2024-09-12T16:44:01.479 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T16:44:01.502 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T16:44:01.591 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902695 branch: wip-rgw-meta-handlers description: rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} email: null first_in_suite: false job_id: '7902695' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-rgw-meta-handlers ceph: conf: client: debug rgw: 20 debug rgw notification: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw reshard progress judge interval: 10 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 rgw override bucket index max shards: 1 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 lockdep: true osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug objclass: 20 debug osd: 20 debug rocksdb: 4/10 lockdep: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b rgw: compression type: random ec-data-pool: false frontend: beast inline data: false storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 s3 main: RGW11111111111111111 s3 tenant: RGW33333333333333333 force-branch: ceph-master storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rgw-meta-handlers sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b owner: scheduled_cbodley@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 6279 sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b sleep_before_teardown: 0 suite: rgw suite_branch: wip-rgw-meta-handlers suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b targets: smithi016.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIBhD+b7GMceAXINIDKeamDSffskdFZ48f4juY/QzsmgBtufRoeNYJlfkw127Il5PlNjqwui02clHZXt+Ol49WA= smithi019.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJcYaOgMdpI1ansrczjZ69fzlLmZT2Po9KC5yBFHow8JchqIiXiFuAZSf28p4wwh1sPdSaYpFVv4IyWb0EivN1k= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-12_15:39:52 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T16:44:01.592 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa; will attempt to use it 2024-09-12T16:44:01.593 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa/tasks 2024-09-12T16:44:01.593 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T16:44:01.594 INFO:teuthology.task.internal:Checking packages... 2024-09-12T16:44:01.616 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'bad475c18c96ec20c5778159aa33ba72b84e9c1b' 2024-09-12T16:44:01.616 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T16:44:01.616 INFO:teuthology.packaging:ref: None 2024-09-12T16:44:01.617 INFO:teuthology.packaging:tag: None 2024-09-12T16:44:01.617 INFO:teuthology.packaging:branch: wip-rgw-meta-handlers 2024-09-12T16:44:01.617 INFO:teuthology.packaging:sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T16:44:01.617 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-rgw-meta-handlers 2024-09-12T16:44:01.776 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4762-gbad475c1-1jammy 2024-09-12T16:44:01.778 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T16:44:01.787 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T16:44:01.787 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T16:44:01.817 INFO:teuthology.task.internal:Saving configuration 2024-09-12T16:44:01.835 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T16:44:01.844 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T16:44:01.862 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi016.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902695', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 16:38:26.416790', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIMySMQpKCjD1UkTteSEteObc9igN2PAcCRNZ10yggy8a'} 2024-09-12T16:44:01.883 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi019.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902695', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 16:38:26.418156', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIO+b6NzE8gAKcc5PXEIj7bQe7JqcCfUk7ymKHkF0bXp2'} 2024-09-12T16:44:01.883 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T16:44:01.892 INFO:teuthology.task.internal:roles: ubuntu@smithi016.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T16:44:01.893 INFO:teuthology.task.internal:roles: ubuntu@smithi019.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T16:44:01.893 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T16:44:01.955 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f84f6c3f2e0>, signals=[15]) 2024-09-12T16:44:01.955 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T16:44:01.997 INFO:teuthology.task.internal:Opening connections... 2024-09-12T16:44:01.997 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi016.front.sepia.ceph.com 2024-09-12T16:44:01.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:44:02.077 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T16:44:02.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:44:02.160 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T16:44:02.169 DEBUG:teuthology.orchestra.run.smithi016:> uname -m 2024-09-12T16:44:02.174 INFO:teuthology.orchestra.run.smithi016.stdout:x86_64 2024-09-12T16:44:02.174 DEBUG:teuthology.orchestra.run.smithi016:> cat /etc/os-release 2024-09-12T16:44:02.223 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T16:44:02.223 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="Ubuntu" 2024-09-12T16:44:02.223 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="22.04" 2024-09-12T16:44:02.223 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T16:44:02.223 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_CODENAME=jammy 2024-09-12T16:44:02.223 INFO:teuthology.orchestra.run.smithi016.stdout:ID=ubuntu 2024-09-12T16:44:02.223 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE=debian 2024-09-12T16:44:02.224 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T16:44:02.224 INFO:teuthology.orchestra.run.smithi016.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T16:44:02.224 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T16:44:02.224 INFO:teuthology.orchestra.run.smithi016.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T16:44:02.224 INFO:teuthology.orchestra.run.smithi016.stdout:UBUNTU_CODENAME=jammy 2024-09-12T16:44:02.224 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2024-09-12T16:44:02.244 DEBUG:teuthology.orchestra.run.smithi019:> uname -m 2024-09-12T16:44:02.249 INFO:teuthology.orchestra.run.smithi019.stdout:x86_64 2024-09-12T16:44:02.249 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release 2024-09-12T16:44:02.294 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T16:44:02.295 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="Ubuntu" 2024-09-12T16:44:02.295 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="22.04" 2024-09-12T16:44:02.295 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T16:44:02.295 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_CODENAME=jammy 2024-09-12T16:44:02.295 INFO:teuthology.orchestra.run.smithi019.stdout:ID=ubuntu 2024-09-12T16:44:02.295 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE=debian 2024-09-12T16:44:02.295 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T16:44:02.295 INFO:teuthology.orchestra.run.smithi019.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T16:44:02.295 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T16:44:02.295 INFO:teuthology.orchestra.run.smithi019.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T16:44:02.295 INFO:teuthology.orchestra.run.smithi019.stdout:UBUNTU_CODENAME=jammy 2024-09-12T16:44:02.296 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server 2024-09-12T16:44:02.318 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T16:44:02.329 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T16:44:02.340 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T16:44:02.341 DEBUG:teuthology.orchestra.run.smithi016:> test '!' -e /home/ubuntu/cephtest 2024-09-12T16:44:02.343 DEBUG:teuthology.orchestra.run.smithi019:> test '!' -e /home/ubuntu/cephtest 2024-09-12T16:44:02.347 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T16:44:02.357 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T16:44:02.357 DEBUG:teuthology.orchestra.run.smithi016:> test -z $(ls -A /var/lib/ceph) 2024-09-12T16:44:02.389 DEBUG:teuthology.orchestra.run.smithi019:> test -z $(ls -A /var/lib/ceph) 2024-09-12T16:44:02.404 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T16:44:02.454 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T16:44:02.472 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-12T16:44:02.472 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-12T16:44:02.473 DEBUG:teuthology.orchestra.run.smithi016:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T16:44:02.473 DEBUG:teuthology.orchestra.run.smithi019:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T16:44:02.477 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T16:44:02.478 DEBUG:teuthology.orchestra.run.smithi016:> uname -r 2024-09-12T16:44:02.479 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T16:44:02.479 DEBUG:teuthology.orchestra.run.smithi019:> uname -r 2024-09-12T16:44:02.524 INFO:teuthology.orchestra.run.smithi016.stdout:5.15.0-56-generic 2024-09-12T16:44:02.524 INFO:teuthology.task.kernel:Running kernel on smithi016: 5.15.0-56-generic 2024-09-12T16:44:02.524 DEBUG:teuthology.orchestra.run.smithi016:> sudo apt-get clean 2024-09-12T16:44:02.526 INFO:teuthology.orchestra.run.smithi019.stdout:5.15.0-56-generic 2024-09-12T16:44:02.526 INFO:teuthology.task.kernel:Running kernel on smithi019: 5.15.0-56-generic 2024-09-12T16:44:02.527 DEBUG:teuthology.orchestra.run.smithi019:> sudo apt-get clean 2024-09-12T16:44:02.641 DEBUG:teuthology.orchestra.run.smithi016:> sudo apt-get update 2024-09-12T16:44:02.679 DEBUG:teuthology.orchestra.run.smithi019:> sudo apt-get update 2024-09-12T16:44:02.922 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T16:44:02.923 INFO:teuthology.orchestra.run.smithi016.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T16:44:02.989 INFO:teuthology.orchestra.run.smithi016.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T16:44:03.041 INFO:teuthology.orchestra.run.smithi019.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T16:44:03.048 INFO:teuthology.orchestra.run.smithi019.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T16:44:03.049 INFO:teuthology.orchestra.run.smithi019.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T16:44:03.343 INFO:teuthology.orchestra.run.smithi016.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-12T16:44:03.365 INFO:teuthology.orchestra.run.smithi016.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-12T16:44:03.378 INFO:teuthology.orchestra.run.smithi019.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-12T16:44:03.397 INFO:teuthology.orchestra.run.smithi019.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-12T16:44:03.482 INFO:teuthology.orchestra.run.smithi016.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-12T16:44:03.516 INFO:teuthology.orchestra.run.smithi019.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-12T16:44:03.686 INFO:teuthology.orchestra.run.smithi016.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-12T16:44:03.720 INFO:teuthology.orchestra.run.smithi019.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-12T16:44:03.784 INFO:teuthology.orchestra.run.smithi016.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-12T16:44:03.800 INFO:teuthology.orchestra.run.smithi016.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-12T16:44:03.810 INFO:teuthology.orchestra.run.smithi016.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-12T16:44:03.810 INFO:teuthology.orchestra.run.smithi016.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-12T16:44:03.816 INFO:teuthology.orchestra.run.smithi019.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-12T16:44:03.832 INFO:teuthology.orchestra.run.smithi019.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-12T16:44:03.832 INFO:teuthology.orchestra.run.smithi016.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-12T16:44:03.841 INFO:teuthology.orchestra.run.smithi019.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-12T16:44:03.841 INFO:teuthology.orchestra.run.smithi019.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-12T16:44:03.843 INFO:teuthology.orchestra.run.smithi019.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-12T16:44:03.847 INFO:teuthology.orchestra.run.smithi016.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-12T16:44:03.847 INFO:teuthology.orchestra.run.smithi016.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-12T16:44:03.849 INFO:teuthology.orchestra.run.smithi016.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-12T16:44:03.869 INFO:teuthology.orchestra.run.smithi019.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-12T16:44:03.881 INFO:teuthology.orchestra.run.smithi019.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-12T16:44:03.881 INFO:teuthology.orchestra.run.smithi019.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-12T16:44:03.910 INFO:teuthology.orchestra.run.smithi016.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-12T16:44:03.911 INFO:teuthology.orchestra.run.smithi016.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-12T16:44:03.919 INFO:teuthology.orchestra.run.smithi016.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-12T16:44:03.922 INFO:teuthology.orchestra.run.smithi016.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-12T16:44:03.939 INFO:teuthology.orchestra.run.smithi019.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-12T16:44:03.942 INFO:teuthology.orchestra.run.smithi016.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-12T16:44:03.943 INFO:teuthology.orchestra.run.smithi016.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-12T16:44:03.944 INFO:teuthology.orchestra.run.smithi016.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-12T16:44:03.949 INFO:teuthology.orchestra.run.smithi019.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-12T16:44:03.966 INFO:teuthology.orchestra.run.smithi016.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-12T16:44:03.972 INFO:teuthology.orchestra.run.smithi016.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-12T16:44:03.980 INFO:teuthology.orchestra.run.smithi016.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-12T16:44:03.984 INFO:teuthology.orchestra.run.smithi016.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-12T16:44:03.984 INFO:teuthology.orchestra.run.smithi016.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-12T16:44:03.984 INFO:teuthology.orchestra.run.smithi016.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-12T16:44:03.986 INFO:teuthology.orchestra.run.smithi016.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-12T16:44:03.991 INFO:teuthology.orchestra.run.smithi016.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-12T16:44:03.998 INFO:teuthology.orchestra.run.smithi019.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-12T16:44:03.998 INFO:teuthology.orchestra.run.smithi019.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-12T16:44:03.998 INFO:teuthology.orchestra.run.smithi019.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-12T16:44:03.998 INFO:teuthology.orchestra.run.smithi016.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-12T16:44:03.998 INFO:teuthology.orchestra.run.smithi016.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-12T16:44:03.999 INFO:teuthology.orchestra.run.smithi016.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-12T16:44:04.001 INFO:teuthology.orchestra.run.smithi019.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-12T16:44:04.002 INFO:teuthology.orchestra.run.smithi019.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-12T16:44:04.004 INFO:teuthology.orchestra.run.smithi019.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-12T16:44:04.020 INFO:teuthology.orchestra.run.smithi019.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-12T16:44:04.021 INFO:teuthology.orchestra.run.smithi019.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-12T16:44:04.023 INFO:teuthology.orchestra.run.smithi019.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-12T16:44:04.024 INFO:teuthology.orchestra.run.smithi019.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-12T16:44:04.024 INFO:teuthology.orchestra.run.smithi019.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-12T16:44:04.025 INFO:teuthology.orchestra.run.smithi019.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-12T16:44:04.034 INFO:teuthology.orchestra.run.smithi019.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-12T16:44:04.038 INFO:teuthology.orchestra.run.smithi019.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-12T16:44:04.039 INFO:teuthology.orchestra.run.smithi019.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-12T16:44:04.039 INFO:teuthology.orchestra.run.smithi019.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-12T16:44:04.040 INFO:teuthology.orchestra.run.smithi019.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-12T16:44:04.050 INFO:teuthology.orchestra.run.smithi016.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-12T16:44:04.050 INFO:teuthology.orchestra.run.smithi016.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-12T16:44:04.073 INFO:teuthology.orchestra.run.smithi016.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-12T16:44:04.073 INFO:teuthology.orchestra.run.smithi016.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-12T16:44:04.074 INFO:teuthology.orchestra.run.smithi016.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-12T16:44:04.075 INFO:teuthology.orchestra.run.smithi016.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-12T16:44:04.075 INFO:teuthology.orchestra.run.smithi016.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-12T16:44:04.079 INFO:teuthology.orchestra.run.smithi016.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-12T16:44:04.080 INFO:teuthology.orchestra.run.smithi019.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-12T16:44:04.081 INFO:teuthology.orchestra.run.smithi016.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-12T16:44:04.114 INFO:teuthology.orchestra.run.smithi019.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-12T16:44:04.114 INFO:teuthology.orchestra.run.smithi019.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-12T16:44:04.115 INFO:teuthology.orchestra.run.smithi019.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-12T16:44:04.116 INFO:teuthology.orchestra.run.smithi019.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-12T16:44:04.161 INFO:teuthology.orchestra.run.smithi016.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-12T16:44:04.161 INFO:teuthology.orchestra.run.smithi016.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-12T16:44:04.195 INFO:teuthology.orchestra.run.smithi019.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-12T16:44:04.196 INFO:teuthology.orchestra.run.smithi019.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-12T16:44:04.196 INFO:teuthology.orchestra.run.smithi019.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-12T16:44:04.196 INFO:teuthology.orchestra.run.smithi019.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-12T16:44:04.197 INFO:teuthology.orchestra.run.smithi019.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-12T16:44:10.302 INFO:teuthology.orchestra.run.smithi016.stdout:Fetched 15.8 MB in 3s (5,658 kB/s) 2024-09-12T16:44:10.506 INFO:teuthology.orchestra.run.smithi019.stdout:Fetched 15.8 MB in 3s (5,609 kB/s) 2024-09-12T16:44:11.709 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2024-09-12T16:44:11.727 DEBUG:teuthology.orchestra.run.smithi016:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T16:44:11.792 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2024-09-12T16:44:11.963 INFO:teuthology.orchestra.run.smithi019.stdout:Reading package lists... 2024-09-12T16:44:11.981 DEBUG:teuthology.orchestra.run.smithi019:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T16:44:12.001 INFO:teuthology.orchestra.run.smithi016.stdout:Building dependency tree... 2024-09-12T16:44:12.003 INFO:teuthology.orchestra.run.smithi016.stdout:Reading state information... 2024-09-12T16:44:12.037 INFO:teuthology.orchestra.run.smithi019.stdout:Reading package lists... 2024-09-12T16:44:12.195 INFO:teuthology.orchestra.run.smithi016.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T16:44:12.195 INFO:teuthology.orchestra.run.smithi016.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T16:44:12.195 INFO:teuthology.orchestra.run.smithi016.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T16:44:12.196 INFO:teuthology.orchestra.run.smithi016.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T16:44:12.196 INFO:teuthology.orchestra.run.smithi016.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T16:44:12.196 INFO:teuthology.orchestra.run.smithi016.stdout: python2.7-minimal 2024-09-12T16:44:12.196 INFO:teuthology.orchestra.run.smithi016.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T16:44:12.201 INFO:teuthology.orchestra.run.smithi016.stdout:The following additional packages will be installed: 2024-09-12T16:44:12.201 INFO:teuthology.orchestra.run.smithi016.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T16:44:12.201 INFO:teuthology.orchestra.run.smithi016.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-12T16:44:12.201 INFO:teuthology.orchestra.run.smithi016.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-12T16:44:12.201 INFO:teuthology.orchestra.run.smithi016.stdout:Suggested packages: 2024-09-12T16:44:12.201 INFO:teuthology.orchestra.run.smithi016.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-12T16:44:12.201 INFO:teuthology.orchestra.run.smithi016.stdout:Recommended packages: 2024-09-12T16:44:12.201 INFO:teuthology.orchestra.run.smithi016.stdout: thermald 2024-09-12T16:44:12.241 INFO:teuthology.orchestra.run.smithi016.stdout:The following NEW packages will be installed: 2024-09-12T16:44:12.241 INFO:teuthology.orchestra.run.smithi016.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T16:44:12.241 INFO:teuthology.orchestra.run.smithi016.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-12T16:44:12.242 INFO:teuthology.orchestra.run.smithi016.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-12T16:44:12.243 INFO:teuthology.orchestra.run.smithi016.stdout:The following packages will be upgraded: 2024-09-12T16:44:12.243 INFO:teuthology.orchestra.run.smithi016.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-12T16:44:12.246 INFO:teuthology.orchestra.run.smithi019.stdout:Building dependency tree... 2024-09-12T16:44:12.247 INFO:teuthology.orchestra.run.smithi019.stdout:Reading state information... 2024-09-12T16:44:12.295 INFO:teuthology.orchestra.run.smithi016.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T16:44:12.295 INFO:teuthology.orchestra.run.smithi016.stdout:Need to get 113 MB of archives. 2024-09-12T16:44:12.295 INFO:teuthology.orchestra.run.smithi016.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-12T16:44:12.295 INFO:teuthology.orchestra.run.smithi016.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-12T16:44:12.420 INFO:teuthology.orchestra.run.smithi019.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T16:44:12.420 INFO:teuthology.orchestra.run.smithi019.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T16:44:12.420 INFO:teuthology.orchestra.run.smithi019.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T16:44:12.420 INFO:teuthology.orchestra.run.smithi019.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T16:44:12.420 INFO:teuthology.orchestra.run.smithi019.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T16:44:12.421 INFO:teuthology.orchestra.run.smithi019.stdout: python2.7-minimal 2024-09-12T16:44:12.421 INFO:teuthology.orchestra.run.smithi019.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T16:44:12.422 INFO:teuthology.orchestra.run.smithi019.stdout:The following additional packages will be installed: 2024-09-12T16:44:12.422 INFO:teuthology.orchestra.run.smithi019.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T16:44:12.422 INFO:teuthology.orchestra.run.smithi019.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-12T16:44:12.422 INFO:teuthology.orchestra.run.smithi019.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-12T16:44:12.423 INFO:teuthology.orchestra.run.smithi019.stdout:Suggested packages: 2024-09-12T16:44:12.423 INFO:teuthology.orchestra.run.smithi019.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-12T16:44:12.423 INFO:teuthology.orchestra.run.smithi019.stdout:Recommended packages: 2024-09-12T16:44:12.424 INFO:teuthology.orchestra.run.smithi019.stdout: thermald 2024-09-12T16:44:12.467 INFO:teuthology.orchestra.run.smithi019.stdout:The following NEW packages will be installed: 2024-09-12T16:44:12.467 INFO:teuthology.orchestra.run.smithi019.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T16:44:12.467 INFO:teuthology.orchestra.run.smithi019.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-12T16:44:12.468 INFO:teuthology.orchestra.run.smithi019.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-12T16:44:12.469 INFO:teuthology.orchestra.run.smithi019.stdout:The following packages will be upgraded: 2024-09-12T16:44:12.469 INFO:teuthology.orchestra.run.smithi019.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-12T16:44:12.649 INFO:teuthology.orchestra.run.smithi019.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T16:44:12.649 INFO:teuthology.orchestra.run.smithi019.stdout:Need to get 113 MB of archives. 2024-09-12T16:44:12.650 INFO:teuthology.orchestra.run.smithi019.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-12T16:44:12.650 INFO:teuthology.orchestra.run.smithi019.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-12T16:44:12.749 INFO:teuthology.orchestra.run.smithi016.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-12T16:44:12.842 INFO:teuthology.orchestra.run.smithi016.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-12T16:44:13.736 INFO:teuthology.orchestra.run.smithi016.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-12T16:44:13.736 INFO:teuthology.orchestra.run.smithi016.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-12T16:44:13.736 INFO:teuthology.orchestra.run.smithi016.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-12T16:44:13.867 INFO:teuthology.orchestra.run.smithi016.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-12T16:44:13.889 INFO:teuthology.orchestra.run.smithi016.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-12T16:44:14.034 INFO:teuthology.orchestra.run.smithi019.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-12T16:44:14.346 INFO:teuthology.orchestra.run.smithi016.stdout:Fetched 113 MB in 2s (69.2 MB/s) 2024-09-12T16:44:14.450 INFO:teuthology.orchestra.run.smithi019.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-12T16:44:14.556 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-12T16:44:16.579 INFO:teuthology.orchestra.run.smithi016.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-12T16:44:16.583 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T16:44:16.645 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:44:16.648 INFO:teuthology.orchestra.run.smithi019.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-12T16:44:16.649 INFO:teuthology.orchestra.run.smithi019.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-12T16:44:16.649 INFO:teuthology.orchestra.run.smithi019.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-12T16:44:17.017 INFO:teuthology.orchestra.run.smithi019.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-12T16:44:17.102 INFO:teuthology.orchestra.run.smithi019.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-12T16:44:17.552 INFO:teuthology.orchestra.run.smithi019.stdout:Fetched 113 MB in 5s (24.5 MB/s) 2024-09-12T16:44:17.704 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-12T16:44:18.763 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-12T16:44:18.785 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T16:44:18.878 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:44:19.375 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-12T16:44:19.396 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T16:44:19.433 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:44:19.677 INFO:teuthology.orchestra.run.smithi019.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-12T16:44:19.681 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T16:44:19.776 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:44:21.960 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-12T16:44:21.982 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T16:44:22.071 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:44:22.497 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-12T16:44:22.517 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T16:44:22.555 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:44:25.942 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T16:44:26.043 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T16:44:26.360 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T16:44:26.488 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T16:44:26.791 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-12T16:44:26.814 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-12T16:44:26.994 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T16:44:29.572 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T16:44:29.690 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T16:44:30.045 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T16:44:30.168 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T16:44:30.430 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-12T16:44:30.453 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-12T16:44:30.488 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T16:44:32.728 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-12T16:44:32.765 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T16:44:32.802 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:44:35.543 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T16:44:35.664 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T16:44:35.998 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T16:44:36.102 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:44:36.203 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-12T16:44:36.324 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:44:36.736 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-12T16:44:36.774 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T16:44:36.811 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:44:37.663 INFO:teuthology.orchestra.run.smithi016.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-12T16:44:37.664 INFO:teuthology.orchestra.run.smithi016.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-12T16:44:37.664 INFO:teuthology.orchestra.run.smithi016.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-12T16:44:37.664 INFO:teuthology.orchestra.run.smithi016.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-12T16:44:37.825 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:44:39.586 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:44:40.682 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T16:44:40.807 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T16:44:40.987 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-12T16:44:41.096 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-12T16:44:41.183 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T16:44:41.222 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:44:41.295 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:44:41.298 INFO:teuthology.orchestra.run.smithi016.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-12T16:44:41.299 INFO:teuthology.orchestra.run.smithi016.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-12T16:44:41.421 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-12T16:44:41.583 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:44:43.012 INFO:teuthology.orchestra.run.smithi019.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-12T16:44:43.012 INFO:teuthology.orchestra.run.smithi019.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-12T16:44:43.012 INFO:teuthology.orchestra.run.smithi019.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-12T16:44:43.012 INFO:teuthology.orchestra.run.smithi019.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-12T16:44:43.160 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:44:45.121 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:44:46.563 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-12T16:44:46.689 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-12T16:44:46.816 INFO:teuthology.orchestra.run.smithi019.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:44:46.887 INFO:teuthology.orchestra.run.smithi019.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-12T16:44:46.887 INFO:teuthology.orchestra.run.smithi019.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-12T16:44:56.206 INFO:teuthology.orchestra.run.smithi016.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-12T16:44:56.206 INFO:teuthology.orchestra.run.smithi016.stdout:Sourcing file `/etc/default/grub' 2024-09-12T16:44:56.218 INFO:teuthology.orchestra.run.smithi016.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T16:44:56.231 INFO:teuthology.orchestra.run.smithi016.stdout:Generating grub configuration file ... 2024-09-12T16:44:56.504 INFO:teuthology.orchestra.run.smithi016.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T16:44:56.530 INFO:teuthology.orchestra.run.smithi016.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T16:44:56.820 INFO:teuthology.orchestra.run.smithi016.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T16:44:56.825 INFO:teuthology.orchestra.run.smithi016.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T16:44:56.893 INFO:teuthology.orchestra.run.smithi016.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T16:44:56.898 INFO:teuthology.orchestra.run.smithi016.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T16:44:57.070 INFO:teuthology.orchestra.run.smithi016.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T16:44:57.070 INFO:teuthology.orchestra.run.smithi016.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T16:44:57.070 INFO:teuthology.orchestra.run.smithi016.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T16:44:57.111 INFO:teuthology.orchestra.run.smithi016.stdout:done 2024-09-12T16:44:57.587 DEBUG:teuthology.orchestra.run.smithi016:> dpkg -s linux-image-generic 2024-09-12T16:44:57.609 INFO:teuthology.orchestra.run.smithi016.stdout:Package: linux-image-generic 2024-09-12T16:44:57.609 INFO:teuthology.orchestra.run.smithi016.stdout:Status: install ok installed 2024-09-12T16:44:57.610 INFO:teuthology.orchestra.run.smithi016.stdout:Priority: optional 2024-09-12T16:44:57.610 INFO:teuthology.orchestra.run.smithi016.stdout:Section: kernel 2024-09-12T16:44:57.610 INFO:teuthology.orchestra.run.smithi016.stdout:Installed-Size: 21 2024-09-12T16:44:57.610 INFO:teuthology.orchestra.run.smithi016.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T16:44:57.610 INFO:teuthology.orchestra.run.smithi016.stdout:Architecture: amd64 2024-09-12T16:44:57.610 INFO:teuthology.orchestra.run.smithi016.stdout:Source: linux-meta 2024-09-12T16:44:57.610 INFO:teuthology.orchestra.run.smithi016.stdout:Version: 5.15.0.119.119 2024-09-12T16:44:57.610 INFO:teuthology.orchestra.run.smithi016.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T16:44:57.610 INFO:teuthology.orchestra.run.smithi016.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T16:44:57.610 INFO:teuthology.orchestra.run.smithi016.stdout:Recommends: thermald 2024-09-12T16:44:57.610 INFO:teuthology.orchestra.run.smithi016.stdout:Description: Generic Linux kernel image 2024-09-12T16:44:57.610 INFO:teuthology.orchestra.run.smithi016.stdout: This package will always depend on the latest generic kernel image 2024-09-12T16:44:57.611 INFO:teuthology.orchestra.run.smithi016.stdout: available. 2024-09-12T16:44:57.611 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-12T16:44:57.611 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T16:44:57.611 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T16:44:57.611 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-12T16:44:57.612 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi016.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T16:44:57.612 DEBUG:teuthology.orchestra.run.smithi016:> sudo apt-get clean 2024-09-12T16:44:57.756 DEBUG:teuthology.orchestra.run.smithi016:> sudo apt-get update 2024-09-12T16:44:57.873 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T16:44:57.885 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T16:44:57.903 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T16:44:57.994 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T16:44:59.278 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2024-09-12T16:44:59.297 DEBUG:teuthology.orchestra.run.smithi016:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T16:44:59.351 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2024-09-12T16:44:59.540 INFO:teuthology.orchestra.run.smithi016.stdout:Building dependency tree... 2024-09-12T16:44:59.541 INFO:teuthology.orchestra.run.smithi016.stdout:Reading state information... 2024-09-12T16:44:59.712 INFO:teuthology.orchestra.run.smithi016.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-12T16:44:59.712 INFO:teuthology.orchestra.run.smithi016.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T16:44:59.712 INFO:teuthology.orchestra.run.smithi016.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T16:44:59.712 INFO:teuthology.orchestra.run.smithi016.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T16:44:59.712 INFO:teuthology.orchestra.run.smithi016.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T16:44:59.713 INFO:teuthology.orchestra.run.smithi016.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T16:44:59.713 INFO:teuthology.orchestra.run.smithi016.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T16:44:59.713 INFO:teuthology.orchestra.run.smithi016.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T16:44:59.753 INFO:teuthology.orchestra.run.smithi016.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T16:44:59.755 DEBUG:teuthology.orchestra.run.smithi016:> dpkg -s linux-image-generic 2024-09-12T16:44:59.818 INFO:teuthology.orchestra.run.smithi016.stdout:Package: linux-image-generic 2024-09-12T16:44:59.819 INFO:teuthology.orchestra.run.smithi016.stdout:Status: install ok installed 2024-09-12T16:44:59.819 INFO:teuthology.orchestra.run.smithi016.stdout:Priority: optional 2024-09-12T16:44:59.819 INFO:teuthology.orchestra.run.smithi016.stdout:Section: kernel 2024-09-12T16:44:59.819 INFO:teuthology.orchestra.run.smithi016.stdout:Installed-Size: 21 2024-09-12T16:44:59.819 INFO:teuthology.orchestra.run.smithi016.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T16:44:59.819 INFO:teuthology.orchestra.run.smithi016.stdout:Architecture: amd64 2024-09-12T16:44:59.819 INFO:teuthology.orchestra.run.smithi016.stdout:Source: linux-meta 2024-09-12T16:44:59.819 INFO:teuthology.orchestra.run.smithi016.stdout:Version: 5.15.0.119.119 2024-09-12T16:44:59.819 INFO:teuthology.orchestra.run.smithi016.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T16:44:59.819 INFO:teuthology.orchestra.run.smithi016.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T16:44:59.819 INFO:teuthology.orchestra.run.smithi016.stdout:Recommends: thermald 2024-09-12T16:44:59.820 INFO:teuthology.orchestra.run.smithi016.stdout:Description: Generic Linux kernel image 2024-09-12T16:44:59.820 INFO:teuthology.orchestra.run.smithi016.stdout: This package will always depend on the latest generic kernel image 2024-09-12T16:44:59.820 INFO:teuthology.orchestra.run.smithi016.stdout: available. 2024-09-12T16:44:59.820 DEBUG:teuthology.orchestra.run.smithi016:> mktemp 2024-09-12T16:44:59.873 INFO:teuthology.orchestra.run.smithi016.stdout:/tmp/tmp.1B2w8H032G 2024-09-12T16:44:59.873 DEBUG:teuthology.orchestra.run.smithi016:> sudo cp /boot/grub/grub.cfg /tmp/tmp.1B2w8H032G 2024-09-12T16:44:59.927 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0666 /tmp/tmp.1B2w8H032G 2024-09-12T16:45:00.044 DEBUG:teuthology.orchestra.remote:smithi016:/tmp/tmp.1B2w8H032G is 10KB 2024-09-12T16:45:00.058 DEBUG:teuthology.orchestra.run.smithi016:> rm -fr /tmp/tmp.1B2w8H032G 2024-09-12T16:45:00.099 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-12T16:45:00.119 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-12T16:45:00.119 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-12T16:45:00.119 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-12T16:45:00.186 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-12T16:45:00.187 DEBUG:teuthology.orchestra.run.smithi016:> sudo update-grub 2024-09-12T16:45:01.438 INFO:teuthology.orchestra.run.smithi016.stderr:Sourcing file `/etc/default/grub' 2024-09-12T16:45:01.439 INFO:teuthology.orchestra.run.smithi016.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T16:45:01.441 INFO:teuthology.orchestra.run.smithi016.stderr:Generating grub configuration file ... 2024-09-12T16:45:01.612 INFO:teuthology.orchestra.run.smithi016.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T16:45:01.617 INFO:teuthology.orchestra.run.smithi016.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T16:45:01.803 INFO:teuthology.orchestra.run.smithi019.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-12T16:45:01.803 INFO:teuthology.orchestra.run.smithi019.stdout:Sourcing file `/etc/default/grub' 2024-09-12T16:45:01.829 INFO:teuthology.orchestra.run.smithi019.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T16:45:01.852 INFO:teuthology.orchestra.run.smithi019.stdout:Generating grub configuration file ... 2024-09-12T16:45:02.107 INFO:teuthology.orchestra.run.smithi016.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T16:45:02.113 INFO:teuthology.orchestra.run.smithi016.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T16:45:02.122 INFO:teuthology.orchestra.run.smithi019.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T16:45:02.144 INFO:teuthology.orchestra.run.smithi019.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T16:45:02.159 INFO:teuthology.orchestra.run.smithi016.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T16:45:02.166 INFO:teuthology.orchestra.run.smithi016.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T16:45:02.305 INFO:teuthology.orchestra.run.smithi016.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T16:45:02.305 INFO:teuthology.orchestra.run.smithi016.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T16:45:02.305 INFO:teuthology.orchestra.run.smithi016.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T16:45:02.315 INFO:teuthology.orchestra.run.smithi016.stderr:done 2024-09-12T16:45:02.322 DEBUG:teuthology.orchestra.run.smithi016:> sudo shutdown -r now 2024-09-12T16:45:02.494 INFO:teuthology.orchestra.run.smithi019.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T16:45:02.502 INFO:teuthology.orchestra.run.smithi019.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T16:45:02.580 INFO:teuthology.orchestra.run.smithi019.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T16:45:02.585 INFO:teuthology.orchestra.run.smithi019.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T16:45:02.758 INFO:teuthology.orchestra.run.smithi019.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T16:45:02.758 INFO:teuthology.orchestra.run.smithi019.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T16:45:02.758 INFO:teuthology.orchestra.run.smithi019.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T16:45:02.789 INFO:teuthology.orchestra.run.smithi019.stdout:done 2024-09-12T16:45:03.324 DEBUG:teuthology.orchestra.run.smithi019:> dpkg -s linux-image-generic 2024-09-12T16:45:03.350 INFO:teuthology.orchestra.run.smithi019.stdout:Package: linux-image-generic 2024-09-12T16:45:03.350 INFO:teuthology.orchestra.run.smithi019.stdout:Status: install ok installed 2024-09-12T16:45:03.350 INFO:teuthology.orchestra.run.smithi019.stdout:Priority: optional 2024-09-12T16:45:03.350 INFO:teuthology.orchestra.run.smithi019.stdout:Section: kernel 2024-09-12T16:45:03.350 INFO:teuthology.orchestra.run.smithi019.stdout:Installed-Size: 21 2024-09-12T16:45:03.350 INFO:teuthology.orchestra.run.smithi019.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T16:45:03.351 INFO:teuthology.orchestra.run.smithi019.stdout:Architecture: amd64 2024-09-12T16:45:03.351 INFO:teuthology.orchestra.run.smithi019.stdout:Source: linux-meta 2024-09-12T16:45:03.351 INFO:teuthology.orchestra.run.smithi019.stdout:Version: 5.15.0.119.119 2024-09-12T16:45:03.351 INFO:teuthology.orchestra.run.smithi019.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T16:45:03.351 INFO:teuthology.orchestra.run.smithi019.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T16:45:03.351 INFO:teuthology.orchestra.run.smithi019.stdout:Recommends: thermald 2024-09-12T16:45:03.351 INFO:teuthology.orchestra.run.smithi019.stdout:Description: Generic Linux kernel image 2024-09-12T16:45:03.351 INFO:teuthology.orchestra.run.smithi019.stdout: This package will always depend on the latest generic kernel image 2024-09-12T16:45:03.351 INFO:teuthology.orchestra.run.smithi019.stdout: available. 2024-09-12T16:45:03.352 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-12T16:45:03.352 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T16:45:03.352 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T16:45:03.352 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-12T16:45:03.352 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi019.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T16:45:03.353 DEBUG:teuthology.orchestra.run.smithi019:> sudo apt-get clean 2024-09-12T16:45:03.519 DEBUG:teuthology.orchestra.run.smithi019:> sudo apt-get update 2024-09-12T16:45:03.633 INFO:teuthology.orchestra.run.smithi019.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T16:45:03.644 INFO:teuthology.orchestra.run.smithi019.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T16:45:03.664 INFO:teuthology.orchestra.run.smithi019.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T16:45:03.757 INFO:teuthology.orchestra.run.smithi019.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T16:45:05.109 INFO:teuthology.orchestra.run.smithi019.stdout:Reading package lists... 2024-09-12T16:45:05.128 DEBUG:teuthology.orchestra.run.smithi019:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T16:45:05.182 INFO:teuthology.orchestra.run.smithi019.stdout:Reading package lists... 2024-09-12T16:45:05.381 INFO:teuthology.orchestra.run.smithi019.stdout:Building dependency tree... 2024-09-12T16:45:05.382 INFO:teuthology.orchestra.run.smithi019.stdout:Reading state information... 2024-09-12T16:45:05.554 INFO:teuthology.orchestra.run.smithi019.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-12T16:45:05.555 INFO:teuthology.orchestra.run.smithi019.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T16:45:05.555 INFO:teuthology.orchestra.run.smithi019.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T16:45:05.555 INFO:teuthology.orchestra.run.smithi019.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T16:45:05.555 INFO:teuthology.orchestra.run.smithi019.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T16:45:05.555 INFO:teuthology.orchestra.run.smithi019.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T16:45:05.555 INFO:teuthology.orchestra.run.smithi019.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T16:45:05.556 INFO:teuthology.orchestra.run.smithi019.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T16:45:05.597 INFO:teuthology.orchestra.run.smithi019.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T16:45:05.598 DEBUG:teuthology.orchestra.run.smithi019:> dpkg -s linux-image-generic 2024-09-12T16:45:05.657 INFO:teuthology.orchestra.run.smithi019.stdout:Package: linux-image-generic 2024-09-12T16:45:05.658 INFO:teuthology.orchestra.run.smithi019.stdout:Status: install ok installed 2024-09-12T16:45:05.658 INFO:teuthology.orchestra.run.smithi019.stdout:Priority: optional 2024-09-12T16:45:05.658 INFO:teuthology.orchestra.run.smithi019.stdout:Section: kernel 2024-09-12T16:45:05.658 INFO:teuthology.orchestra.run.smithi019.stdout:Installed-Size: 21 2024-09-12T16:45:05.658 INFO:teuthology.orchestra.run.smithi019.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T16:45:05.658 INFO:teuthology.orchestra.run.smithi019.stdout:Architecture: amd64 2024-09-12T16:45:05.658 INFO:teuthology.orchestra.run.smithi019.stdout:Source: linux-meta 2024-09-12T16:45:05.658 INFO:teuthology.orchestra.run.smithi019.stdout:Version: 5.15.0.119.119 2024-09-12T16:45:05.658 INFO:teuthology.orchestra.run.smithi019.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T16:45:05.658 INFO:teuthology.orchestra.run.smithi019.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T16:45:05.658 INFO:teuthology.orchestra.run.smithi019.stdout:Recommends: thermald 2024-09-12T16:45:05.659 INFO:teuthology.orchestra.run.smithi019.stdout:Description: Generic Linux kernel image 2024-09-12T16:45:05.659 INFO:teuthology.orchestra.run.smithi019.stdout: This package will always depend on the latest generic kernel image 2024-09-12T16:45:05.659 INFO:teuthology.orchestra.run.smithi019.stdout: available. 2024-09-12T16:45:05.659 DEBUG:teuthology.orchestra.run.smithi019:> mktemp 2024-09-12T16:45:05.706 INFO:teuthology.orchestra.run.smithi019.stdout:/tmp/tmp.bgkTXhekHm 2024-09-12T16:45:05.706 DEBUG:teuthology.orchestra.run.smithi019:> sudo cp /boot/grub/grub.cfg /tmp/tmp.bgkTXhekHm 2024-09-12T16:45:05.761 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0666 /tmp/tmp.bgkTXhekHm 2024-09-12T16:45:05.878 DEBUG:teuthology.orchestra.remote:smithi019:/tmp/tmp.bgkTXhekHm is 10KB 2024-09-12T16:45:05.891 DEBUG:teuthology.orchestra.run.smithi019:> rm -fr /tmp/tmp.bgkTXhekHm 2024-09-12T16:45:05.896 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-12T16:45:05.949 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T16:45:05.949 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-12T16:45:05.949 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-12T16:45:06.013 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-12T16:45:06.014 DEBUG:teuthology.orchestra.run.smithi019:> sudo update-grub 2024-09-12T16:45:07.214 INFO:teuthology.orchestra.run.smithi019.stderr:Sourcing file `/etc/default/grub' 2024-09-12T16:45:07.215 INFO:teuthology.orchestra.run.smithi019.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T16:45:07.217 INFO:teuthology.orchestra.run.smithi019.stderr:Generating grub configuration file ... 2024-09-12T16:45:07.472 INFO:teuthology.orchestra.run.smithi019.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T16:45:07.478 INFO:teuthology.orchestra.run.smithi019.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T16:45:07.701 INFO:teuthology.orchestra.run.smithi019.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T16:45:07.706 INFO:teuthology.orchestra.run.smithi019.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T16:45:07.748 INFO:teuthology.orchestra.run.smithi019.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T16:45:07.752 INFO:teuthology.orchestra.run.smithi019.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T16:45:07.862 INFO:teuthology.orchestra.run.smithi019.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T16:45:07.862 INFO:teuthology.orchestra.run.smithi019.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T16:45:07.862 INFO:teuthology.orchestra.run.smithi019.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T16:45:07.893 INFO:teuthology.orchestra.run.smithi019.stderr:done 2024-09-12T16:45:07.895 DEBUG:teuthology.orchestra.run.smithi019:> sudo shutdown -r now 2024-09-12T16:45:32.393 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-12T16:45:32.394 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-09-12T16:45:32.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:45:37.903 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-12T16:45:37.903 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-12T16:45:37.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:46:32.453 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T16:46:37.911 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T16:46:41.456 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-09-12T16:46:41.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:46:46.917 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-12T16:46:46.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:46:49.493 DEBUG:teuthology.orchestra.run.smithi016:> true 2024-09-12T16:46:49.949 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.19 2024-09-12T16:46:50.301 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-09-12T16:46:50.301 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-119-generic"... 2024-09-12T16:46:50.301 DEBUG:teuthology.orchestra.run.smithi016:> uname -r 2024-09-12T16:46:50.307 INFO:teuthology.orchestra.run.smithi016.stdout:5.15.0-119-generic 2024-09-12T16:46:50.307 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-12T16:46:50.307 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T16:46:50.307 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T16:46:51.308 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-12T16:46:51.308 DEBUG:teuthology.orchestra.run.smithi016:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T16:46:51.611 INFO:teuthology.orchestra.run.smithi016.stdout:ttyS1 2024-09-12T16:46:51.647 DEBUG:teuthology.parallel:result is None 2024-09-12T16:47:01.950 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-12T16:47:01.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:47:02.217 DEBUG:teuthology.orchestra.run.smithi019:> true 2024-09-12T16:47:02.905 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-12T16:47:02.905 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-119-generic"... 2024-09-12T16:47:02.905 DEBUG:teuthology.orchestra.run.smithi019:> uname -r 2024-09-12T16:47:02.953 INFO:teuthology.orchestra.run.smithi019.stdout:5.15.0-119-generic 2024-09-12T16:47:02.953 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-12T16:47:02.953 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T16:47:02.953 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T16:47:03.954 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-12T16:47:03.955 DEBUG:teuthology.orchestra.run.smithi019:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T16:47:04.031 INFO:teuthology.orchestra.run.smithi019.stdout:ttyS1 2024-09-12T16:47:04.070 DEBUG:teuthology.parallel:result is None 2024-09-12T16:47:04.071 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T16:47:04.083 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T16:47:04.084 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T16:47:04.086 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T16:47:04.092 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T16:47:04.102 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T16:47:04.112 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T16:47:04.112 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T16:47:04.134 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T16:47:04.151 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T16:47:04.157 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T16:47:04.158 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T16:47:04.190 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T16:47:04.205 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T16:47:04.209 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T16:47:04.214 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T16:47:04.218 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T16:47:04.219 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T16:47:04.226 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T16:47:04.226 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T16:47:04.262 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T16:47:04.276 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T16:47:04.286 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T16:47:04.286 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T16:47:04.318 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T16:47:04.325 DEBUG:teuthology.orchestra.run.smithi016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T16:47:04.369 DEBUG:teuthology.orchestra.run.smithi016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T16:47:04.418 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-12T16:47:04.418 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T16:47:04.494 DEBUG:teuthology.orchestra.run.smithi019:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T16:47:04.501 DEBUG:teuthology.orchestra.run.smithi019:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T16:47:04.549 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T16:47:04.549 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T16:47:04.609 DEBUG:teuthology.orchestra.run.smithi016:> sudo service rsyslog restart 2024-09-12T16:47:04.611 DEBUG:teuthology.orchestra.run.smithi019:> sudo service rsyslog restart 2024-09-12T16:47:04.686 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T16:47:04.693 INFO:teuthology.task.internal:Starting timer... 2024-09-12T16:47:04.694 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T16:47:04.712 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T16:47:04.725 DEBUG:teuthology.task.selinux:Excluding smithi016: OS 'ubuntu' does not support SELinux 2024-09-12T16:47:04.725 DEBUG:teuthology.task.selinux:Excluding smithi019: OS 'ubuntu' does not support SELinux 2024-09-12T16:47:04.725 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T16:47:04.726 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-12T16:47:04.726 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T16:47:04.726 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T16:47:04.737 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T16:47:04.749 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T16:47:04.750 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi016.front.sepia.ceph.com,smithi019.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T16:54:46.974 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi016.front.sepia.ceph.com'), Remote(name='ubuntu@smithi019.front.sepia.ceph.com')] 2024-09-12T16:54:46.998 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-09-12T16:54:47.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:54:47.083 DEBUG:teuthology.orchestra.run.smithi016:> true 2024-09-12T16:54:47.161 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-09-12T16:54:47.161 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-12T16:54:47.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:54:47.249 DEBUG:teuthology.orchestra.run.smithi019:> true 2024-09-12T16:54:47.325 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-12T16:54:47.325 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T16:54:47.335 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T16:54:47.336 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T16:54:47.336 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T16:54:47.339 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T16:54:47.339 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T16:54:47.367 INFO:teuthology.orchestra.run.smithi016.stdout:12 Sep 16:54:47 ntpd[18360]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T16:54:47.367 INFO:teuthology.orchestra.run.smithi016.stdout:12 Sep 16:54:47 ntpd[18360]: Command line: ntpd -gq 2024-09-12T16:54:47.367 INFO:teuthology.orchestra.run.smithi016.stdout:12 Sep 16:54:47 ntpd[18360]: ---------------------------------------------------- 2024-09-12T16:54:47.367 INFO:teuthology.orchestra.run.smithi016.stdout:12 Sep 16:54:47 ntpd[18360]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T16:54:47.367 INFO:teuthology.orchestra.run.smithi016.stdout:12 Sep 16:54:47 ntpd[18360]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T16:54:47.367 INFO:teuthology.orchestra.run.smithi016.stdout:12 Sep 16:54:47 ntpd[18360]: corporation. Support and training for ntp-4 are 2024-09-12T16:54:47.367 INFO:teuthology.orchestra.run.smithi016.stdout:12 Sep 16:54:47 ntpd[18360]: available at https://www.nwtime.org/support 2024-09-12T16:54:47.367 INFO:teuthology.orchestra.run.smithi016.stdout:12 Sep 16:54:47 ntpd[18360]: ---------------------------------------------------- 2024-09-12T16:54:47.368 INFO:teuthology.orchestra.run.smithi016.stdout:12 Sep 16:54:47 ntpd[18360]: proto: precision = 0.047 usec (-24) 2024-09-12T16:54:47.369 INFO:teuthology.orchestra.run.smithi016.stdout:12 Sep 16:54:47 ntpd[18360]: basedate set to 2022-02-04 2024-09-12T16:54:47.369 INFO:teuthology.orchestra.run.smithi016.stdout:12 Sep 16:54:47 ntpd[18360]: gps base set to 2022-02-06 (week 2196) 2024-09-12T16:54:47.369 INFO:teuthology.orchestra.run.smithi016.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T16:54:47.369 INFO:teuthology.orchestra.run.smithi016.stdout:12 Sep 16:54:47 ntpd[18360]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T16:54:47.369 INFO:teuthology.orchestra.run.smithi016.stdout:12 Sep 16:54:47 ntpd[18360]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T16:54:47.370 INFO:teuthology.orchestra.run.smithi016.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T16:54:47.371 INFO:teuthology.orchestra.run.smithi016.stdout:12 Sep 16:54:47 ntpd[18360]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T16:54:47.371 INFO:teuthology.orchestra.run.smithi016.stdout:12 Sep 16:54:47 ntpd[18360]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T16:54:47.371 INFO:teuthology.orchestra.run.smithi016.stdout:12 Sep 16:54:47 ntpd[18360]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T16:54:47.371 INFO:teuthology.orchestra.run.smithi016.stdout:12 Sep 16:54:47 ntpd[18360]: Listen normally on 3 ens1f0 172.21.15.16:123 2024-09-12T16:54:47.371 INFO:teuthology.orchestra.run.smithi016.stdout:12 Sep 16:54:47 ntpd[18360]: Listen normally on 4 lo [::1]:123 2024-09-12T16:54:47.371 INFO:teuthology.orchestra.run.smithi016.stdout:12 Sep 16:54:47 ntpd[18360]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1564%4]:123 2024-09-12T16:54:47.371 INFO:teuthology.orchestra.run.smithi016.stdout:12 Sep 16:54:47 ntpd[18360]: Listening on routing socket on fd #22 for interface updates 2024-09-12T16:54:47.396 INFO:teuthology.orchestra.run.smithi019.stdout:12 Sep 16:54:47 ntpd[18386]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T16:54:47.396 INFO:teuthology.orchestra.run.smithi019.stdout:12 Sep 16:54:47 ntpd[18386]: Command line: ntpd -gq 2024-09-12T16:54:47.397 INFO:teuthology.orchestra.run.smithi019.stdout:12 Sep 16:54:47 ntpd[18386]: ---------------------------------------------------- 2024-09-12T16:54:47.397 INFO:teuthology.orchestra.run.smithi019.stdout:12 Sep 16:54:47 ntpd[18386]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T16:54:47.397 INFO:teuthology.orchestra.run.smithi019.stdout:12 Sep 16:54:47 ntpd[18386]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T16:54:47.397 INFO:teuthology.orchestra.run.smithi019.stdout:12 Sep 16:54:47 ntpd[18386]: corporation. Support and training for ntp-4 are 2024-09-12T16:54:47.397 INFO:teuthology.orchestra.run.smithi019.stdout:12 Sep 16:54:47 ntpd[18386]: available at https://www.nwtime.org/support 2024-09-12T16:54:47.397 INFO:teuthology.orchestra.run.smithi019.stdout:12 Sep 16:54:47 ntpd[18386]: ---------------------------------------------------- 2024-09-12T16:54:47.398 INFO:teuthology.orchestra.run.smithi019.stdout:12 Sep 16:54:47 ntpd[18386]: proto: precision = 0.045 usec (-24) 2024-09-12T16:54:47.398 INFO:teuthology.orchestra.run.smithi019.stdout:12 Sep 16:54:47 ntpd[18386]: basedate set to 2022-02-04 2024-09-12T16:54:47.398 INFO:teuthology.orchestra.run.smithi019.stdout:12 Sep 16:54:47 ntpd[18386]: gps base set to 2022-02-06 (week 2196) 2024-09-12T16:54:47.398 INFO:teuthology.orchestra.run.smithi019.stdout:12 Sep 16:54:47 ntpd[18386]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T16:54:47.398 INFO:teuthology.orchestra.run.smithi019.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T16:54:47.399 INFO:teuthology.orchestra.run.smithi019.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T16:54:47.400 INFO:teuthology.orchestra.run.smithi019.stdout:12 Sep 16:54:47 ntpd[18386]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T16:54:47.400 INFO:teuthology.orchestra.run.smithi019.stdout:12 Sep 16:54:47 ntpd[18386]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T16:54:47.400 INFO:teuthology.orchestra.run.smithi019.stdout:12 Sep 16:54:47 ntpd[18386]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T16:54:47.400 INFO:teuthology.orchestra.run.smithi019.stdout:12 Sep 16:54:47 ntpd[18386]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T16:54:47.400 INFO:teuthology.orchestra.run.smithi019.stdout:12 Sep 16:54:47 ntpd[18386]: Listen normally on 3 ens1f0 172.21.15.19:123 2024-09-12T16:54:47.400 INFO:teuthology.orchestra.run.smithi019.stdout:12 Sep 16:54:47 ntpd[18386]: Listen normally on 4 lo [::1]:123 2024-09-12T16:54:47.400 INFO:teuthology.orchestra.run.smithi019.stdout:12 Sep 16:54:47 ntpd[18386]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:161e%4]:123 2024-09-12T16:54:47.401 INFO:teuthology.orchestra.run.smithi019.stdout:12 Sep 16:54:47 ntpd[18386]: Listening on routing socket on fd #22 for interface updates 2024-09-12T16:54:48.368 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:48 ntpd[18360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:54:48.368 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:48 ntpd[18360]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:54:48.368 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:48 ntpd[18360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:54:48.368 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:48 ntpd[18360]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:54:48.368 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:48 ntpd[18360]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T16:54:48.368 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:48 ntpd[18360]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T16:54:48.397 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:48 ntpd[18386]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:54:48.397 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:48 ntpd[18386]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:54:48.398 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:48 ntpd[18386]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:54:48.398 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:48 ntpd[18386]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:54:48.398 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:48 ntpd[18386]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:54:48.398 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:48 ntpd[18386]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:54:48.398 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:48 ntpd[18386]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T16:54:48.398 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:48 ntpd[18386]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T16:54:50.369 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:50 ntpd[18360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:54:50.369 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:50 ntpd[18360]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:54:50.369 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:50 ntpd[18360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:54:50.369 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:50 ntpd[18360]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:54:50.369 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:50 ntpd[18360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:54:50.369 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:50 ntpd[18360]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:54:50.369 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:50 ntpd[18360]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T16:54:50.369 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:50 ntpd[18360]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T16:54:50.369 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:50 ntpd[18360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:54:50.369 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:50 ntpd[18360]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:54:50.370 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:50 ntpd[18360]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T16:54:50.370 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:50 ntpd[18360]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T16:54:50.397 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:50 ntpd[18386]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:54:50.397 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:50 ntpd[18386]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:54:50.397 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:50 ntpd[18386]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:54:50.397 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:50 ntpd[18386]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:54:50.397 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:50 ntpd[18386]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T16:54:50.397 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:50 ntpd[18386]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T16:54:51.368 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:51 ntpd[18360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:54:51.369 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:51 ntpd[18360]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:54:51.369 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:51 ntpd[18360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:54:51.369 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:51 ntpd[18360]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:54:51.369 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:51 ntpd[18360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:54:51.369 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:51 ntpd[18360]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:54:51.370 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:51 ntpd[18360]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T16:54:51.370 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:51 ntpd[18360]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T16:54:52.369 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:52 ntpd[18360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:54:52.369 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:52 ntpd[18360]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:54:52.369 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:52 ntpd[18360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:54:52.369 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:52 ntpd[18360]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:54:52.369 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:52 ntpd[18360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:54:52.369 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:52 ntpd[18360]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:54:52.369 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:52 ntpd[18360]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T16:54:52.369 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:52 ntpd[18360]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T16:54:52.369 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:52 ntpd[18360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:54:52.370 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:52 ntpd[18360]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:54:52.370 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:52 ntpd[18360]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T16:54:52.370 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:52 ntpd[18360]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T16:54:52.399 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:52 ntpd[18386]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:54:52.399 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:52 ntpd[18386]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:54:52.399 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:52 ntpd[18386]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:54:52.399 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:52 ntpd[18386]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:54:52.399 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:52 ntpd[18386]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:54:52.399 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:52 ntpd[18386]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:54:52.399 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:52 ntpd[18386]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:54:52.399 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:52 ntpd[18386]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:54:52.399 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:52 ntpd[18386]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T16:54:52.399 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:52 ntpd[18386]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T16:54:52.399 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:52 ntpd[18386]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:54:52.400 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:52 ntpd[18386]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:54:52.400 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:52 ntpd[18386]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T16:54:52.400 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:52 ntpd[18386]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T16:54:52.400 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:52 ntpd[18386]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:54:52.400 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:52 ntpd[18386]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:54:52.400 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:52 ntpd[18386]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T16:54:52.400 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:52 ntpd[18386]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T16:54:53.368 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:53 ntpd[18360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:54:53.368 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:53 ntpd[18360]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:54:53.368 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:53 ntpd[18360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:54:53.368 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:53 ntpd[18360]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:54:53.368 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:53 ntpd[18360]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T16:54:53.368 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:53 ntpd[18360]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T16:54:54.368 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:54 ntpd[18360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:54:54.369 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:54 ntpd[18360]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:54:54.369 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:54 ntpd[18360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:54:54.369 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:54 ntpd[18360]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:54:54.369 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:54 ntpd[18360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:54:54.369 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:54 ntpd[18360]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:54:54.369 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:54 ntpd[18360]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T16:54:54.369 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:54 ntpd[18360]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T16:54:54.370 INFO:teuthology.orchestra.run.smithi016.stdout:12 Sep 16:54:54 ntpd[18360]: ntpd: time slew -0.000358 s 2024-09-12T16:54:54.370 INFO:teuthology.orchestra.run.smithi016.stdout:ntpd: time slew -0.000358s 2024-09-12T16:54:54.370 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:54 ntpd[18360]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T16:54:54.371 INFO:teuthology.orchestra.run.smithi016.stderr:12 Sep 16:54:54 ntpd[18360]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T16:54:54.399 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:54 ntpd[18386]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:54:54.400 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:54 ntpd[18386]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:54:54.400 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:54 ntpd[18386]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:54:54.400 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:54 ntpd[18386]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:54:54.400 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:54 ntpd[18386]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:54:54.400 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:54 ntpd[18386]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:54:54.400 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:54 ntpd[18386]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:54:54.401 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:54 ntpd[18386]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:54:54.401 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:54 ntpd[18386]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T16:54:54.401 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:54 ntpd[18386]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T16:54:54.401 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:54 ntpd[18386]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T16:54:54.402 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:54 ntpd[18386]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T16:54:54.402 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:54 ntpd[18386]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T16:54:54.402 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:54 ntpd[18386]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T16:54:54.409 INFO:teuthology.orchestra.run.smithi019.stdout:12 Sep 16:54:54 ntpd[18386]: ntpd: time slew -0.000280 s 2024-09-12T16:54:54.409 INFO:teuthology.orchestra.run.smithi019.stdout:ntpd: time slew -0.000280s 2024-09-12T16:54:54.410 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:54 ntpd[18386]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T16:54:54.410 INFO:teuthology.orchestra.run.smithi019.stderr:12 Sep 16:54:54 ntpd[18386]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T16:54:54.424 INFO:teuthology.orchestra.run.smithi016.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T16:54:54.424 INFO:teuthology.orchestra.run.smithi016.stdout:============================================================================== 2024-09-12T16:54:54.424 INFO:teuthology.orchestra.run.smithi016.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T16:54:54.424 INFO:teuthology.orchestra.run.smithi016.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T16:54:54.424 INFO:teuthology.orchestra.run.smithi016.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T16:54:54.424 INFO:teuthology.orchestra.run.smithi016.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T16:54:54.446 INFO:teuthology.orchestra.run.smithi019.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T16:54:54.446 INFO:teuthology.orchestra.run.smithi019.stdout:============================================================================== 2024-09-12T16:54:54.446 INFO:teuthology.orchestra.run.smithi019.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T16:54:54.447 INFO:teuthology.orchestra.run.smithi019.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T16:54:54.447 INFO:teuthology.orchestra.run.smithi019.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T16:54:54.447 INFO:teuthology.orchestra.run.smithi019.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T16:54:54.448 INFO:teuthology.run_tasks:Running task install... 2024-09-12T16:54:54.460 DEBUG:teuthology.task.install:project ceph 2024-09-12T16:54:54.460 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}} 2024-09-12T16:54:54.460 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'} 2024-09-12T16:54:54.460 INFO:teuthology.task.install:Using flavor: default 2024-09-12T16:54:54.466 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T16:54:54.466 INFO:teuthology.task.install:extra packages: [] 2024-09-12T16:54:54.467 DEBUG:teuthology.orchestra.run.smithi016:> sudo apt-key list | grep Ceph 2024-09-12T16:54:54.467 DEBUG:teuthology.orchestra.run.smithi019:> sudo apt-key list | grep Ceph 2024-09-12T16:54:54.528 INFO:teuthology.orchestra.run.smithi016.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T16:54:54.552 INFO:teuthology.orchestra.run.smithi019.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T16:54:54.555 INFO:teuthology.orchestra.run.smithi016.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T16:54:54.555 INFO:teuthology.orchestra.run.smithi016.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T16:54:54.555 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T16:54:54.556 INFO:teuthology.task.install.deb:Installing system (non-project) packages: s3cmd, maven on remote deb x86_64 2024-09-12T16:54:54.556 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T16:54:54.581 INFO:teuthology.orchestra.run.smithi019.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T16:54:54.581 INFO:teuthology.orchestra.run.smithi019.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T16:54:54.581 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T16:54:54.581 INFO:teuthology.task.install.deb:Installing system (non-project) packages: s3cmd, maven on remote deb x86_64 2024-09-12T16:54:54.582 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T16:54:54.731 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default/ 2024-09-12T16:54:54.732 INFO:teuthology.task.install.deb:Package version is 19.3.0-4762-gbad475c1-1jammy 2024-09-12T16:54:54.741 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default/ 2024-09-12T16:54:54.741 INFO:teuthology.task.install.deb:Package version is 19.3.0-4762-gbad475c1-1jammy 2024-09-12T16:54:54.852 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-12T16:54:54.853 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T16:54:54.865 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T16:54:54.865 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T16:54:54.868 DEBUG:teuthology.orchestra.run.smithi016:> sudo apt-get update 2024-09-12T16:54:54.882 DEBUG:teuthology.orchestra.run.smithi019:> sudo apt-get update 2024-09-12T16:54:55.052 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T16:54:55.057 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T16:54:55.060 INFO:teuthology.orchestra.run.smithi019.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T16:54:55.060 INFO:teuthology.orchestra.run.smithi019.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T16:54:55.061 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T16:54:55.070 INFO:teuthology.orchestra.run.smithi019.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T16:54:55.078 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T16:54:55.087 INFO:teuthology.orchestra.run.smithi019.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T16:54:55.095 INFO:teuthology.orchestra.run.smithi016.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T16:54:55.115 INFO:teuthology.orchestra.run.smithi019.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T16:54:55.116 INFO:teuthology.orchestra.run.smithi016.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy Release [7,005 B] 2024-09-12T16:54:55.136 INFO:teuthology.orchestra.run.smithi019.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy Release [7,005 B] 2024-09-12T16:54:55.140 INFO:teuthology.orchestra.run.smithi016.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T16:54:55.158 INFO:teuthology.orchestra.run.smithi019.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T16:54:55.161 INFO:teuthology.orchestra.run.smithi016.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,427 B] 2024-09-12T16:54:55.179 INFO:teuthology.orchestra.run.smithi019.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-12T16:54:55.189 INFO:teuthology.orchestra.run.smithi016.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-12T16:54:55.206 INFO:teuthology.orchestra.run.smithi019.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,427 B] 2024-09-12T16:54:55.429 INFO:teuthology.orchestra.run.smithi019.stdout:Fetched 28.6 kB in 0s (81.4 kB/s) 2024-09-12T16:54:55.453 INFO:teuthology.orchestra.run.smithi016.stdout:Fetched 28.6 kB in 0s (74.7 kB/s) 2024-09-12T16:54:56.470 INFO:teuthology.orchestra.run.smithi019.stdout:Reading package lists... 2024-09-12T16:54:56.487 DEBUG:teuthology.orchestra.run.smithi019:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4762-gbad475c1-1jammy cephadm=19.3.0-4762-gbad475c1-1jammy ceph-mds=19.3.0-4762-gbad475c1-1jammy ceph-mgr=19.3.0-4762-gbad475c1-1jammy ceph-common=19.3.0-4762-gbad475c1-1jammy ceph-fuse=19.3.0-4762-gbad475c1-1jammy ceph-test=19.3.0-4762-gbad475c1-1jammy ceph-volume=19.3.0-4762-gbad475c1-1jammy radosgw=19.3.0-4762-gbad475c1-1jammy python3-rados=19.3.0-4762-gbad475c1-1jammy python3-rgw=19.3.0-4762-gbad475c1-1jammy python3-cephfs=19.3.0-4762-gbad475c1-1jammy python3-rbd=19.3.0-4762-gbad475c1-1jammy libcephfs2=19.3.0-4762-gbad475c1-1jammy libcephfs-dev=19.3.0-4762-gbad475c1-1jammy librados2=19.3.0-4762-gbad475c1-1jammy librbd1=19.3.0-4762-gbad475c1-1jammy rbd-fuse=19.3.0-4762-gbad475c1-1jammy 2024-09-12T16:54:56.498 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2024-09-12T16:54:56.514 DEBUG:teuthology.orchestra.run.smithi016:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4762-gbad475c1-1jammy cephadm=19.3.0-4762-gbad475c1-1jammy ceph-mds=19.3.0-4762-gbad475c1-1jammy ceph-mgr=19.3.0-4762-gbad475c1-1jammy ceph-common=19.3.0-4762-gbad475c1-1jammy ceph-fuse=19.3.0-4762-gbad475c1-1jammy ceph-test=19.3.0-4762-gbad475c1-1jammy ceph-volume=19.3.0-4762-gbad475c1-1jammy radosgw=19.3.0-4762-gbad475c1-1jammy python3-rados=19.3.0-4762-gbad475c1-1jammy python3-rgw=19.3.0-4762-gbad475c1-1jammy python3-cephfs=19.3.0-4762-gbad475c1-1jammy python3-rbd=19.3.0-4762-gbad475c1-1jammy libcephfs2=19.3.0-4762-gbad475c1-1jammy libcephfs-dev=19.3.0-4762-gbad475c1-1jammy librados2=19.3.0-4762-gbad475c1-1jammy librbd1=19.3.0-4762-gbad475c1-1jammy rbd-fuse=19.3.0-4762-gbad475c1-1jammy 2024-09-12T16:54:56.542 INFO:teuthology.orchestra.run.smithi019.stdout:Reading package lists... 2024-09-12T16:54:56.582 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2024-09-12T16:54:56.731 INFO:teuthology.orchestra.run.smithi019.stdout:Building dependency tree... 2024-09-12T16:54:56.732 INFO:teuthology.orchestra.run.smithi019.stdout:Reading state information... 2024-09-12T16:54:56.794 INFO:teuthology.orchestra.run.smithi016.stdout:Building dependency tree... 2024-09-12T16:54:56.795 INFO:teuthology.orchestra.run.smithi016.stdout:Reading state information... 2024-09-12T16:54:56.921 INFO:teuthology.orchestra.run.smithi019.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T16:54:56.921 INFO:teuthology.orchestra.run.smithi019.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T16:54:56.921 INFO:teuthology.orchestra.run.smithi019.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T16:54:56.921 INFO:teuthology.orchestra.run.smithi019.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T16:54:56.922 INFO:teuthology.orchestra.run.smithi019.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T16:54:56.922 INFO:teuthology.orchestra.run.smithi019.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T16:54:56.922 INFO:teuthology.orchestra.run.smithi019.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T16:54:56.924 INFO:teuthology.orchestra.run.smithi019.stdout:The following additional packages will be installed: 2024-09-12T16:54:56.924 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T16:54:56.924 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T16:54:56.924 INFO:teuthology.orchestra.run.smithi019.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T16:54:56.924 INFO:teuthology.orchestra.run.smithi019.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-12T16:54:56.924 INFO:teuthology.orchestra.run.smithi019.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-12T16:54:56.924 INFO:teuthology.orchestra.run.smithi019.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-12T16:54:56.924 INFO:teuthology.orchestra.run.smithi019.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-12T16:54:56.924 INFO:teuthology.orchestra.run.smithi019.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-12T16:54:56.924 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-12T16:54:56.925 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T16:54:56.925 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T16:54:56.925 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T16:54:56.925 INFO:teuthology.orchestra.run.smithi019.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T16:54:56.925 INFO:teuthology.orchestra.run.smithi019.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T16:54:56.925 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T16:54:56.925 INFO:teuthology.orchestra.run.smithi019.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T16:54:56.925 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-12T16:54:56.925 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-12T16:54:56.925 INFO:teuthology.orchestra.run.smithi019.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T16:54:56.925 INFO:teuthology.orchestra.run.smithi019.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T16:54:56.925 INFO:teuthology.orchestra.run.smithi019.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T16:54:56.926 INFO:teuthology.orchestra.run.smithi019.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T16:54:56.926 INFO:teuthology.orchestra.run.smithi019.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T16:54:56.926 INFO:teuthology.orchestra.run.smithi019.stdout: xmlstarlet zip 2024-09-12T16:54:56.926 INFO:teuthology.orchestra.run.smithi019.stdout:Suggested packages: 2024-09-12T16:54:56.926 INFO:teuthology.orchestra.run.smithi019.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T16:54:56.926 INFO:teuthology.orchestra.run.smithi019.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T16:54:56.926 INFO:teuthology.orchestra.run.smithi019.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T16:54:56.926 INFO:teuthology.orchestra.run.smithi019.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T16:54:56.926 INFO:teuthology.orchestra.run.smithi019.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T16:54:56.927 INFO:teuthology.orchestra.run.smithi019.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T16:54:56.927 INFO:teuthology.orchestra.run.smithi019.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T16:54:56.927 INFO:teuthology.orchestra.run.smithi019.stdout:Recommended packages: 2024-09-12T16:54:56.927 INFO:teuthology.orchestra.run.smithi019.stdout: btrfs-tools 2024-09-12T16:54:57.009 INFO:teuthology.orchestra.run.smithi016.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T16:54:57.009 INFO:teuthology.orchestra.run.smithi016.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T16:54:57.009 INFO:teuthology.orchestra.run.smithi016.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T16:54:57.009 INFO:teuthology.orchestra.run.smithi016.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T16:54:57.010 INFO:teuthology.orchestra.run.smithi016.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T16:54:57.010 INFO:teuthology.orchestra.run.smithi016.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T16:54:57.010 INFO:teuthology.orchestra.run.smithi016.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T16:54:57.010 INFO:teuthology.orchestra.run.smithi016.stdout:The following additional packages will be installed: 2024-09-12T16:54:57.011 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T16:54:57.011 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T16:54:57.012 INFO:teuthology.orchestra.run.smithi016.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T16:54:57.012 INFO:teuthology.orchestra.run.smithi016.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-12T16:54:57.012 INFO:teuthology.orchestra.run.smithi016.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-12T16:54:57.012 INFO:teuthology.orchestra.run.smithi016.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-12T16:54:57.012 INFO:teuthology.orchestra.run.smithi016.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-12T16:54:57.012 INFO:teuthology.orchestra.run.smithi016.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-12T16:54:57.012 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-12T16:54:57.012 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T16:54:57.013 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T16:54:57.013 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T16:54:57.013 INFO:teuthology.orchestra.run.smithi016.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T16:54:57.013 INFO:teuthology.orchestra.run.smithi016.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T16:54:57.013 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T16:54:57.013 INFO:teuthology.orchestra.run.smithi016.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T16:54:57.013 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-12T16:54:57.013 INFO:teuthology.orchestra.run.smithi016.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-12T16:54:57.013 INFO:teuthology.orchestra.run.smithi016.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T16:54:57.013 INFO:teuthology.orchestra.run.smithi016.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T16:54:57.013 INFO:teuthology.orchestra.run.smithi016.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T16:54:57.014 INFO:teuthology.orchestra.run.smithi016.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T16:54:57.014 INFO:teuthology.orchestra.run.smithi016.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T16:54:57.014 INFO:teuthology.orchestra.run.smithi016.stdout: xmlstarlet zip 2024-09-12T16:54:57.014 INFO:teuthology.orchestra.run.smithi016.stdout:Suggested packages: 2024-09-12T16:54:57.014 INFO:teuthology.orchestra.run.smithi016.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T16:54:57.014 INFO:teuthology.orchestra.run.smithi016.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T16:54:57.014 INFO:teuthology.orchestra.run.smithi016.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T16:54:57.014 INFO:teuthology.orchestra.run.smithi016.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T16:54:57.015 INFO:teuthology.orchestra.run.smithi016.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T16:54:57.015 INFO:teuthology.orchestra.run.smithi016.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T16:54:57.015 INFO:teuthology.orchestra.run.smithi016.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T16:54:57.015 INFO:teuthology.orchestra.run.smithi016.stdout:Recommended packages: 2024-09-12T16:54:57.015 INFO:teuthology.orchestra.run.smithi016.stdout: btrfs-tools 2024-09-12T16:54:57.032 INFO:teuthology.orchestra.run.smithi019.stdout:The following NEW packages will be installed: 2024-09-12T16:54:57.032 INFO:teuthology.orchestra.run.smithi019.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T16:54:57.032 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T16:54:57.032 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T16:54:57.032 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T16:54:57.032 INFO:teuthology.orchestra.run.smithi019.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-12T16:54:57.032 INFO:teuthology.orchestra.run.smithi019.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T16:54:57.034 INFO:teuthology.orchestra.run.smithi019.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T16:54:57.034 INFO:teuthology.orchestra.run.smithi019.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T16:54:57.034 INFO:teuthology.orchestra.run.smithi019.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T16:54:57.034 INFO:teuthology.orchestra.run.smithi019.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T16:54:57.034 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T16:54:57.034 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T16:54:57.034 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T16:54:57.035 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T16:54:57.035 INFO:teuthology.orchestra.run.smithi019.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T16:54:57.035 INFO:teuthology.orchestra.run.smithi019.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T16:54:57.035 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T16:54:57.035 INFO:teuthology.orchestra.run.smithi019.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T16:54:57.035 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T16:54:57.035 INFO:teuthology.orchestra.run.smithi019.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T16:54:57.035 INFO:teuthology.orchestra.run.smithi019.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T16:54:57.035 INFO:teuthology.orchestra.run.smithi019.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T16:54:57.035 INFO:teuthology.orchestra.run.smithi019.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T16:54:57.035 INFO:teuthology.orchestra.run.smithi019.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T16:54:57.036 INFO:teuthology.orchestra.run.smithi019.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T16:54:57.036 INFO:teuthology.orchestra.run.smithi019.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T16:54:57.094 INFO:teuthology.orchestra.run.smithi019.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T16:54:57.094 INFO:teuthology.orchestra.run.smithi019.stdout:Need to get 243 MB of archives. 2024-09-12T16:54:57.094 INFO:teuthology.orchestra.run.smithi019.stdout:After this operation, 908 MB of additional disk space will be used. 2024-09-12T16:54:57.095 INFO:teuthology.orchestra.run.smithi019.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T16:54:57.124 INFO:teuthology.orchestra.run.smithi016.stdout:The following NEW packages will be installed: 2024-09-12T16:54:57.124 INFO:teuthology.orchestra.run.smithi016.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T16:54:57.124 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T16:54:57.125 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T16:54:57.125 INFO:teuthology.orchestra.run.smithi016.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T16:54:57.125 INFO:teuthology.orchestra.run.smithi016.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-12T16:54:57.125 INFO:teuthology.orchestra.run.smithi016.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T16:54:57.126 INFO:teuthology.orchestra.run.smithi016.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T16:54:57.126 INFO:teuthology.orchestra.run.smithi016.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T16:54:57.126 INFO:teuthology.orchestra.run.smithi016.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T16:54:57.126 INFO:teuthology.orchestra.run.smithi016.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T16:54:57.126 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T16:54:57.126 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T16:54:57.126 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T16:54:57.126 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T16:54:57.127 INFO:teuthology.orchestra.run.smithi016.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T16:54:57.127 INFO:teuthology.orchestra.run.smithi016.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T16:54:57.127 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T16:54:57.127 INFO:teuthology.orchestra.run.smithi016.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T16:54:57.127 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T16:54:57.127 INFO:teuthology.orchestra.run.smithi016.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T16:54:57.127 INFO:teuthology.orchestra.run.smithi016.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T16:54:57.127 INFO:teuthology.orchestra.run.smithi016.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T16:54:57.127 INFO:teuthology.orchestra.run.smithi016.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T16:54:57.127 INFO:teuthology.orchestra.run.smithi016.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T16:54:57.127 INFO:teuthology.orchestra.run.smithi016.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T16:54:57.127 INFO:teuthology.orchestra.run.smithi016.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T16:54:57.178 INFO:teuthology.orchestra.run.smithi019.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4762-gbad475c1-1jammy [3,629 kB] 2024-09-12T16:54:57.182 INFO:teuthology.orchestra.run.smithi019.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T16:54:57.184 INFO:teuthology.orchestra.run.smithi019.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T16:54:57.203 INFO:teuthology.orchestra.run.smithi019.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T16:54:57.259 INFO:teuthology.orchestra.run.smithi019.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T16:54:57.264 INFO:teuthology.orchestra.run.smithi019.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T16:54:57.267 INFO:teuthology.orchestra.run.smithi016.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T16:54:57.267 INFO:teuthology.orchestra.run.smithi016.stdout:Need to get 243 MB of archives. 2024-09-12T16:54:57.267 INFO:teuthology.orchestra.run.smithi016.stdout:After this operation, 908 MB of additional disk space will be used. 2024-09-12T16:54:57.267 INFO:teuthology.orchestra.run.smithi016.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4762-gbad475c1-1jammy [3,629 kB] 2024-09-12T16:54:57.278 INFO:teuthology.orchestra.run.smithi019.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T16:54:57.282 INFO:teuthology.orchestra.run.smithi019.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T16:54:57.283 INFO:teuthology.orchestra.run.smithi019.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T16:54:57.284 INFO:teuthology.orchestra.run.smithi019.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T16:54:57.293 INFO:teuthology.orchestra.run.smithi019.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T16:54:57.295 INFO:teuthology.orchestra.run.smithi019.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T16:54:57.298 INFO:teuthology.orchestra.run.smithi019.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T16:54:57.299 INFO:teuthology.orchestra.run.smithi019.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T16:54:57.299 INFO:teuthology.orchestra.run.smithi019.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T16:54:57.301 INFO:teuthology.orchestra.run.smithi019.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T16:54:57.313 INFO:teuthology.orchestra.run.smithi016.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T16:54:57.316 INFO:teuthology.orchestra.run.smithi019.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T16:54:57.318 INFO:teuthology.orchestra.run.smithi019.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T16:54:57.318 INFO:teuthology.orchestra.run.smithi019.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T16:54:57.319 INFO:teuthology.orchestra.run.smithi019.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T16:54:57.320 INFO:teuthology.orchestra.run.smithi019.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T16:54:57.333 INFO:teuthology.orchestra.run.smithi019.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T16:54:57.334 INFO:teuthology.orchestra.run.smithi019.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T16:54:57.334 INFO:teuthology.orchestra.run.smithi019.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T16:54:57.334 INFO:teuthology.orchestra.run.smithi019.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T16:54:57.335 INFO:teuthology.orchestra.run.smithi019.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T16:54:57.350 INFO:teuthology.orchestra.run.smithi019.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T16:54:57.353 INFO:teuthology.orchestra.run.smithi019.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T16:54:57.353 INFO:teuthology.orchestra.run.smithi019.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T16:54:57.354 INFO:teuthology.orchestra.run.smithi019.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T16:54:57.354 INFO:teuthology.orchestra.run.smithi019.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T16:54:57.369 INFO:teuthology.orchestra.run.smithi019.stdout:Get:33 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4762-gbad475c1-1jammy [3,322 kB] 2024-09-12T16:54:57.369 INFO:teuthology.orchestra.run.smithi019.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T16:54:57.369 INFO:teuthology.orchestra.run.smithi019.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T16:54:57.369 INFO:teuthology.orchestra.run.smithi019.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T16:54:57.370 INFO:teuthology.orchestra.run.smithi019.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T16:54:57.370 INFO:teuthology.orchestra.run.smithi019.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T16:54:57.385 INFO:teuthology.orchestra.run.smithi019.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T16:54:57.390 INFO:teuthology.orchestra.run.smithi019.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T16:54:57.390 INFO:teuthology.orchestra.run.smithi019.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T16:54:57.391 INFO:teuthology.orchestra.run.smithi019.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T16:54:57.391 INFO:teuthology.orchestra.run.smithi019.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T16:54:57.402 INFO:teuthology.orchestra.run.smithi019.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T16:54:57.403 INFO:teuthology.orchestra.run.smithi019.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T16:54:57.404 INFO:teuthology.orchestra.run.smithi019.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T16:54:57.406 INFO:teuthology.orchestra.run.smithi019.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T16:54:57.406 INFO:teuthology.orchestra.run.smithi019.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T16:54:57.419 INFO:teuthology.orchestra.run.smithi019.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T16:54:57.420 INFO:teuthology.orchestra.run.smithi019.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T16:54:57.420 INFO:teuthology.orchestra.run.smithi019.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T16:54:57.423 INFO:teuthology.orchestra.run.smithi019.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T16:54:57.447 INFO:teuthology.orchestra.run.smithi019.stdout:Get:53 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4762-gbad475c1-1jammy [721 kB] 2024-09-12T16:54:57.461 INFO:teuthology.orchestra.run.smithi019.stdout:Get:54 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4762-gbad475c1-1jammy [357 kB] 2024-09-12T16:54:57.477 INFO:teuthology.orchestra.run.smithi019.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T16:54:57.477 INFO:teuthology.orchestra.run.smithi019.stdout:Get:56 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4762-gbad475c1-1jammy [32.8 kB] 2024-09-12T16:54:57.478 INFO:teuthology.orchestra.run.smithi019.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T16:54:57.478 INFO:teuthology.orchestra.run.smithi019.stdout:Get:58 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4762-gbad475c1-1jammy [180 kB] 2024-09-12T16:54:57.479 INFO:teuthology.orchestra.run.smithi019.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T16:54:57.479 INFO:teuthology.orchestra.run.smithi019.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T16:54:57.480 INFO:teuthology.orchestra.run.smithi019.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T16:54:57.481 INFO:teuthology.orchestra.run.smithi019.stdout:Get:62 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4762-gbad475c1-1jammy [71.2 kB] 2024-09-12T16:54:57.482 INFO:teuthology.orchestra.run.smithi019.stdout:Get:63 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4762-gbad475c1-1jammy [338 kB] 2024-09-12T16:54:57.488 INFO:teuthology.orchestra.run.smithi019.stdout:Get:64 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4762-gbad475c1-1jammy [7,972 kB] 2024-09-12T16:54:57.498 INFO:teuthology.orchestra.run.smithi019.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T16:54:57.500 INFO:teuthology.orchestra.run.smithi019.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T16:54:57.500 INFO:teuthology.orchestra.run.smithi019.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T16:54:57.501 INFO:teuthology.orchestra.run.smithi016.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4762-gbad475c1-1jammy [3,322 kB] 2024-09-12T16:54:57.515 INFO:teuthology.orchestra.run.smithi019.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T16:54:57.515 INFO:teuthology.orchestra.run.smithi019.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T16:54:57.515 INFO:teuthology.orchestra.run.smithi019.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T16:54:57.516 INFO:teuthology.orchestra.run.smithi019.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T16:54:57.516 INFO:teuthology.orchestra.run.smithi019.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T16:54:57.516 INFO:teuthology.orchestra.run.smithi019.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T16:54:57.530 INFO:teuthology.orchestra.run.smithi019.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T16:54:57.531 INFO:teuthology.orchestra.run.smithi019.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T16:54:57.534 INFO:teuthology.orchestra.run.smithi019.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T16:54:57.547 INFO:teuthology.orchestra.run.smithi019.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T16:54:57.549 INFO:teuthology.orchestra.run.smithi019.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T16:54:57.550 INFO:teuthology.orchestra.run.smithi019.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T16:54:57.553 INFO:teuthology.orchestra.run.smithi019.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T16:54:57.555 INFO:teuthology.orchestra.run.smithi019.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T16:54:57.556 INFO:teuthology.orchestra.run.smithi019.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T16:54:57.557 INFO:teuthology.orchestra.run.smithi019.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T16:54:57.565 INFO:teuthology.orchestra.run.smithi019.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T16:54:57.565 INFO:teuthology.orchestra.run.smithi019.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T16:54:57.568 INFO:teuthology.orchestra.run.smithi019.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T16:54:57.582 INFO:teuthology.orchestra.run.smithi019.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T16:54:57.582 INFO:teuthology.orchestra.run.smithi019.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T16:54:57.583 INFO:teuthology.orchestra.run.smithi019.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T16:54:57.584 INFO:teuthology.orchestra.run.smithi019.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T16:54:57.585 INFO:teuthology.orchestra.run.smithi019.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T16:54:57.591 INFO:teuthology.orchestra.run.smithi019.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T16:54:57.591 INFO:teuthology.orchestra.run.smithi019.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T16:54:57.599 INFO:teuthology.orchestra.run.smithi019.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T16:54:57.601 INFO:teuthology.orchestra.run.smithi019.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T16:54:57.601 INFO:teuthology.orchestra.run.smithi019.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T16:54:57.612 INFO:teuthology.orchestra.run.smithi016.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4762-gbad475c1-1jammy [721 kB] 2024-09-12T16:54:57.649 INFO:teuthology.orchestra.run.smithi016.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4762-gbad475c1-1jammy [357 kB] 2024-09-12T16:54:57.657 INFO:teuthology.orchestra.run.smithi016.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4762-gbad475c1-1jammy [32.8 kB] 2024-09-12T16:54:57.658 INFO:teuthology.orchestra.run.smithi016.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4762-gbad475c1-1jammy [180 kB] 2024-09-12T16:54:57.662 INFO:teuthology.orchestra.run.smithi016.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4762-gbad475c1-1jammy [71.2 kB] 2024-09-12T16:54:57.664 INFO:teuthology.orchestra.run.smithi016.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4762-gbad475c1-1jammy [338 kB] 2024-09-12T16:54:57.695 INFO:teuthology.orchestra.run.smithi016.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4762-gbad475c1-1jammy [7,972 kB] 2024-09-12T16:54:57.720 INFO:teuthology.orchestra.run.smithi019.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4762-gbad475c1-1jammy [112 kB] 2024-09-12T16:54:57.723 INFO:teuthology.orchestra.run.smithi019.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4762-gbad475c1-1jammy [473 kB] 2024-09-12T16:54:57.732 INFO:teuthology.orchestra.run.smithi016.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T16:54:57.733 INFO:teuthology.orchestra.run.smithi019.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4762-gbad475c1-1jammy [28.2 MB] 2024-09-12T16:54:57.744 INFO:teuthology.orchestra.run.smithi016.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T16:54:57.825 INFO:teuthology.orchestra.run.smithi016.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T16:54:58.007 INFO:teuthology.orchestra.run.smithi016.stdout:Get:14 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4762-gbad475c1-1jammy [112 kB] 2024-09-12T16:54:58.010 INFO:teuthology.orchestra.run.smithi016.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4762-gbad475c1-1jammy [473 kB] 2024-09-12T16:54:58.049 INFO:teuthology.orchestra.run.smithi016.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4762-gbad475c1-1jammy [28.2 MB] 2024-09-12T16:54:58.052 INFO:teuthology.orchestra.run.smithi016.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T16:54:58.063 INFO:teuthology.orchestra.run.smithi016.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T16:54:58.093 INFO:teuthology.orchestra.run.smithi016.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T16:54:58.102 INFO:teuthology.orchestra.run.smithi016.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T16:54:58.102 INFO:teuthology.orchestra.run.smithi016.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T16:54:58.104 INFO:teuthology.orchestra.run.smithi016.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T16:54:58.122 INFO:teuthology.orchestra.run.smithi016.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T16:54:58.126 INFO:teuthology.orchestra.run.smithi016.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T16:54:58.131 INFO:teuthology.orchestra.run.smithi016.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T16:54:58.134 INFO:teuthology.orchestra.run.smithi016.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T16:54:58.215 INFO:teuthology.orchestra.run.smithi016.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T16:54:58.219 INFO:teuthology.orchestra.run.smithi016.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T16:54:58.224 INFO:teuthology.orchestra.run.smithi016.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T16:54:58.227 INFO:teuthology.orchestra.run.smithi016.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T16:54:58.229 INFO:teuthology.orchestra.run.smithi016.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T16:54:58.229 INFO:teuthology.orchestra.run.smithi016.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T16:54:58.231 INFO:teuthology.orchestra.run.smithi016.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T16:54:58.232 INFO:teuthology.orchestra.run.smithi016.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T16:54:58.233 INFO:teuthology.orchestra.run.smithi016.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T16:54:58.297 INFO:teuthology.orchestra.run.smithi016.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T16:54:58.315 INFO:teuthology.orchestra.run.smithi016.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T16:54:58.316 INFO:teuthology.orchestra.run.smithi016.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T16:54:58.316 INFO:teuthology.orchestra.run.smithi016.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T16:54:58.322 INFO:teuthology.orchestra.run.smithi016.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T16:54:58.323 INFO:teuthology.orchestra.run.smithi016.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T16:54:58.324 INFO:teuthology.orchestra.run.smithi016.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T16:54:58.379 INFO:teuthology.orchestra.run.smithi016.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T16:54:58.380 INFO:teuthology.orchestra.run.smithi016.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T16:54:58.381 INFO:teuthology.orchestra.run.smithi016.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T16:54:58.459 INFO:teuthology.orchestra.run.smithi016.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T16:54:58.461 INFO:teuthology.orchestra.run.smithi016.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T16:54:58.463 INFO:teuthology.orchestra.run.smithi016.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T16:54:58.464 INFO:teuthology.orchestra.run.smithi016.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T16:54:58.474 INFO:teuthology.orchestra.run.smithi016.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T16:54:58.475 INFO:teuthology.orchestra.run.smithi016.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T16:54:58.540 INFO:teuthology.orchestra.run.smithi016.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T16:54:58.541 INFO:teuthology.orchestra.run.smithi016.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T16:54:58.543 INFO:teuthology.orchestra.run.smithi016.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T16:54:58.548 INFO:teuthology.orchestra.run.smithi016.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T16:54:58.557 INFO:teuthology.orchestra.run.smithi019.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4762-gbad475c1-1jammy [5,206 kB] 2024-09-12T16:54:58.621 INFO:teuthology.orchestra.run.smithi016.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T16:54:58.625 INFO:teuthology.orchestra.run.smithi016.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T16:54:58.625 INFO:teuthology.orchestra.run.smithi016.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T16:54:58.630 INFO:teuthology.orchestra.run.smithi016.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T16:54:58.631 INFO:teuthology.orchestra.run.smithi016.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T16:54:58.633 INFO:teuthology.orchestra.run.smithi016.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T16:54:58.637 INFO:teuthology.orchestra.run.smithi019.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4762-gbad475c1-1jammy [251 kB] 2024-09-12T16:54:58.640 INFO:teuthology.orchestra.run.smithi019.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4762-gbad475c1-1jammy [124 kB] 2024-09-12T16:54:58.642 INFO:teuthology.orchestra.run.smithi019.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4762-gbad475c1-1jammy [1,562 kB] 2024-09-12T16:54:58.692 INFO:teuthology.orchestra.run.smithi019.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4762-gbad475c1-1jammy [6,310 kB] 2024-09-12T16:54:58.702 INFO:teuthology.orchestra.run.smithi016.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T16:54:58.844 INFO:teuthology.orchestra.run.smithi019.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4762-gbad475c1-1jammy [23.1 MB] 2024-09-12T16:54:58.866 INFO:teuthology.orchestra.run.smithi016.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T16:54:58.868 INFO:teuthology.orchestra.run.smithi016.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T16:54:58.871 INFO:teuthology.orchestra.run.smithi016.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T16:54:58.871 INFO:teuthology.orchestra.run.smithi016.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T16:54:58.874 INFO:teuthology.orchestra.run.smithi016.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T16:54:58.911 INFO:teuthology.orchestra.run.smithi016.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T16:54:58.914 INFO:teuthology.orchestra.run.smithi016.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T16:54:58.915 INFO:teuthology.orchestra.run.smithi016.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T16:54:58.971 INFO:teuthology.orchestra.run.smithi016.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T16:54:58.971 INFO:teuthology.orchestra.run.smithi016.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T16:54:59.032 INFO:teuthology.orchestra.run.smithi016.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T16:54:59.033 INFO:teuthology.orchestra.run.smithi016.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T16:54:59.034 INFO:teuthology.orchestra.run.smithi016.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T16:54:59.035 INFO:teuthology.orchestra.run.smithi016.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T16:54:59.036 INFO:teuthology.orchestra.run.smithi016.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T16:54:59.037 INFO:teuthology.orchestra.run.smithi016.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T16:54:59.044 INFO:teuthology.orchestra.run.smithi016.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T16:54:59.113 INFO:teuthology.orchestra.run.smithi016.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T16:54:59.117 INFO:teuthology.orchestra.run.smithi016.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T16:54:59.118 INFO:teuthology.orchestra.run.smithi016.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T16:54:59.194 INFO:teuthology.orchestra.run.smithi016.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T16:54:59.201 INFO:teuthology.orchestra.run.smithi016.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T16:54:59.203 INFO:teuthology.orchestra.run.smithi016.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T16:54:59.204 INFO:teuthology.orchestra.run.smithi016.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T16:54:59.215 INFO:teuthology.orchestra.run.smithi016.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T16:54:59.217 INFO:teuthology.orchestra.run.smithi016.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T16:54:59.224 INFO:teuthology.orchestra.run.smithi016.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T16:54:59.275 INFO:teuthology.orchestra.run.smithi016.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T16:54:59.277 INFO:teuthology.orchestra.run.smithi016.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T16:54:59.278 INFO:teuthology.orchestra.run.smithi016.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T16:54:59.356 INFO:teuthology.orchestra.run.smithi016.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T16:54:59.388 INFO:teuthology.orchestra.run.smithi016.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T16:54:59.475 INFO:teuthology.orchestra.run.smithi019.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4762-gbad475c1-1jammy [14.1 kB] 2024-09-12T16:54:59.475 INFO:teuthology.orchestra.run.smithi019.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4762-gbad475c1-1jammy [880 kB] 2024-09-12T16:54:59.476 INFO:teuthology.orchestra.run.smithi016.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T16:54:59.477 INFO:teuthology.orchestra.run.smithi016.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4762-gbad475c1-1jammy [5,206 kB] 2024-09-12T16:54:59.477 INFO:teuthology.orchestra.run.smithi016.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T16:54:59.478 INFO:teuthology.orchestra.run.smithi016.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T16:54:59.484 INFO:teuthology.orchestra.run.smithi016.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T16:54:59.486 INFO:teuthology.orchestra.run.smithi016.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T16:54:59.491 INFO:teuthology.orchestra.run.smithi019.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4762-gbad475c1-1jammy [2,438 kB] 2024-09-12T16:54:59.529 INFO:teuthology.orchestra.run.smithi019.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4762-gbad475c1-1jammy [812 kB] 2024-09-12T16:54:59.539 INFO:teuthology.orchestra.run.smithi019.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4762-gbad475c1-1jammy [160 kB] 2024-09-12T16:54:59.541 INFO:teuthology.orchestra.run.smithi019.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4762-gbad475c1-1jammy [61.4 MB] 2024-09-12T16:54:59.561 INFO:teuthology.orchestra.run.smithi016.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4762-gbad475c1-1jammy [251 kB] 2024-09-12T16:54:59.564 INFO:teuthology.orchestra.run.smithi016.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4762-gbad475c1-1jammy [124 kB] 2024-09-12T16:54:59.565 INFO:teuthology.orchestra.run.smithi016.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4762-gbad475c1-1jammy [1,562 kB] 2024-09-12T16:54:59.637 INFO:teuthology.orchestra.run.smithi016.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4762-gbad475c1-1jammy [6,310 kB] 2024-09-12T16:54:59.966 INFO:teuthology.orchestra.run.smithi016.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4762-gbad475c1-1jammy [23.1 MB] 2024-09-12T16:55:01.204 INFO:teuthology.orchestra.run.smithi016.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4762-gbad475c1-1jammy [14.1 kB] 2024-09-12T16:55:01.204 INFO:teuthology.orchestra.run.smithi016.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4762-gbad475c1-1jammy [880 kB] 2024-09-12T16:55:01.222 INFO:teuthology.orchestra.run.smithi016.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4762-gbad475c1-1jammy [2,438 kB] 2024-09-12T16:55:01.264 INFO:teuthology.orchestra.run.smithi016.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4762-gbad475c1-1jammy [812 kB] 2024-09-12T16:55:01.275 INFO:teuthology.orchestra.run.smithi016.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4762-gbad475c1-1jammy [160 kB] 2024-09-12T16:55:01.277 INFO:teuthology.orchestra.run.smithi016.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4762-gbad475c1-1jammy [61.4 MB] 2024-09-12T16:55:01.350 INFO:teuthology.orchestra.run.smithi019.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4762-gbad475c1-1jammy [8,625 kB] 2024-09-12T16:55:01.511 INFO:teuthology.orchestra.run.smithi019.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4762-gbad475c1-1jammy [14.2 kB] 2024-09-12T16:55:01.519 INFO:teuthology.orchestra.run.smithi019.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4762-gbad475c1-1jammy [48.5 MB] 2024-09-12T16:55:02.878 INFO:teuthology.orchestra.run.smithi019.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4762-gbad475c1-1jammy [130 kB] 2024-09-12T16:55:02.951 INFO:teuthology.orchestra.run.smithi019.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4762-gbad475c1-1jammy [39.0 kB] 2024-09-12T16:55:02.952 INFO:teuthology.orchestra.run.smithi019.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4762-gbad475c1-1jammy [15.8 MB] 2024-09-12T16:55:03.363 INFO:teuthology.orchestra.run.smithi019.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4762-gbad475c1-1jammy [91.2 kB] 2024-09-12T16:55:03.659 INFO:teuthology.orchestra.run.smithi016.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4762-gbad475c1-1jammy [8,625 kB] 2024-09-12T16:55:03.771 INFO:teuthology.orchestra.run.smithi016.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4762-gbad475c1-1jammy [14.2 kB] 2024-09-12T16:55:03.771 INFO:teuthology.orchestra.run.smithi016.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4762-gbad475c1-1jammy [48.5 MB] 2024-09-12T16:55:03.961 INFO:teuthology.orchestra.run.smithi019.stdout:Fetched 243 MB in 6s (38.5 MB/s) 2024-09-12T16:55:04.123 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T16:55:04.226 INFO:teuthology.orchestra.run.smithi019.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T16:55:04.231 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T16:55:04.313 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T16:55:04.649 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T16:55:04.676 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T16:55:04.747 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T16:55:04.831 INFO:teuthology.orchestra.run.smithi016.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4762-gbad475c1-1jammy [130 kB] 2024-09-12T16:55:04.833 INFO:teuthology.orchestra.run.smithi016.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4762-gbad475c1-1jammy [39.0 kB] 2024-09-12T16:55:04.834 INFO:teuthology.orchestra.run.smithi016.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4762-gbad475c1-1jammy [15.8 MB] 2024-09-12T16:55:05.102 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T16:55:05.129 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T16:55:05.150 INFO:teuthology.orchestra.run.smithi016.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4762-gbad475c1-1jammy [91.2 kB] 2024-09-12T16:55:05.169 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T16:55:05.608 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T16:55:05.635 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T16:55:05.683 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T16:55:05.736 INFO:teuthology.orchestra.run.smithi016.stdout:Fetched 243 MB in 8s (30.4 MB/s) 2024-09-12T16:55:05.853 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T16:55:05.947 INFO:teuthology.orchestra.run.smithi016.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T16:55:05.953 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T16:55:06.027 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T16:55:06.094 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T16:55:06.121 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T16:55:06.161 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T16:55:06.364 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T16:55:06.391 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T16:55:06.430 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T16:55:06.464 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T16:55:06.491 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T16:55:06.522 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T16:55:06.817 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T16:55:06.844 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T16:55:06.883 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T16:55:07.017 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T16:55:07.044 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T16:55:07.084 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T16:55:07.279 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T16:55:07.305 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T16:55:07.346 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T16:55:07.378 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package librados2. 2024-09-12T16:55:07.405 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../007-librados2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:55:07.445 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking librados2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:07.765 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T16:55:07.792 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T16:55:07.832 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T16:55:07.881 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package librbd1. 2024-09-12T16:55:07.908 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../008-librbd1_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:55:07.939 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking librbd1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:08.310 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T16:55:08.337 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T16:55:08.377 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T16:55:08.383 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T16:55:08.410 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:55:08.450 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libcephfs2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:08.688 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T16:55:08.715 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T16:55:08.728 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-rados. 2024-09-12T16:55:08.746 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T16:55:08.755 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:55:08.794 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-rados (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:09.083 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package librados2. 2024-09-12T16:55:09.089 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T16:55:09.110 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../007-librados2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:55:09.116 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T16:55:09.147 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-ceph-argparse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:09.149 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking librados2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:09.383 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T16:55:09.410 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:55:09.450 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-cephfs (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:09.628 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package librbd1. 2024-09-12T16:55:09.654 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../008-librbd1_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:55:09.694 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking librbd1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:09.761 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T16:55:09.788 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T16:55:09.853 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:10.105 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T16:55:10.122 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:55:10.155 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libcephfs2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:10.181 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T16:55:10.208 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T16:55:10.247 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T16:55:10.584 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T16:55:10.611 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T16:55:10.650 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T16:55:10.658 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-rados. 2024-09-12T16:55:10.674 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:55:10.716 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-rados (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:10.861 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T16:55:10.885 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:55:10.919 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-rbd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:11.045 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T16:55:11.073 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T16:55:11.111 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-ceph-argparse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:11.248 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T16:55:11.275 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T16:55:11.314 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T16:55:11.355 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T16:55:11.372 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:55:11.405 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-cephfs (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:11.592 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T16:55:11.607 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T16:55:11.650 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T16:55:11.691 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T16:55:11.718 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T16:55:11.758 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:11.936 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T16:55:11.952 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T16:55:11.994 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T16:55:12.211 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T16:55:12.238 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T16:55:12.273 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package lua5.1. 2024-09-12T16:55:12.278 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T16:55:12.288 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T16:55:12.322 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T16:55:12.606 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T16:55:12.632 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T16:55:12.634 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package lua-any. 2024-09-12T16:55:12.650 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-12T16:55:12.672 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T16:55:12.692 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T16:55:12.902 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T16:55:12.929 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:55:12.953 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package zip. 2024-09-12T16:55:12.969 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-rbd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:12.980 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-12T16:55:13.229 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T16:55:13.307 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package unzip. 2024-09-12T16:55:13.323 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T16:55:13.330 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T16:55:13.357 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T16:55:13.358 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T16:55:13.396 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T16:55:13.699 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T16:55:13.726 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T16:55:13.727 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package luarocks. 2024-09-12T16:55:13.754 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T16:55:13.765 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T16:55:13.794 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T16:55:14.069 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T16:55:14.084 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T16:55:14.118 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T16:55:14.177 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package librgw2. 2024-09-12T16:55:14.204 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../025-librgw2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:55:14.243 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking librgw2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:14.397 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package lua5.1. 2024-09-12T16:55:14.423 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T16:55:14.463 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T16:55:14.783 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package lua-any. 2024-09-12T16:55:14.799 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-12T16:55:14.842 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T16:55:15.055 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T16:55:15.127 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package zip. 2024-09-12T16:55:15.128 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-12T16:55:15.128 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:55:15.128 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-rgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:15.136 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T16:55:15.405 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package unzip. 2024-09-12T16:55:15.433 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T16:55:15.441 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T16:55:15.464 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T16:55:15.470 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T16:55:15.507 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T16:55:15.810 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T16:55:15.837 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:55:15.877 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libradosstriper1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:15.878 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package luarocks. 2024-09-12T16:55:15.903 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T16:55:15.943 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T16:55:16.272 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-common. 2024-09-12T16:55:16.298 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:55:16.330 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:16.334 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package librgw2. 2024-09-12T16:55:16.361 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../025-librgw2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:55:16.401 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking librgw2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:17.028 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T16:55:17.044 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:55:17.078 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-rgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:17.406 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T16:55:17.433 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T16:55:17.473 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T16:55:17.817 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T16:55:17.844 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:55:17.884 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libradosstriper1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:17.885 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-base. 2024-09-12T16:55:17.912 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:55:17.962 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-base (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:18.254 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-common. 2024-09-12T16:55:18.282 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:55:18.312 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:18.523 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T16:55:18.550 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T16:55:18.590 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T16:55:18.867 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T16:55:18.894 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T16:55:18.934 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T16:55:19.271 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T16:55:19.298 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T16:55:19.329 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T16:55:19.640 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T16:55:19.667 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T16:55:19.707 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T16:55:20.010 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T16:55:20.036 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T16:55:20.067 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-base. 2024-09-12T16:55:20.076 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T16:55:20.094 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:55:20.143 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-base (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:20.372 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T16:55:20.397 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T16:55:20.429 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T16:55:20.690 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-portend. 2024-09-12T16:55:20.705 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T16:55:20.717 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-12T16:55:20.725 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T16:55:20.757 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T16:55:20.763 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T16:55:21.060 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T16:55:21.087 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T16:55:21.126 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T16:55:21.265 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T16:55:21.292 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T16:55:21.332 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T16:55:21.429 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T16:55:21.456 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T16:55:21.496 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T16:55:21.677 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T16:55:21.704 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T16:55:21.744 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T16:55:21.833 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T16:55:21.860 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T16:55:21.899 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T16:55:22.046 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T16:55:22.073 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T16:55:22.121 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T16:55:22.228 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T16:55:22.255 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T16:55:22.294 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T16:55:22.407 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T16:55:22.434 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T16:55:22.474 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T16:55:22.597 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T16:55:22.624 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T16:55:22.697 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T16:55:22.744 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T16:55:22.771 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T16:55:22.810 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T16:55:22.966 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-mako. 2024-09-12T16:55:22.993 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T16:55:23.025 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T16:55:23.105 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-portend. 2024-09-12T16:55:23.132 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-12T16:55:23.171 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T16:55:23.311 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T16:55:23.338 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T16:55:23.378 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T16:55:23.424 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T16:55:23.440 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T16:55:23.474 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T16:55:23.681 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T16:55:23.708 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T16:55:23.747 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T16:55:23.760 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T16:55:23.787 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T16:55:23.827 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T16:55:24.050 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-webob. 2024-09-12T16:55:24.078 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T16:55:24.117 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T16:55:24.172 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T16:55:24.199 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T16:55:24.238 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T16:55:24.445 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T16:55:24.472 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T16:55:24.515 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T16:55:24.533 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T16:55:24.557 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T16:55:24.600 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T16:55:24.789 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T16:55:24.816 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T16:55:24.857 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T16:55:24.880 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T16:55:24.894 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T16:55:24.928 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T16:55:25.135 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-paste. 2024-09-12T16:55:25.161 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T16:55:25.201 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-mako. 2024-09-12T16:55:25.228 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T16:55:25.272 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T16:55:25.356 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T16:55:25.601 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T16:55:25.628 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T16:55:25.667 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T16:55:25.712 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T16:55:25.740 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T16:55:25.779 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T16:55:26.012 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T16:55:26.039 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T16:55:26.078 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T16:55:26.090 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T16:55:26.117 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T16:55:26.157 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T16:55:26.460 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T16:55:26.487 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T16:55:26.506 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-webob. 2024-09-12T16:55:26.526 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T16:55:26.533 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T16:55:26.572 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T16:55:26.796 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T16:55:26.823 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T16:55:26.854 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T16:55:26.892 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T16:55:26.919 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T16:55:26.954 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T16:55:27.159 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T16:55:27.175 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T16:55:27.209 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T16:55:27.220 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T16:55:27.247 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T16:55:27.287 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T16:55:27.529 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-idna. 2024-09-12T16:55:27.556 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T16:55:27.573 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-paste. 2024-09-12T16:55:27.595 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T16:55:27.600 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T16:55:27.639 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T16:55:27.898 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T16:55:27.925 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T16:55:27.925 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T16:55:27.942 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T16:55:27.964 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T16:55:27.976 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T16:55:28.279 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T16:55:28.306 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T16:55:28.318 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-requests. 2024-09-12T16:55:28.345 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T16:55:28.346 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T16:55:28.384 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T16:55:28.657 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T16:55:28.683 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T16:55:28.713 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T16:55:28.723 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T16:55:28.740 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T16:55:28.779 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T16:55:29.009 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T16:55:29.036 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T16:55:29.067 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T16:55:29.074 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T16:55:29.090 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T16:55:29.132 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:29.389 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T16:55:29.405 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T16:55:29.439 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T16:55:29.546 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T16:55:29.573 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:55:29.612 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:29.750 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-idna. 2024-09-12T16:55:29.777 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T16:55:29.916 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T16:55:29.916 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T16:55:29.942 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T16:55:29.982 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T16:55:30.162 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T16:55:30.189 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T16:55:30.228 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T16:55:30.268 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T16:55:30.295 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T16:55:30.699 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T16:55:31.446 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T16:55:31.457 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-requests. 2024-09-12T16:55:31.473 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:55:31.484 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T16:55:31.513 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-mgr (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:31.523 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T16:55:31.834 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T16:55:31.862 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T16:55:31.866 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T16:55:31.893 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:55:31.901 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T16:55:31.924 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-mon (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:32.195 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T16:55:32.212 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T16:55:32.254 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:32.626 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T16:55:32.653 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:55:32.653 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T16:55:32.680 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:55:32.692 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:32.719 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-osd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:33.020 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T16:55:33.047 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T16:55:33.087 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T16:55:33.391 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T16:55:33.417 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T16:55:33.456 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T16:55:33.751 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T16:55:33.778 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:55:33.798 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph. 2024-09-12T16:55:33.809 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:33.814 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../066-ceph_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:55:33.856 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:34.142 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T16:55:34.169 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:55:34.200 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:34.221 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T16:55:34.248 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:55:34.287 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mon (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:34.579 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T16:55:34.606 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:55:34.645 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-mds (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:34.949 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T16:55:34.976 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:55:35.015 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-osd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:35.040 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package cephadm. 2024-09-12T16:55:35.067 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../069-cephadm_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:55:35.107 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:35.417 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T16:55:35.445 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T16:55:35.484 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T16:55:35.778 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T16:55:35.795 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T16:55:35.836 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T16:55:36.210 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph. 2024-09-12T16:55:36.237 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../066-ceph_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:55:36.285 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:36.688 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T16:55:36.717 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:55:36.850 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-babel. 2024-09-12T16:55:36.866 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T16:55:36.896 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:36.899 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T16:55:37.153 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T16:55:37.169 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T16:55:37.202 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T16:55:37.299 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T16:55:37.327 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:55:37.374 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mds (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:37.506 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T16:55:37.534 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T16:55:37.564 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:37.836 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package cephadm. 2024-09-12T16:55:37.863 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../069-cephadm_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:55:37.919 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:37.926 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T16:55:37.953 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T16:55:37.992 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T16:55:38.278 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-routes. 2024-09-12T16:55:38.306 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T16:55:38.322 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T16:55:38.345 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T16:55:38.349 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T16:55:38.396 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T16:55:38.681 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T16:55:38.709 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T16:55:38.748 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:38.758 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T16:55:38.774 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T16:55:38.824 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T16:55:39.947 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-babel. 2024-09-12T16:55:39.975 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T16:55:40.013 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T16:55:40.357 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T16:55:40.384 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T16:55:40.424 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T16:55:40.777 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T16:55:40.804 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T16:55:40.843 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:41.197 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T16:55:41.224 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T16:55:41.263 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T16:55:41.558 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-routes. 2024-09-12T16:55:41.585 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T16:55:41.624 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T16:55:41.803 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T16:55:41.834 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T16:55:41.878 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T16:55:41.977 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T16:55:42.004 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T16:55:42.044 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:42.365 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T16:55:42.393 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T16:55:42.431 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T16:55:42.760 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T16:55:42.788 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T16:55:42.826 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T16:55:43.113 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T16:55:43.141 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T16:55:43.179 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T16:55:43.880 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T16:55:43.908 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T16:55:44.032 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:44.961 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T16:55:44.989 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T16:55:45.027 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T16:55:45.040 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T16:55:45.058 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T16:55:45.107 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T16:55:45.330 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T16:55:45.358 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T16:55:45.396 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T16:55:45.669 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T16:55:45.697 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T16:55:45.727 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T16:55:45.744 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T16:55:45.755 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T16:55:45.794 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T16:55:46.080 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T16:55:46.100 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T16:55:46.110 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-12T16:55:46.117 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T16:55:46.147 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T16:55:46.156 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T16:55:46.483 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T16:55:46.511 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T16:55:46.553 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T16:55:46.608 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T16:55:46.637 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T16:55:46.675 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T16:55:47.028 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T16:55:47.057 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T16:55:47.095 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T16:55:47.364 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T16:55:47.393 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T16:55:47.422 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T16:55:47.534 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T16:55:47.563 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T16:55:47.686 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:47.998 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T16:55:47.999 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T16:55:47.999 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T16:55:48.456 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T16:55:48.474 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T16:55:48.514 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:48.648 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T16:55:48.674 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T16:55:48.714 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T16:55:48.834 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T16:55:48.862 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T16:55:48.900 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T16:55:48.950 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T16:55:48.967 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T16:55:49.009 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T16:55:49.195 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T16:55:49.224 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T16:55:49.253 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T16:55:49.329 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T16:55:49.357 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T16:55:49.396 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T16:55:49.506 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package jq. 2024-09-12T16:55:49.523 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T16:55:49.564 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T16:55:49.707 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T16:55:49.736 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-12T16:55:49.774 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T16:55:49.817 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package socat. 2024-09-12T16:55:49.834 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T16:55:49.875 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T16:55:50.077 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T16:55:50.106 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T16:55:50.144 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T16:55:50.195 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T16:55:50.212 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T16:55:50.253 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T16:55:50.489 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T16:55:50.518 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T16:55:50.555 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T16:55:50.608 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-test. 2024-09-12T16:55:50.637 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:55:50.674 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-test (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:50.866 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T16:55:50.884 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T16:55:50.924 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T16:55:51.270 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T16:55:51.298 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T16:55:51.336 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T16:55:52.208 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T16:55:52.225 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T16:55:52.266 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:52.577 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T16:55:52.606 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T16:55:52.644 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T16:55:52.939 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T16:55:52.967 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T16:55:52.970 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T16:55:52.997 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T16:55:52.998 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T16:55:53.036 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-volume (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:53.275 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package jq. 2024-09-12T16:55:53.303 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T16:55:53.348 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T16:55:53.349 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T16:55:53.365 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:55:53.407 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libcephfs-dev (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:53.652 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package socat. 2024-09-12T16:55:53.681 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T16:55:53.718 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T16:55:53.727 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T16:55:53.746 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T16:55:53.784 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T16:55:54.049 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T16:55:54.066 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T16:55:54.080 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T16:55:54.097 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T16:55:54.107 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T16:55:54.130 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T16:55:54.501 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T16:55:54.529 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-test. 2024-09-12T16:55:54.530 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T16:55:54.557 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:55:54.567 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T16:55:54.603 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-test (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:54.981 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package pkg-config. 2024-09-12T16:55:55.010 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T16:55:55.047 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T16:55:55.292 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T16:55:55.320 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T16:55:55.358 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T16:55:55.778 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T16:55:55.808 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T16:55:55.844 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T16:55:56.173 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T16:55:56.201 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T16:55:56.230 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T16:55:56.509 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T16:55:56.537 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T16:55:56.575 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T16:55:56.878 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T16:55:56.907 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T16:55:56.945 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T16:55:56.966 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T16:55:56.995 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T16:55:57.032 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-volume (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:57.264 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-py. 2024-09-12T16:55:57.293 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-12T16:55:57.331 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T16:55:57.345 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T16:55:57.362 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:55:57.403 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libcephfs-dev (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:55:57.634 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T16:55:57.663 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T16:55:57.700 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T16:55:57.739 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T16:55:57.768 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T16:55:57.806 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T16:55:58.144 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T16:55:58.163 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T16:55:58.172 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T16:55:58.192 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T16:55:58.210 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T16:55:58.229 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T16:55:58.540 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-toml. 2024-09-12T16:55:58.569 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-12T16:55:58.589 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T16:55:58.606 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T16:55:58.617 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T16:55:58.664 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T16:55:58.868 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T16:55:58.897 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T16:55:58.926 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T16:55:59.086 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package pkg-config. 2024-09-12T16:55:59.114 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T16:55:59.152 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T16:55:59.296 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T16:55:59.325 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T16:55:59.363 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T16:55:59.414 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T16:55:59.442 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T16:55:59.480 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T16:55:59.624 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T16:55:59.641 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T16:55:59.682 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T16:55:59.908 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T16:55:59.937 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T16:55:59.975 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T16:56:00.261 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T16:56:00.289 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T16:56:00.327 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T16:56:00.352 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package radosgw. 2024-09-12T16:56:00.381 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../116-radosgw_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:56:00.410 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking radosgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:00.630 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T16:56:00.659 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T16:56:00.689 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T16:56:00.959 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T16:56:00.987 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T16:56:01.025 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T16:56:01.330 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T16:56:01.359 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:56:01.361 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-py. 2024-09-12T16:56:01.390 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-12T16:56:01.421 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking rbd-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:01.428 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T16:56:01.706 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T16:56:01.719 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T16:56:01.723 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T16:56:01.773 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T16:56:02.110 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T16:56:02.244 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T16:56:02.302 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T16:56:02.331 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T16:56:02.376 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T16:56:02.523 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T16:56:02.880 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T16:56:03.022 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-toml. 2024-09-12T16:56:03.050 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-12T16:56:03.088 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T16:56:03.330 INFO:teuthology.orchestra.run.smithi019.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T16:56:03.413 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:03.449 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T16:56:03.478 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T16:56:03.524 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T16:56:03.869 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T16:56:03.898 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T16:56:03.935 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T16:56:04.029 INFO:teuthology.orchestra.run.smithi019.stdout:Adding system user cephadm....done 2024-09-12T16:56:04.185 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T16:56:04.205 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T16:56:04.233 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T16:56:04.271 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T16:56:04.462 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T16:56:04.730 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T16:56:04.840 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T16:56:05.042 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package radosgw. 2024-09-12T16:56:05.080 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../116-radosgw_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:56:05.100 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking radosgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:05.207 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T16:56:05.475 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T16:56:05.601 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T16:56:05.928 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T16:56:06.103 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T16:56:06.120 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T16:56:06.161 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking rbd-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:06.313 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T16:56:06.475 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T16:56:06.572 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T16:56:06.733 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T16:56:06.833 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T16:56:06.859 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T16:56:07.063 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T16:56:07.131 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T16:56:07.325 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T16:56:07.473 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T16:56:07.577 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T16:56:07.836 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-ceph-argparse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:07.881 INFO:teuthology.orchestra.run.smithi016.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T16:56:08.096 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T16:56:08.116 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:08.230 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T16:56:08.331 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T16:56:08.440 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T16:56:08.700 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T16:56:08.796 INFO:teuthology.orchestra.run.smithi016.stdout:Adding system user cephadm....done 2024-09-12T16:56:08.977 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T16:56:09.103 INFO:teuthology.orchestra.run.smithi019.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T16:56:09.132 INFO:teuthology.orchestra.run.smithi019.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T16:56:09.195 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T16:56:09.321 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T16:56:09.570 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T16:56:09.689 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T16:56:09.789 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T16:56:09.913 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T16:56:10.023 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T16:56:10.040 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T16:56:10.274 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T16:56:10.308 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T16:56:10.534 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T16:56:10.618 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T16:56:10.660 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T16:56:10.744 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T16:56:10.986 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T16:56:11.355 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T16:56:11.446 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T16:56:11.590 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T16:56:11.697 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T16:56:11.798 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T16:56:11.866 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T16:56:11.907 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T16:56:12.109 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T16:56:12.216 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T16:56:12.435 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T16:56:12.626 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T16:56:12.694 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T16:56:12.885 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T16:56:12.954 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-ceph-argparse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:13.205 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T16:56:13.279 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T16:56:13.307 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T16:56:13.432 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T16:56:13.558 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T16:56:13.572 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T16:56:13.817 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T16:56:13.923 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T16:56:14.166 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T16:56:14.194 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T16:56:14.224 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T16:56:14.287 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T16:56:14.292 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:14.388 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T16:56:14.626 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T16:56:14.748 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T16:56:14.899 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T16:56:14.961 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T16:56:15.183 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T16:56:15.451 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T16:56:15.794 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T16:56:15.920 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T16:56:16.233 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T16:56:16.493 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T16:56:16.627 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T16:56:16.663 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T16:56:16.895 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T16:56:16.914 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T16:56:17.021 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T16:56:17.041 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T16:56:17.139 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T16:56:17.166 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T16:56:17.468 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T16:56:17.540 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T16:56:17.861 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T16:56:17.941 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T16:56:18.137 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T16:56:18.192 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T16:56:18.343 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T16:56:18.521 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T16:56:18.653 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T16:56:18.806 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T16:56:18.912 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T16:56:19.157 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T16:56:19.163 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T16:56:19.398 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T16:56:19.409 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T16:56:19.535 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:19.640 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T16:56:19.861 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T16:56:19.908 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T16:56:20.034 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T16:56:20.187 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T16:56:20.327 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T16:56:20.489 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T16:56:20.771 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T16:56:21.055 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T16:56:21.306 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T16:56:21.432 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T16:56:21.484 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T16:56:21.558 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T16:56:21.648 INFO:teuthology.orchestra.run.smithi019.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T16:56:21.744 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T16:56:21.870 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T16:56:21.893 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T16:56:22.019 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T16:56:22.121 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T16:56:22.222 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T16:56:22.332 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T16:56:22.429 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T16:56:22.641 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T16:56:22.722 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T16:56:22.823 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T16:56:22.901 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T16:56:23.066 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T16:56:23.162 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T16:56:23.198 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T16:56:23.287 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T16:56:23.518 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T16:56:23.588 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T16:56:23.822 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T16:56:23.852 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T16:56:24.082 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T16:56:24.137 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T16:56:24.263 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T16:56:24.341 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T16:56:24.522 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T16:56:24.601 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T16:56:24.792 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T16:56:24.869 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T16:56:24.994 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T16:56:25.143 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T16:56:25.270 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T16:56:25.388 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T16:56:25.545 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T16:56:25.681 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T16:56:25.855 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T16:56:25.999 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T16:56:26.190 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T16:56:26.258 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T16:56:26.316 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up librados2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:26.384 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T16:56:26.442 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:26.510 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T16:56:26.568 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T16:56:26.599 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T16:56:26.853 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T16:56:26.921 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libcephfs2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:26.971 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T16:56:27.022 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libradosstriper1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:27.123 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T16:56:27.373 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T16:56:27.391 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up librbd1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:27.518 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-mgr-modules-core (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:27.641 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T16:56:27.643 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:27.766 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T16:56:27.863 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T16:56:27.863 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T16:56:28.026 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T16:56:28.152 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T16:56:28.378 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libcephfs-dev (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:28.478 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T16:56:28.504 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-rados (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:28.613 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up librgw2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:28.723 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T16:56:28.812 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T16:56:29.072 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T16:56:29.181 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T16:56:29.449 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T16:56:29.733 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T16:56:29.968 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-rbd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:30.087 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T16:56:30.094 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up rbd-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:30.229 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-rgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:30.354 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-cephfs (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:30.455 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:30.488 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T16:56:30.798 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T16:56:30.965 INFO:teuthology.orchestra.run.smithi019.stdout:Adding group ceph....done 2024-09-12T16:56:31.143 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T16:56:31.277 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up librados2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:31.342 INFO:teuthology.orchestra.run.smithi019.stdout:Adding system user ceph....done 2024-09-12T16:56:31.386 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:31.510 INFO:teuthology.orchestra.run.smithi019.stdout:Setting system user ceph properties....done 2024-09-12T16:56:31.512 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T16:56:31.527 INFO:teuthology.orchestra.run.smithi019.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T16:56:31.671 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T16:56:31.874 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libcephfs2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:32.000 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libradosstriper1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:32.013 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T16:56:32.126 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T16:56:32.394 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up librbd1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:32.515 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-test (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:32.520 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-modules-core (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:32.632 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up radosgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:32.638 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:32.840 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T16:56:32.840 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T16:56:33.109 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T16:56:33.110 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T16:56:33.322 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libcephfs-dev (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:33.457 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-rados (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:33.601 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-base (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:33.608 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up librgw2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:33.734 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T16:56:34.015 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T16:56:34.547 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-mds (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:34.774 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T16:56:34.774 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T16:56:35.012 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-rbd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:35.130 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up rbd-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:35.231 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-rgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:35.274 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-mgr (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:35.382 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-cephfs (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:35.502 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T16:56:35.502 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T16:56:35.508 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:35.983 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-osd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:36.051 INFO:teuthology.orchestra.run.smithi016.stdout:Adding group ceph....done 2024-09-12T16:56:36.263 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T16:56:36.264 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T16:56:36.453 INFO:teuthology.orchestra.run.smithi016.stdout:Adding system user ceph....done 2024-09-12T16:56:36.622 INFO:teuthology.orchestra.run.smithi016.stdout:Setting system user ceph properties....done 2024-09-12T16:56:36.641 INFO:teuthology.orchestra.run.smithi016.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T16:56:36.752 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:36.787 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T16:56:36.878 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:37.029 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-mon (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:37.148 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T16:56:37.245 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T16:56:37.245 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T16:56:37.601 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-test (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:37.702 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up radosgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:37.738 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-mgr-cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:37.864 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:37.990 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-mgr-dashboard (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:38.159 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T16:56:38.159 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T16:56:38.205 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-volume (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:38.620 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-base (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:38.662 INFO:teuthology.orchestra.run.smithi019.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T16:56:38.780 INFO:teuthology.orchestra.run.smithi019.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T16:56:38.957 INFO:teuthology.orchestra.run.smithi019.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T16:56:39.002 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T16:56:39.491 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mds (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:39.697 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T16:56:39.697 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T16:56:40.074 INFO:teuthology.orchestra.run.smithi019.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T16:56:40.158 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:40.372 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T16:56:40.372 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T16:56:40.741 INFO:teuthology.orchestra.run.smithi019.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T16:56:40.744 DEBUG:teuthology.orchestra.run.smithi019:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install s3cmd maven 2024-09-12T16:56:40.826 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-osd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:40.848 INFO:teuthology.orchestra.run.smithi019.stdout:Reading package lists... 2024-09-12T16:56:41.063 INFO:teuthology.orchestra.run.smithi019.stdout:Building dependency tree... 2024-09-12T16:56:41.064 INFO:teuthology.orchestra.run.smithi019.stdout:Reading state information... 2024-09-12T16:56:41.104 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T16:56:41.104 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T16:56:41.275 INFO:teuthology.orchestra.run.smithi019.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T16:56:41.275 INFO:teuthology.orchestra.run.smithi019.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T16:56:41.275 INFO:teuthology.orchestra.run.smithi019.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T16:56:41.275 INFO:teuthology.orchestra.run.smithi019.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T16:56:41.275 INFO:teuthology.orchestra.run.smithi019.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T16:56:41.276 INFO:teuthology.orchestra.run.smithi019.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T16:56:41.276 INFO:teuthology.orchestra.run.smithi019.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T16:56:41.277 INFO:teuthology.orchestra.run.smithi019.stdout:The following additional packages will be installed: 2024-09-12T16:56:41.277 INFO:teuthology.orchestra.run.smithi019.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T16:56:41.277 INFO:teuthology.orchestra.run.smithi019.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T16:56:41.277 INFO:teuthology.orchestra.run.smithi019.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T16:56:41.277 INFO:teuthology.orchestra.run.smithi019.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T16:56:41.277 INFO:teuthology.orchestra.run.smithi019.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T16:56:41.277 INFO:teuthology.orchestra.run.smithi019.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T16:56:41.277 INFO:teuthology.orchestra.run.smithi019.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T16:56:41.278 INFO:teuthology.orchestra.run.smithi019.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T16:56:41.278 INFO:teuthology.orchestra.run.smithi019.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T16:56:41.278 INFO:teuthology.orchestra.run.smithi019.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T16:56:41.278 INFO:teuthology.orchestra.run.smithi019.stdout: libwagon-http-shaded-java libwagon-provider-api-java python3-magic 2024-09-12T16:56:41.279 INFO:teuthology.orchestra.run.smithi019.stdout:Suggested packages: 2024-09-12T16:56:41.279 INFO:teuthology.orchestra.run.smithi019.stdout: libaopalliance-java-doc libatinject-jsr330-api-java-doc libel-api-java 2024-09-12T16:56:41.279 INFO:teuthology.orchestra.run.smithi019.stdout: libcommons-io-java-doc libcommons-lang3-java-doc libasm-java libcglib-java 2024-09-12T16:56:41.279 INFO:teuthology.orchestra.run.smithi019.stdout: libjsr305-java-doc libmaven-shared-utils-java-doc liblogback-java 2024-09-12T16:56:41.279 INFO:teuthology.orchestra.run.smithi019.stdout: libplexus-classworlds-java-doc libplexus-sec-dispatcher-java-doc 2024-09-12T16:56:41.279 INFO:teuthology.orchestra.run.smithi019.stdout: libplexus-utils2-java-doc testng libcommons-logging-java liblog4j1.2-java 2024-09-12T16:56:41.320 INFO:teuthology.orchestra.run.smithi019.stdout:The following NEW packages will be installed: 2024-09-12T16:56:41.320 INFO:teuthology.orchestra.run.smithi019.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T16:56:41.320 INFO:teuthology.orchestra.run.smithi019.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T16:56:41.320 INFO:teuthology.orchestra.run.smithi019.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T16:56:41.320 INFO:teuthology.orchestra.run.smithi019.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T16:56:41.320 INFO:teuthology.orchestra.run.smithi019.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T16:56:41.321 INFO:teuthology.orchestra.run.smithi019.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T16:56:41.321 INFO:teuthology.orchestra.run.smithi019.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T16:56:41.321 INFO:teuthology.orchestra.run.smithi019.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T16:56:41.321 INFO:teuthology.orchestra.run.smithi019.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T16:56:41.321 INFO:teuthology.orchestra.run.smithi019.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T16:56:41.321 INFO:teuthology.orchestra.run.smithi019.stdout: libwagon-http-shaded-java libwagon-provider-api-java maven python3-magic 2024-09-12T16:56:41.321 INFO:teuthology.orchestra.run.smithi019.stdout: s3cmd 2024-09-12T16:56:41.374 INFO:teuthology.orchestra.run.smithi019.stdout:0 upgraded, 35 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T16:56:41.374 INFO:teuthology.orchestra.run.smithi019.stdout:Need to get 10.4 MB of archives. 2024-09-12T16:56:41.374 INFO:teuthology.orchestra.run.smithi019.stdout:After this operation, 13.9 MB of additional disk space will be used. 2024-09-12T16:56:41.374 INFO:teuthology.orchestra.run.smithi019.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libapache-pom-java all 18-1 [4,720 B] 2024-09-12T16:56:41.392 INFO:teuthology.orchestra.run.smithi019.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libatinject-jsr330-api-java all 1.0+ds1-5 [5,348 B] 2024-09-12T16:56:41.392 INFO:teuthology.orchestra.run.smithi019.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-interceptor-3.0-spec-java all 1.0.1-4fakesync [8,616 B] 2024-09-12T16:56:41.395 INFO:teuthology.orchestra.run.smithi019.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcdi-api-java all 1.2-3 [54.3 kB] 2024-09-12T16:56:41.430 INFO:teuthology.orchestra.run.smithi019.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-cli-java all 1.4-2 [55.8 kB] 2024-09-12T16:56:41.445 INFO:teuthology.orchestra.run.smithi019.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-parent-java all 43-1 [10.8 kB] 2024-09-12T16:56:41.447 INFO:teuthology.orchestra.run.smithi019.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-io-java all 2.11.0-2 [297 kB] 2024-09-12T16:56:41.477 INFO:teuthology.orchestra.run.smithi019.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-lang3-java all 3.11-1 [526 kB] 2024-09-12T16:56:41.497 INFO:teuthology.orchestra.run.smithi019.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-annotation-1.3-spec-java all 1.3-1 [11.2 kB] 2024-09-12T16:56:41.498 INFO:teuthology.orchestra.run.smithi019.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjsr305-java all 0.1~+svn49-11 [27.0 kB] 2024-09-12T16:56:41.499 INFO:teuthology.orchestra.run.smithi019.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguava-java all 29.0-6 [2,418 kB] 2024-09-12T16:56:41.546 INFO:teuthology.orchestra.run.smithi019.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libaopalliance-java all 20070526-6 [9,084 B] 2024-09-12T16:56:41.546 INFO:teuthology.orchestra.run.smithi019.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguice-java all 4.2.3-2 [1,434 kB] 2024-09-12T16:56:41.552 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:41.565 INFO:teuthology.orchestra.run.smithi019.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libhawtjni-runtime-java all 1.17-1 [28.8 kB] 2024-09-12T16:56:41.565 INFO:teuthology.orchestra.run.smithi019.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-native-java all 1.8-1 [23.8 kB] 2024-09-12T16:56:41.566 INFO:teuthology.orchestra.run.smithi019.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-java all 1.18-1 [56.8 kB] 2024-09-12T16:56:41.567 INFO:teuthology.orchestra.run.smithi019.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-parent-java all 31-2 [5,140 B] 2024-09-12T16:56:41.567 INFO:teuthology.orchestra.run.smithi019.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-utils2-java all 3.3.0-1 [250 kB] 2024-09-12T16:56:41.570 INFO:teuthology.orchestra.run.smithi019.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-provider-api-java all 3.3.4-1 [48.5 kB] 2024-09-12T16:56:41.571 INFO:teuthology.orchestra.run.smithi019.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-resolver-java all 1.4.2-3build1 [555 kB] 2024-09-12T16:56:41.577 INFO:teuthology.orchestra.run.smithi019.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libmaven-shared-utils-java all 3.3.0-1ubuntu0.22.04.1 [148 kB] 2024-09-12T16:56:41.583 INFO:teuthology.orchestra.run.smithi019.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-cipher-java all 1.8-2 [15.1 kB] 2024-09-12T16:56:41.596 INFO:teuthology.orchestra.run.smithi019.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-classworlds-java all 2.6.0-1 [49.4 kB] 2024-09-12T16:56:41.596 INFO:teuthology.orchestra.run.smithi019.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-component-annotations-java all 2.1.0-1 [6,564 B] 2024-09-12T16:56:41.597 INFO:teuthology.orchestra.run.smithi019.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-interpolation-java all 1.26-1 [76.8 kB] 2024-09-12T16:56:41.597 INFO:teuthology.orchestra.run.smithi019.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-sec-dispatcher-java all 1.4-4 [28.1 kB] 2024-09-12T16:56:41.598 INFO:teuthology.orchestra.run.smithi019.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libslf4j-java all 1.7.32-1 [141 kB] 2024-09-12T16:56:41.600 INFO:teuthology.orchestra.run.smithi019.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-inject-java all 0.3.4-2 [347 kB] 2024-09-12T16:56:41.603 INFO:teuthology.orchestra.run.smithi019.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-plexus-java all 0.3.4-3 [181 kB] 2024-09-12T16:56:41.605 INFO:teuthology.orchestra.run.smithi019.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven3-core-java all 3.6.3-5 [1,535 kB] 2024-09-12T16:56:41.620 INFO:teuthology.orchestra.run.smithi019.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-file-java all 3.3.4-1 [7,928 B] 2024-09-12T16:56:41.620 INFO:teuthology.orchestra.run.smithi019.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-http-shaded-java all 3.3.4-1 [1,855 kB] 2024-09-12T16:56:41.638 INFO:teuthology.orchestra.run.smithi019.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 maven all 3.6.3-5 [17.8 kB] 2024-09-12T16:56:41.638 INFO:teuthology.orchestra.run.smithi019.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-magic all 2:0.4.24-2 [12.6 kB] 2024-09-12T16:56:41.638 INFO:teuthology.orchestra.run.smithi019.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 s3cmd all 2.2.0-1 [120 kB] 2024-09-12T16:56:41.678 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:41.829 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mon (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:42.032 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T16:56:42.032 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T16:56:42.100 INFO:teuthology.orchestra.run.smithi019.stdout:Fetched 10.4 MB in 0s (33.5 MB/s) 2024-09-12T16:56:42.188 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libapache-pom-java. 2024-09-12T16:56:42.275 INFO:teuthology.orchestra.run.smithi019.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176248 files and directories currently installed.) 2024-09-12T16:56:42.281 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../00-libapache-pom-java_18-1_all.deb ... 2024-09-12T16:56:42.320 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libapache-pom-java (18-1) ... 2024-09-12T16:56:42.538 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:42.572 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libatinject-jsr330-api-java. 2024-09-12T16:56:42.590 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../01-libatinject-jsr330-api-java_1.0+ds1-5_all.deb ... 2024-09-12T16:56:42.631 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T16:56:42.673 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:42.799 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-dashboard (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:42.883 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libgeronimo-interceptor-3.0-spec-java. 2024-09-12T16:56:42.901 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../02-libgeronimo-interceptor-3.0-spec-java_1.0.1-4fakesync_all.deb ... 2024-09-12T16:56:42.942 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T16:56:42.950 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-volume (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T16:56:43.153 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libcdi-api-java. 2024-09-12T16:56:43.181 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../03-libcdi-api-java_1.2-3_all.deb ... 2024-09-12T16:56:43.211 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libcdi-api-java (1.2-3) ... 2024-09-12T16:56:43.395 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T16:56:43.488 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libcommons-cli-java. 2024-09-12T16:56:43.495 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T16:56:43.506 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../04-libcommons-cli-java_1.4-2_all.deb ... 2024-09-12T16:56:43.606 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libcommons-cli-java (1.4-2) ... 2024-09-12T16:56:43.648 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T16:56:43.892 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libcommons-parent-java. 2024-09-12T16:56:43.933 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../05-libcommons-parent-java_43-1_all.deb ... 2024-09-12T16:56:43.951 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libcommons-parent-java (43-1) ... 2024-09-12T16:56:44.217 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libcommons-io-java. 2024-09-12T16:56:44.249 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../06-libcommons-io-java_2.11.0-2_all.deb ... 2024-09-12T16:56:44.277 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libcommons-io-java (2.11.0-2) ... 2024-09-12T16:56:44.531 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libcommons-lang3-java. 2024-09-12T16:56:44.547 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../07-libcommons-lang3-java_3.11-1_all.deb ... 2024-09-12T16:56:44.597 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libcommons-lang3-java (3.11-1) ... 2024-09-12T16:56:44.677 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T16:56:44.891 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libgeronimo-annotation-1.3-spec-java. 2024-09-12T16:56:44.907 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../08-libgeronimo-annotation-1.3-spec-java_1.3-1_all.deb ... 2024-09-12T16:56:44.949 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T16:56:45.227 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libjsr305-java. 2024-09-12T16:56:45.255 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../09-libjsr305-java_0.1~+svn49-11_all.deb ... 2024-09-12T16:56:45.293 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libjsr305-java (0.1~+svn49-11) ... 2024-09-12T16:56:45.327 INFO:teuthology.orchestra.run.smithi016.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T16:56:45.330 DEBUG:teuthology.orchestra.run.smithi016:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install s3cmd maven 2024-09-12T16:56:45.385 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2024-09-12T16:56:45.546 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libguava-java. 2024-09-12T16:56:45.574 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../10-libguava-java_29.0-6_all.deb ... 2024-09-12T16:56:45.600 INFO:teuthology.orchestra.run.smithi016.stdout:Building dependency tree... 2024-09-12T16:56:45.600 INFO:teuthology.orchestra.run.smithi016.stdout:Reading state information... 2024-09-12T16:56:45.612 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libguava-java (29.0-6) ... 2024-09-12T16:56:45.793 INFO:teuthology.orchestra.run.smithi016.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T16:56:45.793 INFO:teuthology.orchestra.run.smithi016.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T16:56:45.793 INFO:teuthology.orchestra.run.smithi016.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T16:56:45.794 INFO:teuthology.orchestra.run.smithi016.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T16:56:45.794 INFO:teuthology.orchestra.run.smithi016.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T16:56:45.794 INFO:teuthology.orchestra.run.smithi016.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T16:56:45.794 INFO:teuthology.orchestra.run.smithi016.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T16:56:45.795 INFO:teuthology.orchestra.run.smithi016.stdout:The following additional packages will be installed: 2024-09-12T16:56:45.796 INFO:teuthology.orchestra.run.smithi016.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T16:56:45.796 INFO:teuthology.orchestra.run.smithi016.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T16:56:45.796 INFO:teuthology.orchestra.run.smithi016.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T16:56:45.796 INFO:teuthology.orchestra.run.smithi016.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T16:56:45.796 INFO:teuthology.orchestra.run.smithi016.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T16:56:45.796 INFO:teuthology.orchestra.run.smithi016.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T16:56:45.797 INFO:teuthology.orchestra.run.smithi016.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T16:56:45.797 INFO:teuthology.orchestra.run.smithi016.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T16:56:45.797 INFO:teuthology.orchestra.run.smithi016.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T16:56:45.797 INFO:teuthology.orchestra.run.smithi016.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T16:56:45.797 INFO:teuthology.orchestra.run.smithi016.stdout: libwagon-http-shaded-java libwagon-provider-api-java python3-magic 2024-09-12T16:56:45.798 INFO:teuthology.orchestra.run.smithi016.stdout:Suggested packages: 2024-09-12T16:56:45.798 INFO:teuthology.orchestra.run.smithi016.stdout: libaopalliance-java-doc libatinject-jsr330-api-java-doc libel-api-java 2024-09-12T16:56:45.798 INFO:teuthology.orchestra.run.smithi016.stdout: libcommons-io-java-doc libcommons-lang3-java-doc libasm-java libcglib-java 2024-09-12T16:56:45.798 INFO:teuthology.orchestra.run.smithi016.stdout: libjsr305-java-doc libmaven-shared-utils-java-doc liblogback-java 2024-09-12T16:56:45.798 INFO:teuthology.orchestra.run.smithi016.stdout: libplexus-classworlds-java-doc libplexus-sec-dispatcher-java-doc 2024-09-12T16:56:45.798 INFO:teuthology.orchestra.run.smithi016.stdout: libplexus-utils2-java-doc testng libcommons-logging-java liblog4j1.2-java 2024-09-12T16:56:45.839 INFO:teuthology.orchestra.run.smithi016.stdout:The following NEW packages will be installed: 2024-09-12T16:56:45.839 INFO:teuthology.orchestra.run.smithi016.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T16:56:45.839 INFO:teuthology.orchestra.run.smithi016.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T16:56:45.839 INFO:teuthology.orchestra.run.smithi016.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T16:56:45.839 INFO:teuthology.orchestra.run.smithi016.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T16:56:45.839 INFO:teuthology.orchestra.run.smithi016.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T16:56:45.839 INFO:teuthology.orchestra.run.smithi016.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T16:56:45.839 INFO:teuthology.orchestra.run.smithi016.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T16:56:45.840 INFO:teuthology.orchestra.run.smithi016.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T16:56:45.840 INFO:teuthology.orchestra.run.smithi016.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T16:56:45.840 INFO:teuthology.orchestra.run.smithi016.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T16:56:45.840 INFO:teuthology.orchestra.run.smithi016.stdout: libwagon-http-shaded-java libwagon-provider-api-java maven python3-magic 2024-09-12T16:56:45.840 INFO:teuthology.orchestra.run.smithi016.stdout: s3cmd 2024-09-12T16:56:46.021 INFO:teuthology.orchestra.run.smithi016.stdout:0 upgraded, 35 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T16:56:46.021 INFO:teuthology.orchestra.run.smithi016.stdout:Need to get 10.4 MB of archives. 2024-09-12T16:56:46.021 INFO:teuthology.orchestra.run.smithi016.stdout:After this operation, 13.9 MB of additional disk space will be used. 2024-09-12T16:56:46.021 INFO:teuthology.orchestra.run.smithi016.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libapache-pom-java all 18-1 [4,720 B] 2024-09-12T16:56:46.049 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libaopalliance-java. 2024-09-12T16:56:46.065 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../11-libaopalliance-java_20070526-6_all.deb ... 2024-09-12T16:56:46.103 INFO:teuthology.orchestra.run.smithi016.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libatinject-jsr330-api-java all 1.0+ds1-5 [5,348 B] 2024-09-12T16:56:46.104 INFO:teuthology.orchestra.run.smithi016.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-interceptor-3.0-spec-java all 1.0.1-4fakesync [8,616 B] 2024-09-12T16:56:46.107 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libaopalliance-java (20070526-6) ... 2024-09-12T16:56:46.120 INFO:teuthology.orchestra.run.smithi016.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcdi-api-java all 1.2-3 [54.3 kB] 2024-09-12T16:56:46.284 INFO:teuthology.orchestra.run.smithi016.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-cli-java all 1.4-2 [55.8 kB] 2024-09-12T16:56:46.354 INFO:teuthology.orchestra.run.smithi016.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-parent-java all 43-1 [10.8 kB] 2024-09-12T16:56:46.359 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libguice-java. 2024-09-12T16:56:46.362 INFO:teuthology.orchestra.run.smithi016.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-io-java all 2.11.0-2 [297 kB] 2024-09-12T16:56:46.376 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../12-libguice-java_4.2.3-2_all.deb ... 2024-09-12T16:56:46.417 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libguice-java (4.2.3-2) ... 2024-09-12T16:56:46.497 INFO:teuthology.orchestra.run.smithi016.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-lang3-java all 3.11-1 [526 kB] 2024-09-12T16:56:46.591 INFO:teuthology.orchestra.run.smithi016.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-annotation-1.3-spec-java all 1.3-1 [11.2 kB] 2024-09-12T16:56:46.592 INFO:teuthology.orchestra.run.smithi016.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjsr305-java all 0.1~+svn49-11 [27.0 kB] 2024-09-12T16:56:46.595 INFO:teuthology.orchestra.run.smithi016.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguava-java all 29.0-6 [2,418 kB] 2024-09-12T16:56:46.747 INFO:teuthology.orchestra.run.smithi016.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libaopalliance-java all 20070526-6 [9,084 B] 2024-09-12T16:56:46.747 INFO:teuthology.orchestra.run.smithi016.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguice-java all 4.2.3-2 [1,434 kB] 2024-09-12T16:56:46.763 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libhawtjni-runtime-java. 2024-09-12T16:56:46.777 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../13-libhawtjni-runtime-java_1.17-1_all.deb ... 2024-09-12T16:56:46.789 INFO:teuthology.orchestra.run.smithi016.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libhawtjni-runtime-java all 1.17-1 [28.8 kB] 2024-09-12T16:56:46.789 INFO:teuthology.orchestra.run.smithi016.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-native-java all 1.8-1 [23.8 kB] 2024-09-12T16:56:46.791 INFO:teuthology.orchestra.run.smithi016.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-java all 1.18-1 [56.8 kB] 2024-09-12T16:56:46.792 INFO:teuthology.orchestra.run.smithi016.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-parent-java all 31-2 [5,140 B] 2024-09-12T16:56:46.793 INFO:teuthology.orchestra.run.smithi016.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-utils2-java all 3.3.0-1 [250 kB] 2024-09-12T16:56:46.800 INFO:teuthology.orchestra.run.smithi016.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-provider-api-java all 3.3.4-1 [48.5 kB] 2024-09-12T16:56:46.801 INFO:teuthology.orchestra.run.smithi016.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-resolver-java all 1.4.2-3build1 [555 kB] 2024-09-12T16:56:46.813 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libhawtjni-runtime-java (1.17-1) ... 2024-09-12T16:56:46.837 INFO:teuthology.orchestra.run.smithi016.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libmaven-shared-utils-java all 3.3.0-1ubuntu0.22.04.1 [148 kB] 2024-09-12T16:56:46.840 INFO:teuthology.orchestra.run.smithi016.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-cipher-java all 1.8-2 [15.1 kB] 2024-09-12T16:56:46.899 INFO:teuthology.orchestra.run.smithi016.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-classworlds-java all 2.6.0-1 [49.4 kB] 2024-09-12T16:56:46.900 INFO:teuthology.orchestra.run.smithi016.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-component-annotations-java all 2.1.0-1 [6,564 B] 2024-09-12T16:56:46.901 INFO:teuthology.orchestra.run.smithi016.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-interpolation-java all 1.26-1 [76.8 kB] 2024-09-12T16:56:46.903 INFO:teuthology.orchestra.run.smithi016.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-sec-dispatcher-java all 1.4-4 [28.1 kB] 2024-09-12T16:56:46.904 INFO:teuthology.orchestra.run.smithi016.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libslf4j-java all 1.7.32-1 [141 kB] 2024-09-12T16:56:46.919 INFO:teuthology.orchestra.run.smithi016.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-inject-java all 0.3.4-2 [347 kB] 2024-09-12T16:56:46.927 INFO:teuthology.orchestra.run.smithi016.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-plexus-java all 0.3.4-3 [181 kB] 2024-09-12T16:56:46.931 INFO:teuthology.orchestra.run.smithi016.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven3-core-java all 3.6.3-5 [1,535 kB] 2024-09-12T16:56:47.000 INFO:teuthology.orchestra.run.smithi016.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-file-java all 3.3.4-1 [7,928 B] 2024-09-12T16:56:47.000 INFO:teuthology.orchestra.run.smithi016.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-http-shaded-java all 3.3.4-1 [1,855 kB] 2024-09-12T16:56:47.034 INFO:teuthology.orchestra.run.smithi016.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 maven all 3.6.3-5 [17.8 kB] 2024-09-12T16:56:47.035 INFO:teuthology.orchestra.run.smithi016.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-magic all 2:0.4.24-2 [12.6 kB] 2024-09-12T16:56:47.035 INFO:teuthology.orchestra.run.smithi016.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 s3cmd all 2.2.0-1 [120 kB] 2024-09-12T16:56:47.066 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libjansi-native-java. 2024-09-12T16:56:47.094 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../14-libjansi-native-java_1.8-1_all.deb ... 2024-09-12T16:56:47.132 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libjansi-native-java (1.8-1) ... 2024-09-12T16:56:47.385 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libjansi-java. 2024-09-12T16:56:47.413 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../15-libjansi-java_1.18-1_all.deb ... 2024-09-12T16:56:47.451 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libjansi-java (1.18-1) ... 2024-09-12T16:56:47.493 INFO:teuthology.orchestra.run.smithi016.stdout:Fetched 10.4 MB in 1s (8,720 kB/s) 2024-09-12T16:56:47.573 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libapache-pom-java. 2024-09-12T16:56:47.654 INFO:teuthology.orchestra.run.smithi016.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176248 files and directories currently installed.) 2024-09-12T16:56:47.659 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../00-libapache-pom-java_18-1_all.deb ... 2024-09-12T16:56:47.704 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libmaven-parent-java. 2024-09-12T16:56:47.705 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libapache-pom-java (18-1) ... 2024-09-12T16:56:47.732 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../16-libmaven-parent-java_31-2_all.deb ... 2024-09-12T16:56:47.770 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libmaven-parent-java (31-2) ... 2024-09-12T16:56:47.949 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libatinject-jsr330-api-java. 2024-09-12T16:56:47.966 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../01-libatinject-jsr330-api-java_1.0+ds1-5_all.deb ... 2024-09-12T16:56:48.008 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T16:56:48.014 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libplexus-utils2-java. 2024-09-12T16:56:48.042 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../17-libplexus-utils2-java_3.3.0-1_all.deb ... 2024-09-12T16:56:48.081 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libplexus-utils2-java (3.3.0-1) ... 2024-09-12T16:56:48.235 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libgeronimo-interceptor-3.0-spec-java. 2024-09-12T16:56:48.253 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../02-libgeronimo-interceptor-3.0-spec-java_1.0.1-4fakesync_all.deb ... 2024-09-12T16:56:48.289 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T16:56:48.394 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libwagon-provider-api-java. 2024-09-12T16:56:48.422 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../18-libwagon-provider-api-java_3.3.4-1_all.deb ... 2024-09-12T16:56:48.458 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T16:56:48.513 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libcdi-api-java. 2024-09-12T16:56:48.530 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../03-libcdi-api-java_1.2-3_all.deb ... 2024-09-12T16:56:48.571 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libcdi-api-java (1.2-3) ... 2024-09-12T16:56:48.841 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libcommons-cli-java. 2024-09-12T16:56:48.870 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../04-libcommons-cli-java_1.4-2_all.deb ... 2024-09-12T16:56:48.907 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libcommons-cli-java (1.4-2) ... 2024-09-12T16:56:49.007 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libmaven-resolver-java. 2024-09-12T16:56:49.038 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../19-libmaven-resolver-java_1.4.2-3build1_all.deb ... 2024-09-12T16:56:49.253 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T16:56:49.318 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libcommons-parent-java. 2024-09-12T16:56:49.345 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../05-libcommons-parent-java_43-1_all.deb ... 2024-09-12T16:56:49.386 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libcommons-parent-java (43-1) ... 2024-09-12T16:56:49.566 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libmaven-shared-utils-java. 2024-09-12T16:56:49.595 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../20-libmaven-shared-utils-java_3.3.0-1ubuntu0.22.04.1_all.deb ... 2024-09-12T16:56:49.597 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libcommons-io-java. 2024-09-12T16:56:49.626 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../06-libcommons-io-java_2.11.0-2_all.deb ... 2024-09-12T16:56:49.633 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T16:56:49.655 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libcommons-io-java (2.11.0-2) ... 2024-09-12T16:56:49.877 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libplexus-cipher-java. 2024-09-12T16:56:49.903 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../21-libplexus-cipher-java_1.8-2_all.deb ... 2024-09-12T16:56:49.924 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libcommons-lang3-java. 2024-09-12T16:56:49.942 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../07-libcommons-lang3-java_3.11-1_all.deb ... 2024-09-12T16:56:49.943 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libplexus-cipher-java (1.8-2) ... 2024-09-12T16:56:49.982 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libcommons-lang3-java (3.11-1) ... 2024-09-12T16:56:50.163 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libplexus-classworlds-java. 2024-09-12T16:56:50.176 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../22-libplexus-classworlds-java_2.6.0-1_all.deb ... 2024-09-12T16:56:50.213 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T16:56:50.277 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libgeronimo-annotation-1.3-spec-java. 2024-09-12T16:56:50.294 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../08-libgeronimo-annotation-1.3-spec-java_1.3-1_all.deb ... 2024-09-12T16:56:50.335 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T16:56:50.474 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libplexus-component-annotations-java. 2024-09-12T16:56:50.490 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../23-libplexus-component-annotations-java_2.1.0-1_all.deb ... 2024-09-12T16:56:50.532 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T16:56:50.537 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libjsr305-java. 2024-09-12T16:56:50.551 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../09-libjsr305-java_0.1~+svn49-11_all.deb ... 2024-09-12T16:56:50.596 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libjsr305-java (0.1~+svn49-11) ... 2024-09-12T16:56:50.784 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libplexus-interpolation-java. 2024-09-12T16:56:50.807 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libguava-java. 2024-09-12T16:56:50.813 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../24-libplexus-interpolation-java_1.26-1_all.deb ... 2024-09-12T16:56:50.824 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../10-libguava-java_29.0-6_all.deb ... 2024-09-12T16:56:50.851 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libplexus-interpolation-java (1.26-1) ... 2024-09-12T16:56:50.856 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libguava-java (29.0-6) ... 2024-09-12T16:56:51.120 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libplexus-sec-dispatcher-java. 2024-09-12T16:56:51.149 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../25-libplexus-sec-dispatcher-java_1.4-4_all.deb ... 2024-09-12T16:56:51.186 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T16:56:51.293 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libaopalliance-java. 2024-09-12T16:56:51.311 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../11-libaopalliance-java_20070526-6_all.deb ... 2024-09-12T16:56:51.351 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libaopalliance-java (20070526-6) ... 2024-09-12T16:56:51.448 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libslf4j-java. 2024-09-12T16:56:51.476 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../26-libslf4j-java_1.7.32-1_all.deb ... 2024-09-12T16:56:51.506 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libslf4j-java (1.7.32-1) ... 2024-09-12T16:56:51.604 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libguice-java. 2024-09-12T16:56:51.620 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../12-libguice-java_4.2.3-2_all.deb ... 2024-09-12T16:56:51.662 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libguice-java (4.2.3-2) ... 2024-09-12T16:56:51.802 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libsisu-inject-java. 2024-09-12T16:56:51.830 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../27-libsisu-inject-java_0.3.4-2_all.deb ... 2024-09-12T16:56:51.868 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libsisu-inject-java (0.3.4-2) ... 2024-09-12T16:56:52.015 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libhawtjni-runtime-java. 2024-09-12T16:56:52.029 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../13-libhawtjni-runtime-java_1.17-1_all.deb ... 2024-09-12T16:56:52.065 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libhawtjni-runtime-java (1.17-1) ... 2024-09-12T16:56:52.154 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libsisu-plexus-java. 2024-09-12T16:56:52.170 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../28-libsisu-plexus-java_0.3.4-3_all.deb ... 2024-09-12T16:56:52.212 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libsisu-plexus-java (0.3.4-3) ... 2024-09-12T16:56:52.302 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libjansi-native-java. 2024-09-12T16:56:52.319 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../14-libjansi-native-java_1.8-1_all.deb ... 2024-09-12T16:56:52.360 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libjansi-native-java (1.8-1) ... 2024-09-12T16:56:52.481 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libmaven3-core-java. 2024-09-12T16:56:52.510 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../29-libmaven3-core-java_3.6.3-5_all.deb ... 2024-09-12T16:56:52.548 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libmaven3-core-java (3.6.3-5) ... 2024-09-12T16:56:52.612 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libjansi-java. 2024-09-12T16:56:52.641 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../15-libjansi-java_1.18-1_all.deb ... 2024-09-12T16:56:52.679 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libjansi-java (1.18-1) ... 2024-09-12T16:56:52.919 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libwagon-file-java. 2024-09-12T16:56:52.937 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../30-libwagon-file-java_3.3.4-1_all.deb ... 2024-09-12T16:56:52.939 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libmaven-parent-java. 2024-09-12T16:56:52.957 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../16-libmaven-parent-java_31-2_all.deb ... 2024-09-12T16:56:52.977 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libwagon-file-java (3.3.4-1) ... 2024-09-12T16:56:52.998 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libmaven-parent-java (31-2) ... 2024-09-12T16:56:53.229 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libwagon-http-shaded-java. 2024-09-12T16:56:53.258 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../31-libwagon-http-shaded-java_3.3.4-1_all.deb ... 2024-09-12T16:56:53.296 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T16:56:53.350 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libplexus-utils2-java. 2024-09-12T16:56:53.368 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../17-libplexus-utils2-java_3.3.0-1_all.deb ... 2024-09-12T16:56:53.409 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libplexus-utils2-java (3.3.0-1) ... 2024-09-12T16:56:53.645 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libwagon-provider-api-java. 2024-09-12T16:56:53.662 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../18-libwagon-provider-api-java_3.3.4-1_all.deb ... 2024-09-12T16:56:53.695 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T16:56:53.724 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package maven. 2024-09-12T16:56:53.742 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../32-maven_3.6.3-5_all.deb ... 2024-09-12T16:56:53.782 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking maven (3.6.3-5) ... 2024-09-12T16:56:53.947 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libmaven-resolver-java. 2024-09-12T16:56:53.965 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../19-libmaven-resolver-java_1.4.2-3build1_all.deb ... 2024-09-12T16:56:54.006 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T16:56:54.052 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-magic. 2024-09-12T16:56:54.081 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../33-python3-magic_2%3a0.4.24-2_all.deb ... 2024-09-12T16:56:54.110 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-magic (2:0.4.24-2) ... 2024-09-12T16:56:54.411 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libmaven-shared-utils-java. 2024-09-12T16:56:54.441 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../20-libmaven-shared-utils-java_3.3.0-1ubuntu0.22.04.1_all.deb ... 2024-09-12T16:56:54.477 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T16:56:54.480 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package s3cmd. 2024-09-12T16:56:54.509 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../34-s3cmd_2.2.0-1_all.deb ... 2024-09-12T16:56:54.546 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking s3cmd (2.2.0-1) ... 2024-09-12T16:56:54.713 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libplexus-cipher-java. 2024-09-12T16:56:54.730 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../21-libplexus-cipher-java_1.8-2_all.deb ... 2024-09-12T16:56:54.763 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libplexus-cipher-java (1.8-2) ... 2024-09-12T16:56:54.910 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libslf4j-java (1.7.32-1) ... 2024-09-12T16:56:55.008 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libplexus-classworlds-java. 2024-09-12T16:56:55.019 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libplexus-utils2-java (3.3.0-1) ... 2024-09-12T16:56:55.025 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../22-libplexus-classworlds-java_2.6.0-1_all.deb ... 2024-09-12T16:56:55.057 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T16:56:55.120 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T16:56:55.229 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libjsr305-java (0.1~+svn49-11) ... 2024-09-12T16:56:55.285 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libplexus-component-annotations-java. 2024-09-12T16:56:55.303 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../23-libplexus-component-annotations-java_2.1.0-1_all.deb ... 2024-09-12T16:56:55.343 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T16:56:55.355 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libaopalliance-java (20070526-6) ... 2024-09-12T16:56:55.489 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libcommons-cli-java (1.4-2) ... 2024-09-12T16:56:55.604 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libplexus-interpolation-java. 2024-09-12T16:56:55.615 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T16:56:55.621 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../24-libplexus-interpolation-java_1.26-1_all.deb ... 2024-09-12T16:56:55.662 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libplexus-interpolation-java (1.26-1) ... 2024-09-12T16:56:55.741 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libplexus-cipher-java (1.8-2) ... 2024-09-12T16:56:55.867 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T16:56:55.948 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libplexus-sec-dispatcher-java. 2024-09-12T16:56:55.965 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../25-libplexus-sec-dispatcher-java_1.4-4_all.deb ... 2024-09-12T16:56:55.993 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T16:56:56.006 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T16:56:56.094 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libapache-pom-java (18-1) ... 2024-09-12T16:56:56.195 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T16:56:56.209 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libslf4j-java. 2024-09-12T16:56:56.226 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../26-libslf4j-java_1.7.32-1_all.deb ... 2024-09-12T16:56:56.267 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libslf4j-java (1.7.32-1) ... 2024-09-12T16:56:56.296 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libplexus-interpolation-java (1.26-1) ... 2024-09-12T16:56:56.422 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T16:56:56.530 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libsisu-inject-java. 2024-09-12T16:56:56.556 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T16:56:56.558 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../27-libsisu-inject-java_0.3.4-2_all.deb ... 2024-09-12T16:56:56.596 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libsisu-inject-java (0.3.4-2) ... 2024-09-12T16:56:56.682 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-magic (2:0.4.24-2) ... 2024-09-12T16:56:56.874 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libsisu-plexus-java. 2024-09-12T16:56:56.891 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../28-libsisu-plexus-java_0.3.4-3_all.deb ... 2024-09-12T16:56:56.932 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libsisu-plexus-java (0.3.4-3) ... 2024-09-12T16:56:56.942 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libcdi-api-java (1.2-3) ... 2024-09-12T16:56:57.043 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libhawtjni-runtime-java (1.17-1) ... 2024-09-12T16:56:57.169 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T16:56:57.201 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libmaven3-core-java. 2024-09-12T16:56:57.218 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../29-libmaven3-core-java_3.6.3-5_all.deb ... 2024-09-12T16:56:57.260 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libmaven3-core-java (3.6.3-5) ... 2024-09-12T16:56:57.295 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libmaven-parent-java (31-2) ... 2024-09-12T16:56:57.446 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libcommons-parent-java (43-1) ... 2024-09-12T16:56:57.572 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libsisu-inject-java (0.3.4-2) ... 2024-09-12T16:56:57.606 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libwagon-file-java. 2024-09-12T16:56:57.619 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../30-libwagon-file-java_3.3.4-1_all.deb ... 2024-09-12T16:56:57.664 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libwagon-file-java (3.3.4-1) ... 2024-09-12T16:56:57.706 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up s3cmd (2.2.0-1) ... 2024-09-12T16:56:57.916 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libwagon-http-shaded-java. 2024-09-12T16:56:57.945 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../31-libwagon-http-shaded-java_3.3.4-1_all.deb ... 2024-09-12T16:56:57.983 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T16:56:58.007 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libsisu-plexus-java (0.3.4-3) ... 2024-09-12T16:56:58.134 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T16:56:58.260 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libguava-java (29.0-6) ... 2024-09-12T16:56:58.377 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libcommons-lang3-java (3.11-1) ... 2024-09-12T16:56:58.444 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package maven. 2024-09-12T16:56:58.473 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../32-maven_3.6.3-5_all.deb ... 2024-09-12T16:56:58.478 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libjansi-native-java (1.8-1) ... 2024-09-12T16:56:58.527 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking maven (3.6.3-5) ... 2024-09-12T16:56:58.579 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libwagon-file-java (3.3.4-1) ... 2024-09-12T16:56:58.713 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libcommons-io-java (2.11.0-2) ... 2024-09-12T16:56:58.797 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-magic. 2024-09-12T16:56:58.826 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../33-python3-magic_2%3a0.4.24-2_all.deb ... 2024-09-12T16:56:58.839 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libguice-java (4.2.3-2) ... 2024-09-12T16:56:58.855 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-magic (2:0.4.24-2) ... 2024-09-12T16:56:58.965 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libjansi-java (1.18-1) ... 2024-09-12T16:56:59.091 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T16:56:59.141 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package s3cmd. 2024-09-12T16:56:59.159 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../34-s3cmd_2.2.0-1_all.deb ... 2024-09-12T16:56:59.199 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking s3cmd (2.2.0-1) ... 2024-09-12T16:56:59.217 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libmaven3-core-java (3.6.3-5) ... 2024-09-12T16:56:59.343 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up maven (3.6.3-5) ... 2024-09-12T16:56:59.567 INFO:teuthology.orchestra.run.smithi019.stdout:update-alternatives: using /usr/share/maven/bin/mvn to provide /usr/bin/mvn (mvn) in auto mode 2024-09-12T16:56:59.621 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libslf4j-java (1.7.32-1) ... 2024-09-12T16:56:59.622 INFO:teuthology.orchestra.run.smithi019.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T16:56:59.764 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libplexus-utils2-java (3.3.0-1) ... 2024-09-12T16:56:59.890 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T16:57:00.024 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libjsr305-java (0.1~+svn49-11) ... 2024-09-12T16:57:00.125 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libaopalliance-java (20070526-6) ... 2024-09-12T16:57:00.252 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libcommons-cli-java (1.4-2) ... 2024-09-12T16:57:00.378 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T16:57:00.504 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libplexus-cipher-java (1.8-2) ... 2024-09-12T16:57:00.630 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T16:57:00.756 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T16:57:00.882 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libapache-pom-java (18-1) ... 2024-09-12T16:57:00.999 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T16:57:01.131 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libplexus-interpolation-java (1.26-1) ... 2024-09-12T16:57:01.132 INFO:teuthology.orchestra.run.smithi019.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T16:57:01.136 DEBUG:teuthology.parallel:result is None 2024-09-12T16:57:01.201 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T16:57:01.336 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T16:57:01.462 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-magic (2:0.4.24-2) ... 2024-09-12T16:57:01.730 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libcdi-api-java (1.2-3) ... 2024-09-12T16:57:01.856 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libhawtjni-runtime-java (1.17-1) ... 2024-09-12T16:57:01.982 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T16:57:02.083 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libmaven-parent-java (31-2) ... 2024-09-12T16:57:02.184 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libcommons-parent-java (43-1) ... 2024-09-12T16:57:02.302 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libsisu-inject-java (0.3.4-2) ... 2024-09-12T16:57:02.428 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up s3cmd (2.2.0-1) ... 2024-09-12T16:57:02.737 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libsisu-plexus-java (0.3.4-3) ... 2024-09-12T16:57:02.864 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T16:57:02.989 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libguava-java (29.0-6) ... 2024-09-12T16:57:03.115 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libcommons-lang3-java (3.11-1) ... 2024-09-12T16:57:03.233 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libjansi-native-java (1.8-1) ... 2024-09-12T16:57:03.342 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libwagon-file-java (3.3.4-1) ... 2024-09-12T16:57:03.460 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libcommons-io-java (2.11.0-2) ... 2024-09-12T16:57:03.603 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libguice-java (4.2.3-2) ... 2024-09-12T16:57:03.729 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libjansi-java (1.18-1) ... 2024-09-12T16:57:03.855 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T16:57:03.981 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libmaven3-core-java (3.6.3-5) ... 2024-09-12T16:57:04.124 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up maven (3.6.3-5) ... 2024-09-12T16:57:04.364 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/share/maven/bin/mvn to provide /usr/bin/mvn (mvn) in auto mode 2024-09-12T16:57:04.486 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T16:57:05.827 INFO:teuthology.orchestra.run.smithi016.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T16:57:05.832 DEBUG:teuthology.parallel:result is None 2024-09-12T16:57:05.833 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T16:57:05.980 DEBUG:teuthology.orchestra.run.smithi016:> dpkg-query -W -f '${Version}' ceph 2024-09-12T16:57:05.999 INFO:teuthology.orchestra.run.smithi016.stdout:19.3.0-4762-gbad475c1-1jammy 2024-09-12T16:57:06.000 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4762-gbad475c1-1jammy 2024-09-12T16:57:06.000 INFO:teuthology.task.install:The correct ceph version 19.3.0-4762-gbad475c1-1jammy is installed. 2024-09-12T16:57:06.002 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T16:57:06.141 DEBUG:teuthology.orchestra.run.smithi019:> dpkg-query -W -f '${Version}' ceph 2024-09-12T16:57:06.162 INFO:teuthology.orchestra.run.smithi019.stdout:19.3.0-4762-gbad475c1-1jammy 2024-09-12T16:57:06.162 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4762-gbad475c1-1jammy 2024-09-12T16:57:06.162 INFO:teuthology.task.install:The correct ceph version 19.3.0-4762-gbad475c1-1jammy is installed. 2024-09-12T16:57:06.164 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T16:57:06.164 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-12T16:57:06.164 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T16:57:06.182 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T16:57:06.182 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T16:57:06.226 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T16:57:06.226 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-12T16:57:06.226 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T16:57:06.240 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T16:57:06.308 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T16:57:06.308 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T16:57:06.326 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T16:57:06.381 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T16:57:06.381 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-12T16:57:06.382 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T16:57:06.395 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T16:57:06.454 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T16:57:06.454 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T16:57:06.469 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T16:57:06.537 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T16:57:06.538 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-12T16:57:06.538 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T16:57:06.552 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T16:57:06.607 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T16:57:06.607 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T16:57:06.621 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T16:57:06.677 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T16:57:08.338 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T16:57:08.338 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 777 /var/log/ceph 2024-09-12T16:57:08.344 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 777 /var/log/ceph 2024-09-12T16:57:08.359 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T16:57:08.359 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T16:57:08.400 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T16:57:08.417 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T16:57:08.417 DEBUG:teuthology.orchestra.run.smithi016:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T16:57:08.457 DEBUG:teuthology.orchestra.run.smithi019:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T16:57:08.918 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T16:57:08.918 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T16:57:08.918 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902695', 'branch': 'wip-rgw-meta-handlers', 'description': 'rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep}', 'email': None, 'first_in_suite': False, 'job_id': '7902695', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-rgw-meta-handlers'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, 'rgw': {'compression type': 'random', 'ec-data-pool': False, 'frontend': 'beast', 'inline data': False, 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rgw-meta-handlers', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 6279, 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-rgw-meta-handlers', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'targets': {'smithi016.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIBhD+b7GMceAXINIDKeamDSffskdFZ48f4juY/QzsmgBtufRoeNYJlfkw127Il5PlNjqwui02clHZXt+Ol49WA=', 'smithi019.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJcYaOgMdpI1ansrczjZ69fzlLmZT2Po9KC5yBFHow8JchqIiXiFuAZSf28p4wwh1sPdSaYpFVv4IyWb0EivN1k='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-12_15:39:52', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T16:57:08.919 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T16:57:08.925 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T16:57:08.934 DEBUG:teuthology.orchestra.run.smithi016:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T16:57:08.977 DEBUG:teuthology.orchestra.run.smithi019:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T16:57:08.995 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-12T16:57:08.995 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T16:57:09.036 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T16:57:09.036 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_1 2024-09-12T16:57:09.086 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T16:57:09.086 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T16:57:09.086 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 884 Links: 1 2024-09-12T16:57:09.086 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T16:57:09.086 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-09-12 16:51:09.939486915 +0000 2024-09-12T16:57:09.086 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-09-12 16:51:09.935486952 +0000 2024-09-12T16:57:09.086 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-09-12 16:51:09.935486952 +0000 2024-09-12T16:57:09.086 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: - 2024-09-12T16:57:09.087 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T16:57:09.143 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-09-12T16:57:09.143 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-09-12T16:57:09.143 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000212678 s, 2.4 MB/s 2024-09-12T16:57:09.145 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T16:57:09.194 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_2 2024-09-12T16:57:09.243 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T16:57:09.243 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T16:57:09.243 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 902 Links: 1 2024-09-12T16:57:09.243 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T16:57:09.243 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-09-12 16:51:10.667480412 +0000 2024-09-12T16:57:09.244 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-09-12 16:51:10.415482664 +0000 2024-09-12T16:57:09.244 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-09-12 16:51:10.415482664 +0000 2024-09-12T16:57:09.244 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: - 2024-09-12T16:57:09.244 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T16:57:09.298 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-09-12T16:57:09.298 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-09-12T16:57:09.298 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000301083 s, 1.7 MB/s 2024-09-12T16:57:09.300 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T16:57:09.349 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_3 2024-09-12T16:57:09.395 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T16:57:09.395 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T16:57:09.395 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 917 Links: 1 2024-09-12T16:57:09.395 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T16:57:09.396 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-09-12 16:51:11.151476089 +0000 2024-09-12T16:57:09.396 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-09-12 16:51:10.907478270 +0000 2024-09-12T16:57:09.396 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-09-12 16:51:10.907478270 +0000 2024-09-12T16:57:09.396 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: - 2024-09-12T16:57:09.396 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T16:57:09.449 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-09-12T16:57:09.449 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-09-12T16:57:09.450 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000330719 s, 1.5 MB/s 2024-09-12T16:57:09.451 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T16:57:09.502 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_4 2024-09-12T16:57:09.551 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T16:57:09.551 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T16:57:09.551 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 929 Links: 1 2024-09-12T16:57:09.551 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T16:57:09.551 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-09-12 16:51:11.651471624 +0000 2024-09-12T16:57:09.551 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-09-12 16:51:11.387473981 +0000 2024-09-12T16:57:09.551 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-09-12 16:51:11.387473981 +0000 2024-09-12T16:57:09.552 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: - 2024-09-12T16:57:09.552 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T16:57:09.605 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-09-12T16:57:09.605 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-09-12T16:57:09.605 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000208644 s, 2.5 MB/s 2024-09-12T16:57:09.606 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T16:57:09.660 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T16:57:09.661 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T16:57:09.661 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T16:57:09.667 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T16:57:09.667 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_1 2024-09-12T16:57:09.713 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T16:57:09.713 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T16:57:09.713 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 885 Links: 1 2024-09-12T16:57:09.713 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T16:57:09.713 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-09-12 16:51:11.980141595 +0000 2024-09-12T16:57:09.713 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-09-12 16:51:11.976141631 +0000 2024-09-12T16:57:09.713 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-09-12 16:51:11.976141631 +0000 2024-09-12T16:57:09.714 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: - 2024-09-12T16:57:09.714 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T16:57:09.767 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-09-12T16:57:09.767 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-09-12T16:57:09.768 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000434493 s, 1.2 MB/s 2024-09-12T16:57:09.769 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T16:57:09.818 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_2 2024-09-12T16:57:09.864 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T16:57:09.865 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T16:57:09.865 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 895 Links: 1 2024-09-12T16:57:09.865 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T16:57:09.865 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-09-12 16:51:12.752134700 +0000 2024-09-12T16:57:09.865 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-09-12 16:51:12.500136951 +0000 2024-09-12T16:57:09.865 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-09-12 16:51:12.500136951 +0000 2024-09-12T16:57:09.865 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: - 2024-09-12T16:57:09.865 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T16:57:09.919 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-09-12T16:57:09.919 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-09-12T16:57:09.919 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000383663 s, 1.3 MB/s 2024-09-12T16:57:09.920 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T16:57:09.973 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_3 2024-09-12T16:57:10.020 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T16:57:10.020 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T16:57:10.021 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 920 Links: 1 2024-09-12T16:57:10.021 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T16:57:10.021 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-09-12 16:51:13.272130055 +0000 2024-09-12T16:57:10.021 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-09-12 16:51:13.008132413 +0000 2024-09-12T16:57:10.021 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-09-12 16:51:13.008132413 +0000 2024-09-12T16:57:10.021 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: - 2024-09-12T16:57:10.021 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T16:57:10.075 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-09-12T16:57:10.075 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-09-12T16:57:10.075 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000426114 s, 1.2 MB/s 2024-09-12T16:57:10.076 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T16:57:10.126 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_4 2024-09-12T16:57:10.172 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T16:57:10.173 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T16:57:10.173 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 937 Links: 1 2024-09-12T16:57:10.173 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T16:57:10.173 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-09-12 16:51:13.748125802 +0000 2024-09-12T16:57:10.173 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-09-12 16:51:13.508127947 +0000 2024-09-12T16:57:10.173 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-09-12 16:51:13.508127947 +0000 2024-09-12T16:57:10.173 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: - 2024-09-12T16:57:10.174 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T16:57:10.227 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-09-12T16:57:10.227 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-09-12T16:57:10.227 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000318173 s, 1.6 MB/s 2024-09-12T16:57:10.228 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T16:57:10.278 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T16:57:10.278 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi016.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi019.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T16:57:10.278 INFO:tasks.ceph:Generating config... 2024-09-12T16:57:10.279 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-12T16:57:10.279 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-09-12T16:57:10.280 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-09-12T16:57:10.280 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-09-12T16:57:10.280 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-09-12T16:57:10.280 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T16:57:10.280 INFO:tasks.ceph:[client] rgw reshard progress judge interval = 10 2024-09-12T16:57:10.280 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-09-12T16:57:10.280 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-09-12T16:57:10.280 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-09-12T16:57:10.280 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-09-12T16:57:10.280 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-12T16:57:10.280 INFO:tasks.ceph:[client] setuser = ceph 2024-09-12T16:57:10.280 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-12T16:57:10.280 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-12T16:57:10.281 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-09-12T16:57:10.281 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-09-12T16:57:10.281 INFO:tasks.ceph:[global] rgw override bucket index max shards = 1 2024-09-12T16:57:10.281 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T16:57:10.281 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T16:57:10.281 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T16:57:10.281 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T16:57:10.281 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T16:57:10.281 INFO:tasks.ceph:[mon] lockdep = True 2024-09-12T16:57:10.281 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-12T16:57:10.281 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-12T16:57:10.281 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-12T16:57:10.282 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T16:57:10.282 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T16:57:10.282 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-12T16:57:10.282 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-12T16:57:10.282 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T16:57:10.282 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-12T16:57:10.282 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T16:57:10.282 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-12T16:57:10.282 INFO:tasks.ceph:[osd] lockdep = True 2024-09-12T16:57:10.282 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T16:57:10.282 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T16:57:10.282 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T16:57:10.282 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T16:57:10.282 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T16:57:10.283 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-12T16:57:10.283 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T16:57:10.283 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T16:57:10.319 INFO:teuthology.orchestra.run.smithi016.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T16:57:10.331 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T16:57:10.410 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T16:57:10.471 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.16'), ('mon.c', '[v2:172.21.15.16:3301,v1:172.21.15.16:6790]'), ('mon.b', '172.21.15.19')] 2024-09-12T16:57:10.472 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.16,[v2:172.21.15.16:3301,v1:172.21.15.16:6790],172.21.15.19', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'lockdep': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-12T16:57:10.473 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-12T16:57:10.473 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T16:57:10.519 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.16 --addv c '[v2:172.21.15.16:3301,v1:172.21.15.16:6790]' --add b 172.21.15.19 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:57:10.606 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:57:10.607 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:57:10.607 INFO:teuthology.orchestra.run.smithi016.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:57:10.607 INFO:teuthology.orchestra.run.smithi016.stdout:monmaptool: generated fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T16:57:10.607 INFO:teuthology.orchestra.run.smithi016.stdout:setting min_mon_release = quincy 2024-09-12T16:57:10.607 INFO:teuthology.orchestra.run.smithi016.stdout:epoch 0 2024-09-12T16:57:10.607 INFO:teuthology.orchestra.run.smithi016.stdout:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T16:57:10.608 INFO:teuthology.orchestra.run.smithi016.stdout:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T16:57:10.608 INFO:teuthology.orchestra.run.smithi016.stdout:created 2024-09-12T16:57:10.607775+0000 2024-09-12T16:57:10.608 INFO:teuthology.orchestra.run.smithi016.stdout:min_mon_release 17 (quincy) 2024-09-12T16:57:10.608 INFO:teuthology.orchestra.run.smithi016.stdout:election_strategy: 1 2024-09-12T16:57:10.608 INFO:teuthology.orchestra.run.smithi016.stdout:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T16:57:10.608 INFO:teuthology.orchestra.run.smithi016.stdout:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T16:57:10.608 INFO:teuthology.orchestra.run.smithi016.stdout:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T16:57:10.608 INFO:teuthology.orchestra.run.smithi016.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-12T16:57:10.609 DEBUG:teuthology.orchestra.run.smithi016:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T16:57:10.614 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 78b0e714-9967-46cd-8c81-870ee811f04f... 2024-09-12T16:57:10.615 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T16:57:10.659 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T16:57:10.688 INFO:teuthology.orchestra.run.smithi016.stdout:[global] 2024-09-12T16:57:10.688 INFO:teuthology.orchestra.run.smithi016.stdout: chdir = "" 2024-09-12T16:57:10.688 INFO:teuthology.orchestra.run.smithi016.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T16:57:10.688 INFO:teuthology.orchestra.run.smithi016.stdout: auth supported = cephx 2024-09-12T16:57:10.689 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T16:57:10.689 INFO:teuthology.orchestra.run.smithi016.stdout: filestore xattr use omap = true 2024-09-12T16:57:10.689 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T16:57:10.689 INFO:teuthology.orchestra.run.smithi016.stdout: mon clock drift allowed = 1.000 2024-09-12T16:57:10.689 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T16:57:10.689 INFO:teuthology.orchestra.run.smithi016.stdout: osd crush chooseleaf type = 0 2024-09-12T16:57:10.689 INFO:teuthology.orchestra.run.smithi016.stdout: auth debug = true 2024-09-12T16:57:10.689 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T16:57:10.689 INFO:teuthology.orchestra.run.smithi016.stdout: ms die on old message = true 2024-09-12T16:57:10.689 INFO:teuthology.orchestra.run.smithi016.stdout: ms die on bug = true 2024-09-12T16:57:10.689 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T16:57:10.689 INFO:teuthology.orchestra.run.smithi016.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T16:57:10.689 INFO:teuthology.orchestra.run.smithi016.stdout: mon pg warn max object skew = 0 2024-09-12T16:57:10.689 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T16:57:10.690 INFO:teuthology.orchestra.run.smithi016.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T16:57:10.690 INFO:teuthology.orchestra.run.smithi016.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T16:57:10.690 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T16:57:10.690 INFO:teuthology.orchestra.run.smithi016.stdout: osd pool default size = 2 2024-09-12T16:57:10.690 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T16:57:10.690 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd allow primary affinity = true 2024-09-12T16:57:10.690 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd allow pg remap = true 2024-09-12T16:57:10.690 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on legacy crush tunables = false 2024-09-12T16:57:10.690 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on crush straw calc version zero = false 2024-09-12T16:57:10.690 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on no sortbitwise = false 2024-09-12T16:57:10.690 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on osd down out interval zero = false 2024-09-12T16:57:10.690 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on too few osds = false 2024-09-12T16:57:10.690 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T16:57:10.690 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T16:57:10.691 INFO:teuthology.orchestra.run.smithi016.stdout: mon_allow_pool_size_one = true 2024-09-12T16:57:10.691 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T16:57:10.691 INFO:teuthology.orchestra.run.smithi016.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T16:57:10.691 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T16:57:10.691 INFO:teuthology.orchestra.run.smithi016.stdout: osd default data pool replay window = 5 2024-09-12T16:57:10.691 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T16:57:10.691 INFO:teuthology.orchestra.run.smithi016.stdout: mon allow pool delete = true 2024-09-12T16:57:10.691 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T16:57:10.691 INFO:teuthology.orchestra.run.smithi016.stdout: mon cluster log file level = debug 2024-09-12T16:57:10.691 INFO:teuthology.orchestra.run.smithi016.stdout: debug asserts on shutdown = true 2024-09-12T16:57:10.691 INFO:teuthology.orchestra.run.smithi016.stdout: mon health detail to clog = false 2024-09-12T16:57:10.691 INFO:teuthology.orchestra.run.smithi016.stdout: mon host = "172.21.15.16,[v2:172.21.15.16:3301,v1:172.21.15.16:6790],172.21.15.19" 2024-09-12T16:57:10.691 INFO:teuthology.orchestra.run.smithi016.stdout: mon client directed command retry = 5 2024-09-12T16:57:10.691 INFO:teuthology.orchestra.run.smithi016.stdout: ms inject socket failures = 5000 2024-09-12T16:57:10.692 INFO:teuthology.orchestra.run.smithi016.stdout: osd_max_pg_log_entries = 10 2024-09-12T16:57:10.692 INFO:teuthology.orchestra.run.smithi016.stdout: osd_min_pg_log_entries = 10 2024-09-12T16:57:10.692 INFO:teuthology.orchestra.run.smithi016.stdout: rgw override bucket index max shards = 1 2024-09-12T16:57:10.692 INFO:teuthology.orchestra.run.smithi016.stdout: fsid = 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T16:57:10.692 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T16:57:10.692 INFO:teuthology.orchestra.run.smithi016.stdout:[osd] 2024-09-12T16:57:10.692 INFO:teuthology.orchestra.run.smithi016.stdout: osd journal size = 100 2024-09-12T16:57:10.692 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T16:57:10.692 INFO:teuthology.orchestra.run.smithi016.stdout: osd scrub load threshold = 5.0 2024-09-12T16:57:10.692 INFO:teuthology.orchestra.run.smithi016.stdout: osd scrub max interval = 600 2024-09-12T16:57:10.692 INFO:teuthology.orchestra.run.smithi016.stdout: osd mclock profile = high_recovery_ops 2024-09-12T16:57:10.692 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T16:57:10.693 INFO:teuthology.orchestra.run.smithi016.stdout: osd recover clone overlap = true 2024-09-12T16:57:10.693 INFO:teuthology.orchestra.run.smithi016.stdout: osd recovery max chunk = 1048576 2024-09-12T16:57:10.693 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T16:57:10.693 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug shutdown = true 2024-09-12T16:57:10.693 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug op order = true 2024-09-12T16:57:10.693 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug verify stray on activate = true 2024-09-12T16:57:10.693 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug trim objects = true 2024-09-12T16:57:10.693 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T16:57:10.693 INFO:teuthology.orchestra.run.smithi016.stdout: osd open classes on start = true 2024-09-12T16:57:10.693 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug pg log writeout = true 2024-09-12T16:57:10.693 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T16:57:10.693 INFO:teuthology.orchestra.run.smithi016.stdout: osd deep scrub update digest min age = 30 2024-09-12T16:57:10.693 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T16:57:10.694 INFO:teuthology.orchestra.run.smithi016.stdout: osd map max advance = 10 2024-09-12T16:57:10.694 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T16:57:10.694 INFO:teuthology.orchestra.run.smithi016.stdout: journal zero on create = true 2024-09-12T16:57:10.694 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T16:57:10.694 INFO:teuthology.orchestra.run.smithi016.stdout: filestore ondisk finisher threads = 3 2024-09-12T16:57:10.694 INFO:teuthology.orchestra.run.smithi016.stdout: filestore apply finisher threads = 3 2024-09-12T16:57:10.694 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T16:57:10.694 INFO:teuthology.orchestra.run.smithi016.stdout: bdev debug aio = true 2024-09-12T16:57:10.694 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug misdirected ops = true 2024-09-12T16:57:10.694 INFO:teuthology.orchestra.run.smithi016.stdout: bdev async discard = True 2024-09-12T16:57:10.694 INFO:teuthology.orchestra.run.smithi016.stdout: bdev enable discard = True 2024-09-12T16:57:10.694 INFO:teuthology.orchestra.run.smithi016.stdout: bluestore allocator = bitmap 2024-09-12T16:57:10.694 INFO:teuthology.orchestra.run.smithi016.stdout: bluestore block size = 96636764160 2024-09-12T16:57:10.695 INFO:teuthology.orchestra.run.smithi016.stdout: bluestore fsck on mount = True 2024-09-12T16:57:10.695 INFO:teuthology.orchestra.run.smithi016.stdout: debug bluefs = 1/20 2024-09-12T16:57:10.695 INFO:teuthology.orchestra.run.smithi016.stdout: debug bluestore = 1/20 2024-09-12T16:57:10.695 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2024-09-12T16:57:10.695 INFO:teuthology.orchestra.run.smithi016.stdout: debug objclass = 20 2024-09-12T16:57:10.695 INFO:teuthology.orchestra.run.smithi016.stdout: debug osd = 20 2024-09-12T16:57:10.695 INFO:teuthology.orchestra.run.smithi016.stdout: debug rocksdb = 4/10 2024-09-12T16:57:10.695 INFO:teuthology.orchestra.run.smithi016.stdout: lockdep = True 2024-09-12T16:57:10.695 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T16:57:10.695 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd full ratio = 0.9 2024-09-12T16:57:10.695 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd nearfull ratio = 0.8 2024-09-12T16:57:10.695 INFO:teuthology.orchestra.run.smithi016.stdout: osd failsafe full ratio = 0.95 2024-09-12T16:57:10.695 INFO:teuthology.orchestra.run.smithi016.stdout: osd objectstore = bluestore 2024-09-12T16:57:10.695 INFO:teuthology.orchestra.run.smithi016.stdout: osd shutdown pgref assert = True 2024-09-12T16:57:10.696 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T16:57:10.696 INFO:teuthology.orchestra.run.smithi016.stdout:[mgr] 2024-09-12T16:57:10.696 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2024-09-12T16:57:10.696 INFO:teuthology.orchestra.run.smithi016.stdout: debug mgr = 20 2024-09-12T16:57:10.696 INFO:teuthology.orchestra.run.smithi016.stdout: debug mon = 20 2024-09-12T16:57:10.696 INFO:teuthology.orchestra.run.smithi016.stdout: debug auth = 20 2024-09-12T16:57:10.696 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min pgs per osd = 4 2024-09-12T16:57:10.696 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min bytes per osd = 10 2024-09-12T16:57:10.696 INFO:teuthology.orchestra.run.smithi016.stdout: mgr/telemetry/nag = false 2024-09-12T16:57:10.696 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T16:57:10.696 INFO:teuthology.orchestra.run.smithi016.stdout:[mon] 2024-09-12T16:57:10.696 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2024-09-12T16:57:10.696 INFO:teuthology.orchestra.run.smithi016.stdout: debug mon = 20 2024-09-12T16:57:10.696 INFO:teuthology.orchestra.run.smithi016.stdout: debug paxos = 20 2024-09-12T16:57:10.696 INFO:teuthology.orchestra.run.smithi016.stdout: debug auth = 20 2024-09-12T16:57:10.697 INFO:teuthology.orchestra.run.smithi016.stdout: mon data avail warn = 5 2024-09-12T16:57:10.697 INFO:teuthology.orchestra.run.smithi016.stdout: mon mgr mkfs grace = 240 2024-09-12T16:57:10.697 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min pgs per osd = 4 2024-09-12T16:57:10.697 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd reporter subtree level = osd 2024-09-12T16:57:10.697 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd prime pg temp = true 2024-09-12T16:57:10.697 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min bytes per osd = 10 2024-09-12T16:57:10.697 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T16:57:10.697 INFO:teuthology.orchestra.run.smithi016.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T16:57:10.697 INFO:teuthology.orchestra.run.smithi016.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T16:57:10.697 INFO:teuthology.orchestra.run.smithi016.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T16:57:10.697 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T16:57:10.697 INFO:teuthology.orchestra.run.smithi016.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T16:57:10.697 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T16:57:10.697 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T16:57:10.698 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T16:57:10.698 INFO:teuthology.orchestra.run.smithi016.stdout: # 1m isn't quite enough 2024-09-12T16:57:10.698 INFO:teuthology.orchestra.run.smithi016.stdout: mon_down_mkfs_grace = 2m 2024-09-12T16:57:10.698 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T16:57:10.698 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_filestore_osds = false 2024-09-12T16:57:10.698 INFO:teuthology.orchestra.run.smithi016.stdout: lockdep = True 2024-09-12T16:57:10.698 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T16:57:10.698 INFO:teuthology.orchestra.run.smithi016.stdout:[client] 2024-09-12T16:57:10.698 INFO:teuthology.orchestra.run.smithi016.stdout: rgw cache enabled = true 2024-09-12T16:57:10.698 INFO:teuthology.orchestra.run.smithi016.stdout: rgw enable ops log = true 2024-09-12T16:57:10.698 INFO:teuthology.orchestra.run.smithi016.stdout: rgw enable usage log = true 2024-09-12T16:57:10.698 INFO:teuthology.orchestra.run.smithi016.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T16:57:10.698 INFO:teuthology.orchestra.run.smithi016.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T16:57:10.698 INFO:teuthology.orchestra.run.smithi016.stdout: debug rgw = 20 2024-09-12T16:57:10.699 INFO:teuthology.orchestra.run.smithi016.stdout: debug rgw notification = 20 2024-09-12T16:57:10.699 INFO:teuthology.orchestra.run.smithi016.stdout: rgw bucket counters cache = True 2024-09-12T16:57:10.699 INFO:teuthology.orchestra.run.smithi016.stdout: rgw crypt require ssl = False 2024-09-12T16:57:10.699 INFO:teuthology.orchestra.run.smithi016.stdout: rgw crypt s3 kms backend = testing 2024-09-12T16:57:10.699 INFO:teuthology.orchestra.run.smithi016.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T16:57:10.699 INFO:teuthology.orchestra.run.smithi016.stdout: rgw reshard progress judge interval = 10 2024-09-12T16:57:10.699 INFO:teuthology.orchestra.run.smithi016.stdout: rgw s3 auth use sts = True 2024-09-12T16:57:10.699 INFO:teuthology.orchestra.run.smithi016.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T16:57:10.699 INFO:teuthology.orchestra.run.smithi016.stdout: rgw torrent flag = True 2024-09-12T16:57:10.699 INFO:teuthology.orchestra.run.smithi016.stdout: rgw user counters cache = True 2024-09-12T16:57:10.699 INFO:teuthology.orchestra.run.smithi016.stdout: setgroup = ceph 2024-09-12T16:57:10.699 INFO:teuthology.orchestra.run.smithi016.stdout: setuser = ceph 2024-09-12T16:57:10.699 INFO:teuthology.orchestra.run.smithi016.stdout:[mon.a] 2024-09-12T16:57:10.700 INFO:teuthology.orchestra.run.smithi016.stdout:[mon.c] 2024-09-12T16:57:10.700 INFO:teuthology.orchestra.run.smithi016.stdout:[mon.b] 2024-09-12T16:57:10.700 INFO:teuthology.orchestra.run.smithi019.stdout:[global] 2024-09-12T16:57:10.700 INFO:teuthology.orchestra.run.smithi019.stdout: chdir = "" 2024-09-12T16:57:10.700 INFO:teuthology.orchestra.run.smithi019.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T16:57:10.700 INFO:teuthology.orchestra.run.smithi019.stdout: auth supported = cephx 2024-09-12T16:57:10.701 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T16:57:10.701 INFO:teuthology.orchestra.run.smithi019.stdout: filestore xattr use omap = true 2024-09-12T16:57:10.701 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T16:57:10.701 INFO:teuthology.orchestra.run.smithi019.stdout: mon clock drift allowed = 1.000 2024-09-12T16:57:10.701 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T16:57:10.701 INFO:teuthology.orchestra.run.smithi019.stdout: osd crush chooseleaf type = 0 2024-09-12T16:57:10.701 INFO:teuthology.orchestra.run.smithi019.stdout: auth debug = true 2024-09-12T16:57:10.701 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T16:57:10.701 INFO:teuthology.orchestra.run.smithi019.stdout: ms die on old message = true 2024-09-12T16:57:10.701 INFO:teuthology.orchestra.run.smithi019.stdout: ms die on bug = true 2024-09-12T16:57:10.701 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T16:57:10.701 INFO:teuthology.orchestra.run.smithi019.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T16:57:10.701 INFO:teuthology.orchestra.run.smithi019.stdout: mon pg warn max object skew = 0 2024-09-12T16:57:10.702 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T16:57:10.702 INFO:teuthology.orchestra.run.smithi019.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T16:57:10.702 INFO:teuthology.orchestra.run.smithi019.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T16:57:10.702 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T16:57:10.702 INFO:teuthology.orchestra.run.smithi019.stdout: osd pool default size = 2 2024-09-12T16:57:10.702 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T16:57:10.702 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd allow primary affinity = true 2024-09-12T16:57:10.702 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd allow pg remap = true 2024-09-12T16:57:10.702 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on legacy crush tunables = false 2024-09-12T16:57:10.702 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on crush straw calc version zero = false 2024-09-12T16:57:10.702 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on no sortbitwise = false 2024-09-12T16:57:10.702 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on osd down out interval zero = false 2024-09-12T16:57:10.702 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on too few osds = false 2024-09-12T16:57:10.702 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T16:57:10.703 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T16:57:10.703 INFO:teuthology.orchestra.run.smithi019.stdout: mon_allow_pool_size_one = true 2024-09-12T16:57:10.703 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T16:57:10.703 INFO:teuthology.orchestra.run.smithi019.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T16:57:10.703 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T16:57:10.703 INFO:teuthology.orchestra.run.smithi019.stdout: osd default data pool replay window = 5 2024-09-12T16:57:10.703 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T16:57:10.703 INFO:teuthology.orchestra.run.smithi019.stdout: mon allow pool delete = true 2024-09-12T16:57:10.703 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T16:57:10.703 INFO:teuthology.orchestra.run.smithi019.stdout: mon cluster log file level = debug 2024-09-12T16:57:10.703 INFO:teuthology.orchestra.run.smithi019.stdout: debug asserts on shutdown = true 2024-09-12T16:57:10.703 INFO:teuthology.orchestra.run.smithi019.stdout: mon health detail to clog = false 2024-09-12T16:57:10.703 INFO:teuthology.orchestra.run.smithi019.stdout: mon host = "172.21.15.16,[v2:172.21.15.16:3301,v1:172.21.15.16:6790],172.21.15.19" 2024-09-12T16:57:10.704 INFO:teuthology.orchestra.run.smithi019.stdout: mon client directed command retry = 5 2024-09-12T16:57:10.704 INFO:teuthology.orchestra.run.smithi019.stdout: ms inject socket failures = 5000 2024-09-12T16:57:10.704 INFO:teuthology.orchestra.run.smithi019.stdout: osd_max_pg_log_entries = 10 2024-09-12T16:57:10.704 INFO:teuthology.orchestra.run.smithi019.stdout: osd_min_pg_log_entries = 10 2024-09-12T16:57:10.704 INFO:teuthology.orchestra.run.smithi019.stdout: rgw override bucket index max shards = 1 2024-09-12T16:57:10.704 INFO:teuthology.orchestra.run.smithi019.stdout: fsid = 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T16:57:10.704 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T16:57:10.704 INFO:teuthology.orchestra.run.smithi019.stdout:[osd] 2024-09-12T16:57:10.704 INFO:teuthology.orchestra.run.smithi019.stdout: osd journal size = 100 2024-09-12T16:57:10.704 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T16:57:10.704 INFO:teuthology.orchestra.run.smithi019.stdout: osd scrub load threshold = 5.0 2024-09-12T16:57:10.704 INFO:teuthology.orchestra.run.smithi019.stdout: osd scrub max interval = 600 2024-09-12T16:57:10.704 INFO:teuthology.orchestra.run.smithi019.stdout: osd mclock profile = high_recovery_ops 2024-09-12T16:57:10.705 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T16:57:10.705 INFO:teuthology.orchestra.run.smithi019.stdout: osd recover clone overlap = true 2024-09-12T16:57:10.705 INFO:teuthology.orchestra.run.smithi019.stdout: osd recovery max chunk = 1048576 2024-09-12T16:57:10.705 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T16:57:10.705 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug shutdown = true 2024-09-12T16:57:10.705 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug op order = true 2024-09-12T16:57:10.705 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug verify stray on activate = true 2024-09-12T16:57:10.705 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug trim objects = true 2024-09-12T16:57:10.705 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T16:57:10.705 INFO:teuthology.orchestra.run.smithi019.stdout: osd open classes on start = true 2024-09-12T16:57:10.705 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug pg log writeout = true 2024-09-12T16:57:10.705 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T16:57:10.705 INFO:teuthology.orchestra.run.smithi019.stdout: osd deep scrub update digest min age = 30 2024-09-12T16:57:10.705 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T16:57:10.706 INFO:teuthology.orchestra.run.smithi019.stdout: osd map max advance = 10 2024-09-12T16:57:10.706 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T16:57:10.706 INFO:teuthology.orchestra.run.smithi019.stdout: journal zero on create = true 2024-09-12T16:57:10.706 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T16:57:10.706 INFO:teuthology.orchestra.run.smithi019.stdout: filestore ondisk finisher threads = 3 2024-09-12T16:57:10.706 INFO:teuthology.orchestra.run.smithi019.stdout: filestore apply finisher threads = 3 2024-09-12T16:57:10.706 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T16:57:10.706 INFO:teuthology.orchestra.run.smithi019.stdout: bdev debug aio = true 2024-09-12T16:57:10.706 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug misdirected ops = true 2024-09-12T16:57:10.706 INFO:teuthology.orchestra.run.smithi019.stdout: bdev async discard = True 2024-09-12T16:57:10.706 INFO:teuthology.orchestra.run.smithi019.stdout: bdev enable discard = True 2024-09-12T16:57:10.706 INFO:teuthology.orchestra.run.smithi019.stdout: bluestore allocator = bitmap 2024-09-12T16:57:10.706 INFO:teuthology.orchestra.run.smithi019.stdout: bluestore block size = 96636764160 2024-09-12T16:57:10.706 INFO:teuthology.orchestra.run.smithi019.stdout: bluestore fsck on mount = True 2024-09-12T16:57:10.707 INFO:teuthology.orchestra.run.smithi019.stdout: debug bluefs = 1/20 2024-09-12T16:57:10.707 INFO:teuthology.orchestra.run.smithi019.stdout: debug bluestore = 1/20 2024-09-12T16:57:10.707 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2024-09-12T16:57:10.707 INFO:teuthology.orchestra.run.smithi019.stdout: debug objclass = 20 2024-09-12T16:57:10.707 INFO:teuthology.orchestra.run.smithi019.stdout: debug osd = 20 2024-09-12T16:57:10.707 INFO:teuthology.orchestra.run.smithi019.stdout: debug rocksdb = 4/10 2024-09-12T16:57:10.707 INFO:teuthology.orchestra.run.smithi019.stdout: lockdep = True 2024-09-12T16:57:10.707 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T16:57:10.707 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd full ratio = 0.9 2024-09-12T16:57:10.707 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd nearfull ratio = 0.8 2024-09-12T16:57:10.707 INFO:teuthology.orchestra.run.smithi019.stdout: osd failsafe full ratio = 0.95 2024-09-12T16:57:10.707 INFO:teuthology.orchestra.run.smithi019.stdout: osd objectstore = bluestore 2024-09-12T16:57:10.707 INFO:teuthology.orchestra.run.smithi019.stdout: osd shutdown pgref assert = True 2024-09-12T16:57:10.707 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T16:57:10.708 INFO:teuthology.orchestra.run.smithi019.stdout:[mgr] 2024-09-12T16:57:10.708 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2024-09-12T16:57:10.708 INFO:teuthology.orchestra.run.smithi019.stdout: debug mgr = 20 2024-09-12T16:57:10.708 INFO:teuthology.orchestra.run.smithi019.stdout: debug mon = 20 2024-09-12T16:57:10.708 INFO:teuthology.orchestra.run.smithi019.stdout: debug auth = 20 2024-09-12T16:57:10.708 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min pgs per osd = 4 2024-09-12T16:57:10.708 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min bytes per osd = 10 2024-09-12T16:57:10.708 INFO:teuthology.orchestra.run.smithi019.stdout: mgr/telemetry/nag = false 2024-09-12T16:57:10.708 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T16:57:10.708 INFO:teuthology.orchestra.run.smithi019.stdout:[mon] 2024-09-12T16:57:10.708 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2024-09-12T16:57:10.708 INFO:teuthology.orchestra.run.smithi019.stdout: debug mon = 20 2024-09-12T16:57:10.708 INFO:teuthology.orchestra.run.smithi019.stdout: debug paxos = 20 2024-09-12T16:57:10.709 INFO:teuthology.orchestra.run.smithi019.stdout: debug auth = 20 2024-09-12T16:57:10.709 INFO:teuthology.orchestra.run.smithi019.stdout: mon data avail warn = 5 2024-09-12T16:57:10.709 INFO:teuthology.orchestra.run.smithi019.stdout: mon mgr mkfs grace = 240 2024-09-12T16:57:10.709 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min pgs per osd = 4 2024-09-12T16:57:10.709 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd reporter subtree level = osd 2024-09-12T16:57:10.709 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd prime pg temp = true 2024-09-12T16:57:10.709 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min bytes per osd = 10 2024-09-12T16:57:10.709 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T16:57:10.709 INFO:teuthology.orchestra.run.smithi019.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T16:57:10.709 INFO:teuthology.orchestra.run.smithi019.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T16:57:10.709 INFO:teuthology.orchestra.run.smithi019.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T16:57:10.709 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T16:57:10.709 INFO:teuthology.orchestra.run.smithi019.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T16:57:10.709 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T16:57:10.709 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T16:57:10.710 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T16:57:10.710 INFO:teuthology.orchestra.run.smithi019.stdout: # 1m isn't quite enough 2024-09-12T16:57:10.710 INFO:teuthology.orchestra.run.smithi019.stdout: mon_down_mkfs_grace = 2m 2024-09-12T16:57:10.710 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T16:57:10.710 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_filestore_osds = false 2024-09-12T16:57:10.710 INFO:teuthology.orchestra.run.smithi019.stdout: lockdep = True 2024-09-12T16:57:10.710 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T16:57:10.710 INFO:teuthology.orchestra.run.smithi019.stdout:[client] 2024-09-12T16:57:10.710 INFO:teuthology.orchestra.run.smithi019.stdout: rgw cache enabled = true 2024-09-12T16:57:10.710 INFO:teuthology.orchestra.run.smithi019.stdout: rgw enable ops log = true 2024-09-12T16:57:10.710 INFO:teuthology.orchestra.run.smithi019.stdout: rgw enable usage log = true 2024-09-12T16:57:10.710 INFO:teuthology.orchestra.run.smithi019.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T16:57:10.710 INFO:teuthology.orchestra.run.smithi019.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T16:57:10.711 INFO:teuthology.orchestra.run.smithi019.stdout: debug rgw = 20 2024-09-12T16:57:10.711 INFO:teuthology.orchestra.run.smithi019.stdout: debug rgw notification = 20 2024-09-12T16:57:10.711 INFO:teuthology.orchestra.run.smithi019.stdout: rgw bucket counters cache = True 2024-09-12T16:57:10.711 INFO:teuthology.orchestra.run.smithi019.stdout: rgw crypt require ssl = False 2024-09-12T16:57:10.711 INFO:teuthology.orchestra.run.smithi019.stdout: rgw crypt s3 kms backend = testing 2024-09-12T16:57:10.711 INFO:teuthology.orchestra.run.smithi019.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T16:57:10.711 INFO:teuthology.orchestra.run.smithi019.stdout: rgw reshard progress judge interval = 10 2024-09-12T16:57:10.711 INFO:teuthology.orchestra.run.smithi019.stdout: rgw s3 auth use sts = True 2024-09-12T16:57:10.711 INFO:teuthology.orchestra.run.smithi019.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T16:57:10.711 INFO:teuthology.orchestra.run.smithi019.stdout: rgw torrent flag = True 2024-09-12T16:57:10.711 INFO:teuthology.orchestra.run.smithi019.stdout: rgw user counters cache = True 2024-09-12T16:57:10.711 INFO:teuthology.orchestra.run.smithi019.stdout: setgroup = ceph 2024-09-12T16:57:10.711 INFO:teuthology.orchestra.run.smithi019.stdout: setuser = ceph 2024-09-12T16:57:10.711 INFO:teuthology.orchestra.run.smithi019.stdout:[mon.a] 2024-09-12T16:57:10.711 INFO:teuthology.orchestra.run.smithi019.stdout:[mon.c] 2024-09-12T16:57:10.712 INFO:teuthology.orchestra.run.smithi019.stdout:[mon.b] 2024-09-12T16:57:10.713 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T16:57:10.713 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T16:57:10.805 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T16:57:10.806 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-12T16:57:10.806 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T16:57:10.811 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-12T16:57:10.811 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T16:57:10.858 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi016.front.sepia.ceph.com 2024-09-12T16:57:10.858 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-12T16:57:10.858 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T16:57:10.859 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T16:57:10.925 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-12T16:57:10.926 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:57:10.971 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T16:57:10.971 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T16:57:10.971 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T16:57:10.971 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T16:57:10.997 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T16:57:10.997 DEBUG:teuthology.orchestra.run.smithi019:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:57:11.045 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T16:57:11.045 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T16:57:11.045 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T16:57:11.089 INFO:teuthology.orchestra.run.smithi016.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T16:57:11.092 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T16:57:11.138 INFO:teuthology.orchestra.run.smithi019.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T16:57:11.153 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T16:57:11.153 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T16:57:11.154 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T16:57:11.193 INFO:teuthology.orchestra.run.smithi016.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T16:57:11.205 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-12T16:57:11.241 INFO:teuthology.orchestra.run.smithi019.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-12T16:57:11.253 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T16:57:11.253 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi016.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi019.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T16:57:11.253 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T16:57:11.267 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T16:57:11.267 INFO:tasks.ceph:role: osd.0 2024-09-12T16:57:11.267 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi016.front.sepia.ceph.com 2024-09-12T16:57:11.267 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T16:57:11.325 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T16:57:11.326 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T16:57:11.326 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T16:57:11.326 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T16:57:11.326 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T16:57:11.326 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2024-09-12T16:57:11.326 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T16:57:11.326 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T16:57:11.326 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T16:57:11.326 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T16:57:11.350 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2024-09-12T16:57:11.351 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2024-09-12T16:57:11.351 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T16:57:11.415 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T16:57:11.467 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T16:57:11.467 INFO:teuthology.orchestra.run.smithi016.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T16:57:11.467 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T16:57:11.520 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T16:57:11.520 INFO:tasks.ceph:role: osd.1 2024-09-12T16:57:11.520 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi016.front.sepia.ceph.com 2024-09-12T16:57:11.521 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T16:57:11.574 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T16:57:11.575 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T16:57:11.575 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T16:57:11.575 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T16:57:11.575 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T16:57:11.575 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2024-09-12T16:57:11.575 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T16:57:11.575 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T16:57:11.575 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T16:57:11.576 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T16:57:11.599 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2024-09-12T16:57:11.601 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2024-09-12T16:57:11.601 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-12T16:57:11.656 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T16:57:11.713 INFO:teuthology.orchestra.run.smithi016.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T16:57:11.713 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T16:57:11.714 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T16:57:11.774 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T16:57:11.775 INFO:tasks.ceph:role: osd.2 2024-09-12T16:57:11.775 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi016.front.sepia.ceph.com 2024-09-12T16:57:11.775 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T16:57:11.830 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T16:57:11.830 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T16:57:11.830 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T16:57:11.830 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T16:57:11.830 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T16:57:11.830 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2024-09-12T16:57:11.830 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T16:57:11.830 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T16:57:11.830 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T16:57:11.831 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T16:57:11.854 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2024-09-12T16:57:11.856 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2024-09-12T16:57:11.856 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-12T16:57:11.912 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T16:57:11.965 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T16:57:11.965 INFO:teuthology.orchestra.run.smithi016.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T16:57:11.966 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-12T16:57:12.018 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T16:57:12.018 INFO:tasks.ceph:role: osd.3 2024-09-12T16:57:12.018 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi016.front.sepia.ceph.com 2024-09-12T16:57:12.018 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T16:57:12.077 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T16:57:12.077 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T16:57:12.077 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T16:57:12.077 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T16:57:12.077 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T16:57:12.077 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2024-09-12T16:57:12.077 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T16:57:12.077 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T16:57:12.077 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T16:57:12.077 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T16:57:12.100 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2024-09-12T16:57:12.102 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2024-09-12T16:57:12.102 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-12T16:57:12.164 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-12T16:57:12.215 INFO:teuthology.orchestra.run.smithi016.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T16:57:12.216 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T16:57:12.217 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:57:12.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:57:12.326+0000 7fa9e715b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T16:57:12.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:57:12.326+0000 7fa9e715b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T16:57:12.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:57:12.326+0000 7fa9e715b7c0 -1 bdev(0x55db5aa2b800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T16:57:12.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:57:12.326+0000 7fa9e715b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T16:57:15.481 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T16:57:15.494 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:57:15.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:57:15.578+0000 7f122bcc47c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T16:57:15.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:57:15.578+0000 7f122bcc47c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T16:57:15.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:57:15.578+0000 7f122bcc47c0 -1 bdev(0x55cf0be47800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T16:57:15.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:57:15.578+0000 7f122bcc47c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T16:57:18.727 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T16:57:18.784 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:57:18.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:57:18.866+0000 7f2dd54177c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T16:57:18.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:57:18.866+0000 7f2dd54177c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T16:57:18.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:57:18.866+0000 7f2dd54177c0 -1 bdev(0x55b7d0e4b800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T16:57:18.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:57:18.866+0000 7f2dd54177c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T16:57:22.011 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T16:57:22.142 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:57:22.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:57:22.226+0000 7fd660afa7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-12T16:57:22.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:57:22.226+0000 7fd660afa7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-12T16:57:22.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:57:22.226+0000 7fd660afa7c0 -1 bdev(0x55d73aa3d800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-12T16:57:22.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:57:22.226+0000 7fd660afa7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-12T16:57:25.366 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-12T16:57:25.426 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-12T16:57:25.442 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T16:57:25.442 INFO:tasks.ceph:role: osd.4 2024-09-12T16:57:25.442 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T16:57:25.442 DEBUG:teuthology.orchestra.run.smithi019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T16:57:25.508 INFO:teuthology.orchestra.run.smithi019.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T16:57:25.508 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T16:57:25.508 INFO:teuthology.orchestra.run.smithi019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T16:57:25.508 INFO:teuthology.orchestra.run.smithi019.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T16:57:25.508 INFO:teuthology.orchestra.run.smithi019.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T16:57:25.509 INFO:teuthology.orchestra.run.smithi019.stdout: = sunit=0 swidth=0 blks 2024-09-12T16:57:25.509 INFO:teuthology.orchestra.run.smithi019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T16:57:25.509 INFO:teuthology.orchestra.run.smithi019.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T16:57:25.509 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T16:57:25.509 INFO:teuthology.orchestra.run.smithi019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T16:57:25.993 INFO:teuthology.orchestra.run.smithi019.stdout:Discarding blocks...Done. 2024-09-12T16:57:25.995 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi019.front.sepia.ceph.com -o noatime 2024-09-12T16:57:25.995 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-12T16:57:26.144 DEBUG:teuthology.orchestra.run.smithi019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-12T16:57:26.156 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T16:57:26.156 INFO:teuthology.orchestra.run.smithi019.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T16:57:26.157 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-12T16:57:26.217 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T16:57:26.218 INFO:tasks.ceph:role: osd.5 2024-09-12T16:57:26.218 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T16:57:26.218 DEBUG:teuthology.orchestra.run.smithi019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T16:57:26.281 INFO:teuthology.orchestra.run.smithi019.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T16:57:26.282 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T16:57:26.282 INFO:teuthology.orchestra.run.smithi019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T16:57:26.282 INFO:teuthology.orchestra.run.smithi019.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T16:57:26.282 INFO:teuthology.orchestra.run.smithi019.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T16:57:26.282 INFO:teuthology.orchestra.run.smithi019.stdout: = sunit=0 swidth=0 blks 2024-09-12T16:57:26.282 INFO:teuthology.orchestra.run.smithi019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T16:57:26.282 INFO:teuthology.orchestra.run.smithi019.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T16:57:26.282 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T16:57:26.282 INFO:teuthology.orchestra.run.smithi019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T16:57:26.733 INFO:teuthology.orchestra.run.smithi019.stdout:Discarding blocks...Done. 2024-09-12T16:57:26.735 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi019.front.sepia.ceph.com -o noatime 2024-09-12T16:57:26.735 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-12T16:57:26.830 DEBUG:teuthology.orchestra.run.smithi019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-12T16:57:26.842 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T16:57:26.843 INFO:teuthology.orchestra.run.smithi019.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T16:57:26.843 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-12T16:57:26.896 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T16:57:26.896 INFO:tasks.ceph:role: osd.6 2024-09-12T16:57:26.896 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T16:57:26.896 DEBUG:teuthology.orchestra.run.smithi019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T16:57:26.962 INFO:teuthology.orchestra.run.smithi019.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T16:57:26.962 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T16:57:26.962 INFO:teuthology.orchestra.run.smithi019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T16:57:26.962 INFO:teuthology.orchestra.run.smithi019.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T16:57:26.962 INFO:teuthology.orchestra.run.smithi019.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T16:57:26.962 INFO:teuthology.orchestra.run.smithi019.stdout: = sunit=0 swidth=0 blks 2024-09-12T16:57:26.962 INFO:teuthology.orchestra.run.smithi019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T16:57:26.962 INFO:teuthology.orchestra.run.smithi019.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T16:57:26.962 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T16:57:26.962 INFO:teuthology.orchestra.run.smithi019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T16:57:27.436 INFO:teuthology.orchestra.run.smithi019.stdout:Discarding blocks...Done. 2024-09-12T16:57:27.439 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi019.front.sepia.ceph.com -o noatime 2024-09-12T16:57:27.439 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-12T16:57:27.524 DEBUG:teuthology.orchestra.run.smithi019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-12T16:57:27.581 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T16:57:27.582 INFO:teuthology.orchestra.run.smithi019.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T16:57:27.582 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-12T16:57:27.638 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T16:57:27.638 INFO:tasks.ceph:role: osd.7 2024-09-12T16:57:27.638 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T16:57:27.638 DEBUG:teuthology.orchestra.run.smithi019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T16:57:27.703 INFO:teuthology.orchestra.run.smithi019.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T16:57:27.703 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T16:57:27.703 INFO:teuthology.orchestra.run.smithi019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T16:57:27.703 INFO:teuthology.orchestra.run.smithi019.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T16:57:27.703 INFO:teuthology.orchestra.run.smithi019.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T16:57:27.703 INFO:teuthology.orchestra.run.smithi019.stdout: = sunit=0 swidth=0 blks 2024-09-12T16:57:27.703 INFO:teuthology.orchestra.run.smithi019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T16:57:27.703 INFO:teuthology.orchestra.run.smithi019.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T16:57:27.703 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T16:57:27.703 INFO:teuthology.orchestra.run.smithi019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T16:57:28.189 INFO:teuthology.orchestra.run.smithi019.stdout:Discarding blocks...Done. 2024-09-12T16:57:28.192 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi019.front.sepia.ceph.com -o noatime 2024-09-12T16:57:28.192 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-12T16:57:28.330 DEBUG:teuthology.orchestra.run.smithi019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-12T16:57:28.341 INFO:teuthology.orchestra.run.smithi019.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T16:57:28.342 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T16:57:28.343 DEBUG:teuthology.orchestra.run.smithi019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:57:28.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T16:57:28.456+0000 7fda79e567c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-12T16:57:28.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T16:57:28.456+0000 7fda79e567c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-12T16:57:28.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T16:57:28.460+0000 7fda79e567c0 -1 bdev(0x55c935d5d800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-12T16:57:28.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T16:57:28.460+0000 7fda79e567c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-12T16:57:31.593 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-12T16:57:31.608 DEBUG:teuthology.orchestra.run.smithi019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:57:31.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T16:57:31.684+0000 7fdc222d77c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-12T16:57:31.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T16:57:31.688+0000 7fdc222d77c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-12T16:57:31.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T16:57:31.688+0000 7fdc222d77c0 -1 bdev(0x55eb7a96f800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-12T16:57:31.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T16:57:31.688+0000 7fdc222d77c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-12T16:57:34.837 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-12T16:57:34.893 DEBUG:teuthology.orchestra.run.smithi019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:57:34.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T16:57:34.972+0000 7fcd50dfe7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-12T16:57:34.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T16:57:34.972+0000 7fcd50dfe7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-12T16:57:34.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T16:57:34.972+0000 7fcd50dfe7c0 -1 bdev(0x56075ce1d800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-12T16:57:34.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T16:57:34.976+0000 7fcd50dfe7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-12T16:57:38.115 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-12T16:57:38.173 DEBUG:teuthology.orchestra.run.smithi019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:57:38.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T16:57:38.252+0000 7f048e6af7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-12T16:57:38.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T16:57:38.252+0000 7f048e6af7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-12T16:57:38.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T16:57:38.252+0000 7f048e6af7c0 -1 bdev(0x5654e8aff800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-12T16:57:38.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T16:57:38.252+0000 7f048e6af7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-12T16:57:41.396 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-12T16:57:41.458 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T16:57:41.458 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-12T16:57:41.458 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-12T16:57:41.474 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-12T16:57:41.474 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T16:57:41.531 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-12T16:57:41.531 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T16:57:41.587 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-12T16:57:41.587 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T16:57:41.642 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-12T16:57:41.642 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-12T16:57:41.698 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T16:57:41.698 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T16:57:41.712 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T16:57:41.712 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-12T16:57:41.768 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T16:57:41.768 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-12T16:57:41.824 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T16:57:41.824 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-12T16:57:41.880 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T16:57:41.880 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-12T16:57:41.936 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-12T16:57:41.936 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T16:57:41.942 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T16:57:41.942 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-12T16:57:41.985 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T16:57:41.985 DEBUG:teuthology.orchestra.run.smithi016:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T16:57:41.988 DEBUG:teuthology.orchestra.run.smithi019:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T16:57:42.030 INFO:teuthology.orchestra.run.smithi016.stdout:[mgr.y] 2024-09-12T16:57:42.030 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQBnHeNmZd1fBRAAHA9YewDseHAHUHRF7uG3GQ== 2024-09-12T16:57:42.031 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.0] 2024-09-12T16:57:42.031 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQBoHeNmWOeVExAArS0/CvMrozh9tcdflRetVQ== 2024-09-12T16:57:42.031 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.1] 2024-09-12T16:57:42.031 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQBrHeNmGa+WIhAATY5ntQEM7/+Zgguw0ZssEQ== 2024-09-12T16:57:42.031 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.2] 2024-09-12T16:57:42.031 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQBuHeNm3De7MxAAB5DueE5oyVCzRkaPYSzsfA== 2024-09-12T16:57:42.031 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.3] 2024-09-12T16:57:42.031 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQByHeNm/nOPDRAAI7aePcpV4H+KHCj80zq7JA== 2024-09-12T16:57:42.031 INFO:teuthology.orchestra.run.smithi016.stdout:[mgr.x] 2024-09-12T16:57:42.031 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQBnHeNmO0c6CBAAG7vu0aDFH/YOIwJAgZ7z/Q== 2024-09-12T16:57:42.031 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.4] 2024-09-12T16:57:42.031 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQB4HeNm8JB7GxAAUaKt+EbR23ofw4aqbg7NUw== 2024-09-12T16:57:42.031 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.5] 2024-09-12T16:57:42.032 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQB7HeNmosA7KRAAvaNBx2jb94bPmeZH9sy/Zg== 2024-09-12T16:57:42.032 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.6] 2024-09-12T16:57:42.032 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQB+HeNmDXJcOhAA2M1GuN42R/hCpB77Mwfl7Q== 2024-09-12T16:57:42.032 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.7] 2024-09-12T16:57:42.032 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQCCHeNmPydCDxAAv0ZjjPXtzm/0oLA6gYH1ng== 2024-09-12T16:57:42.032 INFO:teuthology.orchestra.run.smithi016.stdout:[client.0] 2024-09-12T16:57:42.032 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQBnHeNmb7WNCxAAIaDtZ0LxwwfYiUCRCqaCIg== 2024-09-12T16:57:42.032 INFO:teuthology.orchestra.run.smithi016.stdout:[client.1] 2024-09-12T16:57:42.032 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQBnHeNmw8BYDhAAf0a+NZBXJycFpkSh0VT1Ug== 2024-09-12T16:57:42.038 INFO:teuthology.orchestra.run.smithi019.stdout:[mgr.y] 2024-09-12T16:57:42.039 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQBnHeNmZd1fBRAAHA9YewDseHAHUHRF7uG3GQ== 2024-09-12T16:57:42.039 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.0] 2024-09-12T16:57:42.039 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQBoHeNmWOeVExAArS0/CvMrozh9tcdflRetVQ== 2024-09-12T16:57:42.039 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.1] 2024-09-12T16:57:42.039 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQBrHeNmGa+WIhAATY5ntQEM7/+Zgguw0ZssEQ== 2024-09-12T16:57:42.039 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.2] 2024-09-12T16:57:42.039 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQBuHeNm3De7MxAAB5DueE5oyVCzRkaPYSzsfA== 2024-09-12T16:57:42.039 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.3] 2024-09-12T16:57:42.039 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQByHeNm/nOPDRAAI7aePcpV4H+KHCj80zq7JA== 2024-09-12T16:57:42.040 INFO:teuthology.orchestra.run.smithi019.stdout:[mgr.x] 2024-09-12T16:57:42.040 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQBnHeNmO0c6CBAAG7vu0aDFH/YOIwJAgZ7z/Q== 2024-09-12T16:57:42.040 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.4] 2024-09-12T16:57:42.040 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQB4HeNm8JB7GxAAUaKt+EbR23ofw4aqbg7NUw== 2024-09-12T16:57:42.040 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.5] 2024-09-12T16:57:42.040 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQB7HeNmosA7KRAAvaNBx2jb94bPmeZH9sy/Zg== 2024-09-12T16:57:42.040 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.6] 2024-09-12T16:57:42.040 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQB+HeNmDXJcOhAA2M1GuN42R/hCpB77Mwfl7Q== 2024-09-12T16:57:42.040 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.7] 2024-09-12T16:57:42.040 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQCCHeNmPydCDxAAv0ZjjPXtzm/0oLA6gYH1ng== 2024-09-12T16:57:42.040 INFO:teuthology.orchestra.run.smithi019.stdout:[client.0] 2024-09-12T16:57:42.040 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQBnHeNmb7WNCxAAIaDtZ0LxwwfYiUCRCqaCIg== 2024-09-12T16:57:42.041 INFO:teuthology.orchestra.run.smithi019.stdout:[client.1] 2024-09-12T16:57:42.041 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQBnHeNmw8BYDhAAf0a+NZBXJycFpkSh0VT1Ug== 2024-09-12T16:57:42.041 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T16:57:42.076 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T16:57:42.131 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:57:42.134 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:57:42.176 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:57:42.219 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:57:42.262 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:57:42.304 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:57:42.346 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:57:42.388 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:57:42.431 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T16:57:42.474 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T16:57:42.577 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:57:42.585 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:57:42.681 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:57:42.689 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:57:42.772 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:57:42.782 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:57:42.857 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:57:42.869 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T16:57:42.944 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T16:57:42.955 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T16:57:43.033 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T16:57:43.043 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T16:57:43.087 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T16:57:43.088 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T16:57:43.142 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T16:57:43.234 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T16:57:43.246 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-12T16:57:43.301 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T16:57:43.388 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-12T16:57:43.398 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-12T16:57:43.413 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T16:57:43.506 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-12T16:57:43.520 DEBUG:teuthology.orchestra.run.smithi016:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:57:43.522 DEBUG:teuthology.orchestra.run.smithi019:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T16:57:43.568 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T16:57:43.569 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T16:57:43.569 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T16:57:43.571 INFO:tasks.ceph.mon.a:Started 2024-09-12T16:57:43.571 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T16:57:43.571 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T16:57:43.574 INFO:tasks.ceph.mon.c:Started 2024-09-12T16:57:43.574 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T16:57:43.574 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T16:57:43.613 INFO:tasks.ceph.mon.b:Started 2024-09-12T16:57:43.614 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T16:57:43.614 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-12T16:57:43.614 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-12T16:57:43.616 INFO:tasks.ceph.mgr.y:Started 2024-09-12T16:57:43.616 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T16:57:43.616 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T16:57:43.618 INFO:tasks.ceph.mgr.x:Started 2024-09-12T16:57:43.619 DEBUG:tasks.ceph:set 0 configs 2024-09-12T16:57:43.619 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T16:57:43.619 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T16:57:49.077 INFO:teuthology.orchestra.run.smithi016.stderr:adjusted tunables profile to default 2024-09-12T16:57:49.096 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T16:57:49.096 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T16:57:49.097 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-12T16:57:49.097 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T16:57:49.109 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-12T16:57:49.109 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T16:57:49.161 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-12T16:57:49.162 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T16:57:49.217 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-12T16:57:49.217 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-12T16:57:49.270 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T16:57:49.270 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-12T16:57:49.283 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T16:57:49.284 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-12T16:57:49.336 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T16:57:49.336 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-12T16:57:49.392 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T16:57:49.392 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-12T16:57:49.447 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --cluster ceph osd new 97f57c05-370a-4b28-82e4-d5b5f51b1f8a 0 2024-09-12T16:57:49.710 INFO:teuthology.orchestra.run.smithi019.stdout:0 2024-09-12T16:57:49.727 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --cluster ceph osd new 75d950b7-2dcc-4439-bdc2-30acbd68aa41 1 2024-09-12T16:57:49.925 INFO:teuthology.orchestra.run.smithi019.stdout:1 2024-09-12T16:57:49.942 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --cluster ceph osd new c64ae3d0-e4d6-4dcf-a8d1-3b084d198fd4 2 2024-09-12T16:57:50.147 INFO:teuthology.orchestra.run.smithi019.stdout:2 2024-09-12T16:57:50.164 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --cluster ceph osd new 7a4fac7c-fa31-42e4-9ce0-6a1c9443124d 3 2024-09-12T16:57:50.371 INFO:teuthology.orchestra.run.smithi019.stdout:3 2024-09-12T16:57:50.389 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --cluster ceph osd new af3099b9-372c-449b-a86c-5556cac63c50 4 2024-09-12T16:57:50.586 INFO:teuthology.orchestra.run.smithi019.stdout:4 2024-09-12T16:57:50.603 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --cluster ceph osd new 425fa554-75e8-45ef-8444-072280e8d8b1 5 2024-09-12T16:57:50.805 INFO:teuthology.orchestra.run.smithi019.stdout:5 2024-09-12T16:57:50.822 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --cluster ceph osd new 9530f71e-3731-43dd-89b2-a58b0a05cd6d 6 2024-09-12T16:57:51.023 INFO:teuthology.orchestra.run.smithi019.stdout:6 2024-09-12T16:57:51.039 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --cluster ceph osd new 23c92063-e73a-476a-b073-c7a8ee7b9906 7 2024-09-12T16:57:51.238 INFO:teuthology.orchestra.run.smithi019.stdout:7 2024-09-12T16:57:51.255 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T16:57:51.256 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T16:57:51.258 INFO:tasks.ceph.osd.0:Started 2024-09-12T16:57:51.258 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T16:57:51.258 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T16:57:51.261 INFO:tasks.ceph.osd.1:Started 2024-09-12T16:57:51.261 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T16:57:51.261 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T16:57:51.264 INFO:tasks.ceph.osd.2:Started 2024-09-12T16:57:51.264 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-12T16:57:51.264 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-12T16:57:51.266 INFO:tasks.ceph.osd.3:Started 2024-09-12T16:57:51.266 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-12T16:57:51.266 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-12T16:57:51.268 INFO:tasks.ceph.osd.4:Started 2024-09-12T16:57:51.268 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-12T16:57:51.268 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-12T16:57:51.270 INFO:tasks.ceph.osd.5:Started 2024-09-12T16:57:51.270 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-12T16:57:51.270 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-12T16:57:51.272 INFO:tasks.ceph.osd.6:Started 2024-09-12T16:57:51.272 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-12T16:57:51.273 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-12T16:57:51.274 INFO:tasks.ceph.osd.7:Started 2024-09-12T16:57:51.275 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T16:57:51.465 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T16:57:51.466 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":10,"fsid":"78b0e714-9967-46cd-8c81-870ee811f04f","created":"2024-09-12T16:57:48.948012+0000","modified":"2024-09-12T16:57:51.235408+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T16:57:51.235408+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"97f57c05-370a-4b28-82e4-d5b5f51b1f8a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"75d950b7-2dcc-4439-bdc2-30acbd68aa41","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c64ae3d0-e4d6-4dcf-a8d1-3b084d198fd4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7a4fac7c-fa31-42e4-9ce0-6a1c9443124d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"af3099b9-372c-449b-a86c-5556cac63c50","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"425fa554-75e8-45ef-8444-072280e8d8b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"9530f71e-3731-43dd-89b2-a58b0a05cd6d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"23c92063-e73a-476a-b073-c7a8ee7b9906","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T16:57:51.481 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T16:57:51.482 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T16:57:51.974 INFO:tasks.ceph.mgr.x.smithi019.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-12T16:57:51.974 INFO:tasks.ceph.mgr.x.smithi019.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-12T16:57:51.974 INFO:tasks.ceph.mgr.x.smithi019.stderr: from numpy import show_config as show_numpy_config 2024-09-12T16:57:52.288 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T16:57:52.434 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-09-12T16:57:52.434+0000 7fb4c91fd7c0 -1 Falling back to public interface 2024-09-12T16:57:52.490 INFO:teuthology.misc.health.smithi016.stdout: 2024-09-12T16:57:52.490 INFO:teuthology.misc.health.smithi016.stdout:{"epoch":10,"fsid":"78b0e714-9967-46cd-8c81-870ee811f04f","created":"2024-09-12T16:57:48.948012+0000","modified":"2024-09-12T16:57:51.235408+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T16:57:51.235408+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"97f57c05-370a-4b28-82e4-d5b5f51b1f8a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"75d950b7-2dcc-4439-bdc2-30acbd68aa41","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c64ae3d0-e4d6-4dcf-a8d1-3b084d198fd4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7a4fac7c-fa31-42e4-9ce0-6a1c9443124d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"af3099b9-372c-449b-a86c-5556cac63c50","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"425fa554-75e8-45ef-8444-072280e8d8b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"9530f71e-3731-43dd-89b2-a58b0a05cd6d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"23c92063-e73a-476a-b073-c7a8ee7b9906","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T16:57:52.519 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T16:57:52.685 INFO:tasks.ceph.osd.4.smithi019.stderr:2024-09-12T16:57:52.680+0000 7f08dde0e7c0 -1 Falling back to public interface 2024-09-12T16:57:52.685 INFO:tasks.ceph.osd.6.smithi019.stderr:2024-09-12T16:57:52.680+0000 7fe5a45137c0 -1 Falling back to public interface 2024-09-12T16:57:52.685 INFO:tasks.ceph.osd.4.smithi019.stderr:2024-09-12T16:57:52.680+0000 7f08dcdce640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6802/0: (98) Address already in use 2024-09-12T16:57:52.841 INFO:tasks.ceph.mgr.y.smithi016.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-12T16:57:52.841 INFO:tasks.ceph.mgr.y.smithi016.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-12T16:57:52.841 INFO:tasks.ceph.mgr.y.smithi016.stderr: from numpy import show_config as show_numpy_config 2024-09-12T16:57:52.919 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-09-12T16:57:52.918+0000 7f96a382f7c0 -1 Falling back to public interface 2024-09-12T16:57:52.934 INFO:tasks.ceph.osd.7.smithi019.stderr:2024-09-12T16:57:52.928+0000 7f246b0317c0 -1 Falling back to public interface 2024-09-12T16:57:52.936 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-09-12T16:57:52.934+0000 7fd78e0207c0 -1 Falling back to public interface 2024-09-12T16:57:53.123 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-09-12T16:57:53.122+0000 7f55b9e2c7c0 -1 Falling back to public interface 2024-09-12T16:57:53.217 INFO:tasks.ceph.osd.5.smithi019.stderr:2024-09-12T16:57:53.212+0000 7f343c5b97c0 -1 Falling back to public interface 2024-09-12T16:57:55.081 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T16:57:55.076+0000 7f69e6b58640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T16:57:55.086 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T16:57:55.080+0000 7f69e6b58640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T16:57:56.666 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-09-12T16:57:56.666+0000 7fb4c91fd7c0 -1 osd.2 0 log_to_monitors true 2024-09-12T16:57:56.812 INFO:tasks.ceph.osd.4.smithi019.stderr:2024-09-12T16:57:56.808+0000 7f08dde0e7c0 -1 osd.4 0 log_to_monitors true 2024-09-12T16:57:56.832 INFO:tasks.ceph.osd.6.smithi019.stderr:2024-09-12T16:57:56.828+0000 7fe5a45137c0 -1 osd.6 0 log_to_monitors true 2024-09-12T16:57:57.010 INFO:tasks.ceph.osd.7.smithi019.stderr:2024-09-12T16:57:57.004+0000 7f246b0317c0 -1 osd.7 0 log_to_monitors true 2024-09-12T16:57:57.129 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-09-12T16:57:57.126+0000 7f55b9e2c7c0 -1 osd.3 0 log_to_monitors true 2024-09-12T16:57:57.231 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-09-12T16:57:57.230+0000 7fd78e0207c0 -1 osd.1 0 log_to_monitors true 2024-09-12T16:57:57.278 INFO:tasks.ceph.osd.5.smithi019.stderr:2024-09-12T16:57:57.272+0000 7f343c5b97c0 -1 osd.5 0 log_to_monitors true 2024-09-12T16:57:57.289 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-09-12T16:57:57.285+0000 7f96a382f7c0 -1 osd.0 0 log_to_monitors true 2024-09-12T16:57:58.972 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-09-12T16:57:58.969+0000 7fb4c51a6640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T16:57:58.995 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-09-12T16:57:58.993+0000 7fb4bcfd8640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T16:57:59.325 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T16:57:59.737 INFO:teuthology.misc.health.smithi016.stdout: 2024-09-12T16:57:59.738 INFO:teuthology.misc.health.smithi016.stdout:{"epoch":13,"fsid":"78b0e714-9967-46cd-8c81-870ee811f04f","created":"2024-09-12T16:57:48.948012+0000","modified":"2024-09-12T16:57:59.129399+0000","last_up_change":"2024-09-12T16:57:59.129399+0000","last_in_change":"2024-09-12T16:57:51.235408+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"97f57c05-370a-4b28-82e4-d5b5f51b1f8a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"75d950b7-2dcc-4439-bdc2-30acbd68aa41","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c64ae3d0-e4d6-4dcf-a8d1-3b084d198fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1359899637},{"type":"v1","addr":"172.21.15.16:6801","nonce":1359899637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1359899637},{"type":"v1","addr":"172.21.15.16:6803","nonce":1359899637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1359899637},{"type":"v1","addr":"172.21.15.16:6807","nonce":1359899637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1359899637},{"type":"v1","addr":"172.21.15.16:6805","nonce":1359899637}]},"public_addr":"172.21.15.16:6801/1359899637","cluster_addr":"172.21.15.16:6803/1359899637","heartbeat_back_addr":"172.21.15.16:6807/1359899637","heartbeat_front_addr":"172.21.15.16:6805/1359899637","state":["exists","up"]},{"osd":3,"uuid":"7a4fac7c-fa31-42e4-9ce0-6a1c9443124d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"af3099b9-372c-449b-a86c-5556cac63c50","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"425fa554-75e8-45ef-8444-072280e8d8b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"9530f71e-3731-43dd-89b2-a58b0a05cd6d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"23c92063-e73a-476a-b073-c7a8ee7b9906","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T16:57:59.767 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-12T16:58:00.027 INFO:tasks.ceph.osd.4.smithi019.stderr:2024-09-12T16:58:00.020+0000 7f08d9db7640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T16:58:00.032 INFO:tasks.ceph.osd.6.smithi019.stderr:2024-09-12T16:58:00.028+0000 7fe5a04bc640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T16:58:00.053 INFO:tasks.ceph.osd.4.smithi019.stderr:2024-09-12T16:58:00.048+0000 7f08d1be9640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T16:58:00.070 INFO:tasks.ceph.osd.6.smithi019.stderr:2024-09-12T16:58:00.064+0000 7fe5982ee640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T16:58:00.128 INFO:tasks.ceph.osd.7.smithi019.stderr:2024-09-12T16:58:00.124+0000 7f2466fda640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T16:58:00.158 INFO:tasks.ceph.osd.7.smithi019.stderr:2024-09-12T16:58:00.152+0000 7f245ee0c640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T16:58:00.454 INFO:tasks.ceph.osd.5.smithi019.stderr:2024-09-12T16:58:00.448+0000 7f3438562640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T16:58:00.477 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-09-12T16:58:00.473+0000 7f55b5dd5640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T16:58:00.481 INFO:tasks.ceph.osd.5.smithi019.stderr:2024-09-12T16:58:00.476+0000 7f3430394640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T16:58:00.490 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-09-12T16:58:00.489+0000 7f969f7d8640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T16:58:00.502 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-09-12T16:58:00.501+0000 7f55adc07640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T16:58:00.518 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-09-12T16:58:00.517+0000 7f969760a640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T16:58:00.532 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-09-12T16:58:00.529+0000 7fd78a7db640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T16:58:00.563 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-09-12T16:58:00.561+0000 7fd781dfb640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T16:58:06.574 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T16:58:06.901 INFO:teuthology.misc.health.smithi016.stdout: 2024-09-12T16:58:06.902 INFO:teuthology.misc.health.smithi016.stdout:{"epoch":18,"fsid":"78b0e714-9967-46cd-8c81-870ee811f04f","created":"2024-09-12T16:57:48.948012+0000","modified":"2024-09-12T16:58:04.500939+0000","last_up_change":"2024-09-12T16:58:01.479457+0000","last_in_change":"2024-09-12T16:57:51.235408+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T16:58:02.117200+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"97f57c05-370a-4b28-82e4-d5b5f51b1f8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":2391470178},{"type":"v1","addr":"172.21.15.16:6809","nonce":2391470178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":2391470178},{"type":"v1","addr":"172.21.15.16:6811","nonce":2391470178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2391470178},{"type":"v1","addr":"172.21.15.16:6815","nonce":2391470178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2391470178},{"type":"v1","addr":"172.21.15.16:6813","nonce":2391470178}]},"public_addr":"172.21.15.16:6809/2391470178","cluster_addr":"172.21.15.16:6811/2391470178","heartbeat_back_addr":"172.21.15.16:6815/2391470178","heartbeat_front_addr":"172.21.15.16:6813/2391470178","state":["exists","up"]},{"osd":1,"uuid":"75d950b7-2dcc-4439-bdc2-30acbd68aa41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1659555054},{"type":"v1","addr":"172.21.15.16:6817","nonce":1659555054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1659555054},{"type":"v1","addr":"172.21.15.16:6819","nonce":1659555054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":1659555054},{"type":"v1","addr":"172.21.15.16:6823","nonce":1659555054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1659555054},{"type":"v1","addr":"172.21.15.16:6821","nonce":1659555054}]},"public_addr":"172.21.15.16:6817/1659555054","cluster_addr":"172.21.15.16:6819/1659555054","heartbeat_back_addr":"172.21.15.16:6823/1659555054","heartbeat_front_addr":"172.21.15.16:6821/1659555054","state":["exists","up"]},{"osd":2,"uuid":"c64ae3d0-e4d6-4dcf-a8d1-3b084d198fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1359899637},{"type":"v1","addr":"172.21.15.16:6801","nonce":1359899637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1359899637},{"type":"v1","addr":"172.21.15.16:6803","nonce":1359899637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1359899637},{"type":"v1","addr":"172.21.15.16:6807","nonce":1359899637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1359899637},{"type":"v1","addr":"172.21.15.16:6805","nonce":1359899637}]},"public_addr":"172.21.15.16:6801/1359899637","cluster_addr":"172.21.15.16:6803/1359899637","heartbeat_back_addr":"172.21.15.16:6807/1359899637","heartbeat_front_addr":"172.21.15.16:6805/1359899637","state":["exists","up"]},{"osd":3,"uuid":"7a4fac7c-fa31-42e4-9ce0-6a1c9443124d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":465585330},{"type":"v1","addr":"172.21.15.16:6825","nonce":465585330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":465585330},{"type":"v1","addr":"172.21.15.16:6827","nonce":465585330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":465585330},{"type":"v1","addr":"172.21.15.16:6831","nonce":465585330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":465585330},{"type":"v1","addr":"172.21.15.16:6829","nonce":465585330}]},"public_addr":"172.21.15.16:6825/465585330","cluster_addr":"172.21.15.16:6827/465585330","heartbeat_back_addr":"172.21.15.16:6831/465585330","heartbeat_front_addr":"172.21.15.16:6829/465585330","state":["exists","up"]},{"osd":4,"uuid":"af3099b9-372c-449b-a86c-5556cac63c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":1509147557},{"type":"v1","addr":"172.21.15.19:6801","nonce":1509147557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6803","nonce":1509147557},{"type":"v1","addr":"172.21.15.19:6805","nonce":1509147557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6811","nonce":1509147557},{"type":"v1","addr":"172.21.15.19:6813","nonce":1509147557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6807","nonce":1509147557},{"type":"v1","addr":"172.21.15.19:6809","nonce":1509147557}]},"public_addr":"172.21.15.19:6801/1509147557","cluster_addr":"172.21.15.19:6805/1509147557","heartbeat_back_addr":"172.21.15.19:6813/1509147557","heartbeat_front_addr":"172.21.15.19:6809/1509147557","state":["exists","up"]},{"osd":5,"uuid":"425fa554-75e8-45ef-8444-072280e8d8b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2441769319},{"type":"v1","addr":"172.21.15.19:6825","nonce":2441769319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2441769319},{"type":"v1","addr":"172.21.15.19:6827","nonce":2441769319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2441769319},{"type":"v1","addr":"172.21.15.19:6831","nonce":2441769319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2441769319},{"type":"v1","addr":"172.21.15.19:6829","nonce":2441769319}]},"public_addr":"172.21.15.19:6825/2441769319","cluster_addr":"172.21.15.19:6827/2441769319","heartbeat_back_addr":"172.21.15.19:6831/2441769319","heartbeat_front_addr":"172.21.15.19:6829/2441769319","state":["exists","up"]},{"osd":6,"uuid":"9530f71e-3731-43dd-89b2-a58b0a05cd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":36415917},{"type":"v1","addr":"172.21.15.19:6804","nonce":36415917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":36415917},{"type":"v1","addr":"172.21.15.19:6808","nonce":36415917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":36415917},{"type":"v1","addr":"172.21.15.19:6815","nonce":36415917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":36415917},{"type":"v1","addr":"172.21.15.19:6812","nonce":36415917}]},"public_addr":"172.21.15.19:6804/36415917","cluster_addr":"172.21.15.19:6808/36415917","heartbeat_back_addr":"172.21.15.19:6815/36415917","heartbeat_front_addr":"172.21.15.19:6812/36415917","state":["exists","up"]},{"osd":7,"uuid":"23c92063-e73a-476a-b073-c7a8ee7b9906","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2884335714},{"type":"v1","addr":"172.21.15.19:6817","nonce":2884335714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":2884335714},{"type":"v1","addr":"172.21.15.19:6819","nonce":2884335714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":2884335714},{"type":"v1","addr":"172.21.15.19:6823","nonce":2884335714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":2884335714},{"type":"v1","addr":"172.21.15.19:6821","nonce":2884335714}]},"public_addr":"172.21.15.19:6817/2884335714","cluster_addr":"172.21.15.19:6819/2884335714","heartbeat_back_addr":"172.21.15.19:6823/2884335714","heartbeat_front_addr":"172.21.15.19:6821/2884335714","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:57:58.256342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:57:58.207411+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:57:57.674118+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:57:58.125116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:57:57.765410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:57:58.259970+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:57:57.878594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:57:58.044022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T16:58:06.920 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-12T16:58:06.920 INFO:tasks.ceph:Creating RBD pool 2024-09-12T16:58:06.920 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-12T16:58:07.523 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'rbd' created 2024-09-12T16:58:07.555 DEBUG:teuthology.orchestra.run.smithi016:> rbd --cluster ceph pool init rbd 2024-09-12T16:58:07.601 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:58:07.601 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:58:10.559 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T16:58:10.560 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-12T16:58:10.560 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T16:58:10.923 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T16:58:10.943 INFO:teuthology.orchestra.run.smithi016.stdout:[{"version":9,"timestamp":"2024-09-12T16:58:00.533945+0000","name":"","changes":[{"name":"osd.1/osd_mclock_max_capacity_iops_ssd","new_value":"4627.620307"}]}] 2024-09-12T16:58:10.943 INFO:tasks.ceph_manager:config epoch is 9 2024-09-12T16:58:10.943 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T16:58:10.943 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T16:58:10.944 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T16:58:11.292 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T16:58:11.493 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":5,"flags":0,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":1425282402},{"type":"v1","addr":"172.21.15.19:6833","nonce":1425282402}]},"active_addr":"172.21.15.19:6833/1425282402","active_change":"2024-09-12T16:57:54.060229+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4116,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.19:0","nonce":3335220342}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.19:0","nonce":1067196015}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.19:0","nonce":1681963708}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.19:0","nonce":2749166030}]}]} 2024-09-12T16:58:11.497 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T16:58:11.497 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T16:58:11.498 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T16:58:11.807 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T16:58:11.807 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":22,"fsid":"78b0e714-9967-46cd-8c81-870ee811f04f","created":"2024-09-12T16:57:48.948012+0000","modified":"2024-09-12T16:58:10.527781+0000","last_up_change":"2024-09-12T16:58:01.479457+0000","last_in_change":"2024-09-12T16:57:51.235408+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T16:58:02.117200+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T16:58:07.238522+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"97f57c05-370a-4b28-82e4-d5b5f51b1f8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":2391470178},{"type":"v1","addr":"172.21.15.16:6809","nonce":2391470178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":2391470178},{"type":"v1","addr":"172.21.15.16:6811","nonce":2391470178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2391470178},{"type":"v1","addr":"172.21.15.16:6815","nonce":2391470178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2391470178},{"type":"v1","addr":"172.21.15.16:6813","nonce":2391470178}]},"public_addr":"172.21.15.16:6809/2391470178","cluster_addr":"172.21.15.16:6811/2391470178","heartbeat_back_addr":"172.21.15.16:6815/2391470178","heartbeat_front_addr":"172.21.15.16:6813/2391470178","state":["exists","up"]},{"osd":1,"uuid":"75d950b7-2dcc-4439-bdc2-30acbd68aa41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1659555054},{"type":"v1","addr":"172.21.15.16:6817","nonce":1659555054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1659555054},{"type":"v1","addr":"172.21.15.16:6819","nonce":1659555054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":1659555054},{"type":"v1","addr":"172.21.15.16:6823","nonce":1659555054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1659555054},{"type":"v1","addr":"172.21.15.16:6821","nonce":1659555054}]},"public_addr":"172.21.15.16:6817/1659555054","cluster_addr":"172.21.15.16:6819/1659555054","heartbeat_back_addr":"172.21.15.16:6823/1659555054","heartbeat_front_addr":"172.21.15.16:6821/1659555054","state":["exists","up"]},{"osd":2,"uuid":"c64ae3d0-e4d6-4dcf-a8d1-3b084d198fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1359899637},{"type":"v1","addr":"172.21.15.16:6801","nonce":1359899637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1359899637},{"type":"v1","addr":"172.21.15.16:6803","nonce":1359899637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1359899637},{"type":"v1","addr":"172.21.15.16:6807","nonce":1359899637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1359899637},{"type":"v1","addr":"172.21.15.16:6805","nonce":1359899637}]},"public_addr":"172.21.15.16:6801/1359899637","cluster_addr":"172.21.15.16:6803/1359899637","heartbeat_back_addr":"172.21.15.16:6807/1359899637","heartbeat_front_addr":"172.21.15.16:6805/1359899637","state":["exists","up"]},{"osd":3,"uuid":"7a4fac7c-fa31-42e4-9ce0-6a1c9443124d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":465585330},{"type":"v1","addr":"172.21.15.16:6825","nonce":465585330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":465585330},{"type":"v1","addr":"172.21.15.16:6827","nonce":465585330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":465585330},{"type":"v1","addr":"172.21.15.16:6831","nonce":465585330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":465585330},{"type":"v1","addr":"172.21.15.16:6829","nonce":465585330}]},"public_addr":"172.21.15.16:6825/465585330","cluster_addr":"172.21.15.16:6827/465585330","heartbeat_back_addr":"172.21.15.16:6831/465585330","heartbeat_front_addr":"172.21.15.16:6829/465585330","state":["exists","up"]},{"osd":4,"uuid":"af3099b9-372c-449b-a86c-5556cac63c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":1509147557},{"type":"v1","addr":"172.21.15.19:6801","nonce":1509147557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6803","nonce":1509147557},{"type":"v1","addr":"172.21.15.19:6805","nonce":1509147557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6811","nonce":1509147557},{"type":"v1","addr":"172.21.15.19:6813","nonce":1509147557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6807","nonce":1509147557},{"type":"v1","addr":"172.21.15.19:6809","nonce":1509147557}]},"public_addr":"172.21.15.19:6801/1509147557","cluster_addr":"172.21.15.19:6805/1509147557","heartbeat_back_addr":"172.21.15.19:6813/1509147557","heartbeat_front_addr":"172.21.15.19:6809/1509147557","state":["exists","up"]},{"osd":5,"uuid":"425fa554-75e8-45ef-8444-072280e8d8b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2441769319},{"type":"v1","addr":"172.21.15.19:6825","nonce":2441769319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2441769319},{"type":"v1","addr":"172.21.15.19:6827","nonce":2441769319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2441769319},{"type":"v1","addr":"172.21.15.19:6831","nonce":2441769319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2441769319},{"type":"v1","addr":"172.21.15.19:6829","nonce":2441769319}]},"public_addr":"172.21.15.19:6825/2441769319","cluster_addr":"172.21.15.19:6827/2441769319","heartbeat_back_addr":"172.21.15.19:6831/2441769319","heartbeat_front_addr":"172.21.15.19:6829/2441769319","state":["exists","up"]},{"osd":6,"uuid":"9530f71e-3731-43dd-89b2-a58b0a05cd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":36415917},{"type":"v1","addr":"172.21.15.19:6804","nonce":36415917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":36415917},{"type":"v1","addr":"172.21.15.19:6808","nonce":36415917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":36415917},{"type":"v1","addr":"172.21.15.19:6815","nonce":36415917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":36415917},{"type":"v1","addr":"172.21.15.19:6812","nonce":36415917}]},"public_addr":"172.21.15.19:6804/36415917","cluster_addr":"172.21.15.19:6808/36415917","heartbeat_back_addr":"172.21.15.19:6815/36415917","heartbeat_front_addr":"172.21.15.19:6812/36415917","state":["exists","up"]},{"osd":7,"uuid":"23c92063-e73a-476a-b073-c7a8ee7b9906","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2884335714},{"type":"v1","addr":"172.21.15.19:6817","nonce":2884335714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":2884335714},{"type":"v1","addr":"172.21.15.19:6819","nonce":2884335714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":2884335714},{"type":"v1","addr":"172.21.15.19:6823","nonce":2884335714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":2884335714},{"type":"v1","addr":"172.21.15.19:6821","nonce":2884335714}]},"public_addr":"172.21.15.19:6817/2884335714","cluster_addr":"172.21.15.19:6819/2884335714","heartbeat_back_addr":"172.21.15.19:6823/2884335714","heartbeat_front_addr":"172.21.15.19:6821/2884335714","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:57:58.256342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:57:58.207411+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:57:57.674118+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:57:58.125116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:57:57.765410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:57:58.259970+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:57:57.878594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:57:58.044022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T16:58:11.825 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T16:58:11.825 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T16:58:12.133 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T16:58:12.133 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":22,"fsid":"78b0e714-9967-46cd-8c81-870ee811f04f","created":"2024-09-12T16:57:48.948012+0000","modified":"2024-09-12T16:58:10.527781+0000","last_up_change":"2024-09-12T16:58:01.479457+0000","last_in_change":"2024-09-12T16:57:51.235408+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T16:58:02.117200+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T16:58:07.238522+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"97f57c05-370a-4b28-82e4-d5b5f51b1f8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":2391470178},{"type":"v1","addr":"172.21.15.16:6809","nonce":2391470178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":2391470178},{"type":"v1","addr":"172.21.15.16:6811","nonce":2391470178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2391470178},{"type":"v1","addr":"172.21.15.16:6815","nonce":2391470178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2391470178},{"type":"v1","addr":"172.21.15.16:6813","nonce":2391470178}]},"public_addr":"172.21.15.16:6809/2391470178","cluster_addr":"172.21.15.16:6811/2391470178","heartbeat_back_addr":"172.21.15.16:6815/2391470178","heartbeat_front_addr":"172.21.15.16:6813/2391470178","state":["exists","up"]},{"osd":1,"uuid":"75d950b7-2dcc-4439-bdc2-30acbd68aa41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1659555054},{"type":"v1","addr":"172.21.15.16:6817","nonce":1659555054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1659555054},{"type":"v1","addr":"172.21.15.16:6819","nonce":1659555054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":1659555054},{"type":"v1","addr":"172.21.15.16:6823","nonce":1659555054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1659555054},{"type":"v1","addr":"172.21.15.16:6821","nonce":1659555054}]},"public_addr":"172.21.15.16:6817/1659555054","cluster_addr":"172.21.15.16:6819/1659555054","heartbeat_back_addr":"172.21.15.16:6823/1659555054","heartbeat_front_addr":"172.21.15.16:6821/1659555054","state":["exists","up"]},{"osd":2,"uuid":"c64ae3d0-e4d6-4dcf-a8d1-3b084d198fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1359899637},{"type":"v1","addr":"172.21.15.16:6801","nonce":1359899637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1359899637},{"type":"v1","addr":"172.21.15.16:6803","nonce":1359899637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1359899637},{"type":"v1","addr":"172.21.15.16:6807","nonce":1359899637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1359899637},{"type":"v1","addr":"172.21.15.16:6805","nonce":1359899637}]},"public_addr":"172.21.15.16:6801/1359899637","cluster_addr":"172.21.15.16:6803/1359899637","heartbeat_back_addr":"172.21.15.16:6807/1359899637","heartbeat_front_addr":"172.21.15.16:6805/1359899637","state":["exists","up"]},{"osd":3,"uuid":"7a4fac7c-fa31-42e4-9ce0-6a1c9443124d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":465585330},{"type":"v1","addr":"172.21.15.16:6825","nonce":465585330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":465585330},{"type":"v1","addr":"172.21.15.16:6827","nonce":465585330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":465585330},{"type":"v1","addr":"172.21.15.16:6831","nonce":465585330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":465585330},{"type":"v1","addr":"172.21.15.16:6829","nonce":465585330}]},"public_addr":"172.21.15.16:6825/465585330","cluster_addr":"172.21.15.16:6827/465585330","heartbeat_back_addr":"172.21.15.16:6831/465585330","heartbeat_front_addr":"172.21.15.16:6829/465585330","state":["exists","up"]},{"osd":4,"uuid":"af3099b9-372c-449b-a86c-5556cac63c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":1509147557},{"type":"v1","addr":"172.21.15.19:6801","nonce":1509147557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6803","nonce":1509147557},{"type":"v1","addr":"172.21.15.19:6805","nonce":1509147557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6811","nonce":1509147557},{"type":"v1","addr":"172.21.15.19:6813","nonce":1509147557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6807","nonce":1509147557},{"type":"v1","addr":"172.21.15.19:6809","nonce":1509147557}]},"public_addr":"172.21.15.19:6801/1509147557","cluster_addr":"172.21.15.19:6805/1509147557","heartbeat_back_addr":"172.21.15.19:6813/1509147557","heartbeat_front_addr":"172.21.15.19:6809/1509147557","state":["exists","up"]},{"osd":5,"uuid":"425fa554-75e8-45ef-8444-072280e8d8b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2441769319},{"type":"v1","addr":"172.21.15.19:6825","nonce":2441769319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2441769319},{"type":"v1","addr":"172.21.15.19:6827","nonce":2441769319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2441769319},{"type":"v1","addr":"172.21.15.19:6831","nonce":2441769319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2441769319},{"type":"v1","addr":"172.21.15.19:6829","nonce":2441769319}]},"public_addr":"172.21.15.19:6825/2441769319","cluster_addr":"172.21.15.19:6827/2441769319","heartbeat_back_addr":"172.21.15.19:6831/2441769319","heartbeat_front_addr":"172.21.15.19:6829/2441769319","state":["exists","up"]},{"osd":6,"uuid":"9530f71e-3731-43dd-89b2-a58b0a05cd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":36415917},{"type":"v1","addr":"172.21.15.19:6804","nonce":36415917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":36415917},{"type":"v1","addr":"172.21.15.19:6808","nonce":36415917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":36415917},{"type":"v1","addr":"172.21.15.19:6815","nonce":36415917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":36415917},{"type":"v1","addr":"172.21.15.19:6812","nonce":36415917}]},"public_addr":"172.21.15.19:6804/36415917","cluster_addr":"172.21.15.19:6808/36415917","heartbeat_back_addr":"172.21.15.19:6815/36415917","heartbeat_front_addr":"172.21.15.19:6812/36415917","state":["exists","up"]},{"osd":7,"uuid":"23c92063-e73a-476a-b073-c7a8ee7b9906","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2884335714},{"type":"v1","addr":"172.21.15.19:6817","nonce":2884335714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":2884335714},{"type":"v1","addr":"172.21.15.19:6819","nonce":2884335714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":2884335714},{"type":"v1","addr":"172.21.15.19:6823","nonce":2884335714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":2884335714},{"type":"v1","addr":"172.21.15.19:6821","nonce":2884335714}]},"public_addr":"172.21.15.19:6817/2884335714","cluster_addr":"172.21.15.19:6819/2884335714","heartbeat_back_addr":"172.21.15.19:6823/2884335714","heartbeat_front_addr":"172.21.15.19:6821/2884335714","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:57:58.256342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:57:58.207411+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:57:57.674118+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:57:58.125116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:57:57.765410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:57:58.259970+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:57:57.878594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:57:58.044022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T16:58:12.152 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T16:58:12.152 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T16:58:12.153 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T16:58:12.153 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T16:58:12.154 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-12T16:58:12.154 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-12T16:58:12.155 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-12T16:58:12.155 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-12T16:58:12.409 INFO:teuthology.orchestra.run.smithi016.stdout:55834574853 2024-09-12T16:58:12.409 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T16:58:12.418 INFO:teuthology.orchestra.run.smithi016.stdout:60129542151 2024-09-12T16:58:12.418 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T16:58:12.420 INFO:teuthology.orchestra.run.smithi016.stdout:64424509446 2024-09-12T16:58:12.420 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T16:58:12.425 INFO:teuthology.orchestra.run.smithi016.stdout:64424509447 2024-09-12T16:58:12.425 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T16:58:12.429 INFO:teuthology.orchestra.run.smithi016.stdout:60129542150 2024-09-12T16:58:12.429 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T16:58:12.431 INFO:teuthology.orchestra.run.smithi016.stdout:64424509446 2024-09-12T16:58:12.431 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T16:58:12.437 INFO:teuthology.orchestra.run.smithi016.stdout:64424509447 2024-09-12T16:58:12.437 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T16:58:12.446 INFO:teuthology.orchestra.run.smithi016.stdout:60129542149 2024-09-12T16:58:12.447 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T16:58:12.960 INFO:teuthology.orchestra.run.smithi016.stdout:60129542149 2024-09-12T16:58:12.961 INFO:teuthology.orchestra.run.smithi016.stdout:55834574852 2024-09-12T16:58:12.989 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2024-09-12T16:58:12.990 INFO:teuthology.orchestra.run.smithi016.stdout:64424509445 2024-09-12T16:58:12.991 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.7 2024-09-12T16:58:13.000 INFO:teuthology.orchestra.run.smithi016.stdout:64424509444 2024-09-12T16:58:13.002 INFO:teuthology.orchestra.run.smithi016.stdout:60129542150 2024-09-12T16:58:13.007 INFO:teuthology.orchestra.run.smithi016.stdout:64424509444 2024-09-12T16:58:13.017 INFO:teuthology.orchestra.run.smithi016.stdout:60129542148 2024-09-12T16:58:13.019 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509445 for osd.1 2024-09-12T16:58:13.034 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.3 2024-09-12T16:58:13.035 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.6 2024-09-12T16:58:13.039 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.4 2024-09-12T16:58:13.040 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.0 2024-09-12T16:58:13.042 INFO:teuthology.orchestra.run.smithi016.stdout:64424509445 2024-09-12T16:58:13.058 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509445 for osd.5 2024-09-12T16:58:13.990 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T16:58:13.992 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T16:58:14.019 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T16:58:14.035 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T16:58:14.035 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T16:58:14.039 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T16:58:14.040 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T16:58:14.059 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T16:58:14.514 INFO:teuthology.orchestra.run.smithi016.stdout:55834574852 2024-09-12T16:58:14.538 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2024-09-12T16:58:14.542 INFO:teuthology.orchestra.run.smithi016.stdout:60129542149 2024-09-12T16:58:14.566 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.7 2024-09-12T16:58:14.597 INFO:teuthology.orchestra.run.smithi016.stdout:64424509446 2024-09-12T16:58:14.615 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.3 2024-09-12T16:58:14.615 DEBUG:teuthology.parallel:result is None 2024-09-12T16:58:14.624 INFO:teuthology.orchestra.run.smithi016.stdout:60129542151 2024-09-12T16:58:14.626 INFO:teuthology.orchestra.run.smithi016.stdout:60129542149 2024-09-12T16:58:14.631 INFO:teuthology.orchestra.run.smithi016.stdout:64424509447 2024-09-12T16:58:14.636 INFO:teuthology.orchestra.run.smithi016.stdout:64424509447 2024-09-12T16:58:14.643 INFO:teuthology.orchestra.run.smithi016.stdout:64424509446 2024-09-12T16:58:14.651 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.6 2024-09-12T16:58:14.651 DEBUG:teuthology.parallel:result is None 2024-09-12T16:58:14.652 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.4 2024-09-12T16:58:14.652 DEBUG:teuthology.parallel:result is None 2024-09-12T16:58:14.660 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.5 2024-09-12T16:58:14.661 DEBUG:teuthology.parallel:result is None 2024-09-12T16:58:14.666 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.1 2024-09-12T16:58:14.666 DEBUG:teuthology.parallel:result is None 2024-09-12T16:58:14.670 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.0 2024-09-12T16:58:14.670 DEBUG:teuthology.parallel:result is None 2024-09-12T16:58:15.538 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T16:58:15.567 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T16:58:15.849 INFO:teuthology.orchestra.run.smithi016.stdout:55834574853 2024-09-12T16:58:15.867 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.2 2024-09-12T16:58:15.867 DEBUG:teuthology.parallel:result is None 2024-09-12T16:58:15.896 INFO:teuthology.orchestra.run.smithi016.stdout:60129542150 2024-09-12T16:58:15.913 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.7 2024-09-12T16:58:15.914 DEBUG:teuthology.parallel:result is None 2024-09-12T16:58:15.914 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T16:58:15.914 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T16:58:16.267 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T16:58:16.268 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-09-12T16:58:16.282 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-12T16:58:16.074725+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":235804,"kb_used_data":2896,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738916,"statfs":{"total":773094113280,"available":772852649984,"internally_reserved":0,"allocated":2965504,"data_stored":1787238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.548562"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T16:58:10.537187+0000","last_change":"2024-09-12T16:58:10.537187+0000","last_active":"2024-09-12T16:58:10.537187+0000","last_peered":"2024-09-12T16:58:10.537187+0000","last_clean":"2024-09-12T16:58:10.537187+0000","last_became_active":"2024-09-12T16:58:08.546519+0000","last_became_peered":"2024-09-12T16:58:08.546519+0000","last_unstale":"2024-09-12T16:58:10.537187+0000","last_undegraded":"2024-09-12T16:58:10.537187+0000","last_fullsized":"2024-09-12T16:58:10.537187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_clean_scrub_stamp":"2024-09-12T16:58:07.519706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:11.277662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088376600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T16:58:10.542239+0000","last_change":"2024-09-12T16:58:10.542239+0000","last_active":"2024-09-12T16:58:10.542239+0000","last_peered":"2024-09-12T16:58:10.542239+0000","last_clean":"2024-09-12T16:58:10.542239+0000","last_became_active":"2024-09-12T16:58:08.544406+0000","last_became_peered":"2024-09-12T16:58:08.544406+0000","last_unstale":"2024-09-12T16:58:10.542239+0000","last_undegraded":"2024-09-12T16:58:10.542239+0000","last_fullsized":"2024-09-12T16:58:10.542239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_clean_scrub_stamp":"2024-09-12T16:58:07.519706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:42.866569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012247510000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T16:58:10.928593+0000","last_change":"2024-09-12T16:58:10.928593+0000","last_active":"2024-09-12T16:58:10.928593+0000","last_peered":"2024-09-12T16:58:10.928593+0000","last_clean":"2024-09-12T16:58:10.928593+0000","last_became_active":"2024-09-12T16:58:08.841831+0000","last_became_peered":"2024-09-12T16:58:08.841831+0000","last_unstale":"2024-09-12T16:58:10.928593+0000","last_undegraded":"2024-09-12T16:58:10.928593+0000","last_fullsized":"2024-09-12T16:58:10.928593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_clean_scrub_stamp":"2024-09-12T16:58:07.519706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:41.789253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013535820000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T16:58:10.542079+0000","last_change":"2024-09-12T16:58:10.542079+0000","last_active":"2024-09-12T16:58:10.542079+0000","last_peered":"2024-09-12T16:58:10.542079+0000","last_clean":"2024-09-12T16:58:10.542079+0000","last_became_active":"2024-09-12T16:58:08.842793+0000","last_became_peered":"2024-09-12T16:58:08.842793+0000","last_unstale":"2024-09-12T16:58:10.542079+0000","last_undegraded":"2024-09-12T16:58:10.542079+0000","last_fullsized":"2024-09-12T16:58:10.542079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_clean_scrub_stamp":"2024-09-12T16:58:07.519706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:21.164130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001121181,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T16:58:10.541105+0000","last_change":"2024-09-12T16:58:10.535375+0000","last_active":"2024-09-12T16:58:10.541105+0000","last_peered":"2024-09-12T16:58:10.541105+0000","last_clean":"2024-09-12T16:58:10.541105+0000","last_became_active":"2024-09-12T16:58:08.538078+0000","last_became_peered":"2024-09-12T16:58:08.538078+0000","last_unstale":"2024-09-12T16:58:10.541105+0000","last_undegraded":"2024-09-12T16:58:10.541105+0000","last_fullsized":"2024-09-12T16:58:10.541105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_clean_scrub_stamp":"2024-09-12T16:58:07.519706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:19.309437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012028640000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T16:58:10.590891+0000","last_change":"2024-09-12T16:58:10.591264+0000","last_active":"2024-09-12T16:58:10.590891+0000","last_peered":"2024-09-12T16:58:10.590891+0000","last_clean":"2024-09-12T16:58:10.590891+0000","last_became_active":"2024-09-12T16:58:08.534076+0000","last_became_peered":"2024-09-12T16:58:08.534076+0000","last_unstale":"2024-09-12T16:58:10.590891+0000","last_undegraded":"2024-09-12T16:58:10.590891+0000","last_fullsized":"2024-09-12T16:58:10.590891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_clean_scrub_stamp":"2024-09-12T16:58:07.519706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:08.414186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083305900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T16:58:10.928592+0000","last_change":"2024-09-12T16:58:10.928592+0000","last_active":"2024-09-12T16:58:10.928592+0000","last_peered":"2024-09-12T16:58:10.928592+0000","last_clean":"2024-09-12T16:58:10.928592+0000","last_became_active":"2024-09-12T16:58:08.536415+0000","last_became_peered":"2024-09-12T16:58:08.536415+0000","last_unstale":"2024-09-12T16:58:10.928592+0000","last_undegraded":"2024-09-12T16:58:10.928592+0000","last_fullsized":"2024-09-12T16:58:10.928592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_clean_scrub_stamp":"2024-09-12T16:58:07.519706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:44.873424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001332909,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T16:58:10.535498+0000","last_change":"2024-09-12T16:58:10.535498+0000","last_active":"2024-09-12T16:58:10.535498+0000","last_peered":"2024-09-12T16:58:10.535498+0000","last_clean":"2024-09-12T16:58:10.535498+0000","last_became_active":"2024-09-12T16:58:08.538227+0000","last_became_peered":"2024-09-12T16:58:08.538227+0000","last_unstale":"2024-09-12T16:58:10.535498+0000","last_undegraded":"2024-09-12T16:58:10.535498+0000","last_fullsized":"2024-09-12T16:58:10.535498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_clean_scrub_stamp":"2024-09-12T16:58:07.519706+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:36.699923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001171044,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T16:58:10.927052+0000","last_change":"2024-09-12T16:58:04.218615+0000","last_active":"2024-09-12T16:58:10.927052+0000","last_peered":"2024-09-12T16:58:10.927052+0000","last_clean":"2024-09-12T16:58:10.927052+0000","last_became_active":"2024-09-12T16:58:04.216387+0000","last_became_peered":"2024-09-12T16:58:04.216387+0000","last_unstale":"2024-09-12T16:58:10.927052+0000","last_undegraded":"2024-09-12T16:58:10.927052+0000","last_fullsized":"2024-09-12T16:58:10.927052+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:02.482619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:02.482619+0000","last_clean_scrub_stamp":"2024-09-12T16:58:02.482619+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:20.111220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":75827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":221184,"data_stored":75808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":225280,"data_stored":75827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31992,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339848,"statfs":{"total":96636764160,"available":96604004352,"internally_reserved":0,"allocated":815104,"data_stored":666176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":815104,"data_stored":666176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":75808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":75808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":221184,"data_stored":75808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T16:58:16.283 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T16:58:16.574 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T16:58:16.574 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-09-12T16:58:16.590 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-12T16:58:16.074725+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":235804,"kb_used_data":2896,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738916,"statfs":{"total":773094113280,"available":772852649984,"internally_reserved":0,"allocated":2965504,"data_stored":1787238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.548562"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T16:58:10.537187+0000","last_change":"2024-09-12T16:58:10.537187+0000","last_active":"2024-09-12T16:58:10.537187+0000","last_peered":"2024-09-12T16:58:10.537187+0000","last_clean":"2024-09-12T16:58:10.537187+0000","last_became_active":"2024-09-12T16:58:08.546519+0000","last_became_peered":"2024-09-12T16:58:08.546519+0000","last_unstale":"2024-09-12T16:58:10.537187+0000","last_undegraded":"2024-09-12T16:58:10.537187+0000","last_fullsized":"2024-09-12T16:58:10.537187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_clean_scrub_stamp":"2024-09-12T16:58:07.519706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:11.277662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088376600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T16:58:10.542239+0000","last_change":"2024-09-12T16:58:10.542239+0000","last_active":"2024-09-12T16:58:10.542239+0000","last_peered":"2024-09-12T16:58:10.542239+0000","last_clean":"2024-09-12T16:58:10.542239+0000","last_became_active":"2024-09-12T16:58:08.544406+0000","last_became_peered":"2024-09-12T16:58:08.544406+0000","last_unstale":"2024-09-12T16:58:10.542239+0000","last_undegraded":"2024-09-12T16:58:10.542239+0000","last_fullsized":"2024-09-12T16:58:10.542239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_clean_scrub_stamp":"2024-09-12T16:58:07.519706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:42.866569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012247510000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T16:58:10.928593+0000","last_change":"2024-09-12T16:58:10.928593+0000","last_active":"2024-09-12T16:58:10.928593+0000","last_peered":"2024-09-12T16:58:10.928593+0000","last_clean":"2024-09-12T16:58:10.928593+0000","last_became_active":"2024-09-12T16:58:08.841831+0000","last_became_peered":"2024-09-12T16:58:08.841831+0000","last_unstale":"2024-09-12T16:58:10.928593+0000","last_undegraded":"2024-09-12T16:58:10.928593+0000","last_fullsized":"2024-09-12T16:58:10.928593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_clean_scrub_stamp":"2024-09-12T16:58:07.519706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:41.789253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013535820000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T16:58:10.542079+0000","last_change":"2024-09-12T16:58:10.542079+0000","last_active":"2024-09-12T16:58:10.542079+0000","last_peered":"2024-09-12T16:58:10.542079+0000","last_clean":"2024-09-12T16:58:10.542079+0000","last_became_active":"2024-09-12T16:58:08.842793+0000","last_became_peered":"2024-09-12T16:58:08.842793+0000","last_unstale":"2024-09-12T16:58:10.542079+0000","last_undegraded":"2024-09-12T16:58:10.542079+0000","last_fullsized":"2024-09-12T16:58:10.542079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_clean_scrub_stamp":"2024-09-12T16:58:07.519706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:21.164130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001121181,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T16:58:10.541105+0000","last_change":"2024-09-12T16:58:10.535375+0000","last_active":"2024-09-12T16:58:10.541105+0000","last_peered":"2024-09-12T16:58:10.541105+0000","last_clean":"2024-09-12T16:58:10.541105+0000","last_became_active":"2024-09-12T16:58:08.538078+0000","last_became_peered":"2024-09-12T16:58:08.538078+0000","last_unstale":"2024-09-12T16:58:10.541105+0000","last_undegraded":"2024-09-12T16:58:10.541105+0000","last_fullsized":"2024-09-12T16:58:10.541105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_clean_scrub_stamp":"2024-09-12T16:58:07.519706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:19.309437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012028640000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T16:58:10.590891+0000","last_change":"2024-09-12T16:58:10.591264+0000","last_active":"2024-09-12T16:58:10.590891+0000","last_peered":"2024-09-12T16:58:10.590891+0000","last_clean":"2024-09-12T16:58:10.590891+0000","last_became_active":"2024-09-12T16:58:08.534076+0000","last_became_peered":"2024-09-12T16:58:08.534076+0000","last_unstale":"2024-09-12T16:58:10.590891+0000","last_undegraded":"2024-09-12T16:58:10.590891+0000","last_fullsized":"2024-09-12T16:58:10.590891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_clean_scrub_stamp":"2024-09-12T16:58:07.519706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:08.414186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083305900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T16:58:10.928592+0000","last_change":"2024-09-12T16:58:10.928592+0000","last_active":"2024-09-12T16:58:10.928592+0000","last_peered":"2024-09-12T16:58:10.928592+0000","last_clean":"2024-09-12T16:58:10.928592+0000","last_became_active":"2024-09-12T16:58:08.536415+0000","last_became_peered":"2024-09-12T16:58:08.536415+0000","last_unstale":"2024-09-12T16:58:10.928592+0000","last_undegraded":"2024-09-12T16:58:10.928592+0000","last_fullsized":"2024-09-12T16:58:10.928592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_clean_scrub_stamp":"2024-09-12T16:58:07.519706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:44.873424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001332909,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T16:58:10.535498+0000","last_change":"2024-09-12T16:58:10.535498+0000","last_active":"2024-09-12T16:58:10.535498+0000","last_peered":"2024-09-12T16:58:10.535498+0000","last_clean":"2024-09-12T16:58:10.535498+0000","last_became_active":"2024-09-12T16:58:08.538227+0000","last_became_peered":"2024-09-12T16:58:08.538227+0000","last_unstale":"2024-09-12T16:58:10.535498+0000","last_undegraded":"2024-09-12T16:58:10.535498+0000","last_fullsized":"2024-09-12T16:58:10.535498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_clean_scrub_stamp":"2024-09-12T16:58:07.519706+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:36.699923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001171044,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T16:58:10.927052+0000","last_change":"2024-09-12T16:58:04.218615+0000","last_active":"2024-09-12T16:58:10.927052+0000","last_peered":"2024-09-12T16:58:10.927052+0000","last_clean":"2024-09-12T16:58:10.927052+0000","last_became_active":"2024-09-12T16:58:04.216387+0000","last_became_peered":"2024-09-12T16:58:04.216387+0000","last_unstale":"2024-09-12T16:58:10.927052+0000","last_undegraded":"2024-09-12T16:58:10.927052+0000","last_fullsized":"2024-09-12T16:58:10.927052+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:02.482619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:02.482619+0000","last_clean_scrub_stamp":"2024-09-12T16:58:02.482619+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:20.111220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":75827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":221184,"data_stored":75808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":225280,"data_stored":75827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31992,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339848,"statfs":{"total":96636764160,"available":96604004352,"internally_reserved":0,"allocated":815104,"data_stored":666176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":815104,"data_stored":666176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":75808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":75808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":221184,"data_stored":75808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T16:58:16.591 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T16:58:16.591 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T16:58:16.591 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T16:58:16.591 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T16:58:16.921 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T16:58:16.922 INFO:teuthology.orchestra.run.smithi016.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T16:58:16.940 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T16:58:16.940 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-09-12T16:58:17.235 INFO:teuthology.run_tasks:Running task rgw... 2024-09-12T16:58:17.701 DEBUG:tasks.rgw:config is {'client.0': None} 2024-09-12T16:58:17.701 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-12T16:58:17.701 INFO:tasks.rgw:Creating data pools 2024-09-12T16:58:17.701 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-12T16:58:17.701 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-09-12T16:58:18.573 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'default.rgw.buckets.data' created 2024-09-12T16:58:18.606 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-12T16:58:19.665 INFO:teuthology.orchestra.run.smithi016.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-12T16:58:19.691 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-12T16:58:20.682 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'default.rgw.buckets.index' created 2024-09-12T16:58:20.719 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-12T16:58:21.678 INFO:teuthology.orchestra.run.smithi016.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-12T16:58:21.725 DEBUG:tasks.rgw:Pools created 2024-09-12T16:58:21.725 INFO:tasks.rgw:Configuring compression type = random 2024-09-12T16:58:21.726 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T16:58:21.726 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T16:58:21.726 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T16:58:21.781 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:58:21.781 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:58:23.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:23.785+0000 7f7f14772640 0 -- 172.21.15.16:0/3958833890 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557688a33990 msgr2=0x557688a33d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2024-09-12T16:58:23.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:23.789+0000 7f7f1646b9c0 20 rados->read ofs=0 len=0 2024-09-12T16:58:23.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:23.793+0000 7f7f14772640 0 -- 172.21.15.16:0/1938754391 >> [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] conn(0x7f7dd8070ae0 msgr2=0x7f7dd8072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T16:58:23.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:23.793+0000 7f7f1646b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:58:23.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:23.793+0000 7f7f1646b9c0 20 realm 2024-09-12T16:58:23.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:23.793+0000 7f7f1646b9c0 20 rados->read ofs=0 len=0 2024-09-12T16:58:23.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:23.793+0000 7f7f1646b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:58:23.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:23.793+0000 7f7f1646b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:58:23.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:23.793+0000 7f7f1646b9c0 20 rados->read ofs=0 len=0 2024-09-12T16:58:23.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:23.793+0000 7f7f1646b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:58:23.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:23.793+0000 7f7f1646b9c0 20 rados->read ofs=0 len=0 2024-09-12T16:58:23.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:23.793+0000 7f7f1646b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:58:23.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:23.793+0000 7f7f1646b9c0 20 rados->read ofs=0 len=0 2024-09-12T16:58:23.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:23.797+0000 7f7f1646b9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T16:58:23.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:23.797+0000 7f7f1646b9c0 20 searching for the correct realm 2024-09-12T16:58:23.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:23.817+0000 7f7f1646b9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T16:58:23.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:23.817+0000 7f7f1646b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:58:23.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:23.817+0000 7f7f1646b9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T16:58:23.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:23.817+0000 7f7f1646b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:58:23.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:23.817+0000 7f7f1646b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:58:23.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:23.817+0000 7f7f1646b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:58:23.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:23.817+0000 7f7f1646b9c0 20 rados->read ofs=0 len=0 2024-09-12T16:58:23.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:23.817+0000 7f7f1646b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:58:23.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:23.817+0000 7f7f1646b9c0 20 rados->read ofs=0 len=0 2024-09-12T16:58:23.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:23.821+0000 7f7f1646b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:58:23.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:23.821+0000 7f7f1646b9c0 20 rados->read ofs=0 len=0 2024-09-12T16:58:23.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:23.821+0000 7f7f1646b9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:58:23.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:23.821+0000 7f7f1646b9c0 20 zone default found 2024-09-12T16:58:23.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:23.821+0000 7f7f1646b9c0 4 Realm: () 2024-09-12T16:58:23.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:23.821+0000 7f7f1646b9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T16:58:23.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:23.821+0000 7f7f1646b9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T16:58:23.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:23.821+0000 7f7f1646b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:58:23.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:23.821+0000 7f7f1646b9c0 20 zonegroup default 2024-09-12T16:58:23.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:23.821+0000 7f7f1646b9c0 20 rados->read ofs=0 len=0 2024-09-12T16:58:23.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:23.821+0000 7f7f1646b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:58:23.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:23.821+0000 7f7f1646b9c0 20 rados->read ofs=0 len=0 2024-09-12T16:58:25.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:25.729+0000 7f7f1646b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:58:25.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:25.729+0000 7f7f1646b9c0 20 rados->read ofs=0 len=0 2024-09-12T16:58:25.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:25.729+0000 7f7f1646b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:58:25.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:25.729+0000 7f7f1646b9c0 20 started sync module instance, tier type = 2024-09-12T16:58:25.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:25.729+0000 7f7f1646b9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T16:58:27.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.777+0000 7f7f1646b9c0 20 add_watcher() i=0 2024-09-12T16:58:27.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.777+0000 7f7f1646b9c0 20 add_watcher() i=1 2024-09-12T16:58:27.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.777+0000 7f7f1646b9c0 20 add_watcher() i=2 2024-09-12T16:58:27.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.777+0000 7f7f1646b9c0 20 add_watcher() i=3 2024-09-12T16:58:27.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.777+0000 7f7f1646b9c0 20 add_watcher() i=4 2024-09-12T16:58:27.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.777+0000 7f7f1646b9c0 20 add_watcher() i=5 2024-09-12T16:58:27.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.777+0000 7f7f1646b9c0 20 add_watcher() i=6 2024-09-12T16:58:27.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.781+0000 7f7f1646b9c0 20 add_watcher() i=7 2024-09-12T16:58:27.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.781+0000 7f7f1646b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:58:27.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.781+0000 7f7f1646b9c0 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-09-12T16:58:27.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.781+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-09-12T16:58:27.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.781+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.781+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-09-12T16:58:27.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.781+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-09-12T16:58:27.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.781+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.781+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-09-12T16:58:27.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.781+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-09-12T16:58:27.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.781+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.781+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-09-12T16:58:27.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.781+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-09-12T16:58:27.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.781+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.785+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-09-12T16:58:27.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.785+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-09-12T16:58:27.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.785+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.785+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-09-12T16:58:27.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.785+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-09-12T16:58:27.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.785+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.785+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-09-12T16:58:27.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.785+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-09-12T16:58:27.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.785+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.785+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-09-12T16:58:27.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.785+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-09-12T16:58:27.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.785+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.785+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-09-12T16:58:27.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.785+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-09-12T16:58:27.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.785+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.785+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-09-12T16:58:27.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.785+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-09-12T16:58:27.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.785+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.785+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-09-12T16:58:27.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.785+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-09-12T16:58:27.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.785+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.789+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-09-12T16:58:27.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.789+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-09-12T16:58:27.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.789+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.789+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-09-12T16:58:27.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.789+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-09-12T16:58:27.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.789+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.789+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-09-12T16:58:27.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.789+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-09-12T16:58:27.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.789+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.789+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-09-12T16:58:27.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.789+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-09-12T16:58:27.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.789+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.789+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-09-12T16:58:27.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.789+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-09-12T16:58:27.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.789+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.789+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-09-12T16:58:27.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.789+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-09-12T16:58:27.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.789+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.793+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-09-12T16:58:27.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.793+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-09-12T16:58:27.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.793+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.793+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-09-12T16:58:27.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.793+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-09-12T16:58:27.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.793+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.793+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-09-12T16:58:27.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.793+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-09-12T16:58:27.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.793+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.793+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-09-12T16:58:27.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.793+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-09-12T16:58:27.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.793+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.793+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-09-12T16:58:27.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.793+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-09-12T16:58:27.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.793+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.793+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-09-12T16:58:27.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.793+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-09-12T16:58:27.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.793+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.797+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-09-12T16:58:27.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.797+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-09-12T16:58:27.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.797+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.797+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-09-12T16:58:27.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.797+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-09-12T16:58:27.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.797+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.797+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-09-12T16:58:27.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.797+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-09-12T16:58:27.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.797+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.797+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-09-12T16:58:27.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.797+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-09-12T16:58:27.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.797+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.797+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-09-12T16:58:27.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.797+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-09-12T16:58:27.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.797+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.801+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-09-12T16:58:27.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.801+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-09-12T16:58:27.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.801+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.801+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-09-12T16:58:27.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.801+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-09-12T16:58:27.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.801+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.801+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-09-12T16:58:27.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.801+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-09-12T16:58:27.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.801+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.801+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-09-12T16:58:27.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.801+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-09-12T16:58:27.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.801+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.801+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-09-12T16:58:27.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.801+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-09-12T16:58:27.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.801+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.801+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-09-12T16:58:27.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.801+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-09-12T16:58:27.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.801+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.805+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-09-12T16:58:27.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.805+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-09-12T16:58:27.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.805+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.805+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-09-12T16:58:27.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.805+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-09-12T16:58:27.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.805+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.805+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-09-12T16:58:27.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.805+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-09-12T16:58:27.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.805+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.805+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-09-12T16:58:27.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.805+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-09-12T16:58:27.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.805+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.805+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-09-12T16:58:27.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.805+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-09-12T16:58:27.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.805+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.805+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-09-12T16:58:27.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.805+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-09-12T16:58:27.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.805+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.805+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-09-12T16:58:27.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.805+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-09-12T16:58:27.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.805+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.809+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-09-12T16:58:27.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.809+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-09-12T16:58:27.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.809+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.809+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-09-12T16:58:27.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.809+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-09-12T16:58:27.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.809+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.809+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-09-12T16:58:27.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.809+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-09-12T16:58:27.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.809+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.809+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-09-12T16:58:27.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.809+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-09-12T16:58:27.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.809+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.809+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-09-12T16:58:27.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.809+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-09-12T16:58:27.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.809+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.809+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-09-12T16:58:27.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.809+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-09-12T16:58:27.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.809+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.813+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-09-12T16:58:27.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.813+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-09-12T16:58:27.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.813+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.813+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-09-12T16:58:27.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.813+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-09-12T16:58:27.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.813+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.813+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-09-12T16:58:27.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.813+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-09-12T16:58:27.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.813+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.813+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-09-12T16:58:27.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.813+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-09-12T16:58:27.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.813+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.813+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-09-12T16:58:27.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.813+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-09-12T16:58:27.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.813+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.813+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-09-12T16:58:27.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.813+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-09-12T16:58:27.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.813+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.813+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-09-12T16:58:27.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.813+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-09-12T16:58:27.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.813+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.817+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-09-12T16:58:27.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.817+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-09-12T16:58:27.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.817+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.817+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-09-12T16:58:27.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.817+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-09-12T16:58:27.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.817+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.817+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-09-12T16:58:27.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.817+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-09-12T16:58:27.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.817+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.817+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-09-12T16:58:27.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.817+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-09-12T16:58:27.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.817+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.817+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-09-12T16:58:27.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.817+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-09-12T16:58:27.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.817+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.817+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-09-12T16:58:27.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.817+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-09-12T16:58:27.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.817+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.817+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-09-12T16:58:27.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.817+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-09-12T16:58:27.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.817+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.821+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-09-12T16:58:27.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.821+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-09-12T16:58:27.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.821+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.821+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-09-12T16:58:27.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.821+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-09-12T16:58:27.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.821+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.821+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-09-12T16:58:27.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.821+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-09-12T16:58:27.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.821+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.821+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-09-12T16:58:27.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.821+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-09-12T16:58:27.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.821+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.821+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-09-12T16:58:27.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.821+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-09-12T16:58:27.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.821+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.821+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-09-12T16:58:27.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.821+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-09-12T16:58:27.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.821+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.825+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-09-12T16:58:27.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.825+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-09-12T16:58:27.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.825+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.825+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-09-12T16:58:27.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.825+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-09-12T16:58:27.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.825+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.825+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-09-12T16:58:27.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.825+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-09-12T16:58:27.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.825+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.825+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-09-12T16:58:27.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.825+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-09-12T16:58:27.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.825+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.825+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-09-12T16:58:27.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.825+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-09-12T16:58:27.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.825+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.829+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-09-12T16:58:27.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.829+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-09-12T16:58:27.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.829+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.829+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-09-12T16:58:27.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.829+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-09-12T16:58:27.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.829+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.829+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-09-12T16:58:27.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.829+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-09-12T16:58:27.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.829+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.829+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-09-12T16:58:27.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.829+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-09-12T16:58:27.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.829+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.829+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-09-12T16:58:27.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.829+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-09-12T16:58:27.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.829+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.829+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-09-12T16:58:27.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.829+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-09-12T16:58:27.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.829+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.833+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-09-12T16:58:27.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.833+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-09-12T16:58:27.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.833+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.833+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-09-12T16:58:27.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.833+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-09-12T16:58:27.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.833+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.833+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-09-12T16:58:27.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.833+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-09-12T16:58:27.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.833+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.833+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-09-12T16:58:27.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.833+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-09-12T16:58:27.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.833+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.833+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-09-12T16:58:27.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.833+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-09-12T16:58:27.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.833+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.833+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-09-12T16:58:27.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.833+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-09-12T16:58:27.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.833+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.837+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-09-12T16:58:27.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.837+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-09-12T16:58:27.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.837+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.837+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-09-12T16:58:27.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.837+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-09-12T16:58:27.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.837+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.837+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-09-12T16:58:27.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.837+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-09-12T16:58:27.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.837+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.837+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-09-12T16:58:27.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.837+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-09-12T16:58:27.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.837+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.837+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-09-12T16:58:27.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.837+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-09-12T16:58:27.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.837+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.837+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-09-12T16:58:27.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.837+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-09-12T16:58:27.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.837+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.841+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-09-12T16:58:27.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.841+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-09-12T16:58:27.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.841+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.841+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-09-12T16:58:27.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.841+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-09-12T16:58:27.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.841+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.841+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-09-12T16:58:27.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.841+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-09-12T16:58:27.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.841+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.841+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-09-12T16:58:27.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.841+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-09-12T16:58:27.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.841+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.841+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-09-12T16:58:27.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.841+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-09-12T16:58:27.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.841+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.841+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-09-12T16:58:27.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.841+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-09-12T16:58:27.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.841+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.845+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-09-12T16:58:27.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.845+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-09-12T16:58:27.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.845+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.845+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-09-12T16:58:27.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.845+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-09-12T16:58:27.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.845+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.845+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-09-12T16:58:27.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.845+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-09-12T16:58:27.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.845+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.845+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-09-12T16:58:27.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.845+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-09-12T16:58:27.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.845+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.845+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-09-12T16:58:27.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.845+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-09-12T16:58:27.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.845+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.845+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-09-12T16:58:27.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.845+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-09-12T16:58:27.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.845+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.849+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-09-12T16:58:27.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.849+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-09-12T16:58:27.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.849+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.849+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-09-12T16:58:27.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.849+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-09-12T16:58:27.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.849+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.849+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-09-12T16:58:27.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.849+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-09-12T16:58:27.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.849+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.849+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-09-12T16:58:27.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.849+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-09-12T16:58:27.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.849+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.849+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-09-12T16:58:27.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.849+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-09-12T16:58:27.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.849+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.849+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-09-12T16:58:27.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.849+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-09-12T16:58:27.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.849+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.853+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-09-12T16:58:27.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.853+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-09-12T16:58:27.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.853+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.853+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-09-12T16:58:27.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.853+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-09-12T16:58:27.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.853+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.853+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-09-12T16:58:27.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.853+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-09-12T16:58:27.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.853+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.853+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-09-12T16:58:27.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.853+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-09-12T16:58:27.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.853+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.853+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-09-12T16:58:27.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.853+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-09-12T16:58:27.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.853+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.853+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-09-12T16:58:27.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.853+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-09-12T16:58:27.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.853+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.853+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-09-12T16:58:27.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.853+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-09-12T16:58:27.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.853+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.857+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-09-12T16:58:27.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.857+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-09-12T16:58:27.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.857+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.857+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-09-12T16:58:27.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.857+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-09-12T16:58:27.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.857+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.857+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-09-12T16:58:27.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.857+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-09-12T16:58:27.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.857+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.857+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-09-12T16:58:27.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.857+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-09-12T16:58:27.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.857+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.857+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-09-12T16:58:27.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.857+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-09-12T16:58:27.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.857+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.857+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-09-12T16:58:27.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.857+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-09-12T16:58:27.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.857+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.861+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-09-12T16:58:27.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.861+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-09-12T16:58:27.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.861+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.861+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-09-12T16:58:27.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.861+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-09-12T16:58:27.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.861+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.861+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-09-12T16:58:27.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.861+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-09-12T16:58:27.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.861+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.861+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-09-12T16:58:27.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.861+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-09-12T16:58:27.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.861+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.861+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-09-12T16:58:27.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.861+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-09-12T16:58:27.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.861+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.861+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-09-12T16:58:27.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.861+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-09-12T16:58:27.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.861+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.865+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-09-12T16:58:27.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.865+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-09-12T16:58:27.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.865+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.865+0000 7f7f1646b9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-09-12T16:58:27.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.865+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-09-12T16:58:27.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.869+0000 7f7f1646b9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T16:58:27.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.877+0000 7f7dc5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:58:27.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.877+0000 7f7f1646b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:58:27.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:27.877+0000 7f7f1646b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:58:30.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:30.753+0000 7f7f1646b9c0 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-09-12T16:58:30.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:30.753+0000 7f7f1646b9c0 5 note: GC not initialized 2024-09-12T16:58:30.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:30.889+0000 7f7dc4fe1640 20 reqs_thread_entry: start 2024-09-12T16:58:30.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:30.889+0000 7f7f1646b9c0 20 init_complete bucket index max shards: 1 2024-09-12T16:58:30.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:30.889+0000 7f7f1646b9c0 20 Filter name: none 2024-09-12T16:58:30.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:30.889+0000 7f7d2e7fc640 20 reqs_thread_entry: start 2024-09-12T16:58:30.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:30.941+0000 7f7dc5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:58:30.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:30.945+0000 7f7f1646b9c0 20 remove_watcher() i=0 2024-09-12T16:58:30.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:30.945+0000 7f7f1646b9c0 2 removed watcher, disabling cache 2024-09-12T16:58:30.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:30.949+0000 7f7f1646b9c0 20 remove_watcher() i=1 2024-09-12T16:58:30.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:30.949+0000 7f7f1646b9c0 20 remove_watcher() i=2 2024-09-12T16:58:30.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:30.953+0000 7f7f1646b9c0 20 remove_watcher() i=3 2024-09-12T16:58:30.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:30.957+0000 7f7f1646b9c0 20 remove_watcher() i=4 2024-09-12T16:58:30.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:30.957+0000 7f7f1646b9c0 20 remove_watcher() i=5 2024-09-12T16:58:30.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:30.957+0000 7f7f1646b9c0 20 remove_watcher() i=6 2024-09-12T16:58:30.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:30.961+0000 7f7f1646b9c0 20 remove_watcher() i=7 2024-09-12T16:58:30.982 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-12T16:58:30.982 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T16:58:30.982 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T16:58:30.983 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T16:58:30.983 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-09-12T16:58:31.026 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:58:31.026 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:58:31.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.053+0000 7f5e4e2239c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:58:31.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.053+0000 7f5e4e2239c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:58:31.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.057+0000 7f5c91ffb640 20 reqs_thread_entry: start 2024-09-12T16:58:31.086 INFO:teuthology.orchestra.run.smithi016.stdout:{"id":"4327bd0c-d98b-4f4e-a078-83290070ac8d","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-12T16:58:31.087 DEBUG:tasks.util.rgw: json result: {'id': '4327bd0c-d98b-4f4e-a078-83290070ac8d', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-12T16:58:31.087 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T16:58:31.087 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T16:58:31.088 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T16:58:31.163 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:58:31.164 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:58:31.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.201+0000 7f5c5de249c0 20 rados->read ofs=0 len=0 2024-09-12T16:58:31.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.205+0000 7f5c5de249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:58:31.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.205+0000 7f5c5de249c0 20 realm 2024-09-12T16:58:31.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.205+0000 7f5c5de249c0 20 rados->read ofs=0 len=0 2024-09-12T16:58:31.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.205+0000 7f5c5de249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:58:31.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.205+0000 7f5c5de249c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:58:31.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.205+0000 7f5c5de249c0 20 rados->read ofs=0 len=0 2024-09-12T16:58:31.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.205+0000 7f5c5de249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:58:31.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.205+0000 7f5c5de249c0 20 rados->read ofs=0 len=0 2024-09-12T16:58:31.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.209+0000 7f5c5de249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:58:31.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.209+0000 7f5c5de249c0 20 rados->read ofs=0 len=0 2024-09-12T16:58:31.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.209+0000 7f5c5de249c0 20 rados_obj.operate() r=0 bl.length=1009 2024-09-12T16:58:31.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.209+0000 7f5c5de249c0 20 searching for the correct realm 2024-09-12T16:58:31.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.213+0000 7f5c5c12b640 0 -- 172.21.15.16:0/785975259 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f5c44048040 msgr2=0x7f5c44039420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T16:58:31.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.221+0000 7f5c5b129640 0 -- 172.21.15.16:0/785975259 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f5c54125200 msgr2=0x7f5c540f6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T16:58:31.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.437+0000 7f5c5de249c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T16:58:31.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.437+0000 7f5c5de249c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:58:31.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.437+0000 7f5c5de249c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T16:58:31.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.437+0000 7f5c5de249c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:58:31.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.437+0000 7f5c5de249c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:58:31.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.437+0000 7f5c5de249c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:58:31.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.437+0000 7f5c5de249c0 20 rados->read ofs=0 len=0 2024-09-12T16:58:31.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.441+0000 7f5c5de249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:58:31.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.441+0000 7f5c5de249c0 20 rados->read ofs=0 len=0 2024-09-12T16:58:31.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.441+0000 7f5c5de249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:58:31.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.441+0000 7f5c5de249c0 20 rados->read ofs=0 len=0 2024-09-12T16:58:31.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.441+0000 7f5c5de249c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:58:31.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.441+0000 7f5c5de249c0 20 zone default found 2024-09-12T16:58:31.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.441+0000 7f5c5de249c0 4 Realm: () 2024-09-12T16:58:31.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.441+0000 7f5c5de249c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T16:58:31.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.441+0000 7f5c5de249c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T16:58:31.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.441+0000 7f5c5de249c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:58:31.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.441+0000 7f5c5de249c0 20 zonegroup default 2024-09-12T16:58:31.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.441+0000 7f5c5de249c0 20 rados->read ofs=0 len=0 2024-09-12T16:58:31.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.441+0000 7f5c5de249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:58:31.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.441+0000 7f5c5de249c0 20 rados->read ofs=0 len=0 2024-09-12T16:58:31.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.445+0000 7f5c5de249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:58:31.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.445+0000 7f5c5de249c0 20 rados->read ofs=0 len=0 2024-09-12T16:58:31.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.445+0000 7f5c5de249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:58:31.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.445+0000 7f5c5de249c0 20 started sync module instance, tier type = 2024-09-12T16:58:31.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.445+0000 7f5c5de249c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T16:58:31.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.469+0000 7f5c5de249c0 20 add_watcher() i=0 2024-09-12T16:58:31.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.469+0000 7f5c5de249c0 20 add_watcher() i=1 2024-09-12T16:58:31.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.469+0000 7f5c5de249c0 20 add_watcher() i=2 2024-09-12T16:58:31.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.469+0000 7f5c5de249c0 20 add_watcher() i=3 2024-09-12T16:58:31.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.469+0000 7f5c5de249c0 20 add_watcher() i=4 2024-09-12T16:58:31.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.469+0000 7f5c5de249c0 20 add_watcher() i=5 2024-09-12T16:58:31.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.469+0000 7f5c5de249c0 20 add_watcher() i=6 2024-09-12T16:58:31.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.469+0000 7f5c5de249c0 20 add_watcher() i=7 2024-09-12T16:58:31.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.469+0000 7f5c5de249c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:58:31.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.473+0000 7f5b117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:58:31.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.473+0000 7f5c5de249c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:58:31.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.473+0000 7f5c5de249c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:58:31.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.473+0000 7f5c5de249c0 5 note: GC not initialized 2024-09-12T16:58:31.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.473+0000 7f5a8bfff640 20 reqs_thread_entry: start 2024-09-12T16:58:31.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.473+0000 7f5c5de249c0 20 init_complete bucket index max shards: 1 2024-09-12T16:58:31.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.477+0000 7f5c5de249c0 20 Filter name: none 2024-09-12T16:58:31.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.477+0000 7f5a89ffb640 20 reqs_thread_entry: start 2024-09-12T16:58:31.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.497+0000 7f5b117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:58:31.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.501+0000 7f5c5de249c0 20 remove_watcher() i=0 2024-09-12T16:58:31.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.501+0000 7f5c5de249c0 2 removed watcher, disabling cache 2024-09-12T16:58:31.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.505+0000 7f5c5de249c0 20 remove_watcher() i=1 2024-09-12T16:58:31.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.509+0000 7f5c5de249c0 20 remove_watcher() i=2 2024-09-12T16:58:31.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.509+0000 7f5c5de249c0 20 remove_watcher() i=3 2024-09-12T16:58:31.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.513+0000 7f5c5de249c0 20 remove_watcher() i=4 2024-09-12T16:58:31.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.513+0000 7f5c5de249c0 20 remove_watcher() i=5 2024-09-12T16:58:31.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.517+0000 7f5c5de249c0 20 remove_watcher() i=6 2024-09-12T16:58:31.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.517+0000 7f5c5de249c0 20 remove_watcher() i=7 2024-09-12T16:58:31.539 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-12T16:58:31.540 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T16:58:31.540 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-12T16:58:31.540 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-12T16:58:31.540 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --placement-inline-data false 2024-09-12T16:58:31.629 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:58:31.629 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:58:31.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.653+0000 7f05763cb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:58:31.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.653+0000 7f05763cb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:58:31.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.657+0000 7f03c9ffb640 20 reqs_thread_entry: start 2024-09-12T16:58:31.684 INFO:teuthology.orchestra.run.smithi016.stdout:{"id":"4327bd0c-d98b-4f4e-a078-83290070ac8d","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T16:58:31.685 DEBUG:tasks.util.rgw: json result: {'id': '4327bd0c-d98b-4f4e-a078-83290070ac8d', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T16:58:31.685 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T16:58:31.685 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T16:58:31.685 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T16:58:31.714 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:58:31.714 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:58:31.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.965+0000 7f6ec610f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:58:31.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.965+0000 7f6ec610f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:58:31.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.965+0000 7f6ec610f9c0 20 realm 2024-09-12T16:58:31.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.965+0000 7f6ec610f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:58:31.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.965+0000 7f6ec610f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:58:31.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.965+0000 7f6ec610f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:58:31.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.965+0000 7f6ec610f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:58:31.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.965+0000 7f6ec610f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:58:31.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.965+0000 7f6ec610f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:58:31.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.969+0000 7f6ec610f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:58:31.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.969+0000 7f6ec610f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:58:31.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.969+0000 7f6ec610f9c0 20 rados_obj.operate() r=0 bl.length=1009 2024-09-12T16:58:31.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.969+0000 7f6ec610f9c0 20 searching for the correct realm 2024-09-12T16:58:31.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:31.973+0000 7f6ec3414640 0 -- 172.21.15.16:0/127712941 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7f6eb403b070 msgr2=0x7f6eb404b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T16:58:32.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.189+0000 7f6ec4416640 0 -- 172.21.15.16:0/127712941 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f6eb8008040 msgr2=0x7f6eb803b3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T16:58:32.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.205+0000 7f6ec610f9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T16:58:32.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.205+0000 7f6ec610f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:58:32.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.205+0000 7f6ec610f9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T16:58:32.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.205+0000 7f6ec610f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:58:32.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.205+0000 7f6ec610f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:58:32.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.205+0000 7f6ec610f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:58:32.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.205+0000 7f6ec610f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:58:32.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.209+0000 7f6ec610f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:58:32.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.209+0000 7f6ec610f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:58:32.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.209+0000 7f6ec610f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:58:32.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.209+0000 7f6ec610f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:58:32.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.209+0000 7f6ec610f9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T16:58:32.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.209+0000 7f6ec610f9c0 20 zone default found 2024-09-12T16:58:32.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.209+0000 7f6ec610f9c0 4 Realm: () 2024-09-12T16:58:32.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.209+0000 7f6ec610f9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T16:58:32.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.209+0000 7f6ec610f9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T16:58:32.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.209+0000 7f6ec610f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:58:32.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.209+0000 7f6ec610f9c0 20 zonegroup default 2024-09-12T16:58:32.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.209+0000 7f6ec610f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:58:32.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.209+0000 7f6ec610f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:58:32.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.209+0000 7f6ec610f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:58:32.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.213+0000 7f6ec610f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:58:32.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.213+0000 7f6ec610f9c0 20 rados->read ofs=0 len=0 2024-09-12T16:58:32.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.213+0000 7f6ec610f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:58:32.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.213+0000 7f6ec610f9c0 20 started sync module instance, tier type = 2024-09-12T16:58:32.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.213+0000 7f6ec610f9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T16:58:32.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.237+0000 7f6ec610f9c0 20 add_watcher() i=0 2024-09-12T16:58:32.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.237+0000 7f6ec610f9c0 20 add_watcher() i=1 2024-09-12T16:58:32.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.237+0000 7f6ec610f9c0 20 add_watcher() i=2 2024-09-12T16:58:32.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.237+0000 7f6ec610f9c0 20 add_watcher() i=3 2024-09-12T16:58:32.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.237+0000 7f6ec610f9c0 20 add_watcher() i=4 2024-09-12T16:58:32.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.237+0000 7f6ec610f9c0 20 add_watcher() i=5 2024-09-12T16:58:32.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.237+0000 7f6ec610f9c0 20 add_watcher() i=6 2024-09-12T16:58:32.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.237+0000 7f6ec610f9c0 20 add_watcher() i=7 2024-09-12T16:58:32.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.237+0000 7f6ec610f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:58:32.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.241+0000 7f6d79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:58:32.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.241+0000 7f6ec610f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:58:32.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.241+0000 7f6ec610f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:58:32.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.241+0000 7f6ec610f9c0 5 note: GC not initialized 2024-09-12T16:58:32.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.245+0000 7f6d78fe1640 20 reqs_thread_entry: start 2024-09-12T16:58:32.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.245+0000 7f6ec610f9c0 20 init_complete bucket index max shards: 1 2024-09-12T16:58:32.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.245+0000 7f6ec610f9c0 20 Filter name: none 2024-09-12T16:58:32.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.245+0000 7f6cf27fc640 20 reqs_thread_entry: start 2024-09-12T16:58:32.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.265+0000 7f6d79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:58:32.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.273+0000 7f6ec610f9c0 20 remove_watcher() i=0 2024-09-12T16:58:32.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.273+0000 7f6ec610f9c0 2 removed watcher, disabling cache 2024-09-12T16:58:32.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.273+0000 7f6ec610f9c0 20 remove_watcher() i=1 2024-09-12T16:58:32.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.277+0000 7f6ec610f9c0 20 remove_watcher() i=2 2024-09-12T16:58:32.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.281+0000 7f6ec610f9c0 20 remove_watcher() i=3 2024-09-12T16:58:32.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.281+0000 7f6ec610f9c0 20 remove_watcher() i=4 2024-09-12T16:58:32.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.285+0000 7f6ec610f9c0 20 remove_watcher() i=5 2024-09-12T16:58:32.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.285+0000 7f6ec610f9c0 20 remove_watcher() i=6 2024-09-12T16:58:32.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.289+0000 7f6ec610f9c0 20 remove_watcher() i=7 2024-09-12T16:58:32.309 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-09-12T16:58:32.310 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T16:58:32.310 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-09-12T16:58:32.310 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T16:58:32.310 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T16:58:32.310 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-09-12T16:58:32.394 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:58:32.394 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:58:32.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.421+0000 7ff8800619c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:58:32.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.421+0000 7ff8800619c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:58:32.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.425+0000 7ff740fe1640 20 reqs_thread_entry: start 2024-09-12T16:58:32.451 INFO:teuthology.orchestra.run.smithi016.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-09-12T16:58:32.451 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-09-12T16:58:32.451 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T16:58:32.451 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T16:58:32.451 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-09-12T16:58:32.532 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:58:32.533 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:58:32.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.557+0000 7ff1125419c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:58:32.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.557+0000 7ff1125419c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:58:32.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.561+0000 7fef567fc640 20 reqs_thread_entry: start 2024-09-12T16:58:32.590 INFO:teuthology.orchestra.run.smithi016.stdout:{"id":"4327bd0c-d98b-4f4e-a078-83290070ac8d","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T16:58:32.590 DEBUG:tasks.util.rgw: json result: {'id': '4327bd0c-d98b-4f4e-a078-83290070ac8d', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T16:58:32.590 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-09-12T16:58:32.590 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T16:58:32.590 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T16:58:32.591 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-09-12T16:58:32.669 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:58:32.669 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:58:32.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.697+0000 7ffae51569c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:58:32.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.697+0000 7ffae51569c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:58:32.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.701+0000 7ff9a0ff9640 20 reqs_thread_entry: start 2024-09-12T16:58:32.723 INFO:teuthology.orchestra.run.smithi016.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-09-12T16:58:32.723 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-09-12T16:58:32.723 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T16:58:32.723 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T16:58:32.723 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-09-12T16:58:32.813 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:58:32.813 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:58:32.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.841+0000 7f93a343a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:58:32.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.841+0000 7f93a343a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:58:32.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T16:58:32.845+0000 7f91e6ffd640 20 reqs_thread_entry: start 2024-09-12T16:58:32.871 INFO:teuthology.orchestra.run.smithi016.stdout:{"id":"4327bd0c-d98b-4f4e-a078-83290070ac8d","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T16:58:32.871 DEBUG:tasks.util.rgw: json result: {'id': '4327bd0c-d98b-4f4e-a078-83290070ac8d', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T16:58:32.871 INFO:tasks.rgw:Starting rgw... 2024-09-12T16:58:32.871 INFO:tasks.rgw:rgw client.0 config is {} 2024-09-12T16:58:32.871 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-12T16:58:32.872 DEBUG:teuthology.orchestra.run.smithi016:> sudo echo -n http://smithi016.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-12T16:58:32.882 INFO:teuthology.orchestra.run.smithi016.stdout:http://smithi016.front.sepia.ceph.com:80 2024-09-12T16:58:32.882 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-12T16:58:32.936 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-12T16:58:32.936 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-12T16:58:32.979 INFO:tasks.rgw.client.0:Started 2024-09-12T16:58:32.980 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi016.front.sepia.ceph.com:80/ 2024-09-12T16:58:32.980 DEBUG:teuthology.orchestra.run.smithi016:> curl http://smithi016.front.sepia.ceph.com:80/ 2024-09-12T16:58:33.001 INFO:teuthology.orchestra.run.smithi016.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T16:58:33.001 INFO:teuthology.orchestra.run.smithi016.stderr: Dload Upload Total Spent Left Speed 2024-09-12T16:58:33.004 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T16:58:33.004 INFO:teuthology.orchestra.run.smithi016.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T16:58:33.004 INFO:teuthology.orchestra.run.smithi016.stderr:curl: (7) Failed to connect to smithi016.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-12T16:58:34.006 DEBUG:teuthology.orchestra.run.smithi016:> curl http://smithi016.front.sepia.ceph.com:80/ 2024-09-12T16:58:34.017 INFO:teuthology.orchestra.run.smithi016.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T16:58:34.017 INFO:teuthology.orchestra.run.smithi016.stderr: Dload Upload Total Spent Left Speed 2024-09-12T16:58:34.020 INFO:teuthology.orchestra.run.smithi016.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 53034 0 --:--:-- --:--:-- --:--:-- 62333 2024-09-12T16:58:34.021 INFO:teuthology.orchestra.run.smithi016.stdout:anonymous 2024-09-12T16:58:34.021 INFO:teuthology.run_tasks:Running task tox... 2024-09-12T16:58:34.033 INFO:tasks.tox:Deploying tox from pip... 2024-09-12T16:58:34.033 DEBUG:teuthology.orchestra.run.smithi016:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-09-12T16:58:37.099 DEBUG:teuthology.orchestra.run.smithi016:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-09-12T16:58:37.819 INFO:teuthology.orchestra.run.smithi016.stdout:Collecting tox==3.15.0 2024-09-12T16:58:37.920 INFO:teuthology.orchestra.run.smithi016.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-09-12T16:58:38.059 INFO:teuthology.orchestra.run.smithi016.stdout: --------------------------------------- 82.1/82.1 KB 541.7 kB/s eta 0:00:00 2024-09-12T16:58:38.241 INFO:teuthology.orchestra.run.smithi016.stdout:Collecting filelock<4,>=3.0.0 2024-09-12T16:58:38.256 INFO:teuthology.orchestra.run.smithi016.stdout: Downloading filelock-3.16.0-py3-none-any.whl (16 kB) 2024-09-12T16:58:38.334 INFO:teuthology.orchestra.run.smithi016.stdout:Collecting toml>=0.9.4 2024-09-12T16:58:38.351 INFO:teuthology.orchestra.run.smithi016.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-09-12T16:58:38.476 INFO:teuthology.orchestra.run.smithi016.stdout:Collecting packaging>=14 2024-09-12T16:58:38.491 INFO:teuthology.orchestra.run.smithi016.stdout: Downloading packaging-24.1-py3-none-any.whl (53 kB) 2024-09-12T16:58:38.537 INFO:teuthology.orchestra.run.smithi016.stdout: ---------------------------------------- 54.0/54.0 KB 1.0 MB/s eta 0:00:00 2024-09-12T16:58:38.809 INFO:teuthology.orchestra.run.smithi016.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-09-12T16:58:38.825 INFO:teuthology.orchestra.run.smithi016.stdout: Downloading virtualenv-20.26.4-py3-none-any.whl (6.0 MB) 2024-09-12T16:58:39.333 INFO:teuthology.orchestra.run.smithi016.stdout: ---------------------------------------- 6.0/6.0 MB 11.9 MB/s eta 0:00:00 2024-09-12T16:58:39.471 INFO:teuthology.orchestra.run.smithi016.stdout:Collecting pluggy<1,>=0.12.0 2024-09-12T16:58:39.488 INFO:teuthology.orchestra.run.smithi016.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-09-12T16:58:39.578 INFO:teuthology.orchestra.run.smithi016.stdout:Collecting six<2,>=1.14.0 2024-09-12T16:58:39.595 INFO:teuthology.orchestra.run.smithi016.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T16:58:39.723 INFO:teuthology.orchestra.run.smithi016.stdout:Collecting py<2,>=1.4.17 2024-09-12T16:58:39.741 INFO:teuthology.orchestra.run.smithi016.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-09-12T16:58:39.783 INFO:teuthology.orchestra.run.smithi016.stdout: ---------------------------------------- 98.7/98.7 KB 2.4 MB/s eta 0:00:00 2024-09-12T16:58:39.973 INFO:teuthology.orchestra.run.smithi016.stdout:Collecting platformdirs<5,>=3.9.1 2024-09-12T16:58:39.987 INFO:teuthology.orchestra.run.smithi016.stdout: Downloading platformdirs-4.3.2-py3-none-any.whl (18 kB) 2024-09-12T16:58:40.077 INFO:teuthology.orchestra.run.smithi016.stdout:Collecting distlib<1,>=0.3.7 2024-09-12T16:58:40.093 INFO:teuthology.orchestra.run.smithi016.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-09-12T16:58:40.143 INFO:teuthology.orchestra.run.smithi016.stdout: -------------------------------------- 468.9/468.9 KB 10.1 MB/s eta 0:00:00 2024-09-12T16:58:40.305 INFO:teuthology.orchestra.run.smithi016.stdout:Installing collected packages: distlib, toml, six, py, pluggy, platformdirs, packaging, filelock, virtualenv, tox 2024-09-12T16:58:41.276 INFO:teuthology.orchestra.run.smithi016.stdout:Successfully installed distlib-0.3.8 filelock-3.16.0 packaging-24.1 platformdirs-4.3.2 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.4 2024-09-12T16:58:41.360 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T16:58:41.380 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T16:58:41.380 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T16:58:41.381 DEBUG:teuthology.orchestra.run.smithi016:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T16:58:41.386 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T16:58:41.387 INFO:teuthology.orchestra.run.smithi016.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T16:58:41.387 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T16:58:41.435 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T16:58:41.435 DEBUG:teuthology.orchestra.run.smithi016:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T16:58:41.483 INFO:tasks.workunit:timeout=3h 2024-09-12T16:58:41.483 INFO:tasks.workunit:cleanup=True 2024-09-12T16:58:41.483 DEBUG:teuthology.orchestra.run.smithi016:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T16:58:41.533 INFO:tasks.workunit.client.0.smithi016.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T16:59:40.075 INFO:tasks.workunit.client.0.smithi016.stderr:Updating files: 93% (11923/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-12T16:59:40.448 INFO:tasks.workunit.client.0.smithi016.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T16:59:40.449 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T16:59:40.449 INFO:tasks.workunit.client.0.smithi016.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T16:59:40.449 INFO:tasks.workunit.client.0.smithi016.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T16:59:40.449 INFO:tasks.workunit.client.0.smithi016.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T16:59:40.449 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T16:59:40.449 INFO:tasks.workunit.client.0.smithi016.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T16:59:40.450 INFO:tasks.workunit.client.0.smithi016.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T16:59:40.450 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T16:59:40.450 INFO:tasks.workunit.client.0.smithi016.stderr: git switch -c 2024-09-12T16:59:40.450 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T16:59:40.450 INFO:tasks.workunit.client.0.smithi016.stderr:Or undo this operation with: 2024-09-12T16:59:40.450 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T16:59:40.450 INFO:tasks.workunit.client.0.smithi016.stderr: git switch - 2024-09-12T16:59:40.450 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T16:59:40.450 INFO:tasks.workunit.client.0.smithi016.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T16:59:40.450 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T16:59:40.450 INFO:tasks.workunit.client.0.smithi016.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T16:59:40.458 DEBUG:teuthology.orchestra.run.smithi016:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T16:59:40.505 INFO:tasks.workunit.client.0.smithi016.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T16:59:40.508 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T16:59:40.509 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T16:59:41.250 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T16:59:41.330 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T16:59:41.394 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T16:59:41.395 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T16:59:41.395 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T16:59:41.449 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T16:59:41.451 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-12T16:59:41.451 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T16:59:41.500 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-09-12T16:59:41.501 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-09-12T16:59:41.501 DEBUG:teuthology.orchestra.run.smithi016:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T16:59:41.553 INFO:tasks.workunit.client.0.smithi016.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T16:59:41.554 INFO:tasks.workunit.client.0.smithi016.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T16:59:41.554 INFO:tasks.workunit.client.0.smithi016.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T16:59:44.649 INFO:tasks.workunit.client.0.smithi016.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T16:59:44.649 INFO:tasks.workunit.client.0.smithi016.stderr:++ deactivate nondestructive 2024-09-12T16:59:44.650 INFO:tasks.workunit.client.0.smithi016.stderr:++ '[' -n '' ']' 2024-09-12T16:59:44.650 INFO:tasks.workunit.client.0.smithi016.stderr:++ '[' -n '' ']' 2024-09-12T16:59:44.650 INFO:tasks.workunit.client.0.smithi016.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T16:59:44.650 INFO:tasks.workunit.client.0.smithi016.stderr:++ hash -r 2024-09-12T16:59:44.650 INFO:tasks.workunit.client.0.smithi016.stderr:++ '[' -n '' ']' 2024-09-12T16:59:44.650 INFO:tasks.workunit.client.0.smithi016.stderr:++ unset VIRTUAL_ENV 2024-09-12T16:59:44.650 INFO:tasks.workunit.client.0.smithi016.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-12T16:59:44.650 INFO:tasks.workunit.client.0.smithi016.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T16:59:44.650 INFO:tasks.workunit.client.0.smithi016.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T16:59:44.650 INFO:tasks.workunit.client.0.smithi016.stderr:++ export VIRTUAL_ENV 2024-09-12T16:59:44.650 INFO:tasks.workunit.client.0.smithi016.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T16:59:44.650 INFO:tasks.workunit.client.0.smithi016.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T16:59:44.651 INFO:tasks.workunit.client.0.smithi016.stderr:++ export PATH 2024-09-12T16:59:44.651 INFO:tasks.workunit.client.0.smithi016.stderr:++ '[' -n '' ']' 2024-09-12T16:59:44.651 INFO:tasks.workunit.client.0.smithi016.stderr:++ '[' -z '' ']' 2024-09-12T16:59:44.651 INFO:tasks.workunit.client.0.smithi016.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T16:59:44.651 INFO:tasks.workunit.client.0.smithi016.stderr:++ PS1='(rgw) ' 2024-09-12T16:59:44.651 INFO:tasks.workunit.client.0.smithi016.stderr:++ export PS1 2024-09-12T16:59:44.651 INFO:tasks.workunit.client.0.smithi016.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-12T16:59:44.651 INFO:tasks.workunit.client.0.smithi016.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-12T16:59:44.651 INFO:tasks.workunit.client.0.smithi016.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T16:59:44.651 INFO:tasks.workunit.client.0.smithi016.stderr:++ hash -r 2024-09-12T16:59:44.651 INFO:tasks.workunit.client.0.smithi016.stderr:+ pip install pip --upgrade 2024-09-12T16:59:45.023 INFO:tasks.workunit.client.0.smithi016.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T16:59:45.260 INFO:tasks.workunit.client.0.smithi016.stdout:Collecting pip 2024-09-12T16:59:45.365 INFO:tasks.workunit.client.0.smithi016.stdout: Downloading pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T16:59:45.596 INFO:tasks.workunit.client.0.smithi016.stdout: ---------------------------------------- 1.8/1.8 MB 8.1 MB/s eta 0:00:00 2024-09-12T16:59:45.670 INFO:tasks.workunit.client.0.smithi016.stdout:Installing collected packages: pip 2024-09-12T16:59:45.670 INFO:tasks.workunit.client.0.smithi016.stdout: Attempting uninstall: pip 2024-09-12T16:59:45.671 INFO:tasks.workunit.client.0.smithi016.stdout: Found existing installation: pip 22.0.2 2024-09-12T16:59:45.972 INFO:tasks.workunit.client.0.smithi016.stdout: Uninstalling pip-22.0.2: 2024-09-12T16:59:45.980 INFO:tasks.workunit.client.0.smithi016.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T16:59:46.782 INFO:tasks.workunit.client.0.smithi016.stdout:Successfully installed pip-24.2 2024-09-12T16:59:46.842 INFO:tasks.workunit.client.0.smithi016.stderr:+ pip install boto3 2024-09-12T16:59:47.904 INFO:tasks.workunit.client.0.smithi016.stdout:Collecting boto3 2024-09-12T16:59:47.948 INFO:tasks.workunit.client.0.smithi016.stdout: Downloading boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T16:59:48.604 INFO:tasks.workunit.client.0.smithi016.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T16:59:48.618 INFO:tasks.workunit.client.0.smithi016.stdout: Downloading botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T16:59:48.743 INFO:tasks.workunit.client.0.smithi016.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T16:59:48.757 INFO:tasks.workunit.client.0.smithi016.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T16:59:48.905 INFO:tasks.workunit.client.0.smithi016.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T16:59:48.922 INFO:tasks.workunit.client.0.smithi016.stdout: Downloading s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T16:59:49.077 INFO:tasks.workunit.client.0.smithi016.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T16:59:49.094 INFO:tasks.workunit.client.0.smithi016.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T16:59:49.306 INFO:tasks.workunit.client.0.smithi016.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T16:59:49.321 INFO:tasks.workunit.client.0.smithi016.stdout: Downloading urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB) 2024-09-12T16:59:49.586 INFO:tasks.workunit.client.0.smithi016.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T16:59:49.601 INFO:tasks.workunit.client.0.smithi016.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T16:59:49.673 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T16:59:49.776 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T16:59:50.019 INFO:tasks.workunit.client.0.smithi016.stdout: ---------------------------------------- 12.5/12.5 MB 54.0 MB/s eta 0:00:00 2024-09-12T16:59:50.036 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T16:59:50.101 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T16:59:50.177 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T16:59:50.253 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading urllib3-2.2.3-py3-none-any.whl (126 kB) 2024-09-12T16:59:50.337 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T16:59:50.502 INFO:tasks.workunit.client.0.smithi016.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T16:59:51.684 INFO:tasks.workunit.client.0.smithi016.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.3 2024-09-12T16:59:52.145 INFO:tasks.workunit.client.0.smithi016.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-09-12T16:59:52.301 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-09-12T16:59:52.341 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:59:52.341 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:59:52.388 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.383+0000 7fc9058e79c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:52.389 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.383+0000 7fc9058e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:52.389 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.383+0000 7fc9058e79c0 20 realm 2024-09-12T16:59:52.390 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.383+0000 7fc9058e79c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:52.390 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.383+0000 7fc9058e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:52.390 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.383+0000 7fc9058e79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:59:52.390 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.383+0000 7fc9058e79c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:52.390 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.383+0000 7fc9058e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:52.390 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.383+0000 7fc9058e79c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:52.391 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.387+0000 7fc9058e79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:59:52.392 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.387+0000 7fc9058e79c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:52.394 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.387+0000 7fc9058e79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T16:59:52.394 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.387+0000 7fc9058e79c0 20 searching for the correct realm 2024-09-12T16:59:52.397 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.391+0000 7fc903bee640 0 -- 172.21.15.16:0/659670833 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fc8f8016c20 msgr2=0x7fc8f80631a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T16:59:52.405 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.399+0000 7fc902bec640 0 -- 172.21.15.16:0/659670833 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fc8fc119040 msgr2=0x7fc8fc112070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T16:59:52.623 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.619+0000 7fc9058e79c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T16:59:52.623 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.619+0000 7fc9058e79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:59:52.623 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.619+0000 7fc9058e79c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T16:59:52.623 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.619+0000 7fc9058e79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:59:52.623 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.619+0000 7fc9058e79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:59:52.624 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.619+0000 7fc9058e79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:59:52.624 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.619+0000 7fc9058e79c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:52.624 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.619+0000 7fc9058e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:52.624 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.619+0000 7fc9058e79c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:52.624 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.619+0000 7fc9058e79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:59:52.625 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.619+0000 7fc9058e79c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:52.625 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.619+0000 7fc9058e79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T16:59:52.626 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.619+0000 7fc9058e79c0 20 zone default found 2024-09-12T16:59:52.626 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.619+0000 7fc9058e79c0 4 Realm: () 2024-09-12T16:59:52.626 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.619+0000 7fc9058e79c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T16:59:52.626 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.619+0000 7fc9058e79c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T16:59:52.626 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.619+0000 7fc9058e79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:59:52.626 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.619+0000 7fc9058e79c0 20 zonegroup default 2024-09-12T16:59:52.626 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.619+0000 7fc9058e79c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:52.626 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.619+0000 7fc9058e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:52.627 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.619+0000 7fc9058e79c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:52.627 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.623+0000 7fc9058e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:52.627 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.623+0000 7fc9058e79c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:52.628 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.623+0000 7fc9058e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:52.628 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.623+0000 7fc9058e79c0 20 started sync module instance, tier type = 2024-09-12T16:59:52.628 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.623+0000 7fc9058e79c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T16:59:52.654 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.647+0000 7fc9058e79c0 20 add_watcher() i=0 2024-09-12T16:59:52.654 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.647+0000 7fc9058e79c0 20 add_watcher() i=1 2024-09-12T16:59:52.654 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.647+0000 7fc9058e79c0 20 add_watcher() i=2 2024-09-12T16:59:52.654 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.647+0000 7fc9058e79c0 20 add_watcher() i=3 2024-09-12T16:59:52.654 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.647+0000 7fc9058e79c0 20 add_watcher() i=4 2024-09-12T16:59:52.654 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.647+0000 7fc9058e79c0 20 add_watcher() i=5 2024-09-12T16:59:52.654 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.647+0000 7fc9058e79c0 20 add_watcher() i=6 2024-09-12T16:59:52.656 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.651+0000 7fc9058e79c0 20 add_watcher() i=7 2024-09-12T16:59:52.656 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.651+0000 7fc9058e79c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:59:52.660 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.655+0000 7fc7b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:59:52.661 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.655+0000 7fc9058e79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:59:52.662 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.655+0000 7fc9058e79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:59:52.662 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.655+0000 7fc9058e79c0 5 note: GC not initialized 2024-09-12T16:59:52.662 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.655+0000 7fc7b8fe1640 20 reqs_thread_entry: start 2024-09-12T16:59:52.663 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.655+0000 7fc9058e79c0 20 init_complete bucket index max shards: 1 2024-09-12T16:59:52.663 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.655+0000 7fc9058e79c0 20 Filter name: none 2024-09-12T16:59:52.663 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.655+0000 7fc7327fc640 20 reqs_thread_entry: start 2024-09-12T16:59:52.663 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.659+0000 7fc9058e79c0 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-09-12T16:59:52.663 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.659+0000 7fc9058e79c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:52.664 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.659+0000 7fc9058e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:52.664 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.659+0000 7fc9058e79c0 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-09-12T16:59:52.664 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.659+0000 7fc9058e79c0 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T16:59:52.664 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.659+0000 7fc9058e79c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-09-12T16:59:52.664 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.659+0000 7fc9058e79c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:52.665 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.659+0000 7fc9058e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:52.665 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.659+0000 7fc9058e79c0 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-09-12T16:59:52.665 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.659+0000 7fc9058e79c0 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T16:59:52.665 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.659+0000 7fc9058e79c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T16:59:52.665 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.659+0000 7fc9058e79c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T16:59:52.668 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.663+0000 7fc9058e79c0 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T16:59:52.668 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.663+0000 7fc9058e79c0 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T16:59:52.668 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.663+0000 7fc9058e79c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-09-12T16:59:52.669 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.663+0000 7fc7e6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 163208757248 cookie 93917500090784 notifier 4586 bl.length()=593 2024-09-12T16:59:52.669 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.663+0000 7fc7e6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T16:59:52.670 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.663+0000 7fc7e6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T16:59:52.673 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.667+0000 7fc9058e79c0 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T16:59:52.673 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.667+0000 7fc9058e79c0 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T16:59:52.673 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.667+0000 7fc9058e79c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-09-12T16:59:52.674 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.667+0000 7fc7e6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 163208757248 cookie 93917500085360 notifier 4586 bl.length()=186 2024-09-12T16:59:52.674 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.667+0000 7fc7e6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T16:59:52.674 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.667+0000 7fc7e6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T16:59:52.677 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.671+0000 7fc7b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:59:52.682 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.675+0000 7fc9058e79c0 20 remove_watcher() i=0 2024-09-12T16:59:52.682 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.675+0000 7fc9058e79c0 2 removed watcher, disabling cache 2024-09-12T16:59:52.684 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.679+0000 7fc9058e79c0 20 remove_watcher() i=1 2024-09-12T16:59:52.686 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.679+0000 7fc9058e79c0 20 remove_watcher() i=2 2024-09-12T16:59:52.689 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.683+0000 7fc9058e79c0 20 remove_watcher() i=3 2024-09-12T16:59:52.691 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.687+0000 7fc9058e79c0 20 remove_watcher() i=4 2024-09-12T16:59:52.692 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.687+0000 7fc9058e79c0 20 remove_watcher() i=5 2024-09-12T16:59:52.693 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.687+0000 7fc9058e79c0 20 remove_watcher() i=6 2024-09-12T16:59:52.695 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:52.691+0000 7fc9058e79c0 20 remove_watcher() i=7 2024-09-12T16:59:53.178 INFO:tasks.workunit.client.0.smithi016.stderr:TEST: recalculated bucket check stats are correct 2024-09-12T16:59:53.178 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T16:59:53.178 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T16:59:53.214 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:59:53.214 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:59:53.263 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.259+0000 7f81236e19c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:53.265 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.259+0000 7f81236e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:53.265 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.259+0000 7f81236e19c0 20 realm 2024-09-12T16:59:53.266 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.259+0000 7f81236e19c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:53.266 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.259+0000 7f81236e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:53.266 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.259+0000 7f81236e19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:59:53.266 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.259+0000 7f81236e19c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:53.266 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.259+0000 7f81236e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:53.266 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.259+0000 7f81236e19c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:53.267 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.263+0000 7f81236e19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:59:53.267 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.263+0000 7f81236e19c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:53.269 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.263+0000 7f81236e19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T16:59:53.269 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.263+0000 7f81236e19c0 20 searching for the correct realm 2024-09-12T16:59:53.272 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.267+0000 7f81219e8640 0 -- 172.21.15.16:0/426611277 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f810c041950 msgr2=0x7f810c035420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T16:59:53.280 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.275+0000 7f81209e6640 0 -- 172.21.15.16:0/426611277 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f811c01f060 msgr2=0x7f811c07ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T16:59:53.498 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.491+0000 7f81236e19c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T16:59:53.498 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.491+0000 7f81236e19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:59:53.499 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.491+0000 7f81236e19c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T16:59:53.499 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.491+0000 7f81236e19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:59:53.499 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.491+0000 7f81236e19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:59:53.499 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.491+0000 7f81236e19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:59:53.499 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.491+0000 7f81236e19c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:53.499 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.495+0000 7f81236e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:53.499 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.495+0000 7f81236e19c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:53.500 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.495+0000 7f81236e19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:59:53.500 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.495+0000 7f81236e19c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:53.501 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.495+0000 7f81236e19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T16:59:53.501 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.495+0000 7f81236e19c0 20 zone default found 2024-09-12T16:59:53.501 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.495+0000 7f81236e19c0 4 Realm: () 2024-09-12T16:59:53.501 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.495+0000 7f81236e19c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T16:59:53.501 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.495+0000 7f81236e19c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T16:59:53.501 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.495+0000 7f81236e19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:59:53.501 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.495+0000 7f81236e19c0 20 zonegroup default 2024-09-12T16:59:53.501 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.495+0000 7f81236e19c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:53.502 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.495+0000 7f81236e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:53.502 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.495+0000 7f81236e19c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:53.502 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.495+0000 7f81236e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:53.502 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.495+0000 7f81236e19c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:53.503 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.499+0000 7f81236e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:53.503 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.499+0000 7f81236e19c0 20 started sync module instance, tier type = 2024-09-12T16:59:53.503 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.499+0000 7f81236e19c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T16:59:53.528 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.523+0000 7f81236e19c0 20 add_watcher() i=0 2024-09-12T16:59:53.528 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.523+0000 7f81236e19c0 20 add_watcher() i=1 2024-09-12T16:59:53.528 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.523+0000 7f81236e19c0 20 add_watcher() i=2 2024-09-12T16:59:53.528 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.523+0000 7f81236e19c0 20 add_watcher() i=3 2024-09-12T16:59:53.528 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.523+0000 7f81236e19c0 20 add_watcher() i=4 2024-09-12T16:59:53.529 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.523+0000 7f81236e19c0 20 add_watcher() i=5 2024-09-12T16:59:53.529 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.523+0000 7f81236e19c0 20 add_watcher() i=6 2024-09-12T16:59:53.530 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.523+0000 7f81236e19c0 20 add_watcher() i=7 2024-09-12T16:59:53.530 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.523+0000 7f81236e19c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:59:53.534 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.527+0000 7f7fd77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:59:53.535 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.527+0000 7f81236e19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:59:53.535 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.527+0000 7f81236e19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:59:53.535 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.531+0000 7f81236e19c0 5 note: GC not initialized 2024-09-12T16:59:53.535 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.531+0000 7f7fd67e4640 20 reqs_thread_entry: start 2024-09-12T16:59:53.535 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.531+0000 7f81236e19c0 20 init_complete bucket index max shards: 1 2024-09-12T16:59:53.535 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.531+0000 7f81236e19c0 20 Filter name: none 2024-09-12T16:59:53.536 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.531+0000 7f7f47fff640 20 reqs_thread_entry: start 2024-09-12T16:59:53.536 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.531+0000 7f81236e19c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T16:59:53.536 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.531+0000 7f81236e19c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:53.536 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.531+0000 7f81236e19c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T16:59:53.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.531+0000 7f81236e19c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T16:59:53.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.531+0000 7f81236e19c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T16:59:53.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.531+0000 7f81236e19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1 : miss 2024-09-12T16:59:53.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.531+0000 7f81236e19c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:53.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.531+0000 7f81236e19c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T16:59:53.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.531+0000 7f81236e19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1 info.flags=0x17 2024-09-12T16:59:53.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.531+0000 7f81236e19c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1 to cache LRU end 2024-09-12T16:59:53.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.531+0000 7f81236e19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:59:53.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.531+0000 7f81236e19c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T16:59:53.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.531+0000 7f81236e19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1 2024-09-12T16:59:53.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.531+0000 7f81236e19c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T16:59:53.545 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.539+0000 7f7fd77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:59:53.551 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.547+0000 7f81236e19c0 20 remove_watcher() i=0 2024-09-12T16:59:53.551 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.547+0000 7f81236e19c0 2 removed watcher, disabling cache 2024-09-12T16:59:53.553 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.547+0000 7f81236e19c0 20 remove_watcher() i=1 2024-09-12T16:59:53.556 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.551+0000 7f81236e19c0 20 remove_watcher() i=2 2024-09-12T16:59:53.558 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.551+0000 7f81236e19c0 20 remove_watcher() i=3 2024-09-12T16:59:53.561 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.555+0000 7f81236e19c0 20 remove_watcher() i=4 2024-09-12T16:59:53.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.555+0000 7f81236e19c0 20 remove_watcher() i=5 2024-09-12T16:59:53.564 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.559+0000 7f81236e19c0 20 remove_watcher() i=6 2024-09-12T16:59:53.565 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.559+0000 7f81236e19c0 20 remove_watcher() i=7 2024-09-12T16:59:53.583 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T16:59:53.615 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:59:53.615 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:59:53.662 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.655+0000 7f1358c209c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:53.664 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.659+0000 7f1358c209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:53.664 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.659+0000 7f1358c209c0 20 realm 2024-09-12T16:59:53.664 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.659+0000 7f1358c209c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:53.664 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.659+0000 7f1358c209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:53.665 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.659+0000 7f1358c209c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:59:53.665 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.659+0000 7f1358c209c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:53.665 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.659+0000 7f1358c209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:53.665 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.659+0000 7f1358c209c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:53.666 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.659+0000 7f1358c209c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:59:53.666 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.659+0000 7f1358c209c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:53.668 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.663+0000 7f1358c209c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T16:59:53.668 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.663+0000 7f1358c209c0 20 searching for the correct realm 2024-09-12T16:59:53.671 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.667+0000 7f1356f27640 0 -- 172.21.15.16:0/2127505961 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f134c0feb10 msgr2=0x7f134c123a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T16:59:53.680 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.675+0000 7f1355f25640 0 -- 172.21.15.16:0/2127505961 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f135005e940 msgr2=0x7f1350004920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T16:59:53.899 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.895+0000 7f1358c209c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T16:59:53.899 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.895+0000 7f1358c209c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:59:53.899 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.895+0000 7f1358c209c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T16:59:53.899 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.895+0000 7f1358c209c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:59:53.899 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.895+0000 7f1358c209c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:59:53.900 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.895+0000 7f1358c209c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:59:53.900 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.895+0000 7f1358c209c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:53.900 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.895+0000 7f1358c209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:53.900 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.895+0000 7f1358c209c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:53.901 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.895+0000 7f1358c209c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:59:53.901 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.895+0000 7f1358c209c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:53.902 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.895+0000 7f1358c209c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T16:59:53.902 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.895+0000 7f1358c209c0 20 zone default found 2024-09-12T16:59:53.902 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.895+0000 7f1358c209c0 4 Realm: () 2024-09-12T16:59:53.902 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.895+0000 7f1358c209c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T16:59:53.902 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.895+0000 7f1358c209c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T16:59:53.902 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.895+0000 7f1358c209c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:59:53.902 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.895+0000 7f1358c209c0 20 zonegroup default 2024-09-12T16:59:53.902 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.895+0000 7f1358c209c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:53.903 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.895+0000 7f1358c209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:53.903 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.895+0000 7f1358c209c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:53.903 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.899+0000 7f1358c209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:53.903 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.899+0000 7f1358c209c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:53.904 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.899+0000 7f1358c209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:53.904 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.899+0000 7f1358c209c0 20 started sync module instance, tier type = 2024-09-12T16:59:53.904 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.899+0000 7f1358c209c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T16:59:53.928 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.923+0000 7f1358c209c0 20 add_watcher() i=0 2024-09-12T16:59:53.928 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.923+0000 7f1358c209c0 20 add_watcher() i=1 2024-09-12T16:59:53.928 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.923+0000 7f1358c209c0 20 add_watcher() i=2 2024-09-12T16:59:53.928 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.923+0000 7f1358c209c0 20 add_watcher() i=3 2024-09-12T16:59:53.928 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.923+0000 7f1358c209c0 20 add_watcher() i=4 2024-09-12T16:59:53.928 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.923+0000 7f1358c209c0 20 add_watcher() i=5 2024-09-12T16:59:53.928 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.923+0000 7f1358c209c0 20 add_watcher() i=6 2024-09-12T16:59:53.930 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.923+0000 7f1358c209c0 20 add_watcher() i=7 2024-09-12T16:59:53.930 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.923+0000 7f1358c209c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:59:53.934 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.927+0000 7f120cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:59:53.935 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.931+0000 7f1358c209c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:59:53.935 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.931+0000 7f1358c209c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:59:53.935 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.931+0000 7f1358c209c0 5 note: GC not initialized 2024-09-12T16:59:53.936 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.931+0000 7f11877fe640 20 reqs_thread_entry: start 2024-09-12T16:59:53.936 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.931+0000 7f1358c209c0 20 init_complete bucket index max shards: 1 2024-09-12T16:59:53.936 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.931+0000 7f1358c209c0 20 Filter name: none 2024-09-12T16:59:53.936 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.931+0000 7f11857fa640 20 reqs_thread_entry: start 2024-09-12T16:59:53.937 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.931+0000 7f1358c209c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:53.937 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.931+0000 7f1358c209c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T16:59:53.937 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.931+0000 7f1358c209c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:53.938 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.931+0000 7f1358c209c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T16:59:53.939 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.931+0000 7f1358c209c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T16:59:53.939 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.931+0000 7f1358c209c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:53.939 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.931+0000 7f1358c209c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T16:59:53.939 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.931+0000 7f1358c209c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:53.939 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.935+0000 7f1358c209c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T16:59:53.939 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.935+0000 7f1358c209c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T16:59:53.942 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.935+0000 7f120cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:59:53.947 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.943+0000 7f1358c209c0 20 remove_watcher() i=0 2024-09-12T16:59:53.948 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.943+0000 7f1358c209c0 2 removed watcher, disabling cache 2024-09-12T16:59:53.950 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.943+0000 7f1358c209c0 20 remove_watcher() i=1 2024-09-12T16:59:53.952 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.947+0000 7f1358c209c0 20 remove_watcher() i=2 2024-09-12T16:59:53.954 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.947+0000 7f1358c209c0 20 remove_watcher() i=3 2024-09-12T16:59:53.956 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.951+0000 7f1358c209c0 20 remove_watcher() i=4 2024-09-12T16:59:53.958 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.951+0000 7f1358c209c0 20 remove_watcher() i=5 2024-09-12T16:59:53.959 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.955+0000 7f1358c209c0 20 remove_watcher() i=6 2024-09-12T16:59:53.961 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:53.955+0000 7f1358c209c0 20 remove_watcher() i=7 2024-09-12T16:59:53.982 INFO:tasks.workunit.client.0.smithi016.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 60, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-09-12T16:59:53.982 INFO:tasks.workunit.client.0.smithi016.stderr:TEST: bucket check unlinked does not report normal entries 2024-09-12T16:59:53.982 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T16:59:53.982 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T16:59:54.016 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:59:54.016 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:59:54.064 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.059+0000 7ffa433ad9c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:54.066 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.059+0000 7ffa433ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:54.066 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.059+0000 7ffa433ad9c0 20 realm 2024-09-12T16:59:54.066 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.059+0000 7ffa433ad9c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:54.066 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.059+0000 7ffa433ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:54.066 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.059+0000 7ffa433ad9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:59:54.066 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.059+0000 7ffa433ad9c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:54.066 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.059+0000 7ffa433ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:54.066 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.059+0000 7ffa433ad9c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:54.068 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.063+0000 7ffa433ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:59:54.068 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.063+0000 7ffa433ad9c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:54.070 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.063+0000 7ffa433ad9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T16:59:54.070 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.063+0000 7ffa433ad9c0 20 searching for the correct realm 2024-09-12T16:59:54.072 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.067+0000 7ffa416b4640 0 -- 172.21.15.16:0/1383248286 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7ffa34029070 msgr2=0x7ffa34061cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T16:59:54.290 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.283+0000 7ffa406b2640 0 -- 172.21.15.16:0/1383248286 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7ffa38062c20 msgr2=0x7ffa38047a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T16:59:54.506 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.499+0000 7ffa433ad9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T16:59:54.506 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.499+0000 7ffa433ad9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:59:54.506 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.499+0000 7ffa433ad9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T16:59:54.506 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.499+0000 7ffa433ad9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:59:54.506 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.499+0000 7ffa433ad9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:59:54.506 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.499+0000 7ffa433ad9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:59:54.506 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.499+0000 7ffa433ad9c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:54.506 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.499+0000 7ffa433ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:54.506 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.499+0000 7ffa433ad9c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:54.507 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.503+0000 7ffa433ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:59:54.507 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.503+0000 7ffa433ad9c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:54.508 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.503+0000 7ffa433ad9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T16:59:54.508 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.503+0000 7ffa433ad9c0 20 zone default found 2024-09-12T16:59:54.508 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.503+0000 7ffa433ad9c0 4 Realm: () 2024-09-12T16:59:54.508 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.503+0000 7ffa433ad9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T16:59:54.508 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.503+0000 7ffa433ad9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T16:59:54.508 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.503+0000 7ffa433ad9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:59:54.508 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.503+0000 7ffa433ad9c0 20 zonegroup default 2024-09-12T16:59:54.509 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.503+0000 7ffa433ad9c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:54.509 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.503+0000 7ffa433ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:54.509 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.503+0000 7ffa433ad9c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:54.509 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.503+0000 7ffa433ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:54.510 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.503+0000 7ffa433ad9c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:54.511 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.503+0000 7ffa433ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:54.511 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.507+0000 7ffa433ad9c0 20 started sync module instance, tier type = 2024-09-12T16:59:54.511 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.507+0000 7ffa433ad9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T16:59:54.536 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.531+0000 7ffa433ad9c0 20 add_watcher() i=0 2024-09-12T16:59:54.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.531+0000 7ffa433ad9c0 20 add_watcher() i=1 2024-09-12T16:59:54.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.531+0000 7ffa433ad9c0 20 add_watcher() i=2 2024-09-12T16:59:54.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.531+0000 7ffa433ad9c0 20 add_watcher() i=3 2024-09-12T16:59:54.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.531+0000 7ffa433ad9c0 20 add_watcher() i=4 2024-09-12T16:59:54.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.531+0000 7ffa433ad9c0 20 add_watcher() i=5 2024-09-12T16:59:54.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.531+0000 7ffa433ad9c0 20 add_watcher() i=6 2024-09-12T16:59:54.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.531+0000 7ffa433ad9c0 20 add_watcher() i=7 2024-09-12T16:59:54.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.531+0000 7ffa433ad9c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:59:54.542 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.535+0000 7ff8f6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:59:54.543 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.539+0000 7ffa433ad9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:59:54.543 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.539+0000 7ffa433ad9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:59:54.543 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.539+0000 7ffa433ad9c0 5 note: GC not initialized 2024-09-12T16:59:54.544 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.539+0000 7ff8f5fe3640 20 reqs_thread_entry: start 2024-09-12T16:59:54.544 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.539+0000 7ffa433ad9c0 20 init_complete bucket index max shards: 1 2024-09-12T16:59:54.544 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.539+0000 7ffa433ad9c0 20 Filter name: none 2024-09-12T16:59:54.544 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.539+0000 7ff8677fe640 20 reqs_thread_entry: start 2024-09-12T16:59:54.544 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.539+0000 7ffa433ad9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T16:59:54.544 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.539+0000 7ffa433ad9c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:54.545 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.539+0000 7ffa433ad9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T16:59:54.545 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.539+0000 7ffa433ad9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T16:59:54.545 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.539+0000 7ffa433ad9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T16:59:54.545 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.539+0000 7ffa433ad9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1 : miss 2024-09-12T16:59:54.545 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.539+0000 7ffa433ad9c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:54.546 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.539+0000 7ffa433ad9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T16:59:54.546 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.539+0000 7ffa433ad9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1 info.flags=0x17 2024-09-12T16:59:54.546 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.539+0000 7ffa433ad9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1 to cache LRU end 2024-09-12T16:59:54.546 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.539+0000 7ffa433ad9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:59:54.546 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.539+0000 7ffa433ad9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T16:59:54.546 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.539+0000 7ffa433ad9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1 2024-09-12T16:59:54.547 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.539+0000 7ffa433ad9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T16:59:54.547 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.543+0000 7ffa433ad9c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T16:59:54.547 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.543+0000 7ffa433ad9c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T16:59:54.549 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.543+0000 7ff8f6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:59:54.555 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.551+0000 7ffa433ad9c0 20 remove_watcher() i=0 2024-09-12T16:59:54.555 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.551+0000 7ffa433ad9c0 2 removed watcher, disabling cache 2024-09-12T16:59:54.557 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.551+0000 7ffa433ad9c0 20 remove_watcher() i=1 2024-09-12T16:59:54.559 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.555+0000 7ffa433ad9c0 20 remove_watcher() i=2 2024-09-12T16:59:54.561 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.555+0000 7ffa433ad9c0 20 remove_watcher() i=3 2024-09-12T16:59:54.564 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.559+0000 7ffa433ad9c0 20 remove_watcher() i=4 2024-09-12T16:59:54.565 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.559+0000 7ffa433ad9c0 20 remove_watcher() i=5 2024-09-12T16:59:54.567 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.563+0000 7ffa433ad9c0 20 remove_watcher() i=6 2024-09-12T16:59:54.568 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:54.563+0000 7ffa433ad9c0 20 remove_watcher() i=7 2024-09-12T16:59:54.586 INFO:tasks.workunit.client.0.smithi016.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T16:59:55.033 INFO:tasks.workunit.client.0.smithi016.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T16:59:56.540 INFO:tasks.workunit.client.0.smithi016.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T16:59:56.540 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T16:59:56.578 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:59:56.578 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:59:56.625 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.619+0000 7ff9d29919c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:56.627 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.623+0000 7ff9d29919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:56.627 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.623+0000 7ff9d29919c0 20 realm 2024-09-12T16:59:56.627 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.623+0000 7ff9d29919c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:56.627 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.623+0000 7ff9d29919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:56.627 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.623+0000 7ff9d29919c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:59:56.627 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.623+0000 7ff9d29919c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:56.628 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.623+0000 7ff9d29919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:56.628 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.623+0000 7ff9d29919c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:56.629 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.623+0000 7ff9d29919c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:59:56.629 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.623+0000 7ff9d29919c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:56.630 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.623+0000 7ff9d29919c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T16:59:56.630 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.623+0000 7ff9d29919c0 20 searching for the correct realm 2024-09-12T16:59:56.633 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.627+0000 7ff9d0c98640 0 -- 172.21.15.16:0/928691436 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7ff9b8062c20 msgr2=0x7ff9b8092a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T16:59:56.641 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.635+0000 7ff9cfc96640 0 -- 172.21.15.16:0/928691436 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7ff9c8114ba0 msgr2=0x7ff9c81340b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T16:59:56.858 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.851+0000 7ff9d29919c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T16:59:56.858 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.851+0000 7ff9d29919c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:59:56.858 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.851+0000 7ff9d29919c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T16:59:56.858 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.851+0000 7ff9d29919c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:59:56.859 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.851+0000 7ff9d29919c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:59:56.859 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.851+0000 7ff9d29919c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:59:56.859 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.851+0000 7ff9d29919c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:56.859 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.851+0000 7ff9d29919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:56.859 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.851+0000 7ff9d29919c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:56.860 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.855+0000 7ff9d29919c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:59:56.860 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.855+0000 7ff9d29919c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:56.860 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.855+0000 7ff9d29919c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T16:59:56.861 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.855+0000 7ff9d29919c0 20 zone default found 2024-09-12T16:59:56.861 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.855+0000 7ff9d29919c0 4 Realm: () 2024-09-12T16:59:56.861 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.855+0000 7ff9d29919c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T16:59:56.861 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.855+0000 7ff9d29919c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T16:59:56.861 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.855+0000 7ff9d29919c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:59:56.861 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.855+0000 7ff9d29919c0 20 zonegroup default 2024-09-12T16:59:56.861 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.855+0000 7ff9d29919c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:56.861 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.855+0000 7ff9d29919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:56.862 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.855+0000 7ff9d29919c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:56.862 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.855+0000 7ff9d29919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:56.862 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.855+0000 7ff9d29919c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:56.863 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.859+0000 7ff9d29919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:56.863 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.859+0000 7ff9d29919c0 20 started sync module instance, tier type = 2024-09-12T16:59:56.863 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.859+0000 7ff9d29919c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T16:59:56.888 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.883+0000 7ff9d29919c0 20 add_watcher() i=0 2024-09-12T16:59:56.888 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.883+0000 7ff9d29919c0 20 add_watcher() i=1 2024-09-12T16:59:56.888 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.883+0000 7ff9d29919c0 20 add_watcher() i=2 2024-09-12T16:59:56.889 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.883+0000 7ff9d29919c0 20 add_watcher() i=3 2024-09-12T16:59:56.889 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.883+0000 7ff9d29919c0 20 add_watcher() i=4 2024-09-12T16:59:56.889 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.883+0000 7ff9d29919c0 20 add_watcher() i=5 2024-09-12T16:59:56.889 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.883+0000 7ff9d29919c0 20 add_watcher() i=6 2024-09-12T16:59:56.890 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.883+0000 7ff9d29919c0 20 add_watcher() i=7 2024-09-12T16:59:56.890 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.883+0000 7ff9d29919c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:59:56.894 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.887+0000 7ff886fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:59:56.895 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.891+0000 7ff9d29919c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:59:56.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.891+0000 7ff9d29919c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:59:56.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.891+0000 7ff9d29919c0 5 note: GC not initialized 2024-09-12T16:59:56.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.891+0000 7ff885fdb640 20 reqs_thread_entry: start 2024-09-12T16:59:56.897 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.891+0000 7ff9d29919c0 20 init_complete bucket index max shards: 1 2024-09-12T16:59:56.897 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.891+0000 7ff9d29919c0 20 Filter name: none 2024-09-12T16:59:56.897 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.891+0000 7ff7f77fe640 20 reqs_thread_entry: start 2024-09-12T16:59:56.897 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.891+0000 7ff9d29919c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:56.897 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.891+0000 7ff9d29919c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T16:59:56.898 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.891+0000 7ff9d29919c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:56.898 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.891+0000 7ff9d29919c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T16:59:56.898 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.891+0000 7ff9d29919c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T16:59:56.898 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.891+0000 7ff9d29919c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T16:59:56.898 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.891+0000 7ff9d29919c0 20 INFO: main: starting shard=0 2024-09-12T16:59:56.898 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.891+0000 7ff9d29919c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T16:59:56.900 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.895+0000 7ff9d29919c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T16:59:56.900 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.895+0000 7ff9d29919c0 20 INFO: main: done 2024-09-12T16:59:56.902 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.895+0000 7ff886fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:59:56.907 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.903+0000 7ff9d29919c0 20 remove_watcher() i=0 2024-09-12T16:59:56.907 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.903+0000 7ff9d29919c0 2 removed watcher, disabling cache 2024-09-12T16:59:56.909 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.903+0000 7ff9d29919c0 20 remove_watcher() i=1 2024-09-12T16:59:56.911 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.907+0000 7ff9d29919c0 20 remove_watcher() i=2 2024-09-12T16:59:56.913 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.907+0000 7ff9d29919c0 20 remove_watcher() i=3 2024-09-12T16:59:56.915 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.911+0000 7ff9d29919c0 20 remove_watcher() i=4 2024-09-12T16:59:56.917 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.911+0000 7ff9d29919c0 20 remove_watcher() i=5 2024-09-12T16:59:56.919 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.915+0000 7ff9d29919c0 20 remove_watcher() i=6 2024-09-12T16:59:56.920 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:56.915+0000 7ff9d29919c0 20 remove_watcher() i=7 2024-09-12T16:59:57.004 INFO:tasks.workunit.client.0.smithi016.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T16:59:57.004 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T16:59:57.042 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:59:57.042 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:59:57.090 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.083+0000 7ffa8ef059c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:57.092 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.087+0000 7ffa8ef059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:57.092 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.087+0000 7ffa8ef059c0 20 realm 2024-09-12T16:59:57.092 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.087+0000 7ffa8ef059c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:57.093 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.087+0000 7ffa8ef059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:57.093 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.087+0000 7ffa8ef059c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:59:57.093 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.087+0000 7ffa8ef059c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:57.093 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.087+0000 7ffa8ef059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:57.093 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.087+0000 7ffa8ef059c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:57.094 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.087+0000 7ffa8ef059c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:59:57.094 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.087+0000 7ffa8ef059c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:57.096 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.091+0000 7ffa8ef059c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T16:59:57.096 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.091+0000 7ffa8ef059c0 20 searching for the correct realm 2024-09-12T16:59:57.099 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.095+0000 7ffa8d20c640 0 -- 172.21.15.16:0/2425955459 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7ffa7804a040 msgr2=0x7ffa7804a930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T16:59:57.317 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.311+0000 7ffa87fff640 0 -- 172.21.15.16:0/2425955459 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7ffa88048c10 msgr2=0x7ffa88056960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T16:59:57.534 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.527+0000 7ffa8ef059c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T16:59:57.535 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.527+0000 7ffa8ef059c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:59:57.535 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.527+0000 7ffa8ef059c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T16:59:57.535 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.527+0000 7ffa8ef059c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:59:57.535 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.527+0000 7ffa8ef059c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:59:57.535 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.527+0000 7ffa8ef059c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:59:57.535 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.527+0000 7ffa8ef059c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:57.535 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.531+0000 7ffa8ef059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:57.536 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.531+0000 7ffa8ef059c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:57.536 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.531+0000 7ffa8ef059c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:59:57.536 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.531+0000 7ffa8ef059c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:57.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.531+0000 7ffa8ef059c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T16:59:57.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.531+0000 7ffa8ef059c0 20 zone default found 2024-09-12T16:59:57.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.531+0000 7ffa8ef059c0 4 Realm: () 2024-09-12T16:59:57.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.531+0000 7ffa8ef059c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T16:59:57.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.531+0000 7ffa8ef059c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T16:59:57.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.531+0000 7ffa8ef059c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:59:57.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.531+0000 7ffa8ef059c0 20 zonegroup default 2024-09-12T16:59:57.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.531+0000 7ffa8ef059c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:57.539 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.531+0000 7ffa8ef059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:57.539 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.531+0000 7ffa8ef059c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:57.539 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.535+0000 7ffa8ef059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:57.539 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.535+0000 7ffa8ef059c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:57.540 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.535+0000 7ffa8ef059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:57.540 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.535+0000 7ffa8ef059c0 20 started sync module instance, tier type = 2024-09-12T16:59:57.540 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.535+0000 7ffa8ef059c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T16:59:57.564 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.559+0000 7ffa8ef059c0 20 add_watcher() i=0 2024-09-12T16:59:57.564 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.559+0000 7ffa8ef059c0 20 add_watcher() i=1 2024-09-12T16:59:57.565 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.559+0000 7ffa8ef059c0 20 add_watcher() i=2 2024-09-12T16:59:57.565 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.559+0000 7ffa8ef059c0 20 add_watcher() i=3 2024-09-12T16:59:57.565 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.559+0000 7ffa8ef059c0 20 add_watcher() i=4 2024-09-12T16:59:57.565 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.559+0000 7ffa8ef059c0 20 add_watcher() i=5 2024-09-12T16:59:57.565 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.559+0000 7ffa8ef059c0 20 add_watcher() i=6 2024-09-12T16:59:57.567 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.563+0000 7ffa8ef059c0 20 add_watcher() i=7 2024-09-12T16:59:57.567 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.563+0000 7ffa8ef059c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:59:57.572 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.567+0000 7ff942fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:59:57.573 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.567+0000 7ffa8ef059c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:59:57.573 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.567+0000 7ffa8ef059c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:59:57.573 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.567+0000 7ffa8ef059c0 5 note: GC not initialized 2024-09-12T16:59:57.573 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.567+0000 7ff941fe3640 20 reqs_thread_entry: start 2024-09-12T16:59:57.573 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.567+0000 7ffa8ef059c0 20 init_complete bucket index max shards: 1 2024-09-12T16:59:57.573 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.567+0000 7ffa8ef059c0 20 Filter name: none 2024-09-12T16:59:57.574 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.567+0000 7ff8b37fe640 20 reqs_thread_entry: start 2024-09-12T16:59:57.574 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.567+0000 7ffa8ef059c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:57.574 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.567+0000 7ffa8ef059c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T16:59:57.575 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.567+0000 7ffa8ef059c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:57.575 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.571+0000 7ffa8ef059c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T16:59:57.575 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.571+0000 7ffa8ef059c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T16:59:57.575 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.571+0000 7ffa8ef059c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T16:59:57.575 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.571+0000 7ffa8ef059c0 20 INFO: main: starting shard=0 2024-09-12T16:59:57.576 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.571+0000 7ffa8ef059c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T16:59:57.577 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.571+0000 7ffa8ef059c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T16:59:57.577 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.571+0000 7ffa8ef059c0 20 INFO: main: done 2024-09-12T16:59:57.578 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.571+0000 7ff942fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:59:57.584 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.579+0000 7ffa8ef059c0 20 remove_watcher() i=0 2024-09-12T16:59:57.584 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.579+0000 7ffa8ef059c0 2 removed watcher, disabling cache 2024-09-12T16:59:57.586 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.579+0000 7ffa8ef059c0 20 remove_watcher() i=1 2024-09-12T16:59:57.589 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.583+0000 7ffa8ef059c0 20 remove_watcher() i=2 2024-09-12T16:59:57.591 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.587+0000 7ffa8ef059c0 20 remove_watcher() i=3 2024-09-12T16:59:57.593 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.587+0000 7ffa8ef059c0 20 remove_watcher() i=4 2024-09-12T16:59:57.595 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.591+0000 7ffa8ef059c0 20 remove_watcher() i=5 2024-09-12T16:59:57.597 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.591+0000 7ffa8ef059c0 20 remove_watcher() i=6 2024-09-12T16:59:57.598 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.591+0000 7ffa8ef059c0 20 remove_watcher() i=7 2024-09-12T16:59:57.688 INFO:tasks.workunit.client.0.smithi016.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T16:59:57.688 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T16:59:57.727 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:59:57.727 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:59:57.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.767+0000 7f75434989c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:57.775 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.771+0000 7f75434989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:57.775 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.771+0000 7f75434989c0 20 realm 2024-09-12T16:59:57.775 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.771+0000 7f75434989c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:57.776 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.771+0000 7f75434989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:57.776 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.771+0000 7f75434989c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:59:57.776 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.771+0000 7f75434989c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:57.776 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.771+0000 7f75434989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:57.776 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.771+0000 7f75434989c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:57.777 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.771+0000 7f75434989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:59:57.777 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.771+0000 7f75434989c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:57.779 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.775+0000 7f75434989c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T16:59:57.779 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.775+0000 7f75434989c0 20 searching for the correct realm 2024-09-12T16:59:57.782 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.775+0000 7f754179f640 0 -- 172.21.15.16:0/838550301 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f752c102c20 msgr2=0x7f752c1263d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T16:59:57.997 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:57.991+0000 7f753bfff640 0 -- 172.21.15.16:0/838550301 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f753c038040 msgr2=0x7f753c038420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T16:59:58.215 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.211+0000 7f75434989c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T16:59:58.215 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.211+0000 7f75434989c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:59:58.216 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.211+0000 7f75434989c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T16:59:58.216 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.211+0000 7f75434989c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:59:58.216 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.211+0000 7f75434989c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:59:58.216 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.211+0000 7f75434989c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:59:58.216 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.211+0000 7f75434989c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:58.216 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.211+0000 7f75434989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:58.216 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.211+0000 7f75434989c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:58.217 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.211+0000 7f75434989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:59:58.217 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.211+0000 7f75434989c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:58.218 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.211+0000 7f75434989c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T16:59:58.218 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.211+0000 7f75434989c0 20 zone default found 2024-09-12T16:59:58.218 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.211+0000 7f75434989c0 4 Realm: () 2024-09-12T16:59:58.218 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.211+0000 7f75434989c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T16:59:58.218 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.211+0000 7f75434989c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T16:59:58.218 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.211+0000 7f75434989c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:59:58.218 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.211+0000 7f75434989c0 20 zonegroup default 2024-09-12T16:59:58.219 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.211+0000 7f75434989c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:58.219 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.211+0000 7f75434989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:58.219 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.215+0000 7f75434989c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:58.220 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.215+0000 7f75434989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:58.220 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.215+0000 7f75434989c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:58.221 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.215+0000 7f75434989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:58.221 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.215+0000 7f75434989c0 20 started sync module instance, tier type = 2024-09-12T16:59:58.221 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.215+0000 7f75434989c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T16:59:58.246 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.239+0000 7f75434989c0 20 add_watcher() i=0 2024-09-12T16:59:58.246 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.239+0000 7f75434989c0 20 add_watcher() i=1 2024-09-12T16:59:58.246 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.239+0000 7f75434989c0 20 add_watcher() i=2 2024-09-12T16:59:58.246 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.239+0000 7f75434989c0 20 add_watcher() i=3 2024-09-12T16:59:58.246 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.239+0000 7f75434989c0 20 add_watcher() i=4 2024-09-12T16:59:58.246 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.239+0000 7f75434989c0 20 add_watcher() i=5 2024-09-12T16:59:58.246 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.239+0000 7f75434989c0 20 add_watcher() i=6 2024-09-12T16:59:58.248 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.243+0000 7f75434989c0 20 add_watcher() i=7 2024-09-12T16:59:58.248 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.243+0000 7f75434989c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:59:58.252 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.247+0000 7f73f6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:59:58.253 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.247+0000 7f75434989c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:59:58.253 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.247+0000 7f75434989c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:59:58.253 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.247+0000 7f75434989c0 5 note: GC not initialized 2024-09-12T16:59:58.254 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.247+0000 7f73f5fe3640 20 reqs_thread_entry: start 2024-09-12T16:59:58.254 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.247+0000 7f75434989c0 20 init_complete bucket index max shards: 1 2024-09-12T16:59:58.255 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.247+0000 7f75434989c0 20 Filter name: none 2024-09-12T16:59:58.255 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.247+0000 7f73677fe640 20 reqs_thread_entry: start 2024-09-12T16:59:58.255 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.247+0000 7f75434989c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:58.255 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.251+0000 7f75434989c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T16:59:58.255 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.251+0000 7f75434989c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:58.256 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.251+0000 7f75434989c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T16:59:58.256 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.251+0000 7f75434989c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T16:59:58.256 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.251+0000 7f75434989c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T16:59:58.256 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.251+0000 7f75434989c0 20 INFO: main: starting shard=0 2024-09-12T16:59:58.256 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.251+0000 7f75434989c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T16:59:58.258 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.251+0000 7f75434989c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T16:59:58.258 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.251+0000 7f75434989c0 20 INFO: main: done 2024-09-12T16:59:58.259 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.255+0000 7f73f6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:59:58.265 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.259+0000 7f75434989c0 20 remove_watcher() i=0 2024-09-12T16:59:58.265 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.259+0000 7f75434989c0 2 removed watcher, disabling cache 2024-09-12T16:59:58.267 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.263+0000 7f75434989c0 20 remove_watcher() i=1 2024-09-12T16:59:58.269 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.263+0000 7f75434989c0 20 remove_watcher() i=2 2024-09-12T16:59:58.271 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.267+0000 7f75434989c0 20 remove_watcher() i=3 2024-09-12T16:59:58.273 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.267+0000 7f75434989c0 20 remove_watcher() i=4 2024-09-12T16:59:58.275 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.271+0000 7f75434989c0 20 remove_watcher() i=5 2024-09-12T16:59:58.276 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.271+0000 7f75434989c0 20 remove_watcher() i=6 2024-09-12T16:59:58.278 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.271+0000 7f75434989c0 20 remove_watcher() i=7 2024-09-12T16:59:58.360 INFO:tasks.workunit.client.0.smithi016.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T16:59:58.360 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T16:59:58.398 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:59:58.398 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:59:58.446 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.439+0000 7fd0606ec9c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:58.448 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.443+0000 7fd0606ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:58.448 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.443+0000 7fd0606ec9c0 20 realm 2024-09-12T16:59:58.448 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.443+0000 7fd0606ec9c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:58.448 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.443+0000 7fd0606ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:58.448 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.443+0000 7fd0606ec9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:59:58.449 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.443+0000 7fd0606ec9c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:58.449 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.443+0000 7fd0606ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:58.449 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.443+0000 7fd0606ec9c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:58.450 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.443+0000 7fd0606ec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:59:58.450 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.443+0000 7fd0606ec9c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:58.451 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.447+0000 7fd0606ec9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T16:59:58.452 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.447+0000 7fd0606ec9c0 20 searching for the correct realm 2024-09-12T16:59:58.456 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.451+0000 7fd05d9f1640 0 -- 172.21.15.16:0/3185838267 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7fd0500bac00 msgr2=0x7fd0500c6930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T16:59:58.664 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.659+0000 7fd05e9f3640 0 -- 172.21.15.16:0/3185838267 >> [v2:172.21.15.19:6800/1509147557,v1:172.21.15.19:6801/1509147557] conn(0x56418ab79f60 msgr2=0x56418ab7c350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T16:59:58.679 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.675+0000 7fd0606ec9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T16:59:58.679 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.675+0000 7fd0606ec9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:59:58.679 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.675+0000 7fd0606ec9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T16:59:58.679 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.675+0000 7fd0606ec9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:59:58.679 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.675+0000 7fd0606ec9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:59:58.679 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.675+0000 7fd0606ec9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:59:58.679 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.675+0000 7fd0606ec9c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:58.680 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.675+0000 7fd0606ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:58.680 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.675+0000 7fd0606ec9c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:58.680 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.675+0000 7fd0606ec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:59:58.680 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.675+0000 7fd0606ec9c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:58.681 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.675+0000 7fd0606ec9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T16:59:58.681 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.675+0000 7fd0606ec9c0 20 zone default found 2024-09-12T16:59:58.681 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.675+0000 7fd0606ec9c0 4 Realm: () 2024-09-12T16:59:58.681 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.675+0000 7fd0606ec9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T16:59:58.682 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.675+0000 7fd0606ec9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T16:59:58.682 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.675+0000 7fd0606ec9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:59:58.682 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.675+0000 7fd0606ec9c0 20 zonegroup default 2024-09-12T16:59:58.682 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.675+0000 7fd0606ec9c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:58.682 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.675+0000 7fd0606ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:58.683 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.675+0000 7fd0606ec9c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:58.683 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.679+0000 7fd0606ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:58.683 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.679+0000 7fd0606ec9c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:58.684 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.679+0000 7fd0606ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:58.684 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.679+0000 7fd0606ec9c0 20 started sync module instance, tier type = 2024-09-12T16:59:58.684 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.679+0000 7fd0606ec9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T16:59:58.710 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.703+0000 7fd0606ec9c0 20 add_watcher() i=0 2024-09-12T16:59:58.710 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.703+0000 7fd0606ec9c0 20 add_watcher() i=1 2024-09-12T16:59:58.710 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.703+0000 7fd0606ec9c0 20 add_watcher() i=2 2024-09-12T16:59:58.710 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.703+0000 7fd0606ec9c0 20 add_watcher() i=3 2024-09-12T16:59:58.711 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.703+0000 7fd0606ec9c0 20 add_watcher() i=4 2024-09-12T16:59:58.711 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.703+0000 7fd0606ec9c0 20 add_watcher() i=5 2024-09-12T16:59:58.711 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.703+0000 7fd0606ec9c0 20 add_watcher() i=6 2024-09-12T16:59:58.712 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.707+0000 7fd0606ec9c0 20 add_watcher() i=7 2024-09-12T16:59:58.712 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.707+0000 7fd0606ec9c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:59:58.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.711+0000 7fcf157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:59:58.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.711+0000 7fd0606ec9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:59:58.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.711+0000 7fd0606ec9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:59:58.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.711+0000 7fd0606ec9c0 5 note: GC not initialized 2024-09-12T16:59:58.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.711+0000 7fcf0f7fe640 20 reqs_thread_entry: start 2024-09-12T16:59:58.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.711+0000 7fd0606ec9c0 20 init_complete bucket index max shards: 1 2024-09-12T16:59:58.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.711+0000 7fd0606ec9c0 20 Filter name: none 2024-09-12T16:59:58.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.711+0000 7fcf0d7fa640 20 reqs_thread_entry: start 2024-09-12T16:59:58.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.715+0000 7fd0606ec9c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:58.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.715+0000 7fd0606ec9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T16:59:58.720 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.715+0000 7fd0606ec9c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:58.721 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.715+0000 7fd0606ec9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T16:59:58.721 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.715+0000 7fd0606ec9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T16:59:58.721 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.715+0000 7fd0606ec9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T16:59:58.721 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.715+0000 7fd0606ec9c0 20 INFO: main: starting shard=0 2024-09-12T16:59:58.721 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.715+0000 7fd0606ec9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T16:59:58.722 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.715+0000 7fd0606ec9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T16:59:58.722 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.715+0000 7fd0606ec9c0 20 INFO: main: done 2024-09-12T16:59:58.724 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.719+0000 7fcf157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:59:58.729 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.723+0000 7fd0606ec9c0 20 remove_watcher() i=0 2024-09-12T16:59:58.729 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.723+0000 7fd0606ec9c0 2 removed watcher, disabling cache 2024-09-12T16:59:58.732 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.727+0000 7fd0606ec9c0 20 remove_watcher() i=1 2024-09-12T16:59:58.734 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.727+0000 7fd0606ec9c0 20 remove_watcher() i=2 2024-09-12T16:59:58.736 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.731+0000 7fd0606ec9c0 20 remove_watcher() i=3 2024-09-12T16:59:58.739 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.735+0000 7fd0606ec9c0 20 remove_watcher() i=4 2024-09-12T16:59:58.740 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.735+0000 7fd0606ec9c0 20 remove_watcher() i=5 2024-09-12T16:59:58.742 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.735+0000 7fd0606ec9c0 20 remove_watcher() i=6 2024-09-12T16:59:58.744 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:58.739+0000 7fd0606ec9c0 20 remove_watcher() i=7 2024-09-12T16:59:58.775 INFO:tasks.workunit.client.0.smithi016.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T16:59:59.215 INFO:tasks.workunit.client.0.smithi016.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T16:59:59.651 INFO:tasks.workunit.client.0.smithi016.stderr:TEST: bucket check unlinked finds unlistable entries 2024-09-12T16:59:59.652 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T16:59:59.652 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T16:59:59.688 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:59:59.688 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T16:59:59.731 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.727+0000 7fe5360ec9c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:59.733 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.727+0000 7fe5360ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:59.733 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.727+0000 7fe5360ec9c0 20 realm 2024-09-12T16:59:59.733 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.727+0000 7fe5360ec9c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:59.733 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.727+0000 7fe5360ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:59.733 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.727+0000 7fe5360ec9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T16:59:59.733 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.727+0000 7fe5360ec9c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:59.733 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.727+0000 7fe5360ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:59.733 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.727+0000 7fe5360ec9c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:59.734 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.727+0000 7fe5360ec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:59:59.734 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.727+0000 7fe5360ec9c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:59.736 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.731+0000 7fe5360ec9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T16:59:59.736 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.731+0000 7fe5360ec9c0 20 searching for the correct realm 2024-09-12T16:59:59.741 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.735+0000 7fe533bf2640 0 -- 172.21.15.16:0/1150908553 >> [v2:172.21.15.16:6824/465585330,v1:172.21.15.16:6825/465585330] conn(0x558547e34010 msgr2=0x558547e364d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T16:59:59.747 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.743+0000 7fe5333f1640 0 -- 172.21.15.16:0/1150908553 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fe52c063b40 msgr2=0x7fe52c0962e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T16:59:59.755 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.747+0000 7fe5360ec9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T16:59:59.755 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.747+0000 7fe5360ec9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T16:59:59.755 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.747+0000 7fe5360ec9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T16:59:59.755 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.747+0000 7fe5360ec9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T16:59:59.755 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.747+0000 7fe5360ec9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T16:59:59.755 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.747+0000 7fe5360ec9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T16:59:59.755 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.747+0000 7fe5360ec9c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:59.755 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.751+0000 7fe5360ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:59.755 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.751+0000 7fe5360ec9c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:59.756 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.751+0000 7fe5360ec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T16:59:59.756 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.751+0000 7fe5360ec9c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:59.757 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.751+0000 7fe5360ec9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T16:59:59.757 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.751+0000 7fe5360ec9c0 20 zone default found 2024-09-12T16:59:59.757 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.751+0000 7fe5360ec9c0 4 Realm: () 2024-09-12T16:59:59.757 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.751+0000 7fe5360ec9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T16:59:59.757 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.751+0000 7fe5360ec9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T16:59:59.757 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.751+0000 7fe5360ec9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T16:59:59.757 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.751+0000 7fe5360ec9c0 20 zonegroup default 2024-09-12T16:59:59.757 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.751+0000 7fe5360ec9c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:59.757 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.751+0000 7fe5360ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:59.757 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.751+0000 7fe5360ec9c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:59.758 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.751+0000 7fe5360ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:59.758 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.751+0000 7fe5360ec9c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:59.758 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.751+0000 7fe5360ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T16:59:59.758 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.751+0000 7fe5360ec9c0 20 started sync module instance, tier type = 2024-09-12T16:59:59.758 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.751+0000 7fe5360ec9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T16:59:59.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.767+0000 7fe5360ec9c0 20 add_watcher() i=0 2024-09-12T16:59:59.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.767+0000 7fe5360ec9c0 20 add_watcher() i=1 2024-09-12T16:59:59.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.767+0000 7fe5360ec9c0 20 add_watcher() i=2 2024-09-12T16:59:59.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.767+0000 7fe5360ec9c0 20 add_watcher() i=3 2024-09-12T16:59:59.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.767+0000 7fe5360ec9c0 20 add_watcher() i=4 2024-09-12T16:59:59.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.767+0000 7fe5360ec9c0 20 add_watcher() i=5 2024-09-12T16:59:59.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.767+0000 7fe5360ec9c0 20 add_watcher() i=6 2024-09-12T16:59:59.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.767+0000 7fe5360ec9c0 20 add_watcher() i=7 2024-09-12T16:59:59.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.767+0000 7fe5360ec9c0 2 all 8 watchers are set, enabling cache 2024-09-12T16:59:59.777 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.771+0000 7fe3e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:59:59.778 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.771+0000 7fe5360ec9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T16:59:59.778 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.771+0000 7fe5360ec9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T16:59:59.778 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.771+0000 7fe5360ec9c0 5 note: GC not initialized 2024-09-12T16:59:59.778 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.771+0000 7fe3e8fe1640 20 reqs_thread_entry: start 2024-09-12T16:59:59.778 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.771+0000 7fe5360ec9c0 20 init_complete bucket index max shards: 1 2024-09-12T16:59:59.778 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.771+0000 7fe5360ec9c0 20 Filter name: none 2024-09-12T16:59:59.778 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.771+0000 7fe3627fc640 20 reqs_thread_entry: start 2024-09-12T16:59:59.778 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.771+0000 7fe5360ec9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T16:59:59.779 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.771+0000 7fe5360ec9c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:59.779 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.771+0000 7fe5360ec9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T16:59:59.780 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.771+0000 7fe5360ec9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T16:59:59.780 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.771+0000 7fe5360ec9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T16:59:59.780 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.771+0000 7fe5360ec9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1 : miss 2024-09-12T16:59:59.780 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.771+0000 7fe5360ec9c0 20 rados->read ofs=0 len=0 2024-09-12T16:59:59.780 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.775+0000 7fe5360ec9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T16:59:59.780 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.775+0000 7fe5360ec9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1 info.flags=0x17 2024-09-12T16:59:59.780 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.775+0000 7fe5360ec9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1 to cache LRU end 2024-09-12T16:59:59.780 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.775+0000 7fe5360ec9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T16:59:59.780 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.775+0000 7fe5360ec9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T16:59:59.780 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.775+0000 7fe5360ec9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1 2024-09-12T16:59:59.780 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.775+0000 7fe5360ec9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T16:59:59.784 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.779+0000 7fe5360ec9c0 1 NOTICE: finished shard 0 (4 entries found) 2024-09-12T16:59:59.784 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.779+0000 7fe5360ec9c0 1 NOTICE: finished all shards (4 entries found) 2024-09-12T16:59:59.785 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.779+0000 7fe3e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T16:59:59.790 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.783+0000 7fe5360ec9c0 20 remove_watcher() i=0 2024-09-12T16:59:59.790 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.783+0000 7fe5360ec9c0 2 removed watcher, disabling cache 2024-09-12T16:59:59.792 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.787+0000 7fe5360ec9c0 20 remove_watcher() i=1 2024-09-12T16:59:59.794 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.787+0000 7fe5360ec9c0 20 remove_watcher() i=2 2024-09-12T16:59:59.796 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.791+0000 7fe5360ec9c0 20 remove_watcher() i=3 2024-09-12T16:59:59.798 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.791+0000 7fe5360ec9c0 20 remove_watcher() i=4 2024-09-12T16:59:59.799 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.795+0000 7fe5360ec9c0 20 remove_watcher() i=5 2024-09-12T16:59:59.800 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.795+0000 7fe5360ec9c0 20 remove_watcher() i=6 2024-09-12T16:59:59.801 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T16:59:59.795+0000 7fe5360ec9c0 20 remove_watcher() i=7 2024-09-12T16:59:59.812 INFO:tasks.workunit.client.0.smithi016.stderr:TEST: unlinked entries are not listable 2024-09-12T16:59:59.812 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T16:59:59.819 INFO:tasks.workunit.client.0.smithi016.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-09-12T16:59:59.819 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T16:59:59.920 INFO:tasks.workunit.client.0.smithi016.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-09-12T16:59:59.920 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T16:59:59.921 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T16:59:59.960 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T16:59:59.960 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:00:00.009 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.003+0000 7fcbb566a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:00.011 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.003+0000 7fcbb566a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:00.011 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.003+0000 7fcbb566a9c0 20 realm 2024-09-12T17:00:00.011 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.003+0000 7fcbb566a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:00.011 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.003+0000 7fcbb566a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:00.011 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.003+0000 7fcbb566a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:00:00.011 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.003+0000 7fcbb566a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:00.011 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.007+0000 7fcbb566a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:00.011 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.007+0000 7fcbb566a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:00.012 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.007+0000 7fcbb566a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:00:00.012 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.007+0000 7fcbb566a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:00.014 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.007+0000 7fcbb566a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:00:00.014 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.007+0000 7fcbb566a9c0 20 searching for the correct realm 2024-09-12T17:00:00.017 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.011+0000 7fcbb3971640 0 -- 172.21.15.16:0/3465087299 >> [v2:172.21.15.19:6800/1509147557,v1:172.21.15.19:6801/1509147557] conn(0x5605894a8fc0 msgr2=0x5605894ab3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:00:00.024 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.019+0000 7fcbb296f640 0 -- 172.21.15.16:0/3465087299 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fcbac067420 msgr2=0x7fcbac09a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:00:00.242 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.235+0000 7fcbb566a9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:00:00.243 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.235+0000 7fcbb566a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:00:00.243 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.235+0000 7fcbb566a9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:00:00.243 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.235+0000 7fcbb566a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:00:00.243 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.235+0000 7fcbb566a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:00:00.243 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.235+0000 7fcbb566a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:00:00.243 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.235+0000 7fcbb566a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:00.243 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.239+0000 7fcbb566a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:00.244 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.239+0000 7fcbb566a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:00.244 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.239+0000 7fcbb566a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:00:00.244 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.239+0000 7fcbb566a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:00.245 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.239+0000 7fcbb566a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:00:00.245 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.239+0000 7fcbb566a9c0 20 zone default found 2024-09-12T17:00:00.245 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.239+0000 7fcbb566a9c0 4 Realm: () 2024-09-12T17:00:00.245 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.239+0000 7fcbb566a9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:00:00.245 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.239+0000 7fcbb566a9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:00:00.245 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.239+0000 7fcbb566a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:00:00.245 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.239+0000 7fcbb566a9c0 20 zonegroup default 2024-09-12T17:00:00.246 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.239+0000 7fcbb566a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:00.246 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.239+0000 7fcbb566a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:00.246 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.239+0000 7fcbb566a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:00.246 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.239+0000 7fcbb566a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:00.246 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.239+0000 7fcbb566a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:00.247 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.243+0000 7fcbb566a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:00.247 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.243+0000 7fcbb566a9c0 20 started sync module instance, tier type = 2024-09-12T17:00:00.247 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.243+0000 7fcbb566a9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:00:00.272 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.267+0000 7fcbb566a9c0 20 add_watcher() i=0 2024-09-12T17:00:00.272 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.267+0000 7fcbb566a9c0 20 add_watcher() i=1 2024-09-12T17:00:00.273 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.267+0000 7fcbb566a9c0 20 add_watcher() i=2 2024-09-12T17:00:00.273 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.267+0000 7fcbb566a9c0 20 add_watcher() i=3 2024-09-12T17:00:00.273 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.267+0000 7fcbb566a9c0 20 add_watcher() i=4 2024-09-12T17:00:00.273 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.267+0000 7fcbb566a9c0 20 add_watcher() i=5 2024-09-12T17:00:00.273 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.267+0000 7fcbb566a9c0 20 add_watcher() i=6 2024-09-12T17:00:00.275 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.271+0000 7fcbb566a9c0 20 add_watcher() i=7 2024-09-12T17:00:00.275 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.271+0000 7fcbb566a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:00:00.279 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.275+0000 7fca69fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:00:00.280 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.275+0000 7fcbb566a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:00:00.280 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.275+0000 7fcbb566a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:00:00.280 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.275+0000 7fcbb566a9c0 5 note: GC not initialized 2024-09-12T17:00:00.281 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.275+0000 7fca68fe1640 20 reqs_thread_entry: start 2024-09-12T17:00:00.281 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.275+0000 7fcbb566a9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:00:00.281 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.275+0000 7fcbb566a9c0 20 Filter name: none 2024-09-12T17:00:00.282 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.275+0000 7fc9e27fc640 20 reqs_thread_entry: start 2024-09-12T17:00:00.282 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.275+0000 7fcbb566a9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:00:00.282 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.275+0000 7fcbb566a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:00.282 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.275+0000 7fcbb566a9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:00:00.282 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.275+0000 7fcbb566a9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:00:00.282 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.275+0000 7fcbb566a9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:00:00.283 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.275+0000 7fcbb566a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1 : miss 2024-09-12T17:00:00.283 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.275+0000 7fcbb566a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:00.283 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.279+0000 7fcbb566a9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:00:00.283 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.279+0000 7fcbb566a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1 info.flags=0x17 2024-09-12T17:00:00.283 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.279+0000 7fcbb566a9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1 to cache LRU end 2024-09-12T17:00:00.284 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.279+0000 7fcbb566a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:00:00.284 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.279+0000 7fcbb566a9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:00:00.284 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.279+0000 7fcbb566a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1 2024-09-12T17:00:00.284 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.279+0000 7fcbb566a9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:00.287 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.283+0000 7fcbb566a9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:00.288 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.283+0000 7fcbb566a9c0 20 get_obj_state: octx=0x56058922f110 obj=check-bucket:c state=0x5605894e39b8 s->prefetch_data=0 2024-09-12T17:00:00.289 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.283+0000 7fcbb566a9c0 20 get_obj_state: setting s->obj_tag to n93mm90jtq6zwcfjiyzd2vvx13de741b 2024-09-12T17:00:00.289 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.283+0000 7fcbb566a9c0 20 get_obj_state_impl: setting s->olh_tag to z7tve3do5n7tsr0yucdprm794m71wv6o 2024-09-12T17:00:00.290 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.283+0000 7fcbb566a9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=z7tve3do5n7tsr0yucdprm794m71wv6o 2024-09-12T17:00:00.292 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.287+0000 7fcbb566a9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:00.296 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.291+0000 7fcbb566a9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:00.297 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.291+0000 7fcbb566a9c0 20 olh_log_entry: epoch=3 op=3 key=c[1Qkc6gD3mNQ8EIIfGOxiofRHhaXV1UZ] 2024-09-12T17:00:00.297 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.291+0000 7fcbb566a9c0 20 get_obj_state: octx=0x56058922f110 obj=check-bucket:_:1Qkc6gD3mNQ8EIIfGOxiofRHhaXV1UZ_c state=0x5605894de408 s->prefetch_data=0 2024-09-12T17:00:00.298 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.291+0000 7fcbb566a9c0 10 manifest: total_size = 22 2024-09-12T17:00:00.298 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.291+0000 7fcbb566a9c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17583373033244930257 2024-09-12T17:00:00.299 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.291+0000 7fcbb566a9c0 20 get_obj_state: octx=0x56058922f110 obj=check-bucket:_:1Qkc6gD3mNQ8EIIfGOxiofRHhaXV1UZ_c state=0x5605894de408 s->prefetch_data=0 2024-09-12T17:00:00.299 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.291+0000 7fcbb566a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5605894de408 2024-09-12T17:00:00.299 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.291+0000 7fcbb566a9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:00.305 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.299+0000 7fcbb566a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:00:00.305 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.299+0000 7fcbb566a9c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T17:00:00.305 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.299+0000 7fcbb566a9c0 0 deleting objects inline since gc isn't initialized 2024-09-12T17:00:00.305 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.299+0000 7fcbb566a9c0 5 delete_objs_inline: removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1__shadow:1Qkc6gD3mNQ8EIIfGOxiofRHhaXV1UZ_.K1SE4XOur9g1rnC-VbuGX2UHReby6Ll_0 2024-09-12T17:00:00.307 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.303+0000 7fcbb566a9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:00:00.307 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.303+0000 7fca967fc640 20 handle_completion(): completion ok for obj=c[1Qkc6gD3mNQ8EIIfGOxiofRHhaXV1UZ] 2024-09-12T17:00:00.310 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.303+0000 7fcbb566a9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:00.310 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.303+0000 7fcbb566a9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:00.313 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.307+0000 7fcbb566a9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:00.315 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.311+0000 7fcbb566a9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:00.316 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.311+0000 7fcbb566a9c0 20 get_obj_state: octx=0x56058922f110 obj=check-bucket:d state=0x560589510f28 s->prefetch_data=0 2024-09-12T17:00:00.317 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.311+0000 7fcbb566a9c0 20 get_obj_state: setting s->obj_tag to vvygdfs47rmq21q43udqqm19l0c0114w 2024-09-12T17:00:00.317 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.311+0000 7fcbb566a9c0 20 get_obj_state_impl: setting s->olh_tag to 8zx2f3mezb2ixf7xkargqkq8l1vfvn8l 2024-09-12T17:00:00.317 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.311+0000 7fcbb566a9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=8zx2f3mezb2ixf7xkargqkq8l1vfvn8l 2024-09-12T17:00:00.320 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.315+0000 7fcbb566a9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:00.323 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.319+0000 7fcbb566a9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:00.325 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.319+0000 7fcbb566a9c0 20 olh_log_entry: epoch=3 op=3 key=d[alZu3dsU9RNvzKvVUGpm2OmCzpENG2V] 2024-09-12T17:00:00.325 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.319+0000 7fcbb566a9c0 20 get_obj_state: octx=0x56058922f110 obj=check-bucket:_:alZu3dsU9RNvzKvVUGpm2OmCzpENG2V_d state=0x5605894e49c8 s->prefetch_data=0 2024-09-12T17:00:00.326 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.319+0000 7fcbb566a9c0 10 manifest: total_size = 22 2024-09-12T17:00:00.326 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.319+0000 7fcbb566a9c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7602584510111995913 2024-09-12T17:00:00.326 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.319+0000 7fcbb566a9c0 20 get_obj_state: octx=0x56058922f110 obj=check-bucket:_:alZu3dsU9RNvzKvVUGpm2OmCzpENG2V_d state=0x5605894e49c8 s->prefetch_data=0 2024-09-12T17:00:00.326 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.319+0000 7fcbb566a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5605894e49c8 2024-09-12T17:00:00.326 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.319+0000 7fcbb566a9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:00.332 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.327+0000 7fcbb566a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:00:00.332 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.327+0000 7fcbb566a9c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T17:00:00.332 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.327+0000 7fcbb566a9c0 0 deleting objects inline since gc isn't initialized 2024-09-12T17:00:00.332 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.327+0000 7fcbb566a9c0 5 delete_objs_inline: removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1__shadow:alZu3dsU9RNvzKvVUGpm2OmCzpENG2V_.VG1pjXcDOkjksYURwBmZFUiMczdDW9-_0 2024-09-12T17:00:00.335 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.331+0000 7fca96ffd640 20 handle_completion(): completion ok for obj=d[alZu3dsU9RNvzKvVUGpm2OmCzpENG2V] 2024-09-12T17:00:00.335 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.331+0000 7fcbb566a9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:00:00.338 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.331+0000 7fcbb566a9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:00.338 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.331+0000 7fcbb566a9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:00.341 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.335+0000 7fcbb566a9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:00.342 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.335+0000 7fcbb566a9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:00.343 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.339+0000 7fcbb566a9c0 20 get_obj_state: octx=0x56058922f110 obj=check-bucket:e state=0x560589510f28 s->prefetch_data=0 2024-09-12T17:00:00.344 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.339+0000 7fcbb566a9c0 20 get_obj_state: setting s->obj_tag to 8px46hljcqsjspb4l30kp0k9zp7t95jb 2024-09-12T17:00:00.344 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.339+0000 7fcbb566a9c0 20 get_obj_state_impl: setting s->olh_tag to xvtviu0hw7tvximi9mm7fx82nhnfvs7b 2024-09-12T17:00:00.345 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.339+0000 7fcbb566a9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=xvtviu0hw7tvximi9mm7fx82nhnfvs7b 2024-09-12T17:00:00.348 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.343+0000 7fcbb566a9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:00.351 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.347+0000 7fcbb566a9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:00.352 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.347+0000 7fcbb566a9c0 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T17:00:00.353 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.347+0000 7fcbb566a9c0 20 olh_log_entry: epoch=2 op=3 key=e[sylRdJ2uAZ2s9KUrncXRHEDzNLCXKV9] 2024-09-12T17:00:00.353 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.347+0000 7fcbb566a9c0 20 get_obj_state: octx=0x56058922f110 obj=check-bucket:_:sylRdJ2uAZ2s9KUrncXRHEDzNLCXKV9_e state=0x5605894db3d8 s->prefetch_data=0 2024-09-12T17:00:00.354 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.347+0000 7fcbb566a9c0 10 manifest: total_size = 22 2024-09-12T17:00:00.354 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.347+0000 7fcbb566a9c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8676393084265065801 2024-09-12T17:00:00.354 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.347+0000 7fcbb566a9c0 20 get_obj_state: octx=0x56058922f110 obj=check-bucket:_:sylRdJ2uAZ2s9KUrncXRHEDzNLCXKV9_e state=0x5605894db3d8 s->prefetch_data=0 2024-09-12T17:00:00.354 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.347+0000 7fcbb566a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5605894db3d8 2024-09-12T17:00:00.354 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.347+0000 7fcbb566a9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:00.360 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.355+0000 7fcbb566a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:00:00.360 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.355+0000 7fcbb566a9c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T17:00:00.360 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.355+0000 7fcbb566a9c0 0 deleting objects inline since gc isn't initialized 2024-09-12T17:00:00.360 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.355+0000 7fcbb566a9c0 5 delete_objs_inline: removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1__shadow:sylRdJ2uAZ2s9KUrncXRHEDzNLCXKV9_.HQCd0lFPT_3Uukq1fkGHw4rytQF_HOr_0 2024-09-12T17:00:00.362 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.355+0000 7fcbb566a9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:00:00.365 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.359+0000 7fcbb566a9c0 20 get_obj_state: octx=0x56058922f110 obj=check-bucket:e state=0x560589510f28 s->prefetch_data=0 2024-09-12T17:00:00.365 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.359+0000 7fcbb566a9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=xvtviu0hw7tvximi9mm7fx82nhnfvs7b 2024-09-12T17:00:00.368 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.363+0000 7fca967fc640 20 handle_completion(): completion ok for obj=e[sylRdJ2uAZ2s9KUrncXRHEDzNLCXKV9] 2024-09-12T17:00:00.372 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.367+0000 7fcbb566a9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:00.375 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.371+0000 7fcbb566a9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:00.376 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.371+0000 7fcbb566a9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:00.377 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.371+0000 7fcbb566a9c0 20 get_obj_state: octx=0x56058922f110 obj=check-bucket:f state=0x560589510f28 s->prefetch_data=0 2024-09-12T17:00:00.378 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.371+0000 7fcbb566a9c0 20 get_obj_state: setting s->obj_tag to pao99w5pin7vzesycdvuubz1x3utxqx5 2024-09-12T17:00:00.378 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.371+0000 7fcbb566a9c0 20 get_obj_state_impl: setting s->olh_tag to 8jzbjjnotpym23cytv2k9dyb2cc4fhmj 2024-09-12T17:00:00.379 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.371+0000 7fcbb566a9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=8jzbjjnotpym23cytv2k9dyb2cc4fhmj 2024-09-12T17:00:00.381 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.375+0000 7fcbb566a9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:00.385 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.379+0000 7fcbb566a9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:00.387 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.383+0000 7fcbb566a9c0 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T17:00:00.387 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.383+0000 7fcbb566a9c0 20 olh_log_entry: epoch=2 op=3 key=f[Zk4RBR6dOj60TZl3JU04oj5DcmoQMkn] 2024-09-12T17:00:00.387 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.383+0000 7fcbb566a9c0 20 get_obj_state: octx=0x56058922f110 obj=check-bucket:_:Zk4RBR6dOj60TZl3JU04oj5DcmoQMkn_f state=0x5605894da3c8 s->prefetch_data=0 2024-09-12T17:00:00.388 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.383+0000 7fcbb566a9c0 10 manifest: total_size = 12 2024-09-12T17:00:00.388 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.383+0000 7fcbb566a9c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17427605960497424465 2024-09-12T17:00:00.388 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.383+0000 7fcbb566a9c0 20 get_obj_state: octx=0x56058922f110 obj=check-bucket:_:Zk4RBR6dOj60TZl3JU04oj5DcmoQMkn_f state=0x5605894da3c8 s->prefetch_data=0 2024-09-12T17:00:00.388 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.383+0000 7fcbb566a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5605894da3c8 2024-09-12T17:00:00.388 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.383+0000 7fcbb566a9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:00.396 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.391+0000 7fcbb566a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:00:00.396 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.391+0000 7fcbb566a9c0 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T17:00:00.397 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.391+0000 7fcbb566a9c0 0 deleting objects inline since gc isn't initialized 2024-09-12T17:00:00.397 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.391+0000 7fcbb566a9c0 5 delete_objs_inline: removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1__shadow:Zk4RBR6dOj60TZl3JU04oj5DcmoQMkn_.DCKQo75hNuiZk0qA-l_054A1ZQIvvH__0 2024-09-12T17:00:00.399 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.395+0000 7fcbb566a9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:00:00.402 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.395+0000 7fca96ffd640 20 handle_completion(): completion ok for obj=f[Zk4RBR6dOj60TZl3JU04oj5DcmoQMkn] 2024-09-12T17:00:00.402 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.395+0000 7fcbb566a9c0 20 get_obj_state: octx=0x56058922f110 obj=check-bucket:f state=0x560589510f28 s->prefetch_data=0 2024-09-12T17:00:00.402 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.395+0000 7fcbb566a9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=8jzbjjnotpym23cytv2k9dyb2cc4fhmj 2024-09-12T17:00:00.408 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.403+0000 7fcbb566a9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:00.411 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.407+0000 7fcbb566a9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:00.412 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.407+0000 7fcbb566a9c0 1 NOTICE: finished shard 0 (4 entries removed) 2024-09-12T17:00:00.412 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.407+0000 7fcbb566a9c0 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T17:00:00.414 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.407+0000 7fca69fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:00:00.419 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.415+0000 7fcbb566a9c0 20 remove_watcher() i=0 2024-09-12T17:00:00.420 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.415+0000 7fcbb566a9c0 2 removed watcher, disabling cache 2024-09-12T17:00:00.422 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.415+0000 7fcbb566a9c0 20 remove_watcher() i=1 2024-09-12T17:00:00.424 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.419+0000 7fcbb566a9c0 20 remove_watcher() i=2 2024-09-12T17:00:00.427 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.423+0000 7fcbb566a9c0 20 remove_watcher() i=3 2024-09-12T17:00:00.429 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.423+0000 7fcbb566a9c0 20 remove_watcher() i=4 2024-09-12T17:00:00.431 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.427+0000 7fcbb566a9c0 20 remove_watcher() i=5 2024-09-12T17:00:00.433 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.427+0000 7fcbb566a9c0 20 remove_watcher() i=6 2024-09-12T17:00:00.435 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.431+0000 7fcbb566a9c0 20 remove_watcher() i=7 2024-09-12T17:00:00.474 INFO:tasks.workunit.client.0.smithi016.stderr:TEST: bucket check unlinked does not affect normal entries 2024-09-12T17:00:00.474 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:00:00.549 INFO:tasks.workunit.client.0.smithi016.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-09-12T17:00:00.549 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:00:00.549 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T17:00:00.588 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:00:00.588 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:00:00.635 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.631+0000 7fc09cbbb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:00.637 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.631+0000 7fc09cbbb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:00.637 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.631+0000 7fc09cbbb9c0 20 realm 2024-09-12T17:00:00.637 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.631+0000 7fc09cbbb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:00.637 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.631+0000 7fc09cbbb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:00.637 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.631+0000 7fc09cbbb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:00:00.637 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.631+0000 7fc09cbbb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:00.637 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.631+0000 7fc09cbbb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:00.637 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.631+0000 7fc09cbbb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:00.639 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.631+0000 7fc09cbbb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:00:00.639 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.631+0000 7fc09cbbb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:00.640 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.635+0000 7fc09cbbb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:00:00.641 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.635+0000 7fc09cbbb9c0 20 searching for the correct realm 2024-09-12T17:00:00.644 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.639+0000 7fc09aec2640 0 -- 172.21.15.16:0/691522744 >> [v2:172.21.15.19:6800/1509147557,v1:172.21.15.19:6801/1509147557] conn(0x5636306f4ed0 msgr2=0x5636306f72c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:00:00.652 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.647+0000 7fc099ec0640 0 -- 172.21.15.16:0/691522744 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fc094063210 msgr2=0x7fc09407d250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:00:00.871 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.863+0000 7fc09cbbb9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:00:00.871 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.863+0000 7fc09cbbb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:00:00.871 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.863+0000 7fc09cbbb9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:00:00.871 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.863+0000 7fc09cbbb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:00:00.871 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.863+0000 7fc09cbbb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:00:00.871 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.863+0000 7fc09cbbb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:00:00.871 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.867+0000 7fc09cbbb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:00.872 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.867+0000 7fc09cbbb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:00.872 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.867+0000 7fc09cbbb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:00.873 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.867+0000 7fc09cbbb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:00:00.873 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.867+0000 7fc09cbbb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:00.877 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.867+0000 7fc09cbbb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:00:00.877 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.867+0000 7fc09cbbb9c0 20 zone default found 2024-09-12T17:00:00.877 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.867+0000 7fc09cbbb9c0 4 Realm: () 2024-09-12T17:00:00.877 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.867+0000 7fc09cbbb9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:00:00.877 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.867+0000 7fc09cbbb9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:00:00.878 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.867+0000 7fc09cbbb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:00:00.878 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.867+0000 7fc09cbbb9c0 20 zonegroup default 2024-09-12T17:00:00.878 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.867+0000 7fc09cbbb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:00.878 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.867+0000 7fc09cbbb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:00.878 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.867+0000 7fc09cbbb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:00.878 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.871+0000 7fc09cbbb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:00.878 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.871+0000 7fc09cbbb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:00.878 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.871+0000 7fc09cbbb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:00.878 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.871+0000 7fc09cbbb9c0 20 started sync module instance, tier type = 2024-09-12T17:00:00.878 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.871+0000 7fc09cbbb9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:00:00.900 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.895+0000 7fc09cbbb9c0 20 add_watcher() i=0 2024-09-12T17:00:00.900 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.895+0000 7fc09cbbb9c0 20 add_watcher() i=1 2024-09-12T17:00:00.900 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.895+0000 7fc09cbbb9c0 20 add_watcher() i=2 2024-09-12T17:00:00.901 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.895+0000 7fc09cbbb9c0 20 add_watcher() i=3 2024-09-12T17:00:00.901 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.895+0000 7fc09cbbb9c0 20 add_watcher() i=4 2024-09-12T17:00:00.901 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.895+0000 7fc09cbbb9c0 20 add_watcher() i=5 2024-09-12T17:00:00.901 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.895+0000 7fc09cbbb9c0 20 add_watcher() i=6 2024-09-12T17:00:00.903 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.899+0000 7fc09cbbb9c0 20 add_watcher() i=7 2024-09-12T17:00:00.903 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.899+0000 7fc09cbbb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:00:00.907 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.903+0000 7fbf517e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:00:00.908 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.903+0000 7fc09cbbb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:00:00.908 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.903+0000 7fc09cbbb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:00:00.908 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.903+0000 7fc09cbbb9c0 5 note: GC not initialized 2024-09-12T17:00:00.909 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.903+0000 7fbf4b7fe640 20 reqs_thread_entry: start 2024-09-12T17:00:00.909 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.903+0000 7fc09cbbb9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:00:00.909 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.903+0000 7fc09cbbb9c0 20 Filter name: none 2024-09-12T17:00:00.910 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.903+0000 7fbf497fa640 20 reqs_thread_entry: start 2024-09-12T17:00:00.910 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.903+0000 7fc09cbbb9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:00:00.910 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.903+0000 7fc09cbbb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:00.911 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.907+0000 7fc09cbbb9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:00:00.911 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.907+0000 7fc09cbbb9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:00:00.911 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.907+0000 7fc09cbbb9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:00:00.911 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.907+0000 7fc09cbbb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1 : miss 2024-09-12T17:00:00.911 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.907+0000 7fc09cbbb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:00.912 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.907+0000 7fc09cbbb9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:00:00.912 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.907+0000 7fc09cbbb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1 info.flags=0x17 2024-09-12T17:00:00.912 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.907+0000 7fc09cbbb9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1 to cache LRU end 2024-09-12T17:00:00.912 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.907+0000 7fc09cbbb9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:00:00.912 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.907+0000 7fc09cbbb9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:00:00.912 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.907+0000 7fc09cbbb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1 2024-09-12T17:00:00.912 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.907+0000 7fc09cbbb9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:00.913 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.907+0000 7fc09cbbb9c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T17:00:00.913 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.907+0000 7fc09cbbb9c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T17:00:00.915 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.911+0000 7fbf517e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:00:00.921 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.915+0000 7fc09cbbb9c0 20 remove_watcher() i=0 2024-09-12T17:00:00.921 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.915+0000 7fc09cbbb9c0 2 removed watcher, disabling cache 2024-09-12T17:00:00.923 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.919+0000 7fc09cbbb9c0 20 remove_watcher() i=1 2024-09-12T17:00:00.926 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.919+0000 7fc09cbbb9c0 20 remove_watcher() i=2 2024-09-12T17:00:00.928 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.923+0000 7fc09cbbb9c0 20 remove_watcher() i=3 2024-09-12T17:00:00.931 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.927+0000 7fc09cbbb9c0 20 remove_watcher() i=4 2024-09-12T17:00:00.933 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.927+0000 7fc09cbbb9c0 20 remove_watcher() i=5 2024-09-12T17:00:00.934 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.927+0000 7fc09cbbb9c0 20 remove_watcher() i=6 2024-09-12T17:00:00.936 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:00.931+0000 7fc09cbbb9c0 20 remove_watcher() i=7 2024-09-12T17:00:01.012 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T17:00:01.048 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:00:01.048 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:00:01.095 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.091+0000 7f517b7ea9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:01.097 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.091+0000 7f517b7ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:01.097 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.091+0000 7f517b7ea9c0 20 realm 2024-09-12T17:00:01.098 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.091+0000 7f517b7ea9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:01.098 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.091+0000 7f517b7ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:01.098 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.091+0000 7f517b7ea9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:00:01.098 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.091+0000 7f517b7ea9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:01.098 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.091+0000 7f517b7ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:01.098 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.091+0000 7f517b7ea9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:01.099 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.095+0000 7f517b7ea9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:00:01.099 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.095+0000 7f517b7ea9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:01.101 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.095+0000 7f517b7ea9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:00:01.101 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.095+0000 7f517b7ea9c0 20 searching for the correct realm 2024-09-12T17:00:01.106 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.099+0000 7f5179af1640 0 -- 172.21.15.16:0/1299452139 >> [v2:172.21.15.19:6800/1509147557,v1:172.21.15.19:6801/1509147557] conn(0x55c1035e8da0 msgr2=0x55c1035eb190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:00:01.112 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.107+0000 7f5179af1640 0 -- 172.21.15.16:0/1299452139 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f516c0cd030 msgr2=0x7f516c103050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:00:01.123 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.115+0000 7f517b7ea9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:00:01.123 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.115+0000 7f517b7ea9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:00:01.123 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.115+0000 7f517b7ea9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:00:01.123 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.115+0000 7f517b7ea9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:00:01.123 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.115+0000 7f517b7ea9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:00:01.123 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.115+0000 7f517b7ea9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:00:01.123 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.115+0000 7f517b7ea9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:01.124 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.119+0000 7f517b7ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:01.124 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.119+0000 7f517b7ea9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:01.124 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.119+0000 7f517b7ea9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:00:01.124 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.119+0000 7f517b7ea9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:01.125 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.119+0000 7f517b7ea9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:00:01.125 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.119+0000 7f517b7ea9c0 20 zone default found 2024-09-12T17:00:01.125 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.119+0000 7f517b7ea9c0 4 Realm: () 2024-09-12T17:00:01.125 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.119+0000 7f517b7ea9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:00:01.125 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.119+0000 7f517b7ea9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:00:01.125 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.119+0000 7f517b7ea9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:00:01.125 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.119+0000 7f517b7ea9c0 20 zonegroup default 2024-09-12T17:00:01.125 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.119+0000 7f517b7ea9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:01.125 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.119+0000 7f517b7ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:01.125 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.119+0000 7f517b7ea9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:01.126 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.119+0000 7f517b7ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:01.126 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.119+0000 7f517b7ea9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:01.126 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.119+0000 7f517b7ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:01.126 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.119+0000 7f517b7ea9c0 20 started sync module instance, tier type = 2024-09-12T17:00:01.126 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.119+0000 7f517b7ea9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:00:01.142 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.135+0000 7f517b7ea9c0 20 add_watcher() i=0 2024-09-12T17:00:01.142 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.135+0000 7f517b7ea9c0 20 add_watcher() i=1 2024-09-12T17:00:01.142 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.135+0000 7f517b7ea9c0 20 add_watcher() i=2 2024-09-12T17:00:01.142 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.135+0000 7f517b7ea9c0 20 add_watcher() i=3 2024-09-12T17:00:01.142 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.135+0000 7f517b7ea9c0 20 add_watcher() i=4 2024-09-12T17:00:01.142 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.135+0000 7f517b7ea9c0 20 add_watcher() i=5 2024-09-12T17:00:01.142 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.135+0000 7f517b7ea9c0 20 add_watcher() i=6 2024-09-12T17:00:01.143 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.139+0000 7f517b7ea9c0 20 add_watcher() i=7 2024-09-12T17:00:01.143 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.139+0000 7f517b7ea9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:00:01.145 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.139+0000 7f502ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:00:01.146 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.139+0000 7f517b7ea9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:00:01.146 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.139+0000 7f517b7ea9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:00:01.146 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.139+0000 7f517b7ea9c0 5 note: GC not initialized 2024-09-12T17:00:01.147 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.139+0000 7f502efe5640 20 reqs_thread_entry: start 2024-09-12T17:00:01.147 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.139+0000 7f517b7ea9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:00:01.147 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.143+0000 7f517b7ea9c0 20 Filter name: none 2024-09-12T17:00:01.147 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.143+0000 7f502cfe1640 20 reqs_thread_entry: start 2024-09-12T17:00:01.147 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.143+0000 7f517b7ea9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:01.148 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.143+0000 7f517b7ea9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:00:01.148 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.143+0000 7f517b7ea9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:01.148 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.143+0000 7f517b7ea9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:00:01.148 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.143+0000 7f517b7ea9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:00:01.149 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.143+0000 7f517b7ea9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T17:00:01.149 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.143+0000 7f517b7ea9c0 20 INFO: main: starting shard=0 2024-09-12T17:00:01.149 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.143+0000 7f517b7ea9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:01.150 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.143+0000 7f517b7ea9c0 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T17:00:01.150 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.143+0000 7f517b7ea9c0 20 INFO: main: done 2024-09-12T17:00:01.151 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.147+0000 7f502ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:00:01.156 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.151+0000 7f517b7ea9c0 20 remove_watcher() i=0 2024-09-12T17:00:01.156 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.151+0000 7f517b7ea9c0 2 removed watcher, disabling cache 2024-09-12T17:00:01.158 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.151+0000 7f517b7ea9c0 20 remove_watcher() i=1 2024-09-12T17:00:01.160 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.155+0000 7f517b7ea9c0 20 remove_watcher() i=2 2024-09-12T17:00:01.162 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.155+0000 7f517b7ea9c0 20 remove_watcher() i=3 2024-09-12T17:00:01.164 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.159+0000 7f517b7ea9c0 20 remove_watcher() i=4 2024-09-12T17:00:01.166 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.159+0000 7f517b7ea9c0 20 remove_watcher() i=5 2024-09-12T17:00:01.167 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.163+0000 7f517b7ea9c0 20 remove_watcher() i=6 2024-09-12T17:00:01.168 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.163+0000 7f517b7ea9c0 20 remove_watcher() i=7 2024-09-12T17:00:01.183 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T17:00:01.212 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:00:01.212 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:00:01.257 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.251+0000 7f6b0842a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:01.259 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.255+0000 7f6b0842a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:01.259 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.255+0000 7f6b0842a9c0 20 realm 2024-09-12T17:00:01.260 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.255+0000 7f6b0842a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:01.260 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.255+0000 7f6b0842a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:01.260 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.255+0000 7f6b0842a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:00:01.260 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.255+0000 7f6b0842a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:01.260 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.255+0000 7f6b0842a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:01.260 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.255+0000 7f6b0842a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:01.261 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.255+0000 7f6b0842a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:00:01.261 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.255+0000 7f6b0842a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:01.263 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.259+0000 7f6b0842a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:00:01.263 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.259+0000 7f6b0842a9c0 20 searching for the correct realm 2024-09-12T17:00:01.266 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.259+0000 7f6b06731640 0 -- 172.21.15.16:0/3307562164 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f6afc018070 msgr2=0x7f6afc0648e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:00:01.274 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.267+0000 7f6b0572f640 0 -- 172.21.15.16:0/3307562164 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f6b000c8410 msgr2=0x7f6b000c8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:00:01.492 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.487+0000 7f6b0842a9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:00:01.493 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.487+0000 7f6b0842a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:00:01.493 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.487+0000 7f6b0842a9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:00:01.493 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.487+0000 7f6b0842a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:00:01.493 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.487+0000 7f6b0842a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:00:01.493 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.487+0000 7f6b0842a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:00:01.493 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.487+0000 7f6b0842a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:01.494 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.487+0000 7f6b0842a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:01.494 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.487+0000 7f6b0842a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:01.494 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.487+0000 7f6b0842a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:00:01.494 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.487+0000 7f6b0842a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:01.495 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.487+0000 7f6b0842a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:00:01.495 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.487+0000 7f6b0842a9c0 20 zone default found 2024-09-12T17:00:01.496 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.487+0000 7f6b0842a9c0 4 Realm: () 2024-09-12T17:00:01.496 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.487+0000 7f6b0842a9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:00:01.496 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.487+0000 7f6b0842a9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:00:01.496 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.487+0000 7f6b0842a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:00:01.496 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.487+0000 7f6b0842a9c0 20 zonegroup default 2024-09-12T17:00:01.496 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.487+0000 7f6b0842a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:01.497 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.491+0000 7f6b0842a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:01.497 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.491+0000 7f6b0842a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:01.497 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.491+0000 7f6b0842a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:01.497 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.491+0000 7f6b0842a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:01.497 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.491+0000 7f6b0842a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:01.497 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.491+0000 7f6b0842a9c0 20 started sync module instance, tier type = 2024-09-12T17:00:01.497 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.491+0000 7f6b0842a9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:00:01.522 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.515+0000 7f6b0842a9c0 20 add_watcher() i=0 2024-09-12T17:00:01.522 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.515+0000 7f6b0842a9c0 20 add_watcher() i=1 2024-09-12T17:00:01.522 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.515+0000 7f6b0842a9c0 20 add_watcher() i=2 2024-09-12T17:00:01.522 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.515+0000 7f6b0842a9c0 20 add_watcher() i=3 2024-09-12T17:00:01.522 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.515+0000 7f6b0842a9c0 20 add_watcher() i=4 2024-09-12T17:00:01.522 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.515+0000 7f6b0842a9c0 20 add_watcher() i=5 2024-09-12T17:00:01.522 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.515+0000 7f6b0842a9c0 20 add_watcher() i=6 2024-09-12T17:00:01.524 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.519+0000 7f6b0842a9c0 20 add_watcher() i=7 2024-09-12T17:00:01.524 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.519+0000 7f6b0842a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:00:01.529 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.523+0000 7f69bbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:00:01.530 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.523+0000 7f6b0842a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:00:01.530 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.523+0000 7f6b0842a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:00:01.530 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.523+0000 7f6b0842a9c0 5 note: GC not initialized 2024-09-12T17:00:01.531 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.523+0000 7f69bafe5640 20 reqs_thread_entry: start 2024-09-12T17:00:01.531 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.523+0000 7f6b0842a9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:00:01.531 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.527+0000 7f6b0842a9c0 20 Filter name: none 2024-09-12T17:00:01.531 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.527+0000 7f69b8fe1640 20 reqs_thread_entry: start 2024-09-12T17:00:01.531 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.527+0000 7f6b0842a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:01.532 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.527+0000 7f6b0842a9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:00:01.532 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.527+0000 7f6b0842a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:01.533 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.527+0000 7f6b0842a9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:00:01.533 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.527+0000 7f6b0842a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:00:01.533 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.527+0000 7f6b0842a9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T17:00:01.533 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.527+0000 7f6b0842a9c0 20 INFO: main: starting shard=0 2024-09-12T17:00:01.533 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.527+0000 7f6b0842a9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:01.534 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.527+0000 7f6b0842a9c0 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T17:00:01.534 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.527+0000 7f6b0842a9c0 20 INFO: main: done 2024-09-12T17:00:01.536 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.531+0000 7f69bbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:00:01.544 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.539+0000 7f6b0842a9c0 20 remove_watcher() i=0 2024-09-12T17:00:01.544 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.539+0000 7f6b0842a9c0 2 removed watcher, disabling cache 2024-09-12T17:00:01.546 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.539+0000 7f6b0842a9c0 20 remove_watcher() i=1 2024-09-12T17:00:01.550 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.543+0000 7f6b0842a9c0 20 remove_watcher() i=2 2024-09-12T17:00:01.552 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.547+0000 7f6b0842a9c0 20 remove_watcher() i=3 2024-09-12T17:00:01.554 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.551+0000 7f6b0842a9c0 20 remove_watcher() i=4 2024-09-12T17:00:01.556 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.551+0000 7f6b0842a9c0 20 remove_watcher() i=5 2024-09-12T17:00:01.557 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.551+0000 7f6b0842a9c0 20 remove_watcher() i=6 2024-09-12T17:00:01.559 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.555+0000 7f6b0842a9c0 20 remove_watcher() i=7 2024-09-12T17:00:01.579 INFO:tasks.workunit.client.0.smithi016.stderr:TEST: bucket check olh finds leftover OLH entries 2024-09-12T17:00:01.580 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:00:01.580 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T17:00:01.616 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:00:01.616 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:00:01.664 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.659+0000 7ff118ae99c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:01.666 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.659+0000 7ff118ae99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:01.666 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.659+0000 7ff118ae99c0 20 realm 2024-09-12T17:00:01.666 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.659+0000 7ff118ae99c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:01.667 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.659+0000 7ff118ae99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:01.667 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.659+0000 7ff118ae99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:00:01.667 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.659+0000 7ff118ae99c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:01.667 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.659+0000 7ff118ae99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:01.667 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.659+0000 7ff118ae99c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:01.668 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.663+0000 7ff118ae99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:00:01.668 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.663+0000 7ff118ae99c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:01.670 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.663+0000 7ff118ae99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:00:01.670 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.663+0000 7ff118ae99c0 20 searching for the correct realm 2024-09-12T17:00:01.673 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.667+0000 7ff116df0640 0 -- 172.21.15.16:0/2003288554 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7ff10c01a040 msgr2=0x7ff10c01a420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:00:01.889 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:01.883+0000 7ff115dee640 0 -- 172.21.15.16:0/2003288554 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7ff110050960 msgr2=0x7ff11000ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:00:02.109 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.103+0000 7ff118ae99c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:00:02.109 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.103+0000 7ff118ae99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:00:02.109 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.103+0000 7ff118ae99c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:00:02.109 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.103+0000 7ff118ae99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:00:02.109 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.103+0000 7ff118ae99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:00:02.109 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.103+0000 7ff118ae99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:00:02.110 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.103+0000 7ff118ae99c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:02.110 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.103+0000 7ff118ae99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:02.110 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.103+0000 7ff118ae99c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:02.110 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.103+0000 7ff118ae99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:00:02.110 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.103+0000 7ff118ae99c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:02.110 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.103+0000 7ff118ae99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:00:02.111 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.103+0000 7ff118ae99c0 20 zone default found 2024-09-12T17:00:02.111 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.103+0000 7ff118ae99c0 4 Realm: () 2024-09-12T17:00:02.111 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.103+0000 7ff118ae99c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:00:02.111 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.103+0000 7ff118ae99c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:00:02.111 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.103+0000 7ff118ae99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:00:02.111 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.103+0000 7ff118ae99c0 20 zonegroup default 2024-09-12T17:00:02.111 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.103+0000 7ff118ae99c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:02.111 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.103+0000 7ff118ae99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:02.111 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.103+0000 7ff118ae99c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:02.112 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.107+0000 7ff118ae99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:02.112 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.107+0000 7ff118ae99c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:02.112 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.107+0000 7ff118ae99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:02.112 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.107+0000 7ff118ae99c0 20 started sync module instance, tier type = 2024-09-12T17:00:02.113 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.107+0000 7ff118ae99c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:00:02.137 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.131+0000 7ff118ae99c0 20 add_watcher() i=0 2024-09-12T17:00:02.137 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.131+0000 7ff118ae99c0 20 add_watcher() i=1 2024-09-12T17:00:02.137 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.131+0000 7ff118ae99c0 20 add_watcher() i=2 2024-09-12T17:00:02.137 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.131+0000 7ff118ae99c0 20 add_watcher() i=3 2024-09-12T17:00:02.137 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.131+0000 7ff118ae99c0 20 add_watcher() i=4 2024-09-12T17:00:02.137 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.131+0000 7ff118ae99c0 20 add_watcher() i=5 2024-09-12T17:00:02.137 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.131+0000 7ff118ae99c0 20 add_watcher() i=6 2024-09-12T17:00:02.139 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.135+0000 7ff118ae99c0 20 add_watcher() i=7 2024-09-12T17:00:02.140 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.135+0000 7ff118ae99c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:00:02.144 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.139+0000 7fefccfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:00:02.145 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.139+0000 7ff118ae99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:00:02.145 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.139+0000 7ff118ae99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:00:02.145 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.139+0000 7ff118ae99c0 5 note: GC not initialized 2024-09-12T17:00:02.146 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.139+0000 7fef477fe640 20 reqs_thread_entry: start 2024-09-12T17:00:02.146 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.139+0000 7ff118ae99c0 20 init_complete bucket index max shards: 1 2024-09-12T17:00:02.146 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.139+0000 7ff118ae99c0 20 Filter name: none 2024-09-12T17:00:02.146 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.139+0000 7fef457fa640 20 reqs_thread_entry: start 2024-09-12T17:00:02.146 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.139+0000 7ff118ae99c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:00:02.146 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.139+0000 7ff118ae99c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:02.147 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.143+0000 7ff118ae99c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:00:02.147 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.143+0000 7ff118ae99c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:00:02.147 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.143+0000 7ff118ae99c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:00:02.147 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.143+0000 7ff118ae99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1 : miss 2024-09-12T17:00:02.147 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.143+0000 7ff118ae99c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:02.148 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.143+0000 7ff118ae99c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:00:02.148 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.143+0000 7ff118ae99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1 info.flags=0x17 2024-09-12T17:00:02.148 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.143+0000 7ff118ae99c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1 to cache LRU end 2024-09-12T17:00:02.148 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.143+0000 7ff118ae99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:00:02.148 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.143+0000 7ff118ae99c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:00:02.148 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.143+0000 7ff118ae99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1 2024-09-12T17:00:02.148 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.143+0000 7ff118ae99c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:02.149 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.143+0000 7ff118ae99c0 1 NOTICE: finished shard 0 (2 entries found) 2024-09-12T17:00:02.149 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.143+0000 7ff118ae99c0 1 NOTICE: finished all shards (2 entries found) 2024-09-12T17:00:02.151 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.147+0000 7fefccfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:00:02.157 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.151+0000 7ff118ae99c0 20 remove_watcher() i=0 2024-09-12T17:00:02.157 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.151+0000 7ff118ae99c0 2 removed watcher, disabling cache 2024-09-12T17:00:02.159 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.155+0000 7ff118ae99c0 20 remove_watcher() i=1 2024-09-12T17:00:02.162 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.155+0000 7ff118ae99c0 20 remove_watcher() i=2 2024-09-12T17:00:02.164 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.159+0000 7ff118ae99c0 20 remove_watcher() i=3 2024-09-12T17:00:02.167 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.163+0000 7ff118ae99c0 20 remove_watcher() i=4 2024-09-12T17:00:02.169 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.163+0000 7ff118ae99c0 20 remove_watcher() i=5 2024-09-12T17:00:02.171 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.167+0000 7ff118ae99c0 20 remove_watcher() i=6 2024-09-12T17:00:02.172 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.167+0000 7ff118ae99c0 20 remove_watcher() i=7 2024-09-12T17:00:02.197 INFO:tasks.workunit.client.0.smithi016.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-09-12T17:00:02.197 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:00:02.197 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T17:00:02.234 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:00:02.234 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:00:02.282 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.275+0000 7fcc24e1d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:02.284 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.279+0000 7fcc24e1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:02.284 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.279+0000 7fcc24e1d9c0 20 realm 2024-09-12T17:00:02.284 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.279+0000 7fcc24e1d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:02.284 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.279+0000 7fcc24e1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:02.285 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.279+0000 7fcc24e1d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:00:02.285 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.279+0000 7fcc24e1d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:02.285 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.279+0000 7fcc24e1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:02.285 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.279+0000 7fcc24e1d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:02.286 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.279+0000 7fcc24e1d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:00:02.286 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.279+0000 7fcc24e1d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:02.287 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.283+0000 7fcc24e1d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:00:02.288 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.283+0000 7fcc24e1d9c0 20 searching for the correct realm 2024-09-12T17:00:02.291 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.287+0000 7fcc23124640 0 -- 172.21.15.16:0/613054875 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fcc1806b1e0 msgr2=0x7fcc180634f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:00:02.299 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.295+0000 7fcc22122640 0 -- 172.21.15.16:0/613054875 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fcc1c0b9c20 msgr2=0x7fcc1c0e2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:00:02.523 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.515+0000 7fcc24e1d9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:00:02.523 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.515+0000 7fcc24e1d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:00:02.523 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.515+0000 7fcc24e1d9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:00:02.523 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.515+0000 7fcc24e1d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:00:02.523 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.515+0000 7fcc24e1d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:00:02.523 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.515+0000 7fcc24e1d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:00:02.523 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.515+0000 7fcc24e1d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:02.523 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.515+0000 7fcc24e1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:02.523 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.515+0000 7fcc24e1d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:02.523 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.515+0000 7fcc24e1d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:00:02.523 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.515+0000 7fcc24e1d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:02.523 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.515+0000 7fcc24e1d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:00:02.524 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.515+0000 7fcc24e1d9c0 20 zone default found 2024-09-12T17:00:02.524 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.515+0000 7fcc24e1d9c0 4 Realm: () 2024-09-12T17:00:02.524 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.515+0000 7fcc24e1d9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:00:02.524 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.515+0000 7fcc24e1d9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:00:02.524 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.515+0000 7fcc24e1d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:00:02.524 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.515+0000 7fcc24e1d9c0 20 zonegroup default 2024-09-12T17:00:02.524 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.515+0000 7fcc24e1d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:02.524 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.519+0000 7fcc24e1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:02.524 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.519+0000 7fcc24e1d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:02.525 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.519+0000 7fcc24e1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:02.525 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.519+0000 7fcc24e1d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:02.525 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.519+0000 7fcc24e1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:02.525 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.519+0000 7fcc24e1d9c0 20 started sync module instance, tier type = 2024-09-12T17:00:02.525 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.519+0000 7fcc24e1d9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:00:02.550 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.543+0000 7fcc24e1d9c0 20 add_watcher() i=0 2024-09-12T17:00:02.550 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.543+0000 7fcc24e1d9c0 20 add_watcher() i=1 2024-09-12T17:00:02.550 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.543+0000 7fcc24e1d9c0 20 add_watcher() i=2 2024-09-12T17:00:02.550 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.543+0000 7fcc24e1d9c0 20 add_watcher() i=3 2024-09-12T17:00:02.550 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.543+0000 7fcc24e1d9c0 20 add_watcher() i=4 2024-09-12T17:00:02.550 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.543+0000 7fcc24e1d9c0 20 add_watcher() i=5 2024-09-12T17:00:02.551 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.543+0000 7fcc24e1d9c0 20 add_watcher() i=6 2024-09-12T17:00:02.552 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.547+0000 7fcc24e1d9c0 20 add_watcher() i=7 2024-09-12T17:00:02.552 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.547+0000 7fcc24e1d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:00:02.556 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.551+0000 7fcad97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:00:02.557 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.551+0000 7fcc24e1d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:00:02.557 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.551+0000 7fcc24e1d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:00:02.558 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.551+0000 7fcc24e1d9c0 5 note: GC not initialized 2024-09-12T17:00:02.558 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.551+0000 7fca53fff640 20 reqs_thread_entry: start 2024-09-12T17:00:02.558 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.551+0000 7fcc24e1d9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:00:02.559 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.551+0000 7fcc24e1d9c0 20 Filter name: none 2024-09-12T17:00:02.559 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.555+0000 7fca51ffb640 20 reqs_thread_entry: start 2024-09-12T17:00:02.559 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.555+0000 7fcc24e1d9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:00:02.559 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.555+0000 7fcc24e1d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:02.560 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.555+0000 7fcc24e1d9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:00:02.560 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.555+0000 7fcc24e1d9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:00:02.560 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.555+0000 7fcc24e1d9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:00:02.560 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.555+0000 7fcc24e1d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1 : miss 2024-09-12T17:00:02.560 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.555+0000 7fcc24e1d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:02.561 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.555+0000 7fcc24e1d9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:00:02.561 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.555+0000 7fcc24e1d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1 info.flags=0x17 2024-09-12T17:00:02.561 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.555+0000 7fcc24e1d9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1 to cache LRU end 2024-09-12T17:00:02.561 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.555+0000 7fcc24e1d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:00:02.561 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.555+0000 7fcc24e1d9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:00:02.561 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.555+0000 7fcc24e1d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1 2024-09-12T17:00:02.561 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.555+0000 7fcc24e1d9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:02.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.555+0000 7fcc24e1d9c0 20 get_obj_state: octx=0x55f2e94a9100 obj=check-bucket:c state=0x55f2e975f2f8 s->prefetch_data=0 2024-09-12T17:00:02.564 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.559+0000 7fcc24e1d9c0 20 get_obj_state: setting s->obj_tag to n93mm90jtq6zwcfjiyzd2vvx13de741b 2024-09-12T17:00:02.564 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.559+0000 7fcc24e1d9c0 20 get_obj_state_impl: setting s->olh_tag to z7tve3do5n7tsr0yucdprm794m71wv6o 2024-09-12T17:00:02.564 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.559+0000 7fcc24e1d9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:02.565 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.559+0000 7fcc24e1d9c0 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-09-12T17:00:02.565 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.559+0000 7fcc24e1d9c0 20 olh_log_entry: epoch=4 op=3 key=c[3gJMXyVkqg2KJ0OMgAAWRkVZbi0lM7C] 2024-09-12T17:00:02.565 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.559+0000 7fcc24e1d9c0 20 get_obj_state: octx=0x55f2e9788aa0 obj=check-bucket:_:3gJMXyVkqg2KJ0OMgAAWRkVZbi0lM7C_c state=0x55f2e9758d78 s->prefetch_data=0 2024-09-12T17:00:02.568 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.563+0000 7fcc24e1d9c0 20 get_obj_state: octx=0x55f2e9788aa0 obj=check-bucket:c state=0x55f2e97601f8 s->prefetch_data=0 2024-09-12T17:00:02.569 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.563+0000 7fcc24e1d9c0 20 get_obj_state: setting s->obj_tag to n93mm90jtq6zwcfjiyzd2vvx13de741b 2024-09-12T17:00:02.569 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.563+0000 7fcc24e1d9c0 20 get_obj_state_impl: setting s->olh_tag to z7tve3do5n7tsr0yucdprm794m71wv6o 2024-09-12T17:00:02.569 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.563+0000 7fcc24e1d9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=z7tve3do5n7tsr0yucdprm794m71wv6o 2024-09-12T17:00:02.574 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.567+0000 7fcc24e1d9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:02.577 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.571+0000 7fcc24e1d9c0 20 get_obj_state: octx=0x55f2e94a9100 obj=check-bucket:d state=0x55f2e975f2f8 s->prefetch_data=0 2024-09-12T17:00:02.578 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.571+0000 7fcc24e1d9c0 20 get_obj_state: setting s->obj_tag to vvygdfs47rmq21q43udqqm19l0c0114w 2024-09-12T17:00:02.578 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.571+0000 7fcc24e1d9c0 20 get_obj_state_impl: setting s->olh_tag to 8zx2f3mezb2ixf7xkargqkq8l1vfvn8l 2024-09-12T17:00:02.578 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.571+0000 7fcc24e1d9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:02.579 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.575+0000 7fcc24e1d9c0 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-09-12T17:00:02.579 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.575+0000 7fcc24e1d9c0 20 olh_log_entry: epoch=4 op=3 key=d[y.tXxO89P9L3Liq-avikQhNxaXLqR5X] 2024-09-12T17:00:02.579 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.575+0000 7fcc24e1d9c0 20 get_obj_state: octx=0x55f2e9788aa0 obj=check-bucket:_:y.tXxO89P9L3Liq-avikQhNxaXLqR5X_d state=0x55f2e97894e8 s->prefetch_data=0 2024-09-12T17:00:02.582 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.575+0000 7fcc24e1d9c0 20 get_obj_state: octx=0x55f2e9788aa0 obj=check-bucket:d state=0x55f2e9759ea8 s->prefetch_data=0 2024-09-12T17:00:02.583 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.579+0000 7fcc24e1d9c0 20 get_obj_state: setting s->obj_tag to vvygdfs47rmq21q43udqqm19l0c0114w 2024-09-12T17:00:02.583 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.579+0000 7fcc24e1d9c0 20 get_obj_state_impl: setting s->olh_tag to 8zx2f3mezb2ixf7xkargqkq8l1vfvn8l 2024-09-12T17:00:02.583 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.579+0000 7fcc24e1d9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=8zx2f3mezb2ixf7xkargqkq8l1vfvn8l 2024-09-12T17:00:02.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.583+0000 7fcc24e1d9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:02.591 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.587+0000 7fcc24e1d9c0 1 NOTICE: finished shard 0 (2 entries removed) 2024-09-12T17:00:02.591 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.587+0000 7fcc24e1d9c0 1 NOTICE: finished all shards (2 entries removed) 2024-09-12T17:00:02.593 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.587+0000 7fcad97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:00:02.599 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.595+0000 7fcc24e1d9c0 20 remove_watcher() i=0 2024-09-12T17:00:02.600 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.595+0000 7fcc24e1d9c0 2 removed watcher, disabling cache 2024-09-12T17:00:02.602 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.595+0000 7fcc24e1d9c0 20 remove_watcher() i=1 2024-09-12T17:00:02.605 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.599+0000 7fcc24e1d9c0 20 remove_watcher() i=2 2024-09-12T17:00:02.608 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.603+0000 7fcc24e1d9c0 20 remove_watcher() i=3 2024-09-12T17:00:02.610 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.603+0000 7fcc24e1d9c0 20 remove_watcher() i=4 2024-09-12T17:00:02.612 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.607+0000 7fcc24e1d9c0 20 remove_watcher() i=5 2024-09-12T17:00:02.613 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.607+0000 7fcc24e1d9c0 20 remove_watcher() i=6 2024-09-12T17:00:02.615 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.611+0000 7fcc24e1d9c0 20 remove_watcher() i=7 2024-09-12T17:00:02.635 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T17:00:02.670 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:00:02.671 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:00:02.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.715+0000 7fc4d826d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:02.721 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.715+0000 7fc4d826d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:02.721 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.715+0000 7fc4d826d9c0 20 realm 2024-09-12T17:00:02.721 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.715+0000 7fc4d826d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:02.721 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.715+0000 7fc4d826d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:02.721 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.715+0000 7fc4d826d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:00:02.721 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.715+0000 7fc4d826d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:02.722 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.715+0000 7fc4d826d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:02.722 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.715+0000 7fc4d826d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:02.723 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.719+0000 7fc4d826d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:00:02.723 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.719+0000 7fc4d826d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:02.725 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.719+0000 7fc4d826d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:00:02.725 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.719+0000 7fc4d826d9c0 20 searching for the correct realm 2024-09-12T17:00:02.728 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.723+0000 7fc4d6574640 0 -- 172.21.15.16:0/3372571914 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fc4cc008070 msgr2=0x7fc4cc093050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:00:02.944 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:02.939+0000 7fc4d5572640 0 -- 172.21.15.16:0/3372571914 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fc4d0117b50 msgr2=0x7fc4d00d89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:00:03.163 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.159+0000 7fc4d826d9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:00:03.163 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.159+0000 7fc4d826d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:00:03.163 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.159+0000 7fc4d826d9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:00:03.163 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.159+0000 7fc4d826d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:00:03.163 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.159+0000 7fc4d826d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:00:03.164 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.159+0000 7fc4d826d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:00:03.164 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.159+0000 7fc4d826d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:03.164 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.159+0000 7fc4d826d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:03.164 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.159+0000 7fc4d826d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:03.165 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.159+0000 7fc4d826d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:00:03.165 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.159+0000 7fc4d826d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:03.166 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.159+0000 7fc4d826d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:00:03.166 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.159+0000 7fc4d826d9c0 20 zone default found 2024-09-12T17:00:03.166 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.159+0000 7fc4d826d9c0 4 Realm: () 2024-09-12T17:00:03.166 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.159+0000 7fc4d826d9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:00:03.166 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.159+0000 7fc4d826d9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:00:03.166 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.159+0000 7fc4d826d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:00:03.166 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.159+0000 7fc4d826d9c0 20 zonegroup default 2024-09-12T17:00:03.166 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.159+0000 7fc4d826d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:03.167 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.159+0000 7fc4d826d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:03.167 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.159+0000 7fc4d826d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:03.167 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.163+0000 7fc4d826d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:03.168 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.163+0000 7fc4d826d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:03.169 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.163+0000 7fc4d826d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:03.169 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.163+0000 7fc4d826d9c0 20 started sync module instance, tier type = 2024-09-12T17:00:03.169 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.163+0000 7fc4d826d9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:00:03.196 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.191+0000 7fc4d826d9c0 20 add_watcher() i=0 2024-09-12T17:00:03.196 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.191+0000 7fc4d826d9c0 20 add_watcher() i=1 2024-09-12T17:00:03.196 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.191+0000 7fc4d826d9c0 20 add_watcher() i=2 2024-09-12T17:00:03.196 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.191+0000 7fc4d826d9c0 20 add_watcher() i=3 2024-09-12T17:00:03.196 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.191+0000 7fc4d826d9c0 20 add_watcher() i=4 2024-09-12T17:00:03.196 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.191+0000 7fc4d826d9c0 20 add_watcher() i=5 2024-09-12T17:00:03.197 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.191+0000 7fc4d826d9c0 20 add_watcher() i=6 2024-09-12T17:00:03.198 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.191+0000 7fc4d826d9c0 20 add_watcher() i=7 2024-09-12T17:00:03.198 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.191+0000 7fc4d826d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:00:03.203 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.199+0000 7fc3677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:00:03.204 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.199+0000 7fc4d826d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:00:03.204 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.199+0000 7fc4d826d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:00:03.204 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.199+0000 7fc4d826d9c0 5 note: GC not initialized 2024-09-12T17:00:03.204 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.199+0000 7fc3667fc640 20 reqs_thread_entry: start 2024-09-12T17:00:03.205 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.199+0000 7fc4d826d9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:00:03.205 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.199+0000 7fc4d826d9c0 20 Filter name: none 2024-09-12T17:00:03.205 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.199+0000 7fc2fbfff640 20 reqs_thread_entry: start 2024-09-12T17:00:03.205 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.199+0000 7fc4d826d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:03.206 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.199+0000 7fc4d826d9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:00:03.206 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.199+0000 7fc4d826d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:03.206 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.199+0000 7fc4d826d9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:00:03.206 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.199+0000 7fc4d826d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:00:03.207 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.199+0000 7fc4d826d9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T17:00:03.207 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.199+0000 7fc4d826d9c0 20 INFO: main: starting shard=0 2024-09-12T17:00:03.207 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.199+0000 7fc4d826d9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:03.207 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.203+0000 7fc4d826d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:00:03.208 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.203+0000 7fc4d826d9c0 20 INFO: main: done 2024-09-12T17:00:03.209 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.203+0000 7fc3677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:00:03.215 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.207+0000 7fc4d826d9c0 20 remove_watcher() i=0 2024-09-12T17:00:03.215 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.207+0000 7fc4d826d9c0 2 removed watcher, disabling cache 2024-09-12T17:00:03.217 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.211+0000 7fc4d826d9c0 20 remove_watcher() i=1 2024-09-12T17:00:03.220 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.215+0000 7fc4d826d9c0 20 remove_watcher() i=2 2024-09-12T17:00:03.223 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.219+0000 7fc4d826d9c0 20 remove_watcher() i=3 2024-09-12T17:00:03.225 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.219+0000 7fc4d826d9c0 20 remove_watcher() i=4 2024-09-12T17:00:03.227 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.223+0000 7fc4d826d9c0 20 remove_watcher() i=5 2024-09-12T17:00:03.229 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.223+0000 7fc4d826d9c0 20 remove_watcher() i=6 2024-09-12T17:00:03.231 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.223+0000 7fc4d826d9c0 20 remove_watcher() i=7 2024-09-12T17:00:03.249 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T17:00:03.278 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:00:03.278 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:00:03.324 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.319+0000 7ff7bbc4a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:03.326 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.319+0000 7ff7bbc4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:03.326 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.319+0000 7ff7bbc4a9c0 20 realm 2024-09-12T17:00:03.326 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.319+0000 7ff7bbc4a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:03.326 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.319+0000 7ff7bbc4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:03.326 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.319+0000 7ff7bbc4a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:00:03.326 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.319+0000 7ff7bbc4a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:03.327 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.319+0000 7ff7bbc4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:03.327 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.319+0000 7ff7bbc4a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:03.328 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.323+0000 7ff7bbc4a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:00:03.328 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.323+0000 7ff7bbc4a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:03.330 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.323+0000 7ff7bbc4a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:00:03.330 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.323+0000 7ff7bbc4a9c0 20 searching for the correct realm 2024-09-12T17:00:03.337 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.327+0000 7ff7b9f51640 0 -- 172.21.15.16:0/1631488237 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7ff7b008b030 msgr2=0x7ff7b005bb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:00:03.341 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.335+0000 7ff7b8f4f640 0 -- 172.21.15.16:0/1631488237 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7ff7b40e6040 msgr2=0x7ff7b40e64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:00:03.557 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.551+0000 7ff7bbc4a9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:00:03.558 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.551+0000 7ff7bbc4a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:00:03.558 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.551+0000 7ff7bbc4a9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:00:03.558 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.551+0000 7ff7bbc4a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:00:03.558 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.551+0000 7ff7bbc4a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:00:03.558 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.551+0000 7ff7bbc4a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:00:03.558 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.551+0000 7ff7bbc4a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:03.558 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.551+0000 7ff7bbc4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:03.558 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.551+0000 7ff7bbc4a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:03.559 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.555+0000 7ff7bbc4a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:00:03.559 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.555+0000 7ff7bbc4a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:03.560 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.555+0000 7ff7bbc4a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:00:03.560 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.555+0000 7ff7bbc4a9c0 20 zone default found 2024-09-12T17:00:03.560 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.555+0000 7ff7bbc4a9c0 4 Realm: () 2024-09-12T17:00:03.560 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.555+0000 7ff7bbc4a9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:00:03.560 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.555+0000 7ff7bbc4a9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:00:03.560 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.555+0000 7ff7bbc4a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:00:03.560 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.555+0000 7ff7bbc4a9c0 20 zonegroup default 2024-09-12T17:00:03.561 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.555+0000 7ff7bbc4a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:03.561 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.555+0000 7ff7bbc4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:03.561 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.555+0000 7ff7bbc4a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:03.561 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.555+0000 7ff7bbc4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:03.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.555+0000 7ff7bbc4a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:03.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.555+0000 7ff7bbc4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:03.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.555+0000 7ff7bbc4a9c0 20 started sync module instance, tier type = 2024-09-12T17:00:03.563 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.555+0000 7ff7bbc4a9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:00:03.587 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.583+0000 7ff7bbc4a9c0 20 add_watcher() i=0 2024-09-12T17:00:03.587 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.583+0000 7ff7bbc4a9c0 20 add_watcher() i=1 2024-09-12T17:00:03.587 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.583+0000 7ff7bbc4a9c0 20 add_watcher() i=2 2024-09-12T17:00:03.587 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.583+0000 7ff7bbc4a9c0 20 add_watcher() i=3 2024-09-12T17:00:03.587 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.583+0000 7ff7bbc4a9c0 20 add_watcher() i=4 2024-09-12T17:00:03.587 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.583+0000 7ff7bbc4a9c0 20 add_watcher() i=5 2024-09-12T17:00:03.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.583+0000 7ff7bbc4a9c0 20 add_watcher() i=6 2024-09-12T17:00:03.590 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.583+0000 7ff7bbc4a9c0 20 add_watcher() i=7 2024-09-12T17:00:03.590 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.583+0000 7ff7bbc4a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:00:03.595 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.591+0000 7ff66f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:00:03.596 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.591+0000 7ff7bbc4a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:00:03.596 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.591+0000 7ff7bbc4a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:00:03.596 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.591+0000 7ff7bbc4a9c0 5 note: GC not initialized 2024-09-12T17:00:03.596 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.591+0000 7ff66e7e4640 20 reqs_thread_entry: start 2024-09-12T17:00:03.597 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.591+0000 7ff7bbc4a9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:00:03.597 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.591+0000 7ff7bbc4a9c0 20 Filter name: none 2024-09-12T17:00:03.597 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.591+0000 7ff5dffff640 20 reqs_thread_entry: start 2024-09-12T17:00:03.597 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.591+0000 7ff7bbc4a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:03.598 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.591+0000 7ff7bbc4a9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:00:03.598 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.591+0000 7ff7bbc4a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:03.599 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.595+0000 7ff7bbc4a9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:00:03.599 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.595+0000 7ff7bbc4a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:00:03.599 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.595+0000 7ff7bbc4a9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T17:00:03.599 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.595+0000 7ff7bbc4a9c0 20 INFO: main: starting shard=0 2024-09-12T17:00:03.599 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.595+0000 7ff7bbc4a9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:03.600 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.595+0000 7ff7bbc4a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:00:03.600 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.595+0000 7ff7bbc4a9c0 20 INFO: main: done 2024-09-12T17:00:03.602 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.595+0000 7ff66f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:00:03.607 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.603+0000 7ff7bbc4a9c0 20 remove_watcher() i=0 2024-09-12T17:00:03.607 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.603+0000 7ff7bbc4a9c0 2 removed watcher, disabling cache 2024-09-12T17:00:03.610 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.603+0000 7ff7bbc4a9c0 20 remove_watcher() i=1 2024-09-12T17:00:03.612 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.607+0000 7ff7bbc4a9c0 20 remove_watcher() i=2 2024-09-12T17:00:03.615 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.611+0000 7ff7bbc4a9c0 20 remove_watcher() i=3 2024-09-12T17:00:03.617 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.611+0000 7ff7bbc4a9c0 20 remove_watcher() i=4 2024-09-12T17:00:03.619 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.615+0000 7ff7bbc4a9c0 20 remove_watcher() i=5 2024-09-12T17:00:03.620 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.615+0000 7ff7bbc4a9c0 20 remove_watcher() i=6 2024-09-12T17:00:03.622 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.615+0000 7ff7bbc4a9c0 20 remove_watcher() i=7 2024-09-12T17:00:03.638 INFO:tasks.workunit.client.0.smithi016.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-09-12T17:00:03.638 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:00:03.638 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T17:00:03.668 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:00:03.668 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:00:03.714 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.707+0000 7fc6211ba9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:03.716 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.711+0000 7fc6211ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:03.716 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.711+0000 7fc6211ba9c0 20 realm 2024-09-12T17:00:03.716 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.711+0000 7fc6211ba9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:03.716 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.711+0000 7fc6211ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:03.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.711+0000 7fc6211ba9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:00:03.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.711+0000 7fc6211ba9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:03.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.711+0000 7fc6211ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:03.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.711+0000 7fc6211ba9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:03.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.711+0000 7fc6211ba9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:00:03.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.711+0000 7fc6211ba9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:03.720 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.715+0000 7fc6211ba9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:00:03.720 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.715+0000 7fc6211ba9c0 20 searching for the correct realm 2024-09-12T17:00:03.723 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.719+0000 7fc61f4c1640 0 -- 172.21.15.16:0/3894981935 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fc61400e070 msgr2=0x7fc61402afc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:00:03.731 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.727+0000 7fc61e4bf640 0 -- 172.21.15.16:0/3894981935 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fc618004040 msgr2=0x7fc6180d6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:00:03.950 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.943+0000 7fc6211ba9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:00:03.951 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.943+0000 7fc6211ba9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:00:03.951 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.943+0000 7fc6211ba9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:00:03.951 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.943+0000 7fc6211ba9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:00:03.951 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.943+0000 7fc6211ba9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:00:03.951 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.943+0000 7fc6211ba9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:00:03.951 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.943+0000 7fc6211ba9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:03.951 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.947+0000 7fc6211ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:03.952 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.947+0000 7fc6211ba9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:03.952 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.947+0000 7fc6211ba9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:00:03.952 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.947+0000 7fc6211ba9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:03.953 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.947+0000 7fc6211ba9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:00:03.953 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.947+0000 7fc6211ba9c0 20 zone default found 2024-09-12T17:00:03.953 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.947+0000 7fc6211ba9c0 4 Realm: () 2024-09-12T17:00:03.953 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.947+0000 7fc6211ba9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:00:03.953 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.947+0000 7fc6211ba9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:00:03.953 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.947+0000 7fc6211ba9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:00:03.953 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.947+0000 7fc6211ba9c0 20 zonegroup default 2024-09-12T17:00:03.953 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.947+0000 7fc6211ba9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:03.954 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.947+0000 7fc6211ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:03.954 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.947+0000 7fc6211ba9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:03.954 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.947+0000 7fc6211ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:03.954 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.947+0000 7fc6211ba9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:03.955 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.951+0000 7fc6211ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:03.955 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.951+0000 7fc6211ba9c0 20 started sync module instance, tier type = 2024-09-12T17:00:03.955 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.951+0000 7fc6211ba9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:00:03.977 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.971+0000 7fc6211ba9c0 20 add_watcher() i=0 2024-09-12T17:00:03.977 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.971+0000 7fc6211ba9c0 20 add_watcher() i=1 2024-09-12T17:00:03.977 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.971+0000 7fc6211ba9c0 20 add_watcher() i=2 2024-09-12T17:00:03.977 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.971+0000 7fc6211ba9c0 20 add_watcher() i=3 2024-09-12T17:00:03.977 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.971+0000 7fc6211ba9c0 20 add_watcher() i=4 2024-09-12T17:00:03.977 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.971+0000 7fc6211ba9c0 20 add_watcher() i=5 2024-09-12T17:00:03.977 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.971+0000 7fc6211ba9c0 20 add_watcher() i=6 2024-09-12T17:00:03.979 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.975+0000 7fc6211ba9c0 20 add_watcher() i=7 2024-09-12T17:00:03.979 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.975+0000 7fc6211ba9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:00:03.982 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.975+0000 7fc4d57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:00:03.983 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.979+0000 7fc6211ba9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:00:03.983 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.979+0000 7fc6211ba9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:00:03.983 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.979+0000 7fc6211ba9c0 5 note: GC not initialized 2024-09-12T17:00:03.984 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.979+0000 7fc44ffff640 20 reqs_thread_entry: start 2024-09-12T17:00:03.984 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.979+0000 7fc6211ba9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:00:03.985 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.979+0000 7fc6211ba9c0 20 Filter name: none 2024-09-12T17:00:03.985 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.979+0000 7fc44dffb640 20 reqs_thread_entry: start 2024-09-12T17:00:03.985 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.979+0000 7fc6211ba9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:00:03.985 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.979+0000 7fc6211ba9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:03.986 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.979+0000 7fc6211ba9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:00:03.986 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.979+0000 7fc6211ba9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:00:03.986 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.979+0000 7fc6211ba9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:00:03.986 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.979+0000 7fc6211ba9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1 : miss 2024-09-12T17:00:03.986 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.979+0000 7fc6211ba9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:03.987 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.979+0000 7fc6211ba9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:00:03.987 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.983+0000 7fc6211ba9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1 info.flags=0x17 2024-09-12T17:00:03.987 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.983+0000 7fc6211ba9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1 to cache LRU end 2024-09-12T17:00:03.987 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.983+0000 7fc6211ba9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:00:03.987 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.983+0000 7fc6211ba9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:00:03.987 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.983+0000 7fc6211ba9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1 2024-09-12T17:00:03.987 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.983+0000 7fc6211ba9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:03.989 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.983+0000 7fc6211ba9c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T17:00:03.989 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.983+0000 7fc6211ba9c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T17:00:03.990 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.983+0000 7fc4d57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:00:03.995 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.991+0000 7fc6211ba9c0 20 remove_watcher() i=0 2024-09-12T17:00:03.995 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.991+0000 7fc6211ba9c0 2 removed watcher, disabling cache 2024-09-12T17:00:03.998 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.991+0000 7fc6211ba9c0 20 remove_watcher() i=1 2024-09-12T17:00:04.001 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.995+0000 7fc6211ba9c0 20 remove_watcher() i=2 2024-09-12T17:00:04.003 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.999+0000 7fc6211ba9c0 20 remove_watcher() i=3 2024-09-12T17:00:04.006 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:03.999+0000 7fc6211ba9c0 20 remove_watcher() i=4 2024-09-12T17:00:04.007 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:04.003+0000 7fc6211ba9c0 20 remove_watcher() i=5 2024-09-12T17:00:04.009 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:04.003+0000 7fc6211ba9c0 20 remove_watcher() i=6 2024-09-12T17:00:04.011 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:04.007+0000 7fc6211ba9c0 20 remove_watcher() i=7 2024-09-12T17:00:04.027 INFO:tasks.workunit.client.0.smithi016.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-09-12T17:00:04.028 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:00:04.090 INFO:tasks.workunit.client.0.smithi016.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-09-12T17:00:04.090 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:00:04.466 INFO:tasks.workunit.client.0.smithi016.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T17:00:04.910 INFO:tasks.workunit.client.0.smithi016.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T17:00:06.420 INFO:tasks.workunit.client.0.smithi016.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:00:06.420 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T17:00:06.457 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:00:06.457 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:00:06.504 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.498+0000 7faa613119c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:06.505 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.498+0000 7faa613119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:06.506 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.498+0000 7faa613119c0 20 realm 2024-09-12T17:00:06.506 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.498+0000 7faa613119c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:06.506 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.498+0000 7faa613119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:06.506 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.498+0000 7faa613119c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:00:06.506 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.498+0000 7faa613119c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:06.506 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.498+0000 7faa613119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:06.507 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.498+0000 7faa613119c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:06.508 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.502+0000 7faa613119c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:00:06.508 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.502+0000 7faa613119c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:06.509 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.502+0000 7faa613119c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:00:06.509 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.502+0000 7faa613119c0 20 searching for the correct realm 2024-09-12T17:00:06.512 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.506+0000 7faa5f618640 0 -- 172.21.15.16:0/1414398666 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7faa4801c030 msgr2=0x7faa4801c470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:00:06.520 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.514+0000 7faa5e616640 0 -- 172.21.15.16:0/1414398666 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7faa58040950 msgr2=0x7faa580273a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:00:06.739 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.730+0000 7faa613119c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:00:06.739 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.730+0000 7faa613119c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:00:06.739 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.730+0000 7faa613119c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:00:06.739 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.730+0000 7faa613119c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:00:06.739 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.730+0000 7faa613119c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:00:06.739 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.730+0000 7faa613119c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:00:06.739 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.730+0000 7faa613119c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:06.740 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.734+0000 7faa613119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:06.740 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.734+0000 7faa613119c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:06.740 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.734+0000 7faa613119c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:00:06.740 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.734+0000 7faa613119c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:06.741 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.734+0000 7faa613119c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:00:06.741 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.734+0000 7faa613119c0 20 zone default found 2024-09-12T17:00:06.741 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.734+0000 7faa613119c0 4 Realm: () 2024-09-12T17:00:06.742 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.734+0000 7faa613119c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:00:06.742 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.734+0000 7faa613119c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:00:06.742 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.734+0000 7faa613119c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:00:06.742 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.734+0000 7faa613119c0 20 zonegroup default 2024-09-12T17:00:06.742 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.734+0000 7faa613119c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:06.742 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.734+0000 7faa613119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:06.742 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.734+0000 7faa613119c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:06.743 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.738+0000 7faa613119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:06.743 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.738+0000 7faa613119c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:06.744 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.738+0000 7faa613119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:06.744 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.738+0000 7faa613119c0 20 started sync module instance, tier type = 2024-09-12T17:00:06.744 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.738+0000 7faa613119c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:00:06.771 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.766+0000 7faa613119c0 20 add_watcher() i=0 2024-09-12T17:00:06.771 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.766+0000 7faa613119c0 20 add_watcher() i=1 2024-09-12T17:00:06.772 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.766+0000 7faa613119c0 20 add_watcher() i=2 2024-09-12T17:00:06.772 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.766+0000 7faa613119c0 20 add_watcher() i=3 2024-09-12T17:00:06.772 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.766+0000 7faa613119c0 20 add_watcher() i=4 2024-09-12T17:00:06.772 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.766+0000 7faa613119c0 20 add_watcher() i=5 2024-09-12T17:00:06.772 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.766+0000 7faa613119c0 20 add_watcher() i=6 2024-09-12T17:00:06.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.766+0000 7faa613119c0 20 add_watcher() i=7 2024-09-12T17:00:06.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.766+0000 7faa613119c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:00:06.778 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.770+0000 7fa9157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:00:06.779 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.774+0000 7faa613119c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:00:06.779 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.774+0000 7faa613119c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:00:06.780 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.774+0000 7faa613119c0 5 note: GC not initialized 2024-09-12T17:00:06.780 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.774+0000 7fa88ffff640 20 reqs_thread_entry: start 2024-09-12T17:00:06.780 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.774+0000 7faa613119c0 20 init_complete bucket index max shards: 1 2024-09-12T17:00:06.781 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.774+0000 7faa613119c0 20 Filter name: none 2024-09-12T17:00:06.781 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.774+0000 7fa88dffb640 20 reqs_thread_entry: start 2024-09-12T17:00:06.781 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.774+0000 7faa613119c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:06.781 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.774+0000 7faa613119c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:00:06.781 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.774+0000 7faa613119c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:06.782 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.774+0000 7faa613119c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:00:06.782 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.774+0000 7faa613119c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:00:06.782 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.774+0000 7faa613119c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T17:00:06.782 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.774+0000 7faa613119c0 20 INFO: main: starting shard=0 2024-09-12T17:00:06.782 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.774+0000 7faa613119c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:06.784 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.778+0000 7faa613119c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T17:00:06.784 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.778+0000 7faa613119c0 20 INFO: main: done 2024-09-12T17:00:06.786 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.778+0000 7fa9157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:00:06.791 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.786+0000 7faa613119c0 20 remove_watcher() i=0 2024-09-12T17:00:06.791 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.786+0000 7faa613119c0 2 removed watcher, disabling cache 2024-09-12T17:00:06.793 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.786+0000 7faa613119c0 20 remove_watcher() i=1 2024-09-12T17:00:06.796 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.790+0000 7faa613119c0 20 remove_watcher() i=2 2024-09-12T17:00:06.799 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.794+0000 7faa613119c0 20 remove_watcher() i=3 2024-09-12T17:00:06.801 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.794+0000 7faa613119c0 20 remove_watcher() i=4 2024-09-12T17:00:06.803 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.798+0000 7faa613119c0 20 remove_watcher() i=5 2024-09-12T17:00:06.805 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.798+0000 7faa613119c0 20 remove_watcher() i=6 2024-09-12T17:00:06.807 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.802+0000 7faa613119c0 20 remove_watcher() i=7 2024-09-12T17:00:06.896 INFO:tasks.workunit.client.0.smithi016.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:00:06.896 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T17:00:06.932 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:00:06.933 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:00:06.980 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.974+0000 7efd454089c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:06.982 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.974+0000 7efd454089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:06.982 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.974+0000 7efd454089c0 20 realm 2024-09-12T17:00:06.982 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.974+0000 7efd454089c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:06.982 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.974+0000 7efd454089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:06.982 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.974+0000 7efd454089c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:00:06.982 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.974+0000 7efd454089c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:06.983 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.974+0000 7efd454089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:06.983 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.974+0000 7efd454089c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:06.984 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.978+0000 7efd454089c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:00:06.984 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.978+0000 7efd454089c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:06.985 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.978+0000 7efd454089c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:00:06.986 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.978+0000 7efd454089c0 20 searching for the correct realm 2024-09-12T17:00:06.989 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.982+0000 7efd4370f640 0 -- 172.21.15.16:0/2113559548 >> [v2:172.21.15.19:6800/1509147557,v1:172.21.15.19:6801/1509147557] conn(0x5645934f3940 msgr2=0x5645934f5d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:00:06.996 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:06.990+0000 7efd4270d640 0 -- 172.21.15.16:0/2113559548 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7efd3c0c2040 msgr2=0x7efd3c0d0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:00:07.214 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.206+0000 7efd454089c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:00:07.215 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.206+0000 7efd454089c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:00:07.215 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.206+0000 7efd454089c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:00:07.215 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.206+0000 7efd454089c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:00:07.215 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.206+0000 7efd454089c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:00:07.215 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.206+0000 7efd454089c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:00:07.215 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.206+0000 7efd454089c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:07.215 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.210+0000 7efd454089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:07.215 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.210+0000 7efd454089c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:07.216 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.210+0000 7efd454089c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:00:07.216 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.210+0000 7efd454089c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:07.217 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.210+0000 7efd454089c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:00:07.217 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.210+0000 7efd454089c0 20 zone default found 2024-09-12T17:00:07.217 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.210+0000 7efd454089c0 4 Realm: () 2024-09-12T17:00:07.217 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.210+0000 7efd454089c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:00:07.217 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.210+0000 7efd454089c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:00:07.217 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.210+0000 7efd454089c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:00:07.217 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.210+0000 7efd454089c0 20 zonegroup default 2024-09-12T17:00:07.217 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.210+0000 7efd454089c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:07.218 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.210+0000 7efd454089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:07.218 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.210+0000 7efd454089c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:07.218 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.214+0000 7efd454089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:07.219 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.214+0000 7efd454089c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:07.219 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.214+0000 7efd454089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:07.219 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.214+0000 7efd454089c0 20 started sync module instance, tier type = 2024-09-12T17:00:07.219 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.214+0000 7efd454089c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:00:07.243 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.238+0000 7efd454089c0 20 add_watcher() i=0 2024-09-12T17:00:07.244 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.238+0000 7efd454089c0 20 add_watcher() i=1 2024-09-12T17:00:07.244 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.238+0000 7efd454089c0 20 add_watcher() i=2 2024-09-12T17:00:07.244 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.238+0000 7efd454089c0 20 add_watcher() i=3 2024-09-12T17:00:07.244 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.238+0000 7efd454089c0 20 add_watcher() i=4 2024-09-12T17:00:07.244 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.238+0000 7efd454089c0 20 add_watcher() i=5 2024-09-12T17:00:07.244 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.238+0000 7efd454089c0 20 add_watcher() i=6 2024-09-12T17:00:07.246 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.238+0000 7efd454089c0 20 add_watcher() i=7 2024-09-12T17:00:07.246 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.238+0000 7efd454089c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:00:07.250 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.242+0000 7efbf97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:00:07.251 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.246+0000 7efd454089c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:00:07.251 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.246+0000 7efd454089c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:00:07.251 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.246+0000 7efd454089c0 5 note: GC not initialized 2024-09-12T17:00:07.251 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.246+0000 7efb73fff640 20 reqs_thread_entry: start 2024-09-12T17:00:07.251 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.246+0000 7efd454089c0 20 init_complete bucket index max shards: 1 2024-09-12T17:00:07.252 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.246+0000 7efd454089c0 20 Filter name: none 2024-09-12T17:00:07.252 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.246+0000 7efb71ffb640 20 reqs_thread_entry: start 2024-09-12T17:00:07.252 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.246+0000 7efd454089c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:07.253 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.246+0000 7efd454089c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:00:07.253 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.246+0000 7efd454089c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:07.253 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.246+0000 7efd454089c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:00:07.253 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.246+0000 7efd454089c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:00:07.253 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.246+0000 7efd454089c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T17:00:07.253 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.246+0000 7efd454089c0 20 INFO: main: starting shard=0 2024-09-12T17:00:07.253 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.246+0000 7efd454089c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:07.255 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.250+0000 7efd454089c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T17:00:07.255 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.250+0000 7efd454089c0 20 INFO: main: done 2024-09-12T17:00:07.256 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.250+0000 7efbf97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:00:07.262 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.254+0000 7efd454089c0 20 remove_watcher() i=0 2024-09-12T17:00:07.262 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.254+0000 7efd454089c0 2 removed watcher, disabling cache 2024-09-12T17:00:07.264 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.258+0000 7efd454089c0 20 remove_watcher() i=1 2024-09-12T17:00:07.267 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.262+0000 7efd454089c0 20 remove_watcher() i=2 2024-09-12T17:00:07.269 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.262+0000 7efd454089c0 20 remove_watcher() i=3 2024-09-12T17:00:07.271 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.266+0000 7efd454089c0 20 remove_watcher() i=4 2024-09-12T17:00:07.273 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.266+0000 7efd454089c0 20 remove_watcher() i=5 2024-09-12T17:00:07.274 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.266+0000 7efd454089c0 20 remove_watcher() i=6 2024-09-12T17:00:07.276 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.270+0000 7efd454089c0 20 remove_watcher() i=7 2024-09-12T17:00:07.364 INFO:tasks.workunit.client.0.smithi016.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:00:07.364 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T17:00:07.401 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:00:07.401 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:00:07.448 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.442+0000 7f41e604b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:07.450 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.442+0000 7f41e604b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:07.450 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.442+0000 7f41e604b9c0 20 realm 2024-09-12T17:00:07.450 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.442+0000 7f41e604b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:07.450 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.442+0000 7f41e604b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:07.450 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.442+0000 7f41e604b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:00:07.450 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.442+0000 7f41e604b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:07.450 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.442+0000 7f41e604b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:07.450 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.442+0000 7f41e604b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:07.452 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.446+0000 7f41e604b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:00:07.452 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.446+0000 7f41e604b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:07.454 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.446+0000 7f41e604b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:00:07.454 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.446+0000 7f41e604b9c0 20 searching for the correct realm 2024-09-12T17:00:07.457 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.450+0000 7f41e4352640 0 -- 172.21.15.16:0/1390552580 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f41d8007610 msgr2=0x7f41d8076a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:00:07.673 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.666+0000 7f41e3350640 0 -- 172.21.15.16:0/1390552580 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f41dc1060e0 msgr2=0x7f41dc1308c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:00:07.891 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.886+0000 7f41e604b9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:00:07.891 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.886+0000 7f41e604b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:00:07.891 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.886+0000 7f41e604b9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:00:07.891 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.886+0000 7f41e604b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:00:07.892 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.886+0000 7f41e604b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:00:07.892 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.886+0000 7f41e604b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:00:07.892 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.886+0000 7f41e604b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:07.892 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.886+0000 7f41e604b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:07.892 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.886+0000 7f41e604b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:07.893 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.886+0000 7f41e604b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:00:07.893 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.886+0000 7f41e604b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:07.893 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.886+0000 7f41e604b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:00:07.894 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.886+0000 7f41e604b9c0 20 zone default found 2024-09-12T17:00:07.894 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.886+0000 7f41e604b9c0 4 Realm: () 2024-09-12T17:00:07.894 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.886+0000 7f41e604b9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:00:07.894 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.886+0000 7f41e604b9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:00:07.894 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.886+0000 7f41e604b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:00:07.894 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.886+0000 7f41e604b9c0 20 zonegroup default 2024-09-12T17:00:07.894 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.886+0000 7f41e604b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:07.895 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.886+0000 7f41e604b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:07.895 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.886+0000 7f41e604b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:07.895 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.890+0000 7f41e604b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:07.895 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.890+0000 7f41e604b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:07.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.890+0000 7f41e604b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:07.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.890+0000 7f41e604b9c0 20 started sync module instance, tier type = 2024-09-12T17:00:07.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.890+0000 7f41e604b9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:00:07.919 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.910+0000 7f41e604b9c0 20 add_watcher() i=0 2024-09-12T17:00:07.919 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.910+0000 7f41e604b9c0 20 add_watcher() i=1 2024-09-12T17:00:07.919 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.910+0000 7f41e604b9c0 20 add_watcher() i=2 2024-09-12T17:00:07.919 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.910+0000 7f41e604b9c0 20 add_watcher() i=3 2024-09-12T17:00:07.919 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.910+0000 7f41e604b9c0 20 add_watcher() i=4 2024-09-12T17:00:07.919 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.910+0000 7f41e604b9c0 20 add_watcher() i=5 2024-09-12T17:00:07.919 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.910+0000 7f41e604b9c0 20 add_watcher() i=6 2024-09-12T17:00:07.921 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.914+0000 7f41e604b9c0 20 add_watcher() i=7 2024-09-12T17:00:07.921 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.914+0000 7f41e604b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:00:07.925 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.918+0000 7f4099fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:00:07.926 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.918+0000 7f41e604b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:00:07.926 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.918+0000 7f41e604b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:00:07.926 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.918+0000 7f41e604b9c0 5 note: GC not initialized 2024-09-12T17:00:07.927 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.918+0000 7f4098fe1640 20 reqs_thread_entry: start 2024-09-12T17:00:07.927 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.922+0000 7f41e604b9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:00:07.927 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.922+0000 7f41e604b9c0 20 Filter name: none 2024-09-12T17:00:07.927 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.922+0000 7f40127fc640 20 reqs_thread_entry: start 2024-09-12T17:00:07.927 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.922+0000 7f41e604b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:07.928 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.922+0000 7f41e604b9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:00:07.928 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.922+0000 7f41e604b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:07.928 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.922+0000 7f41e604b9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:00:07.929 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.922+0000 7f41e604b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:00:07.929 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.922+0000 7f41e604b9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T17:00:07.929 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.922+0000 7f41e604b9c0 20 INFO: main: starting shard=0 2024-09-12T17:00:07.929 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.922+0000 7f41e604b9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:07.930 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.922+0000 7f41e604b9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:00:07.930 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.922+0000 7f41e604b9c0 20 INFO: main: done 2024-09-12T17:00:07.931 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.926+0000 7f4099fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:00:07.937 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.930+0000 7f41e604b9c0 20 remove_watcher() i=0 2024-09-12T17:00:07.937 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.930+0000 7f41e604b9c0 2 removed watcher, disabling cache 2024-09-12T17:00:07.940 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.934+0000 7f41e604b9c0 20 remove_watcher() i=1 2024-09-12T17:00:07.942 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.934+0000 7f41e604b9c0 20 remove_watcher() i=2 2024-09-12T17:00:07.944 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.938+0000 7f41e604b9c0 20 remove_watcher() i=3 2024-09-12T17:00:07.949 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.942+0000 7f41e604b9c0 20 remove_watcher() i=4 2024-09-12T17:00:07.950 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.942+0000 7f41e604b9c0 20 remove_watcher() i=5 2024-09-12T17:00:07.952 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.946+0000 7f41e604b9c0 20 remove_watcher() i=6 2024-09-12T17:00:07.954 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:07.946+0000 7f41e604b9c0 20 remove_watcher() i=7 2024-09-12T17:00:08.035 INFO:tasks.workunit.client.0.smithi016.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:00:08.036 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T17:00:08.072 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:00:08.072 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:00:08.119 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.114+0000 7f345fc369c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:08.121 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.114+0000 7f345fc369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:08.121 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.114+0000 7f345fc369c0 20 realm 2024-09-12T17:00:08.122 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.114+0000 7f345fc369c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:08.122 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.114+0000 7f345fc369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:08.122 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.114+0000 7f345fc369c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:00:08.122 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.114+0000 7f345fc369c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:08.122 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.114+0000 7f345fc369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:08.123 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.114+0000 7f345fc369c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:08.123 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.118+0000 7f345fc369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:00:08.124 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.118+0000 7f345fc369c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:08.125 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.118+0000 7f345fc369c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:00:08.125 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.118+0000 7f345fc369c0 20 searching for the correct realm 2024-09-12T17:00:08.128 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.122+0000 7f345df3d640 0 -- 172.21.15.16:0/2886748638 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f345005bb80 msgr2=0x7f3450046a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:00:08.345 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.338+0000 7f345cf3b640 0 -- 172.21.15.16:0/2886748638 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f345806c410 msgr2=0x7f345808fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:00:08.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.554+0000 7f345fc369c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:00:08.563 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.554+0000 7f345fc369c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:00:08.563 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.554+0000 7f345fc369c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:00:08.563 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.554+0000 7f345fc369c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:00:08.563 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.554+0000 7f345fc369c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:00:08.563 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.554+0000 7f345fc369c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:00:08.563 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.554+0000 7f345fc369c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:08.563 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.558+0000 7f345fc369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:08.563 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.558+0000 7f345fc369c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:08.564 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.558+0000 7f345fc369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:00:08.564 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.558+0000 7f345fc369c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:08.565 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.558+0000 7f345fc369c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:00:08.565 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.558+0000 7f345fc369c0 20 zone default found 2024-09-12T17:00:08.565 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.558+0000 7f345fc369c0 4 Realm: () 2024-09-12T17:00:08.565 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.558+0000 7f345fc369c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:00:08.565 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.558+0000 7f345fc369c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:00:08.565 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.558+0000 7f345fc369c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:00:08.565 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.558+0000 7f345fc369c0 20 zonegroup default 2024-09-12T17:00:08.565 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.558+0000 7f345fc369c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:08.566 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.558+0000 7f345fc369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:08.566 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.558+0000 7f345fc369c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:08.566 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.558+0000 7f345fc369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:08.566 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.558+0000 7f345fc369c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:08.567 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.562+0000 7f345fc369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:08.567 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.562+0000 7f345fc369c0 20 started sync module instance, tier type = 2024-09-12T17:00:08.567 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.562+0000 7f345fc369c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:00:08.594 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.586+0000 7f345fc369c0 20 add_watcher() i=0 2024-09-12T17:00:08.594 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.586+0000 7f345fc369c0 20 add_watcher() i=1 2024-09-12T17:00:08.594 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.586+0000 7f345fc369c0 20 add_watcher() i=2 2024-09-12T17:00:08.594 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.586+0000 7f345fc369c0 20 add_watcher() i=3 2024-09-12T17:00:08.594 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.586+0000 7f345fc369c0 20 add_watcher() i=4 2024-09-12T17:00:08.594 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.586+0000 7f345fc369c0 20 add_watcher() i=5 2024-09-12T17:00:08.594 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.586+0000 7f345fc369c0 20 add_watcher() i=6 2024-09-12T17:00:08.597 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.590+0000 7f345fc369c0 20 add_watcher() i=7 2024-09-12T17:00:08.597 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.590+0000 7f345fc369c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:00:08.602 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.594+0000 7f33137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:00:08.603 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.598+0000 7f345fc369c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:00:08.603 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.598+0000 7f345fc369c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:00:08.603 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.598+0000 7f345fc369c0 5 note: GC not initialized 2024-09-12T17:00:08.603 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.598+0000 7f33127e4640 20 reqs_thread_entry: start 2024-09-12T17:00:08.604 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.598+0000 7f345fc369c0 20 init_complete bucket index max shards: 1 2024-09-12T17:00:08.604 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.598+0000 7f345fc369c0 20 Filter name: none 2024-09-12T17:00:08.604 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.598+0000 7f3283fff640 20 reqs_thread_entry: start 2024-09-12T17:00:08.604 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.598+0000 7f345fc369c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:08.605 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.598+0000 7f345fc369c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:00:08.605 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.598+0000 7f345fc369c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:08.607 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.602+0000 7f345fc369c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:00:08.607 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.602+0000 7f345fc369c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:00:08.607 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.602+0000 7f345fc369c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T17:00:08.607 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.602+0000 7f345fc369c0 20 INFO: main: starting shard=0 2024-09-12T17:00:08.607 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.602+0000 7f345fc369c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:08.608 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.602+0000 7f345fc369c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:00:08.608 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.602+0000 7f345fc369c0 20 INFO: main: done 2024-09-12T17:00:08.610 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.602+0000 7f33137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:00:08.616 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.610+0000 7f345fc369c0 20 remove_watcher() i=0 2024-09-12T17:00:08.616 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.610+0000 7f345fc369c0 2 removed watcher, disabling cache 2024-09-12T17:00:08.619 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.614+0000 7f345fc369c0 20 remove_watcher() i=1 2024-09-12T17:00:08.621 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.614+0000 7f345fc369c0 20 remove_watcher() i=2 2024-09-12T17:00:08.623 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.618+0000 7f345fc369c0 20 remove_watcher() i=3 2024-09-12T17:00:08.626 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.618+0000 7f345fc369c0 20 remove_watcher() i=4 2024-09-12T17:00:08.628 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.622+0000 7f345fc369c0 20 remove_watcher() i=5 2024-09-12T17:00:08.630 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.622+0000 7f345fc369c0 20 remove_watcher() i=6 2024-09-12T17:00:08.632 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:08.626+0000 7f345fc369c0 20 remove_watcher() i=7 2024-09-12T17:00:08.656 INFO:tasks.workunit.client.0.smithi016.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T17:00:09.101 INFO:tasks.workunit.client.0.smithi016.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T17:00:09.540 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T17:00:09.573 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:00:09.574 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:00:09.619 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.614+0000 7fcb014909c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:09.620 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.614+0000 7fcb014909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:09.620 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.614+0000 7fcb014909c0 20 realm 2024-09-12T17:00:09.620 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.614+0000 7fcb014909c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:09.621 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.614+0000 7fcb014909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:09.621 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.614+0000 7fcb014909c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:00:09.621 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.614+0000 7fcb014909c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:09.621 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.614+0000 7fcb014909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:09.621 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.614+0000 7fcb014909c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:09.622 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.614+0000 7fcb014909c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:00:09.622 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.614+0000 7fcb014909c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:09.624 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.618+0000 7fcb014909c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:00:09.624 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.618+0000 7fcb014909c0 20 searching for the correct realm 2024-09-12T17:00:09.627 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.622+0000 7fcaff797640 0 -- 172.21.15.16:0/3660449387 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fcae80e3040 msgr2=0x7fcae8112400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:00:09.634 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.626+0000 7fcafe795640 0 -- 172.21.15.16:0/3660449387 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fcaf802db60 msgr2=0x7fcaf800a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:00:09.850 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.842+0000 7fcb014909c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:00:09.851 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.842+0000 7fcb014909c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:00:09.851 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.842+0000 7fcb014909c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:00:09.851 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.842+0000 7fcb014909c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:00:09.851 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.842+0000 7fcb014909c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:00:09.851 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.842+0000 7fcb014909c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:00:09.851 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.842+0000 7fcb014909c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:09.851 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.846+0000 7fcb014909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:09.851 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.846+0000 7fcb014909c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:09.852 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.846+0000 7fcb014909c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:00:09.852 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.846+0000 7fcb014909c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:09.853 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.846+0000 7fcb014909c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:00:09.853 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.846+0000 7fcb014909c0 20 zone default found 2024-09-12T17:00:09.853 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.846+0000 7fcb014909c0 4 Realm: () 2024-09-12T17:00:09.853 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.846+0000 7fcb014909c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:00:09.853 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.846+0000 7fcb014909c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:00:09.853 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.846+0000 7fcb014909c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:00:09.853 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.846+0000 7fcb014909c0 20 zonegroup default 2024-09-12T17:00:09.853 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.846+0000 7fcb014909c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:09.854 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.846+0000 7fcb014909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:09.854 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.846+0000 7fcb014909c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:09.855 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.850+0000 7fcb014909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:09.855 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.850+0000 7fcb014909c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:09.855 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.850+0000 7fcb014909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:09.855 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.850+0000 7fcb014909c0 20 started sync module instance, tier type = 2024-09-12T17:00:09.855 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.850+0000 7fcb014909c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:00:09.877 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.870+0000 7fcb014909c0 20 add_watcher() i=0 2024-09-12T17:00:09.878 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.870+0000 7fcb014909c0 20 add_watcher() i=1 2024-09-12T17:00:09.878 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.870+0000 7fcb014909c0 20 add_watcher() i=2 2024-09-12T17:00:09.878 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.870+0000 7fcb014909c0 20 add_watcher() i=3 2024-09-12T17:00:09.878 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.870+0000 7fcb014909c0 20 add_watcher() i=4 2024-09-12T17:00:09.878 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.870+0000 7fcb014909c0 20 add_watcher() i=5 2024-09-12T17:00:09.878 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.870+0000 7fcb014909c0 20 add_watcher() i=6 2024-09-12T17:00:09.880 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.874+0000 7fcb014909c0 20 add_watcher() i=7 2024-09-12T17:00:09.880 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.874+0000 7fcb014909c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:00:09.885 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.878+0000 7fc9b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:00:09.886 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.878+0000 7fcb014909c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:00:09.886 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.878+0000 7fcb014909c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:00:09.886 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.878+0000 7fcb014909c0 5 note: GC not initialized 2024-09-12T17:00:09.887 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.878+0000 7fc92ffff640 20 reqs_thread_entry: start 2024-09-12T17:00:09.887 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.878+0000 7fcb014909c0 20 init_complete bucket index max shards: 1 2024-09-12T17:00:09.887 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.878+0000 7fcb014909c0 20 Filter name: none 2024-09-12T17:00:09.887 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.878+0000 7fc92dffb640 20 reqs_thread_entry: start 2024-09-12T17:00:09.887 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.878+0000 7fcb014909c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:00:09.887 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.878+0000 7fcb014909c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:09.887 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.882+0000 7fcb014909c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:00:09.888 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.882+0000 7fcb014909c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:00:09.888 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.882+0000 7fcb014909c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:00:09.888 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.882+0000 7fcb014909c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1 : miss 2024-09-12T17:00:09.888 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.882+0000 7fcb014909c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:09.888 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.882+0000 7fcb014909c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:00:09.889 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.882+0000 7fcb014909c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1 info.flags=0x17 2024-09-12T17:00:09.889 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.882+0000 7fcb014909c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1 to cache LRU end 2024-09-12T17:00:09.889 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.882+0000 7fcb014909c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:00:09.889 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.882+0000 7fcb014909c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:00:09.889 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.882+0000 7fcb014909c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1 2024-09-12T17:00:09.889 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.882+0000 7fcb014909c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:09.898 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.890+0000 7fc9b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:00:09.903 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.898+0000 7fcb014909c0 20 remove_watcher() i=0 2024-09-12T17:00:09.903 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.898+0000 7fcb014909c0 2 removed watcher, disabling cache 2024-09-12T17:00:09.905 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.898+0000 7fcb014909c0 20 remove_watcher() i=1 2024-09-12T17:00:09.908 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.902+0000 7fcb014909c0 20 remove_watcher() i=2 2024-09-12T17:00:09.911 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.906+0000 7fcb014909c0 20 remove_watcher() i=3 2024-09-12T17:00:09.913 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.906+0000 7fcb014909c0 20 remove_watcher() i=4 2024-09-12T17:00:09.915 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.910+0000 7fcb014909c0 20 remove_watcher() i=5 2024-09-12T17:00:09.917 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.910+0000 7fcb014909c0 20 remove_watcher() i=6 2024-09-12T17:00:09.919 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:09.914+0000 7fcb014909c0 20 remove_watcher() i=7 2024-09-12T17:00:09.937 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T17:00:09.976 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:00:09.977 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:00:10.023 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.018+0000 7fc23a5f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:10.025 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.018+0000 7fc23a5f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:10.025 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.018+0000 7fc23a5f69c0 20 realm 2024-09-12T17:00:10.025 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.018+0000 7fc23a5f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:10.025 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.018+0000 7fc23a5f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:10.025 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.018+0000 7fc23a5f69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:00:10.025 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.018+0000 7fc23a5f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:10.025 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.018+0000 7fc23a5f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:10.025 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.018+0000 7fc23a5f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:10.026 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.018+0000 7fc23a5f69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:00:10.027 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.018+0000 7fc23a5f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:10.028 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.022+0000 7fc23a5f69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:00:10.028 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.022+0000 7fc23a5f69c0 20 searching for the correct realm 2024-09-12T17:00:10.031 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.026+0000 7fc2388fd640 0 -- 172.21.15.16:0/2441175899 >> [v2:172.21.15.19:6800/1509147557,v1:172.21.15.19:6801/1509147557] conn(0x563d0a139340 msgr2=0x563d0a13b750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:00:10.037 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.030+0000 7fc2378fb640 0 -- 172.21.15.16:0/2441175899 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fc23001a040 msgr2=0x7fc2300249c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:00:10.254 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.246+0000 7fc23a5f69c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:00:10.254 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.246+0000 7fc23a5f69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:00:10.254 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.246+0000 7fc23a5f69c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:00:10.254 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.246+0000 7fc23a5f69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:00:10.254 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.246+0000 7fc23a5f69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:00:10.255 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.246+0000 7fc23a5f69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:00:10.255 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.246+0000 7fc23a5f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:10.255 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.246+0000 7fc23a5f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:10.255 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.246+0000 7fc23a5f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:10.255 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.250+0000 7fc23a5f69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:00:10.255 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.250+0000 7fc23a5f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:10.256 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.250+0000 7fc23a5f69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:00:10.256 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.250+0000 7fc23a5f69c0 20 zone default found 2024-09-12T17:00:10.256 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.250+0000 7fc23a5f69c0 4 Realm: () 2024-09-12T17:00:10.256 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.250+0000 7fc23a5f69c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:00:10.256 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.250+0000 7fc23a5f69c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:00:10.257 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.250+0000 7fc23a5f69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:00:10.257 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.250+0000 7fc23a5f69c0 20 zonegroup default 2024-09-12T17:00:10.257 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.250+0000 7fc23a5f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:10.257 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.250+0000 7fc23a5f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:10.257 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.250+0000 7fc23a5f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:10.258 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.250+0000 7fc23a5f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:10.258 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.250+0000 7fc23a5f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:10.259 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.250+0000 7fc23a5f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:10.259 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.250+0000 7fc23a5f69c0 20 started sync module instance, tier type = 2024-09-12T17:00:10.259 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.250+0000 7fc23a5f69c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:00:10.281 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.274+0000 7fc23a5f69c0 20 add_watcher() i=0 2024-09-12T17:00:10.281 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.274+0000 7fc23a5f69c0 20 add_watcher() i=1 2024-09-12T17:00:10.281 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.274+0000 7fc23a5f69c0 20 add_watcher() i=2 2024-09-12T17:00:10.281 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.274+0000 7fc23a5f69c0 20 add_watcher() i=3 2024-09-12T17:00:10.282 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.274+0000 7fc23a5f69c0 20 add_watcher() i=4 2024-09-12T17:00:10.282 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.274+0000 7fc23a5f69c0 20 add_watcher() i=5 2024-09-12T17:00:10.282 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.274+0000 7fc23a5f69c0 20 add_watcher() i=6 2024-09-12T17:00:10.284 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.278+0000 7fc23a5f69c0 20 add_watcher() i=7 2024-09-12T17:00:10.284 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.278+0000 7fc23a5f69c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:00:10.288 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.282+0000 7fc0ee7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:00:10.289 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.282+0000 7fc23a5f69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:00:10.289 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.282+0000 7fc23a5f69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:00:10.289 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.282+0000 7fc23a5f69c0 5 note: GC not initialized 2024-09-12T17:00:10.290 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.282+0000 7fc0ed7e2640 20 reqs_thread_entry: start 2024-09-12T17:00:10.290 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.282+0000 7fc23a5f69c0 20 init_complete bucket index max shards: 1 2024-09-12T17:00:10.290 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.282+0000 7fc23a5f69c0 20 Filter name: none 2024-09-12T17:00:10.290 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.282+0000 7fc05effd640 20 reqs_thread_entry: start 2024-09-12T17:00:10.290 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.282+0000 7fc23a5f69c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:00:10.290 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.282+0000 7fc23a5f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:10.291 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.286+0000 7fc23a5f69c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:00:10.291 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.286+0000 7fc23a5f69c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:00:10.291 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.286+0000 7fc23a5f69c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:00:10.291 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.286+0000 7fc23a5f69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1 : miss 2024-09-12T17:00:10.292 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.286+0000 7fc23a5f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:10.292 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.286+0000 7fc23a5f69c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:00:10.292 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.286+0000 7fc23a5f69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1 info.flags=0x17 2024-09-12T17:00:10.292 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.286+0000 7fc23a5f69c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1 to cache LRU end 2024-09-12T17:00:10.292 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.286+0000 7fc23a5f69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:00:10.292 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.286+0000 7fc23a5f69c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:00:10.292 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.286+0000 7fc23a5f69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1 2024-09-12T17:00:10.292 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.286+0000 7fc23a5f69c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:10.295 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.290+0000 7fc23a5f69c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:10.296 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.290+0000 7fc23a5f69c0 20 get_obj_state: octx=0x563d09ec1110 obj=check-bucket:c state=0x563d0a173868 s->prefetch_data=0 2024-09-12T17:00:10.297 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.290+0000 7fc23a5f69c0 20 get_obj_state: setting s->obj_tag to pl0yrixh3yhqtu54q1nd86lvu19jffz7 2024-09-12T17:00:10.297 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.290+0000 7fc23a5f69c0 20 get_obj_state_impl: setting s->olh_tag to 7grk6ubcuqr0dbu3j6b03hxm8y6jn4fm 2024-09-12T17:00:10.297 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.290+0000 7fc23a5f69c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=7grk6ubcuqr0dbu3j6b03hxm8y6jn4fm 2024-09-12T17:00:10.300 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.294+0000 7fc23a5f69c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:10.303 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.298+0000 7fc23a5f69c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:10.304 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.298+0000 7fc23a5f69c0 20 olh_log_entry: epoch=3 op=3 key=c[oYj03BN06yLrHsKnKTXCqgt9LOMFf9d] 2024-09-12T17:00:10.304 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.298+0000 7fc23a5f69c0 20 get_obj_state: octx=0x563d09ec1110 obj=check-bucket:_:oYj03BN06yLrHsKnKTXCqgt9LOMFf9d_c state=0x563d0a16d8b8 s->prefetch_data=0 2024-09-12T17:00:10.305 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.298+0000 7fc23a5f69c0 10 manifest: total_size = 22 2024-09-12T17:00:10.305 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.298+0000 7fc23a5f69c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15047333855147618974 2024-09-12T17:00:10.306 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.298+0000 7fc23a5f69c0 20 get_obj_state: octx=0x563d09ec1110 obj=check-bucket:_:oYj03BN06yLrHsKnKTXCqgt9LOMFf9d_c state=0x563d0a16d8b8 s->prefetch_data=0 2024-09-12T17:00:10.306 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.298+0000 7fc23a5f69c0 20 prepare_atomic_modification: state is not atomic. state=0x563d0a16d8b8 2024-09-12T17:00:10.306 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.298+0000 7fc23a5f69c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:10.312 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.306+0000 7fc23a5f69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:00:10.312 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.306+0000 7fc23a5f69c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T17:00:10.312 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.306+0000 7fc23a5f69c0 0 deleting objects inline since gc isn't initialized 2024-09-12T17:00:10.312 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.306+0000 7fc23a5f69c0 5 delete_objs_inline: removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1__shadow:oYj03BN06yLrHsKnKTXCqgt9LOMFf9d_.gKjqj2v5TqYdLZjdKfwctZde4R2C1Th_0 2024-09-12T17:00:10.314 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.306+0000 7fc23a5f69c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:00:10.315 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.310+0000 7fc116ffd640 20 handle_completion(): completion ok for obj=c[oYj03BN06yLrHsKnKTXCqgt9LOMFf9d] 2024-09-12T17:00:10.317 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.310+0000 7fc23a5f69c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:10.317 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.310+0000 7fc23a5f69c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:10.322 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.314+0000 7fc23a5f69c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:10.324 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.318+0000 7fc23a5f69c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:10.324 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.318+0000 7fc23a5f69c0 20 get_obj_state: octx=0x563d09ec1110 obj=check-bucket:d state=0x563d0a19d018 s->prefetch_data=0 2024-09-12T17:00:10.325 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.318+0000 7fc23a5f69c0 20 get_obj_state: setting s->obj_tag to 0ydwosi33mi09dbvcbadteku9un6jech 2024-09-12T17:00:10.325 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.318+0000 7fc23a5f69c0 20 get_obj_state_impl: setting s->olh_tag to 47dsuze75m83ms0l6ikze782s9u1wlfs 2024-09-12T17:00:10.326 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.318+0000 7fc23a5f69c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=47dsuze75m83ms0l6ikze782s9u1wlfs 2024-09-12T17:00:10.328 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.322+0000 7fc23a5f69c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:10.331 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.326+0000 7fc23a5f69c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:10.332 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.326+0000 7fc23a5f69c0 20 olh_log_entry: epoch=3 op=3 key=d[hSWa9MuTgRrnUmOfbTrdbPvAXOZuDK9] 2024-09-12T17:00:10.332 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.326+0000 7fc23a5f69c0 20 get_obj_state: octx=0x563d09ec1110 obj=check-bucket:_:hSWa9MuTgRrnUmOfbTrdbPvAXOZuDK9_d state=0x563d0a171788 s->prefetch_data=0 2024-09-12T17:00:10.333 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.326+0000 7fc23a5f69c0 10 manifest: total_size = 11 2024-09-12T17:00:10.333 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.326+0000 7fc23a5f69c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4328560823564358152 2024-09-12T17:00:10.334 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.326+0000 7fc23a5f69c0 20 get_obj_state: octx=0x563d09ec1110 obj=check-bucket:_:hSWa9MuTgRrnUmOfbTrdbPvAXOZuDK9_d state=0x563d0a171788 s->prefetch_data=0 2024-09-12T17:00:10.334 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.326+0000 7fc23a5f69c0 20 prepare_atomic_modification: state is not atomic. state=0x563d0a171788 2024-09-12T17:00:10.334 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.326+0000 7fc23a5f69c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:10.339 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.334+0000 7fc23a5f69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:00:10.340 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.334+0000 7fc23a5f69c0 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-12T17:00:10.340 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.334+0000 7fc23a5f69c0 0 deleting objects inline since gc isn't initialized 2024-09-12T17:00:10.340 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.334+0000 7fc23a5f69c0 5 delete_objs_inline: removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1__shadow:hSWa9MuTgRrnUmOfbTrdbPvAXOZuDK9_.G6jjQt6A8E94bVhpPhsYHMg5I-gWN4o_0 2024-09-12T17:00:10.341 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.334+0000 7fc23a5f69c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:00:10.342 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.334+0000 7fc116ffd640 20 handle_completion(): completion ok for obj=d[hSWa9MuTgRrnUmOfbTrdbPvAXOZuDK9] 2024-09-12T17:00:10.344 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.338+0000 7fc23a5f69c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:10.344 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.338+0000 7fc23a5f69c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:10.347 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.342+0000 7fc23a5f69c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:10.348 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.342+0000 7fc23a5f69c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:10.349 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.342+0000 7fc23a5f69c0 20 get_obj_state: octx=0x563d09ec1110 obj=check-bucket:e state=0x563d0a19d018 s->prefetch_data=0 2024-09-12T17:00:10.350 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.342+0000 7fc23a5f69c0 20 get_obj_state: setting s->obj_tag to 3qhi5fxjl7g3aq265q1bb87pc34cx59r 2024-09-12T17:00:10.350 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.342+0000 7fc23a5f69c0 20 get_obj_state_impl: setting s->olh_tag to ofmtal3g2qyx1ukkz6w2mxil2s3iv0yc 2024-09-12T17:00:10.350 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.342+0000 7fc23a5f69c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ofmtal3g2qyx1ukkz6w2mxil2s3iv0yc 2024-09-12T17:00:10.353 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.346+0000 7fc23a5f69c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:10.356 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.350+0000 7fc23a5f69c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:10.357 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.350+0000 7fc23a5f69c0 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T17:00:10.357 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.350+0000 7fc23a5f69c0 20 olh_log_entry: epoch=2 op=3 key=e[ES83QzAq16xfWRfJJFKzLuh.I0MIA72] 2024-09-12T17:00:10.357 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.350+0000 7fc23a5f69c0 20 get_obj_state: octx=0x563d09ec1110 obj=check-bucket:_:ES83QzAq16xfWRfJJFKzLuh.I0MIA72_e state=0x563d0a19db78 s->prefetch_data=0 2024-09-12T17:00:10.358 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.350+0000 7fc23a5f69c0 10 manifest: total_size = 22 2024-09-12T17:00:10.358 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.350+0000 7fc23a5f69c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3140278054116743204 2024-09-12T17:00:10.358 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.350+0000 7fc23a5f69c0 20 get_obj_state: octx=0x563d09ec1110 obj=check-bucket:_:ES83QzAq16xfWRfJJFKzLuh.I0MIA72_e state=0x563d0a19db78 s->prefetch_data=0 2024-09-12T17:00:10.358 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.350+0000 7fc23a5f69c0 20 prepare_atomic_modification: state is not atomic. state=0x563d0a19db78 2024-09-12T17:00:10.358 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.350+0000 7fc23a5f69c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:10.363 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.358+0000 7fc23a5f69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:00:10.363 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.358+0000 7fc23a5f69c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T17:00:10.363 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.358+0000 7fc23a5f69c0 0 deleting objects inline since gc isn't initialized 2024-09-12T17:00:10.363 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.358+0000 7fc23a5f69c0 5 delete_objs_inline: removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1__shadow:ES83QzAq16xfWRfJJFKzLuh.I0MIA72_.aqLklpRy5vyjSOfGF9RhM2f7XAFbyRz_0 2024-09-12T17:00:10.366 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.358+0000 7fc23a5f69c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:00:10.366 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.358+0000 7fc116ffd640 20 handle_completion(): completion ok for obj=e[ES83QzAq16xfWRfJJFKzLuh.I0MIA72] 2024-09-12T17:00:10.368 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.362+0000 7fc23a5f69c0 20 get_obj_state: octx=0x563d09ec1110 obj=check-bucket:e state=0x563d0a19d018 s->prefetch_data=0 2024-09-12T17:00:10.368 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.362+0000 7fc23a5f69c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ofmtal3g2qyx1ukkz6w2mxil2s3iv0yc 2024-09-12T17:00:10.373 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.366+0000 7fc23a5f69c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:10.377 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.370+0000 7fc23a5f69c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:10.378 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.370+0000 7fc23a5f69c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:10.378 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.370+0000 7fc23a5f69c0 20 get_obj_state: octx=0x563d09ec1110 obj=check-bucket:f state=0x563d0a169878 s->prefetch_data=0 2024-09-12T17:00:10.379 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.374+0000 7fc23a5f69c0 20 get_obj_state: setting s->obj_tag to dv37136c1qy4htcx4b4632khakw1l7ni 2024-09-12T17:00:10.379 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.374+0000 7fc23a5f69c0 20 get_obj_state_impl: setting s->olh_tag to ke1ae50vru8onisoa6xuyynhaf1v9yae 2024-09-12T17:00:10.380 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.374+0000 7fc23a5f69c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ke1ae50vru8onisoa6xuyynhaf1v9yae 2024-09-12T17:00:10.382 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.374+0000 7fc23a5f69c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:10.385 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.378+0000 7fc23a5f69c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:10.386 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.378+0000 7fc23a5f69c0 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T17:00:10.386 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.378+0000 7fc23a5f69c0 20 olh_log_entry: epoch=2 op=3 key=f[EsiBwxxZ08FRTrShiL9S9GyhTtmFy3h] 2024-09-12T17:00:10.386 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.378+0000 7fc23a5f69c0 20 get_obj_state: octx=0x563d09ec1110 obj=check-bucket:_:EsiBwxxZ08FRTrShiL9S9GyhTtmFy3h_f state=0x563d0a16cba8 s->prefetch_data=0 2024-09-12T17:00:10.387 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.382+0000 7fc23a5f69c0 10 manifest: total_size = 12 2024-09-12T17:00:10.387 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.382+0000 7fc23a5f69c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13951599694360640699 2024-09-12T17:00:10.387 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.382+0000 7fc23a5f69c0 20 get_obj_state: octx=0x563d09ec1110 obj=check-bucket:_:EsiBwxxZ08FRTrShiL9S9GyhTtmFy3h_f state=0x563d0a16cba8 s->prefetch_data=0 2024-09-12T17:00:10.387 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.382+0000 7fc23a5f69c0 20 prepare_atomic_modification: state is not atomic. state=0x563d0a16cba8 2024-09-12T17:00:10.387 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.382+0000 7fc23a5f69c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:10.393 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.386+0000 7fc23a5f69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:00:10.393 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.386+0000 7fc23a5f69c0 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T17:00:10.393 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.386+0000 7fc23a5f69c0 0 deleting objects inline since gc isn't initialized 2024-09-12T17:00:10.393 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.386+0000 7fc23a5f69c0 5 delete_objs_inline: removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1__shadow:EsiBwxxZ08FRTrShiL9S9GyhTtmFy3h_.vDMBPSkc__7yVrMhR0InoZWhDvDSa9Z_0 2024-09-12T17:00:10.396 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.390+0000 7fc23a5f69c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:00:10.396 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.390+0000 7fc116ffd640 20 handle_completion(): completion ok for obj=f[EsiBwxxZ08FRTrShiL9S9GyhTtmFy3h] 2024-09-12T17:00:10.399 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.394+0000 7fc23a5f69c0 20 get_obj_state: octx=0x563d09ec1110 obj=check-bucket:f state=0x563d0a169878 s->prefetch_data=0 2024-09-12T17:00:10.399 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.394+0000 7fc23a5f69c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ke1ae50vru8onisoa6xuyynhaf1v9yae 2024-09-12T17:00:10.405 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.398+0000 7fc23a5f69c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:10.408 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.402+0000 7fc23a5f69c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1.0 2024-09-12T17:00:10.408 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.402+0000 7fc23a5f69c0 1 NOTICE: finished shard 0 (4 entries removed) 2024-09-12T17:00:10.409 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.402+0000 7fc23a5f69c0 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T17:00:10.411 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.406+0000 7fc0ee7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:00:10.417 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.410+0000 7fc23a5f69c0 20 remove_watcher() i=0 2024-09-12T17:00:10.417 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.410+0000 7fc23a5f69c0 2 removed watcher, disabling cache 2024-09-12T17:00:10.419 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.414+0000 7fc23a5f69c0 20 remove_watcher() i=1 2024-09-12T17:00:10.422 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.414+0000 7fc23a5f69c0 20 remove_watcher() i=2 2024-09-12T17:00:10.425 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.418+0000 7fc23a5f69c0 20 remove_watcher() i=3 2024-09-12T17:00:10.427 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.422+0000 7fc23a5f69c0 20 remove_watcher() i=4 2024-09-12T17:00:10.430 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.422+0000 7fc23a5f69c0 20 remove_watcher() i=5 2024-09-12T17:00:10.432 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.426+0000 7fc23a5f69c0 20 remove_watcher() i=6 2024-09-12T17:00:10.435 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.430+0000 7fc23a5f69c0 20 remove_watcher() i=7 2024-09-12T17:00:10.549 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T17:00:10.583 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:00:10.583 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:00:10.630 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.622+0000 7fb8707079c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:10.632 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.626+0000 7fb8707079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:10.633 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.626+0000 7fb8707079c0 20 realm 2024-09-12T17:00:10.633 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.626+0000 7fb8707079c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:10.633 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.626+0000 7fb8707079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:10.633 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.626+0000 7fb8707079c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:00:10.633 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.626+0000 7fb8707079c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:10.633 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.626+0000 7fb8707079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:10.633 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.626+0000 7fb8707079c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:10.634 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.626+0000 7fb8707079c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:00:10.634 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.626+0000 7fb8707079c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:10.636 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.630+0000 7fb8707079c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:00:10.636 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.630+0000 7fb8707079c0 20 searching for the correct realm 2024-09-12T17:00:10.639 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.634+0000 7fb86ea0e640 0 -- 172.21.15.16:0/2498519817 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fb864041070 msgr2=0x7fb86404f920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:00:10.647 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.642+0000 7fb86da0c640 0 -- 172.21.15.16:0/2498519817 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fb868042900 msgr2=0x7fb868042da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:00:10.866 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.858+0000 7fb8707079c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:00:10.866 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.858+0000 7fb8707079c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:00:10.866 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.858+0000 7fb8707079c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:00:10.867 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.858+0000 7fb8707079c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:00:10.867 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.858+0000 7fb8707079c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:00:10.867 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.858+0000 7fb8707079c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:00:10.867 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.858+0000 7fb8707079c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:10.867 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.862+0000 7fb8707079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:10.867 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.862+0000 7fb8707079c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:10.868 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.862+0000 7fb8707079c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:00:10.868 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.862+0000 7fb8707079c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:10.869 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.862+0000 7fb8707079c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:00:10.869 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.862+0000 7fb8707079c0 20 zone default found 2024-09-12T17:00:10.869 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.862+0000 7fb8707079c0 4 Realm: () 2024-09-12T17:00:10.869 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.862+0000 7fb8707079c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:00:10.869 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.862+0000 7fb8707079c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:00:10.869 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.862+0000 7fb8707079c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:00:10.869 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.862+0000 7fb8707079c0 20 zonegroup default 2024-09-12T17:00:10.869 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.862+0000 7fb8707079c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:10.870 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.862+0000 7fb8707079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:10.870 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.862+0000 7fb8707079c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:10.871 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.866+0000 7fb8707079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:10.871 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.866+0000 7fb8707079c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:10.871 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.866+0000 7fb8707079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:00:10.871 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.866+0000 7fb8707079c0 20 started sync module instance, tier type = 2024-09-12T17:00:10.872 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.866+0000 7fb8707079c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:00:10.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.890+0000 7fb8707079c0 20 add_watcher() i=0 2024-09-12T17:00:10.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.890+0000 7fb8707079c0 20 add_watcher() i=1 2024-09-12T17:00:10.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.890+0000 7fb8707079c0 20 add_watcher() i=2 2024-09-12T17:00:10.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.890+0000 7fb8707079c0 20 add_watcher() i=3 2024-09-12T17:00:10.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.890+0000 7fb8707079c0 20 add_watcher() i=4 2024-09-12T17:00:10.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.890+0000 7fb8707079c0 20 add_watcher() i=5 2024-09-12T17:00:10.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.890+0000 7fb8707079c0 20 add_watcher() i=6 2024-09-12T17:00:10.898 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.890+0000 7fb8707079c0 20 add_watcher() i=7 2024-09-12T17:00:10.898 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.890+0000 7fb8707079c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:00:10.907 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.894+0000 7fb724fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:00:10.907 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.898+0000 7fb8707079c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:00:10.907 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.898+0000 7fb8707079c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:00:10.907 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.898+0000 7fb8707079c0 5 note: GC not initialized 2024-09-12T17:00:10.907 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.898+0000 7fb69f7fe640 20 reqs_thread_entry: start 2024-09-12T17:00:10.907 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.898+0000 7fb8707079c0 20 init_complete bucket index max shards: 1 2024-09-12T17:00:10.907 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.898+0000 7fb8707079c0 20 Filter name: none 2024-09-12T17:00:10.907 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.898+0000 7fb69d7fa640 20 reqs_thread_entry: start 2024-09-12T17:00:10.907 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.898+0000 7fb8707079c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:10.907 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.898+0000 7fb8707079c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:00:10.907 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.898+0000 7fb8707079c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:10.907 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.898+0000 7fb8707079c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:00:10.908 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.898+0000 7fb8707079c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:00:10.908 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.898+0000 7fb8707079c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:10.908 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.898+0000 7fb8707079c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:00:10.908 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.902+0000 7fb8707079c0 20 rados->read ofs=0 len=0 2024-09-12T17:00:10.908 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.902+0000 7fb8707079c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:00:10.908 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.902+0000 7fb8707079c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:00:10.910 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.902+0000 7fb724fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:00:10.915 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.910+0000 7fb8707079c0 20 remove_watcher() i=0 2024-09-12T17:00:10.915 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.910+0000 7fb8707079c0 2 removed watcher, disabling cache 2024-09-12T17:00:10.918 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.910+0000 7fb8707079c0 20 remove_watcher() i=1 2024-09-12T17:00:10.921 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.914+0000 7fb8707079c0 20 remove_watcher() i=2 2024-09-12T17:00:10.923 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.918+0000 7fb8707079c0 20 remove_watcher() i=3 2024-09-12T17:00:10.926 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.918+0000 7fb8707079c0 20 remove_watcher() i=4 2024-09-12T17:00:10.928 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.922+0000 7fb8707079c0 20 remove_watcher() i=5 2024-09-12T17:00:10.929 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.922+0000 7fb8707079c0 20 remove_watcher() i=6 2024-09-12T17:00:10.932 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:00:10.926+0000 7fb8707079c0 20 remove_watcher() i=7 2024-09-12T17:00:10.950 INFO:tasks.workunit.client.0.smithi016.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T17:00:10.950 INFO:tasks.workunit.client.0.smithi016.stderr:Deleting bucket check-bucket 2024-09-12T17:00:10.987 INFO:tasks.workunit.client.0.smithi016.stderr:Completed bucket check tests 2024-09-12T17:00:10.987 INFO:tasks.workunit.client.0.smithi016.stdout:connected to http://localhost:80 2024-09-12T17:00:11.070 INFO:tasks.workunit.client.0.smithi016.stderr:+ deactivate 2024-09-12T17:00:11.071 INFO:tasks.workunit.client.0.smithi016.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-12T17:00:11.071 INFO:tasks.workunit.client.0.smithi016.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T17:00:11.071 INFO:tasks.workunit.client.0.smithi016.stderr:+ export PATH 2024-09-12T17:00:11.071 INFO:tasks.workunit.client.0.smithi016.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T17:00:11.071 INFO:tasks.workunit.client.0.smithi016.stderr:+ '[' -n '' ']' 2024-09-12T17:00:11.071 INFO:tasks.workunit.client.0.smithi016.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:00:11.071 INFO:tasks.workunit.client.0.smithi016.stderr:+ hash -r 2024-09-12T17:00:11.071 INFO:tasks.workunit.client.0.smithi016.stderr:+ '[' -n '' ']' 2024-09-12T17:00:11.071 INFO:tasks.workunit.client.0.smithi016.stderr:+ unset VIRTUAL_ENV 2024-09-12T17:00:11.071 INFO:tasks.workunit.client.0.smithi016.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-12T17:00:11.071 INFO:tasks.workunit.client.0.smithi016.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T17:00:11.071 INFO:tasks.workunit.client.0.smithi016.stderr:+ unset -f deactivate 2024-09-12T17:00:11.071 INFO:tasks.workunit.client.0.smithi016.stderr:+ echo OK. 2024-09-12T17:00:11.072 INFO:tasks.workunit.client.0.smithi016.stdout:OK. 2024-09-12T17:00:11.073 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:00:11.073 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:00:11.086 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-09-12T17:00:11.086 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:00:11.469 DEBUG:teuthology.parallel:result is None 2024-09-12T17:00:11.470 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:00:11.483 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:00:11.483 DEBUG:teuthology.orchestra.run.smithi016:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:00:11.544 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:00:11.545 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:00:11.555 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:00:11.555 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:00:11.555 DEBUG:teuthology.orchestra.run.smithi016:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:00:11.591 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:00:11.592 INFO:teuthology.orchestra.run.smithi016.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:00:11.592 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:00:11.640 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:00:11.640 DEBUG:teuthology.orchestra.run.smithi016:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:00:11.688 INFO:tasks.workunit:timeout=3h 2024-09-12T17:00:11.688 INFO:tasks.workunit:cleanup=True 2024-09-12T17:00:11.688 DEBUG:teuthology.orchestra.run.smithi016:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:00:11.738 INFO:tasks.workunit.client.0.smithi016.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:01:15.847 INFO:tasks.workunit.client.0.smithi016.stderr:Updating files: 99% (12586/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-12T17:01:16.744 INFO:tasks.workunit.client.0.smithi016.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:01:16.744 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:01:16.744 INFO:tasks.workunit.client.0.smithi016.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:01:16.744 INFO:tasks.workunit.client.0.smithi016.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:01:16.745 INFO:tasks.workunit.client.0.smithi016.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:01:16.745 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:01:16.745 INFO:tasks.workunit.client.0.smithi016.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:01:16.745 INFO:tasks.workunit.client.0.smithi016.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:01:16.745 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:01:16.745 INFO:tasks.workunit.client.0.smithi016.stderr: git switch -c 2024-09-12T17:01:16.745 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:01:16.745 INFO:tasks.workunit.client.0.smithi016.stderr:Or undo this operation with: 2024-09-12T17:01:16.745 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:01:16.745 INFO:tasks.workunit.client.0.smithi016.stderr: git switch - 2024-09-12T17:01:16.745 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:01:16.745 INFO:tasks.workunit.client.0.smithi016.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:01:16.745 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:01:16.746 INFO:tasks.workunit.client.0.smithi016.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:01:16.752 DEBUG:teuthology.orchestra.run.smithi016:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:01:16.801 INFO:tasks.workunit.client.0.smithi016.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:01:16.804 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:01:16.804 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:01:16.858 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:01:16.916 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:01:16.960 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:01:16.961 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:01:16.961 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:01:17.004 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:01:17.008 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-12T17:01:17.008 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:01:17.056 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-09-12T17:01:17.058 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-09-12T17:01:17.058 DEBUG:teuthology.orchestra.run.smithi016:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-09-12T17:01:17.121 INFO:tasks.workunit.client.0.smithi016.stdout:Running main() from gmock_main.cc 2024-09-12T17:01:17.121 INFO:tasks.workunit.client.0.smithi016.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T17:01:17.121 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] Global test environment set-up. 2024-09-12T17:01:17.121 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] 11 tests from ClsLock 2024-09-12T17:01:17.121 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-09-12T17:01:19.007 INFO:tasks.workunit.client.0.smithi016.stdout:lock: mylock 2024-09-12T17:01:19.007 INFO:tasks.workunit.client.0.smithi016.stdout: lock_type: exclusive 2024-09-12T17:01:19.007 INFO:tasks.workunit.client.0.smithi016.stdout: tag: 2024-09-12T17:01:19.007 INFO:tasks.workunit.client.0.smithi016.stdout: lockers: 2024-09-12T17:01:19.007 INFO:tasks.workunit.client.0.smithi016.stdout: client.5036 expiration=2024-09-12T17:03:18.999404+0000 addr=v1:172.21.15.16:0/2624793699 cookie= 2024-09-12T17:01:19.015 INFO:tasks.workunit.client.0.smithi016.stdout:lock: mylock 2024-09-12T17:01:19.015 INFO:tasks.workunit.client.0.smithi016.stdout: lock_type: shared 2024-09-12T17:01:19.015 INFO:tasks.workunit.client.0.smithi016.stdout: tag: 2024-09-12T17:01:19.015 INFO:tasks.workunit.client.0.smithi016.stdout: lockers: 2024-09-12T17:01:19.015 INFO:tasks.workunit.client.0.smithi016.stdout: client.5036 expiration=2024-09-12T17:03:19.012045+0000 addr=v1:172.21.15.16:0/2624793699 cookie= 2024-09-12T17:01:19.015 INFO:tasks.workunit.client.0.smithi016.stdout: client.5130 expiration=0.000000 addr=v1:172.21.15.16:0/3344339803 cookie= 2024-09-12T17:01:19.017 INFO:tasks.workunit.client.0.smithi016.stdout:lock: mylock 2024-09-12T17:01:19.017 INFO:tasks.workunit.client.0.smithi016.stdout: lock_type: shared 2024-09-12T17:01:19.018 INFO:tasks.workunit.client.0.smithi016.stdout: tag: 2024-09-12T17:01:19.018 INFO:tasks.workunit.client.0.smithi016.stdout: lockers: 2024-09-12T17:01:19.018 INFO:tasks.workunit.client.0.smithi016.stdout: client.5130 expiration=0.000000 addr=v1:172.21.15.16:0/3344339803 cookie= 2024-09-12T17:01:19.978 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] ClsLock.TestMultiLocking (2858 ms) 2024-09-12T17:01:19.978 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] ClsLock.TestMeta 2024-09-12T17:01:22.050 INFO:tasks.workunit.client.0.smithi016.stdout:lock: mylock 2024-09-12T17:01:22.050 INFO:tasks.workunit.client.0.smithi016.stdout: lock_type: shared 2024-09-12T17:01:22.050 INFO:tasks.workunit.client.0.smithi016.stdout: tag: 2024-09-12T17:01:22.050 INFO:tasks.workunit.client.0.smithi016.stdout: lockers: 2024-09-12T17:01:22.050 INFO:tasks.workunit.client.0.smithi016.stdout: client.5142 expiration=0.000000 addr=v1:172.21.15.16:0/3001935456 cookie= 2024-09-12T17:01:22.053 INFO:tasks.workunit.client.0.smithi016.stdout:lock: mylock 2024-09-12T17:01:22.054 INFO:tasks.workunit.client.0.smithi016.stdout: lock_type: exclusive 2024-09-12T17:01:22.054 INFO:tasks.workunit.client.0.smithi016.stdout: tag: new_tag 2024-09-12T17:01:22.054 INFO:tasks.workunit.client.0.smithi016.stdout: lockers: 2024-09-12T17:01:22.054 INFO:tasks.workunit.client.0.smithi016.stdout: client.5048 expiration=0.000000 addr=v1:172.21.15.16:0/1356366996 cookie= 2024-09-12T17:01:23.015 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] ClsLock.TestMeta (3036 ms) 2024-09-12T17:01:23.015 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] ClsLock.TestCookie 2024-09-12T17:01:25.048 INFO:tasks.workunit.client.0.smithi016.stdout:lock: mylock 2024-09-12T17:01:25.048 INFO:tasks.workunit.client.0.smithi016.stdout: lock_type: exclusive 2024-09-12T17:01:25.048 INFO:tasks.workunit.client.0.smithi016.stdout: tag: 2024-09-12T17:01:25.048 INFO:tasks.workunit.client.0.smithi016.stdout: lockers: 2024-09-12T17:01:25.052 INFO:tasks.workunit.client.0.smithi016.stdout:lock: mylock 2024-09-12T17:01:25.053 INFO:tasks.workunit.client.0.smithi016.stdout: lock_type: shared 2024-09-12T17:01:25.053 INFO:tasks.workunit.client.0.smithi016.stdout: tag: 2024-09-12T17:01:25.053 INFO:tasks.workunit.client.0.smithi016.stdout: lockers: 2024-09-12T17:01:25.053 INFO:tasks.workunit.client.0.smithi016.stdout: client.5054 expiration=0.000000 addr=v1:172.21.15.16:0/2551063566 cookie= 2024-09-12T17:01:25.053 INFO:tasks.workunit.client.0.smithi016.stdout: client.5054 expiration=0.000000 addr=v1:172.21.15.16:0/2551063566 cookie=new cookie 2024-09-12T17:01:26.010 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] ClsLock.TestCookie (2995 ms) 2024-09-12T17:01:26.010 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-09-12T17:01:29.076 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] ClsLock.TestMultipleLocks (3066 ms) 2024-09-12T17:01:29.076 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] ClsLock.TestLockDuration 2024-09-12T17:01:36.222 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] ClsLock.TestLockDuration (7147 ms) 2024-09-12T17:01:36.223 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-09-12T17:01:39.263 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] ClsLock.TestAssertLocked (3040 ms) 2024-09-12T17:01:39.263 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] ClsLock.TestSetCookie 2024-09-12T17:01:42.300 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] ClsLock.TestSetCookie (3037 ms) 2024-09-12T17:01:42.300 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] ClsLock.TestRenew 2024-09-12T17:02:03.409 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] ClsLock.TestRenew (21108 ms) 2024-09-12T17:02:03.409 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-09-12T17:02:10.481 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (7074 ms) 2024-09-12T17:02:10.481 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-09-12T17:02:17.595 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (7113 ms) 2024-09-12T17:02:17.595 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-09-12T17:02:25.644 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8050 ms) 2024-09-12T17:02:25.644 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] 11 tests from ClsLock (68524 ms total) 2024-09-12T17:02:25.644 INFO:tasks.workunit.client.0.smithi016.stdout: 2024-09-12T17:02:25.644 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] Global test environment tear-down 2024-09-12T17:02:25.644 INFO:tasks.workunit.client.0.smithi016.stdout:[==========] 11 tests from 1 test suite ran. (68524 ms total) 2024-09-12T17:02:25.645 INFO:tasks.workunit.client.0.smithi016.stdout:[ PASSED ] 11 tests. 2024-09-12T17:02:25.653 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:02:25.654 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:02:25.712 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-09-12T17:02:25.713 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-09-12T17:02:25.714 DEBUG:teuthology.orchestra.run.smithi016:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-09-12T17:02:25.784 INFO:tasks.workunit.client.0.smithi016.stdout:Running main() from gmock_main.cc 2024-09-12T17:02:25.784 INFO:tasks.workunit.client.0.smithi016.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T17:02:25.784 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] Global test environment set-up. 2024-09-12T17:02:25.784 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] 4 tests from cls_log 2024-09-12T17:02:25.784 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-09-12T17:02:28.661 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] cls_log.test_log_add_same_time (2877 ms) 2024-09-12T17:02:28.661 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-09-12T17:02:31.716 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] cls_log.test_log_add_different_time (3054 ms) 2024-09-12T17:02:31.716 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] cls_log.trim_by_time 2024-09-12T17:02:34.781 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] cls_log.trim_by_time (3066 ms) 2024-09-12T17:02:34.781 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] cls_log.trim_by_marker 2024-09-12T17:02:37.837 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] cls_log.trim_by_marker (3056 ms) 2024-09-12T17:02:37.837 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] 4 tests from cls_log (12053 ms total) 2024-09-12T17:02:37.837 INFO:tasks.workunit.client.0.smithi016.stdout: 2024-09-12T17:02:37.838 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] Global test environment tear-down 2024-09-12T17:02:37.838 INFO:tasks.workunit.client.0.smithi016.stdout:[==========] 4 tests from 1 test suite ran. (12053 ms total) 2024-09-12T17:02:37.838 INFO:tasks.workunit.client.0.smithi016.stdout:[ PASSED ] 4 tests. 2024-09-12T17:02:37.842 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:02:37.842 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:02:37.897 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-09-12T17:02:37.898 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-09-12T17:02:37.899 DEBUG:teuthology.orchestra.run.smithi016:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-09-12T17:02:37.963 INFO:tasks.workunit.client.0.smithi016.stdout:Running main() from gmock_main.cc 2024-09-12T17:02:37.963 INFO:tasks.workunit.client.0.smithi016.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T17:02:37.963 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] Global test environment set-up. 2024-09-12T17:02:37.963 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] 10 tests from cls_refcount 2024-09-12T17:02:37.963 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] cls_refcount.test_implicit 2024-09-12T17:02:40.876 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] cls_refcount.test_implicit (2913 ms) 2024-09-12T17:02:40.876 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-09-12T17:02:43.916 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3039 ms) 2024-09-12T17:02:43.916 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] cls_refcount.test_put_snap 2024-09-12T17:02:53.002 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] cls_refcount.test_put_snap (9085 ms) 2024-09-12T17:02:53.002 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] cls_refcount.test_explicit 2024-09-12T17:02:56.010 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] cls_refcount.test_explicit (3010 ms) 2024-09-12T17:02:56.011 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] cls_refcount.set 2024-09-12T17:02:59.057 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] cls_refcount.set (3047 ms) 2024-09-12T17:02:59.058 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-09-12T17:03:06.111 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] cls_refcount.test_implicit_ec (7053 ms) 2024-09-12T17:03:06.111 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-09-12T17:03:13.185 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7075 ms) 2024-09-12T17:03:13.185 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-09-12T17:03:25.274 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] cls_refcount.test_put_snap_ec (12089 ms) 2024-09-12T17:03:25.274 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-09-12T17:03:32.312 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] cls_refcount.test_explicit_ec (7038 ms) 2024-09-12T17:03:32.313 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] cls_refcount.set_ec 2024-09-12T17:03:39.380 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] cls_refcount.set_ec (7068 ms) 2024-09-12T17:03:39.380 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] 10 tests from cls_refcount (61418 ms total) 2024-09-12T17:03:39.380 INFO:tasks.workunit.client.0.smithi016.stdout: 2024-09-12T17:03:39.380 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] Global test environment tear-down 2024-09-12T17:03:39.381 INFO:tasks.workunit.client.0.smithi016.stdout:[==========] 10 tests from 1 test suite ran. (61418 ms total) 2024-09-12T17:03:39.381 INFO:tasks.workunit.client.0.smithi016.stdout:[ PASSED ] 10 tests. 2024-09-12T17:03:39.386 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:03:39.387 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:03:39.450 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-09-12T17:03:39.451 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-09-12T17:03:39.451 DEBUG:teuthology.orchestra.run.smithi016:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-09-12T17:03:39.520 INFO:tasks.workunit.client.0.smithi016.stdout:Running main() from gmock_main.cc 2024-09-12T17:03:39.520 INFO:tasks.workunit.client.0.smithi016.stdout:[==========] Running 18 tests from 1 test suite. 2024-09-12T17:03:39.520 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] Global test environment set-up. 2024-09-12T17:03:39.520 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] 18 tests from cls_rgw 2024-09-12T17:03:41.408 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] cls_rgw.index_basic 2024-09-12T17:03:41.492 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] cls_rgw.index_basic (84 ms) 2024-09-12T17:03:41.492 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-09-12T17:03:41.575 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (83 ms) 2024-09-12T17:03:41.575 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] cls_rgw.index_remove_object 2024-09-12T17:03:41.701 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] cls_rgw.index_remove_object (126 ms) 2024-09-12T17:03:41.701 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] cls_rgw.index_suggest 2024-09-12T17:03:44.230 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] cls_rgw.index_suggest (2529 ms) 2024-09-12T17:03:44.230 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-09-12T17:03:44.244 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] cls_rgw.index_suggest_complete (14 ms) 2024-09-12T17:03:44.245 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] cls_rgw.index_list 2024-09-12T17:03:44.297 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] cls_rgw.index_list (53 ms) 2024-09-12T17:03:44.297 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-09-12T17:04:37.166 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] cls_rgw.index_list_delimited (52868 ms) 2024-09-12T17:04:37.167 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] cls_rgw.bi_list 2024-09-12T17:04:37.363 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] cls_rgw.bi_list (198 ms) 2024-09-12T17:04:37.363 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] cls_rgw.gc_set 2024-09-12T17:04:37.389 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] cls_rgw.gc_set (26 ms) 2024-09-12T17:04:37.389 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] cls_rgw.gc_list 2024-09-12T17:04:37.417 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] cls_rgw.gc_list (29 ms) 2024-09-12T17:04:37.417 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] cls_rgw.gc_defer 2024-09-12T17:04:44.605 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] cls_rgw.gc_defer (7187 ms) 2024-09-12T17:04:44.605 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] cls_rgw.usage_basic 2024-09-12T17:04:45.050 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] cls_rgw.usage_basic (445 ms) 2024-09-12T17:04:45.050 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-09-12T17:04:45.052 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] cls_rgw.usage_clear_no_obj (3 ms) 2024-09-12T17:04:45.052 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] cls_rgw.usage_clear 2024-09-12T17:04:45.272 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] cls_rgw.usage_clear (219 ms) 2024-09-12T17:04:45.272 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-09-12T17:04:45.396 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] cls_rgw.bi_log_trim (125 ms) 2024-09-12T17:04:45.397 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-09-12T17:04:45.431 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] cls_rgw.index_racing_removes (34 ms) 2024-09-12T17:04:45.431 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] cls_rgw.reshardlog_list 2024-09-12T17:04:45.464 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] cls_rgw.reshardlog_list (34 ms) 2024-09-12T17:04:45.465 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] cls_rgw.reshardlog_num 2024-09-12T17:04:45.491 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] cls_rgw.reshardlog_num (27 ms) 2024-09-12T17:04:45.626 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] 18 tests from cls_rgw (64084 ms total) 2024-09-12T17:04:45.626 INFO:tasks.workunit.client.0.smithi016.stdout: 2024-09-12T17:04:45.626 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] Global test environment tear-down 2024-09-12T17:04:45.626 INFO:tasks.workunit.client.0.smithi016.stdout:[==========] 18 tests from 1 test suite ran. (66099 ms total) 2024-09-12T17:04:45.626 INFO:tasks.workunit.client.0.smithi016.stdout:[ PASSED ] 18 tests. 2024-09-12T17:04:45.627 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:04:45.627 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:04:45.687 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-09-12T17:04:45.689 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-09-12T17:04:45.689 DEBUG:teuthology.orchestra.run.smithi016:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-09-12T17:04:45.758 INFO:tasks.workunit.client.0.smithi016.stdout:Running main() from gmock_main.cc 2024-09-12T17:04:45.758 INFO:tasks.workunit.client.0.smithi016.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T17:04:45.758 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] Global test environment set-up. 2024-09-12T17:04:45.758 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] 9 tests from cls_rgw_gc 2024-09-12T17:04:45.758 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] cls_rgw_gc.init 2024-09-12T17:04:47.659 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] cls_rgw_gc.init (1902 ms) 2024-09-12T17:04:47.660 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-09-12T17:04:47.682 INFO:tasks.workunit.client.0.smithi016.stderr:[ ] list info tag = chain-0 2024-09-12T17:04:47.683 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (23 ms) 2024-09-12T17:04:47.683 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-09-12T17:04:47.695 INFO:tasks.workunit.client.0.smithi016.stderr:[ ] next_marker is: = 0/4263 2024-09-12T17:04:47.696 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (14 ms) 2024-09-12T17:04:47.696 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-09-12T17:04:47.713 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (16 ms) 2024-09-12T17:04:47.713 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-09-12T17:04:47.729 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (17 ms) 2024-09-12T17:04:47.729 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-09-12T17:04:47.747 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (18 ms) 2024-09-12T17:04:47.748 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-09-12T17:04:47.769 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (21 ms) 2024-09-12T17:04:47.769 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-09-12T17:04:47.786 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (18 ms) 2024-09-12T17:04:47.787 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] cls_rgw_gc.finalize 2024-09-12T17:04:48.659 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] cls_rgw_gc.finalize (872 ms) 2024-09-12T17:04:48.659 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] 9 tests from cls_rgw_gc (2901 ms total) 2024-09-12T17:04:48.659 INFO:tasks.workunit.client.0.smithi016.stdout: 2024-09-12T17:04:48.659 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] Global test environment tear-down 2024-09-12T17:04:48.659 INFO:tasks.workunit.client.0.smithi016.stdout:[==========] 9 tests from 1 test suite ran. (2901 ms total) 2024-09-12T17:04:48.659 INFO:tasks.workunit.client.0.smithi016.stdout:[ PASSED ] 9 tests. 2024-09-12T17:04:48.665 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:04:48.666 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:04:48.721 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-09-12T17:04:48.722 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-09-12T17:04:48.722 DEBUG:teuthology.orchestra.run.smithi016:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-09-12T17:04:48.804 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:04:48.804 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:04:48.804 INFO:tasks.workunit.client.0.smithi016.stdout:[==========] Running 1 test from 1 test suite. 2024-09-12T17:04:48.804 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] Global test environment set-up. 2024-09-12T17:04:50.662 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] 1 test from cls_rgw_stats 2024-09-12T17:04:50.662 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] cls_rgw_stats.simulate 2024-09-12T17:04:50.698 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.691+0000 7f026be9d8c0 1 > prepared operation key=Z9YNIEQCVNBA tag=ZFP0H2HXGZZ8 type=write size=807957 2024-09-12T17:04:50.700 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.695+0000 7f026be9d8c0 1 > prepared operation key=ALFGNC1YNROX tag=0SB8XTB3XMB6 type=write size=360110 2024-09-12T17:04:50.703 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.699+0000 7f026be9d8c0 1 > prepared operation key=SL2446KSB531 tag=6J790ZYYEWC3 type=write size=708516 2024-09-12T17:04:50.708 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.703+0000 7f026be9d8c0 1 > prepared part key=_multipart_SGT8IC1GJ3IG.2~53LP9P46ISW9.0 size=1048576 2024-09-12T17:04:50.710 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.707+0000 7f026be9d8c0 1 > prepared part key=_multipart_SGT8IC1GJ3IG.2~53LP9P46ISW9.1 size=679520 2024-09-12T17:04:50.710 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.707+0000 7f026be9d8c0 1 > prepared multipart upload key=SGT8IC1GJ3IG upload=53LP9P46ISW9 tag=IU8795J484Q0 type=write size=2776672 2024-09-12T17:04:50.712 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.707+0000 7f026be9d8c0 1 > prepared operation key=Z9YNIEQCVNBA tag=IYBM6Y3YHD3P type=del size=1272363 2024-09-12T17:04:50.715 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.711+0000 7f026be9d8c0 1 > prepared operation key=6VO85REZG2NW tag=6IN5ARJPGA67 type=del size=1881505 2024-09-12T17:04:50.720 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.715+0000 7f026be9d8c0 1 > prepared part key=_multipart_RBNN03IPZ8BT.2~WDO3FKFXQ0VK.0 size=1048576 2024-09-12T17:04:50.722 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.719+0000 7f026be9d8c0 1 > prepared part key=_multipart_RBNN03IPZ8BT.2~WDO3FKFXQ0VK.1 size=1048576 2024-09-12T17:04:50.725 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.719+0000 7f026be9d8c0 1 > prepared part key=_multipart_RBNN03IPZ8BT.2~WDO3FKFXQ0VK.2 size=19599 2024-09-12T17:04:50.725 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.719+0000 7f026be9d8c0 1 > prepared multipart upload key=RBNN03IPZ8BT upload=WDO3FKFXQ0VK tag=3JHSP2TXUP6D type=write size=3165327 2024-09-12T17:04:50.729 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.723+0000 7f026be9d8c0 1 > prepared part key=_multipart_LHKLWIUAT08F.2~JAXWFA73YH1R.0 size=483437 2024-09-12T17:04:50.729 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.723+0000 7f026be9d8c0 1 > prepared multipart upload key=LHKLWIUAT08F upload=JAXWFA73YH1R tag=RLFOC4WN7HSW type=write size=1532013 2024-09-12T17:04:50.732 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.727+0000 7f026be9d8c0 1 > prepared operation key=SO3HLQZA8B6B tag=YDQQYJ7IKRT7 type=del size=1338307 2024-09-12T17:04:50.734 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.731+0000 7f026be9d8c0 1 > prepared operation key=4G3BKGNT3YZC tag=ZTP9RP79P7NH type=del size=2689215 2024-09-12T17:04:50.738 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.735+0000 7f026be9d8c0 1 > prepared part key=_multipart_L194KQIPFLE1.2~019PU4PK0UW0.0 size=1048576 2024-09-12T17:04:50.740 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.735+0000 7f026be9d8c0 1 > prepared part key=_multipart_L194KQIPFLE1.2~019PU4PK0UW0.1 size=45957 2024-09-12T17:04:50.740 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.735+0000 7f026be9d8c0 1 > prepared multipart upload key=L194KQIPFLE1 upload=019PU4PK0UW0 tag=1VAA79EN09Y4 type=write size=2143109 2024-09-12T17:04:50.742 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.739+0000 7f026be9d8c0 1 > prepared operation key=QVQ4TI319DH5 tag=BSJGB3QF2FBN type=del size=490027 2024-09-12T17:04:50.744 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.739+0000 7f026be9d8c0 1 > prepared operation key=8AFDAVJLMRD2 tag=FFZJU6CMNOOC type=del size=3025931 2024-09-12T17:04:50.748 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.743+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~2BH932XPVEN6.0 size=638484 2024-09-12T17:04:50.748 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.743+0000 7f026be9d8c0 1 > prepared multipart upload key=6VO85REZG2NW upload=2BH932XPVEN6 tag=W88AYCX2DLMP type=write size=1687060 2024-09-12T17:04:50.752 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.747+0000 7f026be9d8c0 1 > prepared part key=_multipart_LHKLWIUAT08F.2~O1O39OC2T2DM.0 size=1048576 2024-09-12T17:04:50.754 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.747+0000 7f026be9d8c0 1 > prepared part key=_multipart_LHKLWIUAT08F.2~O1O39OC2T2DM.1 size=496205 2024-09-12T17:04:50.754 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.747+0000 7f026be9d8c0 1 > prepared multipart upload key=LHKLWIUAT08F upload=O1O39OC2T2DM tag=F597WNSQ72K1 type=write size=2593357 2024-09-12T17:04:50.758 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.751+0000 7f026be9d8c0 1 > prepared part key=_multipart_SGT8IC1GJ3IG.2~KK9TBL5DFEZ3.0 size=1048576 2024-09-12T17:04:50.759 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.755+0000 7f026be9d8c0 1 > prepared part key=_multipart_SGT8IC1GJ3IG.2~KK9TBL5DFEZ3.1 size=529526 2024-09-12T17:04:50.759 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.755+0000 7f026be9d8c0 1 > prepared multipart upload key=SGT8IC1GJ3IG upload=KK9TBL5DFEZ3 tag=C72N442C7AAJ type=write size=2626678 2024-09-12T17:04:50.761 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.755+0000 7f026be9d8c0 1 < completed write operation key=Z9YNIEQCVNBA tag=ZFP0H2HXGZZ8 type=write size=807957 2024-09-12T17:04:50.765 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.759+0000 7f026be9d8c0 1 > prepared part key=_multipart_SGT8IC1GJ3IG.2~QPDMQZJ5CJ0V.0 size=1048576 2024-09-12T17:04:50.768 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.763+0000 7f026be9d8c0 1 > prepared part key=_multipart_SGT8IC1GJ3IG.2~QPDMQZJ5CJ0V.1 size=1048576 2024-09-12T17:04:50.769 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.763+0000 7f026be9d8c0 1 > prepared part key=_multipart_SGT8IC1GJ3IG.2~QPDMQZJ5CJ0V.2 size=142769 2024-09-12T17:04:50.770 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.763+0000 7f026be9d8c0 1 > prepared multipart upload key=SGT8IC1GJ3IG upload=QPDMQZJ5CJ0V tag=7NAM51DTTSHQ type=write size=3288497 2024-09-12T17:04:50.772 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.767+0000 7f026be9d8c0 1 < completed write operation key=ALFGNC1YNROX tag=0SB8XTB3XMB6 type=write size=360110 2024-09-12T17:04:50.775 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.771+0000 7f026be9d8c0 1 > prepared operation key=LHKLWIUAT08F tag=AWUXNZFMQ7LN type=del size=1238012 2024-09-12T17:04:50.780 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.775+0000 7f026be9d8c0 1 < suggested update operation key=SL2446KSB531 tag=6J790ZYYEWC3 type=write size=708516 2024-09-12T17:04:50.784 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.779+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~FMK3I8EF52P8.0 size=1048576 2024-09-12T17:04:50.786 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.783+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~FMK3I8EF52P8.1 size=639144 2024-09-12T17:04:50.786 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.783+0000 7f026be9d8c0 1 > prepared multipart upload key=SL2446KSB531 upload=FMK3I8EF52P8 tag=QLFQ0Z2RV0OP type=write size=2736296 2024-09-12T17:04:50.788 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.783+0000 7f026be9d8c0 1 < completed part key=_multipart_SGT8IC1GJ3IG.2~53LP9P46ISW9.0 size=1048576 2024-09-12T17:04:50.790 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.787+0000 7f026be9d8c0 1 < completed part key=_multipart_SGT8IC1GJ3IG.2~53LP9P46ISW9.1 size=679520 2024-09-12T17:04:50.794 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.791+0000 7f026be9d8c0 1 < completed multipart upload key=SGT8IC1GJ3IG upload=53LP9P46ISW9 tag=IU8795J484Q0 type=write size=2776672 2024-09-12T17:04:50.799 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.795+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z183NH6R676V.2~XK3M58SI8MYM.0 size=1048576 2024-09-12T17:04:50.801 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.795+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z183NH6R676V.2~XK3M58SI8MYM.1 size=1048576 2024-09-12T17:04:50.802 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.799+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z183NH6R676V.2~XK3M58SI8MYM.2 size=423108 2024-09-12T17:04:50.802 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.799+0000 7f026be9d8c0 1 > prepared multipart upload key=Z183NH6R676V upload=XK3M58SI8MYM tag=Q48N8AS3H61N type=write size=3568836 2024-09-12T17:04:50.806 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.803+0000 7f026be9d8c0 1 < completed delete operation key=Z9YNIEQCVNBA tag=IYBM6Y3YHD3P type=del 2024-09-12T17:04:50.812 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.807+0000 7f026be9d8c0 1 > prepared part key=_multipart_3JADN360QEO3.2~0KWQ18JLSL9M.0 size=359387 2024-09-12T17:04:50.812 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.807+0000 7f026be9d8c0 1 > prepared multipart upload key=3JADN360QEO3 upload=0KWQ18JLSL9M tag=LE0E8KU3QJXQ type=write size=1407963 2024-09-12T17:04:50.815 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.811+0000 7f026be9d8c0 1 < completed delete operation key=6VO85REZG2NW tag=6IN5ARJPGA67 type=del 2024-09-12T17:04:50.818 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.815+0000 7f026be9d8c0 1 > prepared operation key=LHKLWIUAT08F tag=VULSFRTJ1AEL type=write size=1033080 2024-09-12T17:04:50.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.815+0000 7f026be9d8c0 1 < completed part key=_multipart_RBNN03IPZ8BT.2~WDO3FKFXQ0VK.0 size=1048576 2024-09-12T17:04:50.823 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.819+0000 7f026be9d8c0 1 < completed part key=_multipart_RBNN03IPZ8BT.2~WDO3FKFXQ0VK.1 size=1048576 2024-09-12T17:04:50.825 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.819+0000 7f026be9d8c0 1 < completed part key=_multipart_RBNN03IPZ8BT.2~WDO3FKFXQ0VK.2 size=19599 2024-09-12T17:04:50.830 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.823+0000 7f026be9d8c0 1 < completed multipart upload key=RBNN03IPZ8BT upload=WDO3FKFXQ0VK tag=3JHSP2TXUP6D type=write size=3165327 2024-09-12T17:04:50.834 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.831+0000 7f026be9d8c0 1 > prepared operation key=ALFGNC1YNROX tag=NHBOIMKHBTAM type=write size=286097 2024-09-12T17:04:50.837 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.831+0000 7f026be9d8c0 1 < completed part key=_multipart_LHKLWIUAT08F.2~JAXWFA73YH1R.0 size=483437 2024-09-12T17:04:50.842 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.839+0000 7f026be9d8c0 1 < completed multipart upload key=LHKLWIUAT08F upload=JAXWFA73YH1R tag=RLFOC4WN7HSW type=write size=1532013 2024-09-12T17:04:50.845 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.839+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=ROIXXQX9RT77 type=del size=3003769 2024-09-12T17:04:50.848 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.843+0000 7f026be9d8c0 1 < completed delete operation key=SO3HLQZA8B6B tag=YDQQYJ7IKRT7 type=del 2024-09-12T17:04:50.851 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.847+0000 7f026be9d8c0 1 > prepared operation key=J8MU1A0CWSAQ tag=VGS4D2ZWX6OQ type=del size=3669873 2024-09-12T17:04:50.854 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.851+0000 7f026be9d8c0 1 < completed delete operation key=4G3BKGNT3YZC tag=ZTP9RP79P7NH type=del 2024-09-12T17:04:50.857 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.851+0000 7f026be9d8c0 1 > prepared operation key=8AFDAVJLMRD2 tag=G0E4EBILBL3B type=del size=1609273 2024-09-12T17:04:50.859 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.855+0000 7f026be9d8c0 1 < completed part key=_multipart_L194KQIPFLE1.2~019PU4PK0UW0.0 size=1048576 2024-09-12T17:04:50.861 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.855+0000 7f026be9d8c0 1 < completed part key=_multipart_L194KQIPFLE1.2~019PU4PK0UW0.1 size=45957 2024-09-12T17:04:50.867 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.863+0000 7f026be9d8c0 1 < completed multipart upload key=L194KQIPFLE1 upload=019PU4PK0UW0 tag=1VAA79EN09Y4 type=write size=2143109 2024-09-12T17:04:50.872 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.867+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~4BU3OLY835FN.0 size=928946 2024-09-12T17:04:50.872 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.867+0000 7f026be9d8c0 1 > prepared multipart upload key=8AFDAVJLMRD2 upload=4BU3OLY835FN tag=C3G6DVHG3WWD type=write size=1977522 2024-09-12T17:04:50.875 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.871+0000 7f026be9d8c0 1 < completed delete operation key=QVQ4TI319DH5 tag=BSJGB3QF2FBN type=del 2024-09-12T17:04:50.878 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.875+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=NT2BQZG962GP type=del size=4086162 2024-09-12T17:04:50.881 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.875+0000 7f026be9d8c0 1 < completed delete operation key=8AFDAVJLMRD2 tag=FFZJU6CMNOOC type=del 2024-09-12T17:04:50.887 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.883+0000 7f026be9d8c0 1 > prepared part key=_multipart_PQSQ39X3O64P.2~8JFKLIAJS6C8.0 size=26556 2024-09-12T17:04:50.887 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.883+0000 7f026be9d8c0 1 > prepared multipart upload key=PQSQ39X3O64P upload=8JFKLIAJS6C8 tag=2UNK8AYFLOV2 type=write size=1075132 2024-09-12T17:04:50.890 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.887+0000 7f026be9d8c0 1 < completed part key=_multipart_6VO85REZG2NW.2~2BH932XPVEN6.0 size=638484 2024-09-12T17:04:50.894 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.891+0000 7f026be9d8c0 1 < completed multipart upload key=6VO85REZG2NW upload=2BH932XPVEN6 tag=W88AYCX2DLMP type=write size=1687060 2024-09-12T17:04:50.897 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.891+0000 7f026be9d8c0 1 > prepared operation key=Y27CDEOCM7DH tag=ZXWVUUVHHHPH type=del size=1136999 2024-09-12T17:04:50.900 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.895+0000 7f026be9d8c0 1 < completed part key=_multipart_LHKLWIUAT08F.2~O1O39OC2T2DM.0 size=1048576 2024-09-12T17:04:50.902 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.899+0000 7f026be9d8c0 1 < completed part key=_multipart_LHKLWIUAT08F.2~O1O39OC2T2DM.1 size=496205 2024-09-12T17:04:50.907 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.903+0000 7f026be9d8c0 1 < completed multipart upload key=LHKLWIUAT08F upload=O1O39OC2T2DM tag=F597WNSQ72K1 type=write size=2593357 2024-09-12T17:04:50.910 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.907+0000 7f026be9d8c0 1 > prepared operation key=L194KQIPFLE1 tag=OIP3BGO0P95K type=del size=162622 2024-09-12T17:04:50.913 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.907+0000 7f026be9d8c0 1 < completed part key=_multipart_SGT8IC1GJ3IG.2~KK9TBL5DFEZ3.0 size=1048576 2024-09-12T17:04:50.915 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.911+0000 7f026be9d8c0 1 < completed part key=_multipart_SGT8IC1GJ3IG.2~KK9TBL5DFEZ3.1 size=529526 2024-09-12T17:04:50.920 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.915+0000 7f026be9d8c0 1 < completed multipart upload key=SGT8IC1GJ3IG upload=KK9TBL5DFEZ3 tag=C72N442C7AAJ type=write size=2626678 2024-09-12T17:04:50.925 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.919+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~RP8TOE8IPEND.0 size=1048576 2024-09-12T17:04:50.928 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.923+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~RP8TOE8IPEND.1 size=908750 2024-09-12T17:04:50.928 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.923+0000 7f026be9d8c0 1 > prepared multipart upload key=XLKR6P8RNRVO upload=RP8TOE8IPEND tag=UB25P8EL60XP type=write size=3005902 2024-09-12T17:04:50.931 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.927+0000 7f026be9d8c0 1 < completed part key=_multipart_SGT8IC1GJ3IG.2~QPDMQZJ5CJ0V.0 size=1048576 2024-09-12T17:04:50.933 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.927+0000 7f026be9d8c0 1 < completed part key=_multipart_SGT8IC1GJ3IG.2~QPDMQZJ5CJ0V.1 size=1048576 2024-09-12T17:04:50.935 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.931+0000 7f026be9d8c0 1 < completed part key=_multipart_SGT8IC1GJ3IG.2~QPDMQZJ5CJ0V.2 size=142769 2024-09-12T17:04:50.941 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.935+0000 7f026be9d8c0 1 < completed multipart upload key=SGT8IC1GJ3IG upload=QPDMQZJ5CJ0V tag=7NAM51DTTSHQ type=write size=3288497 2024-09-12T17:04:50.944 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.939+0000 7f026be9d8c0 1 > prepared operation key=8AFDAVJLMRD2 tag=UJUTX3Z0VNRD type=del size=3532637 2024-09-12T17:04:50.946 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.943+0000 7f026be9d8c0 1 < completed delete operation key=LHKLWIUAT08F tag=AWUXNZFMQ7LN type=del 2024-09-12T17:04:50.949 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.943+0000 7f026be9d8c0 1 > prepared operation key=4U1W97V0OX11 tag=BBQBRSNH4HWJ type=del size=542484 2024-09-12T17:04:50.952 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.947+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~FMK3I8EF52P8.0 size=1048576 2024-09-12T17:04:50.955 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.951+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~FMK3I8EF52P8.1 size=639144 2024-09-12T17:04:50.960 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.955+0000 7f026be9d8c0 1 < completed multipart upload key=SL2446KSB531 upload=FMK3I8EF52P8 tag=QLFQ0Z2RV0OP type=write size=2736296 2024-09-12T17:04:50.964 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.959+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=J09EGDW9C8KT type=del size=12626 2024-09-12T17:04:50.967 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.963+0000 7f026be9d8c0 1 < completed part key=_multipart_Z183NH6R676V.2~XK3M58SI8MYM.0 size=1048576 2024-09-12T17:04:50.972 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.967+0000 7f026be9d8c0 1 < completed part key=_multipart_Z183NH6R676V.2~XK3M58SI8MYM.1 size=1048576 2024-09-12T17:04:50.975 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.971+0000 7f026be9d8c0 1 < completed part key=_multipart_Z183NH6R676V.2~XK3M58SI8MYM.2 size=423108 2024-09-12T17:04:50.980 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.975+0000 7f026be9d8c0 1 < completed multipart upload key=Z183NH6R676V upload=XK3M58SI8MYM tag=Q48N8AS3H61N type=write size=3568836 2024-09-12T17:04:50.986 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.983+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~H4ELC9P6PBTC.0 size=1048576 2024-09-12T17:04:50.988 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.983+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~H4ELC9P6PBTC.1 size=1048576 2024-09-12T17:04:50.991 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.987+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~H4ELC9P6PBTC.2 size=926696 2024-09-12T17:04:50.991 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.987+0000 7f026be9d8c0 1 > prepared multipart upload key=2BQJ30RQQ25L upload=H4ELC9P6PBTC tag=MZE2SUFWKPFO type=write size=4072424 2024-09-12T17:04:50.994 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.991+0000 7f026be9d8c0 1 < completed part key=_multipart_3JADN360QEO3.2~0KWQ18JLSL9M.0 size=359387 2024-09-12T17:04:50.999 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.995+0000 7f026be9d8c0 1 < completed multipart upload key=3JADN360QEO3 upload=0KWQ18JLSL9M tag=LE0E8KU3QJXQ type=write size=1407963 2024-09-12T17:04:51.005 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.999+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~7CQJI8CVVA7Q.0 size=365133 2024-09-12T17:04:51.005 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:50.999+0000 7f026be9d8c0 1 > prepared multipart upload key=UU88OS653L8D upload=7CQJI8CVVA7Q tag=NCUM7Z8AM3DI type=write size=1413709 2024-09-12T17:04:51.008 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.003+0000 7f026be9d8c0 1 < completed write operation key=LHKLWIUAT08F tag=VULSFRTJ1AEL type=write size=1033080 2024-09-12T17:04:51.012 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.007+0000 7f026be9d8c0 1 > prepared operation key=Z183NH6R676V tag=0R6LHN7F727E type=del size=2827766 2024-09-12T17:04:51.015 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.011+0000 7f026be9d8c0 1 < canceled operation key=ALFGNC1YNROX tag=NHBOIMKHBTAM type=write size=286097 2024-09-12T17:04:51.018 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.015+0000 7f026be9d8c0 1 > prepared operation key=Y27CDEOCM7DH tag=BM89HY0KC3EX type=del size=3762487 2024-09-12T17:04:51.025 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.019+0000 7f026be9d8c0 1 < suggested remove operation key=RBNN03IPZ8BT tag=ROIXXQX9RT77 type=del 2024-09-12T17:04:51.028 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.023+0000 7f026be9d8c0 1 > prepared operation key=E0Y3SKNUYCQS tag=UL3U59FCOOG5 type=del size=2331901 2024-09-12T17:04:51.031 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.027+0000 7f026be9d8c0 1 < completed delete operation key=J8MU1A0CWSAQ tag=VGS4D2ZWX6OQ type=del 2024-09-12T17:04:51.034 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.031+0000 7f026be9d8c0 1 > prepared operation key=JJMEQ2O00SA2 tag=89RCVBON1IB9 type=del size=2819512 2024-09-12T17:04:51.038 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.035+0000 7f026be9d8c0 1 < completed delete operation key=8AFDAVJLMRD2 tag=G0E4EBILBL3B type=del 2024-09-12T17:04:51.044 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.039+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~37VVTDONRK1W.0 size=976952 2024-09-12T17:04:51.044 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.039+0000 7f026be9d8c0 1 > prepared multipart upload key=XLKR6P8RNRVO upload=37VVTDONRK1W tag=ASJNORYY486T type=write size=2025528 2024-09-12T17:04:51.047 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.043+0000 7f026be9d8c0 1 < completed part key=_multipart_8AFDAVJLMRD2.2~4BU3OLY835FN.0 size=928946 2024-09-12T17:04:51.051 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.047+0000 7f026be9d8c0 1 < completed multipart upload key=8AFDAVJLMRD2 upload=4BU3OLY835FN tag=C3G6DVHG3WWD type=write size=1977522 2024-09-12T17:04:51.057 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.051+0000 7f026be9d8c0 1 > prepared part key=_multipart_3JADN360QEO3.2~5GV1YT8OJJ8M.0 size=1048576 2024-09-12T17:04:51.059 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.055+0000 7f026be9d8c0 1 > prepared part key=_multipart_3JADN360QEO3.2~5GV1YT8OJJ8M.1 size=1048576 2024-09-12T17:04:51.061 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.055+0000 7f026be9d8c0 1 > prepared part key=_multipart_3JADN360QEO3.2~5GV1YT8OJJ8M.2 size=70702 2024-09-12T17:04:51.061 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.055+0000 7f026be9d8c0 1 > prepared multipart upload key=3JADN360QEO3 upload=5GV1YT8OJJ8M tag=9RN6B8W6N6FG type=write size=3216430 2024-09-12T17:04:51.064 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.059+0000 7f026be9d8c0 1 < completed delete operation key=21ZD52VBZIO4 tag=NT2BQZG962GP type=del 2024-09-12T17:04:51.067 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.063+0000 7f026be9d8c0 1 > prepared operation key=GPUFWJ3AWEMX tag=LB3MT01DBPI1 type=del size=512462 2024-09-12T17:04:51.070 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.067+0000 7f026be9d8c0 1 < completed part key=_multipart_PQSQ39X3O64P.2~8JFKLIAJS6C8.0 size=26556 2024-09-12T17:04:51.076 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.071+0000 7f026be9d8c0 1 < completed multipart upload key=PQSQ39X3O64P upload=8JFKLIAJS6C8 tag=2UNK8AYFLOV2 type=write size=1075132 2024-09-12T17:04:51.079 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.075+0000 7f026be9d8c0 1 > prepared operation key=XLKR6P8RNRVO tag=FM82C9TRZ2Q7 type=del size=3355073 2024-09-12T17:04:51.081 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.075+0000 7f026be9d8c0 1 < completed delete operation key=Y27CDEOCM7DH tag=ZXWVUUVHHHPH type=del 2024-09-12T17:04:51.084 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.079+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=K6QWK8XMSWKG type=del size=3610477 2024-09-12T17:04:51.089 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.083+0000 7f026be9d8c0 1 < suggested remove operation key=L194KQIPFLE1 tag=OIP3BGO0P95K type=del 2024-09-12T17:04:51.094 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.091+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z183NH6R676V.2~BVHQOKIF1OYQ.0 size=1048576 2024-09-12T17:04:51.096 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.091+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z183NH6R676V.2~BVHQOKIF1OYQ.1 size=153332 2024-09-12T17:04:51.096 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.091+0000 7f026be9d8c0 1 > prepared multipart upload key=Z183NH6R676V upload=BVHQOKIF1OYQ tag=O63P6Q3T7T02 type=write size=2250484 2024-09-12T17:04:51.099 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.095+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~RP8TOE8IPEND.0 size=1048576 2024-09-12T17:04:51.102 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.095+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~RP8TOE8IPEND.1 size=908750 2024-09-12T17:04:51.106 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.103+0000 7f026be9d8c0 1 < completed multipart upload key=XLKR6P8RNRVO upload=RP8TOE8IPEND tag=UB25P8EL60XP type=write size=3005902 2024-09-12T17:04:51.109 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.103+0000 7f026be9d8c0 1 > prepared operation key=XLKR6P8RNRVO tag=I8VRFRTG14TP type=del size=3673129 2024-09-12T17:04:51.112 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.107+0000 7f026be9d8c0 1 < completed delete operation key=8AFDAVJLMRD2 tag=UJUTX3Z0VNRD type=del 2024-09-12T17:04:51.115 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.111+0000 7f026be9d8c0 1 > prepared operation key=XNBE2II106VZ tag=J6X55FUTES4F type=del size=3026048 2024-09-12T17:04:51.118 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.115+0000 7f026be9d8c0 1 < completed delete operation key=4U1W97V0OX11 tag=BBQBRSNH4HWJ type=del 2024-09-12T17:04:51.123 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.119+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~M9JCK532293M.0 size=1048576 2024-09-12T17:04:51.130 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.123+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~M9JCK532293M.1 size=1048576 2024-09-12T17:04:51.130 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.123+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~M9JCK532293M.2 size=296749 2024-09-12T17:04:51.130 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.123+0000 7f026be9d8c0 1 > prepared multipart upload key=32XUMOWT8HO2 upload=M9JCK532293M tag=T0NQZKZPEW7H type=write size=3442477 2024-09-12T17:04:51.132 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.127+0000 7f026be9d8c0 1 < completed delete operation key=3JADN360QEO3 tag=J09EGDW9C8KT type=del 2024-09-12T17:04:51.136 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.131+0000 7f026be9d8c0 1 > prepared operation key=8AFDAVJLMRD2 tag=LPT9Z9WWCOBW type=del size=2034022 2024-09-12T17:04:51.140 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.135+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~H4ELC9P6PBTC.0 size=1048576 2024-09-12T17:04:51.142 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.139+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~H4ELC9P6PBTC.1 size=1048576 2024-09-12T17:04:51.145 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.139+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~H4ELC9P6PBTC.2 size=926696 2024-09-12T17:04:51.149 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.143+0000 7f026be9d8c0 1 < completed multipart upload key=2BQJ30RQQ25L upload=H4ELC9P6PBTC tag=MZE2SUFWKPFO type=write size=4072424 2024-09-12T17:04:51.154 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.151+0000 7f026be9d8c0 1 > prepared part key=_multipart_L194KQIPFLE1.2~QCTCJB4BZDG1.0 size=1048576 2024-09-12T17:04:51.156 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.151+0000 7f026be9d8c0 1 > prepared part key=_multipart_L194KQIPFLE1.2~QCTCJB4BZDG1.1 size=1048576 2024-09-12T17:04:51.159 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.155+0000 7f026be9d8c0 1 > prepared part key=_multipart_L194KQIPFLE1.2~QCTCJB4BZDG1.2 size=710848 2024-09-12T17:04:51.159 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.155+0000 7f026be9d8c0 1 > prepared multipart upload key=L194KQIPFLE1 upload=QCTCJB4BZDG1 tag=KWMPPK5H1WXJ type=write size=3856576 2024-09-12T17:04:51.161 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.155+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~7CQJI8CVVA7Q.0 size=365133 2024-09-12T17:04:51.166 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.163+0000 7f026be9d8c0 1 < completed multipart upload key=UU88OS653L8D upload=7CQJI8CVVA7Q tag=NCUM7Z8AM3DI type=write size=1413709 2024-09-12T17:04:51.169 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.163+0000 7f026be9d8c0 1 > prepared operation key=Z183NH6R676V tag=QI0UCEDWTOAD type=write size=611019 2024-09-12T17:04:51.172 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.167+0000 7f026be9d8c0 1 < completed delete operation key=Z183NH6R676V tag=0R6LHN7F727E type=del 2024-09-12T17:04:51.177 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.171+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~05LIJSHPMSYI.0 size=1048576 2024-09-12T17:04:51.179 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.175+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~05LIJSHPMSYI.1 size=1048576 2024-09-12T17:04:51.182 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.175+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~05LIJSHPMSYI.2 size=618648 2024-09-12T17:04:51.182 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.175+0000 7f026be9d8c0 1 > prepared multipart upload key=Y27CDEOCM7DH upload=05LIJSHPMSYI tag=AVUZKJ7ABGH2 type=write size=3764376 2024-09-12T17:04:51.184 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.179+0000 7f026be9d8c0 1 < completed delete operation key=Y27CDEOCM7DH tag=BM89HY0KC3EX type=del 2024-09-12T17:04:51.190 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.183+0000 7f026be9d8c0 1 > prepared part key=_multipart_RBNN03IPZ8BT.2~JNNFLALGSEYF.0 size=851514 2024-09-12T17:04:51.190 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.183+0000 7f026be9d8c0 1 > prepared multipart upload key=RBNN03IPZ8BT upload=JNNFLALGSEYF tag=ZBDHX9SDHKXG type=write size=1900090 2024-09-12T17:04:51.192 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.187+0000 7f026be9d8c0 1 < completed delete operation key=E0Y3SKNUYCQS tag=UL3U59FCOOG5 type=del 2024-09-12T17:04:51.198 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.195+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~MKIMZKUUSABV.0 size=769375 2024-09-12T17:04:51.198 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.195+0000 7f026be9d8c0 1 > prepared multipart upload key=JJMEQ2O00SA2 upload=MKIMZKUUSABV tag=JR310ZZGAI0T type=write size=1817951 2024-09-12T17:04:51.201 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.195+0000 7f026be9d8c0 1 < completed delete operation key=JJMEQ2O00SA2 tag=89RCVBON1IB9 type=del 2024-09-12T17:04:51.204 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.199+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=VMPU7VI6EN4G type=del size=2566740 2024-09-12T17:04:51.204 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.199+0000 7f026be9d8c0 1 < canceled part key=_multipart_XLKR6P8RNRVO.2~37VVTDONRK1W.0 size=976952 2024-09-12T17:04:51.209 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.203+0000 7f026be9d8c0 1 < canceled multipart upload key=XLKR6P8RNRVO upload=37VVTDONRK1W tag=ASJNORYY486T type=write size=2025528 2024-09-12T17:04:51.212 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.207+0000 7f026be9d8c0 1 > prepared operation key=Z9YNIEQCVNBA tag=T6P2ST6OV63E type=write size=563937 2024-09-12T17:04:51.215 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.211+0000 7f026be9d8c0 1 < completed part key=_multipart_3JADN360QEO3.2~5GV1YT8OJJ8M.0 size=1048576 2024-09-12T17:04:51.215 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.211+0000 7f026be9d8c0 1 < canceled part key=_multipart_3JADN360QEO3.2~5GV1YT8OJJ8M.1 size=1048576 2024-09-12T17:04:51.217 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.211+0000 7f026be9d8c0 1 < completed part key=_multipart_3JADN360QEO3.2~5GV1YT8OJJ8M.2 size=70702 2024-09-12T17:04:51.221 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.215+0000 7f026be9d8c0 1 < canceled multipart upload key=3JADN360QEO3 upload=5GV1YT8OJJ8M tag=9RN6B8W6N6FG type=write size=3216430 2024-09-12T17:04:51.225 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.219+0000 7f026be9d8c0 1 > prepared operation key=Z9YNIEQCVNBA tag=9AACRCAMXRXL type=del size=2839124 2024-09-12T17:04:51.227 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.223+0000 7f026be9d8c0 1 < completed delete operation key=GPUFWJ3AWEMX tag=LB3MT01DBPI1 type=del 2024-09-12T17:04:51.230 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.223+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=1VKXW9SUXRGE type=del size=2836463 2024-09-12T17:04:51.233 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.227+0000 7f026be9d8c0 1 < completed delete operation key=XLKR6P8RNRVO tag=FM82C9TRZ2Q7 type=del 2024-09-12T17:04:51.237 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.231+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~5GA1SIE2SY1Q.0 size=1048576 2024-09-12T17:04:51.240 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.235+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~5GA1SIE2SY1Q.1 size=1048576 2024-09-12T17:04:51.242 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.239+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~5GA1SIE2SY1Q.2 size=518638 2024-09-12T17:04:51.242 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.239+0000 7f026be9d8c0 1 > prepared multipart upload key=Y27CDEOCM7DH upload=5GA1SIE2SY1Q tag=R0N11ED3EN68 type=write size=3664366 2024-09-12T17:04:51.247 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.243+0000 7f026be9d8c0 1 < completed delete operation key=RBNN03IPZ8BT tag=K6QWK8XMSWKG type=del 2024-09-12T17:04:51.249 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.243+0000 7f026be9d8c0 1 > prepared operation key=XLKR6P8RNRVO tag=LHL78DZRR3WQ type=write size=767409 2024-09-12T17:04:51.250 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.247+0000 7f026be9d8c0 1 < canceled part key=_multipart_Z183NH6R676V.2~BVHQOKIF1OYQ.0 size=1048576 2024-09-12T17:04:51.252 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.247+0000 7f026be9d8c0 1 < completed part key=_multipart_Z183NH6R676V.2~BVHQOKIF1OYQ.1 size=153332 2024-09-12T17:04:51.257 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.251+0000 7f026be9d8c0 1 < canceled multipart upload key=Z183NH6R676V upload=BVHQOKIF1OYQ tag=O63P6Q3T7T02 type=write size=2250484 2024-09-12T17:04:51.259 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.255+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=M7N9DW7EBFX9 type=del size=916550 2024-09-12T17:04:51.262 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.255+0000 7f026be9d8c0 1 < completed delete operation key=XLKR6P8RNRVO tag=I8VRFRTG14TP type=del 2024-09-12T17:04:51.267 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.263+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~83Y9TR3YMGN8.0 size=346939 2024-09-12T17:04:51.267 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.263+0000 7f026be9d8c0 1 > prepared multipart upload key=8AFDAVJLMRD2 upload=83Y9TR3YMGN8 tag=KWBB19FNRR3D type=write size=1395515 2024-09-12T17:04:51.270 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.263+0000 7f026be9d8c0 1 < canceled operation key=XNBE2II106VZ tag=J6X55FUTES4F type=del size=3026048 2024-09-12T17:04:51.272 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.267+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=WCI6ND1WL86C type=del size=777031 2024-09-12T17:04:51.275 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.271+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~M9JCK532293M.0 size=1048576 2024-09-12T17:04:51.277 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.271+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~M9JCK532293M.1 size=1048576 2024-09-12T17:04:51.280 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.275+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~M9JCK532293M.2 size=296749 2024-09-12T17:04:51.284 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.279+0000 7f026be9d8c0 1 < completed multipart upload key=32XUMOWT8HO2 upload=M9JCK532293M tag=T0NQZKZPEW7H type=write size=3442477 2024-09-12T17:04:51.289 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.283+0000 7f026be9d8c0 1 > prepared part key=_multipart_3JADN360QEO3.2~H2XJUHMMFEZ0.0 size=1048576 2024-09-12T17:04:51.291 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.287+0000 7f026be9d8c0 1 > prepared part key=_multipart_3JADN360QEO3.2~H2XJUHMMFEZ0.1 size=1048576 2024-09-12T17:04:51.294 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.287+0000 7f026be9d8c0 1 > prepared part key=_multipart_3JADN360QEO3.2~H2XJUHMMFEZ0.2 size=53110 2024-09-12T17:04:51.294 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.287+0000 7f026be9d8c0 1 > prepared multipart upload key=3JADN360QEO3 upload=H2XJUHMMFEZ0 tag=VJHIJ5K7IEHD type=write size=3198838 2024-09-12T17:04:51.297 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.291+0000 7f026be9d8c0 1 < canceled operation key=8AFDAVJLMRD2 tag=LPT9Z9WWCOBW type=del size=2034022 2024-09-12T17:04:51.300 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.295+0000 7f026be9d8c0 1 > prepared operation key=GPUFWJ3AWEMX tag=40TZE8K6RB8O type=write size=989019 2024-09-12T17:04:51.304 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.299+0000 7f026be9d8c0 1 < completed part key=_multipart_L194KQIPFLE1.2~QCTCJB4BZDG1.0 size=1048576 2024-09-12T17:04:51.307 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.303+0000 7f026be9d8c0 1 < completed part key=_multipart_L194KQIPFLE1.2~QCTCJB4BZDG1.1 size=1048576 2024-09-12T17:04:51.309 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.303+0000 7f026be9d8c0 1 < completed part key=_multipart_L194KQIPFLE1.2~QCTCJB4BZDG1.2 size=710848 2024-09-12T17:04:51.315 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.311+0000 7f026be9d8c0 1 < completed multipart upload key=L194KQIPFLE1 upload=QCTCJB4BZDG1 tag=KWMPPK5H1WXJ type=write size=3856576 2024-09-12T17:04:51.321 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.315+0000 7f026be9d8c0 1 > prepared part key=_multipart_BBYDPSXZKHZP.2~LRZHXWNJGA7A.0 size=1048576 2024-09-12T17:04:51.324 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.319+0000 7f026be9d8c0 1 > prepared part key=_multipart_BBYDPSXZKHZP.2~LRZHXWNJGA7A.1 size=1048576 2024-09-12T17:04:51.329 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.323+0000 7f026be9d8c0 1 > prepared part key=_multipart_BBYDPSXZKHZP.2~LRZHXWNJGA7A.2 size=854389 2024-09-12T17:04:51.329 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.323+0000 7f026be9d8c0 1 > prepared multipart upload key=BBYDPSXZKHZP upload=LRZHXWNJGA7A tag=ZV1YNQ8CET2G type=write size=4000117 2024-09-12T17:04:51.330 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.327+0000 7f026be9d8c0 1 < completed write operation key=Z183NH6R676V tag=QI0UCEDWTOAD type=write size=611019 2024-09-12T17:04:51.333 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.327+0000 7f026be9d8c0 1 > prepared operation key=L194KQIPFLE1 tag=WUQ8FBQ4WLUF type=del size=2793457 2024-09-12T17:04:51.337 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.331+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~05LIJSHPMSYI.0 size=1048576 2024-09-12T17:04:51.337 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.331+0000 7f026be9d8c0 1 < canceled part key=_multipart_Y27CDEOCM7DH.2~05LIJSHPMSYI.1 size=1048576 2024-09-12T17:04:51.337 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.331+0000 7f026be9d8c0 1 < canceled part key=_multipart_Y27CDEOCM7DH.2~05LIJSHPMSYI.2 size=618648 2024-09-12T17:04:51.342 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.339+0000 7f026be9d8c0 1 < canceled multipart upload key=Y27CDEOCM7DH upload=05LIJSHPMSYI tag=AVUZKJ7ABGH2 type=write size=3764376 2024-09-12T17:04:51.345 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.339+0000 7f026be9d8c0 1 > prepared operation key=LHKLWIUAT08F tag=Q1HAHN5T7QK1 type=del size=3104236 2024-09-12T17:04:51.349 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.343+0000 7f026be9d8c0 1 < completed part key=_multipart_RBNN03IPZ8BT.2~JNNFLALGSEYF.0 size=851514 2024-09-12T17:04:51.354 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.351+0000 7f026be9d8c0 1 < completed multipart upload key=RBNN03IPZ8BT upload=JNNFLALGSEYF tag=ZBDHX9SDHKXG type=write size=1900090 2024-09-12T17:04:51.358 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.351+0000 7f026be9d8c0 1 > prepared operation key=SGT8IC1GJ3IG tag=8A1Y3FN3D6XO type=del size=353180 2024-09-12T17:04:51.361 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.355+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~MKIMZKUUSABV.0 size=769375 2024-09-12T17:04:51.367 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.363+0000 7f026be9d8c0 1 < completed multipart upload key=JJMEQ2O00SA2 upload=MKIMZKUUSABV tag=JR310ZZGAI0T type=write size=1817951 2024-09-12T17:04:51.371 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.367+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=S28AME1LRNC1 type=del size=2404765 2024-09-12T17:04:51.374 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.371+0000 7f026be9d8c0 1 < completed delete operation key=U8W1SAVSLTBF tag=VMPU7VI6EN4G type=del 2024-09-12T17:04:51.378 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.375+0000 7f026be9d8c0 1 > prepared operation key=SL2446KSB531 tag=F4F8OOSUXPHD type=write size=866924 2024-09-12T17:04:51.382 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.379+0000 7f026be9d8c0 1 < canceled operation key=Z9YNIEQCVNBA tag=T6P2ST6OV63E type=write size=563937 2024-09-12T17:04:51.386 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.383+0000 7f026be9d8c0 1 > prepared operation key=LHKLWIUAT08F tag=B0Q2J2VUQRNP type=del size=1476931 2024-09-12T17:04:51.390 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.383+0000 7f026be9d8c0 1 < completed delete operation key=Z9YNIEQCVNBA tag=9AACRCAMXRXL type=del 2024-09-12T17:04:51.393 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.387+0000 7f026be9d8c0 1 > prepared operation key=L194KQIPFLE1 tag=NY9K3FOSXFGS type=del size=72577 2024-09-12T17:04:51.400 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.395+0000 7f026be9d8c0 1 < suggested remove operation key=21ZD52VBZIO4 tag=1VKXW9SUXRGE type=del 2024-09-12T17:04:51.403 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.399+0000 7f026be9d8c0 1 > prepared operation key=MVYWUWKSYQ9Z tag=GBO3509AU915 type=del size=1952149 2024-09-12T17:04:51.408 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.403+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~5GA1SIE2SY1Q.0 size=1048576 2024-09-12T17:04:51.410 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.407+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~5GA1SIE2SY1Q.1 size=1048576 2024-09-12T17:04:51.414 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.407+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~5GA1SIE2SY1Q.2 size=518638 2024-09-12T17:04:51.420 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.415+0000 7f026be9d8c0 1 < completed multipart upload key=Y27CDEOCM7DH upload=5GA1SIE2SY1Q tag=R0N11ED3EN68 type=write size=3664366 2024-09-12T17:04:51.423 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.419+0000 7f026be9d8c0 1 > prepared operation key=UU88OS653L8D tag=OJV6DJK82B96 type=write size=425865 2024-09-12T17:04:51.431 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.427+0000 7f026be9d8c0 1 < suggested update operation key=XLKR6P8RNRVO tag=LHL78DZRR3WQ type=write size=767409 2024-09-12T17:04:51.434 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.431+0000 7f026be9d8c0 1 > prepared operation key=ALFGNC1YNROX tag=8O3Q7SSLKHMT type=del size=656191 2024-09-12T17:04:51.436 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.431+0000 7f026be9d8c0 -1 < no bi entry to suggest for operation key=21ZD52VBZIO4 tag=M7N9DW7EBFX9 type=del size=916550: (2) No such file or directory 2024-09-12T17:04:51.440 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.435+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=FSHXORJ9JFXJ type=write size=582320 2024-09-12T17:04:51.443 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.439+0000 7f026be9d8c0 1 < completed part key=_multipart_8AFDAVJLMRD2.2~83Y9TR3YMGN8.0 size=346939 2024-09-12T17:04:51.449 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.443+0000 7f026be9d8c0 1 < completed multipart upload key=8AFDAVJLMRD2 upload=83Y9TR3YMGN8 tag=KWBB19FNRR3D type=write size=1395515 2024-09-12T17:04:51.456 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.451+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~T8WT58NMHYHI.0 size=419814 2024-09-12T17:04:51.456 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.451+0000 7f026be9d8c0 1 > prepared multipart upload key=XLKR6P8RNRVO upload=T8WT58NMHYHI tag=EMPHKSWBCJLU type=write size=1468390 2024-09-12T17:04:51.460 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.455+0000 7f026be9d8c0 1 < completed delete operation key=RBNN03IPZ8BT tag=WCI6ND1WL86C type=del 2024-09-12T17:04:51.466 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.463+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~9Y2CT9AZ5VKD.0 size=422957 2024-09-12T17:04:51.467 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.463+0000 7f026be9d8c0 1 > prepared multipart upload key=8AFDAVJLMRD2 upload=9Y2CT9AZ5VKD tag=8T5KBG5H14AD type=write size=1471533 2024-09-12T17:04:51.467 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.463+0000 7f026be9d8c0 1 < canceled part key=_multipart_3JADN360QEO3.2~H2XJUHMMFEZ0.0 size=1048576 2024-09-12T17:04:51.470 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.463+0000 7f026be9d8c0 1 < completed part key=_multipart_3JADN360QEO3.2~H2XJUHMMFEZ0.1 size=1048576 2024-09-12T17:04:51.472 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.467+0000 7f026be9d8c0 1 < completed part key=_multipart_3JADN360QEO3.2~H2XJUHMMFEZ0.2 size=53110 2024-09-12T17:04:51.479 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.475+0000 7f026be9d8c0 1 < canceled multipart upload key=3JADN360QEO3 upload=H2XJUHMMFEZ0 tag=VJHIJ5K7IEHD type=write size=3198838 2024-09-12T17:04:51.486 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.479+0000 7f026be9d8c0 1 > prepared part key=_multipart_SGT8IC1GJ3IG.2~GJ7NBD64WDF4.0 size=1048576 2024-09-12T17:04:51.489 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.483+0000 7f026be9d8c0 1 > prepared part key=_multipart_SGT8IC1GJ3IG.2~GJ7NBD64WDF4.1 size=1048576 2024-09-12T17:04:51.491 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.487+0000 7f026be9d8c0 1 > prepared part key=_multipart_SGT8IC1GJ3IG.2~GJ7NBD64WDF4.2 size=348221 2024-09-12T17:04:51.492 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.487+0000 7f026be9d8c0 1 > prepared multipart upload key=SGT8IC1GJ3IG upload=GJ7NBD64WDF4 tag=RYIWK2WDVKT0 type=write size=3493949 2024-09-12T17:04:51.499 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.495+0000 7f026be9d8c0 1 < suggested remove operation key=GPUFWJ3AWEMX tag=40TZE8K6RB8O type=write 2024-09-12T17:04:51.502 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.499+0000 7f026be9d8c0 1 > prepared operation key=BW1T21LBUE2D tag=1HGNZ8OSIOOS type=write size=281760 2024-09-12T17:04:51.505 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.499+0000 7f026be9d8c0 1 < completed part key=_multipart_BBYDPSXZKHZP.2~LRZHXWNJGA7A.0 size=1048576 2024-09-12T17:04:51.507 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.503+0000 7f026be9d8c0 1 < completed part key=_multipart_BBYDPSXZKHZP.2~LRZHXWNJGA7A.1 size=1048576 2024-09-12T17:04:51.510 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.507+0000 7f026be9d8c0 1 < completed part key=_multipart_BBYDPSXZKHZP.2~LRZHXWNJGA7A.2 size=854389 2024-09-12T17:04:51.515 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.511+0000 7f026be9d8c0 1 < completed multipart upload key=BBYDPSXZKHZP upload=LRZHXWNJGA7A tag=ZV1YNQ8CET2G type=write size=4000117 2024-09-12T17:04:51.521 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.515+0000 7f026be9d8c0 1 > prepared part key=_multipart_T6QRDTQRHBPI.2~C8UHVCRE7258.0 size=1048576 2024-09-12T17:04:51.523 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.519+0000 7f026be9d8c0 1 > prepared part key=_multipart_T6QRDTQRHBPI.2~C8UHVCRE7258.1 size=1048576 2024-09-12T17:04:51.525 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.519+0000 7f026be9d8c0 1 > prepared part key=_multipart_T6QRDTQRHBPI.2~C8UHVCRE7258.2 size=426692 2024-09-12T17:04:51.526 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.519+0000 7f026be9d8c0 1 > prepared multipart upload key=T6QRDTQRHBPI upload=C8UHVCRE7258 tag=3TLVAV0NAMDV type=write size=3572420 2024-09-12T17:04:51.529 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.523+0000 7f026be9d8c0 1 < canceled operation key=L194KQIPFLE1 tag=WUQ8FBQ4WLUF type=del size=2793457 2024-09-12T17:04:51.532 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.527+0000 7f026be9d8c0 1 > prepared operation key=2BQJ30RQQ25L tag=5XM4Q1XPMLEX type=del size=1007997 2024-09-12T17:04:51.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.535+0000 7f026be9d8c0 1 < suggested remove operation key=LHKLWIUAT08F tag=Q1HAHN5T7QK1 type=del 2024-09-12T17:04:51.541 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.535+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=XBHYJCB43C99 type=del size=578137 2024-09-12T17:04:51.547 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.543+0000 7f026be9d8c0 1 < suggested update operation key=SGT8IC1GJ3IG tag=8A1Y3FN3D6XO type=del size=353180 2024-09-12T17:04:51.555 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.551+0000 7f026be9d8c0 1 > prepared part key=_multipart_3JADN360QEO3.2~HDOQXIEWEZK6.0 size=1048576 2024-09-12T17:04:51.557 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.551+0000 7f026be9d8c0 1 > prepared part key=_multipart_3JADN360QEO3.2~HDOQXIEWEZK6.1 size=652995 2024-09-12T17:04:51.557 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.551+0000 7f026be9d8c0 1 > prepared multipart upload key=3JADN360QEO3 upload=HDOQXIEWEZK6 tag=D2GUKRK76C0I type=write size=2750147 2024-09-12T17:04:51.561 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.555+0000 7f026be9d8c0 1 < completed delete operation key=RBNN03IPZ8BT tag=S28AME1LRNC1 type=del 2024-09-12T17:04:51.565 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.559+0000 7f026be9d8c0 1 > prepared operation key=ALFGNC1YNROX tag=6KXUU8XH06O2 type=del size=2328543 2024-09-12T17:04:51.568 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.563+0000 7f026be9d8c0 1 < completed write operation key=SL2446KSB531 tag=F4F8OOSUXPHD type=write size=866924 2024-09-12T17:04:51.572 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.567+0000 7f026be9d8c0 1 > prepared operation key=32XUMOWT8HO2 tag=3U6UJVS4T6Z1 type=del size=3025523 2024-09-12T17:04:51.575 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.571+0000 7f026be9d8c0 -1 < failed to complete operation key=LHKLWIUAT08F tag=B0Q2J2VUQRNP type=del size=1476931: (22) Invalid argument 2024-09-12T17:04:51.578 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.575+0000 7f026be9d8c0 1 > prepared operation key=E0Y3SKNUYCQS tag=UVGIFKXKPVY3 type=del size=2036047 2024-09-12T17:04:51.582 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.575+0000 7f026be9d8c0 1 < completed delete operation key=L194KQIPFLE1 tag=NY9K3FOSXFGS type=del 2024-09-12T17:04:51.585 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.579+0000 7f026be9d8c0 1 > prepared operation key=4G3BKGNT3YZC tag=C63G6O39FD7V type=del size=2710964 2024-09-12T17:04:51.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.583+0000 7f026be9d8c0 1 < completed delete operation key=MVYWUWKSYQ9Z tag=GBO3509AU915 type=del 2024-09-12T17:04:51.592 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.587+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=SH4IBRVNYDQM type=del size=799350 2024-09-12T17:04:51.595 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.591+0000 7f026be9d8c0 1 < completed write operation key=UU88OS653L8D tag=OJV6DJK82B96 type=write size=425865 2024-09-12T17:04:51.599 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.595+0000 7f026be9d8c0 1 > prepared operation key=BW1T21LBUE2D tag=4IGMSBL7SMTL type=del size=4150680 2024-09-12T17:04:51.603 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.599+0000 7f026be9d8c0 1 < completed delete operation key=ALFGNC1YNROX tag=8O3Q7SSLKHMT type=del 2024-09-12T17:04:51.606 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.603+0000 7f026be9d8c0 1 > prepared operation key=J8MU1A0CWSAQ tag=4UE6ITXGVE23 type=del size=1529618 2024-09-12T17:04:51.610 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.607+0000 7f026be9d8c0 1 < completed write operation key=3JADN360QEO3 tag=FSHXORJ9JFXJ type=write size=582320 2024-09-12T17:04:51.614 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.611+0000 7f026be9d8c0 1 > prepared operation key=BW1T21LBUE2D tag=DUWG1MA39I2B type=del size=2554897 2024-09-12T17:04:51.618 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.615+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~T8WT58NMHYHI.0 size=419814 2024-09-12T17:04:51.624 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.619+0000 7f026be9d8c0 1 < completed multipart upload key=XLKR6P8RNRVO upload=T8WT58NMHYHI tag=EMPHKSWBCJLU type=write size=1468390 2024-09-12T17:04:51.631 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.627+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~1C0KTZJEO9PU.0 size=232211 2024-09-12T17:04:51.631 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.627+0000 7f026be9d8c0 1 > prepared multipart upload key=UU88OS653L8D upload=1C0KTZJEO9PU tag=9XRXU08QEHDJ type=write size=1280787 2024-09-12T17:04:51.634 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.627+0000 7f026be9d8c0 1 < completed part key=_multipart_8AFDAVJLMRD2.2~9Y2CT9AZ5VKD.0 size=422957 2024-09-12T17:04:51.639 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.635+0000 7f026be9d8c0 1 < completed multipart upload key=8AFDAVJLMRD2 upload=9Y2CT9AZ5VKD tag=8T5KBG5H14AD type=write size=1471533 2024-09-12T17:04:51.642 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.639+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=T7YLHIYWOZGQ type=write size=924358 2024-09-12T17:04:51.646 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.639+0000 7f026be9d8c0 1 < completed part key=_multipart_SGT8IC1GJ3IG.2~GJ7NBD64WDF4.0 size=1048576 2024-09-12T17:04:51.648 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.643+0000 7f026be9d8c0 1 < completed part key=_multipart_SGT8IC1GJ3IG.2~GJ7NBD64WDF4.1 size=1048576 2024-09-12T17:04:51.650 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.647+0000 7f026be9d8c0 1 < completed part key=_multipart_SGT8IC1GJ3IG.2~GJ7NBD64WDF4.2 size=348221 2024-09-12T17:04:51.656 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.651+0000 7f026be9d8c0 1 < completed multipart upload key=SGT8IC1GJ3IG upload=GJ7NBD64WDF4 tag=RYIWK2WDVKT0 type=write size=3493949 2024-09-12T17:04:51.661 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.655+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~Q6IDHOVZ1KWK.0 size=1048576 2024-09-12T17:04:51.664 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.659+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~Q6IDHOVZ1KWK.1 size=93572 2024-09-12T17:04:51.664 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.659+0000 7f026be9d8c0 1 > prepared multipart upload key=Y27CDEOCM7DH upload=Q6IDHOVZ1KWK tag=94JZDFSGL6XG type=write size=2190724 2024-09-12T17:04:51.667 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.663+0000 7f026be9d8c0 1 < completed write operation key=BW1T21LBUE2D tag=1HGNZ8OSIOOS type=write size=281760 2024-09-12T17:04:51.671 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.667+0000 7f026be9d8c0 1 > prepared operation key=Z9YNIEQCVNBA tag=HJ3CAWTQ0FXY type=del size=4034974 2024-09-12T17:04:51.674 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.671+0000 7f026be9d8c0 1 < completed part key=_multipart_T6QRDTQRHBPI.2~C8UHVCRE7258.0 size=1048576 2024-09-12T17:04:51.674 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.671+0000 7f026be9d8c0 1 < canceled part key=_multipart_T6QRDTQRHBPI.2~C8UHVCRE7258.1 size=1048576 2024-09-12T17:04:51.677 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.671+0000 7f026be9d8c0 1 < completed part key=_multipart_T6QRDTQRHBPI.2~C8UHVCRE7258.2 size=426692 2024-09-12T17:04:51.689 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.683+0000 7f026be9d8c0 1 < canceled multipart upload key=T6QRDTQRHBPI upload=C8UHVCRE7258 tag=3TLVAV0NAMDV type=write size=3572420 2024-09-12T17:04:51.701 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.695+0000 7f026be9d8c0 1 > prepared operation key=SL2446KSB531 tag=CJDGGGHHS709 type=del size=1974400 2024-09-12T17:04:51.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.703+0000 7f026be9d8c0 1 < suggested update operation key=2BQJ30RQQ25L tag=5XM4Q1XPMLEX type=del size=1007997 2024-09-12T17:04:51.711 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.707+0000 7f026be9d8c0 1 > prepared operation key=T6QRDTQRHBPI tag=TUU19U7T3FDF type=del size=707241 2024-09-12T17:04:51.714 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.711+0000 7f026be9d8c0 1 < completed delete operation key=RBNN03IPZ8BT tag=XBHYJCB43C99 type=del 2024-09-12T17:04:51.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.711+0000 7f026be9d8c0 1 > prepared operation key=8AFDAVJLMRD2 tag=7IADSDJDSUFI type=write size=660600 2024-09-12T17:04:51.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.715+0000 7f026be9d8c0 1 < completed part key=_multipart_3JADN360QEO3.2~HDOQXIEWEZK6.0 size=1048576 2024-09-12T17:04:51.722 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.715+0000 7f026be9d8c0 1 < completed part key=_multipart_3JADN360QEO3.2~HDOQXIEWEZK6.1 size=652995 2024-09-12T17:04:51.726 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.723+0000 7f026be9d8c0 1 < completed multipart upload key=3JADN360QEO3 upload=HDOQXIEWEZK6 tag=D2GUKRK76C0I type=write size=2750147 2024-09-12T17:04:51.731 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.727+0000 7f026be9d8c0 1 > prepared part key=_multipart_SO3HLQZA8B6B.2~EN26MM5T9FC1.0 size=1048576 2024-09-12T17:04:51.734 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.727+0000 7f026be9d8c0 1 > prepared part key=_multipart_SO3HLQZA8B6B.2~EN26MM5T9FC1.1 size=503041 2024-09-12T17:04:51.734 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.727+0000 7f026be9d8c0 1 > prepared multipart upload key=SO3HLQZA8B6B upload=EN26MM5T9FC1 tag=6JD4AL647ZTZ type=write size=2600193 2024-09-12T17:04:51.736 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.731+0000 7f026be9d8c0 1 < completed delete operation key=ALFGNC1YNROX tag=6KXUU8XH06O2 type=del 2024-09-12T17:04:51.739 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.735+0000 7f026be9d8c0 1 > prepared operation key=E0Y3SKNUYCQS tag=P7JLGPHM7NZG type=del size=799764 2024-09-12T17:04:51.744 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.739+0000 7f026be9d8c0 1 < completed delete operation key=32XUMOWT8HO2 tag=3U6UJVS4T6Z1 type=del 2024-09-12T17:04:51.747 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.743+0000 7f026be9d8c0 1 > prepared part key=_multipart_U8W1SAVSLTBF.2~WQUYIIUXGQAJ.0 size=1048576 2024-09-12T17:04:51.749 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.743+0000 7f026be9d8c0 1 > prepared part key=_multipart_U8W1SAVSLTBF.2~WQUYIIUXGQAJ.1 size=469811 2024-09-12T17:04:51.750 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.743+0000 7f026be9d8c0 1 > prepared multipart upload key=U8W1SAVSLTBF upload=WQUYIIUXGQAJ tag=C63V3W0Y1V4B type=write size=2566963 2024-09-12T17:04:51.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.747+0000 7f026be9d8c0 1 < completed delete operation key=E0Y3SKNUYCQS tag=UVGIFKXKPVY3 type=del 2024-09-12T17:04:51.756 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.751+0000 7f026be9d8c0 1 > prepared operation key=BW1T21LBUE2D tag=EIUOTCMZ2QO8 type=del size=288393 2024-09-12T17:04:51.759 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.755+0000 7f026be9d8c0 1 < completed delete operation key=4G3BKGNT3YZC tag=C63G6O39FD7V type=del 2024-09-12T17:04:51.762 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.759+0000 7f026be9d8c0 1 > prepared operation key=GPUFWJ3AWEMX tag=B4QEMFWVIS13 type=del size=1594400 2024-09-12T17:04:51.765 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.759+0000 7f026be9d8c0 1 < completed delete operation key=21ZD52VBZIO4 tag=SH4IBRVNYDQM type=del 2024-09-12T17:04:51.768 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.763+0000 7f026be9d8c0 1 > prepared operation key=SGT8IC1GJ3IG tag=CCF0NSGAWFSG type=del size=3993036 2024-09-12T17:04:51.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.771+0000 7f026be9d8c0 1 < suggested remove operation key=BW1T21LBUE2D tag=4IGMSBL7SMTL type=del 2024-09-12T17:04:51.779 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.775+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z183NH6R676V.2~SJBN3N1CTC2Z.0 size=424637 2024-09-12T17:04:51.780 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.775+0000 7f026be9d8c0 1 > prepared multipart upload key=Z183NH6R676V upload=SJBN3N1CTC2Z tag=WLV30FZMHWYM type=write size=1473213 2024-09-12T17:04:51.783 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.779+0000 7f026be9d8c0 1 < completed delete operation key=J8MU1A0CWSAQ tag=4UE6ITXGVE23 type=del 2024-09-12T17:04:51.785 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.779+0000 7f026be9d8c0 1 > prepared operation key=PQSQ39X3O64P tag=I72FWAHW74GR type=write size=816907 2024-09-12T17:04:51.788 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.783+0000 7f026be9d8c0 -1 < failed to complete operation key=BW1T21LBUE2D tag=DUWG1MA39I2B type=del size=2554897: (22) Invalid argument 2024-09-12T17:04:51.793 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.787+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~HL96HJRYYYAE.0 size=1048576 2024-09-12T17:04:51.795 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.791+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~HL96HJRYYYAE.1 size=934180 2024-09-12T17:04:51.795 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.791+0000 7f026be9d8c0 1 > prepared multipart upload key=UU88OS653L8D upload=HL96HJRYYYAE tag=9COM5227O0CT type=write size=3031332 2024-09-12T17:04:51.798 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.795+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~1C0KTZJEO9PU.0 size=232211 2024-09-12T17:04:51.803 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.799+0000 7f026be9d8c0 1 < completed multipart upload key=UU88OS653L8D upload=1C0KTZJEO9PU tag=9XRXU08QEHDJ type=write size=1280787 2024-09-12T17:04:51.808 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.803+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~WUFFKTJJ6K31.0 size=1048576 2024-09-12T17:04:51.810 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.807+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~WUFFKTJJ6K31.1 size=91846 2024-09-12T17:04:51.810 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.807+0000 7f026be9d8c0 1 > prepared multipart upload key=4G3BKGNT3YZC upload=WUFFKTJJ6K31 tag=AM3ZYRXCTWDN type=write size=2188998 2024-09-12T17:04:51.813 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.807+0000 7f026be9d8c0 1 < completed write operation key=21ZD52VBZIO4 tag=T7YLHIYWOZGQ type=write size=924358 2024-09-12T17:04:51.816 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.811+0000 7f026be9d8c0 1 > prepared operation key=BW1T21LBUE2D tag=FGNJ2H2GQV93 type=del size=357748 2024-09-12T17:04:51.819 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.815+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~Q6IDHOVZ1KWK.0 size=1048576 2024-09-12T17:04:51.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.815+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~Q6IDHOVZ1KWK.1 size=93572 2024-09-12T17:04:51.825 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.819+0000 7f026be9d8c0 1 < completed multipart upload key=Y27CDEOCM7DH upload=Q6IDHOVZ1KWK tag=94JZDFSGL6XG type=write size=2190724 2024-09-12T17:04:51.828 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.823+0000 7f026be9d8c0 1 > prepared operation key=PQSQ39X3O64P tag=LFF82YTL4ANR type=del size=1958456 2024-09-12T17:04:51.831 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.827+0000 7f026be9d8c0 1 < completed delete operation key=Z9YNIEQCVNBA tag=HJ3CAWTQ0FXY type=del 2024-09-12T17:04:51.833 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.827+0000 7f026be9d8c0 1 > prepared operation key=SO3HLQZA8B6B tag=UU8LE8I3GUCA type=del size=1363381 2024-09-12T17:04:51.836 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.831+0000 7f026be9d8c0 1 < completed delete operation key=SL2446KSB531 tag=CJDGGGHHS709 type=del 2024-09-12T17:04:51.838 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.835+0000 7f026be9d8c0 1 > prepared operation key=ALFGNC1YNROX tag=P8CW19AGZ8I5 type=del size=2883111 2024-09-12T17:04:51.841 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.835+0000 7f026be9d8c0 1 < completed delete operation key=T6QRDTQRHBPI tag=TUU19U7T3FDF type=del 2024-09-12T17:04:51.844 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.839+0000 7f026be9d8c0 1 > prepared operation key=L194KQIPFLE1 tag=G5D8EY73R7GR type=del size=3851236 2024-09-12T17:04:51.849 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.843+0000 7f026be9d8c0 1 < suggested update operation key=8AFDAVJLMRD2 tag=7IADSDJDSUFI type=write size=660600 2024-09-12T17:04:51.852 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.847+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=LC9HSVML827P type=del size=3108021 2024-09-12T17:04:51.855 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.851+0000 7f026be9d8c0 1 < completed part key=_multipart_SO3HLQZA8B6B.2~EN26MM5T9FC1.0 size=1048576 2024-09-12T17:04:51.856 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.851+0000 7f026be9d8c0 1 < canceled part key=_multipart_SO3HLQZA8B6B.2~EN26MM5T9FC1.1 size=503041 2024-09-12T17:04:51.861 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.855+0000 7f026be9d8c0 1 < canceled multipart upload key=SO3HLQZA8B6B upload=EN26MM5T9FC1 tag=6JD4AL647ZTZ type=write size=2600193 2024-09-12T17:04:51.863 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.859+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=HMY1XZJ5IMXB type=del size=1611975 2024-09-12T17:04:51.866 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.863+0000 7f026be9d8c0 1 < completed delete operation key=E0Y3SKNUYCQS tag=P7JLGPHM7NZG type=del 2024-09-12T17:04:51.868 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.863+0000 7f026be9d8c0 1 > prepared operation key=SGT8IC1GJ3IG tag=CN723TTTTKC7 type=write size=420604 2024-09-12T17:04:51.871 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.867+0000 7f026be9d8c0 1 < completed part key=_multipart_U8W1SAVSLTBF.2~WQUYIIUXGQAJ.0 size=1048576 2024-09-12T17:04:51.873 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.867+0000 7f026be9d8c0 1 < completed part key=_multipart_U8W1SAVSLTBF.2~WQUYIIUXGQAJ.1 size=469811 2024-09-12T17:04:51.877 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.871+0000 7f026be9d8c0 1 < completed multipart upload key=U8W1SAVSLTBF upload=WQUYIIUXGQAJ tag=C63V3W0Y1V4B type=write size=2566963 2024-09-12T17:04:51.881 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.875+0000 7f026be9d8c0 1 > prepared part key=_multipart_4U1W97V0OX11.2~7KJXB6GACZ6S.0 size=692582 2024-09-12T17:04:51.881 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.875+0000 7f026be9d8c0 1 > prepared multipart upload key=4U1W97V0OX11 upload=7KJXB6GACZ6S tag=AOU3IAC9PT3D type=write size=1741158 2024-09-12T17:04:51.884 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.879+0000 7f026be9d8c0 -1 < failed to complete operation key=BW1T21LBUE2D tag=EIUOTCMZ2QO8 type=del size=288393: (22) Invalid argument 2024-09-12T17:04:51.888 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.883+0000 7f026be9d8c0 1 > prepared part key=_multipart_BBYDPSXZKHZP.2~D6D6YIWO2MWF.0 size=1048576 2024-09-12T17:04:51.890 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.887+0000 7f026be9d8c0 1 > prepared part key=_multipart_BBYDPSXZKHZP.2~D6D6YIWO2MWF.1 size=1048576 2024-09-12T17:04:51.892 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.887+0000 7f026be9d8c0 1 > prepared part key=_multipart_BBYDPSXZKHZP.2~D6D6YIWO2MWF.2 size=23008 2024-09-12T17:04:51.892 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.887+0000 7f026be9d8c0 1 > prepared multipart upload key=BBYDPSXZKHZP upload=D6D6YIWO2MWF tag=COBNOBQH96DR type=write size=3168736 2024-09-12T17:04:51.895 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.891+0000 7f026be9d8c0 1 < completed delete operation key=GPUFWJ3AWEMX tag=B4QEMFWVIS13 type=del 2024-09-12T17:04:51.899 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.895+0000 7f026be9d8c0 1 > prepared part key=_multipart_21ZD52VBZIO4.2~3CVUGONFDD5B.0 size=1048576 2024-09-12T17:04:51.901 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.895+0000 7f026be9d8c0 1 > prepared part key=_multipart_21ZD52VBZIO4.2~3CVUGONFDD5B.1 size=1048576 2024-09-12T17:04:51.903 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.899+0000 7f026be9d8c0 1 > prepared part key=_multipart_21ZD52VBZIO4.2~3CVUGONFDD5B.2 size=626259 2024-09-12T17:04:51.903 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.899+0000 7f026be9d8c0 1 > prepared multipart upload key=21ZD52VBZIO4 upload=3CVUGONFDD5B tag=1TUR316LQ25E type=write size=3771987 2024-09-12T17:04:51.908 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.903+0000 7f026be9d8c0 1 < suggested remove operation key=SGT8IC1GJ3IG tag=CCF0NSGAWFSG type=del 2024-09-12T17:04:51.911 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.907+0000 7f026be9d8c0 1 > prepared operation key=Z9YNIEQCVNBA tag=GD77SSQIBEZ7 type=write size=142061 2024-09-12T17:04:51.914 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.911+0000 7f026be9d8c0 1 < completed part key=_multipart_Z183NH6R676V.2~SJBN3N1CTC2Z.0 size=424637 2024-09-12T17:04:51.921 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.915+0000 7f026be9d8c0 1 < completed multipart upload key=Z183NH6R676V upload=SJBN3N1CTC2Z tag=WLV30FZMHWYM type=write size=1473213 2024-09-12T17:04:51.926 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.923+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~1I3QBG8S2AZX.0 size=1048576 2024-09-12T17:04:51.928 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.923+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~1I3QBG8S2AZX.1 size=635746 2024-09-12T17:04:51.928 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.923+0000 7f026be9d8c0 1 > prepared multipart upload key=8AFDAVJLMRD2 upload=1I3QBG8S2AZX tag=WIRSNWYBRT5T type=write size=2732898 2024-09-12T17:04:51.931 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.927+0000 7f026be9d8c0 1 < completed write operation key=PQSQ39X3O64P tag=I72FWAHW74GR type=write size=816907 2024-09-12T17:04:51.934 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.931+0000 7f026be9d8c0 1 > prepared operation key=MVYWUWKSYQ9Z tag=YF1QFJK8R0H3 type=write size=277452 2024-09-12T17:04:51.937 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.931+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~HL96HJRYYYAE.0 size=1048576 2024-09-12T17:04:51.940 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.935+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~HL96HJRYYYAE.1 size=934180 2024-09-12T17:04:51.946 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.943+0000 7f026be9d8c0 1 < completed multipart upload key=UU88OS653L8D upload=HL96HJRYYYAE tag=9COM5227O0CT type=write size=3031332 2024-09-12T17:04:51.952 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.947+0000 7f026be9d8c0 1 > prepared part key=_multipart_PQSQ39X3O64P.2~B4O4RQ3ZR0ZB.0 size=460328 2024-09-12T17:04:51.952 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.947+0000 7f026be9d8c0 1 > prepared multipart upload key=PQSQ39X3O64P upload=B4O4RQ3ZR0ZB tag=PPOHA08SFWV7 type=write size=1508904 2024-09-12T17:04:51.955 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.951+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~WUFFKTJJ6K31.0 size=1048576 2024-09-12T17:04:51.957 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.951+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~WUFFKTJJ6K31.1 size=91846 2024-09-12T17:04:51.963 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.959+0000 7f026be9d8c0 1 < completed multipart upload key=4G3BKGNT3YZC upload=WUFFKTJJ6K31 tag=AM3ZYRXCTWDN type=write size=2188998 2024-09-12T17:04:51.966 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.963+0000 7f026be9d8c0 1 > prepared operation key=XLKR6P8RNRVO tag=T194P9N6SQQZ type=del size=1616591 2024-09-12T17:04:51.973 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.967+0000 7f026be9d8c0 1 < suggested update operation key=BW1T21LBUE2D tag=FGNJ2H2GQV93 type=del size=357748 2024-09-12T17:04:51.976 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.971+0000 7f026be9d8c0 1 > prepared operation key=32XUMOWT8HO2 tag=U76RHP09UYZD type=del size=450916 2024-09-12T17:04:51.978 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.975+0000 7f026be9d8c0 1 < completed delete operation key=PQSQ39X3O64P tag=LFF82YTL4ANR type=del 2024-09-12T17:04:51.982 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.975+0000 7f026be9d8c0 1 > prepared operation key=L194KQIPFLE1 tag=7LU7A2E8YUNH type=write size=374020 2024-09-12T17:04:51.985 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.979+0000 7f026be9d8c0 1 < completed delete operation key=SO3HLQZA8B6B tag=UU8LE8I3GUCA type=del 2024-09-12T17:04:51.987 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.983+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=U52WKRH7BPYX type=del size=1935663 2024-09-12T17:04:51.994 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.991+0000 7f026be9d8c0 1 < suggested remove operation key=ALFGNC1YNROX tag=P8CW19AGZ8I5 type=del 2024-09-12T17:04:51.999 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.995+0000 7f026be9d8c0 1 > prepared part key=_multipart_RBNN03IPZ8BT.2~6DR2K3T423PS.0 size=1048576 2024-09-12T17:04:52.003 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.999+0000 7f026be9d8c0 1 > prepared part key=_multipart_RBNN03IPZ8BT.2~6DR2K3T423PS.1 size=1048576 2024-09-12T17:04:52.006 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.999+0000 7f026be9d8c0 1 > prepared part key=_multipart_RBNN03IPZ8BT.2~6DR2K3T423PS.2 size=1008061 2024-09-12T17:04:52.006 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:51.999+0000 7f026be9d8c0 1 > prepared multipart upload key=RBNN03IPZ8BT upload=6DR2K3T423PS tag=74E4EPLYLC0O type=write size=4153789 2024-09-12T17:04:52.012 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.007+0000 7f026be9d8c0 1 < suggested update operation key=L194KQIPFLE1 tag=G5D8EY73R7GR type=del size=3851236 2024-09-12T17:04:52.015 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.011+0000 7f026be9d8c0 1 > prepared operation key=SGT8IC1GJ3IG tag=4YE2AZB187TU type=del size=2247695 2024-09-12T17:04:52.022 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.019+0000 7f026be9d8c0 1 < suggested update operation key=RBNN03IPZ8BT tag=LC9HSVML827P type=del size=3108021 2024-09-12T17:04:52.027 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.023+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~Q3GOZT1FSRKO.0 size=213451 2024-09-12T17:04:52.027 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.023+0000 7f026be9d8c0 1 > prepared multipart upload key=32XUMOWT8HO2 upload=Q3GOZT1FSRKO tag=K7WIHVQ8GFCF type=write size=1262027 2024-09-12T17:04:52.034 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.027+0000 7f026be9d8c0 1 < suggested update operation key=3JADN360QEO3 tag=HMY1XZJ5IMXB type=del size=1611975 2024-09-12T17:04:52.039 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.035+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~NUG2PHP4CLNI.0 size=698038 2024-09-12T17:04:52.040 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.035+0000 7f026be9d8c0 1 > prepared multipart upload key=Z9YNIEQCVNBA upload=NUG2PHP4CLNI tag=LKDRFM9HKZTF type=write size=1746614 2024-09-12T17:04:52.046 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.043+0000 7f026be9d8c0 1 < suggested update operation key=SGT8IC1GJ3IG tag=CN723TTTTKC7 type=write size=420604 2024-09-12T17:04:52.049 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.043+0000 7f026be9d8c0 1 > prepared operation key=4G3BKGNT3YZC tag=190Y9HSQQXWD type=del size=3439666 2024-09-12T17:04:52.052 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.047+0000 7f026be9d8c0 1 < completed part key=_multipart_4U1W97V0OX11.2~7KJXB6GACZ6S.0 size=692582 2024-09-12T17:04:52.057 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.051+0000 7f026be9d8c0 1 < completed multipart upload key=4U1W97V0OX11 upload=7KJXB6GACZ6S tag=AOU3IAC9PT3D type=write size=1741158 2024-09-12T17:04:52.063 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.059+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~RRVQAGBTLBWN.0 size=1048576 2024-09-12T17:04:52.066 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.063+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~RRVQAGBTLBWN.1 size=1048576 2024-09-12T17:04:52.068 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.063+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~RRVQAGBTLBWN.2 size=513882 2024-09-12T17:04:52.068 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.063+0000 7f026be9d8c0 1 > prepared multipart upload key=UU88OS653L8D upload=RRVQAGBTLBWN tag=RAWDF3LKT5NX type=write size=3659610 2024-09-12T17:04:52.071 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.067+0000 7f026be9d8c0 1 < completed part key=_multipart_BBYDPSXZKHZP.2~D6D6YIWO2MWF.0 size=1048576 2024-09-12T17:04:52.074 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.071+0000 7f026be9d8c0 1 < completed part key=_multipart_BBYDPSXZKHZP.2~D6D6YIWO2MWF.1 size=1048576 2024-09-12T17:04:52.076 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.071+0000 7f026be9d8c0 1 < completed part key=_multipart_BBYDPSXZKHZP.2~D6D6YIWO2MWF.2 size=23008 2024-09-12T17:04:52.082 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.079+0000 7f026be9d8c0 1 < completed multipart upload key=BBYDPSXZKHZP upload=D6D6YIWO2MWF tag=COBNOBQH96DR type=write size=3168736 2024-09-12T17:04:52.088 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.083+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~YK9NH0O7DSM5.0 size=1048576 2024-09-12T17:04:52.091 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.087+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~YK9NH0O7DSM5.1 size=1048576 2024-09-12T17:04:52.093 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.087+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~YK9NH0O7DSM5.2 size=1027004 2024-09-12T17:04:52.093 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.087+0000 7f026be9d8c0 1 > prepared multipart upload key=GPUFWJ3AWEMX upload=YK9NH0O7DSM5 tag=2JOJ9W6RHIW4 type=write size=4172732 2024-09-12T17:04:52.097 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.091+0000 7f026be9d8c0 1 < completed part key=_multipart_21ZD52VBZIO4.2~3CVUGONFDD5B.0 size=1048576 2024-09-12T17:04:52.099 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.095+0000 7f026be9d8c0 1 < completed part key=_multipart_21ZD52VBZIO4.2~3CVUGONFDD5B.1 size=1048576 2024-09-12T17:04:52.102 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.099+0000 7f026be9d8c0 1 < completed part key=_multipart_21ZD52VBZIO4.2~3CVUGONFDD5B.2 size=626259 2024-09-12T17:04:52.108 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.103+0000 7f026be9d8c0 1 < completed multipart upload key=21ZD52VBZIO4 upload=3CVUGONFDD5B tag=1TUR316LQ25E type=write size=3771987 2024-09-12T17:04:52.111 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.107+0000 7f026be9d8c0 1 > prepared operation key=L194KQIPFLE1 tag=RSK0S193GKET type=del size=1311743 2024-09-12T17:04:52.114 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.111+0000 7f026be9d8c0 1 < canceled operation key=Z9YNIEQCVNBA tag=GD77SSQIBEZ7 type=write size=142061 2024-09-12T17:04:52.121 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.115+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~S64EPLRN4LZJ.0 size=1048576 2024-09-12T17:04:52.123 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.119+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~S64EPLRN4LZJ.1 size=369805 2024-09-12T17:04:52.123 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.119+0000 7f026be9d8c0 1 > prepared multipart upload key=2BQJ30RQQ25L upload=S64EPLRN4LZJ tag=MEHK4U7WSJUR type=write size=2466957 2024-09-12T17:04:52.124 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.119+0000 7f026be9d8c0 1 < canceled part key=_multipart_8AFDAVJLMRD2.2~1I3QBG8S2AZX.0 size=1048576 2024-09-12T17:04:52.127 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.123+0000 7f026be9d8c0 1 < completed part key=_multipart_8AFDAVJLMRD2.2~1I3QBG8S2AZX.1 size=635746 2024-09-12T17:04:52.131 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.127+0000 7f026be9d8c0 1 < canceled multipart upload key=8AFDAVJLMRD2 upload=1I3QBG8S2AZX tag=WIRSNWYBRT5T type=write size=2732898 2024-09-12T17:04:52.137 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.131+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~OAV4PYECLF05.0 size=1048576 2024-09-12T17:04:52.142 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.139+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~OAV4PYECLF05.1 size=24385 2024-09-12T17:04:52.142 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.139+0000 7f026be9d8c0 1 > prepared multipart upload key=32XUMOWT8HO2 upload=OAV4PYECLF05 tag=S0XGDLG0OYWC type=write size=2121537 2024-09-12T17:04:52.145 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.139+0000 7f026be9d8c0 1 < completed write operation key=MVYWUWKSYQ9Z tag=YF1QFJK8R0H3 type=write size=277452 2024-09-12T17:04:52.148 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.143+0000 7f026be9d8c0 1 > prepared operation key=Y27CDEOCM7DH tag=EXXND96UI5HP type=del size=1129934 2024-09-12T17:04:52.152 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.147+0000 7f026be9d8c0 1 < completed part key=_multipart_PQSQ39X3O64P.2~B4O4RQ3ZR0ZB.0 size=460328 2024-09-12T17:04:52.157 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.151+0000 7f026be9d8c0 1 < completed multipart upload key=PQSQ39X3O64P upload=B4O4RQ3ZR0ZB tag=PPOHA08SFWV7 type=write size=1508904 2024-09-12T17:04:52.160 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.155+0000 7f026be9d8c0 1 > prepared operation key=2BQJ30RQQ25L tag=RNO7QHA2UTEW type=del size=3700434 2024-09-12T17:04:52.163 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.159+0000 7f026be9d8c0 1 < canceled operation key=XLKR6P8RNRVO tag=T194P9N6SQQZ type=del size=1616591 2024-09-12T17:04:52.166 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.163+0000 7f026be9d8c0 1 > prepared operation key=SO3HLQZA8B6B tag=QLKFQORMGKVB type=del size=171168 2024-09-12T17:04:52.169 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.163+0000 7f026be9d8c0 1 < completed delete operation key=32XUMOWT8HO2 tag=U76RHP09UYZD type=del 2024-09-12T17:04:52.172 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.167+0000 7f026be9d8c0 1 > prepared operation key=QVQ4TI319DH5 tag=YFEBECAH9951 type=del size=401830 2024-09-12T17:04:52.175 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.171+0000 7f026be9d8c0 -1 < failed to complete operation key=L194KQIPFLE1 tag=7LU7A2E8YUNH type=write size=374020: (22) Invalid argument 2024-09-12T17:04:52.181 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.175+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~5HNIWTCLPUL2.0 size=1048576 2024-09-12T17:04:52.183 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.179+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~5HNIWTCLPUL2.1 size=1048576 2024-09-12T17:04:52.185 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.179+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~5HNIWTCLPUL2.2 size=657797 2024-09-12T17:04:52.186 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.179+0000 7f026be9d8c0 1 > prepared multipart upload key=SL2446KSB531 upload=5HNIWTCLPUL2 tag=L75MCCCD4G8L type=write size=3803525 2024-09-12T17:04:52.188 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.183+0000 7f026be9d8c0 -1 < failed to complete operation key=3JADN360QEO3 tag=U52WKRH7BPYX type=del size=1935663: (22) Invalid argument 2024-09-12T17:04:52.192 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.187+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=TGQUA26VEUNX type=write size=491298 2024-09-12T17:04:52.195 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.191+0000 7f026be9d8c0 1 < completed part key=_multipart_RBNN03IPZ8BT.2~6DR2K3T423PS.0 size=1048576 2024-09-12T17:04:52.198 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.195+0000 7f026be9d8c0 1 < completed part key=_multipart_RBNN03IPZ8BT.2~6DR2K3T423PS.1 size=1048576 2024-09-12T17:04:52.201 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.195+0000 7f026be9d8c0 1 < completed part key=_multipart_RBNN03IPZ8BT.2~6DR2K3T423PS.2 size=1008061 2024-09-12T17:04:52.206 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.203+0000 7f026be9d8c0 1 < completed multipart upload key=RBNN03IPZ8BT upload=6DR2K3T423PS tag=74E4EPLYLC0O type=write size=4153789 2024-09-12T17:04:52.209 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.203+0000 7f026be9d8c0 1 > prepared operation key=J8MU1A0CWSAQ tag=84Y40D429B1Z type=del size=1640532 2024-09-12T17:04:52.213 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.207+0000 7f026be9d8c0 -1 < failed to complete operation key=SGT8IC1GJ3IG tag=4YE2AZB187TU type=del size=2247695: (22) Invalid argument 2024-09-12T17:04:52.216 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.211+0000 7f026be9d8c0 1 > prepared operation key=Y27CDEOCM7DH tag=ZCJKJHHMXDYG type=del size=2660355 2024-09-12T17:04:52.219 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.215+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~Q3GOZT1FSRKO.0 size=213451 2024-09-12T17:04:52.225 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.219+0000 7f026be9d8c0 1 < completed multipart upload key=32XUMOWT8HO2 upload=Q3GOZT1FSRKO tag=K7WIHVQ8GFCF type=write size=1262027 2024-09-12T17:04:52.228 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.223+0000 7f026be9d8c0 1 > prepared operation key=2BQJ30RQQ25L tag=330JSCXZCX2Z type=del size=3666126 2024-09-12T17:04:52.232 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.227+0000 7f026be9d8c0 1 < completed part key=_multipart_Z9YNIEQCVNBA.2~NUG2PHP4CLNI.0 size=698038 2024-09-12T17:04:52.237 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.231+0000 7f026be9d8c0 1 < completed multipart upload key=Z9YNIEQCVNBA upload=NUG2PHP4CLNI tag=LKDRFM9HKZTF type=write size=1746614 2024-09-12T17:04:52.241 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.235+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=YSTV7UMO0T1F type=write size=151974 2024-09-12T17:04:52.245 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.239+0000 7f026be9d8c0 1 < completed delete operation key=4G3BKGNT3YZC tag=190Y9HSQQXWD type=del 2024-09-12T17:04:52.249 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.243+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=KP0QO32VHZQ8 type=write size=563369 2024-09-12T17:04:52.249 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.243+0000 7f026be9d8c0 1 < canceled part key=_multipart_UU88OS653L8D.2~RRVQAGBTLBWN.0 size=1048576 2024-09-12T17:04:52.252 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.247+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~RRVQAGBTLBWN.1 size=1048576 2024-09-12T17:04:52.255 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.251+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~RRVQAGBTLBWN.2 size=513882 2024-09-12T17:04:52.262 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.255+0000 7f026be9d8c0 1 < canceled multipart upload key=UU88OS653L8D upload=RRVQAGBTLBWN tag=RAWDF3LKT5NX type=write size=3659610 2024-09-12T17:04:52.264 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.259+0000 7f026be9d8c0 1 > prepared operation key=L194KQIPFLE1 tag=GI9S6K6JNEKX type=write size=421933 2024-09-12T17:04:52.268 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.263+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~YK9NH0O7DSM5.0 size=1048576 2024-09-12T17:04:52.271 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.267+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~YK9NH0O7DSM5.1 size=1048576 2024-09-12T17:04:52.274 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.271+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~YK9NH0O7DSM5.2 size=1027004 2024-09-12T17:04:52.280 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.275+0000 7f026be9d8c0 1 < completed multipart upload key=GPUFWJ3AWEMX upload=YK9NH0O7DSM5 tag=2JOJ9W6RHIW4 type=write size=4172732 2024-09-12T17:04:52.284 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.279+0000 7f026be9d8c0 1 > prepared operation key=6VO85REZG2NW tag=L7XI90KYACHC type=del size=2243665 2024-09-12T17:04:52.287 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.283+0000 7f026be9d8c0 1 < canceled operation key=L194KQIPFLE1 tag=RSK0S193GKET type=del size=1311743 2024-09-12T17:04:52.291 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.287+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=X49K7038Y9VW type=del size=3389426 2024-09-12T17:04:52.295 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.291+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~S64EPLRN4LZJ.0 size=1048576 2024-09-12T17:04:52.297 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.291+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~S64EPLRN4LZJ.1 size=369805 2024-09-12T17:04:52.303 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.299+0000 7f026be9d8c0 1 < completed multipart upload key=2BQJ30RQQ25L upload=S64EPLRN4LZJ tag=MEHK4U7WSJUR type=write size=2466957 2024-09-12T17:04:52.306 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.303+0000 7f026be9d8c0 1 > prepared operation key=4U1W97V0OX11 tag=KY65Y5C7QJ70 type=write size=12004 2024-09-12T17:04:52.307 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.303+0000 7f026be9d8c0 1 < canceled part key=_multipart_32XUMOWT8HO2.2~OAV4PYECLF05.0 size=1048576 2024-09-12T17:04:52.311 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.307+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~OAV4PYECLF05.1 size=24385 2024-09-12T17:04:52.316 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.311+0000 7f026be9d8c0 1 < canceled multipart upload key=32XUMOWT8HO2 upload=OAV4PYECLF05 tag=S0XGDLG0OYWC type=write size=2121537 2024-09-12T17:04:52.319 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.315+0000 7f026be9d8c0 1 > prepared operation key=SL2446KSB531 tag=5UC2CLYD17B5 type=del size=1601316 2024-09-12T17:04:52.326 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.323+0000 7f026be9d8c0 1 < suggested update operation key=Y27CDEOCM7DH tag=EXXND96UI5HP type=del size=1129934 2024-09-12T17:04:52.330 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.323+0000 7f026be9d8c0 1 > prepared operation key=SO3HLQZA8B6B tag=5UNVDUGW8F9U type=write size=246506 2024-09-12T17:04:52.333 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.327+0000 7f026be9d8c0 1 < completed delete operation key=2BQJ30RQQ25L tag=RNO7QHA2UTEW type=del 2024-09-12T17:04:52.337 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.331+0000 7f026be9d8c0 1 > prepared operation key=SL2446KSB531 tag=HJ43QUFAIPKA type=write size=668695 2024-09-12T17:04:52.343 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.339+0000 7f026be9d8c0 1 < suggested remove operation key=SO3HLQZA8B6B tag=QLKFQORMGKVB type=del 2024-09-12T17:04:52.350 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.347+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~9EMPKFEOVA9J.0 size=206345 2024-09-12T17:04:52.350 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.347+0000 7f026be9d8c0 1 > prepared multipart upload key=6VO85REZG2NW upload=9EMPKFEOVA9J tag=RAHXL9XOBPW5 type=write size=1254921 2024-09-12T17:04:52.353 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.347+0000 7f026be9d8c0 1 < completed delete operation key=QVQ4TI319DH5 tag=YFEBECAH9951 type=del 2024-09-12T17:04:52.360 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.355+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~A6LXXSP3Y268.0 size=1048576 2024-09-12T17:04:52.362 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.359+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~A6LXXSP3Y268.1 size=319763 2024-09-12T17:04:52.362 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.359+0000 7f026be9d8c0 1 > prepared multipart upload key=UU88OS653L8D upload=A6LXXSP3Y268 tag=7Y9S93954PX6 type=write size=2416915 2024-09-12T17:04:52.365 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.359+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~5HNIWTCLPUL2.0 size=1048576 2024-09-12T17:04:52.368 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.363+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~5HNIWTCLPUL2.1 size=1048576 2024-09-12T17:04:52.371 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.367+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~5HNIWTCLPUL2.2 size=657797 2024-09-12T17:04:52.377 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.371+0000 7f026be9d8c0 1 < completed multipart upload key=SL2446KSB531 upload=5HNIWTCLPUL2 tag=L75MCCCD4G8L type=write size=3803525 2024-09-12T17:04:52.383 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.379+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~FSV7IJ787XUI.0 size=1048576 2024-09-12T17:04:52.386 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.383+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~FSV7IJ787XUI.1 size=1048576 2024-09-12T17:04:52.389 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.383+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~FSV7IJ787XUI.2 size=927108 2024-09-12T17:04:52.389 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.383+0000 7f026be9d8c0 1 > prepared multipart upload key=2BQJ30RQQ25L upload=FSV7IJ787XUI tag=TV3MIUFSNHXW type=write size=4072836 2024-09-12T17:04:52.393 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.387+0000 7f026be9d8c0 1 < completed write operation key=21ZD52VBZIO4 tag=TGQUA26VEUNX type=write size=491298 2024-09-12T17:04:52.396 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.391+0000 7f026be9d8c0 1 > prepared operation key=ALFGNC1YNROX tag=ZS8GUT2RFL34 type=del size=3291704 2024-09-12T17:04:52.400 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.395+0000 7f026be9d8c0 1 < completed delete operation key=J8MU1A0CWSAQ tag=84Y40D429B1Z type=del 2024-09-12T17:04:52.407 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.403+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~7NIE3N53NVT4.0 size=1048576 2024-09-12T17:04:52.410 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.407+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~7NIE3N53NVT4.1 size=1048576 2024-09-12T17:04:52.413 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.407+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~7NIE3N53NVT4.2 size=120364 2024-09-12T17:04:52.413 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.407+0000 7f026be9d8c0 1 > prepared multipart upload key=2BQJ30RQQ25L upload=7NIE3N53NVT4 tag=XJ2ZJ6567S6K type=write size=3266092 2024-09-12T17:04:52.417 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.411+0000 7f026be9d8c0 -1 < failed to complete operation key=Y27CDEOCM7DH tag=ZCJKJHHMXDYG type=del size=2660355: (22) Invalid argument 2024-09-12T17:04:52.420 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.415+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=PFM8UN0MBHFQ type=del size=2949204 2024-09-12T17:04:52.424 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.419+0000 7f026be9d8c0 1 < completed delete operation key=2BQJ30RQQ25L tag=330JSCXZCX2Z type=del 2024-09-12T17:04:52.431 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.427+0000 7f026be9d8c0 1 > prepared part key=_multipart_T6QRDTQRHBPI.2~4WCJY2W0QBQM.0 size=865191 2024-09-12T17:04:52.431 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.427+0000 7f026be9d8c0 1 > prepared multipart upload key=T6QRDTQRHBPI upload=4WCJY2W0QBQM tag=JIPKCMYB6XIX type=write size=1913767 2024-09-12T17:04:52.434 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.431+0000 7f026be9d8c0 1 < completed write operation key=RBNN03IPZ8BT tag=YSTV7UMO0T1F type=write size=151974 2024-09-12T17:04:52.438 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.431+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=RH6B9S5UM68P type=del size=985677 2024-09-12T17:04:52.441 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.435+0000 7f026be9d8c0 1 < completed write operation key=U8W1SAVSLTBF tag=KP0QO32VHZQ8 type=write size=563369 2024-09-12T17:04:52.447 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.443+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~4YRE5ICCY3D9.0 size=1048576 2024-09-12T17:04:52.450 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.447+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~4YRE5ICCY3D9.1 size=179195 2024-09-12T17:04:52.450 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.447+0000 7f026be9d8c0 1 > prepared multipart upload key=XLKR6P8RNRVO upload=4YRE5ICCY3D9 tag=X0XGJKTJ6LZL type=write size=2276347 2024-09-12T17:04:52.454 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.451+0000 7f026be9d8c0 1 < completed write operation key=L194KQIPFLE1 tag=GI9S6K6JNEKX type=write size=421933 2024-09-12T17:04:52.457 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.451+0000 7f026be9d8c0 1 > prepared operation key=L194KQIPFLE1 tag=BD1UITUGMTQL type=del size=1656353 2024-09-12T17:04:52.467 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.463+0000 7f026be9d8c0 1 < suggested remove operation key=6VO85REZG2NW tag=L7XI90KYACHC type=del 2024-09-12T17:04:52.470 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.467+0000 7f026be9d8c0 1 > prepared operation key=ALFGNC1YNROX tag=MCIMZDOJ74IJ type=del size=3162077 2024-09-12T17:04:52.474 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.471+0000 7f026be9d8c0 1 < canceled operation key=21ZD52VBZIO4 tag=X49K7038Y9VW type=del size=3389426 2024-09-12T17:04:52.480 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.475+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~3OXYPDAF8GX7.0 size=1048576 2024-09-12T17:04:52.483 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.479+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~3OXYPDAF8GX7.1 size=1048576 2024-09-12T17:04:52.486 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.483+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~3OXYPDAF8GX7.2 size=156059 2024-09-12T17:04:52.486 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.483+0000 7f026be9d8c0 1 > prepared multipart upload key=ALFGNC1YNROX upload=3OXYPDAF8GX7 tag=TY1O2BL6J08N type=write size=3301787 2024-09-12T17:04:52.489 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.483+0000 7f026be9d8c0 1 < completed write operation key=4U1W97V0OX11 tag=KY65Y5C7QJ70 type=write size=12004 2024-09-12T17:04:52.496 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.491+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~DIHB27BFGKBX.0 size=510108 2024-09-12T17:04:52.496 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.491+0000 7f026be9d8c0 1 > prepared multipart upload key=8AFDAVJLMRD2 upload=DIHB27BFGKBX tag=U58TNXS92E07 type=write size=1558684 2024-09-12T17:04:52.500 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.495+0000 7f026be9d8c0 1 < completed delete operation key=SL2446KSB531 tag=5UC2CLYD17B5 type=del 2024-09-12T17:04:52.503 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.499+0000 7f026be9d8c0 1 > prepared operation key=LHKLWIUAT08F tag=ERIRY2XHJAXK type=del size=480663 2024-09-12T17:04:52.505 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.499+0000 7f026be9d8c0 -1 < failed to complete operation key=SO3HLQZA8B6B tag=5UNVDUGW8F9U type=write size=246506: (22) Invalid argument 2024-09-12T17:04:52.508 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.503+0000 7f026be9d8c0 1 > prepared operation key=Z9YNIEQCVNBA tag=2H6FQNYMQNV1 type=del size=2497025 2024-09-12T17:04:52.515 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.511+0000 7f026be9d8c0 1 < suggested remove operation key=SL2446KSB531 tag=HJ43QUFAIPKA type=write 2024-09-12T17:04:52.521 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.515+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~THXLI7OXJ9KZ.0 size=307479 2024-09-12T17:04:52.521 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.515+0000 7f026be9d8c0 1 > prepared multipart upload key=4G3BKGNT3YZC upload=THXLI7OXJ9KZ tag=WA7GUETDZ6VV type=write size=1356055 2024-09-12T17:04:52.524 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.519+0000 7f026be9d8c0 1 < completed part key=_multipart_6VO85REZG2NW.2~9EMPKFEOVA9J.0 size=206345 2024-09-12T17:04:52.530 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.523+0000 7f026be9d8c0 1 < completed multipart upload key=6VO85REZG2NW upload=9EMPKFEOVA9J tag=RAHXL9XOBPW5 type=write size=1254921 2024-09-12T17:04:52.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.531+0000 7f026be9d8c0 1 > prepared part key=_multipart_SO3HLQZA8B6B.2~32GJXRSIDCPI.0 size=85524 2024-09-12T17:04:52.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.531+0000 7f026be9d8c0 1 > prepared multipart upload key=SO3HLQZA8B6B upload=32GJXRSIDCPI tag=PNJC53EB9EOE type=write size=1134100 2024-09-12T17:04:52.539 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.535+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~A6LXXSP3Y268.0 size=1048576 2024-09-12T17:04:52.543 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.539+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~A6LXXSP3Y268.1 size=319763 2024-09-12T17:04:52.548 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.543+0000 7f026be9d8c0 1 < completed multipart upload key=UU88OS653L8D upload=A6LXXSP3Y268 tag=7Y9S93954PX6 type=write size=2416915 2024-09-12T17:04:52.552 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.547+0000 7f026be9d8c0 1 > prepared operation key=J8MU1A0CWSAQ tag=81T46V1GGD0M type=del size=3505378 2024-09-12T17:04:52.556 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.551+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~FSV7IJ787XUI.0 size=1048576 2024-09-12T17:04:52.560 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.555+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~FSV7IJ787XUI.1 size=1048576 2024-09-12T17:04:52.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.555+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~FSV7IJ787XUI.2 size=927108 2024-09-12T17:04:52.568 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.563+0000 7f026be9d8c0 1 < completed multipart upload key=2BQJ30RQQ25L upload=FSV7IJ787XUI tag=TV3MIUFSNHXW type=write size=4072836 2024-09-12T17:04:52.574 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.571+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~E5X57HGPWM5N.0 size=1048576 2024-09-12T17:04:52.577 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.571+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~E5X57HGPWM5N.1 size=1048576 2024-09-12T17:04:52.580 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.575+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~E5X57HGPWM5N.2 size=491171 2024-09-12T17:04:52.580 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.575+0000 7f026be9d8c0 1 > prepared multipart upload key=BW1T21LBUE2D upload=E5X57HGPWM5N tag=DETRR0LYI0GJ type=write size=3636899 2024-09-12T17:04:52.583 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.579+0000 7f026be9d8c0 1 < completed delete operation key=ALFGNC1YNROX tag=ZS8GUT2RFL34 type=del 2024-09-12T17:04:52.590 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.583+0000 7f026be9d8c0 1 > prepared part key=_multipart_XNBE2II106VZ.2~CEZ6PCPLS0GJ.0 size=1048576 2024-09-12T17:04:52.593 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.587+0000 7f026be9d8c0 1 > prepared part key=_multipart_XNBE2II106VZ.2~CEZ6PCPLS0GJ.1 size=488809 2024-09-12T17:04:52.593 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.587+0000 7f026be9d8c0 1 > prepared multipart upload key=XNBE2II106VZ upload=CEZ6PCPLS0GJ tag=5HTX9XTTVCKF type=write size=2585961 2024-09-12T17:04:52.596 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.591+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~7NIE3N53NVT4.0 size=1048576 2024-09-12T17:04:52.596 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.591+0000 7f026be9d8c0 1 < canceled part key=_multipart_2BQJ30RQQ25L.2~7NIE3N53NVT4.1 size=1048576 2024-09-12T17:04:52.599 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.595+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~7NIE3N53NVT4.2 size=120364 2024-09-12T17:04:52.604 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.599+0000 7f026be9d8c0 1 < canceled multipart upload key=2BQJ30RQQ25L upload=7NIE3N53NVT4 tag=XJ2ZJ6567S6K type=write size=3266092 2024-09-12T17:04:52.608 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.603+0000 7f026be9d8c0 1 > prepared operation key=MVYWUWKSYQ9Z tag=LZ37N71OK6DQ type=del size=1626319 2024-09-12T17:04:52.612 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.607+0000 7f026be9d8c0 1 < canceled operation key=U8W1SAVSLTBF tag=PFM8UN0MBHFQ type=del size=2949204 2024-09-12T17:04:52.618 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.615+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~N72V4MZHYPP1.0 size=1048576 2024-09-12T17:04:52.621 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.615+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~N72V4MZHYPP1.1 size=1048576 2024-09-12T17:04:52.624 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.619+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~N72V4MZHYPP1.2 size=375942 2024-09-12T17:04:52.624 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.619+0000 7f026be9d8c0 1 > prepared multipart upload key=ALFGNC1YNROX upload=N72V4MZHYPP1 tag=HLF3BLSSNUZ9 type=write size=3521670 2024-09-12T17:04:52.627 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.623+0000 7f026be9d8c0 1 < completed part key=_multipart_T6QRDTQRHBPI.2~4WCJY2W0QBQM.0 size=865191 2024-09-12T17:04:52.633 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.627+0000 7f026be9d8c0 1 < completed multipart upload key=T6QRDTQRHBPI upload=4WCJY2W0QBQM tag=JIPKCMYB6XIX type=write size=1913767 2024-09-12T17:04:52.636 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.631+0000 7f026be9d8c0 1 > prepared operation key=GPUFWJ3AWEMX tag=GLJP3OZ9OM9I type=write size=1038164 2024-09-12T17:04:52.640 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.635+0000 7f026be9d8c0 1 < completed delete operation key=21ZD52VBZIO4 tag=RH6B9S5UM68P type=del 2024-09-12T17:04:52.644 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.639+0000 7f026be9d8c0 1 > prepared operation key=BBYDPSXZKHZP tag=4UEDI1NQSU5I type=del size=3155969 2024-09-12T17:04:52.647 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.643+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~4YRE5ICCY3D9.0 size=1048576 2024-09-12T17:04:52.650 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.647+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~4YRE5ICCY3D9.1 size=179195 2024-09-12T17:04:52.656 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.651+0000 7f026be9d8c0 1 < completed multipart upload key=XLKR6P8RNRVO upload=4YRE5ICCY3D9 tag=X0XGJKTJ6LZL type=write size=2276347 2024-09-12T17:04:52.659 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.655+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=2F0N2PA7ULT9 type=write size=750992 2024-09-12T17:04:52.663 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.659+0000 7f026be9d8c0 1 < completed delete operation key=L194KQIPFLE1 tag=BD1UITUGMTQL type=del 2024-09-12T17:04:52.669 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.663+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~GH3XE16MK8VW.0 size=1048576 2024-09-12T17:04:52.672 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.667+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~GH3XE16MK8VW.1 size=1048576 2024-09-12T17:04:52.676 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.671+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~GH3XE16MK8VW.2 size=134979 2024-09-12T17:04:52.676 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.671+0000 7f026be9d8c0 1 > prepared multipart upload key=2BQJ30RQQ25L upload=GH3XE16MK8VW tag=07HB085S1WGQ type=write size=3280707 2024-09-12T17:04:52.680 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.675+0000 7f026be9d8c0 1 < completed delete operation key=ALFGNC1YNROX tag=MCIMZDOJ74IJ type=del 2024-09-12T17:04:52.686 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.683+0000 7f026be9d8c0 1 > prepared part key=_multipart_MVYWUWKSYQ9Z.2~PB3DY8QLNFHU.0 size=1048576 2024-09-12T17:04:52.690 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.687+0000 7f026be9d8c0 1 > prepared part key=_multipart_MVYWUWKSYQ9Z.2~PB3DY8QLNFHU.1 size=1048576 2024-09-12T17:04:52.693 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.687+0000 7f026be9d8c0 1 > prepared part key=_multipart_MVYWUWKSYQ9Z.2~PB3DY8QLNFHU.2 size=236217 2024-09-12T17:04:52.693 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.687+0000 7f026be9d8c0 1 > prepared multipart upload key=MVYWUWKSYQ9Z upload=PB3DY8QLNFHU tag=TE34JWZGEDZ5 type=write size=3381945 2024-09-12T17:04:52.696 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.691+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~3OXYPDAF8GX7.0 size=1048576 2024-09-12T17:04:52.702 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.695+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~3OXYPDAF8GX7.1 size=1048576 2024-09-12T17:04:52.702 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.695+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~3OXYPDAF8GX7.2 size=156059 2024-09-12T17:04:52.707 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.703+0000 7f026be9d8c0 1 < completed multipart upload key=ALFGNC1YNROX upload=3OXYPDAF8GX7 tag=TY1O2BL6J08N type=write size=3301787 2024-09-12T17:04:52.710 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.703+0000 7f026be9d8c0 1 > prepared operation key=E0Y3SKNUYCQS tag=LIS0EGZXCTSW type=del size=191058 2024-09-12T17:04:52.710 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.707+0000 7f026be9d8c0 1 < canceled part key=_multipart_8AFDAVJLMRD2.2~DIHB27BFGKBX.0 size=510108 2024-09-12T17:04:52.716 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.711+0000 7f026be9d8c0 1 < canceled multipart upload key=8AFDAVJLMRD2 upload=DIHB27BFGKBX tag=U58TNXS92E07 type=write size=1558684 2024-09-12T17:04:52.721 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.715+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~4QBQ8C983WWB.0 size=267349 2024-09-12T17:04:52.721 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.715+0000 7f026be9d8c0 1 > prepared multipart upload key=Y27CDEOCM7DH upload=4QBQ8C983WWB tag=F7BFX3HVFJII type=write size=1315925 2024-09-12T17:04:52.724 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.719+0000 7f026be9d8c0 1 < completed delete operation key=LHKLWIUAT08F tag=ERIRY2XHJAXK type=del 2024-09-12T17:04:52.727 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.723+0000 7f026be9d8c0 1 > prepared operation key=SGT8IC1GJ3IG tag=Z4ZGR0YZRPUO type=del size=3484322 2024-09-12T17:04:52.730 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.727+0000 7f026be9d8c0 1 < completed delete operation key=Z9YNIEQCVNBA tag=2H6FQNYMQNV1 type=del 2024-09-12T17:04:52.737 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.731+0000 7f026be9d8c0 1 > prepared part key=_multipart_E0Y3SKNUYCQS.2~K1FGCS9IQTQV.0 size=1048576 2024-09-12T17:04:52.739 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.735+0000 7f026be9d8c0 1 > prepared part key=_multipart_E0Y3SKNUYCQS.2~K1FGCS9IQTQV.1 size=174592 2024-09-12T17:04:52.739 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.735+0000 7f026be9d8c0 1 > prepared multipart upload key=E0Y3SKNUYCQS upload=K1FGCS9IQTQV tag=GH7A8AF95DJN type=write size=2271744 2024-09-12T17:04:52.742 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.739+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~THXLI7OXJ9KZ.0 size=307479 2024-09-12T17:04:52.747 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.743+0000 7f026be9d8c0 1 < completed multipart upload key=4G3BKGNT3YZC upload=THXLI7OXJ9KZ tag=WA7GUETDZ6VV type=write size=1356055 2024-09-12T17:04:52.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.747+0000 7f026be9d8c0 1 > prepared part key=_multipart_XNBE2II106VZ.2~SL0A6R9CKS7S.0 size=46486 2024-09-12T17:04:52.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.747+0000 7f026be9d8c0 1 > prepared multipart upload key=XNBE2II106VZ upload=SL0A6R9CKS7S tag=R1RNWE1D5FQK type=write size=1095062 2024-09-12T17:04:52.757 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.751+0000 7f026be9d8c0 1 < completed part key=_multipart_SO3HLQZA8B6B.2~32GJXRSIDCPI.0 size=85524 2024-09-12T17:04:52.764 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.759+0000 7f026be9d8c0 1 < completed multipart upload key=SO3HLQZA8B6B upload=32GJXRSIDCPI tag=PNJC53EB9EOE type=write size=1134100 2024-09-12T17:04:52.769 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.763+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z183NH6R676V.2~JK1PQDP4HZC2.0 size=1048576 2024-09-12T17:04:52.772 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.767+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z183NH6R676V.2~JK1PQDP4HZC2.1 size=1048576 2024-09-12T17:04:52.778 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.775+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z183NH6R676V.2~JK1PQDP4HZC2.2 size=94763 2024-09-12T17:04:52.778 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.775+0000 7f026be9d8c0 1 > prepared multipart upload key=Z183NH6R676V upload=JK1PQDP4HZC2 tag=FZU6YA5M6VL3 type=write size=3240491 2024-09-12T17:04:52.781 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.775+0000 7f026be9d8c0 1 < completed delete operation key=J8MU1A0CWSAQ tag=81T46V1GGD0M type=del 2024-09-12T17:04:52.785 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.779+0000 7f026be9d8c0 1 > prepared operation key=L194KQIPFLE1 tag=GYUG01HE97J9 type=del size=3820460 2024-09-12T17:04:52.786 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.783+0000 7f026be9d8c0 1 < canceled part key=_multipart_BW1T21LBUE2D.2~E5X57HGPWM5N.0 size=1048576 2024-09-12T17:04:52.790 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.783+0000 7f026be9d8c0 1 < completed part key=_multipart_BW1T21LBUE2D.2~E5X57HGPWM5N.1 size=1048576 2024-09-12T17:04:52.793 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.787+0000 7f026be9d8c0 1 < completed part key=_multipart_BW1T21LBUE2D.2~E5X57HGPWM5N.2 size=491171 2024-09-12T17:04:52.798 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.791+0000 7f026be9d8c0 1 < canceled multipart upload key=BW1T21LBUE2D upload=E5X57HGPWM5N tag=DETRR0LYI0GJ type=write size=3636899 2024-09-12T17:04:52.803 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.799+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~QH07WK8N7T2Y.0 size=389052 2024-09-12T17:04:52.803 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.799+0000 7f026be9d8c0 1 > prepared multipart upload key=Z9YNIEQCVNBA upload=QH07WK8N7T2Y tag=FTSFIKHGEI3D type=write size=1437628 2024-09-12T17:04:52.806 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.803+0000 7f026be9d8c0 1 < completed part key=_multipart_XNBE2II106VZ.2~CEZ6PCPLS0GJ.0 size=1048576 2024-09-12T17:04:52.808 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.803+0000 7f026be9d8c0 1 < completed part key=_multipart_XNBE2II106VZ.2~CEZ6PCPLS0GJ.1 size=488809 2024-09-12T17:04:52.813 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.807+0000 7f026be9d8c0 1 < completed multipart upload key=XNBE2II106VZ upload=CEZ6PCPLS0GJ tag=5HTX9XTTVCKF type=write size=2585961 2024-09-12T17:04:52.816 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.811+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=K5F75I5ZPE45 type=del size=920742 2024-09-12T17:04:52.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.815+0000 7f026be9d8c0 1 < suggested remove operation key=MVYWUWKSYQ9Z tag=LZ37N71OK6DQ type=del 2024-09-12T17:04:52.826 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.823+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~SVC5VMPWLKH7.0 size=1048576 2024-09-12T17:04:52.829 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.823+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~SVC5VMPWLKH7.1 size=1048576 2024-09-12T17:04:52.831 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.827+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~SVC5VMPWLKH7.2 size=510302 2024-09-12T17:04:52.831 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.827+0000 7f026be9d8c0 1 > prepared multipart upload key=8AFDAVJLMRD2 upload=SVC5VMPWLKH7 tag=FWI6YR8DXXIT type=write size=3656030 2024-09-12T17:04:52.834 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.831+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~N72V4MZHYPP1.0 size=1048576 2024-09-12T17:04:52.836 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.831+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~N72V4MZHYPP1.1 size=1048576 2024-09-12T17:04:52.838 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.835+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~N72V4MZHYPP1.2 size=375942 2024-09-12T17:04:52.843 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.839+0000 7f026be9d8c0 1 < completed multipart upload key=ALFGNC1YNROX upload=N72V4MZHYPP1 tag=HLF3BLSSNUZ9 type=write size=3521670 2024-09-12T17:04:52.849 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.843+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~HZ2T7C0M8GWS.0 size=1048576 2024-09-12T17:04:52.851 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.847+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~HZ2T7C0M8GWS.1 size=932929 2024-09-12T17:04:52.851 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.847+0000 7f026be9d8c0 1 > prepared multipart upload key=ALFGNC1YNROX upload=HZ2T7C0M8GWS tag=K2GUD6ZBE291 type=write size=3030081 2024-09-12T17:04:52.857 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.851+0000 7f026be9d8c0 1 < suggested update operation key=GPUFWJ3AWEMX tag=GLJP3OZ9OM9I type=write size=1038164 2024-09-12T17:04:52.862 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.855+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~Q08PZEEQJUUL.0 size=799354 2024-09-12T17:04:52.862 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.855+0000 7f026be9d8c0 1 > prepared multipart upload key=6VO85REZG2NW upload=Q08PZEEQJUUL tag=ATMHWW7U3MWD type=write size=1847930 2024-09-12T17:04:52.865 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.859+0000 7f026be9d8c0 1 < completed delete operation key=BBYDPSXZKHZP tag=4UEDI1NQSU5I type=del 2024-09-12T17:04:52.870 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.867+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~0PGQNN1FENJK.0 size=1048576 2024-09-12T17:04:52.872 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.867+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~0PGQNN1FENJK.1 size=799988 2024-09-12T17:04:52.872 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.867+0000 7f026be9d8c0 1 > prepared multipart upload key=SL2446KSB531 upload=0PGQNN1FENJK tag=DYYZ1KDD7XIZ type=write size=2897140 2024-09-12T17:04:52.875 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.871+0000 7f026be9d8c0 1 < completed write operation key=RBNN03IPZ8BT tag=2F0N2PA7ULT9 type=write size=750992 2024-09-12T17:04:52.878 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.875+0000 7f026be9d8c0 1 > prepared operation key=JJMEQ2O00SA2 tag=DFG48PK7KKZE type=del size=3847767 2024-09-12T17:04:52.881 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.875+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~GH3XE16MK8VW.0 size=1048576 2024-09-12T17:04:52.885 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.879+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~GH3XE16MK8VW.1 size=1048576 2024-09-12T17:04:52.888 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.883+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~GH3XE16MK8VW.2 size=134979 2024-09-12T17:04:52.893 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.887+0000 7f026be9d8c0 1 < completed multipart upload key=2BQJ30RQQ25L upload=GH3XE16MK8VW tag=07HB085S1WGQ type=write size=3280707 2024-09-12T17:04:52.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.891+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=2ODD7VFW2K5D type=del size=3614450 2024-09-12T17:04:52.899 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.895+0000 7f026be9d8c0 1 < completed part key=_multipart_MVYWUWKSYQ9Z.2~PB3DY8QLNFHU.0 size=1048576 2024-09-12T17:04:52.902 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.899+0000 7f026be9d8c0 1 < completed part key=_multipart_MVYWUWKSYQ9Z.2~PB3DY8QLNFHU.1 size=1048576 2024-09-12T17:04:52.905 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.899+0000 7f026be9d8c0 1 < completed part key=_multipart_MVYWUWKSYQ9Z.2~PB3DY8QLNFHU.2 size=236217 2024-09-12T17:04:52.910 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.903+0000 7f026be9d8c0 1 < completed multipart upload key=MVYWUWKSYQ9Z upload=PB3DY8QLNFHU tag=TE34JWZGEDZ5 type=write size=3381945 2024-09-12T17:04:52.915 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.911+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~HM01KS2AMUDG.0 size=1048576 2024-09-12T17:04:52.918 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.915+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~HM01KS2AMUDG.1 size=78465 2024-09-12T17:04:52.918 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.915+0000 7f026be9d8c0 1 > prepared multipart upload key=BW1T21LBUE2D upload=HM01KS2AMUDG tag=TTKAA0ADXYC0 type=write size=2175617 2024-09-12T17:04:52.921 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.915+0000 7f026be9d8c0 1 < completed delete operation key=E0Y3SKNUYCQS tag=LIS0EGZXCTSW type=del 2024-09-12T17:04:52.925 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.919+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=FYR8BETMRG3Q type=del size=2635090 2024-09-12T17:04:52.929 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.923+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~4QBQ8C983WWB.0 size=267349 2024-09-12T17:04:52.935 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.931+0000 7f026be9d8c0 1 < completed multipart upload key=Y27CDEOCM7DH upload=4QBQ8C983WWB tag=F7BFX3HVFJII type=write size=1315925 2024-09-12T17:04:52.938 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.935+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=N1KRXALOFU88 type=write size=657384 2024-09-12T17:04:52.942 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.939+0000 7f026be9d8c0 1 < canceled operation key=SGT8IC1GJ3IG tag=Z4ZGR0YZRPUO type=del size=3484322 2024-09-12T17:04:52.945 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.939+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=NOUSF52MTUJ1 type=del size=988602 2024-09-12T17:04:52.949 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.943+0000 7f026be9d8c0 1 < completed part key=_multipart_E0Y3SKNUYCQS.2~K1FGCS9IQTQV.0 size=1048576 2024-09-12T17:04:52.952 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.947+0000 7f026be9d8c0 1 < completed part key=_multipart_E0Y3SKNUYCQS.2~K1FGCS9IQTQV.1 size=174592 2024-09-12T17:04:52.958 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.955+0000 7f026be9d8c0 1 < completed multipart upload key=E0Y3SKNUYCQS upload=K1FGCS9IQTQV tag=GH7A8AF95DJN type=write size=2271744 2024-09-12T17:04:52.961 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.955+0000 7f026be9d8c0 1 > prepared operation key=Y27CDEOCM7DH tag=4L5W08YJFVHA type=del size=4114156 2024-09-12T17:04:52.968 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.959+0000 7f026be9d8c0 1 < completed part key=_multipart_XNBE2II106VZ.2~SL0A6R9CKS7S.0 size=46486 2024-09-12T17:04:52.971 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.967+0000 7f026be9d8c0 1 < completed multipart upload key=XNBE2II106VZ upload=SL0A6R9CKS7S tag=R1RNWE1D5FQK type=write size=1095062 2024-09-12T17:04:52.977 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.971+0000 7f026be9d8c0 1 > prepared part key=_multipart_SGT8IC1GJ3IG.2~K7J7EHDXFOSD.0 size=1048576 2024-09-12T17:04:52.980 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.975+0000 7f026be9d8c0 1 > prepared part key=_multipart_SGT8IC1GJ3IG.2~K7J7EHDXFOSD.1 size=722902 2024-09-12T17:04:52.980 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.975+0000 7f026be9d8c0 1 > prepared multipart upload key=SGT8IC1GJ3IG upload=K7J7EHDXFOSD tag=VISCLIFXWPD4 type=write size=2820054 2024-09-12T17:04:52.983 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.979+0000 7f026be9d8c0 1 < completed part key=_multipart_Z183NH6R676V.2~JK1PQDP4HZC2.0 size=1048576 2024-09-12T17:04:52.986 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.983+0000 7f026be9d8c0 1 < completed part key=_multipart_Z183NH6R676V.2~JK1PQDP4HZC2.1 size=1048576 2024-09-12T17:04:52.989 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.983+0000 7f026be9d8c0 1 < completed part key=_multipart_Z183NH6R676V.2~JK1PQDP4HZC2.2 size=94763 2024-09-12T17:04:52.995 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.991+0000 7f026be9d8c0 1 < completed multipart upload key=Z183NH6R676V upload=JK1PQDP4HZC2 tag=FZU6YA5M6VL3 type=write size=3240491 2024-09-12T17:04:53.001 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.995+0000 7f026be9d8c0 1 > prepared part key=_multipart_4U1W97V0OX11.2~Z0ESN6HQOMW9.0 size=1048576 2024-09-12T17:04:53.004 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:52.999+0000 7f026be9d8c0 1 > prepared part key=_multipart_4U1W97V0OX11.2~Z0ESN6HQOMW9.1 size=1048576 2024-09-12T17:04:53.007 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.003+0000 7f026be9d8c0 1 > prepared part key=_multipart_4U1W97V0OX11.2~Z0ESN6HQOMW9.2 size=411079 2024-09-12T17:04:53.007 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.003+0000 7f026be9d8c0 1 > prepared multipart upload key=4U1W97V0OX11 upload=Z0ESN6HQOMW9 tag=J9Y9ZATVAXEL type=write size=3556807 2024-09-12T17:04:53.010 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.007+0000 7f026be9d8c0 1 < completed delete operation key=L194KQIPFLE1 tag=GYUG01HE97J9 type=del 2024-09-12T17:04:53.014 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.007+0000 7f026be9d8c0 1 > prepared operation key=T6QRDTQRHBPI tag=2N9XVO3Q8T47 type=del size=3877841 2024-09-12T17:04:53.017 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.011+0000 7f026be9d8c0 1 < completed part key=_multipart_Z9YNIEQCVNBA.2~QH07WK8N7T2Y.0 size=389052 2024-09-12T17:04:53.023 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.019+0000 7f026be9d8c0 1 < completed multipart upload key=Z9YNIEQCVNBA upload=QH07WK8N7T2Y tag=FTSFIKHGEI3D type=write size=1437628 2024-09-12T17:04:53.031 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.027+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~K2APTZ6ZYYP3.0 size=1048576 2024-09-12T17:04:53.034 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.027+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~K2APTZ6ZYYP3.1 size=1048576 2024-09-12T17:04:53.036 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.031+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~K2APTZ6ZYYP3.2 size=796193 2024-09-12T17:04:53.036 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.031+0000 7f026be9d8c0 1 > prepared multipart upload key=JJMEQ2O00SA2 upload=K2APTZ6ZYYP3 tag=YM5Y7XCRR25B type=write size=3941921 2024-09-12T17:04:53.040 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.035+0000 7f026be9d8c0 1 < completed delete operation key=U8W1SAVSLTBF tag=K5F75I5ZPE45 type=del 2024-09-12T17:04:53.046 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.043+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~0Z2N0F3SLOE1.0 size=1048576 2024-09-12T17:04:53.048 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.043+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~0Z2N0F3SLOE1.1 size=1048576 2024-09-12T17:04:53.051 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.047+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~0Z2N0F3SLOE1.2 size=540326 2024-09-12T17:04:53.051 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.047+0000 7f026be9d8c0 1 > prepared multipart upload key=2BQJ30RQQ25L upload=0Z2N0F3SLOE1 tag=RMCNGEMBUZYW type=write size=3686054 2024-09-12T17:04:53.055 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.051+0000 7f026be9d8c0 1 < completed part key=_multipart_8AFDAVJLMRD2.2~SVC5VMPWLKH7.0 size=1048576 2024-09-12T17:04:53.057 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.051+0000 7f026be9d8c0 1 < completed part key=_multipart_8AFDAVJLMRD2.2~SVC5VMPWLKH7.1 size=1048576 2024-09-12T17:04:53.060 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.055+0000 7f026be9d8c0 1 < completed part key=_multipart_8AFDAVJLMRD2.2~SVC5VMPWLKH7.2 size=510302 2024-09-12T17:04:53.065 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.059+0000 7f026be9d8c0 1 < completed multipart upload key=8AFDAVJLMRD2 upload=SVC5VMPWLKH7 tag=FWI6YR8DXXIT type=write size=3656030 2024-09-12T17:04:53.068 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.063+0000 7f026be9d8c0 1 > prepared operation key=Z183NH6R676V tag=ZXK9PD2CTYH8 type=del size=3220198 2024-09-12T17:04:53.074 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.071+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~HZ2T7C0M8GWS.0 size=1048576 2024-09-12T17:04:53.077 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.071+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~HZ2T7C0M8GWS.1 size=932929 2024-09-12T17:04:53.082 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.079+0000 7f026be9d8c0 1 < completed multipart upload key=ALFGNC1YNROX upload=HZ2T7C0M8GWS tag=K2GUD6ZBE291 type=write size=3030081 2024-09-12T17:04:53.086 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.083+0000 7f026be9d8c0 1 > prepared operation key=J8MU1A0CWSAQ tag=WRI01FVIYSPJ type=del size=3327934 2024-09-12T17:04:53.089 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.083+0000 7f026be9d8c0 1 < completed part key=_multipart_6VO85REZG2NW.2~Q08PZEEQJUUL.0 size=799354 2024-09-12T17:04:53.095 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.091+0000 7f026be9d8c0 1 < completed multipart upload key=6VO85REZG2NW upload=Q08PZEEQJUUL tag=ATMHWW7U3MWD type=write size=1847930 2024-09-12T17:04:53.098 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.095+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=M339P15QUHH3 type=del size=893854 2024-09-12T17:04:53.102 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.099+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~0PGQNN1FENJK.0 size=1048576 2024-09-12T17:04:53.105 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.099+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~0PGQNN1FENJK.1 size=799988 2024-09-12T17:04:53.112 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.107+0000 7f026be9d8c0 1 < completed multipart upload key=SL2446KSB531 upload=0PGQNN1FENJK tag=DYYZ1KDD7XIZ type=write size=2897140 2024-09-12T17:04:53.116 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.111+0000 7f026be9d8c0 1 > prepared operation key=2BQJ30RQQ25L tag=21SKZJ68VVN4 type=del size=3114889 2024-09-12T17:04:53.122 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.119+0000 7f026be9d8c0 1 < suggested remove operation key=JJMEQ2O00SA2 tag=DFG48PK7KKZE type=del 2024-09-12T17:04:53.126 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.123+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=40WFJLJTG6C6 type=del size=1562573 2024-09-12T17:04:53.133 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.127+0000 7f026be9d8c0 1 < suggested update operation key=RBNN03IPZ8BT tag=2ODD7VFW2K5D type=del size=3614450 2024-09-12T17:04:53.139 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.135+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~IRACFXGY1FOY.0 size=1048576 2024-09-12T17:04:53.142 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.139+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~IRACFXGY1FOY.1 size=1048576 2024-09-12T17:04:53.145 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.139+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~IRACFXGY1FOY.2 size=719907 2024-09-12T17:04:53.145 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.139+0000 7f026be9d8c0 1 > prepared multipart upload key=32XUMOWT8HO2 upload=IRACFXGY1FOY tag=HPJK8AIKH6EN type=write size=3865635 2024-09-12T17:04:53.148 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.143+0000 7f026be9d8c0 1 < completed part key=_multipart_BW1T21LBUE2D.2~HM01KS2AMUDG.0 size=1048576 2024-09-12T17:04:53.151 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.147+0000 7f026be9d8c0 1 < completed part key=_multipart_BW1T21LBUE2D.2~HM01KS2AMUDG.1 size=78465 2024-09-12T17:04:53.157 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.151+0000 7f026be9d8c0 1 < completed multipart upload key=BW1T21LBUE2D upload=HM01KS2AMUDG tag=TTKAA0ADXYC0 type=write size=2175617 2024-09-12T17:04:53.164 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.159+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~VVZ2R4839HW5.0 size=1048576 2024-09-12T17:04:53.166 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.163+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~VVZ2R4839HW5.1 size=573396 2024-09-12T17:04:53.166 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.163+0000 7f026be9d8c0 1 > prepared multipart upload key=Y27CDEOCM7DH upload=VVZ2R4839HW5 tag=TRS3CC7BNDN5 type=write size=2670548 2024-09-12T17:04:53.174 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.167+0000 7f026be9d8c0 1 < suggested remove operation key=3JADN360QEO3 tag=FYR8BETMRG3Q type=del 2024-09-12T17:04:53.181 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.175+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~NKZ322BI9YQM.0 size=922307 2024-09-12T17:04:53.181 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.175+0000 7f026be9d8c0 1 > prepared multipart upload key=Y27CDEOCM7DH upload=NKZ322BI9YQM tag=EK463WV93M21 type=write size=1970883 2024-09-12T17:04:53.187 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.183+0000 7f026be9d8c0 1 < suggested update operation key=RBNN03IPZ8BT tag=N1KRXALOFU88 type=write size=657384 2024-09-12T17:04:53.191 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.187+0000 7f026be9d8c0 1 > prepared operation key=2BQJ30RQQ25L tag=I4SETJQOEF8E type=del size=3451663 2024-09-12T17:04:53.193 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.187+0000 7f026be9d8c0 -1 < no bi entry to suggest for operation key=3JADN360QEO3 tag=NOUSF52MTUJ1 type=del size=988602: (2) No such file or directory 2024-09-12T17:04:53.199 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.195+0000 7f026be9d8c0 1 > prepared part key=_multipart_3JADN360QEO3.2~E9IPFP5WDE0D.0 size=1039940 2024-09-12T17:04:53.199 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.195+0000 7f026be9d8c0 1 > prepared multipart upload key=3JADN360QEO3 upload=E9IPFP5WDE0D tag=AL98ZIKP044R type=write size=2088516 2024-09-12T17:04:53.203 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.199+0000 7f026be9d8c0 1 < completed delete operation key=Y27CDEOCM7DH tag=4L5W08YJFVHA type=del 2024-09-12T17:04:53.209 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.203+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~UDFICLR2B8AO.0 size=1048576 2024-09-12T17:04:53.212 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.207+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~UDFICLR2B8AO.1 size=350888 2024-09-12T17:04:53.212 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.207+0000 7f026be9d8c0 1 > prepared multipart upload key=JJMEQ2O00SA2 upload=UDFICLR2B8AO tag=WQ1G5203A1KJ type=write size=2448040 2024-09-12T17:04:53.216 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.211+0000 7f026be9d8c0 1 < completed part key=_multipart_SGT8IC1GJ3IG.2~K7J7EHDXFOSD.0 size=1048576 2024-09-12T17:04:53.219 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.215+0000 7f026be9d8c0 1 < completed part key=_multipart_SGT8IC1GJ3IG.2~K7J7EHDXFOSD.1 size=722902 2024-09-12T17:04:53.225 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.219+0000 7f026be9d8c0 1 < completed multipart upload key=SGT8IC1GJ3IG upload=K7J7EHDXFOSD tag=VISCLIFXWPD4 type=write size=2820054 2024-09-12T17:04:53.232 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.227+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~DA63CUUB1OUY.0 size=683589 2024-09-12T17:04:53.232 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.227+0000 7f026be9d8c0 1 > prepared multipart upload key=SL2446KSB531 upload=DA63CUUB1OUY tag=UC96I8SVMMX1 type=write size=1732165 2024-09-12T17:04:53.235 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.231+0000 7f026be9d8c0 1 < completed part key=_multipart_4U1W97V0OX11.2~Z0ESN6HQOMW9.0 size=1048576 2024-09-12T17:04:53.237 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.231+0000 7f026be9d8c0 1 < completed part key=_multipart_4U1W97V0OX11.2~Z0ESN6HQOMW9.1 size=1048576 2024-09-12T17:04:53.240 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.235+0000 7f026be9d8c0 1 < completed part key=_multipart_4U1W97V0OX11.2~Z0ESN6HQOMW9.2 size=411079 2024-09-12T17:04:53.245 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.239+0000 7f026be9d8c0 1 < completed multipart upload key=4U1W97V0OX11 upload=Z0ESN6HQOMW9 tag=J9Y9ZATVAXEL type=write size=3556807 2024-09-12T17:04:53.251 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.247+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~5IOQ2GBW5U2D.0 size=1048576 2024-09-12T17:04:53.253 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.247+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~5IOQ2GBW5U2D.1 size=1039497 2024-09-12T17:04:53.253 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.247+0000 7f026be9d8c0 1 > prepared multipart upload key=BW1T21LBUE2D upload=5IOQ2GBW5U2D tag=Z5Z3BICXZO0A type=write size=3136649 2024-09-12T17:04:53.256 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.251+0000 7f026be9d8c0 1 < completed delete operation key=T6QRDTQRHBPI tag=2N9XVO3Q8T47 type=del 2024-09-12T17:04:53.261 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.255+0000 7f026be9d8c0 1 > prepared part key=_multipart_E0Y3SKNUYCQS.2~9I27BSYR1OLR.0 size=1048576 2024-09-12T17:04:53.263 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.259+0000 7f026be9d8c0 1 > prepared part key=_multipart_E0Y3SKNUYCQS.2~9I27BSYR1OLR.1 size=503292 2024-09-12T17:04:53.264 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.259+0000 7f026be9d8c0 1 > prepared multipart upload key=E0Y3SKNUYCQS upload=9I27BSYR1OLR tag=PA3MPQPEOECQ type=write size=2600444 2024-09-12T17:04:53.267 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.263+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~K2APTZ6ZYYP3.0 size=1048576 2024-09-12T17:04:53.269 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.263+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~K2APTZ6ZYYP3.1 size=1048576 2024-09-12T17:04:53.272 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.267+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~K2APTZ6ZYYP3.2 size=796193 2024-09-12T17:04:53.277 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.271+0000 7f026be9d8c0 1 < completed multipart upload key=JJMEQ2O00SA2 upload=K2APTZ6ZYYP3 tag=YM5Y7XCRR25B type=write size=3941921 2024-09-12T17:04:53.283 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.279+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z183NH6R676V.2~U67O3C1VHDQF.0 size=388942 2024-09-12T17:04:53.283 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.279+0000 7f026be9d8c0 1 > prepared multipart upload key=Z183NH6R676V upload=U67O3C1VHDQF tag=21DDGVQW3XTH type=write size=1437518 2024-09-12T17:04:53.284 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.279+0000 7f026be9d8c0 1 < canceled part key=_multipart_2BQJ30RQQ25L.2~0Z2N0F3SLOE1.0 size=1048576 2024-09-12T17:04:53.287 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.283+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~0Z2N0F3SLOE1.1 size=1048576 2024-09-12T17:04:53.289 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.283+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~0Z2N0F3SLOE1.2 size=540326 2024-09-12T17:04:53.294 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.291+0000 7f026be9d8c0 1 < canceled multipart upload key=2BQJ30RQQ25L upload=0Z2N0F3SLOE1 tag=RMCNGEMBUZYW type=write size=3686054 2024-09-12T17:04:53.300 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.295+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~JKO0HDM5BA8G.0 size=134080 2024-09-12T17:04:53.300 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.295+0000 7f026be9d8c0 1 > prepared multipart upload key=Z9YNIEQCVNBA upload=JKO0HDM5BA8G tag=Q49KNP3N77HL type=write size=1182656 2024-09-12T17:04:53.304 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.299+0000 7f026be9d8c0 1 < completed delete operation key=Z183NH6R676V tag=ZXK9PD2CTYH8 type=del 2024-09-12T17:04:53.308 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.303+0000 7f026be9d8c0 1 > prepared operation key=J8MU1A0CWSAQ tag=1J0F2SHAT5IF type=del size=3322056 2024-09-12T17:04:53.311 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.307+0000 7f026be9d8c0 1 < completed delete operation key=J8MU1A0CWSAQ tag=WRI01FVIYSPJ type=del 2024-09-12T17:04:53.314 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.311+0000 7f026be9d8c0 1 > prepared operation key=UU88OS653L8D tag=3B10SRPRHCT7 type=del size=1704291 2024-09-12T17:04:53.318 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.311+0000 7f026be9d8c0 -1 < failed to complete operation key=RBNN03IPZ8BT tag=M339P15QUHH3 type=del size=893854: (22) Invalid argument 2024-09-12T17:04:53.323 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.319+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~AJG990ITOUU5.0 size=1048576 2024-09-12T17:04:53.325 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.319+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~AJG990ITOUU5.1 size=1048576 2024-09-12T17:04:53.328 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.323+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~AJG990ITOUU5.2 size=273698 2024-09-12T17:04:53.328 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.323+0000 7f026be9d8c0 1 > prepared multipart upload key=QVQ4TI319DH5 upload=AJG990ITOUU5 tag=UST2UJHVXUQ6 type=write size=3419426 2024-09-12T17:04:53.335 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.331+0000 7f026be9d8c0 1 < suggested remove operation key=2BQJ30RQQ25L tag=21SKZJ68VVN4 type=del 2024-09-12T17:04:53.344 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.339+0000 7f026be9d8c0 1 > prepared part key=_multipart_LHKLWIUAT08F.2~MVNGCNJ8UK0Q.0 size=64880 2024-09-12T17:04:53.345 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.339+0000 7f026be9d8c0 1 > prepared multipart upload key=LHKLWIUAT08F upload=MVNGCNJ8UK0Q tag=Q0O2LNYHP6O8 type=write size=1113456 2024-09-12T17:04:53.346 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.339+0000 7f026be9d8c0 -1 < failed to complete operation key=RBNN03IPZ8BT tag=40WFJLJTG6C6 type=del size=1562573: (22) Invalid argument 2024-09-12T17:04:53.350 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.343+0000 7f026be9d8c0 1 > prepared operation key=XNBE2II106VZ tag=3MZV4BG04EHC type=del size=3041135 2024-09-12T17:04:53.353 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.347+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~IRACFXGY1FOY.0 size=1048576 2024-09-12T17:04:53.356 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.351+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~IRACFXGY1FOY.1 size=1048576 2024-09-12T17:04:53.356 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.351+0000 7f026be9d8c0 1 < canceled part key=_multipart_32XUMOWT8HO2.2~IRACFXGY1FOY.2 size=719907 2024-09-12T17:04:53.361 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.355+0000 7f026be9d8c0 1 < canceled multipart upload key=32XUMOWT8HO2 upload=IRACFXGY1FOY tag=HPJK8AIKH6EN type=write size=3865635 2024-09-12T17:04:53.365 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.359+0000 7f026be9d8c0 1 > prepared operation key=XNBE2II106VZ tag=GDX84BH3CFZE type=del size=3318387 2024-09-12T17:04:53.369 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.363+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~VVZ2R4839HW5.0 size=1048576 2024-09-12T17:04:53.372 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.367+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~VVZ2R4839HW5.1 size=573396 2024-09-12T17:04:53.378 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.375+0000 7f026be9d8c0 1 < completed multipart upload key=Y27CDEOCM7DH upload=VVZ2R4839HW5 tag=TRS3CC7BNDN5 type=write size=2670548 2024-09-12T17:04:53.384 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.379+0000 7f026be9d8c0 1 > prepared part key=_multipart_RBNN03IPZ8BT.2~0KS0KPJH0N9V.0 size=152030 2024-09-12T17:04:53.385 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.379+0000 7f026be9d8c0 1 > prepared multipart upload key=RBNN03IPZ8BT upload=0KS0KPJH0N9V tag=5D27XZTIRHNT type=write size=1200606 2024-09-12T17:04:53.391 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.387+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~NKZ322BI9YQM.0 size=922307 2024-09-12T17:04:53.396 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.391+0000 7f026be9d8c0 1 < completed multipart upload key=Y27CDEOCM7DH upload=NKZ322BI9YQM tag=EK463WV93M21 type=write size=1970883 2024-09-12T17:04:53.404 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.399+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~URL9JFDNQE6M.0 size=711484 2024-09-12T17:04:53.404 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.399+0000 7f026be9d8c0 1 > prepared multipart upload key=J8MU1A0CWSAQ upload=URL9JFDNQE6M tag=P3GGXT4JOVWY type=write size=1760060 2024-09-12T17:04:53.407 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.403+0000 7f026be9d8c0 -1 < failed to complete operation key=2BQJ30RQQ25L tag=I4SETJQOEF8E type=del size=3451663: (22) Invalid argument 2024-09-12T17:04:53.411 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.407+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=980TW71XIJED type=del size=1745469 2024-09-12T17:04:53.414 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.411+0000 7f026be9d8c0 1 < completed part key=_multipart_3JADN360QEO3.2~E9IPFP5WDE0D.0 size=1039940 2024-09-12T17:04:53.419 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.415+0000 7f026be9d8c0 1 < completed multipart upload key=3JADN360QEO3 upload=E9IPFP5WDE0D tag=AL98ZIKP044R type=write size=2088516 2024-09-12T17:04:53.422 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.415+0000 7f026be9d8c0 1 > prepared operation key=PQSQ39X3O64P tag=BTF0DI06MT8M type=write size=351068 2024-09-12T17:04:53.422 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.419+0000 7f026be9d8c0 1 < canceled part key=_multipart_JJMEQ2O00SA2.2~UDFICLR2B8AO.0 size=1048576 2024-09-12T17:04:53.425 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.419+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~UDFICLR2B8AO.1 size=350888 2024-09-12T17:04:53.430 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.427+0000 7f026be9d8c0 1 < canceled multipart upload key=JJMEQ2O00SA2 upload=UDFICLR2B8AO tag=WQ1G5203A1KJ type=write size=2448040 2024-09-12T17:04:53.434 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.427+0000 7f026be9d8c0 1 > prepared operation key=J8MU1A0CWSAQ tag=YJN9GYN92IM4 type=del size=402257 2024-09-12T17:04:53.437 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.431+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~DA63CUUB1OUY.0 size=683589 2024-09-12T17:04:53.442 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.439+0000 7f026be9d8c0 1 < completed multipart upload key=SL2446KSB531 upload=DA63CUUB1OUY tag=UC96I8SVMMX1 type=write size=1732165 2024-09-12T17:04:53.448 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.443+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~1VEWKL8MZPIX.0 size=1048576 2024-09-12T17:04:53.450 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.447+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~1VEWKL8MZPIX.1 size=97019 2024-09-12T17:04:53.450 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.447+0000 7f026be9d8c0 1 > prepared multipart upload key=6VO85REZG2NW upload=1VEWKL8MZPIX tag=MERENHMFTD1Y type=write size=2194171 2024-09-12T17:04:53.451 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.447+0000 7f026be9d8c0 1 < canceled part key=_multipart_BW1T21LBUE2D.2~5IOQ2GBW5U2D.0 size=1048576 2024-09-12T17:04:53.453 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.447+0000 7f026be9d8c0 1 < completed part key=_multipart_BW1T21LBUE2D.2~5IOQ2GBW5U2D.1 size=1039497 2024-09-12T17:04:53.458 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.455+0000 7f026be9d8c0 1 < canceled multipart upload key=BW1T21LBUE2D upload=5IOQ2GBW5U2D tag=Z5Z3BICXZO0A type=write size=3136649 2024-09-12T17:04:53.461 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.455+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=OZCP48KBI46Q type=del size=2675625 2024-09-12T17:04:53.464 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.459+0000 7f026be9d8c0 1 < completed part key=_multipart_E0Y3SKNUYCQS.2~9I27BSYR1OLR.0 size=1048576 2024-09-12T17:04:53.466 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.463+0000 7f026be9d8c0 1 < completed part key=_multipart_E0Y3SKNUYCQS.2~9I27BSYR1OLR.1 size=503292 2024-09-12T17:04:53.471 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.467+0000 7f026be9d8c0 1 < completed multipart upload key=E0Y3SKNUYCQS upload=9I27BSYR1OLR tag=PA3MPQPEOECQ type=write size=2600444 2024-09-12T17:04:53.475 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.471+0000 7f026be9d8c0 1 > prepared operation key=Y27CDEOCM7DH tag=U7KXFM8X6WY5 type=del size=2752470 2024-09-12T17:04:53.478 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.471+0000 7f026be9d8c0 1 < completed part key=_multipart_Z183NH6R676V.2~U67O3C1VHDQF.0 size=388942 2024-09-12T17:04:53.482 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.479+0000 7f026be9d8c0 1 < completed multipart upload key=Z183NH6R676V upload=U67O3C1VHDQF tag=21DDGVQW3XTH type=write size=1437518 2024-09-12T17:04:53.486 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.479+0000 7f026be9d8c0 1 > prepared operation key=LHKLWIUAT08F tag=TC011D3LOY5P type=del size=779902 2024-09-12T17:04:53.486 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.483+0000 7f026be9d8c0 1 < canceled part key=_multipart_Z9YNIEQCVNBA.2~JKO0HDM5BA8G.0 size=134080 2024-09-12T17:04:53.491 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.487+0000 7f026be9d8c0 1 < canceled multipart upload key=Z9YNIEQCVNBA upload=JKO0HDM5BA8G tag=Q49KNP3N77HL type=write size=1182656 2024-09-12T17:04:53.496 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.491+0000 7f026be9d8c0 1 > prepared operation key=2BQJ30RQQ25L tag=U5ZTQH3GL557 type=del size=3317200 2024-09-12T17:04:53.499 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.495+0000 7f026be9d8c0 1 < completed delete operation key=J8MU1A0CWSAQ tag=1J0F2SHAT5IF type=del 2024-09-12T17:04:53.502 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.499+0000 7f026be9d8c0 1 > prepared operation key=JJMEQ2O00SA2 tag=NLFBG7VY5GQ0 type=del size=936965 2024-09-12T17:04:53.508 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.503+0000 7f026be9d8c0 1 < suggested update operation key=UU88OS653L8D tag=3B10SRPRHCT7 type=del size=1704291 2024-09-12T17:04:53.514 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.511+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~VRKGI9KIRVZX.0 size=1048576 2024-09-12T17:04:53.517 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.511+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~VRKGI9KIRVZX.1 size=200679 2024-09-12T17:04:53.517 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.511+0000 7f026be9d8c0 1 > prepared multipart upload key=4G3BKGNT3YZC upload=VRKGI9KIRVZX tag=E3JACFR7QYFW type=write size=2297831 2024-09-12T17:04:53.520 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.515+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~AJG990ITOUU5.0 size=1048576 2024-09-12T17:04:53.523 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.519+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~AJG990ITOUU5.1 size=1048576 2024-09-12T17:04:53.526 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.523+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~AJG990ITOUU5.2 size=273698 2024-09-12T17:04:53.532 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.527+0000 7f026be9d8c0 1 < completed multipart upload key=QVQ4TI319DH5 upload=AJG990ITOUU5 tag=UST2UJHVXUQ6 type=write size=3419426 2024-09-12T17:04:53.535 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.531+0000 7f026be9d8c0 1 > prepared operation key=Z9YNIEQCVNBA tag=1MI66V8CSO5R type=del size=1147855 2024-09-12T17:04:53.539 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.535+0000 7f026be9d8c0 1 < completed part key=_multipart_LHKLWIUAT08F.2~MVNGCNJ8UK0Q.0 size=64880 2024-09-12T17:04:53.545 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.539+0000 7f026be9d8c0 1 < completed multipart upload key=LHKLWIUAT08F upload=MVNGCNJ8UK0Q tag=Q0O2LNYHP6O8 type=write size=1113456 2024-09-12T17:04:53.548 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.543+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=XIWYUIGJJJH5 type=del size=3214667 2024-09-12T17:04:53.552 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.547+0000 7f026be9d8c0 1 < completed delete operation key=XNBE2II106VZ tag=3MZV4BG04EHC type=del 2024-09-12T17:04:53.558 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.555+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~AZ3923ISUCR8.0 size=1048576 2024-09-12T17:04:53.561 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.555+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~AZ3923ISUCR8.1 size=682960 2024-09-12T17:04:53.561 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.555+0000 7f026be9d8c0 1 > prepared multipart upload key=SL2446KSB531 upload=AZ3923ISUCR8 tag=1H24MWT13MXJ type=write size=2780112 2024-09-12T17:04:53.564 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.559+0000 7f026be9d8c0 1 < completed delete operation key=XNBE2II106VZ tag=GDX84BH3CFZE type=del 2024-09-12T17:04:53.571 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.567+0000 7f026be9d8c0 1 > prepared part key=_multipart_U8W1SAVSLTBF.2~MY1GDJHDP4IU.0 size=1048576 2024-09-12T17:04:53.573 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.567+0000 7f026be9d8c0 1 > prepared part key=_multipart_U8W1SAVSLTBF.2~MY1GDJHDP4IU.1 size=711307 2024-09-12T17:04:53.573 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.567+0000 7f026be9d8c0 1 > prepared multipart upload key=U8W1SAVSLTBF upload=MY1GDJHDP4IU tag=949TO9VNM7DM type=write size=2808459 2024-09-12T17:04:53.577 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.571+0000 7f026be9d8c0 1 < completed part key=_multipart_RBNN03IPZ8BT.2~0KS0KPJH0N9V.0 size=152030 2024-09-12T17:04:53.584 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.579+0000 7f026be9d8c0 1 < completed multipart upload key=RBNN03IPZ8BT upload=0KS0KPJH0N9V tag=5D27XZTIRHNT type=write size=1200606 2024-09-12T17:04:53.586 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.583+0000 7f026be9d8c0 1 > prepared operation key=4U1W97V0OX11 tag=S037A05L89S4 type=del size=995819 2024-09-12T17:04:53.590 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.583+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~URL9JFDNQE6M.0 size=711484 2024-09-12T17:04:53.596 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.591+0000 7f026be9d8c0 1 < completed multipart upload key=J8MU1A0CWSAQ upload=URL9JFDNQE6M tag=P3GGXT4JOVWY type=write size=1760060 2024-09-12T17:04:53.603 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.599+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~X4RJ0QH3QPU6.0 size=1048576 2024-09-12T17:04:53.605 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.599+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~X4RJ0QH3QPU6.1 size=993479 2024-09-12T17:04:53.605 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.599+0000 7f026be9d8c0 1 > prepared multipart upload key=GPUFWJ3AWEMX upload=X4RJ0QH3QPU6 tag=8GRZIJTBPXJ1 type=write size=3090631 2024-09-12T17:04:53.612 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.607+0000 7f026be9d8c0 1 < suggested remove operation key=3JADN360QEO3 tag=980TW71XIJED type=del 2024-09-12T17:04:53.615 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.611+0000 7f026be9d8c0 1 > prepared operation key=E0Y3SKNUYCQS tag=IFF1A5NHMPCV type=del size=2328957 2024-09-12T17:04:53.621 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.615+0000 7f026be9d8c0 1 < suggested update operation key=PQSQ39X3O64P tag=BTF0DI06MT8M type=write size=351068 2024-09-12T17:04:53.628 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.623+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~ISWVXC27AJDP.0 size=1048576 2024-09-12T17:04:53.631 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.627+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~ISWVXC27AJDP.1 size=614890 2024-09-12T17:04:53.632 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.627+0000 7f026be9d8c0 1 > prepared multipart upload key=UU88OS653L8D upload=ISWVXC27AJDP tag=U7L8BQ82PZGA type=write size=2712042 2024-09-12T17:04:53.638 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.635+0000 7f026be9d8c0 1 < suggested update operation key=J8MU1A0CWSAQ tag=YJN9GYN92IM4 type=del size=402257 2024-09-12T17:04:53.641 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.635+0000 7f026be9d8c0 1 > prepared operation key=XLKR6P8RNRVO tag=ROYR66A1QBI9 type=del size=3123429 2024-09-12T17:04:53.645 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.639+0000 7f026be9d8c0 1 < completed part key=_multipart_6VO85REZG2NW.2~1VEWKL8MZPIX.0 size=1048576 2024-09-12T17:04:53.648 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.643+0000 7f026be9d8c0 1 < completed part key=_multipart_6VO85REZG2NW.2~1VEWKL8MZPIX.1 size=97019 2024-09-12T17:04:53.653 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.647+0000 7f026be9d8c0 1 < completed multipart upload key=6VO85REZG2NW upload=1VEWKL8MZPIX tag=MERENHMFTD1Y type=write size=2194171 2024-09-12T17:04:53.656 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.651+0000 7f026be9d8c0 1 > prepared operation key=SO3HLQZA8B6B tag=W2SNF2SBJFJW type=del size=1036838 2024-09-12T17:04:53.659 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.655+0000 7f026be9d8c0 1 < completed delete operation key=U8W1SAVSLTBF tag=OZCP48KBI46Q type=del 2024-09-12T17:04:53.662 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.659+0000 7f026be9d8c0 1 > prepared operation key=BW1T21LBUE2D tag=HG3N03KZMCIP type=del size=413464 2024-09-12T17:04:53.665 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.659+0000 7f026be9d8c0 1 < completed delete operation key=Y27CDEOCM7DH tag=U7KXFM8X6WY5 type=del 2024-09-12T17:04:53.669 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.663+0000 7f026be9d8c0 1 > prepared operation key=8AFDAVJLMRD2 tag=L0YU3L8I02O4 type=del size=1736483 2024-09-12T17:04:53.672 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.667+0000 7f026be9d8c0 1 < completed delete operation key=LHKLWIUAT08F tag=TC011D3LOY5P type=del 2024-09-12T17:04:53.676 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.671+0000 7f026be9d8c0 1 > prepared operation key=MVYWUWKSYQ9Z tag=K1DD3QKF0AQX type=del size=517158 2024-09-12T17:04:53.683 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.679+0000 7f026be9d8c0 1 < suggested remove operation key=2BQJ30RQQ25L tag=U5ZTQH3GL557 type=del 2024-09-12T17:04:53.686 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.683+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=UW7WMF08WNUQ type=del size=1707675 2024-09-12T17:04:53.689 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.683+0000 7f026be9d8c0 1 < completed delete operation key=JJMEQ2O00SA2 tag=NLFBG7VY5GQ0 type=del 2024-09-12T17:04:53.693 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.687+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=DQ8XBHAKG0NU type=del size=1756237 2024-09-12T17:04:53.697 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.691+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~VRKGI9KIRVZX.0 size=1048576 2024-09-12T17:04:53.702 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.699+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~VRKGI9KIRVZX.1 size=200679 2024-09-12T17:04:53.708 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.703+0000 7f026be9d8c0 1 < completed multipart upload key=4G3BKGNT3YZC upload=VRKGI9KIRVZX tag=E3JACFR7QYFW type=write size=2297831 2024-09-12T17:04:53.712 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.707+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=ZYNYMCCNSEAV type=write size=902239 2024-09-12T17:04:53.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.715+0000 7f026be9d8c0 1 < suggested remove operation key=Z9YNIEQCVNBA tag=1MI66V8CSO5R type=del 2024-09-12T17:04:53.724 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.719+0000 7f026be9d8c0 1 > prepared part key=_multipart_4U1W97V0OX11.2~5CTL3OZY28K5.0 size=1048576 2024-09-12T17:04:53.726 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.723+0000 7f026be9d8c0 1 > prepared part key=_multipart_4U1W97V0OX11.2~5CTL3OZY28K5.1 size=844992 2024-09-12T17:04:53.726 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.723+0000 7f026be9d8c0 1 > prepared multipart upload key=4U1W97V0OX11 upload=5CTL3OZY28K5 tag=4ZJBXKU0JTSO type=write size=2942144 2024-09-12T17:04:53.730 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.727+0000 7f026be9d8c0 -1 < failed to complete operation key=3JADN360QEO3 tag=XIWYUIGJJJH5 type=del size=3214667: (22) Invalid argument 2024-09-12T17:04:53.733 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.727+0000 7f026be9d8c0 1 > prepared operation key=JJMEQ2O00SA2 tag=5X3DBL1ADW6S type=del size=183428 2024-09-12T17:04:53.736 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.731+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~AZ3923ISUCR8.0 size=1048576 2024-09-12T17:04:53.737 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.731+0000 7f026be9d8c0 1 < canceled part key=_multipart_SL2446KSB531.2~AZ3923ISUCR8.1 size=682960 2024-09-12T17:04:53.741 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.735+0000 7f026be9d8c0 1 < canceled multipart upload key=SL2446KSB531 upload=AZ3923ISUCR8 tag=1H24MWT13MXJ type=write size=2780112 2024-09-12T17:04:53.746 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.743+0000 7f026be9d8c0 1 > prepared part key=_multipart_21ZD52VBZIO4.2~Q7498DDZD8QV.0 size=1048576 2024-09-12T17:04:53.748 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.743+0000 7f026be9d8c0 1 > prepared part key=_multipart_21ZD52VBZIO4.2~Q7498DDZD8QV.1 size=1048576 2024-09-12T17:04:53.750 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.747+0000 7f026be9d8c0 1 > prepared part key=_multipart_21ZD52VBZIO4.2~Q7498DDZD8QV.2 size=145380 2024-09-12T17:04:53.750 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.747+0000 7f026be9d8c0 1 > prepared multipart upload key=21ZD52VBZIO4 upload=Q7498DDZD8QV tag=K4PWDXNGGZ6K type=write size=3291108 2024-09-12T17:04:53.751 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.747+0000 7f026be9d8c0 1 < canceled part key=_multipart_U8W1SAVSLTBF.2~MY1GDJHDP4IU.0 size=1048576 2024-09-12T17:04:53.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.747+0000 7f026be9d8c0 1 < completed part key=_multipart_U8W1SAVSLTBF.2~MY1GDJHDP4IU.1 size=711307 2024-09-12T17:04:53.757 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.751+0000 7f026be9d8c0 1 < canceled multipart upload key=U8W1SAVSLTBF upload=MY1GDJHDP4IU tag=949TO9VNM7DM type=write size=2808459 2024-09-12T17:04:53.759 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.755+0000 7f026be9d8c0 1 > prepared operation key=2BQJ30RQQ25L tag=M406RN8QWFEJ type=del size=876861 2024-09-12T17:04:53.762 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.759+0000 7f026be9d8c0 1 < completed delete operation key=4U1W97V0OX11 tag=S037A05L89S4 type=del 2024-09-12T17:04:53.767 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.763+0000 7f026be9d8c0 1 > prepared part key=_multipart_E0Y3SKNUYCQS.2~2PZ4E5HU7A7P.0 size=1048576 2024-09-12T17:04:53.769 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.763+0000 7f026be9d8c0 1 > prepared part key=_multipart_E0Y3SKNUYCQS.2~2PZ4E5HU7A7P.1 size=111416 2024-09-12T17:04:53.769 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.763+0000 7f026be9d8c0 1 > prepared multipart upload key=E0Y3SKNUYCQS upload=2PZ4E5HU7A7P tag=LNVOBX5MAKNU type=write size=2208568 2024-09-12T17:04:53.772 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.767+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~X4RJ0QH3QPU6.0 size=1048576 2024-09-12T17:04:53.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.771+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~X4RJ0QH3QPU6.1 size=993479 2024-09-12T17:04:53.778 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.775+0000 7f026be9d8c0 1 < completed multipart upload key=GPUFWJ3AWEMX upload=X4RJ0QH3QPU6 tag=8GRZIJTBPXJ1 type=write size=3090631 2024-09-12T17:04:53.781 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.775+0000 7f026be9d8c0 1 > prepared operation key=SO3HLQZA8B6B tag=AT1PSUZ9DP96 type=del size=3818434 2024-09-12T17:04:53.783 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.779+0000 7f026be9d8c0 1 < completed delete operation key=E0Y3SKNUYCQS tag=IFF1A5NHMPCV type=del 2024-09-12T17:04:53.788 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.783+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~7AN66ESNPW5V.0 size=1048576 2024-09-12T17:04:53.792 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.787+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~7AN66ESNPW5V.1 size=1048576 2024-09-12T17:04:53.792 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.787+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~7AN66ESNPW5V.2 size=30564 2024-09-12T17:04:53.792 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.787+0000 7f026be9d8c0 1 > prepared multipart upload key=4G3BKGNT3YZC upload=7AN66ESNPW5V tag=RRJGGGW5FN0I type=write size=3176292 2024-09-12T17:04:53.795 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.791+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~ISWVXC27AJDP.0 size=1048576 2024-09-12T17:04:53.797 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.791+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~ISWVXC27AJDP.1 size=614890 2024-09-12T17:04:53.802 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.799+0000 7f026be9d8c0 1 < completed multipart upload key=UU88OS653L8D upload=ISWVXC27AJDP tag=U7L8BQ82PZGA type=write size=2712042 2024-09-12T17:04:53.805 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.799+0000 7f026be9d8c0 1 > prepared operation key=QVQ4TI319DH5 tag=CXQQ6RU07LQ9 type=del size=3289234 2024-09-12T17:04:53.807 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.803+0000 7f026be9d8c0 1 < completed delete operation key=XLKR6P8RNRVO tag=ROYR66A1QBI9 type=del 2024-09-12T17:04:53.810 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.807+0000 7f026be9d8c0 1 > prepared operation key=SO3HLQZA8B6B tag=JJFNQ6AJLBBK type=del size=3388988 2024-09-12T17:04:53.813 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.807+0000 7f026be9d8c0 1 < completed delete operation key=SO3HLQZA8B6B tag=W2SNF2SBJFJW type=del 2024-09-12T17:04:53.815 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.811+0000 7f026be9d8c0 1 > prepared operation key=ALFGNC1YNROX tag=SNJK3OO0Z59G type=del size=4176036 2024-09-12T17:04:53.820 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.815+0000 7f026be9d8c0 1 < suggested update operation key=BW1T21LBUE2D tag=HG3N03KZMCIP type=del size=413464 2024-09-12T17:04:53.822 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.819+0000 7f026be9d8c0 1 > prepared operation key=MVYWUWKSYQ9Z tag=D062HR6B30JU type=del size=2851247 2024-09-12T17:04:53.824 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.819+0000 7f026be9d8c0 1 < completed delete operation key=8AFDAVJLMRD2 tag=L0YU3L8I02O4 type=del 2024-09-12T17:04:53.829 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.823+0000 7f026be9d8c0 1 > prepared part key=_multipart_3JADN360QEO3.2~77WYD4JX3EEG.0 size=1048576 2024-09-12T17:04:53.831 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.827+0000 7f026be9d8c0 1 > prepared part key=_multipart_3JADN360QEO3.2~77WYD4JX3EEG.1 size=1048576 2024-09-12T17:04:53.832 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.827+0000 7f026be9d8c0 1 > prepared part key=_multipart_3JADN360QEO3.2~77WYD4JX3EEG.2 size=149158 2024-09-12T17:04:53.833 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.827+0000 7f026be9d8c0 1 > prepared multipart upload key=3JADN360QEO3 upload=77WYD4JX3EEG tag=RTDL03IR9VBX type=write size=3294886 2024-09-12T17:04:53.837 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.831+0000 7f026be9d8c0 1 < suggested update operation key=MVYWUWKSYQ9Z tag=K1DD3QKF0AQX type=del size=517158 2024-09-12T17:04:53.840 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.835+0000 7f026be9d8c0 1 > prepared operation key=QVQ4TI319DH5 tag=HGHK6MRUR4XN type=del size=1693984 2024-09-12T17:04:53.842 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.839+0000 7f026be9d8c0 1 < completed delete operation key=U8W1SAVSLTBF tag=UW7WMF08WNUQ type=del 2024-09-12T17:04:53.845 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.839+0000 7f026be9d8c0 1 > prepared operation key=BBYDPSXZKHZP tag=AULSLLPD5OY2 type=del size=716651 2024-09-12T17:04:53.847 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.843+0000 7f026be9d8c0 1 < canceled operation key=3JADN360QEO3 tag=DQ8XBHAKG0NU type=del size=1756237 2024-09-12T17:04:53.850 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.847+0000 7f026be9d8c0 1 > prepared operation key=2BQJ30RQQ25L tag=UAHHCMZ2KU9J type=write size=736945 2024-09-12T17:04:53.855 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.851+0000 7f026be9d8c0 1 < suggested remove operation key=21ZD52VBZIO4 tag=ZYNYMCCNSEAV type=write 2024-09-12T17:04:53.859 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.855+0000 7f026be9d8c0 1 > prepared part key=_multipart_E0Y3SKNUYCQS.2~8TQOFKBUFDBT.0 size=1048576 2024-09-12T17:04:53.861 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.855+0000 7f026be9d8c0 1 > prepared part key=_multipart_E0Y3SKNUYCQS.2~8TQOFKBUFDBT.1 size=1048576 2024-09-12T17:04:53.864 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.859+0000 7f026be9d8c0 1 > prepared part key=_multipart_E0Y3SKNUYCQS.2~8TQOFKBUFDBT.2 size=292409 2024-09-12T17:04:53.864 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.859+0000 7f026be9d8c0 1 > prepared multipart upload key=E0Y3SKNUYCQS upload=8TQOFKBUFDBT tag=3TUZW228X3L0 type=write size=3438137 2024-09-12T17:04:53.864 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.859+0000 7f026be9d8c0 1 < canceled part key=_multipart_4U1W97V0OX11.2~5CTL3OZY28K5.0 size=1048576 2024-09-12T17:04:53.866 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.863+0000 7f026be9d8c0 1 < completed part key=_multipart_4U1W97V0OX11.2~5CTL3OZY28K5.1 size=844992 2024-09-12T17:04:53.871 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.867+0000 7f026be9d8c0 1 < canceled multipart upload key=4U1W97V0OX11 upload=5CTL3OZY28K5 tag=4ZJBXKU0JTSO type=write size=2942144 2024-09-12T17:04:53.874 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.871+0000 7f026be9d8c0 1 > prepared operation key=Z9YNIEQCVNBA tag=L05J7E789AVP type=del size=3217556 2024-09-12T17:04:53.877 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.871+0000 7f026be9d8c0 1 < completed delete operation key=JJMEQ2O00SA2 tag=5X3DBL1ADW6S type=del 2024-09-12T17:04:53.880 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.875+0000 7f026be9d8c0 1 > prepared operation key=PQSQ39X3O64P tag=1T3FMFU520P3 type=write size=925011 2024-09-12T17:04:53.883 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.879+0000 7f026be9d8c0 1 < completed part key=_multipart_21ZD52VBZIO4.2~Q7498DDZD8QV.0 size=1048576 2024-09-12T17:04:53.885 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.879+0000 7f026be9d8c0 1 < completed part key=_multipart_21ZD52VBZIO4.2~Q7498DDZD8QV.1 size=1048576 2024-09-12T17:04:53.888 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.883+0000 7f026be9d8c0 1 < completed part key=_multipart_21ZD52VBZIO4.2~Q7498DDZD8QV.2 size=145380 2024-09-12T17:04:53.893 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.887+0000 7f026be9d8c0 1 < completed multipart upload key=21ZD52VBZIO4 upload=Q7498DDZD8QV tag=K4PWDXNGGZ6K type=write size=3291108 2024-09-12T17:04:53.899 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.895+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~HY4OICG96U0F.0 size=1048576 2024-09-12T17:04:53.901 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.895+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~HY4OICG96U0F.1 size=731790 2024-09-12T17:04:53.901 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.895+0000 7f026be9d8c0 1 > prepared multipart upload key=Z9YNIEQCVNBA upload=HY4OICG96U0F tag=AJH0AXF2BFGO type=write size=2828942 2024-09-12T17:04:53.904 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.899+0000 7f026be9d8c0 1 < completed delete operation key=2BQJ30RQQ25L tag=M406RN8QWFEJ type=del 2024-09-12T17:04:53.907 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.903+0000 7f026be9d8c0 1 > prepared operation key=E0Y3SKNUYCQS tag=UNB9OWVDKFB6 type=del size=1679990 2024-09-12T17:04:53.910 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.907+0000 7f026be9d8c0 1 < completed part key=_multipart_E0Y3SKNUYCQS.2~2PZ4E5HU7A7P.0 size=1048576 2024-09-12T17:04:53.912 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.907+0000 7f026be9d8c0 1 < completed part key=_multipart_E0Y3SKNUYCQS.2~2PZ4E5HU7A7P.1 size=111416 2024-09-12T17:04:53.917 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.911+0000 7f026be9d8c0 1 < completed multipart upload key=E0Y3SKNUYCQS upload=2PZ4E5HU7A7P tag=LNVOBX5MAKNU type=write size=2208568 2024-09-12T17:04:53.923 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.919+0000 7f026be9d8c0 1 > prepared part key=_multipart_3JADN360QEO3.2~LOAS4O43U04Q.0 size=563776 2024-09-12T17:04:53.923 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.919+0000 7f026be9d8c0 1 > prepared multipart upload key=3JADN360QEO3 upload=LOAS4O43U04Q tag=9WLFILQ4HHET type=write size=1612352 2024-09-12T17:04:53.928 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.923+0000 7f026be9d8c0 1 < suggested remove operation key=SO3HLQZA8B6B tag=AT1PSUZ9DP96 type=del 2024-09-12T17:04:53.932 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.927+0000 7f026be9d8c0 1 > prepared operation key=32XUMOWT8HO2 tag=GH2N9AZHKWR1 type=del size=2129199 2024-09-12T17:04:53.935 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.931+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~7AN66ESNPW5V.0 size=1048576 2024-09-12T17:04:53.937 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.931+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~7AN66ESNPW5V.1 size=1048576 2024-09-12T17:04:53.937 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.931+0000 7f026be9d8c0 1 < canceled part key=_multipart_4G3BKGNT3YZC.2~7AN66ESNPW5V.2 size=30564 2024-09-12T17:04:53.942 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.939+0000 7f026be9d8c0 1 < canceled multipart upload key=4G3BKGNT3YZC upload=7AN66ESNPW5V tag=RRJGGGW5FN0I type=write size=3176292 2024-09-12T17:04:53.945 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.939+0000 7f026be9d8c0 1 > prepared operation key=UU88OS653L8D tag=OPYK814AGLO4 type=del size=3736191 2024-09-12T17:04:53.949 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.943+0000 7f026be9d8c0 1 < canceled operation key=QVQ4TI319DH5 tag=CXQQ6RU07LQ9 type=del size=3289234 2024-09-12T17:04:53.955 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.951+0000 7f026be9d8c0 1 > prepared part key=_multipart_SGT8IC1GJ3IG.2~85TIZ5QCJJWF.0 size=1048576 2024-09-12T17:04:53.957 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.951+0000 7f026be9d8c0 1 > prepared part key=_multipart_SGT8IC1GJ3IG.2~85TIZ5QCJJWF.1 size=1048576 2024-09-12T17:04:53.962 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.959+0000 7f026be9d8c0 1 > prepared part key=_multipart_SGT8IC1GJ3IG.2~85TIZ5QCJJWF.2 size=1039976 2024-09-12T17:04:53.962 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.959+0000 7f026be9d8c0 1 > prepared multipart upload key=SGT8IC1GJ3IG upload=85TIZ5QCJJWF tag=QS0XO631KURP type=write size=4185704 2024-09-12T17:04:53.965 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.959+0000 7f026be9d8c0 -1 < failed to complete operation key=SO3HLQZA8B6B tag=JJFNQ6AJLBBK type=del size=3388988: (22) Invalid argument 2024-09-12T17:04:53.969 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.963+0000 7f026be9d8c0 1 > prepared part key=_multipart_21ZD52VBZIO4.2~VOQ88PVK1SQ6.0 size=93149 2024-09-12T17:04:53.969 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.963+0000 7f026be9d8c0 1 > prepared multipart upload key=21ZD52VBZIO4 upload=VOQ88PVK1SQ6 tag=G47NM08C31ST type=write size=1141725 2024-09-12T17:04:53.973 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.967+0000 7f026be9d8c0 1 < canceled operation key=ALFGNC1YNROX tag=SNJK3OO0Z59G type=del size=4176036 2024-09-12T17:04:53.978 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.975+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~39LEIEPMZHPT.0 size=1048576 2024-09-12T17:04:53.981 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.975+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~39LEIEPMZHPT.1 size=375473 2024-09-12T17:04:53.981 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.975+0000 7f026be9d8c0 1 > prepared multipart upload key=ALFGNC1YNROX upload=39LEIEPMZHPT tag=U3A1LFZZBHVF type=write size=2472625 2024-09-12T17:04:53.984 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.979+0000 7f026be9d8c0 -1 < failed to complete operation key=MVYWUWKSYQ9Z tag=D062HR6B30JU type=del size=2851247: (22) Invalid argument 2024-09-12T17:04:53.987 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.983+0000 7f026be9d8c0 1 > prepared operation key=L194KQIPFLE1 tag=OX5VVEGR7OXP type=del size=4055627 2024-09-12T17:04:53.990 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.987+0000 7f026be9d8c0 1 < completed part key=_multipart_3JADN360QEO3.2~77WYD4JX3EEG.0 size=1048576 2024-09-12T17:04:53.993 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.987+0000 7f026be9d8c0 1 < completed part key=_multipart_3JADN360QEO3.2~77WYD4JX3EEG.1 size=1048576 2024-09-12T17:04:53.996 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.991+0000 7f026be9d8c0 1 < completed part key=_multipart_3JADN360QEO3.2~77WYD4JX3EEG.2 size=149158 2024-09-12T17:04:54.000 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.995+0000 7f026be9d8c0 1 < completed multipart upload key=3JADN360QEO3 upload=77WYD4JX3EEG tag=RTDL03IR9VBX type=write size=3294886 2024-09-12T17:04:54.005 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.999+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~CXG5LA6ZV96O.0 size=504178 2024-09-12T17:04:54.005 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:53.999+0000 7f026be9d8c0 1 > prepared multipart upload key=Z9YNIEQCVNBA upload=CXG5LA6ZV96O tag=3XP8XA0GE6G3 type=write size=1552754 2024-09-12T17:04:54.008 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.003+0000 7f026be9d8c0 1 < completed delete operation key=QVQ4TI319DH5 tag=HGHK6MRUR4XN type=del 2024-09-12T17:04:54.013 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.007+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~QJCVFIO5R0FA.0 size=1048576 2024-09-12T17:04:54.016 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.011+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~QJCVFIO5R0FA.1 size=1048576 2024-09-12T17:04:54.018 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.015+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~QJCVFIO5R0FA.2 size=442810 2024-09-12T17:04:54.018 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.015+0000 7f026be9d8c0 1 > prepared multipart upload key=32XUMOWT8HO2 upload=QJCVFIO5R0FA tag=ADY0U4XR8BZ7 type=write size=3588538 2024-09-12T17:04:54.021 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.015+0000 7f026be9d8c0 1 < completed delete operation key=BBYDPSXZKHZP tag=AULSLLPD5OY2 type=del 2024-09-12T17:04:54.024 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.019+0000 7f026be9d8c0 1 > prepared operation key=BW1T21LBUE2D tag=135EFRE8H98C type=del size=214226 2024-09-12T17:04:54.027 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.023+0000 7f026be9d8c0 1 < completed write operation key=2BQJ30RQQ25L tag=UAHHCMZ2KU9J type=write size=736945 2024-09-12T17:04:54.030 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.027+0000 7f026be9d8c0 1 > prepared operation key=4U1W97V0OX11 tag=59L8N893BHG2 type=write size=374225 2024-09-12T17:04:54.033 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.027+0000 7f026be9d8c0 1 < completed part key=_multipart_E0Y3SKNUYCQS.2~8TQOFKBUFDBT.0 size=1048576 2024-09-12T17:04:54.033 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.027+0000 7f026be9d8c0 1 < canceled part key=_multipart_E0Y3SKNUYCQS.2~8TQOFKBUFDBT.1 size=1048576 2024-09-12T17:04:54.035 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.031+0000 7f026be9d8c0 1 < completed part key=_multipart_E0Y3SKNUYCQS.2~8TQOFKBUFDBT.2 size=292409 2024-09-12T17:04:54.040 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.035+0000 7f026be9d8c0 1 < canceled multipart upload key=E0Y3SKNUYCQS upload=8TQOFKBUFDBT tag=3TUZW228X3L0 type=write size=3438137 2024-09-12T17:04:54.045 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.039+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~CW6SNTZZ3WQ7.0 size=1048576 2024-09-12T17:04:54.047 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.043+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~CW6SNTZZ3WQ7.1 size=1048576 2024-09-12T17:04:54.049 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.043+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~CW6SNTZZ3WQ7.2 size=341016 2024-09-12T17:04:54.049 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.043+0000 7f026be9d8c0 1 > prepared multipart upload key=6VO85REZG2NW upload=CW6SNTZZ3WQ7 tag=N2GTPG4CU1MO type=write size=3486744 2024-09-12T17:04:54.052 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.047+0000 7f026be9d8c0 1 < completed delete operation key=Z9YNIEQCVNBA tag=L05J7E789AVP type=del 2024-09-12T17:04:54.057 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.051+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~WRDF16ARHNSU.0 size=1048576 2024-09-12T17:04:54.059 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.055+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~WRDF16ARHNSU.1 size=227456 2024-09-12T17:04:54.060 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.055+0000 7f026be9d8c0 1 > prepared multipart upload key=GPUFWJ3AWEMX upload=WRDF16ARHNSU tag=FWRT1M6PFII0 type=write size=2324608 2024-09-12T17:04:54.062 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.059+0000 7f026be9d8c0 1 < completed write operation key=PQSQ39X3O64P tag=1T3FMFU520P3 type=write size=925011 2024-09-12T17:04:54.065 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.059+0000 7f026be9d8c0 1 > prepared operation key=L194KQIPFLE1 tag=45SNRDLYUPAT type=del size=3786783 2024-09-12T17:04:54.068 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.063+0000 7f026be9d8c0 1 < completed part key=_multipart_Z9YNIEQCVNBA.2~HY4OICG96U0F.0 size=1048576 2024-09-12T17:04:54.070 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.067+0000 7f026be9d8c0 1 < completed part key=_multipart_Z9YNIEQCVNBA.2~HY4OICG96U0F.1 size=731790 2024-09-12T17:04:54.075 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.071+0000 7f026be9d8c0 1 < completed multipart upload key=Z9YNIEQCVNBA upload=HY4OICG96U0F tag=AJH0AXF2BFGO type=write size=2828942 2024-09-12T17:04:54.080 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.075+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~PHYGVIDW1VOV.0 size=898829 2024-09-12T17:04:54.080 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.075+0000 7f026be9d8c0 1 > prepared multipart upload key=8AFDAVJLMRD2 upload=PHYGVIDW1VOV tag=MG6XEZUPD30J type=write size=1947405 2024-09-12T17:04:54.086 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.083+0000 7f026be9d8c0 1 < suggested remove operation key=E0Y3SKNUYCQS tag=UNB9OWVDKFB6 type=del 2024-09-12T17:04:54.091 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.087+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~GDRX0JL8KA3W.0 size=720988 2024-09-12T17:04:54.091 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.087+0000 7f026be9d8c0 1 > prepared multipart upload key=4G3BKGNT3YZC upload=GDRX0JL8KA3W tag=Y7EXT6O1CZ5Y type=write size=1769564 2024-09-12T17:04:54.094 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.091+0000 7f026be9d8c0 1 < completed part key=_multipart_3JADN360QEO3.2~LOAS4O43U04Q.0 size=563776 2024-09-12T17:04:54.099 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.095+0000 7f026be9d8c0 1 < completed multipart upload key=3JADN360QEO3 upload=LOAS4O43U04Q tag=9WLFILQ4HHET type=write size=1612352 2024-09-12T17:04:54.104 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.099+0000 7f026be9d8c0 1 > prepared part key=_multipart_BBYDPSXZKHZP.2~GLOA32W1E4GX.0 size=1048576 2024-09-12T17:04:54.106 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.103+0000 7f026be9d8c0 1 > prepared part key=_multipart_BBYDPSXZKHZP.2~GLOA32W1E4GX.1 size=176395 2024-09-12T17:04:54.106 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.103+0000 7f026be9d8c0 1 > prepared multipart upload key=BBYDPSXZKHZP upload=GLOA32W1E4GX tag=T2MJGAAR7S7K type=write size=2273547 2024-09-12T17:04:54.109 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.103+0000 7f026be9d8c0 1 < completed delete operation key=32XUMOWT8HO2 tag=GH2N9AZHKWR1 type=del 2024-09-12T17:04:54.112 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.107+0000 7f026be9d8c0 1 > prepared operation key=PQSQ39X3O64P tag=0WSMAMKC7D67 type=del size=991614 2024-09-12T17:04:54.115 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.111+0000 7f026be9d8c0 1 < completed delete operation key=UU88OS653L8D tag=OPYK814AGLO4 type=del 2024-09-12T17:04:54.119 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.115+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=L5Q0HKWJAFBU type=del size=893599 2024-09-12T17:04:54.122 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.119+0000 7f026be9d8c0 1 < completed part key=_multipart_SGT8IC1GJ3IG.2~85TIZ5QCJJWF.0 size=1048576 2024-09-12T17:04:54.125 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.119+0000 7f026be9d8c0 1 < completed part key=_multipart_SGT8IC1GJ3IG.2~85TIZ5QCJJWF.1 size=1048576 2024-09-12T17:04:54.128 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.123+0000 7f026be9d8c0 1 < completed part key=_multipart_SGT8IC1GJ3IG.2~85TIZ5QCJJWF.2 size=1039976 2024-09-12T17:04:54.134 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.127+0000 7f026be9d8c0 1 < completed multipart upload key=SGT8IC1GJ3IG upload=85TIZ5QCJJWF tag=QS0XO631KURP type=write size=4185704 2024-09-12T17:04:54.137 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.131+0000 7f026be9d8c0 1 > prepared operation key=E0Y3SKNUYCQS tag=XFISC04036IN type=del size=2468904 2024-09-12T17:04:54.141 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.135+0000 7f026be9d8c0 1 < completed part key=_multipart_21ZD52VBZIO4.2~VOQ88PVK1SQ6.0 size=93149 2024-09-12T17:04:54.147 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.143+0000 7f026be9d8c0 1 < completed multipart upload key=21ZD52VBZIO4 upload=VOQ88PVK1SQ6 tag=G47NM08C31ST type=write size=1141725 2024-09-12T17:04:54.153 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.147+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~MFF5G0K0SLCR.0 size=36528 2024-09-12T17:04:54.153 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.147+0000 7f026be9d8c0 1 > prepared multipart upload key=2BQJ30RQQ25L upload=MFF5G0K0SLCR tag=4D6ND27JTS55 type=write size=1085104 2024-09-12T17:04:54.157 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.151+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~39LEIEPMZHPT.0 size=1048576 2024-09-12T17:04:54.159 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.155+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~39LEIEPMZHPT.1 size=375473 2024-09-12T17:04:54.166 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.159+0000 7f026be9d8c0 1 < completed multipart upload key=ALFGNC1YNROX upload=39LEIEPMZHPT tag=U3A1LFZZBHVF type=write size=2472625 2024-09-12T17:04:54.169 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.163+0000 7f026be9d8c0 1 > prepared operation key=ALFGNC1YNROX tag=53U5L6VOBGBF type=write size=576582 2024-09-12T17:04:54.173 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.167+0000 7f026be9d8c0 1 < completed delete operation key=L194KQIPFLE1 tag=OX5VVEGR7OXP type=del 2024-09-12T17:04:54.179 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.175+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~258WAJNKK9V2.0 size=1048576 2024-09-12T17:04:54.182 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.179+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~258WAJNKK9V2.1 size=765383 2024-09-12T17:04:54.182 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.179+0000 7f026be9d8c0 1 > prepared multipart upload key=2BQJ30RQQ25L upload=258WAJNKK9V2 tag=NMUB0L6F9WUR type=write size=2862535 2024-09-12T17:04:54.183 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.179+0000 7f026be9d8c0 1 < canceled part key=_multipart_Z9YNIEQCVNBA.2~CXG5LA6ZV96O.0 size=504178 2024-09-12T17:04:54.188 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.183+0000 7f026be9d8c0 1 < canceled multipart upload key=Z9YNIEQCVNBA upload=CXG5LA6ZV96O tag=3XP8XA0GE6G3 type=write size=1552754 2024-09-12T17:04:54.195 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.191+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~JAOM0C17NWUK.0 size=813865 2024-09-12T17:04:54.195 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.191+0000 7f026be9d8c0 1 > prepared multipart upload key=32XUMOWT8HO2 upload=JAOM0C17NWUK tag=P211OW2G1QSN type=write size=1862441 2024-09-12T17:04:54.200 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.195+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~QJCVFIO5R0FA.0 size=1048576 2024-09-12T17:04:54.201 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.195+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~QJCVFIO5R0FA.1 size=1048576 2024-09-12T17:04:54.204 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.199+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~QJCVFIO5R0FA.2 size=442810 2024-09-12T17:04:54.210 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.207+0000 7f026be9d8c0 1 < completed multipart upload key=32XUMOWT8HO2 upload=QJCVFIO5R0FA tag=ADY0U4XR8BZ7 type=write size=3588538 2024-09-12T17:04:54.214 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.211+0000 7f026be9d8c0 1 > prepared operation key=Y27CDEOCM7DH tag=HG0TO9W8IIKV type=del size=3696382 2024-09-12T17:04:54.218 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.215+0000 7f026be9d8c0 1 < completed delete operation key=BW1T21LBUE2D tag=135EFRE8H98C type=del 2024-09-12T17:04:54.224 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.219+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~ZSGNAQI859Y2.0 size=729536 2024-09-12T17:04:54.224 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.219+0000 7f026be9d8c0 1 > prepared multipart upload key=JJMEQ2O00SA2 upload=ZSGNAQI859Y2 tag=A3TNEUIWH6I8 type=write size=1778112 2024-09-12T17:04:54.231 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.227+0000 7f026be9d8c0 1 < suggested update operation key=4U1W97V0OX11 tag=59L8N893BHG2 type=write size=374225 2024-09-12T17:04:54.235 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.231+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=2C9IYAGQBQ65 type=del size=2851196 2024-09-12T17:04:54.239 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.235+0000 7f026be9d8c0 1 < completed part key=_multipart_6VO85REZG2NW.2~CW6SNTZZ3WQ7.0 size=1048576 2024-09-12T17:04:54.242 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.239+0000 7f026be9d8c0 1 < completed part key=_multipart_6VO85REZG2NW.2~CW6SNTZZ3WQ7.1 size=1048576 2024-09-12T17:04:54.245 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.239+0000 7f026be9d8c0 1 < completed part key=_multipart_6VO85REZG2NW.2~CW6SNTZZ3WQ7.2 size=341016 2024-09-12T17:04:54.255 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.251+0000 7f026be9d8c0 1 < completed multipart upload key=6VO85REZG2NW upload=CW6SNTZZ3WQ7 tag=N2GTPG4CU1MO type=write size=3486744 2024-09-12T17:04:54.260 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.255+0000 7f026be9d8c0 1 > prepared operation key=UU88OS653L8D tag=IYQJHIVYJJYC type=write size=446774 2024-09-12T17:04:54.263 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.259+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~WRDF16ARHNSU.0 size=1048576 2024-09-12T17:04:54.266 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.263+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~WRDF16ARHNSU.1 size=227456 2024-09-12T17:04:54.272 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.267+0000 7f026be9d8c0 1 < completed multipart upload key=GPUFWJ3AWEMX upload=WRDF16ARHNSU tag=FWRT1M6PFII0 type=write size=2324608 2024-09-12T17:04:54.275 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.271+0000 7f026be9d8c0 1 > prepared operation key=6VO85REZG2NW tag=9WCSJGKTR503 type=del size=3322570 2024-09-12T17:04:54.279 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.275+0000 7f026be9d8c0 1 < completed delete operation key=L194KQIPFLE1 tag=45SNRDLYUPAT type=del 2024-09-12T17:04:54.282 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.279+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=F0J0FHWHMPTM type=del size=531466 2024-09-12T17:04:54.286 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.283+0000 7f026be9d8c0 1 < completed part key=_multipart_8AFDAVJLMRD2.2~PHYGVIDW1VOV.0 size=898829 2024-09-12T17:04:54.292 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.287+0000 7f026be9d8c0 1 < completed multipart upload key=8AFDAVJLMRD2 upload=PHYGVIDW1VOV tag=MG6XEZUPD30J type=write size=1947405 2024-09-12T17:04:54.295 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.291+0000 7f026be9d8c0 1 > prepared operation key=Y27CDEOCM7DH tag=2XS5NGZYS8TA type=del size=1819156 2024-09-12T17:04:54.299 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.295+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~GDRX0JL8KA3W.0 size=720988 2024-09-12T17:04:54.305 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.299+0000 7f026be9d8c0 1 < completed multipart upload key=4G3BKGNT3YZC upload=GDRX0JL8KA3W tag=Y7EXT6O1CZ5Y type=write size=1769564 2024-09-12T17:04:54.311 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.307+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~BNMMZRI5SO9E.0 size=1048576 2024-09-12T17:04:54.314 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.311+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~BNMMZRI5SO9E.1 size=1048576 2024-09-12T17:04:54.317 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.311+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~BNMMZRI5SO9E.2 size=522808 2024-09-12T17:04:54.317 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.311+0000 7f026be9d8c0 1 > prepared multipart upload key=Z9YNIEQCVNBA upload=BNMMZRI5SO9E tag=BTS4FBOGS76V type=write size=3668536 2024-09-12T17:04:54.320 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.315+0000 7f026be9d8c0 1 < completed part key=_multipart_BBYDPSXZKHZP.2~GLOA32W1E4GX.0 size=1048576 2024-09-12T17:04:54.323 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.319+0000 7f026be9d8c0 1 < completed part key=_multipart_BBYDPSXZKHZP.2~GLOA32W1E4GX.1 size=176395 2024-09-12T17:04:54.329 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.323+0000 7f026be9d8c0 1 < completed multipart upload key=BBYDPSXZKHZP upload=GLOA32W1E4GX tag=T2MJGAAR7S7K type=write size=2273547 2024-09-12T17:04:54.333 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.327+0000 7f026be9d8c0 1 > prepared operation key=J8MU1A0CWSAQ tag=I7HA63MD20R1 type=write size=717938 2024-09-12T17:04:54.340 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.335+0000 7f026be9d8c0 1 < suggested remove operation key=PQSQ39X3O64P tag=0WSMAMKC7D67 type=del 2024-09-12T17:04:54.343 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.339+0000 7f026be9d8c0 1 > prepared operation key=ALFGNC1YNROX tag=SGBL59PEVCXF type=del size=1664759 2024-09-12T17:04:54.347 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.343+0000 7f026be9d8c0 1 < completed delete operation key=3JADN360QEO3 tag=L5Q0HKWJAFBU type=del 2024-09-12T17:04:54.353 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.347+0000 7f026be9d8c0 1 > prepared part key=_multipart_L194KQIPFLE1.2~XGA1LARVBOXR.0 size=827382 2024-09-12T17:04:54.353 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.347+0000 7f026be9d8c0 1 > prepared multipart upload key=L194KQIPFLE1 upload=XGA1LARVBOXR tag=T7F17GNZ755B type=write size=1875958 2024-09-12T17:04:54.357 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.351+0000 7f026be9d8c0 1 < completed delete operation key=E0Y3SKNUYCQS tag=XFISC04036IN type=del 2024-09-12T17:04:54.360 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.355+0000 7f026be9d8c0 1 > prepared operation key=SO3HLQZA8B6B tag=5MFPKQYMA41I type=del size=2724217 2024-09-12T17:04:54.364 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.359+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~MFF5G0K0SLCR.0 size=36528 2024-09-12T17:04:54.370 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.367+0000 7f026be9d8c0 1 < completed multipart upload key=2BQJ30RQQ25L upload=MFF5G0K0SLCR tag=4D6ND27JTS55 type=write size=1085104 2024-09-12T17:04:54.374 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.371+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=3B666IUPZS4L type=del size=2077330 2024-09-12T17:04:54.378 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.375+0000 7f026be9d8c0 1 < completed write operation key=ALFGNC1YNROX tag=53U5L6VOBGBF type=write size=576582 2024-09-12T17:04:54.382 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.375+0000 7f026be9d8c0 1 > prepared operation key=PQSQ39X3O64P tag=A9FLY55RIV35 type=del size=1614721 2024-09-12T17:04:54.385 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.379+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~258WAJNKK9V2.0 size=1048576 2024-09-12T17:04:54.388 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.383+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~258WAJNKK9V2.1 size=765383 2024-09-12T17:04:54.394 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.391+0000 7f026be9d8c0 1 < completed multipart upload key=2BQJ30RQQ25L upload=258WAJNKK9V2 tag=NMUB0L6F9WUR type=write size=2862535 2024-09-12T17:04:54.397 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.391+0000 7f026be9d8c0 1 > prepared operation key=PQSQ39X3O64P tag=IZCRBZMVB2IA type=del size=1584327 2024-09-12T17:04:54.401 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.395+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~JAOM0C17NWUK.0 size=813865 2024-09-12T17:04:54.408 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.403+0000 7f026be9d8c0 1 < completed multipart upload key=32XUMOWT8HO2 upload=JAOM0C17NWUK tag=P211OW2G1QSN type=write size=1862441 2024-09-12T17:04:54.410 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.407+0000 7f026be9d8c0 1 > prepared operation key=Y27CDEOCM7DH tag=BRF5TVOM8AWZ type=write size=783612 2024-09-12T17:04:54.414 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.407+0000 7f026be9d8c0 1 < completed delete operation key=Y27CDEOCM7DH tag=HG0TO9W8IIKV type=del 2024-09-12T17:04:54.417 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.411+0000 7f026be9d8c0 1 > prepared operation key=Z9YNIEQCVNBA tag=9CK0K78A3L0T type=write size=195153 2024-09-12T17:04:54.420 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.415+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~ZSGNAQI859Y2.0 size=729536 2024-09-12T17:04:54.426 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.423+0000 7f026be9d8c0 1 < completed multipart upload key=JJMEQ2O00SA2 upload=ZSGNAQI859Y2 tag=A3TNEUIWH6I8 type=write size=1778112 2024-09-12T17:04:54.430 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.427+0000 7f026be9d8c0 1 > prepared operation key=6VO85REZG2NW tag=85ZDU7TTP6PR type=del size=3984006 2024-09-12T17:04:54.437 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.431+0000 7f026be9d8c0 1 < suggested update operation key=RBNN03IPZ8BT tag=2C9IYAGQBQ65 type=del size=2851196 2024-09-12T17:04:54.441 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.435+0000 7f026be9d8c0 1 > prepared operation key=XNBE2II106VZ tag=AE2XT9KQ3EZ6 type=del size=708004 2024-09-12T17:04:54.444 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.439+0000 7f026be9d8c0 1 < completed write operation key=UU88OS653L8D tag=IYQJHIVYJJYC type=write size=446774 2024-09-12T17:04:54.451 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.447+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~SDL1OGN2G0Y3.0 size=697110 2024-09-12T17:04:54.451 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.447+0000 7f026be9d8c0 1 > prepared multipart upload key=Y27CDEOCM7DH upload=SDL1OGN2G0Y3 tag=I7PYGIHOI2VK type=write size=1745686 2024-09-12T17:04:54.455 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.451+0000 7f026be9d8c0 1 < completed delete operation key=6VO85REZG2NW tag=9WCSJGKTR503 type=del 2024-09-12T17:04:54.458 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.455+0000 7f026be9d8c0 1 > prepared operation key=SGT8IC1GJ3IG tag=1VMBZOM9XWSR type=write size=889117 2024-09-12T17:04:54.462 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.459+0000 7f026be9d8c0 1 < completed delete operation key=U8W1SAVSLTBF tag=F0J0FHWHMPTM type=del 2024-09-12T17:04:54.465 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.459+0000 7f026be9d8c0 1 > prepared operation key=32XUMOWT8HO2 tag=440JCRMFKWH2 type=del size=1360127 2024-09-12T17:04:54.469 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.463+0000 7f026be9d8c0 1 < completed delete operation key=Y27CDEOCM7DH tag=2XS5NGZYS8TA type=del 2024-09-12T17:04:54.475 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.471+0000 7f026be9d8c0 1 > prepared part key=_multipart_MVYWUWKSYQ9Z.2~DD0D45BA2V4I.0 size=1048576 2024-09-12T17:04:54.478 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.471+0000 7f026be9d8c0 1 > prepared part key=_multipart_MVYWUWKSYQ9Z.2~DD0D45BA2V4I.1 size=491447 2024-09-12T17:04:54.478 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.471+0000 7f026be9d8c0 1 > prepared multipart upload key=MVYWUWKSYQ9Z upload=DD0D45BA2V4I tag=MEZMP21KIR03 type=write size=2588599 2024-09-12T17:04:54.481 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.475+0000 7f026be9d8c0 1 < completed part key=_multipart_Z9YNIEQCVNBA.2~BNMMZRI5SO9E.0 size=1048576 2024-09-12T17:04:54.484 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.479+0000 7f026be9d8c0 1 < completed part key=_multipart_Z9YNIEQCVNBA.2~BNMMZRI5SO9E.1 size=1048576 2024-09-12T17:04:54.487 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.483+0000 7f026be9d8c0 1 < completed part key=_multipart_Z9YNIEQCVNBA.2~BNMMZRI5SO9E.2 size=522808 2024-09-12T17:04:54.492 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.487+0000 7f026be9d8c0 1 < completed multipart upload key=Z9YNIEQCVNBA upload=BNMMZRI5SO9E tag=BTS4FBOGS76V type=write size=3668536 2024-09-12T17:04:54.496 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.491+0000 7f026be9d8c0 1 > prepared operation key=BBYDPSXZKHZP tag=4BV97H5XCHJ4 type=del size=1189883 2024-09-12T17:04:54.500 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.495+0000 7f026be9d8c0 1 < completed write operation key=J8MU1A0CWSAQ tag=I7HA63MD20R1 type=write size=717938 2024-09-12T17:04:54.503 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.499+0000 7f026be9d8c0 1 > prepared operation key=32XUMOWT8HO2 tag=42SNK8EJCTTI type=write size=123870 2024-09-12T17:04:54.507 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.503+0000 7f026be9d8c0 1 < completed delete operation key=ALFGNC1YNROX tag=SGBL59PEVCXF type=del 2024-09-12T17:04:54.510 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.507+0000 7f026be9d8c0 1 > prepared operation key=L194KQIPFLE1 tag=W4HULJO57ERT type=del size=294291 2024-09-12T17:04:54.514 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.511+0000 7f026be9d8c0 1 < completed part key=_multipart_L194KQIPFLE1.2~XGA1LARVBOXR.0 size=827382 2024-09-12T17:04:54.520 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.515+0000 7f026be9d8c0 1 < completed multipart upload key=L194KQIPFLE1 upload=XGA1LARVBOXR tag=T7F17GNZ755B type=write size=1875958 2024-09-12T17:04:54.523 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.519+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=O2UU5VB2J8R0 type=del size=2956632 2024-09-12T17:04:54.527 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.523+0000 7f026be9d8c0 1 < completed delete operation key=SO3HLQZA8B6B tag=5MFPKQYMA41I type=del 2024-09-12T17:04:54.533 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.527+0000 7f026be9d8c0 1 > prepared part key=_multipart_LHKLWIUAT08F.2~UUE6WACBCM4D.0 size=382354 2024-09-12T17:04:54.533 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.527+0000 7f026be9d8c0 1 > prepared multipart upload key=LHKLWIUAT08F upload=UUE6WACBCM4D tag=6LPC9GH0CA1X type=write size=1430930 2024-09-12T17:04:54.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.531+0000 7f026be9d8c0 1 < completed delete operation key=U8W1SAVSLTBF tag=3B666IUPZS4L type=del 2024-09-12T17:04:54.541 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.535+0000 7f026be9d8c0 1 > prepared operation key=8AFDAVJLMRD2 tag=DSHB4UIOGDCK type=del size=3468178 2024-09-12T17:04:54.548 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.543+0000 7f026be9d8c0 1 < suggested update operation key=PQSQ39X3O64P tag=A9FLY55RIV35 type=del size=1614721 2024-09-12T17:04:54.552 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.547+0000 7f026be9d8c0 1 > prepared operation key=SL2446KSB531 tag=YICUJWHX8U8Z type=del size=2239804 2024-09-12T17:04:54.555 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.551+0000 7f026be9d8c0 -1 < failed to complete operation key=PQSQ39X3O64P tag=IZCRBZMVB2IA type=del size=1584327: (22) Invalid argument 2024-09-12T17:04:54.559 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.555+0000 7f026be9d8c0 1 > prepared operation key=BW1T21LBUE2D tag=PUUT85A3PHWI type=del size=4110279 2024-09-12T17:04:54.566 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.563+0000 7f026be9d8c0 1 < suggested update operation key=Y27CDEOCM7DH tag=BRF5TVOM8AWZ type=write size=783612 2024-09-12T17:04:54.569 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.563+0000 7f026be9d8c0 1 > prepared operation key=Z9YNIEQCVNBA tag=BZ7ZEIP3H0ZR type=del size=3977703 2024-09-12T17:04:54.573 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.567+0000 7f026be9d8c0 1 < completed write operation key=Z9YNIEQCVNBA tag=9CK0K78A3L0T type=write size=195153 2024-09-12T17:04:54.577 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.571+0000 7f026be9d8c0 1 > prepared operation key=SO3HLQZA8B6B tag=9HM67GCY65DT type=del size=612866 2024-09-12T17:04:54.580 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.575+0000 7f026be9d8c0 1 < canceled operation key=6VO85REZG2NW tag=85ZDU7TTP6PR type=del size=3984006 2024-09-12T17:04:54.587 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.583+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~PCAFAOYNL7EG.0 size=1048576 2024-09-12T17:04:54.592 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.587+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~PCAFAOYNL7EG.1 size=565627 2024-09-12T17:04:54.593 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.587+0000 7f026be9d8c0 1 > prepared multipart upload key=Y27CDEOCM7DH upload=PCAFAOYNL7EG tag=79CAET7YQZW4 type=write size=2662779 2024-09-12T17:04:54.600 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.595+0000 7f026be9d8c0 1 < suggested update operation key=XNBE2II106VZ tag=AE2XT9KQ3EZ6 type=del size=708004 2024-09-12T17:04:54.603 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.599+0000 7f026be9d8c0 1 > prepared operation key=PQSQ39X3O64P tag=H2FWQM1PJOU8 type=write size=732635 2024-09-12T17:04:54.604 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.599+0000 7f026be9d8c0 1 < canceled part key=_multipart_Y27CDEOCM7DH.2~SDL1OGN2G0Y3.0 size=697110 2024-09-12T17:04:54.613 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.603+0000 7f026be9d8c0 1 < canceled multipart upload key=Y27CDEOCM7DH upload=SDL1OGN2G0Y3 tag=I7PYGIHOI2VK type=write size=1745686 2024-09-12T17:04:54.895 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.607+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=1DMLE132ZQNW type=del size=379465 2024-09-12T17:04:54.895 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.611+0000 7f026be9d8c0 1 < completed write operation key=SGT8IC1GJ3IG tag=1VMBZOM9XWSR type=write size=889117 2024-09-12T17:04:54.895 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.615+0000 7f026be9d8c0 1 > prepared operation key=E0Y3SKNUYCQS tag=TXEVP0X2FRT8 type=del size=917736 2024-09-12T17:04:54.895 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.623+0000 7f026be9d8c0 1 < suggested remove operation key=32XUMOWT8HO2 tag=440JCRMFKWH2 type=del 2024-09-12T17:04:54.895 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.627+0000 7f026be9d8c0 1 > prepared operation key=LHKLWIUAT08F tag=QUN38C43310Q type=del size=3592160 2024-09-12T17:04:54.895 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.627+0000 7f026be9d8c0 1 < canceled part key=_multipart_MVYWUWKSYQ9Z.2~DD0D45BA2V4I.0 size=1048576 2024-09-12T17:04:54.895 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.627+0000 7f026be9d8c0 1 < canceled part key=_multipart_MVYWUWKSYQ9Z.2~DD0D45BA2V4I.1 size=491447 2024-09-12T17:04:54.895 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.635+0000 7f026be9d8c0 1 < canceled multipart upload key=MVYWUWKSYQ9Z upload=DD0D45BA2V4I tag=MEZMP21KIR03 type=write size=2588599 2024-09-12T17:04:54.895 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.639+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~KXL9XRCQ41KZ.0 size=1048576 2024-09-12T17:04:54.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.643+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~KXL9XRCQ41KZ.1 size=170112 2024-09-12T17:04:54.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.643+0000 7f026be9d8c0 1 > prepared multipart upload key=GPUFWJ3AWEMX upload=KXL9XRCQ41KZ tag=0H8YDE14XBEA type=write size=2267264 2024-09-12T17:04:54.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.647+0000 7f026be9d8c0 1 < completed delete operation key=BBYDPSXZKHZP tag=4BV97H5XCHJ4 type=del 2024-09-12T17:04:54.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.655+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~AVUENSLD1NYC.0 size=1048576 2024-09-12T17:04:54.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.655+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~AVUENSLD1NYC.1 size=1048576 2024-09-12T17:04:54.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.659+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~AVUENSLD1NYC.2 size=242942 2024-09-12T17:04:54.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.659+0000 7f026be9d8c0 1 > prepared multipart upload key=8AFDAVJLMRD2 upload=AVUENSLD1NYC tag=1BFLA6DJ58DH type=write size=3388670 2024-09-12T17:04:54.897 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.659+0000 7f026be9d8c0 -1 < no bi entry to suggest for operation key=32XUMOWT8HO2 tag=42SNK8EJCTTI type=write size=123870: (2) No such file or directory 2024-09-12T17:04:54.897 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.663+0000 7f026be9d8c0 1 > prepared operation key=UU88OS653L8D tag=OLPI8F0S6CKS type=del size=3698521 2024-09-12T17:04:54.897 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.667+0000 7f026be9d8c0 1 < completed delete operation key=L194KQIPFLE1 tag=W4HULJO57ERT type=del 2024-09-12T17:04:54.897 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.675+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~7P9ZRMTWS3GV.0 size=1048576 2024-09-12T17:04:54.897 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.679+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~7P9ZRMTWS3GV.1 size=476210 2024-09-12T17:04:54.897 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.679+0000 7f026be9d8c0 1 > prepared multipart upload key=Y27CDEOCM7DH upload=7P9ZRMTWS3GV tag=RPBM0Y7N2XS6 type=write size=2573362 2024-09-12T17:04:54.897 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.683+0000 7f026be9d8c0 1 < completed delete operation key=U8W1SAVSLTBF tag=O2UU5VB2J8R0 type=del 2024-09-12T17:04:54.897 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.683+0000 7f026be9d8c0 1 > prepared operation key=2BQJ30RQQ25L tag=IEX8PA3K9OVO type=del size=1989480 2024-09-12T17:04:54.897 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.687+0000 7f026be9d8c0 1 < completed part key=_multipart_LHKLWIUAT08F.2~UUE6WACBCM4D.0 size=382354 2024-09-12T17:04:54.897 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.695+0000 7f026be9d8c0 1 < completed multipart upload key=LHKLWIUAT08F upload=UUE6WACBCM4D tag=6LPC9GH0CA1X type=write size=1430930 2024-09-12T17:04:54.897 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.699+0000 7f026be9d8c0 1 > prepared operation key=4U1W97V0OX11 tag=RCI9C0QYI63A type=del size=4113903 2024-09-12T17:04:54.898 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.703+0000 7f026be9d8c0 1 < completed delete operation key=8AFDAVJLMRD2 tag=DSHB4UIOGDCK type=del 2024-09-12T17:04:54.898 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.707+0000 7f026be9d8c0 1 > prepared part key=_multipart_E0Y3SKNUYCQS.2~Z02VBRF59CCQ.0 size=1048576 2024-09-12T17:04:54.898 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.711+0000 7f026be9d8c0 1 > prepared part key=_multipart_E0Y3SKNUYCQS.2~Z02VBRF59CCQ.1 size=1048576 2024-09-12T17:04:54.898 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.711+0000 7f026be9d8c0 1 > prepared part key=_multipart_E0Y3SKNUYCQS.2~Z02VBRF59CCQ.2 size=450956 2024-09-12T17:04:54.898 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.711+0000 7f026be9d8c0 1 > prepared multipart upload key=E0Y3SKNUYCQS upload=Z02VBRF59CCQ tag=XE8AGTQ0KU8T type=write size=3596684 2024-09-12T17:04:54.898 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.719+0000 7f026be9d8c0 1 < suggested update operation key=SL2446KSB531 tag=YICUJWHX8U8Z type=del size=2239804 2024-09-12T17:04:54.898 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.727+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~V1Z8ONBD7408.0 size=1002019 2024-09-12T17:04:54.898 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.727+0000 7f026be9d8c0 1 > prepared multipart upload key=4G3BKGNT3YZC upload=V1Z8ONBD7408 tag=MD1JXWMU1LAL type=write size=2050595 2024-09-12T17:04:54.899 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.731+0000 7f026be9d8c0 1 < completed delete operation key=BW1T21LBUE2D tag=PUUT85A3PHWI type=del 2024-09-12T17:04:54.899 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.739+0000 7f026be9d8c0 1 > prepared part key=_multipart_SGT8IC1GJ3IG.2~781SSAOJOWS4.0 size=1048576 2024-09-12T17:04:54.899 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.739+0000 7f026be9d8c0 1 > prepared part key=_multipart_SGT8IC1GJ3IG.2~781SSAOJOWS4.1 size=829154 2024-09-12T17:04:54.899 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.739+0000 7f026be9d8c0 1 > prepared multipart upload key=SGT8IC1GJ3IG upload=781SSAOJOWS4 tag=89DZ1TT4AFM7 type=write size=2926306 2024-09-12T17:04:54.899 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.747+0000 7f026be9d8c0 1 < suggested update operation key=Z9YNIEQCVNBA tag=BZ7ZEIP3H0ZR type=del size=3977703 2024-09-12T17:04:54.899 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.751+0000 7f026be9d8c0 1 > prepared operation key=PQSQ39X3O64P tag=F3DTK7WY61ZL type=del size=3792383 2024-09-12T17:04:54.899 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.755+0000 7f026be9d8c0 1 < completed delete operation key=SO3HLQZA8B6B tag=9HM67GCY65DT type=del 2024-09-12T17:04:54.899 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.759+0000 7f026be9d8c0 1 > prepared operation key=XNBE2II106VZ tag=HY84OYX0W32G type=del size=2514795 2024-09-12T17:04:54.900 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.763+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~PCAFAOYNL7EG.0 size=1048576 2024-09-12T17:04:54.900 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.767+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~PCAFAOYNL7EG.1 size=565627 2024-09-12T17:04:54.900 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.775+0000 7f026be9d8c0 1 < completed multipart upload key=Y27CDEOCM7DH upload=PCAFAOYNL7EG tag=79CAET7YQZW4 type=write size=2662779 2024-09-12T17:04:54.900 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.779+0000 7f026be9d8c0 1 > prepared operation key=6VO85REZG2NW tag=291D460FTROD type=del size=4099199 2024-09-12T17:04:54.900 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.779+0000 7f026be9d8c0 1 < completed write operation key=PQSQ39X3O64P tag=H2FWQM1PJOU8 type=write size=732635 2024-09-12T17:04:54.900 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.787+0000 7f026be9d8c0 1 > prepared part key=_multipart_XNBE2II106VZ.2~IMA3409X1ZSB.0 size=806299 2024-09-12T17:04:54.900 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.787+0000 7f026be9d8c0 1 > prepared multipart upload key=XNBE2II106VZ upload=IMA3409X1ZSB tag=RK5QHG00LZ71 type=write size=1854875 2024-09-12T17:04:54.900 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.795+0000 7f026be9d8c0 1 < suggested update operation key=3JADN360QEO3 tag=1DMLE132ZQNW type=del size=379465 2024-09-12T17:04:54.901 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.799+0000 7f026be9d8c0 1 > prepared part key=_multipart_SO3HLQZA8B6B.2~D1PO3OFLD5GC.0 size=1048576 2024-09-12T17:04:54.901 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.803+0000 7f026be9d8c0 1 > prepared part key=_multipart_SO3HLQZA8B6B.2~D1PO3OFLD5GC.1 size=966763 2024-09-12T17:04:54.901 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.803+0000 7f026be9d8c0 1 > prepared multipart upload key=SO3HLQZA8B6B upload=D1PO3OFLD5GC tag=BSM1QQA7JA5Z type=write size=3063915 2024-09-12T17:04:54.901 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.807+0000 7f026be9d8c0 1 < completed delete operation key=E0Y3SKNUYCQS tag=TXEVP0X2FRT8 type=del 2024-09-12T17:04:54.901 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.811+0000 7f026be9d8c0 1 > prepared operation key=UU88OS653L8D tag=LBE7Z9C7X6BV type=del size=2933053 2024-09-12T17:04:54.902 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.815+0000 7f026be9d8c0 1 < canceled operation key=LHKLWIUAT08F tag=QUN38C43310Q type=del size=3592160 2024-09-12T17:04:54.902 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.819+0000 7f026be9d8c0 1 > prepared operation key=T6QRDTQRHBPI tag=5X5DBCZZ58DA type=del size=2521904 2024-09-12T17:04:54.902 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.823+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~KXL9XRCQ41KZ.0 size=1048576 2024-09-12T17:04:54.902 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.827+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~KXL9XRCQ41KZ.1 size=170112 2024-09-12T17:04:54.902 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.835+0000 7f026be9d8c0 1 < completed multipart upload key=GPUFWJ3AWEMX upload=KXL9XRCQ41KZ tag=0H8YDE14XBEA type=write size=2267264 2024-09-12T17:04:54.902 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.839+0000 7f026be9d8c0 1 > prepared operation key=2BQJ30RQQ25L tag=RFX6NC1P27AH type=write size=430671 2024-09-12T17:04:54.903 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.843+0000 7f026be9d8c0 1 < completed part key=_multipart_8AFDAVJLMRD2.2~AVUENSLD1NYC.0 size=1048576 2024-09-12T17:04:54.903 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.843+0000 7f026be9d8c0 1 < completed part key=_multipart_8AFDAVJLMRD2.2~AVUENSLD1NYC.1 size=1048576 2024-09-12T17:04:54.903 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.847+0000 7f026be9d8c0 1 < completed part key=_multipart_8AFDAVJLMRD2.2~AVUENSLD1NYC.2 size=242942 2024-09-12T17:04:54.903 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.851+0000 7f026be9d8c0 1 < completed multipart upload key=8AFDAVJLMRD2 upload=AVUENSLD1NYC tag=1BFLA6DJ58DH type=write size=3388670 2024-09-12T17:04:54.903 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.855+0000 7f026be9d8c0 1 > prepared operation key=UU88OS653L8D tag=E69HNP231UXI type=del size=3435875 2024-09-12T17:04:54.903 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.859+0000 7f026be9d8c0 1 < canceled operation key=UU88OS653L8D tag=OLPI8F0S6CKS type=del size=3698521 2024-09-12T17:04:54.903 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.867+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~9GR1WUJSCRQ2.0 size=474126 2024-09-12T17:04:54.903 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.867+0000 7f026be9d8c0 1 > prepared multipart upload key=JJMEQ2O00SA2 upload=9GR1WUJSCRQ2 tag=A515AMC4SVPS type=write size=1522702 2024-09-12T17:04:54.903 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.871+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~7P9ZRMTWS3GV.0 size=1048576 2024-09-12T17:04:54.903 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.875+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~7P9ZRMTWS3GV.1 size=476210 2024-09-12T17:04:54.903 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.879+0000 7f026be9d8c0 1 < completed multipart upload key=Y27CDEOCM7DH upload=7P9ZRMTWS3GV tag=RPBM0Y7N2XS6 type=write size=2573362 2024-09-12T17:04:54.903 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.887+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~BVW2RYK7ZU2L.0 size=969726 2024-09-12T17:04:54.903 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.887+0000 7f026be9d8c0 1 > prepared multipart upload key=J8MU1A0CWSAQ upload=BVW2RYK7ZU2L tag=0GVGBVQ0S9K0 type=write size=2018302 2024-09-12T17:04:54.904 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.891+0000 7f026be9d8c0 1 < completed delete operation key=2BQJ30RQQ25L tag=IEX8PA3K9OVO type=del 2024-09-12T17:04:54.904 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.899+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~15VHZ1KSPD5D.0 size=1048576 2024-09-12T17:04:54.905 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.899+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~15VHZ1KSPD5D.1 size=222599 2024-09-12T17:04:54.905 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.899+0000 7f026be9d8c0 1 > prepared multipart upload key=QVQ4TI319DH5 upload=15VHZ1KSPD5D tag=1AUBVVVQ6LR9 type=write size=2319751 2024-09-12T17:04:54.908 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.903+0000 7f026be9d8c0 1 < completed delete operation key=4U1W97V0OX11 tag=RCI9C0QYI63A type=del 2024-09-12T17:04:54.911 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.907+0000 7f026be9d8c0 1 > prepared operation key=T6QRDTQRHBPI tag=Q2SYS527H0W3 type=write size=293164 2024-09-12T17:04:54.915 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.911+0000 7f026be9d8c0 1 < completed part key=_multipart_E0Y3SKNUYCQS.2~Z02VBRF59CCQ.0 size=1048576 2024-09-12T17:04:54.918 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.911+0000 7f026be9d8c0 1 < completed part key=_multipart_E0Y3SKNUYCQS.2~Z02VBRF59CCQ.1 size=1048576 2024-09-12T17:04:54.921 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.915+0000 7f026be9d8c0 1 < completed part key=_multipart_E0Y3SKNUYCQS.2~Z02VBRF59CCQ.2 size=450956 2024-09-12T17:04:54.927 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.923+0000 7f026be9d8c0 1 < completed multipart upload key=E0Y3SKNUYCQS upload=Z02VBRF59CCQ tag=XE8AGTQ0KU8T type=write size=3596684 2024-09-12T17:04:54.930 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.927+0000 7f026be9d8c0 1 > prepared operation key=E0Y3SKNUYCQS tag=HWFPGF91U8CQ type=del size=2944188 2024-09-12T17:04:54.936 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.931+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~V1Z8ONBD7408.0 size=1002019 2024-09-12T17:04:54.942 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.935+0000 7f026be9d8c0 1 < completed multipart upload key=4G3BKGNT3YZC upload=V1Z8ONBD7408 tag=MD1JXWMU1LAL type=write size=2050595 2024-09-12T17:04:54.945 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.939+0000 7f026be9d8c0 1 > prepared operation key=J8MU1A0CWSAQ tag=5VIQYOLDMJHD type=del size=1617770 2024-09-12T17:04:54.948 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.943+0000 7f026be9d8c0 1 < completed part key=_multipart_SGT8IC1GJ3IG.2~781SSAOJOWS4.0 size=1048576 2024-09-12T17:04:54.951 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.947+0000 7f026be9d8c0 1 < completed part key=_multipart_SGT8IC1GJ3IG.2~781SSAOJOWS4.1 size=829154 2024-09-12T17:04:54.956 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.951+0000 7f026be9d8c0 1 < completed multipart upload key=SGT8IC1GJ3IG upload=781SSAOJOWS4 tag=89DZ1TT4AFM7 type=write size=2926306 2024-09-12T17:04:54.960 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.955+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=GV74UTZV5DNC type=del size=65986 2024-09-12T17:04:54.963 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.959+0000 7f026be9d8c0 1 < completed delete operation key=PQSQ39X3O64P tag=F3DTK7WY61ZL type=del 2024-09-12T17:04:54.967 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.963+0000 7f026be9d8c0 1 > prepared operation key=XNBE2II106VZ tag=Y4POFH0XQ1HC type=del size=2526181 2024-09-12T17:04:54.970 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.967+0000 7f026be9d8c0 1 < completed delete operation key=XNBE2II106VZ tag=HY84OYX0W32G type=del 2024-09-12T17:04:54.973 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.967+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=FSKWNEB8PNWO type=write size=275294 2024-09-12T17:04:54.977 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.971+0000 7f026be9d8c0 1 < completed delete operation key=6VO85REZG2NW tag=291D460FTROD type=del 2024-09-12T17:04:54.983 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.979+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~WZ9F2E6XME1B.0 size=1048576 2024-09-12T17:04:54.986 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.983+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~WZ9F2E6XME1B.1 size=492944 2024-09-12T17:04:54.986 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.983+0000 7f026be9d8c0 1 > prepared multipart upload key=Y27CDEOCM7DH upload=WZ9F2E6XME1B tag=9BSQKAF7AWO9 type=write size=2590096 2024-09-12T17:04:54.989 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.983+0000 7f026be9d8c0 1 < completed part key=_multipart_XNBE2II106VZ.2~IMA3409X1ZSB.0 size=806299 2024-09-12T17:04:54.995 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.991+0000 7f026be9d8c0 1 < completed multipart upload key=XNBE2II106VZ upload=IMA3409X1ZSB tag=RK5QHG00LZ71 type=write size=1854875 2024-09-12T17:04:54.999 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.995+0000 7f026be9d8c0 1 > prepared operation key=LHKLWIUAT08F tag=9NIBH1YUQ9P3 type=del size=3094198 2024-09-12T17:04:55.002 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.999+0000 7f026be9d8c0 1 < completed part key=_multipart_SO3HLQZA8B6B.2~D1PO3OFLD5GC.0 size=1048576 2024-09-12T17:04:55.005 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:54.999+0000 7f026be9d8c0 1 < completed part key=_multipart_SO3HLQZA8B6B.2~D1PO3OFLD5GC.1 size=966763 2024-09-12T17:04:55.011 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.007+0000 7f026be9d8c0 1 < completed multipart upload key=SO3HLQZA8B6B upload=D1PO3OFLD5GC tag=BSM1QQA7JA5Z type=write size=3063915 2024-09-12T17:04:55.014 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.007+0000 7f026be9d8c0 1 > prepared operation key=XNBE2II106VZ tag=IBWFGQ0RQX10 type=del size=2467419 2024-09-12T17:04:55.017 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.011+0000 7f026be9d8c0 1 < completed delete operation key=UU88OS653L8D tag=LBE7Z9C7X6BV type=del 2024-09-12T17:04:55.024 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.019+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~F3Y7WWCX0592.0 size=1048576 2024-09-12T17:04:55.026 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.023+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~F3Y7WWCX0592.1 size=1048576 2024-09-12T17:04:55.030 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.023+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~F3Y7WWCX0592.2 size=691651 2024-09-12T17:04:55.030 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.023+0000 7f026be9d8c0 1 > prepared multipart upload key=ALFGNC1YNROX upload=F3Y7WWCX0592 tag=X9X3U5ZP7FPW type=write size=3837379 2024-09-12T17:04:55.033 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.027+0000 7f026be9d8c0 1 < completed delete operation key=T6QRDTQRHBPI tag=5X5DBCZZ58DA type=del 2024-09-12T17:04:55.037 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.031+0000 7f026be9d8c0 1 > prepared operation key=BBYDPSXZKHZP tag=7C2Y9YOVVP8D type=write size=243637 2024-09-12T17:04:55.041 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.035+0000 7f026be9d8c0 1 < completed write operation key=2BQJ30RQQ25L tag=RFX6NC1P27AH type=write size=430671 2024-09-12T17:04:55.047 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.043+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~XSTC8A0GISL5.0 size=1048576 2024-09-12T17:04:55.050 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.047+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~XSTC8A0GISL5.1 size=545986 2024-09-12T17:04:55.050 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.047+0000 7f026be9d8c0 1 > prepared multipart upload key=XLKR6P8RNRVO upload=XSTC8A0GISL5 tag=IKH73P3ZX0AA type=write size=2643138 2024-09-12T17:04:55.054 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.047+0000 7f026be9d8c0 1 < completed delete operation key=UU88OS653L8D tag=E69HNP231UXI type=del 2024-09-12T17:04:55.059 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.051+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=4JD4NNJZHNPL type=del size=1029882 2024-09-12T17:04:55.060 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.055+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~9GR1WUJSCRQ2.0 size=474126 2024-09-12T17:04:55.067 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.063+0000 7f026be9d8c0 1 < completed multipart upload key=JJMEQ2O00SA2 upload=9GR1WUJSCRQ2 tag=A515AMC4SVPS type=write size=1522702 2024-09-12T17:04:55.073 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.067+0000 7f026be9d8c0 1 > prepared part key=_multipart_LHKLWIUAT08F.2~WN66BC4UH6FE.0 size=1048576 2024-09-12T17:04:55.075 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.071+0000 7f026be9d8c0 1 > prepared part key=_multipart_LHKLWIUAT08F.2~WN66BC4UH6FE.1 size=1048576 2024-09-12T17:04:55.078 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.075+0000 7f026be9d8c0 1 > prepared part key=_multipart_LHKLWIUAT08F.2~WN66BC4UH6FE.2 size=583866 2024-09-12T17:04:55.078 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.075+0000 7f026be9d8c0 1 > prepared multipart upload key=LHKLWIUAT08F upload=WN66BC4UH6FE tag=P1TKLP2KK61B type=write size=3729594 2024-09-12T17:04:55.081 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.075+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~BVW2RYK7ZU2L.0 size=969726 2024-09-12T17:04:55.087 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.083+0000 7f026be9d8c0 1 < completed multipart upload key=J8MU1A0CWSAQ upload=BVW2RYK7ZU2L tag=0GVGBVQ0S9K0 type=write size=2018302 2024-09-12T17:04:55.090 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.087+0000 7f026be9d8c0 1 > prepared operation key=ALFGNC1YNROX tag=ZPCFLJLNDCJN type=del size=3893606 2024-09-12T17:04:55.094 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.091+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~15VHZ1KSPD5D.0 size=1048576 2024-09-12T17:04:55.097 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.091+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~15VHZ1KSPD5D.1 size=222599 2024-09-12T17:04:55.102 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.099+0000 7f026be9d8c0 1 < completed multipart upload key=QVQ4TI319DH5 upload=15VHZ1KSPD5D tag=1AUBVVVQ6LR9 type=write size=2319751 2024-09-12T17:04:55.109 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.103+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~K9ZW2598SQCR.0 size=1048576 2024-09-12T17:04:55.111 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.107+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~K9ZW2598SQCR.1 size=1048576 2024-09-12T17:04:55.114 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.111+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~K9ZW2598SQCR.2 size=674982 2024-09-12T17:04:55.114 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.111+0000 7f026be9d8c0 1 > prepared multipart upload key=4G3BKGNT3YZC upload=K9ZW2598SQCR tag=EIGQO9837BB0 type=write size=3820710 2024-09-12T17:04:55.117 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.111+0000 7f026be9d8c0 1 < canceled operation key=T6QRDTQRHBPI tag=Q2SYS527H0W3 type=write size=293164 2024-09-12T17:04:55.124 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.119+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~IAKY9Y86MHZN.0 size=1048576 2024-09-12T17:04:55.126 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.123+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~IAKY9Y86MHZN.1 size=1048576 2024-09-12T17:04:55.129 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.123+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~IAKY9Y86MHZN.2 size=85718 2024-09-12T17:04:55.129 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.123+0000 7f026be9d8c0 1 > prepared multipart upload key=Y27CDEOCM7DH upload=IAKY9Y86MHZN tag=GQTJZWY1QODX type=write size=3231446 2024-09-12T17:04:55.132 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.127+0000 7f026be9d8c0 1 < completed delete operation key=E0Y3SKNUYCQS tag=HWFPGF91U8CQ type=del 2024-09-12T17:04:55.136 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.131+0000 7f026be9d8c0 1 > prepared operation key=SGT8IC1GJ3IG tag=6FO0NGHYKAHY type=del size=2425080 2024-09-12T17:04:55.139 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.135+0000 7f026be9d8c0 1 < completed delete operation key=J8MU1A0CWSAQ tag=5VIQYOLDMJHD type=del 2024-09-12T17:04:55.145 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.139+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~MV13BMNW22I0.0 size=1048576 2024-09-12T17:04:55.148 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.143+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~MV13BMNW22I0.1 size=1048576 2024-09-12T17:04:55.150 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.147+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~MV13BMNW22I0.2 size=78163 2024-09-12T17:04:55.150 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.147+0000 7f026be9d8c0 1 > prepared multipart upload key=Y27CDEOCM7DH upload=MV13BMNW22I0 tag=YOX6YG2XJ6FE type=write size=3223891 2024-09-12T17:04:55.157 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.151+0000 7f026be9d8c0 1 < suggested remove operation key=RBNN03IPZ8BT tag=GV74UTZV5DNC type=del 2024-09-12T17:04:55.161 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.155+0000 7f026be9d8c0 1 > prepared operation key=XLKR6P8RNRVO tag=JB30ZSZIRBRE type=del size=1253968 2024-09-12T17:04:55.165 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.159+0000 7f026be9d8c0 1 < completed delete operation key=XNBE2II106VZ tag=Y4POFH0XQ1HC type=del 2024-09-12T17:04:55.171 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.167+0000 7f026be9d8c0 1 > prepared part key=_multipart_L194KQIPFLE1.2~TEWG0DH5A9I8.0 size=1048576 2024-09-12T17:04:55.174 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.171+0000 7f026be9d8c0 1 > prepared part key=_multipart_L194KQIPFLE1.2~TEWG0DH5A9I8.1 size=1048576 2024-09-12T17:04:55.176 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.171+0000 7f026be9d8c0 1 > prepared part key=_multipart_L194KQIPFLE1.2~TEWG0DH5A9I8.2 size=452846 2024-09-12T17:04:55.176 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.171+0000 7f026be9d8c0 1 > prepared multipart upload key=L194KQIPFLE1 upload=TEWG0DH5A9I8 tag=4SQD522DX9JK type=write size=3598574 2024-09-12T17:04:55.180 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.175+0000 7f026be9d8c0 1 < completed write operation key=3JADN360QEO3 tag=FSKWNEB8PNWO type=write size=275294 2024-09-12T17:04:55.186 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.183+0000 7f026be9d8c0 1 > prepared part key=_multipart_U8W1SAVSLTBF.2~0L9I959JIBYH.0 size=1048576 2024-09-12T17:04:55.188 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.183+0000 7f026be9d8c0 1 > prepared part key=_multipart_U8W1SAVSLTBF.2~0L9I959JIBYH.1 size=600153 2024-09-12T17:04:55.189 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.183+0000 7f026be9d8c0 1 > prepared multipart upload key=U8W1SAVSLTBF upload=0L9I959JIBYH tag=3W9KIUKQR6OQ type=write size=2697305 2024-09-12T17:04:55.192 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.187+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~WZ9F2E6XME1B.0 size=1048576 2024-09-12T17:04:55.195 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.191+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~WZ9F2E6XME1B.1 size=492944 2024-09-12T17:04:55.200 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.195+0000 7f026be9d8c0 1 < completed multipart upload key=Y27CDEOCM7DH upload=WZ9F2E6XME1B tag=9BSQKAF7AWO9 type=write size=2590096 2024-09-12T17:04:55.206 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.203+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~0OG2KPIIF0IW.0 size=1048576 2024-09-12T17:04:55.209 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.203+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~0OG2KPIIF0IW.1 size=17217 2024-09-12T17:04:55.209 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.203+0000 7f026be9d8c0 1 > prepared multipart upload key=UU88OS653L8D upload=0OG2KPIIF0IW tag=TAK0FTBI1TSS type=write size=2114369 2024-09-12T17:04:55.212 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.207+0000 7f026be9d8c0 1 < completed delete operation key=LHKLWIUAT08F tag=9NIBH1YUQ9P3 type=del 2024-09-12T17:04:55.216 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.211+0000 7f026be9d8c0 1 > prepared operation key=XNBE2II106VZ tag=SI5YAV68PTCK type=del size=958992 2024-09-12T17:04:55.222 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.219+0000 7f026be9d8c0 1 < suggested remove operation key=XNBE2II106VZ tag=IBWFGQ0RQX10 type=del 2024-09-12T17:04:55.228 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.223+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~8L8B06G3NMTT.0 size=1048576 2024-09-12T17:04:55.231 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.227+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~8L8B06G3NMTT.1 size=1048576 2024-09-12T17:04:55.233 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.227+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~8L8B06G3NMTT.2 size=685967 2024-09-12T17:04:55.233 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.227+0000 7f026be9d8c0 1 > prepared multipart upload key=GPUFWJ3AWEMX upload=8L8B06G3NMTT tag=JDU9Y8Q3PWXL type=write size=3831695 2024-09-12T17:04:55.237 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.231+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~F3Y7WWCX0592.0 size=1048576 2024-09-12T17:04:55.239 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.235+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~F3Y7WWCX0592.1 size=1048576 2024-09-12T17:04:55.242 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.239+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~F3Y7WWCX0592.2 size=691651 2024-09-12T17:04:55.250 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.247+0000 7f026be9d8c0 1 < completed multipart upload key=ALFGNC1YNROX upload=F3Y7WWCX0592 tag=X9X3U5ZP7FPW type=write size=3837379 2024-09-12T17:04:55.257 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.251+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~KUJVANOYPV9E.0 size=1048576 2024-09-12T17:04:55.259 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.255+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~KUJVANOYPV9E.1 size=1048576 2024-09-12T17:04:55.261 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.255+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~KUJVANOYPV9E.2 size=216119 2024-09-12T17:04:55.261 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.255+0000 7f026be9d8c0 1 > prepared multipart upload key=J8MU1A0CWSAQ upload=KUJVANOYPV9E tag=JQ4TNMKF4JVI type=write size=3361847 2024-09-12T17:04:55.264 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.259+0000 7f026be9d8c0 1 < completed write operation key=BBYDPSXZKHZP tag=7C2Y9YOVVP8D type=write size=243637 2024-09-12T17:04:55.268 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.263+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=ST4PIUOPF1L8 type=del size=716648 2024-09-12T17:04:55.268 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.263+0000 7f026be9d8c0 1 < canceled part key=_multipart_XLKR6P8RNRVO.2~XSTC8A0GISL5.0 size=1048576 2024-09-12T17:04:55.271 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.267+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~XSTC8A0GISL5.1 size=545986 2024-09-12T17:04:55.276 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.271+0000 7f026be9d8c0 1 < canceled multipart upload key=XLKR6P8RNRVO upload=XSTC8A0GISL5 tag=IKH73P3ZX0AA type=write size=2643138 2024-09-12T17:04:55.279 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.275+0000 7f026be9d8c0 1 > prepared operation key=XNBE2II106VZ tag=5YBX1FHTQ108 type=del size=4235 2024-09-12T17:04:55.282 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.279+0000 7f026be9d8c0 -1 < failed to complete operation key=RBNN03IPZ8BT tag=4JD4NNJZHNPL type=del size=1029882: (22) Invalid argument 2024-09-12T17:04:55.288 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.283+0000 7f026be9d8c0 1 > prepared part key=_multipart_3JADN360QEO3.2~SFRZQVEYUPNY.0 size=1048576 2024-09-12T17:04:55.291 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.287+0000 7f026be9d8c0 1 > prepared part key=_multipart_3JADN360QEO3.2~SFRZQVEYUPNY.1 size=1048576 2024-09-12T17:04:55.293 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.287+0000 7f026be9d8c0 1 > prepared part key=_multipart_3JADN360QEO3.2~SFRZQVEYUPNY.2 size=569628 2024-09-12T17:04:55.293 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.287+0000 7f026be9d8c0 1 > prepared multipart upload key=3JADN360QEO3 upload=SFRZQVEYUPNY tag=5D3OFHJ4F6J9 type=write size=3715356 2024-09-12T17:04:55.296 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.291+0000 7f026be9d8c0 1 < completed part key=_multipart_LHKLWIUAT08F.2~WN66BC4UH6FE.0 size=1048576 2024-09-12T17:04:55.299 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.295+0000 7f026be9d8c0 1 < completed part key=_multipart_LHKLWIUAT08F.2~WN66BC4UH6FE.1 size=1048576 2024-09-12T17:04:55.301 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.295+0000 7f026be9d8c0 1 < completed part key=_multipart_LHKLWIUAT08F.2~WN66BC4UH6FE.2 size=583866 2024-09-12T17:04:55.307 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.303+0000 7f026be9d8c0 1 < completed multipart upload key=LHKLWIUAT08F upload=WN66BC4UH6FE tag=P1TKLP2KK61B type=write size=3729594 2024-09-12T17:04:55.314 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.307+0000 7f026be9d8c0 1 > prepared part key=_multipart_T6QRDTQRHBPI.2~E4WCQ8TU2QJV.0 size=986913 2024-09-12T17:04:55.314 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.307+0000 7f026be9d8c0 1 > prepared multipart upload key=T6QRDTQRHBPI upload=E4WCQ8TU2QJV tag=MK9JIGBHIG8V type=write size=2035489 2024-09-12T17:04:55.317 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.311+0000 7f026be9d8c0 1 < completed delete operation key=ALFGNC1YNROX tag=ZPCFLJLNDCJN type=del 2024-09-12T17:04:55.323 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.319+0000 7f026be9d8c0 1 > prepared part key=_multipart_E0Y3SKNUYCQS.2~IGB373MJDLY2.0 size=14279 2024-09-12T17:04:55.324 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.319+0000 7f026be9d8c0 1 > prepared multipart upload key=E0Y3SKNUYCQS upload=IGB373MJDLY2 tag=8BEM2XGGO548 type=write size=1062855 2024-09-12T17:04:55.328 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.323+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~K9ZW2598SQCR.0 size=1048576 2024-09-12T17:04:55.330 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.327+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~K9ZW2598SQCR.1 size=1048576 2024-09-12T17:04:55.333 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.327+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~K9ZW2598SQCR.2 size=674982 2024-09-12T17:04:55.341 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.335+0000 7f026be9d8c0 1 < completed multipart upload key=4G3BKGNT3YZC upload=K9ZW2598SQCR tag=EIGQO9837BB0 type=write size=3820710 2024-09-12T17:04:55.347 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.343+0000 7f026be9d8c0 1 > prepared part key=_multipart_E0Y3SKNUYCQS.2~KR77VPZ9QR2H.0 size=1048576 2024-09-12T17:04:55.350 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.347+0000 7f026be9d8c0 1 > prepared part key=_multipart_E0Y3SKNUYCQS.2~KR77VPZ9QR2H.1 size=1048576 2024-09-12T17:04:55.353 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.347+0000 7f026be9d8c0 1 > prepared part key=_multipart_E0Y3SKNUYCQS.2~KR77VPZ9QR2H.2 size=770751 2024-09-12T17:04:55.353 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.347+0000 7f026be9d8c0 1 > prepared multipart upload key=E0Y3SKNUYCQS upload=KR77VPZ9QR2H tag=0RNC2EEFD1YP type=write size=3916479 2024-09-12T17:04:55.353 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.347+0000 7f026be9d8c0 1 < canceled part key=_multipart_Y27CDEOCM7DH.2~IAKY9Y86MHZN.0 size=1048576 2024-09-12T17:04:55.356 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.351+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~IAKY9Y86MHZN.1 size=1048576 2024-09-12T17:04:55.360 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.355+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~IAKY9Y86MHZN.2 size=85718 2024-09-12T17:04:55.365 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.359+0000 7f026be9d8c0 1 < canceled multipart upload key=Y27CDEOCM7DH upload=IAKY9Y86MHZN tag=GQTJZWY1QODX type=write size=3231446 2024-09-12T17:04:55.368 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.363+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=P01TGYDS693L type=del size=2648063 2024-09-12T17:04:55.372 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.367+0000 7f026be9d8c0 1 < completed delete operation key=SGT8IC1GJ3IG tag=6FO0NGHYKAHY type=del 2024-09-12T17:04:55.376 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.371+0000 7f026be9d8c0 1 > prepared operation key=GPUFWJ3AWEMX tag=8CBCWUK7FF9Q type=del size=2821277 2024-09-12T17:04:55.377 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.371+0000 7f026be9d8c0 1 < canceled part key=_multipart_Y27CDEOCM7DH.2~MV13BMNW22I0.0 size=1048576 2024-09-12T17:04:55.380 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.375+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~MV13BMNW22I0.1 size=1048576 2024-09-12T17:04:55.382 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.379+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~MV13BMNW22I0.2 size=78163 2024-09-12T17:04:55.388 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.383+0000 7f026be9d8c0 1 < canceled multipart upload key=Y27CDEOCM7DH upload=MV13BMNW22I0 tag=YOX6YG2XJ6FE type=write size=3223891 2024-09-12T17:04:55.392 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.387+0000 7f026be9d8c0 1 > prepared operation key=4G3BKGNT3YZC tag=IMGRJVS0OMB1 type=del size=3781796 2024-09-12T17:04:55.396 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.391+0000 7f026be9d8c0 1 < completed delete operation key=XLKR6P8RNRVO tag=JB30ZSZIRBRE type=del 2024-09-12T17:04:55.399 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.395+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=6NGAWRBBJQ39 type=write size=476232 2024-09-12T17:04:55.403 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.399+0000 7f026be9d8c0 1 < completed part key=_multipart_L194KQIPFLE1.2~TEWG0DH5A9I8.0 size=1048576 2024-09-12T17:04:55.406 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.399+0000 7f026be9d8c0 1 < completed part key=_multipart_L194KQIPFLE1.2~TEWG0DH5A9I8.1 size=1048576 2024-09-12T17:04:55.409 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.403+0000 7f026be9d8c0 1 < completed part key=_multipart_L194KQIPFLE1.2~TEWG0DH5A9I8.2 size=452846 2024-09-12T17:04:55.415 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.411+0000 7f026be9d8c0 1 < completed multipart upload key=L194KQIPFLE1 upload=TEWG0DH5A9I8 tag=4SQD522DX9JK type=write size=3598574 2024-09-12T17:04:55.419 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.415+0000 7f026be9d8c0 1 > prepared operation key=32XUMOWT8HO2 tag=N3U3IVRLO76Q type=write size=1046567 2024-09-12T17:04:55.423 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.419+0000 7f026be9d8c0 1 < completed part key=_multipart_U8W1SAVSLTBF.2~0L9I959JIBYH.0 size=1048576 2024-09-12T17:04:55.427 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.423+0000 7f026be9d8c0 1 < completed part key=_multipart_U8W1SAVSLTBF.2~0L9I959JIBYH.1 size=600153 2024-09-12T17:04:55.434 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.431+0000 7f026be9d8c0 1 < completed multipart upload key=U8W1SAVSLTBF upload=0L9I959JIBYH tag=3W9KIUKQR6OQ type=write size=2697305 2024-09-12T17:04:55.442 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.435+0000 7f026be9d8c0 1 > prepared part key=_multipart_SGT8IC1GJ3IG.2~AR1Z3Q5F6HQQ.0 size=1048576 2024-09-12T17:04:55.445 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.439+0000 7f026be9d8c0 1 > prepared part key=_multipart_SGT8IC1GJ3IG.2~AR1Z3Q5F6HQQ.1 size=1048576 2024-09-12T17:04:55.448 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.443+0000 7f026be9d8c0 1 > prepared part key=_multipart_SGT8IC1GJ3IG.2~AR1Z3Q5F6HQQ.2 size=501665 2024-09-12T17:04:55.448 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.443+0000 7f026be9d8c0 1 > prepared multipart upload key=SGT8IC1GJ3IG upload=AR1Z3Q5F6HQQ tag=XB32I670GO45 type=write size=3647393 2024-09-12T17:04:55.452 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.447+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~0OG2KPIIF0IW.0 size=1048576 2024-09-12T17:04:55.452 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.447+0000 7f026be9d8c0 1 < canceled part key=_multipart_UU88OS653L8D.2~0OG2KPIIF0IW.1 size=17217 2024-09-12T17:04:55.458 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.455+0000 7f026be9d8c0 1 < canceled multipart upload key=UU88OS653L8D upload=0OG2KPIIF0IW tag=TAK0FTBI1TSS type=write size=2114369 2024-09-12T17:04:55.461 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.455+0000 7f026be9d8c0 1 > prepared operation key=2BQJ30RQQ25L tag=5WXCJGC93J8L type=write size=610735 2024-09-12T17:04:55.465 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.459+0000 7f026be9d8c0 -1 < failed to complete operation key=XNBE2II106VZ tag=SI5YAV68PTCK type=del size=958992: (22) Invalid argument 2024-09-12T17:04:55.468 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.463+0000 7f026be9d8c0 1 > prepared operation key=UU88OS653L8D tag=N059052OC81W type=del size=166615 2024-09-12T17:04:55.471 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.467+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~8L8B06G3NMTT.0 size=1048576 2024-09-12T17:04:55.474 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.471+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~8L8B06G3NMTT.1 size=1048576 2024-09-12T17:04:55.477 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.471+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~8L8B06G3NMTT.2 size=685967 2024-09-12T17:04:55.483 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.479+0000 7f026be9d8c0 1 < completed multipart upload key=GPUFWJ3AWEMX upload=8L8B06G3NMTT tag=JDU9Y8Q3PWXL type=write size=3831695 2024-09-12T17:04:55.486 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.483+0000 7f026be9d8c0 1 > prepared operation key=BBYDPSXZKHZP tag=ZGFJBLALYSJN type=del size=1889474 2024-09-12T17:04:55.492 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.487+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~KUJVANOYPV9E.0 size=1048576 2024-09-12T17:04:55.494 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.491+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~KUJVANOYPV9E.1 size=1048576 2024-09-12T17:04:55.497 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.491+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~KUJVANOYPV9E.2 size=216119 2024-09-12T17:04:55.502 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.499+0000 7f026be9d8c0 1 < completed multipart upload key=J8MU1A0CWSAQ upload=KUJVANOYPV9E tag=JQ4TNMKF4JVI type=write size=3361847 2024-09-12T17:04:55.509 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.503+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~GKNGH0X57121.0 size=361795 2024-09-12T17:04:55.509 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.503+0000 7f026be9d8c0 1 > prepared multipart upload key=JJMEQ2O00SA2 upload=GKNGH0X57121 tag=8IYNHMH5RJEO type=write size=1410371 2024-09-12T17:04:55.512 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.507+0000 7f026be9d8c0 1 < completed delete operation key=RBNN03IPZ8BT tag=ST4PIUOPF1L8 type=del 2024-09-12T17:04:55.515 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.511+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=8CB7GSY0NA6A type=del size=1896637 2024-09-12T17:04:55.522 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.519+0000 7f026be9d8c0 1 < suggested update operation key=XNBE2II106VZ tag=5YBX1FHTQ108 type=del size=4235 2024-09-12T17:04:55.528 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.523+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~ADQZA2SZ8D05.0 size=328009 2024-09-12T17:04:55.528 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.523+0000 7f026be9d8c0 1 > prepared multipart upload key=8AFDAVJLMRD2 upload=ADQZA2SZ8D05 tag=T0TB4QI8CUGS type=write size=1376585 2024-09-12T17:04:55.532 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.527+0000 7f026be9d8c0 1 < completed part key=_multipart_3JADN360QEO3.2~SFRZQVEYUPNY.0 size=1048576 2024-09-12T17:04:55.535 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.531+0000 7f026be9d8c0 1 < completed part key=_multipart_3JADN360QEO3.2~SFRZQVEYUPNY.1 size=1048576 2024-09-12T17:04:55.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.531+0000 7f026be9d8c0 1 < completed part key=_multipart_3JADN360QEO3.2~SFRZQVEYUPNY.2 size=569628 2024-09-12T17:04:55.543 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.539+0000 7f026be9d8c0 1 < completed multipart upload key=3JADN360QEO3 upload=SFRZQVEYUPNY tag=5D3OFHJ4F6J9 type=write size=3715356 2024-09-12T17:04:55.550 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.543+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~0Z6UWJV5E4UB.0 size=1048576 2024-09-12T17:04:55.552 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.547+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~0Z6UWJV5E4UB.1 size=1048576 2024-09-12T17:04:55.555 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.551+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~0Z6UWJV5E4UB.2 size=83882 2024-09-12T17:04:55.555 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.551+0000 7f026be9d8c0 1 > prepared multipart upload key=JJMEQ2O00SA2 upload=0Z6UWJV5E4UB tag=OWYAU5CPIO7E type=write size=3229610 2024-09-12T17:04:55.556 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.551+0000 7f026be9d8c0 1 < canceled part key=_multipart_T6QRDTQRHBPI.2~E4WCQ8TU2QJV.0 size=986913 2024-09-12T17:04:55.561 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.555+0000 7f026be9d8c0 1 < canceled multipart upload key=T6QRDTQRHBPI upload=E4WCQ8TU2QJV tag=MK9JIGBHIG8V type=write size=2035489 2024-09-12T17:04:55.571 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.567+0000 7f026be9d8c0 1 > prepared part key=_multipart_PQSQ39X3O64P.2~K8GD8BV6ZXET.0 size=1048576 2024-09-12T17:04:55.574 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.571+0000 7f026be9d8c0 1 > prepared part key=_multipart_PQSQ39X3O64P.2~K8GD8BV6ZXET.1 size=970823 2024-09-12T17:04:55.574 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.571+0000 7f026be9d8c0 1 > prepared multipart upload key=PQSQ39X3O64P upload=K8GD8BV6ZXET tag=R1N19NWQVZFJ type=write size=3067975 2024-09-12T17:04:55.577 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.571+0000 7f026be9d8c0 1 < completed part key=_multipart_E0Y3SKNUYCQS.2~IGB373MJDLY2.0 size=14279 2024-09-12T17:04:55.584 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.579+0000 7f026be9d8c0 1 < completed multipart upload key=E0Y3SKNUYCQS upload=IGB373MJDLY2 tag=8BEM2XGGO548 type=write size=1062855 2024-09-12T17:04:55.587 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.583+0000 7f026be9d8c0 1 > prepared operation key=ALFGNC1YNROX tag=A9O92NZBXOWN type=del size=2082113 2024-09-12T17:04:55.591 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.587+0000 7f026be9d8c0 1 < completed part key=_multipart_E0Y3SKNUYCQS.2~KR77VPZ9QR2H.0 size=1048576 2024-09-12T17:04:55.594 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.587+0000 7f026be9d8c0 1 < completed part key=_multipart_E0Y3SKNUYCQS.2~KR77VPZ9QR2H.1 size=1048576 2024-09-12T17:04:55.596 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.591+0000 7f026be9d8c0 1 < completed part key=_multipart_E0Y3SKNUYCQS.2~KR77VPZ9QR2H.2 size=770751 2024-09-12T17:04:55.602 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.599+0000 7f026be9d8c0 1 < completed multipart upload key=E0Y3SKNUYCQS upload=KR77VPZ9QR2H tag=0RNC2EEFD1YP type=write size=3916479 2024-09-12T17:04:55.606 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.603+0000 7f026be9d8c0 1 > prepared operation key=4G3BKGNT3YZC tag=03E0MCNRR94B type=write size=864262 2024-09-12T17:04:55.610 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.607+0000 7f026be9d8c0 1 < completed delete operation key=21ZD52VBZIO4 tag=P01TGYDS693L type=del 2024-09-12T17:04:55.614 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.607+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=3V30PNLMW9J5 type=del size=2925511 2024-09-12T17:04:55.618 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.611+0000 7f026be9d8c0 1 < completed delete operation key=GPUFWJ3AWEMX tag=8CBCWUK7FF9Q type=del 2024-09-12T17:04:55.622 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.619+0000 7f026be9d8c0 1 > prepared operation key=Y27CDEOCM7DH tag=9LEY1LX36BGB type=write size=885682 2024-09-12T17:04:55.625 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.619+0000 7f026be9d8c0 1 < canceled operation key=4G3BKGNT3YZC tag=IMGRJVS0OMB1 type=del size=3781796 2024-09-12T17:04:55.629 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.623+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=59TXSSBGJE3X type=del size=708755 2024-09-12T17:04:55.633 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.627+0000 7f026be9d8c0 1 < completed write operation key=U8W1SAVSLTBF tag=6NGAWRBBJQ39 type=write size=476232 2024-09-12T17:04:55.637 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.631+0000 7f026be9d8c0 1 > prepared operation key=SGT8IC1GJ3IG tag=IJZKU68KFKNR type=del size=720979 2024-09-12T17:04:55.640 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.635+0000 7f026be9d8c0 1 < completed write operation key=32XUMOWT8HO2 tag=N3U3IVRLO76Q type=write size=1046567 2024-09-12T17:04:55.644 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.639+0000 7f026be9d8c0 1 > prepared operation key=BW1T21LBUE2D tag=HL5GRKCR9J3M type=del size=3292145 2024-09-12T17:04:55.648 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.643+0000 7f026be9d8c0 1 < completed part key=_multipart_SGT8IC1GJ3IG.2~AR1Z3Q5F6HQQ.0 size=1048576 2024-09-12T17:04:55.650 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.647+0000 7f026be9d8c0 1 < completed part key=_multipart_SGT8IC1GJ3IG.2~AR1Z3Q5F6HQQ.1 size=1048576 2024-09-12T17:04:55.653 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.647+0000 7f026be9d8c0 1 < completed part key=_multipart_SGT8IC1GJ3IG.2~AR1Z3Q5F6HQQ.2 size=501665 2024-09-12T17:04:55.658 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.655+0000 7f026be9d8c0 1 < completed multipart upload key=SGT8IC1GJ3IG upload=AR1Z3Q5F6HQQ tag=XB32I670GO45 type=write size=3647393 2024-09-12T17:04:55.664 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.659+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~Q9430ER4649R.0 size=1048576 2024-09-12T17:04:55.667 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.663+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~Q9430ER4649R.1 size=150570 2024-09-12T17:04:55.667 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.663+0000 7f026be9d8c0 1 > prepared multipart upload key=JJMEQ2O00SA2 upload=Q9430ER4649R tag=32B1KY7NO0N1 type=write size=2247722 2024-09-12T17:04:55.673 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.667+0000 7f026be9d8c0 1 < suggested remove operation key=2BQJ30RQQ25L tag=5WXCJGC93J8L type=write 2024-09-12T17:04:55.677 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.671+0000 7f026be9d8c0 1 > prepared operation key=JJMEQ2O00SA2 tag=7W37P66YHS9N type=del size=3713380 2024-09-12T17:04:55.680 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.675+0000 7f026be9d8c0 1 < completed delete operation key=UU88OS653L8D tag=N059052OC81W type=del 2024-09-12T17:04:55.683 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.679+0000 7f026be9d8c0 1 > prepared operation key=XNBE2II106VZ tag=05W422FNXX7N type=write size=331042 2024-09-12T17:04:55.686 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.683+0000 7f026be9d8c0 1 < completed delete operation key=BBYDPSXZKHZP tag=ZGFJBLALYSJN type=del 2024-09-12T17:04:55.689 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.683+0000 7f026be9d8c0 1 > prepared operation key=BW1T21LBUE2D tag=80X7XHFUG8BM type=del size=2374767 2024-09-12T17:04:55.693 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.687+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~GKNGH0X57121.0 size=361795 2024-09-12T17:04:55.699 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.695+0000 7f026be9d8c0 1 < completed multipart upload key=JJMEQ2O00SA2 upload=GKNGH0X57121 tag=8IYNHMH5RJEO type=write size=1410371 2024-09-12T17:04:55.705 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.699+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~VL7KSU3WOB31.0 size=387152 2024-09-12T17:04:55.705 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.699+0000 7f026be9d8c0 1 > prepared multipart upload key=JJMEQ2O00SA2 upload=VL7KSU3WOB31 tag=S1CU7USH30IV type=write size=1435728 2024-09-12T17:04:55.708 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.703+0000 7f026be9d8c0 1 < completed delete operation key=21ZD52VBZIO4 tag=8CB7GSY0NA6A type=del 2024-09-12T17:04:55.713 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.707+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~MK7CJV6DPWR2.0 size=629566 2024-09-12T17:04:55.713 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.707+0000 7f026be9d8c0 1 > prepared multipart upload key=QVQ4TI319DH5 upload=MK7CJV6DPWR2 tag=DC80WNY3N65Y type=write size=1678142 2024-09-12T17:04:55.716 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.711+0000 7f026be9d8c0 1 < completed part key=_multipart_8AFDAVJLMRD2.2~ADQZA2SZ8D05.0 size=328009 2024-09-12T17:04:55.722 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.715+0000 7f026be9d8c0 1 < completed multipart upload key=8AFDAVJLMRD2 upload=ADQZA2SZ8D05 tag=T0TB4QI8CUGS type=write size=1376585 2024-09-12T17:04:55.725 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.719+0000 7f026be9d8c0 1 > prepared operation key=SO3HLQZA8B6B tag=UZNA2XOPU545 type=del size=3848800 2024-09-12T17:04:55.728 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.723+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~0Z6UWJV5E4UB.0 size=1048576 2024-09-12T17:04:55.731 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.727+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~0Z6UWJV5E4UB.1 size=1048576 2024-09-12T17:04:55.733 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.727+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~0Z6UWJV5E4UB.2 size=83882 2024-09-12T17:04:55.739 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.735+0000 7f026be9d8c0 1 < completed multipart upload key=JJMEQ2O00SA2 upload=0Z6UWJV5E4UB tag=OWYAU5CPIO7E type=write size=3229610 2024-09-12T17:04:55.744 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.739+0000 7f026be9d8c0 1 > prepared part key=_multipart_L194KQIPFLE1.2~HE4OYLPD1K9O.0 size=1048576 2024-09-12T17:04:55.746 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.743+0000 7f026be9d8c0 1 > prepared part key=_multipart_L194KQIPFLE1.2~HE4OYLPD1K9O.1 size=229332 2024-09-12T17:04:55.746 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.743+0000 7f026be9d8c0 1 > prepared multipart upload key=L194KQIPFLE1 upload=HE4OYLPD1K9O tag=7DCO3R33AC60 type=write size=2326484 2024-09-12T17:04:55.749 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.743+0000 7f026be9d8c0 1 < completed part key=_multipart_PQSQ39X3O64P.2~K8GD8BV6ZXET.0 size=1048576 2024-09-12T17:04:55.750 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.743+0000 7f026be9d8c0 1 < canceled part key=_multipart_PQSQ39X3O64P.2~K8GD8BV6ZXET.1 size=970823 2024-09-12T17:04:55.754 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.751+0000 7f026be9d8c0 1 < canceled multipart upload key=PQSQ39X3O64P upload=K8GD8BV6ZXET tag=R1N19NWQVZFJ type=write size=3067975 2024-09-12T17:04:55.757 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.751+0000 7f026be9d8c0 1 > prepared operation key=SGT8IC1GJ3IG tag=7E1UNRIRIF61 type=del size=1368130 2024-09-12T17:04:55.760 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.755+0000 7f026be9d8c0 1 < completed delete operation key=ALFGNC1YNROX tag=A9O92NZBXOWN type=del 2024-09-12T17:04:55.763 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.759+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=YG2NEV0SJV5H type=del size=2874829 2024-09-12T17:04:55.768 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.763+0000 7f026be9d8c0 1 < suggested remove operation key=4G3BKGNT3YZC tag=03E0MCNRR94B type=write 2024-09-12T17:04:55.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.771+0000 7f026be9d8c0 1 > prepared part key=_multipart_4U1W97V0OX11.2~4DCHH29548Q7.0 size=1048576 2024-09-12T17:04:55.777 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.771+0000 7f026be9d8c0 1 > prepared part key=_multipart_4U1W97V0OX11.2~4DCHH29548Q7.1 size=819537 2024-09-12T17:04:55.777 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.771+0000 7f026be9d8c0 1 > prepared multipart upload key=4U1W97V0OX11 upload=4DCHH29548Q7 tag=FGV7B4HEEPLV type=write size=2916689 2024-09-12T17:04:55.779 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.775+0000 7f026be9d8c0 1 < completed delete operation key=U8W1SAVSLTBF tag=3V30PNLMW9J5 type=del 2024-09-12T17:04:55.782 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.775+0000 7f026be9d8c0 1 > prepared operation key=2BQJ30RQQ25L tag=PC39ZQGOVCA1 type=del size=3989524 2024-09-12T17:04:55.787 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.783+0000 7f026be9d8c0 1 < suggested remove operation key=Y27CDEOCM7DH tag=9LEY1LX36BGB type=write 2024-09-12T17:04:55.793 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.787+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~K2EN86F1HTDR.0 size=1048576 2024-09-12T17:04:55.795 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.791+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~K2EN86F1HTDR.1 size=1048576 2024-09-12T17:04:55.797 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.791+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~K2EN86F1HTDR.2 size=66600 2024-09-12T17:04:55.797 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.791+0000 7f026be9d8c0 1 > prepared multipart upload key=QVQ4TI319DH5 upload=K2EN86F1HTDR tag=39H9RB37F5XN type=write size=3212328 2024-09-12T17:04:55.800 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.795+0000 7f026be9d8c0 1 < completed delete operation key=U8W1SAVSLTBF tag=59TXSSBGJE3X type=del 2024-09-12T17:04:55.803 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.799+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=7X4IGN8I3ZVY type=del size=413905 2024-09-12T17:04:55.806 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.799+0000 7f026be9d8c0 1 < completed delete operation key=SGT8IC1GJ3IG tag=IJZKU68KFKNR type=del 2024-09-12T17:04:55.811 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.807+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~NCQRX7EIMV8C.0 size=1048576 2024-09-12T17:04:55.814 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.811+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~NCQRX7EIMV8C.1 size=505002 2024-09-12T17:04:55.814 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.811+0000 7f026be9d8c0 1 > prepared multipart upload key=Z9YNIEQCVNBA upload=NCQRX7EIMV8C tag=IY11T2KKEB1E type=write size=2602154 2024-09-12T17:04:55.817 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.811+0000 7f026be9d8c0 1 < completed delete operation key=BW1T21LBUE2D tag=HL5GRKCR9J3M type=del 2024-09-12T17:04:55.819 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.815+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=HDEJ1WEN3OB3 type=del size=848316 2024-09-12T17:04:55.823 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.819+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~Q9430ER4649R.0 size=1048576 2024-09-12T17:04:55.825 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.819+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~Q9430ER4649R.1 size=150570 2024-09-12T17:04:55.830 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.827+0000 7f026be9d8c0 1 < completed multipart upload key=JJMEQ2O00SA2 upload=Q9430ER4649R tag=32B1KY7NO0N1 type=write size=2247722 2024-09-12T17:04:55.833 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.827+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=HBQ6E83ZTU6N type=del size=3454552 2024-09-12T17:04:55.836 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.831+0000 7f026be9d8c0 1 < completed delete operation key=JJMEQ2O00SA2 tag=7W37P66YHS9N type=del 2024-09-12T17:04:55.841 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.835+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~HZ16O0QEM1AY.0 size=1048576 2024-09-12T17:04:55.843 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.839+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~HZ16O0QEM1AY.1 size=91768 2024-09-12T17:04:55.843 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.839+0000 7f026be9d8c0 1 > prepared multipart upload key=JJMEQ2O00SA2 upload=HZ16O0QEM1AY tag=7OPA3UGKM346 type=write size=2188920 2024-09-12T17:04:55.846 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.843+0000 7f026be9d8c0 1 < canceled operation key=XNBE2II106VZ tag=05W422FNXX7N type=write size=331042 2024-09-12T17:04:55.851 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.847+0000 7f026be9d8c0 1 > prepared part key=_multipart_E0Y3SKNUYCQS.2~E3HOAOMJJ3OK.0 size=1048576 2024-09-12T17:04:55.853 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.847+0000 7f026be9d8c0 1 > prepared part key=_multipart_E0Y3SKNUYCQS.2~E3HOAOMJJ3OK.1 size=1048576 2024-09-12T17:04:55.855 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.851+0000 7f026be9d8c0 1 > prepared part key=_multipart_E0Y3SKNUYCQS.2~E3HOAOMJJ3OK.2 size=1016787 2024-09-12T17:04:55.856 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.851+0000 7f026be9d8c0 1 > prepared multipart upload key=E0Y3SKNUYCQS upload=E3HOAOMJJ3OK tag=0BCT3U8XHKIP type=write size=4162515 2024-09-12T17:04:55.858 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.855+0000 7f026be9d8c0 1 < canceled operation key=BW1T21LBUE2D tag=80X7XHFUG8BM type=del size=2374767 2024-09-12T17:04:55.864 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.859+0000 7f026be9d8c0 1 > prepared operation key=QVQ4TI319DH5 tag=77HEST8H26C1 type=del size=3662004 2024-09-12T17:04:55.867 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.863+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~VL7KSU3WOB31.0 size=387152 2024-09-12T17:04:55.872 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.867+0000 7f026be9d8c0 1 < completed multipart upload key=JJMEQ2O00SA2 upload=VL7KSU3WOB31 tag=S1CU7USH30IV type=write size=1435728 2024-09-12T17:04:55.877 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.871+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~Z4DZR85Q7S5T.0 size=1048576 2024-09-12T17:04:55.880 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.875+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~Z4DZR85Q7S5T.1 size=838997 2024-09-12T17:04:55.880 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.875+0000 7f026be9d8c0 1 > prepared multipart upload key=8AFDAVJLMRD2 upload=Z4DZR85Q7S5T tag=5AA693MIJO8I type=write size=2936149 2024-09-12T17:04:55.883 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.879+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~MK7CJV6DPWR2.0 size=629566 2024-09-12T17:04:55.887 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.883+0000 7f026be9d8c0 1 < completed multipart upload key=QVQ4TI319DH5 upload=MK7CJV6DPWR2 tag=DC80WNY3N65Y type=write size=1678142 2024-09-12T17:04:55.890 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.887+0000 7f026be9d8c0 1 > prepared operation key=XNBE2II106VZ tag=U5YRYKHEZREA type=del size=3750798 2024-09-12T17:04:55.893 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.887+0000 7f026be9d8c0 1 < completed delete operation key=SO3HLQZA8B6B tag=UZNA2XOPU545 type=del 2024-09-12T17:04:55.895 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.891+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=CMXY8GKBINXK type=del size=1084033 2024-09-12T17:04:55.898 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.895+0000 7f026be9d8c0 1 < completed part key=_multipart_L194KQIPFLE1.2~HE4OYLPD1K9O.0 size=1048576 2024-09-12T17:04:55.900 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.895+0000 7f026be9d8c0 1 < completed part key=_multipart_L194KQIPFLE1.2~HE4OYLPD1K9O.1 size=229332 2024-09-12T17:04:55.905 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.899+0000 7f026be9d8c0 1 < completed multipart upload key=L194KQIPFLE1 upload=HE4OYLPD1K9O tag=7DCO3R33AC60 type=write size=2326484 2024-09-12T17:04:55.907 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.903+0000 7f026be9d8c0 1 > prepared operation key=4G3BKGNT3YZC tag=WJ4R0O49U7LF type=del size=2221715 2024-09-12T17:04:55.912 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.907+0000 7f026be9d8c0 1 < suggested remove operation key=SGT8IC1GJ3IG tag=7E1UNRIRIF61 type=del 2024-09-12T17:04:55.915 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.911+0000 7f026be9d8c0 1 > prepared operation key=L194KQIPFLE1 tag=HNZCDS1P1SB4 type=write size=661583 2024-09-12T17:04:55.917 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.911+0000 7f026be9d8c0 1 < completed delete operation key=RBNN03IPZ8BT tag=YG2NEV0SJV5H type=del 2024-09-12T17:04:55.920 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.915+0000 7f026be9d8c0 1 > prepared operation key=LHKLWIUAT08F tag=7MOT331S40PK type=del size=1282758 2024-09-12T17:04:55.923 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.919+0000 7f026be9d8c0 1 < completed part key=_multipart_4U1W97V0OX11.2~4DCHH29548Q7.0 size=1048576 2024-09-12T17:04:55.925 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.919+0000 7f026be9d8c0 1 < completed part key=_multipart_4U1W97V0OX11.2~4DCHH29548Q7.1 size=819537 2024-09-12T17:04:55.930 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.923+0000 7f026be9d8c0 1 < completed multipart upload key=4U1W97V0OX11 upload=4DCHH29548Q7 tag=FGV7B4HEEPLV type=write size=2916689 2024-09-12T17:04:55.932 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.927+0000 7f026be9d8c0 1 > prepared operation key=SL2446KSB531 tag=52DCNQATHQSA type=del size=891095 2024-09-12T17:04:55.935 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.931+0000 7f026be9d8c0 1 < completed delete operation key=2BQJ30RQQ25L tag=PC39ZQGOVCA1 type=del 2024-09-12T17:04:55.938 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.935+0000 7f026be9d8c0 1 > prepared operation key=SO3HLQZA8B6B tag=LRBW92IU3XCS type=del size=811314 2024-09-12T17:04:55.941 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.935+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~K2EN86F1HTDR.0 size=1048576 2024-09-12T17:04:55.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.939+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~K2EN86F1HTDR.1 size=1048576 2024-09-12T17:04:55.946 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.943+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~K2EN86F1HTDR.2 size=66600 2024-09-12T17:04:55.951 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.947+0000 7f026be9d8c0 1 < completed multipart upload key=QVQ4TI319DH5 upload=K2EN86F1HTDR tag=39H9RB37F5XN type=write size=3212328 2024-09-12T17:04:55.954 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.947+0000 7f026be9d8c0 1 > prepared operation key=Z183NH6R676V tag=I2T21UV25E35 type=del size=3327555 2024-09-12T17:04:55.957 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.951+0000 7f026be9d8c0 1 < completed delete operation key=3JADN360QEO3 tag=7X4IGN8I3ZVY type=del 2024-09-12T17:04:55.962 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.959+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~7N9FB4KT9UKM.0 size=777457 2024-09-12T17:04:55.963 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.959+0000 7f026be9d8c0 1 > prepared multipart upload key=UU88OS653L8D upload=7N9FB4KT9UKM tag=2Z00J1D0L9DJ type=write size=1826033 2024-09-12T17:04:55.966 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.963+0000 7f026be9d8c0 1 < completed part key=_multipart_Z9YNIEQCVNBA.2~NCQRX7EIMV8C.0 size=1048576 2024-09-12T17:04:55.969 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.963+0000 7f026be9d8c0 1 < completed part key=_multipart_Z9YNIEQCVNBA.2~NCQRX7EIMV8C.1 size=505002 2024-09-12T17:04:55.974 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.971+0000 7f026be9d8c0 1 < completed multipart upload key=Z9YNIEQCVNBA upload=NCQRX7EIMV8C tag=IY11T2KKEB1E type=write size=2602154 2024-09-12T17:04:55.977 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.971+0000 7f026be9d8c0 1 > prepared operation key=2BQJ30RQQ25L tag=D053VWQAHW3H type=del size=1889394 2024-09-12T17:04:55.983 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.979+0000 7f026be9d8c0 1 < suggested remove operation key=3JADN360QEO3 tag=HDEJ1WEN3OB3 type=del 2024-09-12T17:04:55.986 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.983+0000 7f026be9d8c0 1 > prepared operation key=JJMEQ2O00SA2 tag=ME22V5B001B5 type=del size=3733763 2024-09-12T17:04:55.989 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.983+0000 7f026be9d8c0 1 < completed delete operation key=U8W1SAVSLTBF tag=HBQ6E83ZTU6N type=del 2024-09-12T17:04:55.993 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.987+0000 7f026be9d8c0 1 > prepared operation key=Z183NH6R676V tag=A0BI8J30XHAK type=del size=2411854 2024-09-12T17:04:55.996 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.991+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~HZ16O0QEM1AY.0 size=1048576 2024-09-12T17:04:55.998 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.995+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~HZ16O0QEM1AY.1 size=91768 2024-09-12T17:04:56.003 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:55.999+0000 7f026be9d8c0 1 < completed multipart upload key=JJMEQ2O00SA2 upload=HZ16O0QEM1AY tag=7OPA3UGKM346 type=write size=2188920 2024-09-12T17:04:56.006 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.003+0000 7f026be9d8c0 1 > prepared operation key=E0Y3SKNUYCQS tag=XSWNCCQKV0KW type=write size=935007 2024-09-12T17:04:56.010 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.007+0000 7f026be9d8c0 1 < completed part key=_multipart_E0Y3SKNUYCQS.2~E3HOAOMJJ3OK.0 size=1048576 2024-09-12T17:04:56.013 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.007+0000 7f026be9d8c0 1 < completed part key=_multipart_E0Y3SKNUYCQS.2~E3HOAOMJJ3OK.1 size=1048576 2024-09-12T17:04:56.016 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.011+0000 7f026be9d8c0 1 < completed part key=_multipart_E0Y3SKNUYCQS.2~E3HOAOMJJ3OK.2 size=1016787 2024-09-12T17:04:56.022 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.019+0000 7f026be9d8c0 1 < completed multipart upload key=E0Y3SKNUYCQS upload=E3HOAOMJJ3OK tag=0BCT3U8XHKIP type=write size=4162515 2024-09-12T17:04:56.028 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.023+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~G23BH8501K9I.0 size=1034925 2024-09-12T17:04:56.028 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.023+0000 7f026be9d8c0 1 > prepared multipart upload key=J8MU1A0CWSAQ upload=G23BH8501K9I tag=VQDESTJ7T41I type=write size=2083501 2024-09-12T17:04:56.032 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.027+0000 7f026be9d8c0 1 < completed delete operation key=QVQ4TI319DH5 tag=77HEST8H26C1 type=del 2024-09-12T17:04:56.035 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.031+0000 7f026be9d8c0 1 > prepared operation key=Z9YNIEQCVNBA tag=KKT70C1YXF0G type=del size=2034058 2024-09-12T17:04:56.038 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.035+0000 7f026be9d8c0 1 < completed part key=_multipart_8AFDAVJLMRD2.2~Z4DZR85Q7S5T.0 size=1048576 2024-09-12T17:04:56.041 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.035+0000 7f026be9d8c0 1 < completed part key=_multipart_8AFDAVJLMRD2.2~Z4DZR85Q7S5T.1 size=838997 2024-09-12T17:04:56.046 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.043+0000 7f026be9d8c0 1 < completed multipart upload key=8AFDAVJLMRD2 upload=Z4DZR85Q7S5T tag=5AA693MIJO8I type=write size=2936149 2024-09-12T17:04:56.052 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.047+0000 7f026be9d8c0 1 > prepared part key=_multipart_E0Y3SKNUYCQS.2~1GT2YNFTL5VP.0 size=1048576 2024-09-12T17:04:56.055 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.051+0000 7f026be9d8c0 1 > prepared part key=_multipart_E0Y3SKNUYCQS.2~1GT2YNFTL5VP.1 size=1048576 2024-09-12T17:04:56.057 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.051+0000 7f026be9d8c0 1 > prepared part key=_multipart_E0Y3SKNUYCQS.2~1GT2YNFTL5VP.2 size=869504 2024-09-12T17:04:56.057 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.051+0000 7f026be9d8c0 1 > prepared multipart upload key=E0Y3SKNUYCQS upload=1GT2YNFTL5VP tag=OT2VCXRGX65H type=write size=4015232 2024-09-12T17:04:56.060 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.055+0000 7f026be9d8c0 1 < canceled operation key=XNBE2II106VZ tag=U5YRYKHEZREA type=del size=3750798 2024-09-12T17:04:56.064 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.059+0000 7f026be9d8c0 1 > prepared operation key=BW1T21LBUE2D tag=6W510YSETOHS type=write size=367335 2024-09-12T17:04:56.067 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.063+0000 7f026be9d8c0 -1 < failed to complete operation key=3JADN360QEO3 tag=CMXY8GKBINXK type=del size=1084033: (22) Invalid argument 2024-09-12T17:04:56.073 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.067+0000 7f026be9d8c0 1 > prepared part key=_multipart_SGT8IC1GJ3IG.2~JSA0KLCPALZK.0 size=372303 2024-09-12T17:04:56.073 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.067+0000 7f026be9d8c0 1 > prepared multipart upload key=SGT8IC1GJ3IG upload=JSA0KLCPALZK tag=I5ETL0SL555W type=write size=1420879 2024-09-12T17:04:56.077 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.071+0000 7f026be9d8c0 1 < completed delete operation key=4G3BKGNT3YZC tag=WJ4R0O49U7LF type=del 2024-09-12T17:04:56.085 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.079+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z183NH6R676V.2~9D0AY3DCFFN0.0 size=1048576 2024-09-12T17:04:56.088 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.083+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z183NH6R676V.2~9D0AY3DCFFN0.1 size=981180 2024-09-12T17:04:56.088 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.083+0000 7f026be9d8c0 1 > prepared multipart upload key=Z183NH6R676V upload=9D0AY3DCFFN0 tag=OTX330ZBYKU1 type=write size=3078332 2024-09-12T17:04:56.092 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.087+0000 7f026be9d8c0 1 < canceled operation key=L194KQIPFLE1 tag=HNZCDS1P1SB4 type=write size=661583 2024-09-12T17:04:56.100 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.095+0000 7f026be9d8c0 1 > prepared part key=_multipart_3JADN360QEO3.2~THSD4MLKQ064.0 size=1048576 2024-09-12T17:04:56.103 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.099+0000 7f026be9d8c0 1 > prepared part key=_multipart_3JADN360QEO3.2~THSD4MLKQ064.1 size=1048576 2024-09-12T17:04:56.106 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.103+0000 7f026be9d8c0 1 > prepared part key=_multipart_3JADN360QEO3.2~THSD4MLKQ064.2 size=55014 2024-09-12T17:04:56.106 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.103+0000 7f026be9d8c0 1 > prepared multipart upload key=3JADN360QEO3 upload=THSD4MLKQ064 tag=1IXFIKRXGC1J type=write size=3200742 2024-09-12T17:04:56.110 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.107+0000 7f026be9d8c0 1 < completed delete operation key=LHKLWIUAT08F tag=7MOT331S40PK type=del 2024-09-12T17:04:56.113 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.107+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=PDCSLF4FY9PD type=del size=2434961 2024-09-12T17:04:56.118 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.111+0000 7f026be9d8c0 1 < canceled operation key=SL2446KSB531 tag=52DCNQATHQSA type=del size=891095 2024-09-12T17:04:56.121 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.115+0000 7f026be9d8c0 1 > prepared operation key=XLKR6P8RNRVO tag=K7ELOH3IENZT type=write size=590981 2024-09-12T17:04:56.126 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.119+0000 7f026be9d8c0 1 < completed delete operation key=SO3HLQZA8B6B tag=LRBW92IU3XCS type=del 2024-09-12T17:04:56.130 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.123+0000 7f026be9d8c0 1 > prepared operation key=Z9YNIEQCVNBA tag=CN4P1EPNUX5O type=del size=3561932 2024-09-12T17:04:56.137 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.131+0000 7f026be9d8c0 1 < suggested update operation key=Z183NH6R676V tag=I2T21UV25E35 type=del size=3327555 2024-09-12T17:04:56.141 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.135+0000 7f026be9d8c0 1 > prepared operation key=T6QRDTQRHBPI tag=4722OHGHKV0K type=del size=2498421 2024-09-12T17:04:56.145 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.139+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~7N9FB4KT9UKM.0 size=777457 2024-09-12T17:04:56.151 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.147+0000 7f026be9d8c0 1 < completed multipart upload key=UU88OS653L8D upload=7N9FB4KT9UKM tag=2Z00J1D0L9DJ type=write size=1826033 2024-09-12T17:04:56.156 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.151+0000 7f026be9d8c0 1 > prepared operation key=2BQJ30RQQ25L tag=K4Q24OT1U1V0 type=write size=736261 2024-09-12T17:04:56.160 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.155+0000 7f026be9d8c0 1 < completed delete operation key=2BQJ30RQQ25L tag=D053VWQAHW3H type=del 2024-09-12T17:04:56.163 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.159+0000 7f026be9d8c0 1 > prepared operation key=32XUMOWT8HO2 tag=MGDAUXZ6L9GH type=del size=3331834 2024-09-12T17:04:56.169 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.163+0000 7f026be9d8c0 1 < completed delete operation key=JJMEQ2O00SA2 tag=ME22V5B001B5 type=del 2024-09-12T17:04:56.173 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.167+0000 7f026be9d8c0 1 > prepared operation key=SGT8IC1GJ3IG tag=INGN191HYDIU type=del size=506384 2024-09-12T17:04:56.182 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.175+0000 7f026be9d8c0 1 < suggested update operation key=Z183NH6R676V tag=A0BI8J30XHAK type=del size=2411854 2024-09-12T17:04:56.189 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.183+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~OHDNGTSQPL33.0 size=1048576 2024-09-12T17:04:56.192 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.187+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~OHDNGTSQPL33.1 size=1048576 2024-09-12T17:04:56.195 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.191+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~OHDNGTSQPL33.2 size=807059 2024-09-12T17:04:56.195 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.191+0000 7f026be9d8c0 1 > prepared multipart upload key=2BQJ30RQQ25L upload=OHDNGTSQPL33 tag=1F1Y3ELUZDBG type=write size=3952787 2024-09-12T17:04:56.204 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.199+0000 7f026be9d8c0 1 < suggested remove operation key=E0Y3SKNUYCQS tag=XSWNCCQKV0KW type=write 2024-09-12T17:04:56.206 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.203+0000 7f026be9d8c0 1 > prepared operation key=J8MU1A0CWSAQ tag=E8BFDAVAQ3HV type=del size=53190 2024-09-12T17:04:56.209 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.203+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~G23BH8501K9I.0 size=1034925 2024-09-12T17:04:56.215 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.211+0000 7f026be9d8c0 1 < completed multipart upload key=J8MU1A0CWSAQ upload=G23BH8501K9I tag=VQDESTJ7T41I type=write size=2083501 2024-09-12T17:04:56.221 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.215+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z183NH6R676V.2~IKNM0KIJ32WG.0 size=1048576 2024-09-12T17:04:56.224 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.219+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z183NH6R676V.2~IKNM0KIJ32WG.1 size=12697 2024-09-12T17:04:56.224 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.219+0000 7f026be9d8c0 1 > prepared multipart upload key=Z183NH6R676V upload=IKNM0KIJ32WG tag=MQNOUYILB5UY type=write size=2109849 2024-09-12T17:04:56.228 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.223+0000 7f026be9d8c0 1 < completed delete operation key=Z9YNIEQCVNBA tag=KKT70C1YXF0G type=del 2024-09-12T17:04:56.234 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.231+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~GIMRCDP6OJ31.0 size=1048576 2024-09-12T17:04:56.237 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.231+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~GIMRCDP6OJ31.1 size=1048576 2024-09-12T17:04:56.240 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.235+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~GIMRCDP6OJ31.2 size=149864 2024-09-12T17:04:56.240 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.235+0000 7f026be9d8c0 1 > prepared multipart upload key=QVQ4TI319DH5 upload=GIMRCDP6OJ31 tag=FODQFMLCVUV7 type=write size=3295592 2024-09-12T17:04:56.243 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.239+0000 7f026be9d8c0 1 < completed part key=_multipart_E0Y3SKNUYCQS.2~1GT2YNFTL5VP.0 size=1048576 2024-09-12T17:04:56.246 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.243+0000 7f026be9d8c0 1 < completed part key=_multipart_E0Y3SKNUYCQS.2~1GT2YNFTL5VP.1 size=1048576 2024-09-12T17:04:56.248 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.243+0000 7f026be9d8c0 1 < completed part key=_multipart_E0Y3SKNUYCQS.2~1GT2YNFTL5VP.2 size=869504 2024-09-12T17:04:56.254 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.251+0000 7f026be9d8c0 1 < completed multipart upload key=E0Y3SKNUYCQS upload=1GT2YNFTL5VP tag=OT2VCXRGX65H type=write size=4015232 2024-09-12T17:04:56.258 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.251+0000 7f026be9d8c0 1 > prepared operation key=4U1W97V0OX11 tag=YWTRA554394S type=del size=3517920 2024-09-12T17:04:56.265 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.259+0000 7f026be9d8c0 1 < suggested update operation key=BW1T21LBUE2D tag=6W510YSETOHS type=write size=367335 2024-09-12T17:04:56.271 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.267+0000 7f026be9d8c0 1 > prepared part key=_multipart_MVYWUWKSYQ9Z.2~M4VIL5CU8BMD.0 size=1048576 2024-09-12T17:04:56.274 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.271+0000 7f026be9d8c0 1 > prepared part key=_multipart_MVYWUWKSYQ9Z.2~M4VIL5CU8BMD.1 size=713900 2024-09-12T17:04:56.274 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.271+0000 7f026be9d8c0 1 > prepared multipart upload key=MVYWUWKSYQ9Z upload=M4VIL5CU8BMD tag=BA1LOSSG7XD3 type=write size=2811052 2024-09-12T17:04:56.277 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.271+0000 7f026be9d8c0 1 < completed part key=_multipart_SGT8IC1GJ3IG.2~JSA0KLCPALZK.0 size=372303 2024-09-12T17:04:56.283 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.279+0000 7f026be9d8c0 1 < completed multipart upload key=SGT8IC1GJ3IG upload=JSA0KLCPALZK tag=I5ETL0SL555W type=write size=1420879 2024-09-12T17:04:56.286 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.283+0000 7f026be9d8c0 1 > prepared operation key=Z183NH6R676V tag=A6RHOIW5ADHW type=del size=58677 2024-09-12T17:04:56.289 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.283+0000 7f026be9d8c0 1 < completed part key=_multipart_Z183NH6R676V.2~9D0AY3DCFFN0.0 size=1048576 2024-09-12T17:04:56.292 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.287+0000 7f026be9d8c0 1 < completed part key=_multipart_Z183NH6R676V.2~9D0AY3DCFFN0.1 size=981180 2024-09-12T17:04:56.298 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.295+0000 7f026be9d8c0 1 < completed multipart upload key=Z183NH6R676V upload=9D0AY3DCFFN0 tag=OTX330ZBYKU1 type=write size=3078332 2024-09-12T17:04:56.304 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.299+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~4NFZKL9HX453.0 size=851209 2024-09-12T17:04:56.304 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.299+0000 7f026be9d8c0 1 > prepared multipart upload key=2BQJ30RQQ25L upload=4NFZKL9HX453 tag=M9KPTUWVY5OM type=write size=1899785 2024-09-12T17:04:56.307 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.303+0000 7f026be9d8c0 1 < completed part key=_multipart_3JADN360QEO3.2~THSD4MLKQ064.0 size=1048576 2024-09-12T17:04:56.310 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.303+0000 7f026be9d8c0 1 < completed part key=_multipart_3JADN360QEO3.2~THSD4MLKQ064.1 size=1048576 2024-09-12T17:04:56.312 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.307+0000 7f026be9d8c0 1 < completed part key=_multipart_3JADN360QEO3.2~THSD4MLKQ064.2 size=55014 2024-09-12T17:04:56.318 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.315+0000 7f026be9d8c0 1 < completed multipart upload key=3JADN360QEO3 upload=THSD4MLKQ064 tag=1IXFIKRXGC1J type=write size=3200742 2024-09-12T17:04:56.321 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.315+0000 7f026be9d8c0 1 > prepared operation key=4U1W97V0OX11 tag=LTMQS1SHYQLI type=write size=337050 2024-09-12T17:04:56.324 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.319+0000 7f026be9d8c0 1 < completed delete operation key=RBNN03IPZ8BT tag=PDCSLF4FY9PD type=del 2024-09-12T17:04:56.327 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.323+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=6IOB5XEJZNUY type=del size=1086777 2024-09-12T17:04:56.330 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.327+0000 7f026be9d8c0 1 < completed write operation key=XLKR6P8RNRVO tag=K7ELOH3IENZT type=write size=590981 2024-09-12T17:04:56.334 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.331+0000 7f026be9d8c0 1 > prepared operation key=6VO85REZG2NW tag=J1301YVWP0E3 type=del size=2909625 2024-09-12T17:04:56.337 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.331+0000 7f026be9d8c0 1 < completed delete operation key=Z9YNIEQCVNBA tag=CN4P1EPNUX5O type=del 2024-09-12T17:04:56.340 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.335+0000 7f026be9d8c0 1 > prepared operation key=L194KQIPFLE1 tag=U4HI887RMFGF type=del size=3617934 2024-09-12T17:04:56.346 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.343+0000 7f026be9d8c0 1 < suggested update operation key=T6QRDTQRHBPI tag=4722OHGHKV0K type=del size=2498421 2024-09-12T17:04:56.352 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.347+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~V1HK1RFEZ8EP.0 size=1048576 2024-09-12T17:04:56.355 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.351+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~V1HK1RFEZ8EP.1 size=1048576 2024-09-12T17:04:56.357 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.351+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~V1HK1RFEZ8EP.2 size=641658 2024-09-12T17:04:56.357 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.351+0000 7f026be9d8c0 1 > prepared multipart upload key=QVQ4TI319DH5 upload=V1HK1RFEZ8EP tag=7IQHW2ACVTAP type=write size=3787386 2024-09-12T17:04:56.361 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.355+0000 7f026be9d8c0 1 < completed write operation key=2BQJ30RQQ25L tag=K4Q24OT1U1V0 type=write size=736261 2024-09-12T17:04:56.368 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.363+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~3MGCU8MB0PHU.0 size=359016 2024-09-12T17:04:56.368 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.363+0000 7f026be9d8c0 1 > prepared multipart upload key=2BQJ30RQQ25L upload=3MGCU8MB0PHU tag=VGQIHC53P1NJ type=write size=1407592 2024-09-12T17:04:56.372 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.367+0000 7f026be9d8c0 1 < completed delete operation key=32XUMOWT8HO2 tag=MGDAUXZ6L9GH type=del 2024-09-12T17:04:56.375 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.371+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=6UB82EH6QJB0 type=del size=124745 2024-09-12T17:04:56.378 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.375+0000 7f026be9d8c0 1 < completed delete operation key=SGT8IC1GJ3IG tag=INGN191HYDIU type=del 2024-09-12T17:04:56.382 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.375+0000 7f026be9d8c0 1 > prepared operation key=SL2446KSB531 tag=99HLYGEBJ0YU type=write size=929940 2024-09-12T17:04:56.382 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.379+0000 7f026be9d8c0 1 < canceled part key=_multipart_2BQJ30RQQ25L.2~OHDNGTSQPL33.0 size=1048576 2024-09-12T17:04:56.385 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.379+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~OHDNGTSQPL33.1 size=1048576 2024-09-12T17:04:56.388 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.383+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~OHDNGTSQPL33.2 size=807059 2024-09-12T17:04:56.393 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.387+0000 7f026be9d8c0 1 < canceled multipart upload key=2BQJ30RQQ25L upload=OHDNGTSQPL33 tag=1F1Y3ELUZDBG type=write size=3952787 2024-09-12T17:04:56.396 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.391+0000 7f026be9d8c0 1 > prepared operation key=PQSQ39X3O64P tag=6UAIA9M593LT type=del size=1866621 2024-09-12T17:04:56.403 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.399+0000 7f026be9d8c0 1 < suggested update operation key=J8MU1A0CWSAQ tag=E8BFDAVAQ3HV type=del size=53190 2024-09-12T17:04:56.409 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.403+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~LP49PCCUZMBW.0 size=1048576 2024-09-12T17:04:56.412 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.407+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~LP49PCCUZMBW.1 size=633386 2024-09-12T17:04:56.412 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.407+0000 7f026be9d8c0 1 > prepared multipart upload key=XLKR6P8RNRVO upload=LP49PCCUZMBW tag=UVCYYWL0B6SV type=write size=2730538 2024-09-12T17:04:56.415 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.411+0000 7f026be9d8c0 1 < completed part key=_multipart_Z183NH6R676V.2~IKNM0KIJ32WG.0 size=1048576 2024-09-12T17:04:56.418 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.415+0000 7f026be9d8c0 1 < completed part key=_multipart_Z183NH6R676V.2~IKNM0KIJ32WG.1 size=12697 2024-09-12T17:04:56.423 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.419+0000 7f026be9d8c0 1 < completed multipart upload key=Z183NH6R676V upload=IKNM0KIJ32WG tag=MQNOUYILB5UY type=write size=2109849 2024-09-12T17:04:56.429 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.423+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~9I38JJT6EPPH.0 size=1048576 2024-09-12T17:04:56.432 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.427+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~9I38JJT6EPPH.1 size=1048576 2024-09-12T17:04:56.435 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.431+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~9I38JJT6EPPH.2 size=672146 2024-09-12T17:04:56.435 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.431+0000 7f026be9d8c0 1 > prepared multipart upload key=Y27CDEOCM7DH upload=9I38JJT6EPPH tag=X52R8BNJDC75 type=write size=3817874 2024-09-12T17:04:56.438 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.435+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~GIMRCDP6OJ31.0 size=1048576 2024-09-12T17:04:56.441 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.435+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~GIMRCDP6OJ31.1 size=1048576 2024-09-12T17:04:56.443 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.439+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~GIMRCDP6OJ31.2 size=149864 2024-09-12T17:04:56.449 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.443+0000 7f026be9d8c0 1 < completed multipart upload key=QVQ4TI319DH5 upload=GIMRCDP6OJ31 tag=FODQFMLCVUV7 type=write size=3295592 2024-09-12T17:04:56.453 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.447+0000 7f026be9d8c0 1 > prepared operation key=ALFGNC1YNROX tag=N0Q6FGPIMMGN type=del size=3413852 2024-09-12T17:04:56.456 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.451+0000 7f026be9d8c0 1 < completed delete operation key=4U1W97V0OX11 tag=YWTRA554394S type=del 2024-09-12T17:04:56.459 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.455+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=05D0YX4I0TP4 type=del size=3777419 2024-09-12T17:04:56.463 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.459+0000 7f026be9d8c0 1 < completed part key=_multipart_MVYWUWKSYQ9Z.2~M4VIL5CU8BMD.0 size=1048576 2024-09-12T17:04:56.465 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.459+0000 7f026be9d8c0 1 < completed part key=_multipart_MVYWUWKSYQ9Z.2~M4VIL5CU8BMD.1 size=713900 2024-09-12T17:04:56.471 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.467+0000 7f026be9d8c0 1 < completed multipart upload key=MVYWUWKSYQ9Z upload=M4VIL5CU8BMD tag=BA1LOSSG7XD3 type=write size=2811052 2024-09-12T17:04:56.475 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.471+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=0AN2RHQGG2UM type=write size=976553 2024-09-12T17:04:56.478 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.475+0000 7f026be9d8c0 1 < completed delete operation key=Z183NH6R676V tag=A6RHOIW5ADHW type=del 2024-09-12T17:04:56.483 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.479+0000 7f026be9d8c0 1 > prepared operation key=8AFDAVJLMRD2 tag=NEZWHO87GIVA type=del size=500707 2024-09-12T17:04:56.486 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.483+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~4NFZKL9HX453.0 size=851209 2024-09-12T17:04:56.491 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.487+0000 7f026be9d8c0 1 < completed multipart upload key=2BQJ30RQQ25L upload=4NFZKL9HX453 tag=M9KPTUWVY5OM type=write size=1899785 2024-09-12T17:04:56.497 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.491+0000 7f026be9d8c0 1 > prepared part key=_multipart_SGT8IC1GJ3IG.2~H76ML21FLJDA.0 size=463696 2024-09-12T17:04:56.497 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.491+0000 7f026be9d8c0 1 > prepared multipart upload key=SGT8IC1GJ3IG upload=H76ML21FLJDA tag=4P2UA57Q9LKS type=write size=1512272 2024-09-12T17:04:56.500 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.495+0000 7f026be9d8c0 1 < completed write operation key=4U1W97V0OX11 tag=LTMQS1SHYQLI type=write size=337050 2024-09-12T17:04:56.503 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.499+0000 7f026be9d8c0 1 > prepared operation key=BW1T21LBUE2D tag=XVAVBCRLBNZN type=del size=1820309 2024-09-12T17:04:56.506 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.503+0000 7f026be9d8c0 1 < completed delete operation key=3JADN360QEO3 tag=6IOB5XEJZNUY type=del 2024-09-12T17:04:56.510 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.503+0000 7f026be9d8c0 1 > prepared operation key=T6QRDTQRHBPI tag=W17I8O9BLQ7O type=del size=3466459 2024-09-12T17:04:56.513 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.507+0000 7f026be9d8c0 1 < completed delete operation key=6VO85REZG2NW tag=J1301YVWP0E3 type=del 2024-09-12T17:04:56.517 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.511+0000 7f026be9d8c0 1 > prepared operation key=JJMEQ2O00SA2 tag=FCTS634RPI7C type=write size=1010609 2024-09-12T17:04:56.521 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.515+0000 7f026be9d8c0 1 < completed delete operation key=L194KQIPFLE1 tag=U4HI887RMFGF type=del 2024-09-12T17:04:56.525 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.519+0000 7f026be9d8c0 1 > prepared operation key=JJMEQ2O00SA2 tag=SH738DAU93JV type=del size=3271686 2024-09-12T17:04:56.529 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.523+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~V1HK1RFEZ8EP.0 size=1048576 2024-09-12T17:04:56.529 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.523+0000 7f026be9d8c0 1 < canceled part key=_multipart_QVQ4TI319DH5.2~V1HK1RFEZ8EP.1 size=1048576 2024-09-12T17:04:56.529 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.523+0000 7f026be9d8c0 1 < canceled part key=_multipart_QVQ4TI319DH5.2~V1HK1RFEZ8EP.2 size=641658 2024-09-12T17:04:56.535 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.531+0000 7f026be9d8c0 1 < canceled multipart upload key=QVQ4TI319DH5 upload=V1HK1RFEZ8EP tag=7IQHW2ACVTAP type=write size=3787386 2024-09-12T17:04:56.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.535+0000 7f026be9d8c0 1 > prepared operation key=ALFGNC1YNROX tag=P10B2PCQWSUO type=del size=1381842 2024-09-12T17:04:56.542 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.535+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~3MGCU8MB0PHU.0 size=359016 2024-09-12T17:04:56.547 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.543+0000 7f026be9d8c0 1 < completed multipart upload key=2BQJ30RQQ25L upload=3MGCU8MB0PHU tag=VGQIHC53P1NJ type=write size=1407592 2024-09-12T17:04:56.551 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.547+0000 7f026be9d8c0 1 > prepared operation key=Z183NH6R676V tag=M3NXRLMECZ4R type=del size=2054158 2024-09-12T17:04:56.559 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.555+0000 7f026be9d8c0 1 < suggested update operation key=3JADN360QEO3 tag=6UB82EH6QJB0 type=del size=124745 2024-09-12T17:04:56.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.559+0000 7f026be9d8c0 1 > prepared operation key=BBYDPSXZKHZP tag=RW0IUE27FTSL type=write size=189978 2024-09-12T17:04:56.566 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.563+0000 7f026be9d8c0 1 < completed write operation key=SL2446KSB531 tag=99HLYGEBJ0YU type=write size=929940 2024-09-12T17:04:56.569 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.563+0000 7f026be9d8c0 1 > prepared operation key=UU88OS653L8D tag=GNGXD48J1HRP type=del size=969480 2024-09-12T17:04:56.576 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.571+0000 7f026be9d8c0 1 < suggested remove operation key=PQSQ39X3O64P tag=6UAIA9M593LT type=del 2024-09-12T17:04:56.582 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.579+0000 7f026be9d8c0 1 > prepared part key=_multipart_E0Y3SKNUYCQS.2~62EJLRB4CC3C.0 size=343947 2024-09-12T17:04:56.582 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.579+0000 7f026be9d8c0 1 > prepared multipart upload key=E0Y3SKNUYCQS upload=62EJLRB4CC3C tag=POTU9MGI2L75 type=write size=1392523 2024-09-12T17:04:56.583 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.579+0000 7f026be9d8c0 1 < canceled part key=_multipart_XLKR6P8RNRVO.2~LP49PCCUZMBW.0 size=1048576 2024-09-12T17:04:56.586 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.583+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~LP49PCCUZMBW.1 size=633386 2024-09-12T17:04:56.592 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.587+0000 7f026be9d8c0 1 < canceled multipart upload key=XLKR6P8RNRVO upload=LP49PCCUZMBW tag=UVCYYWL0B6SV type=write size=2730538 2024-09-12T17:04:56.598 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.595+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~VT4864KKB485.0 size=1048576 2024-09-12T17:04:56.602 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.595+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~VT4864KKB485.1 size=739419 2024-09-12T17:04:56.602 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.595+0000 7f026be9d8c0 1 > prepared multipart upload key=BW1T21LBUE2D upload=VT4864KKB485 tag=QJI5N86V156D type=write size=2836571 2024-09-12T17:04:56.605 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.599+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~9I38JJT6EPPH.0 size=1048576 2024-09-12T17:04:56.608 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.603+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~9I38JJT6EPPH.1 size=1048576 2024-09-12T17:04:56.610 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.607+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~9I38JJT6EPPH.2 size=672146 2024-09-12T17:04:56.616 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.611+0000 7f026be9d8c0 1 < completed multipart upload key=Y27CDEOCM7DH upload=9I38JJT6EPPH tag=X52R8BNJDC75 type=write size=3817874 2024-09-12T17:04:56.619 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.615+0000 7f026be9d8c0 1 > prepared operation key=Y27CDEOCM7DH tag=5VV1LK0GKJBG type=del size=33549 2024-09-12T17:04:56.626 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.623+0000 7f026be9d8c0 1 < suggested update operation key=ALFGNC1YNROX tag=N0Q6FGPIMMGN type=del size=3413852 2024-09-12T17:04:56.629 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.623+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=SLB7730Y2G29 type=write size=827160 2024-09-12T17:04:56.633 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.627+0000 7f026be9d8c0 1 < canceled operation key=21ZD52VBZIO4 tag=05D0YX4I0TP4 type=del size=3777419 2024-09-12T17:04:56.637 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.631+0000 7f026be9d8c0 1 > prepared operation key=SO3HLQZA8B6B tag=Y51AIXN3GZP4 type=del size=2289422 2024-09-12T17:04:56.640 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.635+0000 7f026be9d8c0 -1 < failed to complete operation key=3JADN360QEO3 tag=0AN2RHQGG2UM type=write size=976553: (22) Invalid argument 2024-09-12T17:04:56.644 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.639+0000 7f026be9d8c0 1 > prepared operation key=8AFDAVJLMRD2 tag=0VX87J58P6CV type=del size=70403 2024-09-12T17:04:56.648 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.643+0000 7f026be9d8c0 1 < completed delete operation key=8AFDAVJLMRD2 tag=NEZWHO87GIVA type=del 2024-09-12T17:04:56.654 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.651+0000 7f026be9d8c0 1 > prepared part key=_multipart_RBNN03IPZ8BT.2~RYIFME4DYFVJ.0 size=795744 2024-09-12T17:04:56.654 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.651+0000 7f026be9d8c0 1 > prepared multipart upload key=RBNN03IPZ8BT upload=RYIFME4DYFVJ tag=I508BCCT0ITK type=write size=1844320 2024-09-12T17:04:56.658 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.655+0000 7f026be9d8c0 1 < completed part key=_multipart_SGT8IC1GJ3IG.2~H76ML21FLJDA.0 size=463696 2024-09-12T17:04:56.663 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.659+0000 7f026be9d8c0 1 < completed multipart upload key=SGT8IC1GJ3IG upload=H76ML21FLJDA tag=4P2UA57Q9LKS type=write size=1512272 2024-09-12T17:04:56.667 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.663+0000 7f026be9d8c0 1 > prepared operation key=Z9YNIEQCVNBA tag=GRJ2L8553NX9 type=write size=669759 2024-09-12T17:04:56.671 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.667+0000 7f026be9d8c0 1 < completed delete operation key=BW1T21LBUE2D tag=XVAVBCRLBNZN type=del 2024-09-12T17:04:56.674 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.671+0000 7f026be9d8c0 1 > prepared operation key=BBYDPSXZKHZP tag=CR8U4GPL77HE type=del size=3850431 2024-09-12T17:04:56.678 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.675+0000 7f026be9d8c0 1 < completed delete operation key=T6QRDTQRHBPI tag=W17I8O9BLQ7O type=del 2024-09-12T17:04:56.682 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.675+0000 7f026be9d8c0 1 > prepared operation key=Y27CDEOCM7DH tag=BBEUNGMCUEWV type=del size=1486854 2024-09-12T17:04:56.685 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.679+0000 7f026be9d8c0 1 < completed write operation key=JJMEQ2O00SA2 tag=FCTS634RPI7C type=write size=1010609 2024-09-12T17:04:56.692 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.687+0000 7f026be9d8c0 1 > prepared part key=_multipart_SO3HLQZA8B6B.2~J4V02U4Q7D7W.0 size=1048576 2024-09-12T17:04:56.695 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.691+0000 7f026be9d8c0 1 > prepared part key=_multipart_SO3HLQZA8B6B.2~J4V02U4Q7D7W.1 size=1048576 2024-09-12T17:04:56.697 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.691+0000 7f026be9d8c0 1 > prepared part key=_multipart_SO3HLQZA8B6B.2~J4V02U4Q7D7W.2 size=137112 2024-09-12T17:04:56.697 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.691+0000 7f026be9d8c0 1 > prepared multipart upload key=SO3HLQZA8B6B upload=J4V02U4Q7D7W tag=P02BV9YCPLOL type=write size=3282840 2024-09-12T17:04:56.702 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.699+0000 7f026be9d8c0 1 < completed delete operation key=JJMEQ2O00SA2 tag=SH738DAU93JV type=del 2024-09-12T17:04:56.706 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.703+0000 7f026be9d8c0 1 > prepared operation key=BW1T21LBUE2D tag=MBQKIEYW5JWX type=write size=1002118 2024-09-12T17:04:56.710 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.703+0000 7f026be9d8c0 -1 < failed to complete operation key=ALFGNC1YNROX tag=P10B2PCQWSUO type=del size=1381842: (22) Invalid argument 2024-09-12T17:04:56.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.711+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~A5IKKMZWGB6O.0 size=1048576 2024-09-12T17:04:56.720 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.715+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~A5IKKMZWGB6O.1 size=1048576 2024-09-12T17:04:56.724 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.719+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~A5IKKMZWGB6O.2 size=577851 2024-09-12T17:04:56.724 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.719+0000 7f026be9d8c0 1 > prepared multipart upload key=4G3BKGNT3YZC upload=A5IKKMZWGB6O tag=SSOR2PNXOGS5 type=write size=3723579 2024-09-12T17:04:56.728 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.723+0000 7f026be9d8c0 1 < completed delete operation key=Z183NH6R676V tag=M3NXRLMECZ4R type=del 2024-09-12T17:04:56.731 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.727+0000 7f026be9d8c0 1 > prepared operation key=XNBE2II106VZ tag=90PFWPJJISEU type=del size=480664 2024-09-12T17:04:56.736 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.731+0000 7f026be9d8c0 1 < completed write operation key=BBYDPSXZKHZP tag=RW0IUE27FTSL type=write size=189978 2024-09-12T17:04:56.739 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.735+0000 7f026be9d8c0 1 > prepared operation key=4G3BKGNT3YZC tag=36686REWL31A type=del size=2123421 2024-09-12T17:04:56.746 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.743+0000 7f026be9d8c0 1 < suggested update operation key=UU88OS653L8D tag=GNGXD48J1HRP type=del size=969480 2024-09-12T17:04:56.752 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.747+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~7BB9QN9AW6W8.0 size=21700 2024-09-12T17:04:56.752 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.747+0000 7f026be9d8c0 1 > prepared multipart upload key=Y27CDEOCM7DH upload=7BB9QN9AW6W8 tag=189J2F7LPT8H type=write size=1070276 2024-09-12T17:04:56.755 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.751+0000 7f026be9d8c0 1 < completed part key=_multipart_E0Y3SKNUYCQS.2~62EJLRB4CC3C.0 size=343947 2024-09-12T17:04:56.762 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.759+0000 7f026be9d8c0 1 < completed multipart upload key=E0Y3SKNUYCQS upload=62EJLRB4CC3C tag=POTU9MGI2L75 type=write size=1392523 2024-09-12T17:04:56.766 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.759+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=KSD5YS328BYG type=write size=377532 2024-09-12T17:04:56.770 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.767+0000 7f026be9d8c0 1 < completed part key=_multipart_BW1T21LBUE2D.2~VT4864KKB485.0 size=1048576 2024-09-12T17:04:56.770 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.767+0000 7f026be9d8c0 1 < canceled part key=_multipart_BW1T21LBUE2D.2~VT4864KKB485.1 size=739419 2024-09-12T17:04:56.776 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.771+0000 7f026be9d8c0 1 < canceled multipart upload key=BW1T21LBUE2D upload=VT4864KKB485 tag=QJI5N86V156D type=write size=2836571 2024-09-12T17:04:56.783 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.779+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~T5WV2M087MBU.0 size=1048576 2024-09-12T17:04:56.785 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.779+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~T5WV2M087MBU.1 size=1048576 2024-09-12T17:04:56.788 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.783+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~T5WV2M087MBU.2 size=457643 2024-09-12T17:04:56.788 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.783+0000 7f026be9d8c0 1 > prepared multipart upload key=8AFDAVJLMRD2 upload=T5WV2M087MBU tag=XPB2TKDK7ZUO type=write size=3603371 2024-09-12T17:04:56.791 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.787+0000 7f026be9d8c0 1 < completed delete operation key=Y27CDEOCM7DH tag=5VV1LK0GKJBG type=del 2024-09-12T17:04:56.795 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.791+0000 7f026be9d8c0 1 > prepared operation key=LHKLWIUAT08F tag=9W8VBA0YQFUK type=del size=2483275 2024-09-12T17:04:56.801 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.795+0000 7f026be9d8c0 1 < suggested remove operation key=U8W1SAVSLTBF tag=SLB7730Y2G29 type=write 2024-09-12T17:04:56.805 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.799+0000 7f026be9d8c0 1 > prepared operation key=L194KQIPFLE1 tag=LPIU9M11NKS9 type=del size=407741 2024-09-12T17:04:56.810 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.807+0000 7f026be9d8c0 1 < completed delete operation key=SO3HLQZA8B6B tag=Y51AIXN3GZP4 type=del 2024-09-12T17:04:56.817 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.811+0000 7f026be9d8c0 1 > prepared part key=_multipart_3JADN360QEO3.2~LOTDPR0HJGGB.0 size=1048576 2024-09-12T17:04:56.823 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.819+0000 7f026be9d8c0 1 > prepared part key=_multipart_3JADN360QEO3.2~LOTDPR0HJGGB.1 size=1048576 2024-09-12T17:04:56.826 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.823+0000 7f026be9d8c0 1 > prepared part key=_multipart_3JADN360QEO3.2~LOTDPR0HJGGB.2 size=444444 2024-09-12T17:04:56.826 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.823+0000 7f026be9d8c0 1 > prepared multipart upload key=3JADN360QEO3 upload=LOTDPR0HJGGB tag=LRWXE834SVNP type=write size=3590172 2024-09-12T17:04:56.830 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.827+0000 7f026be9d8c0 1 < canceled operation key=8AFDAVJLMRD2 tag=0VX87J58P6CV type=del size=70403 2024-09-12T17:04:56.837 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.831+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~7HE288T6JD3O.0 size=345675 2024-09-12T17:04:56.837 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.831+0000 7f026be9d8c0 1 > prepared multipart upload key=J8MU1A0CWSAQ upload=7HE288T6JD3O tag=VVN5M5JY0LPR type=write size=1394251 2024-09-12T17:04:56.841 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.835+0000 7f026be9d8c0 1 < completed part key=_multipart_RBNN03IPZ8BT.2~RYIFME4DYFVJ.0 size=795744 2024-09-12T17:04:56.847 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.843+0000 7f026be9d8c0 1 < completed multipart upload key=RBNN03IPZ8BT upload=RYIFME4DYFVJ tag=I508BCCT0ITK type=write size=1844320 2024-09-12T17:04:56.853 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.847+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~ECUCZ808IHV9.0 size=391758 2024-09-12T17:04:56.853 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.847+0000 7f026be9d8c0 1 > prepared multipart upload key=GPUFWJ3AWEMX upload=ECUCZ808IHV9 tag=WAKIA5ZKD1WZ type=write size=1440334 2024-09-12T17:04:56.860 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.855+0000 7f026be9d8c0 1 < suggested remove operation key=Z9YNIEQCVNBA tag=GRJ2L8553NX9 type=write 2024-09-12T17:04:56.863 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.859+0000 7f026be9d8c0 1 > prepared operation key=Z183NH6R676V tag=D2YRVUKN4KAW type=del size=1599872 2024-09-12T17:04:56.868 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.863+0000 7f026be9d8c0 1 < completed delete operation key=BBYDPSXZKHZP tag=CR8U4GPL77HE type=del 2024-09-12T17:04:56.872 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.867+0000 7f026be9d8c0 1 > prepared operation key=MVYWUWKSYQ9Z tag=9UZFVOVWXR58 type=del size=1569532 2024-09-12T17:04:56.875 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.871+0000 7f026be9d8c0 1 < completed delete operation key=Y27CDEOCM7DH tag=BBEUNGMCUEWV type=del 2024-09-12T17:04:56.879 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.875+0000 7f026be9d8c0 1 > prepared operation key=J8MU1A0CWSAQ tag=I1ZGVP1EQSLZ type=write size=980605 2024-09-12T17:04:56.882 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.879+0000 7f026be9d8c0 1 < completed part key=_multipart_SO3HLQZA8B6B.2~J4V02U4Q7D7W.0 size=1048576 2024-09-12T17:04:56.885 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.879+0000 7f026be9d8c0 1 < completed part key=_multipart_SO3HLQZA8B6B.2~J4V02U4Q7D7W.1 size=1048576 2024-09-12T17:04:56.889 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.883+0000 7f026be9d8c0 1 < completed part key=_multipart_SO3HLQZA8B6B.2~J4V02U4Q7D7W.2 size=137112 2024-09-12T17:04:56.895 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.891+0000 7f026be9d8c0 1 < completed multipart upload key=SO3HLQZA8B6B upload=J4V02U4Q7D7W tag=P02BV9YCPLOL type=write size=3282840 2024-09-12T17:04:56.901 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.895+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~2DBN3ZLGXVGX.0 size=1048576 2024-09-12T17:04:56.904 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.899+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~2DBN3ZLGXVGX.1 size=1048576 2024-09-12T17:04:56.907 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.903+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~2DBN3ZLGXVGX.2 size=594752 2024-09-12T17:04:56.907 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.903+0000 7f026be9d8c0 1 > prepared multipart upload key=Z9YNIEQCVNBA upload=2DBN3ZLGXVGX tag=IRX6EBQT8Y4K type=write size=3740480 2024-09-12T17:04:56.915 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.911+0000 7f026be9d8c0 1 < suggested remove operation key=BW1T21LBUE2D tag=MBQKIEYW5JWX type=write 2024-09-12T17:04:56.918 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.915+0000 7f026be9d8c0 1 > prepared operation key=GPUFWJ3AWEMX tag=3PJRKLYTFRDJ type=write size=410071 2024-09-12T17:04:56.922 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.919+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~A5IKKMZWGB6O.0 size=1048576 2024-09-12T17:04:56.925 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.919+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~A5IKKMZWGB6O.1 size=1048576 2024-09-12T17:04:56.925 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.919+0000 7f026be9d8c0 1 < canceled part key=_multipart_4G3BKGNT3YZC.2~A5IKKMZWGB6O.2 size=577851 2024-09-12T17:04:56.931 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.927+0000 7f026be9d8c0 1 < canceled multipart upload key=4G3BKGNT3YZC upload=A5IKKMZWGB6O tag=SSOR2PNXOGS5 type=write size=3723579 2024-09-12T17:04:56.935 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.931+0000 7f026be9d8c0 1 > prepared operation key=JJMEQ2O00SA2 tag=FJEMP060IFST type=write size=231055 2024-09-12T17:04:56.939 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.935+0000 7f026be9d8c0 1 < canceled operation key=XNBE2II106VZ tag=90PFWPJJISEU type=del size=480664 2024-09-12T17:04:56.942 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.939+0000 7f026be9d8c0 1 > prepared operation key=2BQJ30RQQ25L tag=MGPVJ2Y272XV type=del size=210628 2024-09-12T17:04:56.946 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.943+0000 7f026be9d8c0 1 < completed delete operation key=4G3BKGNT3YZC tag=36686REWL31A type=del 2024-09-12T17:04:56.950 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.947+0000 7f026be9d8c0 1 > prepared operation key=6VO85REZG2NW tag=YB4C9EEGGSBV type=del size=921743 2024-09-12T17:04:56.953 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.947+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~7BB9QN9AW6W8.0 size=21700 2024-09-12T17:04:56.958 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.955+0000 7f026be9d8c0 1 < completed multipart upload key=Y27CDEOCM7DH upload=7BB9QN9AW6W8 tag=189J2F7LPT8H type=write size=1070276 2024-09-12T17:04:56.962 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.955+0000 7f026be9d8c0 1 > prepared operation key=GPUFWJ3AWEMX tag=8WJVAF8W7XRZ type=del size=317047 2024-09-12T17:04:56.965 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.959+0000 7f026be9d8c0 1 < completed write operation key=21ZD52VBZIO4 tag=KSD5YS328BYG type=write size=377532 2024-09-12T17:04:56.968 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.963+0000 7f026be9d8c0 1 > prepared operation key=MVYWUWKSYQ9Z tag=9OKXVURGVKES type=del size=2260064 2024-09-12T17:04:56.972 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.967+0000 7f026be9d8c0 1 < completed part key=_multipart_8AFDAVJLMRD2.2~T5WV2M087MBU.0 size=1048576 2024-09-12T17:04:56.974 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.971+0000 7f026be9d8c0 1 < completed part key=_multipart_8AFDAVJLMRD2.2~T5WV2M087MBU.1 size=1048576 2024-09-12T17:04:56.977 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.971+0000 7f026be9d8c0 1 < completed part key=_multipart_8AFDAVJLMRD2.2~T5WV2M087MBU.2 size=457643 2024-09-12T17:04:56.983 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.979+0000 7f026be9d8c0 1 < completed multipart upload key=8AFDAVJLMRD2 upload=T5WV2M087MBU tag=XPB2TKDK7ZUO type=write size=3603371 2024-09-12T17:04:56.988 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.983+0000 7f026be9d8c0 1 > prepared part key=_multipart_SO3HLQZA8B6B.2~83JVMGYEG8N6.0 size=276784 2024-09-12T17:04:56.988 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.983+0000 7f026be9d8c0 1 > prepared multipart upload key=SO3HLQZA8B6B upload=83JVMGYEG8N6 tag=Q4LDRUHB8QY0 type=write size=1325360 2024-09-12T17:04:56.991 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.987+0000 7f026be9d8c0 1 < completed delete operation key=LHKLWIUAT08F tag=9W8VBA0YQFUK type=del 2024-09-12T17:04:56.997 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.991+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~L08SQUS28SEB.0 size=44225 2024-09-12T17:04:56.997 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.991+0000 7f026be9d8c0 1 > prepared multipart upload key=2BQJ30RQQ25L upload=L08SQUS28SEB tag=QGT23JRMQCF9 type=write size=1092801 2024-09-12T17:04:57.000 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.995+0000 7f026be9d8c0 1 < completed delete operation key=L194KQIPFLE1 tag=LPIU9M11NKS9 type=del 2024-09-12T17:04:57.003 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:56.999+0000 7f026be9d8c0 1 > prepared operation key=BBYDPSXZKHZP tag=P2IJM5HC4554 type=del size=806498 2024-09-12T17:04:57.007 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.003+0000 7f026be9d8c0 1 < completed part key=_multipart_3JADN360QEO3.2~LOTDPR0HJGGB.0 size=1048576 2024-09-12T17:04:57.007 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.003+0000 7f026be9d8c0 1 < canceled part key=_multipart_3JADN360QEO3.2~LOTDPR0HJGGB.1 size=1048576 2024-09-12T17:04:57.009 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.003+0000 7f026be9d8c0 1 < completed part key=_multipart_3JADN360QEO3.2~LOTDPR0HJGGB.2 size=444444 2024-09-12T17:04:57.015 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.011+0000 7f026be9d8c0 1 < canceled multipart upload key=3JADN360QEO3 upload=LOTDPR0HJGGB tag=LRWXE834SVNP type=write size=3590172 2024-09-12T17:04:57.018 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.015+0000 7f026be9d8c0 1 > prepared operation key=6VO85REZG2NW tag=OHOIR1NC7R1O type=del size=3615200 2024-09-12T17:04:57.022 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.015+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~7HE288T6JD3O.0 size=345675 2024-09-12T17:04:57.027 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.023+0000 7f026be9d8c0 1 < completed multipart upload key=J8MU1A0CWSAQ upload=7HE288T6JD3O tag=VVN5M5JY0LPR type=write size=1394251 2024-09-12T17:04:57.034 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.027+0000 7f026be9d8c0 1 > prepared part key=_multipart_T6QRDTQRHBPI.2~FZ2THQ0OQY7Y.0 size=707604 2024-09-12T17:04:57.034 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.027+0000 7f026be9d8c0 1 > prepared multipart upload key=T6QRDTQRHBPI upload=FZ2THQ0OQY7Y tag=C3RV2TUXNG2U type=write size=1756180 2024-09-12T17:04:57.037 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.031+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~ECUCZ808IHV9.0 size=391758 2024-09-12T17:04:57.043 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.039+0000 7f026be9d8c0 1 < completed multipart upload key=GPUFWJ3AWEMX upload=ECUCZ808IHV9 tag=WAKIA5ZKD1WZ type=write size=1440334 2024-09-12T17:04:57.046 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.043+0000 7f026be9d8c0 1 > prepared operation key=E0Y3SKNUYCQS tag=0UIB275IIU3Q type=del size=3448788 2024-09-12T17:04:57.049 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.043+0000 7f026be9d8c0 1 < completed delete operation key=Z183NH6R676V tag=D2YRVUKN4KAW type=del 2024-09-12T17:04:57.053 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.047+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=22GP4D2PIHV1 type=del size=1301298 2024-09-12T17:04:57.060 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.055+0000 7f026be9d8c0 1 < suggested remove operation key=MVYWUWKSYQ9Z tag=9UZFVOVWXR58 type=del 2024-09-12T17:04:57.063 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.059+0000 7f026be9d8c0 1 > prepared operation key=SO3HLQZA8B6B tag=IDB8X5J4SEQC type=del size=1383225 2024-09-12T17:04:57.067 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.063+0000 7f026be9d8c0 1 < completed write operation key=J8MU1A0CWSAQ tag=I1ZGVP1EQSLZ type=write size=980605 2024-09-12T17:04:57.070 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.067+0000 7f026be9d8c0 1 > prepared operation key=QVQ4TI319DH5 tag=L46KQNCBRZG0 type=del size=614971 2024-09-12T17:04:57.073 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.067+0000 7f026be9d8c0 1 < completed part key=_multipart_Z9YNIEQCVNBA.2~2DBN3ZLGXVGX.0 size=1048576 2024-09-12T17:04:57.076 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.071+0000 7f026be9d8c0 1 < completed part key=_multipart_Z9YNIEQCVNBA.2~2DBN3ZLGXVGX.1 size=1048576 2024-09-12T17:04:57.079 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.075+0000 7f026be9d8c0 1 < completed part key=_multipart_Z9YNIEQCVNBA.2~2DBN3ZLGXVGX.2 size=594752 2024-09-12T17:04:57.084 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.079+0000 7f026be9d8c0 1 < completed multipart upload key=Z9YNIEQCVNBA upload=2DBN3ZLGXVGX tag=IRX6EBQT8Y4K type=write size=3740480 2024-09-12T17:04:57.087 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.083+0000 7f026be9d8c0 1 > prepared operation key=MVYWUWKSYQ9Z tag=PPUNPNN7N37G type=write size=613438 2024-09-12T17:04:57.091 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.087+0000 7f026be9d8c0 1 < completed write operation key=GPUFWJ3AWEMX tag=3PJRKLYTFRDJ type=write size=410071 2024-09-12T17:04:57.095 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.091+0000 7f026be9d8c0 1 > prepared operation key=Z183NH6R676V tag=YMUC5652DA6J type=del size=3098569 2024-09-12T17:04:57.098 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.095+0000 7f026be9d8c0 1 < canceled operation key=JJMEQ2O00SA2 tag=FJEMP060IFST type=write size=231055 2024-09-12T17:04:57.105 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.099+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~U1CD7LFI7ZQ2.0 size=380302 2024-09-12T17:04:57.105 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.099+0000 7f026be9d8c0 1 > prepared multipart upload key=QVQ4TI319DH5 upload=U1CD7LFI7ZQ2 tag=J8AWYGF8032I type=write size=1428878 2024-09-12T17:04:57.109 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.103+0000 7f026be9d8c0 1 < completed delete operation key=2BQJ30RQQ25L tag=MGPVJ2Y272XV type=del 2024-09-12T17:04:57.116 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.111+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~64ECUVL9KOSE.0 size=1048576 2024-09-12T17:04:57.119 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.115+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~64ECUVL9KOSE.1 size=1048576 2024-09-12T17:04:57.122 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.119+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~64ECUVL9KOSE.2 size=283253 2024-09-12T17:04:57.122 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.119+0000 7f026be9d8c0 1 > prepared multipart upload key=XLKR6P8RNRVO upload=64ECUVL9KOSE tag=8ZPT69EH3OQD type=write size=3428981 2024-09-12T17:04:57.126 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.123+0000 7f026be9d8c0 1 < completed delete operation key=6VO85REZG2NW tag=YB4C9EEGGSBV type=del 2024-09-12T17:04:57.134 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.127+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~N6KJH0ANPZ1N.0 size=1048576 2024-09-12T17:04:57.137 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.131+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~N6KJH0ANPZ1N.1 size=940184 2024-09-12T17:04:57.137 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.131+0000 7f026be9d8c0 1 > prepared multipart upload key=2BQJ30RQQ25L upload=N6KJH0ANPZ1N tag=XN51K5RRC4G6 type=write size=3037336 2024-09-12T17:04:57.146 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.139+0000 7f026be9d8c0 1 < suggested update operation key=GPUFWJ3AWEMX tag=8WJVAF8W7XRZ type=del size=317047 2024-09-12T17:04:57.150 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.147+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=1XG3LUI9VBGN type=write size=653763 2024-09-12T17:04:57.157 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.151+0000 7f026be9d8c0 -1 < failed to complete operation key=MVYWUWKSYQ9Z tag=9OKXVURGVKES type=del size=2260064: (22) Invalid argument 2024-09-12T17:04:57.160 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.155+0000 7f026be9d8c0 1 > prepared operation key=QVQ4TI319DH5 tag=IWT1OEMMVVL1 type=del size=3859943 2024-09-12T17:04:57.163 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.159+0000 7f026be9d8c0 1 < completed part key=_multipart_SO3HLQZA8B6B.2~83JVMGYEG8N6.0 size=276784 2024-09-12T17:04:57.168 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.163+0000 7f026be9d8c0 1 < completed multipart upload key=SO3HLQZA8B6B upload=83JVMGYEG8N6 tag=Q4LDRUHB8QY0 type=write size=1325360 2024-09-12T17:04:57.171 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.167+0000 7f026be9d8c0 1 > prepared operation key=XNBE2II106VZ tag=ZS2VPGO8R93E type=write size=118373 2024-09-12T17:04:57.175 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.171+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~L08SQUS28SEB.0 size=44225 2024-09-12T17:04:57.181 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.175+0000 7f026be9d8c0 1 < completed multipart upload key=2BQJ30RQQ25L upload=L08SQUS28SEB tag=QGT23JRMQCF9 type=write size=1092801 2024-09-12T17:04:57.184 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.179+0000 7f026be9d8c0 1 > prepared operation key=Z183NH6R676V tag=OG37NB43U5T7 type=write size=883361 2024-09-12T17:04:57.188 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.183+0000 7f026be9d8c0 1 < completed delete operation key=BBYDPSXZKHZP tag=P2IJM5HC4554 type=del 2024-09-12T17:04:57.191 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.187+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=LL9RO8SGR1ZG type=write size=693178 2024-09-12T17:04:57.198 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.195+0000 7f026be9d8c0 1 < suggested remove operation key=6VO85REZG2NW tag=OHOIR1NC7R1O type=del 2024-09-12T17:04:57.205 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.199+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~RHCK7ECTQ90C.0 size=538369 2024-09-12T17:04:57.205 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.199+0000 7f026be9d8c0 1 > prepared multipart upload key=J8MU1A0CWSAQ upload=RHCK7ECTQ90C tag=GHN10NPZB448 type=write size=1586945 2024-09-12T17:04:57.208 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.203+0000 7f026be9d8c0 1 < completed part key=_multipart_T6QRDTQRHBPI.2~FZ2THQ0OQY7Y.0 size=707604 2024-09-12T17:04:57.214 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.211+0000 7f026be9d8c0 1 < completed multipart upload key=T6QRDTQRHBPI upload=FZ2THQ0OQY7Y tag=C3RV2TUXNG2U type=write size=1756180 2024-09-12T17:04:57.218 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.215+0000 7f026be9d8c0 1 > prepared operation key=PQSQ39X3O64P tag=GK2IWZTP0CQ3 type=del size=612205 2024-09-12T17:04:57.222 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.215+0000 7f026be9d8c0 1 < completed delete operation key=E0Y3SKNUYCQS tag=0UIB275IIU3Q type=del 2024-09-12T17:04:57.225 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.219+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=5JMR3F94L12F type=del size=2857194 2024-09-12T17:04:57.228 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.223+0000 7f026be9d8c0 1 < completed delete operation key=3JADN360QEO3 tag=22GP4D2PIHV1 type=del 2024-09-12T17:04:57.232 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.227+0000 7f026be9d8c0 1 > prepared operation key=8AFDAVJLMRD2 tag=QOJA631WK6N8 type=del size=63038 2024-09-12T17:04:57.239 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.235+0000 7f026be9d8c0 1 < suggested update operation key=SO3HLQZA8B6B tag=IDB8X5J4SEQC type=del size=1383225 2024-09-12T17:04:57.245 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.239+0000 7f026be9d8c0 1 > prepared part key=_multipart_U8W1SAVSLTBF.2~YLTLG5XOMML6.0 size=1048576 2024-09-12T17:04:57.248 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.243+0000 7f026be9d8c0 1 > prepared part key=_multipart_U8W1SAVSLTBF.2~YLTLG5XOMML6.1 size=1048576 2024-09-12T17:04:57.251 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.247+0000 7f026be9d8c0 1 > prepared part key=_multipart_U8W1SAVSLTBF.2~YLTLG5XOMML6.2 size=921268 2024-09-12T17:04:57.252 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.247+0000 7f026be9d8c0 1 > prepared multipart upload key=U8W1SAVSLTBF upload=YLTLG5XOMML6 tag=1G42KPF3EJJ8 type=write size=4066996 2024-09-12T17:04:57.256 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.251+0000 7f026be9d8c0 1 < canceled operation key=QVQ4TI319DH5 tag=L46KQNCBRZG0 type=del size=614971 2024-09-12T17:04:57.260 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.255+0000 7f026be9d8c0 1 > prepared operation key=BBYDPSXZKHZP tag=11GBRLTGSISF type=del size=821619 2024-09-12T17:04:57.264 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.259+0000 7f026be9d8c0 1 < completed write operation key=MVYWUWKSYQ9Z tag=PPUNPNN7N37G type=write size=613438 2024-09-12T17:04:57.268 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.263+0000 7f026be9d8c0 1 > prepared operation key=UU88OS653L8D tag=TYKMH0X01HJZ type=del size=1599647 2024-09-12T17:04:57.272 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.267+0000 7f026be9d8c0 1 < completed delete operation key=Z183NH6R676V tag=YMUC5652DA6J type=del 2024-09-12T17:04:57.276 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.271+0000 7f026be9d8c0 1 > prepared operation key=XNBE2II106VZ tag=QV5068Q8XUL6 type=del size=2468405 2024-09-12T17:04:57.279 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.275+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~U1CD7LFI7ZQ2.0 size=380302 2024-09-12T17:04:57.284 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.279+0000 7f026be9d8c0 1 < completed multipart upload key=QVQ4TI319DH5 upload=U1CD7LFI7ZQ2 tag=J8AWYGF8032I type=write size=1428878 2024-09-12T17:04:57.288 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.283+0000 7f026be9d8c0 1 > prepared operation key=UU88OS653L8D tag=C6C5OOXFALW8 type=del size=288577 2024-09-12T17:04:57.289 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.283+0000 7f026be9d8c0 1 < canceled part key=_multipart_XLKR6P8RNRVO.2~64ECUVL9KOSE.0 size=1048576 2024-09-12T17:04:57.291 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.287+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~64ECUVL9KOSE.1 size=1048576 2024-09-12T17:04:57.294 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.291+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~64ECUVL9KOSE.2 size=283253 2024-09-12T17:04:57.300 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.295+0000 7f026be9d8c0 1 < canceled multipart upload key=XLKR6P8RNRVO upload=64ECUVL9KOSE tag=8ZPT69EH3OQD type=write size=3428981 2024-09-12T17:04:57.304 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.299+0000 7f026be9d8c0 1 > prepared operation key=GPUFWJ3AWEMX tag=9SJ2OI26AOQC type=del size=2178 2024-09-12T17:04:57.308 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.303+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~N6KJH0ANPZ1N.0 size=1048576 2024-09-12T17:04:57.311 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.307+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~N6KJH0ANPZ1N.1 size=940184 2024-09-12T17:04:57.317 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.311+0000 7f026be9d8c0 1 < completed multipart upload key=2BQJ30RQQ25L upload=N6KJH0ANPZ1N tag=XN51K5RRC4G6 type=write size=3037336 2024-09-12T17:04:57.323 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.319+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~FSP4VNI6LBOL.0 size=1048576 2024-09-12T17:04:57.326 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.323+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~FSP4VNI6LBOL.1 size=246654 2024-09-12T17:04:57.327 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.323+0000 7f026be9d8c0 1 > prepared multipart upload key=8AFDAVJLMRD2 upload=FSP4VNI6LBOL tag=G9GAAHKV878R type=write size=2343806 2024-09-12T17:04:57.330 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.327+0000 7f026be9d8c0 1 < completed write operation key=21ZD52VBZIO4 tag=1XG3LUI9VBGN type=write size=653763 2024-09-12T17:04:57.334 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.331+0000 7f026be9d8c0 1 > prepared operation key=SL2446KSB531 tag=AXALR4MFBAF1 type=del size=3934429 2024-09-12T17:04:57.338 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.331+0000 7f026be9d8c0 1 < completed delete operation key=QVQ4TI319DH5 tag=IWT1OEMMVVL1 type=del 2024-09-12T17:04:57.344 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.339+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~OE2PAWOXLF56.0 size=1048576 2024-09-12T17:04:57.347 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.343+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~OE2PAWOXLF56.1 size=1048576 2024-09-12T17:04:57.350 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.347+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~OE2PAWOXLF56.2 size=471972 2024-09-12T17:04:57.350 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.347+0000 7f026be9d8c0 1 > prepared multipart upload key=XLKR6P8RNRVO upload=OE2PAWOXLF56 tag=UZ3UW8EINN52 type=write size=3617700 2024-09-12T17:04:57.359 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.355+0000 7f026be9d8c0 1 < suggested update operation key=XNBE2II106VZ tag=ZS2VPGO8R93E type=write size=118373 2024-09-12T17:04:57.365 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.359+0000 7f026be9d8c0 1 > prepared part key=_multipart_E0Y3SKNUYCQS.2~PNGK4IINFOFD.0 size=1048576 2024-09-12T17:04:57.368 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.363+0000 7f026be9d8c0 1 > prepared part key=_multipart_E0Y3SKNUYCQS.2~PNGK4IINFOFD.1 size=15746 2024-09-12T17:04:57.368 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.363+0000 7f026be9d8c0 1 > prepared multipart upload key=E0Y3SKNUYCQS upload=PNGK4IINFOFD tag=4MT01Q4SDD3Q type=write size=2112898 2024-09-12T17:04:57.371 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.367+0000 7f026be9d8c0 1 < canceled operation key=Z183NH6R676V tag=OG37NB43U5T7 type=write size=883361 2024-09-12T17:04:57.378 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.371+0000 7f026be9d8c0 1 > prepared part key=_multipart_L194KQIPFLE1.2~ZC61X3KF2D91.0 size=1048576 2024-09-12T17:04:57.380 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.375+0000 7f026be9d8c0 1 > prepared part key=_multipart_L194KQIPFLE1.2~ZC61X3KF2D91.1 size=1048576 2024-09-12T17:04:57.383 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.379+0000 7f026be9d8c0 1 > prepared part key=_multipart_L194KQIPFLE1.2~ZC61X3KF2D91.2 size=290177 2024-09-12T17:04:57.383 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.379+0000 7f026be9d8c0 1 > prepared multipart upload key=L194KQIPFLE1 upload=ZC61X3KF2D91 tag=VSMK1RDX1U6Y type=write size=3435905 2024-09-12T17:04:57.390 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.387+0000 7f026be9d8c0 1 < suggested update operation key=3JADN360QEO3 tag=LL9RO8SGR1ZG type=write size=693178 2024-09-12T17:04:57.394 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.387+0000 7f026be9d8c0 1 > prepared operation key=SGT8IC1GJ3IG tag=L8KTVWU1EAM1 type=write size=863819 2024-09-12T17:04:57.398 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.391+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~RHCK7ECTQ90C.0 size=538369 2024-09-12T17:04:57.403 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.399+0000 7f026be9d8c0 1 < completed multipart upload key=J8MU1A0CWSAQ upload=RHCK7ECTQ90C tag=GHN10NPZB448 type=write size=1586945 2024-09-12T17:04:57.407 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.403+0000 7f026be9d8c0 1 > prepared operation key=8AFDAVJLMRD2 tag=BZ2D8EET52NB type=del size=3346998 2024-09-12T17:04:57.410 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.407+0000 7f026be9d8c0 1 < completed delete operation key=PQSQ39X3O64P tag=GK2IWZTP0CQ3 type=del 2024-09-12T17:04:57.413 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.407+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=8V35XMJMXLAZ type=del size=159367 2024-09-12T17:04:57.416 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.411+0000 7f026be9d8c0 1 < completed delete operation key=RBNN03IPZ8BT tag=5JMR3F94L12F type=del 2024-09-12T17:04:57.420 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.415+0000 7f026be9d8c0 1 > prepared operation key=4U1W97V0OX11 tag=I633KG6AMMWB type=del size=416476 2024-09-12T17:04:57.423 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.419+0000 7f026be9d8c0 1 < completed delete operation key=8AFDAVJLMRD2 tag=QOJA631WK6N8 type=del 2024-09-12T17:04:57.426 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.419+0000 7f026be9d8c0 1 > prepared operation key=PQSQ39X3O64P tag=THQAJKNH4UN5 type=write size=812729 2024-09-12T17:04:57.429 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.423+0000 7f026be9d8c0 1 < completed part key=_multipart_U8W1SAVSLTBF.2~YLTLG5XOMML6.0 size=1048576 2024-09-12T17:04:57.429 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.423+0000 7f026be9d8c0 1 < canceled part key=_multipart_U8W1SAVSLTBF.2~YLTLG5XOMML6.1 size=1048576 2024-09-12T17:04:57.431 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.427+0000 7f026be9d8c0 1 < completed part key=_multipart_U8W1SAVSLTBF.2~YLTLG5XOMML6.2 size=921268 2024-09-12T17:04:57.437 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.431+0000 7f026be9d8c0 1 < canceled multipart upload key=U8W1SAVSLTBF upload=YLTLG5XOMML6 tag=1G42KPF3EJJ8 type=write size=4066996 2024-09-12T17:04:57.439 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.435+0000 7f026be9d8c0 1 > prepared operation key=PQSQ39X3O64P tag=6NI5C1O69C7N type=del size=877496 2024-09-12T17:04:57.442 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.439+0000 7f026be9d8c0 1 < completed delete operation key=BBYDPSXZKHZP tag=11GBRLTGSISF type=del 2024-09-12T17:04:57.449 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.443+0000 7f026be9d8c0 1 > prepared part key=_multipart_LHKLWIUAT08F.2~YZA1IYE9C7K1.0 size=864948 2024-09-12T17:04:57.449 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.443+0000 7f026be9d8c0 1 > prepared multipart upload key=LHKLWIUAT08F upload=YZA1IYE9C7K1 tag=FFSW04VME9I4 type=write size=1913524 2024-09-12T17:04:57.451 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.447+0000 7f026be9d8c0 1 < completed delete operation key=UU88OS653L8D tag=TYKMH0X01HJZ type=del 2024-09-12T17:04:57.457 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.451+0000 7f026be9d8c0 1 > prepared part key=_multipart_U8W1SAVSLTBF.2~S4KIJOLFMPN7.0 size=1048576 2024-09-12T17:04:57.460 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.455+0000 7f026be9d8c0 1 > prepared part key=_multipart_U8W1SAVSLTBF.2~S4KIJOLFMPN7.1 size=974175 2024-09-12T17:04:57.460 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.455+0000 7f026be9d8c0 1 > prepared multipart upload key=U8W1SAVSLTBF upload=S4KIJOLFMPN7 tag=9E74BH4QN4I9 type=write size=3071327 2024-09-12T17:04:57.463 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.459+0000 7f026be9d8c0 -1 < failed to complete operation key=XNBE2II106VZ tag=QV5068Q8XUL6 type=del size=2468405: (22) Invalid argument 2024-09-12T17:04:57.467 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.463+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=DUJ5JWT7Q1H1 type=del size=1253802 2024-09-12T17:04:57.475 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.471+0000 7f026be9d8c0 1 < suggested remove operation key=UU88OS653L8D tag=C6C5OOXFALW8 type=del 2024-09-12T17:04:57.477 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.471+0000 7f026be9d8c0 1 > prepared operation key=Z183NH6R676V tag=6R71N1YIAG5H type=del size=221862 2024-09-12T17:04:57.487 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.483+0000 7f026be9d8c0 1 < suggested remove operation key=GPUFWJ3AWEMX tag=9SJ2OI26AOQC type=del 2024-09-12T17:04:58.532 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.487+0000 7f026be9d8c0 1 > prepared operation key=L194KQIPFLE1 tag=585CVY71M0ZP type=del size=1015948 2024-09-12T17:04:58.532 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.487+0000 7f026be9d8c0 1 < canceled part key=_multipart_8AFDAVJLMRD2.2~FSP4VNI6LBOL.0 size=1048576 2024-09-12T17:04:58.532 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.491+0000 7f026be9d8c0 1 < completed part key=_multipart_8AFDAVJLMRD2.2~FSP4VNI6LBOL.1 size=246654 2024-09-12T17:04:58.532 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.495+0000 7f026be9d8c0 1 < canceled multipart upload key=8AFDAVJLMRD2 upload=FSP4VNI6LBOL tag=G9GAAHKV878R type=write size=2343806 2024-09-12T17:04:58.532 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.499+0000 7f026be9d8c0 1 > prepared operation key=GPUFWJ3AWEMX tag=Z562O06CSTPQ type=write size=1020723 2024-09-12T17:04:58.533 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.507+0000 7f026be9d8c0 1 < suggested update operation key=SL2446KSB531 tag=AXALR4MFBAF1 type=del size=3934429 2024-09-12T17:04:58.533 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.511+0000 7f026be9d8c0 1 > prepared operation key=Z9YNIEQCVNBA tag=I9SANUQ0UIPM type=del size=2840736 2024-09-12T17:04:58.533 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.511+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~OE2PAWOXLF56.0 size=1048576 2024-09-12T17:04:58.533 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.515+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~OE2PAWOXLF56.1 size=1048576 2024-09-12T17:04:58.533 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.515+0000 7f026be9d8c0 1 < canceled part key=_multipart_XLKR6P8RNRVO.2~OE2PAWOXLF56.2 size=471972 2024-09-12T17:04:58.533 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.523+0000 7f026be9d8c0 1 < canceled multipart upload key=XLKR6P8RNRVO upload=OE2PAWOXLF56 tag=UZ3UW8EINN52 type=write size=3617700 2024-09-12T17:04:58.533 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.531+0000 7f026be9d8c0 1 > prepared part key=_multipart_BBYDPSXZKHZP.2~JXK100637S5S.0 size=609104 2024-09-12T17:04:58.533 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.531+0000 7f026be9d8c0 1 > prepared multipart upload key=BBYDPSXZKHZP upload=JXK100637S5S tag=ZA7OW9VXV902 type=write size=1657680 2024-09-12T17:04:58.533 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.535+0000 7f026be9d8c0 1 < completed part key=_multipart_E0Y3SKNUYCQS.2~PNGK4IINFOFD.0 size=1048576 2024-09-12T17:04:58.533 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.535+0000 7f026be9d8c0 1 < completed part key=_multipart_E0Y3SKNUYCQS.2~PNGK4IINFOFD.1 size=15746 2024-09-12T17:04:58.533 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.543+0000 7f026be9d8c0 1 < completed multipart upload key=E0Y3SKNUYCQS upload=PNGK4IINFOFD tag=4MT01Q4SDD3Q type=write size=2112898 2024-09-12T17:04:58.533 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.547+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~G3LPD8HTPZR8.0 size=1048576 2024-09-12T17:04:58.533 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.551+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~G3LPD8HTPZR8.1 size=206633 2024-09-12T17:04:58.534 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.551+0000 7f026be9d8c0 1 > prepared multipart upload key=Y27CDEOCM7DH upload=G3LPD8HTPZR8 tag=0AT8W03P2746 type=write size=2303785 2024-09-12T17:04:58.534 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.555+0000 7f026be9d8c0 1 < completed part key=_multipart_L194KQIPFLE1.2~ZC61X3KF2D91.0 size=1048576 2024-09-12T17:04:58.534 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.559+0000 7f026be9d8c0 1 < completed part key=_multipart_L194KQIPFLE1.2~ZC61X3KF2D91.1 size=1048576 2024-09-12T17:04:58.534 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.563+0000 7f026be9d8c0 1 < completed part key=_multipart_L194KQIPFLE1.2~ZC61X3KF2D91.2 size=290177 2024-09-12T17:04:58.534 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.567+0000 7f026be9d8c0 1 < completed multipart upload key=L194KQIPFLE1 upload=ZC61X3KF2D91 tag=VSMK1RDX1U6Y type=write size=3435905 2024-09-12T17:04:58.534 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.571+0000 7f026be9d8c0 1 > prepared operation key=4G3BKGNT3YZC tag=2BHA83Z6N295 type=del size=92746 2024-09-12T17:04:58.534 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.575+0000 7f026be9d8c0 1 < completed write operation key=SGT8IC1GJ3IG tag=L8KTVWU1EAM1 type=write size=863819 2024-09-12T17:04:58.534 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.579+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~RMIY4LZURV0K.0 size=1048576 2024-09-12T17:04:58.534 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.583+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~RMIY4LZURV0K.1 size=1048576 2024-09-12T17:04:58.534 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.583+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~RMIY4LZURV0K.2 size=846153 2024-09-12T17:04:58.534 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.583+0000 7f026be9d8c0 1 > prepared multipart upload key=XLKR6P8RNRVO upload=RMIY4LZURV0K tag=FAYOQ50ATFIS type=write size=3991881 2024-09-12T17:04:58.534 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.587+0000 7f026be9d8c0 1 < completed delete operation key=8AFDAVJLMRD2 tag=BZ2D8EET52NB type=del 2024-09-12T17:04:58.534 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.591+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=7O7YD38CP7IN type=del size=690661 2024-09-12T17:04:58.535 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.599+0000 7f026be9d8c0 1 < suggested update operation key=21ZD52VBZIO4 tag=8V35XMJMXLAZ type=del size=159367 2024-09-12T17:04:58.535 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.603+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=X5N3MMYRW8A2 type=del size=3876990 2024-09-12T17:04:58.535 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.607+0000 7f026be9d8c0 1 < suggested update operation key=4U1W97V0OX11 tag=I633KG6AMMWB type=del size=416476 2024-09-12T17:04:58.535 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.611+0000 7f026be9d8c0 1 > prepared operation key=ALFGNC1YNROX tag=JN5CE5D77K04 type=del size=2666101 2024-09-12T17:04:58.535 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.615+0000 7f026be9d8c0 1 < completed write operation key=PQSQ39X3O64P tag=THQAJKNH4UN5 type=write size=812729 2024-09-12T17:04:58.535 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.619+0000 7f026be9d8c0 1 > prepared operation key=XNBE2II106VZ tag=EQRIU9CK3XVF type=del size=3663104 2024-09-12T17:04:58.535 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.623+0000 7f026be9d8c0 1 < completed delete operation key=PQSQ39X3O64P tag=6NI5C1O69C7N type=del 2024-09-12T17:04:58.535 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.631+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~GMHJLMVPVMLQ.0 size=901234 2024-09-12T17:04:58.535 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.631+0000 7f026be9d8c0 1 > prepared multipart upload key=2BQJ30RQQ25L upload=GMHJLMVPVMLQ tag=8ID9KJI13BLU type=write size=1949810 2024-09-12T17:04:58.535 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.635+0000 7f026be9d8c0 1 < completed part key=_multipart_LHKLWIUAT08F.2~YZA1IYE9C7K1.0 size=864948 2024-09-12T17:04:58.535 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.639+0000 7f026be9d8c0 1 < completed multipart upload key=LHKLWIUAT08F upload=YZA1IYE9C7K1 tag=FFSW04VME9I4 type=write size=1913524 2024-09-12T17:04:58.535 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.647+0000 7f026be9d8c0 1 > prepared part key=_multipart_21ZD52VBZIO4.2~A5NATVUYJCSG.0 size=991718 2024-09-12T17:04:58.535 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.647+0000 7f026be9d8c0 1 > prepared multipart upload key=21ZD52VBZIO4 upload=A5NATVUYJCSG tag=5Y7ULYII8HRF type=write size=2040294 2024-09-12T17:04:58.536 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.651+0000 7f026be9d8c0 1 < completed part key=_multipart_U8W1SAVSLTBF.2~S4KIJOLFMPN7.0 size=1048576 2024-09-12T17:04:58.536 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.651+0000 7f026be9d8c0 1 < completed part key=_multipart_U8W1SAVSLTBF.2~S4KIJOLFMPN7.1 size=974175 2024-09-12T17:04:58.536 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.659+0000 7f026be9d8c0 1 < completed multipart upload key=U8W1SAVSLTBF upload=S4KIJOLFMPN7 tag=9E74BH4QN4I9 type=write size=3071327 2024-09-12T17:04:58.536 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.663+0000 7f026be9d8c0 1 > prepared operation key=JJMEQ2O00SA2 tag=FMI24XB8DAQL type=del size=1041214 2024-09-12T17:04:58.536 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.667+0000 7f026be9d8c0 1 < suggested update operation key=RBNN03IPZ8BT tag=DUJ5JWT7Q1H1 type=del size=1253802 2024-09-12T17:04:58.536 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.675+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~DW00GQYFMUHK.0 size=1048576 2024-09-12T17:04:58.536 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.679+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~DW00GQYFMUHK.1 size=891395 2024-09-12T17:04:58.536 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.679+0000 7f026be9d8c0 1 > prepared multipart upload key=32XUMOWT8HO2 upload=DW00GQYFMUHK tag=QBNSZA9RYKVS type=write size=2988547 2024-09-12T17:04:58.536 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.683+0000 7f026be9d8c0 1 < canceled operation key=Z183NH6R676V tag=6R71N1YIAG5H type=del size=221862 2024-09-12T17:04:58.536 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.683+0000 7f026be9d8c0 1 > prepared operation key=UU88OS653L8D tag=MXJLVM76Q2R9 type=del size=2382217 2024-09-12T17:04:58.536 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.691+0000 7f026be9d8c0 1 < suggested update operation key=L194KQIPFLE1 tag=585CVY71M0ZP type=del size=1015948 2024-09-12T17:04:58.536 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.699+0000 7f026be9d8c0 1 > prepared part key=_multipart_L194KQIPFLE1.2~MQZ3N08CX261.0 size=11354 2024-09-12T17:04:58.536 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.699+0000 7f026be9d8c0 1 > prepared multipart upload key=L194KQIPFLE1 upload=MQZ3N08CX261 tag=7HX7K3AJCLKA type=write size=1059930 2024-09-12T17:04:58.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.703+0000 7f026be9d8c0 1 < completed write operation key=GPUFWJ3AWEMX tag=Z562O06CSTPQ type=write size=1020723 2024-09-12T17:04:58.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.707+0000 7f026be9d8c0 1 > prepared operation key=T6QRDTQRHBPI tag=A223WN2JJ70B type=del size=2303690 2024-09-12T17:04:58.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.711+0000 7f026be9d8c0 1 < canceled operation key=Z9YNIEQCVNBA tag=I9SANUQ0UIPM type=del size=2840736 2024-09-12T17:04:58.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.715+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~W7IRYDG8XQEF.0 size=1048576 2024-09-12T17:04:58.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.719+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~W7IRYDG8XQEF.1 size=780288 2024-09-12T17:04:58.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.719+0000 7f026be9d8c0 1 > prepared multipart upload key=32XUMOWT8HO2 upload=W7IRYDG8XQEF tag=2ZLMYO238CF2 type=write size=2877440 2024-09-12T17:04:58.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.723+0000 7f026be9d8c0 1 < completed part key=_multipart_BBYDPSXZKHZP.2~JXK100637S5S.0 size=609104 2024-09-12T17:04:58.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.727+0000 7f026be9d8c0 1 < completed multipart upload key=BBYDPSXZKHZP upload=JXK100637S5S tag=ZA7OW9VXV902 type=write size=1657680 2024-09-12T17:04:58.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.731+0000 7f026be9d8c0 1 > prepared operation key=ALFGNC1YNROX tag=2DFTEEHN588Z type=del size=2971943 2024-09-12T17:04:58.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.735+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~G3LPD8HTPZR8.0 size=1048576 2024-09-12T17:04:58.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.739+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~G3LPD8HTPZR8.1 size=206633 2024-09-12T17:04:58.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.743+0000 7f026be9d8c0 1 < completed multipart upload key=Y27CDEOCM7DH upload=G3LPD8HTPZR8 tag=0AT8W03P2746 type=write size=2303785 2024-09-12T17:04:58.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.751+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~VETL47U3Z5F6.0 size=724563 2024-09-12T17:04:58.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.751+0000 7f026be9d8c0 1 > prepared multipart upload key=8AFDAVJLMRD2 upload=VETL47U3Z5F6 tag=XVHEFLB7FOBS type=write size=1773139 2024-09-12T17:04:58.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.759+0000 7f026be9d8c0 1 < suggested remove operation key=4G3BKGNT3YZC tag=2BHA83Z6N295 type=del 2024-09-12T17:04:58.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.763+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~6KV710H5H250.0 size=500615 2024-09-12T17:04:58.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.763+0000 7f026be9d8c0 1 > prepared multipart upload key=Y27CDEOCM7DH upload=6KV710H5H250 tag=AO7LXY6EPEN6 type=write size=1549191 2024-09-12T17:04:58.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.767+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~RMIY4LZURV0K.0 size=1048576 2024-09-12T17:04:58.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.767+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~RMIY4LZURV0K.1 size=1048576 2024-09-12T17:04:58.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.771+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~RMIY4LZURV0K.2 size=846153 2024-09-12T17:04:58.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.779+0000 7f026be9d8c0 1 < completed multipart upload key=XLKR6P8RNRVO upload=RMIY4LZURV0K tag=FAYOQ50ATFIS type=write size=3991881 2024-09-12T17:04:58.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.779+0000 7f026be9d8c0 1 > prepared operation key=Z9YNIEQCVNBA tag=K6KZ2YXYHT14 type=del size=1787886 2024-09-12T17:04:58.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.787+0000 7f026be9d8c0 1 < suggested remove operation key=3JADN360QEO3 tag=7O7YD38CP7IN type=del 2024-09-12T17:04:58.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.791+0000 7f026be9d8c0 1 > prepared operation key=LHKLWIUAT08F tag=R4U43E6ZSKBR type=del size=1781612 2024-09-12T17:04:58.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.799+0000 7f026be9d8c0 1 < suggested update operation key=U8W1SAVSLTBF tag=X5N3MMYRW8A2 type=del size=3876990 2024-09-12T17:04:58.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.803+0000 7f026be9d8c0 1 > prepared operation key=4G3BKGNT3YZC tag=WHSWJVZK3CV6 type=del size=108831 2024-09-12T17:04:58.539 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.811+0000 7f026be9d8c0 1 < suggested remove operation key=ALFGNC1YNROX tag=JN5CE5D77K04 type=del 2024-09-12T17:04:58.539 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.815+0000 7f026be9d8c0 1 > prepared operation key=Y27CDEOCM7DH tag=N51KGYQ3RHKZ type=del size=1656208 2024-09-12T17:04:58.539 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.819+0000 7f026be9d8c0 1 < completed delete operation key=XNBE2II106VZ tag=EQRIU9CK3XVF type=del 2024-09-12T17:04:58.539 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.823+0000 7f026be9d8c0 1 > prepared operation key=2BQJ30RQQ25L tag=OL97ZKYSH5QR type=write size=42342 2024-09-12T17:04:58.539 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.827+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~GMHJLMVPVMLQ.0 size=901234 2024-09-12T17:04:58.539 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.831+0000 7f026be9d8c0 1 < completed multipart upload key=2BQJ30RQQ25L upload=GMHJLMVPVMLQ tag=8ID9KJI13BLU type=write size=1949810 2024-09-12T17:04:58.539 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.839+0000 7f026be9d8c0 1 > prepared part key=_multipart_MVYWUWKSYQ9Z.2~B6717TVS1B72.0 size=1048576 2024-09-12T17:04:58.539 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.843+0000 7f026be9d8c0 1 > prepared part key=_multipart_MVYWUWKSYQ9Z.2~B6717TVS1B72.1 size=1048576 2024-09-12T17:04:58.539 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.843+0000 7f026be9d8c0 1 > prepared part key=_multipart_MVYWUWKSYQ9Z.2~B6717TVS1B72.2 size=898971 2024-09-12T17:04:58.539 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.843+0000 7f026be9d8c0 1 > prepared multipart upload key=MVYWUWKSYQ9Z upload=B6717TVS1B72 tag=KRJ92MWRKV3N type=write size=4044699 2024-09-12T17:04:58.539 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.847+0000 7f026be9d8c0 1 < completed part key=_multipart_21ZD52VBZIO4.2~A5NATVUYJCSG.0 size=991718 2024-09-12T17:04:58.539 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.855+0000 7f026be9d8c0 1 < completed multipart upload key=21ZD52VBZIO4 upload=A5NATVUYJCSG tag=5Y7ULYII8HRF type=write size=2040294 2024-09-12T17:04:58.539 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.859+0000 7f026be9d8c0 1 > prepared operation key=ALFGNC1YNROX tag=1IUGFIMY7JFV type=del size=2046041 2024-09-12T17:04:58.540 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.863+0000 7f026be9d8c0 1 < completed delete operation key=JJMEQ2O00SA2 tag=FMI24XB8DAQL type=del 2024-09-12T17:04:58.540 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.867+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~0LI6TJRMZCL2.0 size=111792 2024-09-12T17:04:58.540 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.867+0000 7f026be9d8c0 1 > prepared multipart upload key=8AFDAVJLMRD2 upload=0LI6TJRMZCL2 tag=I8MY7X43RPHO type=write size=1160368 2024-09-12T17:04:58.540 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.871+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~DW00GQYFMUHK.0 size=1048576 2024-09-12T17:04:58.540 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.875+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~DW00GQYFMUHK.1 size=891395 2024-09-12T17:04:58.540 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.879+0000 7f026be9d8c0 1 < completed multipart upload key=32XUMOWT8HO2 upload=DW00GQYFMUHK tag=QBNSZA9RYKVS type=write size=2988547 2024-09-12T17:04:58.540 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.887+0000 7f026be9d8c0 1 > prepared part key=_multipart_BBYDPSXZKHZP.2~01NCFPQIUFYQ.0 size=1048576 2024-09-12T17:04:58.540 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.887+0000 7f026be9d8c0 1 > prepared part key=_multipart_BBYDPSXZKHZP.2~01NCFPQIUFYQ.1 size=32482 2024-09-12T17:04:58.540 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.887+0000 7f026be9d8c0 1 > prepared multipart upload key=BBYDPSXZKHZP upload=01NCFPQIUFYQ tag=OVSO8DK8OF9G type=write size=2129634 2024-09-12T17:04:58.540 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.891+0000 7f026be9d8c0 1 < completed delete operation key=UU88OS653L8D tag=MXJLVM76Q2R9 type=del 2024-09-12T17:04:58.540 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.895+0000 7f026be9d8c0 1 > prepared operation key=XNBE2II106VZ tag=9J3BEK0LGTGI type=del size=138024 2024-09-12T17:04:58.540 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.899+0000 7f026be9d8c0 1 < completed part key=_multipart_L194KQIPFLE1.2~MQZ3N08CX261.0 size=11354 2024-09-12T17:04:58.540 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.903+0000 7f026be9d8c0 1 < completed multipart upload key=L194KQIPFLE1 upload=MQZ3N08CX261 tag=7HX7K3AJCLKA type=write size=1059930 2024-09-12T17:04:58.541 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.907+0000 7f026be9d8c0 1 > prepared operation key=2BQJ30RQQ25L tag=6EYRXNRNR1JV type=del size=978338 2024-09-12T17:04:58.541 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.911+0000 7f026be9d8c0 1 < completed delete operation key=T6QRDTQRHBPI tag=A223WN2JJ70B type=del 2024-09-12T17:04:58.541 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.915+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~HZPODRGCCJSS.0 size=1048576 2024-09-12T17:04:58.541 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.919+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~HZPODRGCCJSS.1 size=1048576 2024-09-12T17:04:58.541 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.923+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~HZPODRGCCJSS.2 size=1008768 2024-09-12T17:04:58.541 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.923+0000 7f026be9d8c0 1 > prepared multipart upload key=J8MU1A0CWSAQ upload=HZPODRGCCJSS tag=089N1MMA7BBG type=write size=4154496 2024-09-12T17:04:58.541 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.927+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~W7IRYDG8XQEF.0 size=1048576 2024-09-12T17:04:58.541 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.927+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~W7IRYDG8XQEF.1 size=780288 2024-09-12T17:04:58.541 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.931+0000 7f026be9d8c0 1 < completed multipart upload key=32XUMOWT8HO2 upload=W7IRYDG8XQEF tag=2ZLMYO238CF2 type=write size=2877440 2024-09-12T17:04:58.541 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.939+0000 7f026be9d8c0 1 > prepared part key=_multipart_XNBE2II106VZ.2~8US0O4MLXRGT.0 size=1048576 2024-09-12T17:04:58.541 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.939+0000 7f026be9d8c0 1 > prepared part key=_multipart_XNBE2II106VZ.2~8US0O4MLXRGT.1 size=1048576 2024-09-12T17:04:58.541 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.943+0000 7f026be9d8c0 1 > prepared part key=_multipart_XNBE2II106VZ.2~8US0O4MLXRGT.2 size=718891 2024-09-12T17:04:58.541 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.943+0000 7f026be9d8c0 1 > prepared multipart upload key=XNBE2II106VZ upload=8US0O4MLXRGT tag=1Q5DTXNM3BR0 type=write size=3864619 2024-09-12T17:04:58.542 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.947+0000 7f026be9d8c0 -1 < failed to complete operation key=ALFGNC1YNROX tag=2DFTEEHN588Z type=del size=2971943: (22) Invalid argument 2024-09-12T17:04:58.542 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.951+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~L1P9IQOOJZ9R.0 size=211238 2024-09-12T17:04:58.542 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.951+0000 7f026be9d8c0 1 > prepared multipart upload key=UU88OS653L8D upload=L1P9IQOOJZ9R tag=ITZNGQG7FMCY type=write size=1259814 2024-09-12T17:04:58.542 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.955+0000 7f026be9d8c0 1 < completed part key=_multipart_8AFDAVJLMRD2.2~VETL47U3Z5F6.0 size=724563 2024-09-12T17:04:58.542 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.963+0000 7f026be9d8c0 1 < completed multipart upload key=8AFDAVJLMRD2 upload=VETL47U3Z5F6 tag=XVHEFLB7FOBS type=write size=1773139 2024-09-12T17:04:58.542 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.963+0000 7f026be9d8c0 1 > prepared operation key=MVYWUWKSYQ9Z tag=HVMTSYL0W92E type=del size=493130 2024-09-12T17:04:58.542 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.967+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~6KV710H5H250.0 size=500615 2024-09-12T17:04:58.542 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.971+0000 7f026be9d8c0 1 < completed multipart upload key=Y27CDEOCM7DH upload=6KV710H5H250 tag=AO7LXY6EPEN6 type=write size=1549191 2024-09-12T17:04:58.542 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.975+0000 7f026be9d8c0 1 > prepared operation key=Z9YNIEQCVNBA tag=DKQYJ9GLB36F type=del size=1688213 2024-09-12T17:04:58.542 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.979+0000 7f026be9d8c0 1 < completed delete operation key=Z9YNIEQCVNBA tag=K6KZ2YXYHT14 type=del 2024-09-12T17:04:58.542 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.983+0000 7f026be9d8c0 1 > prepared operation key=LHKLWIUAT08F tag=OR95YOR16KHN type=write size=499094 2024-09-12T17:04:58.542 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.987+0000 7f026be9d8c0 1 < canceled operation key=LHKLWIUAT08F tag=R4U43E6ZSKBR type=del size=1781612 2024-09-12T17:04:58.542 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.995+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~DQS4WAZCQCN7.0 size=1048576 2024-09-12T17:04:58.543 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.995+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~DQS4WAZCQCN7.1 size=887050 2024-09-12T17:04:58.543 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.995+0000 7f026be9d8c0 1 > prepared multipart upload key=2BQJ30RQQ25L upload=DQS4WAZCQCN7 tag=6IEHB851M9MS type=write size=2984202 2024-09-12T17:04:58.543 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:57.999+0000 7f026be9d8c0 1 < completed delete operation key=4G3BKGNT3YZC tag=WHSWJVZK3CV6 type=del 2024-09-12T17:04:58.543 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.003+0000 7f026be9d8c0 1 > prepared operation key=T6QRDTQRHBPI tag=UQLH0EL77IRO type=del size=388500 2024-09-12T17:04:58.543 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.007+0000 7f026be9d8c0 1 < completed delete operation key=Y27CDEOCM7DH tag=N51KGYQ3RHKZ type=del 2024-09-12T17:04:58.543 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.011+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=NIWRU2PEDKWR type=del size=557688 2024-09-12T17:04:58.543 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.015+0000 7f026be9d8c0 1 < completed write operation key=2BQJ30RQQ25L tag=OL97ZKYSH5QR type=write size=42342 2024-09-12T17:04:58.543 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.019+0000 7f026be9d8c0 1 > prepared operation key=MVYWUWKSYQ9Z tag=D3GL5M05EPIO type=write size=769495 2024-09-12T17:04:58.543 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.023+0000 7f026be9d8c0 1 < completed part key=_multipart_MVYWUWKSYQ9Z.2~B6717TVS1B72.0 size=1048576 2024-09-12T17:04:58.543 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.027+0000 7f026be9d8c0 1 < completed part key=_multipart_MVYWUWKSYQ9Z.2~B6717TVS1B72.1 size=1048576 2024-09-12T17:04:58.543 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.027+0000 7f026be9d8c0 1 < completed part key=_multipart_MVYWUWKSYQ9Z.2~B6717TVS1B72.2 size=898971 2024-09-12T17:04:58.543 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.035+0000 7f026be9d8c0 1 < completed multipart upload key=MVYWUWKSYQ9Z upload=B6717TVS1B72 tag=KRJ92MWRKV3N type=write size=4044699 2024-09-12T17:04:58.543 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.039+0000 7f026be9d8c0 1 > prepared operation key=UU88OS653L8D tag=X8Q09W62DRCE type=del size=3641911 2024-09-12T17:04:58.544 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.039+0000 7f026be9d8c0 1 < canceled operation key=ALFGNC1YNROX tag=1IUGFIMY7JFV type=del size=2046041 2024-09-12T17:04:58.544 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.047+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~BQ7CZXX9SYM6.0 size=1048576 2024-09-12T17:04:58.544 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.047+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~BQ7CZXX9SYM6.1 size=1048576 2024-09-12T17:04:58.544 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.051+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~BQ7CZXX9SYM6.2 size=469685 2024-09-12T17:04:58.544 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.051+0000 7f026be9d8c0 1 > prepared multipart upload key=ALFGNC1YNROX upload=BQ7CZXX9SYM6 tag=YNNAQTO3ORXQ type=write size=3615413 2024-09-12T17:04:58.544 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.051+0000 7f026be9d8c0 1 < canceled part key=_multipart_8AFDAVJLMRD2.2~0LI6TJRMZCL2.0 size=111792 2024-09-12T17:04:58.544 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.055+0000 7f026be9d8c0 1 < canceled multipart upload key=8AFDAVJLMRD2 upload=0LI6TJRMZCL2 tag=I8MY7X43RPHO type=write size=1160368 2024-09-12T17:04:58.544 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.059+0000 7f026be9d8c0 1 > prepared operation key=E0Y3SKNUYCQS tag=SA8121VQ9BG3 type=del size=143594 2024-09-12T17:04:58.544 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.063+0000 7f026be9d8c0 1 < completed part key=_multipart_BBYDPSXZKHZP.2~01NCFPQIUFYQ.0 size=1048576 2024-09-12T17:04:58.544 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.067+0000 7f026be9d8c0 1 < completed part key=_multipart_BBYDPSXZKHZP.2~01NCFPQIUFYQ.1 size=32482 2024-09-12T17:04:58.544 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.071+0000 7f026be9d8c0 1 < completed multipart upload key=BBYDPSXZKHZP upload=01NCFPQIUFYQ tag=OVSO8DK8OF9G type=write size=2129634 2024-09-12T17:04:58.544 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.071+0000 7f026be9d8c0 1 > prepared operation key=Y27CDEOCM7DH tag=4S3LPY1D97VV type=write size=134632 2024-09-12T17:04:58.544 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.075+0000 7f026be9d8c0 1 < completed delete operation key=XNBE2II106VZ tag=9J3BEK0LGTGI type=del 2024-09-12T17:04:58.545 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.079+0000 7f026be9d8c0 1 > prepared operation key=Z9YNIEQCVNBA tag=9I8FAL6JDADB type=del size=1917476 2024-09-12T17:04:58.545 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.083+0000 7f026be9d8c0 1 < completed delete operation key=2BQJ30RQQ25L tag=6EYRXNRNR1JV type=del 2024-09-12T17:04:58.545 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.087+0000 7f026be9d8c0 1 > prepared operation key=4G3BKGNT3YZC tag=ETMM8TQZAECO type=del size=867671 2024-09-12T17:04:58.545 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.087+0000 7f026be9d8c0 1 < canceled part key=_multipart_J8MU1A0CWSAQ.2~HZPODRGCCJSS.0 size=1048576 2024-09-12T17:04:58.545 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.087+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~HZPODRGCCJSS.1 size=1048576 2024-09-12T17:04:58.545 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.091+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~HZPODRGCCJSS.2 size=1008768 2024-09-12T17:04:58.545 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.095+0000 7f026be9d8c0 1 < canceled multipart upload key=J8MU1A0CWSAQ upload=HZPODRGCCJSS tag=089N1MMA7BBG type=write size=4154496 2024-09-12T17:04:58.545 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.099+0000 7f026be9d8c0 1 > prepared operation key=L194KQIPFLE1 tag=AOCJXY5PKKAR type=del size=2577360 2024-09-12T17:04:58.545 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.103+0000 7f026be9d8c0 1 < completed part key=_multipart_XNBE2II106VZ.2~8US0O4MLXRGT.0 size=1048576 2024-09-12T17:04:58.545 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.103+0000 7f026be9d8c0 1 < completed part key=_multipart_XNBE2II106VZ.2~8US0O4MLXRGT.1 size=1048576 2024-09-12T17:04:58.545 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.107+0000 7f026be9d8c0 1 < completed part key=_multipart_XNBE2II106VZ.2~8US0O4MLXRGT.2 size=718891 2024-09-12T17:04:58.545 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.115+0000 7f026be9d8c0 1 < completed multipart upload key=XNBE2II106VZ upload=8US0O4MLXRGT tag=1Q5DTXNM3BR0 type=write size=3864619 2024-09-12T17:04:58.545 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.123+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~VYVWF2YN6357.0 size=1048576 2024-09-12T17:04:58.546 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.123+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~VYVWF2YN6357.1 size=1048576 2024-09-12T17:04:58.546 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.127+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~VYVWF2YN6357.2 size=1013957 2024-09-12T17:04:58.546 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.127+0000 7f026be9d8c0 1 > prepared multipart upload key=UU88OS653L8D upload=VYVWF2YN6357 tag=GBY4KR1PK7WE type=write size=4159685 2024-09-12T17:04:58.546 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.131+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~L1P9IQOOJZ9R.0 size=211238 2024-09-12T17:04:58.546 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.135+0000 7f026be9d8c0 1 < completed multipart upload key=UU88OS653L8D upload=L1P9IQOOJZ9R tag=ITZNGQG7FMCY type=write size=1259814 2024-09-12T17:04:58.546 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.139+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~V8BKEBVY2GVM.0 size=364495 2024-09-12T17:04:58.546 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.139+0000 7f026be9d8c0 1 > prepared multipart upload key=32XUMOWT8HO2 upload=V8BKEBVY2GVM tag=N3IV48DML10Z type=write size=1413071 2024-09-12T17:04:58.546 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.147+0000 7f026be9d8c0 1 < suggested remove operation key=MVYWUWKSYQ9Z tag=HVMTSYL0W92E type=del 2024-09-12T17:04:58.546 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.151+0000 7f026be9d8c0 1 > prepared operation key=Y27CDEOCM7DH tag=GW9PF1FKLB7M type=del size=2717768 2024-09-12T17:04:58.546 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.151+0000 7f026be9d8c0 1 < canceled operation key=Z9YNIEQCVNBA tag=DKQYJ9GLB36F type=del size=1688213 2024-09-12T17:04:58.546 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.155+0000 7f026be9d8c0 1 > prepared operation key=32XUMOWT8HO2 tag=1RPAORNTETPM type=del size=278701 2024-09-12T17:04:58.546 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.159+0000 7f026be9d8c0 1 < completed write operation key=LHKLWIUAT08F tag=OR95YOR16KHN type=write size=499094 2024-09-12T17:04:58.546 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.163+0000 7f026be9d8c0 1 > prepared operation key=32XUMOWT8HO2 tag=YS1WJ28P97OH type=del size=3252929 2024-09-12T17:04:58.547 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.167+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~DQS4WAZCQCN7.0 size=1048576 2024-09-12T17:04:58.547 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.167+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~DQS4WAZCQCN7.1 size=887050 2024-09-12T17:04:58.547 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.171+0000 7f026be9d8c0 1 < completed multipart upload key=2BQJ30RQQ25L upload=DQS4WAZCQCN7 tag=6IEHB851M9MS type=write size=2984202 2024-09-12T17:04:58.547 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.179+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~14DSJ17IPNH4.0 size=549089 2024-09-12T17:04:58.547 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.179+0000 7f026be9d8c0 1 > prepared multipart upload key=4G3BKGNT3YZC upload=14DSJ17IPNH4 tag=VLJQ2LIUQ2WZ type=write size=1597665 2024-09-12T17:04:58.547 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.183+0000 7f026be9d8c0 1 < completed delete operation key=T6QRDTQRHBPI tag=UQLH0EL77IRO type=del 2024-09-12T17:04:58.547 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.187+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~1C45RVMD9IGI.0 size=1048576 2024-09-12T17:04:58.547 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.191+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~1C45RVMD9IGI.1 size=101607 2024-09-12T17:04:58.547 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.191+0000 7f026be9d8c0 1 > prepared multipart upload key=2BQJ30RQQ25L upload=1C45RVMD9IGI tag=OZOYKRUD9QFP type=write size=2198759 2024-09-12T17:04:58.547 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.195+0000 7f026be9d8c0 1 < completed delete operation key=RBNN03IPZ8BT tag=NIWRU2PEDKWR type=del 2024-09-12T17:04:58.547 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.199+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=YBA7HWFHGFBI type=del size=552086 2024-09-12T17:04:58.547 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.199+0000 7f026be9d8c0 -1 < failed to complete operation key=MVYWUWKSYQ9Z tag=D3GL5M05EPIO type=write size=769495: (22) Invalid argument 2024-09-12T17:04:58.547 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.203+0000 7f026be9d8c0 1 > prepared operation key=SL2446KSB531 tag=3LWB3FD1V2GQ type=del size=788426 2024-09-12T17:04:58.548 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.211+0000 7f026be9d8c0 1 < suggested update operation key=UU88OS653L8D tag=X8Q09W62DRCE type=del size=3641911 2024-09-12T17:04:58.548 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.215+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~7FQSKCL4QYLX.0 size=1048576 2024-09-12T17:04:58.548 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.219+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~7FQSKCL4QYLX.1 size=1048576 2024-09-12T17:04:58.548 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.223+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~7FQSKCL4QYLX.2 size=216876 2024-09-12T17:04:58.548 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.223+0000 7f026be9d8c0 1 > prepared multipart upload key=XLKR6P8RNRVO upload=7FQSKCL4QYLX tag=03WUM1ZA7DBP type=write size=3362604 2024-09-12T17:04:58.548 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.227+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~BQ7CZXX9SYM6.0 size=1048576 2024-09-12T17:04:58.548 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.227+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~BQ7CZXX9SYM6.1 size=1048576 2024-09-12T17:04:58.548 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.231+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~BQ7CZXX9SYM6.2 size=469685 2024-09-12T17:04:58.548 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.235+0000 7f026be9d8c0 1 < completed multipart upload key=ALFGNC1YNROX upload=BQ7CZXX9SYM6 tag=YNNAQTO3ORXQ type=write size=3615413 2024-09-12T17:04:58.548 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.239+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~M69RBS4KYW4P.0 size=739816 2024-09-12T17:04:58.548 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.239+0000 7f026be9d8c0 1 > prepared multipart upload key=ALFGNC1YNROX upload=M69RBS4KYW4P tag=R3C38A2MQ144 type=write size=1788392 2024-09-12T17:04:58.548 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.247+0000 7f026be9d8c0 1 < suggested remove operation key=E0Y3SKNUYCQS tag=SA8121VQ9BG3 type=del 2024-09-12T17:04:58.548 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.251+0000 7f026be9d8c0 1 > prepared operation key=4G3BKGNT3YZC tag=Q3G1U0XDJ0UC type=write size=575899 2024-09-12T17:04:58.549 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.255+0000 7f026be9d8c0 1 < suggested update operation key=Y27CDEOCM7DH tag=4S3LPY1D97VV type=write size=134632 2024-09-12T17:04:58.549 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.259+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=B0H368VVC70R type=del size=1683604 2024-09-12T17:04:58.549 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.263+0000 7f026be9d8c0 1 < suggested update operation key=Z9YNIEQCVNBA tag=9I8FAL6JDADB type=del size=1917476 2024-09-12T17:04:58.549 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.267+0000 7f026be9d8c0 1 > prepared operation key=SGT8IC1GJ3IG tag=KZ0QAGOPA4BN type=del size=3150305 2024-09-12T17:04:58.549 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.271+0000 7f026be9d8c0 1 < completed delete operation key=4G3BKGNT3YZC tag=ETMM8TQZAECO type=del 2024-09-12T17:04:58.549 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.275+0000 7f026be9d8c0 1 > prepared operation key=BW1T21LBUE2D tag=L488BZHLB1FO type=del size=1353397 2024-09-12T17:04:58.549 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.279+0000 7f026be9d8c0 1 < completed delete operation key=L194KQIPFLE1 tag=AOCJXY5PKKAR type=del 2024-09-12T17:04:58.549 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.279+0000 7f026be9d8c0 1 > prepared operation key=XNBE2II106VZ tag=0XBRJSPRCWWO type=write size=30077 2024-09-12T17:04:58.549 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.283+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~VYVWF2YN6357.0 size=1048576 2024-09-12T17:04:58.549 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.287+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~VYVWF2YN6357.1 size=1048576 2024-09-12T17:04:58.549 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.287+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~VYVWF2YN6357.2 size=1013957 2024-09-12T17:04:58.549 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.295+0000 7f026be9d8c0 1 < completed multipart upload key=UU88OS653L8D upload=VYVWF2YN6357 tag=GBY4KR1PK7WE type=write size=4159685 2024-09-12T17:04:58.549 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.295+0000 7f026be9d8c0 1 > prepared operation key=XLKR6P8RNRVO tag=B0TTCLFN446Y type=del size=3267166 2024-09-12T17:04:58.550 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.299+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~V8BKEBVY2GVM.0 size=364495 2024-09-12T17:04:58.550 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.303+0000 7f026be9d8c0 1 < completed multipart upload key=32XUMOWT8HO2 upload=V8BKEBVY2GVM tag=N3IV48DML10Z type=write size=1413071 2024-09-12T17:04:58.550 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.307+0000 7f026be9d8c0 1 > prepared operation key=SL2446KSB531 tag=J0N1QKCPNZ5W type=del size=2209782 2024-09-12T17:04:58.550 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.311+0000 7f026be9d8c0 -1 < failed to complete operation key=Y27CDEOCM7DH tag=GW9PF1FKLB7M type=del size=2717768: (22) Invalid argument 2024-09-12T17:04:58.550 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.319+0000 7f026be9d8c0 1 > prepared part key=_multipart_E0Y3SKNUYCQS.2~N8PVTSLPIB11.0 size=1048576 2024-09-12T17:04:58.550 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.319+0000 7f026be9d8c0 1 > prepared part key=_multipart_E0Y3SKNUYCQS.2~N8PVTSLPIB11.1 size=710810 2024-09-12T17:04:58.550 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.319+0000 7f026be9d8c0 1 > prepared multipart upload key=E0Y3SKNUYCQS upload=N8PVTSLPIB11 tag=0UPHY4RYATNE type=write size=2807962 2024-09-12T17:04:58.550 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.323+0000 7f026be9d8c0 1 < completed delete operation key=32XUMOWT8HO2 tag=1RPAORNTETPM type=del 2024-09-12T17:04:58.550 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.327+0000 7f026be9d8c0 1 > prepared operation key=T6QRDTQRHBPI tag=TV164VMNQHQH type=del size=3560702 2024-09-12T17:04:58.550 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.335+0000 7f026be9d8c0 1 < suggested remove operation key=32XUMOWT8HO2 tag=YS1WJ28P97OH type=del 2024-09-12T17:04:58.550 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.339+0000 7f026be9d8c0 1 > prepared operation key=LHKLWIUAT08F tag=QVPQEU0FQP4F type=del size=2474304 2024-09-12T17:04:58.550 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.339+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~14DSJ17IPNH4.0 size=549089 2024-09-12T17:04:58.550 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.347+0000 7f026be9d8c0 1 < completed multipart upload key=4G3BKGNT3YZC upload=14DSJ17IPNH4 tag=VLJQ2LIUQ2WZ type=write size=1597665 2024-09-12T17:04:58.550 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.351+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~OMC16EBM1V83.0 size=480318 2024-09-12T17:04:58.551 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.351+0000 7f026be9d8c0 1 > prepared multipart upload key=Z9YNIEQCVNBA upload=OMC16EBM1V83 tag=POE36LTZGFFD type=write size=1528894 2024-09-12T17:04:58.551 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.355+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~1C45RVMD9IGI.0 size=1048576 2024-09-12T17:04:58.551 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.359+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~1C45RVMD9IGI.1 size=101607 2024-09-12T17:04:58.551 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.367+0000 7f026be9d8c0 1 < completed multipart upload key=2BQJ30RQQ25L upload=1C45RVMD9IGI tag=OZOYKRUD9QFP type=write size=2198759 2024-09-12T17:04:58.551 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.367+0000 7f026be9d8c0 1 > prepared operation key=BBYDPSXZKHZP tag=48VGELFX3YU4 type=del size=3830343 2024-09-12T17:04:58.551 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.371+0000 7f026be9d8c0 1 < completed delete operation key=RBNN03IPZ8BT tag=YBA7HWFHGFBI type=del 2024-09-12T17:04:58.551 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.375+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=8RCIJVTLFGXT type=del size=4070957 2024-09-12T17:04:58.551 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.379+0000 7f026be9d8c0 1 < completed delete operation key=SL2446KSB531 tag=3LWB3FD1V2GQ type=del 2024-09-12T17:04:58.551 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.383+0000 7f026be9d8c0 1 > prepared operation key=SO3HLQZA8B6B tag=EMUX6U19D983 type=write size=358597 2024-09-12T17:04:58.551 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.387+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~7FQSKCL4QYLX.0 size=1048576 2024-09-12T17:04:58.551 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.391+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~7FQSKCL4QYLX.1 size=1048576 2024-09-12T17:04:58.551 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.391+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~7FQSKCL4QYLX.2 size=216876 2024-09-12T17:04:58.551 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.399+0000 7f026be9d8c0 1 < completed multipart upload key=XLKR6P8RNRVO upload=7FQSKCL4QYLX tag=03WUM1ZA7DBP type=write size=3362604 2024-09-12T17:04:58.552 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.407+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~E13LC9355SHY.0 size=1048576 2024-09-12T17:04:58.552 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.411+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~E13LC9355SHY.1 size=1048576 2024-09-12T17:04:58.552 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.411+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~E13LC9355SHY.2 size=253722 2024-09-12T17:04:58.552 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.411+0000 7f026be9d8c0 1 > prepared multipart upload key=32XUMOWT8HO2 upload=E13LC9355SHY tag=VXE2MR9Z2501 type=write size=3399450 2024-09-12T17:04:58.552 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.415+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~M69RBS4KYW4P.0 size=739816 2024-09-12T17:04:58.552 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.427+0000 7f026be9d8c0 1 < completed multipart upload key=ALFGNC1YNROX upload=M69RBS4KYW4P tag=R3C38A2MQ144 type=write size=1788392 2024-09-12T17:04:58.552 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.431+0000 7f026be9d8c0 1 > prepared operation key=GPUFWJ3AWEMX tag=3MUZSQ0HWFOC type=del size=2009839 2024-09-12T17:04:58.552 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.435+0000 7f026be9d8c0 1 < completed write operation key=4G3BKGNT3YZC tag=Q3G1U0XDJ0UC type=write size=575899 2024-09-12T17:04:58.552 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.439+0000 7f026be9d8c0 1 > prepared operation key=T6QRDTQRHBPI tag=BZLW3KMPEJH3 type=del size=1465853 2024-09-12T17:04:58.552 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.443+0000 7f026be9d8c0 1 < completed delete operation key=U8W1SAVSLTBF tag=B0H368VVC70R type=del 2024-09-12T17:04:58.552 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.447+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~KUSZ3O4NPYWI.0 size=707953 2024-09-12T17:04:58.552 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.447+0000 7f026be9d8c0 1 > prepared multipart upload key=ALFGNC1YNROX upload=KUSZ3O4NPYWI tag=63RPIR6V1V4Q type=write size=1756529 2024-09-12T17:04:58.552 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.451+0000 7f026be9d8c0 1 < completed delete operation key=SGT8IC1GJ3IG tag=KZ0QAGOPA4BN type=del 2024-09-12T17:04:58.553 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.455+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=0PFH3VAF2GXN type=write size=554881 2024-09-12T17:04:58.553 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.463+0000 7f026be9d8c0 1 < suggested update operation key=BW1T21LBUE2D tag=L488BZHLB1FO type=del size=1353397 2024-09-12T17:04:58.553 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.467+0000 7f026be9d8c0 1 > prepared operation key=JJMEQ2O00SA2 tag=IAK7EKEX5WET type=del size=3718885 2024-09-12T17:04:58.553 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.471+0000 7f026be9d8c0 1 < completed write operation key=XNBE2II106VZ tag=0XBRJSPRCWWO type=write size=30077 2024-09-12T17:04:58.553 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.475+0000 7f026be9d8c0 1 > prepared operation key=JJMEQ2O00SA2 tag=2K3KCZTWMV1K type=del size=3717823 2024-09-12T17:04:58.553 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.479+0000 7f026be9d8c0 1 < completed delete operation key=XLKR6P8RNRVO tag=B0TTCLFN446Y type=del 2024-09-12T17:04:58.553 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.483+0000 7f026be9d8c0 1 > prepared operation key=QVQ4TI319DH5 tag=W3BY9GMCDJ9R type=del size=1799208 2024-09-12T17:04:58.553 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.487+0000 7f026be9d8c0 1 < completed delete operation key=SL2446KSB531 tag=J0N1QKCPNZ5W type=del 2024-09-12T17:04:58.553 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.495+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~7J9YZO37XJ9P.0 size=1048576 2024-09-12T17:04:58.553 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.495+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~7J9YZO37XJ9P.1 size=694480 2024-09-12T17:04:58.553 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.495+0000 7f026be9d8c0 1 > prepared multipart upload key=Y27CDEOCM7DH upload=7J9YZO37XJ9P tag=R41UH0S9OJQT type=write size=2791632 2024-09-12T17:04:58.553 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.499+0000 7f026be9d8c0 1 < completed part key=_multipart_E0Y3SKNUYCQS.2~N8PVTSLPIB11.0 size=1048576 2024-09-12T17:04:58.553 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.503+0000 7f026be9d8c0 1 < completed part key=_multipart_E0Y3SKNUYCQS.2~N8PVTSLPIB11.1 size=710810 2024-09-12T17:04:58.553 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.511+0000 7f026be9d8c0 1 < completed multipart upload key=E0Y3SKNUYCQS upload=N8PVTSLPIB11 tag=0UPHY4RYATNE type=write size=2807962 2024-09-12T17:04:58.554 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.515+0000 7f026be9d8c0 1 > prepared operation key=UU88OS653L8D tag=07XWWDHYS55C type=del size=1482163 2024-09-12T17:04:58.554 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.519+0000 7f026be9d8c0 1 < completed delete operation key=T6QRDTQRHBPI tag=TV164VMNQHQH type=del 2024-09-12T17:04:58.555 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.523+0000 7f026be9d8c0 1 > prepared operation key=T6QRDTQRHBPI tag=KY7AA7ONP5IT type=del size=1741830 2024-09-12T17:04:58.555 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.523+0000 7f026be9d8c0 1 < canceled operation key=LHKLWIUAT08F tag=QVPQEU0FQP4F type=del size=2474304 2024-09-12T17:04:58.555 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.527+0000 7f026be9d8c0 1 > prepared operation key=QVQ4TI319DH5 tag=UE8P6K8XZ7WX type=write size=937649 2024-09-12T17:04:58.555 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.531+0000 7f026be9d8c0 1 < completed part key=_multipart_Z9YNIEQCVNBA.2~OMC16EBM1V83.0 size=480318 2024-09-12T17:04:58.555 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.539+0000 7f026be9d8c0 1 < completed multipart upload key=Z9YNIEQCVNBA upload=OMC16EBM1V83 tag=POE36LTZGFFD type=write size=1528894 2024-09-12T17:04:58.555 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.543+0000 7f026be9d8c0 1 > prepared operation key=XNBE2II106VZ tag=VMMNS25P0UCJ type=del size=3193120 2024-09-12T17:04:58.555 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.551+0000 7f026be9d8c0 1 < suggested update operation key=BBYDPSXZKHZP tag=48VGELFX3YU4 type=del size=3830343 2024-09-12T17:04:58.561 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.555+0000 7f026be9d8c0 1 > prepared part key=_multipart_PQSQ39X3O64P.2~XB3JLJ9P37U7.0 size=215646 2024-09-12T17:04:58.561 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.555+0000 7f026be9d8c0 1 > prepared multipart upload key=PQSQ39X3O64P upload=XB3JLJ9P37U7 tag=S9PCWRN44J32 type=write size=1264222 2024-09-12T17:04:58.564 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.559+0000 7f026be9d8c0 1 < completed delete operation key=U8W1SAVSLTBF tag=8RCIJVTLFGXT type=del 2024-09-12T17:04:58.569 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.563+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~4D8WPYXJLPX1.0 size=1048576 2024-09-12T17:04:58.572 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.567+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~4D8WPYXJLPX1.1 size=1048576 2024-09-12T17:04:58.575 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.571+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~4D8WPYXJLPX1.2 size=98294 2024-09-12T17:04:58.575 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.571+0000 7f026be9d8c0 1 > prepared multipart upload key=2BQJ30RQQ25L upload=4D8WPYXJLPX1 tag=3VFM0VY9VFBR type=write size=3244022 2024-09-12T17:04:58.578 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.575+0000 7f026be9d8c0 1 < completed write operation key=SO3HLQZA8B6B tag=EMUX6U19D983 type=write size=358597 2024-09-12T17:04:58.582 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.579+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=DJ34TE6O78T3 type=del size=961362 2024-09-12T17:04:58.585 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.579+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~E13LC9355SHY.0 size=1048576 2024-09-12T17:04:58.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.583+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~E13LC9355SHY.1 size=1048576 2024-09-12T17:04:58.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.583+0000 7f026be9d8c0 1 < canceled part key=_multipart_32XUMOWT8HO2.2~E13LC9355SHY.2 size=253722 2024-09-12T17:04:58.594 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.591+0000 7f026be9d8c0 1 < canceled multipart upload key=32XUMOWT8HO2 upload=E13LC9355SHY tag=VXE2MR9Z2501 type=write size=3399450 2024-09-12T17:04:58.601 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.595+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z183NH6R676V.2~AY171DQHFYTH.0 size=1048576 2024-09-12T17:04:58.603 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.599+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z183NH6R676V.2~AY171DQHFYTH.1 size=1048576 2024-09-12T17:04:58.606 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.603+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z183NH6R676V.2~AY171DQHFYTH.2 size=669881 2024-09-12T17:04:58.606 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.603+0000 7f026be9d8c0 1 > prepared multipart upload key=Z183NH6R676V upload=AY171DQHFYTH tag=1AEZIQ3IWQHV type=write size=3815609 2024-09-12T17:04:58.609 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.603+0000 7f026be9d8c0 1 < completed delete operation key=GPUFWJ3AWEMX tag=3MUZSQ0HWFOC type=del 2024-09-12T17:04:58.613 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.607+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=I4I4K5KMGR8L type=write size=491300 2024-09-12T17:04:58.616 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.611+0000 7f026be9d8c0 1 < completed delete operation key=T6QRDTQRHBPI tag=BZLW3KMPEJH3 type=del 2024-09-12T17:04:58.620 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.615+0000 7f026be9d8c0 1 > prepared operation key=GPUFWJ3AWEMX tag=Z1DFLMQMZGY1 type=del size=3199203 2024-09-12T17:04:58.623 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.619+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~KUSZ3O4NPYWI.0 size=707953 2024-09-12T17:04:58.629 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.623+0000 7f026be9d8c0 1 < completed multipart upload key=ALFGNC1YNROX upload=KUSZ3O4NPYWI tag=63RPIR6V1V4Q type=write size=1756529 2024-09-12T17:04:58.635 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.631+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z183NH6R676V.2~ZKDWCFMRDAL2.0 size=1048576 2024-09-12T17:04:58.637 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.631+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z183NH6R676V.2~ZKDWCFMRDAL2.1 size=1048576 2024-09-12T17:04:58.641 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.635+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z183NH6R676V.2~ZKDWCFMRDAL2.2 size=845794 2024-09-12T17:04:58.641 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.635+0000 7f026be9d8c0 1 > prepared multipart upload key=Z183NH6R676V upload=ZKDWCFMRDAL2 tag=5E8AT1P0GSXD type=write size=3991522 2024-09-12T17:04:58.648 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.643+0000 7f026be9d8c0 1 < suggested update operation key=21ZD52VBZIO4 tag=0PFH3VAF2GXN type=write size=554881 2024-09-12T17:04:58.654 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.647+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z183NH6R676V.2~B886DBI183TW.0 size=437987 2024-09-12T17:04:58.654 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.647+0000 7f026be9d8c0 1 > prepared multipart upload key=Z183NH6R676V upload=B886DBI183TW tag=XH6UWKKOH4XV type=write size=1486563 2024-09-12T17:04:58.660 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.655+0000 7f026be9d8c0 1 < suggested update operation key=JJMEQ2O00SA2 tag=IAK7EKEX5WET type=del size=3718885 2024-09-12T17:04:58.666 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.663+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~UN7F8QF1D0YA.0 size=1048576 2024-09-12T17:04:58.669 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.663+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~UN7F8QF1D0YA.1 size=1048576 2024-09-12T17:04:58.672 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.667+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~UN7F8QF1D0YA.2 size=249338 2024-09-12T17:04:58.672 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.667+0000 7f026be9d8c0 1 > prepared multipart upload key=J8MU1A0CWSAQ upload=UN7F8QF1D0YA tag=50FT0540YJHB type=write size=3395066 2024-09-12T17:04:58.676 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.671+0000 7f026be9d8c0 -1 < failed to complete operation key=JJMEQ2O00SA2 tag=2K3KCZTWMV1K type=del size=3717823: (22) Invalid argument 2024-09-12T17:04:58.680 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.675+0000 7f026be9d8c0 1 > prepared operation key=MVYWUWKSYQ9Z tag=NTSNMXNWZ242 type=write size=130878 2024-09-12T17:04:58.683 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.679+0000 7f026be9d8c0 1 < completed delete operation key=QVQ4TI319DH5 tag=W3BY9GMCDJ9R type=del 2024-09-12T17:04:58.689 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.683+0000 7f026be9d8c0 1 > prepared operation key=Y27CDEOCM7DH tag=CU12IBB22XH3 type=del size=3433294 2024-09-12T17:04:58.692 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.687+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~7J9YZO37XJ9P.0 size=1048576 2024-09-12T17:04:58.695 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.691+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~7J9YZO37XJ9P.1 size=694480 2024-09-12T17:04:58.700 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.695+0000 7f026be9d8c0 1 < completed multipart upload key=Y27CDEOCM7DH upload=7J9YZO37XJ9P tag=R41UH0S9OJQT type=write size=2791632 2024-09-12T17:04:58.705 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.699+0000 7f026be9d8c0 1 > prepared operation key=JJMEQ2O00SA2 tag=IRSY838WA7OC type=del size=499540 2024-09-12T17:04:58.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.703+0000 7f026be9d8c0 1 < completed delete operation key=UU88OS653L8D tag=07XWWDHYS55C type=del 2024-09-12T17:04:58.712 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.707+0000 7f026be9d8c0 1 > prepared operation key=4U1W97V0OX11 tag=76P4A79MVZGG type=del size=2558959 2024-09-12T17:04:58.716 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.711+0000 7f026be9d8c0 1 < completed delete operation key=T6QRDTQRHBPI tag=KY7AA7ONP5IT type=del 2024-09-12T17:04:58.721 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.715+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~PGR4I8MDB0ZF.0 size=589567 2024-09-12T17:04:58.722 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.715+0000 7f026be9d8c0 1 > prepared multipart upload key=2BQJ30RQQ25L upload=PGR4I8MDB0ZF tag=I6XKUWLE1WYA type=write size=1638143 2024-09-12T17:04:58.724 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.719+0000 7f026be9d8c0 1 < completed write operation key=QVQ4TI319DH5 tag=UE8P6K8XZ7WX type=write size=937649 2024-09-12T17:04:58.728 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.723+0000 7f026be9d8c0 1 > prepared operation key=E0Y3SKNUYCQS tag=U8F82N0OE71D type=write size=581999 2024-09-12T17:04:58.731 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.727+0000 7f026be9d8c0 1 < completed delete operation key=XNBE2II106VZ tag=VMMNS25P0UCJ type=del 2024-09-12T17:04:58.737 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.731+0000 7f026be9d8c0 1 > prepared part key=_multipart_SGT8IC1GJ3IG.2~0COUZBZR2JCP.0 size=1048576 2024-09-12T17:04:58.739 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.735+0000 7f026be9d8c0 1 > prepared part key=_multipart_SGT8IC1GJ3IG.2~0COUZBZR2JCP.1 size=485963 2024-09-12T17:04:58.739 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.735+0000 7f026be9d8c0 1 > prepared multipart upload key=SGT8IC1GJ3IG upload=0COUZBZR2JCP tag=2UC8F3USHI6U type=write size=2583115 2024-09-12T17:04:58.742 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.739+0000 7f026be9d8c0 1 < completed part key=_multipart_PQSQ39X3O64P.2~XB3JLJ9P37U7.0 size=215646 2024-09-12T17:04:58.747 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.743+0000 7f026be9d8c0 1 < completed multipart upload key=PQSQ39X3O64P upload=XB3JLJ9P37U7 tag=S9PCWRN44J32 type=write size=1264222 2024-09-12T17:04:58.750 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.747+0000 7f026be9d8c0 1 > prepared operation key=QVQ4TI319DH5 tag=9VGGGVULFZGC type=del size=3039701 2024-09-12T17:04:58.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.747+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~4D8WPYXJLPX1.0 size=1048576 2024-09-12T17:04:58.756 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.751+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~4D8WPYXJLPX1.1 size=1048576 2024-09-12T17:04:58.756 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.751+0000 7f026be9d8c0 1 < canceled part key=_multipart_2BQJ30RQQ25L.2~4D8WPYXJLPX1.2 size=98294 2024-09-12T17:04:58.763 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.759+0000 7f026be9d8c0 1 < canceled multipart upload key=2BQJ30RQQ25L upload=4D8WPYXJLPX1 tag=3VFM0VY9VFBR type=write size=3244022 2024-09-12T17:04:58.766 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.763+0000 7f026be9d8c0 1 > prepared operation key=MVYWUWKSYQ9Z tag=XXM95LFS0GDR type=del size=3174958 2024-09-12T17:04:58.770 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.767+0000 7f026be9d8c0 1 < completed delete operation key=3JADN360QEO3 tag=DJ34TE6O78T3 type=del 2024-09-12T17:04:58.776 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.771+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~S2TXYT42KY9A.0 size=1048576 2024-09-12T17:04:58.778 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.775+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~S2TXYT42KY9A.1 size=1048576 2024-09-12T17:04:58.781 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.775+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~S2TXYT42KY9A.2 size=388070 2024-09-12T17:04:58.781 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.775+0000 7f026be9d8c0 1 > prepared multipart upload key=JJMEQ2O00SA2 upload=S2TXYT42KY9A tag=378HH2M69Y7I type=write size=3533798 2024-09-12T17:04:58.784 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.779+0000 7f026be9d8c0 1 < completed part key=_multipart_Z183NH6R676V.2~AY171DQHFYTH.0 size=1048576 2024-09-12T17:04:58.787 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.783+0000 7f026be9d8c0 1 < completed part key=_multipart_Z183NH6R676V.2~AY171DQHFYTH.1 size=1048576 2024-09-12T17:04:58.789 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.783+0000 7f026be9d8c0 1 < completed part key=_multipart_Z183NH6R676V.2~AY171DQHFYTH.2 size=669881 2024-09-12T17:04:58.794 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.791+0000 7f026be9d8c0 1 < completed multipart upload key=Z183NH6R676V upload=AY171DQHFYTH tag=1AEZIQ3IWQHV type=write size=3815609 2024-09-12T17:04:58.798 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.795+0000 7f026be9d8c0 1 > prepared operation key=XLKR6P8RNRVO tag=E3BKY2X1YJG4 type=del size=3378408 2024-09-12T17:04:58.805 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.799+0000 7f026be9d8c0 1 < suggested update operation key=21ZD52VBZIO4 tag=I4I4K5KMGR8L type=write size=491300 2024-09-12T17:04:58.809 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.803+0000 7f026be9d8c0 1 > prepared operation key=4U1W97V0OX11 tag=ZOFDNI2F1U2C type=write size=259111 2024-09-12T17:04:58.815 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.811+0000 7f026be9d8c0 1 < suggested remove operation key=GPUFWJ3AWEMX tag=Z1DFLMQMZGY1 type=del 2024-09-12T17:04:58.818 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.815+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=1IEV3BN91357 type=write size=52301 2024-09-12T17:04:58.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.815+0000 7f026be9d8c0 1 < completed part key=_multipart_Z183NH6R676V.2~ZKDWCFMRDAL2.0 size=1048576 2024-09-12T17:04:58.824 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.819+0000 7f026be9d8c0 1 < completed part key=_multipart_Z183NH6R676V.2~ZKDWCFMRDAL2.1 size=1048576 2024-09-12T17:04:58.827 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.823+0000 7f026be9d8c0 1 < completed part key=_multipart_Z183NH6R676V.2~ZKDWCFMRDAL2.2 size=845794 2024-09-12T17:04:58.832 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.827+0000 7f026be9d8c0 1 < completed multipart upload key=Z183NH6R676V upload=ZKDWCFMRDAL2 tag=5E8AT1P0GSXD type=write size=3991522 2024-09-12T17:04:58.837 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.831+0000 7f026be9d8c0 1 > prepared part key=_multipart_T6QRDTQRHBPI.2~7Z8XWGWNLHQN.0 size=1048576 2024-09-12T17:04:58.839 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.835+0000 7f026be9d8c0 1 > prepared part key=_multipart_T6QRDTQRHBPI.2~7Z8XWGWNLHQN.1 size=1048576 2024-09-12T17:04:58.842 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.835+0000 7f026be9d8c0 1 > prepared part key=_multipart_T6QRDTQRHBPI.2~7Z8XWGWNLHQN.2 size=288273 2024-09-12T17:04:58.842 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.835+0000 7f026be9d8c0 1 > prepared multipart upload key=T6QRDTQRHBPI upload=7Z8XWGWNLHQN tag=DOKD3N9ILJXB type=write size=3434001 2024-09-12T17:04:58.844 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.839+0000 7f026be9d8c0 1 < completed part key=_multipart_Z183NH6R676V.2~B886DBI183TW.0 size=437987 2024-09-12T17:04:58.849 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.843+0000 7f026be9d8c0 1 < completed multipart upload key=Z183NH6R676V upload=B886DBI183TW tag=XH6UWKKOH4XV type=write size=1486563 2024-09-12T17:04:58.852 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.847+0000 7f026be9d8c0 1 > prepared operation key=Z9YNIEQCVNBA tag=NJ0TEMBBO773 type=del size=3612530 2024-09-12T17:04:58.855 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.851+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~UN7F8QF1D0YA.0 size=1048576 2024-09-12T17:04:58.857 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.851+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~UN7F8QF1D0YA.1 size=1048576 2024-09-12T17:04:58.860 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.855+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~UN7F8QF1D0YA.2 size=249338 2024-09-12T17:04:58.865 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.859+0000 7f026be9d8c0 1 < completed multipart upload key=J8MU1A0CWSAQ upload=UN7F8QF1D0YA tag=50FT0540YJHB type=write size=3395066 2024-09-12T17:04:58.869 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.863+0000 7f026be9d8c0 1 > prepared part key=_multipart_U8W1SAVSLTBF.2~3U6FW3B5RV9L.0 size=434603 2024-09-12T17:04:58.869 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.863+0000 7f026be9d8c0 1 > prepared multipart upload key=U8W1SAVSLTBF upload=3U6FW3B5RV9L tag=J5R6ZVJJ5EQR type=write size=1483179 2024-09-12T17:04:58.872 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.867+0000 7f026be9d8c0 1 < completed write operation key=MVYWUWKSYQ9Z tag=NTSNMXNWZ242 type=write size=130878 2024-09-12T17:04:58.874 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.871+0000 7f026be9d8c0 1 > prepared operation key=8AFDAVJLMRD2 tag=EXVN6T9RCKUM type=del size=3062938 2024-09-12T17:04:58.877 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.871+0000 7f026be9d8c0 1 < completed delete operation key=Y27CDEOCM7DH tag=CU12IBB22XH3 type=del 2024-09-12T17:04:58.880 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.875+0000 7f026be9d8c0 1 > prepared operation key=8AFDAVJLMRD2 tag=6639PZX014RO type=del size=1503082 2024-09-12T17:04:58.885 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.879+0000 7f026be9d8c0 1 < suggested remove operation key=JJMEQ2O00SA2 tag=IRSY838WA7OC type=del 2024-09-12T17:04:58.892 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.887+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~UCFL9HCMYJHK.0 size=1048576 2024-09-12T17:04:58.895 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.891+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~UCFL9HCMYJHK.1 size=1033307 2024-09-12T17:04:58.895 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.891+0000 7f026be9d8c0 1 > prepared multipart upload key=BW1T21LBUE2D upload=UCFL9HCMYJHK tag=GQVTTSXIJ05O type=write size=3130459 2024-09-12T17:04:58.898 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.895+0000 7f026be9d8c0 1 < completed delete operation key=4U1W97V0OX11 tag=76P4A79MVZGG type=del 2024-09-12T17:04:58.904 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.899+0000 7f026be9d8c0 1 > prepared part key=_multipart_MVYWUWKSYQ9Z.2~1J003NSI4M96.0 size=1048576 2024-09-12T17:04:58.908 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.903+0000 7f026be9d8c0 1 > prepared part key=_multipart_MVYWUWKSYQ9Z.2~1J003NSI4M96.1 size=1048576 2024-09-12T17:04:58.909 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.903+0000 7f026be9d8c0 1 > prepared part key=_multipart_MVYWUWKSYQ9Z.2~1J003NSI4M96.2 size=941341 2024-09-12T17:04:58.909 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.903+0000 7f026be9d8c0 1 > prepared multipart upload key=MVYWUWKSYQ9Z upload=1J003NSI4M96 tag=NP6GGTZEAYZ4 type=write size=4087069 2024-09-12T17:04:58.913 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.907+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~PGR4I8MDB0ZF.0 size=589567 2024-09-12T17:04:58.918 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.915+0000 7f026be9d8c0 1 < completed multipart upload key=2BQJ30RQQ25L upload=PGR4I8MDB0ZF tag=I6XKUWLE1WYA type=write size=1638143 2024-09-12T17:04:58.923 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.919+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~VTLB6QWR4H16.0 size=1048576 2024-09-12T17:04:58.925 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.919+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~VTLB6QWR4H16.1 size=1048576 2024-09-12T17:04:58.928 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.923+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~VTLB6QWR4H16.2 size=570523 2024-09-12T17:04:58.928 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.923+0000 7f026be9d8c0 1 > prepared multipart upload key=JJMEQ2O00SA2 upload=VTLB6QWR4H16 tag=BVY81OTV05JC type=write size=3716251 2024-09-12T17:04:58.931 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.927+0000 7f026be9d8c0 1 < completed write operation key=E0Y3SKNUYCQS tag=U8F82N0OE71D type=write size=581999 2024-09-12T17:04:58.937 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.931+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~VE7FROF2MIES.0 size=1048576 2024-09-12T17:04:58.939 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.935+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~VE7FROF2MIES.1 size=1048576 2024-09-12T17:04:58.942 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.935+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~VE7FROF2MIES.2 size=565634 2024-09-12T17:04:58.942 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.935+0000 7f026be9d8c0 1 > prepared multipart upload key=4G3BKGNT3YZC upload=VE7FROF2MIES tag=1OR51KCXZU2W type=write size=3711362 2024-09-12T17:04:58.944 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.939+0000 7f026be9d8c0 1 < completed part key=_multipart_SGT8IC1GJ3IG.2~0COUZBZR2JCP.0 size=1048576 2024-09-12T17:04:58.947 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.943+0000 7f026be9d8c0 1 < completed part key=_multipart_SGT8IC1GJ3IG.2~0COUZBZR2JCP.1 size=485963 2024-09-12T17:04:58.951 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.947+0000 7f026be9d8c0 1 < completed multipart upload key=SGT8IC1GJ3IG upload=0COUZBZR2JCP tag=2UC8F3USHI6U type=write size=2583115 2024-09-12T17:04:58.957 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.951+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~XY3JP6Q6DCL7.0 size=1048576 2024-09-12T17:04:58.959 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.955+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~XY3JP6Q6DCL7.1 size=401931 2024-09-12T17:04:58.959 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.955+0000 7f026be9d8c0 1 > prepared multipart upload key=UU88OS653L8D upload=XY3JP6Q6DCL7 tag=JV0GJ4A9VY19 type=write size=2499083 2024-09-12T17:04:58.962 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.959+0000 7f026be9d8c0 1 < completed delete operation key=QVQ4TI319DH5 tag=9VGGGVULFZGC type=del 2024-09-12T17:04:58.965 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.959+0000 7f026be9d8c0 1 > prepared operation key=Z9YNIEQCVNBA tag=K9ZZC1OG057Q type=del size=2421143 2024-09-12T17:04:58.967 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.963+0000 7f026be9d8c0 1 < completed delete operation key=MVYWUWKSYQ9Z tag=XXM95LFS0GDR type=del 2024-09-12T17:04:58.972 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.967+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~21DVJHFZNCTQ.0 size=454113 2024-09-12T17:04:58.972 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.967+0000 7f026be9d8c0 1 > prepared multipart upload key=6VO85REZG2NW upload=21DVJHFZNCTQ tag=1MURM1TIQ05L type=write size=1502689 2024-09-12T17:04:58.975 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.971+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~S2TXYT42KY9A.0 size=1048576 2024-09-12T17:04:58.978 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.971+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~S2TXYT42KY9A.1 size=1048576 2024-09-12T17:04:58.980 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.975+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~S2TXYT42KY9A.2 size=388070 2024-09-12T17:04:58.985 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.979+0000 7f026be9d8c0 1 < completed multipart upload key=JJMEQ2O00SA2 upload=S2TXYT42KY9A tag=378HH2M69Y7I type=write size=3533798 2024-09-12T17:04:58.989 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.983+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=M2000P2MFEAF type=del size=2920254 2024-09-12T17:04:58.992 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.987+0000 7f026be9d8c0 1 < completed delete operation key=XLKR6P8RNRVO tag=E3BKY2X1YJG4 type=del 2024-09-12T17:04:58.997 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.991+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~NFGV7PYRMOIP.0 size=625896 2024-09-12T17:04:58.997 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.991+0000 7f026be9d8c0 1 > prepared multipart upload key=Z9YNIEQCVNBA upload=NFGV7PYRMOIP tag=KOOOLOTYW7VZ type=write size=1674472 2024-09-12T17:04:59.000 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.995+0000 7f026be9d8c0 1 < completed write operation key=4U1W97V0OX11 tag=ZOFDNI2F1U2C type=write size=259111 2024-09-12T17:04:59.003 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.999+0000 7f026be9d8c0 1 > prepared operation key=32XUMOWT8HO2 tag=XER31ZTU36F3 type=del size=3216932 2024-09-12T17:04:59.005 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:58.999+0000 7f026be9d8c0 1 < completed write operation key=U8W1SAVSLTBF tag=1IEV3BN91357 type=write size=52301 2024-09-12T17:04:59.008 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.003+0000 7f026be9d8c0 1 > prepared operation key=SGT8IC1GJ3IG tag=A91KPHTB5MZ1 type=write size=573570 2024-09-12T17:04:59.010 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.007+0000 7f026be9d8c0 1 < completed part key=_multipart_T6QRDTQRHBPI.2~7Z8XWGWNLHQN.0 size=1048576 2024-09-12T17:04:59.011 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.007+0000 7f026be9d8c0 1 < canceled part key=_multipart_T6QRDTQRHBPI.2~7Z8XWGWNLHQN.1 size=1048576 2024-09-12T17:04:59.013 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.007+0000 7f026be9d8c0 1 < completed part key=_multipart_T6QRDTQRHBPI.2~7Z8XWGWNLHQN.2 size=288273 2024-09-12T17:04:59.017 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.011+0000 7f026be9d8c0 1 < canceled multipart upload key=T6QRDTQRHBPI upload=7Z8XWGWNLHQN tag=DOKD3N9ILJXB type=write size=3434001 2024-09-12T17:04:59.020 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.015+0000 7f026be9d8c0 1 > prepared operation key=Y27CDEOCM7DH tag=K6VOTED93933 type=del size=748356 2024-09-12T17:04:59.022 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.019+0000 7f026be9d8c0 1 < completed delete operation key=Z9YNIEQCVNBA tag=NJ0TEMBBO773 type=del 2024-09-12T17:04:59.026 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.019+0000 7f026be9d8c0 1 > prepared operation key=6VO85REZG2NW tag=I9FMAJ157733 type=del size=3062884 2024-09-12T17:04:59.029 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.023+0000 7f026be9d8c0 1 < completed part key=_multipart_U8W1SAVSLTBF.2~3U6FW3B5RV9L.0 size=434603 2024-09-12T17:04:59.033 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.027+0000 7f026be9d8c0 1 < completed multipart upload key=U8W1SAVSLTBF upload=3U6FW3B5RV9L tag=J5R6ZVJJ5EQR type=write size=1483179 2024-09-12T17:04:59.037 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.031+0000 7f026be9d8c0 1 > prepared operation key=SL2446KSB531 tag=O3NT0EP8EABB type=write size=742913 2024-09-12T17:04:59.042 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.039+0000 7f026be9d8c0 1 < suggested update operation key=8AFDAVJLMRD2 tag=EXVN6T9RCKUM type=del size=3062938 2024-09-12T17:04:59.045 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.039+0000 7f026be9d8c0 1 > prepared operation key=XLKR6P8RNRVO tag=225TR0EOC5HK type=del size=1727607 2024-09-12T17:04:59.052 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.047+0000 7f026be9d8c0 1 < suggested update operation key=8AFDAVJLMRD2 tag=6639PZX014RO type=del size=1503082 2024-09-12T17:04:59.055 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.051+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=9WMXCT97CC1P type=del size=2992570 2024-09-12T17:04:59.058 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.055+0000 7f026be9d8c0 1 < completed part key=_multipart_BW1T21LBUE2D.2~UCFL9HCMYJHK.0 size=1048576 2024-09-12T17:04:59.058 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.055+0000 7f026be9d8c0 1 < canceled part key=_multipart_BW1T21LBUE2D.2~UCFL9HCMYJHK.1 size=1033307 2024-09-12T17:04:59.062 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.059+0000 7f026be9d8c0 1 < canceled multipart upload key=BW1T21LBUE2D upload=UCFL9HCMYJHK tag=GQVTTSXIJ05O type=write size=3130459 2024-09-12T17:04:59.067 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.063+0000 7f026be9d8c0 1 > prepared part key=_multipart_PQSQ39X3O64P.2~LXOOY0L2KB3P.0 size=833336 2024-09-12T17:04:59.067 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.063+0000 7f026be9d8c0 1 > prepared multipart upload key=PQSQ39X3O64P upload=LXOOY0L2KB3P tag=AYZVMGNYNQM2 type=write size=1881912 2024-09-12T17:04:59.070 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.067+0000 7f026be9d8c0 1 < completed part key=_multipart_MVYWUWKSYQ9Z.2~1J003NSI4M96.0 size=1048576 2024-09-12T17:04:59.073 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.067+0000 7f026be9d8c0 1 < completed part key=_multipart_MVYWUWKSYQ9Z.2~1J003NSI4M96.1 size=1048576 2024-09-12T17:04:59.076 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.071+0000 7f026be9d8c0 1 < completed part key=_multipart_MVYWUWKSYQ9Z.2~1J003NSI4M96.2 size=941341 2024-09-12T17:04:59.082 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.079+0000 7f026be9d8c0 1 < completed multipart upload key=MVYWUWKSYQ9Z upload=1J003NSI4M96 tag=NP6GGTZEAYZ4 type=write size=4087069 2024-09-12T17:04:59.085 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.079+0000 7f026be9d8c0 1 > prepared operation key=BW1T21LBUE2D tag=W8GE2LPQAVBZ type=write size=413380 2024-09-12T17:04:59.089 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.083+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~VTLB6QWR4H16.0 size=1048576 2024-09-12T17:04:59.093 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.087+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~VTLB6QWR4H16.1 size=1048576 2024-09-12T17:04:59.095 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.091+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~VTLB6QWR4H16.2 size=570523 2024-09-12T17:04:59.101 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.095+0000 7f026be9d8c0 1 < completed multipart upload key=JJMEQ2O00SA2 upload=VTLB6QWR4H16 tag=BVY81OTV05JC type=write size=3716251 2024-09-12T17:04:59.106 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.103+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~A4TUTMXWGY6I.0 size=1048576 2024-09-12T17:04:59.109 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.103+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~A4TUTMXWGY6I.1 size=197756 2024-09-12T17:04:59.109 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.103+0000 7f026be9d8c0 1 > prepared multipart upload key=4G3BKGNT3YZC upload=A4TUTMXWGY6I tag=H2XEEV2VP362 type=write size=2294908 2024-09-12T17:04:59.112 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.107+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~VE7FROF2MIES.0 size=1048576 2024-09-12T17:04:59.112 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.107+0000 7f026be9d8c0 1 < canceled part key=_multipart_4G3BKGNT3YZC.2~VE7FROF2MIES.1 size=1048576 2024-09-12T17:04:59.115 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.111+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~VE7FROF2MIES.2 size=565634 2024-09-12T17:04:59.120 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.115+0000 7f026be9d8c0 1 < canceled multipart upload key=4G3BKGNT3YZC upload=VE7FROF2MIES tag=1OR51KCXZU2W type=write size=3711362 2024-09-12T17:04:59.126 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.123+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~LDCLQS2172DT.0 size=1048576 2024-09-12T17:04:59.129 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.123+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~LDCLQS2172DT.1 size=626189 2024-09-12T17:04:59.129 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.123+0000 7f026be9d8c0 1 > prepared multipart upload key=JJMEQ2O00SA2 upload=LDCLQS2172DT tag=BEM267HR51NJ type=write size=2723341 2024-09-12T17:04:59.132 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.127+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~XY3JP6Q6DCL7.0 size=1048576 2024-09-12T17:04:59.134 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.131+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~XY3JP6Q6DCL7.1 size=401931 2024-09-12T17:04:59.140 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.135+0000 7f026be9d8c0 1 < completed multipart upload key=UU88OS653L8D upload=XY3JP6Q6DCL7 tag=JV0GJ4A9VY19 type=write size=2499083 2024-09-12T17:04:59.145 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.139+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~SCY75N8STSY7.0 size=1048576 2024-09-12T17:04:59.148 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.143+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~SCY75N8STSY7.1 size=915486 2024-09-12T17:04:59.148 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.143+0000 7f026be9d8c0 1 > prepared multipart upload key=8AFDAVJLMRD2 upload=SCY75N8STSY7 tag=HW7I330P4B1S type=write size=3012638 2024-09-12T17:04:59.152 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.147+0000 7f026be9d8c0 1 < completed delete operation key=Z9YNIEQCVNBA tag=K9ZZC1OG057Q type=del 2024-09-12T17:04:59.155 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.151+0000 7f026be9d8c0 1 > prepared operation key=JJMEQ2O00SA2 tag=1GLLA79GWODJ type=del size=3985687 2024-09-12T17:04:59.159 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.155+0000 7f026be9d8c0 1 < completed part key=_multipart_6VO85REZG2NW.2~21DVJHFZNCTQ.0 size=454113 2024-09-12T17:04:59.164 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.159+0000 7f026be9d8c0 1 < completed multipart upload key=6VO85REZG2NW upload=21DVJHFZNCTQ tag=1MURM1TIQ05L type=write size=1502689 2024-09-12T17:04:59.171 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.167+0000 7f026be9d8c0 1 > prepared part key=_multipart_L194KQIPFLE1.2~JGTV659D9P1I.0 size=180476 2024-09-12T17:04:59.171 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.167+0000 7f026be9d8c0 1 > prepared multipart upload key=L194KQIPFLE1 upload=JGTV659D9P1I tag=1GDLOC0Z2B2V type=write size=1229052 2024-09-12T17:04:59.174 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.171+0000 7f026be9d8c0 1 < completed delete operation key=U8W1SAVSLTBF tag=M2000P2MFEAF type=del 2024-09-12T17:04:59.180 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.175+0000 7f026be9d8c0 1 > prepared part key=_multipart_LHKLWIUAT08F.2~LB1QNNAPT23H.0 size=1048576 2024-09-12T17:04:59.183 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.179+0000 7f026be9d8c0 1 > prepared part key=_multipart_LHKLWIUAT08F.2~LB1QNNAPT23H.1 size=1048576 2024-09-12T17:04:59.186 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.183+0000 7f026be9d8c0 1 > prepared part key=_multipart_LHKLWIUAT08F.2~LB1QNNAPT23H.2 size=78989 2024-09-12T17:04:59.186 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.183+0000 7f026be9d8c0 1 > prepared multipart upload key=LHKLWIUAT08F upload=LB1QNNAPT23H tag=4430VG274ONN type=write size=3224717 2024-09-12T17:04:59.189 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.183+0000 7f026be9d8c0 1 < completed part key=_multipart_Z9YNIEQCVNBA.2~NFGV7PYRMOIP.0 size=625896 2024-09-12T17:04:59.195 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.191+0000 7f026be9d8c0 1 < completed multipart upload key=Z9YNIEQCVNBA upload=NFGV7PYRMOIP tag=KOOOLOTYW7VZ type=write size=1674472 2024-09-12T17:04:59.202 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.195+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~ZSJAKL88XZT2.0 size=631409 2024-09-12T17:04:59.202 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.195+0000 7f026be9d8c0 1 > prepared multipart upload key=SL2446KSB531 upload=ZSJAKL88XZT2 tag=CG970B5WG3RZ type=write size=1679985 2024-09-12T17:04:59.205 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.199+0000 7f026be9d8c0 1 < completed delete operation key=32XUMOWT8HO2 tag=XER31ZTU36F3 type=del 2024-09-12T17:04:59.211 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.207+0000 7f026be9d8c0 1 > prepared part key=_multipart_PQSQ39X3O64P.2~16QJ7SRZNHLZ.0 size=692384 2024-09-12T17:04:59.211 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.207+0000 7f026be9d8c0 1 > prepared multipart upload key=PQSQ39X3O64P upload=16QJ7SRZNHLZ tag=C6ZBY6ZZCZYF type=write size=1740960 2024-09-12T17:04:59.214 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.211+0000 7f026be9d8c0 1 < completed write operation key=SGT8IC1GJ3IG tag=A91KPHTB5MZ1 type=write size=573570 2024-09-12T17:04:59.217 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.211+0000 7f026be9d8c0 1 > prepared operation key=BBYDPSXZKHZP tag=POAYCFY3PYD0 type=write size=1044249 2024-09-12T17:04:59.224 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.219+0000 7f026be9d8c0 1 < suggested remove operation key=Y27CDEOCM7DH tag=K6VOTED93933 type=del 2024-09-12T17:04:59.229 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.223+0000 7f026be9d8c0 1 > prepared part key=_multipart_21ZD52VBZIO4.2~3FBJ5I62G6XE.0 size=1048576 2024-09-12T17:04:59.232 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.227+0000 7f026be9d8c0 1 > prepared part key=_multipart_21ZD52VBZIO4.2~3FBJ5I62G6XE.1 size=226583 2024-09-12T17:04:59.232 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.227+0000 7f026be9d8c0 1 > prepared multipart upload key=21ZD52VBZIO4 upload=3FBJ5I62G6XE tag=47E8BC8QHWT9 type=write size=2323735 2024-09-12T17:04:59.238 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.231+0000 7f026be9d8c0 1 < suggested remove operation key=6VO85REZG2NW tag=I9FMAJ157733 type=del 2024-09-12T17:04:59.241 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.235+0000 7f026be9d8c0 1 > prepared operation key=6VO85REZG2NW tag=L6BMKPJ1SAVZ type=del size=1834676 2024-09-12T17:04:59.244 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.239+0000 7f026be9d8c0 1 < completed write operation key=SL2446KSB531 tag=O3NT0EP8EABB type=write size=742913 2024-09-12T17:04:59.247 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.243+0000 7f026be9d8c0 1 > prepared operation key=LHKLWIUAT08F tag=0XRQ4LKBNNEI type=write size=416758 2024-09-12T17:04:59.250 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.247+0000 7f026be9d8c0 1 < completed delete operation key=XLKR6P8RNRVO tag=225TR0EOC5HK type=del 2024-09-12T17:04:59.254 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.251+0000 7f026be9d8c0 1 > prepared operation key=2BQJ30RQQ25L tag=SE6J1XBXW6OA type=del size=539806 2024-09-12T17:04:59.257 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.251+0000 7f026be9d8c0 1 < completed delete operation key=21ZD52VBZIO4 tag=9WMXCT97CC1P type=del 2024-09-12T17:04:59.264 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.259+0000 7f026be9d8c0 1 > prepared part key=_multipart_LHKLWIUAT08F.2~ANQ63OXQ2MXJ.0 size=1048576 2024-09-12T17:04:59.266 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.263+0000 7f026be9d8c0 1 > prepared part key=_multipart_LHKLWIUAT08F.2~ANQ63OXQ2MXJ.1 size=1048576 2024-09-12T17:04:59.270 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.263+0000 7f026be9d8c0 1 > prepared part key=_multipart_LHKLWIUAT08F.2~ANQ63OXQ2MXJ.2 size=715175 2024-09-12T17:04:59.270 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.263+0000 7f026be9d8c0 1 > prepared multipart upload key=LHKLWIUAT08F upload=ANQ63OXQ2MXJ tag=2CK0UEF9LH7U type=write size=3860903 2024-09-12T17:04:59.273 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.267+0000 7f026be9d8c0 1 < completed part key=_multipart_PQSQ39X3O64P.2~LXOOY0L2KB3P.0 size=833336 2024-09-12T17:04:59.279 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.275+0000 7f026be9d8c0 1 < completed multipart upload key=PQSQ39X3O64P upload=LXOOY0L2KB3P tag=AYZVMGNYNQM2 type=write size=1881912 2024-09-12T17:04:59.285 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.279+0000 7f026be9d8c0 1 > prepared part key=_multipart_SO3HLQZA8B6B.2~D24RN90P06LS.0 size=1048576 2024-09-12T17:04:59.287 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.283+0000 7f026be9d8c0 1 > prepared part key=_multipart_SO3HLQZA8B6B.2~D24RN90P06LS.1 size=1048576 2024-09-12T17:04:59.290 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.287+0000 7f026be9d8c0 1 > prepared part key=_multipart_SO3HLQZA8B6B.2~D24RN90P06LS.2 size=933357 2024-09-12T17:04:59.290 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.287+0000 7f026be9d8c0 1 > prepared multipart upload key=SO3HLQZA8B6B upload=D24RN90P06LS tag=WD6FPLVSLOT0 type=write size=4079085 2024-09-12T17:04:59.293 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.287+0000 7f026be9d8c0 1 < completed write operation key=BW1T21LBUE2D tag=W8GE2LPQAVBZ type=write size=413380 2024-09-12T17:04:59.296 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.291+0000 7f026be9d8c0 1 > prepared operation key=6VO85REZG2NW tag=PURHD6LA37R3 type=write size=479454 2024-09-12T17:04:59.300 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.295+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~A4TUTMXWGY6I.0 size=1048576 2024-09-12T17:04:59.302 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.299+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~A4TUTMXWGY6I.1 size=197756 2024-09-12T17:04:59.307 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.303+0000 7f026be9d8c0 1 < completed multipart upload key=4G3BKGNT3YZC upload=A4TUTMXWGY6I tag=H2XEEV2VP362 type=write size=2294908 2024-09-12T17:04:59.313 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.307+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~GT21FV1O9QTW.0 size=1048576 2024-09-12T17:04:59.316 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.311+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~GT21FV1O9QTW.1 size=1048576 2024-09-12T17:04:59.318 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.311+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~GT21FV1O9QTW.2 size=194241 2024-09-12T17:04:59.318 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.311+0000 7f026be9d8c0 1 > prepared multipart upload key=32XUMOWT8HO2 upload=GT21FV1O9QTW tag=O63CCCFLHJ86 type=write size=3339969 2024-09-12T17:04:59.321 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.315+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~LDCLQS2172DT.0 size=1048576 2024-09-12T17:04:59.323 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.319+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~LDCLQS2172DT.1 size=626189 2024-09-12T17:04:59.328 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.323+0000 7f026be9d8c0 1 < completed multipart upload key=JJMEQ2O00SA2 upload=LDCLQS2172DT tag=BEM267HR51NJ type=write size=2723341 2024-09-12T17:04:59.334 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.331+0000 7f026be9d8c0 1 > prepared operation key=4U1W97V0OX11 tag=IZMPELGG2DEN type=del size=1556110 2024-09-12T17:04:59.337 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.331+0000 7f026be9d8c0 1 < completed part key=_multipart_8AFDAVJLMRD2.2~SCY75N8STSY7.0 size=1048576 2024-09-12T17:04:59.340 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.335+0000 7f026be9d8c0 1 < completed part key=_multipart_8AFDAVJLMRD2.2~SCY75N8STSY7.1 size=915486 2024-09-12T17:04:59.345 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.339+0000 7f026be9d8c0 1 < completed multipart upload key=8AFDAVJLMRD2 upload=SCY75N8STSY7 tag=HW7I330P4B1S type=write size=3012638 2024-09-12T17:04:59.348 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.343+0000 7f026be9d8c0 1 > prepared operation key=4U1W97V0OX11 tag=593CB3K0V0YQ type=del size=1463602 2024-09-12T17:04:59.351 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.347+0000 7f026be9d8c0 1 < completed delete operation key=JJMEQ2O00SA2 tag=1GLLA79GWODJ type=del 2024-09-12T17:04:59.354 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.351+0000 7f026be9d8c0 1 > prepared operation key=SL2446KSB531 tag=WX28LV8AMZ2P type=del size=2994582 2024-09-12T17:04:59.358 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.355+0000 7f026be9d8c0 1 < completed part key=_multipart_L194KQIPFLE1.2~JGTV659D9P1I.0 size=180476 2024-09-12T17:04:59.363 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.359+0000 7f026be9d8c0 1 < completed multipart upload key=L194KQIPFLE1 upload=JGTV659D9P1I tag=1GDLOC0Z2B2V type=write size=1229052 2024-09-12T17:04:59.369 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.363+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z183NH6R676V.2~C9GYDN3M5ECV.0 size=503652 2024-09-12T17:04:59.369 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.363+0000 7f026be9d8c0 1 > prepared multipart upload key=Z183NH6R676V upload=C9GYDN3M5ECV tag=075HFM9R3JVB type=write size=1552228 2024-09-12T17:04:59.372 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.367+0000 7f026be9d8c0 1 < completed part key=_multipart_LHKLWIUAT08F.2~LB1QNNAPT23H.0 size=1048576 2024-09-12T17:04:59.375 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.371+0000 7f026be9d8c0 1 < completed part key=_multipart_LHKLWIUAT08F.2~LB1QNNAPT23H.1 size=1048576 2024-09-12T17:04:59.378 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.371+0000 7f026be9d8c0 1 < completed part key=_multipart_LHKLWIUAT08F.2~LB1QNNAPT23H.2 size=78989 2024-09-12T17:04:59.383 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.379+0000 7f026be9d8c0 1 < completed multipart upload key=LHKLWIUAT08F upload=LB1QNNAPT23H tag=4430VG274ONN type=write size=3224717 2024-09-12T17:04:59.386 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.383+0000 7f026be9d8c0 1 > prepared operation key=2BQJ30RQQ25L tag=WWBVO0X6JZF7 type=del size=992400 2024-09-12T17:04:59.391 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.387+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~ZSJAKL88XZT2.0 size=631409 2024-09-12T17:04:59.396 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.391+0000 7f026be9d8c0 1 < completed multipart upload key=SL2446KSB531 upload=ZSJAKL88XZT2 tag=CG970B5WG3RZ type=write size=1679985 2024-09-12T17:04:59.399 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.395+0000 7f026be9d8c0 1 > prepared operation key=ALFGNC1YNROX tag=807ZB0OGG8O4 type=del size=2720842 2024-09-12T17:04:59.402 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.399+0000 7f026be9d8c0 1 < completed part key=_multipart_PQSQ39X3O64P.2~16QJ7SRZNHLZ.0 size=692384 2024-09-12T17:04:59.408 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.403+0000 7f026be9d8c0 1 < completed multipart upload key=PQSQ39X3O64P upload=16QJ7SRZNHLZ tag=C6ZBY6ZZCZYF type=write size=1740960 2024-09-12T17:04:59.411 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.407+0000 7f026be9d8c0 1 > prepared operation key=GPUFWJ3AWEMX tag=1AOHWQA5D6BT type=del size=2067627 2024-09-12T17:04:59.415 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.411+0000 7f026be9d8c0 1 < canceled operation key=BBYDPSXZKHZP tag=POAYCFY3PYD0 type=write size=1044249 2024-09-12T17:04:59.419 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.415+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=40YZZBY3D4M4 type=del size=3694104 2024-09-12T17:04:59.423 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.419+0000 7f026be9d8c0 1 < completed part key=_multipart_21ZD52VBZIO4.2~3FBJ5I62G6XE.0 size=1048576 2024-09-12T17:04:59.425 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.419+0000 7f026be9d8c0 1 < completed part key=_multipart_21ZD52VBZIO4.2~3FBJ5I62G6XE.1 size=226583 2024-09-12T17:04:59.431 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.427+0000 7f026be9d8c0 1 < completed multipart upload key=21ZD52VBZIO4 upload=3FBJ5I62G6XE tag=47E8BC8QHWT9 type=write size=2323735 2024-09-12T17:04:59.437 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.431+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~F8NHRUGM1D74.0 size=747689 2024-09-12T17:04:59.437 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.431+0000 7f026be9d8c0 1 > prepared multipart upload key=QVQ4TI319DH5 upload=F8NHRUGM1D74 tag=BJRQXYQDUOOQ type=write size=1796265 2024-09-12T17:04:59.441 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.435+0000 7f026be9d8c0 1 < completed delete operation key=6VO85REZG2NW tag=L6BMKPJ1SAVZ type=del 2024-09-12T17:04:59.444 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.439+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=13YOT5HNH57Z type=del size=730621 2024-09-12T17:04:59.447 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.443+0000 7f026be9d8c0 1 < completed write operation key=LHKLWIUAT08F tag=0XRQ4LKBNNEI type=write size=416758 2024-09-12T17:04:59.453 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.447+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~Z7A43LJIZF0Y.0 size=1048576 2024-09-12T17:04:59.455 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.451+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~Z7A43LJIZF0Y.1 size=1048576 2024-09-12T17:04:59.458 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.455+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~Z7A43LJIZF0Y.2 size=107916 2024-09-12T17:04:59.458 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.455+0000 7f026be9d8c0 1 > prepared multipart upload key=32XUMOWT8HO2 upload=Z7A43LJIZF0Y tag=JDQCMYI381FM type=write size=3253644 2024-09-12T17:04:59.465 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.459+0000 7f026be9d8c0 1 < suggested remove operation key=2BQJ30RQQ25L tag=SE6J1XBXW6OA type=del 2024-09-12T17:04:59.468 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.463+0000 7f026be9d8c0 1 > prepared operation key=Z9YNIEQCVNBA tag=KNC7FG3PBHY1 type=del size=607875 2024-09-12T17:04:59.469 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.463+0000 7f026be9d8c0 1 < canceled part key=_multipart_LHKLWIUAT08F.2~ANQ63OXQ2MXJ.0 size=1048576 2024-09-12T17:04:59.471 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.467+0000 7f026be9d8c0 1 < completed part key=_multipart_LHKLWIUAT08F.2~ANQ63OXQ2MXJ.1 size=1048576 2024-09-12T17:04:59.475 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.471+0000 7f026be9d8c0 1 < completed part key=_multipart_LHKLWIUAT08F.2~ANQ63OXQ2MXJ.2 size=715175 2024-09-12T17:04:59.480 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.475+0000 7f026be9d8c0 1 < canceled multipart upload key=LHKLWIUAT08F upload=ANQ63OXQ2MXJ tag=2CK0UEF9LH7U type=write size=3860903 2024-09-12T17:04:59.483 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.479+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=L4M5QOU7MZMM type=del size=943236 2024-09-12T17:04:59.487 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.483+0000 7f026be9d8c0 1 < completed part key=_multipart_SO3HLQZA8B6B.2~D24RN90P06LS.0 size=1048576 2024-09-12T17:04:59.489 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.483+0000 7f026be9d8c0 1 < completed part key=_multipart_SO3HLQZA8B6B.2~D24RN90P06LS.1 size=1048576 2024-09-12T17:04:59.492 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.487+0000 7f026be9d8c0 1 < completed part key=_multipart_SO3HLQZA8B6B.2~D24RN90P06LS.2 size=933357 2024-09-12T17:04:59.497 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.491+0000 7f026be9d8c0 1 < completed multipart upload key=SO3HLQZA8B6B upload=D24RN90P06LS tag=WD6FPLVSLOT0 type=write size=4079085 2024-09-12T17:04:59.501 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.495+0000 7f026be9d8c0 1 > prepared operation key=UU88OS653L8D tag=1XTDYLBI1XE5 type=write size=437231 2024-09-12T17:04:59.504 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.499+0000 7f026be9d8c0 1 < completed write operation key=6VO85REZG2NW tag=PURHD6LA37R3 type=write size=479454 2024-09-12T17:04:59.511 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.507+0000 7f026be9d8c0 1 > prepared part key=_multipart_L194KQIPFLE1.2~61JUQS0CVCGR.0 size=1048576 2024-09-12T17:04:59.514 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.511+0000 7f026be9d8c0 1 > prepared part key=_multipart_L194KQIPFLE1.2~61JUQS0CVCGR.1 size=1048576 2024-09-12T17:04:59.517 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.511+0000 7f026be9d8c0 1 > prepared part key=_multipart_L194KQIPFLE1.2~61JUQS0CVCGR.2 size=718088 2024-09-12T17:04:59.517 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.511+0000 7f026be9d8c0 1 > prepared multipart upload key=L194KQIPFLE1 upload=61JUQS0CVCGR tag=EHWL7MSZFZPH type=write size=3863816 2024-09-12T17:04:59.520 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.515+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~GT21FV1O9QTW.0 size=1048576 2024-09-12T17:04:59.523 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.519+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~GT21FV1O9QTW.1 size=1048576 2024-09-12T17:04:59.526 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.523+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~GT21FV1O9QTW.2 size=194241 2024-09-12T17:04:59.532 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.527+0000 7f026be9d8c0 1 < completed multipart upload key=32XUMOWT8HO2 upload=GT21FV1O9QTW tag=O63CCCFLHJ86 type=write size=3339969 2024-09-12T17:04:59.536 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.531+0000 7f026be9d8c0 1 > prepared operation key=SO3HLQZA8B6B tag=QV77Q1G16G0U type=del size=1365230 2024-09-12T17:04:59.539 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.535+0000 7f026be9d8c0 1 < completed delete operation key=4U1W97V0OX11 tag=IZMPELGG2DEN type=del 2024-09-12T17:04:59.543 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.539+0000 7f026be9d8c0 1 > prepared operation key=32XUMOWT8HO2 tag=1V0D6I57TTN5 type=write size=760488 2024-09-12T17:04:59.547 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.543+0000 7f026be9d8c0 1 < completed delete operation key=4U1W97V0OX11 tag=593CB3K0V0YQ type=del 2024-09-12T17:04:59.553 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.547+0000 7f026be9d8c0 1 > prepared part key=_multipart_XNBE2II106VZ.2~LR413RFQIJ5S.0 size=1048576 2024-09-12T17:04:59.556 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.551+0000 7f026be9d8c0 1 > prepared part key=_multipart_XNBE2II106VZ.2~LR413RFQIJ5S.1 size=1048576 2024-09-12T17:04:59.559 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.555+0000 7f026be9d8c0 1 > prepared part key=_multipart_XNBE2II106VZ.2~LR413RFQIJ5S.2 size=598217 2024-09-12T17:04:59.559 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.555+0000 7f026be9d8c0 1 > prepared multipart upload key=XNBE2II106VZ upload=LR413RFQIJ5S tag=6072E6DO5WT0 type=write size=3743945 2024-09-12T17:04:59.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.559+0000 7f026be9d8c0 1 < canceled operation key=SL2446KSB531 tag=WX28LV8AMZ2P type=del size=2994582 2024-09-12T17:04:59.566 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.559+0000 7f026be9d8c0 1 > prepared operation key=T6QRDTQRHBPI tag=BIDO91WU9N5R type=del size=1764724 2024-09-12T17:04:59.569 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.563+0000 7f026be9d8c0 1 < completed part key=_multipart_Z183NH6R676V.2~C9GYDN3M5ECV.0 size=503652 2024-09-12T17:04:59.576 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.571+0000 7f026be9d8c0 1 < completed multipart upload key=Z183NH6R676V upload=C9GYDN3M5ECV tag=075HFM9R3JVB type=write size=1552228 2024-09-12T17:04:59.579 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.575+0000 7f026be9d8c0 1 > prepared operation key=BW1T21LBUE2D tag=60L4E6VFLG1U type=del size=1534150 2024-09-12T17:04:59.582 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.579+0000 7f026be9d8c0 -1 < failed to complete operation key=2BQJ30RQQ25L tag=WWBVO0X6JZF7 type=del size=992400: (22) Invalid argument 2024-09-12T17:04:59.586 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.583+0000 7f026be9d8c0 1 > prepared operation key=T6QRDTQRHBPI tag=RZO7GZ6TMJID type=del size=1253499 2024-09-12T17:04:59.590 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.583+0000 7f026be9d8c0 1 < canceled operation key=ALFGNC1YNROX tag=807ZB0OGG8O4 type=del size=2720842 2024-09-12T17:04:59.593 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.587+0000 7f026be9d8c0 1 > prepared operation key=LHKLWIUAT08F tag=FV8E63H74I38 type=del size=1695830 2024-09-12T17:04:59.597 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.591+0000 7f026be9d8c0 1 < canceled operation key=GPUFWJ3AWEMX tag=1AOHWQA5D6BT type=del size=2067627 2024-09-12T17:04:59.601 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.595+0000 7f026be9d8c0 1 > prepared operation key=BW1T21LBUE2D tag=228GA9JAYJJR type=del size=2545366 2024-09-12T17:04:59.605 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.599+0000 7f026be9d8c0 1 < completed delete operation key=RBNN03IPZ8BT tag=40YZZBY3D4M4 type=del 2024-09-12T17:04:59.608 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.603+0000 7f026be9d8c0 1 > prepared operation key=Z183NH6R676V tag=H6GBUGBZX3BC type=write size=228839 2024-09-12T17:04:59.612 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.607+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~F8NHRUGM1D74.0 size=747689 2024-09-12T17:04:59.618 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.615+0000 7f026be9d8c0 1 < completed multipart upload key=QVQ4TI319DH5 upload=F8NHRUGM1D74 tag=BJRQXYQDUOOQ type=write size=1796265 2024-09-12T17:04:59.622 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.619+0000 7f026be9d8c0 1 > prepared operation key=PQSQ39X3O64P tag=2QVNIH6IJFZC type=del size=349809 2024-09-12T17:04:59.625 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.619+0000 7f026be9d8c0 1 < completed delete operation key=U8W1SAVSLTBF tag=13YOT5HNH57Z type=del 2024-09-12T17:04:59.629 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.623+0000 7f026be9d8c0 1 > prepared operation key=J8MU1A0CWSAQ tag=OUVLE8R2Y3LO type=del size=1383860 2024-09-12T17:04:59.633 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.627+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~Z7A43LJIZF0Y.0 size=1048576 2024-09-12T17:04:59.636 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.631+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~Z7A43LJIZF0Y.1 size=1048576 2024-09-12T17:04:59.640 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.635+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~Z7A43LJIZF0Y.2 size=107916 2024-09-12T17:04:59.646 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.643+0000 7f026be9d8c0 1 < completed multipart upload key=32XUMOWT8HO2 upload=Z7A43LJIZF0Y tag=JDQCMYI381FM type=write size=3253644 2024-09-12T17:04:59.650 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.643+0000 7f026be9d8c0 1 > prepared operation key=T6QRDTQRHBPI tag=UDOGGGV34EK8 type=del size=567838 2024-09-12T17:04:59.657 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.651+0000 7f026be9d8c0 1 < completed delete operation key=Z9YNIEQCVNBA tag=KNC7FG3PBHY1 type=del 2024-09-12T17:04:59.660 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.655+0000 7f026be9d8c0 1 > prepared operation key=ALFGNC1YNROX tag=B5Z903QB4942 type=del size=1214827 2024-09-12T17:04:59.664 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.659+0000 7f026be9d8c0 1 < completed delete operation key=RBNN03IPZ8BT tag=L4M5QOU7MZMM type=del 2024-09-12T17:04:59.672 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.667+0000 7f026be9d8c0 1 > prepared part key=_multipart_4U1W97V0OX11.2~T8PVA7RAH2RG.0 size=1048576 2024-09-12T17:04:59.674 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.671+0000 7f026be9d8c0 1 > prepared part key=_multipart_4U1W97V0OX11.2~T8PVA7RAH2RG.1 size=1048576 2024-09-12T17:04:59.677 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.671+0000 7f026be9d8c0 1 > prepared part key=_multipart_4U1W97V0OX11.2~T8PVA7RAH2RG.2 size=787980 2024-09-12T17:04:59.677 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.671+0000 7f026be9d8c0 1 > prepared multipart upload key=4U1W97V0OX11 upload=T8PVA7RAH2RG tag=CRDVKUQMGP2V type=write size=3933708 2024-09-12T17:04:59.681 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.675+0000 7f026be9d8c0 1 < completed write operation key=UU88OS653L8D tag=1XTDYLBI1XE5 type=write size=437231 2024-09-12T17:04:59.684 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.679+0000 7f026be9d8c0 1 > prepared operation key=BW1T21LBUE2D tag=0E91H92TSII1 type=del size=771536 2024-09-12T17:04:59.688 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.683+0000 7f026be9d8c0 1 < completed part key=_multipart_L194KQIPFLE1.2~61JUQS0CVCGR.0 size=1048576 2024-09-12T17:04:59.691 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.687+0000 7f026be9d8c0 1 < completed part key=_multipart_L194KQIPFLE1.2~61JUQS0CVCGR.1 size=1048576 2024-09-12T17:04:59.694 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.691+0000 7f026be9d8c0 1 < completed part key=_multipart_L194KQIPFLE1.2~61JUQS0CVCGR.2 size=718088 2024-09-12T17:04:59.702 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.695+0000 7f026be9d8c0 1 < completed multipart upload key=L194KQIPFLE1 upload=61JUQS0CVCGR tag=EHWL7MSZFZPH type=write size=3863816 2024-09-12T17:04:59.710 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.703+0000 7f026be9d8c0 1 > prepared part key=_multipart_U8W1SAVSLTBF.2~MVPTROI21Y6T.0 size=770705 2024-09-12T17:04:59.710 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.703+0000 7f026be9d8c0 1 > prepared multipart upload key=U8W1SAVSLTBF upload=MVPTROI21Y6T tag=JL71DS412I08 type=write size=1819281 2024-09-12T17:04:59.714 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.711+0000 7f026be9d8c0 1 < completed delete operation key=SO3HLQZA8B6B tag=QV77Q1G16G0U type=del 2024-09-12T17:04:59.720 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.715+0000 7f026be9d8c0 1 > prepared part key=_multipart_4U1W97V0OX11.2~7BC1GFU7G00T.0 size=1048576 2024-09-12T17:04:59.724 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.719+0000 7f026be9d8c0 1 > prepared part key=_multipart_4U1W97V0OX11.2~7BC1GFU7G00T.1 size=782682 2024-09-12T17:04:59.724 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.719+0000 7f026be9d8c0 1 > prepared multipart upload key=4U1W97V0OX11 upload=7BC1GFU7G00T tag=0XPWPJUE5XKT type=write size=2879834 2024-09-12T17:04:59.729 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.723+0000 7f026be9d8c0 1 < suggested remove operation key=32XUMOWT8HO2 tag=1V0D6I57TTN5 type=write 2024-09-12T17:04:59.736 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.731+0000 7f026be9d8c0 1 > prepared part key=_multipart_T6QRDTQRHBPI.2~QUVH0IB7C4LD.0 size=1048576 2024-09-12T17:04:59.739 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.735+0000 7f026be9d8c0 1 > prepared part key=_multipart_T6QRDTQRHBPI.2~QUVH0IB7C4LD.1 size=240094 2024-09-12T17:04:59.739 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.735+0000 7f026be9d8c0 1 > prepared multipart upload key=T6QRDTQRHBPI upload=QUVH0IB7C4LD tag=NHDVFV2QAM94 type=write size=2337246 2024-09-12T17:04:59.743 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.739+0000 7f026be9d8c0 1 < completed part key=_multipart_XNBE2II106VZ.2~LR413RFQIJ5S.0 size=1048576 2024-09-12T17:04:59.746 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.739+0000 7f026be9d8c0 1 < completed part key=_multipart_XNBE2II106VZ.2~LR413RFQIJ5S.1 size=1048576 2024-09-12T17:04:59.748 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.743+0000 7f026be9d8c0 1 < completed part key=_multipart_XNBE2II106VZ.2~LR413RFQIJ5S.2 size=598217 2024-09-12T17:04:59.755 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.751+0000 7f026be9d8c0 1 < completed multipart upload key=XNBE2II106VZ upload=LR413RFQIJ5S tag=6072E6DO5WT0 type=write size=3743945 2024-09-12T17:04:59.759 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.755+0000 7f026be9d8c0 1 > prepared operation key=4U1W97V0OX11 tag=1YS42MM0VLCC type=write size=215485 2024-09-12T17:04:59.762 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.759+0000 7f026be9d8c0 1 < completed delete operation key=T6QRDTQRHBPI tag=BIDO91WU9N5R type=del 2024-09-12T17:04:59.766 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.763+0000 7f026be9d8c0 1 > prepared operation key=UU88OS653L8D tag=CEELAC98HTL9 type=write size=302813 2024-09-12T17:04:59.770 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.763+0000 7f026be9d8c0 1 < canceled operation key=BW1T21LBUE2D tag=60L4E6VFLG1U type=del size=1534150 2024-09-12T17:04:59.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.767+0000 7f026be9d8c0 1 > prepared operation key=Z183NH6R676V tag=OFMN3E4LAX9S type=del size=1476181 2024-09-12T17:04:59.777 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.771+0000 7f026be9d8c0 1 < completed delete operation key=T6QRDTQRHBPI tag=RZO7GZ6TMJID type=del 2024-09-12T17:04:59.780 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.775+0000 7f026be9d8c0 1 > prepared operation key=4G3BKGNT3YZC tag=4FR6OWA0092B type=del size=1928047 2024-09-12T17:04:59.783 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.779+0000 7f026be9d8c0 1 < completed delete operation key=LHKLWIUAT08F tag=FV8E63H74I38 type=del 2024-09-12T17:04:59.787 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.783+0000 7f026be9d8c0 1 > prepared operation key=MVYWUWKSYQ9Z tag=Y131FLAE89I9 type=del size=2119307 2024-09-12T17:04:59.790 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.787+0000 7f026be9d8c0 1 < completed delete operation key=BW1T21LBUE2D tag=228GA9JAYJJR type=del 2024-09-12T17:04:59.797 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.791+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~HQ921R6PC2OE.0 size=1048576 2024-09-12T17:04:59.799 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.795+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~HQ921R6PC2OE.1 size=1048576 2024-09-12T17:04:59.802 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.799+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~HQ921R6PC2OE.2 size=739647 2024-09-12T17:04:59.802 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.799+0000 7f026be9d8c0 1 > prepared multipart upload key=J8MU1A0CWSAQ upload=HQ921R6PC2OE tag=11TX9EB98OTW type=write size=3885375 2024-09-12T17:04:59.806 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.799+0000 7f026be9d8c0 1 < completed write operation key=Z183NH6R676V tag=H6GBUGBZX3BC type=write size=228839 2024-09-12T17:04:59.813 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.807+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~41S8TRUMYUD9.0 size=1048576 2024-09-12T17:04:59.815 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.811+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~41S8TRUMYUD9.1 size=1048576 2024-09-12T17:04:59.817 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.811+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~41S8TRUMYUD9.2 size=232144 2024-09-12T17:04:59.817 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.811+0000 7f026be9d8c0 1 > prepared multipart upload key=JJMEQ2O00SA2 upload=41S8TRUMYUD9 tag=442RXPS0VFCU type=write size=3377872 2024-09-12T17:04:59.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.815+0000 7f026be9d8c0 1 < canceled operation key=PQSQ39X3O64P tag=2QVNIH6IJFZC type=del size=349809 2024-09-12T17:04:59.827 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.823+0000 7f026be9d8c0 1 > prepared part key=_multipart_21ZD52VBZIO4.2~6XISYD6OZDP0.0 size=1048576 2024-09-12T17:04:59.830 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.827+0000 7f026be9d8c0 1 > prepared part key=_multipart_21ZD52VBZIO4.2~6XISYD6OZDP0.1 size=1048576 2024-09-12T17:04:59.833 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.827+0000 7f026be9d8c0 1 > prepared part key=_multipart_21ZD52VBZIO4.2~6XISYD6OZDP0.2 size=719643 2024-09-12T17:04:59.834 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.827+0000 7f026be9d8c0 1 > prepared multipart upload key=21ZD52VBZIO4 upload=6XISYD6OZDP0 tag=7BTWNP3WSUI0 type=write size=3865371 2024-09-12T17:04:59.837 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.831+0000 7f026be9d8c0 1 < completed delete operation key=J8MU1A0CWSAQ tag=OUVLE8R2Y3LO type=del 2024-09-12T17:04:59.843 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.839+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~IH2SZCDST0WB.0 size=1048576 2024-09-12T17:04:59.846 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.839+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~IH2SZCDST0WB.1 size=1048576 2024-09-12T17:04:59.848 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.843+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~IH2SZCDST0WB.2 size=818500 2024-09-12T17:04:59.848 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.843+0000 7f026be9d8c0 1 > prepared multipart upload key=QVQ4TI319DH5 upload=IH2SZCDST0WB tag=H8O2CY7MVM8X type=write size=3964228 2024-09-12T17:04:59.852 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.847+0000 7f026be9d8c0 1 < canceled operation key=T6QRDTQRHBPI tag=UDOGGGV34EK8 type=del size=567838 2024-09-12T17:04:59.856 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.851+0000 7f026be9d8c0 1 > prepared operation key=J8MU1A0CWSAQ tag=I5K2YJ5SWT75 type=del size=692882 2024-09-12T17:04:59.859 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.855+0000 7f026be9d8c0 1 < canceled operation key=ALFGNC1YNROX tag=B5Z903QB4942 type=del size=1214827 2024-09-12T17:04:59.866 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.859+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~DTHBZCLW750R.0 size=1048576 2024-09-12T17:04:59.868 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.863+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~DTHBZCLW750R.1 size=1048576 2024-09-12T17:04:59.871 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.867+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~DTHBZCLW750R.2 size=657435 2024-09-12T17:04:59.871 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.867+0000 7f026be9d8c0 1 > prepared multipart upload key=J8MU1A0CWSAQ upload=DTHBZCLW750R tag=P27D3LKST0TR type=write size=3803163 2024-09-12T17:04:59.875 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.871+0000 7f026be9d8c0 1 < completed part key=_multipart_4U1W97V0OX11.2~T8PVA7RAH2RG.0 size=1048576 2024-09-12T17:04:59.878 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.871+0000 7f026be9d8c0 1 < completed part key=_multipart_4U1W97V0OX11.2~T8PVA7RAH2RG.1 size=1048576 2024-09-12T17:04:59.880 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.875+0000 7f026be9d8c0 1 < completed part key=_multipart_4U1W97V0OX11.2~T8PVA7RAH2RG.2 size=787980 2024-09-12T17:04:59.887 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.883+0000 7f026be9d8c0 1 < completed multipart upload key=4U1W97V0OX11 upload=T8PVA7RAH2RG tag=CRDVKUQMGP2V type=write size=3933708 2024-09-12T17:04:59.892 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.887+0000 7f026be9d8c0 1 > prepared operation key=GPUFWJ3AWEMX tag=M4HAW4W2JOEQ type=del size=2675169 2024-09-12T17:04:59.895 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.891+0000 7f026be9d8c0 1 < completed delete operation key=BW1T21LBUE2D tag=0E91H92TSII1 type=del 2024-09-12T17:04:59.899 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.895+0000 7f026be9d8c0 1 > prepared operation key=MVYWUWKSYQ9Z tag=QWIP89BOVHAA type=del size=4083995 2024-09-12T17:04:59.900 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.895+0000 7f026be9d8c0 1 < canceled part key=_multipart_U8W1SAVSLTBF.2~MVPTROI21Y6T.0 size=770705 2024-09-12T17:04:59.906 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.899+0000 7f026be9d8c0 1 < canceled multipart upload key=U8W1SAVSLTBF upload=MVPTROI21Y6T tag=JL71DS412I08 type=write size=1819281 2024-09-12T17:04:59.912 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.907+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~APRN6HIJ6Q2C.0 size=1048576 2024-09-12T17:04:59.914 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.911+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~APRN6HIJ6Q2C.1 size=1008482 2024-09-12T17:04:59.914 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.911+0000 7f026be9d8c0 1 > prepared multipart upload key=XLKR6P8RNRVO upload=APRN6HIJ6Q2C tag=PG4XJ4W3E4IP type=write size=3105634 2024-09-12T17:04:59.918 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.911+0000 7f026be9d8c0 1 < completed part key=_multipart_4U1W97V0OX11.2~7BC1GFU7G00T.0 size=1048576 2024-09-12T17:04:59.920 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.915+0000 7f026be9d8c0 1 < completed part key=_multipart_4U1W97V0OX11.2~7BC1GFU7G00T.1 size=782682 2024-09-12T17:04:59.926 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.923+0000 7f026be9d8c0 1 < completed multipart upload key=4U1W97V0OX11 upload=7BC1GFU7G00T tag=0XPWPJUE5XKT type=write size=2879834 2024-09-12T17:04:59.933 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.927+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~ELVQ0DSIH8YJ.0 size=1048576 2024-09-12T17:04:59.935 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.931+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~ELVQ0DSIH8YJ.1 size=1048576 2024-09-12T17:04:59.938 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.935+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~ELVQ0DSIH8YJ.2 size=621783 2024-09-12T17:04:59.938 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.935+0000 7f026be9d8c0 1 > prepared multipart upload key=32XUMOWT8HO2 upload=ELVQ0DSIH8YJ tag=UTLXIXLOBUEC type=write size=3767511 2024-09-12T17:04:59.942 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.939+0000 7f026be9d8c0 1 < completed part key=_multipart_T6QRDTQRHBPI.2~QUVH0IB7C4LD.0 size=1048576 2024-09-12T17:04:59.946 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.939+0000 7f026be9d8c0 1 < completed part key=_multipart_T6QRDTQRHBPI.2~QUVH0IB7C4LD.1 size=240094 2024-09-12T17:04:59.952 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.947+0000 7f026be9d8c0 1 < completed multipart upload key=T6QRDTQRHBPI upload=QUVH0IB7C4LD tag=NHDVFV2QAM94 type=write size=2337246 2024-09-12T17:04:59.960 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.955+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~VQNSXDNDWMIC.0 size=1048576 2024-09-12T17:04:59.962 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.959+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~VQNSXDNDWMIC.1 size=1048576 2024-09-12T17:04:59.965 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.959+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~VQNSXDNDWMIC.2 size=85146 2024-09-12T17:04:59.965 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.959+0000 7f026be9d8c0 1 > prepared multipart upload key=BW1T21LBUE2D upload=VQNSXDNDWMIC tag=MF95BWG2QDNU type=write size=3230874 2024-09-12T17:04:59.973 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.967+0000 7f026be9d8c0 1 < suggested update operation key=4U1W97V0OX11 tag=1YS42MM0VLCC type=write size=215485 2024-09-12T17:04:59.976 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.971+0000 7f026be9d8c0 1 > prepared operation key=SO3HLQZA8B6B tag=9VQ71UKJRJ0U type=write size=379367 2024-09-12T17:04:59.983 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.979+0000 7f026be9d8c0 1 < suggested update operation key=UU88OS653L8D tag=CEELAC98HTL9 type=write size=302813 2024-09-12T17:04:59.991 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.987+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~104MBSB6O9GM.0 size=1048576 2024-09-12T17:04:59.995 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.991+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~104MBSB6O9GM.1 size=260966 2024-09-12T17:04:59.995 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.991+0000 7f026be9d8c0 1 > prepared multipart upload key=4G3BKGNT3YZC upload=104MBSB6O9GM tag=UJ9QKYEC7VKF type=write size=2358118 2024-09-12T17:04:59.999 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.995+0000 7f026be9d8c0 1 < completed delete operation key=Z183NH6R676V tag=OFMN3E4LAX9S type=del 2024-09-12T17:05:00.002 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:04:59.999+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=USOSTQPHSN93 type=del size=2651279 2024-09-12T17:05:00.008 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.003+0000 7f026be9d8c0 1 < suggested update operation key=4G3BKGNT3YZC tag=4FR6OWA0092B type=del size=1928047 2024-09-12T17:05:00.012 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.007+0000 7f026be9d8c0 1 > prepared operation key=2BQJ30RQQ25L tag=AUJMA4SME3J0 type=del size=2101873 2024-09-12T17:05:00.015 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.011+0000 7f026be9d8c0 1 < completed delete operation key=MVYWUWKSYQ9Z tag=Y131FLAE89I9 type=del 2024-09-12T17:05:00.021 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.015+0000 7f026be9d8c0 1 > prepared part key=_multipart_LHKLWIUAT08F.2~VYU3V56IT410.0 size=742993 2024-09-12T17:05:00.021 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.015+0000 7f026be9d8c0 1 > prepared multipart upload key=LHKLWIUAT08F upload=VYU3V56IT410 tag=HG36ON9PFY66 type=write size=1791569 2024-09-12T17:05:00.024 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.019+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~HQ921R6PC2OE.0 size=1048576 2024-09-12T17:05:00.026 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.023+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~HQ921R6PC2OE.1 size=1048576 2024-09-12T17:05:00.029 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.023+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~HQ921R6PC2OE.2 size=739647 2024-09-12T17:05:00.034 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.031+0000 7f026be9d8c0 1 < completed multipart upload key=J8MU1A0CWSAQ upload=HQ921R6PC2OE tag=11TX9EB98OTW type=write size=3885375 2024-09-12T17:05:00.036 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.031+0000 7f026be9d8c0 1 > prepared operation key=Z183NH6R676V tag=JQHWA0ZFPYPJ type=del size=570929 2024-09-12T17:05:00.038 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.035+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~41S8TRUMYUD9.0 size=1048576 2024-09-12T17:05:00.040 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.035+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~41S8TRUMYUD9.1 size=1048576 2024-09-12T17:05:00.042 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.039+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~41S8TRUMYUD9.2 size=232144 2024-09-12T17:05:00.047 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.043+0000 7f026be9d8c0 1 < completed multipart upload key=JJMEQ2O00SA2 upload=41S8TRUMYUD9 tag=442RXPS0VFCU type=write size=3377872 2024-09-12T17:05:00.052 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.047+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~0VTM20QZXK7O.0 size=1048576 2024-09-12T17:05:00.054 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.051+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~0VTM20QZXK7O.1 size=1048576 2024-09-12T17:05:00.056 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.051+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~0VTM20QZXK7O.2 size=492885 2024-09-12T17:05:00.056 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.051+0000 7f026be9d8c0 1 > prepared multipart upload key=32XUMOWT8HO2 upload=0VTM20QZXK7O tag=YGPAYXVCERP9 type=write size=3638613 2024-09-12T17:05:00.059 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.055+0000 7f026be9d8c0 1 < completed part key=_multipart_21ZD52VBZIO4.2~6XISYD6OZDP0.0 size=1048576 2024-09-12T17:05:00.062 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.059+0000 7f026be9d8c0 1 < completed part key=_multipart_21ZD52VBZIO4.2~6XISYD6OZDP0.1 size=1048576 2024-09-12T17:05:00.062 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.059+0000 7f026be9d8c0 1 < canceled part key=_multipart_21ZD52VBZIO4.2~6XISYD6OZDP0.2 size=719643 2024-09-12T17:05:00.067 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.063+0000 7f026be9d8c0 1 < canceled multipart upload key=21ZD52VBZIO4 upload=6XISYD6OZDP0 tag=7BTWNP3WSUI0 type=write size=3865371 2024-09-12T17:05:00.073 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.067+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~4GI4EUBHCXKT.0 size=1048576 2024-09-12T17:05:00.076 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.071+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~4GI4EUBHCXKT.1 size=242542 2024-09-12T17:05:00.077 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.071+0000 7f026be9d8c0 1 > prepared multipart upload key=SL2446KSB531 upload=4GI4EUBHCXKT tag=SWM5BRH5JSDA type=write size=2339694 2024-09-12T17:05:00.077 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.071+0000 7f026be9d8c0 1 < canceled part key=_multipart_QVQ4TI319DH5.2~IH2SZCDST0WB.0 size=1048576 2024-09-12T17:05:00.077 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.071+0000 7f026be9d8c0 1 < canceled part key=_multipart_QVQ4TI319DH5.2~IH2SZCDST0WB.1 size=1048576 2024-09-12T17:05:00.080 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.075+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~IH2SZCDST0WB.2 size=818500 2024-09-12T17:05:00.086 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.083+0000 7f026be9d8c0 1 < canceled multipart upload key=QVQ4TI319DH5 upload=IH2SZCDST0WB tag=H8O2CY7MVM8X type=write size=3964228 2024-09-12T17:05:00.093 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.087+0000 7f026be9d8c0 1 > prepared part key=_multipart_21ZD52VBZIO4.2~72X2C43JXKMP.0 size=1048576 2024-09-12T17:05:00.096 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.091+0000 7f026be9d8c0 1 > prepared part key=_multipart_21ZD52VBZIO4.2~72X2C43JXKMP.1 size=405936 2024-09-12T17:05:00.096 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.091+0000 7f026be9d8c0 1 > prepared multipart upload key=21ZD52VBZIO4 upload=72X2C43JXKMP tag=YQKHY5L6VOGN type=write size=2503088 2024-09-12T17:05:00.100 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.095+0000 7f026be9d8c0 1 < completed delete operation key=J8MU1A0CWSAQ tag=I5K2YJ5SWT75 type=del 2024-09-12T17:05:00.103 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.099+0000 7f026be9d8c0 1 > prepared operation key=E0Y3SKNUYCQS tag=3BQ4D9PAUEKX type=del size=2002612 2024-09-12T17:05:00.107 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.103+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~DTHBZCLW750R.0 size=1048576 2024-09-12T17:05:00.110 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.107+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~DTHBZCLW750R.1 size=1048576 2024-09-12T17:05:00.113 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.107+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~DTHBZCLW750R.2 size=657435 2024-09-12T17:05:00.119 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.115+0000 7f026be9d8c0 1 < completed multipart upload key=J8MU1A0CWSAQ upload=DTHBZCLW750R tag=P27D3LKST0TR type=write size=3803163 2024-09-12T17:05:00.126 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.119+0000 7f026be9d8c0 1 > prepared part key=_multipart_RBNN03IPZ8BT.2~30D7QPMAUNOY.0 size=1048576 2024-09-12T17:05:00.128 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.123+0000 7f026be9d8c0 1 > prepared part key=_multipart_RBNN03IPZ8BT.2~30D7QPMAUNOY.1 size=1048576 2024-09-12T17:05:00.131 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.127+0000 7f026be9d8c0 1 > prepared part key=_multipart_RBNN03IPZ8BT.2~30D7QPMAUNOY.2 size=471496 2024-09-12T17:05:00.131 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.127+0000 7f026be9d8c0 1 > prepared multipart upload key=RBNN03IPZ8BT upload=30D7QPMAUNOY tag=BNULCYQHIX2N type=write size=3617224 2024-09-12T17:05:00.138 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.131+0000 7f026be9d8c0 1 < suggested remove operation key=GPUFWJ3AWEMX tag=M4HAW4W2JOEQ type=del 2024-09-12T17:05:00.141 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.135+0000 7f026be9d8c0 1 > prepared operation key=Z183NH6R676V tag=P8THQE7NNKAS type=del size=3133119 2024-09-12T17:05:00.147 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.143+0000 7f026be9d8c0 1 < suggested remove operation key=MVYWUWKSYQ9Z tag=QWIP89BOVHAA type=del 2024-09-12T17:05:00.153 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.147+0000 7f026be9d8c0 1 > prepared part key=_multipart_RBNN03IPZ8BT.2~0TG7SXVB8EQQ.0 size=846460 2024-09-12T17:05:00.153 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.147+0000 7f026be9d8c0 1 > prepared multipart upload key=RBNN03IPZ8BT upload=0TG7SXVB8EQQ tag=MZTZXB1MLPNH type=write size=1895036 2024-09-12T17:05:00.156 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.151+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~APRN6HIJ6Q2C.0 size=1048576 2024-09-12T17:05:00.159 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.155+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~APRN6HIJ6Q2C.1 size=1008482 2024-09-12T17:05:00.165 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.159+0000 7f026be9d8c0 1 < completed multipart upload key=XLKR6P8RNRVO upload=APRN6HIJ6Q2C tag=PG4XJ4W3E4IP type=write size=3105634 2024-09-12T17:05:00.172 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.167+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~WV7RJ8O5SZCQ.0 size=1048576 2024-09-12T17:05:00.174 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.171+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~WV7RJ8O5SZCQ.1 size=986023 2024-09-12T17:05:00.174 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.171+0000 7f026be9d8c0 1 > prepared multipart upload key=ALFGNC1YNROX upload=WV7RJ8O5SZCQ tag=G56TEZ0BA0YW type=write size=3083175 2024-09-12T17:05:00.177 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.171+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~ELVQ0DSIH8YJ.0 size=1048576 2024-09-12T17:05:00.180 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.175+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~ELVQ0DSIH8YJ.1 size=1048576 2024-09-12T17:05:00.182 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.179+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~ELVQ0DSIH8YJ.2 size=621783 2024-09-12T17:05:00.188 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.183+0000 7f026be9d8c0 1 < completed multipart upload key=32XUMOWT8HO2 upload=ELVQ0DSIH8YJ tag=UTLXIXLOBUEC type=write size=3767511 2024-09-12T17:05:00.195 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.191+0000 7f026be9d8c0 1 > prepared part key=_multipart_RBNN03IPZ8BT.2~ZZ0577AZ5F61.0 size=1048576 2024-09-12T17:05:00.198 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.191+0000 7f026be9d8c0 1 > prepared part key=_multipart_RBNN03IPZ8BT.2~ZZ0577AZ5F61.1 size=1048576 2024-09-12T17:05:00.201 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.195+0000 7f026be9d8c0 1 > prepared part key=_multipart_RBNN03IPZ8BT.2~ZZ0577AZ5F61.2 size=932830 2024-09-12T17:05:00.201 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.195+0000 7f026be9d8c0 1 > prepared multipart upload key=RBNN03IPZ8BT upload=ZZ0577AZ5F61 tag=JINTW5S08DEW type=write size=4078558 2024-09-12T17:05:00.206 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.199+0000 7f026be9d8c0 1 < completed part key=_multipart_BW1T21LBUE2D.2~VQNSXDNDWMIC.0 size=1048576 2024-09-12T17:05:00.208 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.203+0000 7f026be9d8c0 1 < completed part key=_multipart_BW1T21LBUE2D.2~VQNSXDNDWMIC.1 size=1048576 2024-09-12T17:05:00.212 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.207+0000 7f026be9d8c0 1 < completed part key=_multipart_BW1T21LBUE2D.2~VQNSXDNDWMIC.2 size=85146 2024-09-12T17:05:00.217 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.211+0000 7f026be9d8c0 1 < completed multipart upload key=BW1T21LBUE2D upload=VQNSXDNDWMIC tag=MF95BWG2QDNU type=write size=3230874 2024-09-12T17:05:00.221 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.215+0000 7f026be9d8c0 1 > prepared operation key=XLKR6P8RNRVO tag=XMHKHW67YW39 type=del size=2126200 2024-09-12T17:05:00.227 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.223+0000 7f026be9d8c0 1 < suggested remove operation key=SO3HLQZA8B6B tag=9VQ71UKJRJ0U type=write 2024-09-12T17:05:00.230 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.223+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=65JEVWH5A9YV type=del size=2969978 2024-09-12T17:05:00.233 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.227+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~104MBSB6O9GM.0 size=1048576 2024-09-12T17:05:00.236 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.231+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~104MBSB6O9GM.1 size=260966 2024-09-12T17:05:00.241 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.235+0000 7f026be9d8c0 1 < completed multipart upload key=4G3BKGNT3YZC upload=104MBSB6O9GM tag=UJ9QKYEC7VKF type=write size=2358118 2024-09-12T17:05:00.247 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.243+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~BSJOHKBIUD9X.0 size=283449 2024-09-12T17:05:00.247 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.243+0000 7f026be9d8c0 1 > prepared multipart upload key=SL2446KSB531 upload=BSJOHKBIUD9X tag=QJL1MD9J5BFB type=write size=1332025 2024-09-12T17:05:00.252 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.247+0000 7f026be9d8c0 1 < suggested update operation key=21ZD52VBZIO4 tag=USOSTQPHSN93 type=del size=2651279 2024-09-12T17:05:00.256 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.251+0000 7f026be9d8c0 1 > prepared operation key=Y27CDEOCM7DH tag=ANEZJ43T80LU type=del size=439708 2024-09-12T17:05:00.259 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.255+0000 7f026be9d8c0 1 < completed delete operation key=2BQJ30RQQ25L tag=AUJMA4SME3J0 type=del 2024-09-12T17:05:00.262 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.255+0000 7f026be9d8c0 1 > prepared operation key=XLKR6P8RNRVO tag=2WXJRI6535R2 type=del size=2913058 2024-09-12T17:05:00.265 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.259+0000 7f026be9d8c0 1 < completed part key=_multipart_LHKLWIUAT08F.2~VYU3V56IT410.0 size=742993 2024-09-12T17:05:00.269 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.263+0000 7f026be9d8c0 1 < completed multipart upload key=LHKLWIUAT08F upload=VYU3V56IT410 tag=HG36ON9PFY66 type=write size=1791569 2024-09-12T17:05:00.275 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.271+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~UGFK0POXT30G.0 size=178843 2024-09-12T17:05:00.275 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.271+0000 7f026be9d8c0 1 > prepared multipart upload key=ALFGNC1YNROX upload=UGFK0POXT30G tag=C4T2Q28TEGJU type=write size=1227419 2024-09-12T17:05:00.278 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.275+0000 7f026be9d8c0 1 < completed delete operation key=Z183NH6R676V tag=JQHWA0ZFPYPJ type=del 2024-09-12T17:05:00.281 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.275+0000 7f026be9d8c0 1 > prepared operation key=4U1W97V0OX11 tag=O5S50UEDLIOJ type=del size=1353821 2024-09-12T17:05:00.288 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.283+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~0VTM20QZXK7O.0 size=1048576 2024-09-12T17:05:00.290 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.287+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~0VTM20QZXK7O.1 size=1048576 2024-09-12T17:05:00.293 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.287+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~0VTM20QZXK7O.2 size=492885 2024-09-12T17:05:00.298 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.295+0000 7f026be9d8c0 1 < completed multipart upload key=32XUMOWT8HO2 upload=0VTM20QZXK7O tag=YGPAYXVCERP9 type=write size=3638613 2024-09-12T17:05:00.302 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.295+0000 7f026be9d8c0 1 > prepared operation key=4U1W97V0OX11 tag=E1X8LU6VF3BQ type=del size=1504857 2024-09-12T17:05:00.305 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.299+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~4GI4EUBHCXKT.0 size=1048576 2024-09-12T17:05:00.308 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.303+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~4GI4EUBHCXKT.1 size=242542 2024-09-12T17:05:00.313 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.307+0000 7f026be9d8c0 1 < completed multipart upload key=SL2446KSB531 upload=4GI4EUBHCXKT tag=SWM5BRH5JSDA type=write size=2339694 2024-09-12T17:05:00.316 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.311+0000 7f026be9d8c0 1 > prepared operation key=ALFGNC1YNROX tag=FC93W9DYGFST type=write size=591306 2024-09-12T17:05:00.319 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.315+0000 7f026be9d8c0 1 < completed part key=_multipart_21ZD52VBZIO4.2~72X2C43JXKMP.0 size=1048576 2024-09-12T17:05:00.322 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.315+0000 7f026be9d8c0 1 < completed part key=_multipart_21ZD52VBZIO4.2~72X2C43JXKMP.1 size=405936 2024-09-12T17:05:00.327 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.323+0000 7f026be9d8c0 1 < completed multipart upload key=21ZD52VBZIO4 upload=72X2C43JXKMP tag=YQKHY5L6VOGN type=write size=2503088 2024-09-12T17:05:00.331 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.327+0000 7f026be9d8c0 1 > prepared operation key=JJMEQ2O00SA2 tag=PT3BA0TIAN2B type=del size=2935054 2024-09-12T17:05:00.334 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.331+0000 7f026be9d8c0 1 < canceled operation key=E0Y3SKNUYCQS tag=3BQ4D9PAUEKX type=del size=2002612 2024-09-12T17:05:00.338 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.335+0000 7f026be9d8c0 1 > prepared operation key=2BQJ30RQQ25L tag=EM7368061X09 type=del size=3000855 2024-09-12T17:05:00.341 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.335+0000 7f026be9d8c0 1 < completed part key=_multipart_RBNN03IPZ8BT.2~30D7QPMAUNOY.0 size=1048576 2024-09-12T17:05:00.342 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.335+0000 7f026be9d8c0 1 < canceled part key=_multipart_RBNN03IPZ8BT.2~30D7QPMAUNOY.1 size=1048576 2024-09-12T17:05:00.342 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.335+0000 7f026be9d8c0 1 < canceled part key=_multipart_RBNN03IPZ8BT.2~30D7QPMAUNOY.2 size=471496 2024-09-12T17:05:00.347 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.343+0000 7f026be9d8c0 1 < canceled multipart upload key=RBNN03IPZ8BT upload=30D7QPMAUNOY tag=BNULCYQHIX2N type=write size=3617224 2024-09-12T17:05:00.353 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.347+0000 7f026be9d8c0 1 > prepared part key=_multipart_XNBE2II106VZ.2~Q3PY2C0VDVY6.0 size=1048576 2024-09-12T17:05:00.355 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.351+0000 7f026be9d8c0 1 > prepared part key=_multipart_XNBE2II106VZ.2~Q3PY2C0VDVY6.1 size=1048576 2024-09-12T17:05:00.358 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.351+0000 7f026be9d8c0 1 > prepared part key=_multipart_XNBE2II106VZ.2~Q3PY2C0VDVY6.2 size=1012096 2024-09-12T17:05:00.358 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.351+0000 7f026be9d8c0 1 > prepared multipart upload key=XNBE2II106VZ upload=Q3PY2C0VDVY6 tag=22S3GI9LAP9T type=write size=4157824 2024-09-12T17:05:00.364 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.359+0000 7f026be9d8c0 1 < suggested remove operation key=Z183NH6R676V tag=P8THQE7NNKAS type=del 2024-09-12T17:05:00.367 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.363+0000 7f026be9d8c0 1 > prepared operation key=SL2446KSB531 tag=P3E57UT6P42W type=del size=2692207 2024-09-12T17:05:00.370 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.367+0000 7f026be9d8c0 1 < completed part key=_multipart_RBNN03IPZ8BT.2~0TG7SXVB8EQQ.0 size=846460 2024-09-12T17:05:00.375 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.371+0000 7f026be9d8c0 1 < completed multipart upload key=RBNN03IPZ8BT upload=0TG7SXVB8EQQ tag=MZTZXB1MLPNH type=write size=1895036 2024-09-12T17:05:00.381 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.375+0000 7f026be9d8c0 1 > prepared part key=_multipart_E0Y3SKNUYCQS.2~3CLSW4JM7SOT.0 size=526810 2024-09-12T17:05:00.381 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.375+0000 7f026be9d8c0 1 > prepared multipart upload key=E0Y3SKNUYCQS upload=3CLSW4JM7SOT tag=IJE1EWWUIN9E type=write size=1575386 2024-09-12T17:05:00.384 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.379+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~WV7RJ8O5SZCQ.0 size=1048576 2024-09-12T17:05:00.384 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.379+0000 7f026be9d8c0 1 < canceled part key=_multipart_ALFGNC1YNROX.2~WV7RJ8O5SZCQ.1 size=986023 2024-09-12T17:05:00.389 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.383+0000 7f026be9d8c0 1 < canceled multipart upload key=ALFGNC1YNROX upload=WV7RJ8O5SZCQ tag=G56TEZ0BA0YW type=write size=3083175 2024-09-12T17:05:00.392 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.387+0000 7f026be9d8c0 1 > prepared operation key=BBYDPSXZKHZP tag=3WZ2HS96JXR9 type=del size=4027504 2024-09-12T17:05:00.392 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.387+0000 7f026be9d8c0 1 < canceled part key=_multipart_RBNN03IPZ8BT.2~ZZ0577AZ5F61.0 size=1048576 2024-09-12T17:05:00.392 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.387+0000 7f026be9d8c0 1 < canceled part key=_multipart_RBNN03IPZ8BT.2~ZZ0577AZ5F61.1 size=1048576 2024-09-12T17:05:00.394 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.391+0000 7f026be9d8c0 1 < completed part key=_multipart_RBNN03IPZ8BT.2~ZZ0577AZ5F61.2 size=932830 2024-09-12T17:05:00.399 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.395+0000 7f026be9d8c0 1 < canceled multipart upload key=RBNN03IPZ8BT upload=ZZ0577AZ5F61 tag=JINTW5S08DEW type=write size=4078558 2024-09-12T17:05:00.402 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.399+0000 7f026be9d8c0 1 > prepared operation key=MVYWUWKSYQ9Z tag=9QH45NL3NC8F type=del size=2576941 2024-09-12T17:05:00.405 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.399+0000 7f026be9d8c0 1 < completed delete operation key=XLKR6P8RNRVO tag=XMHKHW67YW39 type=del 2024-09-12T17:05:00.409 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.403+0000 7f026be9d8c0 1 > prepared operation key=MVYWUWKSYQ9Z tag=V4QBB5CF4NLY type=del size=1394383 2024-09-12T17:05:00.412 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.407+0000 7f026be9d8c0 1 < completed delete operation key=U8W1SAVSLTBF tag=65JEVWH5A9YV type=del 2024-09-12T17:05:00.415 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.411+0000 7f026be9d8c0 1 > prepared operation key=UU88OS653L8D tag=JR450NOONP6C type=del size=860515 2024-09-12T17:05:00.419 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.415+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~BSJOHKBIUD9X.0 size=283449 2024-09-12T17:05:00.424 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.419+0000 7f026be9d8c0 1 < completed multipart upload key=SL2446KSB531 upload=BSJOHKBIUD9X tag=QJL1MD9J5BFB type=write size=1332025 2024-09-12T17:05:00.430 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.427+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~UVYO9150X03Z.0 size=837670 2024-09-12T17:05:00.430 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.427+0000 7f026be9d8c0 1 > prepared multipart upload key=JJMEQ2O00SA2 upload=UVYO9150X03Z tag=B9YQMQG7A8EI type=write size=1886246 2024-09-12T17:05:00.433 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.427+0000 7f026be9d8c0 1 < completed delete operation key=Y27CDEOCM7DH tag=ANEZJ43T80LU type=del 2024-09-12T17:05:00.439 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.435+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~GD64O432BIQ9.0 size=1048576 2024-09-12T17:05:00.442 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.439+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~GD64O432BIQ9.1 size=1035255 2024-09-12T17:05:00.442 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.439+0000 7f026be9d8c0 1 > prepared multipart upload key=6VO85REZG2NW upload=GD64O432BIQ9 tag=F79C0NZAO0NW type=write size=3132407 2024-09-12T17:05:00.445 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.439+0000 7f026be9d8c0 1 < completed delete operation key=XLKR6P8RNRVO tag=2WXJRI6535R2 type=del 2024-09-12T17:05:00.452 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.447+0000 7f026be9d8c0 1 > prepared part key=_multipart_SO3HLQZA8B6B.2~BRD5621PDAN8.0 size=1048576 2024-09-12T17:05:00.454 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.451+0000 7f026be9d8c0 1 > prepared part key=_multipart_SO3HLQZA8B6B.2~BRD5621PDAN8.1 size=1048576 2024-09-12T17:05:00.457 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.451+0000 7f026be9d8c0 1 > prepared part key=_multipart_SO3HLQZA8B6B.2~BRD5621PDAN8.2 size=40723 2024-09-12T17:05:00.457 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.451+0000 7f026be9d8c0 1 > prepared multipart upload key=SO3HLQZA8B6B upload=BRD5621PDAN8 tag=RWBKKLTBGS39 type=write size=3186451 2024-09-12T17:05:00.461 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.455+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~UGFK0POXT30G.0 size=178843 2024-09-12T17:05:00.466 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.463+0000 7f026be9d8c0 1 < completed multipart upload key=ALFGNC1YNROX upload=UGFK0POXT30G tag=C4T2Q28TEGJU type=write size=1227419 2024-09-12T17:05:00.470 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.463+0000 7f026be9d8c0 1 > prepared operation key=6VO85REZG2NW tag=Q9E6GVQO1PNI type=del size=2079557 2024-09-12T17:05:00.473 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.467+0000 7f026be9d8c0 1 < completed delete operation key=4U1W97V0OX11 tag=O5S50UEDLIOJ type=del 2024-09-12T17:05:00.479 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.475+0000 7f026be9d8c0 1 > prepared part key=_multipart_3JADN360QEO3.2~OKZBH4AO6D4L.0 size=1048576 2024-09-12T17:05:00.482 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.475+0000 7f026be9d8c0 1 > prepared part key=_multipart_3JADN360QEO3.2~OKZBH4AO6D4L.1 size=811287 2024-09-12T17:05:00.482 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.475+0000 7f026be9d8c0 1 > prepared multipart upload key=3JADN360QEO3 upload=OKZBH4AO6D4L tag=Y50A2PBYE40C type=write size=2908439 2024-09-12T17:05:00.485 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.479+0000 7f026be9d8c0 1 < completed delete operation key=4U1W97V0OX11 tag=E1X8LU6VF3BQ type=del 2024-09-12T17:05:00.489 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.483+0000 7f026be9d8c0 1 > prepared operation key=LHKLWIUAT08F tag=K3OP7X60FCWE type=write size=98937 2024-09-12T17:05:00.492 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.487+0000 7f026be9d8c0 1 < completed write operation key=ALFGNC1YNROX tag=FC93W9DYGFST type=write size=591306 2024-09-12T17:05:00.495 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.491+0000 7f026be9d8c0 1 > prepared operation key=BBYDPSXZKHZP tag=LMBDWW61KH8K type=del size=1214857 2024-09-12T17:05:00.499 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.495+0000 7f026be9d8c0 1 < completed delete operation key=JJMEQ2O00SA2 tag=PT3BA0TIAN2B type=del 2024-09-12T17:05:00.502 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.499+0000 7f026be9d8c0 1 > prepared operation key=8AFDAVJLMRD2 tag=1WT2XGSZFJ9K type=del size=2260208 2024-09-12T17:05:00.508 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.503+0000 7f026be9d8c0 1 < suggested update operation key=2BQJ30RQQ25L tag=EM7368061X09 type=del size=3000855 2024-09-12T17:05:00.512 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.507+0000 7f026be9d8c0 1 > prepared operation key=SO3HLQZA8B6B tag=CGCVY7ISI7ML type=del size=1913436 2024-09-12T17:05:00.516 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.511+0000 7f026be9d8c0 1 < completed part key=_multipart_XNBE2II106VZ.2~Q3PY2C0VDVY6.0 size=1048576 2024-09-12T17:05:00.519 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.515+0000 7f026be9d8c0 1 < completed part key=_multipart_XNBE2II106VZ.2~Q3PY2C0VDVY6.1 size=1048576 2024-09-12T17:05:00.522 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.519+0000 7f026be9d8c0 1 < completed part key=_multipart_XNBE2II106VZ.2~Q3PY2C0VDVY6.2 size=1012096 2024-09-12T17:05:00.528 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.523+0000 7f026be9d8c0 1 < completed multipart upload key=XNBE2II106VZ upload=Q3PY2C0VDVY6 tag=22S3GI9LAP9T type=write size=4157824 2024-09-12T17:05:00.532 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.527+0000 7f026be9d8c0 1 > prepared operation key=GPUFWJ3AWEMX tag=2PPIZP5B93B1 type=del size=3413747 2024-09-12T17:05:00.536 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.531+0000 7f026be9d8c0 1 < completed delete operation key=SL2446KSB531 tag=P3E57UT6P42W type=del 2024-09-12T17:05:00.542 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.539+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~FHUAQV2OUWFZ.0 size=1048576 2024-09-12T17:05:00.545 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.539+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~FHUAQV2OUWFZ.1 size=249378 2024-09-12T17:05:00.545 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.539+0000 7f026be9d8c0 1 > prepared multipart upload key=QVQ4TI319DH5 upload=FHUAQV2OUWFZ tag=02D3MRQ1J65X type=write size=2346530 2024-09-12T17:05:00.549 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.543+0000 7f026be9d8c0 1 < completed part key=_multipart_E0Y3SKNUYCQS.2~3CLSW4JM7SOT.0 size=526810 2024-09-12T17:05:00.555 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.551+0000 7f026be9d8c0 1 < completed multipart upload key=E0Y3SKNUYCQS upload=3CLSW4JM7SOT tag=IJE1EWWUIN9E type=write size=1575386 2024-09-12T17:05:00.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.559+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~SYW4RJBQS9W0.0 size=1048576 2024-09-12T17:05:00.565 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.559+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~SYW4RJBQS9W0.1 size=1048576 2024-09-12T17:05:00.568 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.563+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~SYW4RJBQS9W0.2 size=464318 2024-09-12T17:05:00.568 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.563+0000 7f026be9d8c0 1 > prepared multipart upload key=6VO85REZG2NW upload=SYW4RJBQS9W0 tag=O33RMOTQ6N6M type=write size=3610046 2024-09-12T17:05:00.571 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.567+0000 7f026be9d8c0 1 < completed delete operation key=BBYDPSXZKHZP tag=3WZ2HS96JXR9 type=del 2024-09-12T17:05:00.575 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.571+0000 7f026be9d8c0 1 > prepared operation key=ALFGNC1YNROX tag=2GVDKIK8RGD8 type=write size=860243 2024-09-12T17:05:00.579 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.575+0000 7f026be9d8c0 1 < completed delete operation key=MVYWUWKSYQ9Z tag=9QH45NL3NC8F type=del 2024-09-12T17:05:00.586 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.583+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~WJBGPUDBHHCU.0 size=484271 2024-09-12T17:05:00.586 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.583+0000 7f026be9d8c0 1 > prepared multipart upload key=Y27CDEOCM7DH upload=WJBGPUDBHHCU tag=KKLLRKD0FWKF type=write size=1532847 2024-09-12T17:05:00.593 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.587+0000 7f026be9d8c0 1 < suggested remove operation key=MVYWUWKSYQ9Z tag=V4QBB5CF4NLY type=del 2024-09-12T17:05:00.604 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.599+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~EHXSP8T4JKS6.0 size=1048576 2024-09-12T17:05:00.607 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.603+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~EHXSP8T4JKS6.1 size=1048576 2024-09-12T17:05:00.610 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.607+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~EHXSP8T4JKS6.2 size=150172 2024-09-12T17:05:00.610 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.607+0000 7f026be9d8c0 1 > prepared multipart upload key=Z9YNIEQCVNBA upload=EHXSP8T4JKS6 tag=W0XY2FCWQ5UJ type=write size=3295900 2024-09-12T17:05:00.617 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.611+0000 7f026be9d8c0 1 < suggested remove operation key=UU88OS653L8D tag=JR450NOONP6C type=del 2024-09-12T17:05:00.624 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.619+0000 7f026be9d8c0 1 > prepared part key=_multipart_L194KQIPFLE1.2~XARYBMMJZCTZ.0 size=1048576 2024-09-12T17:05:00.627 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.623+0000 7f026be9d8c0 1 > prepared part key=_multipart_L194KQIPFLE1.2~XARYBMMJZCTZ.1 size=1048576 2024-09-12T17:05:00.630 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.623+0000 7f026be9d8c0 1 > prepared part key=_multipart_L194KQIPFLE1.2~XARYBMMJZCTZ.2 size=75348 2024-09-12T17:05:00.630 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.623+0000 7f026be9d8c0 1 > prepared multipart upload key=L194KQIPFLE1 upload=XARYBMMJZCTZ tag=PPUROO1ISDS1 type=write size=3221076 2024-09-12T17:05:00.633 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.627+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~UVYO9150X03Z.0 size=837670 2024-09-12T17:05:00.639 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.635+0000 7f026be9d8c0 1 < completed multipart upload key=JJMEQ2O00SA2 upload=UVYO9150X03Z tag=B9YQMQG7A8EI type=write size=1886246 2024-09-12T17:05:00.646 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.643+0000 7f026be9d8c0 1 > prepared part key=_multipart_SGT8IC1GJ3IG.2~JVD4DJFK4T98.0 size=1048576 2024-09-12T17:05:00.649 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.643+0000 7f026be9d8c0 1 > prepared part key=_multipart_SGT8IC1GJ3IG.2~JVD4DJFK4T98.1 size=1048576 2024-09-12T17:05:00.652 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.647+0000 7f026be9d8c0 1 > prepared part key=_multipart_SGT8IC1GJ3IG.2~JVD4DJFK4T98.2 size=19949 2024-09-12T17:05:00.652 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.647+0000 7f026be9d8c0 1 > prepared multipart upload key=SGT8IC1GJ3IG upload=JVD4DJFK4T98 tag=LAVGRHEBOISE type=write size=3165677 2024-09-12T17:05:00.655 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.651+0000 7f026be9d8c0 1 < completed part key=_multipart_6VO85REZG2NW.2~GD64O432BIQ9.0 size=1048576 2024-09-12T17:05:00.655 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.651+0000 7f026be9d8c0 1 < canceled part key=_multipart_6VO85REZG2NW.2~GD64O432BIQ9.1 size=1035255 2024-09-12T17:05:00.662 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.659+0000 7f026be9d8c0 1 < canceled multipart upload key=6VO85REZG2NW upload=GD64O432BIQ9 tag=F79C0NZAO0NW type=write size=3132407 2024-09-12T17:05:00.665 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.659+0000 7f026be9d8c0 1 > prepared operation key=Z183NH6R676V tag=1OVW8W8G0NAG type=del size=2450329 2024-09-12T17:05:00.669 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.663+0000 7f026be9d8c0 1 < completed part key=_multipart_SO3HLQZA8B6B.2~BRD5621PDAN8.0 size=1048576 2024-09-12T17:05:00.672 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.667+0000 7f026be9d8c0 1 < completed part key=_multipart_SO3HLQZA8B6B.2~BRD5621PDAN8.1 size=1048576 2024-09-12T17:05:00.675 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.671+0000 7f026be9d8c0 1 < completed part key=_multipart_SO3HLQZA8B6B.2~BRD5621PDAN8.2 size=40723 2024-09-12T17:05:00.681 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.675+0000 7f026be9d8c0 1 < completed multipart upload key=SO3HLQZA8B6B upload=BRD5621PDAN8 tag=RWBKKLTBGS39 type=write size=3186451 2024-09-12T17:05:00.685 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.679+0000 7f026be9d8c0 1 > prepared operation key=8AFDAVJLMRD2 tag=HEGN6QWA3ORK type=del size=75818 2024-09-12T17:05:00.692 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.687+0000 7f026be9d8c0 1 < suggested remove operation key=6VO85REZG2NW tag=Q9E6GVQO1PNI type=del 2024-09-12T17:05:00.698 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.695+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~F1LLDJGY1TQT.0 size=1048576 2024-09-12T17:05:00.702 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.695+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~F1LLDJGY1TQT.1 size=1000013 2024-09-12T17:05:00.702 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.695+0000 7f026be9d8c0 1 > prepared multipart upload key=GPUFWJ3AWEMX upload=F1LLDJGY1TQT tag=J2W68DOTWI80 type=write size=3097165 2024-09-12T17:05:00.705 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.699+0000 7f026be9d8c0 1 < completed part key=_multipart_3JADN360QEO3.2~OKZBH4AO6D4L.0 size=1048576 2024-09-12T17:05:00.708 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.703+0000 7f026be9d8c0 1 < completed part key=_multipart_3JADN360QEO3.2~OKZBH4AO6D4L.1 size=811287 2024-09-12T17:05:00.715 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.711+0000 7f026be9d8c0 1 < completed multipart upload key=3JADN360QEO3 upload=OKZBH4AO6D4L tag=Y50A2PBYE40C type=write size=2908439 2024-09-12T17:05:00.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.715+0000 7f026be9d8c0 1 > prepared operation key=SGT8IC1GJ3IG tag=7JFDLF65DG26 type=del size=2924818 2024-09-12T17:05:00.726 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.719+0000 7f026be9d8c0 1 < suggested update operation key=LHKLWIUAT08F tag=K3OP7X60FCWE type=write size=98937 2024-09-12T17:05:00.730 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.727+0000 7f026be9d8c0 1 > prepared operation key=ALFGNC1YNROX tag=KP4ZE9H8BO3V type=del size=4028278 2024-09-12T17:05:00.737 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.731+0000 7f026be9d8c0 1 < suggested update operation key=BBYDPSXZKHZP tag=LMBDWW61KH8K type=del size=1214857 2024-09-12T17:05:00.740 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.735+0000 7f026be9d8c0 1 > prepared operation key=J8MU1A0CWSAQ tag=6YM8H7ATLO0E type=del size=2262417 2024-09-12T17:05:00.743 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.739+0000 7f026be9d8c0 1 < canceled operation key=8AFDAVJLMRD2 tag=1WT2XGSZFJ9K type=del size=2260208 2024-09-12T17:05:00.750 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.743+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~NYJALFXT7HYV.0 size=702615 2024-09-12T17:05:00.750 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.747+0000 7f026be9d8c0 1 > prepared multipart upload key=Y27CDEOCM7DH upload=NYJALFXT7HYV tag=1VGADDDS2LL1 type=write size=1751191 2024-09-12T17:05:00.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.747+0000 7f026be9d8c0 1 < completed delete operation key=SO3HLQZA8B6B tag=CGCVY7ISI7ML type=del 2024-09-12T17:05:00.759 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.755+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~LBY35HDRQX6Z.0 size=1048576 2024-09-12T17:05:00.762 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.759+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~LBY35HDRQX6Z.1 size=1048576 2024-09-12T17:05:00.765 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.759+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~LBY35HDRQX6Z.2 size=367242 2024-09-12T17:05:00.765 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.759+0000 7f026be9d8c0 1 > prepared multipart upload key=4G3BKGNT3YZC upload=LBY35HDRQX6Z tag=9SF305IECO2I type=write size=3512970 2024-09-12T17:05:00.768 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.763+0000 7f026be9d8c0 1 < completed delete operation key=GPUFWJ3AWEMX tag=2PPIZP5B93B1 type=del 2024-09-12T17:05:00.776 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.771+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~XT46OJON81X7.0 size=1048576 2024-09-12T17:05:00.779 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.775+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~XT46OJON81X7.1 size=1006942 2024-09-12T17:05:00.779 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.775+0000 7f026be9d8c0 1 > prepared multipart upload key=ALFGNC1YNROX upload=XT46OJON81X7 tag=5VPWSRZKSYM9 type=write size=3104094 2024-09-12T17:05:00.783 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.779+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~FHUAQV2OUWFZ.0 size=1048576 2024-09-12T17:05:00.786 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.783+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~FHUAQV2OUWFZ.1 size=249378 2024-09-12T17:05:00.791 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.787+0000 7f026be9d8c0 1 < completed multipart upload key=QVQ4TI319DH5 upload=FHUAQV2OUWFZ tag=02D3MRQ1J65X type=write size=2346530 2024-09-12T17:05:00.795 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.791+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=6CKMDUQJXMPX type=del size=2302471 2024-09-12T17:05:00.799 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.795+0000 7f026be9d8c0 1 < completed part key=_multipart_6VO85REZG2NW.2~SYW4RJBQS9W0.0 size=1048576 2024-09-12T17:05:00.801 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.795+0000 7f026be9d8c0 1 < completed part key=_multipart_6VO85REZG2NW.2~SYW4RJBQS9W0.1 size=1048576 2024-09-12T17:05:00.805 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.799+0000 7f026be9d8c0 1 < completed part key=_multipart_6VO85REZG2NW.2~SYW4RJBQS9W0.2 size=464318 2024-09-12T17:05:00.810 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.807+0000 7f026be9d8c0 1 < completed multipart upload key=6VO85REZG2NW upload=SYW4RJBQS9W0 tag=O33RMOTQ6N6M type=write size=3610046 2024-09-12T17:05:00.814 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.807+0000 7f026be9d8c0 1 > prepared operation key=32XUMOWT8HO2 tag=P7X1W5N89KZB type=del size=2650416 2024-09-12T17:05:00.818 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.811+0000 7f026be9d8c0 1 < completed write operation key=ALFGNC1YNROX tag=2GVDKIK8RGD8 type=write size=860243 2024-09-12T17:05:00.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.815+0000 7f026be9d8c0 1 > prepared operation key=Y27CDEOCM7DH tag=QI3WOMEB1PG8 type=del size=3486054 2024-09-12T17:05:00.825 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.819+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~WJBGPUDBHHCU.0 size=484271 2024-09-12T17:05:00.831 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.827+0000 7f026be9d8c0 1 < completed multipart upload key=Y27CDEOCM7DH upload=WJBGPUDBHHCU tag=KKLLRKD0FWKF type=write size=1532847 2024-09-12T17:05:00.837 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.831+0000 7f026be9d8c0 1 > prepared part key=_multipart_PQSQ39X3O64P.2~0GV67ZZBMS66.0 size=47980 2024-09-12T17:05:00.837 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.831+0000 7f026be9d8c0 1 > prepared multipart upload key=PQSQ39X3O64P upload=0GV67ZZBMS66 tag=H50CP1CQ821C type=write size=1096556 2024-09-12T17:05:00.841 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.835+0000 7f026be9d8c0 1 < completed part key=_multipart_Z9YNIEQCVNBA.2~EHXSP8T4JKS6.0 size=1048576 2024-09-12T17:05:00.844 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.839+0000 7f026be9d8c0 1 < completed part key=_multipart_Z9YNIEQCVNBA.2~EHXSP8T4JKS6.1 size=1048576 2024-09-12T17:05:00.847 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.843+0000 7f026be9d8c0 1 < completed part key=_multipart_Z9YNIEQCVNBA.2~EHXSP8T4JKS6.2 size=150172 2024-09-12T17:05:00.853 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.847+0000 7f026be9d8c0 1 < completed multipart upload key=Z9YNIEQCVNBA upload=EHXSP8T4JKS6 tag=W0XY2FCWQ5UJ type=write size=3295900 2024-09-12T17:05:00.859 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.855+0000 7f026be9d8c0 1 > prepared part key=_multipart_BBYDPSXZKHZP.2~LBH4Y1VRTBUM.0 size=572225 2024-09-12T17:05:00.859 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.855+0000 7f026be9d8c0 1 > prepared multipart upload key=BBYDPSXZKHZP upload=LBH4Y1VRTBUM tag=CUKKQTCF2F5U type=write size=1620801 2024-09-12T17:05:00.860 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.855+0000 7f026be9d8c0 1 < canceled part key=_multipart_L194KQIPFLE1.2~XARYBMMJZCTZ.0 size=1048576 2024-09-12T17:05:00.863 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.859+0000 7f026be9d8c0 1 < completed part key=_multipart_L194KQIPFLE1.2~XARYBMMJZCTZ.1 size=1048576 2024-09-12T17:05:00.865 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.859+0000 7f026be9d8c0 1 < completed part key=_multipart_L194KQIPFLE1.2~XARYBMMJZCTZ.2 size=75348 2024-09-12T17:05:00.871 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.867+0000 7f026be9d8c0 1 < canceled multipart upload key=L194KQIPFLE1 upload=XARYBMMJZCTZ tag=PPUROO1ISDS1 type=write size=3221076 2024-09-12T17:05:00.875 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.871+0000 7f026be9d8c0 1 > prepared operation key=32XUMOWT8HO2 tag=JOPYXG2HV9ZM type=del size=2395952 2024-09-12T17:05:00.875 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.871+0000 7f026be9d8c0 1 < canceled part key=_multipart_SGT8IC1GJ3IG.2~JVD4DJFK4T98.0 size=1048576 2024-09-12T17:05:00.878 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.875+0000 7f026be9d8c0 1 < completed part key=_multipart_SGT8IC1GJ3IG.2~JVD4DJFK4T98.1 size=1048576 2024-09-12T17:05:00.881 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.875+0000 7f026be9d8c0 1 < completed part key=_multipart_SGT8IC1GJ3IG.2~JVD4DJFK4T98.2 size=19949 2024-09-12T17:05:00.888 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.883+0000 7f026be9d8c0 1 < canceled multipart upload key=SGT8IC1GJ3IG upload=JVD4DJFK4T98 tag=LAVGRHEBOISE type=write size=3165677 2024-09-12T17:05:00.891 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.887+0000 7f026be9d8c0 1 > prepared operation key=JJMEQ2O00SA2 tag=POIV6WZEQH25 type=write size=486430 2024-09-12T17:05:00.895 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.891+0000 7f026be9d8c0 1 < completed delete operation key=Z183NH6R676V tag=1OVW8W8G0NAG type=del 2024-09-12T17:05:00.899 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.895+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=B8TETICOXOC9 type=del size=687827 2024-09-12T17:05:00.902 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.899+0000 7f026be9d8c0 1 < completed delete operation key=8AFDAVJLMRD2 tag=HEGN6QWA3ORK type=del 2024-09-12T17:05:00.909 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.903+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z183NH6R676V.2~OWFIVE7MTHVD.0 size=302248 2024-09-12T17:05:00.909 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.903+0000 7f026be9d8c0 1 > prepared multipart upload key=Z183NH6R676V upload=OWFIVE7MTHVD tag=1AZMK1Y9LJLS type=write size=1350824 2024-09-12T17:05:00.912 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.907+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~F1LLDJGY1TQT.0 size=1048576 2024-09-12T17:05:00.916 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.911+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~F1LLDJGY1TQT.1 size=1000013 2024-09-12T17:05:00.922 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.915+0000 7f026be9d8c0 1 < completed multipart upload key=GPUFWJ3AWEMX upload=F1LLDJGY1TQT tag=J2W68DOTWI80 type=write size=3097165 2024-09-12T17:05:00.932 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.927+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~PYIGRRYIPTLJ.0 size=1048576 2024-09-12T17:05:00.935 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.931+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~PYIGRRYIPTLJ.1 size=1048576 2024-09-12T17:05:00.938 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.935+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~PYIGRRYIPTLJ.2 size=491564 2024-09-12T17:05:00.938 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.935+0000 7f026be9d8c0 1 > prepared multipart upload key=SL2446KSB531 upload=PYIGRRYIPTLJ tag=LMMFUUIMBYC6 type=write size=3637292 2024-09-12T17:05:00.942 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.939+0000 7f026be9d8c0 1 < completed delete operation key=SGT8IC1GJ3IG tag=7JFDLF65DG26 type=del 2024-09-12T17:05:00.948 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.943+0000 7f026be9d8c0 1 > prepared part key=_multipart_SO3HLQZA8B6B.2~2TD70785COFL.0 size=1048576 2024-09-12T17:05:00.952 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.947+0000 7f026be9d8c0 1 > prepared part key=_multipart_SO3HLQZA8B6B.2~2TD70785COFL.1 size=581493 2024-09-12T17:05:00.952 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.947+0000 7f026be9d8c0 1 > prepared multipart upload key=SO3HLQZA8B6B upload=2TD70785COFL tag=FHRHNXP4ZWK3 type=write size=2678645 2024-09-12T17:05:00.955 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.951+0000 7f026be9d8c0 1 < completed delete operation key=ALFGNC1YNROX tag=KP4ZE9H8BO3V type=del 2024-09-12T17:05:00.960 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.955+0000 7f026be9d8c0 1 > prepared operation key=32XUMOWT8HO2 tag=82ZSJ9O6F48E type=write size=341890 2024-09-12T17:05:00.963 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.959+0000 7f026be9d8c0 1 < completed delete operation key=J8MU1A0CWSAQ tag=6YM8H7ATLO0E type=del 2024-09-12T17:05:00.970 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.967+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~YP6YUM23JI9X.0 size=1048576 2024-09-12T17:05:00.973 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.967+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~YP6YUM23JI9X.1 size=456067 2024-09-12T17:05:00.973 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.967+0000 7f026be9d8c0 1 > prepared multipart upload key=GPUFWJ3AWEMX upload=YP6YUM23JI9X tag=CGXWRBM24N3U type=write size=2553219 2024-09-12T17:05:00.974 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.971+0000 7f026be9d8c0 1 < canceled part key=_multipart_Y27CDEOCM7DH.2~NYJALFXT7HYV.0 size=702615 2024-09-12T17:05:00.981 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.975+0000 7f026be9d8c0 1 < canceled multipart upload key=Y27CDEOCM7DH upload=NYJALFXT7HYV tag=1VGADDDS2LL1 type=write size=1751191 2024-09-12T17:05:00.985 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.979+0000 7f026be9d8c0 1 > prepared operation key=J8MU1A0CWSAQ tag=TPZVYDRW9YSS type=del size=871314 2024-09-12T17:05:00.990 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.987+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~LBY35HDRQX6Z.0 size=1048576 2024-09-12T17:05:00.993 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.987+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~LBY35HDRQX6Z.1 size=1048576 2024-09-12T17:05:00.997 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.991+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~LBY35HDRQX6Z.2 size=367242 2024-09-12T17:05:01.004 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:00.999+0000 7f026be9d8c0 1 < completed multipart upload key=4G3BKGNT3YZC upload=LBY35HDRQX6Z tag=9SF305IECO2I type=write size=3512970 2024-09-12T17:05:01.008 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.003+0000 7f026be9d8c0 1 > prepared operation key=UU88OS653L8D tag=MHHPYSNZ7Z9L type=write size=824929 2024-09-12T17:05:01.013 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.007+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~XT46OJON81X7.0 size=1048576 2024-09-12T17:05:01.016 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.011+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~XT46OJON81X7.1 size=1006942 2024-09-12T17:05:01.023 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.019+0000 7f026be9d8c0 1 < completed multipart upload key=ALFGNC1YNROX upload=XT46OJON81X7 tag=5VPWSRZKSYM9 type=write size=3104094 2024-09-12T17:05:01.029 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.023+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~0RH6MQWK8T1T.0 size=1048576 2024-09-12T17:05:01.032 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.027+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~0RH6MQWK8T1T.1 size=294112 2024-09-12T17:05:01.032 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.027+0000 7f026be9d8c0 1 > prepared multipart upload key=6VO85REZG2NW upload=0RH6MQWK8T1T tag=YMZ1ZI52IU8Y type=write size=2391264 2024-09-12T17:05:01.035 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.031+0000 7f026be9d8c0 1 < completed delete operation key=3JADN360QEO3 tag=6CKMDUQJXMPX type=del 2024-09-12T17:05:01.041 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.035+0000 7f026be9d8c0 1 > prepared part key=_multipart_4U1W97V0OX11.2~AC1Q7CUGCW9L.0 size=1048576 2024-09-12T17:05:01.044 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.039+0000 7f026be9d8c0 1 > prepared part key=_multipart_4U1W97V0OX11.2~AC1Q7CUGCW9L.1 size=456904 2024-09-12T17:05:01.044 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.039+0000 7f026be9d8c0 1 > prepared multipart upload key=4U1W97V0OX11 upload=AC1Q7CUGCW9L tag=X46NUNXHZPEU type=write size=2554056 2024-09-12T17:05:01.048 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.043+0000 7f026be9d8c0 1 < completed delete operation key=32XUMOWT8HO2 tag=P7X1W5N89KZB type=del 2024-09-12T17:05:01.054 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.047+0000 7f026be9d8c0 1 > prepared part key=_multipart_XNBE2II106VZ.2~JIQOB6PVOQVY.0 size=1048576 2024-09-12T17:05:01.056 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.051+0000 7f026be9d8c0 1 > prepared part key=_multipart_XNBE2II106VZ.2~JIQOB6PVOQVY.1 size=1048576 2024-09-12T17:05:01.059 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.055+0000 7f026be9d8c0 1 > prepared part key=_multipart_XNBE2II106VZ.2~JIQOB6PVOQVY.2 size=249608 2024-09-12T17:05:01.059 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.055+0000 7f026be9d8c0 1 > prepared multipart upload key=XNBE2II106VZ upload=JIQOB6PVOQVY tag=SN3G1FB0N53P type=write size=3395336 2024-09-12T17:05:01.063 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.059+0000 7f026be9d8c0 1 < completed delete operation key=Y27CDEOCM7DH tag=QI3WOMEB1PG8 type=del 2024-09-12T17:05:01.066 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.063+0000 7f026be9d8c0 1 > prepared operation key=Z9YNIEQCVNBA tag=UTUJDIDF8MQN type=del size=654378 2024-09-12T17:05:01.067 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.063+0000 7f026be9d8c0 1 < canceled part key=_multipart_PQSQ39X3O64P.2~0GV67ZZBMS66.0 size=47980 2024-09-12T17:05:01.072 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.067+0000 7f026be9d8c0 1 < canceled multipart upload key=PQSQ39X3O64P upload=0GV67ZZBMS66 tag=H50CP1CQ821C type=write size=1096556 2024-09-12T17:05:01.078 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.075+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~YF6MWFOVVZFS.0 size=445405 2024-09-12T17:05:01.078 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.075+0000 7f026be9d8c0 1 > prepared multipart upload key=QVQ4TI319DH5 upload=YF6MWFOVVZFS tag=IBLP4O8IAQVO type=write size=1493981 2024-09-12T17:05:01.081 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.075+0000 7f026be9d8c0 1 < completed part key=_multipart_BBYDPSXZKHZP.2~LBH4Y1VRTBUM.0 size=572225 2024-09-12T17:05:01.087 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.083+0000 7f026be9d8c0 1 < completed multipart upload key=BBYDPSXZKHZP upload=LBH4Y1VRTBUM tag=CUKKQTCF2F5U type=write size=1620801 2024-09-12T17:05:01.090 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.087+0000 7f026be9d8c0 1 > prepared operation key=SO3HLQZA8B6B tag=BTUU2ML53V3T type=del size=1633197 2024-09-12T17:05:01.094 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.091+0000 7f026be9d8c0 1 < completed delete operation key=32XUMOWT8HO2 tag=JOPYXG2HV9ZM type=del 2024-09-12T17:05:01.098 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.091+0000 7f026be9d8c0 1 > prepared operation key=SL2446KSB531 tag=8L2PN0ATJYPI type=del size=4034399 2024-09-12T17:05:01.101 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.095+0000 7f026be9d8c0 1 < completed write operation key=JJMEQ2O00SA2 tag=POIV6WZEQH25 type=write size=486430 2024-09-12T17:05:01.107 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.103+0000 7f026be9d8c0 1 > prepared part key=_multipart_XNBE2II106VZ.2~IK0U6BX511MA.0 size=1048576 2024-09-12T17:05:01.110 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.107+0000 7f026be9d8c0 1 > prepared part key=_multipart_XNBE2II106VZ.2~IK0U6BX511MA.1 size=1048576 2024-09-12T17:05:01.112 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.107+0000 7f026be9d8c0 1 > prepared part key=_multipart_XNBE2II106VZ.2~IK0U6BX511MA.2 size=740674 2024-09-12T17:05:01.112 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.107+0000 7f026be9d8c0 1 > prepared multipart upload key=XNBE2II106VZ upload=IK0U6BX511MA tag=Q9FF5HFXZJA0 type=write size=3886402 2024-09-12T17:05:01.116 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.111+0000 7f026be9d8c0 1 < completed delete operation key=21ZD52VBZIO4 tag=B8TETICOXOC9 type=del 2024-09-12T17:05:01.119 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.115+0000 7f026be9d8c0 1 > prepared operation key=LHKLWIUAT08F tag=RM2BDTXRY1VM type=del size=2624461 2024-09-12T17:05:01.123 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.119+0000 7f026be9d8c0 1 < completed part key=_multipart_Z183NH6R676V.2~OWFIVE7MTHVD.0 size=302248 2024-09-12T17:05:01.128 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.123+0000 7f026be9d8c0 1 < completed multipart upload key=Z183NH6R676V upload=OWFIVE7MTHVD tag=1AZMK1Y9LJLS type=write size=1350824 2024-09-12T17:05:01.131 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.127+0000 7f026be9d8c0 1 > prepared operation key=L194KQIPFLE1 tag=85KKMF3JD3DX type=del size=2510883 2024-09-12T17:05:01.135 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.131+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~PYIGRRYIPTLJ.0 size=1048576 2024-09-12T17:05:01.137 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.131+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~PYIGRRYIPTLJ.1 size=1048576 2024-09-12T17:05:01.140 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.135+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~PYIGRRYIPTLJ.2 size=491564 2024-09-12T17:05:01.146 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.139+0000 7f026be9d8c0 1 < completed multipart upload key=SL2446KSB531 upload=PYIGRRYIPTLJ tag=LMMFUUIMBYC6 type=write size=3637292 2024-09-12T17:05:01.152 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.147+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z183NH6R676V.2~04R8VW3C10F1.0 size=631572 2024-09-12T17:05:01.153 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.147+0000 7f026be9d8c0 1 > prepared multipart upload key=Z183NH6R676V upload=04R8VW3C10F1 tag=PNEECL01046Q type=write size=1680148 2024-09-12T17:05:01.155 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.151+0000 7f026be9d8c0 1 < completed part key=_multipart_SO3HLQZA8B6B.2~2TD70785COFL.0 size=1048576 2024-09-12T17:05:01.158 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.155+0000 7f026be9d8c0 1 < completed part key=_multipart_SO3HLQZA8B6B.2~2TD70785COFL.1 size=581493 2024-09-12T17:05:01.164 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.159+0000 7f026be9d8c0 1 < completed multipart upload key=SO3HLQZA8B6B upload=2TD70785COFL tag=FHRHNXP4ZWK3 type=write size=2678645 2024-09-12T17:05:01.167 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.163+0000 7f026be9d8c0 1 > prepared operation key=BW1T21LBUE2D tag=26DA85TX4GTR type=write size=115129 2024-09-12T17:05:01.171 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.167+0000 7f026be9d8c0 1 < completed write operation key=32XUMOWT8HO2 tag=82ZSJ9O6F48E type=write size=341890 2024-09-12T17:05:01.174 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.171+0000 7f026be9d8c0 1 > prepared operation key=MVYWUWKSYQ9Z tag=PM3ZZRNYJBP0 type=del size=2183475 2024-09-12T17:05:01.178 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.175+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~YP6YUM23JI9X.0 size=1048576 2024-09-12T17:05:01.181 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.175+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~YP6YUM23JI9X.1 size=456067 2024-09-12T17:05:01.187 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.183+0000 7f026be9d8c0 1 < completed multipart upload key=GPUFWJ3AWEMX upload=YP6YUM23JI9X tag=CGXWRBM24N3U type=write size=2553219 2024-09-12T17:05:01.195 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.191+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~KST2V6V54YPZ.0 size=1048576 2024-09-12T17:05:01.198 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.191+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~KST2V6V54YPZ.1 size=1048576 2024-09-12T17:05:01.200 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.195+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~KST2V6V54YPZ.2 size=473623 2024-09-12T17:05:01.200 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.195+0000 7f026be9d8c0 1 > prepared multipart upload key=SL2446KSB531 upload=KST2V6V54YPZ tag=U00NK8MNUW1U type=write size=3619351 2024-09-12T17:05:01.204 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.199+0000 7f026be9d8c0 1 < completed delete operation key=J8MU1A0CWSAQ tag=TPZVYDRW9YSS type=del 2024-09-12T17:05:01.210 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.207+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~NS75HNGYI8R1.0 size=546332 2024-09-12T17:05:01.210 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.207+0000 7f026be9d8c0 1 > prepared multipart upload key=SL2446KSB531 upload=NS75HNGYI8R1 tag=MT9CCL645HPE type=write size=1594908 2024-09-12T17:05:01.214 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.207+0000 7f026be9d8c0 1 < completed write operation key=UU88OS653L8D tag=MHHPYSNZ7Z9L type=write size=824929 2024-09-12T17:05:01.217 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.211+0000 7f026be9d8c0 1 > prepared operation key=J8MU1A0CWSAQ tag=UY6QWOTN89BJ type=del size=3879598 2024-09-12T17:05:01.220 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.215+0000 7f026be9d8c0 1 < completed part key=_multipart_6VO85REZG2NW.2~0RH6MQWK8T1T.0 size=1048576 2024-09-12T17:05:01.223 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.219+0000 7f026be9d8c0 1 < completed part key=_multipart_6VO85REZG2NW.2~0RH6MQWK8T1T.1 size=294112 2024-09-12T17:05:01.229 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.223+0000 7f026be9d8c0 1 < completed multipart upload key=6VO85REZG2NW upload=0RH6MQWK8T1T tag=YMZ1ZI52IU8Y type=write size=2391264 2024-09-12T17:05:01.233 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.227+0000 7f026be9d8c0 1 > prepared operation key=T6QRDTQRHBPI tag=1AM65SAVXI97 type=del size=313933 2024-09-12T17:05:01.237 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.231+0000 7f026be9d8c0 1 < completed part key=_multipart_4U1W97V0OX11.2~AC1Q7CUGCW9L.0 size=1048576 2024-09-12T17:05:01.239 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.235+0000 7f026be9d8c0 1 < completed part key=_multipart_4U1W97V0OX11.2~AC1Q7CUGCW9L.1 size=456904 2024-09-12T17:05:01.246 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.243+0000 7f026be9d8c0 1 < completed multipart upload key=4U1W97V0OX11 upload=AC1Q7CUGCW9L tag=X46NUNXHZPEU type=write size=2554056 2024-09-12T17:05:01.250 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.243+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=PQO0H2RD9VDW type=del size=2381220 2024-09-12T17:05:01.253 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.247+0000 7f026be9d8c0 1 < completed part key=_multipart_XNBE2II106VZ.2~JIQOB6PVOQVY.0 size=1048576 2024-09-12T17:05:01.256 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.251+0000 7f026be9d8c0 1 < completed part key=_multipart_XNBE2II106VZ.2~JIQOB6PVOQVY.1 size=1048576 2024-09-12T17:05:01.263 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.259+0000 7f026be9d8c0 1 < completed part key=_multipart_XNBE2II106VZ.2~JIQOB6PVOQVY.2 size=249608 2024-09-12T17:05:01.269 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.263+0000 7f026be9d8c0 1 < completed multipart upload key=XNBE2II106VZ upload=JIQOB6PVOQVY tag=SN3G1FB0N53P type=write size=3395336 2024-09-12T17:05:01.273 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.267+0000 7f026be9d8c0 1 > prepared operation key=4G3BKGNT3YZC tag=C46MCCZZFFEJ type=del size=3273362 2024-09-12T17:05:01.276 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.271+0000 7f026be9d8c0 1 < canceled operation key=Z9YNIEQCVNBA tag=UTUJDIDF8MQN type=del size=654378 2024-09-12T17:05:01.280 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.275+0000 7f026be9d8c0 1 > prepared operation key=L194KQIPFLE1 tag=57Y4RGZAA688 type=write size=764419 2024-09-12T17:05:01.284 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.279+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~YF6MWFOVVZFS.0 size=445405 2024-09-12T17:05:01.290 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.287+0000 7f026be9d8c0 1 < completed multipart upload key=QVQ4TI319DH5 upload=YF6MWFOVVZFS tag=IBLP4O8IAQVO type=write size=1493981 2024-09-12T17:05:01.293 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.287+0000 7f026be9d8c0 1 > prepared operation key=XNBE2II106VZ tag=P31F8OFPOUYM type=write size=939696 2024-09-12T17:05:01.297 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.291+0000 7f026be9d8c0 1 < canceled operation key=SO3HLQZA8B6B tag=BTUU2ML53V3T type=del size=1633197 2024-09-12T17:05:01.300 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.295+0000 7f026be9d8c0 1 > prepared operation key=XNBE2II106VZ tag=BEZGZS40VWJN type=del size=1647001 2024-09-12T17:05:01.304 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.299+0000 7f026be9d8c0 1 < completed delete operation key=SL2446KSB531 tag=8L2PN0ATJYPI type=del 2024-09-12T17:05:01.310 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.307+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~L8BK7AMTWF0H.0 size=1048576 2024-09-12T17:05:01.313 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.307+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~L8BK7AMTWF0H.1 size=1048576 2024-09-12T17:05:01.316 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.311+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~L8BK7AMTWF0H.2 size=535967 2024-09-12T17:05:01.316 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.311+0000 7f026be9d8c0 1 > prepared multipart upload key=QVQ4TI319DH5 upload=L8BK7AMTWF0H tag=TOEXND2924IR type=write size=3681695 2024-09-12T17:05:01.319 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.315+0000 7f026be9d8c0 1 < completed part key=_multipart_XNBE2II106VZ.2~IK0U6BX511MA.0 size=1048576 2024-09-12T17:05:01.322 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.319+0000 7f026be9d8c0 1 < completed part key=_multipart_XNBE2II106VZ.2~IK0U6BX511MA.1 size=1048576 2024-09-12T17:05:01.325 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.319+0000 7f026be9d8c0 1 < completed part key=_multipart_XNBE2II106VZ.2~IK0U6BX511MA.2 size=740674 2024-09-12T17:05:01.331 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.327+0000 7f026be9d8c0 1 < completed multipart upload key=XNBE2II106VZ upload=IK0U6BX511MA tag=Q9FF5HFXZJA0 type=write size=3886402 2024-09-12T17:05:01.335 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.331+0000 7f026be9d8c0 1 > prepared operation key=SO3HLQZA8B6B tag=25HOW9ASOAKW type=del size=3752048 2024-09-12T17:05:01.337 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.331+0000 7f026be9d8c0 1 < completed delete operation key=LHKLWIUAT08F tag=RM2BDTXRY1VM type=del 2024-09-12T17:05:01.339 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.335+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=QJPHCP46IZDA type=del size=2242110 2024-09-12T17:05:01.342 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.335+0000 7f026be9d8c0 1 < completed delete operation key=L194KQIPFLE1 tag=85KKMF3JD3DX type=del 2024-09-12T17:05:01.343 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.339+0000 7f026be9d8c0 1 > prepared operation key=J8MU1A0CWSAQ tag=T9IRM3I1EBZ7 type=del size=2165708 2024-09-12T17:05:01.345 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.339+0000 7f026be9d8c0 1 < completed part key=_multipart_Z183NH6R676V.2~04R8VW3C10F1.0 size=631572 2024-09-12T17:05:01.348 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.343+0000 7f026be9d8c0 1 < completed multipart upload key=Z183NH6R676V upload=04R8VW3C10F1 tag=PNEECL01046Q type=write size=1680148 2024-09-12T17:05:01.351 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.347+0000 7f026be9d8c0 1 > prepared part key=_multipart_SGT8IC1GJ3IG.2~8BUBA352HIKC.0 size=1048576 2024-09-12T17:05:01.353 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.347+0000 7f026be9d8c0 1 > prepared part key=_multipart_SGT8IC1GJ3IG.2~8BUBA352HIKC.1 size=146316 2024-09-12T17:05:01.353 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.347+0000 7f026be9d8c0 1 > prepared multipart upload key=SGT8IC1GJ3IG upload=8BUBA352HIKC tag=XC1YQWF8BKDV type=write size=2243468 2024-09-12T17:05:01.356 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.351+0000 7f026be9d8c0 1 < suggested remove operation key=BW1T21LBUE2D tag=26DA85TX4GTR type=write 2024-09-12T17:05:01.360 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.355+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~MNI9DSX1YMJI.0 size=1048576 2024-09-12T17:05:01.361 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.355+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~MNI9DSX1YMJI.1 size=1048576 2024-09-12T17:05:01.363 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.359+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~MNI9DSX1YMJI.2 size=903514 2024-09-12T17:05:01.363 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.359+0000 7f026be9d8c0 1 > prepared multipart upload key=BW1T21LBUE2D upload=MNI9DSX1YMJI tag=MAJMTUZB48F9 type=write size=4049242 2024-09-12T17:05:01.365 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.359+0000 7f026be9d8c0 1 < canceled operation key=MVYWUWKSYQ9Z tag=PM3ZZRNYJBP0 type=del size=2183475 2024-09-12T17:05:01.367 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.363+0000 7f026be9d8c0 1 > prepared operation key=MVYWUWKSYQ9Z tag=1OZOKSZT8NB8 type=del size=1869807 2024-09-12T17:05:01.369 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.363+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~KST2V6V54YPZ.0 size=1048576 2024-09-12T17:05:01.370 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.367+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~KST2V6V54YPZ.1 size=1048576 2024-09-12T17:05:01.372 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.367+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~KST2V6V54YPZ.2 size=473623 2024-09-12T17:05:01.375 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.371+0000 7f026be9d8c0 1 < completed multipart upload key=SL2446KSB531 upload=KST2V6V54YPZ tag=U00NK8MNUW1U type=write size=3619351 2024-09-12T17:05:01.377 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.371+0000 7f026be9d8c0 1 > prepared operation key=32XUMOWT8HO2 tag=ZWYHVZ9E7XB4 type=del size=1146795 2024-09-12T17:05:01.378 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.375+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~NS75HNGYI8R1.0 size=546332 2024-09-12T17:05:01.381 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.375+0000 7f026be9d8c0 1 < completed multipart upload key=SL2446KSB531 upload=NS75HNGYI8R1 tag=MT9CCL645HPE type=write size=1594908 2024-09-12T17:05:01.384 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.379+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~LJHXG1P21S0J.0 size=5611 2024-09-12T17:05:01.385 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.379+0000 7f026be9d8c0 1 > prepared multipart upload key=Y27CDEOCM7DH upload=LJHXG1P21S0J tag=D7SZ5089YU7F type=write size=1054187 2024-09-12T17:05:01.386 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.383+0000 7f026be9d8c0 1 < completed delete operation key=J8MU1A0CWSAQ tag=UY6QWOTN89BJ type=del 2024-09-12T17:05:01.388 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.383+0000 7f026be9d8c0 1 > prepared operation key=L194KQIPFLE1 tag=DCT751SBT2LG type=del size=2432043 2024-09-12T17:05:01.390 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.387+0000 7f026be9d8c0 1 < completed delete operation key=T6QRDTQRHBPI tag=1AM65SAVXI97 type=del 2024-09-12T17:05:01.394 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.391+0000 7f026be9d8c0 1 > prepared part key=_multipart_BBYDPSXZKHZP.2~9EU1OOWBHP4N.0 size=927716 2024-09-12T17:05:01.394 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.391+0000 7f026be9d8c0 1 > prepared multipart upload key=BBYDPSXZKHZP upload=9EU1OOWBHP4N tag=CV6N5VNM62T0 type=write size=1976292 2024-09-12T17:05:01.396 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.391+0000 7f026be9d8c0 1 < completed delete operation key=RBNN03IPZ8BT tag=PQO0H2RD9VDW type=del 2024-09-12T17:05:01.398 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.395+0000 7f026be9d8c0 1 > prepared operation key=MVYWUWKSYQ9Z tag=8GGU115NQS1Y type=del size=4157902 2024-09-12T17:05:01.400 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.395+0000 7f026be9d8c0 1 < completed delete operation key=4G3BKGNT3YZC tag=C46MCCZZFFEJ type=del 2024-09-12T17:05:01.404 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.399+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~ZCMM8R31CA23.0 size=307573 2024-09-12T17:05:01.404 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.399+0000 7f026be9d8c0 1 > prepared multipart upload key=QVQ4TI319DH5 upload=ZCMM8R31CA23 tag=0KOS092I3LCO type=write size=1356149 2024-09-12T17:05:01.406 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.403+0000 7f026be9d8c0 1 < completed write operation key=L194KQIPFLE1 tag=57Y4RGZAA688 type=write size=764419 2024-09-12T17:05:01.410 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.407+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~XOIMWM9MJP04.0 size=1048576 2024-09-12T17:05:01.411 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.407+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~XOIMWM9MJP04.1 size=790870 2024-09-12T17:05:01.411 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.407+0000 7f026be9d8c0 1 > prepared multipart upload key=SL2446KSB531 upload=XOIMWM9MJP04 tag=NBS92ZGIMAQN type=write size=2888022 2024-09-12T17:05:01.413 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.407+0000 7f026be9d8c0 1 < completed write operation key=XNBE2II106VZ tag=P31F8OFPOUYM type=write size=939696 2024-09-12T17:05:01.417 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.411+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~9KICHUGZTK89.0 size=67668 2024-09-12T17:05:01.417 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.411+0000 7f026be9d8c0 1 > prepared multipart upload key=Z9YNIEQCVNBA upload=9KICHUGZTK89 tag=N7E5NJ7XAAMT type=write size=1116244 2024-09-12T17:05:01.420 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.415+0000 7f026be9d8c0 1 < suggested update operation key=XNBE2II106VZ tag=BEZGZS40VWJN type=del size=1647001 2024-09-12T17:05:01.424 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.419+0000 7f026be9d8c0 1 > prepared part key=_multipart_XNBE2II106VZ.2~TH0IKO3QKHCK.0 size=349896 2024-09-12T17:05:01.424 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.419+0000 7f026be9d8c0 1 > prepared multipart upload key=XNBE2II106VZ upload=TH0IKO3QKHCK tag=IH4WOPD3Q26V type=write size=1398472 2024-09-12T17:05:01.426 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.423+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~L8BK7AMTWF0H.0 size=1048576 2024-09-12T17:05:01.427 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.423+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~L8BK7AMTWF0H.1 size=1048576 2024-09-12T17:05:01.429 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.423+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~L8BK7AMTWF0H.2 size=535967 2024-09-12T17:05:01.432 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.427+0000 7f026be9d8c0 1 < completed multipart upload key=QVQ4TI319DH5 upload=L8BK7AMTWF0H tag=TOEXND2924IR type=write size=3681695 2024-09-12T17:05:01.435 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.431+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~CANS5JQZ89H8.0 size=1048576 2024-09-12T17:05:01.437 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.431+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~CANS5JQZ89H8.1 size=439370 2024-09-12T17:05:01.437 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.431+0000 7f026be9d8c0 1 > prepared multipart upload key=GPUFWJ3AWEMX upload=CANS5JQZ89H8 tag=YSV2NT8MPTJ4 type=write size=2536522 2024-09-12T17:05:01.440 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.435+0000 7f026be9d8c0 1 < suggested remove operation key=SO3HLQZA8B6B tag=25HOW9ASOAKW type=del 2024-09-12T17:05:01.442 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.439+0000 7f026be9d8c0 1 > prepared operation key=8AFDAVJLMRD2 tag=JE49DOYOISH1 type=del size=4084427 2024-09-12T17:05:01.444 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.439+0000 7f026be9d8c0 1 < completed delete operation key=RBNN03IPZ8BT tag=QJPHCP46IZDA type=del 2024-09-12T17:05:01.446 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.443+0000 7f026be9d8c0 1 > prepared operation key=XLKR6P8RNRVO tag=6CSC191BKYBP type=del size=1879194 2024-09-12T17:05:01.448 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.443+0000 7f026be9d8c0 1 < completed delete operation key=J8MU1A0CWSAQ tag=T9IRM3I1EBZ7 type=del 2024-09-12T17:05:01.452 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.447+0000 7f026be9d8c0 1 > prepared part key=_multipart_L194KQIPFLE1.2~DD0ZDVKKJA00.0 size=793902 2024-09-12T17:05:01.453 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.447+0000 7f026be9d8c0 1 > prepared multipart upload key=L194KQIPFLE1 upload=DD0ZDVKKJA00 tag=YL9OJWQP2VQR type=write size=1842478 2024-09-12T17:05:01.455 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.451+0000 7f026be9d8c0 1 < completed part key=_multipart_SGT8IC1GJ3IG.2~8BUBA352HIKC.0 size=1048576 2024-09-12T17:05:01.456 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.451+0000 7f026be9d8c0 1 < completed part key=_multipart_SGT8IC1GJ3IG.2~8BUBA352HIKC.1 size=146316 2024-09-12T17:05:01.460 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.455+0000 7f026be9d8c0 1 < completed multipart upload key=SGT8IC1GJ3IG upload=8BUBA352HIKC tag=XC1YQWF8BKDV type=write size=2243468 2024-09-12T17:05:01.462 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.459+0000 7f026be9d8c0 1 > prepared operation key=GPUFWJ3AWEMX tag=SPO2473SSDCI type=del size=4063170 2024-09-12T17:05:01.464 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.459+0000 7f026be9d8c0 1 < completed part key=_multipart_BW1T21LBUE2D.2~MNI9DSX1YMJI.0 size=1048576 2024-09-12T17:05:01.466 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.463+0000 7f026be9d8c0 1 < completed part key=_multipart_BW1T21LBUE2D.2~MNI9DSX1YMJI.1 size=1048576 2024-09-12T17:05:01.468 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.463+0000 7f026be9d8c0 1 < completed part key=_multipart_BW1T21LBUE2D.2~MNI9DSX1YMJI.2 size=903514 2024-09-12T17:05:01.471 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.467+0000 7f026be9d8c0 1 < completed multipart upload key=BW1T21LBUE2D upload=MNI9DSX1YMJI tag=MAJMTUZB48F9 type=write size=4049242 2024-09-12T17:05:01.480 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.475+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~10IVHSS8WNEI.0 size=1048576 2024-09-12T17:05:01.482 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.479+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~10IVHSS8WNEI.1 size=1048576 2024-09-12T17:05:01.485 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.479+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~10IVHSS8WNEI.2 size=525726 2024-09-12T17:05:01.485 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.479+0000 7f026be9d8c0 1 > prepared multipart upload key=UU88OS653L8D upload=10IVHSS8WNEI tag=0WPZ03QFPQG3 type=write size=3671454 2024-09-12T17:05:01.490 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.487+0000 7f026be9d8c0 1 < suggested update operation key=MVYWUWKSYQ9Z tag=1OZOKSZT8NB8 type=del size=1869807 2024-09-12T17:05:01.492 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.487+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=RQ1799CVRN95 type=write size=586827 2024-09-12T17:05:01.495 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.491+0000 7f026be9d8c0 1 < completed delete operation key=32XUMOWT8HO2 tag=ZWYHVZ9E7XB4 type=del 2024-09-12T17:05:01.499 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.495+0000 7f026be9d8c0 1 > prepared part key=_multipart_21ZD52VBZIO4.2~OIXYGZZVUS9C.0 size=1048576 2024-09-12T17:05:01.501 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.495+0000 7f026be9d8c0 1 > prepared part key=_multipart_21ZD52VBZIO4.2~OIXYGZZVUS9C.1 size=276191 2024-09-12T17:05:01.501 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.495+0000 7f026be9d8c0 1 > prepared multipart upload key=21ZD52VBZIO4 upload=OIXYGZZVUS9C tag=XQUY9ZMLAXDF type=write size=2373343 2024-09-12T17:05:01.503 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.499+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~LJHXG1P21S0J.0 size=5611 2024-09-12T17:05:01.507 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.503+0000 7f026be9d8c0 1 < completed multipart upload key=Y27CDEOCM7DH upload=LJHXG1P21S0J tag=D7SZ5089YU7F type=write size=1054187 2024-09-12T17:05:01.509 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.503+0000 7f026be9d8c0 1 > prepared operation key=T6QRDTQRHBPI tag=QDTKEH6ORRCF type=write size=169487 2024-09-12T17:05:01.511 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.507+0000 7f026be9d8c0 1 < completed delete operation key=L194KQIPFLE1 tag=DCT751SBT2LG type=del 2024-09-12T17:05:01.514 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.507+0000 7f026be9d8c0 1 > prepared operation key=SO3HLQZA8B6B tag=MRU9R73KC7X8 type=del size=158528 2024-09-12T17:05:01.516 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.511+0000 7f026be9d8c0 1 < completed part key=_multipart_BBYDPSXZKHZP.2~9EU1OOWBHP4N.0 size=927716 2024-09-12T17:05:01.520 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.515+0000 7f026be9d8c0 1 < completed multipart upload key=BBYDPSXZKHZP upload=9EU1OOWBHP4N tag=CV6N5VNM62T0 type=write size=1976292 2024-09-12T17:05:01.522 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.519+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=A66L5O0N4Y7U type=del size=3121888 2024-09-12T17:05:01.527 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.523+0000 7f026be9d8c0 1 < suggested remove operation key=MVYWUWKSYQ9Z tag=8GGU115NQS1Y type=del 2024-09-12T17:05:01.531 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.527+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~84UBG0DFVOOX.0 size=1048576 2024-09-12T17:05:01.533 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.527+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~84UBG0DFVOOX.1 size=889848 2024-09-12T17:05:01.533 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.527+0000 7f026be9d8c0 1 > prepared multipart upload key=UU88OS653L8D upload=84UBG0DFVOOX tag=2AC7H3048BRF type=write size=2987000 2024-09-12T17:05:01.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.531+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~ZCMM8R31CA23.0 size=307573 2024-09-12T17:05:01.540 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.535+0000 7f026be9d8c0 1 < completed multipart upload key=QVQ4TI319DH5 upload=ZCMM8R31CA23 tag=0KOS092I3LCO type=write size=1356149 2024-09-12T17:05:01.545 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.539+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~VMUVJST6458Y.0 size=1048576 2024-09-12T17:05:01.547 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.543+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~VMUVJST6458Y.1 size=831969 2024-09-12T17:05:01.547 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.543+0000 7f026be9d8c0 1 > prepared multipart upload key=BW1T21LBUE2D upload=VMUVJST6458Y tag=RVZQ13BUTYXN type=write size=2929121 2024-09-12T17:05:01.549 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.543+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~XOIMWM9MJP04.0 size=1048576 2024-09-12T17:05:01.551 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.547+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~XOIMWM9MJP04.1 size=790870 2024-09-12T17:05:01.556 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.551+0000 7f026be9d8c0 1 < completed multipart upload key=SL2446KSB531 upload=XOIMWM9MJP04 tag=NBS92ZGIMAQN type=write size=2888022 2024-09-12T17:05:01.560 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.555+0000 7f026be9d8c0 1 > prepared part key=_multipart_4U1W97V0OX11.2~MU3Q1LANPPVF.0 size=1048576 2024-09-12T17:05:01.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.559+0000 7f026be9d8c0 1 > prepared part key=_multipart_4U1W97V0OX11.2~MU3Q1LANPPVF.1 size=105293 2024-09-12T17:05:01.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.559+0000 7f026be9d8c0 1 > prepared multipart upload key=4U1W97V0OX11 upload=MU3Q1LANPPVF tag=9GOZ2S3XTXQO type=write size=2202445 2024-09-12T17:05:01.565 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.559+0000 7f026be9d8c0 1 < completed part key=_multipart_Z9YNIEQCVNBA.2~9KICHUGZTK89.0 size=67668 2024-09-12T17:05:01.569 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.563+0000 7f026be9d8c0 1 < completed multipart upload key=Z9YNIEQCVNBA upload=9KICHUGZTK89 tag=N7E5NJ7XAAMT type=write size=1116244 2024-09-12T17:05:01.576 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.571+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~QFXRD95SII1L.0 size=1048576 2024-09-12T17:05:01.578 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.575+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~QFXRD95SII1L.1 size=1048576 2024-09-12T17:05:01.581 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.575+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~QFXRD95SII1L.2 size=934526 2024-09-12T17:05:01.581 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.575+0000 7f026be9d8c0 1 > prepared multipart upload key=BW1T21LBUE2D upload=QFXRD95SII1L tag=AF5MY7KOJJR8 type=write size=4080254 2024-09-12T17:05:01.581 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.575+0000 7f026be9d8c0 1 < canceled part key=_multipart_XNBE2II106VZ.2~TH0IKO3QKHCK.0 size=349896 2024-09-12T17:05:01.586 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.583+0000 7f026be9d8c0 1 < canceled multipart upload key=XNBE2II106VZ upload=TH0IKO3QKHCK tag=IH4WOPD3Q26V type=write size=1398472 2024-09-12T17:05:01.589 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.583+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=3VKKRJOGEKDP type=write size=648922 2024-09-12T17:05:01.592 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.587+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~CANS5JQZ89H8.0 size=1048576 2024-09-12T17:05:01.595 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.591+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~CANS5JQZ89H8.1 size=439370 2024-09-12T17:05:01.600 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.595+0000 7f026be9d8c0 1 < completed multipart upload key=GPUFWJ3AWEMX upload=CANS5JQZ89H8 tag=YSV2NT8MPTJ4 type=write size=2536522 2024-09-12T17:05:01.603 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.599+0000 7f026be9d8c0 1 > prepared operation key=XNBE2II106VZ tag=TYVEVO1OS78L type=del size=799346 2024-09-12T17:05:01.605 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.599+0000 7f026be9d8c0 1 < completed delete operation key=8AFDAVJLMRD2 tag=JE49DOYOISH1 type=del 2024-09-12T17:05:01.610 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.607+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~0GXBJHYSI60A.0 size=1048576 2024-09-12T17:05:01.612 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.607+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~0GXBJHYSI60A.1 size=1048576 2024-09-12T17:05:01.614 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.611+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~0GXBJHYSI60A.2 size=1037419 2024-09-12T17:05:01.614 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.611+0000 7f026be9d8c0 1 > prepared multipart upload key=J8MU1A0CWSAQ upload=0GXBJHYSI60A tag=JWUOP5ZB2JDB type=write size=4183147 2024-09-12T17:05:01.617 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.611+0000 7f026be9d8c0 1 < completed delete operation key=XLKR6P8RNRVO tag=6CSC191BKYBP type=del 2024-09-12T17:05:01.620 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.615+0000 7f026be9d8c0 1 > prepared operation key=SL2446KSB531 tag=1YGFWTFWV5F7 type=del size=1367354 2024-09-12T17:05:01.623 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.619+0000 7f026be9d8c0 1 < completed part key=_multipart_L194KQIPFLE1.2~DD0ZDVKKJA00.0 size=793902 2024-09-12T17:05:01.628 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.623+0000 7f026be9d8c0 1 < completed multipart upload key=L194KQIPFLE1 upload=DD0ZDVKKJA00 tag=YL9OJWQP2VQR type=write size=1842478 2024-09-12T17:05:01.632 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.627+0000 7f026be9d8c0 1 > prepared operation key=UU88OS653L8D tag=VE4HBZQBDP8A type=write size=932501 2024-09-12T17:05:01.635 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.631+0000 7f026be9d8c0 1 < completed delete operation key=GPUFWJ3AWEMX tag=SPO2473SSDCI type=del 2024-09-12T17:05:01.642 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.639+0000 7f026be9d8c0 1 > prepared part key=_multipart_PQSQ39X3O64P.2~RO28L8DQ3M7T.0 size=1048576 2024-09-12T17:05:01.644 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.639+0000 7f026be9d8c0 1 > prepared part key=_multipart_PQSQ39X3O64P.2~RO28L8DQ3M7T.1 size=123308 2024-09-12T17:05:01.644 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.639+0000 7f026be9d8c0 1 > prepared multipart upload key=PQSQ39X3O64P upload=RO28L8DQ3M7T tag=1I9X4RDOQMO9 type=write size=2220460 2024-09-12T17:05:01.648 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.643+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~10IVHSS8WNEI.0 size=1048576 2024-09-12T17:05:01.651 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.647+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~10IVHSS8WNEI.1 size=1048576 2024-09-12T17:05:01.654 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.651+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~10IVHSS8WNEI.2 size=525726 2024-09-12T17:05:01.660 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.655+0000 7f026be9d8c0 1 < completed multipart upload key=UU88OS653L8D upload=10IVHSS8WNEI tag=0WPZ03QFPQG3 type=write size=3671454 2024-09-12T17:05:01.667 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.663+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~YAWB6D48MXTF.0 size=1048576 2024-09-12T17:05:01.670 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.667+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~YAWB6D48MXTF.1 size=55119 2024-09-12T17:05:01.671 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.667+0000 7f026be9d8c0 1 > prepared multipart upload key=BW1T21LBUE2D upload=YAWB6D48MXTF tag=ZP5ESL7H731K type=write size=2152271 2024-09-12T17:05:01.674 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.671+0000 7f026be9d8c0 1 < completed write operation key=3JADN360QEO3 tag=RQ1799CVRN95 type=write size=586827 2024-09-12T17:05:01.680 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.675+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~1J04C31LQMRW.0 size=1048576 2024-09-12T17:05:01.682 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.679+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~1J04C31LQMRW.1 size=43741 2024-09-12T17:05:01.682 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.679+0000 7f026be9d8c0 1 > prepared multipart upload key=6VO85REZG2NW upload=1J04C31LQMRW tag=8W3PYDRQ0A73 type=write size=2140893 2024-09-12T17:05:01.683 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.679+0000 7f026be9d8c0 1 < canceled part key=_multipart_21ZD52VBZIO4.2~OIXYGZZVUS9C.0 size=1048576 2024-09-12T17:05:01.685 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.679+0000 7f026be9d8c0 1 < completed part key=_multipart_21ZD52VBZIO4.2~OIXYGZZVUS9C.1 size=276191 2024-09-12T17:05:01.689 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.683+0000 7f026be9d8c0 1 < canceled multipart upload key=21ZD52VBZIO4 upload=OIXYGZZVUS9C tag=XQUY9ZMLAXDF type=write size=2373343 2024-09-12T17:05:01.695 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.691+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~Y2WVV9KWJLWE.0 size=1048576 2024-09-12T17:05:01.697 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.691+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~Y2WVV9KWJLWE.1 size=8404 2024-09-12T17:05:01.697 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.691+0000 7f026be9d8c0 1 > prepared multipart upload key=ALFGNC1YNROX upload=Y2WVV9KWJLWE tag=28QSXBJG6N3E type=write size=2105556 2024-09-12T17:05:01.700 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.695+0000 7f026be9d8c0 1 < completed write operation key=T6QRDTQRHBPI tag=QDTKEH6ORRCF type=write size=169487 2024-09-12T17:05:01.706 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.699+0000 7f026be9d8c0 1 > prepared part key=_multipart_RBNN03IPZ8BT.2~G260ABV9PSSS.0 size=1048576 2024-09-12T17:05:01.708 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.703+0000 7f026be9d8c0 1 > prepared part key=_multipart_RBNN03IPZ8BT.2~G260ABV9PSSS.1 size=108934 2024-09-12T17:05:01.708 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.703+0000 7f026be9d8c0 1 > prepared multipart upload key=RBNN03IPZ8BT upload=G260ABV9PSSS tag=1XISBOA9A8T4 type=write size=2206086 2024-09-12T17:05:01.712 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.707+0000 7f026be9d8c0 1 < completed delete operation key=SO3HLQZA8B6B tag=MRU9R73KC7X8 type=del 2024-09-12T17:05:01.716 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.711+0000 7f026be9d8c0 1 > prepared operation key=4G3BKGNT3YZC tag=GY4MP84MPXFB type=write size=978744 2024-09-12T17:05:01.722 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.715+0000 7f026be9d8c0 1 < suggested remove operation key=RBNN03IPZ8BT tag=A66L5O0N4Y7U type=del 2024-09-12T17:05:01.727 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.723+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~B2FE0B712OQR.0 size=1048576 2024-09-12T17:05:01.729 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.723+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~B2FE0B712OQR.1 size=1048576 2024-09-12T17:05:01.731 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.727+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~B2FE0B712OQR.2 size=974064 2024-09-12T17:05:01.731 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.727+0000 7f026be9d8c0 1 > prepared multipart upload key=J8MU1A0CWSAQ upload=B2FE0B712OQR tag=DBGK12HJQR0A type=write size=4119792 2024-09-12T17:05:01.734 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.731+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~84UBG0DFVOOX.0 size=1048576 2024-09-12T17:05:01.737 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.731+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~84UBG0DFVOOX.1 size=889848 2024-09-12T17:05:01.744 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.739+0000 7f026be9d8c0 1 < completed multipart upload key=UU88OS653L8D upload=84UBG0DFVOOX tag=2AC7H3048BRF type=write size=2987000 2024-09-12T17:05:01.746 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.743+0000 7f026be9d8c0 1 > prepared operation key=Z183NH6R676V tag=7OPQ211IJ2PS type=write size=737480 2024-09-12T17:05:01.749 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.743+0000 7f026be9d8c0 1 < completed part key=_multipart_BW1T21LBUE2D.2~VMUVJST6458Y.0 size=1048576 2024-09-12T17:05:01.751 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.747+0000 7f026be9d8c0 1 < completed part key=_multipart_BW1T21LBUE2D.2~VMUVJST6458Y.1 size=831969 2024-09-12T17:05:01.755 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.751+0000 7f026be9d8c0 1 < completed multipart upload key=BW1T21LBUE2D upload=VMUVJST6458Y tag=RVZQ13BUTYXN type=write size=2929121 2024-09-12T17:05:01.758 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.755+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=RB8VEZDUS2QX type=del size=2603390 2024-09-12T17:05:01.760 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.755+0000 7f026be9d8c0 1 < completed part key=_multipart_4U1W97V0OX11.2~MU3Q1LANPPVF.0 size=1048576 2024-09-12T17:05:01.762 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.759+0000 7f026be9d8c0 1 < completed part key=_multipart_4U1W97V0OX11.2~MU3Q1LANPPVF.1 size=105293 2024-09-12T17:05:01.767 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.763+0000 7f026be9d8c0 1 < completed multipart upload key=4U1W97V0OX11 upload=MU3Q1LANPPVF tag=9GOZ2S3XTXQO type=write size=2202445 2024-09-12T17:05:01.769 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.763+0000 7f026be9d8c0 1 > prepared operation key=4U1W97V0OX11 tag=JLY097XGB3FD type=del size=3622667 2024-09-12T17:05:01.770 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.763+0000 7f026be9d8c0 1 < canceled part key=_multipart_BW1T21LBUE2D.2~QFXRD95SII1L.0 size=1048576 2024-09-12T17:05:01.772 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.767+0000 7f026be9d8c0 1 < completed part key=_multipart_BW1T21LBUE2D.2~QFXRD95SII1L.1 size=1048576 2024-09-12T17:05:01.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.771+0000 7f026be9d8c0 1 < completed part key=_multipart_BW1T21LBUE2D.2~QFXRD95SII1L.2 size=934526 2024-09-12T17:05:01.778 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.775+0000 7f026be9d8c0 1 < canceled multipart upload key=BW1T21LBUE2D upload=QFXRD95SII1L tag=AF5MY7KOJJR8 type=write size=4080254 2024-09-12T17:05:01.780 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.775+0000 7f026be9d8c0 1 > prepared operation key=SO3HLQZA8B6B tag=UDGC1DVHRY2Q type=del size=1192758 2024-09-12T17:05:01.782 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.775+0000 7f026be9d8c0 -1 < no bi entry to suggest for operation key=RBNN03IPZ8BT tag=3VKKRJOGEKDP type=write size=648922: (2) No such file or directory 2024-09-12T17:05:01.784 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.779+0000 7f026be9d8c0 1 > prepared operation key=BBYDPSXZKHZP tag=VWCGZNKSD7EH type=del size=305956 2024-09-12T17:05:01.787 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.783+0000 7f026be9d8c0 1 < completed delete operation key=XNBE2II106VZ tag=TYVEVO1OS78L type=del 2024-09-12T17:05:01.791 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.787+0000 7f026be9d8c0 1 > prepared operation key=4U1W97V0OX11 tag=L4GU39WWVLGL type=del size=210544 2024-09-12T17:05:01.791 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.787+0000 7f026be9d8c0 1 < canceled part key=_multipart_J8MU1A0CWSAQ.2~0GXBJHYSI60A.0 size=1048576 2024-09-12T17:05:01.791 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.787+0000 7f026be9d8c0 1 < canceled part key=_multipart_J8MU1A0CWSAQ.2~0GXBJHYSI60A.1 size=1048576 2024-09-12T17:05:01.793 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.787+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~0GXBJHYSI60A.2 size=1037419 2024-09-12T17:05:01.797 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.791+0000 7f026be9d8c0 1 < canceled multipart upload key=J8MU1A0CWSAQ upload=0GXBJHYSI60A tag=JWUOP5ZB2JDB type=write size=4183147 2024-09-12T17:05:01.800 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.795+0000 7f026be9d8c0 1 > prepared operation key=4G3BKGNT3YZC tag=BQ5WJT8A7529 type=del size=3607181 2024-09-12T17:05:01.805 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.799+0000 7f026be9d8c0 1 < suggested update operation key=SL2446KSB531 tag=1YGFWTFWV5F7 type=del size=1367354 2024-09-12T17:05:01.808 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.803+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=Z52LE40880CO type=del size=1539842 2024-09-12T17:05:01.813 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.807+0000 7f026be9d8c0 1 < suggested remove operation key=UU88OS653L8D tag=VE4HBZQBDP8A type=write 2024-09-12T17:05:01.816 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.811+0000 7f026be9d8c0 1 > prepared operation key=SL2446KSB531 tag=6SJ5NLAXGLK0 type=del size=3999691 2024-09-12T17:05:01.818 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.815+0000 7f026be9d8c0 1 < completed part key=_multipart_PQSQ39X3O64P.2~RO28L8DQ3M7T.0 size=1048576 2024-09-12T17:05:01.820 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.815+0000 7f026be9d8c0 1 < completed part key=_multipart_PQSQ39X3O64P.2~RO28L8DQ3M7T.1 size=123308 2024-09-12T17:05:01.825 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.819+0000 7f026be9d8c0 1 < completed multipart upload key=PQSQ39X3O64P upload=RO28L8DQ3M7T tag=1I9X4RDOQMO9 type=write size=2220460 2024-09-12T17:05:01.827 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.823+0000 7f026be9d8c0 1 > prepared operation key=BW1T21LBUE2D tag=O7F46KJ419OW type=del size=3369607 2024-09-12T17:05:01.830 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.827+0000 7f026be9d8c0 1 < completed part key=_multipart_BW1T21LBUE2D.2~YAWB6D48MXTF.0 size=1048576 2024-09-12T17:05:01.832 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.827+0000 7f026be9d8c0 1 < completed part key=_multipart_BW1T21LBUE2D.2~YAWB6D48MXTF.1 size=55119 2024-09-12T17:05:01.836 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.831+0000 7f026be9d8c0 1 < completed multipart upload key=BW1T21LBUE2D upload=YAWB6D48MXTF tag=ZP5ESL7H731K type=write size=2152271 2024-09-12T17:05:01.838 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.835+0000 7f026be9d8c0 1 > prepared operation key=4U1W97V0OX11 tag=6VE61AY9N03J type=del size=1290857 2024-09-12T17:05:01.841 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.835+0000 7f026be9d8c0 1 < completed part key=_multipart_6VO85REZG2NW.2~1J04C31LQMRW.0 size=1048576 2024-09-12T17:05:01.843 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.839+0000 7f026be9d8c0 1 < completed part key=_multipart_6VO85REZG2NW.2~1J04C31LQMRW.1 size=43741 2024-09-12T17:05:01.847 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.843+0000 7f026be9d8c0 1 < completed multipart upload key=6VO85REZG2NW upload=1J04C31LQMRW tag=8W3PYDRQ0A73 type=write size=2140893 2024-09-12T17:05:01.850 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.843+0000 7f026be9d8c0 1 > prepared operation key=Z183NH6R676V tag=HEUDOFP31GCY type=write size=256902 2024-09-12T17:05:01.852 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.847+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~Y2WVV9KWJLWE.0 size=1048576 2024-09-12T17:05:01.853 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.847+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~Y2WVV9KWJLWE.1 size=8404 2024-09-12T17:05:01.857 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.851+0000 7f026be9d8c0 1 < completed multipart upload key=ALFGNC1YNROX upload=Y2WVV9KWJLWE tag=28QSXBJG6N3E type=write size=2105556 2024-09-12T17:05:01.860 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.855+0000 7f026be9d8c0 1 > prepared operation key=LHKLWIUAT08F tag=UN6QBSU5MKVR type=del size=3674703 2024-09-12T17:05:01.863 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.859+0000 7f026be9d8c0 1 < completed part key=_multipart_RBNN03IPZ8BT.2~G260ABV9PSSS.0 size=1048576 2024-09-12T17:05:01.865 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.859+0000 7f026be9d8c0 1 < completed part key=_multipart_RBNN03IPZ8BT.2~G260ABV9PSSS.1 size=108934 2024-09-12T17:05:01.869 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.863+0000 7f026be9d8c0 1 < completed multipart upload key=RBNN03IPZ8BT upload=G260ABV9PSSS tag=1XISBOA9A8T4 type=write size=2206086 2024-09-12T17:05:01.872 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.867+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=E6UCTXPADWWU type=del size=2842920 2024-09-12T17:05:01.874 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.871+0000 7f026be9d8c0 1 < completed write operation key=4G3BKGNT3YZC tag=GY4MP84MPXFB type=write size=978744 2024-09-12T17:05:01.877 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.871+0000 7f026be9d8c0 1 > prepared operation key=8AFDAVJLMRD2 tag=LIKRWV4VMEGS type=del size=2929353 2024-09-12T17:05:01.880 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.875+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~B2FE0B712OQR.0 size=1048576 2024-09-12T17:05:01.882 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.879+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~B2FE0B712OQR.1 size=1048576 2024-09-12T17:05:01.884 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.879+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~B2FE0B712OQR.2 size=974064 2024-09-12T17:05:01.888 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.883+0000 7f026be9d8c0 1 < completed multipart upload key=J8MU1A0CWSAQ upload=B2FE0B712OQR tag=DBGK12HJQR0A type=write size=4119792 2024-09-12T17:05:01.892 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.887+0000 7f026be9d8c0 1 > prepared operation key=6VO85REZG2NW tag=46I72O6EJAZK type=del size=771573 2024-09-12T17:05:01.893 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.887+0000 7f026be9d8c0 1 < completed write operation key=Z183NH6R676V tag=7OPQ211IJ2PS type=write size=737480 2024-09-12T17:05:01.895 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.891+0000 7f026be9d8c0 1 > prepared operation key=Y27CDEOCM7DH tag=BSDWMELYRL5P type=del size=1955248 2024-09-12T17:05:01.898 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.895+0000 7f026be9d8c0 1 < completed delete operation key=U8W1SAVSLTBF tag=RB8VEZDUS2QX type=del 2024-09-12T17:05:01.900 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.895+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=4GDJJXL6890L type=del size=1600505 2024-09-12T17:05:01.903 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.899+0000 7f026be9d8c0 1 < completed delete operation key=4U1W97V0OX11 tag=JLY097XGB3FD type=del 2024-09-12T17:05:01.905 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.899+0000 7f026be9d8c0 1 > prepared operation key=XLKR6P8RNRVO tag=EJDAAUU6WZ0N type=del size=2149506 2024-09-12T17:05:01.908 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.903+0000 7f026be9d8c0 1 < completed delete operation key=SO3HLQZA8B6B tag=UDGC1DVHRY2Q type=del 2024-09-12T17:05:01.910 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.907+0000 7f026be9d8c0 1 > prepared operation key=6VO85REZG2NW tag=8Z9G2BJITQ9R type=del size=2845991 2024-09-12T17:05:01.914 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.907+0000 7f026be9d8c0 1 < completed delete operation key=BBYDPSXZKHZP tag=VWCGZNKSD7EH type=del 2024-09-12T17:05:01.916 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.911+0000 7f026be9d8c0 1 > prepared operation key=UU88OS653L8D tag=0YJB89I6M4V2 type=del size=769936 2024-09-12T17:05:01.922 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.915+0000 7f026be9d8c0 1 < suggested update operation key=4U1W97V0OX11 tag=L4GU39WWVLGL type=del size=210544 2024-09-12T17:05:01.924 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.919+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=BTDTM7RH29ZH type=del size=1386762 2024-09-12T17:05:01.927 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.923+0000 7f026be9d8c0 1 < canceled operation key=4G3BKGNT3YZC tag=BQ5WJT8A7529 type=del size=3607181 2024-09-12T17:05:01.933 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.927+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~P35DWXTDWNK7.0 size=1048576 2024-09-12T17:05:01.935 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.931+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~P35DWXTDWNK7.1 size=1048576 2024-09-12T17:05:01.937 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.931+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~P35DWXTDWNK7.2 size=788338 2024-09-12T17:05:01.937 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.931+0000 7f026be9d8c0 1 > prepared multipart upload key=SL2446KSB531 upload=P35DWXTDWNK7 tag=PCVMVJ8PSST0 type=write size=3934066 2024-09-12T17:05:01.941 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.935+0000 7f026be9d8c0 1 < completed delete operation key=U8W1SAVSLTBF tag=Z52LE40880CO type=del 2024-09-12T17:05:01.946 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.943+0000 7f026be9d8c0 1 > prepared part key=_multipart_LHKLWIUAT08F.2~HLHCJ94NZF8X.0 size=1048576 2024-09-12T17:05:01.949 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.943+0000 7f026be9d8c0 1 > prepared part key=_multipart_LHKLWIUAT08F.2~HLHCJ94NZF8X.1 size=1048576 2024-09-12T17:05:01.951 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.947+0000 7f026be9d8c0 1 > prepared part key=_multipart_LHKLWIUAT08F.2~HLHCJ94NZF8X.2 size=291618 2024-09-12T17:05:01.951 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.947+0000 7f026be9d8c0 1 > prepared multipart upload key=LHKLWIUAT08F upload=HLHCJ94NZF8X tag=T0WQ07CCCW4C type=write size=3437346 2024-09-12T17:05:01.954 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.951+0000 7f026be9d8c0 1 < completed delete operation key=SL2446KSB531 tag=6SJ5NLAXGLK0 type=del 2024-09-12T17:05:01.957 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.951+0000 7f026be9d8c0 1 > prepared operation key=PQSQ39X3O64P tag=PYWQPX1D6EAK type=del size=18629 2024-09-12T17:05:01.960 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.955+0000 7f026be9d8c0 1 < completed delete operation key=BW1T21LBUE2D tag=O7F46KJ419OW type=del 2024-09-12T17:05:01.963 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.959+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=6HDLVKX7YZSH type=del size=2072404 2024-09-12T17:05:01.969 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.963+0000 7f026be9d8c0 1 < suggested update operation key=4U1W97V0OX11 tag=6VE61AY9N03J type=del size=1290857 2024-09-12T17:05:01.972 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.967+0000 7f026be9d8c0 1 > prepared operation key=UU88OS653L8D tag=NI9XER5GJ1RB type=del size=3007291 2024-09-12T17:05:01.976 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.971+0000 7f026be9d8c0 1 < completed write operation key=Z183NH6R676V tag=HEUDOFP31GCY type=write size=256902 2024-09-12T17:05:01.982 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.975+0000 7f026be9d8c0 1 > prepared part key=_multipart_PQSQ39X3O64P.2~KDDK1ZD5MRQ9.0 size=1048576 2024-09-12T17:05:01.984 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.979+0000 7f026be9d8c0 1 > prepared part key=_multipart_PQSQ39X3O64P.2~KDDK1ZD5MRQ9.1 size=857018 2024-09-12T17:05:01.984 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.979+0000 7f026be9d8c0 1 > prepared multipart upload key=PQSQ39X3O64P upload=KDDK1ZD5MRQ9 tag=5J0K8L1H0POQ type=write size=2954170 2024-09-12T17:05:01.988 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.983+0000 7f026be9d8c0 1 < completed delete operation key=LHKLWIUAT08F tag=UN6QBSU5MKVR type=del 2024-09-12T17:05:01.997 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.991+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~X478DSZMVUYW.0 size=1048576 2024-09-12T17:05:01.999 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.995+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~X478DSZMVUYW.1 size=1048576 2024-09-12T17:05:02.002 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.995+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~X478DSZMVUYW.2 size=210672 2024-09-12T17:05:02.002 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:01.995+0000 7f026be9d8c0 1 > prepared multipart upload key=4G3BKGNT3YZC upload=X478DSZMVUYW tag=N40GK9JQI79O type=write size=3356400 2024-09-12T17:05:02.008 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.003+0000 7f026be9d8c0 1 < suggested update operation key=3JADN360QEO3 tag=E6UCTXPADWWU type=del size=2842920 2024-09-12T17:05:02.011 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.007+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=QH6F2OGW1CUV type=del size=3638478 2024-09-12T17:05:02.018 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.011+0000 7f026be9d8c0 1 < suggested remove operation key=8AFDAVJLMRD2 tag=LIKRWV4VMEGS type=del 2024-09-12T17:05:02.021 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.015+0000 7f026be9d8c0 1 > prepared operation key=ALFGNC1YNROX tag=1RWXENHV3P4A type=del size=1178122 2024-09-12T17:05:02.024 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.019+0000 7f026be9d8c0 1 < completed delete operation key=6VO85REZG2NW tag=46I72O6EJAZK type=del 2024-09-12T17:05:02.027 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.023+0000 7f026be9d8c0 1 > prepared operation key=JJMEQ2O00SA2 tag=0AKVYJ0EIRB9 type=write size=441106 2024-09-12T17:05:02.034 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.027+0000 7f026be9d8c0 1 < suggested update operation key=Y27CDEOCM7DH tag=BSDWMELYRL5P type=del size=1955248 2024-09-12T17:05:02.040 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.035+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~6PR4SG4YN0LO.0 size=1048576 2024-09-12T17:05:02.043 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.039+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~6PR4SG4YN0LO.1 size=1048576 2024-09-12T17:05:02.045 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.039+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~6PR4SG4YN0LO.2 size=491503 2024-09-12T17:05:02.045 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.039+0000 7f026be9d8c0 1 > prepared multipart upload key=J8MU1A0CWSAQ upload=6PR4SG4YN0LO tag=F2D4WG20IFHI type=write size=3637231 2024-09-12T17:05:02.052 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.047+0000 7f026be9d8c0 1 < suggested remove operation key=RBNN03IPZ8BT tag=4GDJJXL6890L type=del 2024-09-12T17:05:02.058 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.055+0000 7f026be9d8c0 1 > prepared part key=_multipart_SGT8IC1GJ3IG.2~JTV7UJAYN8AB.0 size=631029 2024-09-12T17:05:02.058 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.055+0000 7f026be9d8c0 1 > prepared multipart upload key=SGT8IC1GJ3IG upload=JTV7UJAYN8AB tag=PQT1BDVCGSZT type=write size=1679605 2024-09-12T17:05:02.064 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.059+0000 7f026be9d8c0 1 < suggested remove operation key=XLKR6P8RNRVO tag=EJDAAUU6WZ0N type=del 2024-09-12T17:05:02.067 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.063+0000 7f026be9d8c0 1 > prepared operation key=L194KQIPFLE1 tag=ADGHSJ2HHBQ5 type=del size=230489 2024-09-12T17:05:02.071 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.067+0000 7f026be9d8c0 1 < completed delete operation key=6VO85REZG2NW tag=8Z9G2BJITQ9R type=del 2024-09-12T17:05:02.074 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.071+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=8BCZ0RZJV0ZU type=del size=2412619 2024-09-12T17:05:02.077 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.071+0000 7f026be9d8c0 1 < completed delete operation key=UU88OS653L8D tag=0YJB89I6M4V2 type=del 2024-09-12T17:05:02.081 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.075+0000 7f026be9d8c0 1 > prepared operation key=8AFDAVJLMRD2 tag=1Q5CCLOPDIBR type=del size=2775706 2024-09-12T17:05:02.084 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.079+0000 7f026be9d8c0 -1 < failed to complete operation key=RBNN03IPZ8BT tag=BTDTM7RH29ZH type=del size=1386762: (22) Invalid argument 2024-09-12T17:05:02.087 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.083+0000 7f026be9d8c0 1 > prepared operation key=BW1T21LBUE2D tag=311GKXBD2KQD type=del size=1271758 2024-09-12T17:05:02.090 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.087+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~P35DWXTDWNK7.0 size=1048576 2024-09-12T17:05:02.093 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.087+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~P35DWXTDWNK7.1 size=1048576 2024-09-12T17:05:02.095 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.091+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~P35DWXTDWNK7.2 size=788338 2024-09-12T17:05:02.101 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.095+0000 7f026be9d8c0 1 < completed multipart upload key=SL2446KSB531 upload=P35DWXTDWNK7 tag=PCVMVJ8PSST0 type=write size=3934066 2024-09-12T17:05:02.104 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.099+0000 7f026be9d8c0 1 > prepared operation key=SGT8IC1GJ3IG tag=UB5PO1KFD73S type=del size=841748 2024-09-12T17:05:02.108 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.103+0000 7f026be9d8c0 1 < completed part key=_multipart_LHKLWIUAT08F.2~HLHCJ94NZF8X.0 size=1048576 2024-09-12T17:05:02.110 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.107+0000 7f026be9d8c0 1 < completed part key=_multipart_LHKLWIUAT08F.2~HLHCJ94NZF8X.1 size=1048576 2024-09-12T17:05:02.111 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.107+0000 7f026be9d8c0 1 < canceled part key=_multipart_LHKLWIUAT08F.2~HLHCJ94NZF8X.2 size=291618 2024-09-12T17:05:02.116 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.111+0000 7f026be9d8c0 1 < canceled multipart upload key=LHKLWIUAT08F upload=HLHCJ94NZF8X tag=T0WQ07CCCW4C type=write size=3437346 2024-09-12T17:05:02.120 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.115+0000 7f026be9d8c0 1 > prepared operation key=XLKR6P8RNRVO tag=R5H8IKIXEMQC type=write size=38693 2024-09-12T17:05:02.124 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.119+0000 7f026be9d8c0 1 < completed delete operation key=PQSQ39X3O64P tag=PYWQPX1D6EAK type=del 2024-09-12T17:05:02.127 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.123+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=C7Y52GIGZ16G type=del size=4055200 2024-09-12T17:05:02.131 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.127+0000 7f026be9d8c0 1 < completed delete operation key=21ZD52VBZIO4 tag=6HDLVKX7YZSH type=del 2024-09-12T17:05:02.134 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.131+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=YENBVOY4WULL type=write size=372184 2024-09-12T17:05:02.137 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.131+0000 7f026be9d8c0 1 < completed delete operation key=UU88OS653L8D tag=NI9XER5GJ1RB type=del 2024-09-12T17:05:02.143 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.139+0000 7f026be9d8c0 1 > prepared part key=_multipart_4U1W97V0OX11.2~RF1F7ED36ZEN.0 size=1048576 2024-09-12T17:05:02.146 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.143+0000 7f026be9d8c0 1 > prepared part key=_multipart_4U1W97V0OX11.2~RF1F7ED36ZEN.1 size=1048576 2024-09-12T17:05:02.148 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.143+0000 7f026be9d8c0 1 > prepared part key=_multipart_4U1W97V0OX11.2~RF1F7ED36ZEN.2 size=725194 2024-09-12T17:05:02.148 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.143+0000 7f026be9d8c0 1 > prepared multipart upload key=4U1W97V0OX11 upload=RF1F7ED36ZEN tag=1SBQ8KUEBADA type=write size=3870922 2024-09-12T17:05:02.152 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.147+0000 7f026be9d8c0 1 < completed part key=_multipart_PQSQ39X3O64P.2~KDDK1ZD5MRQ9.0 size=1048576 2024-09-12T17:05:02.154 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.151+0000 7f026be9d8c0 1 < completed part key=_multipart_PQSQ39X3O64P.2~KDDK1ZD5MRQ9.1 size=857018 2024-09-12T17:05:02.160 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.155+0000 7f026be9d8c0 1 < completed multipart upload key=PQSQ39X3O64P upload=KDDK1ZD5MRQ9 tag=5J0K8L1H0POQ type=write size=2954170 2024-09-12T17:05:02.164 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.159+0000 7f026be9d8c0 1 > prepared operation key=SO3HLQZA8B6B tag=Y7Q3ZKSWY3U7 type=write size=697602 2024-09-12T17:05:02.168 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.163+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~X478DSZMVUYW.0 size=1048576 2024-09-12T17:05:02.172 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.167+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~X478DSZMVUYW.1 size=1048576 2024-09-12T17:05:02.173 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.167+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~X478DSZMVUYW.2 size=210672 2024-09-12T17:05:02.178 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.175+0000 7f026be9d8c0 1 < completed multipart upload key=4G3BKGNT3YZC upload=X478DSZMVUYW tag=N40GK9JQI79O type=write size=3356400 2024-09-12T17:05:02.184 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.179+0000 7f026be9d8c0 1 > prepared part key=_multipart_3JADN360QEO3.2~50QH4TEIY8OD.0 size=1048576 2024-09-12T17:05:02.186 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.183+0000 7f026be9d8c0 1 > prepared part key=_multipart_3JADN360QEO3.2~50QH4TEIY8OD.1 size=1048576 2024-09-12T17:05:02.189 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.183+0000 7f026be9d8c0 1 > prepared part key=_multipart_3JADN360QEO3.2~50QH4TEIY8OD.2 size=487207 2024-09-12T17:05:02.189 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.183+0000 7f026be9d8c0 1 > prepared multipart upload key=3JADN360QEO3 upload=50QH4TEIY8OD tag=5PGSU42CUJSX type=write size=3632935 2024-09-12T17:05:02.195 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.191+0000 7f026be9d8c0 1 < suggested update operation key=21ZD52VBZIO4 tag=QH6F2OGW1CUV type=del size=3638478 2024-09-12T17:05:02.198 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.195+0000 7f026be9d8c0 1 > prepared operation key=6VO85REZG2NW tag=7P76V8SPKLDY type=del size=598473 2024-09-12T17:05:02.202 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.199+0000 7f026be9d8c0 1 < completed delete operation key=ALFGNC1YNROX tag=1RWXENHV3P4A type=del 2024-09-12T17:05:02.205 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.199+0000 7f026be9d8c0 1 > prepared operation key=Y27CDEOCM7DH tag=R9KQNIH8ZP6N type=write size=1031804 2024-09-12T17:05:02.208 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.203+0000 7f026be9d8c0 1 < completed write operation key=JJMEQ2O00SA2 tag=0AKVYJ0EIRB9 type=write size=441106 2024-09-12T17:05:02.212 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.207+0000 7f026be9d8c0 1 > prepared operation key=L194KQIPFLE1 tag=3CJ2DSEFKJHO type=del size=2596608 2024-09-12T17:05:02.215 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.211+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~6PR4SG4YN0LO.0 size=1048576 2024-09-12T17:05:02.218 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.211+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~6PR4SG4YN0LO.1 size=1048576 2024-09-12T17:05:02.220 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.215+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~6PR4SG4YN0LO.2 size=491503 2024-09-12T17:05:02.226 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.223+0000 7f026be9d8c0 1 < completed multipart upload key=J8MU1A0CWSAQ upload=6PR4SG4YN0LO tag=F2D4WG20IFHI type=write size=3637231 2024-09-12T17:05:02.232 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.227+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~INPHOY81GO40.0 size=871632 2024-09-12T17:05:02.232 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.227+0000 7f026be9d8c0 1 > prepared multipart upload key=8AFDAVJLMRD2 upload=INPHOY81GO40 tag=U2MDPTMDN0AA type=write size=1920208 2024-09-12T17:05:02.235 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.231+0000 7f026be9d8c0 1 < completed part key=_multipart_SGT8IC1GJ3IG.2~JTV7UJAYN8AB.0 size=631029 2024-09-12T17:05:02.241 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.235+0000 7f026be9d8c0 1 < completed multipart upload key=SGT8IC1GJ3IG upload=JTV7UJAYN8AB tag=PQT1BDVCGSZT type=write size=1679605 2024-09-12T17:05:02.244 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.239+0000 7f026be9d8c0 1 > prepared operation key=MVYWUWKSYQ9Z tag=HMIJIAU8627B type=del size=3704096 2024-09-12T17:05:02.248 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.243+0000 7f026be9d8c0 1 < completed delete operation key=L194KQIPFLE1 tag=ADGHSJ2HHBQ5 type=del 2024-09-12T17:05:02.251 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.247+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=5UG81XGVCNWC type=del size=1177670 2024-09-12T17:05:02.255 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.251+0000 7f026be9d8c0 1 < completed delete operation key=U8W1SAVSLTBF tag=8BCZ0RZJV0ZU type=del 2024-09-12T17:05:02.258 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.255+0000 7f026be9d8c0 1 > prepared operation key=8AFDAVJLMRD2 tag=K4LESZWJ1XMX type=del size=1168704 2024-09-12T17:05:02.262 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.255+0000 7f026be9d8c0 1 < completed delete operation key=8AFDAVJLMRD2 tag=1Q5CCLOPDIBR type=del 2024-09-12T17:05:02.268 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.263+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~WKX2SKIAIJ1C.0 size=1048576 2024-09-12T17:05:02.271 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.267+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~WKX2SKIAIJ1C.1 size=269850 2024-09-12T17:05:02.271 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.267+0000 7f026be9d8c0 1 > prepared multipart upload key=UU88OS653L8D upload=WKX2SKIAIJ1C tag=EVYQ0HV21555 type=write size=2367002 2024-09-12T17:05:02.278 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.275+0000 7f026be9d8c0 1 < suggested remove operation key=BW1T21LBUE2D tag=311GKXBD2KQD type=del 2024-09-12T17:05:02.282 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.279+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=3MGP1RCH0G8U type=del size=1934698 2024-09-12T17:05:02.285 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.279+0000 7f026be9d8c0 1 < completed delete operation key=SGT8IC1GJ3IG tag=UB5PO1KFD73S type=del 2024-09-12T17:05:02.289 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.283+0000 7f026be9d8c0 1 > prepared operation key=BBYDPSXZKHZP tag=MB61LJ5L5092 type=write size=886719 2024-09-12T17:05:02.296 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.291+0000 7f026be9d8c0 1 < suggested remove operation key=XLKR6P8RNRVO tag=R5H8IKIXEMQC type=write 2024-09-12T17:05:02.303 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.299+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~9WUO3U7K7Y1R.0 size=191695 2024-09-12T17:05:02.303 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.299+0000 7f026be9d8c0 1 > prepared multipart upload key=2BQJ30RQQ25L upload=9WUO3U7K7Y1R tag=MCMJJRV68KTJ type=write size=1240271 2024-09-12T17:05:02.315 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.311+0000 7f026be9d8c0 1 < suggested update operation key=21ZD52VBZIO4 tag=C7Y52GIGZ16G type=del size=4055200 2024-09-12T17:05:02.319 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.315+0000 7f026be9d8c0 1 > prepared operation key=BW1T21LBUE2D tag=IBXHAEP7ST58 type=del size=1589142 2024-09-12T17:05:02.323 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.319+0000 7f026be9d8c0 -1 < failed to complete operation key=21ZD52VBZIO4 tag=YENBVOY4WULL type=write size=372184: (22) Invalid argument 2024-09-12T17:05:02.327 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.323+0000 7f026be9d8c0 1 > prepared operation key=Z183NH6R676V tag=YYTAIW7USYOZ type=del size=3669386 2024-09-12T17:05:02.331 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.327+0000 7f026be9d8c0 1 < completed part key=_multipart_4U1W97V0OX11.2~RF1F7ED36ZEN.0 size=1048576 2024-09-12T17:05:02.334 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.327+0000 7f026be9d8c0 1 < completed part key=_multipart_4U1W97V0OX11.2~RF1F7ED36ZEN.1 size=1048576 2024-09-12T17:05:02.337 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.331+0000 7f026be9d8c0 1 < completed part key=_multipart_4U1W97V0OX11.2~RF1F7ED36ZEN.2 size=725194 2024-09-12T17:05:02.343 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.339+0000 7f026be9d8c0 1 < completed multipart upload key=4U1W97V0OX11 upload=RF1F7ED36ZEN tag=1SBQ8KUEBADA type=write size=3870922 2024-09-12T17:05:02.349 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.343+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~1FTMQBIFYUD7.0 size=1048576 2024-09-12T17:05:02.352 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.347+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~1FTMQBIFYUD7.1 size=1048576 2024-09-12T17:05:02.354 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.351+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~1FTMQBIFYUD7.2 size=785128 2024-09-12T17:05:02.354 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.351+0000 7f026be9d8c0 1 > prepared multipart upload key=JJMEQ2O00SA2 upload=1FTMQBIFYUD7 tag=8KAF498WCBYM type=write size=3930856 2024-09-12T17:05:02.358 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.355+0000 7f026be9d8c0 1 < completed write operation key=SO3HLQZA8B6B tag=Y7Q3ZKSWY3U7 type=write size=697602 2024-09-12T17:05:02.364 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.359+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~WD7H8OXD3YTK.0 size=1048576 2024-09-12T17:05:02.367 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.363+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~WD7H8OXD3YTK.1 size=842413 2024-09-12T17:05:02.367 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.363+0000 7f026be9d8c0 1 > prepared multipart upload key=XLKR6P8RNRVO upload=WD7H8OXD3YTK tag=NIC5UA082TR9 type=write size=2939565 2024-09-12T17:05:02.370 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.367+0000 7f026be9d8c0 1 < completed part key=_multipart_3JADN360QEO3.2~50QH4TEIY8OD.0 size=1048576 2024-09-12T17:05:02.373 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.367+0000 7f026be9d8c0 1 < completed part key=_multipart_3JADN360QEO3.2~50QH4TEIY8OD.1 size=1048576 2024-09-12T17:05:02.376 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.371+0000 7f026be9d8c0 1 < completed part key=_multipart_3JADN360QEO3.2~50QH4TEIY8OD.2 size=487207 2024-09-12T17:05:02.381 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.375+0000 7f026be9d8c0 1 < completed multipart upload key=3JADN360QEO3 upload=50QH4TEIY8OD tag=5PGSU42CUJSX type=write size=3632935 2024-09-12T17:05:02.384 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.379+0000 7f026be9d8c0 1 > prepared operation key=XLKR6P8RNRVO tag=RP414JK55U7X type=del size=4126190 2024-09-12T17:05:02.387 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.383+0000 7f026be9d8c0 1 < completed delete operation key=6VO85REZG2NW tag=7P76V8SPKLDY type=del 2024-09-12T17:05:02.393 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.387+0000 7f026be9d8c0 1 > prepared part key=_multipart_SGT8IC1GJ3IG.2~4NU5TOOB7BVK.0 size=477430 2024-09-12T17:05:02.393 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.387+0000 7f026be9d8c0 1 > prepared multipart upload key=SGT8IC1GJ3IG upload=4NU5TOOB7BVK tag=ODI1T18HJJ0U type=write size=1526006 2024-09-12T17:05:02.396 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.391+0000 7f026be9d8c0 1 < completed write operation key=Y27CDEOCM7DH tag=R9KQNIH8ZP6N type=write size=1031804 2024-09-12T17:05:02.400 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.395+0000 7f026be9d8c0 1 > prepared operation key=8AFDAVJLMRD2 tag=L8ESVDOTSULR type=del size=1925650 2024-09-12T17:05:02.407 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.403+0000 7f026be9d8c0 1 < suggested remove operation key=L194KQIPFLE1 tag=3CJ2DSEFKJHO type=del 2024-09-12T17:05:02.410 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.407+0000 7f026be9d8c0 1 > prepared operation key=6VO85REZG2NW tag=IRROMBXR7729 type=del size=2570664 2024-09-12T17:05:02.414 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.407+0000 7f026be9d8c0 1 < completed part key=_multipart_8AFDAVJLMRD2.2~INPHOY81GO40.0 size=871632 2024-09-12T17:05:02.419 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.415+0000 7f026be9d8c0 1 < completed multipart upload key=8AFDAVJLMRD2 upload=INPHOY81GO40 tag=U2MDPTMDN0AA type=write size=1920208 2024-09-12T17:05:02.425 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.419+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~623662U88AQM.0 size=541048 2024-09-12T17:05:02.426 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.419+0000 7f026be9d8c0 1 > prepared multipart upload key=GPUFWJ3AWEMX upload=623662U88AQM tag=VJU8NX28TA5G type=write size=1589624 2024-09-12T17:05:02.429 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.423+0000 7f026be9d8c0 1 < completed delete operation key=MVYWUWKSYQ9Z tag=HMIJIAU8627B type=del 2024-09-12T17:05:02.435 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.431+0000 7f026be9d8c0 1 > prepared part key=_multipart_4U1W97V0OX11.2~R6ARKBTKZ72I.0 size=1048576 2024-09-12T17:05:02.438 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.431+0000 7f026be9d8c0 1 > prepared part key=_multipart_4U1W97V0OX11.2~R6ARKBTKZ72I.1 size=1048576 2024-09-12T17:05:02.440 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.435+0000 7f026be9d8c0 1 > prepared part key=_multipart_4U1W97V0OX11.2~R6ARKBTKZ72I.2 size=691055 2024-09-12T17:05:02.440 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.435+0000 7f026be9d8c0 1 > prepared multipart upload key=4U1W97V0OX11 upload=R6ARKBTKZ72I tag=XZ6O1B0LZBR0 type=write size=3836783 2024-09-12T17:05:02.444 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.439+0000 7f026be9d8c0 -1 < failed to complete operation key=21ZD52VBZIO4 tag=5UG81XGVCNWC type=del size=1177670: (22) Invalid argument 2024-09-12T17:05:02.447 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.443+0000 7f026be9d8c0 1 > prepared operation key=SGT8IC1GJ3IG tag=N4KDE11VG6OG type=del size=4055224 2024-09-12T17:05:02.451 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.447+0000 7f026be9d8c0 1 < completed delete operation key=8AFDAVJLMRD2 tag=K4LESZWJ1XMX type=del 2024-09-12T17:05:02.454 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.451+0000 7f026be9d8c0 1 > prepared operation key=XNBE2II106VZ tag=VMIONUQIN37Q type=del size=894604 2024-09-12T17:05:02.458 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.451+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~WKX2SKIAIJ1C.0 size=1048576 2024-09-12T17:05:02.460 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.455+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~WKX2SKIAIJ1C.1 size=269850 2024-09-12T17:05:02.466 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.463+0000 7f026be9d8c0 1 < completed multipart upload key=UU88OS653L8D upload=WKX2SKIAIJ1C tag=EVYQ0HV21555 type=write size=2367002 2024-09-12T17:05:02.472 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.467+0000 7f026be9d8c0 1 > prepared part key=_multipart_4U1W97V0OX11.2~YZQNG0DWKOR9.0 size=429314 2024-09-12T17:05:02.472 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.467+0000 7f026be9d8c0 1 > prepared multipart upload key=4U1W97V0OX11 upload=YZQNG0DWKOR9 tag=SUEKQLEJ7EXP type=write size=1477890 2024-09-12T17:05:02.475 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.471+0000 7f026be9d8c0 -1 < failed to complete operation key=21ZD52VBZIO4 tag=3MGP1RCH0G8U type=del size=1934698: (22) Invalid argument 2024-09-12T17:05:02.482 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.479+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~M9EFY3711OAC.0 size=1048576 2024-09-12T17:05:02.485 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.479+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~M9EFY3711OAC.1 size=596102 2024-09-12T17:05:02.485 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.479+0000 7f026be9d8c0 1 > prepared multipart upload key=2BQJ30RQQ25L upload=M9EFY3711OAC tag=FZD70UJA2P35 type=write size=2693254 2024-09-12T17:05:02.489 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.483+0000 7f026be9d8c0 1 < canceled operation key=BBYDPSXZKHZP tag=MB61LJ5L5092 type=write size=886719 2024-09-12T17:05:02.492 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.487+0000 7f026be9d8c0 1 > prepared operation key=BBYDPSXZKHZP tag=MO9M9EHBDU72 type=del size=1520390 2024-09-12T17:05:02.495 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.491+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~9WUO3U7K7Y1R.0 size=191695 2024-09-12T17:05:02.501 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.495+0000 7f026be9d8c0 1 < completed multipart upload key=2BQJ30RQQ25L upload=9WUO3U7K7Y1R tag=MCMJJRV68KTJ type=write size=1240271 2024-09-12T17:05:02.508 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.503+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~LVZPGOW8UB16.0 size=949665 2024-09-12T17:05:02.508 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.503+0000 7f026be9d8c0 1 > prepared multipart upload key=JJMEQ2O00SA2 upload=LVZPGOW8UB16 tag=K70USIZSNBBC type=write size=1998241 2024-09-12T17:05:02.511 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.507+0000 7f026be9d8c0 1 < completed delete operation key=BW1T21LBUE2D tag=IBXHAEP7ST58 type=del 2024-09-12T17:05:02.515 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.511+0000 7f026be9d8c0 1 > prepared operation key=Z9YNIEQCVNBA tag=C4I0SDMCE935 type=write size=927817 2024-09-12T17:05:02.519 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.515+0000 7f026be9d8c0 1 < completed delete operation key=Z183NH6R676V tag=YYTAIW7USYOZ type=del 2024-09-12T17:05:02.522 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.519+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=3ZDDT0TGJRGJ type=del size=1170009 2024-09-12T17:05:02.526 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.523+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~1FTMQBIFYUD7.0 size=1048576 2024-09-12T17:05:02.529 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.523+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~1FTMQBIFYUD7.1 size=1048576 2024-09-12T17:05:02.531 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.527+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~1FTMQBIFYUD7.2 size=785128 2024-09-12T17:05:02.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.531+0000 7f026be9d8c0 1 < completed multipart upload key=JJMEQ2O00SA2 upload=1FTMQBIFYUD7 tag=8KAF498WCBYM type=write size=3930856 2024-09-12T17:05:02.543 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.539+0000 7f026be9d8c0 1 > prepared part key=_multipart_RBNN03IPZ8BT.2~S4VJOKR33A6G.0 size=189654 2024-09-12T17:05:02.543 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.539+0000 7f026be9d8c0 1 > prepared multipart upload key=RBNN03IPZ8BT upload=S4VJOKR33A6G tag=9YVC6QFFFA6W type=write size=1238230 2024-09-12T17:05:02.544 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.539+0000 7f026be9d8c0 1 < canceled part key=_multipart_XLKR6P8RNRVO.2~WD7H8OXD3YTK.0 size=1048576 2024-09-12T17:05:02.547 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.543+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~WD7H8OXD3YTK.1 size=842413 2024-09-12T17:05:02.553 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.547+0000 7f026be9d8c0 1 < canceled multipart upload key=XLKR6P8RNRVO upload=WD7H8OXD3YTK tag=NIC5UA082TR9 type=write size=2939565 2024-09-12T17:05:02.559 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.555+0000 7f026be9d8c0 1 > prepared part key=_multipart_SGT8IC1GJ3IG.2~GN3VJ1WCPXC4.0 size=1048576 2024-09-12T17:05:02.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.555+0000 7f026be9d8c0 1 > prepared part key=_multipart_SGT8IC1GJ3IG.2~GN3VJ1WCPXC4.1 size=1048576 2024-09-12T17:05:02.564 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.559+0000 7f026be9d8c0 1 > prepared part key=_multipart_SGT8IC1GJ3IG.2~GN3VJ1WCPXC4.2 size=48998 2024-09-12T17:05:02.564 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.559+0000 7f026be9d8c0 1 > prepared multipart upload key=SGT8IC1GJ3IG upload=GN3VJ1WCPXC4 tag=C0BQDCAESG65 type=write size=3194726 2024-09-12T17:05:02.568 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.563+0000 7f026be9d8c0 1 < completed delete operation key=XLKR6P8RNRVO tag=RP414JK55U7X type=del 2024-09-12T17:05:02.574 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.567+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~QTV70Y2BDBEW.0 size=1048576 2024-09-12T17:05:02.576 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.571+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~QTV70Y2BDBEW.1 size=1048576 2024-09-12T17:05:02.579 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.575+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~QTV70Y2BDBEW.2 size=610204 2024-09-12T17:05:02.580 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.575+0000 7f026be9d8c0 1 > prepared multipart upload key=SL2446KSB531 upload=QTV70Y2BDBEW tag=HZTNZZ0EKXO2 type=write size=3755932 2024-09-12T17:05:02.580 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.575+0000 7f026be9d8c0 1 < canceled part key=_multipart_SGT8IC1GJ3IG.2~4NU5TOOB7BVK.0 size=477430 2024-09-12T17:05:02.585 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.579+0000 7f026be9d8c0 1 < canceled multipart upload key=SGT8IC1GJ3IG upload=4NU5TOOB7BVK tag=ODI1T18HJJ0U type=write size=1526006 2024-09-12T17:05:02.592 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.587+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~FS9GOMOJHITV.0 size=716195 2024-09-12T17:05:02.592 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.587+0000 7f026be9d8c0 1 > prepared multipart upload key=UU88OS653L8D upload=FS9GOMOJHITV tag=A5QLWG83LTG2 type=write size=1764771 2024-09-12T17:05:02.595 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.591+0000 7f026be9d8c0 1 < completed delete operation key=8AFDAVJLMRD2 tag=L8ESVDOTSULR type=del 2024-09-12T17:05:02.599 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.595+0000 7f026be9d8c0 1 > prepared operation key=QVQ4TI319DH5 tag=UPW40YT0F497 type=del size=621519 2024-09-12T17:05:02.603 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.599+0000 7f026be9d8c0 1 < completed delete operation key=6VO85REZG2NW tag=IRROMBXR7729 type=del 2024-09-12T17:05:02.608 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.603+0000 7f026be9d8c0 1 > prepared part key=_multipart_E0Y3SKNUYCQS.2~XV1ZJJN5SL9I.0 size=395035 2024-09-12T17:05:02.608 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.603+0000 7f026be9d8c0 1 > prepared multipart upload key=E0Y3SKNUYCQS upload=XV1ZJJN5SL9I tag=9NG7F3V4FE7C type=write size=1443611 2024-09-12T17:05:02.612 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.607+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~623662U88AQM.0 size=541048 2024-09-12T17:05:02.617 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.611+0000 7f026be9d8c0 1 < completed multipart upload key=GPUFWJ3AWEMX upload=623662U88AQM tag=VJU8NX28TA5G type=write size=1589624 2024-09-12T17:05:02.620 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.615+0000 7f026be9d8c0 1 > prepared operation key=PQSQ39X3O64P tag=0OGM2FTL95XW type=write size=361511 2024-09-12T17:05:02.623 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.619+0000 7f026be9d8c0 1 < completed part key=_multipart_4U1W97V0OX11.2~R6ARKBTKZ72I.0 size=1048576 2024-09-12T17:05:02.626 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.623+0000 7f026be9d8c0 1 < completed part key=_multipart_4U1W97V0OX11.2~R6ARKBTKZ72I.1 size=1048576 2024-09-12T17:05:02.626 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.623+0000 7f026be9d8c0 1 < canceled part key=_multipart_4U1W97V0OX11.2~R6ARKBTKZ72I.2 size=691055 2024-09-12T17:05:02.634 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.631+0000 7f026be9d8c0 1 < canceled multipart upload key=4U1W97V0OX11 upload=R6ARKBTKZ72I tag=XZ6O1B0LZBR0 type=write size=3836783 2024-09-12T17:05:02.641 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.635+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~MUEA5YPUZFL1.0 size=612984 2024-09-12T17:05:02.641 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.635+0000 7f026be9d8c0 1 > prepared multipart upload key=Y27CDEOCM7DH upload=MUEA5YPUZFL1 tag=HVYNOULD4PQ8 type=write size=1661560 2024-09-12T17:05:02.644 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.639+0000 7f026be9d8c0 1 < canceled operation key=SGT8IC1GJ3IG tag=N4KDE11VG6OG type=del size=4055224 2024-09-12T17:05:02.647 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.643+0000 7f026be9d8c0 1 > prepared operation key=MVYWUWKSYQ9Z tag=V041F4R7EI8Y type=write size=977486 2024-09-12T17:05:02.653 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.647+0000 7f026be9d8c0 1 < suggested remove operation key=XNBE2II106VZ tag=VMIONUQIN37Q type=del 2024-09-12T17:05:02.660 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.655+0000 7f026be9d8c0 1 > prepared part key=_multipart_LHKLWIUAT08F.2~ECN8KN5YRC1J.0 size=1048576 2024-09-12T17:05:02.662 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.659+0000 7f026be9d8c0 1 > prepared part key=_multipart_LHKLWIUAT08F.2~ECN8KN5YRC1J.1 size=1048576 2024-09-12T17:05:02.665 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.659+0000 7f026be9d8c0 1 > prepared part key=_multipart_LHKLWIUAT08F.2~ECN8KN5YRC1J.2 size=675801 2024-09-12T17:05:02.665 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.659+0000 7f026be9d8c0 1 > prepared multipart upload key=LHKLWIUAT08F upload=ECN8KN5YRC1J tag=9EKDI5I0L53I type=write size=3821529 2024-09-12T17:05:02.669 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.663+0000 7f026be9d8c0 1 < completed part key=_multipart_4U1W97V0OX11.2~YZQNG0DWKOR9.0 size=429314 2024-09-12T17:05:02.674 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.671+0000 7f026be9d8c0 1 < completed multipart upload key=4U1W97V0OX11 upload=YZQNG0DWKOR9 tag=SUEKQLEJ7EXP type=write size=1477890 2024-09-12T17:05:02.680 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.675+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~3BO731G0IMYI.0 size=1048576 2024-09-12T17:05:02.683 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.679+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~3BO731G0IMYI.1 size=1048576 2024-09-12T17:05:02.686 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.683+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~3BO731G0IMYI.2 size=394779 2024-09-12T17:05:02.686 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.683+0000 7f026be9d8c0 1 > prepared multipart upload key=BW1T21LBUE2D upload=3BO731G0IMYI tag=5QCZZF5AFGM4 type=write size=3540507 2024-09-12T17:05:02.689 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.683+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~M9EFY3711OAC.0 size=1048576 2024-09-12T17:05:02.692 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.687+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~M9EFY3711OAC.1 size=596102 2024-09-12T17:05:02.699 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.695+0000 7f026be9d8c0 1 < completed multipart upload key=2BQJ30RQQ25L upload=M9EFY3711OAC tag=FZD70UJA2P35 type=write size=2693254 2024-09-12T17:05:02.702 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.699+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=IWHWTKIQ6994 type=del size=2074876 2024-09-12T17:05:02.706 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.703+0000 7f026be9d8c0 1 < completed delete operation key=BBYDPSXZKHZP tag=MO9M9EHBDU72 type=del 2024-09-12T17:05:02.713 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.707+0000 7f026be9d8c0 1 > prepared part key=_multipart_4U1W97V0OX11.2~EKKKH3OUZORC.0 size=269637 2024-09-12T17:05:02.713 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.707+0000 7f026be9d8c0 1 > prepared multipart upload key=4U1W97V0OX11 upload=EKKKH3OUZORC tag=V0D3RRCPLGA4 type=write size=1318213 2024-09-12T17:05:02.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.715+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~LVZPGOW8UB16.0 size=949665 2024-09-12T17:05:02.724 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.719+0000 7f026be9d8c0 1 < completed multipart upload key=JJMEQ2O00SA2 upload=LVZPGOW8UB16 tag=K70USIZSNBBC type=write size=1998241 2024-09-12T17:05:02.730 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.727+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~OCYT8V0NBTA4.0 size=621849 2024-09-12T17:05:02.730 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.727+0000 7f026be9d8c0 1 > prepared multipart upload key=JJMEQ2O00SA2 upload=OCYT8V0NBTA4 tag=SG2LUACQA780 type=write size=1670425 2024-09-12T17:05:02.734 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.731+0000 7f026be9d8c0 1 < completed write operation key=Z9YNIEQCVNBA tag=C4I0SDMCE935 type=write size=927817 2024-09-12T17:05:02.737 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.731+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=5RJADHOD7RK6 type=del size=2496217 2024-09-12T17:05:02.741 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.735+0000 7f026be9d8c0 1 < canceled operation key=RBNN03IPZ8BT tag=3ZDDT0TGJRGJ type=del size=1170009 2024-09-12T17:05:02.747 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.743+0000 7f026be9d8c0 1 > prepared part key=_multipart_MVYWUWKSYQ9Z.2~1VPQKTL9V01Y.0 size=1048576 2024-09-12T17:05:02.749 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.743+0000 7f026be9d8c0 1 > prepared part key=_multipart_MVYWUWKSYQ9Z.2~1VPQKTL9V01Y.1 size=1048576 2024-09-12T17:05:02.752 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.747+0000 7f026be9d8c0 1 > prepared part key=_multipart_MVYWUWKSYQ9Z.2~1VPQKTL9V01Y.2 size=544426 2024-09-12T17:05:02.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.747+0000 7f026be9d8c0 1 > prepared multipart upload key=MVYWUWKSYQ9Z upload=1VPQKTL9V01Y tag=AGUZ03BT25EQ type=write size=3690154 2024-09-12T17:05:02.756 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.751+0000 7f026be9d8c0 1 < completed part key=_multipart_RBNN03IPZ8BT.2~S4VJOKR33A6G.0 size=189654 2024-09-12T17:05:02.762 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.759+0000 7f026be9d8c0 1 < completed multipart upload key=RBNN03IPZ8BT upload=S4VJOKR33A6G tag=9YVC6QFFFA6W type=write size=1238230 2024-09-12T17:05:02.766 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.763+0000 7f026be9d8c0 1 > prepared operation key=J8MU1A0CWSAQ tag=X7L8AVHYUHEG type=del size=3806664 2024-09-12T17:05:02.770 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.767+0000 7f026be9d8c0 1 < completed part key=_multipart_SGT8IC1GJ3IG.2~GN3VJ1WCPXC4.0 size=1048576 2024-09-12T17:05:02.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.767+0000 7f026be9d8c0 1 < completed part key=_multipart_SGT8IC1GJ3IG.2~GN3VJ1WCPXC4.1 size=1048576 2024-09-12T17:05:02.777 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.771+0000 7f026be9d8c0 1 < completed part key=_multipart_SGT8IC1GJ3IG.2~GN3VJ1WCPXC4.2 size=48998 2024-09-12T17:05:02.784 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.779+0000 7f026be9d8c0 1 < completed multipart upload key=SGT8IC1GJ3IG upload=GN3VJ1WCPXC4 tag=C0BQDCAESG65 type=write size=3194726 2024-09-12T17:05:02.788 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.783+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=2F8RPTUH97UI type=del size=533062 2024-09-12T17:05:02.792 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.787+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~QTV70Y2BDBEW.0 size=1048576 2024-09-12T17:05:02.795 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.791+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~QTV70Y2BDBEW.1 size=1048576 2024-09-12T17:05:02.797 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.791+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~QTV70Y2BDBEW.2 size=610204 2024-09-12T17:05:02.804 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.799+0000 7f026be9d8c0 1 < completed multipart upload key=SL2446KSB531 upload=QTV70Y2BDBEW tag=HZTNZZ0EKXO2 type=write size=3755932 2024-09-12T17:05:02.807 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.803+0000 7f026be9d8c0 1 > prepared operation key=32XUMOWT8HO2 tag=9C44CHKK1CHX type=del size=690248 2024-09-12T17:05:02.811 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.807+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~FS9GOMOJHITV.0 size=716195 2024-09-12T17:05:02.817 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.811+0000 7f026be9d8c0 1 < completed multipart upload key=UU88OS653L8D upload=FS9GOMOJHITV tag=A5QLWG83LTG2 type=write size=1764771 2024-09-12T17:05:02.820 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.815+0000 7f026be9d8c0 1 > prepared operation key=UU88OS653L8D tag=JR86YD7KRTNV type=del size=3545013 2024-09-12T17:05:02.824 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.819+0000 7f026be9d8c0 1 < completed delete operation key=QVQ4TI319DH5 tag=UPW40YT0F497 type=del 2024-09-12T17:05:02.831 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.827+0000 7f026be9d8c0 1 > prepared part key=_multipart_PQSQ39X3O64P.2~AKK2U46V3KS4.0 size=1048576 2024-09-12T17:05:02.834 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.827+0000 7f026be9d8c0 1 > prepared part key=_multipart_PQSQ39X3O64P.2~AKK2U46V3KS4.1 size=1048576 2024-09-12T17:05:02.837 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.831+0000 7f026be9d8c0 1 > prepared part key=_multipart_PQSQ39X3O64P.2~AKK2U46V3KS4.2 size=993490 2024-09-12T17:05:02.837 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.831+0000 7f026be9d8c0 1 > prepared multipart upload key=PQSQ39X3O64P upload=AKK2U46V3KS4 tag=1MXVXCMWCX6L type=write size=4139218 2024-09-12T17:05:02.840 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.835+0000 7f026be9d8c0 1 < completed part key=_multipart_E0Y3SKNUYCQS.2~XV1ZJJN5SL9I.0 size=395035 2024-09-12T17:05:02.847 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.843+0000 7f026be9d8c0 1 < completed multipart upload key=E0Y3SKNUYCQS upload=XV1ZJJN5SL9I tag=9NG7F3V4FE7C type=write size=1443611 2024-09-12T17:05:02.850 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.847+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=F8J5AV5WB7AB type=write size=315390 2024-09-12T17:05:02.854 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.851+0000 7f026be9d8c0 1 < completed write operation key=PQSQ39X3O64P tag=0OGM2FTL95XW type=write size=361511 2024-09-12T17:05:02.860 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.855+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~JUNL881PYVSM.0 size=1048576 2024-09-12T17:05:02.863 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.859+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~JUNL881PYVSM.1 size=1048576 2024-09-12T17:05:02.866 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.863+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~JUNL881PYVSM.2 size=1013202 2024-09-12T17:05:02.866 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.863+0000 7f026be9d8c0 1 > prepared multipart upload key=8AFDAVJLMRD2 upload=JUNL881PYVSM tag=3KM3J4BWSMNC type=write size=4158930 2024-09-12T17:05:02.869 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.863+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~MUEA5YPUZFL1.0 size=612984 2024-09-12T17:05:02.875 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.871+0000 7f026be9d8c0 1 < completed multipart upload key=Y27CDEOCM7DH upload=MUEA5YPUZFL1 tag=HVYNOULD4PQ8 type=write size=1661560 2024-09-12T17:05:02.881 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.875+0000 7f026be9d8c0 1 > prepared part key=_multipart_T6QRDTQRHBPI.2~VIA6ZBQAHAHH.0 size=1048576 2024-09-12T17:05:02.883 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.879+0000 7f026be9d8c0 1 > prepared part key=_multipart_T6QRDTQRHBPI.2~VIA6ZBQAHAHH.1 size=542680 2024-09-12T17:05:02.883 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.879+0000 7f026be9d8c0 1 > prepared multipart upload key=T6QRDTQRHBPI upload=VIA6ZBQAHAHH tag=9UBHMYMR2FCH type=write size=2639832 2024-09-12T17:05:02.886 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.883+0000 7f026be9d8c0 1 < completed write operation key=MVYWUWKSYQ9Z tag=V041F4R7EI8Y type=write size=977486 2024-09-12T17:05:02.893 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.887+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~UYY6PL3S6M7T.0 size=1048576 2024-09-12T17:05:02.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.891+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~UYY6PL3S6M7T.1 size=1048576 2024-09-12T17:05:02.898 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.895+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~UYY6PL3S6M7T.2 size=826002 2024-09-12T17:05:02.898 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.895+0000 7f026be9d8c0 1 > prepared multipart upload key=J8MU1A0CWSAQ upload=UYY6PL3S6M7T tag=AGLAA4YD49FH type=write size=3971730 2024-09-12T17:05:02.899 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.895+0000 7f026be9d8c0 1 < canceled part key=_multipart_LHKLWIUAT08F.2~ECN8KN5YRC1J.0 size=1048576 2024-09-12T17:05:02.901 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.895+0000 7f026be9d8c0 1 < completed part key=_multipart_LHKLWIUAT08F.2~ECN8KN5YRC1J.1 size=1048576 2024-09-12T17:05:02.904 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.899+0000 7f026be9d8c0 1 < completed part key=_multipart_LHKLWIUAT08F.2~ECN8KN5YRC1J.2 size=675801 2024-09-12T17:05:02.909 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.903+0000 7f026be9d8c0 1 < canceled multipart upload key=LHKLWIUAT08F upload=ECN8KN5YRC1J tag=9EKDI5I0L53I type=write size=3821529 2024-09-12T17:05:02.912 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.907+0000 7f026be9d8c0 1 > prepared operation key=SL2446KSB531 tag=5IPHDX26I88V type=del size=2419285 2024-09-12T17:05:02.916 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.911+0000 7f026be9d8c0 1 < completed part key=_multipart_BW1T21LBUE2D.2~3BO731G0IMYI.0 size=1048576 2024-09-12T17:05:02.918 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.915+0000 7f026be9d8c0 1 < completed part key=_multipart_BW1T21LBUE2D.2~3BO731G0IMYI.1 size=1048576 2024-09-12T17:05:02.921 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.915+0000 7f026be9d8c0 1 < completed part key=_multipart_BW1T21LBUE2D.2~3BO731G0IMYI.2 size=394779 2024-09-12T17:05:02.926 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.923+0000 7f026be9d8c0 1 < completed multipart upload key=BW1T21LBUE2D upload=3BO731G0IMYI tag=5QCZZF5AFGM4 type=write size=3540507 2024-09-12T17:05:02.932 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.927+0000 7f026be9d8c0 1 > prepared part key=_multipart_L194KQIPFLE1.2~6QHF4BBXWMKX.0 size=457172 2024-09-12T17:05:02.933 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.927+0000 7f026be9d8c0 1 > prepared multipart upload key=L194KQIPFLE1 upload=6QHF4BBXWMKX tag=IGGYIDHN11T6 type=write size=1505748 2024-09-12T17:05:02.936 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.931+0000 7f026be9d8c0 1 < completed delete operation key=21ZD52VBZIO4 tag=IWHWTKIQ6994 type=del 2024-09-12T17:05:02.939 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.935+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=RKK2YS3KGL48 type=del size=2086234 2024-09-12T17:05:02.942 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.939+0000 7f026be9d8c0 1 < completed part key=_multipart_4U1W97V0OX11.2~EKKKH3OUZORC.0 size=269637 2024-09-12T17:05:02.950 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.947+0000 7f026be9d8c0 1 < completed multipart upload key=4U1W97V0OX11 upload=EKKKH3OUZORC tag=V0D3RRCPLGA4 type=write size=1318213 2024-09-12T17:05:02.954 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.947+0000 7f026be9d8c0 1 > prepared operation key=SGT8IC1GJ3IG tag=5X10ILT2UN01 type=del size=420211 2024-09-12T17:05:02.957 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.951+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~OCYT8V0NBTA4.0 size=621849 2024-09-12T17:05:02.962 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.959+0000 7f026be9d8c0 1 < completed multipart upload key=JJMEQ2O00SA2 upload=OCYT8V0NBTA4 tag=SG2LUACQA780 type=write size=1670425 2024-09-12T17:05:02.968 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.963+0000 7f026be9d8c0 1 > prepared part key=_multipart_RBNN03IPZ8BT.2~PF0ADRV9BDOZ.0 size=755499 2024-09-12T17:05:02.968 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.963+0000 7f026be9d8c0 1 > prepared multipart upload key=RBNN03IPZ8BT upload=PF0ADRV9BDOZ tag=2GQ1PEWE53DX type=write size=1804075 2024-09-12T17:05:02.971 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.967+0000 7f026be9d8c0 1 < completed delete operation key=RBNN03IPZ8BT tag=5RJADHOD7RK6 type=del 2024-09-12T17:05:02.974 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.971+0000 7f026be9d8c0 1 > prepared operation key=SO3HLQZA8B6B tag=UYT1COW8IR74 type=del size=1710070 2024-09-12T17:05:02.974 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.971+0000 7f026be9d8c0 1 < canceled part key=_multipart_MVYWUWKSYQ9Z.2~1VPQKTL9V01Y.0 size=1048576 2024-09-12T17:05:02.977 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.971+0000 7f026be9d8c0 1 < completed part key=_multipart_MVYWUWKSYQ9Z.2~1VPQKTL9V01Y.1 size=1048576 2024-09-12T17:05:02.980 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.975+0000 7f026be9d8c0 1 < completed part key=_multipart_MVYWUWKSYQ9Z.2~1VPQKTL9V01Y.2 size=544426 2024-09-12T17:05:02.985 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.979+0000 7f026be9d8c0 1 < canceled multipart upload key=MVYWUWKSYQ9Z upload=1VPQKTL9V01Y tag=AGUZ03BT25EQ type=write size=3690154 2024-09-12T17:05:02.992 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.987+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~9CEXUL5MRXYQ.0 size=1048576 2024-09-12T17:05:02.993 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.987+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~9CEXUL5MRXYQ.1 size=1048576 2024-09-12T17:05:02.996 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.991+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~9CEXUL5MRXYQ.2 size=892605 2024-09-12T17:05:02.996 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.991+0000 7f026be9d8c0 1 > prepared multipart upload key=8AFDAVJLMRD2 upload=9CEXUL5MRXYQ tag=00L1OU7NI5MH type=write size=4038333 2024-09-12T17:05:02.999 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.995+0000 7f026be9d8c0 1 < completed delete operation key=J8MU1A0CWSAQ tag=X7L8AVHYUHEG type=del 2024-09-12T17:05:03.002 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:02.999+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=WQU2RPR4OLFF type=del size=3155129 2024-09-12T17:05:03.008 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.003+0000 7f026be9d8c0 1 < suggested remove operation key=21ZD52VBZIO4 tag=2F8RPTUH97UI type=del 2024-09-12T17:05:03.012 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.007+0000 7f026be9d8c0 1 > prepared operation key=LHKLWIUAT08F tag=41LQ0AZIYDI2 type=del size=199322 2024-09-12T17:05:03.018 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.015+0000 7f026be9d8c0 1 < suggested update operation key=32XUMOWT8HO2 tag=9C44CHKK1CHX type=del size=690248 2024-09-12T17:05:03.022 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.019+0000 7f026be9d8c0 1 > prepared operation key=XNBE2II106VZ tag=XC3NQLS30K54 type=del size=980328 2024-09-12T17:05:03.025 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.019+0000 7f026be9d8c0 1 < completed delete operation key=UU88OS653L8D tag=JR86YD7KRTNV type=del 2024-09-12T17:05:03.031 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.027+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~YKOA6G03UHIP.0 size=845853 2024-09-12T17:05:03.031 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.027+0000 7f026be9d8c0 1 > prepared multipart upload key=QVQ4TI319DH5 upload=YKOA6G03UHIP tag=6PGEY0NB0W15 type=write size=1894429 2024-09-12T17:05:03.034 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.031+0000 7f026be9d8c0 1 < completed part key=_multipart_PQSQ39X3O64P.2~AKK2U46V3KS4.0 size=1048576 2024-09-12T17:05:03.037 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.031+0000 7f026be9d8c0 1 < completed part key=_multipart_PQSQ39X3O64P.2~AKK2U46V3KS4.1 size=1048576 2024-09-12T17:05:03.039 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.035+0000 7f026be9d8c0 1 < completed part key=_multipart_PQSQ39X3O64P.2~AKK2U46V3KS4.2 size=993490 2024-09-12T17:05:03.044 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.039+0000 7f026be9d8c0 1 < completed multipart upload key=PQSQ39X3O64P upload=AKK2U46V3KS4 tag=1MXVXCMWCX6L type=write size=4139218 2024-09-12T17:05:03.047 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.043+0000 7f026be9d8c0 1 > prepared operation key=J8MU1A0CWSAQ tag=R4MF2Q9XYGWT type=write size=649409 2024-09-12T17:05:03.053 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.047+0000 7f026be9d8c0 1 < suggested update operation key=U8W1SAVSLTBF tag=F8J5AV5WB7AB type=write size=315390 2024-09-12T17:05:03.058 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.055+0000 7f026be9d8c0 1 > prepared part key=_multipart_MVYWUWKSYQ9Z.2~RFDOCNNMPWO1.0 size=1048576 2024-09-12T17:05:03.061 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.055+0000 7f026be9d8c0 1 > prepared part key=_multipart_MVYWUWKSYQ9Z.2~RFDOCNNMPWO1.1 size=810778 2024-09-12T17:05:03.061 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.055+0000 7f026be9d8c0 1 > prepared multipart upload key=MVYWUWKSYQ9Z upload=RFDOCNNMPWO1 tag=ALLC02X8TPEA type=write size=2907930 2024-09-12T17:05:03.064 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.059+0000 7f026be9d8c0 1 < completed part key=_multipart_8AFDAVJLMRD2.2~JUNL881PYVSM.0 size=1048576 2024-09-12T17:05:03.066 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.063+0000 7f026be9d8c0 1 < completed part key=_multipart_8AFDAVJLMRD2.2~JUNL881PYVSM.1 size=1048576 2024-09-12T17:05:03.068 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.063+0000 7f026be9d8c0 1 < completed part key=_multipart_8AFDAVJLMRD2.2~JUNL881PYVSM.2 size=1013202 2024-09-12T17:05:03.074 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.071+0000 7f026be9d8c0 1 < completed multipart upload key=8AFDAVJLMRD2 upload=JUNL881PYVSM tag=3KM3J4BWSMNC type=write size=4158930 2024-09-12T17:05:03.077 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.071+0000 7f026be9d8c0 1 > prepared operation key=QVQ4TI319DH5 tag=VYTD0AEKBDJK type=del size=1105372 2024-09-12T17:05:03.081 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.075+0000 7f026be9d8c0 1 < completed part key=_multipart_T6QRDTQRHBPI.2~VIA6ZBQAHAHH.0 size=1048576 2024-09-12T17:05:03.083 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.079+0000 7f026be9d8c0 1 < completed part key=_multipart_T6QRDTQRHBPI.2~VIA6ZBQAHAHH.1 size=542680 2024-09-12T17:05:03.089 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.083+0000 7f026be9d8c0 1 < completed multipart upload key=T6QRDTQRHBPI upload=VIA6ZBQAHAHH tag=9UBHMYMR2FCH type=write size=2639832 2024-09-12T17:05:03.095 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.091+0000 7f026be9d8c0 1 > prepared part key=_multipart_L194KQIPFLE1.2~A2O6S0P667SL.0 size=889756 2024-09-12T17:05:03.096 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.091+0000 7f026be9d8c0 1 > prepared multipart upload key=L194KQIPFLE1 upload=A2O6S0P667SL tag=W30CRYIYVZVW type=write size=1938332 2024-09-12T17:05:03.099 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.095+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~UYY6PL3S6M7T.0 size=1048576 2024-09-12T17:05:03.099 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.095+0000 7f026be9d8c0 1 < canceled part key=_multipart_J8MU1A0CWSAQ.2~UYY6PL3S6M7T.1 size=1048576 2024-09-12T17:05:03.101 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.095+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~UYY6PL3S6M7T.2 size=826002 2024-09-12T17:05:03.107 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.103+0000 7f026be9d8c0 1 < canceled multipart upload key=J8MU1A0CWSAQ upload=UYY6PL3S6M7T tag=AGLAA4YD49FH type=write size=3971730 2024-09-12T17:05:03.113 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.107+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~6PILU5X3UYNL.0 size=1048576 2024-09-12T17:05:03.116 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.111+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~6PILU5X3UYNL.1 size=142109 2024-09-12T17:05:03.116 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.111+0000 7f026be9d8c0 1 > prepared multipart upload key=SL2446KSB531 upload=6PILU5X3UYNL tag=AUKKNK1XH68V type=write size=2239261 2024-09-12T17:05:03.119 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.115+0000 7f026be9d8c0 1 < completed delete operation key=SL2446KSB531 tag=5IPHDX26I88V type=del 2024-09-12T17:05:03.124 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.119+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~DZPHTMUMB60U.0 size=120845 2024-09-12T17:05:03.124 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.119+0000 7f026be9d8c0 1 > prepared multipart upload key=6VO85REZG2NW upload=DZPHTMUMB60U tag=2UEKD6NM02KF type=write size=1169421 2024-09-12T17:05:03.127 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.123+0000 7f026be9d8c0 1 < completed part key=_multipart_L194KQIPFLE1.2~6QHF4BBXWMKX.0 size=457172 2024-09-12T17:05:03.132 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.127+0000 7f026be9d8c0 1 < completed multipart upload key=L194KQIPFLE1 upload=6QHF4BBXWMKX tag=IGGYIDHN11T6 type=write size=1505748 2024-09-12T17:05:03.138 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.135+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z183NH6R676V.2~QLUAE3WBPL6K.0 size=1048576 2024-09-12T17:05:03.140 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.135+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z183NH6R676V.2~QLUAE3WBPL6K.1 size=1048576 2024-09-12T17:05:03.143 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.139+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z183NH6R676V.2~QLUAE3WBPL6K.2 size=302195 2024-09-12T17:05:03.143 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.139+0000 7f026be9d8c0 1 > prepared multipart upload key=Z183NH6R676V upload=QLUAE3WBPL6K tag=DLKASFHGB45O type=write size=3447923 2024-09-12T17:05:03.145 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.139+0000 7f026be9d8c0 -1 < no bi entry to suggest for operation key=21ZD52VBZIO4 tag=RKK2YS3KGL48 type=del size=2086234: (2) No such file or directory 2024-09-12T17:05:03.148 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.143+0000 7f026be9d8c0 1 > prepared operation key=XLKR6P8RNRVO tag=W32S6ZSZ01YB type=del size=905970 2024-09-12T17:05:03.155 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.151+0000 7f026be9d8c0 1 < suggested remove operation key=SGT8IC1GJ3IG tag=5X10ILT2UN01 type=del 2024-09-12T17:05:03.158 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.155+0000 7f026be9d8c0 1 > prepared operation key=MVYWUWKSYQ9Z tag=0TJM0V7ASQ4Q type=write size=901941 2024-09-12T17:05:03.161 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.155+0000 7f026be9d8c0 1 < completed part key=_multipart_RBNN03IPZ8BT.2~PF0ADRV9BDOZ.0 size=755499 2024-09-12T17:05:03.167 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.163+0000 7f026be9d8c0 1 < completed multipart upload key=RBNN03IPZ8BT upload=PF0ADRV9BDOZ tag=2GQ1PEWE53DX type=write size=1804075 2024-09-12T17:05:03.170 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.167+0000 7f026be9d8c0 1 > prepared operation key=6VO85REZG2NW tag=I2H45PD8I2EB type=del size=378742 2024-09-12T17:05:03.174 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.171+0000 7f026be9d8c0 1 < completed delete operation key=SO3HLQZA8B6B tag=UYT1COW8IR74 type=del 2024-09-12T17:05:03.177 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.171+0000 7f026be9d8c0 1 > prepared operation key=SL2446KSB531 tag=CS2O9BMFVIFY type=write size=293036 2024-09-12T17:05:03.182 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.175+0000 7f026be9d8c0 1 < completed part key=_multipart_8AFDAVJLMRD2.2~9CEXUL5MRXYQ.0 size=1048576 2024-09-12T17:05:03.183 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.179+0000 7f026be9d8c0 1 < completed part key=_multipart_8AFDAVJLMRD2.2~9CEXUL5MRXYQ.1 size=1048576 2024-09-12T17:05:03.186 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.183+0000 7f026be9d8c0 1 < completed part key=_multipart_8AFDAVJLMRD2.2~9CEXUL5MRXYQ.2 size=892605 2024-09-12T17:05:03.191 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.187+0000 7f026be9d8c0 1 < completed multipart upload key=8AFDAVJLMRD2 upload=9CEXUL5MRXYQ tag=00L1OU7NI5MH type=write size=4038333 2024-09-12T17:05:03.197 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.191+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~MB4WYKAZFG53.0 size=1048576 2024-09-12T17:05:03.200 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.195+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~MB4WYKAZFG53.1 size=947339 2024-09-12T17:05:03.201 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.195+0000 7f026be9d8c0 1 > prepared multipart upload key=2BQJ30RQQ25L upload=MB4WYKAZFG53 tag=SMEMHCJBOW9T type=write size=3044491 2024-09-12T17:05:03.202 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.199+0000 7f026be9d8c0 1 < completed delete operation key=3JADN360QEO3 tag=WQU2RPR4OLFF type=del 2024-09-12T17:05:03.205 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.199+0000 7f026be9d8c0 1 > prepared operation key=SGT8IC1GJ3IG tag=055H3WV7QIDV type=write size=480667 2024-09-12T17:05:03.209 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.203+0000 7f026be9d8c0 1 < completed delete operation key=LHKLWIUAT08F tag=41LQ0AZIYDI2 type=del 2024-09-12T17:05:03.212 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.207+0000 7f026be9d8c0 1 > prepared operation key=Z183NH6R676V tag=GKXDZHV143C5 type=del size=2268914 2024-09-12T17:05:03.215 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.211+0000 7f026be9d8c0 1 < canceled operation key=XNBE2II106VZ tag=XC3NQLS30K54 type=del size=980328 2024-09-12T17:05:03.219 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.215+0000 7f026be9d8c0 1 > prepared operation key=L194KQIPFLE1 tag=PM8GAQ0ZPMXO type=del size=112435 2024-09-12T17:05:03.222 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.219+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~YKOA6G03UHIP.0 size=845853 2024-09-12T17:05:03.227 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.223+0000 7f026be9d8c0 1 < completed multipart upload key=QVQ4TI319DH5 upload=YKOA6G03UHIP tag=6PGEY0NB0W15 type=write size=1894429 2024-09-12T17:05:03.229 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.223+0000 7f026be9d8c0 1 > prepared operation key=QVQ4TI319DH5 tag=28HIXYNI66O8 type=del size=2921603 2024-09-12T17:05:03.236 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.231+0000 7f026be9d8c0 1 < suggested remove operation key=J8MU1A0CWSAQ tag=R4MF2Q9XYGWT type=write 2024-09-12T17:05:03.239 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.235+0000 7f026be9d8c0 1 > prepared operation key=GPUFWJ3AWEMX tag=PDN690XDKTGU type=del size=1334156 2024-09-12T17:05:03.243 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.239+0000 7f026be9d8c0 1 < completed part key=_multipart_MVYWUWKSYQ9Z.2~RFDOCNNMPWO1.0 size=1048576 2024-09-12T17:05:03.249 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.243+0000 7f026be9d8c0 1 < completed part key=_multipart_MVYWUWKSYQ9Z.2~RFDOCNNMPWO1.1 size=810778 2024-09-12T17:05:03.254 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.251+0000 7f026be9d8c0 1 < completed multipart upload key=MVYWUWKSYQ9Z upload=RFDOCNNMPWO1 tag=ALLC02X8TPEA type=write size=2907930 2024-09-12T17:05:03.260 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.255+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~FI0XB7120NAI.0 size=633553 2024-09-12T17:05:03.260 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.255+0000 7f026be9d8c0 1 > prepared multipart upload key=8AFDAVJLMRD2 upload=FI0XB7120NAI tag=FSN9396CM6TI type=write size=1682129 2024-09-12T17:05:03.266 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.263+0000 7f026be9d8c0 1 < suggested remove operation key=QVQ4TI319DH5 tag=VYTD0AEKBDJK type=del 2024-09-12T17:05:03.269 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.263+0000 7f026be9d8c0 1 > prepared operation key=32XUMOWT8HO2 tag=N57EORIC0038 type=del size=801892 2024-09-12T17:05:03.273 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.267+0000 7f026be9d8c0 1 < completed part key=_multipart_L194KQIPFLE1.2~A2O6S0P667SL.0 size=889756 2024-09-12T17:05:03.278 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.275+0000 7f026be9d8c0 1 < completed multipart upload key=L194KQIPFLE1 upload=A2O6S0P667SL tag=W30CRYIYVZVW type=write size=1938332 2024-09-12T17:05:03.285 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.279+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~3CVOMW4R9KXO.0 size=1048576 2024-09-12T17:05:03.288 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.283+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~3CVOMW4R9KXO.1 size=1018844 2024-09-12T17:05:03.288 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.283+0000 7f026be9d8c0 1 > prepared multipart upload key=BW1T21LBUE2D upload=3CVOMW4R9KXO tag=EUNGQ97PMXU4 type=write size=3115996 2024-09-12T17:05:03.292 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.287+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~6PILU5X3UYNL.0 size=1048576 2024-09-12T17:05:03.294 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.291+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~6PILU5X3UYNL.1 size=142109 2024-09-12T17:05:03.301 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.295+0000 7f026be9d8c0 1 < completed multipart upload key=SL2446KSB531 upload=6PILU5X3UYNL tag=AUKKNK1XH68V type=write size=2239261 2024-09-12T17:05:03.304 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.299+0000 7f026be9d8c0 1 > prepared operation key=8AFDAVJLMRD2 tag=KH9ZN12YQL4B type=del size=1519396 2024-09-12T17:05:03.309 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.303+0000 7f026be9d8c0 1 < completed part key=_multipart_6VO85REZG2NW.2~DZPHTMUMB60U.0 size=120845 2024-09-12T17:05:03.314 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.311+0000 7f026be9d8c0 1 < completed multipart upload key=6VO85REZG2NW upload=DZPHTMUMB60U tag=2UEKD6NM02KF type=write size=1169421 2024-09-12T17:05:03.319 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.315+0000 7f026be9d8c0 1 > prepared part key=_multipart_MVYWUWKSYQ9Z.2~5I9EYV9P3VY4.0 size=332866 2024-09-12T17:05:03.319 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.315+0000 7f026be9d8c0 1 > prepared multipart upload key=MVYWUWKSYQ9Z upload=5I9EYV9P3VY4 tag=70NM04M0JHCV type=write size=1381442 2024-09-12T17:05:03.323 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.319+0000 7f026be9d8c0 1 < completed part key=_multipart_Z183NH6R676V.2~QLUAE3WBPL6K.0 size=1048576 2024-09-12T17:05:03.326 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.323+0000 7f026be9d8c0 1 < completed part key=_multipart_Z183NH6R676V.2~QLUAE3WBPL6K.1 size=1048576 2024-09-12T17:05:03.328 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.323+0000 7f026be9d8c0 1 < completed part key=_multipart_Z183NH6R676V.2~QLUAE3WBPL6K.2 size=302195 2024-09-12T17:05:03.334 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.331+0000 7f026be9d8c0 1 < completed multipart upload key=Z183NH6R676V upload=QLUAE3WBPL6K tag=DLKASFHGB45O type=write size=3447923 2024-09-12T17:05:03.338 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.335+0000 7f026be9d8c0 1 > prepared operation key=8AFDAVJLMRD2 tag=7JGK3QEQKV48 type=del size=2683184 2024-09-12T17:05:03.342 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.335+0000 7f026be9d8c0 1 < completed delete operation key=XLKR6P8RNRVO tag=W32S6ZSZ01YB type=del 2024-09-12T17:05:03.345 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.339+0000 7f026be9d8c0 1 > prepared operation key=BBYDPSXZKHZP tag=DMDBD6RH2413 type=write size=479799 2024-09-12T17:05:03.348 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.343+0000 7f026be9d8c0 1 < completed write operation key=MVYWUWKSYQ9Z tag=0TJM0V7ASQ4Q type=write size=901941 2024-09-12T17:05:03.355 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.351+0000 7f026be9d8c0 1 > prepared part key=_multipart_BBYDPSXZKHZP.2~7H02RS3Y5AY0.0 size=1048576 2024-09-12T17:05:03.358 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.351+0000 7f026be9d8c0 1 > prepared part key=_multipart_BBYDPSXZKHZP.2~7H02RS3Y5AY0.1 size=6510 2024-09-12T17:05:03.358 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.355+0000 7f026be9d8c0 1 > prepared multipart upload key=BBYDPSXZKHZP upload=7H02RS3Y5AY0 tag=P7002P2BA007 type=write size=2103662 2024-09-12T17:05:03.365 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.359+0000 7f026be9d8c0 1 < suggested update operation key=6VO85REZG2NW tag=I2H45PD8I2EB type=del size=378742 2024-09-12T17:05:03.371 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.367+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~7VX87XSKTKO1.0 size=1040751 2024-09-12T17:05:03.371 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.367+0000 7f026be9d8c0 1 > prepared multipart upload key=QVQ4TI319DH5 upload=7VX87XSKTKO1 tag=0RAEZB1AGMQJ type=write size=2089327 2024-09-12T17:05:03.375 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.371+0000 7f026be9d8c0 1 < completed write operation key=SL2446KSB531 tag=CS2O9BMFVIFY type=write size=293036 2024-09-12T17:05:03.378 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.375+0000 7f026be9d8c0 1 > prepared operation key=QVQ4TI319DH5 tag=LVKPE7GPWCRB type=del size=1244064 2024-09-12T17:05:03.381 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.375+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~MB4WYKAZFG53.0 size=1048576 2024-09-12T17:05:03.384 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.379+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~MB4WYKAZFG53.1 size=947339 2024-09-12T17:05:03.389 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.383+0000 7f026be9d8c0 1 < completed multipart upload key=2BQJ30RQQ25L upload=MB4WYKAZFG53 tag=SMEMHCJBOW9T type=write size=3044491 2024-09-12T17:05:03.393 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.387+0000 7f026be9d8c0 1 > prepared operation key=PQSQ39X3O64P tag=7621JSB32EYD type=del size=3291538 2024-09-12T17:05:03.397 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.391+0000 7f026be9d8c0 1 < completed write operation key=SGT8IC1GJ3IG tag=055H3WV7QIDV type=write size=480667 2024-09-12T17:05:03.401 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.395+0000 7f026be9d8c0 1 > prepared operation key=Y27CDEOCM7DH tag=MI9B3M7HCI9G type=del size=2140317 2024-09-12T17:05:03.404 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.399+0000 7f026be9d8c0 1 < completed delete operation key=Z183NH6R676V tag=GKXDZHV143C5 type=del 2024-09-12T17:05:03.411 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.407+0000 7f026be9d8c0 1 > prepared part key=_multipart_L194KQIPFLE1.2~MHJOR0TVLV5J.0 size=994262 2024-09-12T17:05:03.411 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.407+0000 7f026be9d8c0 1 > prepared multipart upload key=L194KQIPFLE1 upload=MHJOR0TVLV5J tag=Y3DOLZ6SGMNI type=write size=2042838 2024-09-12T17:05:03.414 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.411+0000 7f026be9d8c0 1 < completed delete operation key=L194KQIPFLE1 tag=PM8GAQ0ZPMXO type=del 2024-09-12T17:05:03.419 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.415+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~WU8BU3VGR5O2.0 size=1048576 2024-09-12T17:05:03.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.415+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~WU8BU3VGR5O2.1 size=1048576 2024-09-12T17:05:03.424 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.419+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~WU8BU3VGR5O2.2 size=58783 2024-09-12T17:05:03.424 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.419+0000 7f026be9d8c0 1 > prepared multipart upload key=2BQJ30RQQ25L upload=WU8BU3VGR5O2 tag=1VFHMFECVNA0 type=write size=3204511 2024-09-12T17:05:03.426 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.423+0000 7f026be9d8c0 -1 < failed to complete operation key=QVQ4TI319DH5 tag=28HIXYNI66O8 type=del size=2921603: (22) Invalid argument 2024-09-12T17:05:03.429 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.423+0000 7f026be9d8c0 1 > prepared operation key=UU88OS653L8D tag=0WXUDFLHW2KF type=del size=3805619 2024-09-12T17:05:03.432 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.427+0000 7f026be9d8c0 1 < completed delete operation key=GPUFWJ3AWEMX tag=PDN690XDKTGU type=del 2024-09-12T17:05:03.438 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.435+0000 7f026be9d8c0 1 > prepared part key=_multipart_RBNN03IPZ8BT.2~2ZOQVST8ITSX.0 size=1048576 2024-09-12T17:05:03.440 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.435+0000 7f026be9d8c0 1 > prepared part key=_multipart_RBNN03IPZ8BT.2~2ZOQVST8ITSX.1 size=359610 2024-09-12T17:05:03.440 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.435+0000 7f026be9d8c0 1 > prepared multipart upload key=RBNN03IPZ8BT upload=2ZOQVST8ITSX tag=L02B5DSO8JDP type=write size=2456762 2024-09-12T17:05:03.442 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.439+0000 7f026be9d8c0 1 < completed part key=_multipart_8AFDAVJLMRD2.2~FI0XB7120NAI.0 size=633553 2024-09-12T17:05:03.447 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.443+0000 7f026be9d8c0 1 < completed multipart upload key=8AFDAVJLMRD2 upload=FI0XB7120NAI tag=FSN9396CM6TI type=write size=1682129 2024-09-12T17:05:03.450 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.443+0000 7f026be9d8c0 1 > prepared operation key=4G3BKGNT3YZC tag=T4OAO7ETHSC1 type=write size=15749 2024-09-12T17:05:03.452 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.447+0000 7f026be9d8c0 1 < completed delete operation key=32XUMOWT8HO2 tag=N57EORIC0038 type=del 2024-09-12T17:05:03.457 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.451+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~U95PQNFME91G.0 size=1048576 2024-09-12T17:05:03.460 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.455+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~U95PQNFME91G.1 size=1048576 2024-09-12T17:05:03.462 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.455+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~U95PQNFME91G.2 size=471048 2024-09-12T17:05:03.462 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.455+0000 7f026be9d8c0 1 > prepared multipart upload key=8AFDAVJLMRD2 upload=U95PQNFME91G tag=A8E8NPKK3BYJ type=write size=3616776 2024-09-12T17:05:03.464 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.459+0000 7f026be9d8c0 1 < completed part key=_multipart_BW1T21LBUE2D.2~3CVOMW4R9KXO.0 size=1048576 2024-09-12T17:05:03.466 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.463+0000 7f026be9d8c0 1 < completed part key=_multipart_BW1T21LBUE2D.2~3CVOMW4R9KXO.1 size=1018844 2024-09-12T17:05:03.471 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.467+0000 7f026be9d8c0 1 < completed multipart upload key=BW1T21LBUE2D upload=3CVOMW4R9KXO tag=EUNGQ97PMXU4 type=write size=3115996 2024-09-12T17:05:03.474 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.467+0000 7f026be9d8c0 1 > prepared operation key=4G3BKGNT3YZC tag=D3LKSMMZCEKR type=del size=3340295 2024-09-12T17:05:03.476 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.471+0000 7f026be9d8c0 1 < completed delete operation key=8AFDAVJLMRD2 tag=KH9ZN12YQL4B type=del 2024-09-12T17:05:03.479 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.475+0000 7f026be9d8c0 1 > prepared operation key=L194KQIPFLE1 tag=UQ00V5YBSPOY type=del size=803337 2024-09-12T17:05:03.481 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.475+0000 7f026be9d8c0 1 < completed part key=_multipart_MVYWUWKSYQ9Z.2~5I9EYV9P3VY4.0 size=332866 2024-09-12T17:05:03.485 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.479+0000 7f026be9d8c0 1 < completed multipart upload key=MVYWUWKSYQ9Z upload=5I9EYV9P3VY4 tag=70NM04M0JHCV type=write size=1381442 2024-09-12T17:05:03.491 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.487+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~3G5TIJHDCD2F.0 size=1048576 2024-09-12T17:05:03.493 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.487+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~3G5TIJHDCD2F.1 size=392877 2024-09-12T17:05:03.493 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.487+0000 7f026be9d8c0 1 > prepared multipart upload key=Z9YNIEQCVNBA upload=3G5TIJHDCD2F tag=B0VZQB5UOZ1G type=write size=2490029 2024-09-12T17:05:03.496 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.491+0000 7f026be9d8c0 1 < completed delete operation key=8AFDAVJLMRD2 tag=7JGK3QEQKV48 type=del 2024-09-12T17:05:03.499 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.495+0000 7f026be9d8c0 1 > prepared operation key=MVYWUWKSYQ9Z tag=1H8HI2MGX9P3 type=del size=768284 2024-09-12T17:05:03.503 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.499+0000 7f026be9d8c0 1 < completed write operation key=BBYDPSXZKHZP tag=DMDBD6RH2413 type=write size=479799 2024-09-12T17:05:03.507 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.503+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~3SVCRBBD9P5E.0 size=1048576 2024-09-12T17:05:03.509 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.503+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~3SVCRBBD9P5E.1 size=1048576 2024-09-12T17:05:03.511 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.507+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~3SVCRBBD9P5E.2 size=936231 2024-09-12T17:05:03.511 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.507+0000 7f026be9d8c0 1 > prepared multipart upload key=SL2446KSB531 upload=3SVCRBBD9P5E tag=SYTXT5RP1OYG type=write size=4081959 2024-09-12T17:05:03.514 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.511+0000 7f026be9d8c0 1 < completed part key=_multipart_BBYDPSXZKHZP.2~7H02RS3Y5AY0.0 size=1048576 2024-09-12T17:05:03.516 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.511+0000 7f026be9d8c0 1 < completed part key=_multipart_BBYDPSXZKHZP.2~7H02RS3Y5AY0.1 size=6510 2024-09-12T17:05:03.521 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.515+0000 7f026be9d8c0 1 < completed multipart upload key=BBYDPSXZKHZP upload=7H02RS3Y5AY0 tag=P7002P2BA007 type=write size=2103662 2024-09-12T17:05:03.523 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.519+0000 7f026be9d8c0 1 > prepared operation key=L194KQIPFLE1 tag=BFMUQ35SVDJM type=del size=96870 2024-09-12T17:05:03.526 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.523+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~7VX87XSKTKO1.0 size=1040751 2024-09-12T17:05:03.531 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.527+0000 7f026be9d8c0 1 < completed multipart upload key=QVQ4TI319DH5 upload=7VX87XSKTKO1 tag=0RAEZB1AGMQJ type=write size=2089327 2024-09-12T17:05:03.541 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.535+0000 7f026be9d8c0 1 > prepared part key=_multipart_E0Y3SKNUYCQS.2~2I25K6L6ATZC.0 size=138966 2024-09-12T17:05:03.541 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.535+0000 7f026be9d8c0 1 > prepared multipart upload key=E0Y3SKNUYCQS upload=2I25K6L6ATZC tag=TUZLP94491Z0 type=write size=1187542 2024-09-12T17:05:03.544 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.539+0000 7f026be9d8c0 1 < completed delete operation key=QVQ4TI319DH5 tag=LVKPE7GPWCRB type=del 2024-09-12T17:05:03.549 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.543+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~B3L0JO1P6YCY.0 size=1048576 2024-09-12T17:05:03.551 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.547+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~B3L0JO1P6YCY.1 size=1048576 2024-09-12T17:05:03.553 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.547+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~B3L0JO1P6YCY.2 size=414546 2024-09-12T17:05:03.553 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.547+0000 7f026be9d8c0 1 > prepared multipart upload key=SL2446KSB531 upload=B3L0JO1P6YCY tag=CV9CVQ122Z84 type=write size=3560274 2024-09-12T17:05:03.556 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.551+0000 7f026be9d8c0 1 < completed delete operation key=PQSQ39X3O64P tag=7621JSB32EYD type=del 2024-09-12T17:05:03.561 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.555+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~6S1DZVDOKID4.0 size=1048576 2024-09-12T17:05:03.563 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.559+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~6S1DZVDOKID4.1 size=492602 2024-09-12T17:05:03.563 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.559+0000 7f026be9d8c0 1 > prepared multipart upload key=4G3BKGNT3YZC upload=6S1DZVDOKID4 tag=2ZTY7NVFUTW4 type=write size=2589754 2024-09-12T17:05:03.568 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.563+0000 7f026be9d8c0 1 < suggested update operation key=Y27CDEOCM7DH tag=MI9B3M7HCI9G type=del size=2140317 2024-09-12T17:05:03.571 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.567+0000 7f026be9d8c0 1 > prepared operation key=4G3BKGNT3YZC tag=HCSKBRZ9J5IT type=write size=833852 2024-09-12T17:05:03.574 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.571+0000 7f026be9d8c0 1 < completed part key=_multipart_L194KQIPFLE1.2~MHJOR0TVLV5J.0 size=994262 2024-09-12T17:05:03.579 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.575+0000 7f026be9d8c0 1 < completed multipart upload key=L194KQIPFLE1 upload=MHJOR0TVLV5J tag=Y3DOLZ6SGMNI type=write size=2042838 2024-09-12T17:05:03.582 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.579+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=I1X2012IULWQ type=write size=202729 2024-09-12T17:05:03.585 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.579+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~WU8BU3VGR5O2.0 size=1048576 2024-09-12T17:05:03.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.583+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~WU8BU3VGR5O2.1 size=1048576 2024-09-12T17:05:03.590 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.587+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~WU8BU3VGR5O2.2 size=58783 2024-09-12T17:05:03.596 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.591+0000 7f026be9d8c0 1 < completed multipart upload key=2BQJ30RQQ25L upload=WU8BU3VGR5O2 tag=1VFHMFECVNA0 type=write size=3204511 2024-09-12T17:05:03.600 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.595+0000 7f026be9d8c0 1 > prepared operation key=Y27CDEOCM7DH tag=LRG4ZXCSNLOS type=del size=3083028 2024-09-12T17:05:03.603 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.599+0000 7f026be9d8c0 1 < completed delete operation key=UU88OS653L8D tag=0WXUDFLHW2KF type=del 2024-09-12T17:05:03.606 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.603+0000 7f026be9d8c0 1 > prepared operation key=6VO85REZG2NW tag=HACNUDYUXVQW type=del size=3742340 2024-09-12T17:05:03.610 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.607+0000 7f026be9d8c0 1 < completed part key=_multipart_RBNN03IPZ8BT.2~2ZOQVST8ITSX.0 size=1048576 2024-09-12T17:05:03.612 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.607+0000 7f026be9d8c0 1 < completed part key=_multipart_RBNN03IPZ8BT.2~2ZOQVST8ITSX.1 size=359610 2024-09-12T17:05:03.617 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.611+0000 7f026be9d8c0 1 < completed multipart upload key=RBNN03IPZ8BT upload=2ZOQVST8ITSX tag=L02B5DSO8JDP type=write size=2456762 2024-09-12T17:05:03.622 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.619+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~1F1E7RRZ8AVN.0 size=1048576 2024-09-12T17:05:03.625 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.619+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~1F1E7RRZ8AVN.1 size=434262 2024-09-12T17:05:03.625 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.619+0000 7f026be9d8c0 1 > prepared multipart upload key=Z9YNIEQCVNBA upload=1F1E7RRZ8AVN tag=1BBNXJQNZ7VB type=write size=2531414 2024-09-12T17:05:03.628 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.623+0000 7f026be9d8c0 1 < completed write operation key=4G3BKGNT3YZC tag=T4OAO7ETHSC1 type=write size=15749 2024-09-12T17:05:03.633 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.627+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~U5SUBY7EAPAR.0 size=372428 2024-09-12T17:05:03.633 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.627+0000 7f026be9d8c0 1 > prepared multipart upload key=UU88OS653L8D upload=U5SUBY7EAPAR tag=EZMTEFLS08LA type=write size=1421004 2024-09-12T17:05:03.637 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.631+0000 7f026be9d8c0 1 < completed part key=_multipart_8AFDAVJLMRD2.2~U95PQNFME91G.0 size=1048576 2024-09-12T17:05:03.639 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.635+0000 7f026be9d8c0 1 < completed part key=_multipart_8AFDAVJLMRD2.2~U95PQNFME91G.1 size=1048576 2024-09-12T17:05:03.641 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.635+0000 7f026be9d8c0 1 < completed part key=_multipart_8AFDAVJLMRD2.2~U95PQNFME91G.2 size=471048 2024-09-12T17:05:03.646 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.643+0000 7f026be9d8c0 1 < completed multipart upload key=8AFDAVJLMRD2 upload=U95PQNFME91G tag=A8E8NPKK3BYJ type=write size=3616776 2024-09-12T17:05:03.650 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.647+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=ZNL9LAVYP01I type=del size=47836 2024-09-12T17:05:03.653 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.647+0000 7f026be9d8c0 1 < completed delete operation key=4G3BKGNT3YZC tag=D3LKSMMZCEKR type=del 2024-09-12T17:05:03.656 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.651+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=FEJ74LVIUGWF type=del size=1099010 2024-09-12T17:05:03.662 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.655+0000 7f026be9d8c0 1 < suggested remove operation key=L194KQIPFLE1 tag=UQ00V5YBSPOY type=del 2024-09-12T17:05:03.664 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.659+0000 7f026be9d8c0 1 > prepared operation key=UU88OS653L8D tag=8EHDBN5359HC type=del size=2175847 2024-09-12T17:05:03.667 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.663+0000 7f026be9d8c0 1 < completed part key=_multipart_Z9YNIEQCVNBA.2~3G5TIJHDCD2F.0 size=1048576 2024-09-12T17:05:03.669 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.663+0000 7f026be9d8c0 1 < completed part key=_multipart_Z9YNIEQCVNBA.2~3G5TIJHDCD2F.1 size=392877 2024-09-12T17:05:03.674 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.671+0000 7f026be9d8c0 1 < completed multipart upload key=Z9YNIEQCVNBA upload=3G5TIJHDCD2F tag=B0VZQB5UOZ1G type=write size=2490029 2024-09-12T17:05:03.679 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.675+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~J72K6C56QX3U.0 size=1048576 2024-09-12T17:05:03.681 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.675+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~J72K6C56QX3U.1 size=1048576 2024-09-12T17:05:03.684 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.679+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~J72K6C56QX3U.2 size=882856 2024-09-12T17:05:03.684 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.679+0000 7f026be9d8c0 1 > prepared multipart upload key=JJMEQ2O00SA2 upload=J72K6C56QX3U tag=APFTNGT9BCE6 type=write size=4028584 2024-09-12T17:05:03.686 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.683+0000 7f026be9d8c0 1 < completed delete operation key=MVYWUWKSYQ9Z tag=1H8HI2MGX9P3 type=del 2024-09-12T17:05:03.689 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.683+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=J90PV75KR8M8 type=del size=1758811 2024-09-12T17:05:03.692 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.687+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~3SVCRBBD9P5E.0 size=1048576 2024-09-12T17:05:03.694 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.691+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~3SVCRBBD9P5E.1 size=1048576 2024-09-12T17:05:03.696 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.691+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~3SVCRBBD9P5E.2 size=936231 2024-09-12T17:05:03.701 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.695+0000 7f026be9d8c0 1 < completed multipart upload key=SL2446KSB531 upload=3SVCRBBD9P5E tag=SYTXT5RP1OYG type=write size=4081959 2024-09-12T17:05:03.706 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.703+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~T0S1DN9ZG7PW.0 size=1048576 2024-09-12T17:05:03.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.703+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~T0S1DN9ZG7PW.1 size=1048576 2024-09-12T17:05:03.711 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.707+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~T0S1DN9ZG7PW.2 size=671993 2024-09-12T17:05:03.711 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.707+0000 7f026be9d8c0 1 > prepared multipart upload key=JJMEQ2O00SA2 upload=T0S1DN9ZG7PW tag=OMN8NZXKSJSN type=write size=3817721 2024-09-12T17:05:03.712 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.707+0000 7f026be9d8c0 -1 < no bi entry to suggest for operation key=L194KQIPFLE1 tag=BFMUQ35SVDJM type=del size=96870: (2) No such file or directory 2024-09-12T17:05:03.715 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.711+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=5UZK9WJHR0RT type=del size=3037708 2024-09-12T17:05:03.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.715+0000 7f026be9d8c0 1 < completed part key=_multipart_E0Y3SKNUYCQS.2~2I25K6L6ATZC.0 size=138966 2024-09-12T17:05:03.723 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.719+0000 7f026be9d8c0 1 < completed multipart upload key=E0Y3SKNUYCQS upload=2I25K6L6ATZC tag=TUZLP94491Z0 type=write size=1187542 2024-09-12T17:05:03.726 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.723+0000 7f026be9d8c0 1 > prepared operation key=T6QRDTQRHBPI tag=6UEXP5C65DIU type=del size=3753059 2024-09-12T17:05:03.729 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.723+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~B3L0JO1P6YCY.0 size=1048576 2024-09-12T17:05:03.731 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.727+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~B3L0JO1P6YCY.1 size=1048576 2024-09-12T17:05:03.733 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.727+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~B3L0JO1P6YCY.2 size=414546 2024-09-12T17:05:03.738 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.735+0000 7f026be9d8c0 1 < completed multipart upload key=SL2446KSB531 upload=B3L0JO1P6YCY tag=CV9CVQ122Z84 type=write size=3560274 2024-09-12T17:05:03.742 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.739+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~SPNCRD4HNX94.0 size=1048576 2024-09-12T17:05:03.744 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.739+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~SPNCRD4HNX94.1 size=79598 2024-09-12T17:05:03.744 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.739+0000 7f026be9d8c0 1 > prepared multipart upload key=XLKR6P8RNRVO upload=SPNCRD4HNX94 tag=FE0QQMOTVQNG type=write size=2176750 2024-09-12T17:05:03.746 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.743+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~6S1DZVDOKID4.0 size=1048576 2024-09-12T17:05:03.748 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.743+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~6S1DZVDOKID4.1 size=492602 2024-09-12T17:05:03.752 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.747+0000 7f026be9d8c0 1 < completed multipart upload key=4G3BKGNT3YZC upload=6S1DZVDOKID4 tag=2ZTY7NVFUTW4 type=write size=2589754 2024-09-12T17:05:03.755 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.751+0000 7f026be9d8c0 1 > prepared operation key=2BQJ30RQQ25L tag=8BPOA7EHDSVZ type=del size=3334794 2024-09-12T17:05:03.757 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.751+0000 7f026be9d8c0 1 < completed write operation key=4G3BKGNT3YZC tag=HCSKBRZ9J5IT type=write size=833852 2024-09-12T17:05:03.762 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.759+0000 7f026be9d8c0 1 > prepared part key=_multipart_L194KQIPFLE1.2~TYJTF0PSH2EU.0 size=1048576 2024-09-12T17:05:03.764 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.759+0000 7f026be9d8c0 1 > prepared part key=_multipart_L194KQIPFLE1.2~TYJTF0PSH2EU.1 size=1048576 2024-09-12T17:05:03.766 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.763+0000 7f026be9d8c0 1 > prepared part key=_multipart_L194KQIPFLE1.2~TYJTF0PSH2EU.2 size=622010 2024-09-12T17:05:03.766 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.763+0000 7f026be9d8c0 1 > prepared multipart upload key=L194KQIPFLE1 upload=TYJTF0PSH2EU tag=MZ6UL3QWCS7A type=write size=3767738 2024-09-12T17:05:03.771 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.767+0000 7f026be9d8c0 1 < suggested remove operation key=3JADN360QEO3 tag=I1X2012IULWQ type=write 2024-09-12T17:05:03.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.771+0000 7f026be9d8c0 1 > prepared operation key=JJMEQ2O00SA2 tag=RGETLQC03PA3 type=del size=2101086 2024-09-12T17:05:03.777 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.771+0000 7f026be9d8c0 1 < completed delete operation key=Y27CDEOCM7DH tag=LRG4ZXCSNLOS type=del 2024-09-12T17:05:03.780 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.775+0000 7f026be9d8c0 1 > prepared operation key=MVYWUWKSYQ9Z tag=9WCHVIIW7MU1 type=del size=1728117 2024-09-12T17:05:03.785 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.779+0000 7f026be9d8c0 1 < suggested remove operation key=6VO85REZG2NW tag=HACNUDYUXVQW type=del 2024-09-12T17:05:03.788 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.783+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=9P6G9YDQ4274 type=del size=1309021 2024-09-12T17:05:03.790 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.787+0000 7f026be9d8c0 1 < completed part key=_multipart_Z9YNIEQCVNBA.2~1F1E7RRZ8AVN.0 size=1048576 2024-09-12T17:05:03.792 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.787+0000 7f026be9d8c0 1 < completed part key=_multipart_Z9YNIEQCVNBA.2~1F1E7RRZ8AVN.1 size=434262 2024-09-12T17:05:03.798 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.791+0000 7f026be9d8c0 1 < completed multipart upload key=Z9YNIEQCVNBA upload=1F1E7RRZ8AVN tag=1BBNXJQNZ7VB type=write size=2531414 2024-09-12T17:05:03.802 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.799+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~IYH4XNZGA3EX.0 size=784613 2024-09-12T17:05:03.802 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.799+0000 7f026be9d8c0 1 > prepared multipart upload key=J8MU1A0CWSAQ upload=IYH4XNZGA3EX tag=37073HOX1ZH9 type=write size=1833189 2024-09-12T17:05:03.805 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.799+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~U5SUBY7EAPAR.0 size=372428 2024-09-12T17:05:03.808 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.803+0000 7f026be9d8c0 1 < completed multipart upload key=UU88OS653L8D upload=U5SUBY7EAPAR tag=EZMTEFLS08LA type=write size=1421004 2024-09-12T17:05:03.812 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.807+0000 7f026be9d8c0 1 > prepared operation key=SL2446KSB531 tag=WOO6P926C4E6 type=write size=978072 2024-09-12T17:05:03.813 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.807+0000 7f026be9d8c0 -1 < failed to complete operation key=3JADN360QEO3 tag=ZNL9LAVYP01I type=del size=47836: (22) Invalid argument 2024-09-12T17:05:03.815 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.811+0000 7f026be9d8c0 1 > prepared operation key=PQSQ39X3O64P tag=ZD1TJVAGT3Q4 type=del size=3626552 2024-09-12T17:05:03.818 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.815+0000 7f026be9d8c0 1 < completed delete operation key=21ZD52VBZIO4 tag=FEJ74LVIUGWF type=del 2024-09-12T17:05:03.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.815+0000 7f026be9d8c0 1 > prepared operation key=SGT8IC1GJ3IG tag=0UDK3FX0F6QU type=del size=2488780 2024-09-12T17:05:03.823 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.819+0000 7f026be9d8c0 1 < completed delete operation key=UU88OS653L8D tag=8EHDBN5359HC type=del 2024-09-12T17:05:03.826 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.823+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=Z42D5292EY0D type=del size=504875 2024-09-12T17:05:03.828 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.823+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~J72K6C56QX3U.0 size=1048576 2024-09-12T17:05:03.830 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.827+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~J72K6C56QX3U.1 size=1048576 2024-09-12T17:05:03.832 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.827+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~J72K6C56QX3U.2 size=882856 2024-09-12T17:05:03.836 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.831+0000 7f026be9d8c0 1 < completed multipart upload key=JJMEQ2O00SA2 upload=J72K6C56QX3U tag=APFTNGT9BCE6 type=write size=4028584 2024-09-12T17:05:03.839 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.835+0000 7f026be9d8c0 1 > prepared operation key=SL2446KSB531 tag=7AVJROM91LA5 type=del size=827167 2024-09-12T17:05:03.841 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.835+0000 7f026be9d8c0 1 < canceled operation key=RBNN03IPZ8BT tag=J90PV75KR8M8 type=del size=1758811 2024-09-12T17:05:03.846 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.843+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~YXEPR04EXN62.0 size=163260 2024-09-12T17:05:03.846 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.843+0000 7f026be9d8c0 1 > prepared multipart upload key=JJMEQ2O00SA2 upload=YXEPR04EXN62 tag=76FV0ISUKFQP type=write size=1211836 2024-09-12T17:05:03.848 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.843+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~T0S1DN9ZG7PW.0 size=1048576 2024-09-12T17:05:03.848 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.843+0000 7f026be9d8c0 1 < canceled part key=_multipart_JJMEQ2O00SA2.2~T0S1DN9ZG7PW.1 size=1048576 2024-09-12T17:05:03.850 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.847+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~T0S1DN9ZG7PW.2 size=671993 2024-09-12T17:05:03.855 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.851+0000 7f026be9d8c0 1 < canceled multipart upload key=JJMEQ2O00SA2 upload=T0S1DN9ZG7PW tag=OMN8NZXKSJSN type=write size=3817721 2024-09-12T17:05:03.860 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.855+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~VH48FYJR7ESX.0 size=1048576 2024-09-12T17:05:03.862 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.859+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~VH48FYJR7ESX.1 size=754171 2024-09-12T17:05:03.862 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.859+0000 7f026be9d8c0 1 > prepared multipart upload key=SL2446KSB531 upload=VH48FYJR7ESX tag=0JMDC5R330GI type=write size=2851323 2024-09-12T17:05:03.867 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.863+0000 7f026be9d8c0 1 < suggested remove operation key=U8W1SAVSLTBF tag=5UZK9WJHR0RT type=del 2024-09-12T17:05:03.871 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.867+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~LUGGUB9ZZDE1.0 size=1048576 2024-09-12T17:05:03.873 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.867+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~LUGGUB9ZZDE1.1 size=1048576 2024-09-12T17:05:03.874 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.871+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~LUGGUB9ZZDE1.2 size=718970 2024-09-12T17:05:03.874 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.871+0000 7f026be9d8c0 1 > prepared multipart upload key=2BQJ30RQQ25L upload=LUGGUB9ZZDE1 tag=3HKZKCDZLZEB type=write size=3864698 2024-09-12T17:05:03.877 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.871+0000 7f026be9d8c0 1 < completed delete operation key=T6QRDTQRHBPI tag=6UEXP5C65DIU type=del 2024-09-12T17:05:03.879 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.875+0000 7f026be9d8c0 1 > prepared operation key=PQSQ39X3O64P tag=FUSR8C5VLJLY type=write size=904457 2024-09-12T17:05:03.881 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.875+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~SPNCRD4HNX94.0 size=1048576 2024-09-12T17:05:03.882 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.875+0000 7f026be9d8c0 1 < canceled part key=_multipart_XLKR6P8RNRVO.2~SPNCRD4HNX94.1 size=79598 2024-09-12T17:05:03.886 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.879+0000 7f026be9d8c0 1 < canceled multipart upload key=XLKR6P8RNRVO upload=SPNCRD4HNX94 tag=FE0QQMOTVQNG type=write size=2176750 2024-09-12T17:05:03.890 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.887+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~33W62IMEO9QM.0 size=706026 2024-09-12T17:05:03.891 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.887+0000 7f026be9d8c0 1 > prepared multipart upload key=Z9YNIEQCVNBA upload=33W62IMEO9QM tag=IUUY72E6OWLD type=write size=1754602 2024-09-12T17:05:03.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.891+0000 7f026be9d8c0 1 < suggested update operation key=2BQJ30RQQ25L tag=8BPOA7EHDSVZ type=del size=3334794 2024-09-12T17:05:03.898 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.895+0000 7f026be9d8c0 1 > prepared operation key=ALFGNC1YNROX tag=8SXBS3Y3HO31 type=del size=2000046 2024-09-12T17:05:03.901 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.895+0000 7f026be9d8c0 1 < completed part key=_multipart_L194KQIPFLE1.2~TYJTF0PSH2EU.0 size=1048576 2024-09-12T17:05:03.903 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.899+0000 7f026be9d8c0 1 < completed part key=_multipart_L194KQIPFLE1.2~TYJTF0PSH2EU.1 size=1048576 2024-09-12T17:05:03.906 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.903+0000 7f026be9d8c0 1 < completed part key=_multipart_L194KQIPFLE1.2~TYJTF0PSH2EU.2 size=622010 2024-09-12T17:05:03.910 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.907+0000 7f026be9d8c0 1 < completed multipart upload key=L194KQIPFLE1 upload=TYJTF0PSH2EU tag=MZ6UL3QWCS7A type=write size=3767738 2024-09-12T17:05:03.914 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.911+0000 7f026be9d8c0 1 > prepared part key=_multipart_U8W1SAVSLTBF.2~8KY8G974SN80.0 size=1048576 2024-09-12T17:05:03.916 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.911+0000 7f026be9d8c0 1 > prepared part key=_multipart_U8W1SAVSLTBF.2~8KY8G974SN80.1 size=68696 2024-09-12T17:05:03.916 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.911+0000 7f026be9d8c0 1 > prepared multipart upload key=U8W1SAVSLTBF upload=8KY8G974SN80 tag=HHGYFRC09M7S type=write size=2165848 2024-09-12T17:05:03.918 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.915+0000 7f026be9d8c0 1 < completed delete operation key=JJMEQ2O00SA2 tag=RGETLQC03PA3 type=del 2024-09-12T17:05:03.921 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.915+0000 7f026be9d8c0 1 > prepared operation key=MVYWUWKSYQ9Z tag=VCGUJORG1ZK2 type=del size=961633 2024-09-12T17:05:03.923 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.919+0000 7f026be9d8c0 1 < completed delete operation key=MVYWUWKSYQ9Z tag=9WCHVIIW7MU1 type=del 2024-09-12T17:05:03.929 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.923+0000 7f026be9d8c0 1 > prepared part key=_multipart_21ZD52VBZIO4.2~LMHAQWP6M1QO.0 size=1048576 2024-09-12T17:05:03.931 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.927+0000 7f026be9d8c0 1 > prepared part key=_multipart_21ZD52VBZIO4.2~LMHAQWP6M1QO.1 size=184131 2024-09-12T17:05:03.931 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.927+0000 7f026be9d8c0 1 > prepared multipart upload key=21ZD52VBZIO4 upload=LMHAQWP6M1QO tag=9G3O4O7P4DLN type=write size=2281283 2024-09-12T17:05:03.933 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.927+0000 7f026be9d8c0 -1 < failed to complete operation key=U8W1SAVSLTBF tag=9P6G9YDQ4274 type=del size=1309021: (22) Invalid argument 2024-09-12T17:05:03.936 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.931+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=1WBGLO2NF2AR type=del size=1476945 2024-09-12T17:05:03.939 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.935+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~IYH4XNZGA3EX.0 size=784613 2024-09-12T17:05:03.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.939+0000 7f026be9d8c0 1 < completed multipart upload key=J8MU1A0CWSAQ upload=IYH4XNZGA3EX tag=37073HOX1ZH9 type=write size=1833189 2024-09-12T17:05:03.946 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.939+0000 7f026be9d8c0 1 > prepared operation key=Z9YNIEQCVNBA tag=QPFG0AOV6422 type=del size=2991006 2024-09-12T17:05:03.948 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.943+0000 7f026be9d8c0 1 < completed write operation key=SL2446KSB531 tag=WOO6P926C4E6 type=write size=978072 2024-09-12T17:05:03.952 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.947+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~K0DSQFRI7R6V.0 size=1048576 2024-09-12T17:05:03.954 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.951+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~K0DSQFRI7R6V.1 size=11810 2024-09-12T17:05:03.954 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.951+0000 7f026be9d8c0 1 > prepared multipart upload key=GPUFWJ3AWEMX upload=K0DSQFRI7R6V tag=ILXQTOH8DPVX type=write size=2108962 2024-09-12T17:05:03.957 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.951+0000 7f026be9d8c0 1 < completed delete operation key=PQSQ39X3O64P tag=ZD1TJVAGT3Q4 type=del 2024-09-12T17:05:03.959 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.955+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=DSN3U9NHCY4B type=del size=2767167 2024-09-12T17:05:03.962 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.959+0000 7f026be9d8c0 1 < completed delete operation key=SGT8IC1GJ3IG tag=0UDK3FX0F6QU type=del 2024-09-12T17:05:03.964 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.959+0000 7f026be9d8c0 1 > prepared operation key=Z9YNIEQCVNBA tag=34DPLM9NUKXL type=del size=3229623 2024-09-12T17:05:03.970 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.967+0000 7f026be9d8c0 1 < suggested update operation key=U8W1SAVSLTBF tag=Z42D5292EY0D type=del size=504875 2024-09-12T17:05:03.975 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.971+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~PIFSD30FNWHF.0 size=1048576 2024-09-12T17:05:03.976 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.971+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~PIFSD30FNWHF.1 size=1048576 2024-09-12T17:05:03.979 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.975+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~PIFSD30FNWHF.2 size=653644 2024-09-12T17:05:03.979 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.975+0000 7f026be9d8c0 1 > prepared multipart upload key=6VO85REZG2NW upload=PIFSD30FNWHF tag=CJMMK5GWO1ZS type=write size=3799372 2024-09-12T17:05:03.981 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.975+0000 7f026be9d8c0 1 < completed delete operation key=SL2446KSB531 tag=7AVJROM91LA5 type=del 2024-09-12T17:05:03.984 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.979+0000 7f026be9d8c0 1 > prepared operation key=UU88OS653L8D tag=69BEWJFLLC7H type=del size=3924533 2024-09-12T17:05:03.987 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.983+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~YXEPR04EXN62.0 size=163260 2024-09-12T17:05:03.991 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.987+0000 7f026be9d8c0 1 < completed multipart upload key=JJMEQ2O00SA2 upload=YXEPR04EXN62 tag=76FV0ISUKFQP type=write size=1211836 2024-09-12T17:05:03.994 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.991+0000 7f026be9d8c0 1 > prepared operation key=SO3HLQZA8B6B tag=BFDGI8XJJVXE type=del size=1902182 2024-09-12T17:05:03.996 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.991+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~VH48FYJR7ESX.0 size=1048576 2024-09-12T17:05:03.999 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.995+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~VH48FYJR7ESX.1 size=754171 2024-09-12T17:05:04.003 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.999+0000 7f026be9d8c0 1 < completed multipart upload key=SL2446KSB531 upload=VH48FYJR7ESX tag=0JMDC5R330GI type=write size=2851323 2024-09-12T17:05:04.006 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:03.999+0000 7f026be9d8c0 1 > prepared operation key=4G3BKGNT3YZC tag=FQ6ZH4VPEXAS type=del size=2020071 2024-09-12T17:05:04.009 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.003+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~LUGGUB9ZZDE1.0 size=1048576 2024-09-12T17:05:04.011 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.007+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~LUGGUB9ZZDE1.1 size=1048576 2024-09-12T17:05:04.014 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.011+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~LUGGUB9ZZDE1.2 size=718970 2024-09-12T17:05:04.018 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.015+0000 7f026be9d8c0 1 < completed multipart upload key=2BQJ30RQQ25L upload=LUGGUB9ZZDE1 tag=3HKZKCDZLZEB type=write size=3864698 2024-09-12T17:05:04.021 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.015+0000 7f026be9d8c0 1 > prepared operation key=L194KQIPFLE1 tag=J9DERC2YJK8D type=del size=2574180 2024-09-12T17:05:04.024 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.019+0000 7f026be9d8c0 1 < completed write operation key=PQSQ39X3O64P tag=FUSR8C5VLJLY type=write size=904457 2024-09-12T17:05:04.027 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.023+0000 7f026be9d8c0 1 > prepared operation key=UU88OS653L8D tag=P4QCL668ZS9G type=write size=774649 2024-09-12T17:05:04.027 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.023+0000 7f026be9d8c0 1 < canceled part key=_multipart_Z9YNIEQCVNBA.2~33W62IMEO9QM.0 size=706026 2024-09-12T17:05:04.031 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.027+0000 7f026be9d8c0 1 < canceled multipart upload key=Z9YNIEQCVNBA upload=33W62IMEO9QM tag=IUUY72E6OWLD type=write size=1754602 2024-09-12T17:05:04.039 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.035+0000 7f026be9d8c0 1 > prepared part key=_multipart_RBNN03IPZ8BT.2~JX9V20FUQR9O.0 size=1048576 2024-09-12T17:05:04.041 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.035+0000 7f026be9d8c0 1 > prepared part key=_multipart_RBNN03IPZ8BT.2~JX9V20FUQR9O.1 size=176697 2024-09-12T17:05:04.041 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.035+0000 7f026be9d8c0 1 > prepared multipart upload key=RBNN03IPZ8BT upload=JX9V20FUQR9O tag=OCOFQF5XJEBH type=write size=2273849 2024-09-12T17:05:04.043 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.039+0000 7f026be9d8c0 1 < completed delete operation key=ALFGNC1YNROX tag=8SXBS3Y3HO31 type=del 2024-09-12T17:05:04.048 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.043+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~EZTG4SOA1PXR.0 size=424576 2024-09-12T17:05:04.048 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.043+0000 7f026be9d8c0 1 > prepared multipart upload key=8AFDAVJLMRD2 upload=EZTG4SOA1PXR tag=0EHQS5CBSTV9 type=write size=1473152 2024-09-12T17:05:04.051 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.047+0000 7f026be9d8c0 1 < completed part key=_multipart_U8W1SAVSLTBF.2~8KY8G974SN80.0 size=1048576 2024-09-12T17:05:04.053 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.047+0000 7f026be9d8c0 1 < completed part key=_multipart_U8W1SAVSLTBF.2~8KY8G974SN80.1 size=68696 2024-09-12T17:05:04.057 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.051+0000 7f026be9d8c0 1 < completed multipart upload key=U8W1SAVSLTBF upload=8KY8G974SN80 tag=HHGYFRC09M7S type=write size=2165848 2024-09-12T17:05:04.061 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.055+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~L2OP7HVH60TB.0 size=949875 2024-09-12T17:05:04.062 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.055+0000 7f026be9d8c0 1 > prepared multipart upload key=2BQJ30RQQ25L upload=L2OP7HVH60TB tag=XCPRNT6OFMD8 type=write size=1998451 2024-09-12T17:05:04.064 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.059+0000 7f026be9d8c0 1 < completed delete operation key=MVYWUWKSYQ9Z tag=VCGUJORG1ZK2 type=del 2024-09-12T17:05:04.066 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.063+0000 7f026be9d8c0 1 > prepared operation key=E0Y3SKNUYCQS tag=VB2KVLCYGABO type=del size=2928845 2024-09-12T17:05:04.069 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.063+0000 7f026be9d8c0 1 < completed part key=_multipart_21ZD52VBZIO4.2~LMHAQWP6M1QO.0 size=1048576 2024-09-12T17:05:04.069 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.063+0000 7f026be9d8c0 1 < canceled part key=_multipart_21ZD52VBZIO4.2~LMHAQWP6M1QO.1 size=184131 2024-09-12T17:05:04.073 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.067+0000 7f026be9d8c0 1 < canceled multipart upload key=21ZD52VBZIO4 upload=LMHAQWP6M1QO tag=9G3O4O7P4DLN type=write size=2281283 2024-09-12T17:05:04.079 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.075+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~8KHJF85W1IZD.0 size=1048576 2024-09-12T17:05:04.081 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.075+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~8KHJF85W1IZD.1 size=800727 2024-09-12T17:05:04.081 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.075+0000 7f026be9d8c0 1 > prepared multipart upload key=J8MU1A0CWSAQ upload=8KHJF85W1IZD tag=8K8SIBW2O1G4 type=write size=2897879 2024-09-12T17:05:04.084 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.079+0000 7f026be9d8c0 -1 < failed to complete operation key=U8W1SAVSLTBF tag=1WBGLO2NF2AR type=del size=1476945: (22) Invalid argument 2024-09-12T17:05:04.087 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.083+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=197WN3UOEBVX type=write size=104204 2024-09-12T17:05:04.090 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.087+0000 7f026be9d8c0 1 < completed delete operation key=Z9YNIEQCVNBA tag=QPFG0AOV6422 type=del 2024-09-12T17:05:04.093 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.087+0000 7f026be9d8c0 1 > prepared operation key=E0Y3SKNUYCQS tag=39ZTO5SGAQDD type=write size=378817 2024-09-12T17:05:04.095 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.091+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~K0DSQFRI7R6V.0 size=1048576 2024-09-12T17:05:04.097 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.091+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~K0DSQFRI7R6V.1 size=11810 2024-09-12T17:05:04.102 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.095+0000 7f026be9d8c0 1 < completed multipart upload key=GPUFWJ3AWEMX upload=K0DSQFRI7R6V tag=ILXQTOH8DPVX type=write size=2108962 2024-09-12T17:05:04.104 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.099+0000 7f026be9d8c0 1 > prepared operation key=Z9YNIEQCVNBA tag=96C81GST78KB type=del size=1235751 2024-09-12T17:05:04.111 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.107+0000 7f026be9d8c0 1 < suggested update operation key=3JADN360QEO3 tag=DSN3U9NHCY4B type=del size=2767167 2024-09-12T17:05:04.115 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.111+0000 7f026be9d8c0 1 > prepared part key=_multipart_BBYDPSXZKHZP.2~G1EWP8Z42K5V.0 size=484152 2024-09-12T17:05:04.115 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.111+0000 7f026be9d8c0 1 > prepared multipart upload key=BBYDPSXZKHZP upload=G1EWP8Z42K5V tag=V5O05WAWD872 type=write size=1532728 2024-09-12T17:05:04.118 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.115+0000 7f026be9d8c0 1 < completed delete operation key=Z9YNIEQCVNBA tag=34DPLM9NUKXL type=del 2024-09-12T17:05:04.122 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.119+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~BR9QUZY3Q0O9.0 size=1048576 2024-09-12T17:05:04.125 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.119+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~BR9QUZY3Q0O9.1 size=1048576 2024-09-12T17:05:04.127 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.123+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~BR9QUZY3Q0O9.2 size=137071 2024-09-12T17:05:04.127 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.123+0000 7f026be9d8c0 1 > prepared multipart upload key=J8MU1A0CWSAQ upload=BR9QUZY3Q0O9 tag=RPWL4AFXHBPL type=write size=3282799 2024-09-12T17:05:04.130 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.127+0000 7f026be9d8c0 1 < completed part key=_multipart_6VO85REZG2NW.2~PIFSD30FNWHF.0 size=1048576 2024-09-12T17:05:04.132 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.127+0000 7f026be9d8c0 1 < completed part key=_multipart_6VO85REZG2NW.2~PIFSD30FNWHF.1 size=1048576 2024-09-12T17:05:04.133 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.127+0000 7f026be9d8c0 1 < canceled part key=_multipart_6VO85REZG2NW.2~PIFSD30FNWHF.2 size=653644 2024-09-12T17:05:04.137 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.131+0000 7f026be9d8c0 1 < canceled multipart upload key=6VO85REZG2NW upload=PIFSD30FNWHF tag=CJMMK5GWO1ZS type=write size=3799372 2024-09-12T17:05:04.142 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.139+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~L0RDMRHO42MR.0 size=1048576 2024-09-12T17:05:04.144 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.139+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~L0RDMRHO42MR.1 size=47803 2024-09-12T17:05:04.144 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.139+0000 7f026be9d8c0 1 > prepared multipart upload key=32XUMOWT8HO2 upload=L0RDMRHO42MR tag=HKPDY67E6B4T type=write size=2144955 2024-09-12T17:05:04.149 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.143+0000 7f026be9d8c0 1 < suggested remove operation key=UU88OS653L8D tag=69BEWJFLLC7H type=del 2024-09-12T17:05:04.154 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.151+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~XOKTY8ZNIM42.0 size=1048576 2024-09-12T17:05:04.156 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.151+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~XOKTY8ZNIM42.1 size=1048576 2024-09-12T17:05:04.158 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.155+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~XOKTY8ZNIM42.2 size=766299 2024-09-12T17:05:04.158 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.155+0000 7f026be9d8c0 1 > prepared multipart upload key=GPUFWJ3AWEMX upload=XOKTY8ZNIM42 tag=57YGCJ1F992M type=write size=3912027 2024-09-12T17:05:04.163 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.159+0000 7f026be9d8c0 1 < suggested remove operation key=SO3HLQZA8B6B tag=BFDGI8XJJVXE type=del 2024-09-12T17:05:04.168 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.163+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~5R2CTNMNIVBN.0 size=1048576 2024-09-12T17:05:04.171 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.167+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~5R2CTNMNIVBN.1 size=788574 2024-09-12T17:05:04.171 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.167+0000 7f026be9d8c0 1 > prepared multipart upload key=Z9YNIEQCVNBA upload=5R2CTNMNIVBN tag=2WFO4ZVQCUHS type=write size=2885726 2024-09-12T17:05:04.174 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.171+0000 7f026be9d8c0 1 < completed delete operation key=4G3BKGNT3YZC tag=FQ6ZH4VPEXAS type=del 2024-09-12T17:05:04.179 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.175+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~IYH8S6DUW4L6.0 size=1048576 2024-09-12T17:05:04.181 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.175+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~IYH8S6DUW4L6.1 size=834018 2024-09-12T17:05:04.181 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.175+0000 7f026be9d8c0 1 > prepared multipart upload key=SL2446KSB531 upload=IYH8S6DUW4L6 tag=26GL38Q9HYBU type=write size=2931170 2024-09-12T17:05:04.184 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.179+0000 7f026be9d8c0 1 < completed delete operation key=L194KQIPFLE1 tag=J9DERC2YJK8D type=del 2024-09-12T17:05:04.187 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.183+0000 7f026be9d8c0 1 > prepared operation key=4U1W97V0OX11 tag=FQYSX9RMUA0T type=del size=2591386 2024-09-12T17:05:04.190 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.187+0000 7f026be9d8c0 -1 < failed to complete operation key=UU88OS653L8D tag=P4QCL668ZS9G type=write size=774649: (22) Invalid argument 2024-09-12T17:05:04.193 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.187+0000 7f026be9d8c0 1 > prepared operation key=PQSQ39X3O64P tag=WISHKG09IKC0 type=del size=1682564 2024-09-12T17:05:04.194 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.191+0000 7f026be9d8c0 1 < canceled part key=_multipart_RBNN03IPZ8BT.2~JX9V20FUQR9O.0 size=1048576 2024-09-12T17:05:04.196 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.191+0000 7f026be9d8c0 1 < completed part key=_multipart_RBNN03IPZ8BT.2~JX9V20FUQR9O.1 size=176697 2024-09-12T17:05:04.201 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.195+0000 7f026be9d8c0 1 < canceled multipart upload key=RBNN03IPZ8BT upload=JX9V20FUQR9O tag=OCOFQF5XJEBH type=write size=2273849 2024-09-12T17:05:04.204 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.199+0000 7f026be9d8c0 1 > prepared operation key=Y27CDEOCM7DH tag=7193HN035WBQ type=del size=1341207 2024-09-12T17:05:04.206 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.203+0000 7f026be9d8c0 1 < completed part key=_multipart_8AFDAVJLMRD2.2~EZTG4SOA1PXR.0 size=424576 2024-09-12T17:05:04.211 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.207+0000 7f026be9d8c0 1 < completed multipart upload key=8AFDAVJLMRD2 upload=EZTG4SOA1PXR tag=0EHQS5CBSTV9 type=write size=1473152 2024-09-12T17:05:04.214 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.211+0000 7f026be9d8c0 1 > prepared operation key=BW1T21LBUE2D tag=FOOXVL01PN8V type=del size=1405617 2024-09-12T17:05:04.217 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.211+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~L2OP7HVH60TB.0 size=949875 2024-09-12T17:05:04.222 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.219+0000 7f026be9d8c0 1 < completed multipart upload key=2BQJ30RQQ25L upload=L2OP7HVH60TB tag=XCPRNT6OFMD8 type=write size=1998451 2024-09-12T17:05:04.225 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.219+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=QYQ0O7K20V0O type=write size=856898 2024-09-12T17:05:04.227 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.223+0000 7f026be9d8c0 1 < completed delete operation key=E0Y3SKNUYCQS tag=VB2KVLCYGABO type=del 2024-09-12T17:05:04.230 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.227+0000 7f026be9d8c0 1 > prepared operation key=XLKR6P8RNRVO tag=3LAL95C0ARBX type=del size=1784985 2024-09-12T17:05:04.233 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.227+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~8KHJF85W1IZD.0 size=1048576 2024-09-12T17:05:04.236 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.231+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~8KHJF85W1IZD.1 size=800727 2024-09-12T17:05:04.241 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.235+0000 7f026be9d8c0 1 < completed multipart upload key=J8MU1A0CWSAQ upload=8KHJF85W1IZD tag=8K8SIBW2O1G4 type=write size=2897879 2024-09-12T17:05:04.244 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.239+0000 7f026be9d8c0 1 > prepared operation key=8AFDAVJLMRD2 tag=QZWTLK68YX43 type=write size=287207 2024-09-12T17:05:04.247 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.243+0000 7f026be9d8c0 1 < completed write operation key=U8W1SAVSLTBF tag=197WN3UOEBVX type=write size=104204 2024-09-12T17:05:04.254 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.247+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~JZ465V10QFFZ.0 size=1048576 2024-09-12T17:05:04.256 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.251+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~JZ465V10QFFZ.1 size=470299 2024-09-12T17:05:04.256 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.251+0000 7f026be9d8c0 1 > prepared multipart upload key=GPUFWJ3AWEMX upload=JZ465V10QFFZ tag=UO5TQGUXBWX6 type=write size=2567451 2024-09-12T17:05:04.259 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.255+0000 7f026be9d8c0 1 < completed write operation key=E0Y3SKNUYCQS tag=39ZTO5SGAQDD type=write size=378817 2024-09-12T17:05:04.262 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.259+0000 7f026be9d8c0 1 > prepared operation key=UU88OS653L8D tag=2CJ71Z3DI01D type=del size=1100218 2024-09-12T17:05:04.265 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.259+0000 7f026be9d8c0 1 < canceled operation key=Z9YNIEQCVNBA tag=96C81GST78KB type=del size=1235751 2024-09-12T17:05:04.268 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.263+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=31O3BJNIOY9K type=del size=3487041 2024-09-12T17:05:04.271 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.267+0000 7f026be9d8c0 1 < completed part key=_multipart_BBYDPSXZKHZP.2~G1EWP8Z42K5V.0 size=484152 2024-09-12T17:05:04.275 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.271+0000 7f026be9d8c0 1 < completed multipart upload key=BBYDPSXZKHZP upload=G1EWP8Z42K5V tag=V5O05WAWD872 type=write size=1532728 2024-09-12T17:05:04.280 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.275+0000 7f026be9d8c0 1 > prepared part key=_multipart_4U1W97V0OX11.2~EZD7RSRAB5L9.0 size=991227 2024-09-12T17:05:04.281 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.275+0000 7f026be9d8c0 1 > prepared multipart upload key=4U1W97V0OX11 upload=EZD7RSRAB5L9 tag=KP0UAXJWUCH8 type=write size=2039803 2024-09-12T17:05:04.283 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.279+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~BR9QUZY3Q0O9.0 size=1048576 2024-09-12T17:05:04.283 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.279+0000 7f026be9d8c0 1 < canceled part key=_multipart_J8MU1A0CWSAQ.2~BR9QUZY3Q0O9.1 size=1048576 2024-09-12T17:05:04.285 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.279+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~BR9QUZY3Q0O9.2 size=137071 2024-09-12T17:05:04.290 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.287+0000 7f026be9d8c0 1 < canceled multipart upload key=J8MU1A0CWSAQ upload=BR9QUZY3Q0O9 tag=RPWL4AFXHBPL type=write size=3282799 2024-09-12T17:05:04.297 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.291+0000 7f026be9d8c0 1 > prepared operation key=JJMEQ2O00SA2 tag=ZQ3Z4FVTDL3B type=del size=2009894 2024-09-12T17:05:04.300 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.295+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~L0RDMRHO42MR.0 size=1048576 2024-09-12T17:05:04.300 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.295+0000 7f026be9d8c0 1 < canceled part key=_multipart_32XUMOWT8HO2.2~L0RDMRHO42MR.1 size=47803 2024-09-12T17:05:04.305 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.299+0000 7f026be9d8c0 1 < canceled multipart upload key=32XUMOWT8HO2 upload=L0RDMRHO42MR tag=HKPDY67E6B4T type=write size=2144955 2024-09-12T17:05:04.308 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.303+0000 7f026be9d8c0 1 > prepared operation key=4G3BKGNT3YZC tag=AFLA3148JL95 type=write size=988608 2024-09-12T17:05:04.311 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.307+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~XOKTY8ZNIM42.0 size=1048576 2024-09-12T17:05:04.314 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.307+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~XOKTY8ZNIM42.1 size=1048576 2024-09-12T17:05:04.316 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.311+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~XOKTY8ZNIM42.2 size=766299 2024-09-12T17:05:04.321 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.315+0000 7f026be9d8c0 1 < completed multipart upload key=GPUFWJ3AWEMX upload=XOKTY8ZNIM42 tag=57YGCJ1F992M type=write size=3912027 2024-09-12T17:05:04.323 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.319+0000 7f026be9d8c0 1 > prepared operation key=ALFGNC1YNROX tag=BSTONZ1976ZW type=del size=2527925 2024-09-12T17:05:04.326 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.323+0000 7f026be9d8c0 1 < completed part key=_multipart_Z9YNIEQCVNBA.2~5R2CTNMNIVBN.0 size=1048576 2024-09-12T17:05:04.328 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.323+0000 7f026be9d8c0 1 < completed part key=_multipart_Z9YNIEQCVNBA.2~5R2CTNMNIVBN.1 size=788574 2024-09-12T17:05:04.332 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.327+0000 7f026be9d8c0 1 < completed multipart upload key=Z9YNIEQCVNBA upload=5R2CTNMNIVBN tag=2WFO4ZVQCUHS type=write size=2885726 2024-09-12T17:05:04.337 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.331+0000 7f026be9d8c0 1 > prepared part key=_multipart_3JADN360QEO3.2~1E6LJV6V45W8.0 size=118919 2024-09-12T17:05:04.337 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.331+0000 7f026be9d8c0 1 > prepared multipart upload key=3JADN360QEO3 upload=1E6LJV6V45W8 tag=Z6L2Z6HB4WO6 type=write size=1167495 2024-09-12T17:05:04.340 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.335+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~IYH8S6DUW4L6.0 size=1048576 2024-09-12T17:05:04.342 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.339+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~IYH8S6DUW4L6.1 size=834018 2024-09-12T17:05:04.347 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.343+0000 7f026be9d8c0 1 < completed multipart upload key=SL2446KSB531 upload=IYH8S6DUW4L6 tag=26GL38Q9HYBU type=write size=2931170 2024-09-12T17:05:04.350 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.347+0000 7f026be9d8c0 1 > prepared operation key=JJMEQ2O00SA2 tag=PSHDS2UBK2JP type=write size=61679 2024-09-12T17:05:04.354 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.347+0000 7f026be9d8c0 1 < completed delete operation key=4U1W97V0OX11 tag=FQYSX9RMUA0T type=del 2024-09-12T17:05:04.359 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.355+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~JM64U8UDHEAK.0 size=749493 2024-09-12T17:05:04.359 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.355+0000 7f026be9d8c0 1 > prepared multipart upload key=6VO85REZG2NW upload=JM64U8UDHEAK tag=UA6UBSRHBD53 type=write size=1798069 2024-09-12T17:05:04.362 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.359+0000 7f026be9d8c0 1 < completed delete operation key=PQSQ39X3O64P tag=WISHKG09IKC0 type=del 2024-09-12T17:05:04.366 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.359+0000 7f026be9d8c0 1 > prepared operation key=SO3HLQZA8B6B tag=4U7QKW3FSDVK type=del size=2027185 2024-09-12T17:05:04.372 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.367+0000 7f026be9d8c0 1 < suggested remove operation key=Y27CDEOCM7DH tag=7193HN035WBQ type=del 2024-09-12T17:05:04.374 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.371+0000 7f026be9d8c0 1 > prepared operation key=ALFGNC1YNROX tag=RG1HUJWB6OQC type=del size=966087 2024-09-12T17:05:04.378 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.371+0000 7f026be9d8c0 1 < completed delete operation key=BW1T21LBUE2D tag=FOOXVL01PN8V type=del 2024-09-12T17:05:04.380 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.375+0000 7f026be9d8c0 1 > prepared operation key=Z9YNIEQCVNBA tag=ZBYF5MAJZ49O type=write size=901663 2024-09-12T17:05:04.383 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.379+0000 7f026be9d8c0 1 < completed write operation key=U8W1SAVSLTBF tag=QYQ0O7K20V0O type=write size=856898 2024-09-12T17:05:04.387 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.383+0000 7f026be9d8c0 1 > prepared operation key=XNBE2II106VZ tag=5NKA2AZ9PJ40 type=del size=1815705 2024-09-12T17:05:04.390 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.387+0000 7f026be9d8c0 1 < completed delete operation key=XLKR6P8RNRVO tag=3LAL95C0ARBX type=del 2024-09-12T17:05:04.396 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.391+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~A9MWB57N5H5T.0 size=1048576 2024-09-12T17:05:04.398 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.395+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~A9MWB57N5H5T.1 size=1048576 2024-09-12T17:05:04.401 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.395+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~A9MWB57N5H5T.2 size=384733 2024-09-12T17:05:04.401 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.395+0000 7f026be9d8c0 1 > prepared multipart upload key=ALFGNC1YNROX upload=A9MWB57N5H5T tag=IKEU86X8D4Q2 type=write size=3530461 2024-09-12T17:05:04.407 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.403+0000 7f026be9d8c0 1 < suggested remove operation key=8AFDAVJLMRD2 tag=QZWTLK68YX43 type=write 2024-09-12T17:05:04.410 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.407+0000 7f026be9d8c0 1 > prepared operation key=SO3HLQZA8B6B tag=KQOECDN1LLJD type=write size=383054 2024-09-12T17:05:04.414 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.411+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~JZ465V10QFFZ.0 size=1048576 2024-09-12T17:05:04.416 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.411+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~JZ465V10QFFZ.1 size=470299 2024-09-12T17:05:04.422 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.419+0000 7f026be9d8c0 1 < completed multipart upload key=GPUFWJ3AWEMX upload=JZ465V10QFFZ tag=UO5TQGUXBWX6 type=write size=2567451 2024-09-12T17:05:04.425 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.419+0000 7f026be9d8c0 1 > prepared operation key=PQSQ39X3O64P tag=VPBMB6UDAYLL type=del size=3203782 2024-09-12T17:05:04.429 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.423+0000 7f026be9d8c0 1 < completed delete operation key=UU88OS653L8D tag=2CJ71Z3DI01D type=del 2024-09-12T17:05:04.432 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.427+0000 7f026be9d8c0 1 > prepared operation key=SL2446KSB531 tag=ZM20N1FAMY55 type=del size=3864737 2024-09-12T17:05:04.439 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.435+0000 7f026be9d8c0 1 < suggested update operation key=RBNN03IPZ8BT tag=31O3BJNIOY9K type=del size=3487041 2024-09-12T17:05:04.442 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.439+0000 7f026be9d8c0 1 > prepared operation key=ALFGNC1YNROX tag=QVQ8PA8BD3FU type=del size=2691125 2024-09-12T17:05:04.446 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.443+0000 7f026be9d8c0 1 < completed part key=_multipart_4U1W97V0OX11.2~EZD7RSRAB5L9.0 size=991227 2024-09-12T17:05:04.451 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.447+0000 7f026be9d8c0 1 < completed multipart upload key=4U1W97V0OX11 upload=EZD7RSRAB5L9 tag=KP0UAXJWUCH8 type=write size=2039803 2024-09-12T17:05:04.454 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.451+0000 7f026be9d8c0 1 > prepared operation key=2BQJ30RQQ25L tag=8AQZQKU8QU3G type=del size=3048777 2024-09-12T17:05:04.457 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.451+0000 7f026be9d8c0 1 < completed delete operation key=JJMEQ2O00SA2 tag=ZQ3Z4FVTDL3B type=del 2024-09-12T17:05:04.460 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.455+0000 7f026be9d8c0 1 > prepared operation key=LHKLWIUAT08F tag=CDQGH4YTYIS0 type=del size=2345919 2024-09-12T17:05:04.463 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.459+0000 7f026be9d8c0 1 < completed write operation key=4G3BKGNT3YZC tag=AFLA3148JL95 type=write size=988608 2024-09-12T17:05:04.469 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.463+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~B2Y36AZ2V9UA.0 size=1048576 2024-09-12T17:05:04.471 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.467+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~B2Y36AZ2V9UA.1 size=816291 2024-09-12T17:05:04.471 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.467+0000 7f026be9d8c0 1 > prepared multipart upload key=32XUMOWT8HO2 upload=B2Y36AZ2V9UA tag=UPIHWNJASXUD type=write size=2913443 2024-09-12T17:05:04.474 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.471+0000 7f026be9d8c0 1 < completed delete operation key=ALFGNC1YNROX tag=BSTONZ1976ZW type=del 2024-09-12T17:05:04.480 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.475+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~EX4SJZZONA6M.0 size=84771 2024-09-12T17:05:04.480 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.475+0000 7f026be9d8c0 1 > prepared multipart upload key=J8MU1A0CWSAQ upload=EX4SJZZONA6M tag=SE3ITIGDBTU1 type=write size=1133347 2024-09-12T17:05:04.483 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.479+0000 7f026be9d8c0 1 < completed part key=_multipart_3JADN360QEO3.2~1E6LJV6V45W8.0 size=118919 2024-09-12T17:05:04.488 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.483+0000 7f026be9d8c0 1 < completed multipart upload key=3JADN360QEO3 upload=1E6LJV6V45W8 tag=Z6L2Z6HB4WO6 type=write size=1167495 2024-09-12T17:05:04.494 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.491+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~FV9U0ITO6AP9.0 size=1048576 2024-09-12T17:05:04.497 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.491+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~FV9U0ITO6AP9.1 size=1048576 2024-09-12T17:05:04.499 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.495+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~FV9U0ITO6AP9.2 size=345936 2024-09-12T17:05:04.499 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.495+0000 7f026be9d8c0 1 > prepared multipart upload key=J8MU1A0CWSAQ upload=FV9U0ITO6AP9 tag=5PVTFI6H3BTO type=write size=3491664 2024-09-12T17:05:04.506 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.499+0000 7f026be9d8c0 1 < suggested update operation key=JJMEQ2O00SA2 tag=PSHDS2UBK2JP type=write size=61679 2024-09-12T17:05:04.509 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.503+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=H8KYSSD1UJ73 type=del size=3883027 2024-09-12T17:05:04.512 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.507+0000 7f026be9d8c0 1 < completed part key=_multipart_6VO85REZG2NW.2~JM64U8UDHEAK.0 size=749493 2024-09-12T17:05:04.518 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.511+0000 7f026be9d8c0 1 < completed multipart upload key=6VO85REZG2NW upload=JM64U8UDHEAK tag=UA6UBSRHBD53 type=write size=1798069 2024-09-12T17:05:04.521 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.515+0000 7f026be9d8c0 1 > prepared operation key=4G3BKGNT3YZC tag=XANYWU01PFBH type=del size=1921630 2024-09-12T17:05:04.527 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.523+0000 7f026be9d8c0 1 < suggested update operation key=SO3HLQZA8B6B tag=4U7QKW3FSDVK type=del size=2027185 2024-09-12T17:05:04.530 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.527+0000 7f026be9d8c0 1 > prepared operation key=T6QRDTQRHBPI tag=Z2G0C8AHL4WA type=write size=406524 2024-09-12T17:05:04.533 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.527+0000 7f026be9d8c0 1 < completed delete operation key=ALFGNC1YNROX tag=RG1HUJWB6OQC type=del 2024-09-12T17:05:04.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.531+0000 7f026be9d8c0 1 > prepared operation key=4U1W97V0OX11 tag=RGTZTNK51JYL type=del size=4103773 2024-09-12T17:05:04.543 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.539+0000 7f026be9d8c0 1 < suggested update operation key=Z9YNIEQCVNBA tag=ZBYF5MAJZ49O type=write size=901663 2024-09-12T17:05:04.550 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.543+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~NB0P1EDG1VZV.0 size=1048576 2024-09-12T17:05:04.552 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.547+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~NB0P1EDG1VZV.1 size=1048576 2024-09-12T17:05:04.555 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.551+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~NB0P1EDG1VZV.2 size=692249 2024-09-12T17:05:04.555 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.551+0000 7f026be9d8c0 1 > prepared multipart upload key=GPUFWJ3AWEMX upload=NB0P1EDG1VZV tag=YB6UC02LN9EN type=write size=3837977 2024-09-12T17:05:04.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.559+0000 7f026be9d8c0 1 < suggested update operation key=XNBE2II106VZ tag=5NKA2AZ9PJ40 type=del size=1815705 2024-09-12T17:05:04.568 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.563+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~Q7SCK5VJ2E30.0 size=1048576 2024-09-12T17:05:04.571 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.567+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~Q7SCK5VJ2E30.1 size=738196 2024-09-12T17:05:04.571 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.567+0000 7f026be9d8c0 1 > prepared multipart upload key=4G3BKGNT3YZC upload=Q7SCK5VJ2E30 tag=UL22OBYQRGUZ type=write size=2835348 2024-09-12T17:05:04.575 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.571+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~A9MWB57N5H5T.0 size=1048576 2024-09-12T17:05:04.578 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.575+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~A9MWB57N5H5T.1 size=1048576 2024-09-12T17:05:04.581 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.575+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~A9MWB57N5H5T.2 size=384733 2024-09-12T17:05:04.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.583+0000 7f026be9d8c0 1 < completed multipart upload key=ALFGNC1YNROX upload=A9MWB57N5H5T tag=IKEU86X8D4Q2 type=write size=3530461 2024-09-12T17:05:04.595 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.591+0000 7f026be9d8c0 1 > prepared operation key=Z9YNIEQCVNBA tag=RRIDARFR3TEV type=del size=1144360 2024-09-12T17:05:04.599 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.595+0000 7f026be9d8c0 -1 < failed to complete operation key=SO3HLQZA8B6B tag=KQOECDN1LLJD type=write size=383054: (22) Invalid argument 2024-09-12T17:05:04.606 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.599+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~Y4XIUZPH0LAQ.0 size=1048576 2024-09-12T17:05:04.608 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.603+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~Y4XIUZPH0LAQ.1 size=329818 2024-09-12T17:05:04.608 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.603+0000 7f026be9d8c0 1 > prepared multipart upload key=BW1T21LBUE2D upload=Y4XIUZPH0LAQ tag=44GABGONTDE4 type=write size=2426970 2024-09-12T17:05:04.615 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.611+0000 7f026be9d8c0 1 < suggested update operation key=PQSQ39X3O64P tag=VPBMB6UDAYLL type=del size=3203782 2024-09-12T17:05:04.618 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.615+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=Y8IV21VKDY2U type=del size=399064 2024-09-12T17:05:04.622 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.615+0000 7f026be9d8c0 1 < completed delete operation key=SL2446KSB531 tag=ZM20N1FAMY55 type=del 2024-09-12T17:05:04.625 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.619+0000 7f026be9d8c0 1 > prepared operation key=QVQ4TI319DH5 tag=GM83DU12FK30 type=write size=54421 2024-09-12T17:05:04.628 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.623+0000 7f026be9d8c0 1 < completed delete operation key=ALFGNC1YNROX tag=QVQ8PA8BD3FU type=del 2024-09-12T17:05:04.631 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.627+0000 7f026be9d8c0 1 > prepared operation key=UU88OS653L8D tag=AO7HXUNODDUC type=del size=220237 2024-09-12T17:05:04.635 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.631+0000 7f026be9d8c0 1 < completed delete operation key=2BQJ30RQQ25L tag=8AQZQKU8QU3G type=del 2024-09-12T17:05:04.638 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.635+0000 7f026be9d8c0 1 > prepared operation key=SGT8IC1GJ3IG tag=JC1F2WQ9KFT9 type=del size=3949409 2024-09-12T17:05:04.641 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.635+0000 7f026be9d8c0 1 < completed delete operation key=LHKLWIUAT08F tag=CDQGH4YTYIS0 type=del 2024-09-12T17:05:04.645 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.639+0000 7f026be9d8c0 1 > prepared operation key=T6QRDTQRHBPI tag=78FXLI4UEEH6 type=del size=3805074 2024-09-12T17:05:04.648 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.643+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~B2Y36AZ2V9UA.0 size=1048576 2024-09-12T17:05:04.651 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.647+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~B2Y36AZ2V9UA.1 size=816291 2024-09-12T17:05:04.655 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.651+0000 7f026be9d8c0 1 < completed multipart upload key=32XUMOWT8HO2 upload=B2Y36AZ2V9UA tag=UPIHWNJASXUD type=write size=2913443 2024-09-12T17:05:04.661 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.655+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~3DZ25M2UKU8G.0 size=813429 2024-09-12T17:05:04.661 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.655+0000 7f026be9d8c0 1 > prepared multipart upload key=4G3BKGNT3YZC upload=3DZ25M2UKU8G tag=QSB9M9UL7OUS type=write size=1862005 2024-09-12T17:05:04.664 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.659+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~EX4SJZZONA6M.0 size=84771 2024-09-12T17:05:04.669 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.663+0000 7f026be9d8c0 1 < completed multipart upload key=J8MU1A0CWSAQ upload=EX4SJZZONA6M tag=SE3ITIGDBTU1 type=write size=1133347 2024-09-12T17:05:04.673 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.667+0000 7f026be9d8c0 1 > prepared operation key=ALFGNC1YNROX tag=8B050KFVJ0JC type=write size=111568 2024-09-12T17:05:04.677 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.671+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~FV9U0ITO6AP9.0 size=1048576 2024-09-12T17:05:04.681 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.675+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~FV9U0ITO6AP9.1 size=1048576 2024-09-12T17:05:04.684 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.679+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~FV9U0ITO6AP9.2 size=345936 2024-09-12T17:05:04.689 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.683+0000 7f026be9d8c0 1 < completed multipart upload key=J8MU1A0CWSAQ upload=FV9U0ITO6AP9 tag=5PVTFI6H3BTO type=write size=3491664 2024-09-12T17:05:04.695 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.691+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~94CCMPVBY2U5.0 size=413708 2024-09-12T17:05:04.696 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.691+0000 7f026be9d8c0 1 > prepared multipart upload key=QVQ4TI319DH5 upload=94CCMPVBY2U5 tag=IMYS3C0XCKSS type=write size=1462284 2024-09-12T17:05:04.699 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.695+0000 7f026be9d8c0 1 < canceled operation key=U8W1SAVSLTBF tag=H8KYSSD1UJ73 type=del size=3883027 2024-09-12T17:05:04.703 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.699+0000 7f026be9d8c0 1 > prepared operation key=2BQJ30RQQ25L tag=4WGRFFLIE3IA type=del size=912224 2024-09-12T17:05:04.711 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.707+0000 7f026be9d8c0 1 < suggested remove operation key=4G3BKGNT3YZC tag=XANYWU01PFBH type=del 2024-09-12T17:05:04.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.715+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~QCHHS8O3AEUV.0 size=1048576 2024-09-12T17:05:04.721 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.715+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~QCHHS8O3AEUV.1 size=955499 2024-09-12T17:05:04.721 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.715+0000 7f026be9d8c0 1 > prepared multipart upload key=GPUFWJ3AWEMX upload=QCHHS8O3AEUV tag=IKUH425D5GSU type=write size=3052651 2024-09-12T17:05:04.725 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.719+0000 7f026be9d8c0 1 < completed write operation key=T6QRDTQRHBPI tag=Z2G0C8AHL4WA type=write size=406524 2024-09-12T17:05:04.731 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.727+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~DZUUZLWJUDHD.0 size=1048576 2024-09-12T17:05:04.734 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.731+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~DZUUZLWJUDHD.1 size=1048576 2024-09-12T17:05:04.737 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.731+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~DZUUZLWJUDHD.2 size=545682 2024-09-12T17:05:04.737 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.731+0000 7f026be9d8c0 1 > prepared multipart upload key=XLKR6P8RNRVO upload=DZUUZLWJUDHD tag=DINZ75UG9QC3 type=write size=3691410 2024-09-12T17:05:04.739 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.735+0000 7f026be9d8c0 1 < completed delete operation key=4U1W97V0OX11 tag=RGTZTNK51JYL type=del 2024-09-12T17:05:04.743 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.739+0000 7f026be9d8c0 1 > prepared operation key=BW1T21LBUE2D tag=BNIRKXF9A5VA type=write size=78410 2024-09-12T17:05:04.746 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.739+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~NB0P1EDG1VZV.0 size=1048576 2024-09-12T17:05:04.748 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.743+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~NB0P1EDG1VZV.1 size=1048576 2024-09-12T17:05:04.751 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.747+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~NB0P1EDG1VZV.2 size=692249 2024-09-12T17:05:04.756 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.751+0000 7f026be9d8c0 1 < completed multipart upload key=GPUFWJ3AWEMX upload=NB0P1EDG1VZV tag=YB6UC02LN9EN type=write size=3837977 2024-09-12T17:05:04.762 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.755+0000 7f026be9d8c0 1 > prepared part key=_multipart_XNBE2II106VZ.2~IX57KDIM01N8.0 size=1048576 2024-09-12T17:05:04.765 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.759+0000 7f026be9d8c0 1 > prepared part key=_multipart_XNBE2II106VZ.2~IX57KDIM01N8.1 size=626060 2024-09-12T17:05:04.765 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.759+0000 7f026be9d8c0 1 > prepared multipart upload key=XNBE2II106VZ upload=IX57KDIM01N8 tag=CL75GKXEB9QE type=write size=2723212 2024-09-12T17:05:04.768 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.763+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~Q7SCK5VJ2E30.0 size=1048576 2024-09-12T17:05:04.771 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.767+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~Q7SCK5VJ2E30.1 size=738196 2024-09-12T17:05:04.776 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.771+0000 7f026be9d8c0 1 < completed multipart upload key=4G3BKGNT3YZC upload=Q7SCK5VJ2E30 tag=UL22OBYQRGUZ type=write size=2835348 2024-09-12T17:05:04.783 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.779+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~OSE6EFXFE91V.0 size=839724 2024-09-12T17:05:04.784 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.779+0000 7f026be9d8c0 1 > prepared multipart upload key=2BQJ30RQQ25L upload=OSE6EFXFE91V tag=6179ONLL7JYH type=write size=1888300 2024-09-12T17:05:04.788 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.783+0000 7f026be9d8c0 1 < completed delete operation key=Z9YNIEQCVNBA tag=RRIDARFR3TEV type=del 2024-09-12T17:05:04.791 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.787+0000 7f026be9d8c0 1 > prepared operation key=JJMEQ2O00SA2 tag=RZHAD3JHM5JC type=del size=972269 2024-09-12T17:05:04.795 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.791+0000 7f026be9d8c0 1 < completed part key=_multipart_BW1T21LBUE2D.2~Y4XIUZPH0LAQ.0 size=1048576 2024-09-12T17:05:04.798 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.795+0000 7f026be9d8c0 1 < completed part key=_multipart_BW1T21LBUE2D.2~Y4XIUZPH0LAQ.1 size=329818 2024-09-12T17:05:04.804 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.799+0000 7f026be9d8c0 1 < completed multipart upload key=BW1T21LBUE2D upload=Y4XIUZPH0LAQ tag=44GABGONTDE4 type=write size=2426970 2024-09-12T17:05:04.808 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.803+0000 7f026be9d8c0 1 > prepared operation key=ALFGNC1YNROX tag=ONTM230CIFCK type=del size=1301258 2024-09-12T17:05:04.811 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.807+0000 7f026be9d8c0 1 < canceled operation key=RBNN03IPZ8BT tag=Y8IV21VKDY2U type=del size=399064 2024-09-12T17:05:04.818 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.815+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~QIL3AE0NSFUO.0 size=1048576 2024-09-12T17:05:04.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.815+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~QIL3AE0NSFUO.1 size=1048576 2024-09-12T17:05:04.824 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.819+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~QIL3AE0NSFUO.2 size=837196 2024-09-12T17:05:04.824 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.819+0000 7f026be9d8c0 1 > prepared multipart upload key=Y27CDEOCM7DH upload=QIL3AE0NSFUO tag=2X4SZA6RGBYT type=write size=3982924 2024-09-12T17:05:04.828 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.823+0000 7f026be9d8c0 1 < completed write operation key=QVQ4TI319DH5 tag=GM83DU12FK30 type=write size=54421 2024-09-12T17:05:04.832 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.827+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=4LKEPUA33BTQ type=write size=341910 2024-09-12T17:05:04.835 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.831+0000 7f026be9d8c0 1 < completed delete operation key=UU88OS653L8D tag=AO7HXUNODDUC type=del 2024-09-12T17:05:04.839 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.835+0000 7f026be9d8c0 1 > prepared operation key=4U1W97V0OX11 tag=C7MK4MZURSRB type=write size=115855 2024-09-12T17:05:04.842 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.839+0000 7f026be9d8c0 1 < completed delete operation key=SGT8IC1GJ3IG tag=JC1F2WQ9KFT9 type=del 2024-09-12T17:05:04.846 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.839+0000 7f026be9d8c0 1 > prepared operation key=LHKLWIUAT08F tag=NV7NGM231VAG type=write size=333057 2024-09-12T17:05:04.849 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.843+0000 7f026be9d8c0 1 < completed delete operation key=T6QRDTQRHBPI tag=78FXLI4UEEH6 type=del 2024-09-12T17:05:04.852 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.847+0000 7f026be9d8c0 1 > prepared operation key=J8MU1A0CWSAQ tag=TRRO4A3X6K40 type=del size=2134952 2024-09-12T17:05:04.856 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.851+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~3DZ25M2UKU8G.0 size=813429 2024-09-12T17:05:04.861 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.855+0000 7f026be9d8c0 1 < completed multipart upload key=4G3BKGNT3YZC upload=3DZ25M2UKU8G tag=QSB9M9UL7OUS type=write size=1862005 2024-09-12T17:05:04.865 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.859+0000 7f026be9d8c0 1 > prepared operation key=8AFDAVJLMRD2 tag=HZXNNYU433YT type=write size=474119 2024-09-12T17:05:04.871 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.867+0000 7f026be9d8c0 1 < suggested update operation key=ALFGNC1YNROX tag=8B050KFVJ0JC type=write size=111568 2024-09-12T17:05:04.877 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.871+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~OU95C9C56EEO.0 size=1048576 2024-09-12T17:05:04.880 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.875+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~OU95C9C56EEO.1 size=191049 2024-09-12T17:05:04.880 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.875+0000 7f026be9d8c0 1 > prepared multipart upload key=SL2446KSB531 upload=OU95C9C56EEO tag=1SQ1QDQK6FNZ type=write size=2288201 2024-09-12T17:05:04.883 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.879+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~94CCMPVBY2U5.0 size=413708 2024-09-12T17:05:04.889 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.883+0000 7f026be9d8c0 1 < completed multipart upload key=QVQ4TI319DH5 upload=94CCMPVBY2U5 tag=IMYS3C0XCKSS type=write size=1462284 2024-09-12T17:05:04.892 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.887+0000 7f026be9d8c0 1 > prepared operation key=4G3BKGNT3YZC tag=NI4RGJBN2SJT type=del size=3524654 2024-09-12T17:05:04.895 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.891+0000 7f026be9d8c0 1 < canceled operation key=2BQJ30RQQ25L tag=4WGRFFLIE3IA type=del size=912224 2024-09-12T17:05:04.901 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.895+0000 7f026be9d8c0 1 > prepared part key=_multipart_4U1W97V0OX11.2~T1N21S86BCID.0 size=174016 2024-09-12T17:05:04.902 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.895+0000 7f026be9d8c0 1 > prepared multipart upload key=4U1W97V0OX11 upload=T1N21S86BCID tag=NX6TZTSZ6RJM type=write size=1222592 2024-09-12T17:05:04.905 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.899+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~QCHHS8O3AEUV.0 size=1048576 2024-09-12T17:05:04.907 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.903+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~QCHHS8O3AEUV.1 size=955499 2024-09-12T17:05:04.918 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.915+0000 7f026be9d8c0 1 < completed multipart upload key=GPUFWJ3AWEMX upload=QCHHS8O3AEUV tag=IKUH425D5GSU type=write size=3052651 2024-09-12T17:05:04.921 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.915+0000 7f026be9d8c0 1 > prepared operation key=T6QRDTQRHBPI tag=N0IWZTBYDPEM type=del size=2775504 2024-09-12T17:05:04.925 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.919+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~DZUUZLWJUDHD.0 size=1048576 2024-09-12T17:05:04.928 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.923+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~DZUUZLWJUDHD.1 size=1048576 2024-09-12T17:05:04.931 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.927+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~DZUUZLWJUDHD.2 size=545682 2024-09-12T17:05:04.936 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.931+0000 7f026be9d8c0 1 < completed multipart upload key=XLKR6P8RNRVO upload=DZUUZLWJUDHD tag=DINZ75UG9QC3 type=write size=3691410 2024-09-12T17:05:04.940 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.935+0000 7f026be9d8c0 1 > prepared operation key=LHKLWIUAT08F tag=2G4QJ7UE59QC type=write size=708001 2024-09-12T17:05:04.944 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.939+0000 7f026be9d8c0 1 < completed write operation key=BW1T21LBUE2D tag=BNIRKXF9A5VA type=write size=78410 2024-09-12T17:05:04.950 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.943+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~OMMBZ9BKMTWN.0 size=425772 2024-09-12T17:05:04.950 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.943+0000 7f026be9d8c0 1 > prepared multipart upload key=J8MU1A0CWSAQ upload=OMMBZ9BKMTWN tag=6TLRZCXH3TOL type=write size=1474348 2024-09-12T17:05:04.953 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.947+0000 7f026be9d8c0 1 < completed part key=_multipart_XNBE2II106VZ.2~IX57KDIM01N8.0 size=1048576 2024-09-12T17:05:04.956 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.951+0000 7f026be9d8c0 1 < completed part key=_multipart_XNBE2II106VZ.2~IX57KDIM01N8.1 size=626060 2024-09-12T17:05:04.961 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.955+0000 7f026be9d8c0 1 < completed multipart upload key=XNBE2II106VZ upload=IX57KDIM01N8 tag=CL75GKXEB9QE type=write size=2723212 2024-09-12T17:05:04.964 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.959+0000 7f026be9d8c0 1 > prepared operation key=UU88OS653L8D tag=0J4I8E058DYR type=del size=2623342 2024-09-12T17:05:04.968 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.963+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~OSE6EFXFE91V.0 size=839724 2024-09-12T17:05:04.974 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.967+0000 7f026be9d8c0 1 < completed multipart upload key=2BQJ30RQQ25L upload=OSE6EFXFE91V tag=6179ONLL7JYH type=write size=1888300 2024-09-12T17:05:04.977 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.971+0000 7f026be9d8c0 1 > prepared operation key=BBYDPSXZKHZP tag=Z657GM1ZU8CV type=del size=3479632 2024-09-12T17:05:04.981 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.975+0000 7f026be9d8c0 1 < canceled operation key=JJMEQ2O00SA2 tag=RZHAD3JHM5JC type=del size=972269 2024-09-12T17:05:04.987 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.983+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~5NUWN1KN8BQB.0 size=1048576 2024-09-12T17:05:04.990 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.983+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~5NUWN1KN8BQB.1 size=219412 2024-09-12T17:05:04.990 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.983+0000 7f026be9d8c0 1 > prepared multipart upload key=XLKR6P8RNRVO upload=5NUWN1KN8BQB tag=RMX63TH94IWI type=write size=2316564 2024-09-12T17:05:04.993 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.987+0000 7f026be9d8c0 -1 < failed to complete operation key=ALFGNC1YNROX tag=ONTM230CIFCK type=del size=1301258: (22) Invalid argument 2024-09-12T17:05:04.997 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.991+0000 7f026be9d8c0 1 > prepared operation key=E0Y3SKNUYCQS tag=A9FE5QW6GTIQ type=write size=625538 2024-09-12T17:05:05.000 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.995+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~QIL3AE0NSFUO.0 size=1048576 2024-09-12T17:05:05.003 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.999+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~QIL3AE0NSFUO.1 size=1048576 2024-09-12T17:05:05.006 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:04.999+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~QIL3AE0NSFUO.2 size=837196 2024-09-12T17:05:05.011 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.007+0000 7f026be9d8c0 1 < completed multipart upload key=Y27CDEOCM7DH upload=QIL3AE0NSFUO tag=2X4SZA6RGBYT type=write size=3982924 2024-09-12T17:05:05.017 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.011+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~31R41ORTC9SQ.0 size=1048576 2024-09-12T17:05:05.020 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.015+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~31R41ORTC9SQ.1 size=1048576 2024-09-12T17:05:05.023 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.019+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~31R41ORTC9SQ.2 size=547842 2024-09-12T17:05:05.023 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.019+0000 7f026be9d8c0 1 > prepared multipart upload key=32XUMOWT8HO2 upload=31R41ORTC9SQ tag=7B4E8SRZ81NR type=write size=3693570 2024-09-12T17:05:05.026 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.023+0000 7f026be9d8c0 1 < completed write operation key=21ZD52VBZIO4 tag=4LKEPUA33BTQ type=write size=341910 2024-09-12T17:05:05.031 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.027+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~PW46I6EVSO9W.0 size=1048576 2024-09-12T17:05:05.037 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.031+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~PW46I6EVSO9W.1 size=355836 2024-09-12T17:05:05.037 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.031+0000 7f026be9d8c0 1 > prepared multipart upload key=XLKR6P8RNRVO upload=PW46I6EVSO9W tag=IU2MSD8B3NU0 type=write size=2452988 2024-09-12T17:05:05.040 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.035+0000 7f026be9d8c0 1 < suggested update operation key=4U1W97V0OX11 tag=C7MK4MZURSRB type=write size=115855 2024-09-12T17:05:05.046 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.043+0000 7f026be9d8c0 1 > prepared part key=_multipart_XNBE2II106VZ.2~DRUGEYPL9IF2.0 size=1048576 2024-09-12T17:05:05.049 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.043+0000 7f026be9d8c0 1 > prepared part key=_multipart_XNBE2II106VZ.2~DRUGEYPL9IF2.1 size=1048576 2024-09-12T17:05:05.051 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.047+0000 7f026be9d8c0 1 > prepared part key=_multipart_XNBE2II106VZ.2~DRUGEYPL9IF2.2 size=477620 2024-09-12T17:05:05.052 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.047+0000 7f026be9d8c0 1 > prepared multipart upload key=XNBE2II106VZ upload=DRUGEYPL9IF2 tag=3B1JNKG96GFP type=write size=3623348 2024-09-12T17:05:05.055 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.051+0000 7f026be9d8c0 1 < completed write operation key=LHKLWIUAT08F tag=NV7NGM231VAG type=write size=333057 2024-09-12T17:05:05.061 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.055+0000 7f026be9d8c0 1 > prepared part key=_multipart_U8W1SAVSLTBF.2~7428WIO5G5O9.0 size=1048576 2024-09-12T17:05:05.064 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.059+0000 7f026be9d8c0 1 > prepared part key=_multipart_U8W1SAVSLTBF.2~7428WIO5G5O9.1 size=1048576 2024-09-12T17:05:05.067 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.063+0000 7f026be9d8c0 1 > prepared part key=_multipart_U8W1SAVSLTBF.2~7428WIO5G5O9.2 size=787958 2024-09-12T17:05:05.067 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.063+0000 7f026be9d8c0 1 > prepared multipart upload key=U8W1SAVSLTBF upload=7428WIO5G5O9 tag=56B2P6R6ZHBD type=write size=3933686 2024-09-12T17:05:05.070 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.067+0000 7f026be9d8c0 1 < completed delete operation key=J8MU1A0CWSAQ tag=TRRO4A3X6K40 type=del 2024-09-12T17:05:05.074 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.071+0000 7f026be9d8c0 1 > prepared operation key=Z183NH6R676V tag=XQW6XUC84X4S type=del size=2246399 2024-09-12T17:05:05.078 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.075+0000 7f026be9d8c0 1 < completed write operation key=8AFDAVJLMRD2 tag=HZXNNYU433YT type=write size=474119 2024-09-12T17:05:05.085 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.079+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~73IEK8E99G63.0 size=33875 2024-09-12T17:05:05.085 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.079+0000 7f026be9d8c0 1 > prepared multipart upload key=BW1T21LBUE2D upload=73IEK8E99G63 tag=7IS31EDMIZ0K type=write size=1082451 2024-09-12T17:05:05.086 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.083+0000 7f026be9d8c0 1 < canceled part key=_multipart_SL2446KSB531.2~OU95C9C56EEO.0 size=1048576 2024-09-12T17:05:05.086 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.083+0000 7f026be9d8c0 1 < canceled part key=_multipart_SL2446KSB531.2~OU95C9C56EEO.1 size=191049 2024-09-12T17:05:05.091 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.087+0000 7f026be9d8c0 1 < canceled multipart upload key=SL2446KSB531 upload=OU95C9C56EEO tag=1SQ1QDQK6FNZ type=write size=2288201 2024-09-12T17:05:05.095 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.091+0000 7f026be9d8c0 1 > prepared operation key=4U1W97V0OX11 tag=SBGUNUJHVN7I type=write size=423330 2024-09-12T17:05:05.098 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.095+0000 7f026be9d8c0 1 < canceled operation key=4G3BKGNT3YZC tag=NI4RGJBN2SJT type=del size=3524654 2024-09-12T17:05:05.102 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.099+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=XSBL0NI78U2O type=del size=3325828 2024-09-12T17:05:05.105 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.099+0000 7f026be9d8c0 1 < completed part key=_multipart_4U1W97V0OX11.2~T1N21S86BCID.0 size=174016 2024-09-12T17:05:05.110 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.107+0000 7f026be9d8c0 1 < completed multipart upload key=4U1W97V0OX11 upload=T1N21S86BCID tag=NX6TZTSZ6RJM type=write size=1222592 2024-09-12T17:05:05.117 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.111+0000 7f026be9d8c0 1 > prepared part key=_multipart_21ZD52VBZIO4.2~STP69DUF99B8.0 size=1048576 2024-09-12T17:05:05.120 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.115+0000 7f026be9d8c0 1 > prepared part key=_multipart_21ZD52VBZIO4.2~STP69DUF99B8.1 size=1048576 2024-09-12T17:05:05.122 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.119+0000 7f026be9d8c0 1 > prepared part key=_multipart_21ZD52VBZIO4.2~STP69DUF99B8.2 size=837643 2024-09-12T17:05:05.122 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.119+0000 7f026be9d8c0 1 > prepared multipart upload key=21ZD52VBZIO4 upload=STP69DUF99B8 tag=UYZD0P3L86E2 type=write size=3983371 2024-09-12T17:05:05.126 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.119+0000 7f026be9d8c0 1 < completed delete operation key=T6QRDTQRHBPI tag=N0IWZTBYDPEM type=del 2024-09-12T17:05:05.132 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.127+0000 7f026be9d8c0 1 > prepared part key=_multipart_MVYWUWKSYQ9Z.2~7BUHL7TZ8NOX.0 size=959265 2024-09-12T17:05:05.132 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.127+0000 7f026be9d8c0 1 > prepared multipart upload key=MVYWUWKSYQ9Z upload=7BUHL7TZ8NOX tag=V3OCXJEV0I8S type=write size=2007841 2024-09-12T17:05:05.135 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.131+0000 7f026be9d8c0 1 < completed write operation key=LHKLWIUAT08F tag=2G4QJ7UE59QC type=write size=708001 2024-09-12T17:05:05.138 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.135+0000 7f026be9d8c0 1 > prepared operation key=L194KQIPFLE1 tag=3NPQFT9V3OA0 type=del size=191508 2024-09-12T17:05:05.141 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.135+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~OMMBZ9BKMTWN.0 size=425772 2024-09-12T17:05:05.147 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.143+0000 7f026be9d8c0 1 < completed multipart upload key=J8MU1A0CWSAQ upload=OMMBZ9BKMTWN tag=6TLRZCXH3TOL type=write size=1474348 2024-09-12T17:05:05.150 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.143+0000 7f026be9d8c0 1 > prepared operation key=QVQ4TI319DH5 tag=XU99DKS5FT4U type=write size=416775 2024-09-12T17:05:05.153 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.147+0000 7f026be9d8c0 1 < completed delete operation key=UU88OS653L8D tag=0J4I8E058DYR type=del 2024-09-12T17:05:05.156 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.151+0000 7f026be9d8c0 1 > prepared operation key=XLKR6P8RNRVO tag=TXUPQ7PMEPBG type=del size=3923252 2024-09-12T17:05:05.162 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.159+0000 7f026be9d8c0 1 < suggested update operation key=BBYDPSXZKHZP tag=Z657GM1ZU8CV type=del size=3479632 2024-09-12T17:05:05.169 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.163+0000 7f026be9d8c0 1 > prepared part key=_multipart_BBYDPSXZKHZP.2~5HSW22CZUFP9.0 size=1048576 2024-09-12T17:05:05.172 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.167+0000 7f026be9d8c0 1 > prepared part key=_multipart_BBYDPSXZKHZP.2~5HSW22CZUFP9.1 size=658176 2024-09-12T17:05:05.172 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.167+0000 7f026be9d8c0 1 > prepared multipart upload key=BBYDPSXZKHZP upload=5HSW22CZUFP9 tag=S3CYHWSBZ0AD type=write size=2755328 2024-09-12T17:05:05.175 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.171+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~5NUWN1KN8BQB.0 size=1048576 2024-09-12T17:05:05.178 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.175+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~5NUWN1KN8BQB.1 size=219412 2024-09-12T17:05:05.184 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.179+0000 7f026be9d8c0 1 < completed multipart upload key=XLKR6P8RNRVO upload=5NUWN1KN8BQB tag=RMX63TH94IWI type=write size=2316564 2024-09-12T17:05:05.188 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.183+0000 7f026be9d8c0 1 > prepared operation key=32XUMOWT8HO2 tag=UP91HBLQS5HI type=del size=3738947 2024-09-12T17:05:05.192 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.187+0000 7f026be9d8c0 1 < canceled operation key=E0Y3SKNUYCQS tag=A9FE5QW6GTIQ type=write size=625538 2024-09-12T17:05:05.195 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.191+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=HHNAM9Y2M0EX type=del size=3785440 2024-09-12T17:05:05.196 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.191+0000 7f026be9d8c0 1 < canceled part key=_multipart_32XUMOWT8HO2.2~31R41ORTC9SQ.0 size=1048576 2024-09-12T17:05:05.198 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.195+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~31R41ORTC9SQ.1 size=1048576 2024-09-12T17:05:05.201 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.195+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~31R41ORTC9SQ.2 size=547842 2024-09-12T17:05:05.207 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.203+0000 7f026be9d8c0 1 < canceled multipart upload key=32XUMOWT8HO2 upload=31R41ORTC9SQ tag=7B4E8SRZ81NR type=write size=3693570 2024-09-12T17:05:05.213 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.207+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~SF9TDBLHJCU5.0 size=1048576 2024-09-12T17:05:05.216 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.211+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~SF9TDBLHJCU5.1 size=1048576 2024-09-12T17:05:05.219 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.215+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~SF9TDBLHJCU5.2 size=744993 2024-09-12T17:05:05.219 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.215+0000 7f026be9d8c0 1 > prepared multipart upload key=6VO85REZG2NW upload=SF9TDBLHJCU5 tag=43PLMKYIKYU1 type=write size=3890721 2024-09-12T17:05:05.220 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.215+0000 7f026be9d8c0 1 < canceled part key=_multipart_XLKR6P8RNRVO.2~PW46I6EVSO9W.0 size=1048576 2024-09-12T17:05:05.220 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.215+0000 7f026be9d8c0 1 < canceled part key=_multipart_XLKR6P8RNRVO.2~PW46I6EVSO9W.1 size=355836 2024-09-12T17:05:05.226 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.223+0000 7f026be9d8c0 1 < canceled multipart upload key=XLKR6P8RNRVO upload=PW46I6EVSO9W tag=IU2MSD8B3NU0 type=write size=2452988 2024-09-12T17:05:05.234 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.231+0000 7f026be9d8c0 1 > prepared operation key=8AFDAVJLMRD2 tag=9PLJOSEBHZ9W type=del size=3100468 2024-09-12T17:05:05.238 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.235+0000 7f026be9d8c0 1 < completed part key=_multipart_XNBE2II106VZ.2~DRUGEYPL9IF2.0 size=1048576 2024-09-12T17:05:05.241 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.235+0000 7f026be9d8c0 1 < completed part key=_multipart_XNBE2II106VZ.2~DRUGEYPL9IF2.1 size=1048576 2024-09-12T17:05:05.241 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.235+0000 7f026be9d8c0 1 < canceled part key=_multipart_XNBE2II106VZ.2~DRUGEYPL9IF2.2 size=477620 2024-09-12T17:05:05.246 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.243+0000 7f026be9d8c0 1 < canceled multipart upload key=XNBE2II106VZ upload=DRUGEYPL9IF2 tag=3B1JNKG96GFP type=write size=3623348 2024-09-12T17:05:05.250 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.247+0000 7f026be9d8c0 1 > prepared operation key=BBYDPSXZKHZP tag=H90G6GL6WGFZ type=del size=3346496 2024-09-12T17:05:05.253 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.247+0000 7f026be9d8c0 1 < completed part key=_multipart_U8W1SAVSLTBF.2~7428WIO5G5O9.0 size=1048576 2024-09-12T17:05:05.257 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.251+0000 7f026be9d8c0 1 < completed part key=_multipart_U8W1SAVSLTBF.2~7428WIO5G5O9.1 size=1048576 2024-09-12T17:05:05.259 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.255+0000 7f026be9d8c0 1 < completed part key=_multipart_U8W1SAVSLTBF.2~7428WIO5G5O9.2 size=787958 2024-09-12T17:05:05.265 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.259+0000 7f026be9d8c0 1 < completed multipart upload key=U8W1SAVSLTBF upload=7428WIO5G5O9 tag=56B2P6R6ZHBD type=write size=3933686 2024-09-12T17:05:05.271 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.267+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~7KPPU263H3L1.0 size=1048576 2024-09-12T17:05:05.274 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.271+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~7KPPU263H3L1.1 size=560414 2024-09-12T17:05:05.274 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.271+0000 7f026be9d8c0 1 > prepared multipart upload key=SL2446KSB531 upload=7KPPU263H3L1 tag=WU9YGR7UJ7NY type=write size=2657566 2024-09-12T17:05:05.278 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.275+0000 7f026be9d8c0 1 < completed delete operation key=Z183NH6R676V tag=XQW6XUC84X4S type=del 2024-09-12T17:05:05.283 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.279+0000 7f026be9d8c0 1 > prepared operation key=E0Y3SKNUYCQS tag=UMHEMGQTUP8N type=write size=397431 2024-09-12T17:05:05.287 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.283+0000 7f026be9d8c0 1 < completed part key=_multipart_BW1T21LBUE2D.2~73IEK8E99G63.0 size=33875 2024-09-12T17:05:05.294 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.287+0000 7f026be9d8c0 1 < completed multipart upload key=BW1T21LBUE2D upload=73IEK8E99G63 tag=7IS31EDMIZ0K type=write size=1082451 2024-09-12T17:05:05.298 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.295+0000 7f026be9d8c0 1 > prepared operation key=L194KQIPFLE1 tag=2JYXMBEWLFWT type=del size=360440 2024-09-12T17:05:05.303 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.299+0000 7f026be9d8c0 1 < completed write operation key=4U1W97V0OX11 tag=SBGUNUJHVN7I type=write size=423330 2024-09-12T17:05:05.307 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.303+0000 7f026be9d8c0 1 > prepared operation key=BW1T21LBUE2D tag=57RFKK4YSL65 type=del size=1034088 2024-09-12T17:05:05.312 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.307+0000 7f026be9d8c0 1 < completed delete operation key=U8W1SAVSLTBF tag=XSBL0NI78U2O type=del 2024-09-12T17:05:05.316 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.311+0000 7f026be9d8c0 1 > prepared operation key=LHKLWIUAT08F tag=6OQVGRV15K8E type=del size=1354439 2024-09-12T17:05:05.321 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.315+0000 7f026be9d8c0 1 < completed part key=_multipart_21ZD52VBZIO4.2~STP69DUF99B8.0 size=1048576 2024-09-12T17:05:05.324 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.319+0000 7f026be9d8c0 1 < completed part key=_multipart_21ZD52VBZIO4.2~STP69DUF99B8.1 size=1048576 2024-09-12T17:05:05.324 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.319+0000 7f026be9d8c0 1 < canceled part key=_multipart_21ZD52VBZIO4.2~STP69DUF99B8.2 size=837643 2024-09-12T17:05:05.331 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.327+0000 7f026be9d8c0 1 < canceled multipart upload key=21ZD52VBZIO4 upload=STP69DUF99B8 tag=UYZD0P3L86E2 type=write size=3983371 2024-09-12T17:05:05.335 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.331+0000 7f026be9d8c0 1 > prepared operation key=SL2446KSB531 tag=AWX5M874F60T type=del size=1599633 2024-09-12T17:05:05.338 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.335+0000 7f026be9d8c0 1 < completed part key=_multipart_MVYWUWKSYQ9Z.2~7BUHL7TZ8NOX.0 size=959265 2024-09-12T17:05:05.345 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.339+0000 7f026be9d8c0 1 < completed multipart upload key=MVYWUWKSYQ9Z upload=7BUHL7TZ8NOX tag=V3OCXJEV0I8S type=write size=2007841 2024-09-12T17:05:05.348 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.343+0000 7f026be9d8c0 1 > prepared operation key=T6QRDTQRHBPI tag=TXL5MZ86ZH2W type=write size=556735 2024-09-12T17:05:05.352 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.347+0000 7f026be9d8c0 1 < completed delete operation key=L194KQIPFLE1 tag=3NPQFT9V3OA0 type=del 2024-09-12T17:05:05.355 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.351+0000 7f026be9d8c0 1 > prepared operation key=L194KQIPFLE1 tag=0PVSL2KRZZWT type=del size=367288 2024-09-12T17:05:05.359 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.355+0000 7f026be9d8c0 1 < completed write operation key=QVQ4TI319DH5 tag=XU99DKS5FT4U type=write size=416775 2024-09-12T17:05:05.363 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.359+0000 7f026be9d8c0 1 > prepared operation key=SGT8IC1GJ3IG tag=8O5CKDXWQ0LW type=del size=1572546 2024-09-12T17:05:05.366 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.363+0000 7f026be9d8c0 1 < canceled operation key=XLKR6P8RNRVO tag=TXUPQ7PMEPBG type=del size=3923252 2024-09-12T17:05:05.373 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.367+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~40YO8SY2YLMB.0 size=1048576 2024-09-12T17:05:05.376 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.371+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~40YO8SY2YLMB.1 size=122638 2024-09-12T17:05:05.376 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.371+0000 7f026be9d8c0 1 > prepared multipart upload key=BW1T21LBUE2D upload=40YO8SY2YLMB tag=F3L7A0BZ2WJG type=write size=2219790 2024-09-12T17:05:05.381 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.375+0000 7f026be9d8c0 1 < completed part key=_multipart_BBYDPSXZKHZP.2~5HSW22CZUFP9.0 size=1048576 2024-09-12T17:05:05.384 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.379+0000 7f026be9d8c0 1 < completed part key=_multipart_BBYDPSXZKHZP.2~5HSW22CZUFP9.1 size=658176 2024-09-12T17:05:05.391 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.387+0000 7f026be9d8c0 1 < completed multipart upload key=BBYDPSXZKHZP upload=5HSW22CZUFP9 tag=S3CYHWSBZ0AD type=write size=2755328 2024-09-12T17:05:05.399 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.395+0000 7f026be9d8c0 1 > prepared part key=_multipart_3JADN360QEO3.2~MN8HU98TXG8X.0 size=1048576 2024-09-12T17:05:05.402 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.399+0000 7f026be9d8c0 1 > prepared part key=_multipart_3JADN360QEO3.2~MN8HU98TXG8X.1 size=1048576 2024-09-12T17:05:05.406 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.399+0000 7f026be9d8c0 1 > prepared part key=_multipart_3JADN360QEO3.2~MN8HU98TXG8X.2 size=507549 2024-09-12T17:05:05.406 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.399+0000 7f026be9d8c0 1 > prepared multipart upload key=3JADN360QEO3 upload=MN8HU98TXG8X tag=X5R4EXGQ29GV type=write size=3653277 2024-09-12T17:05:05.410 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.407+0000 7f026be9d8c0 1 < completed delete operation key=32XUMOWT8HO2 tag=UP91HBLQS5HI type=del 2024-09-12T17:05:05.414 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.411+0000 7f026be9d8c0 1 > prepared operation key=4U1W97V0OX11 tag=9GQBJ6UGT0E2 type=del size=2902202 2024-09-12T17:05:05.418 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.415+0000 7f026be9d8c0 1 < completed delete operation key=RBNN03IPZ8BT tag=HHNAM9Y2M0EX type=del 2024-09-12T17:05:05.423 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.419+0000 7f026be9d8c0 1 > prepared operation key=MVYWUWKSYQ9Z tag=G46ID19GJNR9 type=del size=2597979 2024-09-12T17:05:05.424 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.419+0000 7f026be9d8c0 1 < canceled part key=_multipart_6VO85REZG2NW.2~SF9TDBLHJCU5.0 size=1048576 2024-09-12T17:05:05.427 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.423+0000 7f026be9d8c0 1 < completed part key=_multipart_6VO85REZG2NW.2~SF9TDBLHJCU5.1 size=1048576 2024-09-12T17:05:05.431 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.427+0000 7f026be9d8c0 1 < completed part key=_multipart_6VO85REZG2NW.2~SF9TDBLHJCU5.2 size=744993 2024-09-12T17:05:05.441 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.431+0000 7f026be9d8c0 1 < canceled multipart upload key=6VO85REZG2NW upload=SF9TDBLHJCU5 tag=43PLMKYIKYU1 type=write size=3890721 2024-09-12T17:05:05.442 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.435+0000 7f026be9d8c0 1 > prepared operation key=BW1T21LBUE2D tag=Y8AUUX7XZBCA type=del size=2137380 2024-09-12T17:05:05.445 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.439+0000 7f026be9d8c0 1 < completed delete operation key=8AFDAVJLMRD2 tag=9PLJOSEBHZ9W type=del 2024-09-12T17:05:05.450 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.447+0000 7f026be9d8c0 1 > prepared operation key=J8MU1A0CWSAQ tag=CGFD2OU8XBTR type=del size=1259409 2024-09-12T17:05:05.454 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.451+0000 7f026be9d8c0 1 < completed delete operation key=BBYDPSXZKHZP tag=H90G6GL6WGFZ type=del 2024-09-12T17:05:05.462 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.455+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~IM05F05BDOQC.0 size=1048576 2024-09-12T17:05:05.465 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.459+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~IM05F05BDOQC.1 size=1048576 2024-09-12T17:05:05.467 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.463+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~IM05F05BDOQC.2 size=891490 2024-09-12T17:05:05.467 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.463+0000 7f026be9d8c0 1 > prepared multipart upload key=32XUMOWT8HO2 upload=IM05F05BDOQC tag=UCEPB1N1EW0G type=write size=4037218 2024-09-12T17:05:05.471 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.467+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~7KPPU263H3L1.0 size=1048576 2024-09-12T17:05:05.471 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.467+0000 7f026be9d8c0 1 < canceled part key=_multipart_SL2446KSB531.2~7KPPU263H3L1.1 size=560414 2024-09-12T17:05:05.478 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.475+0000 7f026be9d8c0 1 < canceled multipart upload key=SL2446KSB531 upload=7KPPU263H3L1 tag=WU9YGR7UJ7NY type=write size=2657566 2024-09-12T17:05:05.482 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.479+0000 7f026be9d8c0 1 > prepared operation key=GPUFWJ3AWEMX tag=UKZ7Y3DNOQEX type=del size=1818168 2024-09-12T17:05:05.485 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.479+0000 7f026be9d8c0 1 < completed write operation key=E0Y3SKNUYCQS tag=UMHEMGQTUP8N type=write size=397431 2024-09-12T17:05:05.492 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.487+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~E8BZWG0E6SUZ.0 size=218693 2024-09-12T17:05:05.492 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.487+0000 7f026be9d8c0 1 > prepared multipart upload key=GPUFWJ3AWEMX upload=E8BZWG0E6SUZ tag=JS0I5LTA03OK type=write size=1267269 2024-09-12T17:05:05.499 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.495+0000 7f026be9d8c0 1 < suggested update operation key=L194KQIPFLE1 tag=2JYXMBEWLFWT type=del size=360440 2024-09-12T17:05:05.503 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.499+0000 7f026be9d8c0 1 > prepared operation key=MVYWUWKSYQ9Z tag=ZLW5J6B2B19Q type=del size=3586389 2024-09-12T17:05:05.507 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.503+0000 7f026be9d8c0 1 < completed delete operation key=BW1T21LBUE2D tag=57RFKK4YSL65 type=del 2024-09-12T17:05:05.511 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.507+0000 7f026be9d8c0 1 > prepared operation key=XLKR6P8RNRVO tag=YV9EC960FVDU type=del size=1839078 2024-09-12T17:05:05.515 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.511+0000 7f026be9d8c0 1 < completed delete operation key=LHKLWIUAT08F tag=6OQVGRV15K8E type=del 2024-09-12T17:05:05.519 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.515+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=P1VEPKUZY1W0 type=write size=437943 2024-09-12T17:05:05.523 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.519+0000 7f026be9d8c0 1 < completed delete operation key=SL2446KSB531 tag=AWX5M874F60T type=del 2024-09-12T17:05:05.526 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.523+0000 7f026be9d8c0 1 > prepared operation key=E0Y3SKNUYCQS tag=L0CUX4QU8P4N type=write size=203479 2024-09-12T17:05:05.530 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.527+0000 7f026be9d8c0 1 < completed write operation key=T6QRDTQRHBPI tag=TXL5MZ86ZH2W type=write size=556735 2024-09-12T17:05:05.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.531+0000 7f026be9d8c0 1 > prepared part key=_multipart_BBYDPSXZKHZP.2~NSOQE4ME4NHG.0 size=1048576 2024-09-12T17:05:05.539 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.535+0000 7f026be9d8c0 1 > prepared part key=_multipart_BBYDPSXZKHZP.2~NSOQE4ME4NHG.1 size=1048576 2024-09-12T17:05:05.542 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.539+0000 7f026be9d8c0 1 > prepared part key=_multipart_BBYDPSXZKHZP.2~NSOQE4ME4NHG.2 size=972285 2024-09-12T17:05:05.542 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.539+0000 7f026be9d8c0 1 > prepared multipart upload key=BBYDPSXZKHZP upload=NSOQE4ME4NHG tag=NYQTWQSU1P7P type=write size=4118013 2024-09-12T17:05:05.546 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.543+0000 7f026be9d8c0 -1 < failed to complete operation key=L194KQIPFLE1 tag=0PVSL2KRZZWT type=del size=367288: (22) Invalid argument 2024-09-12T17:05:05.549 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.543+0000 7f026be9d8c0 1 > prepared operation key=32XUMOWT8HO2 tag=UQWH5BCW6K5L type=del size=3626377 2024-09-12T17:05:05.553 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.547+0000 7f026be9d8c0 1 < completed delete operation key=SGT8IC1GJ3IG tag=8O5CKDXWQ0LW type=del 2024-09-12T17:05:05.557 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.551+0000 7f026be9d8c0 1 > prepared operation key=Z183NH6R676V tag=GEIGFUNJCACC type=write size=698928 2024-09-12T17:05:05.561 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.555+0000 7f026be9d8c0 1 < completed part key=_multipart_BW1T21LBUE2D.2~40YO8SY2YLMB.0 size=1048576 2024-09-12T17:05:05.563 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.559+0000 7f026be9d8c0 1 < completed part key=_multipart_BW1T21LBUE2D.2~40YO8SY2YLMB.1 size=122638 2024-09-12T17:05:05.570 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.567+0000 7f026be9d8c0 1 < completed multipart upload key=BW1T21LBUE2D upload=40YO8SY2YLMB tag=F3L7A0BZ2WJG type=write size=2219790 2024-09-12T17:05:05.573 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.567+0000 7f026be9d8c0 1 > prepared operation key=Z183NH6R676V tag=WOPGHMCTE0UB type=del size=2187767 2024-09-12T17:05:05.578 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.571+0000 7f026be9d8c0 1 < completed part key=_multipart_3JADN360QEO3.2~MN8HU98TXG8X.0 size=1048576 2024-09-12T17:05:05.580 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.575+0000 7f026be9d8c0 1 < completed part key=_multipart_3JADN360QEO3.2~MN8HU98TXG8X.1 size=1048576 2024-09-12T17:05:05.584 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.579+0000 7f026be9d8c0 1 < completed part key=_multipart_3JADN360QEO3.2~MN8HU98TXG8X.2 size=507549 2024-09-12T17:05:05.590 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.587+0000 7f026be9d8c0 1 < completed multipart upload key=3JADN360QEO3 upload=MN8HU98TXG8X tag=X5R4EXGQ29GV type=write size=3653277 2024-09-12T17:05:05.598 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.595+0000 7f026be9d8c0 1 > prepared operation key=2BQJ30RQQ25L tag=O5M6G19T99CQ type=del size=784309 2024-09-12T17:05:05.602 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.599+0000 7f026be9d8c0 1 < completed delete operation key=4U1W97V0OX11 tag=9GQBJ6UGT0E2 type=del 2024-09-12T17:05:05.606 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.599+0000 7f026be9d8c0 1 > prepared operation key=T6QRDTQRHBPI tag=IA8B33DKMUMY type=del size=1036783 2024-09-12T17:05:05.610 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.603+0000 7f026be9d8c0 1 < completed delete operation key=MVYWUWKSYQ9Z tag=G46ID19GJNR9 type=del 2024-09-12T17:05:05.613 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.607+0000 7f026be9d8c0 1 > prepared operation key=Z9YNIEQCVNBA tag=6CAP2Z9ILBT7 type=del size=3056997 2024-09-12T17:05:05.617 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.611+0000 7f026be9d8c0 1 < completed delete operation key=BW1T21LBUE2D tag=Y8AUUX7XZBCA type=del 2024-09-12T17:05:05.621 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.615+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=RHYR466IV05U type=del size=3196256 2024-09-12T17:05:05.625 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.619+0000 7f026be9d8c0 1 < completed delete operation key=J8MU1A0CWSAQ tag=CGFD2OU8XBTR type=del 2024-09-12T17:05:05.629 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.623+0000 7f026be9d8c0 1 > prepared operation key=6VO85REZG2NW tag=7JFT54OISHK3 type=write size=894281 2024-09-12T17:05:05.633 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.627+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~IM05F05BDOQC.0 size=1048576 2024-09-12T17:05:05.636 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.631+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~IM05F05BDOQC.1 size=1048576 2024-09-12T17:05:05.638 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.635+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~IM05F05BDOQC.2 size=891490 2024-09-12T17:05:05.644 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.639+0000 7f026be9d8c0 1 < completed multipart upload key=32XUMOWT8HO2 upload=IM05F05BDOQC tag=UCEPB1N1EW0G type=write size=4037218 2024-09-12T17:05:05.649 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.643+0000 7f026be9d8c0 1 > prepared operation key=XLKR6P8RNRVO tag=S2QKFCZNPUB2 type=del size=2805733 2024-09-12T17:05:05.651 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.647+0000 7f026be9d8c0 1 < completed delete operation key=GPUFWJ3AWEMX tag=UKZ7Y3DNOQEX type=del 2024-09-12T17:05:05.654 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.651+0000 7f026be9d8c0 1 > prepared operation key=SGT8IC1GJ3IG tag=YA952Z3MJLZO type=del size=1997611 2024-09-12T17:05:05.658 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.651+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~E8BZWG0E6SUZ.0 size=218693 2024-09-12T17:05:05.663 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.659+0000 7f026be9d8c0 1 < completed multipart upload key=GPUFWJ3AWEMX upload=E8BZWG0E6SUZ tag=JS0I5LTA03OK type=write size=1267269 2024-09-12T17:05:05.667 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.663+0000 7f026be9d8c0 1 > prepared operation key=J8MU1A0CWSAQ tag=7HPQPJM4VFQK type=del size=315376 2024-09-12T17:05:05.674 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.671+0000 7f026be9d8c0 1 < suggested remove operation key=MVYWUWKSYQ9Z tag=ZLW5J6B2B19Q type=del 2024-09-12T17:05:05.680 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.675+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~GNJR13P6P8JP.0 size=1048576 2024-09-12T17:05:05.683 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.679+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~GNJR13P6P8JP.1 size=1048576 2024-09-12T17:05:05.686 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.679+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~GNJR13P6P8JP.2 size=523671 2024-09-12T17:05:05.686 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.679+0000 7f026be9d8c0 1 > prepared multipart upload key=SL2446KSB531 upload=GNJR13P6P8JP tag=OYCHT2JWV250 type=write size=3669399 2024-09-12T17:05:05.689 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.683+0000 7f026be9d8c0 1 < completed delete operation key=XLKR6P8RNRVO tag=YV9EC960FVDU type=del 2024-09-12T17:05:05.693 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.687+0000 7f026be9d8c0 1 > prepared operation key=8AFDAVJLMRD2 tag=OIFHOLLU0W8F type=del size=2137905 2024-09-12T17:05:05.697 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.691+0000 7f026be9d8c0 1 < canceled operation key=U8W1SAVSLTBF tag=P1VEPKUZY1W0 type=write size=437943 2024-09-12T17:05:05.700 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.695+0000 7f026be9d8c0 1 > prepared operation key=32XUMOWT8HO2 tag=J52OHA13NU6N type=del size=3802372 2024-09-12T17:05:05.704 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.699+0000 7f026be9d8c0 1 < completed write operation key=E0Y3SKNUYCQS tag=L0CUX4QU8P4N type=write size=203479 2024-09-12T17:05:05.711 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.707+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~DAZD1URYVRLG.0 size=277953 2024-09-12T17:05:05.711 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.707+0000 7f026be9d8c0 1 > prepared multipart upload key=4G3BKGNT3YZC upload=DAZD1URYVRLG tag=OAD70MBM4B22 type=write size=1326529 2024-09-12T17:05:05.715 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.711+0000 7f026be9d8c0 1 < completed part key=_multipart_BBYDPSXZKHZP.2~NSOQE4ME4NHG.0 size=1048576 2024-09-12T17:05:05.715 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.711+0000 7f026be9d8c0 1 < canceled part key=_multipart_BBYDPSXZKHZP.2~NSOQE4ME4NHG.1 size=1048576 2024-09-12T17:05:05.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.715+0000 7f026be9d8c0 1 < completed part key=_multipart_BBYDPSXZKHZP.2~NSOQE4ME4NHG.2 size=972285 2024-09-12T17:05:05.725 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.719+0000 7f026be9d8c0 1 < canceled multipart upload key=BBYDPSXZKHZP upload=NSOQE4ME4NHG tag=NYQTWQSU1P7P type=write size=4118013 2024-09-12T17:05:05.731 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.727+0000 7f026be9d8c0 1 > prepared part key=_multipart_SGT8IC1GJ3IG.2~HU94Q1D9T016.0 size=1048576 2024-09-12T17:05:05.734 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.731+0000 7f026be9d8c0 1 > prepared part key=_multipart_SGT8IC1GJ3IG.2~HU94Q1D9T016.1 size=1031328 2024-09-12T17:05:05.735 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.731+0000 7f026be9d8c0 1 > prepared multipart upload key=SGT8IC1GJ3IG upload=HU94Q1D9T016 tag=SFQZ7B5ZN0NM type=write size=3128480 2024-09-12T17:05:05.738 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.735+0000 7f026be9d8c0 1 < completed delete operation key=32XUMOWT8HO2 tag=UQWH5BCW6K5L type=del 2024-09-12T17:05:05.741 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.735+0000 7f026be9d8c0 1 > prepared operation key=BBYDPSXZKHZP tag=2E4CCXJ72PFA type=write size=743069 2024-09-12T17:05:05.745 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.739+0000 7f026be9d8c0 1 < completed write operation key=Z183NH6R676V tag=GEIGFUNJCACC type=write size=698928 2024-09-12T17:05:05.749 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.743+0000 7f026be9d8c0 1 > prepared operation key=GPUFWJ3AWEMX tag=B229G9YEJP5E type=del size=2682860 2024-09-12T17:05:05.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.747+0000 7f026be9d8c0 1 < completed delete operation key=Z183NH6R676V tag=WOPGHMCTE0UB type=del 2024-09-12T17:05:05.756 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.751+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=UUI6XDSF9J58 type=write size=282512 2024-09-12T17:05:05.760 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.755+0000 7f026be9d8c0 1 < completed delete operation key=2BQJ30RQQ25L tag=O5M6G19T99CQ type=del 2024-09-12T17:05:05.766 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.763+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~29NSFLRYP1AW.0 size=1048576 2024-09-12T17:05:05.769 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.763+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~29NSFLRYP1AW.1 size=348012 2024-09-12T17:05:05.769 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.763+0000 7f026be9d8c0 1 > prepared multipart upload key=6VO85REZG2NW upload=29NSFLRYP1AW tag=7PR32QER7DO5 type=write size=2445164 2024-09-12T17:05:05.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.767+0000 7f026be9d8c0 1 < completed delete operation key=T6QRDTQRHBPI tag=IA8B33DKMUMY type=del 2024-09-12T17:05:05.777 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.771+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=HWK265I4HVSP type=del size=835946 2024-09-12T17:05:05.784 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.779+0000 7f026be9d8c0 1 < suggested update operation key=Z9YNIEQCVNBA tag=6CAP2Z9ILBT7 type=del size=3056997 2024-09-12T17:05:05.790 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.787+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~SA0N7NID0N5B.0 size=1048576 2024-09-12T17:05:05.793 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.787+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~SA0N7NID0N5B.1 size=1048576 2024-09-12T17:05:05.796 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.791+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~SA0N7NID0N5B.2 size=1045805 2024-09-12T17:05:05.796 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.791+0000 7f026be9d8c0 1 > prepared multipart upload key=BW1T21LBUE2D upload=SA0N7NID0N5B tag=I6A2EYNR31G6 type=write size=4191533 2024-09-12T17:05:05.799 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.795+0000 7f026be9d8c0 1 < canceled operation key=3JADN360QEO3 tag=RHYR466IV05U type=del size=3196256 2024-09-12T17:05:05.803 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.799+0000 7f026be9d8c0 1 > prepared operation key=SGT8IC1GJ3IG tag=UTR93MXPO18P type=del size=3183705 2024-09-12T17:05:05.807 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.803+0000 7f026be9d8c0 1 < completed write operation key=6VO85REZG2NW tag=7JFT54OISHK3 type=write size=894281 2024-09-12T17:05:05.814 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.811+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z183NH6R676V.2~EX74X1YXD5B3.0 size=1024658 2024-09-12T17:05:05.814 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.811+0000 7f026be9d8c0 1 > prepared multipart upload key=Z183NH6R676V upload=EX74X1YXD5B3 tag=M17FL03IR1U4 type=write size=2073234 2024-09-12T17:05:05.818 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.815+0000 7f026be9d8c0 1 < completed delete operation key=XLKR6P8RNRVO tag=S2QKFCZNPUB2 type=del 2024-09-12T17:05:05.825 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.819+0000 7f026be9d8c0 1 > prepared part key=_multipart_3JADN360QEO3.2~1RT074DLSLBE.0 size=1048576 2024-09-12T17:05:05.829 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.823+0000 7f026be9d8c0 1 > prepared part key=_multipart_3JADN360QEO3.2~1RT074DLSLBE.1 size=1016117 2024-09-12T17:05:05.829 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.823+0000 7f026be9d8c0 1 > prepared multipart upload key=3JADN360QEO3 upload=1RT074DLSLBE tag=3Z5KV1K1EQO9 type=write size=3113269 2024-09-12T17:05:05.833 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.827+0000 7f026be9d8c0 1 < completed delete operation key=SGT8IC1GJ3IG tag=YA952Z3MJLZO type=del 2024-09-12T17:05:05.836 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.831+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=KLJJEXA61S3U type=del size=2793667 2024-09-12T17:05:05.840 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.835+0000 7f026be9d8c0 1 < completed delete operation key=J8MU1A0CWSAQ tag=7HPQPJM4VFQK type=del 2024-09-12T17:05:05.848 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.843+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~2UHM9NZXLFA2.0 size=1048576 2024-09-12T17:05:05.851 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.847+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~2UHM9NZXLFA2.1 size=413568 2024-09-12T17:05:05.851 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.847+0000 7f026be9d8c0 1 > prepared multipart upload key=UU88OS653L8D upload=2UHM9NZXLFA2 tag=63M6NV3A1RK5 type=write size=2510720 2024-09-12T17:05:05.852 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.847+0000 7f026be9d8c0 1 < canceled part key=_multipart_SL2446KSB531.2~GNJR13P6P8JP.0 size=1048576 2024-09-12T17:05:05.854 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.851+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~GNJR13P6P8JP.1 size=1048576 2024-09-12T17:05:05.857 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.851+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~GNJR13P6P8JP.2 size=523671 2024-09-12T17:05:05.863 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.859+0000 7f026be9d8c0 1 < canceled multipart upload key=SL2446KSB531 upload=GNJR13P6P8JP tag=OYCHT2JWV250 type=write size=3669399 2024-09-12T17:05:05.867 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.863+0000 7f026be9d8c0 1 > prepared operation key=6VO85REZG2NW tag=MVKQHLX7PQXN type=write size=630816 2024-09-12T17:05:05.870 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.867+0000 7f026be9d8c0 1 < completed delete operation key=8AFDAVJLMRD2 tag=OIFHOLLU0W8F type=del 2024-09-12T17:05:05.873 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.867+0000 7f026be9d8c0 1 > prepared operation key=8AFDAVJLMRD2 tag=WRAGEFJ1IWJG type=del size=1989556 2024-09-12T17:05:05.877 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.871+0000 7f026be9d8c0 1 < completed delete operation key=32XUMOWT8HO2 tag=J52OHA13NU6N type=del 2024-09-12T17:05:05.883 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.879+0000 7f026be9d8c0 1 > prepared part key=_multipart_PQSQ39X3O64P.2~CF32WDS21USZ.0 size=1048576 2024-09-12T17:05:05.886 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.879+0000 7f026be9d8c0 1 > prepared part key=_multipart_PQSQ39X3O64P.2~CF32WDS21USZ.1 size=63774 2024-09-12T17:05:05.886 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.879+0000 7f026be9d8c0 1 > prepared multipart upload key=PQSQ39X3O64P upload=CF32WDS21USZ tag=GFVO2ZALB08G type=write size=2160926 2024-09-12T17:05:05.890 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.883+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~DAZD1URYVRLG.0 size=277953 2024-09-12T17:05:05.895 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.891+0000 7f026be9d8c0 1 < completed multipart upload key=4G3BKGNT3YZC upload=DAZD1URYVRLG tag=OAD70MBM4B22 type=write size=1326529 2024-09-12T17:05:05.899 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.895+0000 7f026be9d8c0 1 > prepared operation key=2BQJ30RQQ25L tag=PG71M94KCIF1 type=del size=675930 2024-09-12T17:05:05.903 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.899+0000 7f026be9d8c0 1 < completed part key=_multipart_SGT8IC1GJ3IG.2~HU94Q1D9T016.0 size=1048576 2024-09-12T17:05:05.905 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.899+0000 7f026be9d8c0 1 < completed part key=_multipart_SGT8IC1GJ3IG.2~HU94Q1D9T016.1 size=1031328 2024-09-12T17:05:05.911 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.907+0000 7f026be9d8c0 1 < completed multipart upload key=SGT8IC1GJ3IG upload=HU94Q1D9T016 tag=SFQZ7B5ZN0NM type=write size=3128480 2024-09-12T17:05:05.918 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.911+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~VU562C36S9CE.0 size=1048576 2024-09-12T17:05:05.921 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.915+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~VU562C36S9CE.1 size=350738 2024-09-12T17:05:05.921 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.915+0000 7f026be9d8c0 1 > prepared multipart upload key=JJMEQ2O00SA2 upload=VU562C36S9CE tag=DIANB0ZVHND2 type=write size=2447890 2024-09-12T17:05:05.924 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.919+0000 7f026be9d8c0 1 < completed write operation key=BBYDPSXZKHZP tag=2E4CCXJ72PFA type=write size=743069 2024-09-12T17:05:05.928 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.923+0000 7f026be9d8c0 1 > prepared operation key=SGT8IC1GJ3IG tag=QSX2O6XVYB1M type=del size=816818 2024-09-12T17:05:05.932 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.927+0000 7f026be9d8c0 1 < completed delete operation key=GPUFWJ3AWEMX tag=B229G9YEJP5E type=del 2024-09-12T17:05:05.935 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.931+0000 7f026be9d8c0 1 > prepared operation key=GPUFWJ3AWEMX tag=GZALUAJO06VU type=del size=2425217 2024-09-12T17:05:05.946 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.943+0000 7f026be9d8c0 1 < suggested update operation key=U8W1SAVSLTBF tag=UUI6XDSF9J58 type=write size=282512 2024-09-12T17:05:05.949 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.943+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=APSC42H5SGKJ type=del size=2331893 2024-09-12T17:05:05.953 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.947+0000 7f026be9d8c0 1 < completed part key=_multipart_6VO85REZG2NW.2~29NSFLRYP1AW.0 size=1048576 2024-09-12T17:05:05.956 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.951+0000 7f026be9d8c0 1 < completed part key=_multipart_6VO85REZG2NW.2~29NSFLRYP1AW.1 size=348012 2024-09-12T17:05:05.962 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.959+0000 7f026be9d8c0 1 < completed multipart upload key=6VO85REZG2NW upload=29NSFLRYP1AW tag=7PR32QER7DO5 type=write size=2445164 2024-09-12T17:05:05.965 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.959+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=OQGHBBWFRR0F type=del size=3560285 2024-09-12T17:05:05.969 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.963+0000 7f026be9d8c0 1 < completed delete operation key=21ZD52VBZIO4 tag=HWK265I4HVSP type=del 2024-09-12T17:05:05.973 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.967+0000 7f026be9d8c0 1 > prepared operation key=UU88OS653L8D tag=HQSUG2E8L41L type=del size=181442 2024-09-12T17:05:05.977 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.971+0000 7f026be9d8c0 1 < completed part key=_multipart_BW1T21LBUE2D.2~SA0N7NID0N5B.0 size=1048576 2024-09-12T17:05:05.979 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.975+0000 7f026be9d8c0 1 < completed part key=_multipart_BW1T21LBUE2D.2~SA0N7NID0N5B.1 size=1048576 2024-09-12T17:05:05.982 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.979+0000 7f026be9d8c0 1 < completed part key=_multipart_BW1T21LBUE2D.2~SA0N7NID0N5B.2 size=1045805 2024-09-12T17:05:05.988 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.983+0000 7f026be9d8c0 1 < completed multipart upload key=BW1T21LBUE2D upload=SA0N7NID0N5B tag=I6A2EYNR31G6 type=write size=4191533 2024-09-12T17:05:05.995 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.991+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~Q2G6JHW19JL6.0 size=1048576 2024-09-12T17:05:05.997 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.991+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~Q2G6JHW19JL6.1 size=613147 2024-09-12T17:05:05.998 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.991+0000 7f026be9d8c0 1 > prepared multipart upload key=XLKR6P8RNRVO upload=Q2G6JHW19JL6 tag=NGHGH7B41LYA type=write size=2710299 2024-09-12T17:05:06.004 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:05.999+0000 7f026be9d8c0 1 < suggested remove operation key=SGT8IC1GJ3IG tag=UTR93MXPO18P type=del 2024-09-12T17:05:06.007 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.003+0000 7f026be9d8c0 1 > prepared operation key=XLKR6P8RNRVO tag=4N6P2VVQU8NW type=del size=1941062 2024-09-12T17:05:06.011 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.007+0000 7f026be9d8c0 1 < completed part key=_multipart_Z183NH6R676V.2~EX74X1YXD5B3.0 size=1024658 2024-09-12T17:05:06.016 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.011+0000 7f026be9d8c0 1 < completed multipart upload key=Z183NH6R676V upload=EX74X1YXD5B3 tag=M17FL03IR1U4 type=write size=2073234 2024-09-12T17:05:06.020 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.015+0000 7f026be9d8c0 1 > prepared operation key=XNBE2II106VZ tag=WPIS3NMW22JG type=del size=2292562 2024-09-12T17:05:06.023 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.019+0000 7f026be9d8c0 1 < completed part key=_multipart_3JADN360QEO3.2~1RT074DLSLBE.0 size=1048576 2024-09-12T17:05:06.026 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.023+0000 7f026be9d8c0 1 < completed part key=_multipart_3JADN360QEO3.2~1RT074DLSLBE.1 size=1016117 2024-09-12T17:05:06.031 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.027+0000 7f026be9d8c0 1 < completed multipart upload key=3JADN360QEO3 upload=1RT074DLSLBE tag=3Z5KV1K1EQO9 type=write size=3113269 2024-09-12T17:05:06.034 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.031+0000 7f026be9d8c0 1 > prepared operation key=32XUMOWT8HO2 tag=27ZOZF7GCAQE type=del size=2705726 2024-09-12T17:05:06.038 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.031+0000 7f026be9d8c0 -1 < failed to complete operation key=U8W1SAVSLTBF tag=KLJJEXA61S3U type=del size=2793667: (22) Invalid argument 2024-09-12T17:05:06.041 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.035+0000 7f026be9d8c0 1 > prepared operation key=BW1T21LBUE2D tag=EIICOV83V0Z9 type=del size=3720998 2024-09-12T17:05:06.044 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.039+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~2UHM9NZXLFA2.0 size=1048576 2024-09-12T17:05:06.047 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.043+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~2UHM9NZXLFA2.1 size=413568 2024-09-12T17:05:06.052 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.047+0000 7f026be9d8c0 1 < completed multipart upload key=UU88OS653L8D upload=2UHM9NZXLFA2 tag=63M6NV3A1RK5 type=write size=2510720 2024-09-12T17:05:06.057 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.051+0000 7f026be9d8c0 1 > prepared operation key=BBYDPSXZKHZP tag=ZR7SQ227JQ56 type=del size=3460886 2024-09-12T17:05:06.059 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.055+0000 7f026be9d8c0 1 < canceled operation key=6VO85REZG2NW tag=MVKQHLX7PQXN type=write size=630816 2024-09-12T17:05:06.062 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.059+0000 7f026be9d8c0 1 > prepared operation key=BW1T21LBUE2D tag=X34DLTL4AONK type=del size=3656374 2024-09-12T17:05:06.066 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.059+0000 7f026be9d8c0 1 < completed delete operation key=8AFDAVJLMRD2 tag=WRAGEFJ1IWJG type=del 2024-09-12T17:05:06.071 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.067+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~JKL574LX2QJV.0 size=1048576 2024-09-12T17:05:06.073 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.067+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~JKL574LX2QJV.1 size=1048576 2024-09-12T17:05:06.076 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.071+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~JKL574LX2QJV.2 size=927359 2024-09-12T17:05:06.076 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.071+0000 7f026be9d8c0 1 > prepared multipart upload key=2BQJ30RQQ25L upload=JKL574LX2QJV tag=C5DPNQHGATJ2 type=write size=4073087 2024-09-12T17:05:06.079 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.075+0000 7f026be9d8c0 1 < completed part key=_multipart_PQSQ39X3O64P.2~CF32WDS21USZ.0 size=1048576 2024-09-12T17:05:06.081 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.075+0000 7f026be9d8c0 1 < completed part key=_multipart_PQSQ39X3O64P.2~CF32WDS21USZ.1 size=63774 2024-09-12T17:05:06.086 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.083+0000 7f026be9d8c0 1 < completed multipart upload key=PQSQ39X3O64P upload=CF32WDS21USZ tag=GFVO2ZALB08G type=write size=2160926 2024-09-12T17:05:06.089 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.083+0000 7f026be9d8c0 1 > prepared operation key=J8MU1A0CWSAQ tag=DBKFJUBYD6SH type=del size=2961878 2024-09-12T17:05:06.092 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.087+0000 7f026be9d8c0 1 < completed delete operation key=2BQJ30RQQ25L tag=PG71M94KCIF1 type=del 2024-09-12T17:05:06.098 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.095+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~8CYWLZQF2BKT.0 size=1048576 2024-09-12T17:05:06.100 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.095+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~8CYWLZQF2BKT.1 size=1048576 2024-09-12T17:05:06.103 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.099+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~8CYWLZQF2BKT.2 size=981282 2024-09-12T17:05:06.103 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.099+0000 7f026be9d8c0 1 > prepared multipart upload key=4G3BKGNT3YZC upload=8CYWLZQF2BKT tag=NLXZKP8K99VG type=write size=4127010 2024-09-12T17:05:06.103 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.099+0000 7f026be9d8c0 1 < canceled part key=_multipart_JJMEQ2O00SA2.2~VU562C36S9CE.0 size=1048576 2024-09-12T17:05:06.106 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.103+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~VU562C36S9CE.1 size=350738 2024-09-12T17:05:06.111 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.107+0000 7f026be9d8c0 1 < canceled multipart upload key=JJMEQ2O00SA2 upload=VU562C36S9CE tag=DIANB0ZVHND2 type=write size=2447890 2024-09-12T17:05:06.114 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.111+0000 7f026be9d8c0 1 > prepared operation key=J8MU1A0CWSAQ tag=9O3AC16LDY2M type=del size=1635285 2024-09-12T17:05:06.117 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.111+0000 7f026be9d8c0 -1 < failed to complete operation key=SGT8IC1GJ3IG tag=QSX2O6XVYB1M type=del size=816818: (22) Invalid argument 2024-09-12T17:05:06.120 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.115+0000 7f026be9d8c0 1 > prepared operation key=Y27CDEOCM7DH tag=2ED1MQ0DQARY type=del size=2193598 2024-09-12T17:05:06.124 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.119+0000 7f026be9d8c0 1 < completed delete operation key=GPUFWJ3AWEMX tag=GZALUAJO06VU type=del 2024-09-12T17:05:06.127 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.123+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=8YUKEOXKX8Q4 type=del size=3739740 2024-09-12T17:05:06.135 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.131+0000 7f026be9d8c0 1 < suggested remove operation key=3JADN360QEO3 tag=APSC42H5SGKJ type=del 2024-09-12T17:05:06.138 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.135+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=0E49MF26ND1V type=write size=226904 2024-09-12T17:05:06.141 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.135+0000 7f026be9d8c0 -1 < failed to complete operation key=3JADN360QEO3 tag=OQGHBBWFRR0F type=del size=3560285: (22) Invalid argument 2024-09-12T17:05:06.144 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.139+0000 7f026be9d8c0 1 > prepared operation key=4U1W97V0OX11 tag=FR3OFXJLE6H8 type=del size=152162 2024-09-12T17:05:06.147 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.143+0000 7f026be9d8c0 1 < completed delete operation key=UU88OS653L8D tag=HQSUG2E8L41L type=del 2024-09-12T17:05:06.152 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.147+0000 7f026be9d8c0 1 > prepared part key=_multipart_PQSQ39X3O64P.2~20ZWVW05OIY8.0 size=1048576 2024-09-12T17:05:06.155 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.151+0000 7f026be9d8c0 1 > prepared part key=_multipart_PQSQ39X3O64P.2~20ZWVW05OIY8.1 size=615827 2024-09-12T17:05:06.155 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.151+0000 7f026be9d8c0 1 > prepared multipart upload key=PQSQ39X3O64P upload=20ZWVW05OIY8 tag=9Y4BZ7GSH61Z type=write size=2712979 2024-09-12T17:05:06.158 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.155+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~Q2G6JHW19JL6.0 size=1048576 2024-09-12T17:05:06.158 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.155+0000 7f026be9d8c0 1 < canceled part key=_multipart_XLKR6P8RNRVO.2~Q2G6JHW19JL6.1 size=613147 2024-09-12T17:05:06.163 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.159+0000 7f026be9d8c0 1 < canceled multipart upload key=XLKR6P8RNRVO upload=Q2G6JHW19JL6 tag=NGHGH7B41LYA type=write size=2710299 2024-09-12T17:05:06.166 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.163+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=AB9IDDLJLJBW type=del size=2373992 2024-09-12T17:05:06.171 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.167+0000 7f026be9d8c0 1 < suggested remove operation key=XLKR6P8RNRVO tag=4N6P2VVQU8NW type=del 2024-09-12T17:05:06.177 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.171+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~W6KM0E1L6HOH.0 size=318226 2024-09-12T17:05:06.177 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.171+0000 7f026be9d8c0 1 > prepared multipart upload key=4G3BKGNT3YZC upload=W6KM0E1L6HOH tag=GWW2O43WAOYL type=write size=1366802 2024-09-12T17:05:06.184 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.179+0000 7f026be9d8c0 1 < suggested remove operation key=XNBE2II106VZ tag=WPIS3NMW22JG type=del 2024-09-12T17:05:06.189 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.183+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~8DIZFM4SXWFN.0 size=1048576 2024-09-12T17:05:06.192 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.187+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~8DIZFM4SXWFN.1 size=1048576 2024-09-12T17:05:06.194 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.191+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~8DIZFM4SXWFN.2 size=98797 2024-09-12T17:05:06.194 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.191+0000 7f026be9d8c0 1 > prepared multipart upload key=6VO85REZG2NW upload=8DIZFM4SXWFN tag=ZV3TKR1XK1IL type=write size=3244525 2024-09-12T17:05:06.198 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.195+0000 7f026be9d8c0 1 < completed delete operation key=32XUMOWT8HO2 tag=27ZOZF7GCAQE type=del 2024-09-12T17:05:06.201 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.195+0000 7f026be9d8c0 1 > prepared operation key=BW1T21LBUE2D tag=V7JL5X7OJDXZ type=del size=646901 2024-09-12T17:05:06.208 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.203+0000 7f026be9d8c0 1 < suggested update operation key=BW1T21LBUE2D tag=EIICOV83V0Z9 type=del size=3720998 2024-09-12T17:05:06.211 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.207+0000 7f026be9d8c0 1 > prepared operation key=Z183NH6R676V tag=RGIIKD93D193 type=write size=119414 2024-09-12T17:05:06.214 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.211+0000 7f026be9d8c0 1 < completed delete operation key=BBYDPSXZKHZP tag=ZR7SQ227JQ56 type=del 2024-09-12T17:05:06.220 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.215+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~B2PZ7VV4UPH5.0 size=1048576 2024-09-12T17:05:06.223 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.219+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~B2PZ7VV4UPH5.1 size=963016 2024-09-12T17:05:06.223 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.219+0000 7f026be9d8c0 1 > prepared multipart upload key=6VO85REZG2NW upload=B2PZ7VV4UPH5 tag=HL4LYKF9RN0B type=write size=3060168 2024-09-12T17:05:06.226 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.223+0000 7f026be9d8c0 -1 < failed to complete operation key=BW1T21LBUE2D tag=X34DLTL4AONK type=del size=3656374: (22) Invalid argument 2024-09-12T17:05:06.229 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.223+0000 7f026be9d8c0 1 > prepared operation key=L194KQIPFLE1 tag=D2KUHFSSYOWU type=del size=2580334 2024-09-12T17:05:06.233 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.227+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~JKL574LX2QJV.0 size=1048576 2024-09-12T17:05:06.235 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.231+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~JKL574LX2QJV.1 size=1048576 2024-09-12T17:05:06.235 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.231+0000 7f026be9d8c0 1 < canceled part key=_multipart_2BQJ30RQQ25L.2~JKL574LX2QJV.2 size=927359 2024-09-12T17:05:06.240 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.235+0000 7f026be9d8c0 1 < canceled multipart upload key=2BQJ30RQQ25L upload=JKL574LX2QJV tag=C5DPNQHGATJ2 type=write size=4073087 2024-09-12T17:05:06.247 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.243+0000 7f026be9d8c0 1 > prepared operation key=QVQ4TI319DH5 tag=M5ST0TE74YTP type=del size=357068 2024-09-12T17:05:06.250 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.247+0000 7f026be9d8c0 1 < canceled operation key=J8MU1A0CWSAQ tag=DBKFJUBYD6SH type=del size=2961878 2024-09-12T17:05:06.253 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.247+0000 7f026be9d8c0 1 > prepared operation key=XLKR6P8RNRVO tag=ZDHAOSQJO452 type=del size=2691804 2024-09-12T17:05:06.256 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.251+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~8CYWLZQF2BKT.0 size=1048576 2024-09-12T17:05:06.261 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.255+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~8CYWLZQF2BKT.1 size=1048576 2024-09-12T17:05:06.261 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.255+0000 7f026be9d8c0 1 < canceled part key=_multipart_4G3BKGNT3YZC.2~8CYWLZQF2BKT.2 size=981282 2024-09-12T17:05:06.264 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.259+0000 7f026be9d8c0 1 < canceled multipart upload key=4G3BKGNT3YZC upload=8CYWLZQF2BKT tag=NLXZKP8K99VG type=write size=4127010 2024-09-12T17:05:06.267 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.263+0000 7f026be9d8c0 1 > prepared operation key=L194KQIPFLE1 tag=AIKFUY3AC0N6 type=del size=3893296 2024-09-12T17:05:06.271 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.267+0000 7f026be9d8c0 1 < completed delete operation key=J8MU1A0CWSAQ tag=9O3AC16LDY2M type=del 2024-09-12T17:05:06.276 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.271+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~TJP0D9XFPHWW.0 size=1048576 2024-09-12T17:05:06.279 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.275+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~TJP0D9XFPHWW.1 size=1048576 2024-09-12T17:05:06.282 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.275+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~TJP0D9XFPHWW.2 size=714485 2024-09-12T17:05:06.282 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.275+0000 7f026be9d8c0 1 > prepared multipart upload key=XLKR6P8RNRVO upload=TJP0D9XFPHWW tag=JA7M3NT9WGYP type=write size=3860213 2024-09-12T17:05:06.285 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.279+0000 7f026be9d8c0 1 < canceled operation key=Y27CDEOCM7DH tag=2ED1MQ0DQARY type=del size=2193598 2024-09-12T17:05:06.292 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.287+0000 7f026be9d8c0 1 > prepared part key=_multipart_3JADN360QEO3.2~J63NDPH5BBN8.0 size=1048576 2024-09-12T17:05:06.295 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.291+0000 7f026be9d8c0 1 > prepared part key=_multipart_3JADN360QEO3.2~J63NDPH5BBN8.1 size=1048576 2024-09-12T17:05:06.298 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.295+0000 7f026be9d8c0 1 > prepared part key=_multipart_3JADN360QEO3.2~J63NDPH5BBN8.2 size=590148 2024-09-12T17:05:06.298 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.295+0000 7f026be9d8c0 1 > prepared multipart upload key=3JADN360QEO3 upload=J63NDPH5BBN8 tag=MY19JINI88C8 type=write size=3735876 2024-09-12T17:05:06.302 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.299+0000 7f026be9d8c0 1 < completed delete operation key=21ZD52VBZIO4 tag=8YUKEOXKX8Q4 type=del 2024-09-12T17:05:06.306 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.303+0000 7f026be9d8c0 1 > prepared operation key=XNBE2II106VZ tag=R0IWCYJQ7ZQ3 type=del size=3981492 2024-09-12T17:05:06.310 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.307+0000 7f026be9d8c0 1 < canceled operation key=3JADN360QEO3 tag=0E49MF26ND1V type=write size=226904 2024-09-12T17:05:06.313 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.307+0000 7f026be9d8c0 1 > prepared operation key=4U1W97V0OX11 tag=EI2CO6YQ01WD type=write size=624682 2024-09-12T17:05:06.320 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.315+0000 7f026be9d8c0 1 < suggested remove operation key=4U1W97V0OX11 tag=FR3OFXJLE6H8 type=del 2024-09-12T17:05:06.327 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.323+0000 7f026be9d8c0 1 > prepared part key=_multipart_SO3HLQZA8B6B.2~5K239UP9251J.0 size=1048576 2024-09-12T17:05:06.329 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.323+0000 7f026be9d8c0 1 > prepared part key=_multipart_SO3HLQZA8B6B.2~5K239UP9251J.1 size=1042477 2024-09-12T17:05:06.329 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.323+0000 7f026be9d8c0 1 > prepared multipart upload key=SO3HLQZA8B6B upload=5K239UP9251J tag=XEA5LT8Q0792 type=write size=3139629 2024-09-12T17:05:06.333 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.327+0000 7f026be9d8c0 1 < completed part key=_multipart_PQSQ39X3O64P.2~20ZWVW05OIY8.0 size=1048576 2024-09-12T17:05:06.336 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.331+0000 7f026be9d8c0 1 < completed part key=_multipart_PQSQ39X3O64P.2~20ZWVW05OIY8.1 size=615827 2024-09-12T17:05:06.343 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.339+0000 7f026be9d8c0 1 < completed multipart upload key=PQSQ39X3O64P upload=20ZWVW05OIY8 tag=9Y4BZ7GSH61Z type=write size=2712979 2024-09-12T17:05:06.349 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.343+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~6Z0W1ABRE438.0 size=1048576 2024-09-12T17:05:06.352 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.347+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~6Z0W1ABRE438.1 size=886406 2024-09-12T17:05:06.352 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.347+0000 7f026be9d8c0 1 > prepared multipart upload key=GPUFWJ3AWEMX upload=6Z0W1ABRE438 tag=RDJ5M7WS6D9H type=write size=2983558 2024-09-12T17:05:06.357 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.351+0000 7f026be9d8c0 1 < canceled operation key=U8W1SAVSLTBF tag=AB9IDDLJLJBW type=del size=2373992 2024-09-12T17:05:06.364 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.359+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~EQNT7ZTGP089.0 size=732718 2024-09-12T17:05:06.364 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.359+0000 7f026be9d8c0 1 > prepared multipart upload key=2BQJ30RQQ25L upload=EQNT7ZTGP089 tag=KAW0FYOWNH0P type=write size=1781294 2024-09-12T17:05:06.367 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.363+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~W6KM0E1L6HOH.0 size=318226 2024-09-12T17:05:06.372 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.367+0000 7f026be9d8c0 1 < completed multipart upload key=4G3BKGNT3YZC upload=W6KM0E1L6HOH tag=GWW2O43WAOYL type=write size=1366802 2024-09-12T17:05:06.378 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.375+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~MMSDBF38H0WP.0 size=634103 2024-09-12T17:05:06.378 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.375+0000 7f026be9d8c0 1 > prepared multipart upload key=QVQ4TI319DH5 upload=MMSDBF38H0WP tag=1T4X3B4A065Y type=write size=1682679 2024-09-12T17:05:06.382 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.379+0000 7f026be9d8c0 1 < completed part key=_multipart_6VO85REZG2NW.2~8DIZFM4SXWFN.0 size=1048576 2024-09-12T17:05:06.385 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.379+0000 7f026be9d8c0 1 < completed part key=_multipart_6VO85REZG2NW.2~8DIZFM4SXWFN.1 size=1048576 2024-09-12T17:05:06.388 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.383+0000 7f026be9d8c0 1 < completed part key=_multipart_6VO85REZG2NW.2~8DIZFM4SXWFN.2 size=98797 2024-09-12T17:05:06.394 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.391+0000 7f026be9d8c0 1 < completed multipart upload key=6VO85REZG2NW upload=8DIZFM4SXWFN tag=ZV3TKR1XK1IL type=write size=3244525 2024-09-12T17:05:06.398 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.391+0000 7f026be9d8c0 1 > prepared operation key=J8MU1A0CWSAQ tag=9QA7JMACIXZO type=write size=602253 2024-09-12T17:05:06.401 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.395+0000 7f026be9d8c0 -1 < failed to complete operation key=BW1T21LBUE2D tag=V7JL5X7OJDXZ type=del size=646901: (22) Invalid argument 2024-09-12T17:05:06.408 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.403+0000 7f026be9d8c0 1 > prepared part key=_multipart_L194KQIPFLE1.2~N4WD3IZVL7EU.0 size=1048576 2024-09-12T17:05:06.411 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.407+0000 7f026be9d8c0 1 > prepared part key=_multipart_L194KQIPFLE1.2~N4WD3IZVL7EU.1 size=168097 2024-09-12T17:05:06.411 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.407+0000 7f026be9d8c0 1 > prepared multipart upload key=L194KQIPFLE1 upload=N4WD3IZVL7EU tag=4A5JJTBB82RI type=write size=2265249 2024-09-12T17:05:06.415 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.411+0000 7f026be9d8c0 1 < completed write operation key=Z183NH6R676V tag=RGIIKD93D193 type=write size=119414 2024-09-12T17:05:06.422 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.415+0000 7f026be9d8c0 1 > prepared part key=_multipart_LHKLWIUAT08F.2~P7P72P5Z4CRF.0 size=1048576 2024-09-12T17:05:06.425 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.419+0000 7f026be9d8c0 1 > prepared part key=_multipart_LHKLWIUAT08F.2~P7P72P5Z4CRF.1 size=966013 2024-09-12T17:05:06.425 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.419+0000 7f026be9d8c0 1 > prepared multipart upload key=LHKLWIUAT08F upload=P7P72P5Z4CRF tag=5MX7WS92QJ3I type=write size=3063165 2024-09-12T17:05:06.428 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.423+0000 7f026be9d8c0 1 < completed part key=_multipart_6VO85REZG2NW.2~B2PZ7VV4UPH5.0 size=1048576 2024-09-12T17:05:06.431 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.427+0000 7f026be9d8c0 1 < completed part key=_multipart_6VO85REZG2NW.2~B2PZ7VV4UPH5.1 size=963016 2024-09-12T17:05:06.437 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.431+0000 7f026be9d8c0 1 < completed multipart upload key=6VO85REZG2NW upload=B2PZ7VV4UPH5 tag=HL4LYKF9RN0B type=write size=3060168 2024-09-12T17:05:06.443 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.439+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~CIDCRIG927NY.0 size=694077 2024-09-12T17:05:06.443 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.439+0000 7f026be9d8c0 1 > prepared multipart upload key=SL2446KSB531 upload=CIDCRIG927NY tag=TRE5BLDLNQ8X type=write size=1742653 2024-09-12T17:05:06.446 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.443+0000 7f026be9d8c0 1 < completed delete operation key=L194KQIPFLE1 tag=D2KUHFSSYOWU type=del 2024-09-12T17:05:06.452 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.447+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~HDOA5DYUAHA0.0 size=637093 2024-09-12T17:05:06.452 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.447+0000 7f026be9d8c0 1 > prepared multipart upload key=4G3BKGNT3YZC upload=HDOA5DYUAHA0 tag=9YM2068KEQBR type=write size=1685669 2024-09-12T17:05:06.455 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.451+0000 7f026be9d8c0 1 < completed delete operation key=QVQ4TI319DH5 tag=M5ST0TE74YTP type=del 2024-09-12T17:05:06.459 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.455+0000 7f026be9d8c0 1 > prepared operation key=4G3BKGNT3YZC tag=0TEV9PAHP531 type=del size=852954 2024-09-12T17:05:06.466 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.459+0000 7f026be9d8c0 1 < suggested update operation key=XLKR6P8RNRVO tag=ZDHAOSQJO452 type=del size=2691804 2024-09-12T17:05:06.472 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.467+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~F0Q71A21LEOB.0 size=1048576 2024-09-12T17:05:06.474 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.471+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~F0Q71A21LEOB.1 size=1048576 2024-09-12T17:05:06.477 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.471+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~F0Q71A21LEOB.2 size=206766 2024-09-12T17:05:06.477 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.471+0000 7f026be9d8c0 1 > prepared multipart upload key=2BQJ30RQQ25L upload=F0Q71A21LEOB tag=UMSED1WO2E7H type=write size=3352494 2024-09-12T17:05:06.480 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.475+0000 7f026be9d8c0 1 < completed delete operation key=L194KQIPFLE1 tag=AIKFUY3AC0N6 type=del 2024-09-12T17:05:06.484 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.479+0000 7f026be9d8c0 1 > prepared operation key=32XUMOWT8HO2 tag=1AEQOL3XSVTJ type=del size=665052 2024-09-12T17:05:06.487 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.483+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~TJP0D9XFPHWW.0 size=1048576 2024-09-12T17:05:06.490 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.487+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~TJP0D9XFPHWW.1 size=1048576 2024-09-12T17:05:06.493 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.487+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~TJP0D9XFPHWW.2 size=714485 2024-09-12T17:05:06.499 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.495+0000 7f026be9d8c0 1 < completed multipart upload key=XLKR6P8RNRVO upload=TJP0D9XFPHWW tag=JA7M3NT9WGYP type=write size=3860213 2024-09-12T17:05:06.505 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.499+0000 7f026be9d8c0 1 > prepared part key=_multipart_MVYWUWKSYQ9Z.2~V6RZVS3U5LGK.0 size=1048576 2024-09-12T17:05:06.507 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.503+0000 7f026be9d8c0 1 > prepared part key=_multipart_MVYWUWKSYQ9Z.2~V6RZVS3U5LGK.1 size=1048576 2024-09-12T17:05:06.510 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.507+0000 7f026be9d8c0 1 > prepared part key=_multipart_MVYWUWKSYQ9Z.2~V6RZVS3U5LGK.2 size=680473 2024-09-12T17:05:06.510 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.507+0000 7f026be9d8c0 1 > prepared multipart upload key=MVYWUWKSYQ9Z upload=V6RZVS3U5LGK tag=Z5NQEIRF6OTD type=write size=3826201 2024-09-12T17:05:06.511 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.507+0000 7f026be9d8c0 1 < canceled part key=_multipart_3JADN360QEO3.2~J63NDPH5BBN8.0 size=1048576 2024-09-12T17:05:06.513 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.507+0000 7f026be9d8c0 1 < completed part key=_multipart_3JADN360QEO3.2~J63NDPH5BBN8.1 size=1048576 2024-09-12T17:05:06.516 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.511+0000 7f026be9d8c0 1 < completed part key=_multipart_3JADN360QEO3.2~J63NDPH5BBN8.2 size=590148 2024-09-12T17:05:06.522 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.519+0000 7f026be9d8c0 1 < canceled multipart upload key=3JADN360QEO3 upload=J63NDPH5BBN8 tag=MY19JINI88C8 type=write size=3735876 2024-09-12T17:05:06.526 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.523+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=KO1JWUNOA021 type=del size=1484083 2024-09-12T17:05:06.533 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.527+0000 7f026be9d8c0 1 < suggested remove operation key=XNBE2II106VZ tag=R0IWCYJQ7ZQ3 type=del 2024-09-12T17:05:06.540 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.535+0000 7f026be9d8c0 1 > prepared part key=_multipart_SO3HLQZA8B6B.2~0HBALT8J4KZ7.0 size=373346 2024-09-12T17:05:06.540 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.535+0000 7f026be9d8c0 1 > prepared multipart upload key=SO3HLQZA8B6B upload=0HBALT8J4KZ7 tag=S0694HAPBBRI type=write size=1421922 2024-09-12T17:05:06.543 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.539+0000 7f026be9d8c0 -1 < failed to complete operation key=4U1W97V0OX11 tag=EI2CO6YQ01WD type=write size=624682: (22) Invalid argument 2024-09-12T17:05:06.547 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.543+0000 7f026be9d8c0 1 > prepared operation key=2BQJ30RQQ25L tag=0O5ZJM94NYB5 type=write size=305417 2024-09-12T17:05:06.550 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.547+0000 7f026be9d8c0 1 < completed part key=_multipart_SO3HLQZA8B6B.2~5K239UP9251J.0 size=1048576 2024-09-12T17:05:06.551 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.547+0000 7f026be9d8c0 1 < canceled part key=_multipart_SO3HLQZA8B6B.2~5K239UP9251J.1 size=1042477 2024-09-12T17:05:06.556 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.551+0000 7f026be9d8c0 1 < canceled multipart upload key=SO3HLQZA8B6B upload=5K239UP9251J tag=XEA5LT8Q0792 type=write size=3139629 2024-09-12T17:05:06.560 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.555+0000 7f026be9d8c0 1 > prepared operation key=XNBE2II106VZ tag=J0TFP6MRS0IY type=write size=360849 2024-09-12T17:05:06.564 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.559+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~6Z0W1ABRE438.0 size=1048576 2024-09-12T17:05:06.572 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.567+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~6Z0W1ABRE438.1 size=886406 2024-09-12T17:05:06.578 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.575+0000 7f026be9d8c0 1 < completed multipart upload key=GPUFWJ3AWEMX upload=6Z0W1ABRE438 tag=RDJ5M7WS6D9H type=write size=2983558 2024-09-12T17:05:06.583 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.579+0000 7f026be9d8c0 1 > prepared operation key=GPUFWJ3AWEMX tag=AQCKDOXBWTF6 type=del size=523331 2024-09-12T17:05:06.587 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.583+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~EQNT7ZTGP089.0 size=732718 2024-09-12T17:05:06.593 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.587+0000 7f026be9d8c0 1 < completed multipart upload key=2BQJ30RQQ25L upload=EQNT7ZTGP089 tag=KAW0FYOWNH0P type=write size=1781294 2024-09-12T17:05:06.597 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.591+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=PM0EH4TKI1BB type=del size=2054734 2024-09-12T17:05:06.601 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.595+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~MMSDBF38H0WP.0 size=634103 2024-09-12T17:05:06.606 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.603+0000 7f026be9d8c0 1 < completed multipart upload key=QVQ4TI319DH5 upload=MMSDBF38H0WP tag=1T4X3B4A065Y type=write size=1682679 2024-09-12T17:05:06.612 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.607+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~LR2D1JNYPM5E.0 size=545588 2024-09-12T17:05:06.612 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.607+0000 7f026be9d8c0 1 > prepared multipart upload key=2BQJ30RQQ25L upload=LR2D1JNYPM5E tag=PBOD61WBXAZZ type=write size=1594164 2024-09-12T17:05:06.615 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.611+0000 7f026be9d8c0 1 < completed write operation key=J8MU1A0CWSAQ tag=9QA7JMACIXZO type=write size=602253 2024-09-12T17:05:06.622 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.619+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~DOZ1ZN9FI0V2.0 size=1048576 2024-09-12T17:05:06.625 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.619+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~DOZ1ZN9FI0V2.1 size=525201 2024-09-12T17:05:06.625 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.619+0000 7f026be9d8c0 1 > prepared multipart upload key=UU88OS653L8D upload=DOZ1ZN9FI0V2 tag=Z7VB0GCKX0EU type=write size=2622353 2024-09-12T17:05:06.628 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.623+0000 7f026be9d8c0 1 < completed part key=_multipart_L194KQIPFLE1.2~N4WD3IZVL7EU.0 size=1048576 2024-09-12T17:05:06.631 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.627+0000 7f026be9d8c0 1 < completed part key=_multipart_L194KQIPFLE1.2~N4WD3IZVL7EU.1 size=168097 2024-09-12T17:05:06.637 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.631+0000 7f026be9d8c0 1 < completed multipart upload key=L194KQIPFLE1 upload=N4WD3IZVL7EU tag=4A5JJTBB82RI type=write size=2265249 2024-09-12T17:05:06.643 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.639+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~ZJID8PP6TSYL.0 size=1048576 2024-09-12T17:05:06.646 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.643+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~ZJID8PP6TSYL.1 size=1048576 2024-09-12T17:05:06.649 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.643+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~ZJID8PP6TSYL.2 size=314696 2024-09-12T17:05:06.649 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.643+0000 7f026be9d8c0 1 > prepared multipart upload key=BW1T21LBUE2D upload=ZJID8PP6TSYL tag=5O0XOB21JNIM type=write size=3460424 2024-09-12T17:05:06.652 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.647+0000 7f026be9d8c0 1 < completed part key=_multipart_LHKLWIUAT08F.2~P7P72P5Z4CRF.0 size=1048576 2024-09-12T17:05:06.655 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.651+0000 7f026be9d8c0 1 < completed part key=_multipart_LHKLWIUAT08F.2~P7P72P5Z4CRF.1 size=966013 2024-09-12T17:05:06.661 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.655+0000 7f026be9d8c0 1 < completed multipart upload key=LHKLWIUAT08F upload=P7P72P5Z4CRF tag=5MX7WS92QJ3I type=write size=3063165 2024-09-12T17:05:06.665 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.659+0000 7f026be9d8c0 1 > prepared operation key=Z183NH6R676V tag=QG91ND2EH4U3 type=write size=739092 2024-09-12T17:05:06.669 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.663+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~CIDCRIG927NY.0 size=694077 2024-09-12T17:05:06.675 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.671+0000 7f026be9d8c0 1 < completed multipart upload key=SL2446KSB531 upload=CIDCRIG927NY tag=TRE5BLDLNQ8X type=write size=1742653 2024-09-12T17:05:06.679 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.675+0000 7f026be9d8c0 1 > prepared operation key=Y27CDEOCM7DH tag=OWIC4AX2YZXA type=del size=4064736 2024-09-12T17:05:06.683 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.679+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~HDOA5DYUAHA0.0 size=637093 2024-09-12T17:05:06.689 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.683+0000 7f026be9d8c0 1 < completed multipart upload key=4G3BKGNT3YZC upload=HDOA5DYUAHA0 tag=9YM2068KEQBR type=write size=1685669 2024-09-12T17:05:06.693 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.687+0000 7f026be9d8c0 1 > prepared operation key=Z183NH6R676V tag=YDAEN8MDRRFA type=del size=3031576 2024-09-12T17:05:06.699 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.695+0000 7f026be9d8c0 1 < suggested update operation key=4G3BKGNT3YZC tag=0TEV9PAHP531 type=del size=852954 2024-09-12T17:05:06.703 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.699+0000 7f026be9d8c0 1 > prepared operation key=T6QRDTQRHBPI tag=5Q11U1V9M6OW type=del size=590494 2024-09-12T17:05:06.706 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.703+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~F0Q71A21LEOB.0 size=1048576 2024-09-12T17:05:06.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.703+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~F0Q71A21LEOB.1 size=1048576 2024-09-12T17:05:06.712 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.707+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~F0Q71A21LEOB.2 size=206766 2024-09-12T17:05:06.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.711+0000 7f026be9d8c0 1 < completed multipart upload key=2BQJ30RQQ25L upload=F0Q71A21LEOB tag=UMSED1WO2E7H type=write size=3352494 2024-09-12T17:05:06.721 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.715+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=5QPPBXD9JFYH type=del size=4056844 2024-09-12T17:05:06.725 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.719+0000 7f026be9d8c0 1 < completed delete operation key=32XUMOWT8HO2 tag=1AEQOL3XSVTJ type=del 2024-09-12T17:05:06.728 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.723+0000 7f026be9d8c0 1 > prepared operation key=LHKLWIUAT08F tag=7VGTJ59W25YT type=del size=2224145 2024-09-12T17:05:06.731 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.727+0000 7f026be9d8c0 1 < completed part key=_multipart_MVYWUWKSYQ9Z.2~V6RZVS3U5LGK.0 size=1048576 2024-09-12T17:05:06.733 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.727+0000 7f026be9d8c0 1 < completed part key=_multipart_MVYWUWKSYQ9Z.2~V6RZVS3U5LGK.1 size=1048576 2024-09-12T17:05:06.736 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.731+0000 7f026be9d8c0 1 < completed part key=_multipart_MVYWUWKSYQ9Z.2~V6RZVS3U5LGK.2 size=680473 2024-09-12T17:05:06.740 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.735+0000 7f026be9d8c0 1 < completed multipart upload key=MVYWUWKSYQ9Z upload=V6RZVS3U5LGK tag=Z5NQEIRF6OTD type=write size=3826201 2024-09-12T17:05:06.743 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.739+0000 7f026be9d8c0 1 > prepared operation key=4G3BKGNT3YZC tag=AVOYU4KX124W type=del size=1348902 2024-09-12T17:05:06.746 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.743+0000 7f026be9d8c0 1 < completed delete operation key=U8W1SAVSLTBF tag=KO1JWUNOA021 type=del 2024-09-12T17:05:06.751 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.747+0000 7f026be9d8c0 1 > prepared part key=_multipart_SGT8IC1GJ3IG.2~26QZCG642V1Q.0 size=599695 2024-09-12T17:05:06.751 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.747+0000 7f026be9d8c0 1 > prepared multipart upload key=SGT8IC1GJ3IG upload=26QZCG642V1Q tag=0BSLHEXONQ63 type=write size=1648271 2024-09-12T17:05:06.754 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.747+0000 7f026be9d8c0 1 < completed part key=_multipart_SO3HLQZA8B6B.2~0HBALT8J4KZ7.0 size=373346 2024-09-12T17:05:06.758 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.755+0000 7f026be9d8c0 1 < completed multipart upload key=SO3HLQZA8B6B upload=0HBALT8J4KZ7 tag=S0694HAPBBRI type=write size=1421922 2024-09-12T17:05:06.761 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.755+0000 7f026be9d8c0 1 > prepared operation key=QVQ4TI319DH5 tag=PMI5NCIKDUQQ type=del size=4014296 2024-09-12T17:05:06.766 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.763+0000 7f026be9d8c0 1 < suggested remove operation key=2BQJ30RQQ25L tag=0O5ZJM94NYB5 type=write 2024-09-12T17:05:06.769 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.763+0000 7f026be9d8c0 1 > prepared operation key=Z183NH6R676V tag=PKXPW3SMKXZ4 type=write size=600153 2024-09-12T17:05:06.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.771+0000 7f026be9d8c0 1 < suggested update operation key=XNBE2II106VZ tag=J0TFP6MRS0IY type=write size=360849 2024-09-12T17:05:06.779 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.775+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~JKTZJHSMJAQU.0 size=1048576 2024-09-12T17:05:06.781 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.775+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~JKTZJHSMJAQU.1 size=236826 2024-09-12T17:05:06.781 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.775+0000 7f026be9d8c0 1 > prepared multipart upload key=SL2446KSB531 upload=JKTZJHSMJAQU tag=VG44LJW9RB4P type=write size=2333978 2024-09-12T17:05:06.786 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.783+0000 7f026be9d8c0 1 < suggested remove operation key=GPUFWJ3AWEMX tag=AQCKDOXBWTF6 type=del 2024-09-12T17:05:06.788 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.783+0000 7f026be9d8c0 1 > prepared operation key=T6QRDTQRHBPI tag=Z0X81E5JCCUR type=del size=2889539 2024-09-12T17:05:06.791 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.787+0000 7f026be9d8c0 1 < canceled operation key=U8W1SAVSLTBF tag=PM0EH4TKI1BB type=del size=2054734 2024-09-12T17:05:06.794 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.787+0000 7f026be9d8c0 1 > prepared operation key=XLKR6P8RNRVO tag=Q727JY4RO1VR type=del size=3623203 2024-09-12T17:05:06.797 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.791+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~LR2D1JNYPM5E.0 size=545588 2024-09-12T17:05:06.801 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.795+0000 7f026be9d8c0 1 < completed multipart upload key=2BQJ30RQQ25L upload=LR2D1JNYPM5E tag=PBOD61WBXAZZ type=write size=1594164 2024-09-12T17:05:06.804 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.799+0000 7f026be9d8c0 1 > prepared operation key=6VO85REZG2NW tag=283YSADLHQIE type=del size=1129545 2024-09-12T17:05:06.806 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.803+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~DOZ1ZN9FI0V2.0 size=1048576 2024-09-12T17:05:06.809 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.803+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~DOZ1ZN9FI0V2.1 size=525201 2024-09-12T17:05:06.813 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.807+0000 7f026be9d8c0 1 < completed multipart upload key=UU88OS653L8D upload=DOZ1ZN9FI0V2 tag=Z7VB0GCKX0EU type=write size=2622353 2024-09-12T17:05:06.819 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.815+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~XBSYFFHVZ9A7.0 size=671578 2024-09-12T17:05:06.819 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.815+0000 7f026be9d8c0 1 > prepared multipart upload key=2BQJ30RQQ25L upload=XBSYFFHVZ9A7 tag=8O4LBBJ6DSFA type=write size=1720154 2024-09-12T17:05:06.822 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.819+0000 7f026be9d8c0 1 < completed part key=_multipart_BW1T21LBUE2D.2~ZJID8PP6TSYL.0 size=1048576 2024-09-12T17:05:06.822 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.819+0000 7f026be9d8c0 1 < canceled part key=_multipart_BW1T21LBUE2D.2~ZJID8PP6TSYL.1 size=1048576 2024-09-12T17:05:06.825 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.819+0000 7f026be9d8c0 1 < completed part key=_multipart_BW1T21LBUE2D.2~ZJID8PP6TSYL.2 size=314696 2024-09-12T17:05:06.830 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.827+0000 7f026be9d8c0 1 < canceled multipart upload key=BW1T21LBUE2D upload=ZJID8PP6TSYL tag=5O0XOB21JNIM type=write size=3460424 2024-09-12T17:05:06.833 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.827+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=XGLD7RPEF1T5 type=del size=4081153 2024-09-12T17:05:06.836 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.831+0000 7f026be9d8c0 1 < completed write operation key=Z183NH6R676V tag=QG91ND2EH4U3 type=write size=739092 2024-09-12T17:05:06.839 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.835+0000 7f026be9d8c0 1 > prepared operation key=BBYDPSXZKHZP tag=Q0W4EWUFAAP3 type=del size=2979406 2024-09-12T17:05:06.842 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.839+0000 7f026be9d8c0 1 < completed delete operation key=Y27CDEOCM7DH tag=OWIC4AX2YZXA type=del 2024-09-12T17:05:06.845 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.839+0000 7f026be9d8c0 1 > prepared operation key=PQSQ39X3O64P tag=5GC9Q20EY5GL type=del size=2985205 2024-09-12T17:05:06.848 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.843+0000 7f026be9d8c0 1 < completed delete operation key=Z183NH6R676V tag=YDAEN8MDRRFA type=del 2024-09-12T17:05:06.851 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.847+0000 7f026be9d8c0 1 > prepared operation key=GPUFWJ3AWEMX tag=6G8OFCVRETFO type=del size=944294 2024-09-12T17:05:06.854 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.851+0000 7f026be9d8c0 1 < completed delete operation key=T6QRDTQRHBPI tag=5Q11U1V9M6OW type=del 2024-09-12T17:05:06.857 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.851+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=3SED6YSAJ3UT type=write size=1038357 2024-09-12T17:05:06.861 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.855+0000 7f026be9d8c0 1 < completed delete operation key=21ZD52VBZIO4 tag=5QPPBXD9JFYH type=del 2024-09-12T17:05:06.864 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.859+0000 7f026be9d8c0 1 > prepared operation key=T6QRDTQRHBPI tag=7VI93GDBUI3W type=del size=1799610 2024-09-12T17:05:06.873 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.867+0000 7f026be9d8c0 1 < suggested update operation key=LHKLWIUAT08F tag=7VGTJ59W25YT type=del size=2224145 2024-09-12T17:05:06.877 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.871+0000 7f026be9d8c0 1 > prepared operation key=Y27CDEOCM7DH tag=4P5ZIJXBN8X9 type=del size=610222 2024-09-12T17:05:06.879 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.875+0000 7f026be9d8c0 1 < completed delete operation key=4G3BKGNT3YZC tag=AVOYU4KX124W type=del 2024-09-12T17:05:06.882 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.879+0000 7f026be9d8c0 1 > prepared operation key=GPUFWJ3AWEMX tag=WB0GGKX211JL type=del size=3874018 2024-09-12T17:05:06.885 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.879+0000 7f026be9d8c0 1 < completed part key=_multipart_SGT8IC1GJ3IG.2~26QZCG642V1Q.0 size=599695 2024-09-12T17:05:06.890 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.887+0000 7f026be9d8c0 1 < completed multipart upload key=SGT8IC1GJ3IG upload=26QZCG642V1Q tag=0BSLHEXONQ63 type=write size=1648271 2024-09-12T17:05:06.893 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.887+0000 7f026be9d8c0 1 > prepared operation key=Z183NH6R676V tag=4DEQ1JAC8WB7 type=del size=2574022 2024-09-12T17:05:06.899 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.895+0000 7f026be9d8c0 1 < suggested remove operation key=QVQ4TI319DH5 tag=PMI5NCIKDUQQ type=del 2024-09-12T17:05:06.902 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.895+0000 7f026be9d8c0 1 > prepared operation key=SO3HLQZA8B6B tag=JJWKT0NZN2X7 type=del size=2300408 2024-09-12T17:05:06.904 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.899+0000 7f026be9d8c0 1 < completed write operation key=Z183NH6R676V tag=PKXPW3SMKXZ4 type=write size=600153 2024-09-12T17:05:06.907 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.903+0000 7f026be9d8c0 1 > prepared operation key=SO3HLQZA8B6B tag=1RI83141S99D type=del size=4014563 2024-09-12T17:05:06.910 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.907+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~JKTZJHSMJAQU.0 size=1048576 2024-09-12T17:05:06.913 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.907+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~JKTZJHSMJAQU.1 size=236826 2024-09-12T17:05:06.918 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.915+0000 7f026be9d8c0 1 < completed multipart upload key=SL2446KSB531 upload=JKTZJHSMJAQU tag=VG44LJW9RB4P type=write size=2333978 2024-09-12T17:05:06.921 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.915+0000 7f026be9d8c0 1 > prepared operation key=BBYDPSXZKHZP tag=GT560CP45COX type=write size=878053 2024-09-12T17:05:06.924 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.919+0000 7f026be9d8c0 1 < completed delete operation key=T6QRDTQRHBPI tag=Z0X81E5JCCUR type=del 2024-09-12T17:05:06.928 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.923+0000 7f026be9d8c0 1 > prepared operation key=T6QRDTQRHBPI tag=KEQZTY78HL8N type=del size=941022 2024-09-12T17:05:06.932 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.927+0000 7f026be9d8c0 1 < completed delete operation key=XLKR6P8RNRVO tag=Q727JY4RO1VR type=del 2024-09-12T17:05:06.938 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.935+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~FX6ZDL3LED8N.0 size=814211 2024-09-12T17:05:06.938 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.935+0000 7f026be9d8c0 1 > prepared multipart upload key=GPUFWJ3AWEMX upload=FX6ZDL3LED8N tag=WNER1FBPPI93 type=write size=1862787 2024-09-12T17:05:06.941 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.935+0000 7f026be9d8c0 1 < completed delete operation key=6VO85REZG2NW tag=283YSADLHQIE type=del 2024-09-12T17:05:06.945 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.939+0000 7f026be9d8c0 1 > prepared operation key=UU88OS653L8D tag=NBR3XFWTTTPA type=del size=3359500 2024-09-12T17:05:06.949 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.943+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~XBSYFFHVZ9A7.0 size=671578 2024-09-12T17:05:06.955 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.951+0000 7f026be9d8c0 1 < completed multipart upload key=2BQJ30RQQ25L upload=XBSYFFHVZ9A7 tag=8O4LBBJ6DSFA type=write size=1720154 2024-09-12T17:05:06.961 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.955+0000 7f026be9d8c0 1 > prepared part key=_multipart_21ZD52VBZIO4.2~HPHFIR3N82Z2.0 size=1048576 2024-09-12T17:05:06.964 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.959+0000 7f026be9d8c0 1 > prepared part key=_multipart_21ZD52VBZIO4.2~HPHFIR3N82Z2.1 size=1048576 2024-09-12T17:05:06.966 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.963+0000 7f026be9d8c0 1 > prepared part key=_multipart_21ZD52VBZIO4.2~HPHFIR3N82Z2.2 size=325049 2024-09-12T17:05:06.966 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.963+0000 7f026be9d8c0 1 > prepared multipart upload key=21ZD52VBZIO4 upload=HPHFIR3N82Z2 tag=PAZRSGP5BW3F type=write size=3470777 2024-09-12T17:05:06.970 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.963+0000 7f026be9d8c0 1 < completed delete operation key=U8W1SAVSLTBF tag=XGLD7RPEF1T5 type=del 2024-09-12T17:05:06.976 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.971+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~CJJLMZ716I0L.0 size=81506 2024-09-12T17:05:06.976 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.971+0000 7f026be9d8c0 1 > prepared multipart upload key=32XUMOWT8HO2 upload=CJJLMZ716I0L tag=50DNMZFJG5Q1 type=write size=1130082 2024-09-12T17:05:06.979 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.975+0000 7f026be9d8c0 1 < completed delete operation key=BBYDPSXZKHZP tag=Q0W4EWUFAAP3 type=del 2024-09-12T17:05:06.983 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.979+0000 7f026be9d8c0 1 > prepared operation key=PQSQ39X3O64P tag=RZFRA972Z8Z7 type=del size=3334364 2024-09-12T17:05:06.986 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.983+0000 7f026be9d8c0 1 < canceled operation key=PQSQ39X3O64P tag=5GC9Q20EY5GL type=del size=2985205 2024-09-12T17:05:06.991 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.987+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~EXIZ669FZHFZ.0 size=328057 2024-09-12T17:05:06.992 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.987+0000 7f026be9d8c0 1 > prepared multipart upload key=ALFGNC1YNROX upload=EXIZ669FZHFZ tag=2OLSN5EKCQIH type=write size=1376633 2024-09-12T17:05:06.995 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.991+0000 7f026be9d8c0 1 < completed delete operation key=GPUFWJ3AWEMX tag=6G8OFCVRETFO type=del 2024-09-12T17:05:06.998 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.995+0000 7f026be9d8c0 1 > prepared operation key=PQSQ39X3O64P tag=WJUNBU90AN49 type=del size=3396198 2024-09-12T17:05:07.001 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.995+0000 7f026be9d8c0 1 < completed write operation key=21ZD52VBZIO4 tag=3SED6YSAJ3UT type=write size=1038357 2024-09-12T17:05:07.005 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:06.999+0000 7f026be9d8c0 1 > prepared operation key=4U1W97V0OX11 tag=VKEP1ENW79DZ type=del size=2420245 2024-09-12T17:05:07.011 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.007+0000 7f026be9d8c0 1 < suggested remove operation key=T6QRDTQRHBPI tag=7VI93GDBUI3W type=del 2024-09-12T17:05:07.015 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.011+0000 7f026be9d8c0 1 > prepared operation key=32XUMOWT8HO2 tag=2KDO2OJJUFXU type=del size=626296 2024-09-12T17:05:07.018 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.015+0000 7f026be9d8c0 1 < completed delete operation key=Y27CDEOCM7DH tag=4P5ZIJXBN8X9 type=del 2024-09-12T17:05:07.022 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.019+0000 7f026be9d8c0 1 > prepared operation key=2BQJ30RQQ25L tag=R06F3S54N3RR type=del size=1957234 2024-09-12T17:05:07.025 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.019+0000 7f026be9d8c0 1 < completed delete operation key=GPUFWJ3AWEMX tag=WB0GGKX211JL type=del 2024-09-12T17:05:07.030 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.027+0000 7f026be9d8c0 1 > prepared operation key=PQSQ39X3O64P tag=I6C6H2GX34WU type=del size=2348922 2024-09-12T17:05:07.033 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.027+0000 7f026be9d8c0 1 < completed delete operation key=Z183NH6R676V tag=4DEQ1JAC8WB7 type=del 2024-09-12T17:05:07.037 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.031+0000 7f026be9d8c0 1 > prepared operation key=LHKLWIUAT08F tag=2MQ4P131QWED type=del size=720482 2024-09-12T17:05:07.040 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.035+0000 7f026be9d8c0 1 < completed delete operation key=SO3HLQZA8B6B tag=JJWKT0NZN2X7 type=del 2024-09-12T17:05:07.043 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.039+0000 7f026be9d8c0 1 > prepared operation key=XLKR6P8RNRVO tag=201GYD4VIF6X type=write size=238272 2024-09-12T17:05:07.047 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.043+0000 7f026be9d8c0 1 < completed delete operation key=SO3HLQZA8B6B tag=1RI83141S99D type=del 2024-09-12T17:05:07.050 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.047+0000 7f026be9d8c0 1 > prepared operation key=XLKR6P8RNRVO tag=5DSMWJ8VJLD2 type=del size=1799499 2024-09-12T17:05:07.054 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.047+0000 7f026be9d8c0 1 < completed write operation key=BBYDPSXZKHZP tag=GT560CP45COX type=write size=878053 2024-09-12T17:05:07.057 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.051+0000 7f026be9d8c0 1 > prepared operation key=T6QRDTQRHBPI tag=BNBO0N9IANQU type=del size=1325102 2024-09-12T17:05:07.060 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.055+0000 7f026be9d8c0 -1 < failed to complete operation key=T6QRDTQRHBPI tag=KEQZTY78HL8N type=del size=941022: (22) Invalid argument 2024-09-12T17:05:07.063 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.059+0000 7f026be9d8c0 1 > prepared operation key=JJMEQ2O00SA2 tag=3EMM8IDKOGL6 type=del size=531875 2024-09-12T17:05:07.066 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.063+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~FX6ZDL3LED8N.0 size=814211 2024-09-12T17:05:07.072 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.067+0000 7f026be9d8c0 1 < completed multipart upload key=GPUFWJ3AWEMX upload=FX6ZDL3LED8N tag=WNER1FBPPI93 type=write size=1862787 2024-09-12T17:05:07.080 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.075+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~98Q5HB67TK87.0 size=1048576 2024-09-12T17:05:07.081 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.075+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~98Q5HB67TK87.1 size=1048576 2024-09-12T17:05:07.084 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.079+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~98Q5HB67TK87.2 size=118358 2024-09-12T17:05:07.084 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.079+0000 7f026be9d8c0 1 > prepared multipart upload key=6VO85REZG2NW upload=98Q5HB67TK87 tag=S0ERCV0DOM9M type=write size=3264086 2024-09-12T17:05:07.086 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.083+0000 7f026be9d8c0 1 < completed delete operation key=UU88OS653L8D tag=NBR3XFWTTTPA type=del 2024-09-12T17:05:07.090 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.087+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=19ZUKRDJ59OQ type=del size=2397038 2024-09-12T17:05:07.094 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.087+0000 7f026be9d8c0 1 < completed part key=_multipart_21ZD52VBZIO4.2~HPHFIR3N82Z2.0 size=1048576 2024-09-12T17:05:07.096 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.091+0000 7f026be9d8c0 1 < completed part key=_multipart_21ZD52VBZIO4.2~HPHFIR3N82Z2.1 size=1048576 2024-09-12T17:05:07.099 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.095+0000 7f026be9d8c0 1 < completed part key=_multipart_21ZD52VBZIO4.2~HPHFIR3N82Z2.2 size=325049 2024-09-12T17:05:07.104 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.099+0000 7f026be9d8c0 1 < completed multipart upload key=21ZD52VBZIO4 upload=HPHFIR3N82Z2 tag=PAZRSGP5BW3F type=write size=3470777 2024-09-12T17:05:07.108 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.103+0000 7f026be9d8c0 1 > prepared operation key=SL2446KSB531 tag=NOUXGK6QPEEV type=del size=2792770 2024-09-12T17:05:07.109 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.103+0000 7f026be9d8c0 1 < canceled part key=_multipart_32XUMOWT8HO2.2~CJJLMZ716I0L.0 size=81506 2024-09-12T17:05:07.115 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.111+0000 7f026be9d8c0 1 < canceled multipart upload key=32XUMOWT8HO2 upload=CJJLMZ716I0L tag=50DNMZFJG5Q1 type=write size=1130082 2024-09-12T17:05:07.122 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.115+0000 7f026be9d8c0 1 > prepared part key=_multipart_U8W1SAVSLTBF.2~SSHZF21DV29C.0 size=1048576 2024-09-12T17:05:07.124 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.119+0000 7f026be9d8c0 1 > prepared part key=_multipart_U8W1SAVSLTBF.2~SSHZF21DV29C.1 size=1048576 2024-09-12T17:05:07.127 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.123+0000 7f026be9d8c0 1 > prepared part key=_multipart_U8W1SAVSLTBF.2~SSHZF21DV29C.2 size=809335 2024-09-12T17:05:07.127 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.123+0000 7f026be9d8c0 1 > prepared multipart upload key=U8W1SAVSLTBF upload=SSHZF21DV29C tag=G81NNM1QXX1Y type=write size=3955063 2024-09-12T17:05:07.130 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.127+0000 7f026be9d8c0 1 < completed delete operation key=PQSQ39X3O64P tag=RZFRA972Z8Z7 type=del 2024-09-12T17:05:07.133 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.127+0000 7f026be9d8c0 1 > prepared operation key=UU88OS653L8D tag=JOUIBMK4NXPR type=write size=577805 2024-09-12T17:05:07.136 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.131+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~EXIZ669FZHFZ.0 size=328057 2024-09-12T17:05:07.141 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.135+0000 7f026be9d8c0 1 < completed multipart upload key=ALFGNC1YNROX upload=EXIZ669FZHFZ tag=2OLSN5EKCQIH type=write size=1376633 2024-09-12T17:05:07.144 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.139+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=P6B443W758MX type=del size=752250 2024-09-12T17:05:07.148 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.143+0000 7f026be9d8c0 1 < completed delete operation key=PQSQ39X3O64P tag=WJUNBU90AN49 type=del 2024-09-12T17:05:07.151 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.147+0000 7f026be9d8c0 1 > prepared operation key=XNBE2II106VZ tag=K9XTBYNZ5KYM type=del size=738621 2024-09-12T17:05:07.156 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.151+0000 7f026be9d8c0 1 < completed delete operation key=4U1W97V0OX11 tag=VKEP1ENW79DZ type=del 2024-09-12T17:05:07.160 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.155+0000 7f026be9d8c0 1 > prepared operation key=BW1T21LBUE2D tag=PF485A5KH6EY type=del size=4117497 2024-09-12T17:05:07.164 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.159+0000 7f026be9d8c0 1 < canceled operation key=32XUMOWT8HO2 tag=2KDO2OJJUFXU type=del size=626296 2024-09-12T17:05:07.168 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.163+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=0N0VHY6KCYVJ type=write size=331247 2024-09-12T17:05:07.171 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.167+0000 7f026be9d8c0 1 < completed delete operation key=2BQJ30RQQ25L tag=R06F3S54N3RR type=del 2024-09-12T17:05:07.179 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.175+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~HH0R4K90JKGW.0 size=1048576 2024-09-12T17:05:07.183 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.179+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~HH0R4K90JKGW.1 size=1048576 2024-09-12T17:05:07.186 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.179+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~HH0R4K90JKGW.2 size=48343 2024-09-12T17:05:07.186 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.183+0000 7f026be9d8c0 1 > prepared multipart upload key=8AFDAVJLMRD2 upload=HH0R4K90JKGW tag=VJ6YZHSS6MVG type=write size=3194071 2024-09-12T17:05:07.194 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.191+0000 7f026be9d8c0 1 < completed delete operation key=PQSQ39X3O64P tag=I6C6H2GX34WU type=del 2024-09-12T17:05:07.198 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.195+0000 7f026be9d8c0 1 > prepared operation key=QVQ4TI319DH5 tag=03P4IZHUHIMW type=del size=895642 2024-09-12T17:05:07.202 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.199+0000 7f026be9d8c0 1 < completed delete operation key=LHKLWIUAT08F tag=2MQ4P131QWED type=del 2024-09-12T17:05:07.205 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.199+0000 7f026be9d8c0 1 > prepared operation key=32XUMOWT8HO2 tag=GQZ42JKQIVNC type=del size=3538818 2024-09-12T17:05:07.209 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.203+0000 7f026be9d8c0 1 < completed write operation key=XLKR6P8RNRVO tag=201GYD4VIF6X type=write size=238272 2024-09-12T17:05:07.215 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.211+0000 7f026be9d8c0 1 > prepared part key=_multipart_SO3HLQZA8B6B.2~PI6TG4Q9W98Z.0 size=1048576 2024-09-12T17:05:07.217 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.211+0000 7f026be9d8c0 1 > prepared part key=_multipart_SO3HLQZA8B6B.2~PI6TG4Q9W98Z.1 size=301499 2024-09-12T17:05:07.217 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.211+0000 7f026be9d8c0 1 > prepared multipart upload key=SO3HLQZA8B6B upload=PI6TG4Q9W98Z tag=ODUF8BFRJ2JT type=write size=2398651 2024-09-12T17:05:07.221 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.215+0000 7f026be9d8c0 1 < completed delete operation key=XLKR6P8RNRVO tag=5DSMWJ8VJLD2 type=del 2024-09-12T17:05:07.225 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.219+0000 7f026be9d8c0 1 > prepared operation key=LHKLWIUAT08F tag=I3L5H2SNVCN9 type=del size=86941 2024-09-12T17:05:07.228 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.223+0000 7f026be9d8c0 1 < completed delete operation key=T6QRDTQRHBPI tag=BNBO0N9IANQU type=del 2024-09-12T17:05:07.232 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.227+0000 7f026be9d8c0 1 > prepared operation key=LHKLWIUAT08F tag=HA5QFIJ7CAD2 type=write size=460771 2024-09-12T17:05:07.236 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.231+0000 7f026be9d8c0 1 < completed delete operation key=JJMEQ2O00SA2 tag=3EMM8IDKOGL6 type=del 2024-09-12T17:05:07.239 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.235+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=Z3PIUEUBYW17 type=del size=3362954 2024-09-12T17:05:07.243 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.239+0000 7f026be9d8c0 1 < completed part key=_multipart_6VO85REZG2NW.2~98Q5HB67TK87.0 size=1048576 2024-09-12T17:05:07.246 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.239+0000 7f026be9d8c0 1 < completed part key=_multipart_6VO85REZG2NW.2~98Q5HB67TK87.1 size=1048576 2024-09-12T17:05:07.248 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.243+0000 7f026be9d8c0 1 < completed part key=_multipart_6VO85REZG2NW.2~98Q5HB67TK87.2 size=118358 2024-09-12T17:05:07.254 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.251+0000 7f026be9d8c0 1 < completed multipart upload key=6VO85REZG2NW upload=98Q5HB67TK87 tag=S0ERCV0DOM9M type=write size=3264086 2024-09-12T17:05:07.257 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.251+0000 7f026be9d8c0 1 > prepared operation key=LHKLWIUAT08F tag=A87LPKJ3S276 type=del size=2327022 2024-09-12T17:05:07.261 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.255+0000 7f026be9d8c0 1 < completed delete operation key=RBNN03IPZ8BT tag=19ZUKRDJ59OQ type=del 2024-09-12T17:05:07.264 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.259+0000 7f026be9d8c0 1 > prepared operation key=Z9YNIEQCVNBA tag=PWVGTYTK8DC6 type=del size=301306 2024-09-12T17:05:07.268 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.263+0000 7f026be9d8c0 1 < canceled operation key=SL2446KSB531 tag=NOUXGK6QPEEV type=del size=2792770 2024-09-12T17:05:07.271 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.267+0000 7f026be9d8c0 1 > prepared operation key=4G3BKGNT3YZC tag=YMTRVRQ5402S type=del size=146502 2024-09-12T17:05:07.274 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.271+0000 7f026be9d8c0 1 < completed part key=_multipart_U8W1SAVSLTBF.2~SSHZF21DV29C.0 size=1048576 2024-09-12T17:05:07.277 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.271+0000 7f026be9d8c0 1 < completed part key=_multipart_U8W1SAVSLTBF.2~SSHZF21DV29C.1 size=1048576 2024-09-12T17:05:07.280 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.275+0000 7f026be9d8c0 1 < completed part key=_multipart_U8W1SAVSLTBF.2~SSHZF21DV29C.2 size=809335 2024-09-12T17:05:07.286 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.279+0000 7f026be9d8c0 1 < completed multipart upload key=U8W1SAVSLTBF upload=SSHZF21DV29C tag=G81NNM1QXX1Y type=write size=3955063 2024-09-12T17:05:07.292 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.287+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~PS7A99UPIN56.0 size=1048576 2024-09-12T17:05:07.295 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.291+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~PS7A99UPIN56.1 size=1048576 2024-09-12T17:05:07.298 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.295+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~PS7A99UPIN56.2 size=229643 2024-09-12T17:05:07.298 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.295+0000 7f026be9d8c0 1 > prepared multipart upload key=32XUMOWT8HO2 upload=PS7A99UPIN56 tag=JJHVN56OTJQB type=write size=3375371 2024-09-12T17:05:07.301 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.295+0000 7f026be9d8c0 1 < canceled operation key=UU88OS653L8D tag=JOUIBMK4NXPR type=write size=577805 2024-09-12T17:05:07.306 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.303+0000 7f026be9d8c0 1 > prepared part key=_multipart_SO3HLQZA8B6B.2~MWTVZEZJK216.0 size=1048576 2024-09-12T17:05:07.309 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.303+0000 7f026be9d8c0 1 > prepared part key=_multipart_SO3HLQZA8B6B.2~MWTVZEZJK216.1 size=1048576 2024-09-12T17:05:07.312 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.307+0000 7f026be9d8c0 1 > prepared part key=_multipart_SO3HLQZA8B6B.2~MWTVZEZJK216.2 size=355065 2024-09-12T17:05:07.312 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.307+0000 7f026be9d8c0 1 > prepared multipart upload key=SO3HLQZA8B6B upload=MWTVZEZJK216 tag=TNLJ3ZJVJFMR type=write size=3500793 2024-09-12T17:05:07.316 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.311+0000 7f026be9d8c0 1 < completed delete operation key=3JADN360QEO3 tag=P6B443W758MX type=del 2024-09-12T17:05:07.319 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.315+0000 7f026be9d8c0 1 > prepared operation key=4G3BKGNT3YZC tag=C7RMVYE4ONZS type=del size=3321395 2024-09-12T17:05:07.326 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.323+0000 7f026be9d8c0 1 < suggested update operation key=XNBE2II106VZ tag=K9XTBYNZ5KYM type=del size=738621 2024-09-12T17:05:07.332 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.327+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~JM3P5RESKZXV.0 size=1048576 2024-09-12T17:05:07.335 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.331+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~JM3P5RESKZXV.1 size=1048576 2024-09-12T17:05:07.337 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.331+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~JM3P5RESKZXV.2 size=802376 2024-09-12T17:05:07.337 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.331+0000 7f026be9d8c0 1 > prepared multipart upload key=XLKR6P8RNRVO upload=JM3P5RESKZXV tag=S7MDC994ZPC9 type=write size=3948104 2024-09-12T17:05:07.341 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.335+0000 7f026be9d8c0 1 < completed delete operation key=BW1T21LBUE2D tag=PF485A5KH6EY type=del 2024-09-12T17:05:07.344 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.339+0000 7f026be9d8c0 1 > prepared operation key=T6QRDTQRHBPI tag=8U5LPSGFIP10 type=del size=2677780 2024-09-12T17:05:07.351 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.347+0000 7f026be9d8c0 1 < suggested update operation key=3JADN360QEO3 tag=0N0VHY6KCYVJ type=write size=331247 2024-09-12T17:05:07.357 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.351+0000 7f026be9d8c0 1 > prepared part key=_multipart_SO3HLQZA8B6B.2~RVMUE2KH7LT0.0 size=122515 2024-09-12T17:05:07.358 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.351+0000 7f026be9d8c0 1 > prepared multipart upload key=SO3HLQZA8B6B upload=RVMUE2KH7LT0 tag=AS8VS4C5EZG7 type=write size=1171091 2024-09-12T17:05:07.361 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.355+0000 7f026be9d8c0 1 < completed part key=_multipart_8AFDAVJLMRD2.2~HH0R4K90JKGW.0 size=1048576 2024-09-12T17:05:07.364 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.359+0000 7f026be9d8c0 1 < completed part key=_multipart_8AFDAVJLMRD2.2~HH0R4K90JKGW.1 size=1048576 2024-09-12T17:05:07.367 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.363+0000 7f026be9d8c0 1 < completed part key=_multipart_8AFDAVJLMRD2.2~HH0R4K90JKGW.2 size=48343 2024-09-12T17:05:07.373 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.367+0000 7f026be9d8c0 1 < completed multipart upload key=8AFDAVJLMRD2 upload=HH0R4K90JKGW tag=VJ6YZHSS6MVG type=write size=3194071 2024-09-12T17:05:07.379 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.375+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~RW7XYQVDM0XW.0 size=1048576 2024-09-12T17:05:07.382 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.375+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~RW7XYQVDM0XW.1 size=673360 2024-09-12T17:05:07.382 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.375+0000 7f026be9d8c0 1 > prepared multipart upload key=GPUFWJ3AWEMX upload=RW7XYQVDM0XW tag=RYNL554HQZ0H type=write size=2770512 2024-09-12T17:05:07.385 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.379+0000 7f026be9d8c0 1 < canceled operation key=QVQ4TI319DH5 tag=03P4IZHUHIMW type=del size=895642 2024-09-12T17:05:07.389 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.383+0000 7f026be9d8c0 1 > prepared operation key=MVYWUWKSYQ9Z tag=TDUL2IKQS6CA type=del size=1775082 2024-09-12T17:05:07.392 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.387+0000 7f026be9d8c0 1 < canceled operation key=32XUMOWT8HO2 tag=GQZ42JKQIVNC type=del size=3538818 2024-09-12T17:05:07.398 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.395+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~93OLHHNK5CYI.0 size=1048576 2024-09-12T17:05:07.401 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.395+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~93OLHHNK5CYI.1 size=1048576 2024-09-12T17:05:07.403 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.399+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~93OLHHNK5CYI.2 size=687325 2024-09-12T17:05:07.403 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.399+0000 7f026be9d8c0 1 > prepared multipart upload key=JJMEQ2O00SA2 upload=93OLHHNK5CYI tag=U9K0RPEASTFN type=write size=3833053 2024-09-12T17:05:07.407 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.403+0000 7f026be9d8c0 1 < completed part key=_multipart_SO3HLQZA8B6B.2~PI6TG4Q9W98Z.0 size=1048576 2024-09-12T17:05:07.409 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.403+0000 7f026be9d8c0 1 < completed part key=_multipart_SO3HLQZA8B6B.2~PI6TG4Q9W98Z.1 size=301499 2024-09-12T17:05:07.415 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.411+0000 7f026be9d8c0 1 < completed multipart upload key=SO3HLQZA8B6B upload=PI6TG4Q9W98Z tag=ODUF8BFRJ2JT type=write size=2398651 2024-09-12T17:05:07.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.415+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~NDG2T0VETDQN.0 size=1048576 2024-09-12T17:05:07.424 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.419+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~NDG2T0VETDQN.1 size=1048576 2024-09-12T17:05:07.427 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.423+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~NDG2T0VETDQN.2 size=665869 2024-09-12T17:05:07.427 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.423+0000 7f026be9d8c0 1 > prepared multipart upload key=4G3BKGNT3YZC upload=NDG2T0VETDQN tag=L6HF0VVCXJ9X type=write size=3811597 2024-09-12T17:05:07.431 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.427+0000 7f026be9d8c0 1 < completed delete operation key=LHKLWIUAT08F tag=I3L5H2SNVCN9 type=del 2024-09-12T17:05:07.437 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.431+0000 7f026be9d8c0 1 > prepared part key=_multipart_E0Y3SKNUYCQS.2~3DKTFVDYN5KH.0 size=1048576 2024-09-12T17:05:07.441 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.435+0000 7f026be9d8c0 1 > prepared part key=_multipart_E0Y3SKNUYCQS.2~3DKTFVDYN5KH.1 size=1048576 2024-09-12T17:05:07.443 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.439+0000 7f026be9d8c0 1 > prepared part key=_multipart_E0Y3SKNUYCQS.2~3DKTFVDYN5KH.2 size=996768 2024-09-12T17:05:07.443 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.439+0000 7f026be9d8c0 1 > prepared multipart upload key=E0Y3SKNUYCQS upload=3DKTFVDYN5KH tag=AS3EV4HBILSS type=write size=4142496 2024-09-12T17:05:07.447 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.443+0000 7f026be9d8c0 1 < completed write operation key=LHKLWIUAT08F tag=HA5QFIJ7CAD2 type=write size=460771 2024-09-12T17:05:07.453 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.447+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~RMCNC4UNO3FS.0 size=1048576 2024-09-12T17:05:07.456 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.451+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~RMCNC4UNO3FS.1 size=594943 2024-09-12T17:05:07.456 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.451+0000 7f026be9d8c0 1 > prepared multipart upload key=4G3BKGNT3YZC upload=RMCNC4UNO3FS tag=2IPJ3CDG9HGW type=write size=2692095 2024-09-12T17:05:07.459 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.455+0000 7f026be9d8c0 -1 < failed to complete operation key=3JADN360QEO3 tag=Z3PIUEUBYW17 type=del size=3362954: (22) Invalid argument 2024-09-12T17:05:07.465 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.459+0000 7f026be9d8c0 1 > prepared part key=_multipart_BBYDPSXZKHZP.2~2EJX2VF60V1M.0 size=1048576 2024-09-12T17:05:07.468 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.463+0000 7f026be9d8c0 1 > prepared part key=_multipart_BBYDPSXZKHZP.2~2EJX2VF60V1M.1 size=1048576 2024-09-12T17:05:07.470 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.467+0000 7f026be9d8c0 1 > prepared part key=_multipart_BBYDPSXZKHZP.2~2EJX2VF60V1M.2 size=51509 2024-09-12T17:05:07.470 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.467+0000 7f026be9d8c0 1 > prepared multipart upload key=BBYDPSXZKHZP upload=2EJX2VF60V1M tag=AWSTIOBKOG8U type=write size=3197237 2024-09-12T17:05:07.474 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.471+0000 7f026be9d8c0 1 < completed delete operation key=LHKLWIUAT08F tag=A87LPKJ3S276 type=del 2024-09-12T17:05:07.480 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.475+0000 7f026be9d8c0 1 > prepared part key=_multipart_XNBE2II106VZ.2~5SUKH4JV82LS.0 size=1048576 2024-09-12T17:05:07.483 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.479+0000 7f026be9d8c0 1 > prepared part key=_multipart_XNBE2II106VZ.2~5SUKH4JV82LS.1 size=1048576 2024-09-12T17:05:07.486 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.479+0000 7f026be9d8c0 1 > prepared part key=_multipart_XNBE2II106VZ.2~5SUKH4JV82LS.2 size=190662 2024-09-12T17:05:07.486 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.479+0000 7f026be9d8c0 1 > prepared multipart upload key=XNBE2II106VZ upload=5SUKH4JV82LS tag=F10BB6Q3UQE1 type=write size=3336390 2024-09-12T17:05:07.492 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.487+0000 7f026be9d8c0 1 < suggested update operation key=Z9YNIEQCVNBA tag=PWVGTYTK8DC6 type=del size=301306 2024-09-12T17:05:07.496 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.491+0000 7f026be9d8c0 1 > prepared operation key=Z9YNIEQCVNBA tag=JUVX7C5TVMZF type=write size=961759 2024-09-12T17:05:07.500 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.495+0000 7f026be9d8c0 1 < completed delete operation key=4G3BKGNT3YZC tag=YMTRVRQ5402S type=del 2024-09-12T17:05:07.504 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.499+0000 7f026be9d8c0 1 > prepared operation key=4G3BKGNT3YZC tag=2OBMBMI0T1ZM type=del size=363908 2024-09-12T17:05:07.507 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.503+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~PS7A99UPIN56.0 size=1048576 2024-09-12T17:05:07.514 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.511+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~PS7A99UPIN56.1 size=1048576 2024-09-12T17:05:07.517 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.511+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~PS7A99UPIN56.2 size=229643 2024-09-12T17:05:07.523 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.519+0000 7f026be9d8c0 1 < completed multipart upload key=32XUMOWT8HO2 upload=PS7A99UPIN56 tag=JJHVN56OTJQB type=write size=3375371 2024-09-12T17:05:07.526 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.523+0000 7f026be9d8c0 1 > prepared operation key=Z183NH6R676V tag=3W02929MBGGH type=del size=2673449 2024-09-12T17:05:07.530 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.527+0000 7f026be9d8c0 1 < completed part key=_multipart_SO3HLQZA8B6B.2~MWTVZEZJK216.0 size=1048576 2024-09-12T17:05:07.533 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.527+0000 7f026be9d8c0 1 < completed part key=_multipart_SO3HLQZA8B6B.2~MWTVZEZJK216.1 size=1048576 2024-09-12T17:05:07.536 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.531+0000 7f026be9d8c0 1 < completed part key=_multipart_SO3HLQZA8B6B.2~MWTVZEZJK216.2 size=355065 2024-09-12T17:05:07.541 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.535+0000 7f026be9d8c0 1 < completed multipart upload key=SO3HLQZA8B6B upload=MWTVZEZJK216 tag=TNLJ3ZJVJFMR type=write size=3500793 2024-09-12T17:05:07.547 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.543+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~8RL2IF6RS287.0 size=1048576 2024-09-12T17:05:07.550 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.547+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~8RL2IF6RS287.1 size=3983 2024-09-12T17:05:07.550 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.547+0000 7f026be9d8c0 1 > prepared multipart upload key=Z9YNIEQCVNBA upload=8RL2IF6RS287 tag=FYOWVZ115OM0 type=write size=2101135 2024-09-12T17:05:07.553 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.547+0000 7f026be9d8c0 1 < canceled operation key=4G3BKGNT3YZC tag=C7RMVYE4ONZS type=del size=3321395 2024-09-12T17:05:07.556 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.551+0000 7f026be9d8c0 1 > prepared operation key=6VO85REZG2NW tag=TUAP39XPZQ32 type=del size=1024884 2024-09-12T17:05:07.560 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.555+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~JM3P5RESKZXV.0 size=1048576 2024-09-12T17:05:07.563 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.559+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~JM3P5RESKZXV.1 size=1048576 2024-09-12T17:05:07.565 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.559+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~JM3P5RESKZXV.2 size=802376 2024-09-12T17:05:07.571 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.567+0000 7f026be9d8c0 1 < completed multipart upload key=XLKR6P8RNRVO upload=JM3P5RESKZXV tag=S7MDC994ZPC9 type=write size=3948104 2024-09-12T17:05:07.578 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.571+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~HTUYEB8AMQVJ.0 size=1048576 2024-09-12T17:05:07.580 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.575+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~HTUYEB8AMQVJ.1 size=1048576 2024-09-12T17:05:07.582 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.579+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~HTUYEB8AMQVJ.2 size=146816 2024-09-12T17:05:07.583 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.579+0000 7f026be9d8c0 1 > prepared multipart upload key=2BQJ30RQQ25L upload=HTUYEB8AMQVJ tag=4FYL5P5NGLLW type=write size=3292544 2024-09-12T17:05:07.586 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.583+0000 7f026be9d8c0 1 < completed delete operation key=T6QRDTQRHBPI tag=8U5LPSGFIP10 type=del 2024-09-12T17:05:07.592 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.587+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~JER0X71F6T0Y.0 size=1048576 2024-09-12T17:05:07.594 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.591+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~JER0X71F6T0Y.1 size=1048576 2024-09-12T17:05:07.597 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.591+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~JER0X71F6T0Y.2 size=392935 2024-09-12T17:05:07.597 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.591+0000 7f026be9d8c0 1 > prepared multipart upload key=ALFGNC1YNROX upload=JER0X71F6T0Y tag=XNDH3FXC5FCG type=write size=3538663 2024-09-12T17:05:07.598 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.595+0000 7f026be9d8c0 1 < canceled part key=_multipart_SO3HLQZA8B6B.2~RVMUE2KH7LT0.0 size=122515 2024-09-12T17:05:07.603 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.599+0000 7f026be9d8c0 1 < canceled multipart upload key=SO3HLQZA8B6B upload=RVMUE2KH7LT0 tag=AS8VS4C5EZG7 type=write size=1171091 2024-09-12T17:05:07.607 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.603+0000 7f026be9d8c0 1 > prepared operation key=SO3HLQZA8B6B tag=ISM5TI57YW1A type=del size=3976011 2024-09-12T17:05:07.611 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.607+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~RW7XYQVDM0XW.0 size=1048576 2024-09-12T17:05:07.613 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.607+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~RW7XYQVDM0XW.1 size=673360 2024-09-12T17:05:07.618 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.615+0000 7f026be9d8c0 1 < completed multipart upload key=GPUFWJ3AWEMX upload=RW7XYQVDM0XW tag=RYNL554HQZ0H type=write size=2770512 2024-09-12T17:05:07.622 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.615+0000 7f026be9d8c0 1 > prepared operation key=2BQJ30RQQ25L tag=XJ0SK0QOAC59 type=del size=258392 2024-09-12T17:05:07.625 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.619+0000 7f026be9d8c0 1 < completed delete operation key=MVYWUWKSYQ9Z tag=TDUL2IKQS6CA type=del 2024-09-12T17:05:07.632 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.627+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~92L6T3JH4D71.0 size=1048576 2024-09-12T17:05:07.634 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.631+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~92L6T3JH4D71.1 size=208130 2024-09-12T17:05:07.634 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.631+0000 7f026be9d8c0 1 > prepared multipart upload key=32XUMOWT8HO2 upload=92L6T3JH4D71 tag=P2TP6VGPCB4Y type=write size=2305282 2024-09-12T17:05:07.637 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.631+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~93OLHHNK5CYI.0 size=1048576 2024-09-12T17:05:07.640 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.635+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~93OLHHNK5CYI.1 size=1048576 2024-09-12T17:05:07.643 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.639+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~93OLHHNK5CYI.2 size=687325 2024-09-12T17:05:07.649 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.643+0000 7f026be9d8c0 1 < completed multipart upload key=JJMEQ2O00SA2 upload=93OLHHNK5CYI tag=U9K0RPEASTFN type=write size=3833053 2024-09-12T17:05:07.655 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.651+0000 7f026be9d8c0 1 > prepared part key=_multipart_4U1W97V0OX11.2~3YJNIIM475LI.0 size=1048576 2024-09-12T17:05:07.658 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.655+0000 7f026be9d8c0 1 > prepared part key=_multipart_4U1W97V0OX11.2~3YJNIIM475LI.1 size=1016386 2024-09-12T17:05:07.658 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.655+0000 7f026be9d8c0 1 > prepared multipart upload key=4U1W97V0OX11 upload=3YJNIIM475LI tag=7ZF53KDEQ52K type=write size=3113538 2024-09-12T17:05:07.662 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.659+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~NDG2T0VETDQN.0 size=1048576 2024-09-12T17:05:07.665 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.659+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~NDG2T0VETDQN.1 size=1048576 2024-09-12T17:05:07.668 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.663+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~NDG2T0VETDQN.2 size=665869 2024-09-12T17:05:07.674 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.671+0000 7f026be9d8c0 1 < completed multipart upload key=4G3BKGNT3YZC upload=NDG2T0VETDQN tag=L6HF0VVCXJ9X type=write size=3811597 2024-09-12T17:05:07.677 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.671+0000 7f026be9d8c0 1 > prepared operation key=Y27CDEOCM7DH tag=TLPCDO110FXY type=del size=657471 2024-09-12T17:05:07.682 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.679+0000 7f026be9d8c0 1 < completed part key=_multipart_E0Y3SKNUYCQS.2~3DKTFVDYN5KH.0 size=1048576 2024-09-12T17:05:07.685 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.679+0000 7f026be9d8c0 1 < completed part key=_multipart_E0Y3SKNUYCQS.2~3DKTFVDYN5KH.1 size=1048576 2024-09-12T17:05:07.687 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.683+0000 7f026be9d8c0 1 < completed part key=_multipart_E0Y3SKNUYCQS.2~3DKTFVDYN5KH.2 size=996768 2024-09-12T17:05:07.694 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.687+0000 7f026be9d8c0 1 < completed multipart upload key=E0Y3SKNUYCQS upload=3DKTFVDYN5KH tag=AS3EV4HBILSS type=write size=4142496 2024-09-12T17:05:07.697 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.691+0000 7f026be9d8c0 1 > prepared operation key=Z9YNIEQCVNBA tag=5M11WAHAJ6YO type=write size=729387 2024-09-12T17:05:07.698 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.695+0000 7f026be9d8c0 1 < canceled part key=_multipart_4G3BKGNT3YZC.2~RMCNC4UNO3FS.0 size=1048576 2024-09-12T17:05:07.700 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.695+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~RMCNC4UNO3FS.1 size=594943 2024-09-12T17:05:07.706 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.703+0000 7f026be9d8c0 1 < canceled multipart upload key=4G3BKGNT3YZC upload=RMCNC4UNO3FS tag=2IPJ3CDG9HGW type=write size=2692095 2024-09-12T17:05:07.710 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.707+0000 7f026be9d8c0 1 > prepared operation key=XLKR6P8RNRVO tag=K60X0LKH243W type=write size=853839 2024-09-12T17:05:07.714 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.707+0000 7f026be9d8c0 1 < completed part key=_multipart_BBYDPSXZKHZP.2~2EJX2VF60V1M.0 size=1048576 2024-09-12T17:05:07.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.711+0000 7f026be9d8c0 1 < completed part key=_multipart_BBYDPSXZKHZP.2~2EJX2VF60V1M.1 size=1048576 2024-09-12T17:05:07.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.715+0000 7f026be9d8c0 1 < completed part key=_multipart_BBYDPSXZKHZP.2~2EJX2VF60V1M.2 size=51509 2024-09-12T17:05:07.726 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.723+0000 7f026be9d8c0 1 < completed multipart upload key=BBYDPSXZKHZP upload=2EJX2VF60V1M tag=AWSTIOBKOG8U type=write size=3197237 2024-09-12T17:05:07.730 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.727+0000 7f026be9d8c0 1 > prepared operation key=SGT8IC1GJ3IG tag=LB4Y2VQ7MSQY type=write size=685597 2024-09-12T17:05:07.733 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.727+0000 7f026be9d8c0 1 < completed part key=_multipart_XNBE2II106VZ.2~5SUKH4JV82LS.0 size=1048576 2024-09-12T17:05:07.737 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.731+0000 7f026be9d8c0 1 < completed part key=_multipart_XNBE2II106VZ.2~5SUKH4JV82LS.1 size=1048576 2024-09-12T17:05:07.738 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.735+0000 7f026be9d8c0 1 < completed part key=_multipart_XNBE2II106VZ.2~5SUKH4JV82LS.2 size=190662 2024-09-12T17:05:07.745 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.739+0000 7f026be9d8c0 1 < completed multipart upload key=XNBE2II106VZ upload=5SUKH4JV82LS tag=F10BB6Q3UQE1 type=write size=3336390 2024-09-12T17:05:07.749 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.743+0000 7f026be9d8c0 1 > prepared operation key=SGT8IC1GJ3IG tag=VE5G0B9EJXVL type=del size=2464814 2024-09-12T17:05:07.752 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.747+0000 7f026be9d8c0 1 < completed write operation key=Z9YNIEQCVNBA tag=JUVX7C5TVMZF type=write size=961759 2024-09-12T17:05:07.758 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.755+0000 7f026be9d8c0 1 > prepared part key=_multipart_U8W1SAVSLTBF.2~LIVHR2Y1OJFN.0 size=1048576 2024-09-12T17:05:07.761 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.755+0000 7f026be9d8c0 1 > prepared part key=_multipart_U8W1SAVSLTBF.2~LIVHR2Y1OJFN.1 size=787311 2024-09-12T17:05:07.761 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.755+0000 7f026be9d8c0 1 > prepared multipart upload key=U8W1SAVSLTBF upload=LIVHR2Y1OJFN tag=85ZBUTGXDJEL type=write size=2884463 2024-09-12T17:05:07.764 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.759+0000 7f026be9d8c0 1 < completed delete operation key=4G3BKGNT3YZC tag=2OBMBMI0T1ZM type=del 2024-09-12T17:05:07.767 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.763+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=82QAMGAPFHM1 type=del size=3889904 2024-09-12T17:05:07.770 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.767+0000 7f026be9d8c0 1 < completed delete operation key=Z183NH6R676V tag=3W02929MBGGH type=del 2024-09-12T17:05:07.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.767+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=9HIIYUU8RUV5 type=del size=2082883 2024-09-12T17:05:07.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.771+0000 7f026be9d8c0 1 < canceled part key=_multipart_Z9YNIEQCVNBA.2~8RL2IF6RS287.0 size=1048576 2024-09-12T17:05:07.777 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.771+0000 7f026be9d8c0 1 < completed part key=_multipart_Z9YNIEQCVNBA.2~8RL2IF6RS287.1 size=3983 2024-09-12T17:05:07.783 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.779+0000 7f026be9d8c0 1 < canceled multipart upload key=Z9YNIEQCVNBA upload=8RL2IF6RS287 tag=FYOWVZ115OM0 type=write size=2101135 2024-09-12T17:05:07.785 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.779+0000 7f026be9d8c0 1 > prepared operation key=SO3HLQZA8B6B tag=1I0JXA9DJ6YN type=del size=1456795 2024-09-12T17:05:07.791 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.787+0000 7f026be9d8c0 1 < suggested update operation key=6VO85REZG2NW tag=TUAP39XPZQ32 type=del size=1024884 2024-09-12T17:05:07.794 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.787+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=MUR0JQG12060 type=del size=387826 2024-09-12T17:05:07.794 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.791+0000 7f026be9d8c0 1 < canceled part key=_multipart_2BQJ30RQQ25L.2~HTUYEB8AMQVJ.0 size=1048576 2024-09-12T17:05:07.797 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.791+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~HTUYEB8AMQVJ.1 size=1048576 2024-09-12T17:05:07.799 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.795+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~HTUYEB8AMQVJ.2 size=146816 2024-09-12T17:05:07.804 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.799+0000 7f026be9d8c0 1 < canceled multipart upload key=2BQJ30RQQ25L upload=HTUYEB8AMQVJ tag=4FYL5P5NGLLW type=write size=3292544 2024-09-12T17:05:07.809 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.803+0000 7f026be9d8c0 1 > prepared part key=_multipart_U8W1SAVSLTBF.2~PUTMUOZCW3JG.0 size=1048576 2024-09-12T17:05:07.812 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.807+0000 7f026be9d8c0 1 > prepared part key=_multipart_U8W1SAVSLTBF.2~PUTMUOZCW3JG.1 size=847471 2024-09-12T17:05:07.812 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.807+0000 7f026be9d8c0 1 > prepared multipart upload key=U8W1SAVSLTBF upload=PUTMUOZCW3JG tag=06G79G8DQ6RE type=write size=2944623 2024-09-12T17:05:07.815 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.811+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~JER0X71F6T0Y.0 size=1048576 2024-09-12T17:05:07.822 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.819+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~JER0X71F6T0Y.1 size=1048576 2024-09-12T17:05:07.825 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.819+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~JER0X71F6T0Y.2 size=392935 2024-09-12T17:05:07.830 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.823+0000 7f026be9d8c0 1 < completed multipart upload key=ALFGNC1YNROX upload=JER0X71F6T0Y tag=XNDH3FXC5FCG type=write size=3538663 2024-09-12T17:05:07.833 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.827+0000 7f026be9d8c0 1 > prepared operation key=Y27CDEOCM7DH tag=WCCVAX644975 type=del size=3024544 2024-09-12T17:05:07.836 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.831+0000 7f026be9d8c0 1 < completed delete operation key=SO3HLQZA8B6B tag=ISM5TI57YW1A type=del 2024-09-12T17:05:07.839 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.835+0000 7f026be9d8c0 1 > prepared operation key=BW1T21LBUE2D tag=5NDWW29A0HZJ type=write size=111071 2024-09-12T17:05:07.846 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.843+0000 7f026be9d8c0 1 < suggested remove operation key=2BQJ30RQQ25L tag=XJ0SK0QOAC59 type=del 2024-09-12T17:05:07.849 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.843+0000 7f026be9d8c0 1 > prepared operation key=4G3BKGNT3YZC tag=BEOUAT6UPH3G type=del size=363653 2024-09-12T17:05:07.854 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.851+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~92L6T3JH4D71.0 size=1048576 2024-09-12T17:05:07.856 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.851+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~92L6T3JH4D71.1 size=208130 2024-09-12T17:05:07.861 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.855+0000 7f026be9d8c0 1 < completed multipart upload key=32XUMOWT8HO2 upload=92L6T3JH4D71 tag=P2TP6VGPCB4Y type=write size=2305282 2024-09-12T17:05:07.867 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.863+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z183NH6R676V.2~A26403I9ZAPZ.0 size=1048576 2024-09-12T17:05:07.869 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.863+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z183NH6R676V.2~A26403I9ZAPZ.1 size=970203 2024-09-12T17:05:07.870 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.863+0000 7f026be9d8c0 1 > prepared multipart upload key=Z183NH6R676V upload=A26403I9ZAPZ tag=B8WVT57V0GSW type=write size=3067355 2024-09-12T17:05:07.873 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.867+0000 7f026be9d8c0 1 < completed part key=_multipart_4U1W97V0OX11.2~3YJNIIM475LI.0 size=1048576 2024-09-12T17:05:07.876 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.871+0000 7f026be9d8c0 1 < completed part key=_multipart_4U1W97V0OX11.2~3YJNIIM475LI.1 size=1016386 2024-09-12T17:05:07.882 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.875+0000 7f026be9d8c0 1 < completed multipart upload key=4U1W97V0OX11 upload=3YJNIIM475LI tag=7ZF53KDEQ52K type=write size=3113538 2024-09-12T17:05:07.885 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.879+0000 7f026be9d8c0 1 > prepared operation key=BBYDPSXZKHZP tag=RZAVCWBUXK7X type=write size=304118 2024-09-12T17:05:07.892 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.887+0000 7f026be9d8c0 1 < suggested remove operation key=Y27CDEOCM7DH tag=TLPCDO110FXY type=del 2024-09-12T17:05:07.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.891+0000 7f026be9d8c0 1 > prepared operation key=UU88OS653L8D tag=B2QI3GSKL2LQ type=write size=554078 2024-09-12T17:05:07.899 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.895+0000 7f026be9d8c0 1 < completed write operation key=Z9YNIEQCVNBA tag=5M11WAHAJ6YO type=write size=729387 2024-09-12T17:05:07.906 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.899+0000 7f026be9d8c0 1 > prepared part key=_multipart_MVYWUWKSYQ9Z.2~6AZRRMS8XOXT.0 size=1048576 2024-09-12T17:05:07.908 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.903+0000 7f026be9d8c0 1 > prepared part key=_multipart_MVYWUWKSYQ9Z.2~6AZRRMS8XOXT.1 size=555546 2024-09-12T17:05:07.909 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.903+0000 7f026be9d8c0 1 > prepared multipart upload key=MVYWUWKSYQ9Z upload=6AZRRMS8XOXT tag=031IFKN0QTSA type=write size=2652698 2024-09-12T17:05:07.912 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.907+0000 7f026be9d8c0 1 < completed write operation key=XLKR6P8RNRVO tag=K60X0LKH243W type=write size=853839 2024-09-12T17:05:07.915 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.911+0000 7f026be9d8c0 1 > prepared operation key=SGT8IC1GJ3IG tag=T3YV0MKW0N3P type=del size=3146926 2024-09-12T17:05:07.919 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.915+0000 7f026be9d8c0 1 < completed write operation key=SGT8IC1GJ3IG tag=LB4Y2VQ7MSQY type=write size=685597 2024-09-12T17:05:07.926 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.919+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~UQE1IK9WTSBQ.0 size=1048576 2024-09-12T17:05:07.928 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.923+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~UQE1IK9WTSBQ.1 size=828957 2024-09-12T17:05:07.928 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.923+0000 7f026be9d8c0 1 > prepared multipart upload key=JJMEQ2O00SA2 upload=UQE1IK9WTSBQ tag=I51PZ2OBWJT6 type=write size=2926109 2024-09-12T17:05:07.932 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.927+0000 7f026be9d8c0 1 < completed delete operation key=SGT8IC1GJ3IG tag=VE5G0B9EJXVL type=del 2024-09-12T17:05:07.935 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.931+0000 7f026be9d8c0 1 > prepared operation key=Z9YNIEQCVNBA tag=80OM1STNGJV0 type=del size=2085242 2024-09-12T17:05:07.939 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.935+0000 7f026be9d8c0 1 < completed part key=_multipart_U8W1SAVSLTBF.2~LIVHR2Y1OJFN.0 size=1048576 2024-09-12T17:05:07.942 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.939+0000 7f026be9d8c0 1 < completed part key=_multipart_U8W1SAVSLTBF.2~LIVHR2Y1OJFN.1 size=787311 2024-09-12T17:05:07.948 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.943+0000 7f026be9d8c0 1 < completed multipart upload key=U8W1SAVSLTBF upload=LIVHR2Y1OJFN tag=85ZBUTGXDJEL type=write size=2884463 2024-09-12T17:05:07.954 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.951+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~LZDS755PCW61.0 size=1048576 2024-09-12T17:05:07.956 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.951+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~LZDS755PCW61.1 size=779954 2024-09-12T17:05:07.957 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.951+0000 7f026be9d8c0 1 > prepared multipart upload key=GPUFWJ3AWEMX upload=LZDS755PCW61 tag=WXJ1BUCO6S87 type=write size=2877106 2024-09-12T17:05:07.960 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.955+0000 7f026be9d8c0 1 < completed delete operation key=RBNN03IPZ8BT tag=82QAMGAPFHM1 type=del 2024-09-12T17:05:07.966 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.963+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~O2RH4J35422C.0 size=1048576 2024-09-12T17:05:07.970 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.963+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~O2RH4J35422C.1 size=1048576 2024-09-12T17:05:07.972 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.967+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~O2RH4J35422C.2 size=1006389 2024-09-12T17:05:07.973 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.967+0000 7f026be9d8c0 1 > prepared multipart upload key=2BQJ30RQQ25L upload=O2RH4J35422C tag=DP61T0ONDNUL type=write size=4152117 2024-09-12T17:05:07.976 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.971+0000 7f026be9d8c0 1 < completed delete operation key=U8W1SAVSLTBF tag=9HIIYUU8RUV5 type=del 2024-09-12T17:05:07.980 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.975+0000 7f026be9d8c0 1 > prepared operation key=GPUFWJ3AWEMX tag=L0OCB212OEAV type=write size=936632 2024-09-12T17:05:07.984 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.979+0000 7f026be9d8c0 1 < completed delete operation key=SO3HLQZA8B6B tag=1I0JXA9DJ6YN type=del 2024-09-12T17:05:07.990 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.987+0000 7f026be9d8c0 1 > prepared part key=_multipart_4U1W97V0OX11.2~XFQ7I2XIKO2E.0 size=1048576 2024-09-12T17:05:07.993 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.987+0000 7f026be9d8c0 1 > prepared part key=_multipart_4U1W97V0OX11.2~XFQ7I2XIKO2E.1 size=1001354 2024-09-12T17:05:07.993 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.987+0000 7f026be9d8c0 1 > prepared multipart upload key=4U1W97V0OX11 upload=XFQ7I2XIKO2E tag=HFXYL4OGZ96P type=write size=3098506 2024-09-12T17:05:07.997 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.991+0000 7f026be9d8c0 1 < completed delete operation key=RBNN03IPZ8BT tag=MUR0JQG12060 type=del 2024-09-12T17:05:08.000 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.995+0000 7f026be9d8c0 1 > prepared operation key=LHKLWIUAT08F tag=RLCQZV80E4AQ type=del size=2914780 2024-09-12T17:05:08.001 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.995+0000 7f026be9d8c0 1 < canceled part key=_multipart_U8W1SAVSLTBF.2~PUTMUOZCW3JG.0 size=1048576 2024-09-12T17:05:08.005 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:07.999+0000 7f026be9d8c0 1 < completed part key=_multipart_U8W1SAVSLTBF.2~PUTMUOZCW3JG.1 size=847471 2024-09-12T17:05:08.012 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.007+0000 7f026be9d8c0 1 < canceled multipart upload key=U8W1SAVSLTBF upload=PUTMUOZCW3JG tag=06G79G8DQ6RE type=write size=2944623 2024-09-12T17:05:08.019 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.015+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~OTZSJ2PT1QFT.0 size=1048576 2024-09-12T17:05:08.023 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.019+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~OTZSJ2PT1QFT.1 size=1048576 2024-09-12T17:05:08.026 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.023+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~OTZSJ2PT1QFT.2 size=769325 2024-09-12T17:05:08.026 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.023+0000 7f026be9d8c0 1 > prepared multipart upload key=6VO85REZG2NW upload=OTZSJ2PT1QFT tag=3KXCI6DPZ9QE type=write size=3915053 2024-09-12T17:05:08.029 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.023+0000 7f026be9d8c0 -1 < failed to complete operation key=Y27CDEOCM7DH tag=WCCVAX644975 type=del size=3024544: (22) Invalid argument 2024-09-12T17:05:08.032 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.027+0000 7f026be9d8c0 1 > prepared operation key=SGT8IC1GJ3IG tag=FMHZGTUZ404J type=del size=4115508 2024-09-12T17:05:08.037 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.031+0000 7f026be9d8c0 1 < canceled operation key=BW1T21LBUE2D tag=5NDWW29A0HZJ type=write size=111071 2024-09-12T17:05:08.041 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.035+0000 7f026be9d8c0 1 > prepared operation key=XNBE2II106VZ tag=1B7O4LXGV99Q type=del size=6585 2024-09-12T17:05:08.044 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.039+0000 7f026be9d8c0 1 < completed delete operation key=4G3BKGNT3YZC tag=BEOUAT6UPH3G type=del 2024-09-12T17:05:08.050 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.047+0000 7f026be9d8c0 1 > prepared part key=_multipart_SO3HLQZA8B6B.2~VKU1ZT7FISHV.0 size=1048576 2024-09-12T17:05:08.053 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.047+0000 7f026be9d8c0 1 > prepared part key=_multipart_SO3HLQZA8B6B.2~VKU1ZT7FISHV.1 size=972933 2024-09-12T17:05:08.053 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.047+0000 7f026be9d8c0 1 > prepared multipart upload key=SO3HLQZA8B6B upload=VKU1ZT7FISHV tag=K429QE88D9SC type=write size=3070085 2024-09-12T17:05:08.057 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.051+0000 7f026be9d8c0 1 < completed part key=_multipart_Z183NH6R676V.2~A26403I9ZAPZ.0 size=1048576 2024-09-12T17:05:08.060 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.055+0000 7f026be9d8c0 1 < completed part key=_multipart_Z183NH6R676V.2~A26403I9ZAPZ.1 size=970203 2024-09-12T17:05:08.066 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.059+0000 7f026be9d8c0 1 < completed multipart upload key=Z183NH6R676V upload=A26403I9ZAPZ tag=B8WVT57V0GSW type=write size=3067355 2024-09-12T17:05:08.072 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.067+0000 7f026be9d8c0 1 > prepared part key=_multipart_LHKLWIUAT08F.2~4MQEFHDCJ7G4.0 size=1048576 2024-09-12T17:05:08.074 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.071+0000 7f026be9d8c0 1 > prepared part key=_multipart_LHKLWIUAT08F.2~4MQEFHDCJ7G4.1 size=1048576 2024-09-12T17:05:08.077 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.071+0000 7f026be9d8c0 1 > prepared part key=_multipart_LHKLWIUAT08F.2~4MQEFHDCJ7G4.2 size=560648 2024-09-12T17:05:08.077 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.071+0000 7f026be9d8c0 1 > prepared multipart upload key=LHKLWIUAT08F upload=4MQEFHDCJ7G4 tag=GSY6VO0PXKFL type=write size=3706376 2024-09-12T17:05:08.081 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.075+0000 7f026be9d8c0 1 < completed write operation key=BBYDPSXZKHZP tag=RZAVCWBUXK7X type=write size=304118 2024-09-12T17:05:08.087 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.083+0000 7f026be9d8c0 1 > prepared part key=_multipart_U8W1SAVSLTBF.2~KKAZ5GGJ1CFJ.0 size=1048576 2024-09-12T17:05:08.090 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.087+0000 7f026be9d8c0 1 > prepared part key=_multipart_U8W1SAVSLTBF.2~KKAZ5GGJ1CFJ.1 size=215644 2024-09-12T17:05:08.090 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.087+0000 7f026be9d8c0 1 > prepared multipart upload key=U8W1SAVSLTBF upload=KKAZ5GGJ1CFJ tag=H13XDKCTGQO0 type=write size=2312796 2024-09-12T17:05:08.093 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.087+0000 7f026be9d8c0 1 < completed write operation key=UU88OS653L8D tag=B2QI3GSKL2LQ type=write size=554078 2024-09-12T17:05:08.100 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.095+0000 7f026be9d8c0 1 > prepared part key=_multipart_U8W1SAVSLTBF.2~1C8VIJ8OAHBH.0 size=744812 2024-09-12T17:05:08.100 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.095+0000 7f026be9d8c0 1 > prepared multipart upload key=U8W1SAVSLTBF upload=1C8VIJ8OAHBH tag=34O2AKNWT27Q type=write size=1793388 2024-09-12T17:05:08.103 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.099+0000 7f026be9d8c0 1 < completed part key=_multipart_MVYWUWKSYQ9Z.2~6AZRRMS8XOXT.0 size=1048576 2024-09-12T17:05:08.106 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.103+0000 7f026be9d8c0 1 < completed part key=_multipart_MVYWUWKSYQ9Z.2~6AZRRMS8XOXT.1 size=555546 2024-09-12T17:05:08.113 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.107+0000 7f026be9d8c0 1 < completed multipart upload key=MVYWUWKSYQ9Z upload=6AZRRMS8XOXT tag=031IFKN0QTSA type=write size=2652698 2024-09-12T17:05:08.116 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.111+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=BLYBEYAN4DIS type=del size=2384953 2024-09-12T17:05:08.120 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.115+0000 7f026be9d8c0 1 < canceled operation key=SGT8IC1GJ3IG tag=T3YV0MKW0N3P type=del size=3146926 2024-09-12T17:05:08.123 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.119+0000 7f026be9d8c0 1 > prepared operation key=BW1T21LBUE2D tag=YS1ZDHY0X7KK type=del size=1359297 2024-09-12T17:05:08.126 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.123+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~UQE1IK9WTSBQ.0 size=1048576 2024-09-12T17:05:08.129 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.123+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~UQE1IK9WTSBQ.1 size=828957 2024-09-12T17:05:08.134 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.131+0000 7f026be9d8c0 1 < completed multipart upload key=JJMEQ2O00SA2 upload=UQE1IK9WTSBQ tag=I51PZ2OBWJT6 type=write size=2926109 2024-09-12T17:05:08.138 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.135+0000 7f026be9d8c0 1 > prepared operation key=8AFDAVJLMRD2 tag=39ONCG5U54CO type=del size=2584907 2024-09-12T17:05:08.141 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.135+0000 7f026be9d8c0 1 < completed delete operation key=Z9YNIEQCVNBA tag=80OM1STNGJV0 type=del 2024-09-12T17:05:08.149 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.143+0000 7f026be9d8c0 1 > prepared operation key=XLKR6P8RNRVO tag=USACE9CL1EHW type=del size=734532 2024-09-12T17:05:08.153 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.147+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~LZDS755PCW61.0 size=1048576 2024-09-12T17:05:08.155 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.151+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~LZDS755PCW61.1 size=779954 2024-09-12T17:05:08.161 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.155+0000 7f026be9d8c0 1 < completed multipart upload key=GPUFWJ3AWEMX upload=LZDS755PCW61 tag=WXJ1BUCO6S87 type=write size=2877106 2024-09-12T17:05:08.167 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.163+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~BLDBG5P7LQAY.0 size=1048576 2024-09-12T17:05:08.170 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.167+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~BLDBG5P7LQAY.1 size=834112 2024-09-12T17:05:08.170 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.167+0000 7f026be9d8c0 1 > prepared multipart upload key=ALFGNC1YNROX upload=BLDBG5P7LQAY tag=1X335QKNBV6S type=write size=2931264 2024-09-12T17:05:08.173 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.167+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~O2RH4J35422C.0 size=1048576 2024-09-12T17:05:08.176 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.171+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~O2RH4J35422C.1 size=1048576 2024-09-12T17:05:08.179 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.175+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~O2RH4J35422C.2 size=1006389 2024-09-12T17:05:08.185 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.179+0000 7f026be9d8c0 1 < completed multipart upload key=2BQJ30RQQ25L upload=O2RH4J35422C tag=DP61T0ONDNUL type=write size=4152117 2024-09-12T17:05:08.192 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.187+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~APEIUZ2DZ5EV.0 size=1048576 2024-09-12T17:05:08.195 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.191+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~APEIUZ2DZ5EV.1 size=915045 2024-09-12T17:05:08.195 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.191+0000 7f026be9d8c0 1 > prepared multipart upload key=BW1T21LBUE2D upload=APEIUZ2DZ5EV tag=LLVW4E971AV0 type=write size=3012197 2024-09-12T17:05:08.199 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.195+0000 7f026be9d8c0 1 < completed write operation key=GPUFWJ3AWEMX tag=L0OCB212OEAV type=write size=936632 2024-09-12T17:05:08.203 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.199+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=DWCEQPNQKWFZ type=del size=2610743 2024-09-12T17:05:08.204 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.199+0000 7f026be9d8c0 1 < canceled part key=_multipart_4U1W97V0OX11.2~XFQ7I2XIKO2E.0 size=1048576 2024-09-12T17:05:08.206 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.203+0000 7f026be9d8c0 1 < completed part key=_multipart_4U1W97V0OX11.2~XFQ7I2XIKO2E.1 size=1001354 2024-09-12T17:05:08.213 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.207+0000 7f026be9d8c0 1 < canceled multipart upload key=4U1W97V0OX11 upload=XFQ7I2XIKO2E tag=HFXYL4OGZ96P type=write size=3098506 2024-09-12T17:05:08.216 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.211+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=BIO36OWPFF1Y type=del size=1766889 2024-09-12T17:05:08.223 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.219+0000 7f026be9d8c0 1 < suggested remove operation key=LHKLWIUAT08F tag=RLCQZV80E4AQ type=del 2024-09-12T17:05:08.227 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.223+0000 7f026be9d8c0 1 > prepared operation key=4G3BKGNT3YZC tag=HM0PJ0F6GOJR type=del size=2491969 2024-09-12T17:05:08.227 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.223+0000 7f026be9d8c0 1 < canceled part key=_multipart_6VO85REZG2NW.2~OTZSJ2PT1QFT.0 size=1048576 2024-09-12T17:05:08.230 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.227+0000 7f026be9d8c0 1 < completed part key=_multipart_6VO85REZG2NW.2~OTZSJ2PT1QFT.1 size=1048576 2024-09-12T17:05:08.233 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.227+0000 7f026be9d8c0 1 < completed part key=_multipart_6VO85REZG2NW.2~OTZSJ2PT1QFT.2 size=769325 2024-09-12T17:05:08.239 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.235+0000 7f026be9d8c0 1 < canceled multipart upload key=6VO85REZG2NW upload=OTZSJ2PT1QFT tag=3KXCI6DPZ9QE type=write size=3915053 2024-09-12T17:05:08.243 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.239+0000 7f026be9d8c0 1 > prepared operation key=MVYWUWKSYQ9Z tag=XC7VOLUKITKK type=del size=1823012 2024-09-12T17:05:08.247 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.243+0000 7f026be9d8c0 1 < completed delete operation key=SGT8IC1GJ3IG tag=FMHZGTUZ404J type=del 2024-09-12T17:05:08.250 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.247+0000 7f026be9d8c0 1 > prepared operation key=LHKLWIUAT08F tag=JESJUT3S2VB5 type=del size=1155225 2024-09-12T17:05:08.254 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.251+0000 7f026be9d8c0 1 < canceled operation key=XNBE2II106VZ tag=1B7O4LXGV99Q type=del size=6585 2024-09-12T17:05:08.260 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.255+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~LHBR979O1RN0.0 size=1048576 2024-09-12T17:05:08.264 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.259+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~LHBR979O1RN0.1 size=1048576 2024-09-12T17:05:08.267 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.263+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~LHBR979O1RN0.2 size=855682 2024-09-12T17:05:08.267 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.263+0000 7f026be9d8c0 1 > prepared multipart upload key=Z9YNIEQCVNBA upload=LHBR979O1RN0 tag=TUG8QR7NOLSB type=write size=4001410 2024-09-12T17:05:08.271 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.267+0000 7f026be9d8c0 1 < completed part key=_multipart_SO3HLQZA8B6B.2~VKU1ZT7FISHV.0 size=1048576 2024-09-12T17:05:08.273 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.267+0000 7f026be9d8c0 1 < completed part key=_multipart_SO3HLQZA8B6B.2~VKU1ZT7FISHV.1 size=972933 2024-09-12T17:05:08.279 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.275+0000 7f026be9d8c0 1 < completed multipart upload key=SO3HLQZA8B6B upload=VKU1ZT7FISHV tag=K429QE88D9SC type=write size=3070085 2024-09-12T17:05:08.285 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.279+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~85IX346BKQUW.0 size=1048576 2024-09-12T17:05:08.288 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.283+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~85IX346BKQUW.1 size=557837 2024-09-12T17:05:08.288 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.283+0000 7f026be9d8c0 1 > prepared multipart upload key=J8MU1A0CWSAQ upload=85IX346BKQUW tag=0WQ2J0PHPPJD type=write size=2654989 2024-09-12T17:05:08.289 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.283+0000 7f026be9d8c0 1 < canceled part key=_multipart_LHKLWIUAT08F.2~4MQEFHDCJ7G4.0 size=1048576 2024-09-12T17:05:08.292 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.287+0000 7f026be9d8c0 1 < completed part key=_multipart_LHKLWIUAT08F.2~4MQEFHDCJ7G4.1 size=1048576 2024-09-12T17:05:08.295 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.291+0000 7f026be9d8c0 1 < completed part key=_multipart_LHKLWIUAT08F.2~4MQEFHDCJ7G4.2 size=560648 2024-09-12T17:05:08.301 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.295+0000 7f026be9d8c0 1 < canceled multipart upload key=LHKLWIUAT08F upload=4MQEFHDCJ7G4 tag=GSY6VO0PXKFL type=write size=3706376 2024-09-12T17:05:08.304 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.299+0000 7f026be9d8c0 1 > prepared operation key=6VO85REZG2NW tag=PU57TF29WSKY type=write size=39847 2024-09-12T17:05:08.308 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.303+0000 7f026be9d8c0 1 < completed part key=_multipart_U8W1SAVSLTBF.2~KKAZ5GGJ1CFJ.0 size=1048576 2024-09-12T17:05:08.311 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.307+0000 7f026be9d8c0 1 < completed part key=_multipart_U8W1SAVSLTBF.2~KKAZ5GGJ1CFJ.1 size=215644 2024-09-12T17:05:08.318 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.315+0000 7f026be9d8c0 1 < completed multipart upload key=U8W1SAVSLTBF upload=KKAZ5GGJ1CFJ tag=H13XDKCTGQO0 type=write size=2312796 2024-09-12T17:05:08.322 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.319+0000 7f026be9d8c0 1 > prepared operation key=XNBE2II106VZ tag=179LHYLJD06Y type=del size=3841344 2024-09-12T17:05:08.326 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.319+0000 7f026be9d8c0 1 < completed part key=_multipart_U8W1SAVSLTBF.2~1C8VIJ8OAHBH.0 size=744812 2024-09-12T17:05:08.332 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.327+0000 7f026be9d8c0 1 < completed multipart upload key=U8W1SAVSLTBF upload=1C8VIJ8OAHBH tag=34O2AKNWT27Q type=write size=1793388 2024-09-12T17:05:08.338 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.335+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~GDE4TEAV2VIH.0 size=533162 2024-09-12T17:05:08.338 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.335+0000 7f026be9d8c0 1 > prepared multipart upload key=2BQJ30RQQ25L upload=GDE4TEAV2VIH tag=6LSZ568MZEVY type=write size=1581738 2024-09-12T17:05:08.342 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.339+0000 7f026be9d8c0 1 < completed delete operation key=U8W1SAVSLTBF tag=BLYBEYAN4DIS type=del 2024-09-12T17:05:08.345 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.339+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=MAEYLD9GTK9F type=del size=3456007 2024-09-12T17:05:08.349 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.343+0000 7f026be9d8c0 1 < completed delete operation key=BW1T21LBUE2D tag=YS1ZDHY0X7KK type=del 2024-09-12T17:05:08.353 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.347+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=PSQF5DH76S87 type=del size=4076339 2024-09-12T17:05:08.356 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.351+0000 7f026be9d8c0 1 < completed delete operation key=8AFDAVJLMRD2 tag=39ONCG5U54CO type=del 2024-09-12T17:05:08.360 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.355+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=LW6CT523J3YG type=del size=3509123 2024-09-12T17:05:08.364 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.359+0000 7f026be9d8c0 1 < completed delete operation key=XLKR6P8RNRVO tag=USACE9CL1EHW type=del 2024-09-12T17:05:08.368 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.363+0000 7f026be9d8c0 1 > prepared operation key=T6QRDTQRHBPI tag=UOFAKA5Z3LVD type=del size=2538092 2024-09-12T17:05:08.371 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.367+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~BLDBG5P7LQAY.0 size=1048576 2024-09-12T17:05:08.375 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.371+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~BLDBG5P7LQAY.1 size=834112 2024-09-12T17:05:08.381 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.375+0000 7f026be9d8c0 1 < completed multipart upload key=ALFGNC1YNROX upload=BLDBG5P7LQAY tag=1X335QKNBV6S type=write size=2931264 2024-09-12T17:05:08.384 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.379+0000 7f026be9d8c0 1 > prepared operation key=BBYDPSXZKHZP tag=GHRDM92KHOQL type=del size=458217 2024-09-12T17:05:08.388 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.383+0000 7f026be9d8c0 1 < completed part key=_multipart_BW1T21LBUE2D.2~APEIUZ2DZ5EV.0 size=1048576 2024-09-12T17:05:08.391 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.387+0000 7f026be9d8c0 1 < completed part key=_multipart_BW1T21LBUE2D.2~APEIUZ2DZ5EV.1 size=915045 2024-09-12T17:05:08.397 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.391+0000 7f026be9d8c0 1 < completed multipart upload key=BW1T21LBUE2D upload=APEIUZ2DZ5EV tag=LLVW4E971AV0 type=write size=3012197 2024-09-12T17:05:08.403 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.399+0000 7f026be9d8c0 1 > prepared part key=_multipart_PQSQ39X3O64P.2~6B6Y61AJRAH9.0 size=1048576 2024-09-12T17:05:08.406 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.403+0000 7f026be9d8c0 1 > prepared part key=_multipart_PQSQ39X3O64P.2~6B6Y61AJRAH9.1 size=580921 2024-09-12T17:05:08.406 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.403+0000 7f026be9d8c0 1 > prepared multipart upload key=PQSQ39X3O64P upload=6B6Y61AJRAH9 tag=ZJ2ZTZ2LHAWM type=write size=2678073 2024-09-12T17:05:08.411 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.407+0000 7f026be9d8c0 1 < completed delete operation key=RBNN03IPZ8BT tag=DWCEQPNQKWFZ type=del 2024-09-12T17:05:08.415 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.411+0000 7f026be9d8c0 1 > prepared operation key=XLKR6P8RNRVO tag=HL3MRBNYV22K type=del size=3447436 2024-09-12T17:05:08.423 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.419+0000 7f026be9d8c0 1 < suggested remove operation key=RBNN03IPZ8BT tag=BIO36OWPFF1Y type=del 2024-09-12T17:05:08.426 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.423+0000 7f026be9d8c0 1 > prepared operation key=ALFGNC1YNROX tag=EPLMS6N3KOSS type=del size=3106044 2024-09-12T17:05:08.430 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.427+0000 7f026be9d8c0 1 < completed delete operation key=4G3BKGNT3YZC tag=HM0PJ0F6GOJR type=del 2024-09-12T17:05:08.433 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.427+0000 7f026be9d8c0 1 > prepared operation key=4G3BKGNT3YZC tag=VC025J8E9EYQ type=del size=452721 2024-09-12T17:05:08.437 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.431+0000 7f026be9d8c0 1 < completed delete operation key=MVYWUWKSYQ9Z tag=XC7VOLUKITKK type=del 2024-09-12T17:05:08.441 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.435+0000 7f026be9d8c0 1 > prepared operation key=SGT8IC1GJ3IG tag=NV8I1Q3Z1YKC type=del size=3512033 2024-09-12T17:05:08.445 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.439+0000 7f026be9d8c0 1 < completed delete operation key=LHKLWIUAT08F tag=JESJUT3S2VB5 type=del 2024-09-12T17:05:08.448 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.443+0000 7f026be9d8c0 1 > prepared operation key=PQSQ39X3O64P tag=GYLN6M4GBCF7 type=write size=680418 2024-09-12T17:05:08.452 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.447+0000 7f026be9d8c0 1 < completed part key=_multipart_Z9YNIEQCVNBA.2~LHBR979O1RN0.0 size=1048576 2024-09-12T17:05:08.455 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.451+0000 7f026be9d8c0 1 < completed part key=_multipart_Z9YNIEQCVNBA.2~LHBR979O1RN0.1 size=1048576 2024-09-12T17:05:08.458 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.455+0000 7f026be9d8c0 1 < completed part key=_multipart_Z9YNIEQCVNBA.2~LHBR979O1RN0.2 size=855682 2024-09-12T17:05:08.465 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.459+0000 7f026be9d8c0 1 < completed multipart upload key=Z9YNIEQCVNBA upload=LHBR979O1RN0 tag=TUG8QR7NOLSB type=write size=4001410 2024-09-12T17:05:08.468 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.463+0000 7f026be9d8c0 1 > prepared operation key=JJMEQ2O00SA2 tag=KZATZJU495E5 type=del size=1300956 2024-09-12T17:05:08.471 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.467+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~85IX346BKQUW.0 size=1048576 2024-09-12T17:05:08.475 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.471+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~85IX346BKQUW.1 size=557837 2024-09-12T17:05:08.480 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.475+0000 7f026be9d8c0 1 < completed multipart upload key=J8MU1A0CWSAQ upload=85IX346BKQUW tag=0WQ2J0PHPPJD type=write size=2654989 2024-09-12T17:05:08.489 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.483+0000 7f026be9d8c0 1 > prepared operation key=32XUMOWT8HO2 tag=702HT6BBW373 type=write size=684691 2024-09-12T17:05:08.496 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.491+0000 7f026be9d8c0 1 < suggested remove operation key=6VO85REZG2NW tag=PU57TF29WSKY type=write 2024-09-12T17:05:08.500 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.495+0000 7f026be9d8c0 1 > prepared operation key=LHKLWIUAT08F tag=RK60SLQ5FE5U type=write size=1023707 2024-09-12T17:05:08.503 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.499+0000 7f026be9d8c0 1 < canceled operation key=XNBE2II106VZ tag=179LHYLJD06Y type=del size=3841344 2024-09-12T17:05:08.506 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.503+0000 7f026be9d8c0 1 > prepared operation key=PQSQ39X3O64P tag=XC8LRSR9JTX6 type=write size=590373 2024-09-12T17:05:08.507 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.503+0000 7f026be9d8c0 1 < canceled part key=_multipart_2BQJ30RQQ25L.2~GDE4TEAV2VIH.0 size=533162 2024-09-12T17:05:08.513 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.507+0000 7f026be9d8c0 1 < canceled multipart upload key=2BQJ30RQQ25L upload=GDE4TEAV2VIH tag=6LSZ568MZEVY type=write size=1581738 2024-09-12T17:05:08.516 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.511+0000 7f026be9d8c0 1 > prepared operation key=JJMEQ2O00SA2 tag=AQBV3DCWU5P8 type=write size=390212 2024-09-12T17:05:08.520 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.515+0000 7f026be9d8c0 1 < completed delete operation key=3JADN360QEO3 tag=MAEYLD9GTK9F type=del 2024-09-12T17:05:08.524 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.519+0000 7f026be9d8c0 1 > prepared operation key=Z9YNIEQCVNBA tag=GY0ZPFURXDC8 type=del size=3182028 2024-09-12T17:05:08.527 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.523+0000 7f026be9d8c0 1 < completed delete operation key=U8W1SAVSLTBF tag=PSQF5DH76S87 type=del 2024-09-12T17:05:08.531 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.527+0000 7f026be9d8c0 1 > prepared operation key=PQSQ39X3O64P tag=33IOUPJIZKFZ type=del size=3728878 2024-09-12T17:05:08.535 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.531+0000 7f026be9d8c0 1 < completed delete operation key=U8W1SAVSLTBF tag=LW6CT523J3YG type=del 2024-09-12T17:05:08.540 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.535+0000 7f026be9d8c0 1 > prepared operation key=Z9YNIEQCVNBA tag=PSN25D02X8HO type=del size=3673434 2024-09-12T17:05:08.544 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.539+0000 7f026be9d8c0 1 < canceled operation key=T6QRDTQRHBPI tag=UOFAKA5Z3LVD type=del size=2538092 2024-09-12T17:05:08.551 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.547+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~I537ZB5TFA04.0 size=333403 2024-09-12T17:05:08.552 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.547+0000 7f026be9d8c0 1 > prepared multipart upload key=QVQ4TI319DH5 upload=I537ZB5TFA04 tag=DQS6LS0IM44U type=write size=1381979 2024-09-12T17:05:08.555 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.551+0000 7f026be9d8c0 1 < completed delete operation key=BBYDPSXZKHZP tag=GHRDM92KHOQL type=del 2024-09-12T17:05:08.563 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.559+0000 7f026be9d8c0 1 > prepared part key=_multipart_BBYDPSXZKHZP.2~CYE7N4B2KFQO.0 size=1048576 2024-09-12T17:05:08.566 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.559+0000 7f026be9d8c0 1 > prepared part key=_multipart_BBYDPSXZKHZP.2~CYE7N4B2KFQO.1 size=1048576 2024-09-12T17:05:08.569 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.563+0000 7f026be9d8c0 1 > prepared part key=_multipart_BBYDPSXZKHZP.2~CYE7N4B2KFQO.2 size=543151 2024-09-12T17:05:08.569 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.563+0000 7f026be9d8c0 1 > prepared multipart upload key=BBYDPSXZKHZP upload=CYE7N4B2KFQO tag=UFDG15T3CG7C type=write size=3688879 2024-09-12T17:05:08.572 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.567+0000 7f026be9d8c0 1 < completed part key=_multipart_PQSQ39X3O64P.2~6B6Y61AJRAH9.0 size=1048576 2024-09-12T17:05:08.575 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.571+0000 7f026be9d8c0 1 < completed part key=_multipart_PQSQ39X3O64P.2~6B6Y61AJRAH9.1 size=580921 2024-09-12T17:05:08.581 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.575+0000 7f026be9d8c0 1 < completed multipart upload key=PQSQ39X3O64P upload=6B6Y61AJRAH9 tag=ZJ2ZTZ2LHAWM type=write size=2678073 2024-09-12T17:05:08.586 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.583+0000 7f026be9d8c0 1 > prepared operation key=SL2446KSB531 tag=X617G3S7496Y type=del size=2986431 2024-09-12T17:05:08.590 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.583+0000 7f026be9d8c0 1 < completed delete operation key=XLKR6P8RNRVO tag=HL3MRBNYV22K type=del 2024-09-12T17:05:08.597 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.591+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~PJR1PCO6ZTX2.0 size=16207 2024-09-12T17:05:08.597 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.591+0000 7f026be9d8c0 1 > prepared multipart upload key=Y27CDEOCM7DH upload=PJR1PCO6ZTX2 tag=B4GVL5M0IE0Q type=write size=1064783 2024-09-12T17:05:08.602 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.595+0000 7f026be9d8c0 1 < completed delete operation key=ALFGNC1YNROX tag=EPLMS6N3KOSS type=del 2024-09-12T17:05:08.610 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.603+0000 7f026be9d8c0 1 > prepared part key=_multipart_MVYWUWKSYQ9Z.2~MYVZ9JX4S22A.0 size=1048576 2024-09-12T17:05:08.613 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.607+0000 7f026be9d8c0 1 > prepared part key=_multipart_MVYWUWKSYQ9Z.2~MYVZ9JX4S22A.1 size=446907 2024-09-12T17:05:08.613 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.607+0000 7f026be9d8c0 1 > prepared multipart upload key=MVYWUWKSYQ9Z upload=MYVZ9JX4S22A tag=VZ9XWPPT8DN8 type=write size=2544059 2024-09-12T17:05:08.618 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.615+0000 7f026be9d8c0 1 < completed delete operation key=4G3BKGNT3YZC tag=VC025J8E9EYQ type=del 2024-09-12T17:05:08.626 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.619+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~3DA1F97K7B06.0 size=1048576 2024-09-12T17:05:08.629 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.623+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~3DA1F97K7B06.1 size=1048576 2024-09-12T17:05:08.633 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.627+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~3DA1F97K7B06.2 size=869655 2024-09-12T17:05:08.633 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.627+0000 7f026be9d8c0 1 > prepared multipart upload key=UU88OS653L8D upload=3DA1F97K7B06 tag=B1RE4CUR6F5U type=write size=4015383 2024-09-12T17:05:08.637 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.631+0000 7f026be9d8c0 1 < completed delete operation key=SGT8IC1GJ3IG tag=NV8I1Q3Z1YKC type=del 2024-09-12T17:05:08.642 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.639+0000 7f026be9d8c0 1 > prepared operation key=SGT8IC1GJ3IG tag=OWR1KCR96SC0 type=write size=811864 2024-09-12T17:05:08.646 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.639+0000 7f026be9d8c0 1 < completed write operation key=PQSQ39X3O64P tag=GYLN6M4GBCF7 type=write size=680418 2024-09-12T17:05:08.652 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.647+0000 7f026be9d8c0 1 > prepared part key=_multipart_L194KQIPFLE1.2~0PJTRU88LFJO.0 size=1048576 2024-09-12T17:05:08.655 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.651+0000 7f026be9d8c0 1 > prepared part key=_multipart_L194KQIPFLE1.2~0PJTRU88LFJO.1 size=751396 2024-09-12T17:05:08.655 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.651+0000 7f026be9d8c0 1 > prepared multipart upload key=L194KQIPFLE1 upload=0PJTRU88LFJO tag=41EW84JXWA0Z type=write size=2848548 2024-09-12T17:05:08.662 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.659+0000 7f026be9d8c0 1 < suggested update operation key=JJMEQ2O00SA2 tag=KZATZJU495E5 type=del size=1300956 2024-09-12T17:05:08.668 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.663+0000 7f026be9d8c0 1 > prepared part key=_multipart_3JADN360QEO3.2~JYAME9E2YZAP.0 size=1048576 2024-09-12T17:05:08.671 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.667+0000 7f026be9d8c0 1 > prepared part key=_multipart_3JADN360QEO3.2~JYAME9E2YZAP.1 size=378568 2024-09-12T17:05:08.671 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.667+0000 7f026be9d8c0 1 > prepared multipart upload key=3JADN360QEO3 upload=JYAME9E2YZAP tag=AFFU6081UWHP type=write size=2475720 2024-09-12T17:05:08.675 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.671+0000 7f026be9d8c0 1 < canceled operation key=32XUMOWT8HO2 tag=702HT6BBW373 type=write size=684691 2024-09-12T17:05:08.681 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.675+0000 7f026be9d8c0 1 > prepared part key=_multipart_21ZD52VBZIO4.2~1CESSH9BJL33.0 size=1048576 2024-09-12T17:05:08.684 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.679+0000 7f026be9d8c0 1 > prepared part key=_multipart_21ZD52VBZIO4.2~1CESSH9BJL33.1 size=1048576 2024-09-12T17:05:08.687 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.683+0000 7f026be9d8c0 1 > prepared part key=_multipart_21ZD52VBZIO4.2~1CESSH9BJL33.2 size=860697 2024-09-12T17:05:08.687 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.683+0000 7f026be9d8c0 1 > prepared multipart upload key=21ZD52VBZIO4 upload=1CESSH9BJL33 tag=JKZDXFD6GVHG type=write size=4006425 2024-09-12T17:05:08.690 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.687+0000 7f026be9d8c0 1 < completed write operation key=LHKLWIUAT08F tag=RK60SLQ5FE5U type=write size=1023707 2024-09-12T17:05:08.694 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.691+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=0A1BHHAC4XND type=del size=239447 2024-09-12T17:05:08.698 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.691+0000 7f026be9d8c0 1 < completed write operation key=PQSQ39X3O64P tag=XC8LRSR9JTX6 type=write size=590373 2024-09-12T17:05:08.704 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.699+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~PR4YZSRDZZ9L.0 size=1048576 2024-09-12T17:05:08.707 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.703+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~PR4YZSRDZZ9L.1 size=985706 2024-09-12T17:05:08.707 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.703+0000 7f026be9d8c0 1 > prepared multipart upload key=6VO85REZG2NW upload=PR4YZSRDZZ9L tag=4Q84BOP0JK71 type=write size=3082858 2024-09-12T17:05:08.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.711+0000 7f026be9d8c0 1 < suggested update operation key=JJMEQ2O00SA2 tag=AQBV3DCWU5P8 type=write size=390212 2024-09-12T17:05:08.721 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.715+0000 7f026be9d8c0 1 > prepared part key=_multipart_XNBE2II106VZ.2~LEUTAH2RGTFR.0 size=1048576 2024-09-12T17:05:08.723 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.719+0000 7f026be9d8c0 1 > prepared part key=_multipart_XNBE2II106VZ.2~LEUTAH2RGTFR.1 size=1048576 2024-09-12T17:05:08.727 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.723+0000 7f026be9d8c0 1 > prepared part key=_multipart_XNBE2II106VZ.2~LEUTAH2RGTFR.2 size=98610 2024-09-12T17:05:08.727 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.723+0000 7f026be9d8c0 1 > prepared multipart upload key=XNBE2II106VZ upload=LEUTAH2RGTFR tag=SHYHGWG6TWIU type=write size=3244338 2024-09-12T17:05:08.731 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.727+0000 7f026be9d8c0 1 < completed delete operation key=Z9YNIEQCVNBA tag=GY0ZPFURXDC8 type=del 2024-09-12T17:05:08.738 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.731+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~10BVHLU3H8R3.0 size=1048576 2024-09-12T17:05:08.740 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.735+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~10BVHLU3H8R3.1 size=424691 2024-09-12T17:05:08.740 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.735+0000 7f026be9d8c0 1 > prepared multipart upload key=UU88OS653L8D upload=10BVHLU3H8R3 tag=01KDYI7SFM4U type=write size=2521843 2024-09-12T17:05:08.744 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.739+0000 7f026be9d8c0 1 < completed delete operation key=PQSQ39X3O64P tag=33IOUPJIZKFZ type=del 2024-09-12T17:05:08.750 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.747+0000 7f026be9d8c0 1 > prepared part key=_multipart_3JADN360QEO3.2~FD3FPCCN1E4B.0 size=953232 2024-09-12T17:05:08.750 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.747+0000 7f026be9d8c0 1 > prepared multipart upload key=3JADN360QEO3 upload=FD3FPCCN1E4B tag=HC83WWSJNKI5 type=write size=2001808 2024-09-12T17:05:08.754 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.751+0000 7f026be9d8c0 1 < completed delete operation key=Z9YNIEQCVNBA tag=PSN25D02X8HO type=del 2024-09-12T17:05:08.760 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.755+0000 7f026be9d8c0 1 > prepared part key=_multipart_BBYDPSXZKHZP.2~QR8EITVNOLBD.0 size=965411 2024-09-12T17:05:08.760 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.755+0000 7f026be9d8c0 1 > prepared multipart upload key=BBYDPSXZKHZP upload=QR8EITVNOLBD tag=92E1NEJOY8ZT type=write size=2013987 2024-09-12T17:05:08.763 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.759+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~I537ZB5TFA04.0 size=333403 2024-09-12T17:05:08.768 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.763+0000 7f026be9d8c0 1 < completed multipart upload key=QVQ4TI319DH5 upload=I537ZB5TFA04 tag=DQS6LS0IM44U type=write size=1381979 2024-09-12T17:05:08.771 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.767+0000 7f026be9d8c0 1 > prepared operation key=MVYWUWKSYQ9Z tag=P8QH9ZZUH4O9 type=del size=12732 2024-09-12T17:05:08.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.771+0000 7f026be9d8c0 1 < completed part key=_multipart_BBYDPSXZKHZP.2~CYE7N4B2KFQO.0 size=1048576 2024-09-12T17:05:08.776 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.771+0000 7f026be9d8c0 1 < completed part key=_multipart_BBYDPSXZKHZP.2~CYE7N4B2KFQO.1 size=1048576 2024-09-12T17:05:08.779 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.775+0000 7f026be9d8c0 1 < completed part key=_multipart_BBYDPSXZKHZP.2~CYE7N4B2KFQO.2 size=543151 2024-09-12T17:05:08.784 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.779+0000 7f026be9d8c0 1 < completed multipart upload key=BBYDPSXZKHZP upload=CYE7N4B2KFQO tag=UFDG15T3CG7C type=write size=3688879 2024-09-12T17:05:08.787 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.783+0000 7f026be9d8c0 1 > prepared operation key=E0Y3SKNUYCQS tag=JHX0IJ7E72PH type=write size=511098 2024-09-12T17:05:08.791 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.787+0000 7f026be9d8c0 1 < canceled operation key=SL2446KSB531 tag=X617G3S7496Y type=del size=2986431 2024-09-12T17:05:08.794 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.791+0000 7f026be9d8c0 1 > prepared operation key=PQSQ39X3O64P tag=R35E03PRWEKA type=del size=3231915 2024-09-12T17:05:08.797 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.791+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~PJR1PCO6ZTX2.0 size=16207 2024-09-12T17:05:08.802 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.799+0000 7f026be9d8c0 1 < completed multipart upload key=Y27CDEOCM7DH upload=PJR1PCO6ZTX2 tag=B4GVL5M0IE0Q type=write size=1064783 2024-09-12T17:05:08.805 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.799+0000 7f026be9d8c0 1 > prepared operation key=SGT8IC1GJ3IG tag=TFL7O4XXLSWG type=del size=2839815 2024-09-12T17:05:08.809 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.803+0000 7f026be9d8c0 1 < completed part key=_multipart_MVYWUWKSYQ9Z.2~MYVZ9JX4S22A.0 size=1048576 2024-09-12T17:05:08.811 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.807+0000 7f026be9d8c0 1 < completed part key=_multipart_MVYWUWKSYQ9Z.2~MYVZ9JX4S22A.1 size=446907 2024-09-12T17:05:08.817 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.811+0000 7f026be9d8c0 1 < completed multipart upload key=MVYWUWKSYQ9Z upload=MYVZ9JX4S22A tag=VZ9XWPPT8DN8 type=write size=2544059 2024-09-12T17:05:08.820 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.815+0000 7f026be9d8c0 1 > prepared operation key=SGT8IC1GJ3IG tag=30B1JCBHO5DB type=write size=205374 2024-09-12T17:05:08.823 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.819+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~3DA1F97K7B06.0 size=1048576 2024-09-12T17:05:08.829 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.823+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~3DA1F97K7B06.1 size=1048576 2024-09-12T17:05:08.832 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.827+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~3DA1F97K7B06.2 size=869655 2024-09-12T17:05:08.838 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.835+0000 7f026be9d8c0 1 < completed multipart upload key=UU88OS653L8D upload=3DA1F97K7B06 tag=B1RE4CUR6F5U type=write size=4015383 2024-09-12T17:05:08.841 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.835+0000 7f026be9d8c0 1 > prepared operation key=JJMEQ2O00SA2 tag=VSG24BRI3M5O type=del size=1685548 2024-09-12T17:05:08.845 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.839+0000 7f026be9d8c0 1 < completed write operation key=SGT8IC1GJ3IG tag=OWR1KCR96SC0 type=write size=811864 2024-09-12T17:05:08.849 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.843+0000 7f026be9d8c0 1 > prepared operation key=2BQJ30RQQ25L tag=TKNUBWDGJMCH type=del size=3226972 2024-09-12T17:05:08.852 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.847+0000 7f026be9d8c0 1 < completed part key=_multipart_L194KQIPFLE1.2~0PJTRU88LFJO.0 size=1048576 2024-09-12T17:05:08.855 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.851+0000 7f026be9d8c0 1 < completed part key=_multipart_L194KQIPFLE1.2~0PJTRU88LFJO.1 size=751396 2024-09-12T17:05:08.860 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.855+0000 7f026be9d8c0 1 < completed multipart upload key=L194KQIPFLE1 upload=0PJTRU88LFJO tag=41EW84JXWA0Z type=write size=2848548 2024-09-12T17:05:08.863 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.859+0000 7f026be9d8c0 1 > prepared operation key=6VO85REZG2NW tag=C4JAXPWU5STN type=del size=3128495 2024-09-12T17:05:08.866 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.863+0000 7f026be9d8c0 1 < completed part key=_multipart_3JADN360QEO3.2~JYAME9E2YZAP.0 size=1048576 2024-09-12T17:05:08.869 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.863+0000 7f026be9d8c0 1 < completed part key=_multipart_3JADN360QEO3.2~JYAME9E2YZAP.1 size=378568 2024-09-12T17:05:08.875 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.871+0000 7f026be9d8c0 1 < completed multipart upload key=3JADN360QEO3 upload=JYAME9E2YZAP tag=AFFU6081UWHP type=write size=2475720 2024-09-12T17:05:08.881 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.875+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~VMSTHNJ1A5E6.0 size=1048576 2024-09-12T17:05:08.883 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.879+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~VMSTHNJ1A5E6.1 size=1048576 2024-09-12T17:05:08.886 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.883+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~VMSTHNJ1A5E6.2 size=829667 2024-09-12T17:05:08.886 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.883+0000 7f026be9d8c0 1 > prepared multipart upload key=Y27CDEOCM7DH upload=VMSTHNJ1A5E6 tag=HZMNMOBC62J9 type=write size=3975395 2024-09-12T17:05:08.890 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.887+0000 7f026be9d8c0 1 < completed part key=_multipart_21ZD52VBZIO4.2~1CESSH9BJL33.0 size=1048576 2024-09-12T17:05:08.893 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.887+0000 7f026be9d8c0 1 < completed part key=_multipart_21ZD52VBZIO4.2~1CESSH9BJL33.1 size=1048576 2024-09-12T17:05:08.895 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.891+0000 7f026be9d8c0 1 < completed part key=_multipart_21ZD52VBZIO4.2~1CESSH9BJL33.2 size=860697 2024-09-12T17:05:08.901 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.895+0000 7f026be9d8c0 1 < completed multipart upload key=21ZD52VBZIO4 upload=1CESSH9BJL33 tag=JKZDXFD6GVHG type=write size=4006425 2024-09-12T17:05:08.905 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.899+0000 7f026be9d8c0 1 > prepared operation key=J8MU1A0CWSAQ tag=E3A7WF46B253 type=del size=1837416 2024-09-12T17:05:08.908 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.903+0000 7f026be9d8c0 1 < completed delete operation key=U8W1SAVSLTBF tag=0A1BHHAC4XND type=del 2024-09-12T17:05:08.912 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.907+0000 7f026be9d8c0 1 > prepared operation key=XNBE2II106VZ tag=5PEREND4CTXE type=del size=1734158 2024-09-12T17:05:08.915 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.911+0000 7f026be9d8c0 1 < completed part key=_multipart_6VO85REZG2NW.2~PR4YZSRDZZ9L.0 size=1048576 2024-09-12T17:05:08.918 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.915+0000 7f026be9d8c0 1 < completed part key=_multipart_6VO85REZG2NW.2~PR4YZSRDZZ9L.1 size=985706 2024-09-12T17:05:08.924 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.919+0000 7f026be9d8c0 1 < completed multipart upload key=6VO85REZG2NW upload=PR4YZSRDZZ9L tag=4Q84BOP0JK71 type=write size=3082858 2024-09-12T17:05:08.930 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.927+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~MBA1VYM0BA8M.0 size=1048576 2024-09-12T17:05:08.933 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.927+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~MBA1VYM0BA8M.1 size=450585 2024-09-12T17:05:08.933 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.927+0000 7f026be9d8c0 1 > prepared multipart upload key=XLKR6P8RNRVO upload=MBA1VYM0BA8M tag=QBDDL4NV350K type=write size=2547737 2024-09-12T17:05:08.933 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.927+0000 7f026be9d8c0 1 < canceled part key=_multipart_XNBE2II106VZ.2~LEUTAH2RGTFR.0 size=1048576 2024-09-12T17:05:08.936 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.931+0000 7f026be9d8c0 1 < completed part key=_multipart_XNBE2II106VZ.2~LEUTAH2RGTFR.1 size=1048576 2024-09-12T17:05:08.939 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.935+0000 7f026be9d8c0 1 < completed part key=_multipart_XNBE2II106VZ.2~LEUTAH2RGTFR.2 size=98610 2024-09-12T17:05:08.945 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.939+0000 7f026be9d8c0 1 < canceled multipart upload key=XNBE2II106VZ upload=LEUTAH2RGTFR tag=SHYHGWG6TWIU type=write size=3244338 2024-09-12T17:05:08.949 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.943+0000 7f026be9d8c0 1 > prepared operation key=E0Y3SKNUYCQS tag=ZNTTPWNS3XUL type=write size=689353 2024-09-12T17:05:08.953 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.947+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~10BVHLU3H8R3.0 size=1048576 2024-09-12T17:05:08.953 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.947+0000 7f026be9d8c0 1 < canceled part key=_multipart_UU88OS653L8D.2~10BVHLU3H8R3.1 size=424691 2024-09-12T17:05:08.958 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.955+0000 7f026be9d8c0 1 < canceled multipart upload key=UU88OS653L8D upload=10BVHLU3H8R3 tag=01KDYI7SFM4U type=write size=2521843 2024-09-12T17:05:08.962 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.959+0000 7f026be9d8c0 1 > prepared operation key=XNBE2II106VZ tag=E04THXWF3DK1 type=del size=2640139 2024-09-12T17:05:08.966 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.963+0000 7f026be9d8c0 1 < completed part key=_multipart_3JADN360QEO3.2~FD3FPCCN1E4B.0 size=953232 2024-09-12T17:05:08.972 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.967+0000 7f026be9d8c0 1 < completed multipart upload key=3JADN360QEO3 upload=FD3FPCCN1E4B tag=HC83WWSJNKI5 type=write size=2001808 2024-09-12T17:05:08.976 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.971+0000 7f026be9d8c0 1 > prepared operation key=6VO85REZG2NW tag=PCSRNNI81RYT type=del size=158314 2024-09-12T17:05:08.980 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.975+0000 7f026be9d8c0 1 < completed part key=_multipart_BBYDPSXZKHZP.2~QR8EITVNOLBD.0 size=965411 2024-09-12T17:05:08.986 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.983+0000 7f026be9d8c0 1 < completed multipart upload key=BBYDPSXZKHZP upload=QR8EITVNOLBD tag=92E1NEJOY8ZT type=write size=2013987 2024-09-12T17:05:08.990 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.987+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=QLGS1D5MF8TC type=write size=995529 2024-09-12T17:05:08.993 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.987+0000 7f026be9d8c0 1 < completed delete operation key=MVYWUWKSYQ9Z tag=P8QH9ZZUH4O9 type=del 2024-09-12T17:05:08.997 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.991+0000 7f026be9d8c0 1 > prepared operation key=LHKLWIUAT08F tag=ZSTRKAQJG6J2 type=del size=1944409 2024-09-12T17:05:09.004 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:08.999+0000 7f026be9d8c0 1 < suggested remove operation key=E0Y3SKNUYCQS tag=JHX0IJ7E72PH type=write 2024-09-12T17:05:09.011 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.007+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~RFHH73ZQ22JH.0 size=1048576 2024-09-12T17:05:09.013 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.007+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~RFHH73ZQ22JH.1 size=116787 2024-09-12T17:05:09.014 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.007+0000 7f026be9d8c0 1 > prepared multipart upload key=UU88OS653L8D upload=RFHH73ZQ22JH tag=BRRBG0KP6H06 type=write size=2213939 2024-09-12T17:05:09.021 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.015+0000 7f026be9d8c0 1 < suggested update operation key=PQSQ39X3O64P tag=R35E03PRWEKA type=del size=3231915 2024-09-12T17:05:09.025 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.019+0000 7f026be9d8c0 1 > prepared operation key=32XUMOWT8HO2 tag=E3UPC7C51J9Z type=del size=3195261 2024-09-12T17:05:09.028 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.023+0000 7f026be9d8c0 1 < completed delete operation key=SGT8IC1GJ3IG tag=TFL7O4XXLSWG type=del 2024-09-12T17:05:09.032 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.027+0000 7f026be9d8c0 1 > prepared operation key=J8MU1A0CWSAQ tag=QS1JXXJ2YPPI type=del size=525242 2024-09-12T17:05:09.036 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.031+0000 7f026be9d8c0 1 < completed write operation key=SGT8IC1GJ3IG tag=30B1JCBHO5DB type=write size=205374 2024-09-12T17:05:09.043 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.039+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~2BZ8AU66VK0G.0 size=1048576 2024-09-12T17:05:09.045 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.039+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~2BZ8AU66VK0G.1 size=1048576 2024-09-12T17:05:09.048 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.043+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~2BZ8AU66VK0G.2 size=409963 2024-09-12T17:05:09.049 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.043+0000 7f026be9d8c0 1 > prepared multipart upload key=ALFGNC1YNROX upload=2BZ8AU66VK0G tag=LRKTIW9X3UHF type=write size=3555691 2024-09-12T17:05:09.055 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.051+0000 7f026be9d8c0 1 < suggested update operation key=JJMEQ2O00SA2 tag=VSG24BRI3M5O type=del size=1685548 2024-09-12T17:05:09.058 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.055+0000 7f026be9d8c0 1 > prepared operation key=4U1W97V0OX11 tag=C1T5TN8SSDMW type=del size=2659043 2024-09-12T17:05:09.065 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.059+0000 7f026be9d8c0 1 < suggested remove operation key=2BQJ30RQQ25L tag=TKNUBWDGJMCH type=del 2024-09-12T17:05:09.069 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.063+0000 7f026be9d8c0 1 > prepared operation key=JJMEQ2O00SA2 tag=XC1RFG3J0XHJ type=del size=3622312 2024-09-12T17:05:09.072 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.067+0000 7f026be9d8c0 1 < completed delete operation key=6VO85REZG2NW tag=C4JAXPWU5STN type=del 2024-09-12T17:05:09.079 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.075+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~V2EYIMYGWPHP.0 size=1048576 2024-09-12T17:05:09.082 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.079+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~V2EYIMYGWPHP.1 size=398048 2024-09-12T17:05:09.082 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.079+0000 7f026be9d8c0 1 > prepared multipart upload key=Z9YNIEQCVNBA upload=V2EYIMYGWPHP tag=5B416QG5YWVF type=write size=2495200 2024-09-12T17:05:09.086 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.079+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~VMSTHNJ1A5E6.0 size=1048576 2024-09-12T17:05:09.089 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.083+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~VMSTHNJ1A5E6.1 size=1048576 2024-09-12T17:05:09.091 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.087+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~VMSTHNJ1A5E6.2 size=829667 2024-09-12T17:05:09.097 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.091+0000 7f026be9d8c0 1 < completed multipart upload key=Y27CDEOCM7DH upload=VMSTHNJ1A5E6 tag=HZMNMOBC62J9 type=write size=3975395 2024-09-12T17:05:09.101 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.095+0000 7f026be9d8c0 1 > prepared operation key=GPUFWJ3AWEMX tag=H5RYAOBF4GCQ type=del size=2647544 2024-09-12T17:05:09.107 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.103+0000 7f026be9d8c0 1 < suggested remove operation key=J8MU1A0CWSAQ tag=E3A7WF46B253 type=del 2024-09-12T17:05:09.111 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.107+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=SUJ1E5MS1AAE type=write size=673018 2024-09-12T17:05:09.114 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.111+0000 7f026be9d8c0 1 < completed delete operation key=XNBE2II106VZ tag=5PEREND4CTXE type=del 2024-09-12T17:05:09.118 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.111+0000 7f026be9d8c0 1 > prepared operation key=XNBE2II106VZ tag=QH8CS4L32OPM type=del size=2070938 2024-09-12T17:05:09.121 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.115+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~MBA1VYM0BA8M.0 size=1048576 2024-09-12T17:05:09.124 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.119+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~MBA1VYM0BA8M.1 size=450585 2024-09-12T17:05:09.129 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.123+0000 7f026be9d8c0 1 < completed multipart upload key=XLKR6P8RNRVO upload=MBA1VYM0BA8M tag=QBDDL4NV350K type=write size=2547737 2024-09-12T17:05:09.135 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.131+0000 7f026be9d8c0 1 > prepared part key=_multipart_3JADN360QEO3.2~XPB3FMYO2PWB.0 size=801261 2024-09-12T17:05:09.136 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.131+0000 7f026be9d8c0 1 > prepared multipart upload key=3JADN360QEO3 upload=XPB3FMYO2PWB tag=BNZAXZ6UPZSP type=write size=1849837 2024-09-12T17:05:09.139 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.135+0000 7f026be9d8c0 -1 < failed to complete operation key=E0Y3SKNUYCQS tag=ZNTTPWNS3XUL type=write size=689353: (22) Invalid argument 2024-09-12T17:05:09.142 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.139+0000 7f026be9d8c0 1 > prepared operation key=BW1T21LBUE2D tag=2OQ27V6FFEOL type=del size=12246 2024-09-12T17:05:09.146 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.143+0000 7f026be9d8c0 1 < completed delete operation key=XNBE2II106VZ tag=E04THXWF3DK1 type=del 2024-09-12T17:05:09.149 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.143+0000 7f026be9d8c0 1 > prepared operation key=LHKLWIUAT08F tag=VMQXCCX7Q4JZ type=write size=996518 2024-09-12T17:05:09.157 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.151+0000 7f026be9d8c0 1 < completed delete operation key=6VO85REZG2NW tag=PCSRNNI81RYT type=del 2024-09-12T17:05:09.161 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.155+0000 7f026be9d8c0 1 > prepared operation key=LHKLWIUAT08F tag=2EUB5T2N3T3M type=del size=2364113 2024-09-12T17:05:09.164 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.159+0000 7f026be9d8c0 1 < completed write operation key=RBNN03IPZ8BT tag=QLGS1D5MF8TC type=write size=995529 2024-09-12T17:05:09.168 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.163+0000 7f026be9d8c0 1 > prepared operation key=LHKLWIUAT08F tag=EHQIEUGRNM3N type=write size=130478 2024-09-12T17:05:09.172 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.167+0000 7f026be9d8c0 1 < completed delete operation key=LHKLWIUAT08F tag=ZSTRKAQJG6J2 type=del 2024-09-12T17:05:09.175 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.171+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=PAJ1K73KTADN type=write size=728888 2024-09-12T17:05:09.176 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.171+0000 7f026be9d8c0 1 < canceled part key=_multipart_UU88OS653L8D.2~RFHH73ZQ22JH.0 size=1048576 2024-09-12T17:05:09.179 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.175+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~RFHH73ZQ22JH.1 size=116787 2024-09-12T17:05:09.184 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.179+0000 7f026be9d8c0 1 < canceled multipart upload key=UU88OS653L8D upload=RFHH73ZQ22JH tag=BRRBG0KP6H06 type=write size=2213939 2024-09-12T17:05:09.187 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.183+0000 7f026be9d8c0 1 > prepared operation key=32XUMOWT8HO2 tag=J29LHPXZAYQT type=del size=27665 2024-09-12T17:05:09.190 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.187+0000 7f026be9d8c0 1 < completed delete operation key=32XUMOWT8HO2 tag=E3UPC7C51J9Z type=del 2024-09-12T17:05:09.194 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.187+0000 7f026be9d8c0 1 > prepared operation key=LHKLWIUAT08F tag=M1URN0YITJHS type=del size=995134 2024-09-12T17:05:09.197 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.191+0000 7f026be9d8c0 -1 < failed to complete operation key=J8MU1A0CWSAQ tag=QS1JXXJ2YPPI type=del size=525242: (22) Invalid argument 2024-09-12T17:05:09.203 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.199+0000 7f026be9d8c0 1 > prepared part key=_multipart_RBNN03IPZ8BT.2~DHJIHDCT4VWY.0 size=1048576 2024-09-12T17:05:09.207 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.203+0000 7f026be9d8c0 1 > prepared part key=_multipart_RBNN03IPZ8BT.2~DHJIHDCT4VWY.1 size=1048576 2024-09-12T17:05:09.210 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.207+0000 7f026be9d8c0 1 > prepared part key=_multipart_RBNN03IPZ8BT.2~DHJIHDCT4VWY.2 size=685595 2024-09-12T17:05:09.210 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.207+0000 7f026be9d8c0 1 > prepared multipart upload key=RBNN03IPZ8BT upload=DHJIHDCT4VWY tag=I9559SHQ9RUH type=write size=3831323 2024-09-12T17:05:09.213 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.207+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~2BZ8AU66VK0G.0 size=1048576 2024-09-12T17:05:09.216 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.211+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~2BZ8AU66VK0G.1 size=1048576 2024-09-12T17:05:09.218 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.215+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~2BZ8AU66VK0G.2 size=409963 2024-09-12T17:05:09.224 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.219+0000 7f026be9d8c0 1 < completed multipart upload key=ALFGNC1YNROX upload=2BZ8AU66VK0G tag=LRKTIW9X3UHF type=write size=3555691 2024-09-12T17:05:09.228 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.223+0000 7f026be9d8c0 1 > prepared operation key=T6QRDTQRHBPI tag=NT18PYWNDFLF type=del size=109043 2024-09-12T17:05:09.231 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.227+0000 7f026be9d8c0 1 < canceled operation key=4U1W97V0OX11 tag=C1T5TN8SSDMW type=del size=2659043 2024-09-12T17:05:09.234 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.231+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=BS28GIYC71JW type=del size=3952668 2024-09-12T17:05:09.238 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.235+0000 7f026be9d8c0 1 < completed delete operation key=JJMEQ2O00SA2 tag=XC1RFG3J0XHJ type=del 2024-09-12T17:05:09.244 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.239+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~B0F0OMRMROYT.0 size=1048576 2024-09-12T17:05:09.246 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.243+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~B0F0OMRMROYT.1 size=1048576 2024-09-12T17:05:09.249 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.243+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~B0F0OMRMROYT.2 size=365897 2024-09-12T17:05:09.249 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.243+0000 7f026be9d8c0 1 > prepared multipart upload key=QVQ4TI319DH5 upload=B0F0OMRMROYT tag=9VWSLOPAPOEK type=write size=3511625 2024-09-12T17:05:09.252 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.247+0000 7f026be9d8c0 1 < completed part key=_multipart_Z9YNIEQCVNBA.2~V2EYIMYGWPHP.0 size=1048576 2024-09-12T17:05:09.255 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.251+0000 7f026be9d8c0 1 < completed part key=_multipart_Z9YNIEQCVNBA.2~V2EYIMYGWPHP.1 size=398048 2024-09-12T17:05:09.261 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.255+0000 7f026be9d8c0 1 < completed multipart upload key=Z9YNIEQCVNBA upload=V2EYIMYGWPHP tag=5B416QG5YWVF type=write size=2495200 2024-09-12T17:05:09.264 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.259+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=B83P1EINP00X type=write size=99901 2024-09-12T17:05:09.267 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.263+0000 7f026be9d8c0 1 < completed delete operation key=GPUFWJ3AWEMX tag=H5RYAOBF4GCQ type=del 2024-09-12T17:05:09.270 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.267+0000 7f026be9d8c0 1 > prepared operation key=J8MU1A0CWSAQ tag=K2TTIZOXT3E7 type=write size=976472 2024-09-12T17:05:09.278 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.271+0000 7f026be9d8c0 1 < suggested update operation key=U8W1SAVSLTBF tag=SUJ1E5MS1AAE type=write size=673018 2024-09-12T17:05:09.284 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.279+0000 7f026be9d8c0 1 > prepared part key=_multipart_4U1W97V0OX11.2~24KV8B3I82JV.0 size=426889 2024-09-12T17:05:09.284 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.279+0000 7f026be9d8c0 1 > prepared multipart upload key=4U1W97V0OX11 upload=24KV8B3I82JV tag=2KJGRUMLHD61 type=write size=1475465 2024-09-12T17:05:09.287 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.283+0000 7f026be9d8c0 1 < completed delete operation key=XNBE2II106VZ tag=QH8CS4L32OPM type=del 2024-09-12T17:05:09.293 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.287+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~6D0QR3UG0AY1.0 size=557548 2024-09-12T17:05:09.293 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.287+0000 7f026be9d8c0 1 > prepared multipart upload key=8AFDAVJLMRD2 upload=6D0QR3UG0AY1 tag=16LN290QQEKN type=write size=1606124 2024-09-12T17:05:09.297 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.291+0000 7f026be9d8c0 1 < completed part key=_multipart_3JADN360QEO3.2~XPB3FMYO2PWB.0 size=801261 2024-09-12T17:05:09.302 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.299+0000 7f026be9d8c0 1 < completed multipart upload key=3JADN360QEO3 upload=XPB3FMYO2PWB tag=BNZAXZ6UPZSP type=write size=1849837 2024-09-12T17:05:09.306 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.299+0000 7f026be9d8c0 1 > prepared operation key=4G3BKGNT3YZC tag=GRCWWNKQK94N type=del size=2601908 2024-09-12T17:05:09.309 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.303+0000 7f026be9d8c0 1 < completed delete operation key=BW1T21LBUE2D tag=2OQ27V6FFEOL type=del 2024-09-12T17:05:09.313 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.307+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=MHSKO23G5X7D type=del size=3257933 2024-09-12T17:05:09.316 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.311+0000 7f026be9d8c0 1 < completed write operation key=LHKLWIUAT08F tag=VMQXCCX7Q4JZ type=write size=996518 2024-09-12T17:05:09.319 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.315+0000 7f026be9d8c0 1 > prepared operation key=4G3BKGNT3YZC tag=AVNKSASY6A2P type=del size=1326256 2024-09-12T17:05:09.326 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.319+0000 7f026be9d8c0 1 < canceled operation key=LHKLWIUAT08F tag=2EUB5T2N3T3M type=del size=2364113 2024-09-12T17:05:09.329 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.323+0000 7f026be9d8c0 1 > prepared operation key=2BQJ30RQQ25L tag=CSH7X1Z2Q88U type=del size=711261 2024-09-12T17:05:09.333 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.327+0000 7f026be9d8c0 1 < completed write operation key=LHKLWIUAT08F tag=EHQIEUGRNM3N type=write size=130478 2024-09-12T17:05:09.337 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.331+0000 7f026be9d8c0 1 > prepared operation key=SGT8IC1GJ3IG tag=0XVUDS33PDAX type=write size=269998 2024-09-12T17:05:09.340 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.335+0000 7f026be9d8c0 1 < completed write operation key=21ZD52VBZIO4 tag=PAJ1K73KTADN type=write size=728888 2024-09-12T17:05:09.343 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.339+0000 7f026be9d8c0 1 > prepared operation key=4U1W97V0OX11 tag=NW7MYWPQC32G type=del size=4068785 2024-09-12T17:05:09.350 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.347+0000 7f026be9d8c0 1 < suggested update operation key=32XUMOWT8HO2 tag=J29LHPXZAYQT type=del size=27665 2024-09-12T17:05:09.353 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.347+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=6411J6A65EW5 type=write size=799853 2024-09-12T17:05:09.357 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.351+0000 7f026be9d8c0 1 < completed delete operation key=LHKLWIUAT08F tag=M1URN0YITJHS type=del 2024-09-12T17:05:09.361 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.355+0000 7f026be9d8c0 1 > prepared operation key=2BQJ30RQQ25L tag=MP876KGG1MG3 type=del size=1657046 2024-09-12T17:05:09.364 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.359+0000 7f026be9d8c0 1 < completed part key=_multipart_RBNN03IPZ8BT.2~DHJIHDCT4VWY.0 size=1048576 2024-09-12T17:05:09.367 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.363+0000 7f026be9d8c0 1 < completed part key=_multipart_RBNN03IPZ8BT.2~DHJIHDCT4VWY.1 size=1048576 2024-09-12T17:05:09.370 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.367+0000 7f026be9d8c0 1 < completed part key=_multipart_RBNN03IPZ8BT.2~DHJIHDCT4VWY.2 size=685595 2024-09-12T17:05:09.376 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.371+0000 7f026be9d8c0 1 < completed multipart upload key=RBNN03IPZ8BT upload=DHJIHDCT4VWY tag=I9559SHQ9RUH type=write size=3831323 2024-09-12T17:05:09.380 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.375+0000 7f026be9d8c0 1 > prepared operation key=JJMEQ2O00SA2 tag=M2HR9ZQK4OL7 type=write size=188708 2024-09-12T17:05:09.383 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.379+0000 7f026be9d8c0 1 < completed delete operation key=T6QRDTQRHBPI tag=NT18PYWNDFLF type=del 2024-09-12T17:05:09.387 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.383+0000 7f026be9d8c0 1 > prepared operation key=L194KQIPFLE1 tag=63N9TZ7MOPAJ type=del size=1615614 2024-09-12T17:05:09.394 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.391+0000 7f026be9d8c0 1 < suggested remove operation key=21ZD52VBZIO4 tag=BS28GIYC71JW type=del 2024-09-12T17:05:09.397 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.391+0000 7f026be9d8c0 1 > prepared operation key=4U1W97V0OX11 tag=H22FHHS974PA type=del size=2047113 2024-09-12T17:05:09.401 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.395+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~B0F0OMRMROYT.0 size=1048576 2024-09-12T17:05:09.404 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.399+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~B0F0OMRMROYT.1 size=1048576 2024-09-12T17:05:09.407 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.403+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~B0F0OMRMROYT.2 size=365897 2024-09-12T17:05:09.413 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.407+0000 7f026be9d8c0 1 < completed multipart upload key=QVQ4TI319DH5 upload=B0F0OMRMROYT tag=9VWSLOPAPOEK type=write size=3511625 2024-09-12T17:05:09.420 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.415+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~5GN4RU3UOYHO.0 size=1008223 2024-09-12T17:05:09.420 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.415+0000 7f026be9d8c0 1 > prepared multipart upload key=4G3BKGNT3YZC upload=5GN4RU3UOYHO tag=23EYXFK62YHX type=write size=2056799 2024-09-12T17:05:09.423 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.419+0000 7f026be9d8c0 1 < completed write operation key=RBNN03IPZ8BT tag=B83P1EINP00X type=write size=99901 2024-09-12T17:05:09.430 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.427+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~GL8FWCODU0ZW.0 size=1048576 2024-09-12T17:05:09.433 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.427+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~GL8FWCODU0ZW.1 size=1048576 2024-09-12T17:05:09.435 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.431+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~GL8FWCODU0ZW.2 size=830918 2024-09-12T17:05:09.435 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.431+0000 7f026be9d8c0 1 > prepared multipart upload key=4G3BKGNT3YZC upload=GL8FWCODU0ZW tag=XYBYDVA04VCA type=write size=3976646 2024-09-12T17:05:09.439 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.435+0000 7f026be9d8c0 1 < completed write operation key=J8MU1A0CWSAQ tag=K2TTIZOXT3E7 type=write size=976472 2024-09-12T17:05:09.442 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.439+0000 7f026be9d8c0 1 > prepared operation key=ALFGNC1YNROX tag=0EN6H9ECKB5W type=write size=848816 2024-09-12T17:05:09.446 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.443+0000 7f026be9d8c0 1 < completed part key=_multipart_4U1W97V0OX11.2~24KV8B3I82JV.0 size=426889 2024-09-12T17:05:09.452 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.447+0000 7f026be9d8c0 1 < completed multipart upload key=4U1W97V0OX11 upload=24KV8B3I82JV tag=2KJGRUMLHD61 type=write size=1475465 2024-09-12T17:05:09.458 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.455+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~NG7HW2L63BQS.0 size=1048576 2024-09-12T17:05:09.461 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.455+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~NG7HW2L63BQS.1 size=34708 2024-09-12T17:05:09.461 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.455+0000 7f026be9d8c0 1 > prepared multipart upload key=GPUFWJ3AWEMX upload=NG7HW2L63BQS tag=OLRW0PDGYYA6 type=write size=2131860 2024-09-12T17:05:09.465 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.459+0000 7f026be9d8c0 1 < completed part key=_multipart_8AFDAVJLMRD2.2~6D0QR3UG0AY1.0 size=557548 2024-09-12T17:05:09.473 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.467+0000 7f026be9d8c0 1 < completed multipart upload key=8AFDAVJLMRD2 upload=6D0QR3UG0AY1 tag=16LN290QQEKN type=write size=1606124 2024-09-12T17:05:09.475 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.471+0000 7f026be9d8c0 1 > prepared operation key=XNBE2II106VZ tag=MZ2WPCKUB1OM type=del size=3890626 2024-09-12T17:05:09.478 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.475+0000 7f026be9d8c0 1 < completed delete operation key=4G3BKGNT3YZC tag=GRCWWNKQK94N type=del 2024-09-12T17:05:09.482 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.479+0000 7f026be9d8c0 1 > prepared operation key=UU88OS653L8D tag=XABFCAKHS0T2 type=del size=1273654 2024-09-12T17:05:09.489 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.483+0000 7f026be9d8c0 1 < completed delete operation key=3JADN360QEO3 tag=MHSKO23G5X7D type=del 2024-09-12T17:05:09.493 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.487+0000 7f026be9d8c0 1 > prepared operation key=Y27CDEOCM7DH tag=QXX4YG3QGHI3 type=del size=511364 2024-09-12T17:05:09.497 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.491+0000 7f026be9d8c0 1 < canceled operation key=4G3BKGNT3YZC tag=AVNKSASY6A2P type=del size=1326256 2024-09-12T17:05:09.504 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.499+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~BLN54I9Z39YY.0 size=1048576 2024-09-12T17:05:09.507 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.503+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~BLN54I9Z39YY.1 size=1048576 2024-09-12T17:05:09.510 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.507+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~BLN54I9Z39YY.2 size=104859 2024-09-12T17:05:09.510 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.507+0000 7f026be9d8c0 1 > prepared multipart upload key=J8MU1A0CWSAQ upload=BLN54I9Z39YY tag=L5J7CSFUSW37 type=write size=3250587 2024-09-12T17:05:09.513 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.507+0000 7f026be9d8c0 1 < completed delete operation key=2BQJ30RQQ25L tag=CSH7X1Z2Q88U type=del 2024-09-12T17:05:09.517 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.511+0000 7f026be9d8c0 1 > prepared operation key=SL2446KSB531 tag=4X1UWI93YV8I type=write size=276876 2024-09-12T17:05:09.521 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.515+0000 7f026be9d8c0 1 < completed write operation key=SGT8IC1GJ3IG tag=0XVUDS33PDAX type=write size=269998 2024-09-12T17:05:09.524 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.519+0000 7f026be9d8c0 1 > prepared operation key=SGT8IC1GJ3IG tag=DZA2HTKVB0LI type=del size=3730588 2024-09-12T17:05:09.528 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.523+0000 7f026be9d8c0 1 < completed delete operation key=4U1W97V0OX11 tag=NW7MYWPQC32G type=del 2024-09-12T17:05:09.531 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.527+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=G2PMDLSKQT6M type=del size=2932434 2024-09-12T17:05:09.534 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.531+0000 7f026be9d8c0 1 < completed write operation key=3JADN360QEO3 tag=6411J6A65EW5 type=write size=799853 2024-09-12T17:05:09.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.535+0000 7f026be9d8c0 1 > prepared operation key=SO3HLQZA8B6B tag=OZ9WRCR2BGWL type=del size=757633 2024-09-12T17:05:09.541 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.535+0000 7f026be9d8c0 1 < completed delete operation key=2BQJ30RQQ25L tag=MP876KGG1MG3 type=del 2024-09-12T17:05:09.545 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.539+0000 7f026be9d8c0 1 > prepared operation key=JJMEQ2O00SA2 tag=GZ205YP0B2L1 type=write size=900828 2024-09-12T17:05:09.549 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.543+0000 7f026be9d8c0 1 < completed write operation key=JJMEQ2O00SA2 tag=M2HR9ZQK4OL7 type=write size=188708 2024-09-12T17:05:09.553 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.547+0000 7f026be9d8c0 1 > prepared operation key=XNBE2II106VZ tag=K0LD65F5YVMZ type=del size=1103146 2024-09-12T17:05:09.556 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.551+0000 7f026be9d8c0 1 < completed delete operation key=L194KQIPFLE1 tag=63N9TZ7MOPAJ type=del 2024-09-12T17:05:09.560 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.555+0000 7f026be9d8c0 1 > prepared operation key=Z183NH6R676V tag=LY94UM4AGGJ7 type=del size=4137795 2024-09-12T17:05:09.567 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.563+0000 7f026be9d8c0 1 < suggested update operation key=4U1W97V0OX11 tag=H22FHHS974PA type=del size=2047113 2024-09-12T17:05:09.571 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.567+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=VRLRZMEF0X1Q type=del size=2464641 2024-09-12T17:05:09.575 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.571+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~5GN4RU3UOYHO.0 size=1008223 2024-09-12T17:05:09.581 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.575+0000 7f026be9d8c0 1 < completed multipart upload key=4G3BKGNT3YZC upload=5GN4RU3UOYHO tag=23EYXFK62YHX type=write size=2056799 2024-09-12T17:05:09.585 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.579+0000 7f026be9d8c0 1 > prepared operation key=SL2446KSB531 tag=TGEZVP0J60WR type=write size=181746 2024-09-12T17:05:09.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.583+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~GL8FWCODU0ZW.0 size=1048576 2024-09-12T17:05:09.591 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.587+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~GL8FWCODU0ZW.1 size=1048576 2024-09-12T17:05:09.594 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.591+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~GL8FWCODU0ZW.2 size=830918 2024-09-12T17:05:09.600 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.595+0000 7f026be9d8c0 1 < completed multipart upload key=4G3BKGNT3YZC upload=GL8FWCODU0ZW tag=XYBYDVA04VCA type=write size=3976646 2024-09-12T17:05:09.603 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.599+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=2G1WLIWTSRIO type=del size=493104 2024-09-12T17:05:09.607 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.603+0000 7f026be9d8c0 1 < canceled operation key=ALFGNC1YNROX tag=0EN6H9ECKB5W type=write size=848816 2024-09-12T17:05:09.614 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.607+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~ZJNH6GKP1YTI.0 size=1048576 2024-09-12T17:05:09.616 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.611+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~ZJNH6GKP1YTI.1 size=884548 2024-09-12T17:05:09.616 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.611+0000 7f026be9d8c0 1 > prepared multipart upload key=J8MU1A0CWSAQ upload=ZJNH6GKP1YTI tag=1GZHMV14ML1Q type=write size=2981700 2024-09-12T17:05:09.620 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.615+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~NG7HW2L63BQS.0 size=1048576 2024-09-12T17:05:09.623 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.619+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~NG7HW2L63BQS.1 size=34708 2024-09-12T17:05:09.629 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.623+0000 7f026be9d8c0 1 < completed multipart upload key=GPUFWJ3AWEMX upload=NG7HW2L63BQS tag=OLRW0PDGYYA6 type=write size=2131860 2024-09-12T17:05:09.635 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.631+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~D2HB7LWS7M8M.0 size=1048576 2024-09-12T17:05:09.637 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.631+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~D2HB7LWS7M8M.1 size=166691 2024-09-12T17:05:09.637 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.631+0000 7f026be9d8c0 1 > prepared multipart upload key=XLKR6P8RNRVO upload=D2HB7LWS7M8M tag=8IYS8R5SAUG8 type=write size=2263843 2024-09-12T17:05:09.641 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.635+0000 7f026be9d8c0 1 < completed delete operation key=XNBE2II106VZ tag=MZ2WPCKUB1OM type=del 2024-09-12T17:05:09.644 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.639+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=5WDL54HIUETI type=del size=93015 2024-09-12T17:05:09.648 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.643+0000 7f026be9d8c0 1 < completed delete operation key=UU88OS653L8D tag=XABFCAKHS0T2 type=del 2024-09-12T17:05:09.651 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.647+0000 7f026be9d8c0 1 > prepared operation key=T6QRDTQRHBPI tag=T1016XVB1OSX type=del size=3814394 2024-09-12T17:05:09.655 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.651+0000 7f026be9d8c0 1 < completed delete operation key=Y27CDEOCM7DH tag=QXX4YG3QGHI3 type=del 2024-09-12T17:05:09.660 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.655+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~EYHFHD2NRXNJ.0 size=1048576 2024-09-12T17:05:09.663 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.659+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~EYHFHD2NRXNJ.1 size=219762 2024-09-12T17:05:09.663 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.659+0000 7f026be9d8c0 1 > prepared multipart upload key=Y27CDEOCM7DH upload=EYHFHD2NRXNJ tag=MMKJCN3X7BLZ type=write size=2316914 2024-09-12T17:05:09.666 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.663+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~BLN54I9Z39YY.0 size=1048576 2024-09-12T17:05:09.668 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.663+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~BLN54I9Z39YY.1 size=1048576 2024-09-12T17:05:09.671 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.667+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~BLN54I9Z39YY.2 size=104859 2024-09-12T17:05:09.676 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.671+0000 7f026be9d8c0 1 < completed multipart upload key=J8MU1A0CWSAQ upload=BLN54I9Z39YY tag=L5J7CSFUSW37 type=write size=3250587 2024-09-12T17:05:09.682 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.679+0000 7f026be9d8c0 1 > prepared part key=_multipart_RBNN03IPZ8BT.2~GJCWX8FXMIAK.0 size=1048576 2024-09-12T17:05:09.684 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.679+0000 7f026be9d8c0 1 > prepared part key=_multipart_RBNN03IPZ8BT.2~GJCWX8FXMIAK.1 size=1048576 2024-09-12T17:05:09.686 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.683+0000 7f026be9d8c0 1 > prepared part key=_multipart_RBNN03IPZ8BT.2~GJCWX8FXMIAK.2 size=832424 2024-09-12T17:05:09.687 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.683+0000 7f026be9d8c0 1 > prepared multipart upload key=RBNN03IPZ8BT upload=GJCWX8FXMIAK tag=39G3RN5PNTIV type=write size=3978152 2024-09-12T17:05:09.690 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.687+0000 7f026be9d8c0 1 < completed write operation key=SL2446KSB531 tag=4X1UWI93YV8I type=write size=276876 2024-09-12T17:05:09.693 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.687+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=B17RA1VR4BS7 type=write size=588735 2024-09-12T17:05:09.696 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.691+0000 7f026be9d8c0 1 < completed delete operation key=SGT8IC1GJ3IG tag=DZA2HTKVB0LI type=del 2024-09-12T17:05:09.699 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.695+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=T7SY6BCRXLCW type=write size=189437 2024-09-12T17:05:09.703 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.699+0000 7f026be9d8c0 1 < completed delete operation key=U8W1SAVSLTBF tag=G2PMDLSKQT6M type=del 2024-09-12T17:05:09.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.703+0000 7f026be9d8c0 1 > prepared part key=_multipart_3JADN360QEO3.2~OLHR7FCWDBL9.0 size=1048576 2024-09-12T17:05:09.711 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.707+0000 7f026be9d8c0 1 > prepared part key=_multipart_3JADN360QEO3.2~OLHR7FCWDBL9.1 size=60544 2024-09-12T17:05:09.711 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.707+0000 7f026be9d8c0 1 > prepared multipart upload key=3JADN360QEO3 upload=OLHR7FCWDBL9 tag=ZF13ZBYD528F type=write size=2157696 2024-09-12T17:05:09.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.715+0000 7f026be9d8c0 1 < suggested remove operation key=SO3HLQZA8B6B tag=OZ9WRCR2BGWL type=del 2024-09-12T17:05:09.722 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.719+0000 7f026be9d8c0 1 > prepared operation key=GPUFWJ3AWEMX tag=1HWA8IXURA5B type=write size=532198 2024-09-12T17:05:09.726 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.723+0000 7f026be9d8c0 1 < completed write operation key=JJMEQ2O00SA2 tag=GZ205YP0B2L1 type=write size=900828 2024-09-12T17:05:09.735 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.731+0000 7f026be9d8c0 1 > prepared operation key=32XUMOWT8HO2 tag=VBCVEN82V4RC type=write size=647083 2024-09-12T17:05:09.739 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.735+0000 7f026be9d8c0 1 < completed delete operation key=XNBE2II106VZ tag=K0LD65F5YVMZ type=del 2024-09-12T17:05:09.743 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.739+0000 7f026be9d8c0 1 > prepared operation key=ALFGNC1YNROX tag=ABTE71420E6H type=del size=3232554 2024-09-12T17:05:09.746 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.743+0000 7f026be9d8c0 1 < completed delete operation key=Z183NH6R676V tag=LY94UM4AGGJ7 type=del 2024-09-12T17:05:09.749 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.743+0000 7f026be9d8c0 1 > prepared operation key=MVYWUWKSYQ9Z tag=WQOJ9EC8JEW3 type=del size=1028225 2024-09-12T17:05:09.755 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.751+0000 7f026be9d8c0 1 < suggested update operation key=21ZD52VBZIO4 tag=VRLRZMEF0X1Q type=del size=2464641 2024-09-12T17:05:09.758 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.755+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=OSUU8AQQIPZ5 type=del size=353321 2024-09-12T17:05:09.761 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.755+0000 7f026be9d8c0 1 < canceled operation key=SL2446KSB531 tag=TGEZVP0J60WR type=write size=181746 2024-09-12T17:05:09.765 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.759+0000 7f026be9d8c0 1 > prepared operation key=Z9YNIEQCVNBA tag=PRPVV82KL0T6 type=del size=2870486 2024-09-12T17:05:09.767 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.763+0000 7f026be9d8c0 1 < completed delete operation key=3JADN360QEO3 tag=2G1WLIWTSRIO type=del 2024-09-12T17:05:09.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.767+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~PE3TLMV7TW8Q.0 size=808874 2024-09-12T17:05:09.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.767+0000 7f026be9d8c0 1 > prepared multipart upload key=2BQJ30RQQ25L upload=PE3TLMV7TW8Q tag=C6YLLSZTWLMR type=write size=1857450 2024-09-12T17:05:09.776 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.771+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~ZJNH6GKP1YTI.0 size=1048576 2024-09-12T17:05:09.778 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.775+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~ZJNH6GKP1YTI.1 size=884548 2024-09-12T17:05:09.783 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.779+0000 7f026be9d8c0 1 < completed multipart upload key=J8MU1A0CWSAQ upload=ZJNH6GKP1YTI tag=1GZHMV14ML1Q type=write size=2981700 2024-09-12T17:05:09.789 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.783+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~MNS3R585CHM6.0 size=1048576 2024-09-12T17:05:09.791 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.787+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~MNS3R585CHM6.1 size=1048576 2024-09-12T17:05:09.794 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.791+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~MNS3R585CHM6.2 size=105789 2024-09-12T17:05:09.794 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.791+0000 7f026be9d8c0 1 > prepared multipart upload key=XLKR6P8RNRVO upload=MNS3R585CHM6 tag=5CZE5KWTTVZH type=write size=3251517 2024-09-12T17:05:09.797 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.791+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~D2HB7LWS7M8M.0 size=1048576 2024-09-12T17:05:09.800 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.795+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~D2HB7LWS7M8M.1 size=166691 2024-09-12T17:05:09.805 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.799+0000 7f026be9d8c0 1 < completed multipart upload key=XLKR6P8RNRVO upload=D2HB7LWS7M8M tag=8IYS8R5SAUG8 type=write size=2263843 2024-09-12T17:05:09.808 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.803+0000 7f026be9d8c0 1 > prepared operation key=ALFGNC1YNROX tag=B2P8UVM3R2X7 type=del size=3979981 2024-09-12T17:05:09.815 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.811+0000 7f026be9d8c0 1 < canceled operation key=3JADN360QEO3 tag=5WDL54HIUETI type=del size=93015 2024-09-12T17:05:09.818 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.815+0000 7f026be9d8c0 1 > prepared operation key=L194KQIPFLE1 tag=KQ7LB9R05HGR type=del size=3184400 2024-09-12T17:05:09.824 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.819+0000 7f026be9d8c0 1 < suggested remove operation key=T6QRDTQRHBPI tag=T1016XVB1OSX type=del 2024-09-12T17:05:09.830 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.823+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~EIV355NI6F0T.0 size=362560 2024-09-12T17:05:09.830 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.823+0000 7f026be9d8c0 1 > prepared multipart upload key=BW1T21LBUE2D upload=EIV355NI6F0T tag=Y3AVT4QYSVS3 type=write size=1411136 2024-09-12T17:05:09.833 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.827+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~EYHFHD2NRXNJ.0 size=1048576 2024-09-12T17:05:09.836 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.831+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~EYHFHD2NRXNJ.1 size=219762 2024-09-12T17:05:09.840 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.835+0000 7f026be9d8c0 1 < completed multipart upload key=Y27CDEOCM7DH upload=EYHFHD2NRXNJ tag=MMKJCN3X7BLZ type=write size=2316914 2024-09-12T17:05:09.846 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.843+0000 7f026be9d8c0 1 > prepared part key=_multipart_L194KQIPFLE1.2~1W1INQOJR92W.0 size=1048576 2024-09-12T17:05:09.848 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.843+0000 7f026be9d8c0 1 > prepared part key=_multipart_L194KQIPFLE1.2~1W1INQOJR92W.1 size=1048576 2024-09-12T17:05:09.851 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.847+0000 7f026be9d8c0 1 > prepared part key=_multipart_L194KQIPFLE1.2~1W1INQOJR92W.2 size=464688 2024-09-12T17:05:09.851 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.847+0000 7f026be9d8c0 1 > prepared multipart upload key=L194KQIPFLE1 upload=1W1INQOJR92W tag=QPG6M4B8A8FX type=write size=3610416 2024-09-12T17:05:09.851 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.847+0000 7f026be9d8c0 1 < canceled part key=_multipart_RBNN03IPZ8BT.2~GJCWX8FXMIAK.0 size=1048576 2024-09-12T17:05:09.854 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.851+0000 7f026be9d8c0 1 < completed part key=_multipart_RBNN03IPZ8BT.2~GJCWX8FXMIAK.1 size=1048576 2024-09-12T17:05:09.856 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.851+0000 7f026be9d8c0 1 < completed part key=_multipart_RBNN03IPZ8BT.2~GJCWX8FXMIAK.2 size=832424 2024-09-12T17:05:09.861 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.855+0000 7f026be9d8c0 1 < canceled multipart upload key=RBNN03IPZ8BT upload=GJCWX8FXMIAK tag=39G3RN5PNTIV type=write size=3978152 2024-09-12T17:05:09.867 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.863+0000 7f026be9d8c0 1 > prepared part key=_multipart_BBYDPSXZKHZP.2~ND95HPHX851P.0 size=1048576 2024-09-12T17:05:09.869 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.863+0000 7f026be9d8c0 1 > prepared part key=_multipart_BBYDPSXZKHZP.2~ND95HPHX851P.1 size=1048576 2024-09-12T17:05:09.871 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.867+0000 7f026be9d8c0 1 > prepared part key=_multipart_BBYDPSXZKHZP.2~ND95HPHX851P.2 size=244748 2024-09-12T17:05:09.871 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.867+0000 7f026be9d8c0 1 > prepared multipart upload key=BBYDPSXZKHZP upload=ND95HPHX851P tag=AGEPGEPAV728 type=write size=3390476 2024-09-12T17:05:09.875 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.871+0000 7f026be9d8c0 1 < completed write operation key=U8W1SAVSLTBF tag=B17RA1VR4BS7 type=write size=588735 2024-09-12T17:05:09.878 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.875+0000 7f026be9d8c0 1 > prepared operation key=GPUFWJ3AWEMX tag=2T7BE7U9GHZA type=write size=554637 2024-09-12T17:05:09.885 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.879+0000 7f026be9d8c0 1 < suggested update operation key=21ZD52VBZIO4 tag=T7SY6BCRXLCW type=write size=189437 2024-09-12T17:05:09.891 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.887+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~J1O3543OU46C.0 size=325850 2024-09-12T17:05:09.891 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.887+0000 7f026be9d8c0 1 > prepared multipart upload key=Z9YNIEQCVNBA upload=J1O3543OU46C tag=LVGGNSGOV17I type=write size=1374426 2024-09-12T17:05:09.894 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.891+0000 7f026be9d8c0 1 < completed part key=_multipart_3JADN360QEO3.2~OLHR7FCWDBL9.0 size=1048576 2024-09-12T17:05:09.894 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.891+0000 7f026be9d8c0 1 < canceled part key=_multipart_3JADN360QEO3.2~OLHR7FCWDBL9.1 size=60544 2024-09-12T17:05:09.899 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.895+0000 7f026be9d8c0 1 < canceled multipart upload key=3JADN360QEO3 upload=OLHR7FCWDBL9 tag=ZF13ZBYD528F type=write size=2157696 2024-09-12T17:05:09.903 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.899+0000 7f026be9d8c0 1 > prepared operation key=XNBE2II106VZ tag=6HXYC24N23JF type=del size=2234118 2024-09-12T17:05:09.906 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.903+0000 7f026be9d8c0 1 < completed write operation key=GPUFWJ3AWEMX tag=1HWA8IXURA5B type=write size=532198 2024-09-12T17:05:09.912 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.907+0000 7f026be9d8c0 1 > prepared part key=_multipart_PQSQ39X3O64P.2~UI3LX6B9ZS7Z.0 size=1048576 2024-09-12T17:05:09.915 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.911+0000 7f026be9d8c0 1 > prepared part key=_multipart_PQSQ39X3O64P.2~UI3LX6B9ZS7Z.1 size=1048576 2024-09-12T17:05:09.917 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.911+0000 7f026be9d8c0 1 > prepared part key=_multipart_PQSQ39X3O64P.2~UI3LX6B9ZS7Z.2 size=116498 2024-09-12T17:05:09.918 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.911+0000 7f026be9d8c0 1 > prepared multipart upload key=PQSQ39X3O64P upload=UI3LX6B9ZS7Z tag=RLXMWY9L9BTA type=write size=3262226 2024-09-12T17:05:09.921 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.915+0000 7f026be9d8c0 1 < completed write operation key=32XUMOWT8HO2 tag=VBCVEN82V4RC type=write size=647083 2024-09-12T17:05:09.926 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.923+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~EOE3GQUPC1OO.0 size=1048576 2024-09-12T17:05:09.928 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.923+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~EOE3GQUPC1OO.1 size=100838 2024-09-12T17:05:09.929 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.923+0000 7f026be9d8c0 1 > prepared multipart upload key=QVQ4TI319DH5 upload=EOE3GQUPC1OO tag=QP2UOYFFBKFX type=write size=2197990 2024-09-12T17:05:09.932 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.927+0000 7f026be9d8c0 1 < completed delete operation key=ALFGNC1YNROX tag=ABTE71420E6H type=del 2024-09-12T17:05:09.935 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.931+0000 7f026be9d8c0 1 > prepared operation key=PQSQ39X3O64P tag=G29JHGZI01YW type=del size=2609702 2024-09-12T17:05:09.938 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.935+0000 7f026be9d8c0 1 < completed delete operation key=MVYWUWKSYQ9Z tag=WQOJ9EC8JEW3 type=del 2024-09-12T17:05:09.941 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.935+0000 7f026be9d8c0 1 > prepared operation key=2BQJ30RQQ25L tag=IJKLDSFQBXL4 type=del size=2030280 2024-09-12T17:05:09.945 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.939+0000 7f026be9d8c0 1 < completed delete operation key=U8W1SAVSLTBF tag=OSUU8AQQIPZ5 type=del 2024-09-12T17:05:09.949 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.943+0000 7f026be9d8c0 1 > prepared operation key=8AFDAVJLMRD2 tag=W7H9TXQNHO2P type=del size=2249062 2024-09-12T17:05:09.951 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.947+0000 7f026be9d8c0 1 < completed delete operation key=Z9YNIEQCVNBA tag=PRPVV82KL0T6 type=del 2024-09-12T17:05:09.954 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.947+0000 7f026be9d8c0 1 > prepared operation key=2BQJ30RQQ25L tag=AHGQVVLNURNT type=del size=1884120 2024-09-12T17:05:09.957 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.951+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~PE3TLMV7TW8Q.0 size=808874 2024-09-12T17:05:09.962 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.959+0000 7f026be9d8c0 1 < completed multipart upload key=2BQJ30RQQ25L upload=PE3TLMV7TW8Q tag=C6YLLSZTWLMR type=write size=1857450 2024-09-12T17:05:09.966 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.963+0000 7f026be9d8c0 1 > prepared operation key=E0Y3SKNUYCQS tag=1A6B0HWLP6XS type=del size=3699743 2024-09-12T17:05:09.969 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.963+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~MNS3R585CHM6.0 size=1048576 2024-09-12T17:05:09.972 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.967+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~MNS3R585CHM6.1 size=1048576 2024-09-12T17:05:09.975 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.971+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~MNS3R585CHM6.2 size=105789 2024-09-12T17:05:09.981 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.975+0000 7f026be9d8c0 1 < completed multipart upload key=XLKR6P8RNRVO upload=MNS3R585CHM6 tag=5CZE5KWTTVZH type=write size=3251517 2024-09-12T17:05:09.984 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.979+0000 7f026be9d8c0 1 > prepared operation key=XLKR6P8RNRVO tag=EVSP7OQ4Y34Q type=del size=2444524 2024-09-12T17:05:09.987 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.983+0000 7f026be9d8c0 1 < completed delete operation key=ALFGNC1YNROX tag=B2P8UVM3R2X7 type=del 2024-09-12T17:05:09.994 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.987+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~4OLSRXU9QIB7.0 size=1048576 2024-09-12T17:05:09.996 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.991+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~4OLSRXU9QIB7.1 size=7193 2024-09-12T17:05:09.996 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.991+0000 7f026be9d8c0 1 > prepared multipart upload key=8AFDAVJLMRD2 upload=4OLSRXU9QIB7 tag=J181XAGCNL3G type=write size=2104345 2024-09-12T17:05:10.000 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.995+0000 7f026be9d8c0 1 < completed delete operation key=L194KQIPFLE1 tag=KQ7LB9R05HGR type=del 2024-09-12T17:05:10.004 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:09.999+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=JMGIVB5H0JOU type=del size=14493 2024-09-12T17:05:10.007 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.003+0000 7f026be9d8c0 1 < completed part key=_multipart_BW1T21LBUE2D.2~EIV355NI6F0T.0 size=362560 2024-09-12T17:05:10.013 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.007+0000 7f026be9d8c0 1 < completed multipart upload key=BW1T21LBUE2D upload=EIV355NI6F0T tag=Y3AVT4QYSVS3 type=write size=1411136 2024-09-12T17:05:10.016 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.011+0000 7f026be9d8c0 1 > prepared operation key=4U1W97V0OX11 tag=C5LWNLYTAPCI type=del size=1374797 2024-09-12T17:05:10.019 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.015+0000 7f026be9d8c0 1 < completed part key=_multipart_L194KQIPFLE1.2~1W1INQOJR92W.0 size=1048576 2024-09-12T17:05:10.021 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.015+0000 7f026be9d8c0 1 < completed part key=_multipart_L194KQIPFLE1.2~1W1INQOJR92W.1 size=1048576 2024-09-12T17:05:10.024 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.019+0000 7f026be9d8c0 1 < completed part key=_multipart_L194KQIPFLE1.2~1W1INQOJR92W.2 size=464688 2024-09-12T17:05:10.030 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.023+0000 7f026be9d8c0 1 < completed multipart upload key=L194KQIPFLE1 upload=1W1INQOJR92W tag=QPG6M4B8A8FX type=write size=3610416 2024-09-12T17:05:10.033 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.027+0000 7f026be9d8c0 1 > prepared operation key=QVQ4TI319DH5 tag=OCCBE1RFQD10 type=del size=1937740 2024-09-12T17:05:10.036 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.031+0000 7f026be9d8c0 1 < completed part key=_multipart_BBYDPSXZKHZP.2~ND95HPHX851P.0 size=1048576 2024-09-12T17:05:10.038 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.035+0000 7f026be9d8c0 1 < completed part key=_multipart_BBYDPSXZKHZP.2~ND95HPHX851P.1 size=1048576 2024-09-12T17:05:10.041 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.035+0000 7f026be9d8c0 1 < completed part key=_multipart_BBYDPSXZKHZP.2~ND95HPHX851P.2 size=244748 2024-09-12T17:05:10.046 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.043+0000 7f026be9d8c0 1 < completed multipart upload key=BBYDPSXZKHZP upload=ND95HPHX851P tag=AGEPGEPAV728 type=write size=3390476 2024-09-12T17:05:10.052 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.047+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~MHK2CVCMF3ZI.0 size=1048576 2024-09-12T17:05:10.054 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.051+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~MHK2CVCMF3ZI.1 size=207861 2024-09-12T17:05:10.055 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.051+0000 7f026be9d8c0 1 > prepared multipart upload key=UU88OS653L8D upload=MHK2CVCMF3ZI tag=HTRBE8ZCR7LD type=write size=2305013 2024-09-12T17:05:10.058 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.055+0000 7f026be9d8c0 1 < completed write operation key=GPUFWJ3AWEMX tag=2T7BE7U9GHZA type=write size=554637 2024-09-12T17:05:10.061 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.055+0000 7f026be9d8c0 1 > prepared operation key=SGT8IC1GJ3IG tag=BDDL4VIYCOO5 type=del size=1234093 2024-09-12T17:05:10.064 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.059+0000 7f026be9d8c0 1 < completed part key=_multipart_Z9YNIEQCVNBA.2~J1O3543OU46C.0 size=325850 2024-09-12T17:05:10.070 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.063+0000 7f026be9d8c0 1 < completed multipart upload key=Z9YNIEQCVNBA upload=J1O3543OU46C tag=LVGGNSGOV17I type=write size=1374426 2024-09-12T17:05:10.072 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.067+0000 7f026be9d8c0 1 > prepared operation key=ALFGNC1YNROX tag=11P4PEZ6RFGA type=del size=3293960 2024-09-12T17:05:10.076 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.071+0000 7f026be9d8c0 1 < completed delete operation key=XNBE2II106VZ tag=6HXYC24N23JF type=del 2024-09-12T17:05:10.082 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.079+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~6BJ25QUM9Z3K.0 size=1048576 2024-09-12T17:05:10.085 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.079+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~6BJ25QUM9Z3K.1 size=1048576 2024-09-12T17:05:10.087 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.083+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~6BJ25QUM9Z3K.2 size=435675 2024-09-12T17:05:10.087 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.083+0000 7f026be9d8c0 1 > prepared multipart upload key=ALFGNC1YNROX upload=6BJ25QUM9Z3K tag=JPJHXAIUS1DP type=write size=3581403 2024-09-12T17:05:10.088 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.083+0000 7f026be9d8c0 1 < canceled part key=_multipart_PQSQ39X3O64P.2~UI3LX6B9ZS7Z.0 size=1048576 2024-09-12T17:05:10.090 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.087+0000 7f026be9d8c0 1 < completed part key=_multipart_PQSQ39X3O64P.2~UI3LX6B9ZS7Z.1 size=1048576 2024-09-12T17:05:10.093 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.087+0000 7f026be9d8c0 1 < completed part key=_multipart_PQSQ39X3O64P.2~UI3LX6B9ZS7Z.2 size=116498 2024-09-12T17:05:10.099 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.095+0000 7f026be9d8c0 1 < canceled multipart upload key=PQSQ39X3O64P upload=UI3LX6B9ZS7Z tag=RLXMWY9L9BTA type=write size=3262226 2024-09-12T17:05:10.105 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.099+0000 7f026be9d8c0 1 > prepared part key=_multipart_MVYWUWKSYQ9Z.2~PDAR2F4OWZ5X.0 size=931961 2024-09-12T17:05:10.105 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.099+0000 7f026be9d8c0 1 > prepared multipart upload key=MVYWUWKSYQ9Z upload=PDAR2F4OWZ5X tag=XSK4Z6KC2128 type=write size=1980537 2024-09-12T17:05:10.113 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.107+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~EOE3GQUPC1OO.0 size=1048576 2024-09-12T17:05:10.116 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.111+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~EOE3GQUPC1OO.1 size=100838 2024-09-12T17:05:10.122 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.115+0000 7f026be9d8c0 1 < completed multipart upload key=QVQ4TI319DH5 upload=EOE3GQUPC1OO tag=QP2UOYFFBKFX type=write size=2197990 2024-09-12T17:05:10.128 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.123+0000 7f026be9d8c0 1 > prepared part key=_multipart_T6QRDTQRHBPI.2~R2JR4EUZ3ECW.0 size=915934 2024-09-12T17:05:10.128 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.123+0000 7f026be9d8c0 1 > prepared multipart upload key=T6QRDTQRHBPI upload=R2JR4EUZ3ECW tag=YDWLCZUA264A type=write size=1964510 2024-09-12T17:05:10.131 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.127+0000 7f026be9d8c0 1 < completed delete operation key=PQSQ39X3O64P tag=G29JHGZI01YW type=del 2024-09-12T17:05:10.135 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.131+0000 7f026be9d8c0 1 > prepared operation key=JJMEQ2O00SA2 tag=P7KQZNV90M6Q type=write size=333209 2024-09-12T17:05:10.138 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.135+0000 7f026be9d8c0 1 < completed delete operation key=2BQJ30RQQ25L tag=IJKLDSFQBXL4 type=del 2024-09-12T17:05:10.143 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.139+0000 7f026be9d8c0 1 > prepared operation key=4G3BKGNT3YZC tag=1KOV3033VR1W type=del size=755716 2024-09-12T17:05:10.147 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.143+0000 7f026be9d8c0 1 < completed delete operation key=8AFDAVJLMRD2 tag=W7H9TXQNHO2P type=del 2024-09-12T17:05:10.151 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.147+0000 7f026be9d8c0 1 > prepared operation key=BW1T21LBUE2D tag=SRMWSZVTTLP5 type=del size=3395463 2024-09-12T17:05:10.155 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.151+0000 7f026be9d8c0 1 < completed delete operation key=2BQJ30RQQ25L tag=AHGQVVLNURNT type=del 2024-09-12T17:05:10.160 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.155+0000 7f026be9d8c0 1 > prepared operation key=GPUFWJ3AWEMX tag=66MCNA035WZG type=del size=2560016 2024-09-12T17:05:10.169 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.163+0000 7f026be9d8c0 1 < suggested remove operation key=E0Y3SKNUYCQS tag=1A6B0HWLP6XS type=del 2024-09-12T17:05:10.177 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.171+0000 7f026be9d8c0 1 > prepared part key=_multipart_PQSQ39X3O64P.2~D4MP2USJ0ECX.0 size=798986 2024-09-12T17:05:10.177 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.171+0000 7f026be9d8c0 1 > prepared multipart upload key=PQSQ39X3O64P upload=D4MP2USJ0ECX tag=QIQGODXLSYO0 type=write size=1847562 2024-09-12T17:05:10.181 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.175+0000 7f026be9d8c0 1 < completed delete operation key=XLKR6P8RNRVO tag=EVSP7OQ4Y34Q type=del 2024-09-12T17:05:10.184 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.179+0000 7f026be9d8c0 1 > prepared operation key=Z183NH6R676V tag=S9MOF5L06V5B type=del size=312498 2024-09-12T17:05:10.188 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.183+0000 7f026be9d8c0 1 < completed part key=_multipart_8AFDAVJLMRD2.2~4OLSRXU9QIB7.0 size=1048576 2024-09-12T17:05:10.191 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.187+0000 7f026be9d8c0 1 < completed part key=_multipart_8AFDAVJLMRD2.2~4OLSRXU9QIB7.1 size=7193 2024-09-12T17:05:10.197 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.191+0000 7f026be9d8c0 1 < completed multipart upload key=8AFDAVJLMRD2 upload=4OLSRXU9QIB7 tag=J181XAGCNL3G type=write size=2104345 2024-09-12T17:05:10.204 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.199+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~R1H09EQLAC89.0 size=1048576 2024-09-12T17:05:10.206 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.203+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~R1H09EQLAC89.1 size=414587 2024-09-12T17:05:10.207 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.203+0000 7f026be9d8c0 1 > prepared multipart upload key=JJMEQ2O00SA2 upload=R1H09EQLAC89 tag=ID2CKNK0J08G type=write size=2511739 2024-09-12T17:05:10.213 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.207+0000 7f026be9d8c0 1 < suggested update operation key=21ZD52VBZIO4 tag=JMGIVB5H0JOU type=del size=14493 2024-09-12T17:05:10.220 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.215+0000 7f026be9d8c0 1 > prepared part key=_multipart_21ZD52VBZIO4.2~NUF9CEW0TG79.0 size=1048576 2024-09-12T17:05:10.223 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.219+0000 7f026be9d8c0 1 > prepared part key=_multipart_21ZD52VBZIO4.2~NUF9CEW0TG79.1 size=975590 2024-09-12T17:05:10.223 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.219+0000 7f026be9d8c0 1 > prepared multipart upload key=21ZD52VBZIO4 upload=NUF9CEW0TG79 tag=3937LAD7J3KX type=write size=3072742 2024-09-12T17:05:10.226 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.223+0000 7f026be9d8c0 1 < completed delete operation key=4U1W97V0OX11 tag=C5LWNLYTAPCI type=del 2024-09-12T17:05:10.232 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.227+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~46N81A401WUR.0 size=1048576 2024-09-12T17:05:10.235 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.231+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~46N81A401WUR.1 size=234170 2024-09-12T17:05:10.235 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.231+0000 7f026be9d8c0 1 > prepared multipart upload key=QVQ4TI319DH5 upload=46N81A401WUR tag=OBN3OQ8XBDKK type=write size=2331322 2024-09-12T17:05:10.238 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.231+0000 7f026be9d8c0 1 < completed delete operation key=QVQ4TI319DH5 tag=OCCBE1RFQD10 type=del 2024-09-12T17:05:10.241 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.235+0000 7f026be9d8c0 1 > prepared operation key=6VO85REZG2NW tag=57GCJSJBOWBB type=del size=1194139 2024-09-12T17:05:10.245 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.239+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~MHK2CVCMF3ZI.0 size=1048576 2024-09-12T17:05:10.247 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.243+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~MHK2CVCMF3ZI.1 size=207861 2024-09-12T17:05:10.253 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.247+0000 7f026be9d8c0 1 < completed multipart upload key=UU88OS653L8D upload=MHK2CVCMF3ZI tag=HTRBE8ZCR7LD type=write size=2305013 2024-09-12T17:05:10.256 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.251+0000 7f026be9d8c0 1 > prepared operation key=J8MU1A0CWSAQ tag=9W6CDH3TQQ7B type=del size=1405159 2024-09-12T17:05:10.259 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.255+0000 7f026be9d8c0 1 < completed delete operation key=SGT8IC1GJ3IG tag=BDDL4VIYCOO5 type=del 2024-09-12T17:05:10.263 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.259+0000 7f026be9d8c0 1 > prepared operation key=BBYDPSXZKHZP tag=EBMCFXNLX2EQ type=del size=876164 2024-09-12T17:05:10.266 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.263+0000 7f026be9d8c0 1 < canceled operation key=ALFGNC1YNROX tag=11P4PEZ6RFGA type=del size=3293960 2024-09-12T17:05:10.270 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.263+0000 7f026be9d8c0 1 > prepared operation key=QVQ4TI319DH5 tag=57DEERJ5DDAB type=del size=2032045 2024-09-12T17:05:10.273 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.267+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~6BJ25QUM9Z3K.0 size=1048576 2024-09-12T17:05:10.276 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.271+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~6BJ25QUM9Z3K.1 size=1048576 2024-09-12T17:05:10.279 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.275+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~6BJ25QUM9Z3K.2 size=435675 2024-09-12T17:05:10.285 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.279+0000 7f026be9d8c0 1 < completed multipart upload key=ALFGNC1YNROX upload=6BJ25QUM9Z3K tag=JPJHXAIUS1DP type=write size=3581403 2024-09-12T17:05:10.287 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.283+0000 7f026be9d8c0 1 > prepared operation key=XLKR6P8RNRVO tag=3JJ5OSW1E93T type=del size=3721544 2024-09-12T17:05:10.291 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.287+0000 7f026be9d8c0 1 < completed part key=_multipart_MVYWUWKSYQ9Z.2~PDAR2F4OWZ5X.0 size=931961 2024-09-12T17:05:10.296 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.291+0000 7f026be9d8c0 1 < completed multipart upload key=MVYWUWKSYQ9Z upload=PDAR2F4OWZ5X tag=XSK4Z6KC2128 type=write size=1980537 2024-09-12T17:05:10.300 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.295+0000 7f026be9d8c0 1 > prepared operation key=SO3HLQZA8B6B tag=67Z6U3GWSV0I type=del size=3441484 2024-09-12T17:05:10.303 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.299+0000 7f026be9d8c0 1 < completed part key=_multipart_T6QRDTQRHBPI.2~R2JR4EUZ3ECW.0 size=915934 2024-09-12T17:05:10.308 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.303+0000 7f026be9d8c0 1 < completed multipart upload key=T6QRDTQRHBPI upload=R2JR4EUZ3ECW tag=YDWLCZUA264A type=write size=1964510 2024-09-12T17:05:10.315 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.311+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~A9426FYJZON3.0 size=1048576 2024-09-12T17:05:10.317 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.311+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~A9426FYJZON3.1 size=1048576 2024-09-12T17:05:10.319 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.315+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~A9426FYJZON3.2 size=716111 2024-09-12T17:05:10.319 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.315+0000 7f026be9d8c0 1 > prepared multipart upload key=GPUFWJ3AWEMX upload=A9426FYJZON3 tag=HLO5CUT9IWEX type=write size=3861839 2024-09-12T17:05:10.322 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.319+0000 7f026be9d8c0 1 < completed write operation key=JJMEQ2O00SA2 tag=P7KQZNV90M6Q type=write size=333209 2024-09-12T17:05:10.326 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.323+0000 7f026be9d8c0 1 > prepared operation key=XNBE2II106VZ tag=U3I73I9W3111 type=del size=2895555 2024-09-12T17:05:10.334 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.327+0000 7f026be9d8c0 1 < suggested update operation key=4G3BKGNT3YZC tag=1KOV3033VR1W type=del size=755716 2024-09-12T17:05:10.340 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.335+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~T3C9Z1ABA068.0 size=87136 2024-09-12T17:05:10.340 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.335+0000 7f026be9d8c0 1 > prepared multipart upload key=2BQJ30RQQ25L upload=T3C9Z1ABA068 tag=II80DVFGIPJV type=write size=1135712 2024-09-12T17:05:10.344 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.339+0000 7f026be9d8c0 1 < canceled operation key=BW1T21LBUE2D tag=SRMWSZVTTLP5 type=del size=3395463 2024-09-12T17:05:10.350 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.347+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~208B1B5Y806V.0 size=925184 2024-09-12T17:05:10.350 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.347+0000 7f026be9d8c0 1 > prepared multipart upload key=XLKR6P8RNRVO upload=208B1B5Y806V tag=UFF3ZSXT3N3K type=write size=1973760 2024-09-12T17:05:10.354 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.351+0000 7f026be9d8c0 1 < completed delete operation key=GPUFWJ3AWEMX tag=66MCNA035WZG type=del 2024-09-12T17:05:10.358 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.351+0000 7f026be9d8c0 1 > prepared operation key=PQSQ39X3O64P tag=Q0DMKO819U6J type=write size=747180 2024-09-12T17:05:10.361 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.355+0000 7f026be9d8c0 1 < completed part key=_multipart_PQSQ39X3O64P.2~D4MP2USJ0ECX.0 size=798986 2024-09-12T17:05:10.367 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.363+0000 7f026be9d8c0 1 < completed multipart upload key=PQSQ39X3O64P upload=D4MP2USJ0ECX tag=QIQGODXLSYO0 type=write size=1847562 2024-09-12T17:05:10.371 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.367+0000 7f026be9d8c0 1 > prepared operation key=UU88OS653L8D tag=JD5AM6YCAYZC type=del size=1458036 2024-09-12T17:05:10.375 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.371+0000 7f026be9d8c0 1 < canceled operation key=Z183NH6R676V tag=S9MOF5L06V5B type=del size=312498 2024-09-12T17:05:10.381 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.375+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~PM9O5APTR1VN.0 size=1048576 2024-09-12T17:05:10.384 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.379+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~PM9O5APTR1VN.1 size=19028 2024-09-12T17:05:10.384 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.379+0000 7f026be9d8c0 1 > prepared multipart upload key=Y27CDEOCM7DH upload=PM9O5APTR1VN tag=97B7YY8F4I1S type=write size=2116180 2024-09-12T17:05:10.388 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.383+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~R1H09EQLAC89.0 size=1048576 2024-09-12T17:05:10.388 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.383+0000 7f026be9d8c0 1 < canceled part key=_multipart_JJMEQ2O00SA2.2~R1H09EQLAC89.1 size=414587 2024-09-12T17:05:10.393 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.387+0000 7f026be9d8c0 1 < canceled multipart upload key=JJMEQ2O00SA2 upload=R1H09EQLAC89 tag=ID2CKNK0J08G type=write size=2511739 2024-09-12T17:05:10.400 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.395+0000 7f026be9d8c0 1 > prepared part key=_multipart_PQSQ39X3O64P.2~RV1CT5Z00URJ.0 size=1048576 2024-09-12T17:05:10.402 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.399+0000 7f026be9d8c0 1 > prepared part key=_multipart_PQSQ39X3O64P.2~RV1CT5Z00URJ.1 size=1048576 2024-09-12T17:05:10.405 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.399+0000 7f026be9d8c0 1 > prepared part key=_multipart_PQSQ39X3O64P.2~RV1CT5Z00URJ.2 size=191543 2024-09-12T17:05:10.405 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.399+0000 7f026be9d8c0 1 > prepared multipart upload key=PQSQ39X3O64P upload=RV1CT5Z00URJ tag=BLGS6K746F49 type=write size=3337271 2024-09-12T17:05:10.413 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.403+0000 7f026be9d8c0 1 < completed part key=_multipart_21ZD52VBZIO4.2~NUF9CEW0TG79.0 size=1048576 2024-09-12T17:05:10.413 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.407+0000 7f026be9d8c0 1 < completed part key=_multipart_21ZD52VBZIO4.2~NUF9CEW0TG79.1 size=975590 2024-09-12T17:05:10.418 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.415+0000 7f026be9d8c0 1 < completed multipart upload key=21ZD52VBZIO4 upload=NUF9CEW0TG79 tag=3937LAD7J3KX type=write size=3072742 2024-09-12T17:05:10.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.415+0000 7f026be9d8c0 1 > prepared operation key=MVYWUWKSYQ9Z tag=7I292XF8KTJZ type=del size=3465043 2024-09-12T17:05:10.425 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.419+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~46N81A401WUR.0 size=1048576 2024-09-12T17:05:10.428 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.423+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~46N81A401WUR.1 size=234170 2024-09-12T17:05:10.433 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.427+0000 7f026be9d8c0 1 < completed multipart upload key=QVQ4TI319DH5 upload=46N81A401WUR tag=OBN3OQ8XBDKK type=write size=2331322 2024-09-12T17:05:10.437 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.431+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=2H1PD8DR3H88 type=write size=1014528 2024-09-12T17:05:10.446 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.439+0000 7f026be9d8c0 1 < completed delete operation key=6VO85REZG2NW tag=57GCJSJBOWBB type=del 2024-09-12T17:05:10.450 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.443+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=G2POK8X4UX5N type=del size=4162219 2024-09-12T17:05:10.454 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.447+0000 7f026be9d8c0 1 < completed delete operation key=J8MU1A0CWSAQ tag=9W6CDH3TQQ7B type=del 2024-09-12T17:05:10.461 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.455+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~IDP6YUHJCE3U.0 size=1048576 2024-09-12T17:05:10.463 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.459+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~IDP6YUHJCE3U.1 size=1048576 2024-09-12T17:05:10.466 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.463+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~IDP6YUHJCE3U.2 size=307527 2024-09-12T17:05:10.466 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.463+0000 7f026be9d8c0 1 > prepared multipart upload key=GPUFWJ3AWEMX upload=IDP6YUHJCE3U tag=BU4RYFLOPASY type=write size=3453255 2024-09-12T17:05:10.469 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.463+0000 7f026be9d8c0 1 < completed delete operation key=BBYDPSXZKHZP tag=EBMCFXNLX2EQ type=del 2024-09-12T17:05:10.473 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.467+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=YFCK4EW072XE type=del size=3964849 2024-09-12T17:05:10.476 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.471+0000 7f026be9d8c0 1 < completed delete operation key=QVQ4TI319DH5 tag=57DEERJ5DDAB type=del 2024-09-12T17:05:10.480 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.475+0000 7f026be9d8c0 1 > prepared operation key=MVYWUWKSYQ9Z tag=3LBC3UIKQ9ZS type=write size=962735 2024-09-12T17:05:10.487 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.483+0000 7f026be9d8c0 1 < suggested remove operation key=XLKR6P8RNRVO tag=3JJ5OSW1E93T type=del 2024-09-12T17:05:10.494 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.491+0000 7f026be9d8c0 1 > prepared part key=_multipart_T6QRDTQRHBPI.2~BAVONXLQN9WX.0 size=1048576 2024-09-12T17:05:10.496 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.491+0000 7f026be9d8c0 1 > prepared part key=_multipart_T6QRDTQRHBPI.2~BAVONXLQN9WX.1 size=353973 2024-09-12T17:05:10.497 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.491+0000 7f026be9d8c0 1 > prepared multipart upload key=T6QRDTQRHBPI upload=BAVONXLQN9WX tag=TL774ESB8Z1T type=write size=2451125 2024-09-12T17:05:10.500 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.495+0000 7f026be9d8c0 1 < completed delete operation key=SO3HLQZA8B6B tag=67Z6U3GWSV0I type=del 2024-09-12T17:05:10.504 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.499+0000 7f026be9d8c0 1 > prepared operation key=4G3BKGNT3YZC tag=WR0WW0K7CA5Z type=del size=1473239 2024-09-12T17:05:10.508 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.503+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~A9426FYJZON3.0 size=1048576 2024-09-12T17:05:10.511 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.507+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~A9426FYJZON3.1 size=1048576 2024-09-12T17:05:10.513 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.507+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~A9426FYJZON3.2 size=716111 2024-09-12T17:05:10.519 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.515+0000 7f026be9d8c0 1 < completed multipart upload key=GPUFWJ3AWEMX upload=A9426FYJZON3 tag=HLO5CUT9IWEX type=write size=3861839 2024-09-12T17:05:10.526 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.519+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~1VSN8M8BRQKP.0 size=1048576 2024-09-12T17:05:10.528 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.523+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~1VSN8M8BRQKP.1 size=848616 2024-09-12T17:05:10.528 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.523+0000 7f026be9d8c0 1 > prepared multipart upload key=ALFGNC1YNROX upload=1VSN8M8BRQKP tag=261EP8SFF22T type=write size=2945768 2024-09-12T17:05:10.532 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.527+0000 7f026be9d8c0 1 < completed delete operation key=XNBE2II106VZ tag=U3I73I9W3111 type=del 2024-09-12T17:05:10.539 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.535+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~FWKFE7X7JAUM.0 size=1048576 2024-09-12T17:05:10.542 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.539+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~FWKFE7X7JAUM.1 size=1048576 2024-09-12T17:05:10.545 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.539+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~FWKFE7X7JAUM.2 size=229969 2024-09-12T17:05:10.545 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.539+0000 7f026be9d8c0 1 > prepared multipart upload key=UU88OS653L8D upload=FWKFE7X7JAUM tag=UAK9CW07TQK1 type=write size=3375697 2024-09-12T17:05:10.550 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.543+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~T3C9Z1ABA068.0 size=87136 2024-09-12T17:05:10.556 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.551+0000 7f026be9d8c0 1 < completed multipart upload key=2BQJ30RQQ25L upload=T3C9Z1ABA068 tag=II80DVFGIPJV type=write size=1135712 2024-09-12T17:05:10.563 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.559+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~EK78Y4O7X350.0 size=458029 2024-09-12T17:05:10.563 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.559+0000 7f026be9d8c0 1 > prepared multipart upload key=Y27CDEOCM7DH upload=EK78Y4O7X350 tag=7JCX1FY3D001 type=write size=1506605 2024-09-12T17:05:10.566 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.563+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~208B1B5Y806V.0 size=925184 2024-09-12T17:05:10.573 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.567+0000 7f026be9d8c0 1 < completed multipart upload key=XLKR6P8RNRVO upload=208B1B5Y806V tag=UFF3ZSXT3N3K type=write size=1973760 2024-09-12T17:05:10.576 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.571+0000 7f026be9d8c0 1 > prepared operation key=Z9YNIEQCVNBA tag=J4SDB4MS6RY5 type=del size=3628948 2024-09-12T17:05:10.584 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.579+0000 7f026be9d8c0 1 < suggested update operation key=PQSQ39X3O64P tag=Q0DMKO819U6J type=write size=747180 2024-09-12T17:05:10.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.583+0000 7f026be9d8c0 1 > prepared operation key=J8MU1A0CWSAQ tag=2IFCPSUSIVDO type=del size=2155408 2024-09-12T17:05:10.592 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.587+0000 7f026be9d8c0 1 < canceled operation key=UU88OS653L8D tag=JD5AM6YCAYZC type=del size=1458036 2024-09-12T17:05:10.596 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.591+0000 7f026be9d8c0 1 > prepared operation key=8AFDAVJLMRD2 tag=1PIBNNS4BQHX type=del size=1649037 2024-09-12T17:05:10.600 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.595+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~PM9O5APTR1VN.0 size=1048576 2024-09-12T17:05:10.602 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.599+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~PM9O5APTR1VN.1 size=19028 2024-09-12T17:05:10.609 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.603+0000 7f026be9d8c0 1 < completed multipart upload key=Y27CDEOCM7DH upload=PM9O5APTR1VN tag=97B7YY8F4I1S type=write size=2116180 2024-09-12T17:05:10.612 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.607+0000 7f026be9d8c0 1 > prepared operation key=6VO85REZG2NW tag=8IP6PWE9IWTE type=del size=2113455 2024-09-12T17:05:10.615 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.611+0000 7f026be9d8c0 1 < completed part key=_multipart_PQSQ39X3O64P.2~RV1CT5Z00URJ.0 size=1048576 2024-09-12T17:05:10.618 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.615+0000 7f026be9d8c0 1 < completed part key=_multipart_PQSQ39X3O64P.2~RV1CT5Z00URJ.1 size=1048576 2024-09-12T17:05:10.621 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.615+0000 7f026be9d8c0 1 < completed part key=_multipart_PQSQ39X3O64P.2~RV1CT5Z00URJ.2 size=191543 2024-09-12T17:05:10.626 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.623+0000 7f026be9d8c0 1 < completed multipart upload key=PQSQ39X3O64P upload=RV1CT5Z00URJ tag=BLGS6K746F49 type=write size=3337271 2024-09-12T17:05:10.630 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.627+0000 7f026be9d8c0 1 > prepared operation key=BW1T21LBUE2D tag=IUH49KMM10YF type=del size=1957800 2024-09-12T17:05:10.633 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.627+0000 7f026be9d8c0 1 < completed delete operation key=MVYWUWKSYQ9Z tag=7I292XF8KTJZ type=del 2024-09-12T17:05:10.637 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.631+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=WZ1AAWJI6PBS type=del size=1627081 2024-09-12T17:05:10.644 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.639+0000 7f026be9d8c0 1 < suggested update operation key=RBNN03IPZ8BT tag=2H1PD8DR3H88 type=write size=1014528 2024-09-12T17:05:10.650 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.647+0000 7f026be9d8c0 1 > prepared part key=_multipart_MVYWUWKSYQ9Z.2~OMLPJ9RWAQ77.0 size=256745 2024-09-12T17:05:10.650 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.647+0000 7f026be9d8c0 1 > prepared multipart upload key=MVYWUWKSYQ9Z upload=OMLPJ9RWAQ77 tag=MWTEUOZQ3K5K type=write size=1305321 2024-09-12T17:05:10.654 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.651+0000 7f026be9d8c0 1 < completed delete operation key=3JADN360QEO3 tag=G2POK8X4UX5N type=del 2024-09-12T17:05:10.657 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.651+0000 7f026be9d8c0 1 > prepared operation key=SGT8IC1GJ3IG tag=6PR2G17S6SLW type=del size=3467227 2024-09-12T17:05:10.661 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.655+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~IDP6YUHJCE3U.0 size=1048576 2024-09-12T17:05:10.661 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.655+0000 7f026be9d8c0 1 < canceled part key=_multipart_GPUFWJ3AWEMX.2~IDP6YUHJCE3U.1 size=1048576 2024-09-12T17:05:10.664 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.659+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~IDP6YUHJCE3U.2 size=307527 2024-09-12T17:05:10.669 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.663+0000 7f026be9d8c0 1 < canceled multipart upload key=GPUFWJ3AWEMX upload=IDP6YUHJCE3U tag=BU4RYFLOPASY type=write size=3453255 2024-09-12T17:05:10.672 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.667+0000 7f026be9d8c0 1 > prepared operation key=BBYDPSXZKHZP tag=9GRBGIV3KM87 type=del size=3082609 2024-09-12T17:05:10.679 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.675+0000 7f026be9d8c0 1 < suggested update operation key=RBNN03IPZ8BT tag=YFCK4EW072XE type=del size=3964849 2024-09-12T17:05:10.682 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.679+0000 7f026be9d8c0 1 > prepared operation key=Z9YNIEQCVNBA tag=N0GLNBJEC1NA type=del size=3039753 2024-09-12T17:05:10.685 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.679+0000 7f026be9d8c0 1 < completed write operation key=MVYWUWKSYQ9Z tag=3LBC3UIKQ9ZS type=write size=962735 2024-09-12T17:05:10.689 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.683+0000 7f026be9d8c0 1 > prepared operation key=PQSQ39X3O64P tag=8HIF568S6QNL type=del size=3928954 2024-09-12T17:05:10.692 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.687+0000 7f026be9d8c0 1 < completed part key=_multipart_T6QRDTQRHBPI.2~BAVONXLQN9WX.0 size=1048576 2024-09-12T17:05:10.695 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.691+0000 7f026be9d8c0 1 < completed part key=_multipart_T6QRDTQRHBPI.2~BAVONXLQN9WX.1 size=353973 2024-09-12T17:05:10.701 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.695+0000 7f026be9d8c0 1 < completed multipart upload key=T6QRDTQRHBPI upload=BAVONXLQN9WX tag=TL774ESB8Z1T type=write size=2451125 2024-09-12T17:05:10.705 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.699+0000 7f026be9d8c0 1 > prepared operation key=JJMEQ2O00SA2 tag=I4EGE86IFNVG type=del size=6053 2024-09-12T17:05:10.712 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.707+0000 7f026be9d8c0 1 < suggested remove operation key=4G3BKGNT3YZC tag=WR0WW0K7CA5Z type=del 2024-09-12T17:05:10.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.715+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~JKWHD0X77EFA.0 size=28661 2024-09-12T17:05:10.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.715+0000 7f026be9d8c0 1 > prepared multipart upload key=GPUFWJ3AWEMX upload=JKWHD0X77EFA tag=NB5IPI9Z14W7 type=write size=1077237 2024-09-12T17:05:10.722 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.719+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~1VSN8M8BRQKP.0 size=1048576 2024-09-12T17:05:10.722 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.719+0000 7f026be9d8c0 1 < canceled part key=_multipart_ALFGNC1YNROX.2~1VSN8M8BRQKP.1 size=848616 2024-09-12T17:05:10.728 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.723+0000 7f026be9d8c0 1 < canceled multipart upload key=ALFGNC1YNROX upload=1VSN8M8BRQKP tag=261EP8SFF22T type=write size=2945768 2024-09-12T17:05:10.739 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.735+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~NMUM0W6O5HEF.0 size=565446 2024-09-12T17:05:10.739 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.735+0000 7f026be9d8c0 1 > prepared multipart upload key=4G3BKGNT3YZC upload=NMUM0W6O5HEF tag=5MQ06L3BP39W type=write size=1614022 2024-09-12T17:05:10.743 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.739+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~FWKFE7X7JAUM.0 size=1048576 2024-09-12T17:05:10.745 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.739+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~FWKFE7X7JAUM.1 size=1048576 2024-09-12T17:05:10.748 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.743+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~FWKFE7X7JAUM.2 size=229969 2024-09-12T17:05:10.755 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.751+0000 7f026be9d8c0 1 < completed multipart upload key=UU88OS653L8D upload=FWKFE7X7JAUM tag=UAK9CW07TQK1 type=write size=3375697 2024-09-12T17:05:10.758 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.755+0000 7f026be9d8c0 1 > prepared operation key=J8MU1A0CWSAQ tag=5LP01HQICMRI type=del size=3094806 2024-09-12T17:05:10.764 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.759+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~EK78Y4O7X350.0 size=458029 2024-09-12T17:05:10.768 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.763+0000 7f026be9d8c0 1 < completed multipart upload key=Y27CDEOCM7DH upload=EK78Y4O7X350 tag=7JCX1FY3D001 type=write size=1506605 2024-09-12T17:05:10.775 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.771+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~ENHVUCFINY7S.0 size=504997 2024-09-12T17:05:10.775 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.771+0000 7f026be9d8c0 1 > prepared multipart upload key=XLKR6P8RNRVO upload=ENHVUCFINY7S tag=F53PQHVT5HO2 type=write size=1553573 2024-09-12T17:05:10.787 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.783+0000 7f026be9d8c0 1 < suggested update operation key=Z9YNIEQCVNBA tag=J4SDB4MS6RY5 type=del size=3628948 2024-09-12T17:05:10.794 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.791+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~KQCNABKX1TSI.0 size=1048576 2024-09-12T17:05:10.797 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.791+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~KQCNABKX1TSI.1 size=406331 2024-09-12T17:05:10.798 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.791+0000 7f026be9d8c0 1 > prepared multipart upload key=QVQ4TI319DH5 upload=KQCNABKX1TSI tag=BX5ETRPPU24U type=write size=2503483 2024-09-12T17:05:10.805 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.799+0000 7f026be9d8c0 1 < suggested update operation key=J8MU1A0CWSAQ tag=2IFCPSUSIVDO type=del size=2155408 2024-09-12T17:05:10.809 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.803+0000 7f026be9d8c0 1 > prepared operation key=XLKR6P8RNRVO tag=64AJ9UQD4W93 type=write size=307412 2024-09-12T17:05:10.813 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.807+0000 7f026be9d8c0 1 < completed delete operation key=8AFDAVJLMRD2 tag=1PIBNNS4BQHX type=del 2024-09-12T17:05:10.816 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.811+0000 7f026be9d8c0 1 > prepared operation key=QVQ4TI319DH5 tag=FYLC5X88LTBJ type=del size=2227737 2024-09-12T17:05:10.819 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.815+0000 7f026be9d8c0 1 < completed delete operation key=6VO85REZG2NW tag=8IP6PWE9IWTE type=del 2024-09-12T17:05:10.823 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.819+0000 7f026be9d8c0 1 > prepared operation key=QVQ4TI319DH5 tag=VVB8PPXMZH6T type=del size=2421796 2024-09-12T17:05:10.827 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.823+0000 7f026be9d8c0 1 < completed delete operation key=BW1T21LBUE2D tag=IUH49KMM10YF type=del 2024-09-12T17:05:10.830 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.827+0000 7f026be9d8c0 1 > prepared operation key=T6QRDTQRHBPI tag=0GB4RIT1UA4U type=del size=644197 2024-09-12T17:05:10.834 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.831+0000 7f026be9d8c0 1 < completed delete operation key=3JADN360QEO3 tag=WZ1AAWJI6PBS type=del 2024-09-12T17:05:10.840 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.835+0000 7f026be9d8c0 1 > prepared part key=_multipart_SO3HLQZA8B6B.2~CCOWBQOXS34I.0 size=1048576 2024-09-12T17:05:10.843 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.839+0000 7f026be9d8c0 1 > prepared part key=_multipart_SO3HLQZA8B6B.2~CCOWBQOXS34I.1 size=866862 2024-09-12T17:05:10.843 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.839+0000 7f026be9d8c0 1 > prepared multipart upload key=SO3HLQZA8B6B upload=CCOWBQOXS34I tag=WUYCNF8WF2AW type=write size=2964014 2024-09-12T17:05:10.847 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.843+0000 7f026be9d8c0 1 < completed part key=_multipart_MVYWUWKSYQ9Z.2~OMLPJ9RWAQ77.0 size=256745 2024-09-12T17:05:10.854 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.851+0000 7f026be9d8c0 1 < completed multipart upload key=MVYWUWKSYQ9Z upload=OMLPJ9RWAQ77 tag=MWTEUOZQ3K5K type=write size=1305321 2024-09-12T17:05:10.860 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.855+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~A46TO1HDRT3P.0 size=1048576 2024-09-12T17:05:10.863 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.859+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~A46TO1HDRT3P.1 size=206975 2024-09-12T17:05:10.863 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.859+0000 7f026be9d8c0 1 > prepared multipart upload key=SL2446KSB531 upload=A46TO1HDRT3P tag=SUP42K2DPR13 type=write size=2304127 2024-09-12T17:05:10.867 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.863+0000 7f026be9d8c0 1 < completed delete operation key=SGT8IC1GJ3IG tag=6PR2G17S6SLW type=del 2024-09-12T17:05:10.873 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.867+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~0W58UF18AOX2.0 size=1048576 2024-09-12T17:05:10.876 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.871+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~0W58UF18AOX2.1 size=1048576 2024-09-12T17:05:10.879 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.875+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~0W58UF18AOX2.2 size=599862 2024-09-12T17:05:10.879 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.875+0000 7f026be9d8c0 1 > prepared multipart upload key=XLKR6P8RNRVO upload=0W58UF18AOX2 tag=VZL739TSCYQD type=write size=3745590 2024-09-12T17:05:10.883 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.879+0000 7f026be9d8c0 1 < completed delete operation key=BBYDPSXZKHZP tag=9GRBGIV3KM87 type=del 2024-09-12T17:05:10.887 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.883+0000 7f026be9d8c0 1 > prepared operation key=SGT8IC1GJ3IG tag=71P2P9QJUS8W type=del size=3125096 2024-09-12T17:05:10.894 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.891+0000 7f026be9d8c0 1 < suggested update operation key=Z9YNIEQCVNBA tag=N0GLNBJEC1NA type=del size=3039753 2024-09-12T17:05:10.898 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.895+0000 7f026be9d8c0 1 > prepared operation key=UU88OS653L8D tag=R5KH8QGYOMAR type=del size=3884443 2024-09-12T17:05:10.902 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.899+0000 7f026be9d8c0 1 < completed delete operation key=PQSQ39X3O64P tag=8HIF568S6QNL type=del 2024-09-12T17:05:10.906 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.899+0000 7f026be9d8c0 1 > prepared operation key=SGT8IC1GJ3IG tag=PPCM2LMTPEQ2 type=write size=414421 2024-09-12T17:05:10.909 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.903+0000 7f026be9d8c0 1 < completed delete operation key=JJMEQ2O00SA2 tag=I4EGE86IFNVG type=del 2024-09-12T17:05:10.916 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.911+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~A79IZRCQ8FA5.0 size=1048576 2024-09-12T17:05:10.919 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.915+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~A79IZRCQ8FA5.1 size=106893 2024-09-12T17:05:10.919 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.915+0000 7f026be9d8c0 1 > prepared multipart upload key=Y27CDEOCM7DH upload=A79IZRCQ8FA5 tag=QVGW2UN96MIT type=write size=2204045 2024-09-12T17:05:10.923 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.919+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~JKWHD0X77EFA.0 size=28661 2024-09-12T17:05:10.929 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.923+0000 7f026be9d8c0 1 < completed multipart upload key=GPUFWJ3AWEMX upload=JKWHD0X77EFA tag=NB5IPI9Z14W7 type=write size=1077237 2024-09-12T17:05:10.932 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.927+0000 7f026be9d8c0 1 > prepared operation key=4U1W97V0OX11 tag=IT258CLQLVTN type=del size=13349 2024-09-12T17:05:10.936 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.931+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~NMUM0W6O5HEF.0 size=565446 2024-09-12T17:05:10.942 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.939+0000 7f026be9d8c0 1 < completed multipart upload key=4G3BKGNT3YZC upload=NMUM0W6O5HEF tag=5MQ06L3BP39W type=write size=1614022 2024-09-12T17:05:10.948 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.943+0000 7f026be9d8c0 1 > prepared part key=_multipart_SO3HLQZA8B6B.2~P32YC15Q8UBW.0 size=1048576 2024-09-12T17:05:10.950 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.947+0000 7f026be9d8c0 1 > prepared part key=_multipart_SO3HLQZA8B6B.2~P32YC15Q8UBW.1 size=1048576 2024-09-12T17:05:10.953 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.947+0000 7f026be9d8c0 1 > prepared part key=_multipart_SO3HLQZA8B6B.2~P32YC15Q8UBW.2 size=902756 2024-09-12T17:05:10.953 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.947+0000 7f026be9d8c0 1 > prepared multipart upload key=SO3HLQZA8B6B upload=P32YC15Q8UBW tag=PGJ9INHA6ENO type=write size=4048484 2024-09-12T17:05:10.956 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.951+0000 7f026be9d8c0 -1 < failed to complete operation key=J8MU1A0CWSAQ tag=5LP01HQICMRI type=del size=3094806: (22) Invalid argument 2024-09-12T17:05:10.960 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.955+0000 7f026be9d8c0 1 > prepared operation key=MVYWUWKSYQ9Z tag=N50FXPX2DOXF type=del size=1870587 2024-09-12T17:05:10.963 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.959+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~ENHVUCFINY7S.0 size=504997 2024-09-12T17:05:10.969 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.963+0000 7f026be9d8c0 1 < completed multipart upload key=XLKR6P8RNRVO upload=ENHVUCFINY7S tag=F53PQHVT5HO2 type=write size=1553573 2024-09-12T17:05:10.972 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.967+0000 7f026be9d8c0 1 > prepared operation key=QVQ4TI319DH5 tag=YLGZK0TP2QCZ type=del size=3697000 2024-09-12T17:05:10.976 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.971+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~KQCNABKX1TSI.0 size=1048576 2024-09-12T17:05:10.976 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.971+0000 7f026be9d8c0 1 < canceled part key=_multipart_QVQ4TI319DH5.2~KQCNABKX1TSI.1 size=406331 2024-09-12T17:05:10.982 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.975+0000 7f026be9d8c0 1 < canceled multipart upload key=QVQ4TI319DH5 upload=KQCNABKX1TSI tag=BX5ETRPPU24U type=write size=2503483 2024-09-12T17:05:10.985 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.979+0000 7f026be9d8c0 1 > prepared operation key=4G3BKGNT3YZC tag=4T1IP7RQMIXZ type=del size=997244 2024-09-12T17:05:10.992 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.987+0000 7f026be9d8c0 1 < suggested remove operation key=XLKR6P8RNRVO tag=64AJ9UQD4W93 type=write 2024-09-12T17:05:10.999 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.995+0000 7f026be9d8c0 1 > prepared part key=_multipart_21ZD52VBZIO4.2~3LMJ7VQBCKH8.0 size=1048576 2024-09-12T17:05:11.002 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.995+0000 7f026be9d8c0 1 > prepared part key=_multipart_21ZD52VBZIO4.2~3LMJ7VQBCKH8.1 size=663550 2024-09-12T17:05:11.002 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.995+0000 7f026be9d8c0 1 > prepared multipart upload key=21ZD52VBZIO4 upload=3LMJ7VQBCKH8 tag=5IN7M0Q3GKVS type=write size=2760702 2024-09-12T17:05:11.005 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:10.999+0000 7f026be9d8c0 1 < completed delete operation key=QVQ4TI319DH5 tag=FYLC5X88LTBJ type=del 2024-09-12T17:05:11.012 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.007+0000 7f026be9d8c0 1 > prepared part key=_multipart_E0Y3SKNUYCQS.2~6VFRK7RTFZ1U.0 size=1048576 2024-09-12T17:05:11.015 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.011+0000 7f026be9d8c0 1 > prepared part key=_multipart_E0Y3SKNUYCQS.2~6VFRK7RTFZ1U.1 size=1048576 2024-09-12T17:05:11.018 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.015+0000 7f026be9d8c0 1 > prepared part key=_multipart_E0Y3SKNUYCQS.2~6VFRK7RTFZ1U.2 size=630188 2024-09-12T17:05:11.018 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.015+0000 7f026be9d8c0 1 > prepared multipart upload key=E0Y3SKNUYCQS upload=6VFRK7RTFZ1U tag=LUCJPTW0QGO4 type=write size=3775916 2024-09-12T17:05:11.022 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.019+0000 7f026be9d8c0 1 < completed delete operation key=QVQ4TI319DH5 tag=VVB8PPXMZH6T type=del 2024-09-12T17:05:11.025 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.019+0000 7f026be9d8c0 1 > prepared operation key=J8MU1A0CWSAQ tag=7VXJKO6CNPQI type=del size=1904104 2024-09-12T17:05:11.029 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.023+0000 7f026be9d8c0 1 < canceled operation key=T6QRDTQRHBPI tag=0GB4RIT1UA4U type=del size=644197 2024-09-12T17:05:11.033 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.027+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=CA5QRYSAJ4V3 type=write size=1030681 2024-09-12T17:05:11.037 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.031+0000 7f026be9d8c0 1 < completed part key=_multipart_SO3HLQZA8B6B.2~CCOWBQOXS34I.0 size=1048576 2024-09-12T17:05:11.040 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.035+0000 7f026be9d8c0 1 < completed part key=_multipart_SO3HLQZA8B6B.2~CCOWBQOXS34I.1 size=866862 2024-09-12T17:05:11.045 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.039+0000 7f026be9d8c0 1 < completed multipart upload key=SO3HLQZA8B6B upload=CCOWBQOXS34I tag=WUYCNF8WF2AW type=write size=2964014 2024-09-12T17:05:11.052 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.047+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z183NH6R676V.2~H1EPKU9FBU0X.0 size=466723 2024-09-12T17:05:11.052 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.047+0000 7f026be9d8c0 1 > prepared multipart upload key=Z183NH6R676V upload=H1EPKU9FBU0X tag=B2R1B742J9EL type=write size=1515299 2024-09-12T17:05:11.052 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.047+0000 7f026be9d8c0 1 < canceled part key=_multipart_SL2446KSB531.2~A46TO1HDRT3P.0 size=1048576 2024-09-12T17:05:11.055 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.051+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~A46TO1HDRT3P.1 size=206975 2024-09-12T17:05:11.061 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.055+0000 7f026be9d8c0 1 < canceled multipart upload key=SL2446KSB531 upload=A46TO1HDRT3P tag=SUP42K2DPR13 type=write size=2304127 2024-09-12T17:05:11.065 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.059+0000 7f026be9d8c0 1 > prepared operation key=8AFDAVJLMRD2 tag=2WMXVCU0CU0W type=del size=1542684 2024-09-12T17:05:11.069 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.063+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~0W58UF18AOX2.0 size=1048576 2024-09-12T17:05:11.072 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.067+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~0W58UF18AOX2.1 size=1048576 2024-09-12T17:05:11.074 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.071+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~0W58UF18AOX2.2 size=599862 2024-09-12T17:05:11.081 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.075+0000 7f026be9d8c0 1 < completed multipart upload key=XLKR6P8RNRVO upload=0W58UF18AOX2 tag=VZL739TSCYQD type=write size=3745590 2024-09-12T17:05:11.087 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.083+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~H9EFEY7QXN10.0 size=1048576 2024-09-12T17:05:11.090 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.087+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~H9EFEY7QXN10.1 size=1048576 2024-09-12T17:05:11.092 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.087+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~H9EFEY7QXN10.2 size=872710 2024-09-12T17:05:11.093 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.087+0000 7f026be9d8c0 1 > prepared multipart upload key=XLKR6P8RNRVO upload=H9EFEY7QXN10 tag=QPNR9LA30JXN type=write size=4018438 2024-09-12T17:05:11.096 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.091+0000 7f026be9d8c0 1 < completed delete operation key=SGT8IC1GJ3IG tag=71P2P9QJUS8W type=del 2024-09-12T17:05:11.100 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.095+0000 7f026be9d8c0 1 > prepared operation key=BW1T21LBUE2D tag=PB0XT6CB5249 type=del size=144479 2024-09-12T17:05:11.103 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.099+0000 7f026be9d8c0 1 < completed delete operation key=UU88OS653L8D tag=R5KH8QGYOMAR type=del 2024-09-12T17:05:11.107 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.103+0000 7f026be9d8c0 1 > prepared operation key=Y27CDEOCM7DH tag=4YBAVUPL0PZM type=del size=858795 2024-09-12T17:05:11.111 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.107+0000 7f026be9d8c0 1 < completed write operation key=SGT8IC1GJ3IG tag=PPCM2LMTPEQ2 type=write size=414421 2024-09-12T17:05:11.115 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.111+0000 7f026be9d8c0 1 > prepared operation key=Z183NH6R676V tag=59HOUUEMLPAU type=del size=2926186 2024-09-12T17:05:11.119 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.115+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~A79IZRCQ8FA5.0 size=1048576 2024-09-12T17:05:11.126 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.123+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~A79IZRCQ8FA5.1 size=106893 2024-09-12T17:05:11.132 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.127+0000 7f026be9d8c0 1 < completed multipart upload key=Y27CDEOCM7DH upload=A79IZRCQ8FA5 tag=QVGW2UN96MIT type=write size=2204045 2024-09-12T17:05:11.136 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.131+0000 7f026be9d8c0 1 > prepared operation key=6VO85REZG2NW tag=T63XIQ1CENKP type=del size=119778 2024-09-12T17:05:11.139 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.135+0000 7f026be9d8c0 1 < canceled operation key=4U1W97V0OX11 tag=IT258CLQLVTN type=del size=13349 2024-09-12T17:05:11.146 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.143+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~MVQED0H9Y8TM.0 size=1048576 2024-09-12T17:05:11.149 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.143+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~MVQED0H9Y8TM.1 size=863657 2024-09-12T17:05:11.149 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.143+0000 7f026be9d8c0 1 > prepared multipart upload key=SL2446KSB531 upload=MVQED0H9Y8TM tag=B26D8DR96WIB type=write size=2960809 2024-09-12T17:05:11.150 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.143+0000 7f026be9d8c0 1 < canceled part key=_multipart_SO3HLQZA8B6B.2~P32YC15Q8UBW.0 size=1048576 2024-09-12T17:05:11.152 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.147+0000 7f026be9d8c0 1 < completed part key=_multipart_SO3HLQZA8B6B.2~P32YC15Q8UBW.1 size=1048576 2024-09-12T17:05:11.155 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.151+0000 7f026be9d8c0 1 < completed part key=_multipart_SO3HLQZA8B6B.2~P32YC15Q8UBW.2 size=902756 2024-09-12T17:05:11.161 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.155+0000 7f026be9d8c0 1 < canceled multipart upload key=SO3HLQZA8B6B upload=P32YC15Q8UBW tag=PGJ9INHA6ENO type=write size=4048484 2024-09-12T17:05:11.164 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.159+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=STA08A28G27B type=del size=1376464 2024-09-12T17:05:11.168 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.163+0000 7f026be9d8c0 1 < completed delete operation key=MVYWUWKSYQ9Z tag=N50FXPX2DOXF type=del 2024-09-12T17:05:11.174 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.171+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z183NH6R676V.2~UAF1KOF07MNZ.0 size=1048576 2024-09-12T17:05:11.177 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.171+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z183NH6R676V.2~UAF1KOF07MNZ.1 size=51870 2024-09-12T17:05:11.177 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.171+0000 7f026be9d8c0 1 > prepared multipart upload key=Z183NH6R676V upload=UAF1KOF07MNZ tag=TZ309W7BHTFP type=write size=2149022 2024-09-12T17:05:11.180 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.175+0000 7f026be9d8c0 1 < completed delete operation key=QVQ4TI319DH5 tag=YLGZK0TP2QCZ type=del 2024-09-12T17:05:11.187 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.183+0000 7f026be9d8c0 1 > prepared part key=_multipart_BBYDPSXZKHZP.2~7PTIW2U7JZNR.0 size=1048576 2024-09-12T17:05:11.189 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.183+0000 7f026be9d8c0 1 > prepared part key=_multipart_BBYDPSXZKHZP.2~7PTIW2U7JZNR.1 size=949152 2024-09-12T17:05:11.190 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.183+0000 7f026be9d8c0 1 > prepared multipart upload key=BBYDPSXZKHZP upload=7PTIW2U7JZNR tag=ILCVMM2J80KL type=write size=3046304 2024-09-12T17:05:11.193 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.187+0000 7f026be9d8c0 1 < canceled operation key=4G3BKGNT3YZC tag=4T1IP7RQMIXZ type=del size=997244 2024-09-12T17:05:11.200 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.195+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z183NH6R676V.2~3SWGZCUV3AVT.0 size=1048576 2024-09-12T17:05:11.203 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.199+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z183NH6R676V.2~3SWGZCUV3AVT.1 size=1048576 2024-09-12T17:05:11.205 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.199+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z183NH6R676V.2~3SWGZCUV3AVT.2 size=1003324 2024-09-12T17:05:11.205 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.199+0000 7f026be9d8c0 1 > prepared multipart upload key=Z183NH6R676V upload=3SWGZCUV3AVT tag=KL34791M7TZ6 type=write size=4149052 2024-09-12T17:05:11.209 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.203+0000 7f026be9d8c0 1 < completed part key=_multipart_21ZD52VBZIO4.2~3LMJ7VQBCKH8.0 size=1048576 2024-09-12T17:05:11.212 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.207+0000 7f026be9d8c0 1 < completed part key=_multipart_21ZD52VBZIO4.2~3LMJ7VQBCKH8.1 size=663550 2024-09-12T17:05:11.218 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.215+0000 7f026be9d8c0 1 < completed multipart upload key=21ZD52VBZIO4 upload=3LMJ7VQBCKH8 tag=5IN7M0Q3GKVS type=write size=2760702 2024-09-12T17:05:11.225 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.219+0000 7f026be9d8c0 1 > prepared part key=_multipart_L194KQIPFLE1.2~32F5C82PVIZP.0 size=1038751 2024-09-12T17:05:11.225 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.219+0000 7f026be9d8c0 1 > prepared multipart upload key=L194KQIPFLE1 upload=32F5C82PVIZP tag=CFU9ER3UFAW9 type=write size=2087327 2024-09-12T17:05:11.228 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.223+0000 7f026be9d8c0 1 < completed part key=_multipart_E0Y3SKNUYCQS.2~6VFRK7RTFZ1U.0 size=1048576 2024-09-12T17:05:11.231 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.227+0000 7f026be9d8c0 1 < completed part key=_multipart_E0Y3SKNUYCQS.2~6VFRK7RTFZ1U.1 size=1048576 2024-09-12T17:05:11.234 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.227+0000 7f026be9d8c0 1 < completed part key=_multipart_E0Y3SKNUYCQS.2~6VFRK7RTFZ1U.2 size=630188 2024-09-12T17:05:11.240 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.235+0000 7f026be9d8c0 1 < completed multipart upload key=E0Y3SKNUYCQS upload=6VFRK7RTFZ1U tag=LUCJPTW0QGO4 type=write size=3775916 2024-09-12T17:05:11.243 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.239+0000 7f026be9d8c0 1 > prepared operation key=Y27CDEOCM7DH tag=8HN3TG9KVOD4 type=del size=1768451 2024-09-12T17:05:11.247 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.243+0000 7f026be9d8c0 1 < completed delete operation key=J8MU1A0CWSAQ tag=7VXJKO6CNPQI type=del 2024-09-12T17:05:11.250 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.247+0000 7f026be9d8c0 1 > prepared operation key=UU88OS653L8D tag=903HK5Y17QYC type=del size=2999916 2024-09-12T17:05:11.254 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.251+0000 7f026be9d8c0 1 < completed write operation key=3JADN360QEO3 tag=CA5QRYSAJ4V3 type=write size=1030681 2024-09-12T17:05:11.257 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.251+0000 7f026be9d8c0 1 > prepared operation key=MVYWUWKSYQ9Z tag=OGHF779FP6R5 type=del size=1848418 2024-09-12T17:05:11.261 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.255+0000 7f026be9d8c0 1 < completed part key=_multipart_Z183NH6R676V.2~H1EPKU9FBU0X.0 size=466723 2024-09-12T17:05:11.266 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.263+0000 7f026be9d8c0 1 < completed multipart upload key=Z183NH6R676V upload=H1EPKU9FBU0X tag=B2R1B742J9EL type=write size=1515299 2024-09-12T17:05:11.270 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.267+0000 7f026be9d8c0 1 > prepared operation key=LHKLWIUAT08F tag=2C1QV0FOYJDS type=del size=798818 2024-09-12T17:05:11.273 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.267+0000 7f026be9d8c0 1 < completed delete operation key=8AFDAVJLMRD2 tag=2WMXVCU0CU0W type=del 2024-09-12T17:05:11.279 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.275+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~IDQ68J3FMQJB.0 size=1048576 2024-09-12T17:05:11.282 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.279+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~IDQ68J3FMQJB.1 size=1048576 2024-09-12T17:05:11.285 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.279+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~IDQ68J3FMQJB.2 size=80802 2024-09-12T17:05:11.285 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.279+0000 7f026be9d8c0 1 > prepared multipart upload key=QVQ4TI319DH5 upload=IDQ68J3FMQJB tag=SPG2ZJPC5MXJ type=write size=3226530 2024-09-12T17:05:11.288 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.283+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~H9EFEY7QXN10.0 size=1048576 2024-09-12T17:05:11.291 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.287+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~H9EFEY7QXN10.1 size=1048576 2024-09-12T17:05:11.294 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.291+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~H9EFEY7QXN10.2 size=872710 2024-09-12T17:05:11.301 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.295+0000 7f026be9d8c0 1 < completed multipart upload key=XLKR6P8RNRVO upload=H9EFEY7QXN10 tag=QPNR9LA30JXN type=write size=4018438 2024-09-12T17:05:11.304 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.299+0000 7f026be9d8c0 1 > prepared operation key=SGT8IC1GJ3IG tag=YVMNI61EQUFS type=write size=741387 2024-09-12T17:05:11.308 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.303+0000 7f026be9d8c0 1 < canceled operation key=BW1T21LBUE2D tag=PB0XT6CB5249 type=del size=144479 2024-09-12T17:05:11.314 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.311+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~9LS91P0BPAAI.0 size=1048576 2024-09-12T17:05:11.317 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.311+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~9LS91P0BPAAI.1 size=1048576 2024-09-12T17:05:11.320 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.315+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~9LS91P0BPAAI.2 size=682053 2024-09-12T17:05:11.320 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.315+0000 7f026be9d8c0 1 > prepared multipart upload key=ALFGNC1YNROX upload=9LS91P0BPAAI tag=T6SXAWDREB4P type=write size=3827781 2024-09-12T17:05:11.324 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.319+0000 7f026be9d8c0 1 < completed delete operation key=Y27CDEOCM7DH tag=4YBAVUPL0PZM type=del 2024-09-12T17:05:11.327 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.323+0000 7f026be9d8c0 1 > prepared operation key=XLKR6P8RNRVO tag=G5ILYRSH22AL type=write size=777892 2024-09-12T17:05:11.330 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.327+0000 7f026be9d8c0 1 < canceled operation key=Z183NH6R676V tag=59HOUUEMLPAU type=del size=2926186 2024-09-12T17:05:11.335 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.331+0000 7f026be9d8c0 1 > prepared operation key=MVYWUWKSYQ9Z tag=0X7GSJH8WUTN type=del size=3941893 2024-09-12T17:05:11.338 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.335+0000 7f026be9d8c0 1 < completed delete operation key=6VO85REZG2NW tag=T63XIQ1CENKP type=del 2024-09-12T17:05:11.341 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.335+0000 7f026be9d8c0 1 > prepared operation key=ALFGNC1YNROX tag=GND3U611C28J type=del size=2459231 2024-09-12T17:05:11.345 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.339+0000 7f026be9d8c0 1 < completed part key=_multipart_SL2446KSB531.2~MVQED0H9Y8TM.0 size=1048576 2024-09-12T17:05:11.345 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.339+0000 7f026be9d8c0 1 < canceled part key=_multipart_SL2446KSB531.2~MVQED0H9Y8TM.1 size=863657 2024-09-12T17:05:11.350 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.347+0000 7f026be9d8c0 1 < canceled multipart upload key=SL2446KSB531 upload=MVQED0H9Y8TM tag=B26D8DR96WIB type=write size=2960809 2024-09-12T17:05:11.354 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.347+0000 7f026be9d8c0 1 > prepared operation key=XLKR6P8RNRVO tag=SA6D172LPPTE type=del size=214852 2024-09-12T17:05:11.360 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.355+0000 7f026be9d8c0 1 < suggested remove operation key=RBNN03IPZ8BT tag=STA08A28G27B type=del 2024-09-12T17:05:11.366 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.363+0000 7f026be9d8c0 1 > prepared part key=_multipart_21ZD52VBZIO4.2~Y5SOZLETGJAF.0 size=1048576 2024-09-12T17:05:11.368 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.363+0000 7f026be9d8c0 1 > prepared part key=_multipart_21ZD52VBZIO4.2~Y5SOZLETGJAF.1 size=128313 2024-09-12T17:05:11.369 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.363+0000 7f026be9d8c0 1 > prepared multipart upload key=21ZD52VBZIO4 upload=Y5SOZLETGJAF tag=98GXVNMNXLM2 type=write size=2225465 2024-09-12T17:05:11.372 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.367+0000 7f026be9d8c0 1 < completed part key=_multipart_Z183NH6R676V.2~UAF1KOF07MNZ.0 size=1048576 2024-09-12T17:05:11.377 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.371+0000 7f026be9d8c0 1 < completed part key=_multipart_Z183NH6R676V.2~UAF1KOF07MNZ.1 size=51870 2024-09-12T17:05:11.380 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.375+0000 7f026be9d8c0 1 < completed multipart upload key=Z183NH6R676V upload=UAF1KOF07MNZ tag=TZ309W7BHTFP type=write size=2149022 2024-09-12T17:05:11.384 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.379+0000 7f026be9d8c0 1 > prepared operation key=2BQJ30RQQ25L tag=2PKBAVFG03C4 type=del size=2503290 2024-09-12T17:05:11.387 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.383+0000 7f026be9d8c0 1 < completed part key=_multipart_BBYDPSXZKHZP.2~7PTIW2U7JZNR.0 size=1048576 2024-09-12T17:05:11.390 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.383+0000 7f026be9d8c0 1 < completed part key=_multipart_BBYDPSXZKHZP.2~7PTIW2U7JZNR.1 size=949152 2024-09-12T17:05:11.395 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.391+0000 7f026be9d8c0 1 < completed multipart upload key=BBYDPSXZKHZP upload=7PTIW2U7JZNR tag=ILCVMM2J80KL type=write size=3046304 2024-09-12T17:05:11.399 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.395+0000 7f026be9d8c0 1 > prepared operation key=4U1W97V0OX11 tag=FHULTCBW0HQI type=del size=2619568 2024-09-12T17:05:11.402 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.399+0000 7f026be9d8c0 1 < completed part key=_multipart_Z183NH6R676V.2~3SWGZCUV3AVT.0 size=1048576 2024-09-12T17:05:11.405 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.399+0000 7f026be9d8c0 1 < completed part key=_multipart_Z183NH6R676V.2~3SWGZCUV3AVT.1 size=1048576 2024-09-12T17:05:11.408 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.403+0000 7f026be9d8c0 1 < completed part key=_multipart_Z183NH6R676V.2~3SWGZCUV3AVT.2 size=1003324 2024-09-12T17:05:11.414 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.407+0000 7f026be9d8c0 1 < completed multipart upload key=Z183NH6R676V upload=3SWGZCUV3AVT tag=KL34791M7TZ6 type=write size=4149052 2024-09-12T17:05:11.420 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.415+0000 7f026be9d8c0 1 > prepared part key=_multipart_4U1W97V0OX11.2~UA6O13XF7VU9.0 size=1048576 2024-09-12T17:05:11.423 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.419+0000 7f026be9d8c0 1 > prepared part key=_multipart_4U1W97V0OX11.2~UA6O13XF7VU9.1 size=274793 2024-09-12T17:05:11.423 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.419+0000 7f026be9d8c0 1 > prepared multipart upload key=4U1W97V0OX11 upload=UA6O13XF7VU9 tag=X2LUVMEL7VMU type=write size=2371945 2024-09-12T17:05:11.423 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.419+0000 7f026be9d8c0 1 < canceled part key=_multipart_L194KQIPFLE1.2~32F5C82PVIZP.0 size=1038751 2024-09-12T17:05:11.429 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.423+0000 7f026be9d8c0 1 < canceled multipart upload key=L194KQIPFLE1 upload=32F5C82PVIZP tag=CFU9ER3UFAW9 type=write size=2087327 2024-09-12T17:05:11.433 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.427+0000 7f026be9d8c0 1 > prepared operation key=6VO85REZG2NW tag=YAB1YI9WG6FT type=del size=3865599 2024-09-12T17:05:11.437 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.431+0000 7f026be9d8c0 1 < completed delete operation key=Y27CDEOCM7DH tag=8HN3TG9KVOD4 type=del 2024-09-12T17:05:11.441 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.435+0000 7f026be9d8c0 1 > prepared operation key=UU88OS653L8D tag=VHDOTCYT9NID type=del size=472251 2024-09-12T17:05:11.449 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.443+0000 7f026be9d8c0 1 < completed delete operation key=UU88OS653L8D tag=903HK5Y17QYC type=del 2024-09-12T17:05:11.456 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.451+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~G43R3UHMZTQG.0 size=1048576 2024-09-12T17:05:11.459 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.455+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~G43R3UHMZTQG.1 size=849850 2024-09-12T17:05:11.459 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.455+0000 7f026be9d8c0 1 > prepared multipart upload key=Z9YNIEQCVNBA upload=G43R3UHMZTQG tag=GUS3HFD9R33H type=write size=2947002 2024-09-12T17:05:11.463 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.459+0000 7f026be9d8c0 1 < completed delete operation key=MVYWUWKSYQ9Z tag=OGHF779FP6R5 type=del 2024-09-12T17:05:11.466 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.463+0000 7f026be9d8c0 1 > prepared operation key=4U1W97V0OX11 tag=OR1SHX2NTPQ3 type=del size=2732229 2024-09-12T17:05:11.470 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.467+0000 7f026be9d8c0 1 < completed delete operation key=LHKLWIUAT08F tag=2C1QV0FOYJDS type=del 2024-09-12T17:05:11.473 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.467+0000 7f026be9d8c0 1 > prepared operation key=MVYWUWKSYQ9Z tag=EXKX0E5Q52B9 type=del size=3914445 2024-09-12T17:05:11.477 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.471+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~IDQ68J3FMQJB.0 size=1048576 2024-09-12T17:05:11.479 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.475+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~IDQ68J3FMQJB.1 size=1048576 2024-09-12T17:05:11.482 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.479+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~IDQ68J3FMQJB.2 size=80802 2024-09-12T17:05:11.489 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.483+0000 7f026be9d8c0 1 < completed multipart upload key=QVQ4TI319DH5 upload=IDQ68J3FMQJB tag=SPG2ZJPC5MXJ type=write size=3226530 2024-09-12T17:05:11.492 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.487+0000 7f026be9d8c0 1 > prepared operation key=XNBE2II106VZ tag=E0Y2J9MNC857 type=del size=378863 2024-09-12T17:05:11.500 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.495+0000 7f026be9d8c0 1 < suggested update operation key=SGT8IC1GJ3IG tag=YVMNI61EQUFS type=write size=741387 2024-09-12T17:05:11.504 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.499+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=DNAVPI85D32V type=del size=4054907 2024-09-12T17:05:11.507 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.503+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~9LS91P0BPAAI.0 size=1048576 2024-09-12T17:05:11.510 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.503+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~9LS91P0BPAAI.1 size=1048576 2024-09-12T17:05:11.512 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.507+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~9LS91P0BPAAI.2 size=682053 2024-09-12T17:05:11.517 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.511+0000 7f026be9d8c0 1 < completed multipart upload key=ALFGNC1YNROX upload=9LS91P0BPAAI tag=T6SXAWDREB4P type=write size=3827781 2024-09-12T17:05:11.520 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.515+0000 7f026be9d8c0 1 > prepared operation key=T6QRDTQRHBPI tag=P6STRDK427IN type=del size=1450194 2024-09-12T17:05:11.523 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.519+0000 7f026be9d8c0 1 < completed write operation key=XLKR6P8RNRVO tag=G5ILYRSH22AL type=write size=777892 2024-09-12T17:05:11.526 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.523+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=5Z8PC7TXVZXW type=del size=2223299 2024-09-12T17:05:11.529 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.523+0000 7f026be9d8c0 1 < completed delete operation key=MVYWUWKSYQ9Z tag=0X7GSJH8WUTN type=del 2024-09-12T17:05:11.532 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.527+0000 7f026be9d8c0 1 > prepared operation key=6VO85REZG2NW tag=66T9DD34PO2T type=del size=3901110 2024-09-12T17:05:11.536 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.531+0000 7f026be9d8c0 1 < completed delete operation key=ALFGNC1YNROX tag=GND3U611C28J type=del 2024-09-12T17:05:11.539 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.535+0000 7f026be9d8c0 1 > prepared operation key=2BQJ30RQQ25L tag=H6UM5Y99TDE4 type=del size=602718 2024-09-12T17:05:11.542 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.539+0000 7f026be9d8c0 1 < completed delete operation key=XLKR6P8RNRVO tag=SA6D172LPPTE type=del 2024-09-12T17:05:11.548 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.543+0000 7f026be9d8c0 1 > prepared part key=_multipart_LHKLWIUAT08F.2~TT7F0VZTCQE6.0 size=1048576 2024-09-12T17:05:11.550 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.547+0000 7f026be9d8c0 1 > prepared part key=_multipart_LHKLWIUAT08F.2~TT7F0VZTCQE6.1 size=551395 2024-09-12T17:05:11.550 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.547+0000 7f026be9d8c0 1 > prepared multipart upload key=LHKLWIUAT08F upload=TT7F0VZTCQE6 tag=1GEG20464K4X type=write size=2648547 2024-09-12T17:05:11.553 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.547+0000 7f026be9d8c0 1 < completed part key=_multipart_21ZD52VBZIO4.2~Y5SOZLETGJAF.0 size=1048576 2024-09-12T17:05:11.556 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.551+0000 7f026be9d8c0 1 < completed part key=_multipart_21ZD52VBZIO4.2~Y5SOZLETGJAF.1 size=128313 2024-09-12T17:05:11.561 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.555+0000 7f026be9d8c0 1 < completed multipart upload key=21ZD52VBZIO4 upload=Y5SOZLETGJAF tag=98GXVNMNXLM2 type=write size=2225465 2024-09-12T17:05:11.566 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.563+0000 7f026be9d8c0 1 > prepared part key=_multipart_21ZD52VBZIO4.2~9QI0Q0BKINWJ.0 size=1048576 2024-09-12T17:05:11.570 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.567+0000 7f026be9d8c0 1 > prepared part key=_multipart_21ZD52VBZIO4.2~9QI0Q0BKINWJ.1 size=932672 2024-09-12T17:05:11.570 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.567+0000 7f026be9d8c0 1 > prepared multipart upload key=21ZD52VBZIO4 upload=9QI0Q0BKINWJ tag=P9LK37T8IXKC type=write size=3029824 2024-09-12T17:05:11.573 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.567+0000 7f026be9d8c0 1 < canceled operation key=2BQJ30RQQ25L tag=2PKBAVFG03C4 type=del size=2503290 2024-09-12T17:05:11.577 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.571+0000 7f026be9d8c0 1 > prepared operation key=T6QRDTQRHBPI tag=A9208BU4JO7N type=del size=3096501 2024-09-12T17:05:11.580 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.575+0000 7f026be9d8c0 1 < completed delete operation key=4U1W97V0OX11 tag=FHULTCBW0HQI type=del 2024-09-12T17:05:11.584 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.579+0000 7f026be9d8c0 1 > prepared operation key=6VO85REZG2NW tag=KVAS71F0GFKT type=write size=954230 2024-09-12T17:05:11.587 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.583+0000 7f026be9d8c0 1 < completed part key=_multipart_4U1W97V0OX11.2~UA6O13XF7VU9.0 size=1048576 2024-09-12T17:05:11.589 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.583+0000 7f026be9d8c0 1 < completed part key=_multipart_4U1W97V0OX11.2~UA6O13XF7VU9.1 size=274793 2024-09-12T17:05:11.595 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.591+0000 7f026be9d8c0 1 < completed multipart upload key=4U1W97V0OX11 upload=UA6O13XF7VU9 tag=X2LUVMEL7VMU type=write size=2371945 2024-09-12T17:05:11.601 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.595+0000 7f026be9d8c0 1 > prepared part key=_multipart_RBNN03IPZ8BT.2~AU4WV5491O9R.0 size=1048576 2024-09-12T17:05:11.604 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.599+0000 7f026be9d8c0 1 > prepared part key=_multipart_RBNN03IPZ8BT.2~AU4WV5491O9R.1 size=60730 2024-09-12T17:05:11.604 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.599+0000 7f026be9d8c0 1 > prepared multipart upload key=RBNN03IPZ8BT upload=AU4WV5491O9R tag=Z0QBSTQ89P3F type=write size=2157882 2024-09-12T17:05:11.608 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.603+0000 7f026be9d8c0 1 < completed delete operation key=6VO85REZG2NW tag=YAB1YI9WG6FT type=del 2024-09-12T17:05:11.614 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.611+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~63OXQ85J3LF7.0 size=1048576 2024-09-12T17:05:11.617 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.611+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~63OXQ85J3LF7.1 size=914518 2024-09-12T17:05:11.617 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.611+0000 7f026be9d8c0 1 > prepared multipart upload key=2BQJ30RQQ25L upload=63OXQ85J3LF7 tag=1POHPQ41UJEM type=write size=3011670 2024-09-12T17:05:11.621 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.615+0000 7f026be9d8c0 1 < completed delete operation key=UU88OS653L8D tag=VHDOTCYT9NID type=del 2024-09-12T17:05:11.624 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.619+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=DAMSVWRGTDL6 type=del size=57956 2024-09-12T17:05:11.628 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.623+0000 7f026be9d8c0 1 < completed part key=_multipart_Z9YNIEQCVNBA.2~G43R3UHMZTQG.0 size=1048576 2024-09-12T17:05:11.631 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.627+0000 7f026be9d8c0 1 < completed part key=_multipart_Z9YNIEQCVNBA.2~G43R3UHMZTQG.1 size=849850 2024-09-12T17:05:11.636 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.631+0000 7f026be9d8c0 1 < completed multipart upload key=Z9YNIEQCVNBA upload=G43R3UHMZTQG tag=GUS3HFD9R33H type=write size=2947002 2024-09-12T17:05:11.643 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.639+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~6E11VE73BWZM.0 size=958212 2024-09-12T17:05:11.643 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.639+0000 7f026be9d8c0 1 > prepared multipart upload key=J8MU1A0CWSAQ upload=6E11VE73BWZM tag=8T92E832MKYJ type=write size=2006788 2024-09-12T17:05:11.646 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.643+0000 7f026be9d8c0 1 < completed delete operation key=4U1W97V0OX11 tag=OR1SHX2NTPQ3 type=del 2024-09-12T17:05:11.649 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.643+0000 7f026be9d8c0 1 > prepared operation key=2BQJ30RQQ25L tag=VXMHUROCVG29 type=del size=770560 2024-09-12T17:05:11.653 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.647+0000 7f026be9d8c0 1 < completed delete operation key=MVYWUWKSYQ9Z tag=EXKX0E5Q52B9 type=del 2024-09-12T17:05:11.657 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.651+0000 7f026be9d8c0 1 > prepared operation key=8AFDAVJLMRD2 tag=LX1M0UAFYVBI type=del size=1548455 2024-09-12T17:05:11.660 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.655+0000 7f026be9d8c0 1 < completed delete operation key=XNBE2II106VZ tag=E0Y2J9MNC857 type=del 2024-09-12T17:05:11.666 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.663+0000 7f026be9d8c0 1 > prepared part key=_multipart_PQSQ39X3O64P.2~0NHOQ3STJJPO.0 size=352800 2024-09-12T17:05:11.666 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.663+0000 7f026be9d8c0 1 > prepared multipart upload key=PQSQ39X3O64P upload=0NHOQ3STJJPO tag=UZULEIPMAYXV type=write size=1401376 2024-09-12T17:05:11.670 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.667+0000 7f026be9d8c0 1 < completed delete operation key=21ZD52VBZIO4 tag=DNAVPI85D32V type=del 2024-09-12T17:05:11.673 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.667+0000 7f026be9d8c0 1 > prepared operation key=ALFGNC1YNROX tag=41Y5US7WBOFS type=del size=1672467 2024-09-12T17:05:11.677 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.671+0000 7f026be9d8c0 1 < completed delete operation key=T6QRDTQRHBPI tag=P6STRDK427IN type=del 2024-09-12T17:05:11.683 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.679+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~CEVCVVQG0LV9.0 size=906829 2024-09-12T17:05:11.683 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.679+0000 7f026be9d8c0 1 > prepared multipart upload key=32XUMOWT8HO2 upload=CEVCVVQG0LV9 tag=9EOK7O1WBYVX type=write size=1955405 2024-09-12T17:05:11.691 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.687+0000 7f026be9d8c0 1 < suggested update operation key=RBNN03IPZ8BT tag=5Z8PC7TXVZXW type=del size=2223299 2024-09-12T17:05:11.694 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.691+0000 7f026be9d8c0 1 > prepared operation key=JJMEQ2O00SA2 tag=UH6J4FQ91BVH type=del size=3736032 2024-09-12T17:05:11.698 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.695+0000 7f026be9d8c0 1 < completed delete operation key=6VO85REZG2NW tag=66T9DD34PO2T type=del 2024-09-12T17:05:11.705 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.699+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~TOV5GT05YW8M.0 size=672252 2024-09-12T17:05:11.705 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.699+0000 7f026be9d8c0 1 > prepared multipart upload key=JJMEQ2O00SA2 upload=TOV5GT05YW8M tag=YBQRDWQKA0J0 type=write size=1720828 2024-09-12T17:05:11.708 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.703+0000 7f026be9d8c0 1 < canceled operation key=2BQJ30RQQ25L tag=H6UM5Y99TDE4 type=del size=602718 2024-09-12T17:05:11.712 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.707+0000 7f026be9d8c0 1 > prepared operation key=Z9YNIEQCVNBA tag=5TXIEHYI826E type=write size=4678 2024-09-12T17:05:11.716 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.711+0000 7f026be9d8c0 1 < completed part key=_multipart_LHKLWIUAT08F.2~TT7F0VZTCQE6.0 size=1048576 2024-09-12T17:05:11.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.715+0000 7f026be9d8c0 1 < completed part key=_multipart_LHKLWIUAT08F.2~TT7F0VZTCQE6.1 size=551395 2024-09-12T17:05:11.725 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.719+0000 7f026be9d8c0 1 < completed multipart upload key=LHKLWIUAT08F upload=TT7F0VZTCQE6 tag=1GEG20464K4X type=write size=2648547 2024-09-12T17:05:11.732 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.727+0000 7f026be9d8c0 1 > prepared part key=_multipart_U8W1SAVSLTBF.2~DKNNYRLIHLF3.0 size=1048576 2024-09-12T17:05:11.736 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.731+0000 7f026be9d8c0 1 > prepared part key=_multipart_U8W1SAVSLTBF.2~DKNNYRLIHLF3.1 size=1048576 2024-09-12T17:05:11.739 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.735+0000 7f026be9d8c0 1 > prepared part key=_multipart_U8W1SAVSLTBF.2~DKNNYRLIHLF3.2 size=509805 2024-09-12T17:05:11.739 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.735+0000 7f026be9d8c0 1 > prepared multipart upload key=U8W1SAVSLTBF upload=DKNNYRLIHLF3 tag=U4PIGM5DGNSA type=write size=3655533 2024-09-12T17:05:11.742 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.739+0000 7f026be9d8c0 1 < completed part key=_multipart_21ZD52VBZIO4.2~9QI0Q0BKINWJ.0 size=1048576 2024-09-12T17:05:11.745 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.739+0000 7f026be9d8c0 1 < completed part key=_multipart_21ZD52VBZIO4.2~9QI0Q0BKINWJ.1 size=932672 2024-09-12T17:05:11.751 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.747+0000 7f026be9d8c0 1 < completed multipart upload key=21ZD52VBZIO4 upload=9QI0Q0BKINWJ tag=P9LK37T8IXKC type=write size=3029824 2024-09-12T17:05:11.757 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.751+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~43ZKQ7BRCB7U.0 size=1048576 2024-09-12T17:05:11.760 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.755+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~43ZKQ7BRCB7U.1 size=1048576 2024-09-12T17:05:11.762 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.759+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~43ZKQ7BRCB7U.2 size=81141 2024-09-12T17:05:11.762 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.759+0000 7f026be9d8c0 1 > prepared multipart upload key=JJMEQ2O00SA2 upload=43ZKQ7BRCB7U tag=UHU5RYT0LLW6 type=write size=3226869 2024-09-12T17:05:11.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.767+0000 7f026be9d8c0 1 < suggested update operation key=T6QRDTQRHBPI tag=A9208BU4JO7N type=del size=3096501 2024-09-12T17:05:11.776 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.771+0000 7f026be9d8c0 1 > prepared operation key=L194KQIPFLE1 tag=WZFB92ERSDYM type=write size=1017635 2024-09-12T17:05:11.780 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.775+0000 7f026be9d8c0 1 < completed write operation key=6VO85REZG2NW tag=KVAS71F0GFKT type=write size=954230 2024-09-12T17:05:11.785 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.779+0000 7f026be9d8c0 1 > prepared operation key=T6QRDTQRHBPI tag=A00FXM99NK8W type=del size=3192714 2024-09-12T17:05:11.786 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.783+0000 7f026be9d8c0 1 < completed part key=_multipart_RBNN03IPZ8BT.2~AU4WV5491O9R.0 size=1048576 2024-09-12T17:05:11.788 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.783+0000 7f026be9d8c0 1 < completed part key=_multipart_RBNN03IPZ8BT.2~AU4WV5491O9R.1 size=60730 2024-09-12T17:05:11.794 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.791+0000 7f026be9d8c0 1 < completed multipart upload key=RBNN03IPZ8BT upload=AU4WV5491O9R tag=Z0QBSTQ89P3F type=write size=2157882 2024-09-12T17:05:11.797 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.791+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=Y9PMMX3NQOJG type=del size=3971535 2024-09-12T17:05:11.801 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.795+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~63OXQ85J3LF7.0 size=1048576 2024-09-12T17:05:11.801 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.795+0000 7f026be9d8c0 1 < canceled part key=_multipart_2BQJ30RQQ25L.2~63OXQ85J3LF7.1 size=914518 2024-09-12T17:05:11.806 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.803+0000 7f026be9d8c0 1 < canceled multipart upload key=2BQJ30RQQ25L upload=63OXQ85J3LF7 tag=1POHPQ41UJEM type=write size=3011670 2024-09-12T17:05:11.810 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.803+0000 7f026be9d8c0 1 > prepared operation key=J8MU1A0CWSAQ tag=7TDZD1P22IUJ type=write size=820823 2024-09-12T17:05:11.813 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.807+0000 7f026be9d8c0 1 < completed delete operation key=21ZD52VBZIO4 tag=DAMSVWRGTDL6 type=del 2024-09-12T17:05:11.816 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.811+0000 7f026be9d8c0 1 > prepared operation key=T6QRDTQRHBPI tag=5D0KXSW4PDO8 type=del size=3019338 2024-09-12T17:05:11.819 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.815+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~6E11VE73BWZM.0 size=958212 2024-09-12T17:05:11.825 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.819+0000 7f026be9d8c0 1 < completed multipart upload key=J8MU1A0CWSAQ upload=6E11VE73BWZM tag=8T92E832MKYJ type=write size=2006788 2024-09-12T17:05:11.829 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.823+0000 7f026be9d8c0 1 > prepared operation key=4G3BKGNT3YZC tag=W7R0HCBYCTRJ type=del size=3154447 2024-09-12T17:05:11.833 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.827+0000 7f026be9d8c0 1 < completed delete operation key=2BQJ30RQQ25L tag=VXMHUROCVG29 type=del 2024-09-12T17:05:11.838 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.835+0000 7f026be9d8c0 1 > prepared operation key=PQSQ39X3O64P tag=OHQX6KQU3CXT type=del size=1215282 2024-09-12T17:05:11.845 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.839+0000 7f026be9d8c0 1 < suggested remove operation key=8AFDAVJLMRD2 tag=LX1M0UAFYVBI type=del 2024-09-12T17:05:11.849 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.843+0000 7f026be9d8c0 1 > prepared operation key=SL2446KSB531 tag=HWRTUK7GCIIT type=del size=1238301 2024-09-12T17:05:11.853 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.847+0000 7f026be9d8c0 1 < completed part key=_multipart_PQSQ39X3O64P.2~0NHOQ3STJJPO.0 size=352800 2024-09-12T17:05:11.858 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.855+0000 7f026be9d8c0 1 < completed multipart upload key=PQSQ39X3O64P upload=0NHOQ3STJJPO tag=UZULEIPMAYXV type=write size=1401376 2024-09-12T17:05:11.862 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.859+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=2CAMW53H7UWX type=del size=2897888 2024-09-12T17:05:11.866 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.859+0000 7f026be9d8c0 1 < completed delete operation key=ALFGNC1YNROX tag=41Y5US7WBOFS type=del 2024-09-12T17:05:11.869 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.863+0000 7f026be9d8c0 1 > prepared operation key=2BQJ30RQQ25L tag=09R7F6XE93VY type=del size=4061857 2024-09-12T17:05:11.873 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.867+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~CEVCVVQG0LV9.0 size=906829 2024-09-12T17:05:11.878 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.875+0000 7f026be9d8c0 1 < completed multipart upload key=32XUMOWT8HO2 upload=CEVCVVQG0LV9 tag=9EOK7O1WBYVX type=write size=1955405 2024-09-12T17:05:11.882 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.879+0000 7f026be9d8c0 1 > prepared operation key=4U1W97V0OX11 tag=J9A3UN8FHQQ3 type=del size=608892 2024-09-12T17:05:11.889 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.883+0000 7f026be9d8c0 1 < suggested update operation key=JJMEQ2O00SA2 tag=UH6J4FQ91BVH type=del size=3736032 2024-09-12T17:05:11.893 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.887+0000 7f026be9d8c0 1 > prepared operation key=T6QRDTQRHBPI tag=1Q6IH6CE6SEI type=del size=376959 2024-09-12T17:05:11.897 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.891+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~TOV5GT05YW8M.0 size=672252 2024-09-12T17:05:11.903 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.899+0000 7f026be9d8c0 1 < completed multipart upload key=JJMEQ2O00SA2 upload=TOV5GT05YW8M tag=YBQRDWQKA0J0 type=write size=1720828 2024-09-12T17:05:11.909 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.903+0000 7f026be9d8c0 1 > prepared part key=_multipart_SGT8IC1GJ3IG.2~4IRRQYD3F2HH.0 size=1048576 2024-09-12T17:05:11.912 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.907+0000 7f026be9d8c0 1 > prepared part key=_multipart_SGT8IC1GJ3IG.2~4IRRQYD3F2HH.1 size=1048576 2024-09-12T17:05:11.915 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.911+0000 7f026be9d8c0 1 > prepared part key=_multipart_SGT8IC1GJ3IG.2~4IRRQYD3F2HH.2 size=975339 2024-09-12T17:05:11.915 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.911+0000 7f026be9d8c0 1 > prepared multipart upload key=SGT8IC1GJ3IG upload=4IRRQYD3F2HH tag=G4OEN4ACEEEC type=write size=4121067 2024-09-12T17:05:11.922 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.919+0000 7f026be9d8c0 1 < suggested remove operation key=Z9YNIEQCVNBA tag=5TXIEHYI826E type=write 2024-09-12T17:05:11.925 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.919+0000 7f026be9d8c0 1 > prepared operation key=4U1W97V0OX11 tag=MCV56153NM19 type=write size=392461 2024-09-12T17:05:11.929 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.923+0000 7f026be9d8c0 1 < completed part key=_multipart_U8W1SAVSLTBF.2~DKNNYRLIHLF3.0 size=1048576 2024-09-12T17:05:11.932 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.927+0000 7f026be9d8c0 1 < completed part key=_multipart_U8W1SAVSLTBF.2~DKNNYRLIHLF3.1 size=1048576 2024-09-12T17:05:11.935 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.931+0000 7f026be9d8c0 1 < completed part key=_multipart_U8W1SAVSLTBF.2~DKNNYRLIHLF3.2 size=509805 2024-09-12T17:05:11.941 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.935+0000 7f026be9d8c0 1 < completed multipart upload key=U8W1SAVSLTBF upload=DKNNYRLIHLF3 tag=U4PIGM5DGNSA type=write size=3655533 2024-09-12T17:05:11.944 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.939+0000 7f026be9d8c0 1 > prepared operation key=SL2446KSB531 tag=YOXUCI6TLDP5 type=del size=172089 2024-09-12T17:05:11.947 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.943+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~43ZKQ7BRCB7U.0 size=1048576 2024-09-12T17:05:11.949 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.943+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~43ZKQ7BRCB7U.1 size=1048576 2024-09-12T17:05:11.952 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.947+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~43ZKQ7BRCB7U.2 size=81141 2024-09-12T17:05:11.957 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.951+0000 7f026be9d8c0 1 < completed multipart upload key=JJMEQ2O00SA2 upload=43ZKQ7BRCB7U tag=UHU5RYT0LLW6 type=write size=3226869 2024-09-12T17:05:11.963 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.959+0000 7f026be9d8c0 1 > prepared part key=_multipart_4U1W97V0OX11.2~7ISFZX8BOP50.0 size=1006330 2024-09-12T17:05:11.963 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.959+0000 7f026be9d8c0 1 > prepared multipart upload key=4U1W97V0OX11 upload=7ISFZX8BOP50 tag=ZVPRSAWX0RRZ type=write size=2054906 2024-09-12T17:05:11.969 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.963+0000 7f026be9d8c0 1 < suggested update operation key=L194KQIPFLE1 tag=WZFB92ERSDYM type=write size=1017635 2024-09-12T17:05:11.975 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.971+0000 7f026be9d8c0 1 > prepared part key=_multipart_RBNN03IPZ8BT.2~W0JLMNYDV0HV.0 size=1048576 2024-09-12T17:05:11.977 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.971+0000 7f026be9d8c0 1 > prepared part key=_multipart_RBNN03IPZ8BT.2~W0JLMNYDV0HV.1 size=1048576 2024-09-12T17:05:11.980 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.975+0000 7f026be9d8c0 1 > prepared part key=_multipart_RBNN03IPZ8BT.2~W0JLMNYDV0HV.2 size=757900 2024-09-12T17:05:11.980 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.975+0000 7f026be9d8c0 1 > prepared multipart upload key=RBNN03IPZ8BT upload=W0JLMNYDV0HV tag=7MKDX28U26OH type=write size=3903628 2024-09-12T17:05:11.983 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.979+0000 7f026be9d8c0 1 < completed delete operation key=T6QRDTQRHBPI tag=A00FXM99NK8W type=del 2024-09-12T17:05:11.989 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.983+0000 7f026be9d8c0 1 > prepared operation key=4U1W97V0OX11 tag=T03KA0K79W8A type=del size=1226751 2024-09-12T17:05:11.994 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.991+0000 7f026be9d8c0 1 < suggested update operation key=3JADN360QEO3 tag=Y9PMMX3NQOJG type=del size=3971535 2024-09-12T17:05:11.997 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.991+0000 7f026be9d8c0 1 > prepared operation key=E0Y3SKNUYCQS tag=CEN7NMWLT7BP type=del size=1335130 2024-09-12T17:05:12.001 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.995+0000 7f026be9d8c0 1 < completed write operation key=J8MU1A0CWSAQ tag=7TDZD1P22IUJ type=write size=820823 2024-09-12T17:05:12.005 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:11.999+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=H6SYNSTEYOQO type=write size=55685 2024-09-12T17:05:12.008 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.003+0000 7f026be9d8c0 1 < completed delete operation key=T6QRDTQRHBPI tag=5D0KXSW4PDO8 type=del 2024-09-12T17:05:12.012 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.007+0000 7f026be9d8c0 1 > prepared operation key=2BQJ30RQQ25L tag=5Y8Y0Q24T59O type=del size=503716 2024-09-12T17:05:12.015 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.011+0000 7f026be9d8c0 1 < completed delete operation key=4G3BKGNT3YZC tag=W7R0HCBYCTRJ type=del 2024-09-12T17:05:12.022 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.015+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~U0VV7NJ78A0K.0 size=1048576 2024-09-12T17:05:12.024 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.019+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~U0VV7NJ78A0K.1 size=1048576 2024-09-12T17:05:12.027 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.023+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~U0VV7NJ78A0K.2 size=637094 2024-09-12T17:05:12.027 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.023+0000 7f026be9d8c0 1 > prepared multipart upload key=J8MU1A0CWSAQ upload=U0VV7NJ78A0K tag=DREPPNCK7D1N type=write size=3782822 2024-09-12T17:05:12.030 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.027+0000 7f026be9d8c0 1 < completed delete operation key=PQSQ39X3O64P tag=OHQX6KQU3CXT type=del 2024-09-12T17:05:12.036 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.031+0000 7f026be9d8c0 1 > prepared part key=_multipart_E0Y3SKNUYCQS.2~305MYFLZCYTT.0 size=1048576 2024-09-12T17:05:12.039 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.035+0000 7f026be9d8c0 1 > prepared part key=_multipart_E0Y3SKNUYCQS.2~305MYFLZCYTT.1 size=1048576 2024-09-12T17:05:12.041 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.035+0000 7f026be9d8c0 1 > prepared part key=_multipart_E0Y3SKNUYCQS.2~305MYFLZCYTT.2 size=50594 2024-09-12T17:05:12.041 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.035+0000 7f026be9d8c0 1 > prepared multipart upload key=E0Y3SKNUYCQS upload=305MYFLZCYTT tag=ECLQC2GPDMC6 type=write size=3196322 2024-09-12T17:05:12.045 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.039+0000 7f026be9d8c0 1 < completed delete operation key=SL2446KSB531 tag=HWRTUK7GCIIT type=del 2024-09-12T17:05:12.048 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.043+0000 7f026be9d8c0 1 > prepared operation key=4U1W97V0OX11 tag=WJSEHMATVDYK type=write size=1047775 2024-09-12T17:05:12.051 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.047+0000 7f026be9d8c0 1 < completed delete operation key=U8W1SAVSLTBF tag=2CAMW53H7UWX type=del 2024-09-12T17:05:12.054 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.051+0000 7f026be9d8c0 1 > prepared operation key=Z9YNIEQCVNBA tag=GX8RRJV67YI5 type=del size=730534 2024-09-12T17:05:12.057 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.051+0000 7f026be9d8c0 1 < completed delete operation key=2BQJ30RQQ25L tag=09R7F6XE93VY type=del 2024-09-12T17:05:12.063 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.059+0000 7f026be9d8c0 1 > prepared part key=_multipart_RBNN03IPZ8BT.2~5O7MJZNVL1MX.0 size=1048576 2024-09-12T17:05:12.065 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.059+0000 7f026be9d8c0 1 > prepared part key=_multipart_RBNN03IPZ8BT.2~5O7MJZNVL1MX.1 size=372417 2024-09-12T17:05:12.065 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.059+0000 7f026be9d8c0 1 > prepared multipart upload key=RBNN03IPZ8BT upload=5O7MJZNVL1MX tag=CP0JMC4AUWTL type=write size=2469569 2024-09-12T17:05:12.069 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.063+0000 7f026be9d8c0 1 < completed delete operation key=4U1W97V0OX11 tag=J9A3UN8FHQQ3 type=del 2024-09-12T17:05:12.074 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.071+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~FTBAODES23SJ.0 size=822299 2024-09-12T17:05:12.075 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.071+0000 7f026be9d8c0 1 > prepared multipart upload key=UU88OS653L8D upload=FTBAODES23SJ tag=J591WUTUPBEX type=write size=1870875 2024-09-12T17:05:12.082 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.075+0000 7f026be9d8c0 1 < suggested update operation key=T6QRDTQRHBPI tag=1Q6IH6CE6SEI type=del size=376959 2024-09-12T17:05:12.085 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.079+0000 7f026be9d8c0 1 > prepared operation key=SL2446KSB531 tag=ZFSPLGZPU52I type=del size=1124440 2024-09-12T17:05:12.089 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.083+0000 7f026be9d8c0 1 < completed part key=_multipart_SGT8IC1GJ3IG.2~4IRRQYD3F2HH.0 size=1048576 2024-09-12T17:05:12.095 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.091+0000 7f026be9d8c0 1 < completed part key=_multipart_SGT8IC1GJ3IG.2~4IRRQYD3F2HH.1 size=1048576 2024-09-12T17:05:12.097 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.091+0000 7f026be9d8c0 1 < completed part key=_multipart_SGT8IC1GJ3IG.2~4IRRQYD3F2HH.2 size=975339 2024-09-12T17:05:12.103 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.099+0000 7f026be9d8c0 1 < completed multipart upload key=SGT8IC1GJ3IG upload=4IRRQYD3F2HH tag=G4OEN4ACEEEC type=write size=4121067 2024-09-12T17:05:12.110 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.103+0000 7f026be9d8c0 1 > prepared part key=_multipart_T6QRDTQRHBPI.2~2B5FM73A97IU.0 size=431003 2024-09-12T17:05:12.110 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.103+0000 7f026be9d8c0 1 > prepared multipart upload key=T6QRDTQRHBPI upload=2B5FM73A97IU tag=O96D1R8FGQ9U type=write size=1479579 2024-09-12T17:05:12.117 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.111+0000 7f026be9d8c0 1 < suggested remove operation key=4U1W97V0OX11 tag=MCV56153NM19 type=write 2024-09-12T17:05:12.120 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.115+0000 7f026be9d8c0 1 > prepared operation key=MVYWUWKSYQ9Z tag=ZF4RE1KOI06C type=del size=782412 2024-09-12T17:05:12.124 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.119+0000 7f026be9d8c0 1 < canceled operation key=SL2446KSB531 tag=YOXUCI6TLDP5 type=del size=172089 2024-09-12T17:05:12.127 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.123+0000 7f026be9d8c0 1 > prepared operation key=GPUFWJ3AWEMX tag=RNHUTAGAEKG0 type=del size=712590 2024-09-12T17:05:12.132 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.127+0000 7f026be9d8c0 1 < completed part key=_multipart_4U1W97V0OX11.2~7ISFZX8BOP50.0 size=1006330 2024-09-12T17:05:12.138 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.135+0000 7f026be9d8c0 1 < completed multipart upload key=4U1W97V0OX11 upload=7ISFZX8BOP50 tag=ZVPRSAWX0RRZ type=write size=2054906 2024-09-12T17:05:12.145 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.139+0000 7f026be9d8c0 1 > prepared part key=_multipart_E0Y3SKNUYCQS.2~GMRPL2UCE37S.0 size=1048576 2024-09-12T17:05:12.147 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.143+0000 7f026be9d8c0 1 > prepared part key=_multipart_E0Y3SKNUYCQS.2~GMRPL2UCE37S.1 size=936965 2024-09-12T17:05:12.148 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.143+0000 7f026be9d8c0 1 > prepared multipart upload key=E0Y3SKNUYCQS upload=GMRPL2UCE37S tag=8PAJ3OVI3MFZ type=write size=3034117 2024-09-12T17:05:12.151 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.147+0000 7f026be9d8c0 1 < completed part key=_multipart_RBNN03IPZ8BT.2~W0JLMNYDV0HV.0 size=1048576 2024-09-12T17:05:12.153 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.147+0000 7f026be9d8c0 1 < completed part key=_multipart_RBNN03IPZ8BT.2~W0JLMNYDV0HV.1 size=1048576 2024-09-12T17:05:12.156 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.151+0000 7f026be9d8c0 1 < completed part key=_multipart_RBNN03IPZ8BT.2~W0JLMNYDV0HV.2 size=757900 2024-09-12T17:05:12.162 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.159+0000 7f026be9d8c0 1 < completed multipart upload key=RBNN03IPZ8BT upload=W0JLMNYDV0HV tag=7MKDX28U26OH type=write size=3903628 2024-09-12T17:05:12.165 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.159+0000 7f026be9d8c0 1 > prepared operation key=PQSQ39X3O64P tag=81CROLI6DAXI type=del size=3137892 2024-09-12T17:05:12.173 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.167+0000 7f026be9d8c0 1 < suggested remove operation key=4U1W97V0OX11 tag=T03KA0K79W8A type=del 2024-09-12T17:05:12.179 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.175+0000 7f026be9d8c0 1 > prepared part key=_multipart_LHKLWIUAT08F.2~NYPOKJNMD6YS.0 size=2365 2024-09-12T17:05:12.179 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.175+0000 7f026be9d8c0 1 > prepared multipart upload key=LHKLWIUAT08F upload=NYPOKJNMD6YS tag=VA9JQOJCLMJ6 type=write size=1050941 2024-09-12T17:05:12.183 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.179+0000 7f026be9d8c0 1 < completed delete operation key=E0Y3SKNUYCQS tag=CEN7NMWLT7BP type=del 2024-09-12T17:05:12.190 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.187+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~NH2WFTO32BNS.0 size=193258 2024-09-12T17:05:12.190 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.187+0000 7f026be9d8c0 1 > prepared multipart upload key=ALFGNC1YNROX upload=NH2WFTO32BNS tag=90M0EKCZ1ZUK type=write size=1241834 2024-09-12T17:05:12.193 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.187+0000 7f026be9d8c0 1 < completed write operation key=U8W1SAVSLTBF tag=H6SYNSTEYOQO type=write size=55685 2024-09-12T17:05:12.197 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.191+0000 7f026be9d8c0 1 > prepared operation key=SGT8IC1GJ3IG tag=AZUM08ZGISZ1 type=write size=27528 2024-09-12T17:05:12.200 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.195+0000 7f026be9d8c0 1 < canceled operation key=2BQJ30RQQ25L tag=5Y8Y0Q24T59O type=del size=503716 2024-09-12T17:05:12.207 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.203+0000 7f026be9d8c0 1 > prepared part key=_multipart_PQSQ39X3O64P.2~2REYW2VXU8TA.0 size=461022 2024-09-12T17:05:12.207 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.203+0000 7f026be9d8c0 1 > prepared multipart upload key=PQSQ39X3O64P upload=2REYW2VXU8TA tag=UVA6Z9M16IN3 type=write size=1509598 2024-09-12T17:05:12.210 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.207+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~U0VV7NJ78A0K.0 size=1048576 2024-09-12T17:05:12.213 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.207+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~U0VV7NJ78A0K.1 size=1048576 2024-09-12T17:05:12.216 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.211+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~U0VV7NJ78A0K.2 size=637094 2024-09-12T17:05:12.221 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.215+0000 7f026be9d8c0 1 < completed multipart upload key=J8MU1A0CWSAQ upload=U0VV7NJ78A0K tag=DREPPNCK7D1N type=write size=3782822 2024-09-12T17:05:12.228 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.223+0000 7f026be9d8c0 1 > prepared part key=_multipart_RBNN03IPZ8BT.2~3L3CLUR4FW76.0 size=1048576 2024-09-12T17:05:12.230 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.227+0000 7f026be9d8c0 1 > prepared part key=_multipart_RBNN03IPZ8BT.2~3L3CLUR4FW76.1 size=1025787 2024-09-12T17:05:12.231 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.227+0000 7f026be9d8c0 1 > prepared multipart upload key=RBNN03IPZ8BT upload=3L3CLUR4FW76 tag=ZI276SX8FGNI type=write size=3122939 2024-09-12T17:05:12.234 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.231+0000 7f026be9d8c0 1 < completed part key=_multipart_E0Y3SKNUYCQS.2~305MYFLZCYTT.0 size=1048576 2024-09-12T17:05:12.237 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.231+0000 7f026be9d8c0 1 < completed part key=_multipart_E0Y3SKNUYCQS.2~305MYFLZCYTT.1 size=1048576 2024-09-12T17:05:12.240 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.235+0000 7f026be9d8c0 1 < completed part key=_multipart_E0Y3SKNUYCQS.2~305MYFLZCYTT.2 size=50594 2024-09-12T17:05:12.247 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.243+0000 7f026be9d8c0 1 < completed multipart upload key=E0Y3SKNUYCQS upload=305MYFLZCYTT tag=ECLQC2GPDMC6 type=write size=3196322 2024-09-12T17:05:12.251 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.247+0000 7f026be9d8c0 1 > prepared operation key=2BQJ30RQQ25L tag=Q8ZNSGM0L1WL type=del size=1859891 2024-09-12T17:05:12.253 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.247+0000 7f026be9d8c0 -1 < no bi entry to suggest for operation key=4U1W97V0OX11 tag=WJSEHMATVDYK type=write size=1047775: (2) No such file or directory 2024-09-12T17:05:12.257 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.251+0000 7f026be9d8c0 1 > prepared operation key=ALFGNC1YNROX tag=UUNPDIIAFSQN type=del size=1470275 2024-09-12T17:05:12.262 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.259+0000 7f026be9d8c0 1 < canceled operation key=Z9YNIEQCVNBA tag=GX8RRJV67YI5 type=del size=730534 2024-09-12T17:05:12.266 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.263+0000 7f026be9d8c0 1 > prepared operation key=SL2446KSB531 tag=QXMYWKT48G6M type=del size=2909708 2024-09-12T17:05:12.270 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.267+0000 7f026be9d8c0 1 < completed part key=_multipart_RBNN03IPZ8BT.2~5O7MJZNVL1MX.0 size=1048576 2024-09-12T17:05:12.270 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.267+0000 7f026be9d8c0 1 < canceled part key=_multipart_RBNN03IPZ8BT.2~5O7MJZNVL1MX.1 size=372417 2024-09-12T17:05:12.277 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.271+0000 7f026be9d8c0 1 < canceled multipart upload key=RBNN03IPZ8BT upload=5O7MJZNVL1MX tag=CP0JMC4AUWTL type=write size=2469569 2024-09-12T17:05:12.281 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.275+0000 7f026be9d8c0 1 > prepared operation key=MVYWUWKSYQ9Z tag=NA3VR30YJ8U0 type=del size=1651951 2024-09-12T17:05:12.284 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.279+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~FTBAODES23SJ.0 size=822299 2024-09-12T17:05:12.291 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.287+0000 7f026be9d8c0 1 < completed multipart upload key=UU88OS653L8D upload=FTBAODES23SJ tag=J591WUTUPBEX type=write size=1870875 2024-09-12T17:05:12.299 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.295+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~6IEHDTESVL5S.0 size=1048576 2024-09-12T17:05:12.303 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.299+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~6IEHDTESVL5S.1 size=660312 2024-09-12T17:05:12.303 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.299+0000 7f026be9d8c0 1 > prepared multipart upload key=QVQ4TI319DH5 upload=6IEHDTESVL5S tag=MU7B8FLJHAXH type=write size=2757464 2024-09-12T17:05:12.307 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.303+0000 7f026be9d8c0 1 < completed delete operation key=SL2446KSB531 tag=ZFSPLGZPU52I type=del 2024-09-12T17:05:12.314 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.311+0000 7f026be9d8c0 1 > prepared part key=_multipart_XNBE2II106VZ.2~R3B0EMKXVZUE.0 size=433488 2024-09-12T17:05:12.314 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.311+0000 7f026be9d8c0 1 > prepared multipart upload key=XNBE2II106VZ upload=R3B0EMKXVZUE tag=2A7BCWWPK6LE type=write size=1482064 2024-09-12T17:05:12.317 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.311+0000 7f026be9d8c0 1 < completed part key=_multipart_T6QRDTQRHBPI.2~2B5FM73A97IU.0 size=431003 2024-09-12T17:05:12.323 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.319+0000 7f026be9d8c0 1 < completed multipart upload key=T6QRDTQRHBPI upload=2B5FM73A97IU tag=O96D1R8FGQ9U type=write size=1479579 2024-09-12T17:05:12.329 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.323+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~8TY3GDPIQB8X.0 size=1048576 2024-09-12T17:05:12.331 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.327+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~8TY3GDPIQB8X.1 size=919403 2024-09-12T17:05:12.331 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.327+0000 7f026be9d8c0 1 > prepared multipart upload key=JJMEQ2O00SA2 upload=8TY3GDPIQB8X tag=H010TQFSJ0HK type=write size=3016555 2024-09-12T17:05:12.335 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.331+0000 7f026be9d8c0 1 < canceled operation key=MVYWUWKSYQ9Z tag=ZF4RE1KOI06C type=del size=782412 2024-09-12T17:05:12.338 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.335+0000 7f026be9d8c0 1 > prepared operation key=JJMEQ2O00SA2 tag=U3K4NC3VASMS type=del size=2809138 2024-09-12T17:05:12.342 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.335+0000 7f026be9d8c0 1 < completed delete operation key=GPUFWJ3AWEMX tag=RNHUTAGAEKG0 type=del 2024-09-12T17:05:12.348 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.343+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~KQ1OMRS836PO.0 size=175975 2024-09-12T17:05:12.348 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.343+0000 7f026be9d8c0 1 > prepared multipart upload key=J8MU1A0CWSAQ upload=KQ1OMRS836PO tag=LNJDQMZ9MIN9 type=write size=1224551 2024-09-12T17:05:12.351 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.347+0000 7f026be9d8c0 1 < completed part key=_multipart_E0Y3SKNUYCQS.2~GMRPL2UCE37S.0 size=1048576 2024-09-12T17:05:12.354 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.351+0000 7f026be9d8c0 1 < completed part key=_multipart_E0Y3SKNUYCQS.2~GMRPL2UCE37S.1 size=936965 2024-09-12T17:05:12.359 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.355+0000 7f026be9d8c0 1 < completed multipart upload key=E0Y3SKNUYCQS upload=GMRPL2UCE37S tag=8PAJ3OVI3MFZ type=write size=3034117 2024-09-12T17:05:12.366 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.359+0000 7f026be9d8c0 1 > prepared part key=_multipart_4U1W97V0OX11.2~AMQA6VLKXU9R.0 size=1048576 2024-09-12T17:05:12.368 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.363+0000 7f026be9d8c0 1 > prepared part key=_multipart_4U1W97V0OX11.2~AMQA6VLKXU9R.1 size=1048576 2024-09-12T17:05:12.371 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.367+0000 7f026be9d8c0 1 > prepared part key=_multipart_4U1W97V0OX11.2~AMQA6VLKXU9R.2 size=261432 2024-09-12T17:05:12.371 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.367+0000 7f026be9d8c0 1 > prepared multipart upload key=4U1W97V0OX11 upload=AMQA6VLKXU9R tag=W5IED2U0XS25 type=write size=3407160 2024-09-12T17:05:12.378 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.375+0000 7f026be9d8c0 1 < suggested update operation key=PQSQ39X3O64P tag=81CROLI6DAXI type=del size=3137892 2024-09-12T17:05:12.381 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.375+0000 7f026be9d8c0 1 > prepared operation key=6VO85REZG2NW tag=BGUKZR318VN0 type=del size=3966617 2024-09-12T17:05:12.385 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.379+0000 7f026be9d8c0 1 < completed part key=_multipart_LHKLWIUAT08F.2~NYPOKJNMD6YS.0 size=2365 2024-09-12T17:05:12.390 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.387+0000 7f026be9d8c0 1 < completed multipart upload key=LHKLWIUAT08F upload=NYPOKJNMD6YS tag=VA9JQOJCLMJ6 type=write size=1050941 2024-09-12T17:05:12.397 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.391+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~32X5PXDPHP8Q.0 size=1048576 2024-09-12T17:05:12.399 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.395+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~32X5PXDPHP8Q.1 size=869730 2024-09-12T17:05:12.399 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.395+0000 7f026be9d8c0 1 > prepared multipart upload key=JJMEQ2O00SA2 upload=32X5PXDPHP8Q tag=Y3U0Z0CERMYF type=write size=2966882 2024-09-12T17:05:12.402 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.399+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~NH2WFTO32BNS.0 size=193258 2024-09-12T17:05:12.408 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.403+0000 7f026be9d8c0 1 < completed multipart upload key=ALFGNC1YNROX upload=NH2WFTO32BNS tag=90M0EKCZ1ZUK type=write size=1241834 2024-09-12T17:05:12.414 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.411+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~CVAMYB8ZCQ5B.0 size=1040969 2024-09-12T17:05:12.415 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.411+0000 7f026be9d8c0 1 > prepared multipart upload key=JJMEQ2O00SA2 upload=CVAMYB8ZCQ5B tag=A0KHDX1YLCSK type=write size=2089545 2024-09-12T17:05:12.418 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.415+0000 7f026be9d8c0 1 < completed write operation key=SGT8IC1GJ3IG tag=AZUM08ZGISZ1 type=write size=27528 2024-09-12T17:05:12.422 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.419+0000 7f026be9d8c0 1 > prepared operation key=MVYWUWKSYQ9Z tag=GTIMB2NKU6W5 type=write size=16357 2024-09-12T17:05:12.430 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.427+0000 7f026be9d8c0 1 < completed part key=_multipart_PQSQ39X3O64P.2~2REYW2VXU8TA.0 size=461022 2024-09-12T17:05:12.436 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.431+0000 7f026be9d8c0 1 < completed multipart upload key=PQSQ39X3O64P upload=2REYW2VXU8TA tag=UVA6Z9M16IN3 type=write size=1509598 2024-09-12T17:05:12.442 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.439+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~0NUU1JV493NS.0 size=175244 2024-09-12T17:05:12.442 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.439+0000 7f026be9d8c0 1 > prepared multipart upload key=XLKR6P8RNRVO upload=0NUU1JV493NS tag=KAKU2EC6JIG6 type=write size=1223820 2024-09-12T17:05:12.446 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.443+0000 7f026be9d8c0 1 < completed part key=_multipart_RBNN03IPZ8BT.2~3L3CLUR4FW76.0 size=1048576 2024-09-12T17:05:12.449 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.443+0000 7f026be9d8c0 1 < completed part key=_multipart_RBNN03IPZ8BT.2~3L3CLUR4FW76.1 size=1025787 2024-09-12T17:05:12.455 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.451+0000 7f026be9d8c0 1 < completed multipart upload key=RBNN03IPZ8BT upload=3L3CLUR4FW76 tag=ZI276SX8FGNI type=write size=3122939 2024-09-12T17:05:12.458 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.455+0000 7f026be9d8c0 1 > prepared operation key=BW1T21LBUE2D tag=ZFX7OL8FRD7W type=del size=3804584 2024-09-12T17:05:12.462 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.459+0000 7f026be9d8c0 1 < completed delete operation key=2BQJ30RQQ25L tag=Q8ZNSGM0L1WL type=del 2024-09-12T17:05:12.468 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.463+0000 7f026be9d8c0 1 > prepared part key=_multipart_SGT8IC1GJ3IG.2~2ZYKVW5V2P5X.0 size=834380 2024-09-12T17:05:12.469 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.463+0000 7f026be9d8c0 1 > prepared multipart upload key=SGT8IC1GJ3IG upload=2ZYKVW5V2P5X tag=90K65RD4WVQW type=write size=1882956 2024-09-12T17:05:12.472 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.467+0000 7f026be9d8c0 1 < completed delete operation key=ALFGNC1YNROX tag=UUNPDIIAFSQN type=del 2024-09-12T17:05:12.478 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.475+0000 7f026be9d8c0 1 > prepared part key=_multipart_MVYWUWKSYQ9Z.2~6YD0009P5N61.0 size=593513 2024-09-12T17:05:12.478 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.475+0000 7f026be9d8c0 1 > prepared multipart upload key=MVYWUWKSYQ9Z upload=6YD0009P5N61 tag=IL391C6JYA0T type=write size=1642089 2024-09-12T17:05:12.486 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.479+0000 7f026be9d8c0 1 < suggested update operation key=SL2446KSB531 tag=QXMYWKT48G6M type=del size=2909708 2024-09-12T17:05:12.492 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.487+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~6ABYIY3HBARX.0 size=1048576 2024-09-12T17:05:12.495 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.491+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~6ABYIY3HBARX.1 size=1033818 2024-09-12T17:05:12.495 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.491+0000 7f026be9d8c0 1 > prepared multipart upload key=BW1T21LBUE2D upload=6ABYIY3HBARX tag=MRNM86FWTWQ2 type=write size=3130970 2024-09-12T17:05:12.499 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.495+0000 7f026be9d8c0 1 < completed delete operation key=MVYWUWKSYQ9Z tag=NA3VR30YJ8U0 type=del 2024-09-12T17:05:12.503 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.499+0000 7f026be9d8c0 1 > prepared operation key=JJMEQ2O00SA2 tag=VVG6WIW97J1U type=del size=1718250 2024-09-12T17:05:12.506 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.503+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~6IEHDTESVL5S.0 size=1048576 2024-09-12T17:05:12.509 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.503+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~6IEHDTESVL5S.1 size=660312 2024-09-12T17:05:12.515 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.511+0000 7f026be9d8c0 1 < completed multipart upload key=QVQ4TI319DH5 upload=6IEHDTESVL5S tag=MU7B8FLJHAXH type=write size=2757464 2024-09-12T17:05:12.519 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.515+0000 7f026be9d8c0 1 > prepared operation key=PQSQ39X3O64P tag=J7A0JT5PTNYT type=del size=3133001 2024-09-12T17:05:12.523 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.519+0000 7f026be9d8c0 1 < completed part key=_multipart_XNBE2II106VZ.2~R3B0EMKXVZUE.0 size=433488 2024-09-12T17:05:12.528 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.523+0000 7f026be9d8c0 1 < completed multipart upload key=XNBE2II106VZ upload=R3B0EMKXVZUE tag=2A7BCWWPK6LE type=write size=1482064 2024-09-12T17:05:12.532 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.527+0000 7f026be9d8c0 1 > prepared operation key=8AFDAVJLMRD2 tag=U1X0HTETORR3 type=del size=2928505 2024-09-12T17:05:12.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.531+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~8TY3GDPIQB8X.0 size=1048576 2024-09-12T17:05:12.539 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.535+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~8TY3GDPIQB8X.1 size=919403 2024-09-12T17:05:12.546 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.543+0000 7f026be9d8c0 1 < completed multipart upload key=JJMEQ2O00SA2 upload=8TY3GDPIQB8X tag=H010TQFSJ0HK type=write size=3016555 2024-09-12T17:05:12.549 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.543+0000 7f026be9d8c0 1 > prepared operation key=T6QRDTQRHBPI tag=FOOQWHWTL5VL type=del size=3323968 2024-09-12T17:05:12.553 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.547+0000 7f026be9d8c0 1 < completed delete operation key=JJMEQ2O00SA2 tag=U3K4NC3VASMS type=del 2024-09-12T17:05:12.557 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.551+0000 7f026be9d8c0 1 > prepared operation key=XLKR6P8RNRVO tag=6D4VS55QKLAS type=del size=2579955 2024-09-12T17:05:12.561 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.555+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~KQ1OMRS836PO.0 size=175975 2024-09-12T17:05:12.566 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.563+0000 7f026be9d8c0 1 < completed multipart upload key=J8MU1A0CWSAQ upload=KQ1OMRS836PO tag=LNJDQMZ9MIN9 type=write size=1224551 2024-09-12T17:05:12.570 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.567+0000 7f026be9d8c0 1 > prepared operation key=E0Y3SKNUYCQS tag=KQZUE5GTBK2G type=del size=987762 2024-09-12T17:05:12.573 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.567+0000 7f026be9d8c0 1 < completed part key=_multipart_4U1W97V0OX11.2~AMQA6VLKXU9R.0 size=1048576 2024-09-12T17:05:12.573 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.567+0000 7f026be9d8c0 1 < canceled part key=_multipart_4U1W97V0OX11.2~AMQA6VLKXU9R.1 size=1048576 2024-09-12T17:05:12.576 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.571+0000 7f026be9d8c0 1 < completed part key=_multipart_4U1W97V0OX11.2~AMQA6VLKXU9R.2 size=261432 2024-09-12T17:05:12.582 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.579+0000 7f026be9d8c0 1 < canceled multipart upload key=4U1W97V0OX11 upload=AMQA6VLKXU9R tag=W5IED2U0XS25 type=write size=3407160 2024-09-12T17:05:12.587 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.583+0000 7f026be9d8c0 1 > prepared operation key=8AFDAVJLMRD2 tag=F71J0OSD3X2S type=del size=658989 2024-09-12T17:05:12.591 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.587+0000 7f026be9d8c0 1 < completed delete operation key=6VO85REZG2NW tag=BGUKZR318VN0 type=del 2024-09-12T17:05:12.599 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.595+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~2E4F6UO64K4E.0 size=1048576 2024-09-12T17:05:12.602 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.595+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~2E4F6UO64K4E.1 size=1048576 2024-09-12T17:05:12.604 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.599+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~2E4F6UO64K4E.2 size=101093 2024-09-12T17:05:12.604 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.599+0000 7f026be9d8c0 1 > prepared multipart upload key=8AFDAVJLMRD2 upload=2E4F6UO64K4E tag=J22J2CXTNVFO type=write size=3246821 2024-09-12T17:05:12.608 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.603+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~32X5PXDPHP8Q.0 size=1048576 2024-09-12T17:05:12.611 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.607+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~32X5PXDPHP8Q.1 size=869730 2024-09-12T17:05:12.616 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.611+0000 7f026be9d8c0 1 < completed multipart upload key=JJMEQ2O00SA2 upload=32X5PXDPHP8Q tag=Y3U0Z0CERMYF type=write size=2966882 2024-09-12T17:05:12.620 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.615+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=3SK87RLSUS6L type=del size=804558 2024-09-12T17:05:12.623 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.619+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~CVAMYB8ZCQ5B.0 size=1040969 2024-09-12T17:05:12.629 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.623+0000 7f026be9d8c0 1 < completed multipart upload key=JJMEQ2O00SA2 upload=CVAMYB8ZCQ5B tag=A0KHDX1YLCSK type=write size=2089545 2024-09-12T17:05:12.635 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.631+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~SU9C72MLDN86.0 size=421994 2024-09-12T17:05:12.636 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.631+0000 7f026be9d8c0 1 > prepared multipart upload key=Y27CDEOCM7DH upload=SU9C72MLDN86 tag=5LZM712Z9SJZ type=write size=1470570 2024-09-12T17:05:12.642 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.639+0000 7f026be9d8c0 1 < suggested remove operation key=MVYWUWKSYQ9Z tag=GTIMB2NKU6W5 type=write 2024-09-12T17:05:12.645 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.639+0000 7f026be9d8c0 1 > prepared operation key=4G3BKGNT3YZC tag=T2VM89FM4VDR type=write size=486057 2024-09-12T17:05:12.649 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.643+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~0NUU1JV493NS.0 size=175244 2024-09-12T17:05:12.655 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.651+0000 7f026be9d8c0 1 < completed multipart upload key=XLKR6P8RNRVO upload=0NUU1JV493NS tag=KAKU2EC6JIG6 type=write size=1223820 2024-09-12T17:05:12.658 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.655+0000 7f026be9d8c0 1 > prepared operation key=ALFGNC1YNROX tag=E2WISLM5TA5R type=del size=1187877 2024-09-12T17:05:12.661 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.655+0000 7f026be9d8c0 1 < completed delete operation key=BW1T21LBUE2D tag=ZFX7OL8FRD7W type=del 2024-09-12T17:05:12.665 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.659+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=YHL670LNAB0M type=del size=558299 2024-09-12T17:05:12.669 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.663+0000 7f026be9d8c0 1 < completed part key=_multipart_SGT8IC1GJ3IG.2~2ZYKVW5V2P5X.0 size=834380 2024-09-12T17:05:12.675 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.671+0000 7f026be9d8c0 1 < completed multipart upload key=SGT8IC1GJ3IG upload=2ZYKVW5V2P5X tag=90K65RD4WVQW type=write size=1882956 2024-09-12T17:05:12.681 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.675+0000 7f026be9d8c0 1 > prepared part key=_multipart_4U1W97V0OX11.2~DIZK4YFSRJ6I.0 size=195819 2024-09-12T17:05:12.681 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.675+0000 7f026be9d8c0 1 > prepared multipart upload key=4U1W97V0OX11 upload=DIZK4YFSRJ6I tag=VO5E8AXK2XZG type=write size=1244395 2024-09-12T17:05:12.685 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.679+0000 7f026be9d8c0 1 < completed part key=_multipart_MVYWUWKSYQ9Z.2~6YD0009P5N61.0 size=593513 2024-09-12T17:05:12.690 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.687+0000 7f026be9d8c0 1 < completed multipart upload key=MVYWUWKSYQ9Z upload=6YD0009P5N61 tag=IL391C6JYA0T type=write size=1642089 2024-09-12T17:05:12.694 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.691+0000 7f026be9d8c0 1 > prepared operation key=J8MU1A0CWSAQ tag=483676EQHWVY type=write size=937917 2024-09-12T17:05:12.697 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.691+0000 7f026be9d8c0 1 < completed part key=_multipart_BW1T21LBUE2D.2~6ABYIY3HBARX.0 size=1048576 2024-09-12T17:05:12.700 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.695+0000 7f026be9d8c0 1 < completed part key=_multipart_BW1T21LBUE2D.2~6ABYIY3HBARX.1 size=1033818 2024-09-12T17:05:12.706 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.703+0000 7f026be9d8c0 1 < completed multipart upload key=BW1T21LBUE2D upload=6ABYIY3HBARX tag=MRNM86FWTWQ2 type=write size=3130970 2024-09-12T17:05:12.710 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.703+0000 7f026be9d8c0 1 > prepared operation key=BBYDPSXZKHZP tag=MCBBH9CZI6JU type=del size=1676514 2024-09-12T17:05:12.713 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.707+0000 7f026be9d8c0 1 < completed delete operation key=JJMEQ2O00SA2 tag=VVG6WIW97J1U type=del 2024-09-12T17:05:12.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.711+0000 7f026be9d8c0 1 > prepared operation key=E0Y3SKNUYCQS tag=CJ38127INY21 type=write size=179389 2024-09-12T17:05:12.720 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.715+0000 7f026be9d8c0 1 < completed delete operation key=PQSQ39X3O64P tag=J7A0JT5PTNYT type=del 2024-09-12T17:05:12.724 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.719+0000 7f026be9d8c0 1 > prepared operation key=ALFGNC1YNROX tag=46FN0JC6QY1O type=del size=277361 2024-09-12T17:05:12.731 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.727+0000 7f026be9d8c0 1 < suggested remove operation key=8AFDAVJLMRD2 tag=U1X0HTETORR3 type=del 2024-09-12T17:05:12.735 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.731+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=K33GVBE6Q1QW type=del size=2779137 2024-09-12T17:05:12.739 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.735+0000 7f026be9d8c0 1 < completed delete operation key=T6QRDTQRHBPI tag=FOOQWHWTL5VL type=del 2024-09-12T17:05:12.742 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.739+0000 7f026be9d8c0 1 > prepared operation key=UU88OS653L8D tag=IBCA7NI3ER72 type=write size=755160 2024-09-12T17:05:12.746 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.739+0000 7f026be9d8c0 1 < canceled operation key=XLKR6P8RNRVO tag=6D4VS55QKLAS type=del size=2579955 2024-09-12T17:05:12.749 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.743+0000 7f026be9d8c0 1 > prepared operation key=SGT8IC1GJ3IG tag=KLPR4CRS1BD0 type=del size=3524899 2024-09-12T17:05:12.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.747+0000 7f026be9d8c0 1 < canceled operation key=E0Y3SKNUYCQS tag=KQZUE5GTBK2G type=del size=987762 2024-09-12T17:05:12.756 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.751+0000 7f026be9d8c0 1 > prepared operation key=Y27CDEOCM7DH tag=LLG1KXPZDETV type=del size=3708615 2024-09-12T17:05:12.759 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.755+0000 7f026be9d8c0 -1 < failed to complete operation key=8AFDAVJLMRD2 tag=F71J0OSD3X2S type=del size=658989: (22) Invalid argument 2024-09-12T17:05:12.766 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.763+0000 7f026be9d8c0 1 > prepared operation key=BW1T21LBUE2D tag=8BHIZ3IALVYY type=del size=758728 2024-09-12T17:05:12.769 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.763+0000 7f026be9d8c0 1 < completed part key=_multipart_8AFDAVJLMRD2.2~2E4F6UO64K4E.0 size=1048576 2024-09-12T17:05:12.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.767+0000 7f026be9d8c0 1 < completed part key=_multipart_8AFDAVJLMRD2.2~2E4F6UO64K4E.1 size=1048576 2024-09-12T17:05:12.775 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.771+0000 7f026be9d8c0 1 < completed part key=_multipart_8AFDAVJLMRD2.2~2E4F6UO64K4E.2 size=101093 2024-09-12T17:05:12.781 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.775+0000 7f026be9d8c0 1 < completed multipart upload key=8AFDAVJLMRD2 upload=2E4F6UO64K4E tag=J22J2CXTNVFO type=write size=3246821 2024-09-12T17:05:12.784 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.779+0000 7f026be9d8c0 1 > prepared operation key=SGT8IC1GJ3IG tag=6HPMP319TMK5 type=write size=298456 2024-09-12T17:05:12.788 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.783+0000 7f026be9d8c0 1 < completed delete operation key=U8W1SAVSLTBF tag=3SK87RLSUS6L type=del 2024-09-12T17:05:12.791 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.787+0000 7f026be9d8c0 1 > prepared operation key=4U1W97V0OX11 tag=LBIA6J6EHW5C type=del size=2074630 2024-09-12T17:05:12.792 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.787+0000 7f026be9d8c0 1 < canceled part key=_multipart_Y27CDEOCM7DH.2~SU9C72MLDN86.0 size=421994 2024-09-12T17:05:12.797 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.791+0000 7f026be9d8c0 1 < canceled multipart upload key=Y27CDEOCM7DH upload=SU9C72MLDN86 tag=5LZM712Z9SJZ type=write size=1470570 2024-09-12T17:05:12.801 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.795+0000 7f026be9d8c0 1 > prepared operation key=LHKLWIUAT08F tag=CZ5379PS62SL type=write size=66544 2024-09-12T17:05:12.808 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.803+0000 7f026be9d8c0 1 < suggested update operation key=4G3BKGNT3YZC tag=T2VM89FM4VDR type=write size=486057 2024-09-12T17:05:12.814 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.807+0000 7f026be9d8c0 1 > prepared part key=_multipart_T6QRDTQRHBPI.2~T11P181ILNSJ.0 size=1048576 2024-09-12T17:05:12.816 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.811+0000 7f026be9d8c0 1 > prepared part key=_multipart_T6QRDTQRHBPI.2~T11P181ILNSJ.1 size=251407 2024-09-12T17:05:12.816 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.811+0000 7f026be9d8c0 1 > prepared multipart upload key=T6QRDTQRHBPI upload=T11P181ILNSJ tag=SBO2605T1G68 type=write size=2348559 2024-09-12T17:05:12.819 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.815+0000 7f026be9d8c0 1 < completed delete operation key=ALFGNC1YNROX tag=E2WISLM5TA5R type=del 2024-09-12T17:05:12.822 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.819+0000 7f026be9d8c0 1 > prepared operation key=Z9YNIEQCVNBA tag=82ZEULJUFHH6 type=del size=2180040 2024-09-12T17:05:12.825 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.819+0000 7f026be9d8c0 1 < completed delete operation key=U8W1SAVSLTBF tag=YHL670LNAB0M type=del 2024-09-12T17:05:12.831 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.827+0000 7f026be9d8c0 1 > prepared part key=_multipart_T6QRDTQRHBPI.2~DCSB2CUVJA9V.0 size=1048576 2024-09-12T17:05:12.833 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.827+0000 7f026be9d8c0 1 > prepared part key=_multipart_T6QRDTQRHBPI.2~DCSB2CUVJA9V.1 size=434635 2024-09-12T17:05:12.833 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.827+0000 7f026be9d8c0 1 > prepared multipart upload key=T6QRDTQRHBPI upload=DCSB2CUVJA9V tag=YASY83ONSDB7 type=write size=2531787 2024-09-12T17:05:12.837 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.831+0000 7f026be9d8c0 1 < completed part key=_multipart_4U1W97V0OX11.2~DIZK4YFSRJ6I.0 size=195819 2024-09-12T17:05:12.843 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.839+0000 7f026be9d8c0 1 < completed multipart upload key=4U1W97V0OX11 upload=DIZK4YFSRJ6I tag=VO5E8AXK2XZG type=write size=1244395 2024-09-12T17:05:12.846 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.843+0000 7f026be9d8c0 1 > prepared operation key=SGT8IC1GJ3IG tag=Q32L444NDH6V type=del size=1803832 2024-09-12T17:05:12.849 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.843+0000 7f026be9d8c0 1 < canceled operation key=J8MU1A0CWSAQ tag=483676EQHWVY type=write size=937917 2024-09-12T17:05:12.852 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.847+0000 7f026be9d8c0 1 > prepared operation key=32XUMOWT8HO2 tag=OK693RG6RBUN type=del size=3949587 2024-09-12T17:05:12.856 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.851+0000 7f026be9d8c0 1 < completed delete operation key=BBYDPSXZKHZP tag=MCBBH9CZI6JU type=del 2024-09-12T17:05:12.860 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.855+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=6XCM6LVEZ54Z type=del size=2782087 2024-09-12T17:05:12.863 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.859+0000 7f026be9d8c0 1 < completed write operation key=E0Y3SKNUYCQS tag=CJ38127INY21 type=write size=179389 2024-09-12T17:05:12.870 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.867+0000 7f026be9d8c0 1 > prepared part key=_multipart_E0Y3SKNUYCQS.2~3K7K8GF1SS92.0 size=1025765 2024-09-12T17:05:12.870 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.867+0000 7f026be9d8c0 1 > prepared multipart upload key=E0Y3SKNUYCQS upload=3K7K8GF1SS92 tag=WGKSDRB2GMHI type=write size=2074341 2024-09-12T17:05:12.874 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.871+0000 7f026be9d8c0 1 < completed delete operation key=ALFGNC1YNROX tag=46FN0JC6QY1O type=del 2024-09-12T17:05:12.878 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.875+0000 7f026be9d8c0 1 > prepared operation key=Y27CDEOCM7DH tag=DE8NAVFODQ73 type=del size=3128729 2024-09-12T17:05:12.882 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.879+0000 7f026be9d8c0 1 < completed delete operation key=3JADN360QEO3 tag=K33GVBE6Q1QW type=del 2024-09-12T17:05:12.886 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.883+0000 7f026be9d8c0 1 > prepared operation key=LHKLWIUAT08F tag=F9TAPMWUJBVN type=del size=1674699 2024-09-12T17:05:12.890 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.887+0000 7f026be9d8c0 1 < completed write operation key=UU88OS653L8D tag=IBCA7NI3ER72 type=write size=755160 2024-09-12T17:05:12.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.891+0000 7f026be9d8c0 1 > prepared part key=_multipart_LHKLWIUAT08F.2~0FYYSUS8YNUK.0 size=1048576 2024-09-12T17:05:12.898 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.895+0000 7f026be9d8c0 1 > prepared part key=_multipart_LHKLWIUAT08F.2~0FYYSUS8YNUK.1 size=1048576 2024-09-12T17:05:12.901 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.895+0000 7f026be9d8c0 1 > prepared part key=_multipart_LHKLWIUAT08F.2~0FYYSUS8YNUK.2 size=556108 2024-09-12T17:05:12.901 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.895+0000 7f026be9d8c0 1 > prepared multipart upload key=LHKLWIUAT08F upload=0FYYSUS8YNUK tag=QK99ZGCEHT2J type=write size=3701836 2024-09-12T17:05:12.905 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.899+0000 7f026be9d8c0 1 < completed delete operation key=SGT8IC1GJ3IG tag=KLPR4CRS1BD0 type=del 2024-09-12T17:05:12.911 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.907+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~Q98PW9TZ7OB6.0 size=357489 2024-09-12T17:05:12.911 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.907+0000 7f026be9d8c0 1 > prepared multipart upload key=GPUFWJ3AWEMX upload=Q98PW9TZ7OB6 tag=5XP6AIGWZ68S type=write size=1406065 2024-09-12T17:05:12.919 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.915+0000 7f026be9d8c0 1 < suggested remove operation key=Y27CDEOCM7DH tag=LLG1KXPZDETV type=del 2024-09-12T17:05:12.922 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.919+0000 7f026be9d8c0 1 > prepared operation key=BBYDPSXZKHZP tag=O9DBYOF2V70W type=del size=918800 2024-09-12T17:05:12.926 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.923+0000 7f026be9d8c0 1 < completed delete operation key=BW1T21LBUE2D tag=8BHIZ3IALVYY type=del 2024-09-12T17:05:12.933 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.927+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~3ZSD7VEWPUI7.0 size=83691 2024-09-12T17:05:12.933 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.927+0000 7f026be9d8c0 1 > prepared multipart upload key=GPUFWJ3AWEMX upload=3ZSD7VEWPUI7 tag=MLER1QHJM3MC type=write size=1132267 2024-09-12T17:05:12.939 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.935+0000 7f026be9d8c0 1 < suggested remove operation key=SGT8IC1GJ3IG tag=6HPMP319TMK5 type=write 2024-09-12T17:05:12.946 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.943+0000 7f026be9d8c0 1 > prepared part key=_multipart_SGT8IC1GJ3IG.2~15HLO5V6OFYK.0 size=1048576 2024-09-12T17:05:12.948 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.943+0000 7f026be9d8c0 1 > prepared part key=_multipart_SGT8IC1GJ3IG.2~15HLO5V6OFYK.1 size=890270 2024-09-12T17:05:12.948 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.943+0000 7f026be9d8c0 1 > prepared multipart upload key=SGT8IC1GJ3IG upload=15HLO5V6OFYK tag=L9VRER1EDO5G type=write size=2987422 2024-09-12T17:05:12.951 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.947+0000 7f026be9d8c0 1 < completed delete operation key=4U1W97V0OX11 tag=LBIA6J6EHW5C type=del 2024-09-12T17:05:12.955 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.951+0000 7f026be9d8c0 1 > prepared operation key=JJMEQ2O00SA2 tag=BD8YWMG84GVQ type=del size=1056803 2024-09-12T17:05:12.958 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.955+0000 7f026be9d8c0 1 < completed write operation key=LHKLWIUAT08F tag=CZ5379PS62SL type=write size=66544 2024-09-12T17:05:12.962 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.959+0000 7f026be9d8c0 1 > prepared operation key=UU88OS653L8D tag=2BSU45SDLLQY type=del size=3787006 2024-09-12T17:05:12.966 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.959+0000 7f026be9d8c0 1 < completed part key=_multipart_T6QRDTQRHBPI.2~T11P181ILNSJ.0 size=1048576 2024-09-12T17:05:12.966 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.959+0000 7f026be9d8c0 1 < canceled part key=_multipart_T6QRDTQRHBPI.2~T11P181ILNSJ.1 size=251407 2024-09-12T17:05:12.972 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.967+0000 7f026be9d8c0 1 < canceled multipart upload key=T6QRDTQRHBPI upload=T11P181ILNSJ tag=SBO2605T1G68 type=write size=2348559 2024-09-12T17:05:12.976 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.971+0000 7f026be9d8c0 1 > prepared operation key=XNBE2II106VZ tag=E2OR5D7EIIR1 type=del size=3743567 2024-09-12T17:05:12.979 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.975+0000 7f026be9d8c0 1 < completed delete operation key=Z9YNIEQCVNBA tag=82ZEULJUFHH6 type=del 2024-09-12T17:05:12.986 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.983+0000 7f026be9d8c0 1 > prepared part key=_multipart_T6QRDTQRHBPI.2~KA40Z0G2KUVS.0 size=675487 2024-09-12T17:05:12.986 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.983+0000 7f026be9d8c0 1 > prepared multipart upload key=T6QRDTQRHBPI upload=KA40Z0G2KUVS tag=Z9W1PUDUX12Y type=write size=1724063 2024-09-12T17:05:12.990 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.987+0000 7f026be9d8c0 1 < completed part key=_multipart_T6QRDTQRHBPI.2~DCSB2CUVJA9V.0 size=1048576 2024-09-12T17:05:12.993 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.987+0000 7f026be9d8c0 1 < completed part key=_multipart_T6QRDTQRHBPI.2~DCSB2CUVJA9V.1 size=434635 2024-09-12T17:05:12.998 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.995+0000 7f026be9d8c0 1 < completed multipart upload key=T6QRDTQRHBPI upload=DCSB2CUVJA9V tag=YASY83ONSDB7 type=write size=2531787 2024-09-12T17:05:13.005 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:12.999+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~C1DNTYQYZ6BI.0 size=1048576 2024-09-12T17:05:13.008 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.003+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~C1DNTYQYZ6BI.1 size=1048576 2024-09-12T17:05:13.010 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.007+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~C1DNTYQYZ6BI.2 size=695150 2024-09-12T17:05:13.010 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.007+0000 7f026be9d8c0 1 > prepared multipart upload key=UU88OS653L8D upload=C1DNTYQYZ6BI tag=TV1LELLZXPHK type=write size=3840878 2024-09-12T17:05:13.014 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.007+0000 7f026be9d8c0 -1 < failed to complete operation key=SGT8IC1GJ3IG tag=Q32L444NDH6V type=del size=1803832: (22) Invalid argument 2024-09-12T17:05:13.017 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.011+0000 7f026be9d8c0 1 > prepared operation key=4G3BKGNT3YZC tag=QQHRAMXY8HTR type=del size=115989 2024-09-12T17:05:13.022 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.019+0000 7f026be9d8c0 1 < completed delete operation key=32XUMOWT8HO2 tag=OK693RG6RBUN type=del 2024-09-12T17:05:13.029 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.023+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~P387MKCO0VU3.0 size=1048576 2024-09-12T17:05:13.033 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.027+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~P387MKCO0VU3.1 size=1048576 2024-09-12T17:05:13.035 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.031+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~P387MKCO0VU3.2 size=94766 2024-09-12T17:05:13.035 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.031+0000 7f026be9d8c0 1 > prepared multipart upload key=Z9YNIEQCVNBA upload=P387MKCO0VU3 tag=4A090BFCEV2E type=write size=3240494 2024-09-12T17:05:13.039 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.035+0000 7f026be9d8c0 1 < completed delete operation key=3JADN360QEO3 tag=6XCM6LVEZ54Z type=del 2024-09-12T17:05:13.042 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.039+0000 7f026be9d8c0 1 > prepared operation key=SL2446KSB531 tag=VORCTDCO2NVV type=del size=3080070 2024-09-12T17:05:13.043 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.039+0000 7f026be9d8c0 1 < canceled part key=_multipart_E0Y3SKNUYCQS.2~3K7K8GF1SS92.0 size=1025765 2024-09-12T17:05:13.050 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.043+0000 7f026be9d8c0 1 < canceled multipart upload key=E0Y3SKNUYCQS upload=3K7K8GF1SS92 tag=WGKSDRB2GMHI type=write size=2074341 2024-09-12T17:05:13.058 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.051+0000 7f026be9d8c0 1 > prepared part key=_multipart_XNBE2II106VZ.2~V3CIHUKAHE1G.0 size=1048576 2024-09-12T17:05:13.060 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.055+0000 7f026be9d8c0 1 > prepared part key=_multipart_XNBE2II106VZ.2~V3CIHUKAHE1G.1 size=385046 2024-09-12T17:05:13.060 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.055+0000 7f026be9d8c0 1 > prepared multipart upload key=XNBE2II106VZ upload=V3CIHUKAHE1G tag=BQ05LO9UETN7 type=write size=2482198 2024-09-12T17:05:13.063 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.059+0000 7f026be9d8c0 -1 < failed to complete operation key=Y27CDEOCM7DH tag=DE8NAVFODQ73 type=del size=3128729: (22) Invalid argument 2024-09-12T17:05:13.067 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.063+0000 7f026be9d8c0 1 > prepared operation key=T6QRDTQRHBPI tag=OVST2OLZXOWO type=write size=740156 2024-09-12T17:05:13.070 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.067+0000 7f026be9d8c0 1 < canceled operation key=LHKLWIUAT08F tag=F9TAPMWUJBVN type=del size=1674699 2024-09-12T17:05:13.074 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.067+0000 7f026be9d8c0 1 > prepared operation key=Z183NH6R676V tag=PN51F8FCXX4F type=del size=2775293 2024-09-12T17:05:13.077 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.071+0000 7f026be9d8c0 1 < completed part key=_multipart_LHKLWIUAT08F.2~0FYYSUS8YNUK.0 size=1048576 2024-09-12T17:05:13.080 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.075+0000 7f026be9d8c0 1 < completed part key=_multipart_LHKLWIUAT08F.2~0FYYSUS8YNUK.1 size=1048576 2024-09-12T17:05:13.083 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.079+0000 7f026be9d8c0 1 < completed part key=_multipart_LHKLWIUAT08F.2~0FYYSUS8YNUK.2 size=556108 2024-09-12T17:05:13.089 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.083+0000 7f026be9d8c0 1 < completed multipart upload key=LHKLWIUAT08F upload=0FYYSUS8YNUK tag=QK99ZGCEHT2J type=write size=3701836 2024-09-12T17:05:13.100 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.095+0000 7f026be9d8c0 1 > prepared part key=_multipart_PQSQ39X3O64P.2~3CVZ1K1LQA5P.0 size=1048576 2024-09-12T17:05:13.103 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.099+0000 7f026be9d8c0 1 > prepared part key=_multipart_PQSQ39X3O64P.2~3CVZ1K1LQA5P.1 size=807731 2024-09-12T17:05:13.103 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.099+0000 7f026be9d8c0 1 > prepared multipart upload key=PQSQ39X3O64P upload=3CVZ1K1LQA5P tag=W6Y9KDTO2XQP type=write size=2904883 2024-09-12T17:05:13.107 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.103+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~Q98PW9TZ7OB6.0 size=357489 2024-09-12T17:05:13.112 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.107+0000 7f026be9d8c0 1 < completed multipart upload key=GPUFWJ3AWEMX upload=Q98PW9TZ7OB6 tag=5XP6AIGWZ68S type=write size=1406065 2024-09-12T17:05:13.116 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.111+0000 7f026be9d8c0 1 > prepared operation key=E0Y3SKNUYCQS tag=9IR3O3OP5NZ9 type=del size=3874911 2024-09-12T17:05:13.120 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.115+0000 7f026be9d8c0 1 < completed delete operation key=BBYDPSXZKHZP tag=O9DBYOF2V70W type=del 2024-09-12T17:05:13.125 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.119+0000 7f026be9d8c0 1 > prepared operation key=LHKLWIUAT08F tag=LO5PVK5WCV56 type=del size=1098241 2024-09-12T17:05:13.129 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.123+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~3ZSD7VEWPUI7.0 size=83691 2024-09-12T17:05:13.135 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.131+0000 7f026be9d8c0 1 < completed multipart upload key=GPUFWJ3AWEMX upload=3ZSD7VEWPUI7 tag=MLER1QHJM3MC type=write size=1132267 2024-09-12T17:05:13.139 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.135+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=T98OZ8YB0H7O type=del size=1303152 2024-09-12T17:05:13.142 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.139+0000 7f026be9d8c0 1 < completed part key=_multipart_SGT8IC1GJ3IG.2~15HLO5V6OFYK.0 size=1048576 2024-09-12T17:05:13.145 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.139+0000 7f026be9d8c0 1 < completed part key=_multipart_SGT8IC1GJ3IG.2~15HLO5V6OFYK.1 size=890270 2024-09-12T17:05:13.152 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.147+0000 7f026be9d8c0 1 < completed multipart upload key=SGT8IC1GJ3IG upload=15HLO5V6OFYK tag=L9VRER1EDO5G type=write size=2987422 2024-09-12T17:05:13.160 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.155+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~2I55HMUNR0HT.0 size=1048576 2024-09-12T17:05:13.163 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.159+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~2I55HMUNR0HT.1 size=258127 2024-09-12T17:05:13.163 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.159+0000 7f026be9d8c0 1 > prepared multipart upload key=8AFDAVJLMRD2 upload=2I55HMUNR0HT tag=6TJ3UWXAT8LU type=write size=2355279 2024-09-12T17:05:13.166 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.163+0000 7f026be9d8c0 1 < completed delete operation key=JJMEQ2O00SA2 tag=BD8YWMG84GVQ type=del 2024-09-12T17:05:13.169 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.163+0000 7f026be9d8c0 1 > prepared operation key=ALFGNC1YNROX tag=IAWAI5U01FF3 type=del size=962799 2024-09-12T17:05:13.173 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.167+0000 7f026be9d8c0 1 < completed delete operation key=UU88OS653L8D tag=2BSU45SDLLQY type=del 2024-09-12T17:05:13.179 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.175+0000 7f026be9d8c0 1 > prepared part key=_multipart_BBYDPSXZKHZP.2~MP41DFKPUT77.0 size=1048576 2024-09-12T17:05:13.182 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.175+0000 7f026be9d8c0 1 > prepared part key=_multipart_BBYDPSXZKHZP.2~MP41DFKPUT77.1 size=1025115 2024-09-12T17:05:13.182 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.175+0000 7f026be9d8c0 1 > prepared multipart upload key=BBYDPSXZKHZP upload=MP41DFKPUT77 tag=L4M5HETQS0SP type=write size=3122267 2024-09-12T17:05:13.185 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.179+0000 7f026be9d8c0 1 < completed delete operation key=XNBE2II106VZ tag=E2OR5D7EIIR1 type=del 2024-09-12T17:05:13.191 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.187+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~3ONDEAY1YI5E.0 size=1048576 2024-09-12T17:05:13.193 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.187+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~3ONDEAY1YI5E.1 size=528882 2024-09-12T17:05:13.193 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.187+0000 7f026be9d8c0 1 > prepared multipart upload key=32XUMOWT8HO2 upload=3ONDEAY1YI5E tag=LV1OXG3K5439 type=write size=2626034 2024-09-12T17:05:13.197 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.191+0000 7f026be9d8c0 1 < completed part key=_multipart_T6QRDTQRHBPI.2~KA40Z0G2KUVS.0 size=675487 2024-09-12T17:05:13.202 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.199+0000 7f026be9d8c0 1 < completed multipart upload key=T6QRDTQRHBPI upload=KA40Z0G2KUVS tag=Z9W1PUDUX12Y type=write size=1724063 2024-09-12T17:05:13.205 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.199+0000 7f026be9d8c0 1 > prepared operation key=6VO85REZG2NW tag=FMJGGJT6VR83 type=write size=512696 2024-09-12T17:05:13.208 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.203+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~C1DNTYQYZ6BI.0 size=1048576 2024-09-12T17:05:13.212 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.207+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~C1DNTYQYZ6BI.1 size=1048576 2024-09-12T17:05:13.213 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.207+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~C1DNTYQYZ6BI.2 size=695150 2024-09-12T17:05:13.218 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.215+0000 7f026be9d8c0 1 < completed multipart upload key=UU88OS653L8D upload=C1DNTYQYZ6BI tag=TV1LELLZXPHK type=write size=3840878 2024-09-12T17:05:13.221 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.215+0000 7f026be9d8c0 1 > prepared operation key=PQSQ39X3O64P tag=58BVVL9XKXLJ type=del size=3081848 2024-09-12T17:05:13.227 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.223+0000 7f026be9d8c0 1 < suggested update operation key=4G3BKGNT3YZC tag=QQHRAMXY8HTR type=del size=115989 2024-09-12T17:05:13.230 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.227+0000 7f026be9d8c0 1 > prepared operation key=J8MU1A0CWSAQ tag=1GY2Q2CFGFQB type=del size=1688709 2024-09-12T17:05:13.233 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.227+0000 7f026be9d8c0 1 < completed part key=_multipart_Z9YNIEQCVNBA.2~P387MKCO0VU3.0 size=1048576 2024-09-12T17:05:13.238 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.231+0000 7f026be9d8c0 1 < completed part key=_multipart_Z9YNIEQCVNBA.2~P387MKCO0VU3.1 size=1048576 2024-09-12T17:05:13.239 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.235+0000 7f026be9d8c0 1 < completed part key=_multipart_Z9YNIEQCVNBA.2~P387MKCO0VU3.2 size=94766 2024-09-12T17:05:13.244 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.239+0000 7f026be9d8c0 1 < completed multipart upload key=Z9YNIEQCVNBA upload=P387MKCO0VU3 tag=4A090BFCEV2E type=write size=3240494 2024-09-12T17:05:13.248 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.243+0000 7f026be9d8c0 1 > prepared operation key=RBNN03IPZ8BT tag=2DFWI3TM1CMC type=del size=3164051 2024-09-12T17:05:13.251 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.247+0000 7f026be9d8c0 1 < completed delete operation key=SL2446KSB531 tag=VORCTDCO2NVV type=del 2024-09-12T17:05:13.255 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.251+0000 7f026be9d8c0 1 > prepared operation key=6VO85REZG2NW tag=A8P6KN0CZ8PC type=del size=1545192 2024-09-12T17:05:13.258 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.255+0000 7f026be9d8c0 1 < completed part key=_multipart_XNBE2II106VZ.2~V3CIHUKAHE1G.0 size=1048576 2024-09-12T17:05:13.261 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.255+0000 7f026be9d8c0 1 < completed part key=_multipart_XNBE2II106VZ.2~V3CIHUKAHE1G.1 size=385046 2024-09-12T17:05:13.267 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.263+0000 7f026be9d8c0 1 < completed multipart upload key=XNBE2II106VZ upload=V3CIHUKAHE1G tag=BQ05LO9UETN7 type=write size=2482198 2024-09-12T17:05:13.270 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.267+0000 7f026be9d8c0 1 > prepared operation key=4G3BKGNT3YZC tag=6EVLFII77QH0 type=del size=4186880 2024-09-12T17:05:13.274 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.271+0000 7f026be9d8c0 1 < completed write operation key=T6QRDTQRHBPI tag=OVST2OLZXOWO type=write size=740156 2024-09-12T17:05:13.277 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.271+0000 7f026be9d8c0 1 > prepared operation key=Z183NH6R676V tag=OTOIOKVD0Z2N type=del size=1777662 2024-09-12T17:05:13.281 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.275+0000 7f026be9d8c0 1 < completed delete operation key=Z183NH6R676V tag=PN51F8FCXX4F type=del 2024-09-12T17:05:13.287 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.283+0000 7f026be9d8c0 1 > prepared part key=_multipart_LHKLWIUAT08F.2~16KE3S1IH2GM.0 size=486715 2024-09-12T17:05:13.287 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.283+0000 7f026be9d8c0 1 > prepared multipart upload key=LHKLWIUAT08F upload=16KE3S1IH2GM tag=MX1CGF8N5TLK type=write size=1535291 2024-09-12T17:05:13.288 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.283+0000 7f026be9d8c0 1 < canceled part key=_multipart_PQSQ39X3O64P.2~3CVZ1K1LQA5P.0 size=1048576 2024-09-12T17:05:13.288 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.283+0000 7f026be9d8c0 1 < canceled part key=_multipart_PQSQ39X3O64P.2~3CVZ1K1LQA5P.1 size=807731 2024-09-12T17:05:13.293 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.287+0000 7f026be9d8c0 1 < canceled multipart upload key=PQSQ39X3O64P upload=3CVZ1K1LQA5P tag=W6Y9KDTO2XQP type=write size=2904883 2024-09-12T17:05:13.297 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.291+0000 7f026be9d8c0 1 > prepared operation key=Z9YNIEQCVNBA tag=YH8MTSVGPE68 type=del size=1706832 2024-09-12T17:05:13.301 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.295+0000 7f026be9d8c0 1 < canceled operation key=E0Y3SKNUYCQS tag=9IR3O3OP5NZ9 type=del size=3874911 2024-09-12T17:05:13.304 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.299+0000 7f026be9d8c0 1 > prepared operation key=SL2446KSB531 tag=2P4QDRYTFJBU type=del size=826934 2024-09-12T17:05:13.312 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.307+0000 7f026be9d8c0 1 < suggested update operation key=LHKLWIUAT08F tag=LO5PVK5WCV56 type=del size=1098241 2024-09-12T17:05:13.318 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.311+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~7WKUE31Y642N.0 size=613864 2024-09-12T17:05:13.318 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.311+0000 7f026be9d8c0 1 > prepared multipart upload key=UU88OS653L8D upload=7WKUE31Y642N tag=2T199IJ5SQE0 type=write size=1662440 2024-09-12T17:05:13.321 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.315+0000 7f026be9d8c0 1 < completed delete operation key=21ZD52VBZIO4 tag=T98OZ8YB0H7O type=del 2024-09-12T17:05:13.326 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.323+0000 7f026be9d8c0 1 > prepared part key=_multipart_MVYWUWKSYQ9Z.2~2HP6762IDGUK.0 size=1048576 2024-09-12T17:05:13.329 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.323+0000 7f026be9d8c0 1 > prepared part key=_multipart_MVYWUWKSYQ9Z.2~2HP6762IDGUK.1 size=1048576 2024-09-12T17:05:13.331 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.327+0000 7f026be9d8c0 1 > prepared part key=_multipart_MVYWUWKSYQ9Z.2~2HP6762IDGUK.2 size=871698 2024-09-12T17:05:13.331 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.327+0000 7f026be9d8c0 1 > prepared multipart upload key=MVYWUWKSYQ9Z upload=2HP6762IDGUK tag=GB1HJAWD6YPQ type=write size=4017426 2024-09-12T17:05:13.335 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.331+0000 7f026be9d8c0 1 < completed part key=_multipart_8AFDAVJLMRD2.2~2I55HMUNR0HT.0 size=1048576 2024-09-12T17:05:13.337 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.331+0000 7f026be9d8c0 1 < completed part key=_multipart_8AFDAVJLMRD2.2~2I55HMUNR0HT.1 size=258127 2024-09-12T17:05:13.342 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.339+0000 7f026be9d8c0 1 < completed multipart upload key=8AFDAVJLMRD2 upload=2I55HMUNR0HT tag=6TJ3UWXAT8LU type=write size=2355279 2024-09-12T17:05:13.348 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.343+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~2J0ZXNQ6YOZ9.0 size=1048576 2024-09-12T17:05:13.351 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.347+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~2J0ZXNQ6YOZ9.1 size=1048576 2024-09-12T17:05:13.353 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.347+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~2J0ZXNQ6YOZ9.2 size=929345 2024-09-12T17:05:13.353 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.347+0000 7f026be9d8c0 1 > prepared multipart upload key=4G3BKGNT3YZC upload=2J0ZXNQ6YOZ9 tag=NWXEAKVSBBJ5 type=write size=4075073 2024-09-12T17:05:13.356 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.351+0000 7f026be9d8c0 1 < completed delete operation key=ALFGNC1YNROX tag=IAWAI5U01FF3 type=del 2024-09-12T17:05:13.360 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.355+0000 7f026be9d8c0 1 > prepared operation key=32XUMOWT8HO2 tag=H5SYNRT4ZBLO type=del size=4132615 2024-09-12T17:05:13.364 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.359+0000 7f026be9d8c0 1 < completed part key=_multipart_BBYDPSXZKHZP.2~MP41DFKPUT77.0 size=1048576 2024-09-12T17:05:13.366 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.363+0000 7f026be9d8c0 1 < completed part key=_multipart_BBYDPSXZKHZP.2~MP41DFKPUT77.1 size=1025115 2024-09-12T17:05:13.372 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.367+0000 7f026be9d8c0 1 < completed multipart upload key=BBYDPSXZKHZP upload=MP41DFKPUT77 tag=L4M5HETQS0SP type=write size=3122267 2024-09-12T17:05:13.375 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.371+0000 7f026be9d8c0 1 > prepared operation key=Z183NH6R676V tag=MMPACX1664K1 type=write size=325907 2024-09-12T17:05:13.379 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.375+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~3ONDEAY1YI5E.0 size=1048576 2024-09-12T17:05:13.382 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.379+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~3ONDEAY1YI5E.1 size=528882 2024-09-12T17:05:13.388 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.383+0000 7f026be9d8c0 1 < completed multipart upload key=32XUMOWT8HO2 upload=3ONDEAY1YI5E tag=LV1OXG3K5439 type=write size=2626034 2024-09-12T17:05:13.391 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.387+0000 7f026be9d8c0 1 > prepared operation key=8AFDAVJLMRD2 tag=ZZG0NYEOJCVR type=del size=2931400 2024-09-12T17:05:13.395 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.391+0000 7f026be9d8c0 1 < completed write operation key=6VO85REZG2NW tag=FMJGGJT6VR83 type=write size=512696 2024-09-12T17:05:13.401 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.395+0000 7f026be9d8c0 1 > prepared part key=_multipart_U8W1SAVSLTBF.2~QFSXHN8CFAII.0 size=1048576 2024-09-12T17:05:13.404 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.399+0000 7f026be9d8c0 1 > prepared part key=_multipart_U8W1SAVSLTBF.2~QFSXHN8CFAII.1 size=1048576 2024-09-12T17:05:13.407 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.403+0000 7f026be9d8c0 1 > prepared part key=_multipart_U8W1SAVSLTBF.2~QFSXHN8CFAII.2 size=79985 2024-09-12T17:05:13.407 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.403+0000 7f026be9d8c0 1 > prepared multipart upload key=U8W1SAVSLTBF upload=QFSXHN8CFAII tag=7GH22PHO35Q7 type=write size=3225713 2024-09-12T17:05:13.410 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.407+0000 7f026be9d8c0 1 < completed delete operation key=PQSQ39X3O64P tag=58BVVL9XKXLJ type=del 2024-09-12T17:05:13.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.415+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~J9TA03DQ16XD.0 size=1048576 2024-09-12T17:05:13.424 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.419+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~J9TA03DQ16XD.1 size=1048576 2024-09-12T17:05:13.427 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.423+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~J9TA03DQ16XD.2 size=840603 2024-09-12T17:05:13.427 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.423+0000 7f026be9d8c0 1 > prepared multipart upload key=Z9YNIEQCVNBA upload=J9TA03DQ16XD tag=PCP7P2N8SB7N type=write size=3986331 2024-09-12T17:05:13.430 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.427+0000 7f026be9d8c0 1 < completed delete operation key=J8MU1A0CWSAQ tag=1GY2Q2CFGFQB type=del 2024-09-12T17:05:13.433 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.427+0000 7f026be9d8c0 1 > prepared operation key=SO3HLQZA8B6B tag=RFM35IM98ACR type=del size=3409547 2024-09-12T17:05:13.437 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.431+0000 7f026be9d8c0 1 < completed delete operation key=RBNN03IPZ8BT tag=2DFWI3TM1CMC type=del 2024-09-12T17:05:13.441 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.435+0000 7f026be9d8c0 1 > prepared operation key=3JADN360QEO3 tag=4S2W9MKCPRJ8 type=del size=376581 2024-09-12T17:05:13.444 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.439+0000 7f026be9d8c0 1 < canceled operation key=6VO85REZG2NW tag=A8P6KN0CZ8PC type=del size=1545192 2024-09-12T17:05:13.447 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.443+0000 7f026be9d8c0 1 > prepared operation key=4G3BKGNT3YZC tag=P4TC737K8BPY type=write size=315403 2024-09-12T17:05:13.451 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.447+0000 7f026be9d8c0 1 < completed delete operation key=4G3BKGNT3YZC tag=6EVLFII77QH0 type=del 2024-09-12T17:05:13.457 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.451+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~L3OH49DXH1D4.0 size=1048576 2024-09-12T17:05:13.460 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.455+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~L3OH49DXH1D4.1 size=168634 2024-09-12T17:05:13.460 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.455+0000 7f026be9d8c0 1 > prepared multipart upload key=UU88OS653L8D upload=L3OH49DXH1D4 tag=ZJ26Z5RV587B type=write size=2265786 2024-09-12T17:05:13.464 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.459+0000 7f026be9d8c0 1 < completed delete operation key=Z183NH6R676V tag=OTOIOKVD0Z2N type=del 2024-09-12T17:05:13.467 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.463+0000 7f026be9d8c0 1 > prepared operation key=GPUFWJ3AWEMX tag=YX8M3Y7VL1W0 type=del size=3421482 2024-09-12T17:05:13.471 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.467+0000 7f026be9d8c0 1 < completed part key=_multipart_LHKLWIUAT08F.2~16KE3S1IH2GM.0 size=486715 2024-09-12T17:05:13.477 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.471+0000 7f026be9d8c0 1 < completed multipart upload key=LHKLWIUAT08F upload=16KE3S1IH2GM tag=MX1CGF8N5TLK type=write size=1535291 2024-09-12T17:05:13.481 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.475+0000 7f026be9d8c0 1 > prepared operation key=6VO85REZG2NW tag=66DA5JN00TSZ type=del size=2574277 2024-09-12T17:05:13.487 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.483+0000 7f026be9d8c0 1 < suggested remove operation key=Z9YNIEQCVNBA tag=YH8MTSVGPE68 type=del 2024-09-12T17:05:13.494 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.487+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~83602JPW3ZQL.0 size=1048576 2024-09-12T17:05:13.496 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.491+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~83602JPW3ZQL.1 size=958376 2024-09-12T17:05:13.496 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.491+0000 7f026be9d8c0 1 > prepared multipart upload key=GPUFWJ3AWEMX upload=83602JPW3ZQL tag=1924U6IVNM13 type=write size=3055528 2024-09-12T17:05:13.500 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.495+0000 7f026be9d8c0 1 < completed delete operation key=SL2446KSB531 tag=2P4QDRYTFJBU type=del 2024-09-12T17:05:13.503 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.499+0000 7f026be9d8c0 1 > prepared operation key=T6QRDTQRHBPI tag=MB6RKXYATFEM type=write size=355739 2024-09-12T17:05:13.509 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.503+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~7WKUE31Y642N.0 size=613864 2024-09-12T17:05:13.513 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.507+0000 7f026be9d8c0 1 < completed multipart upload key=UU88OS653L8D upload=7WKUE31Y642N tag=2T199IJ5SQE0 type=write size=1662440 2024-09-12T17:05:13.517 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.511+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=BWBS6AUHKMOZ type=write size=712741 2024-09-12T17:05:13.521 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.515+0000 7f026be9d8c0 1 < completed part key=_multipart_MVYWUWKSYQ9Z.2~2HP6762IDGUK.0 size=1048576 2024-09-12T17:05:13.524 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.519+0000 7f026be9d8c0 1 < completed part key=_multipart_MVYWUWKSYQ9Z.2~2HP6762IDGUK.1 size=1048576 2024-09-12T17:05:13.528 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.523+0000 7f026be9d8c0 1 < completed part key=_multipart_MVYWUWKSYQ9Z.2~2HP6762IDGUK.2 size=871698 2024-09-12T17:05:13.534 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.531+0000 7f026be9d8c0 1 < completed multipart upload key=MVYWUWKSYQ9Z upload=2HP6762IDGUK tag=GB1HJAWD6YPQ type=write size=4017426 2024-09-12T17:05:13.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.535+0000 7f026be9d8c0 1 > prepared operation key=LHKLWIUAT08F tag=XWM7GNZAP037 type=write size=383475 2024-09-12T17:05:13.543 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.539+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~2J0ZXNQ6YOZ9.0 size=1048576 2024-09-12T17:05:13.546 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.539+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~2J0ZXNQ6YOZ9.1 size=1048576 2024-09-12T17:05:13.549 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.543+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~2J0ZXNQ6YOZ9.2 size=929345 2024-09-12T17:05:13.555 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.551+0000 7f026be9d8c0 1 < completed multipart upload key=4G3BKGNT3YZC upload=2J0ZXNQ6YOZ9 tag=NWXEAKVSBBJ5 type=write size=4075073 2024-09-12T17:05:13.558 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.555+0000 7f026be9d8c0 1 > prepared operation key=SO3HLQZA8B6B tag=CSHE8V9MV1LX type=write size=434589 2024-09-12T17:05:13.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.559+0000 7f026be9d8c0 1 < canceled operation key=32XUMOWT8HO2 tag=H5SYNRT4ZBLO type=del size=4132615 2024-09-12T17:05:13.565 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.559+0000 7f026be9d8c0 1 > prepared operation key=UU88OS653L8D tag=WWEI96KNQYT1 type=del size=31442 2024-09-12T17:05:13.569 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.563+0000 7f026be9d8c0 1 < completed write operation key=Z183NH6R676V tag=MMPACX1664K1 type=write size=325907 2024-09-12T17:05:13.572 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.567+0000 7f026be9d8c0 1 > prepared operation key=Z9YNIEQCVNBA tag=9DBMTD7AOLCA type=del size=2806202 2024-09-12T17:05:13.575 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.571+0000 7f026be9d8c0 1 < completed delete operation key=8AFDAVJLMRD2 tag=ZZG0NYEOJCVR type=del 2024-09-12T17:05:13.579 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.575+0000 7f026be9d8c0 1 > prepared operation key=8AFDAVJLMRD2 tag=EMRDKOIIX72I type=del size=1050183 2024-09-12T17:05:13.583 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.579+0000 7f026be9d8c0 1 < completed part key=_multipart_U8W1SAVSLTBF.2~QFSXHN8CFAII.0 size=1048576 2024-09-12T17:05:13.585 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.579+0000 7f026be9d8c0 1 < completed part key=_multipart_U8W1SAVSLTBF.2~QFSXHN8CFAII.1 size=1048576 2024-09-12T17:05:13.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.583+0000 7f026be9d8c0 1 < completed part key=_multipart_U8W1SAVSLTBF.2~QFSXHN8CFAII.2 size=79985 2024-09-12T17:05:13.594 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.591+0000 7f026be9d8c0 1 < completed multipart upload key=U8W1SAVSLTBF upload=QFSXHN8CFAII tag=7GH22PHO35Q7 type=write size=3225713 2024-09-12T17:05:13.601 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.595+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~6QP42IA8ZM40.0 size=1048576 2024-09-12T17:05:13.603 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.599+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~6QP42IA8ZM40.1 size=876050 2024-09-12T17:05:13.603 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.599+0000 7f026be9d8c0 1 > prepared multipart upload key=6VO85REZG2NW upload=6QP42IA8ZM40 tag=DUNKN0BJQ9K8 type=write size=2973202 2024-09-12T17:05:13.607 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.603+0000 7f026be9d8c0 1 < completed part key=_multipart_Z9YNIEQCVNBA.2~J9TA03DQ16XD.0 size=1048576 2024-09-12T17:05:13.610 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.607+0000 7f026be9d8c0 1 < completed part key=_multipart_Z9YNIEQCVNBA.2~J9TA03DQ16XD.1 size=1048576 2024-09-12T17:05:13.613 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.607+0000 7f026be9d8c0 1 < completed part key=_multipart_Z9YNIEQCVNBA.2~J9TA03DQ16XD.2 size=840603 2024-09-12T17:05:13.618 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.615+0000 7f026be9d8c0 1 < completed multipart upload key=Z9YNIEQCVNBA upload=J9TA03DQ16XD tag=PCP7P2N8SB7N type=write size=3986331 2024-09-12T17:05:13.624 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.619+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~1KY9OLFM8D1O.0 size=1048576 2024-09-12T17:05:13.628 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.623+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~1KY9OLFM8D1O.1 size=719121 2024-09-12T17:05:13.628 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.623+0000 7f026be9d8c0 1 > prepared multipart upload key=Z9YNIEQCVNBA upload=1KY9OLFM8D1O tag=OZIE7AZPKSWQ type=write size=2816273 2024-09-12T17:05:13.632 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.627+0000 7f026be9d8c0 1 < canceled operation key=SO3HLQZA8B6B tag=RFM35IM98ACR type=del size=3409547 2024-09-12T17:05:13.635 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.631+0000 7f026be9d8c0 1 > prepared operation key=E0Y3SKNUYCQS tag=OA2GD5AJ32M3 type=write size=708446 2024-09-12T17:05:13.642 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.639+0000 7f026be9d8c0 1 < suggested remove operation key=3JADN360QEO3 tag=4S2W9MKCPRJ8 type=del 2024-09-12T17:05:13.646 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.639+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=KDAGS2YZNS95 type=del size=346152 2024-09-12T17:05:13.649 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.643+0000 7f026be9d8c0 1 < completed write operation key=4G3BKGNT3YZC tag=P4TC737K8BPY type=write size=315403 2024-09-12T17:05:13.656 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.651+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~IE3XTEMJVRS9.0 size=692396 2024-09-12T17:05:13.656 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.651+0000 7f026be9d8c0 1 > prepared multipart upload key=ALFGNC1YNROX upload=IE3XTEMJVRS9 tag=4WLXX3Q0G8QV type=write size=1740972 2024-09-12T17:05:13.660 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.655+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~L3OH49DXH1D4.0 size=1048576 2024-09-12T17:05:13.660 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.655+0000 7f026be9d8c0 1 < canceled part key=_multipart_UU88OS653L8D.2~L3OH49DXH1D4.1 size=168634 2024-09-12T17:05:13.665 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.659+0000 7f026be9d8c0 1 < canceled multipart upload key=UU88OS653L8D upload=L3OH49DXH1D4 tag=ZJ26Z5RV587B type=write size=2265786 2024-09-12T17:05:13.669 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.663+0000 7f026be9d8c0 1 > prepared operation key=UU88OS653L8D tag=QN0F6C290FV2 type=del size=1288201 2024-09-12T17:05:13.673 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.667+0000 7f026be9d8c0 1 < completed delete operation key=GPUFWJ3AWEMX tag=YX8M3Y7VL1W0 type=del 2024-09-12T17:05:13.679 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.675+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~JUU6JH6YJ33F.0 size=423374 2024-09-12T17:05:13.679 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.675+0000 7f026be9d8c0 1 > prepared multipart upload key=32XUMOWT8HO2 upload=JUU6JH6YJ33F tag=1UUUT400HN7C type=write size=1471950 2024-09-12T17:05:13.683 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.679+0000 7f026be9d8c0 1 < completed delete operation key=6VO85REZG2NW tag=66DA5JN00TSZ type=del 2024-09-12T17:05:13.689 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.683+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~80KED4XJEQKT.0 size=349531 2024-09-12T17:05:13.689 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.683+0000 7f026be9d8c0 1 > prepared multipart upload key=BW1T21LBUE2D upload=80KED4XJEQKT tag=895D74CYS5JJ type=write size=1398107 2024-09-12T17:05:13.693 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.687+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~83602JPW3ZQL.0 size=1048576 2024-09-12T17:05:13.696 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.691+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~83602JPW3ZQL.1 size=958376 2024-09-12T17:05:13.701 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.695+0000 7f026be9d8c0 1 < completed multipart upload key=GPUFWJ3AWEMX upload=83602JPW3ZQL tag=1924U6IVNM13 type=write size=3055528 2024-09-12T17:05:13.705 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.699+0000 7f026be9d8c0 1 > prepared operation key=8AFDAVJLMRD2 tag=SE0TR0BYGN8U type=del size=3713879 2024-09-12T17:05:13.708 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.703+0000 7f026be9d8c0 1 < completed write operation key=T6QRDTQRHBPI tag=MB6RKXYATFEM type=write size=355739 2024-09-12T17:05:13.714 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.711+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~P7BD1EOS2821.0 size=1048576 2024-09-12T17:05:13.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.711+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~P7BD1EOS2821.1 size=1048576 2024-09-12T17:05:13.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.715+0000 7f026be9d8c0 1 > prepared part key=_multipart_XLKR6P8RNRVO.2~P7BD1EOS2821.2 size=858072 2024-09-12T17:05:13.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.715+0000 7f026be9d8c0 1 > prepared multipart upload key=XLKR6P8RNRVO upload=P7BD1EOS2821 tag=Z9DRQRMUP4NG type=write size=4003800 2024-09-12T17:05:13.726 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.719+0000 7f026be9d8c0 1 < suggested remove operation key=21ZD52VBZIO4 tag=BWBS6AUHKMOZ type=write 2024-09-12T17:05:13.729 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.723+0000 7f026be9d8c0 1 > prepared operation key=J8MU1A0CWSAQ tag=JA2MIL4HMLP5 type=del size=12220 2024-09-12T17:05:13.733 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.727+0000 7f026be9d8c0 1 < completed write operation key=LHKLWIUAT08F tag=XWM7GNZAP037 type=write size=383475 2024-09-12T17:05:13.738 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.731+0000 7f026be9d8c0 1 > prepared operation key=Y27CDEOCM7DH tag=A9EZW3E8IXGY type=del size=3965798 2024-09-12T17:05:13.741 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.735+0000 7f026be9d8c0 1 < completed write operation key=SO3HLQZA8B6B tag=CSHE8V9MV1LX type=write size=434589 2024-09-12T17:05:13.745 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.739+0000 7f026be9d8c0 1 > prepared operation key=SGT8IC1GJ3IG tag=VBFLZBZJ18O9 type=del size=2530011 2024-09-12T17:05:13.761 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.751+0000 7f026be9d8c0 1 < suggested remove operation key=UU88OS653L8D tag=WWEI96KNQYT1 type=del 2024-09-12T17:05:13.762 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.755+0000 7f026be9d8c0 1 > prepared operation key=PQSQ39X3O64P tag=0WYKGLIST6XE type=del size=659499 2024-09-12T17:05:13.763 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.759+0000 7f026be9d8c0 1 < completed delete operation key=Z9YNIEQCVNBA tag=9DBMTD7AOLCA type=del 2024-09-12T17:05:13.766 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.763+0000 7f026be9d8c0 1 > prepared operation key=6VO85REZG2NW tag=IY7OWD3GNNIX type=del size=2897413 2024-09-12T17:05:13.770 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.763+0000 7f026be9d8c0 1 < completed delete operation key=8AFDAVJLMRD2 tag=EMRDKOIIX72I type=del 2024-09-12T17:05:13.776 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.771+0000 7f026be9d8c0 1 > prepared part key=_multipart_BBYDPSXZKHZP.2~7K3UGHEBPBJF.0 size=1048576 2024-09-12T17:05:13.778 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.775+0000 7f026be9d8c0 1 > prepared part key=_multipart_BBYDPSXZKHZP.2~7K3UGHEBPBJF.1 size=935530 2024-09-12T17:05:13.778 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.775+0000 7f026be9d8c0 1 > prepared multipart upload key=BBYDPSXZKHZP upload=7K3UGHEBPBJF tag=07FPAASHYBKY type=write size=3032682 2024-09-12T17:05:13.782 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.775+0000 7f026be9d8c0 1 < completed part key=_multipart_6VO85REZG2NW.2~6QP42IA8ZM40.0 size=1048576 2024-09-12T17:05:13.784 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.779+0000 7f026be9d8c0 1 < completed part key=_multipart_6VO85REZG2NW.2~6QP42IA8ZM40.1 size=876050 2024-09-12T17:05:13.789 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.783+0000 7f026be9d8c0 1 < completed multipart upload key=6VO85REZG2NW upload=6QP42IA8ZM40 tag=DUNKN0BJQ9K8 type=write size=2973202 2024-09-12T17:05:13.793 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.787+0000 7f026be9d8c0 1 > prepared operation key=SL2446KSB531 tag=FX8JA347WMOK type=del size=3844214 2024-09-12T17:05:13.794 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.787+0000 7f026be9d8c0 1 < canceled part key=_multipart_Z9YNIEQCVNBA.2~1KY9OLFM8D1O.0 size=1048576 2024-09-12T17:05:13.796 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.791+0000 7f026be9d8c0 1 < completed part key=_multipart_Z9YNIEQCVNBA.2~1KY9OLFM8D1O.1 size=719121 2024-09-12T17:05:13.801 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.795+0000 7f026be9d8c0 1 < canceled multipart upload key=Z9YNIEQCVNBA upload=1KY9OLFM8D1O tag=OZIE7AZPKSWQ type=write size=2816273 2024-09-12T17:05:13.805 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.799+0000 7f026be9d8c0 1 > prepared operation key=SL2446KSB531 tag=J2T8U91VHU40 type=del size=2773011 2024-09-12T17:05:13.808 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.803+0000 7f026be9d8c0 1 < canceled operation key=E0Y3SKNUYCQS tag=OA2GD5AJ32M3 type=write size=708446 2024-09-12T17:05:13.815 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.811+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~MIW1YFDN2EH4.0 size=1048576 2024-09-12T17:05:13.817 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.811+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~MIW1YFDN2EH4.1 size=1048576 2024-09-12T17:05:13.820 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.815+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~MIW1YFDN2EH4.2 size=624019 2024-09-12T17:05:13.820 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.815+0000 7f026be9d8c0 1 > prepared multipart upload key=UU88OS653L8D upload=MIW1YFDN2EH4 tag=0VEUHT7Q9UFU type=write size=3769747 2024-09-12T17:05:13.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.815+0000 7f026be9d8c0 -1 < no bi entry to suggest for operation key=21ZD52VBZIO4 tag=KDAGS2YZNS95 type=del size=346152: (2) No such file or directory 2024-09-12T17:05:13.829 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.823+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~B532BCOJTTS8.0 size=1048576 2024-09-12T17:05:13.830 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.823+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~B532BCOJTTS8.1 size=693733 2024-09-12T17:05:13.830 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.823+0000 7f026be9d8c0 1 > prepared multipart upload key=6VO85REZG2NW upload=B532BCOJTTS8 tag=Y6A9JC9JZA91 type=write size=2790885 2024-09-12T17:05:13.833 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.827+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~IE3XTEMJVRS9.0 size=692396 2024-09-12T17:05:13.839 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.835+0000 7f026be9d8c0 1 < completed multipart upload key=ALFGNC1YNROX upload=IE3XTEMJVRS9 tag=4WLXX3Q0G8QV type=write size=1740972 2024-09-12T17:05:13.845 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.839+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~K3L3TLHPA3BZ.0 size=205934 2024-09-12T17:05:13.845 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.839+0000 7f026be9d8c0 1 > prepared multipart upload key=8AFDAVJLMRD2 upload=K3L3TLHPA3BZ tag=3H151I9L6NYC type=write size=1254510 2024-09-12T17:05:13.846 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.843+0000 7f026be9d8c0 -1 < no bi entry to suggest for operation key=UU88OS653L8D tag=QN0F6C290FV2 type=del size=1288201: (2) No such file or directory 2024-09-12T17:05:13.853 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.847+0000 7f026be9d8c0 1 > prepared part key=_multipart_MVYWUWKSYQ9Z.2~EX4B0D4BFO52.0 size=416963 2024-09-12T17:05:13.853 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.847+0000 7f026be9d8c0 1 > prepared multipart upload key=MVYWUWKSYQ9Z upload=EX4B0D4BFO52 tag=YMXHZHCQVNRA type=write size=1465539 2024-09-12T17:05:13.854 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.851+0000 7f026be9d8c0 1 < canceled part key=_multipart_32XUMOWT8HO2.2~JUU6JH6YJ33F.0 size=423374 2024-09-12T17:05:13.859 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.855+0000 7f026be9d8c0 1 < canceled multipart upload key=32XUMOWT8HO2 upload=JUU6JH6YJ33F tag=1UUUT400HN7C type=write size=1471950 2024-09-12T17:05:13.863 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.859+0000 7f026be9d8c0 1 > prepared operation key=GPUFWJ3AWEMX tag=RC755J3CG5E5 type=del size=365634 2024-09-12T17:05:13.867 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.863+0000 7f026be9d8c0 1 < completed part key=_multipart_BW1T21LBUE2D.2~80KED4XJEQKT.0 size=349531 2024-09-12T17:05:13.873 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.867+0000 7f026be9d8c0 1 < completed multipart upload key=BW1T21LBUE2D upload=80KED4XJEQKT tag=895D74CYS5JJ type=write size=1398107 2024-09-12T17:05:13.879 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.875+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~RHUFKK1VI3XV.0 size=1048576 2024-09-12T17:05:13.882 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.879+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~RHUFKK1VI3XV.1 size=1048576 2024-09-12T17:05:13.885 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.879+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~RHUFKK1VI3XV.2 size=764644 2024-09-12T17:05:13.885 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.879+0000 7f026be9d8c0 1 > prepared multipart upload key=QVQ4TI319DH5 upload=RHUFKK1VI3XV tag=ORZA5PVFLO9J type=write size=3910372 2024-09-12T17:05:13.888 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.883+0000 7f026be9d8c0 1 < completed delete operation key=8AFDAVJLMRD2 tag=SE0TR0BYGN8U type=del 2024-09-12T17:05:13.895 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.891+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~PQKTWJ1S96I6.0 size=1007244 2024-09-12T17:05:13.895 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.891+0000 7f026be9d8c0 1 > prepared multipart upload key=ALFGNC1YNROX upload=PQKTWJ1S96I6 tag=QPDTMOEVOG3J type=write size=2055820 2024-09-12T17:05:13.898 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.895+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~P7BD1EOS2821.0 size=1048576 2024-09-12T17:05:13.901 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.895+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~P7BD1EOS2821.1 size=1048576 2024-09-12T17:05:13.905 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.899+0000 7f026be9d8c0 1 < completed part key=_multipart_XLKR6P8RNRVO.2~P7BD1EOS2821.2 size=858072 2024-09-12T17:05:13.911 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.907+0000 7f026be9d8c0 1 < completed multipart upload key=XLKR6P8RNRVO upload=P7BD1EOS2821 tag=Z9DRQRMUP4NG type=write size=4003800 2024-09-12T17:05:13.918 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.911+0000 7f026be9d8c0 1 > prepared part key=_multipart_MVYWUWKSYQ9Z.2~ILUDQEEXI1PA.0 size=1048576 2024-09-12T17:05:13.921 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.915+0000 7f026be9d8c0 1 > prepared part key=_multipart_MVYWUWKSYQ9Z.2~ILUDQEEXI1PA.1 size=799872 2024-09-12T17:05:13.921 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.915+0000 7f026be9d8c0 1 > prepared multipart upload key=MVYWUWKSYQ9Z upload=ILUDQEEXI1PA tag=2C7BU7CLFZ5D type=write size=2897024 2024-09-12T17:05:13.924 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.919+0000 7f026be9d8c0 1 < completed delete operation key=J8MU1A0CWSAQ tag=JA2MIL4HMLP5 type=del 2024-09-12T17:05:13.932 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.927+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~F4N9GQJ5F0HY.0 size=1048576 2024-09-12T17:05:13.935 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.931+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~F4N9GQJ5F0HY.1 size=1048576 2024-09-12T17:05:13.939 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.935+0000 7f026be9d8c0 1 > prepared part key=_multipart_32XUMOWT8HO2.2~F4N9GQJ5F0HY.2 size=109350 2024-09-12T17:05:13.939 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.935+0000 7f026be9d8c0 1 > prepared multipart upload key=32XUMOWT8HO2 upload=F4N9GQJ5F0HY tag=N3M1AZK3XFJI type=write size=3255078 2024-09-12T17:05:13.942 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.939+0000 7f026be9d8c0 1 < completed delete operation key=Y27CDEOCM7DH tag=A9EZW3E8IXGY type=del 2024-09-12T17:05:13.948 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.943+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~6F2C5DQJ35CP.0 size=1048576 2024-09-12T17:05:13.951 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.947+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~6F2C5DQJ35CP.1 size=1048576 2024-09-12T17:05:13.954 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.951+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~6F2C5DQJ35CP.2 size=227157 2024-09-12T17:05:13.954 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.951+0000 7f026be9d8c0 1 > prepared multipart upload key=4G3BKGNT3YZC upload=6F2C5DQJ35CP tag=WIZ49WVTDN3Z type=write size=3372885 2024-09-12T17:05:13.958 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.955+0000 7f026be9d8c0 1 < canceled operation key=SGT8IC1GJ3IG tag=VBFLZBZJ18O9 type=del size=2530011 2024-09-12T17:05:13.962 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.955+0000 7f026be9d8c0 1 > prepared operation key=LHKLWIUAT08F tag=UPVTE2NY6ORG type=write size=589755 2024-09-12T17:05:13.966 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.959+0000 7f026be9d8c0 1 < completed delete operation key=PQSQ39X3O64P tag=0WYKGLIST6XE type=del 2024-09-12T17:05:13.972 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.967+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~47IAN1Z6VJ65.0 size=113908 2024-09-12T17:05:13.972 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.967+0000 7f026be9d8c0 1 > prepared multipart upload key=GPUFWJ3AWEMX upload=47IAN1Z6VJ65 tag=ZIB13QVX3R14 type=write size=1162484 2024-09-12T17:05:13.976 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.971+0000 7f026be9d8c0 1 < canceled operation key=6VO85REZG2NW tag=IY7OWD3GNNIX type=del size=2897413 2024-09-12T17:05:13.982 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.979+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~3YHDFQ5OF6DV.0 size=367966 2024-09-12T17:05:13.982 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.979+0000 7f026be9d8c0 1 > prepared multipart upload key=4G3BKGNT3YZC upload=3YHDFQ5OF6DV tag=9WVKGUADG8WU type=write size=1416542 2024-09-12T17:05:13.986 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.983+0000 7f026be9d8c0 1 < completed part key=_multipart_BBYDPSXZKHZP.2~7K3UGHEBPBJF.0 size=1048576 2024-09-12T17:05:13.989 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.983+0000 7f026be9d8c0 1 < completed part key=_multipart_BBYDPSXZKHZP.2~7K3UGHEBPBJF.1 size=935530 2024-09-12T17:05:13.995 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.991+0000 7f026be9d8c0 1 < completed multipart upload key=BBYDPSXZKHZP upload=7K3UGHEBPBJF tag=07FPAASHYBKY type=write size=3032682 2024-09-12T17:05:14.001 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.995+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~IZUVDTUZGG8J.0 size=1048576 2024-09-12T17:05:14.004 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:13.999+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~IZUVDTUZGG8J.1 size=1048576 2024-09-12T17:05:14.006 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.003+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~IZUVDTUZGG8J.2 size=299041 2024-09-12T17:05:14.007 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.003+0000 7f026be9d8c0 1 > prepared multipart upload key=QVQ4TI319DH5 upload=IZUVDTUZGG8J tag=RTBDVPFIB33Q type=write size=3444769 2024-09-12T17:05:14.010 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.007+0000 7f026be9d8c0 1 < completed delete operation key=SL2446KSB531 tag=FX8JA347WMOK type=del 2024-09-12T17:05:14.016 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.011+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~3INYTRYXJAA8.0 size=1048576 2024-09-12T17:05:14.019 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.015+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~3INYTRYXJAA8.1 size=591167 2024-09-12T17:05:14.019 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.015+0000 7f026be9d8c0 1 > prepared multipart upload key=Y27CDEOCM7DH upload=3INYTRYXJAA8 tag=0LEY1ZEP8Q6V type=write size=2688319 2024-09-12T17:05:14.023 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.019+0000 7f026be9d8c0 1 < completed delete operation key=SL2446KSB531 tag=J2T8U91VHU40 type=del 2024-09-12T17:05:14.027 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.023+0000 7f026be9d8c0 1 > prepared operation key=L194KQIPFLE1 tag=5YI4NMOKZ81G type=del size=2814202 2024-09-12T17:05:14.030 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.027+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~MIW1YFDN2EH4.0 size=1048576 2024-09-12T17:05:14.033 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.027+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~MIW1YFDN2EH4.1 size=1048576 2024-09-12T17:05:14.036 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.031+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~MIW1YFDN2EH4.2 size=624019 2024-09-12T17:05:14.043 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.039+0000 7f026be9d8c0 1 < completed multipart upload key=UU88OS653L8D upload=MIW1YFDN2EH4 tag=0VEUHT7Q9UFU type=write size=3769747 2024-09-12T17:05:14.047 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.043+0000 7f026be9d8c0 1 > prepared operation key=SL2446KSB531 tag=YJ0SFI3090UQ type=del size=2852847 2024-09-12T17:05:14.051 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.047+0000 7f026be9d8c0 1 < completed part key=_multipart_6VO85REZG2NW.2~B532BCOJTTS8.0 size=1048576 2024-09-12T17:05:14.054 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.051+0000 7f026be9d8c0 1 < completed part key=_multipart_6VO85REZG2NW.2~B532BCOJTTS8.1 size=693733 2024-09-12T17:05:14.060 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.055+0000 7f026be9d8c0 1 < completed multipart upload key=6VO85REZG2NW upload=B532BCOJTTS8 tag=Y6A9JC9JZA91 type=write size=2790885 2024-09-12T17:05:14.064 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.059+0000 7f026be9d8c0 1 > prepared operation key=BBYDPSXZKHZP tag=ZXQ99HCE94W3 type=del size=1756079 2024-09-12T17:05:14.064 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.059+0000 7f026be9d8c0 1 < canceled part key=_multipart_8AFDAVJLMRD2.2~K3L3TLHPA3BZ.0 size=205934 2024-09-12T17:05:14.070 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.063+0000 7f026be9d8c0 1 < canceled multipart upload key=8AFDAVJLMRD2 upload=K3L3TLHPA3BZ tag=3H151I9L6NYC type=write size=1254510 2024-09-12T17:05:14.080 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.075+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z183NH6R676V.2~W1VYHZT3J6F4.0 size=25955 2024-09-12T17:05:14.081 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.075+0000 7f026be9d8c0 1 > prepared multipart upload key=Z183NH6R676V upload=W1VYHZT3J6F4 tag=JU3HENKHJHIN type=write size=1074531 2024-09-12T17:05:14.084 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.079+0000 7f026be9d8c0 1 < completed part key=_multipart_MVYWUWKSYQ9Z.2~EX4B0D4BFO52.0 size=416963 2024-09-12T17:05:14.090 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.087+0000 7f026be9d8c0 1 < completed multipart upload key=MVYWUWKSYQ9Z upload=EX4B0D4BFO52 tag=YMXHZHCQVNRA type=write size=1465539 2024-09-12T17:05:14.093 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.087+0000 7f026be9d8c0 1 > prepared operation key=BW1T21LBUE2D tag=30UZN4CHTDYS type=del size=3553019 2024-09-12T17:05:14.097 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.091+0000 7f026be9d8c0 1 < completed delete operation key=GPUFWJ3AWEMX tag=RC755J3CG5E5 type=del 2024-09-12T17:05:14.103 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.099+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~0T4MMEA0H6Q1.0 size=390517 2024-09-12T17:05:14.103 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.099+0000 7f026be9d8c0 1 > prepared multipart upload key=Y27CDEOCM7DH upload=0T4MMEA0H6Q1 tag=2WWBVO1U9PFK type=write size=1439093 2024-09-12T17:05:14.107 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.103+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~RHUFKK1VI3XV.0 size=1048576 2024-09-12T17:05:14.110 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.107+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~RHUFKK1VI3XV.1 size=1048576 2024-09-12T17:05:14.112 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.107+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~RHUFKK1VI3XV.2 size=764644 2024-09-12T17:05:14.118 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.115+0000 7f026be9d8c0 1 < completed multipart upload key=QVQ4TI319DH5 upload=RHUFKK1VI3XV tag=ORZA5PVFLO9J type=write size=3910372 2024-09-12T17:05:14.124 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.119+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~2KOGY8WCZ1T0.0 size=1048576 2024-09-12T17:05:14.127 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.123+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~2KOGY8WCZ1T0.1 size=1048576 2024-09-12T17:05:14.129 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.123+0000 7f026be9d8c0 1 > prepared part key=_multipart_BW1T21LBUE2D.2~2KOGY8WCZ1T0.2 size=800611 2024-09-12T17:05:14.130 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.123+0000 7f026be9d8c0 1 > prepared multipart upload key=BW1T21LBUE2D upload=2KOGY8WCZ1T0 tag=TZMXSEWENA5G type=write size=3946339 2024-09-12T17:05:14.133 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.127+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~PQKTWJ1S96I6.0 size=1007244 2024-09-12T17:05:14.138 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.135+0000 7f026be9d8c0 1 < completed multipart upload key=ALFGNC1YNROX upload=PQKTWJ1S96I6 tag=QPDTMOEVOG3J type=write size=2055820 2024-09-12T17:05:14.145 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.139+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~9L9J9F4TXDJ3.0 size=565431 2024-09-12T17:05:14.145 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.139+0000 7f026be9d8c0 1 > prepared multipart upload key=4G3BKGNT3YZC upload=9L9J9F4TXDJ3 tag=DNAEQMBUCA0L type=write size=1614007 2024-09-12T17:05:14.148 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.143+0000 7f026be9d8c0 1 < completed part key=_multipart_MVYWUWKSYQ9Z.2~ILUDQEEXI1PA.0 size=1048576 2024-09-12T17:05:14.148 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.143+0000 7f026be9d8c0 1 < canceled part key=_multipart_MVYWUWKSYQ9Z.2~ILUDQEEXI1PA.1 size=799872 2024-09-12T17:05:14.153 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.147+0000 7f026be9d8c0 1 < canceled multipart upload key=MVYWUWKSYQ9Z upload=ILUDQEEXI1PA tag=2C7BU7CLFZ5D type=write size=2897024 2024-09-12T17:05:14.157 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.151+0000 7f026be9d8c0 1 > prepared operation key=XLKR6P8RNRVO tag=8C09QOZDS9IL type=del size=3301450 2024-09-12T17:05:14.160 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.155+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~F4N9GQJ5F0HY.0 size=1048576 2024-09-12T17:05:14.163 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.159+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~F4N9GQJ5F0HY.1 size=1048576 2024-09-12T17:05:14.166 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.159+0000 7f026be9d8c0 1 < completed part key=_multipart_32XUMOWT8HO2.2~F4N9GQJ5F0HY.2 size=109350 2024-09-12T17:05:14.172 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.167+0000 7f026be9d8c0 1 < completed multipart upload key=32XUMOWT8HO2 upload=F4N9GQJ5F0HY tag=N3M1AZK3XFJI type=write size=3255078 2024-09-12T17:05:14.178 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.175+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~W1ZP5K0IMDMX.0 size=1048576 2024-09-12T17:05:14.181 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.175+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~W1ZP5K0IMDMX.1 size=157301 2024-09-12T17:05:14.181 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.175+0000 7f026be9d8c0 1 > prepared multipart upload key=2BQJ30RQQ25L upload=W1ZP5K0IMDMX tag=5Y9WVJ3KGIH4 type=write size=2254453 2024-09-12T17:05:14.184 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.179+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~6F2C5DQJ35CP.0 size=1048576 2024-09-12T17:05:14.187 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.183+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~6F2C5DQJ35CP.1 size=1048576 2024-09-12T17:05:14.190 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.183+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~6F2C5DQJ35CP.2 size=227157 2024-09-12T17:05:14.195 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.191+0000 7f026be9d8c0 1 < completed multipart upload key=4G3BKGNT3YZC upload=6F2C5DQJ35CP tag=WIZ49WVTDN3Z type=write size=3372885 2024-09-12T17:05:14.201 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.195+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~FN8Z309CL7HW.0 size=1048576 2024-09-12T17:05:14.204 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.199+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~FN8Z309CL7HW.1 size=1048576 2024-09-12T17:05:14.206 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.203+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~FN8Z309CL7HW.2 size=578328 2024-09-12T17:05:14.206 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.203+0000 7f026be9d8c0 1 > prepared multipart upload key=JJMEQ2O00SA2 upload=FN8Z309CL7HW tag=I8810A44WI9L type=write size=3724056 2024-09-12T17:05:14.209 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.203+0000 7f026be9d8c0 1 < completed write operation key=LHKLWIUAT08F tag=UPVTE2NY6ORG type=write size=589755 2024-09-12T17:05:14.215 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.211+0000 7f026be9d8c0 1 > prepared part key=_multipart_U8W1SAVSLTBF.2~S2TBGZVG24S4.0 size=1048576 2024-09-12T17:05:14.217 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.211+0000 7f026be9d8c0 1 > prepared part key=_multipart_U8W1SAVSLTBF.2~S2TBGZVG24S4.1 size=1048576 2024-09-12T17:05:14.220 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.215+0000 7f026be9d8c0 1 > prepared part key=_multipart_U8W1SAVSLTBF.2~S2TBGZVG24S4.2 size=615048 2024-09-12T17:05:14.220 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.215+0000 7f026be9d8c0 1 > prepared multipart upload key=U8W1SAVSLTBF upload=S2TBGZVG24S4 tag=71SJ2FEPTNCE type=write size=3760776 2024-09-12T17:05:14.223 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.219+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~47IAN1Z6VJ65.0 size=113908 2024-09-12T17:05:14.229 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.223+0000 7f026be9d8c0 1 < completed multipart upload key=GPUFWJ3AWEMX upload=47IAN1Z6VJ65 tag=ZIB13QVX3R14 type=write size=1162484 2024-09-12T17:05:14.232 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.227+0000 7f026be9d8c0 1 > prepared operation key=32XUMOWT8HO2 tag=3CE53B3D35HM type=write size=164719 2024-09-12T17:05:14.237 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.231+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~3YHDFQ5OF6DV.0 size=367966 2024-09-12T17:05:14.242 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.235+0000 7f026be9d8c0 1 < completed multipart upload key=4G3BKGNT3YZC upload=3YHDFQ5OF6DV tag=9WVKGUADG8WU type=write size=1416542 2024-09-12T17:05:14.245 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.239+0000 7f026be9d8c0 1 > prepared operation key=LHKLWIUAT08F tag=EH5VSQNKVWH0 type=del size=2144536 2024-09-12T17:05:14.249 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.243+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~IZUVDTUZGG8J.0 size=1048576 2024-09-12T17:05:14.251 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.247+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~IZUVDTUZGG8J.1 size=1048576 2024-09-12T17:05:14.254 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.251+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~IZUVDTUZGG8J.2 size=299041 2024-09-12T17:05:14.260 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.255+0000 7f026be9d8c0 1 < completed multipart upload key=QVQ4TI319DH5 upload=IZUVDTUZGG8J tag=RTBDVPFIB33Q type=write size=3444769 2024-09-12T17:05:14.266 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.259+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~JWBR3ZTWPGA4.0 size=1048576 2024-09-12T17:05:14.268 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.263+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~JWBR3ZTWPGA4.1 size=1048576 2024-09-12T17:05:14.271 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.267+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~JWBR3ZTWPGA4.2 size=564514 2024-09-12T17:05:14.271 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.267+0000 7f026be9d8c0 1 > prepared multipart upload key=JJMEQ2O00SA2 upload=JWBR3ZTWPGA4 tag=6QBJ9CRRVT0X type=write size=3710242 2024-09-12T17:05:14.275 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.271+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~3INYTRYXJAA8.0 size=1048576 2024-09-12T17:05:14.279 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.275+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~3INYTRYXJAA8.1 size=591167 2024-09-12T17:05:14.284 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.279+0000 7f026be9d8c0 1 < completed multipart upload key=Y27CDEOCM7DH upload=3INYTRYXJAA8 tag=0LEY1ZEP8Q6V type=write size=2688319 2024-09-12T17:05:14.291 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.287+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~0IJRQT2BEY70.0 size=447685 2024-09-12T17:05:14.291 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.287+0000 7f026be9d8c0 1 > prepared multipart upload key=J8MU1A0CWSAQ upload=0IJRQT2BEY70 tag=A7JLBHTLONNB type=write size=1496261 2024-09-12T17:05:14.294 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.291+0000 7f026be9d8c0 1 < completed delete operation key=L194KQIPFLE1 tag=5YI4NMOKZ81G type=del 2024-09-12T17:05:14.301 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.295+0000 7f026be9d8c0 1 > prepared part key=_multipart_PQSQ39X3O64P.2~A3F9FTG5CXBG.0 size=1048576 2024-09-12T17:05:14.304 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.299+0000 7f026be9d8c0 1 > prepared part key=_multipart_PQSQ39X3O64P.2~A3F9FTG5CXBG.1 size=573350 2024-09-12T17:05:14.304 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.299+0000 7f026be9d8c0 1 > prepared multipart upload key=PQSQ39X3O64P upload=A3F9FTG5CXBG tag=LQHTG42MDRWF type=write size=2670502 2024-09-12T17:05:14.307 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.303+0000 7f026be9d8c0 1 < canceled operation key=SL2446KSB531 tag=YJ0SFI3090UQ type=del size=2852847 2024-09-12T17:05:14.311 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.307+0000 7f026be9d8c0 1 > prepared operation key=BBYDPSXZKHZP tag=VLTXHGSFUAQE type=del size=3956141 2024-09-12T17:05:14.315 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.311+0000 7f026be9d8c0 1 < completed delete operation key=BBYDPSXZKHZP tag=ZXQ99HCE94W3 type=del 2024-09-12T17:05:14.319 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.315+0000 7f026be9d8c0 1 > prepared operation key=XLKR6P8RNRVO tag=3OLNCNJH5CX7 type=del size=2969718 2024-09-12T17:05:14.323 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.319+0000 7f026be9d8c0 1 < completed part key=_multipart_Z183NH6R676V.2~W1VYHZT3J6F4.0 size=25955 2024-09-12T17:05:14.328 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.323+0000 7f026be9d8c0 1 < completed multipart upload key=Z183NH6R676V upload=W1VYHZT3J6F4 tag=JU3HENKHJHIN type=write size=1074531 2024-09-12T17:05:14.332 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.327+0000 7f026be9d8c0 1 > prepared operation key=Z9YNIEQCVNBA tag=5Q9TXSK0PHE4 type=write size=342885 2024-09-12T17:05:14.339 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.335+0000 7f026be9d8c0 1 < suggested remove operation key=BW1T21LBUE2D tag=30UZN4CHTDYS type=del 2024-09-12T17:05:14.343 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.339+0000 7f026be9d8c0 1 > prepared operation key=SGT8IC1GJ3IG tag=HTF4VO59I13M type=del size=1915501 2024-09-12T17:05:14.347 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.343+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~0T4MMEA0H6Q1.0 size=390517 2024-09-12T17:05:14.353 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.347+0000 7f026be9d8c0 1 < completed multipart upload key=Y27CDEOCM7DH upload=0T4MMEA0H6Q1 tag=2WWBVO1U9PFK type=write size=1439093 2024-09-12T17:05:14.360 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.355+0000 7f026be9d8c0 1 > prepared part key=_multipart_MVYWUWKSYQ9Z.2~18F0YORAFAQ0.0 size=735103 2024-09-12T17:05:14.360 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.355+0000 7f026be9d8c0 1 > prepared multipart upload key=MVYWUWKSYQ9Z upload=18F0YORAFAQ0 tag=3JY65F16RJVP type=write size=1783679 2024-09-12T17:05:14.365 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.359+0000 7f026be9d8c0 1 < completed part key=_multipart_BW1T21LBUE2D.2~2KOGY8WCZ1T0.0 size=1048576 2024-09-12T17:05:14.367 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.363+0000 7f026be9d8c0 1 < completed part key=_multipart_BW1T21LBUE2D.2~2KOGY8WCZ1T0.1 size=1048576 2024-09-12T17:05:14.371 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.367+0000 7f026be9d8c0 1 < completed part key=_multipart_BW1T21LBUE2D.2~2KOGY8WCZ1T0.2 size=800611 2024-09-12T17:05:14.377 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.371+0000 7f026be9d8c0 1 < completed multipart upload key=BW1T21LBUE2D upload=2KOGY8WCZ1T0 tag=TZMXSEWENA5G type=write size=3946339 2024-09-12T17:05:14.380 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.375+0000 7f026be9d8c0 1 > prepared operation key=2BQJ30RQQ25L tag=8ZJ1L1XO9ZON type=del size=1407363 2024-09-12T17:05:14.383 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.379+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~9L9J9F4TXDJ3.0 size=565431 2024-09-12T17:05:14.389 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.383+0000 7f026be9d8c0 1 < completed multipart upload key=4G3BKGNT3YZC upload=9L9J9F4TXDJ3 tag=DNAEQMBUCA0L type=write size=1614007 2024-09-12T17:05:14.400 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.395+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~32FQA9OEERDK.0 size=1048576 2024-09-12T17:05:14.403 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.399+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~32FQA9OEERDK.1 size=1048576 2024-09-12T17:05:14.406 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.403+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~32FQA9OEERDK.2 size=181457 2024-09-12T17:05:14.406 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.403+0000 7f026be9d8c0 1 > prepared multipart upload key=ALFGNC1YNROX upload=32FQA9OEERDK tag=97AHJIEXH6XF type=write size=3327185 2024-09-12T17:05:14.411 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.407+0000 7f026be9d8c0 1 < completed delete operation key=XLKR6P8RNRVO tag=8C09QOZDS9IL type=del 2024-09-12T17:05:14.415 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.411+0000 7f026be9d8c0 1 > prepared operation key=2BQJ30RQQ25L tag=L105F75XOHHE type=del size=3198622 2024-09-12T17:05:14.418 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.415+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~W1ZP5K0IMDMX.0 size=1048576 2024-09-12T17:05:14.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.415+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~W1ZP5K0IMDMX.1 size=157301 2024-09-12T17:05:14.427 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.423+0000 7f026be9d8c0 1 < completed multipart upload key=2BQJ30RQQ25L upload=W1ZP5K0IMDMX tag=5Y9WVJ3KGIH4 type=write size=2254453 2024-09-12T17:05:14.433 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.427+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~4UXQ32HGK96W.0 size=1048576 2024-09-12T17:05:14.435 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.431+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~4UXQ32HGK96W.1 size=1048576 2024-09-12T17:05:14.441 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.435+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~4UXQ32HGK96W.2 size=391017 2024-09-12T17:05:14.441 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.435+0000 7f026be9d8c0 1 > prepared multipart upload key=2BQJ30RQQ25L upload=4UXQ32HGK96W tag=QYQS19B9DQII type=write size=3536745 2024-09-12T17:05:14.443 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.439+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~FN8Z309CL7HW.0 size=1048576 2024-09-12T17:05:14.445 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.439+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~FN8Z309CL7HW.1 size=1048576 2024-09-12T17:05:14.445 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.439+0000 7f026be9d8c0 1 < canceled part key=_multipart_JJMEQ2O00SA2.2~FN8Z309CL7HW.2 size=578328 2024-09-12T17:05:14.450 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.447+0000 7f026be9d8c0 1 < canceled multipart upload key=JJMEQ2O00SA2 upload=FN8Z309CL7HW tag=I8810A44WI9L type=write size=3724056 2024-09-12T17:05:14.453 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.447+0000 7f026be9d8c0 1 > prepared operation key=8AFDAVJLMRD2 tag=TVFIXOXFVOAN type=del size=3633208 2024-09-12T17:05:14.456 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.451+0000 7f026be9d8c0 1 < completed part key=_multipart_U8W1SAVSLTBF.2~S2TBGZVG24S4.0 size=1048576 2024-09-12T17:05:14.459 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.455+0000 7f026be9d8c0 1 < completed part key=_multipart_U8W1SAVSLTBF.2~S2TBGZVG24S4.1 size=1048576 2024-09-12T17:05:14.461 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.455+0000 7f026be9d8c0 1 < completed part key=_multipart_U8W1SAVSLTBF.2~S2TBGZVG24S4.2 size=615048 2024-09-12T17:05:14.466 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.463+0000 7f026be9d8c0 1 < completed multipart upload key=U8W1SAVSLTBF upload=S2TBGZVG24S4 tag=71SJ2FEPTNCE type=write size=3760776 2024-09-12T17:05:14.469 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.463+0000 7f026be9d8c0 1 > prepared operation key=BW1T21LBUE2D tag=AGYXPH46KA02 type=del size=2293787 2024-09-12T17:05:14.473 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.467+0000 7f026be9d8c0 1 < completed write operation key=32XUMOWT8HO2 tag=3CE53B3D35HM type=write size=164719 2024-09-12T17:05:14.478 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.475+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~2ULCC7I1CE23.0 size=1048576 2024-09-12T17:05:14.480 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.475+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~2ULCC7I1CE23.1 size=1048576 2024-09-12T17:05:14.483 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.479+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~2ULCC7I1CE23.2 size=617672 2024-09-12T17:05:14.483 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.479+0000 7f026be9d8c0 1 > prepared multipart upload key=GPUFWJ3AWEMX upload=2ULCC7I1CE23 tag=U6CDZ11O9VMG type=write size=3763400 2024-09-12T17:05:14.486 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.483+0000 7f026be9d8c0 1 < completed delete operation key=LHKLWIUAT08F tag=EH5VSQNKVWH0 type=del 2024-09-12T17:05:14.490 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.483+0000 7f026be9d8c0 1 > prepared operation key=Z9YNIEQCVNBA tag=48LOZP3W2RA1 type=del size=2335662 2024-09-12T17:05:14.493 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.487+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~JWBR3ZTWPGA4.0 size=1048576 2024-09-12T17:05:14.495 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.491+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~JWBR3ZTWPGA4.1 size=1048576 2024-09-12T17:05:14.497 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.491+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~JWBR3ZTWPGA4.2 size=564514 2024-09-12T17:05:14.502 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.499+0000 7f026be9d8c0 1 < completed multipart upload key=JJMEQ2O00SA2 upload=JWBR3ZTWPGA4 tag=6QBJ9CRRVT0X type=write size=3710242 2024-09-12T17:05:14.505 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.499+0000 7f026be9d8c0 1 > prepared operation key=SO3HLQZA8B6B tag=GFQSHYTSLY1Y type=del size=476445 2024-09-12T17:05:14.508 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.503+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~0IJRQT2BEY70.0 size=447685 2024-09-12T17:05:14.513 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.507+0000 7f026be9d8c0 1 < completed multipart upload key=J8MU1A0CWSAQ upload=0IJRQT2BEY70 tag=A7JLBHTLONNB type=write size=1496261 2024-09-12T17:05:14.517 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.511+0000 7f026be9d8c0 1 > prepared operation key=XNBE2II106VZ tag=9W5Z7TASSWJE type=del size=3607417 2024-09-12T17:05:14.517 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.511+0000 7f026be9d8c0 1 < canceled part key=_multipart_PQSQ39X3O64P.2~A3F9FTG5CXBG.0 size=1048576 2024-09-12T17:05:14.519 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.515+0000 7f026be9d8c0 1 < completed part key=_multipart_PQSQ39X3O64P.2~A3F9FTG5CXBG.1 size=573350 2024-09-12T17:05:14.525 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.519+0000 7f026be9d8c0 1 < canceled multipart upload key=PQSQ39X3O64P upload=A3F9FTG5CXBG tag=LQHTG42MDRWF type=write size=2670502 2024-09-12T17:05:14.531 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.527+0000 7f026be9d8c0 1 > prepared part key=_multipart_21ZD52VBZIO4.2~MT2LGFOLR2P5.0 size=823838 2024-09-12T17:05:14.531 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.527+0000 7f026be9d8c0 1 > prepared multipart upload key=21ZD52VBZIO4 upload=MT2LGFOLR2P5 tag=7K0POX72YHI1 type=write size=1872414 2024-09-12T17:05:14.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.531+0000 7f026be9d8c0 1 < suggested remove operation key=BBYDPSXZKHZP tag=VLTXHGSFUAQE type=del 2024-09-12T17:05:14.541 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.535+0000 7f026be9d8c0 1 > prepared operation key=J8MU1A0CWSAQ tag=9OLWIL8YIZSV type=del size=3203107 2024-09-12T17:05:14.549 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.543+0000 7f026be9d8c0 1 < suggested update operation key=XLKR6P8RNRVO tag=3OLNCNJH5CX7 type=del size=2969718 2024-09-12T17:05:14.552 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.547+0000 7f026be9d8c0 1 > prepared operation key=E0Y3SKNUYCQS tag=YPGHM9VVPF4W type=del size=253916 2024-09-12T17:05:14.558 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.555+0000 7f026be9d8c0 1 < completed write operation key=Z9YNIEQCVNBA tag=5Q9TXSK0PHE4 type=write size=342885 2024-09-12T17:05:14.564 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.559+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~42E311DJZV9E.0 size=643582 2024-09-12T17:05:14.565 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.559+0000 7f026be9d8c0 1 > prepared multipart upload key=QVQ4TI319DH5 upload=42E311DJZV9E tag=AR7RRWYEYP8M type=write size=1692158 2024-09-12T17:05:14.568 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.563+0000 7f026be9d8c0 1 < completed delete operation key=SGT8IC1GJ3IG tag=HTF4VO59I13M type=del 2024-09-12T17:05:14.571 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.567+0000 7f026be9d8c0 1 > prepared operation key=J8MU1A0CWSAQ tag=Z8YGYOHYRIA1 type=del size=1180557 2024-09-12T17:05:14.575 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.571+0000 7f026be9d8c0 1 < completed part key=_multipart_MVYWUWKSYQ9Z.2~18F0YORAFAQ0.0 size=735103 2024-09-12T17:05:14.581 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.575+0000 7f026be9d8c0 1 < completed multipart upload key=MVYWUWKSYQ9Z upload=18F0YORAFAQ0 tag=3JY65F16RJVP type=write size=1783679 2024-09-12T17:05:14.584 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.579+0000 7f026be9d8c0 1 > prepared operation key=E0Y3SKNUYCQS tag=A5IY038HVIZM type=del size=3500397 2024-09-12T17:05:14.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.583+0000 7f026be9d8c0 1 < canceled operation key=2BQJ30RQQ25L tag=8ZJ1L1XO9ZON type=del size=1407363 2024-09-12T17:05:14.595 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.591+0000 7f026be9d8c0 1 > prepared part key=_multipart_UU88OS653L8D.2~C4RXPW0WRDLV.0 size=67347 2024-09-12T17:05:14.595 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.591+0000 7f026be9d8c0 1 > prepared multipart upload key=UU88OS653L8D upload=C4RXPW0WRDLV tag=IRBJN2SQSZ3S type=write size=1115923 2024-09-12T17:05:14.598 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.595+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~32FQA9OEERDK.0 size=1048576 2024-09-12T17:05:14.603 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.599+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~32FQA9OEERDK.1 size=1048576 2024-09-12T17:05:14.606 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.603+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~32FQA9OEERDK.2 size=181457 2024-09-12T17:05:14.612 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.607+0000 7f026be9d8c0 1 < completed multipart upload key=ALFGNC1YNROX upload=32FQA9OEERDK tag=97AHJIEXH6XF type=write size=3327185 2024-09-12T17:05:14.619 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.615+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z183NH6R676V.2~L62TOHY3V3NC.0 size=1048576 2024-09-12T17:05:14.622 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.615+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z183NH6R676V.2~L62TOHY3V3NC.1 size=1048576 2024-09-12T17:05:14.624 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.619+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z183NH6R676V.2~L62TOHY3V3NC.2 size=489388 2024-09-12T17:05:14.624 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.619+0000 7f026be9d8c0 1 > prepared multipart upload key=Z183NH6R676V upload=L62TOHY3V3NC tag=Z7XZC091JMK5 type=write size=3635116 2024-09-12T17:05:14.628 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.623+0000 7f026be9d8c0 1 < completed delete operation key=2BQJ30RQQ25L tag=L105F75XOHHE type=del 2024-09-12T17:05:14.639 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.627+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=VBPHOZ1FY86S type=write size=879304 2024-09-12T17:05:14.639 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.631+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~4UXQ32HGK96W.0 size=1048576 2024-09-12T17:05:14.639 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.631+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~4UXQ32HGK96W.1 size=1048576 2024-09-12T17:05:14.640 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.635+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~4UXQ32HGK96W.2 size=391017 2024-09-12T17:05:14.647 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.643+0000 7f026be9d8c0 1 < completed multipart upload key=2BQJ30RQQ25L upload=4UXQ32HGK96W tag=QYQS19B9DQII type=write size=3536745 2024-09-12T17:05:14.650 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.647+0000 7f026be9d8c0 1 > prepared operation key=SO3HLQZA8B6B tag=0SHDMMKG9YVC type=write size=175954 2024-09-12T17:05:14.653 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.647+0000 7f026be9d8c0 1 < completed delete operation key=8AFDAVJLMRD2 tag=TVFIXOXFVOAN type=del 2024-09-12T17:05:14.657 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.651+0000 7f026be9d8c0 1 > prepared operation key=QVQ4TI319DH5 tag=T1HDTCJTU5R6 type=del size=2937764 2024-09-12T17:05:14.661 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.655+0000 7f026be9d8c0 1 < completed delete operation key=BW1T21LBUE2D tag=AGYXPH46KA02 type=del 2024-09-12T17:05:14.664 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.659+0000 7f026be9d8c0 1 > prepared operation key=6VO85REZG2NW tag=6RI8XCKLEB4I type=del size=2512359 2024-09-12T17:05:14.668 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.663+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~2ULCC7I1CE23.0 size=1048576 2024-09-12T17:05:14.671 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.667+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~2ULCC7I1CE23.1 size=1048576 2024-09-12T17:05:14.674 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.671+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~2ULCC7I1CE23.2 size=617672 2024-09-12T17:05:14.681 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.675+0000 7f026be9d8c0 1 < completed multipart upload key=GPUFWJ3AWEMX upload=2ULCC7I1CE23 tag=U6CDZ11O9VMG type=write size=3763400 2024-09-12T17:05:14.684 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.679+0000 7f026be9d8c0 1 > prepared operation key=XNBE2II106VZ tag=2630BCXYKEXQ type=write size=640075 2024-09-12T17:05:14.688 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.683+0000 7f026be9d8c0 1 < completed delete operation key=Z9YNIEQCVNBA tag=48LOZP3W2RA1 type=del 2024-09-12T17:05:14.692 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.687+0000 7f026be9d8c0 1 > prepared operation key=QVQ4TI319DH5 tag=IK3BIB9UUY65 type=del size=918419 2024-09-12T17:05:14.695 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.691+0000 7f026be9d8c0 1 < canceled operation key=SO3HLQZA8B6B tag=GFQSHYTSLY1Y type=del size=476445 2024-09-12T17:05:14.698 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.695+0000 7f026be9d8c0 1 > prepared operation key=T6QRDTQRHBPI tag=I9AFQTULLHUS type=del size=780456 2024-09-12T17:05:14.705 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.699+0000 7f026be9d8c0 1 < suggested remove operation key=XNBE2II106VZ tag=9W5Z7TASSWJE type=del 2024-09-12T17:05:14.711 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.707+0000 7f026be9d8c0 1 > prepared part key=_multipart_LHKLWIUAT08F.2~0R8SMV6GMGQC.0 size=633495 2024-09-12T17:05:14.711 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.707+0000 7f026be9d8c0 1 > prepared multipart upload key=LHKLWIUAT08F upload=0R8SMV6GMGQC tag=ET8G4P5LH3VI type=write size=1682071 2024-09-12T17:05:14.711 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.707+0000 7f026be9d8c0 1 < canceled part key=_multipart_21ZD52VBZIO4.2~MT2LGFOLR2P5.0 size=823838 2024-09-12T17:05:14.722 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.719+0000 7f026be9d8c0 1 < canceled multipart upload key=21ZD52VBZIO4 upload=MT2LGFOLR2P5 tag=7K0POX72YHI1 type=write size=1872414 2024-09-12T17:05:14.725 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.719+0000 7f026be9d8c0 1 > prepared operation key=ALFGNC1YNROX tag=T7HEOV23CWKF type=del size=2572886 2024-09-12T17:05:14.728 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.723+0000 7f026be9d8c0 1 < completed delete operation key=J8MU1A0CWSAQ tag=9OLWIL8YIZSV type=del 2024-09-12T17:05:14.733 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.727+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~FEARGMU3LHYL.0 size=1048576 2024-09-12T17:05:14.735 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.731+0000 7f026be9d8c0 1 > prepared part key=_multipart_ALFGNC1YNROX.2~FEARGMU3LHYL.1 size=1010371 2024-09-12T17:05:14.736 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.731+0000 7f026be9d8c0 1 > prepared multipart upload key=ALFGNC1YNROX upload=FEARGMU3LHYL tag=615V291YW0D6 type=write size=3107523 2024-09-12T17:05:14.738 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.735+0000 7f026be9d8c0 1 < completed delete operation key=E0Y3SKNUYCQS tag=YPGHM9VVPF4W type=del 2024-09-12T17:05:14.742 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.735+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=ES1E2FE9RSAB type=del size=3275976 2024-09-12T17:05:14.745 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.739+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~42E311DJZV9E.0 size=643582 2024-09-12T17:05:14.750 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.743+0000 7f026be9d8c0 1 < completed multipart upload key=QVQ4TI319DH5 upload=42E311DJZV9E tag=AR7RRWYEYP8M type=write size=1692158 2024-09-12T17:05:14.755 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.751+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~U5G3VL5ICM9Q.0 size=1048576 2024-09-12T17:05:14.757 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.751+0000 7f026be9d8c0 1 > prepared part key=_multipart_Y27CDEOCM7DH.2~U5G3VL5ICM9Q.1 size=260166 2024-09-12T17:05:14.758 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.751+0000 7f026be9d8c0 1 > prepared multipart upload key=Y27CDEOCM7DH upload=U5G3VL5ICM9Q tag=V5TP3YYK4WI2 type=write size=2357318 2024-09-12T17:05:14.760 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.755+0000 7f026be9d8c0 1 < completed delete operation key=J8MU1A0CWSAQ tag=Z8YGYOHYRIA1 type=del 2024-09-12T17:05:14.764 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.759+0000 7f026be9d8c0 1 > prepared operation key=UU88OS653L8D tag=OXQ6M6OIDPJO type=del size=684015 2024-09-12T17:05:14.766 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.763+0000 7f026be9d8c0 1 < completed delete operation key=E0Y3SKNUYCQS tag=A5IY038HVIZM type=del 2024-09-12T17:05:14.769 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.763+0000 7f026be9d8c0 1 > prepared operation key=Y27CDEOCM7DH tag=EEI7FGTRQ4ZL type=del size=2654108 2024-09-12T17:05:14.771 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.767+0000 7f026be9d8c0 1 < completed part key=_multipart_UU88OS653L8D.2~C4RXPW0WRDLV.0 size=67347 2024-09-12T17:05:14.775 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.771+0000 7f026be9d8c0 1 < completed multipart upload key=UU88OS653L8D upload=C4RXPW0WRDLV tag=IRBJN2SQSZ3S type=write size=1115923 2024-09-12T17:05:14.778 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.775+0000 7f026be9d8c0 1 > prepared operation key=ALFGNC1YNROX tag=6272P1QON4WX type=del size=1057229 2024-09-12T17:05:14.781 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.775+0000 7f026be9d8c0 1 < completed part key=_multipart_Z183NH6R676V.2~L62TOHY3V3NC.0 size=1048576 2024-09-12T17:05:14.783 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.779+0000 7f026be9d8c0 1 < completed part key=_multipart_Z183NH6R676V.2~L62TOHY3V3NC.1 size=1048576 2024-09-12T17:05:14.786 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.779+0000 7f026be9d8c0 1 < completed part key=_multipart_Z183NH6R676V.2~L62TOHY3V3NC.2 size=489388 2024-09-12T17:05:14.790 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.787+0000 7f026be9d8c0 1 < completed multipart upload key=Z183NH6R676V upload=L62TOHY3V3NC tag=Z7XZC091JMK5 type=write size=3635116 2024-09-12T17:05:14.794 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.787+0000 7f026be9d8c0 1 > prepared operation key=Z183NH6R676V tag=9DLEDKCKQLTG type=write size=130794 2024-09-12T17:05:14.796 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.791+0000 7f026be9d8c0 1 < canceled operation key=21ZD52VBZIO4 tag=VBPHOZ1FY86S type=write size=879304 2024-09-12T17:05:14.802 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.799+0000 7f026be9d8c0 1 > prepared part key=_multipart_SO3HLQZA8B6B.2~GH9D67NLG7CL.0 size=1048576 2024-09-12T17:05:14.804 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.799+0000 7f026be9d8c0 1 > prepared part key=_multipart_SO3HLQZA8B6B.2~GH9D67NLG7CL.1 size=669538 2024-09-12T17:05:14.804 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.799+0000 7f026be9d8c0 1 > prepared multipart upload key=SO3HLQZA8B6B upload=GH9D67NLG7CL tag=JCNI60XGFIPU type=write size=2766690 2024-09-12T17:05:14.807 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.803+0000 7f026be9d8c0 1 < completed write operation key=SO3HLQZA8B6B tag=0SHDMMKG9YVC type=write size=175954 2024-09-12T17:05:14.812 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.807+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~AX2EH91SNBGB.0 size=1048576 2024-09-12T17:05:14.814 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.811+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~AX2EH91SNBGB.1 size=1048576 2024-09-12T17:05:14.817 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.811+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~AX2EH91SNBGB.2 size=489162 2024-09-12T17:05:14.817 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.811+0000 7f026be9d8c0 1 > prepared multipart upload key=4G3BKGNT3YZC upload=AX2EH91SNBGB tag=0MFLQT94METW type=write size=3634890 2024-09-12T17:05:14.820 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.815+0000 7f026be9d8c0 1 < completed delete operation key=QVQ4TI319DH5 tag=T1HDTCJTU5R6 type=del 2024-09-12T17:05:14.823 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.819+0000 7f026be9d8c0 1 > prepared operation key=QVQ4TI319DH5 tag=GSB421HXBW4E type=del size=3442181 2024-09-12T17:05:14.829 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.823+0000 7f026be9d8c0 1 < suggested remove operation key=6VO85REZG2NW tag=6RI8XCKLEB4I type=del 2024-09-12T17:05:14.832 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.827+0000 7f026be9d8c0 1 > prepared operation key=SO3HLQZA8B6B tag=ZHAWTI65ME10 type=del size=4098338 2024-09-12T17:05:14.835 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.831+0000 7f026be9d8c0 -1 < failed to complete operation key=XNBE2II106VZ tag=2630BCXYKEXQ type=write size=640075: (22) Invalid argument 2024-09-12T17:05:14.837 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.831+0000 7f026be9d8c0 1 > prepared operation key=U8W1SAVSLTBF tag=2POBO2VSQ1NG type=write size=819984 2024-09-12T17:05:14.841 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.835+0000 7f026be9d8c0 1 < completed delete operation key=QVQ4TI319DH5 tag=IK3BIB9UUY65 type=del 2024-09-12T17:05:14.844 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.839+0000 7f026be9d8c0 1 > prepared operation key=LHKLWIUAT08F tag=1I4LSIBQDA8F type=del size=381776 2024-09-12T17:05:14.849 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.843+0000 7f026be9d8c0 1 < completed delete operation key=T6QRDTQRHBPI tag=I9AFQTULLHUS type=del 2024-09-12T17:05:14.850 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.847+0000 7f026be9d8c0 1 > prepared operation key=J8MU1A0CWSAQ tag=S4YACGEY7Q92 type=del size=730839 2024-09-12T17:05:14.853 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.847+0000 7f026be9d8c0 1 < completed part key=_multipart_LHKLWIUAT08F.2~0R8SMV6GMGQC.0 size=633495 2024-09-12T17:05:14.858 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.855+0000 7f026be9d8c0 1 < completed multipart upload key=LHKLWIUAT08F upload=0R8SMV6GMGQC tag=ET8G4P5LH3VI type=write size=1682071 2024-09-12T17:05:14.861 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.855+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=X8RLID1GHDIT type=del size=2081983 2024-09-12T17:05:14.864 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.859+0000 7f026be9d8c0 1 < completed delete operation key=ALFGNC1YNROX tag=T7HEOV23CWKF type=del 2024-09-12T17:05:14.866 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.863+0000 7f026be9d8c0 1 > prepared operation key=32XUMOWT8HO2 tag=XXCMMBS4VZGB type=del size=146498 2024-09-12T17:05:14.869 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.863+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~FEARGMU3LHYL.0 size=1048576 2024-09-12T17:05:14.872 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.867+0000 7f026be9d8c0 1 < completed part key=_multipart_ALFGNC1YNROX.2~FEARGMU3LHYL.1 size=1010371 2024-09-12T17:05:14.876 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.871+0000 7f026be9d8c0 1 < completed multipart upload key=ALFGNC1YNROX upload=FEARGMU3LHYL tag=615V291YW0D6 type=write size=3107523 2024-09-12T17:05:14.880 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.875+0000 7f026be9d8c0 1 > prepared operation key=XNBE2II106VZ tag=8WV37GW7QTE2 type=write size=278639 2024-09-12T17:05:14.883 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.879+0000 7f026be9d8c0 1 < completed delete operation key=U8W1SAVSLTBF tag=ES1E2FE9RSAB type=del 2024-09-12T17:05:14.888 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.883+0000 7f026be9d8c0 1 > prepared part key=_multipart_LHKLWIUAT08F.2~FTLXB6JOO8E0.0 size=1048576 2024-09-12T17:05:14.890 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.887+0000 7f026be9d8c0 1 > prepared part key=_multipart_LHKLWIUAT08F.2~FTLXB6JOO8E0.1 size=344521 2024-09-12T17:05:14.890 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.887+0000 7f026be9d8c0 1 > prepared multipart upload key=LHKLWIUAT08F upload=FTLXB6JOO8E0 tag=LDD8SH6FL98I type=write size=2441673 2024-09-12T17:05:14.893 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.887+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~U5G3VL5ICM9Q.0 size=1048576 2024-09-12T17:05:14.894 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.891+0000 7f026be9d8c0 1 < completed part key=_multipart_Y27CDEOCM7DH.2~U5G3VL5ICM9Q.1 size=260166 2024-09-12T17:05:14.899 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.895+0000 7f026be9d8c0 1 < completed multipart upload key=Y27CDEOCM7DH upload=U5G3VL5ICM9Q tag=V5TP3YYK4WI2 type=write size=2357318 2024-09-12T17:05:14.904 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.899+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~NTMJGKK1WBJC.0 size=1048576 2024-09-12T17:05:14.906 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.903+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~NTMJGKK1WBJC.1 size=1048576 2024-09-12T17:05:14.908 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.903+0000 7f026be9d8c0 1 > prepared part key=_multipart_GPUFWJ3AWEMX.2~NTMJGKK1WBJC.2 size=986079 2024-09-12T17:05:14.908 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.903+0000 7f026be9d8c0 1 > prepared multipart upload key=GPUFWJ3AWEMX upload=NTMJGKK1WBJC tag=4YSZB7E81DQJ type=write size=4131807 2024-09-12T17:05:14.914 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.911+0000 7f026be9d8c0 1 < suggested remove operation key=UU88OS653L8D tag=OXQ6M6OIDPJO type=del 2024-09-12T17:05:14.917 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.911+0000 7f026be9d8c0 1 > prepared operation key=XLKR6P8RNRVO tag=RH14A544SQ8A type=del size=3550484 2024-09-12T17:05:14.920 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.915+0000 7f026be9d8c0 1 < completed delete operation key=Y27CDEOCM7DH tag=EEI7FGTRQ4ZL type=del 2024-09-12T17:05:14.925 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.919+0000 7f026be9d8c0 1 > prepared part key=_multipart_2BQJ30RQQ25L.2~IWYGXOL8ONL1.0 size=787089 2024-09-12T17:05:14.925 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.919+0000 7f026be9d8c0 1 > prepared multipart upload key=2BQJ30RQQ25L upload=IWYGXOL8ONL1 tag=QZFJ2KOHXC89 type=write size=1835665 2024-09-12T17:05:14.928 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.923+0000 7f026be9d8c0 1 < completed delete operation key=ALFGNC1YNROX tag=6272P1QON4WX type=del 2024-09-12T17:05:14.931 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.927+0000 7f026be9d8c0 1 > prepared operation key=4G3BKGNT3YZC tag=XJJN2RVMOKVR type=del size=4088262 2024-09-12T17:05:14.934 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.931+0000 7f026be9d8c0 1 < canceled operation key=Z183NH6R676V tag=9DLEDKCKQLTG type=write size=130794 2024-09-12T17:05:14.937 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.931+0000 7f026be9d8c0 1 > prepared operation key=6VO85REZG2NW tag=1QBO4QNAYHME type=del size=25703 2024-09-12T17:05:14.940 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.935+0000 7f026be9d8c0 1 < completed part key=_multipart_SO3HLQZA8B6B.2~GH9D67NLG7CL.0 size=1048576 2024-09-12T17:05:14.942 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.939+0000 7f026be9d8c0 1 < completed part key=_multipart_SO3HLQZA8B6B.2~GH9D67NLG7CL.1 size=669538 2024-09-12T17:05:14.947 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.943+0000 7f026be9d8c0 1 < completed multipart upload key=SO3HLQZA8B6B upload=GH9D67NLG7CL tag=JCNI60XGFIPU type=write size=2766690 2024-09-12T17:05:14.950 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.947+0000 7f026be9d8c0 1 > prepared operation key=J8MU1A0CWSAQ tag=IWJ6DHK3PUA1 type=del size=3714948 2024-09-12T17:05:14.951 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.947+0000 7f026be9d8c0 1 < canceled part key=_multipart_4G3BKGNT3YZC.2~AX2EH91SNBGB.0 size=1048576 2024-09-12T17:05:14.954 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.947+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~AX2EH91SNBGB.1 size=1048576 2024-09-12T17:05:14.956 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.951+0000 7f026be9d8c0 1 < completed part key=_multipart_4G3BKGNT3YZC.2~AX2EH91SNBGB.2 size=489162 2024-09-12T17:05:14.961 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.955+0000 7f026be9d8c0 1 < canceled multipart upload key=4G3BKGNT3YZC upload=AX2EH91SNBGB tag=0MFLQT94METW type=write size=3634890 2024-09-12T17:05:14.964 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.959+0000 7f026be9d8c0 1 > prepared operation key=J8MU1A0CWSAQ tag=R0NKWSUAELXS type=write size=909034 2024-09-12T17:05:14.967 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.963+0000 7f026be9d8c0 1 < completed delete operation key=QVQ4TI319DH5 tag=GSB421HXBW4E type=del 2024-09-12T17:05:14.970 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.967+0000 7f026be9d8c0 1 > prepared operation key=LHKLWIUAT08F tag=AJF7VRPJI3ND type=del size=2832010 2024-09-12T17:05:14.974 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.967+0000 7f026be9d8c0 1 < completed delete operation key=SO3HLQZA8B6B tag=ZHAWTI65ME10 type=del 2024-09-12T17:05:14.977 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.971+0000 7f026be9d8c0 1 > prepared operation key=T6QRDTQRHBPI tag=LLDYDR4FCR3I type=write size=445742 2024-09-12T17:05:14.980 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.975+0000 7f026be9d8c0 1 < completed write operation key=U8W1SAVSLTBF tag=2POBO2VSQ1NG type=write size=819984 2024-09-12T17:05:14.983 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.979+0000 7f026be9d8c0 1 > prepared operation key=32XUMOWT8HO2 tag=8BSG0DUTI006 type=del size=782845 2024-09-12T17:05:14.986 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.983+0000 7f026be9d8c0 1 < completed delete operation key=LHKLWIUAT08F tag=1I4LSIBQDA8F type=del 2024-09-12T17:05:14.989 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.983+0000 7f026be9d8c0 1 > prepared operation key=4U1W97V0OX11 tag=8QUZ6GDEFDAB type=del size=818327 2024-09-12T17:05:14.995 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.991+0000 7f026be9d8c0 1 < completed delete operation key=J8MU1A0CWSAQ tag=S4YACGEY7Q92 type=del 2024-09-12T17:05:15.001 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.995+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~E0G1AM28XN7E.0 size=1048576 2024-09-12T17:05:15.003 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:14.999+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~E0G1AM28XN7E.1 size=1048576 2024-09-12T17:05:15.006 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.003+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~E0G1AM28XN7E.2 size=968504 2024-09-12T17:05:15.006 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.003+0000 7f026be9d8c0 1 > prepared multipart upload key=6VO85REZG2NW upload=E0G1AM28XN7E tag=CPFDJ4H62R65 type=write size=4114232 2024-09-12T17:05:15.008 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.003+0000 7f026be9d8c0 1 < completed delete operation key=21ZD52VBZIO4 tag=X8RLID1GHDIT type=del 2024-09-12T17:05:15.011 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.007+0000 7f026be9d8c0 1 > prepared operation key=32XUMOWT8HO2 tag=X2WA5KPUF0QS type=del size=3994996 2024-09-12T17:05:15.014 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.011+0000 7f026be9d8c0 1 < canceled operation key=32XUMOWT8HO2 tag=XXCMMBS4VZGB type=del size=146498 2024-09-12T17:05:15.020 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.015+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~OZ50XRQLULOK.0 size=1048576 2024-09-12T17:05:15.022 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.019+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~OZ50XRQLULOK.1 size=1048576 2024-09-12T17:05:15.024 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.019+0000 7f026be9d8c0 1 > prepared part key=_multipart_JJMEQ2O00SA2.2~OZ50XRQLULOK.2 size=802968 2024-09-12T17:05:15.024 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.019+0000 7f026be9d8c0 1 > prepared multipart upload key=JJMEQ2O00SA2 upload=OZ50XRQLULOK tag=UVRUZ2E3W9QK type=write size=3948696 2024-09-12T17:05:15.028 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.023+0000 7f026be9d8c0 1 < completed write operation key=XNBE2II106VZ tag=8WV37GW7QTE2 type=write size=278639 2024-09-12T17:05:15.031 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.027+0000 7f026be9d8c0 1 > prepared operation key=4U1W97V0OX11 tag=ZC7TPKASAUGD type=write size=228872 2024-09-12T17:05:15.034 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.031+0000 7f026be9d8c0 1 < completed part key=_multipart_LHKLWIUAT08F.2~FTLXB6JOO8E0.0 size=1048576 2024-09-12T17:05:15.037 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.031+0000 7f026be9d8c0 1 < completed part key=_multipart_LHKLWIUAT08F.2~FTLXB6JOO8E0.1 size=344521 2024-09-12T17:05:15.042 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.039+0000 7f026be9d8c0 1 < completed multipart upload key=LHKLWIUAT08F upload=FTLXB6JOO8E0 tag=LDD8SH6FL98I type=write size=2441673 2024-09-12T17:05:15.045 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.039+0000 7f026be9d8c0 1 > prepared operation key=Y27CDEOCM7DH tag=R3JR1479ZC3Z type=write size=417662 2024-09-12T17:05:15.049 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.043+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~NTMJGKK1WBJC.0 size=1048576 2024-09-12T17:05:15.049 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.043+0000 7f026be9d8c0 1 < canceled part key=_multipart_GPUFWJ3AWEMX.2~NTMJGKK1WBJC.1 size=1048576 2024-09-12T17:05:15.051 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.047+0000 7f026be9d8c0 1 < completed part key=_multipart_GPUFWJ3AWEMX.2~NTMJGKK1WBJC.2 size=986079 2024-09-12T17:05:15.057 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.051+0000 7f026be9d8c0 1 < canceled multipart upload key=GPUFWJ3AWEMX upload=NTMJGKK1WBJC tag=4YSZB7E81DQJ type=write size=4131807 2024-09-12T17:05:15.060 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.055+0000 7f026be9d8c0 1 > prepared operation key=8AFDAVJLMRD2 tag=3CJINAFO0V5I type=del size=2565555 2024-09-12T17:05:15.063 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.059+0000 7f026be9d8c0 1 < completed delete operation key=XLKR6P8RNRVO tag=RH14A544SQ8A type=del 2024-09-12T17:05:15.068 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.063+0000 7f026be9d8c0 1 > prepared part key=_multipart_SO3HLQZA8B6B.2~Y6GTZJ6K08W2.0 size=1048576 2024-09-12T17:05:15.070 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.067+0000 7f026be9d8c0 1 > prepared part key=_multipart_SO3HLQZA8B6B.2~Y6GTZJ6K08W2.1 size=294691 2024-09-12T17:05:15.070 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.067+0000 7f026be9d8c0 1 > prepared multipart upload key=SO3HLQZA8B6B upload=Y6GTZJ6K08W2 tag=107TXFNPMXTK type=write size=2391843 2024-09-12T17:05:15.073 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.067+0000 7f026be9d8c0 1 < completed part key=_multipart_2BQJ30RQQ25L.2~IWYGXOL8ONL1.0 size=787089 2024-09-12T17:05:15.077 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.071+0000 7f026be9d8c0 1 < completed multipart upload key=2BQJ30RQQ25L upload=IWYGXOL8ONL1 tag=QZFJ2KOHXC89 type=write size=1835665 2024-09-12T17:05:15.083 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.079+0000 7f026be9d8c0 1 > prepared part key=_multipart_L194KQIPFLE1.2~C116TGZG3EBC.0 size=1048576 2024-09-12T17:05:15.085 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.079+0000 7f026be9d8c0 1 > prepared part key=_multipart_L194KQIPFLE1.2~C116TGZG3EBC.1 size=977697 2024-09-12T17:05:15.086 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.079+0000 7f026be9d8c0 1 > prepared multipart upload key=L194KQIPFLE1 upload=C116TGZG3EBC tag=A0T7AOP1T04M type=write size=3074849 2024-09-12T17:05:15.092 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.087+0000 7f026be9d8c0 1 < suggested update operation key=4G3BKGNT3YZC tag=XJJN2RVMOKVR type=del size=4088262 2024-09-12T17:05:15.095 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.091+0000 7f026be9d8c0 1 > prepared operation key=T6QRDTQRHBPI tag=356XAAZX9K0D type=write size=292304 2024-09-12T17:05:15.098 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.095+0000 7f026be9d8c0 1 < canceled operation key=6VO85REZG2NW tag=1QBO4QNAYHME type=del size=25703 2024-09-12T17:05:15.101 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.095+0000 7f026be9d8c0 1 > prepared operation key=MVYWUWKSYQ9Z tag=34U6H9A40607 type=del size=2401894 2024-09-12T17:05:15.105 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.099+0000 7f026be9d8c0 1 < completed delete operation key=J8MU1A0CWSAQ tag=IWJ6DHK3PUA1 type=del 2024-09-12T17:05:15.110 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.107+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~6HBMW5JYF1P5.0 size=1048576 2024-09-12T17:05:15.113 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.107+0000 7f026be9d8c0 1 > prepared part key=_multipart_8AFDAVJLMRD2.2~6HBMW5JYF1P5.1 size=954127 2024-09-12T17:05:15.113 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.107+0000 7f026be9d8c0 1 > prepared multipart upload key=8AFDAVJLMRD2 upload=6HBMW5JYF1P5 tag=8TXX16N4E46M type=write size=3051279 2024-09-12T17:05:15.116 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.111+0000 7f026be9d8c0 1 < completed write operation key=J8MU1A0CWSAQ tag=R0NKWSUAELXS type=write size=909034 2024-09-12T17:05:15.122 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.119+0000 7f026be9d8c0 1 > prepared part key=_multipart_XNBE2II106VZ.2~BKWV8GGIW1CB.0 size=313510 2024-09-12T17:05:15.122 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.119+0000 7f026be9d8c0 1 > prepared multipart upload key=XNBE2II106VZ upload=BKWV8GGIW1CB tag=939GD4BHOXLA type=write size=1362086 2024-09-12T17:05:15.125 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.119+0000 7f026be9d8c0 1 < completed delete operation key=LHKLWIUAT08F tag=AJF7VRPJI3ND type=del 2024-09-12T17:05:15.129 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.123+0000 7f026be9d8c0 1 > prepared operation key=2BQJ30RQQ25L tag=JV79CZO2YOI4 type=write size=62760 2024-09-12T17:05:15.133 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.127+0000 7f026be9d8c0 1 < completed write operation key=T6QRDTQRHBPI tag=LLDYDR4FCR3I type=write size=445742 2024-09-12T17:05:15.139 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.135+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~WMMQW5ZA799N.0 size=1048576 2024-09-12T17:05:15.141 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.135+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~WMMQW5ZA799N.1 size=123056 2024-09-12T17:05:15.141 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.135+0000 7f026be9d8c0 1 > prepared multipart upload key=J8MU1A0CWSAQ upload=WMMQW5ZA799N tag=7EX4041BDNMH type=write size=2220208 2024-09-12T17:05:15.148 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.143+0000 7f026be9d8c0 1 < suggested remove operation key=32XUMOWT8HO2 tag=8BSG0DUTI006 type=del 2024-09-12T17:05:15.151 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.147+0000 7f026be9d8c0 1 > prepared operation key=SO3HLQZA8B6B tag=EJFF7CDFI7KI type=del size=1259386 2024-09-12T17:05:15.154 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.151+0000 7f026be9d8c0 1 < completed delete operation key=4U1W97V0OX11 tag=8QUZ6GDEFDAB type=del 2024-09-12T17:05:15.160 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.155+0000 7f026be9d8c0 1 > prepared part key=_multipart_T6QRDTQRHBPI.2~RBR3I1AKAFZI.0 size=1048576 2024-09-12T17:05:15.163 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.159+0000 7f026be9d8c0 1 > prepared part key=_multipart_T6QRDTQRHBPI.2~RBR3I1AKAFZI.1 size=1048576 2024-09-12T17:05:15.166 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.159+0000 7f026be9d8c0 1 > prepared part key=_multipart_T6QRDTQRHBPI.2~RBR3I1AKAFZI.2 size=908331 2024-09-12T17:05:15.166 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.159+0000 7f026be9d8c0 1 > prepared multipart upload key=T6QRDTQRHBPI upload=RBR3I1AKAFZI tag=0LNDTM8CGF1A type=write size=4054059 2024-09-12T17:05:15.169 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.163+0000 7f026be9d8c0 1 < completed part key=_multipart_6VO85REZG2NW.2~E0G1AM28XN7E.0 size=1048576 2024-09-12T17:05:15.172 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.167+0000 7f026be9d8c0 1 < completed part key=_multipart_6VO85REZG2NW.2~E0G1AM28XN7E.1 size=1048576 2024-09-12T17:05:15.174 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.171+0000 7f026be9d8c0 1 < completed part key=_multipart_6VO85REZG2NW.2~E0G1AM28XN7E.2 size=968504 2024-09-12T17:05:15.179 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.175+0000 7f026be9d8c0 1 < completed multipart upload key=6VO85REZG2NW upload=E0G1AM28XN7E tag=CPFDJ4H62R65 type=write size=4114232 2024-09-12T17:05:15.184 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.179+0000 7f026be9d8c0 1 > prepared part key=_multipart_RBNN03IPZ8BT.2~UU1SQTXZC2BB.0 size=1048576 2024-09-12T17:05:15.186 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.183+0000 7f026be9d8c0 1 > prepared part key=_multipart_RBNN03IPZ8BT.2~UU1SQTXZC2BB.1 size=1048576 2024-09-12T17:05:15.188 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.183+0000 7f026be9d8c0 1 > prepared part key=_multipart_RBNN03IPZ8BT.2~UU1SQTXZC2BB.2 size=1000132 2024-09-12T17:05:15.188 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.183+0000 7f026be9d8c0 1 > prepared multipart upload key=RBNN03IPZ8BT upload=UU1SQTXZC2BB tag=SZOMFD5B70PM type=write size=4145860 2024-09-12T17:05:15.191 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.187+0000 7f026be9d8c0 -1 < failed to complete operation key=32XUMOWT8HO2 tag=X2WA5KPUF0QS type=del size=3994996: (22) Invalid argument 2024-09-12T17:05:15.194 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.191+0000 7f026be9d8c0 1 > prepared operation key=JJMEQ2O00SA2 tag=ITYQAOWDJ3GI type=del size=3787758 2024-09-12T17:05:15.197 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.191+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~OZ50XRQLULOK.0 size=1048576 2024-09-12T17:05:15.199 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.195+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~OZ50XRQLULOK.1 size=1048576 2024-09-12T17:05:15.202 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.195+0000 7f026be9d8c0 1 < completed part key=_multipart_JJMEQ2O00SA2.2~OZ50XRQLULOK.2 size=802968 2024-09-12T17:05:15.207 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.203+0000 7f026be9d8c0 1 < completed multipart upload key=JJMEQ2O00SA2 upload=OZ50XRQLULOK tag=UVRUZ2E3W9QK type=write size=3948696 2024-09-12T17:05:15.210 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.207+0000 7f026be9d8c0 1 > prepared operation key=L194KQIPFLE1 tag=4XQJ3HSUD2HU type=del size=877353 2024-09-12T17:05:15.214 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.207+0000 7f026be9d8c0 1 < completed write operation key=4U1W97V0OX11 tag=ZC7TPKASAUGD type=write size=228872 2024-09-12T17:05:15.217 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.211+0000 7f026be9d8c0 1 > prepared operation key=SGT8IC1GJ3IG tag=NQSPJ0OVL0VU type=del size=1943322 2024-09-12T17:05:15.220 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.215+0000 7f026be9d8c0 1 < completed write operation key=Y27CDEOCM7DH tag=R3JR1479ZC3Z type=write size=417662 2024-09-12T17:05:15.226 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.223+0000 7f026be9d8c0 1 > prepared part key=_multipart_XNBE2II106VZ.2~EM0V4DBEXRYS.0 size=1048576 2024-09-12T17:05:15.228 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.223+0000 7f026be9d8c0 1 > prepared part key=_multipart_XNBE2II106VZ.2~EM0V4DBEXRYS.1 size=1048576 2024-09-12T17:05:15.231 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.227+0000 7f026be9d8c0 1 > prepared part key=_multipart_XNBE2II106VZ.2~EM0V4DBEXRYS.2 size=498375 2024-09-12T17:05:15.231 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.227+0000 7f026be9d8c0 1 > prepared multipart upload key=XNBE2II106VZ upload=EM0V4DBEXRYS tag=PVBOUAPLXF0F type=write size=3644103 2024-09-12T17:05:15.234 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.231+0000 7f026be9d8c0 1 < completed delete operation key=8AFDAVJLMRD2 tag=3CJINAFO0V5I type=del 2024-09-12T17:05:15.238 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.231+0000 7f026be9d8c0 1 > prepared operation key=GPUFWJ3AWEMX tag=3AZ3BIR0T952 type=del size=4080520 2024-09-12T17:05:15.241 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.235+0000 7f026be9d8c0 1 < completed part key=_multipart_SO3HLQZA8B6B.2~Y6GTZJ6K08W2.0 size=1048576 2024-09-12T17:05:15.241 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.235+0000 7f026be9d8c0 1 < canceled part key=_multipart_SO3HLQZA8B6B.2~Y6GTZJ6K08W2.1 size=294691 2024-09-12T17:05:15.247 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.243+0000 7f026be9d8c0 1 < canceled multipart upload key=SO3HLQZA8B6B upload=Y6GTZJ6K08W2 tag=107TXFNPMXTK type=write size=2391843 2024-09-12T17:05:15.251 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.247+0000 7f026be9d8c0 1 > prepared operation key=32XUMOWT8HO2 tag=2HUA1XZ0WT80 type=del size=1765613 2024-09-12T17:05:15.254 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.251+0000 7f026be9d8c0 1 < completed part key=_multipart_L194KQIPFLE1.2~C116TGZG3EBC.0 size=1048576 2024-09-12T17:05:15.257 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.251+0000 7f026be9d8c0 1 < completed part key=_multipart_L194KQIPFLE1.2~C116TGZG3EBC.1 size=977697 2024-09-12T17:05:15.262 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.259+0000 7f026be9d8c0 1 < completed multipart upload key=L194KQIPFLE1 upload=C116TGZG3EBC tag=A0T7AOP1T04M type=write size=3074849 2024-09-12T17:05:15.266 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.263+0000 7f026be9d8c0 1 > prepared operation key=21ZD52VBZIO4 tag=Q3I2YJ80EO5T type=del size=1012559 2024-09-12T17:05:15.270 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.267+0000 7f026be9d8c0 1 < completed write operation key=T6QRDTQRHBPI tag=356XAAZX9K0D type=write size=292304 2024-09-12T17:05:15.273 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.267+0000 7f026be9d8c0 1 > prepared operation key=Z183NH6R676V tag=MY8LQGVF7SGB type=del size=2540655 2024-09-12T17:05:15.277 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.271+0000 7f026be9d8c0 1 < completed delete operation key=MVYWUWKSYQ9Z tag=34U6H9A40607 type=del 2024-09-12T17:05:15.282 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.279+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~WLO8UHSYTX8L.0 size=1048576 2024-09-12T17:05:15.289 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.283+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~WLO8UHSYTX8L.1 size=1048576 2024-09-12T17:05:15.292 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.287+0000 7f026be9d8c0 1 > prepared part key=_multipart_QVQ4TI319DH5.2~WLO8UHSYTX8L.2 size=40651 2024-09-12T17:05:15.292 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.287+0000 7f026be9d8c0 1 > prepared multipart upload key=QVQ4TI319DH5 upload=WLO8UHSYTX8L tag=HWLOD2RZK64E type=write size=3186379 2024-09-12T17:05:15.295 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.291+0000 7f026be9d8c0 1 < completed part key=_multipart_8AFDAVJLMRD2.2~6HBMW5JYF1P5.0 size=1048576 2024-09-12T17:05:15.296 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.291+0000 7f026be9d8c0 1 < canceled part key=_multipart_8AFDAVJLMRD2.2~6HBMW5JYF1P5.1 size=954127 2024-09-12T17:05:15.301 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.295+0000 7f026be9d8c0 1 < canceled multipart upload key=8AFDAVJLMRD2 upload=6HBMW5JYF1P5 tag=8TXX16N4E46M type=write size=3051279 2024-09-12T17:05:15.305 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.299+0000 7f026be9d8c0 1 > prepared operation key=Z183NH6R676V tag=2QMBNYYDBOXY type=del size=3016617 2024-09-12T17:05:15.308 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.303+0000 7f026be9d8c0 1 < completed part key=_multipart_XNBE2II106VZ.2~BKWV8GGIW1CB.0 size=313510 2024-09-12T17:05:15.313 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.307+0000 7f026be9d8c0 1 < completed multipart upload key=XNBE2II106VZ upload=BKWV8GGIW1CB tag=939GD4BHOXLA type=write size=1362086 2024-09-12T17:05:15.318 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.315+0000 7f026be9d8c0 1 > prepared part key=_multipart_6VO85REZG2NW.2~M4PSYN9PR7SV.0 size=79016 2024-09-12T17:05:15.318 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.315+0000 7f026be9d8c0 1 > prepared multipart upload key=6VO85REZG2NW upload=M4PSYN9PR7SV tag=HQ8IURSECEY9 type=write size=1127592 2024-09-12T17:05:15.321 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.315+0000 7f026be9d8c0 1 < completed write operation key=2BQJ30RQQ25L tag=JV79CZO2YOI4 type=write size=62760 2024-09-12T17:05:15.325 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.319+0000 7f026be9d8c0 1 > prepared operation key=Z9YNIEQCVNBA tag=EY148NE3CFLK type=del size=2672812 2024-09-12T17:05:15.328 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.323+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~WMMQW5ZA799N.0 size=1048576 2024-09-12T17:05:15.331 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.327+0000 7f026be9d8c0 1 < completed part key=_multipart_J8MU1A0CWSAQ.2~WMMQW5ZA799N.1 size=123056 2024-09-12T17:05:15.337 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.331+0000 7f026be9d8c0 1 < completed multipart upload key=J8MU1A0CWSAQ upload=WMMQW5ZA799N tag=7EX4041BDNMH type=write size=2220208 2024-09-12T17:05:15.343 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.339+0000 7f026be9d8c0 1 > prepared part key=_multipart_MVYWUWKSYQ9Z.2~O3GBQ387SJVX.0 size=98949 2024-09-12T17:05:15.343 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.339+0000 7f026be9d8c0 1 > prepared multipart upload key=MVYWUWKSYQ9Z upload=O3GBQ387SJVX tag=W8KVUVDKQV86 type=write size=1147525 2024-09-12T17:05:15.351 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.343+0000 7f026be9d8c0 1 < suggested remove operation key=SO3HLQZA8B6B tag=EJFF7CDFI7KI type=del 2024-09-12T17:05:15.353 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.347+0000 7f026be9d8c0 1 > prepared operation key=4U1W97V0OX11 tag=KHSMG11FBTIM type=del size=1450261 2024-09-12T17:05:15.356 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.351+0000 7f026be9d8c0 1 < completed part key=_multipart_T6QRDTQRHBPI.2~RBR3I1AKAFZI.0 size=1048576 2024-09-12T17:05:15.359 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.355+0000 7f026be9d8c0 1 < completed part key=_multipart_T6QRDTQRHBPI.2~RBR3I1AKAFZI.1 size=1048576 2024-09-12T17:05:15.361 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.355+0000 7f026be9d8c0 1 < completed part key=_multipart_T6QRDTQRHBPI.2~RBR3I1AKAFZI.2 size=908331 2024-09-12T17:05:15.367 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.363+0000 7f026be9d8c0 1 < completed multipart upload key=T6QRDTQRHBPI upload=RBR3I1AKAFZI tag=0LNDTM8CGF1A type=write size=4054059 2024-09-12T17:05:15.370 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.367+0000 7f026be9d8c0 1 > prepared operation key=8AFDAVJLMRD2 tag=JJVK36K2803R type=del size=3544045 2024-09-12T17:05:15.374 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.367+0000 7f026be9d8c0 1 < completed part key=_multipart_RBNN03IPZ8BT.2~UU1SQTXZC2BB.0 size=1048576 2024-09-12T17:05:15.376 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.371+0000 7f026be9d8c0 1 < completed part key=_multipart_RBNN03IPZ8BT.2~UU1SQTXZC2BB.1 size=1048576 2024-09-12T17:05:15.376 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.371+0000 7f026be9d8c0 1 < canceled part key=_multipart_RBNN03IPZ8BT.2~UU1SQTXZC2BB.2 size=1000132 2024-09-12T17:05:15.382 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.379+0000 7f026be9d8c0 1 < canceled multipart upload key=RBNN03IPZ8BT upload=UU1SQTXZC2BB tag=SZOMFD5B70PM type=write size=4145860 2024-09-12T17:05:15.385 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.379+0000 7f026be9d8c0 1 > prepared operation key=SL2446KSB531 tag=SX241T4FDDQ1 type=del size=300719 2024-09-12T17:05:15.389 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.383+0000 7f026be9d8c0 1 < completed delete operation key=JJMEQ2O00SA2 tag=ITYQAOWDJ3GI type=del 2024-09-12T17:05:15.395 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.391+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~DAJ1LCFP5IOZ.0 size=1048576 2024-09-12T17:05:15.398 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.391+0000 7f026be9d8c0 1 > prepared part key=_multipart_J8MU1A0CWSAQ.2~DAJ1LCFP5IOZ.1 size=130033 2024-09-12T17:05:15.398 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.391+0000 7f026be9d8c0 1 > prepared multipart upload key=J8MU1A0CWSAQ upload=DAJ1LCFP5IOZ tag=C6HQ817BU9M7 type=write size=2227185 2024-09-12T17:05:15.404 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.399+0000 7f026be9d8c0 1 < suggested update operation key=L194KQIPFLE1 tag=4XQJ3HSUD2HU type=del size=877353 2024-09-12T17:05:15.410 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.407+0000 7f026be9d8c0 1 > prepared part key=_multipart_MVYWUWKSYQ9Z.2~Y0Z5WA276L2O.0 size=1048576 2024-09-12T17:05:15.413 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.407+0000 7f026be9d8c0 1 > prepared part key=_multipart_MVYWUWKSYQ9Z.2~Y0Z5WA276L2O.1 size=553352 2024-09-12T17:05:15.413 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.407+0000 7f026be9d8c0 1 > prepared multipart upload key=MVYWUWKSYQ9Z upload=Y0Z5WA276L2O tag=ZJBXPS41WK4X type=write size=2650504 2024-09-12T17:05:15.416 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.411+0000 7f026be9d8c0 1 < canceled operation key=SGT8IC1GJ3IG tag=NQSPJ0OVL0VU type=del size=1943322 2024-09-12T17:05:15.419 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.415+0000 7f026be9d8c0 1 > prepared operation key=BW1T21LBUE2D tag=UOFUYLQRFBXK type=del size=900345 2024-09-12T17:05:15.423 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.419+0000 7f026be9d8c0 1 < completed part key=_multipart_XNBE2II106VZ.2~EM0V4DBEXRYS.0 size=1048576 2024-09-12T17:05:15.425 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.419+0000 7f026be9d8c0 1 < completed part key=_multipart_XNBE2II106VZ.2~EM0V4DBEXRYS.1 size=1048576 2024-09-12T17:05:15.425 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.419+0000 7f026be9d8c0 1 < canceled part key=_multipart_XNBE2II106VZ.2~EM0V4DBEXRYS.2 size=498375 2024-09-12T17:05:15.431 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.427+0000 7f026be9d8c0 1 < canceled multipart upload key=XNBE2II106VZ upload=EM0V4DBEXRYS tag=PVBOUAPLXF0F type=write size=3644103 2024-09-12T17:05:15.434 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.431+0000 7f026be9d8c0 1 > prepared operation key=4U1W97V0OX11 tag=BTO8SFN1MCS2 type=del size=797364 2024-09-12T17:05:15.438 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.431+0000 7f026be9d8c0 1 < completed delete operation key=GPUFWJ3AWEMX tag=3AZ3BIR0T952 type=del 2024-09-12T17:05:15.444 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.439+0000 7f026be9d8c0 1 > prepared part key=_multipart_SGT8IC1GJ3IG.2~1XXIT6HEMQEC.0 size=1048576 2024-09-12T17:05:15.447 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.443+0000 7f026be9d8c0 1 > prepared part key=_multipart_SGT8IC1GJ3IG.2~1XXIT6HEMQEC.1 size=583960 2024-09-12T17:05:15.447 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.443+0000 7f026be9d8c0 1 > prepared multipart upload key=SGT8IC1GJ3IG upload=1XXIT6HEMQEC tag=HSRE3NUOQNK8 type=write size=2681112 2024-09-12T17:05:15.450 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.447+0000 7f026be9d8c0 1 < completed delete operation key=32XUMOWT8HO2 tag=2HUA1XZ0WT80 type=del 2024-09-12T17:05:15.456 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.451+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~VE2V51701BE9.0 size=1048576 2024-09-12T17:05:15.459 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.455+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~VE2V51701BE9.1 size=1048576 2024-09-12T17:05:15.461 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.455+0000 7f026be9d8c0 1 > prepared part key=_multipart_Z9YNIEQCVNBA.2~VE2V51701BE9.2 size=1030497 2024-09-12T17:05:15.462 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.455+0000 7f026be9d8c0 1 > prepared multipart upload key=Z9YNIEQCVNBA upload=VE2V51701BE9 tag=K68OGZZD3O5T type=write size=4176225 2024-09-12T17:05:15.465 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.459+0000 7f026be9d8c0 1 < completed delete operation key=21ZD52VBZIO4 tag=Q3I2YJ80EO5T type=del 2024-09-12T17:05:15.468 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.463+0000 7f026be9d8c0 1 > prepared operation key=4U1W97V0OX11 tag=31L949HXK89O type=del size=366730 2024-09-12T17:05:15.471 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.467+0000 7f026be9d8c0 1 < completed delete operation key=Z183NH6R676V tag=MY8LQGVF7SGB type=del 2024-09-12T17:05:15.474 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.471+0000 7f026be9d8c0 1 > prepared operation key=XLKR6P8RNRVO tag=RDU0JWU8FDA8 type=del size=3429891 2024-09-12T17:05:15.475 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.471+0000 7f026be9d8c0 1 < canceled part key=_multipart_QVQ4TI319DH5.2~WLO8UHSYTX8L.0 size=1048576 2024-09-12T17:05:15.478 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.471+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~WLO8UHSYTX8L.1 size=1048576 2024-09-12T17:05:15.480 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.475+0000 7f026be9d8c0 1 < completed part key=_multipart_QVQ4TI319DH5.2~WLO8UHSYTX8L.2 size=40651 2024-09-12T17:05:15.487 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.483+0000 7f026be9d8c0 1 < canceled multipart upload key=QVQ4TI319DH5 upload=WLO8UHSYTX8L tag=HWLOD2RZK64E type=write size=3186379 2024-09-12T17:05:15.491 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.487+0000 7f026be9d8c0 1 > prepared operation key=JJMEQ2O00SA2 tag=N5ZRXCNXW3SU type=del size=3646889 2024-09-12T17:05:15.495 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.491+0000 7f026be9d8c0 1 < completed delete operation key=Z183NH6R676V tag=2QMBNYYDBOXY type=del 2024-09-12T17:05:15.502 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.499+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~9XU9K8P7MYUN.0 size=1048576 2024-09-12T17:05:15.506 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.503+0000 7f026be9d8c0 1 > prepared part key=_multipart_4G3BKGNT3YZC.2~9XU9K8P7MYUN.1 size=930116 2024-09-12T17:05:15.506 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.503+0000 7f026be9d8c0 1 > prepared multipart upload key=4G3BKGNT3YZC upload=9XU9K8P7MYUN tag=BLEH18OC49XP type=write size=3027268 2024-09-12T17:05:15.510 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.507+0000 7f026be9d8c0 1 < completed part key=_multipart_6VO85REZG2NW.2~M4PSYN9PR7SV.0 size=79016 2024-09-12T17:05:15.516 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.511+0000 7f026be9d8c0 1 < completed multipart upload key=6VO85REZG2NW upload=M4PSYN9PR7SV tag=HQ8IURSECEY9 type=write size=1127592 2024-09-12T17:05:15.519 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.515+0000 7f026be9d8c0 1 > prepared operation key=SGT8IC1GJ3IG tag=OYI3UZNOG3BJ type=write size=989090 2024-09-12T17:05:15.523 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.519+0000 7f026be9d8c0 1 < completed delete operation key=Z9YNIEQCVNBA tag=EY148NE3CFLK type=del 2024-09-12T17:05:15.529 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.523+0000 7f026be9d8c0 1 > prepared part key=_multipart_T6QRDTQRHBPI.2~2G9QTP1QJ27M.0 size=1048576 2024-09-12T17:05:15.532 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.527+0000 7f026be9d8c0 1 > prepared part key=_multipart_T6QRDTQRHBPI.2~2G9QTP1QJ27M.1 size=1048576 2024-09-12T17:05:15.534 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.531+0000 7f026be9d8c0 1 > prepared part key=_multipart_T6QRDTQRHBPI.2~2G9QTP1QJ27M.2 size=304388 2024-09-12T17:05:15.534 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.531+0000 7f026be9d8c0 1 > prepared multipart upload key=T6QRDTQRHBPI upload=2G9QTP1QJ27M tag=YHX5TK7GM1Z0 type=write size=3450116 2024-09-12T17:05:15.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.535+0000 7f026be9d8c0 1 < completed part key=_multipart_MVYWUWKSYQ9Z.2~O3GBQ387SJVX.0 size=98949 2024-09-12T17:05:15.544 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.539+0000 7f026be9d8c0 1 < completed multipart upload key=MVYWUWKSYQ9Z upload=O3GBQ387SJVX tag=W8KVUVDKQV86 type=write size=1147525 2024-09-12T17:05:15.550 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.547+0000 7f026be9d8c0 1 > prepared part key=_multipart_SL2446KSB531.2~AGO4T00PCZ4X.0 size=735917 2024-09-12T17:05:15.550 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:05:15.547+0000 7f026be9d8c0 1 > prepared multipart upload key=SL2446KSB531 upload=AGO4T00PCZ4X tag=R2UT04UIKT3W type=write size=1784493 2024-09-12T17:05:15.551 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] cls_rgw_stats.simulate (24890 ms) 2024-09-12T17:05:15.551 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] 1 test from cls_rgw_stats (24890 ms total) 2024-09-12T17:05:15.551 INFO:tasks.workunit.client.0.smithi016.stdout: 2024-09-12T17:05:15.552 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] Global test environment tear-down 2024-09-12T17:05:15.756 INFO:tasks.workunit.client.0.smithi016.stdout:[==========] 1 test from 1 test suite ran. (26951 ms total) 2024-09-12T17:05:15.756 INFO:tasks.workunit.client.0.smithi016.stdout:[ PASSED ] 1 test. 2024-09-12T17:05:15.766 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:05:15.766 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:05:15.824 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-09-12T17:05:15.825 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-09-12T17:05:15.825 DEBUG:teuthology.orchestra.run.smithi016:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-09-12T17:05:15.890 INFO:tasks.workunit.client.0.smithi016.stdout:Running main() from gmock_main.cc 2024-09-12T17:05:15.890 INFO:tasks.workunit.client.0.smithi016.stdout:[==========] Running 31 tests from 1 test suite. 2024-09-12T17:05:15.890 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] Global test environment set-up. 2024-09-12T17:05:17.778 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] 31 tests from CmpOmap 2024-09-12T17:05:17.778 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-09-12T17:05:17.808 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (29 ms) 2024-09-12T17:05:17.808 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-09-12T17:05:17.828 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (21 ms) 2024-09-12T17:05:17.828 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-09-12T17:05:17.835 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (6 ms) 2024-09-12T17:05:17.835 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-09-12T17:05:17.841 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (7 ms) 2024-09-12T17:05:17.841 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-09-12T17:05:17.861 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] CmpOmap.cmp_vals_str (19 ms) 2024-09-12T17:05:17.861 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-09-12T17:05:17.872 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] CmpOmap.cmp_vals_u64 (11 ms) 2024-09-12T17:05:17.872 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-09-12T17:05:17.879 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (7 ms) 2024-09-12T17:05:17.879 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-09-12T17:05:17.889 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (10 ms) 2024-09-12T17:05:17.889 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-09-12T17:05:17.899 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (10 ms) 2024-09-12T17:05:17.899 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-09-12T17:05:17.912 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (13 ms) 2024-09-12T17:05:17.912 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-09-12T17:05:17.918 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (2 ms) 2024-09-12T17:05:17.918 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-09-12T17:05:17.918 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (2 ms) 2024-09-12T17:05:17.918 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-09-12T17:05:17.933 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (18 ms) 2024-09-12T17:05:17.933 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-09-12T17:05:17.952 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (18 ms) 2024-09-12T17:05:17.952 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-09-12T17:05:17.970 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (18 ms) 2024-09-12T17:05:17.970 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-09-12T17:05:17.988 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (19 ms) 2024-09-12T17:05:17.988 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-09-12T17:05:18.009 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] CmpOmap.cmp_set_vals_str (20 ms) 2024-09-12T17:05:18.009 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-09-12T17:05:18.030 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (21 ms) 2024-09-12T17:05:18.030 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-09-12T17:05:18.038 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (7 ms) 2024-09-12T17:05:18.038 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-09-12T17:05:18.044 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (6 ms) 2024-09-12T17:05:18.044 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-09-12T17:05:18.047 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (2 ms) 2024-09-12T17:05:18.047 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-09-12T17:05:18.049 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (2 ms) 2024-09-12T17:05:18.049 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-09-12T17:05:18.068 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (19 ms) 2024-09-12T17:05:18.068 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-09-12T17:05:18.086 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (18 ms) 2024-09-12T17:05:18.086 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-09-12T17:05:18.105 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (20 ms) 2024-09-12T17:05:18.106 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-09-12T17:05:18.127 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (21 ms) 2024-09-12T17:05:18.127 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-09-12T17:05:18.132 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (6 ms) 2024-09-12T17:05:18.132 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-09-12T17:05:18.140 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (7 ms) 2024-09-12T17:05:18.140 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-09-12T17:05:18.142 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (3 ms) 2024-09-12T17:05:18.143 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-09-12T17:05:18.144 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (2 ms) 2024-09-12T17:05:18.145 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-09-12T17:05:18.167 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (22 ms) 2024-09-12T17:05:18.167 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] 31 tests from CmpOmap (388 ms total) 2024-09-12T17:05:18.167 INFO:tasks.workunit.client.0.smithi016.stdout: 2024-09-12T17:05:18.167 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] Global test environment tear-down 2024-09-12T17:05:18.810 INFO:tasks.workunit.client.0.smithi016.stdout:[==========] 31 tests from 1 test suite ran. (2921 ms total) 2024-09-12T17:05:18.811 INFO:tasks.workunit.client.0.smithi016.stdout:[ PASSED ] 31 tests. 2024-09-12T17:05:18.816 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:05:18.816 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:05:18.875 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-09-12T17:05:18.877 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-09-12T17:05:18.877 DEBUG:teuthology.orchestra.run.smithi016:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-09-12T17:05:18.941 INFO:tasks.workunit.client.0.smithi016.stdout:Running main() from gmock_main.cc 2024-09-12T17:05:18.941 INFO:tasks.workunit.client.0.smithi016.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T17:05:18.941 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] Global test environment set-up. 2024-09-12T17:05:18.942 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] 24 tests from TestCls2PCQueue 2024-09-12T17:05:18.942 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-09-12T17:05:21.839 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2898 ms) 2024-09-12T17:05:21.839 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-09-12T17:05:24.879 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3040 ms) 2024-09-12T17:05:24.879 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-09-12T17:05:27.932 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] TestCls2PCQueue.Reserve (3054 ms) 2024-09-12T17:05:27.933 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-09-12T17:05:31.002 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3069 ms) 2024-09-12T17:05:31.002 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-09-12T17:05:35.051 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] TestCls2PCQueue.Commit (4050 ms) 2024-09-12T17:05:35.051 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-09-12T17:05:39.150 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] TestCls2PCQueue.Stats (4098 ms) 2024-09-12T17:05:39.150 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-09-12T17:05:43.186 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4036 ms) 2024-09-12T17:05:43.186 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-09-12T17:05:46.223 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] TestCls2PCQueue.Abort (3036 ms) 2024-09-12T17:05:46.223 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-09-12T17:05:49.256 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] TestCls2PCQueue.ReserveError (3034 ms) 2024-09-12T17:05:49.256 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-09-12T17:05:52.296 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] TestCls2PCQueue.CommitError (3039 ms) 2024-09-12T17:05:52.296 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-09-12T17:05:55.354 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] TestCls2PCQueue.AbortError (3054 ms) 2024-09-12T17:05:55.354 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-09-12T17:05:58.400 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3051 ms) 2024-09-12T17:05:58.401 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-09-12T17:06:01.404 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3004 ms) 2024-09-12T17:06:01.405 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-09-12T17:06:04.470 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3065 ms) 2024-09-12T17:06:04.470 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-09-12T17:06:07.529 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3060 ms) 2024-09-12T17:06:07.530 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-09-12T17:06:10.594 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3063 ms) 2024-09-12T17:06:10.594 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-09-12T17:06:13.595 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3002 ms) 2024-09-12T17:06:13.595 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-09-12T17:06:16.653 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] TestCls2PCQueue.Cleanup (3058 ms) 2024-09-12T17:06:16.653 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-09-12T17:06:29.806 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] TestCls2PCQueue.MultiProducer (13150 ms) 2024-09-12T17:06:29.806 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-09-12T17:06:34.851 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (5049 ms) 2024-09-12T17:06:34.852 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-09-12T17:06:48.997 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (14146 ms) 2024-09-12T17:06:48.997 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-09-12T17:06:56.052 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (7054 ms) 2024-09-12T17:06:56.052 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-09-12T17:07:07.126 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (11075 ms) 2024-09-12T17:07:07.126 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-09-12T17:07:17.442 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (10316 ms) 2024-09-12T17:07:17.442 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] 24 tests from TestCls2PCQueue (118502 ms total) 2024-09-12T17:07:17.442 INFO:tasks.workunit.client.0.smithi016.stdout: 2024-09-12T17:07:17.442 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] Global test environment tear-down 2024-09-12T17:07:17.442 INFO:tasks.workunit.client.0.smithi016.stdout:[==========] 24 tests from 1 test suite ran. (118502 ms total) 2024-09-12T17:07:17.442 INFO:tasks.workunit.client.0.smithi016.stdout:[ PASSED ] 24 tests. 2024-09-12T17:07:17.447 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:07:17.447 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:07:17.507 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-09-12T17:07:17.508 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-09-12T17:07:17.509 DEBUG:teuthology.orchestra.run.smithi016:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-09-12T17:07:17.585 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:07:17.585 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:07:17.586 INFO:tasks.workunit.client.0.smithi016.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T17:07:17.586 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] Global test environment set-up. 2024-09-12T17:07:19.442 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] 4 tests from ClsAccount 2024-09-12T17:07:19.442 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] ClsAccount.add 2024-09-12T17:07:19.490 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] ClsAccount.add (49 ms) 2024-09-12T17:07:19.510 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] ClsAccount.get 2024-09-12T17:07:19.511 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] ClsAccount.get (10 ms) 2024-09-12T17:07:19.511 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] ClsAccount.rm 2024-09-12T17:07:19.826 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] ClsAccount.rm (326 ms) 2024-09-12T17:07:19.826 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] ClsAccount.list 2024-09-12T17:07:19.869 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] ClsAccount.list (43 ms) 2024-09-12T17:07:19.869 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] 4 tests from ClsAccount (428 ms total) 2024-09-12T17:07:19.869 INFO:tasks.workunit.client.0.smithi016.stdout: 2024-09-12T17:07:19.869 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] Global test environment tear-down 2024-09-12T17:07:20.479 INFO:tasks.workunit.client.0.smithi016.stdout:[==========] 4 tests from 1 test suite ran. (2894 ms total) 2024-09-12T17:07:20.480 INFO:tasks.workunit.client.0.smithi016.stdout:[ PASSED ] 4 tests. 2024-09-12T17:07:20.485 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:07:20.485 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:07:20.539 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-09-12T17:07:20.540 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-09-12T17:07:20.540 DEBUG:teuthology.orchestra.run.smithi016:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-09-12T17:07:20.616 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:07:20.616 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:07:20.616 INFO:tasks.workunit.client.0.smithi016.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-12T17:07:20.616 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] Global test environment set-up. 2024-09-12T17:07:22.507 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] 6 tests from rgw_gc_log 2024-09-12T17:07:22.507 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-09-12T17:07:22.521 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] rgw_gc_log.init_existing_queue (13 ms) 2024-09-12T17:07:22.521 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-09-12T17:07:22.527 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] rgw_gc_log.init_existing_omap (7 ms) 2024-09-12T17:07:22.527 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-09-12T17:07:22.535 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (8 ms) 2024-09-12T17:07:22.535 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-09-12T17:07:22.538 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (3 ms) 2024-09-12T17:07:22.538 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-09-12T17:07:22.543 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] rgw_gc_log.defer1_after_init (5 ms) 2024-09-12T17:07:22.543 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-09-12T17:07:22.546 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] rgw_gc_log.defer2_before_init (3 ms) 2024-09-12T17:07:22.546 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] 6 tests from rgw_gc_log (39 ms total) 2024-09-12T17:07:22.546 INFO:tasks.workunit.client.0.smithi016.stdout: 2024-09-12T17:07:22.547 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] Global test environment tear-down 2024-09-12T17:07:23.483 INFO:tasks.workunit.client.0.smithi016.stdout:[==========] 6 tests from 1 test suite ran. (2867 ms total) 2024-09-12T17:07:23.484 INFO:tasks.workunit.client.0.smithi016.stdout:[ PASSED ] 6 tests. 2024-09-12T17:07:23.489 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:07:23.489 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:07:23.551 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-09-12T17:07:23.553 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-09-12T17:07:23.553 DEBUG:teuthology.orchestra.run.smithi016:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-09-12T17:07:23.627 INFO:tasks.workunit.client.0.smithi016.stdout:Running main() from gmock_main.cc 2024-09-12T17:07:23.627 INFO:tasks.workunit.client.0.smithi016.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T17:07:23.627 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] Global test environment set-up. 2024-09-12T17:07:23.627 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] 4 tests from TestRGWObj 2024-09-12T17:07:23.627 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] TestRGWObj.underscore 2024-09-12T17:07:23.627 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: _obj 2024-09-12T17:07:23.628 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: _obj 2024-09-12T17:07:23.628 INFO:tasks.workunit.client.0.smithi016.stdout:stripped: _obj ns= i= 2024-09-12T17:07:23.628 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: _obj 2024-09-12T17:07:23.628 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: _obj 2024-09-12T17:07:23.628 INFO:tasks.workunit.client.0.smithi016.stdout:stripped: _obj ns= i= 2024-09-12T17:07:23.628 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: _obj 2024-09-12T17:07:23.628 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: _obj 2024-09-12T17:07:23.628 INFO:tasks.workunit.client.0.smithi016.stdout:stripped: _obj ns= i= 2024-09-12T17:07:23.628 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.628 INFO:tasks.workunit.client.0.smithi016.stdout: "obj1": { 2024-09-12T17:07:23.628 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.628 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.628 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.629 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.629 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.629 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.629 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.630 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.630 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.630 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.630 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.630 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.630 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_obj", 2024-09-12T17:07:23.630 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.630 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.631 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.631 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.631 INFO:tasks.workunit.client.0.smithi016.stdout: "obj2": { 2024-09-12T17:07:23.631 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.631 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.631 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.631 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.631 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.631 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.631 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.631 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.631 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.631 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.632 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.632 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.632 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_obj", 2024-09-12T17:07:23.632 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.632 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.632 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.632 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.632 INFO:tasks.workunit.client.0.smithi016.stdout: "obj3": { 2024-09-12T17:07:23.632 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.633 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.633 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.633 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.633 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.633 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.633 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.633 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.633 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.633 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.633 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.633 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.633 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_obj", 2024-09-12T17:07:23.634 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.634 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.634 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.634 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.634 INFO:tasks.workunit.client.0.smithi016.stdout: "obj3-2": { 2024-09-12T17:07:23.634 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.634 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.634 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.634 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.634 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.634 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.635 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.635 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.635 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.635 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.635 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.635 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.635 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_obj", 2024-09-12T17:07:23.635 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.635 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.635 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.635 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.635 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.635 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: _obj 2024-09-12T17:07:23.635 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: _obj 2024-09-12T17:07:23.636 INFO:tasks.workunit.client.0.smithi016.stdout:stripped: _obj ns=ns i= 2024-09-12T17:07:23.636 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: _obj 2024-09-12T17:07:23.636 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: _obj 2024-09-12T17:07:23.636 INFO:tasks.workunit.client.0.smithi016.stdout:stripped: _obj ns=ns i= 2024-09-12T17:07:23.636 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: _obj 2024-09-12T17:07:23.636 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: _obj 2024-09-12T17:07:23.636 INFO:tasks.workunit.client.0.smithi016.stdout:stripped: _obj ns=ns i= 2024-09-12T17:07:23.636 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.636 INFO:tasks.workunit.client.0.smithi016.stdout: "obj1": { 2024-09-12T17:07:23.636 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.636 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.636 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.636 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.637 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.637 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.637 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.637 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.637 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.637 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.637 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.637 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.637 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_obj", 2024-09-12T17:07:23.637 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.637 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.637 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.637 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.637 INFO:tasks.workunit.client.0.smithi016.stdout: "obj2": { 2024-09-12T17:07:23.638 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.638 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.638 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.638 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.638 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.638 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.638 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.638 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.638 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.638 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.638 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.638 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.638 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_obj", 2024-09-12T17:07:23.639 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.639 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.639 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.639 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.639 INFO:tasks.workunit.client.0.smithi016.stdout: "obj3": { 2024-09-12T17:07:23.639 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.639 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.639 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.639 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.639 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.639 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.639 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.640 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.640 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.640 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.640 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.640 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.640 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_obj", 2024-09-12T17:07:23.640 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.640 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.640 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.640 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.640 INFO:tasks.workunit.client.0.smithi016.stdout: "obj3-2": { 2024-09-12T17:07:23.640 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.640 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.641 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.641 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.641 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.641 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.641 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.642 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.642 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.642 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.642 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.642 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.642 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_obj", 2024-09-12T17:07:23.642 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.642 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.642 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.642 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.642 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.642 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: _obj[v1] 2024-09-12T17:07:23.642 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: _obj[v1] 2024-09-12T17:07:23.643 INFO:tasks.workunit.client.0.smithi016.stdout:stripped: _obj ns= i=v1 2024-09-12T17:07:23.643 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: _obj[v1] 2024-09-12T17:07:23.643 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: _obj[v1] 2024-09-12T17:07:23.643 INFO:tasks.workunit.client.0.smithi016.stdout:stripped: _obj ns= i=v1 2024-09-12T17:07:23.643 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: _obj[v1] 2024-09-12T17:07:23.643 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: _obj[v1] 2024-09-12T17:07:23.643 INFO:tasks.workunit.client.0.smithi016.stdout:stripped: _obj ns= i=v1 2024-09-12T17:07:23.643 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.643 INFO:tasks.workunit.client.0.smithi016.stdout: "obj1": { 2024-09-12T17:07:23.643 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.643 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.643 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.643 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.644 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.644 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.644 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.644 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.644 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.644 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.644 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.644 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.644 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_obj", 2024-09-12T17:07:23.644 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "v1", 2024-09-12T17:07:23.644 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.644 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.645 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.645 INFO:tasks.workunit.client.0.smithi016.stdout: "obj2": { 2024-09-12T17:07:23.645 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.645 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.645 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.645 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.645 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.645 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.645 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.646 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.646 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.646 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.646 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.646 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.646 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_obj", 2024-09-12T17:07:23.646 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "v1", 2024-09-12T17:07:23.646 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.646 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.646 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.646 INFO:tasks.workunit.client.0.smithi016.stdout: "obj3": { 2024-09-12T17:07:23.646 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.646 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.647 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.647 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.647 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.647 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.647 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.647 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.647 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.648 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.648 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.648 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.648 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_obj", 2024-09-12T17:07:23.648 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.648 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.648 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.648 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.648 INFO:tasks.workunit.client.0.smithi016.stdout: "obj3-2": { 2024-09-12T17:07:23.648 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.648 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.648 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.648 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.649 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.649 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.649 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.649 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.649 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.649 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.649 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.649 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.649 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_obj", 2024-09-12T17:07:23.649 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "v1", 2024-09-12T17:07:23.649 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.649 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.649 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.650 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.650 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: _obj[v1] 2024-09-12T17:07:23.650 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: _obj[v1] 2024-09-12T17:07:23.650 INFO:tasks.workunit.client.0.smithi016.stdout:stripped: _obj ns=ns i=v1 2024-09-12T17:07:23.650 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: _obj[v1] 2024-09-12T17:07:23.650 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: _obj[v1] 2024-09-12T17:07:23.650 INFO:tasks.workunit.client.0.smithi016.stdout:stripped: _obj ns=ns i=v1 2024-09-12T17:07:23.650 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: _obj[v1] 2024-09-12T17:07:23.650 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: _obj[v1] 2024-09-12T17:07:23.651 INFO:tasks.workunit.client.0.smithi016.stdout:stripped: _obj ns=ns i=v1 2024-09-12T17:07:23.651 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.651 INFO:tasks.workunit.client.0.smithi016.stdout: "obj1": { 2024-09-12T17:07:23.651 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.651 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.651 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.651 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.651 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.651 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.651 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.651 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.651 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.651 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.652 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.652 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.652 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_obj", 2024-09-12T17:07:23.652 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "v1", 2024-09-12T17:07:23.652 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.652 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.652 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.652 INFO:tasks.workunit.client.0.smithi016.stdout: "obj2": { 2024-09-12T17:07:23.652 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.652 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.652 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.652 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.653 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.653 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.653 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.653 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.654 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.654 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.654 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.654 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.654 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_obj", 2024-09-12T17:07:23.654 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "v1", 2024-09-12T17:07:23.654 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.654 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.654 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.654 INFO:tasks.workunit.client.0.smithi016.stdout: "obj3": { 2024-09-12T17:07:23.654 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.654 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.654 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.654 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.655 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.655 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.655 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.655 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.655 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.655 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.655 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.655 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.655 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_obj", 2024-09-12T17:07:23.655 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.655 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.655 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.655 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.656 INFO:tasks.workunit.client.0.smithi016.stdout: "obj3-2": { 2024-09-12T17:07:23.656 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.656 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.656 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.656 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.656 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.656 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.656 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.656 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.656 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.656 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.656 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.656 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.657 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_obj", 2024-09-12T17:07:23.657 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "v1", 2024-09-12T17:07:23.657 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.657 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.657 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.657 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.657 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2024-09-12T17:07:23.657 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] TestRGWObj.no_underscore 2024-09-12T17:07:23.657 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: obj 2024-09-12T17:07:23.657 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: obj 2024-09-12T17:07:23.657 INFO:tasks.workunit.client.0.smithi016.stdout:stripped: obj ns= i= 2024-09-12T17:07:23.657 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: obj 2024-09-12T17:07:23.657 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: obj 2024-09-12T17:07:23.657 INFO:tasks.workunit.client.0.smithi016.stdout:stripped: obj ns= i= 2024-09-12T17:07:23.658 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: obj 2024-09-12T17:07:23.658 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: obj 2024-09-12T17:07:23.658 INFO:tasks.workunit.client.0.smithi016.stdout:stripped: obj ns= i= 2024-09-12T17:07:23.658 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.658 INFO:tasks.workunit.client.0.smithi016.stdout: "obj1": { 2024-09-12T17:07:23.658 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.658 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.658 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.658 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.658 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.658 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.658 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.658 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.659 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.659 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.659 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.659 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.659 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "obj", 2024-09-12T17:07:23.659 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.659 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.659 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.659 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.659 INFO:tasks.workunit.client.0.smithi016.stdout: "obj2": { 2024-09-12T17:07:23.659 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.659 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.659 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.660 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.660 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.660 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.660 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.660 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.660 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.660 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.660 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.660 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.660 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "obj", 2024-09-12T17:07:23.660 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.661 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.661 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.661 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.661 INFO:tasks.workunit.client.0.smithi016.stdout: "obj3": { 2024-09-12T17:07:23.661 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.661 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.661 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.661 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.661 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.661 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.661 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.661 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.661 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.661 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.662 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.662 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.662 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "obj", 2024-09-12T17:07:23.662 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.662 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.662 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.662 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.662 INFO:tasks.workunit.client.0.smithi016.stdout: "obj3-2": { 2024-09-12T17:07:23.662 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.662 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.662 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.662 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.662 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.662 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.663 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.663 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.663 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.663 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.663 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.663 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.663 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "obj", 2024-09-12T17:07:23.663 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.663 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.663 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.663 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.663 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.664 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: obj 2024-09-12T17:07:23.664 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: obj 2024-09-12T17:07:23.664 INFO:tasks.workunit.client.0.smithi016.stdout:stripped: obj ns=ns i= 2024-09-12T17:07:23.664 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: obj 2024-09-12T17:07:23.664 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: obj 2024-09-12T17:07:23.664 INFO:tasks.workunit.client.0.smithi016.stdout:stripped: obj ns=ns i= 2024-09-12T17:07:23.664 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: obj 2024-09-12T17:07:23.664 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: obj 2024-09-12T17:07:23.664 INFO:tasks.workunit.client.0.smithi016.stdout:stripped: obj ns=ns i= 2024-09-12T17:07:23.664 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.664 INFO:tasks.workunit.client.0.smithi016.stdout: "obj1": { 2024-09-12T17:07:23.664 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.664 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.664 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.665 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.665 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.665 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.665 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.665 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.665 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.665 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.665 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.665 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.665 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "obj", 2024-09-12T17:07:23.665 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.665 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.665 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.666 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.666 INFO:tasks.workunit.client.0.smithi016.stdout: "obj2": { 2024-09-12T17:07:23.666 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.666 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.666 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.666 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.666 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.666 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.666 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.666 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.666 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.666 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.666 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.666 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.667 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "obj", 2024-09-12T17:07:23.667 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.667 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.667 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.667 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.667 INFO:tasks.workunit.client.0.smithi016.stdout: "obj3": { 2024-09-12T17:07:23.667 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.667 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.667 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.667 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.667 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.667 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.667 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.668 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.668 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.668 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.668 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.668 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.668 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "obj", 2024-09-12T17:07:23.668 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.668 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.668 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.668 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.668 INFO:tasks.workunit.client.0.smithi016.stdout: "obj3-2": { 2024-09-12T17:07:23.668 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.668 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.668 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.669 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.669 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.669 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.669 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.669 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.669 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.669 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.669 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.669 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.669 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "obj", 2024-09-12T17:07:23.669 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.669 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.669 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.670 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.670 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.670 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: obj[v1] 2024-09-12T17:07:23.670 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: obj[v1] 2024-09-12T17:07:23.670 INFO:tasks.workunit.client.0.smithi016.stdout:stripped: obj ns= i=v1 2024-09-12T17:07:23.670 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: obj[v1] 2024-09-12T17:07:23.670 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: obj[v1] 2024-09-12T17:07:23.670 INFO:tasks.workunit.client.0.smithi016.stdout:stripped: obj ns= i=v1 2024-09-12T17:07:23.670 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: obj[v1] 2024-09-12T17:07:23.670 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: obj[v1] 2024-09-12T17:07:23.671 INFO:tasks.workunit.client.0.smithi016.stdout:stripped: obj ns= i=v1 2024-09-12T17:07:23.671 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.671 INFO:tasks.workunit.client.0.smithi016.stdout: "obj1": { 2024-09-12T17:07:23.671 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.671 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.671 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.671 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.671 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.671 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.672 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.672 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.672 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.672 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.672 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.672 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.672 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "obj", 2024-09-12T17:07:23.672 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "v1", 2024-09-12T17:07:23.672 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.672 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.672 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.672 INFO:tasks.workunit.client.0.smithi016.stdout: "obj2": { 2024-09-12T17:07:23.672 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.673 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.673 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.673 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.673 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.673 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.673 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.673 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.673 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.673 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.673 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.673 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.673 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "obj", 2024-09-12T17:07:23.674 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "v1", 2024-09-12T17:07:23.674 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.674 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.674 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.674 INFO:tasks.workunit.client.0.smithi016.stdout: "obj3": { 2024-09-12T17:07:23.674 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.674 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.674 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.674 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.674 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.674 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.674 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.674 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.675 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.675 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.675 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.675 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.675 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "obj", 2024-09-12T17:07:23.675 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.675 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.675 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.675 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.675 INFO:tasks.workunit.client.0.smithi016.stdout: "obj3-2": { 2024-09-12T17:07:23.675 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.675 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.675 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.675 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.676 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.676 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.676 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.676 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.676 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.676 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.676 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.676 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.676 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "obj", 2024-09-12T17:07:23.676 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "v1", 2024-09-12T17:07:23.676 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.676 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.676 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.677 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.677 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: obj[v1] 2024-09-12T17:07:23.677 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: obj[v1] 2024-09-12T17:07:23.677 INFO:tasks.workunit.client.0.smithi016.stdout:stripped: obj ns=ns i=v1 2024-09-12T17:07:23.677 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: obj[v1] 2024-09-12T17:07:23.677 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: obj[v1] 2024-09-12T17:07:23.677 INFO:tasks.workunit.client.0.smithi016.stdout:stripped: obj ns=ns i=v1 2024-09-12T17:07:23.677 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: obj[v1] 2024-09-12T17:07:23.677 INFO:tasks.workunit.client.0.smithi016.stdout:parsed: obj[v1] 2024-09-12T17:07:23.677 INFO:tasks.workunit.client.0.smithi016.stdout:stripped: obj ns=ns i=v1 2024-09-12T17:07:23.677 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.677 INFO:tasks.workunit.client.0.smithi016.stdout: "obj1": { 2024-09-12T17:07:23.677 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.678 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.678 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.678 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.678 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.678 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.678 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.678 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.678 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.678 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.678 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.678 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.678 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "obj", 2024-09-12T17:07:23.678 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "v1", 2024-09-12T17:07:23.679 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.679 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.679 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.679 INFO:tasks.workunit.client.0.smithi016.stdout: "obj2": { 2024-09-12T17:07:23.679 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.679 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.679 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.679 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.679 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.679 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.679 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.679 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.679 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.679 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.680 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.680 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.680 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "obj", 2024-09-12T17:07:23.680 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "v1", 2024-09-12T17:07:23.680 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.680 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.680 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.680 INFO:tasks.workunit.client.0.smithi016.stdout: "obj3": { 2024-09-12T17:07:23.680 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.680 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.680 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.680 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.680 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.681 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.681 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.681 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.681 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.681 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.681 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.681 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.681 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "obj", 2024-09-12T17:07:23.681 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.681 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.681 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.681 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.681 INFO:tasks.workunit.client.0.smithi016.stdout: "obj3-2": { 2024-09-12T17:07:23.682 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.682 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.682 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.682 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.682 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.682 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.682 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.682 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.682 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.682 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.682 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.682 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.682 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "obj", 2024-09-12T17:07:23.682 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "v1", 2024-09-12T17:07:23.683 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.683 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.683 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.683 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.683 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-09-12T17:07:23.683 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-09-12T17:07:23.683 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.683 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.683 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.683 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.683 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.683 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.683 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.683 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.684 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.684 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.684 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.684 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.684 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.684 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.684 INFO:tasks.workunit.client.0.smithi016.stdout: "obj": { 2024-09-12T17:07:23.684 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.684 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.684 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.684 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.684 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.684 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.684 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.685 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.685 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.685 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.685 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.685 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.685 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "myobj", 2024-09-12T17:07:23.685 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.685 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.685 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.685 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.685 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.685 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.685 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj": { 2024-09-12T17:07:23.686 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": "default-placement.data", 2024-09-12T17:07:23.686 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker_myobj", 2024-09-12T17:07:23.686 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "" 2024-09-12T17:07:23.686 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.686 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.686 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.686 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj": { 2024-09-12T17:07:23.686 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.686 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.686 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.687 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.687 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.687 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.687 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.687 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.687 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.687 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.687 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.687 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.687 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "myobj", 2024-09-12T17:07:23.687 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.687 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.687 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.688 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.688 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.688 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.688 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.688 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.688 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.688 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.688 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.688 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.688 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.689 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.689 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.689 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.689 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.689 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.689 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.689 INFO:tasks.workunit.client.0.smithi016.stdout: "obj": { 2024-09-12T17:07:23.689 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.689 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.689 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.689 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.689 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.689 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.689 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.690 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.690 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.690 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.690 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.690 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.690 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "myobj", 2024-09-12T17:07:23.690 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.690 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.690 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.690 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.690 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.690 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.690 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj": { 2024-09-12T17:07:23.690 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": ".data-pool", 2024-09-12T17:07:23.691 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker_myobj", 2024-09-12T17:07:23.691 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "" 2024-09-12T17:07:23.691 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.691 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.691 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.691 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj": { 2024-09-12T17:07:23.691 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.691 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.691 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.691 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.691 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.691 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.691 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.692 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.692 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.692 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.692 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.692 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.692 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "myobj", 2024-09-12T17:07:23.692 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.692 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.692 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.692 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.693 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.693 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.693 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.693 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.693 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.693 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.693 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.693 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.693 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.693 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.693 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.693 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.693 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.694 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.694 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.694 INFO:tasks.workunit.client.0.smithi016.stdout: "obj": { 2024-09-12T17:07:23.694 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.694 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.694 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.694 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.694 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.694 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.694 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.694 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.694 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.694 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.694 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.695 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.695 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "myobj", 2024-09-12T17:07:23.695 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.695 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.695 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.695 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.695 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.695 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.695 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj": { 2024-09-12T17:07:23.695 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": "default-placement.data", 2024-09-12T17:07:23.695 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker__ns_myobj", 2024-09-12T17:07:23.695 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "" 2024-09-12T17:07:23.695 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.695 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.696 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.696 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj": { 2024-09-12T17:07:23.696 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.696 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.696 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.696 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.696 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.696 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.696 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.696 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.696 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.696 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.696 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.696 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.697 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "myobj", 2024-09-12T17:07:23.697 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.697 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.697 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.697 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.697 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.697 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.697 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.697 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.697 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.697 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.697 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.697 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.698 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.698 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.698 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.698 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.698 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.698 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.698 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.698 INFO:tasks.workunit.client.0.smithi016.stdout: "obj": { 2024-09-12T17:07:23.698 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.698 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.698 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.698 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.698 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.698 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.699 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.699 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.699 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.699 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.699 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.699 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.699 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "myobj", 2024-09-12T17:07:23.699 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.699 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.699 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.699 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.699 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.699 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.700 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj": { 2024-09-12T17:07:23.700 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": ".data-pool", 2024-09-12T17:07:23.700 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker__ns_myobj", 2024-09-12T17:07:23.700 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "" 2024-09-12T17:07:23.700 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.700 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.700 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.700 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj": { 2024-09-12T17:07:23.700 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.700 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.700 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.700 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.700 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.701 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.701 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.701 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.701 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.701 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.701 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.701 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.701 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "myobj", 2024-09-12T17:07:23.701 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.701 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.701 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.701 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.701 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.702 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.702 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.702 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.702 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.702 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.702 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.702 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.702 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.702 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.702 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.702 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.702 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.702 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.702 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.702 INFO:tasks.workunit.client.0.smithi016.stdout: "obj": { 2024-09-12T17:07:23.703 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.703 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.703 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.703 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.703 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.703 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.703 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.703 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.703 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.703 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.703 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.703 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.703 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "myobj", 2024-09-12T17:07:23.703 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "inst", 2024-09-12T17:07:23.704 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.704 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.704 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.704 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.704 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.704 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj": { 2024-09-12T17:07:23.704 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": "default-placement.data", 2024-09-12T17:07:23.704 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker__:inst_myobj", 2024-09-12T17:07:23.704 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "" 2024-09-12T17:07:23.704 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.704 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.704 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.704 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj": { 2024-09-12T17:07:23.705 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.705 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.705 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.705 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.705 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.705 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.705 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.705 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.705 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.705 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.705 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.705 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.705 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "myobj", 2024-09-12T17:07:23.705 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "inst", 2024-09-12T17:07:23.706 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.706 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.706 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.706 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.706 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.706 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.706 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.706 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.706 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.706 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.706 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.706 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.706 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.706 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.707 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.707 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.707 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.707 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.707 INFO:tasks.workunit.client.0.smithi016.stdout: "obj": { 2024-09-12T17:07:23.707 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.708 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.708 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.708 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.708 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.708 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.708 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.708 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.708 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.708 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.708 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.708 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.708 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "myobj", 2024-09-12T17:07:23.709 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "inst", 2024-09-12T17:07:23.709 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.709 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.709 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.709 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.709 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.709 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj": { 2024-09-12T17:07:23.709 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": ".data-pool", 2024-09-12T17:07:23.709 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker__:inst_myobj", 2024-09-12T17:07:23.709 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "" 2024-09-12T17:07:23.709 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.709 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.709 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.710 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj": { 2024-09-12T17:07:23.710 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.710 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.710 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.710 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.710 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.710 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.710 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.710 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.710 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.710 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.710 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.710 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.710 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "myobj", 2024-09-12T17:07:23.711 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "inst", 2024-09-12T17:07:23.711 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.711 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.711 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.711 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.711 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.711 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.711 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.711 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.711 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.711 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.711 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.711 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.712 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.712 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.712 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.712 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.712 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.712 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.712 INFO:tasks.workunit.client.0.smithi016.stdout: "obj": { 2024-09-12T17:07:23.712 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.712 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.712 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.712 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.712 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.712 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.712 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.712 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.713 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.713 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.713 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.713 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.713 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "myobj", 2024-09-12T17:07:23.713 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "inst", 2024-09-12T17:07:23.713 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.713 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.713 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.713 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.713 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.713 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj": { 2024-09-12T17:07:23.713 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": "default-placement.data", 2024-09-12T17:07:23.714 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T17:07:23.714 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "" 2024-09-12T17:07:23.714 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.714 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.714 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.714 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj": { 2024-09-12T17:07:23.714 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.714 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.714 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.714 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.714 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.714 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.714 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.715 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.715 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.715 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.715 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.715 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.715 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "myobj", 2024-09-12T17:07:23.715 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "inst", 2024-09-12T17:07:23.715 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.715 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.715 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.715 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.715 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.715 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.715 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.716 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.716 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.716 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.716 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.716 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.716 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.716 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.716 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.716 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.716 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.716 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.716 INFO:tasks.workunit.client.0.smithi016.stdout: "obj": { 2024-09-12T17:07:23.716 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.717 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.717 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.717 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.717 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.717 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.717 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.717 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.717 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.717 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.717 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.717 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.717 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "myobj", 2024-09-12T17:07:23.717 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "inst", 2024-09-12T17:07:23.718 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.718 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.718 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.718 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.718 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.718 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj": { 2024-09-12T17:07:23.718 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": ".data-pool", 2024-09-12T17:07:23.718 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T17:07:23.718 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "" 2024-09-12T17:07:23.718 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.718 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.718 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.718 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj": { 2024-09-12T17:07:23.719 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.719 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.719 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.719 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.719 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.719 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.719 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.719 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.719 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.719 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.719 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.719 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.719 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "myobj", 2024-09-12T17:07:23.719 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "inst", 2024-09-12T17:07:23.720 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.720 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.720 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.720 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.720 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.720 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.720 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.720 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.720 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.720 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.720 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.720 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.720 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.721 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.721 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.721 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.721 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.721 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.721 INFO:tasks.workunit.client.0.smithi016.stdout: "obj": { 2024-09-12T17:07:23.721 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.721 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.721 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.721 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.721 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.721 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.721 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.722 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.722 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.722 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.722 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.722 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.722 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj", 2024-09-12T17:07:23.722 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.722 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.722 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.722 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.722 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.722 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.722 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj": { 2024-09-12T17:07:23.722 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": "default-placement.data", 2024-09-12T17:07:23.723 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker___myobj", 2024-09-12T17:07:23.723 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "marker__myobj" 2024-09-12T17:07:23.723 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.723 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.723 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.723 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj": { 2024-09-12T17:07:23.723 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.723 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.723 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.723 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.723 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.723 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.723 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.724 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.724 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.724 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.724 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.724 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.724 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj", 2024-09-12T17:07:23.724 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.724 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.724 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.724 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.724 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.724 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.724 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.724 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.725 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.725 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.725 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.725 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.725 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.725 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.725 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.725 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.725 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.725 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.725 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.725 INFO:tasks.workunit.client.0.smithi016.stdout: "obj": { 2024-09-12T17:07:23.725 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.726 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.726 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.726 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.726 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.726 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.726 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.726 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.726 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.726 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.726 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.726 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.726 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj", 2024-09-12T17:07:23.726 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.727 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.727 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.727 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.727 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.727 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.727 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj": { 2024-09-12T17:07:23.727 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": ".data-pool", 2024-09-12T17:07:23.727 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker___myobj", 2024-09-12T17:07:23.727 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "marker__myobj" 2024-09-12T17:07:23.727 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.727 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.727 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.727 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj": { 2024-09-12T17:07:23.727 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.728 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.728 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.728 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.728 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.728 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.728 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.728 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.728 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.728 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.728 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.728 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.728 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj", 2024-09-12T17:07:23.728 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.729 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.729 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.729 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.729 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.729 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.729 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.729 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.729 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.729 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.729 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.729 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.729 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.729 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.730 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.730 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.730 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.730 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.730 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.730 INFO:tasks.workunit.client.0.smithi016.stdout: "obj": { 2024-09-12T17:07:23.730 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.730 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.730 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.730 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.730 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.730 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.730 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.731 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.731 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.731 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.731 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.731 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.731 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj", 2024-09-12T17:07:23.731 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.731 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.731 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.731 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.731 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.731 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.731 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj": { 2024-09-12T17:07:23.732 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": "default-placement.data", 2024-09-12T17:07:23.732 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker__ns__myobj", 2024-09-12T17:07:23.732 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "" 2024-09-12T17:07:23.732 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.732 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.732 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.732 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj": { 2024-09-12T17:07:23.732 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.732 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.732 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.732 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.732 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.732 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.733 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.733 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.733 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.733 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.733 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.733 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.733 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj", 2024-09-12T17:07:23.733 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.733 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.733 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.733 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.733 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.733 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.734 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.734 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.734 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.734 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.734 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.734 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.734 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.734 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.734 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.734 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.734 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.734 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.734 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.734 INFO:tasks.workunit.client.0.smithi016.stdout: "obj": { 2024-09-12T17:07:23.735 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.735 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.735 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.735 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.735 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.735 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.735 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.735 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.735 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.735 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.735 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.735 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.735 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj", 2024-09-12T17:07:23.736 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.736 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.736 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.736 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.736 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.736 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.736 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj": { 2024-09-12T17:07:23.736 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": ".data-pool", 2024-09-12T17:07:23.736 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker__ns__myobj", 2024-09-12T17:07:23.736 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "" 2024-09-12T17:07:23.736 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.736 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.736 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.736 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj": { 2024-09-12T17:07:23.737 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.737 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.737 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.737 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.737 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.737 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.737 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.737 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.737 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.737 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.737 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.737 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.737 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj", 2024-09-12T17:07:23.738 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.738 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.738 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.738 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.738 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.738 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.738 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.738 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.738 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.738 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.739 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.739 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.739 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.739 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.739 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.739 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.739 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.739 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.739 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.739 INFO:tasks.workunit.client.0.smithi016.stdout: "obj": { 2024-09-12T17:07:23.739 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.739 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.739 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.740 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.740 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.740 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.740 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.740 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.740 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.740 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.740 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.740 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.740 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj", 2024-09-12T17:07:23.740 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "inst", 2024-09-12T17:07:23.740 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.740 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.741 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.741 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.741 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.741 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj": { 2024-09-12T17:07:23.741 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": "default-placement.data", 2024-09-12T17:07:23.741 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker__:inst__myobj", 2024-09-12T17:07:23.741 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "marker__myobj" 2024-09-12T17:07:23.741 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.741 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.741 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.741 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj": { 2024-09-12T17:07:23.741 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.741 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.741 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.742 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.742 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.742 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.742 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.742 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.742 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.742 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.742 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.742 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.742 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj", 2024-09-12T17:07:23.742 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "inst", 2024-09-12T17:07:23.742 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.742 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.743 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.743 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.743 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.743 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.743 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.743 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.743 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.743 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.743 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.743 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.743 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.743 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.743 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.744 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.744 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.744 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.744 INFO:tasks.workunit.client.0.smithi016.stdout: "obj": { 2024-09-12T17:07:23.744 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.744 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.744 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.744 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.744 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.744 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.744 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.744 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.744 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.745 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.745 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.745 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.745 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj", 2024-09-12T17:07:23.745 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "inst", 2024-09-12T17:07:23.745 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.745 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.745 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.745 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.745 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.745 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj": { 2024-09-12T17:07:23.745 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": ".data-pool", 2024-09-12T17:07:23.745 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker__:inst__myobj", 2024-09-12T17:07:23.746 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "marker__myobj" 2024-09-12T17:07:23.746 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.746 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.746 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.746 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj": { 2024-09-12T17:07:23.746 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.746 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.746 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.746 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.746 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.746 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.746 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.746 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.746 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.747 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.747 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.747 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.747 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj", 2024-09-12T17:07:23.747 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "inst", 2024-09-12T17:07:23.747 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.747 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.747 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.747 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.747 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.747 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.747 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.747 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.748 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.748 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.748 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.748 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.748 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.748 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.748 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.748 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.748 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.748 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.748 INFO:tasks.workunit.client.0.smithi016.stdout: "obj": { 2024-09-12T17:07:23.748 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.748 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.749 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.749 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.749 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.749 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.749 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.749 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.749 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.749 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.749 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.749 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.749 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj", 2024-09-12T17:07:23.749 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "inst", 2024-09-12T17:07:23.749 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.749 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.750 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.750 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.750 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.750 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj": { 2024-09-12T17:07:23.750 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": "default-placement.data", 2024-09-12T17:07:23.750 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T17:07:23.750 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "" 2024-09-12T17:07:23.750 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.750 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.750 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.750 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj": { 2024-09-12T17:07:23.750 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.750 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.751 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.751 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.751 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.751 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.751 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.751 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.751 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.751 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.751 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.751 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.751 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj", 2024-09-12T17:07:23.751 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "inst", 2024-09-12T17:07:23.751 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.751 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.752 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.752 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.752 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.752 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.752 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.752 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.752 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.752 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.752 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.752 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.752 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.752 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.752 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.753 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.753 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.753 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.753 INFO:tasks.workunit.client.0.smithi016.stdout: "obj": { 2024-09-12T17:07:23.753 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.753 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.753 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.753 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.753 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.753 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.753 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.753 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.753 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.753 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.754 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.754 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.754 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj", 2024-09-12T17:07:23.754 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "inst", 2024-09-12T17:07:23.754 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.754 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.754 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.754 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.754 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.754 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj": { 2024-09-12T17:07:23.754 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": ".data-pool", 2024-09-12T17:07:23.754 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T17:07:23.754 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "" 2024-09-12T17:07:23.755 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.755 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.755 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.755 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj": { 2024-09-12T17:07:23.755 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.755 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.755 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.755 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.755 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.755 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.755 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.755 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.755 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.755 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.756 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.756 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.756 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj", 2024-09-12T17:07:23.756 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "inst", 2024-09-12T17:07:23.756 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.756 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.756 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.756 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.756 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.756 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.756 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.756 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.756 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.757 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.757 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.757 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.757 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.757 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.757 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.757 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.757 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.757 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.757 INFO:tasks.workunit.client.0.smithi016.stdout: "obj": { 2024-09-12T17:07:23.757 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.757 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.757 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.757 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.758 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.758 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.758 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.758 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.758 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.758 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.758 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.758 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.758 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj_", 2024-09-12T17:07:23.758 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.758 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.758 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.758 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.758 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.759 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.759 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj": { 2024-09-12T17:07:23.759 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": "default-placement.data", 2024-09-12T17:07:23.759 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker___myobj_", 2024-09-12T17:07:23.759 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "marker__myobj_" 2024-09-12T17:07:23.759 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.759 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.759 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.759 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj": { 2024-09-12T17:07:23.759 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.759 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.759 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.759 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.760 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.760 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.760 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.760 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.760 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.760 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.760 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.760 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.760 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj_", 2024-09-12T17:07:23.760 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.760 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.760 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.760 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.760 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.761 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.761 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.761 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.761 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.761 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.761 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.761 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.761 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.761 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.761 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.761 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.761 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.761 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.762 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.762 INFO:tasks.workunit.client.0.smithi016.stdout: "obj": { 2024-09-12T17:07:23.762 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.762 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.762 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.762 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.762 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.762 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.762 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.762 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.762 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.762 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.762 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.762 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.763 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj_", 2024-09-12T17:07:23.763 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.763 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.763 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.763 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.763 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.763 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.763 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj": { 2024-09-12T17:07:23.763 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": ".data-pool", 2024-09-12T17:07:23.763 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker___myobj_", 2024-09-12T17:07:23.763 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "marker__myobj_" 2024-09-12T17:07:23.763 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.763 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.763 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.764 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj": { 2024-09-12T17:07:23.764 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.764 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.764 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.764 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.764 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.764 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.764 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.764 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.764 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.764 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.764 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.764 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.765 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj_", 2024-09-12T17:07:23.765 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.765 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.765 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.765 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.765 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.765 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.765 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.765 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.765 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.765 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.765 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.765 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.766 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.766 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.766 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.766 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.766 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.766 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.766 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.766 INFO:tasks.workunit.client.0.smithi016.stdout: "obj": { 2024-09-12T17:07:23.766 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.766 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.766 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.766 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.766 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.766 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.767 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.767 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.767 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.767 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.767 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.767 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.767 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj_", 2024-09-12T17:07:23.767 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.767 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.767 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.767 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.767 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.767 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.767 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj": { 2024-09-12T17:07:23.768 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": "default-placement.data", 2024-09-12T17:07:23.768 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker__ns__myobj_", 2024-09-12T17:07:23.768 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "" 2024-09-12T17:07:23.768 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.768 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.768 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.768 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj": { 2024-09-12T17:07:23.768 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.768 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.768 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.768 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.768 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.768 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.769 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.769 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.769 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.769 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.769 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.769 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.769 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj_", 2024-09-12T17:07:23.769 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.769 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.769 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.769 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.769 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.769 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.769 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.770 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.770 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.770 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.770 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.770 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.770 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.770 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.770 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.770 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.770 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.770 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.770 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.770 INFO:tasks.workunit.client.0.smithi016.stdout: "obj": { 2024-09-12T17:07:23.770 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.771 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.771 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.771 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.771 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.771 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.771 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.771 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.771 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.771 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.771 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.771 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.771 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj_", 2024-09-12T17:07:23.772 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.772 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.772 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.772 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.772 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.772 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.772 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj": { 2024-09-12T17:07:23.772 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": ".data-pool", 2024-09-12T17:07:23.772 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker__ns__myobj_", 2024-09-12T17:07:23.772 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "" 2024-09-12T17:07:23.772 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.772 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.772 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.772 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj": { 2024-09-12T17:07:23.773 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.773 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.773 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.773 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.773 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.773 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.773 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.773 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.773 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.773 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.773 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.773 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.773 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj_", 2024-09-12T17:07:23.774 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.774 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.774 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.774 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.774 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.774 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.774 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.774 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.774 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.774 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.774 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.774 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.774 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.775 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.775 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.775 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.775 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.775 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.775 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.775 INFO:tasks.workunit.client.0.smithi016.stdout: "obj": { 2024-09-12T17:07:23.775 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.775 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.775 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.775 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.775 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.775 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.775 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.776 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.776 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.776 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.776 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.776 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.776 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj_", 2024-09-12T17:07:23.776 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "inst", 2024-09-12T17:07:23.776 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.776 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.776 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.776 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.776 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.776 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj": { 2024-09-12T17:07:23.777 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": "default-placement.data", 2024-09-12T17:07:23.777 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T17:07:23.777 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "marker__myobj_" 2024-09-12T17:07:23.777 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.777 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.777 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.777 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj": { 2024-09-12T17:07:23.777 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.777 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.777 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.777 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.777 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.777 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.778 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.778 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.778 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.778 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.778 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.778 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.778 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj_", 2024-09-12T17:07:23.778 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "inst", 2024-09-12T17:07:23.778 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.778 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.778 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.778 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.778 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.778 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.779 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.779 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.779 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.779 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.779 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.779 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.779 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.779 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.779 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.779 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.779 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.779 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.780 INFO:tasks.workunit.client.0.smithi016.stdout: "obj": { 2024-09-12T17:07:23.780 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.780 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.780 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.780 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.780 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.780 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.780 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.780 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.780 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.780 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.780 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.780 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.781 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj_", 2024-09-12T17:07:23.781 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "inst", 2024-09-12T17:07:23.781 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.781 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.781 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.781 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.781 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.781 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj": { 2024-09-12T17:07:23.781 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": ".data-pool", 2024-09-12T17:07:23.781 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T17:07:23.781 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "marker__myobj_" 2024-09-12T17:07:23.781 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.781 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.782 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.782 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj": { 2024-09-12T17:07:23.782 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.782 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.782 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.782 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.782 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.782 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.782 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.782 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.782 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.782 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.782 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.783 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.783 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj_", 2024-09-12T17:07:23.783 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "inst", 2024-09-12T17:07:23.783 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.783 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.783 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.783 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.783 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.783 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.783 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.783 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.783 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.783 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.783 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.784 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.784 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.784 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.784 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.784 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.784 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.784 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.784 INFO:tasks.workunit.client.0.smithi016.stdout: "obj": { 2024-09-12T17:07:23.784 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.784 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.784 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.784 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.784 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.785 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.785 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.785 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.785 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.785 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.785 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.785 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.785 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj_", 2024-09-12T17:07:23.785 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "inst", 2024-09-12T17:07:23.785 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.785 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.785 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.785 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.785 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.786 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj": { 2024-09-12T17:07:23.786 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": "default-placement.data", 2024-09-12T17:07:23.786 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T17:07:23.786 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "" 2024-09-12T17:07:23.786 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.786 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.786 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.786 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj": { 2024-09-12T17:07:23.786 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.786 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "test", 2024-09-12T17:07:23.786 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.786 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.786 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.787 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.787 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": "", 2024-09-12T17:07:23.787 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.787 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": "" 2024-09-12T17:07:23.787 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.787 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.787 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.787 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj_", 2024-09-12T17:07:23.787 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "inst", 2024-09-12T17:07:23.787 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.787 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.787 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.787 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.788 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.788 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.788 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.788 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.788 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.788 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.788 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.788 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.788 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.788 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.788 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.788 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.788 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.788 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.789 INFO:tasks.workunit.client.0.smithi016.stdout: "obj": { 2024-09-12T17:07:23.789 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.789 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.789 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.789 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.789 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.789 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.789 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.789 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.789 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.789 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.789 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.789 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.789 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj_", 2024-09-12T17:07:23.790 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "inst", 2024-09-12T17:07:23.790 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.790 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.790 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.790 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.790 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.790 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj": { 2024-09-12T17:07:23.790 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": ".data-pool", 2024-09-12T17:07:23.790 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T17:07:23.790 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "" 2024-09-12T17:07:23.790 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.790 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.790 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.790 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj": { 2024-09-12T17:07:23.791 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.791 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.791 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.791 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.791 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.791 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.791 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.791 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.791 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.791 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.791 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.791 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.791 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj_", 2024-09-12T17:07:23.792 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "inst", 2024-09-12T17:07:23.792 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.792 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.792 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.792 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.792 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] TestRGWObj.obj_to_raw (1 ms) 2024-09-12T17:07:23.792 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-09-12T17:07:23.792 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.792 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj": { 2024-09-12T17:07:23.792 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": ".data-pool", 2024-09-12T17:07:23.792 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker_myobj", 2024-09-12T17:07:23.792 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "" 2024-09-12T17:07:23.792 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.792 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.793 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.793 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj": { 2024-09-12T17:07:23.793 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.793 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.793 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.793 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.793 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.793 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.793 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.793 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.793 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.793 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.793 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.793 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.794 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "myobj", 2024-09-12T17:07:23.794 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.794 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.794 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.794 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.794 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.794 INFO:tasks.workunit.client.0.smithi016.stdout:raw=.data-pool:marker_myobj 2024-09-12T17:07:23.794 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.794 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj2": { 2024-09-12T17:07:23.794 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": ".data-pool", 2024-09-12T17:07:23.794 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker_myobj", 2024-09-12T17:07:23.794 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "" 2024-09-12T17:07:23.794 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.794 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.795 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.795 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj2": { 2024-09-12T17:07:23.795 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.795 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.795 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.795 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.795 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.795 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.795 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.795 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.795 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.795 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.795 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.795 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.796 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "myobj", 2024-09-12T17:07:23.796 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.796 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.796 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.796 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.796 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.796 INFO:tasks.workunit.client.0.smithi016.stdout:raw2=.data-pool:marker_myobj 2024-09-12T17:07:23.796 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.796 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj": { 2024-09-12T17:07:23.796 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": ".data-pool", 2024-09-12T17:07:23.796 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker__ns_myobj", 2024-09-12T17:07:23.796 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "" 2024-09-12T17:07:23.796 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.797 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.797 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.797 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj": { 2024-09-12T17:07:23.797 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.797 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.797 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.797 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.797 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.797 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.797 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.797 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.797 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.797 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.797 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.798 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.798 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "myobj", 2024-09-12T17:07:23.798 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.798 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.798 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.798 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.798 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.798 INFO:tasks.workunit.client.0.smithi016.stdout:raw=.data-pool:marker__ns_myobj 2024-09-12T17:07:23.798 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.798 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj2": { 2024-09-12T17:07:23.798 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": ".data-pool", 2024-09-12T17:07:23.798 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker__ns_myobj", 2024-09-12T17:07:23.798 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "" 2024-09-12T17:07:23.798 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.799 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.799 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.799 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj2": { 2024-09-12T17:07:23.799 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.799 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.799 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.799 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.799 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.799 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.799 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.799 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.799 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.799 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.800 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.800 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.800 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "myobj", 2024-09-12T17:07:23.800 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.800 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.800 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.800 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.800 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.800 INFO:tasks.workunit.client.0.smithi016.stdout:raw2=.data-pool:marker__ns_myobj 2024-09-12T17:07:23.800 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.800 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj": { 2024-09-12T17:07:23.800 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": ".data-pool", 2024-09-12T17:07:23.800 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker__:inst_myobj", 2024-09-12T17:07:23.801 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "" 2024-09-12T17:07:23.801 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.801 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.801 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.801 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj": { 2024-09-12T17:07:23.801 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.801 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.801 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.801 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.801 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.801 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.801 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.801 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.801 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.802 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.802 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.802 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.802 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "myobj", 2024-09-12T17:07:23.802 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "inst", 2024-09-12T17:07:23.802 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.802 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.802 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.802 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.802 INFO:tasks.workunit.client.0.smithi016.stdout:raw=.data-pool:marker__:inst_myobj 2024-09-12T17:07:23.802 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.802 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj2": { 2024-09-12T17:07:23.802 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": ".data-pool", 2024-09-12T17:07:23.802 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker__:inst_myobj", 2024-09-12T17:07:23.803 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "" 2024-09-12T17:07:23.803 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.803 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.803 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.803 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj2": { 2024-09-12T17:07:23.803 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.803 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.803 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.803 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.803 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.803 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.803 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.803 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.803 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.804 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.804 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.804 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.804 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "myobj", 2024-09-12T17:07:23.804 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "inst", 2024-09-12T17:07:23.804 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.804 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.804 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.804 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.804 INFO:tasks.workunit.client.0.smithi016.stdout:raw2=.data-pool:marker__:inst_myobj 2024-09-12T17:07:23.804 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.804 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj": { 2024-09-12T17:07:23.804 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": ".data-pool", 2024-09-12T17:07:23.805 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T17:07:23.805 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "" 2024-09-12T17:07:23.805 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.805 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.805 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.805 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj": { 2024-09-12T17:07:23.805 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.805 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.805 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.805 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.805 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.805 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.805 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.805 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.806 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.806 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.806 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.806 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.806 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "myobj", 2024-09-12T17:07:23.806 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "inst", 2024-09-12T17:07:23.806 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.806 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.806 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.806 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.806 INFO:tasks.workunit.client.0.smithi016.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-09-12T17:07:23.806 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.806 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj2": { 2024-09-12T17:07:23.806 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": ".data-pool", 2024-09-12T17:07:23.807 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T17:07:23.807 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "" 2024-09-12T17:07:23.807 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.807 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.807 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.807 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj2": { 2024-09-12T17:07:23.807 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.807 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.807 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.807 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.807 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.807 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.807 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.807 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.808 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.808 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.808 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.808 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.808 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "myobj", 2024-09-12T17:07:23.808 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "inst", 2024-09-12T17:07:23.808 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.808 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.808 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.808 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.808 INFO:tasks.workunit.client.0.smithi016.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-09-12T17:07:23.808 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.808 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj": { 2024-09-12T17:07:23.809 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": ".data-pool", 2024-09-12T17:07:23.809 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker___myobj", 2024-09-12T17:07:23.809 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "marker__myobj" 2024-09-12T17:07:23.809 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.809 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.809 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.809 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj": { 2024-09-12T17:07:23.809 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.809 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.809 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.809 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.809 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.809 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.809 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.810 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.810 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.810 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.810 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.810 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.810 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj", 2024-09-12T17:07:23.810 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.810 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.810 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.810 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.810 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.810 INFO:tasks.workunit.client.0.smithi016.stdout:raw=.data-pool:marker___myobj 2024-09-12T17:07:23.810 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.810 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj2": { 2024-09-12T17:07:23.811 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": ".data-pool", 2024-09-12T17:07:23.811 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker___myobj", 2024-09-12T17:07:23.811 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "marker__myobj" 2024-09-12T17:07:23.811 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.811 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.811 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.811 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj2": { 2024-09-12T17:07:23.811 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.811 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.811 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.811 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.811 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.811 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.811 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.812 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.812 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.812 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.812 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.812 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.812 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj", 2024-09-12T17:07:23.812 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.812 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.812 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.812 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.812 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.812 INFO:tasks.workunit.client.0.smithi016.stdout:raw2=.data-pool:marker___myobj 2024-09-12T17:07:23.812 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.813 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj": { 2024-09-12T17:07:23.813 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": ".data-pool", 2024-09-12T17:07:23.813 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker__ns__myobj", 2024-09-12T17:07:23.813 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "" 2024-09-12T17:07:23.813 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.813 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.813 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.813 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj": { 2024-09-12T17:07:23.813 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.813 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.813 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.813 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.813 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.813 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.814 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.814 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.814 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.814 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.814 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.814 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.814 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj", 2024-09-12T17:07:23.814 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.814 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.814 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.814 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.814 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.814 INFO:tasks.workunit.client.0.smithi016.stdout:raw=.data-pool:marker__ns__myobj 2024-09-12T17:07:23.815 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.815 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj2": { 2024-09-12T17:07:23.815 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": ".data-pool", 2024-09-12T17:07:23.815 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker__ns__myobj", 2024-09-12T17:07:23.815 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "" 2024-09-12T17:07:23.815 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.815 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.815 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.815 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj2": { 2024-09-12T17:07:23.815 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.815 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.815 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.815 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.815 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.816 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.816 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.816 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.816 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.816 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.816 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.816 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.816 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj", 2024-09-12T17:07:23.816 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.816 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.816 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.816 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.816 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.816 INFO:tasks.workunit.client.0.smithi016.stdout:raw2=.data-pool:marker__ns__myobj 2024-09-12T17:07:23.817 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.817 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj": { 2024-09-12T17:07:23.817 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": ".data-pool", 2024-09-12T17:07:23.817 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker__:inst__myobj", 2024-09-12T17:07:23.817 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "marker__myobj" 2024-09-12T17:07:23.817 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.817 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.817 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.817 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj": { 2024-09-12T17:07:23.817 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.817 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.817 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.817 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.817 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.818 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.818 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.818 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.818 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.818 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.818 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.818 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.818 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj", 2024-09-12T17:07:23.818 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "inst", 2024-09-12T17:07:23.818 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.818 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.818 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.818 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.818 INFO:tasks.workunit.client.0.smithi016.stdout:raw=.data-pool:marker__:inst__myobj 2024-09-12T17:07:23.819 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.819 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj2": { 2024-09-12T17:07:23.819 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": ".data-pool", 2024-09-12T17:07:23.819 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker__:inst__myobj", 2024-09-12T17:07:23.819 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "marker__myobj" 2024-09-12T17:07:23.819 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.819 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.819 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.819 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj2": { 2024-09-12T17:07:23.819 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.819 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.819 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.819 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.819 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.820 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.820 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.820 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.820 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.820 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.820 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.820 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.820 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj", 2024-09-12T17:07:23.820 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "inst", 2024-09-12T17:07:23.820 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.820 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.820 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.820 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.821 INFO:tasks.workunit.client.0.smithi016.stdout:raw2=.data-pool:marker__:inst__myobj 2024-09-12T17:07:23.821 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.821 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj": { 2024-09-12T17:07:23.821 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": ".data-pool", 2024-09-12T17:07:23.821 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T17:07:23.821 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "" 2024-09-12T17:07:23.821 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.821 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.821 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.821 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj": { 2024-09-12T17:07:23.821 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.821 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.821 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.821 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.822 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.822 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.822 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.822 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.822 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.822 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.822 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.822 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.822 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj", 2024-09-12T17:07:23.822 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "inst", 2024-09-12T17:07:23.822 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.822 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.822 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.822 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.823 INFO:tasks.workunit.client.0.smithi016.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-09-12T17:07:23.823 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.823 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj2": { 2024-09-12T17:07:23.823 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": ".data-pool", 2024-09-12T17:07:23.823 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T17:07:23.823 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "" 2024-09-12T17:07:23.823 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.823 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.823 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.823 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj2": { 2024-09-12T17:07:23.823 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.823 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.823 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.823 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.824 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.824 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.824 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.824 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.824 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.824 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.824 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.824 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.824 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj", 2024-09-12T17:07:23.824 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "inst", 2024-09-12T17:07:23.824 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.824 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.824 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.824 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.825 INFO:tasks.workunit.client.0.smithi016.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-09-12T17:07:23.825 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.825 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj": { 2024-09-12T17:07:23.825 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": ".data-pool", 2024-09-12T17:07:23.825 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker___myobj_", 2024-09-12T17:07:23.825 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "marker__myobj_" 2024-09-12T17:07:23.825 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.825 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.825 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.825 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj": { 2024-09-12T17:07:23.825 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.825 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.825 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.826 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.826 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.826 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.826 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.826 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.826 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.826 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.826 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.826 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.826 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj_", 2024-09-12T17:07:23.826 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.826 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.826 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.826 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.827 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.827 INFO:tasks.workunit.client.0.smithi016.stdout:raw=.data-pool:marker___myobj_ 2024-09-12T17:07:23.827 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.827 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj2": { 2024-09-12T17:07:23.827 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": ".data-pool", 2024-09-12T17:07:23.827 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker___myobj_", 2024-09-12T17:07:23.827 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "marker__myobj_" 2024-09-12T17:07:23.827 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.827 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.827 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.827 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj2": { 2024-09-12T17:07:23.827 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.827 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.828 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.828 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.828 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.828 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.828 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.828 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.828 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.828 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.828 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.828 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.828 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj_", 2024-09-12T17:07:23.828 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.828 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.829 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.829 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.829 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.829 INFO:tasks.workunit.client.0.smithi016.stdout:raw2=.data-pool:marker___myobj_ 2024-09-12T17:07:23.829 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.829 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj": { 2024-09-12T17:07:23.829 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": ".data-pool", 2024-09-12T17:07:23.829 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker__ns__myobj_", 2024-09-12T17:07:23.829 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "" 2024-09-12T17:07:23.829 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.829 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.829 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.829 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj": { 2024-09-12T17:07:23.829 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.830 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.830 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.830 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.830 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.830 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.830 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.830 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.830 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.830 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.830 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.830 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.830 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj_", 2024-09-12T17:07:23.830 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.831 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.831 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.831 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.831 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.831 INFO:tasks.workunit.client.0.smithi016.stdout:raw=.data-pool:marker__ns__myobj_ 2024-09-12T17:07:23.831 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.831 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj2": { 2024-09-12T17:07:23.831 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": ".data-pool", 2024-09-12T17:07:23.831 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker__ns__myobj_", 2024-09-12T17:07:23.831 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "" 2024-09-12T17:07:23.831 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.831 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.831 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.831 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj2": { 2024-09-12T17:07:23.832 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.832 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.832 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.832 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.832 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.832 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.832 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.832 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.832 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.832 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.832 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.832 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.832 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj_", 2024-09-12T17:07:23.833 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "", 2024-09-12T17:07:23.833 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.833 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.833 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.833 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.833 INFO:tasks.workunit.client.0.smithi016.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-09-12T17:07:23.833 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.833 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj": { 2024-09-12T17:07:23.833 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": ".data-pool", 2024-09-12T17:07:23.833 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T17:07:23.833 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "marker__myobj_" 2024-09-12T17:07:23.833 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.833 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.833 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.834 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj": { 2024-09-12T17:07:23.834 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.834 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.834 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.834 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.834 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.834 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.834 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.834 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.834 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.834 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.834 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.834 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.834 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj_", 2024-09-12T17:07:23.835 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "inst", 2024-09-12T17:07:23.835 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.835 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.835 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.835 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.835 INFO:tasks.workunit.client.0.smithi016.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-09-12T17:07:23.835 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.835 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj2": { 2024-09-12T17:07:23.835 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": ".data-pool", 2024-09-12T17:07:23.835 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T17:07:23.835 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "marker__myobj_" 2024-09-12T17:07:23.835 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.835 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.835 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.836 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj2": { 2024-09-12T17:07:23.836 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.836 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.836 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.836 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.836 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.836 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.836 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.836 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.836 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.836 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.836 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.836 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.836 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj_", 2024-09-12T17:07:23.837 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "inst", 2024-09-12T17:07:23.837 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "" 2024-09-12T17:07:23.837 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.837 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.837 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.837 INFO:tasks.workunit.client.0.smithi016.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-09-12T17:07:23.837 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.837 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj": { 2024-09-12T17:07:23.837 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": ".data-pool", 2024-09-12T17:07:23.837 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T17:07:23.837 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "" 2024-09-12T17:07:23.837 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.837 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.837 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.838 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj": { 2024-09-12T17:07:23.838 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.838 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.838 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.838 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.838 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.838 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.838 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.838 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.838 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.838 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.838 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.838 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.839 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj_", 2024-09-12T17:07:23.839 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "inst", 2024-09-12T17:07:23.839 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.839 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.839 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.839 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.839 INFO:tasks.workunit.client.0.smithi016.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-09-12T17:07:23.839 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.839 INFO:tasks.workunit.client.0.smithi016.stdout: "raw_obj2": { 2024-09-12T17:07:23.839 INFO:tasks.workunit.client.0.smithi016.stdout: "pool": ".data-pool", 2024-09-12T17:07:23.839 INFO:tasks.workunit.client.0.smithi016.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T17:07:23.839 INFO:tasks.workunit.client.0.smithi016.stdout: "loc": "" 2024-09-12T17:07:23.839 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.839 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.840 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:23.840 INFO:tasks.workunit.client.0.smithi016.stdout: "new_obj2": { 2024-09-12T17:07:23.840 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket": { 2024-09-12T17:07:23.840 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "ebtest", 2024-09-12T17:07:23.840 INFO:tasks.workunit.client.0.smithi016.stdout: "marker": "marker", 2024-09-12T17:07:23.840 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_id": "bucket-id", 2024-09-12T17:07:23.840 INFO:tasks.workunit.client.0.smithi016.stdout: "tenant": "", 2024-09-12T17:07:23.840 INFO:tasks.workunit.client.0.smithi016.stdout: "explicit_placement": { 2024-09-12T17:07:23.840 INFO:tasks.workunit.client.0.smithi016.stdout: "data_pool": ".data-pool", 2024-09-12T17:07:23.840 INFO:tasks.workunit.client.0.smithi016.stdout: "data_extra_pool": "", 2024-09-12T17:07:23.840 INFO:tasks.workunit.client.0.smithi016.stdout: "index_pool": ".index-pool" 2024-09-12T17:07:23.840 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.840 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:23.840 INFO:tasks.workunit.client.0.smithi016.stdout: "key": { 2024-09-12T17:07:23.841 INFO:tasks.workunit.client.0.smithi016.stdout: "name": "_myobj_", 2024-09-12T17:07:23.841 INFO:tasks.workunit.client.0.smithi016.stdout: "instance": "inst", 2024-09-12T17:07:23.841 INFO:tasks.workunit.client.0.smithi016.stdout: "ns": "ns" 2024-09-12T17:07:23.841 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.841 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:23.841 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:23.841 INFO:tasks.workunit.client.0.smithi016.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-09-12T17:07:23.841 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] TestRGWObj.old_to_raw (1 ms) 2024-09-12T17:07:23.841 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] 4 tests from TestRGWObj (2 ms total) 2024-09-12T17:07:23.841 INFO:tasks.workunit.client.0.smithi016.stdout: 2024-09-12T17:07:23.841 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] Global test environment tear-down 2024-09-12T17:07:23.841 INFO:tasks.workunit.client.0.smithi016.stdout:[==========] 4 tests from 1 test suite ran. (2 ms total) 2024-09-12T17:07:23.841 INFO:tasks.workunit.client.0.smithi016.stdout:[ PASSED ] 4 tests. 2024-09-12T17:07:23.842 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:07:23.842 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:07:23.857 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-09-12T17:07:23.858 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-09-12T17:07:23.858 DEBUG:teuthology.orchestra.run.smithi016:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-09-12T17:07:23.994 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:07:23.994 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:07:24.054 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.053+0000 7ff81535f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:07:24.055 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.053+0000 7ff81535f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:07:24.055 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.053+0000 7ff81535f9c0 20 realm 2024-09-12T17:07:24.056 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.053+0000 7ff81535f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:07:24.056 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.053+0000 7ff81535f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:07:24.056 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.053+0000 7ff81535f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:07:24.056 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.053+0000 7ff81535f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:07:24.057 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.053+0000 7ff81535f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:07:24.057 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.053+0000 7ff81535f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:07:24.058 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.057+0000 7ff81535f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:07:24.058 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.057+0000 7ff81535f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:07:24.060 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.057+0000 7ff81535f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:07:24.060 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.057+0000 7ff81535f9c0 20 searching for the correct realm 2024-09-12T17:07:24.067 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.065+0000 7ff813666640 0 -- 172.21.15.16:0/2115672080 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7ff7fc01b040 msgr2=0x7ff7fc062ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:07:24.083 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.081+0000 7ff812664640 0 -- 172.21.15.16:0/2115672080 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7ff8040bd050 msgr2=0x7ff8040b4410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:07:24.095 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.093+0000 7ff81535f9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:07:24.095 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.093+0000 7ff81535f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:07:24.095 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.093+0000 7ff81535f9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:07:24.095 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.093+0000 7ff81535f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:07:24.095 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.093+0000 7ff81535f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:07:24.095 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.093+0000 7ff81535f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:07:24.095 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.093+0000 7ff81535f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:07:24.096 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.093+0000 7ff81535f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:07:24.096 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.093+0000 7ff81535f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:07:24.096 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.093+0000 7ff81535f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:07:24.096 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.093+0000 7ff81535f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:07:24.097 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.093+0000 7ff81535f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:07:24.097 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.093+0000 7ff81535f9c0 20 zone default found 2024-09-12T17:07:24.097 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.093+0000 7ff81535f9c0 4 Realm: () 2024-09-12T17:07:24.097 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.093+0000 7ff81535f9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:07:24.097 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.093+0000 7ff81535f9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:07:24.097 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.093+0000 7ff81535f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:07:24.098 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.093+0000 7ff81535f9c0 20 zonegroup default 2024-09-12T17:07:24.098 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.093+0000 7ff81535f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:07:24.099 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.097+0000 7ff81535f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:07:24.099 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.097+0000 7ff81535f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:07:24.099 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.097+0000 7ff81535f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:07:24.099 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.097+0000 7ff81535f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:07:24.099 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.097+0000 7ff81535f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:07:24.099 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.097+0000 7ff81535f9c0 20 started sync module instance, tier type = 2024-09-12T17:07:24.099 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.097+0000 7ff81535f9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:07:24.115 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.113+0000 7ff81535f9c0 20 add_watcher() i=0 2024-09-12T17:07:24.115 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.113+0000 7ff81535f9c0 20 add_watcher() i=1 2024-09-12T17:07:24.116 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.113+0000 7ff81535f9c0 20 add_watcher() i=2 2024-09-12T17:07:24.116 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.113+0000 7ff81535f9c0 20 add_watcher() i=3 2024-09-12T17:07:24.116 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.113+0000 7ff81535f9c0 20 add_watcher() i=4 2024-09-12T17:07:24.116 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.113+0000 7ff81535f9c0 20 add_watcher() i=5 2024-09-12T17:07:24.116 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.113+0000 7ff81535f9c0 20 add_watcher() i=6 2024-09-12T17:07:24.116 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.113+0000 7ff81535f9c0 20 add_watcher() i=7 2024-09-12T17:07:24.117 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.113+0000 7ff81535f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:07:24.119 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.117+0000 7ff6c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:07:24.120 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.117+0000 7ff81535f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:07:24.120 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.117+0000 7ff81535f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:07:24.120 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.117+0000 7ff81535f9c0 5 note: GC not initialized 2024-09-12T17:07:24.121 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.117+0000 7ff643fff640 20 reqs_thread_entry: start 2024-09-12T17:07:24.121 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.117+0000 7ff81535f9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:07:24.121 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.117+0000 7ff81535f9c0 20 Filter name: none 2024-09-12T17:07:24.121 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.117+0000 7ff641ffb640 20 reqs_thread_entry: start 2024-09-12T17:07:24.121 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.117+0000 7ff81535f9c0 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-09-12T17:07:24.121 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.117+0000 7ff81535f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:07:24.122 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.117+0000 7ff81535f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:07:24.122 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.117+0000 7ff81535f9c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-09-12T17:07:24.122 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.117+0000 7ff81535f9c0 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T17:07:24.122 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.117+0000 7ff81535f9c0 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-09-12T17:07:24.122 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.117+0000 7ff81535f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:07:24.122 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.121+0000 7ff81535f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:07:24.122 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.121+0000 7ff81535f9c0 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-09-12T17:07:24.123 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.121+0000 7ff81535f9c0 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T17:07:24.123 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.121+0000 7ff81535f9c0 10 cache get: name=default.rgw.meta+users.keys+hSKKIFOoKVxN5heNa8s73krcoY0= : miss 2024-09-12T17:07:24.123 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.121+0000 7ff81535f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:07:24.123 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.121+0000 7ff81535f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:07:24.123 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.121+0000 7ff81535f9c0 10 cache put: name=default.rgw.meta+users.keys+hSKKIFOoKVxN5heNa8s73krcoY0= info.flags=0x0 2024-09-12T17:07:24.123 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.121+0000 7ff81535f9c0 10 adding default.rgw.meta+users.keys+hSKKIFOoKVxN5heNa8s73krcoY0= to cache LRU end 2024-09-12T17:07:24.123 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.121+0000 7ff81535f9c0 10 cache get: name=default.rgw.meta+users.keys+hSKKIFOoKVxN5heNa8s73krcoY0= : hit (negative entry) 2024-09-12T17:07:24.123 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.121+0000 7ff81535f9c0 10 cache get: name=default.rgw.meta+users.keys+hSKKIFOoKVxN5heNa8s73krcoY0= : hit (negative entry) 2024-09-12T17:07:24.126 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.125+0000 7ff81535f9c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T17:07:24.126 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.125+0000 7ff81535f9c0 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T17:07:24.126 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.125+0000 7ff81535f9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-09-12T17:07:24.126 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.125+0000 7ff6f67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791297 cookie 93990590377184 notifier 5321 bl.length()=697 2024-09-12T17:07:24.126 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.125+0000 7ff6f67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T17:07:24.126 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.125+0000 7ff6f67fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T17:07:24.130 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.129+0000 7ff81535f9c0 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T17:07:24.130 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.129+0000 7ff81535f9c0 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T17:07:24.130 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.129+0000 7ff81535f9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-09-12T17:07:24.130 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.129+0000 7ff6f5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791296 cookie 93990590374912 notifier 5321 bl.length()=194 2024-09-12T17:07:24.130 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.129+0000 7ff6f5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T17:07:24.130 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.129+0000 7ff6f5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T17:07:24.133 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.129+0000 7ff81535f9c0 10 cache put: name=default.rgw.meta+users.keys+hSKKIFOoKVxN5heNa8s73krcoY0= info.flags=0x7 2024-09-12T17:07:24.133 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.129+0000 7ff81535f9c0 10 moving default.rgw.meta+users.keys+hSKKIFOoKVxN5heNa8s73krcoY0= to cache LRU end 2024-09-12T17:07:24.133 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.129+0000 7ff81535f9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:hSKKIFOoKVxN5heNa8s73krcoY0=, ofs0, ns] 2024-09-12T17:07:24.134 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.133+0000 7ff6f67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791301 cookie 93990590381024 notifier 5321 bl.length()=203 2024-09-12T17:07:24.134 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.133+0000 7ff6f67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+hSKKIFOoKVxN5heNa8s73krcoY0= info.flags=0x7 2024-09-12T17:07:24.134 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.133+0000 7ff6f67fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+hSKKIFOoKVxN5heNa8s73krcoY0= to cache LRU end 2024-09-12T17:07:24.134 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:07:24.134 INFO:tasks.workunit.client.0.smithi016.stdout: "user_id": "ceph-test-librgw-file", 2024-09-12T17:07:24.134 INFO:tasks.workunit.client.0.smithi016.stdout: "display_name": "librgw test user", 2024-09-12T17:07:24.134 INFO:tasks.workunit.client.0.smithi016.stdout: "email": "librgw@example.com", 2024-09-12T17:07:24.135 INFO:tasks.workunit.client.0.smithi016.stdout: "suspended": 0, 2024-09-12T17:07:24.135 INFO:tasks.workunit.client.0.smithi016.stdout: "max_buckets": 1000, 2024-09-12T17:07:24.135 INFO:tasks.workunit.client.0.smithi016.stdout: "subusers": [], 2024-09-12T17:07:24.135 INFO:tasks.workunit.client.0.smithi016.stdout: "keys": [ 2024-09-12T17:07:24.135 INFO:tasks.workunit.client.0.smithi016.stdout: { 2024-09-12T17:07:24.135 INFO:tasks.workunit.client.0.smithi016.stdout: "user": "ceph-test-librgw-file", 2024-09-12T17:07:24.135 INFO:tasks.workunit.client.0.smithi016.stdout: "access_key": "hSKKIFOoKVxN5heNa8s73krcoY0=", 2024-09-12T17:07:24.135 INFO:tasks.workunit.client.0.smithi016.stdout: "secret_key": "XQo17xyeZa8w9hTDISXzVhY4nen6v9UvBpCB3OsA58Ag76RXWxfMOA==", 2024-09-12T17:07:24.135 INFO:tasks.workunit.client.0.smithi016.stdout: "active": true, 2024-09-12T17:07:24.135 INFO:tasks.workunit.client.0.smithi016.stdout: "create_date": "2024-09-12T17:07:24.123516Z" 2024-09-12T17:07:24.135 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:07:24.135 INFO:tasks.workunit.client.0.smithi016.stdout: ], 2024-09-12T17:07:24.135 INFO:tasks.workunit.client.0.smithi016.stdout: "swift_keys": [], 2024-09-12T17:07:24.136 INFO:tasks.workunit.client.0.smithi016.stdout: "caps": [], 2024-09-12T17:07:24.136 INFO:tasks.workunit.client.0.smithi016.stdout: "op_mask": "read, write, delete", 2024-09-12T17:07:24.136 INFO:tasks.workunit.client.0.smithi016.stdout: "default_placement": "", 2024-09-12T17:07:24.136 INFO:tasks.workunit.client.0.smithi016.stdout: "default_storage_class": "", 2024-09-12T17:07:24.136 INFO:tasks.workunit.client.0.smithi016.stdout: "placement_tags": [], 2024-09-12T17:07:24.136 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_quota": { 2024-09-12T17:07:24.136 INFO:tasks.workunit.client.0.smithi016.stdout: "enabled": false, 2024-09-12T17:07:24.136 INFO:tasks.workunit.client.0.smithi016.stdout: "check_on_raw": false, 2024-09-12T17:07:24.136 INFO:tasks.workunit.client.0.smithi016.stdout: "max_size": -1, 2024-09-12T17:07:24.136 INFO:tasks.workunit.client.0.smithi016.stdout: "max_size_kb": 0, 2024-09-12T17:07:24.136 INFO:tasks.workunit.client.0.smithi016.stdout: "max_objects": -1 2024-09-12T17:07:24.136 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:24.136 INFO:tasks.workunit.client.0.smithi016.stdout: "user_quota": { 2024-09-12T17:07:24.136 INFO:tasks.workunit.client.0.smithi016.stdout: "enabled": false, 2024-09-12T17:07:24.137 INFO:tasks.workunit.client.0.smithi016.stdout: "check_on_raw": false, 2024-09-12T17:07:24.137 INFO:tasks.workunit.client.0.smithi016.stdout: "max_size": -1, 2024-09-12T17:07:24.137 INFO:tasks.workunit.client.0.smithi016.stdout: "max_size_kb": 0, 2024-09-12T17:07:24.137 INFO:tasks.workunit.client.0.smithi016.stdout: "max_objects": -1 2024-09-12T17:07:24.137 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:07:24.137 INFO:tasks.workunit.client.0.smithi016.stdout: "temp_url_keys": [], 2024-09-12T17:07:24.137 INFO:tasks.workunit.client.0.smithi016.stdout: "type": "rgw", 2024-09-12T17:07:24.137 INFO:tasks.workunit.client.0.smithi016.stdout: "mfa_ids": [], 2024-09-12T17:07:24.137 INFO:tasks.workunit.client.0.smithi016.stdout: "account_id": "", 2024-09-12T17:07:24.137 INFO:tasks.workunit.client.0.smithi016.stdout: "path": "/", 2024-09-12T17:07:24.137 INFO:tasks.workunit.client.0.smithi016.stdout: "create_date": "2024-09-12T17:07:24.123501Z", 2024-09-12T17:07:24.137 INFO:tasks.workunit.client.0.smithi016.stdout: "tags": [], 2024-09-12T17:07:24.137 INFO:tasks.workunit.client.0.smithi016.stdout: "group_ids": [] 2024-09-12T17:07:24.138 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:07:24.138 INFO:tasks.workunit.client.0.smithi016.stdout: 2024-09-12T17:07:24.138 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.133+0000 7ff6c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:07:24.141 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.137+0000 7ff81535f9c0 20 remove_watcher() i=0 2024-09-12T17:07:24.141 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.137+0000 7ff81535f9c0 2 removed watcher, disabling cache 2024-09-12T17:07:24.143 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.141+0000 7ff81535f9c0 20 remove_watcher() i=1 2024-09-12T17:07:24.145 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.141+0000 7ff81535f9c0 20 remove_watcher() i=2 2024-09-12T17:07:24.147 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.145+0000 7ff81535f9c0 20 remove_watcher() i=3 2024-09-12T17:07:24.149 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.145+0000 7ff81535f9c0 20 remove_watcher() i=4 2024-09-12T17:07:24.150 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.149+0000 7ff81535f9c0 20 remove_watcher() i=5 2024-09-12T17:07:24.151 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.149+0000 7ff81535f9c0 20 remove_watcher() i=6 2024-09-12T17:07:24.153 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:24.149+0000 7ff81535f9c0 20 remove_watcher() i=7 2024-09-12T17:07:24.167 INFO:tasks.workunit.client.0.smithi016.stdout:phase 1.1 2024-09-12T17:07:24.185 INFO:tasks.workunit.client.0.smithi016.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T17:07:24.186 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] Global test environment set-up. 2024-09-12T17:07:24.186 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] 24 tests from LibRGW 2024-09-12T17:07:24.186 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:07:24.197 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:07:24.198 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:07:24.733 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.INIT (548 ms) 2024-09-12T17:07:24.734 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T17:07:24.735 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.MOUNT_NOROOT (3 ms) 2024-09-12T17:07:24.736 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:07:24.736 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T17:07:24.736 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T17:07:24.747 INFO:tasks.workunit.client.0.smithi016.stdout:creating: nfsroot:foo/bar/baz/quux 2024-09-12T17:07:24.753 INFO:tasks.workunit.client.0.smithi016.stdout:creating: nfsroot:foo/f1 2024-09-12T17:07:24.759 INFO:tasks.workunit.client.0.smithi016.stdout:creating: nfsroot:foo/f2 2024-09-12T17:07:24.763 INFO:tasks.workunit.client.0.smithi016.stdout:creating: nfsroot:foo/bar/f1 2024-09-12T17:07:24.768 INFO:tasks.workunit.client.0.smithi016.stdout:creating: nfsroot:foo/bar/d1/ 2024-09-12T17:07:24.773 INFO:tasks.workunit.client.0.smithi016.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-09-12T17:07:24.779 INFO:tasks.workunit.client.0.smithi016.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-09-12T17:07:24.784 INFO:tasks.workunit.client.0.smithi016.stdout:creating: nfsroot:foo/bar/baz/momma 2024-09-12T17:07:24.789 INFO:tasks.workunit.client.0.smithi016.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-09-12T17:07:24.795 INFO:tasks.workunit.client.0.smithi016.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-09-12T17:07:24.801 INFO:tasks.workunit.client.0.smithi016.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-09-12T17:07:24.806 INFO:tasks.workunit.client.0.smithi016.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-09-12T17:07:24.811 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.SETUP_HIER1 (75 ms) 2024-09-12T17:07:24.811 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T17:07:25.069 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.SETUP_DIRS1 (257 ms) 2024-09-12T17:07:25.069 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T17:07:25.069 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T17:07:25.069 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T17:07:25.116 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (48 ms) 2024-09-12T17:07:25.117 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T17:07:25.219 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (103 ms) 2024-09-12T17:07:25.219 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T17:07:25.219 INFO:tasks.workunit.client.0.smithi016.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-09-12T17:07:25.237 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (18 ms) 2024-09-12T17:07:25.237 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T17:07:25.237 INFO:tasks.workunit.client.0.smithi016.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-09-12T17:07:25.254 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (17 ms) 2024-09-12T17:07:25.254 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T17:07:25.254 INFO:tasks.workunit.client.0.smithi016.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T17:07:25.254 INFO:tasks.workunit.client.0.smithi016.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:07:25.254 INFO:tasks.workunit.client.0.smithi016.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:07:25.254 INFO:tasks.workunit.client.0.smithi016.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:07:25.254 INFO:tasks.workunit.client.0.smithi016.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:07:25.254 INFO:tasks.workunit.client.0.smithi016.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T17:07:25.255 INFO:tasks.workunit.client.0.smithi016.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:07:25.255 INFO:tasks.workunit.client.0.smithi016.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:07:25.255 INFO:tasks.workunit.client.0.smithi016.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:07:25.255 INFO:tasks.workunit.client.0.smithi016.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:07:25.255 INFO:tasks.workunit.client.0.smithi016.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T17:07:25.255 INFO:tasks.workunit.client.0.smithi016.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:07:25.255 INFO:tasks.workunit.client.0.smithi016.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:07:25.255 INFO:tasks.workunit.client.0.smithi016.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:07:25.255 INFO:tasks.workunit.client.0.smithi016.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:07:25.255 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T17:07:25.255 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T17:07:25.255 INFO:tasks.workunit.client.0.smithi016.stdout:read back objects in /bdirs1/dir_0 2024-09-12T17:07:25.255 INFO:tasks.workunit.client.0.smithi016.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T17:07:25.257 INFO:tasks.workunit.client.0.smithi016.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:07:25.257 INFO:tasks.workunit.client.0.smithi016.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T17:07:25.260 INFO:tasks.workunit.client.0.smithi016.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:07:25.260 INFO:tasks.workunit.client.0.smithi016.stdout:read back objects in /bdirs1/dir_1 2024-09-12T17:07:25.260 INFO:tasks.workunit.client.0.smithi016.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T17:07:25.262 INFO:tasks.workunit.client.0.smithi016.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:07:25.263 INFO:tasks.workunit.client.0.smithi016.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T17:07:25.265 INFO:tasks.workunit.client.0.smithi016.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:07:25.265 INFO:tasks.workunit.client.0.smithi016.stdout:read back objects in /bdirs1/dir_2 2024-09-12T17:07:25.265 INFO:tasks.workunit.client.0.smithi016.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T17:07:25.268 INFO:tasks.workunit.client.0.smithi016.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:07:25.268 INFO:tasks.workunit.client.0.smithi016.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T17:07:25.271 INFO:tasks.workunit.client.0.smithi016.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:07:25.271 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.READ_DIRS1 (17 ms) 2024-09-12T17:07:25.271 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T17:07:25.508 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.READF_SETUP1 (236 ms) 2024-09-12T17:07:25.508 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T17:07:25.508 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T17:07:25.508 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T17:07:25.508 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T17:07:25.508 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T17:07:25.508 INFO:tasks.workunit.client.0.smithi016.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:07:25.508 INFO:tasks.workunit.client.0.smithi016.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:07:25.508 INFO:tasks.workunit.client.0.smithi016.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:07:25.508 INFO:tasks.workunit.client.0.smithi016.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:07:25.508 INFO:tasks.workunit.client.0.smithi016.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:07:25.509 INFO:tasks.workunit.client.0.smithi016.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:07:25.509 INFO:tasks.workunit.client.0.smithi016.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:07:25.509 INFO:tasks.workunit.client.0.smithi016.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:07:25.509 INFO:tasks.workunit.client.0.smithi016.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:07:25.509 INFO:tasks.workunit.client.0.smithi016.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:07:25.509 INFO:tasks.workunit.client.0.smithi016.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:07:25.509 INFO:tasks.workunit.client.0.smithi016.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:07:25.509 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T17:07:25.509 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T17:07:25.517 INFO:tasks.workunit.client.0.smithi016.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T17:07:25.518 INFO:tasks.workunit.client.0.smithi016.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T17:07:25.522 INFO:tasks.workunit.client.0.smithi016.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T17:07:25.525 INFO:tasks.workunit.client.0.smithi016.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T17:07:25.529 INFO:tasks.workunit.client.0.smithi016.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T17:07:25.530 INFO:tasks.workunit.client.0.smithi016.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T17:07:25.532 INFO:tasks.workunit.client.0.smithi016.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T17:07:25.532 INFO:tasks.workunit.client.0.smithi016.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T17:07:25.534 INFO:tasks.workunit.client.0.smithi016.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T17:07:25.535 INFO:tasks.workunit.client.0.smithi016.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T17:07:25.536 INFO:tasks.workunit.client.0.smithi016.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T17:07:25.539 INFO:tasks.workunit.client.0.smithi016.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T17:07:25.539 INFO:tasks.workunit.client.0.smithi016.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T17:07:25.539 INFO:tasks.workunit.client.0.smithi016.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T17:07:25.540 INFO:tasks.workunit.client.0.smithi016.stdout:/nfsroot/foo (foo): DIR 2024-09-12T17:07:25.540 INFO:tasks.workunit.client.0.smithi016.stdout:/nfsroot (nfsroot): DIR 2024-09-12T17:07:25.540 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.HIER1 (32 ms) 2024-09-12T17:07:25.541 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:07:25.541 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T17:07:25.541 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:07:25.541 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T17:07:25.541 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:07:25.541 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T17:07:25.541 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:07:25.541 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:07:25.541 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:07:25.541 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:07:25.541 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:07:25.541 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:07:25.541 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:07:25.542 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:25.537+0000 7fd4a3f15a80 -1 shutting down 2024-09-12T17:07:25.542 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:25.541+0000 7fd37dc67640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 54802, si_uid : 1000, si_addr0x3e80000d612, si_status0 2024-09-12T17:07:54.985 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.SHUTDOWN (29446 ms) 2024-09-12T17:07:54.986 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] 24 tests from LibRGW (30800 ms total) 2024-09-12T17:07:54.986 INFO:tasks.workunit.client.0.smithi016.stdout: 2024-09-12T17:07:54.986 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] Global test environment tear-down 2024-09-12T17:07:54.986 INFO:tasks.workunit.client.0.smithi016.stdout:[==========] 24 tests from 1 test suite ran. (30800 ms total) 2024-09-12T17:07:54.986 INFO:tasks.workunit.client.0.smithi016.stdout:[ PASSED ] 24 tests. 2024-09-12T17:07:54.999 INFO:tasks.workunit.client.0.smithi016.stdout:phase 1.2 2024-09-12T17:07:55.023 INFO:tasks.workunit.client.0.smithi016.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T17:07:55.023 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] Global test environment set-up. 2024-09-12T17:07:55.023 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] 24 tests from LibRGW 2024-09-12T17:07:55.023 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:07:55.034 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:07:55.034 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:07:55.785 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.INIT (762 ms) 2024-09-12T17:07:55.786 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T17:07:55.787 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-09-12T17:07:55.788 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:07:55.788 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T17:07:55.788 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T17:07:55.788 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-09-12T17:07:55.788 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T17:07:55.788 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-09-12T17:07:55.788 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T17:07:55.788 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T17:07:55.788 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T17:07:55.788 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T17:07:55.788 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T17:07:55.788 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T17:07:55.789 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T17:07:55.789 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T17:07:55.789 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T17:07:55.789 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T17:07:55.789 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T17:07:55.789 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T17:07:55.789 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T17:07:55.789 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-09-12T17:07:55.789 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T17:07:55.789 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T17:07:55.789 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T17:07:55.789 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T17:07:55.789 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T17:07:55.790 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T17:07:55.790 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T17:07:55.790 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T17:07:55.790 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T17:07:55.790 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-09-12T17:07:55.790 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:07:55.790 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T17:07:55.790 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:07:55.790 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T17:07:55.790 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:07:55.790 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T17:07:55.790 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:07:55.790 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:07:55.791 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:07:55.791 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:07:55.791 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:07:55.791 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:07:55.791 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:07:55.791 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:55.785+0000 7fb309070a80 -1 shutting down 2024-09-12T17:07:55.791 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:07:55.789+0000 7fb1e2dc2640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 55449, si_uid : 1000, si_addr0x3e80000d899, si_status0 2024-09-12T17:08:25.814 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.SHUTDOWN (30026 ms) 2024-09-12T17:08:25.814 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] 24 tests from LibRGW (30790 ms total) 2024-09-12T17:08:25.814 INFO:tasks.workunit.client.0.smithi016.stdout: 2024-09-12T17:08:25.814 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] Global test environment tear-down 2024-09-12T17:08:25.814 INFO:tasks.workunit.client.0.smithi016.stdout:[==========] 24 tests from 1 test suite ran. (30790 ms total) 2024-09-12T17:08:25.814 INFO:tasks.workunit.client.0.smithi016.stdout:[ PASSED ] 24 tests. 2024-09-12T17:08:25.829 INFO:tasks.workunit.client.0.smithi016.stdout:phase 1.3 2024-09-12T17:08:25.853 INFO:tasks.workunit.client.0.smithi016.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T17:08:25.853 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] Global test environment set-up. 2024-09-12T17:08:25.854 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] 24 tests from LibRGW 2024-09-12T17:08:25.854 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:08:25.866 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:08:25.866 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:08:26.631 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.INIT (778 ms) 2024-09-12T17:08:26.632 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T17:08:26.633 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-12T17:08:26.633 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:08:26.633 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T17:08:26.633 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T17:08:26.638 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.SETUP_HIER1 (5 ms) 2024-09-12T17:08:26.638 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T17:08:26.765 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.SETUP_DIRS1 (127 ms) 2024-09-12T17:08:26.765 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T17:08:26.765 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T17:08:26.766 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T17:08:26.766 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T17:08:26.766 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T17:08:26.766 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T17:08:26.766 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T17:08:26.766 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T17:08:26.766 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T17:08:26.766 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T17:08:26.766 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T17:08:26.766 INFO:tasks.workunit.client.0.smithi016.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T17:08:26.766 INFO:tasks.workunit.client.0.smithi016.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:08:26.766 INFO:tasks.workunit.client.0.smithi016.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:08:26.766 INFO:tasks.workunit.client.0.smithi016.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:08:26.767 INFO:tasks.workunit.client.0.smithi016.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:08:26.767 INFO:tasks.workunit.client.0.smithi016.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T17:08:26.767 INFO:tasks.workunit.client.0.smithi016.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:08:26.767 INFO:tasks.workunit.client.0.smithi016.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:08:26.767 INFO:tasks.workunit.client.0.smithi016.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:08:26.767 INFO:tasks.workunit.client.0.smithi016.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:08:26.767 INFO:tasks.workunit.client.0.smithi016.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T17:08:26.767 INFO:tasks.workunit.client.0.smithi016.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:08:26.767 INFO:tasks.workunit.client.0.smithi016.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:08:26.767 INFO:tasks.workunit.client.0.smithi016.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:08:26.767 INFO:tasks.workunit.client.0.smithi016.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:08:26.767 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T17:08:26.767 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T17:08:26.767 INFO:tasks.workunit.client.0.smithi016.stdout:read back objects in /bdirs1/dir_0 2024-09-12T17:08:26.768 INFO:tasks.workunit.client.0.smithi016.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T17:08:26.768 INFO:tasks.workunit.client.0.smithi016.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:08:26.768 INFO:tasks.workunit.client.0.smithi016.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T17:08:26.770 INFO:tasks.workunit.client.0.smithi016.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:08:26.770 INFO:tasks.workunit.client.0.smithi016.stdout:read back objects in /bdirs1/dir_1 2024-09-12T17:08:26.770 INFO:tasks.workunit.client.0.smithi016.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T17:08:26.772 INFO:tasks.workunit.client.0.smithi016.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:08:26.772 INFO:tasks.workunit.client.0.smithi016.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T17:08:26.773 INFO:tasks.workunit.client.0.smithi016.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:08:26.773 INFO:tasks.workunit.client.0.smithi016.stdout:read back objects in /bdirs1/dir_2 2024-09-12T17:08:26.773 INFO:tasks.workunit.client.0.smithi016.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T17:08:26.775 INFO:tasks.workunit.client.0.smithi016.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:08:26.775 INFO:tasks.workunit.client.0.smithi016.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T17:08:26.777 INFO:tasks.workunit.client.0.smithi016.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:08:26.777 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.READ_DIRS1 (12 ms) 2024-09-12T17:08:26.778 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T17:08:26.778 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T17:08:26.778 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T17:08:26.778 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T17:08:26.778 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T17:08:26.778 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T17:08:26.779 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T17:08:26.779 INFO:tasks.workunit.client.0.smithi016.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:08:26.779 INFO:tasks.workunit.client.0.smithi016.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:08:26.779 INFO:tasks.workunit.client.0.smithi016.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:08:26.779 INFO:tasks.workunit.client.0.smithi016.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:08:26.779 INFO:tasks.workunit.client.0.smithi016.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:08:26.780 INFO:tasks.workunit.client.0.smithi016.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:08:26.780 INFO:tasks.workunit.client.0.smithi016.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:08:26.780 INFO:tasks.workunit.client.0.smithi016.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:08:26.780 INFO:tasks.workunit.client.0.smithi016.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:08:26.780 INFO:tasks.workunit.client.0.smithi016.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:08:26.781 INFO:tasks.workunit.client.0.smithi016.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:08:26.781 INFO:tasks.workunit.client.0.smithi016.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:08:26.781 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T17:08:26.781 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T17:08:26.788 INFO:tasks.workunit.client.0.smithi016.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T17:08:26.789 INFO:tasks.workunit.client.0.smithi016.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T17:08:26.794 INFO:tasks.workunit.client.0.smithi016.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T17:08:26.797 INFO:tasks.workunit.client.0.smithi016.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T17:08:26.802 INFO:tasks.workunit.client.0.smithi016.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T17:08:26.803 INFO:tasks.workunit.client.0.smithi016.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T17:08:26.804 INFO:tasks.workunit.client.0.smithi016.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T17:08:26.805 INFO:tasks.workunit.client.0.smithi016.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T17:08:26.806 INFO:tasks.workunit.client.0.smithi016.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T17:08:26.807 INFO:tasks.workunit.client.0.smithi016.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T17:08:26.808 INFO:tasks.workunit.client.0.smithi016.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T17:08:26.812 INFO:tasks.workunit.client.0.smithi016.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T17:08:26.812 INFO:tasks.workunit.client.0.smithi016.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T17:08:26.812 INFO:tasks.workunit.client.0.smithi016.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T17:08:26.812 INFO:tasks.workunit.client.0.smithi016.stdout:/nfsroot/foo (foo): DIR 2024-09-12T17:08:26.812 INFO:tasks.workunit.client.0.smithi016.stdout:/nfsroot (nfsroot): DIR 2024-09-12T17:08:26.812 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.HIER1 (34 ms) 2024-09-12T17:08:26.812 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:08:26.812 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (1 ms) 2024-09-12T17:08:26.812 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:08:26.812 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T17:08:26.812 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:08:26.812 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T17:08:26.813 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:08:26.813 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:08:26.813 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:08:26.813 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:08:26.813 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:08:26.813 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:08:26.813 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:08:26.813 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:08:26.808+0000 7f9e89d3ba80 -1 shutting down 2024-09-12T17:08:26.814 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:08:26.812+0000 7f9d63a8d640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 56094, si_uid : 1000, si_addr0x3e80000db1e, si_status0 2024-09-12T17:08:56.801 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.SHUTDOWN (29989 ms) 2024-09-12T17:08:56.801 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] 24 tests from LibRGW (30947 ms total) 2024-09-12T17:08:56.801 INFO:tasks.workunit.client.0.smithi016.stdout: 2024-09-12T17:08:56.801 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] Global test environment tear-down 2024-09-12T17:08:56.802 INFO:tasks.workunit.client.0.smithi016.stdout:[==========] 24 tests from 1 test suite ran. (30948 ms total) 2024-09-12T17:08:56.802 INFO:tasks.workunit.client.0.smithi016.stdout:[ PASSED ] 24 tests. 2024-09-12T17:08:56.815 INFO:tasks.workunit.client.0.smithi016.stdout:phase 2.1 2024-09-12T17:08:56.839 INFO:tasks.workunit.client.0.smithi016.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T17:08:56.839 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] Global test environment set-up. 2024-09-12T17:08:56.839 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] 9 tests from LibRGW 2024-09-12T17:08:56.839 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:08:56.850 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:08:56.851 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:08:57.617 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.INIT (779 ms) 2024-09-12T17:08:57.617 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:08:57.619 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:08:57.619 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:08:57.634 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.CREATE_BUCKET (15 ms) 2024-09-12T17:08:57.634 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:08:57.634 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T17:08:57.634 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T17:08:57.645 INFO:tasks.workunit.client.0.smithi016.stdout:created: sorrydave0 2024-09-12T17:08:57.661 INFO:tasks.workunit.client.0.smithi016.stdout:created: sorrydave1 2024-09-12T17:08:57.678 INFO:tasks.workunit.client.0.smithi016.stdout:created: sorrydave2 2024-09-12T17:08:57.692 INFO:tasks.workunit.client.0.smithi016.stdout:created: sorrydave3 2024-09-12T17:08:57.710 INFO:tasks.workunit.client.0.smithi016.stdout:created: sorrydave4 2024-09-12T17:08:57.729 INFO:tasks.workunit.client.0.smithi016.stdout:created: sorrydave5 2024-09-12T17:08:57.748 INFO:tasks.workunit.client.0.smithi016.stdout:created: sorrydave6 2024-09-12T17:08:57.765 INFO:tasks.workunit.client.0.smithi016.stdout:created: sorrydave7 2024-09-12T17:08:57.782 INFO:tasks.workunit.client.0.smithi016.stdout:created: sorrydave8 2024-09-12T17:08:57.799 INFO:tasks.workunit.client.0.smithi016.stdout:created: sorrydave9 2024-09-12T17:08:57.799 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (165 ms) 2024-09-12T17:08:57.799 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T17:08:58.211 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (412 ms) 2024-09-12T17:08:58.211 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:08:58.211 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:08:58.211 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:08:58.211 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:08:58.212 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:08:58.212 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:08:58.208+0000 7f747c097a80 -1 shutting down 2024-09-12T17:08:58.214 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:08:58.212+0000 7f7355de9640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 56739, si_uid : 1000, si_addr0x3e80000dda3, si_status0 2024-09-12T17:09:27.695 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.SHUTDOWN (29483 ms) 2024-09-12T17:09:27.695 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] 9 tests from LibRGW (30855 ms total) 2024-09-12T17:09:27.695 INFO:tasks.workunit.client.0.smithi016.stdout: 2024-09-12T17:09:27.695 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] Global test environment tear-down 2024-09-12T17:09:27.695 INFO:tasks.workunit.client.0.smithi016.stdout:[==========] 9 tests from 1 test suite ran. (30855 ms total) 2024-09-12T17:09:27.695 INFO:tasks.workunit.client.0.smithi016.stdout:[ PASSED ] 9 tests. 2024-09-12T17:09:27.708 INFO:tasks.workunit.client.0.smithi016.stdout:phase 2.2 2024-09-12T17:09:27.732 INFO:tasks.workunit.client.0.smithi016.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T17:09:27.732 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] Global test environment set-up. 2024-09-12T17:09:27.733 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] 9 tests from LibRGW 2024-09-12T17:09:27.733 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:09:27.744 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:09:27.744 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:09:28.512 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.INIT (780 ms) 2024-09-12T17:09:28.512 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:09:28.513 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:09:28.513 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:09:28.513 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T17:09:28.514 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:09:28.548 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.DELETE_BUCKET (35 ms) 2024-09-12T17:09:28.548 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T17:09:28.564 INFO:tasks.workunit.client.0.smithi016.stdout:created: sorrydave0 2024-09-12T17:09:28.581 INFO:tasks.workunit.client.0.smithi016.stdout:created: sorrydave1 2024-09-12T17:09:28.595 INFO:tasks.workunit.client.0.smithi016.stdout:created: sorrydave2 2024-09-12T17:09:28.610 INFO:tasks.workunit.client.0.smithi016.stdout:created: sorrydave3 2024-09-12T17:09:28.626 INFO:tasks.workunit.client.0.smithi016.stdout:created: sorrydave4 2024-09-12T17:09:28.641 INFO:tasks.workunit.client.0.smithi016.stdout:created: sorrydave5 2024-09-12T17:09:28.658 INFO:tasks.workunit.client.0.smithi016.stdout:created: sorrydave6 2024-09-12T17:09:28.674 INFO:tasks.workunit.client.0.smithi016.stdout:created: sorrydave7 2024-09-12T17:09:28.689 INFO:tasks.workunit.client.0.smithi016.stdout:created: sorrydave8 2024-09-12T17:09:28.706 INFO:tasks.workunit.client.0.smithi016.stdout:created: sorrydave9 2024-09-12T17:09:28.706 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (158 ms) 2024-09-12T17:09:28.706 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T17:09:29.091 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (385 ms) 2024-09-12T17:09:29.092 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:09:29.092 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:09:29.092 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:09:29.092 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:09:29.092 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:09:29.092 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:09:29.088+0000 7fdba94b0a80 -1 shutting down 2024-09-12T17:09:29.094 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:09:29.092+0000 7fda83202640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 57384, si_uid : 1000, si_addr0x3e80000e028, si_status0 2024-09-12T17:09:58.826 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.SHUTDOWN (29734 ms) 2024-09-12T17:09:58.826 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] 9 tests from LibRGW (31093 ms total) 2024-09-12T17:09:58.826 INFO:tasks.workunit.client.0.smithi016.stdout: 2024-09-12T17:09:58.826 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] Global test environment tear-down 2024-09-12T17:09:58.826 INFO:tasks.workunit.client.0.smithi016.stdout:[==========] 9 tests from 1 test suite ran. (31093 ms total) 2024-09-12T17:09:58.827 INFO:tasks.workunit.client.0.smithi016.stdout:[ PASSED ] 9 tests. 2024-09-12T17:09:58.839 INFO:tasks.workunit.client.0.smithi016.stdout:phase 3.1 2024-09-12T17:09:59.183 INFO:tasks.workunit.client.0.smithi016.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T17:09:59.183 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] Global test environment set-up. 2024-09-12T17:09:59.183 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] 13 tests from LibRGW 2024-09-12T17:09:59.183 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:09:59.193 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:09:59.193 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:09:59.968 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.INIT (785 ms) 2024-09-12T17:09:59.968 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:09:59.969 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:09:59.969 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:09:59.984 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.CREATE_BUCKET (15 ms) 2024-09-12T17:09:59.984 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T17:09:59.990 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2024-09-12T17:09:59.990 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T17:09:59.992 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-09-12T17:09:59.992 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T17:10:00.065 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.LARGE1 (72 ms) 2024-09-12T17:10:00.065 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T17:10:00.145 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.LARGE2 (81 ms) 2024-09-12T17:10:00.146 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T17:10:00.146 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T17:10:00.146 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T17:10:00.146 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T17:10:00.146 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:10:00.146 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T17:10:00.146 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:10:00.146 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:10:00.146 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:10:00.146 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:10:00.146 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:10:00.147 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:10:00.143+0000 7f8a230d0a80 -1 shutting down 2024-09-12T17:10:00.149 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:10:00.147+0000 7f88fce22640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 58029, si_uid : 1000, si_addr0x3e80000e2ad, si_status0 2024-09-12T17:10:30.010 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.SHUTDOWN (29864 ms) 2024-09-12T17:10:30.011 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] 13 tests from LibRGW (30826 ms total) 2024-09-12T17:10:30.011 INFO:tasks.workunit.client.0.smithi016.stdout: 2024-09-12T17:10:30.011 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] Global test environment tear-down 2024-09-12T17:10:30.011 INFO:tasks.workunit.client.0.smithi016.stdout:[==========] 13 tests from 1 test suite ran. (30826 ms total) 2024-09-12T17:10:30.011 INFO:tasks.workunit.client.0.smithi016.stdout:[ PASSED ] 13 tests. 2024-09-12T17:10:30.022 INFO:tasks.workunit.client.0.smithi016.stdout:phase 3.2 2024-09-12T17:10:30.365 INFO:tasks.workunit.client.0.smithi016.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T17:10:30.365 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] Global test environment set-up. 2024-09-12T17:10:30.365 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] 13 tests from LibRGW 2024-09-12T17:10:30.365 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:10:30.373 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:10:30.373 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:10:30.930 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.INIT (566 ms) 2024-09-12T17:10:30.930 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:10:30.931 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T17:10:30.931 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:10:30.932 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T17:10:30.932 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T17:10:30.940 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (8 ms) 2024-09-12T17:10:30.940 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T17:10:30.946 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (6 ms) 2024-09-12T17:10:30.946 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T17:10:31.477 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.LARGE1 (531 ms) 2024-09-12T17:10:31.477 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T17:10:31.477 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-09-12T17:10:31.477 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T17:10:31.478 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T17:10:31.478 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T17:10:31.487 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.DELETE_OBJECT (10 ms) 2024-09-12T17:10:31.487 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:10:31.524 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.DELETE_BUCKET (37 ms) 2024-09-12T17:10:31.524 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:10:31.524 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:10:31.525 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:10:31.525 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:10:31.525 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:10:31.525 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:10:31.519+0000 7f496a978a80 -1 shutting down 2024-09-12T17:10:31.527 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:10:31.523+0000 7f48446ca640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 58675, si_uid : 1000, si_addr0x3e80000e533, si_status0 2024-09-12T17:11:01.202 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.SHUTDOWN (29677 ms) 2024-09-12T17:11:01.202 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] 13 tests from LibRGW (30837 ms total) 2024-09-12T17:11:01.202 INFO:tasks.workunit.client.0.smithi016.stdout: 2024-09-12T17:11:01.202 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] Global test environment tear-down 2024-09-12T17:11:01.202 INFO:tasks.workunit.client.0.smithi016.stdout:[==========] 13 tests from 1 test suite ran. (30837 ms total) 2024-09-12T17:11:01.203 INFO:tasks.workunit.client.0.smithi016.stdout:[ PASSED ] 13 tests. 2024-09-12T17:11:01.216 INFO:tasks.workunit.client.0.smithi016.stdout:phase 4.1 2024-09-12T17:11:01.239 INFO:tasks.workunit.client.0.smithi016.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T17:11:01.239 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] Global test environment set-up. 2024-09-12T17:11:01.239 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] 11 tests from LibRGW 2024-09-12T17:11:01.239 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T17:11:01.239 INFO:tasks.workunit.client.0.smithi016.stdout:read i1: 64001 2024-09-12T17:11:01.240 INFO:tasks.workunit.client.0.smithi016.stdout:read s1: blunderbuss 2024-09-12T17:11:01.240 INFO:tasks.workunit.client.0.smithi016.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T17:11:01.240 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:11:01.253 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:01.253 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:02.018 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.INIT (779 ms) 2024-09-12T17:11:02.019 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:11:02.020 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T17:11:02.020 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:11:02.048 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (28 ms) 2024-09-12T17:11:02.048 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:11:03.513 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_0 2024-09-12T17:11:03.513 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_1 2024-09-12T17:11:03.513 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_2 2024-09-12T17:11:03.513 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_3 2024-09-12T17:11:03.513 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_4 2024-09-12T17:11:03.513 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_5 2024-09-12T17:11:03.513 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_6 2024-09-12T17:11:03.513 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_7 2024-09-12T17:11:03.514 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_8 2024-09-12T17:11:03.514 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_9 2024-09-12T17:11:03.514 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_10 2024-09-12T17:11:03.514 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_11 2024-09-12T17:11:03.514 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_12 2024-09-12T17:11:03.514 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_13 2024-09-12T17:11:03.514 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_14 2024-09-12T17:11:03.514 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_15 2024-09-12T17:11:03.514 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_16 2024-09-12T17:11:03.514 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_17 2024-09-12T17:11:03.514 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_18 2024-09-12T17:11:03.514 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_19 2024-09-12T17:11:03.514 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_20 2024-09-12T17:11:03.514 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_21 2024-09-12T17:11:03.515 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_22 2024-09-12T17:11:03.515 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_23 2024-09-12T17:11:03.515 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_24 2024-09-12T17:11:03.515 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_25 2024-09-12T17:11:03.515 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_26 2024-09-12T17:11:03.515 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_27 2024-09-12T17:11:03.515 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_28 2024-09-12T17:11:03.515 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_29 2024-09-12T17:11:03.515 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_30 2024-09-12T17:11:03.515 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_31 2024-09-12T17:11:03.515 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_32 2024-09-12T17:11:03.515 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_33 2024-09-12T17:11:03.515 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_34 2024-09-12T17:11:03.515 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_35 2024-09-12T17:11:03.516 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_36 2024-09-12T17:11:03.516 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_37 2024-09-12T17:11:03.516 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_38 2024-09-12T17:11:03.516 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_39 2024-09-12T17:11:03.516 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_40 2024-09-12T17:11:03.516 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_41 2024-09-12T17:11:03.516 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_42 2024-09-12T17:11:03.516 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_43 2024-09-12T17:11:03.516 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_44 2024-09-12T17:11:03.516 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_45 2024-09-12T17:11:03.516 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_46 2024-09-12T17:11:03.516 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_47 2024-09-12T17:11:03.516 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_48 2024-09-12T17:11:03.517 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_49 2024-09-12T17:11:03.517 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_50 2024-09-12T17:11:03.517 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_51 2024-09-12T17:11:03.517 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_52 2024-09-12T17:11:03.517 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_53 2024-09-12T17:11:03.517 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_54 2024-09-12T17:11:03.517 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_55 2024-09-12T17:11:03.517 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_56 2024-09-12T17:11:03.517 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_57 2024-09-12T17:11:03.517 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_58 2024-09-12T17:11:03.517 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_59 2024-09-12T17:11:03.517 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_60 2024-09-12T17:11:03.517 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_61 2024-09-12T17:11:03.517 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_62 2024-09-12T17:11:03.517 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_63 2024-09-12T17:11:03.518 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_64 2024-09-12T17:11:03.518 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_65 2024-09-12T17:11:03.518 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_66 2024-09-12T17:11:03.518 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_67 2024-09-12T17:11:03.518 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_68 2024-09-12T17:11:03.518 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_69 2024-09-12T17:11:03.518 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_70 2024-09-12T17:11:03.518 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_71 2024-09-12T17:11:03.518 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_72 2024-09-12T17:11:03.518 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_73 2024-09-12T17:11:03.518 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_74 2024-09-12T17:11:03.518 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_75 2024-09-12T17:11:03.518 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_76 2024-09-12T17:11:03.519 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_77 2024-09-12T17:11:03.519 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_78 2024-09-12T17:11:03.519 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_79 2024-09-12T17:11:03.519 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_80 2024-09-12T17:11:03.519 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_81 2024-09-12T17:11:03.519 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_82 2024-09-12T17:11:03.519 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_83 2024-09-12T17:11:03.519 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_84 2024-09-12T17:11:03.519 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_85 2024-09-12T17:11:03.519 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_86 2024-09-12T17:11:03.519 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_87 2024-09-12T17:11:03.519 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_88 2024-09-12T17:11:03.519 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_89 2024-09-12T17:11:03.519 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_90 2024-09-12T17:11:03.520 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_91 2024-09-12T17:11:03.520 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_92 2024-09-12T17:11:03.520 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_93 2024-09-12T17:11:03.520 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_94 2024-09-12T17:11:03.520 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_95 2024-09-12T17:11:03.520 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_96 2024-09-12T17:11:03.520 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_97 2024-09-12T17:11:03.520 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_98 2024-09-12T17:11:03.520 INFO:tasks.workunit.client.0.smithi016.stdout:created: dmarker:f_99 2024-09-12T17:11:03.520 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (1464 ms) 2024-09-12T17:11:03.520 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:11:03.521 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-09-12T17:11:03.521 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-09-12T17:11:03.521 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T17:11:03.521 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T17:11:03.521 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T17:11:03.521 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T17:11:03.522 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T17:11:03.522 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T17:11:03.522 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T17:11:03.522 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T17:11:03.522 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T17:11:03.522 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T17:11:03.522 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T17:11:03.522 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T17:11:03.522 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T17:11:03.522 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T17:11:03.522 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T17:11:03.522 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T17:11:03.522 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T17:11:03.523 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T17:11:03.523 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T17:11:03.523 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T17:11:03.523 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T17:11:03.523 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T17:11:03.523 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T17:11:03.523 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T17:11:03.523 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T17:11:03.523 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T17:11:03.523 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T17:11:03.523 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T17:11:03.523 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T17:11:03.523 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T17:11:03.523 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T17:11:03.524 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T17:11:03.524 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T17:11:03.524 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T17:11:03.524 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T17:11:03.524 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T17:11:03.524 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T17:11:03.524 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T17:11:03.524 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T17:11:03.524 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T17:11:03.524 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T17:11:03.524 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T17:11:03.524 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T17:11:03.525 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T17:11:03.525 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T17:11:03.525 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T17:11:03.525 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T17:11:03.525 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T17:11:03.525 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T17:11:03.525 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T17:11:03.525 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T17:11:03.525 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T17:11:03.525 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T17:11:03.525 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T17:11:03.525 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T17:11:03.525 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T17:11:03.525 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T17:11:03.526 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T17:11:03.526 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T17:11:03.526 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T17:11:03.526 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T17:11:03.526 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T17:11:03.526 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T17:11:03.526 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T17:11:03.526 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T17:11:03.526 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T17:11:03.526 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T17:11:03.526 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T17:11:03.526 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T17:11:03.527 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T17:11:03.527 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T17:11:03.527 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T17:11:03.527 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T17:11:03.527 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T17:11:03.527 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T17:11:03.527 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T17:11:03.527 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T17:11:03.527 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T17:11:03.527 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T17:11:03.527 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T17:11:03.527 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T17:11:03.527 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T17:11:03.528 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T17:11:03.528 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T17:11:03.528 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T17:11:03.528 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T17:11:03.528 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T17:11:03.528 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T17:11:03.528 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T17:11:03.528 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T17:11:03.528 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T17:11:03.528 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T17:11:03.528 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T17:11:03.528 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T17:11:03.528 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T17:11:03.528 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T17:11:03.529 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T17:11:03.529 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T17:11:03.529 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T17:11:03.529 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T17:11:03.529 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.MARKER1_READDIR (9 ms) 2024-09-12T17:11:03.529 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T17:11:03.530 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T17:11:03.530 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T17:11:03.530 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T17:11:03.530 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T17:11:03.530 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T17:11:03.530 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T17:11:03.530 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T17:11:03.530 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T17:11:03.531 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T17:11:03.531 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T17:11:03.531 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T17:11:03.531 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T17:11:03.531 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T17:11:03.531 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T17:11:03.531 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T17:11:03.531 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T17:11:03.531 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T17:11:03.531 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T17:11:03.532 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T17:11:03.532 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T17:11:03.532 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T17:11:03.532 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T17:11:03.532 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T17:11:03.532 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T17:11:03.532 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T17:11:03.532 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T17:11:03.532 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T17:11:03.532 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T17:11:03.532 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T17:11:03.532 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T17:11:03.532 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T17:11:03.533 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T17:11:03.533 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T17:11:03.533 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T17:11:03.533 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T17:11:03.533 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T17:11:03.533 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T17:11:03.533 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T17:11:03.533 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T17:11:03.533 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T17:11:03.533 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T17:11:03.533 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T17:11:03.533 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T17:11:03.534 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T17:11:03.534 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T17:11:03.534 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T17:11:03.534 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T17:11:03.534 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T17:11:03.534 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T17:11:03.534 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T17:11:03.534 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T17:11:03.534 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T17:11:03.534 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T17:11:03.534 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T17:11:03.534 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T17:11:03.534 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T17:11:03.535 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T17:11:03.535 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T17:11:03.535 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T17:11:03.535 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T17:11:03.535 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T17:11:03.535 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T17:11:03.535 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T17:11:03.535 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T17:11:03.535 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T17:11:03.535 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T17:11:03.535 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T17:11:03.535 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T17:11:03.535 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T17:11:03.536 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T17:11:03.536 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T17:11:03.536 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T17:11:03.536 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T17:11:03.536 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T17:11:03.536 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T17:11:03.536 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T17:11:03.536 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T17:11:03.536 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T17:11:03.536 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T17:11:03.536 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T17:11:03.536 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T17:11:03.536 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T17:11:03.536 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T17:11:03.537 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T17:11:03.537 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T17:11:03.537 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T17:11:03.537 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T17:11:03.537 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T17:11:03.537 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T17:11:03.537 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T17:11:03.537 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T17:11:03.537 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T17:11:03.537 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T17:11:03.537 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T17:11:03.537 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T17:11:03.537 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T17:11:03.538 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T17:11:03.538 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T17:11:03.538 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T17:11:03.538 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T17:11:03.538 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.MARKER2_READDIR (6 ms) 2024-09-12T17:11:03.538 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:11:03.538 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:11:03.538 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:11:03.538 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:11:03.538 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:11:03.538 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.UMOUNT (1 ms) 2024-09-12T17:11:03.538 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:11:03.539 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:11:03.523+0000 7ff27739da80 -1 shutting down 2024-09-12T17:11:03.539 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:11:03.527+0000 7ff1510ef640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 59320, si_uid : 1000, si_addr0x3e80000e7b8, si_status0 2024-09-12T17:11:32.221 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.SHUTDOWN (28693 ms) 2024-09-12T17:11:32.221 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] 11 tests from LibRGW (30982 ms total) 2024-09-12T17:11:32.221 INFO:tasks.workunit.client.0.smithi016.stdout: 2024-09-12T17:11:32.222 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] Global test environment tear-down 2024-09-12T17:11:32.222 INFO:tasks.workunit.client.0.smithi016.stdout:[==========] 11 tests from 1 test suite ran. (30982 ms total) 2024-09-12T17:11:32.222 INFO:tasks.workunit.client.0.smithi016.stdout:[ PASSED ] 11 tests. 2024-09-12T17:11:32.236 INFO:tasks.workunit.client.0.smithi016.stdout:phase 4.2 2024-09-12T17:11:32.259 INFO:tasks.workunit.client.0.smithi016.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T17:11:32.259 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] Global test environment set-up. 2024-09-12T17:11:32.259 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] 11 tests from LibRGW 2024-09-12T17:11:32.259 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T17:11:32.259 INFO:tasks.workunit.client.0.smithi016.stdout:read i1: 64001 2024-09-12T17:11:32.259 INFO:tasks.workunit.client.0.smithi016.stdout:read s1: blunderbuss 2024-09-12T17:11:32.259 INFO:tasks.workunit.client.0.smithi016.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T17:11:32.260 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:11:32.269 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:32.269 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:33.019 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.INIT (761 ms) 2024-09-12T17:11:33.020 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:11:33.021 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:11:33.021 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:11:33.038 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (16 ms) 2024-09-12T17:11:33.038 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:11:33.039 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T17:11:33.039 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:11:33.039 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T17:11:33.039 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T17:11:33.044 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T17:11:33.044 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T17:11:33.044 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T17:11:33.044 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T17:11:33.044 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T17:11:33.044 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T17:11:33.044 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T17:11:33.044 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T17:11:33.044 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T17:11:33.044 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T17:11:33.045 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T17:11:33.045 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T17:11:33.045 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T17:11:33.045 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T17:11:33.045 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T17:11:33.045 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T17:11:33.045 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T17:11:33.045 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T17:11:33.045 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T17:11:33.045 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T17:11:33.045 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T17:11:33.045 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T17:11:33.046 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T17:11:33.046 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T17:11:33.046 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T17:11:33.046 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T17:11:33.046 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T17:11:33.046 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T17:11:33.046 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T17:11:33.046 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T17:11:33.046 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T17:11:33.046 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T17:11:33.046 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T17:11:33.046 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T17:11:33.046 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T17:11:33.047 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T17:11:33.047 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T17:11:33.047 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T17:11:33.047 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T17:11:33.047 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T17:11:33.047 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T17:11:33.047 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T17:11:33.047 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T17:11:33.047 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T17:11:33.047 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T17:11:33.047 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T17:11:33.047 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T17:11:33.047 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T17:11:33.048 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T17:11:33.048 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T17:11:33.048 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T17:11:33.048 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T17:11:33.048 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T17:11:33.048 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T17:11:33.048 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T17:11:33.048 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T17:11:33.048 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T17:11:33.048 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T17:11:33.048 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T17:11:33.048 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T17:11:33.049 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T17:11:33.049 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T17:11:33.049 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T17:11:33.049 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T17:11:33.049 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T17:11:33.049 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T17:11:33.049 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T17:11:33.049 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T17:11:33.049 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T17:11:33.049 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T17:11:33.049 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T17:11:33.049 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T17:11:33.049 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T17:11:33.050 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T17:11:33.050 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T17:11:33.050 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T17:11:33.050 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T17:11:33.050 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T17:11:33.050 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T17:11:33.050 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T17:11:33.050 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T17:11:33.050 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T17:11:33.050 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T17:11:33.050 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T17:11:33.050 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T17:11:33.050 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T17:11:33.051 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T17:11:33.051 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T17:11:33.051 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T17:11:33.051 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T17:11:33.051 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T17:11:33.051 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T17:11:33.051 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T17:11:33.051 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T17:11:33.051 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T17:11:33.051 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T17:11:33.051 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T17:11:33.051 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T17:11:33.051 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T17:11:33.051 INFO:tasks.workunit.client.0.smithi016.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T17:11:33.052 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.MARKER2_READDIR (7 ms) 2024-09-12T17:11:33.052 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:11:33.052 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:11:33.052 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:11:33.052 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:11:33.052 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:11:33.052 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:11:33.052 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:11:33.052 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:11:33.042+0000 7f912152fa80 -1 shutting down 2024-09-12T17:11:33.053 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:11:33.046+0000 7f8ffb281640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 59965, si_uid : 1000, si_addr0x3e80000ea3d, si_status0 2024-09-12T17:12:03.197 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.SHUTDOWN (30152 ms) 2024-09-12T17:12:03.197 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] 11 tests from LibRGW (30937 ms total) 2024-09-12T17:12:03.198 INFO:tasks.workunit.client.0.smithi016.stdout: 2024-09-12T17:12:03.198 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] Global test environment tear-down 2024-09-12T17:12:03.198 INFO:tasks.workunit.client.0.smithi016.stdout:[==========] 11 tests from 1 test suite ran. (30937 ms total) 2024-09-12T17:12:03.198 INFO:tasks.workunit.client.0.smithi016.stdout:[ PASSED ] 11 tests. 2024-09-12T17:12:03.210 INFO:tasks.workunit.client.0.smithi016.stdout:phase 5.1 2024-09-12T17:12:03.245 INFO:tasks.workunit.client.0.smithi016.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T17:12:03.245 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] Global test environment set-up. 2024-09-12T17:12:03.245 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] 19 tests from LibRGW 2024-09-12T17:12:03.245 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:12:03.257 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:12:03.257 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:12:03.994 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.INIT (749 ms) 2024-09-12T17:12:03.994 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:12:03.995 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T17:12:03.996 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:12:04.011 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.CREATE_BUCKET (15 ms) 2024-09-12T17:12:04.011 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T17:12:04.017 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2024-09-12T17:12:04.017 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T17:12:04.017 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T17:12:04.017 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T17:12:04.020 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (3 ms) 2024-09-12T17:12:04.020 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T17:12:04.020 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T17:12:04.020 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T17:12:04.028 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.PUT_OBJECT (8 ms) 2024-09-12T17:12:04.028 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T17:12:04.032 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.GET_OBJECT (4 ms) 2024-09-12T17:12:04.032 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T17:12:04.032 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T17:12:04.032 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T17:12:04.032 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T17:12:04.032 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T17:12:04.032 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T17:12:04.032 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.READV 2024-09-12T17:12:04.033 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T17:12:04.033 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T17:12:04.033 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T17:12:04.033 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T17:12:04.033 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T17:12:04.033 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:12:04.033 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T17:12:04.033 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:12:04.033 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:12:04.033 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:12:04.033 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:12:04.033 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:12:04.034 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:12:04.030+0000 7f7121811a80 -1 shutting down 2024-09-12T17:12:04.034 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:12:04.034+0000 7f6ffb563640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 60611, si_uid : 1000, si_addr0x3e80000ecc3, si_status0 2024-09-12T17:12:34.038 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.SHUTDOWN (30006 ms) 2024-09-12T17:12:34.039 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] 19 tests from LibRGW (30793 ms total) 2024-09-12T17:12:34.039 INFO:tasks.workunit.client.0.smithi016.stdout: 2024-09-12T17:12:34.039 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] Global test environment tear-down 2024-09-12T17:12:34.039 INFO:tasks.workunit.client.0.smithi016.stdout:[==========] 19 tests from 1 test suite ran. (30793 ms total) 2024-09-12T17:12:34.039 INFO:tasks.workunit.client.0.smithi016.stdout:[ PASSED ] 19 tests. 2024-09-12T17:12:34.048 INFO:tasks.workunit.client.0.smithi016.stdout:phase 5.2 2024-09-12T17:12:34.081 INFO:tasks.workunit.client.0.smithi016.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T17:12:34.081 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] Global test environment set-up. 2024-09-12T17:12:34.081 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] 19 tests from LibRGW 2024-09-12T17:12:34.082 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:12:34.090 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:12:34.090 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:12:34.661 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.INIT (580 ms) 2024-09-12T17:12:34.661 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:12:34.663 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T17:12:34.663 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:12:34.663 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T17:12:34.663 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T17:12:34.673 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (10 ms) 2024-09-12T17:12:34.673 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T17:12:34.673 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T17:12:34.674 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T17:12:34.674 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-09-12T17:12:34.674 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T17:12:34.674 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T17:12:34.674 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T17:12:34.674 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-09-12T17:12:34.674 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T17:12:34.674 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-09-12T17:12:34.674 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T17:12:34.674 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T17:12:34.674 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T17:12:34.675 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T17:12:34.675 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T17:12:34.675 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T17:12:34.675 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.READV 2024-09-12T17:12:34.675 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T17:12:34.675 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T17:12:34.675 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T17:12:34.675 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T17:12:34.683 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.DELETE_OBJECT (10 ms) 2024-09-12T17:12:34.683 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:12:34.713 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.DELETE_BUCKET (30 ms) 2024-09-12T17:12:34.713 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:12:34.713 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:12:34.713 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:12:34.713 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:12:34.713 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:12:34.714 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:12:34.713+0000 7f38a4743a80 -1 shutting down 2024-09-12T17:12:34.716 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:12:34.713+0000 7f377e495640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 61256, si_uid : 1000, si_addr0x3e80000ef48, si_status0 2024-09-12T17:13:04.739 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.SHUTDOWN (30025 ms) 2024-09-12T17:13:04.739 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] 19 tests from LibRGW (30657 ms total) 2024-09-12T17:13:04.739 INFO:tasks.workunit.client.0.smithi016.stdout: 2024-09-12T17:13:04.739 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] Global test environment tear-down 2024-09-12T17:13:04.739 INFO:tasks.workunit.client.0.smithi016.stdout:[==========] 19 tests from 1 test suite ran. (30657 ms total) 2024-09-12T17:13:04.739 INFO:tasks.workunit.client.0.smithi016.stdout:[ PASSED ] 19 tests. 2024-09-12T17:13:04.748 INFO:tasks.workunit.client.0.smithi016.stdout:phase 6.1 2024-09-12T17:13:04.771 INFO:tasks.workunit.client.0.smithi016.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T17:13:04.771 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] Global test environment set-up. 2024-09-12T17:13:04.771 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] 10 tests from LibRGW 2024-09-12T17:13:04.771 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:13:04.780 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:04.780 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:05.537 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.INIT (767 ms) 2024-09-12T17:13:05.538 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:13:05.539 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:13:05.539 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-09-12T17:13:05.566 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.CREATE_BUCKETS (27 ms) 2024-09-12T17:13:05.566 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-09-12T17:13:05.577 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (11 ms) 2024-09-12T17:13:05.577 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-09-12T17:13:05.612 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.TOPDIR_RENAME (35 ms) 2024-09-12T17:13:05.612 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-09-12T17:13:05.661 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.SUBDIR_RENAME (49 ms) 2024-09-12T17:13:05.661 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-09-12T17:13:05.717 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (56 ms) 2024-09-12T17:13:05.717 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:13:05.717 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:13:05.717 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:13:05.717 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:13:05.717 INFO:tasks.workunit.client.0.smithi016.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:13:05.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:05.717+0000 7fe719caaa80 -1 shutting down 2024-09-12T17:13:05.720 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:05.717+0000 7fe5f39fc640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 61901, si_uid : 1000, si_addr0x3e80000f1cd, si_status0 2024-09-12T17:13:35.790 INFO:tasks.workunit.client.0.smithi016.stdout:[ OK ] LibRGW.SHUTDOWN (30072 ms) 2024-09-12T17:13:35.790 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] 10 tests from LibRGW (31019 ms total) 2024-09-12T17:13:35.790 INFO:tasks.workunit.client.0.smithi016.stdout: 2024-09-12T17:13:35.790 INFO:tasks.workunit.client.0.smithi016.stdout:[----------] Global test environment tear-down 2024-09-12T17:13:35.790 INFO:tasks.workunit.client.0.smithi016.stdout:[==========] 10 tests from 1 test suite ran. (31019 ms total) 2024-09-12T17:13:35.790 INFO:tasks.workunit.client.0.smithi016.stdout:[ PASSED ] 10 tests. 2024-09-12T17:13:35.805 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:13:35.806 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:13:35.822 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-09-12T17:13:35.824 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-09-12T17:13:35.824 DEBUG:teuthology.orchestra.run.smithi016:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-09-12T17:13:35.875 INFO:tasks.workunit.client.0.smithi016.stderr:+ [ -z ] 2024-09-12T17:13:35.875 INFO:tasks.workunit.client.0.smithi016.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T17:13:35.875 INFO:tasks.workunit.client.0.smithi016.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T17:13:35.875 INFO:tasks.workunit.client.0.smithi016.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name maven test user --email sigv4@example.com 2024-09-12T17:13:35.912 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:35.912 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:35.960 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:35.956+0000 7f09070dd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:35.961 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:35.960+0000 7f09070dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:35.961 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:35.960+0000 7f09070dd9c0 20 realm 2024-09-12T17:13:35.962 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:35.960+0000 7f09070dd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:35.962 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:35.960+0000 7f09070dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:35.962 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:35.960+0000 7f09070dd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:13:35.962 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:35.960+0000 7f09070dd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:35.962 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:35.960+0000 7f09070dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:35.963 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:35.960+0000 7f09070dd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:35.964 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:35.960+0000 7f09070dd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:35.964 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:35.960+0000 7f09070dd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:35.965 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:35.964+0000 7f09070dd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:13:35.966 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:35.964+0000 7f09070dd9c0 20 searching for the correct realm 2024-09-12T17:13:35.968 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:35.968+0000 7f09053e4640 0 -- 172.21.15.16:0/612241225 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f08f8032060 msgr2=0x7f08f8062630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:13:36.185 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.184+0000 7f09043e2640 0 -- 172.21.15.16:0/612241225 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f08fc0e7930 msgr2=0x7f08fc0f43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:13:36.404 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.400+0000 7f09070dd9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:13:36.404 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.400+0000 7f09070dd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:13:36.404 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.400+0000 7f09070dd9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:13:36.404 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.400+0000 7f09070dd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:13:36.404 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.400+0000 7f09070dd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:13:36.404 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.400+0000 7f09070dd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:13:36.405 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.400+0000 7f09070dd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:36.405 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.404+0000 7f09070dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:36.405 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.404+0000 7f09070dd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:36.405 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.404+0000 7f09070dd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:36.405 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.404+0000 7f09070dd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:36.406 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.404+0000 7f09070dd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:13:36.407 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.404+0000 7f09070dd9c0 20 zone default found 2024-09-12T17:13:36.407 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.404+0000 7f09070dd9c0 4 Realm: () 2024-09-12T17:13:36.407 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.404+0000 7f09070dd9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:13:36.407 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.404+0000 7f09070dd9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:13:36.407 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.404+0000 7f09070dd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:13:36.407 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.404+0000 7f09070dd9c0 20 zonegroup default 2024-09-12T17:13:36.407 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.404+0000 7f09070dd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:36.407 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.404+0000 7f09070dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:36.408 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.404+0000 7f09070dd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:36.408 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.408+0000 7f09070dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:36.408 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.408+0000 7f09070dd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:36.409 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.408+0000 7f09070dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:36.409 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.408+0000 7f09070dd9c0 20 started sync module instance, tier type = 2024-09-12T17:13:36.409 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.408+0000 7f09070dd9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:13:36.433 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.432+0000 7f09070dd9c0 20 add_watcher() i=0 2024-09-12T17:13:36.433 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.432+0000 7f09070dd9c0 20 add_watcher() i=1 2024-09-12T17:13:36.433 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.432+0000 7f09070dd9c0 20 add_watcher() i=2 2024-09-12T17:13:36.434 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.432+0000 7f09070dd9c0 20 add_watcher() i=3 2024-09-12T17:13:36.434 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.432+0000 7f09070dd9c0 20 add_watcher() i=4 2024-09-12T17:13:36.434 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.432+0000 7f09070dd9c0 20 add_watcher() i=5 2024-09-12T17:13:36.434 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.432+0000 7f09070dd9c0 20 add_watcher() i=6 2024-09-12T17:13:36.435 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.432+0000 7f09070dd9c0 20 add_watcher() i=7 2024-09-12T17:13:36.435 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.432+0000 7f09070dd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:13:36.439 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.436+0000 7f07bafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:36.440 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.440+0000 7f09070dd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:36.440 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.440+0000 7f09070dd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:36.440 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.440+0000 7f09070dd9c0 5 note: GC not initialized 2024-09-12T17:13:36.441 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.440+0000 7f07b9fe3640 20 reqs_thread_entry: start 2024-09-12T17:13:36.441 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.440+0000 7f09070dd9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:13:36.441 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.440+0000 7f09070dd9c0 20 Filter name: none 2024-09-12T17:13:36.441 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.440+0000 7f072b7fe640 20 reqs_thread_entry: start 2024-09-12T17:13:36.442 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.440+0000 7f09070dd9c0 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-09-12T17:13:36.442 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.440+0000 7f09070dd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:36.442 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.440+0000 7f09070dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:36.442 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.440+0000 7f09070dd9c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-09-12T17:13:36.442 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.440+0000 7f09070dd9c0 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T17:13:36.443 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.440+0000 7f09070dd9c0 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-09-12T17:13:36.443 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.440+0000 7f09070dd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:36.443 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.440+0000 7f09070dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:36.443 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.440+0000 7f09070dd9c0 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-09-12T17:13:36.443 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.440+0000 7f09070dd9c0 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T17:13:36.443 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.440+0000 7f09070dd9c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-09-12T17:13:36.443 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.440+0000 7f09070dd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:36.444 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.440+0000 7f09070dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:36.444 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.440+0000 7f09070dd9c0 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-09-12T17:13:36.444 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.440+0000 7f09070dd9c0 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T17:13:36.444 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.440+0000 7f09070dd9c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T17:13:36.444 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.440+0000 7f09070dd9c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T17:13:36.445 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.444+0000 7f09070dd9c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T17:13:36.445 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.444+0000 7f09070dd9c0 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T17:13:36.445 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.444+0000 7f09070dd9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-09-12T17:13:36.445 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.444+0000 7f07dbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791298 cookie 93969132917232 notifier 5540 bl.length()=677 2024-09-12T17:13:36.446 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.444+0000 7f07dbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T17:13:36.446 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.444+0000 7f07dbfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T17:13:36.449 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.448+0000 7f09070dd9c0 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T17:13:36.449 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.448+0000 7f09070dd9c0 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T17:13:36.449 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.448+0000 7f09070dd9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-09-12T17:13:36.451 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.448+0000 7f07db7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791307 cookie 93969132905232 notifier 5540 bl.length()=187 2024-09-12T17:13:36.451 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.448+0000 7f07db7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T17:13:36.451 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.448+0000 7f07db7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T17:13:36.454 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.452+0000 7f09070dd9c0 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T17:13:36.454 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.452+0000 7f09070dd9c0 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T17:13:36.455 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.452+0000 7f09070dd9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-09-12T17:13:36.455 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.452+0000 7f07dbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791308 cookie 93969132905232 notifier 5540 bl.length()=197 2024-09-12T17:13:36.455 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.452+0000 7f07dbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T17:13:36.455 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.452+0000 7f07dbfff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T17:13:36.456 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:13:36.457 INFO:tasks.workunit.client.0.smithi016.stdout: "user_id": "ceph-test-maven", 2024-09-12T17:13:36.457 INFO:tasks.workunit.client.0.smithi016.stdout: "display_name": "maven test user", 2024-09-12T17:13:36.457 INFO:tasks.workunit.client.0.smithi016.stdout: "email": "sigv4@example.com", 2024-09-12T17:13:36.457 INFO:tasks.workunit.client.0.smithi016.stdout: "suspended": 0, 2024-09-12T17:13:36.457 INFO:tasks.workunit.client.0.smithi016.stdout: "max_buckets": 1000, 2024-09-12T17:13:36.457 INFO:tasks.workunit.client.0.smithi016.stdout: "subusers": [], 2024-09-12T17:13:36.457 INFO:tasks.workunit.client.0.smithi016.stdout: "keys": [ 2024-09-12T17:13:36.457 INFO:tasks.workunit.client.0.smithi016.stdout: { 2024-09-12T17:13:36.457 INFO:tasks.workunit.client.0.smithi016.stdout: "user": "ceph-test-maven", 2024-09-12T17:13:36.457 INFO:tasks.workunit.client.0.smithi016.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-09-12T17:13:36.457 INFO:tasks.workunit.client.0.smithi016.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-09-12T17:13:36.457 INFO:tasks.workunit.client.0.smithi016.stdout: "active": true, 2024-09-12T17:13:36.457 INFO:tasks.workunit.client.0.smithi016.stdout: "create_date": "2024-09-12T17:13:36.445818Z" 2024-09-12T17:13:36.458 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:13:36.458 INFO:tasks.workunit.client.0.smithi016.stdout: ], 2024-09-12T17:13:36.458 INFO:tasks.workunit.client.0.smithi016.stdout: "swift_keys": [], 2024-09-12T17:13:36.458 INFO:tasks.workunit.client.0.smithi016.stdout: "caps": [], 2024-09-12T17:13:36.458 INFO:tasks.workunit.client.0.smithi016.stdout: "op_mask": "read, write, delete", 2024-09-12T17:13:36.458 INFO:tasks.workunit.client.0.smithi016.stdout: "default_placement": "", 2024-09-12T17:13:36.458 INFO:tasks.workunit.client.0.smithi016.stdout: "default_storage_class": "", 2024-09-12T17:13:36.458 INFO:tasks.workunit.client.0.smithi016.stdout: "placement_tags": [], 2024-09-12T17:13:36.458 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_quota": { 2024-09-12T17:13:36.458 INFO:tasks.workunit.client.0.smithi016.stdout: "enabled": false, 2024-09-12T17:13:36.458 INFO:tasks.workunit.client.0.smithi016.stdout: "check_on_raw": false, 2024-09-12T17:13:36.458 INFO:tasks.workunit.client.0.smithi016.stdout: "max_size": -1, 2024-09-12T17:13:36.458 INFO:tasks.workunit.client.0.smithi016.stdout: "max_size_kb": 0, 2024-09-12T17:13:36.458 INFO:tasks.workunit.client.0.smithi016.stdout: "max_objects": -1 2024-09-12T17:13:36.458 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:13:36.459 INFO:tasks.workunit.client.0.smithi016.stdout: "user_quota": { 2024-09-12T17:13:36.459 INFO:tasks.workunit.client.0.smithi016.stdout: "enabled": false, 2024-09-12T17:13:36.459 INFO:tasks.workunit.client.0.smithi016.stdout: "check_on_raw": false, 2024-09-12T17:13:36.459 INFO:tasks.workunit.client.0.smithi016.stdout: "max_size": -1, 2024-09-12T17:13:36.459 INFO:tasks.workunit.client.0.smithi016.stdout: "max_size_kb": 0, 2024-09-12T17:13:36.459 INFO:tasks.workunit.client.0.smithi016.stdout: "max_objects": -1 2024-09-12T17:13:36.459 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:13:36.459 INFO:tasks.workunit.client.0.smithi016.stdout: "temp_url_keys": [], 2024-09-12T17:13:36.459 INFO:tasks.workunit.client.0.smithi016.stdout: "type": "rgw", 2024-09-12T17:13:36.459 INFO:tasks.workunit.client.0.smithi016.stdout: "mfa_ids": [], 2024-09-12T17:13:36.459 INFO:tasks.workunit.client.0.smithi016.stdout: "account_id": "", 2024-09-12T17:13:36.459 INFO:tasks.workunit.client.0.smithi016.stdout: "path": "/", 2024-09-12T17:13:36.459 INFO:tasks.workunit.client.0.smithi016.stdout: "create_date": "2024-09-12T17:13:36.445791Z", 2024-09-12T17:13:36.459 INFO:tasks.workunit.client.0.smithi016.stdout: "tags": [], 2024-09-12T17:13:36.460 INFO:tasks.workunit.client.0.smithi016.stdout: "group_ids": [] 2024-09-12T17:13:36.460 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:13:36.460 INFO:tasks.workunit.client.0.smithi016.stdout: 2024-09-12T17:13:36.461 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.456+0000 7f07bafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:36.463 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.460+0000 7f09070dd9c0 20 remove_watcher() i=0 2024-09-12T17:13:36.463 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.460+0000 7f09070dd9c0 2 removed watcher, disabling cache 2024-09-12T17:13:36.465 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.464+0000 7f09070dd9c0 20 remove_watcher() i=1 2024-09-12T17:13:36.468 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.464+0000 7f09070dd9c0 20 remove_watcher() i=2 2024-09-12T17:13:36.470 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.468+0000 7f09070dd9c0 20 remove_watcher() i=3 2024-09-12T17:13:36.472 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.472+0000 7f09070dd9c0 20 remove_watcher() i=4 2024-09-12T17:13:36.474 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.472+0000 7f09070dd9c0 20 remove_watcher() i=5 2024-09-12T17:13:36.477 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.476+0000 7f09070dd9c0 20 remove_watcher() i=6 2024-09-12T17:13:36.479 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:13:36.476+0000 7f09070dd9c0 20 remove_watcher() i=7 2024-09-12T17:13:36.495 INFO:tasks.workunit.client.0.smithi016.stderr:+ [ -z ] 2024-09-12T17:13:36.495 INFO:tasks.workunit.client.0.smithi016.stderr:+ [ -z /home/ubuntu/cephtest ] 2024-09-12T17:13:36.495 INFO:tasks.workunit.client.0.smithi016.stderr:+ cat /home/ubuntu/cephtest/url_file 2024-09-12T17:13:36.495 INFO:tasks.workunit.client.0.smithi016.stderr:+ export RGW_HTTP_ENDPOINT_URL=http://smithi016.front.sepia.ceph.com:80 2024-09-12T17:13:36.495 INFO:tasks.workunit.client.0.smithi016.stderr:+ [ -z /home/ubuntu/cephtest/clone.client.0 ] 2024-09-12T17:13:36.495 INFO:tasks.workunit.client.0.smithi016.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-09-12T17:13:36.496 INFO:tasks.workunit.client.0.smithi016.stderr:+ ./mvnw clean package 2024-09-12T17:13:36.502 INFO:tasks.workunit.client.0.smithi016.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T17:13:40.728 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] Scanning for projects... 2024-09-12T17:13:40.880 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-09-12T17:13:40.970 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 60 kB/s) 2024-09-12T17:13:40.994 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-09-12T17:13:41.028 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 1.4/83 kB Progress (1): 2.8/83 kB Progress (1): 4.1/83 kB Progress (1): 5.5/83 kB Progress (1): 6.9/83 kB Progress (1): 8.3/83 kB Progress (1): 9.7/83 kB Progress (1): 11/83 kB Progress (1): 12/83 kB Progress (1): 14/83 kB Progress (1): 15/83 kB Progress (1): 16/83 kB Progress (1): 33/83 kB Progress (1): 49/83 kB Progress (1): 65/83 kB Progress (1): 81/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 2.4 MB/s) 2024-09-12T17:13:41.040 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-09-12T17:13:41.060 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 15/77 kB Progress (1): 31/77 kB Progress (1): 48/77 kB Progress (1): 64/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 3.8 MB/s) 2024-09-12T17:13:41.095 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] 2024-09-12T17:13:41.095 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T17:13:41.096 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] Building jcksum 1.0 2024-09-12T17:13:41.096 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] from pom.xml 2024-09-12T17:13:41.096 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T17:13:41.099 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-09-12T17:13:41.115 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 332 kB/s) 2024-09-12T17:13:41.124 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-09-12T17:13:41.139 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 619 kB/s) 2024-09-12T17:13:41.144 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-09-12T17:13:41.160 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.7 MB/s) 2024-09-12T17:13:41.171 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-09-12T17:13:41.187 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.2 MB/s) 2024-09-12T17:13:41.205 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-09-12T17:13:41.222 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/36 kB Progress (1): 32/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 2.1 MB/s) 2024-09-12T17:13:41.232 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-09-12T17:13:41.248 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 480 kB/s) 2024-09-12T17:13:41.252 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-09-12T17:13:41.268 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 539 kB/s) 2024-09-12T17:13:41.271 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-09-12T17:13:41.287 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/48 kB Progress (1): 32/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 2.8 MB/s) 2024-09-12T17:13:41.292 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-09-12T17:13:41.309 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.3 MB/s) 2024-09-12T17:13:41.316 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-09-12T17:13:41.333 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 1.9 MB/s) 2024-09-12T17:13:41.344 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-09-12T17:13:41.360 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 577 kB/s) 2024-09-12T17:13:41.372 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-09-12T17:13:41.395 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/66 kB Progress (1): 32/66 kB Progress (1): 49/66 kB Progress (1): 65/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 2.9 MB/s) 2024-09-12T17:13:41.408 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-09-12T17:13:41.425 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 296 kB/s) 2024-09-12T17:13:41.430 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-09-12T17:13:41.448 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.2 MB/s) 2024-09-12T17:13:41.455 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-09-12T17:13:41.473 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/50 kB Progress (1): 33/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 2.8 MB/s) 2024-09-12T17:13:41.481 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-09-12T17:13:41.498 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.3 MB/s) 2024-09-12T17:13:41.510 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-09-12T17:13:41.527 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 331 kB/s) 2024-09-12T17:13:41.537 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-09-12T17:13:41.554 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 1.4/45 kB Progress (1): 5.5/45 kB Progress (1): 9.6/45 kB Progress (1): 16/45 kB Progress (1): 25/45 kB Progress (1): 32/45 kB Progress (1): 36/45 kB Progress (1): 38/45 kB Progress (1): 43/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 2.2 MB/s) 2024-09-12T17:13:41.569 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-09-12T17:13:41.585 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 398 kB/s) 2024-09-12T17:13:41.590 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-09-12T17:13:41.606 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 582 kB/s) 2024-09-12T17:13:41.611 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-09-12T17:13:41.629 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/46 kB Progress (1): 33/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 2.5 MB/s) 2024-09-12T17:13:41.636 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-09-12T17:13:41.654 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.1 MB/s) 2024-09-12T17:13:41.664 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-09-12T17:13:41.681 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.6 MB/s) 2024-09-12T17:13:41.711 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-09-12T17:13:41.730 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 320 kB/s) 2024-09-12T17:13:41.735 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-09-12T17:13:41.753 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.1 MB/s) 2024-09-12T17:13:41.766 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-09-12T17:13:41.785 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.1 MB/s) 2024-09-12T17:13:41.804 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-09-12T17:13:41.822 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 222 kB/s) 2024-09-12T17:13:41.828 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-09-12T17:13:41.845 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 86 kB/s) 2024-09-12T17:13:41.850 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-09-12T17:13:41.867 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 124 kB/s) 2024-09-12T17:13:41.879 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-09-12T17:13:41.896 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 202 kB/s) 2024-09-12T17:13:41.904 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-09-12T17:13:41.921 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 190 kB/s) 2024-09-12T17:13:41.928 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-09-12T17:13:41.944 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 645 kB/s) 2024-09-12T17:13:41.952 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-09-12T17:13:41.968 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 105 kB/s) 2024-09-12T17:13:41.975 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-09-12T17:13:41.991 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 225 kB/s) 2024-09-12T17:13:41.999 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-09-12T17:13:42.016 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 289 kB/s) 2024-09-12T17:13:42.025 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-09-12T17:13:42.039 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 68 kB/s) 2024-09-12T17:13:42.045 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-09-12T17:13:42.060 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 226 kB/s) 2024-09-12T17:13:42.064 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-09-12T17:13:42.080 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 863 kB/s) 2024-09-12T17:13:42.086 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-09-12T17:13:42.103 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 2.7/3.7 kB Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 216 kB/s) 2024-09-12T17:13:42.113 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-09-12T17:13:42.130 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 144 kB/s) 2024-09-12T17:13:42.138 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-09-12T17:13:42.156 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 162 kB/s) 2024-09-12T17:13:42.166 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-09-12T17:13:42.185 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 390 kB/s) 2024-09-12T17:13:42.194 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-09-12T17:13:42.211 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 303 kB/s) 2024-09-12T17:13:42.221 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-09-12T17:13:42.239 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 194 kB/s) 2024-09-12T17:13:42.249 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-09-12T17:13:42.267 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 244 kB/s) 2024-09-12T17:13:42.271 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-09-12T17:13:42.289 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 142 kB/s) 2024-09-12T17:13:42.298 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-09-12T17:13:42.315 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 379 kB/s) 2024-09-12T17:13:42.325 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-09-12T17:13:42.343 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 337 kB/s) 2024-09-12T17:13:42.353 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-09-12T17:13:42.369 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 165 kB/s) 2024-09-12T17:13:42.379 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-09-12T17:13:42.396 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 204 kB/s) 2024-09-12T17:13:42.407 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-09-12T17:13:42.424 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 240 kB/s) 2024-09-12T17:13:42.428 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-09-12T17:13:42.445 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 105 kB/s) 2024-09-12T17:13:42.455 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-09-12T17:13:42.472 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 389 kB/s) 2024-09-12T17:13:42.477 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-09-12T17:13:42.494 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 910 kB/s) 2024-09-12T17:13:42.500 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-09-12T17:13:42.518 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 1.8 MB/s) 2024-09-12T17:13:42.525 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-09-12T17:13:42.542 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 1.1 MB/s) 2024-09-12T17:13:42.551 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-09-12T17:13:42.567 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 292 kB/s) 2024-09-12T17:13:42.572 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-09-12T17:13:42.589 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 775 kB/s) 2024-09-12T17:13:42.599 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-09-12T17:13:42.616 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 776 kB/s) 2024-09-12T17:13:42.622 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-09-12T17:13:42.642 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/68 kB Progress (1): 32/68 kB Progress (1): 49/68 kB Progress (1): 65/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 3.2 MB/s) 2024-09-12T17:13:42.674 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-09-12T17:13:42.691 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 783 kB/s) 2024-09-12T17:13:42.707 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-09-12T17:13:42.724 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 858 kB/s) 2024-09-12T17:13:42.729 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-09-12T17:13:42.749 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/79 kB Progress (1): 32/79 kB Progress (1): 49/79 kB Progress (1): 65/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 3.8 MB/s) 2024-09-12T17:13:42.766 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-09-12T17:13:42.785 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 921 kB/s) 2024-09-12T17:13:42.798 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-09-12T17:13:42.817 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 1.1 MB/s) 2024-09-12T17:13:42.824 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-09-12T17:13:42.846 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/78 kB Progress (1): 32/78 kB Progress (1): 49/78 kB Progress (1): 65/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 3.5 MB/s) 2024-09-12T17:13:42.865 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-09-12T17:13:42.882 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 226 kB/s) 2024-09-12T17:13:42.887 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-09-12T17:13:42.902 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 863 kB/s) 2024-09-12T17:13:42.909 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-09-12T17:13:42.925 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 189 kB/s) 2024-09-12T17:13:42.932 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-09-12T17:13:42.948 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 187 kB/s) 2024-09-12T17:13:42.951 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-09-12T17:13:42.966 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 136 kB/s) 2024-09-12T17:13:42.970 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-09-12T17:13:42.986 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 167 kB/s) 2024-09-12T17:13:42.990 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-09-12T17:13:43.006 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 95 kB/s) 2024-09-12T17:13:43.010 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-09-12T17:13:43.026 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 188 kB/s) 2024-09-12T17:13:43.029 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-09-12T17:13:43.045 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 200 kB/s) 2024-09-12T17:13:43.048 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-09-12T17:13:43.063 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 214 kB/s) 2024-09-12T17:13:43.067 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-09-12T17:13:43.082 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 64 kB/s) 2024-09-12T17:13:43.088 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-09-12T17:13:43.103 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 64 kB/s) 2024-09-12T17:13:43.108 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-09-12T17:13:43.123 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 203 kB/s) 2024-09-12T17:13:43.127 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-09-12T17:13:43.143 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 190 kB/s) 2024-09-12T17:13:43.147 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-09-12T17:13:43.164 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 215 kB/s) 2024-09-12T17:13:43.168 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-09-12T17:13:43.186 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 202 kB/s) 2024-09-12T17:13:43.190 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-09-12T17:13:43.206 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 202 kB/s) 2024-09-12T17:13:43.251 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-09-12T17:13:43.377 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 26 MB/s) 2024-09-12T17:13:43.380 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-09-12T17:13:43.380 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-09-12T17:13:43.380 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-09-12T17:13:43.381 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-09-12T17:13:43.381 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-09-12T17:13:43.423 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 15/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 367 kB/s) 2024-09-12T17:13:43.423 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-09-12T17:13:43.442 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 1.4/35 kB Progress (2): 1.4/35 kB | 1.4/49 kB Progress (2): 2.8/35 kB | 1.4/49 kB Progress (2): 2.8/35 kB | 2.8/49 kB Progress (2): 4.1/35 kB | 2.8/49 kB Progress (2): 4.1/35 kB | 4.1/49 kB Progress (2): 5.5/35 kB | 4.1/49 kB Progress (2): 5.5/35 kB | 5.5/49 kB Progress (2): 6.9/35 kB | 5.5/49 kB Progress (2): 6.9/35 kB | 6.9/49 kB Progress (2): 8.3/35 kB | 6.9/49 kB Progress (2): 8.3/35 kB | 8.3/49 kB Progress (2): 9.7/35 kB | 8.3/49 kB Progress (2): 9.7/35 kB | 9.7/49 kB Progress (2): 11/35 kB | 9.7/49 kB Progress (2): 11/35 kB | 11/49 kB Progress (2): 12/35 kB | 11/49 kB Progress (2): 12/35 kB | 12/49 kB Progress (2): 14/35 kB | 12/49 kB Progress (3): 14/35 kB | 12/49 kB | 16 kB Progress (3): 15/35 kB | 12/49 kB | 16 kB Progress (3): 15/35 kB | 14/49 kB | 16 kB Progress (3): 16/35 kB | 14/49 kB | 16 kB Progress (3): 16/35 kB | 15/49 kB | 16 kB Progress (3): 18/35 kB | 15/49 kB | 16 kB Progress (3): 18/35 kB | 16/49 kB | 16 kB Progress (3): 19/35 kB | 16/49 kB | 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 277 kB/s) 2024-09-12T17:13:43.443 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (2): 21/35 kB | 16/49 kB Progress (2): 21/35 kB | 18/49 kB Progress (2): 22/35 kB | 18/49 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-09-12T17:13:43.443 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (2): 22/35 kB | 19/49 kB Progress (2): 23/35 kB | 19/49 kB Progress (2): 23/35 kB | 21/49 kB Progress (2): 25/35 kB | 21/49 kB Progress (2): 25/35 kB | 22/49 kB Progress (2): 26/35 kB | 22/49 kB Progress (2): 26/35 kB | 23/49 kB Progress (2): 27/35 kB | 23/49 kB Progress (2): 27/35 kB | 25/49 kB Progress (2): 29/35 kB | 25/49 kB Progress (2): 29/35 kB | 26/49 kB Progress (2): 30/35 kB | 26/49 kB Progress (2): 30/35 kB | 27/49 kB Progress (2): 32/35 kB | 27/49 kB Progress (2): 32/35 kB | 29/49 kB Progress (2): 33/35 kB | 29/49 kB Progress (2): 33/35 kB | 30/49 kB Progress (2): 34/35 kB | 30/49 kB Progress (2): 34/35 kB | 32/49 kB Progress (2): 35 kB | 32/49 kB Progress (2): 35 kB | 33/49 kB Progress (2): 35 kB | 34/49 kB Progress (2): 35 kB | 36/49 kB Progress (2): 35 kB | 37/49 kB Progress (2): 35 kB | 38/49 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 558 kB/s) 2024-09-12T17:13:43.443 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-09-12T17:13:43.449 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 40/49 kB Progress (1): 41/49 kB Progress (1): 43/49 kB Progress (1): 44/49 kB Progress (1): 45/49 kB Progress (1): 47/49 kB Progress (1): 48/49 kB Progress (1): 49 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 714 kB/s) 2024-09-12T17:13:43.450 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-09-12T17:13:43.460 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/782 kB Progress (1): 33/782 kB Progress (1): 49/782 kB Progress (1): 65/782 kB Progress (1): 82/782 kB Progress (1): 98/782 kB Progress (1): 115/782 kB Progress (2): 115/782 kB | 1.4/11 kB Progress (2): 115/782 kB | 2.8/11 kB Progress (2): 115/782 kB | 4.1/11 kB Progress (2): 131/782 kB | 4.1/11 kB Progress (2): 131/782 kB | 5.5/11 kB Progress (2): 131/782 kB | 6.9/11 kB Progress (2): 131/782 kB | 8.3/11 kB Progress (2): 131/782 kB | 9.7/11 kB Progress (2): 147/782 kB | 9.7/11 kB Progress (2): 147/782 kB | 11/11 kB Progress (2): 147/782 kB | 11 kB Progress (2): 164/782 kB | 11 kB Progress (2): 180/782 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 150 kB/s) 2024-09-12T17:13:43.461 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-09-12T17:13:43.471 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 197/782 kB Progress (1): 213/782 kB Progress (1): 229/782 kB Progress (1): 246/782 kB Progress (1): 262/782 kB Progress (1): 278/782 kB Progress (1): 295/782 kB Progress (1): 311/782 kB Progress (1): 328/782 kB Progress (1): 344/782 kB Progress (1): 360/782 kB Progress (1): 377/782 kB Progress (1): 393/782 kB Progress (1): 410/782 kB Progress (1): 426/782 kB Progress (1): 442/782 kB Progress (1): 459/782 kB Progress (1): 475/782 kB Progress (1): 491/782 kB Progress (1): 508/782 kB Progress (1): 524/782 kB Progress (1): 541/782 kB Progress (2): 541/782 kB | 1.4/71 kB Progress (2): 557/782 kB | 1.4/71 kB Progress (2): 557/782 kB | 2.8/71 kB Progress (2): 557/782 kB | 4.1/71 kB Progress (3): 557/782 kB | 4.1/71 kB | 1.4/98 kB Progress (3): 573/782 kB | 4.1/71 kB | 1.4/98 kB Progress (3): 573/782 kB | 5.5/71 kB | 1.4/98 kB Progress (3): 573/782 kB | 5.5/71 kB | 2.8/98 kB Progress (3): 573/782 kB | 6.9/71 kB | 2.8/98 kB Progress (3): 573/782 kB | 6.9/71 kB | 4.1/98 kB Progress (3): 573/782 kB | 8.3/71 kB | 4.1/98 kB Progress (3): 590/782 kB | 8.3/71 kB | 4.1/98 kB Progress (3): 590/782 kB | 8.3/71 kB | 5.5/98 kB Progress (3): 590/782 kB | 9.7/71 kB | 5.5/98 kB Progress (3): 590/782 kB | 9.7/71 kB | 6.9/98 kB Progress (3): 590/782 kB | 11/71 kB | 6.9/98 kB Progress (4): 590/782 kB | 11/71 kB | 6.9/98 kB | 16/205 kB Progress (4): 606/782 kB | 11/71 kB | 6.9/98 kB | 16/205 kB Progress (4): 606/782 kB | 11/71 kB | 8.3/98 kB | 16/205 kB Progress (4): 606/782 kB | 12/71 kB | 8.3/98 kB | 16/205 kB Progress (4): 606/782 kB | 12/71 kB | 9.7/98 kB | 16/205 kB Progress (4): 606/782 kB | 14/71 kB | 9.7/98 kB | 16/205 kB Progress (4): 606/782 kB | 14/71 kB | 11/98 kB | 16/205 kB Progress (4): 606/782 kB | 15/71 kB | 11/98 kB | 16/205 kB Progress (4): 623/782 kB | 15/71 kB | 11/98 kB | 16/205 kB Progress (4): 623/782 kB | 16/71 kB | 11/98 kB | 16/205 kB Progress (4): 623/782 kB | 16/71 kB | 12/98 kB | 16/205 kB Progress (4): 623/782 kB | 16/71 kB | 14/98 kB | 16/205 kB Progress (4): 639/782 kB | 16/71 kB | 14/98 kB | 16/205 kB Progress (4): 639/782 kB | 16/71 kB | 14/98 kB | 33/205 kB Progress (4): 639/782 kB | 16/71 kB | 15/98 kB | 33/205 kB Progress (4): 639/782 kB | 16/71 kB | 17/98 kB | 33/205 kB Progress (4): 639/782 kB | 16/71 kB | 18/98 kB | 33/205 kB Progress (4): 655/782 kB | 16/71 kB | 18/98 kB | 33/205 kB Progress (4): 655/782 kB | 16/71 kB | 19/98 kB | 33/205 kB Progress (4): 655/782 kB | 16/71 kB | 21/98 kB | 33/205 kB Progress (4): 655/782 kB | 16/71 kB | 21/98 kB | 49/205 kB Progress (4): 655/782 kB | 16/71 kB | 22/98 kB | 49/205 kB Progress (4): 672/782 kB | 16/71 kB | 22/98 kB | 49/205 kB Progress (4): 672/782 kB | 16/71 kB | 23/98 kB | 49/205 kB Progress (4): 672/782 kB | 16/71 kB | 25/98 kB | 49/205 kB Progress (4): 672/782 kB | 16/71 kB | 26/98 kB | 49/205 kB Progress (4): 672/782 kB | 33/71 kB | 26/98 kB | 49/205 kB Progress (4): 688/782 kB | 33/71 kB | 26/98 kB | 49/205 kB Progress (4): 688/782 kB | 33/71 kB | 28/98 kB | 49/205 kB Progress (4): 688/782 kB | 33/71 kB | 28/98 kB | 64/205 kB Progress (4): 688/782 kB | 33/71 kB | 29/98 kB | 64/205 kB Progress (4): 704/782 kB | 33/71 kB | 29/98 kB | 64/205 kB Progress (4): 704/782 kB | 33/71 kB | 30/98 kB | 64/205 kB Progress (4): 704/782 kB | 33/71 kB | 32/98 kB | 64/205 kB Progress (4): 721/782 kB | 33/71 kB | 32/98 kB | 64/205 kB Progress (4): 721/782 kB | 33/71 kB | 33/98 kB | 64/205 kB Progress (4): 721/782 kB | 33/71 kB | 34/98 kB | 64/205 kB Progress (4): 721/782 kB | 33/71 kB | 36/98 kB | 64/205 kB Progress (4): 737/782 kB | 33/71 kB | 36/98 kB | 64/205 kB Progress (4): 737/782 kB | 33/71 kB | 37/98 kB | 64/205 kB Progress (4): 737/782 kB | 33/71 kB | 39/98 kB | 64/205 kB Progress (4): 754/782 kB | 33/71 kB | 39/98 kB | 64/205 kB Progress (4): 770/782 kB | 33/71 kB | 39/98 kB | 64/205 kB Progress (4): 782 kB | 33/71 kB | 39/98 kB | 64/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 8.7 MB/s) 2024-09-12T17:13:43.472 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-09-12T17:13:43.473 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (4): 33/71 kB | 39/98 kB | 64/205 kB | 16/30 kB Progress (4): 33/71 kB | 39/98 kB | 64/205 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 325 kB/s) 2024-09-12T17:13:43.474 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-09-12T17:13:43.479 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (3): 33/71 kB | 40/98 kB | 64/205 kB Progress (3): 33/71 kB | 41/98 kB | 64/205 kB Progress (3): 33/71 kB | 43/98 kB | 64/205 kB Progress (3): 49/71 kB | 43/98 kB | 64/205 kB Progress (3): 49/71 kB | 44/98 kB | 64/205 kB Progress (3): 49/71 kB | 46/98 kB | 64/205 kB Progress (3): 49/71 kB | 47/98 kB | 64/205 kB Progress (3): 49/71 kB | 47/98 kB | 80/205 kB Progress (3): 49/71 kB | 48/98 kB | 80/205 kB Progress (3): 49/71 kB | 49/98 kB | 80/205 kB Progress (3): 49/71 kB | 51/98 kB | 80/205 kB Progress (3): 49/71 kB | 52/98 kB | 80/205 kB Progress (3): 49/71 kB | 53/98 kB | 80/205 kB Progress (3): 49/71 kB | 53/98 kB | 97/205 kB Progress (3): 49/71 kB | 55/98 kB | 97/205 kB Progress (3): 49/71 kB | 56/98 kB | 97/205 kB Progress (3): 49/71 kB | 57/98 kB | 97/205 kB Progress (3): 49/71 kB | 59/98 kB | 97/205 kB Progress (3): 49/71 kB | 60/98 kB | 97/205 kB Progress (3): 49/71 kB | 62/98 kB | 97/205 kB Progress (3): 49/71 kB | 63/98 kB | 97/205 kB Progress (3): 49/71 kB | 63/98 kB | 113/205 kB Progress (3): 66/71 kB | 63/98 kB | 113/205 kB Progress (3): 71 kB | 63/98 kB | 113/205 kB Progress (3): 71 kB | 63/98 kB | 129/205 kB Progress (3): 71 kB | 63/98 kB | 146/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 705 kB/s) 2024-09-12T17:13:43.479 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-09-12T17:13:43.482 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (2): 63/98 kB | 162/205 kB Progress (2): 79/98 kB | 162/205 kB Progress (2): 79/98 kB | 179/205 kB Progress (2): 79/98 kB | 195/205 kB Progress (2): 79/98 kB | 205 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 2.0 MB/s) 2024-09-12T17:13:43.482 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-09-12T17:13:43.487 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (2): 79/98 kB | 16/81 kB Progress (2): 79/98 kB | 33/81 kB Progress (2): 95/98 kB | 33/81 kB Progress (2): 98 kB | 33/81 kB Progress (2): 98 kB | 49/81 kB Progress (2): 98 kB | 64/81 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 892 kB/s) 2024-09-12T17:13:43.487 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-09-12T17:13:43.488 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 80/81 kB Progress (1): 81 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 767 kB/s) 2024-09-12T17:13:43.488 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-09-12T17:13:43.494 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/798 kB Progress (1): 33/798 kB Progress (1): 49/798 kB Progress (2): 49/798 kB | 13 kB Progress (2): 62/798 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 118 kB/s) 2024-09-12T17:13:43.494 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-09-12T17:13:43.503 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (2): 62/798 kB | 16/182 kB Progress (2): 62/798 kB | 33/182 kB Progress (2): 62/798 kB | 49/182 kB Progress (2): 62/798 kB | 62/182 kB Progress (2): 62/798 kB | 78/182 kB Progress (2): 62/798 kB | 94/182 kB Progress (2): 62/798 kB | 111/182 kB Progress (2): 62/798 kB | 127/182 kB Progress (3): 62/798 kB | 127/182 kB | 16/151 kB Progress (3): 78/798 kB | 127/182 kB | 16/151 kB Progress (3): 78/798 kB | 127/182 kB | 33/151 kB Progress (3): 78/798 kB | 143/182 kB | 33/151 kB Progress (3): 78/798 kB | 143/182 kB | 49/151 kB Progress (3): 95/798 kB | 143/182 kB | 49/151 kB Progress (3): 95/798 kB | 160/182 kB | 49/151 kB Progress (3): 95/798 kB | 160/182 kB | 62/151 kB Progress (4): 95/798 kB | 160/182 kB | 62/151 kB | 16/27 kB Progress (4): 95/798 kB | 176/182 kB | 62/151 kB | 16/27 kB Progress (4): 95/798 kB | 176/182 kB | 79/151 kB | 16/27 kB Progress (4): 95/798 kB | 176/182 kB | 79/151 kB | 27 kB Progress (4): 95/798 kB | 182 kB | 79/151 kB | 27 kB Progress (4): 111/798 kB | 182 kB | 79/151 kB | 27 kB Progress (4): 111/798 kB | 182 kB | 95/151 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 227 kB/s) 2024-09-12T17:13:43.503 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-09-12T17:13:43.504 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (3): 111/798 kB | 182 kB | 111/151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.5 MB/s) 2024-09-12T17:13:43.504 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-09-12T17:13:43.505 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (2): 111/798 kB | 128/151 kB Progress (2): 128/798 kB | 128/151 kB Progress (2): 128/798 kB | 144/151 kB Progress (2): 128/798 kB | 151 kB Progress (2): 144/798 kB | 151 kB Progress (2): 160/798 kB | 151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.2 MB/s) 2024-09-12T17:13:43.505 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-09-12T17:13:43.510 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 177/798 kB Progress (1): 193/798 kB Progress (1): 209/798 kB Progress (1): 226/798 kB Progress (2): 226/798 kB | 16/30 kB Progress (2): 226/798 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 237 kB/s) 2024-09-12T17:13:43.510 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-09-12T17:13:43.519 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 242/798 kB Progress (1): 259/798 kB Progress (1): 275/798 kB Progress (1): 291/798 kB Progress (1): 308/798 kB Progress (1): 324/798 kB Progress (1): 341/798 kB Progress (1): 357/798 kB Progress (1): 373/798 kB Progress (1): 390/798 kB Progress (2): 390/798 kB | 13 kB Progress (2): 406/798 kB | 13 kB Progress (3): 406/798 kB | 13 kB | 16/385 kB Progress (3): 422/798 kB | 13 kB | 16/385 kB Progress (3): 422/798 kB | 13 kB | 33/385 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 97 kB/s) 2024-09-12T17:13:43.519 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-09-12T17:13:43.521 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (2): 439/798 kB | 33/385 kB Progress (2): 439/798 kB | 49/385 kB Progress (3): 439/798 kB | 49/385 kB | 16/75 kB Progress (3): 455/798 kB | 49/385 kB | 16/75 kB Progress (3): 455/798 kB | 49/385 kB | 33/75 kB Progress (3): 455/798 kB | 65/385 kB | 33/75 kB Progress (3): 472/798 kB | 65/385 kB | 33/75 kB Progress (3): 472/798 kB | 65/385 kB | 49/75 kB Progress (3): 472/798 kB | 82/385 kB | 49/75 kB Progress (3): 472/798 kB | 82/385 kB | 66/75 kB Progress (3): 488/798 kB | 82/385 kB | 66/75 kB Progress (3): 488/798 kB | 82/385 kB | 75 kB Progress (3): 504/798 kB | 82/385 kB | 75 kB Progress (3): 504/798 kB | 98/385 kB | 75 kB Progress (3): 521/798 kB | 98/385 kB | 75 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 544 kB/s) 2024-09-12T17:13:43.521 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-09-12T17:13:43.530 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (2): 521/798 kB | 114/385 kB Progress (2): 521/798 kB | 131/385 kB Progress (2): 521/798 kB | 147/385 kB Progress (2): 521/798 kB | 164/385 kB Progress (2): 521/798 kB | 180/385 kB Progress (2): 521/798 kB | 196/385 kB Progress (2): 521/798 kB | 213/385 kB Progress (2): 521/798 kB | 229/385 kB Progress (2): 521/798 kB | 245/385 kB Progress (2): 521/798 kB | 262/385 kB Progress (2): 521/798 kB | 278/385 kB Progress (2): 521/798 kB | 295/385 kB Progress (2): 537/798 kB | 295/385 kB Progress (2): 537/798 kB | 311/385 kB Progress (2): 537/798 kB | 327/385 kB Progress (2): 537/798 kB | 344/385 kB Progress (2): 554/798 kB | 344/385 kB Progress (2): 554/798 kB | 360/385 kB Progress (2): 570/798 kB | 360/385 kB Progress (2): 570/798 kB | 376/385 kB Progress (2): 586/798 kB | 376/385 kB Progress (2): 603/798 kB | 376/385 kB Progress (2): 619/798 kB | 376/385 kB Progress (2): 635/798 kB | 376/385 kB Progress (3): 635/798 kB | 376/385 kB | 16/780 kB Progress (3): 652/798 kB | 376/385 kB | 16/780 kB Progress (3): 652/798 kB | 376/385 kB | 33/780 kB Progress (3): 668/798 kB | 376/385 kB | 33/780 kB Progress (3): 685/798 kB | 376/385 kB | 33/780 kB Progress (3): 701/798 kB | 376/385 kB | 33/780 kB Progress (3): 717/798 kB | 376/385 kB | 33/780 kB Progress (3): 717/798 kB | 376/385 kB | 49/780 kB Progress (3): 734/798 kB | 376/385 kB | 49/780 kB Progress (3): 750/798 kB | 376/385 kB | 49/780 kB Progress (3): 750/798 kB | 385 kB | 49/780 kB Progress (3): 766/798 kB | 385 kB | 49/780 kB Progress (3): 766/798 kB | 385 kB | 66/780 kB Progress (3): 783/798 kB | 385 kB | 66/780 kB Progress (3): 798 kB | 385 kB | 66/780 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 2.6 MB/s) 2024-09-12T17:13:43.530 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-09-12T17:13:43.530 INFO:tasks.workunit.client.0.smithi016.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 5.4 MB/s) 2024-09-12T17:13:43.530 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 82/780 kB Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-09-12T17:13:43.566 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 98/780 kB Progress (2): 98/780 kB | 16/329 kB Progress (2): 98/780 kB | 33/329 kB Progress (3): 98/780 kB | 33/329 kB | 16/501 kB Progress (3): 98/780 kB | 33/329 kB | 33/501 kB Progress (3): 98/780 kB | 49/329 kB | 33/501 kB Progress (3): 98/780 kB | 64/329 kB | 33/501 kB Progress (3): 98/780 kB | 64/329 kB | 49/501 kB Progress (3): 98/780 kB | 64/329 kB | 63/501 kB Progress (3): 98/780 kB | 81/329 kB | 63/501 kB Progress (3): 98/780 kB | 81/329 kB | 79/501 kB Progress (3): 98/780 kB | 81/329 kB | 96/501 kB Progress (3): 98/780 kB | 81/329 kB | 112/501 kB Progress (3): 98/780 kB | 97/329 kB | 112/501 kB Progress (3): 98/780 kB | 97/329 kB | 128/501 kB Progress (3): 98/780 kB | 97/329 kB | 145/501 kB Progress (3): 98/780 kB | 113/329 kB | 145/501 kB Progress (3): 98/780 kB | 113/329 kB | 161/501 kB Progress (3): 98/780 kB | 130/329 kB | 161/501 kB Progress (3): 98/780 kB | 130/329 kB | 177/501 kB Progress (3): 115/780 kB | 130/329 kB | 177/501 kB Progress (3): 131/780 kB | 130/329 kB | 177/501 kB Progress (3): 131/780 kB | 130/329 kB | 194/501 kB Progress (3): 131/780 kB | 146/329 kB | 194/501 kB Progress (3): 147/780 kB | 146/329 kB | 194/501 kB Progress (3): 147/780 kB | 146/329 kB | 210/501 kB Progress (3): 147/780 kB | 162/329 kB | 210/501 kB Progress (3): 164/780 kB | 162/329 kB | 210/501 kB Progress (4): 164/780 kB | 162/329 kB | 210/501 kB | 16/354 kB Progress (5): 164/780 kB | 162/329 kB | 210/501 kB | 16/354 kB | 16/41 kB Progress (5): 164/780 kB | 162/329 kB | 227/501 kB | 16/354 kB | 16/41 kB Progress (5): 164/780 kB | 179/329 kB | 227/501 kB | 16/354 kB | 16/41 kB Progress (5): 164/780 kB | 179/329 kB | 227/501 kB | 33/354 kB | 16/41 kB Progress (5): 180/780 kB | 179/329 kB | 227/501 kB | 33/354 kB | 16/41 kB Progress (5): 180/780 kB | 179/329 kB | 243/501 kB | 33/354 kB | 16/41 kB Progress (5): 180/780 kB | 179/329 kB | 243/501 kB | 49/354 kB | 16/41 kB Progress (5): 197/780 kB | 179/329 kB | 243/501 kB | 49/354 kB | 16/41 kB Progress (5): 197/780 kB | 179/329 kB | 259/501 kB | 49/354 kB | 16/41 kB Progress (5): 197/780 kB | 179/329 kB | 259/501 kB | 49/354 kB | 33/41 kB Progress (5): 197/780 kB | 179/329 kB | 259/501 kB | 66/354 kB | 33/41 kB Progress (5): 213/780 kB | 179/329 kB | 259/501 kB | 66/354 kB | 33/41 kB Progress (5): 213/780 kB | 179/329 kB | 276/501 kB | 66/354 kB | 33/41 kB Progress (5): 213/780 kB | 179/329 kB | 276/501 kB | 82/354 kB | 33/41 kB Progress (5): 229/780 kB | 179/329 kB | 276/501 kB | 82/354 kB | 33/41 kB Progress (5): 229/780 kB | 179/329 kB | 292/501 kB | 82/354 kB | 33/41 kB Progress (5): 229/780 kB | 179/329 kB | 292/501 kB | 98/354 kB | 33/41 kB Progress (5): 246/780 kB | 179/329 kB | 292/501 kB | 98/354 kB | 33/41 kB Progress (5): 256/780 kB | 179/329 kB | 292/501 kB | 98/354 kB | 33/41 kB Progress (5): 256/780 kB | 195/329 kB | 292/501 kB | 98/354 kB | 33/41 kB Progress (5): 256/780 kB | 195/329 kB | 292/501 kB | 115/354 kB | 33/41 kB Progress (5): 256/780 kB | 195/329 kB | 309/501 kB | 115/354 kB | 33/41 kB Progress (5): 272/780 kB | 195/329 kB | 309/501 kB | 115/354 kB | 33/41 kB Progress (5): 272/780 kB | 195/329 kB | 309/501 kB | 131/354 kB | 33/41 kB Progress (5): 272/780 kB | 195/329 kB | 325/501 kB | 131/354 kB | 33/41 kB Progress (5): 272/780 kB | 195/329 kB | 325/501 kB | 147/354 kB | 33/41 kB Progress (5): 272/780 kB | 195/329 kB | 325/501 kB | 164/354 kB | 33/41 kB Progress (5): 272/780 kB | 195/329 kB | 341/501 kB | 164/354 kB | 33/41 kB Progress (5): 272/780 kB | 195/329 kB | 341/501 kB | 180/354 kB | 33/41 kB Progress (5): 272/780 kB | 195/329 kB | 358/501 kB | 180/354 kB | 33/41 kB Progress (5): 272/780 kB | 195/329 kB | 358/501 kB | 180/354 kB | 41 kB Progress (5): 272/780 kB | 195/329 kB | 358/501 kB | 197/354 kB | 41 kB Progress (5): 289/780 kB | 195/329 kB | 358/501 kB | 197/354 kB | 41 kB Progress (5): 289/780 kB | 212/329 kB | 358/501 kB | 197/354 kB | 41 kB Progress (5): 289/780 kB | 212/329 kB | 374/501 kB | 197/354 kB | 41 kB Progress (5): 289/780 kB | 212/329 kB | 374/501 kB | 213/354 kB | 41 kB Progress (5): 305/780 kB | 212/329 kB | 374/501 kB | 213/354 kB | 41 kB Progress (5): 305/780 kB | 228/329 kB | 374/501 kB | 213/354 kB | 41 kB Progress (5): 305/780 kB | 228/329 kB | 390/501 kB | 213/354 kB | 41 kB Progress (5): 305/780 kB | 228/329 kB | 390/501 kB | 229/354 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 239 kB/s) 2024-09-12T17:13:43.566 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (4): 321/780 kB | 228/329 kB | 390/501 kB | 229/354 kB Progress (4): 321/780 kB | 244/329 kB | 390/501 kB | 229/354 kB Progress (4): 321/780 kB | 244/329 kB | 407/501 kB | 229/354 kB Progress (4): 321/780 kB | 244/329 kB | 407/501 kB | 246/354 kB Progress (4): 338/780 kB | 244/329 kB | 407/501 kB | 246/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-09-12T17:13:43.567 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (4): 338/780 kB | 244/329 kB | 423/501 kB | 246/354 kB Progress (4): 354/780 kB | 244/329 kB | 423/501 kB | 246/354 kB Progress (4): 354/780 kB | 244/329 kB | 440/501 kB | 246/354 kB Progress (4): 354/780 kB | 261/329 kB | 440/501 kB | 246/354 kB Progress (4): 370/780 kB | 261/329 kB | 440/501 kB | 246/354 kB Progress (4): 370/780 kB | 261/329 kB | 456/501 kB | 246/354 kB Progress (4): 370/780 kB | 277/329 kB | 456/501 kB | 246/354 kB Progress (4): 387/780 kB | 277/329 kB | 456/501 kB | 246/354 kB Progress (4): 387/780 kB | 277/329 kB | 472/501 kB | 246/354 kB Progress (4): 387/780 kB | 294/329 kB | 472/501 kB | 246/354 kB Progress (4): 403/780 kB | 294/329 kB | 472/501 kB | 246/354 kB Progress (4): 403/780 kB | 294/329 kB | 489/501 kB | 246/354 kB Progress (4): 403/780 kB | 294/329 kB | 489/501 kB | 262/354 kB Progress (4): 420/780 kB | 294/329 kB | 489/501 kB | 262/354 kB Progress (4): 420/780 kB | 310/329 kB | 489/501 kB | 262/354 kB Progress (4): 420/780 kB | 310/329 kB | 501 kB | 262/354 kB Progress (4): 436/780 kB | 310/329 kB | 501 kB | 262/354 kB Progress (4): 436/780 kB | 310/329 kB | 501 kB | 279/354 kB Progress (4): 436/780 kB | 326/329 kB | 501 kB | 279/354 kB Progress (4): 452/780 kB | 326/329 kB | 501 kB | 279/354 kB Progress (4): 452/780 kB | 329 kB | 501 kB | 279/354 kB Progress (4): 452/780 kB | 329 kB | 501 kB | 295/354 kB Progress (4): 469/780 kB | 329 kB | 501 kB | 295/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 2.8 MB/s) 2024-09-12T17:13:43.567 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-09-12T17:13:43.567 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (3): 469/780 kB | 329 kB | 311/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 1.9 MB/s) 2024-09-12T17:13:43.567 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-09-12T17:13:43.567 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (2): 469/780 kB | 328/354 kB Progress (2): 469/780 kB | 344/354 kB Progress (2): 469/780 kB | 354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 2.0 MB/s) 2024-09-12T17:13:43.567 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-09-12T17:13:43.569 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 485/780 kB Progress (1): 502/780 kB Progress (1): 518/780 kB Progress (1): 534/780 kB Progress (1): 551/780 kB Progress (1): 567/780 kB Progress (1): 583/780 kB Progress (1): 600/780 kB Progress (1): 616/780 kB Progress (1): 633/780 kB Progress (1): 649/780 kB Progress (1): 665/780 kB Progress (1): 682/780 kB Progress (1): 698/780 kB Progress (1): 715/780 kB Progress (1): 731/780 kB Progress (1): 747/780 kB Progress (1): 764/780 kB Progress (1): 780/780 kB Progress (1): 780 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 4.2 MB/s) 2024-09-12T17:13:43.569 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-09-12T17:13:43.572 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 34 kB/s) 2024-09-12T17:13:43.572 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-09-12T17:13:43.576 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/211 kB Progress (2): 16/211 kB | 16/586 kB Progress (2): 33/211 kB | 16/586 kB Progress (2): 33/211 kB | 33/586 kB Progress (2): 49/211 kB | 33/586 kB Progress (3): 49/211 kB | 33/586 kB | 14 kB Progress (3): 65/211 kB | 33/586 kB | 14 kB Progress (3): 65/211 kB | 49/586 kB | 14 kB Progress (3): 65/211 kB | 62/586 kB | 14 kB Progress (3): 81/211 kB | 62/586 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 75 kB/s) 2024-09-12T17:13:43.576 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-09-12T17:13:43.579 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (2): 81/211 kB | 78/586 kB Progress (2): 98/211 kB | 78/586 kB Progress (2): 98/211 kB | 95/586 kB Progress (2): 114/211 kB | 95/586 kB Progress (2): 131/211 kB | 95/586 kB Progress (2): 131/211 kB | 111/586 kB Progress (2): 147/211 kB | 111/586 kB Progress (2): 163/211 kB | 111/586 kB Progress (2): 163/211 kB | 127/586 kB Progress (2): 180/211 kB | 127/586 kB Progress (2): 196/211 kB | 127/586 kB Progress (2): 196/211 kB | 144/586 kB Progress (2): 211 kB | 144/586 kB Progress (2): 211 kB | 160/586 kB Progress (2): 211 kB | 176/586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 1.1 MB/s) 2024-09-12T17:13:43.579 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-09-12T17:13:43.586 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 193/586 kB Progress (1): 209/586 kB Progress (1): 226/586 kB Progress (1): 242/586 kB Progress (1): 258/586 kB Progress (1): 275/586 kB Progress (1): 291/586 kB Progress (1): 308/586 kB Progress (1): 324/586 kB Progress (1): 340/586 kB Progress (1): 357/586 kB Progress (2): 357/586 kB | 15/106 kB Progress (2): 373/586 kB | 15/106 kB Progress (2): 373/586 kB | 31/106 kB Progress (2): 389/586 kB | 31/106 kB Progress (2): 389/586 kB | 48/106 kB Progress (2): 406/586 kB | 48/106 kB Progress (2): 406/586 kB | 64/106 kB Progress (2): 422/586 kB | 64/106 kB Progress (2): 422/586 kB | 77/106 kB Progress (2): 439/586 kB | 77/106 kB Progress (3): 439/586 kB | 77/106 kB | 6.8 kB Progress (3): 439/586 kB | 94/106 kB | 6.8 kB Progress (3): 455/586 kB | 94/106 kB | 6.8 kB Progress (3): 455/586 kB | 106 kB | 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 34 kB/s) 2024-09-12T17:13:43.586 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (2): 471/586 kB | 106 kB Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-09-12T17:13:43.586 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (2): 488/586 kB | 106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 529 kB/s) 2024-09-12T17:13:43.586 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-09-12T17:13:43.590 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 504/586 kB Progress (1): 521/586 kB Progress (1): 537/586 kB Progress (1): 553/586 kB Progress (1): 570/586 kB Progress (1): 586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 2.9 MB/s) 2024-09-12T17:13:43.590 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-09-12T17:13:43.595 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/245 kB Progress (1): 33/245 kB Progress (1): 49/245 kB Progress (1): 64/245 kB Progress (1): 80/245 kB Progress (1): 96/245 kB Progress (1): 113/245 kB Progress (1): 129/245 kB Progress (1): 146/245 kB Progress (1): 162/245 kB Progress (1): 178/245 kB Progress (1): 195/245 kB Progress (1): 211/245 kB Progress (1): 227/245 kB Progress (1): 244/245 kB Progress (1): 245 kB Progress (2): 245 kB | 16/205 kB Progress (2): 245 kB | 33/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.2 MB/s) 2024-09-12T17:13:43.595 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-09-12T17:13:43.598 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 49/205 kB Progress (1): 66/205 kB Progress (1): 82/205 kB Progress (1): 98/205 kB Progress (1): 115/205 kB Progress (1): 131/205 kB Progress (1): 147/205 kB Progress (1): 164/205 kB Progress (1): 180/205 kB Progress (1): 197/205 kB Progress (1): 205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 962 kB/s) 2024-09-12T17:13:43.598 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-09-12T17:13:43.601 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 71 kB/s) 2024-09-12T17:13:43.601 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-09-12T17:13:43.602 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 76 kB/s) 2024-09-12T17:13:43.602 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-09-12T17:13:43.604 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 29 kB/s) 2024-09-12T17:13:43.613 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/24 kB Progress (2): 16/24 kB | 16/23 kB Progress (2): 24 kB | 16/23 kB Progress (2): 24 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 99 kB/s) 2024-09-12T17:13:43.614 INFO:tasks.workunit.client.0.smithi016.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 106 kB/s) 2024-09-12T17:13:43.615 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 76 kB/s) 2024-09-12T17:13:43.620 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/184 kB Progress (1): 32/184 kB Progress (1): 49/184 kB Progress (1): 65/184 kB Progress (1): 81/184 kB Progress (1): 98/184 kB Progress (1): 114/184 kB Progress (1): 130/184 kB Progress (1): 147/184 kB Progress (1): 163/184 kB Progress (1): 180/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 785 kB/s) 2024-09-12T17:13:43.648 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] 2024-09-12T17:13:43.648 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-09-12T17:13:43.661 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-09-12T17:13:43.672 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 364 kB/s) 2024-09-12T17:13:43.675 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-09-12T17:13:43.690 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 340 kB/s) 2024-09-12T17:13:43.693 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-09-12T17:13:43.708 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/43 kB Progress (1): 33/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 2.9 MB/s) 2024-09-12T17:13:43.714 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-09-12T17:13:43.728 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 950 kB/s) 2024-09-12T17:13:43.735 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-09-12T17:13:43.755 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/153 kB Progress (1): 33/153 kB Progress (1): 49/153 kB Progress (1): 66/153 kB Progress (1): 82/153 kB Progress (1): 98/153 kB Progress (1): 115/153 kB Progress (1): 131/153 kB Progress (1): 147/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 8.1 MB/s) 2024-09-12T17:13:43.755 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-09-12T17:13:43.773 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/215 kB Progress (1): 33/215 kB Progress (1): 49/215 kB Progress (1): 66/215 kB Progress (1): 82/215 kB Progress (1): 98/215 kB Progress (1): 112/215 kB Progress (1): 129/215 kB Progress (1): 145/215 kB Progress (1): 161/215 kB Progress (1): 178/215 kB Progress (1): 194/215 kB Progress (1): 211/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 12 MB/s) 2024-09-12T17:13:43.841 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] 2024-09-12T17:13:43.841 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T17:13:43.845 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-09-12T17:13:43.858 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 190 kB/s) 2024-09-12T17:13:43.860 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-09-12T17:13:43.875 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.6 MB/s) 2024-09-12T17:13:43.878 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-09-12T17:13:43.891 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 626 kB/s) 2024-09-12T17:13:43.894 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-09-12T17:13:43.908 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.8 MB/s) 2024-09-12T17:13:43.910 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-09-12T17:13:43.924 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 431 kB/s) 2024-09-12T17:13:43.926 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-09-12T17:13:43.940 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 230 kB/s) 2024-09-12T17:13:43.943 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-09-12T17:13:43.957 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 44 kB/s) 2024-09-12T17:13:43.959 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-09-12T17:13:43.973 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 211 kB/s) 2024-09-12T17:13:43.975 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-09-12T17:13:43.988 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 1.0 MB/s) 2024-09-12T17:13:43.991 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-09-12T17:13:44.006 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 214 kB/s) 2024-09-12T17:13:44.007 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-09-12T17:13:44.021 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 597 kB/s) 2024-09-12T17:13:44.023 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-09-12T17:13:44.037 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 597 kB/s) 2024-09-12T17:13:44.040 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-09-12T17:13:44.054 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 572 kB/s) 2024-09-12T17:13:44.057 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-09-12T17:13:44.072 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.4 MB/s) 2024-09-12T17:13:44.079 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-09-12T17:13:44.092 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 364 kB/s) 2024-09-12T17:13:44.095 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-09-12T17:13:44.109 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 2.2 MB/s) 2024-09-12T17:13:44.115 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-09-12T17:13:44.129 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 364 kB/s) 2024-09-12T17:13:44.133 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-09-12T17:13:44.148 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/85 kB Progress (1): 33/85 kB Progress (1): 49/85 kB Progress (1): 66/85 kB Progress (1): 82/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 5.3 MB/s) 2024-09-12T17:13:44.149 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-09-12T17:13:44.149 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-09-12T17:13:44.149 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-09-12T17:13:44.150 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-09-12T17:13:44.150 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-09-12T17:13:44.165 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 2.5 kB Progress (2): 2.5 kB | 8.5 kB Progress (3): 2.5 kB | 8.5 kB | 16/41 kB Progress (4): 2.5 kB | 8.5 kB | 16/41 kB | 16/55 kB Progress (4): 2.5 kB | 8.5 kB | 16/41 kB | 33/55 kB Progress (4): 2.5 kB | 8.5 kB | 33/41 kB | 33/55 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 166 kB/s) 2024-09-12T17:13:44.165 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-09-12T17:13:44.165 INFO:tasks.workunit.client.0.smithi016.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 565 kB/s) 2024-09-12T17:13:44.165 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (3): 33/41 kB | 33/55 kB | 16/269 kB Progress (3): 33/41 kB | 49/55 kB | 16/269 kB Progress (3): 41 kB | 49/55 kB | 16/269 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-09-12T17:13:44.166 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (3): 41 kB | 55 kB | 16/269 kB Progress (3): 41 kB | 55 kB | 33/269 kB Progress (3): 41 kB | 55 kB | 49/269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 3.2 MB/s) 2024-09-12T17:13:44.166 INFO:tasks.workunit.client.0.smithi016.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.4 MB/s) 2024-09-12T17:13:44.171 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 63/269 kB Progress (1): 80/269 kB Progress (1): 96/269 kB Progress (1): 112/269 kB Progress (1): 129/269 kB Progress (1): 145/269 kB Progress (1): 162/269 kB Progress (1): 178/269 kB Progress (1): 194/269 kB Progress (1): 211/269 kB Progress (1): 227/269 kB Progress (1): 243/269 kB Progress (1): 260/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 12 MB/s) 2024-09-12T17:13:44.190 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/327 kB Progress (1): 33/327 kB Progress (2): 33/327 kB | 16/587 kB Progress (2): 49/327 kB | 16/587 kB Progress (2): 49/327 kB | 33/587 kB Progress (2): 66/327 kB | 33/587 kB Progress (2): 66/327 kB | 49/587 kB Progress (2): 82/327 kB | 49/587 kB Progress (2): 82/327 kB | 66/587 kB Progress (2): 82/327 kB | 82/587 kB Progress (2): 98/327 kB | 82/587 kB Progress (2): 98/327 kB | 98/587 kB Progress (2): 115/327 kB | 98/587 kB Progress (2): 115/327 kB | 115/587 kB Progress (2): 131/327 kB | 115/587 kB Progress (2): 131/327 kB | 131/587 kB Progress (2): 147/327 kB | 131/587 kB Progress (2): 147/327 kB | 147/587 kB Progress (2): 147/327 kB | 164/587 kB Progress (2): 164/327 kB | 164/587 kB Progress (2): 164/327 kB | 180/587 kB Progress (2): 180/327 kB | 180/587 kB Progress (2): 180/327 kB | 197/587 kB Progress (2): 197/327 kB | 197/587 kB Progress (2): 197/327 kB | 213/587 kB Progress (2): 197/327 kB | 229/587 kB Progress (2): 213/327 kB | 229/587 kB Progress (2): 213/327 kB | 246/587 kB Progress (2): 229/327 kB | 246/587 kB Progress (2): 229/327 kB | 256/587 kB Progress (2): 229/327 kB | 272/587 kB Progress (2): 246/327 kB | 272/587 kB Progress (2): 246/327 kB | 289/587 kB Progress (2): 262/327 kB | 289/587 kB Progress (2): 262/327 kB | 305/587 kB Progress (2): 279/327 kB | 305/587 kB Progress (2): 279/327 kB | 321/587 kB Progress (2): 295/327 kB | 321/587 kB Progress (2): 295/327 kB | 338/587 kB Progress (2): 311/327 kB | 338/587 kB Progress (2): 311/327 kB | 354/587 kB Progress (2): 311/327 kB | 370/587 kB Progress (2): 327 kB | 370/587 kB Progress (2): 327 kB | 387/587 kB Progress (2): 327 kB | 403/587 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 8.6 MB/s) 2024-09-12T17:13:44.191 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 420/587 kB Progress (1): 436/587 kB Progress (1): 452/587 kB Progress (1): 469/587 kB Progress (1): 485/587 kB Progress (1): 502/587 kB Progress (1): 518/587 kB Progress (1): 534/587 kB Progress (1): 551/587 kB Progress (1): 567/587 kB Progress (1): 583/587 kB Progress (1): 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 14 MB/s) 2024-09-12T17:13:44.249 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T17:13:44.250 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] 2024-09-12T17:13:44.250 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T17:13:44.257 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-09-12T17:13:44.275 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 296 kB/s) 2024-09-12T17:13:44.276 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-09-12T17:13:44.292 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 424 kB/s) 2024-09-12T17:13:44.296 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-09-12T17:13:44.311 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 2.0 MB/s) 2024-09-12T17:13:44.316 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-09-12T17:13:44.329 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 998 kB/s) 2024-09-12T17:13:44.334 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-09-12T17:13:44.349 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 51 kB/s) 2024-09-12T17:13:44.353 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-09-12T17:13:44.369 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 249 kB/s) 2024-09-12T17:13:44.373 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-09-12T17:13:44.392 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 865 kB/s) 2024-09-12T17:13:44.398 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-09-12T17:13:44.414 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 311 kB/s) 2024-09-12T17:13:44.417 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-09-12T17:13:44.432 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 276 kB/s) 2024-09-12T17:13:44.436 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-09-12T17:13:44.451 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 158 kB/s) 2024-09-12T17:13:44.453 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-09-12T17:13:44.468 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 806 kB/s) 2024-09-12T17:13:44.472 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-09-12T17:13:44.487 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 1.1 MB/s) 2024-09-12T17:13:44.490 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-09-12T17:13:44.505 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 469 kB/s) 2024-09-12T17:13:44.509 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-09-12T17:13:44.523 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 70 kB/s) 2024-09-12T17:13:44.526 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-09-12T17:13:44.541 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 559 kB/s) 2024-09-12T17:13:44.543 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-09-12T17:13:44.558 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 179 kB/s) 2024-09-12T17:13:44.562 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-09-12T17:13:44.578 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 375 kB/s) 2024-09-12T17:13:44.582 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-09-12T17:13:44.597 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 76 kB/s) 2024-09-12T17:13:44.601 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-09-12T17:13:44.616 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 55 kB/s) 2024-09-12T17:13:44.618 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-09-12T17:13:44.633 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 431 kB/s) 2024-09-12T17:13:44.635 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-09-12T17:13:44.650 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.7 MB/s) 2024-09-12T17:13:44.655 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-09-12T17:13:44.669 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 80 kB/s) 2024-09-12T17:13:44.672 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-09-12T17:13:44.687 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 88 kB/s) 2024-09-12T17:13:44.695 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-09-12T17:13:44.710 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 967 kB/s) 2024-09-12T17:13:44.710 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-09-12T17:13:44.711 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-09-12T17:13:44.711 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-09-12T17:13:44.711 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-09-12T17:13:44.712 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-09-12T17:13:44.726 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 4.2 kB Progress (2): 4.2 kB | 16/122 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 263 kB/s) 2024-09-12T17:13:44.726 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (2): 16/122 kB | 16/27 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-09-12T17:13:44.729 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (3): 16/122 kB | 16/27 kB | 16/334 kB Progress (3): 16/122 kB | 16/27 kB | 33/334 kB Progress (3): 16/122 kB | 16/27 kB | 49/334 kB Progress (3): 32/122 kB | 16/27 kB | 49/334 kB Progress (3): 32/122 kB | 27 kB | 49/334 kB Progress (4): 32/122 kB | 27 kB | 49/334 kB | 16/55 kB Progress (4): 32/122 kB | 27 kB | 66/334 kB | 16/55 kB Progress (4): 49/122 kB | 27 kB | 66/334 kB | 16/55 kB Progress (4): 49/122 kB | 27 kB | 82/334 kB | 16/55 kB Progress (4): 65/122 kB | 27 kB | 82/334 kB | 16/55 kB Progress (4): 65/122 kB | 27 kB | 82/334 kB | 33/55 kB Progress (4): 65/122 kB | 27 kB | 98/334 kB | 33/55 kB Progress (4): 81/122 kB | 27 kB | 98/334 kB | 33/55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.6 MB/s) 2024-09-12T17:13:44.729 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-09-12T17:13:44.729 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (3): 81/122 kB | 114/334 kB | 33/55 kB Progress (3): 98/122 kB | 114/334 kB | 33/55 kB Progress (3): 98/122 kB | 114/334 kB | 49/55 kB Progress (3): 98/122 kB | 131/334 kB | 49/55 kB Progress (3): 114/122 kB | 131/334 kB | 49/55 kB Progress (3): 122 kB | 131/334 kB | 49/55 kB Progress (3): 122 kB | 131/334 kB | 55 kB Progress (3): 122 kB | 147/334 kB | 55 kB Progress (3): 122 kB | 164/334 kB | 55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 6.8 MB/s) 2024-09-12T17:13:44.729 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-09-12T17:13:44.729 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (2): 180/334 kB | 55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 3.0 MB/s) 2024-09-12T17:13:44.731 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 196/334 kB Progress (1): 213/334 kB Progress (1): 229/334 kB Progress (1): 245/334 kB Progress (1): 262/334 kB Progress (1): 278/334 kB Progress (1): 295/334 kB Progress (1): 311/334 kB Progress (1): 327/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 17 MB/s) 2024-09-12T17:13:44.741 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/267 kB Progress (1): 32/267 kB Progress (1): 49/267 kB Progress (1): 65/267 kB Progress (1): 80/267 kB Progress (1): 96/267 kB Progress (1): 112/267 kB Progress (1): 129/267 kB Progress (2): 129/267 kB | 4.7 kB Progress (2): 145/267 kB | 4.7 kB Progress (2): 162/267 kB | 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 150 kB/s) 2024-09-12T17:13:44.743 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 178/267 kB Progress (1): 194/267 kB Progress (1): 211/267 kB Progress (1): 227/267 kB Progress (2): 227/267 kB | 16/23 kB Progress (2): 244/267 kB | 16/23 kB Progress (2): 244/267 kB | 23 kB Progress (2): 260/267 kB | 23 kB Progress (2): 267 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 735 kB/s) 2024-09-12T17:13:44.743 INFO:tasks.workunit.client.0.smithi016.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 8.1 MB/s) 2024-09-12T17:13:44.847 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] Changes detected - recompiling the module! :source 2024-09-12T17:13:44.849 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-09-12T17:13:46.087 INFO:tasks.workunit.client.0.smithi016.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T17:13:46.088 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] 2024-09-12T17:13:46.088 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T17:13:46.092 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T17:13:46.092 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] 2024-09-12T17:13:46.092 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T17:13:46.099 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-09-12T17:13:46.099 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-09-12T17:13:46.317 INFO:tasks.workunit.client.0.smithi016.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T17:13:46.317 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] 2024-09-12T17:13:46.318 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T17:13:46.318 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-09-12T17:13:46.332 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 416 kB/s) 2024-09-12T17:13:46.335 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-09-12T17:13:46.349 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 252 kB/s) 2024-09-12T17:13:46.352 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-09-12T17:13:46.366 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 217 kB/s) 2024-09-12T17:13:46.369 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-09-12T17:13:46.385 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 271 kB/s) 2024-09-12T17:13:46.388 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-09-12T17:13:46.405 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 194 kB/s) 2024-09-12T17:13:46.408 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-09-12T17:13:46.422 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 318 kB/s) 2024-09-12T17:13:46.426 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-09-12T17:13:46.442 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 110 kB/s) 2024-09-12T17:13:46.445 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-09-12T17:13:46.458 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 169 kB/s) 2024-09-12T17:13:46.460 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-09-12T17:13:46.474 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 2.2 MB/s) 2024-09-12T17:13:46.476 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-09-12T17:13:46.490 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 135 kB/s) 2024-09-12T17:13:46.492 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-09-12T17:13:46.506 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 446 kB/s) 2024-09-12T17:13:46.508 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-09-12T17:13:46.522 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 181 kB/s) 2024-09-12T17:13:46.524 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-09-12T17:13:46.537 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.6 MB/s) 2024-09-12T17:13:46.539 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-09-12T17:13:46.553 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/37 kB Progress (1): 33/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.7 MB/s) 2024-09-12T17:13:46.555 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-09-12T17:13:46.569 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 1.2 MB/s) 2024-09-12T17:13:46.571 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-09-12T17:13:46.586 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 618 kB/s) 2024-09-12T17:13:46.587 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-09-12T17:13:46.600 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 2.0 MB/s) 2024-09-12T17:13:46.603 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-09-12T17:13:46.617 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 576 kB/s) 2024-09-12T17:13:46.620 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-09-12T17:13:46.633 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 155 kB/s) 2024-09-12T17:13:46.636 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-09-12T17:13:46.650 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 200 kB/s) 2024-09-12T17:13:46.652 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-09-12T17:13:46.666 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 118 kB/s) 2024-09-12T17:13:46.667 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-09-12T17:13:46.680 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 236 kB/s) 2024-09-12T17:13:46.682 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-09-12T17:13:46.695 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.5 MB/s) 2024-09-12T17:13:46.697 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-09-12T17:13:46.711 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 520 kB/s) 2024-09-12T17:13:46.712 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-09-12T17:13:46.730 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 1.0 MB/s) 2024-09-12T17:13:46.730 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-09-12T17:13:46.742 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 212 kB/s) 2024-09-12T17:13:46.744 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-09-12T17:13:46.758 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 486 kB/s) 2024-09-12T17:13:46.759 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-09-12T17:13:46.773 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 646 kB/s) 2024-09-12T17:13:46.775 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-09-12T17:13:46.789 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 159 kB/s) 2024-09-12T17:13:46.791 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-09-12T17:13:46.805 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 171 kB/s) 2024-09-12T17:13:46.808 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-09-12T17:13:46.821 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 216 kB/s) 2024-09-12T17:13:46.824 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-09-12T17:13:46.839 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 1.1 MB/s) 2024-09-12T17:13:46.840 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-09-12T17:13:46.854 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 1.1 MB/s) 2024-09-12T17:13:46.857 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-09-12T17:13:46.871 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 895 kB/s) 2024-09-12T17:13:46.873 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-09-12T17:13:46.887 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 342 kB/s) 2024-09-12T17:13:46.889 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-09-12T17:13:46.903 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 448 kB/s) 2024-09-12T17:13:46.904 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-09-12T17:13:46.918 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 2.5 MB/s) 2024-09-12T17:13:46.920 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-09-12T17:13:46.935 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 1.2 MB/s) 2024-09-12T17:13:46.936 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-09-12T17:13:46.950 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 987 kB/s) 2024-09-12T17:13:46.956 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-09-12T17:13:46.971 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 50 kB/s) 2024-09-12T17:13:46.974 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-09-12T17:13:46.989 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 320 kB/s) 2024-09-12T17:13:46.993 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-09-12T17:13:47.008 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 527 kB/s) 2024-09-12T17:13:47.012 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-09-12T17:13:47.026 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 214 kB/s) 2024-09-12T17:13:47.031 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-09-12T17:13:47.045 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 283 kB/s) 2024-09-12T17:13:47.050 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-09-12T17:13:47.065 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 137 kB/s) 2024-09-12T17:13:47.067 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-09-12T17:13:47.082 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 248 kB/s) 2024-09-12T17:13:47.086 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-09-12T17:13:47.101 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 729 kB/s) 2024-09-12T17:13:47.104 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-09-12T17:13:47.119 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 898 kB/s) 2024-09-12T17:13:47.122 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-09-12T17:13:47.139 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 1.2 MB/s) 2024-09-12T17:13:47.140 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-09-12T17:13:47.154 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 24 kB/s) 2024-09-12T17:13:47.158 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-09-12T17:13:47.172 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 436 kB/s) 2024-09-12T17:13:47.175 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-09-12T17:13:47.189 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 489 kB/s) 2024-09-12T17:13:47.192 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-09-12T17:13:47.207 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 322 kB/s) 2024-09-12T17:13:47.213 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-09-12T17:13:47.229 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 430 kB/s) 2024-09-12T17:13:47.237 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-09-12T17:13:47.253 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.4 MB/s) 2024-09-12T17:13:47.257 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-09-12T17:13:47.273 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/78 kB Progress (1): 32/78 kB Progress (1): 49/78 kB Progress (1): 65/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 4.6 MB/s) 2024-09-12T17:13:47.280 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-09-12T17:13:47.295 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.5 MB/s) 2024-09-12T17:13:47.302 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-09-12T17:13:47.317 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 377 kB/s) 2024-09-12T17:13:47.322 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-09-12T17:13:47.343 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 285 kB/s) 2024-09-12T17:13:47.343 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-09-12T17:13:47.355 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 213 kB/s) 2024-09-12T17:13:47.359 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-09-12T17:13:47.375 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 1.7 MB/s) 2024-09-12T17:13:47.381 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-09-12T17:13:47.396 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 158 kB/s) 2024-09-12T17:13:47.413 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-09-12T17:13:47.450 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/308 kB Progress (1): 33/308 kB Progress (1): 49/308 kB Progress (1): 65/308 kB Progress (1): 82/308 kB Progress (1): 98/308 kB Progress (1): 114/308 kB Progress (1): 131/308 kB Progress (1): 147/308 kB Progress (1): 163/308 kB Progress (1): 180/308 kB Progress (1): 196/308 kB Progress (1): 213/308 kB Progress (1): 229/308 kB Progress (1): 245/308 kB Progress (1): 262/308 kB Progress (1): 278/308 kB Progress (1): 294/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 8.3 MB/s) 2024-09-12T17:13:47.451 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-09-12T17:13:47.451 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-09-12T17:13:47.452 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-09-12T17:13:47.452 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-09-12T17:13:47.453 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-09-12T17:13:47.467 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 849 kB/s) 2024-09-12T17:13:47.467 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-09-12T17:13:47.474 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/171 kB Progress (2): 16/171 kB | 16/26 kB Progress (2): 16/171 kB | 26 kB Progress (2): 33/171 kB | 26 kB Progress (3): 33/171 kB | 26 kB | 8.2 kB Progress (4): 33/171 kB | 26 kB | 8.2 kB | 16/118 kB Progress (4): 49/171 kB | 26 kB | 8.2 kB | 16/118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.5 MB/s) 2024-09-12T17:13:47.474 INFO:tasks.workunit.client.0.smithi016.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 511 kB/s) 2024-09-12T17:13:47.474 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (2): 49/171 kB | 33/118 kB Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-09-12T17:13:47.474 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (2): 64/171 kB | 33/118 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-09-12T17:13:47.474 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (2): 64/171 kB | 49/118 kB Progress (2): 81/171 kB | 49/118 kB Progress (2): 81/171 kB | 64/118 kB Progress (2): 97/171 kB | 64/118 kB Progress (2): 97/171 kB | 80/118 kB Progress (2): 113/171 kB | 80/118 kB Progress (2): 113/171 kB | 97/118 kB Progress (2): 130/171 kB | 97/118 kB Progress (2): 130/171 kB | 113/118 kB Progress (2): 146/171 kB | 113/118 kB Progress (2): 146/171 kB | 118 kB Progress (2): 163/171 kB | 118 kB Progress (2): 171 kB | 118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 5.6 MB/s) 2024-09-12T17:13:47.475 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-09-12T17:13:47.475 INFO:tasks.workunit.client.0.smithi016.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 7.4 MB/s) 2024-09-12T17:13:47.475 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-09-12T17:13:47.486 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/136 kB Progress (2): 16/136 kB | 16/61 kB Progress (2): 33/136 kB | 16/61 kB Progress (2): 33/136 kB | 32/61 kB Progress (2): 49/136 kB | 32/61 kB Progress (2): 66/136 kB | 32/61 kB Progress (2): 66/136 kB | 49/61 kB Progress (2): 82/136 kB | 49/61 kB Progress (2): 82/136 kB | 61 kB Progress (2): 98/136 kB | 61 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 1.9 MB/s) 2024-09-12T17:13:47.486 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-09-12T17:13:47.487 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 114/136 kB Progress (1): 130/136 kB Progress (2): 130/136 kB | 15/146 kB Progress (2): 136 kB | 15/146 kB Progress (2): 136 kB | 31/146 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 4.0 MB/s) 2024-09-12T17:13:47.487 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-09-12T17:13:47.491 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 48/146 kB Progress (1): 64/146 kB Progress (1): 81/146 kB Progress (1): 95/146 kB Progress (2): 95/146 kB | 16/501 kB Progress (2): 112/146 kB | 16/501 kB Progress (3): 112/146 kB | 16/501 kB | 16/58 kB Progress (3): 128/146 kB | 16/501 kB | 16/58 kB Progress (3): 128/146 kB | 33/501 kB | 16/58 kB Progress (3): 144/146 kB | 33/501 kB | 16/58 kB Progress (3): 144/146 kB | 33/501 kB | 33/58 kB Progress (3): 146 kB | 33/501 kB | 33/58 kB Progress (3): 146 kB | 49/501 kB | 33/58 kB Progress (3): 146 kB | 49/501 kB | 49/58 kB Progress (3): 146 kB | 66/501 kB | 49/58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 3.9 MB/s) 2024-09-12T17:13:47.491 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (2): 66/501 kB | 58 kB Progress (2): 82/501 kB | 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.6 MB/s) 2024-09-12T17:13:47.503 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 98/501 kB Progress (1): 115/501 kB Progress (1): 131/501 kB Progress (1): 147/501 kB Progress (1): 164/501 kB Progress (1): 180/501 kB Progress (1): 197/501 kB Progress (1): 213/501 kB Progress (1): 229/501 kB Progress (1): 246/501 kB Progress (1): 262/501 kB Progress (1): 279/501 kB Progress (1): 295/501 kB Progress (1): 311/501 kB Progress (1): 328/501 kB Progress (1): 344/501 kB Progress (1): 360/501 kB Progress (1): 377/501 kB Progress (1): 393/501 kB Progress (1): 410/501 kB Progress (1): 426/501 kB Progress (1): 442/501 kB Progress (2): 442/501 kB | 16/124 kB Progress (2): 459/501 kB | 16/124 kB Progress (2): 459/501 kB | 33/124 kB Progress (2): 475/501 kB | 33/124 kB Progress (2): 475/501 kB | 49/124 kB Progress (2): 492/501 kB | 49/124 kB Progress (2): 501 kB | 49/124 kB Progress (2): 501 kB | 66/124 kB Progress (2): 501 kB | 82/124 kB Progress (3): 501 kB | 82/124 kB | 0/2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 11 MB/s) 2024-09-12T17:13:47.503 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (2): 98/124 kB | 0/2.4 MB Progress (2): 98/124 kB | 0/2.4 MB Progress (2): 115/124 kB | 0/2.4 MB Progress (2): 115/124 kB | 0/2.4 MB Progress (2): 124 kB | 0/2.4 MB Progress (2): 124 kB | 0.1/2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.6 MB/s) 2024-09-12T17:13:47.541 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 28 MB/s) 2024-09-12T17:13:47.647 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] 2024-09-12T17:13:47.647 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-09-12T17:13:47.649 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-09-12T17:13:47.663 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 320 kB/s) 2024-09-12T17:13:47.936 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-09-12T17:13:47.936 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 350 kB/s) 2024-09-12T17:13:47.936 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-09-12T17:13:47.936 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/45 kB Progress (1): 32/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 3.0 MB/s) 2024-09-12T17:13:47.936 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-09-12T17:13:47.937 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.5 MB/s) 2024-09-12T17:13:47.937 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-09-12T17:13:47.937 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 370 kB/s) 2024-09-12T17:13:47.937 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-09-12T17:13:47.937 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 280 kB/s) 2024-09-12T17:13:47.937 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-09-12T17:13:47.937 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 430 kB/s) 2024-09-12T17:13:47.937 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-09-12T17:13:47.937 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 391 kB/s) 2024-09-12T17:13:47.937 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-09-12T17:13:47.937 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.4 MB/s) 2024-09-12T17:13:47.937 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-09-12T17:13:47.938 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 969 kB/s) 2024-09-12T17:13:47.938 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-09-12T17:13:47.938 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 146 kB/s) 2024-09-12T17:13:47.938 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-09-12T17:13:47.938 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 587 kB/s) 2024-09-12T17:13:47.938 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-09-12T17:13:47.938 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.8 MB/s) 2024-09-12T17:13:47.938 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-09-12T17:13:47.938 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 2.6 MB/s) 2024-09-12T17:13:47.938 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-09-12T17:13:47.939 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-09-12T17:13:47.939 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-09-12T17:13:47.939 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-09-12T17:13:47.939 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-09-12T17:13:47.939 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/58 kB Progress (2): 16/58 kB | 16/79 kB Progress (2): 33/58 kB | 16/79 kB Progress (3): 33/58 kB | 16/79 kB | 16/26 kB Progress (3): 33/58 kB | 33/79 kB | 16/26 kB Progress (4): 33/58 kB | 33/79 kB | 16/26 kB | 16/211 kB Progress (4): 49/58 kB | 33/79 kB | 16/26 kB | 16/211 kB Progress (4): 49/58 kB | 33/79 kB | 26 kB | 16/211 kB Progress (4): 49/58 kB | 49/79 kB | 26 kB | 16/211 kB Progress (4): 58 kB | 49/79 kB | 26 kB | 16/211 kB Progress (4): 58 kB | 49/79 kB | 26 kB | 33/211 kB Progress (4): 58 kB | 66/79 kB | 26 kB | 33/211 kB Progress (4): 58 kB | 66/79 kB | 26 kB | 49/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 3.6 MB/s) 2024-09-12T17:13:47.939 INFO:tasks.workunit.client.0.smithi016.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.5 MB/s) 2024-09-12T17:13:47.939 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-09-12T17:13:47.939 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (2): 79 kB | 49/211 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-09-12T17:13:47.939 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (2): 79 kB | 63/211 kB Progress (3): 79 kB | 63/211 kB | 0/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 4.4 MB/s) 2024-09-12T17:13:47.939 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (2): 79/211 kB | 0/1.0 MB Progress (2): 79/211 kB | 0/1.0 MB Progress (2): 95/211 kB | 0/1.0 MB Progress (2): 95/211 kB | 0/1.0 MB Progress (2): 112/211 kB | 0/1.0 MB Progress (2): 112/211 kB | 0.1/1.0 MB Progress (2): 128/211 kB | 0.1/1.0 MB Progress (2): 128/211 kB | 0.1/1.0 MB Progress (2): 145/211 kB | 0.1/1.0 MB Progress (2): 145/211 kB | 0.1/1.0 MB Progress (2): 161/211 kB | 0.1/1.0 MB Progress (2): 161/211 kB | 0.1/1.0 MB Progress (2): 177/211 kB | 0.1/1.0 MB Progress (2): 194/211 kB | 0.1/1.0 MB Progress (2): 194/211 kB | 0.1/1.0 MB Progress (2): 210/211 kB | 0.1/1.0 MB Progress (2): 211 kB | 0.1/1.0 MB Progress (2): 211 kB | 0.1/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 10 MB/s) 2024-09-12T17:13:47.939 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (2): 0.6/1.0 MB | 16/116 kB Progress (2): 0.6/1.0 MB | 16/116 kB Progress (3): 0.6/1.0 MB | 16/116 kB | 16/267 kB Progress (3): 0.6/1.0 MB | 16/116 kB | 16/267 kB Progress (3): 0.6/1.0 MB | 33/116 kB | 16/267 kB Progress (3): 0.6/1.0 MB | 33/116 kB | 33/267 kB Progress (3): 0.6/1.0 MB | 33/116 kB | 33/267 kB Progress (3): 0.6/1.0 MB | 49/116 kB | 33/267 kB Progress (3): 0.6/1.0 MB | 49/116 kB | 49/267 kB Progress (3): 0.6/1.0 MB | 49/116 kB | 49/267 kB Progress (3): 0.6/1.0 MB | 66/116 kB | 49/267 kB Progress (3): 0.6/1.0 MB | 66/116 kB | 66/267 kB Progress (3): 0.7/1.0 MB | 66/116 kB | 66/267 kB Progress (3): 0.7/1.0 MB | 82/116 kB | 66/267 kB Progress (3): 0.7/1.0 MB | 82/116 kB | 79/267 kB Progress (3): 0.7/1.0 MB | 82/116 kB | 79/267 kB Progress (3): 0.7/1.0 MB | 98/116 kB | 79/267 kB Progress (3): 0.7/1.0 MB | 98/116 kB | 96/267 kB Progress (3): 0.7/1.0 MB | 98/116 kB | 96/267 kB Progress (3): 0.7/1.0 MB | 115/116 kB | 96/267 kB Progress (3): 0.7/1.0 MB | 115/116 kB | 112/267 kB Progress (3): 0.7/1.0 MB | 116 kB | 112/267 kB Progress (3): 0.7/1.0 MB | 116 kB | 112/267 kB Progress (3): 0.7/1.0 MB | 116 kB | 128/267 kB Progress (3): 0.7/1.0 MB | 116 kB | 128/267 kB Progress (3): 0.7/1.0 MB | 116 kB | 145/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.5 MB/s) 2024-09-12T17:13:47.939 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (2): 0.7/1.0 MB | 145/267 kB Progress (2): 0.7/1.0 MB | 161/267 kB Progress (2): 0.7/1.0 MB | 161/267 kB Progress (2): 0.7/1.0 MB | 178/267 kB Progress (2): 0.8/1.0 MB | 178/267 kB Progress (2): 0.8/1.0 MB | 194/267 kB Progress (2): 0.8/1.0 MB | 194/267 kB Progress (2): 0.8/1.0 MB | 210/267 kB Progress (2): 0.8/1.0 MB | 210/267 kB Progress (2): 0.8/1.0 MB | 227/267 kB Progress (2): 0.8/1.0 MB | 227/267 kB Progress (2): 0.8/1.0 MB | 243/267 kB Progress (2): 0.8/1.0 MB | 243/267 kB Progress (2): 0.8/1.0 MB | 260/267 kB Progress (2): 0.8/1.0 MB | 267 kB Progress (2): 0.8/1.0 MB | 267 kB Progress (2): 0.9/1.0 MB | 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 7.4 MB/s) 2024-09-12T17:13:47.939 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 25 MB/s) 2024-09-12T17:13:48.098 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-09-12T17:13:48.127 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:13:48.127 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] BUILD SUCCESS 2024-09-12T17:13:48.127 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:13:48.128 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] Total time: 7.447 s 2024-09-12T17:13:48.128 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] Finished at: 2024-09-12T17:13:48Z 2024-09-12T17:13:48.128 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:13:48.158 INFO:tasks.workunit.client.0.smithi016.stderr:+ ./mvnw test -Dtest=PutObjects 2024-09-12T17:13:48.164 INFO:tasks.workunit.client.0.smithi016.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T17:13:49.403 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] Scanning for projects... 2024-09-12T17:13:49.485 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] 2024-09-12T17:13:49.485 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T17:13:49.485 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] Building jcksum 1.0 2024-09-12T17:13:49.485 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] from pom.xml 2024-09-12T17:13:49.485 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T17:13:49.754 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] 2024-09-12T17:13:49.754 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T17:13:49.883 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T17:13:49.884 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] 2024-09-12T17:13:49.884 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T17:13:49.983 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T17:13:49.983 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] 2024-09-12T17:13:49.983 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T17:13:49.985 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T17:13:49.985 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] 2024-09-12T17:13:49.985 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T17:13:49.990 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T17:13:49.990 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] 2024-09-12T17:13:49.990 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T17:13:50.243 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-09-12T17:13:50.523 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-09-12T17:13:50.736 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 21 kB/s) 2024-09-12T17:13:50.746 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-09-12T17:13:50.763 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 145 kB/s) 2024-09-12T17:13:50.771 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-09-12T17:13:50.790 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 148 kB/s) 2024-09-12T17:13:50.796 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-09-12T17:13:50.813 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 168 kB/s) 2024-09-12T17:13:50.816 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-09-12T17:13:50.832 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 188 kB/s) 2024-09-12T17:13:50.836 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-09-12T17:13:50.852 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 105 kB/s) 2024-09-12T17:13:50.855 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-09-12T17:13:50.871 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 167 kB/s) 2024-09-12T17:13:50.878 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-09-12T17:13:50.901 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 17/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.1 MB/s) 2024-09-12T17:13:50.905 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-09-12T17:13:50.905 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-09-12T17:13:50.905 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-09-12T17:13:50.905 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-09-12T17:13:50.908 INFO:tasks.workunit.client.0.smithi016.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-09-12T17:13:50.929 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 650 kB/s) 2024-09-12T17:13:50.967 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 1.4/7.7 kB Progress (1): 2.8/7.7 kB Progress (2): 2.8/7.7 kB | 1.4/189 kB Progress (2): 4.1/7.7 kB | 1.4/189 kB Progress (3): 4.1/7.7 kB | 1.4/189 kB | 16/103 kB Progress (3): 4.1/7.7 kB | 2.8/189 kB | 16/103 kB Progress (4): 4.1/7.7 kB | 2.8/189 kB | 16/103 kB | 1.4/169 kB Progress (4): 5.5/7.7 kB | 2.8/189 kB | 16/103 kB | 1.4/169 kB Progress (4): 5.5/7.7 kB | 2.8/189 kB | 16/103 kB | 2.8/169 kB Progress (4): 5.5/7.7 kB | 4.1/189 kB | 16/103 kB | 2.8/169 kB Progress (4): 5.5/7.7 kB | 4.1/189 kB | 33/103 kB | 2.8/169 kB Progress (4): 6.9/7.7 kB | 4.1/189 kB | 33/103 kB | 2.8/169 kB Progress (4): 6.9/7.7 kB | 5.5/189 kB | 33/103 kB | 2.8/169 kB Progress (4): 6.9/7.7 kB | 5.5/189 kB | 33/103 kB | 4.1/169 kB Progress (4): 6.9/7.7 kB | 6.9/189 kB | 33/103 kB | 4.1/169 kB Progress (4): 7.7 kB | 6.9/189 kB | 33/103 kB | 4.1/169 kB Progress (4): 7.7 kB | 8.3/189 kB | 33/103 kB | 4.1/169 kB Progress (4): 7.7 kB | 8.3/189 kB | 33/103 kB | 5.5/169 kB Progress (4): 7.7 kB | 9.7/189 kB | 33/103 kB | 5.5/169 kB Progress (4): 7.7 kB | 9.7/189 kB | 33/103 kB | 6.9/169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 123 kB/s) 2024-09-12T17:13:50.985 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (3): 9.7/189 kB | 33/103 kB | 8.3/169 kB Progress (3): 11/189 kB | 33/103 kB | 8.3/169 kB Progress (3): 11/189 kB | 33/103 kB | 9.7/169 kB Progress (3): 12/189 kB | 33/103 kB | 9.7/169 kB Progress (3): 12/189 kB | 33/103 kB | 11/169 kB Progress (3): 14/189 kB | 33/103 kB | 11/169 kB Progress (3): 14/189 kB | 33/103 kB | 12/169 kB Progress (3): 14/189 kB | 49/103 kB | 12/169 kB Progress (3): 14/189 kB | 49/103 kB | 14/169 kB Progress (3): 15/189 kB | 49/103 kB | 14/169 kB Progress (3): 15/189 kB | 49/103 kB | 15/169 kB Progress (3): 16/189 kB | 49/103 kB | 15/169 kB Progress (3): 16/189 kB | 49/103 kB | 17/169 kB Progress (3): 18/189 kB | 49/103 kB | 17/169 kB Progress (3): 18/189 kB | 66/103 kB | 17/169 kB Progress (3): 18/189 kB | 66/103 kB | 18/169 kB Progress (3): 19/189 kB | 66/103 kB | 18/169 kB Progress (3): 19/189 kB | 66/103 kB | 19/169 kB Progress (3): 21/189 kB | 66/103 kB | 19/169 kB Progress (3): 21/189 kB | 66/103 kB | 21/169 kB Progress (3): 21/189 kB | 82/103 kB | 21/169 kB Progress (3): 21/189 kB | 82/103 kB | 22/169 kB Progress (3): 22/189 kB | 82/103 kB | 22/169 kB Progress (3): 22/189 kB | 82/103 kB | 23/169 kB Progress (3): 23/189 kB | 82/103 kB | 23/169 kB Progress (3): 23/189 kB | 82/103 kB | 25/169 kB Progress (3): 25/189 kB | 82/103 kB | 25/169 kB Progress (3): 25/189 kB | 82/103 kB | 26/169 kB Progress (3): 26/189 kB | 82/103 kB | 26/169 kB Progress (3): 26/189 kB | 82/103 kB | 28/169 kB Progress (3): 27/189 kB | 82/103 kB | 28/169 kB Progress (3): 27/189 kB | 82/103 kB | 29/169 kB Progress (3): 29/189 kB | 82/103 kB | 29/169 kB Progress (3): 29/189 kB | 98/103 kB | 29/169 kB Progress (3): 30/189 kB | 98/103 kB | 29/169 kB Progress (3): 30/189 kB | 98/103 kB | 30/169 kB Progress (3): 30/189 kB | 103 kB | 30/169 kB Progress (3): 30/189 kB | 103 kB | 31/169 kB Progress (3): 32/189 kB | 103 kB | 31/169 kB Progress (3): 32/189 kB | 103 kB | 33/169 kB Progress (3): 33/189 kB | 103 kB | 33/169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.3 MB/s) 2024-09-12T17:13:51.008 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (2): 33/189 kB | 34/169 kB Progress (2): 34/189 kB | 34/169 kB Progress (2): 34/189 kB | 36/169 kB Progress (2): 36/189 kB | 36/169 kB Progress (2): 36/189 kB | 37/169 kB Progress (2): 37/189 kB | 37/169 kB Progress (2): 37/189 kB | 38/169 kB Progress (2): 38/189 kB | 38/169 kB Progress (2): 38/189 kB | 40/169 kB Progress (2): 40/189 kB | 40/169 kB Progress (2): 40/189 kB | 41/169 kB Progress (2): 41/189 kB | 41/169 kB Progress (2): 41/189 kB | 42/169 kB Progress (2): 41/189 kB | 44/169 kB Progress (2): 43/189 kB | 44/169 kB Progress (2): 43/189 kB | 45/169 kB Progress (2): 44/189 kB | 45/169 kB Progress (2): 44/189 kB | 47/169 kB Progress (2): 45/189 kB | 47/169 kB Progress (2): 45/189 kB | 48/169 kB Progress (2): 47/189 kB | 48/169 kB Progress (2): 47/189 kB | 49/169 kB Progress (2): 47/189 kB | 51/169 kB Progress (2): 48/189 kB | 51/169 kB Progress (2): 48/189 kB | 52/169 kB Progress (2): 48/189 kB | 53/169 kB Progress (2): 49/189 kB | 53/169 kB Progress (2): 49/189 kB | 55/169 kB Progress (2): 49/189 kB | 56/169 kB Progress (2): 51/189 kB | 56/169 kB Progress (2): 51/189 kB | 58/169 kB Progress (2): 52/189 kB | 58/169 kB Progress (2): 52/189 kB | 59/169 kB Progress (2): 54/189 kB | 59/169 kB Progress (2): 54/189 kB | 60/169 kB Progress (2): 55/189 kB | 60/169 kB Progress (2): 55/189 kB | 61/169 kB Progress (2): 56/189 kB | 61/169 kB Progress (2): 56/189 kB | 78/169 kB Progress (2): 58/189 kB | 78/169 kB Progress (2): 58/189 kB | 94/169 kB Progress (2): 59/189 kB | 94/169 kB Progress (2): 61/189 kB | 94/169 kB Progress (2): 61/189 kB | 111/169 kB Progress (2): 62/189 kB | 111/169 kB Progress (2): 63/189 kB | 111/169 kB Progress (2): 79/189 kB | 111/169 kB Progress (2): 96/189 kB | 111/169 kB Progress (2): 112/189 kB | 111/169 kB Progress (2): 112/189 kB | 127/169 kB Progress (2): 128/189 kB | 127/169 kB Progress (2): 128/189 kB | 143/169 kB Progress (2): 145/189 kB | 143/169 kB Progress (2): 145/189 kB | 160/169 kB Progress (2): 161/189 kB | 160/169 kB Progress (2): 161/189 kB | 169 kB Progress (2): 178/189 kB | 169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 1.6 MB/s) 2024-09-12T17:13:51.010 INFO:tasks.workunit.client.0.smithi016.stdout:Progress (1): 189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 1.8 MB/s) 2024-09-12T17:13:51.027 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] 2024-09-12T17:13:51.027 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] ------------------------------------------------------- 2024-09-12T17:13:51.027 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] T E S T S 2024-09-12T17:13:51.027 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] ------------------------------------------------------- 2024-09-12T17:13:51.688 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-09-12T17:13:51.798 INFO:tasks.workunit.client.0.smithi016.stdout:PutObjects.java: starting test run: 2024-09-12T17:13:51.798 INFO:tasks.workunit.client.0.smithi016.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T17:13:51.799 INFO:tasks.workunit.client.0.smithi016.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T17:13:51.799 INFO:tasks.workunit.client.0.smithi016.stdout: EndpointUrl=http://smithi016.front.sepia.ceph.com:80 2024-09-12T17:13:51.799 INFO:tasks.workunit.client.0.smithi016.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-09-12T17:13:51.896 INFO:tasks.workunit.client.0.smithi016.stdout:DEBUG: Environment Variables Read 2024-09-12T17:13:52.300 INFO:tasks.workunit.client.0.smithi016.stdout:DEBUG: S3 Client Initialized 2024-09-12T17:13:52.300 INFO:tasks.workunit.client.0.smithi016.stdout:DEBUG: Generating File 2024-09-12T17:13:52.300 INFO:tasks.workunit.client.0.smithi016.stdout:DEBUG: File Generated 2024-09-12T17:13:52.300 INFO:tasks.workunit.client.0.smithi016.stdout:DEBUG: Generating File 2024-09-12T17:13:52.301 INFO:tasks.workunit.client.0.smithi016.stdout:DEBUG: File Generated 2024-09-12T17:13:52.301 INFO:tasks.workunit.client.0.smithi016.stdout:DEBUG: Generating File 2024-09-12T17:13:52.301 INFO:tasks.workunit.client.0.smithi016.stdout:DEBUG: File Generated 2024-09-12T17:13:52.301 INFO:tasks.workunit.client.0.smithi016.stdout:DEBUG: Generating File 2024-09-12T17:13:52.301 INFO:tasks.workunit.client.0.smithi016.stdout:DEBUG: File Generated 2024-09-12T17:13:52.301 INFO:tasks.workunit.client.0.smithi016.stdout:DEBUG: Generating File 2024-09-12T17:13:52.301 INFO:tasks.workunit.client.0.smithi016.stdout:DEBUG: File Generated 2024-09-12T17:13:52.301 INFO:tasks.workunit.client.0.smithi016.stdout:DEBUG: Generating File 2024-09-12T17:13:52.301 INFO:tasks.workunit.client.0.smithi016.stdout:DEBUG: File Generated 2024-09-12T17:13:52.301 INFO:tasks.workunit.client.0.smithi016.stdout:DEBUG: Generated Big Files 2024-09-12T17:13:52.497 INFO:tasks.workunit.client.0.smithi016.stdout:HeadBucketResponse() 2024-09-12T17:13:52.498 INFO:tasks.workunit.client.0.smithi016.stdout:sheik is ready 2024-09-12T17:13:52.498 INFO:tasks.workunit.client.0.smithi016.stdout:DEBUG: Test Bucket Created 2024-09-12T17:13:52.597 INFO:tasks.workunit.client.0.smithi016.stdout:putObjectFromFileNoCksum called with file-0b 2024-09-12T17:13:52.697 INFO:tasks.workunit.client.0.smithi016.stdout:putObjectFromFileNoCksum called with file-8b 2024-09-12T17:13:52.798 INFO:tasks.workunit.client.0.smithi016.stdout:putObjectFromFileNoCksum called with file-200b 2024-09-12T17:13:52.898 INFO:tasks.workunit.client.0.smithi016.stdout:putObjectFromFileNoCksum called with file-21983b 2024-09-12T17:13:52.998 INFO:tasks.workunit.client.0.smithi016.stdout:putObjectFromFileNoCksum called with file-5519b 2024-09-12T17:13:53.098 INFO:tasks.workunit.client.0.smithi016.stdout:putObjectFromFileNoCksum called with file-204329b 2024-09-12T17:13:53.199 INFO:tasks.workunit.client.0.smithi016.stdout:putObjectFromFileNoCksum called with file-256k 2024-09-12T17:13:53.299 INFO:tasks.workunit.client.0.smithi016.stdout:putObjectFromFileNoCksum called with file-1m 2024-09-12T17:13:53.399 INFO:tasks.workunit.client.0.smithi016.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-09-12T17:13:53.499 INFO:tasks.workunit.client.0.smithi016.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-09-12T17:13:55.404 INFO:tasks.workunit.client.0.smithi016.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-09-12T17:13:55.906 INFO:tasks.workunit.client.0.smithi016.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-09-12T17:13:59.688 INFO:tasks.workunit.client.0.smithi016.stdout:arg: file-0b 2024-09-12T17:13:59.689 INFO:tasks.workunit.client.0.smithi016.stdout:arg: file-8b 2024-09-12T17:13:59.691 INFO:tasks.workunit.client.0.smithi016.stdout:arg: file-200b 2024-09-12T17:13:59.692 INFO:tasks.workunit.client.0.smithi016.stdout:arg: file-21983b 2024-09-12T17:13:59.694 INFO:tasks.workunit.client.0.smithi016.stdout:arg: file-5519b 2024-09-12T17:13:59.696 INFO:tasks.workunit.client.0.smithi016.stdout:arg: file-204329b 2024-09-12T17:13:59.697 INFO:tasks.workunit.client.0.smithi016.stdout:arg: file-256k 2024-09-12T17:13:59.698 INFO:tasks.workunit.client.0.smithi016.stdout:arg: file-1m 2024-09-12T17:13:59.699 INFO:tasks.workunit.client.0.smithi016.stdout:arg: file-1038757b 2024-09-12T17:13:59.715 INFO:tasks.workunit.client.0.smithi016.stdout:putObjectFromFileCksum called with file-0b 2024-09-12T17:13:59.742 INFO:tasks.workunit.client.0.smithi016.stdout:PutObjectResponse 2024-09-12T17:13:59.806 INFO:tasks.workunit.client.0.smithi016.stdout:putObjectFromFileCksum called with file-8b 2024-09-12T17:13:59.806 INFO:tasks.workunit.client.0.smithi016.stdout:PutObjectResponse 2024-09-12T17:13:59.815 INFO:tasks.workunit.client.0.smithi016.stdout:putObjectFromFileCksum called with file-200b 2024-09-12T17:13:59.878 INFO:tasks.workunit.client.0.smithi016.stdout:PutObjectResponse 2024-09-12T17:13:59.916 INFO:tasks.workunit.client.0.smithi016.stdout:putObjectFromFileCksum called with file-21983b 2024-09-12T17:13:59.916 INFO:tasks.workunit.client.0.smithi016.stdout:PutObjectResponse 2024-09-12T17:14:00.016 INFO:tasks.workunit.client.0.smithi016.stdout:putObjectFromFileCksum called with file-5519b 2024-09-12T17:14:00.016 INFO:tasks.workunit.client.0.smithi016.stdout:PutObjectResponse 2024-09-12T17:14:00.103 INFO:tasks.workunit.client.0.smithi016.stdout:putObjectFromFileCksum called with file-204329b 2024-09-12T17:14:00.103 INFO:tasks.workunit.client.0.smithi016.stdout:PutObjectResponse 2024-09-12T17:14:00.116 INFO:tasks.workunit.client.0.smithi016.stdout:putObjectFromFileCksum called with file-256k 2024-09-12T17:14:00.164 INFO:tasks.workunit.client.0.smithi016.stdout:PutObjectResponse 2024-09-12T17:14:00.217 INFO:tasks.workunit.client.0.smithi016.stdout:putObjectFromFileCksum called with file-1m 2024-09-12T17:14:00.304 INFO:tasks.workunit.client.0.smithi016.stdout:PutObjectResponse 2024-09-12T17:14:00.317 INFO:tasks.workunit.client.0.smithi016.stdout:putObjectFromFileCksum called with file-1038757b 2024-09-12T17:14:00.407 INFO:tasks.workunit.client.0.smithi016.stdout:PutObjectResponse 2024-09-12T17:14:00.417 INFO:tasks.workunit.client.0.smithi016.stdout:mpuObjectFromFileCksum called with file-5m 2024-09-12T17:14:00.918 INFO:tasks.workunit.client.0.smithi016.stdout:mpuObjectFromFileCksum called with file-10m 2024-09-12T17:14:01.720 INFO:tasks.workunit.client.0.smithi016.stdout:mpuObjectFromFileCksum called with file-100m 2024-09-12T17:14:08.332 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.61 s -- in io.ceph.jcksum.PutObjects 2024-09-12T17:14:08.355 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] 2024-09-12T17:14:08.355 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] Results: 2024-09-12T17:14:08.355 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] 2024-09-12T17:14:08.355 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-09-12T17:14:08.355 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] 2024-09-12T17:14:08.357 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:14:08.357 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] BUILD SUCCESS 2024-09-12T17:14:08.357 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:14:08.358 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] Total time: 18.975 s 2024-09-12T17:14:08.358 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] Finished at: 2024-09-12T17:14:08Z 2024-09-12T17:14:08.358 INFO:tasks.workunit.client.0.smithi016.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:14:08.381 INFO:tasks.workunit.client.0.smithi016.stderr:+ exit 2024-09-12T17:14:08.381 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:14:08.381 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:14:08.436 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-09-12T17:14:08.436 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:14:08.824 DEBUG:teuthology.parallel:result is None 2024-09-12T17:14:08.825 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:14:08.836 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:14:08.836 DEBUG:teuthology.orchestra.run.smithi016:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:14:08.885 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:14:08.885 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:14:08.899 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:14:08.899 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:14:08.900 DEBUG:teuthology.orchestra.run.smithi016:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:14:08.933 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:14:08.934 INFO:teuthology.orchestra.run.smithi016.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:14:08.934 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:14:08.981 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:14:08.981 DEBUG:teuthology.orchestra.run.smithi016:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:14:09.029 INFO:tasks.workunit:timeout=3h 2024-09-12T17:14:09.029 INFO:tasks.workunit:cleanup=True 2024-09-12T17:14:09.030 DEBUG:teuthology.orchestra.run.smithi016:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:14:09.079 INFO:tasks.workunit.client.0.smithi016.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:15:07.604 INFO:tasks.workunit.client.0.smithi016.stderr:Updating files: 91% (11572/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-12T17:15:08.398 INFO:tasks.workunit.client.0.smithi016.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:15:08.398 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:15:08.398 INFO:tasks.workunit.client.0.smithi016.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:15:08.398 INFO:tasks.workunit.client.0.smithi016.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:15:08.398 INFO:tasks.workunit.client.0.smithi016.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:15:08.398 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:15:08.398 INFO:tasks.workunit.client.0.smithi016.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:15:08.398 INFO:tasks.workunit.client.0.smithi016.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:15:08.398 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:15:08.399 INFO:tasks.workunit.client.0.smithi016.stderr: git switch -c 2024-09-12T17:15:08.399 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:15:08.399 INFO:tasks.workunit.client.0.smithi016.stderr:Or undo this operation with: 2024-09-12T17:15:08.399 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:15:08.399 INFO:tasks.workunit.client.0.smithi016.stderr: git switch - 2024-09-12T17:15:08.399 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:15:08.399 INFO:tasks.workunit.client.0.smithi016.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:15:08.399 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:15:08.399 INFO:tasks.workunit.client.0.smithi016.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:15:08.406 DEBUG:teuthology.orchestra.run.smithi016:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:15:08.454 INFO:tasks.workunit.client.0.smithi016.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:15:08.456 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:15:08.456 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:15:08.512 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:15:08.570 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:15:08.611 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:15:08.611 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:15:08.611 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:15:08.651 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:15:08.658 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-12T17:15:08.658 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:15:08.721 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-09-12T17:15:08.722 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-09-12T17:15:08.722 DEBUG:teuthology.orchestra.run.smithi016:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-09-12T17:15:08.797 INFO:tasks.workunit.client.0.smithi016.stdout:INFO: fully qualified domain name: smithi016.front.sepia.ceph.com 2024-09-12T17:15:08.797 INFO:tasks.workunit.client.0.smithi016.stdout:== TESTING *COMPLETING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-09-12T17:15:08.797 INFO:tasks.workunit.client.0.smithi016.stdout:== TESTING VERSIONED BUCKET == 2024-09-12T17:15:12.169 INFO:tasks.workunit.client.0.smithi016.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T17:15:12.378 INFO:tasks.workunit.client.0.smithi016.stdout:Collecting pip 2024-09-12T17:15:12.384 INFO:tasks.workunit.client.0.smithi016.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T17:15:12.420 INFO:tasks.workunit.client.0.smithi016.stdout:Installing collected packages: pip 2024-09-12T17:15:12.420 INFO:tasks.workunit.client.0.smithi016.stdout: Attempting uninstall: pip 2024-09-12T17:15:12.420 INFO:tasks.workunit.client.0.smithi016.stdout: Found existing installation: pip 22.0.2 2024-09-12T17:15:12.691 INFO:tasks.workunit.client.0.smithi016.stdout: Uninstalling pip-22.0.2: 2024-09-12T17:15:12.697 INFO:tasks.workunit.client.0.smithi016.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T17:15:13.471 INFO:tasks.workunit.client.0.smithi016.stdout:Successfully installed pip-24.2 2024-09-12T17:15:14.556 INFO:tasks.workunit.client.0.smithi016.stdout:Collecting boto3 2024-09-12T17:15:14.557 INFO:tasks.workunit.client.0.smithi016.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T17:15:15.094 INFO:tasks.workunit.client.0.smithi016.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T17:15:15.095 INFO:tasks.workunit.client.0.smithi016.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T17:15:15.154 INFO:tasks.workunit.client.0.smithi016.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T17:15:15.155 INFO:tasks.workunit.client.0.smithi016.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T17:15:15.210 INFO:tasks.workunit.client.0.smithi016.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T17:15:15.211 INFO:tasks.workunit.client.0.smithi016.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T17:15:15.260 INFO:tasks.workunit.client.0.smithi016.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:15:15.261 INFO:tasks.workunit.client.0.smithi016.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T17:15:15.340 INFO:tasks.workunit.client.0.smithi016.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:15:15.341 INFO:tasks.workunit.client.0.smithi016.stdout: Using cached urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB) 2024-09-12T17:15:15.482 INFO:tasks.workunit.client.0.smithi016.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:15:15.483 INFO:tasks.workunit.client.0.smithi016.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T17:15:15.487 INFO:tasks.workunit.client.0.smithi016.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T17:15:15.488 INFO:tasks.workunit.client.0.smithi016.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T17:15:15.498 INFO:tasks.workunit.client.0.smithi016.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T17:15:15.499 INFO:tasks.workunit.client.0.smithi016.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T17:15:15.500 INFO:tasks.workunit.client.0.smithi016.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T17:15:15.501 INFO:tasks.workunit.client.0.smithi016.stdout:Using cached urllib3-2.2.3-py3-none-any.whl (126 kB) 2024-09-12T17:15:15.503 INFO:tasks.workunit.client.0.smithi016.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T17:15:15.574 INFO:tasks.workunit.client.0.smithi016.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T17:15:16.581 INFO:tasks.workunit.client.0.smithi016.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.3 2024-09-12T17:15:17.175 INFO:tasks.workunit.client.0.smithi016.stdout:INFO: creating user 2024-09-12T17:15:17.538 INFO:tasks.workunit.client.0.smithi016.stdout:{ 2024-09-12T17:15:17.538 INFO:tasks.workunit.client.0.smithi016.stdout: "user_id": "testid", 2024-09-12T17:15:17.538 INFO:tasks.workunit.client.0.smithi016.stdout: "display_name": "M. Tester", 2024-09-12T17:15:17.538 INFO:tasks.workunit.client.0.smithi016.stdout: "email": "tester@ceph.com", 2024-09-12T17:15:17.538 INFO:tasks.workunit.client.0.smithi016.stdout: "suspended": 0, 2024-09-12T17:15:17.538 INFO:tasks.workunit.client.0.smithi016.stdout: "max_buckets": 1000, 2024-09-12T17:15:17.538 INFO:tasks.workunit.client.0.smithi016.stdout: "subusers": [], 2024-09-12T17:15:17.538 INFO:tasks.workunit.client.0.smithi016.stdout: "keys": [ 2024-09-12T17:15:17.538 INFO:tasks.workunit.client.0.smithi016.stdout: { 2024-09-12T17:15:17.538 INFO:tasks.workunit.client.0.smithi016.stdout: "user": "testid", 2024-09-12T17:15:17.539 INFO:tasks.workunit.client.0.smithi016.stdout: "access_key": "0555b35654ad1656d804", 2024-09-12T17:15:17.539 INFO:tasks.workunit.client.0.smithi016.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-09-12T17:15:17.539 INFO:tasks.workunit.client.0.smithi016.stdout: "active": true, 2024-09-12T17:15:17.539 INFO:tasks.workunit.client.0.smithi016.stdout: "create_date": "2024-09-12T17:15:17.527853Z" 2024-09-12T17:15:17.539 INFO:tasks.workunit.client.0.smithi016.stdout: } 2024-09-12T17:15:17.539 INFO:tasks.workunit.client.0.smithi016.stdout: ], 2024-09-12T17:15:17.539 INFO:tasks.workunit.client.0.smithi016.stdout: "swift_keys": [], 2024-09-12T17:15:17.539 INFO:tasks.workunit.client.0.smithi016.stdout: "caps": [], 2024-09-12T17:15:17.539 INFO:tasks.workunit.client.0.smithi016.stdout: "op_mask": "read, write, delete", 2024-09-12T17:15:17.539 INFO:tasks.workunit.client.0.smithi016.stdout: "default_placement": "", 2024-09-12T17:15:17.539 INFO:tasks.workunit.client.0.smithi016.stdout: "default_storage_class": "", 2024-09-12T17:15:17.539 INFO:tasks.workunit.client.0.smithi016.stdout: "placement_tags": [], 2024-09-12T17:15:17.539 INFO:tasks.workunit.client.0.smithi016.stdout: "bucket_quota": { 2024-09-12T17:15:17.539 INFO:tasks.workunit.client.0.smithi016.stdout: "enabled": false, 2024-09-12T17:15:17.540 INFO:tasks.workunit.client.0.smithi016.stdout: "check_on_raw": false, 2024-09-12T17:15:17.540 INFO:tasks.workunit.client.0.smithi016.stdout: "max_size": -1, 2024-09-12T17:15:17.540 INFO:tasks.workunit.client.0.smithi016.stdout: "max_size_kb": 0, 2024-09-12T17:15:17.540 INFO:tasks.workunit.client.0.smithi016.stdout: "max_objects": -1 2024-09-12T17:15:17.540 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:15:17.540 INFO:tasks.workunit.client.0.smithi016.stdout: "user_quota": { 2024-09-12T17:15:17.540 INFO:tasks.workunit.client.0.smithi016.stdout: "enabled": false, 2024-09-12T17:15:17.540 INFO:tasks.workunit.client.0.smithi016.stdout: "check_on_raw": false, 2024-09-12T17:15:17.540 INFO:tasks.workunit.client.0.smithi016.stdout: "max_size": -1, 2024-09-12T17:15:17.540 INFO:tasks.workunit.client.0.smithi016.stdout: "max_size_kb": 0, 2024-09-12T17:15:17.540 INFO:tasks.workunit.client.0.smithi016.stdout: "max_objects": -1 2024-09-12T17:15:17.540 INFO:tasks.workunit.client.0.smithi016.stdout: }, 2024-09-12T17:15:17.540 INFO:tasks.workunit.client.0.smithi016.stdout: "temp_url_keys": [], 2024-09-12T17:15:17.541 INFO:tasks.workunit.client.0.smithi016.stdout: "type": "rgw", 2024-09-12T17:15:17.541 INFO:tasks.workunit.client.0.smithi016.stdout: "mfa_ids": [], 2024-09-12T17:15:17.541 INFO:tasks.workunit.client.0.smithi016.stdout: "account_id": "", 2024-09-12T17:15:17.541 INFO:tasks.workunit.client.0.smithi016.stdout: "path": "/", 2024-09-12T17:15:17.541 INFO:tasks.workunit.client.0.smithi016.stdout: "create_date": "2024-09-12T17:15:17.527811Z", 2024-09-12T17:15:17.541 INFO:tasks.workunit.client.0.smithi016.stdout: "tags": [], 2024-09-12T17:15:17.541 INFO:tasks.workunit.client.0.smithi016.stdout: "group_ids": [] 2024-09-12T17:15:17.541 INFO:tasks.workunit.client.0.smithi016.stdout:} 2024-09-12T17:15:17.541 INFO:tasks.workunit.client.0.smithi016.stdout: 2024-09-12T17:15:17.860 INFO:tasks.workunit.client.0.smithi016.stderr:5+0 records in 2024-09-12T17:15:17.860 INFO:tasks.workunit.client.0.smithi016.stderr:5+0 records out 2024-09-12T17:15:17.860 INFO:tasks.workunit.client.0.smithi016.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0225972 s, 232 MB/s 2024-09-12T17:15:20.263 INFO:tasks.workunit.client.0.smithi016.stdout:bucket nams is reupload-bkt-123871 2024-09-12T17:15:20.263 INFO:tasks.workunit.client.0.smithi016.stdout:endpoint is http://smithi016.front.sepia.ceph.com:80 2024-09-12T17:15:20.264 INFO:tasks.workunit.client.0.smithi016.stdout:start UploadId=2~XpIzMiQ4r-4-Z9DjhT7paKj8q6GZb1E 2024-09-12T17:15:20.264 INFO:tasks.workunit.client.0.smithi016.stdout:phase 1 uploaded part {'ETag': '"fa7e76f9b0e33c3bc8e1eb4d6dedbdc5"', 'PartNumber': 1} 2024-09-12T17:15:20.264 INFO:tasks.workunit.client.0.smithi016.stdout:phase 1 uploaded part {'ETag': '"fa7e76f9b0e33c3bc8e1eb4d6dedbdc5"', 'PartNumber': 2} 2024-09-12T17:15:20.264 INFO:tasks.workunit.client.0.smithi016.stdout:phase 2 uploaded part {'ETag': '"fa7e76f9b0e33c3bc8e1eb4d6dedbdc5"', 'PartNumber': 1} 2024-09-12T17:15:20.264 INFO:tasks.workunit.client.0.smithi016.stdout:phase 2 uploaded part {'ETag': '"fa7e76f9b0e33c3bc8e1eb4d6dedbdc5"', 'PartNumber': 1} 2024-09-12T17:15:20.264 INFO:tasks.workunit.client.0.smithi016.stdout:phase 2 uploaded part {'ETag': '"fa7e76f9b0e33c3bc8e1eb4d6dedbdc5"', 'PartNumber': 1} 2024-09-12T17:15:20.264 INFO:tasks.workunit.client.0.smithi016.stdout:phase 2 uploaded part {'ETag': '"fa7e76f9b0e33c3bc8e1eb4d6dedbdc5"', 'PartNumber': 1} 2024-09-12T17:15:20.264 INFO:tasks.workunit.client.0.smithi016.stdout:phase 2 uploaded part {'ETag': '"fa7e76f9b0e33c3bc8e1eb4d6dedbdc5"', 'PartNumber': 1} 2024-09-12T17:15:20.264 INFO:tasks.workunit.client.0.smithi016.stdout:phase 2 uploaded part {'ETag': '"fa7e76f9b0e33c3bc8e1eb4d6dedbdc5"', 'PartNumber': 1} 2024-09-12T17:15:20.264 INFO:tasks.workunit.client.0.smithi016.stdout:phase 2 uploaded part {'ETag': '"fa7e76f9b0e33c3bc8e1eb4d6dedbdc5"', 'PartNumber': 1} 2024-09-12T17:15:20.264 INFO:tasks.workunit.client.0.smithi016.stdout:phase 2 uploaded part {'ETag': '"fa7e76f9b0e33c3bc8e1eb4d6dedbdc5"', 'PartNumber': 1} 2024-09-12T17:15:20.264 INFO:tasks.workunit.client.0.smithi016.stdout:phase 2 uploaded part {'ETag': '"fa7e76f9b0e33c3bc8e1eb4d6dedbdc5"', 'PartNumber': 1} 2024-09-12T17:15:20.265 INFO:tasks.workunit.client.0.smithi016.stdout:phase 2 uploaded part {'ETag': '"fa7e76f9b0e33c3bc8e1eb4d6dedbdc5"', 'PartNumber': 1} 2024-09-12T17:15:20.265 INFO:tasks.workunit.client.0.smithi016.stdout:phase 2 uploaded part {'ETag': '"fa7e76f9b0e33c3bc8e1eb4d6dedbdc5"', 'PartNumber': 1} 2024-09-12T17:15:20.265 INFO:tasks.workunit.client.0.smithi016.stdout:completing multipart upload, parts=[{'ETag': '"fa7e76f9b0e33c3bc8e1eb4d6dedbdc5"', 'PartNumber': 1}, {'ETag': '"fa7e76f9b0e33c3bc8e1eb4d6dedbdc5"', 'PartNumber': 2}] 2024-09-12T17:15:22.758 INFO:tasks.workunit.client.0.smithi016.stdout:radosgw-admin bucket radoslist: 2024-09-12T17:15:22.758 INFO:tasks.workunit.client.0.smithi016.stdout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3__:jAZ2x2DNP3HxtAM3MAH68y4mRWybXmu_mpu_test4 2024-09-12T17:15:22.759 INFO:tasks.workunit.client.0.smithi016.stdout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3_mpu_test4 2024-09-12T17:15:22.759 INFO:tasks.workunit.client.0.smithi016.stdout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3__multipart_mpu_test4.2~XpIzMiQ4r-4-Z9DjhT7paKj8q6GZb1E.2 2024-09-12T17:15:22.759 INFO:tasks.workunit.client.0.smithi016.stdout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3__multipart_mpu_test4.yGZHLN3RRaVnG1Ztu7JMJO9sPXe5a2Ri.1 2024-09-12T17:15:22.759 INFO:tasks.workunit.client.0.smithi016.stdout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3__shadow_mpu_test4.2~XpIzMiQ4r-4-Z9DjhT7paKj8q6GZb1E.2_1 2024-09-12T17:15:22.759 INFO:tasks.workunit.client.0.smithi016.stdout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3__shadow_mpu_test4.yGZHLN3RRaVnG1Ztu7JMJO9sPXe5a2Ri.1_1 2024-09-12T17:15:22.846 INFO:tasks.workunit.client.0.smithi016.stdout:rados ls: 2024-09-12T17:15:22.846 INFO:tasks.workunit.client.0.smithi016.stdout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3__:jAZ2x2DNP3HxtAM3MAH68y4mRWybXmu_mpu_test4 2024-09-12T17:15:22.846 INFO:tasks.workunit.client.0.smithi016.stdout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3_mpu_test4 2024-09-12T17:15:22.846 INFO:tasks.workunit.client.0.smithi016.stdout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3__multipart_mpu_test4.2~XpIzMiQ4r-4-Z9DjhT7paKj8q6GZb1E.2 2024-09-12T17:15:22.846 INFO:tasks.workunit.client.0.smithi016.stdout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3__multipart_mpu_test4.yGZHLN3RRaVnG1Ztu7JMJO9sPXe5a2Ri.1 2024-09-12T17:15:22.847 INFO:tasks.workunit.client.0.smithi016.stdout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3__shadow_mpu_test4.2~XpIzMiQ4r-4-Z9DjhT7paKj8q6GZb1E.2_1 2024-09-12T17:15:22.847 INFO:tasks.workunit.client.0.smithi016.stdout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3__shadow_mpu_test4.yGZHLN3RRaVnG1Ztu7JMJO9sPXe5a2Ri.1_1 2024-09-12T17:15:22.863 INFO:tasks.workunit.client.0.smithi016.stdout:== PASSED == 2024-09-12T17:15:22.864 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:15:22.864 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:15:22.923 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-09-12T17:15:22.923 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:15:23.306 DEBUG:teuthology.parallel:result is None 2024-09-12T17:15:23.306 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:15:23.319 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:15:23.319 DEBUG:teuthology.orchestra.run.smithi016:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:15:23.368 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:15:23.369 INFO:teuthology.run_tasks:Running task ragweed... 2024-09-12T17:15:23.385 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-09-12T17:15:23.386 INFO:tasks.ragweed:Downloading ragweed... 2024-09-12T17:15:23.386 INFO:tasks.ragweed:Using branch 'wip-rgw-meta-handlers' for ragweed 2024-09-12T17:15:23.387 DEBUG:teuthology.orchestra.run.smithi016:> git clone -b wip-rgw-meta-handlers https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T17:15:23.417 INFO:teuthology.orchestra.run.smithi016.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-12T17:15:23.474 INFO:teuthology.orchestra.run.smithi016.stderr:fatal: Remote branch wip-rgw-meta-handlers not found in upstream origin 2024-09-12T17:15:23.474 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-09-12T17:15:23.476 INFO:tasks.ragweed:Using branch 'ceph-master' for ragweed 2024-09-12T17:15:23.476 DEBUG:teuthology.orchestra.run.smithi016:> git clone -b ceph-master https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T17:15:23.525 INFO:teuthology.orchestra.run.smithi016.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-12T17:15:23.711 INFO:tasks.ragweed:Creating rgw users... 2024-09-12T17:15:23.711 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-09-12T17:15:23.711 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key UAPVZTHPLBOMOHGESCNY --secret Hb9/XDV0ZOz9b581gsiBkUg9FjQjVuPyMnOBNY70ulWPTrkt2D/YnA== --email ragweed.client.0+test@test.test --system false 2024-09-12T17:15:23.806 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:15:23.806 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:15:23.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:23.847+0000 7fb79109a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:23.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:23.847+0000 7fb79109a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:23.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:23.847+0000 7fb79109a9c0 20 realm 2024-09-12T17:15:23.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:23.847+0000 7fb79109a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:23.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:23.847+0000 7fb79109a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:23.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:23.847+0000 7fb79109a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:15:23.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:23.847+0000 7fb79109a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:23.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:23.847+0000 7fb79109a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:23.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:23.847+0000 7fb79109a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:23.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:23.851+0000 7fb79109a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:15:23.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:23.851+0000 7fb79109a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:23.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:23.851+0000 7fb79109a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:15:23.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:23.851+0000 7fb79109a9c0 20 searching for the correct realm 2024-09-12T17:15:23.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:23.855+0000 7fb78e39f640 0 -- 172.21.15.16:0/3910143164 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7fb78001f060 msgr2=0x7fb78007b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:15:24.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.071+0000 7fb78f3a1640 0 -- 172.21.15.16:0/3910143164 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fb7840cb070 msgr2=0x7fb7840d8960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:15:24.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.087+0000 7fb79109a9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:15:24.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.087+0000 7fb79109a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:15:24.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.087+0000 7fb79109a9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:15:24.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.087+0000 7fb79109a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:15:24.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.087+0000 7fb79109a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:15:24.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.087+0000 7fb79109a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:15:24.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.087+0000 7fb79109a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:24.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.087+0000 7fb79109a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:24.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.087+0000 7fb79109a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:24.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.087+0000 7fb79109a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:15:24.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.087+0000 7fb79109a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:24.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.091+0000 7fb79109a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:15:24.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.091+0000 7fb79109a9c0 20 zone default found 2024-09-12T17:15:24.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.091+0000 7fb79109a9c0 4 Realm: () 2024-09-12T17:15:24.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.091+0000 7fb79109a9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:15:24.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.091+0000 7fb79109a9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:15:24.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.091+0000 7fb79109a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:15:24.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.091+0000 7fb79109a9c0 20 zonegroup default 2024-09-12T17:15:24.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.091+0000 7fb79109a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:24.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.091+0000 7fb79109a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:24.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.091+0000 7fb79109a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:24.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.091+0000 7fb79109a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:24.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.091+0000 7fb79109a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:24.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.091+0000 7fb79109a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:24.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.091+0000 7fb79109a9c0 20 started sync module instance, tier type = 2024-09-12T17:15:24.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.091+0000 7fb79109a9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:15:24.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.115+0000 7fb79109a9c0 20 add_watcher() i=0 2024-09-12T17:15:24.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.115+0000 7fb79109a9c0 20 add_watcher() i=1 2024-09-12T17:15:24.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.115+0000 7fb79109a9c0 20 add_watcher() i=2 2024-09-12T17:15:24.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.115+0000 7fb79109a9c0 20 add_watcher() i=3 2024-09-12T17:15:24.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.115+0000 7fb79109a9c0 20 add_watcher() i=4 2024-09-12T17:15:24.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.115+0000 7fb79109a9c0 20 add_watcher() i=5 2024-09-12T17:15:24.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.115+0000 7fb79109a9c0 20 add_watcher() i=6 2024-09-12T17:15:24.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.119+0000 7fb79109a9c0 20 add_watcher() i=7 2024-09-12T17:15:24.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.119+0000 7fb79109a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:15:24.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.127+0000 7fb6457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:15:24.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.127+0000 7fb79109a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:15:24.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.127+0000 7fb79109a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:15:24.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.127+0000 7fb79109a9c0 5 note: GC not initialized 2024-09-12T17:15:24.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.127+0000 7fb5bffff640 20 reqs_thread_entry: start 2024-09-12T17:15:24.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.127+0000 7fb79109a9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:15:24.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.127+0000 7fb79109a9c0 20 Filter name: none 2024-09-12T17:15:24.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.127+0000 7fb5bdffb640 20 reqs_thread_entry: start 2024-09-12T17:15:24.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.127+0000 7fb79109a9c0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T17:15:24.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.127+0000 7fb79109a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:24.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.127+0000 7fb79109a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:24.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.127+0000 7fb79109a9c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-09-12T17:15:24.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.127+0000 7fb79109a9c0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T17:15:24.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.127+0000 7fb79109a9c0 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-09-12T17:15:24.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.127+0000 7fb79109a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:24.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.127+0000 7fb79109a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:24.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.127+0000 7fb79109a9c0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-09-12T17:15:24.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.127+0000 7fb79109a9c0 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T17:15:24.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.127+0000 7fb79109a9c0 10 cache get: name=default.rgw.meta+users.keys+UAPVZTHPLBOMOHGESCNY : miss 2024-09-12T17:15:24.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.127+0000 7fb79109a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:24.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.131+0000 7fb79109a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:24.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.131+0000 7fb79109a9c0 10 cache put: name=default.rgw.meta+users.keys+UAPVZTHPLBOMOHGESCNY info.flags=0x0 2024-09-12T17:15:24.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.131+0000 7fb79109a9c0 10 adding default.rgw.meta+users.keys+UAPVZTHPLBOMOHGESCNY to cache LRU end 2024-09-12T17:15:24.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.131+0000 7fb79109a9c0 10 cache get: name=default.rgw.meta+users.keys+UAPVZTHPLBOMOHGESCNY : hit (negative entry) 2024-09-12T17:15:24.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.131+0000 7fb79109a9c0 10 cache get: name=default.rgw.meta+users.keys+UAPVZTHPLBOMOHGESCNY : hit (negative entry) 2024-09-12T17:15:24.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.135+0000 7fb79109a9c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T17:15:24.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.135+0000 7fb79109a9c0 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T17:15:24.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.135+0000 7fb79109a9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T17:15:24.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.135+0000 7fb6727fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693206 cookie 94622791026608 notifier 5859 bl.length()=675 2024-09-12T17:15:24.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.135+0000 7fb6727fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T17:15:24.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.135+0000 7fb6727fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T17:15:24.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.139+0000 7fb79109a9c0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T17:15:24.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.139+0000 7fb79109a9c0 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T17:15:24.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.139+0000 7fb79109a9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T17:15:24.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.139+0000 7fb6727fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693198 cookie 94622791018944 notifier 5859 bl.length()=202 2024-09-12T17:15:24.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.139+0000 7fb6727fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T17:15:24.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.139+0000 7fb6727fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T17:15:24.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.143+0000 7fb79109a9c0 10 cache put: name=default.rgw.meta+users.keys+UAPVZTHPLBOMOHGESCNY info.flags=0x7 2024-09-12T17:15:24.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.143+0000 7fb79109a9c0 10 moving default.rgw.meta+users.keys+UAPVZTHPLBOMOHGESCNY to cache LRU end 2024-09-12T17:15:24.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.143+0000 7fb79109a9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:UAPVZTHPLBOMOHGESCNY, ofs0, ns] 2024-09-12T17:15:24.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.143+0000 7fb671ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693196 cookie 94622791032304 notifier 5859 bl.length()=190 2024-09-12T17:15:24.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.143+0000 7fb671ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+UAPVZTHPLBOMOHGESCNY info.flags=0x7 2024-09-12T17:15:24.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.143+0000 7fb671ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+UAPVZTHPLBOMOHGESCNY to cache LRU end 2024-09-12T17:15:24.148 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-12T17:15:24.148 INFO:teuthology.orchestra.run.smithi016.stdout: "user_id": "ragweed.client.0", 2024-09-12T17:15:24.148 INFO:teuthology.orchestra.run.smithi016.stdout: "display_name": "Mr. ragweed.client.0", 2024-09-12T17:15:24.148 INFO:teuthology.orchestra.run.smithi016.stdout: "email": "ragweed.client.0+test@test.test", 2024-09-12T17:15:24.149 INFO:teuthology.orchestra.run.smithi016.stdout: "suspended": 0, 2024-09-12T17:15:24.149 INFO:teuthology.orchestra.run.smithi016.stdout: "max_buckets": 1000, 2024-09-12T17:15:24.149 INFO:teuthology.orchestra.run.smithi016.stdout: "subusers": [], 2024-09-12T17:15:24.149 INFO:teuthology.orchestra.run.smithi016.stdout: "keys": [ 2024-09-12T17:15:24.149 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-12T17:15:24.149 INFO:teuthology.orchestra.run.smithi016.stdout: "user": "ragweed.client.0", 2024-09-12T17:15:24.149 INFO:teuthology.orchestra.run.smithi016.stdout: "access_key": "UAPVZTHPLBOMOHGESCNY", 2024-09-12T17:15:24.149 INFO:teuthology.orchestra.run.smithi016.stdout: "secret_key": "Hb9/XDV0ZOz9b581gsiBkUg9FjQjVuPyMnOBNY70ulWPTrkt2D/YnA==", 2024-09-12T17:15:24.149 INFO:teuthology.orchestra.run.smithi016.stdout: "active": true, 2024-09-12T17:15:24.149 INFO:teuthology.orchestra.run.smithi016.stdout: "create_date": "2024-09-12T17:15:24.135557Z" 2024-09-12T17:15:24.149 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-12T17:15:24.149 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-12T17:15:24.149 INFO:teuthology.orchestra.run.smithi016.stdout: "swift_keys": [], 2024-09-12T17:15:24.150 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": [], 2024-09-12T17:15:24.150 INFO:teuthology.orchestra.run.smithi016.stdout: "op_mask": "read, write, delete", 2024-09-12T17:15:24.150 INFO:teuthology.orchestra.run.smithi016.stdout: "default_placement": "", 2024-09-12T17:15:24.150 INFO:teuthology.orchestra.run.smithi016.stdout: "default_storage_class": "", 2024-09-12T17:15:24.150 INFO:teuthology.orchestra.run.smithi016.stdout: "placement_tags": [], 2024-09-12T17:15:24.150 INFO:teuthology.orchestra.run.smithi016.stdout: "bucket_quota": { 2024-09-12T17:15:24.150 INFO:teuthology.orchestra.run.smithi016.stdout: "enabled": false, 2024-09-12T17:15:24.150 INFO:teuthology.orchestra.run.smithi016.stdout: "check_on_raw": false, 2024-09-12T17:15:24.150 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size": -1, 2024-09-12T17:15:24.151 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size_kb": 0, 2024-09-12T17:15:24.151 INFO:teuthology.orchestra.run.smithi016.stdout: "max_objects": -1 2024-09-12T17:15:24.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-12T17:15:24.151 INFO:teuthology.orchestra.run.smithi016.stdout: "user_quota": { 2024-09-12T17:15:24.151 INFO:teuthology.orchestra.run.smithi016.stdout: "enabled": false, 2024-09-12T17:15:24.151 INFO:teuthology.orchestra.run.smithi016.stdout: "check_on_raw": false, 2024-09-12T17:15:24.151 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size": -1, 2024-09-12T17:15:24.151 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size_kb": 0, 2024-09-12T17:15:24.151 INFO:teuthology.orchestra.run.smithi016.stdout: "max_objects": -1 2024-09-12T17:15:24.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-12T17:15:24.151 INFO:teuthology.orchestra.run.smithi016.stdout: "temp_url_keys": [], 2024-09-12T17:15:24.151 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "rgw", 2024-09-12T17:15:24.151 INFO:teuthology.orchestra.run.smithi016.stdout: "mfa_ids": [], 2024-09-12T17:15:24.151 INFO:teuthology.orchestra.run.smithi016.stdout: "account_id": "", 2024-09-12T17:15:24.152 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-12T17:15:24.152 INFO:teuthology.orchestra.run.smithi016.stdout: "create_date": "2024-09-12T17:15:24.135503Z", 2024-09-12T17:15:24.152 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-12T17:15:24.152 INFO:teuthology.orchestra.run.smithi016.stdout: "group_ids": [] 2024-09-12T17:15:24.152 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-12T17:15:24.152 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:15:24.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.147+0000 7fb6457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:15:24.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.151+0000 7fb79109a9c0 20 remove_watcher() i=0 2024-09-12T17:15:24.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.151+0000 7fb79109a9c0 2 removed watcher, disabling cache 2024-09-12T17:15:24.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.155+0000 7fb79109a9c0 20 remove_watcher() i=1 2024-09-12T17:15:24.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.155+0000 7fb79109a9c0 20 remove_watcher() i=2 2024-09-12T17:15:24.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.159+0000 7fb79109a9c0 20 remove_watcher() i=3 2024-09-12T17:15:24.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.163+0000 7fb79109a9c0 20 remove_watcher() i=4 2024-09-12T17:15:24.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.163+0000 7fb79109a9c0 20 remove_watcher() i=5 2024-09-12T17:15:24.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.163+0000 7fb79109a9c0 20 remove_watcher() i=6 2024-09-12T17:15:24.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.167+0000 7fb79109a9c0 20 remove_watcher() i=7 2024-09-12T17:15:24.185 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-09-12T17:15:24.185 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key FLBDMDVYYKXZVVCNOYNS --secret QNSIL45fpu+TMzpxl+UVU4i196oPnQ2sQhd9Iqk/2NpelerHRnSDRQ== --email sysuser.client.0+test@test.test --system true 2024-09-12T17:15:24.233 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:15:24.233 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:15:24.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.271+0000 7f2d1fb269c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:24.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.479+0000 7f2d1fb269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:24.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.479+0000 7f2d1fb269c0 20 realm 2024-09-12T17:15:24.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.479+0000 7f2d1fb269c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:24.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.479+0000 7f2d1fb269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:24.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.479+0000 7f2d1fb269c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:15:24.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.479+0000 7f2d1fb269c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:24.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.479+0000 7f2d1fb269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:24.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.479+0000 7f2d1fb269c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:24.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.483+0000 7f2d1fb269c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:15:24.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.483+0000 7f2d1fb269c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:24.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.487+0000 7f2d1fb269c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:15:24.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.487+0000 7f2d1fb269c0 20 searching for the correct realm 2024-09-12T17:15:24.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.491+0000 7f2d1de2d640 0 -- 172.21.15.16:0/2199351324 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f2d14088020 msgr2=0x7f2d14080040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:15:24.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.707+0000 7f2d1ce2b640 0 -- 172.21.15.16:0/2199351324 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f2d18018040 msgr2=0x7f2d1808e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:15:24.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.927+0000 7f2d1fb269c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:15:24.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.927+0000 7f2d1fb269c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:15:24.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.927+0000 7f2d1fb269c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:15:24.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.927+0000 7f2d1fb269c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:15:24.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.927+0000 7f2d1fb269c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:15:24.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.927+0000 7f2d1fb269c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:15:24.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.927+0000 7f2d1fb269c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:24.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.927+0000 7f2d1fb269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:24.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.927+0000 7f2d1fb269c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:24.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.927+0000 7f2d1fb269c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:15:24.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.927+0000 7f2d1fb269c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:24.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.927+0000 7f2d1fb269c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:15:24.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.927+0000 7f2d1fb269c0 20 zone default found 2024-09-12T17:15:24.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.927+0000 7f2d1fb269c0 4 Realm: () 2024-09-12T17:15:24.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.927+0000 7f2d1fb269c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:15:24.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.927+0000 7f2d1fb269c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:15:24.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.927+0000 7f2d1fb269c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:15:24.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.927+0000 7f2d1fb269c0 20 zonegroup default 2024-09-12T17:15:24.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.927+0000 7f2d1fb269c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:24.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.927+0000 7f2d1fb269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:24.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.927+0000 7f2d1fb269c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:24.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.931+0000 7f2d1fb269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:24.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.931+0000 7f2d1fb269c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:24.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.931+0000 7f2d1fb269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:24.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.931+0000 7f2d1fb269c0 20 started sync module instance, tier type = 2024-09-12T17:15:24.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.931+0000 7f2d1fb269c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:15:24.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.955+0000 7f2d1fb269c0 20 add_watcher() i=0 2024-09-12T17:15:24.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.955+0000 7f2d1fb269c0 20 add_watcher() i=1 2024-09-12T17:15:24.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.955+0000 7f2d1fb269c0 20 add_watcher() i=2 2024-09-12T17:15:24.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.955+0000 7f2d1fb269c0 20 add_watcher() i=3 2024-09-12T17:15:24.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.955+0000 7f2d1fb269c0 20 add_watcher() i=4 2024-09-12T17:15:24.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.955+0000 7f2d1fb269c0 20 add_watcher() i=5 2024-09-12T17:15:24.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.955+0000 7f2d1fb269c0 20 add_watcher() i=6 2024-09-12T17:15:24.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.959+0000 7f2d1fb269c0 20 add_watcher() i=7 2024-09-12T17:15:24.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.959+0000 7f2d1fb269c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:15:24.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.963+0000 7f2bd37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:15:24.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.963+0000 7f2d1fb269c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:15:24.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.963+0000 7f2d1fb269c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:15:24.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.963+0000 7f2d1fb269c0 5 note: GC not initialized 2024-09-12T17:15:24.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.963+0000 7f2bd27e4640 20 reqs_thread_entry: start 2024-09-12T17:15:24.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.963+0000 7f2d1fb269c0 20 init_complete bucket index max shards: 1 2024-09-12T17:15:24.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.963+0000 7f2d1fb269c0 20 Filter name: none 2024-09-12T17:15:24.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.963+0000 7f2b43fff640 20 reqs_thread_entry: start 2024-09-12T17:15:24.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.963+0000 7f2d1fb269c0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T17:15:24.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.963+0000 7f2d1fb269c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:24.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.963+0000 7f2d1fb269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:24.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.963+0000 7f2d1fb269c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-09-12T17:15:24.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.963+0000 7f2d1fb269c0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T17:15:24.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.963+0000 7f2d1fb269c0 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-09-12T17:15:24.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.963+0000 7f2d1fb269c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:24.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.963+0000 7f2d1fb269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:24.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.963+0000 7f2d1fb269c0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-09-12T17:15:24.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.963+0000 7f2d1fb269c0 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T17:15:24.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.963+0000 7f2d1fb269c0 10 cache get: name=default.rgw.meta+users.keys+FLBDMDVYYKXZVVCNOYNS : miss 2024-09-12T17:15:24.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.963+0000 7f2d1fb269c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:24.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.967+0000 7f2d1fb269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:24.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.967+0000 7f2d1fb269c0 10 cache put: name=default.rgw.meta+users.keys+FLBDMDVYYKXZVVCNOYNS info.flags=0x0 2024-09-12T17:15:24.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.967+0000 7f2d1fb269c0 10 adding default.rgw.meta+users.keys+FLBDMDVYYKXZVVCNOYNS to cache LRU end 2024-09-12T17:15:24.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.967+0000 7f2d1fb269c0 10 cache get: name=default.rgw.meta+users.keys+FLBDMDVYYKXZVVCNOYNS : hit (negative entry) 2024-09-12T17:15:24.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.967+0000 7f2d1fb269c0 10 cache get: name=default.rgw.meta+users.keys+FLBDMDVYYKXZVVCNOYNS : hit (negative entry) 2024-09-12T17:15:24.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.967+0000 7f2d1fb269c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T17:15:24.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.967+0000 7f2d1fb269c0 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T17:15:24.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.967+0000 7f2d1fb269c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T17:15:24.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.971+0000 7f2c00ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693199 cookie 93982462856512 notifier 5663 bl.length()=675 2024-09-12T17:15:24.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.971+0000 7f2c00ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T17:15:24.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.971+0000 7f2c00ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T17:15:24.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.975+0000 7f2d1fb269c0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T17:15:24.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.975+0000 7f2d1fb269c0 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T17:15:24.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.975+0000 7f2d1fb269c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T17:15:24.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.975+0000 7f2c00ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693207 cookie 93982462864912 notifier 5663 bl.length()=202 2024-09-12T17:15:24.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.975+0000 7f2c00ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T17:15:24.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.975+0000 7f2c00ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T17:15:24.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.979+0000 7f2d1fb269c0 10 cache put: name=default.rgw.meta+users.keys+FLBDMDVYYKXZVVCNOYNS info.flags=0x7 2024-09-12T17:15:24.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.979+0000 7f2d1fb269c0 10 moving default.rgw.meta+users.keys+FLBDMDVYYKXZVVCNOYNS to cache LRU end 2024-09-12T17:15:24.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.979+0000 7f2d1fb269c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:FLBDMDVYYKXZVVCNOYNS, ofs0, ns] 2024-09-12T17:15:24.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.979+0000 7f2beffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693208 cookie 93982462850864 notifier 5663 bl.length()=190 2024-09-12T17:15:24.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.979+0000 7f2beffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+FLBDMDVYYKXZVVCNOYNS info.flags=0x7 2024-09-12T17:15:24.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.979+0000 7f2beffff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+FLBDMDVYYKXZVVCNOYNS to cache LRU end 2024-09-12T17:15:24.983 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-12T17:15:24.984 INFO:teuthology.orchestra.run.smithi016.stdout: "user_id": "sysuser.client.0", 2024-09-12T17:15:24.984 INFO:teuthology.orchestra.run.smithi016.stdout: "display_name": "Mr. sysuser.client.0", 2024-09-12T17:15:24.984 INFO:teuthology.orchestra.run.smithi016.stdout: "email": "sysuser.client.0+test@test.test", 2024-09-12T17:15:24.984 INFO:teuthology.orchestra.run.smithi016.stdout: "suspended": 0, 2024-09-12T17:15:24.984 INFO:teuthology.orchestra.run.smithi016.stdout: "max_buckets": 1000, 2024-09-12T17:15:24.984 INFO:teuthology.orchestra.run.smithi016.stdout: "subusers": [], 2024-09-12T17:15:24.984 INFO:teuthology.orchestra.run.smithi016.stdout: "keys": [ 2024-09-12T17:15:24.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-12T17:15:24.984 INFO:teuthology.orchestra.run.smithi016.stdout: "user": "sysuser.client.0", 2024-09-12T17:15:24.985 INFO:teuthology.orchestra.run.smithi016.stdout: "access_key": "FLBDMDVYYKXZVVCNOYNS", 2024-09-12T17:15:24.985 INFO:teuthology.orchestra.run.smithi016.stdout: "secret_key": "QNSIL45fpu+TMzpxl+UVU4i196oPnQ2sQhd9Iqk/2NpelerHRnSDRQ==", 2024-09-12T17:15:24.985 INFO:teuthology.orchestra.run.smithi016.stdout: "active": true, 2024-09-12T17:15:24.985 INFO:teuthology.orchestra.run.smithi016.stdout: "create_date": "2024-09-12T17:15:24.971172Z" 2024-09-12T17:15:24.985 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-12T17:15:24.985 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-12T17:15:24.985 INFO:teuthology.orchestra.run.smithi016.stdout: "swift_keys": [], 2024-09-12T17:15:24.985 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": [], 2024-09-12T17:15:24.985 INFO:teuthology.orchestra.run.smithi016.stdout: "op_mask": "read, write, delete", 2024-09-12T17:15:24.985 INFO:teuthology.orchestra.run.smithi016.stdout: "system": true, 2024-09-12T17:15:24.985 INFO:teuthology.orchestra.run.smithi016.stdout: "default_placement": "", 2024-09-12T17:15:24.985 INFO:teuthology.orchestra.run.smithi016.stdout: "default_storage_class": "", 2024-09-12T17:15:24.985 INFO:teuthology.orchestra.run.smithi016.stdout: "placement_tags": [], 2024-09-12T17:15:24.986 INFO:teuthology.orchestra.run.smithi016.stdout: "bucket_quota": { 2024-09-12T17:15:24.986 INFO:teuthology.orchestra.run.smithi016.stdout: "enabled": false, 2024-09-12T17:15:24.986 INFO:teuthology.orchestra.run.smithi016.stdout: "check_on_raw": false, 2024-09-12T17:15:24.986 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size": -1, 2024-09-12T17:15:24.986 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size_kb": 0, 2024-09-12T17:15:24.986 INFO:teuthology.orchestra.run.smithi016.stdout: "max_objects": -1 2024-09-12T17:15:24.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-12T17:15:24.986 INFO:teuthology.orchestra.run.smithi016.stdout: "user_quota": { 2024-09-12T17:15:24.986 INFO:teuthology.orchestra.run.smithi016.stdout: "enabled": false, 2024-09-12T17:15:24.986 INFO:teuthology.orchestra.run.smithi016.stdout: "check_on_raw": false, 2024-09-12T17:15:24.986 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size": -1, 2024-09-12T17:15:24.986 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size_kb": 0, 2024-09-12T17:15:24.986 INFO:teuthology.orchestra.run.smithi016.stdout: "max_objects": -1 2024-09-12T17:15:24.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-12T17:15:24.987 INFO:teuthology.orchestra.run.smithi016.stdout: "temp_url_keys": [], 2024-09-12T17:15:24.987 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "rgw", 2024-09-12T17:15:24.987 INFO:teuthology.orchestra.run.smithi016.stdout: "mfa_ids": [], 2024-09-12T17:15:24.987 INFO:teuthology.orchestra.run.smithi016.stdout: "account_id": "", 2024-09-12T17:15:24.987 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-12T17:15:24.987 INFO:teuthology.orchestra.run.smithi016.stdout: "create_date": "2024-09-12T17:15:24.971140Z", 2024-09-12T17:15:24.987 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-12T17:15:24.987 INFO:teuthology.orchestra.run.smithi016.stdout: "group_ids": [] 2024-09-12T17:15:24.987 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-12T17:15:24.987 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:15:24.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.983+0000 7f2bd37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:15:24.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.987+0000 7f2d1fb269c0 20 remove_watcher() i=0 2024-09-12T17:15:24.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.987+0000 7f2d1fb269c0 2 removed watcher, disabling cache 2024-09-12T17:15:24.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.991+0000 7f2d1fb269c0 20 remove_watcher() i=1 2024-09-12T17:15:24.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.991+0000 7f2d1fb269c0 20 remove_watcher() i=2 2024-09-12T17:15:24.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.995+0000 7f2d1fb269c0 20 remove_watcher() i=3 2024-09-12T17:15:25.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.995+0000 7f2d1fb269c0 20 remove_watcher() i=4 2024-09-12T17:15:25.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.999+0000 7f2d1fb269c0 20 remove_watcher() i=5 2024-09-12T17:15:25.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:24.999+0000 7f2d1fb269c0 20 remove_watcher() i=6 2024-09-12T17:15:25.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:25.003+0000 7f2d1fb269c0 20 remove_watcher() i=7 2024-09-12T17:15:25.023 INFO:tasks.ragweed:Configuring ragweed... 2024-09-12T17:15:25.023 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-12T17:15:25.023 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-09-12T17:15:25.029 INFO:tasks.ragweed:Configuring boto... 2024-09-12T17:15:25.030 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-12T17:15:25.030 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-09-12T17:15:25.077 DEBUG:teuthology.orchestra.run.smithi016:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-09-12T17:15:25.275 INFO:teuthology.orchestra.run.smithi016.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-09-12T17:15:25.456 INFO:teuthology.orchestra.run.smithi016.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-09-12T17:15:26.132 INFO:teuthology.orchestra.run.smithi016.stdout:py installdeps: -rrequirements.txt 2024-09-12T17:15:28.961 INFO:teuthology.orchestra.run.smithi016.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-09-12T17:15:33.600 INFO:teuthology.orchestra.run.smithi016.stdout:py installed: appdirs==1.4.4,asyncssh==2.5.0,attrs==21.2.0,Babel==2.8.0,bcrypt==3.2.0,beautifulsoup4==4.10.0,beniget==0.4.1,blinker==1.4,boto==2.49.0,Brotli==1.0.9,cachetools==5.0.0,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2020.6.20,chardet==4.0.0,cheroot==8.5.2+ds1,CherryPy==18.6.1,command-not-found==0.3,configobj==5.0.6,cryptography==3.4.8,cycler==0.11.0,dbus-python==1.2.18,decorator==4.4.2,distlib==0.3.4,distro==1.7.0,distro-info===1.1build1,docopt==0.6.2,execnet==1.9.0,filelock==3.6.0,fonttools==4.29.1,fs==2.4.12,gast==0.5.2,gevent==21.8.0,google-auth==1.5.1,greenlet==1.1.2,html5lib==1.1,httplib2==0.20.2,idna==3.3,importlib-metadata==4.6.4,iniconfig==1.1.1,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.4.0,jaraco.functools==3.4.0,jaraco.text==3.6.0,jeepney==0.7.1,Jinja2==3.0.3,joblib==0.17.0,keyring==23.5.0,kiwisolver==1.3.2,kubernetes==12.0.1,language-selector==0.1,launchpadlib==1.10.16,lazr.restfulclient==0.14.4,lazr.uri==1.0.6,logutils==0.3.3,lxml==4.8.0,lz4==3.1.3+dfsg,Mako==1.1.3,MarkupSafe==2.0.1,matplotlib==3.5.1,more-itertools==8.10.0,mpmath==0.0.0,munch==4.0.0,natsort==8.0.2,netifaces==0.11.0,nose==1.3.7,numpy==1.21.5,oauthlib==3.2.0,olefile==0.46,packaging==21.3,Paste==3.5.0,PasteDeploy==2.1.1,PasteScript==2.0.2,pecan==1.3.3,Pillow==9.0.1,platformdirs==2.5.1,pluggy==0.13.0,ply==3.11,portend==3.0.0,prettytable==2.5.0,psutil==5.9.0,py==1.10.0,pyasn1==0.4.8,pyasn1-modules==0.2.1,Pygments==2.11.2,PyGObject==3.42.1,pyinotify==0.9.6,PyJWT==2.3.0,pymacaroons==0.13.0,PyNaCl==1.5.0,pyOpenSSL==21.0.0,pyparsing==2.4.7,pytest==6.2.5,python-apt==2.3.0+ubuntu2.1,python-dateutil==2.8.1,python-magic==0.4.24,pythran==0.10.0,pytz==2022.1,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=a490dc6c320221a79aa9a68a9b25b24f98273a9669c02a0917c0bb0536d7b75c,rbd==2.0.0,registries-conf-ctl @ git+https://github.com/sebastian-philipp/registries-conf-ctl@0e9bf2dc202aa9be9b0bf8e8265aac3f2308f9db,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rsa==4.8,s3cmd==2.2.0,scikit-learn==0.23.2,scipy==1.8.0,SecretStorage==3.3.1,simplegeneric==0.8.1,simplejson==3.17.6,six==1.16.0,soupsieve==2.3.1,ssh-import-id==5.11,sympy==1.9,Tempita==0.5.2,tempora==4.1.2,threadpoolctl==3.1.0,toml==0.10.2,ubuntu-advantage-tools==27.12,ufoLib2==0.13.1,ufw==0.36.1,unattended-upgrades==0.1,unicodedata2==14.0.0,urllib3==1.26.5,virtualenv==20.13.0+ds,wadllib==1.3.6,waitress==1.4.4,wcwidth==0.2.5,webencodings==0.5.1,WebOb==1.8.6,websocket-client==1.2.3,WebTest==2.0.35,Werkzeug==2.0.2,zc.lockfile==2.0,zipp==1.0.0,zope.event==4.4,zope.interface==5.4.0 2024-09-12T17:15:33.600 INFO:teuthology.orchestra.run.smithi016.stdout:py run-test-pre: PYTHONHASHSEED='563942425' 2024-09-12T17:15:33.600 INFO:teuthology.orchestra.run.smithi016.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-09-12T17:15:33.781 INFO:teuthology.orchestra.run.smithi016.stdout:============================= test session starts ============================== 2024-09-12T17:15:33.782 INFO:teuthology.orchestra.run.smithi016.stdout:platform linux -- Python 3.10.6, pytest-6.2.5, py-1.10.0, pluggy-0.13.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-09-12T17:15:33.782 INFO:teuthology.orchestra.run.smithi016.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T17:15:33.782 INFO:teuthology.orchestra.run.smithi016.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0, configfile: pytest.ini 2024-09-12T17:15:33.943 INFO:teuthology.orchestra.run.smithi016.stdout:collecting ... collected 9 items 2024-09-12T17:15:33.943 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:15:34.766 INFO:teuthology.orchestra.run.smithi016.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-09-12T17:15:35.831 INFO:teuthology.orchestra.run.smithi016.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-09-12T17:15:36.661 INFO:teuthology.orchestra.run.smithi016.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-09-12T17:15:37.716 INFO:teuthology.orchestra.run.smithi016.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-09-12T17:15:38.811 INFO:teuthology.orchestra.run.smithi016.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-09-12T17:15:44.906 INFO:teuthology.orchestra.run.smithi016.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-09-12T17:15:47.120 INFO:teuthology.orchestra.run.smithi016.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-09-12T17:15:49.052 INFO:teuthology.orchestra.run.smithi016.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-09-12T17:15:52.503 INFO:teuthology.orchestra.run.smithi016.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-09-12T17:15:52.503 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:15:52.503 INFO:teuthology.orchestra.run.smithi016.stdout:=============================== warnings summary =============================== 2024-09-12T17:15:52.503 INFO:teuthology.orchestra.run.smithi016.stdout:.tox/py/lib/python3.10/site-packages/boto/plugin.py:40 2024-09-12T17:15:52.503 INFO:teuthology.orchestra.run.smithi016.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.10/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses 2024-09-12T17:15:52.503 INFO:teuthology.orchestra.run.smithi016.stdout: import imp 2024-09-12T17:15:52.503 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:15:52.503 INFO:teuthology.orchestra.run.smithi016.stdout:-- Docs: https://docs.pytest.org/en/stable/warnings.html 2024-09-12T17:15:52.503 INFO:teuthology.orchestra.run.smithi016.stdout:======================== 9 passed, 1 warning in 18.72s ========================= 2024-09-12T17:15:52.549 INFO:teuthology.orchestra.run.smithi016.stdout:___________________________________ summary ____________________________________ 2024-09-12T17:15:52.549 INFO:teuthology.orchestra.run.smithi016.stdout: py: commands succeeded 2024-09-12T17:15:52.550 INFO:teuthology.orchestra.run.smithi016.stdout: congratulations :) 2024-09-12T17:15:52.575 INFO:tasks.ragweed:Cleaning up boto... 2024-09-12T17:15:52.575 DEBUG:teuthology.orchestra.run.smithi016:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-09-12T17:15:52.581 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-09-12T17:15:52.662 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:15:52.662 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:15:52.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.702+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:52.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.702+0000 7f040f6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:52.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.702+0000 7f040f6199c0 20 realm 2024-09-12T17:15:52.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.702+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:52.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.702+0000 7f040f6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:52.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.702+0000 7f040f6199c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:15:52.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.702+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:52.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.702+0000 7f040f6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:52.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.702+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:52.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.706+0000 7f040f6199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:15:52.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.706+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:52.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.706+0000 7f040f6199c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:15:52.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.706+0000 7f040f6199c0 20 searching for the correct realm 2024-09-12T17:15:52.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.710+0000 7f040d920640 0 -- 172.21.15.16:0/1218014060 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f0404036070 msgr2=0x7f0404040750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:15:52.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.718+0000 7f040c91e640 0 -- 172.21.15.16:0/1218014060 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f04000cb070 msgr2=0x7f0400007cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:15:52.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.934+0000 7f040f6199c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:15:52.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.934+0000 7f040f6199c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:15:52.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.934+0000 7f040f6199c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:15:52.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.934+0000 7f040f6199c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:15:52.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.934+0000 7f040f6199c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:15:52.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.934+0000 7f040f6199c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:15:52.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.934+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:52.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.934+0000 7f040f6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:52.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.934+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:52.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.934+0000 7f040f6199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:15:52.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.934+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:52.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.938+0000 7f040f6199c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:15:52.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.938+0000 7f040f6199c0 20 zone default found 2024-09-12T17:15:52.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.938+0000 7f040f6199c0 4 Realm: () 2024-09-12T17:15:52.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.938+0000 7f040f6199c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:15:52.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.938+0000 7f040f6199c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:15:52.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.938+0000 7f040f6199c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:15:52.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.938+0000 7f040f6199c0 20 zonegroup default 2024-09-12T17:15:52.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.938+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:52.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.938+0000 7f040f6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:52.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.938+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:52.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.938+0000 7f040f6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:52.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.938+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:52.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.938+0000 7f040f6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:52.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.938+0000 7f040f6199c0 20 started sync module instance, tier type = 2024-09-12T17:15:52.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.938+0000 7f040f6199c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:15:52.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.962+0000 7f040f6199c0 20 add_watcher() i=0 2024-09-12T17:15:52.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.962+0000 7f040f6199c0 20 add_watcher() i=1 2024-09-12T17:15:52.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.962+0000 7f040f6199c0 20 add_watcher() i=2 2024-09-12T17:15:52.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.962+0000 7f040f6199c0 20 add_watcher() i=3 2024-09-12T17:15:52.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.962+0000 7f040f6199c0 20 add_watcher() i=4 2024-09-12T17:15:52.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.962+0000 7f040f6199c0 20 add_watcher() i=5 2024-09-12T17:15:52.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.962+0000 7f040f6199c0 20 add_watcher() i=6 2024-09-12T17:15:52.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.966+0000 7f040f6199c0 20 add_watcher() i=7 2024-09-12T17:15:52.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.966+0000 7f040f6199c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:15:52.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.970+0000 7f02c3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:15:52.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.970+0000 7f040f6199c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:15:52.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:52.970+0000 7f040f6199c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:15:53.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.066+0000 7f02c2fe5640 20 reqs_thread_entry: start 2024-09-12T17:15:53.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.066+0000 7f040f6199c0 20 init_complete bucket index max shards: 1 2024-09-12T17:15:53.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.066+0000 7f040f6199c0 20 Filter name: none 2024-09-12T17:15:53.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.066+0000 7f02c0fe1640 20 reqs_thread_entry: start 2024-09-12T17:15:53.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.066+0000 7f040f6199c0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T17:15:53.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.066+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:53.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.066+0000 7f040f6199c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T17:15:53.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.066+0000 7f040f6199c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-09-12T17:15:53.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.066+0000 7f040f6199c0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T17:15:53.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.066+0000 7f040f6199c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:15:53.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.070+0000 7f040f6199c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4 : miss 2024-09-12T17:15:53.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.070+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:53.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.070+0000 7f040f6199c0 20 rados_obj.operate() r=0 bl.length=426 2024-09-12T17:15:53.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.070+0000 7f040f6199c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4 info.flags=0x17 2024-09-12T17:15:53.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.070+0000 7f040f6199c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4 to cache LRU end 2024-09-12T17:15:53.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.070+0000 7f040f6199c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:15:53.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.070+0000 7f040f6199c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:15:53.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.070+0000 7f040f6199c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4 2024-09-12T17:15:53.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.070+0000 7f040f6199c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-09-12T17:15:53.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.070+0000 7f040f6199c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-09-12T17:15:53.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.070+0000 7f040f6199c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-09-12T17:15:53.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.070+0000 7f040f6199c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-09-12T17:15:53.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.070+0000 7f040f6199c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-09-12T17:15:53.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.070+0000 7f040f6199c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-09-12T17:15:53.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.070+0000 7f040f6199c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-09-12T17:15:53.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.070+0000 7f040f6199c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-09-12T17:15:53.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.070+0000 7f040f6199c0 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-09-12T17:15:53.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.070+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5180f0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55796f5ac9b8 s->prefetch_data=0 2024-09-12T17:15:53.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.070+0000 7f040f6199c0 10 manifest: total_size = 13070 2024-09-12T17:15:53.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.070+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1852825290008853792 2024-09-12T17:15:53.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.070+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5180f0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55796f5ac9b8 s->prefetch_data=0 2024-09-12T17:15:53.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.070+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5ac9b8 2024-09-12T17:15:53.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.070+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4.0 2024-09-12T17:15:53.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.078+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.078+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=13070 stripe_ofs=13070 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.078+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1852825290008853792 2024-09-12T17:15:53.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.078+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.078+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4__shadow_.OjOs3xsDCE01TcoK81hz7Gyj0eNQuaw_0 2024-09-12T17:15:53.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.078+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:15:53.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.078+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.078+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1852825290008853792 2024-09-12T17:15:53.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.082+0000 7f02f0ff9640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-09-12T17:15:53.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.082+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5180f0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55796f5ac4a8 s->prefetch_data=0 2024-09-12T17:15:53.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.082+0000 7f040f6199c0 10 manifest: total_size = 4974 2024-09-12T17:15:53.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.082+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9168035861511241454 2024-09-12T17:15:53.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.082+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5180f0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55796f5ac4a8 s->prefetch_data=0 2024-09-12T17:15:53.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.082+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5ac4a8 2024-09-12T17:15:53.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.082+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4.0 2024-09-12T17:15:53.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.086+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.086+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=4974 stripe_ofs=4974 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.086+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9168035861511241454 2024-09-12T17:15:53.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.086+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.086+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4__shadow_.OYgGr2tkLz6Zq04gAlbBReOcOstzJpR_0 2024-09-12T17:15:53.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.086+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:15:53.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.086+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.086+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9168035861511241454 2024-09-12T17:15:53.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.090+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5180f0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55796f5ac4a8 s->prefetch_data=0 2024-09-12T17:15:53.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.090+0000 7f02dffff640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-09-12T17:15:53.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.090+0000 7f040f6199c0 10 manifest: total_size = 7410 2024-09-12T17:15:53.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.090+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18385800555637969578 2024-09-12T17:15:53.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.090+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5180f0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55796f5ac4a8 s->prefetch_data=0 2024-09-12T17:15:53.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.090+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5ac4a8 2024-09-12T17:15:53.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.090+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4.0 2024-09-12T17:15:53.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.094+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.094+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=7410 stripe_ofs=7410 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.094+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18385800555637969578 2024-09-12T17:15:53.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.094+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.094+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4__shadow_.aWawq9jhJExKZgp9IgmVcPRGqAh7WLf_0 2024-09-12T17:15:53.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.094+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:15:53.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.094+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.094+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18385800555637969578 2024-09-12T17:15:53.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.098+0000 7f02f0ff9640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-09-12T17:15:53.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.098+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5180f0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55796f5ac4a8 s->prefetch_data=0 2024-09-12T17:15:53.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.102+0000 7f040f6199c0 10 manifest: total_size = 12812 2024-09-12T17:15:53.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.102+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15684031463923456818 2024-09-12T17:15:53.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.102+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5180f0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55796f5ac4a8 s->prefetch_data=0 2024-09-12T17:15:53.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.102+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5ac4a8 2024-09-12T17:15:53.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.102+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4.0 2024-09-12T17:15:53.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.106+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.106+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=12812 stripe_ofs=12812 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.106+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15684031463923456818 2024-09-12T17:15:53.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.106+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.106+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4__shadow_.dF4WGEOLPIkBA2_GwmmfofevS_m0Pcg_0 2024-09-12T17:15:53.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.106+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:15:53.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.106+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.106+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15684031463923456818 2024-09-12T17:15:53.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.106+0000 7f02dffff640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-09-12T17:15:53.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.106+0000 7f040f6199c0 20 get_obj_state: octx=0x7f0404094420 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55796f5ac4a8 s->prefetch_data=0 2024-09-12T17:15:53.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.106+0000 7f040f6199c0 10 manifest: total_size = 5222 2024-09-12T17:15:53.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.106+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13449270531802092370 2024-09-12T17:15:53.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.106+0000 7f040f6199c0 20 get_obj_state: octx=0x7f0404094420 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55796f5ac4a8 s->prefetch_data=0 2024-09-12T17:15:53.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.106+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5ac4a8 2024-09-12T17:15:53.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.106+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4.0 2024-09-12T17:15:53.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.114+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.114+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=5222 stripe_ofs=5222 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.114+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13449270531802092370 2024-09-12T17:15:53.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.114+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.114+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4__shadow_.n-VYIk04vBoMynIoYJB4cqu1zIS32hP_0 2024-09-12T17:15:53.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.114+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:15:53.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.114+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.114+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13449270531802092370 2024-09-12T17:15:53.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.118+0000 7f02f0ff9640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-09-12T17:15:53.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.118+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5ad670 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55796f5ac4a8 s->prefetch_data=0 2024-09-12T17:15:53.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.118+0000 7f040f6199c0 10 manifest: total_size = 5283 2024-09-12T17:15:53.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.118+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3809414696627365214 2024-09-12T17:15:53.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.118+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5ad670 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55796f5ac4a8 s->prefetch_data=0 2024-09-12T17:15:53.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.118+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5ac4a8 2024-09-12T17:15:53.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.118+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4.0 2024-09-12T17:15:53.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.122+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.122+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=5283 stripe_ofs=5283 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.122+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3809414696627365214 2024-09-12T17:15:53.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.122+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.122+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4__shadow_.a02GljzmJnmfjj0vCADyowEVxkI75HC_0 2024-09-12T17:15:53.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.122+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:15:53.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.122+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.122+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3809414696627365214 2024-09-12T17:15:53.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.126+0000 7f02dffff640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-09-12T17:15:53.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.126+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5ad670 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55796f5ac4a8 s->prefetch_data=0 2024-09-12T17:15:53.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.126+0000 7f040f6199c0 10 manifest: total_size = 7810 2024-09-12T17:15:53.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.126+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6498210937822074028 2024-09-12T17:15:53.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.126+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5ad670 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55796f5ac4a8 s->prefetch_data=0 2024-09-12T17:15:53.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.126+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5ac4a8 2024-09-12T17:15:53.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.126+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4.0 2024-09-12T17:15:53.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.134+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.134+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=7810 stripe_ofs=7810 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.134+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6498210937822074028 2024-09-12T17:15:53.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.134+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.134+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4__shadow_.eQ01vGBJcC653pdQuMFuzeZI-JQ_uOv_0 2024-09-12T17:15:53.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.134+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:15:53.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.134+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.134+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6498210937822074028 2024-09-12T17:15:53.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.134+0000 7f02f0ff9640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-09-12T17:15:53.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.138+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5a86d0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55796f5ac4a8 s->prefetch_data=0 2024-09-12T17:15:53.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.138+0000 7f040f6199c0 10 manifest: total_size = 7742 2024-09-12T17:15:53.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.138+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7927202697257783231 2024-09-12T17:15:53.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.138+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5a86d0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55796f5ac4a8 s->prefetch_data=0 2024-09-12T17:15:53.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.138+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5ac4a8 2024-09-12T17:15:53.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.138+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4.0 2024-09-12T17:15:53.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.142+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.142+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=7742 stripe_ofs=7742 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.142+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7927202697257783231 2024-09-12T17:15:53.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.142+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.142+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4__shadow_.-aAnzc_Ypzh1a6QDcoW35-p_LtB54Gr_0 2024-09-12T17:15:53.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.142+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:15:53.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.142+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.142+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7927202697257783231 2024-09-12T17:15:53.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.142+0000 7f02dffff640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-09-12T17:15:53.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.146+0000 7f040f6199c0 20 get_obj_state: octx=0x7f04080584a0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55796f5ac4a8 s->prefetch_data=0 2024-09-12T17:15:53.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.146+0000 7f040f6199c0 10 manifest: total_size = 8743 2024-09-12T17:15:53.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.146+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7203141660467888329 2024-09-12T17:15:53.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.146+0000 7f040f6199c0 20 get_obj_state: octx=0x7f04080584a0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55796f5ac4a8 s->prefetch_data=0 2024-09-12T17:15:53.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.146+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5ac4a8 2024-09-12T17:15:53.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.146+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4.0 2024-09-12T17:15:53.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.150+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.150+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=8743 stripe_ofs=8743 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.150+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7203141660467888329 2024-09-12T17:15:53.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.150+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.150+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4__shadow_._JqhpD1Rwlk51QB61IcrRsZc22T5Ovm_0 2024-09-12T17:15:53.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.150+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:15:53.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.150+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.150+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7203141660467888329 2024-09-12T17:15:53.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.154+0000 7f02f0ff9640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-09-12T17:15:53.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.154+0000 7f040f6199c0 20 list_objects_ordered: starting attempt 1 2024-09-12T17:15:53.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.154+0000 7f040f6199c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T17:15:53.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.154+0000 7f040f6199c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:15:53.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.154+0000 7f040f6199c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:15:53.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.154+0000 7f040f6199c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:15:53.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.154+0000 7f040f6199c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:15:53.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.154+0000 7f040f6199c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4])"; uploads.size()=0; is_truncated=0 2024-09-12T17:15:53.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.158+0000 7f040f6199c0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-09-12T17:15:53.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.158+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:53.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.158+0000 7f040f6199c0 20 rados_obj.operate() r=0 bl.length=204 2024-09-12T17:15:53.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.158+0000 7f040f6199c0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-09-12T17:15:53.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.158+0000 7f040f6199c0 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-09-12T17:15:53.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.162+0000 7f040f6199c0 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-09-12T17:15:53.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.162+0000 7f040f6199c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-09-12T17:15:53.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.162+0000 7f02dffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496992 cookie 93980047412432 notifier 5913 bl.length()=162 2024-09-12T17:15:53.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.166+0000 7f040f6199c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4 from cache 2024-09-12T17:15:53.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.166+0000 7f040f6199c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4, ofs0, ns] 2024-09-12T17:15:53.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.166+0000 7f02f0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496993 cookie 93980047412432 notifier 5913 bl.length()=219 2024-09-12T17:15:53.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.170+0000 7f040f6199c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4 : miss 2024-09-12T17:15:53.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.170+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:53.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.170+0000 7f040f6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:53.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.170+0000 7f040f6199c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4 info.flags=0x0 2024-09-12T17:15:53.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.170+0000 7f040f6199c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4 to cache LRU end 2024-09-12T17:15:53.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.178+0000 7f040f6199c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11 : miss 2024-09-12T17:15:53.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.178+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:53.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.178+0000 7f040f6199c0 20 rados_obj.operate() r=0 bl.length=457 2024-09-12T17:15:53.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.178+0000 7f040f6199c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11 info.flags=0x17 2024-09-12T17:15:53.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.178+0000 7f040f6199c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11 to cache LRU end 2024-09-12T17:15:53.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.178+0000 7f040f6199c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:15:53.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.178+0000 7f040f6199c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:15:53.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.178+0000 7f040f6199c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11 2024-09-12T17:15:53.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.178+0000 7f040f6199c0 10 cls_bucket_list_unordered: got foo 2024-09-12T17:15:53.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.178+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5aba10 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55796f5abef8 s->prefetch_data=0 2024-09-12T17:15:53.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.178+0000 7f040f6199c0 10 manifest: total_size = 18874368 2024-09-12T17:15:53.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.178+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.685641654530745675 2024-09-12T17:15:53.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.178+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5aba10 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55796f5abef8 s->prefetch_data=0 2024-09-12T17:15:53.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.178+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5abef8 2024-09-12T17:15:53.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.182+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11.0 2024-09-12T17:15:53.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.186+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:15:53.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.186+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:15:53.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.186+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:15:53.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.186+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:15:53.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.186+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T17:15:53.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.186+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:15:53.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.186+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:15:53.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.186+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:15:53.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.186+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:15:53.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.186+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:15:53.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.186+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:15:53.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.186+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2024-09-12T17:15:53.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.186+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:15:53.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.186+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=5242880 2024-09-12T17:15:53.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.186+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=14680064 stripe_ofs=14680064 part_ofs=10485760 rule->part_size=5242880 2024-09-12T17:15:53.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.186+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:15:53.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.186+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=18874368 part_ofs=10485760 rule->part_size=5242880 2024-09-12T17:15:53.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.186+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2024-09-12T17:15:53.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.186+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2024-09-12T17:15:53.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.186+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=19922944 part_ofs=15728640 rule->part_size=3145728 2024-09-12T17:15:53.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.186+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2024-09-12T17:15:53.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.186+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.685641654530745675 2024-09-12T17:15:53.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.186+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.186+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11__multipart_foo.2~XlrIrIScTl2tZbJxmdGdEq-Viu3jvgw.1 2024-09-12T17:15:53.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.186+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 345 2024-09-12T17:15:53.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.186+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11__shadow_foo.2~XlrIrIScTl2tZbJxmdGdEq-Viu3jvgw.1_1 2024-09-12T17:15:53.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.186+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 589 2024-09-12T17:15:53.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.186+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11__multipart_foo.2~XlrIrIScTl2tZbJxmdGdEq-Viu3jvgw.2 2024-09-12T17:15:53.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.186+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 835 2024-09-12T17:15:53.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.186+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11__shadow_foo.2~XlrIrIScTl2tZbJxmdGdEq-Viu3jvgw.2_1 2024-09-12T17:15:53.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.186+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1079 2024-09-12T17:15:53.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.186+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11__multipart_foo.2~XlrIrIScTl2tZbJxmdGdEq-Viu3jvgw.3 2024-09-12T17:15:53.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.186+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1325 2024-09-12T17:15:53.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.186+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11__shadow_foo.2~XlrIrIScTl2tZbJxmdGdEq-Viu3jvgw.3_1 2024-09-12T17:15:53.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.186+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1569 2024-09-12T17:15:53.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.186+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11__multipart_foo.2~XlrIrIScTl2tZbJxmdGdEq-Viu3jvgw.4 2024-09-12T17:15:53.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.186+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1815 2024-09-12T17:15:53.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.186+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.186+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.685641654530745675 2024-09-12T17:15:53.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.190+0000 7f02f0ff9640 20 handle_completion(): completion ok for obj=foo 2024-09-12T17:15:53.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.190+0000 7f040f6199c0 20 list_objects_ordered: starting attempt 1 2024-09-12T17:15:53.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.190+0000 7f040f6199c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T17:15:53.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.190+0000 7f040f6199c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:15:53.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.190+0000 7f040f6199c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:15:53.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.190+0000 7f040f6199c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:15:53.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.190+0000 7f040f6199c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:15:53.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.190+0000 7f040f6199c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11])"; uploads.size()=0; is_truncated=0 2024-09-12T17:15:53.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.194+0000 7f040f6199c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-09-12T17:15:53.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.194+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:53.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.194+0000 7f040f6199c0 20 rados_obj.operate() r=0 bl.length=235 2024-09-12T17:15:53.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.194+0000 7f040f6199c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-09-12T17:15:53.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.194+0000 7f040f6199c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-09-12T17:15:53.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.202+0000 7f040f6199c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-09-12T17:15:53.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.202+0000 7f040f6199c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-09-12T17:15:53.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.202+0000 7f02dffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497058 cookie 93980047410496 notifier 5913 bl.length()=191 2024-09-12T17:15:53.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.206+0000 7f040f6199c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11 from cache 2024-09-12T17:15:53.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.206+0000 7f040f6199c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11, ofs0, ns] 2024-09-12T17:15:53.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.206+0000 7f02dffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496981 cookie 93980047418048 notifier 5913 bl.length()=249 2024-09-12T17:15:53.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.210+0000 7f040f6199c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11 : miss 2024-09-12T17:15:53.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.210+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:53.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.210+0000 7f040f6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:53.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.210+0000 7f040f6199c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11 info.flags=0x0 2024-09-12T17:15:53.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.210+0000 7f040f6199c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11 to cache LRU end 2024-09-12T17:15:53.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.214+0000 7f040f6199c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12 : miss 2024-09-12T17:15:53.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.214+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:53.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.214+0000 7f040f6199c0 20 rados_obj.operate() r=0 bl.length=464 2024-09-12T17:15:53.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.214+0000 7f040f6199c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12 info.flags=0x17 2024-09-12T17:15:53.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.214+0000 7f040f6199c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12 to cache LRU end 2024-09-12T17:15:53.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.214+0000 7f040f6199c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:15:53.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.214+0000 7f040f6199c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:15:53.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.214+0000 7f040f6199c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12 2024-09-12T17:15:53.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.214+0000 7f040f6199c0 10 cls_bucket_list_unordered: got foo 2024-09-12T17:15:53.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.214+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5b27b0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.214+0000 7f040f6199c0 10 manifest: total_size = 26080 2024-09-12T17:15:53.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.214+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8254609845389550162 2024-09-12T17:15:53.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.214+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5b27b0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.214+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5aa938 2024-09-12T17:15:53.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.214+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12.0 2024-09-12T17:15:53.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.222+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=4 2024-09-12T17:15:53.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.222+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=7672 2024-09-12T17:15:53.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.222+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=7672 stripe_ofs=7672 part_ofs=7672 rule->part_size=7670 2024-09-12T17:15:53.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.222+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=4 2024-09-12T17:15:53.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.222+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=4201976 part_ofs=7672 rule->part_size=7670 2024-09-12T17:15:53.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.222+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=15342 stripe_ofs=15342 part_ofs=15342 rule->part_size=7671 2024-09-12T17:15:53.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.222+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=4 2024-09-12T17:15:53.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.222+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=4209646 part_ofs=15342 rule->part_size=7671 2024-09-12T17:15:53.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.222+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=23013 stripe_ofs=23013 part_ofs=23013 rule->part_size=3067 2024-09-12T17:15:53.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.222+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=4 2024-09-12T17:15:53.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.222+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=4217317 part_ofs=23013 rule->part_size=3067 2024-09-12T17:15:53.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.222+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=26080 stripe_ofs=26080 part_ofs=26080 rule->part_size=3067 2024-09-12T17:15:53.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.222+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8254609845389550162 2024-09-12T17:15:53.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.222+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.222+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12__multipart_foo.2~6jI0yQTY73MqvLSr7XTATmJ_oy_BhQq.1 2024-09-12T17:15:53.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.222+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-12T17:15:53.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.222+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12__multipart_foo.2~6jI0yQTY73MqvLSr7XTATmJ_oy_BhQq.2 2024-09-12T17:15:53.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.222+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-12T17:15:53.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.222+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12__multipart_foo.2~6jI0yQTY73MqvLSr7XTATmJ_oy_BhQq.3 2024-09-12T17:15:53.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.222+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-12T17:15:53.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.222+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12__multipart_foo.2~6jI0yQTY73MqvLSr7XTATmJ_oy_BhQq.4 2024-09-12T17:15:53.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.222+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-12T17:15:53.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.222+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.222+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8254609845389550162 2024-09-12T17:15:53.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.222+0000 7f02dffff640 20 handle_completion(): completion ok for obj=foo 2024-09-12T17:15:53.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.230+0000 7f040f6199c0 20 list_objects_ordered: starting attempt 1 2024-09-12T17:15:53.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.230+0000 7f040f6199c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T17:15:53.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.230+0000 7f040f6199c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:15:53.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.230+0000 7f040f6199c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:15:53.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.230+0000 7f040f6199c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:15:53.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.230+0000 7f040f6199c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:15:53.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.230+0000 7f040f6199c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12])"; uploads.size()=0; is_truncated=0 2024-09-12T17:15:53.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.230+0000 7f040f6199c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-09-12T17:15:53.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.230+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:53.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.230+0000 7f040f6199c0 20 rados_obj.operate() r=0 bl.length=242 2024-09-12T17:15:53.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.230+0000 7f040f6199c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-09-12T17:15:53.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.230+0000 7f040f6199c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-09-12T17:15:53.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.234+0000 7f040f6199c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-09-12T17:15:53.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.234+0000 7f040f6199c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-09-12T17:15:53.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.234+0000 7f02f0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496982 cookie 93980047418048 notifier 5913 bl.length()=198 2024-09-12T17:15:53.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.238+0000 7f040f6199c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12 from cache 2024-09-12T17:15:53.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.238+0000 7f040f6199c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12, ofs0, ns] 2024-09-12T17:15:53.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.242+0000 7f02dffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496966 cookie 93980047430496 notifier 5913 bl.length()=256 2024-09-12T17:15:53.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.242+0000 7f040f6199c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12 : miss 2024-09-12T17:15:53.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.242+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:53.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.242+0000 7f040f6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:53.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.242+0000 7f040f6199c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12 info.flags=0x0 2024-09-12T17:15:53.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.242+0000 7f040f6199c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12 to cache LRU end 2024-09-12T17:15:53.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.250+0000 7f040f6199c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10 : miss 2024-09-12T17:15:53.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.250+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:53.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.250+0000 7f040f6199c0 20 rados_obj.operate() r=0 bl.length=459 2024-09-12T17:15:53.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.250+0000 7f040f6199c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10 info.flags=0x17 2024-09-12T17:15:53.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.250+0000 7f040f6199c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10 to cache LRU end 2024-09-12T17:15:53.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.250+0000 7f040f6199c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:15:53.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.250+0000 7f040f6199c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:15:53.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.250+0000 7f040f6199c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10 2024-09-12T17:15:53.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.250+0000 7f040f6199c0 10 cls_bucket_list_unordered: got foo[abbF9l0rlhqpm8mI0S.OUlTDsJNNm-r] 2024-09-12T17:15:53.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.250+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10.0 2024-09-12T17:15:53.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.254+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5829a0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.254+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to zxi4b2oo9la0t2y8j7k1412efyshemsx 2024-09-12T17:15:53.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.254+0000 7f040f6199c0 20 get_obj_state_impl: setting s->olh_tag to pdnijox557apumdxmnv5v8wqruu3tgly 2024-09-12T17:15:53.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.254+0000 7f040f6199c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=pdnijox557apumdxmnv5v8wqruu3tgly 2024-09-12T17:15:53.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.258+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10.0 2024-09-12T17:15:53.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.266+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10.0 2024-09-12T17:15:53.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.266+0000 7f040f6199c0 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-09-12T17:15:53.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.266+0000 7f040f6199c0 20 olh_log_entry: epoch=3 op=3 key=foo[abbF9l0rlhqpm8mI0S.OUlTDsJNNm-r] 2024-09-12T17:15:53.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.266+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5829a0 obj=test-client.0-r-test-multipart-index-versioning.1:_:abbF9l0rlhqpm8mI0S.OUlTDsJNNm-r_foo state=0x55796f5beb08 s->prefetch_data=0 2024-09-12T17:15:53.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.266+0000 7f040f6199c0 10 manifest: total_size = 18874368 2024-09-12T17:15:53.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.266+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14820083171041765646 2024-09-12T17:15:53.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.266+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5829a0 obj=test-client.0-r-test-multipart-index-versioning.1:_:abbF9l0rlhqpm8mI0S.OUlTDsJNNm-r_foo state=0x55796f5beb08 s->prefetch_data=0 2024-09-12T17:15:53.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.266+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5beb08 2024-09-12T17:15:53.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.266+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10.0 2024-09-12T17:15:53.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.270+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:15:53.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.270+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:15:53.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.270+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:15:53.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.270+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:15:53.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.270+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T17:15:53.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.270+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:15:53.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.270+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:15:53.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.270+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:15:53.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.270+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:15:53.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.270+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:15:53.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.270+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:15:53.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.270+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2024-09-12T17:15:53.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.270+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:15:53.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.270+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=5242880 2024-09-12T17:15:53.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.270+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=14680064 stripe_ofs=14680064 part_ofs=10485760 rule->part_size=5242880 2024-09-12T17:15:53.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.270+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:15:53.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.270+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=18874368 part_ofs=10485760 rule->part_size=5242880 2024-09-12T17:15:53.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.270+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2024-09-12T17:15:53.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.270+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2024-09-12T17:15:53.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.270+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=19922944 part_ofs=15728640 rule->part_size=3145728 2024-09-12T17:15:53.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.270+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2024-09-12T17:15:53.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.270+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14820083171041765646 2024-09-12T17:15:53.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.270+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.270+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10__multipart_foo.2~Zl9iCHbLxZkDMl19wv0gwN3yUOpjNg-.1 2024-09-12T17:15:53.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.270+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-12T17:15:53.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.270+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10__shadow_foo.2~Zl9iCHbLxZkDMl19wv0gwN3yUOpjNg-.1_1 2024-09-12T17:15:53.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.270+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 591 2024-09-12T17:15:53.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.270+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10__multipart_foo.2~Zl9iCHbLxZkDMl19wv0gwN3yUOpjNg-.2 2024-09-12T17:15:53.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.270+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 837 2024-09-12T17:15:53.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.270+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10__shadow_foo.2~Zl9iCHbLxZkDMl19wv0gwN3yUOpjNg-.2_1 2024-09-12T17:15:53.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.270+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1081 2024-09-12T17:15:53.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.270+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10__multipart_foo.2~Zl9iCHbLxZkDMl19wv0gwN3yUOpjNg-.3 2024-09-12T17:15:53.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.270+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1327 2024-09-12T17:15:53.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.270+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10__shadow_foo.2~Zl9iCHbLxZkDMl19wv0gwN3yUOpjNg-.3_1 2024-09-12T17:15:53.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.270+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1571 2024-09-12T17:15:53.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.270+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10__multipart_foo.2~Zl9iCHbLxZkDMl19wv0gwN3yUOpjNg-.4 2024-09-12T17:15:53.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.270+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1817 2024-09-12T17:15:53.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.270+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.270+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14820083171041765646 2024-09-12T17:15:53.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.270+0000 7f02dffff640 20 handle_completion(): completion ok for obj=foo[abbF9l0rlhqpm8mI0S.OUlTDsJNNm-r] 2024-09-12T17:15:53.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.274+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5829a0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.278+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10.0 2024-09-12T17:15:53.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.286+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10.0 2024-09-12T17:15:53.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.286+0000 7f040f6199c0 20 list_objects_ordered: starting attempt 1 2024-09-12T17:15:53.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.286+0000 7f040f6199c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T17:15:53.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.286+0000 7f040f6199c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:15:53.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.286+0000 7f040f6199c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:15:53.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.286+0000 7f040f6199c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:15:53.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.286+0000 7f040f6199c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:15:53.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.286+0000 7f040f6199c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10])"; uploads.size()=0; is_truncated=0 2024-09-12T17:15:53.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.290+0000 7f040f6199c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-09-12T17:15:53.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.290+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:53.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.290+0000 7f040f6199c0 20 rados_obj.operate() r=0 bl.length=237 2024-09-12T17:15:53.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.290+0000 7f040f6199c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-09-12T17:15:53.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.290+0000 7f040f6199c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-09-12T17:15:53.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.290+0000 7f040f6199c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-09-12T17:15:53.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.290+0000 7f040f6199c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-09-12T17:15:53.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.290+0000 7f02f0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496983 cookie 93980047418048 notifier 5913 bl.length()=193 2024-09-12T17:15:53.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.294+0000 7f02f0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496984 cookie 93980047418048 notifier 5913 bl.length()=193 2024-09-12T17:15:53.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.298+0000 7f040f6199c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10 from cache 2024-09-12T17:15:53.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.298+0000 7f040f6199c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10, ofs0, ns] 2024-09-12T17:15:53.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.302+0000 7f02f0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496978 cookie 93980047427312 notifier 5913 bl.length()=251 2024-09-12T17:15:53.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.306+0000 7f040f6199c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10 : miss 2024-09-12T17:15:53.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.306+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:53.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.306+0000 7f040f6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:53.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.306+0000 7f040f6199c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10 info.flags=0x0 2024-09-12T17:15:53.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.306+0000 7f040f6199c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10 to cache LRU end 2024-09-12T17:15:53.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.314+0000 7f040f6199c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9 : miss 2024-09-12T17:15:53.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.314+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:53.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.314+0000 7f040f6199c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:15:53.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.314+0000 7f040f6199c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9 info.flags=0x17 2024-09-12T17:15:53.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.314+0000 7f040f6199c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9 to cache LRU end 2024-09-12T17:15:53.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.314+0000 7f040f6199c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:15:53.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.314+0000 7f040f6199c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:15:53.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.314+0000 7f040f6199c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9 2024-09-12T17:15:53.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.314+0000 7f040f6199c0 10 cls_bucket_list_unordered: got foo 2024-09-12T17:15:53.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.314+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5b3450 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.318+0000 7f040f6199c0 10 manifest: total_size = 26078 2024-09-12T17:15:53.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.318+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17655400658008050371 2024-09-12T17:15:53.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.318+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5b3450 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.318+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5aa938 2024-09-12T17:15:53.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.318+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9.0 2024-09-12T17:15:53.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.322+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=3 2024-09-12T17:15:53.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.322+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=7670 2024-09-12T17:15:53.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.322+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=7670 stripe_ofs=7670 part_ofs=7670 rule->part_size=7670 2024-09-12T17:15:53.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.322+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=3 2024-09-12T17:15:53.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.322+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=4201974 part_ofs=7670 rule->part_size=7670 2024-09-12T17:15:53.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.322+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=15340 stripe_ofs=15340 part_ofs=15340 rule->part_size=7671 2024-09-12T17:15:53.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.322+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=3 2024-09-12T17:15:53.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.322+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=4209644 part_ofs=15340 rule->part_size=7671 2024-09-12T17:15:53.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.322+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=23011 stripe_ofs=23011 part_ofs=23011 rule->part_size=3067 2024-09-12T17:15:53.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.322+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=3 2024-09-12T17:15:53.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.322+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=4217315 part_ofs=23011 rule->part_size=3067 2024-09-12T17:15:53.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.322+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=26078 stripe_ofs=26078 part_ofs=26078 rule->part_size=3067 2024-09-12T17:15:53.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.322+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17655400658008050371 2024-09-12T17:15:53.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.322+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.322+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9__multipart_foo.2~4FS_tgtQo81zJMYD_VBsjlE7-HuWZlC.1 2024-09-12T17:15:53.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.322+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 345 2024-09-12T17:15:53.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.322+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9__multipart_foo.2~4FS_tgtQo81zJMYD_VBsjlE7-HuWZlC.2 2024-09-12T17:15:53.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.322+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 589 2024-09-12T17:15:53.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.322+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9__multipart_foo.2~4FS_tgtQo81zJMYD_VBsjlE7-HuWZlC.3 2024-09-12T17:15:53.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.322+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 833 2024-09-12T17:15:53.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.322+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9__multipart_foo.2~4FS_tgtQo81zJMYD_VBsjlE7-HuWZlC.4 2024-09-12T17:15:53.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.322+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1077 2024-09-12T17:15:53.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.322+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.322+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17655400658008050371 2024-09-12T17:15:53.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.322+0000 7f02f0ff9640 20 handle_completion(): completion ok for obj=foo 2024-09-12T17:15:53.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.322+0000 7f040f6199c0 20 list_objects_ordered: starting attempt 1 2024-09-12T17:15:53.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.322+0000 7f040f6199c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T17:15:53.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.326+0000 7f040f6199c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:15:53.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.326+0000 7f040f6199c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:15:53.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.326+0000 7f040f6199c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:15:53.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.326+0000 7f040f6199c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:15:53.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.326+0000 7f040f6199c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9])"; uploads.size()=0; is_truncated=0 2024-09-12T17:15:53.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.330+0000 7f040f6199c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-09-12T17:15:53.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.330+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:53.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.330+0000 7f040f6199c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:15:53.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.330+0000 7f040f6199c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-09-12T17:15:53.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.330+0000 7f040f6199c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-09-12T17:15:53.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.334+0000 7f040f6199c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-09-12T17:15:53.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.334+0000 7f040f6199c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-09-12T17:15:53.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.334+0000 7f02dffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496994 cookie 93980047425056 notifier 5913 bl.length()=183 2024-09-12T17:15:53.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.338+0000 7f040f6199c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9 from cache 2024-09-12T17:15:53.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.338+0000 7f040f6199c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9, ofs0, ns] 2024-09-12T17:15:53.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.342+0000 7f02dffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496979 cookie 93980047426112 notifier 5913 bl.length()=240 2024-09-12T17:15:53.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.342+0000 7f040f6199c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9 : miss 2024-09-12T17:15:53.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.342+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:53.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.346+0000 7f040f6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:53.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.346+0000 7f040f6199c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9 info.flags=0x0 2024-09-12T17:15:53.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.346+0000 7f040f6199c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9 to cache LRU end 2024-09-12T17:15:53.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.350+0000 7f040f6199c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15 : miss 2024-09-12T17:15:53.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.350+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:53.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.350+0000 7f040f6199c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T17:15:53.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.350+0000 7f040f6199c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15 info.flags=0x17 2024-09-12T17:15:53.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.350+0000 7f040f6199c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15 to cache LRU end 2024-09-12T17:15:53.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.350+0000 7f040f6199c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:15:53.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.350+0000 7f040f6199c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:15:53.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.350+0000 7f040f6199c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15 2024-09-12T17:15:53.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.354+0000 7f040f6199c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T17:15:53.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.354+0000 7f040f6199c0 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T17:15:53.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.354+0000 7f040f6199c0 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T17:15:53.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.354+0000 7f040f6199c0 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T17:15:53.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.354+0000 7f040f6199c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T17:15:53.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.354+0000 7f040f6199c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T17:15:53.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.354+0000 7f040f6199c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T17:15:53.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.354+0000 7f040f6199c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T17:15:53.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.354+0000 7f040f6199c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T17:15:53.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.354+0000 7f040f6199c0 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T17:15:53.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.354+0000 7f040f6199c0 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T17:15:53.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.354+0000 7f040f6199c0 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T17:15:53.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.354+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5b2310 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.354+0000 7f040f6199c0 10 manifest: total_size = 5242880 2024-09-12T17:15:53.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.354+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13048624585831616113 2024-09-12T17:15:53.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.354+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5b2310 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.354+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5aa938 2024-09-12T17:15:53.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.354+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15.0 2024-09-12T17:15:53.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.358+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.358+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.358+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.358+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.358+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13048624585831616113 2024-09-12T17:15:53.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.358+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.358+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15__shadow_.utusUk9Jsewa_Yz-LHSUEX5P9LD3Zmh_0 2024-09-12T17:15:53.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.358+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-12T17:15:53.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.358+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15__shadow_.utusUk9Jsewa_Yz-LHSUEX5P9LD3Zmh_1 2024-09-12T17:15:53.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.358+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-12T17:15:53.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.358+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.358+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13048624585831616113 2024-09-12T17:15:53.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.362+0000 7f02f0ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T17:15:53.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.362+0000 7f040f6199c0 20 get_obj_state: octx=0x7f040804b8f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.362+0000 7f040f6199c0 10 manifest: total_size = 5242880 2024-09-12T17:15:53.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.362+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11182571932139253820 2024-09-12T17:15:53.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.362+0000 7f040f6199c0 20 get_obj_state: octx=0x7f040804b8f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.362+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5aa938 2024-09-12T17:15:53.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.362+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15.0 2024-09-12T17:15:53.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.370+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.370+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.370+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.370+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.370+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11182571932139253820 2024-09-12T17:15:53.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.370+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.370+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15__shadow_.utusUk9Jsewa_Yz-LHSUEX5P9LD3Zmh_0 2024-09-12T17:15:53.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.370+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-12T17:15:53.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.370+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15__shadow_.utusUk9Jsewa_Yz-LHSUEX5P9LD3Zmh_1 2024-09-12T17:15:53.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.370+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-12T17:15:53.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.370+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.370+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11182571932139253820 2024-09-12T17:15:53.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.370+0000 7f02dffff640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T17:15:53.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.374+0000 7f040f6199c0 20 get_obj_state: octx=0x7f0408015450 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.374+0000 7f040f6199c0 10 manifest: total_size = 5242880 2024-09-12T17:15:53.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.374+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to _PQtLRKIMAmoMUzlzAsSt6NnHQC_zBhO 2024-09-12T17:15:53.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.374+0000 7f040f6199c0 20 get_obj_state: octx=0x7f0408015450 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.374+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5aa938 2024-09-12T17:15:53.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.374+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15.0 2024-09-12T17:15:53.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.378+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.378+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.378+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.378+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.378+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: _PQtLRKIMAmoMUzlzAsSt6NnHQC_zBhO 2024-09-12T17:15:53.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.378+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.378+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15__shadow_.OJNTCvTd-ZdkKEyIaNXftj6dP5iE8g8_0 2024-09-12T17:15:53.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.378+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T17:15:53.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.378+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15__shadow_.OJNTCvTd-ZdkKEyIaNXftj6dP5iE8g8_1 2024-09-12T17:15:53.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.378+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-12T17:15:53.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.378+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.378+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: _PQtLRKIMAmoMUzlzAsSt6NnHQC_zBhO 2024-09-12T17:15:53.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.382+0000 7f02f0ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T17:15:53.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.382+0000 7f040f6199c0 20 get_obj_state: octx=0x7f0404068b60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.382+0000 7f040f6199c0 10 manifest: total_size = 5242880 2024-09-12T17:15:53.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.382+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to _cFdunakWtLePCzwytjH51LbaZ0OsDF9 2024-09-12T17:15:53.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.382+0000 7f040f6199c0 20 get_obj_state: octx=0x7f0404068b60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.382+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5aa938 2024-09-12T17:15:53.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.382+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15.0 2024-09-12T17:15:53.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.390+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.390+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.390+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.390+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.390+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: _cFdunakWtLePCzwytjH51LbaZ0OsDF9 2024-09-12T17:15:53.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.390+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.390+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15__shadow_.dxzZ1Nm6uAxAc0f7SeaOpQk7NrapbH3_0 2024-09-12T17:15:53.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.390+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T17:15:53.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.390+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15__shadow_.dxzZ1Nm6uAxAc0f7SeaOpQk7NrapbH3_1 2024-09-12T17:15:53.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.390+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T17:15:53.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.390+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.390+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: _cFdunakWtLePCzwytjH51LbaZ0OsDF9 2024-09-12T17:15:53.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.394+0000 7f040f6199c0 20 get_obj_state: octx=0x7f04040023f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.394+0000 7f02dffff640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T17:15:53.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.394+0000 7f040f6199c0 10 manifest: total_size = 5242880 2024-09-12T17:15:53.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.394+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3107612948714270822 2024-09-12T17:15:53.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.394+0000 7f040f6199c0 20 get_obj_state: octx=0x7f04040023f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.394+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5aa938 2024-09-12T17:15:53.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.394+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15.0 2024-09-12T17:15:53.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.398+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.398+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.398+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.398+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.398+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3107612948714270822 2024-09-12T17:15:53.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.398+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.398+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15__shadow_.gNEl_t_G4qGLCCwWX4kky53MX7zSYVS_0 2024-09-12T17:15:53.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.398+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-12T17:15:53.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.398+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15__shadow_.gNEl_t_G4qGLCCwWX4kky53MX7zSYVS_1 2024-09-12T17:15:53.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.398+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-12T17:15:53.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.398+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.398+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3107612948714270822 2024-09-12T17:15:53.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.402+0000 7f02f0ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T17:15:53.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.402+0000 7f040f6199c0 20 get_obj_state: octx=0x7f0408015450 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.402+0000 7f040f6199c0 10 manifest: total_size = 5242880 2024-09-12T17:15:53.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.402+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to _kRDl7Q0Bp-PDXsTLI2r3ODXX-24q12h 2024-09-12T17:15:53.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.402+0000 7f040f6199c0 20 get_obj_state: octx=0x7f0408015450 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.402+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5aa938 2024-09-12T17:15:53.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.402+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15.0 2024-09-12T17:15:53.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.410+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.410+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.410+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.410+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.410+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: _kRDl7Q0Bp-PDXsTLI2r3ODXX-24q12h 2024-09-12T17:15:53.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.410+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.410+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15__shadow_.3X0mwqfIVqQqrVNtvfB4qZCVwW2blka_0 2024-09-12T17:15:53.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.410+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T17:15:53.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.410+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15__shadow_.3X0mwqfIVqQqrVNtvfB4qZCVwW2blka_1 2024-09-12T17:15:53.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.410+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-12T17:15:53.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.410+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.410+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: _kRDl7Q0Bp-PDXsTLI2r3ODXX-24q12h 2024-09-12T17:15:53.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.414+0000 7f02dffff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T17:15:53.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.414+0000 7f040f6199c0 20 get_obj_state: octx=0x7f04040023f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.414+0000 7f040f6199c0 10 manifest: total_size = 5242880 2024-09-12T17:15:53.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.414+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16574692706069185489 2024-09-12T17:15:53.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.414+0000 7f040f6199c0 20 get_obj_state: octx=0x7f04040023f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.414+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5aa938 2024-09-12T17:15:53.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.414+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15.0 2024-09-12T17:15:53.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.422+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.422+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.422+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.422+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.422+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16574692706069185489 2024-09-12T17:15:53.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.422+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.422+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15__shadow_.gNEl_t_G4qGLCCwWX4kky53MX7zSYVS_0 2024-09-12T17:15:53.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.422+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-12T17:15:53.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.422+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15__shadow_.gNEl_t_G4qGLCCwWX4kky53MX7zSYVS_1 2024-09-12T17:15:53.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.422+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 579 2024-09-12T17:15:53.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.422+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.422+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16574692706069185489 2024-09-12T17:15:53.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.422+0000 7f02f0ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T17:15:53.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.422+0000 7f040f6199c0 20 get_obj_state: octx=0x7f0408015450 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.422+0000 7f040f6199c0 10 manifest: total_size = 5242880 2024-09-12T17:15:53.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.422+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to _5Kv8Gp7BxyA5ZmY6nS94UZqRmCqqiAj 2024-09-12T17:15:53.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.422+0000 7f040f6199c0 20 get_obj_state: octx=0x7f0408015450 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.422+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5aa938 2024-09-12T17:15:53.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.422+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15.0 2024-09-12T17:15:53.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.426+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.426+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.426+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.426+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.426+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: _5Kv8Gp7BxyA5ZmY6nS94UZqRmCqqiAj 2024-09-12T17:15:53.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.426+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.426+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15__shadow_.VTjf7ChGdoT_AzEzGrwdFM1i4QClA3E_0 2024-09-12T17:15:53.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.426+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T17:15:53.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.426+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15__shadow_.VTjf7ChGdoT_AzEzGrwdFM1i4QClA3E_1 2024-09-12T17:15:53.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.426+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T17:15:53.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.426+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.426+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: _5Kv8Gp7BxyA5ZmY6nS94UZqRmCqqiAj 2024-09-12T17:15:53.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.430+0000 7f02dffff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T17:15:53.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.430+0000 7f040f6199c0 20 get_obj_state: octx=0x7f040804b8f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.434+0000 7f040f6199c0 10 manifest: total_size = 22651 2024-09-12T17:15:53.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.434+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7055576976438622482 2024-09-12T17:15:53.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.434+0000 7f040f6199c0 20 get_obj_state: octx=0x7f040804b8f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.434+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5aa938 2024-09-12T17:15:53.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.434+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15.0 2024-09-12T17:15:53.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.438+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.438+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.438+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7055576976438622482 2024-09-12T17:15:53.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.438+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.438+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15__shadow_.2ctIW1yUCwFapgTVqIhDSvbPLTENBgJ_0 2024-09-12T17:15:53.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.438+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-12T17:15:53.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.438+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.438+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7055576976438622482 2024-09-12T17:15:53.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.442+0000 7f02f0ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T17:15:53.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.442+0000 7f040f6199c0 20 get_obj_state: octx=0x7f0408015450 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.442+0000 7f040f6199c0 10 manifest: total_size = 22651 2024-09-12T17:15:53.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.442+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to _tcS6ze1S_kxS4L8dvmfWYNNg5azt3gM 2024-09-12T17:15:53.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.442+0000 7f040f6199c0 20 get_obj_state: octx=0x7f0408015450 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.442+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5aa938 2024-09-12T17:15:53.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.442+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15.0 2024-09-12T17:15:53.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.446+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.446+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.446+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: _tcS6ze1S_kxS4L8dvmfWYNNg5azt3gM 2024-09-12T17:15:53.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.446+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.446+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15__shadow_.1uMa75mmUpM9dPj-AXhiBAemXjhJkcb_0 2024-09-12T17:15:53.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.446+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T17:15:53.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.446+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.446+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: _tcS6ze1S_kxS4L8dvmfWYNNg5azt3gM 2024-09-12T17:15:53.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.450+0000 7f02dffff640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T17:15:53.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.450+0000 7f040f6199c0 20 get_obj_state: octx=0x7f04040023f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.450+0000 7f040f6199c0 10 manifest: total_size = 22651 2024-09-12T17:15:53.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.450+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to _aGuxXVwPfIJzGRilXurnGUipB6ZK4Fp 2024-09-12T17:15:53.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.450+0000 7f040f6199c0 20 get_obj_state: octx=0x7f04040023f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.450+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5aa938 2024-09-12T17:15:53.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.450+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15.0 2024-09-12T17:15:53.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.458+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.458+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.458+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: _aGuxXVwPfIJzGRilXurnGUipB6ZK4Fp 2024-09-12T17:15:53.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.458+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.458+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15__shadow_.LsY80oeYzSgoh_xIeJexfyzdJMK4Ngi_0 2024-09-12T17:15:53.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.458+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T17:15:53.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.458+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.458+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: _aGuxXVwPfIJzGRilXurnGUipB6ZK4Fp 2024-09-12T17:15:53.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.458+0000 7f02f0ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T17:15:53.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.462+0000 7f040f6199c0 20 get_obj_state: octx=0x7f04040023f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.462+0000 7f040f6199c0 10 manifest: total_size = 22651 2024-09-12T17:15:53.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.462+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1456882589075796249 2024-09-12T17:15:53.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.462+0000 7f040f6199c0 20 get_obj_state: octx=0x7f04040023f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.462+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5aa938 2024-09-12T17:15:53.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.462+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15.0 2024-09-12T17:15:53.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.466+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.466+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.466+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1456882589075796249 2024-09-12T17:15:53.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.466+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.466+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15__shadow_.2ctIW1yUCwFapgTVqIhDSvbPLTENBgJ_0 2024-09-12T17:15:53.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.466+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-12T17:15:53.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.466+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.466+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1456882589075796249 2024-09-12T17:15:53.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.470+0000 7f040f6199c0 20 list_objects_ordered: starting attempt 1 2024-09-12T17:15:53.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.470+0000 7f040f6199c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T17:15:53.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.470+0000 7f02dffff640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T17:15:53.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.470+0000 7f040f6199c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:15:53.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.470+0000 7f040f6199c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:15:53.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.470+0000 7f040f6199c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:15:53.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.470+0000 7f040f6199c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:15:53.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.470+0000 7f040f6199c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15])"; uploads.size()=0; is_truncated=0 2024-09-12T17:15:53.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.474+0000 7f040f6199c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-09-12T17:15:53.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.474+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:53.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.474+0000 7f040f6199c0 20 rados_obj.operate() r=0 bl.length=233 2024-09-12T17:15:53.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.474+0000 7f040f6199c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-09-12T17:15:53.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.474+0000 7f040f6199c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-09-12T17:15:53.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.478+0000 7f040f6199c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-09-12T17:15:53.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.478+0000 7f040f6199c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-09-12T17:15:53.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.478+0000 7f02f0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496985 cookie 93980047418048 notifier 5913 bl.length()=189 2024-09-12T17:15:53.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.486+0000 7f040f6199c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15 from cache 2024-09-12T17:15:53.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.486+0000 7f040f6199c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15, ofs0, ns] 2024-09-12T17:15:53.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.486+0000 7f02f0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496980 cookie 93980047427312 notifier 5913 bl.length()=247 2024-09-12T17:15:53.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.486+0000 7f040f6199c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15 : miss 2024-09-12T17:15:53.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.486+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:53.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.486+0000 7f040f6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:53.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.486+0000 7f040f6199c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15 info.flags=0x0 2024-09-12T17:15:53.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.486+0000 7f040f6199c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15 to cache LRU end 2024-09-12T17:15:53.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.494+0000 7f040f6199c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16 : miss 2024-09-12T17:15:53.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.494+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:53.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.494+0000 7f040f6199c0 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T17:15:53.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.494+0000 7f040f6199c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16 info.flags=0x17 2024-09-12T17:15:53.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.494+0000 7f040f6199c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16 to cache LRU end 2024-09-12T17:15:53.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.494+0000 7f040f6199c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:15:53.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.494+0000 7f040f6199c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:15:53.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.494+0000 7f040f6199c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16 2024-09-12T17:15:53.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.502+0000 7f040f6199c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T17:15:53.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.502+0000 7f040f6199c0 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T17:15:53.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.502+0000 7f040f6199c0 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T17:15:53.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.502+0000 7f040f6199c0 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T17:15:53.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.502+0000 7f040f6199c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T17:15:53.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.502+0000 7f040f6199c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T17:15:53.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.502+0000 7f040f6199c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T17:15:53.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.502+0000 7f040f6199c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T17:15:53.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.502+0000 7f040f6199c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T17:15:53.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.502+0000 7f040f6199c0 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T17:15:53.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.502+0000 7f040f6199c0 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T17:15:53.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.502+0000 7f040f6199c0 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T17:15:53.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.502+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5b75f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.502+0000 7f040f6199c0 10 manifest: total_size = 11534336 2024-09-12T17:15:53.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.502+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1924398050553506717 2024-09-12T17:15:53.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.502+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5b75f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.502+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5aa938 2024-09-12T17:15:53.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.502+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16.0 2024-09-12T17:15:53.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.510+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:15:53.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.510+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:15:53.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.510+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:15:53.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.510+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:15:53.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.510+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T17:15:53.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.510+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:15:53.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.510+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:15:53.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.510+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:15:53.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.510+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:15:53.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.510+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:15:53.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.510+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:15:53.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.510+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:15:53.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.510+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:15:53.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.510+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:15:53.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.510+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:15:53.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.510+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1924398050553506717 2024-09-12T17:15:53.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.510+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.510+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__multipart_foo-FROZEN.2~fuvyDC5qsq_81fDJByuyHxTIMW1uFCs.1 2024-09-12T17:15:53.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.510+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-12T17:15:53.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.510+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__shadow_foo-FROZEN.2~fuvyDC5qsq_81fDJByuyHxTIMW1uFCs.1_1 2024-09-12T17:15:53.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.510+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 632 2024-09-12T17:15:53.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.510+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__multipart_foo-FROZEN.2~fuvyDC5qsq_81fDJByuyHxTIMW1uFCs.2 2024-09-12T17:15:53.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.510+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 899 2024-09-12T17:15:53.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.510+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__shadow_foo-FROZEN.2~fuvyDC5qsq_81fDJByuyHxTIMW1uFCs.2_1 2024-09-12T17:15:53.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.510+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1164 2024-09-12T17:15:53.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.510+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__multipart_foo-FROZEN.2~fuvyDC5qsq_81fDJByuyHxTIMW1uFCs.3 2024-09-12T17:15:53.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.510+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1431 2024-09-12T17:15:53.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.510+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.510+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1924398050553506717 2024-09-12T17:15:53.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.510+0000 7f02dffff640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T17:15:53.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.510+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5b6170 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.510+0000 7f040f6199c0 10 manifest: total_size = 11534336 2024-09-12T17:15:53.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.510+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.227293945502479013 2024-09-12T17:15:53.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.510+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5b6170 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.510+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5aa938 2024-09-12T17:15:53.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.510+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16.0 2024-09-12T17:15:53.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.518+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:15:53.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.518+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:15:53.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.518+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:15:53.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.518+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:15:53.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.518+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T17:15:53.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.518+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:15:53.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.518+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:15:53.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.518+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:15:53.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.518+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:15:53.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.518+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:15:53.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.518+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:15:53.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.518+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:15:53.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.518+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:15:53.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.518+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:15:53.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.518+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:15:53.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.518+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.227293945502479013 2024-09-12T17:15:53.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.518+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.518+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__multipart_foo-FROZEN.2~fuvyDC5qsq_81fDJByuyHxTIMW1uFCs.1 2024-09-12T17:15:53.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.518+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 366 2024-09-12T17:15:53.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.518+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__shadow_foo-FROZEN.2~fuvyDC5qsq_81fDJByuyHxTIMW1uFCs.1_1 2024-09-12T17:15:53.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.518+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 631 2024-09-12T17:15:53.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.518+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__multipart_foo-FROZEN.2~fuvyDC5qsq_81fDJByuyHxTIMW1uFCs.2 2024-09-12T17:15:53.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.518+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 898 2024-09-12T17:15:53.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.518+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__shadow_foo-FROZEN.2~fuvyDC5qsq_81fDJByuyHxTIMW1uFCs.2_1 2024-09-12T17:15:53.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.518+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1163 2024-09-12T17:15:53.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.518+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__multipart_foo-FROZEN.2~fuvyDC5qsq_81fDJByuyHxTIMW1uFCs.3 2024-09-12T17:15:53.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.518+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1430 2024-09-12T17:15:53.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.518+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.518+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.227293945502479013 2024-09-12T17:15:53.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.518+0000 7f02f0ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T17:15:53.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.518+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5c4180 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.522+0000 7f040f6199c0 10 manifest: total_size = 11534336 2024-09-12T17:15:53.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.522+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to _ttkyIaTuDYcwpGLfBpllEr0O_sMRi6r 2024-09-12T17:15:53.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.522+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5c4180 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.522+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5aa938 2024-09-12T17:15:53.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.522+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16.0 2024-09-12T17:15:53.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.530+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.530+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.530+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.530+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.530+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.530+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.530+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: _ttkyIaTuDYcwpGLfBpllEr0O_sMRi6r 2024-09-12T17:15:53.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.530+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.530+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__shadow_.pKAZf3LC92a2mi7DnryHieTis3abdOG_0 2024-09-12T17:15:53.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.530+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T17:15:53.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.530+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__shadow_.pKAZf3LC92a2mi7DnryHieTis3abdOG_1 2024-09-12T17:15:53.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.530+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-12T17:15:53.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.530+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__shadow_.pKAZf3LC92a2mi7DnryHieTis3abdOG_2 2024-09-12T17:15:53.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.530+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 788 2024-09-12T17:15:53.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.530+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.530+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: _ttkyIaTuDYcwpGLfBpllEr0O_sMRi6r 2024-09-12T17:15:53.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.530+0000 7f02dffff640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T17:15:53.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.530+0000 7f040f6199c0 20 get_obj_state: octx=0x7f040402c8c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.530+0000 7f040f6199c0 10 manifest: total_size = 11534336 2024-09-12T17:15:53.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.530+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to _7m7Q1FG_X_ueOlxyEtobmYpKGVl9J9I 2024-09-12T17:15:53.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.530+0000 7f040f6199c0 20 get_obj_state: octx=0x7f040402c8c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.530+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5aa938 2024-09-12T17:15:53.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.530+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16.0 2024-09-12T17:15:53.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.538+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.538+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.538+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.538+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.538+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.538+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.538+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: _7m7Q1FG_X_ueOlxyEtobmYpKGVl9J9I 2024-09-12T17:15:53.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.538+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.538+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__shadow_.fNrXldopP9dzg5qJoeKuX76snjIYTT4_0 2024-09-12T17:15:53.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.538+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T17:15:53.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.538+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__shadow_.fNrXldopP9dzg5qJoeKuX76snjIYTT4_1 2024-09-12T17:15:53.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.538+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T17:15:53.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.538+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__shadow_.fNrXldopP9dzg5qJoeKuX76snjIYTT4_2 2024-09-12T17:15:53.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.538+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 761 2024-09-12T17:15:53.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.538+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.538+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: _7m7Q1FG_X_ueOlxyEtobmYpKGVl9J9I 2024-09-12T17:15:53.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.542+0000 7f02f0ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T17:15:53.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.542+0000 7f040f6199c0 20 get_obj_state: octx=0x7f040402c8c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.542+0000 7f040f6199c0 10 manifest: total_size = 11534336 2024-09-12T17:15:53.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.542+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18096450869366490525 2024-09-12T17:15:53.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.542+0000 7f040f6199c0 20 get_obj_state: octx=0x7f040402c8c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.542+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5aa938 2024-09-12T17:15:53.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.542+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16.0 2024-09-12T17:15:53.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.546+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:15:53.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.546+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:15:53.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.546+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:15:53.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.546+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:15:53.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.546+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T17:15:53.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.546+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:15:53.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.546+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:15:53.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.546+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:15:53.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.546+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:15:53.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.546+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:15:53.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.546+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:15:53.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.550+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:15:53.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.550+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:15:53.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.550+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:15:53.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.550+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:15:53.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.550+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18096450869366490525 2024-09-12T17:15:53.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.550+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.550+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__multipart_foo-LUKEWARM.2~MbdvBIPWuandBJkHTE3p6BjlCNRHUdB.1 2024-09-12T17:15:53.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.550+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-12T17:15:53.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.550+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__shadow_foo-LUKEWARM.2~MbdvBIPWuandBJkHTE3p6BjlCNRHUdB.1_1 2024-09-12T17:15:53.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.550+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2024-09-12T17:15:53.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.550+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__multipart_foo-LUKEWARM.2~MbdvBIPWuandBJkHTE3p6BjlCNRHUdB.2 2024-09-12T17:15:53.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.550+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2024-09-12T17:15:53.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.550+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__shadow_foo-LUKEWARM.2~MbdvBIPWuandBJkHTE3p6BjlCNRHUdB.2_1 2024-09-12T17:15:53.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.550+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1189 2024-09-12T17:15:53.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.550+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__multipart_foo-LUKEWARM.2~MbdvBIPWuandBJkHTE3p6BjlCNRHUdB.3 2024-09-12T17:15:53.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.550+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1462 2024-09-12T17:15:53.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.550+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.550+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18096450869366490525 2024-09-12T17:15:53.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.550+0000 7f02dffff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T17:15:53.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.554+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f558a00 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.554+0000 7f040f6199c0 10 manifest: total_size = 11534336 2024-09-12T17:15:53.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.554+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to _nJha90E2jK_xb9VeTVx439whAGmPa4w 2024-09-12T17:15:53.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.554+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f558a00 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.554+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5aa938 2024-09-12T17:15:53.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.554+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16.0 2024-09-12T17:15:53.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.562+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.562+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.562+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.562+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.562+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.562+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.562+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: _nJha90E2jK_xb9VeTVx439whAGmPa4w 2024-09-12T17:15:53.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.562+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.562+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__shadow_.eizR4ixH16WDRcWq4Ax-uNa7EGwRF9R_0 2024-09-12T17:15:53.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.562+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T17:15:53.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.562+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__shadow_.eizR4ixH16WDRcWq4Ax-uNa7EGwRF9R_1 2024-09-12T17:15:53.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.562+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-12T17:15:53.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.562+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__shadow_.eizR4ixH16WDRcWq4Ax-uNa7EGwRF9R_2 2024-09-12T17:15:53.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.562+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 782 2024-09-12T17:15:53.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.562+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.562+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: _nJha90E2jK_xb9VeTVx439whAGmPa4w 2024-09-12T17:15:53.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.566+0000 7f040f6199c0 20 get_obj_state: octx=0x7f040402c8c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.566+0000 7f02f0ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T17:15:53.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.566+0000 7f040f6199c0 10 manifest: total_size = 11534336 2024-09-12T17:15:53.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.566+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4926913302056726504 2024-09-12T17:15:53.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.566+0000 7f040f6199c0 20 get_obj_state: octx=0x7f040402c8c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.566+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5aa938 2024-09-12T17:15:53.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.566+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16.0 2024-09-12T17:15:53.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.570+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:15:53.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.570+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:15:53.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.570+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:15:53.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.570+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:15:53.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.570+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T17:15:53.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.570+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:15:53.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.570+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:15:53.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.570+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:15:53.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.570+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:15:53.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.570+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:15:53.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.570+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:15:53.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.570+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:15:53.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.570+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:15:53.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.570+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:15:53.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.570+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:15:53.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.570+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4926913302056726504 2024-09-12T17:15:53.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.570+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.570+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__multipart_foo-LUKEWARM.2~MbdvBIPWuandBJkHTE3p6BjlCNRHUdB.1 2024-09-12T17:15:53.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.570+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-12T17:15:53.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.570+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__shadow_foo-LUKEWARM.2~MbdvBIPWuandBJkHTE3p6BjlCNRHUdB.1_1 2024-09-12T17:15:53.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.570+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 644 2024-09-12T17:15:53.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.570+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__multipart_foo-LUKEWARM.2~MbdvBIPWuandBJkHTE3p6BjlCNRHUdB.2 2024-09-12T17:15:53.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.570+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 917 2024-09-12T17:15:53.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.570+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__shadow_foo-LUKEWARM.2~MbdvBIPWuandBJkHTE3p6BjlCNRHUdB.2_1 2024-09-12T17:15:53.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.570+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1188 2024-09-12T17:15:53.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.570+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__multipart_foo-LUKEWARM.2~MbdvBIPWuandBJkHTE3p6BjlCNRHUdB.3 2024-09-12T17:15:53.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.570+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1461 2024-09-12T17:15:53.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.570+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.570+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4926913302056726504 2024-09-12T17:15:53.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.578+0000 7f02dffff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T17:15:53.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.578+0000 7f040f6199c0 20 get_obj_state: octx=0x7f0400127560 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.578+0000 7f040f6199c0 10 manifest: total_size = 11534336 2024-09-12T17:15:53.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.578+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to _zy-nq8PiCK04aj7zzybwRKKRZg41tpN 2024-09-12T17:15:53.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.578+0000 7f040f6199c0 20 get_obj_state: octx=0x7f0400127560 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.578+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5aa938 2024-09-12T17:15:53.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.578+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16.0 2024-09-12T17:15:53.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.582+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.582+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.582+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.582+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.582+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.582+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.582+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: _zy-nq8PiCK04aj7zzybwRKKRZg41tpN 2024-09-12T17:15:53.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.582+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.582+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__shadow_.4xJ49Rooxz0Ox9zoS1tbn01vv2arIP7_0 2024-09-12T17:15:53.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.582+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T17:15:53.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.582+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__shadow_.4xJ49Rooxz0Ox9zoS1tbn01vv2arIP7_1 2024-09-12T17:15:53.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.582+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T17:15:53.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.582+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__shadow_.4xJ49Rooxz0Ox9zoS1tbn01vv2arIP7_2 2024-09-12T17:15:53.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.582+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 761 2024-09-12T17:15:53.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.582+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.582+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: _zy-nq8PiCK04aj7zzybwRKKRZg41tpN 2024-09-12T17:15:53.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.582+0000 7f02f0ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T17:15:53.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.582+0000 7f040f6199c0 20 get_obj_state: octx=0x7f0400127560 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.586+0000 7f040f6199c0 10 manifest: total_size = 1087 2024-09-12T17:15:53.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.586+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16491159834743392499 2024-09-12T17:15:53.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.586+0000 7f040f6199c0 20 get_obj_state: octx=0x7f0400127560 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.586+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5aa938 2024-09-12T17:15:53.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.586+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16.0 2024-09-12T17:15:53.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.590+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T17:15:53.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.590+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=516 2024-09-12T17:15:53.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.590+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-12T17:15:53.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.590+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T17:15:53.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.590+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=4194820 part_ofs=516 rule->part_size=516 2024-09-12T17:15:53.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.590+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=55 2024-09-12T17:15:53.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.590+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=55 rules.size()=2 2024-09-12T17:15:53.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.590+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=4195336 part_ofs=1032 rule->part_size=55 2024-09-12T17:15:53.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.590+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=1087 rule->part_size=55 2024-09-12T17:15:53.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.590+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16491159834743392499 2024-09-12T17:15:53.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.590+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.590+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__multipart_foo-STANDARD.2~PePFprsWFGn9I7tkYsRwqWOKGV5h6gp.1 2024-09-12T17:15:53.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.590+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-12T17:15:53.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.590+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__multipart_foo-STANDARD.2~PePFprsWFGn9I7tkYsRwqWOKGV5h6gp.2 2024-09-12T17:15:53.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.590+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-12T17:15:53.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.590+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__multipart_foo-STANDARD.2~PePFprsWFGn9I7tkYsRwqWOKGV5h6gp.3 2024-09-12T17:15:53.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.590+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-12T17:15:53.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.590+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.590+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16491159834743392499 2024-09-12T17:15:53.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.594+0000 7f02dffff640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T17:15:53.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.594+0000 7f040f6199c0 20 get_obj_state: octx=0x7f0404067f70 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.594+0000 7f040f6199c0 10 manifest: total_size = 1087 2024-09-12T17:15:53.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.594+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to _Et2elVde-lJVlb7IxtP-eu5mB-zidlh 2024-09-12T17:15:53.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.594+0000 7f040f6199c0 20 get_obj_state: octx=0x7f0404067f70 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.594+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5aa938 2024-09-12T17:15:53.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.594+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16.0 2024-09-12T17:15:53.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.606+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.606+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.606+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: _Et2elVde-lJVlb7IxtP-eu5mB-zidlh 2024-09-12T17:15:53.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.606+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.606+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__shadow_.ibEhIh8IRbNE7dlTnWWUQSGPptc0ZH2_0 2024-09-12T17:15:53.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.606+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T17:15:53.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.606+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.606+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: _Et2elVde-lJVlb7IxtP-eu5mB-zidlh 2024-09-12T17:15:53.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.606+0000 7f040f6199c0 20 get_obj_state: octx=0x7f040402c8c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.606+0000 7f02f0ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T17:15:53.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.606+0000 7f040f6199c0 10 manifest: total_size = 1087 2024-09-12T17:15:53.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.606+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to _Gi7C4iKCjemNJKVChAu0rc6Ky7tZjDq 2024-09-12T17:15:53.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.606+0000 7f040f6199c0 20 get_obj_state: octx=0x7f040402c8c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.606+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5aa938 2024-09-12T17:15:53.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.606+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16.0 2024-09-12T17:15:53.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.614+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.614+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.614+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: _Gi7C4iKCjemNJKVChAu0rc6Ky7tZjDq 2024-09-12T17:15:53.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.614+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.614+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__shadow_.5yZn2Cz-VFgXaU-_l7WePUcuqVM4Bfo_0 2024-09-12T17:15:53.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.614+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T17:15:53.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.614+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.614+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: _Gi7C4iKCjemNJKVChAu0rc6Ky7tZjDq 2024-09-12T17:15:53.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.614+0000 7f040f6199c0 20 get_obj_state: octx=0x7f040402c8c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.614+0000 7f02dffff640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T17:15:53.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.614+0000 7f040f6199c0 10 manifest: total_size = 1087 2024-09-12T17:15:53.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.614+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8610589648112763892 2024-09-12T17:15:53.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.614+0000 7f040f6199c0 20 get_obj_state: octx=0x7f040402c8c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55796f5aa938 s->prefetch_data=0 2024-09-12T17:15:53.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.614+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5aa938 2024-09-12T17:15:53.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.614+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16.0 2024-09-12T17:15:53.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.622+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T17:15:53.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.622+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=516 2024-09-12T17:15:53.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.622+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-12T17:15:53.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.622+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T17:15:53.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.622+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=4194820 part_ofs=516 rule->part_size=516 2024-09-12T17:15:53.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.622+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=55 2024-09-12T17:15:53.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.622+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=55 rules.size()=2 2024-09-12T17:15:53.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.622+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=4195336 part_ofs=1032 rule->part_size=55 2024-09-12T17:15:53.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.622+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=1087 rule->part_size=55 2024-09-12T17:15:53.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.622+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8610589648112763892 2024-09-12T17:15:53.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.622+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.622+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__multipart_foo-STANDARD.2~PePFprsWFGn9I7tkYsRwqWOKGV5h6gp.1 2024-09-12T17:15:53.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.622+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-12T17:15:53.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.622+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__multipart_foo-STANDARD.2~PePFprsWFGn9I7tkYsRwqWOKGV5h6gp.2 2024-09-12T17:15:53.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.622+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-12T17:15:53.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.622+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__multipart_foo-STANDARD.2~PePFprsWFGn9I7tkYsRwqWOKGV5h6gp.3 2024-09-12T17:15:53.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.622+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-12T17:15:53.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.622+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.622+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8610589648112763892 2024-09-12T17:15:53.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.630+0000 7f02f0ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T17:15:53.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.630+0000 7f040f6199c0 20 list_objects_ordered: starting attempt 1 2024-09-12T17:15:53.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.630+0000 7f040f6199c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T17:15:53.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.630+0000 7f040f6199c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:15:53.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.630+0000 7f040f6199c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:15:53.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.630+0000 7f040f6199c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:15:53.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.630+0000 7f040f6199c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:15:53.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.630+0000 7f040f6199c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16])"; uploads.size()=0; is_truncated=0 2024-09-12T17:15:53.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.630+0000 7f040f6199c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-09-12T17:15:53.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.630+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:53.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.634+0000 7f040f6199c0 20 rados_obj.operate() r=0 bl.length=243 2024-09-12T17:15:53.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.634+0000 7f040f6199c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-09-12T17:15:53.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.634+0000 7f040f6199c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-09-12T17:15:53.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.642+0000 7f040f6199c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-09-12T17:15:53.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.642+0000 7f040f6199c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-09-12T17:15:53.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.642+0000 7f02dffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496979 cookie 93980047421280 notifier 5913 bl.length()=199 2024-09-12T17:15:53.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.642+0000 7f040f6199c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16 from cache 2024-09-12T17:15:53.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.642+0000 7f040f6199c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16, ofs0, ns] 2024-09-12T17:15:53.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.642+0000 7f02f0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496995 cookie 93980047412432 notifier 5913 bl.length()=257 2024-09-12T17:15:53.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.650+0000 7f040f6199c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16 : miss 2024-09-12T17:15:53.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.650+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:53.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.650+0000 7f040f6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:53.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.650+0000 7f040f6199c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16 info.flags=0x0 2024-09-12T17:15:53.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.650+0000 7f040f6199c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16 to cache LRU end 2024-09-12T17:15:53.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.654+0000 7f040f6199c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14 : miss 2024-09-12T17:15:53.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.654+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:53.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.654+0000 7f040f6199c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T17:15:53.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.654+0000 7f040f6199c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14 info.flags=0x17 2024-09-12T17:15:53.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.654+0000 7f040f6199c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14 to cache LRU end 2024-09-12T17:15:53.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.654+0000 7f040f6199c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:15:53.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.654+0000 7f040f6199c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:15:53.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.654+0000 7f040f6199c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14 2024-09-12T17:15:53.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.654+0000 7f040f6199c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T17:15:53.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.654+0000 7f040f6199c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T17:15:53.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.654+0000 7f040f6199c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T17:15:53.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.654+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5b2310 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55796f5c6bb8 s->prefetch_data=0 2024-09-12T17:15:53.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.654+0000 7f040f6199c0 10 manifest: total_size = 11534336 2024-09-12T17:15:53.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.654+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3204554331829301028 2024-09-12T17:15:53.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.654+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5b2310 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55796f5c6bb8 s->prefetch_data=0 2024-09-12T17:15:53.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.654+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5c6bb8 2024-09-12T17:15:53.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.654+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14.0 2024-09-12T17:15:53.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.662+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:15:53.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.662+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:15:53.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.662+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:15:53.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.662+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:15:53.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.662+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T17:15:53.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.662+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:15:53.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.662+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:15:53.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.662+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:15:53.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.662+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:15:53.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.662+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:15:53.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.662+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:15:53.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.662+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:15:53.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.662+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:15:53.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.662+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:15:53.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.662+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:15:53.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.662+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3204554331829301028 2024-09-12T17:15:53.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.662+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.662+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14__multipart_foo-FROZEN.2~_4B2ZHpxBIc-2ah6OFy6pGDPZFpBqnE.1 2024-09-12T17:15:53.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.662+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-12T17:15:53.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.662+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14__shadow_foo-FROZEN.2~_4B2ZHpxBIc-2ah6OFy6pGDPZFpBqnE.1_1 2024-09-12T17:15:53.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.662+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 632 2024-09-12T17:15:53.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.662+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14__multipart_foo-FROZEN.2~_4B2ZHpxBIc-2ah6OFy6pGDPZFpBqnE.2 2024-09-12T17:15:53.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.662+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 899 2024-09-12T17:15:53.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.662+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14__shadow_foo-FROZEN.2~_4B2ZHpxBIc-2ah6OFy6pGDPZFpBqnE.2_1 2024-09-12T17:15:53.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.662+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1164 2024-09-12T17:15:53.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.662+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14__multipart_foo-FROZEN.2~_4B2ZHpxBIc-2ah6OFy6pGDPZFpBqnE.3 2024-09-12T17:15:53.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.662+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1431 2024-09-12T17:15:53.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.662+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.662+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3204554331829301028 2024-09-12T17:15:53.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.662+0000 7f02dffff640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T17:15:53.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.662+0000 7f040f6199c0 20 get_obj_state: octx=0x7f040804b8f0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55796f5c6bb8 s->prefetch_data=0 2024-09-12T17:15:53.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.666+0000 7f040f6199c0 10 manifest: total_size = 11534336 2024-09-12T17:15:53.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.666+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2620504910734951979 2024-09-12T17:15:53.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.666+0000 7f040f6199c0 20 get_obj_state: octx=0x7f040804b8f0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55796f5c6bb8 s->prefetch_data=0 2024-09-12T17:15:53.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.666+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5c6bb8 2024-09-12T17:15:53.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.666+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14.0 2024-09-12T17:15:53.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.670+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:15:53.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.670+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:15:53.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.670+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T17:15:53.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.670+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:15:53.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.670+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T17:15:53.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.670+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:15:53.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.670+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:15:53.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.670+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:15:53.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.670+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:15:53.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.670+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:15:53.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.670+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:15:53.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.670+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:15:53.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.670+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:15:53.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.670+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:15:53.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.670+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:15:53.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.670+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2620504910734951979 2024-09-12T17:15:53.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.670+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.670+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14__multipart_foo-LUKEWARM.2~GQyIHZktKzIuST1-RyMnDOE92SLDINa.1 2024-09-12T17:15:53.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.670+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-12T17:15:53.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.670+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14__shadow_foo-LUKEWARM.2~GQyIHZktKzIuST1-RyMnDOE92SLDINa.1_1 2024-09-12T17:15:53.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.670+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 644 2024-09-12T17:15:53.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.670+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14__multipart_foo-LUKEWARM.2~GQyIHZktKzIuST1-RyMnDOE92SLDINa.2 2024-09-12T17:15:53.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.670+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 917 2024-09-12T17:15:53.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.670+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14__shadow_foo-LUKEWARM.2~GQyIHZktKzIuST1-RyMnDOE92SLDINa.2_1 2024-09-12T17:15:53.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.670+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1188 2024-09-12T17:15:53.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.670+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14__multipart_foo-LUKEWARM.2~GQyIHZktKzIuST1-RyMnDOE92SLDINa.3 2024-09-12T17:15:53.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.670+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1461 2024-09-12T17:15:53.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.670+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.670+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2620504910734951979 2024-09-12T17:15:53.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.678+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5a86f0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55796f5c6bb8 s->prefetch_data=0 2024-09-12T17:15:53.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.678+0000 7f02f0ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T17:15:53.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.678+0000 7f040f6199c0 10 manifest: total_size = 16377 2024-09-12T17:15:53.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.678+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2153452184064885751 2024-09-12T17:15:53.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.678+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5a86f0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55796f5c6bb8 s->prefetch_data=0 2024-09-12T17:15:53.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.678+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5c6bb8 2024-09-12T17:15:53.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.678+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14.0 2024-09-12T17:15:53.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.682+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=2 2024-09-12T17:15:53.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.682+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=7671 2024-09-12T17:15:53.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.682+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=7671 stripe_ofs=7671 part_ofs=7671 rule->part_size=7671 2024-09-12T17:15:53.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.682+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=2 2024-09-12T17:15:53.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.682+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=4201975 part_ofs=7671 rule->part_size=7671 2024-09-12T17:15:53.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.682+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=15342 stripe_ofs=15342 part_ofs=15342 rule->part_size=1035 2024-09-12T17:15:53.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.682+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=2 2024-09-12T17:15:53.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.682+0000 7f040f6199c0 20 RGWObjManifest::operator++(): stripe_ofs=4209646 part_ofs=15342 rule->part_size=1035 2024-09-12T17:15:53.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.682+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=16377 stripe_ofs=16377 part_ofs=16377 rule->part_size=1035 2024-09-12T17:15:53.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.682+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2153452184064885751 2024-09-12T17:15:53.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.682+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.682+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14__multipart_foo-STANDARD.2~e8ZRvt4Ap1AW4PK7MST6jOuFpJeem0p.1 2024-09-12T17:15:53.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.682+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-12T17:15:53.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.682+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14__multipart_foo-STANDARD.2~e8ZRvt4Ap1AW4PK7MST6jOuFpJeem0p.2 2024-09-12T17:15:53.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.682+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-12T17:15:53.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.682+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14__multipart_foo-STANDARD.2~e8ZRvt4Ap1AW4PK7MST6jOuFpJeem0p.3 2024-09-12T17:15:53.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.682+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-12T17:15:53.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.682+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.682+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2153452184064885751 2024-09-12T17:15:53.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.682+0000 7f02dffff640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T17:15:53.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.686+0000 7f040f6199c0 20 list_objects_ordered: starting attempt 1 2024-09-12T17:15:53.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.686+0000 7f040f6199c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T17:15:53.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.686+0000 7f040f6199c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:15:53.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.686+0000 7f040f6199c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:15:53.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.686+0000 7f040f6199c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:15:53.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.686+0000 7f040f6199c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:15:53.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.686+0000 7f040f6199c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14])"; uploads.size()=0; is_truncated=0 2024-09-12T17:15:53.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.690+0000 7f040f6199c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-09-12T17:15:53.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.690+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:53.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.690+0000 7f040f6199c0 20 rados_obj.operate() r=0 bl.length=238 2024-09-12T17:15:53.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.690+0000 7f040f6199c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-09-12T17:15:53.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.690+0000 7f040f6199c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-09-12T17:15:53.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.694+0000 7f040f6199c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-09-12T17:15:53.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.694+0000 7f040f6199c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-09-12T17:15:53.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.694+0000 7f02f0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496981 cookie 93980047427312 notifier 5913 bl.length()=194 2024-09-12T17:15:53.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.698+0000 7f040f6199c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14 from cache 2024-09-12T17:15:53.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.698+0000 7f040f6199c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14, ofs0, ns] 2024-09-12T17:15:53.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.698+0000 7f02dffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496996 cookie 93980047412432 notifier 5913 bl.length()=252 2024-09-12T17:15:53.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.702+0000 7f040f6199c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14 : miss 2024-09-12T17:15:53.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.702+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:53.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.702+0000 7f040f6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:53.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.702+0000 7f040f6199c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14 info.flags=0x0 2024-09-12T17:15:53.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.702+0000 7f040f6199c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14 to cache LRU end 2024-09-12T17:15:53.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.710+0000 7f040f6199c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13 : miss 2024-09-12T17:15:53.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.710+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:53.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.710+0000 7f040f6199c0 20 rados_obj.operate() r=0 bl.length=450 2024-09-12T17:15:53.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.710+0000 7f040f6199c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13 info.flags=0x17 2024-09-12T17:15:53.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.710+0000 7f040f6199c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13 to cache LRU end 2024-09-12T17:15:53.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.710+0000 7f040f6199c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:15:53.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.710+0000 7f040f6199c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:15:53.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.710+0000 7f040f6199c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13 2024-09-12T17:15:53.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.718+0000 7f040f6199c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T17:15:53.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.718+0000 7f040f6199c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T17:15:53.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.718+0000 7f040f6199c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T17:15:53.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.718+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5b8920 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55796f5c6bb8 s->prefetch_data=0 2024-09-12T17:15:53.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.718+0000 7f040f6199c0 10 manifest: total_size = 10485760 2024-09-12T17:15:53.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.718+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5551827395456209444 2024-09-12T17:15:53.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.718+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5b8920 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55796f5c6bb8 s->prefetch_data=0 2024-09-12T17:15:53.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.718+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5c6bb8 2024-09-12T17:15:53.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.718+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13.0 2024-09-12T17:15:53.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.722+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.722+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.722+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.722+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.722+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.722+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.722+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5551827395456209444 2024-09-12T17:15:53.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.722+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.722+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13__shadow_.V2i3dAZNr2eten9trRV6XOH7EhXEDWK_0 2024-09-12T17:15:53.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.722+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-12T17:15:53.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.722+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13__shadow_.V2i3dAZNr2eten9trRV6XOH7EhXEDWK_1 2024-09-12T17:15:53.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.722+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2024-09-12T17:15:53.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.722+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13__shadow_.V2i3dAZNr2eten9trRV6XOH7EhXEDWK_2 2024-09-12T17:15:53.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.722+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 811 2024-09-12T17:15:53.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.722+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.722+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5551827395456209444 2024-09-12T17:15:53.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.722+0000 7f02dffff640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T17:15:53.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.722+0000 7f040f6199c0 20 get_obj_state: octx=0x7f040804b8f0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55796f5c6bb8 s->prefetch_data=0 2024-09-12T17:15:53.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.726+0000 7f040f6199c0 10 manifest: total_size = 10485760 2024-09-12T17:15:53.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.726+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.666103890830699672 2024-09-12T17:15:53.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.726+0000 7f040f6199c0 20 get_obj_state: octx=0x7f040804b8f0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55796f5c6bb8 s->prefetch_data=0 2024-09-12T17:15:53.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.726+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5c6bb8 2024-09-12T17:15:53.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.726+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13.0 2024-09-12T17:15:53.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.730+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.730+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.730+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.730+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.730+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.730+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.730+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.666103890830699672 2024-09-12T17:15:53.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.730+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.730+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13__shadow_.5GF_yVHQpAsmfqo-Or-Mzm4bgj2ulCD_0 2024-09-12T17:15:53.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.730+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-12T17:15:53.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.730+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13__shadow_.5GF_yVHQpAsmfqo-Or-Mzm4bgj2ulCD_1 2024-09-12T17:15:53.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.730+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 577 2024-09-12T17:15:53.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.730+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13__shadow_.5GF_yVHQpAsmfqo-Or-Mzm4bgj2ulCD_2 2024-09-12T17:15:53.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.730+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 816 2024-09-12T17:15:53.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.730+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.730+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.666103890830699672 2024-09-12T17:15:53.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.734+0000 7f02f0ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T17:15:53.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.734+0000 7f040f6199c0 20 get_obj_state: octx=0x7f040404a3c0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55796f5c6bb8 s->prefetch_data=0 2024-09-12T17:15:53.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.734+0000 7f040f6199c0 10 manifest: total_size = 3306 2024-09-12T17:15:53.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.734+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16554624496872212156 2024-09-12T17:15:53.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.734+0000 7f040f6199c0 20 get_obj_state: octx=0x7f040404a3c0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55796f5c6bb8 s->prefetch_data=0 2024-09-12T17:15:53.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.734+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5c6bb8 2024-09-12T17:15:53.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.734+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13.0 2024-09-12T17:15:53.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.746+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.746+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=3306 stripe_ofs=3306 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.746+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16554624496872212156 2024-09-12T17:15:53.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.746+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.746+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13__shadow_.DD32OSbQfK6fAbTk8hoZaf0qj7kOt9h_0 2024-09-12T17:15:53.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.746+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 331 2024-09-12T17:15:53.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.746+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.746+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16554624496872212156 2024-09-12T17:15:53.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.746+0000 7f02dffff640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T17:15:53.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.746+0000 7f040f6199c0 20 list_objects_ordered: starting attempt 1 2024-09-12T17:15:53.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.746+0000 7f040f6199c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T17:15:53.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.746+0000 7f040f6199c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:15:53.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.746+0000 7f040f6199c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:15:53.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.746+0000 7f040f6199c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:15:53.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.746+0000 7f040f6199c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:15:53.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.746+0000 7f040f6199c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13])"; uploads.size()=0; is_truncated=0 2024-09-12T17:15:53.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.750+0000 7f040f6199c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-09-12T17:15:53.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.750+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:53.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.754+0000 7f040f6199c0 20 rados_obj.operate() r=0 bl.length=228 2024-09-12T17:15:53.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.754+0000 7f040f6199c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-09-12T17:15:53.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.754+0000 7f040f6199c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-09-12T17:15:53.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.754+0000 7f040f6199c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-09-12T17:15:53.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.754+0000 7f040f6199c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-09-12T17:15:53.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.758+0000 7f02f0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496986 cookie 93980047418048 notifier 5913 bl.length()=184 2024-09-12T17:15:53.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.762+0000 7f040f6199c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13 from cache 2024-09-12T17:15:53.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.762+0000 7f040f6199c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13, ofs0, ns] 2024-09-12T17:15:53.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.762+0000 7f02dffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496967 cookie 93980047430496 notifier 5913 bl.length()=242 2024-09-12T17:15:53.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.766+0000 7f040f6199c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13 : miss 2024-09-12T17:15:53.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.766+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:53.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.766+0000 7f040f6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:53.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.766+0000 7f040f6199c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13 info.flags=0x0 2024-09-12T17:15:53.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.766+0000 7f040f6199c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13 to cache LRU end 2024-09-12T17:15:53.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.774+0000 7f040f6199c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6 : miss 2024-09-12T17:15:53.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.774+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:53.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.774+0000 7f040f6199c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T17:15:53.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.774+0000 7f040f6199c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6 info.flags=0x17 2024-09-12T17:15:53.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.774+0000 7f040f6199c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6 to cache LRU end 2024-09-12T17:15:53.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.774+0000 7f040f6199c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:15:53.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.774+0000 7f040f6199c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:15:53.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.774+0000 7f040f6199c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6 2024-09-12T17:15:53.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.778+0000 7f040f6199c0 10 cls_bucket_list_unordered: got __ 2024-09-12T17:15:53.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.778+0000 7f040f6199c0 10 cls_bucket_list_unordered: got __ _ 2024-09-12T17:15:53.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.778+0000 7f040f6199c0 10 cls_bucket_list_unordered: got ___ 2024-09-12T17:15:53.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.778+0000 7f040f6199c0 10 cls_bucket_list_unordered: got obj 2024-09-12T17:15:53.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.778+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5b75f0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55796f5c6bb8 s->prefetch_data=0 2024-09-12T17:15:53.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.778+0000 7f040f6199c0 10 manifest: total_size = 0 2024-09-12T17:15:53.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.778+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9626300247521948523 2024-09-12T17:15:53.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.778+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5b75f0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55796f5c6bb8 s->prefetch_data=0 2024-09-12T17:15:53.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.778+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5c6bb8 2024-09-12T17:15:53.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.778+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6.0 2024-09-12T17:15:53.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.786+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5b75f0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55796f5c6bb8 s->prefetch_data=0 2024-09-12T17:15:53.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.786+0000 7f040f6199c0 10 manifest: total_size = 0 2024-09-12T17:15:53.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.786+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13081411843207372394 2024-09-12T17:15:53.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.786+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5b75f0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55796f5c6bb8 s->prefetch_data=0 2024-09-12T17:15:53.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.786+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5c6bb8 2024-09-12T17:15:53.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.786+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6.0 2024-09-12T17:15:53.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.786+0000 7f02dffff640 20 handle_completion(): completion ok for obj=__ 2024-09-12T17:15:53.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.794+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5bfb90 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55796f5c6bb8 s->prefetch_data=0 2024-09-12T17:15:53.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.794+0000 7f040f6199c0 10 manifest: total_size = 0 2024-09-12T17:15:53.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.794+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2053183113705185028 2024-09-12T17:15:53.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.794+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5bfb90 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55796f5c6bb8 s->prefetch_data=0 2024-09-12T17:15:53.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.794+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5c6bb8 2024-09-12T17:15:53.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.794+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6.0 2024-09-12T17:15:53.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.794+0000 7f02f0ff9640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T17:15:53.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.798+0000 7f040f6199c0 20 get_obj_state: octx=0x7f0408009670 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55796f5c6bb8 s->prefetch_data=0 2024-09-12T17:15:53.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.802+0000 7f040f6199c0 10 manifest: total_size = 0 2024-09-12T17:15:53.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.802+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10620312826625245076 2024-09-12T17:15:53.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.802+0000 7f040f6199c0 20 get_obj_state: octx=0x7f0408009670 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55796f5c6bb8 s->prefetch_data=0 2024-09-12T17:15:53.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.802+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5c6bb8 2024-09-12T17:15:53.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.802+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6.0 2024-09-12T17:15:53.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.802+0000 7f02dffff640 20 handle_completion(): completion ok for obj=___ 2024-09-12T17:15:53.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.810+0000 7f040f6199c0 20 list_objects_ordered: starting attempt 1 2024-09-12T17:15:53.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.810+0000 7f040f6199c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T17:15:53.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.814+0000 7f02f0ff9640 20 handle_completion(): completion ok for obj=obj 2024-09-12T17:15:53.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.814+0000 7f040f6199c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:15:53.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.814+0000 7f040f6199c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:15:53.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.814+0000 7f040f6199c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:15:53.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.814+0000 7f040f6199c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:15:53.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.814+0000 7f040f6199c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6])"; uploads.size()=0; is_truncated=0 2024-09-12T17:15:53.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.818+0000 7f040f6199c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-09-12T17:15:53.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.818+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:53.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.818+0000 7f040f6199c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T17:15:53.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.818+0000 7f040f6199c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-09-12T17:15:53.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.818+0000 7f040f6199c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-09-12T17:15:53.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.822+0000 7f040f6199c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-09-12T17:15:53.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.822+0000 7f040f6199c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-09-12T17:15:53.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.822+0000 7f02dffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497059 cookie 93980047410496 notifier 5913 bl.length()=181 2024-09-12T17:15:53.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.826+0000 7f040f6199c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6 from cache 2024-09-12T17:15:53.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.826+0000 7f040f6199c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6, ofs0, ns] 2024-09-12T17:15:53.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.826+0000 7f02f0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496980 cookie 93980047421280 notifier 5913 bl.length()=238 2024-09-12T17:15:53.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.834+0000 7f040f6199c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6 : miss 2024-09-12T17:15:53.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.834+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:53.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.834+0000 7f040f6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:53.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.834+0000 7f040f6199c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6 info.flags=0x0 2024-09-12T17:15:53.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.834+0000 7f040f6199c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6 to cache LRU end 2024-09-12T17:15:53.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.838+0000 7f040f6199c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7 : miss 2024-09-12T17:15:53.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.838+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:53.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.838+0000 7f040f6199c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T17:15:53.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.838+0000 7f040f6199c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7 info.flags=0x17 2024-09-12T17:15:53.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.838+0000 7f040f6199c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7 to cache LRU end 2024-09-12T17:15:53.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.838+0000 7f040f6199c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:15:53.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.838+0000 7f040f6199c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:15:53.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.838+0000 7f040f6199c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7 2024-09-12T17:15:53.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.846+0000 7f040f6199c0 10 cls_bucket_list_unordered: got __ 2024-09-12T17:15:53.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.846+0000 7f040f6199c0 10 cls_bucket_list_unordered: got __ _ 2024-09-12T17:15:53.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.846+0000 7f040f6199c0 10 cls_bucket_list_unordered: got ___ 2024-09-12T17:15:53.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.846+0000 7f040f6199c0 10 cls_bucket_list_unordered: got obj 2024-09-12T17:15:53.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.846+0000 7f040f6199c0 20 get_obj_state: octx=0x7f04040023f0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55796f5c6b58 s->prefetch_data=0 2024-09-12T17:15:53.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.846+0000 7f040f6199c0 10 manifest: total_size = 24595 2024-09-12T17:15:53.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.846+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9411390627892628354 2024-09-12T17:15:53.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.846+0000 7f040f6199c0 20 get_obj_state: octx=0x7f04040023f0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55796f5c6b58 s->prefetch_data=0 2024-09-12T17:15:53.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.846+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5c6b58 2024-09-12T17:15:53.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.846+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7.0 2024-09-12T17:15:53.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.854+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.854+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=24595 stripe_ofs=24595 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.854+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9411390627892628354 2024-09-12T17:15:53.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.854+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.854+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7__shadow_.b8GHddobR4UJg28dOs1GKld7cei20nR_0 2024-09-12T17:15:53.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.854+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:15:53.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.854+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.854+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9411390627892628354 2024-09-12T17:15:53.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.854+0000 7f02f0ff9640 20 handle_completion(): completion ok for obj=__ 2024-09-12T17:15:53.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.854+0000 7f040f6199c0 20 get_obj_state: octx=0x7f04040023f0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55796f5c6b58 s->prefetch_data=0 2024-09-12T17:15:53.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.854+0000 7f040f6199c0 10 manifest: total_size = 38 2024-09-12T17:15:53.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.854+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14351286534416233137 2024-09-12T17:15:53.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.854+0000 7f040f6199c0 20 get_obj_state: octx=0x7f04040023f0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55796f5c6b58 s->prefetch_data=0 2024-09-12T17:15:53.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.854+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5c6b58 2024-09-12T17:15:53.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.854+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7.0 2024-09-12T17:15:53.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.862+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.862+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=38 stripe_ofs=38 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.862+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14351286534416233137 2024-09-12T17:15:53.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.862+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.862+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7__shadow_.VQUQsD5b1aoHpuU1P62fs27wlRWxaKP_0 2024-09-12T17:15:53.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.862+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:15:53.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.862+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.862+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14351286534416233137 2024-09-12T17:15:53.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.866+0000 7f040f6199c0 20 get_obj_state: octx=0x7f040804ba90 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55796f5c6b58 s->prefetch_data=0 2024-09-12T17:15:53.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.866+0000 7f02dffff640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T17:15:53.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.866+0000 7f040f6199c0 10 manifest: total_size = 527 2024-09-12T17:15:53.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.866+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3352295246188258220 2024-09-12T17:15:53.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.866+0000 7f040f6199c0 20 get_obj_state: octx=0x7f040804ba90 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55796f5c6b58 s->prefetch_data=0 2024-09-12T17:15:53.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.866+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5c6b58 2024-09-12T17:15:53.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.866+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7.0 2024-09-12T17:15:53.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.870+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.870+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=527 stripe_ofs=527 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.870+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3352295246188258220 2024-09-12T17:15:53.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.870+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.870+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7__shadow_.rwezzUmKduC5ae7BLm5PJsPeuywwcw7_0 2024-09-12T17:15:53.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.870+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:15:53.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.870+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.870+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3352295246188258220 2024-09-12T17:15:53.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.878+0000 7f02f0ff9640 20 handle_completion(): completion ok for obj=___ 2024-09-12T17:15:53.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.878+0000 7f040f6199c0 20 get_obj_state: octx=0x7f040011ffa0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55796f5c6b58 s->prefetch_data=0 2024-09-12T17:15:53.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.882+0000 7f040f6199c0 10 manifest: total_size = 24595 2024-09-12T17:15:53.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.882+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7168167979193286975 2024-09-12T17:15:53.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.882+0000 7f040f6199c0 20 get_obj_state: octx=0x7f040011ffa0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55796f5c6b58 s->prefetch_data=0 2024-09-12T17:15:53.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.882+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5c6b58 2024-09-12T17:15:53.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.882+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7.0 2024-09-12T17:15:53.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.886+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.886+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=24595 stripe_ofs=24595 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.886+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7168167979193286975 2024-09-12T17:15:53.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.886+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.886+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7__shadow_.WiavqF4yUgAHlK5AF7hEUeYevxyt6iH_0 2024-09-12T17:15:53.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.886+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:15:53.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.886+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.886+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7168167979193286975 2024-09-12T17:15:53.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.886+0000 7f02dffff640 20 handle_completion(): completion ok for obj=obj 2024-09-12T17:15:53.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.886+0000 7f040f6199c0 20 list_objects_ordered: starting attempt 1 2024-09-12T17:15:53.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.886+0000 7f040f6199c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T17:15:53.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.886+0000 7f040f6199c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:15:53.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.886+0000 7f040f6199c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:15:53.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.886+0000 7f040f6199c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:15:53.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.886+0000 7f040f6199c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:15:53.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.886+0000 7f040f6199c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7])"; uploads.size()=0; is_truncated=0 2024-09-12T17:15:53.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.890+0000 7f040f6199c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-09-12T17:15:53.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.890+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:53.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.898+0000 7f040f6199c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T17:15:53.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.898+0000 7f040f6199c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-09-12T17:15:53.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.898+0000 7f040f6199c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-09-12T17:15:53.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.898+0000 7f040f6199c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-09-12T17:15:53.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.898+0000 7f040f6199c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-09-12T17:15:53.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.898+0000 7f02f0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497060 cookie 93980047410496 notifier 5913 bl.length()=181 2024-09-12T17:15:53.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.902+0000 7f040f6199c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7 from cache 2024-09-12T17:15:53.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.902+0000 7f040f6199c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7, ofs0, ns] 2024-09-12T17:15:53.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.902+0000 7f02f0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496981 cookie 93980047421280 notifier 5913 bl.length()=238 2024-09-12T17:15:53.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.906+0000 7f040f6199c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7 : miss 2024-09-12T17:15:53.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.906+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:53.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.906+0000 7f040f6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:53.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.906+0000 7f040f6199c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7 info.flags=0x0 2024-09-12T17:15:53.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.906+0000 7f040f6199c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7 to cache LRU end 2024-09-12T17:15:53.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.914+0000 7f040f6199c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8 : miss 2024-09-12T17:15:53.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.914+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:53.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.914+0000 7f040f6199c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T17:15:53.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.914+0000 7f040f6199c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8 info.flags=0x17 2024-09-12T17:15:53.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.914+0000 7f040f6199c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8 to cache LRU end 2024-09-12T17:15:53.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.914+0000 7f040f6199c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:15:53.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.914+0000 7f040f6199c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:15:53.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.914+0000 7f040f6199c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8 2024-09-12T17:15:53.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.914+0000 7f040f6199c0 10 cls_bucket_list_unordered: got __ 2024-09-12T17:15:53.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.914+0000 7f040f6199c0 10 cls_bucket_list_unordered: got __ _ 2024-09-12T17:15:53.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.914+0000 7f040f6199c0 10 cls_bucket_list_unordered: got ___ 2024-09-12T17:15:53.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.914+0000 7f040f6199c0 10 cls_bucket_list_unordered: got obj 2024-09-12T17:15:53.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.914+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5b2440 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55796f5c6b58 s->prefetch_data=0 2024-09-12T17:15:53.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.918+0000 7f040f6199c0 10 manifest: total_size = 55 2024-09-12T17:15:53.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.918+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7912709036309557461 2024-09-12T17:15:53.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.918+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5b2440 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55796f5c6b58 s->prefetch_data=0 2024-09-12T17:15:53.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.918+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5c6b58 2024-09-12T17:15:53.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.918+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8.0 2024-09-12T17:15:53.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.922+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.922+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=55 stripe_ofs=55 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.922+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7912709036309557461 2024-09-12T17:15:53.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.922+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.922+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8__shadow_.xbD-3FHWR1LY-ELRZN4xRYulW4L-BLw_0 2024-09-12T17:15:53.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.922+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:15:53.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.922+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.922+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7912709036309557461 2024-09-12T17:15:53.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.926+0000 7f02f0ff9640 20 handle_completion(): completion ok for obj=__ 2024-09-12T17:15:53.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.926+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5b2440 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55796f5c6b58 s->prefetch_data=0 2024-09-12T17:15:53.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.930+0000 7f040f6199c0 10 manifest: total_size = 1035 2024-09-12T17:15:53.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.930+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12129352938183977356 2024-09-12T17:15:53.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.930+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5b2440 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55796f5c6b58 s->prefetch_data=0 2024-09-12T17:15:53.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.930+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5c6b58 2024-09-12T17:15:53.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.930+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8.0 2024-09-12T17:15:53.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.934+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.934+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=1035 stripe_ofs=1035 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.934+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12129352938183977356 2024-09-12T17:15:53.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.934+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.934+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8__shadow_.xvLW7x_ji3fEjnsUmChvQuKmi4DisZd_0 2024-09-12T17:15:53.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.934+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:15:53.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.934+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.934+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12129352938183977356 2024-09-12T17:15:53.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.938+0000 7f02dffff640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T17:15:53.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.938+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5b2440 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55796f5c6b58 s->prefetch_data=0 2024-09-12T17:15:53.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.938+0000 7f040f6199c0 10 manifest: total_size = 4134 2024-09-12T17:15:53.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.938+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13936637674301101088 2024-09-12T17:15:53.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.938+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5b2440 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55796f5c6b58 s->prefetch_data=0 2024-09-12T17:15:53.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.938+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5c6b58 2024-09-12T17:15:53.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.938+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8.0 2024-09-12T17:15:53.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.950+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.950+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=4134 stripe_ofs=4134 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.950+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13936637674301101088 2024-09-12T17:15:53.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.950+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.950+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8__shadow_.uBOXcBRohTBfuo-xQEaohyEbjnKg3Kd_0 2024-09-12T17:15:53.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.950+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:15:53.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.950+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.950+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13936637674301101088 2024-09-12T17:15:53.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.950+0000 7f02f0ff9640 20 handle_completion(): completion ok for obj=___ 2024-09-12T17:15:53.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.950+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5b2440 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55796f5c6b58 s->prefetch_data=0 2024-09-12T17:15:53.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.950+0000 7f040f6199c0 10 manifest: total_size = 1048576 2024-09-12T17:15:53.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.950+0000 7f040f6199c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17364181503872102680 2024-09-12T17:15:53.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.950+0000 7f040f6199c0 20 get_obj_state: octx=0x55796f5b2440 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55796f5c6b58 s->prefetch_data=0 2024-09-12T17:15:53.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.950+0000 7f040f6199c0 20 prepare_atomic_modification: state is not atomic. state=0x55796f5c6b58 2024-09-12T17:15:53.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.950+0000 7f040f6199c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8.0 2024-09-12T17:15:53.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.954+0000 7f040f6199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:15:53.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.954+0000 7f040f6199c0 20 RGWObjManifest::operator++(): result: ofs=1048576 stripe_ofs=1048576 part_ofs=0 rule->part_size=0 2024-09-12T17:15:53.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.954+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17364181503872102680 2024-09-12T17:15:53.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.954+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:15:53.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.954+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8__shadow_.dpQpDj2yFYAsmpMgKhuWEiEt7VNxbaL_0 2024-09-12T17:15:53.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.954+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:15:53.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.954+0000 7f040f6199c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:15:53.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.954+0000 7f040f6199c0 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17364181503872102680 2024-09-12T17:15:53.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.958+0000 7f02dffff640 20 handle_completion(): completion ok for obj=obj 2024-09-12T17:15:53.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.958+0000 7f040f6199c0 20 list_objects_ordered: starting attempt 1 2024-09-12T17:15:53.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.958+0000 7f040f6199c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T17:15:53.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.962+0000 7f040f6199c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:15:53.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.962+0000 7f040f6199c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:15:53.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.962+0000 7f040f6199c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:15:53.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.962+0000 7f040f6199c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:15:53.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.962+0000 7f040f6199c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8])"; uploads.size()=0; is_truncated=0 2024-09-12T17:15:53.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.966+0000 7f040f6199c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-09-12T17:15:53.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.966+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:53.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.966+0000 7f040f6199c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T17:15:53.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.966+0000 7f040f6199c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-09-12T17:15:53.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.966+0000 7f040f6199c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-09-12T17:15:53.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.970+0000 7f040f6199c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-09-12T17:15:53.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.970+0000 7f040f6199c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-09-12T17:15:53.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.970+0000 7f02f0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497061 cookie 93980047410496 notifier 5913 bl.length()=181 2024-09-12T17:15:53.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.978+0000 7f040f6199c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8 from cache 2024-09-12T17:15:53.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.978+0000 7f040f6199c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8, ofs0, ns] 2024-09-12T17:15:53.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.978+0000 7f02f0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496982 cookie 93980047421280 notifier 5913 bl.length()=238 2024-09-12T17:15:53.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.978+0000 7f040f6199c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8 : miss 2024-09-12T17:15:53.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.978+0000 7f040f6199c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:53.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.978+0000 7f040f6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:53.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.978+0000 7f040f6199c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8 info.flags=0x0 2024-09-12T17:15:53.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.978+0000 7f040f6199c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8 to cache LRU end 2024-09-12T17:15:53.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.986+0000 7f040f6199c0 10 removing key index: UAPVZTHPLBOMOHGESCNY 2024-09-12T17:15:53.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.986+0000 7f040f6199c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:UAPVZTHPLBOMOHGESCNY, ofs0, ns] 2024-09-12T17:15:53.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.990+0000 7f02f0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496982 cookie 93980047427312 notifier 5913 bl.length()=170 2024-09-12T17:15:53.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.990+0000 7f040f6199c0 10 removing email index: ragweed.client.0+test@test.test 2024-09-12T17:15:53.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.994+0000 7f040f6199c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T17:15:53.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.994+0000 7f02dffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496987 cookie 93980047418048 notifier 5913 bl.length()=182 2024-09-12T17:15:53.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.994+0000 7f040f6199c0 10 removing user buckets index 2024-09-12T17:15:54.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.998+0000 7f040f6199c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-09-12T17:15:54.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.998+0000 7f02dffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496983 cookie 93980047427312 notifier 5913 bl.length()=173 2024-09-12T17:15:54.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:53.998+0000 7f040f6199c0 10 removing user index: ragweed.client.0 2024-09-12T17:15:54.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.002+0000 7f040f6199c0 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-09-12T17:15:54.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.002+0000 7f040f6199c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T17:15:54.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.002+0000 7f02f0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496997 cookie 93980047425056 notifier 5913 bl.length()=165 2024-09-12T17:15:54.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.006+0000 7f02c3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:15:54.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.014+0000 7f040f6199c0 20 remove_watcher() i=0 2024-09-12T17:15:54.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.014+0000 7f040f6199c0 2 removed watcher, disabling cache 2024-09-12T17:15:54.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.014+0000 7f040f6199c0 20 remove_watcher() i=1 2024-09-12T17:15:54.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.018+0000 7f040f6199c0 20 remove_watcher() i=2 2024-09-12T17:15:54.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.026+0000 7f040f6199c0 20 remove_watcher() i=3 2024-09-12T17:15:54.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.026+0000 7f040f6199c0 20 remove_watcher() i=4 2024-09-12T17:15:54.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.026+0000 7f040f6199c0 20 remove_watcher() i=5 2024-09-12T17:15:54.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.026+0000 7f040f6199c0 20 remove_watcher() i=6 2024-09-12T17:15:54.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.030+0000 7f040f6199c0 20 remove_watcher() i=7 2024-09-12T17:15:54.054 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-09-12T17:15:54.135 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:15:54.135 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:15:54.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.174+0000 7fd706ea79c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:54.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.178+0000 7fd706ea79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:54.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.178+0000 7fd706ea79c0 20 realm 2024-09-12T17:15:54.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.178+0000 7fd706ea79c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:54.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.178+0000 7fd706ea79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:54.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.178+0000 7fd706ea79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:15:54.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.178+0000 7fd706ea79c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:54.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.178+0000 7fd706ea79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:54.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.178+0000 7fd706ea79c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:54.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.178+0000 7fd706ea79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:15:54.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.178+0000 7fd706ea79c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:54.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.182+0000 7fd706ea79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:15:54.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.182+0000 7fd706ea79c0 20 searching for the correct realm 2024-09-12T17:15:54.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.186+0000 7fd7051ae640 0 -- 172.21.15.16:0/3487746799 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fd6f808e070 msgr2=0x7fd6f805cba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:15:54.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.402+0000 7fd7041ac640 0 -- 172.21.15.16:0/3487746799 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fd6f4097210 msgr2=0x7fd6f40900c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:15:54.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.618+0000 7fd706ea79c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:15:54.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.618+0000 7fd706ea79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:15:54.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.618+0000 7fd706ea79c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:15:54.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.618+0000 7fd706ea79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:15:54.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.618+0000 7fd706ea79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:15:54.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.618+0000 7fd706ea79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:15:54.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.618+0000 7fd706ea79c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:54.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.618+0000 7fd706ea79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:54.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.618+0000 7fd706ea79c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:54.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.622+0000 7fd706ea79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:15:54.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.622+0000 7fd706ea79c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:54.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.622+0000 7fd706ea79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:15:54.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.622+0000 7fd706ea79c0 20 zone default found 2024-09-12T17:15:54.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.622+0000 7fd706ea79c0 4 Realm: () 2024-09-12T17:15:54.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.622+0000 7fd706ea79c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:15:54.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.622+0000 7fd706ea79c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:15:54.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.622+0000 7fd706ea79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:15:54.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.622+0000 7fd706ea79c0 20 zonegroup default 2024-09-12T17:15:54.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.622+0000 7fd706ea79c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:54.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.622+0000 7fd706ea79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:54.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.622+0000 7fd706ea79c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:54.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.622+0000 7fd706ea79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:54.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.622+0000 7fd706ea79c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:54.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.622+0000 7fd706ea79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:15:54.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.622+0000 7fd706ea79c0 20 started sync module instance, tier type = 2024-09-12T17:15:54.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.622+0000 7fd706ea79c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:15:54.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.650+0000 7fd706ea79c0 20 add_watcher() i=0 2024-09-12T17:15:54.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.650+0000 7fd706ea79c0 20 add_watcher() i=1 2024-09-12T17:15:54.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.650+0000 7fd706ea79c0 20 add_watcher() i=2 2024-09-12T17:15:54.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.650+0000 7fd706ea79c0 20 add_watcher() i=3 2024-09-12T17:15:54.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.650+0000 7fd706ea79c0 20 add_watcher() i=4 2024-09-12T17:15:54.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.650+0000 7fd706ea79c0 20 add_watcher() i=5 2024-09-12T17:15:54.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.650+0000 7fd706ea79c0 20 add_watcher() i=6 2024-09-12T17:15:54.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.650+0000 7fd706ea79c0 20 add_watcher() i=7 2024-09-12T17:15:54.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.650+0000 7fd706ea79c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:15:54.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.654+0000 7fd5bafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:15:54.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.654+0000 7fd706ea79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:15:54.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.654+0000 7fd706ea79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:15:54.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.754+0000 7fd5b9fe3640 20 reqs_thread_entry: start 2024-09-12T17:15:54.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.754+0000 7fd706ea79c0 20 init_complete bucket index max shards: 1 2024-09-12T17:15:54.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.754+0000 7fd706ea79c0 20 Filter name: none 2024-09-12T17:15:54.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.754+0000 7fd52b7fe640 20 reqs_thread_entry: start 2024-09-12T17:15:54.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.754+0000 7fd706ea79c0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T17:15:54.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.754+0000 7fd706ea79c0 20 rados->read ofs=0 len=0 2024-09-12T17:15:54.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.754+0000 7fd706ea79c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T17:15:54.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.754+0000 7fd706ea79c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-09-12T17:15:54.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.754+0000 7fd706ea79c0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T17:15:54.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.754+0000 7fd706ea79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:15:54.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.758+0000 7fd706ea79c0 10 removing key index: FLBDMDVYYKXZVVCNOYNS 2024-09-12T17:15:54.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.758+0000 7fd706ea79c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.keys:FLBDMDVYYKXZVVCNOYNS, ofs0, ns] 2024-09-12T17:15:54.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.762+0000 7fd5dbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496998 cookie 93990782301568 notifier 5934 bl.length()=170 2024-09-12T17:15:54.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.762+0000 7fd706ea79c0 10 removing email index: sysuser.client.0+test@test.test 2024-09-12T17:15:54.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.766+0000 7fd706ea79c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T17:15:54.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.766+0000 7fd5db7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496999 cookie 93990782310976 notifier 5934 bl.length()=182 2024-09-12T17:15:54.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.766+0000 7fd706ea79c0 10 removing user buckets index 2024-09-12T17:15:54.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.770+0000 7fd706ea79c0 10 removing user index: sysuser.client.0 2024-09-12T17:15:54.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.770+0000 7fd706ea79c0 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-09-12T17:15:54.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.770+0000 7fd706ea79c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T17:15:54.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.774+0000 7fd5db7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496988 cookie 93990782312176 notifier 5934 bl.length()=165 2024-09-12T17:15:54.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.774+0000 7fd5bafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:15:54.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.782+0000 7fd706ea79c0 20 remove_watcher() i=0 2024-09-12T17:15:54.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.782+0000 7fd706ea79c0 2 removed watcher, disabling cache 2024-09-12T17:15:54.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.782+0000 7fd706ea79c0 20 remove_watcher() i=1 2024-09-12T17:15:54.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.786+0000 7fd706ea79c0 20 remove_watcher() i=2 2024-09-12T17:15:54.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.786+0000 7fd706ea79c0 20 remove_watcher() i=3 2024-09-12T17:15:54.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.790+0000 7fd706ea79c0 20 remove_watcher() i=4 2024-09-12T17:15:54.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.790+0000 7fd706ea79c0 20 remove_watcher() i=5 2024-09-12T17:15:54.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.794+0000 7fd706ea79c0 20 remove_watcher() i=6 2024-09-12T17:15:54.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:15:54.794+0000 7fd706ea79c0 20 remove_watcher() i=7 2024-09-12T17:15:54.809 INFO:tasks.ragweed:Removing ragweed... 2024-09-12T17:15:54.810 DEBUG:teuthology.orchestra.run.smithi016:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T17:15:54.897 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:15:54.907 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:15:54.908 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:15:54.908 DEBUG:teuthology.orchestra.run.smithi016:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:15:54.913 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:15:54.913 INFO:teuthology.orchestra.run.smithi016.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:15:54.913 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:15:54.960 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:15:54.960 DEBUG:teuthology.orchestra.run.smithi016:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:15:55.008 INFO:tasks.workunit:timeout=3h 2024-09-12T17:15:55.008 INFO:tasks.workunit:cleanup=True 2024-09-12T17:15:55.008 DEBUG:teuthology.orchestra.run.smithi016:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:15:55.059 INFO:tasks.workunit.client.0.smithi016.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:16:52.744 INFO:tasks.workunit.client.0.smithi016.stderr:Updating files: 94% (12023/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-12T17:16:53.586 INFO:tasks.workunit.client.0.smithi016.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:16:53.586 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:16:53.586 INFO:tasks.workunit.client.0.smithi016.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:16:53.586 INFO:tasks.workunit.client.0.smithi016.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:16:53.586 INFO:tasks.workunit.client.0.smithi016.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:16:53.586 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:16:53.586 INFO:tasks.workunit.client.0.smithi016.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:16:53.586 INFO:tasks.workunit.client.0.smithi016.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:16:53.586 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:16:53.586 INFO:tasks.workunit.client.0.smithi016.stderr: git switch -c 2024-09-12T17:16:53.587 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:16:53.587 INFO:tasks.workunit.client.0.smithi016.stderr:Or undo this operation with: 2024-09-12T17:16:53.587 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:16:53.587 INFO:tasks.workunit.client.0.smithi016.stderr: git switch - 2024-09-12T17:16:53.587 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:16:53.587 INFO:tasks.workunit.client.0.smithi016.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:16:53.587 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:16:53.587 INFO:tasks.workunit.client.0.smithi016.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:16:53.594 DEBUG:teuthology.orchestra.run.smithi016:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:16:53.645 INFO:tasks.workunit.client.0.smithi016.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:16:53.648 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:16:53.648 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:16:53.707 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:16:53.762 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:16:53.807 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:16:53.809 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:16:53.809 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:16:53.856 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:16:53.859 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-12T17:16:53.859 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:16:53.905 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-09-12T17:16:53.906 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-09-12T17:16:53.907 DEBUG:teuthology.orchestra.run.smithi016:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T17:16:53.961 INFO:tasks.workunit.client.0.smithi016.stderr:+ ulimit -c 0 2024-09-12T17:16:53.961 INFO:tasks.workunit.client.0.smithi016.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T17:16:53.962 INFO:tasks.workunit.client.0.smithi016.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:16:53.962 INFO:tasks.workunit.client.0.smithi016.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:16:56.966 INFO:tasks.workunit.client.0.smithi016.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T17:16:56.967 INFO:tasks.workunit.client.0.smithi016.stderr:++ deactivate nondestructive 2024-09-12T17:16:56.967 INFO:tasks.workunit.client.0.smithi016.stderr:++ '[' -n '' ']' 2024-09-12T17:16:56.967 INFO:tasks.workunit.client.0.smithi016.stderr:++ '[' -n '' ']' 2024-09-12T17:16:56.967 INFO:tasks.workunit.client.0.smithi016.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:16:56.967 INFO:tasks.workunit.client.0.smithi016.stderr:++ hash -r 2024-09-12T17:16:56.967 INFO:tasks.workunit.client.0.smithi016.stderr:++ '[' -n '' ']' 2024-09-12T17:16:56.967 INFO:tasks.workunit.client.0.smithi016.stderr:++ unset VIRTUAL_ENV 2024-09-12T17:16:56.967 INFO:tasks.workunit.client.0.smithi016.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-12T17:16:56.967 INFO:tasks.workunit.client.0.smithi016.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T17:16:56.968 INFO:tasks.workunit.client.0.smithi016.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:16:56.968 INFO:tasks.workunit.client.0.smithi016.stderr:++ export VIRTUAL_ENV 2024-09-12T17:16:56.968 INFO:tasks.workunit.client.0.smithi016.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T17:16:56.968 INFO:tasks.workunit.client.0.smithi016.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T17:16:56.969 INFO:tasks.workunit.client.0.smithi016.stderr:++ export PATH 2024-09-12T17:16:56.969 INFO:tasks.workunit.client.0.smithi016.stderr:++ '[' -n '' ']' 2024-09-12T17:16:56.969 INFO:tasks.workunit.client.0.smithi016.stderr:++ '[' -z '' ']' 2024-09-12T17:16:56.969 INFO:tasks.workunit.client.0.smithi016.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T17:16:56.969 INFO:tasks.workunit.client.0.smithi016.stderr:++ PS1='(rgw) ' 2024-09-12T17:16:56.969 INFO:tasks.workunit.client.0.smithi016.stderr:++ export PS1 2024-09-12T17:16:56.969 INFO:tasks.workunit.client.0.smithi016.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-12T17:16:56.969 INFO:tasks.workunit.client.0.smithi016.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-12T17:16:56.969 INFO:tasks.workunit.client.0.smithi016.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:16:56.970 INFO:tasks.workunit.client.0.smithi016.stderr:++ hash -r 2024-09-12T17:16:56.970 INFO:tasks.workunit.client.0.smithi016.stderr:+ pip install pip --upgrade 2024-09-12T17:16:57.371 INFO:tasks.workunit.client.0.smithi016.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T17:16:57.581 INFO:tasks.workunit.client.0.smithi016.stdout:Collecting pip 2024-09-12T17:16:57.587 INFO:tasks.workunit.client.0.smithi016.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T17:16:57.623 INFO:tasks.workunit.client.0.smithi016.stdout:Installing collected packages: pip 2024-09-12T17:16:57.623 INFO:tasks.workunit.client.0.smithi016.stdout: Attempting uninstall: pip 2024-09-12T17:16:57.623 INFO:tasks.workunit.client.0.smithi016.stdout: Found existing installation: pip 22.0.2 2024-09-12T17:16:57.898 INFO:tasks.workunit.client.0.smithi016.stdout: Uninstalling pip-22.0.2: 2024-09-12T17:16:57.905 INFO:tasks.workunit.client.0.smithi016.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T17:16:58.685 INFO:tasks.workunit.client.0.smithi016.stdout:Successfully installed pip-24.2 2024-09-12T17:16:58.749 INFO:tasks.workunit.client.0.smithi016.stderr:+ pip install boto3 2024-09-12T17:16:59.722 INFO:tasks.workunit.client.0.smithi016.stdout:Collecting boto3 2024-09-12T17:16:59.723 INFO:tasks.workunit.client.0.smithi016.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T17:17:00.239 INFO:tasks.workunit.client.0.smithi016.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T17:17:00.240 INFO:tasks.workunit.client.0.smithi016.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T17:17:00.306 INFO:tasks.workunit.client.0.smithi016.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T17:17:00.307 INFO:tasks.workunit.client.0.smithi016.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T17:17:00.359 INFO:tasks.workunit.client.0.smithi016.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T17:17:00.361 INFO:tasks.workunit.client.0.smithi016.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T17:17:00.421 INFO:tasks.workunit.client.0.smithi016.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:17:00.423 INFO:tasks.workunit.client.0.smithi016.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T17:17:00.528 INFO:tasks.workunit.client.0.smithi016.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:17:00.529 INFO:tasks.workunit.client.0.smithi016.stdout: Using cached urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB) 2024-09-12T17:17:00.755 INFO:tasks.workunit.client.0.smithi016.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:17:00.756 INFO:tasks.workunit.client.0.smithi016.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T17:17:00.760 INFO:tasks.workunit.client.0.smithi016.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T17:17:00.761 INFO:tasks.workunit.client.0.smithi016.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T17:17:00.772 INFO:tasks.workunit.client.0.smithi016.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T17:17:00.773 INFO:tasks.workunit.client.0.smithi016.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T17:17:00.775 INFO:tasks.workunit.client.0.smithi016.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T17:17:00.776 INFO:tasks.workunit.client.0.smithi016.stdout:Using cached urllib3-2.2.3-py3-none-any.whl (126 kB) 2024-09-12T17:17:00.777 INFO:tasks.workunit.client.0.smithi016.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T17:17:00.852 INFO:tasks.workunit.client.0.smithi016.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T17:17:01.978 INFO:tasks.workunit.client.0.smithi016.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.3 2024-09-12T17:17:02.181 INFO:tasks.workunit.client.0.smithi016.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-09-12T17:17:02.331 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-09-12T17:17:02.372 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:17:02.372 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:17:02.419 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.417+0000 7f1d83b399c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:02.420 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.421+0000 7f1d83b399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:02.420 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.421+0000 7f1d83b399c0 20 realm 2024-09-12T17:17:02.420 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.421+0000 7f1d83b399c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:02.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.421+0000 7f1d83b399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:02.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.421+0000 7f1d83b399c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:17:02.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.421+0000 7f1d83b399c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:02.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.421+0000 7f1d83b399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:02.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.421+0000 7f1d83b399c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:02.422 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.421+0000 7f1d83b399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:02.422 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.421+0000 7f1d83b399c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:02.424 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.425+0000 7f1d83b399c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:17:02.424 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.425+0000 7f1d83b399c0 20 searching for the correct realm 2024-09-12T17:17:02.427 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.425+0000 7f1d81e40640 0 -- 172.21.15.16:0/856581757 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f1d78123130 msgr2=0x7f1d780fd1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:17:02.643 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.641+0000 7f1d80e3e640 0 -- 172.21.15.16:0/856581757 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f1d7c054410 msgr2=0x7f1d7c054890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:02.859 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.857+0000 7f1d83b399c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:17:02.860 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.857+0000 7f1d83b399c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:17:02.860 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.857+0000 7f1d83b399c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:17:02.860 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.857+0000 7f1d83b399c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:17:02.860 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.857+0000 7f1d83b399c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:17:02.860 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.857+0000 7f1d83b399c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:17:02.860 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.857+0000 7f1d83b399c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:02.860 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.857+0000 7f1d83b399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:02.860 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.857+0000 7f1d83b399c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:02.861 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.861+0000 7f1d83b399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:02.861 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.861+0000 7f1d83b399c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:02.862 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.861+0000 7f1d83b399c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:17:02.862 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.861+0000 7f1d83b399c0 20 zone default found 2024-09-12T17:17:02.862 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.861+0000 7f1d83b399c0 4 Realm: () 2024-09-12T17:17:02.862 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.861+0000 7f1d83b399c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:17:02.862 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.861+0000 7f1d83b399c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:17:02.862 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.861+0000 7f1d83b399c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:17:02.862 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.861+0000 7f1d83b399c0 20 zonegroup default 2024-09-12T17:17:02.862 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.861+0000 7f1d83b399c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:02.863 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.861+0000 7f1d83b399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:02.863 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.861+0000 7f1d83b399c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:02.863 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.861+0000 7f1d83b399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:02.863 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.861+0000 7f1d83b399c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:02.864 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.865+0000 7f1d83b399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:02.864 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.865+0000 7f1d83b399c0 20 started sync module instance, tier type = 2024-09-12T17:17:02.864 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.865+0000 7f1d83b399c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:17:02.886 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.885+0000 7f1d83b399c0 20 add_watcher() i=0 2024-09-12T17:17:02.887 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.885+0000 7f1d83b399c0 20 add_watcher() i=1 2024-09-12T17:17:02.887 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.885+0000 7f1d83b399c0 20 add_watcher() i=2 2024-09-12T17:17:02.887 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.885+0000 7f1d83b399c0 20 add_watcher() i=3 2024-09-12T17:17:02.887 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.885+0000 7f1d83b399c0 20 add_watcher() i=4 2024-09-12T17:17:02.887 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.885+0000 7f1d83b399c0 20 add_watcher() i=5 2024-09-12T17:17:02.887 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.885+0000 7f1d83b399c0 20 add_watcher() i=6 2024-09-12T17:17:02.889 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.889+0000 7f1d83b399c0 20 add_watcher() i=7 2024-09-12T17:17:02.889 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.889+0000 7f1d83b399c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:17:02.893 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.893+0000 7f1c37fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:02.894 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.893+0000 7f1d83b399c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:17:02.895 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.893+0000 7f1d83b399c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:17:02.895 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.893+0000 7f1d83b399c0 5 note: GC not initialized 2024-09-12T17:17:02.898 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.893+0000 7f1c36fe5640 20 reqs_thread_entry: start 2024-09-12T17:17:02.898 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.893+0000 7f1d83b399c0 20 init_complete bucket index max shards: 1 2024-09-12T17:17:02.898 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.893+0000 7f1d83b399c0 20 Filter name: none 2024-09-12T17:17:02.898 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.897+0000 7f1c34fe1640 20 reqs_thread_entry: start 2024-09-12T17:17:02.898 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.897+0000 7f1d83b399c0 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-09-12T17:17:02.898 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.897+0000 7f1d83b399c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:02.898 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.897+0000 7f1d83b399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:02.898 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.897+0000 7f1d83b399c0 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-09-12T17:17:02.898 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.897+0000 7f1d83b399c0 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T17:17:02.898 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.897+0000 7f1d83b399c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-12T17:17:02.898 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.897+0000 7f1d83b399c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:02.898 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.897+0000 7f1d83b399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:02.899 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.897+0000 7f1d83b399c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-12T17:17:02.899 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.897+0000 7f1d83b399c0 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T17:17:02.899 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.897+0000 7f1d83b399c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-12T17:17:02.899 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.897+0000 7f1d83b399c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-12T17:17:02.900 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.897+0000 7f1d83b399c0 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-12T17:17:02.900 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.897+0000 7f1d83b399c0 10 moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T17:17:02.900 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.901+0000 7f1d83b399c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester, ofs0, ns] 2024-09-12T17:17:02.900 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.901+0000 7f1c64ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431576 cookie 94481960853472 notifier 5723 bl.length()=569 2024-09-12T17:17:02.900 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.901+0000 7f1c64ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-12T17:17:02.900 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.901+0000 7f1c64ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T17:17:02.902 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.901+0000 7f1d83b399c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-12T17:17:02.902 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.901+0000 7f1d83b399c0 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T17:17:02.902 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.901+0000 7f1d83b399c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-12T17:17:02.903 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.901+0000 7f1c64ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431577 cookie 94481960850832 notifier 5723 bl.length()=180 2024-09-12T17:17:02.903 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.901+0000 7f1c64ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-12T17:17:02.903 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.901+0000 7f1c64ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T17:17:02.905 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.905+0000 7f1c37fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:02.910 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.909+0000 7f1d83b399c0 20 remove_watcher() i=0 2024-09-12T17:17:02.910 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.909+0000 7f1d83b399c0 2 removed watcher, disabling cache 2024-09-12T17:17:02.912 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.913+0000 7f1d83b399c0 20 remove_watcher() i=1 2024-09-12T17:17:02.914 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.913+0000 7f1d83b399c0 20 remove_watcher() i=2 2024-09-12T17:17:02.917 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.917+0000 7f1d83b399c0 20 remove_watcher() i=3 2024-09-12T17:17:02.919 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.917+0000 7f1d83b399c0 20 remove_watcher() i=4 2024-09-12T17:17:02.921 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.921+0000 7f1d83b399c0 20 remove_watcher() i=5 2024-09-12T17:17:02.922 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.921+0000 7f1d83b399c0 20 remove_watcher() i=6 2024-09-12T17:17:02.924 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:02.925+0000 7f1d83b399c0 20 remove_watcher() i=7 2024-09-12T17:17:03.205 INFO:tasks.workunit.client.0.smithi016.stderr:TEST: reshard add 2024-09-12T17:17:03.205 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:03.205 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:17:03.239 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:17:03.239 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:17:03.285 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.285+0000 7ffbc75b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:03.288 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.289+0000 7ffbc75b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:03.288 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.289+0000 7ffbc75b49c0 20 realm 2024-09-12T17:17:03.288 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.289+0000 7ffbc75b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:03.288 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.289+0000 7ffbc75b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:03.288 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.289+0000 7ffbc75b49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:17:03.288 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.289+0000 7ffbc75b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:03.289 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.289+0000 7ffbc75b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:03.289 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.289+0000 7ffbc75b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:03.290 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.289+0000 7ffbc75b49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:03.290 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.289+0000 7ffbc75b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:03.292 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.293+0000 7ffbc75b49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:17:03.292 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.293+0000 7ffbc75b49c0 20 searching for the correct realm 2024-09-12T17:17:03.296 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.297+0000 7ffbc48b9640 0 -- 172.21.15.16:0/2054112404 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7ffbb8024930 msgr2=0x7ffbb8017400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:03.303 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.301+0000 7ffbc48b9640 0 -- 172.21.15.16:0/2054112404 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7ffbc0094040 msgr2=0x7ffbc00965d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:17:03.520 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.517+0000 7ffbc75b49c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:17:03.520 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.517+0000 7ffbc75b49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:17:03.520 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.517+0000 7ffbc75b49c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:17:03.520 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.517+0000 7ffbc75b49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:17:03.520 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.517+0000 7ffbc75b49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:17:03.520 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.517+0000 7ffbc75b49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:17:03.521 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.517+0000 7ffbc75b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:03.521 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.521+0000 7ffbc75b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:03.521 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.521+0000 7ffbc75b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:03.521 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.521+0000 7ffbc75b49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:03.521 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.521+0000 7ffbc75b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:03.522 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.521+0000 7ffbc75b49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:17:03.522 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.521+0000 7ffbc75b49c0 20 zone default found 2024-09-12T17:17:03.522 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.521+0000 7ffbc75b49c0 4 Realm: () 2024-09-12T17:17:03.522 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.521+0000 7ffbc75b49c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:17:03.522 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.521+0000 7ffbc75b49c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:17:03.522 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.521+0000 7ffbc75b49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:17:03.523 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.521+0000 7ffbc75b49c0 20 zonegroup default 2024-09-12T17:17:03.523 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.521+0000 7ffbc75b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:03.523 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.521+0000 7ffbc75b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:03.523 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.521+0000 7ffbc75b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:03.524 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.525+0000 7ffbc75b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:03.524 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.525+0000 7ffbc75b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:03.525 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.525+0000 7ffbc75b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:03.525 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.525+0000 7ffbc75b49c0 20 started sync module instance, tier type = 2024-09-12T17:17:03.525 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.525+0000 7ffbc75b49c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:17:03.549 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.549+0000 7ffbc75b49c0 20 add_watcher() i=0 2024-09-12T17:17:03.549 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.549+0000 7ffbc75b49c0 20 add_watcher() i=1 2024-09-12T17:17:03.549 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.549+0000 7ffbc75b49c0 20 add_watcher() i=2 2024-09-12T17:17:03.549 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.549+0000 7ffbc75b49c0 20 add_watcher() i=3 2024-09-12T17:17:03.549 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.549+0000 7ffbc75b49c0 20 add_watcher() i=4 2024-09-12T17:17:03.549 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.549+0000 7ffbc75b49c0 20 add_watcher() i=5 2024-09-12T17:17:03.549 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.549+0000 7ffbc75b49c0 20 add_watcher() i=6 2024-09-12T17:17:03.552 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.553+0000 7ffbc75b49c0 20 add_watcher() i=7 2024-09-12T17:17:03.552 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.553+0000 7ffbc75b49c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:17:03.556 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.557+0000 7ffa7b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:03.557 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.557+0000 7ffbc75b49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:17:03.557 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.557+0000 7ffbc75b49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:17:03.557 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.557+0000 7ffbc75b49c0 5 note: GC not initialized 2024-09-12T17:17:03.558 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.557+0000 7ffa7a7e4640 20 reqs_thread_entry: start 2024-09-12T17:17:03.558 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.557+0000 7ffbc75b49c0 20 init_complete bucket index max shards: 1 2024-09-12T17:17:03.558 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.557+0000 7ffbc75b49c0 20 Filter name: none 2024-09-12T17:17:03.558 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.557+0000 7ff9ebfff640 20 reqs_thread_entry: start 2024-09-12T17:17:03.558 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.557+0000 7ffbc75b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:03.560 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.561+0000 7ffbc75b49c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:17:03.560 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.561+0000 7ffbc75b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:03.561 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.561+0000 7ffbc75b49c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:17:03.561 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.561+0000 7ffbc75b49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:17:03.561 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.561+0000 7ffbc75b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:03.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.561+0000 7ffbc75b49c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:17:03.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.561+0000 7ffbc75b49c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:03.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.561+0000 7ffbc75b49c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:17:03.563 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.561+0000 7ffbc75b49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:17:03.565 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.565+0000 7ffa7b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:03.570 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.569+0000 7ffbc75b49c0 20 remove_watcher() i=0 2024-09-12T17:17:03.570 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.569+0000 7ffbc75b49c0 2 removed watcher, disabling cache 2024-09-12T17:17:03.573 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.573+0000 7ffbc75b49c0 20 remove_watcher() i=1 2024-09-12T17:17:03.575 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.573+0000 7ffbc75b49c0 20 remove_watcher() i=2 2024-09-12T17:17:03.577 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.577+0000 7ffbc75b49c0 20 remove_watcher() i=3 2024-09-12T17:17:03.580 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.581+0000 7ffbc75b49c0 20 remove_watcher() i=4 2024-09-12T17:17:03.581 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.581+0000 7ffbc75b49c0 20 remove_watcher() i=5 2024-09-12T17:17:03.583 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.585+0000 7ffbc75b49c0 20 remove_watcher() i=6 2024-09-12T17:17:03.585 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.585+0000 7ffbc75b49c0 20 remove_watcher() i=7 2024-09-12T17:17:03.603 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:03.604 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:17:03.604 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: a-bucket id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 num_objects: 0 size_kb: 0 num_shards: 1 2024-09-12T17:17:03.604 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:03.604 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 2 2024-09-12T17:17:03.640 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:17:03.640 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:17:03.688 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.689+0000 7f7ad0a899c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:03.690 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.689+0000 7f7ad0a899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:03.690 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.689+0000 7f7ad0a899c0 20 realm 2024-09-12T17:17:03.690 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.689+0000 7f7ad0a899c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:03.690 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.689+0000 7f7ad0a899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:03.690 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.689+0000 7f7ad0a899c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:17:03.691 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.689+0000 7f7ad0a899c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:03.691 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.689+0000 7f7ad0a899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:03.691 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.689+0000 7f7ad0a899c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:03.692 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.693+0000 7f7ad0a899c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:03.692 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.693+0000 7f7ad0a899c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:03.694 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.693+0000 7f7ad0a899c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:17:03.694 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.693+0000 7f7ad0a899c0 20 searching for the correct realm 2024-09-12T17:17:03.695 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.693+0000 7f7acdd8e640 0 -- 172.21.15.16:0/2511755336 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7f7ac00b3040 msgr2=0x7f7ac00f6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:03.912 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.913+0000 7f7aced90640 0 -- 172.21.15.16:0/2511755336 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f7ac401c040 msgr2=0x7f7ac4063400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:03.930 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.929+0000 7f7ad0a899c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:17:03.930 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.929+0000 7f7ad0a899c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:17:03.930 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.929+0000 7f7ad0a899c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:17:03.930 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.929+0000 7f7ad0a899c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:17:03.930 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.929+0000 7f7ad0a899c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:17:03.930 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.929+0000 7f7ad0a899c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:17:03.930 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.929+0000 7f7ad0a899c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:03.931 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.929+0000 7f7ad0a899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:03.931 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.929+0000 7f7ad0a899c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:03.931 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.929+0000 7f7ad0a899c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:03.931 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.929+0000 7f7ad0a899c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:03.932 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.933+0000 7f7ad0a899c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:17:03.932 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.933+0000 7f7ad0a899c0 20 zone default found 2024-09-12T17:17:03.932 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.933+0000 7f7ad0a899c0 4 Realm: () 2024-09-12T17:17:03.932 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.933+0000 7f7ad0a899c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:17:03.932 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.933+0000 7f7ad0a899c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:17:03.933 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.933+0000 7f7ad0a899c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:17:03.933 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.933+0000 7f7ad0a899c0 20 zonegroup default 2024-09-12T17:17:03.933 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.933+0000 7f7ad0a899c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:03.933 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.933+0000 7f7ad0a899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:03.933 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.933+0000 7f7ad0a899c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:03.934 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.933+0000 7f7ad0a899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:03.934 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.933+0000 7f7ad0a899c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:03.934 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.933+0000 7f7ad0a899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:03.934 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.933+0000 7f7ad0a899c0 20 started sync module instance, tier type = 2024-09-12T17:17:03.935 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.933+0000 7f7ad0a899c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:17:03.956 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.957+0000 7f7ad0a899c0 20 add_watcher() i=0 2024-09-12T17:17:03.956 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.957+0000 7f7ad0a899c0 20 add_watcher() i=1 2024-09-12T17:17:03.957 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.957+0000 7f7ad0a899c0 20 add_watcher() i=2 2024-09-12T17:17:03.957 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.957+0000 7f7ad0a899c0 20 add_watcher() i=3 2024-09-12T17:17:03.957 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.957+0000 7f7ad0a899c0 20 add_watcher() i=4 2024-09-12T17:17:03.957 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.957+0000 7f7ad0a899c0 20 add_watcher() i=5 2024-09-12T17:17:03.957 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.957+0000 7f7ad0a899c0 20 add_watcher() i=6 2024-09-12T17:17:03.958 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.957+0000 7f7ad0a899c0 20 add_watcher() i=7 2024-09-12T17:17:03.958 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.957+0000 7f7ad0a899c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:17:03.965 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.965+0000 7f7984fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:03.966 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.965+0000 7f7ad0a899c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:17:03.966 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.965+0000 7f7ad0a899c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:17:03.966 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.965+0000 7f7ad0a899c0 5 note: GC not initialized 2024-09-12T17:17:03.967 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.965+0000 7f78ff7fe640 20 reqs_thread_entry: start 2024-09-12T17:17:03.967 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.965+0000 7f7ad0a899c0 20 init_complete bucket index max shards: 1 2024-09-12T17:17:03.967 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.965+0000 7f7ad0a899c0 20 Filter name: none 2024-09-12T17:17:03.967 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.965+0000 7f78fd7fa640 20 reqs_thread_entry: start 2024-09-12T17:17:03.967 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.965+0000 7f7ad0a899c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:17:03.967 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.965+0000 7f7ad0a899c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:03.968 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.969+0000 7f7ad0a899c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:17:03.969 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.969+0000 7f7ad0a899c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:17:03.969 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.969+0000 7f7ad0a899c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:17:03.969 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.969+0000 7f7ad0a899c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 : miss 2024-09-12T17:17:03.969 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.969+0000 7f7ad0a899c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:03.969 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.969+0000 7f7ad0a899c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:17:03.970 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.969+0000 7f7ad0a899c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:17:03.970 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.969+0000 7f7ad0a899c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:17:03.970 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.969+0000 7f7ad0a899c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:17:03.970 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.969+0000 7f7ad0a899c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:17:03.970 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.969+0000 7f7ad0a899c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 2024-09-12T17:17:03.973 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.973+0000 7f7984fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:03.978 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.977+0000 7f7ad0a899c0 20 remove_watcher() i=0 2024-09-12T17:17:03.978 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.977+0000 7f7ad0a899c0 2 removed watcher, disabling cache 2024-09-12T17:17:03.981 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.981+0000 7f7ad0a899c0 20 remove_watcher() i=1 2024-09-12T17:17:03.983 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.981+0000 7f7ad0a899c0 20 remove_watcher() i=2 2024-09-12T17:17:03.985 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.985+0000 7f7ad0a899c0 20 remove_watcher() i=3 2024-09-12T17:17:03.987 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.989+0000 7f7ad0a899c0 20 remove_watcher() i=4 2024-09-12T17:17:03.989 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.989+0000 7f7ad0a899c0 20 remove_watcher() i=5 2024-09-12T17:17:03.991 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.989+0000 7f7ad0a899c0 20 remove_watcher() i=6 2024-09-12T17:17:03.993 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:03.993+0000 7f7ad0a899c0 20 remove_watcher() i=7 2024-09-12T17:17:04.010 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin reshard list 2024-09-12T17:17:04.035 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:17:04.036 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:17:04.082 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.081+0000 7fe68b5cb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:04.085 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.085+0000 7fe68b5cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:04.085 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.085+0000 7fe68b5cb9c0 20 realm 2024-09-12T17:17:04.085 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.085+0000 7fe68b5cb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:04.085 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.085+0000 7fe68b5cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:04.085 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.085+0000 7fe68b5cb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:17:04.085 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.085+0000 7fe68b5cb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:04.085 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.085+0000 7fe68b5cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:04.086 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.085+0000 7fe68b5cb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:04.087 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.085+0000 7fe68b5cb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:04.087 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.085+0000 7fe68b5cb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:04.089 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.089+0000 7fe68b5cb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:17:04.089 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.089+0000 7fe68b5cb9c0 20 searching for the correct realm 2024-09-12T17:17:04.092 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.093+0000 7fe6898d2640 0 -- 172.21.15.16:0/3109041966 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fe680018070 msgr2=0x7fe68005ba60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:04.099 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.101+0000 7fe6888d0640 0 -- 172.21.15.16:0/3109041966 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fe684031440 msgr2=0x7fe6840318c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:17:04.320 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.321+0000 7fe68b5cb9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:17:04.320 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.321+0000 7fe68b5cb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:17:04.320 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.321+0000 7fe68b5cb9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:17:04.320 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.321+0000 7fe68b5cb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:17:04.321 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.321+0000 7fe68b5cb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:17:04.321 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.321+0000 7fe68b5cb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:17:04.321 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.321+0000 7fe68b5cb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:04.321 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.321+0000 7fe68b5cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:04.321 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.321+0000 7fe68b5cb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:04.321 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.321+0000 7fe68b5cb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:04.322 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.321+0000 7fe68b5cb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:04.322 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.321+0000 7fe68b5cb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:17:04.323 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.321+0000 7fe68b5cb9c0 20 zone default found 2024-09-12T17:17:04.323 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.321+0000 7fe68b5cb9c0 4 Realm: () 2024-09-12T17:17:04.323 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.321+0000 7fe68b5cb9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:17:04.323 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.321+0000 7fe68b5cb9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:17:04.323 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.321+0000 7fe68b5cb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:17:04.323 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.321+0000 7fe68b5cb9c0 20 zonegroup default 2024-09-12T17:17:04.323 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.321+0000 7fe68b5cb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:04.324 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.321+0000 7fe68b5cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:04.324 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.321+0000 7fe68b5cb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:04.324 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.325+0000 7fe68b5cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:04.324 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.325+0000 7fe68b5cb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:04.325 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.325+0000 7fe68b5cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:04.325 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.325+0000 7fe68b5cb9c0 20 started sync module instance, tier type = 2024-09-12T17:17:04.325 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.325+0000 7fe68b5cb9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:17:04.351 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.349+0000 7fe68b5cb9c0 20 add_watcher() i=0 2024-09-12T17:17:04.351 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.349+0000 7fe68b5cb9c0 20 add_watcher() i=1 2024-09-12T17:17:04.351 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.349+0000 7fe68b5cb9c0 20 add_watcher() i=2 2024-09-12T17:17:04.351 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.349+0000 7fe68b5cb9c0 20 add_watcher() i=3 2024-09-12T17:17:04.351 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.349+0000 7fe68b5cb9c0 20 add_watcher() i=4 2024-09-12T17:17:04.352 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.349+0000 7fe68b5cb9c0 20 add_watcher() i=5 2024-09-12T17:17:04.352 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.349+0000 7fe68b5cb9c0 20 add_watcher() i=6 2024-09-12T17:17:04.353 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.353+0000 7fe68b5cb9c0 20 add_watcher() i=7 2024-09-12T17:17:04.354 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.353+0000 7fe68b5cb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:17:04.358 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.357+0000 7fe53ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:04.359 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.357+0000 7fe68b5cb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:17:04.359 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.357+0000 7fe68b5cb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:17:04.359 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.357+0000 7fe68b5cb9c0 5 note: GC not initialized 2024-09-12T17:17:04.360 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.357+0000 7fe53efe5640 20 reqs_thread_entry: start 2024-09-12T17:17:04.360 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.357+0000 7fe68b5cb9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:17:04.360 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.361+0000 7fe68b5cb9c0 20 Filter name: none 2024-09-12T17:17:04.360 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.361+0000 7fe53cfe1640 20 reqs_thread_entry: start 2024-09-12T17:17:04.373 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.373+0000 7fe53ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:04.378 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.377+0000 7fe68b5cb9c0 20 remove_watcher() i=0 2024-09-12T17:17:04.378 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.377+0000 7fe68b5cb9c0 2 removed watcher, disabling cache 2024-09-12T17:17:04.381 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.381+0000 7fe68b5cb9c0 20 remove_watcher() i=1 2024-09-12T17:17:04.384 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.385+0000 7fe68b5cb9c0 20 remove_watcher() i=2 2024-09-12T17:17:04.386 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.385+0000 7fe68b5cb9c0 20 remove_watcher() i=3 2024-09-12T17:17:04.388 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.389+0000 7fe68b5cb9c0 20 remove_watcher() i=4 2024-09-12T17:17:04.390 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.389+0000 7fe68b5cb9c0 20 remove_watcher() i=5 2024-09-12T17:17:04.391 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.389+0000 7fe68b5cb9c0 20 remove_watcher() i=6 2024-09-12T17:17:04.393 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.393+0000 7fe68b5cb9c0 20 remove_watcher() i=7 2024-09-12T17:17:04.410 INFO:tasks.workunit.client.0.smithi016.stderr:bucket name a-bucket 2024-09-12T17:17:04.410 INFO:tasks.workunit.client.0.smithi016.stderr:TEST: reshard process 2024-09-12T17:17:04.410 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:04.410 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin reshard process 2024-09-12T17:17:04.435 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:17:04.435 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:17:04.481 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.481+0000 7efe9cb4e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:04.484 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.481+0000 7efe9cb4e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:04.484 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.481+0000 7efe9cb4e9c0 20 realm 2024-09-12T17:17:04.484 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.481+0000 7efe9cb4e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:04.484 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.485+0000 7efe9cb4e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:04.484 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.485+0000 7efe9cb4e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:17:04.484 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.485+0000 7efe9cb4e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:04.484 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.485+0000 7efe9cb4e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:04.485 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.485+0000 7efe9cb4e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:04.486 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.485+0000 7efe9cb4e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:04.486 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.485+0000 7efe9cb4e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:04.488 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.489+0000 7efe9cb4e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:17:04.488 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.489+0000 7efe9cb4e9c0 20 searching for the correct realm 2024-09-12T17:17:04.491 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.489+0000 7efe9ae55640 0 -- 172.21.15.16:0/3867819611 >> [v2:172.21.15.19:6800/1509147557,v1:172.21.15.19:6801/1509147557] conn(0x56525be920b0 msgr2=0x56525be944c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:17:04.499 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.497+0000 7efe93fff640 0 -- 172.21.15.16:0/3867819611 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7efe9406ed00 msgr2=0x7efe9409b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:17:04.715 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.713+0000 7efe9cb4e9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:17:04.716 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.713+0000 7efe9cb4e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:17:04.716 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.713+0000 7efe9cb4e9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:17:04.716 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.713+0000 7efe9cb4e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:17:04.716 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.713+0000 7efe9cb4e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:17:04.716 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.713+0000 7efe9cb4e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:17:04.716 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.713+0000 7efe9cb4e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:04.716 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.717+0000 7efe9cb4e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:04.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.717+0000 7efe9cb4e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:04.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.717+0000 7efe9cb4e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:04.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.717+0000 7efe9cb4e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:04.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.717+0000 7efe9cb4e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:17:04.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.717+0000 7efe9cb4e9c0 20 zone default found 2024-09-12T17:17:04.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.717+0000 7efe9cb4e9c0 4 Realm: () 2024-09-12T17:17:04.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.717+0000 7efe9cb4e9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:17:04.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.717+0000 7efe9cb4e9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:17:04.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.717+0000 7efe9cb4e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:17:04.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.717+0000 7efe9cb4e9c0 20 zonegroup default 2024-09-12T17:17:04.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.717+0000 7efe9cb4e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:04.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.717+0000 7efe9cb4e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:04.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.717+0000 7efe9cb4e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:04.720 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.721+0000 7efe9cb4e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:04.720 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.721+0000 7efe9cb4e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:04.721 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.721+0000 7efe9cb4e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:04.721 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.721+0000 7efe9cb4e9c0 20 started sync module instance, tier type = 2024-09-12T17:17:04.721 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.721+0000 7efe9cb4e9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:17:04.745 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.745+0000 7efe9cb4e9c0 20 add_watcher() i=0 2024-09-12T17:17:04.745 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.745+0000 7efe9cb4e9c0 20 add_watcher() i=1 2024-09-12T17:17:04.745 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.745+0000 7efe9cb4e9c0 20 add_watcher() i=2 2024-09-12T17:17:04.745 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.745+0000 7efe9cb4e9c0 20 add_watcher() i=3 2024-09-12T17:17:04.745 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.745+0000 7efe9cb4e9c0 20 add_watcher() i=4 2024-09-12T17:17:04.745 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.745+0000 7efe9cb4e9c0 20 add_watcher() i=5 2024-09-12T17:17:04.745 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.745+0000 7efe9cb4e9c0 20 add_watcher() i=6 2024-09-12T17:17:04.747 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.749+0000 7efe9cb4e9c0 20 add_watcher() i=7 2024-09-12T17:17:04.748 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.749+0000 7efe9cb4e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:17:04.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.753+0000 7efd50fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:04.754 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.753+0000 7efe9cb4e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:17:04.754 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.753+0000 7efe9cb4e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:17:04.754 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.753+0000 7efe9cb4e9c0 5 note: GC not initialized 2024-09-12T17:17:04.756 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.753+0000 7efccb7fe640 20 reqs_thread_entry: start 2024-09-12T17:17:04.756 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.753+0000 7efe9cb4e9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:17:04.756 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.753+0000 7efe9cb4e9c0 20 Filter name: none 2024-09-12T17:17:04.756 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.753+0000 7efcc97fa640 20 reqs_thread_entry: start 2024-09-12T17:17:04.756 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.757+0000 7efe9cb4e9c0 20 processing logshard = reshard.0000000000 2024-09-12T17:17:04.762 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.761+0000 7efe9cb4e9c0 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T17:17:04.762 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.761+0000 7efe9cb4e9c0 20 processing logshard = reshard.0000000001 2024-09-12T17:17:04.768 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.769+0000 7efe9cb4e9c0 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T17:17:04.768 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.769+0000 7efe9cb4e9c0 20 processing logshard = reshard.0000000002 2024-09-12T17:17:04.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.773+0000 7efe9cb4e9c0 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T17:17:04.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.773+0000 7efe9cb4e9c0 20 processing logshard = reshard.0000000003 2024-09-12T17:17:04.779 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.777+0000 7efe9cb4e9c0 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T17:17:04.779 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.777+0000 7efe9cb4e9c0 20 processing logshard = reshard.0000000004 2024-09-12T17:17:04.786 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.785+0000 7efe9cb4e9c0 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T17:17:04.786 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.785+0000 7efe9cb4e9c0 20 processing logshard = reshard.0000000005 2024-09-12T17:17:04.791 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.789+0000 7efe9cb4e9c0 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T17:17:04.791 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.789+0000 7efe9cb4e9c0 20 processing logshard = reshard.0000000006 2024-09-12T17:17:04.794 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.793+0000 7efe9cb4e9c0 20 process_entry resharding a-bucket 2024-09-12T17:17:04.795 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.793+0000 7efe9cb4e9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:17:04.795 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.793+0000 7efe9cb4e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:04.795 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.793+0000 7efe9cb4e9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:17:04.796 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.793+0000 7efe9cb4e9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T17:17:04.796 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.793+0000 7efe9cb4e9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:17:04.796 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.793+0000 7efe9cb4e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 : miss 2024-09-12T17:17:04.796 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.793+0000 7efe9cb4e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:04.796 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.797+0000 7efe9cb4e9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:17:04.796 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.797+0000 7efe9cb4e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:17:04.797 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.797+0000 7efe9cb4e9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:17:04.797 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.797+0000 7efe9cb4e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:17:04.797 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.797+0000 7efe9cb4e9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:17:04.797 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.797+0000 7efe9cb4e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 2024-09-12T17:17:04.808 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.809+0000 7efe9cb4e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:17:04.808 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.809+0000 7efe9cb4e9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:17:04.808 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.809+0000 7efe9cb4e9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:17:04.808 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.809+0000 7efe9cb4e9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17, ofs0, ns] 2024-09-12T17:17:04.809 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.809+0000 7efd7dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431582 cookie 94911729348480 notifier 6027 bl.length()=827 2024-09-12T17:17:04.809 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.809+0000 7efd7dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:17:04.809 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.809+0000 7efd7dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:17:04.809 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.809+0000 7efd7dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:17:04.810 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.809+0000 7efe9cb4e9c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): orig_sources= new_sources= 2024-09-12T17:17:04.810 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.809+0000 7efe9cb4e9c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): potential sources added=[] removed=[] 2024-09-12T17:17:04.810 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.809+0000 7efe9cb4e9c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): orig_dests= new_dests= 2024-09-12T17:17:04.811 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.809+0000 7efe9cb4e9c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): potential dests added=[] removed=[] 2024-09-12T17:17:04.816 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.817+0000 7efe9cb4e9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.1.0 2024-09-12T17:17:04.816 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.817+0000 7efe9cb4e9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.1.0 2024-09-12T17:17:04.816 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.817+0000 7efe9cb4e9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.1.1 2024-09-12T17:17:04.816 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.817+0000 7efe9cb4e9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.1.1 2024-09-12T17:17:04.816 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.817+0000 7efe9cb4e9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.0 2024-09-12T17:17:04.817 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.817+0000 7efe9cb4e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 : hit (requested=0x17, cached=0x17) 2024-09-12T17:17:04.817 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.817+0000 7efe9cb4e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 2024-09-12T17:17:04.818 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.817+0000 7efe9cb4e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:17:04.818 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.817+0000 7efe9cb4e9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:17:04.819 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.817+0000 7efe9cb4e9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:17:04.819 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.817+0000 7efe9cb4e9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17, ofs0, ns] 2024-09-12T17:17:04.819 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.817+0000 7efd7d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431583 cookie 94911729348480 notifier 6027 bl.length()=827 2024-09-12T17:17:04.820 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.817+0000 7efd7d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:17:04.820 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.817+0000 7efd7d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:17:04.820 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.817+0000 7efd7d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:17:04.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.821+0000 7efe9cb4e9c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): orig_sources= new_sources= 2024-09-12T17:17:04.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.821+0000 7efe9cb4e9c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): potential sources added=[] removed=[] 2024-09-12T17:17:04.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.821+0000 7efe9cb4e9c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): orig_dests= new_dests= 2024-09-12T17:17:04.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.821+0000 7efe9cb4e9c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): potential dests added=[] removed=[] 2024-09-12T17:17:04.823 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.821+0000 7efe9cb4e9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.0 2024-09-12T17:17:04.824 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.825+0000 7efe9cb4e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 : hit (requested=0x17, cached=0x17) 2024-09-12T17:17:04.824 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.825+0000 7efe9cb4e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 2024-09-12T17:17:04.827 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.825+0000 7efe9cb4e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:17:04.827 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.825+0000 7efe9cb4e9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:17:04.827 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.825+0000 7efe9cb4e9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:17:04.828 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.825+0000 7efe9cb4e9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17, ofs0, ns] 2024-09-12T17:17:04.828 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.829+0000 7efd7dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431584 cookie 94911729348480 notifier 6027 bl.length()=795 2024-09-12T17:17:04.829 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.829+0000 7efd7dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:17:04.829 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.829+0000 7efd7dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:17:04.829 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.829+0000 7efd7dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:17:04.829 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.829+0000 7efe9cb4e9c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): orig_sources= new_sources= 2024-09-12T17:17:04.829 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.829+0000 7efe9cb4e9c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): potential sources added=[] removed=[] 2024-09-12T17:17:04.830 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.829+0000 7efe9cb4e9c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): orig_dests= new_dests= 2024-09-12T17:17:04.830 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.829+0000 7efe9cb4e9c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): potential dests added=[] removed=[] 2024-09-12T17:17:04.832 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.833+0000 7efe9cb4e9c0 1 execute INFO: reshard of bucket "a-bucket" from 1 shards to 2 shards completed successfully 2024-09-12T17:17:04.835 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.833+0000 7efe9cb4e9c0 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T17:17:04.841 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.841+0000 7efe9cb4e9c0 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T17:17:04.841 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.841+0000 7efe9cb4e9c0 20 processing logshard = reshard.0000000007 2024-09-12T17:17:04.847 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.845+0000 7efe9cb4e9c0 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T17:17:04.847 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.845+0000 7efe9cb4e9c0 20 processing logshard = reshard.0000000008 2024-09-12T17:17:04.853 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.853+0000 7efe9cb4e9c0 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T17:17:04.853 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.853+0000 7efe9cb4e9c0 20 processing logshard = reshard.0000000009 2024-09-12T17:17:04.860 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.861+0000 7efe9cb4e9c0 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T17:17:04.860 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.861+0000 7efe9cb4e9c0 20 processing logshard = reshard.0000000010 2024-09-12T17:17:04.866 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.865+0000 7efe9cb4e9c0 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T17:17:04.866 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.865+0000 7efe9cb4e9c0 20 processing logshard = reshard.0000000011 2024-09-12T17:17:04.873 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.873+0000 7efe9cb4e9c0 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T17:17:04.873 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.873+0000 7efe9cb4e9c0 20 processing logshard = reshard.0000000012 2024-09-12T17:17:04.880 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.881+0000 7efe9cb4e9c0 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T17:17:04.880 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.881+0000 7efe9cb4e9c0 20 processing logshard = reshard.0000000013 2024-09-12T17:17:04.887 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.885+0000 7efe9cb4e9c0 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T17:17:04.887 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.885+0000 7efe9cb4e9c0 20 processing logshard = reshard.0000000014 2024-09-12T17:17:04.894 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.893+0000 7efe9cb4e9c0 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T17:17:04.894 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.893+0000 7efe9cb4e9c0 20 processing logshard = reshard.0000000015 2024-09-12T17:17:04.901 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.901+0000 7efe9cb4e9c0 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T17:17:04.903 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.901+0000 7efd50fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:04.908 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.909+0000 7efe9cb4e9c0 20 remove_watcher() i=0 2024-09-12T17:17:04.909 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.909+0000 7efe9cb4e9c0 2 removed watcher, disabling cache 2024-09-12T17:17:04.911 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.909+0000 7efe9cb4e9c0 20 remove_watcher() i=1 2024-09-12T17:17:04.914 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.913+0000 7efe9cb4e9c0 20 remove_watcher() i=2 2024-09-12T17:17:04.917 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.917+0000 7efe9cb4e9c0 20 remove_watcher() i=3 2024-09-12T17:17:04.920 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.921+0000 7efe9cb4e9c0 20 remove_watcher() i=4 2024-09-12T17:17:04.922 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.921+0000 7efe9cb4e9c0 20 remove_watcher() i=5 2024-09-12T17:17:04.924 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.925+0000 7efe9cb4e9c0 20 remove_watcher() i=6 2024-09-12T17:17:04.926 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:04.925+0000 7efe9cb4e9c0 20 remove_watcher() i=7 2024-09-12T17:17:09.953 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:17:09.989 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:17:09.989 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:17:10.040 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.041+0000 7fd5ac9fd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:10.043 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.041+0000 7fd5ac9fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:10.043 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.041+0000 7fd5ac9fd9c0 20 realm 2024-09-12T17:17:10.043 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.041+0000 7fd5ac9fd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:10.043 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.041+0000 7fd5ac9fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:10.043 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.041+0000 7fd5ac9fd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:17:10.043 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.041+0000 7fd5ac9fd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:10.043 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.041+0000 7fd5ac9fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:10.043 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.041+0000 7fd5ac9fd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:10.044 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.045+0000 7fd5ac9fd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:10.045 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.045+0000 7fd5ac9fd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:10.046 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.045+0000 7fd5ac9fd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:17:10.046 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.045+0000 7fd5ac9fd9c0 20 searching for the correct realm 2024-09-12T17:17:10.048 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.049+0000 7fd5a9d02640 0 -- 172.21.15.16:0/3807525432 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7fd59c064ca0 msgr2=0x7fd59c06d040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:10.264 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.265+0000 7fd5aad04640 0 -- 172.21.15.16:0/3807525432 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fd59406fc20 msgr2=0x7fd59406ead0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:10.282 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.281+0000 7fd5ac9fd9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:17:10.282 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.281+0000 7fd5ac9fd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:17:10.282 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.281+0000 7fd5ac9fd9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:17:10.282 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.281+0000 7fd5ac9fd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:17:10.282 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.281+0000 7fd5ac9fd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:17:10.282 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.281+0000 7fd5ac9fd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:17:10.282 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.281+0000 7fd5ac9fd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:10.283 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.281+0000 7fd5ac9fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:10.283 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.281+0000 7fd5ac9fd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:10.283 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.281+0000 7fd5ac9fd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:10.283 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.281+0000 7fd5ac9fd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:10.284 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.285+0000 7fd5ac9fd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:17:10.284 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.285+0000 7fd5ac9fd9c0 20 zone default found 2024-09-12T17:17:10.284 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.285+0000 7fd5ac9fd9c0 4 Realm: () 2024-09-12T17:17:10.284 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.285+0000 7fd5ac9fd9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:17:10.285 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.285+0000 7fd5ac9fd9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:17:10.285 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.285+0000 7fd5ac9fd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:17:10.285 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.285+0000 7fd5ac9fd9c0 20 zonegroup default 2024-09-12T17:17:10.285 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.285+0000 7fd5ac9fd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:10.285 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.285+0000 7fd5ac9fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:10.285 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.285+0000 7fd5ac9fd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:10.286 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.285+0000 7fd5ac9fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:10.286 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.285+0000 7fd5ac9fd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:10.286 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.285+0000 7fd5ac9fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:10.286 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.285+0000 7fd5ac9fd9c0 20 started sync module instance, tier type = 2024-09-12T17:17:10.287 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.285+0000 7fd5ac9fd9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:17:10.311 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.309+0000 7fd5ac9fd9c0 20 add_watcher() i=0 2024-09-12T17:17:10.311 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.309+0000 7fd5ac9fd9c0 20 add_watcher() i=1 2024-09-12T17:17:10.312 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.309+0000 7fd5ac9fd9c0 20 add_watcher() i=2 2024-09-12T17:17:10.312 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.309+0000 7fd5ac9fd9c0 20 add_watcher() i=3 2024-09-12T17:17:10.312 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.309+0000 7fd5ac9fd9c0 20 add_watcher() i=4 2024-09-12T17:17:10.312 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.309+0000 7fd5ac9fd9c0 20 add_watcher() i=5 2024-09-12T17:17:10.312 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.309+0000 7fd5ac9fd9c0 20 add_watcher() i=6 2024-09-12T17:17:10.314 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.313+0000 7fd5ac9fd9c0 20 add_watcher() i=7 2024-09-12T17:17:10.314 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.313+0000 7fd5ac9fd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:17:10.318 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.317+0000 7fd460fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:10.319 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.317+0000 7fd5ac9fd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:17:10.319 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.317+0000 7fd5ac9fd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:17:10.319 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.317+0000 7fd5ac9fd9c0 5 note: GC not initialized 2024-09-12T17:17:10.320 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.317+0000 7fd3db7fe640 20 reqs_thread_entry: start 2024-09-12T17:17:10.320 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.321+0000 7fd5ac9fd9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:17:10.320 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.321+0000 7fd5ac9fd9c0 20 Filter name: none 2024-09-12T17:17:10.321 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.321+0000 7fd3d97fa640 20 reqs_thread_entry: start 2024-09-12T17:17:10.321 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.321+0000 7fd5ac9fd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:10.322 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.321+0000 7fd5ac9fd9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:17:10.322 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.321+0000 7fd5ac9fd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:10.323 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.321+0000 7fd5ac9fd9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:17:10.323 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.321+0000 7fd5ac9fd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:17:10.323 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.321+0000 7fd5ac9fd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:10.324 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.325+0000 7fd5ac9fd9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:17:10.324 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.325+0000 7fd5ac9fd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:10.325 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.325+0000 7fd5ac9fd9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:17:10.325 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.325+0000 7fd5ac9fd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:17:10.328 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.329+0000 7fd460fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:10.333 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.333+0000 7fd5ac9fd9c0 20 remove_watcher() i=0 2024-09-12T17:17:10.333 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.333+0000 7fd5ac9fd9c0 2 removed watcher, disabling cache 2024-09-12T17:17:10.335 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.333+0000 7fd5ac9fd9c0 20 remove_watcher() i=1 2024-09-12T17:17:10.337 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.337+0000 7fd5ac9fd9c0 20 remove_watcher() i=2 2024-09-12T17:17:10.340 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.341+0000 7fd5ac9fd9c0 20 remove_watcher() i=3 2024-09-12T17:17:10.342 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.341+0000 7fd5ac9fd9c0 20 remove_watcher() i=4 2024-09-12T17:17:10.344 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.345+0000 7fd5ac9fd9c0 20 remove_watcher() i=5 2024-09-12T17:17:10.346 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.345+0000 7fd5ac9fd9c0 20 remove_watcher() i=6 2024-09-12T17:17:10.348 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.349+0000 7fd5ac9fd9c0 20 remove_watcher() i=7 2024-09-12T17:17:10.365 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:10.365 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:17:10.366 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: a-bucket id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 num_objects: 0 size_kb: 0 num_shards: 2 2024-09-12T17:17:10.366 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:10.366 INFO:tasks.workunit.client.0.smithi016.stderr:TEST: reshard add non empty bucket 2024-09-12T17:17:10.366 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:10.490 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:17:10.524 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:17:10.524 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:17:10.572 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.573+0000 7fb6bb9159c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:10.574 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.573+0000 7fb6bb9159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:10.574 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.573+0000 7fb6bb9159c0 20 realm 2024-09-12T17:17:10.574 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.573+0000 7fb6bb9159c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:10.574 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.573+0000 7fb6bb9159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:10.575 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.573+0000 7fb6bb9159c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:17:10.575 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.573+0000 7fb6bb9159c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:10.575 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.573+0000 7fb6bb9159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:10.575 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.573+0000 7fb6bb9159c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:10.576 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.577+0000 7fb6bb9159c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:10.576 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.577+0000 7fb6bb9159c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:10.578 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.577+0000 7fb6bb9159c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:17:10.578 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.577+0000 7fb6bb9159c0 20 searching for the correct realm 2024-09-12T17:17:10.578 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.577+0000 7fb6b941b640 0 -- 172.21.15.16:0/1423892167 >> [v2:172.21.15.16:6824/465585330,v1:172.21.15.16:6825/465585330] conn(0x55dfa307c410 msgr2=0x55dfa307e8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:10.585 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.585+0000 7fb6b941b640 0 -- 172.21.15.16:0/1423892167 >> [v2:172.21.15.19:6802/36415917,v1:172.21.15.19:6804/36415917] conn(0x7fb6ac073c20 msgr2=0x7fb6ac04a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:10.811 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.809+0000 7fb6bb9159c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:17:10.811 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.809+0000 7fb6bb9159c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:17:10.812 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.809+0000 7fb6bb9159c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:17:10.812 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.809+0000 7fb6bb9159c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:17:10.812 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.809+0000 7fb6bb9159c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:17:10.812 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.809+0000 7fb6bb9159c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:17:10.812 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.809+0000 7fb6bb9159c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:10.812 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.809+0000 7fb6bb9159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:10.813 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.809+0000 7fb6bb9159c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:10.814 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.813+0000 7fb6bb9159c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:10.814 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.813+0000 7fb6bb9159c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:10.814 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.813+0000 7fb6bb9159c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:17:10.814 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.813+0000 7fb6bb9159c0 20 zone default found 2024-09-12T17:17:10.815 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.813+0000 7fb6bb9159c0 4 Realm: () 2024-09-12T17:17:10.815 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.813+0000 7fb6bb9159c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:17:10.815 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.813+0000 7fb6bb9159c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:17:10.815 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.813+0000 7fb6bb9159c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:17:10.815 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.813+0000 7fb6bb9159c0 20 zonegroup default 2024-09-12T17:17:10.815 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.813+0000 7fb6bb9159c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:10.817 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.813+0000 7fb6bb9159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:10.817 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.813+0000 7fb6bb9159c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:10.817 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.813+0000 7fb6bb9159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:10.817 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.813+0000 7fb6bb9159c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:10.817 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.817+0000 7fb6bb9159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:10.820 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.817+0000 7fb6bb9159c0 20 started sync module instance, tier type = 2024-09-12T17:17:10.820 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.817+0000 7fb6bb9159c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:17:10.844 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.841+0000 7fb6bb9159c0 20 add_watcher() i=0 2024-09-12T17:17:10.844 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.841+0000 7fb6bb9159c0 20 add_watcher() i=1 2024-09-12T17:17:10.844 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.841+0000 7fb6bb9159c0 20 add_watcher() i=2 2024-09-12T17:17:10.845 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.841+0000 7fb6bb9159c0 20 add_watcher() i=3 2024-09-12T17:17:10.845 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.841+0000 7fb6bb9159c0 20 add_watcher() i=4 2024-09-12T17:17:10.845 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.841+0000 7fb6bb9159c0 20 add_watcher() i=5 2024-09-12T17:17:10.845 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.845+0000 7fb6bb9159c0 20 add_watcher() i=6 2024-09-12T17:17:10.846 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.845+0000 7fb6bb9159c0 20 add_watcher() i=7 2024-09-12T17:17:10.846 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.845+0000 7fb6bb9159c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:17:10.852 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.849+0000 7fb56f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:10.853 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.853+0000 7fb6bb9159c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:17:10.853 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.853+0000 7fb6bb9159c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:17:10.853 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.853+0000 7fb6bb9159c0 5 note: GC not initialized 2024-09-12T17:17:10.854 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.853+0000 7fb56e7e4640 20 reqs_thread_entry: start 2024-09-12T17:17:10.854 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.853+0000 7fb6bb9159c0 20 init_complete bucket index max shards: 1 2024-09-12T17:17:10.854 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.853+0000 7fb6bb9159c0 20 Filter name: none 2024-09-12T17:17:10.854 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.853+0000 7fb4dffff640 20 reqs_thread_entry: start 2024-09-12T17:17:10.854 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.853+0000 7fb6bb9159c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:10.855 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.853+0000 7fb6bb9159c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:17:10.855 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.853+0000 7fb6bb9159c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:10.856 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.857+0000 7fb6bb9159c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:17:10.856 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.857+0000 7fb6bb9159c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:17:10.856 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.857+0000 7fb6bb9159c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:10.857 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.857+0000 7fb6bb9159c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:17:10.857 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.857+0000 7fb6bb9159c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:10.858 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.857+0000 7fb6bb9159c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:17:10.858 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.857+0000 7fb6bb9159c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:17:10.861 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.861+0000 7fb56f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:10.867 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.865+0000 7fb6bb9159c0 20 remove_watcher() i=0 2024-09-12T17:17:10.867 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.865+0000 7fb6bb9159c0 2 removed watcher, disabling cache 2024-09-12T17:17:10.870 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.869+0000 7fb6bb9159c0 20 remove_watcher() i=1 2024-09-12T17:17:10.872 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.873+0000 7fb6bb9159c0 20 remove_watcher() i=2 2024-09-12T17:17:10.875 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.873+0000 7fb6bb9159c0 20 remove_watcher() i=3 2024-09-12T17:17:10.877 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.877+0000 7fb6bb9159c0 20 remove_watcher() i=4 2024-09-12T17:17:10.879 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.877+0000 7fb6bb9159c0 20 remove_watcher() i=5 2024-09-12T17:17:10.881 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.881+0000 7fb6bb9159c0 20 remove_watcher() i=6 2024-09-12T17:17:10.883 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.881+0000 7fb6bb9159c0 20 remove_watcher() i=7 2024-09-12T17:17:10.900 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:10.900 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:17:10.900 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: a-bucket id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 num_objects: 8 size_kb: 1 num_shards: 2 2024-09-12T17:17:10.900 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:10.900 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 3 2024-09-12T17:17:10.935 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:17:10.935 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:17:10.981 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.981+0000 7faa382f09c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:10.983 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.981+0000 7faa382f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:10.983 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.981+0000 7faa382f09c0 20 realm 2024-09-12T17:17:10.983 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.981+0000 7faa382f09c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:10.983 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.981+0000 7faa382f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:10.983 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.981+0000 7faa382f09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:17:10.983 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.981+0000 7faa382f09c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:10.984 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.981+0000 7faa382f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:10.984 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.981+0000 7faa382f09c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:10.985 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.985+0000 7faa382f09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:10.985 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.985+0000 7faa382f09c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:10.987 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.985+0000 7faa382f09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:17:10.987 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.985+0000 7faa382f09c0 20 searching for the correct realm 2024-09-12T17:17:10.988 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:10.989+0000 7faa355f5640 0 -- 172.21.15.16:0/3408167850 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7faa30015070 msgr2=0x7faa30002040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:11.203 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.201+0000 7faa365f7640 0 -- 172.21.15.16:0/3408167850 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7faa2c117150 msgr2=0x7faa2c127f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:11.221 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.221+0000 7faa382f09c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:17:11.221 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.221+0000 7faa382f09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:17:11.221 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.221+0000 7faa382f09c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:17:11.221 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.221+0000 7faa382f09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:17:11.221 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.221+0000 7faa382f09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:17:11.221 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.221+0000 7faa382f09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:17:11.221 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.221+0000 7faa382f09c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:11.221 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.221+0000 7faa382f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:11.222 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.221+0000 7faa382f09c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:11.222 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.221+0000 7faa382f09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:11.222 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.221+0000 7faa382f09c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:11.223 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.221+0000 7faa382f09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:17:11.223 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.221+0000 7faa382f09c0 20 zone default found 2024-09-12T17:17:11.223 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.221+0000 7faa382f09c0 4 Realm: () 2024-09-12T17:17:11.223 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.221+0000 7faa382f09c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:17:11.223 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.221+0000 7faa382f09c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:17:11.223 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.221+0000 7faa382f09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:17:11.224 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.221+0000 7faa382f09c0 20 zonegroup default 2024-09-12T17:17:11.224 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.221+0000 7faa382f09c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:11.224 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.221+0000 7faa382f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:11.224 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.221+0000 7faa382f09c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:11.224 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.225+0000 7faa382f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:11.225 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.225+0000 7faa382f09c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:11.225 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.225+0000 7faa382f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:11.225 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.225+0000 7faa382f09c0 20 started sync module instance, tier type = 2024-09-12T17:17:11.225 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.225+0000 7faa382f09c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:17:11.249 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.249+0000 7faa382f09c0 20 add_watcher() i=0 2024-09-12T17:17:11.249 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.249+0000 7faa382f09c0 20 add_watcher() i=1 2024-09-12T17:17:11.250 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.249+0000 7faa382f09c0 20 add_watcher() i=2 2024-09-12T17:17:11.250 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.249+0000 7faa382f09c0 20 add_watcher() i=3 2024-09-12T17:17:11.250 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.249+0000 7faa382f09c0 20 add_watcher() i=4 2024-09-12T17:17:11.250 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.249+0000 7faa382f09c0 20 add_watcher() i=5 2024-09-12T17:17:11.250 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.249+0000 7faa382f09c0 20 add_watcher() i=6 2024-09-12T17:17:11.252 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.253+0000 7faa382f09c0 20 add_watcher() i=7 2024-09-12T17:17:11.252 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.253+0000 7faa382f09c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:17:11.257 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.257+0000 7fa8ebfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:11.258 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.257+0000 7faa382f09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:17:11.258 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.257+0000 7faa382f09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:17:11.258 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.257+0000 7faa382f09c0 5 note: GC not initialized 2024-09-12T17:17:11.258 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.257+0000 7fa8eafe5640 20 reqs_thread_entry: start 2024-09-12T17:17:11.258 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.257+0000 7faa382f09c0 20 init_complete bucket index max shards: 1 2024-09-12T17:17:11.259 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.257+0000 7faa382f09c0 20 Filter name: none 2024-09-12T17:17:11.259 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.257+0000 7fa8e8fe1640 20 reqs_thread_entry: start 2024-09-12T17:17:11.259 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.257+0000 7faa382f09c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:17:11.259 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.257+0000 7faa382f09c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:11.260 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.261+0000 7faa382f09c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:17:11.260 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.261+0000 7faa382f09c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:17:11.260 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.261+0000 7faa382f09c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:17:11.260 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.261+0000 7faa382f09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 : miss 2024-09-12T17:17:11.260 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.261+0000 7faa382f09c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:11.261 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.261+0000 7faa382f09c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:17:11.261 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.261+0000 7faa382f09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:17:11.261 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.261+0000 7faa382f09c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:17:11.261 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.261+0000 7faa382f09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:17:11.261 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.261+0000 7faa382f09c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:17:11.261 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.261+0000 7faa382f09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 2024-09-12T17:17:11.264 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.265+0000 7fa8ebfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:11.270 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.269+0000 7faa382f09c0 20 remove_watcher() i=0 2024-09-12T17:17:11.270 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.269+0000 7faa382f09c0 2 removed watcher, disabling cache 2024-09-12T17:17:11.272 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.273+0000 7faa382f09c0 20 remove_watcher() i=1 2024-09-12T17:17:11.275 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.273+0000 7faa382f09c0 20 remove_watcher() i=2 2024-09-12T17:17:11.277 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.277+0000 7faa382f09c0 20 remove_watcher() i=3 2024-09-12T17:17:11.280 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.281+0000 7faa382f09c0 20 remove_watcher() i=4 2024-09-12T17:17:11.281 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.281+0000 7faa382f09c0 20 remove_watcher() i=5 2024-09-12T17:17:11.283 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.281+0000 7faa382f09c0 20 remove_watcher() i=6 2024-09-12T17:17:11.285 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.285+0000 7faa382f09c0 20 remove_watcher() i=7 2024-09-12T17:17:11.302 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin reshard list 2024-09-12T17:17:11.330 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:17:11.330 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:17:11.376 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.373+0000 7f3669d7e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:11.377 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.377+0000 7f3669d7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:11.378 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.377+0000 7f3669d7e9c0 20 realm 2024-09-12T17:17:11.378 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.377+0000 7f3669d7e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:11.378 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.377+0000 7f3669d7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:11.378 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.377+0000 7f3669d7e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:17:11.378 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.377+0000 7f3669d7e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:11.378 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.377+0000 7f3669d7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:11.378 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.377+0000 7f3669d7e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:11.379 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.377+0000 7f3669d7e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:11.379 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.377+0000 7f3669d7e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:11.381 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.381+0000 7f3669d7e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:17:11.382 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.381+0000 7f3669d7e9c0 20 searching for the correct realm 2024-09-12T17:17:11.385 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.385+0000 7f3668085640 0 -- 172.21.15.16:0/599961863 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f365c0fc290 msgr2=0x7f365c11e040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:11.602 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.601+0000 7f3667083640 0 -- 172.21.15.16:0/599961863 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f3660063050 msgr2=0x7f3660088ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:11.820 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.821+0000 7f3669d7e9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:17:11.820 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.821+0000 7f3669d7e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:17:11.820 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.821+0000 7f3669d7e9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:17:11.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.821+0000 7f3669d7e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:17:11.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.821+0000 7f3669d7e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:17:11.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.821+0000 7f3669d7e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:17:11.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.821+0000 7f3669d7e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:11.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.821+0000 7f3669d7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:11.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.821+0000 7f3669d7e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:11.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.821+0000 7f3669d7e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:11.822 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.821+0000 7f3669d7e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:11.823 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.821+0000 7f3669d7e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:17:11.823 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.821+0000 7f3669d7e9c0 20 zone default found 2024-09-12T17:17:11.823 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.821+0000 7f3669d7e9c0 4 Realm: () 2024-09-12T17:17:11.823 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.821+0000 7f3669d7e9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:17:11.823 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.821+0000 7f3669d7e9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:17:11.823 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.821+0000 7f3669d7e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:17:11.823 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.821+0000 7f3669d7e9c0 20 zonegroup default 2024-09-12T17:17:11.823 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.821+0000 7f3669d7e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:11.824 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.821+0000 7f3669d7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:11.824 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.821+0000 7f3669d7e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:11.824 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.825+0000 7f3669d7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:11.824 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.825+0000 7f3669d7e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:11.825 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.825+0000 7f3669d7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:11.825 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.825+0000 7f3669d7e9c0 20 started sync module instance, tier type = 2024-09-12T17:17:11.825 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.825+0000 7f3669d7e9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:17:11.852 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.849+0000 7f3669d7e9c0 20 add_watcher() i=0 2024-09-12T17:17:11.852 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.849+0000 7f3669d7e9c0 20 add_watcher() i=1 2024-09-12T17:17:11.852 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.849+0000 7f3669d7e9c0 20 add_watcher() i=2 2024-09-12T17:17:11.852 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.849+0000 7f3669d7e9c0 20 add_watcher() i=3 2024-09-12T17:17:11.853 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.849+0000 7f3669d7e9c0 20 add_watcher() i=4 2024-09-12T17:17:11.853 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.849+0000 7f3669d7e9c0 20 add_watcher() i=5 2024-09-12T17:17:11.853 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.849+0000 7f3669d7e9c0 20 add_watcher() i=6 2024-09-12T17:17:11.854 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.853+0000 7f3669d7e9c0 20 add_watcher() i=7 2024-09-12T17:17:11.854 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.853+0000 7f3669d7e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:17:11.858 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.857+0000 7f351dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:11.859 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.857+0000 7f3669d7e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:17:11.859 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.857+0000 7f3669d7e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:17:11.859 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.857+0000 7f3669d7e9c0 5 note: GC not initialized 2024-09-12T17:17:11.860 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.857+0000 7f351cfe1640 20 reqs_thread_entry: start 2024-09-12T17:17:11.860 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.861+0000 7f3669d7e9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:17:11.860 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.861+0000 7f3669d7e9c0 20 Filter name: none 2024-09-12T17:17:11.860 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.861+0000 7f34967fc640 20 reqs_thread_entry: start 2024-09-12T17:17:11.874 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.873+0000 7f351dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:11.879 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.877+0000 7f3669d7e9c0 20 remove_watcher() i=0 2024-09-12T17:17:11.880 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.877+0000 7f3669d7e9c0 2 removed watcher, disabling cache 2024-09-12T17:17:11.882 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.881+0000 7f3669d7e9c0 20 remove_watcher() i=1 2024-09-12T17:17:11.884 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.885+0000 7f3669d7e9c0 20 remove_watcher() i=2 2024-09-12T17:17:11.886 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.885+0000 7f3669d7e9c0 20 remove_watcher() i=3 2024-09-12T17:17:11.889 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.889+0000 7f3669d7e9c0 20 remove_watcher() i=4 2024-09-12T17:17:11.891 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.889+0000 7f3669d7e9c0 20 remove_watcher() i=5 2024-09-12T17:17:11.893 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.893+0000 7f3669d7e9c0 20 remove_watcher() i=6 2024-09-12T17:17:11.895 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.893+0000 7f3669d7e9c0 20 remove_watcher() i=7 2024-09-12T17:17:11.911 INFO:tasks.workunit.client.0.smithi016.stderr:bucket name a-bucket 2024-09-12T17:17:11.911 INFO:tasks.workunit.client.0.smithi016.stderr:TEST: reshard process non empty bucket 2024-09-12T17:17:11.912 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:11.912 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin reshard process 2024-09-12T17:17:11.942 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:17:11.942 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:17:11.989 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.989+0000 7f1e31c539c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:11.991 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.989+0000 7f1e31c539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:11.991 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.989+0000 7f1e31c539c0 20 realm 2024-09-12T17:17:11.991 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.989+0000 7f1e31c539c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:11.991 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.989+0000 7f1e31c539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:11.991 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.989+0000 7f1e31c539c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:17:11.991 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.989+0000 7f1e31c539c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:11.991 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.989+0000 7f1e31c539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:11.991 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.989+0000 7f1e31c539c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:11.992 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.993+0000 7f1e31c539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:11.993 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.993+0000 7f1e31c539c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:11.994 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.993+0000 7f1e31c539c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:17:11.994 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.993+0000 7f1e31c539c0 20 searching for the correct realm 2024-09-12T17:17:11.997 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:11.997+0000 7f1e2ff5a640 0 -- 172.21.15.16:0/1207107967 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f1e24113bb0 msgr2=0x7f1e24131a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:12.213 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.213+0000 7f1e2ef58640 0 -- 172.21.15.16:0/1207107967 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f1e28051430 msgr2=0x7f1e280518b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:12.431 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.429+0000 7f1e31c539c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:17:12.432 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.429+0000 7f1e31c539c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:17:12.432 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.429+0000 7f1e31c539c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:17:12.432 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.429+0000 7f1e31c539c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:17:12.432 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.429+0000 7f1e31c539c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:17:12.432 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.429+0000 7f1e31c539c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:17:12.432 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.429+0000 7f1e31c539c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:12.432 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.433+0000 7f1e31c539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:12.432 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.433+0000 7f1e31c539c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:12.433 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.433+0000 7f1e31c539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:12.433 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.433+0000 7f1e31c539c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:12.434 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.433+0000 7f1e31c539c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:17:12.434 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.433+0000 7f1e31c539c0 20 zone default found 2024-09-12T17:17:12.434 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.433+0000 7f1e31c539c0 4 Realm: () 2024-09-12T17:17:12.434 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.433+0000 7f1e31c539c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:17:12.434 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.433+0000 7f1e31c539c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:17:12.434 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.433+0000 7f1e31c539c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:17:12.434 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.433+0000 7f1e31c539c0 20 zonegroup default 2024-09-12T17:17:12.434 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.433+0000 7f1e31c539c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:12.435 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.433+0000 7f1e31c539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:12.435 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.433+0000 7f1e31c539c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:12.435 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.433+0000 7f1e31c539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:12.435 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.433+0000 7f1e31c539c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:12.436 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.437+0000 7f1e31c539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:12.436 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.437+0000 7f1e31c539c0 20 started sync module instance, tier type = 2024-09-12T17:17:12.436 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.437+0000 7f1e31c539c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:17:12.461 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.461+0000 7f1e31c539c0 20 add_watcher() i=0 2024-09-12T17:17:12.461 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.461+0000 7f1e31c539c0 20 add_watcher() i=1 2024-09-12T17:17:12.461 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.461+0000 7f1e31c539c0 20 add_watcher() i=2 2024-09-12T17:17:12.461 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.461+0000 7f1e31c539c0 20 add_watcher() i=3 2024-09-12T17:17:12.461 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.461+0000 7f1e31c539c0 20 add_watcher() i=4 2024-09-12T17:17:12.462 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.461+0000 7f1e31c539c0 20 add_watcher() i=5 2024-09-12T17:17:12.462 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.461+0000 7f1e31c539c0 20 add_watcher() i=6 2024-09-12T17:17:12.463 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.461+0000 7f1e31c539c0 20 add_watcher() i=7 2024-09-12T17:17:12.464 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.461+0000 7f1e31c539c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:17:12.468 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.465+0000 7f1ce67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:12.469 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.469+0000 7f1e31c539c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:17:12.469 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.469+0000 7f1e31c539c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:17:12.470 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.469+0000 7f1e31c539c0 5 note: GC not initialized 2024-09-12T17:17:12.470 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.469+0000 7f1ce57e2640 20 reqs_thread_entry: start 2024-09-12T17:17:12.470 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.469+0000 7f1e31c539c0 20 init_complete bucket index max shards: 1 2024-09-12T17:17:12.470 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.469+0000 7f1e31c539c0 20 Filter name: none 2024-09-12T17:17:12.470 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.469+0000 7f1cde7fc640 20 reqs_thread_entry: start 2024-09-12T17:17:12.470 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.469+0000 7f1e31c539c0 20 processing logshard = reshard.0000000000 2024-09-12T17:17:12.477 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.477+0000 7f1e31c539c0 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T17:17:12.477 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.477+0000 7f1e31c539c0 20 processing logshard = reshard.0000000001 2024-09-12T17:17:12.482 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.481+0000 7f1e31c539c0 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T17:17:12.482 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.481+0000 7f1e31c539c0 20 processing logshard = reshard.0000000002 2024-09-12T17:17:12.487 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.485+0000 7f1e31c539c0 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T17:17:12.488 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.485+0000 7f1e31c539c0 20 processing logshard = reshard.0000000003 2024-09-12T17:17:12.494 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.493+0000 7f1e31c539c0 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T17:17:12.494 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.493+0000 7f1e31c539c0 20 processing logshard = reshard.0000000004 2024-09-12T17:17:12.501 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.501+0000 7f1e31c539c0 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T17:17:12.501 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.501+0000 7f1e31c539c0 20 processing logshard = reshard.0000000005 2024-09-12T17:17:12.506 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.505+0000 7f1e31c539c0 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T17:17:12.507 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.505+0000 7f1e31c539c0 20 processing logshard = reshard.0000000006 2024-09-12T17:17:12.509 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.509+0000 7f1e31c539c0 20 process_entry resharding a-bucket 2024-09-12T17:17:12.509 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.509+0000 7f1e31c539c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:17:12.510 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.509+0000 7f1e31c539c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:12.510 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.509+0000 7f1e31c539c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:17:12.510 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.509+0000 7f1e31c539c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T17:17:12.510 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.509+0000 7f1e31c539c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:17:12.510 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.509+0000 7f1e31c539c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 : miss 2024-09-12T17:17:12.511 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.509+0000 7f1e31c539c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:12.511 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.509+0000 7f1e31c539c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:17:12.511 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.509+0000 7f1e31c539c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:17:12.511 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.509+0000 7f1e31c539c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:17:12.511 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.509+0000 7f1e31c539c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:17:12.511 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.509+0000 7f1e31c539c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:17:12.511 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.509+0000 7f1e31c539c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 2024-09-12T17:17:12.522 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.521+0000 7f1e31c539c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:17:12.522 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.521+0000 7f1e31c539c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:17:12.522 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.521+0000 7f1e31c539c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:17:12.523 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.521+0000 7f1e31c539c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17, ofs0, ns] 2024-09-12T17:17:12.523 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.521+0000 7f1d127fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431585 cookie 94361770183584 notifier 6117 bl.length()=827 2024-09-12T17:17:12.523 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.521+0000 7f1d127fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:17:12.523 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.521+0000 7f1d127fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:17:12.523 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.521+0000 7f1d127fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:17:12.524 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.525+0000 7f1e31c539c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): orig_sources= new_sources= 2024-09-12T17:17:12.524 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.525+0000 7f1e31c539c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): potential sources added=[] removed=[] 2024-09-12T17:17:12.524 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.525+0000 7f1e31c539c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): orig_dests= new_dests= 2024-09-12T17:17:12.524 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.525+0000 7f1e31c539c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): potential dests added=[] removed=[] 2024-09-12T17:17:12.529 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.529+0000 7f1e31c539c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.0 2024-09-12T17:17:12.530 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.529+0000 7f1e31c539c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.0 2024-09-12T17:17:12.530 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.529+0000 7f1e31c539c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.1 2024-09-12T17:17:12.530 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.529+0000 7f1e31c539c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.1 2024-09-12T17:17:12.530 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.529+0000 7f1e31c539c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.2 2024-09-12T17:17:12.530 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.529+0000 7f1e31c539c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.2 2024-09-12T17:17:12.530 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.529+0000 7f1e31c539c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.1.0 2024-09-12T17:17:12.530 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.529+0000 7f1e31c539c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.1.0 2024-09-12T17:17:12.530 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.529+0000 7f1e31c539c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.1.1 2024-09-12T17:17:12.531 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.529+0000 7f1e31c539c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.1.1 2024-09-12T17:17:12.535 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.533+0000 7f1e31c539c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 : hit (requested=0x17, cached=0x17) 2024-09-12T17:17:12.535 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.533+0000 7f1e31c539c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 2024-09-12T17:17:12.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.537+0000 7f1e31c539c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:17:12.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.537+0000 7f1e31c539c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:17:12.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.537+0000 7f1e31c539c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:17:12.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.537+0000 7f1e31c539c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17, ofs0, ns] 2024-09-12T17:17:12.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.537+0000 7f1d12ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431586 cookie 94361770183584 notifier 6117 bl.length()=827 2024-09-12T17:17:12.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.537+0000 7f1d12ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:17:12.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.537+0000 7f1d12ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:17:12.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.537+0000 7f1d12ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:17:12.539 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.537+0000 7f1e31c539c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): orig_sources= new_sources= 2024-09-12T17:17:12.539 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.537+0000 7f1e31c539c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): potential sources added=[] removed=[] 2024-09-12T17:17:12.539 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.537+0000 7f1e31c539c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): orig_dests= new_dests= 2024-09-12T17:17:12.539 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.537+0000 7f1e31c539c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): potential dests added=[] removed=[] 2024-09-12T17:17:12.542 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.541+0000 7f1e31c539c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.1.0 2024-09-12T17:17:12.542 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.541+0000 7f1e31c539c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.1.0 2024-09-12T17:17:12.543 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.541+0000 7f1e31c539c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.1.1 2024-09-12T17:17:12.543 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.541+0000 7f1e31c539c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.1.1 2024-09-12T17:17:12.543 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.541+0000 7f1e31c539c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 : hit (requested=0x17, cached=0x17) 2024-09-12T17:17:12.543 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.541+0000 7f1e31c539c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 2024-09-12T17:17:12.546 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.545+0000 7f1e31c539c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:17:12.546 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.545+0000 7f1e31c539c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:17:12.546 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.545+0000 7f1e31c539c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:17:12.546 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.545+0000 7f1e31c539c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17, ofs0, ns] 2024-09-12T17:17:12.546 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.545+0000 7f1d12ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431587 cookie 94361770183584 notifier 6117 bl.length()=795 2024-09-12T17:17:12.546 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.545+0000 7f1d12ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:17:12.547 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.545+0000 7f1d12ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:17:12.547 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.545+0000 7f1d12ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:17:12.547 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.545+0000 7f1e31c539c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): orig_sources= new_sources= 2024-09-12T17:17:12.547 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.545+0000 7f1e31c539c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): potential sources added=[] removed=[] 2024-09-12T17:17:12.547 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.545+0000 7f1e31c539c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): orig_dests= new_dests= 2024-09-12T17:17:12.547 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.545+0000 7f1e31c539c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): potential dests added=[] removed=[] 2024-09-12T17:17:12.550 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.549+0000 7f1e31c539c0 1 execute INFO: reshard of bucket "a-bucket" from 2 shards to 3 shards completed successfully 2024-09-12T17:17:12.552 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.553+0000 7f1e31c539c0 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T17:17:12.556 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.557+0000 7f1e31c539c0 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T17:17:12.556 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.557+0000 7f1e31c539c0 20 processing logshard = reshard.0000000007 2024-09-12T17:17:12.561 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.561+0000 7f1e31c539c0 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T17:17:12.561 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.561+0000 7f1e31c539c0 20 processing logshard = reshard.0000000008 2024-09-12T17:17:12.568 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.569+0000 7f1e31c539c0 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T17:17:12.568 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.569+0000 7f1e31c539c0 20 processing logshard = reshard.0000000009 2024-09-12T17:17:12.575 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.573+0000 7f1e31c539c0 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T17:17:12.575 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.573+0000 7f1e31c539c0 20 processing logshard = reshard.0000000010 2024-09-12T17:17:12.580 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.581+0000 7f1e31c539c0 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T17:17:12.580 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.581+0000 7f1e31c539c0 20 processing logshard = reshard.0000000011 2024-09-12T17:17:12.585 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.585+0000 7f1e31c539c0 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T17:17:12.585 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.585+0000 7f1e31c539c0 20 processing logshard = reshard.0000000012 2024-09-12T17:17:12.592 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.593+0000 7f1e31c539c0 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T17:17:12.593 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.593+0000 7f1e31c539c0 20 processing logshard = reshard.0000000013 2024-09-12T17:17:12.599 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.597+0000 7f1e31c539c0 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T17:17:12.600 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.597+0000 7f1e31c539c0 20 processing logshard = reshard.0000000014 2024-09-12T17:17:12.604 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.605+0000 7f1e31c539c0 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T17:17:12.604 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.605+0000 7f1e31c539c0 20 processing logshard = reshard.0000000015 2024-09-12T17:17:12.612 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.613+0000 7f1e31c539c0 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T17:17:12.614 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.613+0000 7f1ce67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:12.619 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.617+0000 7f1e31c539c0 20 remove_watcher() i=0 2024-09-12T17:17:12.619 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.617+0000 7f1e31c539c0 2 removed watcher, disabling cache 2024-09-12T17:17:12.622 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.621+0000 7f1e31c539c0 20 remove_watcher() i=1 2024-09-12T17:17:12.625 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.625+0000 7f1e31c539c0 20 remove_watcher() i=2 2024-09-12T17:17:12.627 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.625+0000 7f1e31c539c0 20 remove_watcher() i=3 2024-09-12T17:17:12.630 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.629+0000 7f1e31c539c0 20 remove_watcher() i=4 2024-09-12T17:17:12.632 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.633+0000 7f1e31c539c0 20 remove_watcher() i=5 2024-09-12T17:17:12.634 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.633+0000 7f1e31c539c0 20 remove_watcher() i=6 2024-09-12T17:17:12.636 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.637+0000 7f1e31c539c0 20 remove_watcher() i=7 2024-09-12T17:17:12.655 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:17:12.687 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:17:12.687 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:17:12.733 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.733+0000 7f56413e69c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:12.735 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.733+0000 7f56413e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:12.735 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.733+0000 7f56413e69c0 20 realm 2024-09-12T17:17:12.735 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.733+0000 7f56413e69c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:12.736 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.733+0000 7f56413e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:12.736 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.733+0000 7f56413e69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:17:12.736 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.733+0000 7f56413e69c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:12.736 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.733+0000 7f56413e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:12.736 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.733+0000 7f56413e69c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:12.737 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.737+0000 7f56413e69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:12.737 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.737+0000 7f56413e69c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:12.739 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.737+0000 7f56413e69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:17:12.739 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.737+0000 7f56413e69c0 20 searching for the correct realm 2024-09-12T17:17:12.742 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.741+0000 7f563f6ed640 0 -- 172.21.15.16:0/2911973490 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f5628052020 msgr2=0x7f5628083190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:17:12.958 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:12.957+0000 7f563e6eb640 0 -- 172.21.15.16:0/2911973490 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f5638068ba0 msgr2=0x7f5638080180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:13.176 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.173+0000 7f56413e69c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:17:13.177 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.173+0000 7f56413e69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:17:13.177 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.173+0000 7f56413e69c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:17:13.177 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.173+0000 7f56413e69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:17:13.177 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.173+0000 7f56413e69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:17:13.177 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.173+0000 7f56413e69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:17:13.177 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.173+0000 7f56413e69c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:13.178 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.177+0000 7f56413e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:13.178 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.177+0000 7f56413e69c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:13.178 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.177+0000 7f56413e69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:13.178 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.177+0000 7f56413e69c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:13.179 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.177+0000 7f56413e69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:17:13.179 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.177+0000 7f56413e69c0 20 zone default found 2024-09-12T17:17:13.179 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.177+0000 7f56413e69c0 4 Realm: () 2024-09-12T17:17:13.179 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.177+0000 7f56413e69c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:17:13.179 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.177+0000 7f56413e69c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:17:13.179 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.177+0000 7f56413e69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:17:13.179 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.177+0000 7f56413e69c0 20 zonegroup default 2024-09-12T17:17:13.179 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.177+0000 7f56413e69c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:13.180 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.177+0000 7f56413e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:13.180 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.177+0000 7f56413e69c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:13.180 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.181+0000 7f56413e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:13.180 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.181+0000 7f56413e69c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:13.181 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.181+0000 7f56413e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:13.181 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.181+0000 7f56413e69c0 20 started sync module instance, tier type = 2024-09-12T17:17:13.181 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.181+0000 7f56413e69c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:17:13.205 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.205+0000 7f56413e69c0 20 add_watcher() i=0 2024-09-12T17:17:13.205 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.205+0000 7f56413e69c0 20 add_watcher() i=1 2024-09-12T17:17:13.205 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.205+0000 7f56413e69c0 20 add_watcher() i=2 2024-09-12T17:17:13.205 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.205+0000 7f56413e69c0 20 add_watcher() i=3 2024-09-12T17:17:13.205 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.205+0000 7f56413e69c0 20 add_watcher() i=4 2024-09-12T17:17:13.206 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.205+0000 7f56413e69c0 20 add_watcher() i=5 2024-09-12T17:17:13.206 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.205+0000 7f56413e69c0 20 add_watcher() i=6 2024-09-12T17:17:13.207 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.205+0000 7f56413e69c0 20 add_watcher() i=7 2024-09-12T17:17:13.207 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.205+0000 7f56413e69c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:17:13.211 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.209+0000 7f54f57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:13.212 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.213+0000 7f56413e69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:17:13.212 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.213+0000 7f56413e69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:17:13.213 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.213+0000 7f56413e69c0 5 note: GC not initialized 2024-09-12T17:17:13.218 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.213+0000 7f546ffff640 20 reqs_thread_entry: start 2024-09-12T17:17:13.218 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.213+0000 7f56413e69c0 20 init_complete bucket index max shards: 1 2024-09-12T17:17:13.219 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.213+0000 7f56413e69c0 20 Filter name: none 2024-09-12T17:17:13.219 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.213+0000 7f546dffb640 20 reqs_thread_entry: start 2024-09-12T17:17:13.219 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.213+0000 7f56413e69c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:13.219 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.217+0000 7f56413e69c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:17:13.219 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.217+0000 7f56413e69c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:13.219 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.217+0000 7f56413e69c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:17:13.219 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.217+0000 7f56413e69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:17:13.220 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.217+0000 7f56413e69c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:13.221 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.217+0000 7f56413e69c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:17:13.221 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.217+0000 7f56413e69c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:13.223 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.217+0000 7f56413e69c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:17:13.223 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.217+0000 7f56413e69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:17:13.224 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.221+0000 7f54f57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:13.227 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.225+0000 7f56413e69c0 20 remove_watcher() i=0 2024-09-12T17:17:13.227 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.225+0000 7f56413e69c0 2 removed watcher, disabling cache 2024-09-12T17:17:13.229 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.229+0000 7f56413e69c0 20 remove_watcher() i=1 2024-09-12T17:17:13.231 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.229+0000 7f56413e69c0 20 remove_watcher() i=2 2024-09-12T17:17:13.233 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.233+0000 7f56413e69c0 20 remove_watcher() i=3 2024-09-12T17:17:13.235 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.233+0000 7f56413e69c0 20 remove_watcher() i=4 2024-09-12T17:17:13.237 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.237+0000 7f56413e69c0 20 remove_watcher() i=5 2024-09-12T17:17:13.238 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.237+0000 7f56413e69c0 20 remove_watcher() i=6 2024-09-12T17:17:13.240 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.241+0000 7f56413e69c0 20 remove_watcher() i=7 2024-09-12T17:17:13.257 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:13.257 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:17:13.257 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: a-bucket id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 num_objects: 8 size_kb: 1 num_shards: 3 2024-09-12T17:17:13.257 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:13.257 INFO:tasks.workunit.client.0.smithi016.stderr:TEST: reshard bucket with EIO injected at init_index 2024-09-12T17:17:13.257 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:13.712 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T17:17:13.746 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:17:13.746 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:17:13.797 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.797+0000 7f12026259c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:13.799 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.797+0000 7f12026259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:13.799 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.797+0000 7f12026259c0 20 realm 2024-09-12T17:17:13.799 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.797+0000 7f12026259c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:13.799 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.797+0000 7f12026259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:13.799 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.797+0000 7f12026259c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:17:13.799 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.797+0000 7f12026259c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:13.799 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.797+0000 7f12026259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:13.799 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.797+0000 7f12026259c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:13.800 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.801+0000 7f12026259c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:13.801 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.801+0000 7f12026259c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:13.802 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.801+0000 7f12026259c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:17:13.802 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.801+0000 7f12026259c0 20 searching for the correct realm 2024-09-12T17:17:13.802 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:13.801+0000 7f120012b640 0 -- 172.21.15.16:0/2705747558 >> [v2:172.21.15.16:6824/465585330,v1:172.21.15.16:6825/465585330] conn(0x55f301e2d5f0 msgr2=0x55f301e2fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:14.015 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.013+0000 7f120012b640 0 -- 172.21.15.16:0/2705747558 >> [v2:172.21.15.19:6802/36415917,v1:172.21.15.19:6804/36415917] conn(0x7f11f80db040 msgr2=0x7f11f80af970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:14.237 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.237+0000 7f12026259c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:17:14.237 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.237+0000 7f12026259c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:17:14.237 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.237+0000 7f12026259c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:17:14.238 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.237+0000 7f12026259c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:17:14.238 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.237+0000 7f12026259c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:17:14.238 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.237+0000 7f12026259c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:17:14.238 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.237+0000 7f12026259c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:14.238 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.237+0000 7f12026259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:14.238 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.237+0000 7f12026259c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:14.238 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.237+0000 7f12026259c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:14.239 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.237+0000 7f12026259c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:14.240 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.237+0000 7f12026259c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:17:14.240 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.237+0000 7f12026259c0 20 zone default found 2024-09-12T17:17:14.240 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.237+0000 7f12026259c0 4 Realm: () 2024-09-12T17:17:14.240 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.237+0000 7f12026259c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:17:14.240 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.237+0000 7f12026259c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:17:14.240 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.237+0000 7f12026259c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:17:14.240 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.237+0000 7f12026259c0 20 zonegroup default 2024-09-12T17:17:14.240 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.237+0000 7f12026259c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:14.241 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.241+0000 7f12026259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:14.241 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.241+0000 7f12026259c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:14.241 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.241+0000 7f12026259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:14.241 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.241+0000 7f12026259c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:14.242 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.241+0000 7f12026259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:14.242 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.241+0000 7f12026259c0 20 started sync module instance, tier type = 2024-09-12T17:17:14.242 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.241+0000 7f12026259c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:17:14.267 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.265+0000 7f12026259c0 20 add_watcher() i=0 2024-09-12T17:17:14.267 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.265+0000 7f12026259c0 20 add_watcher() i=1 2024-09-12T17:17:14.267 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.265+0000 7f12026259c0 20 add_watcher() i=2 2024-09-12T17:17:14.268 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.265+0000 7f12026259c0 20 add_watcher() i=3 2024-09-12T17:17:14.268 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.265+0000 7f12026259c0 20 add_watcher() i=4 2024-09-12T17:17:14.268 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.265+0000 7f12026259c0 20 add_watcher() i=5 2024-09-12T17:17:14.268 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.265+0000 7f12026259c0 20 add_watcher() i=6 2024-09-12T17:17:14.270 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.269+0000 7f12026259c0 20 add_watcher() i=7 2024-09-12T17:17:14.270 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.269+0000 7f12026259c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:17:14.274 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.273+0000 7f10b6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:14.275 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.273+0000 7f12026259c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:17:14.275 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.273+0000 7f12026259c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:17:14.275 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.273+0000 7f12026259c0 5 note: GC not initialized 2024-09-12T17:17:14.276 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.277+0000 7f10b5fe3640 20 reqs_thread_entry: start 2024-09-12T17:17:14.276 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.277+0000 7f12026259c0 20 init_complete bucket index max shards: 1 2024-09-12T17:17:14.277 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.277+0000 7f12026259c0 20 Filter name: none 2024-09-12T17:17:14.277 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.277+0000 7f10aeffd640 20 reqs_thread_entry: start 2024-09-12T17:17:14.277 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.277+0000 7f12026259c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:14.278 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.277+0000 7f12026259c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:17:14.278 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.277+0000 7f12026259c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:14.279 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.277+0000 7f12026259c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:17:14.279 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.277+0000 7f12026259c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:17:14.279 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.277+0000 7f12026259c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:14.280 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.281+0000 7f12026259c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:17:14.280 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.281+0000 7f12026259c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:14.281 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.281+0000 7f12026259c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:17:14.281 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.281+0000 7f12026259c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:17:14.284 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.285+0000 7f10b6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:14.289 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.289+0000 7f12026259c0 20 remove_watcher() i=0 2024-09-12T17:17:14.289 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.289+0000 7f12026259c0 2 removed watcher, disabling cache 2024-09-12T17:17:14.291 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.289+0000 7f12026259c0 20 remove_watcher() i=1 2024-09-12T17:17:14.294 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.293+0000 7f12026259c0 20 remove_watcher() i=2 2024-09-12T17:17:14.296 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.297+0000 7f12026259c0 20 remove_watcher() i=3 2024-09-12T17:17:14.301 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.297+0000 7f12026259c0 20 remove_watcher() i=4 2024-09-12T17:17:14.301 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.301+0000 7f12026259c0 20 remove_watcher() i=5 2024-09-12T17:17:14.302 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.301+0000 7f12026259c0 20 remove_watcher() i=6 2024-09-12T17:17:14.304 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.305+0000 7f12026259c0 20 remove_watcher() i=7 2024-09-12T17:17:14.321 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:14.321 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:17:14.322 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: error-at-init-index id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:17:14.322 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:14.322 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index 2024-09-12T17:17:14.356 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:17:14.357 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:17:14.403 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.401+0000 7f024fe6e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:14.405 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.405+0000 7f024fe6e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:14.405 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.405+0000 7f024fe6e9c0 20 realm 2024-09-12T17:17:14.405 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.405+0000 7f024fe6e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:14.406 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.405+0000 7f024fe6e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:14.406 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.405+0000 7f024fe6e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:17:14.406 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.405+0000 7f024fe6e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:14.406 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.405+0000 7f024fe6e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:14.406 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.405+0000 7f024fe6e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:14.408 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.405+0000 7f024fe6e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:14.408 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.405+0000 7f024fe6e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:14.409 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.409+0000 7f024fe6e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:17:14.409 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.409+0000 7f024fe6e9c0 20 searching for the correct realm 2024-09-12T17:17:14.413 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.413+0000 7f024e175640 0 -- 172.21.15.16:0/2686051755 >> [v2:172.21.15.19:6800/1509147557,v1:172.21.15.19:6801/1509147557] conn(0x56102f8bfcb0 msgr2=0x56102f8c20c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:14.420 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.421+0000 7f024d173640 0 -- 172.21.15.16:0/2686051755 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f02480fb450 msgr2=0x7f02480fb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:17:14.639 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.637+0000 7f024fe6e9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:17:14.639 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.637+0000 7f024fe6e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:17:14.639 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.637+0000 7f024fe6e9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:17:14.640 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.637+0000 7f024fe6e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:17:14.640 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.637+0000 7f024fe6e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:17:14.640 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.637+0000 7f024fe6e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:17:14.640 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.637+0000 7f024fe6e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:14.640 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.641+0000 7f024fe6e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:14.640 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.641+0000 7f024fe6e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:14.641 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.641+0000 7f024fe6e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:14.641 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.641+0000 7f024fe6e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:14.642 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.641+0000 7f024fe6e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:17:14.642 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.641+0000 7f024fe6e9c0 20 zone default found 2024-09-12T17:17:14.643 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.641+0000 7f024fe6e9c0 4 Realm: () 2024-09-12T17:17:14.643 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.641+0000 7f024fe6e9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:17:14.643 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.641+0000 7f024fe6e9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:17:14.643 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.641+0000 7f024fe6e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:17:14.643 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.641+0000 7f024fe6e9c0 20 zonegroup default 2024-09-12T17:17:14.643 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.641+0000 7f024fe6e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:14.643 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.641+0000 7f024fe6e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:14.643 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.641+0000 7f024fe6e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:14.644 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.641+0000 7f024fe6e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:14.644 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.641+0000 7f024fe6e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:14.644 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.645+0000 7f024fe6e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:14.644 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.645+0000 7f024fe6e9c0 20 started sync module instance, tier type = 2024-09-12T17:17:14.644 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.645+0000 7f024fe6e9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:17:14.669 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.669+0000 7f024fe6e9c0 20 add_watcher() i=0 2024-09-12T17:17:14.669 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.669+0000 7f024fe6e9c0 20 add_watcher() i=1 2024-09-12T17:17:14.669 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.669+0000 7f024fe6e9c0 20 add_watcher() i=2 2024-09-12T17:17:14.669 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.669+0000 7f024fe6e9c0 20 add_watcher() i=3 2024-09-12T17:17:14.669 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.669+0000 7f024fe6e9c0 20 add_watcher() i=4 2024-09-12T17:17:14.670 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.669+0000 7f024fe6e9c0 20 add_watcher() i=5 2024-09-12T17:17:14.670 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.669+0000 7f024fe6e9c0 20 add_watcher() i=6 2024-09-12T17:17:14.671 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.669+0000 7f024fe6e9c0 20 add_watcher() i=7 2024-09-12T17:17:14.671 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.669+0000 7f024fe6e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:17:14.675 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.673+0000 7f00ff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:14.677 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.677+0000 7f024fe6e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:17:14.677 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.677+0000 7f024fe6e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:17:14.677 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.677+0000 7f024fe6e9c0 5 note: GC not initialized 2024-09-12T17:17:14.677 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.677+0000 7f00fe7fc640 20 reqs_thread_entry: start 2024-09-12T17:17:14.677 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.677+0000 7f024fe6e9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:17:14.678 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.677+0000 7f024fe6e9c0 20 Filter name: none 2024-09-12T17:17:14.678 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.677+0000 7f006ffff640 20 reqs_thread_entry: start 2024-09-12T17:17:14.678 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.677+0000 7f024fe6e9c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T17:17:14.678 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.677+0000 7f024fe6e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:14.679 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.677+0000 7f024fe6e9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:17:14.679 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.677+0000 7f024fe6e9c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T17:17:14.679 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.677+0000 7f024fe6e9c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T17:17:14.679 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.677+0000 7f024fe6e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19 : miss 2024-09-12T17:17:14.679 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.677+0000 7f024fe6e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:14.680 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.681+0000 7f024fe6e9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:17:14.680 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.681+0000 7f024fe6e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19 info.flags=0x17 2024-09-12T17:17:14.680 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.681+0000 7f024fe6e9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19 to cache LRU end 2024-09-12T17:17:14.680 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.681+0000 7f024fe6e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:17:14.680 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.681+0000 7f024fe6e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:17:14.680 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.681+0000 7f024fe6e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19 2024-09-12T17:17:14.683 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.681+0000 7f024fe6e9c0 -1 Injecting error=-5 at location=init_index 2024-09-12T17:17:14.683 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.681+0000 7f024fe6e9c0 0 ERROR: init_target_index failed to initialize target index shard objects: (5) Input/output error 2024-09-12T17:17:14.687 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.685+0000 7f00ff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:14.692 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.693+0000 7f024fe6e9c0 20 remove_watcher() i=0 2024-09-12T17:17:14.692 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.693+0000 7f024fe6e9c0 2 removed watcher, disabling cache 2024-09-12T17:17:14.695 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.693+0000 7f024fe6e9c0 20 remove_watcher() i=1 2024-09-12T17:17:14.697 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.697+0000 7f024fe6e9c0 20 remove_watcher() i=2 2024-09-12T17:17:14.699 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.697+0000 7f024fe6e9c0 20 remove_watcher() i=3 2024-09-12T17:17:14.702 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.701+0000 7f024fe6e9c0 20 remove_watcher() i=4 2024-09-12T17:17:14.704 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.705+0000 7f024fe6e9c0 20 remove_watcher() i=5 2024-09-12T17:17:14.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.705+0000 7f024fe6e9c0 20 remove_watcher() i=6 2024-09-12T17:17:14.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.709+0000 7f024fe6e9c0 20 remove_watcher() i=7 2024-09-12T17:17:14.726 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T17:17:14.756 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:17:14.757 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:17:14.803 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.801+0000 7fab0cf769c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:14.805 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.805+0000 7fab0cf769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:14.805 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.805+0000 7fab0cf769c0 20 realm 2024-09-12T17:17:14.805 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.805+0000 7fab0cf769c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:14.805 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.805+0000 7fab0cf769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:14.805 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.805+0000 7fab0cf769c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:17:14.806 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.805+0000 7fab0cf769c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:14.806 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.805+0000 7fab0cf769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:14.806 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.805+0000 7fab0cf769c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:14.807 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.805+0000 7fab0cf769c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:14.807 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.805+0000 7fab0cf769c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:14.809 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.809+0000 7fab0cf769c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:17:14.809 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.809+0000 7fab0cf769c0 20 searching for the correct realm 2024-09-12T17:17:14.812 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:14.813+0000 7fab0b27d640 0 -- 172.21.15.16:0/2981476249 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fab000fa440 msgr2=0x7fab000fa8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:15.030 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.029+0000 7fab0a27b640 0 -- 172.21.15.16:0/2981476249 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fab0400bb40 msgr2=0x7fab0400d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:15.248 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.249+0000 7fab0cf769c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:17:15.248 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.249+0000 7fab0cf769c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:17:15.248 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.249+0000 7fab0cf769c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:17:15.248 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.249+0000 7fab0cf769c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:17:15.248 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.249+0000 7fab0cf769c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:17:15.248 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.249+0000 7fab0cf769c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:17:15.249 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.249+0000 7fab0cf769c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:15.249 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.249+0000 7fab0cf769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:15.249 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.249+0000 7fab0cf769c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:15.250 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.249+0000 7fab0cf769c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:15.250 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.249+0000 7fab0cf769c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:15.251 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.249+0000 7fab0cf769c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:17:15.251 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.249+0000 7fab0cf769c0 20 zone default found 2024-09-12T17:17:15.251 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.249+0000 7fab0cf769c0 4 Realm: () 2024-09-12T17:17:15.251 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.249+0000 7fab0cf769c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:17:15.251 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.249+0000 7fab0cf769c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:17:15.251 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.249+0000 7fab0cf769c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:17:15.252 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.249+0000 7fab0cf769c0 20 zonegroup default 2024-09-12T17:17:15.252 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.249+0000 7fab0cf769c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:15.252 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.253+0000 7fab0cf769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:15.252 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.253+0000 7fab0cf769c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:15.253 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.253+0000 7fab0cf769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:15.253 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.253+0000 7fab0cf769c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:15.254 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.253+0000 7fab0cf769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:15.254 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.253+0000 7fab0cf769c0 20 started sync module instance, tier type = 2024-09-12T17:17:15.254 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.253+0000 7fab0cf769c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:17:15.279 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.277+0000 7fab0cf769c0 20 add_watcher() i=0 2024-09-12T17:17:15.279 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.277+0000 7fab0cf769c0 20 add_watcher() i=1 2024-09-12T17:17:15.279 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.277+0000 7fab0cf769c0 20 add_watcher() i=2 2024-09-12T17:17:15.279 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.277+0000 7fab0cf769c0 20 add_watcher() i=3 2024-09-12T17:17:15.279 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.277+0000 7fab0cf769c0 20 add_watcher() i=4 2024-09-12T17:17:15.280 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.277+0000 7fab0cf769c0 20 add_watcher() i=5 2024-09-12T17:17:15.280 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.277+0000 7fab0cf769c0 20 add_watcher() i=6 2024-09-12T17:17:15.281 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.281+0000 7fab0cf769c0 20 add_watcher() i=7 2024-09-12T17:17:15.281 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.281+0000 7fab0cf769c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:17:15.286 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.285+0000 7fa9c17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:15.287 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.285+0000 7fab0cf769c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:17:15.287 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.285+0000 7fab0cf769c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:17:15.287 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.285+0000 7fab0cf769c0 5 note: GC not initialized 2024-09-12T17:17:15.288 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.285+0000 7fa93bfff640 20 reqs_thread_entry: start 2024-09-12T17:17:15.288 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.285+0000 7fab0cf769c0 20 init_complete bucket index max shards: 1 2024-09-12T17:17:15.288 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.289+0000 7fab0cf769c0 20 Filter name: none 2024-09-12T17:17:15.288 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.289+0000 7fa939ffb640 20 reqs_thread_entry: start 2024-09-12T17:17:15.288 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.289+0000 7fab0cf769c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:15.289 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.289+0000 7fab0cf769c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:17:15.289 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.289+0000 7fab0cf769c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:15.290 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.289+0000 7fab0cf769c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:17:15.290 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.289+0000 7fab0cf769c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:17:15.290 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.289+0000 7fab0cf769c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:15.290 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.289+0000 7fab0cf769c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:17:15.290 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.289+0000 7fab0cf769c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:15.291 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.289+0000 7fab0cf769c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:17:15.291 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.289+0000 7fab0cf769c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:17:15.293 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.293+0000 7fa9c17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:15.298 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.297+0000 7fab0cf769c0 20 remove_watcher() i=0 2024-09-12T17:17:15.298 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.297+0000 7fab0cf769c0 2 removed watcher, disabling cache 2024-09-12T17:17:15.301 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.301+0000 7fab0cf769c0 20 remove_watcher() i=1 2024-09-12T17:17:15.303 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.301+0000 7fab0cf769c0 20 remove_watcher() i=2 2024-09-12T17:17:15.305 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.305+0000 7fab0cf769c0 20 remove_watcher() i=3 2024-09-12T17:17:15.307 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.305+0000 7fab0cf769c0 20 remove_watcher() i=4 2024-09-12T17:17:15.309 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.309+0000 7fab0cf769c0 20 remove_watcher() i=5 2024-09-12T17:17:15.310 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.309+0000 7fab0cf769c0 20 remove_watcher() i=6 2024-09-12T17:17:15.311 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.309+0000 7fab0cf769c0 20 remove_watcher() i=7 2024-09-12T17:17:15.328 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:15.329 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:17:15.329 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: error-at-init-index id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:17:15.329 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:15.389 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:17:15.427 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:17:15.427 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:17:15.475 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.473+0000 7fa06b4bf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:15.477 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.477+0000 7fa06b4bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:15.477 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.477+0000 7fa06b4bf9c0 20 realm 2024-09-12T17:17:15.477 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.477+0000 7fa06b4bf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:15.477 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.477+0000 7fa06b4bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:15.477 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.477+0000 7fa06b4bf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:17:15.477 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.477+0000 7fa06b4bf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:15.478 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.477+0000 7fa06b4bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:15.478 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.477+0000 7fa06b4bf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:15.479 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.477+0000 7fa06b4bf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:15.479 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.477+0000 7fa06b4bf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:15.481 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.481+0000 7fa06b4bf9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:17:15.481 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.481+0000 7fa06b4bf9c0 20 searching for the correct realm 2024-09-12T17:17:15.484 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.485+0000 7fa0697c6640 0 -- 172.21.15.16:0/4189264139 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fa05c0c4060 msgr2=0x7fa05c118a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:15.493 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.493+0000 7fa0687c4640 0 -- 172.21.15.16:0/4189264139 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fa058053420 msgr2=0x7fa0580538a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:15.712 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.713+0000 7fa06b4bf9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:17:15.712 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.713+0000 7fa06b4bf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:17:15.712 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.713+0000 7fa06b4bf9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:17:15.713 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.713+0000 7fa06b4bf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:17:15.713 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.713+0000 7fa06b4bf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:17:15.713 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.713+0000 7fa06b4bf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:17:15.713 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.713+0000 7fa06b4bf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:15.713 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.713+0000 7fa06b4bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:15.713 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.713+0000 7fa06b4bf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:15.714 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.713+0000 7fa06b4bf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:15.714 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.713+0000 7fa06b4bf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:15.715 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.713+0000 7fa06b4bf9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:17:15.715 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.713+0000 7fa06b4bf9c0 20 zone default found 2024-09-12T17:17:15.715 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.713+0000 7fa06b4bf9c0 4 Realm: () 2024-09-12T17:17:15.715 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.713+0000 7fa06b4bf9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:17:15.715 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.713+0000 7fa06b4bf9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:17:15.715 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.713+0000 7fa06b4bf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:17:15.715 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.713+0000 7fa06b4bf9c0 20 zonegroup default 2024-09-12T17:17:15.715 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.713+0000 7fa06b4bf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:15.715 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.713+0000 7fa06b4bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:15.716 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.713+0000 7fa06b4bf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:15.716 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.717+0000 7fa06b4bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:15.716 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.717+0000 7fa06b4bf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:15.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.717+0000 7fa06b4bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:15.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.717+0000 7fa06b4bf9c0 20 started sync module instance, tier type = 2024-09-12T17:17:15.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.717+0000 7fa06b4bf9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:17:15.742 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.741+0000 7fa06b4bf9c0 20 add_watcher() i=0 2024-09-12T17:17:15.742 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.741+0000 7fa06b4bf9c0 20 add_watcher() i=1 2024-09-12T17:17:15.742 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.741+0000 7fa06b4bf9c0 20 add_watcher() i=2 2024-09-12T17:17:15.742 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.741+0000 7fa06b4bf9c0 20 add_watcher() i=3 2024-09-12T17:17:15.742 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.741+0000 7fa06b4bf9c0 20 add_watcher() i=4 2024-09-12T17:17:15.742 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.741+0000 7fa06b4bf9c0 20 add_watcher() i=5 2024-09-12T17:17:15.742 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.741+0000 7fa06b4bf9c0 20 add_watcher() i=6 2024-09-12T17:17:15.744 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.745+0000 7fa06b4bf9c0 20 add_watcher() i=7 2024-09-12T17:17:15.744 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.745+0000 7fa06b4bf9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:17:15.749 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.749+0000 7f9f1efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:15.750 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.749+0000 7fa06b4bf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:17:15.750 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.749+0000 7fa06b4bf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:17:15.750 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.749+0000 7fa06b4bf9c0 5 note: GC not initialized 2024-09-12T17:17:15.751 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.749+0000 7f9f1dfe3640 20 reqs_thread_entry: start 2024-09-12T17:17:15.751 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.749+0000 7fa06b4bf9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:17:15.751 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.749+0000 7fa06b4bf9c0 20 Filter name: none 2024-09-12T17:17:15.751 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.749+0000 7f9e8f7fe640 20 reqs_thread_entry: start 2024-09-12T17:17:15.751 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.749+0000 7fa06b4bf9c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T17:17:15.751 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.749+0000 7fa06b4bf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:15.752 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.753+0000 7fa06b4bf9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:17:15.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.753+0000 7fa06b4bf9c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T17:17:15.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.753+0000 7fa06b4bf9c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T17:17:15.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.753+0000 7fa06b4bf9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19 : miss 2024-09-12T17:17:15.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.753+0000 7fa06b4bf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:15.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.753+0000 7fa06b4bf9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:17:15.754 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.753+0000 7fa06b4bf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19 info.flags=0x17 2024-09-12T17:17:15.754 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.753+0000 7fa06b4bf9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19 to cache LRU end 2024-09-12T17:17:15.754 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.753+0000 7fa06b4bf9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:17:15.754 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.753+0000 7fa06b4bf9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:17:15.754 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.753+0000 7fa06b4bf9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19 2024-09-12T17:17:15.762 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.761+0000 7fa06b4bf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19 info.flags=0x17 2024-09-12T17:17:15.762 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.761+0000 7fa06b4bf9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19 to cache LRU end 2024-09-12T17:17:15.762 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.761+0000 7fa06b4bf9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:17:15.762 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.761+0000 7fa06b4bf9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19, ofs0, ns] 2024-09-12T17:17:15.763 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.761+0000 7f9f3ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431594 cookie 94777437915504 notifier 6207 bl.length()=911 2024-09-12T17:17:15.763 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.761+0000 7f9f3ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19 info.flags=0x17 2024-09-12T17:17:15.763 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.761+0000 7f9f3ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19 to cache LRU end 2024-09-12T17:17:15.763 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.761+0000 7f9f3ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:17:15.765 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.765+0000 7fa06b4bf9c0 20 handle_bi_update(): bucket=:error-at-init-index[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19]): orig_sources= new_sources= 2024-09-12T17:17:15.765 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.765+0000 7fa06b4bf9c0 20 handle_bi_update(): bucket=:error-at-init-index[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19]): potential sources added=[] removed=[] 2024-09-12T17:17:15.765 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.765+0000 7fa06b4bf9c0 20 handle_bi_update(): bucket=:error-at-init-index[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19]): orig_dests= new_dests= 2024-09-12T17:17:15.765 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.765+0000 7fa06b4bf9c0 20 handle_bi_update(): bucket=:error-at-init-index[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19]): potential dests added=[] removed=[] 2024-09-12T17:17:15.770 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.769+0000 7fa06b4bf9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19.1.0 2024-09-12T17:17:15.770 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.769+0000 7fa06b4bf9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19.1.0 2024-09-12T17:17:15.770 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.769+0000 7fa06b4bf9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19.1.1 2024-09-12T17:17:15.771 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.769+0000 7fa06b4bf9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19.1.1 2024-09-12T17:17:15.771 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.769+0000 7fa06b4bf9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19.0 2024-09-12T17:17:15.777 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.777+0000 7fa06b4bf9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19 : hit (requested=0x17, cached=0x17) 2024-09-12T17:17:15.777 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.777+0000 7fa06b4bf9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19 2024-09-12T17:17:15.779 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.777+0000 7fa06b4bf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19 info.flags=0x17 2024-09-12T17:17:15.780 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.777+0000 7fa06b4bf9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19 to cache LRU end 2024-09-12T17:17:15.780 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.777+0000 7fa06b4bf9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:17:15.780 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.777+0000 7fa06b4bf9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19, ofs0, ns] 2024-09-12T17:17:15.780 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.781+0000 7f9f3ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431595 cookie 94777437915504 notifier 6207 bl.length()=911 2024-09-12T17:17:15.780 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.781+0000 7f9f3ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19 info.flags=0x17 2024-09-12T17:17:15.780 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.781+0000 7f9f3ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19 to cache LRU end 2024-09-12T17:17:15.780 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.781+0000 7f9f3ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:17:15.781 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.781+0000 7fa06b4bf9c0 20 handle_bi_update(): bucket=:error-at-init-index[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19]): orig_sources= new_sources= 2024-09-12T17:17:15.781 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.781+0000 7fa06b4bf9c0 20 handle_bi_update(): bucket=:error-at-init-index[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19]): potential sources added=[] removed=[] 2024-09-12T17:17:15.781 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.781+0000 7fa06b4bf9c0 20 handle_bi_update(): bucket=:error-at-init-index[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19]): orig_dests= new_dests= 2024-09-12T17:17:15.782 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.781+0000 7fa06b4bf9c0 20 handle_bi_update(): bucket=:error-at-init-index[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19]): potential dests added=[] removed=[] 2024-09-12T17:17:15.784 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.785+0000 7fa06b4bf9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19.0 2024-09-12T17:17:15.786 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.785+0000 7fa06b4bf9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19 : hit (requested=0x17, cached=0x17) 2024-09-12T17:17:15.786 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.785+0000 7fa06b4bf9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19 2024-09-12T17:17:15.788 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.785+0000 7fa06b4bf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19 info.flags=0x17 2024-09-12T17:17:15.788 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.785+0000 7fa06b4bf9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19 to cache LRU end 2024-09-12T17:17:15.788 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.785+0000 7fa06b4bf9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:17:15.788 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.785+0000 7fa06b4bf9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19, ofs0, ns] 2024-09-12T17:17:15.789 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.789+0000 7f9f3f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431596 cookie 94777437915504 notifier 6207 bl.length()=879 2024-09-12T17:17:15.789 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.789+0000 7f9f3f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19 info.flags=0x17 2024-09-12T17:17:15.789 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.789+0000 7f9f3f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19 to cache LRU end 2024-09-12T17:17:15.789 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.789+0000 7f9f3f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:17:15.790 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.789+0000 7fa06b4bf9c0 20 handle_bi_update(): bucket=:error-at-init-index[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19]): orig_sources= new_sources= 2024-09-12T17:17:15.790 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.789+0000 7fa06b4bf9c0 20 handle_bi_update(): bucket=:error-at-init-index[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19]): potential sources added=[] removed=[] 2024-09-12T17:17:15.790 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.789+0000 7fa06b4bf9c0 20 handle_bi_update(): bucket=:error-at-init-index[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19]): orig_dests= new_dests= 2024-09-12T17:17:15.790 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.789+0000 7fa06b4bf9c0 20 handle_bi_update(): bucket=:error-at-init-index[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19]): potential dests added=[] removed=[] 2024-09-12T17:17:15.792 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.793+0000 7fa06b4bf9c0 1 execute INFO: reshard of bucket "error-at-init-index" from 1 shards to 2 shards completed successfully 2024-09-12T17:17:15.797 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.797+0000 7f9f1efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:15.802 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.801+0000 7fa06b4bf9c0 20 remove_watcher() i=0 2024-09-12T17:17:15.802 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.801+0000 7fa06b4bf9c0 2 removed watcher, disabling cache 2024-09-12T17:17:15.804 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.805+0000 7fa06b4bf9c0 20 remove_watcher() i=1 2024-09-12T17:17:15.807 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.805+0000 7fa06b4bf9c0 20 remove_watcher() i=2 2024-09-12T17:17:15.809 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.809+0000 7fa06b4bf9c0 20 remove_watcher() i=3 2024-09-12T17:17:15.812 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.813+0000 7fa06b4bf9c0 20 remove_watcher() i=4 2024-09-12T17:17:15.814 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.813+0000 7fa06b4bf9c0 20 remove_watcher() i=5 2024-09-12T17:17:15.816 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.817+0000 7fa06b4bf9c0 20 remove_watcher() i=6 2024-09-12T17:17:15.818 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.817+0000 7fa06b4bf9c0 20 remove_watcher() i=7 2024-09-12T17:17:15.836 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T17:17:15.869 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:17:15.869 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:17:15.915 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.913+0000 7f31670649c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:15.917 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.917+0000 7f31670649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:15.917 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.917+0000 7f31670649c0 20 realm 2024-09-12T17:17:15.917 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.917+0000 7f31670649c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:15.917 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.917+0000 7f31670649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:15.917 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.917+0000 7f31670649c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:17:15.917 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.917+0000 7f31670649c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:15.917 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.917+0000 7f31670649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:15.917 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.917+0000 7f31670649c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:15.919 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.917+0000 7f31670649c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:15.919 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.917+0000 7f31670649c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:15.921 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.921+0000 7f31670649c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:17:15.921 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.921+0000 7f31670649c0 20 searching for the correct realm 2024-09-12T17:17:15.924 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:15.925+0000 7f316536b640 0 -- 172.21.15.16:0/2888230330 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f315804f060 msgr2=0x7f315804fb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:16.145 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.141+0000 7f3164369640 0 -- 172.21.15.16:0/2888230330 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f315c02c970 msgr2=0x7f315c02a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:17:16.358 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.357+0000 7f31670649c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:17:16.359 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.357+0000 7f31670649c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:17:16.359 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.357+0000 7f31670649c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:17:16.359 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.357+0000 7f31670649c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:17:16.359 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.357+0000 7f31670649c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:17:16.359 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.357+0000 7f31670649c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:17:16.359 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.357+0000 7f31670649c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:16.359 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.357+0000 7f31670649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:16.359 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.357+0000 7f31670649c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:16.360 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.361+0000 7f31670649c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:16.360 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.361+0000 7f31670649c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:16.360 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.361+0000 7f31670649c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:17:16.360 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.361+0000 7f31670649c0 20 zone default found 2024-09-12T17:17:16.361 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.361+0000 7f31670649c0 4 Realm: () 2024-09-12T17:17:16.361 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.361+0000 7f31670649c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:17:16.361 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.361+0000 7f31670649c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:17:16.361 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.361+0000 7f31670649c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:17:16.361 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.361+0000 7f31670649c0 20 zonegroup default 2024-09-12T17:17:16.361 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.361+0000 7f31670649c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:16.361 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.361+0000 7f31670649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:16.361 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.361+0000 7f31670649c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:16.362 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.361+0000 7f31670649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:16.362 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.361+0000 7f31670649c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:16.363 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.361+0000 7f31670649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:16.363 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.361+0000 7f31670649c0 20 started sync module instance, tier type = 2024-09-12T17:17:16.363 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.361+0000 7f31670649c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:17:16.387 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.385+0000 7f31670649c0 20 add_watcher() i=0 2024-09-12T17:17:16.387 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.385+0000 7f31670649c0 20 add_watcher() i=1 2024-09-12T17:17:16.387 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.385+0000 7f31670649c0 20 add_watcher() i=2 2024-09-12T17:17:16.387 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.385+0000 7f31670649c0 20 add_watcher() i=3 2024-09-12T17:17:16.387 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.385+0000 7f31670649c0 20 add_watcher() i=4 2024-09-12T17:17:16.387 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.385+0000 7f31670649c0 20 add_watcher() i=5 2024-09-12T17:17:16.387 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.385+0000 7f31670649c0 20 add_watcher() i=6 2024-09-12T17:17:16.390 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.389+0000 7f31670649c0 20 add_watcher() i=7 2024-09-12T17:17:16.390 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.389+0000 7f31670649c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:17:16.394 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.393+0000 7f301b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:16.395 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.393+0000 7f31670649c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:17:16.395 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.393+0000 7f31670649c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:17:16.395 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.393+0000 7f31670649c0 5 note: GC not initialized 2024-09-12T17:17:16.395 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.393+0000 7f301a7e4640 20 reqs_thread_entry: start 2024-09-12T17:17:16.396 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.393+0000 7f31670649c0 20 init_complete bucket index max shards: 1 2024-09-12T17:17:16.396 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.393+0000 7f31670649c0 20 Filter name: none 2024-09-12T17:17:16.396 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.397+0000 7f30137fe640 20 reqs_thread_entry: start 2024-09-12T17:17:16.396 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.397+0000 7f31670649c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:16.397 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.397+0000 7f31670649c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:17:16.397 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.397+0000 7f31670649c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:16.398 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.397+0000 7f31670649c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:17:16.398 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.397+0000 7f31670649c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:17:16.398 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.397+0000 7f31670649c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:16.398 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.397+0000 7f31670649c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:17:16.399 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.397+0000 7f31670649c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:16.399 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.397+0000 7f31670649c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:17:16.399 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.397+0000 7f31670649c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:17:16.402 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.401+0000 7f301b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:16.407 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.405+0000 7f31670649c0 20 remove_watcher() i=0 2024-09-12T17:17:16.408 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.405+0000 7f31670649c0 2 removed watcher, disabling cache 2024-09-12T17:17:16.410 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.409+0000 7f31670649c0 20 remove_watcher() i=1 2024-09-12T17:17:16.413 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.413+0000 7f31670649c0 20 remove_watcher() i=2 2024-09-12T17:17:16.415 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.413+0000 7f31670649c0 20 remove_watcher() i=3 2024-09-12T17:17:16.418 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.417+0000 7f31670649c0 20 remove_watcher() i=4 2024-09-12T17:17:16.420 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.421+0000 7f31670649c0 20 remove_watcher() i=5 2024-09-12T17:17:16.422 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.421+0000 7f31670649c0 20 remove_watcher() i=6 2024-09-12T17:17:16.424 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:16.425+0000 7f31670649c0 20 remove_watcher() i=7 2024-09-12T17:17:16.442 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:16.442 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:17:16.442 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: error-at-init-index id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:17:16.442 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:16.527 INFO:tasks.workunit.client.0.smithi016.stderr:TEST: reshard bucket with EOPNOTSUPP injected at init_index 2024-09-12T17:17:16.527 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:16.955 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T17:17:16.990 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:17:16.990 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:17:17.038 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.037+0000 7f2c6ce599c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:17.040 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.041+0000 7f2c6ce599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:17.040 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.041+0000 7f2c6ce599c0 20 realm 2024-09-12T17:17:17.041 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.041+0000 7f2c6ce599c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:17.041 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.041+0000 7f2c6ce599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:17.041 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.041+0000 7f2c6ce599c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:17:17.041 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.041+0000 7f2c6ce599c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:17.041 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.041+0000 7f2c6ce599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:17.041 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.041+0000 7f2c6ce599c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:17.042 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.041+0000 7f2c6ce599c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:17.042 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.041+0000 7f2c6ce599c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:17.044 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.045+0000 7f2c6ce599c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:17:17.044 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.045+0000 7f2c6ce599c0 20 searching for the correct realm 2024-09-12T17:17:17.047 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.045+0000 7f2c6b160640 0 -- 172.21.15.16:0/525219198 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f2c60032060 msgr2=0x7f2c60062570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:17.260 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.261+0000 7f2c6a15e640 0 -- 172.21.15.16:0/525219198 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f2c640eff60 msgr2=0x7f2c6411d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:17.479 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.477+0000 7f2c6ce599c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:17:17.479 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.477+0000 7f2c6ce599c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:17:17.479 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.477+0000 7f2c6ce599c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:17:17.480 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.477+0000 7f2c6ce599c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:17:17.480 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.477+0000 7f2c6ce599c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:17:17.480 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.477+0000 7f2c6ce599c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:17:17.480 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.477+0000 7f2c6ce599c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:17.481 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.477+0000 7f2c6ce599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:17.481 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.477+0000 7f2c6ce599c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:17.481 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.481+0000 7f2c6ce599c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:17.481 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.481+0000 7f2c6ce599c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:17.482 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.481+0000 7f2c6ce599c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:17:17.482 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.481+0000 7f2c6ce599c0 20 zone default found 2024-09-12T17:17:17.482 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.481+0000 7f2c6ce599c0 4 Realm: () 2024-09-12T17:17:17.482 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.481+0000 7f2c6ce599c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:17:17.482 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.481+0000 7f2c6ce599c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:17:17.482 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.481+0000 7f2c6ce599c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:17:17.483 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.481+0000 7f2c6ce599c0 20 zonegroup default 2024-09-12T17:17:17.483 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.481+0000 7f2c6ce599c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:17.483 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.481+0000 7f2c6ce599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:17.483 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.481+0000 7f2c6ce599c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:17.484 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.481+0000 7f2c6ce599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:17.484 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.481+0000 7f2c6ce599c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:17.484 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.485+0000 7f2c6ce599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:17.484 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.485+0000 7f2c6ce599c0 20 started sync module instance, tier type = 2024-09-12T17:17:17.484 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.485+0000 7f2c6ce599c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:17:17.512 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.513+0000 7f2c6ce599c0 20 add_watcher() i=0 2024-09-12T17:17:17.512 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.513+0000 7f2c6ce599c0 20 add_watcher() i=1 2024-09-12T17:17:17.512 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.513+0000 7f2c6ce599c0 20 add_watcher() i=2 2024-09-12T17:17:17.512 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.513+0000 7f2c6ce599c0 20 add_watcher() i=3 2024-09-12T17:17:17.513 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.513+0000 7f2c6ce599c0 20 add_watcher() i=4 2024-09-12T17:17:17.513 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.513+0000 7f2c6ce599c0 20 add_watcher() i=5 2024-09-12T17:17:17.513 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.513+0000 7f2c6ce599c0 20 add_watcher() i=6 2024-09-12T17:17:17.514 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.513+0000 7f2c6ce599c0 20 add_watcher() i=7 2024-09-12T17:17:17.514 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.513+0000 7f2c6ce599c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:17:17.519 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.517+0000 7f2b217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:17.519 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.517+0000 7f2c6ce599c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:17:17.519 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.517+0000 7f2c6ce599c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:17:17.519 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.517+0000 7f2c6ce599c0 5 note: GC not initialized 2024-09-12T17:17:17.520 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.521+0000 7f2a9bfff640 20 reqs_thread_entry: start 2024-09-12T17:17:17.520 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.521+0000 7f2c6ce599c0 20 init_complete bucket index max shards: 1 2024-09-12T17:17:17.521 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.521+0000 7f2c6ce599c0 20 Filter name: none 2024-09-12T17:17:17.521 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.521+0000 7f2a99ffb640 20 reqs_thread_entry: start 2024-09-12T17:17:17.521 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.521+0000 7f2c6ce599c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:17.522 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.521+0000 7f2c6ce599c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:17:17.522 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.521+0000 7f2c6ce599c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:17.523 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.521+0000 7f2c6ce599c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:17:17.523 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.521+0000 7f2c6ce599c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:17:17.523 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.521+0000 7f2c6ce599c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:17.524 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.525+0000 7f2c6ce599c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:17:17.524 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.525+0000 7f2c6ce599c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:17.525 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.525+0000 7f2c6ce599c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:17:17.525 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.525+0000 7f2c6ce599c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:17:17.528 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.529+0000 7f2b217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:17.534 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.533+0000 7f2c6ce599c0 20 remove_watcher() i=0 2024-09-12T17:17:17.534 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.533+0000 7f2c6ce599c0 2 removed watcher, disabling cache 2024-09-12T17:17:17.536 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.537+0000 7f2c6ce599c0 20 remove_watcher() i=1 2024-09-12T17:17:17.539 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.537+0000 7f2c6ce599c0 20 remove_watcher() i=2 2024-09-12T17:17:17.541 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.541+0000 7f2c6ce599c0 20 remove_watcher() i=3 2024-09-12T17:17:17.543 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.541+0000 7f2c6ce599c0 20 remove_watcher() i=4 2024-09-12T17:17:17.545 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.545+0000 7f2c6ce599c0 20 remove_watcher() i=5 2024-09-12T17:17:17.546 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.545+0000 7f2c6ce599c0 20 remove_watcher() i=6 2024-09-12T17:17:17.548 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.549+0000 7f2c6ce599c0 20 remove_watcher() i=7 2024-09-12T17:17:17.566 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:17.566 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:17:17.566 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: error-at-init-index id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:17:17.566 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:17.567 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index --inject-error-code 95 2024-09-12T17:17:17.607 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:17:17.607 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:17:17.653 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.653+0000 7fe67a97e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:17.655 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.653+0000 7fe67a97e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:17.655 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.653+0000 7fe67a97e9c0 20 realm 2024-09-12T17:17:17.655 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.653+0000 7fe67a97e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:17.655 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.653+0000 7fe67a97e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:17.655 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.653+0000 7fe67a97e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:17:17.656 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.653+0000 7fe67a97e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:17.656 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.653+0000 7fe67a97e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:17.656 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.653+0000 7fe67a97e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:17.657 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.657+0000 7fe67a97e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:17.657 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.657+0000 7fe67a97e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:17.658 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.657+0000 7fe67a97e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:17:17.659 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.657+0000 7fe67a97e9c0 20 searching for the correct realm 2024-09-12T17:17:17.661 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.661+0000 7fe678c85640 0 -- 172.21.15.16:0/1845741884 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fe660008070 msgr2=0x7fe660008450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:17.669 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.669+0000 7fe677c83640 0 -- 172.21.15.16:0/1845741884 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fe670017030 msgr2=0x7fe6700199d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:17:17.888 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.885+0000 7fe67a97e9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:17:17.888 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.885+0000 7fe67a97e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:17:17.888 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.885+0000 7fe67a97e9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:17:17.888 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.885+0000 7fe67a97e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:17:17.888 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.885+0000 7fe67a97e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:17:17.888 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.885+0000 7fe67a97e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:17:17.888 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.885+0000 7fe67a97e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:17.889 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.889+0000 7fe67a97e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:17.889 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.889+0000 7fe67a97e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:17.889 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.889+0000 7fe67a97e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:17.889 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.889+0000 7fe67a97e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:17.890 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.889+0000 7fe67a97e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:17:17.890 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.889+0000 7fe67a97e9c0 20 zone default found 2024-09-12T17:17:17.890 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.889+0000 7fe67a97e9c0 4 Realm: () 2024-09-12T17:17:17.890 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.889+0000 7fe67a97e9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:17:17.890 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.889+0000 7fe67a97e9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:17:17.890 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.889+0000 7fe67a97e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:17:17.890 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.889+0000 7fe67a97e9c0 20 zonegroup default 2024-09-12T17:17:17.891 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.889+0000 7fe67a97e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:17.891 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.889+0000 7fe67a97e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:17.891 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.889+0000 7fe67a97e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:17.892 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.893+0000 7fe67a97e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:17.892 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.893+0000 7fe67a97e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:17.892 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.893+0000 7fe67a97e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:17.892 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.893+0000 7fe67a97e9c0 20 started sync module instance, tier type = 2024-09-12T17:17:17.892 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.893+0000 7fe67a97e9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:17:17.920 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.921+0000 7fe67a97e9c0 20 add_watcher() i=0 2024-09-12T17:17:17.920 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.921+0000 7fe67a97e9c0 20 add_watcher() i=1 2024-09-12T17:17:17.920 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.921+0000 7fe67a97e9c0 20 add_watcher() i=2 2024-09-12T17:17:17.920 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.921+0000 7fe67a97e9c0 20 add_watcher() i=3 2024-09-12T17:17:17.920 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.921+0000 7fe67a97e9c0 20 add_watcher() i=4 2024-09-12T17:17:17.920 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.921+0000 7fe67a97e9c0 20 add_watcher() i=5 2024-09-12T17:17:17.920 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.921+0000 7fe67a97e9c0 20 add_watcher() i=6 2024-09-12T17:17:17.922 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.921+0000 7fe67a97e9c0 20 add_watcher() i=7 2024-09-12T17:17:17.922 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.921+0000 7fe67a97e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:17:17.927 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.925+0000 7fe52f7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:17.928 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.925+0000 7fe67a97e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:17:17.928 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.925+0000 7fe67a97e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:17:17.928 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.929+0000 7fe67a97e9c0 5 note: GC not initialized 2024-09-12T17:17:17.928 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.929+0000 7fe52e7dc640 20 reqs_thread_entry: start 2024-09-12T17:17:17.929 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.929+0000 7fe67a97e9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:17:17.929 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.929+0000 7fe67a97e9c0 20 Filter name: none 2024-09-12T17:17:17.929 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.929+0000 7fe5277fe640 20 reqs_thread_entry: start 2024-09-12T17:17:17.929 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.929+0000 7fe67a97e9c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T17:17:17.929 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.929+0000 7fe67a97e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:17.930 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.929+0000 7fe67a97e9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:17:17.931 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.929+0000 7fe67a97e9c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T17:17:17.931 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.929+0000 7fe67a97e9c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T17:17:17.931 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.929+0000 7fe67a97e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20 : miss 2024-09-12T17:17:17.931 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.929+0000 7fe67a97e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:17.932 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.933+0000 7fe67a97e9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:17:17.932 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.933+0000 7fe67a97e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20 info.flags=0x17 2024-09-12T17:17:17.932 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.933+0000 7fe67a97e9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20 to cache LRU end 2024-09-12T17:17:17.932 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.933+0000 7fe67a97e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:17:17.932 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.933+0000 7fe67a97e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:17:17.932 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.933+0000 7fe67a97e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20 2024-09-12T17:17:17.935 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.933+0000 7fe67a97e9c0 -1 Injecting error=-95 at location=init_index 2024-09-12T17:17:17.935 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.933+0000 7fe67a97e9c0 0 WARNING: init_index() does not supported logrecord, falling back to block reshard mode. 2024-09-12T17:17:17.942 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.941+0000 7fe67a97e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20 info.flags=0x17 2024-09-12T17:17:17.942 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.941+0000 7fe67a97e9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20 to cache LRU end 2024-09-12T17:17:17.942 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.941+0000 7fe67a97e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:17:17.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.941+0000 7fe67a97e9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20, ofs0, ns] 2024-09-12T17:17:17.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.941+0000 7fe54f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431599 cookie 93862259355600 notifier 6011 bl.length()=911 2024-09-12T17:17:17.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.941+0000 7fe54f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20 info.flags=0x17 2024-09-12T17:17:17.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.941+0000 7fe54f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20 to cache LRU end 2024-09-12T17:17:17.944 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.941+0000 7fe54f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:17:17.944 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.945+0000 7fe67a97e9c0 20 handle_bi_update(): bucket=:error-at-init-index[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20]): orig_sources= new_sources= 2024-09-12T17:17:17.945 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.945+0000 7fe67a97e9c0 20 handle_bi_update(): bucket=:error-at-init-index[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20]): potential sources added=[] removed=[] 2024-09-12T17:17:17.945 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.945+0000 7fe67a97e9c0 20 handle_bi_update(): bucket=:error-at-init-index[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20]): orig_dests= new_dests= 2024-09-12T17:17:17.945 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.945+0000 7fe67a97e9c0 20 handle_bi_update(): bucket=:error-at-init-index[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20]): potential dests added=[] removed=[] 2024-09-12T17:17:17.947 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.945+0000 7fe67a97e9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20.1.0 2024-09-12T17:17:17.947 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.945+0000 7fe67a97e9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20.1.0 2024-09-12T17:17:17.947 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.945+0000 7fe67a97e9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20.1.1 2024-09-12T17:17:17.947 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.945+0000 7fe67a97e9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20.1.1 2024-09-12T17:17:17.947 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.945+0000 7fe67a97e9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20.0 2024-09-12T17:17:17.953 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.953+0000 7fe67a97e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20 : hit (requested=0x17, cached=0x17) 2024-09-12T17:17:17.954 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.953+0000 7fe67a97e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20 2024-09-12T17:17:17.957 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.957+0000 7fe67a97e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20 info.flags=0x17 2024-09-12T17:17:17.957 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.957+0000 7fe67a97e9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20 to cache LRU end 2024-09-12T17:17:17.957 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.957+0000 7fe67a97e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:17:17.957 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.957+0000 7fe67a97e9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20, ofs0, ns] 2024-09-12T17:17:17.957 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.957+0000 7fe54effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431600 cookie 93862259355600 notifier 6011 bl.length()=879 2024-09-12T17:17:17.958 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.957+0000 7fe54effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20 info.flags=0x17 2024-09-12T17:17:17.958 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.957+0000 7fe54effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20 to cache LRU end 2024-09-12T17:17:17.958 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.957+0000 7fe54effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:17:17.958 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.957+0000 7fe67a97e9c0 20 handle_bi_update(): bucket=:error-at-init-index[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20]): orig_sources= new_sources= 2024-09-12T17:17:17.959 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.957+0000 7fe67a97e9c0 20 handle_bi_update(): bucket=:error-at-init-index[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20]): potential sources added=[] removed=[] 2024-09-12T17:17:17.959 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.957+0000 7fe67a97e9c0 20 handle_bi_update(): bucket=:error-at-init-index[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20]): orig_dests= new_dests= 2024-09-12T17:17:17.959 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.957+0000 7fe67a97e9c0 20 handle_bi_update(): bucket=:error-at-init-index[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20]): potential dests added=[] removed=[] 2024-09-12T17:17:17.961 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.961+0000 7fe67a97e9c0 1 execute INFO: reshard of bucket "error-at-init-index" from 1 shards to 2 shards completed successfully 2024-09-12T17:17:17.965 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.965+0000 7fe52f7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:17.970 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.969+0000 7fe67a97e9c0 20 remove_watcher() i=0 2024-09-12T17:17:17.970 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.969+0000 7fe67a97e9c0 2 removed watcher, disabling cache 2024-09-12T17:17:17.973 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.973+0000 7fe67a97e9c0 20 remove_watcher() i=1 2024-09-12T17:17:17.977 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.977+0000 7fe67a97e9c0 20 remove_watcher() i=2 2024-09-12T17:17:17.979 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.977+0000 7fe67a97e9c0 20 remove_watcher() i=3 2024-09-12T17:17:17.982 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.981+0000 7fe67a97e9c0 20 remove_watcher() i=4 2024-09-12T17:17:17.984 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.985+0000 7fe67a97e9c0 20 remove_watcher() i=5 2024-09-12T17:17:17.989 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.985+0000 7fe67a97e9c0 20 remove_watcher() i=6 2024-09-12T17:17:17.989 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:17.985+0000 7fe67a97e9c0 20 remove_watcher() i=7 2024-09-12T17:17:18.003 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T17:17:18.036 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:17:18.036 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:17:18.081 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.081+0000 7f00e797a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:18.083 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.081+0000 7f00e797a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:18.083 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.081+0000 7f00e797a9c0 20 realm 2024-09-12T17:17:18.083 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.081+0000 7f00e797a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:18.084 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.081+0000 7f00e797a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:18.084 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.081+0000 7f00e797a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:17:18.084 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.081+0000 7f00e797a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:18.084 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.085+0000 7f00e797a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:18.084 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.085+0000 7f00e797a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:18.087 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.085+0000 7f00e797a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:18.087 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.085+0000 7f00e797a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:18.087 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.085+0000 7f00e797a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:17:18.088 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.085+0000 7f00e797a9c0 20 searching for the correct realm 2024-09-12T17:17:18.090 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.089+0000 7f00e5c81640 0 -- 172.21.15.16:0/206359849 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f00dc027020 msgr2=0x7f00dc061a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:18.099 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.097+0000 7f00e4c7f640 0 -- 172.21.15.16:0/206359849 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f00e00838e0 msgr2=0x7f00e00939c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:18.317 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.317+0000 7f00e797a9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:17:18.317 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.317+0000 7f00e797a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:17:18.317 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.317+0000 7f00e797a9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:17:18.317 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.317+0000 7f00e797a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:17:18.317 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.317+0000 7f00e797a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:17:18.317 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.317+0000 7f00e797a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:17:18.317 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.317+0000 7f00e797a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:18.318 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.317+0000 7f00e797a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:18.318 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.317+0000 7f00e797a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:18.318 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.317+0000 7f00e797a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:18.318 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.317+0000 7f00e797a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:18.319 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.317+0000 7f00e797a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:17:18.319 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.317+0000 7f00e797a9c0 20 zone default found 2024-09-12T17:17:18.319 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.317+0000 7f00e797a9c0 4 Realm: () 2024-09-12T17:17:18.319 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.317+0000 7f00e797a9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:17:18.319 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.317+0000 7f00e797a9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:17:18.320 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.317+0000 7f00e797a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:17:18.320 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.317+0000 7f00e797a9c0 20 zonegroup default 2024-09-12T17:17:18.320 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.317+0000 7f00e797a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:18.320 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.321+0000 7f00e797a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:18.320 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.321+0000 7f00e797a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:18.321 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.321+0000 7f00e797a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:18.321 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.321+0000 7f00e797a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:18.321 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.321+0000 7f00e797a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:18.322 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.321+0000 7f00e797a9c0 20 started sync module instance, tier type = 2024-09-12T17:17:18.322 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.321+0000 7f00e797a9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:17:18.349 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.349+0000 7f00e797a9c0 20 add_watcher() i=0 2024-09-12T17:17:18.349 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.349+0000 7f00e797a9c0 20 add_watcher() i=1 2024-09-12T17:17:18.349 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.349+0000 7f00e797a9c0 20 add_watcher() i=2 2024-09-12T17:17:18.349 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.349+0000 7f00e797a9c0 20 add_watcher() i=3 2024-09-12T17:17:18.349 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.349+0000 7f00e797a9c0 20 add_watcher() i=4 2024-09-12T17:17:18.349 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.349+0000 7f00e797a9c0 20 add_watcher() i=5 2024-09-12T17:17:18.349 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.349+0000 7f00e797a9c0 20 add_watcher() i=6 2024-09-12T17:17:18.351 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.349+0000 7f00e797a9c0 20 add_watcher() i=7 2024-09-12T17:17:18.351 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.349+0000 7f00e797a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:17:18.355 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.353+0000 7eff9bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:18.356 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.357+0000 7f00e797a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:17:18.357 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.357+0000 7f00e797a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:17:18.357 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.357+0000 7f00e797a9c0 5 note: GC not initialized 2024-09-12T17:17:18.357 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.357+0000 7eff9afe5640 20 reqs_thread_entry: start 2024-09-12T17:17:18.357 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.357+0000 7f00e797a9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:17:18.358 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.357+0000 7f00e797a9c0 20 Filter name: none 2024-09-12T17:17:18.358 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.357+0000 7eff98fe1640 20 reqs_thread_entry: start 2024-09-12T17:17:18.358 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.357+0000 7f00e797a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:18.360 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.357+0000 7f00e797a9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:17:18.360 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.357+0000 7f00e797a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:18.361 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.361+0000 7f00e797a9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:17:18.361 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.361+0000 7f00e797a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:17:18.361 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.361+0000 7f00e797a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:18.362 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.361+0000 7f00e797a9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:17:18.363 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.361+0000 7f00e797a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:18.364 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.365+0000 7f00e797a9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:17:18.364 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.365+0000 7f00e797a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:17:18.367 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.365+0000 7eff9bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:18.372 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.373+0000 7f00e797a9c0 20 remove_watcher() i=0 2024-09-12T17:17:18.372 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.373+0000 7f00e797a9c0 2 removed watcher, disabling cache 2024-09-12T17:17:18.374 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.373+0000 7f00e797a9c0 20 remove_watcher() i=1 2024-09-12T17:17:18.377 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.377+0000 7f00e797a9c0 20 remove_watcher() i=2 2024-09-12T17:17:18.379 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.377+0000 7f00e797a9c0 20 remove_watcher() i=3 2024-09-12T17:17:18.381 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.381+0000 7f00e797a9c0 20 remove_watcher() i=4 2024-09-12T17:17:18.383 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.381+0000 7f00e797a9c0 20 remove_watcher() i=5 2024-09-12T17:17:18.385 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.385+0000 7f00e797a9c0 20 remove_watcher() i=6 2024-09-12T17:17:18.386 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:18.385+0000 7f00e797a9c0 20 remove_watcher() i=7 2024-09-12T17:17:18.403 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:18.403 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:17:18.403 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: error-at-init-index id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T17:17:18.403 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:18.500 INFO:tasks.workunit.client.0.smithi016.stderr:TEST: reshard bucket with abort at init_index 2024-09-12T17:17:18.500 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:18.965 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T17:17:19.000 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:17:19.000 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:17:19.049 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.049+0000 7fe1a8e989c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.051 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.049+0000 7fe1a8e989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:19.051 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.049+0000 7fe1a8e989c0 20 realm 2024-09-12T17:17:19.052 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.049+0000 7fe1a8e989c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.052 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.049+0000 7fe1a8e989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:19.052 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.049+0000 7fe1a8e989c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:17:19.052 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.049+0000 7fe1a8e989c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.052 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.049+0000 7fe1a8e989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:19.052 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.049+0000 7fe1a8e989c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.053 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.053+0000 7fe1a8e989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:19.053 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.053+0000 7fe1a8e989c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.054 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.053+0000 7fe1a8e989c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:17:19.055 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.053+0000 7fe1a8e989c0 20 searching for the correct realm 2024-09-12T17:17:19.056 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.057+0000 7fe1a619d640 0 -- 172.21.15.16:0/3698474097 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7fe1980de040 msgr2=0x7fe1980ba410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:19.272 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.273+0000 7fe1a719f640 0 -- 172.21.15.16:0/3698474097 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fe19c08f030 msgr2=0x7fe19c01a3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:19.291 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.289+0000 7fe1a8e989c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:17:19.291 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.289+0000 7fe1a8e989c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:17:19.291 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.289+0000 7fe1a8e989c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:17:19.291 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.289+0000 7fe1a8e989c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:17:19.291 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.289+0000 7fe1a8e989c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:17:19.291 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.289+0000 7fe1a8e989c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:17:19.291 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.289+0000 7fe1a8e989c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.292 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.289+0000 7fe1a8e989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:19.292 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.289+0000 7fe1a8e989c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.292 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.293+0000 7fe1a8e989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:19.292 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.293+0000 7fe1a8e989c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.293 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.293+0000 7fe1a8e989c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:17:19.293 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.293+0000 7fe1a8e989c0 20 zone default found 2024-09-12T17:17:19.293 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.293+0000 7fe1a8e989c0 4 Realm: () 2024-09-12T17:17:19.293 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.293+0000 7fe1a8e989c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:17:19.293 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.293+0000 7fe1a8e989c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:17:19.293 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.293+0000 7fe1a8e989c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:17:19.293 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.293+0000 7fe1a8e989c0 20 zonegroup default 2024-09-12T17:17:19.294 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.293+0000 7fe1a8e989c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.294 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.293+0000 7fe1a8e989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:19.294 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.293+0000 7fe1a8e989c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.294 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.293+0000 7fe1a8e989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:19.294 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.293+0000 7fe1a8e989c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.295 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.293+0000 7fe1a8e989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:19.295 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.293+0000 7fe1a8e989c0 20 started sync module instance, tier type = 2024-09-12T17:17:19.295 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.293+0000 7fe1a8e989c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:17:19.318 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.317+0000 7fe1a8e989c0 20 add_watcher() i=0 2024-09-12T17:17:19.318 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.317+0000 7fe1a8e989c0 20 add_watcher() i=1 2024-09-12T17:17:19.319 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.317+0000 7fe1a8e989c0 20 add_watcher() i=2 2024-09-12T17:17:19.319 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.317+0000 7fe1a8e989c0 20 add_watcher() i=3 2024-09-12T17:17:19.319 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.317+0000 7fe1a8e989c0 20 add_watcher() i=4 2024-09-12T17:17:19.319 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.317+0000 7fe1a8e989c0 20 add_watcher() i=5 2024-09-12T17:17:19.319 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.317+0000 7fe1a8e989c0 20 add_watcher() i=6 2024-09-12T17:17:19.320 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.321+0000 7fe1a8e989c0 20 add_watcher() i=7 2024-09-12T17:17:19.320 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.321+0000 7fe1a8e989c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:17:19.324 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.325+0000 7fe05d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:19.325 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.325+0000 7fe1a8e989c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:17:19.325 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.325+0000 7fe1a8e989c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:17:19.325 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.325+0000 7fe1a8e989c0 5 note: GC not initialized 2024-09-12T17:17:19.326 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.325+0000 7fdfd7fff640 20 reqs_thread_entry: start 2024-09-12T17:17:19.326 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.325+0000 7fe1a8e989c0 20 init_complete bucket index max shards: 1 2024-09-12T17:17:19.326 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.325+0000 7fe1a8e989c0 20 Filter name: none 2024-09-12T17:17:19.326 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.325+0000 7fdfd5ffb640 20 reqs_thread_entry: start 2024-09-12T17:17:19.326 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.325+0000 7fe1a8e989c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.327 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.325+0000 7fe1a8e989c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T17:17:19.327 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.325+0000 7fe1a8e989c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.328 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.329+0000 7fe1a8e989c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T17:17:19.328 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.329+0000 7fe1a8e989c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:17:19.329 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.329+0000 7fe1a8e989c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.329 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.329+0000 7fe1a8e989c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T17:17:19.329 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.329+0000 7fe1a8e989c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.331 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.329+0000 7fe1a8e989c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T17:17:19.331 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.329+0000 7fe1a8e989c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:17:19.333 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.333+0000 7fe05d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:19.338 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.337+0000 7fe1a8e989c0 20 remove_watcher() i=0 2024-09-12T17:17:19.338 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.337+0000 7fe1a8e989c0 2 removed watcher, disabling cache 2024-09-12T17:17:19.341 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.341+0000 7fe1a8e989c0 20 remove_watcher() i=1 2024-09-12T17:17:19.343 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.341+0000 7fe1a8e989c0 20 remove_watcher() i=2 2024-09-12T17:17:19.345 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.345+0000 7fe1a8e989c0 20 remove_watcher() i=3 2024-09-12T17:17:19.348 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.349+0000 7fe1a8e989c0 20 remove_watcher() i=4 2024-09-12T17:17:19.349 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.349+0000 7fe1a8e989c0 20 remove_watcher() i=5 2024-09-12T17:17:19.350 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.349+0000 7fe1a8e989c0 20 remove_watcher() i=6 2024-09-12T17:17:19.352 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.353+0000 7fe1a8e989c0 20 remove_watcher() i=7 2024-09-12T17:17:19.368 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:19.368 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:17:19.368 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: abort-at-init-indext id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:17:19.368 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:19.369 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at init_index 2024-09-12T17:17:19.401 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:17:19.401 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:17:19.447 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.445+0000 7f5d8568f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.449 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.449+0000 7f5d8568f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:19.449 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.449+0000 7f5d8568f9c0 20 realm 2024-09-12T17:17:19.449 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.449+0000 7f5d8568f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.449 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.449+0000 7f5d8568f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:19.449 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.449+0000 7f5d8568f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:17:19.449 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.449+0000 7f5d8568f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.449 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.449+0000 7f5d8568f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:19.450 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.449+0000 7f5d8568f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.450 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.449+0000 7f5d8568f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:19.451 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.449+0000 7f5d8568f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.452 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.453+0000 7f5d8568f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:17:19.452 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.453+0000 7f5d8568f9c0 20 searching for the correct realm 2024-09-12T17:17:19.457 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.457+0000 7f5d83996640 0 -- 172.21.15.16:0/2991639686 >> [v2:172.21.15.19:6800/1509147557,v1:172.21.15.19:6801/1509147557] conn(0x56453ca29790 msgr2=0x56453ca2bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:19.463 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.461+0000 7f5d82994640 0 -- 172.21.15.16:0/2991639686 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f5d7c00e040 msgr2=0x7f5d7c058900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:17:19.680 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:17:19.680 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:17:19.681 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:17:19.681 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:17:19.681 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:17:19.681 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:17:19.681 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.682 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:19.682 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.682 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:19.682 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.683 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:17:19.683 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 zone default found 2024-09-12T17:17:19.683 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.681+0000 7f5d8568f9c0 4 Realm: () 2024-09-12T17:17:19.684 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.681+0000 7f5d8568f9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:17:19.684 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.681+0000 7f5d8568f9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:17:19.684 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.681+0000 7f5d8568f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:17:19.684 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 zonegroup default 2024-09-12T17:17:19.684 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.685 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:19.685 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.685 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.685+0000 7f5d8568f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:19.686 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.685+0000 7f5d8568f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.686 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.685+0000 7f5d8568f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:19.686 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.685+0000 7f5d8568f9c0 20 started sync module instance, tier type = 2024-09-12T17:17:19.686 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.685+0000 7f5d8568f9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:17:19.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.709+0000 7f5d8568f9c0 20 add_watcher() i=0 2024-09-12T17:17:19.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.709+0000 7f5d8568f9c0 20 add_watcher() i=1 2024-09-12T17:17:19.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.709+0000 7f5d8568f9c0 20 add_watcher() i=2 2024-09-12T17:17:19.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.709+0000 7f5d8568f9c0 20 add_watcher() i=3 2024-09-12T17:17:19.710 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.709+0000 7f5d8568f9c0 20 add_watcher() i=4 2024-09-12T17:17:19.710 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.709+0000 7f5d8568f9c0 20 add_watcher() i=5 2024-09-12T17:17:19.710 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.709+0000 7f5d8568f9c0 20 add_watcher() i=6 2024-09-12T17:17:19.711 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.709+0000 7f5d8568f9c0 20 add_watcher() i=7 2024-09-12T17:17:19.711 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.709+0000 7f5d8568f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:17:19.715 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.713+0000 7f5c3a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:19.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.713+0000 7f5d8568f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:17:19.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.713+0000 7f5d8568f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:17:19.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.713+0000 7f5d8568f9c0 5 note: GC not initialized 2024-09-12T17:17:19.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.717+0000 7f5c397e2640 20 reqs_thread_entry: start 2024-09-12T17:17:19.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.717+0000 7f5d8568f9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:17:19.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.717+0000 7f5d8568f9c0 20 Filter name: none 2024-09-12T17:17:19.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.717+0000 7f5c327fc640 20 reqs_thread_entry: start 2024-09-12T17:17:19.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.717+0000 7f5d8568f9c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T17:17:19.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.717+0000 7f5d8568f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.717+0000 7f5d8568f9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T17:17:19.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.717+0000 7f5d8568f9c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T17:17:19.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.717+0000 7f5d8568f9c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T17:17:19.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.717+0000 7f5d8568f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21 : miss 2024-09-12T17:17:19.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.717+0000 7f5d8568f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.720 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.717+0000 7f5d8568f9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T17:17:19.720 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.717+0000 7f5d8568f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21 info.flags=0x17 2024-09-12T17:17:19.720 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.717+0000 7f5d8568f9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21 to cache LRU end 2024-09-12T17:17:19.720 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.717+0000 7f5d8568f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:17:19.720 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.717+0000 7f5d8568f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:17:19.720 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.717+0000 7f5d8568f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21 2024-09-12T17:17:19.721 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5d8568f9c0 time 2024-09-12T17:17:19.724710+0000 2024-09-12T17:17:19.721 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:17:19.724 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:17:19.724 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f5d88f692eb] 2024-09-12T17:17:19.724 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5d88f6949f] 2024-09-12T17:17:19.724 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56453a06b0c1] 2024-09-12T17:17:19.724 INFO:tasks.workunit.client.0.smithi016.stderr: 4: radosgw-admin(+0x140f572) [0x56453aac0572] 2024-09-12T17:17:19.724 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56453a07d18d] 2024-09-12T17:17:19.724 INFO:tasks.workunit.client.0.smithi016.stderr: 6: main() 2024-09-12T17:17:19.724 INFO:tasks.workunit.client.0.smithi016.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5d87dcfd90] 2024-09-12T17:17:19.724 INFO:tasks.workunit.client.0.smithi016.stderr: 8: __libc_start_main() 2024-09-12T17:17:19.724 INFO:tasks.workunit.client.0.smithi016.stderr: 9: _start() 2024-09-12T17:17:19.724 INFO:tasks.workunit.client.0.smithi016.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:17:19.725 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7f5d8568f9c0 thread_name:radosgw-admin 2024-09-12T17:17:19.725 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.721+0000 7f5d8568f9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5d8568f9c0 time 2024-09-12T17:17:19.724710+0000 2024-09-12T17:17:19.725 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:17:19.725 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:19.725 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:17:19.725 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f5d88f692eb] 2024-09-12T17:17:19.725 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5d88f6949f] 2024-09-12T17:17:19.725 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56453a06b0c1] 2024-09-12T17:17:19.725 INFO:tasks.workunit.client.0.smithi016.stderr: 4: radosgw-admin(+0x140f572) [0x56453aac0572] 2024-09-12T17:17:19.725 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56453a07d18d] 2024-09-12T17:17:19.725 INFO:tasks.workunit.client.0.smithi016.stderr: 6: main() 2024-09-12T17:17:19.725 INFO:tasks.workunit.client.0.smithi016.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5d87dcfd90] 2024-09-12T17:17:19.725 INFO:tasks.workunit.client.0.smithi016.stderr: 8: __libc_start_main() 2024-09-12T17:17:19.726 INFO:tasks.workunit.client.0.smithi016.stderr: 9: _start() 2024-09-12T17:17:19.726 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:19.755 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:17:19.755 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f5d87de8520] 2024-09-12T17:17:19.755 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:17:19.755 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:17:19.755 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:17:19.755 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f5d88f69345] 2024-09-12T17:17:19.755 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5d88f6949f] 2024-09-12T17:17:19.755 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56453a06b0c1] 2024-09-12T17:17:19.755 INFO:tasks.workunit.client.0.smithi016.stderr: 8: radosgw-admin(+0x140f572) [0x56453aac0572] 2024-09-12T17:17:19.756 INFO:tasks.workunit.client.0.smithi016.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56453a07d18d] 2024-09-12T17:17:19.756 INFO:tasks.workunit.client.0.smithi016.stderr: 10: main() 2024-09-12T17:17:19.756 INFO:tasks.workunit.client.0.smithi016.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5d87dcfd90] 2024-09-12T17:17:19.756 INFO:tasks.workunit.client.0.smithi016.stderr: 12: __libc_start_main() 2024-09-12T17:17:19.756 INFO:tasks.workunit.client.0.smithi016.stderr: 13: _start() 2024-09-12T17:17:19.756 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.725+0000 7f5d8568f9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:17:19.757 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7f5d8568f9c0 thread_name:radosgw-admin 2024-09-12T17:17:19.757 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:19.757 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:17:19.757 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f5d87de8520] 2024-09-12T17:17:19.757 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:17:19.757 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:17:19.757 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:17:19.757 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f5d88f69345] 2024-09-12T17:17:19.757 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5d88f6949f] 2024-09-12T17:17:19.757 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56453a06b0c1] 2024-09-12T17:17:19.757 INFO:tasks.workunit.client.0.smithi016.stderr: 8: radosgw-admin(+0x140f572) [0x56453aac0572] 2024-09-12T17:17:19.758 INFO:tasks.workunit.client.0.smithi016.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56453a07d18d] 2024-09-12T17:17:19.758 INFO:tasks.workunit.client.0.smithi016.stderr: 10: main() 2024-09-12T17:17:19.758 INFO:tasks.workunit.client.0.smithi016.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5d87dcfd90] 2024-09-12T17:17:19.758 INFO:tasks.workunit.client.0.smithi016.stderr: 12: __libc_start_main() 2024-09-12T17:17:19.758 INFO:tasks.workunit.client.0.smithi016.stderr: 13: _start() 2024-09-12T17:17:19.758 INFO:tasks.workunit.client.0.smithi016.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:17:19.758 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:19.758 INFO:tasks.workunit.client.0.smithi016.stderr:--- begin dump of recent events --- 2024-09-12T17:17:19.758 INFO:tasks.workunit.client.0.smithi016.stderr: -499> 2024-09-12T17:17:19.421+0000 7f5d8568f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:19.758 INFO:tasks.workunit.client.0.smithi016.stderr: -498> 2024-09-12T17:17:19.421+0000 7f5d8568f9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:17:19.758 INFO:tasks.workunit.client.0.smithi016.stderr: -497> 2024-09-12T17:17:19.421+0000 7f5d8568f9c0 10 monclient(hunting): authenticate will time out at 2157.399086s 2024-09-12T17:17:19.759 INFO:tasks.workunit.client.0.smithi016.stderr: -496> 2024-09-12T17:17:19.421+0000 7f5d83996640 10 monclient(hunting): get_auth_request con 0x56453c87e720 auth_method 0 2024-09-12T17:17:19.759 INFO:tasks.workunit.client.0.smithi016.stderr: -495> 2024-09-12T17:17:19.421+0000 7f5d83996640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:17:19.759 INFO:tasks.workunit.client.0.smithi016.stderr: -494> 2024-09-12T17:17:19.421+0000 7f5d83996640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:17:19.759 INFO:tasks.workunit.client.0.smithi016.stderr: -493> 2024-09-12T17:17:19.421+0000 7f5d83996640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:17:19.759 INFO:tasks.workunit.client.0.smithi016.stderr: -492> 2024-09-12T17:17:19.421+0000 7f5d82994640 10 monclient(hunting): get_auth_request con 0x56453c87b660 auth_method 0 2024-09-12T17:17:19.759 INFO:tasks.workunit.client.0.smithi016.stderr: -491> 2024-09-12T17:17:19.421+0000 7f5d82994640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:17:19.759 INFO:tasks.workunit.client.0.smithi016.stderr: -490> 2024-09-12T17:17:19.421+0000 7f5d82994640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:17:19.759 INFO:tasks.workunit.client.0.smithi016.stderr: -489> 2024-09-12T17:17:19.421+0000 7f5d82994640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:17:19.759 INFO:tasks.workunit.client.0.smithi016.stderr: -488> 2024-09-12T17:17:19.421+0000 7f5d83996640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:17:19.759 INFO:tasks.workunit.client.0.smithi016.stderr: -487> 2024-09-12T17:17:19.421+0000 7f5d83996640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:17:19.759 INFO:tasks.workunit.client.0.smithi016.stderr: -486> 2024-09-12T17:17:19.421+0000 7f5d83996640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:17:19.760 INFO:tasks.workunit.client.0.smithi016.stderr: -485> 2024-09-12T17:17:19.421+0000 7f5d82994640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:17:19.760 INFO:tasks.workunit.client.0.smithi016.stderr: -484> 2024-09-12T17:17:19.421+0000 7f5d82994640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:17:19.760 INFO:tasks.workunit.client.0.smithi016.stderr: -483> 2024-09-12T17:17:19.421+0000 7f5d82994640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:17:19.760 INFO:tasks.workunit.client.0.smithi016.stderr: -482> 2024-09-12T17:17:19.421+0000 7f5d82994640 10 monclient(hunting): handle_auth_done global_id 6306 payload 274 2024-09-12T17:17:19.760 INFO:tasks.workunit.client.0.smithi016.stderr: -481> 2024-09-12T17:17:19.421+0000 7f5d82994640 10 monclient: _finish_hunting 0 2024-09-12T17:17:19.760 INFO:tasks.workunit.client.0.smithi016.stderr: -480> 2024-09-12T17:17:19.421+0000 7f5d82994640 1 monclient: found mon.noname-a 2024-09-12T17:17:19.760 INFO:tasks.workunit.client.0.smithi016.stderr: -479> 2024-09-12T17:17:19.421+0000 7f5d82994640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:17:19.760 INFO:tasks.workunit.client.0.smithi016.stderr: -478> 2024-09-12T17:17:19.421+0000 7f5d83195640 10 monclient: get_auth_request con 0x56453c7f15b0 auth_method 0 2024-09-12T17:17:19.760 INFO:tasks.workunit.client.0.smithi016.stderr: -477> 2024-09-12T17:17:19.425+0000 7f5c7160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:17:19.760 INFO:tasks.workunit.client.0.smithi016.stderr: -476> 2024-09-12T17:17:19.425+0000 7f5c7160a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:17:19.760 INFO:tasks.workunit.client.0.smithi016.stderr: -475> 2024-09-12T17:17:19.425+0000 7f5c7160a640 10 monclient: dump: 2024-09-12T17:17:19.760 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:17:19.761 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:17:19.761 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:19.761 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:19.761 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:17:19.761 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:19.761 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:17:19.761 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:17:19.761 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:17:19.761 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:19.761 INFO:tasks.workunit.client.0.smithi016.stderr: -474> 2024-09-12T17:17:19.425+0000 7f5c7160a640 10 monclient: _finish_auth 0 2024-09-12T17:17:19.761 INFO:tasks.workunit.client.0.smithi016.stderr: -473> 2024-09-12T17:17:19.425+0000 7f5c7160a640 10 monclient: _check_auth_tickets 2024-09-12T17:17:19.761 INFO:tasks.workunit.client.0.smithi016.stderr: -472> 2024-09-12T17:17:19.425+0000 7f5c7160a640 10 monclient: handle_config config(0 keys) 2024-09-12T17:17:19.762 INFO:tasks.workunit.client.0.smithi016.stderr: -471> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 monclient: authenticate success, global_id 6306 2024-09-12T17:17:19.762 INFO:tasks.workunit.client.0.smithi016.stderr: -470> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 10 monclient: get_monmap_and_config success 2024-09-12T17:17:19.762 INFO:tasks.workunit.client.0.smithi016.stderr: -469> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 4 set_mon_vals no callback set 2024-09-12T17:17:19.762 INFO:tasks.workunit.client.0.smithi016.stderr: -468> 2024-09-12T17:17:19.425+0000 7f5c7160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:17:19.762 INFO:tasks.workunit.client.0.smithi016.stderr: -467> 2024-09-12T17:17:19.425+0000 7f5c7160a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:17:19.762 INFO:tasks.workunit.client.0.smithi016.stderr: -466> 2024-09-12T17:17:19.425+0000 7f5c7160a640 10 monclient: dump: 2024-09-12T17:17:19.762 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:17:19.762 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:17:19.762 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:19.762 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:19.762 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:17:19.762 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:19.762 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:17:19.763 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:17:19.763 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:17:19.763 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:19.763 INFO:tasks.workunit.client.0.smithi016.stderr: -465> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 10 monclient: shutdown 2024-09-12T17:17:19.763 INFO:tasks.workunit.client.0.smithi016.stderr: -464> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 asok(0x56453c7292b0) unregister_commands rotate-key 2024-09-12T17:17:19.763 INFO:tasks.workunit.client.0.smithi016.stderr: -463> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 10 monclient: build_initial_monmap 2024-09-12T17:17:19.763 INFO:tasks.workunit.client.0.smithi016.stderr: -462> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 1 build_initial for_mkfs: 0 2024-09-12T17:17:19.763 INFO:tasks.workunit.client.0.smithi016.stderr: -461> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 10 monclient: monmap: 2024-09-12T17:17:19.763 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:17:19.763 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:17:19.763 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:17:19.764 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:17:19.764 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:17:19.764 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:19.764 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:17:19.764 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:17:19.764 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:17:19.764 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:19.764 INFO:tasks.workunit.client.0.smithi016.stderr: -460> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c93b4f0) adding auth protocol: cephx 2024-09-12T17:17:19.764 INFO:tasks.workunit.client.0.smithi016.stderr: -459> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c93b4f0) adding auth protocol: cephx 2024-09-12T17:17:19.764 INFO:tasks.workunit.client.0.smithi016.stderr: -458> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c93b4f0) adding auth protocol: cephx 2024-09-12T17:17:19.764 INFO:tasks.workunit.client.0.smithi016.stderr: -457> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c93b4f0) adding con mode: secure 2024-09-12T17:17:19.764 INFO:tasks.workunit.client.0.smithi016.stderr: -456> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c93b4f0) adding con mode: crc 2024-09-12T17:17:19.764 INFO:tasks.workunit.client.0.smithi016.stderr: -455> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c93b4f0) adding con mode: secure 2024-09-12T17:17:19.765 INFO:tasks.workunit.client.0.smithi016.stderr: -454> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c93b4f0) adding con mode: crc 2024-09-12T17:17:19.765 INFO:tasks.workunit.client.0.smithi016.stderr: -453> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c93b4f0) adding con mode: secure 2024-09-12T17:17:19.765 INFO:tasks.workunit.client.0.smithi016.stderr: -452> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c93b4f0) adding con mode: crc 2024-09-12T17:17:19.765 INFO:tasks.workunit.client.0.smithi016.stderr: -451> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c93b4f0) adding con mode: crc 2024-09-12T17:17:19.765 INFO:tasks.workunit.client.0.smithi016.stderr: -450> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c93b4f0) adding con mode: secure 2024-09-12T17:17:19.765 INFO:tasks.workunit.client.0.smithi016.stderr: -449> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c93b4f0) adding con mode: crc 2024-09-12T17:17:19.765 INFO:tasks.workunit.client.0.smithi016.stderr: -448> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c93b4f0) adding con mode: secure 2024-09-12T17:17:19.765 INFO:tasks.workunit.client.0.smithi016.stderr: -447> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c93b4f0) adding con mode: crc 2024-09-12T17:17:19.765 INFO:tasks.workunit.client.0.smithi016.stderr: -446> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c93b4f0) adding con mode: secure 2024-09-12T17:17:19.765 INFO:tasks.workunit.client.0.smithi016.stderr: -445> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:19.765 INFO:tasks.workunit.client.0.smithi016.stderr: -444> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 1 librados: starting msgr at 2024-09-12T17:17:19.765 INFO:tasks.workunit.client.0.smithi016.stderr: -443> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 1 librados: starting objecter 2024-09-12T17:17:19.766 INFO:tasks.workunit.client.0.smithi016.stderr: -442> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 asok(0x56453c7292b0) register_command objecter_requests hook 0x56453c6a30e0 2024-09-12T17:17:19.766 INFO:tasks.workunit.client.0.smithi016.stderr: -441> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 1 librados: setting wanted keys 2024-09-12T17:17:19.766 INFO:tasks.workunit.client.0.smithi016.stderr: -440> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 1 librados: calling monclient init 2024-09-12T17:17:19.766 INFO:tasks.workunit.client.0.smithi016.stderr: -439> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 10 monclient: init 2024-09-12T17:17:19.766 INFO:tasks.workunit.client.0.smithi016.stderr: -438> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c935eb0) adding auth protocol: cephx 2024-09-12T17:17:19.766 INFO:tasks.workunit.client.0.smithi016.stderr: -437> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c935eb0) adding auth protocol: cephx 2024-09-12T17:17:19.766 INFO:tasks.workunit.client.0.smithi016.stderr: -436> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c935eb0) adding auth protocol: cephx 2024-09-12T17:17:19.766 INFO:tasks.workunit.client.0.smithi016.stderr: -435> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c935eb0) adding con mode: secure 2024-09-12T17:17:19.766 INFO:tasks.workunit.client.0.smithi016.stderr: -434> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c935eb0) adding con mode: crc 2024-09-12T17:17:19.766 INFO:tasks.workunit.client.0.smithi016.stderr: -433> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c935eb0) adding con mode: secure 2024-09-12T17:17:19.766 INFO:tasks.workunit.client.0.smithi016.stderr: -432> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c935eb0) adding con mode: crc 2024-09-12T17:17:19.766 INFO:tasks.workunit.client.0.smithi016.stderr: -431> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c935eb0) adding con mode: secure 2024-09-12T17:17:19.766 INFO:tasks.workunit.client.0.smithi016.stderr: -430> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c935eb0) adding con mode: crc 2024-09-12T17:17:19.767 INFO:tasks.workunit.client.0.smithi016.stderr: -429> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c935eb0) adding con mode: crc 2024-09-12T17:17:19.767 INFO:tasks.workunit.client.0.smithi016.stderr: -428> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c935eb0) adding con mode: secure 2024-09-12T17:17:19.767 INFO:tasks.workunit.client.0.smithi016.stderr: -427> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c935eb0) adding con mode: crc 2024-09-12T17:17:19.767 INFO:tasks.workunit.client.0.smithi016.stderr: -426> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c935eb0) adding con mode: secure 2024-09-12T17:17:19.767 INFO:tasks.workunit.client.0.smithi016.stderr: -425> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c935eb0) adding con mode: crc 2024-09-12T17:17:19.767 INFO:tasks.workunit.client.0.smithi016.stderr: -424> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c935eb0) adding con mode: secure 2024-09-12T17:17:19.767 INFO:tasks.workunit.client.0.smithi016.stderr: -423> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:19.767 INFO:tasks.workunit.client.0.smithi016.stderr: -422> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:19.767 INFO:tasks.workunit.client.0.smithi016.stderr: -421> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 asok(0x56453c7292b0) register_command rotate-key hook 0x56453c935ff8 2024-09-12T17:17:19.767 INFO:tasks.workunit.client.0.smithi016.stderr: -420> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:17:19.767 INFO:tasks.workunit.client.0.smithi016.stderr: -419> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:17:19.767 INFO:tasks.workunit.client.0.smithi016.stderr: -418> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 10 monclient(hunting): picked mon.noname-a con 0x56453c7f15b0 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:17:19.767 INFO:tasks.workunit.client.0.smithi016.stderr: -417> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 10 monclient(hunting): picked mon.noname-b con 0x56453c87b660 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:17:19.768 INFO:tasks.workunit.client.0.smithi016.stderr: -416> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 10 monclient(hunting): picked mon.noname-c con 0x56453c87e720 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:17:19.768 INFO:tasks.workunit.client.0.smithi016.stderr: -415> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:19.768 INFO:tasks.workunit.client.0.smithi016.stderr: -414> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:19.768 INFO:tasks.workunit.client.0.smithi016.stderr: -413> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:19.768 INFO:tasks.workunit.client.0.smithi016.stderr: -412> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:17:19.768 INFO:tasks.workunit.client.0.smithi016.stderr: -411> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 10 monclient(hunting): authenticate will time out at 2157.402120s 2024-09-12T17:17:19.768 INFO:tasks.workunit.client.0.smithi016.stderr: -410> 2024-09-12T17:17:19.425+0000 7f5d83195640 10 monclient(hunting): get_auth_request con 0x56453c7f15b0 auth_method 0 2024-09-12T17:17:19.768 INFO:tasks.workunit.client.0.smithi016.stderr: -409> 2024-09-12T17:17:19.425+0000 7f5d83195640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:17:19.768 INFO:tasks.workunit.client.0.smithi016.stderr: -408> 2024-09-12T17:17:19.425+0000 7f5d83195640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:17:19.768 INFO:tasks.workunit.client.0.smithi016.stderr: -407> 2024-09-12T17:17:19.425+0000 7f5d83195640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:17:19.768 INFO:tasks.workunit.client.0.smithi016.stderr: -406> 2024-09-12T17:17:19.425+0000 7f5d83996640 10 monclient(hunting): get_auth_request con 0x56453c87e720 auth_method 0 2024-09-12T17:17:19.768 INFO:tasks.workunit.client.0.smithi016.stderr: -405> 2024-09-12T17:17:19.425+0000 7f5d83996640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:17:19.768 INFO:tasks.workunit.client.0.smithi016.stderr: -404> 2024-09-12T17:17:19.425+0000 7f5d83996640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:17:19.769 INFO:tasks.workunit.client.0.smithi016.stderr: -403> 2024-09-12T17:17:19.425+0000 7f5d83996640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:17:19.769 INFO:tasks.workunit.client.0.smithi016.stderr: -402> 2024-09-12T17:17:19.425+0000 7f5d83195640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:17:19.769 INFO:tasks.workunit.client.0.smithi016.stderr: -401> 2024-09-12T17:17:19.425+0000 7f5d83195640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:17:19.769 INFO:tasks.workunit.client.0.smithi016.stderr: -400> 2024-09-12T17:17:19.425+0000 7f5d83195640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:17:19.769 INFO:tasks.workunit.client.0.smithi016.stderr: -399> 2024-09-12T17:17:19.425+0000 7f5d83996640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:17:19.769 INFO:tasks.workunit.client.0.smithi016.stderr: -398> 2024-09-12T17:17:19.425+0000 7f5d83996640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:17:19.769 INFO:tasks.workunit.client.0.smithi016.stderr: -397> 2024-09-12T17:17:19.425+0000 7f5d83996640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:17:19.769 INFO:tasks.workunit.client.0.smithi016.stderr: -396> 2024-09-12T17:17:19.425+0000 7f5d83195640 10 monclient(hunting): handle_auth_done global_id 6309 payload 824 2024-09-12T17:17:19.769 INFO:tasks.workunit.client.0.smithi016.stderr: -395> 2024-09-12T17:17:19.425+0000 7f5d83195640 10 monclient: _finish_hunting 0 2024-09-12T17:17:19.769 INFO:tasks.workunit.client.0.smithi016.stderr: -394> 2024-09-12T17:17:19.425+0000 7f5d83195640 1 monclient: found mon.noname-a 2024-09-12T17:17:19.769 INFO:tasks.workunit.client.0.smithi016.stderr: -393> 2024-09-12T17:17:19.425+0000 7f5d83195640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:17:19.769 INFO:tasks.workunit.client.0.smithi016.stderr: -392> 2024-09-12T17:17:19.425+0000 7f5d82994640 10 monclient: get_auth_request con 0x56453c87b660 auth_method 0 2024-09-12T17:17:19.770 INFO:tasks.workunit.client.0.smithi016.stderr: -391> 2024-09-12T17:17:19.425+0000 7f5c6fe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:17:19.770 INFO:tasks.workunit.client.0.smithi016.stderr: -390> 2024-09-12T17:17:19.425+0000 7f5c6fe07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:17:19.770 INFO:tasks.workunit.client.0.smithi016.stderr: -389> 2024-09-12T17:17:19.425+0000 7f5c6fe07640 10 monclient: dump: 2024-09-12T17:17:19.770 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:17:19.770 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:17:19.770 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:19.770 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:19.770 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:17:19.770 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:19.770 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:17:19.770 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:17:19.771 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:17:19.771 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:19.771 INFO:tasks.workunit.client.0.smithi016.stderr: -388> 2024-09-12T17:17:19.425+0000 7f5c6fe07640 10 monclient: _finish_auth 0 2024-09-12T17:17:19.771 INFO:tasks.workunit.client.0.smithi016.stderr: -387> 2024-09-12T17:17:19.425+0000 7f5c6fe07640 10 monclient: _check_auth_tickets 2024-09-12T17:17:19.771 INFO:tasks.workunit.client.0.smithi016.stderr: -386> 2024-09-12T17:17:19.425+0000 7f5c6fe07640 10 monclient: handle_config config(0 keys) 2024-09-12T17:17:19.771 INFO:tasks.workunit.client.0.smithi016.stderr: -385> 2024-09-12T17:17:19.425+0000 7f5c6fe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:17:19.772 INFO:tasks.workunit.client.0.smithi016.stderr: -384> 2024-09-12T17:17:19.425+0000 7f5c6fe07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:17:19.772 INFO:tasks.workunit.client.0.smithi016.stderr: -383> 2024-09-12T17:17:19.425+0000 7f5c6fe07640 10 monclient: dump: 2024-09-12T17:17:19.772 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:17:19.772 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:17:19.772 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:19.773 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:19.773 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:17:19.773 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:19.773 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:17:19.773 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:17:19.773 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:17:19.774 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:19.774 INFO:tasks.workunit.client.0.smithi016.stderr: -382> 2024-09-12T17:17:19.425+0000 7f5c7160a640 4 set_mon_vals no callback set 2024-09-12T17:17:19.774 INFO:tasks.workunit.client.0.smithi016.stderr: -381> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 monclient: authenticate success, global_id 6309 2024-09-12T17:17:19.774 INFO:tasks.workunit.client.0.smithi016.stderr: -380> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 10 monclient: _renew_subs 2024-09-12T17:17:19.774 INFO:tasks.workunit.client.0.smithi016.stderr: -379> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:17:19.774 INFO:tasks.workunit.client.0.smithi016.stderr: -378> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 10 monclient: _renew_subs 2024-09-12T17:17:19.775 INFO:tasks.workunit.client.0.smithi016.stderr: -377> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:17:19.775 INFO:tasks.workunit.client.0.smithi016.stderr: -376> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 1 librados: init done 2024-09-12T17:17:19.775 INFO:tasks.workunit.client.0.smithi016.stderr: -375> 2024-09-12T17:17:19.429+0000 7f5c6fe07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:17:19.775 INFO:tasks.workunit.client.0.smithi016.stderr: -374> 2024-09-12T17:17:19.429+0000 7f5c6fe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:17:19.775 INFO:tasks.workunit.client.0.smithi016.stderr: -373> 2024-09-12T17:17:19.429+0000 7f5c6fe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:17:19.775 INFO:tasks.workunit.client.0.smithi016.stderr: -372> 2024-09-12T17:17:19.429+0000 7f5d82994640 10 monclient: get_auth_request con 0x7f5c68070ae0 auth_method 0 2024-09-12T17:17:19.775 INFO:tasks.workunit.client.0.smithi016.stderr: -371> 2024-09-12T17:17:19.429+0000 7f5d83996640 10 monclient: get_auth_request con 0x56453c960960 auth_method 0 2024-09-12T17:17:19.775 INFO:tasks.workunit.client.0.smithi016.stderr: -370> 2024-09-12T17:17:19.429+0000 7f5d83195640 10 monclient: get_auth_request con 0x56453c980880 auth_method 0 2024-09-12T17:17:19.775 INFO:tasks.workunit.client.0.smithi016.stderr: -369> 2024-09-12T17:17:19.433+0000 7f5d82994640 10 monclient: get_auth_request con 0x56453c984f20 auth_method 0 2024-09-12T17:17:19.775 INFO:tasks.workunit.client.0.smithi016.stderr: -368> 2024-09-12T17:17:19.433+0000 7f5d83996640 10 monclient: get_auth_request con 0x56453c9845b0 auth_method 0 2024-09-12T17:17:19.776 INFO:tasks.workunit.client.0.smithi016.stderr: -367> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 10 monclient: build_initial_monmap 2024-09-12T17:17:19.776 INFO:tasks.workunit.client.0.smithi016.stderr: -366> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 1 build_initial for_mkfs: 0 2024-09-12T17:17:19.776 INFO:tasks.workunit.client.0.smithi016.stderr: -365> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 10 monclient: monmap: 2024-09-12T17:17:19.776 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:17:19.776 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:17:19.777 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:17:19.777 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:17:19.777 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:17:19.777 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:19.777 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:17:19.777 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:17:19.777 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:17:19.777 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:19.777 INFO:tasks.workunit.client.0.smithi016.stderr: -364> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98cf10) adding auth protocol: cephx 2024-09-12T17:17:19.777 INFO:tasks.workunit.client.0.smithi016.stderr: -363> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98cf10) adding auth protocol: cephx 2024-09-12T17:17:19.777 INFO:tasks.workunit.client.0.smithi016.stderr: -362> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98cf10) adding auth protocol: cephx 2024-09-12T17:17:19.778 INFO:tasks.workunit.client.0.smithi016.stderr: -361> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98cf10) adding con mode: secure 2024-09-12T17:17:19.778 INFO:tasks.workunit.client.0.smithi016.stderr: -360> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98cf10) adding con mode: crc 2024-09-12T17:17:19.778 INFO:tasks.workunit.client.0.smithi016.stderr: -359> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98cf10) adding con mode: secure 2024-09-12T17:17:19.778 INFO:tasks.workunit.client.0.smithi016.stderr: -358> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98cf10) adding con mode: crc 2024-09-12T17:17:19.778 INFO:tasks.workunit.client.0.smithi016.stderr: -357> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98cf10) adding con mode: secure 2024-09-12T17:17:19.778 INFO:tasks.workunit.client.0.smithi016.stderr: -356> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98cf10) adding con mode: crc 2024-09-12T17:17:19.778 INFO:tasks.workunit.client.0.smithi016.stderr: -355> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98cf10) adding con mode: crc 2024-09-12T17:17:19.778 INFO:tasks.workunit.client.0.smithi016.stderr: -354> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98cf10) adding con mode: secure 2024-09-12T17:17:19.778 INFO:tasks.workunit.client.0.smithi016.stderr: -353> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98cf10) adding con mode: crc 2024-09-12T17:17:19.779 INFO:tasks.workunit.client.0.smithi016.stderr: -352> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98cf10) adding con mode: secure 2024-09-12T17:17:19.779 INFO:tasks.workunit.client.0.smithi016.stderr: -351> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98cf10) adding con mode: crc 2024-09-12T17:17:19.779 INFO:tasks.workunit.client.0.smithi016.stderr: -350> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98cf10) adding con mode: secure 2024-09-12T17:17:19.779 INFO:tasks.workunit.client.0.smithi016.stderr: -349> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:19.779 INFO:tasks.workunit.client.0.smithi016.stderr: -348> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 asok(0x56453c7292b0) register_command objecter_requests cmddesc objecter_requests hook 0x56453c9908c0 EEXIST 2024-09-12T17:17:19.779 INFO:tasks.workunit.client.0.smithi016.stderr: -347> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 10 monclient: init 2024-09-12T17:17:19.779 INFO:tasks.workunit.client.0.smithi016.stderr: -346> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98be08) adding auth protocol: cephx 2024-09-12T17:17:19.779 INFO:tasks.workunit.client.0.smithi016.stderr: -345> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98be08) adding auth protocol: cephx 2024-09-12T17:17:19.780 INFO:tasks.workunit.client.0.smithi016.stderr: -344> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98be08) adding auth protocol: cephx 2024-09-12T17:17:19.780 INFO:tasks.workunit.client.0.smithi016.stderr: -343> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98be08) adding con mode: secure 2024-09-12T17:17:19.780 INFO:tasks.workunit.client.0.smithi016.stderr: -342> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98be08) adding con mode: crc 2024-09-12T17:17:19.780 INFO:tasks.workunit.client.0.smithi016.stderr: -341> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98be08) adding con mode: secure 2024-09-12T17:17:19.780 INFO:tasks.workunit.client.0.smithi016.stderr: -340> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98be08) adding con mode: crc 2024-09-12T17:17:19.780 INFO:tasks.workunit.client.0.smithi016.stderr: -339> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98be08) adding con mode: secure 2024-09-12T17:17:19.780 INFO:tasks.workunit.client.0.smithi016.stderr: -338> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98be08) adding con mode: crc 2024-09-12T17:17:19.780 INFO:tasks.workunit.client.0.smithi016.stderr: -337> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98be08) adding con mode: crc 2024-09-12T17:17:19.780 INFO:tasks.workunit.client.0.smithi016.stderr: -336> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98be08) adding con mode: secure 2024-09-12T17:17:19.780 INFO:tasks.workunit.client.0.smithi016.stderr: -335> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98be08) adding con mode: crc 2024-09-12T17:17:19.781 INFO:tasks.workunit.client.0.smithi016.stderr: -334> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98be08) adding con mode: secure 2024-09-12T17:17:19.781 INFO:tasks.workunit.client.0.smithi016.stderr: -333> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98be08) adding con mode: crc 2024-09-12T17:17:19.781 INFO:tasks.workunit.client.0.smithi016.stderr: -332> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98be08) adding con mode: secure 2024-09-12T17:17:19.781 INFO:tasks.workunit.client.0.smithi016.stderr: -331> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:19.781 INFO:tasks.workunit.client.0.smithi016.stderr: -330> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:19.781 INFO:tasks.workunit.client.0.smithi016.stderr: -329> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 asok(0x56453c7292b0) register_command rotate-key cmddesc rotate-key hook 0x56453c98bf50 EEXIST 2024-09-12T17:17:19.781 INFO:tasks.workunit.client.0.smithi016.stderr: -328> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:17:19.781 INFO:tasks.workunit.client.0.smithi016.stderr: -327> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:17:19.781 INFO:tasks.workunit.client.0.smithi016.stderr: -326> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 10 monclient(hunting): picked mon.noname-c con 0x56453c9b4a70 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:17:19.781 INFO:tasks.workunit.client.0.smithi016.stderr: -325> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 10 monclient(hunting): picked mon.noname-a con 0x56453c9b43a0 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:17:19.781 INFO:tasks.workunit.client.0.smithi016.stderr: -324> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 10 monclient(hunting): picked mon.noname-b con 0x56453c9b2d80 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:17:19.781 INFO:tasks.workunit.client.0.smithi016.stderr: -323> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:19.781 INFO:tasks.workunit.client.0.smithi016.stderr: -322> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:19.782 INFO:tasks.workunit.client.0.smithi016.stderr: -321> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:19.782 INFO:tasks.workunit.client.0.smithi016.stderr: -320> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:17:19.782 INFO:tasks.workunit.client.0.smithi016.stderr: -319> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 10 monclient(hunting): authenticate will time out at 2157.413971s 2024-09-12T17:17:19.782 INFO:tasks.workunit.client.0.smithi016.stderr: -318> 2024-09-12T17:17:19.437+0000 7f5d82994640 10 monclient(hunting): get_auth_request con 0x56453c9b4a70 auth_method 0 2024-09-12T17:17:19.782 INFO:tasks.workunit.client.0.smithi016.stderr: -317> 2024-09-12T17:17:19.437+0000 7f5d82994640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:17:19.782 INFO:tasks.workunit.client.0.smithi016.stderr: -316> 2024-09-12T17:17:19.437+0000 7f5d82994640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:17:19.782 INFO:tasks.workunit.client.0.smithi016.stderr: -315> 2024-09-12T17:17:19.437+0000 7f5d82994640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:17:19.782 INFO:tasks.workunit.client.0.smithi016.stderr: -314> 2024-09-12T17:17:19.437+0000 7f5d83996640 10 monclient(hunting): get_auth_request con 0x56453c9b43a0 auth_method 0 2024-09-12T17:17:19.782 INFO:tasks.workunit.client.0.smithi016.stderr: -313> 2024-09-12T17:17:19.437+0000 7f5d83996640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:17:19.782 INFO:tasks.workunit.client.0.smithi016.stderr: -312> 2024-09-12T17:17:19.437+0000 7f5d83996640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:17:19.782 INFO:tasks.workunit.client.0.smithi016.stderr: -311> 2024-09-12T17:17:19.437+0000 7f5d83996640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:17:19.782 INFO:tasks.workunit.client.0.smithi016.stderr: -310> 2024-09-12T17:17:19.437+0000 7f5d82994640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:17:19.782 INFO:tasks.workunit.client.0.smithi016.stderr: -309> 2024-09-12T17:17:19.437+0000 7f5d82994640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:17:19.783 INFO:tasks.workunit.client.0.smithi016.stderr: -308> 2024-09-12T17:17:19.437+0000 7f5d82994640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:17:19.783 INFO:tasks.workunit.client.0.smithi016.stderr: -307> 2024-09-12T17:17:19.437+0000 7f5d83996640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:17:19.783 INFO:tasks.workunit.client.0.smithi016.stderr: -306> 2024-09-12T17:17:19.437+0000 7f5d83996640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:17:19.783 INFO:tasks.workunit.client.0.smithi016.stderr: -305> 2024-09-12T17:17:19.437+0000 7f5d83996640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:17:19.783 INFO:tasks.workunit.client.0.smithi016.stderr: -304> 2024-09-12T17:17:19.437+0000 7f5d82994640 10 monclient(hunting): handle_auth_done global_id 6056 payload 824 2024-09-12T17:17:19.783 INFO:tasks.workunit.client.0.smithi016.stderr: -303> 2024-09-12T17:17:19.437+0000 7f5d82994640 10 monclient: _finish_hunting 0 2024-09-12T17:17:19.783 INFO:tasks.workunit.client.0.smithi016.stderr: -302> 2024-09-12T17:17:19.437+0000 7f5d82994640 1 monclient: found mon.noname-c 2024-09-12T17:17:19.783 INFO:tasks.workunit.client.0.smithi016.stderr: -301> 2024-09-12T17:17:19.437+0000 7f5d82994640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:17:19.783 INFO:tasks.workunit.client.0.smithi016.stderr: -300> 2024-09-12T17:17:19.437+0000 7f5c6d602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:17:19.783 INFO:tasks.workunit.client.0.smithi016.stderr: -299> 2024-09-12T17:17:19.437+0000 7f5c6d602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:17:19.783 INFO:tasks.workunit.client.0.smithi016.stderr: -298> 2024-09-12T17:17:19.437+0000 7f5c6d602640 10 monclient: dump: 2024-09-12T17:17:19.783 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:17:19.783 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:17:19.784 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:19.784 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:19.784 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:17:19.784 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:19.784 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:17:19.784 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:17:19.784 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:17:19.784 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:19.784 INFO:tasks.workunit.client.0.smithi016.stderr: -297> 2024-09-12T17:17:19.437+0000 7f5c6d602640 10 monclient: _finish_auth 0 2024-09-12T17:17:19.784 INFO:tasks.workunit.client.0.smithi016.stderr: -296> 2024-09-12T17:17:19.437+0000 7f5c6d602640 10 monclient: _check_auth_tickets 2024-09-12T17:17:19.784 INFO:tasks.workunit.client.0.smithi016.stderr: -295> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 monclient: authenticate success, global_id 6056 2024-09-12T17:17:19.784 INFO:tasks.workunit.client.0.smithi016.stderr: -294> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 10 monclient: _renew_subs 2024-09-12T17:17:19.785 INFO:tasks.workunit.client.0.smithi016.stderr: -293> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:17:19.785 INFO:tasks.workunit.client.0.smithi016.stderr: -292> 2024-09-12T17:17:19.437+0000 7f5c6d602640 10 monclient: handle_config config(0 keys) 2024-09-12T17:17:19.785 INFO:tasks.workunit.client.0.smithi016.stderr: -291> 2024-09-12T17:17:19.437+0000 7f5c6d602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:17:19.785 INFO:tasks.workunit.client.0.smithi016.stderr: -290> 2024-09-12T17:17:19.437+0000 7f5c6d602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:17:19.785 INFO:tasks.workunit.client.0.smithi016.stderr: -289> 2024-09-12T17:17:19.437+0000 7f5c6d602640 10 monclient: dump: 2024-09-12T17:17:19.785 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:17:19.785 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:17:19.785 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:19.785 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:19.785 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:17:19.785 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:19.785 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:17:19.785 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:17:19.786 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:17:19.786 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:19.786 INFO:tasks.workunit.client.0.smithi016.stderr: -288> 2024-09-12T17:17:19.437+0000 7f5d84197640 4 set_mon_vals no callback set 2024-09-12T17:17:19.786 INFO:tasks.workunit.client.0.smithi016.stderr: -287> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 10 monclient: _renew_subs 2024-09-12T17:17:19.786 INFO:tasks.workunit.client.0.smithi016.stderr: -286> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:17:19.786 INFO:tasks.workunit.client.0.smithi016.stderr: -285> 2024-09-12T17:17:19.441+0000 7f5c6d602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:17:19.786 INFO:tasks.workunit.client.0.smithi016.stderr: -284> 2024-09-12T17:17:19.441+0000 7f5c6d602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:17:19.786 INFO:tasks.workunit.client.0.smithi016.stderr: -283> 2024-09-12T17:17:19.441+0000 7f5c6d602640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:17:19.786 INFO:tasks.workunit.client.0.smithi016.stderr: -282> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 10 monclient: get_monmap_and_config 2024-09-12T17:17:19.786 INFO:tasks.workunit.client.0.smithi016.stderr: -281> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 10 monclient: build_initial_monmap 2024-09-12T17:17:19.786 INFO:tasks.workunit.client.0.smithi016.stderr: -280> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 1 build_initial for_mkfs: 0 2024-09-12T17:17:19.786 INFO:tasks.workunit.client.0.smithi016.stderr: -279> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 10 monclient: monmap: 2024-09-12T17:17:19.786 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:17:19.787 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:17:19.787 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:17:19.787 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:17:19.787 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:17:19.787 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:19.787 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:17:19.787 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:17:19.787 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:17:19.787 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:19.787 INFO:tasks.workunit.client.0.smithi016.stderr: -278> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9d4400) adding auth protocol: cephx 2024-09-12T17:17:19.787 INFO:tasks.workunit.client.0.smithi016.stderr: -277> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9d4400) adding auth protocol: cephx 2024-09-12T17:17:19.787 INFO:tasks.workunit.client.0.smithi016.stderr: -276> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9d4400) adding auth protocol: cephx 2024-09-12T17:17:19.787 INFO:tasks.workunit.client.0.smithi016.stderr: -275> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9d4400) adding con mode: secure 2024-09-12T17:17:19.788 INFO:tasks.workunit.client.0.smithi016.stderr: -274> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9d4400) adding con mode: crc 2024-09-12T17:17:19.788 INFO:tasks.workunit.client.0.smithi016.stderr: -273> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9d4400) adding con mode: secure 2024-09-12T17:17:19.788 INFO:tasks.workunit.client.0.smithi016.stderr: -272> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9d4400) adding con mode: crc 2024-09-12T17:17:19.788 INFO:tasks.workunit.client.0.smithi016.stderr: -271> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9d4400) adding con mode: secure 2024-09-12T17:17:19.788 INFO:tasks.workunit.client.0.smithi016.stderr: -270> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9d4400) adding con mode: crc 2024-09-12T17:17:19.788 INFO:tasks.workunit.client.0.smithi016.stderr: -269> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9d4400) adding con mode: crc 2024-09-12T17:17:19.788 INFO:tasks.workunit.client.0.smithi016.stderr: -268> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9d4400) adding con mode: secure 2024-09-12T17:17:19.788 INFO:tasks.workunit.client.0.smithi016.stderr: -267> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9d4400) adding con mode: crc 2024-09-12T17:17:19.788 INFO:tasks.workunit.client.0.smithi016.stderr: -266> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9d4400) adding con mode: secure 2024-09-12T17:17:19.788 INFO:tasks.workunit.client.0.smithi016.stderr: -265> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9d4400) adding con mode: crc 2024-09-12T17:17:19.788 INFO:tasks.workunit.client.0.smithi016.stderr: -264> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9d4400) adding con mode: secure 2024-09-12T17:17:19.788 INFO:tasks.workunit.client.0.smithi016.stderr: -263> 2024-09-12T17:17:19.441+0000 7f5d83996640 10 monclient: get_auth_request con 0x7f5c5c070a20 auth_method 0 2024-09-12T17:17:19.788 INFO:tasks.workunit.client.0.smithi016.stderr: -262> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:19.789 INFO:tasks.workunit.client.0.smithi016.stderr: -261> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 10 monclient: init 2024-09-12T17:17:19.789 INFO:tasks.workunit.client.0.smithi016.stderr: -260> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95cf40) adding auth protocol: cephx 2024-09-12T17:17:19.789 INFO:tasks.workunit.client.0.smithi016.stderr: -259> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95cf40) adding auth protocol: cephx 2024-09-12T17:17:19.789 INFO:tasks.workunit.client.0.smithi016.stderr: -258> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95cf40) adding auth protocol: cephx 2024-09-12T17:17:19.789 INFO:tasks.workunit.client.0.smithi016.stderr: -257> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95cf40) adding con mode: secure 2024-09-12T17:17:19.789 INFO:tasks.workunit.client.0.smithi016.stderr: -256> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95cf40) adding con mode: crc 2024-09-12T17:17:19.789 INFO:tasks.workunit.client.0.smithi016.stderr: -255> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95cf40) adding con mode: secure 2024-09-12T17:17:19.789 INFO:tasks.workunit.client.0.smithi016.stderr: -254> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95cf40) adding con mode: crc 2024-09-12T17:17:19.789 INFO:tasks.workunit.client.0.smithi016.stderr: -253> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95cf40) adding con mode: secure 2024-09-12T17:17:19.789 INFO:tasks.workunit.client.0.smithi016.stderr: -252> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95cf40) adding con mode: crc 2024-09-12T17:17:19.789 INFO:tasks.workunit.client.0.smithi016.stderr: -251> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95cf40) adding con mode: crc 2024-09-12T17:17:19.789 INFO:tasks.workunit.client.0.smithi016.stderr: -250> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95cf40) adding con mode: secure 2024-09-12T17:17:19.789 INFO:tasks.workunit.client.0.smithi016.stderr: -249> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95cf40) adding con mode: crc 2024-09-12T17:17:19.790 INFO:tasks.workunit.client.0.smithi016.stderr: -248> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95cf40) adding con mode: secure 2024-09-12T17:17:19.790 INFO:tasks.workunit.client.0.smithi016.stderr: -247> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95cf40) adding con mode: crc 2024-09-12T17:17:19.790 INFO:tasks.workunit.client.0.smithi016.stderr: -246> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95cf40) adding con mode: secure 2024-09-12T17:17:19.790 INFO:tasks.workunit.client.0.smithi016.stderr: -245> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:19.790 INFO:tasks.workunit.client.0.smithi016.stderr: -244> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:19.790 INFO:tasks.workunit.client.0.smithi016.stderr: -243> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 asok(0x56453c7292b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd7e95d088 EEXIST 2024-09-12T17:17:19.790 INFO:tasks.workunit.client.0.smithi016.stderr: -242> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:17:19.790 INFO:tasks.workunit.client.0.smithi016.stderr: -241> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:17:19.790 INFO:tasks.workunit.client.0.smithi016.stderr: -240> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 10 monclient(hunting): picked mon.noname-c con 0x56453ca08990 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:17:19.790 INFO:tasks.workunit.client.0.smithi016.stderr: -239> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 10 monclient(hunting): picked mon.noname-a con 0x56453ca02bb0 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:17:19.790 INFO:tasks.workunit.client.0.smithi016.stderr: -238> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 10 monclient(hunting): picked mon.noname-b con 0x56453ca03df0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:17:19.790 INFO:tasks.workunit.client.0.smithi016.stderr: -237> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:19.791 INFO:tasks.workunit.client.0.smithi016.stderr: -236> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:19.791 INFO:tasks.workunit.client.0.smithi016.stderr: -235> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:19.791 INFO:tasks.workunit.client.0.smithi016.stderr: -234> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:17:19.791 INFO:tasks.workunit.client.0.smithi016.stderr: -233> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 10 monclient(hunting): authenticate will time out at 2157.418162s 2024-09-12T17:17:19.791 INFO:tasks.workunit.client.0.smithi016.stderr: -232> 2024-09-12T17:17:19.441+0000 7f5d82994640 10 monclient(hunting): get_auth_request con 0x56453ca08990 auth_method 0 2024-09-12T17:17:19.791 INFO:tasks.workunit.client.0.smithi016.stderr: -231> 2024-09-12T17:17:19.441+0000 7f5d82994640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:17:19.791 INFO:tasks.workunit.client.0.smithi016.stderr: -230> 2024-09-12T17:17:19.441+0000 7f5d82994640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:17:19.791 INFO:tasks.workunit.client.0.smithi016.stderr: -229> 2024-09-12T17:17:19.441+0000 7f5d82994640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:17:19.791 INFO:tasks.workunit.client.0.smithi016.stderr: -228> 2024-09-12T17:17:19.441+0000 7f5d83996640 10 monclient(hunting): get_auth_request con 0x56453ca02bb0 auth_method 0 2024-09-12T17:17:19.791 INFO:tasks.workunit.client.0.smithi016.stderr: -227> 2024-09-12T17:17:19.441+0000 7f5d83996640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:17:19.791 INFO:tasks.workunit.client.0.smithi016.stderr: -226> 2024-09-12T17:17:19.441+0000 7f5d83996640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:17:19.791 INFO:tasks.workunit.client.0.smithi016.stderr: -225> 2024-09-12T17:17:19.441+0000 7f5d83996640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:17:19.791 INFO:tasks.workunit.client.0.smithi016.stderr: -224> 2024-09-12T17:17:19.441+0000 7f5d82994640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:17:19.791 INFO:tasks.workunit.client.0.smithi016.stderr: -223> 2024-09-12T17:17:19.441+0000 7f5d82994640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:17:19.792 INFO:tasks.workunit.client.0.smithi016.stderr: -222> 2024-09-12T17:17:19.441+0000 7f5d82994640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:17:19.792 INFO:tasks.workunit.client.0.smithi016.stderr: -221> 2024-09-12T17:17:19.441+0000 7f5d83996640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:17:19.792 INFO:tasks.workunit.client.0.smithi016.stderr: -220> 2024-09-12T17:17:19.441+0000 7f5d83996640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:17:19.792 INFO:tasks.workunit.client.0.smithi016.stderr: -219> 2024-09-12T17:17:19.441+0000 7f5d83996640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:17:19.792 INFO:tasks.workunit.client.0.smithi016.stderr: -218> 2024-09-12T17:17:19.441+0000 7f5d82994640 10 monclient(hunting): handle_auth_done global_id 6059 payload 274 2024-09-12T17:17:19.792 INFO:tasks.workunit.client.0.smithi016.stderr: -217> 2024-09-12T17:17:19.441+0000 7f5d82994640 10 monclient: _finish_hunting 0 2024-09-12T17:17:19.792 INFO:tasks.workunit.client.0.smithi016.stderr: -216> 2024-09-12T17:17:19.441+0000 7f5d82994640 1 monclient: found mon.noname-c 2024-09-12T17:17:19.792 INFO:tasks.workunit.client.0.smithi016.stderr: -215> 2024-09-12T17:17:19.441+0000 7f5d82994640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:17:19.792 INFO:tasks.workunit.client.0.smithi016.stderr: -214> 2024-09-12T17:17:19.441+0000 7f5c66ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:17:19.792 INFO:tasks.workunit.client.0.smithi016.stderr: -213> 2024-09-12T17:17:19.441+0000 7f5c66ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:17:19.792 INFO:tasks.workunit.client.0.smithi016.stderr: -212> 2024-09-12T17:17:19.441+0000 7f5c66ffd640 10 monclient: dump: 2024-09-12T17:17:19.792 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:17:19.793 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:17:19.793 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:19.793 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:19.793 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:17:19.793 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:19.793 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:17:19.793 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:17:19.793 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:17:19.793 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:19.793 INFO:tasks.workunit.client.0.smithi016.stderr: -211> 2024-09-12T17:17:19.441+0000 7f5c66ffd640 10 monclient: _finish_auth 0 2024-09-12T17:17:19.793 INFO:tasks.workunit.client.0.smithi016.stderr: -210> 2024-09-12T17:17:19.441+0000 7f5c66ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:17:19.793 INFO:tasks.workunit.client.0.smithi016.stderr: -209> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 monclient: authenticate success, global_id 6059 2024-09-12T17:17:19.793 INFO:tasks.workunit.client.0.smithi016.stderr: -208> 2024-09-12T17:17:19.441+0000 7f5c66ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:17:19.794 INFO:tasks.workunit.client.0.smithi016.stderr: -207> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 10 monclient: get_monmap_and_config success 2024-09-12T17:17:19.794 INFO:tasks.workunit.client.0.smithi016.stderr: -206> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 4 set_mon_vals no callback set 2024-09-12T17:17:19.794 INFO:tasks.workunit.client.0.smithi016.stderr: -205> 2024-09-12T17:17:19.441+0000 7f5c66ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:17:19.794 INFO:tasks.workunit.client.0.smithi016.stderr: -204> 2024-09-12T17:17:19.441+0000 7f5c66ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:17:19.794 INFO:tasks.workunit.client.0.smithi016.stderr: -203> 2024-09-12T17:17:19.441+0000 7f5c66ffd640 10 monclient: dump: 2024-09-12T17:17:19.794 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:17:19.794 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:17:19.794 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:19.794 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:19.794 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:17:19.794 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:19.795 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:17:19.795 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:17:19.795 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:17:19.795 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:19.795 INFO:tasks.workunit.client.0.smithi016.stderr: -202> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 10 monclient: shutdown 2024-09-12T17:17:19.795 INFO:tasks.workunit.client.0.smithi016.stderr: -201> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 10 monclient: build_initial_monmap 2024-09-12T17:17:19.795 INFO:tasks.workunit.client.0.smithi016.stderr: -200> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 1 build_initial for_mkfs: 0 2024-09-12T17:17:19.795 INFO:tasks.workunit.client.0.smithi016.stderr: -199> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 10 monclient: monmap: 2024-09-12T17:17:19.795 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:17:19.795 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:17:19.795 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:17:19.795 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:17:19.795 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:17:19.796 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:19.796 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:17:19.796 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:17:19.796 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:17:19.796 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:19.796 INFO:tasks.workunit.client.0.smithi016.stderr: -198> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453ca04bf0) adding auth protocol: cephx 2024-09-12T17:17:19.796 INFO:tasks.workunit.client.0.smithi016.stderr: -197> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453ca04bf0) adding auth protocol: cephx 2024-09-12T17:17:19.796 INFO:tasks.workunit.client.0.smithi016.stderr: -196> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453ca04bf0) adding auth protocol: cephx 2024-09-12T17:17:19.796 INFO:tasks.workunit.client.0.smithi016.stderr: -195> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453ca04bf0) adding con mode: secure 2024-09-12T17:17:19.796 INFO:tasks.workunit.client.0.smithi016.stderr: -194> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453ca04bf0) adding con mode: crc 2024-09-12T17:17:19.796 INFO:tasks.workunit.client.0.smithi016.stderr: -193> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453ca04bf0) adding con mode: secure 2024-09-12T17:17:19.796 INFO:tasks.workunit.client.0.smithi016.stderr: -192> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453ca04bf0) adding con mode: crc 2024-09-12T17:17:19.796 INFO:tasks.workunit.client.0.smithi016.stderr: -191> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453ca04bf0) adding con mode: secure 2024-09-12T17:17:19.797 INFO:tasks.workunit.client.0.smithi016.stderr: -190> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453ca04bf0) adding con mode: crc 2024-09-12T17:17:19.797 INFO:tasks.workunit.client.0.smithi016.stderr: -189> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453ca04bf0) adding con mode: crc 2024-09-12T17:17:19.797 INFO:tasks.workunit.client.0.smithi016.stderr: -188> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453ca04bf0) adding con mode: secure 2024-09-12T17:17:19.797 INFO:tasks.workunit.client.0.smithi016.stderr: -187> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453ca04bf0) adding con mode: crc 2024-09-12T17:17:19.797 INFO:tasks.workunit.client.0.smithi016.stderr: -186> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453ca04bf0) adding con mode: secure 2024-09-12T17:17:19.797 INFO:tasks.workunit.client.0.smithi016.stderr: -185> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453ca04bf0) adding con mode: crc 2024-09-12T17:17:19.797 INFO:tasks.workunit.client.0.smithi016.stderr: -184> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453ca04bf0) adding con mode: secure 2024-09-12T17:17:19.797 INFO:tasks.workunit.client.0.smithi016.stderr: -183> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:19.797 INFO:tasks.workunit.client.0.smithi016.stderr: -182> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 1 librados: starting msgr at 2024-09-12T17:17:19.797 INFO:tasks.workunit.client.0.smithi016.stderr: -181> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 1 librados: starting objecter 2024-09-12T17:17:19.797 INFO:tasks.workunit.client.0.smithi016.stderr: -180> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 5 asok(0x56453c7292b0) register_command objecter_requests cmddesc objecter_requests hook 0x56453ca03520 EEXIST 2024-09-12T17:17:19.797 INFO:tasks.workunit.client.0.smithi016.stderr: -179> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 1 librados: setting wanted keys 2024-09-12T17:17:19.797 INFO:tasks.workunit.client.0.smithi016.stderr: -178> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 1 librados: calling monclient init 2024-09-12T17:17:19.798 INFO:tasks.workunit.client.0.smithi016.stderr: -177> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 10 monclient: init 2024-09-12T17:17:19.798 INFO:tasks.workunit.client.0.smithi016.stderr: -176> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9b6890) adding auth protocol: cephx 2024-09-12T17:17:19.798 INFO:tasks.workunit.client.0.smithi016.stderr: -175> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9b6890) adding auth protocol: cephx 2024-09-12T17:17:19.798 INFO:tasks.workunit.client.0.smithi016.stderr: -174> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9b6890) adding auth protocol: cephx 2024-09-12T17:17:19.798 INFO:tasks.workunit.client.0.smithi016.stderr: -173> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9b6890) adding con mode: secure 2024-09-12T17:17:19.798 INFO:tasks.workunit.client.0.smithi016.stderr: -172> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9b6890) adding con mode: crc 2024-09-12T17:17:19.798 INFO:tasks.workunit.client.0.smithi016.stderr: -171> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9b6890) adding con mode: secure 2024-09-12T17:17:19.798 INFO:tasks.workunit.client.0.smithi016.stderr: -170> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9b6890) adding con mode: crc 2024-09-12T17:17:19.798 INFO:tasks.workunit.client.0.smithi016.stderr: -169> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9b6890) adding con mode: secure 2024-09-12T17:17:19.798 INFO:tasks.workunit.client.0.smithi016.stderr: -168> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9b6890) adding con mode: crc 2024-09-12T17:17:19.798 INFO:tasks.workunit.client.0.smithi016.stderr: -167> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9b6890) adding con mode: crc 2024-09-12T17:17:19.798 INFO:tasks.workunit.client.0.smithi016.stderr: -166> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9b6890) adding con mode: secure 2024-09-12T17:17:19.798 INFO:tasks.workunit.client.0.smithi016.stderr: -165> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9b6890) adding con mode: crc 2024-09-12T17:17:19.799 INFO:tasks.workunit.client.0.smithi016.stderr: -164> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9b6890) adding con mode: secure 2024-09-12T17:17:19.799 INFO:tasks.workunit.client.0.smithi016.stderr: -163> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9b6890) adding con mode: crc 2024-09-12T17:17:19.799 INFO:tasks.workunit.client.0.smithi016.stderr: -162> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9b6890) adding con mode: secure 2024-09-12T17:17:19.799 INFO:tasks.workunit.client.0.smithi016.stderr: -161> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:19.799 INFO:tasks.workunit.client.0.smithi016.stderr: -160> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:19.799 INFO:tasks.workunit.client.0.smithi016.stderr: -159> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 5 asok(0x56453c7292b0) register_command rotate-key cmddesc rotate-key hook 0x56453c9b69d8 EEXIST 2024-09-12T17:17:19.799 INFO:tasks.workunit.client.0.smithi016.stderr: -158> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:17:19.799 INFO:tasks.workunit.client.0.smithi016.stderr: -157> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:17:19.799 INFO:tasks.workunit.client.0.smithi016.stderr: -156> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 10 monclient(hunting): picked mon.noname-a con 0x56453ca02bb0 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:17:19.799 INFO:tasks.workunit.client.0.smithi016.stderr: -155> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 10 monclient(hunting): picked mon.noname-c con 0x56453ca03df0 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:17:19.799 INFO:tasks.workunit.client.0.smithi016.stderr: -154> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 10 monclient(hunting): picked mon.noname-b con 0x56453ca08990 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:17:19.799 INFO:tasks.workunit.client.0.smithi016.stderr: -153> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:19.799 INFO:tasks.workunit.client.0.smithi016.stderr: -152> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:19.800 INFO:tasks.workunit.client.0.smithi016.stderr: -151> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:19.800 INFO:tasks.workunit.client.0.smithi016.stderr: -150> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:17:19.800 INFO:tasks.workunit.client.0.smithi016.stderr: -149> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 10 monclient(hunting): authenticate will time out at 2157.420776s 2024-09-12T17:17:19.800 INFO:tasks.workunit.client.0.smithi016.stderr: -148> 2024-09-12T17:17:19.445+0000 7f5d82994640 10 monclient(hunting): get_auth_request con 0x56453ca02bb0 auth_method 0 2024-09-12T17:17:19.800 INFO:tasks.workunit.client.0.smithi016.stderr: -147> 2024-09-12T17:17:19.445+0000 7f5d82994640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:17:19.800 INFO:tasks.workunit.client.0.smithi016.stderr: -146> 2024-09-12T17:17:19.445+0000 7f5d82994640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:17:19.800 INFO:tasks.workunit.client.0.smithi016.stderr: -145> 2024-09-12T17:17:19.445+0000 7f5d82994640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:17:19.800 INFO:tasks.workunit.client.0.smithi016.stderr: -144> 2024-09-12T17:17:19.445+0000 7f5d83996640 10 monclient(hunting): get_auth_request con 0x56453ca03df0 auth_method 0 2024-09-12T17:17:19.800 INFO:tasks.workunit.client.0.smithi016.stderr: -143> 2024-09-12T17:17:19.445+0000 7f5d83996640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:17:19.800 INFO:tasks.workunit.client.0.smithi016.stderr: -142> 2024-09-12T17:17:19.445+0000 7f5d83996640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:17:19.800 INFO:tasks.workunit.client.0.smithi016.stderr: -141> 2024-09-12T17:17:19.445+0000 7f5d83996640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:17:19.800 INFO:tasks.workunit.client.0.smithi016.stderr: -140> 2024-09-12T17:17:19.445+0000 7f5d82994640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:17:19.800 INFO:tasks.workunit.client.0.smithi016.stderr: -139> 2024-09-12T17:17:19.445+0000 7f5d82994640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:17:19.801 INFO:tasks.workunit.client.0.smithi016.stderr: -138> 2024-09-12T17:17:19.445+0000 7f5d82994640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:17:19.801 INFO:tasks.workunit.client.0.smithi016.stderr: -137> 2024-09-12T17:17:19.445+0000 7f5d83996640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:17:19.801 INFO:tasks.workunit.client.0.smithi016.stderr: -136> 2024-09-12T17:17:19.445+0000 7f5d83996640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:17:19.801 INFO:tasks.workunit.client.0.smithi016.stderr: -135> 2024-09-12T17:17:19.445+0000 7f5d83996640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:17:19.801 INFO:tasks.workunit.client.0.smithi016.stderr: -134> 2024-09-12T17:17:19.445+0000 7f5d82994640 10 monclient(hunting): handle_auth_done global_id 6318 payload 824 2024-09-12T17:17:19.801 INFO:tasks.workunit.client.0.smithi016.stderr: -133> 2024-09-12T17:17:19.445+0000 7f5d82994640 10 monclient: _finish_hunting 0 2024-09-12T17:17:19.801 INFO:tasks.workunit.client.0.smithi016.stderr: -132> 2024-09-12T17:17:19.445+0000 7f5d82994640 1 monclient: found mon.noname-a 2024-09-12T17:17:19.801 INFO:tasks.workunit.client.0.smithi016.stderr: -131> 2024-09-12T17:17:19.445+0000 7f5d82994640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:17:19.801 INFO:tasks.workunit.client.0.smithi016.stderr: -130> 2024-09-12T17:17:19.445+0000 7f5c657fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:17:19.801 INFO:tasks.workunit.client.0.smithi016.stderr: -129> 2024-09-12T17:17:19.445+0000 7f5c657fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:17:19.801 INFO:tasks.workunit.client.0.smithi016.stderr: -128> 2024-09-12T17:17:19.445+0000 7f5c657fa640 10 monclient: dump: 2024-09-12T17:17:19.801 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:17:19.801 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:17:19.802 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:19.802 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:19.802 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:17:19.802 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:19.802 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:17:19.802 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:17:19.802 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:17:19.802 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:19.802 INFO:tasks.workunit.client.0.smithi016.stderr: -127> 2024-09-12T17:17:19.445+0000 7f5c657fa640 10 monclient: _finish_auth 0 2024-09-12T17:17:19.802 INFO:tasks.workunit.client.0.smithi016.stderr: -126> 2024-09-12T17:17:19.445+0000 7f5c657fa640 10 monclient: _check_auth_tickets 2024-09-12T17:17:19.802 INFO:tasks.workunit.client.0.smithi016.stderr: -125> 2024-09-12T17:17:19.445+0000 7f5c657fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:17:19.802 INFO:tasks.workunit.client.0.smithi016.stderr: -124> 2024-09-12T17:17:19.445+0000 7f5c657fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:17:19.802 INFO:tasks.workunit.client.0.smithi016.stderr: -123> 2024-09-12T17:17:19.445+0000 7f5c657fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:17:19.803 INFO:tasks.workunit.client.0.smithi016.stderr: -122> 2024-09-12T17:17:19.445+0000 7f5c657fa640 10 monclient: dump: 2024-09-12T17:17:19.803 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:17:19.803 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:17:19.803 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:19.803 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:19.803 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:17:19.803 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:19.803 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:17:19.803 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:17:19.803 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:17:19.803 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:19.803 INFO:tasks.workunit.client.0.smithi016.stderr: -121> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 5 monclient: authenticate success, global_id 6318 2024-09-12T17:17:19.803 INFO:tasks.workunit.client.0.smithi016.stderr: -120> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 10 monclient: _renew_subs 2024-09-12T17:17:19.804 INFO:tasks.workunit.client.0.smithi016.stderr: -119> 2024-09-12T17:17:19.445+0000 7f5c66ffd640 4 set_mon_vals no callback set 2024-09-12T17:17:19.804 INFO:tasks.workunit.client.0.smithi016.stderr: -118> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:17:19.804 INFO:tasks.workunit.client.0.smithi016.stderr: -117> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 10 monclient: _renew_subs 2024-09-12T17:17:19.804 INFO:tasks.workunit.client.0.smithi016.stderr: -116> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:17:19.804 INFO:tasks.workunit.client.0.smithi016.stderr: -115> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 1 librados: init done 2024-09-12T17:17:19.804 INFO:tasks.workunit.client.0.smithi016.stderr: -114> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 5 asok(0x56453c7292b0) register_command cr dump hook 0x56453c9fc618 2024-09-12T17:17:19.804 INFO:tasks.workunit.client.0.smithi016.stderr: -113> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.804 INFO:tasks.workunit.client.0.smithi016.stderr: -112> 2024-09-12T17:17:19.445+0000 7f5c657fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:17:19.804 INFO:tasks.workunit.client.0.smithi016.stderr: -111> 2024-09-12T17:17:19.445+0000 7f5c657fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:17:19.804 INFO:tasks.workunit.client.0.smithi016.stderr: -110> 2024-09-12T17:17:19.445+0000 7f5c657fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:17:19.804 INFO:tasks.workunit.client.0.smithi016.stderr: -109> 2024-09-12T17:17:19.449+0000 7f5d83195640 10 monclient: get_auth_request con 0x56453ca21d30 auth_method 0 2024-09-12T17:17:19.804 INFO:tasks.workunit.client.0.smithi016.stderr: -108> 2024-09-12T17:17:19.449+0000 7f5d83996640 10 monclient: get_auth_request con 0x7f5c4c070ae0 auth_method 0 2024-09-12T17:17:19.804 INFO:tasks.workunit.client.0.smithi016.stderr: -107> 2024-09-12T17:17:19.449+0000 7f5d8568f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:19.805 INFO:tasks.workunit.client.0.smithi016.stderr: -106> 2024-09-12T17:17:19.449+0000 7f5d8568f9c0 20 realm 2024-09-12T17:17:19.805 INFO:tasks.workunit.client.0.smithi016.stderr: -105> 2024-09-12T17:17:19.449+0000 7f5d8568f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.805 INFO:tasks.workunit.client.0.smithi016.stderr: -104> 2024-09-12T17:17:19.449+0000 7f5d8568f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:19.805 INFO:tasks.workunit.client.0.smithi016.stderr: -103> 2024-09-12T17:17:19.449+0000 7f5d8568f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:17:19.805 INFO:tasks.workunit.client.0.smithi016.stderr: -102> 2024-09-12T17:17:19.449+0000 7f5d8568f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.805 INFO:tasks.workunit.client.0.smithi016.stderr: -101> 2024-09-12T17:17:19.449+0000 7f5d8568f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:19.805 INFO:tasks.workunit.client.0.smithi016.stderr: -100> 2024-09-12T17:17:19.449+0000 7f5d8568f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.805 INFO:tasks.workunit.client.0.smithi016.stderr: -99> 2024-09-12T17:17:19.449+0000 7f5d82994640 10 monclient: get_auth_request con 0x56453ca26050 auth_method 0 2024-09-12T17:17:19.805 INFO:tasks.workunit.client.0.smithi016.stderr: -98> 2024-09-12T17:17:19.449+0000 7f5d8568f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:19.805 INFO:tasks.workunit.client.0.smithi016.stderr: -97> 2024-09-12T17:17:19.449+0000 7f5d8568f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.805 INFO:tasks.workunit.client.0.smithi016.stderr: -96> 2024-09-12T17:17:19.449+0000 7f5d83996640 10 monclient: get_auth_request con 0x56453ca29790 auth_method 0 2024-09-12T17:17:19.805 INFO:tasks.workunit.client.0.smithi016.stderr: -95> 2024-09-12T17:17:19.453+0000 7f5d8568f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:17:19.805 INFO:tasks.workunit.client.0.smithi016.stderr: -94> 2024-09-12T17:17:19.453+0000 7f5d8568f9c0 20 searching for the correct realm 2024-09-12T17:17:19.806 INFO:tasks.workunit.client.0.smithi016.stderr: -93> 2024-09-12T17:17:19.453+0000 7f5d83195640 10 monclient: get_auth_request con 0x56453ca2e4e0 auth_method 0 2024-09-12T17:17:19.806 INFO:tasks.workunit.client.0.smithi016.stderr: -92> 2024-09-12T17:17:19.453+0000 7f5d82994640 10 monclient: get_auth_request con 0x7f5d740f8110 auth_method 0 2024-09-12T17:17:19.806 INFO:tasks.workunit.client.0.smithi016.stderr: -91> 2024-09-12T17:17:19.453+0000 7f5d83996640 10 monclient: get_auth_request con 0x7f5d780374c0 auth_method 0 2024-09-12T17:17:19.806 INFO:tasks.workunit.client.0.smithi016.stderr: -90> 2024-09-12T17:17:19.457+0000 7f5d83996640 0 -- 172.21.15.16:0/2991639686 >> [v2:172.21.15.19:6800/1509147557,v1:172.21.15.19:6801/1509147557] conn(0x56453ca29790 msgr2=0x56453ca2bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:19.806 INFO:tasks.workunit.client.0.smithi016.stderr: -89> 2024-09-12T17:17:19.457+0000 7f5c657fa640 1 client.6318.objecter ms_handle_reset 0x56453ca29790 session 0x56453ca25870 osd.4 2024-09-12T17:17:19.806 INFO:tasks.workunit.client.0.smithi016.stderr: -88> 2024-09-12T17:17:19.457+0000 7f5c657fa640 10 monclient: _renew_subs 2024-09-12T17:17:19.806 INFO:tasks.workunit.client.0.smithi016.stderr: -87> 2024-09-12T17:17:19.457+0000 7f5c657fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:17:19.806 INFO:tasks.workunit.client.0.smithi016.stderr: -86> 2024-09-12T17:17:19.457+0000 7f5d83996640 10 monclient: get_auth_request con 0x7f5c4c080900 auth_method 0 2024-09-12T17:17:19.806 INFO:tasks.workunit.client.0.smithi016.stderr: -85> 2024-09-12T17:17:19.457+0000 7f5d83195640 10 monclient: get_auth_request con 0x7f5d7c033040 auth_method 0 2024-09-12T17:17:19.806 INFO:tasks.workunit.client.0.smithi016.stderr: -84> 2024-09-12T17:17:19.461+0000 7f5d82994640 10 monclient: get_auth_request con 0x7f5d7c00e040 auth_method 0 2024-09-12T17:17:19.806 INFO:tasks.workunit.client.0.smithi016.stderr: -83> 2024-09-12T17:17:19.461+0000 7f5d82994640 0 -- 172.21.15.16:0/2991639686 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f5d7c00e040 msgr2=0x7f5d7c058900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:17:19.806 INFO:tasks.workunit.client.0.smithi016.stderr: -82> 2024-09-12T17:17:19.665+0000 7f5d82994640 10 monclient: get_auth_request con 0x7f5d7c00e040 auth_method 0 2024-09-12T17:17:19.806 INFO:tasks.workunit.client.0.smithi016.stderr: -81> 2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:17:19.807 INFO:tasks.workunit.client.0.smithi016.stderr: -80> 2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:17:19.807 INFO:tasks.workunit.client.0.smithi016.stderr: -79> 2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:17:19.807 INFO:tasks.workunit.client.0.smithi016.stderr: -78> 2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:17:19.807 INFO:tasks.workunit.client.0.smithi016.stderr: -77> 2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:17:19.807 INFO:tasks.workunit.client.0.smithi016.stderr: -76> 2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:17:19.807 INFO:tasks.workunit.client.0.smithi016.stderr: -75> 2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.807 INFO:tasks.workunit.client.0.smithi016.stderr: -74> 2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:19.807 INFO:tasks.workunit.client.0.smithi016.stderr: -73> 2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.807 INFO:tasks.workunit.client.0.smithi016.stderr: -72> 2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:19.807 INFO:tasks.workunit.client.0.smithi016.stderr: -71> 2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.807 INFO:tasks.workunit.client.0.smithi016.stderr: -70> 2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:17:19.807 INFO:tasks.workunit.client.0.smithi016.stderr: -69> 2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 zone default found 2024-09-12T17:17:19.808 INFO:tasks.workunit.client.0.smithi016.stderr: -68> 2024-09-12T17:17:19.681+0000 7f5d8568f9c0 4 Realm: () 2024-09-12T17:17:19.808 INFO:tasks.workunit.client.0.smithi016.stderr: -67> 2024-09-12T17:17:19.681+0000 7f5d8568f9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:17:19.808 INFO:tasks.workunit.client.0.smithi016.stderr: -66> 2024-09-12T17:17:19.681+0000 7f5d8568f9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:17:19.808 INFO:tasks.workunit.client.0.smithi016.stderr: -65> 2024-09-12T17:17:19.681+0000 7f5d8568f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:17:19.808 INFO:tasks.workunit.client.0.smithi016.stderr: -64> 2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 zonegroup default 2024-09-12T17:17:19.808 INFO:tasks.workunit.client.0.smithi016.stderr: -63> 2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.808 INFO:tasks.workunit.client.0.smithi016.stderr: -62> 2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:19.808 INFO:tasks.workunit.client.0.smithi016.stderr: -61> 2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.808 INFO:tasks.workunit.client.0.smithi016.stderr: -60> 2024-09-12T17:17:19.685+0000 7f5d8568f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:19.808 INFO:tasks.workunit.client.0.smithi016.stderr: -59> 2024-09-12T17:17:19.685+0000 7f5d8568f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.808 INFO:tasks.workunit.client.0.smithi016.stderr: -58> 2024-09-12T17:17:19.685+0000 7f5d8568f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:19.808 INFO:tasks.workunit.client.0.smithi016.stderr: -57> 2024-09-12T17:17:19.685+0000 7f5d8568f9c0 20 started sync module instance, tier type = 2024-09-12T17:17:19.809 INFO:tasks.workunit.client.0.smithi016.stderr: -56> 2024-09-12T17:17:19.685+0000 7f5d8568f9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:17:19.809 INFO:tasks.workunit.client.0.smithi016.stderr: -55> 2024-09-12T17:17:19.709+0000 7f5d8568f9c0 20 add_watcher() i=0 2024-09-12T17:17:19.809 INFO:tasks.workunit.client.0.smithi016.stderr: -54> 2024-09-12T17:17:19.709+0000 7f5d8568f9c0 20 add_watcher() i=1 2024-09-12T17:17:19.809 INFO:tasks.workunit.client.0.smithi016.stderr: -53> 2024-09-12T17:17:19.709+0000 7f5d8568f9c0 20 add_watcher() i=2 2024-09-12T17:17:19.809 INFO:tasks.workunit.client.0.smithi016.stderr: -52> 2024-09-12T17:17:19.709+0000 7f5d8568f9c0 20 add_watcher() i=3 2024-09-12T17:17:19.809 INFO:tasks.workunit.client.0.smithi016.stderr: -51> 2024-09-12T17:17:19.709+0000 7f5d8568f9c0 20 add_watcher() i=4 2024-09-12T17:17:19.809 INFO:tasks.workunit.client.0.smithi016.stderr: -50> 2024-09-12T17:17:19.709+0000 7f5d8568f9c0 20 add_watcher() i=5 2024-09-12T17:17:19.809 INFO:tasks.workunit.client.0.smithi016.stderr: -49> 2024-09-12T17:17:19.709+0000 7f5d8568f9c0 20 add_watcher() i=6 2024-09-12T17:17:19.809 INFO:tasks.workunit.client.0.smithi016.stderr: -48> 2024-09-12T17:17:19.709+0000 7f5d8568f9c0 20 add_watcher() i=7 2024-09-12T17:17:19.809 INFO:tasks.workunit.client.0.smithi016.stderr: -47> 2024-09-12T17:17:19.709+0000 7f5d8568f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:17:19.809 INFO:tasks.workunit.client.0.smithi016.stderr: -46> 2024-09-12T17:17:19.713+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95d410) adding auth protocol: cephx 2024-09-12T17:17:19.809 INFO:tasks.workunit.client.0.smithi016.stderr: -45> 2024-09-12T17:17:19.713+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95d410) adding auth protocol: cephx 2024-09-12T17:17:19.809 INFO:tasks.workunit.client.0.smithi016.stderr: -44> 2024-09-12T17:17:19.713+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95d410) adding auth protocol: cephx 2024-09-12T17:17:19.810 INFO:tasks.workunit.client.0.smithi016.stderr: -43> 2024-09-12T17:17:19.713+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95d410) adding con mode: secure 2024-09-12T17:17:19.810 INFO:tasks.workunit.client.0.smithi016.stderr: -42> 2024-09-12T17:17:19.713+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95d410) adding con mode: crc 2024-09-12T17:17:19.810 INFO:tasks.workunit.client.0.smithi016.stderr: -41> 2024-09-12T17:17:19.713+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95d410) adding con mode: secure 2024-09-12T17:17:19.810 INFO:tasks.workunit.client.0.smithi016.stderr: -40> 2024-09-12T17:17:19.713+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95d410) adding con mode: crc 2024-09-12T17:17:19.810 INFO:tasks.workunit.client.0.smithi016.stderr: -39> 2024-09-12T17:17:19.713+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95d410) adding con mode: secure 2024-09-12T17:17:19.810 INFO:tasks.workunit.client.0.smithi016.stderr: -38> 2024-09-12T17:17:19.713+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95d410) adding con mode: crc 2024-09-12T17:17:19.810 INFO:tasks.workunit.client.0.smithi016.stderr: -37> 2024-09-12T17:17:19.713+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95d410) adding con mode: crc 2024-09-12T17:17:19.810 INFO:tasks.workunit.client.0.smithi016.stderr: -36> 2024-09-12T17:17:19.713+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95d410) adding con mode: secure 2024-09-12T17:17:19.810 INFO:tasks.workunit.client.0.smithi016.stderr: -35> 2024-09-12T17:17:19.713+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95d410) adding con mode: crc 2024-09-12T17:17:19.810 INFO:tasks.workunit.client.0.smithi016.stderr: -34> 2024-09-12T17:17:19.713+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95d410) adding con mode: secure 2024-09-12T17:17:19.810 INFO:tasks.workunit.client.0.smithi016.stderr: -33> 2024-09-12T17:17:19.713+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95d410) adding con mode: crc 2024-09-12T17:17:19.810 INFO:tasks.workunit.client.0.smithi016.stderr: -32> 2024-09-12T17:17:19.713+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95d410) adding con mode: secure 2024-09-12T17:17:19.810 INFO:tasks.workunit.client.0.smithi016.stderr: -31> 2024-09-12T17:17:19.713+0000 7f5c3a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:19.811 INFO:tasks.workunit.client.0.smithi016.stderr: -30> 2024-09-12T17:17:19.713+0000 7f5d8568f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:19.811 INFO:tasks.workunit.client.0.smithi016.stderr: -29> 2024-09-12T17:17:19.713+0000 7f5d8568f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:17:19.811 INFO:tasks.workunit.client.0.smithi016.stderr: -28> 2024-09-12T17:17:19.713+0000 7f5d8568f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:17:19.811 INFO:tasks.workunit.client.0.smithi016.stderr: -27> 2024-09-12T17:17:19.713+0000 7f5d8568f9c0 5 asok(0x56453c7292b0) register_command cache list hook 0x56453ca01860 2024-09-12T17:17:19.811 INFO:tasks.workunit.client.0.smithi016.stderr: -26> 2024-09-12T17:17:19.713+0000 7f5d8568f9c0 5 asok(0x56453c7292b0) register_command cache inspect hook 0x56453ca01860 2024-09-12T17:17:19.811 INFO:tasks.workunit.client.0.smithi016.stderr: -25> 2024-09-12T17:17:19.713+0000 7f5d8568f9c0 5 asok(0x56453c7292b0) register_command cache erase hook 0x56453ca01860 2024-09-12T17:17:19.811 INFO:tasks.workunit.client.0.smithi016.stderr: -24> 2024-09-12T17:17:19.713+0000 7f5d8568f9c0 5 asok(0x56453c7292b0) register_command cache zap hook 0x56453ca01860 2024-09-12T17:17:19.811 INFO:tasks.workunit.client.0.smithi016.stderr: -23> 2024-09-12T17:17:19.713+0000 7f5d8568f9c0 5 note: GC not initialized 2024-09-12T17:17:19.811 INFO:tasks.workunit.client.0.smithi016.stderr: -22> 2024-09-12T17:17:19.717+0000 7f5c397e2640 20 reqs_thread_entry: start 2024-09-12T17:17:19.811 INFO:tasks.workunit.client.0.smithi016.stderr: -21> 2024-09-12T17:17:19.717+0000 7f5d8568f9c0 5 asok(0x56453c7292b0) register_command sync trace show hook 0x7f5d7c004720 2024-09-12T17:17:19.811 INFO:tasks.workunit.client.0.smithi016.stderr: -20> 2024-09-12T17:17:19.717+0000 7f5d8568f9c0 5 asok(0x56453c7292b0) register_command sync trace history hook 0x7f5d7c004720 2024-09-12T17:17:19.811 INFO:tasks.workunit.client.0.smithi016.stderr: -19> 2024-09-12T17:17:19.717+0000 7f5d8568f9c0 5 asok(0x56453c7292b0) register_command sync trace active hook 0x7f5d7c004720 2024-09-12T17:17:19.811 INFO:tasks.workunit.client.0.smithi016.stderr: -18> 2024-09-12T17:17:19.717+0000 7f5d8568f9c0 5 asok(0x56453c7292b0) register_command sync trace active_short hook 0x7f5d7c004720 2024-09-12T17:17:19.812 INFO:tasks.workunit.client.0.smithi016.stderr: -17> 2024-09-12T17:17:19.717+0000 7f5d8568f9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:17:19.812 INFO:tasks.workunit.client.0.smithi016.stderr: -16> 2024-09-12T17:17:19.717+0000 7f5d8568f9c0 20 Filter name: none 2024-09-12T17:17:19.812 INFO:tasks.workunit.client.0.smithi016.stderr: -15> 2024-09-12T17:17:19.717+0000 7f5c327fc640 20 reqs_thread_entry: start 2024-09-12T17:17:19.812 INFO:tasks.workunit.client.0.smithi016.stderr: -14> 2024-09-12T17:17:19.717+0000 7f5d8568f9c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T17:17:19.812 INFO:tasks.workunit.client.0.smithi016.stderr: -13> 2024-09-12T17:17:19.717+0000 7f5d8568f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.812 INFO:tasks.workunit.client.0.smithi016.stderr: -12> 2024-09-12T17:17:19.717+0000 7f5d8568f9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T17:17:19.812 INFO:tasks.workunit.client.0.smithi016.stderr: -11> 2024-09-12T17:17:19.717+0000 7f5d8568f9c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T17:17:19.812 INFO:tasks.workunit.client.0.smithi016.stderr: -10> 2024-09-12T17:17:19.717+0000 7f5d8568f9c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T17:17:19.812 INFO:tasks.workunit.client.0.smithi016.stderr: -9> 2024-09-12T17:17:19.717+0000 7f5d8568f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21 : miss 2024-09-12T17:17:19.812 INFO:tasks.workunit.client.0.smithi016.stderr: -8> 2024-09-12T17:17:19.717+0000 7f5d8568f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.812 INFO:tasks.workunit.client.0.smithi016.stderr: -7> 2024-09-12T17:17:19.717+0000 7f5d8568f9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T17:17:19.812 INFO:tasks.workunit.client.0.smithi016.stderr: -6> 2024-09-12T17:17:19.717+0000 7f5d8568f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21 info.flags=0x17 2024-09-12T17:17:19.813 INFO:tasks.workunit.client.0.smithi016.stderr: -5> 2024-09-12T17:17:19.717+0000 7f5d8568f9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21 to cache LRU end 2024-09-12T17:17:19.813 INFO:tasks.workunit.client.0.smithi016.stderr: -4> 2024-09-12T17:17:19.717+0000 7f5d8568f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:17:19.813 INFO:tasks.workunit.client.0.smithi016.stderr: -3> 2024-09-12T17:17:19.717+0000 7f5d8568f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:17:19.813 INFO:tasks.workunit.client.0.smithi016.stderr: -2> 2024-09-12T17:17:19.717+0000 7f5d8568f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21 2024-09-12T17:17:19.813 INFO:tasks.workunit.client.0.smithi016.stderr: -1> 2024-09-12T17:17:19.721+0000 7f5d8568f9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5d8568f9c0 time 2024-09-12T17:17:19.724710+0000 2024-09-12T17:17:19.813 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:17:19.813 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:19.813 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:17:19.813 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f5d88f692eb] 2024-09-12T17:17:19.813 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5d88f6949f] 2024-09-12T17:17:19.813 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56453a06b0c1] 2024-09-12T17:17:19.813 INFO:tasks.workunit.client.0.smithi016.stderr: 4: radosgw-admin(+0x140f572) [0x56453aac0572] 2024-09-12T17:17:19.813 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56453a07d18d] 2024-09-12T17:17:19.814 INFO:tasks.workunit.client.0.smithi016.stderr: 6: main() 2024-09-12T17:17:19.814 INFO:tasks.workunit.client.0.smithi016.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5d87dcfd90] 2024-09-12T17:17:19.814 INFO:tasks.workunit.client.0.smithi016.stderr: 8: __libc_start_main() 2024-09-12T17:17:19.814 INFO:tasks.workunit.client.0.smithi016.stderr: 9: _start() 2024-09-12T17:17:19.814 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:19.814 INFO:tasks.workunit.client.0.smithi016.stderr: 0> 2024-09-12T17:17:19.725+0000 7f5d8568f9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:17:19.814 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7f5d8568f9c0 thread_name:radosgw-admin 2024-09-12T17:17:19.814 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:19.814 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:17:19.814 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f5d87de8520] 2024-09-12T17:17:19.814 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:17:19.814 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:17:19.814 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:17:19.814 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f5d88f69345] 2024-09-12T17:17:19.815 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5d88f6949f] 2024-09-12T17:17:19.815 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56453a06b0c1] 2024-09-12T17:17:19.815 INFO:tasks.workunit.client.0.smithi016.stderr: 8: radosgw-admin(+0x140f572) [0x56453aac0572] 2024-09-12T17:17:19.815 INFO:tasks.workunit.client.0.smithi016.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56453a07d18d] 2024-09-12T17:17:19.815 INFO:tasks.workunit.client.0.smithi016.stderr: 10: main() 2024-09-12T17:17:19.815 INFO:tasks.workunit.client.0.smithi016.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5d87dcfd90] 2024-09-12T17:17:19.815 INFO:tasks.workunit.client.0.smithi016.stderr: 12: __libc_start_main() 2024-09-12T17:17:19.815 INFO:tasks.workunit.client.0.smithi016.stderr: 13: _start() 2024-09-12T17:17:19.815 INFO:tasks.workunit.client.0.smithi016.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:17:19.815 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:19.815 INFO:tasks.workunit.client.0.smithi016.stderr:--- logging levels --- 2024-09-12T17:17:19.815 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 none 2024-09-12T17:17:19.815 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 lockdep 2024-09-12T17:17:19.816 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 context 2024-09-12T17:17:19.816 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 crush 2024-09-12T17:17:19.816 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds 2024-09-12T17:17:19.816 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_balancer 2024-09-12T17:17:19.816 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_locker 2024-09-12T17:17:19.816 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log 2024-09-12T17:17:19.816 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log_expire 2024-09-12T17:17:19.816 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_migrator 2024-09-12T17:17:19.816 INFO:tasks.workunit.client.0.smithi016.stderr: 3/ 5 mds_quiesce 2024-09-12T17:17:19.816 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 buffer 2024-09-12T17:17:19.816 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 timer 2024-09-12T17:17:19.816 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 filer 2024-09-12T17:17:19.817 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 striper 2024-09-12T17:17:19.817 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 objecter 2024-09-12T17:17:19.817 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rados 2024-09-12T17:17:19.817 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd 2024-09-12T17:17:19.817 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_mirror 2024-09-12T17:17:19.817 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_replay 2024-09-12T17:17:19.817 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_pwl 2024-09-12T17:17:19.817 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 journaler 2024-09-12T17:17:19.817 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objectcacher 2024-09-12T17:17:19.817 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:17:19.817 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 client 2024-09-12T17:17:19.817 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 osd 2024-09-12T17:17:19.817 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 optracker 2024-09-12T17:17:19.817 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objclass 2024-09-12T17:17:19.818 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 filestore 2024-09-12T17:17:19.818 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 journal 2024-09-12T17:17:19.818 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 ms 2024-09-12T17:17:19.818 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mon 2024-09-12T17:17:19.818 INFO:tasks.workunit.client.0.smithi016.stderr: 0/10 monc 2024-09-12T17:17:19.818 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 paxos 2024-09-12T17:17:19.818 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 tp 2024-09-12T17:17:19.818 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 auth 2024-09-12T17:17:19.819 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 crypto 2024-09-12T17:17:19.819 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 finisher 2024-09-12T17:17:19.819 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 reserver 2024-09-12T17:17:19.819 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 heartbeatmap 2024-09-12T17:17:19.819 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 perfcounter 2024-09-12T17:17:19.819 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw 2024-09-12T17:17:19.819 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_sync 2024-09-12T17:17:19.819 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_datacache 2024-09-12T17:17:19.819 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_access 2024-09-12T17:17:19.820 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:17:19.820 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_flight 2024-09-12T17:17:19.820 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:17:19.820 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw_notification 2024-09-12T17:17:19.820 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 javaclient 2024-09-12T17:17:19.820 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 asok 2024-09-12T17:17:19.820 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 throttle 2024-09-12T17:17:19.820 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 refs 2024-09-12T17:17:19.820 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 compressor 2024-09-12T17:17:19.820 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluestore 2024-09-12T17:17:19.820 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluefs 2024-09-12T17:17:19.820 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 bdev 2024-09-12T17:17:19.820 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 kstore 2024-09-12T17:17:19.820 INFO:tasks.workunit.client.0.smithi016.stderr: 4/ 5 rocksdb 2024-09-12T17:17:19.821 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 fuse 2024-09-12T17:17:19.821 INFO:tasks.workunit.client.0.smithi016.stderr: 2/ 5 mgr 2024-09-12T17:17:19.821 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mgrc 2024-09-12T17:17:19.821 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 dpdk 2024-09-12T17:17:19.821 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 eventtrace 2024-09-12T17:17:19.821 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 prioritycache 2024-09-12T17:17:19.821 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 test 2024-09-12T17:17:19.821 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:17:19.821 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephsqlite 2024-09-12T17:17:19.821 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:17:19.821 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore 2024-09-12T17:17:19.821 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_onode 2024-09-12T17:17:19.821 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_odata 2024-09-12T17:17:19.821 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_omap 2024-09-12T17:17:19.822 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_tm 2024-09-12T17:17:19.822 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_t 2024-09-12T17:17:19.822 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:17:19.822 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_epm 2024-09-12T17:17:19.822 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_lba 2024-09-12T17:17:19.822 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:17:19.822 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cache 2024-09-12T17:17:19.822 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_journal 2024-09-12T17:17:19.822 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_device 2024-09-12T17:17:19.824 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_backref 2024-09-12T17:17:19.824 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 alienstore 2024-09-12T17:17:19.824 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mclock 2024-09-12T17:17:19.824 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cyanstore 2024-09-12T17:17:19.824 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 ceph_exporter 2024-09-12T17:17:19.824 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 memstore 2024-09-12T17:17:19.825 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 trace 2024-09-12T17:17:19.825 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 ceph_dedup 2024-09-12T17:17:19.825 INFO:tasks.workunit.client.0.smithi016.stderr: -2/-2 (syslog threshold) 2024-09-12T17:17:19.825 INFO:tasks.workunit.client.0.smithi016.stderr: 99/99 (stderr threshold) 2024-09-12T17:17:19.825 INFO:tasks.workunit.client.0.smithi016.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:17:19.825 INFO:tasks.workunit.client.0.smithi016.stderr: 7f5c327fc640 / http_manager 2024-09-12T17:17:19.825 INFO:tasks.workunit.client.0.smithi016.stderr: 7f5c397e2640 / http_manager 2024-09-12T17:17:19.825 INFO:tasks.workunit.client.0.smithi016.stderr: 7f5c3a7e4640 / rgw_dt_lg_renew 2024-09-12T17:17:19.825 INFO:tasks.workunit.client.0.smithi016.stderr: 7f5c657fa640 / ms_dispatch 2024-09-12T17:17:19.825 INFO:tasks.workunit.client.0.smithi016.stderr: 7f5c66ffd640 / io_context_pool 2024-09-12T17:17:19.825 INFO:tasks.workunit.client.0.smithi016.stderr: 7f5c6d602640 / ms_dispatch 2024-09-12T17:17:19.825 INFO:tasks.workunit.client.0.smithi016.stderr: 7f5c6fe07640 / ms_dispatch 2024-09-12T17:17:19.825 INFO:tasks.workunit.client.0.smithi016.stderr: 7f5c7160a640 / io_context_pool 2024-09-12T17:17:19.826 INFO:tasks.workunit.client.0.smithi016.stderr: 7f5d82994640 / msgr-worker-2 2024-09-12T17:17:19.826 INFO:tasks.workunit.client.0.smithi016.stderr: 7f5d83195640 / msgr-worker-1 2024-09-12T17:17:19.826 INFO:tasks.workunit.client.0.smithi016.stderr: 7f5d83996640 / msgr-worker-0 2024-09-12T17:17:19.826 INFO:tasks.workunit.client.0.smithi016.stderr: 7f5d84197640 / io_context_pool 2024-09-12T17:17:19.826 INFO:tasks.workunit.client.0.smithi016.stderr: 7f5d8568f9c0 / radosgw-admin 2024-09-12T17:17:19.826 INFO:tasks.workunit.client.0.smithi016.stderr: max_recent 500 2024-09-12T17:17:19.826 INFO:tasks.workunit.client.0.smithi016.stderr: max_new 1000 2024-09-12T17:17:19.826 INFO:tasks.workunit.client.0.smithi016.stderr: log_file /var/log/ceph/ceph-client.admin.80796.log 2024-09-12T17:17:19.826 INFO:tasks.workunit.client.0.smithi016.stderr:--- end dump of recent events --- 2024-09-12T17:17:19.826 INFO:tasks.workunit.client.0.smithi016.stderr:--- begin dump of recent events --- 2024-09-12T17:17:19.826 INFO:tasks.workunit.client.0.smithi016.stderr: -499> 2024-09-12T17:17:19.421+0000 7f5d8568f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:19.826 INFO:tasks.workunit.client.0.smithi016.stderr: -498> 2024-09-12T17:17:19.421+0000 7f5d8568f9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:17:19.826 INFO:tasks.workunit.client.0.smithi016.stderr: -497> 2024-09-12T17:17:19.421+0000 7f5d8568f9c0 10 monclient(hunting): authenticate will time out at 2157.399086s 2024-09-12T17:17:19.827 INFO:tasks.workunit.client.0.smithi016.stderr: -496> 2024-09-12T17:17:19.421+0000 7f5d83996640 10 monclient(hunting): get_auth_request con 0x56453c87e720 auth_method 0 2024-09-12T17:17:19.827 INFO:tasks.workunit.client.0.smithi016.stderr: -495> 2024-09-12T17:17:19.421+0000 7f5d83996640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:17:19.827 INFO:tasks.workunit.client.0.smithi016.stderr: -494> 2024-09-12T17:17:19.421+0000 7f5d83996640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:17:19.827 INFO:tasks.workunit.client.0.smithi016.stderr: -493> 2024-09-12T17:17:19.421+0000 7f5d83996640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:17:19.827 INFO:tasks.workunit.client.0.smithi016.stderr: -492> 2024-09-12T17:17:19.421+0000 7f5d82994640 10 monclient(hunting): get_auth_request con 0x56453c87b660 auth_method 0 2024-09-12T17:17:19.827 INFO:tasks.workunit.client.0.smithi016.stderr: -491> 2024-09-12T17:17:19.421+0000 7f5d82994640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:17:19.827 INFO:tasks.workunit.client.0.smithi016.stderr: -490> 2024-09-12T17:17:19.421+0000 7f5d82994640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:17:19.827 INFO:tasks.workunit.client.0.smithi016.stderr: -489> 2024-09-12T17:17:19.421+0000 7f5d82994640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:17:19.827 INFO:tasks.workunit.client.0.smithi016.stderr: -488> 2024-09-12T17:17:19.421+0000 7f5d83996640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:17:19.827 INFO:tasks.workunit.client.0.smithi016.stderr: -487> 2024-09-12T17:17:19.421+0000 7f5d83996640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:17:19.827 INFO:tasks.workunit.client.0.smithi016.stderr: -486> 2024-09-12T17:17:19.421+0000 7f5d83996640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:17:19.827 INFO:tasks.workunit.client.0.smithi016.stderr: -485> 2024-09-12T17:17:19.421+0000 7f5d82994640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:17:19.827 INFO:tasks.workunit.client.0.smithi016.stderr: -484> 2024-09-12T17:17:19.421+0000 7f5d82994640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:17:19.828 INFO:tasks.workunit.client.0.smithi016.stderr: -483> 2024-09-12T17:17:19.421+0000 7f5d82994640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:17:19.828 INFO:tasks.workunit.client.0.smithi016.stderr: -482> 2024-09-12T17:17:19.421+0000 7f5d82994640 10 monclient(hunting): handle_auth_done global_id 6306 payload 274 2024-09-12T17:17:19.828 INFO:tasks.workunit.client.0.smithi016.stderr: -481> 2024-09-12T17:17:19.421+0000 7f5d82994640 10 monclient: _finish_hunting 0 2024-09-12T17:17:19.828 INFO:tasks.workunit.client.0.smithi016.stderr: -480> 2024-09-12T17:17:19.421+0000 7f5d82994640 1 monclient: found mon.noname-a 2024-09-12T17:17:19.828 INFO:tasks.workunit.client.0.smithi016.stderr: -479> 2024-09-12T17:17:19.421+0000 7f5d82994640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:17:19.828 INFO:tasks.workunit.client.0.smithi016.stderr: -478> 2024-09-12T17:17:19.421+0000 7f5d83195640 10 monclient: get_auth_request con 0x56453c7f15b0 auth_method 0 2024-09-12T17:17:19.828 INFO:tasks.workunit.client.0.smithi016.stderr: -477> 2024-09-12T17:17:19.425+0000 7f5c7160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:17:19.828 INFO:tasks.workunit.client.0.smithi016.stderr: -476> 2024-09-12T17:17:19.425+0000 7f5c7160a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:17:19.828 INFO:tasks.workunit.client.0.smithi016.stderr: -475> 2024-09-12T17:17:19.425+0000 7f5c7160a640 10 monclient: dump: 2024-09-12T17:17:19.828 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:17:19.828 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:17:19.828 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:19.829 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:19.829 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:17:19.829 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:19.829 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:17:19.829 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:17:19.829 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:17:19.829 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:19.829 INFO:tasks.workunit.client.0.smithi016.stderr: -474> 2024-09-12T17:17:19.425+0000 7f5c7160a640 10 monclient: _finish_auth 0 2024-09-12T17:17:19.829 INFO:tasks.workunit.client.0.smithi016.stderr: -473> 2024-09-12T17:17:19.425+0000 7f5c7160a640 10 monclient: _check_auth_tickets 2024-09-12T17:17:19.829 INFO:tasks.workunit.client.0.smithi016.stderr: -472> 2024-09-12T17:17:19.425+0000 7f5c7160a640 10 monclient: handle_config config(0 keys) 2024-09-12T17:17:19.829 INFO:tasks.workunit.client.0.smithi016.stderr: -471> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 monclient: authenticate success, global_id 6306 2024-09-12T17:17:19.829 INFO:tasks.workunit.client.0.smithi016.stderr: -470> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 10 monclient: get_monmap_and_config success 2024-09-12T17:17:19.829 INFO:tasks.workunit.client.0.smithi016.stderr: -469> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 4 set_mon_vals no callback set 2024-09-12T17:17:19.830 INFO:tasks.workunit.client.0.smithi016.stderr: -468> 2024-09-12T17:17:19.425+0000 7f5c7160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:17:19.830 INFO:tasks.workunit.client.0.smithi016.stderr: -467> 2024-09-12T17:17:19.425+0000 7f5c7160a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:17:19.830 INFO:tasks.workunit.client.0.smithi016.stderr: -466> 2024-09-12T17:17:19.425+0000 7f5c7160a640 10 monclient: dump: 2024-09-12T17:17:19.830 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:17:19.830 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:17:19.831 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:19.831 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:19.831 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:17:19.831 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:19.831 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:17:19.831 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:17:19.831 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:17:19.831 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:19.831 INFO:tasks.workunit.client.0.smithi016.stderr: -465> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 10 monclient: shutdown 2024-09-12T17:17:19.831 INFO:tasks.workunit.client.0.smithi016.stderr: -464> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 asok(0x56453c7292b0) unregister_commands rotate-key 2024-09-12T17:17:19.832 INFO:tasks.workunit.client.0.smithi016.stderr: -463> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 10 monclient: build_initial_monmap 2024-09-12T17:17:19.832 INFO:tasks.workunit.client.0.smithi016.stderr: -462> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 1 build_initial for_mkfs: 0 2024-09-12T17:17:19.832 INFO:tasks.workunit.client.0.smithi016.stderr: -461> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 10 monclient: monmap: 2024-09-12T17:17:19.832 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:17:19.832 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:17:19.832 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:17:19.832 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:17:19.832 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:17:19.832 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:19.832 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:17:19.832 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:17:19.832 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:17:19.832 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:19.833 INFO:tasks.workunit.client.0.smithi016.stderr: -460> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c93b4f0) adding auth protocol: cephx 2024-09-12T17:17:19.833 INFO:tasks.workunit.client.0.smithi016.stderr: -459> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c93b4f0) adding auth protocol: cephx 2024-09-12T17:17:19.833 INFO:tasks.workunit.client.0.smithi016.stderr: -458> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c93b4f0) adding auth protocol: cephx 2024-09-12T17:17:19.833 INFO:tasks.workunit.client.0.smithi016.stderr: -457> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c93b4f0) adding con mode: secure 2024-09-12T17:17:19.833 INFO:tasks.workunit.client.0.smithi016.stderr: -456> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c93b4f0) adding con mode: crc 2024-09-12T17:17:19.833 INFO:tasks.workunit.client.0.smithi016.stderr: -455> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c93b4f0) adding con mode: secure 2024-09-12T17:17:19.833 INFO:tasks.workunit.client.0.smithi016.stderr: -454> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c93b4f0) adding con mode: crc 2024-09-12T17:17:19.833 INFO:tasks.workunit.client.0.smithi016.stderr: -453> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c93b4f0) adding con mode: secure 2024-09-12T17:17:19.833 INFO:tasks.workunit.client.0.smithi016.stderr: -452> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c93b4f0) adding con mode: crc 2024-09-12T17:17:19.833 INFO:tasks.workunit.client.0.smithi016.stderr: -451> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c93b4f0) adding con mode: crc 2024-09-12T17:17:19.833 INFO:tasks.workunit.client.0.smithi016.stderr: -450> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c93b4f0) adding con mode: secure 2024-09-12T17:17:19.833 INFO:tasks.workunit.client.0.smithi016.stderr: -449> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c93b4f0) adding con mode: crc 2024-09-12T17:17:19.833 INFO:tasks.workunit.client.0.smithi016.stderr: -448> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c93b4f0) adding con mode: secure 2024-09-12T17:17:19.834 INFO:tasks.workunit.client.0.smithi016.stderr: -447> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c93b4f0) adding con mode: crc 2024-09-12T17:17:19.834 INFO:tasks.workunit.client.0.smithi016.stderr: -446> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c93b4f0) adding con mode: secure 2024-09-12T17:17:19.834 INFO:tasks.workunit.client.0.smithi016.stderr: -445> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:19.834 INFO:tasks.workunit.client.0.smithi016.stderr: -444> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 1 librados: starting msgr at 2024-09-12T17:17:19.834 INFO:tasks.workunit.client.0.smithi016.stderr: -443> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 1 librados: starting objecter 2024-09-12T17:17:19.834 INFO:tasks.workunit.client.0.smithi016.stderr: -442> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 asok(0x56453c7292b0) register_command objecter_requests hook 0x56453c6a30e0 2024-09-12T17:17:19.834 INFO:tasks.workunit.client.0.smithi016.stderr: -441> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 1 librados: setting wanted keys 2024-09-12T17:17:19.834 INFO:tasks.workunit.client.0.smithi016.stderr: -440> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 1 librados: calling monclient init 2024-09-12T17:17:19.834 INFO:tasks.workunit.client.0.smithi016.stderr: -439> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 10 monclient: init 2024-09-12T17:17:19.835 INFO:tasks.workunit.client.0.smithi016.stderr: -438> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c935eb0) adding auth protocol: cephx 2024-09-12T17:17:19.835 INFO:tasks.workunit.client.0.smithi016.stderr: -437> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c935eb0) adding auth protocol: cephx 2024-09-12T17:17:19.835 INFO:tasks.workunit.client.0.smithi016.stderr: -436> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c935eb0) adding auth protocol: cephx 2024-09-12T17:17:19.835 INFO:tasks.workunit.client.0.smithi016.stderr: -435> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c935eb0) adding con mode: secure 2024-09-12T17:17:19.835 INFO:tasks.workunit.client.0.smithi016.stderr: -434> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c935eb0) adding con mode: crc 2024-09-12T17:17:19.835 INFO:tasks.workunit.client.0.smithi016.stderr: -433> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c935eb0) adding con mode: secure 2024-09-12T17:17:19.835 INFO:tasks.workunit.client.0.smithi016.stderr: -432> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c935eb0) adding con mode: crc 2024-09-12T17:17:19.835 INFO:tasks.workunit.client.0.smithi016.stderr: -431> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c935eb0) adding con mode: secure 2024-09-12T17:17:19.835 INFO:tasks.workunit.client.0.smithi016.stderr: -430> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c935eb0) adding con mode: crc 2024-09-12T17:17:19.835 INFO:tasks.workunit.client.0.smithi016.stderr: -429> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c935eb0) adding con mode: crc 2024-09-12T17:17:19.835 INFO:tasks.workunit.client.0.smithi016.stderr: -428> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c935eb0) adding con mode: secure 2024-09-12T17:17:19.835 INFO:tasks.workunit.client.0.smithi016.stderr: -427> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c935eb0) adding con mode: crc 2024-09-12T17:17:19.836 INFO:tasks.workunit.client.0.smithi016.stderr: -426> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c935eb0) adding con mode: secure 2024-09-12T17:17:19.836 INFO:tasks.workunit.client.0.smithi016.stderr: -425> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c935eb0) adding con mode: crc 2024-09-12T17:17:19.836 INFO:tasks.workunit.client.0.smithi016.stderr: -424> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c935eb0) adding con mode: secure 2024-09-12T17:17:19.836 INFO:tasks.workunit.client.0.smithi016.stderr: -423> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:19.836 INFO:tasks.workunit.client.0.smithi016.stderr: -422> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:19.836 INFO:tasks.workunit.client.0.smithi016.stderr: -421> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 asok(0x56453c7292b0) register_command rotate-key hook 0x56453c935ff8 2024-09-12T17:17:19.836 INFO:tasks.workunit.client.0.smithi016.stderr: -420> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:17:19.836 INFO:tasks.workunit.client.0.smithi016.stderr: -419> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:17:19.836 INFO:tasks.workunit.client.0.smithi016.stderr: -418> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 10 monclient(hunting): picked mon.noname-a con 0x56453c7f15b0 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:17:19.836 INFO:tasks.workunit.client.0.smithi016.stderr: -417> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 10 monclient(hunting): picked mon.noname-b con 0x56453c87b660 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:17:19.836 INFO:tasks.workunit.client.0.smithi016.stderr: -416> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 10 monclient(hunting): picked mon.noname-c con 0x56453c87e720 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:17:19.836 INFO:tasks.workunit.client.0.smithi016.stderr: -415> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:19.836 INFO:tasks.workunit.client.0.smithi016.stderr: -414> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:19.837 INFO:tasks.workunit.client.0.smithi016.stderr: -413> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:19.837 INFO:tasks.workunit.client.0.smithi016.stderr: -412> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:17:19.837 INFO:tasks.workunit.client.0.smithi016.stderr: -411> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 10 monclient(hunting): authenticate will time out at 2157.402120s 2024-09-12T17:17:19.837 INFO:tasks.workunit.client.0.smithi016.stderr: -410> 2024-09-12T17:17:19.425+0000 7f5d83195640 10 monclient(hunting): get_auth_request con 0x56453c7f15b0 auth_method 0 2024-09-12T17:17:19.837 INFO:tasks.workunit.client.0.smithi016.stderr: -409> 2024-09-12T17:17:19.425+0000 7f5d83195640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:17:19.837 INFO:tasks.workunit.client.0.smithi016.stderr: -408> 2024-09-12T17:17:19.425+0000 7f5d83195640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:17:19.837 INFO:tasks.workunit.client.0.smithi016.stderr: -407> 2024-09-12T17:17:19.425+0000 7f5d83195640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:17:19.837 INFO:tasks.workunit.client.0.smithi016.stderr: -406> 2024-09-12T17:17:19.425+0000 7f5d83996640 10 monclient(hunting): get_auth_request con 0x56453c87e720 auth_method 0 2024-09-12T17:17:19.837 INFO:tasks.workunit.client.0.smithi016.stderr: -405> 2024-09-12T17:17:19.425+0000 7f5d83996640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:17:19.837 INFO:tasks.workunit.client.0.smithi016.stderr: -404> 2024-09-12T17:17:19.425+0000 7f5d83996640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:17:19.837 INFO:tasks.workunit.client.0.smithi016.stderr: -403> 2024-09-12T17:17:19.425+0000 7f5d83996640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:17:19.837 INFO:tasks.workunit.client.0.smithi016.stderr: -402> 2024-09-12T17:17:19.425+0000 7f5d83195640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:17:19.837 INFO:tasks.workunit.client.0.smithi016.stderr: -401> 2024-09-12T17:17:19.425+0000 7f5d83195640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:17:19.837 INFO:tasks.workunit.client.0.smithi016.stderr: -400> 2024-09-12T17:17:19.425+0000 7f5d83195640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:17:19.838 INFO:tasks.workunit.client.0.smithi016.stderr: -399> 2024-09-12T17:17:19.425+0000 7f5d83996640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:17:19.838 INFO:tasks.workunit.client.0.smithi016.stderr: -398> 2024-09-12T17:17:19.425+0000 7f5d83996640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:17:19.838 INFO:tasks.workunit.client.0.smithi016.stderr: -397> 2024-09-12T17:17:19.425+0000 7f5d83996640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:17:19.838 INFO:tasks.workunit.client.0.smithi016.stderr: -396> 2024-09-12T17:17:19.425+0000 7f5d83195640 10 monclient(hunting): handle_auth_done global_id 6309 payload 824 2024-09-12T17:17:19.838 INFO:tasks.workunit.client.0.smithi016.stderr: -395> 2024-09-12T17:17:19.425+0000 7f5d83195640 10 monclient: _finish_hunting 0 2024-09-12T17:17:19.838 INFO:tasks.workunit.client.0.smithi016.stderr: -394> 2024-09-12T17:17:19.425+0000 7f5d83195640 1 monclient: found mon.noname-a 2024-09-12T17:17:19.838 INFO:tasks.workunit.client.0.smithi016.stderr: -393> 2024-09-12T17:17:19.425+0000 7f5d83195640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:17:19.838 INFO:tasks.workunit.client.0.smithi016.stderr: -392> 2024-09-12T17:17:19.425+0000 7f5d82994640 10 monclient: get_auth_request con 0x56453c87b660 auth_method 0 2024-09-12T17:17:19.838 INFO:tasks.workunit.client.0.smithi016.stderr: -391> 2024-09-12T17:17:19.425+0000 7f5c6fe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:17:19.838 INFO:tasks.workunit.client.0.smithi016.stderr: -390> 2024-09-12T17:17:19.425+0000 7f5c6fe07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:17:19.838 INFO:tasks.workunit.client.0.smithi016.stderr: -389> 2024-09-12T17:17:19.425+0000 7f5c6fe07640 10 monclient: dump: 2024-09-12T17:17:19.838 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:17:19.838 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:17:19.839 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:19.839 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:19.839 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:17:19.839 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:19.839 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:17:19.839 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:17:19.839 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:17:19.839 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:19.839 INFO:tasks.workunit.client.0.smithi016.stderr: -388> 2024-09-12T17:17:19.425+0000 7f5c6fe07640 10 monclient: _finish_auth 0 2024-09-12T17:17:19.839 INFO:tasks.workunit.client.0.smithi016.stderr: -387> 2024-09-12T17:17:19.425+0000 7f5c6fe07640 10 monclient: _check_auth_tickets 2024-09-12T17:17:19.839 INFO:tasks.workunit.client.0.smithi016.stderr: -386> 2024-09-12T17:17:19.425+0000 7f5c6fe07640 10 monclient: handle_config config(0 keys) 2024-09-12T17:17:19.839 INFO:tasks.workunit.client.0.smithi016.stderr: -385> 2024-09-12T17:17:19.425+0000 7f5c6fe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:17:19.839 INFO:tasks.workunit.client.0.smithi016.stderr: -384> 2024-09-12T17:17:19.425+0000 7f5c6fe07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:17:19.840 INFO:tasks.workunit.client.0.smithi016.stderr: -383> 2024-09-12T17:17:19.425+0000 7f5c6fe07640 10 monclient: dump: 2024-09-12T17:17:19.840 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:17:19.840 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:17:19.840 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:19.840 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:19.840 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:17:19.840 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:19.840 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:17:19.840 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:17:19.840 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:17:19.840 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:19.840 INFO:tasks.workunit.client.0.smithi016.stderr: -382> 2024-09-12T17:17:19.425+0000 7f5c7160a640 4 set_mon_vals no callback set 2024-09-12T17:17:19.840 INFO:tasks.workunit.client.0.smithi016.stderr: -381> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 5 monclient: authenticate success, global_id 6309 2024-09-12T17:17:19.841 INFO:tasks.workunit.client.0.smithi016.stderr: -380> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 10 monclient: _renew_subs 2024-09-12T17:17:19.841 INFO:tasks.workunit.client.0.smithi016.stderr: -379> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:17:19.841 INFO:tasks.workunit.client.0.smithi016.stderr: -378> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 10 monclient: _renew_subs 2024-09-12T17:17:19.841 INFO:tasks.workunit.client.0.smithi016.stderr: -377> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:17:19.841 INFO:tasks.workunit.client.0.smithi016.stderr: -376> 2024-09-12T17:17:19.425+0000 7f5d8568f9c0 1 librados: init done 2024-09-12T17:17:19.841 INFO:tasks.workunit.client.0.smithi016.stderr: -375> 2024-09-12T17:17:19.429+0000 7f5c6fe07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:17:19.841 INFO:tasks.workunit.client.0.smithi016.stderr: -374> 2024-09-12T17:17:19.429+0000 7f5c6fe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:17:19.841 INFO:tasks.workunit.client.0.smithi016.stderr: -373> 2024-09-12T17:17:19.429+0000 7f5c6fe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:17:19.841 INFO:tasks.workunit.client.0.smithi016.stderr: -372> 2024-09-12T17:17:19.429+0000 7f5d82994640 10 monclient: get_auth_request con 0x7f5c68070ae0 auth_method 0 2024-09-12T17:17:19.841 INFO:tasks.workunit.client.0.smithi016.stderr: -371> 2024-09-12T17:17:19.429+0000 7f5d83996640 10 monclient: get_auth_request con 0x56453c960960 auth_method 0 2024-09-12T17:17:19.841 INFO:tasks.workunit.client.0.smithi016.stderr: -370> 2024-09-12T17:17:19.429+0000 7f5d83195640 10 monclient: get_auth_request con 0x56453c980880 auth_method 0 2024-09-12T17:17:19.841 INFO:tasks.workunit.client.0.smithi016.stderr: -369> 2024-09-12T17:17:19.433+0000 7f5d82994640 10 monclient: get_auth_request con 0x56453c984f20 auth_method 0 2024-09-12T17:17:19.841 INFO:tasks.workunit.client.0.smithi016.stderr: -368> 2024-09-12T17:17:19.433+0000 7f5d83996640 10 monclient: get_auth_request con 0x56453c9845b0 auth_method 0 2024-09-12T17:17:19.842 INFO:tasks.workunit.client.0.smithi016.stderr: -367> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 10 monclient: build_initial_monmap 2024-09-12T17:17:19.842 INFO:tasks.workunit.client.0.smithi016.stderr: -366> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 1 build_initial for_mkfs: 0 2024-09-12T17:17:19.842 INFO:tasks.workunit.client.0.smithi016.stderr: -365> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 10 monclient: monmap: 2024-09-12T17:17:19.842 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:17:19.842 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:17:19.842 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:17:19.842 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:17:19.842 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:17:19.842 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:19.842 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:17:19.842 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:17:19.842 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:17:19.842 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:19.842 INFO:tasks.workunit.client.0.smithi016.stderr: -364> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98cf10) adding auth protocol: cephx 2024-09-12T17:17:19.843 INFO:tasks.workunit.client.0.smithi016.stderr: -363> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98cf10) adding auth protocol: cephx 2024-09-12T17:17:19.843 INFO:tasks.workunit.client.0.smithi016.stderr: -362> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98cf10) adding auth protocol: cephx 2024-09-12T17:17:19.843 INFO:tasks.workunit.client.0.smithi016.stderr: -361> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98cf10) adding con mode: secure 2024-09-12T17:17:19.843 INFO:tasks.workunit.client.0.smithi016.stderr: -360> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98cf10) adding con mode: crc 2024-09-12T17:17:19.843 INFO:tasks.workunit.client.0.smithi016.stderr: -359> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98cf10) adding con mode: secure 2024-09-12T17:17:19.843 INFO:tasks.workunit.client.0.smithi016.stderr: -358> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98cf10) adding con mode: crc 2024-09-12T17:17:19.843 INFO:tasks.workunit.client.0.smithi016.stderr: -357> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98cf10) adding con mode: secure 2024-09-12T17:17:19.843 INFO:tasks.workunit.client.0.smithi016.stderr: -356> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98cf10) adding con mode: crc 2024-09-12T17:17:19.843 INFO:tasks.workunit.client.0.smithi016.stderr: -355> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98cf10) adding con mode: crc 2024-09-12T17:17:19.843 INFO:tasks.workunit.client.0.smithi016.stderr: -354> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98cf10) adding con mode: secure 2024-09-12T17:17:19.843 INFO:tasks.workunit.client.0.smithi016.stderr: -353> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98cf10) adding con mode: crc 2024-09-12T17:17:19.843 INFO:tasks.workunit.client.0.smithi016.stderr: -352> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98cf10) adding con mode: secure 2024-09-12T17:17:19.843 INFO:tasks.workunit.client.0.smithi016.stderr: -351> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98cf10) adding con mode: crc 2024-09-12T17:17:19.844 INFO:tasks.workunit.client.0.smithi016.stderr: -350> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98cf10) adding con mode: secure 2024-09-12T17:17:19.844 INFO:tasks.workunit.client.0.smithi016.stderr: -349> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:19.844 INFO:tasks.workunit.client.0.smithi016.stderr: -348> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 asok(0x56453c7292b0) register_command objecter_requests cmddesc objecter_requests hook 0x56453c9908c0 EEXIST 2024-09-12T17:17:19.844 INFO:tasks.workunit.client.0.smithi016.stderr: -347> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 10 monclient: init 2024-09-12T17:17:19.844 INFO:tasks.workunit.client.0.smithi016.stderr: -346> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98be08) adding auth protocol: cephx 2024-09-12T17:17:19.844 INFO:tasks.workunit.client.0.smithi016.stderr: -345> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98be08) adding auth protocol: cephx 2024-09-12T17:17:19.844 INFO:tasks.workunit.client.0.smithi016.stderr: -344> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98be08) adding auth protocol: cephx 2024-09-12T17:17:19.844 INFO:tasks.workunit.client.0.smithi016.stderr: -343> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98be08) adding con mode: secure 2024-09-12T17:17:19.844 INFO:tasks.workunit.client.0.smithi016.stderr: -342> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98be08) adding con mode: crc 2024-09-12T17:17:19.845 INFO:tasks.workunit.client.0.smithi016.stderr: -341> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98be08) adding con mode: secure 2024-09-12T17:17:19.845 INFO:tasks.workunit.client.0.smithi016.stderr: -340> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98be08) adding con mode: crc 2024-09-12T17:17:19.845 INFO:tasks.workunit.client.0.smithi016.stderr: -339> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98be08) adding con mode: secure 2024-09-12T17:17:19.845 INFO:tasks.workunit.client.0.smithi016.stderr: -338> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98be08) adding con mode: crc 2024-09-12T17:17:19.845 INFO:tasks.workunit.client.0.smithi016.stderr: -337> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98be08) adding con mode: crc 2024-09-12T17:17:19.845 INFO:tasks.workunit.client.0.smithi016.stderr: -336> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98be08) adding con mode: secure 2024-09-12T17:17:19.845 INFO:tasks.workunit.client.0.smithi016.stderr: -335> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98be08) adding con mode: crc 2024-09-12T17:17:19.845 INFO:tasks.workunit.client.0.smithi016.stderr: -334> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98be08) adding con mode: secure 2024-09-12T17:17:19.845 INFO:tasks.workunit.client.0.smithi016.stderr: -333> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98be08) adding con mode: crc 2024-09-12T17:17:19.845 INFO:tasks.workunit.client.0.smithi016.stderr: -332> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c98be08) adding con mode: secure 2024-09-12T17:17:19.845 INFO:tasks.workunit.client.0.smithi016.stderr: -331> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:19.845 INFO:tasks.workunit.client.0.smithi016.stderr: -330> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:19.845 INFO:tasks.workunit.client.0.smithi016.stderr: -329> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 asok(0x56453c7292b0) register_command rotate-key cmddesc rotate-key hook 0x56453c98bf50 EEXIST 2024-09-12T17:17:19.846 INFO:tasks.workunit.client.0.smithi016.stderr: -328> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:17:19.846 INFO:tasks.workunit.client.0.smithi016.stderr: -327> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:17:19.846 INFO:tasks.workunit.client.0.smithi016.stderr: -326> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 10 monclient(hunting): picked mon.noname-c con 0x56453c9b4a70 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:17:19.846 INFO:tasks.workunit.client.0.smithi016.stderr: -325> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 10 monclient(hunting): picked mon.noname-a con 0x56453c9b43a0 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:17:19.846 INFO:tasks.workunit.client.0.smithi016.stderr: -324> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 10 monclient(hunting): picked mon.noname-b con 0x56453c9b2d80 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:17:19.846 INFO:tasks.workunit.client.0.smithi016.stderr: -323> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:19.846 INFO:tasks.workunit.client.0.smithi016.stderr: -322> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:19.846 INFO:tasks.workunit.client.0.smithi016.stderr: -321> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:19.846 INFO:tasks.workunit.client.0.smithi016.stderr: -320> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:17:19.846 INFO:tasks.workunit.client.0.smithi016.stderr: -319> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 10 monclient(hunting): authenticate will time out at 2157.413971s 2024-09-12T17:17:19.846 INFO:tasks.workunit.client.0.smithi016.stderr: -318> 2024-09-12T17:17:19.437+0000 7f5d82994640 10 monclient(hunting): get_auth_request con 0x56453c9b4a70 auth_method 0 2024-09-12T17:17:19.846 INFO:tasks.workunit.client.0.smithi016.stderr: -317> 2024-09-12T17:17:19.437+0000 7f5d82994640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:17:19.846 INFO:tasks.workunit.client.0.smithi016.stderr: -316> 2024-09-12T17:17:19.437+0000 7f5d82994640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:17:19.847 INFO:tasks.workunit.client.0.smithi016.stderr: -315> 2024-09-12T17:17:19.437+0000 7f5d82994640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:17:19.847 INFO:tasks.workunit.client.0.smithi016.stderr: -314> 2024-09-12T17:17:19.437+0000 7f5d83996640 10 monclient(hunting): get_auth_request con 0x56453c9b43a0 auth_method 0 2024-09-12T17:17:19.847 INFO:tasks.workunit.client.0.smithi016.stderr: -313> 2024-09-12T17:17:19.437+0000 7f5d83996640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:17:19.847 INFO:tasks.workunit.client.0.smithi016.stderr: -312> 2024-09-12T17:17:19.437+0000 7f5d83996640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:17:19.847 INFO:tasks.workunit.client.0.smithi016.stderr: -311> 2024-09-12T17:17:19.437+0000 7f5d83996640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:17:19.847 INFO:tasks.workunit.client.0.smithi016.stderr: -310> 2024-09-12T17:17:19.437+0000 7f5d82994640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:17:19.847 INFO:tasks.workunit.client.0.smithi016.stderr: -309> 2024-09-12T17:17:19.437+0000 7f5d82994640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:17:19.847 INFO:tasks.workunit.client.0.smithi016.stderr: -308> 2024-09-12T17:17:19.437+0000 7f5d82994640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:17:19.847 INFO:tasks.workunit.client.0.smithi016.stderr: -307> 2024-09-12T17:17:19.437+0000 7f5d83996640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:17:19.847 INFO:tasks.workunit.client.0.smithi016.stderr: -306> 2024-09-12T17:17:19.437+0000 7f5d83996640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:17:19.847 INFO:tasks.workunit.client.0.smithi016.stderr: -305> 2024-09-12T17:17:19.437+0000 7f5d83996640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:17:19.847 INFO:tasks.workunit.client.0.smithi016.stderr: -304> 2024-09-12T17:17:19.437+0000 7f5d82994640 10 monclient(hunting): handle_auth_done global_id 6056 payload 824 2024-09-12T17:17:19.847 INFO:tasks.workunit.client.0.smithi016.stderr: -303> 2024-09-12T17:17:19.437+0000 7f5d82994640 10 monclient: _finish_hunting 0 2024-09-12T17:17:19.847 INFO:tasks.workunit.client.0.smithi016.stderr: -302> 2024-09-12T17:17:19.437+0000 7f5d82994640 1 monclient: found mon.noname-c 2024-09-12T17:17:19.848 INFO:tasks.workunit.client.0.smithi016.stderr: -301> 2024-09-12T17:17:19.437+0000 7f5d82994640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:17:19.848 INFO:tasks.workunit.client.0.smithi016.stderr: -300> 2024-09-12T17:17:19.437+0000 7f5c6d602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:17:19.848 INFO:tasks.workunit.client.0.smithi016.stderr: -299> 2024-09-12T17:17:19.437+0000 7f5c6d602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:17:19.848 INFO:tasks.workunit.client.0.smithi016.stderr: -298> 2024-09-12T17:17:19.437+0000 7f5c6d602640 10 monclient: dump: 2024-09-12T17:17:19.848 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:17:19.848 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:17:19.848 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:19.848 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:19.848 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:17:19.848 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:19.848 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:17:19.848 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:17:19.848 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:17:19.849 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:19.849 INFO:tasks.workunit.client.0.smithi016.stderr: -297> 2024-09-12T17:17:19.437+0000 7f5c6d602640 10 monclient: _finish_auth 0 2024-09-12T17:17:19.849 INFO:tasks.workunit.client.0.smithi016.stderr: -296> 2024-09-12T17:17:19.437+0000 7f5c6d602640 10 monclient: _check_auth_tickets 2024-09-12T17:17:19.849 INFO:tasks.workunit.client.0.smithi016.stderr: -295> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 5 monclient: authenticate success, global_id 6056 2024-09-12T17:17:19.849 INFO:tasks.workunit.client.0.smithi016.stderr: -294> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 10 monclient: _renew_subs 2024-09-12T17:17:19.849 INFO:tasks.workunit.client.0.smithi016.stderr: -293> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:17:19.849 INFO:tasks.workunit.client.0.smithi016.stderr: -292> 2024-09-12T17:17:19.437+0000 7f5c6d602640 10 monclient: handle_config config(0 keys) 2024-09-12T17:17:19.849 INFO:tasks.workunit.client.0.smithi016.stderr: -291> 2024-09-12T17:17:19.437+0000 7f5c6d602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:17:19.849 INFO:tasks.workunit.client.0.smithi016.stderr: -290> 2024-09-12T17:17:19.437+0000 7f5c6d602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:17:19.849 INFO:tasks.workunit.client.0.smithi016.stderr: -289> 2024-09-12T17:17:19.437+0000 7f5c6d602640 10 monclient: dump: 2024-09-12T17:17:19.849 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:17:19.849 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:17:19.849 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:19.850 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:19.850 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:17:19.850 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:19.850 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:17:19.850 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:17:19.850 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:17:19.850 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:19.850 INFO:tasks.workunit.client.0.smithi016.stderr: -288> 2024-09-12T17:17:19.437+0000 7f5d84197640 4 set_mon_vals no callback set 2024-09-12T17:17:19.850 INFO:tasks.workunit.client.0.smithi016.stderr: -287> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 10 monclient: _renew_subs 2024-09-12T17:17:19.850 INFO:tasks.workunit.client.0.smithi016.stderr: -286> 2024-09-12T17:17:19.437+0000 7f5d8568f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:17:19.850 INFO:tasks.workunit.client.0.smithi016.stderr: -285> 2024-09-12T17:17:19.441+0000 7f5c6d602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:17:19.850 INFO:tasks.workunit.client.0.smithi016.stderr: -284> 2024-09-12T17:17:19.441+0000 7f5c6d602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:17:19.850 INFO:tasks.workunit.client.0.smithi016.stderr: -283> 2024-09-12T17:17:19.441+0000 7f5c6d602640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:17:19.851 INFO:tasks.workunit.client.0.smithi016.stderr: -282> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 10 monclient: get_monmap_and_config 2024-09-12T17:17:19.851 INFO:tasks.workunit.client.0.smithi016.stderr: -281> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 10 monclient: build_initial_monmap 2024-09-12T17:17:19.851 INFO:tasks.workunit.client.0.smithi016.stderr: -280> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 1 build_initial for_mkfs: 0 2024-09-12T17:17:19.851 INFO:tasks.workunit.client.0.smithi016.stderr: -279> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 10 monclient: monmap: 2024-09-12T17:17:19.851 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:17:19.851 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:17:19.851 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:17:19.851 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:17:19.851 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:17:19.851 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:19.851 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:17:19.851 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:17:19.851 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:17:19.851 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:19.852 INFO:tasks.workunit.client.0.smithi016.stderr: -278> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9d4400) adding auth protocol: cephx 2024-09-12T17:17:19.852 INFO:tasks.workunit.client.0.smithi016.stderr: -277> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9d4400) adding auth protocol: cephx 2024-09-12T17:17:19.852 INFO:tasks.workunit.client.0.smithi016.stderr: -276> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9d4400) adding auth protocol: cephx 2024-09-12T17:17:19.852 INFO:tasks.workunit.client.0.smithi016.stderr: -275> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9d4400) adding con mode: secure 2024-09-12T17:17:19.852 INFO:tasks.workunit.client.0.smithi016.stderr: -274> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9d4400) adding con mode: crc 2024-09-12T17:17:19.852 INFO:tasks.workunit.client.0.smithi016.stderr: -273> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9d4400) adding con mode: secure 2024-09-12T17:17:19.852 INFO:tasks.workunit.client.0.smithi016.stderr: -272> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9d4400) adding con mode: crc 2024-09-12T17:17:19.852 INFO:tasks.workunit.client.0.smithi016.stderr: -271> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9d4400) adding con mode: secure 2024-09-12T17:17:19.852 INFO:tasks.workunit.client.0.smithi016.stderr: -270> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9d4400) adding con mode: crc 2024-09-12T17:17:19.852 INFO:tasks.workunit.client.0.smithi016.stderr: -269> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9d4400) adding con mode: crc 2024-09-12T17:17:19.852 INFO:tasks.workunit.client.0.smithi016.stderr: -268> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9d4400) adding con mode: secure 2024-09-12T17:17:19.852 INFO:tasks.workunit.client.0.smithi016.stderr: -267> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9d4400) adding con mode: crc 2024-09-12T17:17:19.853 INFO:tasks.workunit.client.0.smithi016.stderr: -266> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9d4400) adding con mode: secure 2024-09-12T17:17:19.853 INFO:tasks.workunit.client.0.smithi016.stderr: -265> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9d4400) adding con mode: crc 2024-09-12T17:17:19.853 INFO:tasks.workunit.client.0.smithi016.stderr: -264> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9d4400) adding con mode: secure 2024-09-12T17:17:19.853 INFO:tasks.workunit.client.0.smithi016.stderr: -263> 2024-09-12T17:17:19.441+0000 7f5d83996640 10 monclient: get_auth_request con 0x7f5c5c070a20 auth_method 0 2024-09-12T17:17:19.853 INFO:tasks.workunit.client.0.smithi016.stderr: -262> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:19.853 INFO:tasks.workunit.client.0.smithi016.stderr: -261> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 10 monclient: init 2024-09-12T17:17:19.853 INFO:tasks.workunit.client.0.smithi016.stderr: -260> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95cf40) adding auth protocol: cephx 2024-09-12T17:17:19.853 INFO:tasks.workunit.client.0.smithi016.stderr: -259> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95cf40) adding auth protocol: cephx 2024-09-12T17:17:19.853 INFO:tasks.workunit.client.0.smithi016.stderr: -258> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95cf40) adding auth protocol: cephx 2024-09-12T17:17:19.853 INFO:tasks.workunit.client.0.smithi016.stderr: -257> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95cf40) adding con mode: secure 2024-09-12T17:17:19.853 INFO:tasks.workunit.client.0.smithi016.stderr: -256> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95cf40) adding con mode: crc 2024-09-12T17:17:19.853 INFO:tasks.workunit.client.0.smithi016.stderr: -255> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95cf40) adding con mode: secure 2024-09-12T17:17:19.853 INFO:tasks.workunit.client.0.smithi016.stderr: -254> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95cf40) adding con mode: crc 2024-09-12T17:17:19.854 INFO:tasks.workunit.client.0.smithi016.stderr: -253> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95cf40) adding con mode: secure 2024-09-12T17:17:19.854 INFO:tasks.workunit.client.0.smithi016.stderr: -252> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95cf40) adding con mode: crc 2024-09-12T17:17:19.854 INFO:tasks.workunit.client.0.smithi016.stderr: -251> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95cf40) adding con mode: crc 2024-09-12T17:17:19.854 INFO:tasks.workunit.client.0.smithi016.stderr: -250> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95cf40) adding con mode: secure 2024-09-12T17:17:19.854 INFO:tasks.workunit.client.0.smithi016.stderr: -249> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95cf40) adding con mode: crc 2024-09-12T17:17:19.854 INFO:tasks.workunit.client.0.smithi016.stderr: -248> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95cf40) adding con mode: secure 2024-09-12T17:17:19.854 INFO:tasks.workunit.client.0.smithi016.stderr: -247> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95cf40) adding con mode: crc 2024-09-12T17:17:19.854 INFO:tasks.workunit.client.0.smithi016.stderr: -246> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95cf40) adding con mode: secure 2024-09-12T17:17:19.854 INFO:tasks.workunit.client.0.smithi016.stderr: -245> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:19.854 INFO:tasks.workunit.client.0.smithi016.stderr: -244> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:19.854 INFO:tasks.workunit.client.0.smithi016.stderr: -243> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 asok(0x56453c7292b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd7e95d088 EEXIST 2024-09-12T17:17:19.854 INFO:tasks.workunit.client.0.smithi016.stderr: -242> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:17:19.854 INFO:tasks.workunit.client.0.smithi016.stderr: -241> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:17:19.854 INFO:tasks.workunit.client.0.smithi016.stderr: -240> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 10 monclient(hunting): picked mon.noname-c con 0x56453ca08990 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:17:19.855 INFO:tasks.workunit.client.0.smithi016.stderr: -239> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 10 monclient(hunting): picked mon.noname-a con 0x56453ca02bb0 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:17:19.855 INFO:tasks.workunit.client.0.smithi016.stderr: -238> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 10 monclient(hunting): picked mon.noname-b con 0x56453ca03df0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:17:19.855 INFO:tasks.workunit.client.0.smithi016.stderr: -237> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:19.855 INFO:tasks.workunit.client.0.smithi016.stderr: -236> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:19.855 INFO:tasks.workunit.client.0.smithi016.stderr: -235> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:19.855 INFO:tasks.workunit.client.0.smithi016.stderr: -234> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:17:19.855 INFO:tasks.workunit.client.0.smithi016.stderr: -233> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 10 monclient(hunting): authenticate will time out at 2157.418162s 2024-09-12T17:17:19.855 INFO:tasks.workunit.client.0.smithi016.stderr: -232> 2024-09-12T17:17:19.441+0000 7f5d82994640 10 monclient(hunting): get_auth_request con 0x56453ca08990 auth_method 0 2024-09-12T17:17:19.855 INFO:tasks.workunit.client.0.smithi016.stderr: -231> 2024-09-12T17:17:19.441+0000 7f5d82994640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:17:19.855 INFO:tasks.workunit.client.0.smithi016.stderr: -230> 2024-09-12T17:17:19.441+0000 7f5d82994640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:17:19.855 INFO:tasks.workunit.client.0.smithi016.stderr: -229> 2024-09-12T17:17:19.441+0000 7f5d82994640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:17:19.855 INFO:tasks.workunit.client.0.smithi016.stderr: -228> 2024-09-12T17:17:19.441+0000 7f5d83996640 10 monclient(hunting): get_auth_request con 0x56453ca02bb0 auth_method 0 2024-09-12T17:17:19.855 INFO:tasks.workunit.client.0.smithi016.stderr: -227> 2024-09-12T17:17:19.441+0000 7f5d83996640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:17:19.856 INFO:tasks.workunit.client.0.smithi016.stderr: -226> 2024-09-12T17:17:19.441+0000 7f5d83996640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:17:19.856 INFO:tasks.workunit.client.0.smithi016.stderr: -225> 2024-09-12T17:17:19.441+0000 7f5d83996640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:17:19.856 INFO:tasks.workunit.client.0.smithi016.stderr: -224> 2024-09-12T17:17:19.441+0000 7f5d82994640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:17:19.856 INFO:tasks.workunit.client.0.smithi016.stderr: -223> 2024-09-12T17:17:19.441+0000 7f5d82994640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:17:19.856 INFO:tasks.workunit.client.0.smithi016.stderr: -222> 2024-09-12T17:17:19.441+0000 7f5d82994640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:17:19.856 INFO:tasks.workunit.client.0.smithi016.stderr: -221> 2024-09-12T17:17:19.441+0000 7f5d83996640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:17:19.856 INFO:tasks.workunit.client.0.smithi016.stderr: -220> 2024-09-12T17:17:19.441+0000 7f5d83996640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:17:19.856 INFO:tasks.workunit.client.0.smithi016.stderr: -219> 2024-09-12T17:17:19.441+0000 7f5d83996640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:17:19.856 INFO:tasks.workunit.client.0.smithi016.stderr: -218> 2024-09-12T17:17:19.441+0000 7f5d82994640 10 monclient(hunting): handle_auth_done global_id 6059 payload 274 2024-09-12T17:17:19.856 INFO:tasks.workunit.client.0.smithi016.stderr: -217> 2024-09-12T17:17:19.441+0000 7f5d82994640 10 monclient: _finish_hunting 0 2024-09-12T17:17:19.856 INFO:tasks.workunit.client.0.smithi016.stderr: -216> 2024-09-12T17:17:19.441+0000 7f5d82994640 1 monclient: found mon.noname-c 2024-09-12T17:17:19.856 INFO:tasks.workunit.client.0.smithi016.stderr: -215> 2024-09-12T17:17:19.441+0000 7f5d82994640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:17:19.857 INFO:tasks.workunit.client.0.smithi016.stderr: -214> 2024-09-12T17:17:19.441+0000 7f5c66ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:17:19.857 INFO:tasks.workunit.client.0.smithi016.stderr: -213> 2024-09-12T17:17:19.441+0000 7f5c66ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:17:19.857 INFO:tasks.workunit.client.0.smithi016.stderr: -212> 2024-09-12T17:17:19.441+0000 7f5c66ffd640 10 monclient: dump: 2024-09-12T17:17:19.857 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:17:19.857 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:17:19.857 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:19.857 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:19.857 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:17:19.857 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:19.857 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:17:19.857 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:17:19.857 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:17:19.858 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:19.858 INFO:tasks.workunit.client.0.smithi016.stderr: -211> 2024-09-12T17:17:19.441+0000 7f5c66ffd640 10 monclient: _finish_auth 0 2024-09-12T17:17:19.858 INFO:tasks.workunit.client.0.smithi016.stderr: -210> 2024-09-12T17:17:19.441+0000 7f5c66ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:17:19.858 INFO:tasks.workunit.client.0.smithi016.stderr: -209> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 monclient: authenticate success, global_id 6059 2024-09-12T17:17:19.858 INFO:tasks.workunit.client.0.smithi016.stderr: -208> 2024-09-12T17:17:19.441+0000 7f5c66ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:17:19.858 INFO:tasks.workunit.client.0.smithi016.stderr: -207> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 10 monclient: get_monmap_and_config success 2024-09-12T17:17:19.858 INFO:tasks.workunit.client.0.smithi016.stderr: -206> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 4 set_mon_vals no callback set 2024-09-12T17:17:19.858 INFO:tasks.workunit.client.0.smithi016.stderr: -205> 2024-09-12T17:17:19.441+0000 7f5c66ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:17:19.858 INFO:tasks.workunit.client.0.smithi016.stderr: -204> 2024-09-12T17:17:19.441+0000 7f5c66ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:17:19.858 INFO:tasks.workunit.client.0.smithi016.stderr: -203> 2024-09-12T17:17:19.441+0000 7f5c66ffd640 10 monclient: dump: 2024-09-12T17:17:19.858 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:17:19.858 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:17:19.859 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:19.859 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:19.859 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:17:19.859 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:19.859 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:17:19.859 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:17:19.859 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:17:19.859 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:19.859 INFO:tasks.workunit.client.0.smithi016.stderr: -202> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 10 monclient: shutdown 2024-09-12T17:17:19.859 INFO:tasks.workunit.client.0.smithi016.stderr: -201> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 10 monclient: build_initial_monmap 2024-09-12T17:17:19.859 INFO:tasks.workunit.client.0.smithi016.stderr: -200> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 1 build_initial for_mkfs: 0 2024-09-12T17:17:19.859 INFO:tasks.workunit.client.0.smithi016.stderr: -199> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 10 monclient: monmap: 2024-09-12T17:17:19.860 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:17:19.860 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:17:19.860 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:17:19.860 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:17:19.860 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:17:19.860 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:19.860 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:17:19.860 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:17:19.860 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:17:19.860 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:19.860 INFO:tasks.workunit.client.0.smithi016.stderr: -198> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453ca04bf0) adding auth protocol: cephx 2024-09-12T17:17:19.860 INFO:tasks.workunit.client.0.smithi016.stderr: -197> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453ca04bf0) adding auth protocol: cephx 2024-09-12T17:17:19.860 INFO:tasks.workunit.client.0.smithi016.stderr: -196> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453ca04bf0) adding auth protocol: cephx 2024-09-12T17:17:19.861 INFO:tasks.workunit.client.0.smithi016.stderr: -195> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453ca04bf0) adding con mode: secure 2024-09-12T17:17:19.861 INFO:tasks.workunit.client.0.smithi016.stderr: -194> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453ca04bf0) adding con mode: crc 2024-09-12T17:17:19.861 INFO:tasks.workunit.client.0.smithi016.stderr: -193> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453ca04bf0) adding con mode: secure 2024-09-12T17:17:19.861 INFO:tasks.workunit.client.0.smithi016.stderr: -192> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453ca04bf0) adding con mode: crc 2024-09-12T17:17:19.861 INFO:tasks.workunit.client.0.smithi016.stderr: -191> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453ca04bf0) adding con mode: secure 2024-09-12T17:17:19.861 INFO:tasks.workunit.client.0.smithi016.stderr: -190> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453ca04bf0) adding con mode: crc 2024-09-12T17:17:19.861 INFO:tasks.workunit.client.0.smithi016.stderr: -189> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453ca04bf0) adding con mode: crc 2024-09-12T17:17:19.861 INFO:tasks.workunit.client.0.smithi016.stderr: -188> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453ca04bf0) adding con mode: secure 2024-09-12T17:17:19.861 INFO:tasks.workunit.client.0.smithi016.stderr: -187> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453ca04bf0) adding con mode: crc 2024-09-12T17:17:19.861 INFO:tasks.workunit.client.0.smithi016.stderr: -186> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453ca04bf0) adding con mode: secure 2024-09-12T17:17:19.861 INFO:tasks.workunit.client.0.smithi016.stderr: -185> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453ca04bf0) adding con mode: crc 2024-09-12T17:17:19.861 INFO:tasks.workunit.client.0.smithi016.stderr: -184> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 5 AuthRegistry(0x56453ca04bf0) adding con mode: secure 2024-09-12T17:17:19.861 INFO:tasks.workunit.client.0.smithi016.stderr: -183> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:19.862 INFO:tasks.workunit.client.0.smithi016.stderr: -182> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 1 librados: starting msgr at 2024-09-12T17:17:19.862 INFO:tasks.workunit.client.0.smithi016.stderr: -181> 2024-09-12T17:17:19.441+0000 7f5d8568f9c0 1 librados: starting objecter 2024-09-12T17:17:19.862 INFO:tasks.workunit.client.0.smithi016.stderr: -180> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 5 asok(0x56453c7292b0) register_command objecter_requests cmddesc objecter_requests hook 0x56453ca03520 EEXIST 2024-09-12T17:17:19.862 INFO:tasks.workunit.client.0.smithi016.stderr: -179> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 1 librados: setting wanted keys 2024-09-12T17:17:19.862 INFO:tasks.workunit.client.0.smithi016.stderr: -178> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 1 librados: calling monclient init 2024-09-12T17:17:19.862 INFO:tasks.workunit.client.0.smithi016.stderr: -177> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 10 monclient: init 2024-09-12T17:17:19.862 INFO:tasks.workunit.client.0.smithi016.stderr: -176> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9b6890) adding auth protocol: cephx 2024-09-12T17:17:19.862 INFO:tasks.workunit.client.0.smithi016.stderr: -175> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9b6890) adding auth protocol: cephx 2024-09-12T17:17:19.862 INFO:tasks.workunit.client.0.smithi016.stderr: -174> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9b6890) adding auth protocol: cephx 2024-09-12T17:17:19.862 INFO:tasks.workunit.client.0.smithi016.stderr: -173> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9b6890) adding con mode: secure 2024-09-12T17:17:19.862 INFO:tasks.workunit.client.0.smithi016.stderr: -172> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9b6890) adding con mode: crc 2024-09-12T17:17:19.862 INFO:tasks.workunit.client.0.smithi016.stderr: -171> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9b6890) adding con mode: secure 2024-09-12T17:17:19.862 INFO:tasks.workunit.client.0.smithi016.stderr: -170> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9b6890) adding con mode: crc 2024-09-12T17:17:19.863 INFO:tasks.workunit.client.0.smithi016.stderr: -169> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9b6890) adding con mode: secure 2024-09-12T17:17:19.863 INFO:tasks.workunit.client.0.smithi016.stderr: -168> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9b6890) adding con mode: crc 2024-09-12T17:17:19.863 INFO:tasks.workunit.client.0.smithi016.stderr: -167> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9b6890) adding con mode: crc 2024-09-12T17:17:19.863 INFO:tasks.workunit.client.0.smithi016.stderr: -166> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9b6890) adding con mode: secure 2024-09-12T17:17:19.863 INFO:tasks.workunit.client.0.smithi016.stderr: -165> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9b6890) adding con mode: crc 2024-09-12T17:17:19.863 INFO:tasks.workunit.client.0.smithi016.stderr: -164> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9b6890) adding con mode: secure 2024-09-12T17:17:19.863 INFO:tasks.workunit.client.0.smithi016.stderr: -163> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9b6890) adding con mode: crc 2024-09-12T17:17:19.863 INFO:tasks.workunit.client.0.smithi016.stderr: -162> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 5 AuthRegistry(0x56453c9b6890) adding con mode: secure 2024-09-12T17:17:19.863 INFO:tasks.workunit.client.0.smithi016.stderr: -161> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:19.863 INFO:tasks.workunit.client.0.smithi016.stderr: -160> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:19.863 INFO:tasks.workunit.client.0.smithi016.stderr: -159> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 5 asok(0x56453c7292b0) register_command rotate-key cmddesc rotate-key hook 0x56453c9b69d8 EEXIST 2024-09-12T17:17:19.863 INFO:tasks.workunit.client.0.smithi016.stderr: -158> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:17:19.864 INFO:tasks.workunit.client.0.smithi016.stderr: -157> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:17:19.864 INFO:tasks.workunit.client.0.smithi016.stderr: -156> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 10 monclient(hunting): picked mon.noname-a con 0x56453ca02bb0 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:17:19.864 INFO:tasks.workunit.client.0.smithi016.stderr: -155> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 10 monclient(hunting): picked mon.noname-c con 0x56453ca03df0 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:17:19.864 INFO:tasks.workunit.client.0.smithi016.stderr: -154> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 10 monclient(hunting): picked mon.noname-b con 0x56453ca08990 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:17:19.864 INFO:tasks.workunit.client.0.smithi016.stderr: -153> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:19.864 INFO:tasks.workunit.client.0.smithi016.stderr: -152> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:19.864 INFO:tasks.workunit.client.0.smithi016.stderr: -151> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:19.864 INFO:tasks.workunit.client.0.smithi016.stderr: -150> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:17:19.864 INFO:tasks.workunit.client.0.smithi016.stderr: -149> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 10 monclient(hunting): authenticate will time out at 2157.420776s 2024-09-12T17:17:19.864 INFO:tasks.workunit.client.0.smithi016.stderr: -148> 2024-09-12T17:17:19.445+0000 7f5d82994640 10 monclient(hunting): get_auth_request con 0x56453ca02bb0 auth_method 0 2024-09-12T17:17:19.864 INFO:tasks.workunit.client.0.smithi016.stderr: -147> 2024-09-12T17:17:19.445+0000 7f5d82994640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:17:19.865 INFO:tasks.workunit.client.0.smithi016.stderr: -146> 2024-09-12T17:17:19.445+0000 7f5d82994640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:17:19.865 INFO:tasks.workunit.client.0.smithi016.stderr: -145> 2024-09-12T17:17:19.445+0000 7f5d82994640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:17:19.865 INFO:tasks.workunit.client.0.smithi016.stderr: -144> 2024-09-12T17:17:19.445+0000 7f5d83996640 10 monclient(hunting): get_auth_request con 0x56453ca03df0 auth_method 0 2024-09-12T17:17:19.865 INFO:tasks.workunit.client.0.smithi016.stderr: -143> 2024-09-12T17:17:19.445+0000 7f5d83996640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:17:19.865 INFO:tasks.workunit.client.0.smithi016.stderr: -142> 2024-09-12T17:17:19.445+0000 7f5d83996640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:17:19.865 INFO:tasks.workunit.client.0.smithi016.stderr: -141> 2024-09-12T17:17:19.445+0000 7f5d83996640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:17:19.865 INFO:tasks.workunit.client.0.smithi016.stderr: -140> 2024-09-12T17:17:19.445+0000 7f5d82994640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:17:19.865 INFO:tasks.workunit.client.0.smithi016.stderr: -139> 2024-09-12T17:17:19.445+0000 7f5d82994640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:17:19.865 INFO:tasks.workunit.client.0.smithi016.stderr: -138> 2024-09-12T17:17:19.445+0000 7f5d82994640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:17:19.865 INFO:tasks.workunit.client.0.smithi016.stderr: -137> 2024-09-12T17:17:19.445+0000 7f5d83996640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:17:19.865 INFO:tasks.workunit.client.0.smithi016.stderr: -136> 2024-09-12T17:17:19.445+0000 7f5d83996640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:17:19.866 INFO:tasks.workunit.client.0.smithi016.stderr: -135> 2024-09-12T17:17:19.445+0000 7f5d83996640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:17:19.866 INFO:tasks.workunit.client.0.smithi016.stderr: -134> 2024-09-12T17:17:19.445+0000 7f5d82994640 10 monclient(hunting): handle_auth_done global_id 6318 payload 824 2024-09-12T17:17:19.866 INFO:tasks.workunit.client.0.smithi016.stderr: -133> 2024-09-12T17:17:19.445+0000 7f5d82994640 10 monclient: _finish_hunting 0 2024-09-12T17:17:19.866 INFO:tasks.workunit.client.0.smithi016.stderr: -132> 2024-09-12T17:17:19.445+0000 7f5d82994640 1 monclient: found mon.noname-a 2024-09-12T17:17:19.866 INFO:tasks.workunit.client.0.smithi016.stderr: -131> 2024-09-12T17:17:19.445+0000 7f5d82994640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:17:19.866 INFO:tasks.workunit.client.0.smithi016.stderr: -130> 2024-09-12T17:17:19.445+0000 7f5c657fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:17:19.866 INFO:tasks.workunit.client.0.smithi016.stderr: -129> 2024-09-12T17:17:19.445+0000 7f5c657fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:17:19.866 INFO:tasks.workunit.client.0.smithi016.stderr: -128> 2024-09-12T17:17:19.445+0000 7f5c657fa640 10 monclient: dump: 2024-09-12T17:17:19.866 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:17:19.866 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:17:19.866 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:19.866 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:19.866 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:17:19.867 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:19.867 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:17:19.867 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:17:19.867 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:17:19.867 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:19.867 INFO:tasks.workunit.client.0.smithi016.stderr: -127> 2024-09-12T17:17:19.445+0000 7f5c657fa640 10 monclient: _finish_auth 0 2024-09-12T17:17:19.867 INFO:tasks.workunit.client.0.smithi016.stderr: -126> 2024-09-12T17:17:19.445+0000 7f5c657fa640 10 monclient: _check_auth_tickets 2024-09-12T17:17:19.867 INFO:tasks.workunit.client.0.smithi016.stderr: -125> 2024-09-12T17:17:19.445+0000 7f5c657fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:17:19.867 INFO:tasks.workunit.client.0.smithi016.stderr: -124> 2024-09-12T17:17:19.445+0000 7f5c657fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:17:19.867 INFO:tasks.workunit.client.0.smithi016.stderr: -123> 2024-09-12T17:17:19.445+0000 7f5c657fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:17:19.867 INFO:tasks.workunit.client.0.smithi016.stderr: -122> 2024-09-12T17:17:19.445+0000 7f5c657fa640 10 monclient: dump: 2024-09-12T17:17:19.867 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:17:19.867 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:17:19.868 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:19.868 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:19.868 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:17:19.868 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:19.868 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:17:19.868 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:17:19.868 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:17:19.868 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:19.868 INFO:tasks.workunit.client.0.smithi016.stderr: -121> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 5 monclient: authenticate success, global_id 6318 2024-09-12T17:17:19.868 INFO:tasks.workunit.client.0.smithi016.stderr: -120> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 10 monclient: _renew_subs 2024-09-12T17:17:19.868 INFO:tasks.workunit.client.0.smithi016.stderr: -119> 2024-09-12T17:17:19.445+0000 7f5c66ffd640 4 set_mon_vals no callback set 2024-09-12T17:17:19.868 INFO:tasks.workunit.client.0.smithi016.stderr: -118> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:17:19.868 INFO:tasks.workunit.client.0.smithi016.stderr: -117> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 10 monclient: _renew_subs 2024-09-12T17:17:19.869 INFO:tasks.workunit.client.0.smithi016.stderr: -116> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:17:19.869 INFO:tasks.workunit.client.0.smithi016.stderr: -115> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 1 librados: init done 2024-09-12T17:17:19.869 INFO:tasks.workunit.client.0.smithi016.stderr: -114> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 5 asok(0x56453c7292b0) register_command cr dump hook 0x56453c9fc618 2024-09-12T17:17:19.869 INFO:tasks.workunit.client.0.smithi016.stderr: -113> 2024-09-12T17:17:19.445+0000 7f5d8568f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.869 INFO:tasks.workunit.client.0.smithi016.stderr: -112> 2024-09-12T17:17:19.445+0000 7f5c657fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:17:19.869 INFO:tasks.workunit.client.0.smithi016.stderr: -111> 2024-09-12T17:17:19.445+0000 7f5c657fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:17:19.869 INFO:tasks.workunit.client.0.smithi016.stderr: -110> 2024-09-12T17:17:19.445+0000 7f5c657fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:17:19.869 INFO:tasks.workunit.client.0.smithi016.stderr: -109> 2024-09-12T17:17:19.449+0000 7f5d83195640 10 monclient: get_auth_request con 0x56453ca21d30 auth_method 0 2024-09-12T17:17:19.869 INFO:tasks.workunit.client.0.smithi016.stderr: -108> 2024-09-12T17:17:19.449+0000 7f5d83996640 10 monclient: get_auth_request con 0x7f5c4c070ae0 auth_method 0 2024-09-12T17:17:19.869 INFO:tasks.workunit.client.0.smithi016.stderr: -107> 2024-09-12T17:17:19.449+0000 7f5d8568f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:19.869 INFO:tasks.workunit.client.0.smithi016.stderr: -106> 2024-09-12T17:17:19.449+0000 7f5d8568f9c0 20 realm 2024-09-12T17:17:19.869 INFO:tasks.workunit.client.0.smithi016.stderr: -105> 2024-09-12T17:17:19.449+0000 7f5d8568f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.869 INFO:tasks.workunit.client.0.smithi016.stderr: -104> 2024-09-12T17:17:19.449+0000 7f5d8568f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:19.870 INFO:tasks.workunit.client.0.smithi016.stderr: -103> 2024-09-12T17:17:19.449+0000 7f5d8568f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:17:19.870 INFO:tasks.workunit.client.0.smithi016.stderr: -102> 2024-09-12T17:17:19.449+0000 7f5d8568f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.870 INFO:tasks.workunit.client.0.smithi016.stderr: -101> 2024-09-12T17:17:19.449+0000 7f5d8568f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:19.870 INFO:tasks.workunit.client.0.smithi016.stderr: -100> 2024-09-12T17:17:19.449+0000 7f5d8568f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.870 INFO:tasks.workunit.client.0.smithi016.stderr: -99> 2024-09-12T17:17:19.449+0000 7f5d82994640 10 monclient: get_auth_request con 0x56453ca26050 auth_method 0 2024-09-12T17:17:19.870 INFO:tasks.workunit.client.0.smithi016.stderr: -98> 2024-09-12T17:17:19.449+0000 7f5d8568f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:19.870 INFO:tasks.workunit.client.0.smithi016.stderr: -97> 2024-09-12T17:17:19.449+0000 7f5d8568f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.870 INFO:tasks.workunit.client.0.smithi016.stderr: -96> 2024-09-12T17:17:19.449+0000 7f5d83996640 10 monclient: get_auth_request con 0x56453ca29790 auth_method 0 2024-09-12T17:17:19.870 INFO:tasks.workunit.client.0.smithi016.stderr: -95> 2024-09-12T17:17:19.453+0000 7f5d8568f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:17:19.870 INFO:tasks.workunit.client.0.smithi016.stderr: -94> 2024-09-12T17:17:19.453+0000 7f5d8568f9c0 20 searching for the correct realm 2024-09-12T17:17:19.870 INFO:tasks.workunit.client.0.smithi016.stderr: -93> 2024-09-12T17:17:19.453+0000 7f5d83195640 10 monclient: get_auth_request con 0x56453ca2e4e0 auth_method 0 2024-09-12T17:17:19.871 INFO:tasks.workunit.client.0.smithi016.stderr: -92> 2024-09-12T17:17:19.453+0000 7f5d82994640 10 monclient: get_auth_request con 0x7f5d740f8110 auth_method 0 2024-09-12T17:17:19.871 INFO:tasks.workunit.client.0.smithi016.stderr: -91> 2024-09-12T17:17:19.453+0000 7f5d83996640 10 monclient: get_auth_request con 0x7f5d780374c0 auth_method 0 2024-09-12T17:17:19.871 INFO:tasks.workunit.client.0.smithi016.stderr: -90> 2024-09-12T17:17:19.457+0000 7f5d83996640 0 -- 172.21.15.16:0/2991639686 >> [v2:172.21.15.19:6800/1509147557,v1:172.21.15.19:6801/1509147557] conn(0x56453ca29790 msgr2=0x56453ca2bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:19.871 INFO:tasks.workunit.client.0.smithi016.stderr: -89> 2024-09-12T17:17:19.457+0000 7f5c657fa640 1 client.6318.objecter ms_handle_reset 0x56453ca29790 session 0x56453ca25870 osd.4 2024-09-12T17:17:19.871 INFO:tasks.workunit.client.0.smithi016.stderr: -88> 2024-09-12T17:17:19.457+0000 7f5c657fa640 10 monclient: _renew_subs 2024-09-12T17:17:19.871 INFO:tasks.workunit.client.0.smithi016.stderr: -87> 2024-09-12T17:17:19.457+0000 7f5c657fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:17:19.871 INFO:tasks.workunit.client.0.smithi016.stderr: -86> 2024-09-12T17:17:19.457+0000 7f5d83996640 10 monclient: get_auth_request con 0x7f5c4c080900 auth_method 0 2024-09-12T17:17:19.871 INFO:tasks.workunit.client.0.smithi016.stderr: -85> 2024-09-12T17:17:19.457+0000 7f5d83195640 10 monclient: get_auth_request con 0x7f5d7c033040 auth_method 0 2024-09-12T17:17:19.871 INFO:tasks.workunit.client.0.smithi016.stderr: -84> 2024-09-12T17:17:19.461+0000 7f5d82994640 10 monclient: get_auth_request con 0x7f5d7c00e040 auth_method 0 2024-09-12T17:17:19.871 INFO:tasks.workunit.client.0.smithi016.stderr: -83> 2024-09-12T17:17:19.461+0000 7f5d82994640 0 -- 172.21.15.16:0/2991639686 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f5d7c00e040 msgr2=0x7f5d7c058900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:17:19.871 INFO:tasks.workunit.client.0.smithi016.stderr: -82> 2024-09-12T17:17:19.665+0000 7f5d82994640 10 monclient: get_auth_request con 0x7f5d7c00e040 auth_method 0 2024-09-12T17:17:19.871 INFO:tasks.workunit.client.0.smithi016.stderr: -81> 2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:17:19.872 INFO:tasks.workunit.client.0.smithi016.stderr: -80> 2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:17:19.872 INFO:tasks.workunit.client.0.smithi016.stderr: -79> 2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:17:19.872 INFO:tasks.workunit.client.0.smithi016.stderr: -78> 2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:17:19.872 INFO:tasks.workunit.client.0.smithi016.stderr: -77> 2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:17:19.872 INFO:tasks.workunit.client.0.smithi016.stderr: -76> 2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:17:19.872 INFO:tasks.workunit.client.0.smithi016.stderr: -75> 2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.872 INFO:tasks.workunit.client.0.smithi016.stderr: -74> 2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:19.872 INFO:tasks.workunit.client.0.smithi016.stderr: -73> 2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.872 INFO:tasks.workunit.client.0.smithi016.stderr: -72> 2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:19.872 INFO:tasks.workunit.client.0.smithi016.stderr: -71> 2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.872 INFO:tasks.workunit.client.0.smithi016.stderr: -70> 2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:17:19.872 INFO:tasks.workunit.client.0.smithi016.stderr: -69> 2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 zone default found 2024-09-12T17:17:19.873 INFO:tasks.workunit.client.0.smithi016.stderr: -68> 2024-09-12T17:17:19.681+0000 7f5d8568f9c0 4 Realm: () 2024-09-12T17:17:19.873 INFO:tasks.workunit.client.0.smithi016.stderr: -67> 2024-09-12T17:17:19.681+0000 7f5d8568f9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:17:19.873 INFO:tasks.workunit.client.0.smithi016.stderr: -66> 2024-09-12T17:17:19.681+0000 7f5d8568f9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:17:19.873 INFO:tasks.workunit.client.0.smithi016.stderr: -65> 2024-09-12T17:17:19.681+0000 7f5d8568f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:17:19.873 INFO:tasks.workunit.client.0.smithi016.stderr: -64> 2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 zonegroup default 2024-09-12T17:17:19.873 INFO:tasks.workunit.client.0.smithi016.stderr: -63> 2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.873 INFO:tasks.workunit.client.0.smithi016.stderr: -62> 2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:19.873 INFO:tasks.workunit.client.0.smithi016.stderr: -61> 2024-09-12T17:17:19.681+0000 7f5d8568f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.873 INFO:tasks.workunit.client.0.smithi016.stderr: -60> 2024-09-12T17:17:19.685+0000 7f5d8568f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:19.873 INFO:tasks.workunit.client.0.smithi016.stderr: -59> 2024-09-12T17:17:19.685+0000 7f5d8568f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.873 INFO:tasks.workunit.client.0.smithi016.stderr: -58> 2024-09-12T17:17:19.685+0000 7f5d8568f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:19.873 INFO:tasks.workunit.client.0.smithi016.stderr: -57> 2024-09-12T17:17:19.685+0000 7f5d8568f9c0 20 started sync module instance, tier type = 2024-09-12T17:17:19.873 INFO:tasks.workunit.client.0.smithi016.stderr: -56> 2024-09-12T17:17:19.685+0000 7f5d8568f9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:17:19.874 INFO:tasks.workunit.client.0.smithi016.stderr: -55> 2024-09-12T17:17:19.709+0000 7f5d8568f9c0 20 add_watcher() i=0 2024-09-12T17:17:19.874 INFO:tasks.workunit.client.0.smithi016.stderr: -54> 2024-09-12T17:17:19.709+0000 7f5d8568f9c0 20 add_watcher() i=1 2024-09-12T17:17:19.874 INFO:tasks.workunit.client.0.smithi016.stderr: -53> 2024-09-12T17:17:19.709+0000 7f5d8568f9c0 20 add_watcher() i=2 2024-09-12T17:17:19.874 INFO:tasks.workunit.client.0.smithi016.stderr: -52> 2024-09-12T17:17:19.709+0000 7f5d8568f9c0 20 add_watcher() i=3 2024-09-12T17:17:19.874 INFO:tasks.workunit.client.0.smithi016.stderr: -51> 2024-09-12T17:17:19.709+0000 7f5d8568f9c0 20 add_watcher() i=4 2024-09-12T17:17:19.874 INFO:tasks.workunit.client.0.smithi016.stderr: -50> 2024-09-12T17:17:19.709+0000 7f5d8568f9c0 20 add_watcher() i=5 2024-09-12T17:17:19.874 INFO:tasks.workunit.client.0.smithi016.stderr: -49> 2024-09-12T17:17:19.709+0000 7f5d8568f9c0 20 add_watcher() i=6 2024-09-12T17:17:19.874 INFO:tasks.workunit.client.0.smithi016.stderr: -48> 2024-09-12T17:17:19.709+0000 7f5d8568f9c0 20 add_watcher() i=7 2024-09-12T17:17:19.874 INFO:tasks.workunit.client.0.smithi016.stderr: -47> 2024-09-12T17:17:19.709+0000 7f5d8568f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:17:19.874 INFO:tasks.workunit.client.0.smithi016.stderr: -46> 2024-09-12T17:17:19.713+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95d410) adding auth protocol: cephx 2024-09-12T17:17:19.874 INFO:tasks.workunit.client.0.smithi016.stderr: -45> 2024-09-12T17:17:19.713+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95d410) adding auth protocol: cephx 2024-09-12T17:17:19.874 INFO:tasks.workunit.client.0.smithi016.stderr: -44> 2024-09-12T17:17:19.713+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95d410) adding auth protocol: cephx 2024-09-12T17:17:19.875 INFO:tasks.workunit.client.0.smithi016.stderr: -43> 2024-09-12T17:17:19.713+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95d410) adding con mode: secure 2024-09-12T17:17:19.875 INFO:tasks.workunit.client.0.smithi016.stderr: -42> 2024-09-12T17:17:19.713+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95d410) adding con mode: crc 2024-09-12T17:17:19.875 INFO:tasks.workunit.client.0.smithi016.stderr: -41> 2024-09-12T17:17:19.713+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95d410) adding con mode: secure 2024-09-12T17:17:19.875 INFO:tasks.workunit.client.0.smithi016.stderr: -40> 2024-09-12T17:17:19.713+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95d410) adding con mode: crc 2024-09-12T17:17:19.875 INFO:tasks.workunit.client.0.smithi016.stderr: -39> 2024-09-12T17:17:19.713+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95d410) adding con mode: secure 2024-09-12T17:17:19.875 INFO:tasks.workunit.client.0.smithi016.stderr: -38> 2024-09-12T17:17:19.713+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95d410) adding con mode: crc 2024-09-12T17:17:19.875 INFO:tasks.workunit.client.0.smithi016.stderr: -37> 2024-09-12T17:17:19.713+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95d410) adding con mode: crc 2024-09-12T17:17:19.875 INFO:tasks.workunit.client.0.smithi016.stderr: -36> 2024-09-12T17:17:19.713+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95d410) adding con mode: secure 2024-09-12T17:17:19.875 INFO:tasks.workunit.client.0.smithi016.stderr: -35> 2024-09-12T17:17:19.713+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95d410) adding con mode: crc 2024-09-12T17:17:19.875 INFO:tasks.workunit.client.0.smithi016.stderr: -34> 2024-09-12T17:17:19.713+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95d410) adding con mode: secure 2024-09-12T17:17:19.875 INFO:tasks.workunit.client.0.smithi016.stderr: -33> 2024-09-12T17:17:19.713+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95d410) adding con mode: crc 2024-09-12T17:17:19.875 INFO:tasks.workunit.client.0.smithi016.stderr: -32> 2024-09-12T17:17:19.713+0000 7f5d8568f9c0 5 AuthRegistry(0x7ffd7e95d410) adding con mode: secure 2024-09-12T17:17:19.876 INFO:tasks.workunit.client.0.smithi016.stderr: -31> 2024-09-12T17:17:19.713+0000 7f5c3a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:19.876 INFO:tasks.workunit.client.0.smithi016.stderr: -30> 2024-09-12T17:17:19.713+0000 7f5d8568f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:19.876 INFO:tasks.workunit.client.0.smithi016.stderr: -29> 2024-09-12T17:17:19.713+0000 7f5d8568f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:17:19.876 INFO:tasks.workunit.client.0.smithi016.stderr: -28> 2024-09-12T17:17:19.713+0000 7f5d8568f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:17:19.876 INFO:tasks.workunit.client.0.smithi016.stderr: -27> 2024-09-12T17:17:19.713+0000 7f5d8568f9c0 5 asok(0x56453c7292b0) register_command cache list hook 0x56453ca01860 2024-09-12T17:17:19.876 INFO:tasks.workunit.client.0.smithi016.stderr: -26> 2024-09-12T17:17:19.713+0000 7f5d8568f9c0 5 asok(0x56453c7292b0) register_command cache inspect hook 0x56453ca01860 2024-09-12T17:17:19.876 INFO:tasks.workunit.client.0.smithi016.stderr: -25> 2024-09-12T17:17:19.713+0000 7f5d8568f9c0 5 asok(0x56453c7292b0) register_command cache erase hook 0x56453ca01860 2024-09-12T17:17:19.876 INFO:tasks.workunit.client.0.smithi016.stderr: -24> 2024-09-12T17:17:19.713+0000 7f5d8568f9c0 5 asok(0x56453c7292b0) register_command cache zap hook 0x56453ca01860 2024-09-12T17:17:19.876 INFO:tasks.workunit.client.0.smithi016.stderr: -23> 2024-09-12T17:17:19.713+0000 7f5d8568f9c0 5 note: GC not initialized 2024-09-12T17:17:19.876 INFO:tasks.workunit.client.0.smithi016.stderr: -22> 2024-09-12T17:17:19.717+0000 7f5c397e2640 20 reqs_thread_entry: start 2024-09-12T17:17:19.876 INFO:tasks.workunit.client.0.smithi016.stderr: -21> 2024-09-12T17:17:19.717+0000 7f5d8568f9c0 5 asok(0x56453c7292b0) register_command sync trace show hook 0x7f5d7c004720 2024-09-12T17:17:19.876 INFO:tasks.workunit.client.0.smithi016.stderr: -20> 2024-09-12T17:17:19.717+0000 7f5d8568f9c0 5 asok(0x56453c7292b0) register_command sync trace history hook 0x7f5d7c004720 2024-09-12T17:17:19.877 INFO:tasks.workunit.client.0.smithi016.stderr: -19> 2024-09-12T17:17:19.717+0000 7f5d8568f9c0 5 asok(0x56453c7292b0) register_command sync trace active hook 0x7f5d7c004720 2024-09-12T17:17:19.877 INFO:tasks.workunit.client.0.smithi016.stderr: -18> 2024-09-12T17:17:19.717+0000 7f5d8568f9c0 5 asok(0x56453c7292b0) register_command sync trace active_short hook 0x7f5d7c004720 2024-09-12T17:17:19.877 INFO:tasks.workunit.client.0.smithi016.stderr: -17> 2024-09-12T17:17:19.717+0000 7f5d8568f9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:17:19.877 INFO:tasks.workunit.client.0.smithi016.stderr: -16> 2024-09-12T17:17:19.717+0000 7f5d8568f9c0 20 Filter name: none 2024-09-12T17:17:19.877 INFO:tasks.workunit.client.0.smithi016.stderr: -15> 2024-09-12T17:17:19.717+0000 7f5c327fc640 20 reqs_thread_entry: start 2024-09-12T17:17:19.877 INFO:tasks.workunit.client.0.smithi016.stderr: -14> 2024-09-12T17:17:19.717+0000 7f5d8568f9c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T17:17:19.877 INFO:tasks.workunit.client.0.smithi016.stderr: -13> 2024-09-12T17:17:19.717+0000 7f5d8568f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.877 INFO:tasks.workunit.client.0.smithi016.stderr: -12> 2024-09-12T17:17:19.717+0000 7f5d8568f9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T17:17:19.877 INFO:tasks.workunit.client.0.smithi016.stderr: -11> 2024-09-12T17:17:19.717+0000 7f5d8568f9c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T17:17:19.877 INFO:tasks.workunit.client.0.smithi016.stderr: -10> 2024-09-12T17:17:19.717+0000 7f5d8568f9c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T17:17:19.877 INFO:tasks.workunit.client.0.smithi016.stderr: -9> 2024-09-12T17:17:19.717+0000 7f5d8568f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21 : miss 2024-09-12T17:17:19.877 INFO:tasks.workunit.client.0.smithi016.stderr: -8> 2024-09-12T17:17:19.717+0000 7f5d8568f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.877 INFO:tasks.workunit.client.0.smithi016.stderr: -7> 2024-09-12T17:17:19.717+0000 7f5d8568f9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T17:17:19.877 INFO:tasks.workunit.client.0.smithi016.stderr: -6> 2024-09-12T17:17:19.717+0000 7f5d8568f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21 info.flags=0x17 2024-09-12T17:17:19.878 INFO:tasks.workunit.client.0.smithi016.stderr: -5> 2024-09-12T17:17:19.717+0000 7f5d8568f9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21 to cache LRU end 2024-09-12T17:17:19.878 INFO:tasks.workunit.client.0.smithi016.stderr: -4> 2024-09-12T17:17:19.717+0000 7f5d8568f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:17:19.878 INFO:tasks.workunit.client.0.smithi016.stderr: -3> 2024-09-12T17:17:19.717+0000 7f5d8568f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:17:19.878 INFO:tasks.workunit.client.0.smithi016.stderr: -2> 2024-09-12T17:17:19.717+0000 7f5d8568f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21 2024-09-12T17:17:19.878 INFO:tasks.workunit.client.0.smithi016.stderr: -1> 2024-09-12T17:17:19.721+0000 7f5d8568f9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5d8568f9c0 time 2024-09-12T17:17:19.724710+0000 2024-09-12T17:17:19.878 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:17:19.878 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:19.878 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:17:19.878 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f5d88f692eb] 2024-09-12T17:17:19.878 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5d88f6949f] 2024-09-12T17:17:19.878 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56453a06b0c1] 2024-09-12T17:17:19.879 INFO:tasks.workunit.client.0.smithi016.stderr: 4: radosgw-admin(+0x140f572) [0x56453aac0572] 2024-09-12T17:17:19.879 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56453a07d18d] 2024-09-12T17:17:19.879 INFO:tasks.workunit.client.0.smithi016.stderr: 6: main() 2024-09-12T17:17:19.879 INFO:tasks.workunit.client.0.smithi016.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5d87dcfd90] 2024-09-12T17:17:19.879 INFO:tasks.workunit.client.0.smithi016.stderr: 8: __libc_start_main() 2024-09-12T17:17:19.879 INFO:tasks.workunit.client.0.smithi016.stderr: 9: _start() 2024-09-12T17:17:19.879 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:19.879 INFO:tasks.workunit.client.0.smithi016.stderr: 0> 2024-09-12T17:17:19.725+0000 7f5d8568f9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:17:19.879 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7f5d8568f9c0 thread_name:radosgw-admin 2024-09-12T17:17:19.879 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:19.879 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:17:19.880 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f5d87de8520] 2024-09-12T17:17:19.880 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:17:19.880 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:17:19.880 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:17:19.880 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f5d88f69345] 2024-09-12T17:17:19.880 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5d88f6949f] 2024-09-12T17:17:19.880 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56453a06b0c1] 2024-09-12T17:17:19.880 INFO:tasks.workunit.client.0.smithi016.stderr: 8: radosgw-admin(+0x140f572) [0x56453aac0572] 2024-09-12T17:17:19.880 INFO:tasks.workunit.client.0.smithi016.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56453a07d18d] 2024-09-12T17:17:19.881 INFO:tasks.workunit.client.0.smithi016.stderr: 10: main() 2024-09-12T17:17:19.881 INFO:tasks.workunit.client.0.smithi016.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5d87dcfd90] 2024-09-12T17:17:19.881 INFO:tasks.workunit.client.0.smithi016.stderr: 12: __libc_start_main() 2024-09-12T17:17:19.881 INFO:tasks.workunit.client.0.smithi016.stderr: 13: _start() 2024-09-12T17:17:19.881 INFO:tasks.workunit.client.0.smithi016.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:17:19.881 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:19.882 INFO:tasks.workunit.client.0.smithi016.stderr:--- logging levels --- 2024-09-12T17:17:19.882 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 none 2024-09-12T17:17:19.882 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 lockdep 2024-09-12T17:17:19.882 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 context 2024-09-12T17:17:19.882 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 crush 2024-09-12T17:17:19.882 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds 2024-09-12T17:17:19.883 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_balancer 2024-09-12T17:17:19.883 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_locker 2024-09-12T17:17:19.883 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log 2024-09-12T17:17:19.883 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log_expire 2024-09-12T17:17:19.883 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_migrator 2024-09-12T17:17:19.883 INFO:tasks.workunit.client.0.smithi016.stderr: 3/ 5 mds_quiesce 2024-09-12T17:17:19.883 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 buffer 2024-09-12T17:17:19.884 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 timer 2024-09-12T17:17:19.884 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 filer 2024-09-12T17:17:19.884 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 striper 2024-09-12T17:17:19.884 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 objecter 2024-09-12T17:17:19.884 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rados 2024-09-12T17:17:19.884 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd 2024-09-12T17:17:19.884 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_mirror 2024-09-12T17:17:19.884 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_replay 2024-09-12T17:17:19.885 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_pwl 2024-09-12T17:17:19.885 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 journaler 2024-09-12T17:17:19.885 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objectcacher 2024-09-12T17:17:19.885 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:17:19.885 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 client 2024-09-12T17:17:19.885 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 osd 2024-09-12T17:17:19.885 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 optracker 2024-09-12T17:17:19.885 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objclass 2024-09-12T17:17:19.886 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 filestore 2024-09-12T17:17:19.886 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 journal 2024-09-12T17:17:19.886 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 ms 2024-09-12T17:17:19.886 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mon 2024-09-12T17:17:19.886 INFO:tasks.workunit.client.0.smithi016.stderr: 0/10 monc 2024-09-12T17:17:19.886 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 paxos 2024-09-12T17:17:19.887 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 tp 2024-09-12T17:17:19.887 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 auth 2024-09-12T17:17:19.887 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 crypto 2024-09-12T17:17:19.887 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 finisher 2024-09-12T17:17:19.887 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 reserver 2024-09-12T17:17:19.887 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 heartbeatmap 2024-09-12T17:17:19.888 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 perfcounter 2024-09-12T17:17:19.888 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw 2024-09-12T17:17:19.888 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_sync 2024-09-12T17:17:19.888 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_datacache 2024-09-12T17:17:19.888 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_access 2024-09-12T17:17:19.888 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:17:19.888 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_flight 2024-09-12T17:17:19.888 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:17:19.888 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw_notification 2024-09-12T17:17:19.888 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 javaclient 2024-09-12T17:17:19.888 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 asok 2024-09-12T17:17:19.888 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 throttle 2024-09-12T17:17:19.889 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 refs 2024-09-12T17:17:19.889 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 compressor 2024-09-12T17:17:19.889 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluestore 2024-09-12T17:17:19.889 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluefs 2024-09-12T17:17:19.889 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 bdev 2024-09-12T17:17:19.889 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 kstore 2024-09-12T17:17:19.889 INFO:tasks.workunit.client.0.smithi016.stderr: 4/ 5 rocksdb 2024-09-12T17:17:19.889 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 fuse 2024-09-12T17:17:19.889 INFO:tasks.workunit.client.0.smithi016.stderr: 2/ 5 mgr 2024-09-12T17:17:19.889 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mgrc 2024-09-12T17:17:19.889 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 dpdk 2024-09-12T17:17:19.889 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 eventtrace 2024-09-12T17:17:19.890 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 prioritycache 2024-09-12T17:17:19.890 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 test 2024-09-12T17:17:19.890 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:17:19.890 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephsqlite 2024-09-12T17:17:19.890 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:17:19.890 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore 2024-09-12T17:17:19.890 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_onode 2024-09-12T17:17:19.890 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_odata 2024-09-12T17:17:19.890 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_omap 2024-09-12T17:17:19.890 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_tm 2024-09-12T17:17:19.890 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_t 2024-09-12T17:17:19.890 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:17:19.890 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_epm 2024-09-12T17:17:19.891 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_lba 2024-09-12T17:17:19.891 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:17:19.891 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cache 2024-09-12T17:17:19.891 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_journal 2024-09-12T17:17:19.891 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_device 2024-09-12T17:17:19.891 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_backref 2024-09-12T17:17:19.891 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 alienstore 2024-09-12T17:17:19.891 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mclock 2024-09-12T17:17:19.891 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cyanstore 2024-09-12T17:17:19.891 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 ceph_exporter 2024-09-12T17:17:19.891 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 memstore 2024-09-12T17:17:19.891 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 trace 2024-09-12T17:17:19.891 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 ceph_dedup 2024-09-12T17:17:19.891 INFO:tasks.workunit.client.0.smithi016.stderr: -2/-2 (syslog threshold) 2024-09-12T17:17:19.892 INFO:tasks.workunit.client.0.smithi016.stderr: 99/99 (stderr threshold) 2024-09-12T17:17:19.892 INFO:tasks.workunit.client.0.smithi016.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:17:19.892 INFO:tasks.workunit.client.0.smithi016.stderr: 7f5c327fc640 / http_manager 2024-09-12T17:17:19.892 INFO:tasks.workunit.client.0.smithi016.stderr: 7f5c397e2640 / http_manager 2024-09-12T17:17:19.892 INFO:tasks.workunit.client.0.smithi016.stderr: 7f5c3a7e4640 / rgw_dt_lg_renew 2024-09-12T17:17:19.892 INFO:tasks.workunit.client.0.smithi016.stderr: 7f5c657fa640 / ms_dispatch 2024-09-12T17:17:19.892 INFO:tasks.workunit.client.0.smithi016.stderr: 7f5c66ffd640 / io_context_pool 2024-09-12T17:17:19.892 INFO:tasks.workunit.client.0.smithi016.stderr: 7f5c6d602640 / ms_dispatch 2024-09-12T17:17:19.892 INFO:tasks.workunit.client.0.smithi016.stderr: 7f5c6fe07640 / ms_dispatch 2024-09-12T17:17:19.892 INFO:tasks.workunit.client.0.smithi016.stderr: 7f5c7160a640 / io_context_pool 2024-09-12T17:17:19.892 INFO:tasks.workunit.client.0.smithi016.stderr: 7f5d82994640 / msgr-worker-2 2024-09-12T17:17:19.892 INFO:tasks.workunit.client.0.smithi016.stderr: 7f5d83195640 / msgr-worker-1 2024-09-12T17:17:19.892 INFO:tasks.workunit.client.0.smithi016.stderr: 7f5d83996640 / msgr-worker-0 2024-09-12T17:17:19.893 INFO:tasks.workunit.client.0.smithi016.stderr: 7f5d84197640 / io_context_pool 2024-09-12T17:17:19.893 INFO:tasks.workunit.client.0.smithi016.stderr: 7f5d8568f9c0 / radosgw-admin 2024-09-12T17:17:19.893 INFO:tasks.workunit.client.0.smithi016.stderr: max_recent 500 2024-09-12T17:17:19.893 INFO:tasks.workunit.client.0.smithi016.stderr: max_new 1000 2024-09-12T17:17:19.893 INFO:tasks.workunit.client.0.smithi016.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:17:19.728913Z_fae6fc38-8214-4284-8314-bf748871ce12/log 2024-09-12T17:17:19.893 INFO:tasks.workunit.client.0.smithi016.stderr:--- end dump of recent events --- 2024-09-12T17:17:19.893 INFO:tasks.workunit.client.0.smithi016.stderr:Aborted 2024-09-12T17:17:19.893 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T17:17:19.895 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:17:19.895 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:17:19.895 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.813+0000 7f9a83e039c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.895 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.817+0000 7f9a83e039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:19.895 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.817+0000 7f9a83e039c0 20 realm 2024-09-12T17:17:19.895 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.817+0000 7f9a83e039c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.895 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.817+0000 7f9a83e039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:19.895 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.817+0000 7f9a83e039c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:17:19.895 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.817+0000 7f9a83e039c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.817+0000 7f9a83e039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:19.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.817+0000 7f9a83e039c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.817+0000 7f9a83e039c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:19.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.817+0000 7f9a83e039c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:19.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.821+0000 7f9a83e039c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:17:19.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.821+0000 7f9a83e039c0 20 searching for the correct realm 2024-09-12T17:17:19.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.825+0000 7f9a8210a640 0 -- 172.21.15.16:0/213098926 >> [v2:172.21.15.19:6800/1509147557,v1:172.21.15.19:6801/1509147557] conn(0x55d2985595d0 msgr2=0x55d29855b9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:19.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:19.829+0000 7f9a7bfff640 0 -- 172.21.15.16:0/213098926 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f9a7c05b190 msgr2=0x7f9a7c007a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:17:20.047 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.045+0000 7f9a83e039c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:17:20.047 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.045+0000 7f9a83e039c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:17:20.047 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.045+0000 7f9a83e039c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:17:20.047 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.045+0000 7f9a83e039c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:17:20.047 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.045+0000 7f9a83e039c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:17:20.047 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.045+0000 7f9a83e039c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:17:20.047 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.045+0000 7f9a83e039c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:20.048 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.045+0000 7f9a83e039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:20.048 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.045+0000 7f9a83e039c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:20.048 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.049+0000 7f9a83e039c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:20.049 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.049+0000 7f9a83e039c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:20.050 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.049+0000 7f9a83e039c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:17:20.050 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.049+0000 7f9a83e039c0 20 zone default found 2024-09-12T17:17:20.050 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.049+0000 7f9a83e039c0 4 Realm: () 2024-09-12T17:17:20.050 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.049+0000 7f9a83e039c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:17:20.050 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.049+0000 7f9a83e039c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:17:20.051 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.049+0000 7f9a83e039c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:17:20.051 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.049+0000 7f9a83e039c0 20 zonegroup default 2024-09-12T17:17:20.051 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.049+0000 7f9a83e039c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:20.052 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.049+0000 7f9a83e039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:20.053 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.049+0000 7f9a83e039c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:20.053 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.049+0000 7f9a83e039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:20.053 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.049+0000 7f9a83e039c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:20.053 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.053+0000 7f9a83e039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:20.054 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.053+0000 7f9a83e039c0 20 started sync module instance, tier type = 2024-09-12T17:17:20.054 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.053+0000 7f9a83e039c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:17:20.075 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.073+0000 7f9a83e039c0 20 add_watcher() i=0 2024-09-12T17:17:20.075 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.073+0000 7f9a83e039c0 20 add_watcher() i=1 2024-09-12T17:17:20.075 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.073+0000 7f9a83e039c0 20 add_watcher() i=2 2024-09-12T17:17:20.075 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.073+0000 7f9a83e039c0 20 add_watcher() i=3 2024-09-12T17:17:20.075 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.073+0000 7f9a83e039c0 20 add_watcher() i=4 2024-09-12T17:17:20.075 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.073+0000 7f9a83e039c0 20 add_watcher() i=5 2024-09-12T17:17:20.075 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.073+0000 7f9a83e039c0 20 add_watcher() i=6 2024-09-12T17:17:20.077 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.077+0000 7f9a83e039c0 20 add_watcher() i=7 2024-09-12T17:17:20.077 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.077+0000 7f9a83e039c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:17:20.081 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.081+0000 7f99337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:20.084 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.081+0000 7f9a83e039c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:17:20.085 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.081+0000 7f9a83e039c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:17:20.085 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.081+0000 7f9a83e039c0 5 note: GC not initialized 2024-09-12T17:17:20.085 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.081+0000 7f99327fc640 20 reqs_thread_entry: start 2024-09-12T17:17:20.085 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.081+0000 7f9a83e039c0 20 init_complete bucket index max shards: 1 2024-09-12T17:17:20.085 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.081+0000 7f9a83e039c0 20 Filter name: none 2024-09-12T17:17:20.085 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.081+0000 7f98a3fff640 20 reqs_thread_entry: start 2024-09-12T17:17:20.085 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.085+0000 7f9a83e039c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:20.087 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.085+0000 7f9a83e039c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T17:17:20.087 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.085+0000 7f9a83e039c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:20.087 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.085+0000 7f9a83e039c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T17:17:20.087 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.085+0000 7f9a83e039c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:17:20.087 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.085+0000 7f9a83e039c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:20.087 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.085+0000 7f9a83e039c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T17:17:20.087 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.085+0000 7f9a83e039c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:20.088 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.085+0000 7f9a83e039c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T17:17:20.088 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.085+0000 7f9a83e039c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:17:20.090 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.089+0000 7f99337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:20.096 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.097+0000 7f9a83e039c0 20 remove_watcher() i=0 2024-09-12T17:17:20.096 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.097+0000 7f9a83e039c0 2 removed watcher, disabling cache 2024-09-12T17:17:20.098 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.097+0000 7f9a83e039c0 20 remove_watcher() i=1 2024-09-12T17:17:20.101 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.101+0000 7f9a83e039c0 20 remove_watcher() i=2 2024-09-12T17:17:20.103 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.101+0000 7f9a83e039c0 20 remove_watcher() i=3 2024-09-12T17:17:20.106 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.105+0000 7f9a83e039c0 20 remove_watcher() i=4 2024-09-12T17:17:20.108 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.109+0000 7f9a83e039c0 20 remove_watcher() i=5 2024-09-12T17:17:20.110 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.109+0000 7f9a83e039c0 20 remove_watcher() i=6 2024-09-12T17:17:20.111 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.109+0000 7f9a83e039c0 20 remove_watcher() i=7 2024-09-12T17:17:20.127 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:20.127 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:17:20.127 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: abort-at-init-indext id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:17:20.127 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:20.185 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:17:20.223 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:17:20.223 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:17:20.273 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.273+0000 7f20584179c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:20.275 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.273+0000 7f20584179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:20.275 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.273+0000 7f20584179c0 20 realm 2024-09-12T17:17:20.275 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.273+0000 7f20584179c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:20.275 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.273+0000 7f20584179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:20.275 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.273+0000 7f20584179c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:17:20.275 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.273+0000 7f20584179c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:20.275 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.273+0000 7f20584179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:20.275 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.273+0000 7f20584179c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:20.276 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.277+0000 7f20584179c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:20.277 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.277+0000 7f20584179c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:20.278 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.277+0000 7f20584179c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:17:20.278 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.277+0000 7f20584179c0 20 searching for the correct realm 2024-09-12T17:17:20.281 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.281+0000 7f205671e640 0 -- 172.21.15.16:0/1414680189 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f204c008050 msgr2=0x7f204c083130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:17:20.497 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.497+0000 7f205571c640 0 -- 172.21.15.16:0/1414680189 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f2048018040 msgr2=0x7f204806aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:20.716 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.717+0000 7f20584179c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:17:20.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.717+0000 7f20584179c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:17:20.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.717+0000 7f20584179c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:17:20.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.717+0000 7f20584179c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:17:20.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.717+0000 7f20584179c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:17:20.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.717+0000 7f20584179c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:17:20.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.717+0000 7f20584179c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:20.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.717+0000 7f20584179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:20.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.717+0000 7f20584179c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:20.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.717+0000 7f20584179c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:20.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.717+0000 7f20584179c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:20.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.717+0000 7f20584179c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:17:20.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.717+0000 7f20584179c0 20 zone default found 2024-09-12T17:17:20.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.717+0000 7f20584179c0 4 Realm: () 2024-09-12T17:17:20.720 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.717+0000 7f20584179c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:17:20.720 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.717+0000 7f20584179c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:17:20.720 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.717+0000 7f20584179c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:17:20.720 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.717+0000 7f20584179c0 20 zonegroup default 2024-09-12T17:17:20.720 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.717+0000 7f20584179c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:20.721 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.721+0000 7f20584179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:20.721 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.721+0000 7f20584179c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:20.722 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.721+0000 7f20584179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:20.722 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.721+0000 7f20584179c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:20.723 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.721+0000 7f20584179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:20.723 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.721+0000 7f20584179c0 20 started sync module instance, tier type = 2024-09-12T17:17:20.723 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.721+0000 7f20584179c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:17:20.746 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.745+0000 7f20584179c0 20 add_watcher() i=0 2024-09-12T17:17:20.746 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.745+0000 7f20584179c0 20 add_watcher() i=1 2024-09-12T17:17:20.746 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.745+0000 7f20584179c0 20 add_watcher() i=2 2024-09-12T17:17:20.746 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.745+0000 7f20584179c0 20 add_watcher() i=3 2024-09-12T17:17:20.746 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.745+0000 7f20584179c0 20 add_watcher() i=4 2024-09-12T17:17:20.746 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.745+0000 7f20584179c0 20 add_watcher() i=5 2024-09-12T17:17:20.746 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.745+0000 7f20584179c0 20 add_watcher() i=6 2024-09-12T17:17:20.748 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.749+0000 7f20584179c0 20 add_watcher() i=7 2024-09-12T17:17:20.748 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.749+0000 7f20584179c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:17:20.752 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.753+0000 7f1f0bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:20.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.753+0000 7f20584179c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:17:20.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.753+0000 7f20584179c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:17:20.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.753+0000 7f20584179c0 5 note: GC not initialized 2024-09-12T17:17:20.754 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.753+0000 7f1f0afe5640 20 reqs_thread_entry: start 2024-09-12T17:17:20.754 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.753+0000 7f20584179c0 20 init_complete bucket index max shards: 1 2024-09-12T17:17:20.754 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.753+0000 7f20584179c0 20 Filter name: none 2024-09-12T17:17:20.755 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.753+0000 7f1f08fe1640 20 reqs_thread_entry: start 2024-09-12T17:17:20.755 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.753+0000 7f20584179c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T17:17:20.755 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.753+0000 7f20584179c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:20.756 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.757+0000 7f20584179c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T17:17:20.756 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.757+0000 7f20584179c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T17:17:20.756 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.757+0000 7f20584179c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T17:17:20.756 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.757+0000 7f20584179c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21 : miss 2024-09-12T17:17:20.756 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.757+0000 7f20584179c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:20.757 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.757+0000 7f20584179c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T17:17:20.757 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.757+0000 7f20584179c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21 info.flags=0x17 2024-09-12T17:17:20.757 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.757+0000 7f20584179c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21 to cache LRU end 2024-09-12T17:17:20.757 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.757+0000 7f20584179c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:17:20.757 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.757+0000 7f20584179c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:17:20.757 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.757+0000 7f20584179c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21 2024-09-12T17:17:20.759 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.757+0000 7f20584179c0 0 INFO: RGWReshardLock::lock found lock on abort-at-init-indext:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21 to be held by another RGW process; skipping for now 2024-09-12T17:17:20.761 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.761+0000 7f1f0bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:20.766 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.765+0000 7f20584179c0 20 remove_watcher() i=0 2024-09-12T17:17:20.766 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.765+0000 7f20584179c0 2 removed watcher, disabling cache 2024-09-12T17:17:20.769 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.769+0000 7f20584179c0 20 remove_watcher() i=1 2024-09-12T17:17:20.771 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.769+0000 7f20584179c0 20 remove_watcher() i=2 2024-09-12T17:17:20.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.773+0000 7f20584179c0 20 remove_watcher() i=3 2024-09-12T17:17:20.775 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.773+0000 7f20584179c0 20 remove_watcher() i=4 2024-09-12T17:17:20.777 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.777+0000 7f20584179c0 20 remove_watcher() i=5 2024-09-12T17:17:20.778 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.777+0000 7f20584179c0 20 remove_watcher() i=6 2024-09-12T17:17:20.780 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:20.781+0000 7f20584179c0 20 remove_watcher() i=7 2024-09-12T17:17:20.801 INFO:tasks.workunit.client.0.smithi016.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:17:50.832 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:17:50.871 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:17:50.871 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:17:50.922 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:50.920+0000 7f063d8e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:50.923 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:50.920+0000 7f063d8e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:50.923 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:50.920+0000 7f063d8e19c0 20 realm 2024-09-12T17:17:50.923 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:50.920+0000 7f063d8e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:50.924 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:50.920+0000 7f063d8e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:50.924 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:50.920+0000 7f063d8e19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:17:50.924 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:50.920+0000 7f063d8e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:50.924 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:50.924+0000 7f063d8e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:50.924 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:50.924+0000 7f063d8e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:50.926 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:50.924+0000 7f063d8e19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:50.926 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:50.924+0000 7f063d8e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:50.927 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:50.924+0000 7f063d8e19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:17:50.927 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:50.924+0000 7f063d8e19c0 20 searching for the correct realm 2024-09-12T17:17:50.931 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:50.928+0000 7f063bbe8640 0 -- 172.21.15.16:0/141148295 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f06300ce040 msgr2=0x7f06300ce930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:51.145 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.144+0000 7f063abe6640 0 -- 172.21.15.16:0/141148295 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f0634018070 msgr2=0x7f0634003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:17:51.364 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.360+0000 7f063d8e19c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:17:51.364 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.360+0000 7f063d8e19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:17:51.364 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.360+0000 7f063d8e19c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:17:51.364 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.360+0000 7f063d8e19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:17:51.364 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.360+0000 7f063d8e19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:17:51.365 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.360+0000 7f063d8e19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:17:51.365 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.360+0000 7f063d8e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:51.365 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.364+0000 7f063d8e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:51.365 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.364+0000 7f063d8e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:51.365 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.364+0000 7f063d8e19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:51.365 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.364+0000 7f063d8e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:51.366 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.364+0000 7f063d8e19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:17:51.366 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.364+0000 7f063d8e19c0 20 zone default found 2024-09-12T17:17:51.367 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.364+0000 7f063d8e19c0 4 Realm: () 2024-09-12T17:17:51.367 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.364+0000 7f063d8e19c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:17:51.367 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.364+0000 7f063d8e19c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:17:51.367 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.364+0000 7f063d8e19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:17:51.367 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.364+0000 7f063d8e19c0 20 zonegroup default 2024-09-12T17:17:51.367 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.364+0000 7f063d8e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:51.367 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.364+0000 7f063d8e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:51.367 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.364+0000 7f063d8e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:51.368 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.368+0000 7f063d8e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:51.368 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.368+0000 7f063d8e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:51.369 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.368+0000 7f063d8e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:51.369 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.368+0000 7f063d8e19c0 20 started sync module instance, tier type = 2024-09-12T17:17:51.369 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.368+0000 7f063d8e19c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:17:51.393 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.392+0000 7f063d8e19c0 20 add_watcher() i=0 2024-09-12T17:17:51.393 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.392+0000 7f063d8e19c0 20 add_watcher() i=1 2024-09-12T17:17:51.393 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.392+0000 7f063d8e19c0 20 add_watcher() i=2 2024-09-12T17:17:51.393 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.392+0000 7f063d8e19c0 20 add_watcher() i=3 2024-09-12T17:17:51.394 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.392+0000 7f063d8e19c0 20 add_watcher() i=4 2024-09-12T17:17:51.394 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.392+0000 7f063d8e19c0 20 add_watcher() i=5 2024-09-12T17:17:51.394 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.392+0000 7f063d8e19c0 20 add_watcher() i=6 2024-09-12T17:17:51.395 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.392+0000 7f063d8e19c0 20 add_watcher() i=7 2024-09-12T17:17:51.395 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.392+0000 7f063d8e19c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:17:51.399 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.396+0000 7f04f27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:51.400 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.400+0000 7f063d8e19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:17:51.400 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.400+0000 7f063d8e19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:17:51.400 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.400+0000 7f063d8e19c0 5 note: GC not initialized 2024-09-12T17:17:51.401 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.400+0000 7f04f17e2640 20 reqs_thread_entry: start 2024-09-12T17:17:51.401 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.400+0000 7f063d8e19c0 20 init_complete bucket index max shards: 1 2024-09-12T17:17:51.401 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.400+0000 7f063d8e19c0 20 Filter name: none 2024-09-12T17:17:51.401 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.400+0000 7f04ea7fc640 20 reqs_thread_entry: start 2024-09-12T17:17:51.401 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.400+0000 7f063d8e19c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T17:17:51.401 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.400+0000 7f063d8e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:51.402 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.400+0000 7f063d8e19c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T17:17:51.402 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.400+0000 7f063d8e19c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T17:17:51.402 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.400+0000 7f063d8e19c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T17:17:51.402 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.400+0000 7f063d8e19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21 : miss 2024-09-12T17:17:51.403 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.400+0000 7f063d8e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:51.403 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.400+0000 7f063d8e19c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T17:17:51.403 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.400+0000 7f063d8e19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21 info.flags=0x17 2024-09-12T17:17:51.403 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.400+0000 7f063d8e19c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21 to cache LRU end 2024-09-12T17:17:51.404 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.400+0000 7f063d8e19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:17:51.404 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.400+0000 7f063d8e19c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:17:51.404 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.400+0000 7f063d8e19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21 2024-09-12T17:17:51.412 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.408+0000 7f063d8e19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21 info.flags=0x17 2024-09-12T17:17:51.412 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.408+0000 7f063d8e19c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21 to cache LRU end 2024-09-12T17:17:51.412 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.408+0000 7f063d8e19c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:17:51.412 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.408+0000 7f063d8e19c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21, ofs0, ns] 2024-09-12T17:17:51.412 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.412+0000 7f051effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431603 cookie 94706070192928 notifier 6372 bl.length()=913 2024-09-12T17:17:51.413 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.412+0000 7f051effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21 info.flags=0x17 2024-09-12T17:17:51.413 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.412+0000 7f051effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21 to cache LRU end 2024-09-12T17:17:51.413 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.412+0000 7f051effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:17:51.414 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.412+0000 7f063d8e19c0 20 handle_bi_update(): bucket=:abort-at-init-indext[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21]): orig_sources= new_sources= 2024-09-12T17:17:51.414 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.412+0000 7f063d8e19c0 20 handle_bi_update(): bucket=:abort-at-init-indext[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21]): potential sources added=[] removed=[] 2024-09-12T17:17:51.414 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.412+0000 7f063d8e19c0 20 handle_bi_update(): bucket=:abort-at-init-indext[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21]): orig_dests= new_dests= 2024-09-12T17:17:51.414 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.412+0000 7f063d8e19c0 20 handle_bi_update(): bucket=:abort-at-init-indext[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21]): potential dests added=[] removed=[] 2024-09-12T17:17:51.419 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.416+0000 7f063d8e19c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21.1.0 2024-09-12T17:17:51.419 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.416+0000 7f063d8e19c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21.1.0 2024-09-12T17:17:51.419 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.416+0000 7f063d8e19c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21.1.1 2024-09-12T17:17:51.419 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.416+0000 7f063d8e19c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21.1.1 2024-09-12T17:17:51.419 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.416+0000 7f063d8e19c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21.0 2024-09-12T17:17:51.425 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.424+0000 7f063d8e19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21 : hit (requested=0x17, cached=0x17) 2024-09-12T17:17:51.425 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.424+0000 7f063d8e19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21 2024-09-12T17:17:51.428 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.424+0000 7f063d8e19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21 info.flags=0x17 2024-09-12T17:17:51.428 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.424+0000 7f063d8e19c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21 to cache LRU end 2024-09-12T17:17:51.428 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.424+0000 7f063d8e19c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:17:51.428 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.424+0000 7f063d8e19c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21, ofs0, ns] 2024-09-12T17:17:51.428 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.428+0000 7f051e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431604 cookie 94706070192928 notifier 6372 bl.length()=913 2024-09-12T17:17:51.428 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.428+0000 7f051e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21 info.flags=0x17 2024-09-12T17:17:51.428 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.428+0000 7f051e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21 to cache LRU end 2024-09-12T17:17:51.429 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.428+0000 7f051e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:17:51.429 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.428+0000 7f063d8e19c0 20 handle_bi_update(): bucket=:abort-at-init-indext[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21]): orig_sources= new_sources= 2024-09-12T17:17:51.429 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.428+0000 7f063d8e19c0 20 handle_bi_update(): bucket=:abort-at-init-indext[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21]): potential sources added=[] removed=[] 2024-09-12T17:17:51.429 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.428+0000 7f063d8e19c0 20 handle_bi_update(): bucket=:abort-at-init-indext[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21]): orig_dests= new_dests= 2024-09-12T17:17:51.429 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.428+0000 7f063d8e19c0 20 handle_bi_update(): bucket=:abort-at-init-indext[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21]): potential dests added=[] removed=[] 2024-09-12T17:17:51.432 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.432+0000 7f063d8e19c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21.0 2024-09-12T17:17:51.433 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.432+0000 7f063d8e19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21 : hit (requested=0x17, cached=0x17) 2024-09-12T17:17:51.433 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.432+0000 7f063d8e19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21 2024-09-12T17:17:51.436 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.436+0000 7f063d8e19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21 info.flags=0x17 2024-09-12T17:17:51.436 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.436+0000 7f063d8e19c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21 to cache LRU end 2024-09-12T17:17:51.437 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.436+0000 7f063d8e19c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:17:51.437 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.436+0000 7f063d8e19c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21, ofs0, ns] 2024-09-12T17:17:51.437 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.436+0000 7f051effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431605 cookie 94706070192928 notifier 6372 bl.length()=881 2024-09-12T17:17:51.437 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.436+0000 7f051effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21 info.flags=0x17 2024-09-12T17:17:51.437 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.436+0000 7f051effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21 to cache LRU end 2024-09-12T17:17:51.437 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.436+0000 7f051effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:17:51.438 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.436+0000 7f063d8e19c0 20 handle_bi_update(): bucket=:abort-at-init-indext[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21]): orig_sources= new_sources= 2024-09-12T17:17:51.438 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.436+0000 7f063d8e19c0 20 handle_bi_update(): bucket=:abort-at-init-indext[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21]): potential sources added=[] removed=[] 2024-09-12T17:17:51.439 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.436+0000 7f063d8e19c0 20 handle_bi_update(): bucket=:abort-at-init-indext[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21]): orig_dests= new_dests= 2024-09-12T17:17:51.439 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.436+0000 7f063d8e19c0 20 handle_bi_update(): bucket=:abort-at-init-indext[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21]): potential dests added=[] removed=[] 2024-09-12T17:17:51.441 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.440+0000 7f063d8e19c0 1 execute INFO: reshard of bucket "abort-at-init-indext" from 1 shards to 2 shards completed successfully 2024-09-12T17:17:51.445 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.444+0000 7f04f27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:51.451 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.448+0000 7f063d8e19c0 20 remove_watcher() i=0 2024-09-12T17:17:51.451 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.448+0000 7f063d8e19c0 2 removed watcher, disabling cache 2024-09-12T17:17:51.453 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.452+0000 7f063d8e19c0 20 remove_watcher() i=1 2024-09-12T17:17:51.455 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.452+0000 7f063d8e19c0 20 remove_watcher() i=2 2024-09-12T17:17:51.457 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.456+0000 7f063d8e19c0 20 remove_watcher() i=3 2024-09-12T17:17:51.460 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.460+0000 7f063d8e19c0 20 remove_watcher() i=4 2024-09-12T17:17:51.462 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.460+0000 7f063d8e19c0 20 remove_watcher() i=5 2024-09-12T17:17:51.463 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.460+0000 7f063d8e19c0 20 remove_watcher() i=6 2024-09-12T17:17:51.465 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.464+0000 7f063d8e19c0 20 remove_watcher() i=7 2024-09-12T17:17:51.482 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T17:17:51.510 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:17:51.511 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:17:51.557 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.556+0000 7efc1878a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:51.559 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.556+0000 7efc1878a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:51.559 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.556+0000 7efc1878a9c0 20 realm 2024-09-12T17:17:51.559 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.556+0000 7efc1878a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:51.559 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.556+0000 7efc1878a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:51.559 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.556+0000 7efc1878a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:17:51.559 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.556+0000 7efc1878a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:51.559 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.556+0000 7efc1878a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:51.559 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.556+0000 7efc1878a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:51.560 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.560+0000 7efc1878a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:51.561 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.560+0000 7efc1878a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:51.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.560+0000 7efc1878a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:17:51.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.560+0000 7efc1878a9c0 20 searching for the correct realm 2024-09-12T17:17:51.566 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.564+0000 7efc16a91640 0 -- 172.21.15.16:0/3125956093 >> [v2:172.21.15.19:6800/1509147557,v1:172.21.15.19:6801/1509147557] conn(0x55e02561fbb0 msgr2=0x55e025621fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:51.573 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.572+0000 7efc15a8f640 0 -- 172.21.15.16:0/3125956093 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7efc1007ea60 msgr2=0x7efc10090310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:51.792 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.788+0000 7efc1878a9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:17:51.792 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.788+0000 7efc1878a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:17:51.792 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.788+0000 7efc1878a9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:17:51.792 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.788+0000 7efc1878a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:17:51.792 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.788+0000 7efc1878a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:17:51.792 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.788+0000 7efc1878a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:17:51.792 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.788+0000 7efc1878a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:51.793 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.792+0000 7efc1878a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:51.793 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.792+0000 7efc1878a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:51.793 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.792+0000 7efc1878a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:51.793 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.792+0000 7efc1878a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:51.794 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.792+0000 7efc1878a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:17:51.794 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.792+0000 7efc1878a9c0 20 zone default found 2024-09-12T17:17:51.794 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.792+0000 7efc1878a9c0 4 Realm: () 2024-09-12T17:17:51.794 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.792+0000 7efc1878a9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:17:51.794 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.792+0000 7efc1878a9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:17:51.794 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.792+0000 7efc1878a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:17:51.794 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.792+0000 7efc1878a9c0 20 zonegroup default 2024-09-12T17:17:51.794 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.792+0000 7efc1878a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:51.795 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.792+0000 7efc1878a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:51.795 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.792+0000 7efc1878a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:51.795 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.792+0000 7efc1878a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:51.795 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.792+0000 7efc1878a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:51.796 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.796+0000 7efc1878a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:51.796 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.796+0000 7efc1878a9c0 20 started sync module instance, tier type = 2024-09-12T17:17:51.796 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.796+0000 7efc1878a9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:17:51.819 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.816+0000 7efc1878a9c0 20 add_watcher() i=0 2024-09-12T17:17:51.819 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.816+0000 7efc1878a9c0 20 add_watcher() i=1 2024-09-12T17:17:51.819 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.816+0000 7efc1878a9c0 20 add_watcher() i=2 2024-09-12T17:17:51.819 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.816+0000 7efc1878a9c0 20 add_watcher() i=3 2024-09-12T17:17:51.820 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.816+0000 7efc1878a9c0 20 add_watcher() i=4 2024-09-12T17:17:51.820 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.816+0000 7efc1878a9c0 20 add_watcher() i=5 2024-09-12T17:17:51.820 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.816+0000 7efc1878a9c0 20 add_watcher() i=6 2024-09-12T17:17:51.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.820+0000 7efc1878a9c0 20 add_watcher() i=7 2024-09-12T17:17:51.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.820+0000 7efc1878a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:17:51.825 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.824+0000 7efaccfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:51.826 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.824+0000 7efc1878a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:17:51.827 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.824+0000 7efc1878a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:17:51.827 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.824+0000 7efc1878a9c0 5 note: GC not initialized 2024-09-12T17:17:51.827 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.824+0000 7efa477fe640 20 reqs_thread_entry: start 2024-09-12T17:17:51.827 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.824+0000 7efc1878a9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:17:51.827 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.824+0000 7efc1878a9c0 20 Filter name: none 2024-09-12T17:17:51.828 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.824+0000 7efa457fa640 20 reqs_thread_entry: start 2024-09-12T17:17:51.828 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.828+0000 7efc1878a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:51.828 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.828+0000 7efc1878a9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T17:17:51.828 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.828+0000 7efc1878a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:51.830 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.828+0000 7efc1878a9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T17:17:51.830 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.828+0000 7efc1878a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:17:51.830 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.828+0000 7efc1878a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:51.830 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.828+0000 7efc1878a9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T17:17:51.830 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.828+0000 7efc1878a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:51.831 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.828+0000 7efc1878a9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T17:17:51.831 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.828+0000 7efc1878a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:17:51.833 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.832+0000 7efaccfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:51.839 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.836+0000 7efc1878a9c0 20 remove_watcher() i=0 2024-09-12T17:17:51.839 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.836+0000 7efc1878a9c0 2 removed watcher, disabling cache 2024-09-12T17:17:51.841 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.840+0000 7efc1878a9c0 20 remove_watcher() i=1 2024-09-12T17:17:51.843 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.840+0000 7efc1878a9c0 20 remove_watcher() i=2 2024-09-12T17:17:51.845 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.844+0000 7efc1878a9c0 20 remove_watcher() i=3 2024-09-12T17:17:51.848 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.848+0000 7efc1878a9c0 20 remove_watcher() i=4 2024-09-12T17:17:51.849 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.848+0000 7efc1878a9c0 20 remove_watcher() i=5 2024-09-12T17:17:51.851 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.848+0000 7efc1878a9c0 20 remove_watcher() i=6 2024-09-12T17:17:51.852 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:51.852+0000 7efc1878a9c0 20 remove_watcher() i=7 2024-09-12T17:17:51.870 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:51.870 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:17:51.870 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: abort-at-init-indext id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:17:51.870 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:51.946 INFO:tasks.workunit.client.0.smithi016.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-09-12T17:17:51.946 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:52.401 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T17:17:52.434 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:17:52.435 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:17:52.484 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.480+0000 7fc9c70259c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:52.488 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.484+0000 7fc9c70259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:52.489 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.484+0000 7fc9c70259c0 20 realm 2024-09-12T17:17:52.489 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.484+0000 7fc9c70259c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:52.489 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.484+0000 7fc9c70259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:52.489 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.484+0000 7fc9c70259c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:17:52.489 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.484+0000 7fc9c70259c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:52.489 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.484+0000 7fc9c70259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:52.489 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.484+0000 7fc9c70259c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:52.489 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.484+0000 7fc9c70259c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:52.489 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.484+0000 7fc9c70259c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:52.490 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.488+0000 7fc9c70259c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:17:52.490 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.488+0000 7fc9c70259c0 20 searching for the correct realm 2024-09-12T17:17:52.494 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.492+0000 7fc9c432a640 0 -- 172.21.15.16:0/1473888503 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7fc9bc0c1020 msgr2=0x7fc9bc114150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:52.500 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.500+0000 7fc9c432a640 0 -- 172.21.15.16:0/1473888503 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fc9b4063f30 msgr2=0x7fc9b407d190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:17:52.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.716+0000 7fc9c70259c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:17:52.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.716+0000 7fc9c70259c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:17:52.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.716+0000 7fc9c70259c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:17:52.720 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.716+0000 7fc9c70259c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:17:52.720 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.716+0000 7fc9c70259c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:17:52.720 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.716+0000 7fc9c70259c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:17:52.720 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.716+0000 7fc9c70259c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:52.720 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.716+0000 7fc9c70259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:52.720 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.716+0000 7fc9c70259c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:52.720 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.720+0000 7fc9c70259c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:52.720 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.720+0000 7fc9c70259c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:52.721 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.720+0000 7fc9c70259c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:17:52.721 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.720+0000 7fc9c70259c0 20 zone default found 2024-09-12T17:17:52.721 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.720+0000 7fc9c70259c0 4 Realm: () 2024-09-12T17:17:52.721 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.720+0000 7fc9c70259c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:17:52.721 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.720+0000 7fc9c70259c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:17:52.722 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.720+0000 7fc9c70259c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:17:52.722 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.720+0000 7fc9c70259c0 20 zonegroup default 2024-09-12T17:17:52.722 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.720+0000 7fc9c70259c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:52.722 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.720+0000 7fc9c70259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:52.722 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.720+0000 7fc9c70259c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:52.723 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.720+0000 7fc9c70259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:52.723 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.720+0000 7fc9c70259c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:52.724 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.720+0000 7fc9c70259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:52.724 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.724+0000 7fc9c70259c0 20 started sync module instance, tier type = 2024-09-12T17:17:52.724 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.724+0000 7fc9c70259c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:17:52.748 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.748+0000 7fc9c70259c0 20 add_watcher() i=0 2024-09-12T17:17:52.748 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.748+0000 7fc9c70259c0 20 add_watcher() i=1 2024-09-12T17:17:52.748 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.748+0000 7fc9c70259c0 20 add_watcher() i=2 2024-09-12T17:17:52.748 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.748+0000 7fc9c70259c0 20 add_watcher() i=3 2024-09-12T17:17:52.749 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.748+0000 7fc9c70259c0 20 add_watcher() i=4 2024-09-12T17:17:52.749 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.748+0000 7fc9c70259c0 20 add_watcher() i=5 2024-09-12T17:17:52.749 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.748+0000 7fc9c70259c0 20 add_watcher() i=6 2024-09-12T17:17:52.750 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.748+0000 7fc9c70259c0 20 add_watcher() i=7 2024-09-12T17:17:52.750 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.748+0000 7fc9c70259c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:17:52.755 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.752+0000 7fc87afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:52.756 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.756+0000 7fc9c70259c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:17:52.756 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.756+0000 7fc9c70259c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:17:52.757 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.756+0000 7fc9c70259c0 5 note: GC not initialized 2024-09-12T17:17:52.757 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.756+0000 7fc879fe3640 20 reqs_thread_entry: start 2024-09-12T17:17:52.757 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.756+0000 7fc9c70259c0 20 init_complete bucket index max shards: 1 2024-09-12T17:17:52.758 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.756+0000 7fc9c70259c0 20 Filter name: none 2024-09-12T17:17:52.758 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.756+0000 7fc7eb7fe640 20 reqs_thread_entry: start 2024-09-12T17:17:52.758 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.756+0000 7fc9c70259c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:52.758 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.756+0000 7fc9c70259c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:17:52.758 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.756+0000 7fc9c70259c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:52.759 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.756+0000 7fc9c70259c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:17:52.759 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.756+0000 7fc9c70259c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:17:52.759 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.756+0000 7fc9c70259c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:52.760 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.756+0000 7fc9c70259c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:17:52.760 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.756+0000 7fc9c70259c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:52.760 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.756+0000 7fc9c70259c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:17:52.760 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.760+0000 7fc9c70259c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:17:52.762 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.760+0000 7fc87afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:52.769 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.768+0000 7fc9c70259c0 20 remove_watcher() i=0 2024-09-12T17:17:52.769 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.768+0000 7fc9c70259c0 2 removed watcher, disabling cache 2024-09-12T17:17:52.771 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.768+0000 7fc9c70259c0 20 remove_watcher() i=1 2024-09-12T17:17:52.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.772+0000 7fc9c70259c0 20 remove_watcher() i=2 2024-09-12T17:17:52.776 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.776+0000 7fc9c70259c0 20 remove_watcher() i=3 2024-09-12T17:17:52.778 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.776+0000 7fc9c70259c0 20 remove_watcher() i=4 2024-09-12T17:17:52.781 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.780+0000 7fc9c70259c0 20 remove_watcher() i=5 2024-09-12T17:17:52.782 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.780+0000 7fc9c70259c0 20 remove_watcher() i=6 2024-09-12T17:17:52.784 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.784+0000 7fc9c70259c0 20 remove_watcher() i=7 2024-09-12T17:17:52.809 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:52.809 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:17:52.809 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: error-at-set-target-layout id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:17:52.809 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:52.809 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-09-12T17:17:52.843 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:17:52.843 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:17:52.889 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.888+0000 7ff5cba359c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:52.891 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.888+0000 7ff5cba359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:52.892 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.888+0000 7ff5cba359c0 20 realm 2024-09-12T17:17:52.892 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.888+0000 7ff5cba359c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:52.892 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.888+0000 7ff5cba359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:52.892 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.888+0000 7ff5cba359c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:17:52.892 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.888+0000 7ff5cba359c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:52.892 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.888+0000 7ff5cba359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:52.892 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.888+0000 7ff5cba359c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:52.893 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.892+0000 7ff5cba359c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:52.894 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.892+0000 7ff5cba359c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:52.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.892+0000 7ff5cba359c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:17:52.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.892+0000 7ff5cba359c0 20 searching for the correct realm 2024-09-12T17:17:52.900 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.896+0000 7ff5c9d3c640 0 -- 172.21.15.16:0/2348280025 >> [v2:172.21.15.19:6800/1509147557,v1:172.21.15.19:6801/1509147557] conn(0x5625d13ec370 msgr2=0x5625d13ee760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:52.907 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:52.904+0000 7ff5c8d3a640 0 -- 172.21.15.16:0/2348280025 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7ff5bc00a040 msgr2=0x7ff5bc06c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:53.124 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.124+0000 7ff5cba359c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:17:53.124 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.124+0000 7ff5cba359c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:17:53.125 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.124+0000 7ff5cba359c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:17:53.125 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.124+0000 7ff5cba359c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:17:53.125 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.124+0000 7ff5cba359c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:17:53.125 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.124+0000 7ff5cba359c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:17:53.125 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.124+0000 7ff5cba359c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:53.125 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.124+0000 7ff5cba359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:53.126 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.124+0000 7ff5cba359c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:53.126 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.124+0000 7ff5cba359c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:53.126 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.124+0000 7ff5cba359c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:53.126 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.124+0000 7ff5cba359c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:17:53.126 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.124+0000 7ff5cba359c0 20 zone default found 2024-09-12T17:17:53.126 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.124+0000 7ff5cba359c0 4 Realm: () 2024-09-12T17:17:53.127 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.124+0000 7ff5cba359c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:17:53.127 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.124+0000 7ff5cba359c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:17:53.127 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.124+0000 7ff5cba359c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:17:53.127 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.124+0000 7ff5cba359c0 20 zonegroup default 2024-09-12T17:17:53.127 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.124+0000 7ff5cba359c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:53.127 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.124+0000 7ff5cba359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:53.127 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.124+0000 7ff5cba359c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:53.128 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.124+0000 7ff5cba359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:53.128 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.124+0000 7ff5cba359c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:53.128 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.128+0000 7ff5cba359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:53.129 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.128+0000 7ff5cba359c0 20 started sync module instance, tier type = 2024-09-12T17:17:53.129 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.128+0000 7ff5cba359c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:17:53.152 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.148+0000 7ff5cba359c0 20 add_watcher() i=0 2024-09-12T17:17:53.153 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.148+0000 7ff5cba359c0 20 add_watcher() i=1 2024-09-12T17:17:53.153 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.148+0000 7ff5cba359c0 20 add_watcher() i=2 2024-09-12T17:17:53.153 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.148+0000 7ff5cba359c0 20 add_watcher() i=3 2024-09-12T17:17:53.153 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.148+0000 7ff5cba359c0 20 add_watcher() i=4 2024-09-12T17:17:53.153 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.148+0000 7ff5cba359c0 20 add_watcher() i=5 2024-09-12T17:17:53.154 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.148+0000 7ff5cba359c0 20 add_watcher() i=6 2024-09-12T17:17:53.154 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.152+0000 7ff5cba359c0 20 add_watcher() i=7 2024-09-12T17:17:53.155 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.152+0000 7ff5cba359c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:17:53.159 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.156+0000 7ff47f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:53.160 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.160+0000 7ff5cba359c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:17:53.160 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.160+0000 7ff5cba359c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:17:53.161 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.160+0000 7ff5cba359c0 5 note: GC not initialized 2024-09-12T17:17:53.164 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.160+0000 7ff47e7e4640 20 reqs_thread_entry: start 2024-09-12T17:17:53.164 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.160+0000 7ff5cba359c0 20 init_complete bucket index max shards: 1 2024-09-12T17:17:53.164 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.160+0000 7ff5cba359c0 20 Filter name: none 2024-09-12T17:17:53.165 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.160+0000 7ff3effff640 20 reqs_thread_entry: start 2024-09-12T17:17:53.165 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.160+0000 7ff5cba359c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T17:17:53.165 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.160+0000 7ff5cba359c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:53.165 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.160+0000 7ff5cba359c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:17:53.166 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.160+0000 7ff5cba359c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T17:17:53.166 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.160+0000 7ff5cba359c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T17:17:53.166 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.160+0000 7ff5cba359c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22 : miss 2024-09-12T17:17:53.166 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.160+0000 7ff5cba359c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:53.166 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.160+0000 7ff5cba359c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:17:53.167 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.160+0000 7ff5cba359c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22 info.flags=0x17 2024-09-12T17:17:53.167 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.160+0000 7ff5cba359c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22 to cache LRU end 2024-09-12T17:17:53.167 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.160+0000 7ff5cba359c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:17:53.167 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.160+0000 7ff5cba359c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:17:53.167 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.160+0000 7ff5cba359c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22 2024-09-12T17:17:53.169 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.168+0000 7ff5cba359c0 -1 Injecting error=-5 at location=set_target_layout 2024-09-12T17:17:53.169 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.168+0000 7ff5cba359c0 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-09-12T17:17:53.176 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.176+0000 7ff47f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:53.182 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.180+0000 7ff5cba359c0 20 remove_watcher() i=0 2024-09-12T17:17:53.182 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.180+0000 7ff5cba359c0 2 removed watcher, disabling cache 2024-09-12T17:17:53.184 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.184+0000 7ff5cba359c0 20 remove_watcher() i=1 2024-09-12T17:17:53.187 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.184+0000 7ff5cba359c0 20 remove_watcher() i=2 2024-09-12T17:17:53.189 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.188+0000 7ff5cba359c0 20 remove_watcher() i=3 2024-09-12T17:17:53.191 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.188+0000 7ff5cba359c0 20 remove_watcher() i=4 2024-09-12T17:17:53.193 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.192+0000 7ff5cba359c0 20 remove_watcher() i=5 2024-09-12T17:17:53.194 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.192+0000 7ff5cba359c0 20 remove_watcher() i=6 2024-09-12T17:17:53.196 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.196+0000 7ff5cba359c0 20 remove_watcher() i=7 2024-09-12T17:17:53.214 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T17:17:53.245 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:17:53.245 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:17:53.293 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.292+0000 7f377118d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:53.295 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.292+0000 7f377118d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:53.295 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.292+0000 7f377118d9c0 20 realm 2024-09-12T17:17:53.295 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.292+0000 7f377118d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:53.295 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.292+0000 7f377118d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:53.295 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.292+0000 7f377118d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:17:53.296 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.292+0000 7f377118d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:53.296 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.292+0000 7f377118d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:53.296 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.292+0000 7f377118d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:53.297 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.296+0000 7f377118d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:53.297 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.296+0000 7f377118d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:53.299 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.296+0000 7f377118d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:17:53.299 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.296+0000 7f377118d9c0 20 searching for the correct realm 2024-09-12T17:17:53.305 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.300+0000 7f376f494640 0 -- 172.21.15.16:0/1511753762 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f3764078070 msgr2=0x7f376407d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:53.518 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.516+0000 7f376e492640 0 -- 172.21.15.16:0/1511753762 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f3768068150 msgr2=0x7f37680990b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:53.735 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.732+0000 7f377118d9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:17:53.736 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.732+0000 7f377118d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:17:53.736 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.732+0000 7f377118d9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:17:53.736 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.732+0000 7f377118d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:17:53.736 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.732+0000 7f377118d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:17:53.736 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.732+0000 7f377118d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:17:53.736 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.732+0000 7f377118d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:53.736 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.732+0000 7f377118d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:53.736 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.732+0000 7f377118d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:53.737 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.736+0000 7f377118d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:53.737 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.736+0000 7f377118d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:53.737 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.736+0000 7f377118d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:17:53.738 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.736+0000 7f377118d9c0 20 zone default found 2024-09-12T17:17:53.738 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.736+0000 7f377118d9c0 4 Realm: () 2024-09-12T17:17:53.738 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.736+0000 7f377118d9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:17:53.738 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.736+0000 7f377118d9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:17:53.738 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.736+0000 7f377118d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:17:53.738 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.736+0000 7f377118d9c0 20 zonegroup default 2024-09-12T17:17:53.738 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.736+0000 7f377118d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:53.738 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.736+0000 7f377118d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:53.739 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.736+0000 7f377118d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:53.739 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.736+0000 7f377118d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:53.739 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.736+0000 7f377118d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:53.740 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.740+0000 7f377118d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:53.740 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.740+0000 7f377118d9c0 20 started sync module instance, tier type = 2024-09-12T17:17:53.740 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.740+0000 7f377118d9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:17:53.765 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.764+0000 7f377118d9c0 20 add_watcher() i=0 2024-09-12T17:17:53.765 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.764+0000 7f377118d9c0 20 add_watcher() i=1 2024-09-12T17:17:53.765 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.764+0000 7f377118d9c0 20 add_watcher() i=2 2024-09-12T17:17:53.765 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.764+0000 7f377118d9c0 20 add_watcher() i=3 2024-09-12T17:17:53.766 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.764+0000 7f377118d9c0 20 add_watcher() i=4 2024-09-12T17:17:53.766 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.764+0000 7f377118d9c0 20 add_watcher() i=5 2024-09-12T17:17:53.766 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.764+0000 7f377118d9c0 20 add_watcher() i=6 2024-09-12T17:17:53.768 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.768+0000 7f377118d9c0 20 add_watcher() i=7 2024-09-12T17:17:53.768 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.768+0000 7f377118d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:17:53.772 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.772+0000 7f36257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:53.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.772+0000 7f377118d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:17:53.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.772+0000 7f377118d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:17:53.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.772+0000 7f377118d9c0 5 note: GC not initialized 2024-09-12T17:17:53.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.772+0000 7f359ffff640 20 reqs_thread_entry: start 2024-09-12T17:17:53.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.772+0000 7f377118d9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:17:53.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.772+0000 7f377118d9c0 20 Filter name: none 2024-09-12T17:17:53.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.772+0000 7f359dffb640 20 reqs_thread_entry: start 2024-09-12T17:17:53.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.772+0000 7f377118d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:53.775 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.772+0000 7f377118d9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:17:53.775 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.772+0000 7f377118d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:53.776 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.772+0000 7f377118d9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:17:53.776 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.772+0000 7f377118d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:17:53.776 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.772+0000 7f377118d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:53.776 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.776+0000 7f377118d9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:17:53.776 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.776+0000 7f377118d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:53.777 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.776+0000 7f377118d9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:17:53.777 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.776+0000 7f377118d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:17:53.778 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.776+0000 7f36257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:53.783 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.780+0000 7f377118d9c0 20 remove_watcher() i=0 2024-09-12T17:17:53.784 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.780+0000 7f377118d9c0 2 removed watcher, disabling cache 2024-09-12T17:17:53.786 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.784+0000 7f377118d9c0 20 remove_watcher() i=1 2024-09-12T17:17:53.788 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.788+0000 7f377118d9c0 20 remove_watcher() i=2 2024-09-12T17:17:53.790 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.788+0000 7f377118d9c0 20 remove_watcher() i=3 2024-09-12T17:17:53.793 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.792+0000 7f377118d9c0 20 remove_watcher() i=4 2024-09-12T17:17:53.794 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.792+0000 7f377118d9c0 20 remove_watcher() i=5 2024-09-12T17:17:53.796 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.796+0000 7f377118d9c0 20 remove_watcher() i=6 2024-09-12T17:17:53.798 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.796+0000 7f377118d9c0 20 remove_watcher() i=7 2024-09-12T17:17:53.821 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:53.821 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:17:53.821 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: error-at-set-target-layout id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:17:53.821 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:53.878 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:17:53.916 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:17:53.916 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:17:53.962 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.960+0000 7f4fd678f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:53.964 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.964+0000 7f4fd678f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:53.964 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.964+0000 7f4fd678f9c0 20 realm 2024-09-12T17:17:53.965 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.964+0000 7f4fd678f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:53.965 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.964+0000 7f4fd678f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:53.965 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.964+0000 7f4fd678f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:17:53.965 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.964+0000 7f4fd678f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:53.965 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.964+0000 7f4fd678f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:53.965 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.964+0000 7f4fd678f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:53.966 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.964+0000 7f4fd678f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:53.966 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.964+0000 7f4fd678f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:53.968 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.968+0000 7f4fd678f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:17:53.968 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.968+0000 7f4fd678f9c0 20 searching for the correct realm 2024-09-12T17:17:53.971 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.968+0000 7f4fd4a96640 0 -- 172.21.15.16:0/4030584237 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f4fc8088b40 msgr2=0x7f4fc80678b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:53.979 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:53.976+0000 7f4fd3a94640 0 -- 172.21.15.16:0/4030584237 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f4fc40fd040 msgr2=0x7f4fc40eb940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:54.197 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.196+0000 7f4fd678f9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:17:54.197 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.196+0000 7f4fd678f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:17:54.197 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.196+0000 7f4fd678f9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:17:54.197 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.196+0000 7f4fd678f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:17:54.197 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.196+0000 7f4fd678f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:17:54.197 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.196+0000 7f4fd678f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:17:54.197 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.196+0000 7f4fd678f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:54.198 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.196+0000 7f4fd678f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:54.198 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.196+0000 7f4fd678f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:54.198 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.196+0000 7f4fd678f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:54.199 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.196+0000 7f4fd678f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:54.200 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.196+0000 7f4fd678f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:17:54.200 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.196+0000 7f4fd678f9c0 20 zone default found 2024-09-12T17:17:54.200 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.196+0000 7f4fd678f9c0 4 Realm: () 2024-09-12T17:17:54.200 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.196+0000 7f4fd678f9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:17:54.200 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.196+0000 7f4fd678f9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:17:54.200 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.196+0000 7f4fd678f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:17:54.200 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.196+0000 7f4fd678f9c0 20 zonegroup default 2024-09-12T17:17:54.200 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.196+0000 7f4fd678f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:54.200 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.200+0000 7f4fd678f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:54.201 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.200+0000 7f4fd678f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:54.201 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.200+0000 7f4fd678f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:54.201 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.200+0000 7f4fd678f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:54.202 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.200+0000 7f4fd678f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:54.202 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.200+0000 7f4fd678f9c0 20 started sync module instance, tier type = 2024-09-12T17:17:54.202 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.200+0000 7f4fd678f9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:17:54.224 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.220+0000 7f4fd678f9c0 20 add_watcher() i=0 2024-09-12T17:17:54.224 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.220+0000 7f4fd678f9c0 20 add_watcher() i=1 2024-09-12T17:17:54.224 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.220+0000 7f4fd678f9c0 20 add_watcher() i=2 2024-09-12T17:17:54.224 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.220+0000 7f4fd678f9c0 20 add_watcher() i=3 2024-09-12T17:17:54.224 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.220+0000 7f4fd678f9c0 20 add_watcher() i=4 2024-09-12T17:17:54.225 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.220+0000 7f4fd678f9c0 20 add_watcher() i=5 2024-09-12T17:17:54.225 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.224+0000 7f4fd678f9c0 20 add_watcher() i=6 2024-09-12T17:17:54.226 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.224+0000 7f4fd678f9c0 20 add_watcher() i=7 2024-09-12T17:17:54.226 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.224+0000 7f4fd678f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:17:54.229 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.228+0000 7f4e8b7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:54.230 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.228+0000 7f4fd678f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:17:54.230 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.228+0000 7f4fd678f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:17:54.230 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.228+0000 7f4fd678f9c0 5 note: GC not initialized 2024-09-12T17:17:54.231 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.228+0000 7f4e8a7dc640 20 reqs_thread_entry: start 2024-09-12T17:17:54.231 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.228+0000 7f4fd678f9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:17:54.231 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.228+0000 7f4fd678f9c0 20 Filter name: none 2024-09-12T17:17:54.231 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.228+0000 7f4e837fe640 20 reqs_thread_entry: start 2024-09-12T17:17:54.231 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.228+0000 7f4fd678f9c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T17:17:54.231 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.228+0000 7f4fd678f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:54.232 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.228+0000 7f4fd678f9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:17:54.232 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.228+0000 7f4fd678f9c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T17:17:54.232 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.228+0000 7f4fd678f9c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T17:17:54.233 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.228+0000 7f4fd678f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22 : miss 2024-09-12T17:17:54.233 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.228+0000 7f4fd678f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:54.233 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.232+0000 7f4fd678f9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:17:54.233 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.232+0000 7f4fd678f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22 info.flags=0x17 2024-09-12T17:17:54.233 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.232+0000 7f4fd678f9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22 to cache LRU end 2024-09-12T17:17:54.233 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.232+0000 7f4fd678f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:17:54.233 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.232+0000 7f4fd678f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:17:54.233 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.232+0000 7f4fd678f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22 2024-09-12T17:17:54.241 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.240+0000 7f4fd678f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22 info.flags=0x17 2024-09-12T17:17:54.241 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.240+0000 7f4fd678f9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22 to cache LRU end 2024-09-12T17:17:54.241 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.240+0000 7f4fd678f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:17:54.241 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.240+0000 7f4fd678f9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22, ofs0, ns] 2024-09-12T17:17:54.242 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.240+0000 7f4eab7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431589 cookie 94807526708336 notifier 6468 bl.length()=925 2024-09-12T17:17:54.242 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.240+0000 7f4eab7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22 info.flags=0x17 2024-09-12T17:17:54.242 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.240+0000 7f4eab7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22 to cache LRU end 2024-09-12T17:17:54.242 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.240+0000 7f4eab7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:17:54.243 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.240+0000 7f4fd678f9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22]): orig_sources= new_sources= 2024-09-12T17:17:54.243 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.240+0000 7f4fd678f9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22]): potential sources added=[] removed=[] 2024-09-12T17:17:54.243 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.240+0000 7f4fd678f9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22]): orig_dests= new_dests= 2024-09-12T17:17:54.243 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.240+0000 7f4fd678f9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22]): potential dests added=[] removed=[] 2024-09-12T17:17:54.246 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.244+0000 7f4fd678f9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22.1.0 2024-09-12T17:17:54.246 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.244+0000 7f4fd678f9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22.1.0 2024-09-12T17:17:54.246 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.244+0000 7f4fd678f9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22.1.1 2024-09-12T17:17:54.247 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.244+0000 7f4fd678f9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22.1.1 2024-09-12T17:17:54.247 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.244+0000 7f4fd678f9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22.0 2024-09-12T17:17:54.250 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.248+0000 7f4fd678f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22 : hit (requested=0x17, cached=0x17) 2024-09-12T17:17:54.251 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.248+0000 7f4fd678f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22 2024-09-12T17:17:54.252 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.252+0000 7f4fd678f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22 info.flags=0x17 2024-09-12T17:17:54.253 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.252+0000 7f4fd678f9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22 to cache LRU end 2024-09-12T17:17:54.253 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.252+0000 7f4fd678f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:17:54.253 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.252+0000 7f4fd678f9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22, ofs0, ns] 2024-09-12T17:17:54.253 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.252+0000 7f4eaaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431590 cookie 94807526708336 notifier 6468 bl.length()=925 2024-09-12T17:17:54.254 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.252+0000 7f4eaaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22 info.flags=0x17 2024-09-12T17:17:54.254 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.252+0000 7f4eaaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22 to cache LRU end 2024-09-12T17:17:54.254 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.252+0000 7f4eaaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:17:54.255 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.252+0000 7f4fd678f9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22]): orig_sources= new_sources= 2024-09-12T17:17:54.255 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.252+0000 7f4fd678f9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22]): potential sources added=[] removed=[] 2024-09-12T17:17:54.255 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.252+0000 7f4fd678f9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22]): orig_dests= new_dests= 2024-09-12T17:17:54.255 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.252+0000 7f4fd678f9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22]): potential dests added=[] removed=[] 2024-09-12T17:17:54.256 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.256+0000 7f4fd678f9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22.0 2024-09-12T17:17:54.257 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.256+0000 7f4fd678f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22 : hit (requested=0x17, cached=0x17) 2024-09-12T17:17:54.257 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.256+0000 7f4fd678f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22 2024-09-12T17:17:54.259 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.256+0000 7f4fd678f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22 info.flags=0x17 2024-09-12T17:17:54.259 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.256+0000 7f4fd678f9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22 to cache LRU end 2024-09-12T17:17:54.259 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.256+0000 7f4fd678f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:17:54.259 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.256+0000 7f4fd678f9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22, ofs0, ns] 2024-09-12T17:17:54.260 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.256+0000 7f4eab7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431591 cookie 94807526708336 notifier 6468 bl.length()=893 2024-09-12T17:17:54.260 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.256+0000 7f4eab7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22 info.flags=0x17 2024-09-12T17:17:54.260 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.256+0000 7f4eab7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22 to cache LRU end 2024-09-12T17:17:54.260 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.256+0000 7f4eab7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:17:54.261 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.260+0000 7f4fd678f9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22]): orig_sources= new_sources= 2024-09-12T17:17:54.261 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.260+0000 7f4fd678f9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22]): potential sources added=[] removed=[] 2024-09-12T17:17:54.261 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.260+0000 7f4fd678f9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22]): orig_dests= new_dests= 2024-09-12T17:17:54.261 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.260+0000 7f4fd678f9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22]): potential dests added=[] removed=[] 2024-09-12T17:17:54.262 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.260+0000 7f4fd678f9c0 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T17:17:54.267 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.264+0000 7f4e8b7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:54.272 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.272+0000 7f4fd678f9c0 20 remove_watcher() i=0 2024-09-12T17:17:54.272 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.272+0000 7f4fd678f9c0 2 removed watcher, disabling cache 2024-09-12T17:17:54.274 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.272+0000 7f4fd678f9c0 20 remove_watcher() i=1 2024-09-12T17:17:54.276 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.276+0000 7f4fd678f9c0 20 remove_watcher() i=2 2024-09-12T17:17:54.279 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.276+0000 7f4fd678f9c0 20 remove_watcher() i=3 2024-09-12T17:17:54.281 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.280+0000 7f4fd678f9c0 20 remove_watcher() i=4 2024-09-12T17:17:54.282 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.280+0000 7f4fd678f9c0 20 remove_watcher() i=5 2024-09-12T17:17:54.284 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.284+0000 7f4fd678f9c0 20 remove_watcher() i=6 2024-09-12T17:17:54.286 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.284+0000 7f4fd678f9c0 20 remove_watcher() i=7 2024-09-12T17:17:54.301 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T17:17:54.329 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:17:54.329 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:17:54.375 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.372+0000 7f31787989c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:54.378 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.376+0000 7f31787989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:54.378 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.376+0000 7f31787989c0 20 realm 2024-09-12T17:17:54.378 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.376+0000 7f31787989c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:54.378 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.376+0000 7f31787989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:54.378 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.376+0000 7f31787989c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:17:54.378 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.376+0000 7f31787989c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:54.378 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.376+0000 7f31787989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:54.378 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.376+0000 7f31787989c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:54.379 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.376+0000 7f31787989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:54.379 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.376+0000 7f31787989c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:54.381 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.380+0000 7f31787989c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:17:54.381 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.380+0000 7f31787989c0 20 searching for the correct realm 2024-09-12T17:17:54.384 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.384+0000 7f3176a9f640 0 -- 172.21.15.16:0/1117367374 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x563fe3f8cfb0 msgr2=0x7f3160008430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:54.392 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.392+0000 7f3175a9d640 0 -- 172.21.15.16:0/1117367374 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f31700c1020 msgr2=0x7f3170110140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:54.613 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.612+0000 7f31787989c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:17:54.613 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.612+0000 7f31787989c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:17:54.613 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.612+0000 7f31787989c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:17:54.613 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.612+0000 7f31787989c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:17:54.613 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.612+0000 7f31787989c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:17:54.613 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.612+0000 7f31787989c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:17:54.613 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.612+0000 7f31787989c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:54.614 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.612+0000 7f31787989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:54.614 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.612+0000 7f31787989c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:54.614 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.612+0000 7f31787989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:54.614 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.612+0000 7f31787989c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:54.616 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.612+0000 7f31787989c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:17:54.616 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.612+0000 7f31787989c0 20 zone default found 2024-09-12T17:17:54.616 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.612+0000 7f31787989c0 4 Realm: () 2024-09-12T17:17:54.616 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.612+0000 7f31787989c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:17:54.616 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.612+0000 7f31787989c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:17:54.616 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.612+0000 7f31787989c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:17:54.616 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.612+0000 7f31787989c0 20 zonegroup default 2024-09-12T17:17:54.616 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.612+0000 7f31787989c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:54.617 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.616+0000 7f31787989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:54.617 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.616+0000 7f31787989c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:54.617 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.616+0000 7f31787989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:54.617 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.616+0000 7f31787989c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:54.617 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.616+0000 7f31787989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:54.618 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.616+0000 7f31787989c0 20 started sync module instance, tier type = 2024-09-12T17:17:54.618 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.616+0000 7f31787989c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:17:54.639 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.636+0000 7f31787989c0 20 add_watcher() i=0 2024-09-12T17:17:54.639 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.636+0000 7f31787989c0 20 add_watcher() i=1 2024-09-12T17:17:54.639 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.636+0000 7f31787989c0 20 add_watcher() i=2 2024-09-12T17:17:54.639 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.636+0000 7f31787989c0 20 add_watcher() i=3 2024-09-12T17:17:54.639 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.636+0000 7f31787989c0 20 add_watcher() i=4 2024-09-12T17:17:54.639 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.636+0000 7f31787989c0 20 add_watcher() i=5 2024-09-12T17:17:54.639 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.636+0000 7f31787989c0 20 add_watcher() i=6 2024-09-12T17:17:54.641 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.640+0000 7f31787989c0 20 add_watcher() i=7 2024-09-12T17:17:54.641 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.640+0000 7f31787989c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:17:54.644 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.644+0000 7f302cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:54.645 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.644+0000 7f31787989c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:17:54.645 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.644+0000 7f31787989c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:17:54.646 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.644+0000 7f31787989c0 5 note: GC not initialized 2024-09-12T17:17:54.646 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.644+0000 7f2fa77fe640 20 reqs_thread_entry: start 2024-09-12T17:17:54.646 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.644+0000 7f31787989c0 20 init_complete bucket index max shards: 1 2024-09-12T17:17:54.646 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.644+0000 7f31787989c0 20 Filter name: none 2024-09-12T17:17:54.647 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.644+0000 7f2fa57fa640 20 reqs_thread_entry: start 2024-09-12T17:17:54.647 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.644+0000 7f31787989c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:54.647 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.644+0000 7f31787989c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:17:54.647 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.644+0000 7f31787989c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:54.648 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.648+0000 7f31787989c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:17:54.648 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.648+0000 7f31787989c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:17:54.648 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.648+0000 7f31787989c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:54.649 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.648+0000 7f31787989c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:17:54.649 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.648+0000 7f31787989c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:54.650 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.648+0000 7f31787989c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:17:54.650 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.648+0000 7f31787989c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:17:54.653 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.652+0000 7f302cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:54.658 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.656+0000 7f31787989c0 20 remove_watcher() i=0 2024-09-12T17:17:54.658 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.656+0000 7f31787989c0 2 removed watcher, disabling cache 2024-09-12T17:17:54.661 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.660+0000 7f31787989c0 20 remove_watcher() i=1 2024-09-12T17:17:54.663 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.660+0000 7f31787989c0 20 remove_watcher() i=2 2024-09-12T17:17:54.665 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.664+0000 7f31787989c0 20 remove_watcher() i=3 2024-09-12T17:17:54.667 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.664+0000 7f31787989c0 20 remove_watcher() i=4 2024-09-12T17:17:54.669 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.668+0000 7f31787989c0 20 remove_watcher() i=5 2024-09-12T17:17:54.670 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.668+0000 7f31787989c0 20 remove_watcher() i=6 2024-09-12T17:17:54.672 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:54.672+0000 7f31787989c0 20 remove_watcher() i=7 2024-09-12T17:17:54.696 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:54.697 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:17:54.697 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: error-at-set-target-layout id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:17:54.697 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:54.785 INFO:tasks.workunit.client.0.smithi016.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-09-12T17:17:54.785 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:55.216 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T17:17:55.251 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:17:55.251 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:17:55.300 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.300+0000 7f5f214289c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:55.303 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.300+0000 7f5f214289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:55.303 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.300+0000 7f5f214289c0 20 realm 2024-09-12T17:17:55.303 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.300+0000 7f5f214289c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:55.303 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.300+0000 7f5f214289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:55.303 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.300+0000 7f5f214289c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:17:55.303 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.300+0000 7f5f214289c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:55.303 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.300+0000 7f5f214289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:55.303 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.300+0000 7f5f214289c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:55.305 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.304+0000 7f5f214289c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:55.305 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.304+0000 7f5f214289c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:55.306 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.304+0000 7f5f214289c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:17:55.307 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.304+0000 7f5f214289c0 20 searching for the correct realm 2024-09-12T17:17:55.310 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.308+0000 7f5f1f72f640 0 -- 172.21.15.16:0/3901067701 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f5f1405bcc0 msgr2=0x7f5f14063a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:55.319 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.316+0000 7f5f1e72d640 0 -- 172.21.15.16:0/3901067701 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f5f18017020 msgr2=0x7f5f18055420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:55.536 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.536+0000 7f5f214289c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:17:55.536 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.536+0000 7f5f214289c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:17:55.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.536+0000 7f5f214289c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:17:55.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.536+0000 7f5f214289c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:17:55.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.536+0000 7f5f214289c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:17:55.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.536+0000 7f5f214289c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:17:55.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.536+0000 7f5f214289c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:55.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.536+0000 7f5f214289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:55.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.536+0000 7f5f214289c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:55.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.536+0000 7f5f214289c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:55.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.536+0000 7f5f214289c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:55.539 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.536+0000 7f5f214289c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:17:55.539 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.536+0000 7f5f214289c0 20 zone default found 2024-09-12T17:17:55.539 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.536+0000 7f5f214289c0 4 Realm: () 2024-09-12T17:17:55.539 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.536+0000 7f5f214289c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:17:55.539 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.536+0000 7f5f214289c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:17:55.539 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.536+0000 7f5f214289c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:17:55.539 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.536+0000 7f5f214289c0 20 zonegroup default 2024-09-12T17:17:55.539 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.536+0000 7f5f214289c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:55.540 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.536+0000 7f5f214289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:55.540 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.536+0000 7f5f214289c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:55.541 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.540+0000 7f5f214289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:55.541 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.540+0000 7f5f214289c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:55.542 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.540+0000 7f5f214289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:55.542 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.540+0000 7f5f214289c0 20 started sync module instance, tier type = 2024-09-12T17:17:55.542 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.540+0000 7f5f214289c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:17:55.566 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.564+0000 7f5f214289c0 20 add_watcher() i=0 2024-09-12T17:17:55.566 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.564+0000 7f5f214289c0 20 add_watcher() i=1 2024-09-12T17:17:55.566 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.564+0000 7f5f214289c0 20 add_watcher() i=2 2024-09-12T17:17:55.566 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.564+0000 7f5f214289c0 20 add_watcher() i=3 2024-09-12T17:17:55.566 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.564+0000 7f5f214289c0 20 add_watcher() i=4 2024-09-12T17:17:55.566 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.564+0000 7f5f214289c0 20 add_watcher() i=5 2024-09-12T17:17:55.566 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.564+0000 7f5f214289c0 20 add_watcher() i=6 2024-09-12T17:17:55.568 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.568+0000 7f5f214289c0 20 add_watcher() i=7 2024-09-12T17:17:55.568 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.568+0000 7f5f214289c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:17:55.574 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.572+0000 7f5dd5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:55.575 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.572+0000 7f5f214289c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:17:55.575 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.572+0000 7f5f214289c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:17:55.575 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.572+0000 7f5f214289c0 5 note: GC not initialized 2024-09-12T17:17:55.576 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.572+0000 7f5dd4fe1640 20 reqs_thread_entry: start 2024-09-12T17:17:55.576 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.572+0000 7f5f214289c0 20 init_complete bucket index max shards: 1 2024-09-12T17:17:55.576 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.572+0000 7f5f214289c0 20 Filter name: none 2024-09-12T17:17:55.576 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.576+0000 7f5dcdffb640 20 reqs_thread_entry: start 2024-09-12T17:17:55.577 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.576+0000 7f5f214289c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:55.577 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.576+0000 7f5f214289c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:17:55.577 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.576+0000 7f5f214289c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:55.578 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.576+0000 7f5f214289c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:17:55.578 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.576+0000 7f5f214289c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:17:55.578 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.576+0000 7f5f214289c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:55.579 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.576+0000 7f5f214289c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:17:55.579 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.576+0000 7f5f214289c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:55.579 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.576+0000 7f5f214289c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:17:55.579 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.576+0000 7f5f214289c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:17:55.582 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.580+0000 7f5dd5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:55.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.588+0000 7f5f214289c0 20 remove_watcher() i=0 2024-09-12T17:17:55.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.588+0000 7f5f214289c0 2 removed watcher, disabling cache 2024-09-12T17:17:55.590 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.588+0000 7f5f214289c0 20 remove_watcher() i=1 2024-09-12T17:17:55.593 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.592+0000 7f5f214289c0 20 remove_watcher() i=2 2024-09-12T17:17:55.595 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.592+0000 7f5f214289c0 20 remove_watcher() i=3 2024-09-12T17:17:55.597 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.596+0000 7f5f214289c0 20 remove_watcher() i=4 2024-09-12T17:17:55.599 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.596+0000 7f5f214289c0 20 remove_watcher() i=5 2024-09-12T17:17:55.600 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.600+0000 7f5f214289c0 20 remove_watcher() i=6 2024-09-12T17:17:55.601 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.600+0000 7f5f214289c0 20 remove_watcher() i=7 2024-09-12T17:17:55.617 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:55.617 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:17:55.617 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: error-at-set-target-layout id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:17:55.617 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:55.618 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-09-12T17:17:55.659 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:17:55.659 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:17:55.705 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.704+0000 7f9a957989c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:55.707 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.704+0000 7f9a957989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:55.707 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.704+0000 7f9a957989c0 20 realm 2024-09-12T17:17:55.707 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.704+0000 7f9a957989c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:55.707 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.704+0000 7f9a957989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:55.707 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.704+0000 7f9a957989c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:17:55.707 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.704+0000 7f9a957989c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:55.707 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.704+0000 7f9a957989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:55.708 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.704+0000 7f9a957989c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:55.708 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.708+0000 7f9a957989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:55.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.708+0000 7f9a957989c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:55.710 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.708+0000 7f9a957989c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:17:55.710 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.708+0000 7f9a957989c0 20 searching for the correct realm 2024-09-12T17:17:55.714 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.712+0000 7f9a93a9f640 0 -- 172.21.15.16:0/1107105877 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f9a8804d020 msgr2=0x7f9a88044a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:17:55.722 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.720+0000 7f9a92a9d640 0 -- 172.21.15.16:0/1107105877 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f9a8c0e0b60 msgr2=0x7f9a8c0c2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:55.940 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.936+0000 7f9a957989c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:17:55.940 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.936+0000 7f9a957989c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:17:55.940 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.936+0000 7f9a957989c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:17:55.940 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.936+0000 7f9a957989c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:17:55.940 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.936+0000 7f9a957989c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:17:55.941 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.936+0000 7f9a957989c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:17:55.941 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.936+0000 7f9a957989c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:55.941 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.940+0000 7f9a957989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:55.941 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.940+0000 7f9a957989c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:55.942 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.940+0000 7f9a957989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:55.942 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.940+0000 7f9a957989c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:55.942 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.940+0000 7f9a957989c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:17:55.942 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.940+0000 7f9a957989c0 20 zone default found 2024-09-12T17:17:55.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.940+0000 7f9a957989c0 4 Realm: () 2024-09-12T17:17:55.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.940+0000 7f9a957989c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:17:55.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.940+0000 7f9a957989c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:17:55.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.940+0000 7f9a957989c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:17:55.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.940+0000 7f9a957989c0 20 zonegroup default 2024-09-12T17:17:55.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.940+0000 7f9a957989c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:55.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.940+0000 7f9a957989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:55.944 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.940+0000 7f9a957989c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:55.944 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.944+0000 7f9a957989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:55.944 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.944+0000 7f9a957989c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:55.945 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.944+0000 7f9a957989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:55.945 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.944+0000 7f9a957989c0 20 started sync module instance, tier type = 2024-09-12T17:17:55.945 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.944+0000 7f9a957989c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:17:55.969 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.968+0000 7f9a957989c0 20 add_watcher() i=0 2024-09-12T17:17:55.969 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.968+0000 7f9a957989c0 20 add_watcher() i=1 2024-09-12T17:17:55.969 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.968+0000 7f9a957989c0 20 add_watcher() i=2 2024-09-12T17:17:55.969 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.968+0000 7f9a957989c0 20 add_watcher() i=3 2024-09-12T17:17:55.969 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.968+0000 7f9a957989c0 20 add_watcher() i=4 2024-09-12T17:17:55.969 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.968+0000 7f9a957989c0 20 add_watcher() i=5 2024-09-12T17:17:55.969 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.968+0000 7f9a957989c0 20 add_watcher() i=6 2024-09-12T17:17:55.971 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.968+0000 7f9a957989c0 20 add_watcher() i=7 2024-09-12T17:17:55.971 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.968+0000 7f9a957989c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:17:55.975 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.972+0000 7f9949fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:55.976 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.976+0000 7f9a957989c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:17:55.976 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.976+0000 7f9a957989c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:17:55.976 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.976+0000 7f9a957989c0 5 note: GC not initialized 2024-09-12T17:17:55.977 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.976+0000 7f9948fe1640 20 reqs_thread_entry: start 2024-09-12T17:17:55.977 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.976+0000 7f9a957989c0 20 init_complete bucket index max shards: 1 2024-09-12T17:17:55.978 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.976+0000 7f9a957989c0 20 Filter name: none 2024-09-12T17:17:55.978 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.976+0000 7f98c27fc640 20 reqs_thread_entry: start 2024-09-12T17:17:55.978 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.976+0000 7f9a957989c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T17:17:55.978 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.976+0000 7f9a957989c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:55.979 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.976+0000 7f9a957989c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:17:55.979 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.976+0000 7f9a957989c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T17:17:55.979 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.976+0000 7f9a957989c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T17:17:55.979 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.976+0000 7f9a957989c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23 : miss 2024-09-12T17:17:55.979 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.976+0000 7f9a957989c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:55.980 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.976+0000 7f9a957989c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:17:55.980 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.976+0000 7f9a957989c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23 info.flags=0x17 2024-09-12T17:17:55.980 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.976+0000 7f9a957989c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23 to cache LRU end 2024-09-12T17:17:55.980 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.976+0000 7f9a957989c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:17:55.980 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.976+0000 7f9a957989c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:17:55.980 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.976+0000 7f9a957989c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23 2024-09-12T17:17:55.985 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.984+0000 7f9a957989c0 -1 Injecting error=-125 at location=set_target_layout 2024-09-12T17:17:55.989 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.988+0000 7f9a957989c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23 info.flags=0x17 2024-09-12T17:17:55.989 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.988+0000 7f9a957989c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23 to cache LRU end 2024-09-12T17:17:55.989 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.988+0000 7f9a957989c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:17:55.989 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.988+0000 7f9a957989c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23, ofs0, ns] 2024-09-12T17:17:55.990 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.988+0000 7f9976ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431594 cookie 94729415531824 notifier 6522 bl.length()=925 2024-09-12T17:17:55.990 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.988+0000 7f9976ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23 info.flags=0x17 2024-09-12T17:17:55.990 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.988+0000 7f9976ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23 to cache LRU end 2024-09-12T17:17:55.990 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.988+0000 7f9976ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:17:55.990 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.988+0000 7f9a957989c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23]): orig_sources= new_sources= 2024-09-12T17:17:55.991 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.988+0000 7f9a957989c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23]): potential sources added=[] removed=[] 2024-09-12T17:17:55.991 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.988+0000 7f9a957989c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23]): orig_dests= new_dests= 2024-09-12T17:17:55.991 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.988+0000 7f9a957989c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23]): potential dests added=[] removed=[] 2024-09-12T17:17:55.997 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.996+0000 7f9a957989c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23.1.0 2024-09-12T17:17:55.997 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.996+0000 7f9a957989c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23.1.0 2024-09-12T17:17:55.997 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.996+0000 7f9a957989c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23.1.1 2024-09-12T17:17:55.997 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.996+0000 7f9a957989c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23.1.1 2024-09-12T17:17:55.998 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:55.996+0000 7f9a957989c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23.0 2024-09-12T17:17:56.003 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.000+0000 7f9a957989c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23 : hit (requested=0x17, cached=0x17) 2024-09-12T17:17:56.004 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.000+0000 7f9a957989c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23 2024-09-12T17:17:56.007 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.004+0000 7f9a957989c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23 info.flags=0x17 2024-09-12T17:17:56.007 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.004+0000 7f9a957989c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23 to cache LRU end 2024-09-12T17:17:56.007 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.004+0000 7f9a957989c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:17:56.007 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.004+0000 7f9a957989c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23, ofs0, ns] 2024-09-12T17:17:56.008 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.008+0000 7f99767fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431595 cookie 94729415531824 notifier 6522 bl.length()=925 2024-09-12T17:17:56.008 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.008+0000 7f99767fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23 info.flags=0x17 2024-09-12T17:17:56.008 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.008+0000 7f99767fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23 to cache LRU end 2024-09-12T17:17:56.008 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.008+0000 7f99767fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:17:56.009 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.008+0000 7f9a957989c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23]): orig_sources= new_sources= 2024-09-12T17:17:56.009 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.008+0000 7f9a957989c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23]): potential sources added=[] removed=[] 2024-09-12T17:17:56.009 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.008+0000 7f9a957989c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23]): orig_dests= new_dests= 2024-09-12T17:17:56.009 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.008+0000 7f9a957989c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23]): potential dests added=[] removed=[] 2024-09-12T17:17:56.012 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.012+0000 7f9a957989c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23.0 2024-09-12T17:17:56.013 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.012+0000 7f9a957989c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23 : hit (requested=0x17, cached=0x17) 2024-09-12T17:17:56.013 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.012+0000 7f9a957989c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23 2024-09-12T17:17:56.017 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.016+0000 7f9a957989c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23 info.flags=0x17 2024-09-12T17:17:56.017 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.016+0000 7f9a957989c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23 to cache LRU end 2024-09-12T17:17:56.017 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.016+0000 7f9a957989c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:17:56.017 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.016+0000 7f9a957989c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23, ofs0, ns] 2024-09-12T17:17:56.017 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.016+0000 7f9976ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431596 cookie 94729415531824 notifier 6522 bl.length()=893 2024-09-12T17:17:56.018 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.016+0000 7f9976ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23 info.flags=0x17 2024-09-12T17:17:56.018 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.016+0000 7f9976ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23 to cache LRU end 2024-09-12T17:17:56.018 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.016+0000 7f9976ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:17:56.019 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.016+0000 7f9a957989c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23]): orig_sources= new_sources= 2024-09-12T17:17:56.019 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.016+0000 7f9a957989c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23]): potential sources added=[] removed=[] 2024-09-12T17:17:56.019 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.016+0000 7f9a957989c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23]): orig_dests= new_dests= 2024-09-12T17:17:56.019 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.016+0000 7f9a957989c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23]): potential dests added=[] removed=[] 2024-09-12T17:17:56.022 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.020+0000 7f9a957989c0 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T17:17:56.026 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.024+0000 7f9949fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:56.032 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.028+0000 7f9a957989c0 20 remove_watcher() i=0 2024-09-12T17:17:56.032 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.028+0000 7f9a957989c0 2 removed watcher, disabling cache 2024-09-12T17:17:56.034 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.032+0000 7f9a957989c0 20 remove_watcher() i=1 2024-09-12T17:17:56.037 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.036+0000 7f9a957989c0 20 remove_watcher() i=2 2024-09-12T17:17:56.039 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.036+0000 7f9a957989c0 20 remove_watcher() i=3 2024-09-12T17:17:56.041 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.040+0000 7f9a957989c0 20 remove_watcher() i=4 2024-09-12T17:17:56.043 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.040+0000 7f9a957989c0 20 remove_watcher() i=5 2024-09-12T17:17:56.045 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.044+0000 7f9a957989c0 20 remove_watcher() i=6 2024-09-12T17:17:56.047 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.044+0000 7f9a957989c0 20 remove_watcher() i=7 2024-09-12T17:17:56.066 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T17:17:56.100 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:17:56.100 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:17:56.147 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.144+0000 7f7e3b8299c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:56.149 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.148+0000 7f7e3b8299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:56.149 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.148+0000 7f7e3b8299c0 20 realm 2024-09-12T17:17:56.149 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.148+0000 7f7e3b8299c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:56.150 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.148+0000 7f7e3b8299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:56.150 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.148+0000 7f7e3b8299c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:17:56.150 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.148+0000 7f7e3b8299c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:56.150 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.148+0000 7f7e3b8299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:56.150 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.148+0000 7f7e3b8299c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:56.151 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.148+0000 7f7e3b8299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:56.152 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.148+0000 7f7e3b8299c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:56.153 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.152+0000 7f7e3b8299c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:17:56.154 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.152+0000 7f7e3b8299c0 20 searching for the correct realm 2024-09-12T17:17:56.156 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.156+0000 7f7e39b30640 0 -- 172.21.15.16:0/4057719821 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f7e30039070 msgr2=0x7f7e30039450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:56.374 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.372+0000 7f7e38b2e640 0 -- 172.21.15.16:0/4057719821 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f7e34063e20 msgr2=0x7f7e3406c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:17:56.592 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.592+0000 7f7e3b8299c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:17:56.592 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.592+0000 7f7e3b8299c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:17:56.592 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.592+0000 7f7e3b8299c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:17:56.593 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.592+0000 7f7e3b8299c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:17:56.593 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.592+0000 7f7e3b8299c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:17:56.593 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.592+0000 7f7e3b8299c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:17:56.593 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.592+0000 7f7e3b8299c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:56.593 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.592+0000 7f7e3b8299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:56.593 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.592+0000 7f7e3b8299c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:56.594 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.592+0000 7f7e3b8299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:56.594 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.592+0000 7f7e3b8299c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:56.595 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.592+0000 7f7e3b8299c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:17:56.595 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.592+0000 7f7e3b8299c0 20 zone default found 2024-09-12T17:17:56.595 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.592+0000 7f7e3b8299c0 4 Realm: () 2024-09-12T17:17:56.595 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.592+0000 7f7e3b8299c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:17:56.595 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.592+0000 7f7e3b8299c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:17:56.595 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.592+0000 7f7e3b8299c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:17:56.595 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.592+0000 7f7e3b8299c0 20 zonegroup default 2024-09-12T17:17:56.595 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.592+0000 7f7e3b8299c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:56.596 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.592+0000 7f7e3b8299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:56.596 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.592+0000 7f7e3b8299c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:56.597 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.596+0000 7f7e3b8299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:56.597 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.596+0000 7f7e3b8299c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:56.597 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.596+0000 7f7e3b8299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:56.597 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.596+0000 7f7e3b8299c0 20 started sync module instance, tier type = 2024-09-12T17:17:56.598 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.596+0000 7f7e3b8299c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:17:56.622 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.620+0000 7f7e3b8299c0 20 add_watcher() i=0 2024-09-12T17:17:56.622 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.620+0000 7f7e3b8299c0 20 add_watcher() i=1 2024-09-12T17:17:56.622 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.620+0000 7f7e3b8299c0 20 add_watcher() i=2 2024-09-12T17:17:56.622 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.620+0000 7f7e3b8299c0 20 add_watcher() i=3 2024-09-12T17:17:56.622 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.620+0000 7f7e3b8299c0 20 add_watcher() i=4 2024-09-12T17:17:56.623 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.620+0000 7f7e3b8299c0 20 add_watcher() i=5 2024-09-12T17:17:56.623 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.620+0000 7f7e3b8299c0 20 add_watcher() i=6 2024-09-12T17:17:56.625 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.624+0000 7f7e3b8299c0 20 add_watcher() i=7 2024-09-12T17:17:56.625 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.624+0000 7f7e3b8299c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:17:56.629 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.628+0000 7f7ceffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:56.630 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.628+0000 7f7e3b8299c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:17:56.630 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.628+0000 7f7e3b8299c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:17:56.630 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.628+0000 7f7e3b8299c0 5 note: GC not initialized 2024-09-12T17:17:56.631 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.628+0000 7f7ceefe5640 20 reqs_thread_entry: start 2024-09-12T17:17:56.631 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.628+0000 7f7e3b8299c0 20 init_complete bucket index max shards: 1 2024-09-12T17:17:56.631 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.628+0000 7f7e3b8299c0 20 Filter name: none 2024-09-12T17:17:56.631 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.628+0000 7f7cecfe1640 20 reqs_thread_entry: start 2024-09-12T17:17:56.631 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.628+0000 7f7e3b8299c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:56.632 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.632+0000 7f7e3b8299c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:17:56.632 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.632+0000 7f7e3b8299c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:56.633 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.632+0000 7f7e3b8299c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:17:56.633 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.632+0000 7f7e3b8299c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:17:56.634 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.632+0000 7f7e3b8299c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:56.634 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.632+0000 7f7e3b8299c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:17:56.634 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.632+0000 7f7e3b8299c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:56.635 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.632+0000 7f7e3b8299c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:17:56.635 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.632+0000 7f7e3b8299c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:17:56.638 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.636+0000 7f7ceffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:56.643 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.640+0000 7f7e3b8299c0 20 remove_watcher() i=0 2024-09-12T17:17:56.643 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.640+0000 7f7e3b8299c0 2 removed watcher, disabling cache 2024-09-12T17:17:56.646 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.644+0000 7f7e3b8299c0 20 remove_watcher() i=1 2024-09-12T17:17:56.649 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.648+0000 7f7e3b8299c0 20 remove_watcher() i=2 2024-09-12T17:17:56.651 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.648+0000 7f7e3b8299c0 20 remove_watcher() i=3 2024-09-12T17:17:56.654 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.652+0000 7f7e3b8299c0 20 remove_watcher() i=4 2024-09-12T17:17:56.655 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.652+0000 7f7e3b8299c0 20 remove_watcher() i=5 2024-09-12T17:17:56.657 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.656+0000 7f7e3b8299c0 20 remove_watcher() i=6 2024-09-12T17:17:56.659 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:56.656+0000 7f7e3b8299c0 20 remove_watcher() i=7 2024-09-12T17:17:56.678 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:56.678 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:17:56.679 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: error-at-set-target-layout id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T17:17:56.679 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:56.778 INFO:tasks.workunit.client.0.smithi016.stderr:TEST: reshard bucket with abort at set_target_layout 2024-09-12T17:17:56.779 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:57.235 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T17:17:57.271 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:17:57.271 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:17:57.319 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.316+0000 7f838828f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:57.321 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.320+0000 7f838828f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:57.321 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.320+0000 7f838828f9c0 20 realm 2024-09-12T17:17:57.321 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.320+0000 7f838828f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:57.321 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.320+0000 7f838828f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:57.321 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.320+0000 7f838828f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:17:57.321 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.320+0000 7f838828f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:57.321 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.320+0000 7f838828f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:57.322 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.320+0000 7f838828f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:57.323 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.320+0000 7f838828f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:57.323 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.320+0000 7f838828f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:57.325 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.324+0000 7f838828f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:17:57.325 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.324+0000 7f838828f9c0 20 searching for the correct realm 2024-09-12T17:17:57.328 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.328+0000 7f8386596640 0 -- 172.21.15.16:0/3114225115 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f837001a040 msgr2=0x7f8370062910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:57.336 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.336+0000 7f837d594640 0 -- 172.21.15.16:0/3114225115 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f838003afb0 msgr2=0x7f838008a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:17:57.555 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.552+0000 7f838828f9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:17:57.555 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.552+0000 7f838828f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:17:57.555 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.552+0000 7f838828f9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:17:57.555 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.552+0000 7f838828f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:17:57.556 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.552+0000 7f838828f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:17:57.556 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.552+0000 7f838828f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:17:57.556 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.552+0000 7f838828f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:57.556 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.552+0000 7f838828f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:57.556 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.552+0000 7f838828f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:57.556 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.556+0000 7f838828f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:57.557 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.556+0000 7f838828f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:57.557 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.556+0000 7f838828f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:17:57.558 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.556+0000 7f838828f9c0 20 zone default found 2024-09-12T17:17:57.558 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.556+0000 7f838828f9c0 4 Realm: () 2024-09-12T17:17:57.558 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.556+0000 7f838828f9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:17:57.558 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.556+0000 7f838828f9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:17:57.558 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.556+0000 7f838828f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:17:57.558 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.556+0000 7f838828f9c0 20 zonegroup default 2024-09-12T17:17:57.558 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.556+0000 7f838828f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:57.559 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.556+0000 7f838828f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:57.559 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.556+0000 7f838828f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:57.559 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.556+0000 7f838828f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:57.559 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.556+0000 7f838828f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:57.560 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.560+0000 7f838828f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:57.560 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.560+0000 7f838828f9c0 20 started sync module instance, tier type = 2024-09-12T17:17:57.560 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.560+0000 7f838828f9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:17:57.585 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.584+0000 7f838828f9c0 20 add_watcher() i=0 2024-09-12T17:17:57.585 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.584+0000 7f838828f9c0 20 add_watcher() i=1 2024-09-12T17:17:57.585 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.584+0000 7f838828f9c0 20 add_watcher() i=2 2024-09-12T17:17:57.585 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.584+0000 7f838828f9c0 20 add_watcher() i=3 2024-09-12T17:17:57.585 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.584+0000 7f838828f9c0 20 add_watcher() i=4 2024-09-12T17:17:57.585 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.584+0000 7f838828f9c0 20 add_watcher() i=5 2024-09-12T17:17:57.585 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.584+0000 7f838828f9c0 20 add_watcher() i=6 2024-09-12T17:17:57.587 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.584+0000 7f838828f9c0 20 add_watcher() i=7 2024-09-12T17:17:57.587 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.584+0000 7f838828f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:17:57.591 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.588+0000 7f82377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:57.592 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.592+0000 7f838828f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:17:57.593 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.592+0000 7f838828f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:17:57.593 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.592+0000 7f838828f9c0 5 note: GC not initialized 2024-09-12T17:17:57.593 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.592+0000 7f82367fc640 20 reqs_thread_entry: start 2024-09-12T17:17:57.593 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.592+0000 7f838828f9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:17:57.593 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.592+0000 7f838828f9c0 20 Filter name: none 2024-09-12T17:17:57.594 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.592+0000 7f81a7fff640 20 reqs_thread_entry: start 2024-09-12T17:17:57.594 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.592+0000 7f838828f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:57.595 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.592+0000 7f838828f9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:17:57.595 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.592+0000 7f838828f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:57.597 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.596+0000 7f838828f9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:17:57.597 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.596+0000 7f838828f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:17:57.597 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.596+0000 7f838828f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:57.598 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.596+0000 7f838828f9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:17:57.598 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.596+0000 7f838828f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:57.599 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.596+0000 7f838828f9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:17:57.599 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.596+0000 7f838828f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:17:57.601 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.600+0000 7f82377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:57.607 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.604+0000 7f838828f9c0 20 remove_watcher() i=0 2024-09-12T17:17:57.607 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.604+0000 7f838828f9c0 2 removed watcher, disabling cache 2024-09-12T17:17:57.609 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.608+0000 7f838828f9c0 20 remove_watcher() i=1 2024-09-12T17:17:57.612 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.608+0000 7f838828f9c0 20 remove_watcher() i=2 2024-09-12T17:17:57.614 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.612+0000 7f838828f9c0 20 remove_watcher() i=3 2024-09-12T17:17:57.616 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.616+0000 7f838828f9c0 20 remove_watcher() i=4 2024-09-12T17:17:57.617 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.616+0000 7f838828f9c0 20 remove_watcher() i=5 2024-09-12T17:17:57.619 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.616+0000 7f838828f9c0 20 remove_watcher() i=6 2024-09-12T17:17:57.620 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.620+0000 7f838828f9c0 20 remove_watcher() i=7 2024-09-12T17:17:57.637 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:57.637 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:17:57.638 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: abort-at-set-target-layout id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:17:57.638 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:57.638 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-09-12T17:17:57.671 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:17:57.671 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:17:57.716 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.716+0000 7f2c8c7219c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:57.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.716+0000 7f2c8c7219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:57.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.716+0000 7f2c8c7219c0 20 realm 2024-09-12T17:17:57.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.716+0000 7f2c8c7219c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:57.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.716+0000 7f2c8c7219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:57.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.716+0000 7f2c8c7219c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:17:57.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.716+0000 7f2c8c7219c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:57.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.716+0000 7f2c8c7219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:57.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.716+0000 7f2c8c7219c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:57.720 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.720+0000 7f2c8c7219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:57.720 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.720+0000 7f2c8c7219c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:57.927 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.924+0000 7f2c8c7219c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:17:57.927 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.924+0000 7f2c8c7219c0 20 searching for the correct realm 2024-09-12T17:17:57.931 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:57.928+0000 7f2c8aa28640 0 -- 172.21.15.16:0/3121594993 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f2c8012cb20 msgr2=0x7f2c800f72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:58.145 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.144+0000 7f2c89a26640 0 -- 172.21.15.16:0/3121594993 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f2c8402e410 msgr2=0x7f2c8402e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:58.364 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:17:58.365 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:17:58.365 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:17:58.365 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:17:58.365 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:17:58.365 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:17:58.365 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.365 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:58.366 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.366 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:58.366 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.367 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:17:58.367 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 zone default found 2024-09-12T17:17:58.367 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.364+0000 7f2c8c7219c0 4 Realm: () 2024-09-12T17:17:58.367 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.364+0000 7f2c8c7219c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:17:58.367 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.364+0000 7f2c8c7219c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:17:58.368 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.364+0000 7f2c8c7219c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:17:58.368 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 zonegroup default 2024-09-12T17:17:58.368 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.368 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:58.368 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.369 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.368+0000 7f2c8c7219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:58.369 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.368+0000 7f2c8c7219c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.369 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.368+0000 7f2c8c7219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:58.370 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.368+0000 7f2c8c7219c0 20 started sync module instance, tier type = 2024-09-12T17:17:58.370 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.368+0000 7f2c8c7219c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:17:58.393 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.392+0000 7f2c8c7219c0 20 add_watcher() i=0 2024-09-12T17:17:58.393 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.392+0000 7f2c8c7219c0 20 add_watcher() i=1 2024-09-12T17:17:58.393 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.392+0000 7f2c8c7219c0 20 add_watcher() i=2 2024-09-12T17:17:58.394 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.392+0000 7f2c8c7219c0 20 add_watcher() i=3 2024-09-12T17:17:58.394 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.392+0000 7f2c8c7219c0 20 add_watcher() i=4 2024-09-12T17:17:58.394 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.392+0000 7f2c8c7219c0 20 add_watcher() i=5 2024-09-12T17:17:58.394 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.392+0000 7f2c8c7219c0 20 add_watcher() i=6 2024-09-12T17:17:58.396 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.392+0000 7f2c8c7219c0 20 add_watcher() i=7 2024-09-12T17:17:58.396 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.392+0000 7f2c8c7219c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:17:58.400 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.396+0000 7f2b40fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:58.401 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.400+0000 7f2c8c7219c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:17:58.401 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.400+0000 7f2c8c7219c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:17:58.401 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.400+0000 7f2c8c7219c0 5 note: GC not initialized 2024-09-12T17:17:58.402 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.400+0000 7f2abb7fe640 20 reqs_thread_entry: start 2024-09-12T17:17:58.402 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.400+0000 7f2c8c7219c0 20 init_complete bucket index max shards: 1 2024-09-12T17:17:58.402 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.400+0000 7f2c8c7219c0 20 Filter name: none 2024-09-12T17:17:58.402 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.400+0000 7f2ab97fa640 20 reqs_thread_entry: start 2024-09-12T17:17:58.402 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.400+0000 7f2c8c7219c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T17:17:58.402 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.400+0000 7f2c8c7219c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.403 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.400+0000 7f2c8c7219c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:17:58.403 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.400+0000 7f2c8c7219c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T17:17:58.404 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.400+0000 7f2c8c7219c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T17:17:58.404 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.400+0000 7f2c8c7219c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24 : miss 2024-09-12T17:17:58.404 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.400+0000 7f2c8c7219c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.405 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.404+0000 7f2c8c7219c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:17:58.405 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.404+0000 7f2c8c7219c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24 info.flags=0x17 2024-09-12T17:17:58.405 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.404+0000 7f2c8c7219c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24 to cache LRU end 2024-09-12T17:17:58.405 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.404+0000 7f2c8c7219c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:17:58.405 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.404+0000 7f2c8c7219c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:17:58.405 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.404+0000 7f2c8c7219c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24 2024-09-12T17:17:58.412 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2c8c7219c0 time 2024-09-12T17:17:58.413570+0000 2024-09-12T17:17:58.413 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:17:58.414 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:17:58.414 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f2c8fffb2eb] 2024-09-12T17:17:58.414 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2c8fffb49f] 2024-09-12T17:17:58.414 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55883a04c0c1] 2024-09-12T17:17:58.414 INFO:tasks.workunit.client.0.smithi016.stderr: 4: radosgw-admin(+0x140f6b8) [0x55883aaa16b8] 2024-09-12T17:17:58.415 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55883a05e18d] 2024-09-12T17:17:58.415 INFO:tasks.workunit.client.0.smithi016.stderr: 6: main() 2024-09-12T17:17:58.415 INFO:tasks.workunit.client.0.smithi016.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2c8ee61d90] 2024-09-12T17:17:58.415 INFO:tasks.workunit.client.0.smithi016.stderr: 8: __libc_start_main() 2024-09-12T17:17:58.415 INFO:tasks.workunit.client.0.smithi016.stderr: 9: _start() 2024-09-12T17:17:58.415 INFO:tasks.workunit.client.0.smithi016.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:17:58.415 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7f2c8c7219c0 thread_name:radosgw-admin 2024-09-12T17:17:58.415 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.412+0000 7f2c8c7219c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2c8c7219c0 time 2024-09-12T17:17:58.413570+0000 2024-09-12T17:17:58.415 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:17:58.415 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:58.415 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:17:58.415 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f2c8fffb2eb] 2024-09-12T17:17:58.415 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2c8fffb49f] 2024-09-12T17:17:58.416 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55883a04c0c1] 2024-09-12T17:17:58.416 INFO:tasks.workunit.client.0.smithi016.stderr: 4: radosgw-admin(+0x140f6b8) [0x55883aaa16b8] 2024-09-12T17:17:58.416 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55883a05e18d] 2024-09-12T17:17:58.416 INFO:tasks.workunit.client.0.smithi016.stderr: 6: main() 2024-09-12T17:17:58.416 INFO:tasks.workunit.client.0.smithi016.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2c8ee61d90] 2024-09-12T17:17:58.416 INFO:tasks.workunit.client.0.smithi016.stderr: 8: __libc_start_main() 2024-09-12T17:17:58.416 INFO:tasks.workunit.client.0.smithi016.stderr: 9: _start() 2024-09-12T17:17:58.416 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:58.418 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:17:58.418 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2c8ee7a520] 2024-09-12T17:17:58.418 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:17:58.418 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:17:58.418 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:17:58.418 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2c8fffb345] 2024-09-12T17:17:58.418 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2c8fffb49f] 2024-09-12T17:17:58.418 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55883a04c0c1] 2024-09-12T17:17:58.419 INFO:tasks.workunit.client.0.smithi016.stderr: 8: radosgw-admin(+0x140f6b8) [0x55883aaa16b8] 2024-09-12T17:17:58.419 INFO:tasks.workunit.client.0.smithi016.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55883a05e18d] 2024-09-12T17:17:58.419 INFO:tasks.workunit.client.0.smithi016.stderr: 10: main() 2024-09-12T17:17:58.419 INFO:tasks.workunit.client.0.smithi016.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2c8ee61d90] 2024-09-12T17:17:58.419 INFO:tasks.workunit.client.0.smithi016.stderr: 12: __libc_start_main() 2024-09-12T17:17:58.419 INFO:tasks.workunit.client.0.smithi016.stderr: 13: _start() 2024-09-12T17:17:58.419 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.416+0000 7f2c8c7219c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:17:58.419 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7f2c8c7219c0 thread_name:radosgw-admin 2024-09-12T17:17:58.419 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:58.419 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:17:58.419 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2c8ee7a520] 2024-09-12T17:17:58.419 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:17:58.419 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:17:58.420 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:17:58.420 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2c8fffb345] 2024-09-12T17:17:58.420 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2c8fffb49f] 2024-09-12T17:17:58.420 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55883a04c0c1] 2024-09-12T17:17:58.420 INFO:tasks.workunit.client.0.smithi016.stderr: 8: radosgw-admin(+0x140f6b8) [0x55883aaa16b8] 2024-09-12T17:17:58.420 INFO:tasks.workunit.client.0.smithi016.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55883a05e18d] 2024-09-12T17:17:58.420 INFO:tasks.workunit.client.0.smithi016.stderr: 10: main() 2024-09-12T17:17:58.420 INFO:tasks.workunit.client.0.smithi016.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2c8ee61d90] 2024-09-12T17:17:58.420 INFO:tasks.workunit.client.0.smithi016.stderr: 12: __libc_start_main() 2024-09-12T17:17:58.421 INFO:tasks.workunit.client.0.smithi016.stderr: 13: _start() 2024-09-12T17:17:58.421 INFO:tasks.workunit.client.0.smithi016.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:17:58.421 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:58.421 INFO:tasks.workunit.client.0.smithi016.stderr:--- begin dump of recent events --- 2024-09-12T17:17:58.438 INFO:tasks.workunit.client.0.smithi016.stderr: -499> 2024-09-12T17:17:57.692+0000 7f2c8a227640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:17:58.439 INFO:tasks.workunit.client.0.smithi016.stderr: -498> 2024-09-12T17:17:57.692+0000 7f2c8aa28640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:17:58.439 INFO:tasks.workunit.client.0.smithi016.stderr: -497> 2024-09-12T17:17:57.692+0000 7f2c8aa28640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:17:58.439 INFO:tasks.workunit.client.0.smithi016.stderr: -496> 2024-09-12T17:17:57.692+0000 7f2c8aa28640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:17:58.439 INFO:tasks.workunit.client.0.smithi016.stderr: -495> 2024-09-12T17:17:57.692+0000 7f2c8a227640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:17:58.439 INFO:tasks.workunit.client.0.smithi016.stderr: -494> 2024-09-12T17:17:57.692+0000 7f2c8a227640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:17:58.439 INFO:tasks.workunit.client.0.smithi016.stderr: -493> 2024-09-12T17:17:57.692+0000 7f2c8a227640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:17:58.439 INFO:tasks.workunit.client.0.smithi016.stderr: -492> 2024-09-12T17:17:57.692+0000 7f2c89a26640 10 monclient(hunting): get_auth_request con 0x55883cf2fb30 auth_method 0 2024-09-12T17:17:58.439 INFO:tasks.workunit.client.0.smithi016.stderr: -491> 2024-09-12T17:17:57.692+0000 7f2c89a26640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:17:58.439 INFO:tasks.workunit.client.0.smithi016.stderr: -490> 2024-09-12T17:17:57.692+0000 7f2c89a26640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:17:58.439 INFO:tasks.workunit.client.0.smithi016.stderr: -489> 2024-09-12T17:17:57.692+0000 7f2c89a26640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:17:58.439 INFO:tasks.workunit.client.0.smithi016.stderr: -488> 2024-09-12T17:17:57.692+0000 7f2c8aa28640 10 monclient(hunting): handle_auth_done global_id 6564 payload 274 2024-09-12T17:17:58.440 INFO:tasks.workunit.client.0.smithi016.stderr: -487> 2024-09-12T17:17:57.692+0000 7f2c8aa28640 10 monclient: _finish_hunting 0 2024-09-12T17:17:58.440 INFO:tasks.workunit.client.0.smithi016.stderr: -486> 2024-09-12T17:17:57.692+0000 7f2c8aa28640 1 monclient: found mon.noname-a 2024-09-12T17:17:58.440 INFO:tasks.workunit.client.0.smithi016.stderr: -485> 2024-09-12T17:17:57.692+0000 7f2c8aa28640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:17:58.440 INFO:tasks.workunit.client.0.smithi016.stderr: -484> 2024-09-12T17:17:57.692+0000 7f2b78608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:17:58.440 INFO:tasks.workunit.client.0.smithi016.stderr: -483> 2024-09-12T17:17:57.692+0000 7f2b78608640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:17:58.440 INFO:tasks.workunit.client.0.smithi016.stderr: -482> 2024-09-12T17:17:57.692+0000 7f2b78608640 10 monclient: dump: 2024-09-12T17:17:58.440 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:17:58.440 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:17:58.440 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:58.440 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:58.440 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:17:58.440 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:58.440 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:17:58.441 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:17:58.441 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:17:58.441 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:58.441 INFO:tasks.workunit.client.0.smithi016.stderr: -481> 2024-09-12T17:17:57.692+0000 7f2b78608640 10 monclient: _finish_auth 0 2024-09-12T17:17:58.441 INFO:tasks.workunit.client.0.smithi016.stderr: -480> 2024-09-12T17:17:57.692+0000 7f2b78608640 10 monclient: _check_auth_tickets 2024-09-12T17:17:58.441 INFO:tasks.workunit.client.0.smithi016.stderr: -479> 2024-09-12T17:17:57.692+0000 7f2b78608640 10 monclient: handle_config config(0 keys) 2024-09-12T17:17:58.441 INFO:tasks.workunit.client.0.smithi016.stderr: -478> 2024-09-12T17:17:57.692+0000 7f2b78608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:17:58.441 INFO:tasks.workunit.client.0.smithi016.stderr: -477> 2024-09-12T17:17:57.692+0000 7f2b78608640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:17:58.441 INFO:tasks.workunit.client.0.smithi016.stderr: -476> 2024-09-12T17:17:57.692+0000 7f2b78608640 10 monclient: dump: 2024-09-12T17:17:58.441 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:17:58.441 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:17:58.441 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:58.441 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:58.442 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:17:58.442 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:58.442 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:17:58.442 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:17:58.442 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:17:58.442 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:58.442 INFO:tasks.workunit.client.0.smithi016.stderr: -475> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 monclient: authenticate success, global_id 6564 2024-09-12T17:17:58.442 INFO:tasks.workunit.client.0.smithi016.stderr: -474> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 10 monclient: get_monmap_and_config success 2024-09-12T17:17:58.442 INFO:tasks.workunit.client.0.smithi016.stderr: -473> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 4 set_mon_vals no callback set 2024-09-12T17:17:58.442 INFO:tasks.workunit.client.0.smithi016.stderr: -472> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 10 monclient: shutdown 2024-09-12T17:17:58.442 INFO:tasks.workunit.client.0.smithi016.stderr: -471> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 asok(0x55883cddd2b0) unregister_commands rotate-key 2024-09-12T17:17:58.442 INFO:tasks.workunit.client.0.smithi016.stderr: -470> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 10 monclient: build_initial_monmap 2024-09-12T17:17:58.442 INFO:tasks.workunit.client.0.smithi016.stderr: -469> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 1 build_initial for_mkfs: 0 2024-09-12T17:17:58.443 INFO:tasks.workunit.client.0.smithi016.stderr: -468> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 10 monclient: monmap: 2024-09-12T17:17:58.443 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:17:58.443 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:17:58.443 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:17:58.443 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:17:58.443 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:17:58.443 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:58.443 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:17:58.443 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:17:58.443 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:17:58.443 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:58.443 INFO:tasks.workunit.client.0.smithi016.stderr: -467> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0133f0) adding auth protocol: cephx 2024-09-12T17:17:58.443 INFO:tasks.workunit.client.0.smithi016.stderr: -466> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0133f0) adding auth protocol: cephx 2024-09-12T17:17:58.444 INFO:tasks.workunit.client.0.smithi016.stderr: -465> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0133f0) adding auth protocol: cephx 2024-09-12T17:17:58.444 INFO:tasks.workunit.client.0.smithi016.stderr: -464> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0133f0) adding con mode: secure 2024-09-12T17:17:58.444 INFO:tasks.workunit.client.0.smithi016.stderr: -463> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0133f0) adding con mode: crc 2024-09-12T17:17:58.444 INFO:tasks.workunit.client.0.smithi016.stderr: -462> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0133f0) adding con mode: secure 2024-09-12T17:17:58.444 INFO:tasks.workunit.client.0.smithi016.stderr: -461> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0133f0) adding con mode: crc 2024-09-12T17:17:58.444 INFO:tasks.workunit.client.0.smithi016.stderr: -460> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0133f0) adding con mode: secure 2024-09-12T17:17:58.444 INFO:tasks.workunit.client.0.smithi016.stderr: -459> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0133f0) adding con mode: crc 2024-09-12T17:17:58.444 INFO:tasks.workunit.client.0.smithi016.stderr: -458> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0133f0) adding con mode: crc 2024-09-12T17:17:58.444 INFO:tasks.workunit.client.0.smithi016.stderr: -457> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0133f0) adding con mode: secure 2024-09-12T17:17:58.444 INFO:tasks.workunit.client.0.smithi016.stderr: -456> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0133f0) adding con mode: crc 2024-09-12T17:17:58.444 INFO:tasks.workunit.client.0.smithi016.stderr: -455> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0133f0) adding con mode: secure 2024-09-12T17:17:58.444 INFO:tasks.workunit.client.0.smithi016.stderr: -454> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0133f0) adding con mode: crc 2024-09-12T17:17:58.445 INFO:tasks.workunit.client.0.smithi016.stderr: -453> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0133f0) adding con mode: secure 2024-09-12T17:17:58.445 INFO:tasks.workunit.client.0.smithi016.stderr: -452> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:58.445 INFO:tasks.workunit.client.0.smithi016.stderr: -451> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 1 librados: starting msgr at 2024-09-12T17:17:58.445 INFO:tasks.workunit.client.0.smithi016.stderr: -450> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 1 librados: starting objecter 2024-09-12T17:17:58.445 INFO:tasks.workunit.client.0.smithi016.stderr: -449> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 asok(0x55883cddd2b0) register_command objecter_requests hook 0x55883d01b340 2024-09-12T17:17:58.445 INFO:tasks.workunit.client.0.smithi016.stderr: -448> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 1 librados: setting wanted keys 2024-09-12T17:17:58.445 INFO:tasks.workunit.client.0.smithi016.stderr: -447> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 1 librados: calling monclient init 2024-09-12T17:17:58.445 INFO:tasks.workunit.client.0.smithi016.stderr: -446> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 10 monclient: init 2024-09-12T17:17:58.445 INFO:tasks.workunit.client.0.smithi016.stderr: -445> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883cfe9a70) adding auth protocol: cephx 2024-09-12T17:17:58.445 INFO:tasks.workunit.client.0.smithi016.stderr: -444> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883cfe9a70) adding auth protocol: cephx 2024-09-12T17:17:58.445 INFO:tasks.workunit.client.0.smithi016.stderr: -443> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883cfe9a70) adding auth protocol: cephx 2024-09-12T17:17:58.445 INFO:tasks.workunit.client.0.smithi016.stderr: -442> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883cfe9a70) adding con mode: secure 2024-09-12T17:17:58.445 INFO:tasks.workunit.client.0.smithi016.stderr: -441> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883cfe9a70) adding con mode: crc 2024-09-12T17:17:58.445 INFO:tasks.workunit.client.0.smithi016.stderr: -440> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883cfe9a70) adding con mode: secure 2024-09-12T17:17:58.446 INFO:tasks.workunit.client.0.smithi016.stderr: -439> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883cfe9a70) adding con mode: crc 2024-09-12T17:17:58.446 INFO:tasks.workunit.client.0.smithi016.stderr: -438> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883cfe9a70) adding con mode: secure 2024-09-12T17:17:58.446 INFO:tasks.workunit.client.0.smithi016.stderr: -437> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883cfe9a70) adding con mode: crc 2024-09-12T17:17:58.446 INFO:tasks.workunit.client.0.smithi016.stderr: -436> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883cfe9a70) adding con mode: crc 2024-09-12T17:17:58.446 INFO:tasks.workunit.client.0.smithi016.stderr: -435> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883cfe9a70) adding con mode: secure 2024-09-12T17:17:58.446 INFO:tasks.workunit.client.0.smithi016.stderr: -434> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883cfe9a70) adding con mode: crc 2024-09-12T17:17:58.446 INFO:tasks.workunit.client.0.smithi016.stderr: -433> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883cfe9a70) adding con mode: secure 2024-09-12T17:17:58.446 INFO:tasks.workunit.client.0.smithi016.stderr: -432> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883cfe9a70) adding con mode: crc 2024-09-12T17:17:58.446 INFO:tasks.workunit.client.0.smithi016.stderr: -431> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883cfe9a70) adding con mode: secure 2024-09-12T17:17:58.446 INFO:tasks.workunit.client.0.smithi016.stderr: -430> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:58.446 INFO:tasks.workunit.client.0.smithi016.stderr: -429> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:58.446 INFO:tasks.workunit.client.0.smithi016.stderr: -428> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 asok(0x55883cddd2b0) register_command rotate-key hook 0x55883cfe9bb8 2024-09-12T17:17:58.447 INFO:tasks.workunit.client.0.smithi016.stderr: -427> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 10 monclient: _reopen_session rank -1 2024-09-12T17:17:58.447 INFO:tasks.workunit.client.0.smithi016.stderr: -426> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:17:58.447 INFO:tasks.workunit.client.0.smithi016.stderr: -425> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 10 monclient(hunting): picked mon.noname-b con 0x55883ce76600 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:17:58.447 INFO:tasks.workunit.client.0.smithi016.stderr: -424> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 10 monclient(hunting): picked mon.noname-c con 0x55883cf2fb30 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:17:58.447 INFO:tasks.workunit.client.0.smithi016.stderr: -423> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 10 monclient(hunting): picked mon.noname-a con 0x55883cf32b60 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:17:58.447 INFO:tasks.workunit.client.0.smithi016.stderr: -422> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:58.447 INFO:tasks.workunit.client.0.smithi016.stderr: -421> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:58.447 INFO:tasks.workunit.client.0.smithi016.stderr: -420> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:58.447 INFO:tasks.workunit.client.0.smithi016.stderr: -419> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 10 monclient(hunting): _renew_subs 2024-09-12T17:17:58.447 INFO:tasks.workunit.client.0.smithi016.stderr: -418> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 10 monclient(hunting): authenticate will time out at 2195.671664s 2024-09-12T17:17:58.447 INFO:tasks.workunit.client.0.smithi016.stderr: -417> 2024-09-12T17:17:57.692+0000 7f2c89a26640 10 monclient(hunting): get_auth_request con 0x55883cf2fb30 auth_method 0 2024-09-12T17:17:58.447 INFO:tasks.workunit.client.0.smithi016.stderr: -416> 2024-09-12T17:17:57.692+0000 7f2c89a26640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:17:58.447 INFO:tasks.workunit.client.0.smithi016.stderr: -415> 2024-09-12T17:17:57.692+0000 7f2c89a26640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:17:58.448 INFO:tasks.workunit.client.0.smithi016.stderr: -414> 2024-09-12T17:17:57.692+0000 7f2c89a26640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:17:58.448 INFO:tasks.workunit.client.0.smithi016.stderr: -413> 2024-09-12T17:17:57.692+0000 7f2c8aa28640 10 monclient(hunting): get_auth_request con 0x55883cf32b60 auth_method 0 2024-09-12T17:17:58.448 INFO:tasks.workunit.client.0.smithi016.stderr: -412> 2024-09-12T17:17:57.692+0000 7f2c8aa28640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:17:58.448 INFO:tasks.workunit.client.0.smithi016.stderr: -411> 2024-09-12T17:17:57.692+0000 7f2c8aa28640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:17:58.448 INFO:tasks.workunit.client.0.smithi016.stderr: -410> 2024-09-12T17:17:57.692+0000 7f2c8aa28640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:17:58.448 INFO:tasks.workunit.client.0.smithi016.stderr: -409> 2024-09-12T17:17:57.692+0000 7f2c89a26640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:17:58.448 INFO:tasks.workunit.client.0.smithi016.stderr: -408> 2024-09-12T17:17:57.692+0000 7f2c89a26640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:17:58.448 INFO:tasks.workunit.client.0.smithi016.stderr: -407> 2024-09-12T17:17:57.692+0000 7f2c89a26640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:17:58.448 INFO:tasks.workunit.client.0.smithi016.stderr: -406> 2024-09-12T17:17:57.692+0000 7f2c8aa28640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:17:58.448 INFO:tasks.workunit.client.0.smithi016.stderr: -405> 2024-09-12T17:17:57.692+0000 7f2c8aa28640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:17:58.448 INFO:tasks.workunit.client.0.smithi016.stderr: -404> 2024-09-12T17:17:57.692+0000 7f2c8aa28640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:17:58.448 INFO:tasks.workunit.client.0.smithi016.stderr: -403> 2024-09-12T17:17:57.696+0000 7f2c8a227640 10 monclient(hunting): get_auth_request con 0x55883ce76600 auth_method 0 2024-09-12T17:17:58.448 INFO:tasks.workunit.client.0.smithi016.stderr: -402> 2024-09-12T17:17:57.696+0000 7f2c8a227640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:17:58.449 INFO:tasks.workunit.client.0.smithi016.stderr: -401> 2024-09-12T17:17:57.696+0000 7f2c8a227640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:17:58.449 INFO:tasks.workunit.client.0.smithi016.stderr: -400> 2024-09-12T17:17:57.696+0000 7f2c8a227640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:17:58.449 INFO:tasks.workunit.client.0.smithi016.stderr: -399> 2024-09-12T17:17:57.696+0000 7f2c89a26640 10 monclient(hunting): handle_auth_done global_id 6299 payload 824 2024-09-12T17:17:58.449 INFO:tasks.workunit.client.0.smithi016.stderr: -398> 2024-09-12T17:17:57.696+0000 7f2c89a26640 10 monclient: _finish_hunting 0 2024-09-12T17:17:58.449 INFO:tasks.workunit.client.0.smithi016.stderr: -397> 2024-09-12T17:17:57.696+0000 7f2c89a26640 1 monclient: found mon.noname-c 2024-09-12T17:17:58.449 INFO:tasks.workunit.client.0.smithi016.stderr: -396> 2024-09-12T17:17:57.696+0000 7f2c89a26640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:17:58.449 INFO:tasks.workunit.client.0.smithi016.stderr: -395> 2024-09-12T17:17:57.696+0000 7f2b76e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:17:58.449 INFO:tasks.workunit.client.0.smithi016.stderr: -394> 2024-09-12T17:17:57.696+0000 7f2b76e05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:17:58.449 INFO:tasks.workunit.client.0.smithi016.stderr: -393> 2024-09-12T17:17:57.696+0000 7f2b76e05640 10 monclient: dump: 2024-09-12T17:17:58.449 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:17:58.449 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:17:58.449 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:58.449 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:58.450 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:17:58.450 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:58.450 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:17:58.450 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:17:58.450 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:17:58.450 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:58.450 INFO:tasks.workunit.client.0.smithi016.stderr: -392> 2024-09-12T17:17:57.696+0000 7f2b76e05640 10 monclient: _finish_auth 0 2024-09-12T17:17:58.450 INFO:tasks.workunit.client.0.smithi016.stderr: -391> 2024-09-12T17:17:57.696+0000 7f2b76e05640 10 monclient: _check_auth_tickets 2024-09-12T17:17:58.450 INFO:tasks.workunit.client.0.smithi016.stderr: -390> 2024-09-12T17:17:57.696+0000 7f2b76e05640 10 monclient: handle_config config(0 keys) 2024-09-12T17:17:58.450 INFO:tasks.workunit.client.0.smithi016.stderr: -389> 2024-09-12T17:17:57.696+0000 7f2b76e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:17:58.450 INFO:tasks.workunit.client.0.smithi016.stderr: -388> 2024-09-12T17:17:57.696+0000 7f2b76e05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:17:58.450 INFO:tasks.workunit.client.0.smithi016.stderr: -387> 2024-09-12T17:17:57.696+0000 7f2b76e05640 10 monclient: dump: 2024-09-12T17:17:58.450 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:17:58.451 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:17:58.451 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:58.451 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:58.451 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:17:58.451 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:58.451 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:17:58.451 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:17:58.451 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:17:58.451 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:58.451 INFO:tasks.workunit.client.0.smithi016.stderr: -386> 2024-09-12T17:17:57.696+0000 7f2c8c7219c0 5 monclient: authenticate success, global_id 6299 2024-09-12T17:17:58.451 INFO:tasks.workunit.client.0.smithi016.stderr: -385> 2024-09-12T17:17:57.696+0000 7f2c8c7219c0 10 monclient: _renew_subs 2024-09-12T17:17:58.451 INFO:tasks.workunit.client.0.smithi016.stderr: -384> 2024-09-12T17:17:57.696+0000 7f2c8c7219c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:17:58.451 INFO:tasks.workunit.client.0.smithi016.stderr: -383> 2024-09-12T17:17:57.696+0000 7f2b78608640 4 set_mon_vals no callback set 2024-09-12T17:17:58.452 INFO:tasks.workunit.client.0.smithi016.stderr: -382> 2024-09-12T17:17:57.696+0000 7f2c8c7219c0 10 monclient: _renew_subs 2024-09-12T17:17:58.452 INFO:tasks.workunit.client.0.smithi016.stderr: -381> 2024-09-12T17:17:57.696+0000 7f2c8c7219c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:17:58.452 INFO:tasks.workunit.client.0.smithi016.stderr: -380> 2024-09-12T17:17:57.696+0000 7f2c8c7219c0 1 librados: init done 2024-09-12T17:17:58.452 INFO:tasks.workunit.client.0.smithi016.stderr: -379> 2024-09-12T17:17:57.696+0000 7f2b76e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:17:58.452 INFO:tasks.workunit.client.0.smithi016.stderr: -378> 2024-09-12T17:17:57.696+0000 7f2b76e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:17:58.452 INFO:tasks.workunit.client.0.smithi016.stderr: -377> 2024-09-12T17:17:57.696+0000 7f2b76e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:17:58.452 INFO:tasks.workunit.client.0.smithi016.stderr: -376> 2024-09-12T17:17:57.696+0000 7f2c8a227640 10 monclient: get_auth_request con 0x7f2b70070b10 auth_method 0 2024-09-12T17:17:58.452 INFO:tasks.workunit.client.0.smithi016.stderr: -375> 2024-09-12T17:17:57.696+0000 7f2c8aa28640 10 monclient: get_auth_request con 0x55883d01d650 auth_method 0 2024-09-12T17:17:58.452 INFO:tasks.workunit.client.0.smithi016.stderr: -374> 2024-09-12T17:17:57.700+0000 7f2c8a227640 10 monclient: get_auth_request con 0x55883d0347a0 auth_method 0 2024-09-12T17:17:58.452 INFO:tasks.workunit.client.0.smithi016.stderr: -373> 2024-09-12T17:17:57.700+0000 7f2c89a26640 10 monclient: get_auth_request con 0x55883d038b00 auth_method 0 2024-09-12T17:17:58.452 INFO:tasks.workunit.client.0.smithi016.stderr: -372> 2024-09-12T17:17:57.704+0000 7f2c8aa28640 10 monclient: get_auth_request con 0x55883d03cf50 auth_method 0 2024-09-12T17:17:58.452 INFO:tasks.workunit.client.0.smithi016.stderr: -371> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 10 monclient: build_initial_monmap 2024-09-12T17:17:58.452 INFO:tasks.workunit.client.0.smithi016.stderr: -370> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 1 build_initial for_mkfs: 0 2024-09-12T17:17:58.453 INFO:tasks.workunit.client.0.smithi016.stderr: -369> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 10 monclient: monmap: 2024-09-12T17:17:58.453 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:17:58.453 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:17:58.453 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:17:58.453 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:17:58.453 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:17:58.453 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:58.453 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:17:58.453 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:17:58.453 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:17:58.453 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:58.453 INFO:tasks.workunit.client.0.smithi016.stderr: -368> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d040ce0) adding auth protocol: cephx 2024-09-12T17:17:58.453 INFO:tasks.workunit.client.0.smithi016.stderr: -367> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d040ce0) adding auth protocol: cephx 2024-09-12T17:17:58.454 INFO:tasks.workunit.client.0.smithi016.stderr: -366> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d040ce0) adding auth protocol: cephx 2024-09-12T17:17:58.454 INFO:tasks.workunit.client.0.smithi016.stderr: -365> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d040ce0) adding con mode: secure 2024-09-12T17:17:58.454 INFO:tasks.workunit.client.0.smithi016.stderr: -364> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d040ce0) adding con mode: crc 2024-09-12T17:17:58.454 INFO:tasks.workunit.client.0.smithi016.stderr: -363> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d040ce0) adding con mode: secure 2024-09-12T17:17:58.454 INFO:tasks.workunit.client.0.smithi016.stderr: -362> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d040ce0) adding con mode: crc 2024-09-12T17:17:58.454 INFO:tasks.workunit.client.0.smithi016.stderr: -361> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d040ce0) adding con mode: secure 2024-09-12T17:17:58.454 INFO:tasks.workunit.client.0.smithi016.stderr: -360> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d040ce0) adding con mode: crc 2024-09-12T17:17:58.454 INFO:tasks.workunit.client.0.smithi016.stderr: -359> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d040ce0) adding con mode: crc 2024-09-12T17:17:58.454 INFO:tasks.workunit.client.0.smithi016.stderr: -358> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d040ce0) adding con mode: secure 2024-09-12T17:17:58.454 INFO:tasks.workunit.client.0.smithi016.stderr: -357> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d040ce0) adding con mode: crc 2024-09-12T17:17:58.454 INFO:tasks.workunit.client.0.smithi016.stderr: -356> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d040ce0) adding con mode: secure 2024-09-12T17:17:58.454 INFO:tasks.workunit.client.0.smithi016.stderr: -355> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d040ce0) adding con mode: crc 2024-09-12T17:17:58.455 INFO:tasks.workunit.client.0.smithi016.stderr: -354> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d040ce0) adding con mode: secure 2024-09-12T17:17:58.455 INFO:tasks.workunit.client.0.smithi016.stderr: -353> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:58.455 INFO:tasks.workunit.client.0.smithi016.stderr: -352> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 asok(0x55883cddd2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55883d0445f0 EEXIST 2024-09-12T17:17:58.455 INFO:tasks.workunit.client.0.smithi016.stderr: -351> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 10 monclient: init 2024-09-12T17:17:58.455 INFO:tasks.workunit.client.0.smithi016.stderr: -350> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d03fc98) adding auth protocol: cephx 2024-09-12T17:17:58.455 INFO:tasks.workunit.client.0.smithi016.stderr: -349> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d03fc98) adding auth protocol: cephx 2024-09-12T17:17:58.455 INFO:tasks.workunit.client.0.smithi016.stderr: -348> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d03fc98) adding auth protocol: cephx 2024-09-12T17:17:58.455 INFO:tasks.workunit.client.0.smithi016.stderr: -347> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d03fc98) adding con mode: secure 2024-09-12T17:17:58.455 INFO:tasks.workunit.client.0.smithi016.stderr: -346> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d03fc98) adding con mode: crc 2024-09-12T17:17:58.455 INFO:tasks.workunit.client.0.smithi016.stderr: -345> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d03fc98) adding con mode: secure 2024-09-12T17:17:58.455 INFO:tasks.workunit.client.0.smithi016.stderr: -344> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d03fc98) adding con mode: crc 2024-09-12T17:17:58.455 INFO:tasks.workunit.client.0.smithi016.stderr: -343> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d03fc98) adding con mode: secure 2024-09-12T17:17:58.455 INFO:tasks.workunit.client.0.smithi016.stderr: -342> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d03fc98) adding con mode: crc 2024-09-12T17:17:58.456 INFO:tasks.workunit.client.0.smithi016.stderr: -341> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d03fc98) adding con mode: crc 2024-09-12T17:17:58.456 INFO:tasks.workunit.client.0.smithi016.stderr: -340> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d03fc98) adding con mode: secure 2024-09-12T17:17:58.456 INFO:tasks.workunit.client.0.smithi016.stderr: -339> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d03fc98) adding con mode: crc 2024-09-12T17:17:58.456 INFO:tasks.workunit.client.0.smithi016.stderr: -338> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d03fc98) adding con mode: secure 2024-09-12T17:17:58.456 INFO:tasks.workunit.client.0.smithi016.stderr: -337> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d03fc98) adding con mode: crc 2024-09-12T17:17:58.456 INFO:tasks.workunit.client.0.smithi016.stderr: -336> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d03fc98) adding con mode: secure 2024-09-12T17:17:58.456 INFO:tasks.workunit.client.0.smithi016.stderr: -335> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:58.456 INFO:tasks.workunit.client.0.smithi016.stderr: -334> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:58.456 INFO:tasks.workunit.client.0.smithi016.stderr: -333> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 asok(0x55883cddd2b0) register_command rotate-key cmddesc rotate-key hook 0x55883d03fde0 EEXIST 2024-09-12T17:17:58.456 INFO:tasks.workunit.client.0.smithi016.stderr: -332> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 10 monclient: _reopen_session rank -1 2024-09-12T17:17:58.456 INFO:tasks.workunit.client.0.smithi016.stderr: -331> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:17:58.456 INFO:tasks.workunit.client.0.smithi016.stderr: -330> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 10 monclient(hunting): picked mon.noname-a con 0x55883d0687a0 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:17:58.456 INFO:tasks.workunit.client.0.smithi016.stderr: -329> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 10 monclient(hunting): picked mon.noname-b con 0x55883d0680d0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:17:58.457 INFO:tasks.workunit.client.0.smithi016.stderr: -328> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 10 monclient(hunting): picked mon.noname-c con 0x55883d066ab0 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:17:58.457 INFO:tasks.workunit.client.0.smithi016.stderr: -327> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:58.457 INFO:tasks.workunit.client.0.smithi016.stderr: -326> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:58.457 INFO:tasks.workunit.client.0.smithi016.stderr: -325> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:58.457 INFO:tasks.workunit.client.0.smithi016.stderr: -324> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 10 monclient(hunting): _renew_subs 2024-09-12T17:17:58.457 INFO:tasks.workunit.client.0.smithi016.stderr: -323> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 10 monclient(hunting): authenticate will time out at 2195.682914s 2024-09-12T17:17:58.457 INFO:tasks.workunit.client.0.smithi016.stderr: -322> 2024-09-12T17:17:57.704+0000 7f2c89a26640 10 monclient(hunting): get_auth_request con 0x55883d0687a0 auth_method 0 2024-09-12T17:17:58.457 INFO:tasks.workunit.client.0.smithi016.stderr: -321> 2024-09-12T17:17:57.704+0000 7f2c89a26640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:17:58.457 INFO:tasks.workunit.client.0.smithi016.stderr: -320> 2024-09-12T17:17:57.704+0000 7f2c89a26640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:17:58.457 INFO:tasks.workunit.client.0.smithi016.stderr: -319> 2024-09-12T17:17:57.704+0000 7f2c89a26640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:17:58.457 INFO:tasks.workunit.client.0.smithi016.stderr: -318> 2024-09-12T17:17:57.704+0000 7f2c8a227640 10 monclient(hunting): get_auth_request con 0x55883d066ab0 auth_method 0 2024-09-12T17:17:58.457 INFO:tasks.workunit.client.0.smithi016.stderr: -317> 2024-09-12T17:17:57.704+0000 7f2c8a227640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:17:58.457 INFO:tasks.workunit.client.0.smithi016.stderr: -316> 2024-09-12T17:17:57.704+0000 7f2c8a227640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:17:58.458 INFO:tasks.workunit.client.0.smithi016.stderr: -315> 2024-09-12T17:17:57.704+0000 7f2c8a227640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:17:58.458 INFO:tasks.workunit.client.0.smithi016.stderr: -314> 2024-09-12T17:17:57.704+0000 7f2c89a26640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:17:58.458 INFO:tasks.workunit.client.0.smithi016.stderr: -313> 2024-09-12T17:17:57.704+0000 7f2c89a26640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:17:58.458 INFO:tasks.workunit.client.0.smithi016.stderr: -312> 2024-09-12T17:17:57.704+0000 7f2c89a26640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:17:58.458 INFO:tasks.workunit.client.0.smithi016.stderr: -311> 2024-09-12T17:17:57.704+0000 7f2c8a227640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:17:58.458 INFO:tasks.workunit.client.0.smithi016.stderr: -310> 2024-09-12T17:17:57.704+0000 7f2c8a227640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:17:58.458 INFO:tasks.workunit.client.0.smithi016.stderr: -309> 2024-09-12T17:17:57.704+0000 7f2c8a227640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:17:58.458 INFO:tasks.workunit.client.0.smithi016.stderr: -308> 2024-09-12T17:17:57.704+0000 7f2c8aa28640 10 monclient(hunting): get_auth_request con 0x55883d0680d0 auth_method 0 2024-09-12T17:17:58.458 INFO:tasks.workunit.client.0.smithi016.stderr: -307> 2024-09-12T17:17:57.704+0000 7f2c8aa28640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:17:58.458 INFO:tasks.workunit.client.0.smithi016.stderr: -306> 2024-09-12T17:17:57.704+0000 7f2c8aa28640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:17:58.458 INFO:tasks.workunit.client.0.smithi016.stderr: -305> 2024-09-12T17:17:57.704+0000 7f2c8aa28640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:17:58.458 INFO:tasks.workunit.client.0.smithi016.stderr: -304> 2024-09-12T17:17:57.704+0000 7f2c89a26640 10 monclient(hunting): handle_auth_done global_id 6570 payload 824 2024-09-12T17:17:58.458 INFO:tasks.workunit.client.0.smithi016.stderr: -303> 2024-09-12T17:17:57.704+0000 7f2c89a26640 10 monclient: _finish_hunting 0 2024-09-12T17:17:58.459 INFO:tasks.workunit.client.0.smithi016.stderr: -302> 2024-09-12T17:17:57.704+0000 7f2c89a26640 1 monclient: found mon.noname-a 2024-09-12T17:17:58.459 INFO:tasks.workunit.client.0.smithi016.stderr: -301> 2024-09-12T17:17:57.704+0000 7f2c89a26640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:17:58.459 INFO:tasks.workunit.client.0.smithi016.stderr: -300> 2024-09-12T17:17:57.704+0000 7f2b6ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:17:58.459 INFO:tasks.workunit.client.0.smithi016.stderr: -299> 2024-09-12T17:17:57.704+0000 7f2b6ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:17:58.459 INFO:tasks.workunit.client.0.smithi016.stderr: -298> 2024-09-12T17:17:57.704+0000 7f2b6ffff640 10 monclient: dump: 2024-09-12T17:17:58.459 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:17:58.459 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:17:58.459 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:58.459 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:58.459 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:17:58.459 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:58.459 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:17:58.459 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:17:58.460 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:17:58.460 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:58.460 INFO:tasks.workunit.client.0.smithi016.stderr: -297> 2024-09-12T17:17:57.704+0000 7f2b6ffff640 10 monclient: _finish_auth 0 2024-09-12T17:17:58.460 INFO:tasks.workunit.client.0.smithi016.stderr: -296> 2024-09-12T17:17:57.704+0000 7f2b6ffff640 10 monclient: _check_auth_tickets 2024-09-12T17:17:58.460 INFO:tasks.workunit.client.0.smithi016.stderr: -295> 2024-09-12T17:17:57.704+0000 7f2b6ffff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:17:58.460 INFO:tasks.workunit.client.0.smithi016.stderr: -294> 2024-09-12T17:17:57.704+0000 7f2b6ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:17:58.460 INFO:tasks.workunit.client.0.smithi016.stderr: -293> 2024-09-12T17:17:57.704+0000 7f2b6ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:17:58.460 INFO:tasks.workunit.client.0.smithi016.stderr: -292> 2024-09-12T17:17:57.704+0000 7f2b6ffff640 10 monclient: dump: 2024-09-12T17:17:58.460 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:17:58.460 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:17:58.460 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:58.460 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:58.460 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:17:58.461 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:58.461 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:17:58.461 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:17:58.461 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:17:58.461 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:58.461 INFO:tasks.workunit.client.0.smithi016.stderr: -291> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 monclient: authenticate success, global_id 6570 2024-09-12T17:17:58.461 INFO:tasks.workunit.client.0.smithi016.stderr: -290> 2024-09-12T17:17:57.704+0000 7f2c8b229640 4 set_mon_vals no callback set 2024-09-12T17:17:58.461 INFO:tasks.workunit.client.0.smithi016.stderr: -289> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 10 monclient: _renew_subs 2024-09-12T17:17:58.461 INFO:tasks.workunit.client.0.smithi016.stderr: -288> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:17:58.461 INFO:tasks.workunit.client.0.smithi016.stderr: -287> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 10 monclient: _renew_subs 2024-09-12T17:17:58.461 INFO:tasks.workunit.client.0.smithi016.stderr: -286> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:17:58.461 INFO:tasks.workunit.client.0.smithi016.stderr: -285> 2024-09-12T17:17:57.708+0000 7f2b6ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:17:58.461 INFO:tasks.workunit.client.0.smithi016.stderr: -284> 2024-09-12T17:17:57.708+0000 7f2b6ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:17:58.462 INFO:tasks.workunit.client.0.smithi016.stderr: -283> 2024-09-12T17:17:57.708+0000 7f2b6ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:17:58.462 INFO:tasks.workunit.client.0.smithi016.stderr: -282> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 10 monclient: get_monmap_and_config 2024-09-12T17:17:58.462 INFO:tasks.workunit.client.0.smithi016.stderr: -281> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 10 monclient: build_initial_monmap 2024-09-12T17:17:58.462 INFO:tasks.workunit.client.0.smithi016.stderr: -280> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 1 build_initial for_mkfs: 0 2024-09-12T17:17:58.462 INFO:tasks.workunit.client.0.smithi016.stderr: -279> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 10 monclient: monmap: 2024-09-12T17:17:58.462 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:17:58.462 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:17:58.462 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:17:58.462 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:17:58.462 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:17:58.462 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:58.462 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:17:58.462 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:17:58.463 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:17:58.463 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:58.463 INFO:tasks.workunit.client.0.smithi016.stderr: -278> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d087e80) adding auth protocol: cephx 2024-09-12T17:17:58.463 INFO:tasks.workunit.client.0.smithi016.stderr: -277> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d087e80) adding auth protocol: cephx 2024-09-12T17:17:58.463 INFO:tasks.workunit.client.0.smithi016.stderr: -276> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d087e80) adding auth protocol: cephx 2024-09-12T17:17:58.463 INFO:tasks.workunit.client.0.smithi016.stderr: -275> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d087e80) adding con mode: secure 2024-09-12T17:17:58.463 INFO:tasks.workunit.client.0.smithi016.stderr: -274> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d087e80) adding con mode: crc 2024-09-12T17:17:58.463 INFO:tasks.workunit.client.0.smithi016.stderr: -273> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d087e80) adding con mode: secure 2024-09-12T17:17:58.463 INFO:tasks.workunit.client.0.smithi016.stderr: -272> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d087e80) adding con mode: crc 2024-09-12T17:17:58.463 INFO:tasks.workunit.client.0.smithi016.stderr: -271> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d087e80) adding con mode: secure 2024-09-12T17:17:58.463 INFO:tasks.workunit.client.0.smithi016.stderr: -270> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d087e80) adding con mode: crc 2024-09-12T17:17:58.463 INFO:tasks.workunit.client.0.smithi016.stderr: -269> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d087e80) adding con mode: crc 2024-09-12T17:17:58.464 INFO:tasks.workunit.client.0.smithi016.stderr: -268> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d087e80) adding con mode: secure 2024-09-12T17:17:58.464 INFO:tasks.workunit.client.0.smithi016.stderr: -267> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d087e80) adding con mode: crc 2024-09-12T17:17:58.464 INFO:tasks.workunit.client.0.smithi016.stderr: -266> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d087e80) adding con mode: secure 2024-09-12T17:17:58.464 INFO:tasks.workunit.client.0.smithi016.stderr: -265> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d087e80) adding con mode: crc 2024-09-12T17:17:58.464 INFO:tasks.workunit.client.0.smithi016.stderr: -264> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d087e80) adding con mode: secure 2024-09-12T17:17:58.464 INFO:tasks.workunit.client.0.smithi016.stderr: -263> 2024-09-12T17:17:57.708+0000 7f2c8aa28640 10 monclient: get_auth_request con 0x7f2b64070a20 auth_method 0 2024-09-12T17:17:58.464 INFO:tasks.workunit.client.0.smithi016.stderr: -262> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:58.464 INFO:tasks.workunit.client.0.smithi016.stderr: -261> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 10 monclient: init 2024-09-12T17:17:58.464 INFO:tasks.workunit.client.0.smithi016.stderr: -260> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e58b0) adding auth protocol: cephx 2024-09-12T17:17:58.464 INFO:tasks.workunit.client.0.smithi016.stderr: -259> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e58b0) adding auth protocol: cephx 2024-09-12T17:17:58.464 INFO:tasks.workunit.client.0.smithi016.stderr: -258> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e58b0) adding auth protocol: cephx 2024-09-12T17:17:58.464 INFO:tasks.workunit.client.0.smithi016.stderr: -257> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e58b0) adding con mode: secure 2024-09-12T17:17:58.464 INFO:tasks.workunit.client.0.smithi016.stderr: -256> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e58b0) adding con mode: crc 2024-09-12T17:17:58.465 INFO:tasks.workunit.client.0.smithi016.stderr: -255> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e58b0) adding con mode: secure 2024-09-12T17:17:58.465 INFO:tasks.workunit.client.0.smithi016.stderr: -254> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e58b0) adding con mode: crc 2024-09-12T17:17:58.465 INFO:tasks.workunit.client.0.smithi016.stderr: -253> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e58b0) adding con mode: secure 2024-09-12T17:17:58.465 INFO:tasks.workunit.client.0.smithi016.stderr: -252> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e58b0) adding con mode: crc 2024-09-12T17:17:58.465 INFO:tasks.workunit.client.0.smithi016.stderr: -251> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e58b0) adding con mode: crc 2024-09-12T17:17:58.465 INFO:tasks.workunit.client.0.smithi016.stderr: -250> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e58b0) adding con mode: secure 2024-09-12T17:17:58.465 INFO:tasks.workunit.client.0.smithi016.stderr: -249> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e58b0) adding con mode: crc 2024-09-12T17:17:58.465 INFO:tasks.workunit.client.0.smithi016.stderr: -248> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e58b0) adding con mode: secure 2024-09-12T17:17:58.465 INFO:tasks.workunit.client.0.smithi016.stderr: -247> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e58b0) adding con mode: crc 2024-09-12T17:17:58.465 INFO:tasks.workunit.client.0.smithi016.stderr: -246> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e58b0) adding con mode: secure 2024-09-12T17:17:58.465 INFO:tasks.workunit.client.0.smithi016.stderr: -245> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:58.465 INFO:tasks.workunit.client.0.smithi016.stderr: -244> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:58.466 INFO:tasks.workunit.client.0.smithi016.stderr: -243> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 asok(0x55883cddd2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffdbf3e59f8 EEXIST 2024-09-12T17:17:58.466 INFO:tasks.workunit.client.0.smithi016.stderr: -242> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 10 monclient: _reopen_session rank -1 2024-09-12T17:17:58.466 INFO:tasks.workunit.client.0.smithi016.stderr: -241> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:17:58.466 INFO:tasks.workunit.client.0.smithi016.stderr: -240> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 10 monclient(hunting): picked mon.noname-a con 0x55883d0bc140 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:17:58.466 INFO:tasks.workunit.client.0.smithi016.stderr: -239> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 10 monclient(hunting): picked mon.noname-b con 0x55883d0bc520 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:17:58.466 INFO:tasks.workunit.client.0.smithi016.stderr: -238> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 10 monclient(hunting): picked mon.noname-c con 0x55883d0b68e0 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:17:58.466 INFO:tasks.workunit.client.0.smithi016.stderr: -237> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:58.466 INFO:tasks.workunit.client.0.smithi016.stderr: -236> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:58.466 INFO:tasks.workunit.client.0.smithi016.stderr: -235> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:58.466 INFO:tasks.workunit.client.0.smithi016.stderr: -234> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 10 monclient(hunting): _renew_subs 2024-09-12T17:17:58.466 INFO:tasks.workunit.client.0.smithi016.stderr: -233> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 10 monclient(hunting): authenticate will time out at 2195.686872s 2024-09-12T17:17:58.466 INFO:tasks.workunit.client.0.smithi016.stderr: -232> 2024-09-12T17:17:57.708+0000 7f2c89a26640 10 monclient(hunting): get_auth_request con 0x55883d0bc140 auth_method 0 2024-09-12T17:17:58.466 INFO:tasks.workunit.client.0.smithi016.stderr: -231> 2024-09-12T17:17:57.708+0000 7f2c89a26640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:17:58.467 INFO:tasks.workunit.client.0.smithi016.stderr: -230> 2024-09-12T17:17:57.708+0000 7f2c89a26640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:17:58.467 INFO:tasks.workunit.client.0.smithi016.stderr: -229> 2024-09-12T17:17:57.708+0000 7f2c89a26640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:17:58.467 INFO:tasks.workunit.client.0.smithi016.stderr: -228> 2024-09-12T17:17:57.708+0000 7f2c8a227640 10 monclient(hunting): get_auth_request con 0x55883d0b68e0 auth_method 0 2024-09-12T17:17:58.467 INFO:tasks.workunit.client.0.smithi016.stderr: -227> 2024-09-12T17:17:57.708+0000 7f2c8a227640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:17:58.467 INFO:tasks.workunit.client.0.smithi016.stderr: -226> 2024-09-12T17:17:57.708+0000 7f2c8a227640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:17:58.467 INFO:tasks.workunit.client.0.smithi016.stderr: -225> 2024-09-12T17:17:57.708+0000 7f2c8a227640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:17:58.467 INFO:tasks.workunit.client.0.smithi016.stderr: -224> 2024-09-12T17:17:57.708+0000 7f2c89a26640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:17:58.467 INFO:tasks.workunit.client.0.smithi016.stderr: -223> 2024-09-12T17:17:57.708+0000 7f2c89a26640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:17:58.467 INFO:tasks.workunit.client.0.smithi016.stderr: -222> 2024-09-12T17:17:57.708+0000 7f2c89a26640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:17:58.467 INFO:tasks.workunit.client.0.smithi016.stderr: -221> 2024-09-12T17:17:57.708+0000 7f2c8a227640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:17:58.467 INFO:tasks.workunit.client.0.smithi016.stderr: -220> 2024-09-12T17:17:57.708+0000 7f2c8a227640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:17:58.467 INFO:tasks.workunit.client.0.smithi016.stderr: -219> 2024-09-12T17:17:57.708+0000 7f2c8a227640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:17:58.468 INFO:tasks.workunit.client.0.smithi016.stderr: -218> 2024-09-12T17:17:57.708+0000 7f2c8aa28640 10 monclient(hunting): get_auth_request con 0x55883d0bc520 auth_method 0 2024-09-12T17:17:58.468 INFO:tasks.workunit.client.0.smithi016.stderr: -217> 2024-09-12T17:17:57.708+0000 7f2c8aa28640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:17:58.468 INFO:tasks.workunit.client.0.smithi016.stderr: -216> 2024-09-12T17:17:57.708+0000 7f2c8aa28640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:17:58.468 INFO:tasks.workunit.client.0.smithi016.stderr: -215> 2024-09-12T17:17:57.708+0000 7f2c8aa28640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:17:58.468 INFO:tasks.workunit.client.0.smithi016.stderr: -214> 2024-09-12T17:17:57.708+0000 7f2c89a26640 10 monclient(hunting): handle_auth_done global_id 6573 payload 274 2024-09-12T17:17:58.468 INFO:tasks.workunit.client.0.smithi016.stderr: -213> 2024-09-12T17:17:57.708+0000 7f2c89a26640 10 monclient: _finish_hunting 0 2024-09-12T17:17:58.468 INFO:tasks.workunit.client.0.smithi016.stderr: -212> 2024-09-12T17:17:57.708+0000 7f2c89a26640 1 monclient: found mon.noname-a 2024-09-12T17:17:58.468 INFO:tasks.workunit.client.0.smithi016.stderr: -211> 2024-09-12T17:17:57.708+0000 7f2c89a26640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:17:58.468 INFO:tasks.workunit.client.0.smithi016.stderr: -210> 2024-09-12T17:17:57.708+0000 7f2b6dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:17:58.468 INFO:tasks.workunit.client.0.smithi016.stderr: -209> 2024-09-12T17:17:57.708+0000 7f2b6dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:17:58.468 INFO:tasks.workunit.client.0.smithi016.stderr: -208> 2024-09-12T17:17:57.708+0000 7f2b6dffb640 10 monclient: dump: 2024-09-12T17:17:58.468 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:17:58.469 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:17:58.469 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:58.469 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:58.469 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:17:58.469 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:58.469 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:17:58.469 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:17:58.469 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:17:58.469 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:58.469 INFO:tasks.workunit.client.0.smithi016.stderr: -207> 2024-09-12T17:17:57.708+0000 7f2b6dffb640 10 monclient: _finish_auth 0 2024-09-12T17:17:58.469 INFO:tasks.workunit.client.0.smithi016.stderr: -206> 2024-09-12T17:17:57.708+0000 7f2b6dffb640 10 monclient: _check_auth_tickets 2024-09-12T17:17:58.469 INFO:tasks.workunit.client.0.smithi016.stderr: -205> 2024-09-12T17:17:57.708+0000 7f2b6dffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:17:58.469 INFO:tasks.workunit.client.0.smithi016.stderr: -204> 2024-09-12T17:17:57.708+0000 7f2b6dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:17:58.469 INFO:tasks.workunit.client.0.smithi016.stderr: -203> 2024-09-12T17:17:57.708+0000 7f2b6dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:17:58.470 INFO:tasks.workunit.client.0.smithi016.stderr: -202> 2024-09-12T17:17:57.708+0000 7f2b6dffb640 10 monclient: dump: 2024-09-12T17:17:58.470 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:17:58.470 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:17:58.470 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:58.470 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:58.470 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:17:58.470 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:58.470 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:17:58.470 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:17:58.470 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:17:58.470 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:58.470 INFO:tasks.workunit.client.0.smithi016.stderr: -201> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 monclient: authenticate success, global_id 6573 2024-09-12T17:17:58.470 INFO:tasks.workunit.client.0.smithi016.stderr: -200> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 10 monclient: get_monmap_and_config success 2024-09-12T17:17:58.471 INFO:tasks.workunit.client.0.smithi016.stderr: -199> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 4 set_mon_vals no callback set 2024-09-12T17:17:58.471 INFO:tasks.workunit.client.0.smithi016.stderr: -198> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 10 monclient: shutdown 2024-09-12T17:17:58.471 INFO:tasks.workunit.client.0.smithi016.stderr: -197> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 10 monclient: build_initial_monmap 2024-09-12T17:17:58.471 INFO:tasks.workunit.client.0.smithi016.stderr: -196> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 1 build_initial for_mkfs: 0 2024-09-12T17:17:58.471 INFO:tasks.workunit.client.0.smithi016.stderr: -195> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 10 monclient: monmap: 2024-09-12T17:17:58.471 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:17:58.471 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:17:58.471 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:17:58.471 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:17:58.471 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:17:58.471 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:58.471 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:17:58.471 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:17:58.472 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:17:58.472 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:58.472 INFO:tasks.workunit.client.0.smithi016.stderr: -194> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0b8580) adding auth protocol: cephx 2024-09-12T17:17:58.472 INFO:tasks.workunit.client.0.smithi016.stderr: -193> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0b8580) adding auth protocol: cephx 2024-09-12T17:17:58.472 INFO:tasks.workunit.client.0.smithi016.stderr: -192> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0b8580) adding auth protocol: cephx 2024-09-12T17:17:58.472 INFO:tasks.workunit.client.0.smithi016.stderr: -191> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0b8580) adding con mode: secure 2024-09-12T17:17:58.472 INFO:tasks.workunit.client.0.smithi016.stderr: -190> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0b8580) adding con mode: crc 2024-09-12T17:17:58.472 INFO:tasks.workunit.client.0.smithi016.stderr: -189> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0b8580) adding con mode: secure 2024-09-12T17:17:58.472 INFO:tasks.workunit.client.0.smithi016.stderr: -188> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0b8580) adding con mode: crc 2024-09-12T17:17:58.472 INFO:tasks.workunit.client.0.smithi016.stderr: -187> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0b8580) adding con mode: secure 2024-09-12T17:17:58.472 INFO:tasks.workunit.client.0.smithi016.stderr: -186> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0b8580) adding con mode: crc 2024-09-12T17:17:58.472 INFO:tasks.workunit.client.0.smithi016.stderr: -185> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0b8580) adding con mode: crc 2024-09-12T17:17:58.472 INFO:tasks.workunit.client.0.smithi016.stderr: -184> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0b8580) adding con mode: secure 2024-09-12T17:17:58.473 INFO:tasks.workunit.client.0.smithi016.stderr: -183> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0b8580) adding con mode: crc 2024-09-12T17:17:58.473 INFO:tasks.workunit.client.0.smithi016.stderr: -182> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0b8580) adding con mode: secure 2024-09-12T17:17:58.473 INFO:tasks.workunit.client.0.smithi016.stderr: -181> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0b8580) adding con mode: crc 2024-09-12T17:17:58.473 INFO:tasks.workunit.client.0.smithi016.stderr: -180> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0b8580) adding con mode: secure 2024-09-12T17:17:58.473 INFO:tasks.workunit.client.0.smithi016.stderr: -179> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:58.473 INFO:tasks.workunit.client.0.smithi016.stderr: -178> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 1 librados: starting msgr at 2024-09-12T17:17:58.473 INFO:tasks.workunit.client.0.smithi016.stderr: -177> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 1 librados: starting objecter 2024-09-12T17:17:58.473 INFO:tasks.workunit.client.0.smithi016.stderr: -176> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 asok(0x55883cddd2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55883d08c610 EEXIST 2024-09-12T17:17:58.473 INFO:tasks.workunit.client.0.smithi016.stderr: -175> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 1 librados: setting wanted keys 2024-09-12T17:17:58.473 INFO:tasks.workunit.client.0.smithi016.stderr: -174> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 1 librados: calling monclient init 2024-09-12T17:17:58.473 INFO:tasks.workunit.client.0.smithi016.stderr: -173> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 10 monclient: init 2024-09-12T17:17:58.473 INFO:tasks.workunit.client.0.smithi016.stderr: -172> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d06a5c0) adding auth protocol: cephx 2024-09-12T17:17:58.473 INFO:tasks.workunit.client.0.smithi016.stderr: -171> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d06a5c0) adding auth protocol: cephx 2024-09-12T17:17:58.474 INFO:tasks.workunit.client.0.smithi016.stderr: -170> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d06a5c0) adding auth protocol: cephx 2024-09-12T17:17:58.474 INFO:tasks.workunit.client.0.smithi016.stderr: -169> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d06a5c0) adding con mode: secure 2024-09-12T17:17:58.474 INFO:tasks.workunit.client.0.smithi016.stderr: -168> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d06a5c0) adding con mode: crc 2024-09-12T17:17:58.474 INFO:tasks.workunit.client.0.smithi016.stderr: -167> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d06a5c0) adding con mode: secure 2024-09-12T17:17:58.474 INFO:tasks.workunit.client.0.smithi016.stderr: -166> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d06a5c0) adding con mode: crc 2024-09-12T17:17:58.474 INFO:tasks.workunit.client.0.smithi016.stderr: -165> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d06a5c0) adding con mode: secure 2024-09-12T17:17:58.474 INFO:tasks.workunit.client.0.smithi016.stderr: -164> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d06a5c0) adding con mode: crc 2024-09-12T17:17:58.474 INFO:tasks.workunit.client.0.smithi016.stderr: -163> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d06a5c0) adding con mode: crc 2024-09-12T17:17:58.474 INFO:tasks.workunit.client.0.smithi016.stderr: -162> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d06a5c0) adding con mode: secure 2024-09-12T17:17:58.474 INFO:tasks.workunit.client.0.smithi016.stderr: -161> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d06a5c0) adding con mode: crc 2024-09-12T17:17:58.474 INFO:tasks.workunit.client.0.smithi016.stderr: -160> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d06a5c0) adding con mode: secure 2024-09-12T17:17:58.474 INFO:tasks.workunit.client.0.smithi016.stderr: -159> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d06a5c0) adding con mode: crc 2024-09-12T17:17:58.474 INFO:tasks.workunit.client.0.smithi016.stderr: -158> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d06a5c0) adding con mode: secure 2024-09-12T17:17:58.475 INFO:tasks.workunit.client.0.smithi016.stderr: -157> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:58.475 INFO:tasks.workunit.client.0.smithi016.stderr: -156> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:58.475 INFO:tasks.workunit.client.0.smithi016.stderr: -155> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 asok(0x55883cddd2b0) register_command rotate-key cmddesc rotate-key hook 0x55883d06a708 EEXIST 2024-09-12T17:17:58.475 INFO:tasks.workunit.client.0.smithi016.stderr: -154> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 10 monclient: _reopen_session rank -1 2024-09-12T17:17:58.475 INFO:tasks.workunit.client.0.smithi016.stderr: -153> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:17:58.475 INFO:tasks.workunit.client.0.smithi016.stderr: -152> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 10 monclient(hunting): picked mon.noname-b con 0x55883d0b68e0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:17:58.475 INFO:tasks.workunit.client.0.smithi016.stderr: -151> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 10 monclient(hunting): picked mon.noname-c con 0x55883d0bc140 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:17:58.475 INFO:tasks.workunit.client.0.smithi016.stderr: -150> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 10 monclient(hunting): picked mon.noname-a con 0x55883d0b1a00 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:17:58.475 INFO:tasks.workunit.client.0.smithi016.stderr: -149> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:58.475 INFO:tasks.workunit.client.0.smithi016.stderr: -148> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:58.475 INFO:tasks.workunit.client.0.smithi016.stderr: -147> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:58.475 INFO:tasks.workunit.client.0.smithi016.stderr: -146> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 10 monclient(hunting): _renew_subs 2024-09-12T17:17:58.475 INFO:tasks.workunit.client.0.smithi016.stderr: -145> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 10 monclient(hunting): authenticate will time out at 2195.689562s 2024-09-12T17:17:58.476 INFO:tasks.workunit.client.0.smithi016.stderr: -144> 2024-09-12T17:17:57.712+0000 7f2c8a227640 10 monclient(hunting): get_auth_request con 0x55883d0b1a00 auth_method 0 2024-09-12T17:17:58.476 INFO:tasks.workunit.client.0.smithi016.stderr: -143> 2024-09-12T17:17:57.712+0000 7f2c8a227640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:17:58.476 INFO:tasks.workunit.client.0.smithi016.stderr: -142> 2024-09-12T17:17:57.712+0000 7f2c8a227640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:17:58.476 INFO:tasks.workunit.client.0.smithi016.stderr: -141> 2024-09-12T17:17:57.712+0000 7f2c8a227640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:17:58.476 INFO:tasks.workunit.client.0.smithi016.stderr: -140> 2024-09-12T17:17:57.712+0000 7f2c8aa28640 10 monclient(hunting): get_auth_request con 0x55883d0bc140 auth_method 0 2024-09-12T17:17:58.476 INFO:tasks.workunit.client.0.smithi016.stderr: -139> 2024-09-12T17:17:57.712+0000 7f2c8aa28640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:17:58.476 INFO:tasks.workunit.client.0.smithi016.stderr: -138> 2024-09-12T17:17:57.712+0000 7f2c8aa28640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:17:58.476 INFO:tasks.workunit.client.0.smithi016.stderr: -137> 2024-09-12T17:17:57.712+0000 7f2c8aa28640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:17:58.476 INFO:tasks.workunit.client.0.smithi016.stderr: -136> 2024-09-12T17:17:57.712+0000 7f2c8a227640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:17:58.476 INFO:tasks.workunit.client.0.smithi016.stderr: -135> 2024-09-12T17:17:57.712+0000 7f2c8a227640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:17:58.476 INFO:tasks.workunit.client.0.smithi016.stderr: -134> 2024-09-12T17:17:57.712+0000 7f2c8a227640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:17:58.476 INFO:tasks.workunit.client.0.smithi016.stderr: -133> 2024-09-12T17:17:57.712+0000 7f2c8aa28640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:17:58.476 INFO:tasks.workunit.client.0.smithi016.stderr: -132> 2024-09-12T17:17:57.712+0000 7f2c8aa28640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:17:58.477 INFO:tasks.workunit.client.0.smithi016.stderr: -131> 2024-09-12T17:17:57.712+0000 7f2c8aa28640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:17:58.477 INFO:tasks.workunit.client.0.smithi016.stderr: -130> 2024-09-12T17:17:57.712+0000 7f2c8a227640 10 monclient(hunting): handle_auth_done global_id 6576 payload 824 2024-09-12T17:17:58.477 INFO:tasks.workunit.client.0.smithi016.stderr: -129> 2024-09-12T17:17:57.712+0000 7f2c8a227640 10 monclient: _finish_hunting 0 2024-09-12T17:17:58.477 INFO:tasks.workunit.client.0.smithi016.stderr: -128> 2024-09-12T17:17:57.712+0000 7f2c8a227640 1 monclient: found mon.noname-a 2024-09-12T17:17:58.477 INFO:tasks.workunit.client.0.smithi016.stderr: -127> 2024-09-12T17:17:57.712+0000 7f2c8a227640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:17:58.477 INFO:tasks.workunit.client.0.smithi016.stderr: -126> 2024-09-12T17:17:57.712+0000 7f2b5bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:17:58.477 INFO:tasks.workunit.client.0.smithi016.stderr: -125> 2024-09-12T17:17:57.712+0000 7f2b5bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:17:58.477 INFO:tasks.workunit.client.0.smithi016.stderr: -124> 2024-09-12T17:17:57.712+0000 7f2b5bfff640 10 monclient: dump: 2024-09-12T17:17:58.477 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:17:58.477 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:17:58.477 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:58.477 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:58.477 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:17:58.478 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:58.478 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:17:58.478 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:17:58.478 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:17:58.478 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:58.478 INFO:tasks.workunit.client.0.smithi016.stderr: -123> 2024-09-12T17:17:57.712+0000 7f2b5bfff640 10 monclient: _finish_auth 0 2024-09-12T17:17:58.478 INFO:tasks.workunit.client.0.smithi016.stderr: -122> 2024-09-12T17:17:57.712+0000 7f2b5bfff640 10 monclient: _check_auth_tickets 2024-09-12T17:17:58.478 INFO:tasks.workunit.client.0.smithi016.stderr: -121> 2024-09-12T17:17:57.712+0000 7f2b5bfff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:17:58.478 INFO:tasks.workunit.client.0.smithi016.stderr: -120> 2024-09-12T17:17:57.712+0000 7f2b5bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:17:58.478 INFO:tasks.workunit.client.0.smithi016.stderr: -119> 2024-09-12T17:17:57.712+0000 7f2b5bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:17:58.478 INFO:tasks.workunit.client.0.smithi016.stderr: -118> 2024-09-12T17:17:57.712+0000 7f2b5bfff640 10 monclient: dump: 2024-09-12T17:17:58.478 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:17:58.478 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:17:58.479 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:58.479 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:58.479 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:17:58.479 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:58.479 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:17:58.479 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:17:58.479 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:17:58.479 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:58.479 INFO:tasks.workunit.client.0.smithi016.stderr: -117> 2024-09-12T17:17:57.712+0000 7f2b6dffb640 4 set_mon_vals no callback set 2024-09-12T17:17:58.479 INFO:tasks.workunit.client.0.smithi016.stderr: -116> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 monclient: authenticate success, global_id 6576 2024-09-12T17:17:58.479 INFO:tasks.workunit.client.0.smithi016.stderr: -115> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 10 monclient: _renew_subs 2024-09-12T17:17:58.479 INFO:tasks.workunit.client.0.smithi016.stderr: -114> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:17:58.479 INFO:tasks.workunit.client.0.smithi016.stderr: -113> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 10 monclient: _renew_subs 2024-09-12T17:17:58.480 INFO:tasks.workunit.client.0.smithi016.stderr: -112> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:17:58.480 INFO:tasks.workunit.client.0.smithi016.stderr: -111> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 1 librados: init done 2024-09-12T17:17:58.480 INFO:tasks.workunit.client.0.smithi016.stderr: -110> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 asok(0x55883cddd2b0) register_command cr dump hook 0x55883d0b13f8 2024-09-12T17:17:58.480 INFO:tasks.workunit.client.0.smithi016.stderr: -109> 2024-09-12T17:17:57.716+0000 7f2c8c7219c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.480 INFO:tasks.workunit.client.0.smithi016.stderr: -108> 2024-09-12T17:17:57.716+0000 7f2b5bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:17:58.480 INFO:tasks.workunit.client.0.smithi016.stderr: -107> 2024-09-12T17:17:57.716+0000 7f2b5bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:17:58.480 INFO:tasks.workunit.client.0.smithi016.stderr: -106> 2024-09-12T17:17:57.716+0000 7f2b5bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:17:58.480 INFO:tasks.workunit.client.0.smithi016.stderr: -105> 2024-09-12T17:17:57.716+0000 7f2c8aa28640 10 monclient: get_auth_request con 0x55883d0d60d0 auth_method 0 2024-09-12T17:17:58.480 INFO:tasks.workunit.client.0.smithi016.stderr: -104> 2024-09-12T17:17:57.716+0000 7f2c89a26640 10 monclient: get_auth_request con 0x7f2b54070ae0 auth_method 0 2024-09-12T17:17:58.480 INFO:tasks.workunit.client.0.smithi016.stderr: -103> 2024-09-12T17:17:57.716+0000 7f2c8c7219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:58.480 INFO:tasks.workunit.client.0.smithi016.stderr: -102> 2024-09-12T17:17:57.716+0000 7f2c8c7219c0 20 realm 2024-09-12T17:17:58.480 INFO:tasks.workunit.client.0.smithi016.stderr: -101> 2024-09-12T17:17:57.716+0000 7f2c8c7219c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.480 INFO:tasks.workunit.client.0.smithi016.stderr: -100> 2024-09-12T17:17:57.716+0000 7f2c8c7219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:58.481 INFO:tasks.workunit.client.0.smithi016.stderr: -99> 2024-09-12T17:17:57.716+0000 7f2c8c7219c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:17:58.481 INFO:tasks.workunit.client.0.smithi016.stderr: -98> 2024-09-12T17:17:57.716+0000 7f2c8c7219c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.481 INFO:tasks.workunit.client.0.smithi016.stderr: -97> 2024-09-12T17:17:57.716+0000 7f2c8c7219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:58.481 INFO:tasks.workunit.client.0.smithi016.stderr: -96> 2024-09-12T17:17:57.716+0000 7f2c8c7219c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.481 INFO:tasks.workunit.client.0.smithi016.stderr: -95> 2024-09-12T17:17:57.716+0000 7f2c89a26640 10 monclient: get_auth_request con 0x55883d0da2d0 auth_method 0 2024-09-12T17:17:58.481 INFO:tasks.workunit.client.0.smithi016.stderr: -94> 2024-09-12T17:17:57.720+0000 7f2c8c7219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:58.481 INFO:tasks.workunit.client.0.smithi016.stderr: -93> 2024-09-12T17:17:57.720+0000 7f2c8c7219c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.481 INFO:tasks.workunit.client.0.smithi016.stderr: -92> 2024-09-12T17:17:57.720+0000 7f2c8aa28640 10 monclient: get_auth_request con 0x55883d0ddb10 auth_method 0 2024-09-12T17:17:58.481 INFO:tasks.workunit.client.0.smithi016.stderr: -91> 2024-09-12T17:17:57.924+0000 7f2c8aa28640 10 monclient: get_auth_request con 0x55883d0ddb10 auth_method 0 2024-09-12T17:17:58.481 INFO:tasks.workunit.client.0.smithi016.stderr: -90> 2024-09-12T17:17:57.924+0000 7f2c8c7219c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:17:58.481 INFO:tasks.workunit.client.0.smithi016.stderr: -89> 2024-09-12T17:17:57.924+0000 7f2c8c7219c0 20 searching for the correct realm 2024-09-12T17:17:58.481 INFO:tasks.workunit.client.0.smithi016.stderr: -88> 2024-09-12T17:17:57.924+0000 7f2c8a227640 10 monclient: get_auth_request con 0x55883d0e2800 auth_method 0 2024-09-12T17:17:58.481 INFO:tasks.workunit.client.0.smithi016.stderr: -87> 2024-09-12T17:17:57.928+0000 7f2c89a26640 10 monclient: get_auth_request con 0x7f2c7c03a060 auth_method 0 2024-09-12T17:17:58.482 INFO:tasks.workunit.client.0.smithi016.stderr: -86> 2024-09-12T17:17:57.928+0000 7f2c8aa28640 0 -- 172.21.15.16:0/3121594993 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f2c8012cb20 msgr2=0x7f2c800f72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:58.482 INFO:tasks.workunit.client.0.smithi016.stderr: -85> 2024-09-12T17:17:58.132+0000 7f2c8aa28640 10 monclient: get_auth_request con 0x7f2c8012cb20 auth_method 0 2024-09-12T17:17:58.482 INFO:tasks.workunit.client.0.smithi016.stderr: -84> 2024-09-12T17:17:58.136+0000 7f2c8a227640 10 monclient: get_auth_request con 0x7f2c84023040 auth_method 0 2024-09-12T17:17:58.482 INFO:tasks.workunit.client.0.smithi016.stderr: -83> 2024-09-12T17:17:58.144+0000 7f2c89a26640 0 -- 172.21.15.16:0/3121594993 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f2c8402e410 msgr2=0x7f2c8402e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:58.482 INFO:tasks.workunit.client.0.smithi016.stderr: -82> 2024-09-12T17:17:58.348+0000 7f2c89a26640 10 monclient: get_auth_request con 0x7f2c8402e410 auth_method 0 2024-09-12T17:17:58.482 INFO:tasks.workunit.client.0.smithi016.stderr: -81> 2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:17:58.482 INFO:tasks.workunit.client.0.smithi016.stderr: -80> 2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:17:58.482 INFO:tasks.workunit.client.0.smithi016.stderr: -79> 2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:17:58.482 INFO:tasks.workunit.client.0.smithi016.stderr: -78> 2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:17:58.482 INFO:tasks.workunit.client.0.smithi016.stderr: -77> 2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:17:58.482 INFO:tasks.workunit.client.0.smithi016.stderr: -76> 2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:17:58.482 INFO:tasks.workunit.client.0.smithi016.stderr: -75> 2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.482 INFO:tasks.workunit.client.0.smithi016.stderr: -74> 2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:58.483 INFO:tasks.workunit.client.0.smithi016.stderr: -73> 2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.483 INFO:tasks.workunit.client.0.smithi016.stderr: -72> 2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:58.483 INFO:tasks.workunit.client.0.smithi016.stderr: -71> 2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.483 INFO:tasks.workunit.client.0.smithi016.stderr: -70> 2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:17:58.483 INFO:tasks.workunit.client.0.smithi016.stderr: -69> 2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 zone default found 2024-09-12T17:17:58.483 INFO:tasks.workunit.client.0.smithi016.stderr: -68> 2024-09-12T17:17:58.364+0000 7f2c8c7219c0 4 Realm: () 2024-09-12T17:17:58.483 INFO:tasks.workunit.client.0.smithi016.stderr: -67> 2024-09-12T17:17:58.364+0000 7f2c8c7219c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:17:58.483 INFO:tasks.workunit.client.0.smithi016.stderr: -66> 2024-09-12T17:17:58.364+0000 7f2c8c7219c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:17:58.483 INFO:tasks.workunit.client.0.smithi016.stderr: -65> 2024-09-12T17:17:58.364+0000 7f2c8c7219c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:17:58.483 INFO:tasks.workunit.client.0.smithi016.stderr: -64> 2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 zonegroup default 2024-09-12T17:17:58.483 INFO:tasks.workunit.client.0.smithi016.stderr: -63> 2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.483 INFO:tasks.workunit.client.0.smithi016.stderr: -62> 2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:58.483 INFO:tasks.workunit.client.0.smithi016.stderr: -61> 2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.483 INFO:tasks.workunit.client.0.smithi016.stderr: -60> 2024-09-12T17:17:58.368+0000 7f2c8c7219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:58.484 INFO:tasks.workunit.client.0.smithi016.stderr: -59> 2024-09-12T17:17:58.368+0000 7f2c8c7219c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.484 INFO:tasks.workunit.client.0.smithi016.stderr: -58> 2024-09-12T17:17:58.368+0000 7f2c8c7219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:58.484 INFO:tasks.workunit.client.0.smithi016.stderr: -57> 2024-09-12T17:17:58.368+0000 7f2c8c7219c0 20 started sync module instance, tier type = 2024-09-12T17:17:58.484 INFO:tasks.workunit.client.0.smithi016.stderr: -56> 2024-09-12T17:17:58.368+0000 7f2c8c7219c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:17:58.484 INFO:tasks.workunit.client.0.smithi016.stderr: -55> 2024-09-12T17:17:58.392+0000 7f2c8c7219c0 20 add_watcher() i=0 2024-09-12T17:17:58.484 INFO:tasks.workunit.client.0.smithi016.stderr: -54> 2024-09-12T17:17:58.392+0000 7f2c8c7219c0 20 add_watcher() i=1 2024-09-12T17:17:58.484 INFO:tasks.workunit.client.0.smithi016.stderr: -53> 2024-09-12T17:17:58.392+0000 7f2c8c7219c0 20 add_watcher() i=2 2024-09-12T17:17:58.484 INFO:tasks.workunit.client.0.smithi016.stderr: -52> 2024-09-12T17:17:58.392+0000 7f2c8c7219c0 20 add_watcher() i=3 2024-09-12T17:17:58.484 INFO:tasks.workunit.client.0.smithi016.stderr: -51> 2024-09-12T17:17:58.392+0000 7f2c8c7219c0 20 add_watcher() i=4 2024-09-12T17:17:58.484 INFO:tasks.workunit.client.0.smithi016.stderr: -50> 2024-09-12T17:17:58.392+0000 7f2c8c7219c0 20 add_watcher() i=5 2024-09-12T17:17:58.484 INFO:tasks.workunit.client.0.smithi016.stderr: -49> 2024-09-12T17:17:58.392+0000 7f2c8c7219c0 20 add_watcher() i=6 2024-09-12T17:17:58.484 INFO:tasks.workunit.client.0.smithi016.stderr: -48> 2024-09-12T17:17:58.392+0000 7f2c8c7219c0 20 add_watcher() i=7 2024-09-12T17:17:58.485 INFO:tasks.workunit.client.0.smithi016.stderr: -47> 2024-09-12T17:17:58.392+0000 7f2c8c7219c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:17:58.485 INFO:tasks.workunit.client.0.smithi016.stderr: -46> 2024-09-12T17:17:58.396+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e5d80) adding auth protocol: cephx 2024-09-12T17:17:58.485 INFO:tasks.workunit.client.0.smithi016.stderr: -45> 2024-09-12T17:17:58.396+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e5d80) adding auth protocol: cephx 2024-09-12T17:17:58.485 INFO:tasks.workunit.client.0.smithi016.stderr: -44> 2024-09-12T17:17:58.396+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e5d80) adding auth protocol: cephx 2024-09-12T17:17:58.485 INFO:tasks.workunit.client.0.smithi016.stderr: -43> 2024-09-12T17:17:58.396+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e5d80) adding con mode: secure 2024-09-12T17:17:58.485 INFO:tasks.workunit.client.0.smithi016.stderr: -42> 2024-09-12T17:17:58.396+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e5d80) adding con mode: crc 2024-09-12T17:17:58.485 INFO:tasks.workunit.client.0.smithi016.stderr: -41> 2024-09-12T17:17:58.396+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e5d80) adding con mode: secure 2024-09-12T17:17:58.485 INFO:tasks.workunit.client.0.smithi016.stderr: -40> 2024-09-12T17:17:58.396+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e5d80) adding con mode: crc 2024-09-12T17:17:58.485 INFO:tasks.workunit.client.0.smithi016.stderr: -39> 2024-09-12T17:17:58.396+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e5d80) adding con mode: secure 2024-09-12T17:17:58.485 INFO:tasks.workunit.client.0.smithi016.stderr: -38> 2024-09-12T17:17:58.396+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e5d80) adding con mode: crc 2024-09-12T17:17:58.485 INFO:tasks.workunit.client.0.smithi016.stderr: -37> 2024-09-12T17:17:58.396+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e5d80) adding con mode: crc 2024-09-12T17:17:58.485 INFO:tasks.workunit.client.0.smithi016.stderr: -36> 2024-09-12T17:17:58.396+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e5d80) adding con mode: secure 2024-09-12T17:17:58.485 INFO:tasks.workunit.client.0.smithi016.stderr: -35> 2024-09-12T17:17:58.396+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e5d80) adding con mode: crc 2024-09-12T17:17:58.486 INFO:tasks.workunit.client.0.smithi016.stderr: -34> 2024-09-12T17:17:58.396+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e5d80) adding con mode: secure 2024-09-12T17:17:58.486 INFO:tasks.workunit.client.0.smithi016.stderr: -33> 2024-09-12T17:17:58.396+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e5d80) adding con mode: crc 2024-09-12T17:17:58.486 INFO:tasks.workunit.client.0.smithi016.stderr: -32> 2024-09-12T17:17:58.396+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e5d80) adding con mode: secure 2024-09-12T17:17:58.486 INFO:tasks.workunit.client.0.smithi016.stderr: -31> 2024-09-12T17:17:58.396+0000 7f2b40fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:58.486 INFO:tasks.workunit.client.0.smithi016.stderr: -30> 2024-09-12T17:17:58.400+0000 7f2c8c7219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:58.486 INFO:tasks.workunit.client.0.smithi016.stderr: -29> 2024-09-12T17:17:58.400+0000 7f2c8c7219c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:17:58.486 INFO:tasks.workunit.client.0.smithi016.stderr: -28> 2024-09-12T17:17:58.400+0000 7f2c8c7219c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:17:58.486 INFO:tasks.workunit.client.0.smithi016.stderr: -27> 2024-09-12T17:17:58.400+0000 7f2c8c7219c0 5 asok(0x55883cddd2b0) register_command cache list hook 0x55883d0b43c0 2024-09-12T17:17:58.486 INFO:tasks.workunit.client.0.smithi016.stderr: -26> 2024-09-12T17:17:58.400+0000 7f2c8c7219c0 5 asok(0x55883cddd2b0) register_command cache inspect hook 0x55883d0b43c0 2024-09-12T17:17:58.486 INFO:tasks.workunit.client.0.smithi016.stderr: -25> 2024-09-12T17:17:58.400+0000 7f2c8c7219c0 5 asok(0x55883cddd2b0) register_command cache erase hook 0x55883d0b43c0 2024-09-12T17:17:58.486 INFO:tasks.workunit.client.0.smithi016.stderr: -24> 2024-09-12T17:17:58.400+0000 7f2c8c7219c0 5 asok(0x55883cddd2b0) register_command cache zap hook 0x55883d0b43c0 2024-09-12T17:17:58.486 INFO:tasks.workunit.client.0.smithi016.stderr: -23> 2024-09-12T17:17:58.400+0000 7f2c8c7219c0 5 note: GC not initialized 2024-09-12T17:17:58.486 INFO:tasks.workunit.client.0.smithi016.stderr: -22> 2024-09-12T17:17:58.400+0000 7f2abb7fe640 20 reqs_thread_entry: start 2024-09-12T17:17:58.487 INFO:tasks.workunit.client.0.smithi016.stderr: -21> 2024-09-12T17:17:58.400+0000 7f2c8c7219c0 5 asok(0x55883cddd2b0) register_command sync trace show hook 0x7f2c8011c070 2024-09-12T17:17:58.487 INFO:tasks.workunit.client.0.smithi016.stderr: -20> 2024-09-12T17:17:58.400+0000 7f2c8c7219c0 5 asok(0x55883cddd2b0) register_command sync trace history hook 0x7f2c8011c070 2024-09-12T17:17:58.487 INFO:tasks.workunit.client.0.smithi016.stderr: -19> 2024-09-12T17:17:58.400+0000 7f2c8c7219c0 5 asok(0x55883cddd2b0) register_command sync trace active hook 0x7f2c8011c070 2024-09-12T17:17:58.487 INFO:tasks.workunit.client.0.smithi016.stderr: -18> 2024-09-12T17:17:58.400+0000 7f2c8c7219c0 5 asok(0x55883cddd2b0) register_command sync trace active_short hook 0x7f2c8011c070 2024-09-12T17:17:58.487 INFO:tasks.workunit.client.0.smithi016.stderr: -17> 2024-09-12T17:17:58.400+0000 7f2c8c7219c0 20 init_complete bucket index max shards: 1 2024-09-12T17:17:58.487 INFO:tasks.workunit.client.0.smithi016.stderr: -16> 2024-09-12T17:17:58.400+0000 7f2c8c7219c0 20 Filter name: none 2024-09-12T17:17:58.487 INFO:tasks.workunit.client.0.smithi016.stderr: -15> 2024-09-12T17:17:58.400+0000 7f2ab97fa640 20 reqs_thread_entry: start 2024-09-12T17:17:58.487 INFO:tasks.workunit.client.0.smithi016.stderr: -14> 2024-09-12T17:17:58.400+0000 7f2c8c7219c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T17:17:58.487 INFO:tasks.workunit.client.0.smithi016.stderr: -13> 2024-09-12T17:17:58.400+0000 7f2c8c7219c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.487 INFO:tasks.workunit.client.0.smithi016.stderr: -12> 2024-09-12T17:17:58.400+0000 7f2c8c7219c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:17:58.487 INFO:tasks.workunit.client.0.smithi016.stderr: -11> 2024-09-12T17:17:58.400+0000 7f2c8c7219c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T17:17:58.487 INFO:tasks.workunit.client.0.smithi016.stderr: -10> 2024-09-12T17:17:58.400+0000 7f2c8c7219c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T17:17:58.487 INFO:tasks.workunit.client.0.smithi016.stderr: -9> 2024-09-12T17:17:58.400+0000 7f2c8c7219c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24 : miss 2024-09-12T17:17:58.487 INFO:tasks.workunit.client.0.smithi016.stderr: -8> 2024-09-12T17:17:58.400+0000 7f2c8c7219c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.488 INFO:tasks.workunit.client.0.smithi016.stderr: -7> 2024-09-12T17:17:58.404+0000 7f2c8c7219c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:17:58.488 INFO:tasks.workunit.client.0.smithi016.stderr: -6> 2024-09-12T17:17:58.404+0000 7f2c8c7219c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24 info.flags=0x17 2024-09-12T17:17:58.488 INFO:tasks.workunit.client.0.smithi016.stderr: -5> 2024-09-12T17:17:58.404+0000 7f2c8c7219c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24 to cache LRU end 2024-09-12T17:17:58.488 INFO:tasks.workunit.client.0.smithi016.stderr: -4> 2024-09-12T17:17:58.404+0000 7f2c8c7219c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:17:58.488 INFO:tasks.workunit.client.0.smithi016.stderr: -3> 2024-09-12T17:17:58.404+0000 7f2c8c7219c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:17:58.488 INFO:tasks.workunit.client.0.smithi016.stderr: -2> 2024-09-12T17:17:58.404+0000 7f2c8c7219c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24 2024-09-12T17:17:58.488 INFO:tasks.workunit.client.0.smithi016.stderr: -1> 2024-09-12T17:17:58.412+0000 7f2c8c7219c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2c8c7219c0 time 2024-09-12T17:17:58.413570+0000 2024-09-12T17:17:58.488 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:17:58.488 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:58.488 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:17:58.488 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f2c8fffb2eb] 2024-09-12T17:17:58.488 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2c8fffb49f] 2024-09-12T17:17:58.489 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55883a04c0c1] 2024-09-12T17:17:58.489 INFO:tasks.workunit.client.0.smithi016.stderr: 4: radosgw-admin(+0x140f6b8) [0x55883aaa16b8] 2024-09-12T17:17:58.489 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55883a05e18d] 2024-09-12T17:17:58.489 INFO:tasks.workunit.client.0.smithi016.stderr: 6: main() 2024-09-12T17:17:58.489 INFO:tasks.workunit.client.0.smithi016.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2c8ee61d90] 2024-09-12T17:17:58.489 INFO:tasks.workunit.client.0.smithi016.stderr: 8: __libc_start_main() 2024-09-12T17:17:58.489 INFO:tasks.workunit.client.0.smithi016.stderr: 9: _start() 2024-09-12T17:17:58.489 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:58.489 INFO:tasks.workunit.client.0.smithi016.stderr: 0> 2024-09-12T17:17:58.416+0000 7f2c8c7219c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:17:58.489 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7f2c8c7219c0 thread_name:radosgw-admin 2024-09-12T17:17:58.489 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:58.489 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:17:58.490 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2c8ee7a520] 2024-09-12T17:17:58.490 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:17:58.490 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:17:58.490 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:17:58.490 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2c8fffb345] 2024-09-12T17:17:58.490 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2c8fffb49f] 2024-09-12T17:17:58.490 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55883a04c0c1] 2024-09-12T17:17:58.490 INFO:tasks.workunit.client.0.smithi016.stderr: 8: radosgw-admin(+0x140f6b8) [0x55883aaa16b8] 2024-09-12T17:17:58.490 INFO:tasks.workunit.client.0.smithi016.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55883a05e18d] 2024-09-12T17:17:58.490 INFO:tasks.workunit.client.0.smithi016.stderr: 10: main() 2024-09-12T17:17:58.490 INFO:tasks.workunit.client.0.smithi016.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2c8ee61d90] 2024-09-12T17:17:58.490 INFO:tasks.workunit.client.0.smithi016.stderr: 12: __libc_start_main() 2024-09-12T17:17:58.490 INFO:tasks.workunit.client.0.smithi016.stderr: 13: _start() 2024-09-12T17:17:58.491 INFO:tasks.workunit.client.0.smithi016.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:17:58.491 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:58.491 INFO:tasks.workunit.client.0.smithi016.stderr:--- logging levels --- 2024-09-12T17:17:58.491 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 none 2024-09-12T17:17:58.491 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 lockdep 2024-09-12T17:17:58.491 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 context 2024-09-12T17:17:58.491 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 crush 2024-09-12T17:17:58.491 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds 2024-09-12T17:17:58.491 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_balancer 2024-09-12T17:17:58.491 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_locker 2024-09-12T17:17:58.491 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log 2024-09-12T17:17:58.491 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log_expire 2024-09-12T17:17:58.491 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_migrator 2024-09-12T17:17:58.491 INFO:tasks.workunit.client.0.smithi016.stderr: 3/ 5 mds_quiesce 2024-09-12T17:17:58.492 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 buffer 2024-09-12T17:17:58.492 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 timer 2024-09-12T17:17:58.492 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 filer 2024-09-12T17:17:58.492 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 striper 2024-09-12T17:17:58.492 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 objecter 2024-09-12T17:17:58.492 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rados 2024-09-12T17:17:58.492 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd 2024-09-12T17:17:58.492 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_mirror 2024-09-12T17:17:58.492 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_replay 2024-09-12T17:17:58.492 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_pwl 2024-09-12T17:17:58.492 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 journaler 2024-09-12T17:17:58.492 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objectcacher 2024-09-12T17:17:58.493 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:17:58.493 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 client 2024-09-12T17:17:58.493 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 osd 2024-09-12T17:17:58.493 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 optracker 2024-09-12T17:17:58.493 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objclass 2024-09-12T17:17:58.493 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 filestore 2024-09-12T17:17:58.493 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 journal 2024-09-12T17:17:58.493 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 ms 2024-09-12T17:17:58.493 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mon 2024-09-12T17:17:58.493 INFO:tasks.workunit.client.0.smithi016.stderr: 0/10 monc 2024-09-12T17:17:58.493 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 paxos 2024-09-12T17:17:58.493 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 tp 2024-09-12T17:17:58.493 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 auth 2024-09-12T17:17:58.493 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 crypto 2024-09-12T17:17:58.494 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 finisher 2024-09-12T17:17:58.494 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 reserver 2024-09-12T17:17:58.494 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 heartbeatmap 2024-09-12T17:17:58.494 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 perfcounter 2024-09-12T17:17:58.494 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw 2024-09-12T17:17:58.494 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_sync 2024-09-12T17:17:58.494 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_datacache 2024-09-12T17:17:58.494 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_access 2024-09-12T17:17:58.494 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:17:58.494 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_flight 2024-09-12T17:17:58.494 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:17:58.494 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw_notification 2024-09-12T17:17:58.494 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 javaclient 2024-09-12T17:17:58.495 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 asok 2024-09-12T17:17:58.495 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 throttle 2024-09-12T17:17:58.495 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 refs 2024-09-12T17:17:58.495 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 compressor 2024-09-12T17:17:58.495 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluestore 2024-09-12T17:17:58.495 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluefs 2024-09-12T17:17:58.495 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 bdev 2024-09-12T17:17:58.495 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 kstore 2024-09-12T17:17:58.495 INFO:tasks.workunit.client.0.smithi016.stderr: 4/ 5 rocksdb 2024-09-12T17:17:58.495 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 fuse 2024-09-12T17:17:58.495 INFO:tasks.workunit.client.0.smithi016.stderr: 2/ 5 mgr 2024-09-12T17:17:58.495 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mgrc 2024-09-12T17:17:58.495 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 dpdk 2024-09-12T17:17:58.495 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 eventtrace 2024-09-12T17:17:58.496 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 prioritycache 2024-09-12T17:17:58.496 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 test 2024-09-12T17:17:58.496 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:17:58.496 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephsqlite 2024-09-12T17:17:58.496 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:17:58.496 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore 2024-09-12T17:17:58.496 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_onode 2024-09-12T17:17:58.496 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_odata 2024-09-12T17:17:58.496 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_omap 2024-09-12T17:17:58.496 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_tm 2024-09-12T17:17:58.496 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_t 2024-09-12T17:17:58.496 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:17:58.497 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_epm 2024-09-12T17:17:58.497 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_lba 2024-09-12T17:17:58.497 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:17:58.497 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cache 2024-09-12T17:17:58.497 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_journal 2024-09-12T17:17:58.497 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_device 2024-09-12T17:17:58.497 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_backref 2024-09-12T17:17:58.497 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 alienstore 2024-09-12T17:17:58.497 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mclock 2024-09-12T17:17:58.497 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cyanstore 2024-09-12T17:17:58.497 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 ceph_exporter 2024-09-12T17:17:58.497 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 memstore 2024-09-12T17:17:58.497 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 trace 2024-09-12T17:17:58.497 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 ceph_dedup 2024-09-12T17:17:58.498 INFO:tasks.workunit.client.0.smithi016.stderr: -2/-2 (syslog threshold) 2024-09-12T17:17:58.498 INFO:tasks.workunit.client.0.smithi016.stderr: 99/99 (stderr threshold) 2024-09-12T17:17:58.498 INFO:tasks.workunit.client.0.smithi016.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:17:58.498 INFO:tasks.workunit.client.0.smithi016.stderr: 7f2ab97fa640 / http_manager 2024-09-12T17:17:58.498 INFO:tasks.workunit.client.0.smithi016.stderr: 7f2abb7fe640 / http_manager 2024-09-12T17:17:58.498 INFO:tasks.workunit.client.0.smithi016.stderr: 7f2b40fe1640 / rgw_dt_lg_renew 2024-09-12T17:17:58.498 INFO:tasks.workunit.client.0.smithi016.stderr: 7f2b5bfff640 / ms_dispatch 2024-09-12T17:17:58.498 INFO:tasks.workunit.client.0.smithi016.stderr: 7f2b6dffb640 / io_context_pool 2024-09-12T17:17:58.498 INFO:tasks.workunit.client.0.smithi016.stderr: 7f2b6ffff640 / ms_dispatch 2024-09-12T17:17:58.498 INFO:tasks.workunit.client.0.smithi016.stderr: 7f2b76e05640 / ms_dispatch 2024-09-12T17:17:58.498 INFO:tasks.workunit.client.0.smithi016.stderr: 7f2b78608640 / io_context_pool 2024-09-12T17:17:58.498 INFO:tasks.workunit.client.0.smithi016.stderr: 7f2c89a26640 / msgr-worker-2 2024-09-12T17:17:58.498 INFO:tasks.workunit.client.0.smithi016.stderr: 7f2c8a227640 / msgr-worker-1 2024-09-12T17:17:58.499 INFO:tasks.workunit.client.0.smithi016.stderr: 7f2c8aa28640 / msgr-worker-0 2024-09-12T17:17:58.499 INFO:tasks.workunit.client.0.smithi016.stderr: 7f2c8b229640 / io_context_pool 2024-09-12T17:17:58.499 INFO:tasks.workunit.client.0.smithi016.stderr: 7f2c8c7219c0 / radosgw-admin 2024-09-12T17:17:58.499 INFO:tasks.workunit.client.0.smithi016.stderr: max_recent 500 2024-09-12T17:17:58.499 INFO:tasks.workunit.client.0.smithi016.stderr: max_new 1000 2024-09-12T17:17:58.499 INFO:tasks.workunit.client.0.smithi016.stderr: log_file /var/log/ceph/ceph-client.admin.89056.log 2024-09-12T17:17:58.499 INFO:tasks.workunit.client.0.smithi016.stderr:--- end dump of recent events --- 2024-09-12T17:17:58.499 INFO:tasks.workunit.client.0.smithi016.stderr:--- begin dump of recent events --- 2024-09-12T17:17:58.499 INFO:tasks.workunit.client.0.smithi016.stderr: -499> 2024-09-12T17:17:57.692+0000 7f2c8a227640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:17:58.499 INFO:tasks.workunit.client.0.smithi016.stderr: -498> 2024-09-12T17:17:57.692+0000 7f2c8aa28640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:17:58.499 INFO:tasks.workunit.client.0.smithi016.stderr: -497> 2024-09-12T17:17:57.692+0000 7f2c8aa28640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:17:58.499 INFO:tasks.workunit.client.0.smithi016.stderr: -496> 2024-09-12T17:17:57.692+0000 7f2c8aa28640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:17:58.499 INFO:tasks.workunit.client.0.smithi016.stderr: -495> 2024-09-12T17:17:57.692+0000 7f2c8a227640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:17:58.500 INFO:tasks.workunit.client.0.smithi016.stderr: -494> 2024-09-12T17:17:57.692+0000 7f2c8a227640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:17:58.500 INFO:tasks.workunit.client.0.smithi016.stderr: -493> 2024-09-12T17:17:57.692+0000 7f2c8a227640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:17:58.500 INFO:tasks.workunit.client.0.smithi016.stderr: -492> 2024-09-12T17:17:57.692+0000 7f2c89a26640 10 monclient(hunting): get_auth_request con 0x55883cf2fb30 auth_method 0 2024-09-12T17:17:58.500 INFO:tasks.workunit.client.0.smithi016.stderr: -491> 2024-09-12T17:17:57.692+0000 7f2c89a26640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:17:58.500 INFO:tasks.workunit.client.0.smithi016.stderr: -490> 2024-09-12T17:17:57.692+0000 7f2c89a26640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:17:58.500 INFO:tasks.workunit.client.0.smithi016.stderr: -489> 2024-09-12T17:17:57.692+0000 7f2c89a26640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:17:58.500 INFO:tasks.workunit.client.0.smithi016.stderr: -488> 2024-09-12T17:17:57.692+0000 7f2c8aa28640 10 monclient(hunting): handle_auth_done global_id 6564 payload 274 2024-09-12T17:17:58.500 INFO:tasks.workunit.client.0.smithi016.stderr: -487> 2024-09-12T17:17:57.692+0000 7f2c8aa28640 10 monclient: _finish_hunting 0 2024-09-12T17:17:58.500 INFO:tasks.workunit.client.0.smithi016.stderr: -486> 2024-09-12T17:17:57.692+0000 7f2c8aa28640 1 monclient: found mon.noname-a 2024-09-12T17:17:58.500 INFO:tasks.workunit.client.0.smithi016.stderr: -485> 2024-09-12T17:17:57.692+0000 7f2c8aa28640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:17:58.500 INFO:tasks.workunit.client.0.smithi016.stderr: -484> 2024-09-12T17:17:57.692+0000 7f2b78608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:17:58.500 INFO:tasks.workunit.client.0.smithi016.stderr: -483> 2024-09-12T17:17:57.692+0000 7f2b78608640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:17:58.500 INFO:tasks.workunit.client.0.smithi016.stderr: -482> 2024-09-12T17:17:57.692+0000 7f2b78608640 10 monclient: dump: 2024-09-12T17:17:58.501 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:17:58.501 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:17:58.501 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:58.501 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:58.501 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:17:58.501 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:58.501 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:17:58.501 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:17:58.501 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:17:58.501 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:58.501 INFO:tasks.workunit.client.0.smithi016.stderr: -481> 2024-09-12T17:17:57.692+0000 7f2b78608640 10 monclient: _finish_auth 0 2024-09-12T17:17:58.501 INFO:tasks.workunit.client.0.smithi016.stderr: -480> 2024-09-12T17:17:57.692+0000 7f2b78608640 10 monclient: _check_auth_tickets 2024-09-12T17:17:58.501 INFO:tasks.workunit.client.0.smithi016.stderr: -479> 2024-09-12T17:17:57.692+0000 7f2b78608640 10 monclient: handle_config config(0 keys) 2024-09-12T17:17:58.502 INFO:tasks.workunit.client.0.smithi016.stderr: -478> 2024-09-12T17:17:57.692+0000 7f2b78608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:17:58.502 INFO:tasks.workunit.client.0.smithi016.stderr: -477> 2024-09-12T17:17:57.692+0000 7f2b78608640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:17:58.502 INFO:tasks.workunit.client.0.smithi016.stderr: -476> 2024-09-12T17:17:57.692+0000 7f2b78608640 10 monclient: dump: 2024-09-12T17:17:58.502 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:17:58.502 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:17:58.502 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:58.502 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:58.502 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:17:58.502 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:58.502 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:17:58.502 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:17:58.502 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:17:58.502 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:58.503 INFO:tasks.workunit.client.0.smithi016.stderr: -475> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 monclient: authenticate success, global_id 6564 2024-09-12T17:17:58.503 INFO:tasks.workunit.client.0.smithi016.stderr: -474> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 10 monclient: get_monmap_and_config success 2024-09-12T17:17:58.503 INFO:tasks.workunit.client.0.smithi016.stderr: -473> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 4 set_mon_vals no callback set 2024-09-12T17:17:58.503 INFO:tasks.workunit.client.0.smithi016.stderr: -472> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 10 monclient: shutdown 2024-09-12T17:17:58.503 INFO:tasks.workunit.client.0.smithi016.stderr: -471> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 asok(0x55883cddd2b0) unregister_commands rotate-key 2024-09-12T17:17:58.503 INFO:tasks.workunit.client.0.smithi016.stderr: -470> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 10 monclient: build_initial_monmap 2024-09-12T17:17:58.503 INFO:tasks.workunit.client.0.smithi016.stderr: -469> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 1 build_initial for_mkfs: 0 2024-09-12T17:17:58.503 INFO:tasks.workunit.client.0.smithi016.stderr: -468> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 10 monclient: monmap: 2024-09-12T17:17:58.503 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:17:58.503 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:17:58.503 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:17:58.503 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:17:58.504 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:17:58.504 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:58.504 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:17:58.504 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:17:58.504 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:17:58.504 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:58.504 INFO:tasks.workunit.client.0.smithi016.stderr: -467> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0133f0) adding auth protocol: cephx 2024-09-12T17:17:58.504 INFO:tasks.workunit.client.0.smithi016.stderr: -466> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0133f0) adding auth protocol: cephx 2024-09-12T17:17:58.504 INFO:tasks.workunit.client.0.smithi016.stderr: -465> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0133f0) adding auth protocol: cephx 2024-09-12T17:17:58.504 INFO:tasks.workunit.client.0.smithi016.stderr: -464> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0133f0) adding con mode: secure 2024-09-12T17:17:58.504 INFO:tasks.workunit.client.0.smithi016.stderr: -463> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0133f0) adding con mode: crc 2024-09-12T17:17:58.504 INFO:tasks.workunit.client.0.smithi016.stderr: -462> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0133f0) adding con mode: secure 2024-09-12T17:17:58.504 INFO:tasks.workunit.client.0.smithi016.stderr: -461> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0133f0) adding con mode: crc 2024-09-12T17:17:58.505 INFO:tasks.workunit.client.0.smithi016.stderr: -460> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0133f0) adding con mode: secure 2024-09-12T17:17:58.505 INFO:tasks.workunit.client.0.smithi016.stderr: -459> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0133f0) adding con mode: crc 2024-09-12T17:17:58.505 INFO:tasks.workunit.client.0.smithi016.stderr: -458> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0133f0) adding con mode: crc 2024-09-12T17:17:58.505 INFO:tasks.workunit.client.0.smithi016.stderr: -457> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0133f0) adding con mode: secure 2024-09-12T17:17:58.505 INFO:tasks.workunit.client.0.smithi016.stderr: -456> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0133f0) adding con mode: crc 2024-09-12T17:17:58.505 INFO:tasks.workunit.client.0.smithi016.stderr: -455> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0133f0) adding con mode: secure 2024-09-12T17:17:58.505 INFO:tasks.workunit.client.0.smithi016.stderr: -454> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0133f0) adding con mode: crc 2024-09-12T17:17:58.505 INFO:tasks.workunit.client.0.smithi016.stderr: -453> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0133f0) adding con mode: secure 2024-09-12T17:17:58.505 INFO:tasks.workunit.client.0.smithi016.stderr: -452> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:58.505 INFO:tasks.workunit.client.0.smithi016.stderr: -451> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 1 librados: starting msgr at 2024-09-12T17:17:58.505 INFO:tasks.workunit.client.0.smithi016.stderr: -450> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 1 librados: starting objecter 2024-09-12T17:17:58.505 INFO:tasks.workunit.client.0.smithi016.stderr: -449> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 asok(0x55883cddd2b0) register_command objecter_requests hook 0x55883d01b340 2024-09-12T17:17:58.505 INFO:tasks.workunit.client.0.smithi016.stderr: -448> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 1 librados: setting wanted keys 2024-09-12T17:17:58.506 INFO:tasks.workunit.client.0.smithi016.stderr: -447> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 1 librados: calling monclient init 2024-09-12T17:17:58.506 INFO:tasks.workunit.client.0.smithi016.stderr: -446> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 10 monclient: init 2024-09-12T17:17:58.506 INFO:tasks.workunit.client.0.smithi016.stderr: -445> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883cfe9a70) adding auth protocol: cephx 2024-09-12T17:17:58.506 INFO:tasks.workunit.client.0.smithi016.stderr: -444> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883cfe9a70) adding auth protocol: cephx 2024-09-12T17:17:58.506 INFO:tasks.workunit.client.0.smithi016.stderr: -443> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883cfe9a70) adding auth protocol: cephx 2024-09-12T17:17:58.506 INFO:tasks.workunit.client.0.smithi016.stderr: -442> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883cfe9a70) adding con mode: secure 2024-09-12T17:17:58.506 INFO:tasks.workunit.client.0.smithi016.stderr: -441> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883cfe9a70) adding con mode: crc 2024-09-12T17:17:58.506 INFO:tasks.workunit.client.0.smithi016.stderr: -440> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883cfe9a70) adding con mode: secure 2024-09-12T17:17:58.506 INFO:tasks.workunit.client.0.smithi016.stderr: -439> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883cfe9a70) adding con mode: crc 2024-09-12T17:17:58.506 INFO:tasks.workunit.client.0.smithi016.stderr: -438> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883cfe9a70) adding con mode: secure 2024-09-12T17:17:58.506 INFO:tasks.workunit.client.0.smithi016.stderr: -437> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883cfe9a70) adding con mode: crc 2024-09-12T17:17:58.506 INFO:tasks.workunit.client.0.smithi016.stderr: -436> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883cfe9a70) adding con mode: crc 2024-09-12T17:17:58.506 INFO:tasks.workunit.client.0.smithi016.stderr: -435> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883cfe9a70) adding con mode: secure 2024-09-12T17:17:58.507 INFO:tasks.workunit.client.0.smithi016.stderr: -434> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883cfe9a70) adding con mode: crc 2024-09-12T17:17:58.507 INFO:tasks.workunit.client.0.smithi016.stderr: -433> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883cfe9a70) adding con mode: secure 2024-09-12T17:17:58.507 INFO:tasks.workunit.client.0.smithi016.stderr: -432> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883cfe9a70) adding con mode: crc 2024-09-12T17:17:58.507 INFO:tasks.workunit.client.0.smithi016.stderr: -431> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 AuthRegistry(0x55883cfe9a70) adding con mode: secure 2024-09-12T17:17:58.507 INFO:tasks.workunit.client.0.smithi016.stderr: -430> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:58.507 INFO:tasks.workunit.client.0.smithi016.stderr: -429> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:58.507 INFO:tasks.workunit.client.0.smithi016.stderr: -428> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 5 asok(0x55883cddd2b0) register_command rotate-key hook 0x55883cfe9bb8 2024-09-12T17:17:58.507 INFO:tasks.workunit.client.0.smithi016.stderr: -427> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 10 monclient: _reopen_session rank -1 2024-09-12T17:17:58.507 INFO:tasks.workunit.client.0.smithi016.stderr: -426> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:17:58.507 INFO:tasks.workunit.client.0.smithi016.stderr: -425> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 10 monclient(hunting): picked mon.noname-b con 0x55883ce76600 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:17:58.507 INFO:tasks.workunit.client.0.smithi016.stderr: -424> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 10 monclient(hunting): picked mon.noname-c con 0x55883cf2fb30 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:17:58.507 INFO:tasks.workunit.client.0.smithi016.stderr: -423> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 10 monclient(hunting): picked mon.noname-a con 0x55883cf32b60 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:17:58.507 INFO:tasks.workunit.client.0.smithi016.stderr: -422> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:58.508 INFO:tasks.workunit.client.0.smithi016.stderr: -421> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:58.508 INFO:tasks.workunit.client.0.smithi016.stderr: -420> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:58.508 INFO:tasks.workunit.client.0.smithi016.stderr: -419> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 10 monclient(hunting): _renew_subs 2024-09-12T17:17:58.508 INFO:tasks.workunit.client.0.smithi016.stderr: -418> 2024-09-12T17:17:57.692+0000 7f2c8c7219c0 10 monclient(hunting): authenticate will time out at 2195.671664s 2024-09-12T17:17:58.508 INFO:tasks.workunit.client.0.smithi016.stderr: -417> 2024-09-12T17:17:57.692+0000 7f2c89a26640 10 monclient(hunting): get_auth_request con 0x55883cf2fb30 auth_method 0 2024-09-12T17:17:58.508 INFO:tasks.workunit.client.0.smithi016.stderr: -416> 2024-09-12T17:17:57.692+0000 7f2c89a26640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:17:58.508 INFO:tasks.workunit.client.0.smithi016.stderr: -415> 2024-09-12T17:17:57.692+0000 7f2c89a26640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:17:58.508 INFO:tasks.workunit.client.0.smithi016.stderr: -414> 2024-09-12T17:17:57.692+0000 7f2c89a26640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:17:58.508 INFO:tasks.workunit.client.0.smithi016.stderr: -413> 2024-09-12T17:17:57.692+0000 7f2c8aa28640 10 monclient(hunting): get_auth_request con 0x55883cf32b60 auth_method 0 2024-09-12T17:17:58.508 INFO:tasks.workunit.client.0.smithi016.stderr: -412> 2024-09-12T17:17:57.692+0000 7f2c8aa28640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:17:58.508 INFO:tasks.workunit.client.0.smithi016.stderr: -411> 2024-09-12T17:17:57.692+0000 7f2c8aa28640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:17:58.508 INFO:tasks.workunit.client.0.smithi016.stderr: -410> 2024-09-12T17:17:57.692+0000 7f2c8aa28640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:17:58.508 INFO:tasks.workunit.client.0.smithi016.stderr: -409> 2024-09-12T17:17:57.692+0000 7f2c89a26640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:17:58.508 INFO:tasks.workunit.client.0.smithi016.stderr: -408> 2024-09-12T17:17:57.692+0000 7f2c89a26640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:17:58.509 INFO:tasks.workunit.client.0.smithi016.stderr: -407> 2024-09-12T17:17:57.692+0000 7f2c89a26640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:17:58.509 INFO:tasks.workunit.client.0.smithi016.stderr: -406> 2024-09-12T17:17:57.692+0000 7f2c8aa28640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:17:58.509 INFO:tasks.workunit.client.0.smithi016.stderr: -405> 2024-09-12T17:17:57.692+0000 7f2c8aa28640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:17:58.509 INFO:tasks.workunit.client.0.smithi016.stderr: -404> 2024-09-12T17:17:57.692+0000 7f2c8aa28640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:17:58.509 INFO:tasks.workunit.client.0.smithi016.stderr: -403> 2024-09-12T17:17:57.696+0000 7f2c8a227640 10 monclient(hunting): get_auth_request con 0x55883ce76600 auth_method 0 2024-09-12T17:17:58.509 INFO:tasks.workunit.client.0.smithi016.stderr: -402> 2024-09-12T17:17:57.696+0000 7f2c8a227640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:17:58.509 INFO:tasks.workunit.client.0.smithi016.stderr: -401> 2024-09-12T17:17:57.696+0000 7f2c8a227640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:17:58.509 INFO:tasks.workunit.client.0.smithi016.stderr: -400> 2024-09-12T17:17:57.696+0000 7f2c8a227640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:17:58.509 INFO:tasks.workunit.client.0.smithi016.stderr: -399> 2024-09-12T17:17:57.696+0000 7f2c89a26640 10 monclient(hunting): handle_auth_done global_id 6299 payload 824 2024-09-12T17:17:58.509 INFO:tasks.workunit.client.0.smithi016.stderr: -398> 2024-09-12T17:17:57.696+0000 7f2c89a26640 10 monclient: _finish_hunting 0 2024-09-12T17:17:58.509 INFO:tasks.workunit.client.0.smithi016.stderr: -397> 2024-09-12T17:17:57.696+0000 7f2c89a26640 1 monclient: found mon.noname-c 2024-09-12T17:17:58.509 INFO:tasks.workunit.client.0.smithi016.stderr: -396> 2024-09-12T17:17:57.696+0000 7f2c89a26640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:17:58.509 INFO:tasks.workunit.client.0.smithi016.stderr: -395> 2024-09-12T17:17:57.696+0000 7f2b76e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:17:58.510 INFO:tasks.workunit.client.0.smithi016.stderr: -394> 2024-09-12T17:17:57.696+0000 7f2b76e05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:17:58.510 INFO:tasks.workunit.client.0.smithi016.stderr: -393> 2024-09-12T17:17:57.696+0000 7f2b76e05640 10 monclient: dump: 2024-09-12T17:17:58.510 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:17:58.510 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:17:58.510 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:58.510 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:58.510 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:17:58.510 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:58.510 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:17:58.510 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:17:58.510 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:17:58.510 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:58.510 INFO:tasks.workunit.client.0.smithi016.stderr: -392> 2024-09-12T17:17:57.696+0000 7f2b76e05640 10 monclient: _finish_auth 0 2024-09-12T17:17:58.511 INFO:tasks.workunit.client.0.smithi016.stderr: -391> 2024-09-12T17:17:57.696+0000 7f2b76e05640 10 monclient: _check_auth_tickets 2024-09-12T17:17:58.511 INFO:tasks.workunit.client.0.smithi016.stderr: -390> 2024-09-12T17:17:57.696+0000 7f2b76e05640 10 monclient: handle_config config(0 keys) 2024-09-12T17:17:58.511 INFO:tasks.workunit.client.0.smithi016.stderr: -389> 2024-09-12T17:17:57.696+0000 7f2b76e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:17:58.511 INFO:tasks.workunit.client.0.smithi016.stderr: -388> 2024-09-12T17:17:57.696+0000 7f2b76e05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:17:58.511 INFO:tasks.workunit.client.0.smithi016.stderr: -387> 2024-09-12T17:17:57.696+0000 7f2b76e05640 10 monclient: dump: 2024-09-12T17:17:58.511 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:17:58.511 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:17:58.511 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:58.511 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:58.511 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:17:58.511 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:58.511 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:17:58.511 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:17:58.512 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:17:58.512 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:58.512 INFO:tasks.workunit.client.0.smithi016.stderr: -386> 2024-09-12T17:17:57.696+0000 7f2c8c7219c0 5 monclient: authenticate success, global_id 6299 2024-09-12T17:17:58.512 INFO:tasks.workunit.client.0.smithi016.stderr: -385> 2024-09-12T17:17:57.696+0000 7f2c8c7219c0 10 monclient: _renew_subs 2024-09-12T17:17:58.512 INFO:tasks.workunit.client.0.smithi016.stderr: -384> 2024-09-12T17:17:57.696+0000 7f2c8c7219c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:17:58.512 INFO:tasks.workunit.client.0.smithi016.stderr: -383> 2024-09-12T17:17:57.696+0000 7f2b78608640 4 set_mon_vals no callback set 2024-09-12T17:17:58.512 INFO:tasks.workunit.client.0.smithi016.stderr: -382> 2024-09-12T17:17:57.696+0000 7f2c8c7219c0 10 monclient: _renew_subs 2024-09-12T17:17:58.512 INFO:tasks.workunit.client.0.smithi016.stderr: -381> 2024-09-12T17:17:57.696+0000 7f2c8c7219c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:17:58.512 INFO:tasks.workunit.client.0.smithi016.stderr: -380> 2024-09-12T17:17:57.696+0000 7f2c8c7219c0 1 librados: init done 2024-09-12T17:17:58.512 INFO:tasks.workunit.client.0.smithi016.stderr: -379> 2024-09-12T17:17:57.696+0000 7f2b76e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:17:58.512 INFO:tasks.workunit.client.0.smithi016.stderr: -378> 2024-09-12T17:17:57.696+0000 7f2b76e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:17:58.512 INFO:tasks.workunit.client.0.smithi016.stderr: -377> 2024-09-12T17:17:57.696+0000 7f2b76e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:17:58.512 INFO:tasks.workunit.client.0.smithi016.stderr: -376> 2024-09-12T17:17:57.696+0000 7f2c8a227640 10 monclient: get_auth_request con 0x7f2b70070b10 auth_method 0 2024-09-12T17:17:58.513 INFO:tasks.workunit.client.0.smithi016.stderr: -375> 2024-09-12T17:17:57.696+0000 7f2c8aa28640 10 monclient: get_auth_request con 0x55883d01d650 auth_method 0 2024-09-12T17:17:58.513 INFO:tasks.workunit.client.0.smithi016.stderr: -374> 2024-09-12T17:17:57.700+0000 7f2c8a227640 10 monclient: get_auth_request con 0x55883d0347a0 auth_method 0 2024-09-12T17:17:58.513 INFO:tasks.workunit.client.0.smithi016.stderr: -373> 2024-09-12T17:17:57.700+0000 7f2c89a26640 10 monclient: get_auth_request con 0x55883d038b00 auth_method 0 2024-09-12T17:17:58.513 INFO:tasks.workunit.client.0.smithi016.stderr: -372> 2024-09-12T17:17:57.704+0000 7f2c8aa28640 10 monclient: get_auth_request con 0x55883d03cf50 auth_method 0 2024-09-12T17:17:58.513 INFO:tasks.workunit.client.0.smithi016.stderr: -371> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 10 monclient: build_initial_monmap 2024-09-12T17:17:58.513 INFO:tasks.workunit.client.0.smithi016.stderr: -370> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 1 build_initial for_mkfs: 0 2024-09-12T17:17:58.513 INFO:tasks.workunit.client.0.smithi016.stderr: -369> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 10 monclient: monmap: 2024-09-12T17:17:58.513 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:17:58.513 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:17:58.513 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:17:58.513 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:17:58.513 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:17:58.513 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:58.514 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:17:58.514 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:17:58.514 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:17:58.514 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:58.514 INFO:tasks.workunit.client.0.smithi016.stderr: -368> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d040ce0) adding auth protocol: cephx 2024-09-12T17:17:58.514 INFO:tasks.workunit.client.0.smithi016.stderr: -367> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d040ce0) adding auth protocol: cephx 2024-09-12T17:17:58.514 INFO:tasks.workunit.client.0.smithi016.stderr: -366> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d040ce0) adding auth protocol: cephx 2024-09-12T17:17:58.514 INFO:tasks.workunit.client.0.smithi016.stderr: -365> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d040ce0) adding con mode: secure 2024-09-12T17:17:58.514 INFO:tasks.workunit.client.0.smithi016.stderr: -364> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d040ce0) adding con mode: crc 2024-09-12T17:17:58.514 INFO:tasks.workunit.client.0.smithi016.stderr: -363> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d040ce0) adding con mode: secure 2024-09-12T17:17:58.514 INFO:tasks.workunit.client.0.smithi016.stderr: -362> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d040ce0) adding con mode: crc 2024-09-12T17:17:58.514 INFO:tasks.workunit.client.0.smithi016.stderr: -361> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d040ce0) adding con mode: secure 2024-09-12T17:17:58.514 INFO:tasks.workunit.client.0.smithi016.stderr: -360> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d040ce0) adding con mode: crc 2024-09-12T17:17:58.515 INFO:tasks.workunit.client.0.smithi016.stderr: -359> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d040ce0) adding con mode: crc 2024-09-12T17:17:58.515 INFO:tasks.workunit.client.0.smithi016.stderr: -358> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d040ce0) adding con mode: secure 2024-09-12T17:17:58.515 INFO:tasks.workunit.client.0.smithi016.stderr: -357> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d040ce0) adding con mode: crc 2024-09-12T17:17:58.515 INFO:tasks.workunit.client.0.smithi016.stderr: -356> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d040ce0) adding con mode: secure 2024-09-12T17:17:58.515 INFO:tasks.workunit.client.0.smithi016.stderr: -355> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d040ce0) adding con mode: crc 2024-09-12T17:17:58.515 INFO:tasks.workunit.client.0.smithi016.stderr: -354> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d040ce0) adding con mode: secure 2024-09-12T17:17:58.515 INFO:tasks.workunit.client.0.smithi016.stderr: -353> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:58.515 INFO:tasks.workunit.client.0.smithi016.stderr: -352> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 asok(0x55883cddd2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55883d0445f0 EEXIST 2024-09-12T17:17:58.515 INFO:tasks.workunit.client.0.smithi016.stderr: -351> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 10 monclient: init 2024-09-12T17:17:58.515 INFO:tasks.workunit.client.0.smithi016.stderr: -350> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d03fc98) adding auth protocol: cephx 2024-09-12T17:17:58.515 INFO:tasks.workunit.client.0.smithi016.stderr: -349> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d03fc98) adding auth protocol: cephx 2024-09-12T17:17:58.515 INFO:tasks.workunit.client.0.smithi016.stderr: -348> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d03fc98) adding auth protocol: cephx 2024-09-12T17:17:58.515 INFO:tasks.workunit.client.0.smithi016.stderr: -347> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d03fc98) adding con mode: secure 2024-09-12T17:17:58.516 INFO:tasks.workunit.client.0.smithi016.stderr: -346> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d03fc98) adding con mode: crc 2024-09-12T17:17:58.516 INFO:tasks.workunit.client.0.smithi016.stderr: -345> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d03fc98) adding con mode: secure 2024-09-12T17:17:58.516 INFO:tasks.workunit.client.0.smithi016.stderr: -344> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d03fc98) adding con mode: crc 2024-09-12T17:17:58.516 INFO:tasks.workunit.client.0.smithi016.stderr: -343> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d03fc98) adding con mode: secure 2024-09-12T17:17:58.516 INFO:tasks.workunit.client.0.smithi016.stderr: -342> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d03fc98) adding con mode: crc 2024-09-12T17:17:58.516 INFO:tasks.workunit.client.0.smithi016.stderr: -341> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d03fc98) adding con mode: crc 2024-09-12T17:17:58.516 INFO:tasks.workunit.client.0.smithi016.stderr: -340> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d03fc98) adding con mode: secure 2024-09-12T17:17:58.516 INFO:tasks.workunit.client.0.smithi016.stderr: -339> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d03fc98) adding con mode: crc 2024-09-12T17:17:58.516 INFO:tasks.workunit.client.0.smithi016.stderr: -338> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d03fc98) adding con mode: secure 2024-09-12T17:17:58.516 INFO:tasks.workunit.client.0.smithi016.stderr: -337> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d03fc98) adding con mode: crc 2024-09-12T17:17:58.516 INFO:tasks.workunit.client.0.smithi016.stderr: -336> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d03fc98) adding con mode: secure 2024-09-12T17:17:58.516 INFO:tasks.workunit.client.0.smithi016.stderr: -335> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:58.517 INFO:tasks.workunit.client.0.smithi016.stderr: -334> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:58.517 INFO:tasks.workunit.client.0.smithi016.stderr: -333> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 asok(0x55883cddd2b0) register_command rotate-key cmddesc rotate-key hook 0x55883d03fde0 EEXIST 2024-09-12T17:17:58.517 INFO:tasks.workunit.client.0.smithi016.stderr: -332> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 10 monclient: _reopen_session rank -1 2024-09-12T17:17:58.517 INFO:tasks.workunit.client.0.smithi016.stderr: -331> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:17:58.517 INFO:tasks.workunit.client.0.smithi016.stderr: -330> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 10 monclient(hunting): picked mon.noname-a con 0x55883d0687a0 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:17:58.517 INFO:tasks.workunit.client.0.smithi016.stderr: -329> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 10 monclient(hunting): picked mon.noname-b con 0x55883d0680d0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:17:58.517 INFO:tasks.workunit.client.0.smithi016.stderr: -328> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 10 monclient(hunting): picked mon.noname-c con 0x55883d066ab0 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:17:58.517 INFO:tasks.workunit.client.0.smithi016.stderr: -327> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:58.517 INFO:tasks.workunit.client.0.smithi016.stderr: -326> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:58.517 INFO:tasks.workunit.client.0.smithi016.stderr: -325> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:58.517 INFO:tasks.workunit.client.0.smithi016.stderr: -324> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 10 monclient(hunting): _renew_subs 2024-09-12T17:17:58.517 INFO:tasks.workunit.client.0.smithi016.stderr: -323> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 10 monclient(hunting): authenticate will time out at 2195.682914s 2024-09-12T17:17:58.517 INFO:tasks.workunit.client.0.smithi016.stderr: -322> 2024-09-12T17:17:57.704+0000 7f2c89a26640 10 monclient(hunting): get_auth_request con 0x55883d0687a0 auth_method 0 2024-09-12T17:17:58.518 INFO:tasks.workunit.client.0.smithi016.stderr: -321> 2024-09-12T17:17:57.704+0000 7f2c89a26640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:17:58.518 INFO:tasks.workunit.client.0.smithi016.stderr: -320> 2024-09-12T17:17:57.704+0000 7f2c89a26640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:17:58.518 INFO:tasks.workunit.client.0.smithi016.stderr: -319> 2024-09-12T17:17:57.704+0000 7f2c89a26640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:17:58.518 INFO:tasks.workunit.client.0.smithi016.stderr: -318> 2024-09-12T17:17:57.704+0000 7f2c8a227640 10 monclient(hunting): get_auth_request con 0x55883d066ab0 auth_method 0 2024-09-12T17:17:58.518 INFO:tasks.workunit.client.0.smithi016.stderr: -317> 2024-09-12T17:17:57.704+0000 7f2c8a227640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:17:58.518 INFO:tasks.workunit.client.0.smithi016.stderr: -316> 2024-09-12T17:17:57.704+0000 7f2c8a227640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:17:58.518 INFO:tasks.workunit.client.0.smithi016.stderr: -315> 2024-09-12T17:17:57.704+0000 7f2c8a227640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:17:58.518 INFO:tasks.workunit.client.0.smithi016.stderr: -314> 2024-09-12T17:17:57.704+0000 7f2c89a26640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:17:58.518 INFO:tasks.workunit.client.0.smithi016.stderr: -313> 2024-09-12T17:17:57.704+0000 7f2c89a26640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:17:58.518 INFO:tasks.workunit.client.0.smithi016.stderr: -312> 2024-09-12T17:17:57.704+0000 7f2c89a26640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:17:58.518 INFO:tasks.workunit.client.0.smithi016.stderr: -311> 2024-09-12T17:17:57.704+0000 7f2c8a227640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:17:58.518 INFO:tasks.workunit.client.0.smithi016.stderr: -310> 2024-09-12T17:17:57.704+0000 7f2c8a227640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:17:58.518 INFO:tasks.workunit.client.0.smithi016.stderr: -309> 2024-09-12T17:17:57.704+0000 7f2c8a227640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:17:58.519 INFO:tasks.workunit.client.0.smithi016.stderr: -308> 2024-09-12T17:17:57.704+0000 7f2c8aa28640 10 monclient(hunting): get_auth_request con 0x55883d0680d0 auth_method 0 2024-09-12T17:17:58.519 INFO:tasks.workunit.client.0.smithi016.stderr: -307> 2024-09-12T17:17:57.704+0000 7f2c8aa28640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:17:58.519 INFO:tasks.workunit.client.0.smithi016.stderr: -306> 2024-09-12T17:17:57.704+0000 7f2c8aa28640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:17:58.519 INFO:tasks.workunit.client.0.smithi016.stderr: -305> 2024-09-12T17:17:57.704+0000 7f2c8aa28640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:17:58.519 INFO:tasks.workunit.client.0.smithi016.stderr: -304> 2024-09-12T17:17:57.704+0000 7f2c89a26640 10 monclient(hunting): handle_auth_done global_id 6570 payload 824 2024-09-12T17:17:58.519 INFO:tasks.workunit.client.0.smithi016.stderr: -303> 2024-09-12T17:17:57.704+0000 7f2c89a26640 10 monclient: _finish_hunting 0 2024-09-12T17:17:58.519 INFO:tasks.workunit.client.0.smithi016.stderr: -302> 2024-09-12T17:17:57.704+0000 7f2c89a26640 1 monclient: found mon.noname-a 2024-09-12T17:17:58.519 INFO:tasks.workunit.client.0.smithi016.stderr: -301> 2024-09-12T17:17:57.704+0000 7f2c89a26640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:17:58.519 INFO:tasks.workunit.client.0.smithi016.stderr: -300> 2024-09-12T17:17:57.704+0000 7f2b6ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:17:58.519 INFO:tasks.workunit.client.0.smithi016.stderr: -299> 2024-09-12T17:17:57.704+0000 7f2b6ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:17:58.519 INFO:tasks.workunit.client.0.smithi016.stderr: -298> 2024-09-12T17:17:57.704+0000 7f2b6ffff640 10 monclient: dump: 2024-09-12T17:17:58.519 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:17:58.519 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:17:58.520 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:58.520 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:58.520 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:17:58.520 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:58.520 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:17:58.520 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:17:58.520 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:17:58.520 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:58.520 INFO:tasks.workunit.client.0.smithi016.stderr: -297> 2024-09-12T17:17:57.704+0000 7f2b6ffff640 10 monclient: _finish_auth 0 2024-09-12T17:17:58.520 INFO:tasks.workunit.client.0.smithi016.stderr: -296> 2024-09-12T17:17:57.704+0000 7f2b6ffff640 10 monclient: _check_auth_tickets 2024-09-12T17:17:58.520 INFO:tasks.workunit.client.0.smithi016.stderr: -295> 2024-09-12T17:17:57.704+0000 7f2b6ffff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:17:58.520 INFO:tasks.workunit.client.0.smithi016.stderr: -294> 2024-09-12T17:17:57.704+0000 7f2b6ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:17:58.521 INFO:tasks.workunit.client.0.smithi016.stderr: -293> 2024-09-12T17:17:57.704+0000 7f2b6ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:17:58.521 INFO:tasks.workunit.client.0.smithi016.stderr: -292> 2024-09-12T17:17:57.704+0000 7f2b6ffff640 10 monclient: dump: 2024-09-12T17:17:58.521 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:17:58.521 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:17:58.521 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:58.521 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:58.521 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:17:58.521 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:58.521 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:17:58.521 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:17:58.522 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:17:58.522 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:58.522 INFO:tasks.workunit.client.0.smithi016.stderr: -291> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 5 monclient: authenticate success, global_id 6570 2024-09-12T17:17:58.522 INFO:tasks.workunit.client.0.smithi016.stderr: -290> 2024-09-12T17:17:57.704+0000 7f2c8b229640 4 set_mon_vals no callback set 2024-09-12T17:17:58.522 INFO:tasks.workunit.client.0.smithi016.stderr: -289> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 10 monclient: _renew_subs 2024-09-12T17:17:58.522 INFO:tasks.workunit.client.0.smithi016.stderr: -288> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:17:58.522 INFO:tasks.workunit.client.0.smithi016.stderr: -287> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 10 monclient: _renew_subs 2024-09-12T17:17:58.522 INFO:tasks.workunit.client.0.smithi016.stderr: -286> 2024-09-12T17:17:57.704+0000 7f2c8c7219c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:17:58.522 INFO:tasks.workunit.client.0.smithi016.stderr: -285> 2024-09-12T17:17:57.708+0000 7f2b6ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:17:58.522 INFO:tasks.workunit.client.0.smithi016.stderr: -284> 2024-09-12T17:17:57.708+0000 7f2b6ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:17:58.522 INFO:tasks.workunit.client.0.smithi016.stderr: -283> 2024-09-12T17:17:57.708+0000 7f2b6ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:17:58.522 INFO:tasks.workunit.client.0.smithi016.stderr: -282> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 10 monclient: get_monmap_and_config 2024-09-12T17:17:58.522 INFO:tasks.workunit.client.0.smithi016.stderr: -281> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 10 monclient: build_initial_monmap 2024-09-12T17:17:58.522 INFO:tasks.workunit.client.0.smithi016.stderr: -280> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 1 build_initial for_mkfs: 0 2024-09-12T17:17:58.523 INFO:tasks.workunit.client.0.smithi016.stderr: -279> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 10 monclient: monmap: 2024-09-12T17:17:58.523 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:17:58.523 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:17:58.523 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:17:58.523 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:17:58.523 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:17:58.523 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:58.523 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:17:58.523 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:17:58.523 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:17:58.523 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:58.523 INFO:tasks.workunit.client.0.smithi016.stderr: -278> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d087e80) adding auth protocol: cephx 2024-09-12T17:17:58.523 INFO:tasks.workunit.client.0.smithi016.stderr: -277> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d087e80) adding auth protocol: cephx 2024-09-12T17:17:58.524 INFO:tasks.workunit.client.0.smithi016.stderr: -276> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d087e80) adding auth protocol: cephx 2024-09-12T17:17:58.524 INFO:tasks.workunit.client.0.smithi016.stderr: -275> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d087e80) adding con mode: secure 2024-09-12T17:17:58.524 INFO:tasks.workunit.client.0.smithi016.stderr: -274> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d087e80) adding con mode: crc 2024-09-12T17:17:58.524 INFO:tasks.workunit.client.0.smithi016.stderr: -273> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d087e80) adding con mode: secure 2024-09-12T17:17:58.524 INFO:tasks.workunit.client.0.smithi016.stderr: -272> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d087e80) adding con mode: crc 2024-09-12T17:17:58.524 INFO:tasks.workunit.client.0.smithi016.stderr: -271> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d087e80) adding con mode: secure 2024-09-12T17:17:58.524 INFO:tasks.workunit.client.0.smithi016.stderr: -270> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d087e80) adding con mode: crc 2024-09-12T17:17:58.524 INFO:tasks.workunit.client.0.smithi016.stderr: -269> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d087e80) adding con mode: crc 2024-09-12T17:17:58.524 INFO:tasks.workunit.client.0.smithi016.stderr: -268> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d087e80) adding con mode: secure 2024-09-12T17:17:58.524 INFO:tasks.workunit.client.0.smithi016.stderr: -267> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d087e80) adding con mode: crc 2024-09-12T17:17:58.524 INFO:tasks.workunit.client.0.smithi016.stderr: -266> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d087e80) adding con mode: secure 2024-09-12T17:17:58.524 INFO:tasks.workunit.client.0.smithi016.stderr: -265> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d087e80) adding con mode: crc 2024-09-12T17:17:58.525 INFO:tasks.workunit.client.0.smithi016.stderr: -264> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d087e80) adding con mode: secure 2024-09-12T17:17:58.525 INFO:tasks.workunit.client.0.smithi016.stderr: -263> 2024-09-12T17:17:57.708+0000 7f2c8aa28640 10 monclient: get_auth_request con 0x7f2b64070a20 auth_method 0 2024-09-12T17:17:58.525 INFO:tasks.workunit.client.0.smithi016.stderr: -262> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:58.525 INFO:tasks.workunit.client.0.smithi016.stderr: -261> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 10 monclient: init 2024-09-12T17:17:58.525 INFO:tasks.workunit.client.0.smithi016.stderr: -260> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e58b0) adding auth protocol: cephx 2024-09-12T17:17:58.525 INFO:tasks.workunit.client.0.smithi016.stderr: -259> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e58b0) adding auth protocol: cephx 2024-09-12T17:17:58.525 INFO:tasks.workunit.client.0.smithi016.stderr: -258> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e58b0) adding auth protocol: cephx 2024-09-12T17:17:58.525 INFO:tasks.workunit.client.0.smithi016.stderr: -257> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e58b0) adding con mode: secure 2024-09-12T17:17:58.525 INFO:tasks.workunit.client.0.smithi016.stderr: -256> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e58b0) adding con mode: crc 2024-09-12T17:17:58.525 INFO:tasks.workunit.client.0.smithi016.stderr: -255> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e58b0) adding con mode: secure 2024-09-12T17:17:58.525 INFO:tasks.workunit.client.0.smithi016.stderr: -254> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e58b0) adding con mode: crc 2024-09-12T17:17:58.525 INFO:tasks.workunit.client.0.smithi016.stderr: -253> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e58b0) adding con mode: secure 2024-09-12T17:17:58.525 INFO:tasks.workunit.client.0.smithi016.stderr: -252> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e58b0) adding con mode: crc 2024-09-12T17:17:58.525 INFO:tasks.workunit.client.0.smithi016.stderr: -251> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e58b0) adding con mode: crc 2024-09-12T17:17:58.526 INFO:tasks.workunit.client.0.smithi016.stderr: -250> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e58b0) adding con mode: secure 2024-09-12T17:17:58.526 INFO:tasks.workunit.client.0.smithi016.stderr: -249> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e58b0) adding con mode: crc 2024-09-12T17:17:58.526 INFO:tasks.workunit.client.0.smithi016.stderr: -248> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e58b0) adding con mode: secure 2024-09-12T17:17:58.526 INFO:tasks.workunit.client.0.smithi016.stderr: -247> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e58b0) adding con mode: crc 2024-09-12T17:17:58.526 INFO:tasks.workunit.client.0.smithi016.stderr: -246> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e58b0) adding con mode: secure 2024-09-12T17:17:58.526 INFO:tasks.workunit.client.0.smithi016.stderr: -245> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:58.526 INFO:tasks.workunit.client.0.smithi016.stderr: -244> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:58.526 INFO:tasks.workunit.client.0.smithi016.stderr: -243> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 asok(0x55883cddd2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffdbf3e59f8 EEXIST 2024-09-12T17:17:58.526 INFO:tasks.workunit.client.0.smithi016.stderr: -242> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 10 monclient: _reopen_session rank -1 2024-09-12T17:17:58.526 INFO:tasks.workunit.client.0.smithi016.stderr: -241> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:17:58.526 INFO:tasks.workunit.client.0.smithi016.stderr: -240> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 10 monclient(hunting): picked mon.noname-a con 0x55883d0bc140 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:17:58.526 INFO:tasks.workunit.client.0.smithi016.stderr: -239> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 10 monclient(hunting): picked mon.noname-b con 0x55883d0bc520 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:17:58.527 INFO:tasks.workunit.client.0.smithi016.stderr: -238> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 10 monclient(hunting): picked mon.noname-c con 0x55883d0b68e0 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:17:58.527 INFO:tasks.workunit.client.0.smithi016.stderr: -237> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:58.527 INFO:tasks.workunit.client.0.smithi016.stderr: -236> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:58.527 INFO:tasks.workunit.client.0.smithi016.stderr: -235> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:58.527 INFO:tasks.workunit.client.0.smithi016.stderr: -234> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 10 monclient(hunting): _renew_subs 2024-09-12T17:17:58.527 INFO:tasks.workunit.client.0.smithi016.stderr: -233> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 10 monclient(hunting): authenticate will time out at 2195.686872s 2024-09-12T17:17:58.527 INFO:tasks.workunit.client.0.smithi016.stderr: -232> 2024-09-12T17:17:57.708+0000 7f2c89a26640 10 monclient(hunting): get_auth_request con 0x55883d0bc140 auth_method 0 2024-09-12T17:17:58.527 INFO:tasks.workunit.client.0.smithi016.stderr: -231> 2024-09-12T17:17:57.708+0000 7f2c89a26640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:17:58.527 INFO:tasks.workunit.client.0.smithi016.stderr: -230> 2024-09-12T17:17:57.708+0000 7f2c89a26640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:17:58.527 INFO:tasks.workunit.client.0.smithi016.stderr: -229> 2024-09-12T17:17:57.708+0000 7f2c89a26640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:17:58.527 INFO:tasks.workunit.client.0.smithi016.stderr: -228> 2024-09-12T17:17:57.708+0000 7f2c8a227640 10 monclient(hunting): get_auth_request con 0x55883d0b68e0 auth_method 0 2024-09-12T17:17:58.527 INFO:tasks.workunit.client.0.smithi016.stderr: -227> 2024-09-12T17:17:57.708+0000 7f2c8a227640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:17:58.527 INFO:tasks.workunit.client.0.smithi016.stderr: -226> 2024-09-12T17:17:57.708+0000 7f2c8a227640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:17:58.528 INFO:tasks.workunit.client.0.smithi016.stderr: -225> 2024-09-12T17:17:57.708+0000 7f2c8a227640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:17:58.528 INFO:tasks.workunit.client.0.smithi016.stderr: -224> 2024-09-12T17:17:57.708+0000 7f2c89a26640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:17:58.528 INFO:tasks.workunit.client.0.smithi016.stderr: -223> 2024-09-12T17:17:57.708+0000 7f2c89a26640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:17:58.528 INFO:tasks.workunit.client.0.smithi016.stderr: -222> 2024-09-12T17:17:57.708+0000 7f2c89a26640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:17:58.528 INFO:tasks.workunit.client.0.smithi016.stderr: -221> 2024-09-12T17:17:57.708+0000 7f2c8a227640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:17:58.528 INFO:tasks.workunit.client.0.smithi016.stderr: -220> 2024-09-12T17:17:57.708+0000 7f2c8a227640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:17:58.528 INFO:tasks.workunit.client.0.smithi016.stderr: -219> 2024-09-12T17:17:57.708+0000 7f2c8a227640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:17:58.528 INFO:tasks.workunit.client.0.smithi016.stderr: -218> 2024-09-12T17:17:57.708+0000 7f2c8aa28640 10 monclient(hunting): get_auth_request con 0x55883d0bc520 auth_method 0 2024-09-12T17:17:58.528 INFO:tasks.workunit.client.0.smithi016.stderr: -217> 2024-09-12T17:17:57.708+0000 7f2c8aa28640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:17:58.528 INFO:tasks.workunit.client.0.smithi016.stderr: -216> 2024-09-12T17:17:57.708+0000 7f2c8aa28640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:17:58.528 INFO:tasks.workunit.client.0.smithi016.stderr: -215> 2024-09-12T17:17:57.708+0000 7f2c8aa28640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:17:58.528 INFO:tasks.workunit.client.0.smithi016.stderr: -214> 2024-09-12T17:17:57.708+0000 7f2c89a26640 10 monclient(hunting): handle_auth_done global_id 6573 payload 274 2024-09-12T17:17:58.528 INFO:tasks.workunit.client.0.smithi016.stderr: -213> 2024-09-12T17:17:57.708+0000 7f2c89a26640 10 monclient: _finish_hunting 0 2024-09-12T17:17:58.528 INFO:tasks.workunit.client.0.smithi016.stderr: -212> 2024-09-12T17:17:57.708+0000 7f2c89a26640 1 monclient: found mon.noname-a 2024-09-12T17:17:58.529 INFO:tasks.workunit.client.0.smithi016.stderr: -211> 2024-09-12T17:17:57.708+0000 7f2c89a26640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:17:58.529 INFO:tasks.workunit.client.0.smithi016.stderr: -210> 2024-09-12T17:17:57.708+0000 7f2b6dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:17:58.529 INFO:tasks.workunit.client.0.smithi016.stderr: -209> 2024-09-12T17:17:57.708+0000 7f2b6dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:17:58.529 INFO:tasks.workunit.client.0.smithi016.stderr: -208> 2024-09-12T17:17:57.708+0000 7f2b6dffb640 10 monclient: dump: 2024-09-12T17:17:58.529 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:17:58.529 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:17:58.529 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:58.529 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:58.529 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:17:58.529 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:58.529 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:17:58.529 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:17:58.529 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:17:58.530 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:58.530 INFO:tasks.workunit.client.0.smithi016.stderr: -207> 2024-09-12T17:17:57.708+0000 7f2b6dffb640 10 monclient: _finish_auth 0 2024-09-12T17:17:58.530 INFO:tasks.workunit.client.0.smithi016.stderr: -206> 2024-09-12T17:17:57.708+0000 7f2b6dffb640 10 monclient: _check_auth_tickets 2024-09-12T17:17:58.530 INFO:tasks.workunit.client.0.smithi016.stderr: -205> 2024-09-12T17:17:57.708+0000 7f2b6dffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:17:58.530 INFO:tasks.workunit.client.0.smithi016.stderr: -204> 2024-09-12T17:17:57.708+0000 7f2b6dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:17:58.530 INFO:tasks.workunit.client.0.smithi016.stderr: -203> 2024-09-12T17:17:57.708+0000 7f2b6dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:17:58.530 INFO:tasks.workunit.client.0.smithi016.stderr: -202> 2024-09-12T17:17:57.708+0000 7f2b6dffb640 10 monclient: dump: 2024-09-12T17:17:58.530 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:17:58.530 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:17:58.530 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:58.530 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:58.530 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:17:58.530 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:58.531 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:17:58.531 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:17:58.531 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:17:58.531 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:58.531 INFO:tasks.workunit.client.0.smithi016.stderr: -201> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 5 monclient: authenticate success, global_id 6573 2024-09-12T17:17:58.531 INFO:tasks.workunit.client.0.smithi016.stderr: -200> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 10 monclient: get_monmap_and_config success 2024-09-12T17:17:58.531 INFO:tasks.workunit.client.0.smithi016.stderr: -199> 2024-09-12T17:17:57.708+0000 7f2c8c7219c0 4 set_mon_vals no callback set 2024-09-12T17:17:58.531 INFO:tasks.workunit.client.0.smithi016.stderr: -198> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 10 monclient: shutdown 2024-09-12T17:17:58.531 INFO:tasks.workunit.client.0.smithi016.stderr: -197> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 10 monclient: build_initial_monmap 2024-09-12T17:17:58.531 INFO:tasks.workunit.client.0.smithi016.stderr: -196> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 1 build_initial for_mkfs: 0 2024-09-12T17:17:58.531 INFO:tasks.workunit.client.0.smithi016.stderr: -195> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 10 monclient: monmap: 2024-09-12T17:17:58.531 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:17:58.531 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:17:58.532 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:17:58.532 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:17:58.532 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:17:58.532 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:58.532 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:17:58.532 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:17:58.532 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:17:58.532 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:58.532 INFO:tasks.workunit.client.0.smithi016.stderr: -194> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0b8580) adding auth protocol: cephx 2024-09-12T17:17:58.532 INFO:tasks.workunit.client.0.smithi016.stderr: -193> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0b8580) adding auth protocol: cephx 2024-09-12T17:17:58.532 INFO:tasks.workunit.client.0.smithi016.stderr: -192> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0b8580) adding auth protocol: cephx 2024-09-12T17:17:58.532 INFO:tasks.workunit.client.0.smithi016.stderr: -191> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0b8580) adding con mode: secure 2024-09-12T17:17:58.532 INFO:tasks.workunit.client.0.smithi016.stderr: -190> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0b8580) adding con mode: crc 2024-09-12T17:17:58.533 INFO:tasks.workunit.client.0.smithi016.stderr: -189> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0b8580) adding con mode: secure 2024-09-12T17:17:58.533 INFO:tasks.workunit.client.0.smithi016.stderr: -188> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0b8580) adding con mode: crc 2024-09-12T17:17:58.533 INFO:tasks.workunit.client.0.smithi016.stderr: -187> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0b8580) adding con mode: secure 2024-09-12T17:17:58.533 INFO:tasks.workunit.client.0.smithi016.stderr: -186> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0b8580) adding con mode: crc 2024-09-12T17:17:58.533 INFO:tasks.workunit.client.0.smithi016.stderr: -185> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0b8580) adding con mode: crc 2024-09-12T17:17:58.533 INFO:tasks.workunit.client.0.smithi016.stderr: -184> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0b8580) adding con mode: secure 2024-09-12T17:17:58.533 INFO:tasks.workunit.client.0.smithi016.stderr: -183> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0b8580) adding con mode: crc 2024-09-12T17:17:58.533 INFO:tasks.workunit.client.0.smithi016.stderr: -182> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0b8580) adding con mode: secure 2024-09-12T17:17:58.533 INFO:tasks.workunit.client.0.smithi016.stderr: -181> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0b8580) adding con mode: crc 2024-09-12T17:17:58.533 INFO:tasks.workunit.client.0.smithi016.stderr: -180> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d0b8580) adding con mode: secure 2024-09-12T17:17:58.533 INFO:tasks.workunit.client.0.smithi016.stderr: -179> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:58.533 INFO:tasks.workunit.client.0.smithi016.stderr: -178> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 1 librados: starting msgr at 2024-09-12T17:17:58.534 INFO:tasks.workunit.client.0.smithi016.stderr: -177> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 1 librados: starting objecter 2024-09-12T17:17:58.534 INFO:tasks.workunit.client.0.smithi016.stderr: -176> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 asok(0x55883cddd2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55883d08c610 EEXIST 2024-09-12T17:17:58.534 INFO:tasks.workunit.client.0.smithi016.stderr: -175> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 1 librados: setting wanted keys 2024-09-12T17:17:58.534 INFO:tasks.workunit.client.0.smithi016.stderr: -174> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 1 librados: calling monclient init 2024-09-12T17:17:58.534 INFO:tasks.workunit.client.0.smithi016.stderr: -173> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 10 monclient: init 2024-09-12T17:17:58.534 INFO:tasks.workunit.client.0.smithi016.stderr: -172> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d06a5c0) adding auth protocol: cephx 2024-09-12T17:17:58.534 INFO:tasks.workunit.client.0.smithi016.stderr: -171> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d06a5c0) adding auth protocol: cephx 2024-09-12T17:17:58.534 INFO:tasks.workunit.client.0.smithi016.stderr: -170> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d06a5c0) adding auth protocol: cephx 2024-09-12T17:17:58.534 INFO:tasks.workunit.client.0.smithi016.stderr: -169> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d06a5c0) adding con mode: secure 2024-09-12T17:17:58.534 INFO:tasks.workunit.client.0.smithi016.stderr: -168> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d06a5c0) adding con mode: crc 2024-09-12T17:17:58.534 INFO:tasks.workunit.client.0.smithi016.stderr: -167> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d06a5c0) adding con mode: secure 2024-09-12T17:17:58.534 INFO:tasks.workunit.client.0.smithi016.stderr: -166> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d06a5c0) adding con mode: crc 2024-09-12T17:17:58.534 INFO:tasks.workunit.client.0.smithi016.stderr: -165> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d06a5c0) adding con mode: secure 2024-09-12T17:17:58.535 INFO:tasks.workunit.client.0.smithi016.stderr: -164> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d06a5c0) adding con mode: crc 2024-09-12T17:17:58.535 INFO:tasks.workunit.client.0.smithi016.stderr: -163> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d06a5c0) adding con mode: crc 2024-09-12T17:17:58.535 INFO:tasks.workunit.client.0.smithi016.stderr: -162> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d06a5c0) adding con mode: secure 2024-09-12T17:17:58.535 INFO:tasks.workunit.client.0.smithi016.stderr: -161> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d06a5c0) adding con mode: crc 2024-09-12T17:17:58.535 INFO:tasks.workunit.client.0.smithi016.stderr: -160> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d06a5c0) adding con mode: secure 2024-09-12T17:17:58.535 INFO:tasks.workunit.client.0.smithi016.stderr: -159> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d06a5c0) adding con mode: crc 2024-09-12T17:17:58.535 INFO:tasks.workunit.client.0.smithi016.stderr: -158> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 AuthRegistry(0x55883d06a5c0) adding con mode: secure 2024-09-12T17:17:58.535 INFO:tasks.workunit.client.0.smithi016.stderr: -157> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:58.535 INFO:tasks.workunit.client.0.smithi016.stderr: -156> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:58.535 INFO:tasks.workunit.client.0.smithi016.stderr: -155> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 asok(0x55883cddd2b0) register_command rotate-key cmddesc rotate-key hook 0x55883d06a708 EEXIST 2024-09-12T17:17:58.535 INFO:tasks.workunit.client.0.smithi016.stderr: -154> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 10 monclient: _reopen_session rank -1 2024-09-12T17:17:58.535 INFO:tasks.workunit.client.0.smithi016.stderr: -153> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:17:58.535 INFO:tasks.workunit.client.0.smithi016.stderr: -152> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 10 monclient(hunting): picked mon.noname-b con 0x55883d0b68e0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:17:58.536 INFO:tasks.workunit.client.0.smithi016.stderr: -151> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 10 monclient(hunting): picked mon.noname-c con 0x55883d0bc140 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:17:58.536 INFO:tasks.workunit.client.0.smithi016.stderr: -150> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 10 monclient(hunting): picked mon.noname-a con 0x55883d0b1a00 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:17:58.536 INFO:tasks.workunit.client.0.smithi016.stderr: -149> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:58.536 INFO:tasks.workunit.client.0.smithi016.stderr: -148> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:58.536 INFO:tasks.workunit.client.0.smithi016.stderr: -147> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:17:58.536 INFO:tasks.workunit.client.0.smithi016.stderr: -146> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 10 monclient(hunting): _renew_subs 2024-09-12T17:17:58.536 INFO:tasks.workunit.client.0.smithi016.stderr: -145> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 10 monclient(hunting): authenticate will time out at 2195.689562s 2024-09-12T17:17:58.536 INFO:tasks.workunit.client.0.smithi016.stderr: -144> 2024-09-12T17:17:57.712+0000 7f2c8a227640 10 monclient(hunting): get_auth_request con 0x55883d0b1a00 auth_method 0 2024-09-12T17:17:58.536 INFO:tasks.workunit.client.0.smithi016.stderr: -143> 2024-09-12T17:17:57.712+0000 7f2c8a227640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:17:58.536 INFO:tasks.workunit.client.0.smithi016.stderr: -142> 2024-09-12T17:17:57.712+0000 7f2c8a227640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:17:58.536 INFO:tasks.workunit.client.0.smithi016.stderr: -141> 2024-09-12T17:17:57.712+0000 7f2c8a227640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:17:58.536 INFO:tasks.workunit.client.0.smithi016.stderr: -140> 2024-09-12T17:17:57.712+0000 7f2c8aa28640 10 monclient(hunting): get_auth_request con 0x55883d0bc140 auth_method 0 2024-09-12T17:17:58.536 INFO:tasks.workunit.client.0.smithi016.stderr: -139> 2024-09-12T17:17:57.712+0000 7f2c8aa28640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:17:58.537 INFO:tasks.workunit.client.0.smithi016.stderr: -138> 2024-09-12T17:17:57.712+0000 7f2c8aa28640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:17:58.537 INFO:tasks.workunit.client.0.smithi016.stderr: -137> 2024-09-12T17:17:57.712+0000 7f2c8aa28640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:17:58.537 INFO:tasks.workunit.client.0.smithi016.stderr: -136> 2024-09-12T17:17:57.712+0000 7f2c8a227640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:17:58.537 INFO:tasks.workunit.client.0.smithi016.stderr: -135> 2024-09-12T17:17:57.712+0000 7f2c8a227640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:17:58.537 INFO:tasks.workunit.client.0.smithi016.stderr: -134> 2024-09-12T17:17:57.712+0000 7f2c8a227640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:17:58.537 INFO:tasks.workunit.client.0.smithi016.stderr: -133> 2024-09-12T17:17:57.712+0000 7f2c8aa28640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:17:58.537 INFO:tasks.workunit.client.0.smithi016.stderr: -132> 2024-09-12T17:17:57.712+0000 7f2c8aa28640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:17:58.537 INFO:tasks.workunit.client.0.smithi016.stderr: -131> 2024-09-12T17:17:57.712+0000 7f2c8aa28640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:17:58.537 INFO:tasks.workunit.client.0.smithi016.stderr: -130> 2024-09-12T17:17:57.712+0000 7f2c8a227640 10 monclient(hunting): handle_auth_done global_id 6576 payload 824 2024-09-12T17:17:58.537 INFO:tasks.workunit.client.0.smithi016.stderr: -129> 2024-09-12T17:17:57.712+0000 7f2c8a227640 10 monclient: _finish_hunting 0 2024-09-12T17:17:58.537 INFO:tasks.workunit.client.0.smithi016.stderr: -128> 2024-09-12T17:17:57.712+0000 7f2c8a227640 1 monclient: found mon.noname-a 2024-09-12T17:17:58.537 INFO:tasks.workunit.client.0.smithi016.stderr: -127> 2024-09-12T17:17:57.712+0000 7f2c8a227640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:17:58.538 INFO:tasks.workunit.client.0.smithi016.stderr: -126> 2024-09-12T17:17:57.712+0000 7f2b5bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:17:58.538 INFO:tasks.workunit.client.0.smithi016.stderr: -125> 2024-09-12T17:17:57.712+0000 7f2b5bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:17:58.538 INFO:tasks.workunit.client.0.smithi016.stderr: -124> 2024-09-12T17:17:57.712+0000 7f2b5bfff640 10 monclient: dump: 2024-09-12T17:17:58.538 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:17:58.538 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:17:58.538 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:58.538 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:58.538 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:17:58.538 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:58.538 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:17:58.538 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:17:58.538 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:17:58.538 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:58.539 INFO:tasks.workunit.client.0.smithi016.stderr: -123> 2024-09-12T17:17:57.712+0000 7f2b5bfff640 10 monclient: _finish_auth 0 2024-09-12T17:17:58.539 INFO:tasks.workunit.client.0.smithi016.stderr: -122> 2024-09-12T17:17:57.712+0000 7f2b5bfff640 10 monclient: _check_auth_tickets 2024-09-12T17:17:58.539 INFO:tasks.workunit.client.0.smithi016.stderr: -121> 2024-09-12T17:17:57.712+0000 7f2b5bfff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:17:58.539 INFO:tasks.workunit.client.0.smithi016.stderr: -120> 2024-09-12T17:17:57.712+0000 7f2b5bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:17:58.539 INFO:tasks.workunit.client.0.smithi016.stderr: -119> 2024-09-12T17:17:57.712+0000 7f2b5bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:17:58.539 INFO:tasks.workunit.client.0.smithi016.stderr: -118> 2024-09-12T17:17:57.712+0000 7f2b5bfff640 10 monclient: dump: 2024-09-12T17:17:58.539 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:17:58.539 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:17:58.539 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:58.539 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:17:58.539 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:17:58.539 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:17:58.539 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:17:58.540 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:17:58.540 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:17:58.540 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:58.540 INFO:tasks.workunit.client.0.smithi016.stderr: -117> 2024-09-12T17:17:57.712+0000 7f2b6dffb640 4 set_mon_vals no callback set 2024-09-12T17:17:58.540 INFO:tasks.workunit.client.0.smithi016.stderr: -116> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 monclient: authenticate success, global_id 6576 2024-09-12T17:17:58.540 INFO:tasks.workunit.client.0.smithi016.stderr: -115> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 10 monclient: _renew_subs 2024-09-12T17:17:58.540 INFO:tasks.workunit.client.0.smithi016.stderr: -114> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:17:58.540 INFO:tasks.workunit.client.0.smithi016.stderr: -113> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 10 monclient: _renew_subs 2024-09-12T17:17:58.540 INFO:tasks.workunit.client.0.smithi016.stderr: -112> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:17:58.540 INFO:tasks.workunit.client.0.smithi016.stderr: -111> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 1 librados: init done 2024-09-12T17:17:58.540 INFO:tasks.workunit.client.0.smithi016.stderr: -110> 2024-09-12T17:17:57.712+0000 7f2c8c7219c0 5 asok(0x55883cddd2b0) register_command cr dump hook 0x55883d0b13f8 2024-09-12T17:17:58.540 INFO:tasks.workunit.client.0.smithi016.stderr: -109> 2024-09-12T17:17:57.716+0000 7f2c8c7219c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.540 INFO:tasks.workunit.client.0.smithi016.stderr: -108> 2024-09-12T17:17:57.716+0000 7f2b5bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:17:58.541 INFO:tasks.workunit.client.0.smithi016.stderr: -107> 2024-09-12T17:17:57.716+0000 7f2b5bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:17:58.541 INFO:tasks.workunit.client.0.smithi016.stderr: -106> 2024-09-12T17:17:57.716+0000 7f2b5bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:17:58.541 INFO:tasks.workunit.client.0.smithi016.stderr: -105> 2024-09-12T17:17:57.716+0000 7f2c8aa28640 10 monclient: get_auth_request con 0x55883d0d60d0 auth_method 0 2024-09-12T17:17:58.541 INFO:tasks.workunit.client.0.smithi016.stderr: -104> 2024-09-12T17:17:57.716+0000 7f2c89a26640 10 monclient: get_auth_request con 0x7f2b54070ae0 auth_method 0 2024-09-12T17:17:58.541 INFO:tasks.workunit.client.0.smithi016.stderr: -103> 2024-09-12T17:17:57.716+0000 7f2c8c7219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:58.541 INFO:tasks.workunit.client.0.smithi016.stderr: -102> 2024-09-12T17:17:57.716+0000 7f2c8c7219c0 20 realm 2024-09-12T17:17:58.541 INFO:tasks.workunit.client.0.smithi016.stderr: -101> 2024-09-12T17:17:57.716+0000 7f2c8c7219c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.541 INFO:tasks.workunit.client.0.smithi016.stderr: -100> 2024-09-12T17:17:57.716+0000 7f2c8c7219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:58.541 INFO:tasks.workunit.client.0.smithi016.stderr: -99> 2024-09-12T17:17:57.716+0000 7f2c8c7219c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:17:58.541 INFO:tasks.workunit.client.0.smithi016.stderr: -98> 2024-09-12T17:17:57.716+0000 7f2c8c7219c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.541 INFO:tasks.workunit.client.0.smithi016.stderr: -97> 2024-09-12T17:17:57.716+0000 7f2c8c7219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:58.541 INFO:tasks.workunit.client.0.smithi016.stderr: -96> 2024-09-12T17:17:57.716+0000 7f2c8c7219c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.541 INFO:tasks.workunit.client.0.smithi016.stderr: -95> 2024-09-12T17:17:57.716+0000 7f2c89a26640 10 monclient: get_auth_request con 0x55883d0da2d0 auth_method 0 2024-09-12T17:17:58.542 INFO:tasks.workunit.client.0.smithi016.stderr: -94> 2024-09-12T17:17:57.720+0000 7f2c8c7219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:58.542 INFO:tasks.workunit.client.0.smithi016.stderr: -93> 2024-09-12T17:17:57.720+0000 7f2c8c7219c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.542 INFO:tasks.workunit.client.0.smithi016.stderr: -92> 2024-09-12T17:17:57.720+0000 7f2c8aa28640 10 monclient: get_auth_request con 0x55883d0ddb10 auth_method 0 2024-09-12T17:17:58.542 INFO:tasks.workunit.client.0.smithi016.stderr: -91> 2024-09-12T17:17:57.924+0000 7f2c8aa28640 10 monclient: get_auth_request con 0x55883d0ddb10 auth_method 0 2024-09-12T17:17:58.542 INFO:tasks.workunit.client.0.smithi016.stderr: -90> 2024-09-12T17:17:57.924+0000 7f2c8c7219c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:17:58.542 INFO:tasks.workunit.client.0.smithi016.stderr: -89> 2024-09-12T17:17:57.924+0000 7f2c8c7219c0 20 searching for the correct realm 2024-09-12T17:17:58.542 INFO:tasks.workunit.client.0.smithi016.stderr: -88> 2024-09-12T17:17:57.924+0000 7f2c8a227640 10 monclient: get_auth_request con 0x55883d0e2800 auth_method 0 2024-09-12T17:17:58.542 INFO:tasks.workunit.client.0.smithi016.stderr: -87> 2024-09-12T17:17:57.928+0000 7f2c89a26640 10 monclient: get_auth_request con 0x7f2c7c03a060 auth_method 0 2024-09-12T17:17:58.542 INFO:tasks.workunit.client.0.smithi016.stderr: -86> 2024-09-12T17:17:57.928+0000 7f2c8aa28640 0 -- 172.21.15.16:0/3121594993 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f2c8012cb20 msgr2=0x7f2c800f72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:58.542 INFO:tasks.workunit.client.0.smithi016.stderr: -85> 2024-09-12T17:17:58.132+0000 7f2c8aa28640 10 monclient: get_auth_request con 0x7f2c8012cb20 auth_method 0 2024-09-12T17:17:58.542 INFO:tasks.workunit.client.0.smithi016.stderr: -84> 2024-09-12T17:17:58.136+0000 7f2c8a227640 10 monclient: get_auth_request con 0x7f2c84023040 auth_method 0 2024-09-12T17:17:58.542 INFO:tasks.workunit.client.0.smithi016.stderr: -83> 2024-09-12T17:17:58.144+0000 7f2c89a26640 0 -- 172.21.15.16:0/3121594993 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f2c8402e410 msgr2=0x7f2c8402e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:58.542 INFO:tasks.workunit.client.0.smithi016.stderr: -82> 2024-09-12T17:17:58.348+0000 7f2c89a26640 10 monclient: get_auth_request con 0x7f2c8402e410 auth_method 0 2024-09-12T17:17:58.543 INFO:tasks.workunit.client.0.smithi016.stderr: -81> 2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:17:58.543 INFO:tasks.workunit.client.0.smithi016.stderr: -80> 2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:17:58.543 INFO:tasks.workunit.client.0.smithi016.stderr: -79> 2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:17:58.543 INFO:tasks.workunit.client.0.smithi016.stderr: -78> 2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:17:58.543 INFO:tasks.workunit.client.0.smithi016.stderr: -77> 2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:17:58.543 INFO:tasks.workunit.client.0.smithi016.stderr: -76> 2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:17:58.543 INFO:tasks.workunit.client.0.smithi016.stderr: -75> 2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.543 INFO:tasks.workunit.client.0.smithi016.stderr: -74> 2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:58.543 INFO:tasks.workunit.client.0.smithi016.stderr: -73> 2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.543 INFO:tasks.workunit.client.0.smithi016.stderr: -72> 2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:58.543 INFO:tasks.workunit.client.0.smithi016.stderr: -71> 2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.543 INFO:tasks.workunit.client.0.smithi016.stderr: -70> 2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:17:58.543 INFO:tasks.workunit.client.0.smithi016.stderr: -69> 2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 zone default found 2024-09-12T17:17:58.544 INFO:tasks.workunit.client.0.smithi016.stderr: -68> 2024-09-12T17:17:58.364+0000 7f2c8c7219c0 4 Realm: () 2024-09-12T17:17:58.544 INFO:tasks.workunit.client.0.smithi016.stderr: -67> 2024-09-12T17:17:58.364+0000 7f2c8c7219c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:17:58.544 INFO:tasks.workunit.client.0.smithi016.stderr: -66> 2024-09-12T17:17:58.364+0000 7f2c8c7219c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:17:58.544 INFO:tasks.workunit.client.0.smithi016.stderr: -65> 2024-09-12T17:17:58.364+0000 7f2c8c7219c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:17:58.544 INFO:tasks.workunit.client.0.smithi016.stderr: -64> 2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 zonegroup default 2024-09-12T17:17:58.544 INFO:tasks.workunit.client.0.smithi016.stderr: -63> 2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.544 INFO:tasks.workunit.client.0.smithi016.stderr: -62> 2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:58.544 INFO:tasks.workunit.client.0.smithi016.stderr: -61> 2024-09-12T17:17:58.364+0000 7f2c8c7219c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.544 INFO:tasks.workunit.client.0.smithi016.stderr: -60> 2024-09-12T17:17:58.368+0000 7f2c8c7219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:58.544 INFO:tasks.workunit.client.0.smithi016.stderr: -59> 2024-09-12T17:17:58.368+0000 7f2c8c7219c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.544 INFO:tasks.workunit.client.0.smithi016.stderr: -58> 2024-09-12T17:17:58.368+0000 7f2c8c7219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:58.544 INFO:tasks.workunit.client.0.smithi016.stderr: -57> 2024-09-12T17:17:58.368+0000 7f2c8c7219c0 20 started sync module instance, tier type = 2024-09-12T17:17:58.544 INFO:tasks.workunit.client.0.smithi016.stderr: -56> 2024-09-12T17:17:58.368+0000 7f2c8c7219c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:17:58.545 INFO:tasks.workunit.client.0.smithi016.stderr: -55> 2024-09-12T17:17:58.392+0000 7f2c8c7219c0 20 add_watcher() i=0 2024-09-12T17:17:58.545 INFO:tasks.workunit.client.0.smithi016.stderr: -54> 2024-09-12T17:17:58.392+0000 7f2c8c7219c0 20 add_watcher() i=1 2024-09-12T17:17:58.545 INFO:tasks.workunit.client.0.smithi016.stderr: -53> 2024-09-12T17:17:58.392+0000 7f2c8c7219c0 20 add_watcher() i=2 2024-09-12T17:17:58.545 INFO:tasks.workunit.client.0.smithi016.stderr: -52> 2024-09-12T17:17:58.392+0000 7f2c8c7219c0 20 add_watcher() i=3 2024-09-12T17:17:58.545 INFO:tasks.workunit.client.0.smithi016.stderr: -51> 2024-09-12T17:17:58.392+0000 7f2c8c7219c0 20 add_watcher() i=4 2024-09-12T17:17:58.545 INFO:tasks.workunit.client.0.smithi016.stderr: -50> 2024-09-12T17:17:58.392+0000 7f2c8c7219c0 20 add_watcher() i=5 2024-09-12T17:17:58.545 INFO:tasks.workunit.client.0.smithi016.stderr: -49> 2024-09-12T17:17:58.392+0000 7f2c8c7219c0 20 add_watcher() i=6 2024-09-12T17:17:58.545 INFO:tasks.workunit.client.0.smithi016.stderr: -48> 2024-09-12T17:17:58.392+0000 7f2c8c7219c0 20 add_watcher() i=7 2024-09-12T17:17:58.545 INFO:tasks.workunit.client.0.smithi016.stderr: -47> 2024-09-12T17:17:58.392+0000 7f2c8c7219c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:17:58.545 INFO:tasks.workunit.client.0.smithi016.stderr: -46> 2024-09-12T17:17:58.396+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e5d80) adding auth protocol: cephx 2024-09-12T17:17:58.545 INFO:tasks.workunit.client.0.smithi016.stderr: -45> 2024-09-12T17:17:58.396+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e5d80) adding auth protocol: cephx 2024-09-12T17:17:58.545 INFO:tasks.workunit.client.0.smithi016.stderr: -44> 2024-09-12T17:17:58.396+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e5d80) adding auth protocol: cephx 2024-09-12T17:17:58.545 INFO:tasks.workunit.client.0.smithi016.stderr: -43> 2024-09-12T17:17:58.396+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e5d80) adding con mode: secure 2024-09-12T17:17:58.546 INFO:tasks.workunit.client.0.smithi016.stderr: -42> 2024-09-12T17:17:58.396+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e5d80) adding con mode: crc 2024-09-12T17:17:58.546 INFO:tasks.workunit.client.0.smithi016.stderr: -41> 2024-09-12T17:17:58.396+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e5d80) adding con mode: secure 2024-09-12T17:17:58.546 INFO:tasks.workunit.client.0.smithi016.stderr: -40> 2024-09-12T17:17:58.396+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e5d80) adding con mode: crc 2024-09-12T17:17:58.546 INFO:tasks.workunit.client.0.smithi016.stderr: -39> 2024-09-12T17:17:58.396+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e5d80) adding con mode: secure 2024-09-12T17:17:58.546 INFO:tasks.workunit.client.0.smithi016.stderr: -38> 2024-09-12T17:17:58.396+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e5d80) adding con mode: crc 2024-09-12T17:17:58.546 INFO:tasks.workunit.client.0.smithi016.stderr: -37> 2024-09-12T17:17:58.396+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e5d80) adding con mode: crc 2024-09-12T17:17:58.546 INFO:tasks.workunit.client.0.smithi016.stderr: -36> 2024-09-12T17:17:58.396+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e5d80) adding con mode: secure 2024-09-12T17:17:58.546 INFO:tasks.workunit.client.0.smithi016.stderr: -35> 2024-09-12T17:17:58.396+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e5d80) adding con mode: crc 2024-09-12T17:17:58.546 INFO:tasks.workunit.client.0.smithi016.stderr: -34> 2024-09-12T17:17:58.396+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e5d80) adding con mode: secure 2024-09-12T17:17:58.546 INFO:tasks.workunit.client.0.smithi016.stderr: -33> 2024-09-12T17:17:58.396+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e5d80) adding con mode: crc 2024-09-12T17:17:58.546 INFO:tasks.workunit.client.0.smithi016.stderr: -32> 2024-09-12T17:17:58.396+0000 7f2c8c7219c0 5 AuthRegistry(0x7ffdbf3e5d80) adding con mode: secure 2024-09-12T17:17:58.546 INFO:tasks.workunit.client.0.smithi016.stderr: -31> 2024-09-12T17:17:58.396+0000 7f2b40fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:58.546 INFO:tasks.workunit.client.0.smithi016.stderr: -30> 2024-09-12T17:17:58.400+0000 7f2c8c7219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:17:58.547 INFO:tasks.workunit.client.0.smithi016.stderr: -29> 2024-09-12T17:17:58.400+0000 7f2c8c7219c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:17:58.547 INFO:tasks.workunit.client.0.smithi016.stderr: -28> 2024-09-12T17:17:58.400+0000 7f2c8c7219c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:17:58.547 INFO:tasks.workunit.client.0.smithi016.stderr: -27> 2024-09-12T17:17:58.400+0000 7f2c8c7219c0 5 asok(0x55883cddd2b0) register_command cache list hook 0x55883d0b43c0 2024-09-12T17:17:58.547 INFO:tasks.workunit.client.0.smithi016.stderr: -26> 2024-09-12T17:17:58.400+0000 7f2c8c7219c0 5 asok(0x55883cddd2b0) register_command cache inspect hook 0x55883d0b43c0 2024-09-12T17:17:58.547 INFO:tasks.workunit.client.0.smithi016.stderr: -25> 2024-09-12T17:17:58.400+0000 7f2c8c7219c0 5 asok(0x55883cddd2b0) register_command cache erase hook 0x55883d0b43c0 2024-09-12T17:17:58.547 INFO:tasks.workunit.client.0.smithi016.stderr: -24> 2024-09-12T17:17:58.400+0000 7f2c8c7219c0 5 asok(0x55883cddd2b0) register_command cache zap hook 0x55883d0b43c0 2024-09-12T17:17:58.547 INFO:tasks.workunit.client.0.smithi016.stderr: -23> 2024-09-12T17:17:58.400+0000 7f2c8c7219c0 5 note: GC not initialized 2024-09-12T17:17:58.547 INFO:tasks.workunit.client.0.smithi016.stderr: -22> 2024-09-12T17:17:58.400+0000 7f2abb7fe640 20 reqs_thread_entry: start 2024-09-12T17:17:58.547 INFO:tasks.workunit.client.0.smithi016.stderr: -21> 2024-09-12T17:17:58.400+0000 7f2c8c7219c0 5 asok(0x55883cddd2b0) register_command sync trace show hook 0x7f2c8011c070 2024-09-12T17:17:58.547 INFO:tasks.workunit.client.0.smithi016.stderr: -20> 2024-09-12T17:17:58.400+0000 7f2c8c7219c0 5 asok(0x55883cddd2b0) register_command sync trace history hook 0x7f2c8011c070 2024-09-12T17:17:58.547 INFO:tasks.workunit.client.0.smithi016.stderr: -19> 2024-09-12T17:17:58.400+0000 7f2c8c7219c0 5 asok(0x55883cddd2b0) register_command sync trace active hook 0x7f2c8011c070 2024-09-12T17:17:58.547 INFO:tasks.workunit.client.0.smithi016.stderr: -18> 2024-09-12T17:17:58.400+0000 7f2c8c7219c0 5 asok(0x55883cddd2b0) register_command sync trace active_short hook 0x7f2c8011c070 2024-09-12T17:17:58.547 INFO:tasks.workunit.client.0.smithi016.stderr: -17> 2024-09-12T17:17:58.400+0000 7f2c8c7219c0 20 init_complete bucket index max shards: 1 2024-09-12T17:17:58.548 INFO:tasks.workunit.client.0.smithi016.stderr: -16> 2024-09-12T17:17:58.400+0000 7f2c8c7219c0 20 Filter name: none 2024-09-12T17:17:58.548 INFO:tasks.workunit.client.0.smithi016.stderr: -15> 2024-09-12T17:17:58.400+0000 7f2ab97fa640 20 reqs_thread_entry: start 2024-09-12T17:17:58.548 INFO:tasks.workunit.client.0.smithi016.stderr: -14> 2024-09-12T17:17:58.400+0000 7f2c8c7219c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T17:17:58.548 INFO:tasks.workunit.client.0.smithi016.stderr: -13> 2024-09-12T17:17:58.400+0000 7f2c8c7219c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.548 INFO:tasks.workunit.client.0.smithi016.stderr: -12> 2024-09-12T17:17:58.400+0000 7f2c8c7219c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:17:58.548 INFO:tasks.workunit.client.0.smithi016.stderr: -11> 2024-09-12T17:17:58.400+0000 7f2c8c7219c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T17:17:58.548 INFO:tasks.workunit.client.0.smithi016.stderr: -10> 2024-09-12T17:17:58.400+0000 7f2c8c7219c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T17:17:58.548 INFO:tasks.workunit.client.0.smithi016.stderr: -9> 2024-09-12T17:17:58.400+0000 7f2c8c7219c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24 : miss 2024-09-12T17:17:58.548 INFO:tasks.workunit.client.0.smithi016.stderr: -8> 2024-09-12T17:17:58.400+0000 7f2c8c7219c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.548 INFO:tasks.workunit.client.0.smithi016.stderr: -7> 2024-09-12T17:17:58.404+0000 7f2c8c7219c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:17:58.548 INFO:tasks.workunit.client.0.smithi016.stderr: -6> 2024-09-12T17:17:58.404+0000 7f2c8c7219c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24 info.flags=0x17 2024-09-12T17:17:58.548 INFO:tasks.workunit.client.0.smithi016.stderr: -5> 2024-09-12T17:17:58.404+0000 7f2c8c7219c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24 to cache LRU end 2024-09-12T17:17:58.548 INFO:tasks.workunit.client.0.smithi016.stderr: -4> 2024-09-12T17:17:58.404+0000 7f2c8c7219c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:17:58.549 INFO:tasks.workunit.client.0.smithi016.stderr: -3> 2024-09-12T17:17:58.404+0000 7f2c8c7219c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:17:58.549 INFO:tasks.workunit.client.0.smithi016.stderr: -2> 2024-09-12T17:17:58.404+0000 7f2c8c7219c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24 2024-09-12T17:17:58.549 INFO:tasks.workunit.client.0.smithi016.stderr: -1> 2024-09-12T17:17:58.412+0000 7f2c8c7219c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2c8c7219c0 time 2024-09-12T17:17:58.413570+0000 2024-09-12T17:17:58.549 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:17:58.549 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:58.549 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:17:58.549 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f2c8fffb2eb] 2024-09-12T17:17:58.549 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2c8fffb49f] 2024-09-12T17:17:58.549 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55883a04c0c1] 2024-09-12T17:17:58.549 INFO:tasks.workunit.client.0.smithi016.stderr: 4: radosgw-admin(+0x140f6b8) [0x55883aaa16b8] 2024-09-12T17:17:58.549 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55883a05e18d] 2024-09-12T17:17:58.549 INFO:tasks.workunit.client.0.smithi016.stderr: 6: main() 2024-09-12T17:17:58.549 INFO:tasks.workunit.client.0.smithi016.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2c8ee61d90] 2024-09-12T17:17:58.550 INFO:tasks.workunit.client.0.smithi016.stderr: 8: __libc_start_main() 2024-09-12T17:17:58.550 INFO:tasks.workunit.client.0.smithi016.stderr: 9: _start() 2024-09-12T17:17:58.550 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:58.550 INFO:tasks.workunit.client.0.smithi016.stderr: 0> 2024-09-12T17:17:58.416+0000 7f2c8c7219c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:17:58.550 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7f2c8c7219c0 thread_name:radosgw-admin 2024-09-12T17:17:58.550 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:58.550 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:17:58.550 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2c8ee7a520] 2024-09-12T17:17:58.550 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:17:58.550 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:17:58.550 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:17:58.550 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2c8fffb345] 2024-09-12T17:17:58.550 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2c8fffb49f] 2024-09-12T17:17:58.551 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55883a04c0c1] 2024-09-12T17:17:58.551 INFO:tasks.workunit.client.0.smithi016.stderr: 8: radosgw-admin(+0x140f6b8) [0x55883aaa16b8] 2024-09-12T17:17:58.551 INFO:tasks.workunit.client.0.smithi016.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55883a05e18d] 2024-09-12T17:17:58.551 INFO:tasks.workunit.client.0.smithi016.stderr: 10: main() 2024-09-12T17:17:58.551 INFO:tasks.workunit.client.0.smithi016.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2c8ee61d90] 2024-09-12T17:17:58.551 INFO:tasks.workunit.client.0.smithi016.stderr: 12: __libc_start_main() 2024-09-12T17:17:58.551 INFO:tasks.workunit.client.0.smithi016.stderr: 13: _start() 2024-09-12T17:17:58.551 INFO:tasks.workunit.client.0.smithi016.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:17:58.551 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:58.551 INFO:tasks.workunit.client.0.smithi016.stderr:--- logging levels --- 2024-09-12T17:17:58.551 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 none 2024-09-12T17:17:58.551 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 lockdep 2024-09-12T17:17:58.551 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 context 2024-09-12T17:17:58.552 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 crush 2024-09-12T17:17:58.552 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds 2024-09-12T17:17:58.552 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_balancer 2024-09-12T17:17:58.552 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_locker 2024-09-12T17:17:58.552 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log 2024-09-12T17:17:58.552 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log_expire 2024-09-12T17:17:58.552 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_migrator 2024-09-12T17:17:58.552 INFO:tasks.workunit.client.0.smithi016.stderr: 3/ 5 mds_quiesce 2024-09-12T17:17:58.552 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 buffer 2024-09-12T17:17:58.552 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 timer 2024-09-12T17:17:58.552 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 filer 2024-09-12T17:17:58.552 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 striper 2024-09-12T17:17:58.552 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 objecter 2024-09-12T17:17:58.553 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rados 2024-09-12T17:17:58.553 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd 2024-09-12T17:17:58.553 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_mirror 2024-09-12T17:17:58.553 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_replay 2024-09-12T17:17:58.553 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_pwl 2024-09-12T17:17:58.553 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 journaler 2024-09-12T17:17:58.553 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objectcacher 2024-09-12T17:17:58.553 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:17:58.553 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 client 2024-09-12T17:17:58.553 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 osd 2024-09-12T17:17:58.553 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 optracker 2024-09-12T17:17:58.553 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objclass 2024-09-12T17:17:58.553 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 filestore 2024-09-12T17:17:58.554 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 journal 2024-09-12T17:17:58.554 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 ms 2024-09-12T17:17:58.554 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mon 2024-09-12T17:17:58.554 INFO:tasks.workunit.client.0.smithi016.stderr: 0/10 monc 2024-09-12T17:17:58.554 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 paxos 2024-09-12T17:17:58.554 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 tp 2024-09-12T17:17:58.554 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 auth 2024-09-12T17:17:58.554 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 crypto 2024-09-12T17:17:58.554 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 finisher 2024-09-12T17:17:58.554 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 reserver 2024-09-12T17:17:58.554 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 heartbeatmap 2024-09-12T17:17:58.554 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 perfcounter 2024-09-12T17:17:58.554 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw 2024-09-12T17:17:58.554 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_sync 2024-09-12T17:17:58.555 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_datacache 2024-09-12T17:17:58.555 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_access 2024-09-12T17:17:58.555 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:17:58.555 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_flight 2024-09-12T17:17:58.555 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:17:58.555 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw_notification 2024-09-12T17:17:58.555 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 javaclient 2024-09-12T17:17:58.555 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 asok 2024-09-12T17:17:58.555 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 throttle 2024-09-12T17:17:58.555 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 refs 2024-09-12T17:17:58.555 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 compressor 2024-09-12T17:17:58.555 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluestore 2024-09-12T17:17:58.555 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluefs 2024-09-12T17:17:58.555 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 bdev 2024-09-12T17:17:58.556 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 kstore 2024-09-12T17:17:58.556 INFO:tasks.workunit.client.0.smithi016.stderr: 4/ 5 rocksdb 2024-09-12T17:17:58.556 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 fuse 2024-09-12T17:17:58.556 INFO:tasks.workunit.client.0.smithi016.stderr: 2/ 5 mgr 2024-09-12T17:17:58.556 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mgrc 2024-09-12T17:17:58.556 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 dpdk 2024-09-12T17:17:58.556 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 eventtrace 2024-09-12T17:17:58.556 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 prioritycache 2024-09-12T17:17:58.556 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 test 2024-09-12T17:17:58.556 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:17:58.556 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephsqlite 2024-09-12T17:17:58.556 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:17:58.557 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore 2024-09-12T17:17:58.557 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_onode 2024-09-12T17:17:58.557 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_odata 2024-09-12T17:17:58.557 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_omap 2024-09-12T17:17:58.557 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_tm 2024-09-12T17:17:58.557 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_t 2024-09-12T17:17:58.557 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:17:58.557 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_epm 2024-09-12T17:17:58.557 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_lba 2024-09-12T17:17:58.557 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:17:58.557 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cache 2024-09-12T17:17:58.557 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_journal 2024-09-12T17:17:58.557 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_device 2024-09-12T17:17:58.558 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_backref 2024-09-12T17:17:58.558 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 alienstore 2024-09-12T17:17:58.558 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mclock 2024-09-12T17:17:58.558 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cyanstore 2024-09-12T17:17:58.558 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 ceph_exporter 2024-09-12T17:17:58.558 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 memstore 2024-09-12T17:17:58.558 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 trace 2024-09-12T17:17:58.558 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 ceph_dedup 2024-09-12T17:17:58.558 INFO:tasks.workunit.client.0.smithi016.stderr: -2/-2 (syslog threshold) 2024-09-12T17:17:58.558 INFO:tasks.workunit.client.0.smithi016.stderr: 99/99 (stderr threshold) 2024-09-12T17:17:58.558 INFO:tasks.workunit.client.0.smithi016.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:17:58.558 INFO:tasks.workunit.client.0.smithi016.stderr: 7f2ab97fa640 / http_manager 2024-09-12T17:17:58.558 INFO:tasks.workunit.client.0.smithi016.stderr: 7f2abb7fe640 / http_manager 2024-09-12T17:17:58.558 INFO:tasks.workunit.client.0.smithi016.stderr: 7f2b40fe1640 / rgw_dt_lg_renew 2024-09-12T17:17:58.559 INFO:tasks.workunit.client.0.smithi016.stderr: 7f2b5bfff640 / ms_dispatch 2024-09-12T17:17:58.559 INFO:tasks.workunit.client.0.smithi016.stderr: 7f2b6dffb640 / io_context_pool 2024-09-12T17:17:58.559 INFO:tasks.workunit.client.0.smithi016.stderr: 7f2b6ffff640 / ms_dispatch 2024-09-12T17:17:58.559 INFO:tasks.workunit.client.0.smithi016.stderr: 7f2b76e05640 / ms_dispatch 2024-09-12T17:17:58.559 INFO:tasks.workunit.client.0.smithi016.stderr: 7f2b78608640 / io_context_pool 2024-09-12T17:17:58.559 INFO:tasks.workunit.client.0.smithi016.stderr: 7f2c89a26640 / msgr-worker-2 2024-09-12T17:17:58.559 INFO:tasks.workunit.client.0.smithi016.stderr: 7f2c8a227640 / msgr-worker-1 2024-09-12T17:17:58.559 INFO:tasks.workunit.client.0.smithi016.stderr: 7f2c8aa28640 / msgr-worker-0 2024-09-12T17:17:58.559 INFO:tasks.workunit.client.0.smithi016.stderr: 7f2c8b229640 / io_context_pool 2024-09-12T17:17:58.559 INFO:tasks.workunit.client.0.smithi016.stderr: 7f2c8c7219c0 / radosgw-admin 2024-09-12T17:17:58.559 INFO:tasks.workunit.client.0.smithi016.stderr: max_recent 500 2024-09-12T17:17:58.559 INFO:tasks.workunit.client.0.smithi016.stderr: max_new 1000 2024-09-12T17:17:58.559 INFO:tasks.workunit.client.0.smithi016.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:17:58.420596Z_040b5fb7-40a1-4c36-9081-12de258114c4/log 2024-09-12T17:17:58.559 INFO:tasks.workunit.client.0.smithi016.stderr:--- end dump of recent events --- 2024-09-12T17:17:58.561 INFO:tasks.workunit.client.0.smithi016.stderr:Aborted 2024-09-12T17:17:58.561 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T17:17:58.561 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:17:58.561 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:17:58.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.512+0000 7fb0200829c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.516+0000 7fb0200829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:58.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.516+0000 7fb0200829c0 20 realm 2024-09-12T17:17:58.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.516+0000 7fb0200829c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.516+0000 7fb0200829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:58.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.516+0000 7fb0200829c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:17:58.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.516+0000 7fb0200829c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.516+0000 7fb0200829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:58.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.516+0000 7fb0200829c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.516+0000 7fb0200829c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:58.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.516+0000 7fb0200829c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.520+0000 7fb0200829c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:17:58.563 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.520+0000 7fb0200829c0 20 searching for the correct realm 2024-09-12T17:17:58.563 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.520+0000 7fb017fff640 0 -- 172.21.15.16:0/3218917915 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7fb01001c400 msgr2=0x7fb01001c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:58.734 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.732+0000 7fb01e389640 0 -- 172.21.15.16:0/3218917915 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fb0080e9040 msgr2=0x7fb0080ea440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:58.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.752+0000 7fb0200829c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:17:58.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.752+0000 7fb0200829c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:17:58.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.752+0000 7fb0200829c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:17:58.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.752+0000 7fb0200829c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:17:58.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.752+0000 7fb0200829c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:17:58.754 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.752+0000 7fb0200829c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:17:58.754 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.752+0000 7fb0200829c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.754 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.752+0000 7fb0200829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:58.754 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.752+0000 7fb0200829c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.754 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.752+0000 7fb0200829c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:58.755 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.752+0000 7fb0200829c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.755 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.752+0000 7fb0200829c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:17:58.755 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.752+0000 7fb0200829c0 20 zone default found 2024-09-12T17:17:58.755 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.752+0000 7fb0200829c0 4 Realm: () 2024-09-12T17:17:58.756 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.752+0000 7fb0200829c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:17:58.756 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.752+0000 7fb0200829c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:17:58.756 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.752+0000 7fb0200829c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:17:58.756 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.752+0000 7fb0200829c0 20 zonegroup default 2024-09-12T17:17:58.756 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.752+0000 7fb0200829c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.756 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.756+0000 7fb0200829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:58.757 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.756+0000 7fb0200829c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.757 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.756+0000 7fb0200829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:58.757 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.756+0000 7fb0200829c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.758 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.756+0000 7fb0200829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:58.758 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.756+0000 7fb0200829c0 20 started sync module instance, tier type = 2024-09-12T17:17:58.758 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.756+0000 7fb0200829c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:17:58.783 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.780+0000 7fb0200829c0 20 add_watcher() i=0 2024-09-12T17:17:58.783 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.780+0000 7fb0200829c0 20 add_watcher() i=1 2024-09-12T17:17:58.784 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.780+0000 7fb0200829c0 20 add_watcher() i=2 2024-09-12T17:17:58.784 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.780+0000 7fb0200829c0 20 add_watcher() i=3 2024-09-12T17:17:58.784 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.780+0000 7fb0200829c0 20 add_watcher() i=4 2024-09-12T17:17:58.784 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.780+0000 7fb0200829c0 20 add_watcher() i=5 2024-09-12T17:17:58.784 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.780+0000 7fb0200829c0 20 add_watcher() i=6 2024-09-12T17:17:58.786 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.784+0000 7fb0200829c0 20 add_watcher() i=7 2024-09-12T17:17:58.786 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.784+0000 7fb0200829c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:17:58.790 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.788+0000 7faecf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:58.791 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.788+0000 7fb0200829c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:17:58.791 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.788+0000 7fb0200829c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:17:58.791 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.788+0000 7fb0200829c0 5 note: GC not initialized 2024-09-12T17:17:58.792 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.788+0000 7faece7fc640 20 reqs_thread_entry: start 2024-09-12T17:17:58.792 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.788+0000 7fb0200829c0 20 init_complete bucket index max shards: 1 2024-09-12T17:17:58.792 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.788+0000 7fb0200829c0 20 Filter name: none 2024-09-12T17:17:58.792 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.792+0000 7fae3ffff640 20 reqs_thread_entry: start 2024-09-12T17:17:58.792 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.792+0000 7fb0200829c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.793 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.792+0000 7fb0200829c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:17:58.793 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.792+0000 7fb0200829c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.794 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.792+0000 7fb0200829c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:17:58.794 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.792+0000 7fb0200829c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:17:58.794 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.792+0000 7fb0200829c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.795 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.792+0000 7fb0200829c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:17:58.795 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.792+0000 7fb0200829c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.796 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.796+0000 7fb0200829c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:17:58.796 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.796+0000 7fb0200829c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:17:58.799 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.796+0000 7faecf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:58.804 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.804+0000 7fb0200829c0 20 remove_watcher() i=0 2024-09-12T17:17:58.804 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.804+0000 7fb0200829c0 2 removed watcher, disabling cache 2024-09-12T17:17:58.806 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.804+0000 7fb0200829c0 20 remove_watcher() i=1 2024-09-12T17:17:58.808 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.808+0000 7fb0200829c0 20 remove_watcher() i=2 2024-09-12T17:17:58.811 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.808+0000 7fb0200829c0 20 remove_watcher() i=3 2024-09-12T17:17:58.813 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.812+0000 7fb0200829c0 20 remove_watcher() i=4 2024-09-12T17:17:58.814 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.812+0000 7fb0200829c0 20 remove_watcher() i=5 2024-09-12T17:17:58.816 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.816+0000 7fb0200829c0 20 remove_watcher() i=6 2024-09-12T17:17:58.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.816+0000 7fb0200829c0 20 remove_watcher() i=7 2024-09-12T17:17:58.833 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:58.833 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:17:58.833 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: abort-at-set-target-layout id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:17:58.833 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:17:58.889 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:17:58.926 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:17:58.926 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:17:58.974 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.972+0000 7f32344139c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.976 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.976+0000 7f32344139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:58.977 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.976+0000 7f32344139c0 20 realm 2024-09-12T17:17:58.977 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.976+0000 7f32344139c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.977 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.976+0000 7f32344139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:58.977 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.976+0000 7f32344139c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:17:58.977 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.976+0000 7f32344139c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.977 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.976+0000 7f32344139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:58.977 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.976+0000 7f32344139c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.978 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.976+0000 7f32344139c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:58.979 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.976+0000 7f32344139c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:58.980 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.980+0000 7f32344139c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:17:58.981 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.980+0000 7f32344139c0 20 searching for the correct realm 2024-09-12T17:17:58.984 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.984+0000 7f323271a640 0 -- 172.21.15.16:0/3755216195 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f321c046940 msgr2=0x7f321c0233e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:58.991 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:58.988+0000 7f3231718640 0 -- 172.21.15.16:0/3755216195 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f322c106bb0 msgr2=0x7f322c0fea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:17:59.207 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.204+0000 7f32344139c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:17:59.207 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.204+0000 7f32344139c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:17:59.208 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.204+0000 7f32344139c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:17:59.208 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.204+0000 7f32344139c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:17:59.208 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.204+0000 7f32344139c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:17:59.208 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.204+0000 7f32344139c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:17:59.208 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.204+0000 7f32344139c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:59.208 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.204+0000 7f32344139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:59.208 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.204+0000 7f32344139c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:59.208 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.208+0000 7f32344139c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:17:59.209 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.208+0000 7f32344139c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:59.210 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.208+0000 7f32344139c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:17:59.210 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.208+0000 7f32344139c0 20 zone default found 2024-09-12T17:17:59.210 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.208+0000 7f32344139c0 4 Realm: () 2024-09-12T17:17:59.210 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.208+0000 7f32344139c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:17:59.210 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.208+0000 7f32344139c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:17:59.210 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.208+0000 7f32344139c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:17:59.211 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.208+0000 7f32344139c0 20 zonegroup default 2024-09-12T17:17:59.211 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.208+0000 7f32344139c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:59.211 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.208+0000 7f32344139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:59.211 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.208+0000 7f32344139c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:59.211 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.208+0000 7f32344139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:59.211 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.208+0000 7f32344139c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:59.212 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.212+0000 7f32344139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:17:59.212 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.212+0000 7f32344139c0 20 started sync module instance, tier type = 2024-09-12T17:17:59.212 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.212+0000 7f32344139c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:17:59.236 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.236+0000 7f32344139c0 20 add_watcher() i=0 2024-09-12T17:17:59.236 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.236+0000 7f32344139c0 20 add_watcher() i=1 2024-09-12T17:17:59.236 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.236+0000 7f32344139c0 20 add_watcher() i=2 2024-09-12T17:17:59.237 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.236+0000 7f32344139c0 20 add_watcher() i=3 2024-09-12T17:17:59.237 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.236+0000 7f32344139c0 20 add_watcher() i=4 2024-09-12T17:17:59.237 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.236+0000 7f32344139c0 20 add_watcher() i=5 2024-09-12T17:17:59.237 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.236+0000 7f32344139c0 20 add_watcher() i=6 2024-09-12T17:17:59.239 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.236+0000 7f32344139c0 20 add_watcher() i=7 2024-09-12T17:17:59.239 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.236+0000 7f32344139c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:17:59.243 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.240+0000 7f30e37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:59.244 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.244+0000 7f32344139c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:17:59.244 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.244+0000 7f32344139c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:17:59.245 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.244+0000 7f32344139c0 5 note: GC not initialized 2024-09-12T17:17:59.245 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.244+0000 7f30e27fc640 20 reqs_thread_entry: start 2024-09-12T17:17:59.245 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.244+0000 7f32344139c0 20 init_complete bucket index max shards: 1 2024-09-12T17:17:59.245 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.244+0000 7f32344139c0 20 Filter name: none 2024-09-12T17:17:59.246 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.244+0000 7f3053fff640 20 reqs_thread_entry: start 2024-09-12T17:17:59.246 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.244+0000 7f32344139c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T17:17:59.246 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.244+0000 7f32344139c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:59.247 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.244+0000 7f32344139c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:17:59.247 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.244+0000 7f32344139c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T17:17:59.247 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.244+0000 7f32344139c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T17:17:59.247 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.244+0000 7f32344139c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24 : miss 2024-09-12T17:17:59.247 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.244+0000 7f32344139c0 20 rados->read ofs=0 len=0 2024-09-12T17:17:59.248 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.248+0000 7f32344139c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:17:59.248 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.248+0000 7f32344139c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24 info.flags=0x17 2024-09-12T17:17:59.248 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.248+0000 7f32344139c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24 to cache LRU end 2024-09-12T17:17:59.248 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.248+0000 7f32344139c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:17:59.248 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.248+0000 7f32344139c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:17:59.248 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.248+0000 7f32344139c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24 2024-09-12T17:17:59.251 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.248+0000 7f32344139c0 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24 to be held by another RGW process; skipping for now 2024-09-12T17:17:59.252 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.252+0000 7f30e37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:17:59.258 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.256+0000 7f32344139c0 20 remove_watcher() i=0 2024-09-12T17:17:59.258 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.256+0000 7f32344139c0 2 removed watcher, disabling cache 2024-09-12T17:17:59.260 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.260+0000 7f32344139c0 20 remove_watcher() i=1 2024-09-12T17:17:59.263 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.260+0000 7f32344139c0 20 remove_watcher() i=2 2024-09-12T17:17:59.265 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.264+0000 7f32344139c0 20 remove_watcher() i=3 2024-09-12T17:17:59.268 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.264+0000 7f32344139c0 20 remove_watcher() i=4 2024-09-12T17:17:59.269 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.268+0000 7f32344139c0 20 remove_watcher() i=5 2024-09-12T17:17:59.271 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.268+0000 7f32344139c0 20 remove_watcher() i=6 2024-09-12T17:17:59.272 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:17:59.272+0000 7f32344139c0 20 remove_watcher() i=7 2024-09-12T17:17:59.291 INFO:tasks.workunit.client.0.smithi016.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:18:29.318 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:18:29.355 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:18:29.355 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:18:29.405 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.404+0000 7f628ac259c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:29.407 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.404+0000 7f628ac259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:29.407 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.404+0000 7f628ac259c0 20 realm 2024-09-12T17:18:29.407 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.404+0000 7f628ac259c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:29.407 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.404+0000 7f628ac259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:29.407 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.404+0000 7f628ac259c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:18:29.407 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.404+0000 7f628ac259c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:29.407 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.404+0000 7f628ac259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:29.407 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.404+0000 7f628ac259c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:29.409 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.408+0000 7f628ac259c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:18:29.409 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.408+0000 7f628ac259c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:29.411 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.408+0000 7f628ac259c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:18:29.411 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.408+0000 7f628ac259c0 20 searching for the correct realm 2024-09-12T17:18:29.414 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.412+0000 7f6288f2c640 0 -- 172.21.15.16:0/1745244137 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f627c008040 msgr2=0x7f627c038910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:18:29.630 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.628+0000 7f6287f2a640 0 -- 172.21.15.16:0/1745244137 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f628010d070 msgr2=0x7f62801119b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:18:29.848 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.844+0000 7f628ac259c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:18:29.848 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.844+0000 7f628ac259c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:18:29.848 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.844+0000 7f628ac259c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:18:29.848 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.844+0000 7f628ac259c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:18:29.848 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.844+0000 7f628ac259c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:18:29.848 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.844+0000 7f628ac259c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:18:29.848 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.844+0000 7f628ac259c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:29.849 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.848+0000 7f628ac259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:29.849 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.848+0000 7f628ac259c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:29.849 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.848+0000 7f628ac259c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:18:29.849 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.848+0000 7f628ac259c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:29.851 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.848+0000 7f628ac259c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:18:29.851 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.848+0000 7f628ac259c0 20 zone default found 2024-09-12T17:18:29.851 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.848+0000 7f628ac259c0 4 Realm: () 2024-09-12T17:18:29.851 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.848+0000 7f628ac259c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:18:29.851 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.848+0000 7f628ac259c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:18:29.851 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.848+0000 7f628ac259c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:18:29.851 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.848+0000 7f628ac259c0 20 zonegroup default 2024-09-12T17:18:29.851 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.848+0000 7f628ac259c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:29.852 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.848+0000 7f628ac259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:29.852 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.848+0000 7f628ac259c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:29.852 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.852+0000 7f628ac259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:29.852 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.852+0000 7f628ac259c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:29.853 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.852+0000 7f628ac259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:29.853 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.852+0000 7f628ac259c0 20 started sync module instance, tier type = 2024-09-12T17:18:29.853 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.852+0000 7f628ac259c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:18:29.876 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.872+0000 7f628ac259c0 20 add_watcher() i=0 2024-09-12T17:18:29.876 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.872+0000 7f628ac259c0 20 add_watcher() i=1 2024-09-12T17:18:29.876 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.872+0000 7f628ac259c0 20 add_watcher() i=2 2024-09-12T17:18:29.876 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.872+0000 7f628ac259c0 20 add_watcher() i=3 2024-09-12T17:18:29.876 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.872+0000 7f628ac259c0 20 add_watcher() i=4 2024-09-12T17:18:29.877 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.872+0000 7f628ac259c0 20 add_watcher() i=5 2024-09-12T17:18:29.877 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.872+0000 7f628ac259c0 20 add_watcher() i=6 2024-09-12T17:18:29.878 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.876+0000 7f628ac259c0 20 add_watcher() i=7 2024-09-12T17:18:29.878 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.876+0000 7f628ac259c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:18:29.882 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.880+0000 7f613efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:18:29.882 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.880+0000 7f628ac259c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:18:29.882 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.880+0000 7f628ac259c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:18:29.883 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.880+0000 7f628ac259c0 5 note: GC not initialized 2024-09-12T17:18:29.883 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.880+0000 7f613dfdb640 20 reqs_thread_entry: start 2024-09-12T17:18:29.883 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.880+0000 7f628ac259c0 20 init_complete bucket index max shards: 1 2024-09-12T17:18:29.884 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.880+0000 7f628ac259c0 20 Filter name: none 2024-09-12T17:18:29.884 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.880+0000 7f60af7fe640 20 reqs_thread_entry: start 2024-09-12T17:18:29.884 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.880+0000 7f628ac259c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T17:18:29.884 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.880+0000 7f628ac259c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:29.884 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.884+0000 7f628ac259c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:18:29.884 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.884+0000 7f628ac259c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T17:18:29.884 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.884+0000 7f628ac259c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T17:18:29.885 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.884+0000 7f628ac259c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24 : miss 2024-09-12T17:18:29.885 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.884+0000 7f628ac259c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:29.886 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.884+0000 7f628ac259c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:18:29.886 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.884+0000 7f628ac259c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24 info.flags=0x17 2024-09-12T17:18:29.886 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.884+0000 7f628ac259c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24 to cache LRU end 2024-09-12T17:18:29.886 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.884+0000 7f628ac259c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:18:29.886 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.884+0000 7f628ac259c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:18:29.886 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.884+0000 7f628ac259c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24 2024-09-12T17:18:29.894 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.892+0000 7f628ac259c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24 info.flags=0x17 2024-09-12T17:18:29.894 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.892+0000 7f628ac259c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24 to cache LRU end 2024-09-12T17:18:29.895 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.892+0000 7f628ac259c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:18:29.895 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.892+0000 7f628ac259c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24, ofs0, ns] 2024-09-12T17:18:29.895 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.892+0000 7f615effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431565 cookie 94774066053312 notifier 6630 bl.length()=925 2024-09-12T17:18:29.895 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.892+0000 7f615effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24 info.flags=0x17 2024-09-12T17:18:29.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.892+0000 7f615effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24 to cache LRU end 2024-09-12T17:18:29.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.892+0000 7f615effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:18:29.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.892+0000 7f628ac259c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24]): orig_sources= new_sources= 2024-09-12T17:18:29.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.892+0000 7f628ac259c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24]): potential sources added=[] removed=[] 2024-09-12T17:18:29.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.892+0000 7f628ac259c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24]): orig_dests= new_dests= 2024-09-12T17:18:29.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.892+0000 7f628ac259c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24]): potential dests added=[] removed=[] 2024-09-12T17:18:29.901 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.900+0000 7f628ac259c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24.1.0 2024-09-12T17:18:29.901 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.900+0000 7f628ac259c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24.1.0 2024-09-12T17:18:29.901 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.900+0000 7f628ac259c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24.1.1 2024-09-12T17:18:29.901 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.900+0000 7f628ac259c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24.1.1 2024-09-12T17:18:29.901 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.900+0000 7f628ac259c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24.0 2024-09-12T17:18:29.906 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.904+0000 7f628ac259c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24 : hit (requested=0x17, cached=0x17) 2024-09-12T17:18:29.907 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.904+0000 7f628ac259c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24 2024-09-12T17:18:29.909 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.908+0000 7f628ac259c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24 info.flags=0x17 2024-09-12T17:18:29.909 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.908+0000 7f628ac259c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24 to cache LRU end 2024-09-12T17:18:29.910 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.908+0000 7f628ac259c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:18:29.910 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.908+0000 7f628ac259c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24, ofs0, ns] 2024-09-12T17:18:29.910 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.908+0000 7f615effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431566 cookie 94774066053312 notifier 6630 bl.length()=925 2024-09-12T17:18:29.910 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.908+0000 7f615effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24 info.flags=0x17 2024-09-12T17:18:29.910 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.908+0000 7f615effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24 to cache LRU end 2024-09-12T17:18:29.911 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.908+0000 7f615effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:18:29.911 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.908+0000 7f628ac259c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24]): orig_sources= new_sources= 2024-09-12T17:18:29.912 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.908+0000 7f628ac259c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24]): potential sources added=[] removed=[] 2024-09-12T17:18:29.912 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.908+0000 7f628ac259c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24]): orig_dests= new_dests= 2024-09-12T17:18:29.912 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.908+0000 7f628ac259c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24]): potential dests added=[] removed=[] 2024-09-12T17:18:29.913 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.912+0000 7f628ac259c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24.0 2024-09-12T17:18:29.914 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.912+0000 7f628ac259c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24 : hit (requested=0x17, cached=0x17) 2024-09-12T17:18:29.914 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.912+0000 7f628ac259c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24 2024-09-12T17:18:29.917 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.916+0000 7f628ac259c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24 info.flags=0x17 2024-09-12T17:18:29.918 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.916+0000 7f628ac259c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24 to cache LRU end 2024-09-12T17:18:29.918 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.916+0000 7f628ac259c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:18:29.918 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.916+0000 7f628ac259c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24, ofs0, ns] 2024-09-12T17:18:29.918 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.916+0000 7f615effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431567 cookie 94774066053312 notifier 6630 bl.length()=893 2024-09-12T17:18:29.918 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.916+0000 7f615effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24 info.flags=0x17 2024-09-12T17:18:29.918 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.916+0000 7f615effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24 to cache LRU end 2024-09-12T17:18:29.918 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.916+0000 7f615effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:18:29.919 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.916+0000 7f628ac259c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24]): orig_sources= new_sources= 2024-09-12T17:18:29.919 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.916+0000 7f628ac259c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24]): potential sources added=[] removed=[] 2024-09-12T17:18:29.919 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.916+0000 7f628ac259c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24]): orig_dests= new_dests= 2024-09-12T17:18:29.919 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.916+0000 7f628ac259c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24]): potential dests added=[] removed=[] 2024-09-12T17:18:29.921 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.920+0000 7f628ac259c0 1 execute INFO: reshard of bucket "abort-at-set-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T17:18:29.925 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.924+0000 7f613efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:18:29.930 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.928+0000 7f628ac259c0 20 remove_watcher() i=0 2024-09-12T17:18:29.930 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.928+0000 7f628ac259c0 2 removed watcher, disabling cache 2024-09-12T17:18:29.932 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.932+0000 7f628ac259c0 20 remove_watcher() i=1 2024-09-12T17:18:29.934 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.932+0000 7f628ac259c0 20 remove_watcher() i=2 2024-09-12T17:18:29.937 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.936+0000 7f628ac259c0 20 remove_watcher() i=3 2024-09-12T17:18:29.939 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.936+0000 7f628ac259c0 20 remove_watcher() i=4 2024-09-12T17:18:29.941 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.940+0000 7f628ac259c0 20 remove_watcher() i=5 2024-09-12T17:18:29.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.940+0000 7f628ac259c0 20 remove_watcher() i=6 2024-09-12T17:18:29.945 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:29.944+0000 7f628ac259c0 20 remove_watcher() i=7 2024-09-12T17:18:29.962 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T17:18:29.989 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:18:29.989 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:18:30.253 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.252+0000 7f7cbbc089c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:30.255 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.252+0000 7f7cbbc089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:30.255 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.252+0000 7f7cbbc089c0 20 realm 2024-09-12T17:18:30.255 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.252+0000 7f7cbbc089c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:30.255 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.252+0000 7f7cbbc089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:30.255 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.252+0000 7f7cbbc089c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:18:30.255 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.252+0000 7f7cbbc089c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:30.255 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.252+0000 7f7cbbc089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:30.255 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.252+0000 7f7cbbc089c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:30.257 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.256+0000 7f7cbbc089c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:18:30.257 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.256+0000 7f7cbbc089c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:30.258 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.256+0000 7f7cbbc089c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:18:30.258 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.256+0000 7f7cbbc089c0 20 searching for the correct realm 2024-09-12T17:18:30.262 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.260+0000 7f7cb9f0f640 0 -- 172.21.15.16:0/608022481 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f7cb000e070 msgr2=0x7f7cb00810c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:18:30.478 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.476+0000 7f7cb8f0d640 0 -- 172.21.15.16:0/608022481 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f7cb4126940 msgr2=0x7f7cb4124520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:18:30.696 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.692+0000 7f7cbbc089c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:18:30.696 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.692+0000 7f7cbbc089c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:18:30.696 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.692+0000 7f7cbbc089c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:18:30.696 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.692+0000 7f7cbbc089c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:18:30.696 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.692+0000 7f7cbbc089c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:18:30.696 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.692+0000 7f7cbbc089c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:18:30.696 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.692+0000 7f7cbbc089c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:30.697 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.696+0000 7f7cbbc089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:30.697 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.696+0000 7f7cbbc089c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:30.697 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.696+0000 7f7cbbc089c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:18:30.697 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.696+0000 7f7cbbc089c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:30.698 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.696+0000 7f7cbbc089c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:18:30.698 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.696+0000 7f7cbbc089c0 20 zone default found 2024-09-12T17:18:30.698 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.696+0000 7f7cbbc089c0 4 Realm: () 2024-09-12T17:18:30.698 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.696+0000 7f7cbbc089c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:18:30.698 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.696+0000 7f7cbbc089c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:18:30.699 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.696+0000 7f7cbbc089c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:18:30.699 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.696+0000 7f7cbbc089c0 20 zonegroup default 2024-09-12T17:18:30.699 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.696+0000 7f7cbbc089c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:30.699 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.696+0000 7f7cbbc089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:30.699 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.696+0000 7f7cbbc089c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:30.700 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.696+0000 7f7cbbc089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:30.700 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.696+0000 7f7cbbc089c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:30.701 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.700+0000 7f7cbbc089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:30.701 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.700+0000 7f7cbbc089c0 20 started sync module instance, tier type = 2024-09-12T17:18:30.701 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.700+0000 7f7cbbc089c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:18:30.729 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.724+0000 7f7cbbc089c0 20 add_watcher() i=0 2024-09-12T17:18:30.730 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.724+0000 7f7cbbc089c0 20 add_watcher() i=1 2024-09-12T17:18:30.730 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.724+0000 7f7cbbc089c0 20 add_watcher() i=2 2024-09-12T17:18:30.730 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.724+0000 7f7cbbc089c0 20 add_watcher() i=3 2024-09-12T17:18:30.730 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.724+0000 7f7cbbc089c0 20 add_watcher() i=4 2024-09-12T17:18:30.730 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.724+0000 7f7cbbc089c0 20 add_watcher() i=5 2024-09-12T17:18:30.730 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.724+0000 7f7cbbc089c0 20 add_watcher() i=6 2024-09-12T17:18:30.730 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.728+0000 7f7cbbc089c0 20 add_watcher() i=7 2024-09-12T17:18:30.730 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.728+0000 7f7cbbc089c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:18:30.733 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.732+0000 7f7b6f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:18:30.734 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.732+0000 7f7cbbc089c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:18:30.734 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.732+0000 7f7cbbc089c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:18:30.734 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.732+0000 7f7cbbc089c0 5 note: GC not initialized 2024-09-12T17:18:30.735 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.732+0000 7f7b6e7e4640 20 reqs_thread_entry: start 2024-09-12T17:18:30.735 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.732+0000 7f7cbbc089c0 20 init_complete bucket index max shards: 1 2024-09-12T17:18:30.735 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.732+0000 7f7cbbc089c0 20 Filter name: none 2024-09-12T17:18:30.735 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.732+0000 7f7adffff640 20 reqs_thread_entry: start 2024-09-12T17:18:30.735 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.732+0000 7f7cbbc089c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:30.736 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.736+0000 7f7cbbc089c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:18:30.737 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.736+0000 7f7cbbc089c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:30.738 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.736+0000 7f7cbbc089c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:18:30.738 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.736+0000 7f7cbbc089c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:18:30.738 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.736+0000 7f7cbbc089c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:30.739 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.736+0000 7f7cbbc089c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:18:30.739 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.736+0000 7f7cbbc089c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:30.740 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.740+0000 7f7cbbc089c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:18:30.740 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.740+0000 7f7cbbc089c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:18:30.743 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.740+0000 7f7b6f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:18:30.748 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.748+0000 7f7cbbc089c0 20 remove_watcher() i=0 2024-09-12T17:18:30.749 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.748+0000 7f7cbbc089c0 2 removed watcher, disabling cache 2024-09-12T17:18:30.751 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.748+0000 7f7cbbc089c0 20 remove_watcher() i=1 2024-09-12T17:18:30.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.752+0000 7f7cbbc089c0 20 remove_watcher() i=2 2024-09-12T17:18:30.756 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.752+0000 7f7cbbc089c0 20 remove_watcher() i=3 2024-09-12T17:18:30.758 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.756+0000 7f7cbbc089c0 20 remove_watcher() i=4 2024-09-12T17:18:30.759 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.756+0000 7f7cbbc089c0 20 remove_watcher() i=5 2024-09-12T17:18:30.761 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.760+0000 7f7cbbc089c0 20 remove_watcher() i=6 2024-09-12T17:18:30.762 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:30.760+0000 7f7cbbc089c0 20 remove_watcher() i=7 2024-09-12T17:18:30.781 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:30.781 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:18:30.781 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: abort-at-set-target-layout id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:18:30.781 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:30.869 INFO:tasks.workunit.client.0.smithi016.stderr:TEST: reshard bucket with EIO injected at trim_reshard_log_entries 2024-09-12T17:18:30.869 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:31.335 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T17:18:31.368 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:18:31.368 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:18:31.416 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.412+0000 7fc23e7d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:31.418 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.416+0000 7fc23e7d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:31.418 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.416+0000 7fc23e7d09c0 20 realm 2024-09-12T17:18:31.418 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.416+0000 7fc23e7d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:31.418 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.416+0000 7fc23e7d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:31.418 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.416+0000 7fc23e7d09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:18:31.419 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.416+0000 7fc23e7d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:31.419 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.416+0000 7fc23e7d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:31.419 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.416+0000 7fc23e7d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:31.420 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.420+0000 7fc23e7d09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:18:31.420 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.420+0000 7fc23e7d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:31.422 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.420+0000 7fc23e7d09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:18:31.422 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.420+0000 7fc23e7d09c0 20 searching for the correct realm 2024-09-12T17:18:31.425 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.424+0000 7fc23cad7640 0 -- 172.21.15.16:0/3785496078 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fc2300dc070 msgr2=0x7fc2300ec910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:18:31.432 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.432+0000 7fc23bad5640 0 -- 172.21.15.16:0/3785496078 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fc234017020 msgr2=0x7fc23409b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:18:31.652 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.648+0000 7fc23e7d09c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:18:31.653 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.648+0000 7fc23e7d09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:18:31.653 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.648+0000 7fc23e7d09c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:18:31.653 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.648+0000 7fc23e7d09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:18:31.653 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.648+0000 7fc23e7d09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:18:31.653 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.648+0000 7fc23e7d09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:18:31.653 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.648+0000 7fc23e7d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:31.653 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.652+0000 7fc23e7d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:31.653 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.652+0000 7fc23e7d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:31.653 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.652+0000 7fc23e7d09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:18:31.654 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.652+0000 7fc23e7d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:31.654 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.652+0000 7fc23e7d09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:18:31.655 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.652+0000 7fc23e7d09c0 20 zone default found 2024-09-12T17:18:31.655 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.652+0000 7fc23e7d09c0 4 Realm: () 2024-09-12T17:18:31.655 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.652+0000 7fc23e7d09c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:18:31.655 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.652+0000 7fc23e7d09c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:18:31.655 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.652+0000 7fc23e7d09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:18:31.655 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.652+0000 7fc23e7d09c0 20 zonegroup default 2024-09-12T17:18:31.655 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.652+0000 7fc23e7d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:31.655 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.652+0000 7fc23e7d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:31.656 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.652+0000 7fc23e7d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:31.656 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.656+0000 7fc23e7d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:31.656 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.656+0000 7fc23e7d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:31.657 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.656+0000 7fc23e7d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:31.657 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.656+0000 7fc23e7d09c0 20 started sync module instance, tier type = 2024-09-12T17:18:31.657 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.656+0000 7fc23e7d09c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:18:31.680 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.676+0000 7fc23e7d09c0 20 add_watcher() i=0 2024-09-12T17:18:31.680 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.676+0000 7fc23e7d09c0 20 add_watcher() i=1 2024-09-12T17:18:31.680 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.676+0000 7fc23e7d09c0 20 add_watcher() i=2 2024-09-12T17:18:31.680 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.676+0000 7fc23e7d09c0 20 add_watcher() i=3 2024-09-12T17:18:31.680 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.676+0000 7fc23e7d09c0 20 add_watcher() i=4 2024-09-12T17:18:31.681 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.676+0000 7fc23e7d09c0 20 add_watcher() i=5 2024-09-12T17:18:31.681 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.680+0000 7fc23e7d09c0 20 add_watcher() i=6 2024-09-12T17:18:31.682 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.680+0000 7fc23e7d09c0 20 add_watcher() i=7 2024-09-12T17:18:31.683 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.680+0000 7fc23e7d09c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:18:31.686 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.684+0000 7fc0f27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:18:31.687 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.684+0000 7fc23e7d09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:18:31.688 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.684+0000 7fc23e7d09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:18:31.688 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.684+0000 7fc23e7d09c0 5 note: GC not initialized 2024-09-12T17:18:31.689 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.684+0000 7fc0f17e2640 20 reqs_thread_entry: start 2024-09-12T17:18:31.689 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.688+0000 7fc23e7d09c0 20 init_complete bucket index max shards: 1 2024-09-12T17:18:31.689 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.688+0000 7fc23e7d09c0 20 Filter name: none 2024-09-12T17:18:31.689 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.688+0000 7fc062ffd640 20 reqs_thread_entry: start 2024-09-12T17:18:31.689 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.688+0000 7fc23e7d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:31.690 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.688+0000 7fc23e7d09c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:18:31.690 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.688+0000 7fc23e7d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:31.691 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.688+0000 7fc23e7d09c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:18:31.692 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.688+0000 7fc23e7d09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:18:31.692 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.688+0000 7fc23e7d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:31.692 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.692+0000 7fc23e7d09c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:18:31.692 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.692+0000 7fc23e7d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:31.693 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.692+0000 7fc23e7d09c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:18:31.694 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.692+0000 7fc23e7d09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:18:31.696 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.696+0000 7fc0f27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:18:31.701 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.700+0000 7fc23e7d09c0 20 remove_watcher() i=0 2024-09-12T17:18:31.701 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.700+0000 7fc23e7d09c0 2 removed watcher, disabling cache 2024-09-12T17:18:31.703 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.700+0000 7fc23e7d09c0 20 remove_watcher() i=1 2024-09-12T17:18:31.706 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.704+0000 7fc23e7d09c0 20 remove_watcher() i=2 2024-09-12T17:18:31.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.708+0000 7fc23e7d09c0 20 remove_watcher() i=3 2024-09-12T17:18:31.711 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.708+0000 7fc23e7d09c0 20 remove_watcher() i=4 2024-09-12T17:18:31.713 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.712+0000 7fc23e7d09c0 20 remove_watcher() i=5 2024-09-12T17:18:31.714 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.712+0000 7fc23e7d09c0 20 remove_watcher() i=6 2024-09-12T17:18:31.716 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.716+0000 7fc23e7d09c0 20 remove_watcher() i=7 2024-09-12T17:18:31.732 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:31.732 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:18:31.732 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: error-at-trim-reshard-log-entries id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:18:31.733 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:31.733 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries 2024-09-12T17:18:31.768 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:18:31.768 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:18:31.813 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.812+0000 7fa6b9eaa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:31.815 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.812+0000 7fa6b9eaa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:31.815 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.812+0000 7fa6b9eaa9c0 20 realm 2024-09-12T17:18:31.815 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.812+0000 7fa6b9eaa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:31.815 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.812+0000 7fa6b9eaa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:31.815 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.812+0000 7fa6b9eaa9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:18:31.815 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.812+0000 7fa6b9eaa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:31.815 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.812+0000 7fa6b9eaa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:31.815 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.812+0000 7fa6b9eaa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:31.817 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.816+0000 7fa6b9eaa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:18:31.817 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.816+0000 7fa6b9eaa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:31.819 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.816+0000 7fa6b9eaa9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:18:31.819 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.816+0000 7fa6b9eaa9c0 20 searching for the correct realm 2024-09-12T17:18:31.823 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.820+0000 7fa6b79b0640 0 -- 172.21.15.16:0/1691605486 >> [v2:172.21.15.16:6824/465585330,v1:172.21.15.16:6825/465585330] conn(0x5620abb12c80 msgr2=0x5620abb15140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:18:31.829 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.828+0000 7fa6b71af640 0 -- 172.21.15.16:0/1691605486 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fa6b008f350 msgr2=0x7fa6b005b290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:18:31.842 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.836+0000 7fa6b9eaa9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:18:31.842 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.836+0000 7fa6b9eaa9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:18:31.842 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.836+0000 7fa6b9eaa9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:18:31.842 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.836+0000 7fa6b9eaa9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:18:31.842 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.836+0000 7fa6b9eaa9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:18:31.842 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.836+0000 7fa6b9eaa9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:18:31.842 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.836+0000 7fa6b9eaa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:31.842 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.836+0000 7fa6b9eaa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:31.842 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.836+0000 7fa6b9eaa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:31.843 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.836+0000 7fa6b9eaa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:18:31.843 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.836+0000 7fa6b9eaa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:31.843 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.836+0000 7fa6b9eaa9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:18:31.843 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.836+0000 7fa6b9eaa9c0 20 zone default found 2024-09-12T17:18:31.843 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.836+0000 7fa6b9eaa9c0 4 Realm: () 2024-09-12T17:18:31.843 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.836+0000 7fa6b9eaa9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:18:31.843 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.836+0000 7fa6b9eaa9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:18:31.843 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.836+0000 7fa6b9eaa9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:18:31.843 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.836+0000 7fa6b9eaa9c0 20 zonegroup default 2024-09-12T17:18:31.843 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.836+0000 7fa6b9eaa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:31.843 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.840+0000 7fa6b9eaa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:31.843 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.840+0000 7fa6b9eaa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:31.843 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.840+0000 7fa6b9eaa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:31.844 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.840+0000 7fa6b9eaa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:31.844 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.840+0000 7fa6b9eaa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:31.844 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.840+0000 7fa6b9eaa9c0 20 started sync module instance, tier type = 2024-09-12T17:18:31.844 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.840+0000 7fa6b9eaa9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:18:31.857 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.856+0000 7fa6b9eaa9c0 20 add_watcher() i=0 2024-09-12T17:18:31.857 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.856+0000 7fa6b9eaa9c0 20 add_watcher() i=1 2024-09-12T17:18:31.857 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.856+0000 7fa6b9eaa9c0 20 add_watcher() i=2 2024-09-12T17:18:31.857 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.856+0000 7fa6b9eaa9c0 20 add_watcher() i=3 2024-09-12T17:18:31.857 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.856+0000 7fa6b9eaa9c0 20 add_watcher() i=4 2024-09-12T17:18:31.858 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.856+0000 7fa6b9eaa9c0 20 add_watcher() i=5 2024-09-12T17:18:31.858 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.856+0000 7fa6b9eaa9c0 20 add_watcher() i=6 2024-09-12T17:18:31.858 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.856+0000 7fa6b9eaa9c0 20 add_watcher() i=7 2024-09-12T17:18:31.858 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.856+0000 7fa6b9eaa9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:18:31.861 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.860+0000 7fa56dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:18:31.862 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.860+0000 7fa6b9eaa9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:18:31.862 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.860+0000 7fa6b9eaa9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:18:31.862 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.860+0000 7fa6b9eaa9c0 5 note: GC not initialized 2024-09-12T17:18:31.862 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.860+0000 7fa56cfe1640 20 reqs_thread_entry: start 2024-09-12T17:18:31.862 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.860+0000 7fa6b9eaa9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:18:31.862 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.860+0000 7fa6b9eaa9c0 20 Filter name: none 2024-09-12T17:18:31.862 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.860+0000 7fa4e67fc640 20 reqs_thread_entry: start 2024-09-12T17:18:31.862 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.860+0000 7fa6b9eaa9c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T17:18:31.862 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.860+0000 7fa6b9eaa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:31.863 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.860+0000 7fa6b9eaa9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:18:31.863 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.860+0000 7fa6b9eaa9c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:18:31.863 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.860+0000 7fa6b9eaa9c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:18:31.863 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.860+0000 7fa6b9eaa9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25 : miss 2024-09-12T17:18:31.863 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.860+0000 7fa6b9eaa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:31.864 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.864+0000 7fa6b9eaa9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:18:31.864 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.864+0000 7fa6b9eaa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25 info.flags=0x17 2024-09-12T17:18:31.864 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.864+0000 7fa6b9eaa9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25 to cache LRU end 2024-09-12T17:18:31.864 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.864+0000 7fa6b9eaa9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:18:31.865 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.864+0000 7fa6b9eaa9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:18:31.865 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.864+0000 7fa6b9eaa9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25 2024-09-12T17:18:31.871 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.868+0000 7fa6b9eaa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25 info.flags=0x17 2024-09-12T17:18:31.872 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.868+0000 7fa6b9eaa9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25 to cache LRU end 2024-09-12T17:18:31.872 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.868+0000 7fa6b9eaa9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:18:31.872 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.868+0000 7fa6b9eaa9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25, ofs0, ns] 2024-09-12T17:18:31.872 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.872+0000 7fa596ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431608 cookie 94698319465696 notifier 6407 bl.length()=939 2024-09-12T17:18:31.873 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.872+0000 7fa596ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25 info.flags=0x17 2024-09-12T17:18:31.873 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.872+0000 7fa596ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25 to cache LRU end 2024-09-12T17:18:31.873 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.872+0000 7fa596ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:18:31.873 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.872+0000 7fa6b9eaa9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25]): orig_sources= new_sources= 2024-09-12T17:18:31.874 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.872+0000 7fa6b9eaa9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25]): potential sources added=[] removed=[] 2024-09-12T17:18:31.874 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.872+0000 7fa6b9eaa9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25]): orig_dests= new_dests= 2024-09-12T17:18:31.874 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.872+0000 7fa6b9eaa9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25]): potential dests added=[] removed=[] 2024-09-12T17:18:31.874 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.872+0000 7fa6b9eaa9c0 -1 Injecting error=-5 at location=trim_reshard_log_entries 2024-09-12T17:18:31.874 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.872+0000 7fa6b9eaa9c0 0 ERROR: init_reshard failed to trim reshard log entries: (5) Input/output error 2024-09-12T17:18:31.876 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.876+0000 7fa56dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:18:31.881 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.880+0000 7fa6b9eaa9c0 20 remove_watcher() i=0 2024-09-12T17:18:31.881 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.880+0000 7fa6b9eaa9c0 2 removed watcher, disabling cache 2024-09-12T17:18:31.883 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.880+0000 7fa6b9eaa9c0 20 remove_watcher() i=1 2024-09-12T17:18:31.885 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.884+0000 7fa6b9eaa9c0 20 remove_watcher() i=2 2024-09-12T17:18:31.887 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.884+0000 7fa6b9eaa9c0 20 remove_watcher() i=3 2024-09-12T17:18:31.889 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.888+0000 7fa6b9eaa9c0 20 remove_watcher() i=4 2024-09-12T17:18:31.890 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.888+0000 7fa6b9eaa9c0 20 remove_watcher() i=5 2024-09-12T17:18:31.892 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.888+0000 7fa6b9eaa9c0 20 remove_watcher() i=6 2024-09-12T17:18:31.893 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.892+0000 7fa6b9eaa9c0 20 remove_watcher() i=7 2024-09-12T17:18:31.907 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T17:18:31.933 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:18:31.933 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:18:31.979 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.976+0000 7f8afca8a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:31.981 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.980+0000 7f8afca8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:31.981 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.980+0000 7f8afca8a9c0 20 realm 2024-09-12T17:18:31.981 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.980+0000 7f8afca8a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:31.982 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.980+0000 7f8afca8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:31.982 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.980+0000 7f8afca8a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:18:31.982 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.980+0000 7f8afca8a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:31.982 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.980+0000 7f8afca8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:31.982 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.980+0000 7f8afca8a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:31.983 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.980+0000 7f8afca8a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:18:31.983 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.980+0000 7f8afca8a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:31.985 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.984+0000 7f8afca8a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:18:31.985 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.984+0000 7f8afca8a9c0 20 searching for the correct realm 2024-09-12T17:18:31.988 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.988+0000 7f8afad91640 0 -- 172.21.15.16:0/1681571670 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f8af0090bb0 msgr2=0x7f8af005c220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:18:31.995 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:31.992+0000 7f8af9d8f640 0 -- 172.21.15.16:0/1681571670 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f8af40fd400 msgr2=0x7f8af4112970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:18:32.212 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.208+0000 7f8afca8a9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:18:32.212 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.208+0000 7f8afca8a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:18:32.212 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.208+0000 7f8afca8a9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:18:32.212 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.208+0000 7f8afca8a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:18:32.212 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.208+0000 7f8afca8a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:18:32.212 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.208+0000 7f8afca8a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:18:32.212 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.208+0000 7f8afca8a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:32.213 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.212+0000 7f8afca8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:32.213 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.212+0000 7f8afca8a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:32.213 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.212+0000 7f8afca8a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:18:32.213 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.212+0000 7f8afca8a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:32.214 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.212+0000 7f8afca8a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:18:32.214 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.212+0000 7f8afca8a9c0 20 zone default found 2024-09-12T17:18:32.214 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.212+0000 7f8afca8a9c0 4 Realm: () 2024-09-12T17:18:32.214 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.212+0000 7f8afca8a9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:18:32.214 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.212+0000 7f8afca8a9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:18:32.214 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.212+0000 7f8afca8a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:18:32.215 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.212+0000 7f8afca8a9c0 20 zonegroup default 2024-09-12T17:18:32.215 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.212+0000 7f8afca8a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:32.215 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.212+0000 7f8afca8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:32.215 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.212+0000 7f8afca8a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:32.216 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.212+0000 7f8afca8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:32.216 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.212+0000 7f8afca8a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:32.216 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.216+0000 7f8afca8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:32.217 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.216+0000 7f8afca8a9c0 20 started sync module instance, tier type = 2024-09-12T17:18:32.217 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.216+0000 7f8afca8a9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:18:32.242 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.240+0000 7f8afca8a9c0 20 add_watcher() i=0 2024-09-12T17:18:32.242 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.240+0000 7f8afca8a9c0 20 add_watcher() i=1 2024-09-12T17:18:32.242 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.240+0000 7f8afca8a9c0 20 add_watcher() i=2 2024-09-12T17:18:32.242 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.240+0000 7f8afca8a9c0 20 add_watcher() i=3 2024-09-12T17:18:32.242 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.240+0000 7f8afca8a9c0 20 add_watcher() i=4 2024-09-12T17:18:32.242 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.240+0000 7f8afca8a9c0 20 add_watcher() i=5 2024-09-12T17:18:32.242 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.240+0000 7f8afca8a9c0 20 add_watcher() i=6 2024-09-12T17:18:32.244 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.240+0000 7f8afca8a9c0 20 add_watcher() i=7 2024-09-12T17:18:32.244 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.240+0000 7f8afca8a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:18:32.248 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.248+0000 7f89b0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:18:32.249 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.248+0000 7f8afca8a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:18:32.249 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.248+0000 7f8afca8a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:18:32.249 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.248+0000 7f8afca8a9c0 5 note: GC not initialized 2024-09-12T17:18:32.250 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.248+0000 7f892b7fe640 20 reqs_thread_entry: start 2024-09-12T17:18:32.250 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.248+0000 7f8afca8a9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:18:32.250 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.248+0000 7f8afca8a9c0 20 Filter name: none 2024-09-12T17:18:32.251 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.248+0000 7f89297fa640 20 reqs_thread_entry: start 2024-09-12T17:18:32.251 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.248+0000 7f8afca8a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:32.252 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.248+0000 7f8afca8a9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:18:32.252 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.248+0000 7f8afca8a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:32.253 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.252+0000 7f8afca8a9c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T17:18:32.253 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.252+0000 7f8afca8a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:18:32.253 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.252+0000 7f8afca8a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:32.254 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.252+0000 7f8afca8a9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:18:32.254 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.252+0000 7f8afca8a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:32.255 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.252+0000 7f8afca8a9c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T17:18:32.255 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.252+0000 7f8afca8a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:18:32.258 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.256+0000 7f89b0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:18:32.263 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.260+0000 7f8afca8a9c0 20 remove_watcher() i=0 2024-09-12T17:18:32.263 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.260+0000 7f8afca8a9c0 2 removed watcher, disabling cache 2024-09-12T17:18:32.265 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.264+0000 7f8afca8a9c0 20 remove_watcher() i=1 2024-09-12T17:18:32.268 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.264+0000 7f8afca8a9c0 20 remove_watcher() i=2 2024-09-12T17:18:32.270 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.268+0000 7f8afca8a9c0 20 remove_watcher() i=3 2024-09-12T17:18:32.273 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.272+0000 7f8afca8a9c0 20 remove_watcher() i=4 2024-09-12T17:18:32.274 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.272+0000 7f8afca8a9c0 20 remove_watcher() i=5 2024-09-12T17:18:32.276 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.276+0000 7f8afca8a9c0 20 remove_watcher() i=6 2024-09-12T17:18:32.278 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.276+0000 7f8afca8a9c0 20 remove_watcher() i=7 2024-09-12T17:18:32.293 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:32.293 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:18:32.294 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: error-at-trim-reshard-log-entries id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:18:32.294 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:32.357 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:18:32.388 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:18:32.389 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:18:32.438 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.436+0000 7fc40361e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:32.439 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.436+0000 7fc40361e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:32.440 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.436+0000 7fc40361e9c0 20 realm 2024-09-12T17:18:32.440 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.436+0000 7fc40361e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:32.440 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.436+0000 7fc40361e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:32.440 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.436+0000 7fc40361e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:18:32.440 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.436+0000 7fc40361e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:32.440 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.436+0000 7fc40361e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:32.440 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.436+0000 7fc40361e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:32.441 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.440+0000 7fc40361e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:18:32.441 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.440+0000 7fc40361e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:32.443 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.440+0000 7fc40361e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:18:32.443 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.440+0000 7fc40361e9c0 20 searching for the correct realm 2024-09-12T17:18:32.444 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.444+0000 7fc400923640 0 -- 172.21.15.16:0/2230759465 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7fc3f40b4040 msgr2=0x7fc3f40be420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:18:32.659 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.656+0000 7fc401925640 0 -- 172.21.15.16:0/2230759465 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fc3f802f070 msgr2=0x7fc3f8049940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:18:32.678 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.676+0000 7fc40361e9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:18:32.678 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.676+0000 7fc40361e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:18:32.678 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.676+0000 7fc40361e9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:18:32.678 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.676+0000 7fc40361e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:18:32.678 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.676+0000 7fc40361e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:18:32.678 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.676+0000 7fc40361e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:18:32.678 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.676+0000 7fc40361e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:32.679 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.676+0000 7fc40361e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:32.679 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.676+0000 7fc40361e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:32.679 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.676+0000 7fc40361e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:18:32.679 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.676+0000 7fc40361e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:32.680 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.680+0000 7fc40361e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:18:32.680 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.680+0000 7fc40361e9c0 20 zone default found 2024-09-12T17:18:32.680 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.680+0000 7fc40361e9c0 4 Realm: () 2024-09-12T17:18:32.681 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.680+0000 7fc40361e9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:18:32.681 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.680+0000 7fc40361e9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:18:32.681 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.680+0000 7fc40361e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:18:32.681 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.680+0000 7fc40361e9c0 20 zonegroup default 2024-09-12T17:18:32.681 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.680+0000 7fc40361e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:32.681 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.680+0000 7fc40361e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:32.681 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.680+0000 7fc40361e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:32.682 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.680+0000 7fc40361e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:32.682 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.680+0000 7fc40361e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:32.683 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.680+0000 7fc40361e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:32.683 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.680+0000 7fc40361e9c0 20 started sync module instance, tier type = 2024-09-12T17:18:32.683 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.680+0000 7fc40361e9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:18:32.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.708+0000 7fc40361e9c0 20 add_watcher() i=0 2024-09-12T17:18:32.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.708+0000 7fc40361e9c0 20 add_watcher() i=1 2024-09-12T17:18:32.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.708+0000 7fc40361e9c0 20 add_watcher() i=2 2024-09-12T17:18:32.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.708+0000 7fc40361e9c0 20 add_watcher() i=3 2024-09-12T17:18:32.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.708+0000 7fc40361e9c0 20 add_watcher() i=4 2024-09-12T17:18:32.710 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.708+0000 7fc40361e9c0 20 add_watcher() i=5 2024-09-12T17:18:32.710 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.708+0000 7fc40361e9c0 20 add_watcher() i=6 2024-09-12T17:18:32.712 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.708+0000 7fc40361e9c0 20 add_watcher() i=7 2024-09-12T17:18:32.712 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.708+0000 7fc40361e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:18:32.716 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.712+0000 7fc2b77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:18:32.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.716+0000 7fc40361e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:18:32.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.716+0000 7fc40361e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:18:32.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.716+0000 7fc40361e9c0 5 note: GC not initialized 2024-09-12T17:18:32.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.716+0000 7fc2b67e4640 20 reqs_thread_entry: start 2024-09-12T17:18:32.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.716+0000 7fc40361e9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:18:32.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.716+0000 7fc40361e9c0 20 Filter name: none 2024-09-12T17:18:32.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.716+0000 7fc227fff640 20 reqs_thread_entry: start 2024-09-12T17:18:32.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.716+0000 7fc40361e9c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T17:18:32.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.716+0000 7fc40361e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:32.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.716+0000 7fc40361e9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:18:32.720 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.716+0000 7fc40361e9c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:18:32.720 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.716+0000 7fc40361e9c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:18:32.720 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.716+0000 7fc40361e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25 : miss 2024-09-12T17:18:32.720 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.716+0000 7fc40361e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:32.721 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.720+0000 7fc40361e9c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T17:18:32.721 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.720+0000 7fc40361e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25 info.flags=0x17 2024-09-12T17:18:32.721 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.720+0000 7fc40361e9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25 to cache LRU end 2024-09-12T17:18:32.721 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.720+0000 7fc40361e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:18:32.721 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.720+0000 7fc40361e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:18:32.721 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.720+0000 7fc40361e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25 2024-09-12T17:18:32.723 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.720+0000 7fc40361e9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:18:32.732 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.732+0000 7fc40361e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25 info.flags=0x17 2024-09-12T17:18:32.732 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.732+0000 7fc40361e9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25 to cache LRU end 2024-09-12T17:18:32.732 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.732+0000 7fc40361e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:18:32.732 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.732+0000 7fc40361e9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25, ofs0, ns] 2024-09-12T17:18:32.733 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.732+0000 7fc2e4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431609 cookie 94069894204320 notifier 6443 bl.length()=939 2024-09-12T17:18:32.733 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.732+0000 7fc2e4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25 info.flags=0x17 2024-09-12T17:18:32.733 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.732+0000 7fc2e4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25 to cache LRU end 2024-09-12T17:18:32.733 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.732+0000 7fc2e4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:18:32.734 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.732+0000 7fc40361e9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25]): orig_sources= new_sources= 2024-09-12T17:18:32.734 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.732+0000 7fc40361e9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25]): potential sources added=[] removed=[] 2024-09-12T17:18:32.734 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.732+0000 7fc40361e9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25]): orig_dests= new_dests= 2024-09-12T17:18:32.734 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.732+0000 7fc40361e9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25]): potential dests added=[] removed=[] 2024-09-12T17:18:32.739 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.736+0000 7fc40361e9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25.2.0 2024-09-12T17:18:32.739 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.736+0000 7fc40361e9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25.2.0 2024-09-12T17:18:32.739 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.736+0000 7fc40361e9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25.2.1 2024-09-12T17:18:32.739 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.736+0000 7fc40361e9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25.2.1 2024-09-12T17:18:32.739 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.736+0000 7fc40361e9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25.0 2024-09-12T17:18:32.744 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.744+0000 7fc40361e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25 : hit (requested=0x17, cached=0x17) 2024-09-12T17:18:32.744 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.744+0000 7fc40361e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25 2024-09-12T17:18:32.747 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.744+0000 7fc40361e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25 info.flags=0x17 2024-09-12T17:18:32.747 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.744+0000 7fc40361e9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25 to cache LRU end 2024-09-12T17:18:32.747 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.744+0000 7fc40361e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:18:32.747 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.744+0000 7fc40361e9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25, ofs0, ns] 2024-09-12T17:18:32.747 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.744+0000 7fc2e4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431610 cookie 94069894204320 notifier 6443 bl.length()=939 2024-09-12T17:18:32.748 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.744+0000 7fc2e4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25 info.flags=0x17 2024-09-12T17:18:32.748 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.744+0000 7fc2e4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25 to cache LRU end 2024-09-12T17:18:32.748 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.744+0000 7fc2e4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:18:32.748 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.748+0000 7fc40361e9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25]): orig_sources= new_sources= 2024-09-12T17:18:32.748 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.748+0000 7fc40361e9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25]): potential sources added=[] removed=[] 2024-09-12T17:18:32.748 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.748+0000 7fc40361e9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25]): orig_dests= new_dests= 2024-09-12T17:18:32.748 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.748+0000 7fc40361e9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25]): potential dests added=[] removed=[] 2024-09-12T17:18:32.751 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.748+0000 7fc40361e9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25.0 2024-09-12T17:18:32.752 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.752+0000 7fc40361e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25 : hit (requested=0x17, cached=0x17) 2024-09-12T17:18:32.752 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.752+0000 7fc40361e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25 2024-09-12T17:18:32.755 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.752+0000 7fc40361e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25 info.flags=0x17 2024-09-12T17:18:32.755 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.752+0000 7fc40361e9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25 to cache LRU end 2024-09-12T17:18:32.755 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.752+0000 7fc40361e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:18:32.755 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.752+0000 7fc40361e9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25, ofs0, ns] 2024-09-12T17:18:32.756 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.752+0000 7fc2e4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431611 cookie 94069894204320 notifier 6443 bl.length()=907 2024-09-12T17:18:32.756 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.752+0000 7fc2e4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25 info.flags=0x17 2024-09-12T17:18:32.756 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.752+0000 7fc2e4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25 to cache LRU end 2024-09-12T17:18:32.756 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.752+0000 7fc2e4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:18:32.757 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.756+0000 7fc40361e9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25]): orig_sources= new_sources= 2024-09-12T17:18:32.757 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.756+0000 7fc40361e9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25]): potential sources added=[] removed=[] 2024-09-12T17:18:32.757 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.756+0000 7fc40361e9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25]): orig_dests= new_dests= 2024-09-12T17:18:32.757 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.756+0000 7fc40361e9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25]): potential dests added=[] removed=[] 2024-09-12T17:18:32.760 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.756+0000 7fc40361e9c0 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 1 shards to 2 shards completed successfully 2024-09-12T17:18:32.764 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.764+0000 7fc2b77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:18:32.770 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.768+0000 7fc40361e9c0 20 remove_watcher() i=0 2024-09-12T17:18:32.770 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.768+0000 7fc40361e9c0 2 removed watcher, disabling cache 2024-09-12T17:18:32.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.772+0000 7fc40361e9c0 20 remove_watcher() i=1 2024-09-12T17:18:32.775 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.772+0000 7fc40361e9c0 20 remove_watcher() i=2 2024-09-12T17:18:32.777 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.776+0000 7fc40361e9c0 20 remove_watcher() i=3 2024-09-12T17:18:32.780 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.780+0000 7fc40361e9c0 20 remove_watcher() i=4 2024-09-12T17:18:32.781 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.780+0000 7fc40361e9c0 20 remove_watcher() i=5 2024-09-12T17:18:32.783 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.780+0000 7fc40361e9c0 20 remove_watcher() i=6 2024-09-12T17:18:32.785 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.784+0000 7fc40361e9c0 20 remove_watcher() i=7 2024-09-12T17:18:32.806 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T17:18:32.839 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:18:32.840 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:18:32.888 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.884+0000 7f68077cd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:32.890 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.888+0000 7f68077cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:32.890 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.888+0000 7f68077cd9c0 20 realm 2024-09-12T17:18:32.890 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.888+0000 7f68077cd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:32.890 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.888+0000 7f68077cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:32.891 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.888+0000 7f68077cd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:18:32.891 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.888+0000 7f68077cd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:32.891 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.888+0000 7f68077cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:32.891 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.888+0000 7f68077cd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:32.892 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.888+0000 7f68077cd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:18:32.892 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.888+0000 7f68077cd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:32.894 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.892+0000 7f68077cd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:18:32.894 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.892+0000 7f68077cd9c0 20 searching for the correct realm 2024-09-12T17:18:32.897 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:32.896+0000 7f6805ad4640 0 -- 172.21.15.16:0/3840071167 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f67fc082c20 msgr2=0x7f67fc083ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:18:33.115 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.112+0000 7f6804ad2640 0 -- 172.21.15.16:0/3840071167 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f68000849c0 msgr2=0x7f68000880d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:18:33.332 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.328+0000 7f68077cd9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:18:33.332 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.328+0000 7f68077cd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:18:33.332 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.328+0000 7f68077cd9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:18:33.333 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.328+0000 7f68077cd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:18:33.333 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.328+0000 7f68077cd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:18:33.333 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.328+0000 7f68077cd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:18:33.333 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.328+0000 7f68077cd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:33.334 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.332+0000 7f68077cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:33.335 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.332+0000 7f68077cd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:33.335 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.332+0000 7f68077cd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:18:33.335 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.332+0000 7f68077cd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:33.335 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.332+0000 7f68077cd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:18:33.335 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.332+0000 7f68077cd9c0 20 zone default found 2024-09-12T17:18:33.336 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.332+0000 7f68077cd9c0 4 Realm: () 2024-09-12T17:18:33.336 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.332+0000 7f68077cd9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:18:33.336 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.332+0000 7f68077cd9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:18:33.336 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.332+0000 7f68077cd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:18:33.336 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.332+0000 7f68077cd9c0 20 zonegroup default 2024-09-12T17:18:33.336 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.332+0000 7f68077cd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:33.338 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.332+0000 7f68077cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:33.338 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.332+0000 7f68077cd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:33.338 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.336+0000 7f68077cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:33.338 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.336+0000 7f68077cd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:33.339 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.336+0000 7f68077cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:33.339 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.336+0000 7f68077cd9c0 20 started sync module instance, tier type = 2024-09-12T17:18:33.339 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.336+0000 7f68077cd9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:18:33.360 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.356+0000 7f68077cd9c0 20 add_watcher() i=0 2024-09-12T17:18:33.360 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.356+0000 7f68077cd9c0 20 add_watcher() i=1 2024-09-12T17:18:33.360 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.356+0000 7f68077cd9c0 20 add_watcher() i=2 2024-09-12T17:18:33.361 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.356+0000 7f68077cd9c0 20 add_watcher() i=3 2024-09-12T17:18:33.361 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.356+0000 7f68077cd9c0 20 add_watcher() i=4 2024-09-12T17:18:33.361 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.360+0000 7f68077cd9c0 20 add_watcher() i=5 2024-09-12T17:18:33.361 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.360+0000 7f68077cd9c0 20 add_watcher() i=6 2024-09-12T17:18:33.362 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.360+0000 7f68077cd9c0 20 add_watcher() i=7 2024-09-12T17:18:33.362 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.360+0000 7f68077cd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:18:33.366 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.364+0000 7f66bbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:18:33.367 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.364+0000 7f68077cd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:18:33.367 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.364+0000 7f68077cd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:18:33.367 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.364+0000 7f68077cd9c0 5 note: GC not initialized 2024-09-12T17:18:33.368 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.364+0000 7f66bafe5640 20 reqs_thread_entry: start 2024-09-12T17:18:33.368 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.368+0000 7f68077cd9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:18:33.368 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.368+0000 7f68077cd9c0 20 Filter name: none 2024-09-12T17:18:33.368 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.368+0000 7f66b8fe1640 20 reqs_thread_entry: start 2024-09-12T17:18:33.369 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.368+0000 7f68077cd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:33.370 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.368+0000 7f68077cd9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:18:33.370 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.368+0000 7f68077cd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:33.371 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.368+0000 7f68077cd9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:18:33.371 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.368+0000 7f68077cd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:18:33.371 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.368+0000 7f68077cd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:33.372 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.372+0000 7f68077cd9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:18:33.372 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.372+0000 7f68077cd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:33.373 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.372+0000 7f68077cd9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:18:33.373 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.372+0000 7f68077cd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:18:33.376 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.372+0000 7f66bbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:18:33.387 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.380+0000 7f68077cd9c0 20 remove_watcher() i=0 2024-09-12T17:18:33.387 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.380+0000 7f68077cd9c0 2 removed watcher, disabling cache 2024-09-12T17:18:33.387 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.380+0000 7f68077cd9c0 20 remove_watcher() i=1 2024-09-12T17:18:33.388 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.384+0000 7f68077cd9c0 20 remove_watcher() i=2 2024-09-12T17:18:33.388 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.384+0000 7f68077cd9c0 20 remove_watcher() i=3 2024-09-12T17:18:33.390 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.388+0000 7f68077cd9c0 20 remove_watcher() i=4 2024-09-12T17:18:33.392 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.388+0000 7f68077cd9c0 20 remove_watcher() i=5 2024-09-12T17:18:33.393 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.392+0000 7f68077cd9c0 20 remove_watcher() i=6 2024-09-12T17:18:33.394 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:33.392+0000 7f68077cd9c0 20 remove_watcher() i=7 2024-09-12T17:18:33.409 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:33.409 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:18:33.410 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: error-at-trim-reshard-log-entries id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:18:33.410 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:33.484 INFO:tasks.workunit.client.0.smithi016.stderr:TEST: reshard bucket with EOPNOTSUPP injected at trim_reshard_log_entries 2024-09-12T17:18:33.484 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:33.970 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T17:18:34.004 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:18:34.004 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:18:34.054 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.052+0000 7fbf8e30b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:34.056 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.052+0000 7fbf8e30b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:34.056 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.052+0000 7fbf8e30b9c0 20 realm 2024-09-12T17:18:34.056 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.052+0000 7fbf8e30b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:34.056 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.056+0000 7fbf8e30b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:34.056 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.056+0000 7fbf8e30b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:18:34.057 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.056+0000 7fbf8e30b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:34.057 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.056+0000 7fbf8e30b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:34.057 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.056+0000 7fbf8e30b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:34.058 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.056+0000 7fbf8e30b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:18:34.058 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.056+0000 7fbf8e30b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:34.060 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.056+0000 7fbf8e30b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:18:34.060 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.056+0000 7fbf8e30b9c0 20 searching for the correct realm 2024-09-12T17:18:34.060 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.060+0000 7fbf8b610640 0 -- 172.21.15.16:0/1083690988 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7fbf7c0bd040 msgr2=0x7fbf7c0be430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:18:34.276 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.271+0000 7fbf8c612640 0 -- 172.21.15.16:0/1083690988 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fbf80044950 msgr2=0x7fbf800503f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:18:34.294 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.291+0000 7fbf8e30b9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:18:34.294 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.291+0000 7fbf8e30b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:18:34.294 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.291+0000 7fbf8e30b9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:18:34.294 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.291+0000 7fbf8e30b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:18:34.294 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.291+0000 7fbf8e30b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:18:34.294 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.291+0000 7fbf8e30b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:18:34.295 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.291+0000 7fbf8e30b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:34.295 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.291+0000 7fbf8e30b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:34.295 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.291+0000 7fbf8e30b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:34.295 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.291+0000 7fbf8e30b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:18:34.295 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.291+0000 7fbf8e30b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:34.297 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.295+0000 7fbf8e30b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:18:34.297 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.295+0000 7fbf8e30b9c0 20 zone default found 2024-09-12T17:18:34.297 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.295+0000 7fbf8e30b9c0 4 Realm: () 2024-09-12T17:18:34.297 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.295+0000 7fbf8e30b9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:18:34.297 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.295+0000 7fbf8e30b9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:18:34.297 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.295+0000 7fbf8e30b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:18:34.297 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.295+0000 7fbf8e30b9c0 20 zonegroup default 2024-09-12T17:18:34.297 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.295+0000 7fbf8e30b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:34.298 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.295+0000 7fbf8e30b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:34.298 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.295+0000 7fbf8e30b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:34.298 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.295+0000 7fbf8e30b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:34.298 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.295+0000 7fbf8e30b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:34.299 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.295+0000 7fbf8e30b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:34.299 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.295+0000 7fbf8e30b9c0 20 started sync module instance, tier type = 2024-09-12T17:18:34.299 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.295+0000 7fbf8e30b9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:18:34.323 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.319+0000 7fbf8e30b9c0 20 add_watcher() i=0 2024-09-12T17:18:34.323 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.319+0000 7fbf8e30b9c0 20 add_watcher() i=1 2024-09-12T17:18:34.323 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.319+0000 7fbf8e30b9c0 20 add_watcher() i=2 2024-09-12T17:18:34.323 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.319+0000 7fbf8e30b9c0 20 add_watcher() i=3 2024-09-12T17:18:34.323 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.319+0000 7fbf8e30b9c0 20 add_watcher() i=4 2024-09-12T17:18:34.323 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.319+0000 7fbf8e30b9c0 20 add_watcher() i=5 2024-09-12T17:18:34.324 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.319+0000 7fbf8e30b9c0 20 add_watcher() i=6 2024-09-12T17:18:34.325 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.323+0000 7fbf8e30b9c0 20 add_watcher() i=7 2024-09-12T17:18:34.325 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.323+0000 7fbf8e30b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:18:34.329 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.327+0000 7fbe41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:18:34.330 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.327+0000 7fbf8e30b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:18:34.330 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.327+0000 7fbf8e30b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:18:34.330 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.327+0000 7fbf8e30b9c0 5 note: GC not initialized 2024-09-12T17:18:34.331 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.327+0000 7fbe40fe1640 20 reqs_thread_entry: start 2024-09-12T17:18:34.331 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.327+0000 7fbf8e30b9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:18:34.331 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.327+0000 7fbf8e30b9c0 20 Filter name: none 2024-09-12T17:18:34.332 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.327+0000 7fbdba7fc640 20 reqs_thread_entry: start 2024-09-12T17:18:34.332 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.327+0000 7fbf8e30b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:34.333 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.331+0000 7fbf8e30b9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:18:34.333 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.331+0000 7fbf8e30b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:34.335 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.331+0000 7fbf8e30b9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:18:34.335 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.331+0000 7fbf8e30b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:18:34.335 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.331+0000 7fbf8e30b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:34.336 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.335+0000 7fbf8e30b9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:18:34.336 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.335+0000 7fbf8e30b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:34.337 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.335+0000 7fbf8e30b9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:18:34.337 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.335+0000 7fbf8e30b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:18:34.340 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.335+0000 7fbe41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:18:34.345 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.343+0000 7fbf8e30b9c0 20 remove_watcher() i=0 2024-09-12T17:18:34.346 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.343+0000 7fbf8e30b9c0 2 removed watcher, disabling cache 2024-09-12T17:18:34.348 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.347+0000 7fbf8e30b9c0 20 remove_watcher() i=1 2024-09-12T17:18:34.351 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.347+0000 7fbf8e30b9c0 20 remove_watcher() i=2 2024-09-12T17:18:34.354 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.351+0000 7fbf8e30b9c0 20 remove_watcher() i=3 2024-09-12T17:18:34.356 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.355+0000 7fbf8e30b9c0 20 remove_watcher() i=4 2024-09-12T17:18:34.357 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.355+0000 7fbf8e30b9c0 20 remove_watcher() i=5 2024-09-12T17:18:34.359 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.355+0000 7fbf8e30b9c0 20 remove_watcher() i=6 2024-09-12T17:18:34.361 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.359+0000 7fbf8e30b9c0 20 remove_watcher() i=7 2024-09-12T17:18:34.376 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:34.376 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:18:34.376 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: error-at-trim-reshard-log-entries id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:18:34.376 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:34.377 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries --inject-error-code 95 2024-09-12T17:18:34.418 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:18:34.418 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:18:34.465 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.463+0000 7f7972f539c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:34.467 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.463+0000 7f7972f539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:34.467 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.463+0000 7f7972f539c0 20 realm 2024-09-12T17:18:34.467 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.463+0000 7f7972f539c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:34.468 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.463+0000 7f7972f539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:34.468 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.463+0000 7f7972f539c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:18:34.468 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.463+0000 7f7972f539c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:34.468 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.463+0000 7f7972f539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:34.468 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.463+0000 7f7972f539c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:34.469 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.467+0000 7f7972f539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:18:34.469 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.467+0000 7f7972f539c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:34.471 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.467+0000 7f7972f539c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:18:34.471 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.467+0000 7f7972f539c0 20 searching for the correct realm 2024-09-12T17:18:34.473 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.471+0000 7f7970258640 0 -- 172.21.15.16:0/1066290359 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7f795c002350 msgr2=0x7f7960029410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:18:34.688 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.687+0000 7f797125a640 0 -- 172.21.15.16:0/1066290359 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f7958123530 msgr2=0x7f79580fd120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:18:34.706 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.703+0000 7f7972f539c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:18:34.706 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.703+0000 7f7972f539c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:18:34.706 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.703+0000 7f7972f539c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:18:34.707 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.703+0000 7f7972f539c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:18:34.707 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.703+0000 7f7972f539c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:18:34.707 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.703+0000 7f7972f539c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:18:34.707 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.703+0000 7f7972f539c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:34.707 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.703+0000 7f7972f539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:34.707 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.703+0000 7f7972f539c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:34.708 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.703+0000 7f7972f539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:18:34.708 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.703+0000 7f7972f539c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:34.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.707+0000 7f7972f539c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:18:34.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.707+0000 7f7972f539c0 20 zone default found 2024-09-12T17:18:34.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.707+0000 7f7972f539c0 4 Realm: () 2024-09-12T17:18:34.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.707+0000 7f7972f539c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:18:34.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.707+0000 7f7972f539c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:18:34.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.707+0000 7f7972f539c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:18:34.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.707+0000 7f7972f539c0 20 zonegroup default 2024-09-12T17:18:34.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.707+0000 7f7972f539c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:34.710 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.707+0000 7f7972f539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:34.710 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.707+0000 7f7972f539c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:34.710 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.707+0000 7f7972f539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:34.710 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.707+0000 7f7972f539c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:34.711 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.707+0000 7f7972f539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:34.711 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.707+0000 7f7972f539c0 20 started sync module instance, tier type = 2024-09-12T17:18:34.711 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.707+0000 7f7972f539c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:18:34.735 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.731+0000 7f7972f539c0 20 add_watcher() i=0 2024-09-12T17:18:34.736 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.731+0000 7f7972f539c0 20 add_watcher() i=1 2024-09-12T17:18:34.736 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.731+0000 7f7972f539c0 20 add_watcher() i=2 2024-09-12T17:18:34.736 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.731+0000 7f7972f539c0 20 add_watcher() i=3 2024-09-12T17:18:34.736 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.731+0000 7f7972f539c0 20 add_watcher() i=4 2024-09-12T17:18:34.736 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.731+0000 7f7972f539c0 20 add_watcher() i=5 2024-09-12T17:18:34.736 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.731+0000 7f7972f539c0 20 add_watcher() i=6 2024-09-12T17:18:34.738 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.735+0000 7f7972f539c0 20 add_watcher() i=7 2024-09-12T17:18:34.738 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.735+0000 7f7972f539c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:18:34.742 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.739+0000 7f7826fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:18:34.742 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.739+0000 7f7972f539c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:18:34.742 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.739+0000 7f7972f539c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:18:34.742 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.739+0000 7f7972f539c0 5 note: GC not initialized 2024-09-12T17:18:34.743 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.739+0000 7f7825fe3640 20 reqs_thread_entry: start 2024-09-12T17:18:34.743 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.739+0000 7f7972f539c0 20 init_complete bucket index max shards: 1 2024-09-12T17:18:34.743 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.739+0000 7f7972f539c0 20 Filter name: none 2024-09-12T17:18:34.743 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.739+0000 7f7972f539c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T17:18:34.743 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.739+0000 7f7972f539c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:34.744 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.739+0000 7f77977fe640 20 reqs_thread_entry: start 2024-09-12T17:18:34.744 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.743+0000 7f7972f539c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:18:34.744 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.743+0000 7f7972f539c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:18:34.744 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.743+0000 7f7972f539c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:18:34.744 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.743+0000 7f7972f539c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26 : miss 2024-09-12T17:18:34.744 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.743+0000 7f7972f539c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:34.745 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.743+0000 7f7972f539c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:18:34.746 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.743+0000 7f7972f539c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26 info.flags=0x17 2024-09-12T17:18:34.746 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.743+0000 7f7972f539c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26 to cache LRU end 2024-09-12T17:18:34.746 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.743+0000 7f7972f539c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:18:34.746 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.743+0000 7f7972f539c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:18:34.746 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.743+0000 7f7972f539c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26 2024-09-12T17:18:34.752 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.751+0000 7f7972f539c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26 info.flags=0x17 2024-09-12T17:18:34.752 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.751+0000 7f7972f539c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26 to cache LRU end 2024-09-12T17:18:34.752 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.751+0000 7f7972f539c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:18:34.752 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.751+0000 7f7972f539c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26, ofs0, ns] 2024-09-12T17:18:34.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.751+0000 7f78477fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431614 cookie 94646505065136 notifier 6774 bl.length()=939 2024-09-12T17:18:34.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.751+0000 7f78477fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26 info.flags=0x17 2024-09-12T17:18:34.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.751+0000 7f78477fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26 to cache LRU end 2024-09-12T17:18:34.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.751+0000 7f78477fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:18:34.754 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.751+0000 7f7972f539c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26]): orig_sources= new_sources= 2024-09-12T17:18:34.754 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.751+0000 7f7972f539c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26]): potential sources added=[] removed=[] 2024-09-12T17:18:34.754 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.751+0000 7f7972f539c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26]): orig_dests= new_dests= 2024-09-12T17:18:34.755 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.751+0000 7f7972f539c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26]): potential dests added=[] removed=[] 2024-09-12T17:18:34.755 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.751+0000 7f7972f539c0 -1 Injecting error=-95 at location=trim_reshard_log_entries 2024-09-12T17:18:34.755 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.751+0000 7f7972f539c0 0 WARNING: trim_reshard_log_entries() does not supported logrecord, falling back to block reshard mode. 2024-09-12T17:18:34.757 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.755+0000 7f7972f539c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26.1.0 2024-09-12T17:18:34.757 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.755+0000 7f7972f539c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26.1.0 2024-09-12T17:18:34.757 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.755+0000 7f7972f539c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26.1.1 2024-09-12T17:18:34.757 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.755+0000 7f7972f539c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26.1.1 2024-09-12T17:18:34.757 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.755+0000 7f7972f539c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26.0 2024-09-12T17:18:34.764 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.759+0000 7f7972f539c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26 : hit (requested=0x17, cached=0x17) 2024-09-12T17:18:34.764 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.759+0000 7f7972f539c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26 2024-09-12T17:18:34.766 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.763+0000 7f7972f539c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26 info.flags=0x17 2024-09-12T17:18:34.767 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.763+0000 7f7972f539c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26 to cache LRU end 2024-09-12T17:18:34.767 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.763+0000 7f7972f539c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:18:34.767 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.763+0000 7f7972f539c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26, ofs0, ns] 2024-09-12T17:18:34.767 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.763+0000 7f7847fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431615 cookie 94646505065136 notifier 6774 bl.length()=907 2024-09-12T17:18:34.767 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.763+0000 7f7847fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26 info.flags=0x17 2024-09-12T17:18:34.767 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.763+0000 7f7847fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26 to cache LRU end 2024-09-12T17:18:34.767 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.763+0000 7f7847fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:18:34.768 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.767+0000 7f7972f539c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26]): orig_sources= new_sources= 2024-09-12T17:18:34.768 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.767+0000 7f7972f539c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26]): potential sources added=[] removed=[] 2024-09-12T17:18:34.769 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.767+0000 7f7972f539c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26]): orig_dests= new_dests= 2024-09-12T17:18:34.769 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.767+0000 7f7972f539c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26]): potential dests added=[] removed=[] 2024-09-12T17:18:34.771 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.767+0000 7f7972f539c0 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 1 shards to 2 shards completed successfully 2024-09-12T17:18:34.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.771+0000 7f7826fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:18:34.779 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.775+0000 7f7972f539c0 20 remove_watcher() i=0 2024-09-12T17:18:34.779 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.775+0000 7f7972f539c0 2 removed watcher, disabling cache 2024-09-12T17:18:34.781 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.779+0000 7f7972f539c0 20 remove_watcher() i=1 2024-09-12T17:18:34.784 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.779+0000 7f7972f539c0 20 remove_watcher() i=2 2024-09-12T17:18:34.786 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.783+0000 7f7972f539c0 20 remove_watcher() i=3 2024-09-12T17:18:34.788 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.787+0000 7f7972f539c0 20 remove_watcher() i=4 2024-09-12T17:18:34.790 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.787+0000 7f7972f539c0 20 remove_watcher() i=5 2024-09-12T17:18:34.791 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.787+0000 7f7972f539c0 20 remove_watcher() i=6 2024-09-12T17:18:34.793 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.791+0000 7f7972f539c0 20 remove_watcher() i=7 2024-09-12T17:18:34.812 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T17:18:34.838 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:18:34.838 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:18:34.885 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.883+0000 7f37e136d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:34.887 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.883+0000 7f37e136d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:34.888 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.883+0000 7f37e136d9c0 20 realm 2024-09-12T17:18:34.888 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.883+0000 7f37e136d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:34.888 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.883+0000 7f37e136d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:34.888 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.883+0000 7f37e136d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:18:34.888 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.883+0000 7f37e136d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:34.888 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.883+0000 7f37e136d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:34.888 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.887+0000 7f37e136d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:34.890 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.887+0000 7f37e136d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:18:34.890 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.887+0000 7f37e136d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:34.891 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.887+0000 7f37e136d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:18:34.891 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.887+0000 7f37e136d9c0 20 searching for the correct realm 2024-09-12T17:18:34.895 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.891+0000 7f37df674640 0 -- 172.21.15.16:0/514214453 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f37d403e030 msgr2=0x7f37d4031420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:18:34.900 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.899+0000 7f37df674640 0 -- 172.21.15.16:0/514214453 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f36a8080900 msgr2=0x7f36a8082d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:18:34.911 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.907+0000 7f37e136d9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:18:34.911 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.907+0000 7f37e136d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:18:34.911 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.907+0000 7f37e136d9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:18:34.911 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.907+0000 7f37e136d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:18:34.911 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.907+0000 7f37e136d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:18:34.911 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.907+0000 7f37e136d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:18:34.911 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.907+0000 7f37e136d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:34.911 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.907+0000 7f37e136d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:34.911 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.907+0000 7f37e136d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:34.912 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.907+0000 7f37e136d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:18:34.912 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.907+0000 7f37e136d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:34.912 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.911+0000 7f37e136d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:18:34.913 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.911+0000 7f37e136d9c0 20 zone default found 2024-09-12T17:18:34.913 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.911+0000 7f37e136d9c0 4 Realm: () 2024-09-12T17:18:34.913 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.911+0000 7f37e136d9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:18:34.913 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.911+0000 7f37e136d9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:18:34.913 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.911+0000 7f37e136d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:18:34.913 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.911+0000 7f37e136d9c0 20 zonegroup default 2024-09-12T17:18:34.913 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.911+0000 7f37e136d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:34.913 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.911+0000 7f37e136d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:34.913 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.911+0000 7f37e136d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:34.914 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.911+0000 7f37e136d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:34.914 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.911+0000 7f37e136d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:34.914 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.911+0000 7f37e136d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:34.914 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.911+0000 7f37e136d9c0 20 started sync module instance, tier type = 2024-09-12T17:18:34.914 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.911+0000 7f37e136d9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:18:34.930 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.927+0000 7f37e136d9c0 20 add_watcher() i=0 2024-09-12T17:18:34.930 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.927+0000 7f37e136d9c0 20 add_watcher() i=1 2024-09-12T17:18:34.930 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.927+0000 7f37e136d9c0 20 add_watcher() i=2 2024-09-12T17:18:34.931 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.927+0000 7f37e136d9c0 20 add_watcher() i=3 2024-09-12T17:18:34.931 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.927+0000 7f37e136d9c0 20 add_watcher() i=4 2024-09-12T17:18:34.931 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.927+0000 7f37e136d9c0 20 add_watcher() i=5 2024-09-12T17:18:34.931 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.927+0000 7f37e136d9c0 20 add_watcher() i=6 2024-09-12T17:18:34.931 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.927+0000 7f37e136d9c0 20 add_watcher() i=7 2024-09-12T17:18:34.931 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.927+0000 7f37e136d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:18:34.933 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.931+0000 7f3695fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:18:34.934 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.931+0000 7f37e136d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:18:34.935 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.931+0000 7f37e136d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:18:34.935 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.931+0000 7f37e136d9c0 5 note: GC not initialized 2024-09-12T17:18:34.935 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.931+0000 7f3694fe1640 20 reqs_thread_entry: start 2024-09-12T17:18:34.935 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.931+0000 7f37e136d9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:18:34.935 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.931+0000 7f37e136d9c0 20 Filter name: none 2024-09-12T17:18:34.935 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.931+0000 7f368dffb640 20 reqs_thread_entry: start 2024-09-12T17:18:34.935 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.931+0000 7f37e136d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:34.935 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.931+0000 7f37e136d9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:18:34.936 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.931+0000 7f37e136d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:34.937 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.935+0000 7f37e136d9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:18:34.937 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.935+0000 7f37e136d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:18:34.937 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.935+0000 7f37e136d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:34.938 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.935+0000 7f37e136d9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:18:34.938 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.935+0000 7f37e136d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:34.939 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.935+0000 7f37e136d9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:18:34.939 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.935+0000 7f37e136d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:18:34.941 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.939+0000 7f3695fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:18:34.946 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.943+0000 7f37e136d9c0 20 remove_watcher() i=0 2024-09-12T17:18:34.946 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.943+0000 7f37e136d9c0 2 removed watcher, disabling cache 2024-09-12T17:18:34.948 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.943+0000 7f37e136d9c0 20 remove_watcher() i=1 2024-09-12T17:18:34.950 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.947+0000 7f37e136d9c0 20 remove_watcher() i=2 2024-09-12T17:18:34.952 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.951+0000 7f37e136d9c0 20 remove_watcher() i=3 2024-09-12T17:18:34.954 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.951+0000 7f37e136d9c0 20 remove_watcher() i=4 2024-09-12T17:18:34.955 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.951+0000 7f37e136d9c0 20 remove_watcher() i=5 2024-09-12T17:18:34.956 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.955+0000 7f37e136d9c0 20 remove_watcher() i=6 2024-09-12T17:18:34.958 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:34.955+0000 7f37e136d9c0 20 remove_watcher() i=7 2024-09-12T17:18:34.972 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:34.972 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:18:34.972 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: error-at-trim-reshard-log-entries id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T17:18:34.973 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:35.055 INFO:tasks.workunit.client.0.smithi016.stderr:TEST: reshard bucket with abort at trim_reshard_log_entries 2024-09-12T17:18:35.055 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:35.525 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T17:18:35.562 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:18:35.562 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:18:35.793 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:35.791+0000 7f80eb7ca640 0 --2- 172.21.15.16:0/2218487047 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a72084b9b0 0x55a7209f2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T17:18:36.037 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.035+0000 7f80edcc49c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.039 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.035+0000 7f80edcc49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:36.039 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.035+0000 7f80edcc49c0 20 realm 2024-09-12T17:18:36.039 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.035+0000 7f80edcc49c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.039 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.035+0000 7f80edcc49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:36.040 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.035+0000 7f80edcc49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:18:36.040 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.035+0000 7f80edcc49c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.040 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.035+0000 7f80edcc49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:36.040 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.035+0000 7f80edcc49c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.041 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.039+0000 7f80edcc49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:18:36.041 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.039+0000 7f80edcc49c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.043 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.039+0000 7f80edcc49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:18:36.043 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.039+0000 7f80edcc49c0 20 searching for the correct realm 2024-09-12T17:18:36.044 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.043+0000 7f80eafc9640 0 -- 172.21.15.16:0/554775043 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7f80dc086030 msgr2=0x7f80dc05e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:18:36.260 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.259+0000 7f80eafc9640 0 -- 172.21.15.16:0/554775043 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7f80dc086030 msgr2=0x7f80dc05e0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:18:36.280 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.275+0000 7f80edcc49c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:18:36.280 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.275+0000 7f80edcc49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:18:36.280 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.275+0000 7f80edcc49c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:18:36.280 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.275+0000 7f80edcc49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:18:36.280 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.275+0000 7f80edcc49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:18:36.280 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.275+0000 7f80edcc49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:18:36.280 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.275+0000 7f80edcc49c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.281 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.279+0000 7f80edcc49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:36.281 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.279+0000 7f80edcc49c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.281 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.279+0000 7f80edcc49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:18:36.281 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.279+0000 7f80edcc49c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.282 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.279+0000 7f80edcc49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:18:36.283 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.279+0000 7f80edcc49c0 20 zone default found 2024-09-12T17:18:36.283 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.279+0000 7f80edcc49c0 4 Realm: () 2024-09-12T17:18:36.283 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.279+0000 7f80edcc49c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:18:36.283 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.279+0000 7f80edcc49c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:18:36.283 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.279+0000 7f80edcc49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:18:36.283 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.279+0000 7f80edcc49c0 20 zonegroup default 2024-09-12T17:18:36.283 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.279+0000 7f80edcc49c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.283 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.279+0000 7f80edcc49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:36.283 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.279+0000 7f80edcc49c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.284 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.283+0000 7f80edcc49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:36.284 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.283+0000 7f80edcc49c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.285 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.283+0000 7f80edcc49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:36.285 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.283+0000 7f80edcc49c0 20 started sync module instance, tier type = 2024-09-12T17:18:36.285 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.283+0000 7f80edcc49c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:18:36.308 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.307+0000 7f80edcc49c0 20 add_watcher() i=0 2024-09-12T17:18:36.308 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.307+0000 7f80edcc49c0 20 add_watcher() i=1 2024-09-12T17:18:36.309 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.307+0000 7f80edcc49c0 20 add_watcher() i=2 2024-09-12T17:18:36.309 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.307+0000 7f80edcc49c0 20 add_watcher() i=3 2024-09-12T17:18:36.309 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.307+0000 7f80edcc49c0 20 add_watcher() i=4 2024-09-12T17:18:36.309 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.307+0000 7f80edcc49c0 20 add_watcher() i=5 2024-09-12T17:18:36.309 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.307+0000 7f80edcc49c0 20 add_watcher() i=6 2024-09-12T17:18:36.311 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.307+0000 7f80edcc49c0 20 add_watcher() i=7 2024-09-12T17:18:36.311 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.307+0000 7f80edcc49c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:18:36.314 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.311+0000 7f7fa1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:18:36.315 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.311+0000 7f80edcc49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:18:36.315 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.311+0000 7f80edcc49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:18:36.315 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.311+0000 7f80edcc49c0 5 note: GC not initialized 2024-09-12T17:18:36.316 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.311+0000 7f7fa0fe1640 20 reqs_thread_entry: start 2024-09-12T17:18:36.316 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.311+0000 7f80edcc49c0 20 init_complete bucket index max shards: 1 2024-09-12T17:18:36.316 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.315+0000 7f80edcc49c0 20 Filter name: none 2024-09-12T17:18:36.316 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.315+0000 7f7f1a7fc640 20 reqs_thread_entry: start 2024-09-12T17:18:36.316 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.315+0000 7f80edcc49c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.317 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.315+0000 7f80edcc49c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:18:36.317 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.315+0000 7f80edcc49c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.318 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.315+0000 7f80edcc49c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:18:36.319 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.315+0000 7f80edcc49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:18:36.319 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.315+0000 7f80edcc49c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.320 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.315+0000 7f80edcc49c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:18:36.320 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.315+0000 7f80edcc49c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.320 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.319+0000 7f80edcc49c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:18:36.320 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.319+0000 7f80edcc49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:18:36.323 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.319+0000 7f7fa1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:18:36.328 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.327+0000 7f80edcc49c0 20 remove_watcher() i=0 2024-09-12T17:18:36.328 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.327+0000 7f80edcc49c0 2 removed watcher, disabling cache 2024-09-12T17:18:36.331 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.327+0000 7f80edcc49c0 20 remove_watcher() i=1 2024-09-12T17:18:36.333 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.331+0000 7f80edcc49c0 20 remove_watcher() i=2 2024-09-12T17:18:36.336 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.331+0000 7f80edcc49c0 20 remove_watcher() i=3 2024-09-12T17:18:36.338 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.335+0000 7f80edcc49c0 20 remove_watcher() i=4 2024-09-12T17:18:36.340 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.339+0000 7f80edcc49c0 20 remove_watcher() i=5 2024-09-12T17:18:36.341 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.339+0000 7f80edcc49c0 20 remove_watcher() i=6 2024-09-12T17:18:36.343 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.339+0000 7f80edcc49c0 20 remove_watcher() i=7 2024-09-12T17:18:36.361 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:36.361 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:18:36.361 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: abort-at-trim-reshard-log-entries id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:18:36.361 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:36.361 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at trim_reshard_log_entries 2024-09-12T17:18:36.399 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:18:36.399 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:18:36.445 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.443+0000 7fc00dbc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.447 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.443+0000 7fc00dbc09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:36.447 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.443+0000 7fc00dbc09c0 20 realm 2024-09-12T17:18:36.447 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.443+0000 7fc00dbc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.448 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.443+0000 7fc00dbc09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:36.448 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.443+0000 7fc00dbc09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:18:36.448 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.443+0000 7fc00dbc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.448 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.443+0000 7fc00dbc09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:36.449 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.443+0000 7fc00dbc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.449 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.447+0000 7fc00dbc09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:18:36.449 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.447+0000 7fc00dbc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.451 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.447+0000 7fc00dbc09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:18:36.451 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.447+0000 7fc00dbc09c0 20 searching for the correct realm 2024-09-12T17:18:36.452 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.451+0000 7fc00aec5640 0 -- 172.21.15.16:0/968992593 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7fbffc06b040 msgr2=0x7fbffc065860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:18:36.668 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.663+0000 7fc00bec7640 0 -- 172.21.15.16:0/968992593 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fc0000dc290 msgr2=0x7fc000122a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:18:36.686 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.683+0000 7fc00dbc09c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:18:36.687 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.683+0000 7fc00dbc09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:18:36.687 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.683+0000 7fc00dbc09c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:18:36.687 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.683+0000 7fc00dbc09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:18:36.687 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.683+0000 7fc00dbc09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:18:36.689 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.683+0000 7fc00dbc09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:18:36.689 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.683+0000 7fc00dbc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.690 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.683+0000 7fc00dbc09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:36.691 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.683+0000 7fc00dbc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.691 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.683+0000 7fc00dbc09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:18:36.691 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.683+0000 7fc00dbc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.691 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.687+0000 7fc00dbc09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:18:36.691 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.687+0000 7fc00dbc09c0 20 zone default found 2024-09-12T17:18:36.691 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.687+0000 7fc00dbc09c0 4 Realm: () 2024-09-12T17:18:36.691 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.687+0000 7fc00dbc09c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:18:36.691 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.687+0000 7fc00dbc09c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:18:36.692 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.687+0000 7fc00dbc09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:18:36.692 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.687+0000 7fc00dbc09c0 20 zonegroup default 2024-09-12T17:18:36.692 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.687+0000 7fc00dbc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.692 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.687+0000 7fc00dbc09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:36.692 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.687+0000 7fc00dbc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.693 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.687+0000 7fc00dbc09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:36.693 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.687+0000 7fc00dbc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.693 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.687+0000 7fc00dbc09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:36.693 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.687+0000 7fc00dbc09c0 20 started sync module instance, tier type = 2024-09-12T17:18:36.693 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.687+0000 7fc00dbc09c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:18:36.716 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.711+0000 7fc00dbc09c0 20 add_watcher() i=0 2024-09-12T17:18:36.716 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.711+0000 7fc00dbc09c0 20 add_watcher() i=1 2024-09-12T17:18:36.716 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.711+0000 7fc00dbc09c0 20 add_watcher() i=2 2024-09-12T17:18:36.716 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.711+0000 7fc00dbc09c0 20 add_watcher() i=3 2024-09-12T17:18:36.716 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.711+0000 7fc00dbc09c0 20 add_watcher() i=4 2024-09-12T17:18:36.716 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.711+0000 7fc00dbc09c0 20 add_watcher() i=5 2024-09-12T17:18:36.716 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.711+0000 7fc00dbc09c0 20 add_watcher() i=6 2024-09-12T17:18:36.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.715+0000 7fc00dbc09c0 20 add_watcher() i=7 2024-09-12T17:18:36.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.715+0000 7fc00dbc09c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:18:36.722 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.719+0000 7fbec1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:18:36.723 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.719+0000 7fc00dbc09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:18:36.723 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.719+0000 7fc00dbc09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:18:36.724 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.719+0000 7fc00dbc09c0 5 note: GC not initialized 2024-09-12T17:18:36.724 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.723+0000 7fbec0fe1640 20 reqs_thread_entry: start 2024-09-12T17:18:36.724 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.723+0000 7fc00dbc09c0 20 init_complete bucket index max shards: 1 2024-09-12T17:18:36.725 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.723+0000 7fc00dbc09c0 20 Filter name: none 2024-09-12T17:18:36.725 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.723+0000 7fbe3a7fc640 20 reqs_thread_entry: start 2024-09-12T17:18:36.725 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.723+0000 7fc00dbc09c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T17:18:36.725 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.723+0000 7fc00dbc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.726 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.723+0000 7fc00dbc09c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:18:36.727 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.723+0000 7fc00dbc09c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:18:36.727 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.723+0000 7fc00dbc09c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:18:36.727 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.723+0000 7fc00dbc09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 : miss 2024-09-12T17:18:36.727 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.723+0000 7fc00dbc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.727 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.723+0000 7fc00dbc09c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:18:36.728 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.723+0000 7fc00dbc09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 info.flags=0x17 2024-09-12T17:18:36.728 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.723+0000 7fc00dbc09c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 to cache LRU end 2024-09-12T17:18:36.728 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.723+0000 7fc00dbc09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:18:36.728 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.723+0000 7fc00dbc09c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:18:36.728 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.723+0000 7fc00dbc09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 2024-09-12T17:18:36.737 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.735+0000 7fc00dbc09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 info.flags=0x17 2024-09-12T17:18:36.737 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.735+0000 7fc00dbc09c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 to cache LRU end 2024-09-12T17:18:36.737 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.735+0000 7fc00dbc09c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:18:36.737 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.735+0000 7fc00dbc09c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27, ofs0, ns] 2024-09-12T17:18:36.738 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.735+0000 7fbeeeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431570 cookie 94840109592816 notifier 6539 bl.length()=939 2024-09-12T17:18:36.738 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.735+0000 7fbeeeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 info.flags=0x17 2024-09-12T17:18:36.738 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.735+0000 7fbeeeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 to cache LRU end 2024-09-12T17:18:36.738 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.735+0000 7fbeeeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:18:36.738 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.735+0000 7fc00dbc09c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27]): orig_sources= new_sources= 2024-09-12T17:18:36.739 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.735+0000 7fc00dbc09c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27]): potential sources added=[] removed=[] 2024-09-12T17:18:36.739 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.735+0000 7fc00dbc09c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27]): orig_dests= new_dests= 2024-09-12T17:18:36.739 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.735+0000 7fc00dbc09c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27]): potential dests added=[] removed=[] 2024-09-12T17:18:36.739 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc00dbc09c0 time 2024-09-12T17:18:36.741155+0000 2024-09-12T17:18:36.739 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:18:36.742 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:18:36.742 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc01149a2eb] 2024-09-12T17:18:36.742 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc01149a49f] 2024-09-12T17:18:36.742 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5641ac91e0c1] 2024-09-12T17:18:36.742 INFO:tasks.workunit.client.0.smithi016.stderr: 4: radosgw-admin(+0x141007e) [0x5641ad37407e] 2024-09-12T17:18:36.742 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5641ac93018d] 2024-09-12T17:18:36.742 INFO:tasks.workunit.client.0.smithi016.stderr: 6: main() 2024-09-12T17:18:36.742 INFO:tasks.workunit.client.0.smithi016.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc010300d90] 2024-09-12T17:18:36.742 INFO:tasks.workunit.client.0.smithi016.stderr: 8: __libc_start_main() 2024-09-12T17:18:36.742 INFO:tasks.workunit.client.0.smithi016.stderr: 9: _start() 2024-09-12T17:18:36.742 INFO:tasks.workunit.client.0.smithi016.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:18:36.742 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7fc00dbc09c0 thread_name:radosgw-admin 2024-09-12T17:18:36.743 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.739+0000 7fc00dbc09c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc00dbc09c0 time 2024-09-12T17:18:36.741155+0000 2024-09-12T17:18:36.743 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:18:36.743 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:36.743 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:18:36.743 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc01149a2eb] 2024-09-12T17:18:36.743 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc01149a49f] 2024-09-12T17:18:36.743 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5641ac91e0c1] 2024-09-12T17:18:36.743 INFO:tasks.workunit.client.0.smithi016.stderr: 4: radosgw-admin(+0x141007e) [0x5641ad37407e] 2024-09-12T17:18:36.743 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5641ac93018d] 2024-09-12T17:18:36.743 INFO:tasks.workunit.client.0.smithi016.stderr: 6: main() 2024-09-12T17:18:36.743 INFO:tasks.workunit.client.0.smithi016.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc010300d90] 2024-09-12T17:18:36.743 INFO:tasks.workunit.client.0.smithi016.stderr: 8: __libc_start_main() 2024-09-12T17:18:36.743 INFO:tasks.workunit.client.0.smithi016.stderr: 9: _start() 2024-09-12T17:18:36.744 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:36.745 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:18:36.745 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc010319520] 2024-09-12T17:18:36.745 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:18:36.746 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:18:36.746 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:18:36.746 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc01149a345] 2024-09-12T17:18:36.746 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc01149a49f] 2024-09-12T17:18:36.746 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5641ac91e0c1] 2024-09-12T17:18:36.746 INFO:tasks.workunit.client.0.smithi016.stderr: 8: radosgw-admin(+0x141007e) [0x5641ad37407e] 2024-09-12T17:18:36.746 INFO:tasks.workunit.client.0.smithi016.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5641ac93018d] 2024-09-12T17:18:36.746 INFO:tasks.workunit.client.0.smithi016.stderr: 10: main() 2024-09-12T17:18:36.746 INFO:tasks.workunit.client.0.smithi016.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc010300d90] 2024-09-12T17:18:36.746 INFO:tasks.workunit.client.0.smithi016.stderr: 12: __libc_start_main() 2024-09-12T17:18:36.746 INFO:tasks.workunit.client.0.smithi016.stderr: 13: _start() 2024-09-12T17:18:36.746 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.743+0000 7fc00dbc09c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:18:36.747 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7fc00dbc09c0 thread_name:radosgw-admin 2024-09-12T17:18:36.747 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:36.747 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:18:36.747 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc010319520] 2024-09-12T17:18:36.747 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:18:36.747 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:18:36.747 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:18:36.747 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc01149a345] 2024-09-12T17:18:36.747 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc01149a49f] 2024-09-12T17:18:36.747 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5641ac91e0c1] 2024-09-12T17:18:36.747 INFO:tasks.workunit.client.0.smithi016.stderr: 8: radosgw-admin(+0x141007e) [0x5641ad37407e] 2024-09-12T17:18:36.747 INFO:tasks.workunit.client.0.smithi016.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5641ac93018d] 2024-09-12T17:18:36.747 INFO:tasks.workunit.client.0.smithi016.stderr: 10: main() 2024-09-12T17:18:36.748 INFO:tasks.workunit.client.0.smithi016.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc010300d90] 2024-09-12T17:18:36.748 INFO:tasks.workunit.client.0.smithi016.stderr: 12: __libc_start_main() 2024-09-12T17:18:36.748 INFO:tasks.workunit.client.0.smithi016.stderr: 13: _start() 2024-09-12T17:18:36.748 INFO:tasks.workunit.client.0.smithi016.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:18:36.748 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:36.748 INFO:tasks.workunit.client.0.smithi016.stderr:--- begin dump of recent events --- 2024-09-12T17:18:36.790 INFO:tasks.workunit.client.0.smithi016.stderr: -499> 2024-09-12T17:18:36.419+0000 7fbef960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:18:36.790 INFO:tasks.workunit.client.0.smithi016.stderr: -498> 2024-09-12T17:18:36.419+0000 7fbef960a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:18:36.790 INFO:tasks.workunit.client.0.smithi016.stderr: -497> 2024-09-12T17:18:36.419+0000 7fbef960a640 10 monclient: dump: 2024-09-12T17:18:36.790 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:18:36.790 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:18:36.790 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:18:36.790 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:18:36.790 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:18:36.791 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:18:36.791 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:18:36.791 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:18:36.791 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:18:36.791 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:36.791 INFO:tasks.workunit.client.0.smithi016.stderr: -496> 2024-09-12T17:18:36.419+0000 7fbef960a640 10 monclient: _finish_auth 0 2024-09-12T17:18:36.791 INFO:tasks.workunit.client.0.smithi016.stderr: -495> 2024-09-12T17:18:36.419+0000 7fbef960a640 10 monclient: _check_auth_tickets 2024-09-12T17:18:36.791 INFO:tasks.workunit.client.0.smithi016.stderr: -494> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 monclient: authenticate success, global_id 6819 2024-09-12T17:18:36.791 INFO:tasks.workunit.client.0.smithi016.stderr: -493> 2024-09-12T17:18:36.419+0000 7fbef960a640 10 monclient: handle_config config(0 keys) 2024-09-12T17:18:36.791 INFO:tasks.workunit.client.0.smithi016.stderr: -492> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 10 monclient: get_monmap_and_config success 2024-09-12T17:18:36.791 INFO:tasks.workunit.client.0.smithi016.stderr: -491> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 4 set_mon_vals no callback set 2024-09-12T17:18:36.791 INFO:tasks.workunit.client.0.smithi016.stderr: -490> 2024-09-12T17:18:36.419+0000 7fbef960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:18:36.791 INFO:tasks.workunit.client.0.smithi016.stderr: -489> 2024-09-12T17:18:36.419+0000 7fbef960a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:18:36.791 INFO:tasks.workunit.client.0.smithi016.stderr: -488> 2024-09-12T17:18:36.419+0000 7fbef960a640 10 monclient: dump: 2024-09-12T17:18:36.792 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:18:36.792 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:18:36.792 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:18:36.792 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:18:36.792 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:18:36.792 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:18:36.792 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:18:36.792 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:18:36.792 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:18:36.792 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:36.792 INFO:tasks.workunit.client.0.smithi016.stderr: -487> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 10 monclient: shutdown 2024-09-12T17:18:36.792 INFO:tasks.workunit.client.0.smithi016.stderr: -486> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 asok(0x5641aeda22b0) unregister_commands rotate-key 2024-09-12T17:18:36.792 INFO:tasks.workunit.client.0.smithi016.stderr: -485> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 10 monclient: build_initial_monmap 2024-09-12T17:18:36.793 INFO:tasks.workunit.client.0.smithi016.stderr: -484> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 1 build_initial for_mkfs: 0 2024-09-12T17:18:36.793 INFO:tasks.workunit.client.0.smithi016.stderr: -483> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 10 monclient: monmap: 2024-09-12T17:18:36.793 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:18:36.793 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:18:36.793 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:18:36.793 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:18:36.793 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:18:36.793 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:18:36.793 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:18:36.793 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:18:36.793 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:18:36.793 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:36.793 INFO:tasks.workunit.client.0.smithi016.stderr: -482> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefb0530) adding auth protocol: cephx 2024-09-12T17:18:36.794 INFO:tasks.workunit.client.0.smithi016.stderr: -481> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefb0530) adding auth protocol: cephx 2024-09-12T17:18:36.794 INFO:tasks.workunit.client.0.smithi016.stderr: -480> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefb0530) adding auth protocol: cephx 2024-09-12T17:18:36.794 INFO:tasks.workunit.client.0.smithi016.stderr: -479> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefb0530) adding con mode: secure 2024-09-12T17:18:36.794 INFO:tasks.workunit.client.0.smithi016.stderr: -478> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefb0530) adding con mode: crc 2024-09-12T17:18:36.794 INFO:tasks.workunit.client.0.smithi016.stderr: -477> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefb0530) adding con mode: secure 2024-09-12T17:18:36.794 INFO:tasks.workunit.client.0.smithi016.stderr: -476> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefb0530) adding con mode: crc 2024-09-12T17:18:36.794 INFO:tasks.workunit.client.0.smithi016.stderr: -475> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefb0530) adding con mode: secure 2024-09-12T17:18:36.794 INFO:tasks.workunit.client.0.smithi016.stderr: -474> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefb0530) adding con mode: crc 2024-09-12T17:18:36.794 INFO:tasks.workunit.client.0.smithi016.stderr: -473> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefb0530) adding con mode: crc 2024-09-12T17:18:36.794 INFO:tasks.workunit.client.0.smithi016.stderr: -472> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefb0530) adding con mode: secure 2024-09-12T17:18:36.794 INFO:tasks.workunit.client.0.smithi016.stderr: -471> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefb0530) adding con mode: crc 2024-09-12T17:18:36.794 INFO:tasks.workunit.client.0.smithi016.stderr: -470> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefb0530) adding con mode: secure 2024-09-12T17:18:36.794 INFO:tasks.workunit.client.0.smithi016.stderr: -469> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefb0530) adding con mode: crc 2024-09-12T17:18:36.795 INFO:tasks.workunit.client.0.smithi016.stderr: -468> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefb0530) adding con mode: secure 2024-09-12T17:18:36.795 INFO:tasks.workunit.client.0.smithi016.stderr: -467> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:18:36.795 INFO:tasks.workunit.client.0.smithi016.stderr: -466> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 1 librados: starting msgr at 2024-09-12T17:18:36.795 INFO:tasks.workunit.client.0.smithi016.stderr: -465> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 1 librados: starting objecter 2024-09-12T17:18:36.795 INFO:tasks.workunit.client.0.smithi016.stderr: -464> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 asok(0x5641aeda22b0) register_command objecter_requests hook 0x5641aefb3990 2024-09-12T17:18:36.795 INFO:tasks.workunit.client.0.smithi016.stderr: -463> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 1 librados: setting wanted keys 2024-09-12T17:18:36.795 INFO:tasks.workunit.client.0.smithi016.stderr: -462> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 1 librados: calling monclient init 2024-09-12T17:18:36.795 INFO:tasks.workunit.client.0.smithi016.stderr: -461> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 10 monclient: init 2024-09-12T17:18:36.795 INFO:tasks.workunit.client.0.smithi016.stderr: -460> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefad130) adding auth protocol: cephx 2024-09-12T17:18:36.795 INFO:tasks.workunit.client.0.smithi016.stderr: -459> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefad130) adding auth protocol: cephx 2024-09-12T17:18:36.795 INFO:tasks.workunit.client.0.smithi016.stderr: -458> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefad130) adding auth protocol: cephx 2024-09-12T17:18:36.795 INFO:tasks.workunit.client.0.smithi016.stderr: -457> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefad130) adding con mode: secure 2024-09-12T17:18:36.795 INFO:tasks.workunit.client.0.smithi016.stderr: -456> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefad130) adding con mode: crc 2024-09-12T17:18:36.796 INFO:tasks.workunit.client.0.smithi016.stderr: -455> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefad130) adding con mode: secure 2024-09-12T17:18:36.796 INFO:tasks.workunit.client.0.smithi016.stderr: -454> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefad130) adding con mode: crc 2024-09-12T17:18:36.796 INFO:tasks.workunit.client.0.smithi016.stderr: -453> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefad130) adding con mode: secure 2024-09-12T17:18:36.796 INFO:tasks.workunit.client.0.smithi016.stderr: -452> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefad130) adding con mode: crc 2024-09-12T17:18:36.796 INFO:tasks.workunit.client.0.smithi016.stderr: -451> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefad130) adding con mode: crc 2024-09-12T17:18:36.796 INFO:tasks.workunit.client.0.smithi016.stderr: -450> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefad130) adding con mode: secure 2024-09-12T17:18:36.796 INFO:tasks.workunit.client.0.smithi016.stderr: -449> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefad130) adding con mode: crc 2024-09-12T17:18:36.796 INFO:tasks.workunit.client.0.smithi016.stderr: -448> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefad130) adding con mode: secure 2024-09-12T17:18:36.796 INFO:tasks.workunit.client.0.smithi016.stderr: -447> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefad130) adding con mode: crc 2024-09-12T17:18:36.796 INFO:tasks.workunit.client.0.smithi016.stderr: -446> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefad130) adding con mode: secure 2024-09-12T17:18:36.796 INFO:tasks.workunit.client.0.smithi016.stderr: -445> 2024-09-12T17:18:36.423+0000 7fc00dbc09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:18:36.796 INFO:tasks.workunit.client.0.smithi016.stderr: -444> 2024-09-12T17:18:36.423+0000 7fc00dbc09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:18:36.796 INFO:tasks.workunit.client.0.smithi016.stderr: -443> 2024-09-12T17:18:36.423+0000 7fc00dbc09c0 5 asok(0x5641aeda22b0) register_command rotate-key hook 0x5641aefad278 2024-09-12T17:18:36.797 INFO:tasks.workunit.client.0.smithi016.stderr: -442> 2024-09-12T17:18:36.423+0000 7fc00dbc09c0 10 monclient: _reopen_session rank -1 2024-09-12T17:18:36.797 INFO:tasks.workunit.client.0.smithi016.stderr: -441> 2024-09-12T17:18:36.423+0000 7fc00dbc09c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:18:36.797 INFO:tasks.workunit.client.0.smithi016.stderr: -440> 2024-09-12T17:18:36.423+0000 7fc00dbc09c0 10 monclient(hunting): picked mon.noname-c con 0x5641aefb33d0 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:18:36.797 INFO:tasks.workunit.client.0.smithi016.stderr: -439> 2024-09-12T17:18:36.423+0000 7fc00dbc09c0 10 monclient(hunting): picked mon.noname-b con 0x5641aefd9c10 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:18:36.797 INFO:tasks.workunit.client.0.smithi016.stderr: -438> 2024-09-12T17:18:36.423+0000 7fc00dbc09c0 10 monclient(hunting): picked mon.noname-a con 0x7fbff4003100 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:18:36.797 INFO:tasks.workunit.client.0.smithi016.stderr: -437> 2024-09-12T17:18:36.423+0000 7fc00dbc09c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:18:36.797 INFO:tasks.workunit.client.0.smithi016.stderr: -436> 2024-09-12T17:18:36.423+0000 7fc00dbc09c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:18:36.797 INFO:tasks.workunit.client.0.smithi016.stderr: -435> 2024-09-12T17:18:36.423+0000 7fc00dbc09c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:18:36.797 INFO:tasks.workunit.client.0.smithi016.stderr: -434> 2024-09-12T17:18:36.423+0000 7fc00dbc09c0 10 monclient(hunting): _renew_subs 2024-09-12T17:18:36.797 INFO:tasks.workunit.client.0.smithi016.stderr: -433> 2024-09-12T17:18:36.423+0000 7fc00dbc09c0 10 monclient(hunting): authenticate will time out at 2234.400457s 2024-09-12T17:18:36.797 INFO:tasks.workunit.client.0.smithi016.stderr: -432> 2024-09-12T17:18:36.423+0000 7fc00b6c6640 10 monclient(hunting): get_auth_request con 0x5641aefb33d0 auth_method 0 2024-09-12T17:18:36.797 INFO:tasks.workunit.client.0.smithi016.stderr: -431> 2024-09-12T17:18:36.423+0000 7fc00b6c6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:18:36.797 INFO:tasks.workunit.client.0.smithi016.stderr: -430> 2024-09-12T17:18:36.423+0000 7fc00b6c6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:18:36.798 INFO:tasks.workunit.client.0.smithi016.stderr: -429> 2024-09-12T17:18:36.423+0000 7fc00b6c6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:18:36.798 INFO:tasks.workunit.client.0.smithi016.stderr: -428> 2024-09-12T17:18:36.423+0000 7fc00bec7640 10 monclient(hunting): get_auth_request con 0x7fbff4003100 auth_method 0 2024-09-12T17:18:36.798 INFO:tasks.workunit.client.0.smithi016.stderr: -427> 2024-09-12T17:18:36.423+0000 7fc00bec7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:18:36.798 INFO:tasks.workunit.client.0.smithi016.stderr: -426> 2024-09-12T17:18:36.423+0000 7fc00bec7640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:18:36.798 INFO:tasks.workunit.client.0.smithi016.stderr: -425> 2024-09-12T17:18:36.423+0000 7fc00bec7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:18:36.798 INFO:tasks.workunit.client.0.smithi016.stderr: -424> 2024-09-12T17:18:36.423+0000 7fc00b6c6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:18:36.798 INFO:tasks.workunit.client.0.smithi016.stderr: -423> 2024-09-12T17:18:36.423+0000 7fc00b6c6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:18:36.798 INFO:tasks.workunit.client.0.smithi016.stderr: -422> 2024-09-12T17:18:36.423+0000 7fc00b6c6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:18:36.798 INFO:tasks.workunit.client.0.smithi016.stderr: -421> 2024-09-12T17:18:36.423+0000 7fc00bec7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:18:36.798 INFO:tasks.workunit.client.0.smithi016.stderr: -420> 2024-09-12T17:18:36.423+0000 7fc00bec7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:18:36.798 INFO:tasks.workunit.client.0.smithi016.stderr: -419> 2024-09-12T17:18:36.423+0000 7fc00bec7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:18:36.798 INFO:tasks.workunit.client.0.smithi016.stderr: -418> 2024-09-12T17:18:36.423+0000 7fc00b6c6640 10 monclient(hunting): handle_auth_done global_id 6530 payload 824 2024-09-12T17:18:36.798 INFO:tasks.workunit.client.0.smithi016.stderr: -417> 2024-09-12T17:18:36.423+0000 7fc00b6c6640 10 monclient: _finish_hunting 0 2024-09-12T17:18:36.798 INFO:tasks.workunit.client.0.smithi016.stderr: -416> 2024-09-12T17:18:36.423+0000 7fc00b6c6640 1 monclient: found mon.noname-c 2024-09-12T17:18:36.799 INFO:tasks.workunit.client.0.smithi016.stderr: -415> 2024-09-12T17:18:36.423+0000 7fc00b6c6640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:18:36.799 INFO:tasks.workunit.client.0.smithi016.stderr: -414> 2024-09-12T17:18:36.423+0000 7fbef7e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:18:36.799 INFO:tasks.workunit.client.0.smithi016.stderr: -413> 2024-09-12T17:18:36.423+0000 7fbef7e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:18:36.799 INFO:tasks.workunit.client.0.smithi016.stderr: -412> 2024-09-12T17:18:36.423+0000 7fbef7e07640 10 monclient: dump: 2024-09-12T17:18:36.799 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:18:36.799 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:18:36.799 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:18:36.799 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:18:36.799 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:18:36.799 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:18:36.799 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:18:36.799 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:18:36.799 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:18:36.799 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:36.800 INFO:tasks.workunit.client.0.smithi016.stderr: -411> 2024-09-12T17:18:36.423+0000 7fbef7e07640 10 monclient: _finish_auth 0 2024-09-12T17:18:36.800 INFO:tasks.workunit.client.0.smithi016.stderr: -410> 2024-09-12T17:18:36.423+0000 7fbef7e07640 10 monclient: _check_auth_tickets 2024-09-12T17:18:36.800 INFO:tasks.workunit.client.0.smithi016.stderr: -409> 2024-09-12T17:18:36.423+0000 7fbef7e07640 10 monclient: handle_config config(0 keys) 2024-09-12T17:18:36.800 INFO:tasks.workunit.client.0.smithi016.stderr: -408> 2024-09-12T17:18:36.423+0000 7fbef7e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:18:36.800 INFO:tasks.workunit.client.0.smithi016.stderr: -407> 2024-09-12T17:18:36.423+0000 7fbef7e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:18:36.800 INFO:tasks.workunit.client.0.smithi016.stderr: -406> 2024-09-12T17:18:36.423+0000 7fbef7e07640 10 monclient: dump: 2024-09-12T17:18:36.800 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:18:36.800 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:18:36.800 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:18:36.800 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:18:36.800 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:18:36.800 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:18:36.800 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:18:36.801 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:18:36.801 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:18:36.801 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:36.801 INFO:tasks.workunit.client.0.smithi016.stderr: -405> 2024-09-12T17:18:36.423+0000 7fc00dbc09c0 5 monclient: authenticate success, global_id 6530 2024-09-12T17:18:36.801 INFO:tasks.workunit.client.0.smithi016.stderr: -404> 2024-09-12T17:18:36.423+0000 7fc00dbc09c0 10 monclient: _renew_subs 2024-09-12T17:18:36.801 INFO:tasks.workunit.client.0.smithi016.stderr: -403> 2024-09-12T17:18:36.423+0000 7fbef960a640 4 set_mon_vals no callback set 2024-09-12T17:18:36.801 INFO:tasks.workunit.client.0.smithi016.stderr: -402> 2024-09-12T17:18:36.423+0000 7fc00dbc09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:18:36.801 INFO:tasks.workunit.client.0.smithi016.stderr: -401> 2024-09-12T17:18:36.423+0000 7fc00dbc09c0 10 monclient: _renew_subs 2024-09-12T17:18:36.801 INFO:tasks.workunit.client.0.smithi016.stderr: -400> 2024-09-12T17:18:36.423+0000 7fc00dbc09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:18:36.801 INFO:tasks.workunit.client.0.smithi016.stderr: -399> 2024-09-12T17:18:36.423+0000 7fc00dbc09c0 1 librados: init done 2024-09-12T17:18:36.801 INFO:tasks.workunit.client.0.smithi016.stderr: -398> 2024-09-12T17:18:36.423+0000 7fbef7e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:18:36.801 INFO:tasks.workunit.client.0.smithi016.stderr: -397> 2024-09-12T17:18:36.423+0000 7fbef7e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:18:36.801 INFO:tasks.workunit.client.0.smithi016.stderr: -396> 2024-09-12T17:18:36.423+0000 7fbef7e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:18:36.802 INFO:tasks.workunit.client.0.smithi016.stderr: -395> 2024-09-12T17:18:36.423+0000 7fc00aec5640 10 monclient: get_auth_request con 0x7fbef0070ae0 auth_method 0 2024-09-12T17:18:36.802 INFO:tasks.workunit.client.0.smithi016.stderr: -394> 2024-09-12T17:18:36.423+0000 7fc00bec7640 10 monclient: get_auth_request con 0x5641aefe14b0 auth_method 0 2024-09-12T17:18:36.802 INFO:tasks.workunit.client.0.smithi016.stderr: -393> 2024-09-12T17:18:36.427+0000 7fc00b6c6640 10 monclient: get_auth_request con 0x5641aeff8d40 auth_method 0 2024-09-12T17:18:36.802 INFO:tasks.workunit.client.0.smithi016.stderr: -392> 2024-09-12T17:18:36.427+0000 7fc00aec5640 10 monclient: get_auth_request con 0x5641aeffd0a0 auth_method 0 2024-09-12T17:18:36.802 INFO:tasks.workunit.client.0.smithi016.stderr: -391> 2024-09-12T17:18:36.431+0000 7fc00bec7640 10 monclient: get_auth_request con 0x5641aeffc570 auth_method 0 2024-09-12T17:18:36.802 INFO:tasks.workunit.client.0.smithi016.stderr: -390> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 10 monclient: build_initial_monmap 2024-09-12T17:18:36.802 INFO:tasks.workunit.client.0.smithi016.stderr: -389> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 1 build_initial for_mkfs: 0 2024-09-12T17:18:36.802 INFO:tasks.workunit.client.0.smithi016.stderr: -388> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 10 monclient: monmap: 2024-09-12T17:18:36.802 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:18:36.802 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:18:36.802 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:18:36.802 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:18:36.802 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:18:36.802 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:18:36.803 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:18:36.803 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:18:36.803 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:18:36.803 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:36.803 INFO:tasks.workunit.client.0.smithi016.stderr: -387> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af005050) adding auth protocol: cephx 2024-09-12T17:18:36.803 INFO:tasks.workunit.client.0.smithi016.stderr: -386> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af005050) adding auth protocol: cephx 2024-09-12T17:18:36.803 INFO:tasks.workunit.client.0.smithi016.stderr: -385> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af005050) adding auth protocol: cephx 2024-09-12T17:18:36.803 INFO:tasks.workunit.client.0.smithi016.stderr: -384> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af005050) adding con mode: secure 2024-09-12T17:18:36.803 INFO:tasks.workunit.client.0.smithi016.stderr: -383> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af005050) adding con mode: crc 2024-09-12T17:18:36.803 INFO:tasks.workunit.client.0.smithi016.stderr: -382> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af005050) adding con mode: secure 2024-09-12T17:18:36.803 INFO:tasks.workunit.client.0.smithi016.stderr: -381> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af005050) adding con mode: crc 2024-09-12T17:18:36.803 INFO:tasks.workunit.client.0.smithi016.stderr: -380> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af005050) adding con mode: secure 2024-09-12T17:18:36.803 INFO:tasks.workunit.client.0.smithi016.stderr: -379> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af005050) adding con mode: crc 2024-09-12T17:18:36.804 INFO:tasks.workunit.client.0.smithi016.stderr: -378> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af005050) adding con mode: crc 2024-09-12T17:18:36.804 INFO:tasks.workunit.client.0.smithi016.stderr: -377> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af005050) adding con mode: secure 2024-09-12T17:18:36.804 INFO:tasks.workunit.client.0.smithi016.stderr: -376> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af005050) adding con mode: crc 2024-09-12T17:18:36.804 INFO:tasks.workunit.client.0.smithi016.stderr: -375> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af005050) adding con mode: secure 2024-09-12T17:18:36.804 INFO:tasks.workunit.client.0.smithi016.stderr: -374> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af005050) adding con mode: crc 2024-09-12T17:18:36.804 INFO:tasks.workunit.client.0.smithi016.stderr: -373> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af005050) adding con mode: secure 2024-09-12T17:18:36.804 INFO:tasks.workunit.client.0.smithi016.stderr: -372> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:18:36.804 INFO:tasks.workunit.client.0.smithi016.stderr: -371> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 asok(0x5641aeda22b0) register_command objecter_requests cmddesc objecter_requests hook 0x5641af008a40 EEXIST 2024-09-12T17:18:36.804 INFO:tasks.workunit.client.0.smithi016.stderr: -370> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 10 monclient: init 2024-09-12T17:18:36.804 INFO:tasks.workunit.client.0.smithi016.stderr: -369> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af003f98) adding auth protocol: cephx 2024-09-12T17:18:36.804 INFO:tasks.workunit.client.0.smithi016.stderr: -368> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af003f98) adding auth protocol: cephx 2024-09-12T17:18:36.804 INFO:tasks.workunit.client.0.smithi016.stderr: -367> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af003f98) adding auth protocol: cephx 2024-09-12T17:18:36.804 INFO:tasks.workunit.client.0.smithi016.stderr: -366> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af003f98) adding con mode: secure 2024-09-12T17:18:36.804 INFO:tasks.workunit.client.0.smithi016.stderr: -365> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af003f98) adding con mode: crc 2024-09-12T17:18:36.805 INFO:tasks.workunit.client.0.smithi016.stderr: -364> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af003f98) adding con mode: secure 2024-09-12T17:18:36.805 INFO:tasks.workunit.client.0.smithi016.stderr: -363> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af003f98) adding con mode: crc 2024-09-12T17:18:36.805 INFO:tasks.workunit.client.0.smithi016.stderr: -362> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af003f98) adding con mode: secure 2024-09-12T17:18:36.805 INFO:tasks.workunit.client.0.smithi016.stderr: -361> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af003f98) adding con mode: crc 2024-09-12T17:18:36.805 INFO:tasks.workunit.client.0.smithi016.stderr: -360> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af003f98) adding con mode: crc 2024-09-12T17:18:36.805 INFO:tasks.workunit.client.0.smithi016.stderr: -359> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af003f98) adding con mode: secure 2024-09-12T17:18:36.805 INFO:tasks.workunit.client.0.smithi016.stderr: -358> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af003f98) adding con mode: crc 2024-09-12T17:18:36.805 INFO:tasks.workunit.client.0.smithi016.stderr: -357> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af003f98) adding con mode: secure 2024-09-12T17:18:36.805 INFO:tasks.workunit.client.0.smithi016.stderr: -356> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af003f98) adding con mode: crc 2024-09-12T17:18:36.805 INFO:tasks.workunit.client.0.smithi016.stderr: -355> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af003f98) adding con mode: secure 2024-09-12T17:18:36.805 INFO:tasks.workunit.client.0.smithi016.stderr: -354> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:18:36.805 INFO:tasks.workunit.client.0.smithi016.stderr: -353> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:18:36.805 INFO:tasks.workunit.client.0.smithi016.stderr: -352> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 asok(0x5641aeda22b0) register_command rotate-key cmddesc rotate-key hook 0x5641af0040e0 EEXIST 2024-09-12T17:18:36.806 INFO:tasks.workunit.client.0.smithi016.stderr: -351> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 10 monclient: _reopen_session rank -1 2024-09-12T17:18:36.806 INFO:tasks.workunit.client.0.smithi016.stderr: -350> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:18:36.806 INFO:tasks.workunit.client.0.smithi016.stderr: -349> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 10 monclient(hunting): picked mon.noname-b con 0x5641af02cbf0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:18:36.806 INFO:tasks.workunit.client.0.smithi016.stderr: -348> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 10 monclient(hunting): picked mon.noname-a con 0x5641af02c520 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:18:36.806 INFO:tasks.workunit.client.0.smithi016.stderr: -347> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 10 monclient(hunting): picked mon.noname-c con 0x5641af02af00 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:18:36.806 INFO:tasks.workunit.client.0.smithi016.stderr: -346> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:18:36.806 INFO:tasks.workunit.client.0.smithi016.stderr: -345> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:18:36.806 INFO:tasks.workunit.client.0.smithi016.stderr: -344> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:18:36.806 INFO:tasks.workunit.client.0.smithi016.stderr: -343> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 10 monclient(hunting): _renew_subs 2024-09-12T17:18:36.806 INFO:tasks.workunit.client.0.smithi016.stderr: -342> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 10 monclient(hunting): authenticate will time out at 2234.411877s 2024-09-12T17:18:36.806 INFO:tasks.workunit.client.0.smithi016.stderr: -341> 2024-09-12T17:18:36.435+0000 7fc00b6c6640 10 monclient(hunting): get_auth_request con 0x5641af02af00 auth_method 0 2024-09-12T17:18:36.806 INFO:tasks.workunit.client.0.smithi016.stderr: -340> 2024-09-12T17:18:36.435+0000 7fc00b6c6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:18:36.807 INFO:tasks.workunit.client.0.smithi016.stderr: -339> 2024-09-12T17:18:36.435+0000 7fc00b6c6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:18:36.807 INFO:tasks.workunit.client.0.smithi016.stderr: -338> 2024-09-12T17:18:36.435+0000 7fc00b6c6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:18:36.807 INFO:tasks.workunit.client.0.smithi016.stderr: -337> 2024-09-12T17:18:36.435+0000 7fc00bec7640 10 monclient(hunting): get_auth_request con 0x5641af02c520 auth_method 0 2024-09-12T17:18:36.807 INFO:tasks.workunit.client.0.smithi016.stderr: -336> 2024-09-12T17:18:36.435+0000 7fc00bec7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:18:36.807 INFO:tasks.workunit.client.0.smithi016.stderr: -335> 2024-09-12T17:18:36.435+0000 7fc00bec7640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:18:36.807 INFO:tasks.workunit.client.0.smithi016.stderr: -334> 2024-09-12T17:18:36.435+0000 7fc00bec7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:18:36.807 INFO:tasks.workunit.client.0.smithi016.stderr: -333> 2024-09-12T17:18:36.435+0000 7fc00b6c6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:18:36.807 INFO:tasks.workunit.client.0.smithi016.stderr: -332> 2024-09-12T17:18:36.435+0000 7fc00b6c6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:18:36.807 INFO:tasks.workunit.client.0.smithi016.stderr: -331> 2024-09-12T17:18:36.435+0000 7fc00b6c6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:18:36.807 INFO:tasks.workunit.client.0.smithi016.stderr: -330> 2024-09-12T17:18:36.435+0000 7fc00bec7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:18:36.807 INFO:tasks.workunit.client.0.smithi016.stderr: -329> 2024-09-12T17:18:36.435+0000 7fc00bec7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:18:36.807 INFO:tasks.workunit.client.0.smithi016.stderr: -328> 2024-09-12T17:18:36.435+0000 7fc00bec7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:18:36.807 INFO:tasks.workunit.client.0.smithi016.stderr: -327> 2024-09-12T17:18:36.435+0000 7fc00aec5640 10 monclient(hunting): get_auth_request con 0x5641af02cbf0 auth_method 0 2024-09-12T17:18:36.808 INFO:tasks.workunit.client.0.smithi016.stderr: -326> 2024-09-12T17:18:36.435+0000 7fc00aec5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:18:36.808 INFO:tasks.workunit.client.0.smithi016.stderr: -325> 2024-09-12T17:18:36.435+0000 7fc00aec5640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:18:36.808 INFO:tasks.workunit.client.0.smithi016.stderr: -324> 2024-09-12T17:18:36.435+0000 7fc00aec5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:18:36.808 INFO:tasks.workunit.client.0.smithi016.stderr: -323> 2024-09-12T17:18:36.435+0000 7fc00b6c6640 10 monclient(hunting): handle_auth_done global_id 6533 payload 824 2024-09-12T17:18:36.808 INFO:tasks.workunit.client.0.smithi016.stderr: -322> 2024-09-12T17:18:36.435+0000 7fc00b6c6640 10 monclient: _finish_hunting 0 2024-09-12T17:18:36.808 INFO:tasks.workunit.client.0.smithi016.stderr: -321> 2024-09-12T17:18:36.435+0000 7fc00b6c6640 1 monclient: found mon.noname-c 2024-09-12T17:18:36.808 INFO:tasks.workunit.client.0.smithi016.stderr: -320> 2024-09-12T17:18:36.435+0000 7fc00b6c6640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:18:36.808 INFO:tasks.workunit.client.0.smithi016.stderr: -319> 2024-09-12T17:18:36.435+0000 7fbef5602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:18:36.808 INFO:tasks.workunit.client.0.smithi016.stderr: -318> 2024-09-12T17:18:36.435+0000 7fbef5602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:18:36.808 INFO:tasks.workunit.client.0.smithi016.stderr: -317> 2024-09-12T17:18:36.435+0000 7fbef5602640 10 monclient: dump: 2024-09-12T17:18:36.808 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:18:36.808 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:18:36.808 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:18:36.809 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:18:36.809 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:18:36.809 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:18:36.809 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:18:36.809 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:18:36.809 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:18:36.809 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:36.809 INFO:tasks.workunit.client.0.smithi016.stderr: -316> 2024-09-12T17:18:36.435+0000 7fbef5602640 10 monclient: _finish_auth 0 2024-09-12T17:18:36.809 INFO:tasks.workunit.client.0.smithi016.stderr: -315> 2024-09-12T17:18:36.435+0000 7fbef5602640 10 monclient: _check_auth_tickets 2024-09-12T17:18:36.809 INFO:tasks.workunit.client.0.smithi016.stderr: -314> 2024-09-12T17:18:36.435+0000 7fbef5602640 10 monclient: handle_config config(0 keys) 2024-09-12T17:18:36.809 INFO:tasks.workunit.client.0.smithi016.stderr: -313> 2024-09-12T17:18:36.435+0000 7fbef5602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:18:36.809 INFO:tasks.workunit.client.0.smithi016.stderr: -312> 2024-09-12T17:18:36.435+0000 7fbef5602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:18:36.809 INFO:tasks.workunit.client.0.smithi016.stderr: -311> 2024-09-12T17:18:36.435+0000 7fbef5602640 10 monclient: dump: 2024-09-12T17:18:36.809 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:18:36.810 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:18:36.810 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:18:36.810 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:18:36.810 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:18:36.810 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:18:36.810 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:18:36.810 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:18:36.810 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:18:36.810 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:36.810 INFO:tasks.workunit.client.0.smithi016.stderr: -310> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 monclient: authenticate success, global_id 6533 2024-09-12T17:18:36.810 INFO:tasks.workunit.client.0.smithi016.stderr: -309> 2024-09-12T17:18:36.435+0000 7fc00c6c8640 4 set_mon_vals no callback set 2024-09-12T17:18:36.810 INFO:tasks.workunit.client.0.smithi016.stderr: -308> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 10 monclient: _renew_subs 2024-09-12T17:18:36.810 INFO:tasks.workunit.client.0.smithi016.stderr: -307> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:18:36.810 INFO:tasks.workunit.client.0.smithi016.stderr: -306> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 10 monclient: _renew_subs 2024-09-12T17:18:36.811 INFO:tasks.workunit.client.0.smithi016.stderr: -305> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:18:36.811 INFO:tasks.workunit.client.0.smithi016.stderr: -304> 2024-09-12T17:18:36.435+0000 7fbef5602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:18:36.811 INFO:tasks.workunit.client.0.smithi016.stderr: -303> 2024-09-12T17:18:36.435+0000 7fbef5602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:18:36.811 INFO:tasks.workunit.client.0.smithi016.stderr: -302> 2024-09-12T17:18:36.435+0000 7fbef5602640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:18:36.811 INFO:tasks.workunit.client.0.smithi016.stderr: -301> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 10 monclient: get_monmap_and_config 2024-09-12T17:18:36.811 INFO:tasks.workunit.client.0.smithi016.stderr: -300> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 10 monclient: build_initial_monmap 2024-09-12T17:18:36.811 INFO:tasks.workunit.client.0.smithi016.stderr: -299> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 1 build_initial for_mkfs: 0 2024-09-12T17:18:36.811 INFO:tasks.workunit.client.0.smithi016.stderr: -298> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 10 monclient: monmap: 2024-09-12T17:18:36.811 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:18:36.811 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:18:36.811 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:18:36.811 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:18:36.811 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:18:36.811 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:18:36.812 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:18:36.812 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:18:36.812 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:18:36.812 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:36.812 INFO:tasks.workunit.client.0.smithi016.stderr: -297> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af04c100) adding auth protocol: cephx 2024-09-12T17:18:36.812 INFO:tasks.workunit.client.0.smithi016.stderr: -296> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af04c100) adding auth protocol: cephx 2024-09-12T17:18:36.812 INFO:tasks.workunit.client.0.smithi016.stderr: -295> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af04c100) adding auth protocol: cephx 2024-09-12T17:18:36.812 INFO:tasks.workunit.client.0.smithi016.stderr: -294> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af04c100) adding con mode: secure 2024-09-12T17:18:36.812 INFO:tasks.workunit.client.0.smithi016.stderr: -293> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af04c100) adding con mode: crc 2024-09-12T17:18:36.812 INFO:tasks.workunit.client.0.smithi016.stderr: -292> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af04c100) adding con mode: secure 2024-09-12T17:18:36.812 INFO:tasks.workunit.client.0.smithi016.stderr: -291> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af04c100) adding con mode: crc 2024-09-12T17:18:36.812 INFO:tasks.workunit.client.0.smithi016.stderr: -290> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af04c100) adding con mode: secure 2024-09-12T17:18:36.813 INFO:tasks.workunit.client.0.smithi016.stderr: -289> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af04c100) adding con mode: crc 2024-09-12T17:18:36.813 INFO:tasks.workunit.client.0.smithi016.stderr: -288> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af04c100) adding con mode: crc 2024-09-12T17:18:36.813 INFO:tasks.workunit.client.0.smithi016.stderr: -287> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af04c100) adding con mode: secure 2024-09-12T17:18:36.813 INFO:tasks.workunit.client.0.smithi016.stderr: -286> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af04c100) adding con mode: crc 2024-09-12T17:18:36.813 INFO:tasks.workunit.client.0.smithi016.stderr: -285> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af04c100) adding con mode: secure 2024-09-12T17:18:36.813 INFO:tasks.workunit.client.0.smithi016.stderr: -284> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af04c100) adding con mode: crc 2024-09-12T17:18:36.813 INFO:tasks.workunit.client.0.smithi016.stderr: -283> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af04c100) adding con mode: secure 2024-09-12T17:18:36.813 INFO:tasks.workunit.client.0.smithi016.stderr: -282> 2024-09-12T17:18:36.435+0000 7fc00aec5640 10 monclient: get_auth_request con 0x7fbee4070a20 auth_method 0 2024-09-12T17:18:36.813 INFO:tasks.workunit.client.0.smithi016.stderr: -281> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:18:36.813 INFO:tasks.workunit.client.0.smithi016.stderr: -280> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 10 monclient: init 2024-09-12T17:18:36.813 INFO:tasks.workunit.client.0.smithi016.stderr: -279> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6275e40) adding auth protocol: cephx 2024-09-12T17:18:36.813 INFO:tasks.workunit.client.0.smithi016.stderr: -278> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6275e40) adding auth protocol: cephx 2024-09-12T17:18:36.813 INFO:tasks.workunit.client.0.smithi016.stderr: -277> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6275e40) adding auth protocol: cephx 2024-09-12T17:18:36.813 INFO:tasks.workunit.client.0.smithi016.stderr: -276> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6275e40) adding con mode: secure 2024-09-12T17:18:36.814 INFO:tasks.workunit.client.0.smithi016.stderr: -275> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6275e40) adding con mode: crc 2024-09-12T17:18:36.814 INFO:tasks.workunit.client.0.smithi016.stderr: -274> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6275e40) adding con mode: secure 2024-09-12T17:18:36.814 INFO:tasks.workunit.client.0.smithi016.stderr: -273> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6275e40) adding con mode: crc 2024-09-12T17:18:36.814 INFO:tasks.workunit.client.0.smithi016.stderr: -272> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6275e40) adding con mode: secure 2024-09-12T17:18:36.814 INFO:tasks.workunit.client.0.smithi016.stderr: -271> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6275e40) adding con mode: crc 2024-09-12T17:18:36.814 INFO:tasks.workunit.client.0.smithi016.stderr: -270> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6275e40) adding con mode: crc 2024-09-12T17:18:36.814 INFO:tasks.workunit.client.0.smithi016.stderr: -269> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6275e40) adding con mode: secure 2024-09-12T17:18:36.814 INFO:tasks.workunit.client.0.smithi016.stderr: -268> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6275e40) adding con mode: crc 2024-09-12T17:18:36.814 INFO:tasks.workunit.client.0.smithi016.stderr: -267> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6275e40) adding con mode: secure 2024-09-12T17:18:36.814 INFO:tasks.workunit.client.0.smithi016.stderr: -266> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6275e40) adding con mode: crc 2024-09-12T17:18:36.814 INFO:tasks.workunit.client.0.smithi016.stderr: -265> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6275e40) adding con mode: secure 2024-09-12T17:18:36.814 INFO:tasks.workunit.client.0.smithi016.stderr: -264> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:18:36.814 INFO:tasks.workunit.client.0.smithi016.stderr: -263> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:18:36.815 INFO:tasks.workunit.client.0.smithi016.stderr: -262> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 asok(0x5641aeda22b0) register_command rotate-key cmddesc rotate-key hook 0x7ffdd6275f88 EEXIST 2024-09-12T17:18:36.815 INFO:tasks.workunit.client.0.smithi016.stderr: -261> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient: _reopen_session rank -1 2024-09-12T17:18:36.815 INFO:tasks.workunit.client.0.smithi016.stderr: -260> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:18:36.815 INFO:tasks.workunit.client.0.smithi016.stderr: -259> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient(hunting): picked mon.noname-a con 0x5641af0805b0 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:18:36.815 INFO:tasks.workunit.client.0.smithi016.stderr: -258> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient(hunting): picked mon.noname-c con 0x5641af051690 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:18:36.815 INFO:tasks.workunit.client.0.smithi016.stderr: -257> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient(hunting): picked mon.noname-b con 0x5641af07bec0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:18:36.815 INFO:tasks.workunit.client.0.smithi016.stderr: -256> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:18:36.815 INFO:tasks.workunit.client.0.smithi016.stderr: -255> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:18:36.815 INFO:tasks.workunit.client.0.smithi016.stderr: -254> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:18:36.815 INFO:tasks.workunit.client.0.smithi016.stderr: -253> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient(hunting): _renew_subs 2024-09-12T17:18:36.815 INFO:tasks.workunit.client.0.smithi016.stderr: -252> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient(hunting): authenticate will time out at 2234.416083s 2024-09-12T17:18:36.815 INFO:tasks.workunit.client.0.smithi016.stderr: -251> 2024-09-12T17:18:36.439+0000 7fc00aec5640 10 monclient(hunting): get_auth_request con 0x5641af0805b0 auth_method 0 2024-09-12T17:18:36.815 INFO:tasks.workunit.client.0.smithi016.stderr: -250> 2024-09-12T17:18:36.439+0000 7fc00aec5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:18:36.815 INFO:tasks.workunit.client.0.smithi016.stderr: -249> 2024-09-12T17:18:36.439+0000 7fc00aec5640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:18:36.816 INFO:tasks.workunit.client.0.smithi016.stderr: -248> 2024-09-12T17:18:36.439+0000 7fc00aec5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:18:36.816 INFO:tasks.workunit.client.0.smithi016.stderr: -247> 2024-09-12T17:18:36.439+0000 7fc00bec7640 10 monclient(hunting): get_auth_request con 0x5641af051690 auth_method 0 2024-09-12T17:18:36.816 INFO:tasks.workunit.client.0.smithi016.stderr: -246> 2024-09-12T17:18:36.439+0000 7fc00bec7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:18:36.816 INFO:tasks.workunit.client.0.smithi016.stderr: -245> 2024-09-12T17:18:36.439+0000 7fc00bec7640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:18:36.816 INFO:tasks.workunit.client.0.smithi016.stderr: -244> 2024-09-12T17:18:36.439+0000 7fc00bec7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:18:36.816 INFO:tasks.workunit.client.0.smithi016.stderr: -243> 2024-09-12T17:18:36.439+0000 7fc00bec7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:18:36.816 INFO:tasks.workunit.client.0.smithi016.stderr: -242> 2024-09-12T17:18:36.439+0000 7fc00bec7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:18:36.816 INFO:tasks.workunit.client.0.smithi016.stderr: -241> 2024-09-12T17:18:36.439+0000 7fc00bec7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:18:36.816 INFO:tasks.workunit.client.0.smithi016.stderr: -240> 2024-09-12T17:18:36.439+0000 7fc00aec5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:18:36.816 INFO:tasks.workunit.client.0.smithi016.stderr: -239> 2024-09-12T17:18:36.439+0000 7fc00aec5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:18:36.816 INFO:tasks.workunit.client.0.smithi016.stderr: -238> 2024-09-12T17:18:36.439+0000 7fc00aec5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:18:36.816 INFO:tasks.workunit.client.0.smithi016.stderr: -237> 2024-09-12T17:18:36.439+0000 7fc00b6c6640 10 monclient(hunting): get_auth_request con 0x5641af07bec0 auth_method 0 2024-09-12T17:18:36.816 INFO:tasks.workunit.client.0.smithi016.stderr: -236> 2024-09-12T17:18:36.439+0000 7fc00b6c6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:18:36.817 INFO:tasks.workunit.client.0.smithi016.stderr: -235> 2024-09-12T17:18:36.439+0000 7fc00b6c6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:18:36.817 INFO:tasks.workunit.client.0.smithi016.stderr: -234> 2024-09-12T17:18:36.439+0000 7fc00b6c6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:18:36.817 INFO:tasks.workunit.client.0.smithi016.stderr: -233> 2024-09-12T17:18:36.439+0000 7fc00bec7640 10 monclient(hunting): handle_auth_done global_id 6536 payload 274 2024-09-12T17:18:36.817 INFO:tasks.workunit.client.0.smithi016.stderr: -232> 2024-09-12T17:18:36.439+0000 7fc00bec7640 10 monclient: _finish_hunting 0 2024-09-12T17:18:36.817 INFO:tasks.workunit.client.0.smithi016.stderr: -231> 2024-09-12T17:18:36.439+0000 7fc00bec7640 1 monclient: found mon.noname-c 2024-09-12T17:18:36.817 INFO:tasks.workunit.client.0.smithi016.stderr: -230> 2024-09-12T17:18:36.439+0000 7fc00bec7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:18:36.817 INFO:tasks.workunit.client.0.smithi016.stderr: -229> 2024-09-12T17:18:36.439+0000 7fbeeeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:18:36.817 INFO:tasks.workunit.client.0.smithi016.stderr: -228> 2024-09-12T17:18:36.439+0000 7fbeeeffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:18:36.817 INFO:tasks.workunit.client.0.smithi016.stderr: -227> 2024-09-12T17:18:36.439+0000 7fbeeeffd640 10 monclient: dump: 2024-09-12T17:18:36.817 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:18:36.817 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:18:36.817 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:18:36.817 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:18:36.817 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:18:36.818 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:18:36.818 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:18:36.818 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:18:36.818 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:18:36.818 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:36.818 INFO:tasks.workunit.client.0.smithi016.stderr: -226> 2024-09-12T17:18:36.439+0000 7fbeeeffd640 10 monclient: _finish_auth 0 2024-09-12T17:18:36.818 INFO:tasks.workunit.client.0.smithi016.stderr: -225> 2024-09-12T17:18:36.439+0000 7fbeeeffd640 10 monclient: _check_auth_tickets 2024-09-12T17:18:36.818 INFO:tasks.workunit.client.0.smithi016.stderr: -224> 2024-09-12T17:18:36.439+0000 7fbeeeffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:18:36.818 INFO:tasks.workunit.client.0.smithi016.stderr: -223> 2024-09-12T17:18:36.439+0000 7fbeeeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:18:36.818 INFO:tasks.workunit.client.0.smithi016.stderr: -222> 2024-09-12T17:18:36.439+0000 7fbeeeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:18:36.818 INFO:tasks.workunit.client.0.smithi016.stderr: -221> 2024-09-12T17:18:36.439+0000 7fbeeeffd640 10 monclient: dump: 2024-09-12T17:18:36.818 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:18:36.818 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:18:36.819 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:18:36.819 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:18:36.819 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:18:36.819 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:18:36.819 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:18:36.819 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:18:36.819 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:18:36.819 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:36.819 INFO:tasks.workunit.client.0.smithi016.stderr: -220> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 monclient: authenticate success, global_id 6536 2024-09-12T17:18:36.819 INFO:tasks.workunit.client.0.smithi016.stderr: -219> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient: get_monmap_and_config success 2024-09-12T17:18:36.819 INFO:tasks.workunit.client.0.smithi016.stderr: -218> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 4 set_mon_vals no callback set 2024-09-12T17:18:36.819 INFO:tasks.workunit.client.0.smithi016.stderr: -217> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient: shutdown 2024-09-12T17:18:36.819 INFO:tasks.workunit.client.0.smithi016.stderr: -216> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient: build_initial_monmap 2024-09-12T17:18:36.819 INFO:tasks.workunit.client.0.smithi016.stderr: -215> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 1 build_initial for_mkfs: 0 2024-09-12T17:18:36.820 INFO:tasks.workunit.client.0.smithi016.stderr: -214> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient: monmap: 2024-09-12T17:18:36.820 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:18:36.820 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:18:36.820 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:18:36.820 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:18:36.820 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:18:36.820 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:18:36.820 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:18:36.820 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:18:36.820 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:18:36.820 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:36.820 INFO:tasks.workunit.client.0.smithi016.stderr: -213> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af07c7d0) adding auth protocol: cephx 2024-09-12T17:18:36.820 INFO:tasks.workunit.client.0.smithi016.stderr: -212> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af07c7d0) adding auth protocol: cephx 2024-09-12T17:18:36.821 INFO:tasks.workunit.client.0.smithi016.stderr: -211> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af07c7d0) adding auth protocol: cephx 2024-09-12T17:18:36.821 INFO:tasks.workunit.client.0.smithi016.stderr: -210> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af07c7d0) adding con mode: secure 2024-09-12T17:18:36.821 INFO:tasks.workunit.client.0.smithi016.stderr: -209> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af07c7d0) adding con mode: crc 2024-09-12T17:18:36.821 INFO:tasks.workunit.client.0.smithi016.stderr: -208> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af07c7d0) adding con mode: secure 2024-09-12T17:18:36.821 INFO:tasks.workunit.client.0.smithi016.stderr: -207> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af07c7d0) adding con mode: crc 2024-09-12T17:18:36.821 INFO:tasks.workunit.client.0.smithi016.stderr: -206> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af07c7d0) adding con mode: secure 2024-09-12T17:18:36.821 INFO:tasks.workunit.client.0.smithi016.stderr: -205> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af07c7d0) adding con mode: crc 2024-09-12T17:18:36.821 INFO:tasks.workunit.client.0.smithi016.stderr: -204> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af07c7d0) adding con mode: crc 2024-09-12T17:18:36.821 INFO:tasks.workunit.client.0.smithi016.stderr: -203> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af07c7d0) adding con mode: secure 2024-09-12T17:18:36.821 INFO:tasks.workunit.client.0.smithi016.stderr: -202> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af07c7d0) adding con mode: crc 2024-09-12T17:18:36.821 INFO:tasks.workunit.client.0.smithi016.stderr: -201> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af07c7d0) adding con mode: secure 2024-09-12T17:18:36.821 INFO:tasks.workunit.client.0.smithi016.stderr: -200> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af07c7d0) adding con mode: crc 2024-09-12T17:18:36.821 INFO:tasks.workunit.client.0.smithi016.stderr: -199> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af07c7d0) adding con mode: secure 2024-09-12T17:18:36.821 INFO:tasks.workunit.client.0.smithi016.stderr: -198> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:18:36.822 INFO:tasks.workunit.client.0.smithi016.stderr: -197> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 1 librados: starting msgr at 2024-09-12T17:18:36.822 INFO:tasks.workunit.client.0.smithi016.stderr: -196> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 1 librados: starting objecter 2024-09-12T17:18:36.822 INFO:tasks.workunit.client.0.smithi016.stderr: -195> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 asok(0x5641aeda22b0) register_command objecter_requests cmddesc objecter_requests hook 0x5641af041f70 EEXIST 2024-09-12T17:18:36.822 INFO:tasks.workunit.client.0.smithi016.stderr: -194> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 1 librados: setting wanted keys 2024-09-12T17:18:36.822 INFO:tasks.workunit.client.0.smithi016.stderr: -193> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 1 librados: calling monclient init 2024-09-12T17:18:36.822 INFO:tasks.workunit.client.0.smithi016.stderr: -192> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient: init 2024-09-12T17:18:36.822 INFO:tasks.workunit.client.0.smithi016.stderr: -191> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af02ea10) adding auth protocol: cephx 2024-09-12T17:18:36.822 INFO:tasks.workunit.client.0.smithi016.stderr: -190> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af02ea10) adding auth protocol: cephx 2024-09-12T17:18:36.822 INFO:tasks.workunit.client.0.smithi016.stderr: -189> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af02ea10) adding auth protocol: cephx 2024-09-12T17:18:36.822 INFO:tasks.workunit.client.0.smithi016.stderr: -188> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af02ea10) adding con mode: secure 2024-09-12T17:18:36.822 INFO:tasks.workunit.client.0.smithi016.stderr: -187> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af02ea10) adding con mode: crc 2024-09-12T17:18:36.822 INFO:tasks.workunit.client.0.smithi016.stderr: -186> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af02ea10) adding con mode: secure 2024-09-12T17:18:36.822 INFO:tasks.workunit.client.0.smithi016.stderr: -185> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af02ea10) adding con mode: crc 2024-09-12T17:18:36.823 INFO:tasks.workunit.client.0.smithi016.stderr: -184> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af02ea10) adding con mode: secure 2024-09-12T17:18:36.823 INFO:tasks.workunit.client.0.smithi016.stderr: -183> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af02ea10) adding con mode: crc 2024-09-12T17:18:36.823 INFO:tasks.workunit.client.0.smithi016.stderr: -182> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af02ea10) adding con mode: crc 2024-09-12T17:18:36.823 INFO:tasks.workunit.client.0.smithi016.stderr: -181> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af02ea10) adding con mode: secure 2024-09-12T17:18:36.823 INFO:tasks.workunit.client.0.smithi016.stderr: -180> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af02ea10) adding con mode: crc 2024-09-12T17:18:36.823 INFO:tasks.workunit.client.0.smithi016.stderr: -179> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af02ea10) adding con mode: secure 2024-09-12T17:18:36.823 INFO:tasks.workunit.client.0.smithi016.stderr: -178> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af02ea10) adding con mode: crc 2024-09-12T17:18:36.823 INFO:tasks.workunit.client.0.smithi016.stderr: -177> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af02ea10) adding con mode: secure 2024-09-12T17:18:36.823 INFO:tasks.workunit.client.0.smithi016.stderr: -176> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:18:36.823 INFO:tasks.workunit.client.0.smithi016.stderr: -175> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:18:36.823 INFO:tasks.workunit.client.0.smithi016.stderr: -174> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 asok(0x5641aeda22b0) register_command rotate-key cmddesc rotate-key hook 0x5641af02eb58 EEXIST 2024-09-12T17:18:36.823 INFO:tasks.workunit.client.0.smithi016.stderr: -173> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient: _reopen_session rank -1 2024-09-12T17:18:36.823 INFO:tasks.workunit.client.0.smithi016.stderr: -172> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:18:36.824 INFO:tasks.workunit.client.0.smithi016.stderr: -171> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient(hunting): picked mon.noname-c con 0x5641af051690 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:18:36.824 INFO:tasks.workunit.client.0.smithi016.stderr: -170> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient(hunting): picked mon.noname-a con 0x5641af07bec0 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:18:36.824 INFO:tasks.workunit.client.0.smithi016.stderr: -169> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient(hunting): picked mon.noname-b con 0x5641af0805b0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:18:36.824 INFO:tasks.workunit.client.0.smithi016.stderr: -168> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:18:36.824 INFO:tasks.workunit.client.0.smithi016.stderr: -167> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:18:36.824 INFO:tasks.workunit.client.0.smithi016.stderr: -166> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:18:36.824 INFO:tasks.workunit.client.0.smithi016.stderr: -165> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient(hunting): _renew_subs 2024-09-12T17:18:36.824 INFO:tasks.workunit.client.0.smithi016.stderr: -164> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient(hunting): authenticate will time out at 2234.418693s 2024-09-12T17:18:36.824 INFO:tasks.workunit.client.0.smithi016.stderr: -163> 2024-09-12T17:18:36.439+0000 7fc00aec5640 10 monclient(hunting): get_auth_request con 0x5641af051690 auth_method 0 2024-09-12T17:18:36.824 INFO:tasks.workunit.client.0.smithi016.stderr: -162> 2024-09-12T17:18:36.439+0000 7fc00aec5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:18:36.824 INFO:tasks.workunit.client.0.smithi016.stderr: -161> 2024-09-12T17:18:36.439+0000 7fc00aec5640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:18:36.824 INFO:tasks.workunit.client.0.smithi016.stderr: -160> 2024-09-12T17:18:36.439+0000 7fc00aec5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:18:36.824 INFO:tasks.workunit.client.0.smithi016.stderr: -159> 2024-09-12T17:18:36.439+0000 7fc00bec7640 10 monclient(hunting): get_auth_request con 0x5641af07bec0 auth_method 0 2024-09-12T17:18:36.824 INFO:tasks.workunit.client.0.smithi016.stderr: -158> 2024-09-12T17:18:36.439+0000 7fc00bec7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:18:36.825 INFO:tasks.workunit.client.0.smithi016.stderr: -157> 2024-09-12T17:18:36.439+0000 7fc00bec7640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:18:36.825 INFO:tasks.workunit.client.0.smithi016.stderr: -156> 2024-09-12T17:18:36.439+0000 7fc00bec7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:18:36.825 INFO:tasks.workunit.client.0.smithi016.stderr: -155> 2024-09-12T17:18:36.439+0000 7fc00aec5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:18:36.825 INFO:tasks.workunit.client.0.smithi016.stderr: -154> 2024-09-12T17:18:36.439+0000 7fc00aec5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:18:36.825 INFO:tasks.workunit.client.0.smithi016.stderr: -153> 2024-09-12T17:18:36.439+0000 7fc00aec5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:18:36.825 INFO:tasks.workunit.client.0.smithi016.stderr: -152> 2024-09-12T17:18:36.439+0000 7fc00bec7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:18:36.825 INFO:tasks.workunit.client.0.smithi016.stderr: -151> 2024-09-12T17:18:36.439+0000 7fc00bec7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:18:36.825 INFO:tasks.workunit.client.0.smithi016.stderr: -150> 2024-09-12T17:18:36.439+0000 7fc00bec7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:18:36.825 INFO:tasks.workunit.client.0.smithi016.stderr: -149> 2024-09-12T17:18:36.439+0000 7fc00b6c6640 10 monclient(hunting): get_auth_request con 0x5641af0805b0 auth_method 0 2024-09-12T17:18:36.825 INFO:tasks.workunit.client.0.smithi016.stderr: -148> 2024-09-12T17:18:36.439+0000 7fc00b6c6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:18:36.825 INFO:tasks.workunit.client.0.smithi016.stderr: -147> 2024-09-12T17:18:36.439+0000 7fc00b6c6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:18:36.825 INFO:tasks.workunit.client.0.smithi016.stderr: -146> 2024-09-12T17:18:36.439+0000 7fc00b6c6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:18:36.826 INFO:tasks.workunit.client.0.smithi016.stderr: -145> 2024-09-12T17:18:36.439+0000 7fc00aec5640 10 monclient(hunting): handle_auth_done global_id 6539 payload 824 2024-09-12T17:18:36.826 INFO:tasks.workunit.client.0.smithi016.stderr: -144> 2024-09-12T17:18:36.439+0000 7fc00aec5640 10 monclient: _finish_hunting 0 2024-09-12T17:18:36.826 INFO:tasks.workunit.client.0.smithi016.stderr: -143> 2024-09-12T17:18:36.439+0000 7fc00aec5640 1 monclient: found mon.noname-c 2024-09-12T17:18:36.826 INFO:tasks.workunit.client.0.smithi016.stderr: -142> 2024-09-12T17:18:36.439+0000 7fc00aec5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:18:36.826 INFO:tasks.workunit.client.0.smithi016.stderr: -141> 2024-09-12T17:18:36.439+0000 7fbeed7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:18:36.826 INFO:tasks.workunit.client.0.smithi016.stderr: -140> 2024-09-12T17:18:36.439+0000 7fbeed7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:18:36.826 INFO:tasks.workunit.client.0.smithi016.stderr: -139> 2024-09-12T17:18:36.439+0000 7fbeed7fa640 10 monclient: dump: 2024-09-12T17:18:36.826 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:18:36.826 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:18:36.826 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:18:36.826 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:18:36.826 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:18:36.826 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:18:36.826 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:18:36.827 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:18:36.827 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:18:36.827 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:36.827 INFO:tasks.workunit.client.0.smithi016.stderr: -138> 2024-09-12T17:18:36.439+0000 7fbeed7fa640 10 monclient: _finish_auth 0 2024-09-12T17:18:36.827 INFO:tasks.workunit.client.0.smithi016.stderr: -137> 2024-09-12T17:18:36.439+0000 7fbeed7fa640 10 monclient: _check_auth_tickets 2024-09-12T17:18:36.827 INFO:tasks.workunit.client.0.smithi016.stderr: -136> 2024-09-12T17:18:36.439+0000 7fbeed7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:18:36.827 INFO:tasks.workunit.client.0.smithi016.stderr: -135> 2024-09-12T17:18:36.439+0000 7fbeed7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:18:36.827 INFO:tasks.workunit.client.0.smithi016.stderr: -134> 2024-09-12T17:18:36.439+0000 7fbeed7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:18:36.827 INFO:tasks.workunit.client.0.smithi016.stderr: -133> 2024-09-12T17:18:36.439+0000 7fbeed7fa640 10 monclient: dump: 2024-09-12T17:18:36.827 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:18:36.827 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:18:36.827 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:18:36.827 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:18:36.827 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:18:36.828 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:18:36.828 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:18:36.828 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:18:36.828 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:18:36.828 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:36.828 INFO:tasks.workunit.client.0.smithi016.stderr: -132> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 monclient: authenticate success, global_id 6539 2024-09-12T17:18:36.828 INFO:tasks.workunit.client.0.smithi016.stderr: -131> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient: _renew_subs 2024-09-12T17:18:36.828 INFO:tasks.workunit.client.0.smithi016.stderr: -130> 2024-09-12T17:18:36.439+0000 7fbeeeffd640 4 set_mon_vals no callback set 2024-09-12T17:18:36.828 INFO:tasks.workunit.client.0.smithi016.stderr: -129> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:18:36.828 INFO:tasks.workunit.client.0.smithi016.stderr: -128> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient: _renew_subs 2024-09-12T17:18:36.828 INFO:tasks.workunit.client.0.smithi016.stderr: -127> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:18:36.828 INFO:tasks.workunit.client.0.smithi016.stderr: -126> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 1 librados: init done 2024-09-12T17:18:36.828 INFO:tasks.workunit.client.0.smithi016.stderr: -125> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 asok(0x5641aeda22b0) register_command cr dump hook 0x5641af077d48 2024-09-12T17:18:36.829 INFO:tasks.workunit.client.0.smithi016.stderr: -124> 2024-09-12T17:18:36.443+0000 7fc00dbc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.829 INFO:tasks.workunit.client.0.smithi016.stderr: -123> 2024-09-12T17:18:36.443+0000 7fbeed7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:18:36.829 INFO:tasks.workunit.client.0.smithi016.stderr: -122> 2024-09-12T17:18:36.443+0000 7fbeed7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:18:36.829 INFO:tasks.workunit.client.0.smithi016.stderr: -121> 2024-09-12T17:18:36.443+0000 7fbeed7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:18:36.829 INFO:tasks.workunit.client.0.smithi016.stderr: -120> 2024-09-12T17:18:36.443+0000 7fc00bec7640 10 monclient: get_auth_request con 0x7fbed4070ae0 auth_method 0 2024-09-12T17:18:36.829 INFO:tasks.workunit.client.0.smithi016.stderr: -119> 2024-09-12T17:18:36.443+0000 7fc00b6c6640 10 monclient: get_auth_request con 0x5641af09a6e0 auth_method 0 2024-09-12T17:18:36.829 INFO:tasks.workunit.client.0.smithi016.stderr: -118> 2024-09-12T17:18:36.443+0000 7fc00dbc09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:36.829 INFO:tasks.workunit.client.0.smithi016.stderr: -117> 2024-09-12T17:18:36.443+0000 7fc00dbc09c0 20 realm 2024-09-12T17:18:36.829 INFO:tasks.workunit.client.0.smithi016.stderr: -116> 2024-09-12T17:18:36.443+0000 7fc00dbc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.829 INFO:tasks.workunit.client.0.smithi016.stderr: -115> 2024-09-12T17:18:36.443+0000 7fc00dbc09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:36.829 INFO:tasks.workunit.client.0.smithi016.stderr: -114> 2024-09-12T17:18:36.443+0000 7fc00dbc09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:18:36.829 INFO:tasks.workunit.client.0.smithi016.stderr: -113> 2024-09-12T17:18:36.443+0000 7fc00dbc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.829 INFO:tasks.workunit.client.0.smithi016.stderr: -112> 2024-09-12T17:18:36.443+0000 7fc00dbc09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:36.830 INFO:tasks.workunit.client.0.smithi016.stderr: -111> 2024-09-12T17:18:36.443+0000 7fc00dbc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.830 INFO:tasks.workunit.client.0.smithi016.stderr: -110> 2024-09-12T17:18:36.443+0000 7fc00aec5640 10 monclient: get_auth_request con 0x5641af09e920 auth_method 0 2024-09-12T17:18:36.830 INFO:tasks.workunit.client.0.smithi016.stderr: -109> 2024-09-12T17:18:36.447+0000 7fc00dbc09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:18:36.830 INFO:tasks.workunit.client.0.smithi016.stderr: -108> 2024-09-12T17:18:36.447+0000 7fc00dbc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.830 INFO:tasks.workunit.client.0.smithi016.stderr: -107> 2024-09-12T17:18:36.447+0000 7fc00bec7640 10 monclient: get_auth_request con 0x5641af0a2180 auth_method 0 2024-09-12T17:18:36.830 INFO:tasks.workunit.client.0.smithi016.stderr: -106> 2024-09-12T17:18:36.447+0000 7fc00dbc09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:18:36.830 INFO:tasks.workunit.client.0.smithi016.stderr: -105> 2024-09-12T17:18:36.447+0000 7fc00dbc09c0 20 searching for the correct realm 2024-09-12T17:18:36.830 INFO:tasks.workunit.client.0.smithi016.stderr: -104> 2024-09-12T17:18:36.447+0000 7fc00b6c6640 10 monclient: get_auth_request con 0x5641af0a6f00 auth_method 0 2024-09-12T17:18:36.830 INFO:tasks.workunit.client.0.smithi016.stderr: -103> 2024-09-12T17:18:36.451+0000 7fc00aec5640 0 -- 172.21.15.16:0/968992593 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7fbffc06b040 msgr2=0x7fbffc065860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:18:36.830 INFO:tasks.workunit.client.0.smithi016.stderr: -102> 2024-09-12T17:18:36.655+0000 7fc00aec5640 10 monclient: get_auth_request con 0x7fbffc06b040 auth_method 0 2024-09-12T17:18:36.830 INFO:tasks.workunit.client.0.smithi016.stderr: -101> 2024-09-12T17:18:36.655+0000 7fc00bec7640 10 monclient: get_auth_request con 0x7fc0000dc290 auth_method 0 2024-09-12T17:18:36.830 INFO:tasks.workunit.client.0.smithi016.stderr: -100> 2024-09-12T17:18:36.663+0000 7fc00b6c6640 10 monclient: get_auth_request con 0x7fc004018040 auth_method 0 2024-09-12T17:18:36.830 INFO:tasks.workunit.client.0.smithi016.stderr: -99> 2024-09-12T17:18:36.663+0000 7fc00bec7640 0 -- 172.21.15.16:0/968992593 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fc0000dc290 msgr2=0x7fc000122a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:18:36.830 INFO:tasks.workunit.client.0.smithi016.stderr: -98> 2024-09-12T17:18:36.663+0000 7fbeed7fa640 1 client.6539.objecter ms_handle_reset 0x7fc0000dc290 session 0x7fc0000d7040 osd.2 2024-09-12T17:18:36.831 INFO:tasks.workunit.client.0.smithi016.stderr: -97> 2024-09-12T17:18:36.663+0000 7fbeed7fa640 10 monclient: _renew_subs 2024-09-12T17:18:36.831 INFO:tasks.workunit.client.0.smithi016.stderr: -96> 2024-09-12T17:18:36.663+0000 7fbeed7fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:18:36.831 INFO:tasks.workunit.client.0.smithi016.stderr: -95> 2024-09-12T17:18:36.667+0000 7fc00bec7640 10 monclient: get_auth_request con 0x7fbed4080900 auth_method 0 2024-09-12T17:18:36.831 INFO:tasks.workunit.client.0.smithi016.stderr: -94> 2024-09-12T17:18:36.667+0000 7fc00aec5640 10 monclient: get_auth_request con 0x7fbff4003be0 auth_method 0 2024-09-12T17:18:36.831 INFO:tasks.workunit.client.0.smithi016.stderr: -93> 2024-09-12T17:18:36.683+0000 7fc00dbc09c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:18:36.831 INFO:tasks.workunit.client.0.smithi016.stderr: -92> 2024-09-12T17:18:36.683+0000 7fc00dbc09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:18:36.831 INFO:tasks.workunit.client.0.smithi016.stderr: -91> 2024-09-12T17:18:36.683+0000 7fc00dbc09c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:18:36.831 INFO:tasks.workunit.client.0.smithi016.stderr: -90> 2024-09-12T17:18:36.683+0000 7fc00dbc09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:18:36.831 INFO:tasks.workunit.client.0.smithi016.stderr: -89> 2024-09-12T17:18:36.683+0000 7fc00dbc09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:18:36.831 INFO:tasks.workunit.client.0.smithi016.stderr: -88> 2024-09-12T17:18:36.683+0000 7fc00dbc09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:18:36.831 INFO:tasks.workunit.client.0.smithi016.stderr: -87> 2024-09-12T17:18:36.683+0000 7fc00dbc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.831 INFO:tasks.workunit.client.0.smithi016.stderr: -86> 2024-09-12T17:18:36.683+0000 7fc00dbc09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:36.831 INFO:tasks.workunit.client.0.smithi016.stderr: -85> 2024-09-12T17:18:36.683+0000 7fc00dbc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.832 INFO:tasks.workunit.client.0.smithi016.stderr: -84> 2024-09-12T17:18:36.683+0000 7fc00dbc09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:18:36.832 INFO:tasks.workunit.client.0.smithi016.stderr: -83> 2024-09-12T17:18:36.683+0000 7fc00dbc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.832 INFO:tasks.workunit.client.0.smithi016.stderr: -82> 2024-09-12T17:18:36.687+0000 7fc00dbc09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:18:36.832 INFO:tasks.workunit.client.0.smithi016.stderr: -81> 2024-09-12T17:18:36.687+0000 7fc00dbc09c0 20 zone default found 2024-09-12T17:18:36.832 INFO:tasks.workunit.client.0.smithi016.stderr: -80> 2024-09-12T17:18:36.687+0000 7fc00dbc09c0 4 Realm: () 2024-09-12T17:18:36.832 INFO:tasks.workunit.client.0.smithi016.stderr: -79> 2024-09-12T17:18:36.687+0000 7fc00dbc09c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:18:36.832 INFO:tasks.workunit.client.0.smithi016.stderr: -78> 2024-09-12T17:18:36.687+0000 7fc00dbc09c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:18:36.832 INFO:tasks.workunit.client.0.smithi016.stderr: -77> 2024-09-12T17:18:36.687+0000 7fc00dbc09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:18:36.832 INFO:tasks.workunit.client.0.smithi016.stderr: -76> 2024-09-12T17:18:36.687+0000 7fc00dbc09c0 20 zonegroup default 2024-09-12T17:18:36.832 INFO:tasks.workunit.client.0.smithi016.stderr: -75> 2024-09-12T17:18:36.687+0000 7fc00dbc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.832 INFO:tasks.workunit.client.0.smithi016.stderr: -74> 2024-09-12T17:18:36.687+0000 7fc00dbc09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:36.832 INFO:tasks.workunit.client.0.smithi016.stderr: -73> 2024-09-12T17:18:36.687+0000 7fc00dbc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.832 INFO:tasks.workunit.client.0.smithi016.stderr: -72> 2024-09-12T17:18:36.687+0000 7fc00dbc09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:36.833 INFO:tasks.workunit.client.0.smithi016.stderr: -71> 2024-09-12T17:18:36.687+0000 7fc00dbc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.833 INFO:tasks.workunit.client.0.smithi016.stderr: -70> 2024-09-12T17:18:36.687+0000 7fc00dbc09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:36.833 INFO:tasks.workunit.client.0.smithi016.stderr: -69> 2024-09-12T17:18:36.687+0000 7fc00dbc09c0 20 started sync module instance, tier type = 2024-09-12T17:18:36.833 INFO:tasks.workunit.client.0.smithi016.stderr: -68> 2024-09-12T17:18:36.687+0000 7fc00dbc09c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:18:36.833 INFO:tasks.workunit.client.0.smithi016.stderr: -67> 2024-09-12T17:18:36.711+0000 7fc00dbc09c0 20 add_watcher() i=0 2024-09-12T17:18:36.833 INFO:tasks.workunit.client.0.smithi016.stderr: -66> 2024-09-12T17:18:36.711+0000 7fc00dbc09c0 20 add_watcher() i=1 2024-09-12T17:18:36.833 INFO:tasks.workunit.client.0.smithi016.stderr: -65> 2024-09-12T17:18:36.711+0000 7fc00dbc09c0 20 add_watcher() i=2 2024-09-12T17:18:36.833 INFO:tasks.workunit.client.0.smithi016.stderr: -64> 2024-09-12T17:18:36.711+0000 7fc00dbc09c0 20 add_watcher() i=3 2024-09-12T17:18:36.833 INFO:tasks.workunit.client.0.smithi016.stderr: -63> 2024-09-12T17:18:36.711+0000 7fc00dbc09c0 20 add_watcher() i=4 2024-09-12T17:18:36.833 INFO:tasks.workunit.client.0.smithi016.stderr: -62> 2024-09-12T17:18:36.711+0000 7fc00dbc09c0 20 add_watcher() i=5 2024-09-12T17:18:36.833 INFO:tasks.workunit.client.0.smithi016.stderr: -61> 2024-09-12T17:18:36.711+0000 7fc00dbc09c0 20 add_watcher() i=6 2024-09-12T17:18:36.833 INFO:tasks.workunit.client.0.smithi016.stderr: -60> 2024-09-12T17:18:36.715+0000 7fc00dbc09c0 20 add_watcher() i=7 2024-09-12T17:18:36.833 INFO:tasks.workunit.client.0.smithi016.stderr: -59> 2024-09-12T17:18:36.715+0000 7fc00dbc09c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:18:36.833 INFO:tasks.workunit.client.0.smithi016.stderr: -58> 2024-09-12T17:18:36.719+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6276310) adding auth protocol: cephx 2024-09-12T17:18:36.834 INFO:tasks.workunit.client.0.smithi016.stderr: -57> 2024-09-12T17:18:36.719+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6276310) adding auth protocol: cephx 2024-09-12T17:18:36.834 INFO:tasks.workunit.client.0.smithi016.stderr: -56> 2024-09-12T17:18:36.719+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6276310) adding auth protocol: cephx 2024-09-12T17:18:36.834 INFO:tasks.workunit.client.0.smithi016.stderr: -55> 2024-09-12T17:18:36.719+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6276310) adding con mode: secure 2024-09-12T17:18:36.834 INFO:tasks.workunit.client.0.smithi016.stderr: -54> 2024-09-12T17:18:36.719+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6276310) adding con mode: crc 2024-09-12T17:18:36.834 INFO:tasks.workunit.client.0.smithi016.stderr: -53> 2024-09-12T17:18:36.719+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6276310) adding con mode: secure 2024-09-12T17:18:36.834 INFO:tasks.workunit.client.0.smithi016.stderr: -52> 2024-09-12T17:18:36.719+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6276310) adding con mode: crc 2024-09-12T17:18:36.834 INFO:tasks.workunit.client.0.smithi016.stderr: -51> 2024-09-12T17:18:36.719+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6276310) adding con mode: secure 2024-09-12T17:18:36.834 INFO:tasks.workunit.client.0.smithi016.stderr: -50> 2024-09-12T17:18:36.719+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6276310) adding con mode: crc 2024-09-12T17:18:36.834 INFO:tasks.workunit.client.0.smithi016.stderr: -49> 2024-09-12T17:18:36.719+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6276310) adding con mode: crc 2024-09-12T17:18:36.834 INFO:tasks.workunit.client.0.smithi016.stderr: -48> 2024-09-12T17:18:36.719+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6276310) adding con mode: secure 2024-09-12T17:18:36.834 INFO:tasks.workunit.client.0.smithi016.stderr: -47> 2024-09-12T17:18:36.719+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6276310) adding con mode: crc 2024-09-12T17:18:36.834 INFO:tasks.workunit.client.0.smithi016.stderr: -46> 2024-09-12T17:18:36.719+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6276310) adding con mode: secure 2024-09-12T17:18:36.834 INFO:tasks.workunit.client.0.smithi016.stderr: -45> 2024-09-12T17:18:36.719+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6276310) adding con mode: crc 2024-09-12T17:18:36.835 INFO:tasks.workunit.client.0.smithi016.stderr: -44> 2024-09-12T17:18:36.719+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6276310) adding con mode: secure 2024-09-12T17:18:36.835 INFO:tasks.workunit.client.0.smithi016.stderr: -43> 2024-09-12T17:18:36.719+0000 7fbec1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:18:36.835 INFO:tasks.workunit.client.0.smithi016.stderr: -42> 2024-09-12T17:18:36.719+0000 7fc00dbc09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:18:36.835 INFO:tasks.workunit.client.0.smithi016.stderr: -41> 2024-09-12T17:18:36.719+0000 7fc00dbc09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:18:36.835 INFO:tasks.workunit.client.0.smithi016.stderr: -40> 2024-09-12T17:18:36.719+0000 7fc00dbc09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:18:36.835 INFO:tasks.workunit.client.0.smithi016.stderr: -39> 2024-09-12T17:18:36.719+0000 7fc00dbc09c0 5 asok(0x5641aeda22b0) register_command cache list hook 0x5641af079d10 2024-09-12T17:18:36.835 INFO:tasks.workunit.client.0.smithi016.stderr: -38> 2024-09-12T17:18:36.719+0000 7fc00dbc09c0 5 asok(0x5641aeda22b0) register_command cache inspect hook 0x5641af079d10 2024-09-12T17:18:36.835 INFO:tasks.workunit.client.0.smithi016.stderr: -37> 2024-09-12T17:18:36.719+0000 7fc00dbc09c0 5 asok(0x5641aeda22b0) register_command cache erase hook 0x5641af079d10 2024-09-12T17:18:36.835 INFO:tasks.workunit.client.0.smithi016.stderr: -36> 2024-09-12T17:18:36.719+0000 7fc00dbc09c0 5 asok(0x5641aeda22b0) register_command cache zap hook 0x5641af079d10 2024-09-12T17:18:36.835 INFO:tasks.workunit.client.0.smithi016.stderr: -35> 2024-09-12T17:18:36.719+0000 7fc00dbc09c0 5 note: GC not initialized 2024-09-12T17:18:36.835 INFO:tasks.workunit.client.0.smithi016.stderr: -34> 2024-09-12T17:18:36.723+0000 7fbec0fe1640 20 reqs_thread_entry: start 2024-09-12T17:18:36.835 INFO:tasks.workunit.client.0.smithi016.stderr: -33> 2024-09-12T17:18:36.723+0000 7fc00dbc09c0 5 asok(0x5641aeda22b0) register_command sync trace show hook 0x7fbffc004ad0 2024-09-12T17:18:36.835 INFO:tasks.workunit.client.0.smithi016.stderr: -32> 2024-09-12T17:18:36.723+0000 7fc00dbc09c0 5 asok(0x5641aeda22b0) register_command sync trace history hook 0x7fbffc004ad0 2024-09-12T17:18:36.835 INFO:tasks.workunit.client.0.smithi016.stderr: -31> 2024-09-12T17:18:36.723+0000 7fc00dbc09c0 5 asok(0x5641aeda22b0) register_command sync trace active hook 0x7fbffc004ad0 2024-09-12T17:18:36.836 INFO:tasks.workunit.client.0.smithi016.stderr: -30> 2024-09-12T17:18:36.723+0000 7fc00dbc09c0 5 asok(0x5641aeda22b0) register_command sync trace active_short hook 0x7fbffc004ad0 2024-09-12T17:18:36.836 INFO:tasks.workunit.client.0.smithi016.stderr: -29> 2024-09-12T17:18:36.723+0000 7fc00dbc09c0 20 init_complete bucket index max shards: 1 2024-09-12T17:18:36.836 INFO:tasks.workunit.client.0.smithi016.stderr: -28> 2024-09-12T17:18:36.723+0000 7fc00dbc09c0 20 Filter name: none 2024-09-12T17:18:36.836 INFO:tasks.workunit.client.0.smithi016.stderr: -27> 2024-09-12T17:18:36.723+0000 7fbe3a7fc640 20 reqs_thread_entry: start 2024-09-12T17:18:36.836 INFO:tasks.workunit.client.0.smithi016.stderr: -26> 2024-09-12T17:18:36.723+0000 7fc00dbc09c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T17:18:36.836 INFO:tasks.workunit.client.0.smithi016.stderr: -25> 2024-09-12T17:18:36.723+0000 7fc00dbc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.836 INFO:tasks.workunit.client.0.smithi016.stderr: -24> 2024-09-12T17:18:36.723+0000 7fc00dbc09c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:18:36.836 INFO:tasks.workunit.client.0.smithi016.stderr: -23> 2024-09-12T17:18:36.723+0000 7fc00dbc09c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:18:36.836 INFO:tasks.workunit.client.0.smithi016.stderr: -22> 2024-09-12T17:18:36.723+0000 7fc00dbc09c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:18:36.836 INFO:tasks.workunit.client.0.smithi016.stderr: -21> 2024-09-12T17:18:36.723+0000 7fc00dbc09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 : miss 2024-09-12T17:18:36.836 INFO:tasks.workunit.client.0.smithi016.stderr: -20> 2024-09-12T17:18:36.723+0000 7fc00dbc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.836 INFO:tasks.workunit.client.0.smithi016.stderr: -19> 2024-09-12T17:18:36.723+0000 7fc00dbc09c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:18:36.836 INFO:tasks.workunit.client.0.smithi016.stderr: -18> 2024-09-12T17:18:36.723+0000 7fc00dbc09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 info.flags=0x17 2024-09-12T17:18:36.837 INFO:tasks.workunit.client.0.smithi016.stderr: -17> 2024-09-12T17:18:36.723+0000 7fc00dbc09c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 to cache LRU end 2024-09-12T17:18:36.837 INFO:tasks.workunit.client.0.smithi016.stderr: -16> 2024-09-12T17:18:36.723+0000 7fc00dbc09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:18:36.837 INFO:tasks.workunit.client.0.smithi016.stderr: -15> 2024-09-12T17:18:36.723+0000 7fc00dbc09c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:18:36.837 INFO:tasks.workunit.client.0.smithi016.stderr: -14> 2024-09-12T17:18:36.723+0000 7fc00dbc09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 2024-09-12T17:18:36.837 INFO:tasks.workunit.client.0.smithi016.stderr: -13> 2024-09-12T17:18:36.735+0000 7fc00dbc09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 info.flags=0x17 2024-09-12T17:18:36.837 INFO:tasks.workunit.client.0.smithi016.stderr: -12> 2024-09-12T17:18:36.735+0000 7fc00dbc09c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 to cache LRU end 2024-09-12T17:18:36.837 INFO:tasks.workunit.client.0.smithi016.stderr: -11> 2024-09-12T17:18:36.735+0000 7fc00dbc09c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:18:36.837 INFO:tasks.workunit.client.0.smithi016.stderr: -10> 2024-09-12T17:18:36.735+0000 7fc00dbc09c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27, ofs0, ns] 2024-09-12T17:18:36.837 INFO:tasks.workunit.client.0.smithi016.stderr: -9> 2024-09-12T17:18:36.735+0000 7fbeeeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431570 cookie 94840109592816 notifier 6539 bl.length()=939 2024-09-12T17:18:36.837 INFO:tasks.workunit.client.0.smithi016.stderr: -8> 2024-09-12T17:18:36.735+0000 7fbeeeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 info.flags=0x17 2024-09-12T17:18:36.837 INFO:tasks.workunit.client.0.smithi016.stderr: -7> 2024-09-12T17:18:36.735+0000 7fbeeeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 to cache LRU end 2024-09-12T17:18:36.837 INFO:tasks.workunit.client.0.smithi016.stderr: -6> 2024-09-12T17:18:36.735+0000 7fbeeeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:18:36.837 INFO:tasks.workunit.client.0.smithi016.stderr: -5> 2024-09-12T17:18:36.735+0000 7fc00dbc09c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27]): orig_sources= new_sources= 2024-09-12T17:18:36.838 INFO:tasks.workunit.client.0.smithi016.stderr: -4> 2024-09-12T17:18:36.735+0000 7fc00dbc09c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27]): potential sources added=[] removed=[] 2024-09-12T17:18:36.838 INFO:tasks.workunit.client.0.smithi016.stderr: -3> 2024-09-12T17:18:36.735+0000 7fc00dbc09c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27]): orig_dests= new_dests= 2024-09-12T17:18:36.838 INFO:tasks.workunit.client.0.smithi016.stderr: -2> 2024-09-12T17:18:36.735+0000 7fc00dbc09c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27]): potential dests added=[] removed=[] 2024-09-12T17:18:36.838 INFO:tasks.workunit.client.0.smithi016.stderr: -1> 2024-09-12T17:18:36.739+0000 7fc00dbc09c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc00dbc09c0 time 2024-09-12T17:18:36.741155+0000 2024-09-12T17:18:36.838 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:18:36.838 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:36.838 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:18:36.838 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc01149a2eb] 2024-09-12T17:18:36.838 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc01149a49f] 2024-09-12T17:18:36.838 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5641ac91e0c1] 2024-09-12T17:18:36.838 INFO:tasks.workunit.client.0.smithi016.stderr: 4: radosgw-admin(+0x141007e) [0x5641ad37407e] 2024-09-12T17:18:36.838 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5641ac93018d] 2024-09-12T17:18:36.838 INFO:tasks.workunit.client.0.smithi016.stderr: 6: main() 2024-09-12T17:18:36.839 INFO:tasks.workunit.client.0.smithi016.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc010300d90] 2024-09-12T17:18:36.839 INFO:tasks.workunit.client.0.smithi016.stderr: 8: __libc_start_main() 2024-09-12T17:18:36.839 INFO:tasks.workunit.client.0.smithi016.stderr: 9: _start() 2024-09-12T17:18:36.839 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:36.839 INFO:tasks.workunit.client.0.smithi016.stderr: 0> 2024-09-12T17:18:36.743+0000 7fc00dbc09c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:18:36.839 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7fc00dbc09c0 thread_name:radosgw-admin 2024-09-12T17:18:36.839 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:36.839 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:18:36.839 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc010319520] 2024-09-12T17:18:36.839 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:18:36.839 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:18:36.839 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:18:36.839 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc01149a345] 2024-09-12T17:18:36.840 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc01149a49f] 2024-09-12T17:18:36.840 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5641ac91e0c1] 2024-09-12T17:18:36.840 INFO:tasks.workunit.client.0.smithi016.stderr: 8: radosgw-admin(+0x141007e) [0x5641ad37407e] 2024-09-12T17:18:36.840 INFO:tasks.workunit.client.0.smithi016.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5641ac93018d] 2024-09-12T17:18:36.840 INFO:tasks.workunit.client.0.smithi016.stderr: 10: main() 2024-09-12T17:18:36.840 INFO:tasks.workunit.client.0.smithi016.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc010300d90] 2024-09-12T17:18:36.840 INFO:tasks.workunit.client.0.smithi016.stderr: 12: __libc_start_main() 2024-09-12T17:18:36.840 INFO:tasks.workunit.client.0.smithi016.stderr: 13: _start() 2024-09-12T17:18:36.840 INFO:tasks.workunit.client.0.smithi016.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:18:36.840 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:36.840 INFO:tasks.workunit.client.0.smithi016.stderr:--- logging levels --- 2024-09-12T17:18:36.840 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 none 2024-09-12T17:18:36.840 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 lockdep 2024-09-12T17:18:36.841 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 context 2024-09-12T17:18:36.841 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 crush 2024-09-12T17:18:36.841 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds 2024-09-12T17:18:36.841 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_balancer 2024-09-12T17:18:36.841 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_locker 2024-09-12T17:18:36.841 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log 2024-09-12T17:18:36.841 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log_expire 2024-09-12T17:18:36.841 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_migrator 2024-09-12T17:18:36.841 INFO:tasks.workunit.client.0.smithi016.stderr: 3/ 5 mds_quiesce 2024-09-12T17:18:36.841 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 buffer 2024-09-12T17:18:36.841 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 timer 2024-09-12T17:18:36.841 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 filer 2024-09-12T17:18:36.841 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 striper 2024-09-12T17:18:36.841 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 objecter 2024-09-12T17:18:36.842 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rados 2024-09-12T17:18:36.842 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd 2024-09-12T17:18:36.842 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_mirror 2024-09-12T17:18:36.842 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_replay 2024-09-12T17:18:36.842 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_pwl 2024-09-12T17:18:36.842 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 journaler 2024-09-12T17:18:36.842 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objectcacher 2024-09-12T17:18:36.842 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:18:36.842 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 client 2024-09-12T17:18:36.842 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 osd 2024-09-12T17:18:36.842 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 optracker 2024-09-12T17:18:36.842 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objclass 2024-09-12T17:18:36.842 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 filestore 2024-09-12T17:18:36.842 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 journal 2024-09-12T17:18:36.843 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 ms 2024-09-12T17:18:36.843 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mon 2024-09-12T17:18:36.843 INFO:tasks.workunit.client.0.smithi016.stderr: 0/10 monc 2024-09-12T17:18:36.843 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 paxos 2024-09-12T17:18:36.843 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 tp 2024-09-12T17:18:36.843 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 auth 2024-09-12T17:18:36.843 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 crypto 2024-09-12T17:18:36.843 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 finisher 2024-09-12T17:18:36.843 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 reserver 2024-09-12T17:18:36.843 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 heartbeatmap 2024-09-12T17:18:36.843 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 perfcounter 2024-09-12T17:18:36.843 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw 2024-09-12T17:18:36.843 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_sync 2024-09-12T17:18:36.843 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_datacache 2024-09-12T17:18:36.844 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_access 2024-09-12T17:18:36.844 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:18:36.844 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_flight 2024-09-12T17:18:36.844 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:18:36.844 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw_notification 2024-09-12T17:18:36.844 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 javaclient 2024-09-12T17:18:36.844 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 asok 2024-09-12T17:18:36.844 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 throttle 2024-09-12T17:18:36.844 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 refs 2024-09-12T17:18:36.844 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 compressor 2024-09-12T17:18:36.844 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluestore 2024-09-12T17:18:36.844 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluefs 2024-09-12T17:18:36.844 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 bdev 2024-09-12T17:18:36.845 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 kstore 2024-09-12T17:18:36.845 INFO:tasks.workunit.client.0.smithi016.stderr: 4/ 5 rocksdb 2024-09-12T17:18:36.845 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 fuse 2024-09-12T17:18:36.845 INFO:tasks.workunit.client.0.smithi016.stderr: 2/ 5 mgr 2024-09-12T17:18:36.845 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mgrc 2024-09-12T17:18:36.845 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 dpdk 2024-09-12T17:18:36.845 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 eventtrace 2024-09-12T17:18:36.845 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 prioritycache 2024-09-12T17:18:36.845 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 test 2024-09-12T17:18:36.845 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:18:36.845 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephsqlite 2024-09-12T17:18:36.845 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:18:36.845 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore 2024-09-12T17:18:36.845 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_onode 2024-09-12T17:18:36.846 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_odata 2024-09-12T17:18:36.846 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_omap 2024-09-12T17:18:36.846 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_tm 2024-09-12T17:18:36.846 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_t 2024-09-12T17:18:36.846 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:18:36.846 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_epm 2024-09-12T17:18:36.846 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_lba 2024-09-12T17:18:36.846 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:18:36.846 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cache 2024-09-12T17:18:36.846 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_journal 2024-09-12T17:18:36.846 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_device 2024-09-12T17:18:36.846 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_backref 2024-09-12T17:18:36.846 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 alienstore 2024-09-12T17:18:36.846 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mclock 2024-09-12T17:18:36.847 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cyanstore 2024-09-12T17:18:36.847 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 ceph_exporter 2024-09-12T17:18:36.847 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 memstore 2024-09-12T17:18:36.847 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 trace 2024-09-12T17:18:36.847 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 ceph_dedup 2024-09-12T17:18:36.847 INFO:tasks.workunit.client.0.smithi016.stderr: -2/-2 (syslog threshold) 2024-09-12T17:18:36.847 INFO:tasks.workunit.client.0.smithi016.stderr: 99/99 (stderr threshold) 2024-09-12T17:18:36.847 INFO:tasks.workunit.client.0.smithi016.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:18:36.847 INFO:tasks.workunit.client.0.smithi016.stderr: 7fbe3a7fc640 / http_manager 2024-09-12T17:18:36.847 INFO:tasks.workunit.client.0.smithi016.stderr: 7fbec0fe1640 / http_manager 2024-09-12T17:18:36.847 INFO:tasks.workunit.client.0.smithi016.stderr: 7fbec1fe3640 / rgw_dt_lg_renew 2024-09-12T17:18:36.847 INFO:tasks.workunit.client.0.smithi016.stderr: 7fbeed7fa640 / ms_dispatch 2024-09-12T17:18:36.847 INFO:tasks.workunit.client.0.smithi016.stderr: 7fbeeeffd640 / io_context_pool 2024-09-12T17:18:36.847 INFO:tasks.workunit.client.0.smithi016.stderr: 7fbef5602640 / ms_dispatch 2024-09-12T17:18:36.848 INFO:tasks.workunit.client.0.smithi016.stderr: 7fbef7e07640 / ms_dispatch 2024-09-12T17:18:36.848 INFO:tasks.workunit.client.0.smithi016.stderr: 7fbef960a640 / io_context_pool 2024-09-12T17:18:36.848 INFO:tasks.workunit.client.0.smithi016.stderr: 7fc00aec5640 / msgr-worker-2 2024-09-12T17:18:36.848 INFO:tasks.workunit.client.0.smithi016.stderr: 7fc00b6c6640 / msgr-worker-1 2024-09-12T17:18:36.848 INFO:tasks.workunit.client.0.smithi016.stderr: 7fc00bec7640 / msgr-worker-0 2024-09-12T17:18:36.848 INFO:tasks.workunit.client.0.smithi016.stderr: 7fc00c6c8640 / io_context_pool 2024-09-12T17:18:36.848 INFO:tasks.workunit.client.0.smithi016.stderr: 7fc00dbc09c0 / radosgw-admin 2024-09-12T17:18:36.848 INFO:tasks.workunit.client.0.smithi016.stderr: max_recent 500 2024-09-12T17:18:36.848 INFO:tasks.workunit.client.0.smithi016.stderr: max_new 1000 2024-09-12T17:18:36.848 INFO:tasks.workunit.client.0.smithi016.stderr: log_file /var/log/ceph/ceph-client.admin.97318.log 2024-09-12T17:18:36.848 INFO:tasks.workunit.client.0.smithi016.stderr:--- end dump of recent events --- 2024-09-12T17:18:36.848 INFO:tasks.workunit.client.0.smithi016.stderr:--- begin dump of recent events --- 2024-09-12T17:18:36.848 INFO:tasks.workunit.client.0.smithi016.stderr: -499> 2024-09-12T17:18:36.419+0000 7fbef960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:18:36.849 INFO:tasks.workunit.client.0.smithi016.stderr: -498> 2024-09-12T17:18:36.419+0000 7fbef960a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:18:36.849 INFO:tasks.workunit.client.0.smithi016.stderr: -497> 2024-09-12T17:18:36.419+0000 7fbef960a640 10 monclient: dump: 2024-09-12T17:18:36.849 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:18:36.849 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:18:36.849 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:18:36.849 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:18:36.849 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:18:36.849 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:18:36.849 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:18:36.849 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:18:36.849 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:18:36.849 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:36.849 INFO:tasks.workunit.client.0.smithi016.stderr: -496> 2024-09-12T17:18:36.419+0000 7fbef960a640 10 monclient: _finish_auth 0 2024-09-12T17:18:36.849 INFO:tasks.workunit.client.0.smithi016.stderr: -495> 2024-09-12T17:18:36.419+0000 7fbef960a640 10 monclient: _check_auth_tickets 2024-09-12T17:18:36.850 INFO:tasks.workunit.client.0.smithi016.stderr: -494> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 monclient: authenticate success, global_id 6819 2024-09-12T17:18:36.850 INFO:tasks.workunit.client.0.smithi016.stderr: -493> 2024-09-12T17:18:36.419+0000 7fbef960a640 10 monclient: handle_config config(0 keys) 2024-09-12T17:18:36.850 INFO:tasks.workunit.client.0.smithi016.stderr: -492> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 10 monclient: get_monmap_and_config success 2024-09-12T17:18:36.850 INFO:tasks.workunit.client.0.smithi016.stderr: -491> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 4 set_mon_vals no callback set 2024-09-12T17:18:36.850 INFO:tasks.workunit.client.0.smithi016.stderr: -490> 2024-09-12T17:18:36.419+0000 7fbef960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:18:36.850 INFO:tasks.workunit.client.0.smithi016.stderr: -489> 2024-09-12T17:18:36.419+0000 7fbef960a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:18:36.850 INFO:tasks.workunit.client.0.smithi016.stderr: -488> 2024-09-12T17:18:36.419+0000 7fbef960a640 10 monclient: dump: 2024-09-12T17:18:36.850 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:18:36.850 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:18:36.850 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:18:36.850 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:18:36.850 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:18:36.850 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:18:36.851 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:18:36.851 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:18:36.851 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:18:36.851 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:36.851 INFO:tasks.workunit.client.0.smithi016.stderr: -487> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 10 monclient: shutdown 2024-09-12T17:18:36.851 INFO:tasks.workunit.client.0.smithi016.stderr: -486> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 asok(0x5641aeda22b0) unregister_commands rotate-key 2024-09-12T17:18:36.851 INFO:tasks.workunit.client.0.smithi016.stderr: -485> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 10 monclient: build_initial_monmap 2024-09-12T17:18:36.851 INFO:tasks.workunit.client.0.smithi016.stderr: -484> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 1 build_initial for_mkfs: 0 2024-09-12T17:18:36.851 INFO:tasks.workunit.client.0.smithi016.stderr: -483> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 10 monclient: monmap: 2024-09-12T17:18:36.851 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:18:36.851 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:18:36.851 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:18:36.851 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:18:36.851 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:18:36.852 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:18:36.852 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:18:36.852 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:18:36.852 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:18:36.852 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:36.852 INFO:tasks.workunit.client.0.smithi016.stderr: -482> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefb0530) adding auth protocol: cephx 2024-09-12T17:18:36.852 INFO:tasks.workunit.client.0.smithi016.stderr: -481> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefb0530) adding auth protocol: cephx 2024-09-12T17:18:36.852 INFO:tasks.workunit.client.0.smithi016.stderr: -480> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefb0530) adding auth protocol: cephx 2024-09-12T17:18:36.852 INFO:tasks.workunit.client.0.smithi016.stderr: -479> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefb0530) adding con mode: secure 2024-09-12T17:18:36.852 INFO:tasks.workunit.client.0.smithi016.stderr: -478> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefb0530) adding con mode: crc 2024-09-12T17:18:36.852 INFO:tasks.workunit.client.0.smithi016.stderr: -477> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefb0530) adding con mode: secure 2024-09-12T17:18:36.852 INFO:tasks.workunit.client.0.smithi016.stderr: -476> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefb0530) adding con mode: crc 2024-09-12T17:18:36.852 INFO:tasks.workunit.client.0.smithi016.stderr: -475> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefb0530) adding con mode: secure 2024-09-12T17:18:36.853 INFO:tasks.workunit.client.0.smithi016.stderr: -474> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefb0530) adding con mode: crc 2024-09-12T17:18:36.853 INFO:tasks.workunit.client.0.smithi016.stderr: -473> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefb0530) adding con mode: crc 2024-09-12T17:18:36.853 INFO:tasks.workunit.client.0.smithi016.stderr: -472> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefb0530) adding con mode: secure 2024-09-12T17:18:36.853 INFO:tasks.workunit.client.0.smithi016.stderr: -471> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefb0530) adding con mode: crc 2024-09-12T17:18:36.853 INFO:tasks.workunit.client.0.smithi016.stderr: -470> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefb0530) adding con mode: secure 2024-09-12T17:18:36.853 INFO:tasks.workunit.client.0.smithi016.stderr: -469> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefb0530) adding con mode: crc 2024-09-12T17:18:36.853 INFO:tasks.workunit.client.0.smithi016.stderr: -468> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefb0530) adding con mode: secure 2024-09-12T17:18:36.853 INFO:tasks.workunit.client.0.smithi016.stderr: -467> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:18:36.853 INFO:tasks.workunit.client.0.smithi016.stderr: -466> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 1 librados: starting msgr at 2024-09-12T17:18:36.853 INFO:tasks.workunit.client.0.smithi016.stderr: -465> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 1 librados: starting objecter 2024-09-12T17:18:36.853 INFO:tasks.workunit.client.0.smithi016.stderr: -464> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 asok(0x5641aeda22b0) register_command objecter_requests hook 0x5641aefb3990 2024-09-12T17:18:36.853 INFO:tasks.workunit.client.0.smithi016.stderr: -463> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 1 librados: setting wanted keys 2024-09-12T17:18:36.853 INFO:tasks.workunit.client.0.smithi016.stderr: -462> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 1 librados: calling monclient init 2024-09-12T17:18:36.854 INFO:tasks.workunit.client.0.smithi016.stderr: -461> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 10 monclient: init 2024-09-12T17:18:36.854 INFO:tasks.workunit.client.0.smithi016.stderr: -460> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefad130) adding auth protocol: cephx 2024-09-12T17:18:36.854 INFO:tasks.workunit.client.0.smithi016.stderr: -459> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefad130) adding auth protocol: cephx 2024-09-12T17:18:36.854 INFO:tasks.workunit.client.0.smithi016.stderr: -458> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefad130) adding auth protocol: cephx 2024-09-12T17:18:36.854 INFO:tasks.workunit.client.0.smithi016.stderr: -457> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefad130) adding con mode: secure 2024-09-12T17:18:36.854 INFO:tasks.workunit.client.0.smithi016.stderr: -456> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefad130) adding con mode: crc 2024-09-12T17:18:36.854 INFO:tasks.workunit.client.0.smithi016.stderr: -455> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefad130) adding con mode: secure 2024-09-12T17:18:36.854 INFO:tasks.workunit.client.0.smithi016.stderr: -454> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefad130) adding con mode: crc 2024-09-12T17:18:36.854 INFO:tasks.workunit.client.0.smithi016.stderr: -453> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefad130) adding con mode: secure 2024-09-12T17:18:36.854 INFO:tasks.workunit.client.0.smithi016.stderr: -452> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefad130) adding con mode: crc 2024-09-12T17:18:36.854 INFO:tasks.workunit.client.0.smithi016.stderr: -451> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefad130) adding con mode: crc 2024-09-12T17:18:36.854 INFO:tasks.workunit.client.0.smithi016.stderr: -450> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefad130) adding con mode: secure 2024-09-12T17:18:36.854 INFO:tasks.workunit.client.0.smithi016.stderr: -449> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefad130) adding con mode: crc 2024-09-12T17:18:36.854 INFO:tasks.workunit.client.0.smithi016.stderr: -448> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefad130) adding con mode: secure 2024-09-12T17:18:36.855 INFO:tasks.workunit.client.0.smithi016.stderr: -447> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefad130) adding con mode: crc 2024-09-12T17:18:36.855 INFO:tasks.workunit.client.0.smithi016.stderr: -446> 2024-09-12T17:18:36.419+0000 7fc00dbc09c0 5 AuthRegistry(0x5641aefad130) adding con mode: secure 2024-09-12T17:18:36.855 INFO:tasks.workunit.client.0.smithi016.stderr: -445> 2024-09-12T17:18:36.423+0000 7fc00dbc09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:18:36.855 INFO:tasks.workunit.client.0.smithi016.stderr: -444> 2024-09-12T17:18:36.423+0000 7fc00dbc09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:18:36.855 INFO:tasks.workunit.client.0.smithi016.stderr: -443> 2024-09-12T17:18:36.423+0000 7fc00dbc09c0 5 asok(0x5641aeda22b0) register_command rotate-key hook 0x5641aefad278 2024-09-12T17:18:36.855 INFO:tasks.workunit.client.0.smithi016.stderr: -442> 2024-09-12T17:18:36.423+0000 7fc00dbc09c0 10 monclient: _reopen_session rank -1 2024-09-12T17:18:36.855 INFO:tasks.workunit.client.0.smithi016.stderr: -441> 2024-09-12T17:18:36.423+0000 7fc00dbc09c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:18:36.855 INFO:tasks.workunit.client.0.smithi016.stderr: -440> 2024-09-12T17:18:36.423+0000 7fc00dbc09c0 10 monclient(hunting): picked mon.noname-c con 0x5641aefb33d0 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:18:36.855 INFO:tasks.workunit.client.0.smithi016.stderr: -439> 2024-09-12T17:18:36.423+0000 7fc00dbc09c0 10 monclient(hunting): picked mon.noname-b con 0x5641aefd9c10 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:18:36.855 INFO:tasks.workunit.client.0.smithi016.stderr: -438> 2024-09-12T17:18:36.423+0000 7fc00dbc09c0 10 monclient(hunting): picked mon.noname-a con 0x7fbff4003100 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:18:36.855 INFO:tasks.workunit.client.0.smithi016.stderr: -437> 2024-09-12T17:18:36.423+0000 7fc00dbc09c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:18:36.855 INFO:tasks.workunit.client.0.smithi016.stderr: -436> 2024-09-12T17:18:36.423+0000 7fc00dbc09c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:18:36.855 INFO:tasks.workunit.client.0.smithi016.stderr: -435> 2024-09-12T17:18:36.423+0000 7fc00dbc09c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:18:36.856 INFO:tasks.workunit.client.0.smithi016.stderr: -434> 2024-09-12T17:18:36.423+0000 7fc00dbc09c0 10 monclient(hunting): _renew_subs 2024-09-12T17:18:36.856 INFO:tasks.workunit.client.0.smithi016.stderr: -433> 2024-09-12T17:18:36.423+0000 7fc00dbc09c0 10 monclient(hunting): authenticate will time out at 2234.400457s 2024-09-12T17:18:36.856 INFO:tasks.workunit.client.0.smithi016.stderr: -432> 2024-09-12T17:18:36.423+0000 7fc00b6c6640 10 monclient(hunting): get_auth_request con 0x5641aefb33d0 auth_method 0 2024-09-12T17:18:36.856 INFO:tasks.workunit.client.0.smithi016.stderr: -431> 2024-09-12T17:18:36.423+0000 7fc00b6c6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:18:36.856 INFO:tasks.workunit.client.0.smithi016.stderr: -430> 2024-09-12T17:18:36.423+0000 7fc00b6c6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:18:36.856 INFO:tasks.workunit.client.0.smithi016.stderr: -429> 2024-09-12T17:18:36.423+0000 7fc00b6c6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:18:36.856 INFO:tasks.workunit.client.0.smithi016.stderr: -428> 2024-09-12T17:18:36.423+0000 7fc00bec7640 10 monclient(hunting): get_auth_request con 0x7fbff4003100 auth_method 0 2024-09-12T17:18:36.856 INFO:tasks.workunit.client.0.smithi016.stderr: -427> 2024-09-12T17:18:36.423+0000 7fc00bec7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:18:36.856 INFO:tasks.workunit.client.0.smithi016.stderr: -426> 2024-09-12T17:18:36.423+0000 7fc00bec7640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:18:36.856 INFO:tasks.workunit.client.0.smithi016.stderr: -425> 2024-09-12T17:18:36.423+0000 7fc00bec7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:18:36.856 INFO:tasks.workunit.client.0.smithi016.stderr: -424> 2024-09-12T17:18:36.423+0000 7fc00b6c6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:18:36.856 INFO:tasks.workunit.client.0.smithi016.stderr: -423> 2024-09-12T17:18:36.423+0000 7fc00b6c6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:18:36.856 INFO:tasks.workunit.client.0.smithi016.stderr: -422> 2024-09-12T17:18:36.423+0000 7fc00b6c6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:18:36.857 INFO:tasks.workunit.client.0.smithi016.stderr: -421> 2024-09-12T17:18:36.423+0000 7fc00bec7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:18:36.857 INFO:tasks.workunit.client.0.smithi016.stderr: -420> 2024-09-12T17:18:36.423+0000 7fc00bec7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:18:36.857 INFO:tasks.workunit.client.0.smithi016.stderr: -419> 2024-09-12T17:18:36.423+0000 7fc00bec7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:18:36.857 INFO:tasks.workunit.client.0.smithi016.stderr: -418> 2024-09-12T17:18:36.423+0000 7fc00b6c6640 10 monclient(hunting): handle_auth_done global_id 6530 payload 824 2024-09-12T17:18:36.857 INFO:tasks.workunit.client.0.smithi016.stderr: -417> 2024-09-12T17:18:36.423+0000 7fc00b6c6640 10 monclient: _finish_hunting 0 2024-09-12T17:18:36.857 INFO:tasks.workunit.client.0.smithi016.stderr: -416> 2024-09-12T17:18:36.423+0000 7fc00b6c6640 1 monclient: found mon.noname-c 2024-09-12T17:18:36.857 INFO:tasks.workunit.client.0.smithi016.stderr: -415> 2024-09-12T17:18:36.423+0000 7fc00b6c6640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:18:36.857 INFO:tasks.workunit.client.0.smithi016.stderr: -414> 2024-09-12T17:18:36.423+0000 7fbef7e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:18:36.857 INFO:tasks.workunit.client.0.smithi016.stderr: -413> 2024-09-12T17:18:36.423+0000 7fbef7e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:18:36.857 INFO:tasks.workunit.client.0.smithi016.stderr: -412> 2024-09-12T17:18:36.423+0000 7fbef7e07640 10 monclient: dump: 2024-09-12T17:18:36.857 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:18:36.857 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:18:36.857 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:18:36.857 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:18:36.858 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:18:36.858 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:18:36.858 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:18:36.858 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:18:36.858 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:18:36.858 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:36.858 INFO:tasks.workunit.client.0.smithi016.stderr: -411> 2024-09-12T17:18:36.423+0000 7fbef7e07640 10 monclient: _finish_auth 0 2024-09-12T17:18:36.858 INFO:tasks.workunit.client.0.smithi016.stderr: -410> 2024-09-12T17:18:36.423+0000 7fbef7e07640 10 monclient: _check_auth_tickets 2024-09-12T17:18:36.858 INFO:tasks.workunit.client.0.smithi016.stderr: -409> 2024-09-12T17:18:36.423+0000 7fbef7e07640 10 monclient: handle_config config(0 keys) 2024-09-12T17:18:36.858 INFO:tasks.workunit.client.0.smithi016.stderr: -408> 2024-09-12T17:18:36.423+0000 7fbef7e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:18:36.858 INFO:tasks.workunit.client.0.smithi016.stderr: -407> 2024-09-12T17:18:36.423+0000 7fbef7e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:18:36.858 INFO:tasks.workunit.client.0.smithi016.stderr: -406> 2024-09-12T17:18:36.423+0000 7fbef7e07640 10 monclient: dump: 2024-09-12T17:18:36.858 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:18:36.859 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:18:36.859 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:18:36.859 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:18:36.859 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:18:36.859 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:18:36.859 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:18:36.859 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:18:36.859 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:18:36.859 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:36.859 INFO:tasks.workunit.client.0.smithi016.stderr: -405> 2024-09-12T17:18:36.423+0000 7fc00dbc09c0 5 monclient: authenticate success, global_id 6530 2024-09-12T17:18:36.859 INFO:tasks.workunit.client.0.smithi016.stderr: -404> 2024-09-12T17:18:36.423+0000 7fc00dbc09c0 10 monclient: _renew_subs 2024-09-12T17:18:36.859 INFO:tasks.workunit.client.0.smithi016.stderr: -403> 2024-09-12T17:18:36.423+0000 7fbef960a640 4 set_mon_vals no callback set 2024-09-12T17:18:36.859 INFO:tasks.workunit.client.0.smithi016.stderr: -402> 2024-09-12T17:18:36.423+0000 7fc00dbc09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:18:36.859 INFO:tasks.workunit.client.0.smithi016.stderr: -401> 2024-09-12T17:18:36.423+0000 7fc00dbc09c0 10 monclient: _renew_subs 2024-09-12T17:18:36.860 INFO:tasks.workunit.client.0.smithi016.stderr: -400> 2024-09-12T17:18:36.423+0000 7fc00dbc09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:18:36.860 INFO:tasks.workunit.client.0.smithi016.stderr: -399> 2024-09-12T17:18:36.423+0000 7fc00dbc09c0 1 librados: init done 2024-09-12T17:18:36.860 INFO:tasks.workunit.client.0.smithi016.stderr: -398> 2024-09-12T17:18:36.423+0000 7fbef7e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:18:36.860 INFO:tasks.workunit.client.0.smithi016.stderr: -397> 2024-09-12T17:18:36.423+0000 7fbef7e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:18:36.860 INFO:tasks.workunit.client.0.smithi016.stderr: -396> 2024-09-12T17:18:36.423+0000 7fbef7e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:18:36.860 INFO:tasks.workunit.client.0.smithi016.stderr: -395> 2024-09-12T17:18:36.423+0000 7fc00aec5640 10 monclient: get_auth_request con 0x7fbef0070ae0 auth_method 0 2024-09-12T17:18:36.860 INFO:tasks.workunit.client.0.smithi016.stderr: -394> 2024-09-12T17:18:36.423+0000 7fc00bec7640 10 monclient: get_auth_request con 0x5641aefe14b0 auth_method 0 2024-09-12T17:18:36.860 INFO:tasks.workunit.client.0.smithi016.stderr: -393> 2024-09-12T17:18:36.427+0000 7fc00b6c6640 10 monclient: get_auth_request con 0x5641aeff8d40 auth_method 0 2024-09-12T17:18:36.860 INFO:tasks.workunit.client.0.smithi016.stderr: -392> 2024-09-12T17:18:36.427+0000 7fc00aec5640 10 monclient: get_auth_request con 0x5641aeffd0a0 auth_method 0 2024-09-12T17:18:36.860 INFO:tasks.workunit.client.0.smithi016.stderr: -391> 2024-09-12T17:18:36.431+0000 7fc00bec7640 10 monclient: get_auth_request con 0x5641aeffc570 auth_method 0 2024-09-12T17:18:36.860 INFO:tasks.workunit.client.0.smithi016.stderr: -390> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 10 monclient: build_initial_monmap 2024-09-12T17:18:36.860 INFO:tasks.workunit.client.0.smithi016.stderr: -389> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 1 build_initial for_mkfs: 0 2024-09-12T17:18:36.860 INFO:tasks.workunit.client.0.smithi016.stderr: -388> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 10 monclient: monmap: 2024-09-12T17:18:36.861 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:18:36.861 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:18:36.861 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:18:36.861 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:18:36.861 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:18:36.861 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:18:36.861 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:18:36.861 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:18:36.861 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:18:36.861 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:36.861 INFO:tasks.workunit.client.0.smithi016.stderr: -387> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af005050) adding auth protocol: cephx 2024-09-12T17:18:36.861 INFO:tasks.workunit.client.0.smithi016.stderr: -386> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af005050) adding auth protocol: cephx 2024-09-12T17:18:36.861 INFO:tasks.workunit.client.0.smithi016.stderr: -385> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af005050) adding auth protocol: cephx 2024-09-12T17:18:36.861 INFO:tasks.workunit.client.0.smithi016.stderr: -384> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af005050) adding con mode: secure 2024-09-12T17:18:36.862 INFO:tasks.workunit.client.0.smithi016.stderr: -383> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af005050) adding con mode: crc 2024-09-12T17:18:36.862 INFO:tasks.workunit.client.0.smithi016.stderr: -382> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af005050) adding con mode: secure 2024-09-12T17:18:36.862 INFO:tasks.workunit.client.0.smithi016.stderr: -381> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af005050) adding con mode: crc 2024-09-12T17:18:36.862 INFO:tasks.workunit.client.0.smithi016.stderr: -380> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af005050) adding con mode: secure 2024-09-12T17:18:36.862 INFO:tasks.workunit.client.0.smithi016.stderr: -379> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af005050) adding con mode: crc 2024-09-12T17:18:36.862 INFO:tasks.workunit.client.0.smithi016.stderr: -378> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af005050) adding con mode: crc 2024-09-12T17:18:36.862 INFO:tasks.workunit.client.0.smithi016.stderr: -377> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af005050) adding con mode: secure 2024-09-12T17:18:36.862 INFO:tasks.workunit.client.0.smithi016.stderr: -376> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af005050) adding con mode: crc 2024-09-12T17:18:36.862 INFO:tasks.workunit.client.0.smithi016.stderr: -375> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af005050) adding con mode: secure 2024-09-12T17:18:36.862 INFO:tasks.workunit.client.0.smithi016.stderr: -374> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af005050) adding con mode: crc 2024-09-12T17:18:36.862 INFO:tasks.workunit.client.0.smithi016.stderr: -373> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af005050) adding con mode: secure 2024-09-12T17:18:36.862 INFO:tasks.workunit.client.0.smithi016.stderr: -372> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:18:36.862 INFO:tasks.workunit.client.0.smithi016.stderr: -371> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 asok(0x5641aeda22b0) register_command objecter_requests cmddesc objecter_requests hook 0x5641af008a40 EEXIST 2024-09-12T17:18:36.863 INFO:tasks.workunit.client.0.smithi016.stderr: -370> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 10 monclient: init 2024-09-12T17:18:36.863 INFO:tasks.workunit.client.0.smithi016.stderr: -369> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af003f98) adding auth protocol: cephx 2024-09-12T17:18:36.863 INFO:tasks.workunit.client.0.smithi016.stderr: -368> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af003f98) adding auth protocol: cephx 2024-09-12T17:18:36.863 INFO:tasks.workunit.client.0.smithi016.stderr: -367> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af003f98) adding auth protocol: cephx 2024-09-12T17:18:36.863 INFO:tasks.workunit.client.0.smithi016.stderr: -366> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af003f98) adding con mode: secure 2024-09-12T17:18:36.863 INFO:tasks.workunit.client.0.smithi016.stderr: -365> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af003f98) adding con mode: crc 2024-09-12T17:18:36.863 INFO:tasks.workunit.client.0.smithi016.stderr: -364> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af003f98) adding con mode: secure 2024-09-12T17:18:36.863 INFO:tasks.workunit.client.0.smithi016.stderr: -363> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af003f98) adding con mode: crc 2024-09-12T17:18:36.863 INFO:tasks.workunit.client.0.smithi016.stderr: -362> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af003f98) adding con mode: secure 2024-09-12T17:18:36.863 INFO:tasks.workunit.client.0.smithi016.stderr: -361> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af003f98) adding con mode: crc 2024-09-12T17:18:36.863 INFO:tasks.workunit.client.0.smithi016.stderr: -360> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af003f98) adding con mode: crc 2024-09-12T17:18:36.863 INFO:tasks.workunit.client.0.smithi016.stderr: -359> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af003f98) adding con mode: secure 2024-09-12T17:18:36.863 INFO:tasks.workunit.client.0.smithi016.stderr: -358> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af003f98) adding con mode: crc 2024-09-12T17:18:36.863 INFO:tasks.workunit.client.0.smithi016.stderr: -357> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af003f98) adding con mode: secure 2024-09-12T17:18:36.864 INFO:tasks.workunit.client.0.smithi016.stderr: -356> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af003f98) adding con mode: crc 2024-09-12T17:18:36.864 INFO:tasks.workunit.client.0.smithi016.stderr: -355> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af003f98) adding con mode: secure 2024-09-12T17:18:36.864 INFO:tasks.workunit.client.0.smithi016.stderr: -354> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:18:36.864 INFO:tasks.workunit.client.0.smithi016.stderr: -353> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:18:36.864 INFO:tasks.workunit.client.0.smithi016.stderr: -352> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 5 asok(0x5641aeda22b0) register_command rotate-key cmddesc rotate-key hook 0x5641af0040e0 EEXIST 2024-09-12T17:18:36.864 INFO:tasks.workunit.client.0.smithi016.stderr: -351> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 10 monclient: _reopen_session rank -1 2024-09-12T17:18:36.864 INFO:tasks.workunit.client.0.smithi016.stderr: -350> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:18:36.864 INFO:tasks.workunit.client.0.smithi016.stderr: -349> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 10 monclient(hunting): picked mon.noname-b con 0x5641af02cbf0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:18:36.864 INFO:tasks.workunit.client.0.smithi016.stderr: -348> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 10 monclient(hunting): picked mon.noname-a con 0x5641af02c520 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:18:36.864 INFO:tasks.workunit.client.0.smithi016.stderr: -347> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 10 monclient(hunting): picked mon.noname-c con 0x5641af02af00 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:18:36.864 INFO:tasks.workunit.client.0.smithi016.stderr: -346> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:18:36.864 INFO:tasks.workunit.client.0.smithi016.stderr: -345> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:18:36.864 INFO:tasks.workunit.client.0.smithi016.stderr: -344> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:18:36.865 INFO:tasks.workunit.client.0.smithi016.stderr: -343> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 10 monclient(hunting): _renew_subs 2024-09-12T17:18:36.865 INFO:tasks.workunit.client.0.smithi016.stderr: -342> 2024-09-12T17:18:36.431+0000 7fc00dbc09c0 10 monclient(hunting): authenticate will time out at 2234.411877s 2024-09-12T17:18:36.865 INFO:tasks.workunit.client.0.smithi016.stderr: -341> 2024-09-12T17:18:36.435+0000 7fc00b6c6640 10 monclient(hunting): get_auth_request con 0x5641af02af00 auth_method 0 2024-09-12T17:18:36.865 INFO:tasks.workunit.client.0.smithi016.stderr: -340> 2024-09-12T17:18:36.435+0000 7fc00b6c6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:18:36.865 INFO:tasks.workunit.client.0.smithi016.stderr: -339> 2024-09-12T17:18:36.435+0000 7fc00b6c6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:18:36.865 INFO:tasks.workunit.client.0.smithi016.stderr: -338> 2024-09-12T17:18:36.435+0000 7fc00b6c6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:18:36.865 INFO:tasks.workunit.client.0.smithi016.stderr: -337> 2024-09-12T17:18:36.435+0000 7fc00bec7640 10 monclient(hunting): get_auth_request con 0x5641af02c520 auth_method 0 2024-09-12T17:18:36.865 INFO:tasks.workunit.client.0.smithi016.stderr: -336> 2024-09-12T17:18:36.435+0000 7fc00bec7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:18:36.865 INFO:tasks.workunit.client.0.smithi016.stderr: -335> 2024-09-12T17:18:36.435+0000 7fc00bec7640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:18:36.865 INFO:tasks.workunit.client.0.smithi016.stderr: -334> 2024-09-12T17:18:36.435+0000 7fc00bec7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:18:36.865 INFO:tasks.workunit.client.0.smithi016.stderr: -333> 2024-09-12T17:18:36.435+0000 7fc00b6c6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:18:36.865 INFO:tasks.workunit.client.0.smithi016.stderr: -332> 2024-09-12T17:18:36.435+0000 7fc00b6c6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:18:36.865 INFO:tasks.workunit.client.0.smithi016.stderr: -331> 2024-09-12T17:18:36.435+0000 7fc00b6c6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:18:36.866 INFO:tasks.workunit.client.0.smithi016.stderr: -330> 2024-09-12T17:18:36.435+0000 7fc00bec7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:18:36.866 INFO:tasks.workunit.client.0.smithi016.stderr: -329> 2024-09-12T17:18:36.435+0000 7fc00bec7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:18:36.866 INFO:tasks.workunit.client.0.smithi016.stderr: -328> 2024-09-12T17:18:36.435+0000 7fc00bec7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:18:36.866 INFO:tasks.workunit.client.0.smithi016.stderr: -327> 2024-09-12T17:18:36.435+0000 7fc00aec5640 10 monclient(hunting): get_auth_request con 0x5641af02cbf0 auth_method 0 2024-09-12T17:18:36.866 INFO:tasks.workunit.client.0.smithi016.stderr: -326> 2024-09-12T17:18:36.435+0000 7fc00aec5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:18:36.866 INFO:tasks.workunit.client.0.smithi016.stderr: -325> 2024-09-12T17:18:36.435+0000 7fc00aec5640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:18:36.866 INFO:tasks.workunit.client.0.smithi016.stderr: -324> 2024-09-12T17:18:36.435+0000 7fc00aec5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:18:36.866 INFO:tasks.workunit.client.0.smithi016.stderr: -323> 2024-09-12T17:18:36.435+0000 7fc00b6c6640 10 monclient(hunting): handle_auth_done global_id 6533 payload 824 2024-09-12T17:18:36.866 INFO:tasks.workunit.client.0.smithi016.stderr: -322> 2024-09-12T17:18:36.435+0000 7fc00b6c6640 10 monclient: _finish_hunting 0 2024-09-12T17:18:36.866 INFO:tasks.workunit.client.0.smithi016.stderr: -321> 2024-09-12T17:18:36.435+0000 7fc00b6c6640 1 monclient: found mon.noname-c 2024-09-12T17:18:36.866 INFO:tasks.workunit.client.0.smithi016.stderr: -320> 2024-09-12T17:18:36.435+0000 7fc00b6c6640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:18:36.866 INFO:tasks.workunit.client.0.smithi016.stderr: -319> 2024-09-12T17:18:36.435+0000 7fbef5602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:18:36.866 INFO:tasks.workunit.client.0.smithi016.stderr: -318> 2024-09-12T17:18:36.435+0000 7fbef5602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:18:36.866 INFO:tasks.workunit.client.0.smithi016.stderr: -317> 2024-09-12T17:18:36.435+0000 7fbef5602640 10 monclient: dump: 2024-09-12T17:18:36.867 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:18:36.867 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:18:36.867 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:18:36.867 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:18:36.867 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:18:36.867 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:18:36.867 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:18:36.867 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:18:36.867 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:18:36.867 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:36.867 INFO:tasks.workunit.client.0.smithi016.stderr: -316> 2024-09-12T17:18:36.435+0000 7fbef5602640 10 monclient: _finish_auth 0 2024-09-12T17:18:36.867 INFO:tasks.workunit.client.0.smithi016.stderr: -315> 2024-09-12T17:18:36.435+0000 7fbef5602640 10 monclient: _check_auth_tickets 2024-09-12T17:18:36.867 INFO:tasks.workunit.client.0.smithi016.stderr: -314> 2024-09-12T17:18:36.435+0000 7fbef5602640 10 monclient: handle_config config(0 keys) 2024-09-12T17:18:36.868 INFO:tasks.workunit.client.0.smithi016.stderr: -313> 2024-09-12T17:18:36.435+0000 7fbef5602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:18:36.868 INFO:tasks.workunit.client.0.smithi016.stderr: -312> 2024-09-12T17:18:36.435+0000 7fbef5602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:18:36.868 INFO:tasks.workunit.client.0.smithi016.stderr: -311> 2024-09-12T17:18:36.435+0000 7fbef5602640 10 monclient: dump: 2024-09-12T17:18:36.868 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:18:36.868 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:18:36.868 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:18:36.868 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:18:36.868 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:18:36.868 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:18:36.868 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:18:36.868 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:18:36.868 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:18:36.868 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:36.868 INFO:tasks.workunit.client.0.smithi016.stderr: -310> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 monclient: authenticate success, global_id 6533 2024-09-12T17:18:36.869 INFO:tasks.workunit.client.0.smithi016.stderr: -309> 2024-09-12T17:18:36.435+0000 7fc00c6c8640 4 set_mon_vals no callback set 2024-09-12T17:18:36.869 INFO:tasks.workunit.client.0.smithi016.stderr: -308> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 10 monclient: _renew_subs 2024-09-12T17:18:36.869 INFO:tasks.workunit.client.0.smithi016.stderr: -307> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:18:36.869 INFO:tasks.workunit.client.0.smithi016.stderr: -306> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 10 monclient: _renew_subs 2024-09-12T17:18:36.869 INFO:tasks.workunit.client.0.smithi016.stderr: -305> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:18:36.869 INFO:tasks.workunit.client.0.smithi016.stderr: -304> 2024-09-12T17:18:36.435+0000 7fbef5602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:18:36.869 INFO:tasks.workunit.client.0.smithi016.stderr: -303> 2024-09-12T17:18:36.435+0000 7fbef5602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:18:36.869 INFO:tasks.workunit.client.0.smithi016.stderr: -302> 2024-09-12T17:18:36.435+0000 7fbef5602640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:18:36.869 INFO:tasks.workunit.client.0.smithi016.stderr: -301> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 10 monclient: get_monmap_and_config 2024-09-12T17:18:36.869 INFO:tasks.workunit.client.0.smithi016.stderr: -300> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 10 monclient: build_initial_monmap 2024-09-12T17:18:36.869 INFO:tasks.workunit.client.0.smithi016.stderr: -299> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 1 build_initial for_mkfs: 0 2024-09-12T17:18:36.869 INFO:tasks.workunit.client.0.smithi016.stderr: -298> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 10 monclient: monmap: 2024-09-12T17:18:36.869 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:18:36.870 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:18:36.870 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:18:36.870 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:18:36.870 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:18:36.870 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:18:36.870 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:18:36.870 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:18:36.870 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:18:36.870 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:36.870 INFO:tasks.workunit.client.0.smithi016.stderr: -297> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af04c100) adding auth protocol: cephx 2024-09-12T17:18:36.870 INFO:tasks.workunit.client.0.smithi016.stderr: -296> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af04c100) adding auth protocol: cephx 2024-09-12T17:18:36.870 INFO:tasks.workunit.client.0.smithi016.stderr: -295> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af04c100) adding auth protocol: cephx 2024-09-12T17:18:36.870 INFO:tasks.workunit.client.0.smithi016.stderr: -294> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af04c100) adding con mode: secure 2024-09-12T17:18:36.870 INFO:tasks.workunit.client.0.smithi016.stderr: -293> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af04c100) adding con mode: crc 2024-09-12T17:18:36.871 INFO:tasks.workunit.client.0.smithi016.stderr: -292> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af04c100) adding con mode: secure 2024-09-12T17:18:36.871 INFO:tasks.workunit.client.0.smithi016.stderr: -291> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af04c100) adding con mode: crc 2024-09-12T17:18:36.871 INFO:tasks.workunit.client.0.smithi016.stderr: -290> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af04c100) adding con mode: secure 2024-09-12T17:18:36.871 INFO:tasks.workunit.client.0.smithi016.stderr: -289> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af04c100) adding con mode: crc 2024-09-12T17:18:36.871 INFO:tasks.workunit.client.0.smithi016.stderr: -288> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af04c100) adding con mode: crc 2024-09-12T17:18:36.871 INFO:tasks.workunit.client.0.smithi016.stderr: -287> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af04c100) adding con mode: secure 2024-09-12T17:18:36.871 INFO:tasks.workunit.client.0.smithi016.stderr: -286> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af04c100) adding con mode: crc 2024-09-12T17:18:36.871 INFO:tasks.workunit.client.0.smithi016.stderr: -285> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af04c100) adding con mode: secure 2024-09-12T17:18:36.871 INFO:tasks.workunit.client.0.smithi016.stderr: -284> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af04c100) adding con mode: crc 2024-09-12T17:18:36.871 INFO:tasks.workunit.client.0.smithi016.stderr: -283> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af04c100) adding con mode: secure 2024-09-12T17:18:36.871 INFO:tasks.workunit.client.0.smithi016.stderr: -282> 2024-09-12T17:18:36.435+0000 7fc00aec5640 10 monclient: get_auth_request con 0x7fbee4070a20 auth_method 0 2024-09-12T17:18:36.871 INFO:tasks.workunit.client.0.smithi016.stderr: -281> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:18:36.871 INFO:tasks.workunit.client.0.smithi016.stderr: -280> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 10 monclient: init 2024-09-12T17:18:36.872 INFO:tasks.workunit.client.0.smithi016.stderr: -279> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6275e40) adding auth protocol: cephx 2024-09-12T17:18:36.872 INFO:tasks.workunit.client.0.smithi016.stderr: -278> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6275e40) adding auth protocol: cephx 2024-09-12T17:18:36.872 INFO:tasks.workunit.client.0.smithi016.stderr: -277> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6275e40) adding auth protocol: cephx 2024-09-12T17:18:36.872 INFO:tasks.workunit.client.0.smithi016.stderr: -276> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6275e40) adding con mode: secure 2024-09-12T17:18:36.872 INFO:tasks.workunit.client.0.smithi016.stderr: -275> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6275e40) adding con mode: crc 2024-09-12T17:18:36.872 INFO:tasks.workunit.client.0.smithi016.stderr: -274> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6275e40) adding con mode: secure 2024-09-12T17:18:36.872 INFO:tasks.workunit.client.0.smithi016.stderr: -273> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6275e40) adding con mode: crc 2024-09-12T17:18:36.872 INFO:tasks.workunit.client.0.smithi016.stderr: -272> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6275e40) adding con mode: secure 2024-09-12T17:18:36.872 INFO:tasks.workunit.client.0.smithi016.stderr: -271> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6275e40) adding con mode: crc 2024-09-12T17:18:36.872 INFO:tasks.workunit.client.0.smithi016.stderr: -270> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6275e40) adding con mode: crc 2024-09-12T17:18:36.872 INFO:tasks.workunit.client.0.smithi016.stderr: -269> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6275e40) adding con mode: secure 2024-09-12T17:18:36.872 INFO:tasks.workunit.client.0.smithi016.stderr: -268> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6275e40) adding con mode: crc 2024-09-12T17:18:36.872 INFO:tasks.workunit.client.0.smithi016.stderr: -267> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6275e40) adding con mode: secure 2024-09-12T17:18:36.873 INFO:tasks.workunit.client.0.smithi016.stderr: -266> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6275e40) adding con mode: crc 2024-09-12T17:18:36.873 INFO:tasks.workunit.client.0.smithi016.stderr: -265> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6275e40) adding con mode: secure 2024-09-12T17:18:36.873 INFO:tasks.workunit.client.0.smithi016.stderr: -264> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:18:36.873 INFO:tasks.workunit.client.0.smithi016.stderr: -263> 2024-09-12T17:18:36.435+0000 7fc00dbc09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:18:36.873 INFO:tasks.workunit.client.0.smithi016.stderr: -262> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 asok(0x5641aeda22b0) register_command rotate-key cmddesc rotate-key hook 0x7ffdd6275f88 EEXIST 2024-09-12T17:18:36.873 INFO:tasks.workunit.client.0.smithi016.stderr: -261> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient: _reopen_session rank -1 2024-09-12T17:18:36.873 INFO:tasks.workunit.client.0.smithi016.stderr: -260> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:18:36.873 INFO:tasks.workunit.client.0.smithi016.stderr: -259> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient(hunting): picked mon.noname-a con 0x5641af0805b0 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:18:36.873 INFO:tasks.workunit.client.0.smithi016.stderr: -258> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient(hunting): picked mon.noname-c con 0x5641af051690 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:18:36.873 INFO:tasks.workunit.client.0.smithi016.stderr: -257> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient(hunting): picked mon.noname-b con 0x5641af07bec0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:18:36.873 INFO:tasks.workunit.client.0.smithi016.stderr: -256> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:18:36.873 INFO:tasks.workunit.client.0.smithi016.stderr: -255> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:18:36.873 INFO:tasks.workunit.client.0.smithi016.stderr: -254> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:18:36.873 INFO:tasks.workunit.client.0.smithi016.stderr: -253> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient(hunting): _renew_subs 2024-09-12T17:18:36.874 INFO:tasks.workunit.client.0.smithi016.stderr: -252> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient(hunting): authenticate will time out at 2234.416083s 2024-09-12T17:18:36.874 INFO:tasks.workunit.client.0.smithi016.stderr: -251> 2024-09-12T17:18:36.439+0000 7fc00aec5640 10 monclient(hunting): get_auth_request con 0x5641af0805b0 auth_method 0 2024-09-12T17:18:36.874 INFO:tasks.workunit.client.0.smithi016.stderr: -250> 2024-09-12T17:18:36.439+0000 7fc00aec5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:18:36.874 INFO:tasks.workunit.client.0.smithi016.stderr: -249> 2024-09-12T17:18:36.439+0000 7fc00aec5640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:18:36.874 INFO:tasks.workunit.client.0.smithi016.stderr: -248> 2024-09-12T17:18:36.439+0000 7fc00aec5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:18:36.874 INFO:tasks.workunit.client.0.smithi016.stderr: -247> 2024-09-12T17:18:36.439+0000 7fc00bec7640 10 monclient(hunting): get_auth_request con 0x5641af051690 auth_method 0 2024-09-12T17:18:36.874 INFO:tasks.workunit.client.0.smithi016.stderr: -246> 2024-09-12T17:18:36.439+0000 7fc00bec7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:18:36.874 INFO:tasks.workunit.client.0.smithi016.stderr: -245> 2024-09-12T17:18:36.439+0000 7fc00bec7640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:18:36.874 INFO:tasks.workunit.client.0.smithi016.stderr: -244> 2024-09-12T17:18:36.439+0000 7fc00bec7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:18:36.874 INFO:tasks.workunit.client.0.smithi016.stderr: -243> 2024-09-12T17:18:36.439+0000 7fc00bec7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:18:36.874 INFO:tasks.workunit.client.0.smithi016.stderr: -242> 2024-09-12T17:18:36.439+0000 7fc00bec7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:18:36.874 INFO:tasks.workunit.client.0.smithi016.stderr: -241> 2024-09-12T17:18:36.439+0000 7fc00bec7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:18:36.874 INFO:tasks.workunit.client.0.smithi016.stderr: -240> 2024-09-12T17:18:36.439+0000 7fc00aec5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:18:36.875 INFO:tasks.workunit.client.0.smithi016.stderr: -239> 2024-09-12T17:18:36.439+0000 7fc00aec5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:18:36.875 INFO:tasks.workunit.client.0.smithi016.stderr: -238> 2024-09-12T17:18:36.439+0000 7fc00aec5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:18:36.875 INFO:tasks.workunit.client.0.smithi016.stderr: -237> 2024-09-12T17:18:36.439+0000 7fc00b6c6640 10 monclient(hunting): get_auth_request con 0x5641af07bec0 auth_method 0 2024-09-12T17:18:36.875 INFO:tasks.workunit.client.0.smithi016.stderr: -236> 2024-09-12T17:18:36.439+0000 7fc00b6c6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:18:36.875 INFO:tasks.workunit.client.0.smithi016.stderr: -235> 2024-09-12T17:18:36.439+0000 7fc00b6c6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:18:36.875 INFO:tasks.workunit.client.0.smithi016.stderr: -234> 2024-09-12T17:18:36.439+0000 7fc00b6c6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:18:36.875 INFO:tasks.workunit.client.0.smithi016.stderr: -233> 2024-09-12T17:18:36.439+0000 7fc00bec7640 10 monclient(hunting): handle_auth_done global_id 6536 payload 274 2024-09-12T17:18:36.875 INFO:tasks.workunit.client.0.smithi016.stderr: -232> 2024-09-12T17:18:36.439+0000 7fc00bec7640 10 monclient: _finish_hunting 0 2024-09-12T17:18:36.875 INFO:tasks.workunit.client.0.smithi016.stderr: -231> 2024-09-12T17:18:36.439+0000 7fc00bec7640 1 monclient: found mon.noname-c 2024-09-12T17:18:36.875 INFO:tasks.workunit.client.0.smithi016.stderr: -230> 2024-09-12T17:18:36.439+0000 7fc00bec7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:18:36.875 INFO:tasks.workunit.client.0.smithi016.stderr: -229> 2024-09-12T17:18:36.439+0000 7fbeeeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:18:36.875 INFO:tasks.workunit.client.0.smithi016.stderr: -228> 2024-09-12T17:18:36.439+0000 7fbeeeffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:18:36.875 INFO:tasks.workunit.client.0.smithi016.stderr: -227> 2024-09-12T17:18:36.439+0000 7fbeeeffd640 10 monclient: dump: 2024-09-12T17:18:36.875 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:18:36.876 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:18:36.876 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:18:36.876 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:18:36.876 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:18:36.876 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:18:36.876 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:18:36.876 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:18:36.876 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:18:36.876 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:36.876 INFO:tasks.workunit.client.0.smithi016.stderr: -226> 2024-09-12T17:18:36.439+0000 7fbeeeffd640 10 monclient: _finish_auth 0 2024-09-12T17:18:36.876 INFO:tasks.workunit.client.0.smithi016.stderr: -225> 2024-09-12T17:18:36.439+0000 7fbeeeffd640 10 monclient: _check_auth_tickets 2024-09-12T17:18:36.876 INFO:tasks.workunit.client.0.smithi016.stderr: -224> 2024-09-12T17:18:36.439+0000 7fbeeeffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:18:36.876 INFO:tasks.workunit.client.0.smithi016.stderr: -223> 2024-09-12T17:18:36.439+0000 7fbeeeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:18:36.877 INFO:tasks.workunit.client.0.smithi016.stderr: -222> 2024-09-12T17:18:36.439+0000 7fbeeeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:18:36.877 INFO:tasks.workunit.client.0.smithi016.stderr: -221> 2024-09-12T17:18:36.439+0000 7fbeeeffd640 10 monclient: dump: 2024-09-12T17:18:36.877 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:18:36.877 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:18:36.877 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:18:36.877 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:18:36.877 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:18:36.877 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:18:36.877 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:18:36.877 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:18:36.877 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:18:36.877 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:36.877 INFO:tasks.workunit.client.0.smithi016.stderr: -220> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 monclient: authenticate success, global_id 6536 2024-09-12T17:18:36.877 INFO:tasks.workunit.client.0.smithi016.stderr: -219> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient: get_monmap_and_config success 2024-09-12T17:18:36.878 INFO:tasks.workunit.client.0.smithi016.stderr: -218> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 4 set_mon_vals no callback set 2024-09-12T17:18:36.878 INFO:tasks.workunit.client.0.smithi016.stderr: -217> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient: shutdown 2024-09-12T17:18:36.878 INFO:tasks.workunit.client.0.smithi016.stderr: -216> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient: build_initial_monmap 2024-09-12T17:18:36.878 INFO:tasks.workunit.client.0.smithi016.stderr: -215> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 1 build_initial for_mkfs: 0 2024-09-12T17:18:36.878 INFO:tasks.workunit.client.0.smithi016.stderr: -214> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient: monmap: 2024-09-12T17:18:36.878 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:18:36.878 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:18:36.878 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:18:36.878 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:18:36.878 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:18:36.878 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:18:36.878 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:18:36.878 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:18:36.878 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:18:36.879 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:36.879 INFO:tasks.workunit.client.0.smithi016.stderr: -213> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af07c7d0) adding auth protocol: cephx 2024-09-12T17:18:36.879 INFO:tasks.workunit.client.0.smithi016.stderr: -212> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af07c7d0) adding auth protocol: cephx 2024-09-12T17:18:36.879 INFO:tasks.workunit.client.0.smithi016.stderr: -211> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af07c7d0) adding auth protocol: cephx 2024-09-12T17:18:36.879 INFO:tasks.workunit.client.0.smithi016.stderr: -210> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af07c7d0) adding con mode: secure 2024-09-12T17:18:36.879 INFO:tasks.workunit.client.0.smithi016.stderr: -209> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af07c7d0) adding con mode: crc 2024-09-12T17:18:36.879 INFO:tasks.workunit.client.0.smithi016.stderr: -208> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af07c7d0) adding con mode: secure 2024-09-12T17:18:36.879 INFO:tasks.workunit.client.0.smithi016.stderr: -207> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af07c7d0) adding con mode: crc 2024-09-12T17:18:36.879 INFO:tasks.workunit.client.0.smithi016.stderr: -206> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af07c7d0) adding con mode: secure 2024-09-12T17:18:36.879 INFO:tasks.workunit.client.0.smithi016.stderr: -205> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af07c7d0) adding con mode: crc 2024-09-12T17:18:36.879 INFO:tasks.workunit.client.0.smithi016.stderr: -204> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af07c7d0) adding con mode: crc 2024-09-12T17:18:36.879 INFO:tasks.workunit.client.0.smithi016.stderr: -203> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af07c7d0) adding con mode: secure 2024-09-12T17:18:36.879 INFO:tasks.workunit.client.0.smithi016.stderr: -202> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af07c7d0) adding con mode: crc 2024-09-12T17:18:36.880 INFO:tasks.workunit.client.0.smithi016.stderr: -201> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af07c7d0) adding con mode: secure 2024-09-12T17:18:36.880 INFO:tasks.workunit.client.0.smithi016.stderr: -200> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af07c7d0) adding con mode: crc 2024-09-12T17:18:36.880 INFO:tasks.workunit.client.0.smithi016.stderr: -199> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af07c7d0) adding con mode: secure 2024-09-12T17:18:36.880 INFO:tasks.workunit.client.0.smithi016.stderr: -198> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:18:36.880 INFO:tasks.workunit.client.0.smithi016.stderr: -197> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 1 librados: starting msgr at 2024-09-12T17:18:36.880 INFO:tasks.workunit.client.0.smithi016.stderr: -196> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 1 librados: starting objecter 2024-09-12T17:18:36.880 INFO:tasks.workunit.client.0.smithi016.stderr: -195> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 asok(0x5641aeda22b0) register_command objecter_requests cmddesc objecter_requests hook 0x5641af041f70 EEXIST 2024-09-12T17:18:36.880 INFO:tasks.workunit.client.0.smithi016.stderr: -194> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 1 librados: setting wanted keys 2024-09-12T17:18:36.880 INFO:tasks.workunit.client.0.smithi016.stderr: -193> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 1 librados: calling monclient init 2024-09-12T17:18:36.880 INFO:tasks.workunit.client.0.smithi016.stderr: -192> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient: init 2024-09-12T17:18:36.880 INFO:tasks.workunit.client.0.smithi016.stderr: -191> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af02ea10) adding auth protocol: cephx 2024-09-12T17:18:36.880 INFO:tasks.workunit.client.0.smithi016.stderr: -190> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af02ea10) adding auth protocol: cephx 2024-09-12T17:18:36.880 INFO:tasks.workunit.client.0.smithi016.stderr: -189> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af02ea10) adding auth protocol: cephx 2024-09-12T17:18:36.881 INFO:tasks.workunit.client.0.smithi016.stderr: -188> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af02ea10) adding con mode: secure 2024-09-12T17:18:36.881 INFO:tasks.workunit.client.0.smithi016.stderr: -187> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af02ea10) adding con mode: crc 2024-09-12T17:18:36.881 INFO:tasks.workunit.client.0.smithi016.stderr: -186> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af02ea10) adding con mode: secure 2024-09-12T17:18:36.881 INFO:tasks.workunit.client.0.smithi016.stderr: -185> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af02ea10) adding con mode: crc 2024-09-12T17:18:36.881 INFO:tasks.workunit.client.0.smithi016.stderr: -184> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af02ea10) adding con mode: secure 2024-09-12T17:18:36.881 INFO:tasks.workunit.client.0.smithi016.stderr: -183> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af02ea10) adding con mode: crc 2024-09-12T17:18:36.881 INFO:tasks.workunit.client.0.smithi016.stderr: -182> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af02ea10) adding con mode: crc 2024-09-12T17:18:36.881 INFO:tasks.workunit.client.0.smithi016.stderr: -181> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af02ea10) adding con mode: secure 2024-09-12T17:18:36.881 INFO:tasks.workunit.client.0.smithi016.stderr: -180> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af02ea10) adding con mode: crc 2024-09-12T17:18:36.881 INFO:tasks.workunit.client.0.smithi016.stderr: -179> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af02ea10) adding con mode: secure 2024-09-12T17:18:36.881 INFO:tasks.workunit.client.0.smithi016.stderr: -178> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af02ea10) adding con mode: crc 2024-09-12T17:18:36.881 INFO:tasks.workunit.client.0.smithi016.stderr: -177> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 AuthRegistry(0x5641af02ea10) adding con mode: secure 2024-09-12T17:18:36.881 INFO:tasks.workunit.client.0.smithi016.stderr: -176> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:18:36.881 INFO:tasks.workunit.client.0.smithi016.stderr: -175> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:18:36.882 INFO:tasks.workunit.client.0.smithi016.stderr: -174> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 asok(0x5641aeda22b0) register_command rotate-key cmddesc rotate-key hook 0x5641af02eb58 EEXIST 2024-09-12T17:18:36.882 INFO:tasks.workunit.client.0.smithi016.stderr: -173> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient: _reopen_session rank -1 2024-09-12T17:18:36.882 INFO:tasks.workunit.client.0.smithi016.stderr: -172> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:18:36.882 INFO:tasks.workunit.client.0.smithi016.stderr: -171> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient(hunting): picked mon.noname-c con 0x5641af051690 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:18:36.882 INFO:tasks.workunit.client.0.smithi016.stderr: -170> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient(hunting): picked mon.noname-a con 0x5641af07bec0 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:18:36.882 INFO:tasks.workunit.client.0.smithi016.stderr: -169> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient(hunting): picked mon.noname-b con 0x5641af0805b0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:18:36.882 INFO:tasks.workunit.client.0.smithi016.stderr: -168> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:18:36.882 INFO:tasks.workunit.client.0.smithi016.stderr: -167> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:18:36.882 INFO:tasks.workunit.client.0.smithi016.stderr: -166> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:18:36.882 INFO:tasks.workunit.client.0.smithi016.stderr: -165> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient(hunting): _renew_subs 2024-09-12T17:18:36.882 INFO:tasks.workunit.client.0.smithi016.stderr: -164> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient(hunting): authenticate will time out at 2234.418693s 2024-09-12T17:18:36.882 INFO:tasks.workunit.client.0.smithi016.stderr: -163> 2024-09-12T17:18:36.439+0000 7fc00aec5640 10 monclient(hunting): get_auth_request con 0x5641af051690 auth_method 0 2024-09-12T17:18:36.882 INFO:tasks.workunit.client.0.smithi016.stderr: -162> 2024-09-12T17:18:36.439+0000 7fc00aec5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:18:36.883 INFO:tasks.workunit.client.0.smithi016.stderr: -161> 2024-09-12T17:18:36.439+0000 7fc00aec5640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:18:36.883 INFO:tasks.workunit.client.0.smithi016.stderr: -160> 2024-09-12T17:18:36.439+0000 7fc00aec5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:18:36.883 INFO:tasks.workunit.client.0.smithi016.stderr: -159> 2024-09-12T17:18:36.439+0000 7fc00bec7640 10 monclient(hunting): get_auth_request con 0x5641af07bec0 auth_method 0 2024-09-12T17:18:36.883 INFO:tasks.workunit.client.0.smithi016.stderr: -158> 2024-09-12T17:18:36.439+0000 7fc00bec7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:18:36.883 INFO:tasks.workunit.client.0.smithi016.stderr: -157> 2024-09-12T17:18:36.439+0000 7fc00bec7640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:18:36.883 INFO:tasks.workunit.client.0.smithi016.stderr: -156> 2024-09-12T17:18:36.439+0000 7fc00bec7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:18:36.883 INFO:tasks.workunit.client.0.smithi016.stderr: -155> 2024-09-12T17:18:36.439+0000 7fc00aec5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:18:36.883 INFO:tasks.workunit.client.0.smithi016.stderr: -154> 2024-09-12T17:18:36.439+0000 7fc00aec5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:18:36.883 INFO:tasks.workunit.client.0.smithi016.stderr: -153> 2024-09-12T17:18:36.439+0000 7fc00aec5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:18:36.883 INFO:tasks.workunit.client.0.smithi016.stderr: -152> 2024-09-12T17:18:36.439+0000 7fc00bec7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:18:36.883 INFO:tasks.workunit.client.0.smithi016.stderr: -151> 2024-09-12T17:18:36.439+0000 7fc00bec7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:18:36.883 INFO:tasks.workunit.client.0.smithi016.stderr: -150> 2024-09-12T17:18:36.439+0000 7fc00bec7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:18:36.883 INFO:tasks.workunit.client.0.smithi016.stderr: -149> 2024-09-12T17:18:36.439+0000 7fc00b6c6640 10 monclient(hunting): get_auth_request con 0x5641af0805b0 auth_method 0 2024-09-12T17:18:36.883 INFO:tasks.workunit.client.0.smithi016.stderr: -148> 2024-09-12T17:18:36.439+0000 7fc00b6c6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:18:36.884 INFO:tasks.workunit.client.0.smithi016.stderr: -147> 2024-09-12T17:18:36.439+0000 7fc00b6c6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:18:36.884 INFO:tasks.workunit.client.0.smithi016.stderr: -146> 2024-09-12T17:18:36.439+0000 7fc00b6c6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:18:36.884 INFO:tasks.workunit.client.0.smithi016.stderr: -145> 2024-09-12T17:18:36.439+0000 7fc00aec5640 10 monclient(hunting): handle_auth_done global_id 6539 payload 824 2024-09-12T17:18:36.884 INFO:tasks.workunit.client.0.smithi016.stderr: -144> 2024-09-12T17:18:36.439+0000 7fc00aec5640 10 monclient: _finish_hunting 0 2024-09-12T17:18:36.884 INFO:tasks.workunit.client.0.smithi016.stderr: -143> 2024-09-12T17:18:36.439+0000 7fc00aec5640 1 monclient: found mon.noname-c 2024-09-12T17:18:36.884 INFO:tasks.workunit.client.0.smithi016.stderr: -142> 2024-09-12T17:18:36.439+0000 7fc00aec5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:18:36.884 INFO:tasks.workunit.client.0.smithi016.stderr: -141> 2024-09-12T17:18:36.439+0000 7fbeed7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:18:36.884 INFO:tasks.workunit.client.0.smithi016.stderr: -140> 2024-09-12T17:18:36.439+0000 7fbeed7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:18:36.884 INFO:tasks.workunit.client.0.smithi016.stderr: -139> 2024-09-12T17:18:36.439+0000 7fbeed7fa640 10 monclient: dump: 2024-09-12T17:18:36.884 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:18:36.884 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:18:36.884 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:18:36.884 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:18:36.885 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:18:36.885 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:18:36.885 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:18:36.885 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:18:36.885 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:18:36.885 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:36.885 INFO:tasks.workunit.client.0.smithi016.stderr: -138> 2024-09-12T17:18:36.439+0000 7fbeed7fa640 10 monclient: _finish_auth 0 2024-09-12T17:18:36.885 INFO:tasks.workunit.client.0.smithi016.stderr: -137> 2024-09-12T17:18:36.439+0000 7fbeed7fa640 10 monclient: _check_auth_tickets 2024-09-12T17:18:36.885 INFO:tasks.workunit.client.0.smithi016.stderr: -136> 2024-09-12T17:18:36.439+0000 7fbeed7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:18:36.885 INFO:tasks.workunit.client.0.smithi016.stderr: -135> 2024-09-12T17:18:36.439+0000 7fbeed7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:18:36.885 INFO:tasks.workunit.client.0.smithi016.stderr: -134> 2024-09-12T17:18:36.439+0000 7fbeed7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:18:36.885 INFO:tasks.workunit.client.0.smithi016.stderr: -133> 2024-09-12T17:18:36.439+0000 7fbeed7fa640 10 monclient: dump: 2024-09-12T17:18:36.885 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:18:36.885 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:18:36.886 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:18:36.886 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:18:36.886 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:18:36.886 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:18:36.886 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:18:36.886 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:18:36.886 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:18:36.886 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:36.886 INFO:tasks.workunit.client.0.smithi016.stderr: -132> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 monclient: authenticate success, global_id 6539 2024-09-12T17:18:36.887 INFO:tasks.workunit.client.0.smithi016.stderr: -131> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient: _renew_subs 2024-09-12T17:18:36.887 INFO:tasks.workunit.client.0.smithi016.stderr: -130> 2024-09-12T17:18:36.439+0000 7fbeeeffd640 4 set_mon_vals no callback set 2024-09-12T17:18:36.887 INFO:tasks.workunit.client.0.smithi016.stderr: -129> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:18:36.887 INFO:tasks.workunit.client.0.smithi016.stderr: -128> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient: _renew_subs 2024-09-12T17:18:36.887 INFO:tasks.workunit.client.0.smithi016.stderr: -127> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:18:36.887 INFO:tasks.workunit.client.0.smithi016.stderr: -126> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 1 librados: init done 2024-09-12T17:18:36.887 INFO:tasks.workunit.client.0.smithi016.stderr: -125> 2024-09-12T17:18:36.439+0000 7fc00dbc09c0 5 asok(0x5641aeda22b0) register_command cr dump hook 0x5641af077d48 2024-09-12T17:18:36.887 INFO:tasks.workunit.client.0.smithi016.stderr: -124> 2024-09-12T17:18:36.443+0000 7fc00dbc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.887 INFO:tasks.workunit.client.0.smithi016.stderr: -123> 2024-09-12T17:18:36.443+0000 7fbeed7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:18:36.887 INFO:tasks.workunit.client.0.smithi016.stderr: -122> 2024-09-12T17:18:36.443+0000 7fbeed7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:18:36.887 INFO:tasks.workunit.client.0.smithi016.stderr: -121> 2024-09-12T17:18:36.443+0000 7fbeed7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:18:36.887 INFO:tasks.workunit.client.0.smithi016.stderr: -120> 2024-09-12T17:18:36.443+0000 7fc00bec7640 10 monclient: get_auth_request con 0x7fbed4070ae0 auth_method 0 2024-09-12T17:18:36.887 INFO:tasks.workunit.client.0.smithi016.stderr: -119> 2024-09-12T17:18:36.443+0000 7fc00b6c6640 10 monclient: get_auth_request con 0x5641af09a6e0 auth_method 0 2024-09-12T17:18:36.887 INFO:tasks.workunit.client.0.smithi016.stderr: -118> 2024-09-12T17:18:36.443+0000 7fc00dbc09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:36.888 INFO:tasks.workunit.client.0.smithi016.stderr: -117> 2024-09-12T17:18:36.443+0000 7fc00dbc09c0 20 realm 2024-09-12T17:18:36.888 INFO:tasks.workunit.client.0.smithi016.stderr: -116> 2024-09-12T17:18:36.443+0000 7fc00dbc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.888 INFO:tasks.workunit.client.0.smithi016.stderr: -115> 2024-09-12T17:18:36.443+0000 7fc00dbc09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:36.888 INFO:tasks.workunit.client.0.smithi016.stderr: -114> 2024-09-12T17:18:36.443+0000 7fc00dbc09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:18:36.888 INFO:tasks.workunit.client.0.smithi016.stderr: -113> 2024-09-12T17:18:36.443+0000 7fc00dbc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.888 INFO:tasks.workunit.client.0.smithi016.stderr: -112> 2024-09-12T17:18:36.443+0000 7fc00dbc09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:36.888 INFO:tasks.workunit.client.0.smithi016.stderr: -111> 2024-09-12T17:18:36.443+0000 7fc00dbc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.888 INFO:tasks.workunit.client.0.smithi016.stderr: -110> 2024-09-12T17:18:36.443+0000 7fc00aec5640 10 monclient: get_auth_request con 0x5641af09e920 auth_method 0 2024-09-12T17:18:36.888 INFO:tasks.workunit.client.0.smithi016.stderr: -109> 2024-09-12T17:18:36.447+0000 7fc00dbc09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:18:36.888 INFO:tasks.workunit.client.0.smithi016.stderr: -108> 2024-09-12T17:18:36.447+0000 7fc00dbc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.888 INFO:tasks.workunit.client.0.smithi016.stderr: -107> 2024-09-12T17:18:36.447+0000 7fc00bec7640 10 monclient: get_auth_request con 0x5641af0a2180 auth_method 0 2024-09-12T17:18:36.888 INFO:tasks.workunit.client.0.smithi016.stderr: -106> 2024-09-12T17:18:36.447+0000 7fc00dbc09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:18:36.888 INFO:tasks.workunit.client.0.smithi016.stderr: -105> 2024-09-12T17:18:36.447+0000 7fc00dbc09c0 20 searching for the correct realm 2024-09-12T17:18:36.889 INFO:tasks.workunit.client.0.smithi016.stderr: -104> 2024-09-12T17:18:36.447+0000 7fc00b6c6640 10 monclient: get_auth_request con 0x5641af0a6f00 auth_method 0 2024-09-12T17:18:36.889 INFO:tasks.workunit.client.0.smithi016.stderr: -103> 2024-09-12T17:18:36.451+0000 7fc00aec5640 0 -- 172.21.15.16:0/968992593 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7fbffc06b040 msgr2=0x7fbffc065860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:18:36.889 INFO:tasks.workunit.client.0.smithi016.stderr: -102> 2024-09-12T17:18:36.655+0000 7fc00aec5640 10 monclient: get_auth_request con 0x7fbffc06b040 auth_method 0 2024-09-12T17:18:36.889 INFO:tasks.workunit.client.0.smithi016.stderr: -101> 2024-09-12T17:18:36.655+0000 7fc00bec7640 10 monclient: get_auth_request con 0x7fc0000dc290 auth_method 0 2024-09-12T17:18:36.889 INFO:tasks.workunit.client.0.smithi016.stderr: -100> 2024-09-12T17:18:36.663+0000 7fc00b6c6640 10 monclient: get_auth_request con 0x7fc004018040 auth_method 0 2024-09-12T17:18:36.889 INFO:tasks.workunit.client.0.smithi016.stderr: -99> 2024-09-12T17:18:36.663+0000 7fc00bec7640 0 -- 172.21.15.16:0/968992593 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fc0000dc290 msgr2=0x7fc000122a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:18:36.889 INFO:tasks.workunit.client.0.smithi016.stderr: -98> 2024-09-12T17:18:36.663+0000 7fbeed7fa640 1 client.6539.objecter ms_handle_reset 0x7fc0000dc290 session 0x7fc0000d7040 osd.2 2024-09-12T17:18:36.889 INFO:tasks.workunit.client.0.smithi016.stderr: -97> 2024-09-12T17:18:36.663+0000 7fbeed7fa640 10 monclient: _renew_subs 2024-09-12T17:18:36.889 INFO:tasks.workunit.client.0.smithi016.stderr: -96> 2024-09-12T17:18:36.663+0000 7fbeed7fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:18:36.889 INFO:tasks.workunit.client.0.smithi016.stderr: -95> 2024-09-12T17:18:36.667+0000 7fc00bec7640 10 monclient: get_auth_request con 0x7fbed4080900 auth_method 0 2024-09-12T17:18:36.889 INFO:tasks.workunit.client.0.smithi016.stderr: -94> 2024-09-12T17:18:36.667+0000 7fc00aec5640 10 monclient: get_auth_request con 0x7fbff4003be0 auth_method 0 2024-09-12T17:18:36.889 INFO:tasks.workunit.client.0.smithi016.stderr: -93> 2024-09-12T17:18:36.683+0000 7fc00dbc09c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:18:36.889 INFO:tasks.workunit.client.0.smithi016.stderr: -92> 2024-09-12T17:18:36.683+0000 7fc00dbc09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:18:36.890 INFO:tasks.workunit.client.0.smithi016.stderr: -91> 2024-09-12T17:18:36.683+0000 7fc00dbc09c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:18:36.890 INFO:tasks.workunit.client.0.smithi016.stderr: -90> 2024-09-12T17:18:36.683+0000 7fc00dbc09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:18:36.890 INFO:tasks.workunit.client.0.smithi016.stderr: -89> 2024-09-12T17:18:36.683+0000 7fc00dbc09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:18:36.890 INFO:tasks.workunit.client.0.smithi016.stderr: -88> 2024-09-12T17:18:36.683+0000 7fc00dbc09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:18:36.890 INFO:tasks.workunit.client.0.smithi016.stderr: -87> 2024-09-12T17:18:36.683+0000 7fc00dbc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.890 INFO:tasks.workunit.client.0.smithi016.stderr: -86> 2024-09-12T17:18:36.683+0000 7fc00dbc09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:36.890 INFO:tasks.workunit.client.0.smithi016.stderr: -85> 2024-09-12T17:18:36.683+0000 7fc00dbc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.890 INFO:tasks.workunit.client.0.smithi016.stderr: -84> 2024-09-12T17:18:36.683+0000 7fc00dbc09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:18:36.890 INFO:tasks.workunit.client.0.smithi016.stderr: -83> 2024-09-12T17:18:36.683+0000 7fc00dbc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.890 INFO:tasks.workunit.client.0.smithi016.stderr: -82> 2024-09-12T17:18:36.687+0000 7fc00dbc09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:18:36.890 INFO:tasks.workunit.client.0.smithi016.stderr: -81> 2024-09-12T17:18:36.687+0000 7fc00dbc09c0 20 zone default found 2024-09-12T17:18:36.890 INFO:tasks.workunit.client.0.smithi016.stderr: -80> 2024-09-12T17:18:36.687+0000 7fc00dbc09c0 4 Realm: () 2024-09-12T17:18:36.890 INFO:tasks.workunit.client.0.smithi016.stderr: -79> 2024-09-12T17:18:36.687+0000 7fc00dbc09c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:18:36.890 INFO:tasks.workunit.client.0.smithi016.stderr: -78> 2024-09-12T17:18:36.687+0000 7fc00dbc09c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:18:36.891 INFO:tasks.workunit.client.0.smithi016.stderr: -77> 2024-09-12T17:18:36.687+0000 7fc00dbc09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:18:36.891 INFO:tasks.workunit.client.0.smithi016.stderr: -76> 2024-09-12T17:18:36.687+0000 7fc00dbc09c0 20 zonegroup default 2024-09-12T17:18:36.891 INFO:tasks.workunit.client.0.smithi016.stderr: -75> 2024-09-12T17:18:36.687+0000 7fc00dbc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.891 INFO:tasks.workunit.client.0.smithi016.stderr: -74> 2024-09-12T17:18:36.687+0000 7fc00dbc09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:36.891 INFO:tasks.workunit.client.0.smithi016.stderr: -73> 2024-09-12T17:18:36.687+0000 7fc00dbc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.891 INFO:tasks.workunit.client.0.smithi016.stderr: -72> 2024-09-12T17:18:36.687+0000 7fc00dbc09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:36.891 INFO:tasks.workunit.client.0.smithi016.stderr: -71> 2024-09-12T17:18:36.687+0000 7fc00dbc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.891 INFO:tasks.workunit.client.0.smithi016.stderr: -70> 2024-09-12T17:18:36.687+0000 7fc00dbc09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:36.891 INFO:tasks.workunit.client.0.smithi016.stderr: -69> 2024-09-12T17:18:36.687+0000 7fc00dbc09c0 20 started sync module instance, tier type = 2024-09-12T17:18:36.891 INFO:tasks.workunit.client.0.smithi016.stderr: -68> 2024-09-12T17:18:36.687+0000 7fc00dbc09c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:18:36.891 INFO:tasks.workunit.client.0.smithi016.stderr: -67> 2024-09-12T17:18:36.711+0000 7fc00dbc09c0 20 add_watcher() i=0 2024-09-12T17:18:36.891 INFO:tasks.workunit.client.0.smithi016.stderr: -66> 2024-09-12T17:18:36.711+0000 7fc00dbc09c0 20 add_watcher() i=1 2024-09-12T17:18:36.891 INFO:tasks.workunit.client.0.smithi016.stderr: -65> 2024-09-12T17:18:36.711+0000 7fc00dbc09c0 20 add_watcher() i=2 2024-09-12T17:18:36.891 INFO:tasks.workunit.client.0.smithi016.stderr: -64> 2024-09-12T17:18:36.711+0000 7fc00dbc09c0 20 add_watcher() i=3 2024-09-12T17:18:36.892 INFO:tasks.workunit.client.0.smithi016.stderr: -63> 2024-09-12T17:18:36.711+0000 7fc00dbc09c0 20 add_watcher() i=4 2024-09-12T17:18:36.892 INFO:tasks.workunit.client.0.smithi016.stderr: -62> 2024-09-12T17:18:36.711+0000 7fc00dbc09c0 20 add_watcher() i=5 2024-09-12T17:18:36.892 INFO:tasks.workunit.client.0.smithi016.stderr: -61> 2024-09-12T17:18:36.711+0000 7fc00dbc09c0 20 add_watcher() i=6 2024-09-12T17:18:36.892 INFO:tasks.workunit.client.0.smithi016.stderr: -60> 2024-09-12T17:18:36.715+0000 7fc00dbc09c0 20 add_watcher() i=7 2024-09-12T17:18:36.892 INFO:tasks.workunit.client.0.smithi016.stderr: -59> 2024-09-12T17:18:36.715+0000 7fc00dbc09c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:18:36.892 INFO:tasks.workunit.client.0.smithi016.stderr: -58> 2024-09-12T17:18:36.719+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6276310) adding auth protocol: cephx 2024-09-12T17:18:36.892 INFO:tasks.workunit.client.0.smithi016.stderr: -57> 2024-09-12T17:18:36.719+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6276310) adding auth protocol: cephx 2024-09-12T17:18:36.892 INFO:tasks.workunit.client.0.smithi016.stderr: -56> 2024-09-12T17:18:36.719+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6276310) adding auth protocol: cephx 2024-09-12T17:18:36.892 INFO:tasks.workunit.client.0.smithi016.stderr: -55> 2024-09-12T17:18:36.719+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6276310) adding con mode: secure 2024-09-12T17:18:36.892 INFO:tasks.workunit.client.0.smithi016.stderr: -54> 2024-09-12T17:18:36.719+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6276310) adding con mode: crc 2024-09-12T17:18:36.892 INFO:tasks.workunit.client.0.smithi016.stderr: -53> 2024-09-12T17:18:36.719+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6276310) adding con mode: secure 2024-09-12T17:18:36.892 INFO:tasks.workunit.client.0.smithi016.stderr: -52> 2024-09-12T17:18:36.719+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6276310) adding con mode: crc 2024-09-12T17:18:36.892 INFO:tasks.workunit.client.0.smithi016.stderr: -51> 2024-09-12T17:18:36.719+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6276310) adding con mode: secure 2024-09-12T17:18:36.893 INFO:tasks.workunit.client.0.smithi016.stderr: -50> 2024-09-12T17:18:36.719+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6276310) adding con mode: crc 2024-09-12T17:18:36.893 INFO:tasks.workunit.client.0.smithi016.stderr: -49> 2024-09-12T17:18:36.719+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6276310) adding con mode: crc 2024-09-12T17:18:36.893 INFO:tasks.workunit.client.0.smithi016.stderr: -48> 2024-09-12T17:18:36.719+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6276310) adding con mode: secure 2024-09-12T17:18:36.893 INFO:tasks.workunit.client.0.smithi016.stderr: -47> 2024-09-12T17:18:36.719+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6276310) adding con mode: crc 2024-09-12T17:18:36.893 INFO:tasks.workunit.client.0.smithi016.stderr: -46> 2024-09-12T17:18:36.719+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6276310) adding con mode: secure 2024-09-12T17:18:36.893 INFO:tasks.workunit.client.0.smithi016.stderr: -45> 2024-09-12T17:18:36.719+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6276310) adding con mode: crc 2024-09-12T17:18:36.893 INFO:tasks.workunit.client.0.smithi016.stderr: -44> 2024-09-12T17:18:36.719+0000 7fc00dbc09c0 5 AuthRegistry(0x7ffdd6276310) adding con mode: secure 2024-09-12T17:18:36.893 INFO:tasks.workunit.client.0.smithi016.stderr: -43> 2024-09-12T17:18:36.719+0000 7fbec1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:18:36.893 INFO:tasks.workunit.client.0.smithi016.stderr: -42> 2024-09-12T17:18:36.719+0000 7fc00dbc09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:18:36.893 INFO:tasks.workunit.client.0.smithi016.stderr: -41> 2024-09-12T17:18:36.719+0000 7fc00dbc09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:18:36.893 INFO:tasks.workunit.client.0.smithi016.stderr: -40> 2024-09-12T17:18:36.719+0000 7fc00dbc09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:18:36.893 INFO:tasks.workunit.client.0.smithi016.stderr: -39> 2024-09-12T17:18:36.719+0000 7fc00dbc09c0 5 asok(0x5641aeda22b0) register_command cache list hook 0x5641af079d10 2024-09-12T17:18:36.893 INFO:tasks.workunit.client.0.smithi016.stderr: -38> 2024-09-12T17:18:36.719+0000 7fc00dbc09c0 5 asok(0x5641aeda22b0) register_command cache inspect hook 0x5641af079d10 2024-09-12T17:18:36.894 INFO:tasks.workunit.client.0.smithi016.stderr: -37> 2024-09-12T17:18:36.719+0000 7fc00dbc09c0 5 asok(0x5641aeda22b0) register_command cache erase hook 0x5641af079d10 2024-09-12T17:18:36.894 INFO:tasks.workunit.client.0.smithi016.stderr: -36> 2024-09-12T17:18:36.719+0000 7fc00dbc09c0 5 asok(0x5641aeda22b0) register_command cache zap hook 0x5641af079d10 2024-09-12T17:18:36.894 INFO:tasks.workunit.client.0.smithi016.stderr: -35> 2024-09-12T17:18:36.719+0000 7fc00dbc09c0 5 note: GC not initialized 2024-09-12T17:18:36.894 INFO:tasks.workunit.client.0.smithi016.stderr: -34> 2024-09-12T17:18:36.723+0000 7fbec0fe1640 20 reqs_thread_entry: start 2024-09-12T17:18:36.894 INFO:tasks.workunit.client.0.smithi016.stderr: -33> 2024-09-12T17:18:36.723+0000 7fc00dbc09c0 5 asok(0x5641aeda22b0) register_command sync trace show hook 0x7fbffc004ad0 2024-09-12T17:18:36.894 INFO:tasks.workunit.client.0.smithi016.stderr: -32> 2024-09-12T17:18:36.723+0000 7fc00dbc09c0 5 asok(0x5641aeda22b0) register_command sync trace history hook 0x7fbffc004ad0 2024-09-12T17:18:36.894 INFO:tasks.workunit.client.0.smithi016.stderr: -31> 2024-09-12T17:18:36.723+0000 7fc00dbc09c0 5 asok(0x5641aeda22b0) register_command sync trace active hook 0x7fbffc004ad0 2024-09-12T17:18:36.894 INFO:tasks.workunit.client.0.smithi016.stderr: -30> 2024-09-12T17:18:36.723+0000 7fc00dbc09c0 5 asok(0x5641aeda22b0) register_command sync trace active_short hook 0x7fbffc004ad0 2024-09-12T17:18:36.894 INFO:tasks.workunit.client.0.smithi016.stderr: -29> 2024-09-12T17:18:36.723+0000 7fc00dbc09c0 20 init_complete bucket index max shards: 1 2024-09-12T17:18:36.894 INFO:tasks.workunit.client.0.smithi016.stderr: -28> 2024-09-12T17:18:36.723+0000 7fc00dbc09c0 20 Filter name: none 2024-09-12T17:18:36.894 INFO:tasks.workunit.client.0.smithi016.stderr: -27> 2024-09-12T17:18:36.723+0000 7fbe3a7fc640 20 reqs_thread_entry: start 2024-09-12T17:18:36.894 INFO:tasks.workunit.client.0.smithi016.stderr: -26> 2024-09-12T17:18:36.723+0000 7fc00dbc09c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T17:18:36.894 INFO:tasks.workunit.client.0.smithi016.stderr: -25> 2024-09-12T17:18:36.723+0000 7fc00dbc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.894 INFO:tasks.workunit.client.0.smithi016.stderr: -24> 2024-09-12T17:18:36.723+0000 7fc00dbc09c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:18:36.895 INFO:tasks.workunit.client.0.smithi016.stderr: -23> 2024-09-12T17:18:36.723+0000 7fc00dbc09c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:18:36.895 INFO:tasks.workunit.client.0.smithi016.stderr: -22> 2024-09-12T17:18:36.723+0000 7fc00dbc09c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:18:36.895 INFO:tasks.workunit.client.0.smithi016.stderr: -21> 2024-09-12T17:18:36.723+0000 7fc00dbc09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 : miss 2024-09-12T17:18:36.895 INFO:tasks.workunit.client.0.smithi016.stderr: -20> 2024-09-12T17:18:36.723+0000 7fc00dbc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.895 INFO:tasks.workunit.client.0.smithi016.stderr: -19> 2024-09-12T17:18:36.723+0000 7fc00dbc09c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:18:36.895 INFO:tasks.workunit.client.0.smithi016.stderr: -18> 2024-09-12T17:18:36.723+0000 7fc00dbc09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 info.flags=0x17 2024-09-12T17:18:36.895 INFO:tasks.workunit.client.0.smithi016.stderr: -17> 2024-09-12T17:18:36.723+0000 7fc00dbc09c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 to cache LRU end 2024-09-12T17:18:36.895 INFO:tasks.workunit.client.0.smithi016.stderr: -16> 2024-09-12T17:18:36.723+0000 7fc00dbc09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:18:36.895 INFO:tasks.workunit.client.0.smithi016.stderr: -15> 2024-09-12T17:18:36.723+0000 7fc00dbc09c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:18:36.895 INFO:tasks.workunit.client.0.smithi016.stderr: -14> 2024-09-12T17:18:36.723+0000 7fc00dbc09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 2024-09-12T17:18:36.895 INFO:tasks.workunit.client.0.smithi016.stderr: -13> 2024-09-12T17:18:36.735+0000 7fc00dbc09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 info.flags=0x17 2024-09-12T17:18:36.895 INFO:tasks.workunit.client.0.smithi016.stderr: -12> 2024-09-12T17:18:36.735+0000 7fc00dbc09c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 to cache LRU end 2024-09-12T17:18:36.895 INFO:tasks.workunit.client.0.smithi016.stderr: -11> 2024-09-12T17:18:36.735+0000 7fc00dbc09c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:18:36.895 INFO:tasks.workunit.client.0.smithi016.stderr: -10> 2024-09-12T17:18:36.735+0000 7fc00dbc09c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27, ofs0, ns] 2024-09-12T17:18:36.896 INFO:tasks.workunit.client.0.smithi016.stderr: -9> 2024-09-12T17:18:36.735+0000 7fbeeeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431570 cookie 94840109592816 notifier 6539 bl.length()=939 2024-09-12T17:18:36.896 INFO:tasks.workunit.client.0.smithi016.stderr: -8> 2024-09-12T17:18:36.735+0000 7fbeeeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 info.flags=0x17 2024-09-12T17:18:36.896 INFO:tasks.workunit.client.0.smithi016.stderr: -7> 2024-09-12T17:18:36.735+0000 7fbeeeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 to cache LRU end 2024-09-12T17:18:36.896 INFO:tasks.workunit.client.0.smithi016.stderr: -6> 2024-09-12T17:18:36.735+0000 7fbeeeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:18:36.896 INFO:tasks.workunit.client.0.smithi016.stderr: -5> 2024-09-12T17:18:36.735+0000 7fc00dbc09c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27]): orig_sources= new_sources= 2024-09-12T17:18:36.896 INFO:tasks.workunit.client.0.smithi016.stderr: -4> 2024-09-12T17:18:36.735+0000 7fc00dbc09c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27]): potential sources added=[] removed=[] 2024-09-12T17:18:36.896 INFO:tasks.workunit.client.0.smithi016.stderr: -3> 2024-09-12T17:18:36.735+0000 7fc00dbc09c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27]): orig_dests= new_dests= 2024-09-12T17:18:36.896 INFO:tasks.workunit.client.0.smithi016.stderr: -2> 2024-09-12T17:18:36.735+0000 7fc00dbc09c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27]): potential dests added=[] removed=[] 2024-09-12T17:18:36.896 INFO:tasks.workunit.client.0.smithi016.stderr: -1> 2024-09-12T17:18:36.739+0000 7fc00dbc09c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc00dbc09c0 time 2024-09-12T17:18:36.741155+0000 2024-09-12T17:18:36.896 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:18:36.896 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:36.896 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:18:36.896 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc01149a2eb] 2024-09-12T17:18:36.897 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc01149a49f] 2024-09-12T17:18:36.897 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5641ac91e0c1] 2024-09-12T17:18:36.897 INFO:tasks.workunit.client.0.smithi016.stderr: 4: radosgw-admin(+0x141007e) [0x5641ad37407e] 2024-09-12T17:18:36.897 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5641ac93018d] 2024-09-12T17:18:36.897 INFO:tasks.workunit.client.0.smithi016.stderr: 6: main() 2024-09-12T17:18:36.897 INFO:tasks.workunit.client.0.smithi016.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc010300d90] 2024-09-12T17:18:36.897 INFO:tasks.workunit.client.0.smithi016.stderr: 8: __libc_start_main() 2024-09-12T17:18:36.897 INFO:tasks.workunit.client.0.smithi016.stderr: 9: _start() 2024-09-12T17:18:36.897 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:36.897 INFO:tasks.workunit.client.0.smithi016.stderr: 0> 2024-09-12T17:18:36.743+0000 7fc00dbc09c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:18:36.897 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7fc00dbc09c0 thread_name:radosgw-admin 2024-09-12T17:18:36.897 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:36.897 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:18:36.898 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc010319520] 2024-09-12T17:18:36.898 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:18:36.898 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:18:36.898 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:18:36.898 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc01149a345] 2024-09-12T17:18:36.898 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc01149a49f] 2024-09-12T17:18:36.898 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5641ac91e0c1] 2024-09-12T17:18:36.898 INFO:tasks.workunit.client.0.smithi016.stderr: 8: radosgw-admin(+0x141007e) [0x5641ad37407e] 2024-09-12T17:18:36.898 INFO:tasks.workunit.client.0.smithi016.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5641ac93018d] 2024-09-12T17:18:36.898 INFO:tasks.workunit.client.0.smithi016.stderr: 10: main() 2024-09-12T17:18:36.898 INFO:tasks.workunit.client.0.smithi016.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc010300d90] 2024-09-12T17:18:36.898 INFO:tasks.workunit.client.0.smithi016.stderr: 12: __libc_start_main() 2024-09-12T17:18:36.898 INFO:tasks.workunit.client.0.smithi016.stderr: 13: _start() 2024-09-12T17:18:36.899 INFO:tasks.workunit.client.0.smithi016.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:18:36.899 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:36.899 INFO:tasks.workunit.client.0.smithi016.stderr:--- logging levels --- 2024-09-12T17:18:36.899 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 none 2024-09-12T17:18:36.899 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 lockdep 2024-09-12T17:18:36.899 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 context 2024-09-12T17:18:36.899 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 crush 2024-09-12T17:18:36.899 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds 2024-09-12T17:18:36.899 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_balancer 2024-09-12T17:18:36.899 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_locker 2024-09-12T17:18:36.899 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log 2024-09-12T17:18:36.899 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log_expire 2024-09-12T17:18:36.899 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_migrator 2024-09-12T17:18:36.899 INFO:tasks.workunit.client.0.smithi016.stderr: 3/ 5 mds_quiesce 2024-09-12T17:18:36.900 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 buffer 2024-09-12T17:18:36.900 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 timer 2024-09-12T17:18:36.900 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 filer 2024-09-12T17:18:36.900 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 striper 2024-09-12T17:18:36.900 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 objecter 2024-09-12T17:18:36.900 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rados 2024-09-12T17:18:36.900 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd 2024-09-12T17:18:36.900 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_mirror 2024-09-12T17:18:36.900 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_replay 2024-09-12T17:18:36.900 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_pwl 2024-09-12T17:18:36.900 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 journaler 2024-09-12T17:18:36.900 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objectcacher 2024-09-12T17:18:36.900 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:18:36.901 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 client 2024-09-12T17:18:36.901 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 osd 2024-09-12T17:18:36.901 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 optracker 2024-09-12T17:18:36.901 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objclass 2024-09-12T17:18:36.901 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 filestore 2024-09-12T17:18:36.901 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 journal 2024-09-12T17:18:36.901 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 ms 2024-09-12T17:18:36.901 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mon 2024-09-12T17:18:36.901 INFO:tasks.workunit.client.0.smithi016.stderr: 0/10 monc 2024-09-12T17:18:36.901 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 paxos 2024-09-12T17:18:36.901 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 tp 2024-09-12T17:18:36.901 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 auth 2024-09-12T17:18:36.901 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 crypto 2024-09-12T17:18:36.901 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 finisher 2024-09-12T17:18:36.902 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 reserver 2024-09-12T17:18:36.902 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 heartbeatmap 2024-09-12T17:18:36.902 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 perfcounter 2024-09-12T17:18:36.902 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw 2024-09-12T17:18:36.902 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_sync 2024-09-12T17:18:36.902 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_datacache 2024-09-12T17:18:36.902 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_access 2024-09-12T17:18:36.902 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:18:36.902 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_flight 2024-09-12T17:18:36.902 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:18:36.902 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw_notification 2024-09-12T17:18:36.902 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 javaclient 2024-09-12T17:18:36.902 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 asok 2024-09-12T17:18:36.902 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 throttle 2024-09-12T17:18:36.903 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 refs 2024-09-12T17:18:36.903 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 compressor 2024-09-12T17:18:36.903 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluestore 2024-09-12T17:18:36.903 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluefs 2024-09-12T17:18:36.903 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 bdev 2024-09-12T17:18:36.903 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 kstore 2024-09-12T17:18:36.903 INFO:tasks.workunit.client.0.smithi016.stderr: 4/ 5 rocksdb 2024-09-12T17:18:36.903 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 fuse 2024-09-12T17:18:36.903 INFO:tasks.workunit.client.0.smithi016.stderr: 2/ 5 mgr 2024-09-12T17:18:36.903 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mgrc 2024-09-12T17:18:36.903 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 dpdk 2024-09-12T17:18:36.903 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 eventtrace 2024-09-12T17:18:36.903 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 prioritycache 2024-09-12T17:18:36.903 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 test 2024-09-12T17:18:36.904 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:18:36.904 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephsqlite 2024-09-12T17:18:36.904 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:18:36.904 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore 2024-09-12T17:18:36.904 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_onode 2024-09-12T17:18:36.904 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_odata 2024-09-12T17:18:36.904 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_omap 2024-09-12T17:18:36.904 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_tm 2024-09-12T17:18:36.904 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_t 2024-09-12T17:18:36.904 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:18:36.904 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_epm 2024-09-12T17:18:36.904 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_lba 2024-09-12T17:18:36.904 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:18:36.905 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cache 2024-09-12T17:18:36.905 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_journal 2024-09-12T17:18:36.905 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_device 2024-09-12T17:18:36.905 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_backref 2024-09-12T17:18:36.905 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 alienstore 2024-09-12T17:18:36.905 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mclock 2024-09-12T17:18:36.905 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cyanstore 2024-09-12T17:18:36.905 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 ceph_exporter 2024-09-12T17:18:36.905 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 memstore 2024-09-12T17:18:36.905 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 trace 2024-09-12T17:18:36.905 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 ceph_dedup 2024-09-12T17:18:36.905 INFO:tasks.workunit.client.0.smithi016.stderr: -2/-2 (syslog threshold) 2024-09-12T17:18:36.905 INFO:tasks.workunit.client.0.smithi016.stderr: 99/99 (stderr threshold) 2024-09-12T17:18:36.905 INFO:tasks.workunit.client.0.smithi016.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:18:36.905 INFO:tasks.workunit.client.0.smithi016.stderr: 7fbe3a7fc640 / http_manager 2024-09-12T17:18:36.906 INFO:tasks.workunit.client.0.smithi016.stderr: 7fbec0fe1640 / http_manager 2024-09-12T17:18:36.906 INFO:tasks.workunit.client.0.smithi016.stderr: 7fbec1fe3640 / rgw_dt_lg_renew 2024-09-12T17:18:36.906 INFO:tasks.workunit.client.0.smithi016.stderr: 7fbeed7fa640 / ms_dispatch 2024-09-12T17:18:36.906 INFO:tasks.workunit.client.0.smithi016.stderr: 7fbeeeffd640 / io_context_pool 2024-09-12T17:18:36.906 INFO:tasks.workunit.client.0.smithi016.stderr: 7fbef5602640 / ms_dispatch 2024-09-12T17:18:36.906 INFO:tasks.workunit.client.0.smithi016.stderr: 7fbef7e07640 / ms_dispatch 2024-09-12T17:18:36.906 INFO:tasks.workunit.client.0.smithi016.stderr: 7fbef960a640 / io_context_pool 2024-09-12T17:18:36.906 INFO:tasks.workunit.client.0.smithi016.stderr: 7fc00aec5640 / msgr-worker-2 2024-09-12T17:18:36.906 INFO:tasks.workunit.client.0.smithi016.stderr: 7fc00b6c6640 / msgr-worker-1 2024-09-12T17:18:36.906 INFO:tasks.workunit.client.0.smithi016.stderr: 7fc00bec7640 / msgr-worker-0 2024-09-12T17:18:36.906 INFO:tasks.workunit.client.0.smithi016.stderr: 7fc00c6c8640 / io_context_pool 2024-09-12T17:18:36.906 INFO:tasks.workunit.client.0.smithi016.stderr: 7fc00dbc09c0 / radosgw-admin 2024-09-12T17:18:36.906 INFO:tasks.workunit.client.0.smithi016.stderr: max_recent 500 2024-09-12T17:18:36.906 INFO:tasks.workunit.client.0.smithi016.stderr: max_new 1000 2024-09-12T17:18:36.907 INFO:tasks.workunit.client.0.smithi016.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:18:36.748112Z_b626bae3-9a2e-4ed6-b5d5-5b220efcd425/log 2024-09-12T17:18:36.907 INFO:tasks.workunit.client.0.smithi016.stderr:--- end dump of recent events --- 2024-09-12T17:18:36.907 INFO:tasks.workunit.client.0.smithi016.stderr:Aborted 2024-09-12T17:18:36.907 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T17:18:36.908 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:18:36.908 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:18:36.909 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.843+0000 7f11437229c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.909 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.843+0000 7f11437229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:36.909 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.843+0000 7f11437229c0 20 realm 2024-09-12T17:18:36.909 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.843+0000 7f11437229c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.909 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.843+0000 7f11437229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:36.909 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.843+0000 7f11437229c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:18:36.909 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.843+0000 7f11437229c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.909 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.843+0000 7f11437229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:36.909 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.843+0000 7f11437229c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.909 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.847+0000 7f11437229c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:18:36.909 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.847+0000 7f11437229c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:36.909 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.847+0000 7f11437229c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:18:36.909 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.847+0000 7f11437229c0 20 searching for the correct realm 2024-09-12T17:18:36.909 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.851+0000 7f1141a29640 0 -- 172.21.15.16:0/3188894605 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f1138113070 msgr2=0x7f113811f440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:18:36.910 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:36.859+0000 7f1140a27640 0 -- 172.21.15.16:0/3188894605 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f113c008050 msgr2=0x7f113c097770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:18:37.080 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.075+0000 7f11437229c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:18:37.080 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.075+0000 7f11437229c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:18:37.080 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.075+0000 7f11437229c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:18:37.080 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.075+0000 7f11437229c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:18:37.080 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.075+0000 7f11437229c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:18:37.081 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.075+0000 7f11437229c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:18:37.081 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.075+0000 7f11437229c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:37.081 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.079+0000 7f11437229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:37.081 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.079+0000 7f11437229c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:37.081 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.079+0000 7f11437229c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:18:37.082 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.079+0000 7f11437229c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:37.082 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.079+0000 7f11437229c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:18:37.083 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.079+0000 7f11437229c0 20 zone default found 2024-09-12T17:18:37.083 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.079+0000 7f11437229c0 4 Realm: () 2024-09-12T17:18:37.083 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.079+0000 7f11437229c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:18:37.083 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.079+0000 7f11437229c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:18:37.083 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.079+0000 7f11437229c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:18:37.083 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.079+0000 7f11437229c0 20 zonegroup default 2024-09-12T17:18:37.083 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.079+0000 7f11437229c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:37.083 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.079+0000 7f11437229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:37.084 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.079+0000 7f11437229c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:37.084 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.083+0000 7f11437229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:37.084 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.083+0000 7f11437229c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:37.085 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.083+0000 7f11437229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:37.085 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.083+0000 7f11437229c0 20 started sync module instance, tier type = 2024-09-12T17:18:37.085 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.083+0000 7f11437229c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:18:37.110 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.107+0000 7f11437229c0 20 add_watcher() i=0 2024-09-12T17:18:37.110 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.107+0000 7f11437229c0 20 add_watcher() i=1 2024-09-12T17:18:37.110 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.107+0000 7f11437229c0 20 add_watcher() i=2 2024-09-12T17:18:37.110 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.107+0000 7f11437229c0 20 add_watcher() i=3 2024-09-12T17:18:37.110 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.107+0000 7f11437229c0 20 add_watcher() i=4 2024-09-12T17:18:37.110 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.107+0000 7f11437229c0 20 add_watcher() i=5 2024-09-12T17:18:37.111 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.107+0000 7f11437229c0 20 add_watcher() i=6 2024-09-12T17:18:37.112 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.111+0000 7f11437229c0 20 add_watcher() i=7 2024-09-12T17:18:37.113 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.111+0000 7f11437229c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:18:37.117 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.115+0000 7f0ff77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:18:37.118 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.115+0000 7f11437229c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:18:37.118 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.115+0000 7f11437229c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:18:37.118 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.115+0000 7f11437229c0 5 note: GC not initialized 2024-09-12T17:18:37.120 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.115+0000 7f0ff67e4640 20 reqs_thread_entry: start 2024-09-12T17:18:37.120 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.115+0000 7f11437229c0 20 init_complete bucket index max shards: 1 2024-09-12T17:18:37.120 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.115+0000 7f11437229c0 20 Filter name: none 2024-09-12T17:18:37.120 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.115+0000 7f0f67fff640 20 reqs_thread_entry: start 2024-09-12T17:18:37.120 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.115+0000 7f11437229c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:37.121 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.119+0000 7f11437229c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:18:37.122 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.119+0000 7f11437229c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:37.122 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.119+0000 7f11437229c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T17:18:37.122 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.119+0000 7f11437229c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:18:37.122 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.119+0000 7f11437229c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:37.123 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.119+0000 7f11437229c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:18:37.123 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.119+0000 7f11437229c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:37.123 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.119+0000 7f11437229c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T17:18:37.124 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.119+0000 7f11437229c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:18:37.125 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.123+0000 7f0ff77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:18:37.131 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.127+0000 7f11437229c0 20 remove_watcher() i=0 2024-09-12T17:18:37.131 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.127+0000 7f11437229c0 2 removed watcher, disabling cache 2024-09-12T17:18:37.133 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.131+0000 7f11437229c0 20 remove_watcher() i=1 2024-09-12T17:18:37.136 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.135+0000 7f11437229c0 20 remove_watcher() i=2 2024-09-12T17:18:37.138 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.135+0000 7f11437229c0 20 remove_watcher() i=3 2024-09-12T17:18:37.141 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.139+0000 7f11437229c0 20 remove_watcher() i=4 2024-09-12T17:18:37.144 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.143+0000 7f11437229c0 20 remove_watcher() i=5 2024-09-12T17:18:37.148 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.147+0000 7f11437229c0 20 remove_watcher() i=6 2024-09-12T17:18:37.150 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.147+0000 7f11437229c0 20 remove_watcher() i=7 2024-09-12T17:18:37.168 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:37.168 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:18:37.168 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: abort-at-trim-reshard-log-entries id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:18:37.168 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:18:37.230 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:18:37.265 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:18:37.265 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:18:37.314 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.311+0000 7f56c76fc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:37.315 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.311+0000 7f56c76fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:37.316 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.311+0000 7f56c76fc9c0 20 realm 2024-09-12T17:18:37.316 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.311+0000 7f56c76fc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:37.316 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.311+0000 7f56c76fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:37.316 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.311+0000 7f56c76fc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:18:37.316 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.311+0000 7f56c76fc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:37.316 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.311+0000 7f56c76fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:37.316 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.311+0000 7f56c76fc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:37.317 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.315+0000 7f56c76fc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:18:37.317 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.315+0000 7f56c76fc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:37.319 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.315+0000 7f56c76fc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:18:37.320 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.315+0000 7f56c76fc9c0 20 searching for the correct realm 2024-09-12T17:18:37.323 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.319+0000 7f56c5a03640 0 -- 172.21.15.16:0/1059999589 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f56bc01f040 msgr2=0x7f56bc0463f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:18:37.332 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.327+0000 7f56c4a01640 0 -- 172.21.15.16:0/1059999589 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f56c0058050 msgr2=0x7f56c006fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:18:37.547 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.543+0000 7f56c76fc9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:18:37.547 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.543+0000 7f56c76fc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:18:37.547 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.543+0000 7f56c76fc9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:18:37.547 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.543+0000 7f56c76fc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:18:37.547 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.543+0000 7f56c76fc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:18:37.547 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.543+0000 7f56c76fc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:18:37.547 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.543+0000 7f56c76fc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:37.548 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.543+0000 7f56c76fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:37.548 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.543+0000 7f56c76fc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:37.548 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.547+0000 7f56c76fc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:18:37.548 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.547+0000 7f56c76fc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:37.550 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.547+0000 7f56c76fc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:18:37.550 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.547+0000 7f56c76fc9c0 20 zone default found 2024-09-12T17:18:37.550 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.547+0000 7f56c76fc9c0 4 Realm: () 2024-09-12T17:18:37.550 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.547+0000 7f56c76fc9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:18:37.550 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.547+0000 7f56c76fc9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:18:37.550 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.547+0000 7f56c76fc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:18:37.550 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.547+0000 7f56c76fc9c0 20 zonegroup default 2024-09-12T17:18:37.550 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.547+0000 7f56c76fc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:37.551 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.547+0000 7f56c76fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:37.551 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.547+0000 7f56c76fc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:37.551 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.547+0000 7f56c76fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:37.551 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.547+0000 7f56c76fc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:37.552 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.547+0000 7f56c76fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:18:37.552 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.547+0000 7f56c76fc9c0 20 started sync module instance, tier type = 2024-09-12T17:18:37.552 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.547+0000 7f56c76fc9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:18:37.579 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.575+0000 7f56c76fc9c0 20 add_watcher() i=0 2024-09-12T17:18:37.579 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.575+0000 7f56c76fc9c0 20 add_watcher() i=1 2024-09-12T17:18:37.579 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.575+0000 7f56c76fc9c0 20 add_watcher() i=2 2024-09-12T17:18:37.579 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.575+0000 7f56c76fc9c0 20 add_watcher() i=3 2024-09-12T17:18:37.579 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.575+0000 7f56c76fc9c0 20 add_watcher() i=4 2024-09-12T17:18:37.579 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.575+0000 7f56c76fc9c0 20 add_watcher() i=5 2024-09-12T17:18:37.579 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.575+0000 7f56c76fc9c0 20 add_watcher() i=6 2024-09-12T17:18:37.582 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.579+0000 7f56c76fc9c0 20 add_watcher() i=7 2024-09-12T17:18:37.582 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.579+0000 7f56c76fc9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:18:37.586 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.583+0000 7f557bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:18:37.587 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.583+0000 7f56c76fc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:18:37.587 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.583+0000 7f56c76fc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:18:37.587 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.583+0000 7f56c76fc9c0 5 note: GC not initialized 2024-09-12T17:18:37.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.583+0000 7f557afe5640 20 reqs_thread_entry: start 2024-09-12T17:18:37.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.583+0000 7f56c76fc9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:18:37.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.583+0000 7f56c76fc9c0 20 Filter name: none 2024-09-12T17:18:37.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.587+0000 7f5578fe1640 20 reqs_thread_entry: start 2024-09-12T17:18:37.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.587+0000 7f56c76fc9c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T17:18:37.589 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.587+0000 7f56c76fc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:37.590 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.587+0000 7f56c76fc9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:18:37.590 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.587+0000 7f56c76fc9c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:18:37.590 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.587+0000 7f56c76fc9c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:18:37.590 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.587+0000 7f56c76fc9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 : miss 2024-09-12T17:18:37.590 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.587+0000 7f56c76fc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:18:37.590 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.587+0000 7f56c76fc9c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T17:18:37.591 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.587+0000 7f56c76fc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 info.flags=0x17 2024-09-12T17:18:37.591 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.587+0000 7f56c76fc9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 to cache LRU end 2024-09-12T17:18:37.591 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.587+0000 7f56c76fc9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:18:37.591 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.587+0000 7f56c76fc9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:18:37.591 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.587+0000 7f56c76fc9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 2024-09-12T17:18:37.593 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.591+0000 7f56c76fc9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 to be held by another RGW process; skipping for now 2024-09-12T17:18:37.595 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.591+0000 7f557bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:18:37.600 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.599+0000 7f56c76fc9c0 20 remove_watcher() i=0 2024-09-12T17:18:37.600 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.599+0000 7f56c76fc9c0 2 removed watcher, disabling cache 2024-09-12T17:18:37.604 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.603+0000 7f56c76fc9c0 20 remove_watcher() i=1 2024-09-12T17:18:37.607 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.603+0000 7f56c76fc9c0 20 remove_watcher() i=2 2024-09-12T17:18:37.609 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.607+0000 7f56c76fc9c0 20 remove_watcher() i=3 2024-09-12T17:18:37.612 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.607+0000 7f56c76fc9c0 20 remove_watcher() i=4 2024-09-12T17:18:37.613 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.611+0000 7f56c76fc9c0 20 remove_watcher() i=5 2024-09-12T17:18:37.615 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.611+0000 7f56c76fc9c0 20 remove_watcher() i=6 2024-09-12T17:18:37.616 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:18:37.615+0000 7f56c76fc9c0 20 remove_watcher() i=7 2024-09-12T17:18:37.632 INFO:tasks.workunit.client.0.smithi016.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:19:07.659 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:19:07.696 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:19:07.696 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:19:07.744 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.739+0000 7fdf059db9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:07.745 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.743+0000 7fdf059db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:07.745 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.743+0000 7fdf059db9c0 20 realm 2024-09-12T17:19:07.745 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.743+0000 7fdf059db9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:07.746 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.743+0000 7fdf059db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:07.746 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.743+0000 7fdf059db9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:19:07.746 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.743+0000 7fdf059db9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:07.746 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.743+0000 7fdf059db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:07.746 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.743+0000 7fdf059db9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:07.747 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.743+0000 7fdf059db9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:07.747 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.743+0000 7fdf059db9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:07.749 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.747+0000 7fdf059db9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:19:07.749 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.747+0000 7fdf059db9c0 20 searching for the correct realm 2024-09-12T17:19:07.754 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.751+0000 7fdf02ce0640 0 -- 172.21.15.16:0/2018717804 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7fdef4027040 msgr2=0x7fdef4064600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:19:07.760 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.759+0000 7fdf02ce0640 0 -- 172.21.15.16:0/2018717804 >> [v2:172.21.15.19:6824/2441769319,v1:172.21.15.19:6825/2441769319] conn(0x7fdef4027040 msgr2=0x7fddcc085750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:19:07.771 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.767+0000 7fdf059db9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:19:07.771 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.767+0000 7fdf059db9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:19:07.771 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.767+0000 7fdf059db9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:19:07.771 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.767+0000 7fdf059db9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:19:07.771 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.767+0000 7fdf059db9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:19:07.771 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.767+0000 7fdf059db9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:19:07.771 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.767+0000 7fdf059db9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:07.771 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.767+0000 7fdf059db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:07.771 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.767+0000 7fdf059db9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:07.772 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.767+0000 7fdf059db9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:07.772 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.767+0000 7fdf059db9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:07.772 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.771+0000 7fdf059db9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:19:07.772 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.771+0000 7fdf059db9c0 20 zone default found 2024-09-12T17:19:07.772 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.771+0000 7fdf059db9c0 4 Realm: () 2024-09-12T17:19:07.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.771+0000 7fdf059db9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:19:07.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.771+0000 7fdf059db9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:19:07.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.771+0000 7fdf059db9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:19:07.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.771+0000 7fdf059db9c0 20 zonegroup default 2024-09-12T17:19:07.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.771+0000 7fdf059db9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:07.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.771+0000 7fdf059db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:07.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.771+0000 7fdf059db9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:07.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.771+0000 7fdf059db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:07.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.771+0000 7fdf059db9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:07.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.771+0000 7fdf059db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:07.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.771+0000 7fdf059db9c0 20 started sync module instance, tier type = 2024-09-12T17:19:07.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.771+0000 7fdf059db9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:19:07.797 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.795+0000 7fdf059db9c0 20 add_watcher() i=0 2024-09-12T17:19:07.797 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.795+0000 7fdf059db9c0 20 add_watcher() i=1 2024-09-12T17:19:07.798 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.795+0000 7fdf059db9c0 20 add_watcher() i=2 2024-09-12T17:19:07.798 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.795+0000 7fdf059db9c0 20 add_watcher() i=3 2024-09-12T17:19:07.798 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.795+0000 7fdf059db9c0 20 add_watcher() i=4 2024-09-12T17:19:07.798 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.795+0000 7fdf059db9c0 20 add_watcher() i=5 2024-09-12T17:19:07.798 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.795+0000 7fdf059db9c0 20 add_watcher() i=6 2024-09-12T17:19:07.798 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.795+0000 7fdf059db9c0 20 add_watcher() i=7 2024-09-12T17:19:07.798 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.795+0000 7fdf059db9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:19:07.802 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.799+0000 7fddb9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:07.802 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.799+0000 7fdf059db9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:19:07.802 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.799+0000 7fdf059db9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:19:07.802 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.799+0000 7fdf059db9c0 5 note: GC not initialized 2024-09-12T17:19:07.803 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.799+0000 7fddb8fe1640 20 reqs_thread_entry: start 2024-09-12T17:19:07.803 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.799+0000 7fdf059db9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:19:07.803 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.799+0000 7fdf059db9c0 20 Filter name: none 2024-09-12T17:19:07.803 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.799+0000 7fdd327fc640 20 reqs_thread_entry: start 2024-09-12T17:19:07.803 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.799+0000 7fdf059db9c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T17:19:07.803 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.799+0000 7fdf059db9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:07.804 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.799+0000 7fdf059db9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:19:07.804 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.799+0000 7fdf059db9c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:19:07.804 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.799+0000 7fdf059db9c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:19:07.804 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.799+0000 7fdf059db9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 : miss 2024-09-12T17:19:07.805 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.799+0000 7fdf059db9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:07.805 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.803+0000 7fdf059db9c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T17:19:07.805 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.803+0000 7fdf059db9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 info.flags=0x17 2024-09-12T17:19:07.805 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.803+0000 7fdf059db9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 to cache LRU end 2024-09-12T17:19:07.805 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.803+0000 7fdf059db9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:19:07.805 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.803+0000 7fdf059db9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:07.805 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.803+0000 7fdf059db9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 2024-09-12T17:19:07.807 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.803+0000 7fdf059db9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:19:07.814 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.811+0000 7fdf059db9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 info.flags=0x17 2024-09-12T17:19:07.814 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.811+0000 7fdf059db9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 to cache LRU end 2024-09-12T17:19:07.814 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.811+0000 7fdf059db9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:07.814 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.811+0000 7fdf059db9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27, ofs0, ns] 2024-09-12T17:19:07.815 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.811+0000 7fdde6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431571 cookie 93845567332544 notifier 6590 bl.length()=939 2024-09-12T17:19:07.815 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.811+0000 7fdde6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 info.flags=0x17 2024-09-12T17:19:07.815 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.811+0000 7fdde6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 to cache LRU end 2024-09-12T17:19:07.815 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.811+0000 7fdde6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:07.815 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.811+0000 7fdf059db9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27]): orig_sources= new_sources= 2024-09-12T17:19:07.815 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.811+0000 7fdf059db9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27]): potential sources added=[] removed=[] 2024-09-12T17:19:07.815 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.811+0000 7fdf059db9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27]): orig_dests= new_dests= 2024-09-12T17:19:07.815 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.811+0000 7fdf059db9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27]): potential dests added=[] removed=[] 2024-09-12T17:19:07.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.819+0000 7fdf059db9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27.2.0 2024-09-12T17:19:07.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.819+0000 7fdf059db9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27.2.0 2024-09-12T17:19:07.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.819+0000 7fdf059db9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27.2.1 2024-09-12T17:19:07.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.819+0000 7fdf059db9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27.2.1 2024-09-12T17:19:07.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.819+0000 7fdf059db9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27.0 2024-09-12T17:19:07.826 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.823+0000 7fdf059db9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 : hit (requested=0x17, cached=0x17) 2024-09-12T17:19:07.826 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.823+0000 7fdf059db9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 2024-09-12T17:19:07.829 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.827+0000 7fdf059db9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 info.flags=0x17 2024-09-12T17:19:07.829 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.827+0000 7fdf059db9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 to cache LRU end 2024-09-12T17:19:07.829 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.827+0000 7fdf059db9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:07.829 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.827+0000 7fdf059db9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27, ofs0, ns] 2024-09-12T17:19:07.829 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.827+0000 7fdde6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431572 cookie 93845567332544 notifier 6590 bl.length()=939 2024-09-12T17:19:07.829 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.827+0000 7fdde6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 info.flags=0x17 2024-09-12T17:19:07.830 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.827+0000 7fdde6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 to cache LRU end 2024-09-12T17:19:07.830 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.827+0000 7fdde6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:07.830 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.827+0000 7fdf059db9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27]): orig_sources= new_sources= 2024-09-12T17:19:07.830 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.827+0000 7fdf059db9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27]): potential sources added=[] removed=[] 2024-09-12T17:19:07.830 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.827+0000 7fdf059db9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27]): orig_dests= new_dests= 2024-09-12T17:19:07.830 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.827+0000 7fdf059db9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27]): potential dests added=[] removed=[] 2024-09-12T17:19:07.833 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.831+0000 7fdf059db9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27.0 2024-09-12T17:19:07.834 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.831+0000 7fdf059db9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 : hit (requested=0x17, cached=0x17) 2024-09-12T17:19:07.834 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.831+0000 7fdf059db9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 2024-09-12T17:19:07.836 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.835+0000 7fdf059db9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 info.flags=0x17 2024-09-12T17:19:07.837 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.835+0000 7fdf059db9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 to cache LRU end 2024-09-12T17:19:07.837 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.835+0000 7fdf059db9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:07.837 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.835+0000 7fdf059db9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27, ofs0, ns] 2024-09-12T17:19:07.837 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.835+0000 7fdde6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431573 cookie 93845567332544 notifier 6590 bl.length()=907 2024-09-12T17:19:07.837 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.835+0000 7fdde6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 info.flags=0x17 2024-09-12T17:19:07.837 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.835+0000 7fdde6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 to cache LRU end 2024-09-12T17:19:07.837 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.835+0000 7fdde6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:07.838 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.835+0000 7fdf059db9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27]): orig_sources= new_sources= 2024-09-12T17:19:07.838 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.835+0000 7fdf059db9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27]): potential sources added=[] removed=[] 2024-09-12T17:19:07.838 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.835+0000 7fdf059db9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27]): orig_dests= new_dests= 2024-09-12T17:19:07.838 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.835+0000 7fdf059db9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27]): potential dests added=[] removed=[] 2024-09-12T17:19:07.840 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.839+0000 7fdf059db9c0 1 execute INFO: reshard of bucket "abort-at-trim-reshard-log-entries" from 1 shards to 2 shards completed successfully 2024-09-12T17:19:07.844 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.839+0000 7fddb9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:07.848 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.847+0000 7fdf059db9c0 20 remove_watcher() i=0 2024-09-12T17:19:07.849 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.847+0000 7fdf059db9c0 2 removed watcher, disabling cache 2024-09-12T17:19:07.851 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.847+0000 7fdf059db9c0 20 remove_watcher() i=1 2024-09-12T17:19:07.853 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.851+0000 7fdf059db9c0 20 remove_watcher() i=2 2024-09-12T17:19:07.858 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.855+0000 7fdf059db9c0 20 remove_watcher() i=3 2024-09-12T17:19:07.860 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.859+0000 7fdf059db9c0 20 remove_watcher() i=4 2024-09-12T17:19:07.862 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.859+0000 7fdf059db9c0 20 remove_watcher() i=5 2024-09-12T17:19:07.864 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.859+0000 7fdf059db9c0 20 remove_watcher() i=6 2024-09-12T17:19:07.865 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.863+0000 7fdf059db9c0 20 remove_watcher() i=7 2024-09-12T17:19:07.884 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T17:19:07.917 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:19:07.917 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:19:07.965 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.963+0000 7f4a9ea139c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:07.967 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.963+0000 7f4a9ea139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:07.967 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.963+0000 7f4a9ea139c0 20 realm 2024-09-12T17:19:07.967 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.963+0000 7f4a9ea139c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:07.967 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.963+0000 7f4a9ea139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:07.967 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.963+0000 7f4a9ea139c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:19:07.967 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.963+0000 7f4a9ea139c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:07.967 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.963+0000 7f4a9ea139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:07.967 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.963+0000 7f4a9ea139c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:07.969 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.967+0000 7f4a9ea139c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:07.969 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.967+0000 7f4a9ea139c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:07.970 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.967+0000 7f4a9ea139c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:19:07.970 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.967+0000 7f4a9ea139c0 20 searching for the correct realm 2024-09-12T17:19:07.973 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.971+0000 7f4a9cd1a640 0 -- 172.21.15.16:0/3727552435 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f4a900642f0 msgr2=0x7f4a900957f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:19:07.982 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:07.979+0000 7f4a9bd18640 0 -- 172.21.15.16:0/3727552435 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f4a9403aba0 msgr2=0x7f4a9400f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:19:08.199 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.195+0000 7f4a9ea139c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:19:08.200 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.195+0000 7f4a9ea139c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:19:08.200 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.195+0000 7f4a9ea139c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:19:08.200 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.195+0000 7f4a9ea139c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:19:08.200 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.195+0000 7f4a9ea139c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:19:08.200 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.195+0000 7f4a9ea139c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:19:08.200 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.195+0000 7f4a9ea139c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:08.200 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.195+0000 7f4a9ea139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:08.201 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.195+0000 7f4a9ea139c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:08.201 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.199+0000 7f4a9ea139c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:08.201 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.199+0000 7f4a9ea139c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:08.202 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.199+0000 7f4a9ea139c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:19:08.202 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.199+0000 7f4a9ea139c0 20 zone default found 2024-09-12T17:19:08.203 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.199+0000 7f4a9ea139c0 4 Realm: () 2024-09-12T17:19:08.203 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.199+0000 7f4a9ea139c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:19:08.203 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.199+0000 7f4a9ea139c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:19:08.203 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.199+0000 7f4a9ea139c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:19:08.203 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.199+0000 7f4a9ea139c0 20 zonegroup default 2024-09-12T17:19:08.203 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.199+0000 7f4a9ea139c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:08.203 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.199+0000 7f4a9ea139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:08.204 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.199+0000 7f4a9ea139c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:08.204 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.203+0000 7f4a9ea139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:08.204 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.203+0000 7f4a9ea139c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:08.205 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.203+0000 7f4a9ea139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:08.205 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.203+0000 7f4a9ea139c0 20 started sync module instance, tier type = 2024-09-12T17:19:08.205 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.203+0000 7f4a9ea139c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:19:08.228 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.223+0000 7f4a9ea139c0 20 add_watcher() i=0 2024-09-12T17:19:08.228 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.223+0000 7f4a9ea139c0 20 add_watcher() i=1 2024-09-12T17:19:08.228 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.223+0000 7f4a9ea139c0 20 add_watcher() i=2 2024-09-12T17:19:08.228 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.223+0000 7f4a9ea139c0 20 add_watcher() i=3 2024-09-12T17:19:08.228 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.223+0000 7f4a9ea139c0 20 add_watcher() i=4 2024-09-12T17:19:08.228 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.223+0000 7f4a9ea139c0 20 add_watcher() i=5 2024-09-12T17:19:08.228 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.223+0000 7f4a9ea139c0 20 add_watcher() i=6 2024-09-12T17:19:08.230 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.227+0000 7f4a9ea139c0 20 add_watcher() i=7 2024-09-12T17:19:08.230 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.227+0000 7f4a9ea139c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:19:08.234 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.231+0000 7f49527e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:08.235 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.231+0000 7f4a9ea139c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:19:08.235 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.231+0000 7f4a9ea139c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:19:08.235 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.231+0000 7f4a9ea139c0 5 note: GC not initialized 2024-09-12T17:19:08.236 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.231+0000 7f49517e2640 20 reqs_thread_entry: start 2024-09-12T17:19:08.236 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.231+0000 7f4a9ea139c0 20 init_complete bucket index max shards: 1 2024-09-12T17:19:08.236 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.231+0000 7f4a9ea139c0 20 Filter name: none 2024-09-12T17:19:08.236 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.231+0000 7f48c2ffd640 20 reqs_thread_entry: start 2024-09-12T17:19:08.236 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.235+0000 7f4a9ea139c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:08.237 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.235+0000 7f4a9ea139c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:19:08.237 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.235+0000 7f4a9ea139c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:08.238 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.235+0000 7f4a9ea139c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:19:08.238 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.235+0000 7f4a9ea139c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:19:08.238 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.235+0000 7f4a9ea139c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:08.239 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.235+0000 7f4a9ea139c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:19:08.239 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.235+0000 7f4a9ea139c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:08.240 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.235+0000 7f4a9ea139c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:19:08.240 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.235+0000 7f4a9ea139c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:19:08.242 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.239+0000 7f49527e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:08.247 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.243+0000 7f4a9ea139c0 20 remove_watcher() i=0 2024-09-12T17:19:08.247 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.243+0000 7f4a9ea139c0 2 removed watcher, disabling cache 2024-09-12T17:19:08.249 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.247+0000 7f4a9ea139c0 20 remove_watcher() i=1 2024-09-12T17:19:08.253 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.251+0000 7f4a9ea139c0 20 remove_watcher() i=2 2024-09-12T17:19:08.255 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.251+0000 7f4a9ea139c0 20 remove_watcher() i=3 2024-09-12T17:19:08.257 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.255+0000 7f4a9ea139c0 20 remove_watcher() i=4 2024-09-12T17:19:08.259 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.255+0000 7f4a9ea139c0 20 remove_watcher() i=5 2024-09-12T17:19:08.261 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.259+0000 7f4a9ea139c0 20 remove_watcher() i=6 2024-09-12T17:19:08.262 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.259+0000 7f4a9ea139c0 20 remove_watcher() i=7 2024-09-12T17:19:08.281 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:08.281 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:19:08.281 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: abort-at-trim-reshard-log-entries id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:19:08.282 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:08.357 INFO:tasks.workunit.client.0.smithi016.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-09-12T17:19:08.357 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:08.814 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T17:19:08.847 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:19:08.847 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:19:08.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.895+0000 7fbd573a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:08.898 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.895+0000 7fbd573a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:08.898 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.895+0000 7fbd573a59c0 20 realm 2024-09-12T17:19:08.898 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.895+0000 7fbd573a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:08.898 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.895+0000 7fbd573a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:08.899 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.895+0000 7fbd573a59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:19:08.899 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.895+0000 7fbd573a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:08.899 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.895+0000 7fbd573a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:08.899 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.895+0000 7fbd573a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:08.900 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.899+0000 7fbd573a59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:08.900 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.899+0000 7fbd573a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:08.902 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.899+0000 7fbd573a59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:19:08.902 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.899+0000 7fbd573a59c0 20 searching for the correct realm 2024-09-12T17:19:08.905 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:08.903+0000 7fbd556ac640 0 -- 172.21.15.16:0/1280842284 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fbd4001a040 msgr2=0x7fbd400899a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:19:09.122 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.119+0000 7fbd4ffff640 0 -- 172.21.15.16:0/1280842284 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fbd500f0bf0 msgr2=0x7fbd501278d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:19:09.340 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.339+0000 7fbd573a59c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:19:09.340 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.339+0000 7fbd573a59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:19:09.341 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.339+0000 7fbd573a59c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:19:09.341 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.339+0000 7fbd573a59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:19:09.341 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.339+0000 7fbd573a59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:19:09.341 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.339+0000 7fbd573a59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:19:09.341 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.339+0000 7fbd573a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:09.341 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.339+0000 7fbd573a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:09.341 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.339+0000 7fbd573a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:09.342 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.339+0000 7fbd573a59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:09.342 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.339+0000 7fbd573a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:09.343 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.339+0000 7fbd573a59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:19:09.343 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.339+0000 7fbd573a59c0 20 zone default found 2024-09-12T17:19:09.343 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.339+0000 7fbd573a59c0 4 Realm: () 2024-09-12T17:19:09.343 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.339+0000 7fbd573a59c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:19:09.343 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.339+0000 7fbd573a59c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:19:09.343 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.339+0000 7fbd573a59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:19:09.343 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.339+0000 7fbd573a59c0 20 zonegroup default 2024-09-12T17:19:09.343 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.339+0000 7fbd573a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:09.345 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.343+0000 7fbd573a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:09.345 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.343+0000 7fbd573a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:09.346 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.343+0000 7fbd573a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:09.346 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.343+0000 7fbd573a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:09.347 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.343+0000 7fbd573a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:09.347 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.343+0000 7fbd573a59c0 20 started sync module instance, tier type = 2024-09-12T17:19:09.347 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.343+0000 7fbd573a59c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:19:09.369 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.367+0000 7fbd573a59c0 20 add_watcher() i=0 2024-09-12T17:19:09.370 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.367+0000 7fbd573a59c0 20 add_watcher() i=1 2024-09-12T17:19:09.370 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.367+0000 7fbd573a59c0 20 add_watcher() i=2 2024-09-12T17:19:09.370 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.367+0000 7fbd573a59c0 20 add_watcher() i=3 2024-09-12T17:19:09.370 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.367+0000 7fbd573a59c0 20 add_watcher() i=4 2024-09-12T17:19:09.370 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.367+0000 7fbd573a59c0 20 add_watcher() i=5 2024-09-12T17:19:09.370 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.367+0000 7fbd573a59c0 20 add_watcher() i=6 2024-09-12T17:19:09.371 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.367+0000 7fbd573a59c0 20 add_watcher() i=7 2024-09-12T17:19:09.371 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.367+0000 7fbd573a59c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:19:09.375 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.371+0000 7fbc0b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:09.376 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.371+0000 7fbd573a59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:19:09.376 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.371+0000 7fbd573a59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:19:09.376 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.371+0000 7fbd573a59c0 5 note: GC not initialized 2024-09-12T17:19:09.376 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.375+0000 7fbc0a7e4640 20 reqs_thread_entry: start 2024-09-12T17:19:09.377 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.375+0000 7fbd573a59c0 20 init_complete bucket index max shards: 1 2024-09-12T17:19:09.377 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.375+0000 7fbd573a59c0 20 Filter name: none 2024-09-12T17:19:09.377 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.375+0000 7fbc037fe640 20 reqs_thread_entry: start 2024-09-12T17:19:09.377 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.375+0000 7fbd573a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:09.378 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.375+0000 7fbd573a59c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:19:09.379 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.375+0000 7fbd573a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:09.379 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.375+0000 7fbd573a59c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T17:19:09.379 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.375+0000 7fbd573a59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:19:09.380 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.375+0000 7fbd573a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:09.380 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.379+0000 7fbd573a59c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:19:09.380 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.379+0000 7fbd573a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:09.381 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.379+0000 7fbd573a59c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T17:19:09.381 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.379+0000 7fbd573a59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:19:09.383 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.379+0000 7fbc0b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:09.388 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.383+0000 7fbd573a59c0 20 remove_watcher() i=0 2024-09-12T17:19:09.388 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.383+0000 7fbd573a59c0 2 removed watcher, disabling cache 2024-09-12T17:19:09.390 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.387+0000 7fbd573a59c0 20 remove_watcher() i=1 2024-09-12T17:19:09.392 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.391+0000 7fbd573a59c0 20 remove_watcher() i=2 2024-09-12T17:19:09.394 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.391+0000 7fbd573a59c0 20 remove_watcher() i=3 2024-09-12T17:19:09.397 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.395+0000 7fbd573a59c0 20 remove_watcher() i=4 2024-09-12T17:19:09.398 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.395+0000 7fbd573a59c0 20 remove_watcher() i=5 2024-09-12T17:19:09.400 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.395+0000 7fbd573a59c0 20 remove_watcher() i=6 2024-09-12T17:19:09.401 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.399+0000 7fbd573a59c0 20 remove_watcher() i=7 2024-09-12T17:19:09.418 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:09.419 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:19:09.419 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: error-at-block-writes id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:19:09.419 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:09.419 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-09-12T17:19:09.452 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:19:09.453 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:19:09.499 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.495+0000 7f2b4c7b09c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:09.501 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.499+0000 7f2b4c7b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:09.501 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.499+0000 7f2b4c7b09c0 20 realm 2024-09-12T17:19:09.501 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.499+0000 7f2b4c7b09c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:09.501 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.499+0000 7f2b4c7b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:09.501 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.499+0000 7f2b4c7b09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:19:09.501 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.499+0000 7f2b4c7b09c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:09.502 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.499+0000 7f2b4c7b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:09.502 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.499+0000 7f2b4c7b09c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:09.503 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.499+0000 7f2b4c7b09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:09.503 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.499+0000 7f2b4c7b09c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:09.504 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.503+0000 7f2b4c7b09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:19:09.505 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.503+0000 7f2b4c7b09c0 20 searching for the correct realm 2024-09-12T17:19:09.508 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.503+0000 7f2b4aab7640 0 -- 172.21.15.16:0/1463150473 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f2b3401b040 msgr2=0x7f2b34063240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:19:09.721 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.719+0000 7f2b49ab5640 0 -- 172.21.15.16:0/1463150473 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f2b440f1400 msgr2=0x7f2b440f1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:19:09.940 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.935+0000 7f2b4c7b09c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:19:09.940 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.935+0000 7f2b4c7b09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:19:09.940 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.935+0000 7f2b4c7b09c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:19:09.940 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.935+0000 7f2b4c7b09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:19:09.941 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.935+0000 7f2b4c7b09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:19:09.941 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.935+0000 7f2b4c7b09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:19:09.941 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.935+0000 7f2b4c7b09c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:09.941 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.939+0000 7f2b4c7b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:09.941 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.939+0000 7f2b4c7b09c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:09.942 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.939+0000 7f2b4c7b09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:09.942 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.939+0000 7f2b4c7b09c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:09.942 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.939+0000 7f2b4c7b09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:19:09.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.939+0000 7f2b4c7b09c0 20 zone default found 2024-09-12T17:19:09.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.939+0000 7f2b4c7b09c0 4 Realm: () 2024-09-12T17:19:09.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.939+0000 7f2b4c7b09c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:19:09.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.939+0000 7f2b4c7b09c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:19:09.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.939+0000 7f2b4c7b09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:19:09.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.939+0000 7f2b4c7b09c0 20 zonegroup default 2024-09-12T17:19:09.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.939+0000 7f2b4c7b09c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:09.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.939+0000 7f2b4c7b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:09.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.939+0000 7f2b4c7b09c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:09.944 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.943+0000 7f2b4c7b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:09.944 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.943+0000 7f2b4c7b09c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:09.945 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.943+0000 7f2b4c7b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:09.945 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.943+0000 7f2b4c7b09c0 20 started sync module instance, tier type = 2024-09-12T17:19:09.945 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.943+0000 7f2b4c7b09c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:19:09.968 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.963+0000 7f2b4c7b09c0 20 add_watcher() i=0 2024-09-12T17:19:09.968 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.963+0000 7f2b4c7b09c0 20 add_watcher() i=1 2024-09-12T17:19:09.968 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.963+0000 7f2b4c7b09c0 20 add_watcher() i=2 2024-09-12T17:19:09.968 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.963+0000 7f2b4c7b09c0 20 add_watcher() i=3 2024-09-12T17:19:09.968 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.963+0000 7f2b4c7b09c0 20 add_watcher() i=4 2024-09-12T17:19:09.968 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.963+0000 7f2b4c7b09c0 20 add_watcher() i=5 2024-09-12T17:19:09.969 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.967+0000 7f2b4c7b09c0 20 add_watcher() i=6 2024-09-12T17:19:09.971 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.967+0000 7f2b4c7b09c0 20 add_watcher() i=7 2024-09-12T17:19:09.971 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.967+0000 7f2b4c7b09c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:19:09.975 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.971+0000 7f2a017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:09.976 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.971+0000 7f2b4c7b09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:19:09.976 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.971+0000 7f2b4c7b09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:19:09.976 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.971+0000 7f2b4c7b09c0 5 note: GC not initialized 2024-09-12T17:19:09.977 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.975+0000 7f29fb7fe640 20 reqs_thread_entry: start 2024-09-12T17:19:09.977 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.975+0000 7f2b4c7b09c0 20 init_complete bucket index max shards: 1 2024-09-12T17:19:09.977 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.975+0000 7f2b4c7b09c0 20 Filter name: none 2024-09-12T17:19:09.977 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.975+0000 7f29f97fa640 20 reqs_thread_entry: start 2024-09-12T17:19:09.977 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.975+0000 7f2b4c7b09c0 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T17:19:09.978 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.975+0000 7f2b4c7b09c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:09.978 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.975+0000 7f2b4c7b09c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:19:09.978 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.975+0000 7f2b4c7b09c0 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T17:19:09.979 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.975+0000 7f2b4c7b09c0 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T17:19:09.979 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.975+0000 7f2b4c7b09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28 : miss 2024-09-12T17:19:09.979 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.975+0000 7f2b4c7b09c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:09.979 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.975+0000 7f2b4c7b09c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T17:19:09.979 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.975+0000 7f2b4c7b09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28 info.flags=0x17 2024-09-12T17:19:09.979 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.975+0000 7f2b4c7b09c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28 to cache LRU end 2024-09-12T17:19:09.979 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.975+0000 7f2b4c7b09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:19:09.980 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.975+0000 7f2b4c7b09c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:09.980 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.975+0000 7f2b4c7b09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28 2024-09-12T17:19:09.986 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.983+0000 7f2b4c7b09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28 info.flags=0x17 2024-09-12T17:19:09.987 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.983+0000 7f2b4c7b09c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28 to cache LRU end 2024-09-12T17:19:09.987 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.983+0000 7f2b4c7b09c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:09.987 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.983+0000 7f2b4c7b09c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28, ofs0, ns] 2024-09-12T17:19:09.987 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.983+0000 7f2a2dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431620 cookie 94680610526192 notifier 6641 bl.length()=915 2024-09-12T17:19:09.987 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.983+0000 7f2a2dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28 info.flags=0x17 2024-09-12T17:19:09.987 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.983+0000 7f2a2dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28 to cache LRU end 2024-09-12T17:19:09.987 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.983+0000 7f2a2dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:09.988 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.987+0000 7f2b4c7b09c0 20 handle_bi_update(): bucket=:error-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28]): orig_sources= new_sources= 2024-09-12T17:19:09.988 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.987+0000 7f2b4c7b09c0 20 handle_bi_update(): bucket=:error-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28]): potential sources added=[] removed=[] 2024-09-12T17:19:09.989 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.987+0000 7f2b4c7b09c0 20 handle_bi_update(): bucket=:error-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28]): orig_dests= new_dests= 2024-09-12T17:19:09.989 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.987+0000 7f2b4c7b09c0 20 handle_bi_update(): bucket=:error-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28]): potential dests added=[] removed=[] 2024-09-12T17:19:09.992 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.987+0000 7f2b4c7b09c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28.1.0 2024-09-12T17:19:09.992 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.987+0000 7f2b4c7b09c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28.1.0 2024-09-12T17:19:09.992 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.987+0000 7f2b4c7b09c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28.1.1 2024-09-12T17:19:09.992 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.987+0000 7f2b4c7b09c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28.1.1 2024-09-12T17:19:09.992 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.987+0000 7f2b4c7b09c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28.0 2024-09-12T17:19:09.996 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.991+0000 7f2b4c7b09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28 : hit (requested=0x17, cached=0x17) 2024-09-12T17:19:09.996 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.991+0000 7f2b4c7b09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28 2024-09-12T17:19:09.998 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.995+0000 7f2b4c7b09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28 info.flags=0x17 2024-09-12T17:19:09.998 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.995+0000 7f2b4c7b09c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28 to cache LRU end 2024-09-12T17:19:09.998 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.995+0000 7f2b4c7b09c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:09.998 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.995+0000 7f2b4c7b09c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28, ofs0, ns] 2024-09-12T17:19:09.999 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.995+0000 7f2a2dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431621 cookie 94680610526192 notifier 6641 bl.length()=915 2024-09-12T17:19:09.999 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.995+0000 7f2a2dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28 info.flags=0x17 2024-09-12T17:19:09.999 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.995+0000 7f2a2dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28 to cache LRU end 2024-09-12T17:19:09.999 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.995+0000 7f2a2dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:10.000 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.999+0000 7f2b4c7b09c0 20 handle_bi_update(): bucket=:error-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28]): orig_sources= new_sources= 2024-09-12T17:19:10.000 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.999+0000 7f2b4c7b09c0 20 handle_bi_update(): bucket=:error-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28]): potential sources added=[] removed=[] 2024-09-12T17:19:10.001 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.999+0000 7f2b4c7b09c0 20 handle_bi_update(): bucket=:error-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28]): orig_dests= new_dests= 2024-09-12T17:19:10.001 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.999+0000 7f2b4c7b09c0 20 handle_bi_update(): bucket=:error-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28]): potential dests added=[] removed=[] 2024-09-12T17:19:10.001 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.999+0000 7f2b4c7b09c0 -1 Injecting error=-5 at location=block_writes 2024-09-12T17:19:10.001 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:09.999+0000 7f2b4c7b09c0 0 ERROR: change_reshard_state failed to pause writes to the current index: (5) Input/output error 2024-09-12T17:19:10.005 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.003+0000 7f2b4c7b09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28 : hit (requested=0x17, cached=0x17) 2024-09-12T17:19:10.005 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.003+0000 7f2b4c7b09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28 2024-09-12T17:19:10.007 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.003+0000 7f2b4c7b09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28 info.flags=0x17 2024-09-12T17:19:10.007 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.003+0000 7f2b4c7b09c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28 to cache LRU end 2024-09-12T17:19:10.007 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.003+0000 7f2b4c7b09c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:10.008 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.003+0000 7f2b4c7b09c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28, ofs0, ns] 2024-09-12T17:19:10.008 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.003+0000 7f2a2dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431622 cookie 94680610526192 notifier 6641 bl.length()=883 2024-09-12T17:19:10.008 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.003+0000 7f2a2dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28 info.flags=0x17 2024-09-12T17:19:10.008 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.003+0000 7f2a2dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28 to cache LRU end 2024-09-12T17:19:10.008 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.003+0000 7f2a2dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:10.009 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.007+0000 7f2b4c7b09c0 20 handle_bi_update(): bucket=:error-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28]): orig_sources= new_sources= 2024-09-12T17:19:10.009 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.007+0000 7f2b4c7b09c0 20 handle_bi_update(): bucket=:error-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28]): potential sources added=[] removed=[] 2024-09-12T17:19:10.009 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.007+0000 7f2b4c7b09c0 20 handle_bi_update(): bucket=:error-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28]): orig_dests= new_dests= 2024-09-12T17:19:10.009 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.007+0000 7f2b4c7b09c0 20 handle_bi_update(): bucket=:error-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28]): potential dests added=[] removed=[] 2024-09-12T17:19:10.010 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.007+0000 7f2b4c7b09c0 1 execute INFO: reshard of bucket "error-at-block-writes" canceled due to errors 2024-09-12T17:19:10.014 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.011+0000 7f2a017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:10.019 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.015+0000 7f2b4c7b09c0 20 remove_watcher() i=0 2024-09-12T17:19:10.019 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.015+0000 7f2b4c7b09c0 2 removed watcher, disabling cache 2024-09-12T17:19:10.021 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.019+0000 7f2b4c7b09c0 20 remove_watcher() i=1 2024-09-12T17:19:10.023 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.019+0000 7f2b4c7b09c0 20 remove_watcher() i=2 2024-09-12T17:19:10.025 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.023+0000 7f2b4c7b09c0 20 remove_watcher() i=3 2024-09-12T17:19:10.027 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.023+0000 7f2b4c7b09c0 20 remove_watcher() i=4 2024-09-12T17:19:10.029 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.027+0000 7f2b4c7b09c0 20 remove_watcher() i=5 2024-09-12T17:19:10.030 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.027+0000 7f2b4c7b09c0 20 remove_watcher() i=6 2024-09-12T17:19:10.031 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.027+0000 7f2b4c7b09c0 20 remove_watcher() i=7 2024-09-12T17:19:10.046 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T17:19:10.078 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:19:10.078 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:19:10.125 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.123+0000 7f6f93c9b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:10.127 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.123+0000 7f6f93c9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:10.127 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.123+0000 7f6f93c9b9c0 20 realm 2024-09-12T17:19:10.127 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.123+0000 7f6f93c9b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:10.127 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.123+0000 7f6f93c9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:10.127 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.123+0000 7f6f93c9b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:19:10.127 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.123+0000 7f6f93c9b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:10.128 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.123+0000 7f6f93c9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:10.128 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.123+0000 7f6f93c9b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:10.129 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.127+0000 7f6f93c9b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:10.129 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.127+0000 7f6f93c9b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:10.131 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.127+0000 7f6f93c9b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:19:10.131 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.127+0000 7f6f93c9b9c0 20 searching for the correct realm 2024-09-12T17:19:10.134 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.131+0000 7f6f91fa2640 0 -- 172.21.15.16:0/3747076454 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f6f88028420 msgr2=0x7f6f88028840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:19:10.350 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.347+0000 7f6f90fa0640 0 -- 172.21.15.16:0/3747076454 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f6f8c0b0070 msgr2=0x7f6f8c0c8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:19:10.568 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.567+0000 7f6f93c9b9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:19:10.569 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.567+0000 7f6f93c9b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:19:10.569 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.567+0000 7f6f93c9b9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:19:10.569 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.567+0000 7f6f93c9b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:19:10.569 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.567+0000 7f6f93c9b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:19:10.569 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.567+0000 7f6f93c9b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:19:10.569 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.567+0000 7f6f93c9b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:10.570 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.567+0000 7f6f93c9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:10.570 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.567+0000 7f6f93c9b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:10.570 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.567+0000 7f6f93c9b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:10.570 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.567+0000 7f6f93c9b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:10.571 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.567+0000 7f6f93c9b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:19:10.572 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.567+0000 7f6f93c9b9c0 20 zone default found 2024-09-12T17:19:10.572 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.567+0000 7f6f93c9b9c0 4 Realm: () 2024-09-12T17:19:10.572 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.567+0000 7f6f93c9b9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:19:10.572 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.567+0000 7f6f93c9b9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:19:10.572 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.567+0000 7f6f93c9b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:19:10.572 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.567+0000 7f6f93c9b9c0 20 zonegroup default 2024-09-12T17:19:10.572 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.567+0000 7f6f93c9b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:10.573 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.567+0000 7f6f93c9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:10.573 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.571+0000 7f6f93c9b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:10.573 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.571+0000 7f6f93c9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:10.573 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.571+0000 7f6f93c9b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:10.574 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.571+0000 7f6f93c9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:10.574 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.571+0000 7f6f93c9b9c0 20 started sync module instance, tier type = 2024-09-12T17:19:10.574 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.571+0000 7f6f93c9b9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:19:10.599 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.595+0000 7f6f93c9b9c0 20 add_watcher() i=0 2024-09-12T17:19:10.599 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.595+0000 7f6f93c9b9c0 20 add_watcher() i=1 2024-09-12T17:19:10.599 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.595+0000 7f6f93c9b9c0 20 add_watcher() i=2 2024-09-12T17:19:10.599 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.595+0000 7f6f93c9b9c0 20 add_watcher() i=3 2024-09-12T17:19:10.599 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.595+0000 7f6f93c9b9c0 20 add_watcher() i=4 2024-09-12T17:19:10.599 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.595+0000 7f6f93c9b9c0 20 add_watcher() i=5 2024-09-12T17:19:10.599 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.595+0000 7f6f93c9b9c0 20 add_watcher() i=6 2024-09-12T17:19:10.601 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.599+0000 7f6f93c9b9c0 20 add_watcher() i=7 2024-09-12T17:19:10.601 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.599+0000 7f6f93c9b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:19:10.605 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.603+0000 7f6e47fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:10.606 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.603+0000 7f6f93c9b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:19:10.606 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.603+0000 7f6f93c9b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:19:10.606 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.603+0000 7f6f93c9b9c0 5 note: GC not initialized 2024-09-12T17:19:10.607 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.603+0000 7f6e46fe5640 20 reqs_thread_entry: start 2024-09-12T17:19:10.607 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.603+0000 7f6f93c9b9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:19:10.607 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.603+0000 7f6f93c9b9c0 20 Filter name: none 2024-09-12T17:19:10.608 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.603+0000 7f6e44fe1640 20 reqs_thread_entry: start 2024-09-12T17:19:10.608 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.603+0000 7f6f93c9b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:10.608 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.607+0000 7f6f93c9b9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:19:10.609 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.607+0000 7f6f93c9b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:10.610 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.607+0000 7f6f93c9b9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T17:19:10.610 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.607+0000 7f6f93c9b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:19:10.610 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.607+0000 7f6f93c9b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:10.611 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.607+0000 7f6f93c9b9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:19:10.611 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.607+0000 7f6f93c9b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:10.612 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.607+0000 7f6f93c9b9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T17:19:10.612 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.607+0000 7f6f93c9b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:19:10.614 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.611+0000 7f6e47fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:10.619 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.615+0000 7f6f93c9b9c0 20 remove_watcher() i=0 2024-09-12T17:19:10.620 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.615+0000 7f6f93c9b9c0 2 removed watcher, disabling cache 2024-09-12T17:19:10.622 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.619+0000 7f6f93c9b9c0 20 remove_watcher() i=1 2024-09-12T17:19:10.624 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.623+0000 7f6f93c9b9c0 20 remove_watcher() i=2 2024-09-12T17:19:10.627 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.623+0000 7f6f93c9b9c0 20 remove_watcher() i=3 2024-09-12T17:19:10.629 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.627+0000 7f6f93c9b9c0 20 remove_watcher() i=4 2024-09-12T17:19:10.631 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.627+0000 7f6f93c9b9c0 20 remove_watcher() i=5 2024-09-12T17:19:10.632 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.631+0000 7f6f93c9b9c0 20 remove_watcher() i=6 2024-09-12T17:19:10.633 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.631+0000 7f6f93c9b9c0 20 remove_watcher() i=7 2024-09-12T17:19:10.651 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:10.651 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:19:10.651 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: error-at-block-writes id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:19:10.651 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:10.710 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:19:10.747 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:19:10.747 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:19:10.794 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.791+0000 7fbf6e3079c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:10.795 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.791+0000 7fbf6e3079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:10.796 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.791+0000 7fbf6e3079c0 20 realm 2024-09-12T17:19:10.796 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.791+0000 7fbf6e3079c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:10.796 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.791+0000 7fbf6e3079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:10.796 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.791+0000 7fbf6e3079c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:19:10.796 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.791+0000 7fbf6e3079c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:10.796 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.791+0000 7fbf6e3079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:10.796 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.791+0000 7fbf6e3079c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:10.797 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.795+0000 7fbf6e3079c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:10.797 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.795+0000 7fbf6e3079c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:10.799 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.795+0000 7fbf6e3079c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:19:10.800 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.795+0000 7fbf6e3079c0 20 searching for the correct realm 2024-09-12T17:19:10.802 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:10.799+0000 7fbf6c60e640 0 -- 172.21.15.16:0/1974698933 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fbf54029020 msgr2=0x7fbf5404dab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:19:11.019 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.015+0000 7fbf6360c640 0 -- 172.21.15.16:0/1974698933 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fbf6411e930 msgr2=0x7fbf6412b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:19:11.237 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.235+0000 7fbf6e3079c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:19:11.237 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.235+0000 7fbf6e3079c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:19:11.237 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.235+0000 7fbf6e3079c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:19:11.237 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.235+0000 7fbf6e3079c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:19:11.238 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.235+0000 7fbf6e3079c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:19:11.238 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.235+0000 7fbf6e3079c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:19:11.238 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.235+0000 7fbf6e3079c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:11.238 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.235+0000 7fbf6e3079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:11.238 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.235+0000 7fbf6e3079c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:11.239 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.235+0000 7fbf6e3079c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:11.239 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.235+0000 7fbf6e3079c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:11.240 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.235+0000 7fbf6e3079c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:19:11.240 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.235+0000 7fbf6e3079c0 20 zone default found 2024-09-12T17:19:11.240 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.235+0000 7fbf6e3079c0 4 Realm: () 2024-09-12T17:19:11.240 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.235+0000 7fbf6e3079c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:19:11.240 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.235+0000 7fbf6e3079c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:19:11.240 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.235+0000 7fbf6e3079c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:19:11.240 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.235+0000 7fbf6e3079c0 20 zonegroup default 2024-09-12T17:19:11.241 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.235+0000 7fbf6e3079c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:11.241 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.239+0000 7fbf6e3079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:11.241 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.239+0000 7fbf6e3079c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:11.241 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.239+0000 7fbf6e3079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:11.242 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.239+0000 7fbf6e3079c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:11.242 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.239+0000 7fbf6e3079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:11.242 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.239+0000 7fbf6e3079c0 20 started sync module instance, tier type = 2024-09-12T17:19:11.242 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.239+0000 7fbf6e3079c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:19:11.264 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.259+0000 7fbf6e3079c0 20 add_watcher() i=0 2024-09-12T17:19:11.264 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.259+0000 7fbf6e3079c0 20 add_watcher() i=1 2024-09-12T17:19:11.264 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.259+0000 7fbf6e3079c0 20 add_watcher() i=2 2024-09-12T17:19:11.264 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.259+0000 7fbf6e3079c0 20 add_watcher() i=3 2024-09-12T17:19:11.264 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.259+0000 7fbf6e3079c0 20 add_watcher() i=4 2024-09-12T17:19:11.265 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.259+0000 7fbf6e3079c0 20 add_watcher() i=5 2024-09-12T17:19:11.265 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.259+0000 7fbf6e3079c0 20 add_watcher() i=6 2024-09-12T17:19:11.266 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.263+0000 7fbf6e3079c0 20 add_watcher() i=7 2024-09-12T17:19:11.266 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.263+0000 7fbf6e3079c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:19:11.269 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.267+0000 7fbe21fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:11.270 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.267+0000 7fbf6e3079c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:19:11.270 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.267+0000 7fbf6e3079c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:19:11.270 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.267+0000 7fbf6e3079c0 5 note: GC not initialized 2024-09-12T17:19:11.271 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.267+0000 7fbe20fe1640 20 reqs_thread_entry: start 2024-09-12T17:19:11.271 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.267+0000 7fbf6e3079c0 20 init_complete bucket index max shards: 1 2024-09-12T17:19:11.271 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.267+0000 7fbf6e3079c0 20 Filter name: none 2024-09-12T17:19:11.271 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.267+0000 7fbd9a7fc640 20 reqs_thread_entry: start 2024-09-12T17:19:11.271 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.267+0000 7fbf6e3079c0 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T17:19:11.271 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.267+0000 7fbf6e3079c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:11.272 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.267+0000 7fbf6e3079c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:19:11.272 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.267+0000 7fbf6e3079c0 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T17:19:11.272 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.267+0000 7fbf6e3079c0 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T17:19:11.272 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.267+0000 7fbf6e3079c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28 : miss 2024-09-12T17:19:11.272 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.267+0000 7fbf6e3079c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:11.272 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.271+0000 7fbf6e3079c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T17:19:11.273 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.271+0000 7fbf6e3079c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28 info.flags=0x17 2024-09-12T17:19:11.273 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.271+0000 7fbf6e3079c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28 to cache LRU end 2024-09-12T17:19:11.273 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.271+0000 7fbf6e3079c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:19:11.273 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.271+0000 7fbf6e3079c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:11.273 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.271+0000 7fbf6e3079c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28 2024-09-12T17:19:11.279 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.275+0000 7fbf6e3079c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28 info.flags=0x17 2024-09-12T17:19:11.280 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.275+0000 7fbf6e3079c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28 to cache LRU end 2024-09-12T17:19:11.280 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.275+0000 7fbf6e3079c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:11.280 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.275+0000 7fbf6e3079c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28, ofs0, ns] 2024-09-12T17:19:11.280 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.279+0000 7fbe4affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431623 cookie 94144420374624 notifier 6677 bl.length()=915 2024-09-12T17:19:11.281 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.279+0000 7fbe4affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28 info.flags=0x17 2024-09-12T17:19:11.281 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.279+0000 7fbe4affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28 to cache LRU end 2024-09-12T17:19:11.281 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.279+0000 7fbe4affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:11.282 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.279+0000 7fbf6e3079c0 20 handle_bi_update(): bucket=:error-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28]): orig_sources= new_sources= 2024-09-12T17:19:11.282 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.279+0000 7fbf6e3079c0 20 handle_bi_update(): bucket=:error-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28]): potential sources added=[] removed=[] 2024-09-12T17:19:11.282 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.279+0000 7fbf6e3079c0 20 handle_bi_update(): bucket=:error-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28]): orig_dests= new_dests= 2024-09-12T17:19:11.282 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.279+0000 7fbf6e3079c0 20 handle_bi_update(): bucket=:error-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28]): potential dests added=[] removed=[] 2024-09-12T17:19:11.285 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.283+0000 7fbf6e3079c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28.1.0 2024-09-12T17:19:11.285 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.283+0000 7fbf6e3079c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28.1.0 2024-09-12T17:19:11.285 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.283+0000 7fbf6e3079c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28.1.1 2024-09-12T17:19:11.285 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.283+0000 7fbf6e3079c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28.1.1 2024-09-12T17:19:11.285 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.283+0000 7fbf6e3079c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28.0 2024-09-12T17:19:11.289 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.287+0000 7fbf6e3079c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28 : hit (requested=0x17, cached=0x17) 2024-09-12T17:19:11.289 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.287+0000 7fbf6e3079c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28 2024-09-12T17:19:11.291 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.287+0000 7fbf6e3079c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28 info.flags=0x17 2024-09-12T17:19:11.291 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.287+0000 7fbf6e3079c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28 to cache LRU end 2024-09-12T17:19:11.291 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.287+0000 7fbf6e3079c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:11.291 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.287+0000 7fbf6e3079c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28, ofs0, ns] 2024-09-12T17:19:11.292 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.291+0000 7fbe4a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431624 cookie 94144420374624 notifier 6677 bl.length()=915 2024-09-12T17:19:11.292 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.291+0000 7fbe4a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28 info.flags=0x17 2024-09-12T17:19:11.292 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.291+0000 7fbe4a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28 to cache LRU end 2024-09-12T17:19:11.293 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.291+0000 7fbe4a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:11.294 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.291+0000 7fbf6e3079c0 20 handle_bi_update(): bucket=:error-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28]): orig_sources= new_sources= 2024-09-12T17:19:11.294 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.291+0000 7fbf6e3079c0 20 handle_bi_update(): bucket=:error-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28]): potential sources added=[] removed=[] 2024-09-12T17:19:11.294 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.291+0000 7fbf6e3079c0 20 handle_bi_update(): bucket=:error-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28]): orig_dests= new_dests= 2024-09-12T17:19:11.294 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.291+0000 7fbf6e3079c0 20 handle_bi_update(): bucket=:error-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28]): potential dests added=[] removed=[] 2024-09-12T17:19:11.296 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.291+0000 7fbf6e3079c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28.0 2024-09-12T17:19:11.296 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.295+0000 7fbf6e3079c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28 : hit (requested=0x17, cached=0x17) 2024-09-12T17:19:11.296 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.295+0000 7fbf6e3079c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28 2024-09-12T17:19:11.299 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.295+0000 7fbf6e3079c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28 info.flags=0x17 2024-09-12T17:19:11.299 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.295+0000 7fbf6e3079c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28 to cache LRU end 2024-09-12T17:19:11.299 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.295+0000 7fbf6e3079c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:11.299 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.295+0000 7fbf6e3079c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28, ofs0, ns] 2024-09-12T17:19:11.300 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.295+0000 7fbe4a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431625 cookie 94144420374624 notifier 6677 bl.length()=883 2024-09-12T17:19:11.300 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.295+0000 7fbe4a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28 info.flags=0x17 2024-09-12T17:19:11.300 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.295+0000 7fbe4a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28 to cache LRU end 2024-09-12T17:19:11.300 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.295+0000 7fbe4a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:11.301 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.299+0000 7fbf6e3079c0 20 handle_bi_update(): bucket=:error-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28]): orig_sources= new_sources= 2024-09-12T17:19:11.301 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.299+0000 7fbf6e3079c0 20 handle_bi_update(): bucket=:error-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28]): potential sources added=[] removed=[] 2024-09-12T17:19:11.301 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.299+0000 7fbf6e3079c0 20 handle_bi_update(): bucket=:error-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28]): orig_dests= new_dests= 2024-09-12T17:19:11.301 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.299+0000 7fbf6e3079c0 20 handle_bi_update(): bucket=:error-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28]): potential dests added=[] removed=[] 2024-09-12T17:19:11.303 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.299+0000 7fbf6e3079c0 1 execute INFO: reshard of bucket "error-at-block-writes" from 1 shards to 2 shards completed successfully 2024-09-12T17:19:11.306 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.303+0000 7fbe21fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:11.311 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.307+0000 7fbf6e3079c0 20 remove_watcher() i=0 2024-09-12T17:19:11.311 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.307+0000 7fbf6e3079c0 2 removed watcher, disabling cache 2024-09-12T17:19:11.313 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.311+0000 7fbf6e3079c0 20 remove_watcher() i=1 2024-09-12T17:19:11.317 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.315+0000 7fbf6e3079c0 20 remove_watcher() i=2 2024-09-12T17:19:11.319 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.315+0000 7fbf6e3079c0 20 remove_watcher() i=3 2024-09-12T17:19:11.322 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.319+0000 7fbf6e3079c0 20 remove_watcher() i=4 2024-09-12T17:19:11.323 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.319+0000 7fbf6e3079c0 20 remove_watcher() i=5 2024-09-12T17:19:11.325 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.323+0000 7fbf6e3079c0 20 remove_watcher() i=6 2024-09-12T17:19:11.326 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.323+0000 7fbf6e3079c0 20 remove_watcher() i=7 2024-09-12T17:19:11.342 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T17:19:11.370 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:19:11.370 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:19:11.417 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.415+0000 7f744fe029c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:11.419 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.415+0000 7f744fe029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:11.419 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.415+0000 7f744fe029c0 20 realm 2024-09-12T17:19:11.419 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.415+0000 7f744fe029c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:11.419 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.415+0000 7f744fe029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:11.419 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.415+0000 7f744fe029c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:19:11.419 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.415+0000 7f744fe029c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:11.419 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.415+0000 7f744fe029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:11.419 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.415+0000 7f744fe029c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:11.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.419+0000 7f744fe029c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:11.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.419+0000 7f744fe029c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:11.422 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.419+0000 7f744fe029c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:19:11.422 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.419+0000 7f744fe029c0 20 searching for the correct realm 2024-09-12T17:19:11.426 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.423+0000 7f744e109640 0 -- 172.21.15.16:0/670628355 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f744400e070 msgr2=0x7f744406d830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:19:11.434 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.431+0000 7f744d107640 0 -- 172.21.15.16:0/670628355 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f744801e920 msgr2=0x7f74480313f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:19:11.652 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.647+0000 7f744fe029c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:19:11.652 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.647+0000 7f744fe029c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:19:11.652 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.647+0000 7f744fe029c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:19:11.653 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.647+0000 7f744fe029c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:19:11.653 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.647+0000 7f744fe029c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:19:11.653 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.647+0000 7f744fe029c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:19:11.653 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.647+0000 7f744fe029c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:11.653 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.647+0000 7f744fe029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:11.653 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.651+0000 7f744fe029c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:11.653 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.651+0000 7f744fe029c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:11.653 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.651+0000 7f744fe029c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:11.654 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.651+0000 7f744fe029c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:19:11.654 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.651+0000 7f744fe029c0 20 zone default found 2024-09-12T17:19:11.654 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.651+0000 7f744fe029c0 4 Realm: () 2024-09-12T17:19:11.654 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.651+0000 7f744fe029c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:19:11.654 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.651+0000 7f744fe029c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:19:11.654 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.651+0000 7f744fe029c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:19:11.655 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.651+0000 7f744fe029c0 20 zonegroup default 2024-09-12T17:19:11.655 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.651+0000 7f744fe029c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:11.655 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.651+0000 7f744fe029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:11.655 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.651+0000 7f744fe029c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:11.656 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.651+0000 7f744fe029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:11.656 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.651+0000 7f744fe029c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:11.657 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.655+0000 7f744fe029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:11.657 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.655+0000 7f744fe029c0 20 started sync module instance, tier type = 2024-09-12T17:19:11.657 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.655+0000 7f744fe029c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:19:11.681 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.679+0000 7f744fe029c0 20 add_watcher() i=0 2024-09-12T17:19:11.681 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.679+0000 7f744fe029c0 20 add_watcher() i=1 2024-09-12T17:19:11.681 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.679+0000 7f744fe029c0 20 add_watcher() i=2 2024-09-12T17:19:11.681 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.679+0000 7f744fe029c0 20 add_watcher() i=3 2024-09-12T17:19:11.681 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.679+0000 7f744fe029c0 20 add_watcher() i=4 2024-09-12T17:19:11.681 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.679+0000 7f744fe029c0 20 add_watcher() i=5 2024-09-12T17:19:11.681 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.679+0000 7f744fe029c0 20 add_watcher() i=6 2024-09-12T17:19:11.683 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.679+0000 7f744fe029c0 20 add_watcher() i=7 2024-09-12T17:19:11.683 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.679+0000 7f744fe029c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:19:11.688 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.683+0000 7f72ff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:11.689 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.687+0000 7f744fe029c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:19:11.689 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.687+0000 7f744fe029c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:19:11.689 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.687+0000 7f744fe029c0 5 note: GC not initialized 2024-09-12T17:19:11.690 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.687+0000 7f72fe7fc640 20 reqs_thread_entry: start 2024-09-12T17:19:11.690 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.687+0000 7f744fe029c0 20 init_complete bucket index max shards: 1 2024-09-12T17:19:11.690 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.687+0000 7f744fe029c0 20 Filter name: none 2024-09-12T17:19:11.690 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.687+0000 7f726ffff640 20 reqs_thread_entry: start 2024-09-12T17:19:11.690 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.687+0000 7f744fe029c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:11.691 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.687+0000 7f744fe029c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:19:11.691 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.687+0000 7f744fe029c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:11.692 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.691+0000 7f744fe029c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T17:19:11.692 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.691+0000 7f744fe029c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:19:11.692 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.691+0000 7f744fe029c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:11.693 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.691+0000 7f744fe029c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:19:11.694 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.691+0000 7f744fe029c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:11.694 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.691+0000 7f744fe029c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T17:19:11.694 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.691+0000 7f744fe029c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:19:11.697 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.695+0000 7f72ff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:11.703 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.699+0000 7f744fe029c0 20 remove_watcher() i=0 2024-09-12T17:19:11.703 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.699+0000 7f744fe029c0 2 removed watcher, disabling cache 2024-09-12T17:19:11.705 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.703+0000 7f744fe029c0 20 remove_watcher() i=1 2024-09-12T17:19:11.708 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.703+0000 7f744fe029c0 20 remove_watcher() i=2 2024-09-12T17:19:11.710 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.707+0000 7f744fe029c0 20 remove_watcher() i=3 2024-09-12T17:19:11.712 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.711+0000 7f744fe029c0 20 remove_watcher() i=4 2024-09-12T17:19:11.714 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.711+0000 7f744fe029c0 20 remove_watcher() i=5 2024-09-12T17:19:11.716 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.711+0000 7f744fe029c0 20 remove_watcher() i=6 2024-09-12T17:19:11.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:11.715+0000 7f744fe029c0 20 remove_watcher() i=7 2024-09-12T17:19:11.737 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:11.737 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:19:11.737 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: error-at-block-writes id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:19:11.737 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:11.823 INFO:tasks.workunit.client.0.smithi016.stderr:TEST: reshard bucket with abort at block_writes 2024-09-12T17:19:11.823 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:12.280 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T17:19:12.315 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:19:12.315 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:19:12.363 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.359+0000 7f5f4b98d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.365 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.363+0000 7f5f4b98d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:12.365 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.363+0000 7f5f4b98d9c0 20 realm 2024-09-12T17:19:12.365 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.363+0000 7f5f4b98d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.365 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.363+0000 7f5f4b98d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:12.365 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.363+0000 7f5f4b98d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:19:12.365 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.363+0000 7f5f4b98d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.365 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.363+0000 7f5f4b98d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:12.365 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.363+0000 7f5f4b98d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.367 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.363+0000 7f5f4b98d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:12.367 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.363+0000 7f5f4b98d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.368 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.367+0000 7f5f4b98d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:19:12.369 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.367+0000 7f5f4b98d9c0 20 searching for the correct realm 2024-09-12T17:19:12.372 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.367+0000 7f5f48c92640 0 -- 172.21.15.16:0/892489952 >> [v2:172.21.15.19:6800/1509147557,v1:172.21.15.19:6801/1509147557] conn(0x55d493b8ad10 msgr2=0x55d493b8d100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:19:12.381 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.379+0000 7f5f49493640 0 -- 172.21.15.16:0/892489952 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f5f4006f550 msgr2=0x7f5f40067a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:19:12.600 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.595+0000 7f5f4b98d9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:19:12.600 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.595+0000 7f5f4b98d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:19:12.600 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.595+0000 7f5f4b98d9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:19:12.600 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.595+0000 7f5f4b98d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:19:12.600 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.595+0000 7f5f4b98d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:19:12.600 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.595+0000 7f5f4b98d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:19:12.600 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.595+0000 7f5f4b98d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.601 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.595+0000 7f5f4b98d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:12.601 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.599+0000 7f5f4b98d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.601 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.599+0000 7f5f4b98d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:12.601 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.599+0000 7f5f4b98d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.602 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.599+0000 7f5f4b98d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:19:12.602 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.599+0000 7f5f4b98d9c0 20 zone default found 2024-09-12T17:19:12.602 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.599+0000 7f5f4b98d9c0 4 Realm: () 2024-09-12T17:19:12.602 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.599+0000 7f5f4b98d9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:19:12.602 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.599+0000 7f5f4b98d9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:19:12.603 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.599+0000 7f5f4b98d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:19:12.603 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.599+0000 7f5f4b98d9c0 20 zonegroup default 2024-09-12T17:19:12.603 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.599+0000 7f5f4b98d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.603 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.599+0000 7f5f4b98d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:12.603 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.599+0000 7f5f4b98d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.604 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.599+0000 7f5f4b98d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:12.604 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.599+0000 7f5f4b98d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.604 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.603+0000 7f5f4b98d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:12.604 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.603+0000 7f5f4b98d9c0 20 started sync module instance, tier type = 2024-09-12T17:19:12.604 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.603+0000 7f5f4b98d9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:19:12.627 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.623+0000 7f5f4b98d9c0 20 add_watcher() i=0 2024-09-12T17:19:12.627 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.623+0000 7f5f4b98d9c0 20 add_watcher() i=1 2024-09-12T17:19:12.627 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.623+0000 7f5f4b98d9c0 20 add_watcher() i=2 2024-09-12T17:19:12.627 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.623+0000 7f5f4b98d9c0 20 add_watcher() i=3 2024-09-12T17:19:12.627 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.623+0000 7f5f4b98d9c0 20 add_watcher() i=4 2024-09-12T17:19:12.627 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.623+0000 7f5f4b98d9c0 20 add_watcher() i=5 2024-09-12T17:19:12.627 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.623+0000 7f5f4b98d9c0 20 add_watcher() i=6 2024-09-12T17:19:12.629 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.627+0000 7f5f4b98d9c0 20 add_watcher() i=7 2024-09-12T17:19:12.629 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.627+0000 7f5f4b98d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:19:12.633 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.631+0000 7f5dfffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:12.634 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.631+0000 7f5f4b98d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:19:12.634 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.631+0000 7f5f4b98d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:19:12.634 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.631+0000 7f5f4b98d9c0 5 note: GC not initialized 2024-09-12T17:19:12.635 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.631+0000 7f5dfefe5640 20 reqs_thread_entry: start 2024-09-12T17:19:12.635 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.631+0000 7f5f4b98d9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:19:12.635 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.631+0000 7f5f4b98d9c0 20 Filter name: none 2024-09-12T17:19:12.635 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.631+0000 7f5dfcfe1640 20 reqs_thread_entry: start 2024-09-12T17:19:12.635 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.631+0000 7f5f4b98d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.636 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.635+0000 7f5f4b98d9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:19:12.636 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.635+0000 7f5f4b98d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.638 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.635+0000 7f5f4b98d9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T17:19:12.638 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.635+0000 7f5f4b98d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:19:12.638 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.635+0000 7f5f4b98d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.638 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.635+0000 7f5f4b98d9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:19:12.639 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.635+0000 7f5f4b98d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.639 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.635+0000 7f5f4b98d9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T17:19:12.639 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.635+0000 7f5f4b98d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:19:12.642 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.639+0000 7f5dfffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:12.647 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.643+0000 7f5f4b98d9c0 20 remove_watcher() i=0 2024-09-12T17:19:12.647 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.643+0000 7f5f4b98d9c0 2 removed watcher, disabling cache 2024-09-12T17:19:12.649 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.647+0000 7f5f4b98d9c0 20 remove_watcher() i=1 2024-09-12T17:19:12.651 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.647+0000 7f5f4b98d9c0 20 remove_watcher() i=2 2024-09-12T17:19:12.653 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.651+0000 7f5f4b98d9c0 20 remove_watcher() i=3 2024-09-12T17:19:12.656 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.651+0000 7f5f4b98d9c0 20 remove_watcher() i=4 2024-09-12T17:19:12.658 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.655+0000 7f5f4b98d9c0 20 remove_watcher() i=5 2024-09-12T17:19:12.659 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.655+0000 7f5f4b98d9c0 20 remove_watcher() i=6 2024-09-12T17:19:12.661 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.659+0000 7f5f4b98d9c0 20 remove_watcher() i=7 2024-09-12T17:19:12.679 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:12.679 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:19:12.679 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: abort-at-block-writes id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:19:12.679 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:12.679 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-09-12T17:19:12.712 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:19:12.712 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:19:12.760 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.762 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.759+0000 7f0dc9f0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:12.762 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.759+0000 7f0dc9f0b9c0 20 realm 2024-09-12T17:19:12.762 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.759+0000 7f0dc9f0b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.762 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.759+0000 7f0dc9f0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:12.762 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.759+0000 7f0dc9f0b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:19:12.762 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.759+0000 7f0dc9f0b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.762 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.759+0000 7f0dc9f0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:12.763 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.759+0000 7f0dc9f0b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.764 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.759+0000 7f0dc9f0b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:12.764 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.759+0000 7f0dc9f0b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.765 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.763+0000 7f0dc9f0b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:19:12.765 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.763+0000 7f0dc9f0b9c0 20 searching for the correct realm 2024-09-12T17:19:12.767 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.763+0000 7f0dc7210640 0 -- 172.21.15.16:0/3305785925 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7f0db8028040 msgr2=0x7f0db8040400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:19:12.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.771+0000 7f0dc8212640 0 -- 172.21.15.16:0/3305785925 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f0dbc049420 msgr2=0x7f0dbc049840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:19:12.786 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.783+0000 7f0dc9f0b9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:19:12.786 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.783+0000 7f0dc9f0b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:19:12.786 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.783+0000 7f0dc9f0b9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:19:12.786 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.783+0000 7f0dc9f0b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:19:12.787 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.783+0000 7f0dc9f0b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:19:12.787 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.783+0000 7f0dc9f0b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:19:12.787 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.783+0000 7f0dc9f0b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.787 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.783+0000 7f0dc9f0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:12.787 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.783+0000 7f0dc9f0b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.787 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.783+0000 7f0dc9f0b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:12.788 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.783+0000 7f0dc9f0b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.789 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.783+0000 7f0dc9f0b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:19:12.789 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.787+0000 7f0dc9f0b9c0 20 zone default found 2024-09-12T17:19:12.789 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.787+0000 7f0dc9f0b9c0 4 Realm: () 2024-09-12T17:19:12.789 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.787+0000 7f0dc9f0b9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:19:12.789 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.787+0000 7f0dc9f0b9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:19:12.789 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.787+0000 7f0dc9f0b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:19:12.789 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.787+0000 7f0dc9f0b9c0 20 zonegroup default 2024-09-12T17:19:12.789 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.787+0000 7f0dc9f0b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.789 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.787+0000 7f0dc9f0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:12.789 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.787+0000 7f0dc9f0b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.790 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.787+0000 7f0dc9f0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:12.790 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.787+0000 7f0dc9f0b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.790 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.787+0000 7f0dc9f0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:12.790 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.787+0000 7f0dc9f0b9c0 20 started sync module instance, tier type = 2024-09-12T17:19:12.790 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.787+0000 7f0dc9f0b9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:19:12.805 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.803+0000 7f0dc9f0b9c0 20 add_watcher() i=0 2024-09-12T17:19:12.806 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.803+0000 7f0dc9f0b9c0 20 add_watcher() i=1 2024-09-12T17:19:12.806 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.803+0000 7f0dc9f0b9c0 20 add_watcher() i=2 2024-09-12T17:19:12.806 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.803+0000 7f0dc9f0b9c0 20 add_watcher() i=3 2024-09-12T17:19:12.806 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.803+0000 7f0dc9f0b9c0 20 add_watcher() i=4 2024-09-12T17:19:12.806 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.803+0000 7f0dc9f0b9c0 20 add_watcher() i=5 2024-09-12T17:19:12.806 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.803+0000 7f0dc9f0b9c0 20 add_watcher() i=6 2024-09-12T17:19:12.806 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.803+0000 7f0dc9f0b9c0 20 add_watcher() i=7 2024-09-12T17:19:12.807 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.803+0000 7f0dc9f0b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:19:12.809 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.807+0000 7f0c7dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:12.811 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:19:12.811 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:19:12.811 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 note: GC not initialized 2024-09-12T17:19:12.811 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.807+0000 7f0c7cfe1640 20 reqs_thread_entry: start 2024-09-12T17:19:12.811 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:19:12.811 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 20 Filter name: none 2024-09-12T17:19:12.811 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.807+0000 7f0bf67fc640 20 reqs_thread_entry: start 2024-09-12T17:19:12.811 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T17:19:12.811 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.812 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:19:12.812 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T17:19:12.812 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T17:19:12.813 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 : miss 2024-09-12T17:19:12.813 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.813 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T17:19:12.813 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 info.flags=0x17 2024-09-12T17:19:12.813 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 to cache LRU end 2024-09-12T17:19:12.813 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:19:12.813 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:12.813 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 2024-09-12T17:19:12.819 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.815+0000 7f0dc9f0b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 info.flags=0x17 2024-09-12T17:19:12.819 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.815+0000 7f0dc9f0b9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 to cache LRU end 2024-09-12T17:19:12.819 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.815+0000 7f0dc9f0b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:12.820 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.815+0000 7f0dc9f0b9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29, ofs0, ns] 2024-09-12T17:19:12.820 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.815+0000 7f0ca6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431576 cookie 94508393508096 notifier 7029 bl.length()=915 2024-09-12T17:19:12.820 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.815+0000 7f0ca6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 info.flags=0x17 2024-09-12T17:19:12.820 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.815+0000 7f0ca6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 to cache LRU end 2024-09-12T17:19:12.820 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.815+0000 7f0ca6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:12.820 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.819+0000 7f0dc9f0b9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29]): orig_sources= new_sources= 2024-09-12T17:19:12.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.819+0000 7f0dc9f0b9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29]): potential sources added=[] removed=[] 2024-09-12T17:19:12.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.819+0000 7f0dc9f0b9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29]): orig_dests= new_dests= 2024-09-12T17:19:12.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.819+0000 7f0dc9f0b9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29]): potential dests added=[] removed=[] 2024-09-12T17:19:12.825 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.823+0000 7f0dc9f0b9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29.1.0 2024-09-12T17:19:12.825 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.823+0000 7f0dc9f0b9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29.1.0 2024-09-12T17:19:12.825 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.823+0000 7f0dc9f0b9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29.1.1 2024-09-12T17:19:12.825 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.823+0000 7f0dc9f0b9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29.1.1 2024-09-12T17:19:12.825 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.823+0000 7f0dc9f0b9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29.0 2024-09-12T17:19:12.830 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.827+0000 7f0dc9f0b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 : hit (requested=0x17, cached=0x17) 2024-09-12T17:19:12.830 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.827+0000 7f0dc9f0b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 2024-09-12T17:19:12.832 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.831+0000 7f0dc9f0b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 info.flags=0x17 2024-09-12T17:19:12.832 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.831+0000 7f0dc9f0b9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 to cache LRU end 2024-09-12T17:19:12.832 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.831+0000 7f0dc9f0b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:12.833 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.831+0000 7f0dc9f0b9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29, ofs0, ns] 2024-09-12T17:19:12.833 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.831+0000 7f0ca6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431577 cookie 94508393508096 notifier 7029 bl.length()=915 2024-09-12T17:19:12.833 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.831+0000 7f0ca6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 info.flags=0x17 2024-09-12T17:19:12.833 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.831+0000 7f0ca6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 to cache LRU end 2024-09-12T17:19:12.834 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.831+0000 7f0ca6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:12.834 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.831+0000 7f0dc9f0b9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29]): orig_sources= new_sources= 2024-09-12T17:19:12.834 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.831+0000 7f0dc9f0b9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29]): potential sources added=[] removed=[] 2024-09-12T17:19:12.834 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.831+0000 7f0dc9f0b9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29]): orig_dests= new_dests= 2024-09-12T17:19:12.834 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.831+0000 7f0dc9f0b9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29]): potential dests added=[] removed=[] 2024-09-12T17:19:12.834 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0dc9f0b9c0 time 2024-09-12T17:19:12.835996+0000 2024-09-12T17:19:12.834 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:19:12.835 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:19:12.835 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f0dcd7e52eb] 2024-09-12T17:19:12.835 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0dcd7e549f] 2024-09-12T17:19:12.835 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f471ec70c1] 2024-09-12T17:19:12.835 INFO:tasks.workunit.client.0.smithi016.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55f471ed855b] 2024-09-12T17:19:12.835 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55f471ed9b44] 2024-09-12T17:19:12.835 INFO:tasks.workunit.client.0.smithi016.stderr: 6: main() 2024-09-12T17:19:12.836 INFO:tasks.workunit.client.0.smithi016.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0dcc64bd90] 2024-09-12T17:19:12.836 INFO:tasks.workunit.client.0.smithi016.stderr: 8: __libc_start_main() 2024-09-12T17:19:12.836 INFO:tasks.workunit.client.0.smithi016.stderr: 9: _start() 2024-09-12T17:19:12.836 INFO:tasks.workunit.client.0.smithi016.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:19:12.836 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7f0dc9f0b9c0 thread_name:radosgw-admin 2024-09-12T17:19:12.836 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.831+0000 7f0dc9f0b9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0dc9f0b9c0 time 2024-09-12T17:19:12.835996+0000 2024-09-12T17:19:12.836 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:19:12.836 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:12.836 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:19:12.836 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f0dcd7e52eb] 2024-09-12T17:19:12.837 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0dcd7e549f] 2024-09-12T17:19:12.837 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f471ec70c1] 2024-09-12T17:19:12.837 INFO:tasks.workunit.client.0.smithi016.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55f471ed855b] 2024-09-12T17:19:12.837 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55f471ed9b44] 2024-09-12T17:19:12.837 INFO:tasks.workunit.client.0.smithi016.stderr: 6: main() 2024-09-12T17:19:12.837 INFO:tasks.workunit.client.0.smithi016.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0dcc64bd90] 2024-09-12T17:19:12.837 INFO:tasks.workunit.client.0.smithi016.stderr: 8: __libc_start_main() 2024-09-12T17:19:12.837 INFO:tasks.workunit.client.0.smithi016.stderr: 9: _start() 2024-09-12T17:19:12.837 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:12.859 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:19:12.859 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f0dcc664520] 2024-09-12T17:19:12.859 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:19:12.859 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:19:12.859 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:19:12.859 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f0dcd7e5345] 2024-09-12T17:19:12.860 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0dcd7e549f] 2024-09-12T17:19:12.860 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f471ec70c1] 2024-09-12T17:19:12.860 INFO:tasks.workunit.client.0.smithi016.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55f471ed855b] 2024-09-12T17:19:12.860 INFO:tasks.workunit.client.0.smithi016.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55f471ed9b44] 2024-09-12T17:19:12.860 INFO:tasks.workunit.client.0.smithi016.stderr: 10: main() 2024-09-12T17:19:12.860 INFO:tasks.workunit.client.0.smithi016.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0dcc64bd90] 2024-09-12T17:19:12.860 INFO:tasks.workunit.client.0.smithi016.stderr: 12: __libc_start_main() 2024-09-12T17:19:12.860 INFO:tasks.workunit.client.0.smithi016.stderr: 13: _start() 2024-09-12T17:19:12.860 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.831+0000 7f0dc9f0b9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:19:12.860 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7f0dc9f0b9c0 thread_name:radosgw-admin 2024-09-12T17:19:12.860 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:12.861 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:19:12.861 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f0dcc664520] 2024-09-12T17:19:12.861 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:19:12.861 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:19:12.861 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:19:12.861 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f0dcd7e5345] 2024-09-12T17:19:12.861 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0dcd7e549f] 2024-09-12T17:19:12.861 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f471ec70c1] 2024-09-12T17:19:12.861 INFO:tasks.workunit.client.0.smithi016.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55f471ed855b] 2024-09-12T17:19:12.861 INFO:tasks.workunit.client.0.smithi016.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55f471ed9b44] 2024-09-12T17:19:12.861 INFO:tasks.workunit.client.0.smithi016.stderr: 10: main() 2024-09-12T17:19:12.862 INFO:tasks.workunit.client.0.smithi016.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0dcc64bd90] 2024-09-12T17:19:12.862 INFO:tasks.workunit.client.0.smithi016.stderr: 12: __libc_start_main() 2024-09-12T17:19:12.862 INFO:tasks.workunit.client.0.smithi016.stderr: 13: _start() 2024-09-12T17:19:12.862 INFO:tasks.workunit.client.0.smithi016.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:19:12.862 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:12.862 INFO:tasks.workunit.client.0.smithi016.stderr:--- begin dump of recent events --- 2024-09-12T17:19:12.862 INFO:tasks.workunit.client.0.smithi016.stderr: -499> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 10 monclient: get_monmap_and_config success 2024-09-12T17:19:12.862 INFO:tasks.workunit.client.0.smithi016.stderr: -498> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 4 set_mon_vals no callback set 2024-09-12T17:19:12.862 INFO:tasks.workunit.client.0.smithi016.stderr: -497> 2024-09-12T17:19:12.735+0000 7f0cb5e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:19:12.862 INFO:tasks.workunit.client.0.smithi016.stderr: -496> 2024-09-12T17:19:12.735+0000 7f0cb5e0b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:19:12.862 INFO:tasks.workunit.client.0.smithi016.stderr: -495> 2024-09-12T17:19:12.735+0000 7f0cb5e0b640 10 monclient: dump: 2024-09-12T17:19:12.863 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:19:12.863 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:19:12.863 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:12.863 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:12.863 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:19:12.863 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:12.863 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:19:12.863 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:19:12.863 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:19:12.863 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:12.863 INFO:tasks.workunit.client.0.smithi016.stderr: -494> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 10 monclient: shutdown 2024-09-12T17:19:12.864 INFO:tasks.workunit.client.0.smithi016.stderr: -493> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 asok(0x55f47308b2b0) unregister_commands rotate-key 2024-09-12T17:19:12.864 INFO:tasks.workunit.client.0.smithi016.stderr: -492> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 10 monclient: build_initial_monmap 2024-09-12T17:19:12.864 INFO:tasks.workunit.client.0.smithi016.stderr: -491> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 1 build_initial for_mkfs: 0 2024-09-12T17:19:12.864 INFO:tasks.workunit.client.0.smithi016.stderr: -490> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 10 monclient: monmap: 2024-09-12T17:19:12.864 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:19:12.864 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:19:12.864 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:19:12.864 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:19:12.864 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:19:12.864 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:12.864 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:19:12.864 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:19:12.865 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:19:12.865 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:12.865 INFO:tasks.workunit.client.0.smithi016.stderr: -489> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473297f70) adding auth protocol: cephx 2024-09-12T17:19:12.865 INFO:tasks.workunit.client.0.smithi016.stderr: -488> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473297f70) adding auth protocol: cephx 2024-09-12T17:19:12.865 INFO:tasks.workunit.client.0.smithi016.stderr: -487> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473297f70) adding auth protocol: cephx 2024-09-12T17:19:12.865 INFO:tasks.workunit.client.0.smithi016.stderr: -486> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473297f70) adding con mode: secure 2024-09-12T17:19:12.865 INFO:tasks.workunit.client.0.smithi016.stderr: -485> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473297f70) adding con mode: crc 2024-09-12T17:19:12.865 INFO:tasks.workunit.client.0.smithi016.stderr: -484> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473297f70) adding con mode: secure 2024-09-12T17:19:12.865 INFO:tasks.workunit.client.0.smithi016.stderr: -483> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473297f70) adding con mode: crc 2024-09-12T17:19:12.865 INFO:tasks.workunit.client.0.smithi016.stderr: -482> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473297f70) adding con mode: secure 2024-09-12T17:19:12.865 INFO:tasks.workunit.client.0.smithi016.stderr: -481> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473297f70) adding con mode: crc 2024-09-12T17:19:12.865 INFO:tasks.workunit.client.0.smithi016.stderr: -480> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473297f70) adding con mode: crc 2024-09-12T17:19:12.866 INFO:tasks.workunit.client.0.smithi016.stderr: -479> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473297f70) adding con mode: secure 2024-09-12T17:19:12.866 INFO:tasks.workunit.client.0.smithi016.stderr: -478> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473297f70) adding con mode: crc 2024-09-12T17:19:12.866 INFO:tasks.workunit.client.0.smithi016.stderr: -477> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473297f70) adding con mode: secure 2024-09-12T17:19:12.866 INFO:tasks.workunit.client.0.smithi016.stderr: -476> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473297f70) adding con mode: crc 2024-09-12T17:19:12.866 INFO:tasks.workunit.client.0.smithi016.stderr: -475> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473297f70) adding con mode: secure 2024-09-12T17:19:12.866 INFO:tasks.workunit.client.0.smithi016.stderr: -474> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:12.866 INFO:tasks.workunit.client.0.smithi016.stderr: -473> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 1 librados: starting msgr at 2024-09-12T17:19:12.866 INFO:tasks.workunit.client.0.smithi016.stderr: -472> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 1 librados: starting objecter 2024-09-12T17:19:12.866 INFO:tasks.workunit.client.0.smithi016.stderr: -471> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 asok(0x55f47308b2b0) register_command objecter_requests hook 0x55f473297590 2024-09-12T17:19:12.866 INFO:tasks.workunit.client.0.smithi016.stderr: -470> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 1 librados: setting wanted keys 2024-09-12T17:19:12.866 INFO:tasks.workunit.client.0.smithi016.stderr: -469> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 1 librados: calling monclient init 2024-09-12T17:19:12.867 INFO:tasks.workunit.client.0.smithi016.stderr: -468> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 10 monclient: init 2024-09-12T17:19:12.867 INFO:tasks.workunit.client.0.smithi016.stderr: -467> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732928a0) adding auth protocol: cephx 2024-09-12T17:19:12.867 INFO:tasks.workunit.client.0.smithi016.stderr: -466> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732928a0) adding auth protocol: cephx 2024-09-12T17:19:12.867 INFO:tasks.workunit.client.0.smithi016.stderr: -465> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732928a0) adding auth protocol: cephx 2024-09-12T17:19:12.867 INFO:tasks.workunit.client.0.smithi016.stderr: -464> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732928a0) adding con mode: secure 2024-09-12T17:19:12.867 INFO:tasks.workunit.client.0.smithi016.stderr: -463> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732928a0) adding con mode: crc 2024-09-12T17:19:12.867 INFO:tasks.workunit.client.0.smithi016.stderr: -462> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732928a0) adding con mode: secure 2024-09-12T17:19:12.867 INFO:tasks.workunit.client.0.smithi016.stderr: -461> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732928a0) adding con mode: crc 2024-09-12T17:19:12.867 INFO:tasks.workunit.client.0.smithi016.stderr: -460> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732928a0) adding con mode: secure 2024-09-12T17:19:12.867 INFO:tasks.workunit.client.0.smithi016.stderr: -459> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732928a0) adding con mode: crc 2024-09-12T17:19:12.867 INFO:tasks.workunit.client.0.smithi016.stderr: -458> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732928a0) adding con mode: crc 2024-09-12T17:19:12.867 INFO:tasks.workunit.client.0.smithi016.stderr: -457> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732928a0) adding con mode: secure 2024-09-12T17:19:12.868 INFO:tasks.workunit.client.0.smithi016.stderr: -456> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732928a0) adding con mode: crc 2024-09-12T17:19:12.868 INFO:tasks.workunit.client.0.smithi016.stderr: -455> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732928a0) adding con mode: secure 2024-09-12T17:19:12.868 INFO:tasks.workunit.client.0.smithi016.stderr: -454> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732928a0) adding con mode: crc 2024-09-12T17:19:12.868 INFO:tasks.workunit.client.0.smithi016.stderr: -453> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732928a0) adding con mode: secure 2024-09-12T17:19:12.868 INFO:tasks.workunit.client.0.smithi016.stderr: -452> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:12.868 INFO:tasks.workunit.client.0.smithi016.stderr: -451> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:12.868 INFO:tasks.workunit.client.0.smithi016.stderr: -450> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 asok(0x55f47308b2b0) register_command rotate-key hook 0x55f4732929e8 2024-09-12T17:19:12.868 INFO:tasks.workunit.client.0.smithi016.stderr: -449> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:19:12.868 INFO:tasks.workunit.client.0.smithi016.stderr: -448> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:19:12.868 INFO:tasks.workunit.client.0.smithi016.stderr: -447> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 10 monclient(hunting): picked mon.noname-a con 0x55f473295930 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:19:12.868 INFO:tasks.workunit.client.0.smithi016.stderr: -446> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 10 monclient(hunting): picked mon.noname-b con 0x55f4732bbde0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:19:12.869 INFO:tasks.workunit.client.0.smithi016.stderr: -445> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 10 monclient(hunting): picked mon.noname-c con 0x7f0db0003be0 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:19:12.869 INFO:tasks.workunit.client.0.smithi016.stderr: -444> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:12.869 INFO:tasks.workunit.client.0.smithi016.stderr: -443> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:12.869 INFO:tasks.workunit.client.0.smithi016.stderr: -442> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:12.869 INFO:tasks.workunit.client.0.smithi016.stderr: -441> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:19:12.869 INFO:tasks.workunit.client.0.smithi016.stderr: -440> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 10 monclient(hunting): authenticate will time out at 2270.714169s 2024-09-12T17:19:12.869 INFO:tasks.workunit.client.0.smithi016.stderr: -439> 2024-09-12T17:19:12.735+0000 7f0dc8212640 10 monclient(hunting): get_auth_request con 0x7f0db0003be0 auth_method 0 2024-09-12T17:19:12.869 INFO:tasks.workunit.client.0.smithi016.stderr: -438> 2024-09-12T17:19:12.735+0000 7f0dc8212640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:19:12.869 INFO:tasks.workunit.client.0.smithi016.stderr: -437> 2024-09-12T17:19:12.735+0000 7f0dc8212640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:19:12.869 INFO:tasks.workunit.client.0.smithi016.stderr: -436> 2024-09-12T17:19:12.735+0000 7f0dc8212640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:19:12.869 INFO:tasks.workunit.client.0.smithi016.stderr: -435> 2024-09-12T17:19:12.735+0000 7f0dc8212640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:19:12.869 INFO:tasks.workunit.client.0.smithi016.stderr: -434> 2024-09-12T17:19:12.735+0000 7f0dc8212640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:19:12.870 INFO:tasks.workunit.client.0.smithi016.stderr: -433> 2024-09-12T17:19:12.735+0000 7f0dc8212640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:19:12.870 INFO:tasks.workunit.client.0.smithi016.stderr: -432> 2024-09-12T17:19:12.735+0000 7f0dc7a11640 10 monclient(hunting): get_auth_request con 0x55f473295930 auth_method 0 2024-09-12T17:19:12.870 INFO:tasks.workunit.client.0.smithi016.stderr: -431> 2024-09-12T17:19:12.735+0000 7f0dc7a11640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:19:12.870 INFO:tasks.workunit.client.0.smithi016.stderr: -430> 2024-09-12T17:19:12.735+0000 7f0dc7a11640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:19:12.870 INFO:tasks.workunit.client.0.smithi016.stderr: -429> 2024-09-12T17:19:12.735+0000 7f0dc7a11640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:19:12.870 INFO:tasks.workunit.client.0.smithi016.stderr: -428> 2024-09-12T17:19:12.735+0000 7f0dc8212640 10 monclient(hunting): handle_auth_done global_id 6716 payload 824 2024-09-12T17:19:12.870 INFO:tasks.workunit.client.0.smithi016.stderr: -427> 2024-09-12T17:19:12.735+0000 7f0dc8212640 10 monclient: _finish_hunting 0 2024-09-12T17:19:12.870 INFO:tasks.workunit.client.0.smithi016.stderr: -426> 2024-09-12T17:19:12.735+0000 7f0dc8212640 1 monclient: found mon.noname-c 2024-09-12T17:19:12.870 INFO:tasks.workunit.client.0.smithi016.stderr: -425> 2024-09-12T17:19:12.735+0000 7f0dc8212640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:19:12.870 INFO:tasks.workunit.client.0.smithi016.stderr: -424> 2024-09-12T17:19:12.735+0000 7f0caffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:19:12.870 INFO:tasks.workunit.client.0.smithi016.stderr: -423> 2024-09-12T17:19:12.735+0000 7f0caffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:19:12.870 INFO:tasks.workunit.client.0.smithi016.stderr: -422> 2024-09-12T17:19:12.735+0000 7f0caffff640 10 monclient: dump: 2024-09-12T17:19:12.871 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:19:12.871 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:19:12.871 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:12.871 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:12.871 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:19:12.871 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:12.871 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:19:12.871 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:19:12.871 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:19:12.871 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:12.871 INFO:tasks.workunit.client.0.smithi016.stderr: -421> 2024-09-12T17:19:12.735+0000 7f0caffff640 10 monclient: _finish_auth 0 2024-09-12T17:19:12.871 INFO:tasks.workunit.client.0.smithi016.stderr: -420> 2024-09-12T17:19:12.735+0000 7f0caffff640 10 monclient: _check_auth_tickets 2024-09-12T17:19:12.872 INFO:tasks.workunit.client.0.smithi016.stderr: -419> 2024-09-12T17:19:12.735+0000 7f0caffff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:19:12.872 INFO:tasks.workunit.client.0.smithi016.stderr: -418> 2024-09-12T17:19:12.735+0000 7f0caffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:19:12.872 INFO:tasks.workunit.client.0.smithi016.stderr: -417> 2024-09-12T17:19:12.735+0000 7f0caffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:19:12.872 INFO:tasks.workunit.client.0.smithi016.stderr: -416> 2024-09-12T17:19:12.735+0000 7f0caffff640 10 monclient: dump: 2024-09-12T17:19:12.872 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:19:12.872 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:19:12.872 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:12.872 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:12.872 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:19:12.872 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:12.872 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:19:12.873 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:19:12.873 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:19:12.873 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:12.873 INFO:tasks.workunit.client.0.smithi016.stderr: -415> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 monclient: authenticate success, global_id 6716 2024-09-12T17:19:12.873 INFO:tasks.workunit.client.0.smithi016.stderr: -414> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 10 monclient: _renew_subs 2024-09-12T17:19:12.873 INFO:tasks.workunit.client.0.smithi016.stderr: -413> 2024-09-12T17:19:12.735+0000 7f0cb5e0b640 4 set_mon_vals no callback set 2024-09-12T17:19:12.873 INFO:tasks.workunit.client.0.smithi016.stderr: -412> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:19:12.873 INFO:tasks.workunit.client.0.smithi016.stderr: -411> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 10 monclient: _renew_subs 2024-09-12T17:19:12.873 INFO:tasks.workunit.client.0.smithi016.stderr: -410> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:19:12.873 INFO:tasks.workunit.client.0.smithi016.stderr: -409> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 1 librados: init done 2024-09-12T17:19:12.873 INFO:tasks.workunit.client.0.smithi016.stderr: -408> 2024-09-12T17:19:12.739+0000 7f0caffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:19:12.874 INFO:tasks.workunit.client.0.smithi016.stderr: -407> 2024-09-12T17:19:12.739+0000 7f0caffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:19:12.874 INFO:tasks.workunit.client.0.smithi016.stderr: -406> 2024-09-12T17:19:12.739+0000 7f0caffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:19:12.874 INFO:tasks.workunit.client.0.smithi016.stderr: -405> 2024-09-12T17:19:12.739+0000 7f0dc7a11640 10 monclient: get_auth_request con 0x7f0cb0070b10 auth_method 0 2024-09-12T17:19:12.874 INFO:tasks.workunit.client.0.smithi016.stderr: -404> 2024-09-12T17:19:12.739+0000 7f0dc7210640 10 monclient: get_auth_request con 0x55f473295060 auth_method 0 2024-09-12T17:19:12.874 INFO:tasks.workunit.client.0.smithi016.stderr: -403> 2024-09-12T17:19:12.739+0000 7f0dc7a11640 10 monclient: get_auth_request con 0x55f4732dde30 auth_method 0 2024-09-12T17:19:12.874 INFO:tasks.workunit.client.0.smithi016.stderr: -402> 2024-09-12T17:19:12.743+0000 7f0dc7210640 10 monclient: get_auth_request con 0x55f4732e2020 auth_method 0 2024-09-12T17:19:12.874 INFO:tasks.workunit.client.0.smithi016.stderr: -401> 2024-09-12T17:19:12.743+0000 7f0dc8212640 10 monclient: get_auth_request con 0x55f4732e16b0 auth_method 0 2024-09-12T17:19:12.874 INFO:tasks.workunit.client.0.smithi016.stderr: -400> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 10 monclient: build_initial_monmap 2024-09-12T17:19:12.874 INFO:tasks.workunit.client.0.smithi016.stderr: -399> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 1 build_initial for_mkfs: 0 2024-09-12T17:19:12.874 INFO:tasks.workunit.client.0.smithi016.stderr: -398> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 10 monclient: monmap: 2024-09-12T17:19:12.874 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:19:12.874 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:19:12.875 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:19:12.875 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:19:12.875 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:19:12.875 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:12.875 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:19:12.875 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:19:12.875 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:19:12.875 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:12.875 INFO:tasks.workunit.client.0.smithi016.stderr: -397> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e9e90) adding auth protocol: cephx 2024-09-12T17:19:12.875 INFO:tasks.workunit.client.0.smithi016.stderr: -396> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e9e90) adding auth protocol: cephx 2024-09-12T17:19:12.875 INFO:tasks.workunit.client.0.smithi016.stderr: -395> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e9e90) adding auth protocol: cephx 2024-09-12T17:19:12.875 INFO:tasks.workunit.client.0.smithi016.stderr: -394> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e9e90) adding con mode: secure 2024-09-12T17:19:12.876 INFO:tasks.workunit.client.0.smithi016.stderr: -393> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e9e90) adding con mode: crc 2024-09-12T17:19:12.876 INFO:tasks.workunit.client.0.smithi016.stderr: -392> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e9e90) adding con mode: secure 2024-09-12T17:19:12.876 INFO:tasks.workunit.client.0.smithi016.stderr: -391> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e9e90) adding con mode: crc 2024-09-12T17:19:12.876 INFO:tasks.workunit.client.0.smithi016.stderr: -390> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e9e90) adding con mode: secure 2024-09-12T17:19:12.876 INFO:tasks.workunit.client.0.smithi016.stderr: -389> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e9e90) adding con mode: crc 2024-09-12T17:19:12.876 INFO:tasks.workunit.client.0.smithi016.stderr: -388> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e9e90) adding con mode: crc 2024-09-12T17:19:12.876 INFO:tasks.workunit.client.0.smithi016.stderr: -387> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e9e90) adding con mode: secure 2024-09-12T17:19:12.876 INFO:tasks.workunit.client.0.smithi016.stderr: -386> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e9e90) adding con mode: crc 2024-09-12T17:19:12.876 INFO:tasks.workunit.client.0.smithi016.stderr: -385> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e9e90) adding con mode: secure 2024-09-12T17:19:12.876 INFO:tasks.workunit.client.0.smithi016.stderr: -384> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e9e90) adding con mode: crc 2024-09-12T17:19:12.876 INFO:tasks.workunit.client.0.smithi016.stderr: -383> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e9e90) adding con mode: secure 2024-09-12T17:19:12.877 INFO:tasks.workunit.client.0.smithi016.stderr: -382> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:12.877 INFO:tasks.workunit.client.0.smithi016.stderr: -381> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 asok(0x55f47308b2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55f4732ed840 EEXIST 2024-09-12T17:19:12.877 INFO:tasks.workunit.client.0.smithi016.stderr: -380> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 10 monclient: init 2024-09-12T17:19:12.877 INFO:tasks.workunit.client.0.smithi016.stderr: -379> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e8e18) adding auth protocol: cephx 2024-09-12T17:19:12.877 INFO:tasks.workunit.client.0.smithi016.stderr: -378> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e8e18) adding auth protocol: cephx 2024-09-12T17:19:12.877 INFO:tasks.workunit.client.0.smithi016.stderr: -377> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e8e18) adding auth protocol: cephx 2024-09-12T17:19:12.877 INFO:tasks.workunit.client.0.smithi016.stderr: -376> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e8e18) adding con mode: secure 2024-09-12T17:19:12.877 INFO:tasks.workunit.client.0.smithi016.stderr: -375> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e8e18) adding con mode: crc 2024-09-12T17:19:12.877 INFO:tasks.workunit.client.0.smithi016.stderr: -374> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e8e18) adding con mode: secure 2024-09-12T17:19:12.877 INFO:tasks.workunit.client.0.smithi016.stderr: -373> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e8e18) adding con mode: crc 2024-09-12T17:19:12.877 INFO:tasks.workunit.client.0.smithi016.stderr: -372> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e8e18) adding con mode: secure 2024-09-12T17:19:12.877 INFO:tasks.workunit.client.0.smithi016.stderr: -371> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e8e18) adding con mode: crc 2024-09-12T17:19:12.878 INFO:tasks.workunit.client.0.smithi016.stderr: -370> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e8e18) adding con mode: crc 2024-09-12T17:19:12.878 INFO:tasks.workunit.client.0.smithi016.stderr: -369> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e8e18) adding con mode: secure 2024-09-12T17:19:12.878 INFO:tasks.workunit.client.0.smithi016.stderr: -368> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e8e18) adding con mode: crc 2024-09-12T17:19:12.878 INFO:tasks.workunit.client.0.smithi016.stderr: -367> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e8e18) adding con mode: secure 2024-09-12T17:19:12.878 INFO:tasks.workunit.client.0.smithi016.stderr: -366> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e8e18) adding con mode: crc 2024-09-12T17:19:12.878 INFO:tasks.workunit.client.0.smithi016.stderr: -365> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e8e18) adding con mode: secure 2024-09-12T17:19:12.878 INFO:tasks.workunit.client.0.smithi016.stderr: -364> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:12.878 INFO:tasks.workunit.client.0.smithi016.stderr: -363> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:12.878 INFO:tasks.workunit.client.0.smithi016.stderr: -362> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 asok(0x55f47308b2b0) register_command rotate-key cmddesc rotate-key hook 0x55f4732e8f60 EEXIST 2024-09-12T17:19:12.878 INFO:tasks.workunit.client.0.smithi016.stderr: -361> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:19:12.878 INFO:tasks.workunit.client.0.smithi016.stderr: -360> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:19:12.879 INFO:tasks.workunit.client.0.smithi016.stderr: -359> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 10 monclient(hunting): picked mon.noname-c con 0x55f4733119f0 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:19:12.879 INFO:tasks.workunit.client.0.smithi016.stderr: -358> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 10 monclient(hunting): picked mon.noname-a con 0x55f473311320 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:19:12.879 INFO:tasks.workunit.client.0.smithi016.stderr: -357> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 10 monclient(hunting): picked mon.noname-b con 0x55f47330fd00 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:19:12.879 INFO:tasks.workunit.client.0.smithi016.stderr: -356> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:12.879 INFO:tasks.workunit.client.0.smithi016.stderr: -355> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:12.879 INFO:tasks.workunit.client.0.smithi016.stderr: -354> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:12.879 INFO:tasks.workunit.client.0.smithi016.stderr: -353> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:19:12.879 INFO:tasks.workunit.client.0.smithi016.stderr: -352> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 10 monclient(hunting): authenticate will time out at 2270.726107s 2024-09-12T17:19:12.879 INFO:tasks.workunit.client.0.smithi016.stderr: -351> 2024-09-12T17:19:12.747+0000 7f0dc8212640 10 monclient(hunting): get_auth_request con 0x55f473311320 auth_method 0 2024-09-12T17:19:12.879 INFO:tasks.workunit.client.0.smithi016.stderr: -350> 2024-09-12T17:19:12.747+0000 7f0dc8212640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:19:12.879 INFO:tasks.workunit.client.0.smithi016.stderr: -349> 2024-09-12T17:19:12.747+0000 7f0dc8212640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:19:12.880 INFO:tasks.workunit.client.0.smithi016.stderr: -348> 2024-09-12T17:19:12.747+0000 7f0dc8212640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:19:12.880 INFO:tasks.workunit.client.0.smithi016.stderr: -347> 2024-09-12T17:19:12.747+0000 7f0dc7210640 10 monclient(hunting): get_auth_request con 0x55f4733119f0 auth_method 0 2024-09-12T17:19:12.880 INFO:tasks.workunit.client.0.smithi016.stderr: -346> 2024-09-12T17:19:12.747+0000 7f0dc7210640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:19:12.880 INFO:tasks.workunit.client.0.smithi016.stderr: -345> 2024-09-12T17:19:12.747+0000 7f0dc7210640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:19:12.880 INFO:tasks.workunit.client.0.smithi016.stderr: -344> 2024-09-12T17:19:12.747+0000 7f0dc7210640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:19:12.880 INFO:tasks.workunit.client.0.smithi016.stderr: -343> 2024-09-12T17:19:12.747+0000 7f0dc8212640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:19:12.880 INFO:tasks.workunit.client.0.smithi016.stderr: -342> 2024-09-12T17:19:12.747+0000 7f0dc8212640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:19:12.880 INFO:tasks.workunit.client.0.smithi016.stderr: -341> 2024-09-12T17:19:12.747+0000 7f0dc8212640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:19:12.880 INFO:tasks.workunit.client.0.smithi016.stderr: -340> 2024-09-12T17:19:12.747+0000 7f0dc7210640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:19:12.880 INFO:tasks.workunit.client.0.smithi016.stderr: -339> 2024-09-12T17:19:12.747+0000 7f0dc7210640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:19:12.880 INFO:tasks.workunit.client.0.smithi016.stderr: -338> 2024-09-12T17:19:12.747+0000 7f0dc7210640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:19:12.881 INFO:tasks.workunit.client.0.smithi016.stderr: -337> 2024-09-12T17:19:12.747+0000 7f0dc8212640 10 monclient(hunting): handle_auth_done global_id 7023 payload 824 2024-09-12T17:19:12.881 INFO:tasks.workunit.client.0.smithi016.stderr: -336> 2024-09-12T17:19:12.747+0000 7f0dc8212640 10 monclient: _finish_hunting 0 2024-09-12T17:19:12.881 INFO:tasks.workunit.client.0.smithi016.stderr: -335> 2024-09-12T17:19:12.747+0000 7f0dc8212640 1 monclient: found mon.noname-a 2024-09-12T17:19:12.881 INFO:tasks.workunit.client.0.smithi016.stderr: -334> 2024-09-12T17:19:12.747+0000 7f0dc8212640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:19:12.881 INFO:tasks.workunit.client.0.smithi016.stderr: -333> 2024-09-12T17:19:12.747+0000 7f0dc7a11640 10 monclient: get_auth_request con 0x55f47330fd00 auth_method 0 2024-09-12T17:19:12.881 INFO:tasks.workunit.client.0.smithi016.stderr: -332> 2024-09-12T17:19:12.747+0000 7f0cad7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:19:12.881 INFO:tasks.workunit.client.0.smithi016.stderr: -331> 2024-09-12T17:19:12.747+0000 7f0cad7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:19:12.881 INFO:tasks.workunit.client.0.smithi016.stderr: -330> 2024-09-12T17:19:12.747+0000 7f0cad7fa640 10 monclient: dump: 2024-09-12T17:19:12.881 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:19:12.881 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:19:12.881 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:12.882 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:12.882 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:19:12.882 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:12.882 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:19:12.882 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:19:12.882 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:19:12.882 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:12.882 INFO:tasks.workunit.client.0.smithi016.stderr: -329> 2024-09-12T17:19:12.747+0000 7f0cad7fa640 10 monclient: _finish_auth 0 2024-09-12T17:19:12.882 INFO:tasks.workunit.client.0.smithi016.stderr: -328> 2024-09-12T17:19:12.747+0000 7f0cad7fa640 10 monclient: _check_auth_tickets 2024-09-12T17:19:12.882 INFO:tasks.workunit.client.0.smithi016.stderr: -327> 2024-09-12T17:19:12.747+0000 7f0cad7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:19:12.882 INFO:tasks.workunit.client.0.smithi016.stderr: -326> 2024-09-12T17:19:12.747+0000 7f0cad7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:19:12.882 INFO:tasks.workunit.client.0.smithi016.stderr: -325> 2024-09-12T17:19:12.747+0000 7f0cad7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:19:12.883 INFO:tasks.workunit.client.0.smithi016.stderr: -324> 2024-09-12T17:19:12.747+0000 7f0cad7fa640 10 monclient: dump: 2024-09-12T17:19:12.883 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:19:12.883 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:19:12.883 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:12.883 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:12.883 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:19:12.883 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:12.883 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:19:12.883 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:19:12.883 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:19:12.883 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:12.884 INFO:tasks.workunit.client.0.smithi016.stderr: -323> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 monclient: authenticate success, global_id 7023 2024-09-12T17:19:12.884 INFO:tasks.workunit.client.0.smithi016.stderr: -322> 2024-09-12T17:19:12.747+0000 7f0dc6a0f640 4 set_mon_vals no callback set 2024-09-12T17:19:12.884 INFO:tasks.workunit.client.0.smithi016.stderr: -321> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 10 monclient: _renew_subs 2024-09-12T17:19:12.884 INFO:tasks.workunit.client.0.smithi016.stderr: -320> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:19:12.884 INFO:tasks.workunit.client.0.smithi016.stderr: -319> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 10 monclient: _renew_subs 2024-09-12T17:19:12.884 INFO:tasks.workunit.client.0.smithi016.stderr: -318> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:19:12.884 INFO:tasks.workunit.client.0.smithi016.stderr: -317> 2024-09-12T17:19:12.751+0000 7f0cad7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:19:12.884 INFO:tasks.workunit.client.0.smithi016.stderr: -316> 2024-09-12T17:19:12.751+0000 7f0cad7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:19:12.884 INFO:tasks.workunit.client.0.smithi016.stderr: -315> 2024-09-12T17:19:12.751+0000 7f0cad7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:19:12.884 INFO:tasks.workunit.client.0.smithi016.stderr: -314> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 10 monclient: get_monmap_and_config 2024-09-12T17:19:12.885 INFO:tasks.workunit.client.0.smithi016.stderr: -313> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 10 monclient: build_initial_monmap 2024-09-12T17:19:12.885 INFO:tasks.workunit.client.0.smithi016.stderr: -312> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 1 build_initial for_mkfs: 0 2024-09-12T17:19:12.885 INFO:tasks.workunit.client.0.smithi016.stderr: -311> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 10 monclient: monmap: 2024-09-12T17:19:12.885 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:19:12.885 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:19:12.885 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:19:12.885 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:19:12.885 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:19:12.885 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:12.885 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:19:12.885 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:19:12.886 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:19:12.886 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:12.886 INFO:tasks.workunit.client.0.smithi016.stderr: -310> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473330c70) adding auth protocol: cephx 2024-09-12T17:19:12.886 INFO:tasks.workunit.client.0.smithi016.stderr: -309> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473330c70) adding auth protocol: cephx 2024-09-12T17:19:12.886 INFO:tasks.workunit.client.0.smithi016.stderr: -308> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473330c70) adding auth protocol: cephx 2024-09-12T17:19:12.886 INFO:tasks.workunit.client.0.smithi016.stderr: -307> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473330c70) adding con mode: secure 2024-09-12T17:19:12.886 INFO:tasks.workunit.client.0.smithi016.stderr: -306> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473330c70) adding con mode: crc 2024-09-12T17:19:12.886 INFO:tasks.workunit.client.0.smithi016.stderr: -305> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473330c70) adding con mode: secure 2024-09-12T17:19:12.886 INFO:tasks.workunit.client.0.smithi016.stderr: -304> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473330c70) adding con mode: crc 2024-09-12T17:19:12.886 INFO:tasks.workunit.client.0.smithi016.stderr: -303> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473330c70) adding con mode: secure 2024-09-12T17:19:12.886 INFO:tasks.workunit.client.0.smithi016.stderr: -302> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473330c70) adding con mode: crc 2024-09-12T17:19:12.887 INFO:tasks.workunit.client.0.smithi016.stderr: -301> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473330c70) adding con mode: crc 2024-09-12T17:19:12.887 INFO:tasks.workunit.client.0.smithi016.stderr: -300> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473330c70) adding con mode: secure 2024-09-12T17:19:12.887 INFO:tasks.workunit.client.0.smithi016.stderr: -299> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473330c70) adding con mode: crc 2024-09-12T17:19:12.887 INFO:tasks.workunit.client.0.smithi016.stderr: -298> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473330c70) adding con mode: secure 2024-09-12T17:19:12.887 INFO:tasks.workunit.client.0.smithi016.stderr: -297> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473330c70) adding con mode: crc 2024-09-12T17:19:12.887 INFO:tasks.workunit.client.0.smithi016.stderr: -296> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473330c70) adding con mode: secure 2024-09-12T17:19:12.887 INFO:tasks.workunit.client.0.smithi016.stderr: -295> 2024-09-12T17:19:12.751+0000 7f0dc7210640 10 monclient: get_auth_request con 0x7f0ca0070a20 auth_method 0 2024-09-12T17:19:12.887 INFO:tasks.workunit.client.0.smithi016.stderr: -294> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:12.887 INFO:tasks.workunit.client.0.smithi016.stderr: -293> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 10 monclient: init 2024-09-12T17:19:12.887 INFO:tasks.workunit.client.0.smithi016.stderr: -292> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848f8f0) adding auth protocol: cephx 2024-09-12T17:19:12.887 INFO:tasks.workunit.client.0.smithi016.stderr: -291> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848f8f0) adding auth protocol: cephx 2024-09-12T17:19:12.888 INFO:tasks.workunit.client.0.smithi016.stderr: -290> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848f8f0) adding auth protocol: cephx 2024-09-12T17:19:12.888 INFO:tasks.workunit.client.0.smithi016.stderr: -289> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848f8f0) adding con mode: secure 2024-09-12T17:19:12.888 INFO:tasks.workunit.client.0.smithi016.stderr: -288> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848f8f0) adding con mode: crc 2024-09-12T17:19:12.888 INFO:tasks.workunit.client.0.smithi016.stderr: -287> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848f8f0) adding con mode: secure 2024-09-12T17:19:12.888 INFO:tasks.workunit.client.0.smithi016.stderr: -286> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848f8f0) adding con mode: crc 2024-09-12T17:19:12.888 INFO:tasks.workunit.client.0.smithi016.stderr: -285> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848f8f0) adding con mode: secure 2024-09-12T17:19:12.888 INFO:tasks.workunit.client.0.smithi016.stderr: -284> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848f8f0) adding con mode: crc 2024-09-12T17:19:12.888 INFO:tasks.workunit.client.0.smithi016.stderr: -283> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848f8f0) adding con mode: crc 2024-09-12T17:19:12.888 INFO:tasks.workunit.client.0.smithi016.stderr: -282> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848f8f0) adding con mode: secure 2024-09-12T17:19:12.888 INFO:tasks.workunit.client.0.smithi016.stderr: -281> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848f8f0) adding con mode: crc 2024-09-12T17:19:12.888 INFO:tasks.workunit.client.0.smithi016.stderr: -280> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848f8f0) adding con mode: secure 2024-09-12T17:19:12.889 INFO:tasks.workunit.client.0.smithi016.stderr: -279> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848f8f0) adding con mode: crc 2024-09-12T17:19:12.889 INFO:tasks.workunit.client.0.smithi016.stderr: -278> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848f8f0) adding con mode: secure 2024-09-12T17:19:12.889 INFO:tasks.workunit.client.0.smithi016.stderr: -277> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:12.889 INFO:tasks.workunit.client.0.smithi016.stderr: -276> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:12.889 INFO:tasks.workunit.client.0.smithi016.stderr: -275> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 asok(0x55f47308b2b0) register_command rotate-key cmddesc rotate-key hook 0x7fff1848fa38 EEXIST 2024-09-12T17:19:12.889 INFO:tasks.workunit.client.0.smithi016.stderr: -274> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:19:12.889 INFO:tasks.workunit.client.0.smithi016.stderr: -273> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:19:12.889 INFO:tasks.workunit.client.0.smithi016.stderr: -272> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 10 monclient(hunting): picked mon.noname-b con 0x55f473364e50 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:19:12.889 INFO:tasks.workunit.client.0.smithi016.stderr: -271> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 10 monclient(hunting): picked mon.noname-a con 0x55f473365230 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:19:12.889 INFO:tasks.workunit.client.0.smithi016.stderr: -270> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 10 monclient(hunting): picked mon.noname-c con 0x55f473360a10 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:19:12.889 INFO:tasks.workunit.client.0.smithi016.stderr: -269> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:12.890 INFO:tasks.workunit.client.0.smithi016.stderr: -268> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:12.890 INFO:tasks.workunit.client.0.smithi016.stderr: -267> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:12.890 INFO:tasks.workunit.client.0.smithi016.stderr: -266> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:19:12.890 INFO:tasks.workunit.client.0.smithi016.stderr: -265> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 10 monclient(hunting): authenticate will time out at 2270.730465s 2024-09-12T17:19:12.890 INFO:tasks.workunit.client.0.smithi016.stderr: -264> 2024-09-12T17:19:12.751+0000 7f0dc8212640 10 monclient(hunting): get_auth_request con 0x55f473365230 auth_method 0 2024-09-12T17:19:12.890 INFO:tasks.workunit.client.0.smithi016.stderr: -263> 2024-09-12T17:19:12.751+0000 7f0dc8212640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:19:12.890 INFO:tasks.workunit.client.0.smithi016.stderr: -262> 2024-09-12T17:19:12.751+0000 7f0dc8212640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:19:12.890 INFO:tasks.workunit.client.0.smithi016.stderr: -261> 2024-09-12T17:19:12.751+0000 7f0dc8212640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:19:12.890 INFO:tasks.workunit.client.0.smithi016.stderr: -260> 2024-09-12T17:19:12.751+0000 7f0dc7a11640 10 monclient(hunting): get_auth_request con 0x55f473360a10 auth_method 0 2024-09-12T17:19:12.890 INFO:tasks.workunit.client.0.smithi016.stderr: -259> 2024-09-12T17:19:12.751+0000 7f0dc7a11640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:19:12.890 INFO:tasks.workunit.client.0.smithi016.stderr: -258> 2024-09-12T17:19:12.751+0000 7f0dc7a11640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:19:12.891 INFO:tasks.workunit.client.0.smithi016.stderr: -257> 2024-09-12T17:19:12.751+0000 7f0dc7a11640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:19:12.891 INFO:tasks.workunit.client.0.smithi016.stderr: -256> 2024-09-12T17:19:12.751+0000 7f0dc8212640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:19:12.891 INFO:tasks.workunit.client.0.smithi016.stderr: -255> 2024-09-12T17:19:12.751+0000 7f0dc8212640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:19:12.891 INFO:tasks.workunit.client.0.smithi016.stderr: -254> 2024-09-12T17:19:12.751+0000 7f0dc8212640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:19:12.891 INFO:tasks.workunit.client.0.smithi016.stderr: -253> 2024-09-12T17:19:12.751+0000 7f0dc7a11640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:19:12.891 INFO:tasks.workunit.client.0.smithi016.stderr: -252> 2024-09-12T17:19:12.751+0000 7f0dc7a11640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:19:12.891 INFO:tasks.workunit.client.0.smithi016.stderr: -251> 2024-09-12T17:19:12.751+0000 7f0dc7a11640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:19:12.891 INFO:tasks.workunit.client.0.smithi016.stderr: -250> 2024-09-12T17:19:12.751+0000 7f0dc7a11640 10 monclient(hunting): handle_auth_done global_id 6722 payload 274 2024-09-12T17:19:12.891 INFO:tasks.workunit.client.0.smithi016.stderr: -249> 2024-09-12T17:19:12.751+0000 7f0dc7a11640 10 monclient: _finish_hunting 0 2024-09-12T17:19:12.891 INFO:tasks.workunit.client.0.smithi016.stderr: -248> 2024-09-12T17:19:12.751+0000 7f0dc7a11640 1 monclient: found mon.noname-c 2024-09-12T17:19:12.891 INFO:tasks.workunit.client.0.smithi016.stderr: -247> 2024-09-12T17:19:12.751+0000 7f0dc7a11640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:19:12.892 INFO:tasks.workunit.client.0.smithi016.stderr: -246> 2024-09-12T17:19:12.751+0000 7f0ca6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:19:12.892 INFO:tasks.workunit.client.0.smithi016.stderr: -245> 2024-09-12T17:19:12.751+0000 7f0ca6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:19:12.892 INFO:tasks.workunit.client.0.smithi016.stderr: -244> 2024-09-12T17:19:12.751+0000 7f0ca6ffd640 10 monclient: dump: 2024-09-12T17:19:12.892 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:19:12.892 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:19:12.892 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:12.892 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:12.892 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:19:12.892 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:12.892 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:19:12.892 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:19:12.893 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:19:12.893 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:12.893 INFO:tasks.workunit.client.0.smithi016.stderr: -243> 2024-09-12T17:19:12.751+0000 7f0ca6ffd640 10 monclient: _finish_auth 0 2024-09-12T17:19:12.893 INFO:tasks.workunit.client.0.smithi016.stderr: -242> 2024-09-12T17:19:12.751+0000 7f0ca6ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:19:12.893 INFO:tasks.workunit.client.0.smithi016.stderr: -241> 2024-09-12T17:19:12.751+0000 7f0ca6ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:19:12.893 INFO:tasks.workunit.client.0.smithi016.stderr: -240> 2024-09-12T17:19:12.751+0000 7f0ca6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:19:12.893 INFO:tasks.workunit.client.0.smithi016.stderr: -239> 2024-09-12T17:19:12.751+0000 7f0ca6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:19:12.894 INFO:tasks.workunit.client.0.smithi016.stderr: -238> 2024-09-12T17:19:12.751+0000 7f0ca6ffd640 10 monclient: dump: 2024-09-12T17:19:12.894 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:19:12.894 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:19:12.894 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:12.894 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:12.894 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:19:12.894 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:12.894 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:19:12.894 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:19:12.894 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:19:12.894 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:12.895 INFO:tasks.workunit.client.0.smithi016.stderr: -237> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 monclient: authenticate success, global_id 6722 2024-09-12T17:19:12.895 INFO:tasks.workunit.client.0.smithi016.stderr: -236> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 10 monclient: get_monmap_and_config success 2024-09-12T17:19:12.895 INFO:tasks.workunit.client.0.smithi016.stderr: -235> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 4 set_mon_vals no callback set 2024-09-12T17:19:12.895 INFO:tasks.workunit.client.0.smithi016.stderr: -234> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 10 monclient: shutdown 2024-09-12T17:19:12.895 INFO:tasks.workunit.client.0.smithi016.stderr: -233> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 10 monclient: build_initial_monmap 2024-09-12T17:19:12.895 INFO:tasks.workunit.client.0.smithi016.stderr: -232> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 1 build_initial for_mkfs: 0 2024-09-12T17:19:12.895 INFO:tasks.workunit.client.0.smithi016.stderr: -231> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 10 monclient: monmap: 2024-09-12T17:19:12.895 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:19:12.895 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:19:12.895 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:19:12.895 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:19:12.895 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:19:12.896 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:12.896 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:19:12.896 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:19:12.896 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:19:12.896 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:12.896 INFO:tasks.workunit.client.0.smithi016.stderr: -230> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473355690) adding auth protocol: cephx 2024-09-12T17:19:12.896 INFO:tasks.workunit.client.0.smithi016.stderr: -229> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473355690) adding auth protocol: cephx 2024-09-12T17:19:12.896 INFO:tasks.workunit.client.0.smithi016.stderr: -228> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473355690) adding auth protocol: cephx 2024-09-12T17:19:12.896 INFO:tasks.workunit.client.0.smithi016.stderr: -227> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473355690) adding con mode: secure 2024-09-12T17:19:12.896 INFO:tasks.workunit.client.0.smithi016.stderr: -226> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473355690) adding con mode: crc 2024-09-12T17:19:12.896 INFO:tasks.workunit.client.0.smithi016.stderr: -225> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473355690) adding con mode: secure 2024-09-12T17:19:12.896 INFO:tasks.workunit.client.0.smithi016.stderr: -224> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473355690) adding con mode: crc 2024-09-12T17:19:12.897 INFO:tasks.workunit.client.0.smithi016.stderr: -223> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473355690) adding con mode: secure 2024-09-12T17:19:12.897 INFO:tasks.workunit.client.0.smithi016.stderr: -222> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473355690) adding con mode: crc 2024-09-12T17:19:12.897 INFO:tasks.workunit.client.0.smithi016.stderr: -221> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473355690) adding con mode: crc 2024-09-12T17:19:12.897 INFO:tasks.workunit.client.0.smithi016.stderr: -220> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473355690) adding con mode: secure 2024-09-12T17:19:12.897 INFO:tasks.workunit.client.0.smithi016.stderr: -219> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473355690) adding con mode: crc 2024-09-12T17:19:12.897 INFO:tasks.workunit.client.0.smithi016.stderr: -218> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473355690) adding con mode: secure 2024-09-12T17:19:12.897 INFO:tasks.workunit.client.0.smithi016.stderr: -217> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473355690) adding con mode: crc 2024-09-12T17:19:12.897 INFO:tasks.workunit.client.0.smithi016.stderr: -216> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473355690) adding con mode: secure 2024-09-12T17:19:12.897 INFO:tasks.workunit.client.0.smithi016.stderr: -215> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:12.897 INFO:tasks.workunit.client.0.smithi016.stderr: -214> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 1 librados: starting msgr at 2024-09-12T17:19:12.897 INFO:tasks.workunit.client.0.smithi016.stderr: -213> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 1 librados: starting objecter 2024-09-12T17:19:12.898 INFO:tasks.workunit.client.0.smithi016.stderr: -212> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 asok(0x55f47308b2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55f4732c6d10 EEXIST 2024-09-12T17:19:12.898 INFO:tasks.workunit.client.0.smithi016.stderr: -211> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 1 librados: setting wanted keys 2024-09-12T17:19:12.898 INFO:tasks.workunit.client.0.smithi016.stderr: -210> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 1 librados: calling monclient init 2024-09-12T17:19:12.898 INFO:tasks.workunit.client.0.smithi016.stderr: -209> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 10 monclient: init 2024-09-12T17:19:12.898 INFO:tasks.workunit.client.0.smithi016.stderr: -208> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473313810) adding auth protocol: cephx 2024-09-12T17:19:12.898 INFO:tasks.workunit.client.0.smithi016.stderr: -207> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473313810) adding auth protocol: cephx 2024-09-12T17:19:12.898 INFO:tasks.workunit.client.0.smithi016.stderr: -206> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473313810) adding auth protocol: cephx 2024-09-12T17:19:12.898 INFO:tasks.workunit.client.0.smithi016.stderr: -205> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473313810) adding con mode: secure 2024-09-12T17:19:12.898 INFO:tasks.workunit.client.0.smithi016.stderr: -204> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473313810) adding con mode: crc 2024-09-12T17:19:12.898 INFO:tasks.workunit.client.0.smithi016.stderr: -203> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473313810) adding con mode: secure 2024-09-12T17:19:12.898 INFO:tasks.workunit.client.0.smithi016.stderr: -202> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473313810) adding con mode: crc 2024-09-12T17:19:12.898 INFO:tasks.workunit.client.0.smithi016.stderr: -201> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473313810) adding con mode: secure 2024-09-12T17:19:12.899 INFO:tasks.workunit.client.0.smithi016.stderr: -200> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473313810) adding con mode: crc 2024-09-12T17:19:12.899 INFO:tasks.workunit.client.0.smithi016.stderr: -199> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473313810) adding con mode: crc 2024-09-12T17:19:12.899 INFO:tasks.workunit.client.0.smithi016.stderr: -198> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473313810) adding con mode: secure 2024-09-12T17:19:12.899 INFO:tasks.workunit.client.0.smithi016.stderr: -197> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473313810) adding con mode: crc 2024-09-12T17:19:12.899 INFO:tasks.workunit.client.0.smithi016.stderr: -196> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473313810) adding con mode: secure 2024-09-12T17:19:12.899 INFO:tasks.workunit.client.0.smithi016.stderr: -195> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473313810) adding con mode: crc 2024-09-12T17:19:12.899 INFO:tasks.workunit.client.0.smithi016.stderr: -194> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473313810) adding con mode: secure 2024-09-12T17:19:12.899 INFO:tasks.workunit.client.0.smithi016.stderr: -193> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:12.899 INFO:tasks.workunit.client.0.smithi016.stderr: -192> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:12.899 INFO:tasks.workunit.client.0.smithi016.stderr: -191> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 asok(0x55f47308b2b0) register_command rotate-key cmddesc rotate-key hook 0x55f473313958 EEXIST 2024-09-12T17:19:12.899 INFO:tasks.workunit.client.0.smithi016.stderr: -190> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:19:12.899 INFO:tasks.workunit.client.0.smithi016.stderr: -189> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:19:12.900 INFO:tasks.workunit.client.0.smithi016.stderr: -188> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 10 monclient(hunting): picked mon.noname-c con 0x55f473360a10 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:19:12.900 INFO:tasks.workunit.client.0.smithi016.stderr: -187> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 10 monclient(hunting): picked mon.noname-a con 0x55f473364e50 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:19:12.900 INFO:tasks.workunit.client.0.smithi016.stderr: -186> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 10 monclient(hunting): picked mon.noname-b con 0x55f473372b20 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:19:12.900 INFO:tasks.workunit.client.0.smithi016.stderr: -185> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:12.900 INFO:tasks.workunit.client.0.smithi016.stderr: -184> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:12.900 INFO:tasks.workunit.client.0.smithi016.stderr: -183> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:12.900 INFO:tasks.workunit.client.0.smithi016.stderr: -182> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:19:12.900 INFO:tasks.workunit.client.0.smithi016.stderr: -181> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 10 monclient(hunting): authenticate will time out at 2270.733139s 2024-09-12T17:19:12.900 INFO:tasks.workunit.client.0.smithi016.stderr: -180> 2024-09-12T17:19:12.755+0000 7f0dc8212640 10 monclient(hunting): get_auth_request con 0x55f473364e50 auth_method 0 2024-09-12T17:19:12.900 INFO:tasks.workunit.client.0.smithi016.stderr: -179> 2024-09-12T17:19:12.755+0000 7f0dc8212640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:19:12.901 INFO:tasks.workunit.client.0.smithi016.stderr: -178> 2024-09-12T17:19:12.755+0000 7f0dc8212640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:19:12.901 INFO:tasks.workunit.client.0.smithi016.stderr: -177> 2024-09-12T17:19:12.755+0000 7f0dc8212640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:19:12.901 INFO:tasks.workunit.client.0.smithi016.stderr: -176> 2024-09-12T17:19:12.755+0000 7f0dc7210640 10 monclient(hunting): get_auth_request con 0x55f473360a10 auth_method 0 2024-09-12T17:19:12.901 INFO:tasks.workunit.client.0.smithi016.stderr: -175> 2024-09-12T17:19:12.755+0000 7f0dc7210640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:19:12.901 INFO:tasks.workunit.client.0.smithi016.stderr: -174> 2024-09-12T17:19:12.755+0000 7f0dc7210640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:19:12.901 INFO:tasks.workunit.client.0.smithi016.stderr: -173> 2024-09-12T17:19:12.755+0000 7f0dc7210640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:19:12.901 INFO:tasks.workunit.client.0.smithi016.stderr: -172> 2024-09-12T17:19:12.755+0000 7f0dc8212640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:19:12.901 INFO:tasks.workunit.client.0.smithi016.stderr: -171> 2024-09-12T17:19:12.755+0000 7f0dc8212640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:19:12.901 INFO:tasks.workunit.client.0.smithi016.stderr: -170> 2024-09-12T17:19:12.755+0000 7f0dc8212640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:19:12.901 INFO:tasks.workunit.client.0.smithi016.stderr: -169> 2024-09-12T17:19:12.755+0000 7f0dc7210640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:19:12.901 INFO:tasks.workunit.client.0.smithi016.stderr: -168> 2024-09-12T17:19:12.755+0000 7f0dc7210640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:19:12.902 INFO:tasks.workunit.client.0.smithi016.stderr: -167> 2024-09-12T17:19:12.755+0000 7f0dc7210640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:19:12.902 INFO:tasks.workunit.client.0.smithi016.stderr: -166> 2024-09-12T17:19:12.755+0000 7f0dc8212640 10 monclient(hunting): handle_auth_done global_id 7029 payload 824 2024-09-12T17:19:12.902 INFO:tasks.workunit.client.0.smithi016.stderr: -165> 2024-09-12T17:19:12.755+0000 7f0dc8212640 10 monclient: _finish_hunting 0 2024-09-12T17:19:12.902 INFO:tasks.workunit.client.0.smithi016.stderr: -164> 2024-09-12T17:19:12.755+0000 7f0dc8212640 1 monclient: found mon.noname-a 2024-09-12T17:19:12.902 INFO:tasks.workunit.client.0.smithi016.stderr: -163> 2024-09-12T17:19:12.755+0000 7f0dc8212640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:19:12.902 INFO:tasks.workunit.client.0.smithi016.stderr: -162> 2024-09-12T17:19:12.755+0000 7f0ca57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:19:12.902 INFO:tasks.workunit.client.0.smithi016.stderr: -161> 2024-09-12T17:19:12.755+0000 7f0ca57fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:19:12.902 INFO:tasks.workunit.client.0.smithi016.stderr: -160> 2024-09-12T17:19:12.755+0000 7f0ca57fa640 10 monclient: dump: 2024-09-12T17:19:12.902 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:19:12.902 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:19:12.902 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:12.902 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:12.903 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:19:12.903 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:12.903 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:19:12.903 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:19:12.903 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:19:12.903 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:12.903 INFO:tasks.workunit.client.0.smithi016.stderr: -159> 2024-09-12T17:19:12.755+0000 7f0ca57fa640 10 monclient: _finish_auth 0 2024-09-12T17:19:12.903 INFO:tasks.workunit.client.0.smithi016.stderr: -158> 2024-09-12T17:19:12.755+0000 7f0ca57fa640 10 monclient: _check_auth_tickets 2024-09-12T17:19:12.903 INFO:tasks.workunit.client.0.smithi016.stderr: -157> 2024-09-12T17:19:12.755+0000 7f0ca57fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:19:12.903 INFO:tasks.workunit.client.0.smithi016.stderr: -156> 2024-09-12T17:19:12.755+0000 7f0ca57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:19:12.903 INFO:tasks.workunit.client.0.smithi016.stderr: -155> 2024-09-12T17:19:12.755+0000 7f0ca57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:19:12.904 INFO:tasks.workunit.client.0.smithi016.stderr: -154> 2024-09-12T17:19:12.755+0000 7f0ca57fa640 10 monclient: dump: 2024-09-12T17:19:12.904 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:19:12.904 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:19:12.904 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:12.904 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:12.904 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:19:12.904 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:12.904 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:19:12.904 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:19:12.904 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:19:12.904 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:12.904 INFO:tasks.workunit.client.0.smithi016.stderr: -153> 2024-09-12T17:19:12.755+0000 7f0ca6ffd640 4 set_mon_vals no callback set 2024-09-12T17:19:12.905 INFO:tasks.workunit.client.0.smithi016.stderr: -152> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 monclient: authenticate success, global_id 7029 2024-09-12T17:19:12.905 INFO:tasks.workunit.client.0.smithi016.stderr: -151> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 10 monclient: _renew_subs 2024-09-12T17:19:12.905 INFO:tasks.workunit.client.0.smithi016.stderr: -150> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:19:12.905 INFO:tasks.workunit.client.0.smithi016.stderr: -149> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 10 monclient: _renew_subs 2024-09-12T17:19:12.905 INFO:tasks.workunit.client.0.smithi016.stderr: -148> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:19:12.905 INFO:tasks.workunit.client.0.smithi016.stderr: -147> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 1 librados: init done 2024-09-12T17:19:12.905 INFO:tasks.workunit.client.0.smithi016.stderr: -146> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 asok(0x55f47308b2b0) register_command cr dump hook 0x55f47335afc8 2024-09-12T17:19:12.905 INFO:tasks.workunit.client.0.smithi016.stderr: -145> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.905 INFO:tasks.workunit.client.0.smithi016.stderr: -144> 2024-09-12T17:19:12.759+0000 7f0ca57fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:19:12.905 INFO:tasks.workunit.client.0.smithi016.stderr: -143> 2024-09-12T17:19:12.759+0000 7f0ca57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:19:12.905 INFO:tasks.workunit.client.0.smithi016.stderr: -142> 2024-09-12T17:19:12.759+0000 7f0ca57fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:19:12.906 INFO:tasks.workunit.client.0.smithi016.stderr: -141> 2024-09-12T17:19:12.759+0000 7f0dc7a11640 10 monclient: get_auth_request con 0x55f47337e900 auth_method 0 2024-09-12T17:19:12.906 INFO:tasks.workunit.client.0.smithi016.stderr: -140> 2024-09-12T17:19:12.759+0000 7f0dc7210640 10 monclient: get_auth_request con 0x7f0c90070b10 auth_method 0 2024-09-12T17:19:12.906 INFO:tasks.workunit.client.0.smithi016.stderr: -139> 2024-09-12T17:19:12.759+0000 7f0dc9f0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:12.906 INFO:tasks.workunit.client.0.smithi016.stderr: -138> 2024-09-12T17:19:12.759+0000 7f0dc9f0b9c0 20 realm 2024-09-12T17:19:12.906 INFO:tasks.workunit.client.0.smithi016.stderr: -137> 2024-09-12T17:19:12.759+0000 7f0dc9f0b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.906 INFO:tasks.workunit.client.0.smithi016.stderr: -136> 2024-09-12T17:19:12.759+0000 7f0dc9f0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:12.906 INFO:tasks.workunit.client.0.smithi016.stderr: -135> 2024-09-12T17:19:12.759+0000 7f0dc9f0b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:19:12.906 INFO:tasks.workunit.client.0.smithi016.stderr: -134> 2024-09-12T17:19:12.759+0000 7f0dc9f0b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.906 INFO:tasks.workunit.client.0.smithi016.stderr: -133> 2024-09-12T17:19:12.759+0000 7f0dc9f0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:12.906 INFO:tasks.workunit.client.0.smithi016.stderr: -132> 2024-09-12T17:19:12.759+0000 7f0dc9f0b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.906 INFO:tasks.workunit.client.0.smithi016.stderr: -131> 2024-09-12T17:19:12.759+0000 7f0dc7210640 10 monclient: get_auth_request con 0x55f473382bc0 auth_method 0 2024-09-12T17:19:12.906 INFO:tasks.workunit.client.0.smithi016.stderr: -130> 2024-09-12T17:19:12.759+0000 7f0dc9f0b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:12.907 INFO:tasks.workunit.client.0.smithi016.stderr: -129> 2024-09-12T17:19:12.759+0000 7f0dc9f0b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.907 INFO:tasks.workunit.client.0.smithi016.stderr: -128> 2024-09-12T17:19:12.763+0000 7f0dc8212640 10 monclient: get_auth_request con 0x55f473386450 auth_method 0 2024-09-12T17:19:12.907 INFO:tasks.workunit.client.0.smithi016.stderr: -127> 2024-09-12T17:19:12.763+0000 7f0dc9f0b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:19:12.907 INFO:tasks.workunit.client.0.smithi016.stderr: -126> 2024-09-12T17:19:12.763+0000 7f0dc9f0b9c0 20 searching for the correct realm 2024-09-12T17:19:12.907 INFO:tasks.workunit.client.0.smithi016.stderr: -125> 2024-09-12T17:19:12.763+0000 7f0dc7a11640 10 monclient: get_auth_request con 0x55f47338b1f0 auth_method 0 2024-09-12T17:19:12.907 INFO:tasks.workunit.client.0.smithi016.stderr: -124> 2024-09-12T17:19:12.763+0000 7f0dc7210640 10 monclient: get_auth_request con 0x7f0db8028040 auth_method 0 2024-09-12T17:19:12.907 INFO:tasks.workunit.client.0.smithi016.stderr: -123> 2024-09-12T17:19:12.763+0000 7f0dc7210640 0 -- 172.21.15.16:0/3305785925 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7f0db8028040 msgr2=0x7f0db8040400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:19:12.907 INFO:tasks.workunit.client.0.smithi016.stderr: -122> 2024-09-12T17:19:12.763+0000 7f0ca57fa640 1 client.7029.objecter ms_handle_reset 0x7f0db8028040 session 0x7f0db8013040 osd.7 2024-09-12T17:19:12.907 INFO:tasks.workunit.client.0.smithi016.stderr: -121> 2024-09-12T17:19:12.763+0000 7f0ca57fa640 10 monclient: _renew_subs 2024-09-12T17:19:12.907 INFO:tasks.workunit.client.0.smithi016.stderr: -120> 2024-09-12T17:19:12.763+0000 7f0ca57fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:19:12.907 INFO:tasks.workunit.client.0.smithi016.stderr: -119> 2024-09-12T17:19:12.763+0000 7f0dc7210640 10 monclient: get_auth_request con 0x7f0c900808b0 auth_method 0 2024-09-12T17:19:12.907 INFO:tasks.workunit.client.0.smithi016.stderr: -118> 2024-09-12T17:19:12.767+0000 7f0dc8212640 10 monclient: get_auth_request con 0x7f0dbc049420 auth_method 0 2024-09-12T17:19:12.908 INFO:tasks.workunit.client.0.smithi016.stderr: -117> 2024-09-12T17:19:12.771+0000 7f0dc7a11640 10 monclient: get_auth_request con 0x7f0dc00ffc20 auth_method 0 2024-09-12T17:19:12.908 INFO:tasks.workunit.client.0.smithi016.stderr: -116> 2024-09-12T17:19:12.771+0000 7f0dc8212640 0 -- 172.21.15.16:0/3305785925 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f0dbc049420 msgr2=0x7f0dbc049840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:19:12.908 INFO:tasks.workunit.client.0.smithi016.stderr: -115> 2024-09-12T17:19:12.771+0000 7f0ca57fa640 1 client.7029.objecter ms_handle_reset 0x7f0dbc049420 session 0x7f0dbc017040 osd.2 2024-09-12T17:19:12.908 INFO:tasks.workunit.client.0.smithi016.stderr: -114> 2024-09-12T17:19:12.771+0000 7f0dc8212640 10 monclient: get_auth_request con 0x7f0db8028040 auth_method 0 2024-09-12T17:19:12.908 INFO:tasks.workunit.client.0.smithi016.stderr: -113> 2024-09-12T17:19:12.775+0000 7f0dc7210640 10 monclient: get_auth_request con 0x55f4731235f0 auth_method 0 2024-09-12T17:19:12.908 INFO:tasks.workunit.client.0.smithi016.stderr: -112> 2024-09-12T17:19:12.783+0000 7f0dc9f0b9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:19:12.908 INFO:tasks.workunit.client.0.smithi016.stderr: -111> 2024-09-12T17:19:12.783+0000 7f0dc9f0b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:19:12.908 INFO:tasks.workunit.client.0.smithi016.stderr: -110> 2024-09-12T17:19:12.783+0000 7f0dc9f0b9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:19:12.908 INFO:tasks.workunit.client.0.smithi016.stderr: -109> 2024-09-12T17:19:12.783+0000 7f0dc9f0b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:19:12.908 INFO:tasks.workunit.client.0.smithi016.stderr: -108> 2024-09-12T17:19:12.783+0000 7f0dc9f0b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:19:12.908 INFO:tasks.workunit.client.0.smithi016.stderr: -107> 2024-09-12T17:19:12.783+0000 7f0dc9f0b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:19:12.909 INFO:tasks.workunit.client.0.smithi016.stderr: -106> 2024-09-12T17:19:12.783+0000 7f0dc9f0b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.909 INFO:tasks.workunit.client.0.smithi016.stderr: -105> 2024-09-12T17:19:12.783+0000 7f0dc9f0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:12.909 INFO:tasks.workunit.client.0.smithi016.stderr: -104> 2024-09-12T17:19:12.783+0000 7f0dc9f0b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.909 INFO:tasks.workunit.client.0.smithi016.stderr: -103> 2024-09-12T17:19:12.783+0000 7f0dc9f0b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:12.909 INFO:tasks.workunit.client.0.smithi016.stderr: -102> 2024-09-12T17:19:12.783+0000 7f0dc9f0b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.909 INFO:tasks.workunit.client.0.smithi016.stderr: -101> 2024-09-12T17:19:12.783+0000 7f0dc9f0b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:19:12.909 INFO:tasks.workunit.client.0.smithi016.stderr: -100> 2024-09-12T17:19:12.787+0000 7f0dc9f0b9c0 20 zone default found 2024-09-12T17:19:12.909 INFO:tasks.workunit.client.0.smithi016.stderr: -99> 2024-09-12T17:19:12.787+0000 7f0dc9f0b9c0 4 Realm: () 2024-09-12T17:19:12.909 INFO:tasks.workunit.client.0.smithi016.stderr: -98> 2024-09-12T17:19:12.787+0000 7f0dc9f0b9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:19:12.909 INFO:tasks.workunit.client.0.smithi016.stderr: -97> 2024-09-12T17:19:12.787+0000 7f0dc9f0b9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:19:12.909 INFO:tasks.workunit.client.0.smithi016.stderr: -96> 2024-09-12T17:19:12.787+0000 7f0dc9f0b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:19:12.909 INFO:tasks.workunit.client.0.smithi016.stderr: -95> 2024-09-12T17:19:12.787+0000 7f0dc9f0b9c0 20 zonegroup default 2024-09-12T17:19:12.910 INFO:tasks.workunit.client.0.smithi016.stderr: -94> 2024-09-12T17:19:12.787+0000 7f0dc9f0b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.910 INFO:tasks.workunit.client.0.smithi016.stderr: -93> 2024-09-12T17:19:12.787+0000 7f0dc9f0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:12.910 INFO:tasks.workunit.client.0.smithi016.stderr: -92> 2024-09-12T17:19:12.787+0000 7f0dc9f0b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.910 INFO:tasks.workunit.client.0.smithi016.stderr: -91> 2024-09-12T17:19:12.787+0000 7f0dc9f0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:12.910 INFO:tasks.workunit.client.0.smithi016.stderr: -90> 2024-09-12T17:19:12.787+0000 7f0dc9f0b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.910 INFO:tasks.workunit.client.0.smithi016.stderr: -89> 2024-09-12T17:19:12.787+0000 7f0dc9f0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:12.910 INFO:tasks.workunit.client.0.smithi016.stderr: -88> 2024-09-12T17:19:12.787+0000 7f0dc9f0b9c0 20 started sync module instance, tier type = 2024-09-12T17:19:12.910 INFO:tasks.workunit.client.0.smithi016.stderr: -87> 2024-09-12T17:19:12.787+0000 7f0dc9f0b9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:19:12.910 INFO:tasks.workunit.client.0.smithi016.stderr: -86> 2024-09-12T17:19:12.803+0000 7f0dc9f0b9c0 20 add_watcher() i=0 2024-09-12T17:19:12.910 INFO:tasks.workunit.client.0.smithi016.stderr: -85> 2024-09-12T17:19:12.803+0000 7f0dc9f0b9c0 20 add_watcher() i=1 2024-09-12T17:19:12.910 INFO:tasks.workunit.client.0.smithi016.stderr: -84> 2024-09-12T17:19:12.803+0000 7f0dc9f0b9c0 20 add_watcher() i=2 2024-09-12T17:19:12.910 INFO:tasks.workunit.client.0.smithi016.stderr: -83> 2024-09-12T17:19:12.803+0000 7f0dc9f0b9c0 20 add_watcher() i=3 2024-09-12T17:19:12.911 INFO:tasks.workunit.client.0.smithi016.stderr: -82> 2024-09-12T17:19:12.803+0000 7f0dc9f0b9c0 20 add_watcher() i=4 2024-09-12T17:19:12.911 INFO:tasks.workunit.client.0.smithi016.stderr: -81> 2024-09-12T17:19:12.803+0000 7f0dc9f0b9c0 20 add_watcher() i=5 2024-09-12T17:19:12.911 INFO:tasks.workunit.client.0.smithi016.stderr: -80> 2024-09-12T17:19:12.803+0000 7f0dc9f0b9c0 20 add_watcher() i=6 2024-09-12T17:19:12.911 INFO:tasks.workunit.client.0.smithi016.stderr: -79> 2024-09-12T17:19:12.803+0000 7f0dc9f0b9c0 20 add_watcher() i=7 2024-09-12T17:19:12.911 INFO:tasks.workunit.client.0.smithi016.stderr: -78> 2024-09-12T17:19:12.803+0000 7f0dc9f0b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:19:12.911 INFO:tasks.workunit.client.0.smithi016.stderr: -77> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848fdc0) adding auth protocol: cephx 2024-09-12T17:19:12.911 INFO:tasks.workunit.client.0.smithi016.stderr: -76> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848fdc0) adding auth protocol: cephx 2024-09-12T17:19:12.911 INFO:tasks.workunit.client.0.smithi016.stderr: -75> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848fdc0) adding auth protocol: cephx 2024-09-12T17:19:12.911 INFO:tasks.workunit.client.0.smithi016.stderr: -74> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848fdc0) adding con mode: secure 2024-09-12T17:19:12.911 INFO:tasks.workunit.client.0.smithi016.stderr: -73> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848fdc0) adding con mode: crc 2024-09-12T17:19:12.911 INFO:tasks.workunit.client.0.smithi016.stderr: -72> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848fdc0) adding con mode: secure 2024-09-12T17:19:12.912 INFO:tasks.workunit.client.0.smithi016.stderr: -71> 2024-09-12T17:19:12.807+0000 7f0c7dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:12.912 INFO:tasks.workunit.client.0.smithi016.stderr: -70> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848fdc0) adding con mode: crc 2024-09-12T17:19:12.912 INFO:tasks.workunit.client.0.smithi016.stderr: -69> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848fdc0) adding con mode: secure 2024-09-12T17:19:12.912 INFO:tasks.workunit.client.0.smithi016.stderr: -68> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848fdc0) adding con mode: crc 2024-09-12T17:19:12.912 INFO:tasks.workunit.client.0.smithi016.stderr: -67> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848fdc0) adding con mode: crc 2024-09-12T17:19:12.912 INFO:tasks.workunit.client.0.smithi016.stderr: -66> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848fdc0) adding con mode: secure 2024-09-12T17:19:12.912 INFO:tasks.workunit.client.0.smithi016.stderr: -65> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848fdc0) adding con mode: crc 2024-09-12T17:19:12.912 INFO:tasks.workunit.client.0.smithi016.stderr: -64> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848fdc0) adding con mode: secure 2024-09-12T17:19:12.912 INFO:tasks.workunit.client.0.smithi016.stderr: -63> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848fdc0) adding con mode: crc 2024-09-12T17:19:12.912 INFO:tasks.workunit.client.0.smithi016.stderr: -62> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848fdc0) adding con mode: secure 2024-09-12T17:19:12.912 INFO:tasks.workunit.client.0.smithi016.stderr: -61> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:12.913 INFO:tasks.workunit.client.0.smithi016.stderr: -60> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:19:12.913 INFO:tasks.workunit.client.0.smithi016.stderr: -59> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:19:12.913 INFO:tasks.workunit.client.0.smithi016.stderr: -58> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 asok(0x55f47308b2b0) register_command cache list hook 0x55f47335a4a0 2024-09-12T17:19:12.913 INFO:tasks.workunit.client.0.smithi016.stderr: -57> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 asok(0x55f47308b2b0) register_command cache inspect hook 0x55f47335a4a0 2024-09-12T17:19:12.913 INFO:tasks.workunit.client.0.smithi016.stderr: -56> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 asok(0x55f47308b2b0) register_command cache erase hook 0x55f47335a4a0 2024-09-12T17:19:12.913 INFO:tasks.workunit.client.0.smithi016.stderr: -55> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 asok(0x55f47308b2b0) register_command cache zap hook 0x55f47335a4a0 2024-09-12T17:19:12.913 INFO:tasks.workunit.client.0.smithi016.stderr: -54> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 note: GC not initialized 2024-09-12T17:19:12.913 INFO:tasks.workunit.client.0.smithi016.stderr: -53> 2024-09-12T17:19:12.807+0000 7f0c7cfe1640 20 reqs_thread_entry: start 2024-09-12T17:19:12.913 INFO:tasks.workunit.client.0.smithi016.stderr: -52> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 asok(0x55f47308b2b0) register_command sync trace show hook 0x7f0db0001d40 2024-09-12T17:19:12.913 INFO:tasks.workunit.client.0.smithi016.stderr: -51> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 asok(0x55f47308b2b0) register_command sync trace history hook 0x7f0db0001d40 2024-09-12T17:19:12.913 INFO:tasks.workunit.client.0.smithi016.stderr: -50> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 asok(0x55f47308b2b0) register_command sync trace active hook 0x7f0db0001d40 2024-09-12T17:19:12.913 INFO:tasks.workunit.client.0.smithi016.stderr: -49> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 asok(0x55f47308b2b0) register_command sync trace active_short hook 0x7f0db0001d40 2024-09-12T17:19:12.914 INFO:tasks.workunit.client.0.smithi016.stderr: -48> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:19:12.914 INFO:tasks.workunit.client.0.smithi016.stderr: -47> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 20 Filter name: none 2024-09-12T17:19:12.914 INFO:tasks.workunit.client.0.smithi016.stderr: -46> 2024-09-12T17:19:12.807+0000 7f0bf67fc640 20 reqs_thread_entry: start 2024-09-12T17:19:12.914 INFO:tasks.workunit.client.0.smithi016.stderr: -45> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T17:19:12.914 INFO:tasks.workunit.client.0.smithi016.stderr: -44> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.914 INFO:tasks.workunit.client.0.smithi016.stderr: -43> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:19:12.914 INFO:tasks.workunit.client.0.smithi016.stderr: -42> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T17:19:12.914 INFO:tasks.workunit.client.0.smithi016.stderr: -41> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T17:19:12.914 INFO:tasks.workunit.client.0.smithi016.stderr: -40> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 : miss 2024-09-12T17:19:12.914 INFO:tasks.workunit.client.0.smithi016.stderr: -39> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.914 INFO:tasks.workunit.client.0.smithi016.stderr: -38> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T17:19:12.914 INFO:tasks.workunit.client.0.smithi016.stderr: -37> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 info.flags=0x17 2024-09-12T17:19:12.915 INFO:tasks.workunit.client.0.smithi016.stderr: -36> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 to cache LRU end 2024-09-12T17:19:12.915 INFO:tasks.workunit.client.0.smithi016.stderr: -35> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:19:12.915 INFO:tasks.workunit.client.0.smithi016.stderr: -34> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:12.915 INFO:tasks.workunit.client.0.smithi016.stderr: -33> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 2024-09-12T17:19:12.915 INFO:tasks.workunit.client.0.smithi016.stderr: -32> 2024-09-12T17:19:12.815+0000 7f0dc9f0b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 info.flags=0x17 2024-09-12T17:19:12.915 INFO:tasks.workunit.client.0.smithi016.stderr: -31> 2024-09-12T17:19:12.815+0000 7f0dc9f0b9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 to cache LRU end 2024-09-12T17:19:12.915 INFO:tasks.workunit.client.0.smithi016.stderr: -30> 2024-09-12T17:19:12.815+0000 7f0dc9f0b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:12.916 INFO:tasks.workunit.client.0.smithi016.stderr: -29> 2024-09-12T17:19:12.815+0000 7f0dc9f0b9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29, ofs0, ns] 2024-09-12T17:19:12.916 INFO:tasks.workunit.client.0.smithi016.stderr: -28> 2024-09-12T17:19:12.815+0000 7f0ca6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431576 cookie 94508393508096 notifier 7029 bl.length()=915 2024-09-12T17:19:12.916 INFO:tasks.workunit.client.0.smithi016.stderr: -27> 2024-09-12T17:19:12.815+0000 7f0ca6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 info.flags=0x17 2024-09-12T17:19:12.916 INFO:tasks.workunit.client.0.smithi016.stderr: -26> 2024-09-12T17:19:12.815+0000 7f0ca6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 to cache LRU end 2024-09-12T17:19:12.916 INFO:tasks.workunit.client.0.smithi016.stderr: -25> 2024-09-12T17:19:12.815+0000 7f0ca6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:12.916 INFO:tasks.workunit.client.0.smithi016.stderr: -24> 2024-09-12T17:19:12.819+0000 7f0dc9f0b9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29]): orig_sources= new_sources= 2024-09-12T17:19:12.917 INFO:tasks.workunit.client.0.smithi016.stderr: -23> 2024-09-12T17:19:12.819+0000 7f0dc9f0b9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29]): potential sources added=[] removed=[] 2024-09-12T17:19:12.917 INFO:tasks.workunit.client.0.smithi016.stderr: -22> 2024-09-12T17:19:12.819+0000 7f0dc9f0b9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29]): orig_dests= new_dests= 2024-09-12T17:19:12.917 INFO:tasks.workunit.client.0.smithi016.stderr: -21> 2024-09-12T17:19:12.819+0000 7f0dc9f0b9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29]): potential dests added=[] removed=[] 2024-09-12T17:19:12.917 INFO:tasks.workunit.client.0.smithi016.stderr: -20> 2024-09-12T17:19:12.823+0000 7f0dc9f0b9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29.1.0 2024-09-12T17:19:12.917 INFO:tasks.workunit.client.0.smithi016.stderr: -19> 2024-09-12T17:19:12.823+0000 7f0dc9f0b9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29.1.0 2024-09-12T17:19:12.917 INFO:tasks.workunit.client.0.smithi016.stderr: -18> 2024-09-12T17:19:12.823+0000 7f0dc9f0b9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29.1.1 2024-09-12T17:19:12.917 INFO:tasks.workunit.client.0.smithi016.stderr: -17> 2024-09-12T17:19:12.823+0000 7f0dc9f0b9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29.1.1 2024-09-12T17:19:12.917 INFO:tasks.workunit.client.0.smithi016.stderr: -16> 2024-09-12T17:19:12.823+0000 7f0dc9f0b9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29.0 2024-09-12T17:19:12.917 INFO:tasks.workunit.client.0.smithi016.stderr: -15> 2024-09-12T17:19:12.827+0000 7f0dc9f0b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 : hit (requested=0x17, cached=0x17) 2024-09-12T17:19:12.917 INFO:tasks.workunit.client.0.smithi016.stderr: -14> 2024-09-12T17:19:12.827+0000 7f0dc9f0b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 2024-09-12T17:19:12.917 INFO:tasks.workunit.client.0.smithi016.stderr: -13> 2024-09-12T17:19:12.831+0000 7f0dc9f0b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 info.flags=0x17 2024-09-12T17:19:12.918 INFO:tasks.workunit.client.0.smithi016.stderr: -12> 2024-09-12T17:19:12.831+0000 7f0dc9f0b9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 to cache LRU end 2024-09-12T17:19:12.918 INFO:tasks.workunit.client.0.smithi016.stderr: -11> 2024-09-12T17:19:12.831+0000 7f0dc9f0b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:12.918 INFO:tasks.workunit.client.0.smithi016.stderr: -10> 2024-09-12T17:19:12.831+0000 7f0dc9f0b9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29, ofs0, ns] 2024-09-12T17:19:12.918 INFO:tasks.workunit.client.0.smithi016.stderr: -9> 2024-09-12T17:19:12.831+0000 7f0ca6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431577 cookie 94508393508096 notifier 7029 bl.length()=915 2024-09-12T17:19:12.918 INFO:tasks.workunit.client.0.smithi016.stderr: -8> 2024-09-12T17:19:12.831+0000 7f0ca6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 info.flags=0x17 2024-09-12T17:19:12.918 INFO:tasks.workunit.client.0.smithi016.stderr: -7> 2024-09-12T17:19:12.831+0000 7f0ca6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 to cache LRU end 2024-09-12T17:19:12.918 INFO:tasks.workunit.client.0.smithi016.stderr: -6> 2024-09-12T17:19:12.831+0000 7f0ca6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:12.918 INFO:tasks.workunit.client.0.smithi016.stderr: -5> 2024-09-12T17:19:12.831+0000 7f0dc9f0b9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29]): orig_sources= new_sources= 2024-09-12T17:19:12.918 INFO:tasks.workunit.client.0.smithi016.stderr: -4> 2024-09-12T17:19:12.831+0000 7f0dc9f0b9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29]): potential sources added=[] removed=[] 2024-09-12T17:19:12.918 INFO:tasks.workunit.client.0.smithi016.stderr: -3> 2024-09-12T17:19:12.831+0000 7f0dc9f0b9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29]): orig_dests= new_dests= 2024-09-12T17:19:12.918 INFO:tasks.workunit.client.0.smithi016.stderr: -2> 2024-09-12T17:19:12.831+0000 7f0dc9f0b9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29]): potential dests added=[] removed=[] 2024-09-12T17:19:12.918 INFO:tasks.workunit.client.0.smithi016.stderr: -1> 2024-09-12T17:19:12.831+0000 7f0dc9f0b9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0dc9f0b9c0 time 2024-09-12T17:19:12.835996+0000 2024-09-12T17:19:12.919 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:19:12.919 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:12.919 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:19:12.919 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f0dcd7e52eb] 2024-09-12T17:19:12.919 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0dcd7e549f] 2024-09-12T17:19:12.919 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f471ec70c1] 2024-09-12T17:19:12.919 INFO:tasks.workunit.client.0.smithi016.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55f471ed855b] 2024-09-12T17:19:12.919 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55f471ed9b44] 2024-09-12T17:19:12.919 INFO:tasks.workunit.client.0.smithi016.stderr: 6: main() 2024-09-12T17:19:12.919 INFO:tasks.workunit.client.0.smithi016.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0dcc64bd90] 2024-09-12T17:19:12.919 INFO:tasks.workunit.client.0.smithi016.stderr: 8: __libc_start_main() 2024-09-12T17:19:12.920 INFO:tasks.workunit.client.0.smithi016.stderr: 9: _start() 2024-09-12T17:19:12.920 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:12.920 INFO:tasks.workunit.client.0.smithi016.stderr: 0> 2024-09-12T17:19:12.831+0000 7f0dc9f0b9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:19:12.920 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7f0dc9f0b9c0 thread_name:radosgw-admin 2024-09-12T17:19:12.920 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:12.920 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:19:12.920 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f0dcc664520] 2024-09-12T17:19:12.920 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:19:12.920 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:19:12.920 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:19:12.920 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f0dcd7e5345] 2024-09-12T17:19:12.920 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0dcd7e549f] 2024-09-12T17:19:12.921 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f471ec70c1] 2024-09-12T17:19:12.921 INFO:tasks.workunit.client.0.smithi016.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55f471ed855b] 2024-09-12T17:19:12.921 INFO:tasks.workunit.client.0.smithi016.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55f471ed9b44] 2024-09-12T17:19:12.921 INFO:tasks.workunit.client.0.smithi016.stderr: 10: main() 2024-09-12T17:19:12.921 INFO:tasks.workunit.client.0.smithi016.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0dcc64bd90] 2024-09-12T17:19:12.921 INFO:tasks.workunit.client.0.smithi016.stderr: 12: __libc_start_main() 2024-09-12T17:19:12.921 INFO:tasks.workunit.client.0.smithi016.stderr: 13: _start() 2024-09-12T17:19:12.921 INFO:tasks.workunit.client.0.smithi016.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:19:12.921 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:12.921 INFO:tasks.workunit.client.0.smithi016.stderr:--- logging levels --- 2024-09-12T17:19:12.921 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 none 2024-09-12T17:19:12.922 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 lockdep 2024-09-12T17:19:12.922 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 context 2024-09-12T17:19:12.922 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 crush 2024-09-12T17:19:12.922 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds 2024-09-12T17:19:12.922 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_balancer 2024-09-12T17:19:12.922 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_locker 2024-09-12T17:19:12.922 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log 2024-09-12T17:19:12.922 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log_expire 2024-09-12T17:19:12.922 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_migrator 2024-09-12T17:19:12.922 INFO:tasks.workunit.client.0.smithi016.stderr: 3/ 5 mds_quiesce 2024-09-12T17:19:12.922 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 buffer 2024-09-12T17:19:12.923 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 timer 2024-09-12T17:19:12.923 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 filer 2024-09-12T17:19:12.923 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 striper 2024-09-12T17:19:12.923 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 objecter 2024-09-12T17:19:12.923 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rados 2024-09-12T17:19:12.923 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd 2024-09-12T17:19:12.923 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_mirror 2024-09-12T17:19:12.923 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_replay 2024-09-12T17:19:12.923 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_pwl 2024-09-12T17:19:12.923 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 journaler 2024-09-12T17:19:12.923 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objectcacher 2024-09-12T17:19:12.923 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:19:12.924 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 client 2024-09-12T17:19:12.924 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 osd 2024-09-12T17:19:12.924 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 optracker 2024-09-12T17:19:12.924 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objclass 2024-09-12T17:19:12.924 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 filestore 2024-09-12T17:19:12.924 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 journal 2024-09-12T17:19:12.924 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 ms 2024-09-12T17:19:12.924 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mon 2024-09-12T17:19:12.924 INFO:tasks.workunit.client.0.smithi016.stderr: 0/10 monc 2024-09-12T17:19:12.924 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 paxos 2024-09-12T17:19:12.924 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 tp 2024-09-12T17:19:12.925 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 auth 2024-09-12T17:19:12.925 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 crypto 2024-09-12T17:19:12.925 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 finisher 2024-09-12T17:19:12.925 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 reserver 2024-09-12T17:19:12.925 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 heartbeatmap 2024-09-12T17:19:12.925 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 perfcounter 2024-09-12T17:19:12.925 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw 2024-09-12T17:19:12.925 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_sync 2024-09-12T17:19:12.925 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_datacache 2024-09-12T17:19:12.925 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_access 2024-09-12T17:19:12.925 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:19:12.925 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_flight 2024-09-12T17:19:12.926 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:19:12.926 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw_notification 2024-09-12T17:19:12.926 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 javaclient 2024-09-12T17:19:12.926 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 asok 2024-09-12T17:19:12.926 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 throttle 2024-09-12T17:19:12.926 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 refs 2024-09-12T17:19:12.926 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 compressor 2024-09-12T17:19:12.926 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluestore 2024-09-12T17:19:12.926 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluefs 2024-09-12T17:19:12.926 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 bdev 2024-09-12T17:19:12.926 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 kstore 2024-09-12T17:19:12.927 INFO:tasks.workunit.client.0.smithi016.stderr: 4/ 5 rocksdb 2024-09-12T17:19:12.927 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 fuse 2024-09-12T17:19:12.927 INFO:tasks.workunit.client.0.smithi016.stderr: 2/ 5 mgr 2024-09-12T17:19:12.927 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mgrc 2024-09-12T17:19:12.927 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 dpdk 2024-09-12T17:19:12.927 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 eventtrace 2024-09-12T17:19:12.927 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 prioritycache 2024-09-12T17:19:12.927 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 test 2024-09-12T17:19:12.927 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:19:12.927 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephsqlite 2024-09-12T17:19:12.927 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:19:12.928 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore 2024-09-12T17:19:12.928 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_onode 2024-09-12T17:19:12.928 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_odata 2024-09-12T17:19:12.928 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_omap 2024-09-12T17:19:12.928 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_tm 2024-09-12T17:19:12.928 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_t 2024-09-12T17:19:12.928 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:19:12.928 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_epm 2024-09-12T17:19:12.928 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_lba 2024-09-12T17:19:12.928 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:19:12.928 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cache 2024-09-12T17:19:12.929 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_journal 2024-09-12T17:19:12.929 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_device 2024-09-12T17:19:12.929 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_backref 2024-09-12T17:19:12.929 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 alienstore 2024-09-12T17:19:12.929 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mclock 2024-09-12T17:19:12.929 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cyanstore 2024-09-12T17:19:12.929 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 ceph_exporter 2024-09-12T17:19:12.929 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 memstore 2024-09-12T17:19:12.929 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 trace 2024-09-12T17:19:12.929 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 ceph_dedup 2024-09-12T17:19:12.929 INFO:tasks.workunit.client.0.smithi016.stderr: -2/-2 (syslog threshold) 2024-09-12T17:19:12.930 INFO:tasks.workunit.client.0.smithi016.stderr: 99/99 (stderr threshold) 2024-09-12T17:19:12.930 INFO:tasks.workunit.client.0.smithi016.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:19:12.930 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0bf67fc640 / http_manager 2024-09-12T17:19:12.930 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0c7cfe1640 / http_manager 2024-09-12T17:19:12.930 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0c7dfe3640 / rgw_dt_lg_renew 2024-09-12T17:19:12.930 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0ca57fa640 / ms_dispatch 2024-09-12T17:19:12.930 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0ca6ffd640 / io_context_pool 2024-09-12T17:19:12.930 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0cad7fa640 / ms_dispatch 2024-09-12T17:19:12.930 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0caffff640 / ms_dispatch 2024-09-12T17:19:12.930 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0cb5e0b640 / io_context_pool 2024-09-12T17:19:12.930 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0dc6a0f640 / io_context_pool 2024-09-12T17:19:12.931 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0dc7210640 / msgr-worker-2 2024-09-12T17:19:12.931 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0dc7a11640 / msgr-worker-1 2024-09-12T17:19:12.931 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0dc8212640 / msgr-worker-0 2024-09-12T17:19:12.931 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0dc9f0b9c0 / radosgw-admin 2024-09-12T17:19:12.931 INFO:tasks.workunit.client.0.smithi016.stderr: max_recent 500 2024-09-12T17:19:12.931 INFO:tasks.workunit.client.0.smithi016.stderr: max_new 1000 2024-09-12T17:19:12.931 INFO:tasks.workunit.client.0.smithi016.stderr: log_file /var/log/ceph/ceph-client.admin.103808.log 2024-09-12T17:19:12.931 INFO:tasks.workunit.client.0.smithi016.stderr:--- end dump of recent events --- 2024-09-12T17:19:12.931 INFO:tasks.workunit.client.0.smithi016.stderr:--- begin dump of recent events --- 2024-09-12T17:19:12.931 INFO:tasks.workunit.client.0.smithi016.stderr: -499> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 10 monclient: get_monmap_and_config success 2024-09-12T17:19:12.931 INFO:tasks.workunit.client.0.smithi016.stderr: -498> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 4 set_mon_vals no callback set 2024-09-12T17:19:12.932 INFO:tasks.workunit.client.0.smithi016.stderr: -497> 2024-09-12T17:19:12.735+0000 7f0cb5e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:19:12.932 INFO:tasks.workunit.client.0.smithi016.stderr: -496> 2024-09-12T17:19:12.735+0000 7f0cb5e0b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:19:12.932 INFO:tasks.workunit.client.0.smithi016.stderr: -495> 2024-09-12T17:19:12.735+0000 7f0cb5e0b640 10 monclient: dump: 2024-09-12T17:19:12.932 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:19:12.932 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:19:12.932 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:12.932 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:12.932 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:19:12.932 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:12.932 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:19:12.932 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:19:12.932 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:19:12.933 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:12.933 INFO:tasks.workunit.client.0.smithi016.stderr: -494> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 10 monclient: shutdown 2024-09-12T17:19:12.933 INFO:tasks.workunit.client.0.smithi016.stderr: -493> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 asok(0x55f47308b2b0) unregister_commands rotate-key 2024-09-12T17:19:12.933 INFO:tasks.workunit.client.0.smithi016.stderr: -492> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 10 monclient: build_initial_monmap 2024-09-12T17:19:12.933 INFO:tasks.workunit.client.0.smithi016.stderr: -491> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 1 build_initial for_mkfs: 0 2024-09-12T17:19:12.933 INFO:tasks.workunit.client.0.smithi016.stderr: -490> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 10 monclient: monmap: 2024-09-12T17:19:12.933 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:19:12.933 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:19:12.933 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:19:12.933 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:19:12.933 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:19:12.934 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:12.934 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:19:12.934 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:19:12.934 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:19:12.934 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:12.934 INFO:tasks.workunit.client.0.smithi016.stderr: -489> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473297f70) adding auth protocol: cephx 2024-09-12T17:19:12.934 INFO:tasks.workunit.client.0.smithi016.stderr: -488> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473297f70) adding auth protocol: cephx 2024-09-12T17:19:12.934 INFO:tasks.workunit.client.0.smithi016.stderr: -487> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473297f70) adding auth protocol: cephx 2024-09-12T17:19:12.934 INFO:tasks.workunit.client.0.smithi016.stderr: -486> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473297f70) adding con mode: secure 2024-09-12T17:19:12.934 INFO:tasks.workunit.client.0.smithi016.stderr: -485> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473297f70) adding con mode: crc 2024-09-12T17:19:12.934 INFO:tasks.workunit.client.0.smithi016.stderr: -484> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473297f70) adding con mode: secure 2024-09-12T17:19:12.935 INFO:tasks.workunit.client.0.smithi016.stderr: -483> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473297f70) adding con mode: crc 2024-09-12T17:19:12.935 INFO:tasks.workunit.client.0.smithi016.stderr: -482> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473297f70) adding con mode: secure 2024-09-12T17:19:12.935 INFO:tasks.workunit.client.0.smithi016.stderr: -481> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473297f70) adding con mode: crc 2024-09-12T17:19:12.935 INFO:tasks.workunit.client.0.smithi016.stderr: -480> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473297f70) adding con mode: crc 2024-09-12T17:19:12.935 INFO:tasks.workunit.client.0.smithi016.stderr: -479> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473297f70) adding con mode: secure 2024-09-12T17:19:12.935 INFO:tasks.workunit.client.0.smithi016.stderr: -478> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473297f70) adding con mode: crc 2024-09-12T17:19:12.935 INFO:tasks.workunit.client.0.smithi016.stderr: -477> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473297f70) adding con mode: secure 2024-09-12T17:19:12.935 INFO:tasks.workunit.client.0.smithi016.stderr: -476> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473297f70) adding con mode: crc 2024-09-12T17:19:12.935 INFO:tasks.workunit.client.0.smithi016.stderr: -475> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473297f70) adding con mode: secure 2024-09-12T17:19:12.935 INFO:tasks.workunit.client.0.smithi016.stderr: -474> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:12.935 INFO:tasks.workunit.client.0.smithi016.stderr: -473> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 1 librados: starting msgr at 2024-09-12T17:19:12.935 INFO:tasks.workunit.client.0.smithi016.stderr: -472> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 1 librados: starting objecter 2024-09-12T17:19:12.936 INFO:tasks.workunit.client.0.smithi016.stderr: -471> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 asok(0x55f47308b2b0) register_command objecter_requests hook 0x55f473297590 2024-09-12T17:19:12.936 INFO:tasks.workunit.client.0.smithi016.stderr: -470> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 1 librados: setting wanted keys 2024-09-12T17:19:12.936 INFO:tasks.workunit.client.0.smithi016.stderr: -469> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 1 librados: calling monclient init 2024-09-12T17:19:12.936 INFO:tasks.workunit.client.0.smithi016.stderr: -468> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 10 monclient: init 2024-09-12T17:19:12.936 INFO:tasks.workunit.client.0.smithi016.stderr: -467> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732928a0) adding auth protocol: cephx 2024-09-12T17:19:12.936 INFO:tasks.workunit.client.0.smithi016.stderr: -466> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732928a0) adding auth protocol: cephx 2024-09-12T17:19:12.936 INFO:tasks.workunit.client.0.smithi016.stderr: -465> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732928a0) adding auth protocol: cephx 2024-09-12T17:19:12.936 INFO:tasks.workunit.client.0.smithi016.stderr: -464> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732928a0) adding con mode: secure 2024-09-12T17:19:12.936 INFO:tasks.workunit.client.0.smithi016.stderr: -463> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732928a0) adding con mode: crc 2024-09-12T17:19:12.936 INFO:tasks.workunit.client.0.smithi016.stderr: -462> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732928a0) adding con mode: secure 2024-09-12T17:19:12.936 INFO:tasks.workunit.client.0.smithi016.stderr: -461> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732928a0) adding con mode: crc 2024-09-12T17:19:12.936 INFO:tasks.workunit.client.0.smithi016.stderr: -460> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732928a0) adding con mode: secure 2024-09-12T17:19:12.937 INFO:tasks.workunit.client.0.smithi016.stderr: -459> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732928a0) adding con mode: crc 2024-09-12T17:19:12.937 INFO:tasks.workunit.client.0.smithi016.stderr: -458> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732928a0) adding con mode: crc 2024-09-12T17:19:12.937 INFO:tasks.workunit.client.0.smithi016.stderr: -457> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732928a0) adding con mode: secure 2024-09-12T17:19:12.937 INFO:tasks.workunit.client.0.smithi016.stderr: -456> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732928a0) adding con mode: crc 2024-09-12T17:19:12.937 INFO:tasks.workunit.client.0.smithi016.stderr: -455> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732928a0) adding con mode: secure 2024-09-12T17:19:12.937 INFO:tasks.workunit.client.0.smithi016.stderr: -454> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732928a0) adding con mode: crc 2024-09-12T17:19:12.937 INFO:tasks.workunit.client.0.smithi016.stderr: -453> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732928a0) adding con mode: secure 2024-09-12T17:19:12.937 INFO:tasks.workunit.client.0.smithi016.stderr: -452> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:12.937 INFO:tasks.workunit.client.0.smithi016.stderr: -451> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:12.937 INFO:tasks.workunit.client.0.smithi016.stderr: -450> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 asok(0x55f47308b2b0) register_command rotate-key hook 0x55f4732929e8 2024-09-12T17:19:12.938 INFO:tasks.workunit.client.0.smithi016.stderr: -449> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:19:12.938 INFO:tasks.workunit.client.0.smithi016.stderr: -448> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:19:12.938 INFO:tasks.workunit.client.0.smithi016.stderr: -447> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 10 monclient(hunting): picked mon.noname-a con 0x55f473295930 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:19:12.938 INFO:tasks.workunit.client.0.smithi016.stderr: -446> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 10 monclient(hunting): picked mon.noname-b con 0x55f4732bbde0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:19:12.938 INFO:tasks.workunit.client.0.smithi016.stderr: -445> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 10 monclient(hunting): picked mon.noname-c con 0x7f0db0003be0 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:19:12.938 INFO:tasks.workunit.client.0.smithi016.stderr: -444> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:12.938 INFO:tasks.workunit.client.0.smithi016.stderr: -443> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:12.938 INFO:tasks.workunit.client.0.smithi016.stderr: -442> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:12.938 INFO:tasks.workunit.client.0.smithi016.stderr: -441> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:19:12.938 INFO:tasks.workunit.client.0.smithi016.stderr: -440> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 10 monclient(hunting): authenticate will time out at 2270.714169s 2024-09-12T17:19:12.938 INFO:tasks.workunit.client.0.smithi016.stderr: -439> 2024-09-12T17:19:12.735+0000 7f0dc8212640 10 monclient(hunting): get_auth_request con 0x7f0db0003be0 auth_method 0 2024-09-12T17:19:12.938 INFO:tasks.workunit.client.0.smithi016.stderr: -438> 2024-09-12T17:19:12.735+0000 7f0dc8212640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:19:12.939 INFO:tasks.workunit.client.0.smithi016.stderr: -437> 2024-09-12T17:19:12.735+0000 7f0dc8212640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:19:12.939 INFO:tasks.workunit.client.0.smithi016.stderr: -436> 2024-09-12T17:19:12.735+0000 7f0dc8212640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:19:12.939 INFO:tasks.workunit.client.0.smithi016.stderr: -435> 2024-09-12T17:19:12.735+0000 7f0dc8212640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:19:12.939 INFO:tasks.workunit.client.0.smithi016.stderr: -434> 2024-09-12T17:19:12.735+0000 7f0dc8212640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:19:12.939 INFO:tasks.workunit.client.0.smithi016.stderr: -433> 2024-09-12T17:19:12.735+0000 7f0dc8212640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:19:12.939 INFO:tasks.workunit.client.0.smithi016.stderr: -432> 2024-09-12T17:19:12.735+0000 7f0dc7a11640 10 monclient(hunting): get_auth_request con 0x55f473295930 auth_method 0 2024-09-12T17:19:12.939 INFO:tasks.workunit.client.0.smithi016.stderr: -431> 2024-09-12T17:19:12.735+0000 7f0dc7a11640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:19:12.939 INFO:tasks.workunit.client.0.smithi016.stderr: -430> 2024-09-12T17:19:12.735+0000 7f0dc7a11640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:19:12.939 INFO:tasks.workunit.client.0.smithi016.stderr: -429> 2024-09-12T17:19:12.735+0000 7f0dc7a11640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:19:12.939 INFO:tasks.workunit.client.0.smithi016.stderr: -428> 2024-09-12T17:19:12.735+0000 7f0dc8212640 10 monclient(hunting): handle_auth_done global_id 6716 payload 824 2024-09-12T17:19:12.939 INFO:tasks.workunit.client.0.smithi016.stderr: -427> 2024-09-12T17:19:12.735+0000 7f0dc8212640 10 monclient: _finish_hunting 0 2024-09-12T17:19:12.940 INFO:tasks.workunit.client.0.smithi016.stderr: -426> 2024-09-12T17:19:12.735+0000 7f0dc8212640 1 monclient: found mon.noname-c 2024-09-12T17:19:12.940 INFO:tasks.workunit.client.0.smithi016.stderr: -425> 2024-09-12T17:19:12.735+0000 7f0dc8212640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:19:12.940 INFO:tasks.workunit.client.0.smithi016.stderr: -424> 2024-09-12T17:19:12.735+0000 7f0caffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:19:12.940 INFO:tasks.workunit.client.0.smithi016.stderr: -423> 2024-09-12T17:19:12.735+0000 7f0caffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:19:12.940 INFO:tasks.workunit.client.0.smithi016.stderr: -422> 2024-09-12T17:19:12.735+0000 7f0caffff640 10 monclient: dump: 2024-09-12T17:19:12.940 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:19:12.940 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:19:12.940 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:12.940 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:12.940 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:19:12.940 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:12.941 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:19:12.941 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:19:12.941 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:19:12.941 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:12.941 INFO:tasks.workunit.client.0.smithi016.stderr: -421> 2024-09-12T17:19:12.735+0000 7f0caffff640 10 monclient: _finish_auth 0 2024-09-12T17:19:12.941 INFO:tasks.workunit.client.0.smithi016.stderr: -420> 2024-09-12T17:19:12.735+0000 7f0caffff640 10 monclient: _check_auth_tickets 2024-09-12T17:19:12.941 INFO:tasks.workunit.client.0.smithi016.stderr: -419> 2024-09-12T17:19:12.735+0000 7f0caffff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:19:12.941 INFO:tasks.workunit.client.0.smithi016.stderr: -418> 2024-09-12T17:19:12.735+0000 7f0caffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:19:12.941 INFO:tasks.workunit.client.0.smithi016.stderr: -417> 2024-09-12T17:19:12.735+0000 7f0caffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:19:12.941 INFO:tasks.workunit.client.0.smithi016.stderr: -416> 2024-09-12T17:19:12.735+0000 7f0caffff640 10 monclient: dump: 2024-09-12T17:19:12.941 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:19:12.941 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:19:12.942 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:12.942 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:12.942 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:19:12.942 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:12.942 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:19:12.942 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:19:12.942 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:19:12.942 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:12.942 INFO:tasks.workunit.client.0.smithi016.stderr: -415> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 5 monclient: authenticate success, global_id 6716 2024-09-12T17:19:12.942 INFO:tasks.workunit.client.0.smithi016.stderr: -414> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 10 monclient: _renew_subs 2024-09-12T17:19:12.942 INFO:tasks.workunit.client.0.smithi016.stderr: -413> 2024-09-12T17:19:12.735+0000 7f0cb5e0b640 4 set_mon_vals no callback set 2024-09-12T17:19:12.943 INFO:tasks.workunit.client.0.smithi016.stderr: -412> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:19:12.943 INFO:tasks.workunit.client.0.smithi016.stderr: -411> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 10 monclient: _renew_subs 2024-09-12T17:19:12.943 INFO:tasks.workunit.client.0.smithi016.stderr: -410> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:19:12.943 INFO:tasks.workunit.client.0.smithi016.stderr: -409> 2024-09-12T17:19:12.735+0000 7f0dc9f0b9c0 1 librados: init done 2024-09-12T17:19:12.943 INFO:tasks.workunit.client.0.smithi016.stderr: -408> 2024-09-12T17:19:12.739+0000 7f0caffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:19:12.943 INFO:tasks.workunit.client.0.smithi016.stderr: -407> 2024-09-12T17:19:12.739+0000 7f0caffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:19:12.943 INFO:tasks.workunit.client.0.smithi016.stderr: -406> 2024-09-12T17:19:12.739+0000 7f0caffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:19:12.943 INFO:tasks.workunit.client.0.smithi016.stderr: -405> 2024-09-12T17:19:12.739+0000 7f0dc7a11640 10 monclient: get_auth_request con 0x7f0cb0070b10 auth_method 0 2024-09-12T17:19:12.943 INFO:tasks.workunit.client.0.smithi016.stderr: -404> 2024-09-12T17:19:12.739+0000 7f0dc7210640 10 monclient: get_auth_request con 0x55f473295060 auth_method 0 2024-09-12T17:19:12.943 INFO:tasks.workunit.client.0.smithi016.stderr: -403> 2024-09-12T17:19:12.739+0000 7f0dc7a11640 10 monclient: get_auth_request con 0x55f4732dde30 auth_method 0 2024-09-12T17:19:12.943 INFO:tasks.workunit.client.0.smithi016.stderr: -402> 2024-09-12T17:19:12.743+0000 7f0dc7210640 10 monclient: get_auth_request con 0x55f4732e2020 auth_method 0 2024-09-12T17:19:12.944 INFO:tasks.workunit.client.0.smithi016.stderr: -401> 2024-09-12T17:19:12.743+0000 7f0dc8212640 10 monclient: get_auth_request con 0x55f4732e16b0 auth_method 0 2024-09-12T17:19:12.944 INFO:tasks.workunit.client.0.smithi016.stderr: -400> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 10 monclient: build_initial_monmap 2024-09-12T17:19:12.944 INFO:tasks.workunit.client.0.smithi016.stderr: -399> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 1 build_initial for_mkfs: 0 2024-09-12T17:19:12.944 INFO:tasks.workunit.client.0.smithi016.stderr: -398> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 10 monclient: monmap: 2024-09-12T17:19:12.944 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:19:12.944 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:19:12.944 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:19:12.944 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:19:12.944 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:19:12.944 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:12.944 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:19:12.944 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:19:12.945 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:19:12.945 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:12.945 INFO:tasks.workunit.client.0.smithi016.stderr: -397> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e9e90) adding auth protocol: cephx 2024-09-12T17:19:12.945 INFO:tasks.workunit.client.0.smithi016.stderr: -396> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e9e90) adding auth protocol: cephx 2024-09-12T17:19:12.945 INFO:tasks.workunit.client.0.smithi016.stderr: -395> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e9e90) adding auth protocol: cephx 2024-09-12T17:19:12.945 INFO:tasks.workunit.client.0.smithi016.stderr: -394> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e9e90) adding con mode: secure 2024-09-12T17:19:12.945 INFO:tasks.workunit.client.0.smithi016.stderr: -393> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e9e90) adding con mode: crc 2024-09-12T17:19:12.945 INFO:tasks.workunit.client.0.smithi016.stderr: -392> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e9e90) adding con mode: secure 2024-09-12T17:19:12.945 INFO:tasks.workunit.client.0.smithi016.stderr: -391> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e9e90) adding con mode: crc 2024-09-12T17:19:12.945 INFO:tasks.workunit.client.0.smithi016.stderr: -390> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e9e90) adding con mode: secure 2024-09-12T17:19:12.945 INFO:tasks.workunit.client.0.smithi016.stderr: -389> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e9e90) adding con mode: crc 2024-09-12T17:19:12.946 INFO:tasks.workunit.client.0.smithi016.stderr: -388> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e9e90) adding con mode: crc 2024-09-12T17:19:12.946 INFO:tasks.workunit.client.0.smithi016.stderr: -387> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e9e90) adding con mode: secure 2024-09-12T17:19:12.946 INFO:tasks.workunit.client.0.smithi016.stderr: -386> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e9e90) adding con mode: crc 2024-09-12T17:19:12.946 INFO:tasks.workunit.client.0.smithi016.stderr: -385> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e9e90) adding con mode: secure 2024-09-12T17:19:12.946 INFO:tasks.workunit.client.0.smithi016.stderr: -384> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e9e90) adding con mode: crc 2024-09-12T17:19:12.946 INFO:tasks.workunit.client.0.smithi016.stderr: -383> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e9e90) adding con mode: secure 2024-09-12T17:19:12.946 INFO:tasks.workunit.client.0.smithi016.stderr: -382> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:12.946 INFO:tasks.workunit.client.0.smithi016.stderr: -381> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 asok(0x55f47308b2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55f4732ed840 EEXIST 2024-09-12T17:19:12.946 INFO:tasks.workunit.client.0.smithi016.stderr: -380> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 10 monclient: init 2024-09-12T17:19:12.946 INFO:tasks.workunit.client.0.smithi016.stderr: -379> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e8e18) adding auth protocol: cephx 2024-09-12T17:19:12.946 INFO:tasks.workunit.client.0.smithi016.stderr: -378> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e8e18) adding auth protocol: cephx 2024-09-12T17:19:12.947 INFO:tasks.workunit.client.0.smithi016.stderr: -377> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e8e18) adding auth protocol: cephx 2024-09-12T17:19:12.947 INFO:tasks.workunit.client.0.smithi016.stderr: -376> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e8e18) adding con mode: secure 2024-09-12T17:19:12.947 INFO:tasks.workunit.client.0.smithi016.stderr: -375> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e8e18) adding con mode: crc 2024-09-12T17:19:12.947 INFO:tasks.workunit.client.0.smithi016.stderr: -374> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e8e18) adding con mode: secure 2024-09-12T17:19:12.947 INFO:tasks.workunit.client.0.smithi016.stderr: -373> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e8e18) adding con mode: crc 2024-09-12T17:19:12.947 INFO:tasks.workunit.client.0.smithi016.stderr: -372> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e8e18) adding con mode: secure 2024-09-12T17:19:12.947 INFO:tasks.workunit.client.0.smithi016.stderr: -371> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e8e18) adding con mode: crc 2024-09-12T17:19:12.947 INFO:tasks.workunit.client.0.smithi016.stderr: -370> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e8e18) adding con mode: crc 2024-09-12T17:19:12.947 INFO:tasks.workunit.client.0.smithi016.stderr: -369> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e8e18) adding con mode: secure 2024-09-12T17:19:12.947 INFO:tasks.workunit.client.0.smithi016.stderr: -368> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e8e18) adding con mode: crc 2024-09-12T17:19:12.947 INFO:tasks.workunit.client.0.smithi016.stderr: -367> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e8e18) adding con mode: secure 2024-09-12T17:19:12.948 INFO:tasks.workunit.client.0.smithi016.stderr: -366> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e8e18) adding con mode: crc 2024-09-12T17:19:12.948 INFO:tasks.workunit.client.0.smithi016.stderr: -365> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f4732e8e18) adding con mode: secure 2024-09-12T17:19:12.948 INFO:tasks.workunit.client.0.smithi016.stderr: -364> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:12.948 INFO:tasks.workunit.client.0.smithi016.stderr: -363> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:12.948 INFO:tasks.workunit.client.0.smithi016.stderr: -362> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 asok(0x55f47308b2b0) register_command rotate-key cmddesc rotate-key hook 0x55f4732e8f60 EEXIST 2024-09-12T17:19:12.948 INFO:tasks.workunit.client.0.smithi016.stderr: -361> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:19:12.948 INFO:tasks.workunit.client.0.smithi016.stderr: -360> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:19:12.948 INFO:tasks.workunit.client.0.smithi016.stderr: -359> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 10 monclient(hunting): picked mon.noname-c con 0x55f4733119f0 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:19:12.948 INFO:tasks.workunit.client.0.smithi016.stderr: -358> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 10 monclient(hunting): picked mon.noname-a con 0x55f473311320 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:19:12.948 INFO:tasks.workunit.client.0.smithi016.stderr: -357> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 10 monclient(hunting): picked mon.noname-b con 0x55f47330fd00 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:19:12.948 INFO:tasks.workunit.client.0.smithi016.stderr: -356> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:12.948 INFO:tasks.workunit.client.0.smithi016.stderr: -355> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:12.949 INFO:tasks.workunit.client.0.smithi016.stderr: -354> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:12.949 INFO:tasks.workunit.client.0.smithi016.stderr: -353> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:19:12.949 INFO:tasks.workunit.client.0.smithi016.stderr: -352> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 10 monclient(hunting): authenticate will time out at 2270.726107s 2024-09-12T17:19:12.949 INFO:tasks.workunit.client.0.smithi016.stderr: -351> 2024-09-12T17:19:12.747+0000 7f0dc8212640 10 monclient(hunting): get_auth_request con 0x55f473311320 auth_method 0 2024-09-12T17:19:12.949 INFO:tasks.workunit.client.0.smithi016.stderr: -350> 2024-09-12T17:19:12.747+0000 7f0dc8212640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:19:12.949 INFO:tasks.workunit.client.0.smithi016.stderr: -349> 2024-09-12T17:19:12.747+0000 7f0dc8212640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:19:12.949 INFO:tasks.workunit.client.0.smithi016.stderr: -348> 2024-09-12T17:19:12.747+0000 7f0dc8212640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:19:12.949 INFO:tasks.workunit.client.0.smithi016.stderr: -347> 2024-09-12T17:19:12.747+0000 7f0dc7210640 10 monclient(hunting): get_auth_request con 0x55f4733119f0 auth_method 0 2024-09-12T17:19:12.949 INFO:tasks.workunit.client.0.smithi016.stderr: -346> 2024-09-12T17:19:12.747+0000 7f0dc7210640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:19:12.949 INFO:tasks.workunit.client.0.smithi016.stderr: -345> 2024-09-12T17:19:12.747+0000 7f0dc7210640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:19:12.949 INFO:tasks.workunit.client.0.smithi016.stderr: -344> 2024-09-12T17:19:12.747+0000 7f0dc7210640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:19:12.950 INFO:tasks.workunit.client.0.smithi016.stderr: -343> 2024-09-12T17:19:12.747+0000 7f0dc8212640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:19:12.950 INFO:tasks.workunit.client.0.smithi016.stderr: -342> 2024-09-12T17:19:12.747+0000 7f0dc8212640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:19:12.950 INFO:tasks.workunit.client.0.smithi016.stderr: -341> 2024-09-12T17:19:12.747+0000 7f0dc8212640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:19:12.950 INFO:tasks.workunit.client.0.smithi016.stderr: -340> 2024-09-12T17:19:12.747+0000 7f0dc7210640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:19:12.950 INFO:tasks.workunit.client.0.smithi016.stderr: -339> 2024-09-12T17:19:12.747+0000 7f0dc7210640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:19:12.950 INFO:tasks.workunit.client.0.smithi016.stderr: -338> 2024-09-12T17:19:12.747+0000 7f0dc7210640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:19:12.950 INFO:tasks.workunit.client.0.smithi016.stderr: -337> 2024-09-12T17:19:12.747+0000 7f0dc8212640 10 monclient(hunting): handle_auth_done global_id 7023 payload 824 2024-09-12T17:19:12.950 INFO:tasks.workunit.client.0.smithi016.stderr: -336> 2024-09-12T17:19:12.747+0000 7f0dc8212640 10 monclient: _finish_hunting 0 2024-09-12T17:19:12.950 INFO:tasks.workunit.client.0.smithi016.stderr: -335> 2024-09-12T17:19:12.747+0000 7f0dc8212640 1 monclient: found mon.noname-a 2024-09-12T17:19:12.950 INFO:tasks.workunit.client.0.smithi016.stderr: -334> 2024-09-12T17:19:12.747+0000 7f0dc8212640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:19:12.950 INFO:tasks.workunit.client.0.smithi016.stderr: -333> 2024-09-12T17:19:12.747+0000 7f0dc7a11640 10 monclient: get_auth_request con 0x55f47330fd00 auth_method 0 2024-09-12T17:19:12.950 INFO:tasks.workunit.client.0.smithi016.stderr: -332> 2024-09-12T17:19:12.747+0000 7f0cad7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:19:12.951 INFO:tasks.workunit.client.0.smithi016.stderr: -331> 2024-09-12T17:19:12.747+0000 7f0cad7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:19:12.951 INFO:tasks.workunit.client.0.smithi016.stderr: -330> 2024-09-12T17:19:12.747+0000 7f0cad7fa640 10 monclient: dump: 2024-09-12T17:19:12.951 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:19:12.951 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:19:12.951 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:12.951 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:12.951 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:19:12.951 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:12.951 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:19:12.951 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:19:12.951 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:19:12.952 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:12.952 INFO:tasks.workunit.client.0.smithi016.stderr: -329> 2024-09-12T17:19:12.747+0000 7f0cad7fa640 10 monclient: _finish_auth 0 2024-09-12T17:19:12.952 INFO:tasks.workunit.client.0.smithi016.stderr: -328> 2024-09-12T17:19:12.747+0000 7f0cad7fa640 10 monclient: _check_auth_tickets 2024-09-12T17:19:12.952 INFO:tasks.workunit.client.0.smithi016.stderr: -327> 2024-09-12T17:19:12.747+0000 7f0cad7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:19:12.952 INFO:tasks.workunit.client.0.smithi016.stderr: -326> 2024-09-12T17:19:12.747+0000 7f0cad7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:19:12.952 INFO:tasks.workunit.client.0.smithi016.stderr: -325> 2024-09-12T17:19:12.747+0000 7f0cad7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:19:12.952 INFO:tasks.workunit.client.0.smithi016.stderr: -324> 2024-09-12T17:19:12.747+0000 7f0cad7fa640 10 monclient: dump: 2024-09-12T17:19:12.952 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:19:12.952 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:19:12.952 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:12.952 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:12.953 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:19:12.953 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:12.953 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:19:12.953 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:19:12.953 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:19:12.953 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:12.953 INFO:tasks.workunit.client.0.smithi016.stderr: -323> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 5 monclient: authenticate success, global_id 7023 2024-09-12T17:19:12.953 INFO:tasks.workunit.client.0.smithi016.stderr: -322> 2024-09-12T17:19:12.747+0000 7f0dc6a0f640 4 set_mon_vals no callback set 2024-09-12T17:19:12.953 INFO:tasks.workunit.client.0.smithi016.stderr: -321> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 10 monclient: _renew_subs 2024-09-12T17:19:12.953 INFO:tasks.workunit.client.0.smithi016.stderr: -320> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:19:12.953 INFO:tasks.workunit.client.0.smithi016.stderr: -319> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 10 monclient: _renew_subs 2024-09-12T17:19:12.954 INFO:tasks.workunit.client.0.smithi016.stderr: -318> 2024-09-12T17:19:12.747+0000 7f0dc9f0b9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:19:12.954 INFO:tasks.workunit.client.0.smithi016.stderr: -317> 2024-09-12T17:19:12.751+0000 7f0cad7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:19:12.954 INFO:tasks.workunit.client.0.smithi016.stderr: -316> 2024-09-12T17:19:12.751+0000 7f0cad7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:19:12.954 INFO:tasks.workunit.client.0.smithi016.stderr: -315> 2024-09-12T17:19:12.751+0000 7f0cad7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:19:12.954 INFO:tasks.workunit.client.0.smithi016.stderr: -314> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 10 monclient: get_monmap_and_config 2024-09-12T17:19:12.954 INFO:tasks.workunit.client.0.smithi016.stderr: -313> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 10 monclient: build_initial_monmap 2024-09-12T17:19:12.954 INFO:tasks.workunit.client.0.smithi016.stderr: -312> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 1 build_initial for_mkfs: 0 2024-09-12T17:19:12.954 INFO:tasks.workunit.client.0.smithi016.stderr: -311> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 10 monclient: monmap: 2024-09-12T17:19:12.954 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:19:12.954 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:19:12.955 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:19:12.955 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:19:12.955 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:19:12.955 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:12.955 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:19:12.955 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:19:12.955 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:19:12.955 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:12.955 INFO:tasks.workunit.client.0.smithi016.stderr: -310> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473330c70) adding auth protocol: cephx 2024-09-12T17:19:12.955 INFO:tasks.workunit.client.0.smithi016.stderr: -309> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473330c70) adding auth protocol: cephx 2024-09-12T17:19:12.955 INFO:tasks.workunit.client.0.smithi016.stderr: -308> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473330c70) adding auth protocol: cephx 2024-09-12T17:19:12.956 INFO:tasks.workunit.client.0.smithi016.stderr: -307> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473330c70) adding con mode: secure 2024-09-12T17:19:12.956 INFO:tasks.workunit.client.0.smithi016.stderr: -306> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473330c70) adding con mode: crc 2024-09-12T17:19:12.956 INFO:tasks.workunit.client.0.smithi016.stderr: -305> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473330c70) adding con mode: secure 2024-09-12T17:19:12.956 INFO:tasks.workunit.client.0.smithi016.stderr: -304> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473330c70) adding con mode: crc 2024-09-12T17:19:12.956 INFO:tasks.workunit.client.0.smithi016.stderr: -303> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473330c70) adding con mode: secure 2024-09-12T17:19:12.956 INFO:tasks.workunit.client.0.smithi016.stderr: -302> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473330c70) adding con mode: crc 2024-09-12T17:19:12.956 INFO:tasks.workunit.client.0.smithi016.stderr: -301> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473330c70) adding con mode: crc 2024-09-12T17:19:12.956 INFO:tasks.workunit.client.0.smithi016.stderr: -300> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473330c70) adding con mode: secure 2024-09-12T17:19:12.956 INFO:tasks.workunit.client.0.smithi016.stderr: -299> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473330c70) adding con mode: crc 2024-09-12T17:19:12.956 INFO:tasks.workunit.client.0.smithi016.stderr: -298> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473330c70) adding con mode: secure 2024-09-12T17:19:12.957 INFO:tasks.workunit.client.0.smithi016.stderr: -297> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473330c70) adding con mode: crc 2024-09-12T17:19:12.957 INFO:tasks.workunit.client.0.smithi016.stderr: -296> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473330c70) adding con mode: secure 2024-09-12T17:19:12.957 INFO:tasks.workunit.client.0.smithi016.stderr: -295> 2024-09-12T17:19:12.751+0000 7f0dc7210640 10 monclient: get_auth_request con 0x7f0ca0070a20 auth_method 0 2024-09-12T17:19:12.957 INFO:tasks.workunit.client.0.smithi016.stderr: -294> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:12.957 INFO:tasks.workunit.client.0.smithi016.stderr: -293> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 10 monclient: init 2024-09-12T17:19:12.957 INFO:tasks.workunit.client.0.smithi016.stderr: -292> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848f8f0) adding auth protocol: cephx 2024-09-12T17:19:12.957 INFO:tasks.workunit.client.0.smithi016.stderr: -291> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848f8f0) adding auth protocol: cephx 2024-09-12T17:19:12.957 INFO:tasks.workunit.client.0.smithi016.stderr: -290> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848f8f0) adding auth protocol: cephx 2024-09-12T17:19:12.957 INFO:tasks.workunit.client.0.smithi016.stderr: -289> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848f8f0) adding con mode: secure 2024-09-12T17:19:12.957 INFO:tasks.workunit.client.0.smithi016.stderr: -288> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848f8f0) adding con mode: crc 2024-09-12T17:19:12.957 INFO:tasks.workunit.client.0.smithi016.stderr: -287> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848f8f0) adding con mode: secure 2024-09-12T17:19:12.958 INFO:tasks.workunit.client.0.smithi016.stderr: -286> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848f8f0) adding con mode: crc 2024-09-12T17:19:12.958 INFO:tasks.workunit.client.0.smithi016.stderr: -285> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848f8f0) adding con mode: secure 2024-09-12T17:19:12.958 INFO:tasks.workunit.client.0.smithi016.stderr: -284> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848f8f0) adding con mode: crc 2024-09-12T17:19:12.958 INFO:tasks.workunit.client.0.smithi016.stderr: -283> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848f8f0) adding con mode: crc 2024-09-12T17:19:12.958 INFO:tasks.workunit.client.0.smithi016.stderr: -282> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848f8f0) adding con mode: secure 2024-09-12T17:19:12.958 INFO:tasks.workunit.client.0.smithi016.stderr: -281> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848f8f0) adding con mode: crc 2024-09-12T17:19:12.958 INFO:tasks.workunit.client.0.smithi016.stderr: -280> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848f8f0) adding con mode: secure 2024-09-12T17:19:12.958 INFO:tasks.workunit.client.0.smithi016.stderr: -279> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848f8f0) adding con mode: crc 2024-09-12T17:19:12.958 INFO:tasks.workunit.client.0.smithi016.stderr: -278> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848f8f0) adding con mode: secure 2024-09-12T17:19:12.958 INFO:tasks.workunit.client.0.smithi016.stderr: -277> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:12.958 INFO:tasks.workunit.client.0.smithi016.stderr: -276> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:12.958 INFO:tasks.workunit.client.0.smithi016.stderr: -275> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 asok(0x55f47308b2b0) register_command rotate-key cmddesc rotate-key hook 0x7fff1848fa38 EEXIST 2024-09-12T17:19:12.959 INFO:tasks.workunit.client.0.smithi016.stderr: -274> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:19:12.959 INFO:tasks.workunit.client.0.smithi016.stderr: -273> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:19:12.959 INFO:tasks.workunit.client.0.smithi016.stderr: -272> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 10 monclient(hunting): picked mon.noname-b con 0x55f473364e50 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:19:12.959 INFO:tasks.workunit.client.0.smithi016.stderr: -271> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 10 monclient(hunting): picked mon.noname-a con 0x55f473365230 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:19:12.959 INFO:tasks.workunit.client.0.smithi016.stderr: -270> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 10 monclient(hunting): picked mon.noname-c con 0x55f473360a10 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:19:12.959 INFO:tasks.workunit.client.0.smithi016.stderr: -269> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:12.959 INFO:tasks.workunit.client.0.smithi016.stderr: -268> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:12.959 INFO:tasks.workunit.client.0.smithi016.stderr: -267> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:12.959 INFO:tasks.workunit.client.0.smithi016.stderr: -266> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:19:12.959 INFO:tasks.workunit.client.0.smithi016.stderr: -265> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 10 monclient(hunting): authenticate will time out at 2270.730465s 2024-09-12T17:19:12.960 INFO:tasks.workunit.client.0.smithi016.stderr: -264> 2024-09-12T17:19:12.751+0000 7f0dc8212640 10 monclient(hunting): get_auth_request con 0x55f473365230 auth_method 0 2024-09-12T17:19:12.960 INFO:tasks.workunit.client.0.smithi016.stderr: -263> 2024-09-12T17:19:12.751+0000 7f0dc8212640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:19:12.960 INFO:tasks.workunit.client.0.smithi016.stderr: -262> 2024-09-12T17:19:12.751+0000 7f0dc8212640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:19:12.960 INFO:tasks.workunit.client.0.smithi016.stderr: -261> 2024-09-12T17:19:12.751+0000 7f0dc8212640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:19:12.960 INFO:tasks.workunit.client.0.smithi016.stderr: -260> 2024-09-12T17:19:12.751+0000 7f0dc7a11640 10 monclient(hunting): get_auth_request con 0x55f473360a10 auth_method 0 2024-09-12T17:19:12.960 INFO:tasks.workunit.client.0.smithi016.stderr: -259> 2024-09-12T17:19:12.751+0000 7f0dc7a11640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:19:12.960 INFO:tasks.workunit.client.0.smithi016.stderr: -258> 2024-09-12T17:19:12.751+0000 7f0dc7a11640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:19:12.960 INFO:tasks.workunit.client.0.smithi016.stderr: -257> 2024-09-12T17:19:12.751+0000 7f0dc7a11640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:19:12.960 INFO:tasks.workunit.client.0.smithi016.stderr: -256> 2024-09-12T17:19:12.751+0000 7f0dc8212640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:19:12.960 INFO:tasks.workunit.client.0.smithi016.stderr: -255> 2024-09-12T17:19:12.751+0000 7f0dc8212640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:19:12.960 INFO:tasks.workunit.client.0.smithi016.stderr: -254> 2024-09-12T17:19:12.751+0000 7f0dc8212640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:19:12.961 INFO:tasks.workunit.client.0.smithi016.stderr: -253> 2024-09-12T17:19:12.751+0000 7f0dc7a11640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:19:12.961 INFO:tasks.workunit.client.0.smithi016.stderr: -252> 2024-09-12T17:19:12.751+0000 7f0dc7a11640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:19:12.961 INFO:tasks.workunit.client.0.smithi016.stderr: -251> 2024-09-12T17:19:12.751+0000 7f0dc7a11640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:19:12.961 INFO:tasks.workunit.client.0.smithi016.stderr: -250> 2024-09-12T17:19:12.751+0000 7f0dc7a11640 10 monclient(hunting): handle_auth_done global_id 6722 payload 274 2024-09-12T17:19:12.961 INFO:tasks.workunit.client.0.smithi016.stderr: -249> 2024-09-12T17:19:12.751+0000 7f0dc7a11640 10 monclient: _finish_hunting 0 2024-09-12T17:19:12.961 INFO:tasks.workunit.client.0.smithi016.stderr: -248> 2024-09-12T17:19:12.751+0000 7f0dc7a11640 1 monclient: found mon.noname-c 2024-09-12T17:19:12.961 INFO:tasks.workunit.client.0.smithi016.stderr: -247> 2024-09-12T17:19:12.751+0000 7f0dc7a11640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:19:12.961 INFO:tasks.workunit.client.0.smithi016.stderr: -246> 2024-09-12T17:19:12.751+0000 7f0ca6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:19:12.962 INFO:tasks.workunit.client.0.smithi016.stderr: -245> 2024-09-12T17:19:12.751+0000 7f0ca6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:19:12.962 INFO:tasks.workunit.client.0.smithi016.stderr: -244> 2024-09-12T17:19:12.751+0000 7f0ca6ffd640 10 monclient: dump: 2024-09-12T17:19:12.962 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:19:12.962 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:19:12.962 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:12.962 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:12.962 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:19:12.962 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:12.962 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:19:12.962 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:19:12.962 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:19:12.962 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:12.963 INFO:tasks.workunit.client.0.smithi016.stderr: -243> 2024-09-12T17:19:12.751+0000 7f0ca6ffd640 10 monclient: _finish_auth 0 2024-09-12T17:19:12.963 INFO:tasks.workunit.client.0.smithi016.stderr: -242> 2024-09-12T17:19:12.751+0000 7f0ca6ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:19:12.963 INFO:tasks.workunit.client.0.smithi016.stderr: -241> 2024-09-12T17:19:12.751+0000 7f0ca6ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:19:12.963 INFO:tasks.workunit.client.0.smithi016.stderr: -240> 2024-09-12T17:19:12.751+0000 7f0ca6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:19:12.963 INFO:tasks.workunit.client.0.smithi016.stderr: -239> 2024-09-12T17:19:12.751+0000 7f0ca6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:19:12.963 INFO:tasks.workunit.client.0.smithi016.stderr: -238> 2024-09-12T17:19:12.751+0000 7f0ca6ffd640 10 monclient: dump: 2024-09-12T17:19:12.963 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:19:12.963 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:19:12.963 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:12.963 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:12.963 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:19:12.963 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:12.964 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:19:12.964 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:19:12.964 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:19:12.964 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:12.964 INFO:tasks.workunit.client.0.smithi016.stderr: -237> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 5 monclient: authenticate success, global_id 6722 2024-09-12T17:19:12.964 INFO:tasks.workunit.client.0.smithi016.stderr: -236> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 10 monclient: get_monmap_and_config success 2024-09-12T17:19:12.964 INFO:tasks.workunit.client.0.smithi016.stderr: -235> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 4 set_mon_vals no callback set 2024-09-12T17:19:12.964 INFO:tasks.workunit.client.0.smithi016.stderr: -234> 2024-09-12T17:19:12.751+0000 7f0dc9f0b9c0 10 monclient: shutdown 2024-09-12T17:19:12.964 INFO:tasks.workunit.client.0.smithi016.stderr: -233> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 10 monclient: build_initial_monmap 2024-09-12T17:19:12.964 INFO:tasks.workunit.client.0.smithi016.stderr: -232> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 1 build_initial for_mkfs: 0 2024-09-12T17:19:12.964 INFO:tasks.workunit.client.0.smithi016.stderr: -231> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 10 monclient: monmap: 2024-09-12T17:19:12.965 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:19:12.965 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:19:12.965 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:19:12.965 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:19:12.965 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:19:12.965 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:12.965 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:19:12.965 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:19:12.965 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:19:12.965 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:12.965 INFO:tasks.workunit.client.0.smithi016.stderr: -230> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473355690) adding auth protocol: cephx 2024-09-12T17:19:12.966 INFO:tasks.workunit.client.0.smithi016.stderr: -229> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473355690) adding auth protocol: cephx 2024-09-12T17:19:12.966 INFO:tasks.workunit.client.0.smithi016.stderr: -228> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473355690) adding auth protocol: cephx 2024-09-12T17:19:12.966 INFO:tasks.workunit.client.0.smithi016.stderr: -227> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473355690) adding con mode: secure 2024-09-12T17:19:12.966 INFO:tasks.workunit.client.0.smithi016.stderr: -226> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473355690) adding con mode: crc 2024-09-12T17:19:12.966 INFO:tasks.workunit.client.0.smithi016.stderr: -225> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473355690) adding con mode: secure 2024-09-12T17:19:12.966 INFO:tasks.workunit.client.0.smithi016.stderr: -224> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473355690) adding con mode: crc 2024-09-12T17:19:12.966 INFO:tasks.workunit.client.0.smithi016.stderr: -223> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473355690) adding con mode: secure 2024-09-12T17:19:12.966 INFO:tasks.workunit.client.0.smithi016.stderr: -222> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473355690) adding con mode: crc 2024-09-12T17:19:12.966 INFO:tasks.workunit.client.0.smithi016.stderr: -221> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473355690) adding con mode: crc 2024-09-12T17:19:12.966 INFO:tasks.workunit.client.0.smithi016.stderr: -220> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473355690) adding con mode: secure 2024-09-12T17:19:12.966 INFO:tasks.workunit.client.0.smithi016.stderr: -219> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473355690) adding con mode: crc 2024-09-12T17:19:12.966 INFO:tasks.workunit.client.0.smithi016.stderr: -218> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473355690) adding con mode: secure 2024-09-12T17:19:12.966 INFO:tasks.workunit.client.0.smithi016.stderr: -217> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473355690) adding con mode: crc 2024-09-12T17:19:12.967 INFO:tasks.workunit.client.0.smithi016.stderr: -216> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473355690) adding con mode: secure 2024-09-12T17:19:12.967 INFO:tasks.workunit.client.0.smithi016.stderr: -215> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:12.967 INFO:tasks.workunit.client.0.smithi016.stderr: -214> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 1 librados: starting msgr at 2024-09-12T17:19:12.967 INFO:tasks.workunit.client.0.smithi016.stderr: -213> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 1 librados: starting objecter 2024-09-12T17:19:12.967 INFO:tasks.workunit.client.0.smithi016.stderr: -212> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 asok(0x55f47308b2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55f4732c6d10 EEXIST 2024-09-12T17:19:12.967 INFO:tasks.workunit.client.0.smithi016.stderr: -211> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 1 librados: setting wanted keys 2024-09-12T17:19:12.967 INFO:tasks.workunit.client.0.smithi016.stderr: -210> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 1 librados: calling monclient init 2024-09-12T17:19:12.967 INFO:tasks.workunit.client.0.smithi016.stderr: -209> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 10 monclient: init 2024-09-12T17:19:12.967 INFO:tasks.workunit.client.0.smithi016.stderr: -208> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473313810) adding auth protocol: cephx 2024-09-12T17:19:12.967 INFO:tasks.workunit.client.0.smithi016.stderr: -207> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473313810) adding auth protocol: cephx 2024-09-12T17:19:12.967 INFO:tasks.workunit.client.0.smithi016.stderr: -206> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473313810) adding auth protocol: cephx 2024-09-12T17:19:12.967 INFO:tasks.workunit.client.0.smithi016.stderr: -205> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473313810) adding con mode: secure 2024-09-12T17:19:12.968 INFO:tasks.workunit.client.0.smithi016.stderr: -204> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473313810) adding con mode: crc 2024-09-12T17:19:12.968 INFO:tasks.workunit.client.0.smithi016.stderr: -203> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473313810) adding con mode: secure 2024-09-12T17:19:12.968 INFO:tasks.workunit.client.0.smithi016.stderr: -202> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473313810) adding con mode: crc 2024-09-12T17:19:12.968 INFO:tasks.workunit.client.0.smithi016.stderr: -201> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473313810) adding con mode: secure 2024-09-12T17:19:12.968 INFO:tasks.workunit.client.0.smithi016.stderr: -200> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473313810) adding con mode: crc 2024-09-12T17:19:12.968 INFO:tasks.workunit.client.0.smithi016.stderr: -199> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473313810) adding con mode: crc 2024-09-12T17:19:12.968 INFO:tasks.workunit.client.0.smithi016.stderr: -198> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473313810) adding con mode: secure 2024-09-12T17:19:12.968 INFO:tasks.workunit.client.0.smithi016.stderr: -197> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473313810) adding con mode: crc 2024-09-12T17:19:12.968 INFO:tasks.workunit.client.0.smithi016.stderr: -196> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473313810) adding con mode: secure 2024-09-12T17:19:12.968 INFO:tasks.workunit.client.0.smithi016.stderr: -195> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473313810) adding con mode: crc 2024-09-12T17:19:12.968 INFO:tasks.workunit.client.0.smithi016.stderr: -194> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 AuthRegistry(0x55f473313810) adding con mode: secure 2024-09-12T17:19:12.968 INFO:tasks.workunit.client.0.smithi016.stderr: -193> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:12.969 INFO:tasks.workunit.client.0.smithi016.stderr: -192> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:12.969 INFO:tasks.workunit.client.0.smithi016.stderr: -191> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 asok(0x55f47308b2b0) register_command rotate-key cmddesc rotate-key hook 0x55f473313958 EEXIST 2024-09-12T17:19:12.969 INFO:tasks.workunit.client.0.smithi016.stderr: -190> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:19:12.969 INFO:tasks.workunit.client.0.smithi016.stderr: -189> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:19:12.969 INFO:tasks.workunit.client.0.smithi016.stderr: -188> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 10 monclient(hunting): picked mon.noname-c con 0x55f473360a10 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:19:12.969 INFO:tasks.workunit.client.0.smithi016.stderr: -187> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 10 monclient(hunting): picked mon.noname-a con 0x55f473364e50 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:19:12.969 INFO:tasks.workunit.client.0.smithi016.stderr: -186> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 10 monclient(hunting): picked mon.noname-b con 0x55f473372b20 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:19:12.969 INFO:tasks.workunit.client.0.smithi016.stderr: -185> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:12.969 INFO:tasks.workunit.client.0.smithi016.stderr: -184> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:12.969 INFO:tasks.workunit.client.0.smithi016.stderr: -183> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:12.969 INFO:tasks.workunit.client.0.smithi016.stderr: -182> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:19:12.969 INFO:tasks.workunit.client.0.smithi016.stderr: -181> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 10 monclient(hunting): authenticate will time out at 2270.733139s 2024-09-12T17:19:12.970 INFO:tasks.workunit.client.0.smithi016.stderr: -180> 2024-09-12T17:19:12.755+0000 7f0dc8212640 10 monclient(hunting): get_auth_request con 0x55f473364e50 auth_method 0 2024-09-12T17:19:12.970 INFO:tasks.workunit.client.0.smithi016.stderr: -179> 2024-09-12T17:19:12.755+0000 7f0dc8212640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:19:12.970 INFO:tasks.workunit.client.0.smithi016.stderr: -178> 2024-09-12T17:19:12.755+0000 7f0dc8212640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:19:12.970 INFO:tasks.workunit.client.0.smithi016.stderr: -177> 2024-09-12T17:19:12.755+0000 7f0dc8212640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:19:12.970 INFO:tasks.workunit.client.0.smithi016.stderr: -176> 2024-09-12T17:19:12.755+0000 7f0dc7210640 10 monclient(hunting): get_auth_request con 0x55f473360a10 auth_method 0 2024-09-12T17:19:12.970 INFO:tasks.workunit.client.0.smithi016.stderr: -175> 2024-09-12T17:19:12.755+0000 7f0dc7210640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:19:12.970 INFO:tasks.workunit.client.0.smithi016.stderr: -174> 2024-09-12T17:19:12.755+0000 7f0dc7210640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:19:12.970 INFO:tasks.workunit.client.0.smithi016.stderr: -173> 2024-09-12T17:19:12.755+0000 7f0dc7210640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:19:12.970 INFO:tasks.workunit.client.0.smithi016.stderr: -172> 2024-09-12T17:19:12.755+0000 7f0dc8212640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:19:12.970 INFO:tasks.workunit.client.0.smithi016.stderr: -171> 2024-09-12T17:19:12.755+0000 7f0dc8212640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:19:12.970 INFO:tasks.workunit.client.0.smithi016.stderr: -170> 2024-09-12T17:19:12.755+0000 7f0dc8212640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:19:12.971 INFO:tasks.workunit.client.0.smithi016.stderr: -169> 2024-09-12T17:19:12.755+0000 7f0dc7210640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:19:12.971 INFO:tasks.workunit.client.0.smithi016.stderr: -168> 2024-09-12T17:19:12.755+0000 7f0dc7210640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:19:12.971 INFO:tasks.workunit.client.0.smithi016.stderr: -167> 2024-09-12T17:19:12.755+0000 7f0dc7210640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:19:12.971 INFO:tasks.workunit.client.0.smithi016.stderr: -166> 2024-09-12T17:19:12.755+0000 7f0dc8212640 10 monclient(hunting): handle_auth_done global_id 7029 payload 824 2024-09-12T17:19:12.971 INFO:tasks.workunit.client.0.smithi016.stderr: -165> 2024-09-12T17:19:12.755+0000 7f0dc8212640 10 monclient: _finish_hunting 0 2024-09-12T17:19:12.971 INFO:tasks.workunit.client.0.smithi016.stderr: -164> 2024-09-12T17:19:12.755+0000 7f0dc8212640 1 monclient: found mon.noname-a 2024-09-12T17:19:12.971 INFO:tasks.workunit.client.0.smithi016.stderr: -163> 2024-09-12T17:19:12.755+0000 7f0dc8212640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:19:12.971 INFO:tasks.workunit.client.0.smithi016.stderr: -162> 2024-09-12T17:19:12.755+0000 7f0ca57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:19:12.971 INFO:tasks.workunit.client.0.smithi016.stderr: -161> 2024-09-12T17:19:12.755+0000 7f0ca57fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:19:12.971 INFO:tasks.workunit.client.0.smithi016.stderr: -160> 2024-09-12T17:19:12.755+0000 7f0ca57fa640 10 monclient: dump: 2024-09-12T17:19:12.971 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:19:12.971 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:19:12.972 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:12.972 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:12.972 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:19:12.972 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:12.972 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:19:12.972 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:19:12.972 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:19:12.972 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:12.972 INFO:tasks.workunit.client.0.smithi016.stderr: -159> 2024-09-12T17:19:12.755+0000 7f0ca57fa640 10 monclient: _finish_auth 0 2024-09-12T17:19:12.972 INFO:tasks.workunit.client.0.smithi016.stderr: -158> 2024-09-12T17:19:12.755+0000 7f0ca57fa640 10 monclient: _check_auth_tickets 2024-09-12T17:19:12.972 INFO:tasks.workunit.client.0.smithi016.stderr: -157> 2024-09-12T17:19:12.755+0000 7f0ca57fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:19:12.973 INFO:tasks.workunit.client.0.smithi016.stderr: -156> 2024-09-12T17:19:12.755+0000 7f0ca57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:19:12.973 INFO:tasks.workunit.client.0.smithi016.stderr: -155> 2024-09-12T17:19:12.755+0000 7f0ca57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:19:12.973 INFO:tasks.workunit.client.0.smithi016.stderr: -154> 2024-09-12T17:19:12.755+0000 7f0ca57fa640 10 monclient: dump: 2024-09-12T17:19:12.973 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:19:12.973 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:19:12.973 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:12.973 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:12.973 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:19:12.973 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:12.973 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:19:12.973 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:19:12.974 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:19:12.974 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:12.974 INFO:tasks.workunit.client.0.smithi016.stderr: -153> 2024-09-12T17:19:12.755+0000 7f0ca6ffd640 4 set_mon_vals no callback set 2024-09-12T17:19:12.974 INFO:tasks.workunit.client.0.smithi016.stderr: -152> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 monclient: authenticate success, global_id 7029 2024-09-12T17:19:12.974 INFO:tasks.workunit.client.0.smithi016.stderr: -151> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 10 monclient: _renew_subs 2024-09-12T17:19:12.974 INFO:tasks.workunit.client.0.smithi016.stderr: -150> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:19:12.974 INFO:tasks.workunit.client.0.smithi016.stderr: -149> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 10 monclient: _renew_subs 2024-09-12T17:19:12.974 INFO:tasks.workunit.client.0.smithi016.stderr: -148> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:19:12.974 INFO:tasks.workunit.client.0.smithi016.stderr: -147> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 1 librados: init done 2024-09-12T17:19:12.974 INFO:tasks.workunit.client.0.smithi016.stderr: -146> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 5 asok(0x55f47308b2b0) register_command cr dump hook 0x55f47335afc8 2024-09-12T17:19:12.974 INFO:tasks.workunit.client.0.smithi016.stderr: -145> 2024-09-12T17:19:12.755+0000 7f0dc9f0b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.975 INFO:tasks.workunit.client.0.smithi016.stderr: -144> 2024-09-12T17:19:12.759+0000 7f0ca57fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:19:12.975 INFO:tasks.workunit.client.0.smithi016.stderr: -143> 2024-09-12T17:19:12.759+0000 7f0ca57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:19:12.975 INFO:tasks.workunit.client.0.smithi016.stderr: -142> 2024-09-12T17:19:12.759+0000 7f0ca57fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:19:12.975 INFO:tasks.workunit.client.0.smithi016.stderr: -141> 2024-09-12T17:19:12.759+0000 7f0dc7a11640 10 monclient: get_auth_request con 0x55f47337e900 auth_method 0 2024-09-12T17:19:12.975 INFO:tasks.workunit.client.0.smithi016.stderr: -140> 2024-09-12T17:19:12.759+0000 7f0dc7210640 10 monclient: get_auth_request con 0x7f0c90070b10 auth_method 0 2024-09-12T17:19:12.975 INFO:tasks.workunit.client.0.smithi016.stderr: -139> 2024-09-12T17:19:12.759+0000 7f0dc9f0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:12.975 INFO:tasks.workunit.client.0.smithi016.stderr: -138> 2024-09-12T17:19:12.759+0000 7f0dc9f0b9c0 20 realm 2024-09-12T17:19:12.975 INFO:tasks.workunit.client.0.smithi016.stderr: -137> 2024-09-12T17:19:12.759+0000 7f0dc9f0b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.975 INFO:tasks.workunit.client.0.smithi016.stderr: -136> 2024-09-12T17:19:12.759+0000 7f0dc9f0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:12.975 INFO:tasks.workunit.client.0.smithi016.stderr: -135> 2024-09-12T17:19:12.759+0000 7f0dc9f0b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:19:12.975 INFO:tasks.workunit.client.0.smithi016.stderr: -134> 2024-09-12T17:19:12.759+0000 7f0dc9f0b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.976 INFO:tasks.workunit.client.0.smithi016.stderr: -133> 2024-09-12T17:19:12.759+0000 7f0dc9f0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:12.976 INFO:tasks.workunit.client.0.smithi016.stderr: -132> 2024-09-12T17:19:12.759+0000 7f0dc9f0b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.976 INFO:tasks.workunit.client.0.smithi016.stderr: -131> 2024-09-12T17:19:12.759+0000 7f0dc7210640 10 monclient: get_auth_request con 0x55f473382bc0 auth_method 0 2024-09-12T17:19:12.976 INFO:tasks.workunit.client.0.smithi016.stderr: -130> 2024-09-12T17:19:12.759+0000 7f0dc9f0b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:12.976 INFO:tasks.workunit.client.0.smithi016.stderr: -129> 2024-09-12T17:19:12.759+0000 7f0dc9f0b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.976 INFO:tasks.workunit.client.0.smithi016.stderr: -128> 2024-09-12T17:19:12.763+0000 7f0dc8212640 10 monclient: get_auth_request con 0x55f473386450 auth_method 0 2024-09-12T17:19:12.976 INFO:tasks.workunit.client.0.smithi016.stderr: -127> 2024-09-12T17:19:12.763+0000 7f0dc9f0b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:19:12.976 INFO:tasks.workunit.client.0.smithi016.stderr: -126> 2024-09-12T17:19:12.763+0000 7f0dc9f0b9c0 20 searching for the correct realm 2024-09-12T17:19:12.976 INFO:tasks.workunit.client.0.smithi016.stderr: -125> 2024-09-12T17:19:12.763+0000 7f0dc7a11640 10 monclient: get_auth_request con 0x55f47338b1f0 auth_method 0 2024-09-12T17:19:12.976 INFO:tasks.workunit.client.0.smithi016.stderr: -124> 2024-09-12T17:19:12.763+0000 7f0dc7210640 10 monclient: get_auth_request con 0x7f0db8028040 auth_method 0 2024-09-12T17:19:12.976 INFO:tasks.workunit.client.0.smithi016.stderr: -123> 2024-09-12T17:19:12.763+0000 7f0dc7210640 0 -- 172.21.15.16:0/3305785925 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7f0db8028040 msgr2=0x7f0db8040400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:19:12.976 INFO:tasks.workunit.client.0.smithi016.stderr: -122> 2024-09-12T17:19:12.763+0000 7f0ca57fa640 1 client.7029.objecter ms_handle_reset 0x7f0db8028040 session 0x7f0db8013040 osd.7 2024-09-12T17:19:12.976 INFO:tasks.workunit.client.0.smithi016.stderr: -121> 2024-09-12T17:19:12.763+0000 7f0ca57fa640 10 monclient: _renew_subs 2024-09-12T17:19:12.977 INFO:tasks.workunit.client.0.smithi016.stderr: -120> 2024-09-12T17:19:12.763+0000 7f0ca57fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:19:12.977 INFO:tasks.workunit.client.0.smithi016.stderr: -119> 2024-09-12T17:19:12.763+0000 7f0dc7210640 10 monclient: get_auth_request con 0x7f0c900808b0 auth_method 0 2024-09-12T17:19:12.977 INFO:tasks.workunit.client.0.smithi016.stderr: -118> 2024-09-12T17:19:12.767+0000 7f0dc8212640 10 monclient: get_auth_request con 0x7f0dbc049420 auth_method 0 2024-09-12T17:19:12.977 INFO:tasks.workunit.client.0.smithi016.stderr: -117> 2024-09-12T17:19:12.771+0000 7f0dc7a11640 10 monclient: get_auth_request con 0x7f0dc00ffc20 auth_method 0 2024-09-12T17:19:12.977 INFO:tasks.workunit.client.0.smithi016.stderr: -116> 2024-09-12T17:19:12.771+0000 7f0dc8212640 0 -- 172.21.15.16:0/3305785925 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f0dbc049420 msgr2=0x7f0dbc049840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:19:12.977 INFO:tasks.workunit.client.0.smithi016.stderr: -115> 2024-09-12T17:19:12.771+0000 7f0ca57fa640 1 client.7029.objecter ms_handle_reset 0x7f0dbc049420 session 0x7f0dbc017040 osd.2 2024-09-12T17:19:12.977 INFO:tasks.workunit.client.0.smithi016.stderr: -114> 2024-09-12T17:19:12.771+0000 7f0dc8212640 10 monclient: get_auth_request con 0x7f0db8028040 auth_method 0 2024-09-12T17:19:12.977 INFO:tasks.workunit.client.0.smithi016.stderr: -113> 2024-09-12T17:19:12.775+0000 7f0dc7210640 10 monclient: get_auth_request con 0x55f4731235f0 auth_method 0 2024-09-12T17:19:12.977 INFO:tasks.workunit.client.0.smithi016.stderr: -112> 2024-09-12T17:19:12.783+0000 7f0dc9f0b9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:19:12.977 INFO:tasks.workunit.client.0.smithi016.stderr: -111> 2024-09-12T17:19:12.783+0000 7f0dc9f0b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:19:12.977 INFO:tasks.workunit.client.0.smithi016.stderr: -110> 2024-09-12T17:19:12.783+0000 7f0dc9f0b9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:19:12.978 INFO:tasks.workunit.client.0.smithi016.stderr: -109> 2024-09-12T17:19:12.783+0000 7f0dc9f0b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:19:12.978 INFO:tasks.workunit.client.0.smithi016.stderr: -108> 2024-09-12T17:19:12.783+0000 7f0dc9f0b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:19:12.978 INFO:tasks.workunit.client.0.smithi016.stderr: -107> 2024-09-12T17:19:12.783+0000 7f0dc9f0b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:19:12.978 INFO:tasks.workunit.client.0.smithi016.stderr: -106> 2024-09-12T17:19:12.783+0000 7f0dc9f0b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.978 INFO:tasks.workunit.client.0.smithi016.stderr: -105> 2024-09-12T17:19:12.783+0000 7f0dc9f0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:12.978 INFO:tasks.workunit.client.0.smithi016.stderr: -104> 2024-09-12T17:19:12.783+0000 7f0dc9f0b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.978 INFO:tasks.workunit.client.0.smithi016.stderr: -103> 2024-09-12T17:19:12.783+0000 7f0dc9f0b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:12.978 INFO:tasks.workunit.client.0.smithi016.stderr: -102> 2024-09-12T17:19:12.783+0000 7f0dc9f0b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.978 INFO:tasks.workunit.client.0.smithi016.stderr: -101> 2024-09-12T17:19:12.783+0000 7f0dc9f0b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:19:12.978 INFO:tasks.workunit.client.0.smithi016.stderr: -100> 2024-09-12T17:19:12.787+0000 7f0dc9f0b9c0 20 zone default found 2024-09-12T17:19:12.978 INFO:tasks.workunit.client.0.smithi016.stderr: -99> 2024-09-12T17:19:12.787+0000 7f0dc9f0b9c0 4 Realm: () 2024-09-12T17:19:12.979 INFO:tasks.workunit.client.0.smithi016.stderr: -98> 2024-09-12T17:19:12.787+0000 7f0dc9f0b9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:19:12.979 INFO:tasks.workunit.client.0.smithi016.stderr: -97> 2024-09-12T17:19:12.787+0000 7f0dc9f0b9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:19:12.979 INFO:tasks.workunit.client.0.smithi016.stderr: -96> 2024-09-12T17:19:12.787+0000 7f0dc9f0b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:19:12.979 INFO:tasks.workunit.client.0.smithi016.stderr: -95> 2024-09-12T17:19:12.787+0000 7f0dc9f0b9c0 20 zonegroup default 2024-09-12T17:19:12.979 INFO:tasks.workunit.client.0.smithi016.stderr: -94> 2024-09-12T17:19:12.787+0000 7f0dc9f0b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.979 INFO:tasks.workunit.client.0.smithi016.stderr: -93> 2024-09-12T17:19:12.787+0000 7f0dc9f0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:12.979 INFO:tasks.workunit.client.0.smithi016.stderr: -92> 2024-09-12T17:19:12.787+0000 7f0dc9f0b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.979 INFO:tasks.workunit.client.0.smithi016.stderr: -91> 2024-09-12T17:19:12.787+0000 7f0dc9f0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:12.979 INFO:tasks.workunit.client.0.smithi016.stderr: -90> 2024-09-12T17:19:12.787+0000 7f0dc9f0b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.979 INFO:tasks.workunit.client.0.smithi016.stderr: -89> 2024-09-12T17:19:12.787+0000 7f0dc9f0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:12.979 INFO:tasks.workunit.client.0.smithi016.stderr: -88> 2024-09-12T17:19:12.787+0000 7f0dc9f0b9c0 20 started sync module instance, tier type = 2024-09-12T17:19:12.980 INFO:tasks.workunit.client.0.smithi016.stderr: -87> 2024-09-12T17:19:12.787+0000 7f0dc9f0b9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:19:12.980 INFO:tasks.workunit.client.0.smithi016.stderr: -86> 2024-09-12T17:19:12.803+0000 7f0dc9f0b9c0 20 add_watcher() i=0 2024-09-12T17:19:12.980 INFO:tasks.workunit.client.0.smithi016.stderr: -85> 2024-09-12T17:19:12.803+0000 7f0dc9f0b9c0 20 add_watcher() i=1 2024-09-12T17:19:12.980 INFO:tasks.workunit.client.0.smithi016.stderr: -84> 2024-09-12T17:19:12.803+0000 7f0dc9f0b9c0 20 add_watcher() i=2 2024-09-12T17:19:12.980 INFO:tasks.workunit.client.0.smithi016.stderr: -83> 2024-09-12T17:19:12.803+0000 7f0dc9f0b9c0 20 add_watcher() i=3 2024-09-12T17:19:12.980 INFO:tasks.workunit.client.0.smithi016.stderr: -82> 2024-09-12T17:19:12.803+0000 7f0dc9f0b9c0 20 add_watcher() i=4 2024-09-12T17:19:12.980 INFO:tasks.workunit.client.0.smithi016.stderr: -81> 2024-09-12T17:19:12.803+0000 7f0dc9f0b9c0 20 add_watcher() i=5 2024-09-12T17:19:12.980 INFO:tasks.workunit.client.0.smithi016.stderr: -80> 2024-09-12T17:19:12.803+0000 7f0dc9f0b9c0 20 add_watcher() i=6 2024-09-12T17:19:12.980 INFO:tasks.workunit.client.0.smithi016.stderr: -79> 2024-09-12T17:19:12.803+0000 7f0dc9f0b9c0 20 add_watcher() i=7 2024-09-12T17:19:12.980 INFO:tasks.workunit.client.0.smithi016.stderr: -78> 2024-09-12T17:19:12.803+0000 7f0dc9f0b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:19:12.980 INFO:tasks.workunit.client.0.smithi016.stderr: -77> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848fdc0) adding auth protocol: cephx 2024-09-12T17:19:12.981 INFO:tasks.workunit.client.0.smithi016.stderr: -76> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848fdc0) adding auth protocol: cephx 2024-09-12T17:19:12.981 INFO:tasks.workunit.client.0.smithi016.stderr: -75> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848fdc0) adding auth protocol: cephx 2024-09-12T17:19:12.981 INFO:tasks.workunit.client.0.smithi016.stderr: -74> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848fdc0) adding con mode: secure 2024-09-12T17:19:12.981 INFO:tasks.workunit.client.0.smithi016.stderr: -73> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848fdc0) adding con mode: crc 2024-09-12T17:19:12.981 INFO:tasks.workunit.client.0.smithi016.stderr: -72> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848fdc0) adding con mode: secure 2024-09-12T17:19:12.981 INFO:tasks.workunit.client.0.smithi016.stderr: -71> 2024-09-12T17:19:12.807+0000 7f0c7dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:12.981 INFO:tasks.workunit.client.0.smithi016.stderr: -70> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848fdc0) adding con mode: crc 2024-09-12T17:19:12.981 INFO:tasks.workunit.client.0.smithi016.stderr: -69> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848fdc0) adding con mode: secure 2024-09-12T17:19:12.981 INFO:tasks.workunit.client.0.smithi016.stderr: -68> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848fdc0) adding con mode: crc 2024-09-12T17:19:12.981 INFO:tasks.workunit.client.0.smithi016.stderr: -67> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848fdc0) adding con mode: crc 2024-09-12T17:19:12.981 INFO:tasks.workunit.client.0.smithi016.stderr: -66> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848fdc0) adding con mode: secure 2024-09-12T17:19:12.982 INFO:tasks.workunit.client.0.smithi016.stderr: -65> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848fdc0) adding con mode: crc 2024-09-12T17:19:12.982 INFO:tasks.workunit.client.0.smithi016.stderr: -64> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848fdc0) adding con mode: secure 2024-09-12T17:19:12.982 INFO:tasks.workunit.client.0.smithi016.stderr: -63> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848fdc0) adding con mode: crc 2024-09-12T17:19:12.982 INFO:tasks.workunit.client.0.smithi016.stderr: -62> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 AuthRegistry(0x7fff1848fdc0) adding con mode: secure 2024-09-12T17:19:12.982 INFO:tasks.workunit.client.0.smithi016.stderr: -61> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:12.982 INFO:tasks.workunit.client.0.smithi016.stderr: -60> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:19:12.982 INFO:tasks.workunit.client.0.smithi016.stderr: -59> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:19:12.982 INFO:tasks.workunit.client.0.smithi016.stderr: -58> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 asok(0x55f47308b2b0) register_command cache list hook 0x55f47335a4a0 2024-09-12T17:19:12.982 INFO:tasks.workunit.client.0.smithi016.stderr: -57> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 asok(0x55f47308b2b0) register_command cache inspect hook 0x55f47335a4a0 2024-09-12T17:19:12.982 INFO:tasks.workunit.client.0.smithi016.stderr: -56> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 asok(0x55f47308b2b0) register_command cache erase hook 0x55f47335a4a0 2024-09-12T17:19:12.982 INFO:tasks.workunit.client.0.smithi016.stderr: -55> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 asok(0x55f47308b2b0) register_command cache zap hook 0x55f47335a4a0 2024-09-12T17:19:12.983 INFO:tasks.workunit.client.0.smithi016.stderr: -54> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 note: GC not initialized 2024-09-12T17:19:12.983 INFO:tasks.workunit.client.0.smithi016.stderr: -53> 2024-09-12T17:19:12.807+0000 7f0c7cfe1640 20 reqs_thread_entry: start 2024-09-12T17:19:12.983 INFO:tasks.workunit.client.0.smithi016.stderr: -52> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 asok(0x55f47308b2b0) register_command sync trace show hook 0x7f0db0001d40 2024-09-12T17:19:12.983 INFO:tasks.workunit.client.0.smithi016.stderr: -51> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 asok(0x55f47308b2b0) register_command sync trace history hook 0x7f0db0001d40 2024-09-12T17:19:12.983 INFO:tasks.workunit.client.0.smithi016.stderr: -50> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 asok(0x55f47308b2b0) register_command sync trace active hook 0x7f0db0001d40 2024-09-12T17:19:12.983 INFO:tasks.workunit.client.0.smithi016.stderr: -49> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 5 asok(0x55f47308b2b0) register_command sync trace active_short hook 0x7f0db0001d40 2024-09-12T17:19:12.983 INFO:tasks.workunit.client.0.smithi016.stderr: -48> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:19:12.983 INFO:tasks.workunit.client.0.smithi016.stderr: -47> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 20 Filter name: none 2024-09-12T17:19:12.983 INFO:tasks.workunit.client.0.smithi016.stderr: -46> 2024-09-12T17:19:12.807+0000 7f0bf67fc640 20 reqs_thread_entry: start 2024-09-12T17:19:12.983 INFO:tasks.workunit.client.0.smithi016.stderr: -45> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T17:19:12.983 INFO:tasks.workunit.client.0.smithi016.stderr: -44> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.984 INFO:tasks.workunit.client.0.smithi016.stderr: -43> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:19:12.984 INFO:tasks.workunit.client.0.smithi016.stderr: -42> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T17:19:12.984 INFO:tasks.workunit.client.0.smithi016.stderr: -41> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T17:19:12.984 INFO:tasks.workunit.client.0.smithi016.stderr: -40> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 : miss 2024-09-12T17:19:12.984 INFO:tasks.workunit.client.0.smithi016.stderr: -39> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:12.984 INFO:tasks.workunit.client.0.smithi016.stderr: -38> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T17:19:12.984 INFO:tasks.workunit.client.0.smithi016.stderr: -37> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 info.flags=0x17 2024-09-12T17:19:12.984 INFO:tasks.workunit.client.0.smithi016.stderr: -36> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 to cache LRU end 2024-09-12T17:19:12.984 INFO:tasks.workunit.client.0.smithi016.stderr: -35> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:19:12.984 INFO:tasks.workunit.client.0.smithi016.stderr: -34> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:12.984 INFO:tasks.workunit.client.0.smithi016.stderr: -33> 2024-09-12T17:19:12.807+0000 7f0dc9f0b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 2024-09-12T17:19:12.985 INFO:tasks.workunit.client.0.smithi016.stderr: -32> 2024-09-12T17:19:12.815+0000 7f0dc9f0b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 info.flags=0x17 2024-09-12T17:19:12.985 INFO:tasks.workunit.client.0.smithi016.stderr: -31> 2024-09-12T17:19:12.815+0000 7f0dc9f0b9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 to cache LRU end 2024-09-12T17:19:12.985 INFO:tasks.workunit.client.0.smithi016.stderr: -30> 2024-09-12T17:19:12.815+0000 7f0dc9f0b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:12.985 INFO:tasks.workunit.client.0.smithi016.stderr: -29> 2024-09-12T17:19:12.815+0000 7f0dc9f0b9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29, ofs0, ns] 2024-09-12T17:19:12.985 INFO:tasks.workunit.client.0.smithi016.stderr: -28> 2024-09-12T17:19:12.815+0000 7f0ca6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431576 cookie 94508393508096 notifier 7029 bl.length()=915 2024-09-12T17:19:12.985 INFO:tasks.workunit.client.0.smithi016.stderr: -27> 2024-09-12T17:19:12.815+0000 7f0ca6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 info.flags=0x17 2024-09-12T17:19:12.985 INFO:tasks.workunit.client.0.smithi016.stderr: -26> 2024-09-12T17:19:12.815+0000 7f0ca6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 to cache LRU end 2024-09-12T17:19:12.985 INFO:tasks.workunit.client.0.smithi016.stderr: -25> 2024-09-12T17:19:12.815+0000 7f0ca6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:12.985 INFO:tasks.workunit.client.0.smithi016.stderr: -24> 2024-09-12T17:19:12.819+0000 7f0dc9f0b9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29]): orig_sources= new_sources= 2024-09-12T17:19:12.985 INFO:tasks.workunit.client.0.smithi016.stderr: -23> 2024-09-12T17:19:12.819+0000 7f0dc9f0b9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29]): potential sources added=[] removed=[] 2024-09-12T17:19:12.985 INFO:tasks.workunit.client.0.smithi016.stderr: -22> 2024-09-12T17:19:12.819+0000 7f0dc9f0b9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29]): orig_dests= new_dests= 2024-09-12T17:19:12.986 INFO:tasks.workunit.client.0.smithi016.stderr: -21> 2024-09-12T17:19:12.819+0000 7f0dc9f0b9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29]): potential dests added=[] removed=[] 2024-09-12T17:19:12.986 INFO:tasks.workunit.client.0.smithi016.stderr: -20> 2024-09-12T17:19:12.823+0000 7f0dc9f0b9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29.1.0 2024-09-12T17:19:12.986 INFO:tasks.workunit.client.0.smithi016.stderr: -19> 2024-09-12T17:19:12.823+0000 7f0dc9f0b9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29.1.0 2024-09-12T17:19:12.986 INFO:tasks.workunit.client.0.smithi016.stderr: -18> 2024-09-12T17:19:12.823+0000 7f0dc9f0b9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29.1.1 2024-09-12T17:19:12.986 INFO:tasks.workunit.client.0.smithi016.stderr: -17> 2024-09-12T17:19:12.823+0000 7f0dc9f0b9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29.1.1 2024-09-12T17:19:12.986 INFO:tasks.workunit.client.0.smithi016.stderr: -16> 2024-09-12T17:19:12.823+0000 7f0dc9f0b9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29.0 2024-09-12T17:19:12.986 INFO:tasks.workunit.client.0.smithi016.stderr: -15> 2024-09-12T17:19:12.827+0000 7f0dc9f0b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 : hit (requested=0x17, cached=0x17) 2024-09-12T17:19:12.986 INFO:tasks.workunit.client.0.smithi016.stderr: -14> 2024-09-12T17:19:12.827+0000 7f0dc9f0b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 2024-09-12T17:19:12.986 INFO:tasks.workunit.client.0.smithi016.stderr: -13> 2024-09-12T17:19:12.831+0000 7f0dc9f0b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 info.flags=0x17 2024-09-12T17:19:12.986 INFO:tasks.workunit.client.0.smithi016.stderr: -12> 2024-09-12T17:19:12.831+0000 7f0dc9f0b9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 to cache LRU end 2024-09-12T17:19:12.986 INFO:tasks.workunit.client.0.smithi016.stderr: -11> 2024-09-12T17:19:12.831+0000 7f0dc9f0b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:12.987 INFO:tasks.workunit.client.0.smithi016.stderr: -10> 2024-09-12T17:19:12.831+0000 7f0dc9f0b9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29, ofs0, ns] 2024-09-12T17:19:12.987 INFO:tasks.workunit.client.0.smithi016.stderr: -9> 2024-09-12T17:19:12.831+0000 7f0ca6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431577 cookie 94508393508096 notifier 7029 bl.length()=915 2024-09-12T17:19:12.987 INFO:tasks.workunit.client.0.smithi016.stderr: -8> 2024-09-12T17:19:12.831+0000 7f0ca6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 info.flags=0x17 2024-09-12T17:19:12.987 INFO:tasks.workunit.client.0.smithi016.stderr: -7> 2024-09-12T17:19:12.831+0000 7f0ca6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 to cache LRU end 2024-09-12T17:19:12.987 INFO:tasks.workunit.client.0.smithi016.stderr: -6> 2024-09-12T17:19:12.831+0000 7f0ca6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:12.987 INFO:tasks.workunit.client.0.smithi016.stderr: -5> 2024-09-12T17:19:12.831+0000 7f0dc9f0b9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29]): orig_sources= new_sources= 2024-09-12T17:19:12.987 INFO:tasks.workunit.client.0.smithi016.stderr: -4> 2024-09-12T17:19:12.831+0000 7f0dc9f0b9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29]): potential sources added=[] removed=[] 2024-09-12T17:19:12.987 INFO:tasks.workunit.client.0.smithi016.stderr: -3> 2024-09-12T17:19:12.831+0000 7f0dc9f0b9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29]): orig_dests= new_dests= 2024-09-12T17:19:12.987 INFO:tasks.workunit.client.0.smithi016.stderr: -2> 2024-09-12T17:19:12.831+0000 7f0dc9f0b9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29]): potential dests added=[] removed=[] 2024-09-12T17:19:12.987 INFO:tasks.workunit.client.0.smithi016.stderr: -1> 2024-09-12T17:19:12.831+0000 7f0dc9f0b9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0dc9f0b9c0 time 2024-09-12T17:19:12.835996+0000 2024-09-12T17:19:12.987 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:19:12.988 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:12.988 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:19:12.988 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f0dcd7e52eb] 2024-09-12T17:19:12.988 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0dcd7e549f] 2024-09-12T17:19:12.988 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f471ec70c1] 2024-09-12T17:19:12.988 INFO:tasks.workunit.client.0.smithi016.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55f471ed855b] 2024-09-12T17:19:12.988 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55f471ed9b44] 2024-09-12T17:19:12.988 INFO:tasks.workunit.client.0.smithi016.stderr: 6: main() 2024-09-12T17:19:12.988 INFO:tasks.workunit.client.0.smithi016.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0dcc64bd90] 2024-09-12T17:19:12.988 INFO:tasks.workunit.client.0.smithi016.stderr: 8: __libc_start_main() 2024-09-12T17:19:12.988 INFO:tasks.workunit.client.0.smithi016.stderr: 9: _start() 2024-09-12T17:19:12.989 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:12.989 INFO:tasks.workunit.client.0.smithi016.stderr: 0> 2024-09-12T17:19:12.831+0000 7f0dc9f0b9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:19:12.989 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7f0dc9f0b9c0 thread_name:radosgw-admin 2024-09-12T17:19:12.989 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:12.989 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:19:12.989 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f0dcc664520] 2024-09-12T17:19:12.989 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:19:12.989 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:19:12.989 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:19:12.989 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f0dcd7e5345] 2024-09-12T17:19:12.989 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0dcd7e549f] 2024-09-12T17:19:12.990 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f471ec70c1] 2024-09-12T17:19:12.990 INFO:tasks.workunit.client.0.smithi016.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55f471ed855b] 2024-09-12T17:19:12.990 INFO:tasks.workunit.client.0.smithi016.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55f471ed9b44] 2024-09-12T17:19:12.990 INFO:tasks.workunit.client.0.smithi016.stderr: 10: main() 2024-09-12T17:19:12.990 INFO:tasks.workunit.client.0.smithi016.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0dcc64bd90] 2024-09-12T17:19:12.990 INFO:tasks.workunit.client.0.smithi016.stderr: 12: __libc_start_main() 2024-09-12T17:19:12.990 INFO:tasks.workunit.client.0.smithi016.stderr: 13: _start() 2024-09-12T17:19:12.990 INFO:tasks.workunit.client.0.smithi016.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:19:12.990 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:12.990 INFO:tasks.workunit.client.0.smithi016.stderr:--- logging levels --- 2024-09-12T17:19:12.990 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 none 2024-09-12T17:19:12.991 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 lockdep 2024-09-12T17:19:12.991 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 context 2024-09-12T17:19:12.991 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 crush 2024-09-12T17:19:12.991 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds 2024-09-12T17:19:12.991 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_balancer 2024-09-12T17:19:12.991 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_locker 2024-09-12T17:19:12.991 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log 2024-09-12T17:19:12.991 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log_expire 2024-09-12T17:19:12.991 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_migrator 2024-09-12T17:19:12.991 INFO:tasks.workunit.client.0.smithi016.stderr: 3/ 5 mds_quiesce 2024-09-12T17:19:12.991 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 buffer 2024-09-12T17:19:12.992 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 timer 2024-09-12T17:19:12.992 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 filer 2024-09-12T17:19:12.992 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 striper 2024-09-12T17:19:12.992 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 objecter 2024-09-12T17:19:12.992 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rados 2024-09-12T17:19:12.992 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd 2024-09-12T17:19:12.992 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_mirror 2024-09-12T17:19:12.992 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_replay 2024-09-12T17:19:12.992 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_pwl 2024-09-12T17:19:12.992 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 journaler 2024-09-12T17:19:12.992 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objectcacher 2024-09-12T17:19:12.993 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:19:12.993 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 client 2024-09-12T17:19:12.993 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 osd 2024-09-12T17:19:12.993 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 optracker 2024-09-12T17:19:12.993 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objclass 2024-09-12T17:19:12.993 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 filestore 2024-09-12T17:19:12.993 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 journal 2024-09-12T17:19:12.993 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 ms 2024-09-12T17:19:12.993 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mon 2024-09-12T17:19:12.993 INFO:tasks.workunit.client.0.smithi016.stderr: 0/10 monc 2024-09-12T17:19:12.993 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 paxos 2024-09-12T17:19:12.994 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 tp 2024-09-12T17:19:12.994 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 auth 2024-09-12T17:19:12.994 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 crypto 2024-09-12T17:19:12.994 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 finisher 2024-09-12T17:19:12.994 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 reserver 2024-09-12T17:19:12.994 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 heartbeatmap 2024-09-12T17:19:12.994 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 perfcounter 2024-09-12T17:19:12.994 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw 2024-09-12T17:19:12.994 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_sync 2024-09-12T17:19:12.994 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_datacache 2024-09-12T17:19:12.994 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_access 2024-09-12T17:19:12.995 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:19:12.995 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_flight 2024-09-12T17:19:12.995 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:19:12.995 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw_notification 2024-09-12T17:19:12.995 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 javaclient 2024-09-12T17:19:12.995 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 asok 2024-09-12T17:19:12.995 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 throttle 2024-09-12T17:19:12.995 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 refs 2024-09-12T17:19:12.995 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 compressor 2024-09-12T17:19:12.995 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluestore 2024-09-12T17:19:12.995 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluefs 2024-09-12T17:19:12.995 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 bdev 2024-09-12T17:19:12.996 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 kstore 2024-09-12T17:19:12.996 INFO:tasks.workunit.client.0.smithi016.stderr: 4/ 5 rocksdb 2024-09-12T17:19:12.996 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 fuse 2024-09-12T17:19:12.996 INFO:tasks.workunit.client.0.smithi016.stderr: 2/ 5 mgr 2024-09-12T17:19:12.996 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mgrc 2024-09-12T17:19:12.996 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 dpdk 2024-09-12T17:19:12.996 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 eventtrace 2024-09-12T17:19:12.996 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 prioritycache 2024-09-12T17:19:12.996 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 test 2024-09-12T17:19:12.996 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:19:12.996 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephsqlite 2024-09-12T17:19:12.997 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:19:12.997 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore 2024-09-12T17:19:12.997 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_onode 2024-09-12T17:19:12.997 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_odata 2024-09-12T17:19:12.997 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_omap 2024-09-12T17:19:12.997 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_tm 2024-09-12T17:19:12.997 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_t 2024-09-12T17:19:12.997 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:19:12.997 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_epm 2024-09-12T17:19:12.997 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_lba 2024-09-12T17:19:12.997 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:19:12.997 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cache 2024-09-12T17:19:12.998 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_journal 2024-09-12T17:19:12.998 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_device 2024-09-12T17:19:12.998 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_backref 2024-09-12T17:19:12.998 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 alienstore 2024-09-12T17:19:12.998 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mclock 2024-09-12T17:19:12.998 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cyanstore 2024-09-12T17:19:12.998 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 ceph_exporter 2024-09-12T17:19:12.998 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 memstore 2024-09-12T17:19:12.998 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 trace 2024-09-12T17:19:12.998 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 ceph_dedup 2024-09-12T17:19:12.998 INFO:tasks.workunit.client.0.smithi016.stderr: -2/-2 (syslog threshold) 2024-09-12T17:19:12.998 INFO:tasks.workunit.client.0.smithi016.stderr: 99/99 (stderr threshold) 2024-09-12T17:19:12.999 INFO:tasks.workunit.client.0.smithi016.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:19:12.999 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0bf67fc640 / http_manager 2024-09-12T17:19:12.999 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0c7cfe1640 / http_manager 2024-09-12T17:19:12.999 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0c7dfe3640 / rgw_dt_lg_renew 2024-09-12T17:19:12.999 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0ca57fa640 / ms_dispatch 2024-09-12T17:19:12.999 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0ca6ffd640 / io_context_pool 2024-09-12T17:19:12.999 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0cad7fa640 / ms_dispatch 2024-09-12T17:19:12.999 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0caffff640 / ms_dispatch 2024-09-12T17:19:12.999 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0cb5e0b640 / io_context_pool 2024-09-12T17:19:12.999 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0dc6a0f640 / io_context_pool 2024-09-12T17:19:12.999 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0dc7210640 / msgr-worker-2 2024-09-12T17:19:13.000 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0dc7a11640 / msgr-worker-1 2024-09-12T17:19:13.000 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0dc8212640 / msgr-worker-0 2024-09-12T17:19:13.000 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0dc9f0b9c0 / radosgw-admin 2024-09-12T17:19:13.000 INFO:tasks.workunit.client.0.smithi016.stderr: max_recent 500 2024-09-12T17:19:13.000 INFO:tasks.workunit.client.0.smithi016.stderr: max_new 1000 2024-09-12T17:19:13.000 INFO:tasks.workunit.client.0.smithi016.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:19:12.838383Z_1c9380b8-7dfa-42f5-a93a-b4c50d732ebe/log 2024-09-12T17:19:13.000 INFO:tasks.workunit.client.0.smithi016.stderr:--- end dump of recent events --- 2024-09-12T17:19:13.000 INFO:tasks.workunit.client.0.smithi016.stderr:Aborted 2024-09-12T17:19:13.000 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T17:19:13.002 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:19:13.002 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:19:13.002 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.915+0000 7f45816cb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:13.002 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.919+0000 7f45816cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:13.002 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.919+0000 7f45816cb9c0 20 realm 2024-09-12T17:19:13.002 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.919+0000 7f45816cb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:13.002 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.919+0000 7f45816cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:13.003 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.919+0000 7f45816cb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:19:13.003 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.919+0000 7f45816cb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:13.003 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.919+0000 7f45816cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:13.003 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.919+0000 7f45816cb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:13.003 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.919+0000 7f45816cb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:13.003 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.919+0000 7f45816cb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:13.003 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.923+0000 7f45816cb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:19:13.003 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.923+0000 7f45816cb9c0 20 searching for the correct realm 2024-09-12T17:19:13.003 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:12.927+0000 7f457f9d2640 0 -- 172.21.15.16:0/736125810 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f4574041060 msgr2=0x7f45740673a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:19:13.145 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.143+0000 7f457e9d0640 0 -- 172.21.15.16:0/736125810 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f457811c040 msgr2=0x7f4578105040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:19:13.363 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.359+0000 7f45816cb9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:19:13.363 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.359+0000 7f45816cb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:19:13.364 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.359+0000 7f45816cb9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:19:13.364 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.359+0000 7f45816cb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:19:13.364 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.359+0000 7f45816cb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:19:13.364 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.359+0000 7f45816cb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:19:13.364 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.359+0000 7f45816cb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:13.364 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.359+0000 7f45816cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:13.364 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.359+0000 7f45816cb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:13.365 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.363+0000 7f45816cb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:13.365 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.363+0000 7f45816cb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:13.366 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.363+0000 7f45816cb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:19:13.366 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.363+0000 7f45816cb9c0 20 zone default found 2024-09-12T17:19:13.366 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.363+0000 7f45816cb9c0 4 Realm: () 2024-09-12T17:19:13.366 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.363+0000 7f45816cb9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:19:13.366 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.363+0000 7f45816cb9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:19:13.366 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.363+0000 7f45816cb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:19:13.366 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.363+0000 7f45816cb9c0 20 zonegroup default 2024-09-12T17:19:13.366 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.363+0000 7f45816cb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:13.367 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.363+0000 7f45816cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:13.367 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.363+0000 7f45816cb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:13.367 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.363+0000 7f45816cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:13.367 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.363+0000 7f45816cb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:13.368 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.363+0000 7f45816cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:13.368 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.363+0000 7f45816cb9c0 20 started sync module instance, tier type = 2024-09-12T17:19:13.368 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.363+0000 7f45816cb9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:19:13.394 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.391+0000 7f45816cb9c0 20 add_watcher() i=0 2024-09-12T17:19:13.394 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.391+0000 7f45816cb9c0 20 add_watcher() i=1 2024-09-12T17:19:13.394 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.391+0000 7f45816cb9c0 20 add_watcher() i=2 2024-09-12T17:19:13.394 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.391+0000 7f45816cb9c0 20 add_watcher() i=3 2024-09-12T17:19:13.394 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.391+0000 7f45816cb9c0 20 add_watcher() i=4 2024-09-12T17:19:13.394 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.391+0000 7f45816cb9c0 20 add_watcher() i=5 2024-09-12T17:19:13.394 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.391+0000 7f45816cb9c0 20 add_watcher() i=6 2024-09-12T17:19:13.396 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.395+0000 7f45816cb9c0 20 add_watcher() i=7 2024-09-12T17:19:13.396 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.395+0000 7f45816cb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:19:13.401 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.399+0000 7f4435fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:13.402 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.399+0000 7f45816cb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:19:13.402 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.399+0000 7f45816cb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:19:13.402 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.399+0000 7f45816cb9c0 5 note: GC not initialized 2024-09-12T17:19:13.403 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.399+0000 7f4434fe1640 20 reqs_thread_entry: start 2024-09-12T17:19:13.403 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.399+0000 7f45816cb9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:19:13.403 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.399+0000 7f45816cb9c0 20 Filter name: none 2024-09-12T17:19:13.403 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.399+0000 7f43ae7fc640 20 reqs_thread_entry: start 2024-09-12T17:19:13.404 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.399+0000 7f45816cb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:13.404 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.399+0000 7f45816cb9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:19:13.404 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.399+0000 7f45816cb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:13.406 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.403+0000 7f45816cb9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:19:13.406 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.403+0000 7f45816cb9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:19:13.406 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.403+0000 7f45816cb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:13.406 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.403+0000 7f45816cb9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:19:13.406 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.403+0000 7f45816cb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:13.408 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.403+0000 7f45816cb9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:19:13.408 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.403+0000 7f45816cb9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:19:13.411 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.407+0000 7f4435fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:13.416 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.415+0000 7f45816cb9c0 20 remove_watcher() i=0 2024-09-12T17:19:13.416 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.415+0000 7f45816cb9c0 2 removed watcher, disabling cache 2024-09-12T17:19:13.419 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.415+0000 7f45816cb9c0 20 remove_watcher() i=1 2024-09-12T17:19:13.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.419+0000 7f45816cb9c0 20 remove_watcher() i=2 2024-09-12T17:19:13.424 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.419+0000 7f45816cb9c0 20 remove_watcher() i=3 2024-09-12T17:19:13.426 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.423+0000 7f45816cb9c0 20 remove_watcher() i=4 2024-09-12T17:19:13.428 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.427+0000 7f45816cb9c0 20 remove_watcher() i=5 2024-09-12T17:19:13.430 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.427+0000 7f45816cb9c0 20 remove_watcher() i=6 2024-09-12T17:19:13.431 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.427+0000 7f45816cb9c0 20 remove_watcher() i=7 2024-09-12T17:19:13.457 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:13.457 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:19:13.457 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: abort-at-block-writes id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:19:13.457 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:13.514 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:19:13.552 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:19:13.552 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:19:13.599 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.595+0000 7f8c852849c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:13.601 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.599+0000 7f8c852849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:13.601 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.599+0000 7f8c852849c0 20 realm 2024-09-12T17:19:13.601 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.599+0000 7f8c852849c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:13.601 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.599+0000 7f8c852849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:13.601 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.599+0000 7f8c852849c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:19:13.601 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.599+0000 7f8c852849c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:13.602 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.599+0000 7f8c852849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:13.602 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.599+0000 7f8c852849c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:13.603 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.599+0000 7f8c852849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:13.603 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.599+0000 7f8c852849c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:13.604 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.603+0000 7f8c852849c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:19:13.605 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.603+0000 7f8c852849c0 20 searching for the correct realm 2024-09-12T17:19:13.607 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.603+0000 7f8c8358b640 0 -- 172.21.15.16:0/2869175778 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f8c6c107ab0 msgr2=0x7f8c6c0c9970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:19:13.823 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:13.819+0000 7f8c82589640 0 -- 172.21.15.16:0/2869175778 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f8c7c0714b0 msgr2=0x7f8c7c04b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:19:14.040 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.035+0000 7f8c852849c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:19:14.040 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.035+0000 7f8c852849c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:19:14.040 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.035+0000 7f8c852849c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:19:14.040 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.035+0000 7f8c852849c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:19:14.040 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.035+0000 7f8c852849c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:19:14.040 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.035+0000 7f8c852849c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:19:14.041 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.035+0000 7f8c852849c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:14.041 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.039+0000 7f8c852849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:14.041 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.039+0000 7f8c852849c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:14.041 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.039+0000 7f8c852849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:14.042 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.039+0000 7f8c852849c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:14.042 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.039+0000 7f8c852849c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:19:14.042 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.039+0000 7f8c852849c0 20 zone default found 2024-09-12T17:19:14.042 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.039+0000 7f8c852849c0 4 Realm: () 2024-09-12T17:19:14.042 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.039+0000 7f8c852849c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:19:14.042 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.039+0000 7f8c852849c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:19:14.043 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.039+0000 7f8c852849c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:19:14.043 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.039+0000 7f8c852849c0 20 zonegroup default 2024-09-12T17:19:14.043 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.039+0000 7f8c852849c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:14.043 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.039+0000 7f8c852849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:14.043 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.039+0000 7f8c852849c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:14.044 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.039+0000 7f8c852849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:14.044 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.039+0000 7f8c852849c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:14.045 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.043+0000 7f8c852849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:14.045 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.043+0000 7f8c852849c0 20 started sync module instance, tier type = 2024-09-12T17:19:14.045 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.043+0000 7f8c852849c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:19:14.069 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.063+0000 7f8c852849c0 20 add_watcher() i=0 2024-09-12T17:19:14.069 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.063+0000 7f8c852849c0 20 add_watcher() i=1 2024-09-12T17:19:14.069 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.063+0000 7f8c852849c0 20 add_watcher() i=2 2024-09-12T17:19:14.069 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.063+0000 7f8c852849c0 20 add_watcher() i=3 2024-09-12T17:19:14.069 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.063+0000 7f8c852849c0 20 add_watcher() i=4 2024-09-12T17:19:14.069 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.063+0000 7f8c852849c0 20 add_watcher() i=5 2024-09-12T17:19:14.070 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.063+0000 7f8c852849c0 20 add_watcher() i=6 2024-09-12T17:19:14.070 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.067+0000 7f8c852849c0 20 add_watcher() i=7 2024-09-12T17:19:14.070 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.067+0000 7f8c852849c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:19:14.074 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.071+0000 7f8b39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:14.075 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.071+0000 7f8c852849c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:19:14.075 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.071+0000 7f8c852849c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:19:14.075 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.071+0000 7f8c852849c0 5 note: GC not initialized 2024-09-12T17:19:14.076 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.071+0000 7f8b38fe1640 20 reqs_thread_entry: start 2024-09-12T17:19:14.076 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.071+0000 7f8c852849c0 20 init_complete bucket index max shards: 1 2024-09-12T17:19:14.076 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.071+0000 7f8c852849c0 20 Filter name: none 2024-09-12T17:19:14.076 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.075+0000 7f8b31ffb640 20 reqs_thread_entry: start 2024-09-12T17:19:14.076 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.075+0000 7f8c852849c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T17:19:14.077 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.075+0000 7f8c852849c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:14.077 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.075+0000 7f8c852849c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:19:14.077 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.075+0000 7f8c852849c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T17:19:14.077 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.075+0000 7f8c852849c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T17:19:14.077 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.075+0000 7f8c852849c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 : miss 2024-09-12T17:19:14.077 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.075+0000 7f8c852849c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:14.078 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.075+0000 7f8c852849c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:19:14.079 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.075+0000 7f8c852849c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 info.flags=0x17 2024-09-12T17:19:14.079 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.075+0000 7f8c852849c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 to cache LRU end 2024-09-12T17:19:14.079 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.075+0000 7f8c852849c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:19:14.079 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.075+0000 7f8c852849c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:14.079 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.075+0000 7f8c852849c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 2024-09-12T17:19:14.080 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.079+0000 7f8c852849c0 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 to be held by another RGW process; skipping for now 2024-09-12T17:19:14.082 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.079+0000 7f8b39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:14.087 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.083+0000 7f8c852849c0 20 remove_watcher() i=0 2024-09-12T17:19:14.087 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.083+0000 7f8c852849c0 2 removed watcher, disabling cache 2024-09-12T17:19:14.090 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.087+0000 7f8c852849c0 20 remove_watcher() i=1 2024-09-12T17:19:14.092 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.091+0000 7f8c852849c0 20 remove_watcher() i=2 2024-09-12T17:19:14.094 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.091+0000 7f8c852849c0 20 remove_watcher() i=3 2024-09-12T17:19:14.097 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.095+0000 7f8c852849c0 20 remove_watcher() i=4 2024-09-12T17:19:14.100 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.095+0000 7f8c852849c0 20 remove_watcher() i=5 2024-09-12T17:19:14.101 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.099+0000 7f8c852849c0 20 remove_watcher() i=6 2024-09-12T17:19:14.103 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:14.099+0000 7f8c852849c0 20 remove_watcher() i=7 2024-09-12T17:19:14.122 INFO:tasks.workunit.client.0.smithi016.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:19:44.136 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:19:44.171 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:19:44.171 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:19:44.220 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.218+0000 7fcde81e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:44.222 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.222+0000 7fcde81e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:44.222 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.222+0000 7fcde81e19c0 20 realm 2024-09-12T17:19:44.222 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.222+0000 7fcde81e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:44.222 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.222+0000 7fcde81e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:44.222 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.222+0000 7fcde81e19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:19:44.223 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.222+0000 7fcde81e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:44.223 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.222+0000 7fcde81e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:44.223 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.222+0000 7fcde81e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:44.224 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.226+0000 7fcde81e19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:44.224 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.226+0000 7fcde81e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:44.226 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.226+0000 7fcde81e19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:19:44.226 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.226+0000 7fcde81e19c0 20 searching for the correct realm 2024-09-12T17:19:44.229 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.230+0000 7fcde64e8640 0 -- 172.21.15.16:0/2485157705 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fcddc0767d0 msgr2=0x7fcddc07d520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:19:44.238 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.238+0000 7fcde54e6640 0 -- 172.21.15.16:0/2485157705 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fcde0024040 msgr2=0x7fcde0099980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:19:44.456 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.454+0000 7fcde81e19c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:19:44.456 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.454+0000 7fcde81e19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:19:44.456 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.454+0000 7fcde81e19c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:19:44.456 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.454+0000 7fcde81e19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:19:44.456 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.454+0000 7fcde81e19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:19:44.456 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.454+0000 7fcde81e19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:19:44.456 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.454+0000 7fcde81e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:44.457 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.454+0000 7fcde81e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:44.457 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.454+0000 7fcde81e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:44.457 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.458+0000 7fcde81e19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:44.457 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.458+0000 7fcde81e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:44.458 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.458+0000 7fcde81e19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:19:44.458 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.458+0000 7fcde81e19c0 20 zone default found 2024-09-12T17:19:44.458 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.458+0000 7fcde81e19c0 4 Realm: () 2024-09-12T17:19:44.459 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.458+0000 7fcde81e19c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:19:44.459 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.458+0000 7fcde81e19c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:19:44.459 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.458+0000 7fcde81e19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:19:44.459 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.458+0000 7fcde81e19c0 20 zonegroup default 2024-09-12T17:19:44.459 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.458+0000 7fcde81e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:44.459 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.458+0000 7fcde81e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:44.460 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.458+0000 7fcde81e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:44.461 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.458+0000 7fcde81e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:44.461 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.458+0000 7fcde81e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:44.461 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.462+0000 7fcde81e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:44.461 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.462+0000 7fcde81e19c0 20 started sync module instance, tier type = 2024-09-12T17:19:44.461 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.462+0000 7fcde81e19c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:19:44.486 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.486+0000 7fcde81e19c0 20 add_watcher() i=0 2024-09-12T17:19:44.486 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.486+0000 7fcde81e19c0 20 add_watcher() i=1 2024-09-12T17:19:44.486 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.486+0000 7fcde81e19c0 20 add_watcher() i=2 2024-09-12T17:19:44.486 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.486+0000 7fcde81e19c0 20 add_watcher() i=3 2024-09-12T17:19:44.486 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.486+0000 7fcde81e19c0 20 add_watcher() i=4 2024-09-12T17:19:44.486 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.486+0000 7fcde81e19c0 20 add_watcher() i=5 2024-09-12T17:19:44.486 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.486+0000 7fcde81e19c0 20 add_watcher() i=6 2024-09-12T17:19:44.488 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.490+0000 7fcde81e19c0 20 add_watcher() i=7 2024-09-12T17:19:44.488 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.490+0000 7fcde81e19c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:19:44.493 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.494+0000 7fcc9c7e8640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:44.494 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.494+0000 7fcde81e19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:19:44.494 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.494+0000 7fcde81e19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:19:44.494 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.494+0000 7fcde81e19c0 5 note: GC not initialized 2024-09-12T17:19:44.495 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.494+0000 7fcc9b7e6640 20 reqs_thread_entry: start 2024-09-12T17:19:44.495 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.494+0000 7fcde81e19c0 20 init_complete bucket index max shards: 1 2024-09-12T17:19:44.495 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.494+0000 7fcde81e19c0 20 Filter name: none 2024-09-12T17:19:44.495 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.494+0000 7fcc997e2640 20 reqs_thread_entry: start 2024-09-12T17:19:44.495 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.494+0000 7fcde81e19c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T17:19:44.495 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.494+0000 7fcde81e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:44.496 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.494+0000 7fcde81e19c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:19:44.496 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.494+0000 7fcde81e19c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T17:19:44.496 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.494+0000 7fcde81e19c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T17:19:44.496 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.494+0000 7fcde81e19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 : miss 2024-09-12T17:19:44.496 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.494+0000 7fcde81e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:44.497 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.498+0000 7fcde81e19c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:19:44.497 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.498+0000 7fcde81e19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 info.flags=0x17 2024-09-12T17:19:44.497 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.498+0000 7fcde81e19c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 to cache LRU end 2024-09-12T17:19:44.497 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.498+0000 7fcde81e19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:19:44.497 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.498+0000 7fcde81e19c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:44.497 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.498+0000 7fcde81e19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 2024-09-12T17:19:44.499 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.498+0000 7fcde81e19c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:19:44.509 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.510+0000 7fcde81e19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 info.flags=0x17 2024-09-12T17:19:44.509 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.510+0000 7fcde81e19c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 to cache LRU end 2024-09-12T17:19:44.509 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.510+0000 7fcde81e19c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:44.509 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.510+0000 7fcde81e19c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29, ofs0, ns] 2024-09-12T17:19:44.510 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.510+0000 7fccc97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431578 cookie 94236285664592 notifier 7086 bl.length()=915 2024-09-12T17:19:44.510 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.510+0000 7fccc97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 info.flags=0x17 2024-09-12T17:19:44.510 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.510+0000 7fccc97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 to cache LRU end 2024-09-12T17:19:44.510 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.510+0000 7fccc97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:44.510 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.510+0000 7fcde81e19c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29]): orig_sources= new_sources= 2024-09-12T17:19:44.510 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.510+0000 7fcde81e19c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29]): potential sources added=[] removed=[] 2024-09-12T17:19:44.510 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.510+0000 7fcde81e19c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29]): orig_dests= new_dests= 2024-09-12T17:19:44.510 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.510+0000 7fcde81e19c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29]): potential dests added=[] removed=[] 2024-09-12T17:19:44.519 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.518+0000 7fcde81e19c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29.2.0 2024-09-12T17:19:44.519 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.518+0000 7fcde81e19c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29.2.0 2024-09-12T17:19:44.519 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.518+0000 7fcde81e19c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29.2.1 2024-09-12T17:19:44.519 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.518+0000 7fcde81e19c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29.2.1 2024-09-12T17:19:44.519 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.518+0000 7fcde81e19c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29.0 2024-09-12T17:19:44.525 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.526+0000 7fcde81e19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 : hit (requested=0x17, cached=0x17) 2024-09-12T17:19:44.526 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.526+0000 7fcde81e19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 2024-09-12T17:19:44.529 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.530+0000 7fcde81e19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 info.flags=0x17 2024-09-12T17:19:44.529 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.530+0000 7fcde81e19c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 to cache LRU end 2024-09-12T17:19:44.529 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.530+0000 7fcde81e19c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:44.529 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.530+0000 7fcde81e19c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29, ofs0, ns] 2024-09-12T17:19:44.530 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.530+0000 7fccc8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431579 cookie 94236285664592 notifier 7086 bl.length()=915 2024-09-12T17:19:44.530 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.530+0000 7fccc8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 info.flags=0x17 2024-09-12T17:19:44.530 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.530+0000 7fccc8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 to cache LRU end 2024-09-12T17:19:44.530 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.530+0000 7fccc8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:44.530 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.530+0000 7fcde81e19c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29]): orig_sources= new_sources= 2024-09-12T17:19:44.530 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.530+0000 7fcde81e19c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29]): potential sources added=[] removed=[] 2024-09-12T17:19:44.530 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.530+0000 7fcde81e19c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29]): orig_dests= new_dests= 2024-09-12T17:19:44.530 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.530+0000 7fcde81e19c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29]): potential dests added=[] removed=[] 2024-09-12T17:19:44.532 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.534+0000 7fcde81e19c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29.0 2024-09-12T17:19:44.533 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.534+0000 7fcde81e19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 : hit (requested=0x17, cached=0x17) 2024-09-12T17:19:44.533 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.534+0000 7fcde81e19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 2024-09-12T17:19:44.536 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.534+0000 7fcde81e19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 info.flags=0x17 2024-09-12T17:19:44.536 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.534+0000 7fcde81e19c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 to cache LRU end 2024-09-12T17:19:44.536 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.534+0000 7fcde81e19c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:44.536 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.534+0000 7fcde81e19c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29, ofs0, ns] 2024-09-12T17:19:44.536 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.538+0000 7fccc97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431580 cookie 94236285664592 notifier 7086 bl.length()=883 2024-09-12T17:19:44.536 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.538+0000 7fccc97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 info.flags=0x17 2024-09-12T17:19:44.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.538+0000 7fccc97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 to cache LRU end 2024-09-12T17:19:44.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.538+0000 7fccc97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:44.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.538+0000 7fcde81e19c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29]): orig_sources= new_sources= 2024-09-12T17:19:44.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.538+0000 7fcde81e19c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29]): potential sources added=[] removed=[] 2024-09-12T17:19:44.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.538+0000 7fcde81e19c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29]): orig_dests= new_dests= 2024-09-12T17:19:44.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.538+0000 7fcde81e19c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29]): potential dests added=[] removed=[] 2024-09-12T17:19:44.540 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.538+0000 7fcde81e19c0 1 execute INFO: reshard of bucket "abort-at-block-writes" from 1 shards to 2 shards completed successfully 2024-09-12T17:19:44.542 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.542+0000 7fcc9c7e8640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:44.547 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.546+0000 7fcde81e19c0 20 remove_watcher() i=0 2024-09-12T17:19:44.548 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.546+0000 7fcde81e19c0 2 removed watcher, disabling cache 2024-09-12T17:19:44.550 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.550+0000 7fcde81e19c0 20 remove_watcher() i=1 2024-09-12T17:19:44.552 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.554+0000 7fcde81e19c0 20 remove_watcher() i=2 2024-09-12T17:19:44.555 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.554+0000 7fcde81e19c0 20 remove_watcher() i=3 2024-09-12T17:19:44.557 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.558+0000 7fcde81e19c0 20 remove_watcher() i=4 2024-09-12T17:19:44.559 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.558+0000 7fcde81e19c0 20 remove_watcher() i=5 2024-09-12T17:19:44.561 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.562+0000 7fcde81e19c0 20 remove_watcher() i=6 2024-09-12T17:19:44.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.562+0000 7fcde81e19c0 20 remove_watcher() i=7 2024-09-12T17:19:44.578 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T17:19:44.612 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:19:44.612 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:19:44.660 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.662+0000 7f44445ff9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:44.662 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.662+0000 7f44445ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:44.663 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.662+0000 7f44445ff9c0 20 realm 2024-09-12T17:19:44.663 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.662+0000 7f44445ff9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:44.663 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.662+0000 7f44445ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:44.663 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.662+0000 7f44445ff9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:19:44.663 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.662+0000 7f44445ff9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:44.663 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.662+0000 7f44445ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:44.663 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.662+0000 7f44445ff9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:44.664 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.666+0000 7f44445ff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:44.664 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.666+0000 7f44445ff9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:44.666 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.666+0000 7f44445ff9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:19:44.666 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.666+0000 7f44445ff9c0 20 searching for the correct realm 2024-09-12T17:19:44.669 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.670+0000 7f4441904640 0 -- 172.21.15.16:0/3074807908 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7f44340c0020 msgr2=0x7f44340f74d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:19:44.675 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.674+0000 7f4441904640 0 -- 172.21.15.16:0/3074807908 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7f430c0816f0 msgr2=0x7f430c083b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:19:44.686 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.686+0000 7f44445ff9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:19:44.686 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.686+0000 7f44445ff9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:19:44.686 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.686+0000 7f44445ff9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:19:44.686 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.686+0000 7f44445ff9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:19:44.686 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.686+0000 7f44445ff9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:19:44.686 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.686+0000 7f44445ff9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:19:44.686 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.686+0000 7f44445ff9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:44.686 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.686+0000 7f44445ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:44.686 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.686+0000 7f44445ff9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:44.687 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.686+0000 7f44445ff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:44.687 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.686+0000 7f44445ff9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:44.687 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.686+0000 7f44445ff9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:19:44.688 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.686+0000 7f44445ff9c0 20 zone default found 2024-09-12T17:19:44.688 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.686+0000 7f44445ff9c0 4 Realm: () 2024-09-12T17:19:44.688 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.686+0000 7f44445ff9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:19:44.688 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.686+0000 7f44445ff9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:19:44.688 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.686+0000 7f44445ff9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:19:44.688 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.686+0000 7f44445ff9c0 20 zonegroup default 2024-09-12T17:19:44.688 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.686+0000 7f44445ff9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:44.688 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.686+0000 7f44445ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:44.688 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.686+0000 7f44445ff9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:44.689 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.690+0000 7f44445ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:44.689 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.690+0000 7f44445ff9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:44.689 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.690+0000 7f44445ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:44.689 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.690+0000 7f44445ff9c0 20 started sync module instance, tier type = 2024-09-12T17:19:44.689 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.690+0000 7f44445ff9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:19:44.704 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.706+0000 7f44445ff9c0 20 add_watcher() i=0 2024-09-12T17:19:44.704 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.706+0000 7f44445ff9c0 20 add_watcher() i=1 2024-09-12T17:19:44.704 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.706+0000 7f44445ff9c0 20 add_watcher() i=2 2024-09-12T17:19:44.705 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.706+0000 7f44445ff9c0 20 add_watcher() i=3 2024-09-12T17:19:44.705 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.706+0000 7f44445ff9c0 20 add_watcher() i=4 2024-09-12T17:19:44.705 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.706+0000 7f44445ff9c0 20 add_watcher() i=5 2024-09-12T17:19:44.705 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.706+0000 7f44445ff9c0 20 add_watcher() i=6 2024-09-12T17:19:44.705 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.706+0000 7f44445ff9c0 20 add_watcher() i=7 2024-09-12T17:19:44.705 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.706+0000 7f44445ff9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:19:44.708 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.706+0000 7f42f8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:44.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.710+0000 7f44445ff9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:19:44.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.710+0000 7f44445ff9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:19:44.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.710+0000 7f44445ff9c0 5 note: GC not initialized 2024-09-12T17:19:44.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.710+0000 7f42737fe640 20 reqs_thread_entry: start 2024-09-12T17:19:44.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.710+0000 7f44445ff9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:19:44.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.710+0000 7f44445ff9c0 20 Filter name: none 2024-09-12T17:19:44.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.710+0000 7f42717fa640 20 reqs_thread_entry: start 2024-09-12T17:19:44.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.710+0000 7f44445ff9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:44.710 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.710+0000 7f44445ff9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:19:44.710 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.710+0000 7f44445ff9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:44.711 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.710+0000 7f44445ff9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T17:19:44.711 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.710+0000 7f44445ff9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:19:44.711 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.710+0000 7f44445ff9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:44.711 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.710+0000 7f44445ff9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:19:44.711 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.710+0000 7f44445ff9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:44.712 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.714+0000 7f44445ff9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T17:19:44.712 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.714+0000 7f44445ff9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:19:44.714 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.714+0000 7f42f8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:44.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.718+0000 7f44445ff9c0 20 remove_watcher() i=0 2024-09-12T17:19:44.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.718+0000 7f44445ff9c0 2 removed watcher, disabling cache 2024-09-12T17:19:44.721 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.722+0000 7f44445ff9c0 20 remove_watcher() i=1 2024-09-12T17:19:44.723 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.722+0000 7f44445ff9c0 20 remove_watcher() i=2 2024-09-12T17:19:44.725 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.726+0000 7f44445ff9c0 20 remove_watcher() i=3 2024-09-12T17:19:44.727 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.726+0000 7f44445ff9c0 20 remove_watcher() i=4 2024-09-12T17:19:44.728 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.730+0000 7f44445ff9c0 20 remove_watcher() i=5 2024-09-12T17:19:44.729 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.730+0000 7f44445ff9c0 20 remove_watcher() i=6 2024-09-12T17:19:44.731 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:44.730+0000 7f44445ff9c0 20 remove_watcher() i=7 2024-09-12T17:19:44.744 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:44.744 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:19:44.744 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: abort-at-block-writes id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:19:44.744 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:44.824 INFO:tasks.workunit.client.0.smithi016.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-09-12T17:19:44.825 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:45.272 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T17:19:45.307 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:19:45.307 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:19:45.354 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.354+0000 7fad272749c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.356 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.358+0000 7fad272749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:45.357 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.358+0000 7fad272749c0 20 realm 2024-09-12T17:19:45.357 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.358+0000 7fad272749c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.357 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.358+0000 7fad272749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:45.357 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.358+0000 7fad272749c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:19:45.357 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.358+0000 7fad272749c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.357 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.358+0000 7fad272749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:45.357 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.358+0000 7fad272749c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.358 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.358+0000 7fad272749c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:45.358 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.358+0000 7fad272749c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.360 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.362+0000 7fad272749c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:19:45.360 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.362+0000 7fad272749c0 20 searching for the correct realm 2024-09-12T17:19:45.363 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.362+0000 7fad2557b640 0 -- 172.21.15.16:0/56684133 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fad180909d0 msgr2=0x7fad180924b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:19:45.371 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.370+0000 7fad24579640 0 -- 172.21.15.16:0/56684133 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fad1c065880 msgr2=0x7fad1c0918e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:19:45.587 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.586+0000 7fad272749c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:19:45.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.586+0000 7fad272749c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:19:45.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.586+0000 7fad272749c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:19:45.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.586+0000 7fad272749c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:19:45.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.586+0000 7fad272749c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:19:45.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.586+0000 7fad272749c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:19:45.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.586+0000 7fad272749c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.586+0000 7fad272749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:45.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.586+0000 7fad272749c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.589 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.590+0000 7fad272749c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:45.589 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.590+0000 7fad272749c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.590 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.590+0000 7fad272749c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:19:45.590 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.590+0000 7fad272749c0 20 zone default found 2024-09-12T17:19:45.590 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.590+0000 7fad272749c0 4 Realm: () 2024-09-12T17:19:45.590 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.590+0000 7fad272749c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:19:45.590 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.590+0000 7fad272749c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:19:45.590 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.590+0000 7fad272749c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:19:45.591 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.590+0000 7fad272749c0 20 zonegroup default 2024-09-12T17:19:45.591 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.590+0000 7fad272749c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.591 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.590+0000 7fad272749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:45.591 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.590+0000 7fad272749c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.591 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.590+0000 7fad272749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:45.592 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.590+0000 7fad272749c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.592 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.594+0000 7fad272749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:45.592 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.594+0000 7fad272749c0 20 started sync module instance, tier type = 2024-09-12T17:19:45.593 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.594+0000 7fad272749c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:19:45.617 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.618+0000 7fad272749c0 20 add_watcher() i=0 2024-09-12T17:19:45.617 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.618+0000 7fad272749c0 20 add_watcher() i=1 2024-09-12T17:19:45.617 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.618+0000 7fad272749c0 20 add_watcher() i=2 2024-09-12T17:19:45.617 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.618+0000 7fad272749c0 20 add_watcher() i=3 2024-09-12T17:19:45.617 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.618+0000 7fad272749c0 20 add_watcher() i=4 2024-09-12T17:19:45.617 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.618+0000 7fad272749c0 20 add_watcher() i=5 2024-09-12T17:19:45.617 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.618+0000 7fad272749c0 20 add_watcher() i=6 2024-09-12T17:19:45.619 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.618+0000 7fad272749c0 20 add_watcher() i=7 2024-09-12T17:19:45.619 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.618+0000 7fad272749c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:19:45.623 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.622+0000 7fabdb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:45.624 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.622+0000 7fad272749c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:19:45.624 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.626+0000 7fad272749c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:19:45.624 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.626+0000 7fad272749c0 5 note: GC not initialized 2024-09-12T17:19:45.625 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.626+0000 7fabda7e4640 20 reqs_thread_entry: start 2024-09-12T17:19:45.625 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.626+0000 7fad272749c0 20 init_complete bucket index max shards: 1 2024-09-12T17:19:45.625 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.626+0000 7fad272749c0 20 Filter name: none 2024-09-12T17:19:45.625 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.626+0000 7fabd37fe640 20 reqs_thread_entry: start 2024-09-12T17:19:45.625 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.626+0000 7fad272749c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.627 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.626+0000 7fad272749c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:19:45.627 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.626+0000 7fad272749c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.628 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.626+0000 7fad272749c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:19:45.628 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.630+0000 7fad272749c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:19:45.628 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.630+0000 7fad272749c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.629 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.630+0000 7fad272749c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:19:45.629 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.630+0000 7fad272749c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.630 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.630+0000 7fad272749c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:19:45.630 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.630+0000 7fad272749c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:19:45.633 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.634+0000 7fabdb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:45.638 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.638+0000 7fad272749c0 20 remove_watcher() i=0 2024-09-12T17:19:45.638 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.638+0000 7fad272749c0 2 removed watcher, disabling cache 2024-09-12T17:19:45.641 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.642+0000 7fad272749c0 20 remove_watcher() i=1 2024-09-12T17:19:45.643 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.642+0000 7fad272749c0 20 remove_watcher() i=2 2024-09-12T17:19:45.645 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.646+0000 7fad272749c0 20 remove_watcher() i=3 2024-09-12T17:19:45.647 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.646+0000 7fad272749c0 20 remove_watcher() i=4 2024-09-12T17:19:45.649 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.650+0000 7fad272749c0 20 remove_watcher() i=5 2024-09-12T17:19:45.650 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.650+0000 7fad272749c0 20 remove_watcher() i=6 2024-09-12T17:19:45.652 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.650+0000 7fad272749c0 20 remove_watcher() i=7 2024-09-12T17:19:45.667 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:45.668 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:19:45.668 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: error-at-commit-target-layout id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:19:45.668 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:45.668 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-09-12T17:19:45.700 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:19:45.701 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:19:45.747 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.746+0000 7fbd437809c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.749 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.750+0000 7fbd437809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:45.749 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.750+0000 7fbd437809c0 20 realm 2024-09-12T17:19:45.749 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.750+0000 7fbd437809c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.749 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.750+0000 7fbd437809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:45.749 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.750+0000 7fbd437809c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:19:45.749 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.750+0000 7fbd437809c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.749 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.750+0000 7fbd437809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:45.749 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.750+0000 7fbd437809c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.750 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.750+0000 7fbd437809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:45.750 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.750+0000 7fbd437809c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.752 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.754+0000 7fbd437809c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:19:45.752 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.754+0000 7fbd437809c0 20 searching for the correct realm 2024-09-12T17:19:45.756 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.754+0000 7fbd41a87640 0 -- 172.21.15.16:0/1878498631 >> [v2:172.21.15.19:6800/1509147557,v1:172.21.15.19:6801/1509147557] conn(0x55a228cf3530 msgr2=0x55a228cf5920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:19:45.763 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.762+0000 7fbd40a85640 0 -- 172.21.15.16:0/1878498631 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fbd3c036920 msgr2=0x7fbd3c046410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:19:45.981 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.982+0000 7fbd437809c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:19:45.981 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.982+0000 7fbd437809c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:19:45.981 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.982+0000 7fbd437809c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:19:45.981 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.982+0000 7fbd437809c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:19:45.981 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.982+0000 7fbd437809c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:19:45.981 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.982+0000 7fbd437809c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:19:45.982 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.982+0000 7fbd437809c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.982 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.982+0000 7fbd437809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:45.982 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.982+0000 7fbd437809c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.983 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.982+0000 7fbd437809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:45.983 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.982+0000 7fbd437809c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.984 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.982+0000 7fbd437809c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:19:45.984 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.982+0000 7fbd437809c0 20 zone default found 2024-09-12T17:19:45.984 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.982+0000 7fbd437809c0 4 Realm: () 2024-09-12T17:19:45.984 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.982+0000 7fbd437809c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:19:45.984 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.982+0000 7fbd437809c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:19:45.984 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.982+0000 7fbd437809c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:19:45.984 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.982+0000 7fbd437809c0 20 zonegroup default 2024-09-12T17:19:45.984 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.982+0000 7fbd437809c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.985 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.986+0000 7fbd437809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:45.985 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.986+0000 7fbd437809c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.985 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.986+0000 7fbd437809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:45.985 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.986+0000 7fbd437809c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:45.986 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.986+0000 7fbd437809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:45.986 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.986+0000 7fbd437809c0 20 started sync module instance, tier type = 2024-09-12T17:19:45.986 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:45.986+0000 7fbd437809c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:19:46.011 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.010+0000 7fbd437809c0 20 add_watcher() i=0 2024-09-12T17:19:46.011 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.010+0000 7fbd437809c0 20 add_watcher() i=1 2024-09-12T17:19:46.011 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.010+0000 7fbd437809c0 20 add_watcher() i=2 2024-09-12T17:19:46.011 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.010+0000 7fbd437809c0 20 add_watcher() i=3 2024-09-12T17:19:46.011 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.010+0000 7fbd437809c0 20 add_watcher() i=4 2024-09-12T17:19:46.011 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.010+0000 7fbd437809c0 20 add_watcher() i=5 2024-09-12T17:19:46.011 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.010+0000 7fbd437809c0 20 add_watcher() i=6 2024-09-12T17:19:46.013 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.014+0000 7fbd437809c0 20 add_watcher() i=7 2024-09-12T17:19:46.013 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.014+0000 7fbd437809c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:19:46.017 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.018+0000 7fbbf77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:46.018 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.018+0000 7fbd437809c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:19:46.018 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.018+0000 7fbd437809c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:19:46.019 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.018+0000 7fbd437809c0 5 note: GC not initialized 2024-09-12T17:19:46.019 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.018+0000 7fbbf67e4640 20 reqs_thread_entry: start 2024-09-12T17:19:46.019 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.018+0000 7fbd437809c0 20 init_complete bucket index max shards: 1 2024-09-12T17:19:46.019 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.018+0000 7fbd437809c0 20 Filter name: none 2024-09-12T17:19:46.020 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.018+0000 7fbb67fff640 20 reqs_thread_entry: start 2024-09-12T17:19:46.020 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.018+0000 7fbd437809c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T17:19:46.020 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.018+0000 7fbd437809c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:46.021 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.022+0000 7fbd437809c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:19:46.021 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.022+0000 7fbd437809c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T17:19:46.021 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.022+0000 7fbd437809c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T17:19:46.021 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.022+0000 7fbd437809c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30 : miss 2024-09-12T17:19:46.021 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.022+0000 7fbd437809c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:46.022 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.022+0000 7fbd437809c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:19:46.023 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.022+0000 7fbd437809c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30 info.flags=0x17 2024-09-12T17:19:46.023 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.022+0000 7fbd437809c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30 to cache LRU end 2024-09-12T17:19:46.023 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.022+0000 7fbd437809c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:19:46.023 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.022+0000 7fbd437809c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:46.023 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.022+0000 7fbd437809c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30 2024-09-12T17:19:46.032 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.034+0000 7fbd437809c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30 info.flags=0x17 2024-09-12T17:19:46.032 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.034+0000 7fbd437809c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30 to cache LRU end 2024-09-12T17:19:46.032 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.034+0000 7fbd437809c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:46.033 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.034+0000 7fbd437809c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30, ofs0, ns] 2024-09-12T17:19:46.033 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.034+0000 7fbc24ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431589 cookie 94154957767360 notifier 6824 bl.length()=931 2024-09-12T17:19:46.033 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.034+0000 7fbc24ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30 info.flags=0x17 2024-09-12T17:19:46.033 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.034+0000 7fbc24ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30 to cache LRU end 2024-09-12T17:19:46.034 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.034+0000 7fbc24ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:46.034 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.034+0000 7fbd437809c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30]): orig_sources= new_sources= 2024-09-12T17:19:46.034 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.034+0000 7fbd437809c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30]): potential sources added=[] removed=[] 2024-09-12T17:19:46.034 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.034+0000 7fbd437809c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30]): orig_dests= new_dests= 2024-09-12T17:19:46.034 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.034+0000 7fbd437809c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30]): potential dests added=[] removed=[] 2024-09-12T17:19:46.040 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.038+0000 7fbd437809c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30.1.0 2024-09-12T17:19:46.040 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.038+0000 7fbd437809c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30.1.0 2024-09-12T17:19:46.040 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.038+0000 7fbd437809c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30.1.1 2024-09-12T17:19:46.040 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.038+0000 7fbd437809c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30.1.1 2024-09-12T17:19:46.040 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.038+0000 7fbd437809c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30.0 2024-09-12T17:19:46.046 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.046+0000 7fbd437809c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30 : hit (requested=0x17, cached=0x17) 2024-09-12T17:19:46.046 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.046+0000 7fbd437809c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30 2024-09-12T17:19:46.050 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.050+0000 7fbd437809c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30 info.flags=0x17 2024-09-12T17:19:46.050 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.050+0000 7fbd437809c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30 to cache LRU end 2024-09-12T17:19:46.050 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.050+0000 7fbd437809c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:46.050 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.050+0000 7fbd437809c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30, ofs0, ns] 2024-09-12T17:19:46.050 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.050+0000 7fbc24ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431590 cookie 94154957767360 notifier 6824 bl.length()=931 2024-09-12T17:19:46.051 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.050+0000 7fbc24ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30 info.flags=0x17 2024-09-12T17:19:46.051 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.050+0000 7fbc24ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30 to cache LRU end 2024-09-12T17:19:46.051 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.050+0000 7fbc24ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:46.051 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.050+0000 7fbd437809c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30]): orig_sources= new_sources= 2024-09-12T17:19:46.051 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.050+0000 7fbd437809c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30]): potential sources added=[] removed=[] 2024-09-12T17:19:46.051 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.050+0000 7fbd437809c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30]): orig_dests= new_dests= 2024-09-12T17:19:46.052 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.050+0000 7fbd437809c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30]): potential dests added=[] removed=[] 2024-09-12T17:19:46.054 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.054+0000 7fbd437809c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30.0 2024-09-12T17:19:46.055 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.054+0000 7fbd437809c0 -1 Injecting error=-5 at location=commit_target_layout 2024-09-12T17:19:46.055 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.054+0000 7fbd437809c0 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-09-12T17:19:46.063 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.062+0000 7fbbf77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:46.068 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.070+0000 7fbd437809c0 20 remove_watcher() i=0 2024-09-12T17:19:46.068 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.070+0000 7fbd437809c0 2 removed watcher, disabling cache 2024-09-12T17:19:46.071 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.070+0000 7fbd437809c0 20 remove_watcher() i=1 2024-09-12T17:19:46.073 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.074+0000 7fbd437809c0 20 remove_watcher() i=2 2024-09-12T17:19:46.076 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.078+0000 7fbd437809c0 20 remove_watcher() i=3 2024-09-12T17:19:46.079 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.078+0000 7fbd437809c0 20 remove_watcher() i=4 2024-09-12T17:19:46.081 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.082+0000 7fbd437809c0 20 remove_watcher() i=5 2024-09-12T17:19:46.083 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.082+0000 7fbd437809c0 20 remove_watcher() i=6 2024-09-12T17:19:46.085 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.086+0000 7fbd437809c0 20 remove_watcher() i=7 2024-09-12T17:19:46.105 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T17:19:46.136 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:19:46.137 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:19:46.185 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.186+0000 7fcc02a2a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:46.187 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.186+0000 7fcc02a2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:46.187 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.186+0000 7fcc02a2a9c0 20 realm 2024-09-12T17:19:46.187 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.186+0000 7fcc02a2a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:46.187 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.186+0000 7fcc02a2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:46.187 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.186+0000 7fcc02a2a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:19:46.187 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.186+0000 7fcc02a2a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:46.187 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.186+0000 7fcc02a2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:46.187 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.186+0000 7fcc02a2a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:46.189 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.190+0000 7fcc02a2a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:46.189 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.190+0000 7fcc02a2a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:46.190 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.190+0000 7fcc02a2a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:19:46.190 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.190+0000 7fcc02a2a9c0 20 searching for the correct realm 2024-09-12T17:19:46.194 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.194+0000 7fcc00d31640 0 -- 172.21.15.16:0/2619335538 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fcbf40d1070 msgr2=0x7fcbf40ba750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:19:46.201 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.202+0000 7fcbffd2f640 0 -- 172.21.15.16:0/2619335538 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fcbf8061980 msgr2=0x7fcbf8045400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:19:46.420 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.418+0000 7fcc02a2a9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:19:46.420 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.418+0000 7fcc02a2a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:19:46.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.418+0000 7fcc02a2a9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:19:46.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.418+0000 7fcc02a2a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:19:46.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.418+0000 7fcc02a2a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:19:46.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.418+0000 7fcc02a2a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:19:46.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.422+0000 7fcc02a2a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:46.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.422+0000 7fcc02a2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:46.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.422+0000 7fcc02a2a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:46.422 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.422+0000 7fcc02a2a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:46.422 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.422+0000 7fcc02a2a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:46.423 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.422+0000 7fcc02a2a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:19:46.423 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.422+0000 7fcc02a2a9c0 20 zone default found 2024-09-12T17:19:46.423 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.422+0000 7fcc02a2a9c0 4 Realm: () 2024-09-12T17:19:46.423 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.422+0000 7fcc02a2a9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:19:46.423 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.422+0000 7fcc02a2a9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:19:46.423 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.422+0000 7fcc02a2a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:19:46.423 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.422+0000 7fcc02a2a9c0 20 zonegroup default 2024-09-12T17:19:46.423 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.422+0000 7fcc02a2a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:46.424 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.422+0000 7fcc02a2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:46.424 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.422+0000 7fcc02a2a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:46.425 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.426+0000 7fcc02a2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:46.425 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.426+0000 7fcc02a2a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:46.425 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.426+0000 7fcc02a2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:46.425 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.426+0000 7fcc02a2a9c0 20 started sync module instance, tier type = 2024-09-12T17:19:46.425 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.426+0000 7fcc02a2a9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:19:46.449 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.450+0000 7fcc02a2a9c0 20 add_watcher() i=0 2024-09-12T17:19:46.449 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.450+0000 7fcc02a2a9c0 20 add_watcher() i=1 2024-09-12T17:19:46.449 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.450+0000 7fcc02a2a9c0 20 add_watcher() i=2 2024-09-12T17:19:46.449 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.450+0000 7fcc02a2a9c0 20 add_watcher() i=3 2024-09-12T17:19:46.449 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.450+0000 7fcc02a2a9c0 20 add_watcher() i=4 2024-09-12T17:19:46.450 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.450+0000 7fcc02a2a9c0 20 add_watcher() i=5 2024-09-12T17:19:46.450 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.450+0000 7fcc02a2a9c0 20 add_watcher() i=6 2024-09-12T17:19:46.451 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.450+0000 7fcc02a2a9c0 20 add_watcher() i=7 2024-09-12T17:19:46.451 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.450+0000 7fcc02a2a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:19:46.456 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.454+0000 7fcab6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:46.457 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.458+0000 7fcc02a2a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:19:46.457 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.458+0000 7fcc02a2a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:19:46.457 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.458+0000 7fcc02a2a9c0 5 note: GC not initialized 2024-09-12T17:19:46.458 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.458+0000 7fcab5fdb640 20 reqs_thread_entry: start 2024-09-12T17:19:46.458 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.458+0000 7fcc02a2a9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:19:46.458 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.458+0000 7fcc02a2a9c0 20 Filter name: none 2024-09-12T17:19:46.458 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.458+0000 7fca277fe640 20 reqs_thread_entry: start 2024-09-12T17:19:46.458 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.458+0000 7fcc02a2a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:46.459 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.458+0000 7fcc02a2a9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:19:46.459 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.458+0000 7fcc02a2a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:46.460 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.462+0000 7fcc02a2a9c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T17:19:46.460 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.462+0000 7fcc02a2a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:19:46.461 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.462+0000 7fcc02a2a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:46.461 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.462+0000 7fcc02a2a9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:19:46.461 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.462+0000 7fcc02a2a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:46.462 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.462+0000 7fcc02a2a9c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T17:19:46.462 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.462+0000 7fcc02a2a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:19:46.465 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.466+0000 7fcab6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:46.470 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.470+0000 7fcc02a2a9c0 20 remove_watcher() i=0 2024-09-12T17:19:46.470 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.470+0000 7fcc02a2a9c0 2 removed watcher, disabling cache 2024-09-12T17:19:46.472 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.474+0000 7fcc02a2a9c0 20 remove_watcher() i=1 2024-09-12T17:19:46.475 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.474+0000 7fcc02a2a9c0 20 remove_watcher() i=2 2024-09-12T17:19:46.478 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.478+0000 7fcc02a2a9c0 20 remove_watcher() i=3 2024-09-12T17:19:46.480 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.478+0000 7fcc02a2a9c0 20 remove_watcher() i=4 2024-09-12T17:19:46.482 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.482+0000 7fcc02a2a9c0 20 remove_watcher() i=5 2024-09-12T17:19:46.483 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.482+0000 7fcc02a2a9c0 20 remove_watcher() i=6 2024-09-12T17:19:46.485 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.486+0000 7fcc02a2a9c0 20 remove_watcher() i=7 2024-09-12T17:19:46.501 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:46.501 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:19:46.501 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: error-at-commit-target-layout id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:19:46.502 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:46.562 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:19:46.599 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:19:46.599 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:19:46.646 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.646+0000 7f433a7b99c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:46.647 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.646+0000 7f433a7b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:46.648 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.646+0000 7f433a7b99c0 20 realm 2024-09-12T17:19:46.648 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.646+0000 7f433a7b99c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:46.648 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.646+0000 7f433a7b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:46.648 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.646+0000 7f433a7b99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:19:46.648 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.646+0000 7f433a7b99c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:46.648 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.646+0000 7f433a7b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:46.648 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.646+0000 7f433a7b99c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:46.649 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.650+0000 7f433a7b99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:46.649 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.650+0000 7f433a7b99c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:46.651 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.650+0000 7f433a7b99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:19:46.651 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.650+0000 7f433a7b99c0 20 searching for the correct realm 2024-09-12T17:19:46.655 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.654+0000 7f4338ac0640 0 -- 172.21.15.16:0/2947680816 >> [v2:172.21.15.19:6800/1509147557,v1:172.21.15.19:6801/1509147557] conn(0x55dd3c00d450 msgr2=0x55dd3c00f860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:19:46.662 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.662+0000 7f4337abe640 0 -- 172.21.15.16:0/2947680816 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f432800bb70 msgr2=0x7f432800a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:19:46.880 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.878+0000 7f433a7b99c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:19:46.880 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.878+0000 7f433a7b99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:19:46.880 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.878+0000 7f433a7b99c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:19:46.880 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.878+0000 7f433a7b99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:19:46.881 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.878+0000 7f433a7b99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:19:46.881 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.878+0000 7f433a7b99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:19:46.881 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.878+0000 7f433a7b99c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:46.881 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.882+0000 7f433a7b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:46.881 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.882+0000 7f433a7b99c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:46.882 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.882+0000 7f433a7b99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:46.882 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.882+0000 7f433a7b99c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:46.882 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.882+0000 7f433a7b99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:19:46.883 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.882+0000 7f433a7b99c0 20 zone default found 2024-09-12T17:19:46.883 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.882+0000 7f433a7b99c0 4 Realm: () 2024-09-12T17:19:46.883 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.882+0000 7f433a7b99c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:19:46.883 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.882+0000 7f433a7b99c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:19:46.883 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.882+0000 7f433a7b99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:19:46.883 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.882+0000 7f433a7b99c0 20 zonegroup default 2024-09-12T17:19:46.883 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.882+0000 7f433a7b99c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:46.883 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.882+0000 7f433a7b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:46.884 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.882+0000 7f433a7b99c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:46.884 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.882+0000 7f433a7b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:46.884 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.882+0000 7f433a7b99c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:46.884 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.886+0000 7f433a7b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:46.885 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.886+0000 7f433a7b99c0 20 started sync module instance, tier type = 2024-09-12T17:19:46.885 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.886+0000 7f433a7b99c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:19:46.906 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.906+0000 7f433a7b99c0 20 add_watcher() i=0 2024-09-12T17:19:46.906 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.906+0000 7f433a7b99c0 20 add_watcher() i=1 2024-09-12T17:19:46.906 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.906+0000 7f433a7b99c0 20 add_watcher() i=2 2024-09-12T17:19:46.906 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.906+0000 7f433a7b99c0 20 add_watcher() i=3 2024-09-12T17:19:46.906 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.906+0000 7f433a7b99c0 20 add_watcher() i=4 2024-09-12T17:19:46.906 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.906+0000 7f433a7b99c0 20 add_watcher() i=5 2024-09-12T17:19:46.906 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.906+0000 7f433a7b99c0 20 add_watcher() i=6 2024-09-12T17:19:46.908 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.906+0000 7f433a7b99c0 20 add_watcher() i=7 2024-09-12T17:19:46.908 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.906+0000 7f433a7b99c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:19:46.911 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.910+0000 7f41eefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:46.913 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.910+0000 7f433a7b99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:19:46.913 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.910+0000 7f433a7b99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:19:46.913 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.910+0000 7f433a7b99c0 5 note: GC not initialized 2024-09-12T17:19:46.914 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.914+0000 7f41edfdb640 20 reqs_thread_entry: start 2024-09-12T17:19:46.914 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.914+0000 7f433a7b99c0 20 init_complete bucket index max shards: 1 2024-09-12T17:19:46.914 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.914+0000 7f433a7b99c0 20 Filter name: none 2024-09-12T17:19:46.914 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.914+0000 7f415f7fe640 20 reqs_thread_entry: start 2024-09-12T17:19:46.914 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.914+0000 7f433a7b99c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T17:19:46.914 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.914+0000 7f433a7b99c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:46.915 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.914+0000 7f433a7b99c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:19:46.915 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.914+0000 7f433a7b99c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T17:19:46.915 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.914+0000 7f433a7b99c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T17:19:46.916 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.914+0000 7f433a7b99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30 : miss 2024-09-12T17:19:46.916 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.914+0000 7f433a7b99c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:46.916 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.914+0000 7f433a7b99c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T17:19:46.916 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.914+0000 7f433a7b99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30 info.flags=0x17 2024-09-12T17:19:46.916 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.914+0000 7f433a7b99c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30 to cache LRU end 2024-09-12T17:19:46.916 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.914+0000 7f433a7b99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:19:46.916 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.914+0000 7f433a7b99c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:46.916 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.914+0000 7f433a7b99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30 2024-09-12T17:19:46.917 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.918+0000 7f433a7b99c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:19:46.926 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.926+0000 7f433a7b99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30 info.flags=0x17 2024-09-12T17:19:46.926 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.926+0000 7f433a7b99c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30 to cache LRU end 2024-09-12T17:19:46.927 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.926+0000 7f433a7b99c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:46.927 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.926+0000 7f433a7b99c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30, ofs0, ns] 2024-09-12T17:19:46.927 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.926+0000 7f420effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431591 cookie 94408682856384 notifier 7170 bl.length()=931 2024-09-12T17:19:46.927 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.926+0000 7f420effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30 info.flags=0x17 2024-09-12T17:19:46.927 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.926+0000 7f420effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30 to cache LRU end 2024-09-12T17:19:46.927 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.926+0000 7f420effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:46.928 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.926+0000 7f433a7b99c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30]): orig_sources= new_sources= 2024-09-12T17:19:46.928 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.926+0000 7f433a7b99c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30]): potential sources added=[] removed=[] 2024-09-12T17:19:46.928 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.926+0000 7f433a7b99c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30]): orig_dests= new_dests= 2024-09-12T17:19:46.928 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.926+0000 7f433a7b99c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30]): potential dests added=[] removed=[] 2024-09-12T17:19:46.933 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.934+0000 7f433a7b99c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30.2.0 2024-09-12T17:19:46.934 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.934+0000 7f433a7b99c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30.2.0 2024-09-12T17:19:46.934 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.934+0000 7f433a7b99c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30.2.1 2024-09-12T17:19:46.934 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.934+0000 7f433a7b99c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30.2.1 2024-09-12T17:19:46.934 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.934+0000 7f433a7b99c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30.0 2024-09-12T17:19:46.939 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.938+0000 7f433a7b99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30 : hit (requested=0x17, cached=0x17) 2024-09-12T17:19:46.939 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.938+0000 7f433a7b99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30 2024-09-12T17:19:46.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.942+0000 7f433a7b99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30 info.flags=0x17 2024-09-12T17:19:46.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.942+0000 7f433a7b99c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30 to cache LRU end 2024-09-12T17:19:46.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.942+0000 7f433a7b99c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:46.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.942+0000 7f433a7b99c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30, ofs0, ns] 2024-09-12T17:19:46.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.942+0000 7f420f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431592 cookie 94408682856384 notifier 7170 bl.length()=931 2024-09-12T17:19:46.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.942+0000 7f420f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30 info.flags=0x17 2024-09-12T17:19:46.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.942+0000 7f420f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30 to cache LRU end 2024-09-12T17:19:46.944 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.942+0000 7f420f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:46.944 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.942+0000 7f433a7b99c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30]): orig_sources= new_sources= 2024-09-12T17:19:46.944 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.942+0000 7f433a7b99c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30]): potential sources added=[] removed=[] 2024-09-12T17:19:46.944 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.942+0000 7f433a7b99c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30]): orig_dests= new_dests= 2024-09-12T17:19:46.944 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.942+0000 7f433a7b99c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30]): potential dests added=[] removed=[] 2024-09-12T17:19:46.947 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.946+0000 7f433a7b99c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30.0 2024-09-12T17:19:46.948 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.946+0000 7f433a7b99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30 : hit (requested=0x17, cached=0x17) 2024-09-12T17:19:46.948 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.946+0000 7f433a7b99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30 2024-09-12T17:19:46.951 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.950+0000 7f433a7b99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30 info.flags=0x17 2024-09-12T17:19:46.952 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.950+0000 7f433a7b99c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30 to cache LRU end 2024-09-12T17:19:46.952 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.950+0000 7f433a7b99c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:46.952 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.950+0000 7f433a7b99c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30, ofs0, ns] 2024-09-12T17:19:46.952 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.954+0000 7f420effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431593 cookie 94408682856384 notifier 7170 bl.length()=899 2024-09-12T17:19:46.952 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.954+0000 7f420effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30 info.flags=0x17 2024-09-12T17:19:46.952 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.954+0000 7f420effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30 to cache LRU end 2024-09-12T17:19:46.952 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.954+0000 7f420effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:46.953 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.954+0000 7f433a7b99c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30]): orig_sources= new_sources= 2024-09-12T17:19:46.953 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.954+0000 7f433a7b99c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30]): potential sources added=[] removed=[] 2024-09-12T17:19:46.953 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.954+0000 7f433a7b99c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30]): orig_dests= new_dests= 2024-09-12T17:19:46.953 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.954+0000 7f433a7b99c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30]): potential dests added=[] removed=[] 2024-09-12T17:19:46.956 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.954+0000 7f433a7b99c0 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T17:19:46.960 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.958+0000 7f41eefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:46.965 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.966+0000 7f433a7b99c0 20 remove_watcher() i=0 2024-09-12T17:19:46.965 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.966+0000 7f433a7b99c0 2 removed watcher, disabling cache 2024-09-12T17:19:46.967 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.966+0000 7f433a7b99c0 20 remove_watcher() i=1 2024-09-12T17:19:46.970 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.970+0000 7f433a7b99c0 20 remove_watcher() i=2 2024-09-12T17:19:46.972 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.974+0000 7f433a7b99c0 20 remove_watcher() i=3 2024-09-12T17:19:46.974 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.974+0000 7f433a7b99c0 20 remove_watcher() i=4 2024-09-12T17:19:46.976 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.978+0000 7f433a7b99c0 20 remove_watcher() i=5 2024-09-12T17:19:46.978 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.978+0000 7f433a7b99c0 20 remove_watcher() i=6 2024-09-12T17:19:46.980 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:46.978+0000 7f433a7b99c0 20 remove_watcher() i=7 2024-09-12T17:19:46.995 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T17:19:47.022 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:19:47.022 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:19:47.068 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.070+0000 7f0d5f9089c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:47.071 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.070+0000 7f0d5f9089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:47.071 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.070+0000 7f0d5f9089c0 20 realm 2024-09-12T17:19:47.071 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.070+0000 7f0d5f9089c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:47.071 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.070+0000 7f0d5f9089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:47.071 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.070+0000 7f0d5f9089c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:19:47.071 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.070+0000 7f0d5f9089c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:47.071 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.070+0000 7f0d5f9089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:47.071 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.070+0000 7f0d5f9089c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:47.073 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.074+0000 7f0d5f9089c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:47.073 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.074+0000 7f0d5f9089c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:47.075 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.074+0000 7f0d5f9089c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:19:47.075 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.074+0000 7f0d5f9089c0 20 searching for the correct realm 2024-09-12T17:19:47.078 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.078+0000 7f0d5cc0d640 0 -- 172.21.15.16:0/2646438735 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7f0c28080880 msgr2=0x7f0c28082cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:19:47.085 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.086+0000 7f0d5cc0d640 0 -- 172.21.15.16:0/2646438735 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7f0d50008040 msgr2=0x7f0c28085a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:19:47.096 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.094+0000 7f0d5f9089c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:19:47.096 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.094+0000 7f0d5f9089c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:19:47.096 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.094+0000 7f0d5f9089c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:19:47.096 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.094+0000 7f0d5f9089c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:19:47.096 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.094+0000 7f0d5f9089c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:19:47.096 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.094+0000 7f0d5f9089c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:19:47.097 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.094+0000 7f0d5f9089c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:47.097 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.094+0000 7f0d5f9089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:47.097 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.094+0000 7f0d5f9089c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:47.097 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.098+0000 7f0d5f9089c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:47.097 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.098+0000 7f0d5f9089c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:47.098 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.098+0000 7f0d5f9089c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:19:47.098 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.098+0000 7f0d5f9089c0 20 zone default found 2024-09-12T17:19:47.098 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.098+0000 7f0d5f9089c0 4 Realm: () 2024-09-12T17:19:47.098 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.098+0000 7f0d5f9089c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:19:47.098 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.098+0000 7f0d5f9089c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:19:47.098 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.098+0000 7f0d5f9089c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:19:47.098 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.098+0000 7f0d5f9089c0 20 zonegroup default 2024-09-12T17:19:47.098 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.098+0000 7f0d5f9089c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:47.099 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.098+0000 7f0d5f9089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:47.099 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.098+0000 7f0d5f9089c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:47.099 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.098+0000 7f0d5f9089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:47.100 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.098+0000 7f0d5f9089c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:47.100 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.098+0000 7f0d5f9089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:47.100 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.098+0000 7f0d5f9089c0 20 started sync module instance, tier type = 2024-09-12T17:19:47.100 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.098+0000 7f0d5f9089c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:19:47.115 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.114+0000 7f0d5f9089c0 20 add_watcher() i=0 2024-09-12T17:19:47.116 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.114+0000 7f0d5f9089c0 20 add_watcher() i=1 2024-09-12T17:19:47.116 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.114+0000 7f0d5f9089c0 20 add_watcher() i=2 2024-09-12T17:19:47.116 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.114+0000 7f0d5f9089c0 20 add_watcher() i=3 2024-09-12T17:19:47.116 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.114+0000 7f0d5f9089c0 20 add_watcher() i=4 2024-09-12T17:19:47.116 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.114+0000 7f0d5f9089c0 20 add_watcher() i=5 2024-09-12T17:19:47.117 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.114+0000 7f0d5f9089c0 20 add_watcher() i=6 2024-09-12T17:19:47.117 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.118+0000 7f0d5f9089c0 20 add_watcher() i=7 2024-09-12T17:19:47.117 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.118+0000 7f0d5f9089c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:19:47.119 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.118+0000 7f0c137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:47.121 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.118+0000 7f0d5f9089c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:19:47.122 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.118+0000 7f0d5f9089c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:19:47.122 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.118+0000 7f0d5f9089c0 5 note: GC not initialized 2024-09-12T17:19:47.122 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.118+0000 7f0c127e4640 20 reqs_thread_entry: start 2024-09-12T17:19:47.122 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.118+0000 7f0d5f9089c0 20 init_complete bucket index max shards: 1 2024-09-12T17:19:47.122 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.122+0000 7f0d5f9089c0 20 Filter name: none 2024-09-12T17:19:47.122 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.122+0000 7f0b83fff640 20 reqs_thread_entry: start 2024-09-12T17:19:47.123 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.122+0000 7f0d5f9089c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:47.123 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.122+0000 7f0d5f9089c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:19:47.123 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.122+0000 7f0d5f9089c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:47.124 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.122+0000 7f0d5f9089c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:19:47.124 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.122+0000 7f0d5f9089c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:19:47.124 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.122+0000 7f0d5f9089c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:47.124 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.122+0000 7f0d5f9089c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:19:47.124 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.122+0000 7f0d5f9089c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:47.125 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.126+0000 7f0d5f9089c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:19:47.125 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.126+0000 7f0d5f9089c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:19:47.127 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.126+0000 7f0c137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:47.132 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.134+0000 7f0d5f9089c0 20 remove_watcher() i=0 2024-09-12T17:19:47.132 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.134+0000 7f0d5f9089c0 2 removed watcher, disabling cache 2024-09-12T17:19:47.134 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.134+0000 7f0d5f9089c0 20 remove_watcher() i=1 2024-09-12T17:19:47.137 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.138+0000 7f0d5f9089c0 20 remove_watcher() i=2 2024-09-12T17:19:47.139 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.138+0000 7f0d5f9089c0 20 remove_watcher() i=3 2024-09-12T17:19:47.141 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.142+0000 7f0d5f9089c0 20 remove_watcher() i=4 2024-09-12T17:19:47.142 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.142+0000 7f0d5f9089c0 20 remove_watcher() i=5 2024-09-12T17:19:47.143 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.142+0000 7f0d5f9089c0 20 remove_watcher() i=6 2024-09-12T17:19:47.145 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.146+0000 7f0d5f9089c0 20 remove_watcher() i=7 2024-09-12T17:19:47.159 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:47.159 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:19:47.159 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: error-at-commit-target-layout id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:19:47.159 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:47.245 INFO:tasks.workunit.client.0.smithi016.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-09-12T17:19:47.245 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:47.665 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T17:19:47.700 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:19:47.701 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:19:47.750 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.750+0000 7fa7a54539c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:47.752 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.750+0000 7fa7a54539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:47.752 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.750+0000 7fa7a54539c0 20 realm 2024-09-12T17:19:47.752 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.750+0000 7fa7a54539c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:47.752 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.750+0000 7fa7a54539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:47.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.750+0000 7fa7a54539c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:19:47.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.750+0000 7fa7a54539c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:47.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.750+0000 7fa7a54539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:47.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.750+0000 7fa7a54539c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:47.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.754+0000 7fa7a54539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:47.754 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.754+0000 7fa7a54539c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:47.755 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.754+0000 7fa7a54539c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:19:47.755 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.754+0000 7fa7a54539c0 20 searching for the correct realm 2024-09-12T17:19:47.759 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.758+0000 7fa7a375a640 0 -- 172.21.15.16:0/245977525 >> [v2:172.21.15.19:6800/1509147557,v1:172.21.15.19:6801/1509147557] conn(0x564ce4f54960 msgr2=0x564ce4f56d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:19:47.766 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.766+0000 7fa7a2758640 0 -- 172.21.15.16:0/245977525 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fa79c018440 msgr2=0x7fa79c0188c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:19:47.985 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.986+0000 7fa7a54539c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:19:47.985 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.986+0000 7fa7a54539c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:19:47.985 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.986+0000 7fa7a54539c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:19:47.986 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.986+0000 7fa7a54539c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:19:47.986 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.986+0000 7fa7a54539c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:19:47.986 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.986+0000 7fa7a54539c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:19:47.986 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.986+0000 7fa7a54539c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:47.986 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.986+0000 7fa7a54539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:47.986 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.986+0000 7fa7a54539c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:47.987 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.986+0000 7fa7a54539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:47.987 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.986+0000 7fa7a54539c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:47.987 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.986+0000 7fa7a54539c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:19:47.988 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.986+0000 7fa7a54539c0 20 zone default found 2024-09-12T17:19:47.988 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.986+0000 7fa7a54539c0 4 Realm: () 2024-09-12T17:19:47.988 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.986+0000 7fa7a54539c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:19:47.988 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.986+0000 7fa7a54539c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:19:47.988 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.986+0000 7fa7a54539c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:19:47.988 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.986+0000 7fa7a54539c0 20 zonegroup default 2024-09-12T17:19:47.988 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.986+0000 7fa7a54539c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:47.989 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.990+0000 7fa7a54539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:47.989 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.990+0000 7fa7a54539c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:47.989 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.990+0000 7fa7a54539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:47.989 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.990+0000 7fa7a54539c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:47.990 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.990+0000 7fa7a54539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:47.990 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.990+0000 7fa7a54539c0 20 started sync module instance, tier type = 2024-09-12T17:19:47.990 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:47.990+0000 7fa7a54539c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:19:48.015 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.014+0000 7fa7a54539c0 20 add_watcher() i=0 2024-09-12T17:19:48.015 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.014+0000 7fa7a54539c0 20 add_watcher() i=1 2024-09-12T17:19:48.015 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.014+0000 7fa7a54539c0 20 add_watcher() i=2 2024-09-12T17:19:48.015 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.014+0000 7fa7a54539c0 20 add_watcher() i=3 2024-09-12T17:19:48.015 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.014+0000 7fa7a54539c0 20 add_watcher() i=4 2024-09-12T17:19:48.015 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.014+0000 7fa7a54539c0 20 add_watcher() i=5 2024-09-12T17:19:48.015 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.014+0000 7fa7a54539c0 20 add_watcher() i=6 2024-09-12T17:19:48.017 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.018+0000 7fa7a54539c0 20 add_watcher() i=7 2024-09-12T17:19:48.017 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.018+0000 7fa7a54539c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:19:48.021 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.022+0000 7fa6597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:48.022 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.022+0000 7fa7a54539c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:19:48.022 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.022+0000 7fa7a54539c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:19:48.022 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.022+0000 7fa7a54539c0 5 note: GC not initialized 2024-09-12T17:19:48.023 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.022+0000 7fa5d3fff640 20 reqs_thread_entry: start 2024-09-12T17:19:48.023 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.022+0000 7fa7a54539c0 20 init_complete bucket index max shards: 1 2024-09-12T17:19:48.023 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.022+0000 7fa7a54539c0 20 Filter name: none 2024-09-12T17:19:48.023 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.022+0000 7fa5d1ffb640 20 reqs_thread_entry: start 2024-09-12T17:19:48.023 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.022+0000 7fa7a54539c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:48.025 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.026+0000 7fa7a54539c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:19:48.025 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.026+0000 7fa7a54539c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:48.026 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.026+0000 7fa7a54539c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:19:48.026 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.026+0000 7fa7a54539c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:19:48.026 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.026+0000 7fa7a54539c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:48.027 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.026+0000 7fa7a54539c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:19:48.027 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.026+0000 7fa7a54539c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:48.028 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.026+0000 7fa7a54539c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:19:48.028 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.026+0000 7fa7a54539c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:19:48.032 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.030+0000 7fa6597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:48.037 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.038+0000 7fa7a54539c0 20 remove_watcher() i=0 2024-09-12T17:19:48.037 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.038+0000 7fa7a54539c0 2 removed watcher, disabling cache 2024-09-12T17:19:48.039 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.038+0000 7fa7a54539c0 20 remove_watcher() i=1 2024-09-12T17:19:48.042 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.042+0000 7fa7a54539c0 20 remove_watcher() i=2 2024-09-12T17:19:48.044 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.042+0000 7fa7a54539c0 20 remove_watcher() i=3 2024-09-12T17:19:48.047 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.046+0000 7fa7a54539c0 20 remove_watcher() i=4 2024-09-12T17:19:48.048 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.050+0000 7fa7a54539c0 20 remove_watcher() i=5 2024-09-12T17:19:48.050 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.050+0000 7fa7a54539c0 20 remove_watcher() i=6 2024-09-12T17:19:48.051 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.050+0000 7fa7a54539c0 20 remove_watcher() i=7 2024-09-12T17:19:48.067 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:48.067 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:19:48.067 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: error-at-commit-target-layout id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:19:48.067 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:48.067 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-09-12T17:19:48.108 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:19:48.108 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:19:48.155 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.154+0000 7ff2277ab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:48.156 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.158+0000 7ff2277ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:48.156 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.158+0000 7ff2277ab9c0 20 realm 2024-09-12T17:19:48.156 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.158+0000 7ff2277ab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:48.157 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.158+0000 7ff2277ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:48.157 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.158+0000 7ff2277ab9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:19:48.157 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.158+0000 7ff2277ab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:48.157 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.158+0000 7ff2277ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:48.157 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.158+0000 7ff2277ab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:48.158 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.158+0000 7ff2277ab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:48.158 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.158+0000 7ff2277ab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:48.160 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.158+0000 7ff2277ab9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:19:48.160 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.158+0000 7ff2277ab9c0 20 searching for the correct realm 2024-09-12T17:19:48.163 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.162+0000 7ff225ab2640 0 -- 172.21.15.16:0/3038841850 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7ff21c045040 msgr2=0x7ff21c054400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:19:48.171 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.170+0000 7ff224ab0640 0 -- 172.21.15.16:0/3038841850 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7ff220027900 msgr2=0x7ff220082a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:19:48.388 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.386+0000 7ff2277ab9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:19:48.388 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.386+0000 7ff2277ab9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:19:48.388 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.386+0000 7ff2277ab9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:19:48.388 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.386+0000 7ff2277ab9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:19:48.388 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.386+0000 7ff2277ab9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:19:48.388 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.386+0000 7ff2277ab9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:19:48.388 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.386+0000 7ff2277ab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:48.389 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.390+0000 7ff2277ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:48.389 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.390+0000 7ff2277ab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:48.389 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.390+0000 7ff2277ab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:48.389 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.390+0000 7ff2277ab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:48.391 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.390+0000 7ff2277ab9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:19:48.391 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.390+0000 7ff2277ab9c0 20 zone default found 2024-09-12T17:19:48.391 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.390+0000 7ff2277ab9c0 4 Realm: () 2024-09-12T17:19:48.391 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.390+0000 7ff2277ab9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:19:48.391 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.390+0000 7ff2277ab9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:19:48.391 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.390+0000 7ff2277ab9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:19:48.391 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.390+0000 7ff2277ab9c0 20 zonegroup default 2024-09-12T17:19:48.391 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.390+0000 7ff2277ab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:48.392 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.390+0000 7ff2277ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:48.392 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.390+0000 7ff2277ab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:48.392 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.394+0000 7ff2277ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:48.392 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.394+0000 7ff2277ab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:48.393 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.394+0000 7ff2277ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:48.393 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.394+0000 7ff2277ab9c0 20 started sync module instance, tier type = 2024-09-12T17:19:48.393 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.394+0000 7ff2277ab9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:19:48.417 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.418+0000 7ff2277ab9c0 20 add_watcher() i=0 2024-09-12T17:19:48.418 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.418+0000 7ff2277ab9c0 20 add_watcher() i=1 2024-09-12T17:19:48.418 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.418+0000 7ff2277ab9c0 20 add_watcher() i=2 2024-09-12T17:19:48.418 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.418+0000 7ff2277ab9c0 20 add_watcher() i=3 2024-09-12T17:19:48.418 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.418+0000 7ff2277ab9c0 20 add_watcher() i=4 2024-09-12T17:19:48.418 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.418+0000 7ff2277ab9c0 20 add_watcher() i=5 2024-09-12T17:19:48.418 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.418+0000 7ff2277ab9c0 20 add_watcher() i=6 2024-09-12T17:19:48.420 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.418+0000 7ff2277ab9c0 20 add_watcher() i=7 2024-09-12T17:19:48.420 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.418+0000 7ff2277ab9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:19:48.424 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.426+0000 7ff0dbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:48.425 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.426+0000 7ff2277ab9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:19:48.425 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.426+0000 7ff2277ab9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:19:48.425 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.426+0000 7ff2277ab9c0 5 note: GC not initialized 2024-09-12T17:19:48.426 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.426+0000 7ff0dafe5640 20 reqs_thread_entry: start 2024-09-12T17:19:48.426 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.426+0000 7ff2277ab9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:19:48.426 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.426+0000 7ff2277ab9c0 20 Filter name: none 2024-09-12T17:19:48.427 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.426+0000 7ff0d8fe1640 20 reqs_thread_entry: start 2024-09-12T17:19:48.427 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.426+0000 7ff2277ab9c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T17:19:48.427 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.426+0000 7ff2277ab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:48.427 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.426+0000 7ff2277ab9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:19:48.428 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.426+0000 7ff2277ab9c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T17:19:48.428 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.426+0000 7ff2277ab9c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T17:19:48.428 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.426+0000 7ff2277ab9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31 : miss 2024-09-12T17:19:48.428 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.426+0000 7ff2277ab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:48.428 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.430+0000 7ff2277ab9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:19:48.428 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.430+0000 7ff2277ab9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31 info.flags=0x17 2024-09-12T17:19:48.428 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.430+0000 7ff2277ab9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31 to cache LRU end 2024-09-12T17:19:48.429 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.430+0000 7ff2277ab9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:19:48.429 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.430+0000 7ff2277ab9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:48.429 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.430+0000 7ff2277ab9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31 2024-09-12T17:19:48.437 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.438+0000 7ff2277ab9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31 info.flags=0x17 2024-09-12T17:19:48.437 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.438+0000 7ff2277ab9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31 to cache LRU end 2024-09-12T17:19:48.437 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.438+0000 7ff2277ab9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:48.437 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.438+0000 7ff2277ab9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31, ofs0, ns] 2024-09-12T17:19:48.437 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.438+0000 7ff0f7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431596 cookie 93982787035552 notifier 6908 bl.length()=931 2024-09-12T17:19:48.437 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.438+0000 7ff0f7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31 info.flags=0x17 2024-09-12T17:19:48.438 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.438+0000 7ff0f7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31 to cache LRU end 2024-09-12T17:19:48.438 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.438+0000 7ff0f7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:48.440 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.438+0000 7ff2277ab9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31]): orig_sources= new_sources= 2024-09-12T17:19:48.440 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.438+0000 7ff2277ab9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31]): potential sources added=[] removed=[] 2024-09-12T17:19:48.440 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.438+0000 7ff2277ab9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31]): orig_dests= new_dests= 2024-09-12T17:19:48.440 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.438+0000 7ff2277ab9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31]): potential dests added=[] removed=[] 2024-09-12T17:19:48.443 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.442+0000 7ff2277ab9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31.1.0 2024-09-12T17:19:48.443 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.442+0000 7ff2277ab9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31.1.0 2024-09-12T17:19:48.444 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.442+0000 7ff2277ab9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31.1.1 2024-09-12T17:19:48.444 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.442+0000 7ff2277ab9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31.1.1 2024-09-12T17:19:48.444 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.442+0000 7ff2277ab9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31.0 2024-09-12T17:19:48.449 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.450+0000 7ff2277ab9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31 : hit (requested=0x17, cached=0x17) 2024-09-12T17:19:48.450 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.450+0000 7ff2277ab9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31 2024-09-12T17:19:48.451 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.450+0000 7ff2277ab9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31 info.flags=0x17 2024-09-12T17:19:48.452 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.450+0000 7ff2277ab9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31 to cache LRU end 2024-09-12T17:19:48.452 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.450+0000 7ff2277ab9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:48.452 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.450+0000 7ff2277ab9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31, ofs0, ns] 2024-09-12T17:19:48.453 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.450+0000 7ff0f7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431597 cookie 93982787035552 notifier 6908 bl.length()=931 2024-09-12T17:19:48.453 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.450+0000 7ff0f7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31 info.flags=0x17 2024-09-12T17:19:48.453 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.450+0000 7ff0f7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31 to cache LRU end 2024-09-12T17:19:48.453 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.450+0000 7ff0f7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:48.453 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.454+0000 7ff2277ab9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31]): orig_sources= new_sources= 2024-09-12T17:19:48.453 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.454+0000 7ff2277ab9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31]): potential sources added=[] removed=[] 2024-09-12T17:19:48.453 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.454+0000 7ff2277ab9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31]): orig_dests= new_dests= 2024-09-12T17:19:48.454 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.454+0000 7ff2277ab9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31]): potential dests added=[] removed=[] 2024-09-12T17:19:48.456 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.454+0000 7ff2277ab9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31.0 2024-09-12T17:19:48.457 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.458+0000 7ff2277ab9c0 -1 Injecting error=-125 at location=commit_target_layout 2024-09-12T17:19:48.457 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.458+0000 7ff2277ab9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31 : hit (requested=0x17, cached=0x17) 2024-09-12T17:19:48.457 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.458+0000 7ff2277ab9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31 2024-09-12T17:19:48.459 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.458+0000 7ff2277ab9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31 info.flags=0x17 2024-09-12T17:19:48.459 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.458+0000 7ff2277ab9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31 to cache LRU end 2024-09-12T17:19:48.459 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.458+0000 7ff2277ab9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:48.459 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.458+0000 7ff2277ab9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31, ofs0, ns] 2024-09-12T17:19:48.459 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.458+0000 7ff108ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431598 cookie 93982787035552 notifier 6908 bl.length()=899 2024-09-12T17:19:48.460 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.458+0000 7ff108ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31 info.flags=0x17 2024-09-12T17:19:48.460 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.458+0000 7ff108ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31 to cache LRU end 2024-09-12T17:19:48.460 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.458+0000 7ff108ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:48.460 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.462+0000 7ff2277ab9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31]): orig_sources= new_sources= 2024-09-12T17:19:48.460 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.462+0000 7ff2277ab9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31]): potential sources added=[] removed=[] 2024-09-12T17:19:48.460 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.462+0000 7ff2277ab9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31]): orig_dests= new_dests= 2024-09-12T17:19:48.460 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.462+0000 7ff2277ab9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31]): potential dests added=[] removed=[] 2024-09-12T17:19:48.463 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.462+0000 7ff2277ab9c0 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T17:19:48.467 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.466+0000 7ff0dbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:48.472 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.474+0000 7ff2277ab9c0 20 remove_watcher() i=0 2024-09-12T17:19:48.472 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.474+0000 7ff2277ab9c0 2 removed watcher, disabling cache 2024-09-12T17:19:48.475 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.474+0000 7ff2277ab9c0 20 remove_watcher() i=1 2024-09-12T17:19:48.478 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.478+0000 7ff2277ab9c0 20 remove_watcher() i=2 2024-09-12T17:19:48.480 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.478+0000 7ff2277ab9c0 20 remove_watcher() i=3 2024-09-12T17:19:48.482 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.482+0000 7ff2277ab9c0 20 remove_watcher() i=4 2024-09-12T17:19:48.484 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.486+0000 7ff2277ab9c0 20 remove_watcher() i=5 2024-09-12T17:19:48.486 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.486+0000 7ff2277ab9c0 20 remove_watcher() i=6 2024-09-12T17:19:48.488 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.490+0000 7ff2277ab9c0 20 remove_watcher() i=7 2024-09-12T17:19:48.507 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T17:19:48.539 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:19:48.540 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:19:48.586 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.586+0000 7fe7750939c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:48.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.586+0000 7fe7750939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:48.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.586+0000 7fe7750939c0 20 realm 2024-09-12T17:19:48.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.586+0000 7fe7750939c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:48.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.586+0000 7fe7750939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:48.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.586+0000 7fe7750939c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:19:48.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.586+0000 7fe7750939c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:48.589 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.590+0000 7fe7750939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:48.589 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.590+0000 7fe7750939c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:48.590 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.590+0000 7fe7750939c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:48.590 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.590+0000 7fe7750939c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:48.591 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.590+0000 7fe7750939c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:19:48.591 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.590+0000 7fe7750939c0 20 searching for the correct realm 2024-09-12T17:19:48.595 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.594+0000 7fe77339a640 0 -- 172.21.15.16:0/92733270 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fe7680e6070 msgr2=0x7fe7680db920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:19:48.603 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.602+0000 7fe772398640 0 -- 172.21.15.16:0/92733270 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fe76c036b60 msgr2=0x7fe76c046460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:19:48.820 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.818+0000 7fe7750939c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:19:48.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.818+0000 7fe7750939c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:19:48.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.818+0000 7fe7750939c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:19:48.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.818+0000 7fe7750939c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:19:48.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.818+0000 7fe7750939c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:19:48.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.818+0000 7fe7750939c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:19:48.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.822+0000 7fe7750939c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:48.822 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.822+0000 7fe7750939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:48.822 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.822+0000 7fe7750939c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:48.822 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.822+0000 7fe7750939c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:48.822 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.822+0000 7fe7750939c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:48.823 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.822+0000 7fe7750939c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:19:48.823 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.822+0000 7fe7750939c0 20 zone default found 2024-09-12T17:19:48.823 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.822+0000 7fe7750939c0 4 Realm: () 2024-09-12T17:19:48.823 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.822+0000 7fe7750939c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:19:48.823 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.822+0000 7fe7750939c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:19:48.823 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.822+0000 7fe7750939c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:19:48.824 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.822+0000 7fe7750939c0 20 zonegroup default 2024-09-12T17:19:48.824 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.822+0000 7fe7750939c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:48.824 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.822+0000 7fe7750939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:48.824 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.822+0000 7fe7750939c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:48.825 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.826+0000 7fe7750939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:48.825 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.826+0000 7fe7750939c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:48.825 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.826+0000 7fe7750939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:48.825 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.826+0000 7fe7750939c0 20 started sync module instance, tier type = 2024-09-12T17:19:48.826 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.826+0000 7fe7750939c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:19:48.849 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.850+0000 7fe7750939c0 20 add_watcher() i=0 2024-09-12T17:19:48.849 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.850+0000 7fe7750939c0 20 add_watcher() i=1 2024-09-12T17:19:48.849 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.850+0000 7fe7750939c0 20 add_watcher() i=2 2024-09-12T17:19:48.849 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.850+0000 7fe7750939c0 20 add_watcher() i=3 2024-09-12T17:19:48.849 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.850+0000 7fe7750939c0 20 add_watcher() i=4 2024-09-12T17:19:48.849 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.850+0000 7fe7750939c0 20 add_watcher() i=5 2024-09-12T17:19:48.849 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.850+0000 7fe7750939c0 20 add_watcher() i=6 2024-09-12T17:19:48.851 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.850+0000 7fe7750939c0 20 add_watcher() i=7 2024-09-12T17:19:48.851 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.850+0000 7fe7750939c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:19:48.856 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.854+0000 7fe6297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:48.857 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.858+0000 7fe7750939c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:19:48.857 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.858+0000 7fe7750939c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:19:48.857 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.858+0000 7fe7750939c0 5 note: GC not initialized 2024-09-12T17:19:48.859 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.858+0000 7fe5a3fff640 20 reqs_thread_entry: start 2024-09-12T17:19:48.859 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.858+0000 7fe7750939c0 20 init_complete bucket index max shards: 1 2024-09-12T17:19:48.859 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.858+0000 7fe7750939c0 20 Filter name: none 2024-09-12T17:19:48.859 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.858+0000 7fe5a1ffb640 20 reqs_thread_entry: start 2024-09-12T17:19:48.859 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.858+0000 7fe7750939c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:48.860 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.858+0000 7fe7750939c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:19:48.861 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.858+0000 7fe7750939c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:48.861 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.862+0000 7fe7750939c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:19:48.861 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.862+0000 7fe7750939c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:19:48.862 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.862+0000 7fe7750939c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:48.862 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.862+0000 7fe7750939c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:19:48.862 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.862+0000 7fe7750939c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:48.862 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.862+0000 7fe7750939c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:19:48.863 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.862+0000 7fe7750939c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:19:48.865 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.866+0000 7fe6297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:48.870 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.870+0000 7fe7750939c0 20 remove_watcher() i=0 2024-09-12T17:19:48.870 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.870+0000 7fe7750939c0 2 removed watcher, disabling cache 2024-09-12T17:19:48.872 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.874+0000 7fe7750939c0 20 remove_watcher() i=1 2024-09-12T17:19:48.875 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.874+0000 7fe7750939c0 20 remove_watcher() i=2 2024-09-12T17:19:48.877 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.878+0000 7fe7750939c0 20 remove_watcher() i=3 2024-09-12T17:19:48.879 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.878+0000 7fe7750939c0 20 remove_watcher() i=4 2024-09-12T17:19:48.881 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.882+0000 7fe7750939c0 20 remove_watcher() i=5 2024-09-12T17:19:48.882 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.882+0000 7fe7750939c0 20 remove_watcher() i=6 2024-09-12T17:19:48.884 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:48.882+0000 7fe7750939c0 20 remove_watcher() i=7 2024-09-12T17:19:48.899 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:48.899 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:19:48.899 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: error-at-commit-target-layout id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T17:19:48.899 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:48.995 INFO:tasks.workunit.client.0.smithi016.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-09-12T17:19:48.995 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:49.456 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T17:19:49.488 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:19:49.489 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:19:49.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.538+0000 7f29db24c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:49.540 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.538+0000 7f29db24c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:49.540 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.538+0000 7f29db24c9c0 20 realm 2024-09-12T17:19:49.540 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.538+0000 7f29db24c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:49.540 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.538+0000 7f29db24c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:49.540 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.542+0000 7f29db24c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:19:49.541 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.542+0000 7f29db24c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:49.541 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.542+0000 7f29db24c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:49.541 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.542+0000 7f29db24c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:49.542 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.542+0000 7f29db24c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:49.542 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.542+0000 7f29db24c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:49.544 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.542+0000 7f29db24c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:19:49.544 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.542+0000 7f29db24c9c0 20 searching for the correct realm 2024-09-12T17:19:49.549 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.550+0000 7f29d8551640 0 -- 172.21.15.16:0/1665360226 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7f29c80b9960 msgr2=0x7f29c80d5410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:19:49.555 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.554+0000 7f29d8551640 0 -- 172.21.15.16:0/1665360226 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f29d006dbd0 msgr2=0x7f29d00665a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:19:49.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.774+0000 7f29db24c9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:19:49.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.774+0000 7f29db24c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:19:49.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.774+0000 7f29db24c9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:19:49.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.774+0000 7f29db24c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:19:49.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.774+0000 7f29db24c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:19:49.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.774+0000 7f29db24c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:19:49.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.774+0000 7f29db24c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:49.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.774+0000 7f29db24c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:49.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.774+0000 7f29db24c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:49.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.774+0000 7f29db24c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:49.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.774+0000 7f29db24c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:49.775 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.774+0000 7f29db24c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:19:49.775 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.774+0000 7f29db24c9c0 20 zone default found 2024-09-12T17:19:49.775 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.774+0000 7f29db24c9c0 4 Realm: () 2024-09-12T17:19:49.775 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.774+0000 7f29db24c9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:19:49.775 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.774+0000 7f29db24c9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:19:49.775 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.774+0000 7f29db24c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:19:49.775 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.774+0000 7f29db24c9c0 20 zonegroup default 2024-09-12T17:19:49.775 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.774+0000 7f29db24c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:49.776 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.774+0000 7f29db24c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:49.776 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.774+0000 7f29db24c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:49.776 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.778+0000 7f29db24c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:49.776 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.778+0000 7f29db24c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:49.777 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.778+0000 7f29db24c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:49.777 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.778+0000 7f29db24c9c0 20 started sync module instance, tier type = 2024-09-12T17:19:49.777 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.778+0000 7f29db24c9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:19:49.799 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.798+0000 7f29db24c9c0 20 add_watcher() i=0 2024-09-12T17:19:49.799 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.798+0000 7f29db24c9c0 20 add_watcher() i=1 2024-09-12T17:19:49.799 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.798+0000 7f29db24c9c0 20 add_watcher() i=2 2024-09-12T17:19:49.800 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.798+0000 7f29db24c9c0 20 add_watcher() i=3 2024-09-12T17:19:49.800 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.798+0000 7f29db24c9c0 20 add_watcher() i=4 2024-09-12T17:19:49.800 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.798+0000 7f29db24c9c0 20 add_watcher() i=5 2024-09-12T17:19:49.800 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.798+0000 7f29db24c9c0 20 add_watcher() i=6 2024-09-12T17:19:49.801 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.802+0000 7f29db24c9c0 20 add_watcher() i=7 2024-09-12T17:19:49.801 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.802+0000 7f29db24c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:19:49.805 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.806+0000 7f288efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:49.806 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.806+0000 7f29db24c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:19:49.806 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.806+0000 7f29db24c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:19:49.806 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.806+0000 7f29db24c9c0 5 note: GC not initialized 2024-09-12T17:19:49.807 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.806+0000 7f288dfe3640 20 reqs_thread_entry: start 2024-09-12T17:19:49.807 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.806+0000 7f29db24c9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:19:49.807 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.806+0000 7f29db24c9c0 20 Filter name: none 2024-09-12T17:19:49.807 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.806+0000 7f27ff7fe640 20 reqs_thread_entry: start 2024-09-12T17:19:49.808 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.806+0000 7f29db24c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:49.809 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.810+0000 7f29db24c9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:19:49.809 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.810+0000 7f29db24c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:49.811 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.810+0000 7f29db24c9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:19:49.811 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.810+0000 7f29db24c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:19:49.811 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.810+0000 7f29db24c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:49.811 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.810+0000 7f29db24c9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:19:49.811 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.810+0000 7f29db24c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:49.813 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.814+0000 7f29db24c9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:19:49.813 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.814+0000 7f29db24c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:19:49.816 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.814+0000 7f288efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:49.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.822+0000 7f29db24c9c0 20 remove_watcher() i=0 2024-09-12T17:19:49.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.822+0000 7f29db24c9c0 2 removed watcher, disabling cache 2024-09-12T17:19:49.824 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.826+0000 7f29db24c9c0 20 remove_watcher() i=1 2024-09-12T17:19:49.827 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.826+0000 7f29db24c9c0 20 remove_watcher() i=2 2024-09-12T17:19:49.829 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.830+0000 7f29db24c9c0 20 remove_watcher() i=3 2024-09-12T17:19:49.831 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.830+0000 7f29db24c9c0 20 remove_watcher() i=4 2024-09-12T17:19:49.833 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.834+0000 7f29db24c9c0 20 remove_watcher() i=5 2024-09-12T17:19:49.834 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.834+0000 7f29db24c9c0 20 remove_watcher() i=6 2024-09-12T17:19:49.836 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.834+0000 7f29db24c9c0 20 remove_watcher() i=7 2024-09-12T17:19:49.851 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:49.851 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:19:49.851 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: abort-at-commit-target-layout id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:19:49.851 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:49.852 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-09-12T17:19:49.888 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:19:49.888 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:19:49.933 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.934+0000 7f0224c859c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:49.935 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.934+0000 7f0224c859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:49.935 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.934+0000 7f0224c859c0 20 realm 2024-09-12T17:19:49.935 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.934+0000 7f0224c859c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:49.935 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.934+0000 7f0224c859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:49.935 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.934+0000 7f0224c859c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:19:49.936 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.934+0000 7f0224c859c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:49.936 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.934+0000 7f0224c859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:49.936 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.934+0000 7f0224c859c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:49.937 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.938+0000 7f0224c859c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:49.937 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.938+0000 7f0224c859c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:49.939 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.938+0000 7f0224c859c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:19:49.939 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.938+0000 7f0224c859c0 20 searching for the correct realm 2024-09-12T17:19:49.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.942+0000 7f0222f8c640 0 -- 172.21.15.16:0/560809507 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f02180c7040 msgr2=0x7f02180b79c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:19:49.950 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:49.950+0000 7f0221f8a640 0 -- 172.21.15.16:0/560809507 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f021c09ab90 msgr2=0x7f021c090330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:19:50.166 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.166+0000 7f0224c859c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:19:50.167 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.166+0000 7f0224c859c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:19:50.167 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.166+0000 7f0224c859c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:19:50.167 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.166+0000 7f0224c859c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:19:50.167 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.166+0000 7f0224c859c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:19:50.167 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.166+0000 7f0224c859c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:19:50.167 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.166+0000 7f0224c859c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.168 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.166+0000 7f0224c859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:50.168 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.166+0000 7f0224c859c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.168 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.166+0000 7f0224c859c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:50.168 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.166+0000 7f0224c859c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.169 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.170+0000 7f0224c859c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:19:50.169 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.170+0000 7f0224c859c0 20 zone default found 2024-09-12T17:19:50.169 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.170+0000 7f0224c859c0 4 Realm: () 2024-09-12T17:19:50.169 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.170+0000 7f0224c859c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:19:50.169 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.170+0000 7f0224c859c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:19:50.170 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.170+0000 7f0224c859c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:19:50.170 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.170+0000 7f0224c859c0 20 zonegroup default 2024-09-12T17:19:50.170 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.170+0000 7f0224c859c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.170 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.170+0000 7f0224c859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:50.170 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.170+0000 7f0224c859c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.171 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.170+0000 7f0224c859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:50.171 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.170+0000 7f0224c859c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.171 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.170+0000 7f0224c859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:50.171 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.170+0000 7f0224c859c0 20 started sync module instance, tier type = 2024-09-12T17:19:50.171 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.170+0000 7f0224c859c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:19:50.193 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.194+0000 7f0224c859c0 20 add_watcher() i=0 2024-09-12T17:19:50.193 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.194+0000 7f0224c859c0 20 add_watcher() i=1 2024-09-12T17:19:50.193 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.194+0000 7f0224c859c0 20 add_watcher() i=2 2024-09-12T17:19:50.193 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.194+0000 7f0224c859c0 20 add_watcher() i=3 2024-09-12T17:19:50.193 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.194+0000 7f0224c859c0 20 add_watcher() i=4 2024-09-12T17:19:50.193 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.194+0000 7f0224c859c0 20 add_watcher() i=5 2024-09-12T17:19:50.193 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.194+0000 7f0224c859c0 20 add_watcher() i=6 2024-09-12T17:19:50.195 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.194+0000 7f0224c859c0 20 add_watcher() i=7 2024-09-12T17:19:50.195 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.194+0000 7f0224c859c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:19:50.198 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.198+0000 7f00d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:50.199 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.198+0000 7f0224c859c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:19:50.199 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.198+0000 7f0224c859c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:19:50.199 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.198+0000 7f0224c859c0 5 note: GC not initialized 2024-09-12T17:19:50.200 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.198+0000 7f00537fe640 20 reqs_thread_entry: start 2024-09-12T17:19:50.200 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.198+0000 7f0224c859c0 20 init_complete bucket index max shards: 1 2024-09-12T17:19:50.200 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.198+0000 7f0224c859c0 20 Filter name: none 2024-09-12T17:19:50.200 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.198+0000 7f00517fa640 20 reqs_thread_entry: start 2024-09-12T17:19:50.200 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.198+0000 7f0224c859c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T17:19:50.200 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.198+0000 7f0224c859c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.201 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.202+0000 7f0224c859c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:19:50.201 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.202+0000 7f0224c859c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T17:19:50.201 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.202+0000 7f0224c859c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T17:19:50.201 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.202+0000 7f0224c859c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 : miss 2024-09-12T17:19:50.201 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.202+0000 7f0224c859c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.202 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.202+0000 7f0224c859c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:19:50.202 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.202+0000 7f0224c859c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 info.flags=0x17 2024-09-12T17:19:50.202 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.202+0000 7f0224c859c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 to cache LRU end 2024-09-12T17:19:50.202 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.202+0000 7f0224c859c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:19:50.202 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.202+0000 7f0224c859c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:50.202 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.202+0000 7f0224c859c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 2024-09-12T17:19:50.211 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.210+0000 7f0224c859c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 info.flags=0x17 2024-09-12T17:19:50.211 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.210+0000 7f0224c859c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 to cache LRU end 2024-09-12T17:19:50.212 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.210+0000 7f0224c859c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:50.212 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.210+0000 7f0224c859c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32, ofs0, ns] 2024-09-12T17:19:50.212 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.214+0000 7f0105ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431601 cookie 93869243185312 notifier 7281 bl.length()=931 2024-09-12T17:19:50.212 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.214+0000 7f0105ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 info.flags=0x17 2024-09-12T17:19:50.212 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.214+0000 7f0105ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 to cache LRU end 2024-09-12T17:19:50.213 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.214+0000 7f0105ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:50.214 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.214+0000 7f0224c859c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32]): orig_sources= new_sources= 2024-09-12T17:19:50.214 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.214+0000 7f0224c859c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32]): potential sources added=[] removed=[] 2024-09-12T17:19:50.214 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.214+0000 7f0224c859c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32]): orig_dests= new_dests= 2024-09-12T17:19:50.214 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.214+0000 7f0224c859c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32]): potential dests added=[] removed=[] 2024-09-12T17:19:50.219 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.218+0000 7f0224c859c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32.1.0 2024-09-12T17:19:50.219 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.218+0000 7f0224c859c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32.1.0 2024-09-12T17:19:50.219 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.218+0000 7f0224c859c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32.1.1 2024-09-12T17:19:50.220 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.218+0000 7f0224c859c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32.1.1 2024-09-12T17:19:50.220 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.218+0000 7f0224c859c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32.0 2024-09-12T17:19:50.225 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.226+0000 7f0224c859c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 : hit (requested=0x17, cached=0x17) 2024-09-12T17:19:50.225 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.226+0000 7f0224c859c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 2024-09-12T17:19:50.229 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.230+0000 7f0224c859c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 info.flags=0x17 2024-09-12T17:19:50.229 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.230+0000 7f0224c859c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 to cache LRU end 2024-09-12T17:19:50.229 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.230+0000 7f0224c859c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:50.229 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.230+0000 7f0224c859c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32, ofs0, ns] 2024-09-12T17:19:50.229 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.230+0000 7f0105ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431602 cookie 93869243185312 notifier 7281 bl.length()=931 2024-09-12T17:19:50.229 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.230+0000 7f0105ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 info.flags=0x17 2024-09-12T17:19:50.229 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.230+0000 7f0105ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 to cache LRU end 2024-09-12T17:19:50.230 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.230+0000 7f0105ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:50.231 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.230+0000 7f0224c859c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32]): orig_sources= new_sources= 2024-09-12T17:19:50.231 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.230+0000 7f0224c859c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32]): potential sources added=[] removed=[] 2024-09-12T17:19:50.231 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.230+0000 7f0224c859c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32]): orig_dests= new_dests= 2024-09-12T17:19:50.231 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.230+0000 7f0224c859c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32]): potential dests added=[] removed=[] 2024-09-12T17:19:50.234 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.234+0000 7f0224c859c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32.0 2024-09-12T17:19:50.234 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0224c859c0 time 2024-09-12T17:19:50.237297+0000 2024-09-12T17:19:50.235 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:19:50.237 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:19:50.237 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f022855f2eb] 2024-09-12T17:19:50.237 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f022855f49f] 2024-09-12T17:19:50.237 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555fa04c00c1] 2024-09-12T17:19:50.238 INFO:tasks.workunit.client.0.smithi016.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x555fa04d2467] 2024-09-12T17:19:50.238 INFO:tasks.workunit.client.0.smithi016.stderr: 5: main() 2024-09-12T17:19:50.238 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f02273c5d90] 2024-09-12T17:19:50.238 INFO:tasks.workunit.client.0.smithi016.stderr: 7: __libc_start_main() 2024-09-12T17:19:50.238 INFO:tasks.workunit.client.0.smithi016.stderr: 8: _start() 2024-09-12T17:19:50.238 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.238+0000 7f0224c859c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0224c859c0 time 2024-09-12T17:19:50.237297+0000 2024-09-12T17:19:50.238 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:19:50.238 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:50.238 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:19:50.238 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f022855f2eb] 2024-09-12T17:19:50.238 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f022855f49f] 2024-09-12T17:19:50.239 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555fa04c00c1] 2024-09-12T17:19:50.239 INFO:tasks.workunit.client.0.smithi016.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x555fa04d2467] 2024-09-12T17:19:50.239 INFO:tasks.workunit.client.0.smithi016.stderr: 5: main() 2024-09-12T17:19:50.239 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f02273c5d90] 2024-09-12T17:19:50.239 INFO:tasks.workunit.client.0.smithi016.stderr: 7: __libc_start_main() 2024-09-12T17:19:50.239 INFO:tasks.workunit.client.0.smithi016.stderr: 8: _start() 2024-09-12T17:19:50.239 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:50.239 INFO:tasks.workunit.client.0.smithi016.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:19:50.239 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7f0224c859c0 thread_name:radosgw-admin 2024-09-12T17:19:50.240 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:19:50.241 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f02273de520] 2024-09-12T17:19:50.241 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:19:50.241 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:19:50.241 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:19:50.241 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f022855f345] 2024-09-12T17:19:50.241 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f022855f49f] 2024-09-12T17:19:50.241 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555fa04c00c1] 2024-09-12T17:19:50.241 INFO:tasks.workunit.client.0.smithi016.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x555fa04d2467] 2024-09-12T17:19:50.241 INFO:tasks.workunit.client.0.smithi016.stderr: 9: main() 2024-09-12T17:19:50.241 INFO:tasks.workunit.client.0.smithi016.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f02273c5d90] 2024-09-12T17:19:50.241 INFO:tasks.workunit.client.0.smithi016.stderr: 11: __libc_start_main() 2024-09-12T17:19:50.242 INFO:tasks.workunit.client.0.smithi016.stderr: 12: _start() 2024-09-12T17:19:50.242 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.242+0000 7f0224c859c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:19:50.242 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7f0224c859c0 thread_name:radosgw-admin 2024-09-12T17:19:50.242 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:50.242 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:19:50.242 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f02273de520] 2024-09-12T17:19:50.242 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:19:50.242 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:19:50.242 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:19:50.242 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f022855f345] 2024-09-12T17:19:50.242 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f022855f49f] 2024-09-12T17:19:50.242 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555fa04c00c1] 2024-09-12T17:19:50.243 INFO:tasks.workunit.client.0.smithi016.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x555fa04d2467] 2024-09-12T17:19:50.243 INFO:tasks.workunit.client.0.smithi016.stderr: 9: main() 2024-09-12T17:19:50.243 INFO:tasks.workunit.client.0.smithi016.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f02273c5d90] 2024-09-12T17:19:50.243 INFO:tasks.workunit.client.0.smithi016.stderr: 11: __libc_start_main() 2024-09-12T17:19:50.243 INFO:tasks.workunit.client.0.smithi016.stderr: 12: _start() 2024-09-12T17:19:50.243 INFO:tasks.workunit.client.0.smithi016.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:19:50.243 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:50.243 INFO:tasks.workunit.client.0.smithi016.stderr:--- begin dump of recent events --- 2024-09-12T17:19:50.263 INFO:tasks.workunit.client.0.smithi016.stderr: -499> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d58b30) adding auth protocol: cephx 2024-09-12T17:19:50.263 INFO:tasks.workunit.client.0.smithi016.stderr: -498> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d58b30) adding auth protocol: cephx 2024-09-12T17:19:50.264 INFO:tasks.workunit.client.0.smithi016.stderr: -497> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d58b30) adding auth protocol: cephx 2024-09-12T17:19:50.264 INFO:tasks.workunit.client.0.smithi016.stderr: -496> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d58b30) adding con mode: secure 2024-09-12T17:19:50.264 INFO:tasks.workunit.client.0.smithi016.stderr: -495> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d58b30) adding con mode: crc 2024-09-12T17:19:50.264 INFO:tasks.workunit.client.0.smithi016.stderr: -494> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d58b30) adding con mode: secure 2024-09-12T17:19:50.264 INFO:tasks.workunit.client.0.smithi016.stderr: -493> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d58b30) adding con mode: crc 2024-09-12T17:19:50.264 INFO:tasks.workunit.client.0.smithi016.stderr: -492> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d58b30) adding con mode: secure 2024-09-12T17:19:50.264 INFO:tasks.workunit.client.0.smithi016.stderr: -491> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d58b30) adding con mode: crc 2024-09-12T17:19:50.264 INFO:tasks.workunit.client.0.smithi016.stderr: -490> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d58b30) adding con mode: crc 2024-09-12T17:19:50.264 INFO:tasks.workunit.client.0.smithi016.stderr: -489> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d58b30) adding con mode: secure 2024-09-12T17:19:50.264 INFO:tasks.workunit.client.0.smithi016.stderr: -488> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d58b30) adding con mode: crc 2024-09-12T17:19:50.264 INFO:tasks.workunit.client.0.smithi016.stderr: -487> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d58b30) adding con mode: secure 2024-09-12T17:19:50.265 INFO:tasks.workunit.client.0.smithi016.stderr: -486> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d58b30) adding con mode: crc 2024-09-12T17:19:50.265 INFO:tasks.workunit.client.0.smithi016.stderr: -485> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d58b30) adding con mode: secure 2024-09-12T17:19:50.265 INFO:tasks.workunit.client.0.smithi016.stderr: -484> 2024-09-12T17:19:49.910+0000 7f0224c859c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:50.265 INFO:tasks.workunit.client.0.smithi016.stderr: -483> 2024-09-12T17:19:49.910+0000 7f0224c859c0 1 librados: starting msgr at 2024-09-12T17:19:50.265 INFO:tasks.workunit.client.0.smithi016.stderr: -482> 2024-09-12T17:19:49.910+0000 7f0224c859c0 1 librados: starting objecter 2024-09-12T17:19:50.265 INFO:tasks.workunit.client.0.smithi016.stderr: -481> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 asok(0x555fa2b492b0) register_command objecter_requests hook 0x555fa2d5a870 2024-09-12T17:19:50.265 INFO:tasks.workunit.client.0.smithi016.stderr: -480> 2024-09-12T17:19:49.910+0000 7f0224c859c0 1 librados: setting wanted keys 2024-09-12T17:19:50.265 INFO:tasks.workunit.client.0.smithi016.stderr: -479> 2024-09-12T17:19:49.910+0000 7f0224c859c0 1 librados: calling monclient init 2024-09-12T17:19:50.265 INFO:tasks.workunit.client.0.smithi016.stderr: -478> 2024-09-12T17:19:49.910+0000 7f0224c859c0 10 monclient: init 2024-09-12T17:19:50.265 INFO:tasks.workunit.client.0.smithi016.stderr: -477> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d52c30) adding auth protocol: cephx 2024-09-12T17:19:50.265 INFO:tasks.workunit.client.0.smithi016.stderr: -476> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d52c30) adding auth protocol: cephx 2024-09-12T17:19:50.265 INFO:tasks.workunit.client.0.smithi016.stderr: -475> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d52c30) adding auth protocol: cephx 2024-09-12T17:19:50.266 INFO:tasks.workunit.client.0.smithi016.stderr: -474> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d52c30) adding con mode: secure 2024-09-12T17:19:50.266 INFO:tasks.workunit.client.0.smithi016.stderr: -473> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d52c30) adding con mode: crc 2024-09-12T17:19:50.266 INFO:tasks.workunit.client.0.smithi016.stderr: -472> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d52c30) adding con mode: secure 2024-09-12T17:19:50.266 INFO:tasks.workunit.client.0.smithi016.stderr: -471> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d52c30) adding con mode: crc 2024-09-12T17:19:50.266 INFO:tasks.workunit.client.0.smithi016.stderr: -470> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d52c30) adding con mode: secure 2024-09-12T17:19:50.266 INFO:tasks.workunit.client.0.smithi016.stderr: -469> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d52c30) adding con mode: crc 2024-09-12T17:19:50.266 INFO:tasks.workunit.client.0.smithi016.stderr: -468> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d52c30) adding con mode: crc 2024-09-12T17:19:50.266 INFO:tasks.workunit.client.0.smithi016.stderr: -467> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d52c30) adding con mode: secure 2024-09-12T17:19:50.266 INFO:tasks.workunit.client.0.smithi016.stderr: -466> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d52c30) adding con mode: crc 2024-09-12T17:19:50.266 INFO:tasks.workunit.client.0.smithi016.stderr: -465> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d52c30) adding con mode: secure 2024-09-12T17:19:50.266 INFO:tasks.workunit.client.0.smithi016.stderr: -464> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d52c30) adding con mode: crc 2024-09-12T17:19:50.267 INFO:tasks.workunit.client.0.smithi016.stderr: -463> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d52c30) adding con mode: secure 2024-09-12T17:19:50.267 INFO:tasks.workunit.client.0.smithi016.stderr: -462> 2024-09-12T17:19:49.914+0000 7f0224c859c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:50.267 INFO:tasks.workunit.client.0.smithi016.stderr: -461> 2024-09-12T17:19:49.914+0000 7f0224c859c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:50.267 INFO:tasks.workunit.client.0.smithi016.stderr: -460> 2024-09-12T17:19:49.914+0000 7f0224c859c0 5 asok(0x555fa2b492b0) register_command rotate-key hook 0x555fa2d52d78 2024-09-12T17:19:50.267 INFO:tasks.workunit.client.0.smithi016.stderr: -459> 2024-09-12T17:19:49.914+0000 7f0224c859c0 10 monclient: _reopen_session rank -1 2024-09-12T17:19:50.267 INFO:tasks.workunit.client.0.smithi016.stderr: -458> 2024-09-12T17:19:49.914+0000 7f0224c859c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:19:50.267 INFO:tasks.workunit.client.0.smithi016.stderr: -457> 2024-09-12T17:19:49.914+0000 7f0224c859c0 10 monclient(hunting): picked mon.noname-a con 0x555fa2c02990 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:19:50.267 INFO:tasks.workunit.client.0.smithi016.stderr: -456> 2024-09-12T17:19:49.914+0000 7f0224c859c0 10 monclient(hunting): picked mon.noname-b con 0x555fa2c9b490 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:19:50.267 INFO:tasks.workunit.client.0.smithi016.stderr: -455> 2024-09-12T17:19:49.914+0000 7f0224c859c0 10 monclient(hunting): picked mon.noname-c con 0x555fa2d59a00 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:19:50.267 INFO:tasks.workunit.client.0.smithi016.stderr: -454> 2024-09-12T17:19:49.914+0000 7f0224c859c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:50.267 INFO:tasks.workunit.client.0.smithi016.stderr: -453> 2024-09-12T17:19:49.914+0000 7f0224c859c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:50.268 INFO:tasks.workunit.client.0.smithi016.stderr: -452> 2024-09-12T17:19:49.914+0000 7f0224c859c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:50.268 INFO:tasks.workunit.client.0.smithi016.stderr: -451> 2024-09-12T17:19:49.914+0000 7f0224c859c0 10 monclient(hunting): _renew_subs 2024-09-12T17:19:50.268 INFO:tasks.workunit.client.0.smithi016.stderr: -450> 2024-09-12T17:19:49.914+0000 7f0224c859c0 10 monclient(hunting): authenticate will time out at 2307.888378s 2024-09-12T17:19:50.268 INFO:tasks.workunit.client.0.smithi016.stderr: -449> 2024-09-12T17:19:49.914+0000 7f022278b640 10 monclient(hunting): get_auth_request con 0x555fa2c02990 auth_method 0 2024-09-12T17:19:50.268 INFO:tasks.workunit.client.0.smithi016.stderr: -448> 2024-09-12T17:19:49.914+0000 7f022278b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:19:50.268 INFO:tasks.workunit.client.0.smithi016.stderr: -447> 2024-09-12T17:19:49.914+0000 7f022278b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:19:50.268 INFO:tasks.workunit.client.0.smithi016.stderr: -446> 2024-09-12T17:19:49.914+0000 7f022278b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:19:50.268 INFO:tasks.workunit.client.0.smithi016.stderr: -445> 2024-09-12T17:19:49.914+0000 7f0222f8c640 10 monclient(hunting): get_auth_request con 0x555fa2d59a00 auth_method 0 2024-09-12T17:19:50.268 INFO:tasks.workunit.client.0.smithi016.stderr: -444> 2024-09-12T17:19:49.914+0000 7f0222f8c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:19:50.268 INFO:tasks.workunit.client.0.smithi016.stderr: -443> 2024-09-12T17:19:49.914+0000 7f0222f8c640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:19:50.268 INFO:tasks.workunit.client.0.smithi016.stderr: -442> 2024-09-12T17:19:49.914+0000 7f0222f8c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:19:50.268 INFO:tasks.workunit.client.0.smithi016.stderr: -441> 2024-09-12T17:19:49.914+0000 7f0222f8c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:19:50.269 INFO:tasks.workunit.client.0.smithi016.stderr: -440> 2024-09-12T17:19:49.914+0000 7f0222f8c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:19:50.269 INFO:tasks.workunit.client.0.smithi016.stderr: -439> 2024-09-12T17:19:49.914+0000 7f0222f8c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:19:50.269 INFO:tasks.workunit.client.0.smithi016.stderr: -438> 2024-09-12T17:19:49.914+0000 7f022278b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:19:50.269 INFO:tasks.workunit.client.0.smithi016.stderr: -437> 2024-09-12T17:19:49.914+0000 7f022278b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:19:50.269 INFO:tasks.workunit.client.0.smithi016.stderr: -436> 2024-09-12T17:19:49.914+0000 7f022278b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:19:50.269 INFO:tasks.workunit.client.0.smithi016.stderr: -435> 2024-09-12T17:19:49.914+0000 7f0222f8c640 10 monclient(hunting): handle_auth_done global_id 6944 payload 824 2024-09-12T17:19:50.269 INFO:tasks.workunit.client.0.smithi016.stderr: -434> 2024-09-12T17:19:49.914+0000 7f0222f8c640 10 monclient: _finish_hunting 0 2024-09-12T17:19:50.269 INFO:tasks.workunit.client.0.smithi016.stderr: -433> 2024-09-12T17:19:49.914+0000 7f0222f8c640 1 monclient: found mon.noname-c 2024-09-12T17:19:50.269 INFO:tasks.workunit.client.0.smithi016.stderr: -432> 2024-09-12T17:19:49.914+0000 7f0222f8c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:19:50.269 INFO:tasks.workunit.client.0.smithi016.stderr: -431> 2024-09-12T17:19:49.914+0000 7f010ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:19:50.269 INFO:tasks.workunit.client.0.smithi016.stderr: -430> 2024-09-12T17:19:49.914+0000 7f010ee05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:19:50.269 INFO:tasks.workunit.client.0.smithi016.stderr: -429> 2024-09-12T17:19:49.914+0000 7f010ee05640 10 monclient: dump: 2024-09-12T17:19:50.270 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:19:50.270 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:19:50.270 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:50.270 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:50.270 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:19:50.270 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:50.270 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:19:50.270 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:19:50.271 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:19:50.271 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:50.271 INFO:tasks.workunit.client.0.smithi016.stderr: -428> 2024-09-12T17:19:49.914+0000 7f010ee05640 10 monclient: _finish_auth 0 2024-09-12T17:19:50.271 INFO:tasks.workunit.client.0.smithi016.stderr: -427> 2024-09-12T17:19:49.914+0000 7f010ee05640 10 monclient: _check_auth_tickets 2024-09-12T17:19:50.271 INFO:tasks.workunit.client.0.smithi016.stderr: -426> 2024-09-12T17:19:49.914+0000 7f0224c859c0 5 monclient: authenticate success, global_id 6944 2024-09-12T17:19:50.272 INFO:tasks.workunit.client.0.smithi016.stderr: -425> 2024-09-12T17:19:49.914+0000 7f0224c859c0 10 monclient: _renew_subs 2024-09-12T17:19:50.272 INFO:tasks.workunit.client.0.smithi016.stderr: -424> 2024-09-12T17:19:49.914+0000 7f0224c859c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:19:50.272 INFO:tasks.workunit.client.0.smithi016.stderr: -423> 2024-09-12T17:19:49.914+0000 7f010ee05640 10 monclient: handle_config config(0 keys) 2024-09-12T17:19:50.272 INFO:tasks.workunit.client.0.smithi016.stderr: -422> 2024-09-12T17:19:49.914+0000 7f010ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:19:50.272 INFO:tasks.workunit.client.0.smithi016.stderr: -421> 2024-09-12T17:19:49.914+0000 7f010ee05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:19:50.272 INFO:tasks.workunit.client.0.smithi016.stderr: -420> 2024-09-12T17:19:49.914+0000 7f010ee05640 10 monclient: dump: 2024-09-12T17:19:50.272 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:19:50.272 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:19:50.272 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:50.272 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:50.272 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:19:50.273 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:50.273 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:19:50.273 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:19:50.273 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:19:50.273 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:50.273 INFO:tasks.workunit.client.0.smithi016.stderr: -419> 2024-09-12T17:19:49.914+0000 7f0110608640 4 set_mon_vals no callback set 2024-09-12T17:19:50.273 INFO:tasks.workunit.client.0.smithi016.stderr: -418> 2024-09-12T17:19:49.914+0000 7f0224c859c0 10 monclient: _renew_subs 2024-09-12T17:19:50.273 INFO:tasks.workunit.client.0.smithi016.stderr: -417> 2024-09-12T17:19:49.914+0000 7f0224c859c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:19:50.273 INFO:tasks.workunit.client.0.smithi016.stderr: -416> 2024-09-12T17:19:49.914+0000 7f0224c859c0 1 librados: init done 2024-09-12T17:19:50.273 INFO:tasks.workunit.client.0.smithi016.stderr: -415> 2024-09-12T17:19:49.914+0000 7f010ee05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:19:50.273 INFO:tasks.workunit.client.0.smithi016.stderr: -414> 2024-09-12T17:19:49.914+0000 7f010ee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:19:50.273 INFO:tasks.workunit.client.0.smithi016.stderr: -413> 2024-09-12T17:19:49.914+0000 7f010ee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:19:50.274 INFO:tasks.workunit.client.0.smithi016.stderr: -412> 2024-09-12T17:19:49.914+0000 7f022278b640 10 monclient: get_auth_request con 0x7f0108070ae0 auth_method 0 2024-09-12T17:19:50.274 INFO:tasks.workunit.client.0.smithi016.stderr: -411> 2024-09-12T17:19:49.914+0000 7f0221f8a640 10 monclient: get_auth_request con 0x555fa2d7a960 auth_method 0 2024-09-12T17:19:50.274 INFO:tasks.workunit.client.0.smithi016.stderr: -410> 2024-09-12T17:19:49.918+0000 7f022278b640 10 monclient: get_auth_request con 0x555fa2d9d8e0 auth_method 0 2024-09-12T17:19:50.274 INFO:tasks.workunit.client.0.smithi016.stderr: -409> 2024-09-12T17:19:49.918+0000 7f0221f8a640 10 monclient: get_auth_request con 0x555fa2da1d50 auth_method 0 2024-09-12T17:19:50.274 INFO:tasks.workunit.client.0.smithi016.stderr: -408> 2024-09-12T17:19:49.922+0000 7f0222f8c640 10 monclient: get_auth_request con 0x555fa2da11d0 auth_method 0 2024-09-12T17:19:50.274 INFO:tasks.workunit.client.0.smithi016.stderr: -407> 2024-09-12T17:19:49.922+0000 7f0224c859c0 10 monclient: build_initial_monmap 2024-09-12T17:19:50.274 INFO:tasks.workunit.client.0.smithi016.stderr: -406> 2024-09-12T17:19:49.922+0000 7f0224c859c0 1 build_initial for_mkfs: 0 2024-09-12T17:19:50.274 INFO:tasks.workunit.client.0.smithi016.stderr: -405> 2024-09-12T17:19:49.922+0000 7f0224c859c0 10 monclient: monmap: 2024-09-12T17:19:50.274 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:19:50.274 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:19:50.274 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:19:50.274 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:19:50.275 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:19:50.275 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:50.275 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:19:50.275 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:19:50.275 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:19:50.275 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:50.275 INFO:tasks.workunit.client.0.smithi016.stderr: -404> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da9f50) adding auth protocol: cephx 2024-09-12T17:19:50.275 INFO:tasks.workunit.client.0.smithi016.stderr: -403> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da9f50) adding auth protocol: cephx 2024-09-12T17:19:50.275 INFO:tasks.workunit.client.0.smithi016.stderr: -402> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da9f50) adding auth protocol: cephx 2024-09-12T17:19:50.275 INFO:tasks.workunit.client.0.smithi016.stderr: -401> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da9f50) adding con mode: secure 2024-09-12T17:19:50.275 INFO:tasks.workunit.client.0.smithi016.stderr: -400> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da9f50) adding con mode: crc 2024-09-12T17:19:50.276 INFO:tasks.workunit.client.0.smithi016.stderr: -399> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da9f50) adding con mode: secure 2024-09-12T17:19:50.276 INFO:tasks.workunit.client.0.smithi016.stderr: -398> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da9f50) adding con mode: crc 2024-09-12T17:19:50.276 INFO:tasks.workunit.client.0.smithi016.stderr: -397> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da9f50) adding con mode: secure 2024-09-12T17:19:50.276 INFO:tasks.workunit.client.0.smithi016.stderr: -396> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da9f50) adding con mode: crc 2024-09-12T17:19:50.276 INFO:tasks.workunit.client.0.smithi016.stderr: -395> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da9f50) adding con mode: crc 2024-09-12T17:19:50.276 INFO:tasks.workunit.client.0.smithi016.stderr: -394> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da9f50) adding con mode: secure 2024-09-12T17:19:50.276 INFO:tasks.workunit.client.0.smithi016.stderr: -393> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da9f50) adding con mode: crc 2024-09-12T17:19:50.276 INFO:tasks.workunit.client.0.smithi016.stderr: -392> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da9f50) adding con mode: secure 2024-09-12T17:19:50.276 INFO:tasks.workunit.client.0.smithi016.stderr: -391> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da9f50) adding con mode: crc 2024-09-12T17:19:50.276 INFO:tasks.workunit.client.0.smithi016.stderr: -390> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da9f50) adding con mode: secure 2024-09-12T17:19:50.276 INFO:tasks.workunit.client.0.smithi016.stderr: -389> 2024-09-12T17:19:49.922+0000 7f0224c859c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:50.277 INFO:tasks.workunit.client.0.smithi016.stderr: -388> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 asok(0x555fa2b492b0) register_command objecter_requests cmddesc objecter_requests hook 0x555fa2dad8d0 EEXIST 2024-09-12T17:19:50.277 INFO:tasks.workunit.client.0.smithi016.stderr: -387> 2024-09-12T17:19:49.922+0000 7f0224c859c0 10 monclient: init 2024-09-12T17:19:50.277 INFO:tasks.workunit.client.0.smithi016.stderr: -386> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da8df8) adding auth protocol: cephx 2024-09-12T17:19:50.277 INFO:tasks.workunit.client.0.smithi016.stderr: -385> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da8df8) adding auth protocol: cephx 2024-09-12T17:19:50.277 INFO:tasks.workunit.client.0.smithi016.stderr: -384> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da8df8) adding auth protocol: cephx 2024-09-12T17:19:50.277 INFO:tasks.workunit.client.0.smithi016.stderr: -383> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da8df8) adding con mode: secure 2024-09-12T17:19:50.277 INFO:tasks.workunit.client.0.smithi016.stderr: -382> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da8df8) adding con mode: crc 2024-09-12T17:19:50.277 INFO:tasks.workunit.client.0.smithi016.stderr: -381> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da8df8) adding con mode: secure 2024-09-12T17:19:50.277 INFO:tasks.workunit.client.0.smithi016.stderr: -380> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da8df8) adding con mode: crc 2024-09-12T17:19:50.277 INFO:tasks.workunit.client.0.smithi016.stderr: -379> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da8df8) adding con mode: secure 2024-09-12T17:19:50.277 INFO:tasks.workunit.client.0.smithi016.stderr: -378> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da8df8) adding con mode: crc 2024-09-12T17:19:50.278 INFO:tasks.workunit.client.0.smithi016.stderr: -377> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da8df8) adding con mode: crc 2024-09-12T17:19:50.278 INFO:tasks.workunit.client.0.smithi016.stderr: -376> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da8df8) adding con mode: secure 2024-09-12T17:19:50.278 INFO:tasks.workunit.client.0.smithi016.stderr: -375> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da8df8) adding con mode: crc 2024-09-12T17:19:50.278 INFO:tasks.workunit.client.0.smithi016.stderr: -374> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da8df8) adding con mode: secure 2024-09-12T17:19:50.278 INFO:tasks.workunit.client.0.smithi016.stderr: -373> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da8df8) adding con mode: crc 2024-09-12T17:19:50.278 INFO:tasks.workunit.client.0.smithi016.stderr: -372> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da8df8) adding con mode: secure 2024-09-12T17:19:50.278 INFO:tasks.workunit.client.0.smithi016.stderr: -371> 2024-09-12T17:19:49.922+0000 7f0224c859c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:50.278 INFO:tasks.workunit.client.0.smithi016.stderr: -370> 2024-09-12T17:19:49.922+0000 7f0224c859c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:50.278 INFO:tasks.workunit.client.0.smithi016.stderr: -369> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 asok(0x555fa2b492b0) register_command rotate-key cmddesc rotate-key hook 0x555fa2da8f40 EEXIST 2024-09-12T17:19:50.278 INFO:tasks.workunit.client.0.smithi016.stderr: -368> 2024-09-12T17:19:49.922+0000 7f0224c859c0 10 monclient: _reopen_session rank -1 2024-09-12T17:19:50.278 INFO:tasks.workunit.client.0.smithi016.stderr: -367> 2024-09-12T17:19:49.922+0000 7f0224c859c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:19:50.278 INFO:tasks.workunit.client.0.smithi016.stderr: -366> 2024-09-12T17:19:49.922+0000 7f0224c859c0 10 monclient(hunting): picked mon.noname-b con 0x555fa2dd1590 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:19:50.279 INFO:tasks.workunit.client.0.smithi016.stderr: -365> 2024-09-12T17:19:49.922+0000 7f0224c859c0 10 monclient(hunting): picked mon.noname-a con 0x555fa2dd3cb0 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:19:50.279 INFO:tasks.workunit.client.0.smithi016.stderr: -364> 2024-09-12T17:19:49.922+0000 7f0224c859c0 10 monclient(hunting): picked mon.noname-c con 0x555fa2de9710 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:19:50.279 INFO:tasks.workunit.client.0.smithi016.stderr: -363> 2024-09-12T17:19:49.922+0000 7f0224c859c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:50.279 INFO:tasks.workunit.client.0.smithi016.stderr: -362> 2024-09-12T17:19:49.922+0000 7f0224c859c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:50.279 INFO:tasks.workunit.client.0.smithi016.stderr: -361> 2024-09-12T17:19:49.922+0000 7f0224c859c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:50.279 INFO:tasks.workunit.client.0.smithi016.stderr: -360> 2024-09-12T17:19:49.922+0000 7f0224c859c0 10 monclient(hunting): _renew_subs 2024-09-12T17:19:50.279 INFO:tasks.workunit.client.0.smithi016.stderr: -359> 2024-09-12T17:19:49.922+0000 7f0224c859c0 10 monclient(hunting): authenticate will time out at 2307.899816s 2024-09-12T17:19:50.279 INFO:tasks.workunit.client.0.smithi016.stderr: -358> 2024-09-12T17:19:49.922+0000 7f0222f8c640 10 monclient(hunting): get_auth_request con 0x555fa2dd3cb0 auth_method 0 2024-09-12T17:19:50.279 INFO:tasks.workunit.client.0.smithi016.stderr: -357> 2024-09-12T17:19:49.922+0000 7f0222f8c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:19:50.279 INFO:tasks.workunit.client.0.smithi016.stderr: -356> 2024-09-12T17:19:49.922+0000 7f0222f8c640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:19:50.279 INFO:tasks.workunit.client.0.smithi016.stderr: -355> 2024-09-12T17:19:49.922+0000 7f0222f8c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:19:50.280 INFO:tasks.workunit.client.0.smithi016.stderr: -354> 2024-09-12T17:19:49.926+0000 7f022278b640 10 monclient(hunting): get_auth_request con 0x555fa2de9710 auth_method 0 2024-09-12T17:19:50.280 INFO:tasks.workunit.client.0.smithi016.stderr: -353> 2024-09-12T17:19:49.926+0000 7f022278b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:19:50.280 INFO:tasks.workunit.client.0.smithi016.stderr: -352> 2024-09-12T17:19:49.926+0000 7f022278b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:19:50.280 INFO:tasks.workunit.client.0.smithi016.stderr: -351> 2024-09-12T17:19:49.926+0000 7f022278b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:19:50.280 INFO:tasks.workunit.client.0.smithi016.stderr: -350> 2024-09-12T17:19:49.926+0000 7f0222f8c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:19:50.280 INFO:tasks.workunit.client.0.smithi016.stderr: -349> 2024-09-12T17:19:49.926+0000 7f0222f8c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:19:50.280 INFO:tasks.workunit.client.0.smithi016.stderr: -348> 2024-09-12T17:19:49.926+0000 7f0222f8c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:19:50.280 INFO:tasks.workunit.client.0.smithi016.stderr: -347> 2024-09-12T17:19:49.926+0000 7f022278b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:19:50.280 INFO:tasks.workunit.client.0.smithi016.stderr: -346> 2024-09-12T17:19:49.926+0000 7f022278b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:19:50.280 INFO:tasks.workunit.client.0.smithi016.stderr: -345> 2024-09-12T17:19:49.926+0000 7f022278b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:19:50.281 INFO:tasks.workunit.client.0.smithi016.stderr: -344> 2024-09-12T17:19:49.926+0000 7f0221f8a640 10 monclient(hunting): get_auth_request con 0x555fa2dd1590 auth_method 0 2024-09-12T17:19:50.281 INFO:tasks.workunit.client.0.smithi016.stderr: -343> 2024-09-12T17:19:49.926+0000 7f0221f8a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:19:50.281 INFO:tasks.workunit.client.0.smithi016.stderr: -342> 2024-09-12T17:19:49.926+0000 7f0221f8a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:19:50.281 INFO:tasks.workunit.client.0.smithi016.stderr: -341> 2024-09-12T17:19:49.926+0000 7f0221f8a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:19:50.281 INFO:tasks.workunit.client.0.smithi016.stderr: -340> 2024-09-12T17:19:49.926+0000 7f0222f8c640 10 monclient(hunting): handle_auth_done global_id 7275 payload 824 2024-09-12T17:19:50.281 INFO:tasks.workunit.client.0.smithi016.stderr: -339> 2024-09-12T17:19:49.926+0000 7f0222f8c640 10 monclient: _finish_hunting 0 2024-09-12T17:19:50.281 INFO:tasks.workunit.client.0.smithi016.stderr: -338> 2024-09-12T17:19:49.926+0000 7f0222f8c640 1 monclient: found mon.noname-a 2024-09-12T17:19:50.281 INFO:tasks.workunit.client.0.smithi016.stderr: -337> 2024-09-12T17:19:49.926+0000 7f0222f8c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:19:50.281 INFO:tasks.workunit.client.0.smithi016.stderr: -336> 2024-09-12T17:19:49.926+0000 7f0107fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:19:50.281 INFO:tasks.workunit.client.0.smithi016.stderr: -335> 2024-09-12T17:19:49.926+0000 7f0107fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:19:50.281 INFO:tasks.workunit.client.0.smithi016.stderr: -334> 2024-09-12T17:19:49.926+0000 7f0107fff640 10 monclient: dump: 2024-09-12T17:19:50.281 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:19:50.282 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:19:50.282 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:50.282 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:50.282 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:19:50.282 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:50.282 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:19:50.282 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:19:50.282 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:19:50.282 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:50.282 INFO:tasks.workunit.client.0.smithi016.stderr: -333> 2024-09-12T17:19:49.926+0000 7f0107fff640 10 monclient: _finish_auth 0 2024-09-12T17:19:50.282 INFO:tasks.workunit.client.0.smithi016.stderr: -332> 2024-09-12T17:19:49.926+0000 7f0107fff640 10 monclient: _check_auth_tickets 2024-09-12T17:19:50.283 INFO:tasks.workunit.client.0.smithi016.stderr: -331> 2024-09-12T17:19:49.926+0000 7f0107fff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:19:50.283 INFO:tasks.workunit.client.0.smithi016.stderr: -330> 2024-09-12T17:19:49.926+0000 7f0107fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:19:50.283 INFO:tasks.workunit.client.0.smithi016.stderr: -329> 2024-09-12T17:19:49.926+0000 7f0107fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:19:50.283 INFO:tasks.workunit.client.0.smithi016.stderr: -328> 2024-09-12T17:19:49.926+0000 7f0107fff640 10 monclient: dump: 2024-09-12T17:19:50.283 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:19:50.283 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:19:50.283 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:50.283 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:50.283 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:19:50.283 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:50.283 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:19:50.284 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:19:50.284 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:19:50.284 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:50.284 INFO:tasks.workunit.client.0.smithi016.stderr: -327> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 monclient: authenticate success, global_id 7275 2024-09-12T17:19:50.284 INFO:tasks.workunit.client.0.smithi016.stderr: -326> 2024-09-12T17:19:49.926+0000 7f022378d640 4 set_mon_vals no callback set 2024-09-12T17:19:50.284 INFO:tasks.workunit.client.0.smithi016.stderr: -325> 2024-09-12T17:19:49.926+0000 7f0224c859c0 10 monclient: _renew_subs 2024-09-12T17:19:50.284 INFO:tasks.workunit.client.0.smithi016.stderr: -324> 2024-09-12T17:19:49.926+0000 7f0224c859c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:19:50.284 INFO:tasks.workunit.client.0.smithi016.stderr: -323> 2024-09-12T17:19:49.926+0000 7f0224c859c0 10 monclient: _renew_subs 2024-09-12T17:19:50.284 INFO:tasks.workunit.client.0.smithi016.stderr: -322> 2024-09-12T17:19:49.926+0000 7f0224c859c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:19:50.284 INFO:tasks.workunit.client.0.smithi016.stderr: -321> 2024-09-12T17:19:49.926+0000 7f0107fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:19:50.284 INFO:tasks.workunit.client.0.smithi016.stderr: -320> 2024-09-12T17:19:49.926+0000 7f0107fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:19:50.285 INFO:tasks.workunit.client.0.smithi016.stderr: -319> 2024-09-12T17:19:49.926+0000 7f0107fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:19:50.285 INFO:tasks.workunit.client.0.smithi016.stderr: -318> 2024-09-12T17:19:49.926+0000 7f0224c859c0 10 monclient: get_monmap_and_config 2024-09-12T17:19:50.285 INFO:tasks.workunit.client.0.smithi016.stderr: -317> 2024-09-12T17:19:49.926+0000 7f0224c859c0 10 monclient: build_initial_monmap 2024-09-12T17:19:50.285 INFO:tasks.workunit.client.0.smithi016.stderr: -316> 2024-09-12T17:19:49.926+0000 7f0224c859c0 1 build_initial for_mkfs: 0 2024-09-12T17:19:50.285 INFO:tasks.workunit.client.0.smithi016.stderr: -315> 2024-09-12T17:19:49.926+0000 7f0224c859c0 10 monclient: monmap: 2024-09-12T17:19:50.285 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:19:50.285 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:19:50.285 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:19:50.285 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:19:50.285 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:19:50.285 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:50.286 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:19:50.286 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:19:50.286 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:19:50.286 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:50.286 INFO:tasks.workunit.client.0.smithi016.stderr: -314> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x555fa2df1370) adding auth protocol: cephx 2024-09-12T17:19:50.286 INFO:tasks.workunit.client.0.smithi016.stderr: -313> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x555fa2df1370) adding auth protocol: cephx 2024-09-12T17:19:50.286 INFO:tasks.workunit.client.0.smithi016.stderr: -312> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x555fa2df1370) adding auth protocol: cephx 2024-09-12T17:19:50.286 INFO:tasks.workunit.client.0.smithi016.stderr: -311> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x555fa2df1370) adding con mode: secure 2024-09-12T17:19:50.286 INFO:tasks.workunit.client.0.smithi016.stderr: -310> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x555fa2df1370) adding con mode: crc 2024-09-12T17:19:50.286 INFO:tasks.workunit.client.0.smithi016.stderr: -309> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x555fa2df1370) adding con mode: secure 2024-09-12T17:19:50.286 INFO:tasks.workunit.client.0.smithi016.stderr: -308> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x555fa2df1370) adding con mode: crc 2024-09-12T17:19:50.287 INFO:tasks.workunit.client.0.smithi016.stderr: -307> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x555fa2df1370) adding con mode: secure 2024-09-12T17:19:50.287 INFO:tasks.workunit.client.0.smithi016.stderr: -306> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x555fa2df1370) adding con mode: crc 2024-09-12T17:19:50.287 INFO:tasks.workunit.client.0.smithi016.stderr: -305> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x555fa2df1370) adding con mode: crc 2024-09-12T17:19:50.287 INFO:tasks.workunit.client.0.smithi016.stderr: -304> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x555fa2df1370) adding con mode: secure 2024-09-12T17:19:50.287 INFO:tasks.workunit.client.0.smithi016.stderr: -303> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x555fa2df1370) adding con mode: crc 2024-09-12T17:19:50.287 INFO:tasks.workunit.client.0.smithi016.stderr: -302> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x555fa2df1370) adding con mode: secure 2024-09-12T17:19:50.287 INFO:tasks.workunit.client.0.smithi016.stderr: -301> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x555fa2df1370) adding con mode: crc 2024-09-12T17:19:50.287 INFO:tasks.workunit.client.0.smithi016.stderr: -300> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x555fa2df1370) adding con mode: secure 2024-09-12T17:19:50.287 INFO:tasks.workunit.client.0.smithi016.stderr: -299> 2024-09-12T17:19:49.926+0000 7f0221f8a640 10 monclient: get_auth_request con 0x7f00fc0709f0 auth_method 0 2024-09-12T17:19:50.287 INFO:tasks.workunit.client.0.smithi016.stderr: -298> 2024-09-12T17:19:49.926+0000 7f0224c859c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:50.287 INFO:tasks.workunit.client.0.smithi016.stderr: -297> 2024-09-12T17:19:49.926+0000 7f0224c859c0 10 monclient: init 2024-09-12T17:19:50.287 INFO:tasks.workunit.client.0.smithi016.stderr: -296> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814700) adding auth protocol: cephx 2024-09-12T17:19:50.288 INFO:tasks.workunit.client.0.smithi016.stderr: -295> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814700) adding auth protocol: cephx 2024-09-12T17:19:50.288 INFO:tasks.workunit.client.0.smithi016.stderr: -294> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814700) adding auth protocol: cephx 2024-09-12T17:19:50.288 INFO:tasks.workunit.client.0.smithi016.stderr: -293> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814700) adding con mode: secure 2024-09-12T17:19:50.288 INFO:tasks.workunit.client.0.smithi016.stderr: -292> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814700) adding con mode: crc 2024-09-12T17:19:50.288 INFO:tasks.workunit.client.0.smithi016.stderr: -291> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814700) adding con mode: secure 2024-09-12T17:19:50.288 INFO:tasks.workunit.client.0.smithi016.stderr: -290> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814700) adding con mode: crc 2024-09-12T17:19:50.288 INFO:tasks.workunit.client.0.smithi016.stderr: -289> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814700) adding con mode: secure 2024-09-12T17:19:50.288 INFO:tasks.workunit.client.0.smithi016.stderr: -288> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814700) adding con mode: crc 2024-09-12T17:19:50.288 INFO:tasks.workunit.client.0.smithi016.stderr: -287> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814700) adding con mode: crc 2024-09-12T17:19:50.288 INFO:tasks.workunit.client.0.smithi016.stderr: -286> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814700) adding con mode: secure 2024-09-12T17:19:50.288 INFO:tasks.workunit.client.0.smithi016.stderr: -285> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814700) adding con mode: crc 2024-09-12T17:19:50.289 INFO:tasks.workunit.client.0.smithi016.stderr: -284> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814700) adding con mode: secure 2024-09-12T17:19:50.289 INFO:tasks.workunit.client.0.smithi016.stderr: -283> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814700) adding con mode: crc 2024-09-12T17:19:50.289 INFO:tasks.workunit.client.0.smithi016.stderr: -282> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814700) adding con mode: secure 2024-09-12T17:19:50.289 INFO:tasks.workunit.client.0.smithi016.stderr: -281> 2024-09-12T17:19:49.926+0000 7f0224c859c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:50.289 INFO:tasks.workunit.client.0.smithi016.stderr: -280> 2024-09-12T17:19:49.926+0000 7f0224c859c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:50.289 INFO:tasks.workunit.client.0.smithi016.stderr: -279> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 asok(0x555fa2b492b0) register_command rotate-key cmddesc rotate-key hook 0x7ffda9814848 EEXIST 2024-09-12T17:19:50.289 INFO:tasks.workunit.client.0.smithi016.stderr: -278> 2024-09-12T17:19:49.926+0000 7f0224c859c0 10 monclient: _reopen_session rank -1 2024-09-12T17:19:50.289 INFO:tasks.workunit.client.0.smithi016.stderr: -277> 2024-09-12T17:19:49.926+0000 7f0224c859c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:19:50.289 INFO:tasks.workunit.client.0.smithi016.stderr: -276> 2024-09-12T17:19:49.926+0000 7f0224c859c0 10 monclient(hunting): picked mon.noname-a con 0x555fa2e25850 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:19:50.289 INFO:tasks.workunit.client.0.smithi016.stderr: -275> 2024-09-12T17:19:49.926+0000 7f0224c859c0 10 monclient(hunting): picked mon.noname-c con 0x555fa2df6860 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:19:50.290 INFO:tasks.workunit.client.0.smithi016.stderr: -274> 2024-09-12T17:19:49.926+0000 7f0224c859c0 10 monclient(hunting): picked mon.noname-b con 0x555fa2e20cb0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:19:50.290 INFO:tasks.workunit.client.0.smithi016.stderr: -273> 2024-09-12T17:19:49.926+0000 7f0224c859c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:50.290 INFO:tasks.workunit.client.0.smithi016.stderr: -272> 2024-09-12T17:19:49.926+0000 7f0224c859c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:50.290 INFO:tasks.workunit.client.0.smithi016.stderr: -271> 2024-09-12T17:19:49.926+0000 7f0224c859c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:50.290 INFO:tasks.workunit.client.0.smithi016.stderr: -270> 2024-09-12T17:19:49.926+0000 7f0224c859c0 10 monclient(hunting): _renew_subs 2024-09-12T17:19:50.290 INFO:tasks.workunit.client.0.smithi016.stderr: -269> 2024-09-12T17:19:49.926+0000 7f0224c859c0 10 monclient(hunting): authenticate will time out at 2307.903966s 2024-09-12T17:19:50.290 INFO:tasks.workunit.client.0.smithi016.stderr: -268> 2024-09-12T17:19:49.930+0000 7f0222f8c640 10 monclient(hunting): get_auth_request con 0x555fa2df6860 auth_method 0 2024-09-12T17:19:50.290 INFO:tasks.workunit.client.0.smithi016.stderr: -267> 2024-09-12T17:19:49.930+0000 7f0222f8c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:19:50.290 INFO:tasks.workunit.client.0.smithi016.stderr: -266> 2024-09-12T17:19:49.930+0000 7f0222f8c640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:19:50.290 INFO:tasks.workunit.client.0.smithi016.stderr: -265> 2024-09-12T17:19:49.930+0000 7f0222f8c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:19:50.290 INFO:tasks.workunit.client.0.smithi016.stderr: -264> 2024-09-12T17:19:49.930+0000 7f0221f8a640 10 monclient(hunting): get_auth_request con 0x555fa2e25850 auth_method 0 2024-09-12T17:19:50.290 INFO:tasks.workunit.client.0.smithi016.stderr: -263> 2024-09-12T17:19:49.930+0000 7f0221f8a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:19:50.291 INFO:tasks.workunit.client.0.smithi016.stderr: -262> 2024-09-12T17:19:49.930+0000 7f0221f8a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:19:50.291 INFO:tasks.workunit.client.0.smithi016.stderr: -261> 2024-09-12T17:19:49.930+0000 7f0221f8a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:19:50.291 INFO:tasks.workunit.client.0.smithi016.stderr: -260> 2024-09-12T17:19:49.930+0000 7f0222f8c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:19:50.291 INFO:tasks.workunit.client.0.smithi016.stderr: -259> 2024-09-12T17:19:49.930+0000 7f0222f8c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:19:50.291 INFO:tasks.workunit.client.0.smithi016.stderr: -258> 2024-09-12T17:19:49.930+0000 7f0222f8c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:19:50.291 INFO:tasks.workunit.client.0.smithi016.stderr: -257> 2024-09-12T17:19:49.930+0000 7f0221f8a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:19:50.291 INFO:tasks.workunit.client.0.smithi016.stderr: -256> 2024-09-12T17:19:49.930+0000 7f0221f8a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:19:50.291 INFO:tasks.workunit.client.0.smithi016.stderr: -255> 2024-09-12T17:19:49.930+0000 7f0221f8a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:19:50.291 INFO:tasks.workunit.client.0.smithi016.stderr: -254> 2024-09-12T17:19:49.930+0000 7f0222f8c640 10 monclient(hunting): handle_auth_done global_id 6950 payload 274 2024-09-12T17:19:50.291 INFO:tasks.workunit.client.0.smithi016.stderr: -253> 2024-09-12T17:19:49.930+0000 7f0222f8c640 10 monclient: _finish_hunting 0 2024-09-12T17:19:50.291 INFO:tasks.workunit.client.0.smithi016.stderr: -252> 2024-09-12T17:19:49.930+0000 7f0222f8c640 1 monclient: found mon.noname-c 2024-09-12T17:19:50.291 INFO:tasks.workunit.client.0.smithi016.stderr: -251> 2024-09-12T17:19:49.930+0000 7f0222f8c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:19:50.292 INFO:tasks.workunit.client.0.smithi016.stderr: -250> 2024-09-12T17:19:49.930+0000 7f0105ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:19:50.292 INFO:tasks.workunit.client.0.smithi016.stderr: -249> 2024-09-12T17:19:49.930+0000 7f0105ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:19:50.292 INFO:tasks.workunit.client.0.smithi016.stderr: -248> 2024-09-12T17:19:49.930+0000 7f0105ffb640 10 monclient: dump: 2024-09-12T17:19:50.292 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:19:50.292 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:19:50.292 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:50.292 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:50.292 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:19:50.292 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:50.292 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:19:50.292 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:19:50.293 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:19:50.293 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:50.293 INFO:tasks.workunit.client.0.smithi016.stderr: -247> 2024-09-12T17:19:49.930+0000 7f0105ffb640 10 monclient: _finish_auth 0 2024-09-12T17:19:50.293 INFO:tasks.workunit.client.0.smithi016.stderr: -246> 2024-09-12T17:19:49.930+0000 7f0105ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:19:50.293 INFO:tasks.workunit.client.0.smithi016.stderr: -245> 2024-09-12T17:19:49.930+0000 7f0105ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:19:50.293 INFO:tasks.workunit.client.0.smithi016.stderr: -244> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 monclient: authenticate success, global_id 6950 2024-09-12T17:19:50.293 INFO:tasks.workunit.client.0.smithi016.stderr: -243> 2024-09-12T17:19:49.930+0000 7f0224c859c0 10 monclient: get_monmap_and_config success 2024-09-12T17:19:50.293 INFO:tasks.workunit.client.0.smithi016.stderr: -242> 2024-09-12T17:19:49.930+0000 7f0224c859c0 4 set_mon_vals no callback set 2024-09-12T17:19:50.293 INFO:tasks.workunit.client.0.smithi016.stderr: -241> 2024-09-12T17:19:49.930+0000 7f0105ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:19:50.293 INFO:tasks.workunit.client.0.smithi016.stderr: -240> 2024-09-12T17:19:49.930+0000 7f0105ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:19:50.293 INFO:tasks.workunit.client.0.smithi016.stderr: -239> 2024-09-12T17:19:49.930+0000 7f0105ffb640 10 monclient: dump: 2024-09-12T17:19:50.293 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:19:50.294 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:19:50.294 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:50.294 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:50.294 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:19:50.294 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:50.294 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:19:50.294 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:19:50.294 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:19:50.294 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:50.294 INFO:tasks.workunit.client.0.smithi016.stderr: -238> 2024-09-12T17:19:49.930+0000 7f0224c859c0 10 monclient: shutdown 2024-09-12T17:19:50.294 INFO:tasks.workunit.client.0.smithi016.stderr: -237> 2024-09-12T17:19:49.930+0000 7f0224c859c0 10 monclient: build_initial_monmap 2024-09-12T17:19:50.294 INFO:tasks.workunit.client.0.smithi016.stderr: -236> 2024-09-12T17:19:49.930+0000 7f0224c859c0 1 build_initial for_mkfs: 0 2024-09-12T17:19:50.295 INFO:tasks.workunit.client.0.smithi016.stderr: -235> 2024-09-12T17:19:49.930+0000 7f0224c859c0 10 monclient: monmap: 2024-09-12T17:19:50.295 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:19:50.295 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:19:50.295 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:19:50.295 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:19:50.295 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:19:50.295 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:50.295 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:19:50.295 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:19:50.295 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:19:50.295 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:50.295 INFO:tasks.workunit.client.0.smithi016.stderr: -234> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2e17a50) adding auth protocol: cephx 2024-09-12T17:19:50.296 INFO:tasks.workunit.client.0.smithi016.stderr: -233> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2e17a50) adding auth protocol: cephx 2024-09-12T17:19:50.296 INFO:tasks.workunit.client.0.smithi016.stderr: -232> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2e17a50) adding auth protocol: cephx 2024-09-12T17:19:50.296 INFO:tasks.workunit.client.0.smithi016.stderr: -231> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2e17a50) adding con mode: secure 2024-09-12T17:19:50.296 INFO:tasks.workunit.client.0.smithi016.stderr: -230> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2e17a50) adding con mode: crc 2024-09-12T17:19:50.296 INFO:tasks.workunit.client.0.smithi016.stderr: -229> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2e17a50) adding con mode: secure 2024-09-12T17:19:50.296 INFO:tasks.workunit.client.0.smithi016.stderr: -228> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2e17a50) adding con mode: crc 2024-09-12T17:19:50.296 INFO:tasks.workunit.client.0.smithi016.stderr: -227> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2e17a50) adding con mode: secure 2024-09-12T17:19:50.296 INFO:tasks.workunit.client.0.smithi016.stderr: -226> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2e17a50) adding con mode: crc 2024-09-12T17:19:50.296 INFO:tasks.workunit.client.0.smithi016.stderr: -225> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2e17a50) adding con mode: crc 2024-09-12T17:19:50.296 INFO:tasks.workunit.client.0.smithi016.stderr: -224> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2e17a50) adding con mode: secure 2024-09-12T17:19:50.296 INFO:tasks.workunit.client.0.smithi016.stderr: -223> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2e17a50) adding con mode: crc 2024-09-12T17:19:50.296 INFO:tasks.workunit.client.0.smithi016.stderr: -222> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2e17a50) adding con mode: secure 2024-09-12T17:19:50.297 INFO:tasks.workunit.client.0.smithi016.stderr: -221> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2e17a50) adding con mode: crc 2024-09-12T17:19:50.297 INFO:tasks.workunit.client.0.smithi016.stderr: -220> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2e17a50) adding con mode: secure 2024-09-12T17:19:50.297 INFO:tasks.workunit.client.0.smithi016.stderr: -219> 2024-09-12T17:19:49.930+0000 7f0224c859c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:50.297 INFO:tasks.workunit.client.0.smithi016.stderr: -218> 2024-09-12T17:19:49.930+0000 7f0224c859c0 1 librados: starting msgr at 2024-09-12T17:19:50.297 INFO:tasks.workunit.client.0.smithi016.stderr: -217> 2024-09-12T17:19:49.930+0000 7f0224c859c0 1 librados: starting objecter 2024-09-12T17:19:50.297 INFO:tasks.workunit.client.0.smithi016.stderr: -216> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 asok(0x555fa2b492b0) register_command objecter_requests cmddesc objecter_requests hook 0x555fa2df5560 EEXIST 2024-09-12T17:19:50.297 INFO:tasks.workunit.client.0.smithi016.stderr: -215> 2024-09-12T17:19:49.930+0000 7f0224c859c0 1 librados: setting wanted keys 2024-09-12T17:19:50.297 INFO:tasks.workunit.client.0.smithi016.stderr: -214> 2024-09-12T17:19:49.930+0000 7f0224c859c0 1 librados: calling monclient init 2024-09-12T17:19:50.298 INFO:tasks.workunit.client.0.smithi016.stderr: -213> 2024-09-12T17:19:49.930+0000 7f0224c859c0 10 monclient: init 2024-09-12T17:19:50.298 INFO:tasks.workunit.client.0.smithi016.stderr: -212> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2dcf9d0) adding auth protocol: cephx 2024-09-12T17:19:50.298 INFO:tasks.workunit.client.0.smithi016.stderr: -211> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2dcf9d0) adding auth protocol: cephx 2024-09-12T17:19:50.298 INFO:tasks.workunit.client.0.smithi016.stderr: -210> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2dcf9d0) adding auth protocol: cephx 2024-09-12T17:19:50.298 INFO:tasks.workunit.client.0.smithi016.stderr: -209> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2dcf9d0) adding con mode: secure 2024-09-12T17:19:50.298 INFO:tasks.workunit.client.0.smithi016.stderr: -208> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2dcf9d0) adding con mode: crc 2024-09-12T17:19:50.298 INFO:tasks.workunit.client.0.smithi016.stderr: -207> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2dcf9d0) adding con mode: secure 2024-09-12T17:19:50.298 INFO:tasks.workunit.client.0.smithi016.stderr: -206> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2dcf9d0) adding con mode: crc 2024-09-12T17:19:50.298 INFO:tasks.workunit.client.0.smithi016.stderr: -205> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2dcf9d0) adding con mode: secure 2024-09-12T17:19:50.298 INFO:tasks.workunit.client.0.smithi016.stderr: -204> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2dcf9d0) adding con mode: crc 2024-09-12T17:19:50.298 INFO:tasks.workunit.client.0.smithi016.stderr: -203> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2dcf9d0) adding con mode: crc 2024-09-12T17:19:50.299 INFO:tasks.workunit.client.0.smithi016.stderr: -202> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2dcf9d0) adding con mode: secure 2024-09-12T17:19:50.299 INFO:tasks.workunit.client.0.smithi016.stderr: -201> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2dcf9d0) adding con mode: crc 2024-09-12T17:19:50.299 INFO:tasks.workunit.client.0.smithi016.stderr: -200> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2dcf9d0) adding con mode: secure 2024-09-12T17:19:50.299 INFO:tasks.workunit.client.0.smithi016.stderr: -199> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2dcf9d0) adding con mode: crc 2024-09-12T17:19:50.299 INFO:tasks.workunit.client.0.smithi016.stderr: -198> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2dcf9d0) adding con mode: secure 2024-09-12T17:19:50.299 INFO:tasks.workunit.client.0.smithi016.stderr: -197> 2024-09-12T17:19:49.930+0000 7f0224c859c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:50.299 INFO:tasks.workunit.client.0.smithi016.stderr: -196> 2024-09-12T17:19:49.930+0000 7f0224c859c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:50.299 INFO:tasks.workunit.client.0.smithi016.stderr: -195> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 asok(0x555fa2b492b0) register_command rotate-key cmddesc rotate-key hook 0x555fa2dcfb18 EEXIST 2024-09-12T17:19:50.299 INFO:tasks.workunit.client.0.smithi016.stderr: -194> 2024-09-12T17:19:49.930+0000 7f0224c859c0 10 monclient: _reopen_session rank -1 2024-09-12T17:19:50.299 INFO:tasks.workunit.client.0.smithi016.stderr: -193> 2024-09-12T17:19:49.930+0000 7f0224c859c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:19:50.299 INFO:tasks.workunit.client.0.smithi016.stderr: -192> 2024-09-12T17:19:49.930+0000 7f0224c859c0 10 monclient(hunting): picked mon.noname-c con 0x555fa2df6860 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:19:50.299 INFO:tasks.workunit.client.0.smithi016.stderr: -191> 2024-09-12T17:19:49.930+0000 7f0224c859c0 10 monclient(hunting): picked mon.noname-b con 0x555fa2e20cb0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:19:50.300 INFO:tasks.workunit.client.0.smithi016.stderr: -190> 2024-09-12T17:19:49.930+0000 7f0224c859c0 10 monclient(hunting): picked mon.noname-a con 0x555fa2e25850 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:19:50.300 INFO:tasks.workunit.client.0.smithi016.stderr: -189> 2024-09-12T17:19:49.930+0000 7f0224c859c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:50.300 INFO:tasks.workunit.client.0.smithi016.stderr: -188> 2024-09-12T17:19:49.930+0000 7f0224c859c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:50.300 INFO:tasks.workunit.client.0.smithi016.stderr: -187> 2024-09-12T17:19:49.930+0000 7f0224c859c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:50.300 INFO:tasks.workunit.client.0.smithi016.stderr: -186> 2024-09-12T17:19:49.930+0000 7f0224c859c0 10 monclient(hunting): _renew_subs 2024-09-12T17:19:50.300 INFO:tasks.workunit.client.0.smithi016.stderr: -185> 2024-09-12T17:19:49.930+0000 7f0224c859c0 10 monclient(hunting): authenticate will time out at 2307.906558s 2024-09-12T17:19:50.300 INFO:tasks.workunit.client.0.smithi016.stderr: -184> 2024-09-12T17:19:49.930+0000 7f022278b640 10 monclient(hunting): get_auth_request con 0x555fa2e25850 auth_method 0 2024-09-12T17:19:50.300 INFO:tasks.workunit.client.0.smithi016.stderr: -183> 2024-09-12T17:19:49.930+0000 7f022278b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:19:50.300 INFO:tasks.workunit.client.0.smithi016.stderr: -182> 2024-09-12T17:19:49.930+0000 7f022278b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:19:50.300 INFO:tasks.workunit.client.0.smithi016.stderr: -181> 2024-09-12T17:19:49.930+0000 7f022278b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:19:50.301 INFO:tasks.workunit.client.0.smithi016.stderr: -180> 2024-09-12T17:19:49.930+0000 7f0221f8a640 10 monclient(hunting): get_auth_request con 0x555fa2df6860 auth_method 0 2024-09-12T17:19:50.301 INFO:tasks.workunit.client.0.smithi016.stderr: -179> 2024-09-12T17:19:49.930+0000 7f0221f8a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:19:50.301 INFO:tasks.workunit.client.0.smithi016.stderr: -178> 2024-09-12T17:19:49.930+0000 7f0221f8a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:19:50.301 INFO:tasks.workunit.client.0.smithi016.stderr: -177> 2024-09-12T17:19:49.930+0000 7f0221f8a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:19:50.301 INFO:tasks.workunit.client.0.smithi016.stderr: -176> 2024-09-12T17:19:49.930+0000 7f022278b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:19:50.301 INFO:tasks.workunit.client.0.smithi016.stderr: -175> 2024-09-12T17:19:49.930+0000 7f022278b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:19:50.301 INFO:tasks.workunit.client.0.smithi016.stderr: -174> 2024-09-12T17:19:49.930+0000 7f022278b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:19:50.301 INFO:tasks.workunit.client.0.smithi016.stderr: -173> 2024-09-12T17:19:49.930+0000 7f0221f8a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:19:50.301 INFO:tasks.workunit.client.0.smithi016.stderr: -172> 2024-09-12T17:19:49.930+0000 7f0221f8a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:19:50.301 INFO:tasks.workunit.client.0.smithi016.stderr: -171> 2024-09-12T17:19:49.930+0000 7f0221f8a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:19:50.301 INFO:tasks.workunit.client.0.smithi016.stderr: -170> 2024-09-12T17:19:49.930+0000 7f0222f8c640 10 monclient(hunting): get_auth_request con 0x555fa2e20cb0 auth_method 0 2024-09-12T17:19:50.302 INFO:tasks.workunit.client.0.smithi016.stderr: -169> 2024-09-12T17:19:49.930+0000 7f0222f8c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:19:50.302 INFO:tasks.workunit.client.0.smithi016.stderr: -168> 2024-09-12T17:19:49.930+0000 7f0222f8c640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:19:50.302 INFO:tasks.workunit.client.0.smithi016.stderr: -167> 2024-09-12T17:19:49.930+0000 7f0222f8c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:19:50.302 INFO:tasks.workunit.client.0.smithi016.stderr: -166> 2024-09-12T17:19:49.930+0000 7f022278b640 10 monclient(hunting): handle_auth_done global_id 7281 payload 824 2024-09-12T17:19:50.302 INFO:tasks.workunit.client.0.smithi016.stderr: -165> 2024-09-12T17:19:49.930+0000 7f022278b640 10 monclient: _finish_hunting 0 2024-09-12T17:19:50.302 INFO:tasks.workunit.client.0.smithi016.stderr: -164> 2024-09-12T17:19:49.930+0000 7f022278b640 1 monclient: found mon.noname-a 2024-09-12T17:19:50.302 INFO:tasks.workunit.client.0.smithi016.stderr: -163> 2024-09-12T17:19:49.930+0000 7f022278b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:19:50.302 INFO:tasks.workunit.client.0.smithi016.stderr: -162> 2024-09-12T17:19:49.930+0000 7f00f3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:19:50.302 INFO:tasks.workunit.client.0.smithi016.stderr: -161> 2024-09-12T17:19:49.930+0000 7f00f3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:19:50.302 INFO:tasks.workunit.client.0.smithi016.stderr: -160> 2024-09-12T17:19:49.930+0000 7f00f3fff640 10 monclient: dump: 2024-09-12T17:19:50.302 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:19:50.303 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:19:50.303 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:50.303 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:50.303 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:19:50.303 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:50.303 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:19:50.303 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:19:50.303 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:19:50.303 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:50.303 INFO:tasks.workunit.client.0.smithi016.stderr: -159> 2024-09-12T17:19:49.930+0000 7f00f3fff640 10 monclient: _finish_auth 0 2024-09-12T17:19:50.303 INFO:tasks.workunit.client.0.smithi016.stderr: -158> 2024-09-12T17:19:49.930+0000 7f00f3fff640 10 monclient: _check_auth_tickets 2024-09-12T17:19:50.304 INFO:tasks.workunit.client.0.smithi016.stderr: -157> 2024-09-12T17:19:49.930+0000 7f00f3fff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:19:50.304 INFO:tasks.workunit.client.0.smithi016.stderr: -156> 2024-09-12T17:19:49.930+0000 7f00f3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:19:50.304 INFO:tasks.workunit.client.0.smithi016.stderr: -155> 2024-09-12T17:19:49.930+0000 7f00f3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:19:50.304 INFO:tasks.workunit.client.0.smithi016.stderr: -154> 2024-09-12T17:19:49.930+0000 7f00f3fff640 10 monclient: dump: 2024-09-12T17:19:50.304 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:19:50.304 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:19:50.304 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:50.304 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:50.304 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:19:50.304 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:50.305 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:19:50.305 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:19:50.305 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:19:50.305 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:50.305 INFO:tasks.workunit.client.0.smithi016.stderr: -153> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 monclient: authenticate success, global_id 7281 2024-09-12T17:19:50.305 INFO:tasks.workunit.client.0.smithi016.stderr: -152> 2024-09-12T17:19:49.930+0000 7f0224c859c0 10 monclient: _renew_subs 2024-09-12T17:19:50.305 INFO:tasks.workunit.client.0.smithi016.stderr: -151> 2024-09-12T17:19:49.930+0000 7f0105ffb640 4 set_mon_vals no callback set 2024-09-12T17:19:50.305 INFO:tasks.workunit.client.0.smithi016.stderr: -150> 2024-09-12T17:19:49.930+0000 7f0224c859c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:19:50.305 INFO:tasks.workunit.client.0.smithi016.stderr: -149> 2024-09-12T17:19:49.930+0000 7f0224c859c0 10 monclient: _renew_subs 2024-09-12T17:19:50.305 INFO:tasks.workunit.client.0.smithi016.stderr: -148> 2024-09-12T17:19:49.930+0000 7f0224c859c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:19:50.305 INFO:tasks.workunit.client.0.smithi016.stderr: -147> 2024-09-12T17:19:49.930+0000 7f0224c859c0 1 librados: init done 2024-09-12T17:19:50.306 INFO:tasks.workunit.client.0.smithi016.stderr: -146> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 asok(0x555fa2b492b0) register_command cr dump hook 0x555fa2e25ca8 2024-09-12T17:19:50.306 INFO:tasks.workunit.client.0.smithi016.stderr: -145> 2024-09-12T17:19:49.934+0000 7f0224c859c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.306 INFO:tasks.workunit.client.0.smithi016.stderr: -144> 2024-09-12T17:19:49.934+0000 7f00f3fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:19:50.306 INFO:tasks.workunit.client.0.smithi016.stderr: -143> 2024-09-12T17:19:49.934+0000 7f00f3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:19:50.306 INFO:tasks.workunit.client.0.smithi016.stderr: -142> 2024-09-12T17:19:49.934+0000 7f00f3fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:19:50.306 INFO:tasks.workunit.client.0.smithi016.stderr: -141> 2024-09-12T17:19:49.934+0000 7f0221f8a640 10 monclient: get_auth_request con 0x7f00ec070b10 auth_method 0 2024-09-12T17:19:50.306 INFO:tasks.workunit.client.0.smithi016.stderr: -140> 2024-09-12T17:19:49.934+0000 7f0222f8c640 10 monclient: get_auth_request con 0x555fa2e3f350 auth_method 0 2024-09-12T17:19:50.306 INFO:tasks.workunit.client.0.smithi016.stderr: -139> 2024-09-12T17:19:49.934+0000 7f0224c859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:50.306 INFO:tasks.workunit.client.0.smithi016.stderr: -138> 2024-09-12T17:19:49.934+0000 7f0224c859c0 20 realm 2024-09-12T17:19:50.306 INFO:tasks.workunit.client.0.smithi016.stderr: -137> 2024-09-12T17:19:49.934+0000 7f0224c859c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.306 INFO:tasks.workunit.client.0.smithi016.stderr: -136> 2024-09-12T17:19:49.934+0000 7f0224c859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:50.307 INFO:tasks.workunit.client.0.smithi016.stderr: -135> 2024-09-12T17:19:49.934+0000 7f0224c859c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:19:50.307 INFO:tasks.workunit.client.0.smithi016.stderr: -134> 2024-09-12T17:19:49.934+0000 7f0224c859c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.307 INFO:tasks.workunit.client.0.smithi016.stderr: -133> 2024-09-12T17:19:49.934+0000 7f0224c859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:50.307 INFO:tasks.workunit.client.0.smithi016.stderr: -132> 2024-09-12T17:19:49.934+0000 7f0224c859c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.307 INFO:tasks.workunit.client.0.smithi016.stderr: -131> 2024-09-12T17:19:49.934+0000 7f0221f8a640 10 monclient: get_auth_request con 0x555fa2e43540 auth_method 0 2024-09-12T17:19:50.307 INFO:tasks.workunit.client.0.smithi016.stderr: -130> 2024-09-12T17:19:49.938+0000 7f0224c859c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:50.307 INFO:tasks.workunit.client.0.smithi016.stderr: -129> 2024-09-12T17:19:49.938+0000 7f0224c859c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.307 INFO:tasks.workunit.client.0.smithi016.stderr: -128> 2024-09-12T17:19:49.938+0000 7f0222f8c640 10 monclient: get_auth_request con 0x555fa2e46da0 auth_method 0 2024-09-12T17:19:50.307 INFO:tasks.workunit.client.0.smithi016.stderr: -127> 2024-09-12T17:19:49.938+0000 7f0224c859c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:19:50.307 INFO:tasks.workunit.client.0.smithi016.stderr: -126> 2024-09-12T17:19:49.938+0000 7f0224c859c0 20 searching for the correct realm 2024-09-12T17:19:50.307 INFO:tasks.workunit.client.0.smithi016.stderr: -125> 2024-09-12T17:19:49.938+0000 7f022278b640 10 monclient: get_auth_request con 0x555fa2e4bae0 auth_method 0 2024-09-12T17:19:50.307 INFO:tasks.workunit.client.0.smithi016.stderr: -124> 2024-09-12T17:19:49.942+0000 7f0221f8a640 10 monclient: get_auth_request con 0x7f0214041060 auth_method 0 2024-09-12T17:19:50.308 INFO:tasks.workunit.client.0.smithi016.stderr: -123> 2024-09-12T17:19:49.942+0000 7f0222f8c640 10 monclient: get_auth_request con 0x7f02180c7040 auth_method 0 2024-09-12T17:19:50.308 INFO:tasks.workunit.client.0.smithi016.stderr: -122> 2024-09-12T17:19:49.942+0000 7f0222f8c640 0 -- 172.21.15.16:0/560809507 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f02180c7040 msgr2=0x7f02180b79c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:19:50.308 INFO:tasks.workunit.client.0.smithi016.stderr: -121> 2024-09-12T17:19:49.942+0000 7f00f3fff640 1 client.7281.objecter ms_handle_reset 0x7f02180c7040 session 0x7f02180a6070 osd.2 2024-09-12T17:19:50.308 INFO:tasks.workunit.client.0.smithi016.stderr: -120> 2024-09-12T17:19:49.942+0000 7f00f3fff640 10 monclient: _renew_subs 2024-09-12T17:19:50.308 INFO:tasks.workunit.client.0.smithi016.stderr: -119> 2024-09-12T17:19:49.942+0000 7f00f3fff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:19:50.308 INFO:tasks.workunit.client.0.smithi016.stderr: -118> 2024-09-12T17:19:49.942+0000 7f0222f8c640 10 monclient: get_auth_request con 0x7f00ec080930 auth_method 0 2024-09-12T17:19:50.308 INFO:tasks.workunit.client.0.smithi016.stderr: -117> 2024-09-12T17:19:49.946+0000 7f022278b640 10 monclient: get_auth_request con 0x7f021c094040 auth_method 0 2024-09-12T17:19:50.308 INFO:tasks.workunit.client.0.smithi016.stderr: -116> 2024-09-12T17:19:49.950+0000 7f0221f8a640 10 monclient: get_auth_request con 0x7f021c09ab90 auth_method 0 2024-09-12T17:19:50.308 INFO:tasks.workunit.client.0.smithi016.stderr: -115> 2024-09-12T17:19:49.950+0000 7f0221f8a640 0 -- 172.21.15.16:0/560809507 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f021c09ab90 msgr2=0x7f021c090330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:19:50.308 INFO:tasks.workunit.client.0.smithi016.stderr: -114> 2024-09-12T17:19:50.154+0000 7f0221f8a640 10 monclient: get_auth_request con 0x7f021c09ab90 auth_method 0 2024-09-12T17:19:50.308 INFO:tasks.workunit.client.0.smithi016.stderr: -113> 2024-09-12T17:19:50.166+0000 7f0224c859c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:19:50.309 INFO:tasks.workunit.client.0.smithi016.stderr: -112> 2024-09-12T17:19:50.166+0000 7f0224c859c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:19:50.309 INFO:tasks.workunit.client.0.smithi016.stderr: -111> 2024-09-12T17:19:50.166+0000 7f0224c859c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:19:50.309 INFO:tasks.workunit.client.0.smithi016.stderr: -110> 2024-09-12T17:19:50.166+0000 7f0224c859c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:19:50.309 INFO:tasks.workunit.client.0.smithi016.stderr: -109> 2024-09-12T17:19:50.166+0000 7f0224c859c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:19:50.309 INFO:tasks.workunit.client.0.smithi016.stderr: -108> 2024-09-12T17:19:50.166+0000 7f0224c859c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:19:50.309 INFO:tasks.workunit.client.0.smithi016.stderr: -107> 2024-09-12T17:19:50.166+0000 7f0224c859c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.309 INFO:tasks.workunit.client.0.smithi016.stderr: -106> 2024-09-12T17:19:50.166+0000 7f0224c859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:50.309 INFO:tasks.workunit.client.0.smithi016.stderr: -105> 2024-09-12T17:19:50.166+0000 7f0224c859c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.309 INFO:tasks.workunit.client.0.smithi016.stderr: -104> 2024-09-12T17:19:50.166+0000 7f0224c859c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:50.309 INFO:tasks.workunit.client.0.smithi016.stderr: -103> 2024-09-12T17:19:50.166+0000 7f0224c859c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.309 INFO:tasks.workunit.client.0.smithi016.stderr: -102> 2024-09-12T17:19:50.170+0000 7f0224c859c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:19:50.309 INFO:tasks.workunit.client.0.smithi016.stderr: -101> 2024-09-12T17:19:50.170+0000 7f0224c859c0 20 zone default found 2024-09-12T17:19:50.310 INFO:tasks.workunit.client.0.smithi016.stderr: -100> 2024-09-12T17:19:50.170+0000 7f0224c859c0 4 Realm: () 2024-09-12T17:19:50.310 INFO:tasks.workunit.client.0.smithi016.stderr: -99> 2024-09-12T17:19:50.170+0000 7f0224c859c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:19:50.310 INFO:tasks.workunit.client.0.smithi016.stderr: -98> 2024-09-12T17:19:50.170+0000 7f0224c859c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:19:50.310 INFO:tasks.workunit.client.0.smithi016.stderr: -97> 2024-09-12T17:19:50.170+0000 7f0224c859c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:19:50.310 INFO:tasks.workunit.client.0.smithi016.stderr: -96> 2024-09-12T17:19:50.170+0000 7f0224c859c0 20 zonegroup default 2024-09-12T17:19:50.310 INFO:tasks.workunit.client.0.smithi016.stderr: -95> 2024-09-12T17:19:50.170+0000 7f0224c859c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.310 INFO:tasks.workunit.client.0.smithi016.stderr: -94> 2024-09-12T17:19:50.170+0000 7f0224c859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:50.310 INFO:tasks.workunit.client.0.smithi016.stderr: -93> 2024-09-12T17:19:50.170+0000 7f0224c859c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.310 INFO:tasks.workunit.client.0.smithi016.stderr: -92> 2024-09-12T17:19:50.170+0000 7f0224c859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:50.310 INFO:tasks.workunit.client.0.smithi016.stderr: -91> 2024-09-12T17:19:50.170+0000 7f0224c859c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.310 INFO:tasks.workunit.client.0.smithi016.stderr: -90> 2024-09-12T17:19:50.170+0000 7f0224c859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:50.311 INFO:tasks.workunit.client.0.smithi016.stderr: -89> 2024-09-12T17:19:50.170+0000 7f0224c859c0 20 started sync module instance, tier type = 2024-09-12T17:19:50.311 INFO:tasks.workunit.client.0.smithi016.stderr: -88> 2024-09-12T17:19:50.170+0000 7f0224c859c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:19:50.311 INFO:tasks.workunit.client.0.smithi016.stderr: -87> 2024-09-12T17:19:50.194+0000 7f0224c859c0 20 add_watcher() i=0 2024-09-12T17:19:50.311 INFO:tasks.workunit.client.0.smithi016.stderr: -86> 2024-09-12T17:19:50.194+0000 7f0224c859c0 20 add_watcher() i=1 2024-09-12T17:19:50.311 INFO:tasks.workunit.client.0.smithi016.stderr: -85> 2024-09-12T17:19:50.194+0000 7f0224c859c0 20 add_watcher() i=2 2024-09-12T17:19:50.311 INFO:tasks.workunit.client.0.smithi016.stderr: -84> 2024-09-12T17:19:50.194+0000 7f0224c859c0 20 add_watcher() i=3 2024-09-12T17:19:50.311 INFO:tasks.workunit.client.0.smithi016.stderr: -83> 2024-09-12T17:19:50.194+0000 7f0224c859c0 20 add_watcher() i=4 2024-09-12T17:19:50.311 INFO:tasks.workunit.client.0.smithi016.stderr: -82> 2024-09-12T17:19:50.194+0000 7f0224c859c0 20 add_watcher() i=5 2024-09-12T17:19:50.311 INFO:tasks.workunit.client.0.smithi016.stderr: -81> 2024-09-12T17:19:50.194+0000 7f0224c859c0 20 add_watcher() i=6 2024-09-12T17:19:50.311 INFO:tasks.workunit.client.0.smithi016.stderr: -80> 2024-09-12T17:19:50.194+0000 7f0224c859c0 20 add_watcher() i=7 2024-09-12T17:19:50.311 INFO:tasks.workunit.client.0.smithi016.stderr: -79> 2024-09-12T17:19:50.194+0000 7f0224c859c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:19:50.311 INFO:tasks.workunit.client.0.smithi016.stderr: -78> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814bd0) adding auth protocol: cephx 2024-09-12T17:19:50.312 INFO:tasks.workunit.client.0.smithi016.stderr: -77> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814bd0) adding auth protocol: cephx 2024-09-12T17:19:50.312 INFO:tasks.workunit.client.0.smithi016.stderr: -76> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814bd0) adding auth protocol: cephx 2024-09-12T17:19:50.312 INFO:tasks.workunit.client.0.smithi016.stderr: -75> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814bd0) adding con mode: secure 2024-09-12T17:19:50.312 INFO:tasks.workunit.client.0.smithi016.stderr: -74> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814bd0) adding con mode: crc 2024-09-12T17:19:50.312 INFO:tasks.workunit.client.0.smithi016.stderr: -73> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814bd0) adding con mode: secure 2024-09-12T17:19:50.312 INFO:tasks.workunit.client.0.smithi016.stderr: -72> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814bd0) adding con mode: crc 2024-09-12T17:19:50.312 INFO:tasks.workunit.client.0.smithi016.stderr: -71> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814bd0) adding con mode: secure 2024-09-12T17:19:50.312 INFO:tasks.workunit.client.0.smithi016.stderr: -70> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814bd0) adding con mode: crc 2024-09-12T17:19:50.312 INFO:tasks.workunit.client.0.smithi016.stderr: -69> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814bd0) adding con mode: crc 2024-09-12T17:19:50.312 INFO:tasks.workunit.client.0.smithi016.stderr: -68> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814bd0) adding con mode: secure 2024-09-12T17:19:50.312 INFO:tasks.workunit.client.0.smithi016.stderr: -67> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814bd0) adding con mode: crc 2024-09-12T17:19:50.313 INFO:tasks.workunit.client.0.smithi016.stderr: -66> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814bd0) adding con mode: secure 2024-09-12T17:19:50.313 INFO:tasks.workunit.client.0.smithi016.stderr: -65> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814bd0) adding con mode: crc 2024-09-12T17:19:50.313 INFO:tasks.workunit.client.0.smithi016.stderr: -64> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814bd0) adding con mode: secure 2024-09-12T17:19:50.313 INFO:tasks.workunit.client.0.smithi016.stderr: -63> 2024-09-12T17:19:50.198+0000 7f00d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:50.313 INFO:tasks.workunit.client.0.smithi016.stderr: -62> 2024-09-12T17:19:50.198+0000 7f0224c859c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:50.313 INFO:tasks.workunit.client.0.smithi016.stderr: -61> 2024-09-12T17:19:50.198+0000 7f0224c859c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:19:50.313 INFO:tasks.workunit.client.0.smithi016.stderr: -60> 2024-09-12T17:19:50.198+0000 7f0224c859c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:19:50.313 INFO:tasks.workunit.client.0.smithi016.stderr: -59> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 asok(0x555fa2b492b0) register_command cache list hook 0x555fa2e16b50 2024-09-12T17:19:50.313 INFO:tasks.workunit.client.0.smithi016.stderr: -58> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 asok(0x555fa2b492b0) register_command cache inspect hook 0x555fa2e16b50 2024-09-12T17:19:50.313 INFO:tasks.workunit.client.0.smithi016.stderr: -57> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 asok(0x555fa2b492b0) register_command cache erase hook 0x555fa2e16b50 2024-09-12T17:19:50.313 INFO:tasks.workunit.client.0.smithi016.stderr: -56> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 asok(0x555fa2b492b0) register_command cache zap hook 0x555fa2e16b50 2024-09-12T17:19:50.313 INFO:tasks.workunit.client.0.smithi016.stderr: -55> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 note: GC not initialized 2024-09-12T17:19:50.314 INFO:tasks.workunit.client.0.smithi016.stderr: -54> 2024-09-12T17:19:50.198+0000 7f00537fe640 20 reqs_thread_entry: start 2024-09-12T17:19:50.314 INFO:tasks.workunit.client.0.smithi016.stderr: -53> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 asok(0x555fa2b492b0) register_command sync trace show hook 0x7f021c076070 2024-09-12T17:19:50.314 INFO:tasks.workunit.client.0.smithi016.stderr: -52> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 asok(0x555fa2b492b0) register_command sync trace history hook 0x7f021c076070 2024-09-12T17:19:50.314 INFO:tasks.workunit.client.0.smithi016.stderr: -51> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 asok(0x555fa2b492b0) register_command sync trace active hook 0x7f021c076070 2024-09-12T17:19:50.314 INFO:tasks.workunit.client.0.smithi016.stderr: -50> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 asok(0x555fa2b492b0) register_command sync trace active_short hook 0x7f021c076070 2024-09-12T17:19:50.314 INFO:tasks.workunit.client.0.smithi016.stderr: -49> 2024-09-12T17:19:50.198+0000 7f0224c859c0 20 init_complete bucket index max shards: 1 2024-09-12T17:19:50.314 INFO:tasks.workunit.client.0.smithi016.stderr: -48> 2024-09-12T17:19:50.198+0000 7f0224c859c0 20 Filter name: none 2024-09-12T17:19:50.314 INFO:tasks.workunit.client.0.smithi016.stderr: -47> 2024-09-12T17:19:50.198+0000 7f00517fa640 20 reqs_thread_entry: start 2024-09-12T17:19:50.314 INFO:tasks.workunit.client.0.smithi016.stderr: -46> 2024-09-12T17:19:50.198+0000 7f0224c859c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T17:19:50.314 INFO:tasks.workunit.client.0.smithi016.stderr: -45> 2024-09-12T17:19:50.198+0000 7f0224c859c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.314 INFO:tasks.workunit.client.0.smithi016.stderr: -44> 2024-09-12T17:19:50.202+0000 7f0224c859c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:19:50.314 INFO:tasks.workunit.client.0.smithi016.stderr: -43> 2024-09-12T17:19:50.202+0000 7f0224c859c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T17:19:50.315 INFO:tasks.workunit.client.0.smithi016.stderr: -42> 2024-09-12T17:19:50.202+0000 7f0224c859c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T17:19:50.315 INFO:tasks.workunit.client.0.smithi016.stderr: -41> 2024-09-12T17:19:50.202+0000 7f0224c859c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 : miss 2024-09-12T17:19:50.315 INFO:tasks.workunit.client.0.smithi016.stderr: -40> 2024-09-12T17:19:50.202+0000 7f0224c859c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.315 INFO:tasks.workunit.client.0.smithi016.stderr: -39> 2024-09-12T17:19:50.202+0000 7f0224c859c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:19:50.315 INFO:tasks.workunit.client.0.smithi016.stderr: -38> 2024-09-12T17:19:50.202+0000 7f0224c859c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 info.flags=0x17 2024-09-12T17:19:50.315 INFO:tasks.workunit.client.0.smithi016.stderr: -37> 2024-09-12T17:19:50.202+0000 7f0224c859c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 to cache LRU end 2024-09-12T17:19:50.315 INFO:tasks.workunit.client.0.smithi016.stderr: -36> 2024-09-12T17:19:50.202+0000 7f0224c859c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:19:50.315 INFO:tasks.workunit.client.0.smithi016.stderr: -35> 2024-09-12T17:19:50.202+0000 7f0224c859c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:50.315 INFO:tasks.workunit.client.0.smithi016.stderr: -34> 2024-09-12T17:19:50.202+0000 7f0224c859c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 2024-09-12T17:19:50.315 INFO:tasks.workunit.client.0.smithi016.stderr: -33> 2024-09-12T17:19:50.210+0000 7f0224c859c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 info.flags=0x17 2024-09-12T17:19:50.315 INFO:tasks.workunit.client.0.smithi016.stderr: -32> 2024-09-12T17:19:50.210+0000 7f0224c859c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 to cache LRU end 2024-09-12T17:19:50.316 INFO:tasks.workunit.client.0.smithi016.stderr: -31> 2024-09-12T17:19:50.210+0000 7f0224c859c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:50.316 INFO:tasks.workunit.client.0.smithi016.stderr: -30> 2024-09-12T17:19:50.210+0000 7f0224c859c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32, ofs0, ns] 2024-09-12T17:19:50.316 INFO:tasks.workunit.client.0.smithi016.stderr: -29> 2024-09-12T17:19:50.214+0000 7f0105ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431601 cookie 93869243185312 notifier 7281 bl.length()=931 2024-09-12T17:19:50.316 INFO:tasks.workunit.client.0.smithi016.stderr: -28> 2024-09-12T17:19:50.214+0000 7f0105ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 info.flags=0x17 2024-09-12T17:19:50.316 INFO:tasks.workunit.client.0.smithi016.stderr: -27> 2024-09-12T17:19:50.214+0000 7f0105ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 to cache LRU end 2024-09-12T17:19:50.316 INFO:tasks.workunit.client.0.smithi016.stderr: -26> 2024-09-12T17:19:50.214+0000 7f0105ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:50.316 INFO:tasks.workunit.client.0.smithi016.stderr: -25> 2024-09-12T17:19:50.214+0000 7f0224c859c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32]): orig_sources= new_sources= 2024-09-12T17:19:50.316 INFO:tasks.workunit.client.0.smithi016.stderr: -24> 2024-09-12T17:19:50.214+0000 7f0224c859c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32]): potential sources added=[] removed=[] 2024-09-12T17:19:50.316 INFO:tasks.workunit.client.0.smithi016.stderr: -23> 2024-09-12T17:19:50.214+0000 7f0224c859c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32]): orig_dests= new_dests= 2024-09-12T17:19:50.316 INFO:tasks.workunit.client.0.smithi016.stderr: -22> 2024-09-12T17:19:50.214+0000 7f0224c859c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32]): potential dests added=[] removed=[] 2024-09-12T17:19:50.316 INFO:tasks.workunit.client.0.smithi016.stderr: -21> 2024-09-12T17:19:50.218+0000 7f0224c859c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32.1.0 2024-09-12T17:19:50.316 INFO:tasks.workunit.client.0.smithi016.stderr: -20> 2024-09-12T17:19:50.218+0000 7f0224c859c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32.1.0 2024-09-12T17:19:50.317 INFO:tasks.workunit.client.0.smithi016.stderr: -19> 2024-09-12T17:19:50.218+0000 7f0224c859c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32.1.1 2024-09-12T17:19:50.317 INFO:tasks.workunit.client.0.smithi016.stderr: -18> 2024-09-12T17:19:50.218+0000 7f0224c859c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32.1.1 2024-09-12T17:19:50.317 INFO:tasks.workunit.client.0.smithi016.stderr: -17> 2024-09-12T17:19:50.218+0000 7f0224c859c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32.0 2024-09-12T17:19:50.317 INFO:tasks.workunit.client.0.smithi016.stderr: -16> 2024-09-12T17:19:50.226+0000 7f0224c859c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 : hit (requested=0x17, cached=0x17) 2024-09-12T17:19:50.317 INFO:tasks.workunit.client.0.smithi016.stderr: -15> 2024-09-12T17:19:50.226+0000 7f0224c859c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 2024-09-12T17:19:50.317 INFO:tasks.workunit.client.0.smithi016.stderr: -14> 2024-09-12T17:19:50.230+0000 7f0224c859c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 info.flags=0x17 2024-09-12T17:19:50.317 INFO:tasks.workunit.client.0.smithi016.stderr: -13> 2024-09-12T17:19:50.230+0000 7f0224c859c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 to cache LRU end 2024-09-12T17:19:50.317 INFO:tasks.workunit.client.0.smithi016.stderr: -12> 2024-09-12T17:19:50.230+0000 7f0224c859c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:50.317 INFO:tasks.workunit.client.0.smithi016.stderr: -11> 2024-09-12T17:19:50.230+0000 7f0224c859c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32, ofs0, ns] 2024-09-12T17:19:50.317 INFO:tasks.workunit.client.0.smithi016.stderr: -10> 2024-09-12T17:19:50.230+0000 7f0105ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431602 cookie 93869243185312 notifier 7281 bl.length()=931 2024-09-12T17:19:50.317 INFO:tasks.workunit.client.0.smithi016.stderr: -9> 2024-09-12T17:19:50.230+0000 7f0105ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 info.flags=0x17 2024-09-12T17:19:50.318 INFO:tasks.workunit.client.0.smithi016.stderr: -8> 2024-09-12T17:19:50.230+0000 7f0105ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 to cache LRU end 2024-09-12T17:19:50.318 INFO:tasks.workunit.client.0.smithi016.stderr: -7> 2024-09-12T17:19:50.230+0000 7f0105ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:50.318 INFO:tasks.workunit.client.0.smithi016.stderr: -6> 2024-09-12T17:19:50.230+0000 7f0224c859c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32]): orig_sources= new_sources= 2024-09-12T17:19:50.318 INFO:tasks.workunit.client.0.smithi016.stderr: -5> 2024-09-12T17:19:50.230+0000 7f0224c859c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32]): potential sources added=[] removed=[] 2024-09-12T17:19:50.318 INFO:tasks.workunit.client.0.smithi016.stderr: -4> 2024-09-12T17:19:50.230+0000 7f0224c859c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32]): orig_dests= new_dests= 2024-09-12T17:19:50.318 INFO:tasks.workunit.client.0.smithi016.stderr: -3> 2024-09-12T17:19:50.230+0000 7f0224c859c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32]): potential dests added=[] removed=[] 2024-09-12T17:19:50.318 INFO:tasks.workunit.client.0.smithi016.stderr: -2> 2024-09-12T17:19:50.234+0000 7f0224c859c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32.0 2024-09-12T17:19:50.318 INFO:tasks.workunit.client.0.smithi016.stderr: -1> 2024-09-12T17:19:50.238+0000 7f0224c859c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0224c859c0 time 2024-09-12T17:19:50.237297+0000 2024-09-12T17:19:50.318 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:19:50.318 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:50.318 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:19:50.319 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f022855f2eb] 2024-09-12T17:19:50.319 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f022855f49f] 2024-09-12T17:19:50.319 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555fa04c00c1] 2024-09-12T17:19:50.319 INFO:tasks.workunit.client.0.smithi016.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x555fa04d2467] 2024-09-12T17:19:50.319 INFO:tasks.workunit.client.0.smithi016.stderr: 5: main() 2024-09-12T17:19:50.319 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f02273c5d90] 2024-09-12T17:19:50.319 INFO:tasks.workunit.client.0.smithi016.stderr: 7: __libc_start_main() 2024-09-12T17:19:50.319 INFO:tasks.workunit.client.0.smithi016.stderr: 8: _start() 2024-09-12T17:19:50.319 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:50.319 INFO:tasks.workunit.client.0.smithi016.stderr: 0> 2024-09-12T17:19:50.242+0000 7f0224c859c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:19:50.319 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7f0224c859c0 thread_name:radosgw-admin 2024-09-12T17:19:50.320 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:50.320 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:19:50.320 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f02273de520] 2024-09-12T17:19:50.320 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:19:50.320 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:19:50.320 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:19:50.320 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f022855f345] 2024-09-12T17:19:50.320 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f022855f49f] 2024-09-12T17:19:50.320 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555fa04c00c1] 2024-09-12T17:19:50.320 INFO:tasks.workunit.client.0.smithi016.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x555fa04d2467] 2024-09-12T17:19:50.320 INFO:tasks.workunit.client.0.smithi016.stderr: 9: main() 2024-09-12T17:19:50.321 INFO:tasks.workunit.client.0.smithi016.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f02273c5d90] 2024-09-12T17:19:50.321 INFO:tasks.workunit.client.0.smithi016.stderr: 11: __libc_start_main() 2024-09-12T17:19:50.321 INFO:tasks.workunit.client.0.smithi016.stderr: 12: _start() 2024-09-12T17:19:50.321 INFO:tasks.workunit.client.0.smithi016.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:19:50.321 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:50.321 INFO:tasks.workunit.client.0.smithi016.stderr:--- logging levels --- 2024-09-12T17:19:50.321 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 none 2024-09-12T17:19:50.321 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 lockdep 2024-09-12T17:19:50.321 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 context 2024-09-12T17:19:50.321 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 crush 2024-09-12T17:19:50.321 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds 2024-09-12T17:19:50.321 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_balancer 2024-09-12T17:19:50.322 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_locker 2024-09-12T17:19:50.322 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log 2024-09-12T17:19:50.322 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log_expire 2024-09-12T17:19:50.322 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_migrator 2024-09-12T17:19:50.322 INFO:tasks.workunit.client.0.smithi016.stderr: 3/ 5 mds_quiesce 2024-09-12T17:19:50.322 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 buffer 2024-09-12T17:19:50.322 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 timer 2024-09-12T17:19:50.322 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 filer 2024-09-12T17:19:50.322 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 striper 2024-09-12T17:19:50.322 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 objecter 2024-09-12T17:19:50.322 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rados 2024-09-12T17:19:50.322 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd 2024-09-12T17:19:50.323 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_mirror 2024-09-12T17:19:50.323 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_replay 2024-09-12T17:19:50.323 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_pwl 2024-09-12T17:19:50.323 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 journaler 2024-09-12T17:19:50.323 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objectcacher 2024-09-12T17:19:50.323 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:19:50.323 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 client 2024-09-12T17:19:50.323 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 osd 2024-09-12T17:19:50.323 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 optracker 2024-09-12T17:19:50.323 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objclass 2024-09-12T17:19:50.323 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 filestore 2024-09-12T17:19:50.323 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 journal 2024-09-12T17:19:50.324 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 ms 2024-09-12T17:19:50.324 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mon 2024-09-12T17:19:50.324 INFO:tasks.workunit.client.0.smithi016.stderr: 0/10 monc 2024-09-12T17:19:50.324 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 paxos 2024-09-12T17:19:50.324 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 tp 2024-09-12T17:19:50.324 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 auth 2024-09-12T17:19:50.324 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 crypto 2024-09-12T17:19:50.324 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 finisher 2024-09-12T17:19:50.324 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 reserver 2024-09-12T17:19:50.324 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 heartbeatmap 2024-09-12T17:19:50.324 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 perfcounter 2024-09-12T17:19:50.324 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw 2024-09-12T17:19:50.325 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_sync 2024-09-12T17:19:50.325 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_datacache 2024-09-12T17:19:50.325 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_access 2024-09-12T17:19:50.325 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:19:50.325 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_flight 2024-09-12T17:19:50.325 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:19:50.325 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw_notification 2024-09-12T17:19:50.325 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 javaclient 2024-09-12T17:19:50.325 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 asok 2024-09-12T17:19:50.325 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 throttle 2024-09-12T17:19:50.325 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 refs 2024-09-12T17:19:50.325 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 compressor 2024-09-12T17:19:50.326 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluestore 2024-09-12T17:19:50.326 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluefs 2024-09-12T17:19:50.326 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 bdev 2024-09-12T17:19:50.326 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 kstore 2024-09-12T17:19:50.326 INFO:tasks.workunit.client.0.smithi016.stderr: 4/ 5 rocksdb 2024-09-12T17:19:50.326 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 fuse 2024-09-12T17:19:50.326 INFO:tasks.workunit.client.0.smithi016.stderr: 2/ 5 mgr 2024-09-12T17:19:50.326 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mgrc 2024-09-12T17:19:50.326 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 dpdk 2024-09-12T17:19:50.326 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 eventtrace 2024-09-12T17:19:50.326 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 prioritycache 2024-09-12T17:19:50.326 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 test 2024-09-12T17:19:50.327 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:19:50.327 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephsqlite 2024-09-12T17:19:50.327 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:19:50.327 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore 2024-09-12T17:19:50.327 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_onode 2024-09-12T17:19:50.327 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_odata 2024-09-12T17:19:50.327 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_omap 2024-09-12T17:19:50.327 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_tm 2024-09-12T17:19:50.327 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_t 2024-09-12T17:19:50.327 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:19:50.327 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_epm 2024-09-12T17:19:50.327 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_lba 2024-09-12T17:19:50.328 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:19:50.328 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cache 2024-09-12T17:19:50.328 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_journal 2024-09-12T17:19:50.328 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_device 2024-09-12T17:19:50.328 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_backref 2024-09-12T17:19:50.328 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 alienstore 2024-09-12T17:19:50.328 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mclock 2024-09-12T17:19:50.328 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cyanstore 2024-09-12T17:19:50.328 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 ceph_exporter 2024-09-12T17:19:50.328 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 memstore 2024-09-12T17:19:50.328 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 trace 2024-09-12T17:19:50.329 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 ceph_dedup 2024-09-12T17:19:50.329 INFO:tasks.workunit.client.0.smithi016.stderr: -2/-2 (syslog threshold) 2024-09-12T17:19:50.329 INFO:tasks.workunit.client.0.smithi016.stderr: 99/99 (stderr threshold) 2024-09-12T17:19:50.329 INFO:tasks.workunit.client.0.smithi016.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:19:50.329 INFO:tasks.workunit.client.0.smithi016.stderr: 7f00517fa640 / http_manager 2024-09-12T17:19:50.329 INFO:tasks.workunit.client.0.smithi016.stderr: 7f00537fe640 / http_manager 2024-09-12T17:19:50.329 INFO:tasks.workunit.client.0.smithi016.stderr: 7f00d8fe1640 / rgw_dt_lg_renew 2024-09-12T17:19:50.329 INFO:tasks.workunit.client.0.smithi016.stderr: 7f00f3fff640 / ms_dispatch 2024-09-12T17:19:50.329 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0105ffb640 / io_context_pool 2024-09-12T17:19:50.329 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0107fff640 / ms_dispatch 2024-09-12T17:19:50.329 INFO:tasks.workunit.client.0.smithi016.stderr: 7f010ee05640 / ms_dispatch 2024-09-12T17:19:50.329 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0110608640 / io_context_pool 2024-09-12T17:19:50.330 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0221f8a640 / msgr-worker-2 2024-09-12T17:19:50.330 INFO:tasks.workunit.client.0.smithi016.stderr: 7f022278b640 / msgr-worker-1 2024-09-12T17:19:50.330 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0222f8c640 / msgr-worker-0 2024-09-12T17:19:50.330 INFO:tasks.workunit.client.0.smithi016.stderr: 7f022378d640 / io_context_pool 2024-09-12T17:19:50.330 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0224c859c0 / radosgw-admin 2024-09-12T17:19:50.330 INFO:tasks.workunit.client.0.smithi016.stderr: max_recent 500 2024-09-12T17:19:50.330 INFO:tasks.workunit.client.0.smithi016.stderr: max_new 1000 2024-09-12T17:19:50.330 INFO:tasks.workunit.client.0.smithi016.stderr: log_file /var/log/ceph/ceph-client.admin.112068.log 2024-09-12T17:19:50.330 INFO:tasks.workunit.client.0.smithi016.stderr:--- end dump of recent events --- 2024-09-12T17:19:50.330 INFO:tasks.workunit.client.0.smithi016.stderr:--- begin dump of recent events --- 2024-09-12T17:19:50.330 INFO:tasks.workunit.client.0.smithi016.stderr: -499> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d58b30) adding auth protocol: cephx 2024-09-12T17:19:50.330 INFO:tasks.workunit.client.0.smithi016.stderr: -498> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d58b30) adding auth protocol: cephx 2024-09-12T17:19:50.331 INFO:tasks.workunit.client.0.smithi016.stderr: -497> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d58b30) adding auth protocol: cephx 2024-09-12T17:19:50.331 INFO:tasks.workunit.client.0.smithi016.stderr: -496> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d58b30) adding con mode: secure 2024-09-12T17:19:50.331 INFO:tasks.workunit.client.0.smithi016.stderr: -495> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d58b30) adding con mode: crc 2024-09-12T17:19:50.331 INFO:tasks.workunit.client.0.smithi016.stderr: -494> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d58b30) adding con mode: secure 2024-09-12T17:19:50.331 INFO:tasks.workunit.client.0.smithi016.stderr: -493> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d58b30) adding con mode: crc 2024-09-12T17:19:50.331 INFO:tasks.workunit.client.0.smithi016.stderr: -492> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d58b30) adding con mode: secure 2024-09-12T17:19:50.331 INFO:tasks.workunit.client.0.smithi016.stderr: -491> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d58b30) adding con mode: crc 2024-09-12T17:19:50.331 INFO:tasks.workunit.client.0.smithi016.stderr: -490> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d58b30) adding con mode: crc 2024-09-12T17:19:50.331 INFO:tasks.workunit.client.0.smithi016.stderr: -489> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d58b30) adding con mode: secure 2024-09-12T17:19:50.331 INFO:tasks.workunit.client.0.smithi016.stderr: -488> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d58b30) adding con mode: crc 2024-09-12T17:19:50.331 INFO:tasks.workunit.client.0.smithi016.stderr: -487> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d58b30) adding con mode: secure 2024-09-12T17:19:50.331 INFO:tasks.workunit.client.0.smithi016.stderr: -486> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d58b30) adding con mode: crc 2024-09-12T17:19:50.332 INFO:tasks.workunit.client.0.smithi016.stderr: -485> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d58b30) adding con mode: secure 2024-09-12T17:19:50.332 INFO:tasks.workunit.client.0.smithi016.stderr: -484> 2024-09-12T17:19:49.910+0000 7f0224c859c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:50.332 INFO:tasks.workunit.client.0.smithi016.stderr: -483> 2024-09-12T17:19:49.910+0000 7f0224c859c0 1 librados: starting msgr at 2024-09-12T17:19:50.332 INFO:tasks.workunit.client.0.smithi016.stderr: -482> 2024-09-12T17:19:49.910+0000 7f0224c859c0 1 librados: starting objecter 2024-09-12T17:19:50.332 INFO:tasks.workunit.client.0.smithi016.stderr: -481> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 asok(0x555fa2b492b0) register_command objecter_requests hook 0x555fa2d5a870 2024-09-12T17:19:50.332 INFO:tasks.workunit.client.0.smithi016.stderr: -480> 2024-09-12T17:19:49.910+0000 7f0224c859c0 1 librados: setting wanted keys 2024-09-12T17:19:50.332 INFO:tasks.workunit.client.0.smithi016.stderr: -479> 2024-09-12T17:19:49.910+0000 7f0224c859c0 1 librados: calling monclient init 2024-09-12T17:19:50.332 INFO:tasks.workunit.client.0.smithi016.stderr: -478> 2024-09-12T17:19:49.910+0000 7f0224c859c0 10 monclient: init 2024-09-12T17:19:50.332 INFO:tasks.workunit.client.0.smithi016.stderr: -477> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d52c30) adding auth protocol: cephx 2024-09-12T17:19:50.332 INFO:tasks.workunit.client.0.smithi016.stderr: -476> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d52c30) adding auth protocol: cephx 2024-09-12T17:19:50.332 INFO:tasks.workunit.client.0.smithi016.stderr: -475> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d52c30) adding auth protocol: cephx 2024-09-12T17:19:50.333 INFO:tasks.workunit.client.0.smithi016.stderr: -474> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d52c30) adding con mode: secure 2024-09-12T17:19:50.333 INFO:tasks.workunit.client.0.smithi016.stderr: -473> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d52c30) adding con mode: crc 2024-09-12T17:19:50.333 INFO:tasks.workunit.client.0.smithi016.stderr: -472> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d52c30) adding con mode: secure 2024-09-12T17:19:50.333 INFO:tasks.workunit.client.0.smithi016.stderr: -471> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d52c30) adding con mode: crc 2024-09-12T17:19:50.333 INFO:tasks.workunit.client.0.smithi016.stderr: -470> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d52c30) adding con mode: secure 2024-09-12T17:19:50.333 INFO:tasks.workunit.client.0.smithi016.stderr: -469> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d52c30) adding con mode: crc 2024-09-12T17:19:50.333 INFO:tasks.workunit.client.0.smithi016.stderr: -468> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d52c30) adding con mode: crc 2024-09-12T17:19:50.333 INFO:tasks.workunit.client.0.smithi016.stderr: -467> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d52c30) adding con mode: secure 2024-09-12T17:19:50.333 INFO:tasks.workunit.client.0.smithi016.stderr: -466> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d52c30) adding con mode: crc 2024-09-12T17:19:50.333 INFO:tasks.workunit.client.0.smithi016.stderr: -465> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d52c30) adding con mode: secure 2024-09-12T17:19:50.333 INFO:tasks.workunit.client.0.smithi016.stderr: -464> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d52c30) adding con mode: crc 2024-09-12T17:19:50.334 INFO:tasks.workunit.client.0.smithi016.stderr: -463> 2024-09-12T17:19:49.910+0000 7f0224c859c0 5 AuthRegistry(0x555fa2d52c30) adding con mode: secure 2024-09-12T17:19:50.334 INFO:tasks.workunit.client.0.smithi016.stderr: -462> 2024-09-12T17:19:49.914+0000 7f0224c859c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:50.334 INFO:tasks.workunit.client.0.smithi016.stderr: -461> 2024-09-12T17:19:49.914+0000 7f0224c859c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:50.334 INFO:tasks.workunit.client.0.smithi016.stderr: -460> 2024-09-12T17:19:49.914+0000 7f0224c859c0 5 asok(0x555fa2b492b0) register_command rotate-key hook 0x555fa2d52d78 2024-09-12T17:19:50.334 INFO:tasks.workunit.client.0.smithi016.stderr: -459> 2024-09-12T17:19:49.914+0000 7f0224c859c0 10 monclient: _reopen_session rank -1 2024-09-12T17:19:50.334 INFO:tasks.workunit.client.0.smithi016.stderr: -458> 2024-09-12T17:19:49.914+0000 7f0224c859c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:19:50.334 INFO:tasks.workunit.client.0.smithi016.stderr: -457> 2024-09-12T17:19:49.914+0000 7f0224c859c0 10 monclient(hunting): picked mon.noname-a con 0x555fa2c02990 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:19:50.334 INFO:tasks.workunit.client.0.smithi016.stderr: -456> 2024-09-12T17:19:49.914+0000 7f0224c859c0 10 monclient(hunting): picked mon.noname-b con 0x555fa2c9b490 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:19:50.334 INFO:tasks.workunit.client.0.smithi016.stderr: -455> 2024-09-12T17:19:49.914+0000 7f0224c859c0 10 monclient(hunting): picked mon.noname-c con 0x555fa2d59a00 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:19:50.334 INFO:tasks.workunit.client.0.smithi016.stderr: -454> 2024-09-12T17:19:49.914+0000 7f0224c859c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:50.334 INFO:tasks.workunit.client.0.smithi016.stderr: -453> 2024-09-12T17:19:49.914+0000 7f0224c859c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:50.334 INFO:tasks.workunit.client.0.smithi016.stderr: -452> 2024-09-12T17:19:49.914+0000 7f0224c859c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:50.335 INFO:tasks.workunit.client.0.smithi016.stderr: -451> 2024-09-12T17:19:49.914+0000 7f0224c859c0 10 monclient(hunting): _renew_subs 2024-09-12T17:19:50.335 INFO:tasks.workunit.client.0.smithi016.stderr: -450> 2024-09-12T17:19:49.914+0000 7f0224c859c0 10 monclient(hunting): authenticate will time out at 2307.888378s 2024-09-12T17:19:50.335 INFO:tasks.workunit.client.0.smithi016.stderr: -449> 2024-09-12T17:19:49.914+0000 7f022278b640 10 monclient(hunting): get_auth_request con 0x555fa2c02990 auth_method 0 2024-09-12T17:19:50.335 INFO:tasks.workunit.client.0.smithi016.stderr: -448> 2024-09-12T17:19:49.914+0000 7f022278b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:19:50.335 INFO:tasks.workunit.client.0.smithi016.stderr: -447> 2024-09-12T17:19:49.914+0000 7f022278b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:19:50.335 INFO:tasks.workunit.client.0.smithi016.stderr: -446> 2024-09-12T17:19:49.914+0000 7f022278b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:19:50.335 INFO:tasks.workunit.client.0.smithi016.stderr: -445> 2024-09-12T17:19:49.914+0000 7f0222f8c640 10 monclient(hunting): get_auth_request con 0x555fa2d59a00 auth_method 0 2024-09-12T17:19:50.335 INFO:tasks.workunit.client.0.smithi016.stderr: -444> 2024-09-12T17:19:49.914+0000 7f0222f8c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:19:50.335 INFO:tasks.workunit.client.0.smithi016.stderr: -443> 2024-09-12T17:19:49.914+0000 7f0222f8c640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:19:50.335 INFO:tasks.workunit.client.0.smithi016.stderr: -442> 2024-09-12T17:19:49.914+0000 7f0222f8c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:19:50.335 INFO:tasks.workunit.client.0.smithi016.stderr: -441> 2024-09-12T17:19:49.914+0000 7f0222f8c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:19:50.335 INFO:tasks.workunit.client.0.smithi016.stderr: -440> 2024-09-12T17:19:49.914+0000 7f0222f8c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:19:50.336 INFO:tasks.workunit.client.0.smithi016.stderr: -439> 2024-09-12T17:19:49.914+0000 7f0222f8c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:19:50.336 INFO:tasks.workunit.client.0.smithi016.stderr: -438> 2024-09-12T17:19:49.914+0000 7f022278b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:19:50.336 INFO:tasks.workunit.client.0.smithi016.stderr: -437> 2024-09-12T17:19:49.914+0000 7f022278b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:19:50.336 INFO:tasks.workunit.client.0.smithi016.stderr: -436> 2024-09-12T17:19:49.914+0000 7f022278b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:19:50.336 INFO:tasks.workunit.client.0.smithi016.stderr: -435> 2024-09-12T17:19:49.914+0000 7f0222f8c640 10 monclient(hunting): handle_auth_done global_id 6944 payload 824 2024-09-12T17:19:50.336 INFO:tasks.workunit.client.0.smithi016.stderr: -434> 2024-09-12T17:19:49.914+0000 7f0222f8c640 10 monclient: _finish_hunting 0 2024-09-12T17:19:50.336 INFO:tasks.workunit.client.0.smithi016.stderr: -433> 2024-09-12T17:19:49.914+0000 7f0222f8c640 1 monclient: found mon.noname-c 2024-09-12T17:19:50.336 INFO:tasks.workunit.client.0.smithi016.stderr: -432> 2024-09-12T17:19:49.914+0000 7f0222f8c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:19:50.336 INFO:tasks.workunit.client.0.smithi016.stderr: -431> 2024-09-12T17:19:49.914+0000 7f010ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:19:50.336 INFO:tasks.workunit.client.0.smithi016.stderr: -430> 2024-09-12T17:19:49.914+0000 7f010ee05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:19:50.336 INFO:tasks.workunit.client.0.smithi016.stderr: -429> 2024-09-12T17:19:49.914+0000 7f010ee05640 10 monclient: dump: 2024-09-12T17:19:50.337 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:19:50.337 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:19:50.337 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:50.337 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:50.337 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:19:50.337 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:50.337 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:19:50.337 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:19:50.337 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:19:50.337 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:50.337 INFO:tasks.workunit.client.0.smithi016.stderr: -428> 2024-09-12T17:19:49.914+0000 7f010ee05640 10 monclient: _finish_auth 0 2024-09-12T17:19:50.337 INFO:tasks.workunit.client.0.smithi016.stderr: -427> 2024-09-12T17:19:49.914+0000 7f010ee05640 10 monclient: _check_auth_tickets 2024-09-12T17:19:50.338 INFO:tasks.workunit.client.0.smithi016.stderr: -426> 2024-09-12T17:19:49.914+0000 7f0224c859c0 5 monclient: authenticate success, global_id 6944 2024-09-12T17:19:50.338 INFO:tasks.workunit.client.0.smithi016.stderr: -425> 2024-09-12T17:19:49.914+0000 7f0224c859c0 10 monclient: _renew_subs 2024-09-12T17:19:50.338 INFO:tasks.workunit.client.0.smithi016.stderr: -424> 2024-09-12T17:19:49.914+0000 7f0224c859c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:19:50.338 INFO:tasks.workunit.client.0.smithi016.stderr: -423> 2024-09-12T17:19:49.914+0000 7f010ee05640 10 monclient: handle_config config(0 keys) 2024-09-12T17:19:50.338 INFO:tasks.workunit.client.0.smithi016.stderr: -422> 2024-09-12T17:19:49.914+0000 7f010ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:19:50.338 INFO:tasks.workunit.client.0.smithi016.stderr: -421> 2024-09-12T17:19:49.914+0000 7f010ee05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:19:50.338 INFO:tasks.workunit.client.0.smithi016.stderr: -420> 2024-09-12T17:19:49.914+0000 7f010ee05640 10 monclient: dump: 2024-09-12T17:19:50.338 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:19:50.338 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:19:50.338 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:50.338 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:50.338 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:19:50.339 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:50.339 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:19:50.339 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:19:50.339 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:19:50.339 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:50.339 INFO:tasks.workunit.client.0.smithi016.stderr: -419> 2024-09-12T17:19:49.914+0000 7f0110608640 4 set_mon_vals no callback set 2024-09-12T17:19:50.339 INFO:tasks.workunit.client.0.smithi016.stderr: -418> 2024-09-12T17:19:49.914+0000 7f0224c859c0 10 monclient: _renew_subs 2024-09-12T17:19:50.339 INFO:tasks.workunit.client.0.smithi016.stderr: -417> 2024-09-12T17:19:49.914+0000 7f0224c859c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:19:50.339 INFO:tasks.workunit.client.0.smithi016.stderr: -416> 2024-09-12T17:19:49.914+0000 7f0224c859c0 1 librados: init done 2024-09-12T17:19:50.339 INFO:tasks.workunit.client.0.smithi016.stderr: -415> 2024-09-12T17:19:49.914+0000 7f010ee05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:19:50.339 INFO:tasks.workunit.client.0.smithi016.stderr: -414> 2024-09-12T17:19:49.914+0000 7f010ee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:19:50.340 INFO:tasks.workunit.client.0.smithi016.stderr: -413> 2024-09-12T17:19:49.914+0000 7f010ee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:19:50.340 INFO:tasks.workunit.client.0.smithi016.stderr: -412> 2024-09-12T17:19:49.914+0000 7f022278b640 10 monclient: get_auth_request con 0x7f0108070ae0 auth_method 0 2024-09-12T17:19:50.340 INFO:tasks.workunit.client.0.smithi016.stderr: -411> 2024-09-12T17:19:49.914+0000 7f0221f8a640 10 monclient: get_auth_request con 0x555fa2d7a960 auth_method 0 2024-09-12T17:19:50.340 INFO:tasks.workunit.client.0.smithi016.stderr: -410> 2024-09-12T17:19:49.918+0000 7f022278b640 10 monclient: get_auth_request con 0x555fa2d9d8e0 auth_method 0 2024-09-12T17:19:50.340 INFO:tasks.workunit.client.0.smithi016.stderr: -409> 2024-09-12T17:19:49.918+0000 7f0221f8a640 10 monclient: get_auth_request con 0x555fa2da1d50 auth_method 0 2024-09-12T17:19:50.340 INFO:tasks.workunit.client.0.smithi016.stderr: -408> 2024-09-12T17:19:49.922+0000 7f0222f8c640 10 monclient: get_auth_request con 0x555fa2da11d0 auth_method 0 2024-09-12T17:19:50.340 INFO:tasks.workunit.client.0.smithi016.stderr: -407> 2024-09-12T17:19:49.922+0000 7f0224c859c0 10 monclient: build_initial_monmap 2024-09-12T17:19:50.340 INFO:tasks.workunit.client.0.smithi016.stderr: -406> 2024-09-12T17:19:49.922+0000 7f0224c859c0 1 build_initial for_mkfs: 0 2024-09-12T17:19:50.340 INFO:tasks.workunit.client.0.smithi016.stderr: -405> 2024-09-12T17:19:49.922+0000 7f0224c859c0 10 monclient: monmap: 2024-09-12T17:19:50.340 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:19:50.340 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:19:50.340 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:19:50.341 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:19:50.341 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:19:50.341 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:50.341 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:19:50.341 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:19:50.341 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:19:50.341 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:50.341 INFO:tasks.workunit.client.0.smithi016.stderr: -404> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da9f50) adding auth protocol: cephx 2024-09-12T17:19:50.341 INFO:tasks.workunit.client.0.smithi016.stderr: -403> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da9f50) adding auth protocol: cephx 2024-09-12T17:19:50.341 INFO:tasks.workunit.client.0.smithi016.stderr: -402> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da9f50) adding auth protocol: cephx 2024-09-12T17:19:50.341 INFO:tasks.workunit.client.0.smithi016.stderr: -401> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da9f50) adding con mode: secure 2024-09-12T17:19:50.341 INFO:tasks.workunit.client.0.smithi016.stderr: -400> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da9f50) adding con mode: crc 2024-09-12T17:19:50.342 INFO:tasks.workunit.client.0.smithi016.stderr: -399> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da9f50) adding con mode: secure 2024-09-12T17:19:50.342 INFO:tasks.workunit.client.0.smithi016.stderr: -398> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da9f50) adding con mode: crc 2024-09-12T17:19:50.342 INFO:tasks.workunit.client.0.smithi016.stderr: -397> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da9f50) adding con mode: secure 2024-09-12T17:19:50.342 INFO:tasks.workunit.client.0.smithi016.stderr: -396> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da9f50) adding con mode: crc 2024-09-12T17:19:50.342 INFO:tasks.workunit.client.0.smithi016.stderr: -395> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da9f50) adding con mode: crc 2024-09-12T17:19:50.342 INFO:tasks.workunit.client.0.smithi016.stderr: -394> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da9f50) adding con mode: secure 2024-09-12T17:19:50.342 INFO:tasks.workunit.client.0.smithi016.stderr: -393> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da9f50) adding con mode: crc 2024-09-12T17:19:50.342 INFO:tasks.workunit.client.0.smithi016.stderr: -392> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da9f50) adding con mode: secure 2024-09-12T17:19:50.342 INFO:tasks.workunit.client.0.smithi016.stderr: -391> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da9f50) adding con mode: crc 2024-09-12T17:19:50.342 INFO:tasks.workunit.client.0.smithi016.stderr: -390> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da9f50) adding con mode: secure 2024-09-12T17:19:50.342 INFO:tasks.workunit.client.0.smithi016.stderr: -389> 2024-09-12T17:19:49.922+0000 7f0224c859c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:50.343 INFO:tasks.workunit.client.0.smithi016.stderr: -388> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 asok(0x555fa2b492b0) register_command objecter_requests cmddesc objecter_requests hook 0x555fa2dad8d0 EEXIST 2024-09-12T17:19:50.343 INFO:tasks.workunit.client.0.smithi016.stderr: -387> 2024-09-12T17:19:49.922+0000 7f0224c859c0 10 monclient: init 2024-09-12T17:19:50.343 INFO:tasks.workunit.client.0.smithi016.stderr: -386> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da8df8) adding auth protocol: cephx 2024-09-12T17:19:50.343 INFO:tasks.workunit.client.0.smithi016.stderr: -385> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da8df8) adding auth protocol: cephx 2024-09-12T17:19:50.343 INFO:tasks.workunit.client.0.smithi016.stderr: -384> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da8df8) adding auth protocol: cephx 2024-09-12T17:19:50.343 INFO:tasks.workunit.client.0.smithi016.stderr: -383> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da8df8) adding con mode: secure 2024-09-12T17:19:50.343 INFO:tasks.workunit.client.0.smithi016.stderr: -382> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da8df8) adding con mode: crc 2024-09-12T17:19:50.343 INFO:tasks.workunit.client.0.smithi016.stderr: -381> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da8df8) adding con mode: secure 2024-09-12T17:19:50.343 INFO:tasks.workunit.client.0.smithi016.stderr: -380> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da8df8) adding con mode: crc 2024-09-12T17:19:50.343 INFO:tasks.workunit.client.0.smithi016.stderr: -379> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da8df8) adding con mode: secure 2024-09-12T17:19:50.343 INFO:tasks.workunit.client.0.smithi016.stderr: -378> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da8df8) adding con mode: crc 2024-09-12T17:19:50.343 INFO:tasks.workunit.client.0.smithi016.stderr: -377> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da8df8) adding con mode: crc 2024-09-12T17:19:50.344 INFO:tasks.workunit.client.0.smithi016.stderr: -376> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da8df8) adding con mode: secure 2024-09-12T17:19:50.344 INFO:tasks.workunit.client.0.smithi016.stderr: -375> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da8df8) adding con mode: crc 2024-09-12T17:19:50.344 INFO:tasks.workunit.client.0.smithi016.stderr: -374> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da8df8) adding con mode: secure 2024-09-12T17:19:50.344 INFO:tasks.workunit.client.0.smithi016.stderr: -373> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da8df8) adding con mode: crc 2024-09-12T17:19:50.344 INFO:tasks.workunit.client.0.smithi016.stderr: -372> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 AuthRegistry(0x555fa2da8df8) adding con mode: secure 2024-09-12T17:19:50.344 INFO:tasks.workunit.client.0.smithi016.stderr: -371> 2024-09-12T17:19:49.922+0000 7f0224c859c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:50.344 INFO:tasks.workunit.client.0.smithi016.stderr: -370> 2024-09-12T17:19:49.922+0000 7f0224c859c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:50.344 INFO:tasks.workunit.client.0.smithi016.stderr: -369> 2024-09-12T17:19:49.922+0000 7f0224c859c0 5 asok(0x555fa2b492b0) register_command rotate-key cmddesc rotate-key hook 0x555fa2da8f40 EEXIST 2024-09-12T17:19:50.344 INFO:tasks.workunit.client.0.smithi016.stderr: -368> 2024-09-12T17:19:49.922+0000 7f0224c859c0 10 monclient: _reopen_session rank -1 2024-09-12T17:19:50.344 INFO:tasks.workunit.client.0.smithi016.stderr: -367> 2024-09-12T17:19:49.922+0000 7f0224c859c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:19:50.344 INFO:tasks.workunit.client.0.smithi016.stderr: -366> 2024-09-12T17:19:49.922+0000 7f0224c859c0 10 monclient(hunting): picked mon.noname-b con 0x555fa2dd1590 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:19:50.345 INFO:tasks.workunit.client.0.smithi016.stderr: -365> 2024-09-12T17:19:49.922+0000 7f0224c859c0 10 monclient(hunting): picked mon.noname-a con 0x555fa2dd3cb0 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:19:50.345 INFO:tasks.workunit.client.0.smithi016.stderr: -364> 2024-09-12T17:19:49.922+0000 7f0224c859c0 10 monclient(hunting): picked mon.noname-c con 0x555fa2de9710 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:19:50.345 INFO:tasks.workunit.client.0.smithi016.stderr: -363> 2024-09-12T17:19:49.922+0000 7f0224c859c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:50.345 INFO:tasks.workunit.client.0.smithi016.stderr: -362> 2024-09-12T17:19:49.922+0000 7f0224c859c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:50.345 INFO:tasks.workunit.client.0.smithi016.stderr: -361> 2024-09-12T17:19:49.922+0000 7f0224c859c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:50.345 INFO:tasks.workunit.client.0.smithi016.stderr: -360> 2024-09-12T17:19:49.922+0000 7f0224c859c0 10 monclient(hunting): _renew_subs 2024-09-12T17:19:50.345 INFO:tasks.workunit.client.0.smithi016.stderr: -359> 2024-09-12T17:19:49.922+0000 7f0224c859c0 10 monclient(hunting): authenticate will time out at 2307.899816s 2024-09-12T17:19:50.345 INFO:tasks.workunit.client.0.smithi016.stderr: -358> 2024-09-12T17:19:49.922+0000 7f0222f8c640 10 monclient(hunting): get_auth_request con 0x555fa2dd3cb0 auth_method 0 2024-09-12T17:19:50.345 INFO:tasks.workunit.client.0.smithi016.stderr: -357> 2024-09-12T17:19:49.922+0000 7f0222f8c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:19:50.345 INFO:tasks.workunit.client.0.smithi016.stderr: -356> 2024-09-12T17:19:49.922+0000 7f0222f8c640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:19:50.345 INFO:tasks.workunit.client.0.smithi016.stderr: -355> 2024-09-12T17:19:49.922+0000 7f0222f8c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:19:50.346 INFO:tasks.workunit.client.0.smithi016.stderr: -354> 2024-09-12T17:19:49.926+0000 7f022278b640 10 monclient(hunting): get_auth_request con 0x555fa2de9710 auth_method 0 2024-09-12T17:19:50.346 INFO:tasks.workunit.client.0.smithi016.stderr: -353> 2024-09-12T17:19:49.926+0000 7f022278b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:19:50.346 INFO:tasks.workunit.client.0.smithi016.stderr: -352> 2024-09-12T17:19:49.926+0000 7f022278b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:19:50.346 INFO:tasks.workunit.client.0.smithi016.stderr: -351> 2024-09-12T17:19:49.926+0000 7f022278b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:19:50.346 INFO:tasks.workunit.client.0.smithi016.stderr: -350> 2024-09-12T17:19:49.926+0000 7f0222f8c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:19:50.346 INFO:tasks.workunit.client.0.smithi016.stderr: -349> 2024-09-12T17:19:49.926+0000 7f0222f8c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:19:50.346 INFO:tasks.workunit.client.0.smithi016.stderr: -348> 2024-09-12T17:19:49.926+0000 7f0222f8c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:19:50.346 INFO:tasks.workunit.client.0.smithi016.stderr: -347> 2024-09-12T17:19:49.926+0000 7f022278b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:19:50.346 INFO:tasks.workunit.client.0.smithi016.stderr: -346> 2024-09-12T17:19:49.926+0000 7f022278b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:19:50.346 INFO:tasks.workunit.client.0.smithi016.stderr: -345> 2024-09-12T17:19:49.926+0000 7f022278b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:19:50.346 INFO:tasks.workunit.client.0.smithi016.stderr: -344> 2024-09-12T17:19:49.926+0000 7f0221f8a640 10 monclient(hunting): get_auth_request con 0x555fa2dd1590 auth_method 0 2024-09-12T17:19:50.346 INFO:tasks.workunit.client.0.smithi016.stderr: -343> 2024-09-12T17:19:49.926+0000 7f0221f8a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:19:50.347 INFO:tasks.workunit.client.0.smithi016.stderr: -342> 2024-09-12T17:19:49.926+0000 7f0221f8a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:19:50.347 INFO:tasks.workunit.client.0.smithi016.stderr: -341> 2024-09-12T17:19:49.926+0000 7f0221f8a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:19:50.347 INFO:tasks.workunit.client.0.smithi016.stderr: -340> 2024-09-12T17:19:49.926+0000 7f0222f8c640 10 monclient(hunting): handle_auth_done global_id 7275 payload 824 2024-09-12T17:19:50.347 INFO:tasks.workunit.client.0.smithi016.stderr: -339> 2024-09-12T17:19:49.926+0000 7f0222f8c640 10 monclient: _finish_hunting 0 2024-09-12T17:19:50.347 INFO:tasks.workunit.client.0.smithi016.stderr: -338> 2024-09-12T17:19:49.926+0000 7f0222f8c640 1 monclient: found mon.noname-a 2024-09-12T17:19:50.347 INFO:tasks.workunit.client.0.smithi016.stderr: -337> 2024-09-12T17:19:49.926+0000 7f0222f8c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:19:50.347 INFO:tasks.workunit.client.0.smithi016.stderr: -336> 2024-09-12T17:19:49.926+0000 7f0107fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:19:50.347 INFO:tasks.workunit.client.0.smithi016.stderr: -335> 2024-09-12T17:19:49.926+0000 7f0107fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:19:50.347 INFO:tasks.workunit.client.0.smithi016.stderr: -334> 2024-09-12T17:19:49.926+0000 7f0107fff640 10 monclient: dump: 2024-09-12T17:19:50.347 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:19:50.347 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:19:50.347 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:50.348 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:50.348 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:19:50.348 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:50.348 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:19:50.348 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:19:50.348 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:19:50.348 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:50.348 INFO:tasks.workunit.client.0.smithi016.stderr: -333> 2024-09-12T17:19:49.926+0000 7f0107fff640 10 monclient: _finish_auth 0 2024-09-12T17:19:50.348 INFO:tasks.workunit.client.0.smithi016.stderr: -332> 2024-09-12T17:19:49.926+0000 7f0107fff640 10 monclient: _check_auth_tickets 2024-09-12T17:19:50.348 INFO:tasks.workunit.client.0.smithi016.stderr: -331> 2024-09-12T17:19:49.926+0000 7f0107fff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:19:50.348 INFO:tasks.workunit.client.0.smithi016.stderr: -330> 2024-09-12T17:19:49.926+0000 7f0107fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:19:50.349 INFO:tasks.workunit.client.0.smithi016.stderr: -329> 2024-09-12T17:19:49.926+0000 7f0107fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:19:50.349 INFO:tasks.workunit.client.0.smithi016.stderr: -328> 2024-09-12T17:19:49.926+0000 7f0107fff640 10 monclient: dump: 2024-09-12T17:19:50.349 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:19:50.349 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:19:50.349 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:50.349 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:50.349 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:19:50.349 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:50.349 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:19:50.349 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:19:50.349 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:19:50.349 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:50.350 INFO:tasks.workunit.client.0.smithi016.stderr: -327> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 monclient: authenticate success, global_id 7275 2024-09-12T17:19:50.350 INFO:tasks.workunit.client.0.smithi016.stderr: -326> 2024-09-12T17:19:49.926+0000 7f022378d640 4 set_mon_vals no callback set 2024-09-12T17:19:50.350 INFO:tasks.workunit.client.0.smithi016.stderr: -325> 2024-09-12T17:19:49.926+0000 7f0224c859c0 10 monclient: _renew_subs 2024-09-12T17:19:50.350 INFO:tasks.workunit.client.0.smithi016.stderr: -324> 2024-09-12T17:19:49.926+0000 7f0224c859c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:19:50.350 INFO:tasks.workunit.client.0.smithi016.stderr: -323> 2024-09-12T17:19:49.926+0000 7f0224c859c0 10 monclient: _renew_subs 2024-09-12T17:19:50.350 INFO:tasks.workunit.client.0.smithi016.stderr: -322> 2024-09-12T17:19:49.926+0000 7f0224c859c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:19:50.350 INFO:tasks.workunit.client.0.smithi016.stderr: -321> 2024-09-12T17:19:49.926+0000 7f0107fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:19:50.350 INFO:tasks.workunit.client.0.smithi016.stderr: -320> 2024-09-12T17:19:49.926+0000 7f0107fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:19:50.350 INFO:tasks.workunit.client.0.smithi016.stderr: -319> 2024-09-12T17:19:49.926+0000 7f0107fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:19:50.350 INFO:tasks.workunit.client.0.smithi016.stderr: -318> 2024-09-12T17:19:49.926+0000 7f0224c859c0 10 monclient: get_monmap_and_config 2024-09-12T17:19:50.350 INFO:tasks.workunit.client.0.smithi016.stderr: -317> 2024-09-12T17:19:49.926+0000 7f0224c859c0 10 monclient: build_initial_monmap 2024-09-12T17:19:50.350 INFO:tasks.workunit.client.0.smithi016.stderr: -316> 2024-09-12T17:19:49.926+0000 7f0224c859c0 1 build_initial for_mkfs: 0 2024-09-12T17:19:50.351 INFO:tasks.workunit.client.0.smithi016.stderr: -315> 2024-09-12T17:19:49.926+0000 7f0224c859c0 10 monclient: monmap: 2024-09-12T17:19:50.351 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:19:50.351 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:19:50.351 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:19:50.351 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:19:50.351 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:19:50.351 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:50.351 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:19:50.351 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:19:50.351 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:19:50.351 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:50.351 INFO:tasks.workunit.client.0.smithi016.stderr: -314> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x555fa2df1370) adding auth protocol: cephx 2024-09-12T17:19:50.352 INFO:tasks.workunit.client.0.smithi016.stderr: -313> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x555fa2df1370) adding auth protocol: cephx 2024-09-12T17:19:50.352 INFO:tasks.workunit.client.0.smithi016.stderr: -312> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x555fa2df1370) adding auth protocol: cephx 2024-09-12T17:19:50.352 INFO:tasks.workunit.client.0.smithi016.stderr: -311> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x555fa2df1370) adding con mode: secure 2024-09-12T17:19:50.352 INFO:tasks.workunit.client.0.smithi016.stderr: -310> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x555fa2df1370) adding con mode: crc 2024-09-12T17:19:50.352 INFO:tasks.workunit.client.0.smithi016.stderr: -309> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x555fa2df1370) adding con mode: secure 2024-09-12T17:19:50.352 INFO:tasks.workunit.client.0.smithi016.stderr: -308> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x555fa2df1370) adding con mode: crc 2024-09-12T17:19:50.352 INFO:tasks.workunit.client.0.smithi016.stderr: -307> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x555fa2df1370) adding con mode: secure 2024-09-12T17:19:50.352 INFO:tasks.workunit.client.0.smithi016.stderr: -306> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x555fa2df1370) adding con mode: crc 2024-09-12T17:19:50.352 INFO:tasks.workunit.client.0.smithi016.stderr: -305> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x555fa2df1370) adding con mode: crc 2024-09-12T17:19:50.352 INFO:tasks.workunit.client.0.smithi016.stderr: -304> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x555fa2df1370) adding con mode: secure 2024-09-12T17:19:50.352 INFO:tasks.workunit.client.0.smithi016.stderr: -303> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x555fa2df1370) adding con mode: crc 2024-09-12T17:19:50.353 INFO:tasks.workunit.client.0.smithi016.stderr: -302> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x555fa2df1370) adding con mode: secure 2024-09-12T17:19:50.353 INFO:tasks.workunit.client.0.smithi016.stderr: -301> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x555fa2df1370) adding con mode: crc 2024-09-12T17:19:50.353 INFO:tasks.workunit.client.0.smithi016.stderr: -300> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x555fa2df1370) adding con mode: secure 2024-09-12T17:19:50.353 INFO:tasks.workunit.client.0.smithi016.stderr: -299> 2024-09-12T17:19:49.926+0000 7f0221f8a640 10 monclient: get_auth_request con 0x7f00fc0709f0 auth_method 0 2024-09-12T17:19:50.353 INFO:tasks.workunit.client.0.smithi016.stderr: -298> 2024-09-12T17:19:49.926+0000 7f0224c859c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:50.353 INFO:tasks.workunit.client.0.smithi016.stderr: -297> 2024-09-12T17:19:49.926+0000 7f0224c859c0 10 monclient: init 2024-09-12T17:19:50.353 INFO:tasks.workunit.client.0.smithi016.stderr: -296> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814700) adding auth protocol: cephx 2024-09-12T17:19:50.353 INFO:tasks.workunit.client.0.smithi016.stderr: -295> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814700) adding auth protocol: cephx 2024-09-12T17:19:50.353 INFO:tasks.workunit.client.0.smithi016.stderr: -294> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814700) adding auth protocol: cephx 2024-09-12T17:19:50.353 INFO:tasks.workunit.client.0.smithi016.stderr: -293> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814700) adding con mode: secure 2024-09-12T17:19:50.353 INFO:tasks.workunit.client.0.smithi016.stderr: -292> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814700) adding con mode: crc 2024-09-12T17:19:50.353 INFO:tasks.workunit.client.0.smithi016.stderr: -291> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814700) adding con mode: secure 2024-09-12T17:19:50.354 INFO:tasks.workunit.client.0.smithi016.stderr: -290> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814700) adding con mode: crc 2024-09-12T17:19:50.354 INFO:tasks.workunit.client.0.smithi016.stderr: -289> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814700) adding con mode: secure 2024-09-12T17:19:50.354 INFO:tasks.workunit.client.0.smithi016.stderr: -288> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814700) adding con mode: crc 2024-09-12T17:19:50.354 INFO:tasks.workunit.client.0.smithi016.stderr: -287> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814700) adding con mode: crc 2024-09-12T17:19:50.354 INFO:tasks.workunit.client.0.smithi016.stderr: -286> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814700) adding con mode: secure 2024-09-12T17:19:50.354 INFO:tasks.workunit.client.0.smithi016.stderr: -285> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814700) adding con mode: crc 2024-09-12T17:19:50.354 INFO:tasks.workunit.client.0.smithi016.stderr: -284> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814700) adding con mode: secure 2024-09-12T17:19:50.354 INFO:tasks.workunit.client.0.smithi016.stderr: -283> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814700) adding con mode: crc 2024-09-12T17:19:50.354 INFO:tasks.workunit.client.0.smithi016.stderr: -282> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814700) adding con mode: secure 2024-09-12T17:19:50.354 INFO:tasks.workunit.client.0.smithi016.stderr: -281> 2024-09-12T17:19:49.926+0000 7f0224c859c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:50.354 INFO:tasks.workunit.client.0.smithi016.stderr: -280> 2024-09-12T17:19:49.926+0000 7f0224c859c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:50.354 INFO:tasks.workunit.client.0.smithi016.stderr: -279> 2024-09-12T17:19:49.926+0000 7f0224c859c0 5 asok(0x555fa2b492b0) register_command rotate-key cmddesc rotate-key hook 0x7ffda9814848 EEXIST 2024-09-12T17:19:50.355 INFO:tasks.workunit.client.0.smithi016.stderr: -278> 2024-09-12T17:19:49.926+0000 7f0224c859c0 10 monclient: _reopen_session rank -1 2024-09-12T17:19:50.355 INFO:tasks.workunit.client.0.smithi016.stderr: -277> 2024-09-12T17:19:49.926+0000 7f0224c859c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:19:50.355 INFO:tasks.workunit.client.0.smithi016.stderr: -276> 2024-09-12T17:19:49.926+0000 7f0224c859c0 10 monclient(hunting): picked mon.noname-a con 0x555fa2e25850 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:19:50.355 INFO:tasks.workunit.client.0.smithi016.stderr: -275> 2024-09-12T17:19:49.926+0000 7f0224c859c0 10 monclient(hunting): picked mon.noname-c con 0x555fa2df6860 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:19:50.355 INFO:tasks.workunit.client.0.smithi016.stderr: -274> 2024-09-12T17:19:49.926+0000 7f0224c859c0 10 monclient(hunting): picked mon.noname-b con 0x555fa2e20cb0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:19:50.355 INFO:tasks.workunit.client.0.smithi016.stderr: -273> 2024-09-12T17:19:49.926+0000 7f0224c859c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:50.355 INFO:tasks.workunit.client.0.smithi016.stderr: -272> 2024-09-12T17:19:49.926+0000 7f0224c859c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:50.355 INFO:tasks.workunit.client.0.smithi016.stderr: -271> 2024-09-12T17:19:49.926+0000 7f0224c859c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:50.355 INFO:tasks.workunit.client.0.smithi016.stderr: -270> 2024-09-12T17:19:49.926+0000 7f0224c859c0 10 monclient(hunting): _renew_subs 2024-09-12T17:19:50.355 INFO:tasks.workunit.client.0.smithi016.stderr: -269> 2024-09-12T17:19:49.926+0000 7f0224c859c0 10 monclient(hunting): authenticate will time out at 2307.903966s 2024-09-12T17:19:50.355 INFO:tasks.workunit.client.0.smithi016.stderr: -268> 2024-09-12T17:19:49.930+0000 7f0222f8c640 10 monclient(hunting): get_auth_request con 0x555fa2df6860 auth_method 0 2024-09-12T17:19:50.355 INFO:tasks.workunit.client.0.smithi016.stderr: -267> 2024-09-12T17:19:49.930+0000 7f0222f8c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:19:50.356 INFO:tasks.workunit.client.0.smithi016.stderr: -266> 2024-09-12T17:19:49.930+0000 7f0222f8c640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:19:50.356 INFO:tasks.workunit.client.0.smithi016.stderr: -265> 2024-09-12T17:19:49.930+0000 7f0222f8c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:19:50.356 INFO:tasks.workunit.client.0.smithi016.stderr: -264> 2024-09-12T17:19:49.930+0000 7f0221f8a640 10 monclient(hunting): get_auth_request con 0x555fa2e25850 auth_method 0 2024-09-12T17:19:50.356 INFO:tasks.workunit.client.0.smithi016.stderr: -263> 2024-09-12T17:19:49.930+0000 7f0221f8a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:19:50.356 INFO:tasks.workunit.client.0.smithi016.stderr: -262> 2024-09-12T17:19:49.930+0000 7f0221f8a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:19:50.356 INFO:tasks.workunit.client.0.smithi016.stderr: -261> 2024-09-12T17:19:49.930+0000 7f0221f8a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:19:50.356 INFO:tasks.workunit.client.0.smithi016.stderr: -260> 2024-09-12T17:19:49.930+0000 7f0222f8c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:19:50.356 INFO:tasks.workunit.client.0.smithi016.stderr: -259> 2024-09-12T17:19:49.930+0000 7f0222f8c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:19:50.356 INFO:tasks.workunit.client.0.smithi016.stderr: -258> 2024-09-12T17:19:49.930+0000 7f0222f8c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:19:50.356 INFO:tasks.workunit.client.0.smithi016.stderr: -257> 2024-09-12T17:19:49.930+0000 7f0221f8a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:19:50.356 INFO:tasks.workunit.client.0.smithi016.stderr: -256> 2024-09-12T17:19:49.930+0000 7f0221f8a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:19:50.357 INFO:tasks.workunit.client.0.smithi016.stderr: -255> 2024-09-12T17:19:49.930+0000 7f0221f8a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:19:50.357 INFO:tasks.workunit.client.0.smithi016.stderr: -254> 2024-09-12T17:19:49.930+0000 7f0222f8c640 10 monclient(hunting): handle_auth_done global_id 6950 payload 274 2024-09-12T17:19:50.357 INFO:tasks.workunit.client.0.smithi016.stderr: -253> 2024-09-12T17:19:49.930+0000 7f0222f8c640 10 monclient: _finish_hunting 0 2024-09-12T17:19:50.357 INFO:tasks.workunit.client.0.smithi016.stderr: -252> 2024-09-12T17:19:49.930+0000 7f0222f8c640 1 monclient: found mon.noname-c 2024-09-12T17:19:50.357 INFO:tasks.workunit.client.0.smithi016.stderr: -251> 2024-09-12T17:19:49.930+0000 7f0222f8c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:19:50.357 INFO:tasks.workunit.client.0.smithi016.stderr: -250> 2024-09-12T17:19:49.930+0000 7f0105ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:19:50.357 INFO:tasks.workunit.client.0.smithi016.stderr: -249> 2024-09-12T17:19:49.930+0000 7f0105ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:19:50.357 INFO:tasks.workunit.client.0.smithi016.stderr: -248> 2024-09-12T17:19:49.930+0000 7f0105ffb640 10 monclient: dump: 2024-09-12T17:19:50.357 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:19:50.357 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:19:50.357 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:50.357 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:50.358 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:19:50.358 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:50.358 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:19:50.358 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:19:50.358 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:19:50.358 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:50.358 INFO:tasks.workunit.client.0.smithi016.stderr: -247> 2024-09-12T17:19:49.930+0000 7f0105ffb640 10 monclient: _finish_auth 0 2024-09-12T17:19:50.358 INFO:tasks.workunit.client.0.smithi016.stderr: -246> 2024-09-12T17:19:49.930+0000 7f0105ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:19:50.358 INFO:tasks.workunit.client.0.smithi016.stderr: -245> 2024-09-12T17:19:49.930+0000 7f0105ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:19:50.358 INFO:tasks.workunit.client.0.smithi016.stderr: -244> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 monclient: authenticate success, global_id 6950 2024-09-12T17:19:50.358 INFO:tasks.workunit.client.0.smithi016.stderr: -243> 2024-09-12T17:19:49.930+0000 7f0224c859c0 10 monclient: get_monmap_and_config success 2024-09-12T17:19:50.359 INFO:tasks.workunit.client.0.smithi016.stderr: -242> 2024-09-12T17:19:49.930+0000 7f0224c859c0 4 set_mon_vals no callback set 2024-09-12T17:19:50.359 INFO:tasks.workunit.client.0.smithi016.stderr: -241> 2024-09-12T17:19:49.930+0000 7f0105ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:19:50.359 INFO:tasks.workunit.client.0.smithi016.stderr: -240> 2024-09-12T17:19:49.930+0000 7f0105ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:19:50.359 INFO:tasks.workunit.client.0.smithi016.stderr: -239> 2024-09-12T17:19:49.930+0000 7f0105ffb640 10 monclient: dump: 2024-09-12T17:19:50.359 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:19:50.360 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:19:50.360 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:50.360 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:50.360 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:19:50.360 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:50.360 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:19:50.360 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:19:50.360 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:19:50.360 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:50.360 INFO:tasks.workunit.client.0.smithi016.stderr: -238> 2024-09-12T17:19:49.930+0000 7f0224c859c0 10 monclient: shutdown 2024-09-12T17:19:50.361 INFO:tasks.workunit.client.0.smithi016.stderr: -237> 2024-09-12T17:19:49.930+0000 7f0224c859c0 10 monclient: build_initial_monmap 2024-09-12T17:19:50.361 INFO:tasks.workunit.client.0.smithi016.stderr: -236> 2024-09-12T17:19:49.930+0000 7f0224c859c0 1 build_initial for_mkfs: 0 2024-09-12T17:19:50.361 INFO:tasks.workunit.client.0.smithi016.stderr: -235> 2024-09-12T17:19:49.930+0000 7f0224c859c0 10 monclient: monmap: 2024-09-12T17:19:50.361 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:19:50.361 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:19:50.361 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:19:50.361 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:19:50.361 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:19:50.361 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:50.361 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:19:50.361 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:19:50.362 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:19:50.362 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:50.362 INFO:tasks.workunit.client.0.smithi016.stderr: -234> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2e17a50) adding auth protocol: cephx 2024-09-12T17:19:50.362 INFO:tasks.workunit.client.0.smithi016.stderr: -233> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2e17a50) adding auth protocol: cephx 2024-09-12T17:19:50.362 INFO:tasks.workunit.client.0.smithi016.stderr: -232> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2e17a50) adding auth protocol: cephx 2024-09-12T17:19:50.362 INFO:tasks.workunit.client.0.smithi016.stderr: -231> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2e17a50) adding con mode: secure 2024-09-12T17:19:50.362 INFO:tasks.workunit.client.0.smithi016.stderr: -230> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2e17a50) adding con mode: crc 2024-09-12T17:19:50.362 INFO:tasks.workunit.client.0.smithi016.stderr: -229> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2e17a50) adding con mode: secure 2024-09-12T17:19:50.362 INFO:tasks.workunit.client.0.smithi016.stderr: -228> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2e17a50) adding con mode: crc 2024-09-12T17:19:50.362 INFO:tasks.workunit.client.0.smithi016.stderr: -227> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2e17a50) adding con mode: secure 2024-09-12T17:19:50.362 INFO:tasks.workunit.client.0.smithi016.stderr: -226> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2e17a50) adding con mode: crc 2024-09-12T17:19:50.362 INFO:tasks.workunit.client.0.smithi016.stderr: -225> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2e17a50) adding con mode: crc 2024-09-12T17:19:50.363 INFO:tasks.workunit.client.0.smithi016.stderr: -224> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2e17a50) adding con mode: secure 2024-09-12T17:19:50.363 INFO:tasks.workunit.client.0.smithi016.stderr: -223> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2e17a50) adding con mode: crc 2024-09-12T17:19:50.363 INFO:tasks.workunit.client.0.smithi016.stderr: -222> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2e17a50) adding con mode: secure 2024-09-12T17:19:50.363 INFO:tasks.workunit.client.0.smithi016.stderr: -221> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2e17a50) adding con mode: crc 2024-09-12T17:19:50.363 INFO:tasks.workunit.client.0.smithi016.stderr: -220> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2e17a50) adding con mode: secure 2024-09-12T17:19:50.363 INFO:tasks.workunit.client.0.smithi016.stderr: -219> 2024-09-12T17:19:49.930+0000 7f0224c859c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:50.363 INFO:tasks.workunit.client.0.smithi016.stderr: -218> 2024-09-12T17:19:49.930+0000 7f0224c859c0 1 librados: starting msgr at 2024-09-12T17:19:50.363 INFO:tasks.workunit.client.0.smithi016.stderr: -217> 2024-09-12T17:19:49.930+0000 7f0224c859c0 1 librados: starting objecter 2024-09-12T17:19:50.363 INFO:tasks.workunit.client.0.smithi016.stderr: -216> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 asok(0x555fa2b492b0) register_command objecter_requests cmddesc objecter_requests hook 0x555fa2df5560 EEXIST 2024-09-12T17:19:50.363 INFO:tasks.workunit.client.0.smithi016.stderr: -215> 2024-09-12T17:19:49.930+0000 7f0224c859c0 1 librados: setting wanted keys 2024-09-12T17:19:50.363 INFO:tasks.workunit.client.0.smithi016.stderr: -214> 2024-09-12T17:19:49.930+0000 7f0224c859c0 1 librados: calling monclient init 2024-09-12T17:19:50.363 INFO:tasks.workunit.client.0.smithi016.stderr: -213> 2024-09-12T17:19:49.930+0000 7f0224c859c0 10 monclient: init 2024-09-12T17:19:50.364 INFO:tasks.workunit.client.0.smithi016.stderr: -212> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2dcf9d0) adding auth protocol: cephx 2024-09-12T17:19:50.364 INFO:tasks.workunit.client.0.smithi016.stderr: -211> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2dcf9d0) adding auth protocol: cephx 2024-09-12T17:19:50.364 INFO:tasks.workunit.client.0.smithi016.stderr: -210> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2dcf9d0) adding auth protocol: cephx 2024-09-12T17:19:50.364 INFO:tasks.workunit.client.0.smithi016.stderr: -209> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2dcf9d0) adding con mode: secure 2024-09-12T17:19:50.364 INFO:tasks.workunit.client.0.smithi016.stderr: -208> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2dcf9d0) adding con mode: crc 2024-09-12T17:19:50.364 INFO:tasks.workunit.client.0.smithi016.stderr: -207> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2dcf9d0) adding con mode: secure 2024-09-12T17:19:50.364 INFO:tasks.workunit.client.0.smithi016.stderr: -206> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2dcf9d0) adding con mode: crc 2024-09-12T17:19:50.364 INFO:tasks.workunit.client.0.smithi016.stderr: -205> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2dcf9d0) adding con mode: secure 2024-09-12T17:19:50.364 INFO:tasks.workunit.client.0.smithi016.stderr: -204> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2dcf9d0) adding con mode: crc 2024-09-12T17:19:50.364 INFO:tasks.workunit.client.0.smithi016.stderr: -203> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2dcf9d0) adding con mode: crc 2024-09-12T17:19:50.364 INFO:tasks.workunit.client.0.smithi016.stderr: -202> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2dcf9d0) adding con mode: secure 2024-09-12T17:19:50.365 INFO:tasks.workunit.client.0.smithi016.stderr: -201> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2dcf9d0) adding con mode: crc 2024-09-12T17:19:50.365 INFO:tasks.workunit.client.0.smithi016.stderr: -200> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2dcf9d0) adding con mode: secure 2024-09-12T17:19:50.365 INFO:tasks.workunit.client.0.smithi016.stderr: -199> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2dcf9d0) adding con mode: crc 2024-09-12T17:19:50.365 INFO:tasks.workunit.client.0.smithi016.stderr: -198> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 AuthRegistry(0x555fa2dcf9d0) adding con mode: secure 2024-09-12T17:19:50.365 INFO:tasks.workunit.client.0.smithi016.stderr: -197> 2024-09-12T17:19:49.930+0000 7f0224c859c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:50.365 INFO:tasks.workunit.client.0.smithi016.stderr: -196> 2024-09-12T17:19:49.930+0000 7f0224c859c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:50.365 INFO:tasks.workunit.client.0.smithi016.stderr: -195> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 asok(0x555fa2b492b0) register_command rotate-key cmddesc rotate-key hook 0x555fa2dcfb18 EEXIST 2024-09-12T17:19:50.365 INFO:tasks.workunit.client.0.smithi016.stderr: -194> 2024-09-12T17:19:49.930+0000 7f0224c859c0 10 monclient: _reopen_session rank -1 2024-09-12T17:19:50.365 INFO:tasks.workunit.client.0.smithi016.stderr: -193> 2024-09-12T17:19:49.930+0000 7f0224c859c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:19:50.365 INFO:tasks.workunit.client.0.smithi016.stderr: -192> 2024-09-12T17:19:49.930+0000 7f0224c859c0 10 monclient(hunting): picked mon.noname-c con 0x555fa2df6860 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:19:50.365 INFO:tasks.workunit.client.0.smithi016.stderr: -191> 2024-09-12T17:19:49.930+0000 7f0224c859c0 10 monclient(hunting): picked mon.noname-b con 0x555fa2e20cb0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:19:50.365 INFO:tasks.workunit.client.0.smithi016.stderr: -190> 2024-09-12T17:19:49.930+0000 7f0224c859c0 10 monclient(hunting): picked mon.noname-a con 0x555fa2e25850 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:19:50.366 INFO:tasks.workunit.client.0.smithi016.stderr: -189> 2024-09-12T17:19:49.930+0000 7f0224c859c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:50.366 INFO:tasks.workunit.client.0.smithi016.stderr: -188> 2024-09-12T17:19:49.930+0000 7f0224c859c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:50.366 INFO:tasks.workunit.client.0.smithi016.stderr: -187> 2024-09-12T17:19:49.930+0000 7f0224c859c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:19:50.366 INFO:tasks.workunit.client.0.smithi016.stderr: -186> 2024-09-12T17:19:49.930+0000 7f0224c859c0 10 monclient(hunting): _renew_subs 2024-09-12T17:19:50.366 INFO:tasks.workunit.client.0.smithi016.stderr: -185> 2024-09-12T17:19:49.930+0000 7f0224c859c0 10 monclient(hunting): authenticate will time out at 2307.906558s 2024-09-12T17:19:50.366 INFO:tasks.workunit.client.0.smithi016.stderr: -184> 2024-09-12T17:19:49.930+0000 7f022278b640 10 monclient(hunting): get_auth_request con 0x555fa2e25850 auth_method 0 2024-09-12T17:19:50.366 INFO:tasks.workunit.client.0.smithi016.stderr: -183> 2024-09-12T17:19:49.930+0000 7f022278b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:19:50.366 INFO:tasks.workunit.client.0.smithi016.stderr: -182> 2024-09-12T17:19:49.930+0000 7f022278b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:19:50.366 INFO:tasks.workunit.client.0.smithi016.stderr: -181> 2024-09-12T17:19:49.930+0000 7f022278b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:19:50.366 INFO:tasks.workunit.client.0.smithi016.stderr: -180> 2024-09-12T17:19:49.930+0000 7f0221f8a640 10 monclient(hunting): get_auth_request con 0x555fa2df6860 auth_method 0 2024-09-12T17:19:50.366 INFO:tasks.workunit.client.0.smithi016.stderr: -179> 2024-09-12T17:19:49.930+0000 7f0221f8a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:19:50.367 INFO:tasks.workunit.client.0.smithi016.stderr: -178> 2024-09-12T17:19:49.930+0000 7f0221f8a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:19:50.367 INFO:tasks.workunit.client.0.smithi016.stderr: -177> 2024-09-12T17:19:49.930+0000 7f0221f8a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:19:50.367 INFO:tasks.workunit.client.0.smithi016.stderr: -176> 2024-09-12T17:19:49.930+0000 7f022278b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:19:50.367 INFO:tasks.workunit.client.0.smithi016.stderr: -175> 2024-09-12T17:19:49.930+0000 7f022278b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:19:50.367 INFO:tasks.workunit.client.0.smithi016.stderr: -174> 2024-09-12T17:19:49.930+0000 7f022278b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:19:50.367 INFO:tasks.workunit.client.0.smithi016.stderr: -173> 2024-09-12T17:19:49.930+0000 7f0221f8a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:19:50.367 INFO:tasks.workunit.client.0.smithi016.stderr: -172> 2024-09-12T17:19:49.930+0000 7f0221f8a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:19:50.367 INFO:tasks.workunit.client.0.smithi016.stderr: -171> 2024-09-12T17:19:49.930+0000 7f0221f8a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:19:50.367 INFO:tasks.workunit.client.0.smithi016.stderr: -170> 2024-09-12T17:19:49.930+0000 7f0222f8c640 10 monclient(hunting): get_auth_request con 0x555fa2e20cb0 auth_method 0 2024-09-12T17:19:50.367 INFO:tasks.workunit.client.0.smithi016.stderr: -169> 2024-09-12T17:19:49.930+0000 7f0222f8c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:19:50.367 INFO:tasks.workunit.client.0.smithi016.stderr: -168> 2024-09-12T17:19:49.930+0000 7f0222f8c640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:19:50.367 INFO:tasks.workunit.client.0.smithi016.stderr: -167> 2024-09-12T17:19:49.930+0000 7f0222f8c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:19:50.368 INFO:tasks.workunit.client.0.smithi016.stderr: -166> 2024-09-12T17:19:49.930+0000 7f022278b640 10 monclient(hunting): handle_auth_done global_id 7281 payload 824 2024-09-12T17:19:50.368 INFO:tasks.workunit.client.0.smithi016.stderr: -165> 2024-09-12T17:19:49.930+0000 7f022278b640 10 monclient: _finish_hunting 0 2024-09-12T17:19:50.368 INFO:tasks.workunit.client.0.smithi016.stderr: -164> 2024-09-12T17:19:49.930+0000 7f022278b640 1 monclient: found mon.noname-a 2024-09-12T17:19:50.368 INFO:tasks.workunit.client.0.smithi016.stderr: -163> 2024-09-12T17:19:49.930+0000 7f022278b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:19:50.368 INFO:tasks.workunit.client.0.smithi016.stderr: -162> 2024-09-12T17:19:49.930+0000 7f00f3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:19:50.368 INFO:tasks.workunit.client.0.smithi016.stderr: -161> 2024-09-12T17:19:49.930+0000 7f00f3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:19:50.368 INFO:tasks.workunit.client.0.smithi016.stderr: -160> 2024-09-12T17:19:49.930+0000 7f00f3fff640 10 monclient: dump: 2024-09-12T17:19:50.368 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:19:50.368 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:19:50.368 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:50.368 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:50.368 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:19:50.369 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:50.369 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:19:50.369 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:19:50.369 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:19:50.369 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:50.369 INFO:tasks.workunit.client.0.smithi016.stderr: -159> 2024-09-12T17:19:49.930+0000 7f00f3fff640 10 monclient: _finish_auth 0 2024-09-12T17:19:50.369 INFO:tasks.workunit.client.0.smithi016.stderr: -158> 2024-09-12T17:19:49.930+0000 7f00f3fff640 10 monclient: _check_auth_tickets 2024-09-12T17:19:50.369 INFO:tasks.workunit.client.0.smithi016.stderr: -157> 2024-09-12T17:19:49.930+0000 7f00f3fff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:19:50.369 INFO:tasks.workunit.client.0.smithi016.stderr: -156> 2024-09-12T17:19:49.930+0000 7f00f3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:19:50.369 INFO:tasks.workunit.client.0.smithi016.stderr: -155> 2024-09-12T17:19:49.930+0000 7f00f3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:19:50.369 INFO:tasks.workunit.client.0.smithi016.stderr: -154> 2024-09-12T17:19:49.930+0000 7f00f3fff640 10 monclient: dump: 2024-09-12T17:19:50.369 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:19:50.370 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:19:50.370 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:50.370 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:19:50.370 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:19:50.370 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:19:50.370 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:19:50.370 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:19:50.370 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:19:50.370 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:50.370 INFO:tasks.workunit.client.0.smithi016.stderr: -153> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 monclient: authenticate success, global_id 7281 2024-09-12T17:19:50.370 INFO:tasks.workunit.client.0.smithi016.stderr: -152> 2024-09-12T17:19:49.930+0000 7f0224c859c0 10 monclient: _renew_subs 2024-09-12T17:19:50.371 INFO:tasks.workunit.client.0.smithi016.stderr: -151> 2024-09-12T17:19:49.930+0000 7f0105ffb640 4 set_mon_vals no callback set 2024-09-12T17:19:50.371 INFO:tasks.workunit.client.0.smithi016.stderr: -150> 2024-09-12T17:19:49.930+0000 7f0224c859c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:19:50.371 INFO:tasks.workunit.client.0.smithi016.stderr: -149> 2024-09-12T17:19:49.930+0000 7f0224c859c0 10 monclient: _renew_subs 2024-09-12T17:19:50.371 INFO:tasks.workunit.client.0.smithi016.stderr: -148> 2024-09-12T17:19:49.930+0000 7f0224c859c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:19:50.371 INFO:tasks.workunit.client.0.smithi016.stderr: -147> 2024-09-12T17:19:49.930+0000 7f0224c859c0 1 librados: init done 2024-09-12T17:19:50.371 INFO:tasks.workunit.client.0.smithi016.stderr: -146> 2024-09-12T17:19:49.930+0000 7f0224c859c0 5 asok(0x555fa2b492b0) register_command cr dump hook 0x555fa2e25ca8 2024-09-12T17:19:50.371 INFO:tasks.workunit.client.0.smithi016.stderr: -145> 2024-09-12T17:19:49.934+0000 7f0224c859c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.371 INFO:tasks.workunit.client.0.smithi016.stderr: -144> 2024-09-12T17:19:49.934+0000 7f00f3fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:19:50.371 INFO:tasks.workunit.client.0.smithi016.stderr: -143> 2024-09-12T17:19:49.934+0000 7f00f3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:19:50.371 INFO:tasks.workunit.client.0.smithi016.stderr: -142> 2024-09-12T17:19:49.934+0000 7f00f3fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:19:50.371 INFO:tasks.workunit.client.0.smithi016.stderr: -141> 2024-09-12T17:19:49.934+0000 7f0221f8a640 10 monclient: get_auth_request con 0x7f00ec070b10 auth_method 0 2024-09-12T17:19:50.371 INFO:tasks.workunit.client.0.smithi016.stderr: -140> 2024-09-12T17:19:49.934+0000 7f0222f8c640 10 monclient: get_auth_request con 0x555fa2e3f350 auth_method 0 2024-09-12T17:19:50.371 INFO:tasks.workunit.client.0.smithi016.stderr: -139> 2024-09-12T17:19:49.934+0000 7f0224c859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:50.372 INFO:tasks.workunit.client.0.smithi016.stderr: -138> 2024-09-12T17:19:49.934+0000 7f0224c859c0 20 realm 2024-09-12T17:19:50.372 INFO:tasks.workunit.client.0.smithi016.stderr: -137> 2024-09-12T17:19:49.934+0000 7f0224c859c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.372 INFO:tasks.workunit.client.0.smithi016.stderr: -136> 2024-09-12T17:19:49.934+0000 7f0224c859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:50.372 INFO:tasks.workunit.client.0.smithi016.stderr: -135> 2024-09-12T17:19:49.934+0000 7f0224c859c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:19:50.372 INFO:tasks.workunit.client.0.smithi016.stderr: -134> 2024-09-12T17:19:49.934+0000 7f0224c859c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.372 INFO:tasks.workunit.client.0.smithi016.stderr: -133> 2024-09-12T17:19:49.934+0000 7f0224c859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:50.372 INFO:tasks.workunit.client.0.smithi016.stderr: -132> 2024-09-12T17:19:49.934+0000 7f0224c859c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.372 INFO:tasks.workunit.client.0.smithi016.stderr: -131> 2024-09-12T17:19:49.934+0000 7f0221f8a640 10 monclient: get_auth_request con 0x555fa2e43540 auth_method 0 2024-09-12T17:19:50.372 INFO:tasks.workunit.client.0.smithi016.stderr: -130> 2024-09-12T17:19:49.938+0000 7f0224c859c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:50.372 INFO:tasks.workunit.client.0.smithi016.stderr: -129> 2024-09-12T17:19:49.938+0000 7f0224c859c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.373 INFO:tasks.workunit.client.0.smithi016.stderr: -128> 2024-09-12T17:19:49.938+0000 7f0222f8c640 10 monclient: get_auth_request con 0x555fa2e46da0 auth_method 0 2024-09-12T17:19:50.373 INFO:tasks.workunit.client.0.smithi016.stderr: -127> 2024-09-12T17:19:49.938+0000 7f0224c859c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:19:50.373 INFO:tasks.workunit.client.0.smithi016.stderr: -126> 2024-09-12T17:19:49.938+0000 7f0224c859c0 20 searching for the correct realm 2024-09-12T17:19:50.373 INFO:tasks.workunit.client.0.smithi016.stderr: -125> 2024-09-12T17:19:49.938+0000 7f022278b640 10 monclient: get_auth_request con 0x555fa2e4bae0 auth_method 0 2024-09-12T17:19:50.373 INFO:tasks.workunit.client.0.smithi016.stderr: -124> 2024-09-12T17:19:49.942+0000 7f0221f8a640 10 monclient: get_auth_request con 0x7f0214041060 auth_method 0 2024-09-12T17:19:50.373 INFO:tasks.workunit.client.0.smithi016.stderr: -123> 2024-09-12T17:19:49.942+0000 7f0222f8c640 10 monclient: get_auth_request con 0x7f02180c7040 auth_method 0 2024-09-12T17:19:50.373 INFO:tasks.workunit.client.0.smithi016.stderr: -122> 2024-09-12T17:19:49.942+0000 7f0222f8c640 0 -- 172.21.15.16:0/560809507 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f02180c7040 msgr2=0x7f02180b79c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:19:50.373 INFO:tasks.workunit.client.0.smithi016.stderr: -121> 2024-09-12T17:19:49.942+0000 7f00f3fff640 1 client.7281.objecter ms_handle_reset 0x7f02180c7040 session 0x7f02180a6070 osd.2 2024-09-12T17:19:50.373 INFO:tasks.workunit.client.0.smithi016.stderr: -120> 2024-09-12T17:19:49.942+0000 7f00f3fff640 10 monclient: _renew_subs 2024-09-12T17:19:50.373 INFO:tasks.workunit.client.0.smithi016.stderr: -119> 2024-09-12T17:19:49.942+0000 7f00f3fff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:19:50.373 INFO:tasks.workunit.client.0.smithi016.stderr: -118> 2024-09-12T17:19:49.942+0000 7f0222f8c640 10 monclient: get_auth_request con 0x7f00ec080930 auth_method 0 2024-09-12T17:19:50.373 INFO:tasks.workunit.client.0.smithi016.stderr: -117> 2024-09-12T17:19:49.946+0000 7f022278b640 10 monclient: get_auth_request con 0x7f021c094040 auth_method 0 2024-09-12T17:19:50.374 INFO:tasks.workunit.client.0.smithi016.stderr: -116> 2024-09-12T17:19:49.950+0000 7f0221f8a640 10 monclient: get_auth_request con 0x7f021c09ab90 auth_method 0 2024-09-12T17:19:50.374 INFO:tasks.workunit.client.0.smithi016.stderr: -115> 2024-09-12T17:19:49.950+0000 7f0221f8a640 0 -- 172.21.15.16:0/560809507 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f021c09ab90 msgr2=0x7f021c090330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:19:50.374 INFO:tasks.workunit.client.0.smithi016.stderr: -114> 2024-09-12T17:19:50.154+0000 7f0221f8a640 10 monclient: get_auth_request con 0x7f021c09ab90 auth_method 0 2024-09-12T17:19:50.374 INFO:tasks.workunit.client.0.smithi016.stderr: -113> 2024-09-12T17:19:50.166+0000 7f0224c859c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:19:50.374 INFO:tasks.workunit.client.0.smithi016.stderr: -112> 2024-09-12T17:19:50.166+0000 7f0224c859c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:19:50.374 INFO:tasks.workunit.client.0.smithi016.stderr: -111> 2024-09-12T17:19:50.166+0000 7f0224c859c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:19:50.374 INFO:tasks.workunit.client.0.smithi016.stderr: -110> 2024-09-12T17:19:50.166+0000 7f0224c859c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:19:50.374 INFO:tasks.workunit.client.0.smithi016.stderr: -109> 2024-09-12T17:19:50.166+0000 7f0224c859c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:19:50.374 INFO:tasks.workunit.client.0.smithi016.stderr: -108> 2024-09-12T17:19:50.166+0000 7f0224c859c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:19:50.374 INFO:tasks.workunit.client.0.smithi016.stderr: -107> 2024-09-12T17:19:50.166+0000 7f0224c859c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.374 INFO:tasks.workunit.client.0.smithi016.stderr: -106> 2024-09-12T17:19:50.166+0000 7f0224c859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:50.374 INFO:tasks.workunit.client.0.smithi016.stderr: -105> 2024-09-12T17:19:50.166+0000 7f0224c859c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.375 INFO:tasks.workunit.client.0.smithi016.stderr: -104> 2024-09-12T17:19:50.166+0000 7f0224c859c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:50.375 INFO:tasks.workunit.client.0.smithi016.stderr: -103> 2024-09-12T17:19:50.166+0000 7f0224c859c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.375 INFO:tasks.workunit.client.0.smithi016.stderr: -102> 2024-09-12T17:19:50.170+0000 7f0224c859c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:19:50.375 INFO:tasks.workunit.client.0.smithi016.stderr: -101> 2024-09-12T17:19:50.170+0000 7f0224c859c0 20 zone default found 2024-09-12T17:19:50.375 INFO:tasks.workunit.client.0.smithi016.stderr: -100> 2024-09-12T17:19:50.170+0000 7f0224c859c0 4 Realm: () 2024-09-12T17:19:50.375 INFO:tasks.workunit.client.0.smithi016.stderr: -99> 2024-09-12T17:19:50.170+0000 7f0224c859c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:19:50.375 INFO:tasks.workunit.client.0.smithi016.stderr: -98> 2024-09-12T17:19:50.170+0000 7f0224c859c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:19:50.375 INFO:tasks.workunit.client.0.smithi016.stderr: -97> 2024-09-12T17:19:50.170+0000 7f0224c859c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:19:50.375 INFO:tasks.workunit.client.0.smithi016.stderr: -96> 2024-09-12T17:19:50.170+0000 7f0224c859c0 20 zonegroup default 2024-09-12T17:19:50.375 INFO:tasks.workunit.client.0.smithi016.stderr: -95> 2024-09-12T17:19:50.170+0000 7f0224c859c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.375 INFO:tasks.workunit.client.0.smithi016.stderr: -94> 2024-09-12T17:19:50.170+0000 7f0224c859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:50.376 INFO:tasks.workunit.client.0.smithi016.stderr: -93> 2024-09-12T17:19:50.170+0000 7f0224c859c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.376 INFO:tasks.workunit.client.0.smithi016.stderr: -92> 2024-09-12T17:19:50.170+0000 7f0224c859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:50.376 INFO:tasks.workunit.client.0.smithi016.stderr: -91> 2024-09-12T17:19:50.170+0000 7f0224c859c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.376 INFO:tasks.workunit.client.0.smithi016.stderr: -90> 2024-09-12T17:19:50.170+0000 7f0224c859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:50.376 INFO:tasks.workunit.client.0.smithi016.stderr: -89> 2024-09-12T17:19:50.170+0000 7f0224c859c0 20 started sync module instance, tier type = 2024-09-12T17:19:50.376 INFO:tasks.workunit.client.0.smithi016.stderr: -88> 2024-09-12T17:19:50.170+0000 7f0224c859c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:19:50.376 INFO:tasks.workunit.client.0.smithi016.stderr: -87> 2024-09-12T17:19:50.194+0000 7f0224c859c0 20 add_watcher() i=0 2024-09-12T17:19:50.376 INFO:tasks.workunit.client.0.smithi016.stderr: -86> 2024-09-12T17:19:50.194+0000 7f0224c859c0 20 add_watcher() i=1 2024-09-12T17:19:50.376 INFO:tasks.workunit.client.0.smithi016.stderr: -85> 2024-09-12T17:19:50.194+0000 7f0224c859c0 20 add_watcher() i=2 2024-09-12T17:19:50.376 INFO:tasks.workunit.client.0.smithi016.stderr: -84> 2024-09-12T17:19:50.194+0000 7f0224c859c0 20 add_watcher() i=3 2024-09-12T17:19:50.376 INFO:tasks.workunit.client.0.smithi016.stderr: -83> 2024-09-12T17:19:50.194+0000 7f0224c859c0 20 add_watcher() i=4 2024-09-12T17:19:50.376 INFO:tasks.workunit.client.0.smithi016.stderr: -82> 2024-09-12T17:19:50.194+0000 7f0224c859c0 20 add_watcher() i=5 2024-09-12T17:19:50.377 INFO:tasks.workunit.client.0.smithi016.stderr: -81> 2024-09-12T17:19:50.194+0000 7f0224c859c0 20 add_watcher() i=6 2024-09-12T17:19:50.377 INFO:tasks.workunit.client.0.smithi016.stderr: -80> 2024-09-12T17:19:50.194+0000 7f0224c859c0 20 add_watcher() i=7 2024-09-12T17:19:50.377 INFO:tasks.workunit.client.0.smithi016.stderr: -79> 2024-09-12T17:19:50.194+0000 7f0224c859c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:19:50.377 INFO:tasks.workunit.client.0.smithi016.stderr: -78> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814bd0) adding auth protocol: cephx 2024-09-12T17:19:50.377 INFO:tasks.workunit.client.0.smithi016.stderr: -77> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814bd0) adding auth protocol: cephx 2024-09-12T17:19:50.377 INFO:tasks.workunit.client.0.smithi016.stderr: -76> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814bd0) adding auth protocol: cephx 2024-09-12T17:19:50.377 INFO:tasks.workunit.client.0.smithi016.stderr: -75> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814bd0) adding con mode: secure 2024-09-12T17:19:50.377 INFO:tasks.workunit.client.0.smithi016.stderr: -74> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814bd0) adding con mode: crc 2024-09-12T17:19:50.377 INFO:tasks.workunit.client.0.smithi016.stderr: -73> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814bd0) adding con mode: secure 2024-09-12T17:19:50.377 INFO:tasks.workunit.client.0.smithi016.stderr: -72> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814bd0) adding con mode: crc 2024-09-12T17:19:50.377 INFO:tasks.workunit.client.0.smithi016.stderr: -71> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814bd0) adding con mode: secure 2024-09-12T17:19:50.378 INFO:tasks.workunit.client.0.smithi016.stderr: -70> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814bd0) adding con mode: crc 2024-09-12T17:19:50.378 INFO:tasks.workunit.client.0.smithi016.stderr: -69> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814bd0) adding con mode: crc 2024-09-12T17:19:50.378 INFO:tasks.workunit.client.0.smithi016.stderr: -68> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814bd0) adding con mode: secure 2024-09-12T17:19:50.378 INFO:tasks.workunit.client.0.smithi016.stderr: -67> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814bd0) adding con mode: crc 2024-09-12T17:19:50.378 INFO:tasks.workunit.client.0.smithi016.stderr: -66> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814bd0) adding con mode: secure 2024-09-12T17:19:50.378 INFO:tasks.workunit.client.0.smithi016.stderr: -65> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814bd0) adding con mode: crc 2024-09-12T17:19:50.378 INFO:tasks.workunit.client.0.smithi016.stderr: -64> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 AuthRegistry(0x7ffda9814bd0) adding con mode: secure 2024-09-12T17:19:50.378 INFO:tasks.workunit.client.0.smithi016.stderr: -63> 2024-09-12T17:19:50.198+0000 7f00d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:50.378 INFO:tasks.workunit.client.0.smithi016.stderr: -62> 2024-09-12T17:19:50.198+0000 7f0224c859c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:19:50.378 INFO:tasks.workunit.client.0.smithi016.stderr: -61> 2024-09-12T17:19:50.198+0000 7f0224c859c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:19:50.378 INFO:tasks.workunit.client.0.smithi016.stderr: -60> 2024-09-12T17:19:50.198+0000 7f0224c859c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:19:50.378 INFO:tasks.workunit.client.0.smithi016.stderr: -59> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 asok(0x555fa2b492b0) register_command cache list hook 0x555fa2e16b50 2024-09-12T17:19:50.379 INFO:tasks.workunit.client.0.smithi016.stderr: -58> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 asok(0x555fa2b492b0) register_command cache inspect hook 0x555fa2e16b50 2024-09-12T17:19:50.379 INFO:tasks.workunit.client.0.smithi016.stderr: -57> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 asok(0x555fa2b492b0) register_command cache erase hook 0x555fa2e16b50 2024-09-12T17:19:50.379 INFO:tasks.workunit.client.0.smithi016.stderr: -56> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 asok(0x555fa2b492b0) register_command cache zap hook 0x555fa2e16b50 2024-09-12T17:19:50.379 INFO:tasks.workunit.client.0.smithi016.stderr: -55> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 note: GC not initialized 2024-09-12T17:19:50.379 INFO:tasks.workunit.client.0.smithi016.stderr: -54> 2024-09-12T17:19:50.198+0000 7f00537fe640 20 reqs_thread_entry: start 2024-09-12T17:19:50.379 INFO:tasks.workunit.client.0.smithi016.stderr: -53> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 asok(0x555fa2b492b0) register_command sync trace show hook 0x7f021c076070 2024-09-12T17:19:50.379 INFO:tasks.workunit.client.0.smithi016.stderr: -52> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 asok(0x555fa2b492b0) register_command sync trace history hook 0x7f021c076070 2024-09-12T17:19:50.379 INFO:tasks.workunit.client.0.smithi016.stderr: -51> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 asok(0x555fa2b492b0) register_command sync trace active hook 0x7f021c076070 2024-09-12T17:19:50.379 INFO:tasks.workunit.client.0.smithi016.stderr: -50> 2024-09-12T17:19:50.198+0000 7f0224c859c0 5 asok(0x555fa2b492b0) register_command sync trace active_short hook 0x7f021c076070 2024-09-12T17:19:50.379 INFO:tasks.workunit.client.0.smithi016.stderr: -49> 2024-09-12T17:19:50.198+0000 7f0224c859c0 20 init_complete bucket index max shards: 1 2024-09-12T17:19:50.379 INFO:tasks.workunit.client.0.smithi016.stderr: -48> 2024-09-12T17:19:50.198+0000 7f0224c859c0 20 Filter name: none 2024-09-12T17:19:50.379 INFO:tasks.workunit.client.0.smithi016.stderr: -47> 2024-09-12T17:19:50.198+0000 7f00517fa640 20 reqs_thread_entry: start 2024-09-12T17:19:50.380 INFO:tasks.workunit.client.0.smithi016.stderr: -46> 2024-09-12T17:19:50.198+0000 7f0224c859c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T17:19:50.380 INFO:tasks.workunit.client.0.smithi016.stderr: -45> 2024-09-12T17:19:50.198+0000 7f0224c859c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.380 INFO:tasks.workunit.client.0.smithi016.stderr: -44> 2024-09-12T17:19:50.202+0000 7f0224c859c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:19:50.380 INFO:tasks.workunit.client.0.smithi016.stderr: -43> 2024-09-12T17:19:50.202+0000 7f0224c859c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T17:19:50.380 INFO:tasks.workunit.client.0.smithi016.stderr: -42> 2024-09-12T17:19:50.202+0000 7f0224c859c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T17:19:50.380 INFO:tasks.workunit.client.0.smithi016.stderr: -41> 2024-09-12T17:19:50.202+0000 7f0224c859c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 : miss 2024-09-12T17:19:50.380 INFO:tasks.workunit.client.0.smithi016.stderr: -40> 2024-09-12T17:19:50.202+0000 7f0224c859c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.380 INFO:tasks.workunit.client.0.smithi016.stderr: -39> 2024-09-12T17:19:50.202+0000 7f0224c859c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:19:50.380 INFO:tasks.workunit.client.0.smithi016.stderr: -38> 2024-09-12T17:19:50.202+0000 7f0224c859c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 info.flags=0x17 2024-09-12T17:19:50.380 INFO:tasks.workunit.client.0.smithi016.stderr: -37> 2024-09-12T17:19:50.202+0000 7f0224c859c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 to cache LRU end 2024-09-12T17:19:50.380 INFO:tasks.workunit.client.0.smithi016.stderr: -36> 2024-09-12T17:19:50.202+0000 7f0224c859c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:19:50.381 INFO:tasks.workunit.client.0.smithi016.stderr: -35> 2024-09-12T17:19:50.202+0000 7f0224c859c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:50.381 INFO:tasks.workunit.client.0.smithi016.stderr: -34> 2024-09-12T17:19:50.202+0000 7f0224c859c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 2024-09-12T17:19:50.381 INFO:tasks.workunit.client.0.smithi016.stderr: -33> 2024-09-12T17:19:50.210+0000 7f0224c859c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 info.flags=0x17 2024-09-12T17:19:50.381 INFO:tasks.workunit.client.0.smithi016.stderr: -32> 2024-09-12T17:19:50.210+0000 7f0224c859c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 to cache LRU end 2024-09-12T17:19:50.381 INFO:tasks.workunit.client.0.smithi016.stderr: -31> 2024-09-12T17:19:50.210+0000 7f0224c859c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:50.381 INFO:tasks.workunit.client.0.smithi016.stderr: -30> 2024-09-12T17:19:50.210+0000 7f0224c859c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32, ofs0, ns] 2024-09-12T17:19:50.381 INFO:tasks.workunit.client.0.smithi016.stderr: -29> 2024-09-12T17:19:50.214+0000 7f0105ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431601 cookie 93869243185312 notifier 7281 bl.length()=931 2024-09-12T17:19:50.381 INFO:tasks.workunit.client.0.smithi016.stderr: -28> 2024-09-12T17:19:50.214+0000 7f0105ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 info.flags=0x17 2024-09-12T17:19:50.381 INFO:tasks.workunit.client.0.smithi016.stderr: -27> 2024-09-12T17:19:50.214+0000 7f0105ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 to cache LRU end 2024-09-12T17:19:50.381 INFO:tasks.workunit.client.0.smithi016.stderr: -26> 2024-09-12T17:19:50.214+0000 7f0105ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:50.381 INFO:tasks.workunit.client.0.smithi016.stderr: -25> 2024-09-12T17:19:50.214+0000 7f0224c859c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32]): orig_sources= new_sources= 2024-09-12T17:19:50.381 INFO:tasks.workunit.client.0.smithi016.stderr: -24> 2024-09-12T17:19:50.214+0000 7f0224c859c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32]): potential sources added=[] removed=[] 2024-09-12T17:19:50.382 INFO:tasks.workunit.client.0.smithi016.stderr: -23> 2024-09-12T17:19:50.214+0000 7f0224c859c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32]): orig_dests= new_dests= 2024-09-12T17:19:50.382 INFO:tasks.workunit.client.0.smithi016.stderr: -22> 2024-09-12T17:19:50.214+0000 7f0224c859c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32]): potential dests added=[] removed=[] 2024-09-12T17:19:50.382 INFO:tasks.workunit.client.0.smithi016.stderr: -21> 2024-09-12T17:19:50.218+0000 7f0224c859c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32.1.0 2024-09-12T17:19:50.382 INFO:tasks.workunit.client.0.smithi016.stderr: -20> 2024-09-12T17:19:50.218+0000 7f0224c859c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32.1.0 2024-09-12T17:19:50.382 INFO:tasks.workunit.client.0.smithi016.stderr: -19> 2024-09-12T17:19:50.218+0000 7f0224c859c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32.1.1 2024-09-12T17:19:50.382 INFO:tasks.workunit.client.0.smithi016.stderr: -18> 2024-09-12T17:19:50.218+0000 7f0224c859c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32.1.1 2024-09-12T17:19:50.382 INFO:tasks.workunit.client.0.smithi016.stderr: -17> 2024-09-12T17:19:50.218+0000 7f0224c859c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32.0 2024-09-12T17:19:50.382 INFO:tasks.workunit.client.0.smithi016.stderr: -16> 2024-09-12T17:19:50.226+0000 7f0224c859c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 : hit (requested=0x17, cached=0x17) 2024-09-12T17:19:50.382 INFO:tasks.workunit.client.0.smithi016.stderr: -15> 2024-09-12T17:19:50.226+0000 7f0224c859c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 2024-09-12T17:19:50.382 INFO:tasks.workunit.client.0.smithi016.stderr: -14> 2024-09-12T17:19:50.230+0000 7f0224c859c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 info.flags=0x17 2024-09-12T17:19:50.382 INFO:tasks.workunit.client.0.smithi016.stderr: -13> 2024-09-12T17:19:50.230+0000 7f0224c859c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 to cache LRU end 2024-09-12T17:19:50.383 INFO:tasks.workunit.client.0.smithi016.stderr: -12> 2024-09-12T17:19:50.230+0000 7f0224c859c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:50.383 INFO:tasks.workunit.client.0.smithi016.stderr: -11> 2024-09-12T17:19:50.230+0000 7f0224c859c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32, ofs0, ns] 2024-09-12T17:19:50.383 INFO:tasks.workunit.client.0.smithi016.stderr: -10> 2024-09-12T17:19:50.230+0000 7f0105ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431602 cookie 93869243185312 notifier 7281 bl.length()=931 2024-09-12T17:19:50.383 INFO:tasks.workunit.client.0.smithi016.stderr: -9> 2024-09-12T17:19:50.230+0000 7f0105ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 info.flags=0x17 2024-09-12T17:19:50.383 INFO:tasks.workunit.client.0.smithi016.stderr: -8> 2024-09-12T17:19:50.230+0000 7f0105ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 to cache LRU end 2024-09-12T17:19:50.383 INFO:tasks.workunit.client.0.smithi016.stderr: -7> 2024-09-12T17:19:50.230+0000 7f0105ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:19:50.383 INFO:tasks.workunit.client.0.smithi016.stderr: -6> 2024-09-12T17:19:50.230+0000 7f0224c859c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32]): orig_sources= new_sources= 2024-09-12T17:19:50.383 INFO:tasks.workunit.client.0.smithi016.stderr: -5> 2024-09-12T17:19:50.230+0000 7f0224c859c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32]): potential sources added=[] removed=[] 2024-09-12T17:19:50.383 INFO:tasks.workunit.client.0.smithi016.stderr: -4> 2024-09-12T17:19:50.230+0000 7f0224c859c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32]): orig_dests= new_dests= 2024-09-12T17:19:50.383 INFO:tasks.workunit.client.0.smithi016.stderr: -3> 2024-09-12T17:19:50.230+0000 7f0224c859c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32]): potential dests added=[] removed=[] 2024-09-12T17:19:50.383 INFO:tasks.workunit.client.0.smithi016.stderr: -2> 2024-09-12T17:19:50.234+0000 7f0224c859c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32.0 2024-09-12T17:19:50.383 INFO:tasks.workunit.client.0.smithi016.stderr: -1> 2024-09-12T17:19:50.238+0000 7f0224c859c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0224c859c0 time 2024-09-12T17:19:50.237297+0000 2024-09-12T17:19:50.384 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:19:50.384 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:50.384 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:19:50.384 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f022855f2eb] 2024-09-12T17:19:50.384 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f022855f49f] 2024-09-12T17:19:50.384 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555fa04c00c1] 2024-09-12T17:19:50.384 INFO:tasks.workunit.client.0.smithi016.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x555fa04d2467] 2024-09-12T17:19:50.384 INFO:tasks.workunit.client.0.smithi016.stderr: 5: main() 2024-09-12T17:19:50.384 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f02273c5d90] 2024-09-12T17:19:50.384 INFO:tasks.workunit.client.0.smithi016.stderr: 7: __libc_start_main() 2024-09-12T17:19:50.384 INFO:tasks.workunit.client.0.smithi016.stderr: 8: _start() 2024-09-12T17:19:50.385 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:50.385 INFO:tasks.workunit.client.0.smithi016.stderr: 0> 2024-09-12T17:19:50.242+0000 7f0224c859c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:19:50.385 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7f0224c859c0 thread_name:radosgw-admin 2024-09-12T17:19:50.385 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:50.385 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:19:50.385 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f02273de520] 2024-09-12T17:19:50.385 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:19:50.385 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:19:50.385 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:19:50.385 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f022855f345] 2024-09-12T17:19:50.385 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f022855f49f] 2024-09-12T17:19:50.385 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555fa04c00c1] 2024-09-12T17:19:50.386 INFO:tasks.workunit.client.0.smithi016.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x555fa04d2467] 2024-09-12T17:19:50.386 INFO:tasks.workunit.client.0.smithi016.stderr: 9: main() 2024-09-12T17:19:50.386 INFO:tasks.workunit.client.0.smithi016.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f02273c5d90] 2024-09-12T17:19:50.386 INFO:tasks.workunit.client.0.smithi016.stderr: 11: __libc_start_main() 2024-09-12T17:19:50.386 INFO:tasks.workunit.client.0.smithi016.stderr: 12: _start() 2024-09-12T17:19:50.386 INFO:tasks.workunit.client.0.smithi016.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:19:50.386 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:50.386 INFO:tasks.workunit.client.0.smithi016.stderr:--- logging levels --- 2024-09-12T17:19:50.386 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 none 2024-09-12T17:19:50.386 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 lockdep 2024-09-12T17:19:50.386 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 context 2024-09-12T17:19:50.386 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 crush 2024-09-12T17:19:50.387 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds 2024-09-12T17:19:50.387 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_balancer 2024-09-12T17:19:50.387 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_locker 2024-09-12T17:19:50.387 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log 2024-09-12T17:19:50.387 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log_expire 2024-09-12T17:19:50.387 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_migrator 2024-09-12T17:19:50.387 INFO:tasks.workunit.client.0.smithi016.stderr: 3/ 5 mds_quiesce 2024-09-12T17:19:50.387 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 buffer 2024-09-12T17:19:50.387 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 timer 2024-09-12T17:19:50.387 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 filer 2024-09-12T17:19:50.387 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 striper 2024-09-12T17:19:50.387 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 objecter 2024-09-12T17:19:50.388 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rados 2024-09-12T17:19:50.388 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd 2024-09-12T17:19:50.388 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_mirror 2024-09-12T17:19:50.388 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_replay 2024-09-12T17:19:50.388 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_pwl 2024-09-12T17:19:50.388 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 journaler 2024-09-12T17:19:50.388 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objectcacher 2024-09-12T17:19:50.388 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:19:50.388 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 client 2024-09-12T17:19:50.388 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 osd 2024-09-12T17:19:50.388 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 optracker 2024-09-12T17:19:50.389 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objclass 2024-09-12T17:19:50.389 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 filestore 2024-09-12T17:19:50.389 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 journal 2024-09-12T17:19:50.389 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 ms 2024-09-12T17:19:50.389 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mon 2024-09-12T17:19:50.389 INFO:tasks.workunit.client.0.smithi016.stderr: 0/10 monc 2024-09-12T17:19:50.389 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 paxos 2024-09-12T17:19:50.389 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 tp 2024-09-12T17:19:50.389 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 auth 2024-09-12T17:19:50.389 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 crypto 2024-09-12T17:19:50.389 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 finisher 2024-09-12T17:19:50.389 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 reserver 2024-09-12T17:19:50.389 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 heartbeatmap 2024-09-12T17:19:50.390 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 perfcounter 2024-09-12T17:19:50.390 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw 2024-09-12T17:19:50.390 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_sync 2024-09-12T17:19:50.390 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_datacache 2024-09-12T17:19:50.390 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_access 2024-09-12T17:19:50.390 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:19:50.390 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_flight 2024-09-12T17:19:50.390 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:19:50.390 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw_notification 2024-09-12T17:19:50.390 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 javaclient 2024-09-12T17:19:50.390 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 asok 2024-09-12T17:19:50.390 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 throttle 2024-09-12T17:19:50.391 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 refs 2024-09-12T17:19:50.391 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 compressor 2024-09-12T17:19:50.391 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluestore 2024-09-12T17:19:50.391 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluefs 2024-09-12T17:19:50.391 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 bdev 2024-09-12T17:19:50.391 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 kstore 2024-09-12T17:19:50.391 INFO:tasks.workunit.client.0.smithi016.stderr: 4/ 5 rocksdb 2024-09-12T17:19:50.391 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 fuse 2024-09-12T17:19:50.391 INFO:tasks.workunit.client.0.smithi016.stderr: 2/ 5 mgr 2024-09-12T17:19:50.391 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mgrc 2024-09-12T17:19:50.391 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 dpdk 2024-09-12T17:19:50.391 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 eventtrace 2024-09-12T17:19:50.392 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 prioritycache 2024-09-12T17:19:50.392 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 test 2024-09-12T17:19:50.392 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:19:50.392 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephsqlite 2024-09-12T17:19:50.392 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:19:50.392 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore 2024-09-12T17:19:50.392 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_onode 2024-09-12T17:19:50.392 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_odata 2024-09-12T17:19:50.392 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_omap 2024-09-12T17:19:50.392 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_tm 2024-09-12T17:19:50.392 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_t 2024-09-12T17:19:50.392 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:19:50.393 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_epm 2024-09-12T17:19:50.393 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_lba 2024-09-12T17:19:50.393 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:19:50.393 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cache 2024-09-12T17:19:50.393 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_journal 2024-09-12T17:19:50.393 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_device 2024-09-12T17:19:50.393 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_backref 2024-09-12T17:19:50.393 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 alienstore 2024-09-12T17:19:50.393 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mclock 2024-09-12T17:19:50.393 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cyanstore 2024-09-12T17:19:50.393 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 ceph_exporter 2024-09-12T17:19:50.393 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 memstore 2024-09-12T17:19:50.394 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 trace 2024-09-12T17:19:50.394 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 ceph_dedup 2024-09-12T17:19:50.394 INFO:tasks.workunit.client.0.smithi016.stderr: -2/-2 (syslog threshold) 2024-09-12T17:19:50.394 INFO:tasks.workunit.client.0.smithi016.stderr: 99/99 (stderr threshold) 2024-09-12T17:19:50.394 INFO:tasks.workunit.client.0.smithi016.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:19:50.394 INFO:tasks.workunit.client.0.smithi016.stderr: 7f00517fa640 / http_manager 2024-09-12T17:19:50.394 INFO:tasks.workunit.client.0.smithi016.stderr: 7f00537fe640 / http_manager 2024-09-12T17:19:50.394 INFO:tasks.workunit.client.0.smithi016.stderr: 7f00d8fe1640 / rgw_dt_lg_renew 2024-09-12T17:19:50.394 INFO:tasks.workunit.client.0.smithi016.stderr: 7f00f3fff640 / ms_dispatch 2024-09-12T17:19:50.394 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0105ffb640 / io_context_pool 2024-09-12T17:19:50.394 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0107fff640 / ms_dispatch 2024-09-12T17:19:50.394 INFO:tasks.workunit.client.0.smithi016.stderr: 7f010ee05640 / ms_dispatch 2024-09-12T17:19:50.395 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0110608640 / io_context_pool 2024-09-12T17:19:50.395 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0221f8a640 / msgr-worker-2 2024-09-12T17:19:50.395 INFO:tasks.workunit.client.0.smithi016.stderr: 7f022278b640 / msgr-worker-1 2024-09-12T17:19:50.395 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0222f8c640 / msgr-worker-0 2024-09-12T17:19:50.395 INFO:tasks.workunit.client.0.smithi016.stderr: 7f022378d640 / io_context_pool 2024-09-12T17:19:50.395 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0224c859c0 / radosgw-admin 2024-09-12T17:19:50.395 INFO:tasks.workunit.client.0.smithi016.stderr: max_recent 500 2024-09-12T17:19:50.395 INFO:tasks.workunit.client.0.smithi016.stderr: max_new 1000 2024-09-12T17:19:50.395 INFO:tasks.workunit.client.0.smithi016.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:19:50.243058Z_1b8a5484-de6b-4c72-8ca9-130a9de0ce1e/log 2024-09-12T17:19:50.395 INFO:tasks.workunit.client.0.smithi016.stderr:--- end dump of recent events --- 2024-09-12T17:19:50.395 INFO:tasks.workunit.client.0.smithi016.stderr:Aborted 2024-09-12T17:19:50.395 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T17:19:50.397 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:19:50.397 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:19:50.397 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.338+0000 7f22ae13e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.397 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.338+0000 7f22ae13e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:50.397 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.338+0000 7f22ae13e9c0 20 realm 2024-09-12T17:19:50.397 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.338+0000 7f22ae13e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.398 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.338+0000 7f22ae13e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:50.398 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.338+0000 7f22ae13e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:19:50.398 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.338+0000 7f22ae13e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.398 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.338+0000 7f22ae13e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:50.398 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.338+0000 7f22ae13e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.398 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.342+0000 7f22ae13e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:50.398 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.342+0000 7f22ae13e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.398 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.342+0000 7f22ae13e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:19:50.398 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.342+0000 7f22ae13e9c0 20 searching for the correct realm 2024-09-12T17:19:50.398 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.346+0000 7f22ac445640 0 -- 172.21.15.16:0/2779856888 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f2294008040 msgr2=0x7f2294090ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:19:50.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.562+0000 7f22a3443640 0 -- 172.21.15.16:0/2779856888 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f22a4111070 msgr2=0x7f22a4119420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:19:50.780 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.778+0000 7f22ae13e9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:19:50.780 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.778+0000 7f22ae13e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:19:50.780 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.778+0000 7f22ae13e9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:19:50.780 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.778+0000 7f22ae13e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:19:50.781 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.778+0000 7f22ae13e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:19:50.781 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.778+0000 7f22ae13e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:19:50.781 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.778+0000 7f22ae13e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.781 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.782+0000 7f22ae13e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:50.781 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.782+0000 7f22ae13e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.781 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.782+0000 7f22ae13e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:19:50.781 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.782+0000 7f22ae13e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.782 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.782+0000 7f22ae13e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:19:50.782 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.782+0000 7f22ae13e9c0 20 zone default found 2024-09-12T17:19:50.782 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.782+0000 7f22ae13e9c0 4 Realm: () 2024-09-12T17:19:50.782 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.782+0000 7f22ae13e9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:19:50.783 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.782+0000 7f22ae13e9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:19:50.783 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.782+0000 7f22ae13e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:19:50.783 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.782+0000 7f22ae13e9c0 20 zonegroup default 2024-09-12T17:19:50.783 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.782+0000 7f22ae13e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.783 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.782+0000 7f22ae13e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:50.783 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.782+0000 7f22ae13e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.784 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.782+0000 7f22ae13e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:50.784 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.782+0000 7f22ae13e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.784 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.786+0000 7f22ae13e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:19:50.784 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.786+0000 7f22ae13e9c0 20 started sync module instance, tier type = 2024-09-12T17:19:50.784 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.786+0000 7f22ae13e9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:19:50.807 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.806+0000 7f22ae13e9c0 20 add_watcher() i=0 2024-09-12T17:19:50.807 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.806+0000 7f22ae13e9c0 20 add_watcher() i=1 2024-09-12T17:19:50.807 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.806+0000 7f22ae13e9c0 20 add_watcher() i=2 2024-09-12T17:19:50.808 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.806+0000 7f22ae13e9c0 20 add_watcher() i=3 2024-09-12T17:19:50.808 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.806+0000 7f22ae13e9c0 20 add_watcher() i=4 2024-09-12T17:19:50.808 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.806+0000 7f22ae13e9c0 20 add_watcher() i=5 2024-09-12T17:19:50.808 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.806+0000 7f22ae13e9c0 20 add_watcher() i=6 2024-09-12T17:19:50.809 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.810+0000 7f22ae13e9c0 20 add_watcher() i=7 2024-09-12T17:19:50.809 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.810+0000 7f22ae13e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:19:50.813 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.814+0000 7f2161fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:50.814 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.814+0000 7f22ae13e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:19:50.814 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.814+0000 7f22ae13e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:19:50.814 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.814+0000 7f22ae13e9c0 5 note: GC not initialized 2024-09-12T17:19:50.814 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.814+0000 7f2160fe1640 20 reqs_thread_entry: start 2024-09-12T17:19:50.815 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.814+0000 7f22ae13e9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:19:50.815 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.814+0000 7f22ae13e9c0 20 Filter name: none 2024-09-12T17:19:50.815 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.814+0000 7f20da7fc640 20 reqs_thread_entry: start 2024-09-12T17:19:50.815 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.814+0000 7f22ae13e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.815 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.814+0000 7f22ae13e9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:19:50.815 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.814+0000 7f22ae13e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.817 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.818+0000 7f22ae13e9c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T17:19:50.817 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.818+0000 7f22ae13e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:19:50.817 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.818+0000 7f22ae13e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.817 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.818+0000 7f22ae13e9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:19:50.817 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.818+0000 7f22ae13e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:19:50.818 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.818+0000 7f22ae13e9c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T17:19:50.818 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.818+0000 7f22ae13e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:19:50.820 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.822+0000 7f2161fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:19:50.826 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.826+0000 7f22ae13e9c0 20 remove_watcher() i=0 2024-09-12T17:19:50.826 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.826+0000 7f22ae13e9c0 2 removed watcher, disabling cache 2024-09-12T17:19:50.828 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.830+0000 7f22ae13e9c0 20 remove_watcher() i=1 2024-09-12T17:19:50.831 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.830+0000 7f22ae13e9c0 20 remove_watcher() i=2 2024-09-12T17:19:50.833 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.834+0000 7f22ae13e9c0 20 remove_watcher() i=3 2024-09-12T17:19:50.836 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.834+0000 7f22ae13e9c0 20 remove_watcher() i=4 2024-09-12T17:19:50.837 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.838+0000 7f22ae13e9c0 20 remove_watcher() i=5 2024-09-12T17:19:50.838 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.838+0000 7f22ae13e9c0 20 remove_watcher() i=6 2024-09-12T17:19:50.840 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:19:50.842+0000 7f22ae13e9c0 20 remove_watcher() i=7 2024-09-12T17:19:50.856 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:19:50.856 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:19:50.856 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: abort-at-commit-target-layout id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:19:50.856 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:20.978 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:20:21.017 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:20:21.017 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:20:21.065 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.066+0000 7feff417b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:21.067 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.066+0000 7feff417b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:21.067 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.066+0000 7feff417b9c0 20 realm 2024-09-12T17:20:21.067 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.066+0000 7feff417b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:21.067 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.066+0000 7feff417b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:21.067 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.066+0000 7feff417b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:20:21.067 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.066+0000 7feff417b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:21.067 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.066+0000 7feff417b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:21.068 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.066+0000 7feff417b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:21.069 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.070+0000 7feff417b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:20:21.069 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.070+0000 7feff417b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:21.071 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.070+0000 7feff417b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:20:21.071 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.070+0000 7feff417b9c0 20 searching for the correct realm 2024-09-12T17:20:21.074 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.074+0000 7feff2482640 0 -- 172.21.15.16:0/2430732778 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fefe4065210 msgr2=0x7fefe407fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:20:21.290 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.290+0000 7feff1480640 0 -- 172.21.15.16:0/2430732778 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fefec063970 msgr2=0x7fefec064990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:20:21.509 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.510+0000 7feff417b9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:20:21.509 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.510+0000 7feff417b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:20:21.509 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.510+0000 7feff417b9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:20:21.509 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.510+0000 7feff417b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:20:21.509 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.510+0000 7feff417b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:20:21.509 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.510+0000 7feff417b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:20:21.509 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.510+0000 7feff417b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:21.510 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.510+0000 7feff417b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:21.510 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.510+0000 7feff417b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:21.510 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.510+0000 7feff417b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:20:21.510 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.510+0000 7feff417b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:21.511 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.510+0000 7feff417b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:20:21.511 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.510+0000 7feff417b9c0 20 zone default found 2024-09-12T17:20:21.511 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.510+0000 7feff417b9c0 4 Realm: () 2024-09-12T17:20:21.511 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.510+0000 7feff417b9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:20:21.511 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.510+0000 7feff417b9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:20:21.512 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.510+0000 7feff417b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:20:21.512 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.510+0000 7feff417b9c0 20 zonegroup default 2024-09-12T17:20:21.512 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.510+0000 7feff417b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:21.512 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.510+0000 7feff417b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:21.512 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.510+0000 7feff417b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:21.513 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.514+0000 7feff417b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:21.513 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.514+0000 7feff417b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:21.513 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.514+0000 7feff417b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:21.514 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.514+0000 7feff417b9c0 20 started sync module instance, tier type = 2024-09-12T17:20:21.514 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.514+0000 7feff417b9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:20:21.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.538+0000 7feff417b9c0 20 add_watcher() i=0 2024-09-12T17:20:21.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.538+0000 7feff417b9c0 20 add_watcher() i=1 2024-09-12T17:20:21.539 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.538+0000 7feff417b9c0 20 add_watcher() i=2 2024-09-12T17:20:21.539 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.538+0000 7feff417b9c0 20 add_watcher() i=3 2024-09-12T17:20:21.539 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.538+0000 7feff417b9c0 20 add_watcher() i=4 2024-09-12T17:20:21.539 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.538+0000 7feff417b9c0 20 add_watcher() i=5 2024-09-12T17:20:21.539 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.538+0000 7feff417b9c0 20 add_watcher() i=6 2024-09-12T17:20:21.541 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.542+0000 7feff417b9c0 20 add_watcher() i=7 2024-09-12T17:20:21.541 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.542+0000 7feff417b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:20:21.545 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.546+0000 7feea37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:20:21.546 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.546+0000 7feff417b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:20:21.546 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.546+0000 7feff417b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:20:21.546 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.546+0000 7feff417b9c0 5 note: GC not initialized 2024-09-12T17:20:21.547 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.546+0000 7feea27fc640 20 reqs_thread_entry: start 2024-09-12T17:20:21.547 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.546+0000 7feff417b9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:20:21.547 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.546+0000 7feff417b9c0 20 Filter name: none 2024-09-12T17:20:21.548 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.546+0000 7fee13fff640 20 reqs_thread_entry: start 2024-09-12T17:20:21.548 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.546+0000 7feff417b9c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T17:20:21.548 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.546+0000 7feff417b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:21.549 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.550+0000 7feff417b9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:20:21.549 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.550+0000 7feff417b9c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T17:20:21.549 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.550+0000 7feff417b9c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T17:20:21.549 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.550+0000 7feff417b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 : miss 2024-09-12T17:20:21.549 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.550+0000 7feff417b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:21.550 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.550+0000 7feff417b9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:20:21.550 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.550+0000 7feff417b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 info.flags=0x17 2024-09-12T17:20:21.550 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.550+0000 7feff417b9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 to cache LRU end 2024-09-12T17:20:21.550 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.550+0000 7feff417b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:20:21.550 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.550+0000 7feff417b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:20:21.550 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.550+0000 7feff417b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 2024-09-12T17:20:21.560 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.558+0000 7feff417b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 info.flags=0x17 2024-09-12T17:20:21.560 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.558+0000 7feff417b9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 to cache LRU end 2024-09-12T17:20:21.560 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.558+0000 7feff417b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:20:21.560 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.558+0000 7feff417b9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32, ofs0, ns] 2024-09-12T17:20:21.560 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.562+0000 7feed57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431604 cookie 94052118508480 notifier 7320 bl.length()=931 2024-09-12T17:20:21.560 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.562+0000 7feed57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 info.flags=0x17 2024-09-12T17:20:21.561 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.562+0000 7feed57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 to cache LRU end 2024-09-12T17:20:21.561 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.562+0000 7feed57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:20:21.561 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.562+0000 7feff417b9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32]): orig_sources= new_sources= 2024-09-12T17:20:21.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.562+0000 7feff417b9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32]): potential sources added=[] removed=[] 2024-09-12T17:20:21.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.562+0000 7feff417b9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32]): orig_dests= new_dests= 2024-09-12T17:20:21.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.562+0000 7feff417b9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32]): potential dests added=[] removed=[] 2024-09-12T17:20:21.568 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.566+0000 7feff417b9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32.1.0 2024-09-12T17:20:21.568 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.566+0000 7feff417b9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32.1.0 2024-09-12T17:20:21.568 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.566+0000 7feff417b9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32.1.1 2024-09-12T17:20:21.568 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.566+0000 7feff417b9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32.1.1 2024-09-12T17:20:21.568 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.566+0000 7feff417b9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32.0 2024-09-12T17:20:21.575 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.574+0000 7feff417b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 : hit (requested=0x17, cached=0x17) 2024-09-12T17:20:21.575 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.574+0000 7feff417b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 2024-09-12T17:20:21.578 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.578+0000 7feff417b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 info.flags=0x17 2024-09-12T17:20:21.578 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.578+0000 7feff417b9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 to cache LRU end 2024-09-12T17:20:21.578 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.578+0000 7feff417b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:20:21.579 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.578+0000 7feff417b9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32, ofs0, ns] 2024-09-12T17:20:21.579 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.578+0000 7feed57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431605 cookie 94052118508480 notifier 7320 bl.length()=931 2024-09-12T17:20:21.579 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.578+0000 7feed57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 info.flags=0x17 2024-09-12T17:20:21.579 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.578+0000 7feed57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 to cache LRU end 2024-09-12T17:20:21.579 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.578+0000 7feed57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:20:21.580 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.582+0000 7feff417b9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32]): orig_sources= new_sources= 2024-09-12T17:20:21.580 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.582+0000 7feff417b9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32]): potential sources added=[] removed=[] 2024-09-12T17:20:21.580 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.582+0000 7feff417b9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32]): orig_dests= new_dests= 2024-09-12T17:20:21.580 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.582+0000 7feff417b9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32]): potential dests added=[] removed=[] 2024-09-12T17:20:21.583 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.582+0000 7feff417b9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32.0 2024-09-12T17:20:21.584 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.586+0000 7feff417b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 : hit (requested=0x17, cached=0x17) 2024-09-12T17:20:21.584 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.586+0000 7feff417b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 2024-09-12T17:20:21.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.586+0000 7feff417b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 info.flags=0x17 2024-09-12T17:20:21.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.586+0000 7feff417b9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 to cache LRU end 2024-09-12T17:20:21.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.586+0000 7feff417b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:20:21.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.586+0000 7feff417b9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32, ofs0, ns] 2024-09-12T17:20:21.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.590+0000 7feed57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431606 cookie 94052118508480 notifier 7320 bl.length()=899 2024-09-12T17:20:21.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.590+0000 7feed57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 info.flags=0x17 2024-09-12T17:20:21.589 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.590+0000 7feed57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 to cache LRU end 2024-09-12T17:20:21.589 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.590+0000 7feed57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:20:21.589 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.590+0000 7feff417b9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32]): orig_sources= new_sources= 2024-09-12T17:20:21.589 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.590+0000 7feff417b9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32]): potential sources added=[] removed=[] 2024-09-12T17:20:21.590 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.590+0000 7feff417b9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32]): orig_dests= new_dests= 2024-09-12T17:20:21.590 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.590+0000 7feff417b9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32]): potential dests added=[] removed=[] 2024-09-12T17:20:21.592 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.594+0000 7feff417b9c0 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T17:20:21.597 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.598+0000 7feea37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:20:21.602 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.602+0000 7feff417b9c0 20 remove_watcher() i=0 2024-09-12T17:20:21.602 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.602+0000 7feff417b9c0 2 removed watcher, disabling cache 2024-09-12T17:20:21.604 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.606+0000 7feff417b9c0 20 remove_watcher() i=1 2024-09-12T17:20:21.607 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.606+0000 7feff417b9c0 20 remove_watcher() i=2 2024-09-12T17:20:21.609 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.610+0000 7feff417b9c0 20 remove_watcher() i=3 2024-09-12T17:20:21.612 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.614+0000 7feff417b9c0 20 remove_watcher() i=4 2024-09-12T17:20:21.617 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.614+0000 7feff417b9c0 20 remove_watcher() i=5 2024-09-12T17:20:21.617 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.618+0000 7feff417b9c0 20 remove_watcher() i=6 2024-09-12T17:20:21.618 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.618+0000 7feff417b9c0 20 remove_watcher() i=7 2024-09-12T17:20:21.636 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T17:20:21.669 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:20:21.669 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:20:21.716 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.718+0000 7f5207f4a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:21.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.718+0000 7f5207f4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:21.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.718+0000 7f5207f4a9c0 20 realm 2024-09-12T17:20:21.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.718+0000 7f5207f4a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:21.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.718+0000 7f5207f4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:21.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.718+0000 7f5207f4a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:20:21.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.718+0000 7f5207f4a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:21.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.718+0000 7f5207f4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:21.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.718+0000 7f5207f4a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:21.720 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.722+0000 7f5207f4a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:20:21.720 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.722+0000 7f5207f4a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:21.722 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.722+0000 7f5207f4a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:20:21.722 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.722+0000 7f5207f4a9c0 20 searching for the correct realm 2024-09-12T17:20:21.723 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.722+0000 7f520524f640 0 -- 172.21.15.16:0/732289585 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7f51f0002350 msgr2=0x7f51f805c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:20:21.936 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.934+0000 7f5206251640 0 -- 172.21.15.16:0/732289585 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f51fc1064f0 msgr2=0x7f51fc0fc3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:20:21.955 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.954+0000 7f5207f4a9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:20:21.955 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.954+0000 7f5207f4a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:20:21.955 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.954+0000 7f5207f4a9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:20:21.955 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.954+0000 7f5207f4a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:20:21.955 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.954+0000 7f5207f4a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:20:21.955 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.954+0000 7f5207f4a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:20:21.955 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.954+0000 7f5207f4a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:21.955 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.954+0000 7f5207f4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:21.955 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.954+0000 7f5207f4a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:21.956 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.954+0000 7f5207f4a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:20:21.956 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.954+0000 7f5207f4a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:21.957 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.958+0000 7f5207f4a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:20:21.957 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.958+0000 7f5207f4a9c0 20 zone default found 2024-09-12T17:20:21.957 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.958+0000 7f5207f4a9c0 4 Realm: () 2024-09-12T17:20:21.957 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.958+0000 7f5207f4a9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:20:21.957 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.958+0000 7f5207f4a9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:20:21.957 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.958+0000 7f5207f4a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:20:21.957 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.958+0000 7f5207f4a9c0 20 zonegroup default 2024-09-12T17:20:21.957 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.958+0000 7f5207f4a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:21.958 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.958+0000 7f5207f4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:21.958 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.958+0000 7f5207f4a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:21.959 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.958+0000 7f5207f4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:21.959 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.958+0000 7f5207f4a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:21.959 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.958+0000 7f5207f4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:21.959 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.958+0000 7f5207f4a9c0 20 started sync module instance, tier type = 2024-09-12T17:20:21.959 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.958+0000 7f5207f4a9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:20:21.982 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.982+0000 7f5207f4a9c0 20 add_watcher() i=0 2024-09-12T17:20:21.982 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.982+0000 7f5207f4a9c0 20 add_watcher() i=1 2024-09-12T17:20:21.982 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.982+0000 7f5207f4a9c0 20 add_watcher() i=2 2024-09-12T17:20:21.982 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.982+0000 7f5207f4a9c0 20 add_watcher() i=3 2024-09-12T17:20:21.982 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.982+0000 7f5207f4a9c0 20 add_watcher() i=4 2024-09-12T17:20:21.983 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.982+0000 7f5207f4a9c0 20 add_watcher() i=5 2024-09-12T17:20:21.983 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.982+0000 7f5207f4a9c0 20 add_watcher() i=6 2024-09-12T17:20:21.985 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.986+0000 7f5207f4a9c0 20 add_watcher() i=7 2024-09-12T17:20:21.985 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.986+0000 7f5207f4a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:20:21.989 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.990+0000 7f50b77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:20:21.990 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.990+0000 7f5207f4a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:20:21.990 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.990+0000 7f5207f4a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:20:21.990 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.990+0000 7f5207f4a9c0 5 note: GC not initialized 2024-09-12T17:20:21.990 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.990+0000 7f50b67fc640 20 reqs_thread_entry: start 2024-09-12T17:20:21.990 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.990+0000 7f5207f4a9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:20:21.990 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.990+0000 7f5207f4a9c0 20 Filter name: none 2024-09-12T17:20:21.991 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.990+0000 7f5027fff640 20 reqs_thread_entry: start 2024-09-12T17:20:21.991 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.990+0000 7f5207f4a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:21.991 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.990+0000 7f5207f4a9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:20:21.992 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.990+0000 7f5207f4a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:21.993 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.994+0000 7f5207f4a9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:20:21.993 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.994+0000 7f5207f4a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:20:21.993 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.994+0000 7f5207f4a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:21.993 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.994+0000 7f5207f4a9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:20:21.993 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.994+0000 7f5207f4a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:21.994 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.994+0000 7f5207f4a9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:20:21.994 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.994+0000 7f5207f4a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:20:21.997 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:21.998+0000 7f50b77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:20:22.003 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.002+0000 7f5207f4a9c0 20 remove_watcher() i=0 2024-09-12T17:20:22.003 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.002+0000 7f5207f4a9c0 2 removed watcher, disabling cache 2024-09-12T17:20:22.005 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.006+0000 7f5207f4a9c0 20 remove_watcher() i=1 2024-09-12T17:20:22.007 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.006+0000 7f5207f4a9c0 20 remove_watcher() i=2 2024-09-12T17:20:22.009 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.010+0000 7f5207f4a9c0 20 remove_watcher() i=3 2024-09-12T17:20:22.012 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.010+0000 7f5207f4a9c0 20 remove_watcher() i=4 2024-09-12T17:20:22.014 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.014+0000 7f5207f4a9c0 20 remove_watcher() i=5 2024-09-12T17:20:22.015 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.014+0000 7f5207f4a9c0 20 remove_watcher() i=6 2024-09-12T17:20:22.016 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.018+0000 7f5207f4a9c0 20 remove_watcher() i=7 2024-09-12T17:20:22.035 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:22.035 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:20:22.035 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: abort-at-commit-target-layout id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:20:22.035 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:22.115 INFO:tasks.workunit.client.0.smithi016.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-09-12T17:20:22.115 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:22.628 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T17:20:22.662 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:20:22.662 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:20:22.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.710+0000 7f354e28d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:22.711 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.710+0000 7f354e28d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:22.711 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.710+0000 7f354e28d9c0 20 realm 2024-09-12T17:20:22.712 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.710+0000 7f354e28d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:22.712 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.710+0000 7f354e28d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:22.712 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.710+0000 7f354e28d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:20:22.712 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.710+0000 7f354e28d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:22.712 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.710+0000 7f354e28d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:22.712 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.710+0000 7f354e28d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:22.713 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.714+0000 7f354e28d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:20:22.713 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.714+0000 7f354e28d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:22.715 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.714+0000 7f354e28d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:20:22.715 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.714+0000 7f354e28d9c0 20 searching for the correct realm 2024-09-12T17:20:22.721 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.718+0000 7f354c594640 0 -- 172.21.15.16:0/3169027608 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f3540089c20 msgr2=0x7f3540016450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:20:22.726 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.726+0000 7f354b592640 0 -- 172.21.15.16:0/3169027608 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f3544081130 msgr2=0x7f354408f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:20:22.944 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.942+0000 7f354e28d9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:20:22.944 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.942+0000 7f354e28d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:20:22.944 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.942+0000 7f354e28d9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:20:22.944 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.942+0000 7f354e28d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:20:22.944 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.942+0000 7f354e28d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:20:22.944 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.942+0000 7f354e28d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:20:22.945 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.942+0000 7f354e28d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:22.945 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.946+0000 7f354e28d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:22.945 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.946+0000 7f354e28d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:22.945 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.946+0000 7f354e28d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:20:22.945 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.946+0000 7f354e28d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:22.947 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.946+0000 7f354e28d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:20:22.947 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.946+0000 7f354e28d9c0 20 zone default found 2024-09-12T17:20:22.947 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.946+0000 7f354e28d9c0 4 Realm: () 2024-09-12T17:20:22.947 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.946+0000 7f354e28d9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:20:22.947 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.946+0000 7f354e28d9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:20:22.947 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.946+0000 7f354e28d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:20:22.947 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.946+0000 7f354e28d9c0 20 zonegroup default 2024-09-12T17:20:22.947 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.946+0000 7f354e28d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:22.948 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.946+0000 7f354e28d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:22.948 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.946+0000 7f354e28d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:22.948 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.950+0000 7f354e28d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:22.948 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.950+0000 7f354e28d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:22.949 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.950+0000 7f354e28d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:22.949 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.950+0000 7f354e28d9c0 20 started sync module instance, tier type = 2024-09-12T17:20:22.949 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.950+0000 7f354e28d9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:20:22.973 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.974+0000 7f354e28d9c0 20 add_watcher() i=0 2024-09-12T17:20:22.973 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.974+0000 7f354e28d9c0 20 add_watcher() i=1 2024-09-12T17:20:22.973 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.974+0000 7f354e28d9c0 20 add_watcher() i=2 2024-09-12T17:20:22.973 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.974+0000 7f354e28d9c0 20 add_watcher() i=3 2024-09-12T17:20:22.973 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.974+0000 7f354e28d9c0 20 add_watcher() i=4 2024-09-12T17:20:22.974 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.974+0000 7f354e28d9c0 20 add_watcher() i=5 2024-09-12T17:20:22.974 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.974+0000 7f354e28d9c0 20 add_watcher() i=6 2024-09-12T17:20:22.975 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.974+0000 7f354e28d9c0 20 add_watcher() i=7 2024-09-12T17:20:22.975 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.974+0000 7f354e28d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:20:22.980 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.978+0000 7f3401fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:20:22.980 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.982+0000 7f354e28d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:20:22.981 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.982+0000 7f354e28d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:20:22.981 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.982+0000 7f354e28d9c0 5 note: GC not initialized 2024-09-12T17:20:22.981 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.982+0000 7f3400fe1640 20 reqs_thread_entry: start 2024-09-12T17:20:22.981 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.982+0000 7f354e28d9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:20:22.982 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.982+0000 7f354e28d9c0 20 Filter name: none 2024-09-12T17:20:22.982 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.982+0000 7f337a7fc640 20 reqs_thread_entry: start 2024-09-12T17:20:22.982 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.982+0000 7f354e28d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:22.983 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.982+0000 7f354e28d9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:20:22.983 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.982+0000 7f354e28d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:22.984 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.982+0000 7f354e28d9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:20:22.984 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.982+0000 7f354e28d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:20:22.984 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.986+0000 7f354e28d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:22.985 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.986+0000 7f354e28d9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:20:22.985 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.986+0000 7f354e28d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:22.985 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.986+0000 7f354e28d9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:20:22.985 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.986+0000 7f354e28d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:20:22.987 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.986+0000 7f3401fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:20:22.993 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.994+0000 7f354e28d9c0 20 remove_watcher() i=0 2024-09-12T17:20:22.993 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.994+0000 7f354e28d9c0 2 removed watcher, disabling cache 2024-09-12T17:20:22.996 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.998+0000 7f354e28d9c0 20 remove_watcher() i=1 2024-09-12T17:20:22.999 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:22.998+0000 7f354e28d9c0 20 remove_watcher() i=2 2024-09-12T17:20:23.001 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.002+0000 7f354e28d9c0 20 remove_watcher() i=3 2024-09-12T17:20:23.003 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.002+0000 7f354e28d9c0 20 remove_watcher() i=4 2024-09-12T17:20:23.005 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.006+0000 7f354e28d9c0 20 remove_watcher() i=5 2024-09-12T17:20:23.007 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.006+0000 7f354e28d9c0 20 remove_watcher() i=6 2024-09-12T17:20:23.008 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.010+0000 7f354e28d9c0 20 remove_watcher() i=7 2024-09-12T17:20:23.034 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:23.034 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:20:23.034 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: error-at-do-reshard id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:20:23.034 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:23.034 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-09-12T17:20:23.068 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:20:23.069 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:20:23.116 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.118+0000 7f6c9e60b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:23.119 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.118+0000 7f6c9e60b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:23.119 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.118+0000 7f6c9e60b9c0 20 realm 2024-09-12T17:20:23.119 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.118+0000 7f6c9e60b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:23.119 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.118+0000 7f6c9e60b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:23.119 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.118+0000 7f6c9e60b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:20:23.119 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.118+0000 7f6c9e60b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:23.119 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.118+0000 7f6c9e60b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:23.119 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.118+0000 7f6c9e60b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:23.121 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.122+0000 7f6c9e60b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:20:23.121 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.122+0000 7f6c9e60b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:23.123 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.122+0000 7f6c9e60b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:20:23.123 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.122+0000 7f6c9e60b9c0 20 searching for the correct realm 2024-09-12T17:20:23.127 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.126+0000 7f6c9c912640 0 -- 172.21.15.16:0/1231124334 >> [v2:172.21.15.19:6800/1509147557,v1:172.21.15.19:6801/1509147557] conn(0x55d9fe532d90 msgr2=0x55d9fe535180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:20:23.134 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.134+0000 7f6c9b910640 0 -- 172.21.15.16:0/1231124334 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f6c9410a0f0 msgr2=0x7f6c9412d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:20:23.354 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.354+0000 7f6c9e60b9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:20:23.354 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.354+0000 7f6c9e60b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:20:23.354 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.354+0000 7f6c9e60b9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:20:23.354 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.354+0000 7f6c9e60b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:20:23.355 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.354+0000 7f6c9e60b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:20:23.355 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.354+0000 7f6c9e60b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:20:23.355 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.354+0000 7f6c9e60b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:23.355 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.354+0000 7f6c9e60b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:23.355 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.354+0000 7f6c9e60b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:23.355 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.354+0000 7f6c9e60b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:20:23.355 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.354+0000 7f6c9e60b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:23.356 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.358+0000 7f6c9e60b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:20:23.356 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.358+0000 7f6c9e60b9c0 20 zone default found 2024-09-12T17:20:23.356 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.358+0000 7f6c9e60b9c0 4 Realm: () 2024-09-12T17:20:23.356 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.358+0000 7f6c9e60b9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:20:23.357 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.358+0000 7f6c9e60b9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:20:23.357 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.358+0000 7f6c9e60b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:20:23.357 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.358+0000 7f6c9e60b9c0 20 zonegroup default 2024-09-12T17:20:23.357 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.358+0000 7f6c9e60b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:23.357 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.358+0000 7f6c9e60b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:23.357 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.358+0000 7f6c9e60b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:23.358 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.358+0000 7f6c9e60b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:23.358 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.358+0000 7f6c9e60b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:23.359 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.358+0000 7f6c9e60b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:23.359 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.358+0000 7f6c9e60b9c0 20 started sync module instance, tier type = 2024-09-12T17:20:23.359 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.358+0000 7f6c9e60b9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:20:23.384 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.382+0000 7f6c9e60b9c0 20 add_watcher() i=0 2024-09-12T17:20:23.384 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.382+0000 7f6c9e60b9c0 20 add_watcher() i=1 2024-09-12T17:20:23.384 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.382+0000 7f6c9e60b9c0 20 add_watcher() i=2 2024-09-12T17:20:23.384 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.382+0000 7f6c9e60b9c0 20 add_watcher() i=3 2024-09-12T17:20:23.384 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.382+0000 7f6c9e60b9c0 20 add_watcher() i=4 2024-09-12T17:20:23.384 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.382+0000 7f6c9e60b9c0 20 add_watcher() i=5 2024-09-12T17:20:23.384 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.382+0000 7f6c9e60b9c0 20 add_watcher() i=6 2024-09-12T17:20:23.386 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.386+0000 7f6c9e60b9c0 20 add_watcher() i=7 2024-09-12T17:20:23.386 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.386+0000 7f6c9e60b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:20:23.390 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.390+0000 7f6b52fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:20:23.391 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.390+0000 7f6c9e60b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:20:23.391 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.390+0000 7f6c9e60b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:20:23.392 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.390+0000 7f6c9e60b9c0 5 note: GC not initialized 2024-09-12T17:20:23.392 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.390+0000 7f6b51fdb640 20 reqs_thread_entry: start 2024-09-12T17:20:23.392 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.394+0000 7f6c9e60b9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:20:23.393 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.394+0000 7f6c9e60b9c0 20 Filter name: none 2024-09-12T17:20:23.393 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.394+0000 7f6ac37fe640 20 reqs_thread_entry: start 2024-09-12T17:20:23.393 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.394+0000 7f6c9e60b9c0 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T17:20:23.393 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.394+0000 7f6c9e60b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:23.394 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.394+0000 7f6c9e60b9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:20:23.394 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.394+0000 7f6c9e60b9c0 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T17:20:23.394 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.394+0000 7f6c9e60b9c0 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T17:20:23.394 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.394+0000 7f6c9e60b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33 : miss 2024-09-12T17:20:23.394 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.394+0000 7f6c9e60b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:23.394 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.394+0000 7f6c9e60b9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:20:23.395 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.394+0000 7f6c9e60b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33 info.flags=0x17 2024-09-12T17:20:23.395 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.394+0000 7f6c9e60b9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33 to cache LRU end 2024-09-12T17:20:23.395 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.394+0000 7f6c9e60b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:20:23.395 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.394+0000 7f6c9e60b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:20:23.395 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.394+0000 7f6c9e60b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33 2024-09-12T17:20:23.403 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.402+0000 7f6c9e60b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33 info.flags=0x17 2024-09-12T17:20:23.403 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.402+0000 7f6c9e60b9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33 to cache LRU end 2024-09-12T17:20:23.403 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.402+0000 7f6c9e60b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:20:23.403 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.402+0000 7f6c9e60b9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33, ofs0, ns] 2024-09-12T17:20:23.404 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.402+0000 7f6b737fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431583 cookie 94394763170528 notifier 7034 bl.length()=911 2024-09-12T17:20:23.404 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.402+0000 7f6b737fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33 info.flags=0x17 2024-09-12T17:20:23.404 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.402+0000 7f6b737fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33 to cache LRU end 2024-09-12T17:20:23.404 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.402+0000 7f6b737fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:20:23.404 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.406+0000 7f6c9e60b9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33]): orig_sources= new_sources= 2024-09-12T17:20:23.404 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.406+0000 7f6c9e60b9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33]): potential sources added=[] removed=[] 2024-09-12T17:20:23.405 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.406+0000 7f6c9e60b9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33]): orig_dests= new_dests= 2024-09-12T17:20:23.405 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.406+0000 7f6c9e60b9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33]): potential dests added=[] removed=[] 2024-09-12T17:20:23.409 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.410+0000 7f6c9e60b9c0 -1 Injecting error=-5 at location=do_reshard 2024-09-12T17:20:23.417 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.418+0000 7f6c9e60b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33 : hit (requested=0x17, cached=0x17) 2024-09-12T17:20:23.417 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.418+0000 7f6c9e60b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33 2024-09-12T17:20:23.420 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.422+0000 7f6c9e60b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33 info.flags=0x17 2024-09-12T17:20:23.420 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.422+0000 7f6c9e60b9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33 to cache LRU end 2024-09-12T17:20:23.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.422+0000 7f6c9e60b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:20:23.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.422+0000 7f6c9e60b9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33, ofs0, ns] 2024-09-12T17:20:23.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.422+0000 7f6b72ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431584 cookie 94394763170528 notifier 7034 bl.length()=879 2024-09-12T17:20:23.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.422+0000 7f6b72ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33 info.flags=0x17 2024-09-12T17:20:23.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.422+0000 7f6b72ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33 to cache LRU end 2024-09-12T17:20:23.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.422+0000 7f6b72ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:20:23.422 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.422+0000 7f6c9e60b9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33]): orig_sources= new_sources= 2024-09-12T17:20:23.422 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.422+0000 7f6c9e60b9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33]): potential sources added=[] removed=[] 2024-09-12T17:20:23.422 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.422+0000 7f6c9e60b9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33]): orig_dests= new_dests= 2024-09-12T17:20:23.422 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.422+0000 7f6c9e60b9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33]): potential dests added=[] removed=[] 2024-09-12T17:20:23.422 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.422+0000 7f6c9e60b9c0 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-09-12T17:20:23.425 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.426+0000 7f6b52fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:20:23.430 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.430+0000 7f6c9e60b9c0 20 remove_watcher() i=0 2024-09-12T17:20:23.431 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.430+0000 7f6c9e60b9c0 2 removed watcher, disabling cache 2024-09-12T17:20:23.433 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.434+0000 7f6c9e60b9c0 20 remove_watcher() i=1 2024-09-12T17:20:23.435 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.434+0000 7f6c9e60b9c0 20 remove_watcher() i=2 2024-09-12T17:20:23.437 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.438+0000 7f6c9e60b9c0 20 remove_watcher() i=3 2024-09-12T17:20:23.440 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.438+0000 7f6c9e60b9c0 20 remove_watcher() i=4 2024-09-12T17:20:23.441 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.442+0000 7f6c9e60b9c0 20 remove_watcher() i=5 2024-09-12T17:20:23.443 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.442+0000 7f6c9e60b9c0 20 remove_watcher() i=6 2024-09-12T17:20:23.444 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.446+0000 7f6c9e60b9c0 20 remove_watcher() i=7 2024-09-12T17:20:23.461 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T17:20:23.489 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:20:23.489 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:20:23.536 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.534+0000 7f07072619c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:23.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.538+0000 7f07072619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:23.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.538+0000 7f07072619c0 20 realm 2024-09-12T17:20:23.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.538+0000 7f07072619c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:23.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.538+0000 7f07072619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:23.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.538+0000 7f07072619c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:20:23.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.538+0000 7f07072619c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:23.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.538+0000 7f07072619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:23.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.538+0000 7f07072619c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:23.540 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.538+0000 7f07072619c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:20:23.540 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.538+0000 7f07072619c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:23.542 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.542+0000 7f07072619c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:20:23.542 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.542+0000 7f07072619c0 20 searching for the correct realm 2024-09-12T17:20:23.546 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.546+0000 7f0705568640 0 -- 172.21.15.16:0/2628672951 >> [v2:172.21.15.19:6800/1509147557,v1:172.21.15.19:6801/1509147557] conn(0x5626ac1f8c50 msgr2=0x5626ac1fb040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:20:23.553 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.554+0000 7f0704566640 0 -- 172.21.15.16:0/2628672951 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f06fc12b7a0 msgr2=0x7f06fc10d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:20:23.772 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.770+0000 7f07072619c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:20:23.772 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.770+0000 7f07072619c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:20:23.772 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.770+0000 7f07072619c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:20:23.772 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.770+0000 7f07072619c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:20:23.772 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.770+0000 7f07072619c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:20:23.772 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.770+0000 7f07072619c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:20:23.772 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.770+0000 7f07072619c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:23.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.774+0000 7f07072619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:23.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.774+0000 7f07072619c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:23.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.774+0000 7f07072619c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:20:23.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.774+0000 7f07072619c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:23.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.774+0000 7f07072619c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:20:23.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.774+0000 7f07072619c0 20 zone default found 2024-09-12T17:20:23.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.774+0000 7f07072619c0 4 Realm: () 2024-09-12T17:20:23.775 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.774+0000 7f07072619c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:20:23.775 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.774+0000 7f07072619c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:20:23.775 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.774+0000 7f07072619c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:20:23.775 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.774+0000 7f07072619c0 20 zonegroup default 2024-09-12T17:20:23.775 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.774+0000 7f07072619c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:23.775 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.774+0000 7f07072619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:23.775 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.774+0000 7f07072619c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:23.776 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.774+0000 7f07072619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:23.776 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.774+0000 7f07072619c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:23.777 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.778+0000 7f07072619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:23.777 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.778+0000 7f07072619c0 20 started sync module instance, tier type = 2024-09-12T17:20:23.777 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.778+0000 7f07072619c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:20:23.802 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.802+0000 7f07072619c0 20 add_watcher() i=0 2024-09-12T17:20:23.802 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.802+0000 7f07072619c0 20 add_watcher() i=1 2024-09-12T17:20:23.802 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.802+0000 7f07072619c0 20 add_watcher() i=2 2024-09-12T17:20:23.803 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.802+0000 7f07072619c0 20 add_watcher() i=3 2024-09-12T17:20:23.803 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.802+0000 7f07072619c0 20 add_watcher() i=4 2024-09-12T17:20:23.803 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.802+0000 7f07072619c0 20 add_watcher() i=5 2024-09-12T17:20:23.803 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.802+0000 7f07072619c0 20 add_watcher() i=6 2024-09-12T17:20:23.804 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.802+0000 7f07072619c0 20 add_watcher() i=7 2024-09-12T17:20:23.804 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.806+0000 7f07072619c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:20:23.811 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.810+0000 7f05bb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:20:23.812 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.810+0000 7f07072619c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:20:23.812 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.810+0000 7f07072619c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:20:23.812 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.810+0000 7f07072619c0 5 note: GC not initialized 2024-09-12T17:20:23.812 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.814+0000 7f05ba7e4640 20 reqs_thread_entry: start 2024-09-12T17:20:23.812 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.814+0000 7f07072619c0 20 init_complete bucket index max shards: 1 2024-09-12T17:20:23.813 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.814+0000 7f07072619c0 20 Filter name: none 2024-09-12T17:20:23.813 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.814+0000 7f05b37fe640 20 reqs_thread_entry: start 2024-09-12T17:20:23.813 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.814+0000 7f07072619c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:23.814 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.814+0000 7f07072619c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:20:23.814 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.814+0000 7f07072619c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:23.815 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.814+0000 7f07072619c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:20:23.815 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.814+0000 7f07072619c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:20:23.815 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.814+0000 7f07072619c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:23.816 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.814+0000 7f07072619c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:20:23.816 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.814+0000 7f07072619c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:23.816 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.814+0000 7f07072619c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:20:23.816 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.814+0000 7f07072619c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:20:23.818 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.818+0000 7f05bb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:20:23.824 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.822+0000 7f07072619c0 20 remove_watcher() i=0 2024-09-12T17:20:23.824 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.822+0000 7f07072619c0 2 removed watcher, disabling cache 2024-09-12T17:20:23.827 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.826+0000 7f07072619c0 20 remove_watcher() i=1 2024-09-12T17:20:23.829 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.830+0000 7f07072619c0 20 remove_watcher() i=2 2024-09-12T17:20:23.832 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.830+0000 7f07072619c0 20 remove_watcher() i=3 2024-09-12T17:20:23.834 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.834+0000 7f07072619c0 20 remove_watcher() i=4 2024-09-12T17:20:23.836 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.834+0000 7f07072619c0 20 remove_watcher() i=5 2024-09-12T17:20:23.837 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.838+0000 7f07072619c0 20 remove_watcher() i=6 2024-09-12T17:20:23.838 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:23.838+0000 7f07072619c0 20 remove_watcher() i=7 2024-09-12T17:20:23.862 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:23.862 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:20:23.862 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: error-at-do-reshard id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:20:23.862 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:23.922 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:20:23.959 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:20:23.960 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:20:24.189 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.190+0000 7f673e752640 0 --2- 172.21.15.16:0/2466027967 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c31124f0c0 0x55c311275bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T17:20:24.226 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.226+0000 7f674144d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:24.228 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.226+0000 7f674144d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:24.228 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.226+0000 7f674144d9c0 20 realm 2024-09-12T17:20:24.228 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.226+0000 7f674144d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:24.229 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.230+0000 7f674144d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:24.229 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.230+0000 7f674144d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:20:24.229 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.230+0000 7f674144d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:24.229 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.230+0000 7f674144d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:24.229 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.230+0000 7f674144d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:24.231 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.230+0000 7f674144d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:20:24.231 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.230+0000 7f674144d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:24.231 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.230+0000 7f673f754640 0 -- 172.21.15.16:0/985689475 >> [v2:172.21.15.19:6800/1509147557,v1:172.21.15.19:6801/1509147557] conn(0x55c311336620 msgr2=0x55c311338a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:20:24.435 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.434+0000 7f674144d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:20:24.436 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.434+0000 7f674144d9c0 20 searching for the correct realm 2024-09-12T17:20:24.443 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.442+0000 7f673e752640 0 -- 172.21.15.16:0/985689475 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7f6730035040 msgr2=0x7f673006e040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:20:24.671 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.670+0000 7f674144d9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:20:24.671 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.670+0000 7f674144d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:20:24.671 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.670+0000 7f674144d9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:20:24.671 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.670+0000 7f674144d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:20:24.671 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.670+0000 7f674144d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:20:24.671 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.670+0000 7f674144d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:20:24.671 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.670+0000 7f674144d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:24.672 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.670+0000 7f674144d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:24.672 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.670+0000 7f674144d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:24.672 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.674+0000 7f674144d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:20:24.672 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.674+0000 7f674144d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:24.673 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.674+0000 7f674144d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:20:24.674 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.674+0000 7f674144d9c0 20 zone default found 2024-09-12T17:20:24.674 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.674+0000 7f674144d9c0 4 Realm: () 2024-09-12T17:20:24.674 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.674+0000 7f674144d9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:20:24.674 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.674+0000 7f674144d9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:20:24.674 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.674+0000 7f674144d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:20:24.674 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.674+0000 7f674144d9c0 20 zonegroup default 2024-09-12T17:20:24.674 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.674+0000 7f674144d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:24.674 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.674+0000 7f674144d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:24.675 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.674+0000 7f674144d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:24.675 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.674+0000 7f674144d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:24.675 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.674+0000 7f674144d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:24.676 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.674+0000 7f674144d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:24.676 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.674+0000 7f674144d9c0 20 started sync module instance, tier type = 2024-09-12T17:20:24.676 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.674+0000 7f674144d9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:20:24.700 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.698+0000 7f674144d9c0 20 add_watcher() i=0 2024-09-12T17:20:24.700 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.698+0000 7f674144d9c0 20 add_watcher() i=1 2024-09-12T17:20:24.700 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.698+0000 7f674144d9c0 20 add_watcher() i=2 2024-09-12T17:20:24.700 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.698+0000 7f674144d9c0 20 add_watcher() i=3 2024-09-12T17:20:24.700 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.698+0000 7f674144d9c0 20 add_watcher() i=4 2024-09-12T17:20:24.700 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.698+0000 7f674144d9c0 20 add_watcher() i=5 2024-09-12T17:20:24.700 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.698+0000 7f674144d9c0 20 add_watcher() i=6 2024-09-12T17:20:24.702 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.702+0000 7f674144d9c0 20 add_watcher() i=7 2024-09-12T17:20:24.702 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.702+0000 7f674144d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:20:24.705 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.706+0000 7f65f57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:20:24.706 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.706+0000 7f674144d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:20:24.706 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.706+0000 7f674144d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:20:24.706 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.706+0000 7f674144d9c0 5 note: GC not initialized 2024-09-12T17:20:24.707 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.706+0000 7f656ffff640 20 reqs_thread_entry: start 2024-09-12T17:20:24.707 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.706+0000 7f674144d9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:20:24.707 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.706+0000 7f674144d9c0 20 Filter name: none 2024-09-12T17:20:24.707 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.706+0000 7f656dffb640 20 reqs_thread_entry: start 2024-09-12T17:20:24.707 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.706+0000 7f674144d9c0 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T17:20:24.707 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.706+0000 7f674144d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:24.708 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.706+0000 7f674144d9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:20:24.708 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.706+0000 7f674144d9c0 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T17:20:24.708 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.706+0000 7f674144d9c0 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T17:20:24.708 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.706+0000 7f674144d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33 : miss 2024-09-12T17:20:24.708 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.706+0000 7f674144d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:24.708 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.710+0000 7f674144d9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:20:24.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.710+0000 7f674144d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33 info.flags=0x17 2024-09-12T17:20:24.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.710+0000 7f674144d9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33 to cache LRU end 2024-09-12T17:20:24.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.710+0000 7f674144d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:20:24.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.710+0000 7f674144d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:20:24.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.710+0000 7f674144d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33 2024-09-12T17:20:24.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.718+0000 7f674144d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33 info.flags=0x17 2024-09-12T17:20:24.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.718+0000 7f674144d9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33 to cache LRU end 2024-09-12T17:20:24.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.718+0000 7f674144d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:20:24.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.718+0000 7f674144d9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33, ofs0, ns] 2024-09-12T17:20:24.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.718+0000 7f66227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431585 cookie 94296295625488 notifier 7067 bl.length()=911 2024-09-12T17:20:24.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.718+0000 7f66227fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33 info.flags=0x17 2024-09-12T17:20:24.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.718+0000 7f66227fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33 to cache LRU end 2024-09-12T17:20:24.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.718+0000 7f66227fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:20:24.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.718+0000 7f674144d9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33]): orig_sources= new_sources= 2024-09-12T17:20:24.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.718+0000 7f674144d9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33]): potential sources added=[] removed=[] 2024-09-12T17:20:24.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.718+0000 7f674144d9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33]): orig_dests= new_dests= 2024-09-12T17:20:24.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.718+0000 7f674144d9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33]): potential dests added=[] removed=[] 2024-09-12T17:20:24.722 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.722+0000 7f674144d9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33.1.0 2024-09-12T17:20:24.723 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.722+0000 7f674144d9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33.1.0 2024-09-12T17:20:24.723 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.722+0000 7f674144d9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33.1.1 2024-09-12T17:20:24.723 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.722+0000 7f674144d9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33.1.1 2024-09-12T17:20:24.723 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.722+0000 7f674144d9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33.0 2024-09-12T17:20:24.727 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.726+0000 7f674144d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33 : hit (requested=0x17, cached=0x17) 2024-09-12T17:20:24.727 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.726+0000 7f674144d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33 2024-09-12T17:20:24.730 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.730+0000 7f674144d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33 info.flags=0x17 2024-09-12T17:20:24.730 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.730+0000 7f674144d9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33 to cache LRU end 2024-09-12T17:20:24.730 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.730+0000 7f674144d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:20:24.730 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.730+0000 7f674144d9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33, ofs0, ns] 2024-09-12T17:20:24.731 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.730+0000 7f6621ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431586 cookie 94296295625488 notifier 7067 bl.length()=911 2024-09-12T17:20:24.731 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.730+0000 7f6621ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33 info.flags=0x17 2024-09-12T17:20:24.731 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.730+0000 7f6621ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33 to cache LRU end 2024-09-12T17:20:24.731 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.730+0000 7f6621ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:20:24.731 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.730+0000 7f674144d9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33]): orig_sources= new_sources= 2024-09-12T17:20:24.731 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.730+0000 7f674144d9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33]): potential sources added=[] removed=[] 2024-09-12T17:20:24.731 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.730+0000 7f674144d9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33]): orig_dests= new_dests= 2024-09-12T17:20:24.731 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.730+0000 7f674144d9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33]): potential dests added=[] removed=[] 2024-09-12T17:20:24.733 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.734+0000 7f674144d9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33.0 2024-09-12T17:20:24.733 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.734+0000 7f674144d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33 : hit (requested=0x17, cached=0x17) 2024-09-12T17:20:24.734 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.734+0000 7f674144d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33 2024-09-12T17:20:24.736 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.738+0000 7f674144d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33 info.flags=0x17 2024-09-12T17:20:24.736 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.738+0000 7f674144d9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33 to cache LRU end 2024-09-12T17:20:24.736 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.738+0000 7f674144d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:20:24.736 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.738+0000 7f674144d9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33, ofs0, ns] 2024-09-12T17:20:24.737 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.738+0000 7f66227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431587 cookie 94296295625488 notifier 7067 bl.length()=879 2024-09-12T17:20:24.737 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.738+0000 7f66227fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33 info.flags=0x17 2024-09-12T17:20:24.737 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.738+0000 7f66227fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33 to cache LRU end 2024-09-12T17:20:24.737 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.738+0000 7f66227fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:20:24.737 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.738+0000 7f674144d9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33]): orig_sources= new_sources= 2024-09-12T17:20:24.737 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.738+0000 7f674144d9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33]): potential sources added=[] removed=[] 2024-09-12T17:20:24.737 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.738+0000 7f674144d9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33]): orig_dests= new_dests= 2024-09-12T17:20:24.738 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.738+0000 7f674144d9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33]): potential dests added=[] removed=[] 2024-09-12T17:20:24.740 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.738+0000 7f674144d9c0 1 execute INFO: reshard of bucket "error-at-do-reshard" from 1 shards to 2 shards completed successfully 2024-09-12T17:20:24.743 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.742+0000 7f65f57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:20:24.748 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.750+0000 7f674144d9c0 20 remove_watcher() i=0 2024-09-12T17:20:24.748 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.750+0000 7f674144d9c0 2 removed watcher, disabling cache 2024-09-12T17:20:24.751 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.750+0000 7f674144d9c0 20 remove_watcher() i=1 2024-09-12T17:20:24.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.754+0000 7f674144d9c0 20 remove_watcher() i=2 2024-09-12T17:20:24.755 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.754+0000 7f674144d9c0 20 remove_watcher() i=3 2024-09-12T17:20:24.757 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.758+0000 7f674144d9c0 20 remove_watcher() i=4 2024-09-12T17:20:24.759 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.758+0000 7f674144d9c0 20 remove_watcher() i=5 2024-09-12T17:20:24.761 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.762+0000 7f674144d9c0 20 remove_watcher() i=6 2024-09-12T17:20:24.762 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.762+0000 7f674144d9c0 20 remove_watcher() i=7 2024-09-12T17:20:24.779 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T17:20:24.807 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:20:24.807 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:20:24.853 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.854+0000 7f499e1389c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:24.855 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.854+0000 7f499e1389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:24.855 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.854+0000 7f499e1389c0 20 realm 2024-09-12T17:20:24.855 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.854+0000 7f499e1389c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:24.855 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.854+0000 7f499e1389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:24.855 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.854+0000 7f499e1389c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:20:24.855 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.854+0000 7f499e1389c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:24.855 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.854+0000 7f499e1389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:24.856 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.854+0000 7f499e1389c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:24.857 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.858+0000 7f499e1389c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:20:24.857 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.858+0000 7f499e1389c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:24.858 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.858+0000 7f499e1389c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:20:24.859 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.858+0000 7f499e1389c0 20 searching for the correct realm 2024-09-12T17:20:24.862 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.862+0000 7f499c43f640 0 -- 172.21.15.16:0/4243573809 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f4990025070 msgr2=0x7f49900669e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:20:24.870 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:24.870+0000 7f499b43d640 0 -- 172.21.15.16:0/4243573809 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f499406d2e0 msgr2=0x7f49940901a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:20:25.087 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.086+0000 7f499e1389c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:20:25.088 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.086+0000 7f499e1389c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:20:25.088 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.086+0000 7f499e1389c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:20:25.088 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.086+0000 7f499e1389c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:20:25.088 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.086+0000 7f499e1389c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:20:25.088 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.086+0000 7f499e1389c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:20:25.088 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.086+0000 7f499e1389c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:25.088 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.086+0000 7f499e1389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:25.089 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.086+0000 7f499e1389c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:25.089 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.090+0000 7f499e1389c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:20:25.089 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.090+0000 7f499e1389c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:25.090 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.090+0000 7f499e1389c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:20:25.091 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.090+0000 7f499e1389c0 20 zone default found 2024-09-12T17:20:25.091 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.090+0000 7f499e1389c0 4 Realm: () 2024-09-12T17:20:25.091 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.090+0000 7f499e1389c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:20:25.091 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.090+0000 7f499e1389c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:20:25.091 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.090+0000 7f499e1389c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:20:25.091 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.090+0000 7f499e1389c0 20 zonegroup default 2024-09-12T17:20:25.091 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.090+0000 7f499e1389c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:25.092 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.090+0000 7f499e1389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:25.092 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.090+0000 7f499e1389c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:25.092 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.090+0000 7f499e1389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:25.092 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.090+0000 7f499e1389c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:25.093 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.094+0000 7f499e1389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:25.093 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.094+0000 7f499e1389c0 20 started sync module instance, tier type = 2024-09-12T17:20:25.093 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.094+0000 7f499e1389c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:20:25.117 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.118+0000 7f499e1389c0 20 add_watcher() i=0 2024-09-12T17:20:25.118 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.118+0000 7f499e1389c0 20 add_watcher() i=1 2024-09-12T17:20:25.118 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.118+0000 7f499e1389c0 20 add_watcher() i=2 2024-09-12T17:20:25.118 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.118+0000 7f499e1389c0 20 add_watcher() i=3 2024-09-12T17:20:25.118 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.118+0000 7f499e1389c0 20 add_watcher() i=4 2024-09-12T17:20:25.118 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.118+0000 7f499e1389c0 20 add_watcher() i=5 2024-09-12T17:20:25.118 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.118+0000 7f499e1389c0 20 add_watcher() i=6 2024-09-12T17:20:25.120 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.118+0000 7f499e1389c0 20 add_watcher() i=7 2024-09-12T17:20:25.120 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.118+0000 7f499e1389c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:20:25.124 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.122+0000 7f4851fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:20:25.125 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.126+0000 7f499e1389c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:20:25.125 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.126+0000 7f499e1389c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:20:25.125 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.126+0000 7f499e1389c0 5 note: GC not initialized 2024-09-12T17:20:25.126 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.126+0000 7f4850fe1640 20 reqs_thread_entry: start 2024-09-12T17:20:25.126 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.126+0000 7f499e1389c0 20 init_complete bucket index max shards: 1 2024-09-12T17:20:25.126 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.126+0000 7f499e1389c0 20 Filter name: none 2024-09-12T17:20:25.127 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.126+0000 7f47ca7fc640 20 reqs_thread_entry: start 2024-09-12T17:20:25.127 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.126+0000 7f499e1389c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:25.127 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.126+0000 7f499e1389c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:20:25.127 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.126+0000 7f499e1389c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:25.128 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.126+0000 7f499e1389c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:20:25.128 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.126+0000 7f499e1389c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:20:25.128 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.126+0000 7f499e1389c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:25.129 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.130+0000 7f499e1389c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:20:25.129 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.130+0000 7f499e1389c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:25.129 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.130+0000 7f499e1389c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:20:25.129 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.130+0000 7f499e1389c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:20:25.132 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.130+0000 7f4851fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:20:25.136 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.138+0000 7f499e1389c0 20 remove_watcher() i=0 2024-09-12T17:20:25.136 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.138+0000 7f499e1389c0 2 removed watcher, disabling cache 2024-09-12T17:20:25.139 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.138+0000 7f499e1389c0 20 remove_watcher() i=1 2024-09-12T17:20:25.141 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.142+0000 7f499e1389c0 20 remove_watcher() i=2 2024-09-12T17:20:25.143 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.142+0000 7f499e1389c0 20 remove_watcher() i=3 2024-09-12T17:20:25.145 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.146+0000 7f499e1389c0 20 remove_watcher() i=4 2024-09-12T17:20:25.147 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.146+0000 7f499e1389c0 20 remove_watcher() i=5 2024-09-12T17:20:25.148 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.146+0000 7f499e1389c0 20 remove_watcher() i=6 2024-09-12T17:20:25.149 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.150+0000 7f499e1389c0 20 remove_watcher() i=7 2024-09-12T17:20:25.165 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:25.165 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:20:25.165 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: error-at-do-reshard id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:20:25.165 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:25.248 INFO:tasks.workunit.client.0.smithi016.stderr:TEST: reshard bucket with abort at do_reshard 2024-09-12T17:20:25.249 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:25.705 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T17:20:25.739 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:20:25.739 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:20:25.788 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.790+0000 7f88cd2da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:25.791 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.790+0000 7f88cd2da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:25.791 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.790+0000 7f88cd2da9c0 20 realm 2024-09-12T17:20:25.791 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.790+0000 7f88cd2da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:25.791 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.790+0000 7f88cd2da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:25.791 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.790+0000 7f88cd2da9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:20:25.791 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.790+0000 7f88cd2da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:25.791 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.790+0000 7f88cd2da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:25.791 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.790+0000 7f88cd2da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:25.792 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.794+0000 7f88cd2da9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:20:25.793 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.794+0000 7f88cd2da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:25.794 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.794+0000 7f88cd2da9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:20:25.794 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.794+0000 7f88cd2da9c0 20 searching for the correct realm 2024-09-12T17:20:25.797 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.798+0000 7f88cb5e1640 0 -- 172.21.15.16:0/3212952167 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f88c0089bd0 msgr2=0x7f88c0067060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:20:25.805 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:25.806+0000 7f88ca5df640 0 -- 172.21.15.16:0/3212952167 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f88c40f3040 msgr2=0x7f88c40c8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:20:26.023 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.022+0000 7f88cd2da9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:20:26.023 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.022+0000 7f88cd2da9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:20:26.023 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.022+0000 7f88cd2da9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:20:26.023 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.022+0000 7f88cd2da9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:20:26.023 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.022+0000 7f88cd2da9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:20:26.023 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.022+0000 7f88cd2da9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:20:26.024 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.022+0000 7f88cd2da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.024 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.022+0000 7f88cd2da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:26.024 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.022+0000 7f88cd2da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.024 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.026+0000 7f88cd2da9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:20:26.025 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.026+0000 7f88cd2da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.025 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.026+0000 7f88cd2da9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:20:26.026 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.026+0000 7f88cd2da9c0 20 zone default found 2024-09-12T17:20:26.026 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.026+0000 7f88cd2da9c0 4 Realm: () 2024-09-12T17:20:26.026 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.026+0000 7f88cd2da9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:20:26.026 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.026+0000 7f88cd2da9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:20:26.026 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.026+0000 7f88cd2da9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:20:26.026 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.026+0000 7f88cd2da9c0 20 zonegroup default 2024-09-12T17:20:26.026 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.026+0000 7f88cd2da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.026 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.026+0000 7f88cd2da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:26.026 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.026+0000 7f88cd2da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.027 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.026+0000 7f88cd2da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:26.027 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.026+0000 7f88cd2da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.027 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.026+0000 7f88cd2da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:26.028 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.026+0000 7f88cd2da9c0 20 started sync module instance, tier type = 2024-09-12T17:20:26.028 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.026+0000 7f88cd2da9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:20:26.054 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.054+0000 7f88cd2da9c0 20 add_watcher() i=0 2024-09-12T17:20:26.054 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.054+0000 7f88cd2da9c0 20 add_watcher() i=1 2024-09-12T17:20:26.054 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.054+0000 7f88cd2da9c0 20 add_watcher() i=2 2024-09-12T17:20:26.054 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.054+0000 7f88cd2da9c0 20 add_watcher() i=3 2024-09-12T17:20:26.054 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.054+0000 7f88cd2da9c0 20 add_watcher() i=4 2024-09-12T17:20:26.054 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.054+0000 7f88cd2da9c0 20 add_watcher() i=5 2024-09-12T17:20:26.054 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.054+0000 7f88cd2da9c0 20 add_watcher() i=6 2024-09-12T17:20:26.056 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.054+0000 7f88cd2da9c0 20 add_watcher() i=7 2024-09-12T17:20:26.056 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.054+0000 7f88cd2da9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:20:26.060 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.062+0000 7f87817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:20:26.061 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.062+0000 7f88cd2da9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:20:26.061 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.062+0000 7f88cd2da9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:20:26.061 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.062+0000 7f88cd2da9c0 5 note: GC not initialized 2024-09-12T17:20:26.062 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.062+0000 7f86fbfff640 20 reqs_thread_entry: start 2024-09-12T17:20:26.062 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.062+0000 7f88cd2da9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:20:26.062 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.062+0000 7f88cd2da9c0 20 Filter name: none 2024-09-12T17:20:26.063 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.062+0000 7f86f9ffb640 20 reqs_thread_entry: start 2024-09-12T17:20:26.063 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.062+0000 7f88cd2da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.064 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.066+0000 7f88cd2da9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:20:26.064 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.066+0000 7f88cd2da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.065 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.066+0000 7f88cd2da9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:20:26.065 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.066+0000 7f88cd2da9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:20:26.065 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.066+0000 7f88cd2da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.066 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.066+0000 7f88cd2da9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:20:26.066 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.066+0000 7f88cd2da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.067 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.066+0000 7f88cd2da9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:20:26.067 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.066+0000 7f88cd2da9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:20:26.069 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.070+0000 7f87817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:20:26.075 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.074+0000 7f88cd2da9c0 20 remove_watcher() i=0 2024-09-12T17:20:26.075 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.074+0000 7f88cd2da9c0 2 removed watcher, disabling cache 2024-09-12T17:20:26.077 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.078+0000 7f88cd2da9c0 20 remove_watcher() i=1 2024-09-12T17:20:26.079 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.078+0000 7f88cd2da9c0 20 remove_watcher() i=2 2024-09-12T17:20:26.082 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.082+0000 7f88cd2da9c0 20 remove_watcher() i=3 2024-09-12T17:20:26.084 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.086+0000 7f88cd2da9c0 20 remove_watcher() i=4 2024-09-12T17:20:26.087 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.086+0000 7f88cd2da9c0 20 remove_watcher() i=5 2024-09-12T17:20:26.090 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.090+0000 7f88cd2da9c0 20 remove_watcher() i=6 2024-09-12T17:20:26.092 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.094+0000 7f88cd2da9c0 20 remove_watcher() i=7 2024-09-12T17:20:26.110 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:26.110 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:20:26.110 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: abort-at-do-reshard id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:20:26.110 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:26.110 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T17:20:26.144 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:20:26.144 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:20:26.189 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.190+0000 7f253fb199c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.191 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.190+0000 7f253fb199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:26.191 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.190+0000 7f253fb199c0 20 realm 2024-09-12T17:20:26.191 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.190+0000 7f253fb199c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.191 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.190+0000 7f253fb199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:26.192 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.190+0000 7f253fb199c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:20:26.192 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.190+0000 7f253fb199c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.192 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.190+0000 7f253fb199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:26.192 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.190+0000 7f253fb199c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.193 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.194+0000 7f253fb199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:20:26.193 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.194+0000 7f253fb199c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.194 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.194+0000 7f253fb199c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:20:26.195 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.194+0000 7f253fb199c0 20 searching for the correct realm 2024-09-12T17:20:26.198 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.198+0000 7f253de20640 0 -- 172.21.15.16:0/411721815 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f2534013030 msgr2=0x7f2534013410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:20:26.415 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.414+0000 7f253ce1e640 0 -- 172.21.15.16:0/411721815 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f253007f910 msgr2=0x7f25300791d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:20:26.633 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.634+0000 7f253fb199c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:20:26.633 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.634+0000 7f253fb199c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:20:26.633 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.634+0000 7f253fb199c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:20:26.633 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.634+0000 7f253fb199c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:20:26.633 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.634+0000 7f253fb199c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:20:26.634 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.634+0000 7f253fb199c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:20:26.634 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.634+0000 7f253fb199c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.634 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.634+0000 7f253fb199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:26.634 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.634+0000 7f253fb199c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.634 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.634+0000 7f253fb199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:20:26.635 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.634+0000 7f253fb199c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.636 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.634+0000 7f253fb199c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:20:26.636 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.634+0000 7f253fb199c0 20 zone default found 2024-09-12T17:20:26.636 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.634+0000 7f253fb199c0 4 Realm: () 2024-09-12T17:20:26.636 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.634+0000 7f253fb199c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:20:26.636 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.634+0000 7f253fb199c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:20:26.636 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.634+0000 7f253fb199c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:20:26.636 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.634+0000 7f253fb199c0 20 zonegroup default 2024-09-12T17:20:26.636 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.634+0000 7f253fb199c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.637 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.638+0000 7f253fb199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:26.637 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.638+0000 7f253fb199c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.637 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.638+0000 7f253fb199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:26.637 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.638+0000 7f253fb199c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.638 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.638+0000 7f253fb199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:26.638 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.638+0000 7f253fb199c0 20 started sync module instance, tier type = 2024-09-12T17:20:26.638 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.638+0000 7f253fb199c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:20:26.660 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.662+0000 7f253fb199c0 20 add_watcher() i=0 2024-09-12T17:20:26.661 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.662+0000 7f253fb199c0 20 add_watcher() i=1 2024-09-12T17:20:26.661 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.662+0000 7f253fb199c0 20 add_watcher() i=2 2024-09-12T17:20:26.661 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.662+0000 7f253fb199c0 20 add_watcher() i=3 2024-09-12T17:20:26.661 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.662+0000 7f253fb199c0 20 add_watcher() i=4 2024-09-12T17:20:26.661 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.662+0000 7f253fb199c0 20 add_watcher() i=5 2024-09-12T17:20:26.661 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.662+0000 7f253fb199c0 20 add_watcher() i=6 2024-09-12T17:20:26.663 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.662+0000 7f253fb199c0 20 add_watcher() i=7 2024-09-12T17:20:26.663 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.662+0000 7f253fb199c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:20:26.667 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.666+0000 7f23f3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:20:26.668 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.666+0000 7f253fb199c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:20:26.668 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.666+0000 7f253fb199c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:20:26.668 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.666+0000 7f253fb199c0 5 note: GC not initialized 2024-09-12T17:20:26.668 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.670+0000 7f23f2fe5640 20 reqs_thread_entry: start 2024-09-12T17:20:26.668 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.670+0000 7f253fb199c0 20 init_complete bucket index max shards: 1 2024-09-12T17:20:26.669 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.670+0000 7f253fb199c0 20 Filter name: none 2024-09-12T17:20:26.669 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.670+0000 7f23f0fe1640 20 reqs_thread_entry: start 2024-09-12T17:20:26.669 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.670+0000 7f253fb199c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T17:20:26.669 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.670+0000 7f253fb199c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.670 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.670+0000 7f253fb199c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:20:26.670 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.670+0000 7f253fb199c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T17:20:26.670 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.670+0000 7f253fb199c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T17:20:26.670 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.670+0000 7f253fb199c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 : miss 2024-09-12T17:20:26.670 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.670+0000 7f253fb199c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.671 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.670+0000 7f253fb199c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:20:26.671 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.670+0000 7f253fb199c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 info.flags=0x17 2024-09-12T17:20:26.671 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.670+0000 7f253fb199c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 to cache LRU end 2024-09-12T17:20:26.671 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.670+0000 7f253fb199c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:20:26.671 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.670+0000 7f253fb199c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:20:26.671 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.670+0000 7f253fb199c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 2024-09-12T17:20:26.680 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.678+0000 7f253fb199c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 info.flags=0x17 2024-09-12T17:20:26.680 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.678+0000 7f253fb199c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 to cache LRU end 2024-09-12T17:20:26.680 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.678+0000 7f253fb199c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:20:26.680 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.678+0000 7f253fb199c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34, ofs0, ns] 2024-09-12T17:20:26.680 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.682+0000 7f2420ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431580 cookie 94755183056384 notifier 7118 bl.length()=911 2024-09-12T17:20:26.680 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.682+0000 7f2420ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 info.flags=0x17 2024-09-12T17:20:26.680 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.682+0000 7f2420ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 to cache LRU end 2024-09-12T17:20:26.680 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.682+0000 7f2420ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:20:26.681 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.682+0000 7f253fb199c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34]): orig_sources= new_sources= 2024-09-12T17:20:26.681 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.682+0000 7f253fb199c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34]): potential sources added=[] removed=[] 2024-09-12T17:20:26.681 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.682+0000 7f253fb199c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34]): orig_dests= new_dests= 2024-09-12T17:20:26.681 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.682+0000 7f253fb199c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34]): potential dests added=[] removed=[] 2024-09-12T17:20:26.686 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f253fb199c0 time 2024-09-12T17:20:26.689341+0000 2024-09-12T17:20:26.687 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:20:26.688 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:20:26.688 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f25433f32eb] 2024-09-12T17:20:26.688 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f25433f349f] 2024-09-12T17:20:26.688 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562de72100c1] 2024-09-12T17:20:26.688 INFO:tasks.workunit.client.0.smithi016.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562de72221fa] 2024-09-12T17:20:26.689 INFO:tasks.workunit.client.0.smithi016.stderr: 5: main() 2024-09-12T17:20:26.689 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2542259d90] 2024-09-12T17:20:26.689 INFO:tasks.workunit.client.0.smithi016.stderr: 7: __libc_start_main() 2024-09-12T17:20:26.689 INFO:tasks.workunit.client.0.smithi016.stderr: 8: _start() 2024-09-12T17:20:26.689 INFO:tasks.workunit.client.0.smithi016.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:20:26.689 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7f253fb199c0 thread_name:radosgw-admin 2024-09-12T17:20:26.689 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.686+0000 7f253fb199c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f253fb199c0 time 2024-09-12T17:20:26.689341+0000 2024-09-12T17:20:26.689 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:20:26.689 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:26.689 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:20:26.689 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f25433f32eb] 2024-09-12T17:20:26.689 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f25433f349f] 2024-09-12T17:20:26.689 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562de72100c1] 2024-09-12T17:20:26.690 INFO:tasks.workunit.client.0.smithi016.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562de72221fa] 2024-09-12T17:20:26.690 INFO:tasks.workunit.client.0.smithi016.stderr: 5: main() 2024-09-12T17:20:26.690 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2542259d90] 2024-09-12T17:20:26.690 INFO:tasks.workunit.client.0.smithi016.stderr: 7: __libc_start_main() 2024-09-12T17:20:26.690 INFO:tasks.workunit.client.0.smithi016.stderr: 8: _start() 2024-09-12T17:20:26.690 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:26.707 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:20:26.707 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2542272520] 2024-09-12T17:20:26.707 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:20:26.707 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:20:26.707 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:20:26.707 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f25433f3345] 2024-09-12T17:20:26.708 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f25433f349f] 2024-09-12T17:20:26.708 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562de72100c1] 2024-09-12T17:20:26.708 INFO:tasks.workunit.client.0.smithi016.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562de72221fa] 2024-09-12T17:20:26.708 INFO:tasks.workunit.client.0.smithi016.stderr: 9: main() 2024-09-12T17:20:26.708 INFO:tasks.workunit.client.0.smithi016.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2542259d90] 2024-09-12T17:20:26.708 INFO:tasks.workunit.client.0.smithi016.stderr: 11: __libc_start_main() 2024-09-12T17:20:26.708 INFO:tasks.workunit.client.0.smithi016.stderr: 12: _start() 2024-09-12T17:20:26.708 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.690+0000 7f253fb199c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:20:26.708 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7f253fb199c0 thread_name:radosgw-admin 2024-09-12T17:20:26.708 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:26.708 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:20:26.708 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2542272520] 2024-09-12T17:20:26.708 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:20:26.709 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:20:26.709 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:20:26.709 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f25433f3345] 2024-09-12T17:20:26.709 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f25433f349f] 2024-09-12T17:20:26.709 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562de72100c1] 2024-09-12T17:20:26.709 INFO:tasks.workunit.client.0.smithi016.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562de72221fa] 2024-09-12T17:20:26.709 INFO:tasks.workunit.client.0.smithi016.stderr: 9: main() 2024-09-12T17:20:26.709 INFO:tasks.workunit.client.0.smithi016.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2542259d90] 2024-09-12T17:20:26.709 INFO:tasks.workunit.client.0.smithi016.stderr: 11: __libc_start_main() 2024-09-12T17:20:26.709 INFO:tasks.workunit.client.0.smithi016.stderr: 12: _start() 2024-09-12T17:20:26.709 INFO:tasks.workunit.client.0.smithi016.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:20:26.709 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:26.710 INFO:tasks.workunit.client.0.smithi016.stderr:--- begin dump of recent events --- 2024-09-12T17:20:26.710 INFO:tasks.workunit.client.0.smithi016.stderr: -499> 2024-09-12T17:20:26.166+0000 7f253ce1e640 10 monclient: _finish_hunting 0 2024-09-12T17:20:26.710 INFO:tasks.workunit.client.0.smithi016.stderr: -498> 2024-09-12T17:20:26.166+0000 7f253ce1e640 1 monclient: found mon.noname-a 2024-09-12T17:20:26.710 INFO:tasks.workunit.client.0.smithi016.stderr: -497> 2024-09-12T17:20:26.166+0000 7f253ce1e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:20:26.710 INFO:tasks.workunit.client.0.smithi016.stderr: -496> 2024-09-12T17:20:26.166+0000 7f242b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:20:26.710 INFO:tasks.workunit.client.0.smithi016.stderr: -495> 2024-09-12T17:20:26.166+0000 7f242b606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:20:26.710 INFO:tasks.workunit.client.0.smithi016.stderr: -494> 2024-09-12T17:20:26.166+0000 7f242b606640 10 monclient: dump: 2024-09-12T17:20:26.710 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:20:26.710 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:20:26.710 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:20:26.710 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:20:26.710 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:20:26.711 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:20:26.711 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:20:26.711 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:20:26.711 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:20:26.711 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:26.711 INFO:tasks.workunit.client.0.smithi016.stderr: -493> 2024-09-12T17:20:26.166+0000 7f242b606640 10 monclient: _finish_auth 0 2024-09-12T17:20:26.711 INFO:tasks.workunit.client.0.smithi016.stderr: -492> 2024-09-12T17:20:26.166+0000 7f242b606640 10 monclient: _check_auth_tickets 2024-09-12T17:20:26.711 INFO:tasks.workunit.client.0.smithi016.stderr: -491> 2024-09-12T17:20:26.166+0000 7f242b606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:20:26.711 INFO:tasks.workunit.client.0.smithi016.stderr: -490> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 monclient: authenticate success, global_id 7458 2024-09-12T17:20:26.711 INFO:tasks.workunit.client.0.smithi016.stderr: -489> 2024-09-12T17:20:26.166+0000 7f253fb199c0 10 monclient: get_monmap_and_config success 2024-09-12T17:20:26.711 INFO:tasks.workunit.client.0.smithi016.stderr: -488> 2024-09-12T17:20:26.166+0000 7f253fb199c0 4 set_mon_vals no callback set 2024-09-12T17:20:26.711 INFO:tasks.workunit.client.0.smithi016.stderr: -487> 2024-09-12T17:20:26.166+0000 7f242b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:20:26.711 INFO:tasks.workunit.client.0.smithi016.stderr: -486> 2024-09-12T17:20:26.166+0000 7f242b606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:20:26.711 INFO:tasks.workunit.client.0.smithi016.stderr: -485> 2024-09-12T17:20:26.166+0000 7f242b606640 10 monclient: dump: 2024-09-12T17:20:26.711 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:20:26.712 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:20:26.712 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:20:26.712 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:20:26.712 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:20:26.712 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:20:26.712 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:20:26.712 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:20:26.712 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:20:26.712 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:26.712 INFO:tasks.workunit.client.0.smithi016.stderr: -484> 2024-09-12T17:20:26.166+0000 7f253fb199c0 10 monclient: shutdown 2024-09-12T17:20:26.712 INFO:tasks.workunit.client.0.smithi016.stderr: -483> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 asok(0x562de8d5f2b0) unregister_commands rotate-key 2024-09-12T17:20:26.712 INFO:tasks.workunit.client.0.smithi016.stderr: -482> 2024-09-12T17:20:26.166+0000 7f253fb199c0 10 monclient: build_initial_monmap 2024-09-12T17:20:26.713 INFO:tasks.workunit.client.0.smithi016.stderr: -481> 2024-09-12T17:20:26.166+0000 7f253fb199c0 1 build_initial for_mkfs: 0 2024-09-12T17:20:26.713 INFO:tasks.workunit.client.0.smithi016.stderr: -480> 2024-09-12T17:20:26.166+0000 7f253fb199c0 10 monclient: monmap: 2024-09-12T17:20:26.713 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:20:26.713 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:20:26.713 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:20:26.713 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:20:26.713 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:20:26.713 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:20:26.713 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:20:26.713 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:20:26.713 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:20:26.713 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:26.713 INFO:tasks.workunit.client.0.smithi016.stderr: -479> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f72fc0) adding auth protocol: cephx 2024-09-12T17:20:26.713 INFO:tasks.workunit.client.0.smithi016.stderr: -478> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f72fc0) adding auth protocol: cephx 2024-09-12T17:20:26.713 INFO:tasks.workunit.client.0.smithi016.stderr: -477> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f72fc0) adding auth protocol: cephx 2024-09-12T17:20:26.714 INFO:tasks.workunit.client.0.smithi016.stderr: -476> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f72fc0) adding con mode: secure 2024-09-12T17:20:26.714 INFO:tasks.workunit.client.0.smithi016.stderr: -475> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f72fc0) adding con mode: crc 2024-09-12T17:20:26.714 INFO:tasks.workunit.client.0.smithi016.stderr: -474> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f72fc0) adding con mode: secure 2024-09-12T17:20:26.714 INFO:tasks.workunit.client.0.smithi016.stderr: -473> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f72fc0) adding con mode: crc 2024-09-12T17:20:26.714 INFO:tasks.workunit.client.0.smithi016.stderr: -472> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f72fc0) adding con mode: secure 2024-09-12T17:20:26.714 INFO:tasks.workunit.client.0.smithi016.stderr: -471> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f72fc0) adding con mode: crc 2024-09-12T17:20:26.714 INFO:tasks.workunit.client.0.smithi016.stderr: -470> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f72fc0) adding con mode: crc 2024-09-12T17:20:26.714 INFO:tasks.workunit.client.0.smithi016.stderr: -469> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f72fc0) adding con mode: secure 2024-09-12T17:20:26.714 INFO:tasks.workunit.client.0.smithi016.stderr: -468> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f72fc0) adding con mode: crc 2024-09-12T17:20:26.714 INFO:tasks.workunit.client.0.smithi016.stderr: -467> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f72fc0) adding con mode: secure 2024-09-12T17:20:26.714 INFO:tasks.workunit.client.0.smithi016.stderr: -466> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f72fc0) adding con mode: crc 2024-09-12T17:20:26.714 INFO:tasks.workunit.client.0.smithi016.stderr: -465> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f72fc0) adding con mode: secure 2024-09-12T17:20:26.714 INFO:tasks.workunit.client.0.smithi016.stderr: -464> 2024-09-12T17:20:26.166+0000 7f253fb199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:20:26.714 INFO:tasks.workunit.client.0.smithi016.stderr: -463> 2024-09-12T17:20:26.166+0000 7f253fb199c0 1 librados: starting msgr at 2024-09-12T17:20:26.715 INFO:tasks.workunit.client.0.smithi016.stderr: -462> 2024-09-12T17:20:26.166+0000 7f253fb199c0 1 librados: starting objecter 2024-09-12T17:20:26.715 INFO:tasks.workunit.client.0.smithi016.stderr: -461> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 asok(0x562de8d5f2b0) register_command objecter_requests hook 0x562de8cd9de0 2024-09-12T17:20:26.715 INFO:tasks.workunit.client.0.smithi016.stderr: -460> 2024-09-12T17:20:26.166+0000 7f253fb199c0 1 librados: setting wanted keys 2024-09-12T17:20:26.715 INFO:tasks.workunit.client.0.smithi016.stderr: -459> 2024-09-12T17:20:26.166+0000 7f253fb199c0 1 librados: calling monclient init 2024-09-12T17:20:26.715 INFO:tasks.workunit.client.0.smithi016.stderr: -458> 2024-09-12T17:20:26.166+0000 7f253fb199c0 10 monclient: init 2024-09-12T17:20:26.715 INFO:tasks.workunit.client.0.smithi016.stderr: -457> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f6c380) adding auth protocol: cephx 2024-09-12T17:20:26.715 INFO:tasks.workunit.client.0.smithi016.stderr: -456> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f6c380) adding auth protocol: cephx 2024-09-12T17:20:26.715 INFO:tasks.workunit.client.0.smithi016.stderr: -455> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f6c380) adding auth protocol: cephx 2024-09-12T17:20:26.715 INFO:tasks.workunit.client.0.smithi016.stderr: -454> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f6c380) adding con mode: secure 2024-09-12T17:20:26.715 INFO:tasks.workunit.client.0.smithi016.stderr: -453> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f6c380) adding con mode: crc 2024-09-12T17:20:26.715 INFO:tasks.workunit.client.0.smithi016.stderr: -452> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f6c380) adding con mode: secure 2024-09-12T17:20:26.715 INFO:tasks.workunit.client.0.smithi016.stderr: -451> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f6c380) adding con mode: crc 2024-09-12T17:20:26.716 INFO:tasks.workunit.client.0.smithi016.stderr: -450> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f6c380) adding con mode: secure 2024-09-12T17:20:26.716 INFO:tasks.workunit.client.0.smithi016.stderr: -449> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f6c380) adding con mode: crc 2024-09-12T17:20:26.716 INFO:tasks.workunit.client.0.smithi016.stderr: -448> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f6c380) adding con mode: crc 2024-09-12T17:20:26.716 INFO:tasks.workunit.client.0.smithi016.stderr: -447> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f6c380) adding con mode: secure 2024-09-12T17:20:26.716 INFO:tasks.workunit.client.0.smithi016.stderr: -446> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f6c380) adding con mode: crc 2024-09-12T17:20:26.716 INFO:tasks.workunit.client.0.smithi016.stderr: -445> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f6c380) adding con mode: secure 2024-09-12T17:20:26.716 INFO:tasks.workunit.client.0.smithi016.stderr: -444> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f6c380) adding con mode: crc 2024-09-12T17:20:26.716 INFO:tasks.workunit.client.0.smithi016.stderr: -443> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f6c380) adding con mode: secure 2024-09-12T17:20:26.716 INFO:tasks.workunit.client.0.smithi016.stderr: -442> 2024-09-12T17:20:26.170+0000 7f253fb199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:20:26.716 INFO:tasks.workunit.client.0.smithi016.stderr: -441> 2024-09-12T17:20:26.170+0000 7f253fb199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:20:26.716 INFO:tasks.workunit.client.0.smithi016.stderr: -440> 2024-09-12T17:20:26.170+0000 7f253fb199c0 5 asok(0x562de8d5f2b0) register_command rotate-key hook 0x562de8f6c4c8 2024-09-12T17:20:26.716 INFO:tasks.workunit.client.0.smithi016.stderr: -439> 2024-09-12T17:20:26.170+0000 7f253fb199c0 10 monclient: _reopen_session rank -1 2024-09-12T17:20:26.716 INFO:tasks.workunit.client.0.smithi016.stderr: -438> 2024-09-12T17:20:26.170+0000 7f253fb199c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:20:26.716 INFO:tasks.workunit.client.0.smithi016.stderr: -437> 2024-09-12T17:20:26.170+0000 7f253fb199c0 10 monclient(hunting): picked mon.noname-b con 0x562de8e275b0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:20:26.717 INFO:tasks.workunit.client.0.smithi016.stderr: -436> 2024-09-12T17:20:26.170+0000 7f253fb199c0 10 monclient(hunting): picked mon.noname-c con 0x562de8eb4720 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:20:26.717 INFO:tasks.workunit.client.0.smithi016.stderr: -435> 2024-09-12T17:20:26.170+0000 7f253fb199c0 10 monclient(hunting): picked mon.noname-a con 0x562de8eb5070 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:20:26.717 INFO:tasks.workunit.client.0.smithi016.stderr: -434> 2024-09-12T17:20:26.170+0000 7f253fb199c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:20:26.717 INFO:tasks.workunit.client.0.smithi016.stderr: -433> 2024-09-12T17:20:26.170+0000 7f253fb199c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:20:26.717 INFO:tasks.workunit.client.0.smithi016.stderr: -432> 2024-09-12T17:20:26.170+0000 7f253fb199c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:20:26.717 INFO:tasks.workunit.client.0.smithi016.stderr: -431> 2024-09-12T17:20:26.170+0000 7f253fb199c0 10 monclient(hunting): _renew_subs 2024-09-12T17:20:26.717 INFO:tasks.workunit.client.0.smithi016.stderr: -430> 2024-09-12T17:20:26.170+0000 7f253fb199c0 10 monclient(hunting): authenticate will time out at 2344.144477s 2024-09-12T17:20:26.717 INFO:tasks.workunit.client.0.smithi016.stderr: -429> 2024-09-12T17:20:26.170+0000 7f253de20640 10 monclient(hunting): get_auth_request con 0x562de8eb5070 auth_method 0 2024-09-12T17:20:26.717 INFO:tasks.workunit.client.0.smithi016.stderr: -428> 2024-09-12T17:20:26.170+0000 7f253de20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:20:26.717 INFO:tasks.workunit.client.0.smithi016.stderr: -427> 2024-09-12T17:20:26.170+0000 7f253de20640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:20:26.717 INFO:tasks.workunit.client.0.smithi016.stderr: -426> 2024-09-12T17:20:26.170+0000 7f253de20640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:20:26.717 INFO:tasks.workunit.client.0.smithi016.stderr: -425> 2024-09-12T17:20:26.170+0000 7f253ce1e640 10 monclient(hunting): get_auth_request con 0x562de8eb4720 auth_method 0 2024-09-12T17:20:26.717 INFO:tasks.workunit.client.0.smithi016.stderr: -424> 2024-09-12T17:20:26.170+0000 7f253ce1e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:20:26.718 INFO:tasks.workunit.client.0.smithi016.stderr: -423> 2024-09-12T17:20:26.170+0000 7f253ce1e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:20:26.718 INFO:tasks.workunit.client.0.smithi016.stderr: -422> 2024-09-12T17:20:26.170+0000 7f253ce1e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:20:26.718 INFO:tasks.workunit.client.0.smithi016.stderr: -421> 2024-09-12T17:20:26.170+0000 7f253de20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:20:26.718 INFO:tasks.workunit.client.0.smithi016.stderr: -420> 2024-09-12T17:20:26.170+0000 7f253de20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:20:26.718 INFO:tasks.workunit.client.0.smithi016.stderr: -419> 2024-09-12T17:20:26.170+0000 7f253de20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:20:26.718 INFO:tasks.workunit.client.0.smithi016.stderr: -418> 2024-09-12T17:20:26.170+0000 7f253ce1e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:20:26.718 INFO:tasks.workunit.client.0.smithi016.stderr: -417> 2024-09-12T17:20:26.170+0000 7f253ce1e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:20:26.718 INFO:tasks.workunit.client.0.smithi016.stderr: -416> 2024-09-12T17:20:26.170+0000 7f253ce1e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:20:26.718 INFO:tasks.workunit.client.0.smithi016.stderr: -415> 2024-09-12T17:20:26.170+0000 7f253d61f640 10 monclient(hunting): get_auth_request con 0x562de8e275b0 auth_method 0 2024-09-12T17:20:26.718 INFO:tasks.workunit.client.0.smithi016.stderr: -414> 2024-09-12T17:20:26.170+0000 7f253d61f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:20:26.718 INFO:tasks.workunit.client.0.smithi016.stderr: -413> 2024-09-12T17:20:26.170+0000 7f253d61f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:20:26.718 INFO:tasks.workunit.client.0.smithi016.stderr: -412> 2024-09-12T17:20:26.170+0000 7f253d61f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:20:26.719 INFO:tasks.workunit.client.0.smithi016.stderr: -411> 2024-09-12T17:20:26.170+0000 7f253de20640 10 monclient(hunting): handle_auth_done global_id 7461 payload 824 2024-09-12T17:20:26.719 INFO:tasks.workunit.client.0.smithi016.stderr: -410> 2024-09-12T17:20:26.170+0000 7f253de20640 10 monclient: _finish_hunting 0 2024-09-12T17:20:26.719 INFO:tasks.workunit.client.0.smithi016.stderr: -409> 2024-09-12T17:20:26.170+0000 7f253de20640 1 monclient: found mon.noname-a 2024-09-12T17:20:26.719 INFO:tasks.workunit.client.0.smithi016.stderr: -408> 2024-09-12T17:20:26.170+0000 7f253de20640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:20:26.719 INFO:tasks.workunit.client.0.smithi016.stderr: -407> 2024-09-12T17:20:26.170+0000 7f2429e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:20:26.719 INFO:tasks.workunit.client.0.smithi016.stderr: -406> 2024-09-12T17:20:26.170+0000 7f2429e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:20:26.719 INFO:tasks.workunit.client.0.smithi016.stderr: -405> 2024-09-12T17:20:26.170+0000 7f2429e03640 10 monclient: dump: 2024-09-12T17:20:26.719 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:20:26.719 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:20:26.719 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:20:26.719 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:20:26.719 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:20:26.719 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:20:26.720 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:20:26.720 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:20:26.720 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:20:26.720 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:26.720 INFO:tasks.workunit.client.0.smithi016.stderr: -404> 2024-09-12T17:20:26.170+0000 7f2429e03640 10 monclient: _finish_auth 0 2024-09-12T17:20:26.720 INFO:tasks.workunit.client.0.smithi016.stderr: -403> 2024-09-12T17:20:26.170+0000 7f2429e03640 10 monclient: _check_auth_tickets 2024-09-12T17:20:26.720 INFO:tasks.workunit.client.0.smithi016.stderr: -402> 2024-09-12T17:20:26.170+0000 7f2429e03640 10 monclient: handle_config config(0 keys) 2024-09-12T17:20:26.720 INFO:tasks.workunit.client.0.smithi016.stderr: -401> 2024-09-12T17:20:26.170+0000 7f2429e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:20:26.720 INFO:tasks.workunit.client.0.smithi016.stderr: -400> 2024-09-12T17:20:26.170+0000 7f2429e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:20:26.720 INFO:tasks.workunit.client.0.smithi016.stderr: -399> 2024-09-12T17:20:26.170+0000 7f2429e03640 10 monclient: dump: 2024-09-12T17:20:26.720 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:20:26.720 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:20:26.720 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:20:26.721 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:20:26.721 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:20:26.721 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:20:26.721 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:20:26.721 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:20:26.721 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:20:26.721 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:26.721 INFO:tasks.workunit.client.0.smithi016.stderr: -398> 2024-09-12T17:20:26.170+0000 7f253fb199c0 5 monclient: authenticate success, global_id 7461 2024-09-12T17:20:26.721 INFO:tasks.workunit.client.0.smithi016.stderr: -397> 2024-09-12T17:20:26.170+0000 7f253fb199c0 10 monclient: _renew_subs 2024-09-12T17:20:26.721 INFO:tasks.workunit.client.0.smithi016.stderr: -396> 2024-09-12T17:20:26.170+0000 7f253fb199c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:20:26.721 INFO:tasks.workunit.client.0.smithi016.stderr: -395> 2024-09-12T17:20:26.170+0000 7f242b606640 4 set_mon_vals no callback set 2024-09-12T17:20:26.721 INFO:tasks.workunit.client.0.smithi016.stderr: -394> 2024-09-12T17:20:26.170+0000 7f253fb199c0 10 monclient: _renew_subs 2024-09-12T17:20:26.722 INFO:tasks.workunit.client.0.smithi016.stderr: -393> 2024-09-12T17:20:26.170+0000 7f253fb199c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:20:26.722 INFO:tasks.workunit.client.0.smithi016.stderr: -392> 2024-09-12T17:20:26.170+0000 7f253fb199c0 1 librados: init done 2024-09-12T17:20:26.722 INFO:tasks.workunit.client.0.smithi016.stderr: -391> 2024-09-12T17:20:26.170+0000 7f2429e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:20:26.722 INFO:tasks.workunit.client.0.smithi016.stderr: -390> 2024-09-12T17:20:26.170+0000 7f2429e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:20:26.722 INFO:tasks.workunit.client.0.smithi016.stderr: -389> 2024-09-12T17:20:26.170+0000 7f2429e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:20:26.722 INFO:tasks.workunit.client.0.smithi016.stderr: -388> 2024-09-12T17:20:26.170+0000 7f253d61f640 10 monclient: get_auth_request con 0x7f2424070ae0 auth_method 0 2024-09-12T17:20:26.722 INFO:tasks.workunit.client.0.smithi016.stderr: -387> 2024-09-12T17:20:26.170+0000 7f253ce1e640 10 monclient: get_auth_request con 0x562de8f94600 auth_method 0 2024-09-12T17:20:26.722 INFO:tasks.workunit.client.0.smithi016.stderr: -386> 2024-09-12T17:20:26.174+0000 7f253d61f640 10 monclient: get_auth_request con 0x562de8fb73d0 auth_method 0 2024-09-12T17:20:26.722 INFO:tasks.workunit.client.0.smithi016.stderr: -385> 2024-09-12T17:20:26.174+0000 7f253ce1e640 10 monclient: get_auth_request con 0x562de8fbb5c0 auth_method 0 2024-09-12T17:20:26.722 INFO:tasks.workunit.client.0.smithi016.stderr: -384> 2024-09-12T17:20:26.178+0000 7f253de20640 10 monclient: get_auth_request con 0x562de8fbac00 auth_method 0 2024-09-12T17:20:26.722 INFO:tasks.workunit.client.0.smithi016.stderr: -383> 2024-09-12T17:20:26.178+0000 7f253fb199c0 10 monclient: build_initial_monmap 2024-09-12T17:20:26.723 INFO:tasks.workunit.client.0.smithi016.stderr: -382> 2024-09-12T17:20:26.178+0000 7f253fb199c0 1 build_initial for_mkfs: 0 2024-09-12T17:20:26.723 INFO:tasks.workunit.client.0.smithi016.stderr: -381> 2024-09-12T17:20:26.178+0000 7f253fb199c0 10 monclient: monmap: 2024-09-12T17:20:26.723 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:20:26.723 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:20:26.723 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:20:26.723 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:20:26.723 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:20:26.723 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:20:26.723 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:20:26.723 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:20:26.723 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:20:26.723 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:26.723 INFO:tasks.workunit.client.0.smithi016.stderr: -380> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc3630) adding auth protocol: cephx 2024-09-12T17:20:26.724 INFO:tasks.workunit.client.0.smithi016.stderr: -379> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc3630) adding auth protocol: cephx 2024-09-12T17:20:26.724 INFO:tasks.workunit.client.0.smithi016.stderr: -378> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc3630) adding auth protocol: cephx 2024-09-12T17:20:26.724 INFO:tasks.workunit.client.0.smithi016.stderr: -377> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc3630) adding con mode: secure 2024-09-12T17:20:26.724 INFO:tasks.workunit.client.0.smithi016.stderr: -376> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc3630) adding con mode: crc 2024-09-12T17:20:26.724 INFO:tasks.workunit.client.0.smithi016.stderr: -375> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc3630) adding con mode: secure 2024-09-12T17:20:26.724 INFO:tasks.workunit.client.0.smithi016.stderr: -374> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc3630) adding con mode: crc 2024-09-12T17:20:26.724 INFO:tasks.workunit.client.0.smithi016.stderr: -373> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc3630) adding con mode: secure 2024-09-12T17:20:26.724 INFO:tasks.workunit.client.0.smithi016.stderr: -372> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc3630) adding con mode: crc 2024-09-12T17:20:26.724 INFO:tasks.workunit.client.0.smithi016.stderr: -371> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc3630) adding con mode: crc 2024-09-12T17:20:26.724 INFO:tasks.workunit.client.0.smithi016.stderr: -370> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc3630) adding con mode: secure 2024-09-12T17:20:26.724 INFO:tasks.workunit.client.0.smithi016.stderr: -369> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc3630) adding con mode: crc 2024-09-12T17:20:26.724 INFO:tasks.workunit.client.0.smithi016.stderr: -368> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc3630) adding con mode: secure 2024-09-12T17:20:26.725 INFO:tasks.workunit.client.0.smithi016.stderr: -367> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc3630) adding con mode: crc 2024-09-12T17:20:26.725 INFO:tasks.workunit.client.0.smithi016.stderr: -366> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc3630) adding con mode: secure 2024-09-12T17:20:26.725 INFO:tasks.workunit.client.0.smithi016.stderr: -365> 2024-09-12T17:20:26.178+0000 7f253fb199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:20:26.725 INFO:tasks.workunit.client.0.smithi016.stderr: -364> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 asok(0x562de8d5f2b0) register_command objecter_requests cmddesc objecter_requests hook 0x562de8fc6fb0 EEXIST 2024-09-12T17:20:26.725 INFO:tasks.workunit.client.0.smithi016.stderr: -363> 2024-09-12T17:20:26.178+0000 7f253fb199c0 10 monclient: init 2024-09-12T17:20:26.725 INFO:tasks.workunit.client.0.smithi016.stderr: -362> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc24d8) adding auth protocol: cephx 2024-09-12T17:20:26.725 INFO:tasks.workunit.client.0.smithi016.stderr: -361> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc24d8) adding auth protocol: cephx 2024-09-12T17:20:26.725 INFO:tasks.workunit.client.0.smithi016.stderr: -360> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc24d8) adding auth protocol: cephx 2024-09-12T17:20:26.725 INFO:tasks.workunit.client.0.smithi016.stderr: -359> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc24d8) adding con mode: secure 2024-09-12T17:20:26.725 INFO:tasks.workunit.client.0.smithi016.stderr: -358> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc24d8) adding con mode: crc 2024-09-12T17:20:26.725 INFO:tasks.workunit.client.0.smithi016.stderr: -357> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc24d8) adding con mode: secure 2024-09-12T17:20:26.725 INFO:tasks.workunit.client.0.smithi016.stderr: -356> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc24d8) adding con mode: crc 2024-09-12T17:20:26.726 INFO:tasks.workunit.client.0.smithi016.stderr: -355> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc24d8) adding con mode: secure 2024-09-12T17:20:26.726 INFO:tasks.workunit.client.0.smithi016.stderr: -354> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc24d8) adding con mode: crc 2024-09-12T17:20:26.726 INFO:tasks.workunit.client.0.smithi016.stderr: -353> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc24d8) adding con mode: crc 2024-09-12T17:20:26.726 INFO:tasks.workunit.client.0.smithi016.stderr: -352> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc24d8) adding con mode: secure 2024-09-12T17:20:26.726 INFO:tasks.workunit.client.0.smithi016.stderr: -351> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc24d8) adding con mode: crc 2024-09-12T17:20:26.726 INFO:tasks.workunit.client.0.smithi016.stderr: -350> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc24d8) adding con mode: secure 2024-09-12T17:20:26.726 INFO:tasks.workunit.client.0.smithi016.stderr: -349> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc24d8) adding con mode: crc 2024-09-12T17:20:26.726 INFO:tasks.workunit.client.0.smithi016.stderr: -348> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc24d8) adding con mode: secure 2024-09-12T17:20:26.726 INFO:tasks.workunit.client.0.smithi016.stderr: -347> 2024-09-12T17:20:26.178+0000 7f253fb199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:20:26.726 INFO:tasks.workunit.client.0.smithi016.stderr: -346> 2024-09-12T17:20:26.178+0000 7f253fb199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:20:26.726 INFO:tasks.workunit.client.0.smithi016.stderr: -345> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 asok(0x562de8d5f2b0) register_command rotate-key cmddesc rotate-key hook 0x562de8fc2620 EEXIST 2024-09-12T17:20:26.726 INFO:tasks.workunit.client.0.smithi016.stderr: -344> 2024-09-12T17:20:26.178+0000 7f253fb199c0 10 monclient: _reopen_session rank -1 2024-09-12T17:20:26.726 INFO:tasks.workunit.client.0.smithi016.stderr: -343> 2024-09-12T17:20:26.178+0000 7f253fb199c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:20:26.727 INFO:tasks.workunit.client.0.smithi016.stderr: -342> 2024-09-12T17:20:26.178+0000 7f253fb199c0 10 monclient(hunting): picked mon.noname-b con 0x562de8feb160 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:20:26.727 INFO:tasks.workunit.client.0.smithi016.stderr: -341> 2024-09-12T17:20:26.178+0000 7f253fb199c0 10 monclient(hunting): picked mon.noname-a con 0x562de8feaa90 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:20:26.727 INFO:tasks.workunit.client.0.smithi016.stderr: -340> 2024-09-12T17:20:26.178+0000 7f253fb199c0 10 monclient(hunting): picked mon.noname-c con 0x562de8fe9470 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:20:26.727 INFO:tasks.workunit.client.0.smithi016.stderr: -339> 2024-09-12T17:20:26.178+0000 7f253fb199c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:20:26.727 INFO:tasks.workunit.client.0.smithi016.stderr: -338> 2024-09-12T17:20:26.178+0000 7f253fb199c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:20:26.727 INFO:tasks.workunit.client.0.smithi016.stderr: -337> 2024-09-12T17:20:26.178+0000 7f253fb199c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:20:26.727 INFO:tasks.workunit.client.0.smithi016.stderr: -336> 2024-09-12T17:20:26.178+0000 7f253fb199c0 10 monclient(hunting): _renew_subs 2024-09-12T17:20:26.727 INFO:tasks.workunit.client.0.smithi016.stderr: -335> 2024-09-12T17:20:26.178+0000 7f253fb199c0 10 monclient(hunting): authenticate will time out at 2344.155911s 2024-09-12T17:20:26.727 INFO:tasks.workunit.client.0.smithi016.stderr: -334> 2024-09-12T17:20:26.182+0000 7f253de20640 10 monclient(hunting): get_auth_request con 0x562de8feaa90 auth_method 0 2024-09-12T17:20:26.727 INFO:tasks.workunit.client.0.smithi016.stderr: -333> 2024-09-12T17:20:26.182+0000 7f253de20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:20:26.727 INFO:tasks.workunit.client.0.smithi016.stderr: -332> 2024-09-12T17:20:26.182+0000 7f253de20640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:20:26.727 INFO:tasks.workunit.client.0.smithi016.stderr: -331> 2024-09-12T17:20:26.182+0000 7f253de20640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:20:26.728 INFO:tasks.workunit.client.0.smithi016.stderr: -330> 2024-09-12T17:20:26.182+0000 7f253d61f640 10 monclient(hunting): get_auth_request con 0x562de8fe9470 auth_method 0 2024-09-12T17:20:26.728 INFO:tasks.workunit.client.0.smithi016.stderr: -329> 2024-09-12T17:20:26.182+0000 7f253d61f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:20:26.728 INFO:tasks.workunit.client.0.smithi016.stderr: -328> 2024-09-12T17:20:26.182+0000 7f253d61f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:20:26.728 INFO:tasks.workunit.client.0.smithi016.stderr: -327> 2024-09-12T17:20:26.182+0000 7f253d61f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:20:26.728 INFO:tasks.workunit.client.0.smithi016.stderr: -326> 2024-09-12T17:20:26.182+0000 7f253de20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:20:26.728 INFO:tasks.workunit.client.0.smithi016.stderr: -325> 2024-09-12T17:20:26.182+0000 7f253de20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:20:26.728 INFO:tasks.workunit.client.0.smithi016.stderr: -324> 2024-09-12T17:20:26.182+0000 7f253de20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:20:26.728 INFO:tasks.workunit.client.0.smithi016.stderr: -323> 2024-09-12T17:20:26.182+0000 7f253d61f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:20:26.728 INFO:tasks.workunit.client.0.smithi016.stderr: -322> 2024-09-12T17:20:26.182+0000 7f253d61f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:20:26.728 INFO:tasks.workunit.client.0.smithi016.stderr: -321> 2024-09-12T17:20:26.182+0000 7f253d61f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:20:26.728 INFO:tasks.workunit.client.0.smithi016.stderr: -320> 2024-09-12T17:20:26.182+0000 7f253ce1e640 10 monclient(hunting): get_auth_request con 0x562de8feb160 auth_method 0 2024-09-12T17:20:26.728 INFO:tasks.workunit.client.0.smithi016.stderr: -319> 2024-09-12T17:20:26.182+0000 7f253ce1e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:20:26.728 INFO:tasks.workunit.client.0.smithi016.stderr: -318> 2024-09-12T17:20:26.182+0000 7f253ce1e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:20:26.729 INFO:tasks.workunit.client.0.smithi016.stderr: -317> 2024-09-12T17:20:26.182+0000 7f253ce1e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:20:26.729 INFO:tasks.workunit.client.0.smithi016.stderr: -316> 2024-09-12T17:20:26.182+0000 7f253de20640 10 monclient(hunting): handle_auth_done global_id 7464 payload 824 2024-09-12T17:20:26.729 INFO:tasks.workunit.client.0.smithi016.stderr: -315> 2024-09-12T17:20:26.182+0000 7f253de20640 10 monclient: _finish_hunting 0 2024-09-12T17:20:26.729 INFO:tasks.workunit.client.0.smithi016.stderr: -314> 2024-09-12T17:20:26.182+0000 7f253de20640 1 monclient: found mon.noname-a 2024-09-12T17:20:26.729 INFO:tasks.workunit.client.0.smithi016.stderr: -313> 2024-09-12T17:20:26.182+0000 7f253de20640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:20:26.729 INFO:tasks.workunit.client.0.smithi016.stderr: -312> 2024-09-12T17:20:26.182+0000 7f2422ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:20:26.729 INFO:tasks.workunit.client.0.smithi016.stderr: -311> 2024-09-12T17:20:26.182+0000 7f2422ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:20:26.729 INFO:tasks.workunit.client.0.smithi016.stderr: -310> 2024-09-12T17:20:26.182+0000 7f2422ffd640 10 monclient: dump: 2024-09-12T17:20:26.729 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:20:26.729 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:20:26.729 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:20:26.729 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:20:26.730 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:20:26.730 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:20:26.730 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:20:26.730 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:20:26.730 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:20:26.730 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:26.730 INFO:tasks.workunit.client.0.smithi016.stderr: -309> 2024-09-12T17:20:26.182+0000 7f2422ffd640 10 monclient: _finish_auth 0 2024-09-12T17:20:26.730 INFO:tasks.workunit.client.0.smithi016.stderr: -308> 2024-09-12T17:20:26.182+0000 7f2422ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:20:26.730 INFO:tasks.workunit.client.0.smithi016.stderr: -307> 2024-09-12T17:20:26.182+0000 7f2422ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:20:26.730 INFO:tasks.workunit.client.0.smithi016.stderr: -306> 2024-09-12T17:20:26.182+0000 7f2422ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:20:26.732 INFO:tasks.workunit.client.0.smithi016.stderr: -305> 2024-09-12T17:20:26.182+0000 7f2422ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:20:26.733 INFO:tasks.workunit.client.0.smithi016.stderr: -304> 2024-09-12T17:20:26.182+0000 7f2422ffd640 10 monclient: dump: 2024-09-12T17:20:26.733 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:20:26.733 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:20:26.733 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:20:26.733 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:20:26.733 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:20:26.733 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:20:26.733 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:20:26.733 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:20:26.733 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:20:26.733 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:26.733 INFO:tasks.workunit.client.0.smithi016.stderr: -303> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 monclient: authenticate success, global_id 7464 2024-09-12T17:20:26.734 INFO:tasks.workunit.client.0.smithi016.stderr: -302> 2024-09-12T17:20:26.182+0000 7f253e621640 4 set_mon_vals no callback set 2024-09-12T17:20:26.734 INFO:tasks.workunit.client.0.smithi016.stderr: -301> 2024-09-12T17:20:26.182+0000 7f253fb199c0 10 monclient: _renew_subs 2024-09-12T17:20:26.734 INFO:tasks.workunit.client.0.smithi016.stderr: -300> 2024-09-12T17:20:26.182+0000 7f253fb199c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:20:26.734 INFO:tasks.workunit.client.0.smithi016.stderr: -299> 2024-09-12T17:20:26.182+0000 7f253fb199c0 10 monclient: _renew_subs 2024-09-12T17:20:26.734 INFO:tasks.workunit.client.0.smithi016.stderr: -298> 2024-09-12T17:20:26.182+0000 7f253fb199c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:20:26.734 INFO:tasks.workunit.client.0.smithi016.stderr: -297> 2024-09-12T17:20:26.182+0000 7f2422ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:20:26.734 INFO:tasks.workunit.client.0.smithi016.stderr: -296> 2024-09-12T17:20:26.182+0000 7f2422ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:20:26.734 INFO:tasks.workunit.client.0.smithi016.stderr: -295> 2024-09-12T17:20:26.182+0000 7f2422ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:20:26.734 INFO:tasks.workunit.client.0.smithi016.stderr: -294> 2024-09-12T17:20:26.182+0000 7f253fb199c0 10 monclient: get_monmap_and_config 2024-09-12T17:20:26.734 INFO:tasks.workunit.client.0.smithi016.stderr: -293> 2024-09-12T17:20:26.182+0000 7f253fb199c0 10 monclient: build_initial_monmap 2024-09-12T17:20:26.734 INFO:tasks.workunit.client.0.smithi016.stderr: -292> 2024-09-12T17:20:26.182+0000 7f253fb199c0 1 build_initial for_mkfs: 0 2024-09-12T17:20:26.734 INFO:tasks.workunit.client.0.smithi016.stderr: -291> 2024-09-12T17:20:26.182+0000 7f253fb199c0 10 monclient: monmap: 2024-09-12T17:20:26.734 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:20:26.735 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:20:26.735 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:20:26.735 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:20:26.735 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:20:26.735 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:20:26.735 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:20:26.735 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:20:26.735 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:20:26.735 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:26.735 INFO:tasks.workunit.client.0.smithi016.stderr: -290> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x562de900aaa0) adding auth protocol: cephx 2024-09-12T17:20:26.735 INFO:tasks.workunit.client.0.smithi016.stderr: -289> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x562de900aaa0) adding auth protocol: cephx 2024-09-12T17:20:26.735 INFO:tasks.workunit.client.0.smithi016.stderr: -288> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x562de900aaa0) adding auth protocol: cephx 2024-09-12T17:20:26.735 INFO:tasks.workunit.client.0.smithi016.stderr: -287> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x562de900aaa0) adding con mode: secure 2024-09-12T17:20:26.736 INFO:tasks.workunit.client.0.smithi016.stderr: -286> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x562de900aaa0) adding con mode: crc 2024-09-12T17:20:26.736 INFO:tasks.workunit.client.0.smithi016.stderr: -285> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x562de900aaa0) adding con mode: secure 2024-09-12T17:20:26.736 INFO:tasks.workunit.client.0.smithi016.stderr: -284> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x562de900aaa0) adding con mode: crc 2024-09-12T17:20:26.736 INFO:tasks.workunit.client.0.smithi016.stderr: -283> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x562de900aaa0) adding con mode: secure 2024-09-12T17:20:26.736 INFO:tasks.workunit.client.0.smithi016.stderr: -282> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x562de900aaa0) adding con mode: crc 2024-09-12T17:20:26.736 INFO:tasks.workunit.client.0.smithi016.stderr: -281> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x562de900aaa0) adding con mode: crc 2024-09-12T17:20:26.736 INFO:tasks.workunit.client.0.smithi016.stderr: -280> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x562de900aaa0) adding con mode: secure 2024-09-12T17:20:26.736 INFO:tasks.workunit.client.0.smithi016.stderr: -279> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x562de900aaa0) adding con mode: crc 2024-09-12T17:20:26.736 INFO:tasks.workunit.client.0.smithi016.stderr: -278> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x562de900aaa0) adding con mode: secure 2024-09-12T17:20:26.736 INFO:tasks.workunit.client.0.smithi016.stderr: -277> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x562de900aaa0) adding con mode: crc 2024-09-12T17:20:26.736 INFO:tasks.workunit.client.0.smithi016.stderr: -276> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x562de900aaa0) adding con mode: secure 2024-09-12T17:20:26.736 INFO:tasks.workunit.client.0.smithi016.stderr: -275> 2024-09-12T17:20:26.182+0000 7f253ce1e640 10 monclient: get_auth_request con 0x7f2418070a20 auth_method 0 2024-09-12T17:20:26.737 INFO:tasks.workunit.client.0.smithi016.stderr: -274> 2024-09-12T17:20:26.182+0000 7f253fb199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:20:26.737 INFO:tasks.workunit.client.0.smithi016.stderr: -273> 2024-09-12T17:20:26.182+0000 7f253fb199c0 10 monclient: init 2024-09-12T17:20:26.737 INFO:tasks.workunit.client.0.smithi016.stderr: -272> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf090) adding auth protocol: cephx 2024-09-12T17:20:26.737 INFO:tasks.workunit.client.0.smithi016.stderr: -271> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf090) adding auth protocol: cephx 2024-09-12T17:20:26.737 INFO:tasks.workunit.client.0.smithi016.stderr: -270> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf090) adding auth protocol: cephx 2024-09-12T17:20:26.737 INFO:tasks.workunit.client.0.smithi016.stderr: -269> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf090) adding con mode: secure 2024-09-12T17:20:26.737 INFO:tasks.workunit.client.0.smithi016.stderr: -268> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf090) adding con mode: crc 2024-09-12T17:20:26.737 INFO:tasks.workunit.client.0.smithi016.stderr: -267> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf090) adding con mode: secure 2024-09-12T17:20:26.737 INFO:tasks.workunit.client.0.smithi016.stderr: -266> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf090) adding con mode: crc 2024-09-12T17:20:26.737 INFO:tasks.workunit.client.0.smithi016.stderr: -265> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf090) adding con mode: secure 2024-09-12T17:20:26.737 INFO:tasks.workunit.client.0.smithi016.stderr: -264> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf090) adding con mode: crc 2024-09-12T17:20:26.737 INFO:tasks.workunit.client.0.smithi016.stderr: -263> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf090) adding con mode: crc 2024-09-12T17:20:26.737 INFO:tasks.workunit.client.0.smithi016.stderr: -262> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf090) adding con mode: secure 2024-09-12T17:20:26.737 INFO:tasks.workunit.client.0.smithi016.stderr: -261> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf090) adding con mode: crc 2024-09-12T17:20:26.738 INFO:tasks.workunit.client.0.smithi016.stderr: -260> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf090) adding con mode: secure 2024-09-12T17:20:26.738 INFO:tasks.workunit.client.0.smithi016.stderr: -259> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf090) adding con mode: crc 2024-09-12T17:20:26.738 INFO:tasks.workunit.client.0.smithi016.stderr: -258> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf090) adding con mode: secure 2024-09-12T17:20:26.738 INFO:tasks.workunit.client.0.smithi016.stderr: -257> 2024-09-12T17:20:26.182+0000 7f253fb199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:20:26.738 INFO:tasks.workunit.client.0.smithi016.stderr: -256> 2024-09-12T17:20:26.182+0000 7f253fb199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:20:26.738 INFO:tasks.workunit.client.0.smithi016.stderr: -255> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 asok(0x562de8d5f2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc550cf1d8 EEXIST 2024-09-12T17:20:26.738 INFO:tasks.workunit.client.0.smithi016.stderr: -254> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient: _reopen_session rank -1 2024-09-12T17:20:26.738 INFO:tasks.workunit.client.0.smithi016.stderr: -253> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:20:26.738 INFO:tasks.workunit.client.0.smithi016.stderr: -252> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient(hunting): picked mon.noname-b con 0x562de903f010 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:20:26.738 INFO:tasks.workunit.client.0.smithi016.stderr: -251> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient(hunting): picked mon.noname-c con 0x562de9039230 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:20:26.738 INFO:tasks.workunit.client.0.smithi016.stderr: -250> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient(hunting): picked mon.noname-a con 0x562de903a470 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:20:26.738 INFO:tasks.workunit.client.0.smithi016.stderr: -249> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:20:26.739 INFO:tasks.workunit.client.0.smithi016.stderr: -248> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:20:26.739 INFO:tasks.workunit.client.0.smithi016.stderr: -247> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:20:26.739 INFO:tasks.workunit.client.0.smithi016.stderr: -246> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient(hunting): _renew_subs 2024-09-12T17:20:26.739 INFO:tasks.workunit.client.0.smithi016.stderr: -245> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient(hunting): authenticate will time out at 2344.160084s 2024-09-12T17:20:26.739 INFO:tasks.workunit.client.0.smithi016.stderr: -244> 2024-09-12T17:20:26.186+0000 7f253d61f640 10 monclient(hunting): get_auth_request con 0x562de903a470 auth_method 0 2024-09-12T17:20:26.739 INFO:tasks.workunit.client.0.smithi016.stderr: -243> 2024-09-12T17:20:26.186+0000 7f253d61f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:20:26.739 INFO:tasks.workunit.client.0.smithi016.stderr: -242> 2024-09-12T17:20:26.186+0000 7f253d61f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:20:26.739 INFO:tasks.workunit.client.0.smithi016.stderr: -241> 2024-09-12T17:20:26.186+0000 7f253d61f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:20:26.739 INFO:tasks.workunit.client.0.smithi016.stderr: -240> 2024-09-12T17:20:26.186+0000 7f253de20640 10 monclient(hunting): get_auth_request con 0x562de9039230 auth_method 0 2024-09-12T17:20:26.739 INFO:tasks.workunit.client.0.smithi016.stderr: -239> 2024-09-12T17:20:26.186+0000 7f253de20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:20:26.740 INFO:tasks.workunit.client.0.smithi016.stderr: -238> 2024-09-12T17:20:26.186+0000 7f253de20640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:20:26.740 INFO:tasks.workunit.client.0.smithi016.stderr: -237> 2024-09-12T17:20:26.186+0000 7f253de20640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:20:26.740 INFO:tasks.workunit.client.0.smithi016.stderr: -236> 2024-09-12T17:20:26.186+0000 7f253de20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:20:26.740 INFO:tasks.workunit.client.0.smithi016.stderr: -235> 2024-09-12T17:20:26.186+0000 7f253de20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:20:26.740 INFO:tasks.workunit.client.0.smithi016.stderr: -234> 2024-09-12T17:20:26.186+0000 7f253de20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:20:26.740 INFO:tasks.workunit.client.0.smithi016.stderr: -233> 2024-09-12T17:20:26.186+0000 7f253d61f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:20:26.740 INFO:tasks.workunit.client.0.smithi016.stderr: -232> 2024-09-12T17:20:26.186+0000 7f253d61f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:20:26.740 INFO:tasks.workunit.client.0.smithi016.stderr: -231> 2024-09-12T17:20:26.186+0000 7f253d61f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:20:26.740 INFO:tasks.workunit.client.0.smithi016.stderr: -230> 2024-09-12T17:20:26.186+0000 7f253ce1e640 10 monclient(hunting): get_auth_request con 0x562de903f010 auth_method 0 2024-09-12T17:20:26.740 INFO:tasks.workunit.client.0.smithi016.stderr: -229> 2024-09-12T17:20:26.186+0000 7f253ce1e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:20:26.740 INFO:tasks.workunit.client.0.smithi016.stderr: -228> 2024-09-12T17:20:26.186+0000 7f253ce1e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:20:26.740 INFO:tasks.workunit.client.0.smithi016.stderr: -227> 2024-09-12T17:20:26.186+0000 7f253ce1e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:20:26.741 INFO:tasks.workunit.client.0.smithi016.stderr: -226> 2024-09-12T17:20:26.186+0000 7f253de20640 10 monclient(hunting): handle_auth_done global_id 7115 payload 274 2024-09-12T17:20:26.741 INFO:tasks.workunit.client.0.smithi016.stderr: -225> 2024-09-12T17:20:26.186+0000 7f253de20640 10 monclient: _finish_hunting 0 2024-09-12T17:20:26.741 INFO:tasks.workunit.client.0.smithi016.stderr: -224> 2024-09-12T17:20:26.186+0000 7f253de20640 1 monclient: found mon.noname-c 2024-09-12T17:20:26.741 INFO:tasks.workunit.client.0.smithi016.stderr: -223> 2024-09-12T17:20:26.186+0000 7f253de20640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:20:26.741 INFO:tasks.workunit.client.0.smithi016.stderr: -222> 2024-09-12T17:20:26.186+0000 7f2420ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:20:26.741 INFO:tasks.workunit.client.0.smithi016.stderr: -221> 2024-09-12T17:20:26.186+0000 7f2420ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:20:26.741 INFO:tasks.workunit.client.0.smithi016.stderr: -220> 2024-09-12T17:20:26.186+0000 7f2420ff9640 10 monclient: dump: 2024-09-12T17:20:26.741 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:20:26.741 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:20:26.741 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:20:26.741 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:20:26.741 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:20:26.741 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:20:26.742 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:20:26.742 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:20:26.742 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:20:26.742 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:26.742 INFO:tasks.workunit.client.0.smithi016.stderr: -219> 2024-09-12T17:20:26.186+0000 7f2420ff9640 10 monclient: _finish_auth 0 2024-09-12T17:20:26.742 INFO:tasks.workunit.client.0.smithi016.stderr: -218> 2024-09-12T17:20:26.186+0000 7f2420ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:20:26.742 INFO:tasks.workunit.client.0.smithi016.stderr: -217> 2024-09-12T17:20:26.186+0000 7f2420ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:20:26.742 INFO:tasks.workunit.client.0.smithi016.stderr: -216> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 monclient: authenticate success, global_id 7115 2024-09-12T17:20:26.742 INFO:tasks.workunit.client.0.smithi016.stderr: -215> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient: get_monmap_and_config success 2024-09-12T17:20:26.742 INFO:tasks.workunit.client.0.smithi016.stderr: -214> 2024-09-12T17:20:26.186+0000 7f253fb199c0 4 set_mon_vals no callback set 2024-09-12T17:20:26.742 INFO:tasks.workunit.client.0.smithi016.stderr: -213> 2024-09-12T17:20:26.186+0000 7f2420ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:20:26.742 INFO:tasks.workunit.client.0.smithi016.stderr: -212> 2024-09-12T17:20:26.186+0000 7f2420ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:20:26.742 INFO:tasks.workunit.client.0.smithi016.stderr: -211> 2024-09-12T17:20:26.186+0000 7f2420ff9640 10 monclient: dump: 2024-09-12T17:20:26.742 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:20:26.743 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:20:26.743 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:20:26.743 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:20:26.743 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:20:26.743 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:20:26.743 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:20:26.743 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:20:26.743 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:20:26.743 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:26.743 INFO:tasks.workunit.client.0.smithi016.stderr: -210> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient: shutdown 2024-09-12T17:20:26.743 INFO:tasks.workunit.client.0.smithi016.stderr: -209> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient: build_initial_monmap 2024-09-12T17:20:26.743 INFO:tasks.workunit.client.0.smithi016.stderr: -208> 2024-09-12T17:20:26.186+0000 7f253fb199c0 1 build_initial for_mkfs: 0 2024-09-12T17:20:26.743 INFO:tasks.workunit.client.0.smithi016.stderr: -207> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient: monmap: 2024-09-12T17:20:26.744 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:20:26.744 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:20:26.744 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:20:26.744 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:20:26.744 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:20:26.744 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:20:26.744 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:20:26.744 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:20:26.744 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:20:26.744 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:26.744 INFO:tasks.workunit.client.0.smithi016.stderr: -206> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de900aa50) adding auth protocol: cephx 2024-09-12T17:20:26.744 INFO:tasks.workunit.client.0.smithi016.stderr: -205> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de900aa50) adding auth protocol: cephx 2024-09-12T17:20:26.744 INFO:tasks.workunit.client.0.smithi016.stderr: -204> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de900aa50) adding auth protocol: cephx 2024-09-12T17:20:26.745 INFO:tasks.workunit.client.0.smithi016.stderr: -203> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de900aa50) adding con mode: secure 2024-09-12T17:20:26.745 INFO:tasks.workunit.client.0.smithi016.stderr: -202> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de900aa50) adding con mode: crc 2024-09-12T17:20:26.745 INFO:tasks.workunit.client.0.smithi016.stderr: -201> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de900aa50) adding con mode: secure 2024-09-12T17:20:26.745 INFO:tasks.workunit.client.0.smithi016.stderr: -200> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de900aa50) adding con mode: crc 2024-09-12T17:20:26.745 INFO:tasks.workunit.client.0.smithi016.stderr: -199> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de900aa50) adding con mode: secure 2024-09-12T17:20:26.745 INFO:tasks.workunit.client.0.smithi016.stderr: -198> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de900aa50) adding con mode: crc 2024-09-12T17:20:26.745 INFO:tasks.workunit.client.0.smithi016.stderr: -197> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de900aa50) adding con mode: crc 2024-09-12T17:20:26.745 INFO:tasks.workunit.client.0.smithi016.stderr: -196> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de900aa50) adding con mode: secure 2024-09-12T17:20:26.745 INFO:tasks.workunit.client.0.smithi016.stderr: -195> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de900aa50) adding con mode: crc 2024-09-12T17:20:26.745 INFO:tasks.workunit.client.0.smithi016.stderr: -194> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de900aa50) adding con mode: secure 2024-09-12T17:20:26.745 INFO:tasks.workunit.client.0.smithi016.stderr: -193> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de900aa50) adding con mode: crc 2024-09-12T17:20:26.745 INFO:tasks.workunit.client.0.smithi016.stderr: -192> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de900aa50) adding con mode: secure 2024-09-12T17:20:26.746 INFO:tasks.workunit.client.0.smithi016.stderr: -191> 2024-09-12T17:20:26.186+0000 7f253fb199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:20:26.746 INFO:tasks.workunit.client.0.smithi016.stderr: -190> 2024-09-12T17:20:26.186+0000 7f253fb199c0 1 librados: starting msgr at 2024-09-12T17:20:26.746 INFO:tasks.workunit.client.0.smithi016.stderr: -189> 2024-09-12T17:20:26.186+0000 7f253fb199c0 1 librados: starting objecter 2024-09-12T17:20:26.746 INFO:tasks.workunit.client.0.smithi016.stderr: -188> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 asok(0x562de8d5f2b0) register_command objecter_requests cmddesc objecter_requests hook 0x562de900fa20 EEXIST 2024-09-12T17:20:26.746 INFO:tasks.workunit.client.0.smithi016.stderr: -187> 2024-09-12T17:20:26.186+0000 7f253fb199c0 1 librados: setting wanted keys 2024-09-12T17:20:26.746 INFO:tasks.workunit.client.0.smithi016.stderr: -186> 2024-09-12T17:20:26.186+0000 7f253fb199c0 1 librados: calling monclient init 2024-09-12T17:20:26.746 INFO:tasks.workunit.client.0.smithi016.stderr: -185> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient: init 2024-09-12T17:20:26.746 INFO:tasks.workunit.client.0.smithi016.stderr: -184> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de8fecf80) adding auth protocol: cephx 2024-09-12T17:20:26.746 INFO:tasks.workunit.client.0.smithi016.stderr: -183> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de8fecf80) adding auth protocol: cephx 2024-09-12T17:20:26.746 INFO:tasks.workunit.client.0.smithi016.stderr: -182> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de8fecf80) adding auth protocol: cephx 2024-09-12T17:20:26.746 INFO:tasks.workunit.client.0.smithi016.stderr: -181> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de8fecf80) adding con mode: secure 2024-09-12T17:20:26.746 INFO:tasks.workunit.client.0.smithi016.stderr: -180> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de8fecf80) adding con mode: crc 2024-09-12T17:20:26.746 INFO:tasks.workunit.client.0.smithi016.stderr: -179> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de8fecf80) adding con mode: secure 2024-09-12T17:20:26.747 INFO:tasks.workunit.client.0.smithi016.stderr: -178> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de8fecf80) adding con mode: crc 2024-09-12T17:20:26.747 INFO:tasks.workunit.client.0.smithi016.stderr: -177> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de8fecf80) adding con mode: secure 2024-09-12T17:20:26.747 INFO:tasks.workunit.client.0.smithi016.stderr: -176> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de8fecf80) adding con mode: crc 2024-09-12T17:20:26.747 INFO:tasks.workunit.client.0.smithi016.stderr: -175> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de8fecf80) adding con mode: crc 2024-09-12T17:20:26.747 INFO:tasks.workunit.client.0.smithi016.stderr: -174> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de8fecf80) adding con mode: secure 2024-09-12T17:20:26.747 INFO:tasks.workunit.client.0.smithi016.stderr: -173> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de8fecf80) adding con mode: crc 2024-09-12T17:20:26.747 INFO:tasks.workunit.client.0.smithi016.stderr: -172> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de8fecf80) adding con mode: secure 2024-09-12T17:20:26.747 INFO:tasks.workunit.client.0.smithi016.stderr: -171> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de8fecf80) adding con mode: crc 2024-09-12T17:20:26.747 INFO:tasks.workunit.client.0.smithi016.stderr: -170> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de8fecf80) adding con mode: secure 2024-09-12T17:20:26.747 INFO:tasks.workunit.client.0.smithi016.stderr: -169> 2024-09-12T17:20:26.186+0000 7f253fb199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:20:26.747 INFO:tasks.workunit.client.0.smithi016.stderr: -168> 2024-09-12T17:20:26.186+0000 7f253fb199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:20:26.747 INFO:tasks.workunit.client.0.smithi016.stderr: -167> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 asok(0x562de8d5f2b0) register_command rotate-key cmddesc rotate-key hook 0x562de8fed0c8 EEXIST 2024-09-12T17:20:26.748 INFO:tasks.workunit.client.0.smithi016.stderr: -166> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient: _reopen_session rank -1 2024-09-12T17:20:26.748 INFO:tasks.workunit.client.0.smithi016.stderr: -165> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:20:26.748 INFO:tasks.workunit.client.0.smithi016.stderr: -164> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient(hunting): picked mon.noname-a con 0x562de9039230 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:20:26.748 INFO:tasks.workunit.client.0.smithi016.stderr: -163> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient(hunting): picked mon.noname-c con 0x562de903a470 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:20:26.748 INFO:tasks.workunit.client.0.smithi016.stderr: -162> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient(hunting): picked mon.noname-b con 0x562de903f010 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:20:26.748 INFO:tasks.workunit.client.0.smithi016.stderr: -161> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:20:26.748 INFO:tasks.workunit.client.0.smithi016.stderr: -160> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:20:26.748 INFO:tasks.workunit.client.0.smithi016.stderr: -159> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:20:26.748 INFO:tasks.workunit.client.0.smithi016.stderr: -158> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient(hunting): _renew_subs 2024-09-12T17:20:26.748 INFO:tasks.workunit.client.0.smithi016.stderr: -157> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient(hunting): authenticate will time out at 2344.162651s 2024-09-12T17:20:26.748 INFO:tasks.workunit.client.0.smithi016.stderr: -156> 2024-09-12T17:20:26.186+0000 7f253ce1e640 10 monclient(hunting): get_auth_request con 0x562de9039230 auth_method 0 2024-09-12T17:20:26.748 INFO:tasks.workunit.client.0.smithi016.stderr: -155> 2024-09-12T17:20:26.186+0000 7f253ce1e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:20:26.749 INFO:tasks.workunit.client.0.smithi016.stderr: -154> 2024-09-12T17:20:26.186+0000 7f253ce1e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:20:26.749 INFO:tasks.workunit.client.0.smithi016.stderr: -153> 2024-09-12T17:20:26.186+0000 7f253ce1e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:20:26.749 INFO:tasks.workunit.client.0.smithi016.stderr: -152> 2024-09-12T17:20:26.186+0000 7f253de20640 10 monclient(hunting): get_auth_request con 0x562de903a470 auth_method 0 2024-09-12T17:20:26.749 INFO:tasks.workunit.client.0.smithi016.stderr: -151> 2024-09-12T17:20:26.186+0000 7f253de20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:20:26.749 INFO:tasks.workunit.client.0.smithi016.stderr: -150> 2024-09-12T17:20:26.186+0000 7f253de20640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:20:26.749 INFO:tasks.workunit.client.0.smithi016.stderr: -149> 2024-09-12T17:20:26.186+0000 7f253de20640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:20:26.749 INFO:tasks.workunit.client.0.smithi016.stderr: -148> 2024-09-12T17:20:26.186+0000 7f253de20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:20:26.749 INFO:tasks.workunit.client.0.smithi016.stderr: -147> 2024-09-12T17:20:26.186+0000 7f253de20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:20:26.749 INFO:tasks.workunit.client.0.smithi016.stderr: -146> 2024-09-12T17:20:26.186+0000 7f253de20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:20:26.749 INFO:tasks.workunit.client.0.smithi016.stderr: -145> 2024-09-12T17:20:26.186+0000 7f253ce1e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:20:26.749 INFO:tasks.workunit.client.0.smithi016.stderr: -144> 2024-09-12T17:20:26.186+0000 7f253ce1e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:20:26.749 INFO:tasks.workunit.client.0.smithi016.stderr: -143> 2024-09-12T17:20:26.186+0000 7f253ce1e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:20:26.750 INFO:tasks.workunit.client.0.smithi016.stderr: -142> 2024-09-12T17:20:26.186+0000 7f253de20640 10 monclient(hunting): handle_auth_done global_id 7118 payload 824 2024-09-12T17:20:26.750 INFO:tasks.workunit.client.0.smithi016.stderr: -141> 2024-09-12T17:20:26.186+0000 7f253de20640 10 monclient: _finish_hunting 0 2024-09-12T17:20:26.750 INFO:tasks.workunit.client.0.smithi016.stderr: -140> 2024-09-12T17:20:26.186+0000 7f253de20640 1 monclient: found mon.noname-c 2024-09-12T17:20:26.750 INFO:tasks.workunit.client.0.smithi016.stderr: -139> 2024-09-12T17:20:26.186+0000 7f253de20640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:20:26.750 INFO:tasks.workunit.client.0.smithi016.stderr: -138> 2024-09-12T17:20:26.186+0000 7f240effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:20:26.750 INFO:tasks.workunit.client.0.smithi016.stderr: -137> 2024-09-12T17:20:26.186+0000 7f240effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:20:26.750 INFO:tasks.workunit.client.0.smithi016.stderr: -136> 2024-09-12T17:20:26.186+0000 7f240effd640 10 monclient: dump: 2024-09-12T17:20:26.750 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:20:26.750 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:20:26.750 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:20:26.750 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:20:26.750 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:20:26.750 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:20:26.750 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:20:26.751 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:20:26.751 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:20:26.751 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:26.751 INFO:tasks.workunit.client.0.smithi016.stderr: -135> 2024-09-12T17:20:26.186+0000 7f240effd640 10 monclient: _finish_auth 0 2024-09-12T17:20:26.751 INFO:tasks.workunit.client.0.smithi016.stderr: -134> 2024-09-12T17:20:26.186+0000 7f240effd640 10 monclient: _check_auth_tickets 2024-09-12T17:20:26.751 INFO:tasks.workunit.client.0.smithi016.stderr: -133> 2024-09-12T17:20:26.186+0000 7f240effd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:20:26.751 INFO:tasks.workunit.client.0.smithi016.stderr: -132> 2024-09-12T17:20:26.186+0000 7f240effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:20:26.751 INFO:tasks.workunit.client.0.smithi016.stderr: -131> 2024-09-12T17:20:26.186+0000 7f240effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:20:26.751 INFO:tasks.workunit.client.0.smithi016.stderr: -130> 2024-09-12T17:20:26.186+0000 7f240effd640 10 monclient: dump: 2024-09-12T17:20:26.751 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:20:26.751 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:20:26.751 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:20:26.751 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:20:26.752 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:20:26.752 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:20:26.752 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:20:26.752 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:20:26.752 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:20:26.752 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:26.752 INFO:tasks.workunit.client.0.smithi016.stderr: -129> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 monclient: authenticate success, global_id 7118 2024-09-12T17:20:26.752 INFO:tasks.workunit.client.0.smithi016.stderr: -128> 2024-09-12T17:20:26.186+0000 7f2420ff9640 4 set_mon_vals no callback set 2024-09-12T17:20:26.752 INFO:tasks.workunit.client.0.smithi016.stderr: -127> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient: _renew_subs 2024-09-12T17:20:26.752 INFO:tasks.workunit.client.0.smithi016.stderr: -126> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:20:26.752 INFO:tasks.workunit.client.0.smithi016.stderr: -125> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient: _renew_subs 2024-09-12T17:20:26.752 INFO:tasks.workunit.client.0.smithi016.stderr: -124> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:20:26.752 INFO:tasks.workunit.client.0.smithi016.stderr: -123> 2024-09-12T17:20:26.186+0000 7f253fb199c0 1 librados: init done 2024-09-12T17:20:26.753 INFO:tasks.workunit.client.0.smithi016.stderr: -122> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 asok(0x562de8d5f2b0) register_command cr dump hook 0x562de9035878 2024-09-12T17:20:26.753 INFO:tasks.workunit.client.0.smithi016.stderr: -121> 2024-09-12T17:20:26.190+0000 7f253fb199c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.753 INFO:tasks.workunit.client.0.smithi016.stderr: -120> 2024-09-12T17:20:26.190+0000 7f240effd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:20:26.753 INFO:tasks.workunit.client.0.smithi016.stderr: -119> 2024-09-12T17:20:26.190+0000 7f240effd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:20:26.753 INFO:tasks.workunit.client.0.smithi016.stderr: -118> 2024-09-12T17:20:26.190+0000 7f240effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:20:26.753 INFO:tasks.workunit.client.0.smithi016.stderr: -117> 2024-09-12T17:20:26.190+0000 7f253ce1e640 10 monclient: get_auth_request con 0x7f2408070ae0 auth_method 0 2024-09-12T17:20:26.753 INFO:tasks.workunit.client.0.smithi016.stderr: -116> 2024-09-12T17:20:26.190+0000 7f253d61f640 10 monclient: get_auth_request con 0x562de90580b0 auth_method 0 2024-09-12T17:20:26.753 INFO:tasks.workunit.client.0.smithi016.stderr: -115> 2024-09-12T17:20:26.190+0000 7f253fb199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:26.753 INFO:tasks.workunit.client.0.smithi016.stderr: -114> 2024-09-12T17:20:26.190+0000 7f253fb199c0 20 realm 2024-09-12T17:20:26.753 INFO:tasks.workunit.client.0.smithi016.stderr: -113> 2024-09-12T17:20:26.190+0000 7f253fb199c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.753 INFO:tasks.workunit.client.0.smithi016.stderr: -112> 2024-09-12T17:20:26.190+0000 7f253fb199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:26.753 INFO:tasks.workunit.client.0.smithi016.stderr: -111> 2024-09-12T17:20:26.190+0000 7f253fb199c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:20:26.753 INFO:tasks.workunit.client.0.smithi016.stderr: -110> 2024-09-12T17:20:26.190+0000 7f253fb199c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.754 INFO:tasks.workunit.client.0.smithi016.stderr: -109> 2024-09-12T17:20:26.190+0000 7f253fb199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:26.754 INFO:tasks.workunit.client.0.smithi016.stderr: -108> 2024-09-12T17:20:26.190+0000 7f253fb199c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.754 INFO:tasks.workunit.client.0.smithi016.stderr: -107> 2024-09-12T17:20:26.190+0000 7f253ce1e640 10 monclient: get_auth_request con 0x562de905c350 auth_method 0 2024-09-12T17:20:26.754 INFO:tasks.workunit.client.0.smithi016.stderr: -106> 2024-09-12T17:20:26.194+0000 7f253fb199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:20:26.754 INFO:tasks.workunit.client.0.smithi016.stderr: -105> 2024-09-12T17:20:26.194+0000 7f253fb199c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.754 INFO:tasks.workunit.client.0.smithi016.stderr: -104> 2024-09-12T17:20:26.194+0000 7f253de20640 10 monclient: get_auth_request con 0x562de905fc00 auth_method 0 2024-09-12T17:20:26.754 INFO:tasks.workunit.client.0.smithi016.stderr: -103> 2024-09-12T17:20:26.194+0000 7f253fb199c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:20:26.754 INFO:tasks.workunit.client.0.smithi016.stderr: -102> 2024-09-12T17:20:26.194+0000 7f253fb199c0 20 searching for the correct realm 2024-09-12T17:20:26.754 INFO:tasks.workunit.client.0.smithi016.stderr: -101> 2024-09-12T17:20:26.194+0000 7f253d61f640 10 monclient: get_auth_request con 0x562de9064980 auth_method 0 2024-09-12T17:20:26.754 INFO:tasks.workunit.client.0.smithi016.stderr: -100> 2024-09-12T17:20:26.198+0000 7f253ce1e640 10 monclient: get_auth_request con 0x7f25380c4940 auth_method 0 2024-09-12T17:20:26.754 INFO:tasks.workunit.client.0.smithi016.stderr: -99> 2024-09-12T17:20:26.198+0000 7f253de20640 10 monclient: get_auth_request con 0x7f2534013030 auth_method 0 2024-09-12T17:20:26.754 INFO:tasks.workunit.client.0.smithi016.stderr: -98> 2024-09-12T17:20:26.198+0000 7f253de20640 0 -- 172.21.15.16:0/411721815 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f2534013030 msgr2=0x7f2534013410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:20:26.755 INFO:tasks.workunit.client.0.smithi016.stderr: -97> 2024-09-12T17:20:26.402+0000 7f253de20640 10 monclient: get_auth_request con 0x7f2534013030 auth_method 0 2024-09-12T17:20:26.755 INFO:tasks.workunit.client.0.smithi016.stderr: -96> 2024-09-12T17:20:26.406+0000 7f253d61f640 10 monclient: get_auth_request con 0x7f2530018070 auth_method 0 2024-09-12T17:20:26.755 INFO:tasks.workunit.client.0.smithi016.stderr: -95> 2024-09-12T17:20:26.414+0000 7f253ce1e640 0 -- 172.21.15.16:0/411721815 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f253007f910 msgr2=0x7f25300791d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:20:26.755 INFO:tasks.workunit.client.0.smithi016.stderr: -94> 2024-09-12T17:20:26.618+0000 7f253ce1e640 10 monclient: get_auth_request con 0x7f253007f910 auth_method 0 2024-09-12T17:20:26.755 INFO:tasks.workunit.client.0.smithi016.stderr: -93> 2024-09-12T17:20:26.634+0000 7f253fb199c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:20:26.755 INFO:tasks.workunit.client.0.smithi016.stderr: -92> 2024-09-12T17:20:26.634+0000 7f253fb199c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:20:26.755 INFO:tasks.workunit.client.0.smithi016.stderr: -91> 2024-09-12T17:20:26.634+0000 7f253fb199c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:20:26.755 INFO:tasks.workunit.client.0.smithi016.stderr: -90> 2024-09-12T17:20:26.634+0000 7f253fb199c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:20:26.755 INFO:tasks.workunit.client.0.smithi016.stderr: -89> 2024-09-12T17:20:26.634+0000 7f253fb199c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:20:26.755 INFO:tasks.workunit.client.0.smithi016.stderr: -88> 2024-09-12T17:20:26.634+0000 7f253fb199c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:20:26.755 INFO:tasks.workunit.client.0.smithi016.stderr: -87> 2024-09-12T17:20:26.634+0000 7f253fb199c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.755 INFO:tasks.workunit.client.0.smithi016.stderr: -86> 2024-09-12T17:20:26.634+0000 7f253fb199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:26.755 INFO:tasks.workunit.client.0.smithi016.stderr: -85> 2024-09-12T17:20:26.634+0000 7f253fb199c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.756 INFO:tasks.workunit.client.0.smithi016.stderr: -84> 2024-09-12T17:20:26.634+0000 7f253fb199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:20:26.756 INFO:tasks.workunit.client.0.smithi016.stderr: -83> 2024-09-12T17:20:26.634+0000 7f253fb199c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.756 INFO:tasks.workunit.client.0.smithi016.stderr: -82> 2024-09-12T17:20:26.634+0000 7f253fb199c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:20:26.756 INFO:tasks.workunit.client.0.smithi016.stderr: -81> 2024-09-12T17:20:26.634+0000 7f253fb199c0 20 zone default found 2024-09-12T17:20:26.756 INFO:tasks.workunit.client.0.smithi016.stderr: -80> 2024-09-12T17:20:26.634+0000 7f253fb199c0 4 Realm: () 2024-09-12T17:20:26.756 INFO:tasks.workunit.client.0.smithi016.stderr: -79> 2024-09-12T17:20:26.634+0000 7f253fb199c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:20:26.756 INFO:tasks.workunit.client.0.smithi016.stderr: -78> 2024-09-12T17:20:26.634+0000 7f253fb199c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:20:26.756 INFO:tasks.workunit.client.0.smithi016.stderr: -77> 2024-09-12T17:20:26.634+0000 7f253fb199c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:20:26.756 INFO:tasks.workunit.client.0.smithi016.stderr: -76> 2024-09-12T17:20:26.634+0000 7f253fb199c0 20 zonegroup default 2024-09-12T17:20:26.756 INFO:tasks.workunit.client.0.smithi016.stderr: -75> 2024-09-12T17:20:26.634+0000 7f253fb199c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.756 INFO:tasks.workunit.client.0.smithi016.stderr: -74> 2024-09-12T17:20:26.638+0000 7f253fb199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:26.756 INFO:tasks.workunit.client.0.smithi016.stderr: -73> 2024-09-12T17:20:26.638+0000 7f253fb199c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.756 INFO:tasks.workunit.client.0.smithi016.stderr: -72> 2024-09-12T17:20:26.638+0000 7f253fb199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:26.756 INFO:tasks.workunit.client.0.smithi016.stderr: -71> 2024-09-12T17:20:26.638+0000 7f253fb199c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.757 INFO:tasks.workunit.client.0.smithi016.stderr: -70> 2024-09-12T17:20:26.638+0000 7f253fb199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:26.757 INFO:tasks.workunit.client.0.smithi016.stderr: -69> 2024-09-12T17:20:26.638+0000 7f253fb199c0 20 started sync module instance, tier type = 2024-09-12T17:20:26.757 INFO:tasks.workunit.client.0.smithi016.stderr: -68> 2024-09-12T17:20:26.638+0000 7f253fb199c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:20:26.757 INFO:tasks.workunit.client.0.smithi016.stderr: -67> 2024-09-12T17:20:26.662+0000 7f253fb199c0 20 add_watcher() i=0 2024-09-12T17:20:26.757 INFO:tasks.workunit.client.0.smithi016.stderr: -66> 2024-09-12T17:20:26.662+0000 7f253fb199c0 20 add_watcher() i=1 2024-09-12T17:20:26.757 INFO:tasks.workunit.client.0.smithi016.stderr: -65> 2024-09-12T17:20:26.662+0000 7f253fb199c0 20 add_watcher() i=2 2024-09-12T17:20:26.757 INFO:tasks.workunit.client.0.smithi016.stderr: -64> 2024-09-12T17:20:26.662+0000 7f253fb199c0 20 add_watcher() i=3 2024-09-12T17:20:26.757 INFO:tasks.workunit.client.0.smithi016.stderr: -63> 2024-09-12T17:20:26.662+0000 7f253fb199c0 20 add_watcher() i=4 2024-09-12T17:20:26.757 INFO:tasks.workunit.client.0.smithi016.stderr: -62> 2024-09-12T17:20:26.662+0000 7f253fb199c0 20 add_watcher() i=5 2024-09-12T17:20:26.757 INFO:tasks.workunit.client.0.smithi016.stderr: -61> 2024-09-12T17:20:26.662+0000 7f253fb199c0 20 add_watcher() i=6 2024-09-12T17:20:26.757 INFO:tasks.workunit.client.0.smithi016.stderr: -60> 2024-09-12T17:20:26.662+0000 7f253fb199c0 20 add_watcher() i=7 2024-09-12T17:20:26.757 INFO:tasks.workunit.client.0.smithi016.stderr: -59> 2024-09-12T17:20:26.662+0000 7f253fb199c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:20:26.757 INFO:tasks.workunit.client.0.smithi016.stderr: -58> 2024-09-12T17:20:26.666+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf560) adding auth protocol: cephx 2024-09-12T17:20:26.757 INFO:tasks.workunit.client.0.smithi016.stderr: -57> 2024-09-12T17:20:26.666+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf560) adding auth protocol: cephx 2024-09-12T17:20:26.758 INFO:tasks.workunit.client.0.smithi016.stderr: -56> 2024-09-12T17:20:26.666+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf560) adding auth protocol: cephx 2024-09-12T17:20:26.758 INFO:tasks.workunit.client.0.smithi016.stderr: -55> 2024-09-12T17:20:26.666+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf560) adding con mode: secure 2024-09-12T17:20:26.758 INFO:tasks.workunit.client.0.smithi016.stderr: -54> 2024-09-12T17:20:26.666+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf560) adding con mode: crc 2024-09-12T17:20:26.758 INFO:tasks.workunit.client.0.smithi016.stderr: -53> 2024-09-12T17:20:26.666+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf560) adding con mode: secure 2024-09-12T17:20:26.758 INFO:tasks.workunit.client.0.smithi016.stderr: -52> 2024-09-12T17:20:26.666+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf560) adding con mode: crc 2024-09-12T17:20:26.758 INFO:tasks.workunit.client.0.smithi016.stderr: -51> 2024-09-12T17:20:26.666+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf560) adding con mode: secure 2024-09-12T17:20:26.758 INFO:tasks.workunit.client.0.smithi016.stderr: -50> 2024-09-12T17:20:26.666+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf560) adding con mode: crc 2024-09-12T17:20:26.758 INFO:tasks.workunit.client.0.smithi016.stderr: -49> 2024-09-12T17:20:26.666+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf560) adding con mode: crc 2024-09-12T17:20:26.758 INFO:tasks.workunit.client.0.smithi016.stderr: -48> 2024-09-12T17:20:26.666+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf560) adding con mode: secure 2024-09-12T17:20:26.758 INFO:tasks.workunit.client.0.smithi016.stderr: -47> 2024-09-12T17:20:26.666+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf560) adding con mode: crc 2024-09-12T17:20:26.758 INFO:tasks.workunit.client.0.smithi016.stderr: -46> 2024-09-12T17:20:26.666+0000 7f23f3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:20:26.758 INFO:tasks.workunit.client.0.smithi016.stderr: -45> 2024-09-12T17:20:26.666+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf560) adding con mode: secure 2024-09-12T17:20:26.758 INFO:tasks.workunit.client.0.smithi016.stderr: -44> 2024-09-12T17:20:26.666+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf560) adding con mode: crc 2024-09-12T17:20:26.758 INFO:tasks.workunit.client.0.smithi016.stderr: -43> 2024-09-12T17:20:26.666+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf560) adding con mode: secure 2024-09-12T17:20:26.759 INFO:tasks.workunit.client.0.smithi016.stderr: -42> 2024-09-12T17:20:26.666+0000 7f253fb199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:20:26.759 INFO:tasks.workunit.client.0.smithi016.stderr: -41> 2024-09-12T17:20:26.666+0000 7f253fb199c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:20:26.759 INFO:tasks.workunit.client.0.smithi016.stderr: -40> 2024-09-12T17:20:26.666+0000 7f253fb199c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:20:26.759 INFO:tasks.workunit.client.0.smithi016.stderr: -39> 2024-09-12T17:20:26.666+0000 7f253fb199c0 5 asok(0x562de8d5f2b0) register_command cache list hook 0x562de902faf0 2024-09-12T17:20:26.759 INFO:tasks.workunit.client.0.smithi016.stderr: -38> 2024-09-12T17:20:26.666+0000 7f253fb199c0 5 asok(0x562de8d5f2b0) register_command cache inspect hook 0x562de902faf0 2024-09-12T17:20:26.759 INFO:tasks.workunit.client.0.smithi016.stderr: -37> 2024-09-12T17:20:26.666+0000 7f253fb199c0 5 asok(0x562de8d5f2b0) register_command cache erase hook 0x562de902faf0 2024-09-12T17:20:26.759 INFO:tasks.workunit.client.0.smithi016.stderr: -36> 2024-09-12T17:20:26.666+0000 7f253fb199c0 5 asok(0x562de8d5f2b0) register_command cache zap hook 0x562de902faf0 2024-09-12T17:20:26.759 INFO:tasks.workunit.client.0.smithi016.stderr: -35> 2024-09-12T17:20:26.666+0000 7f253fb199c0 5 note: GC not initialized 2024-09-12T17:20:26.759 INFO:tasks.workunit.client.0.smithi016.stderr: -34> 2024-09-12T17:20:26.670+0000 7f23f2fe5640 20 reqs_thread_entry: start 2024-09-12T17:20:26.759 INFO:tasks.workunit.client.0.smithi016.stderr: -33> 2024-09-12T17:20:26.670+0000 7f253fb199c0 5 asok(0x562de8d5f2b0) register_command sync trace show hook 0x7f2534021040 2024-09-12T17:20:26.759 INFO:tasks.workunit.client.0.smithi016.stderr: -32> 2024-09-12T17:20:26.670+0000 7f253fb199c0 5 asok(0x562de8d5f2b0) register_command sync trace history hook 0x7f2534021040 2024-09-12T17:20:26.759 INFO:tasks.workunit.client.0.smithi016.stderr: -31> 2024-09-12T17:20:26.670+0000 7f253fb199c0 5 asok(0x562de8d5f2b0) register_command sync trace active hook 0x7f2534021040 2024-09-12T17:20:26.759 INFO:tasks.workunit.client.0.smithi016.stderr: -30> 2024-09-12T17:20:26.670+0000 7f253fb199c0 5 asok(0x562de8d5f2b0) register_command sync trace active_short hook 0x7f2534021040 2024-09-12T17:20:26.759 INFO:tasks.workunit.client.0.smithi016.stderr: -29> 2024-09-12T17:20:26.670+0000 7f253fb199c0 20 init_complete bucket index max shards: 1 2024-09-12T17:20:26.759 INFO:tasks.workunit.client.0.smithi016.stderr: -28> 2024-09-12T17:20:26.670+0000 7f253fb199c0 20 Filter name: none 2024-09-12T17:20:26.760 INFO:tasks.workunit.client.0.smithi016.stderr: -27> 2024-09-12T17:20:26.670+0000 7f23f0fe1640 20 reqs_thread_entry: start 2024-09-12T17:20:26.760 INFO:tasks.workunit.client.0.smithi016.stderr: -26> 2024-09-12T17:20:26.670+0000 7f253fb199c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T17:20:26.760 INFO:tasks.workunit.client.0.smithi016.stderr: -25> 2024-09-12T17:20:26.670+0000 7f253fb199c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.760 INFO:tasks.workunit.client.0.smithi016.stderr: -24> 2024-09-12T17:20:26.670+0000 7f253fb199c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:20:26.760 INFO:tasks.workunit.client.0.smithi016.stderr: -23> 2024-09-12T17:20:26.670+0000 7f253fb199c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T17:20:26.760 INFO:tasks.workunit.client.0.smithi016.stderr: -22> 2024-09-12T17:20:26.670+0000 7f253fb199c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T17:20:26.760 INFO:tasks.workunit.client.0.smithi016.stderr: -21> 2024-09-12T17:20:26.670+0000 7f253fb199c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 : miss 2024-09-12T17:20:26.760 INFO:tasks.workunit.client.0.smithi016.stderr: -20> 2024-09-12T17:20:26.670+0000 7f253fb199c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.760 INFO:tasks.workunit.client.0.smithi016.stderr: -19> 2024-09-12T17:20:26.670+0000 7f253fb199c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:20:26.760 INFO:tasks.workunit.client.0.smithi016.stderr: -18> 2024-09-12T17:20:26.670+0000 7f253fb199c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 info.flags=0x17 2024-09-12T17:20:26.760 INFO:tasks.workunit.client.0.smithi016.stderr: -17> 2024-09-12T17:20:26.670+0000 7f253fb199c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 to cache LRU end 2024-09-12T17:20:26.760 INFO:tasks.workunit.client.0.smithi016.stderr: -16> 2024-09-12T17:20:26.670+0000 7f253fb199c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:20:26.760 INFO:tasks.workunit.client.0.smithi016.stderr: -15> 2024-09-12T17:20:26.670+0000 7f253fb199c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:20:26.761 INFO:tasks.workunit.client.0.smithi016.stderr: -14> 2024-09-12T17:20:26.670+0000 7f253fb199c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 2024-09-12T17:20:26.761 INFO:tasks.workunit.client.0.smithi016.stderr: -13> 2024-09-12T17:20:26.678+0000 7f253fb199c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 info.flags=0x17 2024-09-12T17:20:26.761 INFO:tasks.workunit.client.0.smithi016.stderr: -12> 2024-09-12T17:20:26.678+0000 7f253fb199c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 to cache LRU end 2024-09-12T17:20:26.761 INFO:tasks.workunit.client.0.smithi016.stderr: -11> 2024-09-12T17:20:26.678+0000 7f253fb199c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:20:26.761 INFO:tasks.workunit.client.0.smithi016.stderr: -10> 2024-09-12T17:20:26.678+0000 7f253fb199c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34, ofs0, ns] 2024-09-12T17:20:26.761 INFO:tasks.workunit.client.0.smithi016.stderr: -9> 2024-09-12T17:20:26.682+0000 7f2420ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431580 cookie 94755183056384 notifier 7118 bl.length()=911 2024-09-12T17:20:26.761 INFO:tasks.workunit.client.0.smithi016.stderr: -8> 2024-09-12T17:20:26.682+0000 7f2420ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 info.flags=0x17 2024-09-12T17:20:26.761 INFO:tasks.workunit.client.0.smithi016.stderr: -7> 2024-09-12T17:20:26.682+0000 7f2420ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 to cache LRU end 2024-09-12T17:20:26.761 INFO:tasks.workunit.client.0.smithi016.stderr: -6> 2024-09-12T17:20:26.682+0000 7f2420ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:20:26.761 INFO:tasks.workunit.client.0.smithi016.stderr: -5> 2024-09-12T17:20:26.682+0000 7f253fb199c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34]): orig_sources= new_sources= 2024-09-12T17:20:26.761 INFO:tasks.workunit.client.0.smithi016.stderr: -4> 2024-09-12T17:20:26.682+0000 7f253fb199c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34]): potential sources added=[] removed=[] 2024-09-12T17:20:26.761 INFO:tasks.workunit.client.0.smithi016.stderr: -3> 2024-09-12T17:20:26.682+0000 7f253fb199c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34]): orig_dests= new_dests= 2024-09-12T17:20:26.761 INFO:tasks.workunit.client.0.smithi016.stderr: -2> 2024-09-12T17:20:26.682+0000 7f253fb199c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34]): potential dests added=[] removed=[] 2024-09-12T17:20:26.761 INFO:tasks.workunit.client.0.smithi016.stderr: -1> 2024-09-12T17:20:26.686+0000 7f253fb199c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f253fb199c0 time 2024-09-12T17:20:26.689341+0000 2024-09-12T17:20:26.762 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:20:26.762 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:26.762 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:20:26.762 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f25433f32eb] 2024-09-12T17:20:26.762 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f25433f349f] 2024-09-12T17:20:26.762 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562de72100c1] 2024-09-12T17:20:26.762 INFO:tasks.workunit.client.0.smithi016.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562de72221fa] 2024-09-12T17:20:26.762 INFO:tasks.workunit.client.0.smithi016.stderr: 5: main() 2024-09-12T17:20:26.762 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2542259d90] 2024-09-12T17:20:26.762 INFO:tasks.workunit.client.0.smithi016.stderr: 7: __libc_start_main() 2024-09-12T17:20:26.762 INFO:tasks.workunit.client.0.smithi016.stderr: 8: _start() 2024-09-12T17:20:26.762 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:26.762 INFO:tasks.workunit.client.0.smithi016.stderr: 0> 2024-09-12T17:20:26.690+0000 7f253fb199c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:20:26.762 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7f253fb199c0 thread_name:radosgw-admin 2024-09-12T17:20:26.763 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:26.763 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:20:26.763 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2542272520] 2024-09-12T17:20:26.763 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:20:26.763 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:20:26.763 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:20:26.763 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f25433f3345] 2024-09-12T17:20:26.763 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f25433f349f] 2024-09-12T17:20:26.763 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562de72100c1] 2024-09-12T17:20:26.763 INFO:tasks.workunit.client.0.smithi016.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562de72221fa] 2024-09-12T17:20:26.763 INFO:tasks.workunit.client.0.smithi016.stderr: 9: main() 2024-09-12T17:20:26.763 INFO:tasks.workunit.client.0.smithi016.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2542259d90] 2024-09-12T17:20:26.763 INFO:tasks.workunit.client.0.smithi016.stderr: 11: __libc_start_main() 2024-09-12T17:20:26.764 INFO:tasks.workunit.client.0.smithi016.stderr: 12: _start() 2024-09-12T17:20:26.764 INFO:tasks.workunit.client.0.smithi016.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:20:26.764 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:26.764 INFO:tasks.workunit.client.0.smithi016.stderr:--- logging levels --- 2024-09-12T17:20:26.764 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 none 2024-09-12T17:20:26.764 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 lockdep 2024-09-12T17:20:26.764 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 context 2024-09-12T17:20:26.764 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 crush 2024-09-12T17:20:26.764 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds 2024-09-12T17:20:26.764 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_balancer 2024-09-12T17:20:26.764 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_locker 2024-09-12T17:20:26.764 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log 2024-09-12T17:20:26.764 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log_expire 2024-09-12T17:20:26.765 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_migrator 2024-09-12T17:20:26.765 INFO:tasks.workunit.client.0.smithi016.stderr: 3/ 5 mds_quiesce 2024-09-12T17:20:26.765 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 buffer 2024-09-12T17:20:26.765 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 timer 2024-09-12T17:20:26.765 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 filer 2024-09-12T17:20:26.765 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 striper 2024-09-12T17:20:26.765 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 objecter 2024-09-12T17:20:26.765 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rados 2024-09-12T17:20:26.765 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd 2024-09-12T17:20:26.765 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_mirror 2024-09-12T17:20:26.765 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_replay 2024-09-12T17:20:26.765 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_pwl 2024-09-12T17:20:26.765 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 journaler 2024-09-12T17:20:26.765 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objectcacher 2024-09-12T17:20:26.766 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:20:26.766 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 client 2024-09-12T17:20:26.766 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 osd 2024-09-12T17:20:26.766 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 optracker 2024-09-12T17:20:26.766 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objclass 2024-09-12T17:20:26.766 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 filestore 2024-09-12T17:20:26.766 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 journal 2024-09-12T17:20:26.766 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 ms 2024-09-12T17:20:26.766 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mon 2024-09-12T17:20:26.766 INFO:tasks.workunit.client.0.smithi016.stderr: 0/10 monc 2024-09-12T17:20:26.766 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 paxos 2024-09-12T17:20:26.766 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 tp 2024-09-12T17:20:26.766 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 auth 2024-09-12T17:20:26.766 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 crypto 2024-09-12T17:20:26.767 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 finisher 2024-09-12T17:20:26.767 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 reserver 2024-09-12T17:20:26.767 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 heartbeatmap 2024-09-12T17:20:26.767 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 perfcounter 2024-09-12T17:20:26.767 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw 2024-09-12T17:20:26.767 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_sync 2024-09-12T17:20:26.767 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_datacache 2024-09-12T17:20:26.767 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_access 2024-09-12T17:20:26.767 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:20:26.767 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_flight 2024-09-12T17:20:26.767 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:20:26.767 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw_notification 2024-09-12T17:20:26.767 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 javaclient 2024-09-12T17:20:26.768 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 asok 2024-09-12T17:20:26.768 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 throttle 2024-09-12T17:20:26.768 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 refs 2024-09-12T17:20:26.768 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 compressor 2024-09-12T17:20:26.768 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluestore 2024-09-12T17:20:26.768 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluefs 2024-09-12T17:20:26.768 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 bdev 2024-09-12T17:20:26.768 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 kstore 2024-09-12T17:20:26.768 INFO:tasks.workunit.client.0.smithi016.stderr: 4/ 5 rocksdb 2024-09-12T17:20:26.768 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 fuse 2024-09-12T17:20:26.768 INFO:tasks.workunit.client.0.smithi016.stderr: 2/ 5 mgr 2024-09-12T17:20:26.768 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mgrc 2024-09-12T17:20:26.768 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 dpdk 2024-09-12T17:20:26.768 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 eventtrace 2024-09-12T17:20:26.768 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 prioritycache 2024-09-12T17:20:26.769 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 test 2024-09-12T17:20:26.769 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:20:26.769 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephsqlite 2024-09-12T17:20:26.769 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:20:26.769 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore 2024-09-12T17:20:26.769 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_onode 2024-09-12T17:20:26.769 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_odata 2024-09-12T17:20:26.769 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_omap 2024-09-12T17:20:26.769 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_tm 2024-09-12T17:20:26.769 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_t 2024-09-12T17:20:26.769 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:20:26.769 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_epm 2024-09-12T17:20:26.769 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_lba 2024-09-12T17:20:26.770 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:20:26.770 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cache 2024-09-12T17:20:26.770 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_journal 2024-09-12T17:20:26.770 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_device 2024-09-12T17:20:26.770 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_backref 2024-09-12T17:20:26.770 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 alienstore 2024-09-12T17:20:26.770 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mclock 2024-09-12T17:20:26.770 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cyanstore 2024-09-12T17:20:26.770 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 ceph_exporter 2024-09-12T17:20:26.770 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 memstore 2024-09-12T17:20:26.770 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 trace 2024-09-12T17:20:26.770 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 ceph_dedup 2024-09-12T17:20:26.770 INFO:tasks.workunit.client.0.smithi016.stderr: -2/-2 (syslog threshold) 2024-09-12T17:20:26.770 INFO:tasks.workunit.client.0.smithi016.stderr: 99/99 (stderr threshold) 2024-09-12T17:20:26.770 INFO:tasks.workunit.client.0.smithi016.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:20:26.771 INFO:tasks.workunit.client.0.smithi016.stderr: 7f23f0fe1640 / http_manager 2024-09-12T17:20:26.771 INFO:tasks.workunit.client.0.smithi016.stderr: 7f23f2fe5640 / http_manager 2024-09-12T17:20:26.771 INFO:tasks.workunit.client.0.smithi016.stderr: 7f23f3fe7640 / rgw_dt_lg_renew 2024-09-12T17:20:26.771 INFO:tasks.workunit.client.0.smithi016.stderr: 7f240effd640 / ms_dispatch 2024-09-12T17:20:26.771 INFO:tasks.workunit.client.0.smithi016.stderr: 7f2420ff9640 / io_context_pool 2024-09-12T17:20:26.771 INFO:tasks.workunit.client.0.smithi016.stderr: 7f2422ffd640 / ms_dispatch 2024-09-12T17:20:26.771 INFO:tasks.workunit.client.0.smithi016.stderr: 7f2429e03640 / ms_dispatch 2024-09-12T17:20:26.771 INFO:tasks.workunit.client.0.smithi016.stderr: 7f242b606640 / io_context_pool 2024-09-12T17:20:26.771 INFO:tasks.workunit.client.0.smithi016.stderr: 7f253ce1e640 / msgr-worker-2 2024-09-12T17:20:26.771 INFO:tasks.workunit.client.0.smithi016.stderr: 7f253d61f640 / msgr-worker-1 2024-09-12T17:20:26.771 INFO:tasks.workunit.client.0.smithi016.stderr: 7f253de20640 / msgr-worker-0 2024-09-12T17:20:26.771 INFO:tasks.workunit.client.0.smithi016.stderr: 7f253e621640 / io_context_pool 2024-09-12T17:20:26.771 INFO:tasks.workunit.client.0.smithi016.stderr: 7f253fb199c0 / radosgw-admin 2024-09-12T17:20:26.771 INFO:tasks.workunit.client.0.smithi016.stderr: max_recent 500 2024-09-12T17:20:26.772 INFO:tasks.workunit.client.0.smithi016.stderr: max_new 1000 2024-09-12T17:20:26.772 INFO:tasks.workunit.client.0.smithi016.stderr: log_file /var/log/ceph/ceph-client.admin.117968.log 2024-09-12T17:20:26.772 INFO:tasks.workunit.client.0.smithi016.stderr:--- end dump of recent events --- 2024-09-12T17:20:26.772 INFO:tasks.workunit.client.0.smithi016.stderr:--- begin dump of recent events --- 2024-09-12T17:20:26.772 INFO:tasks.workunit.client.0.smithi016.stderr: -499> 2024-09-12T17:20:26.166+0000 7f253ce1e640 10 monclient: _finish_hunting 0 2024-09-12T17:20:26.772 INFO:tasks.workunit.client.0.smithi016.stderr: -498> 2024-09-12T17:20:26.166+0000 7f253ce1e640 1 monclient: found mon.noname-a 2024-09-12T17:20:26.772 INFO:tasks.workunit.client.0.smithi016.stderr: -497> 2024-09-12T17:20:26.166+0000 7f253ce1e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:20:26.772 INFO:tasks.workunit.client.0.smithi016.stderr: -496> 2024-09-12T17:20:26.166+0000 7f242b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:20:26.772 INFO:tasks.workunit.client.0.smithi016.stderr: -495> 2024-09-12T17:20:26.166+0000 7f242b606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:20:26.772 INFO:tasks.workunit.client.0.smithi016.stderr: -494> 2024-09-12T17:20:26.166+0000 7f242b606640 10 monclient: dump: 2024-09-12T17:20:26.772 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:20:26.772 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:20:26.772 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:20:26.772 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:20:26.773 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:20:26.773 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:20:26.773 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:20:26.773 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:20:26.773 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:20:26.773 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:26.773 INFO:tasks.workunit.client.0.smithi016.stderr: -493> 2024-09-12T17:20:26.166+0000 7f242b606640 10 monclient: _finish_auth 0 2024-09-12T17:20:26.773 INFO:tasks.workunit.client.0.smithi016.stderr: -492> 2024-09-12T17:20:26.166+0000 7f242b606640 10 monclient: _check_auth_tickets 2024-09-12T17:20:26.773 INFO:tasks.workunit.client.0.smithi016.stderr: -491> 2024-09-12T17:20:26.166+0000 7f242b606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:20:26.773 INFO:tasks.workunit.client.0.smithi016.stderr: -490> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 monclient: authenticate success, global_id 7458 2024-09-12T17:20:26.773 INFO:tasks.workunit.client.0.smithi016.stderr: -489> 2024-09-12T17:20:26.166+0000 7f253fb199c0 10 monclient: get_monmap_and_config success 2024-09-12T17:20:26.773 INFO:tasks.workunit.client.0.smithi016.stderr: -488> 2024-09-12T17:20:26.166+0000 7f253fb199c0 4 set_mon_vals no callback set 2024-09-12T17:20:26.773 INFO:tasks.workunit.client.0.smithi016.stderr: -487> 2024-09-12T17:20:26.166+0000 7f242b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:20:26.774 INFO:tasks.workunit.client.0.smithi016.stderr: -486> 2024-09-12T17:20:26.166+0000 7f242b606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:20:26.774 INFO:tasks.workunit.client.0.smithi016.stderr: -485> 2024-09-12T17:20:26.166+0000 7f242b606640 10 monclient: dump: 2024-09-12T17:20:26.774 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:20:26.774 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:20:26.774 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:20:26.774 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:20:26.774 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:20:26.774 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:20:26.774 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:20:26.775 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:20:26.775 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:20:26.775 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:26.775 INFO:tasks.workunit.client.0.smithi016.stderr: -484> 2024-09-12T17:20:26.166+0000 7f253fb199c0 10 monclient: shutdown 2024-09-12T17:20:26.775 INFO:tasks.workunit.client.0.smithi016.stderr: -483> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 asok(0x562de8d5f2b0) unregister_commands rotate-key 2024-09-12T17:20:26.775 INFO:tasks.workunit.client.0.smithi016.stderr: -482> 2024-09-12T17:20:26.166+0000 7f253fb199c0 10 monclient: build_initial_monmap 2024-09-12T17:20:26.775 INFO:tasks.workunit.client.0.smithi016.stderr: -481> 2024-09-12T17:20:26.166+0000 7f253fb199c0 1 build_initial for_mkfs: 0 2024-09-12T17:20:26.775 INFO:tasks.workunit.client.0.smithi016.stderr: -480> 2024-09-12T17:20:26.166+0000 7f253fb199c0 10 monclient: monmap: 2024-09-12T17:20:26.775 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:20:26.775 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:20:26.775 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:20:26.775 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:20:26.775 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:20:26.775 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:20:26.776 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:20:26.776 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:20:26.776 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:20:26.776 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:26.776 INFO:tasks.workunit.client.0.smithi016.stderr: -479> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f72fc0) adding auth protocol: cephx 2024-09-12T17:20:26.776 INFO:tasks.workunit.client.0.smithi016.stderr: -478> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f72fc0) adding auth protocol: cephx 2024-09-12T17:20:26.776 INFO:tasks.workunit.client.0.smithi016.stderr: -477> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f72fc0) adding auth protocol: cephx 2024-09-12T17:20:26.776 INFO:tasks.workunit.client.0.smithi016.stderr: -476> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f72fc0) adding con mode: secure 2024-09-12T17:20:26.776 INFO:tasks.workunit.client.0.smithi016.stderr: -475> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f72fc0) adding con mode: crc 2024-09-12T17:20:26.776 INFO:tasks.workunit.client.0.smithi016.stderr: -474> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f72fc0) adding con mode: secure 2024-09-12T17:20:26.776 INFO:tasks.workunit.client.0.smithi016.stderr: -473> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f72fc0) adding con mode: crc 2024-09-12T17:20:26.776 INFO:tasks.workunit.client.0.smithi016.stderr: -472> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f72fc0) adding con mode: secure 2024-09-12T17:20:26.776 INFO:tasks.workunit.client.0.smithi016.stderr: -471> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f72fc0) adding con mode: crc 2024-09-12T17:20:26.777 INFO:tasks.workunit.client.0.smithi016.stderr: -470> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f72fc0) adding con mode: crc 2024-09-12T17:20:26.777 INFO:tasks.workunit.client.0.smithi016.stderr: -469> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f72fc0) adding con mode: secure 2024-09-12T17:20:26.777 INFO:tasks.workunit.client.0.smithi016.stderr: -468> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f72fc0) adding con mode: crc 2024-09-12T17:20:26.777 INFO:tasks.workunit.client.0.smithi016.stderr: -467> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f72fc0) adding con mode: secure 2024-09-12T17:20:26.777 INFO:tasks.workunit.client.0.smithi016.stderr: -466> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f72fc0) adding con mode: crc 2024-09-12T17:20:26.777 INFO:tasks.workunit.client.0.smithi016.stderr: -465> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f72fc0) adding con mode: secure 2024-09-12T17:20:26.777 INFO:tasks.workunit.client.0.smithi016.stderr: -464> 2024-09-12T17:20:26.166+0000 7f253fb199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:20:26.777 INFO:tasks.workunit.client.0.smithi016.stderr: -463> 2024-09-12T17:20:26.166+0000 7f253fb199c0 1 librados: starting msgr at 2024-09-12T17:20:26.777 INFO:tasks.workunit.client.0.smithi016.stderr: -462> 2024-09-12T17:20:26.166+0000 7f253fb199c0 1 librados: starting objecter 2024-09-12T17:20:26.777 INFO:tasks.workunit.client.0.smithi016.stderr: -461> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 asok(0x562de8d5f2b0) register_command objecter_requests hook 0x562de8cd9de0 2024-09-12T17:20:26.777 INFO:tasks.workunit.client.0.smithi016.stderr: -460> 2024-09-12T17:20:26.166+0000 7f253fb199c0 1 librados: setting wanted keys 2024-09-12T17:20:26.777 INFO:tasks.workunit.client.0.smithi016.stderr: -459> 2024-09-12T17:20:26.166+0000 7f253fb199c0 1 librados: calling monclient init 2024-09-12T17:20:26.778 INFO:tasks.workunit.client.0.smithi016.stderr: -458> 2024-09-12T17:20:26.166+0000 7f253fb199c0 10 monclient: init 2024-09-12T17:20:26.778 INFO:tasks.workunit.client.0.smithi016.stderr: -457> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f6c380) adding auth protocol: cephx 2024-09-12T17:20:26.778 INFO:tasks.workunit.client.0.smithi016.stderr: -456> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f6c380) adding auth protocol: cephx 2024-09-12T17:20:26.778 INFO:tasks.workunit.client.0.smithi016.stderr: -455> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f6c380) adding auth protocol: cephx 2024-09-12T17:20:26.778 INFO:tasks.workunit.client.0.smithi016.stderr: -454> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f6c380) adding con mode: secure 2024-09-12T17:20:26.778 INFO:tasks.workunit.client.0.smithi016.stderr: -453> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f6c380) adding con mode: crc 2024-09-12T17:20:26.778 INFO:tasks.workunit.client.0.smithi016.stderr: -452> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f6c380) adding con mode: secure 2024-09-12T17:20:26.778 INFO:tasks.workunit.client.0.smithi016.stderr: -451> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f6c380) adding con mode: crc 2024-09-12T17:20:26.778 INFO:tasks.workunit.client.0.smithi016.stderr: -450> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f6c380) adding con mode: secure 2024-09-12T17:20:26.778 INFO:tasks.workunit.client.0.smithi016.stderr: -449> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f6c380) adding con mode: crc 2024-09-12T17:20:26.778 INFO:tasks.workunit.client.0.smithi016.stderr: -448> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f6c380) adding con mode: crc 2024-09-12T17:20:26.778 INFO:tasks.workunit.client.0.smithi016.stderr: -447> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f6c380) adding con mode: secure 2024-09-12T17:20:26.778 INFO:tasks.workunit.client.0.smithi016.stderr: -446> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f6c380) adding con mode: crc 2024-09-12T17:20:26.779 INFO:tasks.workunit.client.0.smithi016.stderr: -445> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f6c380) adding con mode: secure 2024-09-12T17:20:26.779 INFO:tasks.workunit.client.0.smithi016.stderr: -444> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f6c380) adding con mode: crc 2024-09-12T17:20:26.779 INFO:tasks.workunit.client.0.smithi016.stderr: -443> 2024-09-12T17:20:26.166+0000 7f253fb199c0 5 AuthRegistry(0x562de8f6c380) adding con mode: secure 2024-09-12T17:20:26.779 INFO:tasks.workunit.client.0.smithi016.stderr: -442> 2024-09-12T17:20:26.170+0000 7f253fb199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:20:26.779 INFO:tasks.workunit.client.0.smithi016.stderr: -441> 2024-09-12T17:20:26.170+0000 7f253fb199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:20:26.779 INFO:tasks.workunit.client.0.smithi016.stderr: -440> 2024-09-12T17:20:26.170+0000 7f253fb199c0 5 asok(0x562de8d5f2b0) register_command rotate-key hook 0x562de8f6c4c8 2024-09-12T17:20:26.779 INFO:tasks.workunit.client.0.smithi016.stderr: -439> 2024-09-12T17:20:26.170+0000 7f253fb199c0 10 monclient: _reopen_session rank -1 2024-09-12T17:20:26.779 INFO:tasks.workunit.client.0.smithi016.stderr: -438> 2024-09-12T17:20:26.170+0000 7f253fb199c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:20:26.779 INFO:tasks.workunit.client.0.smithi016.stderr: -437> 2024-09-12T17:20:26.170+0000 7f253fb199c0 10 monclient(hunting): picked mon.noname-b con 0x562de8e275b0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:20:26.779 INFO:tasks.workunit.client.0.smithi016.stderr: -436> 2024-09-12T17:20:26.170+0000 7f253fb199c0 10 monclient(hunting): picked mon.noname-c con 0x562de8eb4720 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:20:26.779 INFO:tasks.workunit.client.0.smithi016.stderr: -435> 2024-09-12T17:20:26.170+0000 7f253fb199c0 10 monclient(hunting): picked mon.noname-a con 0x562de8eb5070 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:20:26.779 INFO:tasks.workunit.client.0.smithi016.stderr: -434> 2024-09-12T17:20:26.170+0000 7f253fb199c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:20:26.779 INFO:tasks.workunit.client.0.smithi016.stderr: -433> 2024-09-12T17:20:26.170+0000 7f253fb199c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:20:26.780 INFO:tasks.workunit.client.0.smithi016.stderr: -432> 2024-09-12T17:20:26.170+0000 7f253fb199c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:20:26.780 INFO:tasks.workunit.client.0.smithi016.stderr: -431> 2024-09-12T17:20:26.170+0000 7f253fb199c0 10 monclient(hunting): _renew_subs 2024-09-12T17:20:26.780 INFO:tasks.workunit.client.0.smithi016.stderr: -430> 2024-09-12T17:20:26.170+0000 7f253fb199c0 10 monclient(hunting): authenticate will time out at 2344.144477s 2024-09-12T17:20:26.780 INFO:tasks.workunit.client.0.smithi016.stderr: -429> 2024-09-12T17:20:26.170+0000 7f253de20640 10 monclient(hunting): get_auth_request con 0x562de8eb5070 auth_method 0 2024-09-12T17:20:26.780 INFO:tasks.workunit.client.0.smithi016.stderr: -428> 2024-09-12T17:20:26.170+0000 7f253de20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:20:26.780 INFO:tasks.workunit.client.0.smithi016.stderr: -427> 2024-09-12T17:20:26.170+0000 7f253de20640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:20:26.780 INFO:tasks.workunit.client.0.smithi016.stderr: -426> 2024-09-12T17:20:26.170+0000 7f253de20640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:20:26.780 INFO:tasks.workunit.client.0.smithi016.stderr: -425> 2024-09-12T17:20:26.170+0000 7f253ce1e640 10 monclient(hunting): get_auth_request con 0x562de8eb4720 auth_method 0 2024-09-12T17:20:26.780 INFO:tasks.workunit.client.0.smithi016.stderr: -424> 2024-09-12T17:20:26.170+0000 7f253ce1e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:20:26.780 INFO:tasks.workunit.client.0.smithi016.stderr: -423> 2024-09-12T17:20:26.170+0000 7f253ce1e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:20:26.780 INFO:tasks.workunit.client.0.smithi016.stderr: -422> 2024-09-12T17:20:26.170+0000 7f253ce1e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:20:26.780 INFO:tasks.workunit.client.0.smithi016.stderr: -421> 2024-09-12T17:20:26.170+0000 7f253de20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:20:26.781 INFO:tasks.workunit.client.0.smithi016.stderr: -420> 2024-09-12T17:20:26.170+0000 7f253de20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:20:26.781 INFO:tasks.workunit.client.0.smithi016.stderr: -419> 2024-09-12T17:20:26.170+0000 7f253de20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:20:26.781 INFO:tasks.workunit.client.0.smithi016.stderr: -418> 2024-09-12T17:20:26.170+0000 7f253ce1e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:20:26.781 INFO:tasks.workunit.client.0.smithi016.stderr: -417> 2024-09-12T17:20:26.170+0000 7f253ce1e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:20:26.781 INFO:tasks.workunit.client.0.smithi016.stderr: -416> 2024-09-12T17:20:26.170+0000 7f253ce1e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:20:26.781 INFO:tasks.workunit.client.0.smithi016.stderr: -415> 2024-09-12T17:20:26.170+0000 7f253d61f640 10 monclient(hunting): get_auth_request con 0x562de8e275b0 auth_method 0 2024-09-12T17:20:26.781 INFO:tasks.workunit.client.0.smithi016.stderr: -414> 2024-09-12T17:20:26.170+0000 7f253d61f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:20:26.781 INFO:tasks.workunit.client.0.smithi016.stderr: -413> 2024-09-12T17:20:26.170+0000 7f253d61f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:20:26.781 INFO:tasks.workunit.client.0.smithi016.stderr: -412> 2024-09-12T17:20:26.170+0000 7f253d61f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:20:26.781 INFO:tasks.workunit.client.0.smithi016.stderr: -411> 2024-09-12T17:20:26.170+0000 7f253de20640 10 monclient(hunting): handle_auth_done global_id 7461 payload 824 2024-09-12T17:20:26.781 INFO:tasks.workunit.client.0.smithi016.stderr: -410> 2024-09-12T17:20:26.170+0000 7f253de20640 10 monclient: _finish_hunting 0 2024-09-12T17:20:26.781 INFO:tasks.workunit.client.0.smithi016.stderr: -409> 2024-09-12T17:20:26.170+0000 7f253de20640 1 monclient: found mon.noname-a 2024-09-12T17:20:26.781 INFO:tasks.workunit.client.0.smithi016.stderr: -408> 2024-09-12T17:20:26.170+0000 7f253de20640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:20:26.782 INFO:tasks.workunit.client.0.smithi016.stderr: -407> 2024-09-12T17:20:26.170+0000 7f2429e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:20:26.782 INFO:tasks.workunit.client.0.smithi016.stderr: -406> 2024-09-12T17:20:26.170+0000 7f2429e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:20:26.782 INFO:tasks.workunit.client.0.smithi016.stderr: -405> 2024-09-12T17:20:26.170+0000 7f2429e03640 10 monclient: dump: 2024-09-12T17:20:26.782 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:20:26.782 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:20:26.782 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:20:26.782 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:20:26.782 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:20:26.782 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:20:26.782 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:20:26.782 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:20:26.782 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:20:26.782 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:26.783 INFO:tasks.workunit.client.0.smithi016.stderr: -404> 2024-09-12T17:20:26.170+0000 7f2429e03640 10 monclient: _finish_auth 0 2024-09-12T17:20:26.783 INFO:tasks.workunit.client.0.smithi016.stderr: -403> 2024-09-12T17:20:26.170+0000 7f2429e03640 10 monclient: _check_auth_tickets 2024-09-12T17:20:26.783 INFO:tasks.workunit.client.0.smithi016.stderr: -402> 2024-09-12T17:20:26.170+0000 7f2429e03640 10 monclient: handle_config config(0 keys) 2024-09-12T17:20:26.783 INFO:tasks.workunit.client.0.smithi016.stderr: -401> 2024-09-12T17:20:26.170+0000 7f2429e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:20:26.783 INFO:tasks.workunit.client.0.smithi016.stderr: -400> 2024-09-12T17:20:26.170+0000 7f2429e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:20:26.783 INFO:tasks.workunit.client.0.smithi016.stderr: -399> 2024-09-12T17:20:26.170+0000 7f2429e03640 10 monclient: dump: 2024-09-12T17:20:26.783 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:20:26.783 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:20:26.783 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:20:26.783 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:20:26.783 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:20:26.783 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:20:26.783 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:20:26.783 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:20:26.784 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:20:26.784 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:26.784 INFO:tasks.workunit.client.0.smithi016.stderr: -398> 2024-09-12T17:20:26.170+0000 7f253fb199c0 5 monclient: authenticate success, global_id 7461 2024-09-12T17:20:26.784 INFO:tasks.workunit.client.0.smithi016.stderr: -397> 2024-09-12T17:20:26.170+0000 7f253fb199c0 10 monclient: _renew_subs 2024-09-12T17:20:26.784 INFO:tasks.workunit.client.0.smithi016.stderr: -396> 2024-09-12T17:20:26.170+0000 7f253fb199c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:20:26.784 INFO:tasks.workunit.client.0.smithi016.stderr: -395> 2024-09-12T17:20:26.170+0000 7f242b606640 4 set_mon_vals no callback set 2024-09-12T17:20:26.784 INFO:tasks.workunit.client.0.smithi016.stderr: -394> 2024-09-12T17:20:26.170+0000 7f253fb199c0 10 monclient: _renew_subs 2024-09-12T17:20:26.784 INFO:tasks.workunit.client.0.smithi016.stderr: -393> 2024-09-12T17:20:26.170+0000 7f253fb199c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:20:26.784 INFO:tasks.workunit.client.0.smithi016.stderr: -392> 2024-09-12T17:20:26.170+0000 7f253fb199c0 1 librados: init done 2024-09-12T17:20:26.784 INFO:tasks.workunit.client.0.smithi016.stderr: -391> 2024-09-12T17:20:26.170+0000 7f2429e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:20:26.784 INFO:tasks.workunit.client.0.smithi016.stderr: -390> 2024-09-12T17:20:26.170+0000 7f2429e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:20:26.785 INFO:tasks.workunit.client.0.smithi016.stderr: -389> 2024-09-12T17:20:26.170+0000 7f2429e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:20:26.785 INFO:tasks.workunit.client.0.smithi016.stderr: -388> 2024-09-12T17:20:26.170+0000 7f253d61f640 10 monclient: get_auth_request con 0x7f2424070ae0 auth_method 0 2024-09-12T17:20:26.785 INFO:tasks.workunit.client.0.smithi016.stderr: -387> 2024-09-12T17:20:26.170+0000 7f253ce1e640 10 monclient: get_auth_request con 0x562de8f94600 auth_method 0 2024-09-12T17:20:26.785 INFO:tasks.workunit.client.0.smithi016.stderr: -386> 2024-09-12T17:20:26.174+0000 7f253d61f640 10 monclient: get_auth_request con 0x562de8fb73d0 auth_method 0 2024-09-12T17:20:26.785 INFO:tasks.workunit.client.0.smithi016.stderr: -385> 2024-09-12T17:20:26.174+0000 7f253ce1e640 10 monclient: get_auth_request con 0x562de8fbb5c0 auth_method 0 2024-09-12T17:20:26.785 INFO:tasks.workunit.client.0.smithi016.stderr: -384> 2024-09-12T17:20:26.178+0000 7f253de20640 10 monclient: get_auth_request con 0x562de8fbac00 auth_method 0 2024-09-12T17:20:26.785 INFO:tasks.workunit.client.0.smithi016.stderr: -383> 2024-09-12T17:20:26.178+0000 7f253fb199c0 10 monclient: build_initial_monmap 2024-09-12T17:20:26.785 INFO:tasks.workunit.client.0.smithi016.stderr: -382> 2024-09-12T17:20:26.178+0000 7f253fb199c0 1 build_initial for_mkfs: 0 2024-09-12T17:20:26.785 INFO:tasks.workunit.client.0.smithi016.stderr: -381> 2024-09-12T17:20:26.178+0000 7f253fb199c0 10 monclient: monmap: 2024-09-12T17:20:26.785 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:20:26.785 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:20:26.785 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:20:26.785 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:20:26.785 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:20:26.786 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:20:26.786 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:20:26.786 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:20:26.786 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:20:26.786 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:26.786 INFO:tasks.workunit.client.0.smithi016.stderr: -380> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc3630) adding auth protocol: cephx 2024-09-12T17:20:26.786 INFO:tasks.workunit.client.0.smithi016.stderr: -379> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc3630) adding auth protocol: cephx 2024-09-12T17:20:26.786 INFO:tasks.workunit.client.0.smithi016.stderr: -378> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc3630) adding auth protocol: cephx 2024-09-12T17:20:26.786 INFO:tasks.workunit.client.0.smithi016.stderr: -377> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc3630) adding con mode: secure 2024-09-12T17:20:26.786 INFO:tasks.workunit.client.0.smithi016.stderr: -376> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc3630) adding con mode: crc 2024-09-12T17:20:26.786 INFO:tasks.workunit.client.0.smithi016.stderr: -375> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc3630) adding con mode: secure 2024-09-12T17:20:26.786 INFO:tasks.workunit.client.0.smithi016.stderr: -374> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc3630) adding con mode: crc 2024-09-12T17:20:26.786 INFO:tasks.workunit.client.0.smithi016.stderr: -373> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc3630) adding con mode: secure 2024-09-12T17:20:26.786 INFO:tasks.workunit.client.0.smithi016.stderr: -372> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc3630) adding con mode: crc 2024-09-12T17:20:26.787 INFO:tasks.workunit.client.0.smithi016.stderr: -371> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc3630) adding con mode: crc 2024-09-12T17:20:26.787 INFO:tasks.workunit.client.0.smithi016.stderr: -370> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc3630) adding con mode: secure 2024-09-12T17:20:26.787 INFO:tasks.workunit.client.0.smithi016.stderr: -369> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc3630) adding con mode: crc 2024-09-12T17:20:26.787 INFO:tasks.workunit.client.0.smithi016.stderr: -368> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc3630) adding con mode: secure 2024-09-12T17:20:26.787 INFO:tasks.workunit.client.0.smithi016.stderr: -367> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc3630) adding con mode: crc 2024-09-12T17:20:26.787 INFO:tasks.workunit.client.0.smithi016.stderr: -366> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc3630) adding con mode: secure 2024-09-12T17:20:26.787 INFO:tasks.workunit.client.0.smithi016.stderr: -365> 2024-09-12T17:20:26.178+0000 7f253fb199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:20:26.787 INFO:tasks.workunit.client.0.smithi016.stderr: -364> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 asok(0x562de8d5f2b0) register_command objecter_requests cmddesc objecter_requests hook 0x562de8fc6fb0 EEXIST 2024-09-12T17:20:26.787 INFO:tasks.workunit.client.0.smithi016.stderr: -363> 2024-09-12T17:20:26.178+0000 7f253fb199c0 10 monclient: init 2024-09-12T17:20:26.787 INFO:tasks.workunit.client.0.smithi016.stderr: -362> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc24d8) adding auth protocol: cephx 2024-09-12T17:20:26.787 INFO:tasks.workunit.client.0.smithi016.stderr: -361> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc24d8) adding auth protocol: cephx 2024-09-12T17:20:26.787 INFO:tasks.workunit.client.0.smithi016.stderr: -360> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc24d8) adding auth protocol: cephx 2024-09-12T17:20:26.787 INFO:tasks.workunit.client.0.smithi016.stderr: -359> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc24d8) adding con mode: secure 2024-09-12T17:20:26.787 INFO:tasks.workunit.client.0.smithi016.stderr: -358> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc24d8) adding con mode: crc 2024-09-12T17:20:26.787 INFO:tasks.workunit.client.0.smithi016.stderr: -357> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc24d8) adding con mode: secure 2024-09-12T17:20:26.788 INFO:tasks.workunit.client.0.smithi016.stderr: -356> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc24d8) adding con mode: crc 2024-09-12T17:20:26.788 INFO:tasks.workunit.client.0.smithi016.stderr: -355> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc24d8) adding con mode: secure 2024-09-12T17:20:26.788 INFO:tasks.workunit.client.0.smithi016.stderr: -354> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc24d8) adding con mode: crc 2024-09-12T17:20:26.788 INFO:tasks.workunit.client.0.smithi016.stderr: -353> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc24d8) adding con mode: crc 2024-09-12T17:20:26.788 INFO:tasks.workunit.client.0.smithi016.stderr: -352> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc24d8) adding con mode: secure 2024-09-12T17:20:26.788 INFO:tasks.workunit.client.0.smithi016.stderr: -351> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc24d8) adding con mode: crc 2024-09-12T17:20:26.788 INFO:tasks.workunit.client.0.smithi016.stderr: -350> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc24d8) adding con mode: secure 2024-09-12T17:20:26.788 INFO:tasks.workunit.client.0.smithi016.stderr: -349> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc24d8) adding con mode: crc 2024-09-12T17:20:26.788 INFO:tasks.workunit.client.0.smithi016.stderr: -348> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 AuthRegistry(0x562de8fc24d8) adding con mode: secure 2024-09-12T17:20:26.788 INFO:tasks.workunit.client.0.smithi016.stderr: -347> 2024-09-12T17:20:26.178+0000 7f253fb199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:20:26.788 INFO:tasks.workunit.client.0.smithi016.stderr: -346> 2024-09-12T17:20:26.178+0000 7f253fb199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:20:26.788 INFO:tasks.workunit.client.0.smithi016.stderr: -345> 2024-09-12T17:20:26.178+0000 7f253fb199c0 5 asok(0x562de8d5f2b0) register_command rotate-key cmddesc rotate-key hook 0x562de8fc2620 EEXIST 2024-09-12T17:20:26.788 INFO:tasks.workunit.client.0.smithi016.stderr: -344> 2024-09-12T17:20:26.178+0000 7f253fb199c0 10 monclient: _reopen_session rank -1 2024-09-12T17:20:26.789 INFO:tasks.workunit.client.0.smithi016.stderr: -343> 2024-09-12T17:20:26.178+0000 7f253fb199c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:20:26.789 INFO:tasks.workunit.client.0.smithi016.stderr: -342> 2024-09-12T17:20:26.178+0000 7f253fb199c0 10 monclient(hunting): picked mon.noname-b con 0x562de8feb160 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:20:26.789 INFO:tasks.workunit.client.0.smithi016.stderr: -341> 2024-09-12T17:20:26.178+0000 7f253fb199c0 10 monclient(hunting): picked mon.noname-a con 0x562de8feaa90 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:20:26.789 INFO:tasks.workunit.client.0.smithi016.stderr: -340> 2024-09-12T17:20:26.178+0000 7f253fb199c0 10 monclient(hunting): picked mon.noname-c con 0x562de8fe9470 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:20:26.789 INFO:tasks.workunit.client.0.smithi016.stderr: -339> 2024-09-12T17:20:26.178+0000 7f253fb199c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:20:26.789 INFO:tasks.workunit.client.0.smithi016.stderr: -338> 2024-09-12T17:20:26.178+0000 7f253fb199c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:20:26.789 INFO:tasks.workunit.client.0.smithi016.stderr: -337> 2024-09-12T17:20:26.178+0000 7f253fb199c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:20:26.789 INFO:tasks.workunit.client.0.smithi016.stderr: -336> 2024-09-12T17:20:26.178+0000 7f253fb199c0 10 monclient(hunting): _renew_subs 2024-09-12T17:20:26.789 INFO:tasks.workunit.client.0.smithi016.stderr: -335> 2024-09-12T17:20:26.178+0000 7f253fb199c0 10 monclient(hunting): authenticate will time out at 2344.155911s 2024-09-12T17:20:26.789 INFO:tasks.workunit.client.0.smithi016.stderr: -334> 2024-09-12T17:20:26.182+0000 7f253de20640 10 monclient(hunting): get_auth_request con 0x562de8feaa90 auth_method 0 2024-09-12T17:20:26.789 INFO:tasks.workunit.client.0.smithi016.stderr: -333> 2024-09-12T17:20:26.182+0000 7f253de20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:20:26.789 INFO:tasks.workunit.client.0.smithi016.stderr: -332> 2024-09-12T17:20:26.182+0000 7f253de20640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:20:26.789 INFO:tasks.workunit.client.0.smithi016.stderr: -331> 2024-09-12T17:20:26.182+0000 7f253de20640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:20:26.789 INFO:tasks.workunit.client.0.smithi016.stderr: -330> 2024-09-12T17:20:26.182+0000 7f253d61f640 10 monclient(hunting): get_auth_request con 0x562de8fe9470 auth_method 0 2024-09-12T17:20:26.790 INFO:tasks.workunit.client.0.smithi016.stderr: -329> 2024-09-12T17:20:26.182+0000 7f253d61f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:20:26.790 INFO:tasks.workunit.client.0.smithi016.stderr: -328> 2024-09-12T17:20:26.182+0000 7f253d61f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:20:26.790 INFO:tasks.workunit.client.0.smithi016.stderr: -327> 2024-09-12T17:20:26.182+0000 7f253d61f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:20:26.790 INFO:tasks.workunit.client.0.smithi016.stderr: -326> 2024-09-12T17:20:26.182+0000 7f253de20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:20:26.790 INFO:tasks.workunit.client.0.smithi016.stderr: -325> 2024-09-12T17:20:26.182+0000 7f253de20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:20:26.790 INFO:tasks.workunit.client.0.smithi016.stderr: -324> 2024-09-12T17:20:26.182+0000 7f253de20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:20:26.790 INFO:tasks.workunit.client.0.smithi016.stderr: -323> 2024-09-12T17:20:26.182+0000 7f253d61f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:20:26.790 INFO:tasks.workunit.client.0.smithi016.stderr: -322> 2024-09-12T17:20:26.182+0000 7f253d61f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:20:26.790 INFO:tasks.workunit.client.0.smithi016.stderr: -321> 2024-09-12T17:20:26.182+0000 7f253d61f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:20:26.790 INFO:tasks.workunit.client.0.smithi016.stderr: -320> 2024-09-12T17:20:26.182+0000 7f253ce1e640 10 monclient(hunting): get_auth_request con 0x562de8feb160 auth_method 0 2024-09-12T17:20:26.790 INFO:tasks.workunit.client.0.smithi016.stderr: -319> 2024-09-12T17:20:26.182+0000 7f253ce1e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:20:26.790 INFO:tasks.workunit.client.0.smithi016.stderr: -318> 2024-09-12T17:20:26.182+0000 7f253ce1e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:20:26.790 INFO:tasks.workunit.client.0.smithi016.stderr: -317> 2024-09-12T17:20:26.182+0000 7f253ce1e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:20:26.791 INFO:tasks.workunit.client.0.smithi016.stderr: -316> 2024-09-12T17:20:26.182+0000 7f253de20640 10 monclient(hunting): handle_auth_done global_id 7464 payload 824 2024-09-12T17:20:26.791 INFO:tasks.workunit.client.0.smithi016.stderr: -315> 2024-09-12T17:20:26.182+0000 7f253de20640 10 monclient: _finish_hunting 0 2024-09-12T17:20:26.791 INFO:tasks.workunit.client.0.smithi016.stderr: -314> 2024-09-12T17:20:26.182+0000 7f253de20640 1 monclient: found mon.noname-a 2024-09-12T17:20:26.791 INFO:tasks.workunit.client.0.smithi016.stderr: -313> 2024-09-12T17:20:26.182+0000 7f253de20640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:20:26.791 INFO:tasks.workunit.client.0.smithi016.stderr: -312> 2024-09-12T17:20:26.182+0000 7f2422ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:20:26.791 INFO:tasks.workunit.client.0.smithi016.stderr: -311> 2024-09-12T17:20:26.182+0000 7f2422ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:20:26.791 INFO:tasks.workunit.client.0.smithi016.stderr: -310> 2024-09-12T17:20:26.182+0000 7f2422ffd640 10 monclient: dump: 2024-09-12T17:20:26.791 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:20:26.791 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:20:26.791 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:20:26.791 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:20:26.791 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:20:26.791 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:20:26.791 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:20:26.792 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:20:26.792 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:20:26.792 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:26.792 INFO:tasks.workunit.client.0.smithi016.stderr: -309> 2024-09-12T17:20:26.182+0000 7f2422ffd640 10 monclient: _finish_auth 0 2024-09-12T17:20:26.792 INFO:tasks.workunit.client.0.smithi016.stderr: -308> 2024-09-12T17:20:26.182+0000 7f2422ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:20:26.792 INFO:tasks.workunit.client.0.smithi016.stderr: -307> 2024-09-12T17:20:26.182+0000 7f2422ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:20:26.792 INFO:tasks.workunit.client.0.smithi016.stderr: -306> 2024-09-12T17:20:26.182+0000 7f2422ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:20:26.792 INFO:tasks.workunit.client.0.smithi016.stderr: -305> 2024-09-12T17:20:26.182+0000 7f2422ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:20:26.792 INFO:tasks.workunit.client.0.smithi016.stderr: -304> 2024-09-12T17:20:26.182+0000 7f2422ffd640 10 monclient: dump: 2024-09-12T17:20:26.792 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:20:26.792 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:20:26.792 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:20:26.792 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:20:26.792 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:20:26.792 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:20:26.793 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:20:26.793 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:20:26.793 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:20:26.793 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:26.793 INFO:tasks.workunit.client.0.smithi016.stderr: -303> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 monclient: authenticate success, global_id 7464 2024-09-12T17:20:26.793 INFO:tasks.workunit.client.0.smithi016.stderr: -302> 2024-09-12T17:20:26.182+0000 7f253e621640 4 set_mon_vals no callback set 2024-09-12T17:20:26.793 INFO:tasks.workunit.client.0.smithi016.stderr: -301> 2024-09-12T17:20:26.182+0000 7f253fb199c0 10 monclient: _renew_subs 2024-09-12T17:20:26.793 INFO:tasks.workunit.client.0.smithi016.stderr: -300> 2024-09-12T17:20:26.182+0000 7f253fb199c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:20:26.793 INFO:tasks.workunit.client.0.smithi016.stderr: -299> 2024-09-12T17:20:26.182+0000 7f253fb199c0 10 monclient: _renew_subs 2024-09-12T17:20:26.793 INFO:tasks.workunit.client.0.smithi016.stderr: -298> 2024-09-12T17:20:26.182+0000 7f253fb199c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:20:26.793 INFO:tasks.workunit.client.0.smithi016.stderr: -297> 2024-09-12T17:20:26.182+0000 7f2422ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:20:26.793 INFO:tasks.workunit.client.0.smithi016.stderr: -296> 2024-09-12T17:20:26.182+0000 7f2422ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:20:26.794 INFO:tasks.workunit.client.0.smithi016.stderr: -295> 2024-09-12T17:20:26.182+0000 7f2422ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:20:26.794 INFO:tasks.workunit.client.0.smithi016.stderr: -294> 2024-09-12T17:20:26.182+0000 7f253fb199c0 10 monclient: get_monmap_and_config 2024-09-12T17:20:26.794 INFO:tasks.workunit.client.0.smithi016.stderr: -293> 2024-09-12T17:20:26.182+0000 7f253fb199c0 10 monclient: build_initial_monmap 2024-09-12T17:20:26.794 INFO:tasks.workunit.client.0.smithi016.stderr: -292> 2024-09-12T17:20:26.182+0000 7f253fb199c0 1 build_initial for_mkfs: 0 2024-09-12T17:20:26.794 INFO:tasks.workunit.client.0.smithi016.stderr: -291> 2024-09-12T17:20:26.182+0000 7f253fb199c0 10 monclient: monmap: 2024-09-12T17:20:26.794 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:20:26.794 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:20:26.794 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:20:26.794 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:20:26.794 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:20:26.794 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:20:26.794 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:20:26.794 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:20:26.795 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:20:26.795 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:26.795 INFO:tasks.workunit.client.0.smithi016.stderr: -290> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x562de900aaa0) adding auth protocol: cephx 2024-09-12T17:20:26.795 INFO:tasks.workunit.client.0.smithi016.stderr: -289> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x562de900aaa0) adding auth protocol: cephx 2024-09-12T17:20:26.795 INFO:tasks.workunit.client.0.smithi016.stderr: -288> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x562de900aaa0) adding auth protocol: cephx 2024-09-12T17:20:26.795 INFO:tasks.workunit.client.0.smithi016.stderr: -287> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x562de900aaa0) adding con mode: secure 2024-09-12T17:20:26.795 INFO:tasks.workunit.client.0.smithi016.stderr: -286> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x562de900aaa0) adding con mode: crc 2024-09-12T17:20:26.795 INFO:tasks.workunit.client.0.smithi016.stderr: -285> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x562de900aaa0) adding con mode: secure 2024-09-12T17:20:26.795 INFO:tasks.workunit.client.0.smithi016.stderr: -284> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x562de900aaa0) adding con mode: crc 2024-09-12T17:20:26.795 INFO:tasks.workunit.client.0.smithi016.stderr: -283> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x562de900aaa0) adding con mode: secure 2024-09-12T17:20:26.795 INFO:tasks.workunit.client.0.smithi016.stderr: -282> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x562de900aaa0) adding con mode: crc 2024-09-12T17:20:26.795 INFO:tasks.workunit.client.0.smithi016.stderr: -281> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x562de900aaa0) adding con mode: crc 2024-09-12T17:20:26.795 INFO:tasks.workunit.client.0.smithi016.stderr: -280> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x562de900aaa0) adding con mode: secure 2024-09-12T17:20:26.796 INFO:tasks.workunit.client.0.smithi016.stderr: -279> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x562de900aaa0) adding con mode: crc 2024-09-12T17:20:26.796 INFO:tasks.workunit.client.0.smithi016.stderr: -278> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x562de900aaa0) adding con mode: secure 2024-09-12T17:20:26.796 INFO:tasks.workunit.client.0.smithi016.stderr: -277> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x562de900aaa0) adding con mode: crc 2024-09-12T17:20:26.796 INFO:tasks.workunit.client.0.smithi016.stderr: -276> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x562de900aaa0) adding con mode: secure 2024-09-12T17:20:26.796 INFO:tasks.workunit.client.0.smithi016.stderr: -275> 2024-09-12T17:20:26.182+0000 7f253ce1e640 10 monclient: get_auth_request con 0x7f2418070a20 auth_method 0 2024-09-12T17:20:26.796 INFO:tasks.workunit.client.0.smithi016.stderr: -274> 2024-09-12T17:20:26.182+0000 7f253fb199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:20:26.796 INFO:tasks.workunit.client.0.smithi016.stderr: -273> 2024-09-12T17:20:26.182+0000 7f253fb199c0 10 monclient: init 2024-09-12T17:20:26.796 INFO:tasks.workunit.client.0.smithi016.stderr: -272> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf090) adding auth protocol: cephx 2024-09-12T17:20:26.796 INFO:tasks.workunit.client.0.smithi016.stderr: -271> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf090) adding auth protocol: cephx 2024-09-12T17:20:26.796 INFO:tasks.workunit.client.0.smithi016.stderr: -270> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf090) adding auth protocol: cephx 2024-09-12T17:20:26.796 INFO:tasks.workunit.client.0.smithi016.stderr: -269> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf090) adding con mode: secure 2024-09-12T17:20:26.796 INFO:tasks.workunit.client.0.smithi016.stderr: -268> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf090) adding con mode: crc 2024-09-12T17:20:26.797 INFO:tasks.workunit.client.0.smithi016.stderr: -267> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf090) adding con mode: secure 2024-09-12T17:20:26.797 INFO:tasks.workunit.client.0.smithi016.stderr: -266> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf090) adding con mode: crc 2024-09-12T17:20:26.797 INFO:tasks.workunit.client.0.smithi016.stderr: -265> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf090) adding con mode: secure 2024-09-12T17:20:26.797 INFO:tasks.workunit.client.0.smithi016.stderr: -264> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf090) adding con mode: crc 2024-09-12T17:20:26.797 INFO:tasks.workunit.client.0.smithi016.stderr: -263> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf090) adding con mode: crc 2024-09-12T17:20:26.797 INFO:tasks.workunit.client.0.smithi016.stderr: -262> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf090) adding con mode: secure 2024-09-12T17:20:26.797 INFO:tasks.workunit.client.0.smithi016.stderr: -261> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf090) adding con mode: crc 2024-09-12T17:20:26.797 INFO:tasks.workunit.client.0.smithi016.stderr: -260> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf090) adding con mode: secure 2024-09-12T17:20:26.797 INFO:tasks.workunit.client.0.smithi016.stderr: -259> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf090) adding con mode: crc 2024-09-12T17:20:26.797 INFO:tasks.workunit.client.0.smithi016.stderr: -258> 2024-09-12T17:20:26.182+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf090) adding con mode: secure 2024-09-12T17:20:26.797 INFO:tasks.workunit.client.0.smithi016.stderr: -257> 2024-09-12T17:20:26.182+0000 7f253fb199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:20:26.797 INFO:tasks.workunit.client.0.smithi016.stderr: -256> 2024-09-12T17:20:26.182+0000 7f253fb199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:20:26.797 INFO:tasks.workunit.client.0.smithi016.stderr: -255> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 asok(0x562de8d5f2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc550cf1d8 EEXIST 2024-09-12T17:20:26.797 INFO:tasks.workunit.client.0.smithi016.stderr: -254> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient: _reopen_session rank -1 2024-09-12T17:20:26.798 INFO:tasks.workunit.client.0.smithi016.stderr: -253> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:20:26.798 INFO:tasks.workunit.client.0.smithi016.stderr: -252> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient(hunting): picked mon.noname-b con 0x562de903f010 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:20:26.798 INFO:tasks.workunit.client.0.smithi016.stderr: -251> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient(hunting): picked mon.noname-c con 0x562de9039230 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:20:26.798 INFO:tasks.workunit.client.0.smithi016.stderr: -250> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient(hunting): picked mon.noname-a con 0x562de903a470 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:20:26.798 INFO:tasks.workunit.client.0.smithi016.stderr: -249> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:20:26.798 INFO:tasks.workunit.client.0.smithi016.stderr: -248> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:20:26.798 INFO:tasks.workunit.client.0.smithi016.stderr: -247> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:20:26.798 INFO:tasks.workunit.client.0.smithi016.stderr: -246> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient(hunting): _renew_subs 2024-09-12T17:20:26.798 INFO:tasks.workunit.client.0.smithi016.stderr: -245> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient(hunting): authenticate will time out at 2344.160084s 2024-09-12T17:20:26.798 INFO:tasks.workunit.client.0.smithi016.stderr: -244> 2024-09-12T17:20:26.186+0000 7f253d61f640 10 monclient(hunting): get_auth_request con 0x562de903a470 auth_method 0 2024-09-12T17:20:26.798 INFO:tasks.workunit.client.0.smithi016.stderr: -243> 2024-09-12T17:20:26.186+0000 7f253d61f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:20:26.798 INFO:tasks.workunit.client.0.smithi016.stderr: -242> 2024-09-12T17:20:26.186+0000 7f253d61f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:20:26.798 INFO:tasks.workunit.client.0.smithi016.stderr: -241> 2024-09-12T17:20:26.186+0000 7f253d61f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:20:26.798 INFO:tasks.workunit.client.0.smithi016.stderr: -240> 2024-09-12T17:20:26.186+0000 7f253de20640 10 monclient(hunting): get_auth_request con 0x562de9039230 auth_method 0 2024-09-12T17:20:26.798 INFO:tasks.workunit.client.0.smithi016.stderr: -239> 2024-09-12T17:20:26.186+0000 7f253de20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:20:26.799 INFO:tasks.workunit.client.0.smithi016.stderr: -238> 2024-09-12T17:20:26.186+0000 7f253de20640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:20:26.799 INFO:tasks.workunit.client.0.smithi016.stderr: -237> 2024-09-12T17:20:26.186+0000 7f253de20640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:20:26.799 INFO:tasks.workunit.client.0.smithi016.stderr: -236> 2024-09-12T17:20:26.186+0000 7f253de20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:20:26.799 INFO:tasks.workunit.client.0.smithi016.stderr: -235> 2024-09-12T17:20:26.186+0000 7f253de20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:20:26.799 INFO:tasks.workunit.client.0.smithi016.stderr: -234> 2024-09-12T17:20:26.186+0000 7f253de20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:20:26.799 INFO:tasks.workunit.client.0.smithi016.stderr: -233> 2024-09-12T17:20:26.186+0000 7f253d61f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:20:26.799 INFO:tasks.workunit.client.0.smithi016.stderr: -232> 2024-09-12T17:20:26.186+0000 7f253d61f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:20:26.799 INFO:tasks.workunit.client.0.smithi016.stderr: -231> 2024-09-12T17:20:26.186+0000 7f253d61f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:20:26.799 INFO:tasks.workunit.client.0.smithi016.stderr: -230> 2024-09-12T17:20:26.186+0000 7f253ce1e640 10 monclient(hunting): get_auth_request con 0x562de903f010 auth_method 0 2024-09-12T17:20:26.799 INFO:tasks.workunit.client.0.smithi016.stderr: -229> 2024-09-12T17:20:26.186+0000 7f253ce1e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:20:26.799 INFO:tasks.workunit.client.0.smithi016.stderr: -228> 2024-09-12T17:20:26.186+0000 7f253ce1e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:20:26.799 INFO:tasks.workunit.client.0.smithi016.stderr: -227> 2024-09-12T17:20:26.186+0000 7f253ce1e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:20:26.799 INFO:tasks.workunit.client.0.smithi016.stderr: -226> 2024-09-12T17:20:26.186+0000 7f253de20640 10 monclient(hunting): handle_auth_done global_id 7115 payload 274 2024-09-12T17:20:26.799 INFO:tasks.workunit.client.0.smithi016.stderr: -225> 2024-09-12T17:20:26.186+0000 7f253de20640 10 monclient: _finish_hunting 0 2024-09-12T17:20:26.800 INFO:tasks.workunit.client.0.smithi016.stderr: -224> 2024-09-12T17:20:26.186+0000 7f253de20640 1 monclient: found mon.noname-c 2024-09-12T17:20:26.800 INFO:tasks.workunit.client.0.smithi016.stderr: -223> 2024-09-12T17:20:26.186+0000 7f253de20640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:20:26.800 INFO:tasks.workunit.client.0.smithi016.stderr: -222> 2024-09-12T17:20:26.186+0000 7f2420ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:20:26.800 INFO:tasks.workunit.client.0.smithi016.stderr: -221> 2024-09-12T17:20:26.186+0000 7f2420ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:20:26.800 INFO:tasks.workunit.client.0.smithi016.stderr: -220> 2024-09-12T17:20:26.186+0000 7f2420ff9640 10 monclient: dump: 2024-09-12T17:20:26.800 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:20:26.800 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:20:26.800 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:20:26.800 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:20:26.800 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:20:26.800 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:20:26.800 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:20:26.800 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:20:26.800 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:20:26.800 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:26.801 INFO:tasks.workunit.client.0.smithi016.stderr: -219> 2024-09-12T17:20:26.186+0000 7f2420ff9640 10 monclient: _finish_auth 0 2024-09-12T17:20:26.801 INFO:tasks.workunit.client.0.smithi016.stderr: -218> 2024-09-12T17:20:26.186+0000 7f2420ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:20:26.801 INFO:tasks.workunit.client.0.smithi016.stderr: -217> 2024-09-12T17:20:26.186+0000 7f2420ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:20:26.801 INFO:tasks.workunit.client.0.smithi016.stderr: -216> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 monclient: authenticate success, global_id 7115 2024-09-12T17:20:26.801 INFO:tasks.workunit.client.0.smithi016.stderr: -215> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient: get_monmap_and_config success 2024-09-12T17:20:26.801 INFO:tasks.workunit.client.0.smithi016.stderr: -214> 2024-09-12T17:20:26.186+0000 7f253fb199c0 4 set_mon_vals no callback set 2024-09-12T17:20:26.801 INFO:tasks.workunit.client.0.smithi016.stderr: -213> 2024-09-12T17:20:26.186+0000 7f2420ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:20:26.801 INFO:tasks.workunit.client.0.smithi016.stderr: -212> 2024-09-12T17:20:26.186+0000 7f2420ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:20:26.801 INFO:tasks.workunit.client.0.smithi016.stderr: -211> 2024-09-12T17:20:26.186+0000 7f2420ff9640 10 monclient: dump: 2024-09-12T17:20:26.801 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:20:26.801 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:20:26.801 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:20:26.801 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:20:26.801 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:20:26.802 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:20:26.802 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:20:26.802 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:20:26.802 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:20:26.802 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:26.802 INFO:tasks.workunit.client.0.smithi016.stderr: -210> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient: shutdown 2024-09-12T17:20:26.802 INFO:tasks.workunit.client.0.smithi016.stderr: -209> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient: build_initial_monmap 2024-09-12T17:20:26.802 INFO:tasks.workunit.client.0.smithi016.stderr: -208> 2024-09-12T17:20:26.186+0000 7f253fb199c0 1 build_initial for_mkfs: 0 2024-09-12T17:20:26.803 INFO:tasks.workunit.client.0.smithi016.stderr: -207> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient: monmap: 2024-09-12T17:20:26.803 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:20:26.803 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:20:26.803 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:20:26.803 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:20:26.803 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:20:26.803 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:20:26.803 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:20:26.803 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:20:26.803 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:20:26.803 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:26.803 INFO:tasks.workunit.client.0.smithi016.stderr: -206> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de900aa50) adding auth protocol: cephx 2024-09-12T17:20:26.803 INFO:tasks.workunit.client.0.smithi016.stderr: -205> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de900aa50) adding auth protocol: cephx 2024-09-12T17:20:26.804 INFO:tasks.workunit.client.0.smithi016.stderr: -204> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de900aa50) adding auth protocol: cephx 2024-09-12T17:20:26.804 INFO:tasks.workunit.client.0.smithi016.stderr: -203> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de900aa50) adding con mode: secure 2024-09-12T17:20:26.804 INFO:tasks.workunit.client.0.smithi016.stderr: -202> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de900aa50) adding con mode: crc 2024-09-12T17:20:26.804 INFO:tasks.workunit.client.0.smithi016.stderr: -201> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de900aa50) adding con mode: secure 2024-09-12T17:20:26.804 INFO:tasks.workunit.client.0.smithi016.stderr: -200> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de900aa50) adding con mode: crc 2024-09-12T17:20:26.804 INFO:tasks.workunit.client.0.smithi016.stderr: -199> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de900aa50) adding con mode: secure 2024-09-12T17:20:26.804 INFO:tasks.workunit.client.0.smithi016.stderr: -198> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de900aa50) adding con mode: crc 2024-09-12T17:20:26.804 INFO:tasks.workunit.client.0.smithi016.stderr: -197> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de900aa50) adding con mode: crc 2024-09-12T17:20:26.804 INFO:tasks.workunit.client.0.smithi016.stderr: -196> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de900aa50) adding con mode: secure 2024-09-12T17:20:26.804 INFO:tasks.workunit.client.0.smithi016.stderr: -195> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de900aa50) adding con mode: crc 2024-09-12T17:20:26.804 INFO:tasks.workunit.client.0.smithi016.stderr: -194> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de900aa50) adding con mode: secure 2024-09-12T17:20:26.804 INFO:tasks.workunit.client.0.smithi016.stderr: -193> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de900aa50) adding con mode: crc 2024-09-12T17:20:26.804 INFO:tasks.workunit.client.0.smithi016.stderr: -192> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de900aa50) adding con mode: secure 2024-09-12T17:20:26.805 INFO:tasks.workunit.client.0.smithi016.stderr: -191> 2024-09-12T17:20:26.186+0000 7f253fb199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:20:26.805 INFO:tasks.workunit.client.0.smithi016.stderr: -190> 2024-09-12T17:20:26.186+0000 7f253fb199c0 1 librados: starting msgr at 2024-09-12T17:20:26.805 INFO:tasks.workunit.client.0.smithi016.stderr: -189> 2024-09-12T17:20:26.186+0000 7f253fb199c0 1 librados: starting objecter 2024-09-12T17:20:26.805 INFO:tasks.workunit.client.0.smithi016.stderr: -188> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 asok(0x562de8d5f2b0) register_command objecter_requests cmddesc objecter_requests hook 0x562de900fa20 EEXIST 2024-09-12T17:20:26.805 INFO:tasks.workunit.client.0.smithi016.stderr: -187> 2024-09-12T17:20:26.186+0000 7f253fb199c0 1 librados: setting wanted keys 2024-09-12T17:20:26.805 INFO:tasks.workunit.client.0.smithi016.stderr: -186> 2024-09-12T17:20:26.186+0000 7f253fb199c0 1 librados: calling monclient init 2024-09-12T17:20:26.805 INFO:tasks.workunit.client.0.smithi016.stderr: -185> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient: init 2024-09-12T17:20:26.805 INFO:tasks.workunit.client.0.smithi016.stderr: -184> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de8fecf80) adding auth protocol: cephx 2024-09-12T17:20:26.805 INFO:tasks.workunit.client.0.smithi016.stderr: -183> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de8fecf80) adding auth protocol: cephx 2024-09-12T17:20:26.805 INFO:tasks.workunit.client.0.smithi016.stderr: -182> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de8fecf80) adding auth protocol: cephx 2024-09-12T17:20:26.805 INFO:tasks.workunit.client.0.smithi016.stderr: -181> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de8fecf80) adding con mode: secure 2024-09-12T17:20:26.805 INFO:tasks.workunit.client.0.smithi016.stderr: -180> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de8fecf80) adding con mode: crc 2024-09-12T17:20:26.806 INFO:tasks.workunit.client.0.smithi016.stderr: -179> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de8fecf80) adding con mode: secure 2024-09-12T17:20:26.806 INFO:tasks.workunit.client.0.smithi016.stderr: -178> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de8fecf80) adding con mode: crc 2024-09-12T17:20:26.806 INFO:tasks.workunit.client.0.smithi016.stderr: -177> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de8fecf80) adding con mode: secure 2024-09-12T17:20:26.806 INFO:tasks.workunit.client.0.smithi016.stderr: -176> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de8fecf80) adding con mode: crc 2024-09-12T17:20:26.806 INFO:tasks.workunit.client.0.smithi016.stderr: -175> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de8fecf80) adding con mode: crc 2024-09-12T17:20:26.806 INFO:tasks.workunit.client.0.smithi016.stderr: -174> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de8fecf80) adding con mode: secure 2024-09-12T17:20:26.806 INFO:tasks.workunit.client.0.smithi016.stderr: -173> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de8fecf80) adding con mode: crc 2024-09-12T17:20:26.806 INFO:tasks.workunit.client.0.smithi016.stderr: -172> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de8fecf80) adding con mode: secure 2024-09-12T17:20:26.806 INFO:tasks.workunit.client.0.smithi016.stderr: -171> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de8fecf80) adding con mode: crc 2024-09-12T17:20:26.806 INFO:tasks.workunit.client.0.smithi016.stderr: -170> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 AuthRegistry(0x562de8fecf80) adding con mode: secure 2024-09-12T17:20:26.806 INFO:tasks.workunit.client.0.smithi016.stderr: -169> 2024-09-12T17:20:26.186+0000 7f253fb199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:20:26.806 INFO:tasks.workunit.client.0.smithi016.stderr: -168> 2024-09-12T17:20:26.186+0000 7f253fb199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:20:26.806 INFO:tasks.workunit.client.0.smithi016.stderr: -167> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 asok(0x562de8d5f2b0) register_command rotate-key cmddesc rotate-key hook 0x562de8fed0c8 EEXIST 2024-09-12T17:20:26.807 INFO:tasks.workunit.client.0.smithi016.stderr: -166> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient: _reopen_session rank -1 2024-09-12T17:20:26.807 INFO:tasks.workunit.client.0.smithi016.stderr: -165> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:20:26.807 INFO:tasks.workunit.client.0.smithi016.stderr: -164> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient(hunting): picked mon.noname-a con 0x562de9039230 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:20:26.807 INFO:tasks.workunit.client.0.smithi016.stderr: -163> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient(hunting): picked mon.noname-c con 0x562de903a470 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:20:26.807 INFO:tasks.workunit.client.0.smithi016.stderr: -162> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient(hunting): picked mon.noname-b con 0x562de903f010 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:20:26.807 INFO:tasks.workunit.client.0.smithi016.stderr: -161> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:20:26.807 INFO:tasks.workunit.client.0.smithi016.stderr: -160> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:20:26.807 INFO:tasks.workunit.client.0.smithi016.stderr: -159> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:20:26.807 INFO:tasks.workunit.client.0.smithi016.stderr: -158> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient(hunting): _renew_subs 2024-09-12T17:20:26.807 INFO:tasks.workunit.client.0.smithi016.stderr: -157> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient(hunting): authenticate will time out at 2344.162651s 2024-09-12T17:20:26.807 INFO:tasks.workunit.client.0.smithi016.stderr: -156> 2024-09-12T17:20:26.186+0000 7f253ce1e640 10 monclient(hunting): get_auth_request con 0x562de9039230 auth_method 0 2024-09-12T17:20:26.808 INFO:tasks.workunit.client.0.smithi016.stderr: -155> 2024-09-12T17:20:26.186+0000 7f253ce1e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:20:26.808 INFO:tasks.workunit.client.0.smithi016.stderr: -154> 2024-09-12T17:20:26.186+0000 7f253ce1e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:20:26.808 INFO:tasks.workunit.client.0.smithi016.stderr: -153> 2024-09-12T17:20:26.186+0000 7f253ce1e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:20:26.808 INFO:tasks.workunit.client.0.smithi016.stderr: -152> 2024-09-12T17:20:26.186+0000 7f253de20640 10 monclient(hunting): get_auth_request con 0x562de903a470 auth_method 0 2024-09-12T17:20:26.808 INFO:tasks.workunit.client.0.smithi016.stderr: -151> 2024-09-12T17:20:26.186+0000 7f253de20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:20:26.808 INFO:tasks.workunit.client.0.smithi016.stderr: -150> 2024-09-12T17:20:26.186+0000 7f253de20640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:20:26.808 INFO:tasks.workunit.client.0.smithi016.stderr: -149> 2024-09-12T17:20:26.186+0000 7f253de20640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:20:26.808 INFO:tasks.workunit.client.0.smithi016.stderr: -148> 2024-09-12T17:20:26.186+0000 7f253de20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:20:26.808 INFO:tasks.workunit.client.0.smithi016.stderr: -147> 2024-09-12T17:20:26.186+0000 7f253de20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:20:26.808 INFO:tasks.workunit.client.0.smithi016.stderr: -146> 2024-09-12T17:20:26.186+0000 7f253de20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:20:26.808 INFO:tasks.workunit.client.0.smithi016.stderr: -145> 2024-09-12T17:20:26.186+0000 7f253ce1e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:20:26.808 INFO:tasks.workunit.client.0.smithi016.stderr: -144> 2024-09-12T17:20:26.186+0000 7f253ce1e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:20:26.809 INFO:tasks.workunit.client.0.smithi016.stderr: -143> 2024-09-12T17:20:26.186+0000 7f253ce1e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:20:26.809 INFO:tasks.workunit.client.0.smithi016.stderr: -142> 2024-09-12T17:20:26.186+0000 7f253de20640 10 monclient(hunting): handle_auth_done global_id 7118 payload 824 2024-09-12T17:20:26.809 INFO:tasks.workunit.client.0.smithi016.stderr: -141> 2024-09-12T17:20:26.186+0000 7f253de20640 10 monclient: _finish_hunting 0 2024-09-12T17:20:26.809 INFO:tasks.workunit.client.0.smithi016.stderr: -140> 2024-09-12T17:20:26.186+0000 7f253de20640 1 monclient: found mon.noname-c 2024-09-12T17:20:26.809 INFO:tasks.workunit.client.0.smithi016.stderr: -139> 2024-09-12T17:20:26.186+0000 7f253de20640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:20:26.809 INFO:tasks.workunit.client.0.smithi016.stderr: -138> 2024-09-12T17:20:26.186+0000 7f240effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:20:26.809 INFO:tasks.workunit.client.0.smithi016.stderr: -137> 2024-09-12T17:20:26.186+0000 7f240effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:20:26.809 INFO:tasks.workunit.client.0.smithi016.stderr: -136> 2024-09-12T17:20:26.186+0000 7f240effd640 10 monclient: dump: 2024-09-12T17:20:26.809 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:20:26.809 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:20:26.809 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:20:26.809 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:20:26.809 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:20:26.810 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:20:26.810 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:20:26.810 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:20:26.810 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:20:26.810 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:26.810 INFO:tasks.workunit.client.0.smithi016.stderr: -135> 2024-09-12T17:20:26.186+0000 7f240effd640 10 monclient: _finish_auth 0 2024-09-12T17:20:26.810 INFO:tasks.workunit.client.0.smithi016.stderr: -134> 2024-09-12T17:20:26.186+0000 7f240effd640 10 monclient: _check_auth_tickets 2024-09-12T17:20:26.810 INFO:tasks.workunit.client.0.smithi016.stderr: -133> 2024-09-12T17:20:26.186+0000 7f240effd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:20:26.810 INFO:tasks.workunit.client.0.smithi016.stderr: -132> 2024-09-12T17:20:26.186+0000 7f240effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:20:26.810 INFO:tasks.workunit.client.0.smithi016.stderr: -131> 2024-09-12T17:20:26.186+0000 7f240effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:20:26.810 INFO:tasks.workunit.client.0.smithi016.stderr: -130> 2024-09-12T17:20:26.186+0000 7f240effd640 10 monclient: dump: 2024-09-12T17:20:26.810 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:20:26.810 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:20:26.811 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:20:26.811 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:20:26.811 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:20:26.811 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:20:26.811 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:20:26.811 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:20:26.811 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:20:26.811 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:26.811 INFO:tasks.workunit.client.0.smithi016.stderr: -129> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 monclient: authenticate success, global_id 7118 2024-09-12T17:20:26.811 INFO:tasks.workunit.client.0.smithi016.stderr: -128> 2024-09-12T17:20:26.186+0000 7f2420ff9640 4 set_mon_vals no callback set 2024-09-12T17:20:26.811 INFO:tasks.workunit.client.0.smithi016.stderr: -127> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient: _renew_subs 2024-09-12T17:20:26.811 INFO:tasks.workunit.client.0.smithi016.stderr: -126> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:20:26.811 INFO:tasks.workunit.client.0.smithi016.stderr: -125> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient: _renew_subs 2024-09-12T17:20:26.811 INFO:tasks.workunit.client.0.smithi016.stderr: -124> 2024-09-12T17:20:26.186+0000 7f253fb199c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:20:26.812 INFO:tasks.workunit.client.0.smithi016.stderr: -123> 2024-09-12T17:20:26.186+0000 7f253fb199c0 1 librados: init done 2024-09-12T17:20:26.812 INFO:tasks.workunit.client.0.smithi016.stderr: -122> 2024-09-12T17:20:26.186+0000 7f253fb199c0 5 asok(0x562de8d5f2b0) register_command cr dump hook 0x562de9035878 2024-09-12T17:20:26.812 INFO:tasks.workunit.client.0.smithi016.stderr: -121> 2024-09-12T17:20:26.190+0000 7f253fb199c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.812 INFO:tasks.workunit.client.0.smithi016.stderr: -120> 2024-09-12T17:20:26.190+0000 7f240effd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:20:26.812 INFO:tasks.workunit.client.0.smithi016.stderr: -119> 2024-09-12T17:20:26.190+0000 7f240effd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:20:26.812 INFO:tasks.workunit.client.0.smithi016.stderr: -118> 2024-09-12T17:20:26.190+0000 7f240effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:20:26.812 INFO:tasks.workunit.client.0.smithi016.stderr: -117> 2024-09-12T17:20:26.190+0000 7f253ce1e640 10 monclient: get_auth_request con 0x7f2408070ae0 auth_method 0 2024-09-12T17:20:26.812 INFO:tasks.workunit.client.0.smithi016.stderr: -116> 2024-09-12T17:20:26.190+0000 7f253d61f640 10 monclient: get_auth_request con 0x562de90580b0 auth_method 0 2024-09-12T17:20:26.812 INFO:tasks.workunit.client.0.smithi016.stderr: -115> 2024-09-12T17:20:26.190+0000 7f253fb199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:26.812 INFO:tasks.workunit.client.0.smithi016.stderr: -114> 2024-09-12T17:20:26.190+0000 7f253fb199c0 20 realm 2024-09-12T17:20:26.812 INFO:tasks.workunit.client.0.smithi016.stderr: -113> 2024-09-12T17:20:26.190+0000 7f253fb199c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.812 INFO:tasks.workunit.client.0.smithi016.stderr: -112> 2024-09-12T17:20:26.190+0000 7f253fb199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:26.813 INFO:tasks.workunit.client.0.smithi016.stderr: -111> 2024-09-12T17:20:26.190+0000 7f253fb199c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:20:26.813 INFO:tasks.workunit.client.0.smithi016.stderr: -110> 2024-09-12T17:20:26.190+0000 7f253fb199c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.813 INFO:tasks.workunit.client.0.smithi016.stderr: -109> 2024-09-12T17:20:26.190+0000 7f253fb199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:26.813 INFO:tasks.workunit.client.0.smithi016.stderr: -108> 2024-09-12T17:20:26.190+0000 7f253fb199c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.813 INFO:tasks.workunit.client.0.smithi016.stderr: -107> 2024-09-12T17:20:26.190+0000 7f253ce1e640 10 monclient: get_auth_request con 0x562de905c350 auth_method 0 2024-09-12T17:20:26.813 INFO:tasks.workunit.client.0.smithi016.stderr: -106> 2024-09-12T17:20:26.194+0000 7f253fb199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:20:26.813 INFO:tasks.workunit.client.0.smithi016.stderr: -105> 2024-09-12T17:20:26.194+0000 7f253fb199c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.813 INFO:tasks.workunit.client.0.smithi016.stderr: -104> 2024-09-12T17:20:26.194+0000 7f253de20640 10 monclient: get_auth_request con 0x562de905fc00 auth_method 0 2024-09-12T17:20:26.813 INFO:tasks.workunit.client.0.smithi016.stderr: -103> 2024-09-12T17:20:26.194+0000 7f253fb199c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:20:26.813 INFO:tasks.workunit.client.0.smithi016.stderr: -102> 2024-09-12T17:20:26.194+0000 7f253fb199c0 20 searching for the correct realm 2024-09-12T17:20:26.813 INFO:tasks.workunit.client.0.smithi016.stderr: -101> 2024-09-12T17:20:26.194+0000 7f253d61f640 10 monclient: get_auth_request con 0x562de9064980 auth_method 0 2024-09-12T17:20:26.813 INFO:tasks.workunit.client.0.smithi016.stderr: -100> 2024-09-12T17:20:26.198+0000 7f253ce1e640 10 monclient: get_auth_request con 0x7f25380c4940 auth_method 0 2024-09-12T17:20:26.813 INFO:tasks.workunit.client.0.smithi016.stderr: -99> 2024-09-12T17:20:26.198+0000 7f253de20640 10 monclient: get_auth_request con 0x7f2534013030 auth_method 0 2024-09-12T17:20:26.814 INFO:tasks.workunit.client.0.smithi016.stderr: -98> 2024-09-12T17:20:26.198+0000 7f253de20640 0 -- 172.21.15.16:0/411721815 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f2534013030 msgr2=0x7f2534013410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:20:26.814 INFO:tasks.workunit.client.0.smithi016.stderr: -97> 2024-09-12T17:20:26.402+0000 7f253de20640 10 monclient: get_auth_request con 0x7f2534013030 auth_method 0 2024-09-12T17:20:26.814 INFO:tasks.workunit.client.0.smithi016.stderr: -96> 2024-09-12T17:20:26.406+0000 7f253d61f640 10 monclient: get_auth_request con 0x7f2530018070 auth_method 0 2024-09-12T17:20:26.814 INFO:tasks.workunit.client.0.smithi016.stderr: -95> 2024-09-12T17:20:26.414+0000 7f253ce1e640 0 -- 172.21.15.16:0/411721815 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f253007f910 msgr2=0x7f25300791d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:20:26.814 INFO:tasks.workunit.client.0.smithi016.stderr: -94> 2024-09-12T17:20:26.618+0000 7f253ce1e640 10 monclient: get_auth_request con 0x7f253007f910 auth_method 0 2024-09-12T17:20:26.814 INFO:tasks.workunit.client.0.smithi016.stderr: -93> 2024-09-12T17:20:26.634+0000 7f253fb199c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:20:26.814 INFO:tasks.workunit.client.0.smithi016.stderr: -92> 2024-09-12T17:20:26.634+0000 7f253fb199c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:20:26.814 INFO:tasks.workunit.client.0.smithi016.stderr: -91> 2024-09-12T17:20:26.634+0000 7f253fb199c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:20:26.814 INFO:tasks.workunit.client.0.smithi016.stderr: -90> 2024-09-12T17:20:26.634+0000 7f253fb199c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:20:26.814 INFO:tasks.workunit.client.0.smithi016.stderr: -89> 2024-09-12T17:20:26.634+0000 7f253fb199c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:20:26.814 INFO:tasks.workunit.client.0.smithi016.stderr: -88> 2024-09-12T17:20:26.634+0000 7f253fb199c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:20:26.814 INFO:tasks.workunit.client.0.smithi016.stderr: -87> 2024-09-12T17:20:26.634+0000 7f253fb199c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.814 INFO:tasks.workunit.client.0.smithi016.stderr: -86> 2024-09-12T17:20:26.634+0000 7f253fb199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:26.815 INFO:tasks.workunit.client.0.smithi016.stderr: -85> 2024-09-12T17:20:26.634+0000 7f253fb199c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.815 INFO:tasks.workunit.client.0.smithi016.stderr: -84> 2024-09-12T17:20:26.634+0000 7f253fb199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:20:26.815 INFO:tasks.workunit.client.0.smithi016.stderr: -83> 2024-09-12T17:20:26.634+0000 7f253fb199c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.815 INFO:tasks.workunit.client.0.smithi016.stderr: -82> 2024-09-12T17:20:26.634+0000 7f253fb199c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:20:26.815 INFO:tasks.workunit.client.0.smithi016.stderr: -81> 2024-09-12T17:20:26.634+0000 7f253fb199c0 20 zone default found 2024-09-12T17:20:26.815 INFO:tasks.workunit.client.0.smithi016.stderr: -80> 2024-09-12T17:20:26.634+0000 7f253fb199c0 4 Realm: () 2024-09-12T17:20:26.815 INFO:tasks.workunit.client.0.smithi016.stderr: -79> 2024-09-12T17:20:26.634+0000 7f253fb199c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:20:26.815 INFO:tasks.workunit.client.0.smithi016.stderr: -78> 2024-09-12T17:20:26.634+0000 7f253fb199c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:20:26.815 INFO:tasks.workunit.client.0.smithi016.stderr: -77> 2024-09-12T17:20:26.634+0000 7f253fb199c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:20:26.815 INFO:tasks.workunit.client.0.smithi016.stderr: -76> 2024-09-12T17:20:26.634+0000 7f253fb199c0 20 zonegroup default 2024-09-12T17:20:26.815 INFO:tasks.workunit.client.0.smithi016.stderr: -75> 2024-09-12T17:20:26.634+0000 7f253fb199c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.815 INFO:tasks.workunit.client.0.smithi016.stderr: -74> 2024-09-12T17:20:26.638+0000 7f253fb199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:26.815 INFO:tasks.workunit.client.0.smithi016.stderr: -73> 2024-09-12T17:20:26.638+0000 7f253fb199c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.815 INFO:tasks.workunit.client.0.smithi016.stderr: -72> 2024-09-12T17:20:26.638+0000 7f253fb199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:26.816 INFO:tasks.workunit.client.0.smithi016.stderr: -71> 2024-09-12T17:20:26.638+0000 7f253fb199c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.816 INFO:tasks.workunit.client.0.smithi016.stderr: -70> 2024-09-12T17:20:26.638+0000 7f253fb199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:26.816 INFO:tasks.workunit.client.0.smithi016.stderr: -69> 2024-09-12T17:20:26.638+0000 7f253fb199c0 20 started sync module instance, tier type = 2024-09-12T17:20:26.816 INFO:tasks.workunit.client.0.smithi016.stderr: -68> 2024-09-12T17:20:26.638+0000 7f253fb199c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:20:26.816 INFO:tasks.workunit.client.0.smithi016.stderr: -67> 2024-09-12T17:20:26.662+0000 7f253fb199c0 20 add_watcher() i=0 2024-09-12T17:20:26.816 INFO:tasks.workunit.client.0.smithi016.stderr: -66> 2024-09-12T17:20:26.662+0000 7f253fb199c0 20 add_watcher() i=1 2024-09-12T17:20:26.816 INFO:tasks.workunit.client.0.smithi016.stderr: -65> 2024-09-12T17:20:26.662+0000 7f253fb199c0 20 add_watcher() i=2 2024-09-12T17:20:26.816 INFO:tasks.workunit.client.0.smithi016.stderr: -64> 2024-09-12T17:20:26.662+0000 7f253fb199c0 20 add_watcher() i=3 2024-09-12T17:20:26.816 INFO:tasks.workunit.client.0.smithi016.stderr: -63> 2024-09-12T17:20:26.662+0000 7f253fb199c0 20 add_watcher() i=4 2024-09-12T17:20:26.816 INFO:tasks.workunit.client.0.smithi016.stderr: -62> 2024-09-12T17:20:26.662+0000 7f253fb199c0 20 add_watcher() i=5 2024-09-12T17:20:26.816 INFO:tasks.workunit.client.0.smithi016.stderr: -61> 2024-09-12T17:20:26.662+0000 7f253fb199c0 20 add_watcher() i=6 2024-09-12T17:20:26.816 INFO:tasks.workunit.client.0.smithi016.stderr: -60> 2024-09-12T17:20:26.662+0000 7f253fb199c0 20 add_watcher() i=7 2024-09-12T17:20:26.816 INFO:tasks.workunit.client.0.smithi016.stderr: -59> 2024-09-12T17:20:26.662+0000 7f253fb199c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:20:26.816 INFO:tasks.workunit.client.0.smithi016.stderr: -58> 2024-09-12T17:20:26.666+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf560) adding auth protocol: cephx 2024-09-12T17:20:26.817 INFO:tasks.workunit.client.0.smithi016.stderr: -57> 2024-09-12T17:20:26.666+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf560) adding auth protocol: cephx 2024-09-12T17:20:26.817 INFO:tasks.workunit.client.0.smithi016.stderr: -56> 2024-09-12T17:20:26.666+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf560) adding auth protocol: cephx 2024-09-12T17:20:26.817 INFO:tasks.workunit.client.0.smithi016.stderr: -55> 2024-09-12T17:20:26.666+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf560) adding con mode: secure 2024-09-12T17:20:26.817 INFO:tasks.workunit.client.0.smithi016.stderr: -54> 2024-09-12T17:20:26.666+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf560) adding con mode: crc 2024-09-12T17:20:26.817 INFO:tasks.workunit.client.0.smithi016.stderr: -53> 2024-09-12T17:20:26.666+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf560) adding con mode: secure 2024-09-12T17:20:26.817 INFO:tasks.workunit.client.0.smithi016.stderr: -52> 2024-09-12T17:20:26.666+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf560) adding con mode: crc 2024-09-12T17:20:26.817 INFO:tasks.workunit.client.0.smithi016.stderr: -51> 2024-09-12T17:20:26.666+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf560) adding con mode: secure 2024-09-12T17:20:26.817 INFO:tasks.workunit.client.0.smithi016.stderr: -50> 2024-09-12T17:20:26.666+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf560) adding con mode: crc 2024-09-12T17:20:26.817 INFO:tasks.workunit.client.0.smithi016.stderr: -49> 2024-09-12T17:20:26.666+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf560) adding con mode: crc 2024-09-12T17:20:26.817 INFO:tasks.workunit.client.0.smithi016.stderr: -48> 2024-09-12T17:20:26.666+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf560) adding con mode: secure 2024-09-12T17:20:26.817 INFO:tasks.workunit.client.0.smithi016.stderr: -47> 2024-09-12T17:20:26.666+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf560) adding con mode: crc 2024-09-12T17:20:26.817 INFO:tasks.workunit.client.0.smithi016.stderr: -46> 2024-09-12T17:20:26.666+0000 7f23f3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:20:26.817 INFO:tasks.workunit.client.0.smithi016.stderr: -45> 2024-09-12T17:20:26.666+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf560) adding con mode: secure 2024-09-12T17:20:26.818 INFO:tasks.workunit.client.0.smithi016.stderr: -44> 2024-09-12T17:20:26.666+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf560) adding con mode: crc 2024-09-12T17:20:26.818 INFO:tasks.workunit.client.0.smithi016.stderr: -43> 2024-09-12T17:20:26.666+0000 7f253fb199c0 5 AuthRegistry(0x7ffc550cf560) adding con mode: secure 2024-09-12T17:20:26.818 INFO:tasks.workunit.client.0.smithi016.stderr: -42> 2024-09-12T17:20:26.666+0000 7f253fb199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:20:26.818 INFO:tasks.workunit.client.0.smithi016.stderr: -41> 2024-09-12T17:20:26.666+0000 7f253fb199c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:20:26.818 INFO:tasks.workunit.client.0.smithi016.stderr: -40> 2024-09-12T17:20:26.666+0000 7f253fb199c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:20:26.818 INFO:tasks.workunit.client.0.smithi016.stderr: -39> 2024-09-12T17:20:26.666+0000 7f253fb199c0 5 asok(0x562de8d5f2b0) register_command cache list hook 0x562de902faf0 2024-09-12T17:20:26.818 INFO:tasks.workunit.client.0.smithi016.stderr: -38> 2024-09-12T17:20:26.666+0000 7f253fb199c0 5 asok(0x562de8d5f2b0) register_command cache inspect hook 0x562de902faf0 2024-09-12T17:20:26.818 INFO:tasks.workunit.client.0.smithi016.stderr: -37> 2024-09-12T17:20:26.666+0000 7f253fb199c0 5 asok(0x562de8d5f2b0) register_command cache erase hook 0x562de902faf0 2024-09-12T17:20:26.818 INFO:tasks.workunit.client.0.smithi016.stderr: -36> 2024-09-12T17:20:26.666+0000 7f253fb199c0 5 asok(0x562de8d5f2b0) register_command cache zap hook 0x562de902faf0 2024-09-12T17:20:26.818 INFO:tasks.workunit.client.0.smithi016.stderr: -35> 2024-09-12T17:20:26.666+0000 7f253fb199c0 5 note: GC not initialized 2024-09-12T17:20:26.818 INFO:tasks.workunit.client.0.smithi016.stderr: -34> 2024-09-12T17:20:26.670+0000 7f23f2fe5640 20 reqs_thread_entry: start 2024-09-12T17:20:26.818 INFO:tasks.workunit.client.0.smithi016.stderr: -33> 2024-09-12T17:20:26.670+0000 7f253fb199c0 5 asok(0x562de8d5f2b0) register_command sync trace show hook 0x7f2534021040 2024-09-12T17:20:26.818 INFO:tasks.workunit.client.0.smithi016.stderr: -32> 2024-09-12T17:20:26.670+0000 7f253fb199c0 5 asok(0x562de8d5f2b0) register_command sync trace history hook 0x7f2534021040 2024-09-12T17:20:26.819 INFO:tasks.workunit.client.0.smithi016.stderr: -31> 2024-09-12T17:20:26.670+0000 7f253fb199c0 5 asok(0x562de8d5f2b0) register_command sync trace active hook 0x7f2534021040 2024-09-12T17:20:26.819 INFO:tasks.workunit.client.0.smithi016.stderr: -30> 2024-09-12T17:20:26.670+0000 7f253fb199c0 5 asok(0x562de8d5f2b0) register_command sync trace active_short hook 0x7f2534021040 2024-09-12T17:20:26.819 INFO:tasks.workunit.client.0.smithi016.stderr: -29> 2024-09-12T17:20:26.670+0000 7f253fb199c0 20 init_complete bucket index max shards: 1 2024-09-12T17:20:26.819 INFO:tasks.workunit.client.0.smithi016.stderr: -28> 2024-09-12T17:20:26.670+0000 7f253fb199c0 20 Filter name: none 2024-09-12T17:20:26.819 INFO:tasks.workunit.client.0.smithi016.stderr: -27> 2024-09-12T17:20:26.670+0000 7f23f0fe1640 20 reqs_thread_entry: start 2024-09-12T17:20:26.819 INFO:tasks.workunit.client.0.smithi016.stderr: -26> 2024-09-12T17:20:26.670+0000 7f253fb199c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T17:20:26.819 INFO:tasks.workunit.client.0.smithi016.stderr: -25> 2024-09-12T17:20:26.670+0000 7f253fb199c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.819 INFO:tasks.workunit.client.0.smithi016.stderr: -24> 2024-09-12T17:20:26.670+0000 7f253fb199c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:20:26.819 INFO:tasks.workunit.client.0.smithi016.stderr: -23> 2024-09-12T17:20:26.670+0000 7f253fb199c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T17:20:26.819 INFO:tasks.workunit.client.0.smithi016.stderr: -22> 2024-09-12T17:20:26.670+0000 7f253fb199c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T17:20:26.819 INFO:tasks.workunit.client.0.smithi016.stderr: -21> 2024-09-12T17:20:26.670+0000 7f253fb199c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 : miss 2024-09-12T17:20:26.819 INFO:tasks.workunit.client.0.smithi016.stderr: -20> 2024-09-12T17:20:26.670+0000 7f253fb199c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.819 INFO:tasks.workunit.client.0.smithi016.stderr: -19> 2024-09-12T17:20:26.670+0000 7f253fb199c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:20:26.819 INFO:tasks.workunit.client.0.smithi016.stderr: -18> 2024-09-12T17:20:26.670+0000 7f253fb199c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 info.flags=0x17 2024-09-12T17:20:26.819 INFO:tasks.workunit.client.0.smithi016.stderr: -17> 2024-09-12T17:20:26.670+0000 7f253fb199c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 to cache LRU end 2024-09-12T17:20:26.820 INFO:tasks.workunit.client.0.smithi016.stderr: -16> 2024-09-12T17:20:26.670+0000 7f253fb199c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:20:26.820 INFO:tasks.workunit.client.0.smithi016.stderr: -15> 2024-09-12T17:20:26.670+0000 7f253fb199c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:20:26.820 INFO:tasks.workunit.client.0.smithi016.stderr: -14> 2024-09-12T17:20:26.670+0000 7f253fb199c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 2024-09-12T17:20:26.820 INFO:tasks.workunit.client.0.smithi016.stderr: -13> 2024-09-12T17:20:26.678+0000 7f253fb199c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 info.flags=0x17 2024-09-12T17:20:26.820 INFO:tasks.workunit.client.0.smithi016.stderr: -12> 2024-09-12T17:20:26.678+0000 7f253fb199c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 to cache LRU end 2024-09-12T17:20:26.820 INFO:tasks.workunit.client.0.smithi016.stderr: -11> 2024-09-12T17:20:26.678+0000 7f253fb199c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:20:26.820 INFO:tasks.workunit.client.0.smithi016.stderr: -10> 2024-09-12T17:20:26.678+0000 7f253fb199c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34, ofs0, ns] 2024-09-12T17:20:26.820 INFO:tasks.workunit.client.0.smithi016.stderr: -9> 2024-09-12T17:20:26.682+0000 7f2420ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431580 cookie 94755183056384 notifier 7118 bl.length()=911 2024-09-12T17:20:26.820 INFO:tasks.workunit.client.0.smithi016.stderr: -8> 2024-09-12T17:20:26.682+0000 7f2420ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 info.flags=0x17 2024-09-12T17:20:26.820 INFO:tasks.workunit.client.0.smithi016.stderr: -7> 2024-09-12T17:20:26.682+0000 7f2420ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 to cache LRU end 2024-09-12T17:20:26.820 INFO:tasks.workunit.client.0.smithi016.stderr: -6> 2024-09-12T17:20:26.682+0000 7f2420ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:20:26.820 INFO:tasks.workunit.client.0.smithi016.stderr: -5> 2024-09-12T17:20:26.682+0000 7f253fb199c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34]): orig_sources= new_sources= 2024-09-12T17:20:26.820 INFO:tasks.workunit.client.0.smithi016.stderr: -4> 2024-09-12T17:20:26.682+0000 7f253fb199c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34]): potential sources added=[] removed=[] 2024-09-12T17:20:26.821 INFO:tasks.workunit.client.0.smithi016.stderr: -3> 2024-09-12T17:20:26.682+0000 7f253fb199c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34]): orig_dests= new_dests= 2024-09-12T17:20:26.821 INFO:tasks.workunit.client.0.smithi016.stderr: -2> 2024-09-12T17:20:26.682+0000 7f253fb199c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34]): potential dests added=[] removed=[] 2024-09-12T17:20:26.821 INFO:tasks.workunit.client.0.smithi016.stderr: -1> 2024-09-12T17:20:26.686+0000 7f253fb199c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f253fb199c0 time 2024-09-12T17:20:26.689341+0000 2024-09-12T17:20:26.821 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:20:26.821 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:26.821 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:20:26.821 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f25433f32eb] 2024-09-12T17:20:26.821 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f25433f349f] 2024-09-12T17:20:26.821 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562de72100c1] 2024-09-12T17:20:26.821 INFO:tasks.workunit.client.0.smithi016.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562de72221fa] 2024-09-12T17:20:26.821 INFO:tasks.workunit.client.0.smithi016.stderr: 5: main() 2024-09-12T17:20:26.821 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2542259d90] 2024-09-12T17:20:26.821 INFO:tasks.workunit.client.0.smithi016.stderr: 7: __libc_start_main() 2024-09-12T17:20:26.821 INFO:tasks.workunit.client.0.smithi016.stderr: 8: _start() 2024-09-12T17:20:26.822 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:26.822 INFO:tasks.workunit.client.0.smithi016.stderr: 0> 2024-09-12T17:20:26.690+0000 7f253fb199c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:20:26.822 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7f253fb199c0 thread_name:radosgw-admin 2024-09-12T17:20:26.822 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:26.822 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:20:26.822 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2542272520] 2024-09-12T17:20:26.822 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:20:26.822 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:20:26.822 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:20:26.822 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f25433f3345] 2024-09-12T17:20:26.822 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f25433f349f] 2024-09-12T17:20:26.822 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562de72100c1] 2024-09-12T17:20:26.822 INFO:tasks.workunit.client.0.smithi016.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562de72221fa] 2024-09-12T17:20:26.823 INFO:tasks.workunit.client.0.smithi016.stderr: 9: main() 2024-09-12T17:20:26.823 INFO:tasks.workunit.client.0.smithi016.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2542259d90] 2024-09-12T17:20:26.823 INFO:tasks.workunit.client.0.smithi016.stderr: 11: __libc_start_main() 2024-09-12T17:20:26.823 INFO:tasks.workunit.client.0.smithi016.stderr: 12: _start() 2024-09-12T17:20:26.823 INFO:tasks.workunit.client.0.smithi016.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:20:26.823 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:26.823 INFO:tasks.workunit.client.0.smithi016.stderr:--- logging levels --- 2024-09-12T17:20:26.823 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 none 2024-09-12T17:20:26.823 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 lockdep 2024-09-12T17:20:26.823 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 context 2024-09-12T17:20:26.823 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 crush 2024-09-12T17:20:26.823 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds 2024-09-12T17:20:26.823 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_balancer 2024-09-12T17:20:26.823 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_locker 2024-09-12T17:20:26.824 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log 2024-09-12T17:20:26.824 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log_expire 2024-09-12T17:20:26.824 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_migrator 2024-09-12T17:20:26.824 INFO:tasks.workunit.client.0.smithi016.stderr: 3/ 5 mds_quiesce 2024-09-12T17:20:26.824 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 buffer 2024-09-12T17:20:26.824 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 timer 2024-09-12T17:20:26.824 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 filer 2024-09-12T17:20:26.824 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 striper 2024-09-12T17:20:26.824 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 objecter 2024-09-12T17:20:26.824 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rados 2024-09-12T17:20:26.824 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd 2024-09-12T17:20:26.824 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_mirror 2024-09-12T17:20:26.824 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_replay 2024-09-12T17:20:26.824 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_pwl 2024-09-12T17:20:26.825 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 journaler 2024-09-12T17:20:26.825 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objectcacher 2024-09-12T17:20:26.825 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:20:26.825 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 client 2024-09-12T17:20:26.825 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 osd 2024-09-12T17:20:26.825 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 optracker 2024-09-12T17:20:26.825 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objclass 2024-09-12T17:20:26.825 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 filestore 2024-09-12T17:20:26.825 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 journal 2024-09-12T17:20:26.825 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 ms 2024-09-12T17:20:26.825 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mon 2024-09-12T17:20:26.825 INFO:tasks.workunit.client.0.smithi016.stderr: 0/10 monc 2024-09-12T17:20:26.825 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 paxos 2024-09-12T17:20:26.825 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 tp 2024-09-12T17:20:26.825 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 auth 2024-09-12T17:20:26.826 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 crypto 2024-09-12T17:20:26.826 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 finisher 2024-09-12T17:20:26.826 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 reserver 2024-09-12T17:20:26.826 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 heartbeatmap 2024-09-12T17:20:26.826 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 perfcounter 2024-09-12T17:20:26.826 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw 2024-09-12T17:20:26.826 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_sync 2024-09-12T17:20:26.826 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_datacache 2024-09-12T17:20:26.826 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_access 2024-09-12T17:20:26.826 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:20:26.826 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_flight 2024-09-12T17:20:26.826 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:20:26.826 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw_notification 2024-09-12T17:20:26.826 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 javaclient 2024-09-12T17:20:26.827 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 asok 2024-09-12T17:20:26.827 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 throttle 2024-09-12T17:20:26.827 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 refs 2024-09-12T17:20:26.827 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 compressor 2024-09-12T17:20:26.827 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluestore 2024-09-12T17:20:26.827 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluefs 2024-09-12T17:20:26.827 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 bdev 2024-09-12T17:20:26.827 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 kstore 2024-09-12T17:20:26.827 INFO:tasks.workunit.client.0.smithi016.stderr: 4/ 5 rocksdb 2024-09-12T17:20:26.827 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 fuse 2024-09-12T17:20:26.827 INFO:tasks.workunit.client.0.smithi016.stderr: 2/ 5 mgr 2024-09-12T17:20:26.827 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mgrc 2024-09-12T17:20:26.827 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 dpdk 2024-09-12T17:20:26.827 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 eventtrace 2024-09-12T17:20:26.827 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 prioritycache 2024-09-12T17:20:26.828 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 test 2024-09-12T17:20:26.828 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:20:26.828 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephsqlite 2024-09-12T17:20:26.828 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:20:26.828 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore 2024-09-12T17:20:26.828 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_onode 2024-09-12T17:20:26.828 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_odata 2024-09-12T17:20:26.828 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_omap 2024-09-12T17:20:26.828 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_tm 2024-09-12T17:20:26.828 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_t 2024-09-12T17:20:26.828 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:20:26.828 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_epm 2024-09-12T17:20:26.829 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_lba 2024-09-12T17:20:26.829 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:20:26.829 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cache 2024-09-12T17:20:26.829 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_journal 2024-09-12T17:20:26.829 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_device 2024-09-12T17:20:26.829 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_backref 2024-09-12T17:20:26.829 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 alienstore 2024-09-12T17:20:26.829 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mclock 2024-09-12T17:20:26.829 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cyanstore 2024-09-12T17:20:26.829 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 ceph_exporter 2024-09-12T17:20:26.829 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 memstore 2024-09-12T17:20:26.829 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 trace 2024-09-12T17:20:26.829 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 ceph_dedup 2024-09-12T17:20:26.829 INFO:tasks.workunit.client.0.smithi016.stderr: -2/-2 (syslog threshold) 2024-09-12T17:20:26.829 INFO:tasks.workunit.client.0.smithi016.stderr: 99/99 (stderr threshold) 2024-09-12T17:20:26.830 INFO:tasks.workunit.client.0.smithi016.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:20:26.830 INFO:tasks.workunit.client.0.smithi016.stderr: 7f23f0fe1640 / http_manager 2024-09-12T17:20:26.830 INFO:tasks.workunit.client.0.smithi016.stderr: 7f23f2fe5640 / http_manager 2024-09-12T17:20:26.830 INFO:tasks.workunit.client.0.smithi016.stderr: 7f23f3fe7640 / rgw_dt_lg_renew 2024-09-12T17:20:26.830 INFO:tasks.workunit.client.0.smithi016.stderr: 7f240effd640 / ms_dispatch 2024-09-12T17:20:26.830 INFO:tasks.workunit.client.0.smithi016.stderr: 7f2420ff9640 / io_context_pool 2024-09-12T17:20:26.830 INFO:tasks.workunit.client.0.smithi016.stderr: 7f2422ffd640 / ms_dispatch 2024-09-12T17:20:26.830 INFO:tasks.workunit.client.0.smithi016.stderr: 7f2429e03640 / ms_dispatch 2024-09-12T17:20:26.830 INFO:tasks.workunit.client.0.smithi016.stderr: 7f242b606640 / io_context_pool 2024-09-12T17:20:26.830 INFO:tasks.workunit.client.0.smithi016.stderr: 7f253ce1e640 / msgr-worker-2 2024-09-12T17:20:26.830 INFO:tasks.workunit.client.0.smithi016.stderr: 7f253d61f640 / msgr-worker-1 2024-09-12T17:20:26.830 INFO:tasks.workunit.client.0.smithi016.stderr: 7f253de20640 / msgr-worker-0 2024-09-12T17:20:26.830 INFO:tasks.workunit.client.0.smithi016.stderr: 7f253e621640 / io_context_pool 2024-09-12T17:20:26.830 INFO:tasks.workunit.client.0.smithi016.stderr: 7f253fb199c0 / radosgw-admin 2024-09-12T17:20:26.830 INFO:tasks.workunit.client.0.smithi016.stderr: max_recent 500 2024-09-12T17:20:26.831 INFO:tasks.workunit.client.0.smithi016.stderr: max_new 1000 2024-09-12T17:20:26.831 INFO:tasks.workunit.client.0.smithi016.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:20:26.692304Z_0c77b130-952e-4eb9-bf73-cb4059122953/log 2024-09-12T17:20:26.831 INFO:tasks.workunit.client.0.smithi016.stderr:--- end dump of recent events --- 2024-09-12T17:20:26.831 INFO:tasks.workunit.client.0.smithi016.stderr:Aborted 2024-09-12T17:20:26.831 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T17:20:26.832 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:20:26.832 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:20:26.832 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.782+0000 7f96d5fde9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.832 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.782+0000 7f96d5fde9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:26.832 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.782+0000 7f96d5fde9c0 20 realm 2024-09-12T17:20:26.833 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.782+0000 7f96d5fde9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.833 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.782+0000 7f96d5fde9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:26.833 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.782+0000 7f96d5fde9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:20:26.833 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.782+0000 7f96d5fde9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.833 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.782+0000 7f96d5fde9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:26.833 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.782+0000 7f96d5fde9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.833 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.786+0000 7f96d5fde9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:20:26.833 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.786+0000 7f96d5fde9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:26.833 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.786+0000 7f96d5fde9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:20:26.833 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.786+0000 7f96d5fde9c0 20 searching for the correct realm 2024-09-12T17:20:26.833 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:26.790+0000 7f96d42e5640 0 -- 172.21.15.16:0/689519097 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f96c8018070 msgr2=0x7f96c805bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:20:27.003 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.002+0000 7f96d32e3640 0 -- 172.21.15.16:0/689519097 >> [v2:172.21.15.19:6824/2441769319,v1:172.21.15.19:6825/2441769319] conn(0x55e535d27fc0 msgr2=0x55e535d2a3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:20:27.018 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.018+0000 7f96d5fde9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:20:27.019 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.018+0000 7f96d5fde9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:20:27.019 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.018+0000 7f96d5fde9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:20:27.019 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.018+0000 7f96d5fde9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:20:27.019 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.018+0000 7f96d5fde9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:20:27.019 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.018+0000 7f96d5fde9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:20:27.019 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.018+0000 7f96d5fde9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:27.019 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.018+0000 7f96d5fde9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:27.019 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.018+0000 7f96d5fde9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:27.020 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.022+0000 7f96d5fde9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:20:27.020 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.022+0000 7f96d5fde9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:27.021 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.022+0000 7f96d5fde9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:20:27.021 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.022+0000 7f96d5fde9c0 20 zone default found 2024-09-12T17:20:27.022 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.022+0000 7f96d5fde9c0 4 Realm: () 2024-09-12T17:20:27.022 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.022+0000 7f96d5fde9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:20:27.022 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.022+0000 7f96d5fde9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:20:27.022 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.022+0000 7f96d5fde9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:20:27.022 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.022+0000 7f96d5fde9c0 20 zonegroup default 2024-09-12T17:20:27.022 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.022+0000 7f96d5fde9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:27.022 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.022+0000 7f96d5fde9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:27.022 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.022+0000 7f96d5fde9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:27.023 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.022+0000 7f96d5fde9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:27.023 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.022+0000 7f96d5fde9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:27.024 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.022+0000 7f96d5fde9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:27.024 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.022+0000 7f96d5fde9c0 20 started sync module instance, tier type = 2024-09-12T17:20:27.024 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.022+0000 7f96d5fde9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:20:27.050 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.050+0000 7f96d5fde9c0 20 add_watcher() i=0 2024-09-12T17:20:27.051 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.050+0000 7f96d5fde9c0 20 add_watcher() i=1 2024-09-12T17:20:27.051 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.050+0000 7f96d5fde9c0 20 add_watcher() i=2 2024-09-12T17:20:27.051 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.050+0000 7f96d5fde9c0 20 add_watcher() i=3 2024-09-12T17:20:27.051 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.050+0000 7f96d5fde9c0 20 add_watcher() i=4 2024-09-12T17:20:27.051 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.050+0000 7f96d5fde9c0 20 add_watcher() i=5 2024-09-12T17:20:27.051 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.050+0000 7f96d5fde9c0 20 add_watcher() i=6 2024-09-12T17:20:27.053 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.054+0000 7f96d5fde9c0 20 add_watcher() i=7 2024-09-12T17:20:27.053 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.054+0000 7f96d5fde9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:20:27.057 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.058+0000 7f958a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:20:27.058 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.058+0000 7f96d5fde9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:20:27.058 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.058+0000 7f96d5fde9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:20:27.058 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.058+0000 7f96d5fde9c0 5 note: GC not initialized 2024-09-12T17:20:27.059 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.058+0000 7f95897e2640 20 reqs_thread_entry: start 2024-09-12T17:20:27.059 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.058+0000 7f96d5fde9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:20:27.059 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.058+0000 7f96d5fde9c0 20 Filter name: none 2024-09-12T17:20:27.059 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.058+0000 7f95827fc640 20 reqs_thread_entry: start 2024-09-12T17:20:27.059 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.058+0000 7f96d5fde9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:27.060 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.062+0000 7f96d5fde9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:20:27.060 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.062+0000 7f96d5fde9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:27.061 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.062+0000 7f96d5fde9c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T17:20:27.061 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.062+0000 7f96d5fde9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:20:27.061 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.062+0000 7f96d5fde9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:27.062 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.062+0000 7f96d5fde9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:20:27.062 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.062+0000 7f96d5fde9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:27.063 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.062+0000 7f96d5fde9c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T17:20:27.063 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.062+0000 7f96d5fde9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:20:27.065 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.066+0000 7f958a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:20:27.071 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.070+0000 7f96d5fde9c0 20 remove_watcher() i=0 2024-09-12T17:20:27.071 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.070+0000 7f96d5fde9c0 2 removed watcher, disabling cache 2024-09-12T17:20:27.074 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.074+0000 7f96d5fde9c0 20 remove_watcher() i=1 2024-09-12T17:20:27.078 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.078+0000 7f96d5fde9c0 20 remove_watcher() i=2 2024-09-12T17:20:27.080 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.082+0000 7f96d5fde9c0 20 remove_watcher() i=3 2024-09-12T17:20:27.082 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.082+0000 7f96d5fde9c0 20 remove_watcher() i=4 2024-09-12T17:20:27.085 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.086+0000 7f96d5fde9c0 20 remove_watcher() i=5 2024-09-12T17:20:27.087 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.086+0000 7f96d5fde9c0 20 remove_watcher() i=6 2024-09-12T17:20:27.090 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.090+0000 7f96d5fde9c0 20 remove_watcher() i=7 2024-09-12T17:20:27.106 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:27.106 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:20:27.106 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: abort-at-do-reshard id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:20:27.106 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:27.166 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:20:27.203 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:20:27.203 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:20:27.251 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.250+0000 7f8ebf1b39c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:27.253 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.254+0000 7f8ebf1b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:27.253 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.254+0000 7f8ebf1b39c0 20 realm 2024-09-12T17:20:27.253 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.254+0000 7f8ebf1b39c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:27.253 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.254+0000 7f8ebf1b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:27.253 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.254+0000 7f8ebf1b39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:20:27.253 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.254+0000 7f8ebf1b39c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:27.254 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.254+0000 7f8ebf1b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:27.254 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.254+0000 7f8ebf1b39c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:27.255 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.254+0000 7f8ebf1b39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:20:27.255 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.254+0000 7f8ebf1b39c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:27.257 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.258+0000 7f8ebf1b39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:20:27.257 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.258+0000 7f8ebf1b39c0 20 searching for the correct realm 2024-09-12T17:20:27.259 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.258+0000 7f8ebd4ba640 0 -- 172.21.15.16:0/2568554978 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f8eb00c3c20 msgr2=0x7f8eb00e1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:20:27.474 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.474+0000 7f8ebc4b8640 0 -- 172.21.15.16:0/2568554978 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f8eb409b0b0 msgr2=0x7f8eb4043750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:20:27.692 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.694+0000 7f8ebf1b39c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:20:27.693 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.694+0000 7f8ebf1b39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:20:27.693 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.694+0000 7f8ebf1b39c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:20:27.693 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.694+0000 7f8ebf1b39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:20:27.693 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.694+0000 7f8ebf1b39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:20:27.693 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.694+0000 7f8ebf1b39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:20:27.693 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.694+0000 7f8ebf1b39c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:27.693 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.694+0000 7f8ebf1b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:27.694 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.694+0000 7f8ebf1b39c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:27.694 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.694+0000 7f8ebf1b39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:20:27.694 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.694+0000 7f8ebf1b39c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:27.695 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.694+0000 7f8ebf1b39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:20:27.695 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.694+0000 7f8ebf1b39c0 20 zone default found 2024-09-12T17:20:27.695 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.694+0000 7f8ebf1b39c0 4 Realm: () 2024-09-12T17:20:27.695 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.694+0000 7f8ebf1b39c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:20:27.695 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.694+0000 7f8ebf1b39c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:20:27.695 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.694+0000 7f8ebf1b39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:20:27.695 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.694+0000 7f8ebf1b39c0 20 zonegroup default 2024-09-12T17:20:27.696 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.694+0000 7f8ebf1b39c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:27.696 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.694+0000 7f8ebf1b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:27.696 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.694+0000 7f8ebf1b39c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:27.697 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.698+0000 7f8ebf1b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:27.697 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.698+0000 7f8ebf1b39c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:27.698 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.698+0000 7f8ebf1b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:27.698 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.698+0000 7f8ebf1b39c0 20 started sync module instance, tier type = 2024-09-12T17:20:27.698 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.698+0000 7f8ebf1b39c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:20:27.729 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.730+0000 7f8ebf1b39c0 20 add_watcher() i=0 2024-09-12T17:20:27.729 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.730+0000 7f8ebf1b39c0 20 add_watcher() i=1 2024-09-12T17:20:27.729 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.730+0000 7f8ebf1b39c0 20 add_watcher() i=2 2024-09-12T17:20:27.729 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.730+0000 7f8ebf1b39c0 20 add_watcher() i=3 2024-09-12T17:20:27.729 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.730+0000 7f8ebf1b39c0 20 add_watcher() i=4 2024-09-12T17:20:27.730 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.730+0000 7f8ebf1b39c0 20 add_watcher() i=5 2024-09-12T17:20:27.730 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.730+0000 7f8ebf1b39c0 20 add_watcher() i=6 2024-09-12T17:20:27.731 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.730+0000 7f8ebf1b39c0 20 add_watcher() i=7 2024-09-12T17:20:27.731 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.730+0000 7f8ebf1b39c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:20:27.735 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.734+0000 7f8d72fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:20:27.736 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.738+0000 7f8ebf1b39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:20:27.737 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.738+0000 7f8ebf1b39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:20:27.737 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.738+0000 7f8ebf1b39c0 5 note: GC not initialized 2024-09-12T17:20:27.738 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.738+0000 7f8d71fe3640 20 reqs_thread_entry: start 2024-09-12T17:20:27.738 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.738+0000 7f8ebf1b39c0 20 init_complete bucket index max shards: 1 2024-09-12T17:20:27.738 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.738+0000 7f8ebf1b39c0 20 Filter name: none 2024-09-12T17:20:27.738 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.738+0000 7f8ce37fe640 20 reqs_thread_entry: start 2024-09-12T17:20:27.738 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.738+0000 7f8ebf1b39c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T17:20:27.738 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.738+0000 7f8ebf1b39c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:27.739 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.738+0000 7f8ebf1b39c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:20:27.739 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.738+0000 7f8ebf1b39c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T17:20:27.739 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.738+0000 7f8ebf1b39c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T17:20:27.739 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.738+0000 7f8ebf1b39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 : miss 2024-09-12T17:20:27.739 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.738+0000 7f8ebf1b39c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:27.740 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.738+0000 7f8ebf1b39c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T17:20:27.740 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.738+0000 7f8ebf1b39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 info.flags=0x17 2024-09-12T17:20:27.740 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.738+0000 7f8ebf1b39c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 to cache LRU end 2024-09-12T17:20:27.740 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.738+0000 7f8ebf1b39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:20:27.740 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.738+0000 7f8ebf1b39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:20:27.740 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.738+0000 7f8ebf1b39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 2024-09-12T17:20:27.743 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.742+0000 7f8ebf1b39c0 0 INFO: RGWReshardLock::lock found lock on abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 to be held by another RGW process; skipping for now 2024-09-12T17:20:27.744 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.746+0000 7f8d72fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:20:27.750 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.750+0000 7f8ebf1b39c0 20 remove_watcher() i=0 2024-09-12T17:20:27.750 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.750+0000 7f8ebf1b39c0 2 removed watcher, disabling cache 2024-09-12T17:20:27.752 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.750+0000 7f8ebf1b39c0 20 remove_watcher() i=1 2024-09-12T17:20:27.754 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.754+0000 7f8ebf1b39c0 20 remove_watcher() i=2 2024-09-12T17:20:27.757 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.758+0000 7f8ebf1b39c0 20 remove_watcher() i=3 2024-09-12T17:20:27.761 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.758+0000 7f8ebf1b39c0 20 remove_watcher() i=4 2024-09-12T17:20:27.761 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.762+0000 7f8ebf1b39c0 20 remove_watcher() i=5 2024-09-12T17:20:27.763 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.762+0000 7f8ebf1b39c0 20 remove_watcher() i=6 2024-09-12T17:20:27.765 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:27.766+0000 7f8ebf1b39c0 20 remove_watcher() i=7 2024-09-12T17:20:27.780 INFO:tasks.workunit.client.0.smithi016.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:20:57.810 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:20:57.848 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:20:57.849 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:20:57.897 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:57.897+0000 7fb289b279c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:57.899 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:57.897+0000 7fb289b279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:57.899 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:57.897+0000 7fb289b279c0 20 realm 2024-09-12T17:20:57.900 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:57.897+0000 7fb289b279c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:57.900 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:57.897+0000 7fb289b279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:57.900 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:57.897+0000 7fb289b279c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:20:57.900 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:57.897+0000 7fb289b279c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:57.900 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:57.897+0000 7fb289b279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:57.900 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:57.897+0000 7fb289b279c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:57.901 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:57.901+0000 7fb289b279c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:20:57.901 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:57.901+0000 7fb289b279c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:57.903 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:57.901+0000 7fb289b279c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:20:57.903 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:57.901+0000 7fb289b279c0 20 searching for the correct realm 2024-09-12T17:20:57.906 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:57.905+0000 7fb287e2e640 0 -- 172.21.15.16:0/123243310 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fb27003a040 msgr2=0x7fb27003a420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:20:57.914 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:57.913+0000 7fb286e2c640 0 -- 172.21.15.16:0/123243310 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fb2800cf430 msgr2=0x7fb2800cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:20:58.133 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.133+0000 7fb289b279c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:20:58.133 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.133+0000 7fb289b279c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:20:58.133 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.133+0000 7fb289b279c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:20:58.133 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.133+0000 7fb289b279c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:20:58.133 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.133+0000 7fb289b279c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:20:58.133 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.133+0000 7fb289b279c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:20:58.133 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.133+0000 7fb289b279c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:58.134 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.133+0000 7fb289b279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:58.134 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.133+0000 7fb289b279c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:58.134 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.133+0000 7fb289b279c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:20:58.134 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.133+0000 7fb289b279c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:58.136 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.133+0000 7fb289b279c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:20:58.136 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.133+0000 7fb289b279c0 20 zone default found 2024-09-12T17:20:58.136 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.133+0000 7fb289b279c0 4 Realm: () 2024-09-12T17:20:58.136 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.133+0000 7fb289b279c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:20:58.136 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.133+0000 7fb289b279c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:20:58.136 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.133+0000 7fb289b279c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:20:58.136 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.133+0000 7fb289b279c0 20 zonegroup default 2024-09-12T17:20:58.136 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.133+0000 7fb289b279c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:58.137 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.137+0000 7fb289b279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:58.137 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.137+0000 7fb289b279c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:58.137 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.137+0000 7fb289b279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:58.137 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.137+0000 7fb289b279c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:58.138 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.137+0000 7fb289b279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:58.138 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.137+0000 7fb289b279c0 20 started sync module instance, tier type = 2024-09-12T17:20:58.138 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.137+0000 7fb289b279c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:20:58.160 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.161+0000 7fb289b279c0 20 add_watcher() i=0 2024-09-12T17:20:58.161 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.161+0000 7fb289b279c0 20 add_watcher() i=1 2024-09-12T17:20:58.161 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.161+0000 7fb289b279c0 20 add_watcher() i=2 2024-09-12T17:20:58.161 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.161+0000 7fb289b279c0 20 add_watcher() i=3 2024-09-12T17:20:58.161 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.161+0000 7fb289b279c0 20 add_watcher() i=4 2024-09-12T17:20:58.161 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.161+0000 7fb289b279c0 20 add_watcher() i=5 2024-09-12T17:20:58.161 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.161+0000 7fb289b279c0 20 add_watcher() i=6 2024-09-12T17:20:58.163 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.161+0000 7fb289b279c0 20 add_watcher() i=7 2024-09-12T17:20:58.163 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.161+0000 7fb289b279c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:20:58.167 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.165+0000 7fb13dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:20:58.168 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.165+0000 7fb289b279c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:20:58.168 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.165+0000 7fb289b279c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:20:58.168 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.165+0000 7fb289b279c0 5 note: GC not initialized 2024-09-12T17:20:58.168 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.169+0000 7fb13cfe1640 20 reqs_thread_entry: start 2024-09-12T17:20:58.169 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.169+0000 7fb289b279c0 20 init_complete bucket index max shards: 1 2024-09-12T17:20:58.169 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.169+0000 7fb289b279c0 20 Filter name: none 2024-09-12T17:20:58.169 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.169+0000 7fb0b67fc640 20 reqs_thread_entry: start 2024-09-12T17:20:58.169 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.169+0000 7fb289b279c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T17:20:58.170 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.169+0000 7fb289b279c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:58.170 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.169+0000 7fb289b279c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:20:58.170 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.169+0000 7fb289b279c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T17:20:58.170 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.169+0000 7fb289b279c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T17:20:58.170 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.169+0000 7fb289b279c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 : miss 2024-09-12T17:20:58.170 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.169+0000 7fb289b279c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:58.171 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.169+0000 7fb289b279c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T17:20:58.171 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.169+0000 7fb289b279c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 info.flags=0x17 2024-09-12T17:20:58.171 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.169+0000 7fb289b279c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 to cache LRU end 2024-09-12T17:20:58.171 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.169+0000 7fb289b279c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:20:58.171 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.169+0000 7fb289b279c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:20:58.171 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.169+0000 7fb289b279c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 2024-09-12T17:20:58.174 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.173+0000 7fb289b279c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:20:58.183 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.181+0000 7fb289b279c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 info.flags=0x17 2024-09-12T17:20:58.183 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.181+0000 7fb289b279c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 to cache LRU end 2024-09-12T17:20:58.183 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.181+0000 7fb289b279c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:20:58.183 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.181+0000 7fb289b279c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34, ofs0, ns] 2024-09-12T17:20:58.183 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.181+0000 7fb16a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431581 cookie 94846880231872 notifier 7527 bl.length()=911 2024-09-12T17:20:58.184 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.181+0000 7fb16a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 info.flags=0x17 2024-09-12T17:20:58.184 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.181+0000 7fb16a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 to cache LRU end 2024-09-12T17:20:58.184 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.181+0000 7fb16a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:20:58.184 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.185+0000 7fb289b279c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34]): orig_sources= new_sources= 2024-09-12T17:20:58.184 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.185+0000 7fb289b279c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34]): potential sources added=[] removed=[] 2024-09-12T17:20:58.184 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.185+0000 7fb289b279c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34]): orig_dests= new_dests= 2024-09-12T17:20:58.184 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.185+0000 7fb289b279c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34]): potential dests added=[] removed=[] 2024-09-12T17:20:58.192 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.189+0000 7fb289b279c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34.2.0 2024-09-12T17:20:58.192 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.189+0000 7fb289b279c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34.2.0 2024-09-12T17:20:58.192 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.189+0000 7fb289b279c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34.2.1 2024-09-12T17:20:58.192 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.189+0000 7fb289b279c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34.2.1 2024-09-12T17:20:58.192 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.189+0000 7fb289b279c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34.0 2024-09-12T17:20:58.197 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.197+0000 7fb289b279c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 : hit (requested=0x17, cached=0x17) 2024-09-12T17:20:58.197 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.197+0000 7fb289b279c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 2024-09-12T17:20:58.200 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.197+0000 7fb289b279c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 info.flags=0x17 2024-09-12T17:20:58.200 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.197+0000 7fb289b279c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 to cache LRU end 2024-09-12T17:20:58.200 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.197+0000 7fb289b279c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:20:58.200 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.197+0000 7fb289b279c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34, ofs0, ns] 2024-09-12T17:20:58.200 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.201+0000 7fb16affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431582 cookie 94846880231872 notifier 7527 bl.length()=911 2024-09-12T17:20:58.201 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.201+0000 7fb16affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 info.flags=0x17 2024-09-12T17:20:58.201 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.201+0000 7fb16affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 to cache LRU end 2024-09-12T17:20:58.201 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.201+0000 7fb16affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:20:58.201 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.201+0000 7fb289b279c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34]): orig_sources= new_sources= 2024-09-12T17:20:58.201 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.201+0000 7fb289b279c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34]): potential sources added=[] removed=[] 2024-09-12T17:20:58.201 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.201+0000 7fb289b279c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34]): orig_dests= new_dests= 2024-09-12T17:20:58.201 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.201+0000 7fb289b279c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34]): potential dests added=[] removed=[] 2024-09-12T17:20:58.203 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.201+0000 7fb289b279c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34.0 2024-09-12T17:20:58.204 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.201+0000 7fb289b279c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 : hit (requested=0x17, cached=0x17) 2024-09-12T17:20:58.204 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.201+0000 7fb289b279c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 2024-09-12T17:20:58.207 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.205+0000 7fb289b279c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 info.flags=0x17 2024-09-12T17:20:58.207 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.205+0000 7fb289b279c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 to cache LRU end 2024-09-12T17:20:58.207 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.205+0000 7fb289b279c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:20:58.207 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.205+0000 7fb289b279c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34, ofs0, ns] 2024-09-12T17:20:58.208 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.205+0000 7fb16a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431583 cookie 94846880231872 notifier 7527 bl.length()=879 2024-09-12T17:20:58.208 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.205+0000 7fb16a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 info.flags=0x17 2024-09-12T17:20:58.208 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.205+0000 7fb16a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 to cache LRU end 2024-09-12T17:20:58.208 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.205+0000 7fb16a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:20:58.208 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.209+0000 7fb289b279c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34]): orig_sources= new_sources= 2024-09-12T17:20:58.208 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.209+0000 7fb289b279c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34]): potential sources added=[] removed=[] 2024-09-12T17:20:58.208 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.209+0000 7fb289b279c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34]): orig_dests= new_dests= 2024-09-12T17:20:58.209 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.209+0000 7fb289b279c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34]): potential dests added=[] removed=[] 2024-09-12T17:20:58.211 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.209+0000 7fb289b279c0 1 execute INFO: reshard of bucket "abort-at-do-reshard" from 1 shards to 2 shards completed successfully 2024-09-12T17:20:58.216 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.213+0000 7fb13dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:20:58.221 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.221+0000 7fb289b279c0 20 remove_watcher() i=0 2024-09-12T17:20:58.221 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.221+0000 7fb289b279c0 2 removed watcher, disabling cache 2024-09-12T17:20:58.223 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.221+0000 7fb289b279c0 20 remove_watcher() i=1 2024-09-12T17:20:58.225 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.225+0000 7fb289b279c0 20 remove_watcher() i=2 2024-09-12T17:20:58.228 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.225+0000 7fb289b279c0 20 remove_watcher() i=3 2024-09-12T17:20:58.230 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.229+0000 7fb289b279c0 20 remove_watcher() i=4 2024-09-12T17:20:58.231 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.229+0000 7fb289b279c0 20 remove_watcher() i=5 2024-09-12T17:20:58.233 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.233+0000 7fb289b279c0 20 remove_watcher() i=6 2024-09-12T17:20:58.235 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.233+0000 7fb289b279c0 20 remove_watcher() i=7 2024-09-12T17:20:58.251 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T17:20:58.282 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:20:58.283 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:20:58.328 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.329+0000 7fca6ca799c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:58.331 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.329+0000 7fca6ca799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:58.331 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.329+0000 7fca6ca799c0 20 realm 2024-09-12T17:20:58.331 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.329+0000 7fca6ca799c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:58.331 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.329+0000 7fca6ca799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:58.331 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.329+0000 7fca6ca799c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:20:58.331 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.329+0000 7fca6ca799c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:58.331 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.329+0000 7fca6ca799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:58.332 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.329+0000 7fca6ca799c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:58.333 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.333+0000 7fca6ca799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:20:58.333 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.333+0000 7fca6ca799c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:58.334 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.333+0000 7fca6ca799c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:20:58.334 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.333+0000 7fca6ca799c0 20 searching for the correct realm 2024-09-12T17:20:58.337 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.337+0000 7fca6ad80640 0 -- 172.21.15.16:0/4102870078 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fca6003a040 msgr2=0x7fca6009c8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:20:58.553 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.553+0000 7fca69d7e640 0 -- 172.21.15.16:0/4102870078 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fca640fe0a0 msgr2=0x7fca640b8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:20:58.772 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.769+0000 7fca6ca799c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:20:58.772 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.769+0000 7fca6ca799c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:20:58.772 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.769+0000 7fca6ca799c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:20:58.772 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.769+0000 7fca6ca799c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:20:58.772 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.769+0000 7fca6ca799c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:20:58.772 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.769+0000 7fca6ca799c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:20:58.772 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.769+0000 7fca6ca799c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:58.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.773+0000 7fca6ca799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:58.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.773+0000 7fca6ca799c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:58.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.773+0000 7fca6ca799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:20:58.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.773+0000 7fca6ca799c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:58.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.773+0000 7fca6ca799c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:20:58.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.773+0000 7fca6ca799c0 20 zone default found 2024-09-12T17:20:58.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.773+0000 7fca6ca799c0 4 Realm: () 2024-09-12T17:20:58.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.773+0000 7fca6ca799c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:20:58.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.773+0000 7fca6ca799c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:20:58.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.773+0000 7fca6ca799c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:20:58.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.773+0000 7fca6ca799c0 20 zonegroup default 2024-09-12T17:20:58.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.773+0000 7fca6ca799c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:58.775 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.773+0000 7fca6ca799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:58.775 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.773+0000 7fca6ca799c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:58.775 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.773+0000 7fca6ca799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:58.775 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.773+0000 7fca6ca799c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:58.776 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.773+0000 7fca6ca799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:58.776 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.773+0000 7fca6ca799c0 20 started sync module instance, tier type = 2024-09-12T17:20:58.776 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.773+0000 7fca6ca799c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:20:58.799 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.797+0000 7fca6ca799c0 20 add_watcher() i=0 2024-09-12T17:20:58.800 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.797+0000 7fca6ca799c0 20 add_watcher() i=1 2024-09-12T17:20:58.800 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.797+0000 7fca6ca799c0 20 add_watcher() i=2 2024-09-12T17:20:58.800 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.797+0000 7fca6ca799c0 20 add_watcher() i=3 2024-09-12T17:20:58.800 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.797+0000 7fca6ca799c0 20 add_watcher() i=4 2024-09-12T17:20:58.800 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.797+0000 7fca6ca799c0 20 add_watcher() i=5 2024-09-12T17:20:58.800 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.797+0000 7fca6ca799c0 20 add_watcher() i=6 2024-09-12T17:20:58.802 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.801+0000 7fca6ca799c0 20 add_watcher() i=7 2024-09-12T17:20:58.802 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.801+0000 7fca6ca799c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:20:58.807 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.805+0000 7fc920fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:20:58.808 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.805+0000 7fca6ca799c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:20:58.808 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.805+0000 7fca6ca799c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:20:58.808 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.805+0000 7fca6ca799c0 5 note: GC not initialized 2024-09-12T17:20:58.808 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.809+0000 7fc89b7fe640 20 reqs_thread_entry: start 2024-09-12T17:20:58.809 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.809+0000 7fca6ca799c0 20 init_complete bucket index max shards: 1 2024-09-12T17:20:58.809 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.809+0000 7fca6ca799c0 20 Filter name: none 2024-09-12T17:20:58.809 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.809+0000 7fc8997fa640 20 reqs_thread_entry: start 2024-09-12T17:20:58.809 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.809+0000 7fca6ca799c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:58.810 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.809+0000 7fca6ca799c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:20:58.810 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.809+0000 7fca6ca799c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:58.811 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.809+0000 7fca6ca799c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:20:58.811 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.809+0000 7fca6ca799c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:20:58.811 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.809+0000 7fca6ca799c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:58.812 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.813+0000 7fca6ca799c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:20:58.812 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.813+0000 7fca6ca799c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:58.812 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.813+0000 7fca6ca799c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:20:58.813 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.813+0000 7fca6ca799c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:20:58.815 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.813+0000 7fc920fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:20:58.820 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.821+0000 7fca6ca799c0 20 remove_watcher() i=0 2024-09-12T17:20:58.820 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.821+0000 7fca6ca799c0 2 removed watcher, disabling cache 2024-09-12T17:20:58.823 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.821+0000 7fca6ca799c0 20 remove_watcher() i=1 2024-09-12T17:20:58.825 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.825+0000 7fca6ca799c0 20 remove_watcher() i=2 2024-09-12T17:20:58.827 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.825+0000 7fca6ca799c0 20 remove_watcher() i=3 2024-09-12T17:20:58.829 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.829+0000 7fca6ca799c0 20 remove_watcher() i=4 2024-09-12T17:20:58.831 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.829+0000 7fca6ca799c0 20 remove_watcher() i=5 2024-09-12T17:20:58.832 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.833+0000 7fca6ca799c0 20 remove_watcher() i=6 2024-09-12T17:20:58.834 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:58.833+0000 7fca6ca799c0 20 remove_watcher() i=7 2024-09-12T17:20:58.852 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:58.853 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:20:58.853 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: abort-at-do-reshard id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:20:58.853 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:58.950 INFO:tasks.workunit.client.0.smithi016.stderr:TEST: reshard bucket with EIO injected at logrecord_writes 2024-09-12T17:20:58.950 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:20:59.417 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T17:20:59.450 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:20:59.451 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:20:59.497 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.497+0000 7f7b6662f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:59.499 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.497+0000 7f7b6662f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:59.499 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.497+0000 7f7b6662f9c0 20 realm 2024-09-12T17:20:59.499 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.497+0000 7f7b6662f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:59.500 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.497+0000 7f7b6662f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:59.500 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.497+0000 7f7b6662f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:20:59.500 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.497+0000 7f7b6662f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:59.500 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.497+0000 7f7b6662f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:59.500 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.497+0000 7f7b6662f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:59.501 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.501+0000 7f7b6662f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:20:59.501 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.501+0000 7f7b6662f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:59.503 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.501+0000 7f7b6662f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:20:59.503 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.501+0000 7f7b6662f9c0 20 searching for the correct realm 2024-09-12T17:20:59.506 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.505+0000 7f7b64936640 0 -- 172.21.15.16:0/2260903956 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f7b58018070 msgr2=0x7f7b5805da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:20:59.723 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.721+0000 7f7b63934640 0 -- 172.21.15.16:0/2260903956 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f7b5c017930 msgr2=0x7f7b5c03b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:20:59.940 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.937+0000 7f7b6662f9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:20:59.940 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.937+0000 7f7b6662f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:20:59.940 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.937+0000 7f7b6662f9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:20:59.940 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.937+0000 7f7b6662f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:20:59.940 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.937+0000 7f7b6662f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:20:59.940 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.937+0000 7f7b6662f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:20:59.940 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.937+0000 7f7b6662f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:59.941 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.941+0000 7f7b6662f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:59.941 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.941+0000 7f7b6662f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:59.941 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.941+0000 7f7b6662f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:20:59.941 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.941+0000 7f7b6662f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:59.942 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.941+0000 7f7b6662f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:20:59.942 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.941+0000 7f7b6662f9c0 20 zone default found 2024-09-12T17:20:59.942 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.941+0000 7f7b6662f9c0 4 Realm: () 2024-09-12T17:20:59.942 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.941+0000 7f7b6662f9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:20:59.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.941+0000 7f7b6662f9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:20:59.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.941+0000 7f7b6662f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:20:59.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.941+0000 7f7b6662f9c0 20 zonegroup default 2024-09-12T17:20:59.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.941+0000 7f7b6662f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:59.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.941+0000 7f7b6662f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:59.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.941+0000 7f7b6662f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:59.944 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.941+0000 7f7b6662f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:59.944 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.941+0000 7f7b6662f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:59.944 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.945+0000 7f7b6662f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:59.944 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.945+0000 7f7b6662f9c0 20 started sync module instance, tier type = 2024-09-12T17:20:59.945 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.945+0000 7f7b6662f9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:20:59.966 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.965+0000 7f7b6662f9c0 20 add_watcher() i=0 2024-09-12T17:20:59.966 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.965+0000 7f7b6662f9c0 20 add_watcher() i=1 2024-09-12T17:20:59.966 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.965+0000 7f7b6662f9c0 20 add_watcher() i=2 2024-09-12T17:20:59.966 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.965+0000 7f7b6662f9c0 20 add_watcher() i=3 2024-09-12T17:20:59.966 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.965+0000 7f7b6662f9c0 20 add_watcher() i=4 2024-09-12T17:20:59.966 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.965+0000 7f7b6662f9c0 20 add_watcher() i=5 2024-09-12T17:20:59.966 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.965+0000 7f7b6662f9c0 20 add_watcher() i=6 2024-09-12T17:20:59.968 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.965+0000 7f7b6662f9c0 20 add_watcher() i=7 2024-09-12T17:20:59.968 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.965+0000 7f7b6662f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:20:59.972 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.973+0000 7f7a1afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:20:59.973 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.973+0000 7f7b6662f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:20:59.974 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.973+0000 7f7b6662f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:20:59.974 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.973+0000 7f7b6662f9c0 5 note: GC not initialized 2024-09-12T17:20:59.974 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.973+0000 7f7a19fdb640 20 reqs_thread_entry: start 2024-09-12T17:20:59.974 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.973+0000 7f7b6662f9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:20:59.975 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.973+0000 7f7b6662f9c0 20 Filter name: none 2024-09-12T17:20:59.975 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.973+0000 7f798b7fe640 20 reqs_thread_entry: start 2024-09-12T17:20:59.975 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.973+0000 7f7b6662f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:59.976 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.977+0000 7f7b6662f9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:20:59.976 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.977+0000 7f7b6662f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:59.978 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.977+0000 7f7b6662f9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T17:20:59.978 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.977+0000 7f7b6662f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:20:59.978 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.977+0000 7f7b6662f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:59.979 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.977+0000 7f7b6662f9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:20:59.979 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.977+0000 7f7b6662f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:20:59.980 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.977+0000 7f7b6662f9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T17:20:59.980 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.977+0000 7f7b6662f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:20:59.982 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.981+0000 7f7a1afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:20:59.988 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.985+0000 7f7b6662f9c0 20 remove_watcher() i=0 2024-09-12T17:20:59.988 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.985+0000 7f7b6662f9c0 2 removed watcher, disabling cache 2024-09-12T17:20:59.990 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.989+0000 7f7b6662f9c0 20 remove_watcher() i=1 2024-09-12T17:20:59.993 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.993+0000 7f7b6662f9c0 20 remove_watcher() i=2 2024-09-12T17:20:59.995 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.993+0000 7f7b6662f9c0 20 remove_watcher() i=3 2024-09-12T17:20:59.998 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.997+0000 7f7b6662f9c0 20 remove_watcher() i=4 2024-09-12T17:20:59.999 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:20:59.997+0000 7f7b6662f9c0 20 remove_watcher() i=5 2024-09-12T17:21:00.001 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.001+0000 7f7b6662f9c0 20 remove_watcher() i=6 2024-09-12T17:21:00.003 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.001+0000 7f7b6662f9c0 20 remove_watcher() i=7 2024-09-12T17:21:00.019 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:00.019 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:21:00.019 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: error-at-logrecord-writes id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:21:00.019 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:00.020 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at logrecord_writes 2024-09-12T17:21:00.053 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:21:00.053 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:21:00.099 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.097+0000 7fd47d3f79c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:00.101 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.101+0000 7fd47d3f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:00.101 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.101+0000 7fd47d3f79c0 20 realm 2024-09-12T17:21:00.101 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.101+0000 7fd47d3f79c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:00.101 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.101+0000 7fd47d3f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:00.101 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.101+0000 7fd47d3f79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:21:00.101 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.101+0000 7fd47d3f79c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:00.101 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.101+0000 7fd47d3f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:00.101 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.101+0000 7fd47d3f79c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:00.102 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.101+0000 7fd47d3f79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:00.102 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.101+0000 7fd47d3f79c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:00.104 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.105+0000 7fd47d3f79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:21:00.105 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.105+0000 7fd47d3f79c0 20 searching for the correct realm 2024-09-12T17:21:00.107 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.105+0000 7fd47b6fe640 0 -- 172.21.15.16:0/1740653390 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fd470008050 msgr2=0x7fd470044930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:00.115 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.113+0000 7fd47a6fc640 0 -- 172.21.15.16:0/1740653390 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fd4740b9930 msgr2=0x7fd474003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:00.331 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.329+0000 7fd47d3f79c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:21:00.332 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.329+0000 7fd47d3f79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:21:00.332 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.329+0000 7fd47d3f79c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:21:00.332 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.329+0000 7fd47d3f79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:21:00.332 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.329+0000 7fd47d3f79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:21:00.332 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.329+0000 7fd47d3f79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:21:00.332 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.329+0000 7fd47d3f79c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:00.333 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.329+0000 7fd47d3f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:00.333 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.329+0000 7fd47d3f79c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:00.333 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.333+0000 7fd47d3f79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:00.333 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.333+0000 7fd47d3f79c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:00.334 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.333+0000 7fd47d3f79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:21:00.334 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.333+0000 7fd47d3f79c0 20 zone default found 2024-09-12T17:21:00.334 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.333+0000 7fd47d3f79c0 4 Realm: () 2024-09-12T17:21:00.334 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.333+0000 7fd47d3f79c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:21:00.334 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.333+0000 7fd47d3f79c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:21:00.334 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.333+0000 7fd47d3f79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:21:00.334 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.333+0000 7fd47d3f79c0 20 zonegroup default 2024-09-12T17:21:00.335 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.333+0000 7fd47d3f79c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:00.335 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.333+0000 7fd47d3f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:00.335 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.333+0000 7fd47d3f79c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:00.335 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.333+0000 7fd47d3f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:00.336 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.333+0000 7fd47d3f79c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:00.336 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.337+0000 7fd47d3f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:00.337 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.337+0000 7fd47d3f79c0 20 started sync module instance, tier type = 2024-09-12T17:21:00.337 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.337+0000 7fd47d3f79c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:21:00.358 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.357+0000 7fd47d3f79c0 20 add_watcher() i=0 2024-09-12T17:21:00.359 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.357+0000 7fd47d3f79c0 20 add_watcher() i=1 2024-09-12T17:21:00.359 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.357+0000 7fd47d3f79c0 20 add_watcher() i=2 2024-09-12T17:21:00.359 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.357+0000 7fd47d3f79c0 20 add_watcher() i=3 2024-09-12T17:21:00.359 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.357+0000 7fd47d3f79c0 20 add_watcher() i=4 2024-09-12T17:21:00.359 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.357+0000 7fd47d3f79c0 20 add_watcher() i=5 2024-09-12T17:21:00.359 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.357+0000 7fd47d3f79c0 20 add_watcher() i=6 2024-09-12T17:21:00.360 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.361+0000 7fd47d3f79c0 20 add_watcher() i=7 2024-09-12T17:21:00.360 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.361+0000 7fd47d3f79c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:21:00.363 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.361+0000 7fd331fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:00.365 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.365+0000 7fd47d3f79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:21:00.365 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.365+0000 7fd47d3f79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:21:00.365 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.365+0000 7fd47d3f79c0 5 note: GC not initialized 2024-09-12T17:21:00.366 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.365+0000 7fd330fe1640 20 reqs_thread_entry: start 2024-09-12T17:21:00.366 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.365+0000 7fd47d3f79c0 20 init_complete bucket index max shards: 1 2024-09-12T17:21:00.366 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.365+0000 7fd47d3f79c0 20 Filter name: none 2024-09-12T17:21:00.366 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.365+0000 7fd329ffb640 20 reqs_thread_entry: start 2024-09-12T17:21:00.366 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.365+0000 7fd47d3f79c0 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T17:21:00.366 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.365+0000 7fd47d3f79c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:00.367 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.365+0000 7fd47d3f79c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:21:00.367 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.365+0000 7fd47d3f79c0 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T17:21:00.367 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.365+0000 7fd47d3f79c0 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T17:21:00.367 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.365+0000 7fd47d3f79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35 : miss 2024-09-12T17:21:00.367 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.365+0000 7fd47d3f79c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:00.368 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.365+0000 7fd47d3f79c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T17:21:00.368 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.365+0000 7fd47d3f79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35 info.flags=0x17 2024-09-12T17:21:00.368 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.365+0000 7fd47d3f79c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35 to cache LRU end 2024-09-12T17:21:00.368 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.365+0000 7fd47d3f79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:21:00.368 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.365+0000 7fd47d3f79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:00.368 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.365+0000 7fd47d3f79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35 2024-09-12T17:21:00.377 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.377+0000 7fd47d3f79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35 info.flags=0x17 2024-09-12T17:21:00.377 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.377+0000 7fd47d3f79c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35 to cache LRU end 2024-09-12T17:21:00.378 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.377+0000 7fd47d3f79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:00.378 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.377+0000 7fd47d3f79c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35, ofs0, ns] 2024-09-12T17:21:00.378 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.377+0000 7fd35dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431609 cookie 94874720784080 notifier 7220 bl.length()=923 2024-09-12T17:21:00.378 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.377+0000 7fd35dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35 info.flags=0x17 2024-09-12T17:21:00.378 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.377+0000 7fd35dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35 to cache LRU end 2024-09-12T17:21:00.378 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.377+0000 7fd35dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:00.379 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.377+0000 7fd47d3f79c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35]): orig_sources= new_sources= 2024-09-12T17:21:00.379 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.377+0000 7fd47d3f79c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35]): potential sources added=[] removed=[] 2024-09-12T17:21:00.379 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.377+0000 7fd47d3f79c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35]): orig_dests= new_dests= 2024-09-12T17:21:00.379 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.377+0000 7fd47d3f79c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35]): potential dests added=[] removed=[] 2024-09-12T17:21:00.382 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.381+0000 7fd47d3f79c0 -1 Injecting error=-5 at location=logrecord_writes 2024-09-12T17:21:00.383 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.381+0000 7fd47d3f79c0 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-09-12T17:21:00.388 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.385+0000 7fd47d3f79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35 : hit (requested=0x17, cached=0x17) 2024-09-12T17:21:00.388 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.385+0000 7fd47d3f79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35 2024-09-12T17:21:00.390 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.389+0000 7fd47d3f79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35 info.flags=0x17 2024-09-12T17:21:00.391 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.389+0000 7fd47d3f79c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35 to cache LRU end 2024-09-12T17:21:00.391 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.389+0000 7fd47d3f79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:00.391 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.389+0000 7fd47d3f79c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35, ofs0, ns] 2024-09-12T17:21:00.391 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.389+0000 7fd35dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431610 cookie 94874720784080 notifier 7220 bl.length()=891 2024-09-12T17:21:00.391 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.389+0000 7fd35dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35 info.flags=0x17 2024-09-12T17:21:00.391 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.389+0000 7fd35dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35 to cache LRU end 2024-09-12T17:21:00.391 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.389+0000 7fd35dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:00.392 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.393+0000 7fd47d3f79c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35]): orig_sources= new_sources= 2024-09-12T17:21:00.392 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.393+0000 7fd47d3f79c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35]): potential sources added=[] removed=[] 2024-09-12T17:21:00.392 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.393+0000 7fd47d3f79c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35]): orig_dests= new_dests= 2024-09-12T17:21:00.392 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.393+0000 7fd47d3f79c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35]): potential dests added=[] removed=[] 2024-09-12T17:21:00.396 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.397+0000 7fd331fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:00.401 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.401+0000 7fd47d3f79c0 20 remove_watcher() i=0 2024-09-12T17:21:00.401 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.401+0000 7fd47d3f79c0 2 removed watcher, disabling cache 2024-09-12T17:21:00.403 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.401+0000 7fd47d3f79c0 20 remove_watcher() i=1 2024-09-12T17:21:00.406 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.405+0000 7fd47d3f79c0 20 remove_watcher() i=2 2024-09-12T17:21:00.408 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.409+0000 7fd47d3f79c0 20 remove_watcher() i=3 2024-09-12T17:21:00.410 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.409+0000 7fd47d3f79c0 20 remove_watcher() i=4 2024-09-12T17:21:00.412 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.409+0000 7fd47d3f79c0 20 remove_watcher() i=5 2024-09-12T17:21:00.413 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.413+0000 7fd47d3f79c0 20 remove_watcher() i=6 2024-09-12T17:21:00.415 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.413+0000 7fd47d3f79c0 20 remove_watcher() i=7 2024-09-12T17:21:00.433 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T17:21:00.465 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:21:00.465 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:21:00.512 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.509+0000 7f5b9c4509c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:00.514 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.513+0000 7f5b9c4509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:00.514 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.513+0000 7f5b9c4509c0 20 realm 2024-09-12T17:21:00.514 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.513+0000 7f5b9c4509c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:00.514 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.513+0000 7f5b9c4509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:00.515 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.513+0000 7f5b9c4509c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:21:00.515 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.513+0000 7f5b9c4509c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:00.515 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.513+0000 7f5b9c4509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:00.515 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.513+0000 7f5b9c4509c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:00.516 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.513+0000 7f5b9c4509c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:00.516 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.513+0000 7f5b9c4509c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:00.518 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.517+0000 7f5b9c4509c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:21:00.518 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.517+0000 7f5b9c4509c0 20 searching for the correct realm 2024-09-12T17:21:00.520 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.517+0000 7f5b99755640 0 -- 172.21.15.16:0/186570514 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7f5b84002300 msgr2=0x7f5b8c05ba90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:00.732 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.733+0000 7f5b9a757640 0 -- 172.21.15.16:0/186570514 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f5b900d6070 msgr2=0x7f5b900fbdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:00.750 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.749+0000 7f5b9c4509c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:21:00.750 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.749+0000 7f5b9c4509c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:21:00.750 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.749+0000 7f5b9c4509c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:21:00.750 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.749+0000 7f5b9c4509c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:21:00.750 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.749+0000 7f5b9c4509c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:21:00.750 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.749+0000 7f5b9c4509c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:21:00.750 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.749+0000 7f5b9c4509c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:00.751 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.749+0000 7f5b9c4509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:00.751 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.749+0000 7f5b9c4509c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:00.751 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.749+0000 7f5b9c4509c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:00.751 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.749+0000 7f5b9c4509c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:00.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.753+0000 7f5b9c4509c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:21:00.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.753+0000 7f5b9c4509c0 20 zone default found 2024-09-12T17:21:00.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.753+0000 7f5b9c4509c0 4 Realm: () 2024-09-12T17:21:00.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.753+0000 7f5b9c4509c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:21:00.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.753+0000 7f5b9c4509c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:21:00.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.753+0000 7f5b9c4509c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:21:00.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.753+0000 7f5b9c4509c0 20 zonegroup default 2024-09-12T17:21:00.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.753+0000 7f5b9c4509c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:00.754 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.753+0000 7f5b9c4509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:00.754 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.753+0000 7f5b9c4509c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:00.754 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.753+0000 7f5b9c4509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:00.754 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.753+0000 7f5b9c4509c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:00.755 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.753+0000 7f5b9c4509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:00.755 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.753+0000 7f5b9c4509c0 20 started sync module instance, tier type = 2024-09-12T17:21:00.755 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.753+0000 7f5b9c4509c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:21:00.779 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.777+0000 7f5b9c4509c0 20 add_watcher() i=0 2024-09-12T17:21:00.779 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.777+0000 7f5b9c4509c0 20 add_watcher() i=1 2024-09-12T17:21:00.779 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.777+0000 7f5b9c4509c0 20 add_watcher() i=2 2024-09-12T17:21:00.779 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.777+0000 7f5b9c4509c0 20 add_watcher() i=3 2024-09-12T17:21:00.779 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.777+0000 7f5b9c4509c0 20 add_watcher() i=4 2024-09-12T17:21:00.779 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.777+0000 7f5b9c4509c0 20 add_watcher() i=5 2024-09-12T17:21:00.779 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.777+0000 7f5b9c4509c0 20 add_watcher() i=6 2024-09-12T17:21:00.781 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.781+0000 7f5b9c4509c0 20 add_watcher() i=7 2024-09-12T17:21:00.781 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.781+0000 7f5b9c4509c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:21:00.785 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.785+0000 7f5a4b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:00.786 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.785+0000 7f5b9c4509c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:21:00.786 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.785+0000 7f5b9c4509c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:21:00.786 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.785+0000 7f5b9c4509c0 5 note: GC not initialized 2024-09-12T17:21:00.787 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.785+0000 7f5a4a7fc640 20 reqs_thread_entry: start 2024-09-12T17:21:00.787 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.785+0000 7f5b9c4509c0 20 init_complete bucket index max shards: 1 2024-09-12T17:21:00.787 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.785+0000 7f5b9c4509c0 20 Filter name: none 2024-09-12T17:21:00.787 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.785+0000 7f59bbfff640 20 reqs_thread_entry: start 2024-09-12T17:21:00.787 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.785+0000 7f5b9c4509c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:00.788 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.789+0000 7f5b9c4509c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:21:00.788 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.789+0000 7f5b9c4509c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:00.790 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.789+0000 7f5b9c4509c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T17:21:00.790 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.789+0000 7f5b9c4509c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:21:00.790 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.789+0000 7f5b9c4509c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:00.791 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.789+0000 7f5b9c4509c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:21:00.791 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.789+0000 7f5b9c4509c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:00.792 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.789+0000 7f5b9c4509c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T17:21:00.792 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.793+0000 7f5b9c4509c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:21:00.794 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.793+0000 7f5a4b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:00.799 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.797+0000 7f5b9c4509c0 20 remove_watcher() i=0 2024-09-12T17:21:00.799 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.797+0000 7f5b9c4509c0 2 removed watcher, disabling cache 2024-09-12T17:21:00.802 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.801+0000 7f5b9c4509c0 20 remove_watcher() i=1 2024-09-12T17:21:00.805 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.805+0000 7f5b9c4509c0 20 remove_watcher() i=2 2024-09-12T17:21:00.807 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.805+0000 7f5b9c4509c0 20 remove_watcher() i=3 2024-09-12T17:21:00.810 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.809+0000 7f5b9c4509c0 20 remove_watcher() i=4 2024-09-12T17:21:00.811 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.809+0000 7f5b9c4509c0 20 remove_watcher() i=5 2024-09-12T17:21:00.812 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.813+0000 7f5b9c4509c0 20 remove_watcher() i=6 2024-09-12T17:21:00.814 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.813+0000 7f5b9c4509c0 20 remove_watcher() i=7 2024-09-12T17:21:00.830 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:00.830 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:21:00.830 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: error-at-logrecord-writes id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:21:00.830 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:00.885 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:21:00.917 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:21:00.917 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:21:00.966 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.965+0000 7fcb5a6089c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:00.968 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.969+0000 7fcb5a6089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:00.968 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.969+0000 7fcb5a6089c0 20 realm 2024-09-12T17:21:00.968 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.969+0000 7fcb5a6089c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:00.969 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.969+0000 7fcb5a6089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:00.969 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.969+0000 7fcb5a6089c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:21:00.969 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.969+0000 7fcb5a6089c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:00.969 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.969+0000 7fcb5a6089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:00.969 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.969+0000 7fcb5a6089c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:00.970 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.969+0000 7fcb5a6089c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:00.970 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.969+0000 7fcb5a6089c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:00.972 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.969+0000 7fcb5a6089c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:21:00.972 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.969+0000 7fcb5a6089c0 20 searching for the correct realm 2024-09-12T17:21:00.975 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.973+0000 7fcb5890f640 0 -- 172.21.15.16:0/432987722 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fcb4c023040 msgr2=0x7fcb4c040940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:21:00.984 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:00.981+0000 7fcb5790d640 0 -- 172.21.15.16:0/432987722 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fcb5012c540 msgr2=0x7fcb500f6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:21:01.200 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.197+0000 7fcb5a6089c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:21:01.200 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.197+0000 7fcb5a6089c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:21:01.200 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.197+0000 7fcb5a6089c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:21:01.200 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.197+0000 7fcb5a6089c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:21:01.200 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.197+0000 7fcb5a6089c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:21:01.200 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.197+0000 7fcb5a6089c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:21:01.200 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.197+0000 7fcb5a6089c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:01.201 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.201+0000 7fcb5a6089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:01.201 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.201+0000 7fcb5a6089c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:01.201 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.201+0000 7fcb5a6089c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:01.201 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.201+0000 7fcb5a6089c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:01.202 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.201+0000 7fcb5a6089c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:21:01.202 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.201+0000 7fcb5a6089c0 20 zone default found 2024-09-12T17:21:01.203 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.201+0000 7fcb5a6089c0 4 Realm: () 2024-09-12T17:21:01.203 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.201+0000 7fcb5a6089c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:21:01.203 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.201+0000 7fcb5a6089c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:21:01.203 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.201+0000 7fcb5a6089c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:21:01.203 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.201+0000 7fcb5a6089c0 20 zonegroup default 2024-09-12T17:21:01.203 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.201+0000 7fcb5a6089c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:01.203 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.201+0000 7fcb5a6089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:01.203 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.201+0000 7fcb5a6089c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:01.204 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.205+0000 7fcb5a6089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:01.204 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.205+0000 7fcb5a6089c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:01.205 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.205+0000 7fcb5a6089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:01.205 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.205+0000 7fcb5a6089c0 20 started sync module instance, tier type = 2024-09-12T17:21:01.205 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.205+0000 7fcb5a6089c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:21:01.229 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.229+0000 7fcb5a6089c0 20 add_watcher() i=0 2024-09-12T17:21:01.229 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.229+0000 7fcb5a6089c0 20 add_watcher() i=1 2024-09-12T17:21:01.230 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.229+0000 7fcb5a6089c0 20 add_watcher() i=2 2024-09-12T17:21:01.230 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.229+0000 7fcb5a6089c0 20 add_watcher() i=3 2024-09-12T17:21:01.230 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.229+0000 7fcb5a6089c0 20 add_watcher() i=4 2024-09-12T17:21:01.230 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.229+0000 7fcb5a6089c0 20 add_watcher() i=5 2024-09-12T17:21:01.230 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.229+0000 7fcb5a6089c0 20 add_watcher() i=6 2024-09-12T17:21:01.232 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.233+0000 7fcb5a6089c0 20 add_watcher() i=7 2024-09-12T17:21:01.232 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.233+0000 7fcb5a6089c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:21:01.236 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.237+0000 7fca0efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:01.237 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.237+0000 7fcb5a6089c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:21:01.237 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.237+0000 7fcb5a6089c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:21:01.237 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.237+0000 7fcb5a6089c0 5 note: GC not initialized 2024-09-12T17:21:01.238 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.237+0000 7fca0dfdb640 20 reqs_thread_entry: start 2024-09-12T17:21:01.238 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.237+0000 7fcb5a6089c0 20 init_complete bucket index max shards: 1 2024-09-12T17:21:01.239 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.237+0000 7fcb5a6089c0 20 Filter name: none 2024-09-12T17:21:01.239 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.237+0000 7fc97f7fe640 20 reqs_thread_entry: start 2024-09-12T17:21:01.239 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.237+0000 7fcb5a6089c0 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T17:21:01.239 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.237+0000 7fcb5a6089c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:01.240 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.237+0000 7fcb5a6089c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:21:01.240 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.237+0000 7fcb5a6089c0 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T17:21:01.240 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.237+0000 7fcb5a6089c0 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T17:21:01.240 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.237+0000 7fcb5a6089c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35 : miss 2024-09-12T17:21:01.240 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.237+0000 7fcb5a6089c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:01.241 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.241+0000 7fcb5a6089c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T17:21:01.241 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.241+0000 7fcb5a6089c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35 info.flags=0x17 2024-09-12T17:21:01.241 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.241+0000 7fcb5a6089c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35 to cache LRU end 2024-09-12T17:21:01.241 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.241+0000 7fcb5a6089c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:21:01.241 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.241+0000 7fcb5a6089c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:01.242 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.241+0000 7fcb5a6089c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35 2024-09-12T17:21:01.250 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.249+0000 7fcb5a6089c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35 info.flags=0x17 2024-09-12T17:21:01.250 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.249+0000 7fcb5a6089c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35 to cache LRU end 2024-09-12T17:21:01.250 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.249+0000 7fcb5a6089c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:01.250 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.249+0000 7fcb5a6089c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35, ofs0, ns] 2024-09-12T17:21:01.251 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.249+0000 7fca2f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431611 cookie 94555188834672 notifier 7250 bl.length()=923 2024-09-12T17:21:01.251 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.249+0000 7fca2f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35 info.flags=0x17 2024-09-12T17:21:01.251 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.249+0000 7fca2f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35 to cache LRU end 2024-09-12T17:21:01.251 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.249+0000 7fca2f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:01.252 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.253+0000 7fcb5a6089c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35]): orig_sources= new_sources= 2024-09-12T17:21:01.252 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.253+0000 7fcb5a6089c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35]): potential sources added=[] removed=[] 2024-09-12T17:21:01.252 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.253+0000 7fcb5a6089c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35]): orig_dests= new_dests= 2024-09-12T17:21:01.252 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.253+0000 7fcb5a6089c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35]): potential dests added=[] removed=[] 2024-09-12T17:21:01.256 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.253+0000 7fcb5a6089c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35.1.0 2024-09-12T17:21:01.256 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.253+0000 7fcb5a6089c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35.1.0 2024-09-12T17:21:01.256 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.253+0000 7fcb5a6089c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35.1.1 2024-09-12T17:21:01.256 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.253+0000 7fcb5a6089c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35.1.1 2024-09-12T17:21:01.256 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.253+0000 7fcb5a6089c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35.0 2024-09-12T17:21:01.261 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.261+0000 7fcb5a6089c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35 : hit (requested=0x17, cached=0x17) 2024-09-12T17:21:01.261 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.261+0000 7fcb5a6089c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35 2024-09-12T17:21:01.264 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.261+0000 7fcb5a6089c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35 info.flags=0x17 2024-09-12T17:21:01.264 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.261+0000 7fcb5a6089c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35 to cache LRU end 2024-09-12T17:21:01.264 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.261+0000 7fcb5a6089c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:01.264 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.261+0000 7fcb5a6089c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35, ofs0, ns] 2024-09-12T17:21:01.264 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.265+0000 7fca2f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431612 cookie 94555188834672 notifier 7250 bl.length()=923 2024-09-12T17:21:01.265 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.265+0000 7fca2f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35 info.flags=0x17 2024-09-12T17:21:01.265 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.265+0000 7fca2f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35 to cache LRU end 2024-09-12T17:21:01.265 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.265+0000 7fca2f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:01.266 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.265+0000 7fcb5a6089c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35]): orig_sources= new_sources= 2024-09-12T17:21:01.266 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.265+0000 7fcb5a6089c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35]): potential sources added=[] removed=[] 2024-09-12T17:21:01.266 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.265+0000 7fcb5a6089c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35]): orig_dests= new_dests= 2024-09-12T17:21:01.266 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.265+0000 7fcb5a6089c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35]): potential dests added=[] removed=[] 2024-09-12T17:21:01.267 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.265+0000 7fcb5a6089c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35.0 2024-09-12T17:21:01.268 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.265+0000 7fcb5a6089c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35 : hit (requested=0x17, cached=0x17) 2024-09-12T17:21:01.268 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.269+0000 7fcb5a6089c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35 2024-09-12T17:21:01.271 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.269+0000 7fcb5a6089c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35 info.flags=0x17 2024-09-12T17:21:01.271 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.269+0000 7fcb5a6089c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35 to cache LRU end 2024-09-12T17:21:01.271 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.269+0000 7fcb5a6089c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:01.271 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.269+0000 7fcb5a6089c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35, ofs0, ns] 2024-09-12T17:21:01.272 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.269+0000 7fca2effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431613 cookie 94555188834672 notifier 7250 bl.length()=891 2024-09-12T17:21:01.272 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.269+0000 7fca2effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35 info.flags=0x17 2024-09-12T17:21:01.272 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.269+0000 7fca2effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35 to cache LRU end 2024-09-12T17:21:01.272 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.269+0000 7fca2effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:01.273 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.273+0000 7fcb5a6089c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35]): orig_sources= new_sources= 2024-09-12T17:21:01.273 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.273+0000 7fcb5a6089c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35]): potential sources added=[] removed=[] 2024-09-12T17:21:01.273 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.273+0000 7fcb5a6089c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35]): orig_dests= new_dests= 2024-09-12T17:21:01.273 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.273+0000 7fcb5a6089c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35]): potential dests added=[] removed=[] 2024-09-12T17:21:01.276 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.273+0000 7fcb5a6089c0 1 execute INFO: reshard of bucket "error-at-logrecord-writes" from 1 shards to 2 shards completed successfully 2024-09-12T17:21:01.278 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.277+0000 7fca0efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:01.284 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.281+0000 7fcb5a6089c0 20 remove_watcher() i=0 2024-09-12T17:21:01.284 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.281+0000 7fcb5a6089c0 2 removed watcher, disabling cache 2024-09-12T17:21:01.286 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.285+0000 7fcb5a6089c0 20 remove_watcher() i=1 2024-09-12T17:21:01.288 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.289+0000 7fcb5a6089c0 20 remove_watcher() i=2 2024-09-12T17:21:01.291 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.289+0000 7fcb5a6089c0 20 remove_watcher() i=3 2024-09-12T17:21:01.293 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.293+0000 7fcb5a6089c0 20 remove_watcher() i=4 2024-09-12T17:21:01.295 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.293+0000 7fcb5a6089c0 20 remove_watcher() i=5 2024-09-12T17:21:01.297 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.297+0000 7fcb5a6089c0 20 remove_watcher() i=6 2024-09-12T17:21:01.298 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.297+0000 7fcb5a6089c0 20 remove_watcher() i=7 2024-09-12T17:21:01.323 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T17:21:01.354 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:21:01.354 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:21:01.403 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.401+0000 7f5bdf9c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:01.405 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.405+0000 7f5bdf9c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:01.405 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.405+0000 7f5bdf9c79c0 20 realm 2024-09-12T17:21:01.405 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.405+0000 7f5bdf9c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:01.405 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.405+0000 7f5bdf9c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:01.405 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.405+0000 7f5bdf9c79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:21:01.405 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.405+0000 7f5bdf9c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:01.405 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.405+0000 7f5bdf9c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:01.405 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.405+0000 7f5bdf9c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:01.407 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.405+0000 7f5bdf9c79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:01.407 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.405+0000 7f5bdf9c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:01.408 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.409+0000 7f5bdf9c79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:21:01.409 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.409+0000 7f5bdf9c79c0 20 searching for the correct realm 2024-09-12T17:21:01.411 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.409+0000 7f5bddcce640 0 -- 172.21.15.16:0/2316317343 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f5bd4018bb0 msgr2=0x7f5bd4021450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:01.626 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.625+0000 7f5bdcccc640 0 -- 172.21.15.16:0/2316317343 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f5bd8004040 msgr2=0x7f5bd80f6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:01.844 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.841+0000 7f5bdf9c79c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:21:01.844 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.841+0000 7f5bdf9c79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:21:01.844 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.841+0000 7f5bdf9c79c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:21:01.844 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.841+0000 7f5bdf9c79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:21:01.844 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.841+0000 7f5bdf9c79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:21:01.844 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.841+0000 7f5bdf9c79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:21:01.844 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.841+0000 7f5bdf9c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:01.845 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.845+0000 7f5bdf9c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:01.845 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.845+0000 7f5bdf9c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:01.845 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.845+0000 7f5bdf9c79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:01.845 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.845+0000 7f5bdf9c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:01.846 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.845+0000 7f5bdf9c79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:21:01.846 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.845+0000 7f5bdf9c79c0 20 zone default found 2024-09-12T17:21:01.847 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.845+0000 7f5bdf9c79c0 4 Realm: () 2024-09-12T17:21:01.847 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.845+0000 7f5bdf9c79c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:21:01.847 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.845+0000 7f5bdf9c79c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:21:01.847 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.845+0000 7f5bdf9c79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:21:01.847 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.845+0000 7f5bdf9c79c0 20 zonegroup default 2024-09-12T17:21:01.847 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.845+0000 7f5bdf9c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:01.847 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.845+0000 7f5bdf9c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:01.847 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.845+0000 7f5bdf9c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:01.848 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.845+0000 7f5bdf9c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:01.848 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.845+0000 7f5bdf9c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:01.848 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.849+0000 7f5bdf9c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:01.849 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.849+0000 7f5bdf9c79c0 20 started sync module instance, tier type = 2024-09-12T17:21:01.849 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.849+0000 7f5bdf9c79c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:21:01.872 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.869+0000 7f5bdf9c79c0 20 add_watcher() i=0 2024-09-12T17:21:01.872 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.869+0000 7f5bdf9c79c0 20 add_watcher() i=1 2024-09-12T17:21:01.872 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.869+0000 7f5bdf9c79c0 20 add_watcher() i=2 2024-09-12T17:21:01.872 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.869+0000 7f5bdf9c79c0 20 add_watcher() i=3 2024-09-12T17:21:01.872 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.869+0000 7f5bdf9c79c0 20 add_watcher() i=4 2024-09-12T17:21:01.872 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.869+0000 7f5bdf9c79c0 20 add_watcher() i=5 2024-09-12T17:21:01.873 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.869+0000 7f5bdf9c79c0 20 add_watcher() i=6 2024-09-12T17:21:01.874 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.873+0000 7f5bdf9c79c0 20 add_watcher() i=7 2024-09-12T17:21:01.874 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.873+0000 7f5bdf9c79c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:21:01.878 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.877+0000 7f5a937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:01.879 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.877+0000 7f5bdf9c79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:21:01.879 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.877+0000 7f5bdf9c79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:21:01.879 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.877+0000 7f5bdf9c79c0 5 note: GC not initialized 2024-09-12T17:21:01.880 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.877+0000 7f5a927e4640 20 reqs_thread_entry: start 2024-09-12T17:21:01.880 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.877+0000 7f5bdf9c79c0 20 init_complete bucket index max shards: 1 2024-09-12T17:21:01.881 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.881+0000 7f5bdf9c79c0 20 Filter name: none 2024-09-12T17:21:01.881 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.881+0000 7f5a03fff640 20 reqs_thread_entry: start 2024-09-12T17:21:01.881 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.881+0000 7f5bdf9c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:01.881 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.881+0000 7f5bdf9c79c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:21:01.882 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.881+0000 7f5bdf9c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:01.883 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.881+0000 7f5bdf9c79c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T17:21:01.883 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.881+0000 7f5bdf9c79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:21:01.884 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.881+0000 7f5bdf9c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:01.884 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.885+0000 7f5bdf9c79c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:21:01.884 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.885+0000 7f5bdf9c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:01.886 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.885+0000 7f5bdf9c79c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T17:21:01.886 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.885+0000 7f5bdf9c79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:21:01.889 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.889+0000 7f5a937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:01.894 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.893+0000 7f5bdf9c79c0 20 remove_watcher() i=0 2024-09-12T17:21:01.894 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.893+0000 7f5bdf9c79c0 2 removed watcher, disabling cache 2024-09-12T17:21:01.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.897+0000 7f5bdf9c79c0 20 remove_watcher() i=1 2024-09-12T17:21:01.899 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.897+0000 7f5bdf9c79c0 20 remove_watcher() i=2 2024-09-12T17:21:01.901 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.901+0000 7f5bdf9c79c0 20 remove_watcher() i=3 2024-09-12T17:21:01.904 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.901+0000 7f5bdf9c79c0 20 remove_watcher() i=4 2024-09-12T17:21:01.905 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.905+0000 7f5bdf9c79c0 20 remove_watcher() i=5 2024-09-12T17:21:01.907 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.905+0000 7f5bdf9c79c0 20 remove_watcher() i=6 2024-09-12T17:21:01.909 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:01.909+0000 7f5bdf9c79c0 20 remove_watcher() i=7 2024-09-12T17:21:01.930 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:01.930 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:21:01.931 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: error-at-logrecord-writes id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:21:01.931 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:02.022 INFO:tasks.workunit.client.0.smithi016.stderr:TEST: reshard bucket with abort at logrecord_writes 2024-09-12T17:21:02.023 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:02.479 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T17:21:02.512 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:21:02.513 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:21:02.560 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:02.561+0000 7ff16c1799c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:02.563 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:02.561+0000 7ff16c1799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:02.563 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:02.561+0000 7ff16c1799c0 20 realm 2024-09-12T17:21:02.563 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:02.561+0000 7ff16c1799c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:02.563 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:02.561+0000 7ff16c1799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:02.563 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:02.561+0000 7ff16c1799c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:21:02.563 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:02.561+0000 7ff16c1799c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:02.563 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:02.561+0000 7ff16c1799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:02.563 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:02.561+0000 7ff16c1799c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:02.564 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:02.565+0000 7ff16c1799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:02.565 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:02.565+0000 7ff16c1799c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:02.566 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:02.565+0000 7ff16c1799c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:21:02.567 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:02.565+0000 7ff16c1799c0 20 searching for the correct realm 2024-09-12T17:21:02.569 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:02.569+0000 7ff16a480640 0 -- 172.21.15.16:0/4104271482 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7ff160043b80 msgr2=0x7ff160070aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:02.786 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:02.785+0000 7ff16947e640 0 -- 172.21.15.16:0/4104271482 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7ff164104960 msgr2=0x7ff1640dd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:21:03.004 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.001+0000 7ff16c1799c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:21:03.004 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.001+0000 7ff16c1799c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:21:03.005 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.001+0000 7ff16c1799c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:21:03.005 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.001+0000 7ff16c1799c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:21:03.005 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.001+0000 7ff16c1799c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:21:03.005 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.001+0000 7ff16c1799c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:21:03.005 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.001+0000 7ff16c1799c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.005 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.005+0000 7ff16c1799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:03.006 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.005+0000 7ff16c1799c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.006 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.005+0000 7ff16c1799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:03.006 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.005+0000 7ff16c1799c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.006 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.005+0000 7ff16c1799c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:21:03.007 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.005+0000 7ff16c1799c0 20 zone default found 2024-09-12T17:21:03.007 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.005+0000 7ff16c1799c0 4 Realm: () 2024-09-12T17:21:03.007 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.005+0000 7ff16c1799c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:21:03.007 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.005+0000 7ff16c1799c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:21:03.007 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.005+0000 7ff16c1799c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:21:03.007 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.005+0000 7ff16c1799c0 20 zonegroup default 2024-09-12T17:21:03.007 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.005+0000 7ff16c1799c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.008 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.005+0000 7ff16c1799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:03.008 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.005+0000 7ff16c1799c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.008 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.009+0000 7ff16c1799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:03.008 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.009+0000 7ff16c1799c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.009 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.009+0000 7ff16c1799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:03.009 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.009+0000 7ff16c1799c0 20 started sync module instance, tier type = 2024-09-12T17:21:03.009 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.009+0000 7ff16c1799c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:21:03.033 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.033+0000 7ff16c1799c0 20 add_watcher() i=0 2024-09-12T17:21:03.034 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.033+0000 7ff16c1799c0 20 add_watcher() i=1 2024-09-12T17:21:03.034 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.033+0000 7ff16c1799c0 20 add_watcher() i=2 2024-09-12T17:21:03.034 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.033+0000 7ff16c1799c0 20 add_watcher() i=3 2024-09-12T17:21:03.034 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.033+0000 7ff16c1799c0 20 add_watcher() i=4 2024-09-12T17:21:03.034 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.033+0000 7ff16c1799c0 20 add_watcher() i=5 2024-09-12T17:21:03.034 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.033+0000 7ff16c1799c0 20 add_watcher() i=6 2024-09-12T17:21:03.036 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.033+0000 7ff16c1799c0 20 add_watcher() i=7 2024-09-12T17:21:03.036 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.033+0000 7ff16c1799c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:21:03.041 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.041+0000 7ff01b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:03.041 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.041+0000 7ff16c1799c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:21:03.042 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.041+0000 7ff16c1799c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:21:03.042 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.041+0000 7ff16c1799c0 5 note: GC not initialized 2024-09-12T17:21:03.042 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.041+0000 7ff01a7fc640 20 reqs_thread_entry: start 2024-09-12T17:21:03.042 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.041+0000 7ff16c1799c0 20 init_complete bucket index max shards: 1 2024-09-12T17:21:03.043 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.041+0000 7ff16c1799c0 20 Filter name: none 2024-09-12T17:21:03.043 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.041+0000 7fef8bfff640 20 reqs_thread_entry: start 2024-09-12T17:21:03.043 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.041+0000 7ff16c1799c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.044 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.045+0000 7ff16c1799c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:21:03.044 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.045+0000 7ff16c1799c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.046 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.045+0000 7ff16c1799c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T17:21:03.046 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.045+0000 7ff16c1799c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:21:03.046 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.045+0000 7ff16c1799c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.047 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.045+0000 7ff16c1799c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:21:03.048 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.045+0000 7ff16c1799c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.048 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.049+0000 7ff16c1799c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T17:21:03.048 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.049+0000 7ff16c1799c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:21:03.051 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.049+0000 7ff01b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:03.057 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.057+0000 7ff16c1799c0 20 remove_watcher() i=0 2024-09-12T17:21:03.057 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.057+0000 7ff16c1799c0 2 removed watcher, disabling cache 2024-09-12T17:21:03.059 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.057+0000 7ff16c1799c0 20 remove_watcher() i=1 2024-09-12T17:21:03.062 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.061+0000 7ff16c1799c0 20 remove_watcher() i=2 2024-09-12T17:21:03.064 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.061+0000 7ff16c1799c0 20 remove_watcher() i=3 2024-09-12T17:21:03.066 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.065+0000 7ff16c1799c0 20 remove_watcher() i=4 2024-09-12T17:21:03.068 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.065+0000 7ff16c1799c0 20 remove_watcher() i=5 2024-09-12T17:21:03.069 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.069+0000 7ff16c1799c0 20 remove_watcher() i=6 2024-09-12T17:21:03.071 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.069+0000 7ff16c1799c0 20 remove_watcher() i=7 2024-09-12T17:21:03.096 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:03.096 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:21:03.096 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: abort-at-logrecord-writes id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:21:03.096 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:03.097 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T17:21:03.134 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:21:03.134 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:21:03.184 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.181+0000 7f0ff6b739c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.186 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.185+0000 7f0ff6b739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:03.186 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.185+0000 7f0ff6b739c0 20 realm 2024-09-12T17:21:03.186 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.185+0000 7f0ff6b739c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.186 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.185+0000 7f0ff6b739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:03.186 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.185+0000 7f0ff6b739c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:21:03.187 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.185+0000 7f0ff6b739c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.187 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.185+0000 7f0ff6b739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:03.187 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.185+0000 7f0ff6b739c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.188 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.189+0000 7f0ff6b739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:03.188 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.189+0000 7f0ff6b739c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.190 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.189+0000 7f0ff6b739c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:21:03.190 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.189+0000 7f0ff6b739c0 20 searching for the correct realm 2024-09-12T17:21:03.193 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.193+0000 7f0ff4e7a640 0 -- 172.21.15.16:0/1658252512 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f0fdc015070 msgr2=0x7f0fdc04f960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:03.200 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.201+0000 7f0ff3e78640 0 -- 172.21.15.16:0/1658252512 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f0fec068bd0 msgr2=0x7f0fec07ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:03.420 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.417+0000 7f0ff6b739c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:21:03.420 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.417+0000 7f0ff6b739c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:21:03.420 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.417+0000 7f0ff6b739c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:21:03.420 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.417+0000 7f0ff6b739c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:21:03.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.417+0000 7f0ff6b739c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:21:03.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.417+0000 7f0ff6b739c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:21:03.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.417+0000 7f0ff6b739c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.421+0000 7f0ff6b739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:03.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.421+0000 7f0ff6b739c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.421+0000 7f0ff6b739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:03.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.421+0000 7f0ff6b739c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.422 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.421+0000 7f0ff6b739c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:21:03.422 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.421+0000 7f0ff6b739c0 20 zone default found 2024-09-12T17:21:03.422 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.421+0000 7f0ff6b739c0 4 Realm: () 2024-09-12T17:21:03.422 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.421+0000 7f0ff6b739c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:21:03.422 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.421+0000 7f0ff6b739c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:21:03.423 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.421+0000 7f0ff6b739c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:21:03.423 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.421+0000 7f0ff6b739c0 20 zonegroup default 2024-09-12T17:21:03.423 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.421+0000 7f0ff6b739c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.423 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.421+0000 7f0ff6b739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:03.423 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.421+0000 7f0ff6b739c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.423 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.421+0000 7f0ff6b739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:03.424 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.421+0000 7f0ff6b739c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.424 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.425+0000 7f0ff6b739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:03.425 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.425+0000 7f0ff6b739c0 20 started sync module instance, tier type = 2024-09-12T17:21:03.425 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.425+0000 7f0ff6b739c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:21:03.447 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.445+0000 7f0ff6b739c0 20 add_watcher() i=0 2024-09-12T17:21:03.448 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.445+0000 7f0ff6b739c0 20 add_watcher() i=1 2024-09-12T17:21:03.448 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.445+0000 7f0ff6b739c0 20 add_watcher() i=2 2024-09-12T17:21:03.448 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.445+0000 7f0ff6b739c0 20 add_watcher() i=3 2024-09-12T17:21:03.448 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.445+0000 7f0ff6b739c0 20 add_watcher() i=4 2024-09-12T17:21:03.449 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.445+0000 7f0ff6b739c0 20 add_watcher() i=5 2024-09-12T17:21:03.449 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.445+0000 7f0ff6b739c0 20 add_watcher() i=6 2024-09-12T17:21:03.450 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.449+0000 7f0ff6b739c0 20 add_watcher() i=7 2024-09-12T17:21:03.450 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.449+0000 7f0ff6b739c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:21:03.454 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.453+0000 7f0eaafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:03.455 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.453+0000 7f0ff6b739c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:21:03.455 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.453+0000 7f0ff6b739c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:21:03.455 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 note: GC not initialized 2024-09-12T17:21:03.456 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.453+0000 7f0ea9fdb640 20 reqs_thread_entry: start 2024-09-12T17:21:03.456 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.453+0000 7f0ff6b739c0 20 init_complete bucket index max shards: 1 2024-09-12T17:21:03.456 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.453+0000 7f0ff6b739c0 20 Filter name: none 2024-09-12T17:21:03.456 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.457+0000 7f0e1b7fe640 20 reqs_thread_entry: start 2024-09-12T17:21:03.456 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.457+0000 7f0ff6b739c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T17:21:03.457 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.457+0000 7f0ff6b739c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.457 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.457+0000 7f0ff6b739c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:21:03.457 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.457+0000 7f0ff6b739c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T17:21:03.457 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.457+0000 7f0ff6b739c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T17:21:03.458 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.457+0000 7f0ff6b739c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 : miss 2024-09-12T17:21:03.458 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.457+0000 7f0ff6b739c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.459 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.457+0000 7f0ff6b739c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T17:21:03.459 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.457+0000 7f0ff6b739c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 info.flags=0x17 2024-09-12T17:21:03.459 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.457+0000 7f0ff6b739c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 to cache LRU end 2024-09-12T17:21:03.459 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.457+0000 7f0ff6b739c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:21:03.459 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.457+0000 7f0ff6b739c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:03.459 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.457+0000 7f0ff6b739c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 2024-09-12T17:21:03.469 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.469+0000 7f0ff6b739c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 info.flags=0x17 2024-09-12T17:21:03.469 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.469+0000 7f0ff6b739c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 to cache LRU end 2024-09-12T17:21:03.469 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.469+0000 7f0ff6b739c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:03.469 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.469+0000 7f0ff6b739c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36, ofs0, ns] 2024-09-12T17:21:03.469 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.469+0000 7f0ecb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431661 cookie 94150953709680 notifier 7304 bl.length()=923 2024-09-12T17:21:03.470 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.469+0000 7f0ecb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 info.flags=0x17 2024-09-12T17:21:03.470 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.469+0000 7f0ecb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 to cache LRU end 2024-09-12T17:21:03.470 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.469+0000 7f0ecb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:03.471 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.469+0000 7f0ff6b739c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36]): orig_sources= new_sources= 2024-09-12T17:21:03.471 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.469+0000 7f0ff6b739c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36]): potential sources added=[] removed=[] 2024-09-12T17:21:03.471 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.469+0000 7f0ff6b739c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36]): orig_dests= new_dests= 2024-09-12T17:21:03.471 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.469+0000 7f0ff6b739c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36]): potential dests added=[] removed=[] 2024-09-12T17:21:03.473 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0ff6b739c0 time 2024-09-12T17:21:03.476173+0000 2024-09-12T17:21:03.473 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:21:03.477 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:21:03.477 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f0ffa44d2eb] 2024-09-12T17:21:03.477 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0ffa44d49f] 2024-09-12T17:21:03.477 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a138d380c1] 2024-09-12T17:21:03.478 INFO:tasks.workunit.client.0.smithi016.stderr: 4: radosgw-admin(+0x14100ec) [0x55a13978e0ec] 2024-09-12T17:21:03.478 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a138d4a18d] 2024-09-12T17:21:03.478 INFO:tasks.workunit.client.0.smithi016.stderr: 6: main() 2024-09-12T17:21:03.478 INFO:tasks.workunit.client.0.smithi016.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0ff92b3d90] 2024-09-12T17:21:03.478 INFO:tasks.workunit.client.0.smithi016.stderr: 8: __libc_start_main() 2024-09-12T17:21:03.478 INFO:tasks.workunit.client.0.smithi016.stderr: 9: _start() 2024-09-12T17:21:03.478 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.477+0000 7f0ff6b739c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0ff6b739c0 time 2024-09-12T17:21:03.476173+0000 2024-09-12T17:21:03.478 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:21:03.478 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:03.478 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:21:03.478 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f0ffa44d2eb] 2024-09-12T17:21:03.478 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0ffa44d49f] 2024-09-12T17:21:03.478 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a138d380c1] 2024-09-12T17:21:03.478 INFO:tasks.workunit.client.0.smithi016.stderr: 4: radosgw-admin(+0x14100ec) [0x55a13978e0ec] 2024-09-12T17:21:03.479 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a138d4a18d] 2024-09-12T17:21:03.479 INFO:tasks.workunit.client.0.smithi016.stderr: 6: main() 2024-09-12T17:21:03.479 INFO:tasks.workunit.client.0.smithi016.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0ff92b3d90] 2024-09-12T17:21:03.479 INFO:tasks.workunit.client.0.smithi016.stderr: 8: __libc_start_main() 2024-09-12T17:21:03.479 INFO:tasks.workunit.client.0.smithi016.stderr: 9: _start() 2024-09-12T17:21:03.479 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:03.479 INFO:tasks.workunit.client.0.smithi016.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:21:03.479 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7f0ff6b739c0 thread_name:radosgw-admin 2024-09-12T17:21:03.481 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:21:03.481 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f0ff92cc520] 2024-09-12T17:21:03.481 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:21:03.481 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:21:03.481 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:21:03.481 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f0ffa44d345] 2024-09-12T17:21:03.481 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0ffa44d49f] 2024-09-12T17:21:03.481 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a138d380c1] 2024-09-12T17:21:03.481 INFO:tasks.workunit.client.0.smithi016.stderr: 8: radosgw-admin(+0x14100ec) [0x55a13978e0ec] 2024-09-12T17:21:03.481 INFO:tasks.workunit.client.0.smithi016.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a138d4a18d] 2024-09-12T17:21:03.481 INFO:tasks.workunit.client.0.smithi016.stderr: 10: main() 2024-09-12T17:21:03.481 INFO:tasks.workunit.client.0.smithi016.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0ff92b3d90] 2024-09-12T17:21:03.482 INFO:tasks.workunit.client.0.smithi016.stderr: 12: __libc_start_main() 2024-09-12T17:21:03.482 INFO:tasks.workunit.client.0.smithi016.stderr: 13: _start() 2024-09-12T17:21:03.482 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.481+0000 7f0ff6b739c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:21:03.482 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7f0ff6b739c0 thread_name:radosgw-admin 2024-09-12T17:21:03.482 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:03.482 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:21:03.482 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f0ff92cc520] 2024-09-12T17:21:03.482 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:21:03.482 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:21:03.482 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:21:03.482 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f0ffa44d345] 2024-09-12T17:21:03.482 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0ffa44d49f] 2024-09-12T17:21:03.482 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a138d380c1] 2024-09-12T17:21:03.482 INFO:tasks.workunit.client.0.smithi016.stderr: 8: radosgw-admin(+0x14100ec) [0x55a13978e0ec] 2024-09-12T17:21:03.483 INFO:tasks.workunit.client.0.smithi016.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a138d4a18d] 2024-09-12T17:21:03.483 INFO:tasks.workunit.client.0.smithi016.stderr: 10: main() 2024-09-12T17:21:03.483 INFO:tasks.workunit.client.0.smithi016.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0ff92b3d90] 2024-09-12T17:21:03.483 INFO:tasks.workunit.client.0.smithi016.stderr: 12: __libc_start_main() 2024-09-12T17:21:03.483 INFO:tasks.workunit.client.0.smithi016.stderr: 13: _start() 2024-09-12T17:21:03.483 INFO:tasks.workunit.client.0.smithi016.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:21:03.483 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:03.483 INFO:tasks.workunit.client.0.smithi016.stderr:--- begin dump of recent events --- 2024-09-12T17:21:03.517 INFO:tasks.workunit.client.0.smithi016.stderr: -499> 2024-09-12T17:21:03.157+0000 7f0ee260c640 10 monclient: dump: 2024-09-12T17:21:03.517 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:21:03.517 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:21:03.517 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:03.518 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:03.518 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:21:03.518 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:03.518 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:21:03.518 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:21:03.518 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:21:03.518 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:03.518 INFO:tasks.workunit.client.0.smithi016.stderr: -498> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 5 monclient: authenticate success, global_id 7659 2024-09-12T17:21:03.518 INFO:tasks.workunit.client.0.smithi016.stderr: -497> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 10 monclient: get_monmap_and_config success 2024-09-12T17:21:03.518 INFO:tasks.workunit.client.0.smithi016.stderr: -496> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 4 set_mon_vals no callback set 2024-09-12T17:21:03.518 INFO:tasks.workunit.client.0.smithi016.stderr: -495> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 10 monclient: shutdown 2024-09-12T17:21:03.518 INFO:tasks.workunit.client.0.smithi016.stderr: -494> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 5 asok(0x55a139f612b0) unregister_commands rotate-key 2024-09-12T17:21:03.518 INFO:tasks.workunit.client.0.smithi016.stderr: -493> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 10 monclient: build_initial_monmap 2024-09-12T17:21:03.519 INFO:tasks.workunit.client.0.smithi016.stderr: -492> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 1 build_initial for_mkfs: 0 2024-09-12T17:21:03.519 INFO:tasks.workunit.client.0.smithi016.stderr: -491> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 10 monclient: monmap: 2024-09-12T17:21:03.519 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:21:03.519 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:21:03.519 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:21:03.519 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:21:03.519 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:21:03.519 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:03.519 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:21:03.519 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:21:03.519 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:21:03.519 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:03.519 INFO:tasks.workunit.client.0.smithi016.stderr: -490> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a173860) adding auth protocol: cephx 2024-09-12T17:21:03.519 INFO:tasks.workunit.client.0.smithi016.stderr: -489> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a173860) adding auth protocol: cephx 2024-09-12T17:21:03.520 INFO:tasks.workunit.client.0.smithi016.stderr: -488> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a173860) adding auth protocol: cephx 2024-09-12T17:21:03.520 INFO:tasks.workunit.client.0.smithi016.stderr: -487> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a173860) adding con mode: secure 2024-09-12T17:21:03.520 INFO:tasks.workunit.client.0.smithi016.stderr: -486> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a173860) adding con mode: crc 2024-09-12T17:21:03.520 INFO:tasks.workunit.client.0.smithi016.stderr: -485> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a173860) adding con mode: secure 2024-09-12T17:21:03.520 INFO:tasks.workunit.client.0.smithi016.stderr: -484> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a173860) adding con mode: crc 2024-09-12T17:21:03.520 INFO:tasks.workunit.client.0.smithi016.stderr: -483> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a173860) adding con mode: secure 2024-09-12T17:21:03.520 INFO:tasks.workunit.client.0.smithi016.stderr: -482> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a173860) adding con mode: crc 2024-09-12T17:21:03.520 INFO:tasks.workunit.client.0.smithi016.stderr: -481> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a173860) adding con mode: crc 2024-09-12T17:21:03.520 INFO:tasks.workunit.client.0.smithi016.stderr: -480> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a173860) adding con mode: secure 2024-09-12T17:21:03.520 INFO:tasks.workunit.client.0.smithi016.stderr: -479> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a173860) adding con mode: crc 2024-09-12T17:21:03.520 INFO:tasks.workunit.client.0.smithi016.stderr: -478> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a173860) adding con mode: secure 2024-09-12T17:21:03.520 INFO:tasks.workunit.client.0.smithi016.stderr: -477> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a173860) adding con mode: crc 2024-09-12T17:21:03.520 INFO:tasks.workunit.client.0.smithi016.stderr: -476> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a173860) adding con mode: secure 2024-09-12T17:21:03.521 INFO:tasks.workunit.client.0.smithi016.stderr: -475> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:03.521 INFO:tasks.workunit.client.0.smithi016.stderr: -474> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 1 librados: starting msgr at 2024-09-12T17:21:03.521 INFO:tasks.workunit.client.0.smithi016.stderr: -473> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 1 librados: starting objecter 2024-09-12T17:21:03.521 INFO:tasks.workunit.client.0.smithi016.stderr: -472> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 5 asok(0x55a139f612b0) register_command objecter_requests hook 0x55a13a172d10 2024-09-12T17:21:03.521 INFO:tasks.workunit.client.0.smithi016.stderr: -471> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 1 librados: setting wanted keys 2024-09-12T17:21:03.521 INFO:tasks.workunit.client.0.smithi016.stderr: -470> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 1 librados: calling monclient init 2024-09-12T17:21:03.521 INFO:tasks.workunit.client.0.smithi016.stderr: -469> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 10 monclient: init 2024-09-12T17:21:03.521 INFO:tasks.workunit.client.0.smithi016.stderr: -468> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a16e020) adding auth protocol: cephx 2024-09-12T17:21:03.521 INFO:tasks.workunit.client.0.smithi016.stderr: -467> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a16e020) adding auth protocol: cephx 2024-09-12T17:21:03.521 INFO:tasks.workunit.client.0.smithi016.stderr: -466> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a16e020) adding auth protocol: cephx 2024-09-12T17:21:03.521 INFO:tasks.workunit.client.0.smithi016.stderr: -465> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a16e020) adding con mode: secure 2024-09-12T17:21:03.521 INFO:tasks.workunit.client.0.smithi016.stderr: -464> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a16e020) adding con mode: crc 2024-09-12T17:21:03.521 INFO:tasks.workunit.client.0.smithi016.stderr: -463> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a16e020) adding con mode: secure 2024-09-12T17:21:03.522 INFO:tasks.workunit.client.0.smithi016.stderr: -462> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a16e020) adding con mode: crc 2024-09-12T17:21:03.522 INFO:tasks.workunit.client.0.smithi016.stderr: -461> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a16e020) adding con mode: secure 2024-09-12T17:21:03.522 INFO:tasks.workunit.client.0.smithi016.stderr: -460> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a16e020) adding con mode: crc 2024-09-12T17:21:03.522 INFO:tasks.workunit.client.0.smithi016.stderr: -459> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a16e020) adding con mode: crc 2024-09-12T17:21:03.522 INFO:tasks.workunit.client.0.smithi016.stderr: -458> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a16e020) adding con mode: secure 2024-09-12T17:21:03.522 INFO:tasks.workunit.client.0.smithi016.stderr: -457> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a16e020) adding con mode: crc 2024-09-12T17:21:03.522 INFO:tasks.workunit.client.0.smithi016.stderr: -456> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a16e020) adding con mode: secure 2024-09-12T17:21:03.522 INFO:tasks.workunit.client.0.smithi016.stderr: -455> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a16e020) adding con mode: crc 2024-09-12T17:21:03.522 INFO:tasks.workunit.client.0.smithi016.stderr: -454> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a16e020) adding con mode: secure 2024-09-12T17:21:03.522 INFO:tasks.workunit.client.0.smithi016.stderr: -453> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:03.522 INFO:tasks.workunit.client.0.smithi016.stderr: -452> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:03.522 INFO:tasks.workunit.client.0.smithi016.stderr: -451> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 5 asok(0x55a139f612b0) register_command rotate-key hook 0x55a13a16e168 2024-09-12T17:21:03.522 INFO:tasks.workunit.client.0.smithi016.stderr: -450> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 10 monclient: _reopen_session rank -1 2024-09-12T17:21:03.522 INFO:tasks.workunit.client.0.smithi016.stderr: -449> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:21:03.523 INFO:tasks.workunit.client.0.smithi016.stderr: -448> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 10 monclient(hunting): picked mon.noname-a con 0x55a13a0295b0 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:21:03.523 INFO:tasks.workunit.client.0.smithi016.stderr: -447> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 10 monclient(hunting): picked mon.noname-b con 0x55a13a0b3660 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:21:03.523 INFO:tasks.workunit.client.0.smithi016.stderr: -446> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 10 monclient(hunting): picked mon.noname-c con 0x55a13a0b6720 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:21:03.523 INFO:tasks.workunit.client.0.smithi016.stderr: -445> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:03.523 INFO:tasks.workunit.client.0.smithi016.stderr: -444> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:03.523 INFO:tasks.workunit.client.0.smithi016.stderr: -443> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:03.523 INFO:tasks.workunit.client.0.smithi016.stderr: -442> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 10 monclient(hunting): _renew_subs 2024-09-12T17:21:03.523 INFO:tasks.workunit.client.0.smithi016.stderr: -441> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 10 monclient(hunting): authenticate will time out at 2381.136828s 2024-09-12T17:21:03.523 INFO:tasks.workunit.client.0.smithi016.stderr: -440> 2024-09-12T17:21:03.161+0000 7f0ff4e7a640 10 monclient(hunting): get_auth_request con 0x55a13a0b6720 auth_method 0 2024-09-12T17:21:03.523 INFO:tasks.workunit.client.0.smithi016.stderr: -439> 2024-09-12T17:21:03.161+0000 7f0ff4e7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:21:03.523 INFO:tasks.workunit.client.0.smithi016.stderr: -438> 2024-09-12T17:21:03.161+0000 7f0ff4e7a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:21:03.523 INFO:tasks.workunit.client.0.smithi016.stderr: -437> 2024-09-12T17:21:03.161+0000 7f0ff4e7a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:21:03.523 INFO:tasks.workunit.client.0.smithi016.stderr: -436> 2024-09-12T17:21:03.161+0000 7f0ff4679640 10 monclient(hunting): get_auth_request con 0x55a13a0295b0 auth_method 0 2024-09-12T17:21:03.524 INFO:tasks.workunit.client.0.smithi016.stderr: -435> 2024-09-12T17:21:03.161+0000 7f0ff4679640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:21:03.524 INFO:tasks.workunit.client.0.smithi016.stderr: -434> 2024-09-12T17:21:03.161+0000 7f0ff4679640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:21:03.524 INFO:tasks.workunit.client.0.smithi016.stderr: -433> 2024-09-12T17:21:03.161+0000 7f0ff4679640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:21:03.524 INFO:tasks.workunit.client.0.smithi016.stderr: -432> 2024-09-12T17:21:03.161+0000 7f0ff4e7a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:21:03.524 INFO:tasks.workunit.client.0.smithi016.stderr: -431> 2024-09-12T17:21:03.161+0000 7f0ff4e7a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:21:03.524 INFO:tasks.workunit.client.0.smithi016.stderr: -430> 2024-09-12T17:21:03.161+0000 7f0ff4e7a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:21:03.524 INFO:tasks.workunit.client.0.smithi016.stderr: -429> 2024-09-12T17:21:03.161+0000 7f0ff4679640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:21:03.524 INFO:tasks.workunit.client.0.smithi016.stderr: -428> 2024-09-12T17:21:03.161+0000 7f0ff4679640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:21:03.524 INFO:tasks.workunit.client.0.smithi016.stderr: -427> 2024-09-12T17:21:03.161+0000 7f0ff4679640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:21:03.524 INFO:tasks.workunit.client.0.smithi016.stderr: -426> 2024-09-12T17:21:03.161+0000 7f0ff3e78640 10 monclient(hunting): get_auth_request con 0x55a13a0b3660 auth_method 0 2024-09-12T17:21:03.524 INFO:tasks.workunit.client.0.smithi016.stderr: -425> 2024-09-12T17:21:03.161+0000 7f0ff3e78640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:21:03.524 INFO:tasks.workunit.client.0.smithi016.stderr: -424> 2024-09-12T17:21:03.161+0000 7f0ff3e78640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:21:03.524 INFO:tasks.workunit.client.0.smithi016.stderr: -423> 2024-09-12T17:21:03.161+0000 7f0ff3e78640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:21:03.525 INFO:tasks.workunit.client.0.smithi016.stderr: -422> 2024-09-12T17:21:03.161+0000 7f0ff4e7a640 10 monclient(hunting): handle_auth_done global_id 7295 payload 824 2024-09-12T17:21:03.525 INFO:tasks.workunit.client.0.smithi016.stderr: -421> 2024-09-12T17:21:03.161+0000 7f0ff4e7a640 10 monclient: _finish_hunting 0 2024-09-12T17:21:03.525 INFO:tasks.workunit.client.0.smithi016.stderr: -420> 2024-09-12T17:21:03.161+0000 7f0ff4e7a640 1 monclient: found mon.noname-c 2024-09-12T17:21:03.525 INFO:tasks.workunit.client.0.smithi016.stderr: -419> 2024-09-12T17:21:03.161+0000 7f0ff4e7a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:21:03.525 INFO:tasks.workunit.client.0.smithi016.stderr: -418> 2024-09-12T17:21:03.161+0000 7f0ee0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:21:03.525 INFO:tasks.workunit.client.0.smithi016.stderr: -417> 2024-09-12T17:21:03.161+0000 7f0ee0e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:21:03.525 INFO:tasks.workunit.client.0.smithi016.stderr: -416> 2024-09-12T17:21:03.161+0000 7f0ee0e09640 10 monclient: dump: 2024-09-12T17:21:03.525 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:21:03.525 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:21:03.526 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:03.526 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:03.526 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:21:03.526 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:03.526 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:21:03.526 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:21:03.526 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:21:03.526 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:03.526 INFO:tasks.workunit.client.0.smithi016.stderr: -415> 2024-09-12T17:21:03.161+0000 7f0ee0e09640 10 monclient: _finish_auth 0 2024-09-12T17:21:03.526 INFO:tasks.workunit.client.0.smithi016.stderr: -414> 2024-09-12T17:21:03.161+0000 7f0ee0e09640 10 monclient: _check_auth_tickets 2024-09-12T17:21:03.526 INFO:tasks.workunit.client.0.smithi016.stderr: -413> 2024-09-12T17:21:03.161+0000 7f0ee0e09640 10 monclient: handle_config config(0 keys) 2024-09-12T17:21:03.526 INFO:tasks.workunit.client.0.smithi016.stderr: -412> 2024-09-12T17:21:03.161+0000 7f0ee0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:21:03.526 INFO:tasks.workunit.client.0.smithi016.stderr: -411> 2024-09-12T17:21:03.161+0000 7f0ee0e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:21:03.527 INFO:tasks.workunit.client.0.smithi016.stderr: -410> 2024-09-12T17:21:03.161+0000 7f0ee0e09640 10 monclient: dump: 2024-09-12T17:21:03.527 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:21:03.527 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:21:03.527 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:03.527 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:03.527 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:21:03.527 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:03.527 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:21:03.527 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:21:03.527 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:21:03.527 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:03.527 INFO:tasks.workunit.client.0.smithi016.stderr: -409> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 5 monclient: authenticate success, global_id 7295 2024-09-12T17:21:03.527 INFO:tasks.workunit.client.0.smithi016.stderr: -408> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 10 monclient: _renew_subs 2024-09-12T17:21:03.527 INFO:tasks.workunit.client.0.smithi016.stderr: -407> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:21:03.528 INFO:tasks.workunit.client.0.smithi016.stderr: -406> 2024-09-12T17:21:03.161+0000 7f0ee260c640 4 set_mon_vals no callback set 2024-09-12T17:21:03.528 INFO:tasks.workunit.client.0.smithi016.stderr: -405> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 10 monclient: _renew_subs 2024-09-12T17:21:03.528 INFO:tasks.workunit.client.0.smithi016.stderr: -404> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:21:03.528 INFO:tasks.workunit.client.0.smithi016.stderr: -403> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 1 librados: init done 2024-09-12T17:21:03.528 INFO:tasks.workunit.client.0.smithi016.stderr: -402> 2024-09-12T17:21:03.165+0000 7f0ee0e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:21:03.528 INFO:tasks.workunit.client.0.smithi016.stderr: -401> 2024-09-12T17:21:03.165+0000 7f0ee0e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:21:03.528 INFO:tasks.workunit.client.0.smithi016.stderr: -400> 2024-09-12T17:21:03.165+0000 7f0ee0e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:21:03.528 INFO:tasks.workunit.client.0.smithi016.stderr: -399> 2024-09-12T17:21:03.165+0000 7f0ff4679640 10 monclient: get_auth_request con 0x7f0edc070b10 auth_method 0 2024-09-12T17:21:03.528 INFO:tasks.workunit.client.0.smithi016.stderr: -398> 2024-09-12T17:21:03.165+0000 7f0ff3e78640 10 monclient: get_auth_request con 0x55a13a1b5eb0 auth_method 0 2024-09-12T17:21:03.529 INFO:tasks.workunit.client.0.smithi016.stderr: -397> 2024-09-12T17:21:03.165+0000 7f0ff4679640 10 monclient: get_auth_request con 0x55a13a1b9090 auth_method 0 2024-09-12T17:21:03.529 INFO:tasks.workunit.client.0.smithi016.stderr: -396> 2024-09-12T17:21:03.169+0000 7f0ff3e78640 10 monclient: get_auth_request con 0x55a13a1bd280 auth_method 0 2024-09-12T17:21:03.529 INFO:tasks.workunit.client.0.smithi016.stderr: -395> 2024-09-12T17:21:03.169+0000 7f0ff4e7a640 10 monclient: get_auth_request con 0x55a13a1c0f60 auth_method 0 2024-09-12T17:21:03.529 INFO:tasks.workunit.client.0.smithi016.stderr: -394> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 10 monclient: build_initial_monmap 2024-09-12T17:21:03.529 INFO:tasks.workunit.client.0.smithi016.stderr: -393> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 1 build_initial for_mkfs: 0 2024-09-12T17:21:03.529 INFO:tasks.workunit.client.0.smithi016.stderr: -392> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 10 monclient: monmap: 2024-09-12T17:21:03.529 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:21:03.529 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:21:03.529 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:21:03.529 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:21:03.529 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:21:03.529 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:03.529 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:21:03.530 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:21:03.530 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:21:03.530 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:03.530 INFO:tasks.workunit.client.0.smithi016.stderr: -391> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c50e0) adding auth protocol: cephx 2024-09-12T17:21:03.530 INFO:tasks.workunit.client.0.smithi016.stderr: -390> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c50e0) adding auth protocol: cephx 2024-09-12T17:21:03.530 INFO:tasks.workunit.client.0.smithi016.stderr: -389> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c50e0) adding auth protocol: cephx 2024-09-12T17:21:03.530 INFO:tasks.workunit.client.0.smithi016.stderr: -388> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c50e0) adding con mode: secure 2024-09-12T17:21:03.530 INFO:tasks.workunit.client.0.smithi016.stderr: -387> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c50e0) adding con mode: crc 2024-09-12T17:21:03.530 INFO:tasks.workunit.client.0.smithi016.stderr: -386> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c50e0) adding con mode: secure 2024-09-12T17:21:03.530 INFO:tasks.workunit.client.0.smithi016.stderr: -385> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c50e0) adding con mode: crc 2024-09-12T17:21:03.530 INFO:tasks.workunit.client.0.smithi016.stderr: -384> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c50e0) adding con mode: secure 2024-09-12T17:21:03.530 INFO:tasks.workunit.client.0.smithi016.stderr: -383> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c50e0) adding con mode: crc 2024-09-12T17:21:03.530 INFO:tasks.workunit.client.0.smithi016.stderr: -382> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c50e0) adding con mode: crc 2024-09-12T17:21:03.531 INFO:tasks.workunit.client.0.smithi016.stderr: -381> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c50e0) adding con mode: secure 2024-09-12T17:21:03.531 INFO:tasks.workunit.client.0.smithi016.stderr: -380> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c50e0) adding con mode: crc 2024-09-12T17:21:03.531 INFO:tasks.workunit.client.0.smithi016.stderr: -379> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c50e0) adding con mode: secure 2024-09-12T17:21:03.531 INFO:tasks.workunit.client.0.smithi016.stderr: -378> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c50e0) adding con mode: crc 2024-09-12T17:21:03.531 INFO:tasks.workunit.client.0.smithi016.stderr: -377> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c50e0) adding con mode: secure 2024-09-12T17:21:03.531 INFO:tasks.workunit.client.0.smithi016.stderr: -376> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:03.531 INFO:tasks.workunit.client.0.smithi016.stderr: -375> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 asok(0x55a139f612b0) register_command objecter_requests cmddesc objecter_requests hook 0x55a13a1c8a60 EEXIST 2024-09-12T17:21:03.531 INFO:tasks.workunit.client.0.smithi016.stderr: -374> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 10 monclient: init 2024-09-12T17:21:03.531 INFO:tasks.workunit.client.0.smithi016.stderr: -373> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c3f88) adding auth protocol: cephx 2024-09-12T17:21:03.531 INFO:tasks.workunit.client.0.smithi016.stderr: -372> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c3f88) adding auth protocol: cephx 2024-09-12T17:21:03.531 INFO:tasks.workunit.client.0.smithi016.stderr: -371> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c3f88) adding auth protocol: cephx 2024-09-12T17:21:03.531 INFO:tasks.workunit.client.0.smithi016.stderr: -370> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c3f88) adding con mode: secure 2024-09-12T17:21:03.531 INFO:tasks.workunit.client.0.smithi016.stderr: -369> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c3f88) adding con mode: crc 2024-09-12T17:21:03.531 INFO:tasks.workunit.client.0.smithi016.stderr: -368> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c3f88) adding con mode: secure 2024-09-12T17:21:03.532 INFO:tasks.workunit.client.0.smithi016.stderr: -367> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c3f88) adding con mode: crc 2024-09-12T17:21:03.532 INFO:tasks.workunit.client.0.smithi016.stderr: -366> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c3f88) adding con mode: secure 2024-09-12T17:21:03.532 INFO:tasks.workunit.client.0.smithi016.stderr: -365> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c3f88) adding con mode: crc 2024-09-12T17:21:03.532 INFO:tasks.workunit.client.0.smithi016.stderr: -364> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c3f88) adding con mode: crc 2024-09-12T17:21:03.532 INFO:tasks.workunit.client.0.smithi016.stderr: -363> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c3f88) adding con mode: secure 2024-09-12T17:21:03.532 INFO:tasks.workunit.client.0.smithi016.stderr: -362> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c3f88) adding con mode: crc 2024-09-12T17:21:03.532 INFO:tasks.workunit.client.0.smithi016.stderr: -361> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c3f88) adding con mode: secure 2024-09-12T17:21:03.532 INFO:tasks.workunit.client.0.smithi016.stderr: -360> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c3f88) adding con mode: crc 2024-09-12T17:21:03.532 INFO:tasks.workunit.client.0.smithi016.stderr: -359> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c3f88) adding con mode: secure 2024-09-12T17:21:03.532 INFO:tasks.workunit.client.0.smithi016.stderr: -358> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:03.533 INFO:tasks.workunit.client.0.smithi016.stderr: -357> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:03.533 INFO:tasks.workunit.client.0.smithi016.stderr: -356> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 asok(0x55a139f612b0) register_command rotate-key cmddesc rotate-key hook 0x55a13a1c40d0 EEXIST 2024-09-12T17:21:03.533 INFO:tasks.workunit.client.0.smithi016.stderr: -355> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 10 monclient: _reopen_session rank -1 2024-09-12T17:21:03.533 INFO:tasks.workunit.client.0.smithi016.stderr: -354> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:21:03.533 INFO:tasks.workunit.client.0.smithi016.stderr: -353> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 10 monclient(hunting): picked mon.noname-c con 0x55a13a1ecc10 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:21:03.533 INFO:tasks.workunit.client.0.smithi016.stderr: -352> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 10 monclient(hunting): picked mon.noname-b con 0x55a13a1ec540 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:21:03.533 INFO:tasks.workunit.client.0.smithi016.stderr: -351> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 10 monclient(hunting): picked mon.noname-a con 0x55a13a1eaf20 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:21:03.533 INFO:tasks.workunit.client.0.smithi016.stderr: -350> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:03.533 INFO:tasks.workunit.client.0.smithi016.stderr: -349> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:03.533 INFO:tasks.workunit.client.0.smithi016.stderr: -348> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:03.533 INFO:tasks.workunit.client.0.smithi016.stderr: -347> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 10 monclient(hunting): _renew_subs 2024-09-12T17:21:03.533 INFO:tasks.workunit.client.0.smithi016.stderr: -346> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 10 monclient(hunting): authenticate will time out at 2381.149699s 2024-09-12T17:21:03.533 INFO:tasks.workunit.client.0.smithi016.stderr: -345> 2024-09-12T17:21:03.173+0000 7f0ff3e78640 10 monclient(hunting): get_auth_request con 0x55a13a1ecc10 auth_method 0 2024-09-12T17:21:03.533 INFO:tasks.workunit.client.0.smithi016.stderr: -344> 2024-09-12T17:21:03.173+0000 7f0ff3e78640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:21:03.534 INFO:tasks.workunit.client.0.smithi016.stderr: -343> 2024-09-12T17:21:03.173+0000 7f0ff3e78640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:21:03.534 INFO:tasks.workunit.client.0.smithi016.stderr: -342> 2024-09-12T17:21:03.173+0000 7f0ff3e78640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:21:03.534 INFO:tasks.workunit.client.0.smithi016.stderr: -341> 2024-09-12T17:21:03.173+0000 7f0ff4679640 10 monclient(hunting): get_auth_request con 0x55a13a1eaf20 auth_method 0 2024-09-12T17:21:03.534 INFO:tasks.workunit.client.0.smithi016.stderr: -340> 2024-09-12T17:21:03.173+0000 7f0ff4679640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:21:03.534 INFO:tasks.workunit.client.0.smithi016.stderr: -339> 2024-09-12T17:21:03.173+0000 7f0ff4679640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:21:03.534 INFO:tasks.workunit.client.0.smithi016.stderr: -338> 2024-09-12T17:21:03.173+0000 7f0ff4679640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:21:03.534 INFO:tasks.workunit.client.0.smithi016.stderr: -337> 2024-09-12T17:21:03.173+0000 7f0ff4679640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:21:03.534 INFO:tasks.workunit.client.0.smithi016.stderr: -336> 2024-09-12T17:21:03.173+0000 7f0ff4679640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:21:03.534 INFO:tasks.workunit.client.0.smithi016.stderr: -335> 2024-09-12T17:21:03.173+0000 7f0ff4679640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:21:03.534 INFO:tasks.workunit.client.0.smithi016.stderr: -334> 2024-09-12T17:21:03.173+0000 7f0ff4e7a640 10 monclient(hunting): get_auth_request con 0x55a13a1ec540 auth_method 0 2024-09-12T17:21:03.534 INFO:tasks.workunit.client.0.smithi016.stderr: -333> 2024-09-12T17:21:03.173+0000 7f0ff4e7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:21:03.534 INFO:tasks.workunit.client.0.smithi016.stderr: -332> 2024-09-12T17:21:03.173+0000 7f0ff4e7a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:21:03.534 INFO:tasks.workunit.client.0.smithi016.stderr: -331> 2024-09-12T17:21:03.173+0000 7f0ff4e7a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:21:03.535 INFO:tasks.workunit.client.0.smithi016.stderr: -330> 2024-09-12T17:21:03.173+0000 7f0ff3e78640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:21:03.535 INFO:tasks.workunit.client.0.smithi016.stderr: -329> 2024-09-12T17:21:03.173+0000 7f0ff3e78640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:21:03.535 INFO:tasks.workunit.client.0.smithi016.stderr: -328> 2024-09-12T17:21:03.173+0000 7f0ff3e78640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:21:03.535 INFO:tasks.workunit.client.0.smithi016.stderr: -327> 2024-09-12T17:21:03.173+0000 7f0ff4e7a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:21:03.535 INFO:tasks.workunit.client.0.smithi016.stderr: -326> 2024-09-12T17:21:03.173+0000 7f0ff4e7a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:21:03.535 INFO:tasks.workunit.client.0.smithi016.stderr: -325> 2024-09-12T17:21:03.173+0000 7f0ff4e7a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:21:03.535 INFO:tasks.workunit.client.0.smithi016.stderr: -324> 2024-09-12T17:21:03.173+0000 7f0ff4679640 10 monclient(hunting): handle_auth_done global_id 7665 payload 824 2024-09-12T17:21:03.535 INFO:tasks.workunit.client.0.smithi016.stderr: -323> 2024-09-12T17:21:03.173+0000 7f0ff4679640 10 monclient: _finish_hunting 0 2024-09-12T17:21:03.535 INFO:tasks.workunit.client.0.smithi016.stderr: -322> 2024-09-12T17:21:03.173+0000 7f0ff4679640 1 monclient: found mon.noname-a 2024-09-12T17:21:03.535 INFO:tasks.workunit.client.0.smithi016.stderr: -321> 2024-09-12T17:21:03.173+0000 7f0ff4679640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:21:03.535 INFO:tasks.workunit.client.0.smithi016.stderr: -320> 2024-09-12T17:21:03.173+0000 7f0ed9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:21:03.535 INFO:tasks.workunit.client.0.smithi016.stderr: -319> 2024-09-12T17:21:03.173+0000 7f0ed9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:21:03.535 INFO:tasks.workunit.client.0.smithi016.stderr: -318> 2024-09-12T17:21:03.173+0000 7f0ed9ffb640 10 monclient: dump: 2024-09-12T17:21:03.536 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:21:03.536 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:21:03.536 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:03.536 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:03.536 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:21:03.536 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:03.536 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:21:03.536 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:21:03.536 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:21:03.536 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:03.536 INFO:tasks.workunit.client.0.smithi016.stderr: -317> 2024-09-12T17:21:03.173+0000 7f0ed9ffb640 10 monclient: _finish_auth 0 2024-09-12T17:21:03.536 INFO:tasks.workunit.client.0.smithi016.stderr: -316> 2024-09-12T17:21:03.173+0000 7f0ed9ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:21:03.536 INFO:tasks.workunit.client.0.smithi016.stderr: -315> 2024-09-12T17:21:03.173+0000 7f0ed9ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:21:03.537 INFO:tasks.workunit.client.0.smithi016.stderr: -314> 2024-09-12T17:21:03.173+0000 7f0ed9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:21:03.537 INFO:tasks.workunit.client.0.smithi016.stderr: -313> 2024-09-12T17:21:03.173+0000 7f0ed9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:21:03.537 INFO:tasks.workunit.client.0.smithi016.stderr: -312> 2024-09-12T17:21:03.173+0000 7f0ed9ffb640 10 monclient: dump: 2024-09-12T17:21:03.537 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:21:03.537 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:21:03.537 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:03.537 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:03.537 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:21:03.537 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:03.537 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:21:03.537 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:21:03.537 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:21:03.537 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:03.537 INFO:tasks.workunit.client.0.smithi016.stderr: -311> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 monclient: authenticate success, global_id 7665 2024-09-12T17:21:03.538 INFO:tasks.workunit.client.0.smithi016.stderr: -310> 2024-09-12T17:21:03.173+0000 7f0ff567b640 4 set_mon_vals no callback set 2024-09-12T17:21:03.538 INFO:tasks.workunit.client.0.smithi016.stderr: -309> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 10 monclient: _renew_subs 2024-09-12T17:21:03.538 INFO:tasks.workunit.client.0.smithi016.stderr: -308> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:21:03.538 INFO:tasks.workunit.client.0.smithi016.stderr: -307> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 10 monclient: _renew_subs 2024-09-12T17:21:03.538 INFO:tasks.workunit.client.0.smithi016.stderr: -306> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:21:03.538 INFO:tasks.workunit.client.0.smithi016.stderr: -305> 2024-09-12T17:21:03.177+0000 7f0ed9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:21:03.538 INFO:tasks.workunit.client.0.smithi016.stderr: -304> 2024-09-12T17:21:03.177+0000 7f0ed9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:21:03.538 INFO:tasks.workunit.client.0.smithi016.stderr: -303> 2024-09-12T17:21:03.177+0000 7f0ed9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:21:03.538 INFO:tasks.workunit.client.0.smithi016.stderr: -302> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 10 monclient: get_monmap_and_config 2024-09-12T17:21:03.538 INFO:tasks.workunit.client.0.smithi016.stderr: -301> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 10 monclient: build_initial_monmap 2024-09-12T17:21:03.538 INFO:tasks.workunit.client.0.smithi016.stderr: -300> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 1 build_initial for_mkfs: 0 2024-09-12T17:21:03.538 INFO:tasks.workunit.client.0.smithi016.stderr: -299> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 10 monclient: monmap: 2024-09-12T17:21:03.538 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:21:03.539 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:21:03.539 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:21:03.539 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:21:03.539 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:21:03.539 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:03.539 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:21:03.539 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:21:03.539 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:21:03.539 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:03.539 INFO:tasks.workunit.client.0.smithi016.stderr: -298> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a20c390) adding auth protocol: cephx 2024-09-12T17:21:03.539 INFO:tasks.workunit.client.0.smithi016.stderr: -297> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a20c390) adding auth protocol: cephx 2024-09-12T17:21:03.539 INFO:tasks.workunit.client.0.smithi016.stderr: -296> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a20c390) adding auth protocol: cephx 2024-09-12T17:21:03.540 INFO:tasks.workunit.client.0.smithi016.stderr: -295> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a20c390) adding con mode: secure 2024-09-12T17:21:03.540 INFO:tasks.workunit.client.0.smithi016.stderr: -294> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a20c390) adding con mode: crc 2024-09-12T17:21:03.540 INFO:tasks.workunit.client.0.smithi016.stderr: -293> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a20c390) adding con mode: secure 2024-09-12T17:21:03.540 INFO:tasks.workunit.client.0.smithi016.stderr: -292> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a20c390) adding con mode: crc 2024-09-12T17:21:03.540 INFO:tasks.workunit.client.0.smithi016.stderr: -291> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a20c390) adding con mode: secure 2024-09-12T17:21:03.540 INFO:tasks.workunit.client.0.smithi016.stderr: -290> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a20c390) adding con mode: crc 2024-09-12T17:21:03.540 INFO:tasks.workunit.client.0.smithi016.stderr: -289> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a20c390) adding con mode: crc 2024-09-12T17:21:03.540 INFO:tasks.workunit.client.0.smithi016.stderr: -288> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a20c390) adding con mode: secure 2024-09-12T17:21:03.540 INFO:tasks.workunit.client.0.smithi016.stderr: -287> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a20c390) adding con mode: crc 2024-09-12T17:21:03.540 INFO:tasks.workunit.client.0.smithi016.stderr: -286> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a20c390) adding con mode: secure 2024-09-12T17:21:03.540 INFO:tasks.workunit.client.0.smithi016.stderr: -285> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a20c390) adding con mode: crc 2024-09-12T17:21:03.540 INFO:tasks.workunit.client.0.smithi016.stderr: -284> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a20c390) adding con mode: secure 2024-09-12T17:21:03.540 INFO:tasks.workunit.client.0.smithi016.stderr: -283> 2024-09-12T17:21:03.177+0000 7f0ff3e78640 10 monclient: get_auth_request con 0x7f0ecc070a20 auth_method 0 2024-09-12T17:21:03.541 INFO:tasks.workunit.client.0.smithi016.stderr: -282> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:03.541 INFO:tasks.workunit.client.0.smithi016.stderr: -281> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 10 monclient: init 2024-09-12T17:21:03.541 INFO:tasks.workunit.client.0.smithi016.stderr: -280> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2ddc0) adding auth protocol: cephx 2024-09-12T17:21:03.541 INFO:tasks.workunit.client.0.smithi016.stderr: -279> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2ddc0) adding auth protocol: cephx 2024-09-12T17:21:03.541 INFO:tasks.workunit.client.0.smithi016.stderr: -278> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2ddc0) adding auth protocol: cephx 2024-09-12T17:21:03.541 INFO:tasks.workunit.client.0.smithi016.stderr: -277> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2ddc0) adding con mode: secure 2024-09-12T17:21:03.541 INFO:tasks.workunit.client.0.smithi016.stderr: -276> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2ddc0) adding con mode: crc 2024-09-12T17:21:03.541 INFO:tasks.workunit.client.0.smithi016.stderr: -275> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2ddc0) adding con mode: secure 2024-09-12T17:21:03.541 INFO:tasks.workunit.client.0.smithi016.stderr: -274> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2ddc0) adding con mode: crc 2024-09-12T17:21:03.541 INFO:tasks.workunit.client.0.smithi016.stderr: -273> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2ddc0) adding con mode: secure 2024-09-12T17:21:03.541 INFO:tasks.workunit.client.0.smithi016.stderr: -272> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2ddc0) adding con mode: crc 2024-09-12T17:21:03.541 INFO:tasks.workunit.client.0.smithi016.stderr: -271> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2ddc0) adding con mode: crc 2024-09-12T17:21:03.541 INFO:tasks.workunit.client.0.smithi016.stderr: -270> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2ddc0) adding con mode: secure 2024-09-12T17:21:03.542 INFO:tasks.workunit.client.0.smithi016.stderr: -269> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2ddc0) adding con mode: crc 2024-09-12T17:21:03.542 INFO:tasks.workunit.client.0.smithi016.stderr: -268> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2ddc0) adding con mode: secure 2024-09-12T17:21:03.542 INFO:tasks.workunit.client.0.smithi016.stderr: -267> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2ddc0) adding con mode: crc 2024-09-12T17:21:03.542 INFO:tasks.workunit.client.0.smithi016.stderr: -266> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2ddc0) adding con mode: secure 2024-09-12T17:21:03.542 INFO:tasks.workunit.client.0.smithi016.stderr: -265> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:03.542 INFO:tasks.workunit.client.0.smithi016.stderr: -264> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:03.542 INFO:tasks.workunit.client.0.smithi016.stderr: -263> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 asok(0x55a139f612b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd02d2df08 EEXIST 2024-09-12T17:21:03.542 INFO:tasks.workunit.client.0.smithi016.stderr: -262> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 10 monclient: _reopen_session rank -1 2024-09-12T17:21:03.542 INFO:tasks.workunit.client.0.smithi016.stderr: -261> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:21:03.542 INFO:tasks.workunit.client.0.smithi016.stderr: -260> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 10 monclient(hunting): picked mon.noname-c con 0x55a13a240810 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:21:03.542 INFO:tasks.workunit.client.0.smithi016.stderr: -259> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 10 monclient(hunting): picked mon.noname-b con 0x55a13a210230 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:21:03.542 INFO:tasks.workunit.client.0.smithi016.stderr: -258> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 10 monclient(hunting): picked mon.noname-a con 0x55a13a23bfe0 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:21:03.542 INFO:tasks.workunit.client.0.smithi016.stderr: -257> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:03.543 INFO:tasks.workunit.client.0.smithi016.stderr: -256> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:03.543 INFO:tasks.workunit.client.0.smithi016.stderr: -255> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:03.543 INFO:tasks.workunit.client.0.smithi016.stderr: -254> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 10 monclient(hunting): _renew_subs 2024-09-12T17:21:03.543 INFO:tasks.workunit.client.0.smithi016.stderr: -253> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 10 monclient(hunting): authenticate will time out at 2381.154516s 2024-09-12T17:21:03.543 INFO:tasks.workunit.client.0.smithi016.stderr: -252> 2024-09-12T17:21:03.177+0000 7f0ff3e78640 10 monclient(hunting): get_auth_request con 0x55a13a240810 auth_method 0 2024-09-12T17:21:03.543 INFO:tasks.workunit.client.0.smithi016.stderr: -251> 2024-09-12T17:21:03.177+0000 7f0ff3e78640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:21:03.543 INFO:tasks.workunit.client.0.smithi016.stderr: -250> 2024-09-12T17:21:03.177+0000 7f0ff3e78640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:21:03.543 INFO:tasks.workunit.client.0.smithi016.stderr: -249> 2024-09-12T17:21:03.177+0000 7f0ff3e78640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:21:03.543 INFO:tasks.workunit.client.0.smithi016.stderr: -248> 2024-09-12T17:21:03.177+0000 7f0ff4679640 10 monclient(hunting): get_auth_request con 0x55a13a23bfe0 auth_method 0 2024-09-12T17:21:03.543 INFO:tasks.workunit.client.0.smithi016.stderr: -247> 2024-09-12T17:21:03.177+0000 7f0ff4679640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:21:03.543 INFO:tasks.workunit.client.0.smithi016.stderr: -246> 2024-09-12T17:21:03.177+0000 7f0ff4679640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:21:03.543 INFO:tasks.workunit.client.0.smithi016.stderr: -245> 2024-09-12T17:21:03.177+0000 7f0ff4679640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:21:03.544 INFO:tasks.workunit.client.0.smithi016.stderr: -244> 2024-09-12T17:21:03.177+0000 7f0ff4679640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:21:03.544 INFO:tasks.workunit.client.0.smithi016.stderr: -243> 2024-09-12T17:21:03.177+0000 7f0ff4679640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:21:03.544 INFO:tasks.workunit.client.0.smithi016.stderr: -242> 2024-09-12T17:21:03.177+0000 7f0ff4679640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:21:03.544 INFO:tasks.workunit.client.0.smithi016.stderr: -241> 2024-09-12T17:21:03.177+0000 7f0ff3e78640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:21:03.544 INFO:tasks.workunit.client.0.smithi016.stderr: -240> 2024-09-12T17:21:03.177+0000 7f0ff3e78640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:21:03.544 INFO:tasks.workunit.client.0.smithi016.stderr: -239> 2024-09-12T17:21:03.177+0000 7f0ff3e78640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:21:03.544 INFO:tasks.workunit.client.0.smithi016.stderr: -238> 2024-09-12T17:21:03.177+0000 7f0ff4e7a640 10 monclient(hunting): get_auth_request con 0x55a13a210230 auth_method 0 2024-09-12T17:21:03.544 INFO:tasks.workunit.client.0.smithi016.stderr: -237> 2024-09-12T17:21:03.177+0000 7f0ff4e7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:21:03.544 INFO:tasks.workunit.client.0.smithi016.stderr: -236> 2024-09-12T17:21:03.177+0000 7f0ff4e7a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:21:03.544 INFO:tasks.workunit.client.0.smithi016.stderr: -235> 2024-09-12T17:21:03.177+0000 7f0ff4e7a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:21:03.544 INFO:tasks.workunit.client.0.smithi016.stderr: -234> 2024-09-12T17:21:03.177+0000 7f0ff4679640 10 monclient(hunting): handle_auth_done global_id 7668 payload 274 2024-09-12T17:21:03.544 INFO:tasks.workunit.client.0.smithi016.stderr: -233> 2024-09-12T17:21:03.177+0000 7f0ff4679640 10 monclient: _finish_hunting 0 2024-09-12T17:21:03.544 INFO:tasks.workunit.client.0.smithi016.stderr: -232> 2024-09-12T17:21:03.177+0000 7f0ff4679640 1 monclient: found mon.noname-a 2024-09-12T17:21:03.545 INFO:tasks.workunit.client.0.smithi016.stderr: -231> 2024-09-12T17:21:03.177+0000 7f0ff4679640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:21:03.545 INFO:tasks.workunit.client.0.smithi016.stderr: -230> 2024-09-12T17:21:03.177+0000 7f0ecb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:21:03.545 INFO:tasks.workunit.client.0.smithi016.stderr: -229> 2024-09-12T17:21:03.177+0000 7f0ecb7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:21:03.545 INFO:tasks.workunit.client.0.smithi016.stderr: -228> 2024-09-12T17:21:03.177+0000 7f0ecb7fe640 10 monclient: dump: 2024-09-12T17:21:03.545 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:21:03.545 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:21:03.545 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:03.545 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:03.545 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:21:03.545 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:03.545 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:21:03.545 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:21:03.545 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:21:03.545 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:03.546 INFO:tasks.workunit.client.0.smithi016.stderr: -227> 2024-09-12T17:21:03.177+0000 7f0ecb7fe640 10 monclient: _finish_auth 0 2024-09-12T17:21:03.546 INFO:tasks.workunit.client.0.smithi016.stderr: -226> 2024-09-12T17:21:03.177+0000 7f0ecb7fe640 10 monclient: _check_auth_tickets 2024-09-12T17:21:03.546 INFO:tasks.workunit.client.0.smithi016.stderr: -225> 2024-09-12T17:21:03.177+0000 7f0ecb7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:21:03.546 INFO:tasks.workunit.client.0.smithi016.stderr: -224> 2024-09-12T17:21:03.177+0000 7f0ecb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:21:03.546 INFO:tasks.workunit.client.0.smithi016.stderr: -223> 2024-09-12T17:21:03.177+0000 7f0ecb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:21:03.546 INFO:tasks.workunit.client.0.smithi016.stderr: -222> 2024-09-12T17:21:03.177+0000 7f0ecb7fe640 10 monclient: dump: 2024-09-12T17:21:03.546 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:21:03.546 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:21:03.546 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:03.546 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:03.546 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:21:03.546 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:03.546 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:21:03.546 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:21:03.547 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:21:03.547 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:03.547 INFO:tasks.workunit.client.0.smithi016.stderr: -221> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 monclient: authenticate success, global_id 7668 2024-09-12T17:21:03.547 INFO:tasks.workunit.client.0.smithi016.stderr: -220> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 10 monclient: get_monmap_and_config success 2024-09-12T17:21:03.547 INFO:tasks.workunit.client.0.smithi016.stderr: -219> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 4 set_mon_vals no callback set 2024-09-12T17:21:03.547 INFO:tasks.workunit.client.0.smithi016.stderr: -218> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 10 monclient: shutdown 2024-09-12T17:21:03.547 INFO:tasks.workunit.client.0.smithi016.stderr: -217> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 10 monclient: build_initial_monmap 2024-09-12T17:21:03.547 INFO:tasks.workunit.client.0.smithi016.stderr: -216> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 1 build_initial for_mkfs: 0 2024-09-12T17:21:03.547 INFO:tasks.workunit.client.0.smithi016.stderr: -215> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 10 monclient: monmap: 2024-09-12T17:21:03.547 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:21:03.547 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:21:03.547 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:21:03.547 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:21:03.548 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:21:03.548 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:03.548 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:21:03.548 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:21:03.548 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:21:03.548 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:03.548 INFO:tasks.workunit.client.0.smithi016.stderr: -214> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a231230) adding auth protocol: cephx 2024-09-12T17:21:03.548 INFO:tasks.workunit.client.0.smithi016.stderr: -213> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a231230) adding auth protocol: cephx 2024-09-12T17:21:03.548 INFO:tasks.workunit.client.0.smithi016.stderr: -212> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a231230) adding auth protocol: cephx 2024-09-12T17:21:03.548 INFO:tasks.workunit.client.0.smithi016.stderr: -211> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a231230) adding con mode: secure 2024-09-12T17:21:03.548 INFO:tasks.workunit.client.0.smithi016.stderr: -210> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a231230) adding con mode: crc 2024-09-12T17:21:03.549 INFO:tasks.workunit.client.0.smithi016.stderr: -209> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a231230) adding con mode: secure 2024-09-12T17:21:03.549 INFO:tasks.workunit.client.0.smithi016.stderr: -208> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a231230) adding con mode: crc 2024-09-12T17:21:03.549 INFO:tasks.workunit.client.0.smithi016.stderr: -207> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a231230) adding con mode: secure 2024-09-12T17:21:03.549 INFO:tasks.workunit.client.0.smithi016.stderr: -206> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a231230) adding con mode: crc 2024-09-12T17:21:03.549 INFO:tasks.workunit.client.0.smithi016.stderr: -205> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a231230) adding con mode: crc 2024-09-12T17:21:03.549 INFO:tasks.workunit.client.0.smithi016.stderr: -204> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a231230) adding con mode: secure 2024-09-12T17:21:03.549 INFO:tasks.workunit.client.0.smithi016.stderr: -203> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a231230) adding con mode: crc 2024-09-12T17:21:03.550 INFO:tasks.workunit.client.0.smithi016.stderr: -202> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a231230) adding con mode: secure 2024-09-12T17:21:03.550 INFO:tasks.workunit.client.0.smithi016.stderr: -201> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a231230) adding con mode: crc 2024-09-12T17:21:03.550 INFO:tasks.workunit.client.0.smithi016.stderr: -200> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a231230) adding con mode: secure 2024-09-12T17:21:03.550 INFO:tasks.workunit.client.0.smithi016.stderr: -199> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:03.550 INFO:tasks.workunit.client.0.smithi016.stderr: -198> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 1 librados: starting msgr at 2024-09-12T17:21:03.550 INFO:tasks.workunit.client.0.smithi016.stderr: -197> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 1 librados: starting objecter 2024-09-12T17:21:03.550 INFO:tasks.workunit.client.0.smithi016.stderr: -196> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 asok(0x55a139f612b0) register_command objecter_requests cmddesc objecter_requests hook 0x55a13a233520 EEXIST 2024-09-12T17:21:03.550 INFO:tasks.workunit.client.0.smithi016.stderr: -195> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 1 librados: setting wanted keys 2024-09-12T17:21:03.550 INFO:tasks.workunit.client.0.smithi016.stderr: -194> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 1 librados: calling monclient init 2024-09-12T17:21:03.550 INFO:tasks.workunit.client.0.smithi016.stderr: -193> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 10 monclient: init 2024-09-12T17:21:03.550 INFO:tasks.workunit.client.0.smithi016.stderr: -192> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1eea30) adding auth protocol: cephx 2024-09-12T17:21:03.551 INFO:tasks.workunit.client.0.smithi016.stderr: -191> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1eea30) adding auth protocol: cephx 2024-09-12T17:21:03.551 INFO:tasks.workunit.client.0.smithi016.stderr: -190> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1eea30) adding auth protocol: cephx 2024-09-12T17:21:03.551 INFO:tasks.workunit.client.0.smithi016.stderr: -189> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1eea30) adding con mode: secure 2024-09-12T17:21:03.551 INFO:tasks.workunit.client.0.smithi016.stderr: -188> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1eea30) adding con mode: crc 2024-09-12T17:21:03.551 INFO:tasks.workunit.client.0.smithi016.stderr: -187> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1eea30) adding con mode: secure 2024-09-12T17:21:03.551 INFO:tasks.workunit.client.0.smithi016.stderr: -186> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1eea30) adding con mode: crc 2024-09-12T17:21:03.551 INFO:tasks.workunit.client.0.smithi016.stderr: -185> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1eea30) adding con mode: secure 2024-09-12T17:21:03.551 INFO:tasks.workunit.client.0.smithi016.stderr: -184> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1eea30) adding con mode: crc 2024-09-12T17:21:03.551 INFO:tasks.workunit.client.0.smithi016.stderr: -183> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1eea30) adding con mode: crc 2024-09-12T17:21:03.551 INFO:tasks.workunit.client.0.smithi016.stderr: -182> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1eea30) adding con mode: secure 2024-09-12T17:21:03.551 INFO:tasks.workunit.client.0.smithi016.stderr: -181> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1eea30) adding con mode: crc 2024-09-12T17:21:03.552 INFO:tasks.workunit.client.0.smithi016.stderr: -180> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1eea30) adding con mode: secure 2024-09-12T17:21:03.552 INFO:tasks.workunit.client.0.smithi016.stderr: -179> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1eea30) adding con mode: crc 2024-09-12T17:21:03.552 INFO:tasks.workunit.client.0.smithi016.stderr: -178> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1eea30) adding con mode: secure 2024-09-12T17:21:03.552 INFO:tasks.workunit.client.0.smithi016.stderr: -177> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:03.552 INFO:tasks.workunit.client.0.smithi016.stderr: -176> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:03.552 INFO:tasks.workunit.client.0.smithi016.stderr: -175> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 asok(0x55a139f612b0) register_command rotate-key cmddesc rotate-key hook 0x55a13a1eeb78 EEXIST 2024-09-12T17:21:03.552 INFO:tasks.workunit.client.0.smithi016.stderr: -174> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 10 monclient: _reopen_session rank -1 2024-09-12T17:21:03.552 INFO:tasks.workunit.client.0.smithi016.stderr: -173> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:21:03.552 INFO:tasks.workunit.client.0.smithi016.stderr: -172> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 10 monclient(hunting): picked mon.noname-a con 0x55a13a210230 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:21:03.552 INFO:tasks.workunit.client.0.smithi016.stderr: -171> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 10 monclient(hunting): picked mon.noname-c con 0x55a13a23bfe0 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:21:03.552 INFO:tasks.workunit.client.0.smithi016.stderr: -170> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 10 monclient(hunting): picked mon.noname-b con 0x55a13a240810 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:21:03.552 INFO:tasks.workunit.client.0.smithi016.stderr: -169> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:03.552 INFO:tasks.workunit.client.0.smithi016.stderr: -168> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:03.553 INFO:tasks.workunit.client.0.smithi016.stderr: -167> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:03.553 INFO:tasks.workunit.client.0.smithi016.stderr: -166> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 10 monclient(hunting): _renew_subs 2024-09-12T17:21:03.553 INFO:tasks.workunit.client.0.smithi016.stderr: -165> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 10 monclient(hunting): authenticate will time out at 2381.157253s 2024-09-12T17:21:03.553 INFO:tasks.workunit.client.0.smithi016.stderr: -164> 2024-09-12T17:21:03.181+0000 7f0ff4e7a640 10 monclient(hunting): get_auth_request con 0x55a13a23bfe0 auth_method 0 2024-09-12T17:21:03.553 INFO:tasks.workunit.client.0.smithi016.stderr: -163> 2024-09-12T17:21:03.181+0000 7f0ff4e7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:21:03.553 INFO:tasks.workunit.client.0.smithi016.stderr: -162> 2024-09-12T17:21:03.181+0000 7f0ff4e7a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:21:03.553 INFO:tasks.workunit.client.0.smithi016.stderr: -161> 2024-09-12T17:21:03.181+0000 7f0ff4e7a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:21:03.553 INFO:tasks.workunit.client.0.smithi016.stderr: -160> 2024-09-12T17:21:03.181+0000 7f0ff3e78640 10 monclient(hunting): get_auth_request con 0x55a13a210230 auth_method 0 2024-09-12T17:21:03.553 INFO:tasks.workunit.client.0.smithi016.stderr: -159> 2024-09-12T17:21:03.181+0000 7f0ff3e78640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:21:03.553 INFO:tasks.workunit.client.0.smithi016.stderr: -158> 2024-09-12T17:21:03.181+0000 7f0ff3e78640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:21:03.553 INFO:tasks.workunit.client.0.smithi016.stderr: -157> 2024-09-12T17:21:03.181+0000 7f0ff3e78640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:21:03.554 INFO:tasks.workunit.client.0.smithi016.stderr: -156> 2024-09-12T17:21:03.181+0000 7f0ff4e7a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:21:03.554 INFO:tasks.workunit.client.0.smithi016.stderr: -155> 2024-09-12T17:21:03.181+0000 7f0ff4e7a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:21:03.554 INFO:tasks.workunit.client.0.smithi016.stderr: -154> 2024-09-12T17:21:03.181+0000 7f0ff4e7a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:21:03.554 INFO:tasks.workunit.client.0.smithi016.stderr: -153> 2024-09-12T17:21:03.181+0000 7f0ff3e78640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:21:03.554 INFO:tasks.workunit.client.0.smithi016.stderr: -152> 2024-09-12T17:21:03.181+0000 7f0ff3e78640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:21:03.554 INFO:tasks.workunit.client.0.smithi016.stderr: -151> 2024-09-12T17:21:03.181+0000 7f0ff3e78640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:21:03.554 INFO:tasks.workunit.client.0.smithi016.stderr: -150> 2024-09-12T17:21:03.181+0000 7f0ff4679640 10 monclient(hunting): get_auth_request con 0x55a13a240810 auth_method 0 2024-09-12T17:21:03.554 INFO:tasks.workunit.client.0.smithi016.stderr: -149> 2024-09-12T17:21:03.181+0000 7f0ff4679640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:21:03.556 INFO:tasks.workunit.client.0.smithi016.stderr: -148> 2024-09-12T17:21:03.181+0000 7f0ff4679640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:21:03.556 INFO:tasks.workunit.client.0.smithi016.stderr: -147> 2024-09-12T17:21:03.181+0000 7f0ff4679640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:21:03.556 INFO:tasks.workunit.client.0.smithi016.stderr: -146> 2024-09-12T17:21:03.181+0000 7f0ff4e7a640 10 monclient(hunting): handle_auth_done global_id 7304 payload 824 2024-09-12T17:21:03.556 INFO:tasks.workunit.client.0.smithi016.stderr: -145> 2024-09-12T17:21:03.181+0000 7f0ff4e7a640 10 monclient: _finish_hunting 0 2024-09-12T17:21:03.556 INFO:tasks.workunit.client.0.smithi016.stderr: -144> 2024-09-12T17:21:03.181+0000 7f0ff4e7a640 1 monclient: found mon.noname-c 2024-09-12T17:21:03.556 INFO:tasks.workunit.client.0.smithi016.stderr: -143> 2024-09-12T17:21:03.181+0000 7f0ff4e7a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:21:03.556 INFO:tasks.workunit.client.0.smithi016.stderr: -142> 2024-09-12T17:21:03.181+0000 7f0ec9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:21:03.556 INFO:tasks.workunit.client.0.smithi016.stderr: -141> 2024-09-12T17:21:03.181+0000 7f0ec9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:21:03.557 INFO:tasks.workunit.client.0.smithi016.stderr: -140> 2024-09-12T17:21:03.181+0000 7f0ec9ffb640 10 monclient: dump: 2024-09-12T17:21:03.557 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:21:03.557 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:21:03.557 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:03.557 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:03.557 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:21:03.557 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:03.557 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:21:03.557 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:21:03.557 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:21:03.557 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:03.557 INFO:tasks.workunit.client.0.smithi016.stderr: -139> 2024-09-12T17:21:03.181+0000 7f0ec9ffb640 10 monclient: _finish_auth 0 2024-09-12T17:21:03.557 INFO:tasks.workunit.client.0.smithi016.stderr: -138> 2024-09-12T17:21:03.181+0000 7f0ec9ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:21:03.558 INFO:tasks.workunit.client.0.smithi016.stderr: -137> 2024-09-12T17:21:03.181+0000 7f0ec9ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:21:03.558 INFO:tasks.workunit.client.0.smithi016.stderr: -136> 2024-09-12T17:21:03.181+0000 7f0ec9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:21:03.558 INFO:tasks.workunit.client.0.smithi016.stderr: -135> 2024-09-12T17:21:03.181+0000 7f0ec9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:21:03.558 INFO:tasks.workunit.client.0.smithi016.stderr: -134> 2024-09-12T17:21:03.181+0000 7f0ec9ffb640 10 monclient: dump: 2024-09-12T17:21:03.558 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:21:03.558 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:21:03.558 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:03.558 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:03.558 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:21:03.558 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:03.558 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:21:03.558 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:21:03.558 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:21:03.558 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:03.559 INFO:tasks.workunit.client.0.smithi016.stderr: -133> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 monclient: authenticate success, global_id 7304 2024-09-12T17:21:03.559 INFO:tasks.workunit.client.0.smithi016.stderr: -132> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 10 monclient: _renew_subs 2024-09-12T17:21:03.559 INFO:tasks.workunit.client.0.smithi016.stderr: -131> 2024-09-12T17:21:03.181+0000 7f0ecb7fe640 4 set_mon_vals no callback set 2024-09-12T17:21:03.559 INFO:tasks.workunit.client.0.smithi016.stderr: -130> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:21:03.559 INFO:tasks.workunit.client.0.smithi016.stderr: -129> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 10 monclient: _renew_subs 2024-09-12T17:21:03.559 INFO:tasks.workunit.client.0.smithi016.stderr: -128> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:21:03.559 INFO:tasks.workunit.client.0.smithi016.stderr: -127> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 1 librados: init done 2024-09-12T17:21:03.559 INFO:tasks.workunit.client.0.smithi016.stderr: -126> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 asok(0x55a139f612b0) register_command cr dump hook 0x55a13a23fc28 2024-09-12T17:21:03.559 INFO:tasks.workunit.client.0.smithi016.stderr: -125> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.559 INFO:tasks.workunit.client.0.smithi016.stderr: -124> 2024-09-12T17:21:03.185+0000 7f0ec9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:21:03.559 INFO:tasks.workunit.client.0.smithi016.stderr: -123> 2024-09-12T17:21:03.185+0000 7f0ec9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:21:03.559 INFO:tasks.workunit.client.0.smithi016.stderr: -122> 2024-09-12T17:21:03.185+0000 7f0ec9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:21:03.559 INFO:tasks.workunit.client.0.smithi016.stderr: -121> 2024-09-12T17:21:03.185+0000 7f0ff4679640 10 monclient: get_auth_request con 0x55a13a25a5c0 auth_method 0 2024-09-12T17:21:03.560 INFO:tasks.workunit.client.0.smithi016.stderr: -120> 2024-09-12T17:21:03.185+0000 7f0ff3e78640 10 monclient: get_auth_request con 0x7f0ebc070ae0 auth_method 0 2024-09-12T17:21:03.560 INFO:tasks.workunit.client.0.smithi016.stderr: -119> 2024-09-12T17:21:03.185+0000 7f0ff6b739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:03.560 INFO:tasks.workunit.client.0.smithi016.stderr: -118> 2024-09-12T17:21:03.185+0000 7f0ff6b739c0 20 realm 2024-09-12T17:21:03.560 INFO:tasks.workunit.client.0.smithi016.stderr: -117> 2024-09-12T17:21:03.185+0000 7f0ff6b739c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.560 INFO:tasks.workunit.client.0.smithi016.stderr: -116> 2024-09-12T17:21:03.185+0000 7f0ff6b739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:03.560 INFO:tasks.workunit.client.0.smithi016.stderr: -115> 2024-09-12T17:21:03.185+0000 7f0ff6b739c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:21:03.560 INFO:tasks.workunit.client.0.smithi016.stderr: -114> 2024-09-12T17:21:03.185+0000 7f0ff6b739c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.560 INFO:tasks.workunit.client.0.smithi016.stderr: -113> 2024-09-12T17:21:03.185+0000 7f0ff6b739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:03.560 INFO:tasks.workunit.client.0.smithi016.stderr: -112> 2024-09-12T17:21:03.185+0000 7f0ff6b739c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.560 INFO:tasks.workunit.client.0.smithi016.stderr: -111> 2024-09-12T17:21:03.185+0000 7f0ff3e78640 10 monclient: get_auth_request con 0x55a13a25e950 auth_method 0 2024-09-12T17:21:03.560 INFO:tasks.workunit.client.0.smithi016.stderr: -110> 2024-09-12T17:21:03.189+0000 7f0ff6b739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:03.560 INFO:tasks.workunit.client.0.smithi016.stderr: -109> 2024-09-12T17:21:03.189+0000 7f0ff6b739c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.560 INFO:tasks.workunit.client.0.smithi016.stderr: -108> 2024-09-12T17:21:03.189+0000 7f0ff4e7a640 10 monclient: get_auth_request con 0x55a13a2620c0 auth_method 0 2024-09-12T17:21:03.561 INFO:tasks.workunit.client.0.smithi016.stderr: -107> 2024-09-12T17:21:03.189+0000 7f0ff6b739c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:21:03.561 INFO:tasks.workunit.client.0.smithi016.stderr: -106> 2024-09-12T17:21:03.189+0000 7f0ff6b739c0 20 searching for the correct realm 2024-09-12T17:21:03.561 INFO:tasks.workunit.client.0.smithi016.stderr: -105> 2024-09-12T17:21:03.189+0000 7f0ff4679640 10 monclient: get_auth_request con 0x55a13a266e60 auth_method 0 2024-09-12T17:21:03.561 INFO:tasks.workunit.client.0.smithi016.stderr: -104> 2024-09-12T17:21:03.189+0000 7f0ff3e78640 10 monclient: get_auth_request con 0x7f0fe41180c0 auth_method 0 2024-09-12T17:21:03.561 INFO:tasks.workunit.client.0.smithi016.stderr: -103> 2024-09-12T17:21:03.193+0000 7f0ff4e7a640 10 monclient: get_auth_request con 0x7f0fdc015070 auth_method 0 2024-09-12T17:21:03.561 INFO:tasks.workunit.client.0.smithi016.stderr: -102> 2024-09-12T17:21:03.193+0000 7f0ff4e7a640 0 -- 172.21.15.16:0/1658252512 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f0fdc015070 msgr2=0x7f0fdc04f960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:03.561 INFO:tasks.workunit.client.0.smithi016.stderr: -101> 2024-09-12T17:21:03.193+0000 7f0ec9ffb640 1 client.7304.objecter ms_handle_reset 0x7f0fdc015070 session 0x7f0fdc015a00 osd.2 2024-09-12T17:21:03.561 INFO:tasks.workunit.client.0.smithi016.stderr: -100> 2024-09-12T17:21:03.193+0000 7f0ec9ffb640 10 monclient: _renew_subs 2024-09-12T17:21:03.561 INFO:tasks.workunit.client.0.smithi016.stderr: -99> 2024-09-12T17:21:03.193+0000 7f0ec9ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:21:03.561 INFO:tasks.workunit.client.0.smithi016.stderr: -98> 2024-09-12T17:21:03.193+0000 7f0ff4e7a640 10 monclient: get_auth_request con 0x7f0ebc080900 auth_method 0 2024-09-12T17:21:03.561 INFO:tasks.workunit.client.0.smithi016.stderr: -97> 2024-09-12T17:21:03.193+0000 7f0ff4679640 10 monclient: get_auth_request con 0x7f0fec05c510 auth_method 0 2024-09-12T17:21:03.561 INFO:tasks.workunit.client.0.smithi016.stderr: -96> 2024-09-12T17:21:03.201+0000 7f0ff3e78640 0 -- 172.21.15.16:0/1658252512 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f0fec068bd0 msgr2=0x7f0fec07ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:03.561 INFO:tasks.workunit.client.0.smithi016.stderr: -95> 2024-09-12T17:21:03.201+0000 7f0ff3e78640 10 monclient: get_auth_request con 0x7f0fec068bd0 auth_method 0 2024-09-12T17:21:03.562 INFO:tasks.workunit.client.0.smithi016.stderr: -94> 2024-09-12T17:21:03.405+0000 7f0ff3e78640 10 monclient: get_auth_request con 0x7f0fec068bd0 auth_method 0 2024-09-12T17:21:03.562 INFO:tasks.workunit.client.0.smithi016.stderr: -93> 2024-09-12T17:21:03.417+0000 7f0ff6b739c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:21:03.562 INFO:tasks.workunit.client.0.smithi016.stderr: -92> 2024-09-12T17:21:03.417+0000 7f0ff6b739c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:21:03.562 INFO:tasks.workunit.client.0.smithi016.stderr: -91> 2024-09-12T17:21:03.417+0000 7f0ff6b739c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:21:03.562 INFO:tasks.workunit.client.0.smithi016.stderr: -90> 2024-09-12T17:21:03.417+0000 7f0ff6b739c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:21:03.562 INFO:tasks.workunit.client.0.smithi016.stderr: -89> 2024-09-12T17:21:03.417+0000 7f0ff6b739c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:21:03.562 INFO:tasks.workunit.client.0.smithi016.stderr: -88> 2024-09-12T17:21:03.417+0000 7f0ff6b739c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:21:03.562 INFO:tasks.workunit.client.0.smithi016.stderr: -87> 2024-09-12T17:21:03.417+0000 7f0ff6b739c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.562 INFO:tasks.workunit.client.0.smithi016.stderr: -86> 2024-09-12T17:21:03.421+0000 7f0ff6b739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:03.562 INFO:tasks.workunit.client.0.smithi016.stderr: -85> 2024-09-12T17:21:03.421+0000 7f0ff6b739c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.562 INFO:tasks.workunit.client.0.smithi016.stderr: -84> 2024-09-12T17:21:03.421+0000 7f0ff6b739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:03.562 INFO:tasks.workunit.client.0.smithi016.stderr: -83> 2024-09-12T17:21:03.421+0000 7f0ff6b739c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.562 INFO:tasks.workunit.client.0.smithi016.stderr: -82> 2024-09-12T17:21:03.421+0000 7f0ff6b739c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:21:03.562 INFO:tasks.workunit.client.0.smithi016.stderr: -81> 2024-09-12T17:21:03.421+0000 7f0ff6b739c0 20 zone default found 2024-09-12T17:21:03.563 INFO:tasks.workunit.client.0.smithi016.stderr: -80> 2024-09-12T17:21:03.421+0000 7f0ff6b739c0 4 Realm: () 2024-09-12T17:21:03.563 INFO:tasks.workunit.client.0.smithi016.stderr: -79> 2024-09-12T17:21:03.421+0000 7f0ff6b739c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:21:03.563 INFO:tasks.workunit.client.0.smithi016.stderr: -78> 2024-09-12T17:21:03.421+0000 7f0ff6b739c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:21:03.563 INFO:tasks.workunit.client.0.smithi016.stderr: -77> 2024-09-12T17:21:03.421+0000 7f0ff6b739c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:21:03.563 INFO:tasks.workunit.client.0.smithi016.stderr: -76> 2024-09-12T17:21:03.421+0000 7f0ff6b739c0 20 zonegroup default 2024-09-12T17:21:03.563 INFO:tasks.workunit.client.0.smithi016.stderr: -75> 2024-09-12T17:21:03.421+0000 7f0ff6b739c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.563 INFO:tasks.workunit.client.0.smithi016.stderr: -74> 2024-09-12T17:21:03.421+0000 7f0ff6b739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:03.563 INFO:tasks.workunit.client.0.smithi016.stderr: -73> 2024-09-12T17:21:03.421+0000 7f0ff6b739c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.563 INFO:tasks.workunit.client.0.smithi016.stderr: -72> 2024-09-12T17:21:03.421+0000 7f0ff6b739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:03.563 INFO:tasks.workunit.client.0.smithi016.stderr: -71> 2024-09-12T17:21:03.421+0000 7f0ff6b739c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.563 INFO:tasks.workunit.client.0.smithi016.stderr: -70> 2024-09-12T17:21:03.425+0000 7f0ff6b739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:03.563 INFO:tasks.workunit.client.0.smithi016.stderr: -69> 2024-09-12T17:21:03.425+0000 7f0ff6b739c0 20 started sync module instance, tier type = 2024-09-12T17:21:03.564 INFO:tasks.workunit.client.0.smithi016.stderr: -68> 2024-09-12T17:21:03.425+0000 7f0ff6b739c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:21:03.564 INFO:tasks.workunit.client.0.smithi016.stderr: -67> 2024-09-12T17:21:03.445+0000 7f0ff6b739c0 20 add_watcher() i=0 2024-09-12T17:21:03.564 INFO:tasks.workunit.client.0.smithi016.stderr: -66> 2024-09-12T17:21:03.445+0000 7f0ff6b739c0 20 add_watcher() i=1 2024-09-12T17:21:03.564 INFO:tasks.workunit.client.0.smithi016.stderr: -65> 2024-09-12T17:21:03.445+0000 7f0ff6b739c0 20 add_watcher() i=2 2024-09-12T17:21:03.564 INFO:tasks.workunit.client.0.smithi016.stderr: -64> 2024-09-12T17:21:03.445+0000 7f0ff6b739c0 20 add_watcher() i=3 2024-09-12T17:21:03.564 INFO:tasks.workunit.client.0.smithi016.stderr: -63> 2024-09-12T17:21:03.445+0000 7f0ff6b739c0 20 add_watcher() i=4 2024-09-12T17:21:03.564 INFO:tasks.workunit.client.0.smithi016.stderr: -62> 2024-09-12T17:21:03.445+0000 7f0ff6b739c0 20 add_watcher() i=5 2024-09-12T17:21:03.564 INFO:tasks.workunit.client.0.smithi016.stderr: -61> 2024-09-12T17:21:03.445+0000 7f0ff6b739c0 20 add_watcher() i=6 2024-09-12T17:21:03.564 INFO:tasks.workunit.client.0.smithi016.stderr: -60> 2024-09-12T17:21:03.449+0000 7f0ff6b739c0 20 add_watcher() i=7 2024-09-12T17:21:03.564 INFO:tasks.workunit.client.0.smithi016.stderr: -59> 2024-09-12T17:21:03.449+0000 7f0ff6b739c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:21:03.564 INFO:tasks.workunit.client.0.smithi016.stderr: -58> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2e290) adding auth protocol: cephx 2024-09-12T17:21:03.564 INFO:tasks.workunit.client.0.smithi016.stderr: -57> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2e290) adding auth protocol: cephx 2024-09-12T17:21:03.564 INFO:tasks.workunit.client.0.smithi016.stderr: -56> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2e290) adding auth protocol: cephx 2024-09-12T17:21:03.565 INFO:tasks.workunit.client.0.smithi016.stderr: -55> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2e290) adding con mode: secure 2024-09-12T17:21:03.565 INFO:tasks.workunit.client.0.smithi016.stderr: -54> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2e290) adding con mode: crc 2024-09-12T17:21:03.565 INFO:tasks.workunit.client.0.smithi016.stderr: -53> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2e290) adding con mode: secure 2024-09-12T17:21:03.565 INFO:tasks.workunit.client.0.smithi016.stderr: -52> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2e290) adding con mode: crc 2024-09-12T17:21:03.565 INFO:tasks.workunit.client.0.smithi016.stderr: -51> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2e290) adding con mode: secure 2024-09-12T17:21:03.565 INFO:tasks.workunit.client.0.smithi016.stderr: -50> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2e290) adding con mode: crc 2024-09-12T17:21:03.565 INFO:tasks.workunit.client.0.smithi016.stderr: -49> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2e290) adding con mode: crc 2024-09-12T17:21:03.565 INFO:tasks.workunit.client.0.smithi016.stderr: -48> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2e290) adding con mode: secure 2024-09-12T17:21:03.565 INFO:tasks.workunit.client.0.smithi016.stderr: -47> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2e290) adding con mode: crc 2024-09-12T17:21:03.565 INFO:tasks.workunit.client.0.smithi016.stderr: -46> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2e290) adding con mode: secure 2024-09-12T17:21:03.565 INFO:tasks.workunit.client.0.smithi016.stderr: -45> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2e290) adding con mode: crc 2024-09-12T17:21:03.565 INFO:tasks.workunit.client.0.smithi016.stderr: -44> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2e290) adding con mode: secure 2024-09-12T17:21:03.565 INFO:tasks.workunit.client.0.smithi016.stderr: -43> 2024-09-12T17:21:03.453+0000 7f0eaafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:03.565 INFO:tasks.workunit.client.0.smithi016.stderr: -42> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:03.566 INFO:tasks.workunit.client.0.smithi016.stderr: -41> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:21:03.566 INFO:tasks.workunit.client.0.smithi016.stderr: -40> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:21:03.566 INFO:tasks.workunit.client.0.smithi016.stderr: -39> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 asok(0x55a139f612b0) register_command cache list hook 0x55a13a2305d0 2024-09-12T17:21:03.566 INFO:tasks.workunit.client.0.smithi016.stderr: -38> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 asok(0x55a139f612b0) register_command cache inspect hook 0x55a13a2305d0 2024-09-12T17:21:03.566 INFO:tasks.workunit.client.0.smithi016.stderr: -37> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 asok(0x55a139f612b0) register_command cache erase hook 0x55a13a2305d0 2024-09-12T17:21:03.566 INFO:tasks.workunit.client.0.smithi016.stderr: -36> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 asok(0x55a139f612b0) register_command cache zap hook 0x55a13a2305d0 2024-09-12T17:21:03.566 INFO:tasks.workunit.client.0.smithi016.stderr: -35> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 note: GC not initialized 2024-09-12T17:21:03.566 INFO:tasks.workunit.client.0.smithi016.stderr: -34> 2024-09-12T17:21:03.453+0000 7f0ea9fdb640 20 reqs_thread_entry: start 2024-09-12T17:21:03.566 INFO:tasks.workunit.client.0.smithi016.stderr: -33> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 asok(0x55a139f612b0) register_command sync trace show hook 0x7f0fe40ca030 2024-09-12T17:21:03.566 INFO:tasks.workunit.client.0.smithi016.stderr: -32> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 asok(0x55a139f612b0) register_command sync trace history hook 0x7f0fe40ca030 2024-09-12T17:21:03.566 INFO:tasks.workunit.client.0.smithi016.stderr: -31> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 asok(0x55a139f612b0) register_command sync trace active hook 0x7f0fe40ca030 2024-09-12T17:21:03.566 INFO:tasks.workunit.client.0.smithi016.stderr: -30> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 asok(0x55a139f612b0) register_command sync trace active_short hook 0x7f0fe40ca030 2024-09-12T17:21:03.566 INFO:tasks.workunit.client.0.smithi016.stderr: -29> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 20 init_complete bucket index max shards: 1 2024-09-12T17:21:03.566 INFO:tasks.workunit.client.0.smithi016.stderr: -28> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 20 Filter name: none 2024-09-12T17:21:03.567 INFO:tasks.workunit.client.0.smithi016.stderr: -27> 2024-09-12T17:21:03.457+0000 7f0e1b7fe640 20 reqs_thread_entry: start 2024-09-12T17:21:03.567 INFO:tasks.workunit.client.0.smithi016.stderr: -26> 2024-09-12T17:21:03.457+0000 7f0ff6b739c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T17:21:03.567 INFO:tasks.workunit.client.0.smithi016.stderr: -25> 2024-09-12T17:21:03.457+0000 7f0ff6b739c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.567 INFO:tasks.workunit.client.0.smithi016.stderr: -24> 2024-09-12T17:21:03.457+0000 7f0ff6b739c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:21:03.567 INFO:tasks.workunit.client.0.smithi016.stderr: -23> 2024-09-12T17:21:03.457+0000 7f0ff6b739c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T17:21:03.567 INFO:tasks.workunit.client.0.smithi016.stderr: -22> 2024-09-12T17:21:03.457+0000 7f0ff6b739c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T17:21:03.567 INFO:tasks.workunit.client.0.smithi016.stderr: -21> 2024-09-12T17:21:03.457+0000 7f0ff6b739c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 : miss 2024-09-12T17:21:03.567 INFO:tasks.workunit.client.0.smithi016.stderr: -20> 2024-09-12T17:21:03.457+0000 7f0ff6b739c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.567 INFO:tasks.workunit.client.0.smithi016.stderr: -19> 2024-09-12T17:21:03.457+0000 7f0ff6b739c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T17:21:03.567 INFO:tasks.workunit.client.0.smithi016.stderr: -18> 2024-09-12T17:21:03.457+0000 7f0ff6b739c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 info.flags=0x17 2024-09-12T17:21:03.567 INFO:tasks.workunit.client.0.smithi016.stderr: -17> 2024-09-12T17:21:03.457+0000 7f0ff6b739c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 to cache LRU end 2024-09-12T17:21:03.567 INFO:tasks.workunit.client.0.smithi016.stderr: -16> 2024-09-12T17:21:03.457+0000 7f0ff6b739c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:21:03.567 INFO:tasks.workunit.client.0.smithi016.stderr: -15> 2024-09-12T17:21:03.457+0000 7f0ff6b739c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:03.568 INFO:tasks.workunit.client.0.smithi016.stderr: -14> 2024-09-12T17:21:03.457+0000 7f0ff6b739c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 2024-09-12T17:21:03.568 INFO:tasks.workunit.client.0.smithi016.stderr: -13> 2024-09-12T17:21:03.469+0000 7f0ff6b739c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 info.flags=0x17 2024-09-12T17:21:03.568 INFO:tasks.workunit.client.0.smithi016.stderr: -12> 2024-09-12T17:21:03.469+0000 7f0ff6b739c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 to cache LRU end 2024-09-12T17:21:03.568 INFO:tasks.workunit.client.0.smithi016.stderr: -11> 2024-09-12T17:21:03.469+0000 7f0ff6b739c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:03.568 INFO:tasks.workunit.client.0.smithi016.stderr: -10> 2024-09-12T17:21:03.469+0000 7f0ff6b739c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36, ofs0, ns] 2024-09-12T17:21:03.568 INFO:tasks.workunit.client.0.smithi016.stderr: -9> 2024-09-12T17:21:03.469+0000 7f0ecb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431661 cookie 94150953709680 notifier 7304 bl.length()=923 2024-09-12T17:21:03.568 INFO:tasks.workunit.client.0.smithi016.stderr: -8> 2024-09-12T17:21:03.469+0000 7f0ecb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 info.flags=0x17 2024-09-12T17:21:03.568 INFO:tasks.workunit.client.0.smithi016.stderr: -7> 2024-09-12T17:21:03.469+0000 7f0ecb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 to cache LRU end 2024-09-12T17:21:03.568 INFO:tasks.workunit.client.0.smithi016.stderr: -6> 2024-09-12T17:21:03.469+0000 7f0ecb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:03.568 INFO:tasks.workunit.client.0.smithi016.stderr: -5> 2024-09-12T17:21:03.469+0000 7f0ff6b739c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36]): orig_sources= new_sources= 2024-09-12T17:21:03.568 INFO:tasks.workunit.client.0.smithi016.stderr: -4> 2024-09-12T17:21:03.469+0000 7f0ff6b739c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36]): potential sources added=[] removed=[] 2024-09-12T17:21:03.568 INFO:tasks.workunit.client.0.smithi016.stderr: -3> 2024-09-12T17:21:03.469+0000 7f0ff6b739c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36]): orig_dests= new_dests= 2024-09-12T17:21:03.568 INFO:tasks.workunit.client.0.smithi016.stderr: -2> 2024-09-12T17:21:03.469+0000 7f0ff6b739c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36]): potential dests added=[] removed=[] 2024-09-12T17:21:03.569 INFO:tasks.workunit.client.0.smithi016.stderr: -1> 2024-09-12T17:21:03.477+0000 7f0ff6b739c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0ff6b739c0 time 2024-09-12T17:21:03.476173+0000 2024-09-12T17:21:03.569 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:21:03.569 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:03.569 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:21:03.569 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f0ffa44d2eb] 2024-09-12T17:21:03.569 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0ffa44d49f] 2024-09-12T17:21:03.569 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a138d380c1] 2024-09-12T17:21:03.569 INFO:tasks.workunit.client.0.smithi016.stderr: 4: radosgw-admin(+0x14100ec) [0x55a13978e0ec] 2024-09-12T17:21:03.569 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a138d4a18d] 2024-09-12T17:21:03.569 INFO:tasks.workunit.client.0.smithi016.stderr: 6: main() 2024-09-12T17:21:03.569 INFO:tasks.workunit.client.0.smithi016.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0ff92b3d90] 2024-09-12T17:21:03.569 INFO:tasks.workunit.client.0.smithi016.stderr: 8: __libc_start_main() 2024-09-12T17:21:03.569 INFO:tasks.workunit.client.0.smithi016.stderr: 9: _start() 2024-09-12T17:21:03.570 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:03.570 INFO:tasks.workunit.client.0.smithi016.stderr: 0> 2024-09-12T17:21:03.481+0000 7f0ff6b739c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:21:03.570 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7f0ff6b739c0 thread_name:radosgw-admin 2024-09-12T17:21:03.570 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:03.570 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:21:03.570 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f0ff92cc520] 2024-09-12T17:21:03.570 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:21:03.570 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:21:03.570 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:21:03.570 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f0ffa44d345] 2024-09-12T17:21:03.570 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0ffa44d49f] 2024-09-12T17:21:03.571 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a138d380c1] 2024-09-12T17:21:03.571 INFO:tasks.workunit.client.0.smithi016.stderr: 8: radosgw-admin(+0x14100ec) [0x55a13978e0ec] 2024-09-12T17:21:03.571 INFO:tasks.workunit.client.0.smithi016.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a138d4a18d] 2024-09-12T17:21:03.571 INFO:tasks.workunit.client.0.smithi016.stderr: 10: main() 2024-09-12T17:21:03.571 INFO:tasks.workunit.client.0.smithi016.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0ff92b3d90] 2024-09-12T17:21:03.571 INFO:tasks.workunit.client.0.smithi016.stderr: 12: __libc_start_main() 2024-09-12T17:21:03.571 INFO:tasks.workunit.client.0.smithi016.stderr: 13: _start() 2024-09-12T17:21:03.571 INFO:tasks.workunit.client.0.smithi016.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:21:03.571 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:03.571 INFO:tasks.workunit.client.0.smithi016.stderr:--- logging levels --- 2024-09-12T17:21:03.571 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 none 2024-09-12T17:21:03.571 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 lockdep 2024-09-12T17:21:03.571 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 context 2024-09-12T17:21:03.572 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 crush 2024-09-12T17:21:03.572 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds 2024-09-12T17:21:03.572 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_balancer 2024-09-12T17:21:03.572 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_locker 2024-09-12T17:21:03.572 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log 2024-09-12T17:21:03.572 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log_expire 2024-09-12T17:21:03.572 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_migrator 2024-09-12T17:21:03.572 INFO:tasks.workunit.client.0.smithi016.stderr: 3/ 5 mds_quiesce 2024-09-12T17:21:03.572 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 buffer 2024-09-12T17:21:03.572 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 timer 2024-09-12T17:21:03.572 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 filer 2024-09-12T17:21:03.572 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 striper 2024-09-12T17:21:03.573 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 objecter 2024-09-12T17:21:03.573 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rados 2024-09-12T17:21:03.573 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd 2024-09-12T17:21:03.573 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_mirror 2024-09-12T17:21:03.573 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_replay 2024-09-12T17:21:03.573 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_pwl 2024-09-12T17:21:03.573 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 journaler 2024-09-12T17:21:03.573 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objectcacher 2024-09-12T17:21:03.573 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:21:03.573 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 client 2024-09-12T17:21:03.573 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 osd 2024-09-12T17:21:03.573 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 optracker 2024-09-12T17:21:03.573 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objclass 2024-09-12T17:21:03.573 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 filestore 2024-09-12T17:21:03.574 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 journal 2024-09-12T17:21:03.574 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 ms 2024-09-12T17:21:03.574 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mon 2024-09-12T17:21:03.574 INFO:tasks.workunit.client.0.smithi016.stderr: 0/10 monc 2024-09-12T17:21:03.574 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 paxos 2024-09-12T17:21:03.574 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 tp 2024-09-12T17:21:03.574 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 auth 2024-09-12T17:21:03.575 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 crypto 2024-09-12T17:21:03.575 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 finisher 2024-09-12T17:21:03.575 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 reserver 2024-09-12T17:21:03.575 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 heartbeatmap 2024-09-12T17:21:03.575 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 perfcounter 2024-09-12T17:21:03.575 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw 2024-09-12T17:21:03.576 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_sync 2024-09-12T17:21:03.576 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_datacache 2024-09-12T17:21:03.576 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_access 2024-09-12T17:21:03.576 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:21:03.576 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_flight 2024-09-12T17:21:03.576 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:21:03.577 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw_notification 2024-09-12T17:21:03.577 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 javaclient 2024-09-12T17:21:03.577 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 asok 2024-09-12T17:21:03.577 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 throttle 2024-09-12T17:21:03.577 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 refs 2024-09-12T17:21:03.577 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 compressor 2024-09-12T17:21:03.577 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluestore 2024-09-12T17:21:03.577 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluefs 2024-09-12T17:21:03.577 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 bdev 2024-09-12T17:21:03.578 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 kstore 2024-09-12T17:21:03.578 INFO:tasks.workunit.client.0.smithi016.stderr: 4/ 5 rocksdb 2024-09-12T17:21:03.578 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 fuse 2024-09-12T17:21:03.578 INFO:tasks.workunit.client.0.smithi016.stderr: 2/ 5 mgr 2024-09-12T17:21:03.578 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mgrc 2024-09-12T17:21:03.578 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 dpdk 2024-09-12T17:21:03.578 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 eventtrace 2024-09-12T17:21:03.578 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 prioritycache 2024-09-12T17:21:03.578 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 test 2024-09-12T17:21:03.578 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:21:03.578 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephsqlite 2024-09-12T17:21:03.578 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:21:03.579 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore 2024-09-12T17:21:03.579 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_onode 2024-09-12T17:21:03.579 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_odata 2024-09-12T17:21:03.579 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_omap 2024-09-12T17:21:03.579 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_tm 2024-09-12T17:21:03.579 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_t 2024-09-12T17:21:03.579 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:21:03.579 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_epm 2024-09-12T17:21:03.579 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_lba 2024-09-12T17:21:03.579 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:21:03.579 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cache 2024-09-12T17:21:03.580 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_journal 2024-09-12T17:21:03.580 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_device 2024-09-12T17:21:03.580 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_backref 2024-09-12T17:21:03.580 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 alienstore 2024-09-12T17:21:03.580 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mclock 2024-09-12T17:21:03.580 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cyanstore 2024-09-12T17:21:03.580 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 ceph_exporter 2024-09-12T17:21:03.580 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 memstore 2024-09-12T17:21:03.580 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 trace 2024-09-12T17:21:03.580 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 ceph_dedup 2024-09-12T17:21:03.580 INFO:tasks.workunit.client.0.smithi016.stderr: -2/-2 (syslog threshold) 2024-09-12T17:21:03.580 INFO:tasks.workunit.client.0.smithi016.stderr: 99/99 (stderr threshold) 2024-09-12T17:21:03.580 INFO:tasks.workunit.client.0.smithi016.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:21:03.581 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0e1b7fe640 / http_manager 2024-09-12T17:21:03.581 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0ea9fdb640 / http_manager 2024-09-12T17:21:03.581 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0eaafdd640 / rgw_dt_lg_renew 2024-09-12T17:21:03.581 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0ec9ffb640 / ms_dispatch 2024-09-12T17:21:03.581 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0ecb7fe640 / io_context_pool 2024-09-12T17:21:03.581 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0ed9ffb640 / ms_dispatch 2024-09-12T17:21:03.581 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0ee0e09640 / ms_dispatch 2024-09-12T17:21:03.581 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0ee260c640 / io_context_pool 2024-09-12T17:21:03.581 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0ff3e78640 / msgr-worker-2 2024-09-12T17:21:03.581 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0ff4679640 / msgr-worker-1 2024-09-12T17:21:03.581 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0ff4e7a640 / msgr-worker-0 2024-09-12T17:21:03.581 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0ff567b640 / io_context_pool 2024-09-12T17:21:03.581 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0ff6b739c0 / radosgw-admin 2024-09-12T17:21:03.582 INFO:tasks.workunit.client.0.smithi016.stderr: max_recent 500 2024-09-12T17:21:03.582 INFO:tasks.workunit.client.0.smithi016.stderr: max_new 1000 2024-09-12T17:21:03.582 INFO:tasks.workunit.client.0.smithi016.stderr: log_file /var/log/ceph/ceph-client.admin.124458.log 2024-09-12T17:21:03.582 INFO:tasks.workunit.client.0.smithi016.stderr:--- end dump of recent events --- 2024-09-12T17:21:03.582 INFO:tasks.workunit.client.0.smithi016.stderr:--- begin dump of recent events --- 2024-09-12T17:21:03.582 INFO:tasks.workunit.client.0.smithi016.stderr: -499> 2024-09-12T17:21:03.157+0000 7f0ee260c640 10 monclient: dump: 2024-09-12T17:21:03.582 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:21:03.582 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:21:03.582 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:03.582 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:03.582 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:21:03.582 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:03.582 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:21:03.582 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:21:03.583 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:21:03.583 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:03.583 INFO:tasks.workunit.client.0.smithi016.stderr: -498> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 5 monclient: authenticate success, global_id 7659 2024-09-12T17:21:03.583 INFO:tasks.workunit.client.0.smithi016.stderr: -497> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 10 monclient: get_monmap_and_config success 2024-09-12T17:21:03.583 INFO:tasks.workunit.client.0.smithi016.stderr: -496> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 4 set_mon_vals no callback set 2024-09-12T17:21:03.583 INFO:tasks.workunit.client.0.smithi016.stderr: -495> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 10 monclient: shutdown 2024-09-12T17:21:03.583 INFO:tasks.workunit.client.0.smithi016.stderr: -494> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 5 asok(0x55a139f612b0) unregister_commands rotate-key 2024-09-12T17:21:03.583 INFO:tasks.workunit.client.0.smithi016.stderr: -493> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 10 monclient: build_initial_monmap 2024-09-12T17:21:03.583 INFO:tasks.workunit.client.0.smithi016.stderr: -492> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 1 build_initial for_mkfs: 0 2024-09-12T17:21:03.583 INFO:tasks.workunit.client.0.smithi016.stderr: -491> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 10 monclient: monmap: 2024-09-12T17:21:03.583 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:21:03.583 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:21:03.583 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:21:03.584 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:21:03.584 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:21:03.584 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:03.584 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:21:03.584 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:21:03.584 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:21:03.584 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:03.584 INFO:tasks.workunit.client.0.smithi016.stderr: -490> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a173860) adding auth protocol: cephx 2024-09-12T17:21:03.584 INFO:tasks.workunit.client.0.smithi016.stderr: -489> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a173860) adding auth protocol: cephx 2024-09-12T17:21:03.584 INFO:tasks.workunit.client.0.smithi016.stderr: -488> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a173860) adding auth protocol: cephx 2024-09-12T17:21:03.584 INFO:tasks.workunit.client.0.smithi016.stderr: -487> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a173860) adding con mode: secure 2024-09-12T17:21:03.584 INFO:tasks.workunit.client.0.smithi016.stderr: -486> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a173860) adding con mode: crc 2024-09-12T17:21:03.584 INFO:tasks.workunit.client.0.smithi016.stderr: -485> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a173860) adding con mode: secure 2024-09-12T17:21:03.585 INFO:tasks.workunit.client.0.smithi016.stderr: -484> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a173860) adding con mode: crc 2024-09-12T17:21:03.585 INFO:tasks.workunit.client.0.smithi016.stderr: -483> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a173860) adding con mode: secure 2024-09-12T17:21:03.585 INFO:tasks.workunit.client.0.smithi016.stderr: -482> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a173860) adding con mode: crc 2024-09-12T17:21:03.585 INFO:tasks.workunit.client.0.smithi016.stderr: -481> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a173860) adding con mode: crc 2024-09-12T17:21:03.585 INFO:tasks.workunit.client.0.smithi016.stderr: -480> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a173860) adding con mode: secure 2024-09-12T17:21:03.585 INFO:tasks.workunit.client.0.smithi016.stderr: -479> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a173860) adding con mode: crc 2024-09-12T17:21:03.585 INFO:tasks.workunit.client.0.smithi016.stderr: -478> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a173860) adding con mode: secure 2024-09-12T17:21:03.585 INFO:tasks.workunit.client.0.smithi016.stderr: -477> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a173860) adding con mode: crc 2024-09-12T17:21:03.585 INFO:tasks.workunit.client.0.smithi016.stderr: -476> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a173860) adding con mode: secure 2024-09-12T17:21:03.585 INFO:tasks.workunit.client.0.smithi016.stderr: -475> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:03.585 INFO:tasks.workunit.client.0.smithi016.stderr: -474> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 1 librados: starting msgr at 2024-09-12T17:21:03.586 INFO:tasks.workunit.client.0.smithi016.stderr: -473> 2024-09-12T17:21:03.157+0000 7f0ff6b739c0 1 librados: starting objecter 2024-09-12T17:21:03.586 INFO:tasks.workunit.client.0.smithi016.stderr: -472> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 5 asok(0x55a139f612b0) register_command objecter_requests hook 0x55a13a172d10 2024-09-12T17:21:03.586 INFO:tasks.workunit.client.0.smithi016.stderr: -471> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 1 librados: setting wanted keys 2024-09-12T17:21:03.586 INFO:tasks.workunit.client.0.smithi016.stderr: -470> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 1 librados: calling monclient init 2024-09-12T17:21:03.586 INFO:tasks.workunit.client.0.smithi016.stderr: -469> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 10 monclient: init 2024-09-12T17:21:03.586 INFO:tasks.workunit.client.0.smithi016.stderr: -468> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a16e020) adding auth protocol: cephx 2024-09-12T17:21:03.586 INFO:tasks.workunit.client.0.smithi016.stderr: -467> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a16e020) adding auth protocol: cephx 2024-09-12T17:21:03.586 INFO:tasks.workunit.client.0.smithi016.stderr: -466> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a16e020) adding auth protocol: cephx 2024-09-12T17:21:03.586 INFO:tasks.workunit.client.0.smithi016.stderr: -465> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a16e020) adding con mode: secure 2024-09-12T17:21:03.586 INFO:tasks.workunit.client.0.smithi016.stderr: -464> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a16e020) adding con mode: crc 2024-09-12T17:21:03.586 INFO:tasks.workunit.client.0.smithi016.stderr: -463> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a16e020) adding con mode: secure 2024-09-12T17:21:03.587 INFO:tasks.workunit.client.0.smithi016.stderr: -462> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a16e020) adding con mode: crc 2024-09-12T17:21:03.587 INFO:tasks.workunit.client.0.smithi016.stderr: -461> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a16e020) adding con mode: secure 2024-09-12T17:21:03.587 INFO:tasks.workunit.client.0.smithi016.stderr: -460> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a16e020) adding con mode: crc 2024-09-12T17:21:03.587 INFO:tasks.workunit.client.0.smithi016.stderr: -459> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a16e020) adding con mode: crc 2024-09-12T17:21:03.587 INFO:tasks.workunit.client.0.smithi016.stderr: -458> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a16e020) adding con mode: secure 2024-09-12T17:21:03.587 INFO:tasks.workunit.client.0.smithi016.stderr: -457> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a16e020) adding con mode: crc 2024-09-12T17:21:03.587 INFO:tasks.workunit.client.0.smithi016.stderr: -456> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a16e020) adding con mode: secure 2024-09-12T17:21:03.587 INFO:tasks.workunit.client.0.smithi016.stderr: -455> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a16e020) adding con mode: crc 2024-09-12T17:21:03.587 INFO:tasks.workunit.client.0.smithi016.stderr: -454> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a16e020) adding con mode: secure 2024-09-12T17:21:03.587 INFO:tasks.workunit.client.0.smithi016.stderr: -453> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:03.587 INFO:tasks.workunit.client.0.smithi016.stderr: -452> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:03.587 INFO:tasks.workunit.client.0.smithi016.stderr: -451> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 5 asok(0x55a139f612b0) register_command rotate-key hook 0x55a13a16e168 2024-09-12T17:21:03.588 INFO:tasks.workunit.client.0.smithi016.stderr: -450> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 10 monclient: _reopen_session rank -1 2024-09-12T17:21:03.588 INFO:tasks.workunit.client.0.smithi016.stderr: -449> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:21:03.588 INFO:tasks.workunit.client.0.smithi016.stderr: -448> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 10 monclient(hunting): picked mon.noname-a con 0x55a13a0295b0 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:21:03.588 INFO:tasks.workunit.client.0.smithi016.stderr: -447> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 10 monclient(hunting): picked mon.noname-b con 0x55a13a0b3660 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:21:03.588 INFO:tasks.workunit.client.0.smithi016.stderr: -446> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 10 monclient(hunting): picked mon.noname-c con 0x55a13a0b6720 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:21:03.588 INFO:tasks.workunit.client.0.smithi016.stderr: -445> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:03.588 INFO:tasks.workunit.client.0.smithi016.stderr: -444> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:03.588 INFO:tasks.workunit.client.0.smithi016.stderr: -443> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:03.588 INFO:tasks.workunit.client.0.smithi016.stderr: -442> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 10 monclient(hunting): _renew_subs 2024-09-12T17:21:03.588 INFO:tasks.workunit.client.0.smithi016.stderr: -441> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 10 monclient(hunting): authenticate will time out at 2381.136828s 2024-09-12T17:21:03.588 INFO:tasks.workunit.client.0.smithi016.stderr: -440> 2024-09-12T17:21:03.161+0000 7f0ff4e7a640 10 monclient(hunting): get_auth_request con 0x55a13a0b6720 auth_method 0 2024-09-12T17:21:03.588 INFO:tasks.workunit.client.0.smithi016.stderr: -439> 2024-09-12T17:21:03.161+0000 7f0ff4e7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:21:03.588 INFO:tasks.workunit.client.0.smithi016.stderr: -438> 2024-09-12T17:21:03.161+0000 7f0ff4e7a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:21:03.589 INFO:tasks.workunit.client.0.smithi016.stderr: -437> 2024-09-12T17:21:03.161+0000 7f0ff4e7a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:21:03.589 INFO:tasks.workunit.client.0.smithi016.stderr: -436> 2024-09-12T17:21:03.161+0000 7f0ff4679640 10 monclient(hunting): get_auth_request con 0x55a13a0295b0 auth_method 0 2024-09-12T17:21:03.589 INFO:tasks.workunit.client.0.smithi016.stderr: -435> 2024-09-12T17:21:03.161+0000 7f0ff4679640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:21:03.589 INFO:tasks.workunit.client.0.smithi016.stderr: -434> 2024-09-12T17:21:03.161+0000 7f0ff4679640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:21:03.589 INFO:tasks.workunit.client.0.smithi016.stderr: -433> 2024-09-12T17:21:03.161+0000 7f0ff4679640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:21:03.589 INFO:tasks.workunit.client.0.smithi016.stderr: -432> 2024-09-12T17:21:03.161+0000 7f0ff4e7a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:21:03.589 INFO:tasks.workunit.client.0.smithi016.stderr: -431> 2024-09-12T17:21:03.161+0000 7f0ff4e7a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:21:03.589 INFO:tasks.workunit.client.0.smithi016.stderr: -430> 2024-09-12T17:21:03.161+0000 7f0ff4e7a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:21:03.589 INFO:tasks.workunit.client.0.smithi016.stderr: -429> 2024-09-12T17:21:03.161+0000 7f0ff4679640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:21:03.589 INFO:tasks.workunit.client.0.smithi016.stderr: -428> 2024-09-12T17:21:03.161+0000 7f0ff4679640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:21:03.589 INFO:tasks.workunit.client.0.smithi016.stderr: -427> 2024-09-12T17:21:03.161+0000 7f0ff4679640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:21:03.589 INFO:tasks.workunit.client.0.smithi016.stderr: -426> 2024-09-12T17:21:03.161+0000 7f0ff3e78640 10 monclient(hunting): get_auth_request con 0x55a13a0b3660 auth_method 0 2024-09-12T17:21:03.589 INFO:tasks.workunit.client.0.smithi016.stderr: -425> 2024-09-12T17:21:03.161+0000 7f0ff3e78640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:21:03.590 INFO:tasks.workunit.client.0.smithi016.stderr: -424> 2024-09-12T17:21:03.161+0000 7f0ff3e78640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:21:03.590 INFO:tasks.workunit.client.0.smithi016.stderr: -423> 2024-09-12T17:21:03.161+0000 7f0ff3e78640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:21:03.590 INFO:tasks.workunit.client.0.smithi016.stderr: -422> 2024-09-12T17:21:03.161+0000 7f0ff4e7a640 10 monclient(hunting): handle_auth_done global_id 7295 payload 824 2024-09-12T17:21:03.590 INFO:tasks.workunit.client.0.smithi016.stderr: -421> 2024-09-12T17:21:03.161+0000 7f0ff4e7a640 10 monclient: _finish_hunting 0 2024-09-12T17:21:03.590 INFO:tasks.workunit.client.0.smithi016.stderr: -420> 2024-09-12T17:21:03.161+0000 7f0ff4e7a640 1 monclient: found mon.noname-c 2024-09-12T17:21:03.590 INFO:tasks.workunit.client.0.smithi016.stderr: -419> 2024-09-12T17:21:03.161+0000 7f0ff4e7a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:21:03.590 INFO:tasks.workunit.client.0.smithi016.stderr: -418> 2024-09-12T17:21:03.161+0000 7f0ee0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:21:03.590 INFO:tasks.workunit.client.0.smithi016.stderr: -417> 2024-09-12T17:21:03.161+0000 7f0ee0e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:21:03.590 INFO:tasks.workunit.client.0.smithi016.stderr: -416> 2024-09-12T17:21:03.161+0000 7f0ee0e09640 10 monclient: dump: 2024-09-12T17:21:03.590 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:21:03.590 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:21:03.590 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:03.590 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:03.590 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:21:03.591 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:03.591 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:21:03.591 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:21:03.591 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:21:03.591 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:03.591 INFO:tasks.workunit.client.0.smithi016.stderr: -415> 2024-09-12T17:21:03.161+0000 7f0ee0e09640 10 monclient: _finish_auth 0 2024-09-12T17:21:03.591 INFO:tasks.workunit.client.0.smithi016.stderr: -414> 2024-09-12T17:21:03.161+0000 7f0ee0e09640 10 monclient: _check_auth_tickets 2024-09-12T17:21:03.591 INFO:tasks.workunit.client.0.smithi016.stderr: -413> 2024-09-12T17:21:03.161+0000 7f0ee0e09640 10 monclient: handle_config config(0 keys) 2024-09-12T17:21:03.591 INFO:tasks.workunit.client.0.smithi016.stderr: -412> 2024-09-12T17:21:03.161+0000 7f0ee0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:21:03.591 INFO:tasks.workunit.client.0.smithi016.stderr: -411> 2024-09-12T17:21:03.161+0000 7f0ee0e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:21:03.591 INFO:tasks.workunit.client.0.smithi016.stderr: -410> 2024-09-12T17:21:03.161+0000 7f0ee0e09640 10 monclient: dump: 2024-09-12T17:21:03.591 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:21:03.591 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:21:03.592 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:03.592 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:03.592 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:21:03.592 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:03.592 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:21:03.592 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:21:03.592 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:21:03.592 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:03.592 INFO:tasks.workunit.client.0.smithi016.stderr: -409> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 5 monclient: authenticate success, global_id 7295 2024-09-12T17:21:03.592 INFO:tasks.workunit.client.0.smithi016.stderr: -408> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 10 monclient: _renew_subs 2024-09-12T17:21:03.592 INFO:tasks.workunit.client.0.smithi016.stderr: -407> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:21:03.592 INFO:tasks.workunit.client.0.smithi016.stderr: -406> 2024-09-12T17:21:03.161+0000 7f0ee260c640 4 set_mon_vals no callback set 2024-09-12T17:21:03.592 INFO:tasks.workunit.client.0.smithi016.stderr: -405> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 10 monclient: _renew_subs 2024-09-12T17:21:03.593 INFO:tasks.workunit.client.0.smithi016.stderr: -404> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:21:03.593 INFO:tasks.workunit.client.0.smithi016.stderr: -403> 2024-09-12T17:21:03.161+0000 7f0ff6b739c0 1 librados: init done 2024-09-12T17:21:03.593 INFO:tasks.workunit.client.0.smithi016.stderr: -402> 2024-09-12T17:21:03.165+0000 7f0ee0e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:21:03.593 INFO:tasks.workunit.client.0.smithi016.stderr: -401> 2024-09-12T17:21:03.165+0000 7f0ee0e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:21:03.593 INFO:tasks.workunit.client.0.smithi016.stderr: -400> 2024-09-12T17:21:03.165+0000 7f0ee0e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:21:03.593 INFO:tasks.workunit.client.0.smithi016.stderr: -399> 2024-09-12T17:21:03.165+0000 7f0ff4679640 10 monclient: get_auth_request con 0x7f0edc070b10 auth_method 0 2024-09-12T17:21:03.593 INFO:tasks.workunit.client.0.smithi016.stderr: -398> 2024-09-12T17:21:03.165+0000 7f0ff3e78640 10 monclient: get_auth_request con 0x55a13a1b5eb0 auth_method 0 2024-09-12T17:21:03.593 INFO:tasks.workunit.client.0.smithi016.stderr: -397> 2024-09-12T17:21:03.165+0000 7f0ff4679640 10 monclient: get_auth_request con 0x55a13a1b9090 auth_method 0 2024-09-12T17:21:03.593 INFO:tasks.workunit.client.0.smithi016.stderr: -396> 2024-09-12T17:21:03.169+0000 7f0ff3e78640 10 monclient: get_auth_request con 0x55a13a1bd280 auth_method 0 2024-09-12T17:21:03.593 INFO:tasks.workunit.client.0.smithi016.stderr: -395> 2024-09-12T17:21:03.169+0000 7f0ff4e7a640 10 monclient: get_auth_request con 0x55a13a1c0f60 auth_method 0 2024-09-12T17:21:03.593 INFO:tasks.workunit.client.0.smithi016.stderr: -394> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 10 monclient: build_initial_monmap 2024-09-12T17:21:03.593 INFO:tasks.workunit.client.0.smithi016.stderr: -393> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 1 build_initial for_mkfs: 0 2024-09-12T17:21:03.593 INFO:tasks.workunit.client.0.smithi016.stderr: -392> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 10 monclient: monmap: 2024-09-12T17:21:03.593 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:21:03.594 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:21:03.594 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:21:03.594 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:21:03.594 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:21:03.594 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:03.594 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:21:03.594 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:21:03.594 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:21:03.594 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:03.594 INFO:tasks.workunit.client.0.smithi016.stderr: -391> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c50e0) adding auth protocol: cephx 2024-09-12T17:21:03.594 INFO:tasks.workunit.client.0.smithi016.stderr: -390> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c50e0) adding auth protocol: cephx 2024-09-12T17:21:03.594 INFO:tasks.workunit.client.0.smithi016.stderr: -389> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c50e0) adding auth protocol: cephx 2024-09-12T17:21:03.594 INFO:tasks.workunit.client.0.smithi016.stderr: -388> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c50e0) adding con mode: secure 2024-09-12T17:21:03.595 INFO:tasks.workunit.client.0.smithi016.stderr: -387> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c50e0) adding con mode: crc 2024-09-12T17:21:03.595 INFO:tasks.workunit.client.0.smithi016.stderr: -386> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c50e0) adding con mode: secure 2024-09-12T17:21:03.595 INFO:tasks.workunit.client.0.smithi016.stderr: -385> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c50e0) adding con mode: crc 2024-09-12T17:21:03.595 INFO:tasks.workunit.client.0.smithi016.stderr: -384> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c50e0) adding con mode: secure 2024-09-12T17:21:03.595 INFO:tasks.workunit.client.0.smithi016.stderr: -383> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c50e0) adding con mode: crc 2024-09-12T17:21:03.595 INFO:tasks.workunit.client.0.smithi016.stderr: -382> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c50e0) adding con mode: crc 2024-09-12T17:21:03.595 INFO:tasks.workunit.client.0.smithi016.stderr: -381> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c50e0) adding con mode: secure 2024-09-12T17:21:03.595 INFO:tasks.workunit.client.0.smithi016.stderr: -380> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c50e0) adding con mode: crc 2024-09-12T17:21:03.595 INFO:tasks.workunit.client.0.smithi016.stderr: -379> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c50e0) adding con mode: secure 2024-09-12T17:21:03.595 INFO:tasks.workunit.client.0.smithi016.stderr: -378> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c50e0) adding con mode: crc 2024-09-12T17:21:03.595 INFO:tasks.workunit.client.0.smithi016.stderr: -377> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c50e0) adding con mode: secure 2024-09-12T17:21:03.595 INFO:tasks.workunit.client.0.smithi016.stderr: -376> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:03.595 INFO:tasks.workunit.client.0.smithi016.stderr: -375> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 asok(0x55a139f612b0) register_command objecter_requests cmddesc objecter_requests hook 0x55a13a1c8a60 EEXIST 2024-09-12T17:21:03.596 INFO:tasks.workunit.client.0.smithi016.stderr: -374> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 10 monclient: init 2024-09-12T17:21:03.596 INFO:tasks.workunit.client.0.smithi016.stderr: -373> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c3f88) adding auth protocol: cephx 2024-09-12T17:21:03.596 INFO:tasks.workunit.client.0.smithi016.stderr: -372> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c3f88) adding auth protocol: cephx 2024-09-12T17:21:03.596 INFO:tasks.workunit.client.0.smithi016.stderr: -371> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c3f88) adding auth protocol: cephx 2024-09-12T17:21:03.596 INFO:tasks.workunit.client.0.smithi016.stderr: -370> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c3f88) adding con mode: secure 2024-09-12T17:21:03.596 INFO:tasks.workunit.client.0.smithi016.stderr: -369> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c3f88) adding con mode: crc 2024-09-12T17:21:03.596 INFO:tasks.workunit.client.0.smithi016.stderr: -368> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c3f88) adding con mode: secure 2024-09-12T17:21:03.596 INFO:tasks.workunit.client.0.smithi016.stderr: -367> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c3f88) adding con mode: crc 2024-09-12T17:21:03.596 INFO:tasks.workunit.client.0.smithi016.stderr: -366> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c3f88) adding con mode: secure 2024-09-12T17:21:03.596 INFO:tasks.workunit.client.0.smithi016.stderr: -365> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c3f88) adding con mode: crc 2024-09-12T17:21:03.596 INFO:tasks.workunit.client.0.smithi016.stderr: -364> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c3f88) adding con mode: crc 2024-09-12T17:21:03.596 INFO:tasks.workunit.client.0.smithi016.stderr: -363> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c3f88) adding con mode: secure 2024-09-12T17:21:03.596 INFO:tasks.workunit.client.0.smithi016.stderr: -362> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c3f88) adding con mode: crc 2024-09-12T17:21:03.596 INFO:tasks.workunit.client.0.smithi016.stderr: -361> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c3f88) adding con mode: secure 2024-09-12T17:21:03.597 INFO:tasks.workunit.client.0.smithi016.stderr: -360> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c3f88) adding con mode: crc 2024-09-12T17:21:03.597 INFO:tasks.workunit.client.0.smithi016.stderr: -359> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1c3f88) adding con mode: secure 2024-09-12T17:21:03.597 INFO:tasks.workunit.client.0.smithi016.stderr: -358> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:03.597 INFO:tasks.workunit.client.0.smithi016.stderr: -357> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:03.597 INFO:tasks.workunit.client.0.smithi016.stderr: -356> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 asok(0x55a139f612b0) register_command rotate-key cmddesc rotate-key hook 0x55a13a1c40d0 EEXIST 2024-09-12T17:21:03.597 INFO:tasks.workunit.client.0.smithi016.stderr: -355> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 10 monclient: _reopen_session rank -1 2024-09-12T17:21:03.597 INFO:tasks.workunit.client.0.smithi016.stderr: -354> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:21:03.597 INFO:tasks.workunit.client.0.smithi016.stderr: -353> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 10 monclient(hunting): picked mon.noname-c con 0x55a13a1ecc10 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:21:03.597 INFO:tasks.workunit.client.0.smithi016.stderr: -352> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 10 monclient(hunting): picked mon.noname-b con 0x55a13a1ec540 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:21:03.597 INFO:tasks.workunit.client.0.smithi016.stderr: -351> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 10 monclient(hunting): picked mon.noname-a con 0x55a13a1eaf20 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:21:03.597 INFO:tasks.workunit.client.0.smithi016.stderr: -350> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:03.597 INFO:tasks.workunit.client.0.smithi016.stderr: -349> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:03.598 INFO:tasks.workunit.client.0.smithi016.stderr: -348> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:03.598 INFO:tasks.workunit.client.0.smithi016.stderr: -347> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 10 monclient(hunting): _renew_subs 2024-09-12T17:21:03.598 INFO:tasks.workunit.client.0.smithi016.stderr: -346> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 10 monclient(hunting): authenticate will time out at 2381.149699s 2024-09-12T17:21:03.598 INFO:tasks.workunit.client.0.smithi016.stderr: -345> 2024-09-12T17:21:03.173+0000 7f0ff3e78640 10 monclient(hunting): get_auth_request con 0x55a13a1ecc10 auth_method 0 2024-09-12T17:21:03.598 INFO:tasks.workunit.client.0.smithi016.stderr: -344> 2024-09-12T17:21:03.173+0000 7f0ff3e78640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:21:03.598 INFO:tasks.workunit.client.0.smithi016.stderr: -343> 2024-09-12T17:21:03.173+0000 7f0ff3e78640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:21:03.598 INFO:tasks.workunit.client.0.smithi016.stderr: -342> 2024-09-12T17:21:03.173+0000 7f0ff3e78640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:21:03.598 INFO:tasks.workunit.client.0.smithi016.stderr: -341> 2024-09-12T17:21:03.173+0000 7f0ff4679640 10 monclient(hunting): get_auth_request con 0x55a13a1eaf20 auth_method 0 2024-09-12T17:21:03.598 INFO:tasks.workunit.client.0.smithi016.stderr: -340> 2024-09-12T17:21:03.173+0000 7f0ff4679640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:21:03.598 INFO:tasks.workunit.client.0.smithi016.stderr: -339> 2024-09-12T17:21:03.173+0000 7f0ff4679640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:21:03.598 INFO:tasks.workunit.client.0.smithi016.stderr: -338> 2024-09-12T17:21:03.173+0000 7f0ff4679640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:21:03.598 INFO:tasks.workunit.client.0.smithi016.stderr: -337> 2024-09-12T17:21:03.173+0000 7f0ff4679640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:21:03.598 INFO:tasks.workunit.client.0.smithi016.stderr: -336> 2024-09-12T17:21:03.173+0000 7f0ff4679640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:21:03.598 INFO:tasks.workunit.client.0.smithi016.stderr: -335> 2024-09-12T17:21:03.173+0000 7f0ff4679640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:21:03.599 INFO:tasks.workunit.client.0.smithi016.stderr: -334> 2024-09-12T17:21:03.173+0000 7f0ff4e7a640 10 monclient(hunting): get_auth_request con 0x55a13a1ec540 auth_method 0 2024-09-12T17:21:03.599 INFO:tasks.workunit.client.0.smithi016.stderr: -333> 2024-09-12T17:21:03.173+0000 7f0ff4e7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:21:03.599 INFO:tasks.workunit.client.0.smithi016.stderr: -332> 2024-09-12T17:21:03.173+0000 7f0ff4e7a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:21:03.599 INFO:tasks.workunit.client.0.smithi016.stderr: -331> 2024-09-12T17:21:03.173+0000 7f0ff4e7a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:21:03.599 INFO:tasks.workunit.client.0.smithi016.stderr: -330> 2024-09-12T17:21:03.173+0000 7f0ff3e78640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:21:03.599 INFO:tasks.workunit.client.0.smithi016.stderr: -329> 2024-09-12T17:21:03.173+0000 7f0ff3e78640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:21:03.599 INFO:tasks.workunit.client.0.smithi016.stderr: -328> 2024-09-12T17:21:03.173+0000 7f0ff3e78640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:21:03.599 INFO:tasks.workunit.client.0.smithi016.stderr: -327> 2024-09-12T17:21:03.173+0000 7f0ff4e7a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:21:03.599 INFO:tasks.workunit.client.0.smithi016.stderr: -326> 2024-09-12T17:21:03.173+0000 7f0ff4e7a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:21:03.599 INFO:tasks.workunit.client.0.smithi016.stderr: -325> 2024-09-12T17:21:03.173+0000 7f0ff4e7a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:21:03.599 INFO:tasks.workunit.client.0.smithi016.stderr: -324> 2024-09-12T17:21:03.173+0000 7f0ff4679640 10 monclient(hunting): handle_auth_done global_id 7665 payload 824 2024-09-12T17:21:03.599 INFO:tasks.workunit.client.0.smithi016.stderr: -323> 2024-09-12T17:21:03.173+0000 7f0ff4679640 10 monclient: _finish_hunting 0 2024-09-12T17:21:03.599 INFO:tasks.workunit.client.0.smithi016.stderr: -322> 2024-09-12T17:21:03.173+0000 7f0ff4679640 1 monclient: found mon.noname-a 2024-09-12T17:21:03.600 INFO:tasks.workunit.client.0.smithi016.stderr: -321> 2024-09-12T17:21:03.173+0000 7f0ff4679640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:21:03.600 INFO:tasks.workunit.client.0.smithi016.stderr: -320> 2024-09-12T17:21:03.173+0000 7f0ed9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:21:03.600 INFO:tasks.workunit.client.0.smithi016.stderr: -319> 2024-09-12T17:21:03.173+0000 7f0ed9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:21:03.600 INFO:tasks.workunit.client.0.smithi016.stderr: -318> 2024-09-12T17:21:03.173+0000 7f0ed9ffb640 10 monclient: dump: 2024-09-12T17:21:03.600 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:21:03.600 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:21:03.600 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:03.600 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:03.600 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:21:03.600 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:03.600 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:21:03.600 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:21:03.600 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:21:03.601 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:03.601 INFO:tasks.workunit.client.0.smithi016.stderr: -317> 2024-09-12T17:21:03.173+0000 7f0ed9ffb640 10 monclient: _finish_auth 0 2024-09-12T17:21:03.601 INFO:tasks.workunit.client.0.smithi016.stderr: -316> 2024-09-12T17:21:03.173+0000 7f0ed9ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:21:03.601 INFO:tasks.workunit.client.0.smithi016.stderr: -315> 2024-09-12T17:21:03.173+0000 7f0ed9ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:21:03.601 INFO:tasks.workunit.client.0.smithi016.stderr: -314> 2024-09-12T17:21:03.173+0000 7f0ed9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:21:03.601 INFO:tasks.workunit.client.0.smithi016.stderr: -313> 2024-09-12T17:21:03.173+0000 7f0ed9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:21:03.601 INFO:tasks.workunit.client.0.smithi016.stderr: -312> 2024-09-12T17:21:03.173+0000 7f0ed9ffb640 10 monclient: dump: 2024-09-12T17:21:03.601 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:21:03.601 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:21:03.601 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:03.601 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:03.601 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:21:03.601 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:03.602 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:21:03.602 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:21:03.602 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:21:03.602 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:03.602 INFO:tasks.workunit.client.0.smithi016.stderr: -311> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 5 monclient: authenticate success, global_id 7665 2024-09-12T17:21:03.602 INFO:tasks.workunit.client.0.smithi016.stderr: -310> 2024-09-12T17:21:03.173+0000 7f0ff567b640 4 set_mon_vals no callback set 2024-09-12T17:21:03.602 INFO:tasks.workunit.client.0.smithi016.stderr: -309> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 10 monclient: _renew_subs 2024-09-12T17:21:03.603 INFO:tasks.workunit.client.0.smithi016.stderr: -308> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:21:03.603 INFO:tasks.workunit.client.0.smithi016.stderr: -307> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 10 monclient: _renew_subs 2024-09-12T17:21:03.603 INFO:tasks.workunit.client.0.smithi016.stderr: -306> 2024-09-12T17:21:03.173+0000 7f0ff6b739c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:21:03.603 INFO:tasks.workunit.client.0.smithi016.stderr: -305> 2024-09-12T17:21:03.177+0000 7f0ed9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:21:03.603 INFO:tasks.workunit.client.0.smithi016.stderr: -304> 2024-09-12T17:21:03.177+0000 7f0ed9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:21:03.603 INFO:tasks.workunit.client.0.smithi016.stderr: -303> 2024-09-12T17:21:03.177+0000 7f0ed9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:21:03.604 INFO:tasks.workunit.client.0.smithi016.stderr: -302> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 10 monclient: get_monmap_and_config 2024-09-12T17:21:03.604 INFO:tasks.workunit.client.0.smithi016.stderr: -301> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 10 monclient: build_initial_monmap 2024-09-12T17:21:03.604 INFO:tasks.workunit.client.0.smithi016.stderr: -300> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 1 build_initial for_mkfs: 0 2024-09-12T17:21:03.604 INFO:tasks.workunit.client.0.smithi016.stderr: -299> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 10 monclient: monmap: 2024-09-12T17:21:03.604 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:21:03.604 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:21:03.604 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:21:03.605 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:21:03.605 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:21:03.605 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:03.605 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:21:03.605 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:21:03.605 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:21:03.606 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:03.606 INFO:tasks.workunit.client.0.smithi016.stderr: -298> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a20c390) adding auth protocol: cephx 2024-09-12T17:21:03.606 INFO:tasks.workunit.client.0.smithi016.stderr: -297> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a20c390) adding auth protocol: cephx 2024-09-12T17:21:03.606 INFO:tasks.workunit.client.0.smithi016.stderr: -296> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a20c390) adding auth protocol: cephx 2024-09-12T17:21:03.606 INFO:tasks.workunit.client.0.smithi016.stderr: -295> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a20c390) adding con mode: secure 2024-09-12T17:21:03.606 INFO:tasks.workunit.client.0.smithi016.stderr: -294> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a20c390) adding con mode: crc 2024-09-12T17:21:03.607 INFO:tasks.workunit.client.0.smithi016.stderr: -293> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a20c390) adding con mode: secure 2024-09-12T17:21:03.607 INFO:tasks.workunit.client.0.smithi016.stderr: -292> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a20c390) adding con mode: crc 2024-09-12T17:21:03.607 INFO:tasks.workunit.client.0.smithi016.stderr: -291> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a20c390) adding con mode: secure 2024-09-12T17:21:03.607 INFO:tasks.workunit.client.0.smithi016.stderr: -290> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a20c390) adding con mode: crc 2024-09-12T17:21:03.607 INFO:tasks.workunit.client.0.smithi016.stderr: -289> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a20c390) adding con mode: crc 2024-09-12T17:21:03.607 INFO:tasks.workunit.client.0.smithi016.stderr: -288> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a20c390) adding con mode: secure 2024-09-12T17:21:03.608 INFO:tasks.workunit.client.0.smithi016.stderr: -287> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a20c390) adding con mode: crc 2024-09-12T17:21:03.608 INFO:tasks.workunit.client.0.smithi016.stderr: -286> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a20c390) adding con mode: secure 2024-09-12T17:21:03.608 INFO:tasks.workunit.client.0.smithi016.stderr: -285> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a20c390) adding con mode: crc 2024-09-12T17:21:03.608 INFO:tasks.workunit.client.0.smithi016.stderr: -284> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a20c390) adding con mode: secure 2024-09-12T17:21:03.608 INFO:tasks.workunit.client.0.smithi016.stderr: -283> 2024-09-12T17:21:03.177+0000 7f0ff3e78640 10 monclient: get_auth_request con 0x7f0ecc070a20 auth_method 0 2024-09-12T17:21:03.608 INFO:tasks.workunit.client.0.smithi016.stderr: -282> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:03.609 INFO:tasks.workunit.client.0.smithi016.stderr: -281> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 10 monclient: init 2024-09-12T17:21:03.609 INFO:tasks.workunit.client.0.smithi016.stderr: -280> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2ddc0) adding auth protocol: cephx 2024-09-12T17:21:03.609 INFO:tasks.workunit.client.0.smithi016.stderr: -279> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2ddc0) adding auth protocol: cephx 2024-09-12T17:21:03.609 INFO:tasks.workunit.client.0.smithi016.stderr: -278> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2ddc0) adding auth protocol: cephx 2024-09-12T17:21:03.609 INFO:tasks.workunit.client.0.smithi016.stderr: -277> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2ddc0) adding con mode: secure 2024-09-12T17:21:03.609 INFO:tasks.workunit.client.0.smithi016.stderr: -276> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2ddc0) adding con mode: crc 2024-09-12T17:21:03.610 INFO:tasks.workunit.client.0.smithi016.stderr: -275> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2ddc0) adding con mode: secure 2024-09-12T17:21:03.610 INFO:tasks.workunit.client.0.smithi016.stderr: -274> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2ddc0) adding con mode: crc 2024-09-12T17:21:03.610 INFO:tasks.workunit.client.0.smithi016.stderr: -273> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2ddc0) adding con mode: secure 2024-09-12T17:21:03.610 INFO:tasks.workunit.client.0.smithi016.stderr: -272> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2ddc0) adding con mode: crc 2024-09-12T17:21:03.610 INFO:tasks.workunit.client.0.smithi016.stderr: -271> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2ddc0) adding con mode: crc 2024-09-12T17:21:03.610 INFO:tasks.workunit.client.0.smithi016.stderr: -270> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2ddc0) adding con mode: secure 2024-09-12T17:21:03.611 INFO:tasks.workunit.client.0.smithi016.stderr: -269> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2ddc0) adding con mode: crc 2024-09-12T17:21:03.611 INFO:tasks.workunit.client.0.smithi016.stderr: -268> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2ddc0) adding con mode: secure 2024-09-12T17:21:03.611 INFO:tasks.workunit.client.0.smithi016.stderr: -267> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2ddc0) adding con mode: crc 2024-09-12T17:21:03.611 INFO:tasks.workunit.client.0.smithi016.stderr: -266> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2ddc0) adding con mode: secure 2024-09-12T17:21:03.611 INFO:tasks.workunit.client.0.smithi016.stderr: -265> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:03.611 INFO:tasks.workunit.client.0.smithi016.stderr: -264> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:03.612 INFO:tasks.workunit.client.0.smithi016.stderr: -263> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 asok(0x55a139f612b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd02d2df08 EEXIST 2024-09-12T17:21:03.612 INFO:tasks.workunit.client.0.smithi016.stderr: -262> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 10 monclient: _reopen_session rank -1 2024-09-12T17:21:03.612 INFO:tasks.workunit.client.0.smithi016.stderr: -261> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:21:03.612 INFO:tasks.workunit.client.0.smithi016.stderr: -260> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 10 monclient(hunting): picked mon.noname-c con 0x55a13a240810 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:21:03.612 INFO:tasks.workunit.client.0.smithi016.stderr: -259> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 10 monclient(hunting): picked mon.noname-b con 0x55a13a210230 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:21:03.613 INFO:tasks.workunit.client.0.smithi016.stderr: -258> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 10 monclient(hunting): picked mon.noname-a con 0x55a13a23bfe0 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:21:03.613 INFO:tasks.workunit.client.0.smithi016.stderr: -257> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:03.613 INFO:tasks.workunit.client.0.smithi016.stderr: -256> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:03.613 INFO:tasks.workunit.client.0.smithi016.stderr: -255> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:03.613 INFO:tasks.workunit.client.0.smithi016.stderr: -254> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 10 monclient(hunting): _renew_subs 2024-09-12T17:21:03.613 INFO:tasks.workunit.client.0.smithi016.stderr: -253> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 10 monclient(hunting): authenticate will time out at 2381.154516s 2024-09-12T17:21:03.614 INFO:tasks.workunit.client.0.smithi016.stderr: -252> 2024-09-12T17:21:03.177+0000 7f0ff3e78640 10 monclient(hunting): get_auth_request con 0x55a13a240810 auth_method 0 2024-09-12T17:21:03.614 INFO:tasks.workunit.client.0.smithi016.stderr: -251> 2024-09-12T17:21:03.177+0000 7f0ff3e78640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:21:03.614 INFO:tasks.workunit.client.0.smithi016.stderr: -250> 2024-09-12T17:21:03.177+0000 7f0ff3e78640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:21:03.614 INFO:tasks.workunit.client.0.smithi016.stderr: -249> 2024-09-12T17:21:03.177+0000 7f0ff3e78640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:21:03.614 INFO:tasks.workunit.client.0.smithi016.stderr: -248> 2024-09-12T17:21:03.177+0000 7f0ff4679640 10 monclient(hunting): get_auth_request con 0x55a13a23bfe0 auth_method 0 2024-09-12T17:21:03.614 INFO:tasks.workunit.client.0.smithi016.stderr: -247> 2024-09-12T17:21:03.177+0000 7f0ff4679640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:21:03.615 INFO:tasks.workunit.client.0.smithi016.stderr: -246> 2024-09-12T17:21:03.177+0000 7f0ff4679640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:21:03.615 INFO:tasks.workunit.client.0.smithi016.stderr: -245> 2024-09-12T17:21:03.177+0000 7f0ff4679640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:21:03.615 INFO:tasks.workunit.client.0.smithi016.stderr: -244> 2024-09-12T17:21:03.177+0000 7f0ff4679640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:21:03.615 INFO:tasks.workunit.client.0.smithi016.stderr: -243> 2024-09-12T17:21:03.177+0000 7f0ff4679640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:21:03.615 INFO:tasks.workunit.client.0.smithi016.stderr: -242> 2024-09-12T17:21:03.177+0000 7f0ff4679640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:21:03.615 INFO:tasks.workunit.client.0.smithi016.stderr: -241> 2024-09-12T17:21:03.177+0000 7f0ff3e78640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:21:03.616 INFO:tasks.workunit.client.0.smithi016.stderr: -240> 2024-09-12T17:21:03.177+0000 7f0ff3e78640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:21:03.616 INFO:tasks.workunit.client.0.smithi016.stderr: -239> 2024-09-12T17:21:03.177+0000 7f0ff3e78640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:21:03.616 INFO:tasks.workunit.client.0.smithi016.stderr: -238> 2024-09-12T17:21:03.177+0000 7f0ff4e7a640 10 monclient(hunting): get_auth_request con 0x55a13a210230 auth_method 0 2024-09-12T17:21:03.616 INFO:tasks.workunit.client.0.smithi016.stderr: -237> 2024-09-12T17:21:03.177+0000 7f0ff4e7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:21:03.616 INFO:tasks.workunit.client.0.smithi016.stderr: -236> 2024-09-12T17:21:03.177+0000 7f0ff4e7a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:21:03.616 INFO:tasks.workunit.client.0.smithi016.stderr: -235> 2024-09-12T17:21:03.177+0000 7f0ff4e7a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:21:03.617 INFO:tasks.workunit.client.0.smithi016.stderr: -234> 2024-09-12T17:21:03.177+0000 7f0ff4679640 10 monclient(hunting): handle_auth_done global_id 7668 payload 274 2024-09-12T17:21:03.617 INFO:tasks.workunit.client.0.smithi016.stderr: -233> 2024-09-12T17:21:03.177+0000 7f0ff4679640 10 monclient: _finish_hunting 0 2024-09-12T17:21:03.617 INFO:tasks.workunit.client.0.smithi016.stderr: -232> 2024-09-12T17:21:03.177+0000 7f0ff4679640 1 monclient: found mon.noname-a 2024-09-12T17:21:03.617 INFO:tasks.workunit.client.0.smithi016.stderr: -231> 2024-09-12T17:21:03.177+0000 7f0ff4679640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:21:03.617 INFO:tasks.workunit.client.0.smithi016.stderr: -230> 2024-09-12T17:21:03.177+0000 7f0ecb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:21:03.618 INFO:tasks.workunit.client.0.smithi016.stderr: -229> 2024-09-12T17:21:03.177+0000 7f0ecb7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:21:03.618 INFO:tasks.workunit.client.0.smithi016.stderr: -228> 2024-09-12T17:21:03.177+0000 7f0ecb7fe640 10 monclient: dump: 2024-09-12T17:21:03.618 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:21:03.618 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:21:03.618 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:03.618 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:03.619 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:21:03.619 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:03.619 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:21:03.619 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:21:03.619 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:21:03.619 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:03.620 INFO:tasks.workunit.client.0.smithi016.stderr: -227> 2024-09-12T17:21:03.177+0000 7f0ecb7fe640 10 monclient: _finish_auth 0 2024-09-12T17:21:03.620 INFO:tasks.workunit.client.0.smithi016.stderr: -226> 2024-09-12T17:21:03.177+0000 7f0ecb7fe640 10 monclient: _check_auth_tickets 2024-09-12T17:21:03.620 INFO:tasks.workunit.client.0.smithi016.stderr: -225> 2024-09-12T17:21:03.177+0000 7f0ecb7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:21:03.620 INFO:tasks.workunit.client.0.smithi016.stderr: -224> 2024-09-12T17:21:03.177+0000 7f0ecb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:21:03.620 INFO:tasks.workunit.client.0.smithi016.stderr: -223> 2024-09-12T17:21:03.177+0000 7f0ecb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:21:03.620 INFO:tasks.workunit.client.0.smithi016.stderr: -222> 2024-09-12T17:21:03.177+0000 7f0ecb7fe640 10 monclient: dump: 2024-09-12T17:21:03.621 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:21:03.621 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:21:03.621 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:03.621 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:03.621 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:21:03.621 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:03.622 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:21:03.622 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:21:03.622 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:21:03.622 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:03.622 INFO:tasks.workunit.client.0.smithi016.stderr: -221> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 5 monclient: authenticate success, global_id 7668 2024-09-12T17:21:03.623 INFO:tasks.workunit.client.0.smithi016.stderr: -220> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 10 monclient: get_monmap_and_config success 2024-09-12T17:21:03.623 INFO:tasks.workunit.client.0.smithi016.stderr: -219> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 4 set_mon_vals no callback set 2024-09-12T17:21:03.623 INFO:tasks.workunit.client.0.smithi016.stderr: -218> 2024-09-12T17:21:03.177+0000 7f0ff6b739c0 10 monclient: shutdown 2024-09-12T17:21:03.623 INFO:tasks.workunit.client.0.smithi016.stderr: -217> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 10 monclient: build_initial_monmap 2024-09-12T17:21:03.623 INFO:tasks.workunit.client.0.smithi016.stderr: -216> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 1 build_initial for_mkfs: 0 2024-09-12T17:21:03.623 INFO:tasks.workunit.client.0.smithi016.stderr: -215> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 10 monclient: monmap: 2024-09-12T17:21:03.624 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:21:03.624 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:21:03.624 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:21:03.624 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:21:03.624 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:21:03.624 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:03.625 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:21:03.625 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:21:03.625 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:21:03.625 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:03.625 INFO:tasks.workunit.client.0.smithi016.stderr: -214> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a231230) adding auth protocol: cephx 2024-09-12T17:21:03.625 INFO:tasks.workunit.client.0.smithi016.stderr: -213> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a231230) adding auth protocol: cephx 2024-09-12T17:21:03.626 INFO:tasks.workunit.client.0.smithi016.stderr: -212> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a231230) adding auth protocol: cephx 2024-09-12T17:21:03.626 INFO:tasks.workunit.client.0.smithi016.stderr: -211> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a231230) adding con mode: secure 2024-09-12T17:21:03.626 INFO:tasks.workunit.client.0.smithi016.stderr: -210> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a231230) adding con mode: crc 2024-09-12T17:21:03.626 INFO:tasks.workunit.client.0.smithi016.stderr: -209> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a231230) adding con mode: secure 2024-09-12T17:21:03.626 INFO:tasks.workunit.client.0.smithi016.stderr: -208> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a231230) adding con mode: crc 2024-09-12T17:21:03.627 INFO:tasks.workunit.client.0.smithi016.stderr: -207> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a231230) adding con mode: secure 2024-09-12T17:21:03.627 INFO:tasks.workunit.client.0.smithi016.stderr: -206> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a231230) adding con mode: crc 2024-09-12T17:21:03.627 INFO:tasks.workunit.client.0.smithi016.stderr: -205> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a231230) adding con mode: crc 2024-09-12T17:21:03.627 INFO:tasks.workunit.client.0.smithi016.stderr: -204> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a231230) adding con mode: secure 2024-09-12T17:21:03.627 INFO:tasks.workunit.client.0.smithi016.stderr: -203> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a231230) adding con mode: crc 2024-09-12T17:21:03.628 INFO:tasks.workunit.client.0.smithi016.stderr: -202> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a231230) adding con mode: secure 2024-09-12T17:21:03.628 INFO:tasks.workunit.client.0.smithi016.stderr: -201> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a231230) adding con mode: crc 2024-09-12T17:21:03.628 INFO:tasks.workunit.client.0.smithi016.stderr: -200> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a231230) adding con mode: secure 2024-09-12T17:21:03.628 INFO:tasks.workunit.client.0.smithi016.stderr: -199> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:03.629 INFO:tasks.workunit.client.0.smithi016.stderr: -198> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 1 librados: starting msgr at 2024-09-12T17:21:03.629 INFO:tasks.workunit.client.0.smithi016.stderr: -197> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 1 librados: starting objecter 2024-09-12T17:21:03.629 INFO:tasks.workunit.client.0.smithi016.stderr: -196> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 asok(0x55a139f612b0) register_command objecter_requests cmddesc objecter_requests hook 0x55a13a233520 EEXIST 2024-09-12T17:21:03.629 INFO:tasks.workunit.client.0.smithi016.stderr: -195> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 1 librados: setting wanted keys 2024-09-12T17:21:03.629 INFO:tasks.workunit.client.0.smithi016.stderr: -194> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 1 librados: calling monclient init 2024-09-12T17:21:03.630 INFO:tasks.workunit.client.0.smithi016.stderr: -193> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 10 monclient: init 2024-09-12T17:21:03.630 INFO:tasks.workunit.client.0.smithi016.stderr: -192> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1eea30) adding auth protocol: cephx 2024-09-12T17:21:03.630 INFO:tasks.workunit.client.0.smithi016.stderr: -191> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1eea30) adding auth protocol: cephx 2024-09-12T17:21:03.630 INFO:tasks.workunit.client.0.smithi016.stderr: -190> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1eea30) adding auth protocol: cephx 2024-09-12T17:21:03.630 INFO:tasks.workunit.client.0.smithi016.stderr: -189> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1eea30) adding con mode: secure 2024-09-12T17:21:03.630 INFO:tasks.workunit.client.0.smithi016.stderr: -188> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1eea30) adding con mode: crc 2024-09-12T17:21:03.630 INFO:tasks.workunit.client.0.smithi016.stderr: -187> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1eea30) adding con mode: secure 2024-09-12T17:21:03.630 INFO:tasks.workunit.client.0.smithi016.stderr: -186> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1eea30) adding con mode: crc 2024-09-12T17:21:03.631 INFO:tasks.workunit.client.0.smithi016.stderr: -185> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1eea30) adding con mode: secure 2024-09-12T17:21:03.631 INFO:tasks.workunit.client.0.smithi016.stderr: -184> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1eea30) adding con mode: crc 2024-09-12T17:21:03.631 INFO:tasks.workunit.client.0.smithi016.stderr: -183> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1eea30) adding con mode: crc 2024-09-12T17:21:03.631 INFO:tasks.workunit.client.0.smithi016.stderr: -182> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1eea30) adding con mode: secure 2024-09-12T17:21:03.631 INFO:tasks.workunit.client.0.smithi016.stderr: -181> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1eea30) adding con mode: crc 2024-09-12T17:21:03.631 INFO:tasks.workunit.client.0.smithi016.stderr: -180> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1eea30) adding con mode: secure 2024-09-12T17:21:03.631 INFO:tasks.workunit.client.0.smithi016.stderr: -179> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1eea30) adding con mode: crc 2024-09-12T17:21:03.632 INFO:tasks.workunit.client.0.smithi016.stderr: -178> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 AuthRegistry(0x55a13a1eea30) adding con mode: secure 2024-09-12T17:21:03.632 INFO:tasks.workunit.client.0.smithi016.stderr: -177> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:03.632 INFO:tasks.workunit.client.0.smithi016.stderr: -176> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:03.632 INFO:tasks.workunit.client.0.smithi016.stderr: -175> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 asok(0x55a139f612b0) register_command rotate-key cmddesc rotate-key hook 0x55a13a1eeb78 EEXIST 2024-09-12T17:21:03.632 INFO:tasks.workunit.client.0.smithi016.stderr: -174> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 10 monclient: _reopen_session rank -1 2024-09-12T17:21:03.632 INFO:tasks.workunit.client.0.smithi016.stderr: -173> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:21:03.632 INFO:tasks.workunit.client.0.smithi016.stderr: -172> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 10 monclient(hunting): picked mon.noname-a con 0x55a13a210230 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:21:03.632 INFO:tasks.workunit.client.0.smithi016.stderr: -171> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 10 monclient(hunting): picked mon.noname-c con 0x55a13a23bfe0 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:21:03.633 INFO:tasks.workunit.client.0.smithi016.stderr: -170> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 10 monclient(hunting): picked mon.noname-b con 0x55a13a240810 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:21:03.633 INFO:tasks.workunit.client.0.smithi016.stderr: -169> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:03.633 INFO:tasks.workunit.client.0.smithi016.stderr: -168> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:03.633 INFO:tasks.workunit.client.0.smithi016.stderr: -167> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:03.633 INFO:tasks.workunit.client.0.smithi016.stderr: -166> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 10 monclient(hunting): _renew_subs 2024-09-12T17:21:03.633 INFO:tasks.workunit.client.0.smithi016.stderr: -165> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 10 monclient(hunting): authenticate will time out at 2381.157253s 2024-09-12T17:21:03.633 INFO:tasks.workunit.client.0.smithi016.stderr: -164> 2024-09-12T17:21:03.181+0000 7f0ff4e7a640 10 monclient(hunting): get_auth_request con 0x55a13a23bfe0 auth_method 0 2024-09-12T17:21:03.634 INFO:tasks.workunit.client.0.smithi016.stderr: -163> 2024-09-12T17:21:03.181+0000 7f0ff4e7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:21:03.634 INFO:tasks.workunit.client.0.smithi016.stderr: -162> 2024-09-12T17:21:03.181+0000 7f0ff4e7a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:21:03.634 INFO:tasks.workunit.client.0.smithi016.stderr: -161> 2024-09-12T17:21:03.181+0000 7f0ff4e7a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:21:03.634 INFO:tasks.workunit.client.0.smithi016.stderr: -160> 2024-09-12T17:21:03.181+0000 7f0ff3e78640 10 monclient(hunting): get_auth_request con 0x55a13a210230 auth_method 0 2024-09-12T17:21:03.634 INFO:tasks.workunit.client.0.smithi016.stderr: -159> 2024-09-12T17:21:03.181+0000 7f0ff3e78640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:21:03.634 INFO:tasks.workunit.client.0.smithi016.stderr: -158> 2024-09-12T17:21:03.181+0000 7f0ff3e78640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:21:03.634 INFO:tasks.workunit.client.0.smithi016.stderr: -157> 2024-09-12T17:21:03.181+0000 7f0ff3e78640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:21:03.634 INFO:tasks.workunit.client.0.smithi016.stderr: -156> 2024-09-12T17:21:03.181+0000 7f0ff4e7a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:21:03.634 INFO:tasks.workunit.client.0.smithi016.stderr: -155> 2024-09-12T17:21:03.181+0000 7f0ff4e7a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:21:03.634 INFO:tasks.workunit.client.0.smithi016.stderr: -154> 2024-09-12T17:21:03.181+0000 7f0ff4e7a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:21:03.634 INFO:tasks.workunit.client.0.smithi016.stderr: -153> 2024-09-12T17:21:03.181+0000 7f0ff3e78640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:21:03.635 INFO:tasks.workunit.client.0.smithi016.stderr: -152> 2024-09-12T17:21:03.181+0000 7f0ff3e78640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:21:03.635 INFO:tasks.workunit.client.0.smithi016.stderr: -151> 2024-09-12T17:21:03.181+0000 7f0ff3e78640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:21:03.635 INFO:tasks.workunit.client.0.smithi016.stderr: -150> 2024-09-12T17:21:03.181+0000 7f0ff4679640 10 monclient(hunting): get_auth_request con 0x55a13a240810 auth_method 0 2024-09-12T17:21:03.635 INFO:tasks.workunit.client.0.smithi016.stderr: -149> 2024-09-12T17:21:03.181+0000 7f0ff4679640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:21:03.635 INFO:tasks.workunit.client.0.smithi016.stderr: -148> 2024-09-12T17:21:03.181+0000 7f0ff4679640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:21:03.635 INFO:tasks.workunit.client.0.smithi016.stderr: -147> 2024-09-12T17:21:03.181+0000 7f0ff4679640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:21:03.635 INFO:tasks.workunit.client.0.smithi016.stderr: -146> 2024-09-12T17:21:03.181+0000 7f0ff4e7a640 10 monclient(hunting): handle_auth_done global_id 7304 payload 824 2024-09-12T17:21:03.635 INFO:tasks.workunit.client.0.smithi016.stderr: -145> 2024-09-12T17:21:03.181+0000 7f0ff4e7a640 10 monclient: _finish_hunting 0 2024-09-12T17:21:03.635 INFO:tasks.workunit.client.0.smithi016.stderr: -144> 2024-09-12T17:21:03.181+0000 7f0ff4e7a640 1 monclient: found mon.noname-c 2024-09-12T17:21:03.635 INFO:tasks.workunit.client.0.smithi016.stderr: -143> 2024-09-12T17:21:03.181+0000 7f0ff4e7a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:21:03.635 INFO:tasks.workunit.client.0.smithi016.stderr: -142> 2024-09-12T17:21:03.181+0000 7f0ec9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:21:03.635 INFO:tasks.workunit.client.0.smithi016.stderr: -141> 2024-09-12T17:21:03.181+0000 7f0ec9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:21:03.635 INFO:tasks.workunit.client.0.smithi016.stderr: -140> 2024-09-12T17:21:03.181+0000 7f0ec9ffb640 10 monclient: dump: 2024-09-12T17:21:03.636 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:21:03.636 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:21:03.636 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:03.636 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:03.636 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:21:03.636 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:03.636 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:21:03.636 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:21:03.636 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:21:03.636 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:03.636 INFO:tasks.workunit.client.0.smithi016.stderr: -139> 2024-09-12T17:21:03.181+0000 7f0ec9ffb640 10 monclient: _finish_auth 0 2024-09-12T17:21:03.636 INFO:tasks.workunit.client.0.smithi016.stderr: -138> 2024-09-12T17:21:03.181+0000 7f0ec9ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:21:03.636 INFO:tasks.workunit.client.0.smithi016.stderr: -137> 2024-09-12T17:21:03.181+0000 7f0ec9ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:21:03.637 INFO:tasks.workunit.client.0.smithi016.stderr: -136> 2024-09-12T17:21:03.181+0000 7f0ec9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:21:03.637 INFO:tasks.workunit.client.0.smithi016.stderr: -135> 2024-09-12T17:21:03.181+0000 7f0ec9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:21:03.637 INFO:tasks.workunit.client.0.smithi016.stderr: -134> 2024-09-12T17:21:03.181+0000 7f0ec9ffb640 10 monclient: dump: 2024-09-12T17:21:03.637 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:21:03.637 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:21:03.637 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:03.637 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:03.637 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:21:03.637 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:03.637 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:21:03.637 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:21:03.637 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:21:03.637 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:03.638 INFO:tasks.workunit.client.0.smithi016.stderr: -133> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 monclient: authenticate success, global_id 7304 2024-09-12T17:21:03.638 INFO:tasks.workunit.client.0.smithi016.stderr: -132> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 10 monclient: _renew_subs 2024-09-12T17:21:03.638 INFO:tasks.workunit.client.0.smithi016.stderr: -131> 2024-09-12T17:21:03.181+0000 7f0ecb7fe640 4 set_mon_vals no callback set 2024-09-12T17:21:03.638 INFO:tasks.workunit.client.0.smithi016.stderr: -130> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:21:03.638 INFO:tasks.workunit.client.0.smithi016.stderr: -129> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 10 monclient: _renew_subs 2024-09-12T17:21:03.638 INFO:tasks.workunit.client.0.smithi016.stderr: -128> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:21:03.638 INFO:tasks.workunit.client.0.smithi016.stderr: -127> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 1 librados: init done 2024-09-12T17:21:03.638 INFO:tasks.workunit.client.0.smithi016.stderr: -126> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 5 asok(0x55a139f612b0) register_command cr dump hook 0x55a13a23fc28 2024-09-12T17:21:03.638 INFO:tasks.workunit.client.0.smithi016.stderr: -125> 2024-09-12T17:21:03.181+0000 7f0ff6b739c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.638 INFO:tasks.workunit.client.0.smithi016.stderr: -124> 2024-09-12T17:21:03.185+0000 7f0ec9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:21:03.638 INFO:tasks.workunit.client.0.smithi016.stderr: -123> 2024-09-12T17:21:03.185+0000 7f0ec9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:21:03.638 INFO:tasks.workunit.client.0.smithi016.stderr: -122> 2024-09-12T17:21:03.185+0000 7f0ec9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:21:03.638 INFO:tasks.workunit.client.0.smithi016.stderr: -121> 2024-09-12T17:21:03.185+0000 7f0ff4679640 10 monclient: get_auth_request con 0x55a13a25a5c0 auth_method 0 2024-09-12T17:21:03.639 INFO:tasks.workunit.client.0.smithi016.stderr: -120> 2024-09-12T17:21:03.185+0000 7f0ff3e78640 10 monclient: get_auth_request con 0x7f0ebc070ae0 auth_method 0 2024-09-12T17:21:03.639 INFO:tasks.workunit.client.0.smithi016.stderr: -119> 2024-09-12T17:21:03.185+0000 7f0ff6b739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:03.639 INFO:tasks.workunit.client.0.smithi016.stderr: -118> 2024-09-12T17:21:03.185+0000 7f0ff6b739c0 20 realm 2024-09-12T17:21:03.639 INFO:tasks.workunit.client.0.smithi016.stderr: -117> 2024-09-12T17:21:03.185+0000 7f0ff6b739c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.639 INFO:tasks.workunit.client.0.smithi016.stderr: -116> 2024-09-12T17:21:03.185+0000 7f0ff6b739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:03.639 INFO:tasks.workunit.client.0.smithi016.stderr: -115> 2024-09-12T17:21:03.185+0000 7f0ff6b739c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:21:03.639 INFO:tasks.workunit.client.0.smithi016.stderr: -114> 2024-09-12T17:21:03.185+0000 7f0ff6b739c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.639 INFO:tasks.workunit.client.0.smithi016.stderr: -113> 2024-09-12T17:21:03.185+0000 7f0ff6b739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:03.639 INFO:tasks.workunit.client.0.smithi016.stderr: -112> 2024-09-12T17:21:03.185+0000 7f0ff6b739c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.639 INFO:tasks.workunit.client.0.smithi016.stderr: -111> 2024-09-12T17:21:03.185+0000 7f0ff3e78640 10 monclient: get_auth_request con 0x55a13a25e950 auth_method 0 2024-09-12T17:21:03.639 INFO:tasks.workunit.client.0.smithi016.stderr: -110> 2024-09-12T17:21:03.189+0000 7f0ff6b739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:03.639 INFO:tasks.workunit.client.0.smithi016.stderr: -109> 2024-09-12T17:21:03.189+0000 7f0ff6b739c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.640 INFO:tasks.workunit.client.0.smithi016.stderr: -108> 2024-09-12T17:21:03.189+0000 7f0ff4e7a640 10 monclient: get_auth_request con 0x55a13a2620c0 auth_method 0 2024-09-12T17:21:03.640 INFO:tasks.workunit.client.0.smithi016.stderr: -107> 2024-09-12T17:21:03.189+0000 7f0ff6b739c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:21:03.640 INFO:tasks.workunit.client.0.smithi016.stderr: -106> 2024-09-12T17:21:03.189+0000 7f0ff6b739c0 20 searching for the correct realm 2024-09-12T17:21:03.640 INFO:tasks.workunit.client.0.smithi016.stderr: -105> 2024-09-12T17:21:03.189+0000 7f0ff4679640 10 monclient: get_auth_request con 0x55a13a266e60 auth_method 0 2024-09-12T17:21:03.640 INFO:tasks.workunit.client.0.smithi016.stderr: -104> 2024-09-12T17:21:03.189+0000 7f0ff3e78640 10 monclient: get_auth_request con 0x7f0fe41180c0 auth_method 0 2024-09-12T17:21:03.640 INFO:tasks.workunit.client.0.smithi016.stderr: -103> 2024-09-12T17:21:03.193+0000 7f0ff4e7a640 10 monclient: get_auth_request con 0x7f0fdc015070 auth_method 0 2024-09-12T17:21:03.640 INFO:tasks.workunit.client.0.smithi016.stderr: -102> 2024-09-12T17:21:03.193+0000 7f0ff4e7a640 0 -- 172.21.15.16:0/1658252512 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f0fdc015070 msgr2=0x7f0fdc04f960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:03.640 INFO:tasks.workunit.client.0.smithi016.stderr: -101> 2024-09-12T17:21:03.193+0000 7f0ec9ffb640 1 client.7304.objecter ms_handle_reset 0x7f0fdc015070 session 0x7f0fdc015a00 osd.2 2024-09-12T17:21:03.640 INFO:tasks.workunit.client.0.smithi016.stderr: -100> 2024-09-12T17:21:03.193+0000 7f0ec9ffb640 10 monclient: _renew_subs 2024-09-12T17:21:03.640 INFO:tasks.workunit.client.0.smithi016.stderr: -99> 2024-09-12T17:21:03.193+0000 7f0ec9ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:21:03.640 INFO:tasks.workunit.client.0.smithi016.stderr: -98> 2024-09-12T17:21:03.193+0000 7f0ff4e7a640 10 monclient: get_auth_request con 0x7f0ebc080900 auth_method 0 2024-09-12T17:21:03.641 INFO:tasks.workunit.client.0.smithi016.stderr: -97> 2024-09-12T17:21:03.193+0000 7f0ff4679640 10 monclient: get_auth_request con 0x7f0fec05c510 auth_method 0 2024-09-12T17:21:03.641 INFO:tasks.workunit.client.0.smithi016.stderr: -96> 2024-09-12T17:21:03.201+0000 7f0ff3e78640 0 -- 172.21.15.16:0/1658252512 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f0fec068bd0 msgr2=0x7f0fec07ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:03.641 INFO:tasks.workunit.client.0.smithi016.stderr: -95> 2024-09-12T17:21:03.201+0000 7f0ff3e78640 10 monclient: get_auth_request con 0x7f0fec068bd0 auth_method 0 2024-09-12T17:21:03.641 INFO:tasks.workunit.client.0.smithi016.stderr: -94> 2024-09-12T17:21:03.405+0000 7f0ff3e78640 10 monclient: get_auth_request con 0x7f0fec068bd0 auth_method 0 2024-09-12T17:21:03.641 INFO:tasks.workunit.client.0.smithi016.stderr: -93> 2024-09-12T17:21:03.417+0000 7f0ff6b739c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:21:03.641 INFO:tasks.workunit.client.0.smithi016.stderr: -92> 2024-09-12T17:21:03.417+0000 7f0ff6b739c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:21:03.641 INFO:tasks.workunit.client.0.smithi016.stderr: -91> 2024-09-12T17:21:03.417+0000 7f0ff6b739c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:21:03.641 INFO:tasks.workunit.client.0.smithi016.stderr: -90> 2024-09-12T17:21:03.417+0000 7f0ff6b739c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:21:03.641 INFO:tasks.workunit.client.0.smithi016.stderr: -89> 2024-09-12T17:21:03.417+0000 7f0ff6b739c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:21:03.641 INFO:tasks.workunit.client.0.smithi016.stderr: -88> 2024-09-12T17:21:03.417+0000 7f0ff6b739c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:21:03.641 INFO:tasks.workunit.client.0.smithi016.stderr: -87> 2024-09-12T17:21:03.417+0000 7f0ff6b739c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.641 INFO:tasks.workunit.client.0.smithi016.stderr: -86> 2024-09-12T17:21:03.421+0000 7f0ff6b739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:03.641 INFO:tasks.workunit.client.0.smithi016.stderr: -85> 2024-09-12T17:21:03.421+0000 7f0ff6b739c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.642 INFO:tasks.workunit.client.0.smithi016.stderr: -84> 2024-09-12T17:21:03.421+0000 7f0ff6b739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:03.642 INFO:tasks.workunit.client.0.smithi016.stderr: -83> 2024-09-12T17:21:03.421+0000 7f0ff6b739c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.642 INFO:tasks.workunit.client.0.smithi016.stderr: -82> 2024-09-12T17:21:03.421+0000 7f0ff6b739c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:21:03.642 INFO:tasks.workunit.client.0.smithi016.stderr: -81> 2024-09-12T17:21:03.421+0000 7f0ff6b739c0 20 zone default found 2024-09-12T17:21:03.642 INFO:tasks.workunit.client.0.smithi016.stderr: -80> 2024-09-12T17:21:03.421+0000 7f0ff6b739c0 4 Realm: () 2024-09-12T17:21:03.642 INFO:tasks.workunit.client.0.smithi016.stderr: -79> 2024-09-12T17:21:03.421+0000 7f0ff6b739c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:21:03.642 INFO:tasks.workunit.client.0.smithi016.stderr: -78> 2024-09-12T17:21:03.421+0000 7f0ff6b739c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:21:03.642 INFO:tasks.workunit.client.0.smithi016.stderr: -77> 2024-09-12T17:21:03.421+0000 7f0ff6b739c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:21:03.642 INFO:tasks.workunit.client.0.smithi016.stderr: -76> 2024-09-12T17:21:03.421+0000 7f0ff6b739c0 20 zonegroup default 2024-09-12T17:21:03.642 INFO:tasks.workunit.client.0.smithi016.stderr: -75> 2024-09-12T17:21:03.421+0000 7f0ff6b739c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.642 INFO:tasks.workunit.client.0.smithi016.stderr: -74> 2024-09-12T17:21:03.421+0000 7f0ff6b739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:03.642 INFO:tasks.workunit.client.0.smithi016.stderr: -73> 2024-09-12T17:21:03.421+0000 7f0ff6b739c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.642 INFO:tasks.workunit.client.0.smithi016.stderr: -72> 2024-09-12T17:21:03.421+0000 7f0ff6b739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:03.642 INFO:tasks.workunit.client.0.smithi016.stderr: -71> 2024-09-12T17:21:03.421+0000 7f0ff6b739c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.643 INFO:tasks.workunit.client.0.smithi016.stderr: -70> 2024-09-12T17:21:03.425+0000 7f0ff6b739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:03.643 INFO:tasks.workunit.client.0.smithi016.stderr: -69> 2024-09-12T17:21:03.425+0000 7f0ff6b739c0 20 started sync module instance, tier type = 2024-09-12T17:21:03.643 INFO:tasks.workunit.client.0.smithi016.stderr: -68> 2024-09-12T17:21:03.425+0000 7f0ff6b739c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:21:03.643 INFO:tasks.workunit.client.0.smithi016.stderr: -67> 2024-09-12T17:21:03.445+0000 7f0ff6b739c0 20 add_watcher() i=0 2024-09-12T17:21:03.643 INFO:tasks.workunit.client.0.smithi016.stderr: -66> 2024-09-12T17:21:03.445+0000 7f0ff6b739c0 20 add_watcher() i=1 2024-09-12T17:21:03.643 INFO:tasks.workunit.client.0.smithi016.stderr: -65> 2024-09-12T17:21:03.445+0000 7f0ff6b739c0 20 add_watcher() i=2 2024-09-12T17:21:03.643 INFO:tasks.workunit.client.0.smithi016.stderr: -64> 2024-09-12T17:21:03.445+0000 7f0ff6b739c0 20 add_watcher() i=3 2024-09-12T17:21:03.643 INFO:tasks.workunit.client.0.smithi016.stderr: -63> 2024-09-12T17:21:03.445+0000 7f0ff6b739c0 20 add_watcher() i=4 2024-09-12T17:21:03.643 INFO:tasks.workunit.client.0.smithi016.stderr: -62> 2024-09-12T17:21:03.445+0000 7f0ff6b739c0 20 add_watcher() i=5 2024-09-12T17:21:03.643 INFO:tasks.workunit.client.0.smithi016.stderr: -61> 2024-09-12T17:21:03.445+0000 7f0ff6b739c0 20 add_watcher() i=6 2024-09-12T17:21:03.643 INFO:tasks.workunit.client.0.smithi016.stderr: -60> 2024-09-12T17:21:03.449+0000 7f0ff6b739c0 20 add_watcher() i=7 2024-09-12T17:21:03.643 INFO:tasks.workunit.client.0.smithi016.stderr: -59> 2024-09-12T17:21:03.449+0000 7f0ff6b739c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:21:03.643 INFO:tasks.workunit.client.0.smithi016.stderr: -58> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2e290) adding auth protocol: cephx 2024-09-12T17:21:03.644 INFO:tasks.workunit.client.0.smithi016.stderr: -57> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2e290) adding auth protocol: cephx 2024-09-12T17:21:03.644 INFO:tasks.workunit.client.0.smithi016.stderr: -56> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2e290) adding auth protocol: cephx 2024-09-12T17:21:03.644 INFO:tasks.workunit.client.0.smithi016.stderr: -55> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2e290) adding con mode: secure 2024-09-12T17:21:03.644 INFO:tasks.workunit.client.0.smithi016.stderr: -54> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2e290) adding con mode: crc 2024-09-12T17:21:03.644 INFO:tasks.workunit.client.0.smithi016.stderr: -53> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2e290) adding con mode: secure 2024-09-12T17:21:03.644 INFO:tasks.workunit.client.0.smithi016.stderr: -52> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2e290) adding con mode: crc 2024-09-12T17:21:03.644 INFO:tasks.workunit.client.0.smithi016.stderr: -51> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2e290) adding con mode: secure 2024-09-12T17:21:03.644 INFO:tasks.workunit.client.0.smithi016.stderr: -50> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2e290) adding con mode: crc 2024-09-12T17:21:03.644 INFO:tasks.workunit.client.0.smithi016.stderr: -49> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2e290) adding con mode: crc 2024-09-12T17:21:03.644 INFO:tasks.workunit.client.0.smithi016.stderr: -48> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2e290) adding con mode: secure 2024-09-12T17:21:03.644 INFO:tasks.workunit.client.0.smithi016.stderr: -47> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2e290) adding con mode: crc 2024-09-12T17:21:03.644 INFO:tasks.workunit.client.0.smithi016.stderr: -46> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2e290) adding con mode: secure 2024-09-12T17:21:03.644 INFO:tasks.workunit.client.0.smithi016.stderr: -45> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2e290) adding con mode: crc 2024-09-12T17:21:03.645 INFO:tasks.workunit.client.0.smithi016.stderr: -44> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 AuthRegistry(0x7ffd02d2e290) adding con mode: secure 2024-09-12T17:21:03.645 INFO:tasks.workunit.client.0.smithi016.stderr: -43> 2024-09-12T17:21:03.453+0000 7f0eaafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:03.645 INFO:tasks.workunit.client.0.smithi016.stderr: -42> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:03.645 INFO:tasks.workunit.client.0.smithi016.stderr: -41> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:21:03.645 INFO:tasks.workunit.client.0.smithi016.stderr: -40> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:21:03.645 INFO:tasks.workunit.client.0.smithi016.stderr: -39> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 asok(0x55a139f612b0) register_command cache list hook 0x55a13a2305d0 2024-09-12T17:21:03.645 INFO:tasks.workunit.client.0.smithi016.stderr: -38> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 asok(0x55a139f612b0) register_command cache inspect hook 0x55a13a2305d0 2024-09-12T17:21:03.645 INFO:tasks.workunit.client.0.smithi016.stderr: -37> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 asok(0x55a139f612b0) register_command cache erase hook 0x55a13a2305d0 2024-09-12T17:21:03.645 INFO:tasks.workunit.client.0.smithi016.stderr: -36> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 asok(0x55a139f612b0) register_command cache zap hook 0x55a13a2305d0 2024-09-12T17:21:03.645 INFO:tasks.workunit.client.0.smithi016.stderr: -35> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 note: GC not initialized 2024-09-12T17:21:03.645 INFO:tasks.workunit.client.0.smithi016.stderr: -34> 2024-09-12T17:21:03.453+0000 7f0ea9fdb640 20 reqs_thread_entry: start 2024-09-12T17:21:03.645 INFO:tasks.workunit.client.0.smithi016.stderr: -33> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 asok(0x55a139f612b0) register_command sync trace show hook 0x7f0fe40ca030 2024-09-12T17:21:03.645 INFO:tasks.workunit.client.0.smithi016.stderr: -32> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 asok(0x55a139f612b0) register_command sync trace history hook 0x7f0fe40ca030 2024-09-12T17:21:03.646 INFO:tasks.workunit.client.0.smithi016.stderr: -31> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 asok(0x55a139f612b0) register_command sync trace active hook 0x7f0fe40ca030 2024-09-12T17:21:03.646 INFO:tasks.workunit.client.0.smithi016.stderr: -30> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 5 asok(0x55a139f612b0) register_command sync trace active_short hook 0x7f0fe40ca030 2024-09-12T17:21:03.646 INFO:tasks.workunit.client.0.smithi016.stderr: -29> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 20 init_complete bucket index max shards: 1 2024-09-12T17:21:03.646 INFO:tasks.workunit.client.0.smithi016.stderr: -28> 2024-09-12T17:21:03.453+0000 7f0ff6b739c0 20 Filter name: none 2024-09-12T17:21:03.646 INFO:tasks.workunit.client.0.smithi016.stderr: -27> 2024-09-12T17:21:03.457+0000 7f0e1b7fe640 20 reqs_thread_entry: start 2024-09-12T17:21:03.646 INFO:tasks.workunit.client.0.smithi016.stderr: -26> 2024-09-12T17:21:03.457+0000 7f0ff6b739c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T17:21:03.646 INFO:tasks.workunit.client.0.smithi016.stderr: -25> 2024-09-12T17:21:03.457+0000 7f0ff6b739c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.646 INFO:tasks.workunit.client.0.smithi016.stderr: -24> 2024-09-12T17:21:03.457+0000 7f0ff6b739c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:21:03.646 INFO:tasks.workunit.client.0.smithi016.stderr: -23> 2024-09-12T17:21:03.457+0000 7f0ff6b739c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T17:21:03.646 INFO:tasks.workunit.client.0.smithi016.stderr: -22> 2024-09-12T17:21:03.457+0000 7f0ff6b739c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T17:21:03.646 INFO:tasks.workunit.client.0.smithi016.stderr: -21> 2024-09-12T17:21:03.457+0000 7f0ff6b739c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 : miss 2024-09-12T17:21:03.646 INFO:tasks.workunit.client.0.smithi016.stderr: -20> 2024-09-12T17:21:03.457+0000 7f0ff6b739c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.646 INFO:tasks.workunit.client.0.smithi016.stderr: -19> 2024-09-12T17:21:03.457+0000 7f0ff6b739c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T17:21:03.647 INFO:tasks.workunit.client.0.smithi016.stderr: -18> 2024-09-12T17:21:03.457+0000 7f0ff6b739c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 info.flags=0x17 2024-09-12T17:21:03.647 INFO:tasks.workunit.client.0.smithi016.stderr: -17> 2024-09-12T17:21:03.457+0000 7f0ff6b739c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 to cache LRU end 2024-09-12T17:21:03.647 INFO:tasks.workunit.client.0.smithi016.stderr: -16> 2024-09-12T17:21:03.457+0000 7f0ff6b739c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:21:03.647 INFO:tasks.workunit.client.0.smithi016.stderr: -15> 2024-09-12T17:21:03.457+0000 7f0ff6b739c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:03.647 INFO:tasks.workunit.client.0.smithi016.stderr: -14> 2024-09-12T17:21:03.457+0000 7f0ff6b739c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 2024-09-12T17:21:03.647 INFO:tasks.workunit.client.0.smithi016.stderr: -13> 2024-09-12T17:21:03.469+0000 7f0ff6b739c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 info.flags=0x17 2024-09-12T17:21:03.647 INFO:tasks.workunit.client.0.smithi016.stderr: -12> 2024-09-12T17:21:03.469+0000 7f0ff6b739c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 to cache LRU end 2024-09-12T17:21:03.647 INFO:tasks.workunit.client.0.smithi016.stderr: -11> 2024-09-12T17:21:03.469+0000 7f0ff6b739c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:03.647 INFO:tasks.workunit.client.0.smithi016.stderr: -10> 2024-09-12T17:21:03.469+0000 7f0ff6b739c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36, ofs0, ns] 2024-09-12T17:21:03.647 INFO:tasks.workunit.client.0.smithi016.stderr: -9> 2024-09-12T17:21:03.469+0000 7f0ecb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431661 cookie 94150953709680 notifier 7304 bl.length()=923 2024-09-12T17:21:03.647 INFO:tasks.workunit.client.0.smithi016.stderr: -8> 2024-09-12T17:21:03.469+0000 7f0ecb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 info.flags=0x17 2024-09-12T17:21:03.647 INFO:tasks.workunit.client.0.smithi016.stderr: -7> 2024-09-12T17:21:03.469+0000 7f0ecb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 to cache LRU end 2024-09-12T17:21:03.647 INFO:tasks.workunit.client.0.smithi016.stderr: -6> 2024-09-12T17:21:03.469+0000 7f0ecb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:03.648 INFO:tasks.workunit.client.0.smithi016.stderr: -5> 2024-09-12T17:21:03.469+0000 7f0ff6b739c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36]): orig_sources= new_sources= 2024-09-12T17:21:03.648 INFO:tasks.workunit.client.0.smithi016.stderr: -4> 2024-09-12T17:21:03.469+0000 7f0ff6b739c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36]): potential sources added=[] removed=[] 2024-09-12T17:21:03.648 INFO:tasks.workunit.client.0.smithi016.stderr: -3> 2024-09-12T17:21:03.469+0000 7f0ff6b739c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36]): orig_dests= new_dests= 2024-09-12T17:21:03.648 INFO:tasks.workunit.client.0.smithi016.stderr: -2> 2024-09-12T17:21:03.469+0000 7f0ff6b739c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36]): potential dests added=[] removed=[] 2024-09-12T17:21:03.648 INFO:tasks.workunit.client.0.smithi016.stderr: -1> 2024-09-12T17:21:03.477+0000 7f0ff6b739c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0ff6b739c0 time 2024-09-12T17:21:03.476173+0000 2024-09-12T17:21:03.648 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:21:03.648 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:03.648 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:21:03.648 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f0ffa44d2eb] 2024-09-12T17:21:03.648 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0ffa44d49f] 2024-09-12T17:21:03.648 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a138d380c1] 2024-09-12T17:21:03.648 INFO:tasks.workunit.client.0.smithi016.stderr: 4: radosgw-admin(+0x14100ec) [0x55a13978e0ec] 2024-09-12T17:21:03.649 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a138d4a18d] 2024-09-12T17:21:03.649 INFO:tasks.workunit.client.0.smithi016.stderr: 6: main() 2024-09-12T17:21:03.649 INFO:tasks.workunit.client.0.smithi016.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0ff92b3d90] 2024-09-12T17:21:03.649 INFO:tasks.workunit.client.0.smithi016.stderr: 8: __libc_start_main() 2024-09-12T17:21:03.649 INFO:tasks.workunit.client.0.smithi016.stderr: 9: _start() 2024-09-12T17:21:03.649 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:03.649 INFO:tasks.workunit.client.0.smithi016.stderr: 0> 2024-09-12T17:21:03.481+0000 7f0ff6b739c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:21:03.649 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7f0ff6b739c0 thread_name:radosgw-admin 2024-09-12T17:21:03.649 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:03.649 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:21:03.649 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f0ff92cc520] 2024-09-12T17:21:03.649 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:21:03.649 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:21:03.650 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:21:03.650 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f0ffa44d345] 2024-09-12T17:21:03.650 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0ffa44d49f] 2024-09-12T17:21:03.650 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a138d380c1] 2024-09-12T17:21:03.650 INFO:tasks.workunit.client.0.smithi016.stderr: 8: radosgw-admin(+0x14100ec) [0x55a13978e0ec] 2024-09-12T17:21:03.650 INFO:tasks.workunit.client.0.smithi016.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a138d4a18d] 2024-09-12T17:21:03.650 INFO:tasks.workunit.client.0.smithi016.stderr: 10: main() 2024-09-12T17:21:03.650 INFO:tasks.workunit.client.0.smithi016.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0ff92b3d90] 2024-09-12T17:21:03.650 INFO:tasks.workunit.client.0.smithi016.stderr: 12: __libc_start_main() 2024-09-12T17:21:03.650 INFO:tasks.workunit.client.0.smithi016.stderr: 13: _start() 2024-09-12T17:21:03.650 INFO:tasks.workunit.client.0.smithi016.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:21:03.650 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:03.650 INFO:tasks.workunit.client.0.smithi016.stderr:--- logging levels --- 2024-09-12T17:21:03.650 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 none 2024-09-12T17:21:03.651 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 lockdep 2024-09-12T17:21:03.651 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 context 2024-09-12T17:21:03.651 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 crush 2024-09-12T17:21:03.651 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds 2024-09-12T17:21:03.651 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_balancer 2024-09-12T17:21:03.651 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_locker 2024-09-12T17:21:03.651 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log 2024-09-12T17:21:03.651 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log_expire 2024-09-12T17:21:03.651 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_migrator 2024-09-12T17:21:03.651 INFO:tasks.workunit.client.0.smithi016.stderr: 3/ 5 mds_quiesce 2024-09-12T17:21:03.651 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 buffer 2024-09-12T17:21:03.651 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 timer 2024-09-12T17:21:03.651 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 filer 2024-09-12T17:21:03.652 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 striper 2024-09-12T17:21:03.652 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 objecter 2024-09-12T17:21:03.652 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rados 2024-09-12T17:21:03.652 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd 2024-09-12T17:21:03.652 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_mirror 2024-09-12T17:21:03.652 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_replay 2024-09-12T17:21:03.652 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_pwl 2024-09-12T17:21:03.652 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 journaler 2024-09-12T17:21:03.652 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objectcacher 2024-09-12T17:21:03.652 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:21:03.652 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 client 2024-09-12T17:21:03.652 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 osd 2024-09-12T17:21:03.652 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 optracker 2024-09-12T17:21:03.652 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objclass 2024-09-12T17:21:03.653 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 filestore 2024-09-12T17:21:03.653 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 journal 2024-09-12T17:21:03.653 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 ms 2024-09-12T17:21:03.653 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mon 2024-09-12T17:21:03.653 INFO:tasks.workunit.client.0.smithi016.stderr: 0/10 monc 2024-09-12T17:21:03.653 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 paxos 2024-09-12T17:21:03.653 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 tp 2024-09-12T17:21:03.653 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 auth 2024-09-12T17:21:03.653 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 crypto 2024-09-12T17:21:03.653 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 finisher 2024-09-12T17:21:03.653 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 reserver 2024-09-12T17:21:03.653 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 heartbeatmap 2024-09-12T17:21:03.654 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 perfcounter 2024-09-12T17:21:03.654 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw 2024-09-12T17:21:03.654 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_sync 2024-09-12T17:21:03.654 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_datacache 2024-09-12T17:21:03.654 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_access 2024-09-12T17:21:03.654 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:21:03.654 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_flight 2024-09-12T17:21:03.654 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:21:03.654 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw_notification 2024-09-12T17:21:03.654 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 javaclient 2024-09-12T17:21:03.654 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 asok 2024-09-12T17:21:03.654 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 throttle 2024-09-12T17:21:03.654 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 refs 2024-09-12T17:21:03.654 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 compressor 2024-09-12T17:21:03.655 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluestore 2024-09-12T17:21:03.655 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluefs 2024-09-12T17:21:03.655 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 bdev 2024-09-12T17:21:03.655 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 kstore 2024-09-12T17:21:03.655 INFO:tasks.workunit.client.0.smithi016.stderr: 4/ 5 rocksdb 2024-09-12T17:21:03.655 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 fuse 2024-09-12T17:21:03.655 INFO:tasks.workunit.client.0.smithi016.stderr: 2/ 5 mgr 2024-09-12T17:21:03.655 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mgrc 2024-09-12T17:21:03.655 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 dpdk 2024-09-12T17:21:03.655 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 eventtrace 2024-09-12T17:21:03.655 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 prioritycache 2024-09-12T17:21:03.655 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 test 2024-09-12T17:21:03.655 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:21:03.656 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephsqlite 2024-09-12T17:21:03.656 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:21:03.656 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore 2024-09-12T17:21:03.656 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_onode 2024-09-12T17:21:03.656 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_odata 2024-09-12T17:21:03.656 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_omap 2024-09-12T17:21:03.656 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_tm 2024-09-12T17:21:03.656 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_t 2024-09-12T17:21:03.656 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:21:03.656 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_epm 2024-09-12T17:21:03.656 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_lba 2024-09-12T17:21:03.656 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:21:03.656 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cache 2024-09-12T17:21:03.656 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_journal 2024-09-12T17:21:03.657 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_device 2024-09-12T17:21:03.657 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_backref 2024-09-12T17:21:03.657 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 alienstore 2024-09-12T17:21:03.657 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mclock 2024-09-12T17:21:03.657 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cyanstore 2024-09-12T17:21:03.657 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 ceph_exporter 2024-09-12T17:21:03.657 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 memstore 2024-09-12T17:21:03.657 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 trace 2024-09-12T17:21:03.657 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 ceph_dedup 2024-09-12T17:21:03.657 INFO:tasks.workunit.client.0.smithi016.stderr: -2/-2 (syslog threshold) 2024-09-12T17:21:03.657 INFO:tasks.workunit.client.0.smithi016.stderr: 99/99 (stderr threshold) 2024-09-12T17:21:03.657 INFO:tasks.workunit.client.0.smithi016.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:21:03.657 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0e1b7fe640 / http_manager 2024-09-12T17:21:03.657 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0ea9fdb640 / http_manager 2024-09-12T17:21:03.658 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0eaafdd640 / rgw_dt_lg_renew 2024-09-12T17:21:03.658 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0ec9ffb640 / ms_dispatch 2024-09-12T17:21:03.658 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0ecb7fe640 / io_context_pool 2024-09-12T17:21:03.658 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0ed9ffb640 / ms_dispatch 2024-09-12T17:21:03.658 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0ee0e09640 / ms_dispatch 2024-09-12T17:21:03.658 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0ee260c640 / io_context_pool 2024-09-12T17:21:03.658 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0ff3e78640 / msgr-worker-2 2024-09-12T17:21:03.658 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0ff4679640 / msgr-worker-1 2024-09-12T17:21:03.658 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0ff4e7a640 / msgr-worker-0 2024-09-12T17:21:03.658 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0ff567b640 / io_context_pool 2024-09-12T17:21:03.658 INFO:tasks.workunit.client.0.smithi016.stderr: 7f0ff6b739c0 / radosgw-admin 2024-09-12T17:21:03.658 INFO:tasks.workunit.client.0.smithi016.stderr: max_recent 500 2024-09-12T17:21:03.658 INFO:tasks.workunit.client.0.smithi016.stderr: max_new 1000 2024-09-12T17:21:03.658 INFO:tasks.workunit.client.0.smithi016.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:21:03.483211Z_9989a9b1-4aa1-4203-8a5f-027eacd000db/log 2024-09-12T17:21:03.659 INFO:tasks.workunit.client.0.smithi016.stderr:--- end dump of recent events --- 2024-09-12T17:21:03.659 INFO:tasks.workunit.client.0.smithi016.stderr:Aborted 2024-09-12T17:21:03.659 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T17:21:03.659 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:21:03.660 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:21:03.660 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.569+0000 7ff2d410f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.773+0000 7ff2d410f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:03.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.773+0000 7ff2d410f9c0 20 realm 2024-09-12T17:21:03.775 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.773+0000 7ff2d410f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.775 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.773+0000 7ff2d410f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:03.775 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.773+0000 7ff2d410f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:21:03.775 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.773+0000 7ff2d410f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.775 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.773+0000 7ff2d410f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:03.775 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.773+0000 7ff2d410f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.777 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.777+0000 7ff2d410f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:03.777 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.777+0000 7ff2d410f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:03.779 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.777+0000 7ff2d410f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:21:03.779 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.777+0000 7ff2d410f9c0 20 searching for the correct realm 2024-09-12T17:21:03.784 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.781+0000 7ff2d2416640 0 -- 172.21.15.16:0/2120958622 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7ff2c8108070 msgr2=0x7ff2c80a54d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:03.998 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:03.997+0000 7ff2d1414640 0 -- 172.21.15.16:0/2120958622 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7ff2cc03a040 msgr2=0x7ff2cc037410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:04.215 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.213+0000 7ff2d410f9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:21:04.215 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.213+0000 7ff2d410f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:21:04.215 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.213+0000 7ff2d410f9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:21:04.215 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.213+0000 7ff2d410f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:21:04.215 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.213+0000 7ff2d410f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:21:04.215 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.213+0000 7ff2d410f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:21:04.216 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.213+0000 7ff2d410f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:04.216 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.213+0000 7ff2d410f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:04.216 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.213+0000 7ff2d410f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:04.216 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.217+0000 7ff2d410f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:04.216 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.217+0000 7ff2d410f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:04.217 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.217+0000 7ff2d410f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:21:04.218 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.217+0000 7ff2d410f9c0 20 zone default found 2024-09-12T17:21:04.218 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.217+0000 7ff2d410f9c0 4 Realm: () 2024-09-12T17:21:04.218 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.217+0000 7ff2d410f9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:21:04.218 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.217+0000 7ff2d410f9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:21:04.218 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.217+0000 7ff2d410f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:21:04.218 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.217+0000 7ff2d410f9c0 20 zonegroup default 2024-09-12T17:21:04.218 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.217+0000 7ff2d410f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:04.218 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.217+0000 7ff2d410f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:04.219 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.217+0000 7ff2d410f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:04.219 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.217+0000 7ff2d410f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:04.219 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.217+0000 7ff2d410f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:04.220 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.217+0000 7ff2d410f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:04.220 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.217+0000 7ff2d410f9c0 20 started sync module instance, tier type = 2024-09-12T17:21:04.220 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.217+0000 7ff2d410f9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:21:04.245 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.245+0000 7ff2d410f9c0 20 add_watcher() i=0 2024-09-12T17:21:04.245 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.245+0000 7ff2d410f9c0 20 add_watcher() i=1 2024-09-12T17:21:04.245 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.245+0000 7ff2d410f9c0 20 add_watcher() i=2 2024-09-12T17:21:04.245 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.245+0000 7ff2d410f9c0 20 add_watcher() i=3 2024-09-12T17:21:04.245 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.245+0000 7ff2d410f9c0 20 add_watcher() i=4 2024-09-12T17:21:04.245 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.245+0000 7ff2d410f9c0 20 add_watcher() i=5 2024-09-12T17:21:04.245 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.245+0000 7ff2d410f9c0 20 add_watcher() i=6 2024-09-12T17:21:04.247 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.245+0000 7ff2d410f9c0 20 add_watcher() i=7 2024-09-12T17:21:04.248 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.245+0000 7ff2d410f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:21:04.252 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.249+0000 7ff1837fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:04.253 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.253+0000 7ff2d410f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:21:04.253 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.253+0000 7ff2d410f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:21:04.253 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.253+0000 7ff2d410f9c0 5 note: GC not initialized 2024-09-12T17:21:04.254 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.253+0000 7ff1827fc640 20 reqs_thread_entry: start 2024-09-12T17:21:04.254 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.253+0000 7ff2d410f9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:21:04.254 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.253+0000 7ff2d410f9c0 20 Filter name: none 2024-09-12T17:21:04.254 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.253+0000 7ff0f3fff640 20 reqs_thread_entry: start 2024-09-12T17:21:04.254 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.253+0000 7ff2d410f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:04.255 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.253+0000 7ff2d410f9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:21:04.255 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.253+0000 7ff2d410f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:04.256 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.257+0000 7ff2d410f9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:21:04.256 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.257+0000 7ff2d410f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:21:04.256 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.257+0000 7ff2d410f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:04.257 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.257+0000 7ff2d410f9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:21:04.257 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.257+0000 7ff2d410f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:04.258 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.257+0000 7ff2d410f9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:21:04.259 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.257+0000 7ff2d410f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:21:04.261 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.261+0000 7ff1837fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:04.266 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.265+0000 7ff2d410f9c0 20 remove_watcher() i=0 2024-09-12T17:21:04.266 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.265+0000 7ff2d410f9c0 2 removed watcher, disabling cache 2024-09-12T17:21:04.269 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.269+0000 7ff2d410f9c0 20 remove_watcher() i=1 2024-09-12T17:21:04.271 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.269+0000 7ff2d410f9c0 20 remove_watcher() i=2 2024-09-12T17:21:04.274 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.273+0000 7ff2d410f9c0 20 remove_watcher() i=3 2024-09-12T17:21:04.276 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.273+0000 7ff2d410f9c0 20 remove_watcher() i=4 2024-09-12T17:21:04.277 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.277+0000 7ff2d410f9c0 20 remove_watcher() i=5 2024-09-12T17:21:04.279 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.277+0000 7ff2d410f9c0 20 remove_watcher() i=6 2024-09-12T17:21:04.280 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.281+0000 7ff2d410f9c0 20 remove_watcher() i=7 2024-09-12T17:21:04.298 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:04.298 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:21:04.298 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: abort-at-logrecord-writes id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:21:04.298 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:04.353 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:21:04.388 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:21:04.388 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:21:04.436 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.433+0000 7f33c8b0e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:04.437 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.437+0000 7f33c8b0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:04.437 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.437+0000 7f33c8b0e9c0 20 realm 2024-09-12T17:21:04.437 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.437+0000 7f33c8b0e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:04.438 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.437+0000 7f33c8b0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:04.438 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.437+0000 7f33c8b0e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:21:04.439 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.437+0000 7f33c8b0e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:04.439 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.437+0000 7f33c8b0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:04.439 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.437+0000 7f33c8b0e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:04.440 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.437+0000 7f33c8b0e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:04.440 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.437+0000 7f33c8b0e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:04.442 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.441+0000 7f33c8b0e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:21:04.442 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.441+0000 7f33c8b0e9c0 20 searching for the correct realm 2024-09-12T17:21:04.445 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.445+0000 7f33c6e15640 0 -- 172.21.15.16:0/1678406675 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f33bc04a020 msgr2=0x7f33bc07ea60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:04.453 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.453+0000 7f33c5e13640 0 -- 172.21.15.16:0/1678406675 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f33c00b8960 msgr2=0x7f33c00d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:04.672 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.669+0000 7f33c8b0e9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:21:04.672 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.669+0000 7f33c8b0e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:21:04.672 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.669+0000 7f33c8b0e9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:21:04.672 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.669+0000 7f33c8b0e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:21:04.672 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.669+0000 7f33c8b0e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:21:04.672 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.669+0000 7f33c8b0e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:21:04.672 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.669+0000 7f33c8b0e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:04.672 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.669+0000 7f33c8b0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:04.672 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.669+0000 7f33c8b0e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:04.673 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.673+0000 7f33c8b0e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:04.673 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.673+0000 7f33c8b0e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:04.674 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.673+0000 7f33c8b0e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:21:04.674 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.673+0000 7f33c8b0e9c0 20 zone default found 2024-09-12T17:21:04.674 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.673+0000 7f33c8b0e9c0 4 Realm: () 2024-09-12T17:21:04.674 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.673+0000 7f33c8b0e9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:21:04.674 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.673+0000 7f33c8b0e9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:21:04.674 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.673+0000 7f33c8b0e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:21:04.675 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.673+0000 7f33c8b0e9c0 20 zonegroup default 2024-09-12T17:21:04.675 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.673+0000 7f33c8b0e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:04.675 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.673+0000 7f33c8b0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:04.675 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.673+0000 7f33c8b0e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:04.675 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.673+0000 7f33c8b0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:04.676 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.673+0000 7f33c8b0e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:04.676 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.677+0000 7f33c8b0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:04.676 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.677+0000 7f33c8b0e9c0 20 started sync module instance, tier type = 2024-09-12T17:21:04.677 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.677+0000 7f33c8b0e9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:21:04.699 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.697+0000 7f33c8b0e9c0 20 add_watcher() i=0 2024-09-12T17:21:04.699 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.697+0000 7f33c8b0e9c0 20 add_watcher() i=1 2024-09-12T17:21:04.699 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.697+0000 7f33c8b0e9c0 20 add_watcher() i=2 2024-09-12T17:21:04.699 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.697+0000 7f33c8b0e9c0 20 add_watcher() i=3 2024-09-12T17:21:04.699 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.697+0000 7f33c8b0e9c0 20 add_watcher() i=4 2024-09-12T17:21:04.699 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.697+0000 7f33c8b0e9c0 20 add_watcher() i=5 2024-09-12T17:21:04.699 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.697+0000 7f33c8b0e9c0 20 add_watcher() i=6 2024-09-12T17:21:04.701 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.701+0000 7f33c8b0e9c0 20 add_watcher() i=7 2024-09-12T17:21:04.701 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.701+0000 7f33c8b0e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:21:04.705 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.705+0000 7f327cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:04.706 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.705+0000 7f33c8b0e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:21:04.706 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.705+0000 7f33c8b0e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:21:04.706 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.705+0000 7f33c8b0e9c0 5 note: GC not initialized 2024-09-12T17:21:04.706 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.705+0000 7f31f77fe640 20 reqs_thread_entry: start 2024-09-12T17:21:04.707 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.705+0000 7f33c8b0e9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:21:04.707 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.705+0000 7f33c8b0e9c0 20 Filter name: none 2024-09-12T17:21:04.707 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.705+0000 7f31f57fa640 20 reqs_thread_entry: start 2024-09-12T17:21:04.707 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.705+0000 7f33c8b0e9c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T17:21:04.707 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.705+0000 7f33c8b0e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:04.708 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.709+0000 7f33c8b0e9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:21:04.708 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.709+0000 7f33c8b0e9c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T17:21:04.708 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.709+0000 7f33c8b0e9c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T17:21:04.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.709+0000 7f33c8b0e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 : miss 2024-09-12T17:21:04.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.709+0000 7f33c8b0e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:04.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.709+0000 7f33c8b0e9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:21:04.710 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.709+0000 7f33c8b0e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 info.flags=0x17 2024-09-12T17:21:04.710 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.709+0000 7f33c8b0e9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 to cache LRU end 2024-09-12T17:21:04.710 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.709+0000 7f33c8b0e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:21:04.710 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.709+0000 7f33c8b0e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:04.710 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.709+0000 7f33c8b0e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 2024-09-12T17:21:04.713 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.713+0000 7f33c8b0e9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 to be held by another RGW process; skipping for now 2024-09-12T17:21:04.715 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.713+0000 7f327cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:04.720 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.717+0000 7f33c8b0e9c0 20 remove_watcher() i=0 2024-09-12T17:21:04.720 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.717+0000 7f33c8b0e9c0 2 removed watcher, disabling cache 2024-09-12T17:21:04.722 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.721+0000 7f33c8b0e9c0 20 remove_watcher() i=1 2024-09-12T17:21:04.725 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.725+0000 7f33c8b0e9c0 20 remove_watcher() i=2 2024-09-12T17:21:04.728 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.725+0000 7f33c8b0e9c0 20 remove_watcher() i=3 2024-09-12T17:21:04.730 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.729+0000 7f33c8b0e9c0 20 remove_watcher() i=4 2024-09-12T17:21:04.732 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.733+0000 7f33c8b0e9c0 20 remove_watcher() i=5 2024-09-12T17:21:04.734 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.733+0000 7f33c8b0e9c0 20 remove_watcher() i=6 2024-09-12T17:21:04.736 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:04.733+0000 7f33c8b0e9c0 20 remove_watcher() i=7 2024-09-12T17:21:04.752 INFO:tasks.workunit.client.0.smithi016.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:21:34.781 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:21:34.821 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:21:34.821 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:21:34.874 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:34.873+0000 7f7704e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:34.875 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:34.873+0000 7f7704e1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:34.876 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:34.873+0000 7f7704e1a9c0 20 realm 2024-09-12T17:21:34.876 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:34.873+0000 7f7704e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:34.876 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:34.873+0000 7f7704e1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:34.876 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:34.873+0000 7f7704e1a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:21:34.876 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:34.873+0000 7f7704e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:34.876 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:34.873+0000 7f7704e1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:34.876 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:34.873+0000 7f7704e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:34.878 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:34.877+0000 7f7704e1a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:34.878 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:34.877+0000 7f7704e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:34.879 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:34.877+0000 7f7704e1a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:21:34.879 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:34.877+0000 7f7704e1a9c0 20 searching for the correct realm 2024-09-12T17:21:34.882 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:34.881+0000 7f7703121640 0 -- 172.21.15.16:0/2183556372 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f76f8062af0 msgr2=0x7f76f80990e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:21:35.098 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.097+0000 7f770211f640 0 -- 172.21.15.16:0/2183556372 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f76fc008050 msgr2=0x7f76fc08c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:21:35.316 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.313+0000 7f7704e1a9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:21:35.316 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.313+0000 7f7704e1a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:21:35.316 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.313+0000 7f7704e1a9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:21:35.316 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.313+0000 7f7704e1a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:21:35.316 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.313+0000 7f7704e1a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:21:35.316 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.313+0000 7f7704e1a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:21:35.317 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.313+0000 7f7704e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:35.317 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.317+0000 7f7704e1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:35.317 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.317+0000 7f7704e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:35.317 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.317+0000 7f7704e1a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:35.317 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.317+0000 7f7704e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:35.318 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.317+0000 7f7704e1a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:21:35.318 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.317+0000 7f7704e1a9c0 20 zone default found 2024-09-12T17:21:35.318 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.317+0000 7f7704e1a9c0 4 Realm: () 2024-09-12T17:21:35.318 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.317+0000 7f7704e1a9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:21:35.318 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.317+0000 7f7704e1a9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:21:35.319 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.317+0000 7f7704e1a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:21:35.319 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.317+0000 7f7704e1a9c0 20 zonegroup default 2024-09-12T17:21:35.319 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.317+0000 7f7704e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:35.319 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.317+0000 7f7704e1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:35.319 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.317+0000 7f7704e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:35.320 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.317+0000 7f7704e1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:35.320 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.317+0000 7f7704e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:35.321 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.321+0000 7f7704e1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:35.321 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.321+0000 7f7704e1a9c0 20 started sync module instance, tier type = 2024-09-12T17:21:35.321 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.321+0000 7f7704e1a9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:21:35.344 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.345+0000 7f7704e1a9c0 20 add_watcher() i=0 2024-09-12T17:21:35.344 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.345+0000 7f7704e1a9c0 20 add_watcher() i=1 2024-09-12T17:21:35.344 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.345+0000 7f7704e1a9c0 20 add_watcher() i=2 2024-09-12T17:21:35.345 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.345+0000 7f7704e1a9c0 20 add_watcher() i=3 2024-09-12T17:21:35.345 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.345+0000 7f7704e1a9c0 20 add_watcher() i=4 2024-09-12T17:21:35.345 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.345+0000 7f7704e1a9c0 20 add_watcher() i=5 2024-09-12T17:21:35.345 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.345+0000 7f7704e1a9c0 20 add_watcher() i=6 2024-09-12T17:21:35.347 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.345+0000 7f7704e1a9c0 20 add_watcher() i=7 2024-09-12T17:21:35.347 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.345+0000 7f7704e1a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:21:35.351 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.349+0000 7f75b97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:35.352 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.349+0000 7f7704e1a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:21:35.352 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.349+0000 7f7704e1a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:21:35.352 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.353+0000 7f7704e1a9c0 5 note: GC not initialized 2024-09-12T17:21:35.353 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.353+0000 7f7533fff640 20 reqs_thread_entry: start 2024-09-12T17:21:35.353 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.353+0000 7f7704e1a9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:21:35.353 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.353+0000 7f7704e1a9c0 20 Filter name: none 2024-09-12T17:21:35.353 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.353+0000 7f7531ffb640 20 reqs_thread_entry: start 2024-09-12T17:21:35.354 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.353+0000 7f7704e1a9c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T17:21:35.354 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.353+0000 7f7704e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:35.354 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.353+0000 7f7704e1a9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:21:35.355 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.353+0000 7f7704e1a9c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T17:21:35.355 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.353+0000 7f7704e1a9c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T17:21:35.355 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.353+0000 7f7704e1a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 : miss 2024-09-12T17:21:35.355 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.353+0000 7f7704e1a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:35.356 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.353+0000 7f7704e1a9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:21:35.356 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.353+0000 7f7704e1a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 info.flags=0x17 2024-09-12T17:21:35.356 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.353+0000 7f7704e1a9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 to cache LRU end 2024-09-12T17:21:35.356 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.353+0000 7f7704e1a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:21:35.356 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.353+0000 7f7704e1a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:35.356 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.353+0000 7f7704e1a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 2024-09-12T17:21:35.358 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.357+0000 7f7704e1a9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:21:35.367 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.365+0000 7f7704e1a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 info.flags=0x17 2024-09-12T17:21:35.367 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.365+0000 7f7704e1a9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 to cache LRU end 2024-09-12T17:21:35.368 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.365+0000 7f7704e1a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:35.368 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.365+0000 7f7704e1a9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36, ofs0, ns] 2024-09-12T17:21:35.368 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.369+0000 7f75e67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431662 cookie 94504244708848 notifier 7731 bl.length()=923 2024-09-12T17:21:35.368 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.369+0000 7f75e67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 info.flags=0x17 2024-09-12T17:21:35.368 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.369+0000 7f75e67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 to cache LRU end 2024-09-12T17:21:35.368 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.369+0000 7f75e67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:35.369 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.369+0000 7f7704e1a9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36]): orig_sources= new_sources= 2024-09-12T17:21:35.369 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.369+0000 7f7704e1a9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36]): potential sources added=[] removed=[] 2024-09-12T17:21:35.369 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.369+0000 7f7704e1a9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36]): orig_dests= new_dests= 2024-09-12T17:21:35.369 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.369+0000 7f7704e1a9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36]): potential dests added=[] removed=[] 2024-09-12T17:21:35.375 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.373+0000 7f7704e1a9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36.2.0 2024-09-12T17:21:35.375 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.373+0000 7f7704e1a9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36.2.0 2024-09-12T17:21:35.375 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.373+0000 7f7704e1a9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36.2.1 2024-09-12T17:21:35.375 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.373+0000 7f7704e1a9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36.2.1 2024-09-12T17:21:35.375 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.373+0000 7f7704e1a9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36.0 2024-09-12T17:21:35.381 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.381+0000 7f7704e1a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 : hit (requested=0x17, cached=0x17) 2024-09-12T17:21:35.381 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.381+0000 7f7704e1a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 2024-09-12T17:21:35.384 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.385+0000 7f7704e1a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 info.flags=0x17 2024-09-12T17:21:35.384 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.385+0000 7f7704e1a9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 to cache LRU end 2024-09-12T17:21:35.384 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.385+0000 7f7704e1a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:35.385 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.385+0000 7f7704e1a9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36, ofs0, ns] 2024-09-12T17:21:35.385 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.385+0000 7f75e67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431663 cookie 94504244708848 notifier 7731 bl.length()=923 2024-09-12T17:21:35.385 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.385+0000 7f75e67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 info.flags=0x17 2024-09-12T17:21:35.385 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.385+0000 7f75e67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 to cache LRU end 2024-09-12T17:21:35.385 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.385+0000 7f75e67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:35.386 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.385+0000 7f7704e1a9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36]): orig_sources= new_sources= 2024-09-12T17:21:35.386 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.385+0000 7f7704e1a9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36]): potential sources added=[] removed=[] 2024-09-12T17:21:35.386 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.385+0000 7f7704e1a9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36]): orig_dests= new_dests= 2024-09-12T17:21:35.386 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.385+0000 7f7704e1a9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36]): potential dests added=[] removed=[] 2024-09-12T17:21:35.389 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.389+0000 7f7704e1a9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36.0 2024-09-12T17:21:35.390 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.389+0000 7f7704e1a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 : hit (requested=0x17, cached=0x17) 2024-09-12T17:21:35.390 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.389+0000 7f7704e1a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 2024-09-12T17:21:35.393 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.393+0000 7f7704e1a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 info.flags=0x17 2024-09-12T17:21:35.393 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.393+0000 7f7704e1a9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 to cache LRU end 2024-09-12T17:21:35.393 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.393+0000 7f7704e1a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:35.393 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.393+0000 7f7704e1a9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36, ofs0, ns] 2024-09-12T17:21:35.394 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.393+0000 7f75e5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431664 cookie 94504244708848 notifier 7731 bl.length()=891 2024-09-12T17:21:35.394 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.393+0000 7f75e5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 info.flags=0x17 2024-09-12T17:21:35.394 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.393+0000 7f75e5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 to cache LRU end 2024-09-12T17:21:35.394 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.393+0000 7f75e5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:35.395 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.393+0000 7f7704e1a9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36]): orig_sources= new_sources= 2024-09-12T17:21:35.395 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.393+0000 7f7704e1a9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36]): potential sources added=[] removed=[] 2024-09-12T17:21:35.395 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.393+0000 7f7704e1a9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36]): orig_dests= new_dests= 2024-09-12T17:21:35.395 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.393+0000 7f7704e1a9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36]): potential dests added=[] removed=[] 2024-09-12T17:21:35.397 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.397+0000 7f7704e1a9c0 1 execute INFO: reshard of bucket "abort-at-logrecord-writes" from 1 shards to 2 shards completed successfully 2024-09-12T17:21:35.402 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.401+0000 7f75b97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:35.407 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.405+0000 7f7704e1a9c0 20 remove_watcher() i=0 2024-09-12T17:21:35.407 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.405+0000 7f7704e1a9c0 2 removed watcher, disabling cache 2024-09-12T17:21:35.409 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.409+0000 7f7704e1a9c0 20 remove_watcher() i=1 2024-09-12T17:21:35.411 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.409+0000 7f7704e1a9c0 20 remove_watcher() i=2 2024-09-12T17:21:35.413 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.413+0000 7f7704e1a9c0 20 remove_watcher() i=3 2024-09-12T17:21:35.416 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.413+0000 7f7704e1a9c0 20 remove_watcher() i=4 2024-09-12T17:21:35.417 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.417+0000 7f7704e1a9c0 20 remove_watcher() i=5 2024-09-12T17:21:35.419 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.417+0000 7f7704e1a9c0 20 remove_watcher() i=6 2024-09-12T17:21:35.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.421+0000 7f7704e1a9c0 20 remove_watcher() i=7 2024-09-12T17:21:35.439 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T17:21:35.471 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:21:35.471 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:21:35.518 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.517+0000 7fcc7bf819c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:35.520 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.517+0000 7fcc7bf819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:35.520 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.517+0000 7fcc7bf819c0 20 realm 2024-09-12T17:21:35.520 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.517+0000 7fcc7bf819c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:35.520 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.521+0000 7fcc7bf819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:35.520 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.521+0000 7fcc7bf819c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:21:35.520 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.521+0000 7fcc7bf819c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:35.521 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.521+0000 7fcc7bf819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:35.521 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.521+0000 7fcc7bf819c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:35.522 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.521+0000 7fcc7bf819c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:35.522 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.521+0000 7fcc7bf819c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:35.524 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.525+0000 7fcc7bf819c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:21:35.524 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.525+0000 7fcc7bf819c0 20 searching for the correct realm 2024-09-12T17:21:35.527 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.525+0000 7fcc7a288640 0 -- 172.21.15.16:0/1958035457 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fcc70063cf0 msgr2=0x7fcc7007e040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:21:35.536 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.537+0000 7fcc79286640 0 -- 172.21.15.16:0/1958035457 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fcc740c1400 msgr2=0x7fcc740c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:35.756 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.753+0000 7fcc7bf819c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:21:35.756 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.753+0000 7fcc7bf819c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:21:35.756 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.753+0000 7fcc7bf819c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:21:35.756 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.753+0000 7fcc7bf819c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:21:35.756 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.753+0000 7fcc7bf819c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:21:35.757 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.753+0000 7fcc7bf819c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:21:35.757 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.753+0000 7fcc7bf819c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:35.757 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.757+0000 7fcc7bf819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:35.757 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.757+0000 7fcc7bf819c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:35.758 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.757+0000 7fcc7bf819c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:35.758 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.757+0000 7fcc7bf819c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:35.759 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.757+0000 7fcc7bf819c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:21:35.759 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.757+0000 7fcc7bf819c0 20 zone default found 2024-09-12T17:21:35.759 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.757+0000 7fcc7bf819c0 4 Realm: () 2024-09-12T17:21:35.759 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.757+0000 7fcc7bf819c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:21:35.759 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.757+0000 7fcc7bf819c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:21:35.759 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.757+0000 7fcc7bf819c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:21:35.759 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.757+0000 7fcc7bf819c0 20 zonegroup default 2024-09-12T17:21:35.759 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.757+0000 7fcc7bf819c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:35.760 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.757+0000 7fcc7bf819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:35.760 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.757+0000 7fcc7bf819c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:35.760 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.761+0000 7fcc7bf819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:35.760 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.761+0000 7fcc7bf819c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:35.761 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.761+0000 7fcc7bf819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:35.761 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.761+0000 7fcc7bf819c0 20 started sync module instance, tier type = 2024-09-12T17:21:35.761 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.761+0000 7fcc7bf819c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:21:35.783 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.781+0000 7fcc7bf819c0 20 add_watcher() i=0 2024-09-12T17:21:35.783 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.781+0000 7fcc7bf819c0 20 add_watcher() i=1 2024-09-12T17:21:35.783 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.781+0000 7fcc7bf819c0 20 add_watcher() i=2 2024-09-12T17:21:35.784 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.781+0000 7fcc7bf819c0 20 add_watcher() i=3 2024-09-12T17:21:35.784 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.781+0000 7fcc7bf819c0 20 add_watcher() i=4 2024-09-12T17:21:35.784 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.781+0000 7fcc7bf819c0 20 add_watcher() i=5 2024-09-12T17:21:35.784 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.781+0000 7fcc7bf819c0 20 add_watcher() i=6 2024-09-12T17:21:35.785 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.785+0000 7fcc7bf819c0 20 add_watcher() i=7 2024-09-12T17:21:35.785 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.785+0000 7fcc7bf819c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:21:35.789 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.789+0000 7fcb2b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:35.790 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.789+0000 7fcc7bf819c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:21:35.790 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.789+0000 7fcc7bf819c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:21:35.790 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.789+0000 7fcc7bf819c0 5 note: GC not initialized 2024-09-12T17:21:35.791 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.789+0000 7fcb2a7fc640 20 reqs_thread_entry: start 2024-09-12T17:21:35.791 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.789+0000 7fcc7bf819c0 20 init_complete bucket index max shards: 1 2024-09-12T17:21:35.791 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.789+0000 7fcc7bf819c0 20 Filter name: none 2024-09-12T17:21:35.791 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.789+0000 7fca9bfff640 20 reqs_thread_entry: start 2024-09-12T17:21:35.791 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.789+0000 7fcc7bf819c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:35.792 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.789+0000 7fcc7bf819c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:21:35.792 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.789+0000 7fcc7bf819c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:35.793 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.793+0000 7fcc7bf819c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T17:21:35.793 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.793+0000 7fcc7bf819c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:21:35.793 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.793+0000 7fcc7bf819c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:35.794 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.793+0000 7fcc7bf819c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:21:35.794 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.793+0000 7fcc7bf819c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:35.795 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.793+0000 7fcc7bf819c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T17:21:35.795 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.793+0000 7fcc7bf819c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:21:35.798 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.797+0000 7fcb2b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:35.803 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.801+0000 7fcc7bf819c0 20 remove_watcher() i=0 2024-09-12T17:21:35.803 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.801+0000 7fcc7bf819c0 2 removed watcher, disabling cache 2024-09-12T17:21:35.805 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.805+0000 7fcc7bf819c0 20 remove_watcher() i=1 2024-09-12T17:21:35.807 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.805+0000 7fcc7bf819c0 20 remove_watcher() i=2 2024-09-12T17:21:35.809 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.809+0000 7fcc7bf819c0 20 remove_watcher() i=3 2024-09-12T17:21:35.812 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.813+0000 7fcc7bf819c0 20 remove_watcher() i=4 2024-09-12T17:21:35.813 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.813+0000 7fcc7bf819c0 20 remove_watcher() i=5 2024-09-12T17:21:35.815 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.813+0000 7fcc7bf819c0 20 remove_watcher() i=6 2024-09-12T17:21:35.817 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:35.817+0000 7fcc7bf819c0 20 remove_watcher() i=7 2024-09-12T17:21:35.832 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:35.833 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:21:35.833 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: abort-at-logrecord-writes id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:21:35.833 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:35.921 INFO:tasks.workunit.client.0.smithi016.stderr:TEST: reshard bucket with EIO injected at change_reshard_state 2024-09-12T17:21:35.921 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:36.376 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T17:21:36.410 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:21:36.411 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:21:36.458 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.457+0000 7f17562219c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:36.461 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.461+0000 7f17562219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:36.461 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.461+0000 7f17562219c0 20 realm 2024-09-12T17:21:36.461 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.461+0000 7f17562219c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:36.461 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.461+0000 7f17562219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:36.461 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.461+0000 7f17562219c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:21:36.461 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.461+0000 7f17562219c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:36.461 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.461+0000 7f17562219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:36.462 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.461+0000 7f17562219c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:36.463 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.461+0000 7f17562219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:36.463 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.461+0000 7f17562219c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:36.464 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.465+0000 7f17562219c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:21:36.464 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.465+0000 7f17562219c0 20 searching for the correct realm 2024-09-12T17:21:36.467 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.465+0000 7f1754528640 0 -- 172.21.15.16:0/2541304014 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f173c11c040 msgr2=0x7f173c0f6640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:36.683 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.681+0000 7f1753526640 0 -- 172.21.15.16:0/2541304014 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f174c067ad0 msgr2=0x7f174c002970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:36.900 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.901+0000 7f17562219c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:21:36.900 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.901+0000 7f17562219c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:21:36.901 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.901+0000 7f17562219c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:21:36.901 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.901+0000 7f17562219c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:21:36.901 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.901+0000 7f17562219c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:21:36.901 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.901+0000 7f17562219c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:21:36.901 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.901+0000 7f17562219c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:36.901 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.901+0000 7f17562219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:36.901 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.901+0000 7f17562219c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:36.902 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.901+0000 7f17562219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:36.902 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.901+0000 7f17562219c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:36.903 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.901+0000 7f17562219c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:21:36.903 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.901+0000 7f17562219c0 20 zone default found 2024-09-12T17:21:36.903 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.901+0000 7f17562219c0 4 Realm: () 2024-09-12T17:21:36.903 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.901+0000 7f17562219c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:21:36.903 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.901+0000 7f17562219c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:21:36.903 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.901+0000 7f17562219c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:21:36.903 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.901+0000 7f17562219c0 20 zonegroup default 2024-09-12T17:21:36.903 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.901+0000 7f17562219c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:36.903 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.901+0000 7f17562219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:36.904 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.901+0000 7f17562219c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:36.904 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.905+0000 7f17562219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:36.904 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.905+0000 7f17562219c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:36.905 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.905+0000 7f17562219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:36.905 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.905+0000 7f17562219c0 20 started sync module instance, tier type = 2024-09-12T17:21:36.905 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.905+0000 7f17562219c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:21:36.928 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.929+0000 7f17562219c0 20 add_watcher() i=0 2024-09-12T17:21:36.928 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.929+0000 7f17562219c0 20 add_watcher() i=1 2024-09-12T17:21:36.929 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.929+0000 7f17562219c0 20 add_watcher() i=2 2024-09-12T17:21:36.929 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.929+0000 7f17562219c0 20 add_watcher() i=3 2024-09-12T17:21:36.929 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.929+0000 7f17562219c0 20 add_watcher() i=4 2024-09-12T17:21:36.929 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.929+0000 7f17562219c0 20 add_watcher() i=5 2024-09-12T17:21:36.929 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.929+0000 7f17562219c0 20 add_watcher() i=6 2024-09-12T17:21:36.931 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.929+0000 7f17562219c0 20 add_watcher() i=7 2024-09-12T17:21:36.931 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.929+0000 7f17562219c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:21:36.935 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.933+0000 7f1609fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:36.936 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.933+0000 7f17562219c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:21:36.936 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.933+0000 7f17562219c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:21:36.936 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.933+0000 7f17562219c0 5 note: GC not initialized 2024-09-12T17:21:36.937 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.937+0000 7f1608fe1640 20 reqs_thread_entry: start 2024-09-12T17:21:36.937 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.937+0000 7f17562219c0 20 init_complete bucket index max shards: 1 2024-09-12T17:21:36.937 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.937+0000 7f17562219c0 20 Filter name: none 2024-09-12T17:21:36.937 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.937+0000 7f15827fc640 20 reqs_thread_entry: start 2024-09-12T17:21:36.937 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.937+0000 7f17562219c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:36.938 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.937+0000 7f17562219c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:21:36.938 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.937+0000 7f17562219c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:36.940 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.937+0000 7f17562219c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:21:36.940 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.937+0000 7f17562219c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:21:36.940 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.937+0000 7f17562219c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:36.941 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.941+0000 7f17562219c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:21:36.941 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.941+0000 7f17562219c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:36.944 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.941+0000 7f17562219c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:21:36.944 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.941+0000 7f17562219c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:21:36.945 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.945+0000 7f1609fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:36.949 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.949+0000 7f17562219c0 20 remove_watcher() i=0 2024-09-12T17:21:36.950 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.949+0000 7f17562219c0 2 removed watcher, disabling cache 2024-09-12T17:21:36.952 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.953+0000 7f17562219c0 20 remove_watcher() i=1 2024-09-12T17:21:36.954 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.953+0000 7f17562219c0 20 remove_watcher() i=2 2024-09-12T17:21:36.956 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.957+0000 7f17562219c0 20 remove_watcher() i=3 2024-09-12T17:21:36.959 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.957+0000 7f17562219c0 20 remove_watcher() i=4 2024-09-12T17:21:36.960 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.961+0000 7f17562219c0 20 remove_watcher() i=5 2024-09-12T17:21:36.961 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.961+0000 7f17562219c0 20 remove_watcher() i=6 2024-09-12T17:21:36.963 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:36.961+0000 7f17562219c0 20 remove_watcher() i=7 2024-09-12T17:21:36.978 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:36.978 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:21:36.978 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: error-at-change-reshard-state id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:21:36.978 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:36.978 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state 2024-09-12T17:21:37.013 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:21:37.013 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:21:37.060 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.057+0000 7f2d4a9b59c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:37.061 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.061+0000 7f2d4a9b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:37.061 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.061+0000 7f2d4a9b59c0 20 realm 2024-09-12T17:21:37.062 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.061+0000 7f2d4a9b59c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:37.062 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.061+0000 7f2d4a9b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:37.062 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.061+0000 7f2d4a9b59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:21:37.062 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.061+0000 7f2d4a9b59c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:37.062 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.061+0000 7f2d4a9b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:37.062 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.061+0000 7f2d4a9b59c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:37.063 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.061+0000 7f2d4a9b59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:37.064 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.061+0000 7f2d4a9b59c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:37.065 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.065+0000 7f2d4a9b59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:21:37.065 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.065+0000 7f2d4a9b59c0 20 searching for the correct realm 2024-09-12T17:21:37.068 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.069+0000 7f2d48cbc640 0 -- 172.21.15.16:0/1177957547 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f2d3c0624d0 msgr2=0x7f2d3c05d580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:37.076 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.073+0000 7f2d47cba640 0 -- 172.21.15.16:0/1177957547 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f2d4006bb00 msgr2=0x7f2d4007c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:37.291 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.289+0000 7f2d4a9b59c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:21:37.291 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.289+0000 7f2d4a9b59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:21:37.292 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.289+0000 7f2d4a9b59c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:21:37.292 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.289+0000 7f2d4a9b59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:21:37.292 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.289+0000 7f2d4a9b59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:21:37.292 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.289+0000 7f2d4a9b59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:21:37.292 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.289+0000 7f2d4a9b59c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:37.293 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.289+0000 7f2d4a9b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:37.294 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.289+0000 7f2d4a9b59c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:37.294 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.293+0000 7f2d4a9b59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:37.294 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.293+0000 7f2d4a9b59c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:37.295 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.293+0000 7f2d4a9b59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:21:37.295 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.293+0000 7f2d4a9b59c0 20 zone default found 2024-09-12T17:21:37.295 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.293+0000 7f2d4a9b59c0 4 Realm: () 2024-09-12T17:21:37.296 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.293+0000 7f2d4a9b59c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:21:37.296 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.293+0000 7f2d4a9b59c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:21:37.296 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.293+0000 7f2d4a9b59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:21:37.296 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.293+0000 7f2d4a9b59c0 20 zonegroup default 2024-09-12T17:21:37.296 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.293+0000 7f2d4a9b59c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:37.297 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.293+0000 7f2d4a9b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:37.297 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.293+0000 7f2d4a9b59c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:37.297 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.293+0000 7f2d4a9b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:37.297 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.293+0000 7f2d4a9b59c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:37.298 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.293+0000 7f2d4a9b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:37.298 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.293+0000 7f2d4a9b59c0 20 started sync module instance, tier type = 2024-09-12T17:21:37.298 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.293+0000 7f2d4a9b59c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:21:37.318 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.317+0000 7f2d4a9b59c0 20 add_watcher() i=0 2024-09-12T17:21:37.319 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.317+0000 7f2d4a9b59c0 20 add_watcher() i=1 2024-09-12T17:21:37.319 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.317+0000 7f2d4a9b59c0 20 add_watcher() i=2 2024-09-12T17:21:37.319 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.317+0000 7f2d4a9b59c0 20 add_watcher() i=3 2024-09-12T17:21:37.319 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.317+0000 7f2d4a9b59c0 20 add_watcher() i=4 2024-09-12T17:21:37.319 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.317+0000 7f2d4a9b59c0 20 add_watcher() i=5 2024-09-12T17:21:37.319 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.317+0000 7f2d4a9b59c0 20 add_watcher() i=6 2024-09-12T17:21:37.321 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.321+0000 7f2d4a9b59c0 20 add_watcher() i=7 2024-09-12T17:21:37.321 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.321+0000 7f2d4a9b59c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:21:37.325 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.325+0000 7f2bfe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:37.326 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.325+0000 7f2d4a9b59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:21:37.327 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.325+0000 7f2d4a9b59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:21:37.327 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.325+0000 7f2d4a9b59c0 5 note: GC not initialized 2024-09-12T17:21:37.328 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.325+0000 7f2bfd7e2640 20 reqs_thread_entry: start 2024-09-12T17:21:37.328 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.325+0000 7f2d4a9b59c0 20 init_complete bucket index max shards: 1 2024-09-12T17:21:37.328 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.325+0000 7f2d4a9b59c0 20 Filter name: none 2024-09-12T17:21:37.328 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.325+0000 7f2b6effd640 20 reqs_thread_entry: start 2024-09-12T17:21:37.328 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.325+0000 7f2d4a9b59c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T17:21:37.328 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.325+0000 7f2d4a9b59c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:37.329 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.329+0000 7f2d4a9b59c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:21:37.329 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.329+0000 7f2d4a9b59c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T17:21:37.329 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.329+0000 7f2d4a9b59c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T17:21:37.329 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.329+0000 7f2d4a9b59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37 : miss 2024-09-12T17:21:37.329 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.329+0000 7f2d4a9b59c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:37.330 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.329+0000 7f2d4a9b59c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:21:37.331 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.329+0000 7f2d4a9b59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37 info.flags=0x17 2024-09-12T17:21:37.331 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.329+0000 7f2d4a9b59c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37 to cache LRU end 2024-09-12T17:21:37.331 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.329+0000 7f2d4a9b59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:21:37.331 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.329+0000 7f2d4a9b59c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:37.331 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.329+0000 7f2d4a9b59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37 2024-09-12T17:21:37.339 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.337+0000 7f2d4a9b59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37 info.flags=0x17 2024-09-12T17:21:37.339 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.337+0000 7f2d4a9b59c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37 to cache LRU end 2024-09-12T17:21:37.339 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.337+0000 7f2d4a9b59c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:37.339 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.337+0000 7f2d4a9b59c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37, ofs0, ns] 2024-09-12T17:21:37.340 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.341+0000 7f2c1f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431616 cookie 93929388400720 notifier 7403 bl.length()=931 2024-09-12T17:21:37.340 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.341+0000 7f2c1f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37 info.flags=0x17 2024-09-12T17:21:37.340 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.341+0000 7f2c1f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37 to cache LRU end 2024-09-12T17:21:37.340 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.341+0000 7f2c1f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:37.341 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.341+0000 7f2d4a9b59c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37]): orig_sources= new_sources= 2024-09-12T17:21:37.341 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.341+0000 7f2d4a9b59c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37]): potential sources added=[] removed=[] 2024-09-12T17:21:37.341 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.341+0000 7f2d4a9b59c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37]): orig_dests= new_dests= 2024-09-12T17:21:37.342 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.341+0000 7f2d4a9b59c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37]): potential dests added=[] removed=[] 2024-09-12T17:21:37.347 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.345+0000 7f2d4a9b59c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37.1.0 2024-09-12T17:21:37.347 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.345+0000 7f2d4a9b59c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37.1.0 2024-09-12T17:21:37.347 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.345+0000 7f2d4a9b59c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37.1.1 2024-09-12T17:21:37.347 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.345+0000 7f2d4a9b59c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37.1.1 2024-09-12T17:21:37.347 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.345+0000 7f2d4a9b59c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37.0 2024-09-12T17:21:37.352 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.349+0000 7f2d4a9b59c0 -1 Injecting error=-5 at location=change_reshard_state 2024-09-12T17:21:37.352 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.353+0000 7f2d4a9b59c0 0 ERROR: change_reshard_state failed to commit target index layout: (5) Input/output error 2024-09-12T17:21:37.362 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.361+0000 7f2d4a9b59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37 : hit (requested=0x17, cached=0x17) 2024-09-12T17:21:37.362 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.361+0000 7f2d4a9b59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37 2024-09-12T17:21:37.365 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.365+0000 7f2d4a9b59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37 info.flags=0x17 2024-09-12T17:21:37.365 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.365+0000 7f2d4a9b59c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37 to cache LRU end 2024-09-12T17:21:37.365 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.365+0000 7f2d4a9b59c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:37.365 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.365+0000 7f2d4a9b59c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37, ofs0, ns] 2024-09-12T17:21:37.366 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.365+0000 7f2c1effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431617 cookie 93929388400720 notifier 7403 bl.length()=899 2024-09-12T17:21:37.366 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.365+0000 7f2c1effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37 info.flags=0x17 2024-09-12T17:21:37.366 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.365+0000 7f2c1effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37 to cache LRU end 2024-09-12T17:21:37.366 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.365+0000 7f2c1effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:37.367 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.365+0000 7f2d4a9b59c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37]): orig_sources= new_sources= 2024-09-12T17:21:37.367 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.365+0000 7f2d4a9b59c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37]): potential sources added=[] removed=[] 2024-09-12T17:21:37.367 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.365+0000 7f2d4a9b59c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37]): orig_dests= new_dests= 2024-09-12T17:21:37.367 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.365+0000 7f2d4a9b59c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37]): potential dests added=[] removed=[] 2024-09-12T17:21:37.367 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.365+0000 7f2d4a9b59c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" canceled due to errors 2024-09-12T17:21:37.370 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.369+0000 7f2bfe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:37.375 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.373+0000 7f2d4a9b59c0 20 remove_watcher() i=0 2024-09-12T17:21:37.375 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.373+0000 7f2d4a9b59c0 2 removed watcher, disabling cache 2024-09-12T17:21:37.377 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.377+0000 7f2d4a9b59c0 20 remove_watcher() i=1 2024-09-12T17:21:37.380 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.377+0000 7f2d4a9b59c0 20 remove_watcher() i=2 2024-09-12T17:21:37.382 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.381+0000 7f2d4a9b59c0 20 remove_watcher() i=3 2024-09-12T17:21:37.384 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.385+0000 7f2d4a9b59c0 20 remove_watcher() i=4 2024-09-12T17:21:37.386 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.385+0000 7f2d4a9b59c0 20 remove_watcher() i=5 2024-09-12T17:21:37.387 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.385+0000 7f2d4a9b59c0 20 remove_watcher() i=6 2024-09-12T17:21:37.389 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.389+0000 7f2d4a9b59c0 20 remove_watcher() i=7 2024-09-12T17:21:37.404 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T17:21:37.432 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:21:37.432 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:21:37.479 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.477+0000 7f64a1a5a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:37.481 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.481+0000 7f64a1a5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:37.481 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.481+0000 7f64a1a5a9c0 20 realm 2024-09-12T17:21:37.481 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.481+0000 7f64a1a5a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:37.482 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.481+0000 7f64a1a5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:37.482 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.481+0000 7f64a1a5a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:21:37.482 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.481+0000 7f64a1a5a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:37.482 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.481+0000 7f64a1a5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:37.482 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.481+0000 7f64a1a5a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:37.483 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.481+0000 7f64a1a5a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:37.483 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.481+0000 7f64a1a5a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:37.484 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.485+0000 7f64a1a5a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:21:37.485 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.485+0000 7f64a1a5a9c0 20 searching for the correct realm 2024-09-12T17:21:37.488 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.489+0000 7f649ed5f640 0 -- 172.21.15.16:0/40739674 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7f64900c0020 msgr2=0x7f64901330e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:21:37.496 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.497+0000 7f649ed5f640 0 -- 172.21.15.16:0/40739674 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f6498033410 msgr2=0x7f6498033890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:37.715 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.713+0000 7f64a1a5a9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:21:37.715 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.713+0000 7f64a1a5a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:21:37.715 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.713+0000 7f64a1a5a9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:21:37.715 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.713+0000 7f64a1a5a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:21:37.715 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.713+0000 7f64a1a5a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:21:37.716 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.713+0000 7f64a1a5a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:21:37.716 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.713+0000 7f64a1a5a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:37.716 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.713+0000 7f64a1a5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:37.716 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.713+0000 7f64a1a5a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:37.716 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.717+0000 7f64a1a5a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:37.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.717+0000 7f64a1a5a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:37.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.717+0000 7f64a1a5a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:21:37.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.717+0000 7f64a1a5a9c0 20 zone default found 2024-09-12T17:21:37.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.717+0000 7f64a1a5a9c0 4 Realm: () 2024-09-12T17:21:37.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.717+0000 7f64a1a5a9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:21:37.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.717+0000 7f64a1a5a9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:21:37.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.717+0000 7f64a1a5a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:21:37.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.717+0000 7f64a1a5a9c0 20 zonegroup default 2024-09-12T17:21:37.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.717+0000 7f64a1a5a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:37.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.717+0000 7f64a1a5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:37.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.717+0000 7f64a1a5a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:37.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.717+0000 7f64a1a5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:37.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.717+0000 7f64a1a5a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:37.720 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.717+0000 7f64a1a5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:37.720 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.721+0000 7f64a1a5a9c0 20 started sync module instance, tier type = 2024-09-12T17:21:37.720 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.721+0000 7f64a1a5a9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:21:37.744 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.741+0000 7f64a1a5a9c0 20 add_watcher() i=0 2024-09-12T17:21:37.744 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.741+0000 7f64a1a5a9c0 20 add_watcher() i=1 2024-09-12T17:21:37.744 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.741+0000 7f64a1a5a9c0 20 add_watcher() i=2 2024-09-12T17:21:37.744 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.741+0000 7f64a1a5a9c0 20 add_watcher() i=3 2024-09-12T17:21:37.744 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.741+0000 7f64a1a5a9c0 20 add_watcher() i=4 2024-09-12T17:21:37.744 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.741+0000 7f64a1a5a9c0 20 add_watcher() i=5 2024-09-12T17:21:37.744 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.741+0000 7f64a1a5a9c0 20 add_watcher() i=6 2024-09-12T17:21:37.746 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.745+0000 7f64a1a5a9c0 20 add_watcher() i=7 2024-09-12T17:21:37.746 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.745+0000 7f64a1a5a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:21:37.750 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.749+0000 7f6355fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:37.751 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.749+0000 7f64a1a5a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:21:37.751 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.749+0000 7f64a1a5a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:21:37.751 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.749+0000 7f64a1a5a9c0 5 note: GC not initialized 2024-09-12T17:21:37.752 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.749+0000 7f6354fe1640 20 reqs_thread_entry: start 2024-09-12T17:21:37.752 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.749+0000 7f64a1a5a9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:21:37.752 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.753+0000 7f64a1a5a9c0 20 Filter name: none 2024-09-12T17:21:37.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.753+0000 7f62ce7fc640 20 reqs_thread_entry: start 2024-09-12T17:21:37.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.753+0000 7f64a1a5a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:37.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.753+0000 7f64a1a5a9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:21:37.754 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.753+0000 7f64a1a5a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:37.755 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.753+0000 7f64a1a5a9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:21:37.755 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.753+0000 7f64a1a5a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:21:37.755 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.753+0000 7f64a1a5a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:37.756 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.757+0000 7f64a1a5a9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:21:37.756 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.757+0000 7f64a1a5a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:37.757 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.757+0000 7f64a1a5a9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:21:37.757 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.757+0000 7f64a1a5a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:21:37.760 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.757+0000 7f6355fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:37.765 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.765+0000 7f64a1a5a9c0 20 remove_watcher() i=0 2024-09-12T17:21:37.765 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.765+0000 7f64a1a5a9c0 2 removed watcher, disabling cache 2024-09-12T17:21:37.768 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.765+0000 7f64a1a5a9c0 20 remove_watcher() i=1 2024-09-12T17:21:37.770 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.769+0000 7f64a1a5a9c0 20 remove_watcher() i=2 2024-09-12T17:21:37.772 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.773+0000 7f64a1a5a9c0 20 remove_watcher() i=3 2024-09-12T17:21:37.775 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.773+0000 7f64a1a5a9c0 20 remove_watcher() i=4 2024-09-12T17:21:37.776 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.777+0000 7f64a1a5a9c0 20 remove_watcher() i=5 2024-09-12T17:21:37.778 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.777+0000 7f64a1a5a9c0 20 remove_watcher() i=6 2024-09-12T17:21:37.780 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.777+0000 7f64a1a5a9c0 20 remove_watcher() i=7 2024-09-12T17:21:37.795 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:37.795 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:21:37.795 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: error-at-change-reshard-state id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:21:37.796 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:37.854 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:21:37.891 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:21:37.891 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:21:37.941 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.941+0000 7f0b5adfb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:37.942 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.941+0000 7f0b5adfb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:37.942 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.941+0000 7f0b5adfb9c0 20 realm 2024-09-12T17:21:37.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.941+0000 7f0b5adfb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:37.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.941+0000 7f0b5adfb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:37.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.941+0000 7f0b5adfb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:21:37.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.941+0000 7f0b5adfb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:37.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.941+0000 7f0b5adfb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:37.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.941+0000 7f0b5adfb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:37.944 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.945+0000 7f0b5adfb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:37.944 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.945+0000 7f0b5adfb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:37.946 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.945+0000 7f0b5adfb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:21:37.946 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.945+0000 7f0b5adfb9c0 20 searching for the correct realm 2024-09-12T17:21:37.947 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:37.945+0000 7f0b58100640 0 -- 172.21.15.16:0/3254097100 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7f0b4812cc20 msgr2=0x7f0b480f5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:38.161 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.161+0000 7f0b59102640 0 -- 172.21.15.16:0/3254097100 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f0b4c008040 msgr2=0x7f0b4c059400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:38.179 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.177+0000 7f0b5adfb9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:21:38.180 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.177+0000 7f0b5adfb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:21:38.180 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.177+0000 7f0b5adfb9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:21:38.180 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.177+0000 7f0b5adfb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:21:38.180 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.177+0000 7f0b5adfb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:21:38.180 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.177+0000 7f0b5adfb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:21:38.180 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.177+0000 7f0b5adfb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.180 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.177+0000 7f0b5adfb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:38.181 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.177+0000 7f0b5adfb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.181 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.181+0000 7f0b5adfb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:38.181 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.181+0000 7f0b5adfb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.182 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.181+0000 7f0b5adfb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:21:38.183 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.181+0000 7f0b5adfb9c0 20 zone default found 2024-09-12T17:21:38.183 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.181+0000 7f0b5adfb9c0 4 Realm: () 2024-09-12T17:21:38.183 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.181+0000 7f0b5adfb9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:21:38.183 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.181+0000 7f0b5adfb9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:21:38.183 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.181+0000 7f0b5adfb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:21:38.183 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.181+0000 7f0b5adfb9c0 20 zonegroup default 2024-09-12T17:21:38.183 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.181+0000 7f0b5adfb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.184 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.181+0000 7f0b5adfb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:38.184 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.181+0000 7f0b5adfb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.184 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.181+0000 7f0b5adfb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:38.184 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.181+0000 7f0b5adfb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.185 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.185+0000 7f0b5adfb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:38.185 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.185+0000 7f0b5adfb9c0 20 started sync module instance, tier type = 2024-09-12T17:21:38.185 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.185+0000 7f0b5adfb9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:21:38.206 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.205+0000 7f0b5adfb9c0 20 add_watcher() i=0 2024-09-12T17:21:38.206 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.205+0000 7f0b5adfb9c0 20 add_watcher() i=1 2024-09-12T17:21:38.207 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.205+0000 7f0b5adfb9c0 20 add_watcher() i=2 2024-09-12T17:21:38.207 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.205+0000 7f0b5adfb9c0 20 add_watcher() i=3 2024-09-12T17:21:38.207 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.205+0000 7f0b5adfb9c0 20 add_watcher() i=4 2024-09-12T17:21:38.207 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.205+0000 7f0b5adfb9c0 20 add_watcher() i=5 2024-09-12T17:21:38.207 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.205+0000 7f0b5adfb9c0 20 add_watcher() i=6 2024-09-12T17:21:38.209 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.209+0000 7f0b5adfb9c0 20 add_watcher() i=7 2024-09-12T17:21:38.209 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.209+0000 7f0b5adfb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:21:38.213 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.213+0000 7f0a0b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:38.214 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.213+0000 7f0b5adfb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:21:38.214 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.213+0000 7f0b5adfb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:21:38.214 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.213+0000 7f0b5adfb9c0 5 note: GC not initialized 2024-09-12T17:21:38.215 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.213+0000 7f0a0a7e4640 20 reqs_thread_entry: start 2024-09-12T17:21:38.215 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.213+0000 7f0b5adfb9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:21:38.215 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.213+0000 7f0b5adfb9c0 20 Filter name: none 2024-09-12T17:21:38.215 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.213+0000 7f0a03fff640 20 reqs_thread_entry: start 2024-09-12T17:21:38.215 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.213+0000 7f0b5adfb9c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T17:21:38.215 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.213+0000 7f0b5adfb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.216 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.217+0000 7f0b5adfb9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:21:38.216 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.217+0000 7f0b5adfb9c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T17:21:38.216 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.217+0000 7f0b5adfb9c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T17:21:38.216 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.217+0000 7f0b5adfb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37 : miss 2024-09-12T17:21:38.217 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.217+0000 7f0b5adfb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.217 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.217+0000 7f0b5adfb9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:21:38.217 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.217+0000 7f0b5adfb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37 info.flags=0x17 2024-09-12T17:21:38.217 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.217+0000 7f0b5adfb9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37 to cache LRU end 2024-09-12T17:21:38.218 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.217+0000 7f0b5adfb9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:21:38.218 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.217+0000 7f0b5adfb9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:38.218 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.217+0000 7f0b5adfb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37 2024-09-12T17:21:38.225 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.225+0000 7f0b5adfb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37 info.flags=0x17 2024-09-12T17:21:38.225 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.225+0000 7f0b5adfb9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37 to cache LRU end 2024-09-12T17:21:38.225 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.225+0000 7f0b5adfb9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:38.225 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.225+0000 7f0b5adfb9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37, ofs0, ns] 2024-09-12T17:21:38.226 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.225+0000 7f0a27fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431618 cookie 94464274909008 notifier 7439 bl.length()=931 2024-09-12T17:21:38.226 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.225+0000 7f0a27fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37 info.flags=0x17 2024-09-12T17:21:38.226 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.225+0000 7f0a27fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37 to cache LRU end 2024-09-12T17:21:38.226 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.225+0000 7f0a27fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:38.227 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.225+0000 7f0b5adfb9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37]): orig_sources= new_sources= 2024-09-12T17:21:38.227 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.225+0000 7f0b5adfb9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37]): potential sources added=[] removed=[] 2024-09-12T17:21:38.227 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.225+0000 7f0b5adfb9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37]): orig_dests= new_dests= 2024-09-12T17:21:38.227 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.225+0000 7f0b5adfb9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37]): potential dests added=[] removed=[] 2024-09-12T17:21:38.232 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.229+0000 7f0b5adfb9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37.1.0 2024-09-12T17:21:38.232 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.229+0000 7f0b5adfb9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37.1.0 2024-09-12T17:21:38.232 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.229+0000 7f0b5adfb9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37.1.1 2024-09-12T17:21:38.232 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.229+0000 7f0b5adfb9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37.1.1 2024-09-12T17:21:38.232 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.233+0000 7f0b5adfb9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37.0 2024-09-12T17:21:38.236 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.237+0000 7f0b5adfb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37 : hit (requested=0x17, cached=0x17) 2024-09-12T17:21:38.237 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.237+0000 7f0b5adfb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37 2024-09-12T17:21:38.239 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.237+0000 7f0b5adfb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37 info.flags=0x17 2024-09-12T17:21:38.239 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.237+0000 7f0b5adfb9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37 to cache LRU end 2024-09-12T17:21:38.239 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.237+0000 7f0b5adfb9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:38.239 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.237+0000 7f0b5adfb9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37, ofs0, ns] 2024-09-12T17:21:38.240 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.241+0000 7f0a27fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431619 cookie 94464274909008 notifier 7439 bl.length()=931 2024-09-12T17:21:38.240 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.241+0000 7f0a27fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37 info.flags=0x17 2024-09-12T17:21:38.240 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.241+0000 7f0a27fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37 to cache LRU end 2024-09-12T17:21:38.240 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.241+0000 7f0a27fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:38.241 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.241+0000 7f0b5adfb9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37]): orig_sources= new_sources= 2024-09-12T17:21:38.241 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.241+0000 7f0b5adfb9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37]): potential sources added=[] removed=[] 2024-09-12T17:21:38.241 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.241+0000 7f0b5adfb9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37]): orig_dests= new_dests= 2024-09-12T17:21:38.241 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.241+0000 7f0b5adfb9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37]): potential dests added=[] removed=[] 2024-09-12T17:21:38.243 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.241+0000 7f0b5adfb9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37.0 2024-09-12T17:21:38.244 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.245+0000 7f0b5adfb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37 : hit (requested=0x17, cached=0x17) 2024-09-12T17:21:38.245 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.245+0000 7f0b5adfb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37 2024-09-12T17:21:38.247 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.245+0000 7f0b5adfb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37 info.flags=0x17 2024-09-12T17:21:38.248 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.245+0000 7f0b5adfb9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37 to cache LRU end 2024-09-12T17:21:38.248 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.245+0000 7f0b5adfb9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:38.248 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.245+0000 7f0b5adfb9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37, ofs0, ns] 2024-09-12T17:21:38.249 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.249+0000 7f0a277fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431620 cookie 94464274909008 notifier 7439 bl.length()=899 2024-09-12T17:21:38.249 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.249+0000 7f0a277fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37 info.flags=0x17 2024-09-12T17:21:38.249 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.249+0000 7f0a277fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37 to cache LRU end 2024-09-12T17:21:38.249 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.249+0000 7f0a277fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:38.250 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.249+0000 7f0b5adfb9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37]): orig_sources= new_sources= 2024-09-12T17:21:38.250 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.249+0000 7f0b5adfb9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37]): potential sources added=[] removed=[] 2024-09-12T17:21:38.250 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.249+0000 7f0b5adfb9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37]): orig_dests= new_dests= 2024-09-12T17:21:38.250 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.249+0000 7f0b5adfb9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37]): potential dests added=[] removed=[] 2024-09-12T17:21:38.252 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.253+0000 7f0b5adfb9c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 1 shards to 2 shards completed successfully 2024-09-12T17:21:38.256 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.257+0000 7f0a0b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:38.261 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.261+0000 7f0b5adfb9c0 20 remove_watcher() i=0 2024-09-12T17:21:38.261 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.261+0000 7f0b5adfb9c0 2 removed watcher, disabling cache 2024-09-12T17:21:38.264 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.261+0000 7f0b5adfb9c0 20 remove_watcher() i=1 2024-09-12T17:21:38.266 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.265+0000 7f0b5adfb9c0 20 remove_watcher() i=2 2024-09-12T17:21:38.268 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.269+0000 7f0b5adfb9c0 20 remove_watcher() i=3 2024-09-12T17:21:38.271 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.269+0000 7f0b5adfb9c0 20 remove_watcher() i=4 2024-09-12T17:21:38.272 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.273+0000 7f0b5adfb9c0 20 remove_watcher() i=5 2024-09-12T17:21:38.274 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.273+0000 7f0b5adfb9c0 20 remove_watcher() i=6 2024-09-12T17:21:38.276 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.273+0000 7f0b5adfb9c0 20 remove_watcher() i=7 2024-09-12T17:21:38.297 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T17:21:38.329 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:21:38.329 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:21:38.377 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.377+0000 7f8088ee69c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.379 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.377+0000 7f8088ee69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:38.379 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.377+0000 7f8088ee69c0 20 realm 2024-09-12T17:21:38.379 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.377+0000 7f8088ee69c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.379 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.377+0000 7f8088ee69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:38.379 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.377+0000 7f8088ee69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:21:38.379 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.377+0000 7f8088ee69c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.379 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.377+0000 7f8088ee69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:38.379 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.377+0000 7f8088ee69c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.381 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.381+0000 7f8088ee69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:38.381 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.381+0000 7f8088ee69c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.384 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.381+0000 7f8088ee69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:21:38.384 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.381+0000 7f8088ee69c0 20 searching for the correct realm 2024-09-12T17:21:38.386 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.385+0000 7f80871ed640 0 -- 172.21.15.16:0/4090726054 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f807c04c040 msgr2=0x7f807c04c930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:38.393 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.393+0000 7f80861eb640 0 -- 172.21.15.16:0/4090726054 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f808008c3f0 msgr2=0x7f80800619c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:38.613 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.613+0000 7f8088ee69c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:21:38.613 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.613+0000 7f8088ee69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:21:38.613 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.613+0000 7f8088ee69c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:21:38.613 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.613+0000 7f8088ee69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:21:38.613 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.613+0000 7f8088ee69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:21:38.613 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.613+0000 7f8088ee69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:21:38.613 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.613+0000 7f8088ee69c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.613 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.613+0000 7f8088ee69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:38.613 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.613+0000 7f8088ee69c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.614 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.613+0000 7f8088ee69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:38.614 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.613+0000 7f8088ee69c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.614 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.613+0000 7f8088ee69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:21:38.614 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.613+0000 7f8088ee69c0 20 zone default found 2024-09-12T17:21:38.615 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.613+0000 7f8088ee69c0 4 Realm: () 2024-09-12T17:21:38.615 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.613+0000 7f8088ee69c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:21:38.615 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.613+0000 7f8088ee69c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:21:38.615 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.613+0000 7f8088ee69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:21:38.615 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.613+0000 7f8088ee69c0 20 zonegroup default 2024-09-12T17:21:38.615 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.613+0000 7f8088ee69c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.615 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.613+0000 7f8088ee69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:38.615 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.613+0000 7f8088ee69c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.616 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.613+0000 7f8088ee69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:38.616 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.613+0000 7f8088ee69c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.616 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.617+0000 7f8088ee69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:38.617 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.617+0000 7f8088ee69c0 20 started sync module instance, tier type = 2024-09-12T17:21:38.617 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.617+0000 7f8088ee69c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:21:38.640 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.641+0000 7f8088ee69c0 20 add_watcher() i=0 2024-09-12T17:21:38.641 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.641+0000 7f8088ee69c0 20 add_watcher() i=1 2024-09-12T17:21:38.641 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.641+0000 7f8088ee69c0 20 add_watcher() i=2 2024-09-12T17:21:38.641 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.641+0000 7f8088ee69c0 20 add_watcher() i=3 2024-09-12T17:21:38.641 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.641+0000 7f8088ee69c0 20 add_watcher() i=4 2024-09-12T17:21:38.641 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.641+0000 7f8088ee69c0 20 add_watcher() i=5 2024-09-12T17:21:38.641 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.641+0000 7f8088ee69c0 20 add_watcher() i=6 2024-09-12T17:21:38.643 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.641+0000 7f8088ee69c0 20 add_watcher() i=7 2024-09-12T17:21:38.643 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.641+0000 7f8088ee69c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:21:38.647 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.645+0000 7f7f3d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:38.648 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.645+0000 7f8088ee69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:21:38.648 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.645+0000 7f8088ee69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:21:38.648 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.645+0000 7f8088ee69c0 5 note: GC not initialized 2024-09-12T17:21:38.649 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.649+0000 7f7eb7fff640 20 reqs_thread_entry: start 2024-09-12T17:21:38.649 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.649+0000 7f8088ee69c0 20 init_complete bucket index max shards: 1 2024-09-12T17:21:38.649 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.649+0000 7f8088ee69c0 20 Filter name: none 2024-09-12T17:21:38.649 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.649+0000 7f7eb5ffb640 20 reqs_thread_entry: start 2024-09-12T17:21:38.650 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.649+0000 7f8088ee69c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.651 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.649+0000 7f8088ee69c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:21:38.651 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.649+0000 7f8088ee69c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.652 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.649+0000 7f8088ee69c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:21:38.652 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.649+0000 7f8088ee69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:21:38.652 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.649+0000 7f8088ee69c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.653 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.653+0000 7f8088ee69c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:21:38.653 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.653+0000 7f8088ee69c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:38.654 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.653+0000 7f8088ee69c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:21:38.654 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.653+0000 7f8088ee69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:21:38.657 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.657+0000 7f7f3d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:38.662 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.661+0000 7f8088ee69c0 20 remove_watcher() i=0 2024-09-12T17:21:38.662 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.661+0000 7f8088ee69c0 2 removed watcher, disabling cache 2024-09-12T17:21:38.664 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.665+0000 7f8088ee69c0 20 remove_watcher() i=1 2024-09-12T17:21:38.666 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.665+0000 7f8088ee69c0 20 remove_watcher() i=2 2024-09-12T17:21:38.668 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.669+0000 7f8088ee69c0 20 remove_watcher() i=3 2024-09-12T17:21:38.671 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.669+0000 7f8088ee69c0 20 remove_watcher() i=4 2024-09-12T17:21:38.672 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.673+0000 7f8088ee69c0 20 remove_watcher() i=5 2024-09-12T17:21:38.674 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.673+0000 7f8088ee69c0 20 remove_watcher() i=6 2024-09-12T17:21:38.676 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:38.677+0000 7f8088ee69c0 20 remove_watcher() i=7 2024-09-12T17:21:38.694 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:38.694 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:21:38.695 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: error-at-change-reshard-state id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:21:38.695 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:38.770 INFO:tasks.workunit.client.0.smithi016.stderr:TEST: reshard bucket with ECANCELED injected at change_reshard_state 2024-09-12T17:21:38.770 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:39.205 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T17:21:39.238 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:21:39.238 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:21:39.287 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.285+0000 7fb6d789a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:39.288 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.289+0000 7fb6d789a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:39.289 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.289+0000 7fb6d789a9c0 20 realm 2024-09-12T17:21:39.289 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.289+0000 7fb6d789a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:39.289 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.289+0000 7fb6d789a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:39.289 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.289+0000 7fb6d789a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:21:39.290 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.289+0000 7fb6d789a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:39.290 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.289+0000 7fb6d789a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:39.290 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.289+0000 7fb6d789a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:39.291 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.289+0000 7fb6d789a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:39.291 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.289+0000 7fb6d789a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:39.293 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.293+0000 7fb6d789a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:21:39.293 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.293+0000 7fb6d789a9c0 20 searching for the correct realm 2024-09-12T17:21:39.293 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.293+0000 7fb6d53a0640 0 -- 172.21.15.16:0/994845604 >> [v2:172.21.15.16:6824/465585330,v1:172.21.15.16:6825/465585330] conn(0x55ccbdf6d220 msgr2=0x55ccbdf6f6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:39.299 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.297+0000 7fb6d53a0640 0 -- 172.21.15.16:0/994845604 >> [v2:172.21.15.19:6802/36415917,v1:172.21.15.19:6804/36415917] conn(0x7fb6d00ca070 msgr2=0x7fb6d011a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:39.523 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.520+0000 7fb6d789a9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:21:39.523 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.520+0000 7fb6d789a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:21:39.523 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.520+0000 7fb6d789a9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:21:39.523 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.520+0000 7fb6d789a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:21:39.523 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.520+0000 7fb6d789a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:21:39.523 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.520+0000 7fb6d789a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:21:39.523 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.520+0000 7fb6d789a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:39.524 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.520+0000 7fb6d789a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:39.524 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.520+0000 7fb6d789a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:39.524 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.524+0000 7fb6d789a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:39.524 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.524+0000 7fb6d789a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:39.525 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.524+0000 7fb6d789a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:21:39.526 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.524+0000 7fb6d789a9c0 20 zone default found 2024-09-12T17:21:39.526 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.524+0000 7fb6d789a9c0 4 Realm: () 2024-09-12T17:21:39.526 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.524+0000 7fb6d789a9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:21:39.526 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.524+0000 7fb6d789a9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:21:39.526 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.524+0000 7fb6d789a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:21:39.526 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.524+0000 7fb6d789a9c0 20 zonegroup default 2024-09-12T17:21:39.526 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.524+0000 7fb6d789a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:39.526 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.524+0000 7fb6d789a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:39.527 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.524+0000 7fb6d789a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:39.527 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.524+0000 7fb6d789a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:39.527 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.524+0000 7fb6d789a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:39.528 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.524+0000 7fb6d789a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:39.528 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.528+0000 7fb6d789a9c0 20 started sync module instance, tier type = 2024-09-12T17:21:39.528 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.528+0000 7fb6d789a9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:21:39.553 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.552+0000 7fb6d789a9c0 20 add_watcher() i=0 2024-09-12T17:21:39.553 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.552+0000 7fb6d789a9c0 20 add_watcher() i=1 2024-09-12T17:21:39.553 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.552+0000 7fb6d789a9c0 20 add_watcher() i=2 2024-09-12T17:21:39.553 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.552+0000 7fb6d789a9c0 20 add_watcher() i=3 2024-09-12T17:21:39.554 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.552+0000 7fb6d789a9c0 20 add_watcher() i=4 2024-09-12T17:21:39.554 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.552+0000 7fb6d789a9c0 20 add_watcher() i=5 2024-09-12T17:21:39.554 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.552+0000 7fb6d789a9c0 20 add_watcher() i=6 2024-09-12T17:21:39.555 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.552+0000 7fb6d789a9c0 20 add_watcher() i=7 2024-09-12T17:21:39.556 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.552+0000 7fb6d789a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:21:39.561 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.560+0000 7fb58bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:39.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.560+0000 7fb6d789a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:21:39.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.560+0000 7fb6d789a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:21:39.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.560+0000 7fb6d789a9c0 5 note: GC not initialized 2024-09-12T17:21:39.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.560+0000 7fb58afe5640 20 reqs_thread_entry: start 2024-09-12T17:21:39.563 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.560+0000 7fb6d789a9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:21:39.563 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.560+0000 7fb6d789a9c0 20 Filter name: none 2024-09-12T17:21:39.563 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.560+0000 7fb588fe1640 20 reqs_thread_entry: start 2024-09-12T17:21:39.563 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.560+0000 7fb6d789a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:39.565 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.564+0000 7fb6d789a9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:21:39.565 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.564+0000 7fb6d789a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:39.566 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.564+0000 7fb6d789a9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:21:39.566 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.564+0000 7fb6d789a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:21:39.566 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.564+0000 7fb6d789a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:39.567 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.564+0000 7fb6d789a9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:21:39.567 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.564+0000 7fb6d789a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:39.568 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.564+0000 7fb6d789a9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:21:39.568 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.564+0000 7fb6d789a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:21:39.570 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.568+0000 7fb58bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:39.575 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.572+0000 7fb6d789a9c0 20 remove_watcher() i=0 2024-09-12T17:21:39.575 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.572+0000 7fb6d789a9c0 2 removed watcher, disabling cache 2024-09-12T17:21:39.577 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.576+0000 7fb6d789a9c0 20 remove_watcher() i=1 2024-09-12T17:21:39.580 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.576+0000 7fb6d789a9c0 20 remove_watcher() i=2 2024-09-12T17:21:39.582 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.580+0000 7fb6d789a9c0 20 remove_watcher() i=3 2024-09-12T17:21:39.584 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.584+0000 7fb6d789a9c0 20 remove_watcher() i=4 2024-09-12T17:21:39.586 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.584+0000 7fb6d789a9c0 20 remove_watcher() i=5 2024-09-12T17:21:39.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.584+0000 7fb6d789a9c0 20 remove_watcher() i=6 2024-09-12T17:21:39.589 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.588+0000 7fb6d789a9c0 20 remove_watcher() i=7 2024-09-12T17:21:39.605 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:39.605 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:21:39.605 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: error-at-change-reshard-state id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:21:39.605 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:39.605 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state --inject-error-code 125 2024-09-12T17:21:39.646 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:21:39.646 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:21:39.695 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.692+0000 7f89342799c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:39.697 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.696+0000 7f89342799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:39.697 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.696+0000 7f89342799c0 20 realm 2024-09-12T17:21:39.697 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.696+0000 7f89342799c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:39.697 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.696+0000 7f89342799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:39.697 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.696+0000 7f89342799c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:21:39.697 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.696+0000 7f89342799c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:39.697 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.696+0000 7f89342799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:39.697 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.696+0000 7f89342799c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:39.699 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.696+0000 7f89342799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:39.699 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.696+0000 7f89342799c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:39.701 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.700+0000 7f89342799c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:21:39.701 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.700+0000 7f89342799c0 20 searching for the correct realm 2024-09-12T17:21:39.701 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.700+0000 7f8931d7f640 0 -- 172.21.15.16:0/999198454 >> [v2:172.21.15.16:6824/465585330,v1:172.21.15.16:6825/465585330] conn(0x558a0927b7d0 msgr2=0x558a0927dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:39.915 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:39.912+0000 7f8931d7f640 0 -- 172.21.15.16:0/999198454 >> [v2:172.21.15.19:6802/36415917,v1:172.21.15.19:6804/36415917] conn(0x7f892c0c3060 msgr2=0x7f892c135040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:40.139 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.136+0000 7f89342799c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:21:40.139 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.136+0000 7f89342799c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:21:40.139 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.136+0000 7f89342799c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:21:40.139 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.136+0000 7f89342799c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:21:40.139 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.136+0000 7f89342799c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:21:40.139 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.136+0000 7f89342799c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:21:40.139 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.136+0000 7f89342799c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:40.139 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.136+0000 7f89342799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:40.140 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.136+0000 7f89342799c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:40.140 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.140+0000 7f89342799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:40.140 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.140+0000 7f89342799c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:40.141 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.140+0000 7f89342799c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:21:40.141 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.140+0000 7f89342799c0 20 zone default found 2024-09-12T17:21:40.141 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.140+0000 7f89342799c0 4 Realm: () 2024-09-12T17:21:40.141 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.140+0000 7f89342799c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:21:40.141 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.140+0000 7f89342799c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:21:40.141 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.140+0000 7f89342799c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:21:40.141 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.140+0000 7f89342799c0 20 zonegroup default 2024-09-12T17:21:40.142 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.140+0000 7f89342799c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:40.142 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.140+0000 7f89342799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:40.142 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.140+0000 7f89342799c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:40.143 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.140+0000 7f89342799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:40.143 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.140+0000 7f89342799c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:40.144 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.140+0000 7f89342799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:40.144 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.140+0000 7f89342799c0 20 started sync module instance, tier type = 2024-09-12T17:21:40.144 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.140+0000 7f89342799c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:21:40.168 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.168+0000 7f89342799c0 20 add_watcher() i=0 2024-09-12T17:21:40.169 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.168+0000 7f89342799c0 20 add_watcher() i=1 2024-09-12T17:21:40.169 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.168+0000 7f89342799c0 20 add_watcher() i=2 2024-09-12T17:21:40.169 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.168+0000 7f89342799c0 20 add_watcher() i=3 2024-09-12T17:21:40.169 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.168+0000 7f89342799c0 20 add_watcher() i=4 2024-09-12T17:21:40.169 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.168+0000 7f89342799c0 20 add_watcher() i=5 2024-09-12T17:21:40.169 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.168+0000 7f89342799c0 20 add_watcher() i=6 2024-09-12T17:21:40.171 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.168+0000 7f89342799c0 20 add_watcher() i=7 2024-09-12T17:21:40.171 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.168+0000 7f89342799c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:21:40.175 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.172+0000 7f87e37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:40.176 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.172+0000 7f89342799c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:21:40.176 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.172+0000 7f89342799c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:21:40.176 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.172+0000 7f89342799c0 5 note: GC not initialized 2024-09-12T17:21:40.176 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.176+0000 7f87e27fc640 20 reqs_thread_entry: start 2024-09-12T17:21:40.177 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.176+0000 7f89342799c0 20 init_complete bucket index max shards: 1 2024-09-12T17:21:40.177 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.176+0000 7f89342799c0 20 Filter name: none 2024-09-12T17:21:40.177 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.176+0000 7f8753fff640 20 reqs_thread_entry: start 2024-09-12T17:21:40.177 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.176+0000 7f89342799c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T17:21:40.177 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.176+0000 7f89342799c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:40.178 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.176+0000 7f89342799c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:21:40.178 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.176+0000 7f89342799c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T17:21:40.178 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.176+0000 7f89342799c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T17:21:40.178 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.176+0000 7f89342799c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38 : miss 2024-09-12T17:21:40.178 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.176+0000 7f89342799c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:40.179 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.176+0000 7f89342799c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:21:40.179 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.176+0000 7f89342799c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38 info.flags=0x17 2024-09-12T17:21:40.179 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.176+0000 7f89342799c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38 to cache LRU end 2024-09-12T17:21:40.179 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.176+0000 7f89342799c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:21:40.179 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.176+0000 7f89342799c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:40.180 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.176+0000 7f89342799c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38 2024-09-12T17:21:40.188 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.188+0000 7f89342799c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38 info.flags=0x17 2024-09-12T17:21:40.188 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.188+0000 7f89342799c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38 to cache LRU end 2024-09-12T17:21:40.188 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.188+0000 7f89342799c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:40.189 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.188+0000 7f89342799c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38, ofs0, ns] 2024-09-12T17:21:40.189 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.188+0000 7f88157fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431623 cookie 94051347471648 notifier 7875 bl.length()=931 2024-09-12T17:21:40.189 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.188+0000 7f88157fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38 info.flags=0x17 2024-09-12T17:21:40.189 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.188+0000 7f88157fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38 to cache LRU end 2024-09-12T17:21:40.189 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.188+0000 7f88157fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:40.190 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.188+0000 7f89342799c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38]): orig_sources= new_sources= 2024-09-12T17:21:40.190 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.188+0000 7f89342799c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38]): potential sources added=[] removed=[] 2024-09-12T17:21:40.190 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.188+0000 7f89342799c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38]): orig_dests= new_dests= 2024-09-12T17:21:40.190 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.188+0000 7f89342799c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38]): potential dests added=[] removed=[] 2024-09-12T17:21:40.194 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.192+0000 7f89342799c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38.1.0 2024-09-12T17:21:40.194 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.192+0000 7f89342799c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38.1.0 2024-09-12T17:21:40.194 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.192+0000 7f89342799c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38.1.1 2024-09-12T17:21:40.194 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.192+0000 7f89342799c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38.1.1 2024-09-12T17:21:40.194 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.192+0000 7f89342799c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38.0 2024-09-12T17:21:40.201 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.200+0000 7f89342799c0 -1 Injecting error=-125 at location=change_reshard_state 2024-09-12T17:21:40.201 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.200+0000 7f89342799c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38 : hit (requested=0x17, cached=0x17) 2024-09-12T17:21:40.201 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.200+0000 7f89342799c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38 2024-09-12T17:21:40.202 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.200+0000 7f89342799c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38 info.flags=0x17 2024-09-12T17:21:40.202 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.200+0000 7f89342799c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38 to cache LRU end 2024-09-12T17:21:40.202 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.200+0000 7f89342799c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:40.202 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.200+0000 7f89342799c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38, ofs0, ns] 2024-09-12T17:21:40.203 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.200+0000 7f8814ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431624 cookie 94051347471648 notifier 7875 bl.length()=931 2024-09-12T17:21:40.203 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.200+0000 7f8814ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38 info.flags=0x17 2024-09-12T17:21:40.203 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.200+0000 7f8814ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38 to cache LRU end 2024-09-12T17:21:40.203 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.200+0000 7f8814ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:40.204 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.204+0000 7f89342799c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38]): orig_sources= new_sources= 2024-09-12T17:21:40.204 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.204+0000 7f89342799c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38]): potential sources added=[] removed=[] 2024-09-12T17:21:40.204 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.204+0000 7f89342799c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38]): orig_dests= new_dests= 2024-09-12T17:21:40.204 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.204+0000 7f89342799c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38]): potential dests added=[] removed=[] 2024-09-12T17:21:40.206 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.204+0000 7f89342799c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38.0 2024-09-12T17:21:40.207 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.204+0000 7f89342799c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38 : hit (requested=0x17, cached=0x17) 2024-09-12T17:21:40.207 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.204+0000 7f89342799c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38 2024-09-12T17:21:40.209 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.208+0000 7f89342799c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38 info.flags=0x17 2024-09-12T17:21:40.209 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.208+0000 7f89342799c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38 to cache LRU end 2024-09-12T17:21:40.209 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.208+0000 7f89342799c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:40.209 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.208+0000 7f89342799c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38, ofs0, ns] 2024-09-12T17:21:40.209 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.208+0000 7f8814ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431625 cookie 94051347471648 notifier 7875 bl.length()=899 2024-09-12T17:21:40.210 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.208+0000 7f8814ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38 info.flags=0x17 2024-09-12T17:21:40.210 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.208+0000 7f8814ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38 to cache LRU end 2024-09-12T17:21:40.210 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.208+0000 7f8814ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:40.210 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.208+0000 7f89342799c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38]): orig_sources= new_sources= 2024-09-12T17:21:40.211 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.208+0000 7f89342799c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38]): potential sources added=[] removed=[] 2024-09-12T17:21:40.211 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.208+0000 7f89342799c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38]): orig_dests= new_dests= 2024-09-12T17:21:40.211 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.208+0000 7f89342799c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38]): potential dests added=[] removed=[] 2024-09-12T17:21:40.212 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.212+0000 7f89342799c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 1 shards to 2 shards completed successfully 2024-09-12T17:21:40.216 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.216+0000 7f87e37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:40.221 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.220+0000 7f89342799c0 20 remove_watcher() i=0 2024-09-12T17:21:40.221 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.220+0000 7f89342799c0 2 removed watcher, disabling cache 2024-09-12T17:21:40.224 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.224+0000 7f89342799c0 20 remove_watcher() i=1 2024-09-12T17:21:40.226 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.224+0000 7f89342799c0 20 remove_watcher() i=2 2024-09-12T17:21:40.229 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.228+0000 7f89342799c0 20 remove_watcher() i=3 2024-09-12T17:21:40.233 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.228+0000 7f89342799c0 20 remove_watcher() i=4 2024-09-12T17:21:40.233 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.232+0000 7f89342799c0 20 remove_watcher() i=5 2024-09-12T17:21:40.234 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.232+0000 7f89342799c0 20 remove_watcher() i=6 2024-09-12T17:21:40.236 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.232+0000 7f89342799c0 20 remove_watcher() i=7 2024-09-12T17:21:40.252 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T17:21:40.285 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:21:40.285 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:21:40.331 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.328+0000 7fb78a8849c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:40.333 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.332+0000 7fb78a8849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:40.333 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.332+0000 7fb78a8849c0 20 realm 2024-09-12T17:21:40.333 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.332+0000 7fb78a8849c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:40.334 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.332+0000 7fb78a8849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:40.334 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.332+0000 7fb78a8849c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:21:40.334 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.332+0000 7fb78a8849c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:40.334 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.332+0000 7fb78a8849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:40.334 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.332+0000 7fb78a8849c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:40.335 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.332+0000 7fb78a8849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:40.335 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.332+0000 7fb78a8849c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:40.337 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.336+0000 7fb78a8849c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:21:40.337 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.336+0000 7fb78a8849c0 20 searching for the correct realm 2024-09-12T17:21:40.339 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.336+0000 7fb788b8b640 0 -- 172.21.15.16:0/4108852201 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fb77c029070 msgr2=0x7fb77c036430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:40.554 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.552+0000 7fb787b89640 0 -- 172.21.15.16:0/4108852201 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fb780005440 msgr2=0x7fb7800058c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:40.772 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.768+0000 7fb78a8849c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:21:40.772 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.768+0000 7fb78a8849c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:21:40.772 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.768+0000 7fb78a8849c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:21:40.772 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.768+0000 7fb78a8849c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:21:40.772 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.768+0000 7fb78a8849c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:21:40.772 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.768+0000 7fb78a8849c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:21:40.772 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.768+0000 7fb78a8849c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:40.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.772+0000 7fb78a8849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:40.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.772+0000 7fb78a8849c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:40.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.772+0000 7fb78a8849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:40.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.772+0000 7fb78a8849c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:40.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.772+0000 7fb78a8849c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:21:40.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.772+0000 7fb78a8849c0 20 zone default found 2024-09-12T17:21:40.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.772+0000 7fb78a8849c0 4 Realm: () 2024-09-12T17:21:40.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.772+0000 7fb78a8849c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:21:40.775 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.772+0000 7fb78a8849c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:21:40.775 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.772+0000 7fb78a8849c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:21:40.775 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.772+0000 7fb78a8849c0 20 zonegroup default 2024-09-12T17:21:40.775 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.772+0000 7fb78a8849c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:40.775 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.772+0000 7fb78a8849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:40.775 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.772+0000 7fb78a8849c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:40.776 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.772+0000 7fb78a8849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:40.776 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.772+0000 7fb78a8849c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:40.777 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.776+0000 7fb78a8849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:40.777 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.776+0000 7fb78a8849c0 20 started sync module instance, tier type = 2024-09-12T17:21:40.777 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.776+0000 7fb78a8849c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:21:40.801 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.800+0000 7fb78a8849c0 20 add_watcher() i=0 2024-09-12T17:21:40.802 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.800+0000 7fb78a8849c0 20 add_watcher() i=1 2024-09-12T17:21:40.802 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.800+0000 7fb78a8849c0 20 add_watcher() i=2 2024-09-12T17:21:40.802 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.800+0000 7fb78a8849c0 20 add_watcher() i=3 2024-09-12T17:21:40.802 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.800+0000 7fb78a8849c0 20 add_watcher() i=4 2024-09-12T17:21:40.802 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.800+0000 7fb78a8849c0 20 add_watcher() i=5 2024-09-12T17:21:40.802 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.800+0000 7fb78a8849c0 20 add_watcher() i=6 2024-09-12T17:21:40.804 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.800+0000 7fb78a8849c0 20 add_watcher() i=7 2024-09-12T17:21:40.804 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.800+0000 7fb78a8849c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:21:40.808 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.804+0000 7fb63efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:40.809 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.808+0000 7fb78a8849c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:21:40.809 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.808+0000 7fb78a8849c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:21:40.809 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.808+0000 7fb78a8849c0 5 note: GC not initialized 2024-09-12T17:21:40.810 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.808+0000 7fb63dfdb640 20 reqs_thread_entry: start 2024-09-12T17:21:40.810 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.808+0000 7fb78a8849c0 20 init_complete bucket index max shards: 1 2024-09-12T17:21:40.810 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.808+0000 7fb78a8849c0 20 Filter name: none 2024-09-12T17:21:40.810 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.808+0000 7fb5af7fe640 20 reqs_thread_entry: start 2024-09-12T17:21:40.811 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.808+0000 7fb78a8849c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:40.811 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.808+0000 7fb78a8849c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:21:40.812 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.808+0000 7fb78a8849c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:40.813 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.812+0000 7fb78a8849c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:21:40.813 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.812+0000 7fb78a8849c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:21:40.813 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.812+0000 7fb78a8849c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:40.814 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.812+0000 7fb78a8849c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:21:40.814 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.812+0000 7fb78a8849c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:40.814 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.812+0000 7fb78a8849c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:21:40.814 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.812+0000 7fb78a8849c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:21:40.817 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.816+0000 7fb63efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:40.822 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.820+0000 7fb78a8849c0 20 remove_watcher() i=0 2024-09-12T17:21:40.823 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.820+0000 7fb78a8849c0 2 removed watcher, disabling cache 2024-09-12T17:21:40.825 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.824+0000 7fb78a8849c0 20 remove_watcher() i=1 2024-09-12T17:21:40.828 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.824+0000 7fb78a8849c0 20 remove_watcher() i=2 2024-09-12T17:21:40.830 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.828+0000 7fb78a8849c0 20 remove_watcher() i=3 2024-09-12T17:21:40.832 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.832+0000 7fb78a8849c0 20 remove_watcher() i=4 2024-09-12T17:21:40.834 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.832+0000 7fb78a8849c0 20 remove_watcher() i=5 2024-09-12T17:21:40.835 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.832+0000 7fb78a8849c0 20 remove_watcher() i=6 2024-09-12T17:21:40.837 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:40.836+0000 7fb78a8849c0 20 remove_watcher() i=7 2024-09-12T17:21:40.857 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:40.858 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:21:40.858 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: error-at-change-reshard-state id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T17:21:40.858 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:40.956 INFO:tasks.workunit.client.0.smithi016.stderr:TEST: reshard bucket with abort at change_reshard_state 2024-09-12T17:21:40.957 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:41.408 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T17:21:41.442 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:21:41.443 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:21:41.489 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.488+0000 7f35bfe259c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:41.491 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.488+0000 7f35bfe259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:41.491 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.488+0000 7f35bfe259c0 20 realm 2024-09-12T17:21:41.491 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.488+0000 7f35bfe259c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:41.492 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.488+0000 7f35bfe259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:41.492 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.488+0000 7f35bfe259c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:21:41.492 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.488+0000 7f35bfe259c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:41.492 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.488+0000 7f35bfe259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:41.492 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.488+0000 7f35bfe259c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:41.493 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.492+0000 7f35bfe259c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:41.494 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.492+0000 7f35bfe259c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:41.495 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.492+0000 7f35bfe259c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:21:41.495 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.492+0000 7f35bfe259c0 20 searching for the correct realm 2024-09-12T17:21:41.498 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.496+0000 7f35be12c640 0 -- 172.21.15.16:0/3014003240 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f35b4131130 msgr2=0x7f35b40fd240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:41.714 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.712+0000 7f35bd12a640 0 -- 172.21.15.16:0/3014003240 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f35b805f960 msgr2=0x7f35b8032410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:41.933 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.932+0000 7f35bfe259c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:21:41.933 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.932+0000 7f35bfe259c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:21:41.933 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.932+0000 7f35bfe259c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:21:41.933 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.932+0000 7f35bfe259c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:21:41.933 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.932+0000 7f35bfe259c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:21:41.933 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.932+0000 7f35bfe259c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:21:41.933 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.932+0000 7f35bfe259c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:41.934 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.932+0000 7f35bfe259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:41.934 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.932+0000 7f35bfe259c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:41.934 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.932+0000 7f35bfe259c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:41.934 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.932+0000 7f35bfe259c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:41.935 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.932+0000 7f35bfe259c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:21:41.935 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.932+0000 7f35bfe259c0 20 zone default found 2024-09-12T17:21:41.935 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.932+0000 7f35bfe259c0 4 Realm: () 2024-09-12T17:21:41.935 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.932+0000 7f35bfe259c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:21:41.935 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.932+0000 7f35bfe259c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:21:41.935 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.932+0000 7f35bfe259c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:21:41.935 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.932+0000 7f35bfe259c0 20 zonegroup default 2024-09-12T17:21:41.936 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.932+0000 7f35bfe259c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:41.936 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.932+0000 7f35bfe259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:41.936 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.932+0000 7f35bfe259c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:41.937 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.936+0000 7f35bfe259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:41.937 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.936+0000 7f35bfe259c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:41.938 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.936+0000 7f35bfe259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:41.938 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.936+0000 7f35bfe259c0 20 started sync module instance, tier type = 2024-09-12T17:21:41.938 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.936+0000 7f35bfe259c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:21:41.963 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.960+0000 7f35bfe259c0 20 add_watcher() i=0 2024-09-12T17:21:41.963 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.960+0000 7f35bfe259c0 20 add_watcher() i=1 2024-09-12T17:21:41.963 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.960+0000 7f35bfe259c0 20 add_watcher() i=2 2024-09-12T17:21:41.963 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.960+0000 7f35bfe259c0 20 add_watcher() i=3 2024-09-12T17:21:41.963 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.960+0000 7f35bfe259c0 20 add_watcher() i=4 2024-09-12T17:21:41.963 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.960+0000 7f35bfe259c0 20 add_watcher() i=5 2024-09-12T17:21:41.964 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.960+0000 7f35bfe259c0 20 add_watcher() i=6 2024-09-12T17:21:41.965 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.964+0000 7f35bfe259c0 20 add_watcher() i=7 2024-09-12T17:21:41.965 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.964+0000 7f35bfe259c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:21:41.970 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.968+0000 7f3473fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:41.971 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.968+0000 7f35bfe259c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:21:41.971 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.968+0000 7f35bfe259c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:21:41.971 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.968+0000 7f35bfe259c0 5 note: GC not initialized 2024-09-12T17:21:41.971 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.968+0000 7f3472fe5640 20 reqs_thread_entry: start 2024-09-12T17:21:41.972 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.968+0000 7f35bfe259c0 20 init_complete bucket index max shards: 1 2024-09-12T17:21:41.972 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.968+0000 7f35bfe259c0 20 Filter name: none 2024-09-12T17:21:41.972 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.968+0000 7f3470fe1640 20 reqs_thread_entry: start 2024-09-12T17:21:41.972 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.972+0000 7f35bfe259c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:41.973 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.972+0000 7f35bfe259c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:21:41.973 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.972+0000 7f35bfe259c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:41.975 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.972+0000 7f35bfe259c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:21:41.975 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.972+0000 7f35bfe259c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:21:41.975 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.972+0000 7f35bfe259c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:41.975 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.972+0000 7f35bfe259c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:21:41.976 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.972+0000 7f35bfe259c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:41.976 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.976+0000 7f35bfe259c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:21:41.976 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.976+0000 7f35bfe259c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:21:41.979 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.976+0000 7f3473fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:41.984 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.984+0000 7f35bfe259c0 20 remove_watcher() i=0 2024-09-12T17:21:41.985 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.984+0000 7f35bfe259c0 2 removed watcher, disabling cache 2024-09-12T17:21:41.987 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.984+0000 7f35bfe259c0 20 remove_watcher() i=1 2024-09-12T17:21:41.990 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.988+0000 7f35bfe259c0 20 remove_watcher() i=2 2024-09-12T17:21:41.992 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.988+0000 7f35bfe259c0 20 remove_watcher() i=3 2024-09-12T17:21:41.994 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.992+0000 7f35bfe259c0 20 remove_watcher() i=4 2024-09-12T17:21:41.996 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.996+0000 7f35bfe259c0 20 remove_watcher() i=5 2024-09-12T17:21:41.997 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.996+0000 7f35bfe259c0 20 remove_watcher() i=6 2024-09-12T17:21:41.999 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:41.996+0000 7f35bfe259c0 20 remove_watcher() i=7 2024-09-12T17:21:42.015 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:42.015 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:21:42.015 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: abort-at-change-reshard-state id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:21:42.015 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:42.015 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T17:21:42.048 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:21:42.049 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:21:42.096 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.092+0000 7fccd15329c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.098 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.096+0000 7fccd15329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:42.098 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.096+0000 7fccd15329c0 20 realm 2024-09-12T17:21:42.098 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.096+0000 7fccd15329c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.098 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.096+0000 7fccd15329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:42.098 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.096+0000 7fccd15329c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:21:42.098 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.096+0000 7fccd15329c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.098 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.096+0000 7fccd15329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:42.098 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.096+0000 7fccd15329c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.100 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.096+0000 7fccd15329c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:42.100 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.096+0000 7fccd15329c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.101 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.100+0000 7fccd15329c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:21:42.101 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.100+0000 7fccd15329c0 20 searching for the correct realm 2024-09-12T17:21:42.105 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.104+0000 7fcccf839640 0 -- 172.21.15.16:0/3570144761 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fccc4008070 msgr2=0x7fccc408eaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:42.112 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.112+0000 7fccce837640 0 -- 172.21.15.16:0/3570144761 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fccc803e040 msgr2=0x7fccc8050930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:42.332 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.332+0000 7fccd15329c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:21:42.333 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.332+0000 7fccd15329c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:21:42.333 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.332+0000 7fccd15329c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:21:42.333 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.332+0000 7fccd15329c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:21:42.333 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.332+0000 7fccd15329c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:21:42.333 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.332+0000 7fccd15329c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:21:42.333 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.332+0000 7fccd15329c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.333 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.332+0000 7fccd15329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:42.334 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.332+0000 7fccd15329c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.334 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.332+0000 7fccd15329c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:42.334 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.332+0000 7fccd15329c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.335 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.332+0000 7fccd15329c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:21:42.335 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.332+0000 7fccd15329c0 20 zone default found 2024-09-12T17:21:42.335 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.332+0000 7fccd15329c0 4 Realm: () 2024-09-12T17:21:42.335 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.332+0000 7fccd15329c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:21:42.335 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.332+0000 7fccd15329c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:21:42.335 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.332+0000 7fccd15329c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:21:42.335 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.332+0000 7fccd15329c0 20 zonegroup default 2024-09-12T17:21:42.335 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.332+0000 7fccd15329c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.336 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.332+0000 7fccd15329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:42.336 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.332+0000 7fccd15329c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.337 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.336+0000 7fccd15329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:42.337 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.336+0000 7fccd15329c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.337 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.336+0000 7fccd15329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:42.338 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.336+0000 7fccd15329c0 20 started sync module instance, tier type = 2024-09-12T17:21:42.338 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.336+0000 7fccd15329c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:21:42.362 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.360+0000 7fccd15329c0 20 add_watcher() i=0 2024-09-12T17:21:42.362 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.360+0000 7fccd15329c0 20 add_watcher() i=1 2024-09-12T17:21:42.362 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.360+0000 7fccd15329c0 20 add_watcher() i=2 2024-09-12T17:21:42.362 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.360+0000 7fccd15329c0 20 add_watcher() i=3 2024-09-12T17:21:42.362 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.360+0000 7fccd15329c0 20 add_watcher() i=4 2024-09-12T17:21:42.363 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.360+0000 7fccd15329c0 20 add_watcher() i=5 2024-09-12T17:21:42.363 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.360+0000 7fccd15329c0 20 add_watcher() i=6 2024-09-12T17:21:42.365 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.364+0000 7fccd15329c0 20 add_watcher() i=7 2024-09-12T17:21:42.365 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.364+0000 7fccd15329c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:21:42.369 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.368+0000 7fcb85fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:42.370 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.368+0000 7fccd15329c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:21:42.370 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.368+0000 7fccd15329c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:21:42.370 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.368+0000 7fccd15329c0 5 note: GC not initialized 2024-09-12T17:21:42.370 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.368+0000 7fcb84fe1640 20 reqs_thread_entry: start 2024-09-12T17:21:42.370 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.368+0000 7fccd15329c0 20 init_complete bucket index max shards: 1 2024-09-12T17:21:42.371 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.368+0000 7fccd15329c0 20 Filter name: none 2024-09-12T17:21:42.371 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.368+0000 7fcafe7fc640 20 reqs_thread_entry: start 2024-09-12T17:21:42.371 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.368+0000 7fccd15329c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T17:21:42.371 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.368+0000 7fccd15329c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.372 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.368+0000 7fccd15329c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:21:42.372 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.368+0000 7fccd15329c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T17:21:42.372 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.368+0000 7fccd15329c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T17:21:42.372 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.368+0000 7fccd15329c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 : miss 2024-09-12T17:21:42.372 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.368+0000 7fccd15329c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.373 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.372+0000 7fccd15329c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:21:42.373 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.372+0000 7fccd15329c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 info.flags=0x17 2024-09-12T17:21:42.373 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.372+0000 7fccd15329c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 to cache LRU end 2024-09-12T17:21:42.373 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.372+0000 7fccd15329c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:21:42.373 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.372+0000 7fccd15329c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:42.374 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.372+0000 7fccd15329c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 2024-09-12T17:21:42.383 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.380+0000 7fccd15329c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 info.flags=0x17 2024-09-12T17:21:42.383 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.380+0000 7fccd15329c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 to cache LRU end 2024-09-12T17:21:42.383 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.380+0000 7fccd15329c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:42.383 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.380+0000 7fccd15329c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39, ofs0, ns] 2024-09-12T17:21:42.383 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.380+0000 7fcbb2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431671 cookie 94147455871328 notifier 7929 bl.length()=931 2024-09-12T17:21:42.384 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.380+0000 7fcbb2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 info.flags=0x17 2024-09-12T17:21:42.384 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.380+0000 7fcbb2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 to cache LRU end 2024-09-12T17:21:42.384 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.380+0000 7fcbb2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:42.385 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.384+0000 7fccd15329c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39]): orig_sources= new_sources= 2024-09-12T17:21:42.385 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.384+0000 7fccd15329c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39]): potential sources added=[] removed=[] 2024-09-12T17:21:42.385 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.384+0000 7fccd15329c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39]): orig_dests= new_dests= 2024-09-12T17:21:42.385 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.384+0000 7fccd15329c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39]): potential dests added=[] removed=[] 2024-09-12T17:21:42.391 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.388+0000 7fccd15329c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39.1.0 2024-09-12T17:21:42.391 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.388+0000 7fccd15329c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39.1.0 2024-09-12T17:21:42.391 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.388+0000 7fccd15329c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39.1.1 2024-09-12T17:21:42.391 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.388+0000 7fccd15329c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39.1.1 2024-09-12T17:21:42.391 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.388+0000 7fccd15329c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39.0 2024-09-12T17:21:42.398 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fccd15329c0 time 2024-09-12T17:21:42.400515+0000 2024-09-12T17:21:42.398 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:21:42.401 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:21:42.401 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fccd4e0c2eb] 2024-09-12T17:21:42.401 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fccd4e0c49f] 2024-09-12T17:21:42.401 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a0668600c1] 2024-09-12T17:21:42.401 INFO:tasks.workunit.client.0.smithi016.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55a0668714f1] 2024-09-12T17:21:42.401 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55a066872b44] 2024-09-12T17:21:42.401 INFO:tasks.workunit.client.0.smithi016.stderr: 6: main() 2024-09-12T17:21:42.402 INFO:tasks.workunit.client.0.smithi016.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fccd3c72d90] 2024-09-12T17:21:42.402 INFO:tasks.workunit.client.0.smithi016.stderr: 8: __libc_start_main() 2024-09-12T17:21:42.402 INFO:tasks.workunit.client.0.smithi016.stderr: 9: _start() 2024-09-12T17:21:42.402 INFO:tasks.workunit.client.0.smithi016.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:21:42.402 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7fccd15329c0 thread_name:radosgw-admin 2024-09-12T17:21:42.402 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.400+0000 7fccd15329c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fccd15329c0 time 2024-09-12T17:21:42.400515+0000 2024-09-12T17:21:42.402 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:21:42.402 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:42.402 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:21:42.402 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fccd4e0c2eb] 2024-09-12T17:21:42.402 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fccd4e0c49f] 2024-09-12T17:21:42.402 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a0668600c1] 2024-09-12T17:21:42.402 INFO:tasks.workunit.client.0.smithi016.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55a0668714f1] 2024-09-12T17:21:42.403 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55a066872b44] 2024-09-12T17:21:42.403 INFO:tasks.workunit.client.0.smithi016.stderr: 6: main() 2024-09-12T17:21:42.403 INFO:tasks.workunit.client.0.smithi016.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fccd3c72d90] 2024-09-12T17:21:42.403 INFO:tasks.workunit.client.0.smithi016.stderr: 8: __libc_start_main() 2024-09-12T17:21:42.403 INFO:tasks.workunit.client.0.smithi016.stderr: 9: _start() 2024-09-12T17:21:42.403 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:42.405 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:21:42.405 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fccd3c8b520] 2024-09-12T17:21:42.405 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:21:42.405 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:21:42.405 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:21:42.405 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fccd4e0c345] 2024-09-12T17:21:42.405 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fccd4e0c49f] 2024-09-12T17:21:42.405 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a0668600c1] 2024-09-12T17:21:42.405 INFO:tasks.workunit.client.0.smithi016.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55a0668714f1] 2024-09-12T17:21:42.405 INFO:tasks.workunit.client.0.smithi016.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55a066872b44] 2024-09-12T17:21:42.406 INFO:tasks.workunit.client.0.smithi016.stderr: 10: main() 2024-09-12T17:21:42.406 INFO:tasks.workunit.client.0.smithi016.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fccd3c72d90] 2024-09-12T17:21:42.406 INFO:tasks.workunit.client.0.smithi016.stderr: 12: __libc_start_main() 2024-09-12T17:21:42.406 INFO:tasks.workunit.client.0.smithi016.stderr: 13: _start() 2024-09-12T17:21:42.406 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.404+0000 7fccd15329c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:21:42.406 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7fccd15329c0 thread_name:radosgw-admin 2024-09-12T17:21:42.406 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:42.406 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:21:42.406 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fccd3c8b520] 2024-09-12T17:21:42.406 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:21:42.406 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:21:42.406 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:21:42.407 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fccd4e0c345] 2024-09-12T17:21:42.407 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fccd4e0c49f] 2024-09-12T17:21:42.407 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a0668600c1] 2024-09-12T17:21:42.407 INFO:tasks.workunit.client.0.smithi016.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55a0668714f1] 2024-09-12T17:21:42.407 INFO:tasks.workunit.client.0.smithi016.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55a066872b44] 2024-09-12T17:21:42.407 INFO:tasks.workunit.client.0.smithi016.stderr: 10: main() 2024-09-12T17:21:42.407 INFO:tasks.workunit.client.0.smithi016.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fccd3c72d90] 2024-09-12T17:21:42.407 INFO:tasks.workunit.client.0.smithi016.stderr: 12: __libc_start_main() 2024-09-12T17:21:42.407 INFO:tasks.workunit.client.0.smithi016.stderr: 13: _start() 2024-09-12T17:21:42.407 INFO:tasks.workunit.client.0.smithi016.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:21:42.407 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:42.407 INFO:tasks.workunit.client.0.smithi016.stderr:--- begin dump of recent events --- 2024-09-12T17:21:42.438 INFO:tasks.workunit.client.0.smithi016.stderr: -499> 2024-09-12T17:21:42.068+0000 7fcbbd60a640 10 monclient: _finish_auth 0 2024-09-12T17:21:42.438 INFO:tasks.workunit.client.0.smithi016.stderr: -498> 2024-09-12T17:21:42.068+0000 7fcbbd60a640 10 monclient: _check_auth_tickets 2024-09-12T17:21:42.438 INFO:tasks.workunit.client.0.smithi016.stderr: -497> 2024-09-12T17:21:42.068+0000 7fcbbd60a640 10 monclient: handle_config config(0 keys) 2024-09-12T17:21:42.438 INFO:tasks.workunit.client.0.smithi016.stderr: -496> 2024-09-12T17:21:42.068+0000 7fccd15329c0 5 monclient: authenticate success, global_id 7917 2024-09-12T17:21:42.438 INFO:tasks.workunit.client.0.smithi016.stderr: -495> 2024-09-12T17:21:42.068+0000 7fccd15329c0 10 monclient: get_monmap_and_config success 2024-09-12T17:21:42.438 INFO:tasks.workunit.client.0.smithi016.stderr: -494> 2024-09-12T17:21:42.068+0000 7fccd15329c0 4 set_mon_vals no callback set 2024-09-12T17:21:42.439 INFO:tasks.workunit.client.0.smithi016.stderr: -493> 2024-09-12T17:21:42.068+0000 7fcbbd60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:21:42.439 INFO:tasks.workunit.client.0.smithi016.stderr: -492> 2024-09-12T17:21:42.068+0000 7fcbbd60a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:21:42.439 INFO:tasks.workunit.client.0.smithi016.stderr: -491> 2024-09-12T17:21:42.068+0000 7fcbbd60a640 10 monclient: dump: 2024-09-12T17:21:42.439 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:21:42.439 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:21:42.439 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:42.439 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:42.439 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:21:42.439 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:42.439 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:21:42.439 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:21:42.439 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:21:42.439 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:42.440 INFO:tasks.workunit.client.0.smithi016.stderr: -490> 2024-09-12T17:21:42.068+0000 7fccd15329c0 10 monclient: shutdown 2024-09-12T17:21:42.440 INFO:tasks.workunit.client.0.smithi016.stderr: -489> 2024-09-12T17:21:42.068+0000 7fccd15329c0 5 asok(0x55a0697932b0) unregister_commands rotate-key 2024-09-12T17:21:42.440 INFO:tasks.workunit.client.0.smithi016.stderr: -488> 2024-09-12T17:21:42.068+0000 7fccd15329c0 10 monclient: build_initial_monmap 2024-09-12T17:21:42.440 INFO:tasks.workunit.client.0.smithi016.stderr: -487> 2024-09-12T17:21:42.068+0000 7fccd15329c0 1 build_initial for_mkfs: 0 2024-09-12T17:21:42.440 INFO:tasks.workunit.client.0.smithi016.stderr: -486> 2024-09-12T17:21:42.068+0000 7fccd15329c0 10 monclient: monmap: 2024-09-12T17:21:42.440 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:21:42.440 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:21:42.440 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:21:42.440 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:21:42.440 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:21:42.440 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:42.440 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:21:42.441 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:21:42.441 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:21:42.441 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:42.441 INFO:tasks.workunit.client.0.smithi016.stderr: -485> 2024-09-12T17:21:42.068+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a3720) adding auth protocol: cephx 2024-09-12T17:21:42.441 INFO:tasks.workunit.client.0.smithi016.stderr: -484> 2024-09-12T17:21:42.068+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a3720) adding auth protocol: cephx 2024-09-12T17:21:42.441 INFO:tasks.workunit.client.0.smithi016.stderr: -483> 2024-09-12T17:21:42.068+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a3720) adding auth protocol: cephx 2024-09-12T17:21:42.441 INFO:tasks.workunit.client.0.smithi016.stderr: -482> 2024-09-12T17:21:42.068+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a3720) adding con mode: secure 2024-09-12T17:21:42.441 INFO:tasks.workunit.client.0.smithi016.stderr: -481> 2024-09-12T17:21:42.068+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a3720) adding con mode: crc 2024-09-12T17:21:42.441 INFO:tasks.workunit.client.0.smithi016.stderr: -480> 2024-09-12T17:21:42.068+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a3720) adding con mode: secure 2024-09-12T17:21:42.441 INFO:tasks.workunit.client.0.smithi016.stderr: -479> 2024-09-12T17:21:42.068+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a3720) adding con mode: crc 2024-09-12T17:21:42.441 INFO:tasks.workunit.client.0.smithi016.stderr: -478> 2024-09-12T17:21:42.068+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a3720) adding con mode: secure 2024-09-12T17:21:42.441 INFO:tasks.workunit.client.0.smithi016.stderr: -477> 2024-09-12T17:21:42.068+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a3720) adding con mode: crc 2024-09-12T17:21:42.441 INFO:tasks.workunit.client.0.smithi016.stderr: -476> 2024-09-12T17:21:42.068+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a3720) adding con mode: crc 2024-09-12T17:21:42.442 INFO:tasks.workunit.client.0.smithi016.stderr: -475> 2024-09-12T17:21:42.068+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a3720) adding con mode: secure 2024-09-12T17:21:42.442 INFO:tasks.workunit.client.0.smithi016.stderr: -474> 2024-09-12T17:21:42.068+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a3720) adding con mode: crc 2024-09-12T17:21:42.442 INFO:tasks.workunit.client.0.smithi016.stderr: -473> 2024-09-12T17:21:42.068+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a3720) adding con mode: secure 2024-09-12T17:21:42.442 INFO:tasks.workunit.client.0.smithi016.stderr: -472> 2024-09-12T17:21:42.068+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a3720) adding con mode: crc 2024-09-12T17:21:42.442 INFO:tasks.workunit.client.0.smithi016.stderr: -471> 2024-09-12T17:21:42.068+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a3720) adding con mode: secure 2024-09-12T17:21:42.442 INFO:tasks.workunit.client.0.smithi016.stderr: -470> 2024-09-12T17:21:42.072+0000 7fccd15329c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:42.442 INFO:tasks.workunit.client.0.smithi016.stderr: -469> 2024-09-12T17:21:42.072+0000 7fccd15329c0 1 librados: starting msgr at 2024-09-12T17:21:42.442 INFO:tasks.workunit.client.0.smithi016.stderr: -468> 2024-09-12T17:21:42.072+0000 7fccd15329c0 1 librados: starting objecter 2024-09-12T17:21:42.442 INFO:tasks.workunit.client.0.smithi016.stderr: -467> 2024-09-12T17:21:42.072+0000 7fccd15329c0 5 asok(0x55a0697932b0) register_command objecter_requests hook 0x55a0699c9fe0 2024-09-12T17:21:42.442 INFO:tasks.workunit.client.0.smithi016.stderr: -466> 2024-09-12T17:21:42.072+0000 7fccd15329c0 1 librados: setting wanted keys 2024-09-12T17:21:42.442 INFO:tasks.workunit.client.0.smithi016.stderr: -465> 2024-09-12T17:21:42.072+0000 7fccd15329c0 1 librados: calling monclient init 2024-09-12T17:21:42.442 INFO:tasks.workunit.client.0.smithi016.stderr: -464> 2024-09-12T17:21:42.072+0000 7fccd15329c0 10 monclient: init 2024-09-12T17:21:42.443 INFO:tasks.workunit.client.0.smithi016.stderr: -463> 2024-09-12T17:21:42.072+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a0470) adding auth protocol: cephx 2024-09-12T17:21:42.443 INFO:tasks.workunit.client.0.smithi016.stderr: -462> 2024-09-12T17:21:42.072+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a0470) adding auth protocol: cephx 2024-09-12T17:21:42.443 INFO:tasks.workunit.client.0.smithi016.stderr: -461> 2024-09-12T17:21:42.072+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a0470) adding auth protocol: cephx 2024-09-12T17:21:42.443 INFO:tasks.workunit.client.0.smithi016.stderr: -460> 2024-09-12T17:21:42.072+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a0470) adding con mode: secure 2024-09-12T17:21:42.443 INFO:tasks.workunit.client.0.smithi016.stderr: -459> 2024-09-12T17:21:42.072+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a0470) adding con mode: crc 2024-09-12T17:21:42.443 INFO:tasks.workunit.client.0.smithi016.stderr: -458> 2024-09-12T17:21:42.072+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a0470) adding con mode: secure 2024-09-12T17:21:42.443 INFO:tasks.workunit.client.0.smithi016.stderr: -457> 2024-09-12T17:21:42.072+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a0470) adding con mode: crc 2024-09-12T17:21:42.443 INFO:tasks.workunit.client.0.smithi016.stderr: -456> 2024-09-12T17:21:42.072+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a0470) adding con mode: secure 2024-09-12T17:21:42.443 INFO:tasks.workunit.client.0.smithi016.stderr: -455> 2024-09-12T17:21:42.072+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a0470) adding con mode: crc 2024-09-12T17:21:42.443 INFO:tasks.workunit.client.0.smithi016.stderr: -454> 2024-09-12T17:21:42.072+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a0470) adding con mode: crc 2024-09-12T17:21:42.443 INFO:tasks.workunit.client.0.smithi016.stderr: -453> 2024-09-12T17:21:42.072+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a0470) adding con mode: secure 2024-09-12T17:21:42.443 INFO:tasks.workunit.client.0.smithi016.stderr: -452> 2024-09-12T17:21:42.072+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a0470) adding con mode: crc 2024-09-12T17:21:42.443 INFO:tasks.workunit.client.0.smithi016.stderr: -451> 2024-09-12T17:21:42.072+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a0470) adding con mode: secure 2024-09-12T17:21:42.444 INFO:tasks.workunit.client.0.smithi016.stderr: -450> 2024-09-12T17:21:42.072+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a0470) adding con mode: crc 2024-09-12T17:21:42.444 INFO:tasks.workunit.client.0.smithi016.stderr: -449> 2024-09-12T17:21:42.072+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a0470) adding con mode: secure 2024-09-12T17:21:42.444 INFO:tasks.workunit.client.0.smithi016.stderr: -448> 2024-09-12T17:21:42.072+0000 7fccd15329c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:42.444 INFO:tasks.workunit.client.0.smithi016.stderr: -447> 2024-09-12T17:21:42.072+0000 7fccd15329c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:42.444 INFO:tasks.workunit.client.0.smithi016.stderr: -446> 2024-09-12T17:21:42.072+0000 7fccd15329c0 5 asok(0x55a0697932b0) register_command rotate-key hook 0x55a0699a05b8 2024-09-12T17:21:42.444 INFO:tasks.workunit.client.0.smithi016.stderr: -445> 2024-09-12T17:21:42.072+0000 7fccd15329c0 10 monclient: _reopen_session rank -1 2024-09-12T17:21:42.444 INFO:tasks.workunit.client.0.smithi016.stderr: -444> 2024-09-12T17:21:42.072+0000 7fccd15329c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:21:42.444 INFO:tasks.workunit.client.0.smithi016.stderr: -443> 2024-09-12T17:21:42.072+0000 7fccd15329c0 10 monclient(hunting): picked mon.noname-c con 0x55a06985b5b0 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:21:42.444 INFO:tasks.workunit.client.0.smithi016.stderr: -442> 2024-09-12T17:21:42.072+0000 7fccd15329c0 10 monclient(hunting): picked mon.noname-b con 0x55a0698e8720 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:21:42.444 INFO:tasks.workunit.client.0.smithi016.stderr: -441> 2024-09-12T17:21:42.072+0000 7fccd15329c0 10 monclient(hunting): picked mon.noname-a con 0x55a0698e9070 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:21:42.444 INFO:tasks.workunit.client.0.smithi016.stderr: -440> 2024-09-12T17:21:42.072+0000 7fccd15329c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:42.444 INFO:tasks.workunit.client.0.smithi016.stderr: -439> 2024-09-12T17:21:42.072+0000 7fccd15329c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:42.444 INFO:tasks.workunit.client.0.smithi016.stderr: -438> 2024-09-12T17:21:42.072+0000 7fccd15329c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:42.445 INFO:tasks.workunit.client.0.smithi016.stderr: -437> 2024-09-12T17:21:42.072+0000 7fccd15329c0 10 monclient(hunting): _renew_subs 2024-09-12T17:21:42.445 INFO:tasks.workunit.client.0.smithi016.stderr: -436> 2024-09-12T17:21:42.072+0000 7fccd15329c0 10 monclient(hunting): authenticate will time out at 2420.049036s 2024-09-12T17:21:42.445 INFO:tasks.workunit.client.0.smithi016.stderr: -435> 2024-09-12T17:21:42.072+0000 7fcccf038640 10 monclient(hunting): get_auth_request con 0x55a06985b5b0 auth_method 0 2024-09-12T17:21:42.445 INFO:tasks.workunit.client.0.smithi016.stderr: -434> 2024-09-12T17:21:42.072+0000 7fcccf038640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:21:42.445 INFO:tasks.workunit.client.0.smithi016.stderr: -433> 2024-09-12T17:21:42.072+0000 7fcccf038640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:21:42.445 INFO:tasks.workunit.client.0.smithi016.stderr: -432> 2024-09-12T17:21:42.072+0000 7fcccf038640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:21:42.445 INFO:tasks.workunit.client.0.smithi016.stderr: -431> 2024-09-12T17:21:42.072+0000 7fcccf839640 10 monclient(hunting): get_auth_request con 0x55a0698e9070 auth_method 0 2024-09-12T17:21:42.445 INFO:tasks.workunit.client.0.smithi016.stderr: -430> 2024-09-12T17:21:42.072+0000 7fcccf839640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:21:42.445 INFO:tasks.workunit.client.0.smithi016.stderr: -429> 2024-09-12T17:21:42.072+0000 7fcccf839640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:21:42.445 INFO:tasks.workunit.client.0.smithi016.stderr: -428> 2024-09-12T17:21:42.072+0000 7fcccf839640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:21:42.445 INFO:tasks.workunit.client.0.smithi016.stderr: -427> 2024-09-12T17:21:42.072+0000 7fcccf038640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:21:42.445 INFO:tasks.workunit.client.0.smithi016.stderr: -426> 2024-09-12T17:21:42.072+0000 7fcccf038640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:21:42.446 INFO:tasks.workunit.client.0.smithi016.stderr: -425> 2024-09-12T17:21:42.072+0000 7fcccf038640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:21:42.446 INFO:tasks.workunit.client.0.smithi016.stderr: -424> 2024-09-12T17:21:42.072+0000 7fcccf839640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:21:42.446 INFO:tasks.workunit.client.0.smithi016.stderr: -423> 2024-09-12T17:21:42.072+0000 7fcccf839640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:21:42.446 INFO:tasks.workunit.client.0.smithi016.stderr: -422> 2024-09-12T17:21:42.072+0000 7fcccf839640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:21:42.446 INFO:tasks.workunit.client.0.smithi016.stderr: -421> 2024-09-12T17:21:42.072+0000 7fcccf038640 10 monclient(hunting): handle_auth_done global_id 7532 payload 824 2024-09-12T17:21:42.446 INFO:tasks.workunit.client.0.smithi016.stderr: -420> 2024-09-12T17:21:42.072+0000 7fcccf038640 10 monclient: _finish_hunting 0 2024-09-12T17:21:42.446 INFO:tasks.workunit.client.0.smithi016.stderr: -419> 2024-09-12T17:21:42.072+0000 7fcccf038640 1 monclient: found mon.noname-c 2024-09-12T17:21:42.446 INFO:tasks.workunit.client.0.smithi016.stderr: -418> 2024-09-12T17:21:42.072+0000 7fcccf038640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:21:42.446 INFO:tasks.workunit.client.0.smithi016.stderr: -417> 2024-09-12T17:21:42.072+0000 7fccce837640 10 monclient: get_auth_request con 0x55a0698e8720 auth_method 0 2024-09-12T17:21:42.446 INFO:tasks.workunit.client.0.smithi016.stderr: -416> 2024-09-12T17:21:42.072+0000 7fcbbbe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:21:42.446 INFO:tasks.workunit.client.0.smithi016.stderr: -415> 2024-09-12T17:21:42.072+0000 7fcbbbe07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:21:42.446 INFO:tasks.workunit.client.0.smithi016.stderr: -414> 2024-09-12T17:21:42.072+0000 7fcbbbe07640 10 monclient: dump: 2024-09-12T17:21:42.446 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:21:42.447 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:21:42.447 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:42.447 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:42.447 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:21:42.447 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:42.447 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:21:42.447 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:21:42.447 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:21:42.447 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:42.447 INFO:tasks.workunit.client.0.smithi016.stderr: -413> 2024-09-12T17:21:42.072+0000 7fcbbbe07640 10 monclient: _finish_auth 0 2024-09-12T17:21:42.447 INFO:tasks.workunit.client.0.smithi016.stderr: -412> 2024-09-12T17:21:42.072+0000 7fcbbbe07640 10 monclient: _check_auth_tickets 2024-09-12T17:21:42.447 INFO:tasks.workunit.client.0.smithi016.stderr: -411> 2024-09-12T17:21:42.072+0000 7fcbbbe07640 10 monclient: handle_config config(0 keys) 2024-09-12T17:21:42.447 INFO:tasks.workunit.client.0.smithi016.stderr: -410> 2024-09-12T17:21:42.072+0000 7fcbbbe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:21:42.448 INFO:tasks.workunit.client.0.smithi016.stderr: -409> 2024-09-12T17:21:42.072+0000 7fcbbbe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:21:42.448 INFO:tasks.workunit.client.0.smithi016.stderr: -408> 2024-09-12T17:21:42.072+0000 7fcbbbe07640 10 monclient: dump: 2024-09-12T17:21:42.448 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:21:42.448 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:21:42.448 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:42.448 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:42.448 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:21:42.448 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:42.448 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:21:42.448 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:21:42.448 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:21:42.448 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:42.448 INFO:tasks.workunit.client.0.smithi016.stderr: -407> 2024-09-12T17:21:42.072+0000 7fcbbd60a640 4 set_mon_vals no callback set 2024-09-12T17:21:42.449 INFO:tasks.workunit.client.0.smithi016.stderr: -406> 2024-09-12T17:21:42.072+0000 7fccd15329c0 5 monclient: authenticate success, global_id 7532 2024-09-12T17:21:42.449 INFO:tasks.workunit.client.0.smithi016.stderr: -405> 2024-09-12T17:21:42.072+0000 7fccd15329c0 10 monclient: _renew_subs 2024-09-12T17:21:42.449 INFO:tasks.workunit.client.0.smithi016.stderr: -404> 2024-09-12T17:21:42.072+0000 7fccd15329c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:21:42.449 INFO:tasks.workunit.client.0.smithi016.stderr: -403> 2024-09-12T17:21:42.072+0000 7fccd15329c0 10 monclient: _renew_subs 2024-09-12T17:21:42.449 INFO:tasks.workunit.client.0.smithi016.stderr: -402> 2024-09-12T17:21:42.072+0000 7fccd15329c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:21:42.449 INFO:tasks.workunit.client.0.smithi016.stderr: -401> 2024-09-12T17:21:42.072+0000 7fccd15329c0 1 librados: init done 2024-09-12T17:21:42.449 INFO:tasks.workunit.client.0.smithi016.stderr: -400> 2024-09-12T17:21:42.076+0000 7fcbbbe07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:21:42.449 INFO:tasks.workunit.client.0.smithi016.stderr: -399> 2024-09-12T17:21:42.076+0000 7fcbbbe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:21:42.449 INFO:tasks.workunit.client.0.smithi016.stderr: -398> 2024-09-12T17:21:42.076+0000 7fcbbbe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:21:42.449 INFO:tasks.workunit.client.0.smithi016.stderr: -397> 2024-09-12T17:21:42.076+0000 7fccce837640 10 monclient: get_auth_request con 0x7fcbb4070ae0 auth_method 0 2024-09-12T17:21:42.449 INFO:tasks.workunit.client.0.smithi016.stderr: -396> 2024-09-12T17:21:42.076+0000 7fcccf839640 10 monclient: get_auth_request con 0x55a0699cc2a0 auth_method 0 2024-09-12T17:21:42.449 INFO:tasks.workunit.client.0.smithi016.stderr: -395> 2024-09-12T17:21:42.076+0000 7fcccf038640 10 monclient: get_auth_request con 0x55a0699eab50 auth_method 0 2024-09-12T17:21:42.449 INFO:tasks.workunit.client.0.smithi016.stderr: -394> 2024-09-12T17:21:42.076+0000 7fccce837640 10 monclient: get_auth_request con 0x55a0699ef1f0 auth_method 0 2024-09-12T17:21:42.450 INFO:tasks.workunit.client.0.smithi016.stderr: -393> 2024-09-12T17:21:42.080+0000 7fcccf839640 10 monclient: get_auth_request con 0x55a0699f30e0 auth_method 0 2024-09-12T17:21:42.450 INFO:tasks.workunit.client.0.smithi016.stderr: -392> 2024-09-12T17:21:42.084+0000 7fccd15329c0 10 monclient: build_initial_monmap 2024-09-12T17:21:42.450 INFO:tasks.workunit.client.0.smithi016.stderr: -391> 2024-09-12T17:21:42.084+0000 7fccd15329c0 1 build_initial for_mkfs: 0 2024-09-12T17:21:42.450 INFO:tasks.workunit.client.0.smithi016.stderr: -390> 2024-09-12T17:21:42.084+0000 7fccd15329c0 10 monclient: monmap: 2024-09-12T17:21:42.450 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:21:42.450 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:21:42.450 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:21:42.450 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:21:42.450 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:21:42.450 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:42.450 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:21:42.450 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:21:42.450 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:21:42.451 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:42.451 INFO:tasks.workunit.client.0.smithi016.stderr: -389> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f7240) adding auth protocol: cephx 2024-09-12T17:21:42.451 INFO:tasks.workunit.client.0.smithi016.stderr: -388> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f7240) adding auth protocol: cephx 2024-09-12T17:21:42.451 INFO:tasks.workunit.client.0.smithi016.stderr: -387> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f7240) adding auth protocol: cephx 2024-09-12T17:21:42.451 INFO:tasks.workunit.client.0.smithi016.stderr: -386> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f7240) adding con mode: secure 2024-09-12T17:21:42.451 INFO:tasks.workunit.client.0.smithi016.stderr: -385> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f7240) adding con mode: crc 2024-09-12T17:21:42.451 INFO:tasks.workunit.client.0.smithi016.stderr: -384> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f7240) adding con mode: secure 2024-09-12T17:21:42.451 INFO:tasks.workunit.client.0.smithi016.stderr: -383> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f7240) adding con mode: crc 2024-09-12T17:21:42.451 INFO:tasks.workunit.client.0.smithi016.stderr: -382> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f7240) adding con mode: secure 2024-09-12T17:21:42.451 INFO:tasks.workunit.client.0.smithi016.stderr: -381> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f7240) adding con mode: crc 2024-09-12T17:21:42.451 INFO:tasks.workunit.client.0.smithi016.stderr: -380> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f7240) adding con mode: crc 2024-09-12T17:21:42.451 INFO:tasks.workunit.client.0.smithi016.stderr: -379> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f7240) adding con mode: secure 2024-09-12T17:21:42.452 INFO:tasks.workunit.client.0.smithi016.stderr: -378> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f7240) adding con mode: crc 2024-09-12T17:21:42.452 INFO:tasks.workunit.client.0.smithi016.stderr: -377> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f7240) adding con mode: secure 2024-09-12T17:21:42.452 INFO:tasks.workunit.client.0.smithi016.stderr: -376> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f7240) adding con mode: crc 2024-09-12T17:21:42.452 INFO:tasks.workunit.client.0.smithi016.stderr: -375> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f7240) adding con mode: secure 2024-09-12T17:21:42.452 INFO:tasks.workunit.client.0.smithi016.stderr: -374> 2024-09-12T17:21:42.084+0000 7fccd15329c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:42.452 INFO:tasks.workunit.client.0.smithi016.stderr: -373> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 asok(0x55a0697932b0) register_command objecter_requests cmddesc objecter_requests hook 0x55a0699fabb0 EEXIST 2024-09-12T17:21:42.452 INFO:tasks.workunit.client.0.smithi016.stderr: -372> 2024-09-12T17:21:42.084+0000 7fccd15329c0 10 monclient: init 2024-09-12T17:21:42.452 INFO:tasks.workunit.client.0.smithi016.stderr: -371> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f6138) adding auth protocol: cephx 2024-09-12T17:21:42.452 INFO:tasks.workunit.client.0.smithi016.stderr: -370> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f6138) adding auth protocol: cephx 2024-09-12T17:21:42.452 INFO:tasks.workunit.client.0.smithi016.stderr: -369> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f6138) adding auth protocol: cephx 2024-09-12T17:21:42.452 INFO:tasks.workunit.client.0.smithi016.stderr: -368> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f6138) adding con mode: secure 2024-09-12T17:21:42.452 INFO:tasks.workunit.client.0.smithi016.stderr: -367> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f6138) adding con mode: crc 2024-09-12T17:21:42.452 INFO:tasks.workunit.client.0.smithi016.stderr: -366> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f6138) adding con mode: secure 2024-09-12T17:21:42.453 INFO:tasks.workunit.client.0.smithi016.stderr: -365> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f6138) adding con mode: crc 2024-09-12T17:21:42.453 INFO:tasks.workunit.client.0.smithi016.stderr: -364> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f6138) adding con mode: secure 2024-09-12T17:21:42.453 INFO:tasks.workunit.client.0.smithi016.stderr: -363> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f6138) adding con mode: crc 2024-09-12T17:21:42.453 INFO:tasks.workunit.client.0.smithi016.stderr: -362> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f6138) adding con mode: crc 2024-09-12T17:21:42.453 INFO:tasks.workunit.client.0.smithi016.stderr: -361> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f6138) adding con mode: secure 2024-09-12T17:21:42.453 INFO:tasks.workunit.client.0.smithi016.stderr: -360> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f6138) adding con mode: crc 2024-09-12T17:21:42.453 INFO:tasks.workunit.client.0.smithi016.stderr: -359> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f6138) adding con mode: secure 2024-09-12T17:21:42.453 INFO:tasks.workunit.client.0.smithi016.stderr: -358> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f6138) adding con mode: crc 2024-09-12T17:21:42.453 INFO:tasks.workunit.client.0.smithi016.stderr: -357> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f6138) adding con mode: secure 2024-09-12T17:21:42.453 INFO:tasks.workunit.client.0.smithi016.stderr: -356> 2024-09-12T17:21:42.084+0000 7fccd15329c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:42.453 INFO:tasks.workunit.client.0.smithi016.stderr: -355> 2024-09-12T17:21:42.084+0000 7fccd15329c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:42.453 INFO:tasks.workunit.client.0.smithi016.stderr: -354> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 asok(0x55a0697932b0) register_command rotate-key cmddesc rotate-key hook 0x55a0699f6280 EEXIST 2024-09-12T17:21:42.453 INFO:tasks.workunit.client.0.smithi016.stderr: -353> 2024-09-12T17:21:42.084+0000 7fccd15329c0 10 monclient: _reopen_session rank -1 2024-09-12T17:21:42.454 INFO:tasks.workunit.client.0.smithi016.stderr: -352> 2024-09-12T17:21:42.084+0000 7fccd15329c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:21:42.454 INFO:tasks.workunit.client.0.smithi016.stderr: -351> 2024-09-12T17:21:42.084+0000 7fccd15329c0 10 monclient(hunting): picked mon.noname-a con 0x55a069a1ed60 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:21:42.454 INFO:tasks.workunit.client.0.smithi016.stderr: -350> 2024-09-12T17:21:42.084+0000 7fccd15329c0 10 monclient(hunting): picked mon.noname-b con 0x55a069a1e690 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:21:42.454 INFO:tasks.workunit.client.0.smithi016.stderr: -349> 2024-09-12T17:21:42.084+0000 7fccd15329c0 10 monclient(hunting): picked mon.noname-c con 0x55a069a1d070 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:21:42.454 INFO:tasks.workunit.client.0.smithi016.stderr: -348> 2024-09-12T17:21:42.084+0000 7fccd15329c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:42.454 INFO:tasks.workunit.client.0.smithi016.stderr: -347> 2024-09-12T17:21:42.084+0000 7fccd15329c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:42.454 INFO:tasks.workunit.client.0.smithi016.stderr: -346> 2024-09-12T17:21:42.084+0000 7fccd15329c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:42.454 INFO:tasks.workunit.client.0.smithi016.stderr: -345> 2024-09-12T17:21:42.084+0000 7fccd15329c0 10 monclient(hunting): _renew_subs 2024-09-12T17:21:42.454 INFO:tasks.workunit.client.0.smithi016.stderr: -344> 2024-09-12T17:21:42.084+0000 7fccd15329c0 10 monclient(hunting): authenticate will time out at 2420.061583s 2024-09-12T17:21:42.454 INFO:tasks.workunit.client.0.smithi016.stderr: -343> 2024-09-12T17:21:42.084+0000 7fccce837640 10 monclient(hunting): get_auth_request con 0x55a069a1ed60 auth_method 0 2024-09-12T17:21:42.454 INFO:tasks.workunit.client.0.smithi016.stderr: -342> 2024-09-12T17:21:42.084+0000 7fccce837640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:21:42.454 INFO:tasks.workunit.client.0.smithi016.stderr: -341> 2024-09-12T17:21:42.084+0000 7fccce837640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:21:42.454 INFO:tasks.workunit.client.0.smithi016.stderr: -340> 2024-09-12T17:21:42.084+0000 7fccce837640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:21:42.455 INFO:tasks.workunit.client.0.smithi016.stderr: -339> 2024-09-12T17:21:42.084+0000 7fcccf038640 10 monclient(hunting): get_auth_request con 0x55a069a1d070 auth_method 0 2024-09-12T17:21:42.455 INFO:tasks.workunit.client.0.smithi016.stderr: -338> 2024-09-12T17:21:42.084+0000 7fcccf038640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:21:42.455 INFO:tasks.workunit.client.0.smithi016.stderr: -337> 2024-09-12T17:21:42.084+0000 7fcccf038640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:21:42.455 INFO:tasks.workunit.client.0.smithi016.stderr: -336> 2024-09-12T17:21:42.084+0000 7fcccf038640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:21:42.455 INFO:tasks.workunit.client.0.smithi016.stderr: -335> 2024-09-12T17:21:42.084+0000 7fcccf038640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:21:42.455 INFO:tasks.workunit.client.0.smithi016.stderr: -334> 2024-09-12T17:21:42.084+0000 7fcccf038640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:21:42.455 INFO:tasks.workunit.client.0.smithi016.stderr: -333> 2024-09-12T17:21:42.084+0000 7fcccf038640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:21:42.455 INFO:tasks.workunit.client.0.smithi016.stderr: -332> 2024-09-12T17:21:42.084+0000 7fccce837640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:21:42.455 INFO:tasks.workunit.client.0.smithi016.stderr: -331> 2024-09-12T17:21:42.084+0000 7fccce837640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:21:42.455 INFO:tasks.workunit.client.0.smithi016.stderr: -330> 2024-09-12T17:21:42.084+0000 7fccce837640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:21:42.455 INFO:tasks.workunit.client.0.smithi016.stderr: -329> 2024-09-12T17:21:42.084+0000 7fcccf839640 10 monclient(hunting): get_auth_request con 0x55a069a1e690 auth_method 0 2024-09-12T17:21:42.455 INFO:tasks.workunit.client.0.smithi016.stderr: -328> 2024-09-12T17:21:42.084+0000 7fcccf839640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:21:42.455 INFO:tasks.workunit.client.0.smithi016.stderr: -327> 2024-09-12T17:21:42.084+0000 7fcccf839640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:21:42.455 INFO:tasks.workunit.client.0.smithi016.stderr: -326> 2024-09-12T17:21:42.084+0000 7fcccf839640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:21:42.456 INFO:tasks.workunit.client.0.smithi016.stderr: -325> 2024-09-12T17:21:42.084+0000 7fcccf038640 10 monclient(hunting): handle_auth_done global_id 7535 payload 824 2024-09-12T17:21:42.456 INFO:tasks.workunit.client.0.smithi016.stderr: -324> 2024-09-12T17:21:42.084+0000 7fcccf038640 10 monclient: _finish_hunting 0 2024-09-12T17:21:42.456 INFO:tasks.workunit.client.0.smithi016.stderr: -323> 2024-09-12T17:21:42.084+0000 7fcccf038640 1 monclient: found mon.noname-c 2024-09-12T17:21:42.456 INFO:tasks.workunit.client.0.smithi016.stderr: -322> 2024-09-12T17:21:42.084+0000 7fcccf038640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:21:42.456 INFO:tasks.workunit.client.0.smithi016.stderr: -321> 2024-09-12T17:21:42.084+0000 7fcbb9602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:21:42.456 INFO:tasks.workunit.client.0.smithi016.stderr: -320> 2024-09-12T17:21:42.084+0000 7fcbb9602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:21:42.456 INFO:tasks.workunit.client.0.smithi016.stderr: -319> 2024-09-12T17:21:42.084+0000 7fcbb9602640 10 monclient: dump: 2024-09-12T17:21:42.456 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:21:42.456 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:21:42.456 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:42.456 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:42.456 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:21:42.456 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:42.457 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:21:42.457 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:21:42.457 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:21:42.457 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:42.457 INFO:tasks.workunit.client.0.smithi016.stderr: -318> 2024-09-12T17:21:42.084+0000 7fcbb9602640 10 monclient: _finish_auth 0 2024-09-12T17:21:42.457 INFO:tasks.workunit.client.0.smithi016.stderr: -317> 2024-09-12T17:21:42.084+0000 7fcbb9602640 10 monclient: _check_auth_tickets 2024-09-12T17:21:42.457 INFO:tasks.workunit.client.0.smithi016.stderr: -316> 2024-09-12T17:21:42.084+0000 7fcbb9602640 10 monclient: handle_config config(0 keys) 2024-09-12T17:21:42.457 INFO:tasks.workunit.client.0.smithi016.stderr: -315> 2024-09-12T17:21:42.084+0000 7fcbb9602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:21:42.457 INFO:tasks.workunit.client.0.smithi016.stderr: -314> 2024-09-12T17:21:42.084+0000 7fcbb9602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:21:42.457 INFO:tasks.workunit.client.0.smithi016.stderr: -313> 2024-09-12T17:21:42.084+0000 7fcbb9602640 10 monclient: dump: 2024-09-12T17:21:42.457 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:21:42.457 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:21:42.457 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:42.458 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:42.458 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:21:42.458 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:42.458 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:21:42.458 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:21:42.458 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:21:42.458 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:42.458 INFO:tasks.workunit.client.0.smithi016.stderr: -312> 2024-09-12T17:21:42.084+0000 7fccce036640 4 set_mon_vals no callback set 2024-09-12T17:21:42.458 INFO:tasks.workunit.client.0.smithi016.stderr: -311> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 monclient: authenticate success, global_id 7535 2024-09-12T17:21:42.458 INFO:tasks.workunit.client.0.smithi016.stderr: -310> 2024-09-12T17:21:42.084+0000 7fccd15329c0 10 monclient: _renew_subs 2024-09-12T17:21:42.458 INFO:tasks.workunit.client.0.smithi016.stderr: -309> 2024-09-12T17:21:42.084+0000 7fccd15329c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:21:42.458 INFO:tasks.workunit.client.0.smithi016.stderr: -308> 2024-09-12T17:21:42.084+0000 7fccd15329c0 10 monclient: _renew_subs 2024-09-12T17:21:42.458 INFO:tasks.workunit.client.0.smithi016.stderr: -307> 2024-09-12T17:21:42.084+0000 7fccd15329c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:21:42.458 INFO:tasks.workunit.client.0.smithi016.stderr: -306> 2024-09-12T17:21:42.088+0000 7fcbb9602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:21:42.458 INFO:tasks.workunit.client.0.smithi016.stderr: -305> 2024-09-12T17:21:42.088+0000 7fcbb9602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:21:42.459 INFO:tasks.workunit.client.0.smithi016.stderr: -304> 2024-09-12T17:21:42.088+0000 7fcbb9602640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:21:42.459 INFO:tasks.workunit.client.0.smithi016.stderr: -303> 2024-09-12T17:21:42.088+0000 7fccd15329c0 10 monclient: get_monmap_and_config 2024-09-12T17:21:42.459 INFO:tasks.workunit.client.0.smithi016.stderr: -302> 2024-09-12T17:21:42.088+0000 7fccd15329c0 10 monclient: build_initial_monmap 2024-09-12T17:21:42.459 INFO:tasks.workunit.client.0.smithi016.stderr: -301> 2024-09-12T17:21:42.088+0000 7fccd15329c0 1 build_initial for_mkfs: 0 2024-09-12T17:21:42.459 INFO:tasks.workunit.client.0.smithi016.stderr: -300> 2024-09-12T17:21:42.088+0000 7fccd15329c0 10 monclient: monmap: 2024-09-12T17:21:42.459 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:21:42.459 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:21:42.459 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:21:42.459 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:21:42.459 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:21:42.459 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:42.459 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:21:42.459 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:21:42.459 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:21:42.460 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:42.460 INFO:tasks.workunit.client.0.smithi016.stderr: -299> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a3e130) adding auth protocol: cephx 2024-09-12T17:21:42.460 INFO:tasks.workunit.client.0.smithi016.stderr: -298> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a3e130) adding auth protocol: cephx 2024-09-12T17:21:42.460 INFO:tasks.workunit.client.0.smithi016.stderr: -297> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a3e130) adding auth protocol: cephx 2024-09-12T17:21:42.460 INFO:tasks.workunit.client.0.smithi016.stderr: -296> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a3e130) adding con mode: secure 2024-09-12T17:21:42.460 INFO:tasks.workunit.client.0.smithi016.stderr: -295> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a3e130) adding con mode: crc 2024-09-12T17:21:42.460 INFO:tasks.workunit.client.0.smithi016.stderr: -294> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a3e130) adding con mode: secure 2024-09-12T17:21:42.460 INFO:tasks.workunit.client.0.smithi016.stderr: -293> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a3e130) adding con mode: crc 2024-09-12T17:21:42.460 INFO:tasks.workunit.client.0.smithi016.stderr: -292> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a3e130) adding con mode: secure 2024-09-12T17:21:42.460 INFO:tasks.workunit.client.0.smithi016.stderr: -291> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a3e130) adding con mode: crc 2024-09-12T17:21:42.460 INFO:tasks.workunit.client.0.smithi016.stderr: -290> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a3e130) adding con mode: crc 2024-09-12T17:21:42.460 INFO:tasks.workunit.client.0.smithi016.stderr: -289> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a3e130) adding con mode: secure 2024-09-12T17:21:42.460 INFO:tasks.workunit.client.0.smithi016.stderr: -288> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a3e130) adding con mode: crc 2024-09-12T17:21:42.461 INFO:tasks.workunit.client.0.smithi016.stderr: -287> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a3e130) adding con mode: secure 2024-09-12T17:21:42.461 INFO:tasks.workunit.client.0.smithi016.stderr: -286> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a3e130) adding con mode: crc 2024-09-12T17:21:42.461 INFO:tasks.workunit.client.0.smithi016.stderr: -285> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a3e130) adding con mode: secure 2024-09-12T17:21:42.461 INFO:tasks.workunit.client.0.smithi016.stderr: -284> 2024-09-12T17:21:42.088+0000 7fccce837640 10 monclient: get_auth_request con 0x7fcba8070a20 auth_method 0 2024-09-12T17:21:42.461 INFO:tasks.workunit.client.0.smithi016.stderr: -283> 2024-09-12T17:21:42.088+0000 7fccd15329c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:42.461 INFO:tasks.workunit.client.0.smithi016.stderr: -282> 2024-09-12T17:21:42.088+0000 7fccd15329c0 10 monclient: init 2024-09-12T17:21:42.461 INFO:tasks.workunit.client.0.smithi016.stderr: -281> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b9395a0) adding auth protocol: cephx 2024-09-12T17:21:42.461 INFO:tasks.workunit.client.0.smithi016.stderr: -280> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b9395a0) adding auth protocol: cephx 2024-09-12T17:21:42.461 INFO:tasks.workunit.client.0.smithi016.stderr: -279> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b9395a0) adding auth protocol: cephx 2024-09-12T17:21:42.461 INFO:tasks.workunit.client.0.smithi016.stderr: -278> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b9395a0) adding con mode: secure 2024-09-12T17:21:42.461 INFO:tasks.workunit.client.0.smithi016.stderr: -277> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b9395a0) adding con mode: crc 2024-09-12T17:21:42.461 INFO:tasks.workunit.client.0.smithi016.stderr: -276> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b9395a0) adding con mode: secure 2024-09-12T17:21:42.461 INFO:tasks.workunit.client.0.smithi016.stderr: -275> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b9395a0) adding con mode: crc 2024-09-12T17:21:42.462 INFO:tasks.workunit.client.0.smithi016.stderr: -274> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b9395a0) adding con mode: secure 2024-09-12T17:21:42.462 INFO:tasks.workunit.client.0.smithi016.stderr: -273> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b9395a0) adding con mode: crc 2024-09-12T17:21:42.462 INFO:tasks.workunit.client.0.smithi016.stderr: -272> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b9395a0) adding con mode: crc 2024-09-12T17:21:42.462 INFO:tasks.workunit.client.0.smithi016.stderr: -271> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b9395a0) adding con mode: secure 2024-09-12T17:21:42.462 INFO:tasks.workunit.client.0.smithi016.stderr: -270> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b9395a0) adding con mode: crc 2024-09-12T17:21:42.462 INFO:tasks.workunit.client.0.smithi016.stderr: -269> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b9395a0) adding con mode: secure 2024-09-12T17:21:42.462 INFO:tasks.workunit.client.0.smithi016.stderr: -268> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b9395a0) adding con mode: crc 2024-09-12T17:21:42.462 INFO:tasks.workunit.client.0.smithi016.stderr: -267> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b9395a0) adding con mode: secure 2024-09-12T17:21:42.462 INFO:tasks.workunit.client.0.smithi016.stderr: -266> 2024-09-12T17:21:42.088+0000 7fccd15329c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:42.462 INFO:tasks.workunit.client.0.smithi016.stderr: -265> 2024-09-12T17:21:42.088+0000 7fccd15329c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:42.462 INFO:tasks.workunit.client.0.smithi016.stderr: -264> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 asok(0x55a0697932b0) register_command rotate-key cmddesc rotate-key hook 0x7fff6b9396e8 EEXIST 2024-09-12T17:21:42.462 INFO:tasks.workunit.client.0.smithi016.stderr: -263> 2024-09-12T17:21:42.088+0000 7fccd15329c0 10 monclient: _reopen_session rank -1 2024-09-12T17:21:42.462 INFO:tasks.workunit.client.0.smithi016.stderr: -262> 2024-09-12T17:21:42.088+0000 7fccd15329c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:21:42.462 INFO:tasks.workunit.client.0.smithi016.stderr: -261> 2024-09-12T17:21:42.088+0000 7fccd15329c0 10 monclient(hunting): picked mon.noname-a con 0x55a069a72640 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:21:42.463 INFO:tasks.workunit.client.0.smithi016.stderr: -260> 2024-09-12T17:21:42.088+0000 7fccd15329c0 10 monclient(hunting): picked mon.noname-c con 0x55a069a42420 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:21:42.463 INFO:tasks.workunit.client.0.smithi016.stderr: -259> 2024-09-12T17:21:42.088+0000 7fccd15329c0 10 monclient(hunting): picked mon.noname-b con 0x55a069a6da30 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:21:42.463 INFO:tasks.workunit.client.0.smithi016.stderr: -258> 2024-09-12T17:21:42.088+0000 7fccd15329c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:42.463 INFO:tasks.workunit.client.0.smithi016.stderr: -257> 2024-09-12T17:21:42.088+0000 7fccd15329c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:42.463 INFO:tasks.workunit.client.0.smithi016.stderr: -256> 2024-09-12T17:21:42.088+0000 7fccd15329c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:42.463 INFO:tasks.workunit.client.0.smithi016.stderr: -255> 2024-09-12T17:21:42.088+0000 7fccd15329c0 10 monclient(hunting): _renew_subs 2024-09-12T17:21:42.463 INFO:tasks.workunit.client.0.smithi016.stderr: -254> 2024-09-12T17:21:42.088+0000 7fccd15329c0 10 monclient(hunting): authenticate will time out at 2420.066354s 2024-09-12T17:21:42.463 INFO:tasks.workunit.client.0.smithi016.stderr: -253> 2024-09-12T17:21:42.088+0000 7fcccf839640 10 monclient(hunting): get_auth_request con 0x55a069a42420 auth_method 0 2024-09-12T17:21:42.463 INFO:tasks.workunit.client.0.smithi016.stderr: -252> 2024-09-12T17:21:42.088+0000 7fcccf839640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:21:42.463 INFO:tasks.workunit.client.0.smithi016.stderr: -251> 2024-09-12T17:21:42.088+0000 7fcccf839640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:21:42.463 INFO:tasks.workunit.client.0.smithi016.stderr: -250> 2024-09-12T17:21:42.088+0000 7fcccf839640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:21:42.463 INFO:tasks.workunit.client.0.smithi016.stderr: -249> 2024-09-12T17:21:42.088+0000 7fccce837640 10 monclient(hunting): get_auth_request con 0x55a069a72640 auth_method 0 2024-09-12T17:21:42.464 INFO:tasks.workunit.client.0.smithi016.stderr: -248> 2024-09-12T17:21:42.088+0000 7fccce837640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:21:42.464 INFO:tasks.workunit.client.0.smithi016.stderr: -247> 2024-09-12T17:21:42.088+0000 7fccce837640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:21:42.464 INFO:tasks.workunit.client.0.smithi016.stderr: -246> 2024-09-12T17:21:42.088+0000 7fccce837640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:21:42.464 INFO:tasks.workunit.client.0.smithi016.stderr: -245> 2024-09-12T17:21:42.088+0000 7fcccf839640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:21:42.464 INFO:tasks.workunit.client.0.smithi016.stderr: -244> 2024-09-12T17:21:42.088+0000 7fcccf839640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:21:42.464 INFO:tasks.workunit.client.0.smithi016.stderr: -243> 2024-09-12T17:21:42.088+0000 7fcccf839640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:21:42.464 INFO:tasks.workunit.client.0.smithi016.stderr: -242> 2024-09-12T17:21:42.088+0000 7fccce837640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:21:42.464 INFO:tasks.workunit.client.0.smithi016.stderr: -241> 2024-09-12T17:21:42.088+0000 7fccce837640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:21:42.464 INFO:tasks.workunit.client.0.smithi016.stderr: -240> 2024-09-12T17:21:42.088+0000 7fccce837640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:21:42.464 INFO:tasks.workunit.client.0.smithi016.stderr: -239> 2024-09-12T17:21:42.088+0000 7fcccf038640 10 monclient(hunting): get_auth_request con 0x55a069a6da30 auth_method 0 2024-09-12T17:21:42.464 INFO:tasks.workunit.client.0.smithi016.stderr: -238> 2024-09-12T17:21:42.088+0000 7fcccf038640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:21:42.464 INFO:tasks.workunit.client.0.smithi016.stderr: -237> 2024-09-12T17:21:42.088+0000 7fcccf038640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:21:42.464 INFO:tasks.workunit.client.0.smithi016.stderr: -236> 2024-09-12T17:21:42.088+0000 7fcccf038640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:21:42.465 INFO:tasks.workunit.client.0.smithi016.stderr: -235> 2024-09-12T17:21:42.088+0000 7fccce837640 10 monclient(hunting): handle_auth_done global_id 7926 payload 274 2024-09-12T17:21:42.465 INFO:tasks.workunit.client.0.smithi016.stderr: -234> 2024-09-12T17:21:42.088+0000 7fccce837640 10 monclient: _finish_hunting 0 2024-09-12T17:21:42.465 INFO:tasks.workunit.client.0.smithi016.stderr: -233> 2024-09-12T17:21:42.088+0000 7fccce837640 1 monclient: found mon.noname-a 2024-09-12T17:21:42.465 INFO:tasks.workunit.client.0.smithi016.stderr: -232> 2024-09-12T17:21:42.088+0000 7fccce837640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:21:42.465 INFO:tasks.workunit.client.0.smithi016.stderr: -231> 2024-09-12T17:21:42.088+0000 7fcbb2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:21:42.465 INFO:tasks.workunit.client.0.smithi016.stderr: -230> 2024-09-12T17:21:42.088+0000 7fcbb2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:21:42.465 INFO:tasks.workunit.client.0.smithi016.stderr: -229> 2024-09-12T17:21:42.088+0000 7fcbb2ffd640 10 monclient: dump: 2024-09-12T17:21:42.465 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:21:42.465 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:21:42.465 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:42.465 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:42.465 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:21:42.465 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:42.466 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:21:42.466 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:21:42.466 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:21:42.466 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:42.466 INFO:tasks.workunit.client.0.smithi016.stderr: -228> 2024-09-12T17:21:42.088+0000 7fcbb2ffd640 10 monclient: _finish_auth 0 2024-09-12T17:21:42.466 INFO:tasks.workunit.client.0.smithi016.stderr: -227> 2024-09-12T17:21:42.088+0000 7fcbb2ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:21:42.466 INFO:tasks.workunit.client.0.smithi016.stderr: -226> 2024-09-12T17:21:42.088+0000 7fcbb2ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:21:42.466 INFO:tasks.workunit.client.0.smithi016.stderr: -225> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 monclient: authenticate success, global_id 7926 2024-09-12T17:21:42.466 INFO:tasks.workunit.client.0.smithi016.stderr: -224> 2024-09-12T17:21:42.088+0000 7fccd15329c0 10 monclient: get_monmap_and_config success 2024-09-12T17:21:42.466 INFO:tasks.workunit.client.0.smithi016.stderr: -223> 2024-09-12T17:21:42.088+0000 7fccd15329c0 4 set_mon_vals no callback set 2024-09-12T17:21:42.466 INFO:tasks.workunit.client.0.smithi016.stderr: -222> 2024-09-12T17:21:42.088+0000 7fcbb2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:21:42.466 INFO:tasks.workunit.client.0.smithi016.stderr: -221> 2024-09-12T17:21:42.088+0000 7fcbb2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:21:42.466 INFO:tasks.workunit.client.0.smithi016.stderr: -220> 2024-09-12T17:21:42.088+0000 7fcbb2ffd640 10 monclient: dump: 2024-09-12T17:21:42.467 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:21:42.467 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:21:42.467 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:42.467 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:42.467 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:21:42.467 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:42.467 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:21:42.467 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:21:42.467 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:21:42.467 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:42.467 INFO:tasks.workunit.client.0.smithi016.stderr: -219> 2024-09-12T17:21:42.088+0000 7fccd15329c0 10 monclient: shutdown 2024-09-12T17:21:42.467 INFO:tasks.workunit.client.0.smithi016.stderr: -218> 2024-09-12T17:21:42.088+0000 7fccd15329c0 10 monclient: build_initial_monmap 2024-09-12T17:21:42.467 INFO:tasks.workunit.client.0.smithi016.stderr: -217> 2024-09-12T17:21:42.088+0000 7fccd15329c0 1 build_initial for_mkfs: 0 2024-09-12T17:21:42.468 INFO:tasks.workunit.client.0.smithi016.stderr: -216> 2024-09-12T17:21:42.088+0000 7fccd15329c0 10 monclient: monmap: 2024-09-12T17:21:42.468 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:21:42.468 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:21:42.468 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:21:42.468 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:21:42.468 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:21:42.468 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:42.468 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:21:42.468 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:21:42.468 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:21:42.468 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:42.468 INFO:tasks.workunit.client.0.smithi016.stderr: -215> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a431f0) adding auth protocol: cephx 2024-09-12T17:21:42.468 INFO:tasks.workunit.client.0.smithi016.stderr: -214> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a431f0) adding auth protocol: cephx 2024-09-12T17:21:42.469 INFO:tasks.workunit.client.0.smithi016.stderr: -213> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a431f0) adding auth protocol: cephx 2024-09-12T17:21:42.469 INFO:tasks.workunit.client.0.smithi016.stderr: -212> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a431f0) adding con mode: secure 2024-09-12T17:21:42.469 INFO:tasks.workunit.client.0.smithi016.stderr: -211> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a431f0) adding con mode: crc 2024-09-12T17:21:42.469 INFO:tasks.workunit.client.0.smithi016.stderr: -210> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a431f0) adding con mode: secure 2024-09-12T17:21:42.469 INFO:tasks.workunit.client.0.smithi016.stderr: -209> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a431f0) adding con mode: crc 2024-09-12T17:21:42.469 INFO:tasks.workunit.client.0.smithi016.stderr: -208> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a431f0) adding con mode: secure 2024-09-12T17:21:42.469 INFO:tasks.workunit.client.0.smithi016.stderr: -207> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a431f0) adding con mode: crc 2024-09-12T17:21:42.469 INFO:tasks.workunit.client.0.smithi016.stderr: -206> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a431f0) adding con mode: crc 2024-09-12T17:21:42.469 INFO:tasks.workunit.client.0.smithi016.stderr: -205> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a431f0) adding con mode: secure 2024-09-12T17:21:42.469 INFO:tasks.workunit.client.0.smithi016.stderr: -204> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a431f0) adding con mode: crc 2024-09-12T17:21:42.469 INFO:tasks.workunit.client.0.smithi016.stderr: -203> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a431f0) adding con mode: secure 2024-09-12T17:21:42.469 INFO:tasks.workunit.client.0.smithi016.stderr: -202> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a431f0) adding con mode: crc 2024-09-12T17:21:42.469 INFO:tasks.workunit.client.0.smithi016.stderr: -201> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a431f0) adding con mode: secure 2024-09-12T17:21:42.470 INFO:tasks.workunit.client.0.smithi016.stderr: -200> 2024-09-12T17:21:42.092+0000 7fccd15329c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:42.470 INFO:tasks.workunit.client.0.smithi016.stderr: -199> 2024-09-12T17:21:42.092+0000 7fccd15329c0 1 librados: starting msgr at 2024-09-12T17:21:42.470 INFO:tasks.workunit.client.0.smithi016.stderr: -198> 2024-09-12T17:21:42.092+0000 7fccd15329c0 1 librados: starting objecter 2024-09-12T17:21:42.470 INFO:tasks.workunit.client.0.smithi016.stderr: -197> 2024-09-12T17:21:42.092+0000 7fccd15329c0 5 asok(0x55a0697932b0) register_command objecter_requests cmddesc objecter_requests hook 0x55a069a65570 EEXIST 2024-09-12T17:21:42.470 INFO:tasks.workunit.client.0.smithi016.stderr: -196> 2024-09-12T17:21:42.092+0000 7fccd15329c0 1 librados: setting wanted keys 2024-09-12T17:21:42.470 INFO:tasks.workunit.client.0.smithi016.stderr: -195> 2024-09-12T17:21:42.092+0000 7fccd15329c0 1 librados: calling monclient init 2024-09-12T17:21:42.470 INFO:tasks.workunit.client.0.smithi016.stderr: -194> 2024-09-12T17:21:42.092+0000 7fccd15329c0 10 monclient: init 2024-09-12T17:21:42.470 INFO:tasks.workunit.client.0.smithi016.stderr: -193> 2024-09-12T17:21:42.092+0000 7fccd15329c0 5 AuthRegistry(0x55a069a20b80) adding auth protocol: cephx 2024-09-12T17:21:42.470 INFO:tasks.workunit.client.0.smithi016.stderr: -192> 2024-09-12T17:21:42.092+0000 7fccd15329c0 5 AuthRegistry(0x55a069a20b80) adding auth protocol: cephx 2024-09-12T17:21:42.470 INFO:tasks.workunit.client.0.smithi016.stderr: -191> 2024-09-12T17:21:42.092+0000 7fccd15329c0 5 AuthRegistry(0x55a069a20b80) adding auth protocol: cephx 2024-09-12T17:21:42.470 INFO:tasks.workunit.client.0.smithi016.stderr: -190> 2024-09-12T17:21:42.092+0000 7fccd15329c0 5 AuthRegistry(0x55a069a20b80) adding con mode: secure 2024-09-12T17:21:42.470 INFO:tasks.workunit.client.0.smithi016.stderr: -189> 2024-09-12T17:21:42.092+0000 7fccd15329c0 5 AuthRegistry(0x55a069a20b80) adding con mode: crc 2024-09-12T17:21:42.470 INFO:tasks.workunit.client.0.smithi016.stderr: -188> 2024-09-12T17:21:42.092+0000 7fccd15329c0 5 AuthRegistry(0x55a069a20b80) adding con mode: secure 2024-09-12T17:21:42.471 INFO:tasks.workunit.client.0.smithi016.stderr: -187> 2024-09-12T17:21:42.092+0000 7fccd15329c0 5 AuthRegistry(0x55a069a20b80) adding con mode: crc 2024-09-12T17:21:42.471 INFO:tasks.workunit.client.0.smithi016.stderr: -186> 2024-09-12T17:21:42.092+0000 7fccd15329c0 5 AuthRegistry(0x55a069a20b80) adding con mode: secure 2024-09-12T17:21:42.471 INFO:tasks.workunit.client.0.smithi016.stderr: -185> 2024-09-12T17:21:42.092+0000 7fccd15329c0 5 AuthRegistry(0x55a069a20b80) adding con mode: crc 2024-09-12T17:21:42.471 INFO:tasks.workunit.client.0.smithi016.stderr: -184> 2024-09-12T17:21:42.092+0000 7fccd15329c0 5 AuthRegistry(0x55a069a20b80) adding con mode: crc 2024-09-12T17:21:42.471 INFO:tasks.workunit.client.0.smithi016.stderr: -183> 2024-09-12T17:21:42.092+0000 7fccd15329c0 5 AuthRegistry(0x55a069a20b80) adding con mode: secure 2024-09-12T17:21:42.471 INFO:tasks.workunit.client.0.smithi016.stderr: -182> 2024-09-12T17:21:42.092+0000 7fccd15329c0 5 AuthRegistry(0x55a069a20b80) adding con mode: crc 2024-09-12T17:21:42.471 INFO:tasks.workunit.client.0.smithi016.stderr: -181> 2024-09-12T17:21:42.092+0000 7fccd15329c0 5 AuthRegistry(0x55a069a20b80) adding con mode: secure 2024-09-12T17:21:42.471 INFO:tasks.workunit.client.0.smithi016.stderr: -180> 2024-09-12T17:21:42.092+0000 7fccd15329c0 5 AuthRegistry(0x55a069a20b80) adding con mode: crc 2024-09-12T17:21:42.471 INFO:tasks.workunit.client.0.smithi016.stderr: -179> 2024-09-12T17:21:42.092+0000 7fccd15329c0 5 AuthRegistry(0x55a069a20b80) adding con mode: secure 2024-09-12T17:21:42.471 INFO:tasks.workunit.client.0.smithi016.stderr: -178> 2024-09-12T17:21:42.092+0000 7fccd15329c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:42.471 INFO:tasks.workunit.client.0.smithi016.stderr: -177> 2024-09-12T17:21:42.092+0000 7fccd15329c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:42.471 INFO:tasks.workunit.client.0.smithi016.stderr: -176> 2024-09-12T17:21:42.092+0000 7fccd15329c0 5 asok(0x55a0697932b0) register_command rotate-key cmddesc rotate-key hook 0x55a069a20cc8 EEXIST 2024-09-12T17:21:42.471 INFO:tasks.workunit.client.0.smithi016.stderr: -175> 2024-09-12T17:21:42.092+0000 7fccd15329c0 10 monclient: _reopen_session rank -1 2024-09-12T17:21:42.471 INFO:tasks.workunit.client.0.smithi016.stderr: -174> 2024-09-12T17:21:42.092+0000 7fccd15329c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:21:42.472 INFO:tasks.workunit.client.0.smithi016.stderr: -173> 2024-09-12T17:21:42.092+0000 7fccd15329c0 10 monclient(hunting): picked mon.noname-a con 0x55a069a42420 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:21:42.472 INFO:tasks.workunit.client.0.smithi016.stderr: -172> 2024-09-12T17:21:42.092+0000 7fccd15329c0 10 monclient(hunting): picked mon.noname-c con 0x55a069a6da30 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:21:42.472 INFO:tasks.workunit.client.0.smithi016.stderr: -171> 2024-09-12T17:21:42.092+0000 7fccd15329c0 10 monclient(hunting): picked mon.noname-b con 0x55a069a72640 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:21:42.472 INFO:tasks.workunit.client.0.smithi016.stderr: -170> 2024-09-12T17:21:42.092+0000 7fccd15329c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:42.472 INFO:tasks.workunit.client.0.smithi016.stderr: -169> 2024-09-12T17:21:42.092+0000 7fccd15329c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:42.472 INFO:tasks.workunit.client.0.smithi016.stderr: -168> 2024-09-12T17:21:42.092+0000 7fccd15329c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:42.472 INFO:tasks.workunit.client.0.smithi016.stderr: -167> 2024-09-12T17:21:42.092+0000 7fccd15329c0 10 monclient(hunting): _renew_subs 2024-09-12T17:21:42.472 INFO:tasks.workunit.client.0.smithi016.stderr: -166> 2024-09-12T17:21:42.092+0000 7fccd15329c0 10 monclient(hunting): authenticate will time out at 2420.068995s 2024-09-12T17:21:42.472 INFO:tasks.workunit.client.0.smithi016.stderr: -165> 2024-09-12T17:21:42.092+0000 7fcccf839640 10 monclient(hunting): get_auth_request con 0x55a069a6da30 auth_method 0 2024-09-12T17:21:42.472 INFO:tasks.workunit.client.0.smithi016.stderr: -164> 2024-09-12T17:21:42.092+0000 7fcccf839640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:21:42.472 INFO:tasks.workunit.client.0.smithi016.stderr: -163> 2024-09-12T17:21:42.092+0000 7fcccf839640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:21:42.472 INFO:tasks.workunit.client.0.smithi016.stderr: -162> 2024-09-12T17:21:42.092+0000 7fcccf839640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:21:42.472 INFO:tasks.workunit.client.0.smithi016.stderr: -161> 2024-09-12T17:21:42.092+0000 7fccce837640 10 monclient(hunting): get_auth_request con 0x55a069a42420 auth_method 0 2024-09-12T17:21:42.472 INFO:tasks.workunit.client.0.smithi016.stderr: -160> 2024-09-12T17:21:42.092+0000 7fccce837640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:21:42.473 INFO:tasks.workunit.client.0.smithi016.stderr: -159> 2024-09-12T17:21:42.092+0000 7fccce837640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:21:42.473 INFO:tasks.workunit.client.0.smithi016.stderr: -158> 2024-09-12T17:21:42.092+0000 7fccce837640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:21:42.473 INFO:tasks.workunit.client.0.smithi016.stderr: -157> 2024-09-12T17:21:42.092+0000 7fcccf839640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:21:42.473 INFO:tasks.workunit.client.0.smithi016.stderr: -156> 2024-09-12T17:21:42.092+0000 7fcccf839640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:21:42.473 INFO:tasks.workunit.client.0.smithi016.stderr: -155> 2024-09-12T17:21:42.092+0000 7fcccf839640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:21:42.473 INFO:tasks.workunit.client.0.smithi016.stderr: -154> 2024-09-12T17:21:42.092+0000 7fccce837640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:21:42.473 INFO:tasks.workunit.client.0.smithi016.stderr: -153> 2024-09-12T17:21:42.092+0000 7fccce837640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:21:42.473 INFO:tasks.workunit.client.0.smithi016.stderr: -152> 2024-09-12T17:21:42.092+0000 7fccce837640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:21:42.473 INFO:tasks.workunit.client.0.smithi016.stderr: -151> 2024-09-12T17:21:42.092+0000 7fccce837640 10 monclient(hunting): handle_auth_done global_id 7929 payload 824 2024-09-12T17:21:42.473 INFO:tasks.workunit.client.0.smithi016.stderr: -150> 2024-09-12T17:21:42.092+0000 7fccce837640 10 monclient: _finish_hunting 0 2024-09-12T17:21:42.473 INFO:tasks.workunit.client.0.smithi016.stderr: -149> 2024-09-12T17:21:42.092+0000 7fccce837640 1 monclient: found mon.noname-a 2024-09-12T17:21:42.473 INFO:tasks.workunit.client.0.smithi016.stderr: -148> 2024-09-12T17:21:42.092+0000 7fccce837640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:21:42.474 INFO:tasks.workunit.client.0.smithi016.stderr: -147> 2024-09-12T17:21:42.092+0000 7fcbb17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:21:42.474 INFO:tasks.workunit.client.0.smithi016.stderr: -146> 2024-09-12T17:21:42.092+0000 7fcbb17fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:21:42.474 INFO:tasks.workunit.client.0.smithi016.stderr: -145> 2024-09-12T17:21:42.092+0000 7fcbb17fa640 10 monclient: dump: 2024-09-12T17:21:42.474 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:21:42.474 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:21:42.474 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:42.474 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:42.474 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:21:42.474 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:42.474 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:21:42.474 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:21:42.474 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:21:42.474 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:42.474 INFO:tasks.workunit.client.0.smithi016.stderr: -144> 2024-09-12T17:21:42.092+0000 7fcbb17fa640 10 monclient: _finish_auth 0 2024-09-12T17:21:42.475 INFO:tasks.workunit.client.0.smithi016.stderr: -143> 2024-09-12T17:21:42.092+0000 7fcbb17fa640 10 monclient: _check_auth_tickets 2024-09-12T17:21:42.475 INFO:tasks.workunit.client.0.smithi016.stderr: -142> 2024-09-12T17:21:42.092+0000 7fcbb17fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:21:42.475 INFO:tasks.workunit.client.0.smithi016.stderr: -141> 2024-09-12T17:21:42.092+0000 7fcbb17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:21:42.475 INFO:tasks.workunit.client.0.smithi016.stderr: -140> 2024-09-12T17:21:42.092+0000 7fcbb17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:21:42.475 INFO:tasks.workunit.client.0.smithi016.stderr: -139> 2024-09-12T17:21:42.092+0000 7fcbb17fa640 10 monclient: dump: 2024-09-12T17:21:42.475 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:21:42.475 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:21:42.475 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:42.475 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:42.475 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:21:42.475 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:42.475 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:21:42.475 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:21:42.476 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:21:42.476 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:42.476 INFO:tasks.workunit.client.0.smithi016.stderr: -138> 2024-09-12T17:21:42.092+0000 7fccd15329c0 5 monclient: authenticate success, global_id 7929 2024-09-12T17:21:42.476 INFO:tasks.workunit.client.0.smithi016.stderr: -137> 2024-09-12T17:21:42.092+0000 7fccd15329c0 10 monclient: _renew_subs 2024-09-12T17:21:42.476 INFO:tasks.workunit.client.0.smithi016.stderr: -136> 2024-09-12T17:21:42.092+0000 7fcbb2ffd640 4 set_mon_vals no callback set 2024-09-12T17:21:42.476 INFO:tasks.workunit.client.0.smithi016.stderr: -135> 2024-09-12T17:21:42.092+0000 7fccd15329c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:21:42.476 INFO:tasks.workunit.client.0.smithi016.stderr: -134> 2024-09-12T17:21:42.092+0000 7fccd15329c0 10 monclient: _renew_subs 2024-09-12T17:21:42.476 INFO:tasks.workunit.client.0.smithi016.stderr: -133> 2024-09-12T17:21:42.092+0000 7fccd15329c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:21:42.476 INFO:tasks.workunit.client.0.smithi016.stderr: -132> 2024-09-12T17:21:42.092+0000 7fccd15329c0 1 librados: init done 2024-09-12T17:21:42.476 INFO:tasks.workunit.client.0.smithi016.stderr: -131> 2024-09-12T17:21:42.092+0000 7fccd15329c0 5 asok(0x55a0697932b0) register_command cr dump hook 0x55a069a687b8 2024-09-12T17:21:42.476 INFO:tasks.workunit.client.0.smithi016.stderr: -130> 2024-09-12T17:21:42.092+0000 7fccd15329c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.476 INFO:tasks.workunit.client.0.smithi016.stderr: -129> 2024-09-12T17:21:42.096+0000 7fcbb17fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:21:42.476 INFO:tasks.workunit.client.0.smithi016.stderr: -128> 2024-09-12T17:21:42.096+0000 7fcbb17fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:21:42.477 INFO:tasks.workunit.client.0.smithi016.stderr: -127> 2024-09-12T17:21:42.096+0000 7fcbb17fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:21:42.477 INFO:tasks.workunit.client.0.smithi016.stderr: -126> 2024-09-12T17:21:42.096+0000 7fcccf839640 10 monclient: get_auth_request con 0x7fcb98070ae0 auth_method 0 2024-09-12T17:21:42.477 INFO:tasks.workunit.client.0.smithi016.stderr: -125> 2024-09-12T17:21:42.096+0000 7fcccf038640 10 monclient: get_auth_request con 0x55a069a8c2e0 auth_method 0 2024-09-12T17:21:42.477 INFO:tasks.workunit.client.0.smithi016.stderr: -124> 2024-09-12T17:21:42.096+0000 7fccd15329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:42.477 INFO:tasks.workunit.client.0.smithi016.stderr: -123> 2024-09-12T17:21:42.096+0000 7fccd15329c0 20 realm 2024-09-12T17:21:42.477 INFO:tasks.workunit.client.0.smithi016.stderr: -122> 2024-09-12T17:21:42.096+0000 7fccd15329c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.477 INFO:tasks.workunit.client.0.smithi016.stderr: -121> 2024-09-12T17:21:42.096+0000 7fccd15329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:42.477 INFO:tasks.workunit.client.0.smithi016.stderr: -120> 2024-09-12T17:21:42.096+0000 7fccd15329c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:21:42.477 INFO:tasks.workunit.client.0.smithi016.stderr: -119> 2024-09-12T17:21:42.096+0000 7fccd15329c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.477 INFO:tasks.workunit.client.0.smithi016.stderr: -118> 2024-09-12T17:21:42.096+0000 7fccd15329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:42.477 INFO:tasks.workunit.client.0.smithi016.stderr: -117> 2024-09-12T17:21:42.096+0000 7fccd15329c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.477 INFO:tasks.workunit.client.0.smithi016.stderr: -116> 2024-09-12T17:21:42.096+0000 7fccce837640 10 monclient: get_auth_request con 0x55a069a90610 auth_method 0 2024-09-12T17:21:42.477 INFO:tasks.workunit.client.0.smithi016.stderr: -115> 2024-09-12T17:21:42.096+0000 7fccd15329c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:42.478 INFO:tasks.workunit.client.0.smithi016.stderr: -114> 2024-09-12T17:21:42.096+0000 7fccd15329c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.478 INFO:tasks.workunit.client.0.smithi016.stderr: -113> 2024-09-12T17:21:42.100+0000 7fcccf839640 10 monclient: get_auth_request con 0x55a069a93d30 auth_method 0 2024-09-12T17:21:42.478 INFO:tasks.workunit.client.0.smithi016.stderr: -112> 2024-09-12T17:21:42.100+0000 7fccd15329c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:21:42.478 INFO:tasks.workunit.client.0.smithi016.stderr: -111> 2024-09-12T17:21:42.100+0000 7fccd15329c0 20 searching for the correct realm 2024-09-12T17:21:42.478 INFO:tasks.workunit.client.0.smithi016.stderr: -110> 2024-09-12T17:21:42.100+0000 7fcccf038640 10 monclient: get_auth_request con 0x55a069a98b10 auth_method 0 2024-09-12T17:21:42.478 INFO:tasks.workunit.client.0.smithi016.stderr: -109> 2024-09-12T17:21:42.100+0000 7fccce837640 10 monclient: get_auth_request con 0x7fccc00c1070 auth_method 0 2024-09-12T17:21:42.478 INFO:tasks.workunit.client.0.smithi016.stderr: -108> 2024-09-12T17:21:42.104+0000 7fcccf839640 10 monclient: get_auth_request con 0x7fccc4008070 auth_method 0 2024-09-12T17:21:42.478 INFO:tasks.workunit.client.0.smithi016.stderr: -107> 2024-09-12T17:21:42.104+0000 7fcccf839640 0 -- 172.21.15.16:0/3570144761 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fccc4008070 msgr2=0x7fccc408eaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:42.478 INFO:tasks.workunit.client.0.smithi016.stderr: -106> 2024-09-12T17:21:42.104+0000 7fcbb17fa640 1 client.7929.objecter ms_handle_reset 0x7fccc4008070 session 0x7fccc4026040 osd.2 2024-09-12T17:21:42.478 INFO:tasks.workunit.client.0.smithi016.stderr: -105> 2024-09-12T17:21:42.104+0000 7fcbb17fa640 10 monclient: _renew_subs 2024-09-12T17:21:42.478 INFO:tasks.workunit.client.0.smithi016.stderr: -104> 2024-09-12T17:21:42.104+0000 7fcbb17fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:21:42.478 INFO:tasks.workunit.client.0.smithi016.stderr: -103> 2024-09-12T17:21:42.104+0000 7fcccf839640 10 monclient: get_auth_request con 0x7fcb98080900 auth_method 0 2024-09-12T17:21:42.478 INFO:tasks.workunit.client.0.smithi016.stderr: -102> 2024-09-12T17:21:42.104+0000 7fcccf038640 10 monclient: get_auth_request con 0x7fccc8050040 auth_method 0 2024-09-12T17:21:42.478 INFO:tasks.workunit.client.0.smithi016.stderr: -101> 2024-09-12T17:21:42.112+0000 7fccce837640 0 -- 172.21.15.16:0/3570144761 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fccc803e040 msgr2=0x7fccc8050930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:42.479 INFO:tasks.workunit.client.0.smithi016.stderr: -100> 2024-09-12T17:21:42.112+0000 7fccce837640 10 monclient: get_auth_request con 0x7fccc803e040 auth_method 0 2024-09-12T17:21:42.479 INFO:tasks.workunit.client.0.smithi016.stderr: -99> 2024-09-12T17:21:42.316+0000 7fccce837640 10 monclient: get_auth_request con 0x7fccc803e040 auth_method 0 2024-09-12T17:21:42.479 INFO:tasks.workunit.client.0.smithi016.stderr: -98> 2024-09-12T17:21:42.332+0000 7fccd15329c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:21:42.479 INFO:tasks.workunit.client.0.smithi016.stderr: -97> 2024-09-12T17:21:42.332+0000 7fccd15329c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:21:42.479 INFO:tasks.workunit.client.0.smithi016.stderr: -96> 2024-09-12T17:21:42.332+0000 7fccd15329c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:21:42.479 INFO:tasks.workunit.client.0.smithi016.stderr: -95> 2024-09-12T17:21:42.332+0000 7fccd15329c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:21:42.479 INFO:tasks.workunit.client.0.smithi016.stderr: -94> 2024-09-12T17:21:42.332+0000 7fccd15329c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:21:42.479 INFO:tasks.workunit.client.0.smithi016.stderr: -93> 2024-09-12T17:21:42.332+0000 7fccd15329c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:21:42.479 INFO:tasks.workunit.client.0.smithi016.stderr: -92> 2024-09-12T17:21:42.332+0000 7fccd15329c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.479 INFO:tasks.workunit.client.0.smithi016.stderr: -91> 2024-09-12T17:21:42.332+0000 7fccd15329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:42.479 INFO:tasks.workunit.client.0.smithi016.stderr: -90> 2024-09-12T17:21:42.332+0000 7fccd15329c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.479 INFO:tasks.workunit.client.0.smithi016.stderr: -89> 2024-09-12T17:21:42.332+0000 7fccd15329c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:42.479 INFO:tasks.workunit.client.0.smithi016.stderr: -88> 2024-09-12T17:21:42.332+0000 7fccd15329c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.480 INFO:tasks.workunit.client.0.smithi016.stderr: -87> 2024-09-12T17:21:42.332+0000 7fccd15329c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:21:42.480 INFO:tasks.workunit.client.0.smithi016.stderr: -86> 2024-09-12T17:21:42.332+0000 7fccd15329c0 20 zone default found 2024-09-12T17:21:42.480 INFO:tasks.workunit.client.0.smithi016.stderr: -85> 2024-09-12T17:21:42.332+0000 7fccd15329c0 4 Realm: () 2024-09-12T17:21:42.480 INFO:tasks.workunit.client.0.smithi016.stderr: -84> 2024-09-12T17:21:42.332+0000 7fccd15329c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:21:42.480 INFO:tasks.workunit.client.0.smithi016.stderr: -83> 2024-09-12T17:21:42.332+0000 7fccd15329c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:21:42.480 INFO:tasks.workunit.client.0.smithi016.stderr: -82> 2024-09-12T17:21:42.332+0000 7fccd15329c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:21:42.480 INFO:tasks.workunit.client.0.smithi016.stderr: -81> 2024-09-12T17:21:42.332+0000 7fccd15329c0 20 zonegroup default 2024-09-12T17:21:42.480 INFO:tasks.workunit.client.0.smithi016.stderr: -80> 2024-09-12T17:21:42.332+0000 7fccd15329c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.480 INFO:tasks.workunit.client.0.smithi016.stderr: -79> 2024-09-12T17:21:42.332+0000 7fccd15329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:42.480 INFO:tasks.workunit.client.0.smithi016.stderr: -78> 2024-09-12T17:21:42.332+0000 7fccd15329c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.480 INFO:tasks.workunit.client.0.smithi016.stderr: -77> 2024-09-12T17:21:42.336+0000 7fccd15329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:42.480 INFO:tasks.workunit.client.0.smithi016.stderr: -76> 2024-09-12T17:21:42.336+0000 7fccd15329c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.480 INFO:tasks.workunit.client.0.smithi016.stderr: -75> 2024-09-12T17:21:42.336+0000 7fccd15329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:42.481 INFO:tasks.workunit.client.0.smithi016.stderr: -74> 2024-09-12T17:21:42.336+0000 7fccd15329c0 20 started sync module instance, tier type = 2024-09-12T17:21:42.481 INFO:tasks.workunit.client.0.smithi016.stderr: -73> 2024-09-12T17:21:42.336+0000 7fccd15329c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:21:42.481 INFO:tasks.workunit.client.0.smithi016.stderr: -72> 2024-09-12T17:21:42.360+0000 7fccd15329c0 20 add_watcher() i=0 2024-09-12T17:21:42.481 INFO:tasks.workunit.client.0.smithi016.stderr: -71> 2024-09-12T17:21:42.360+0000 7fccd15329c0 20 add_watcher() i=1 2024-09-12T17:21:42.481 INFO:tasks.workunit.client.0.smithi016.stderr: -70> 2024-09-12T17:21:42.360+0000 7fccd15329c0 20 add_watcher() i=2 2024-09-12T17:21:42.481 INFO:tasks.workunit.client.0.smithi016.stderr: -69> 2024-09-12T17:21:42.360+0000 7fccd15329c0 20 add_watcher() i=3 2024-09-12T17:21:42.481 INFO:tasks.workunit.client.0.smithi016.stderr: -68> 2024-09-12T17:21:42.360+0000 7fccd15329c0 20 add_watcher() i=4 2024-09-12T17:21:42.481 INFO:tasks.workunit.client.0.smithi016.stderr: -67> 2024-09-12T17:21:42.360+0000 7fccd15329c0 20 add_watcher() i=5 2024-09-12T17:21:42.481 INFO:tasks.workunit.client.0.smithi016.stderr: -66> 2024-09-12T17:21:42.360+0000 7fccd15329c0 20 add_watcher() i=6 2024-09-12T17:21:42.481 INFO:tasks.workunit.client.0.smithi016.stderr: -65> 2024-09-12T17:21:42.364+0000 7fccd15329c0 20 add_watcher() i=7 2024-09-12T17:21:42.481 INFO:tasks.workunit.client.0.smithi016.stderr: -64> 2024-09-12T17:21:42.364+0000 7fccd15329c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:21:42.481 INFO:tasks.workunit.client.0.smithi016.stderr: -63> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b939a70) adding auth protocol: cephx 2024-09-12T17:21:42.481 INFO:tasks.workunit.client.0.smithi016.stderr: -62> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b939a70) adding auth protocol: cephx 2024-09-12T17:21:42.482 INFO:tasks.workunit.client.0.smithi016.stderr: -61> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b939a70) adding auth protocol: cephx 2024-09-12T17:21:42.482 INFO:tasks.workunit.client.0.smithi016.stderr: -60> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b939a70) adding con mode: secure 2024-09-12T17:21:42.482 INFO:tasks.workunit.client.0.smithi016.stderr: -59> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b939a70) adding con mode: crc 2024-09-12T17:21:42.482 INFO:tasks.workunit.client.0.smithi016.stderr: -58> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b939a70) adding con mode: secure 2024-09-12T17:21:42.482 INFO:tasks.workunit.client.0.smithi016.stderr: -57> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b939a70) adding con mode: crc 2024-09-12T17:21:42.482 INFO:tasks.workunit.client.0.smithi016.stderr: -56> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b939a70) adding con mode: secure 2024-09-12T17:21:42.482 INFO:tasks.workunit.client.0.smithi016.stderr: -55> 2024-09-12T17:21:42.368+0000 7fcb85fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:42.482 INFO:tasks.workunit.client.0.smithi016.stderr: -54> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b939a70) adding con mode: crc 2024-09-12T17:21:42.482 INFO:tasks.workunit.client.0.smithi016.stderr: -53> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b939a70) adding con mode: crc 2024-09-12T17:21:42.482 INFO:tasks.workunit.client.0.smithi016.stderr: -52> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b939a70) adding con mode: secure 2024-09-12T17:21:42.482 INFO:tasks.workunit.client.0.smithi016.stderr: -51> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b939a70) adding con mode: crc 2024-09-12T17:21:42.482 INFO:tasks.workunit.client.0.smithi016.stderr: -50> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b939a70) adding con mode: secure 2024-09-12T17:21:42.482 INFO:tasks.workunit.client.0.smithi016.stderr: -49> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b939a70) adding con mode: crc 2024-09-12T17:21:42.483 INFO:tasks.workunit.client.0.smithi016.stderr: -48> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b939a70) adding con mode: secure 2024-09-12T17:21:42.483 INFO:tasks.workunit.client.0.smithi016.stderr: -47> 2024-09-12T17:21:42.368+0000 7fccd15329c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:42.483 INFO:tasks.workunit.client.0.smithi016.stderr: -46> 2024-09-12T17:21:42.368+0000 7fccd15329c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:21:42.483 INFO:tasks.workunit.client.0.smithi016.stderr: -45> 2024-09-12T17:21:42.368+0000 7fccd15329c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:21:42.483 INFO:tasks.workunit.client.0.smithi016.stderr: -44> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 asok(0x55a0697932b0) register_command cache list hook 0x55a069a410e0 2024-09-12T17:21:42.483 INFO:tasks.workunit.client.0.smithi016.stderr: -43> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 asok(0x55a0697932b0) register_command cache inspect hook 0x55a069a410e0 2024-09-12T17:21:42.483 INFO:tasks.workunit.client.0.smithi016.stderr: -42> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 asok(0x55a0697932b0) register_command cache erase hook 0x55a069a410e0 2024-09-12T17:21:42.483 INFO:tasks.workunit.client.0.smithi016.stderr: -41> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 asok(0x55a0697932b0) register_command cache zap hook 0x55a069a410e0 2024-09-12T17:21:42.483 INFO:tasks.workunit.client.0.smithi016.stderr: -40> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 note: GC not initialized 2024-09-12T17:21:42.483 INFO:tasks.workunit.client.0.smithi016.stderr: -39> 2024-09-12T17:21:42.368+0000 7fcb84fe1640 20 reqs_thread_entry: start 2024-09-12T17:21:42.483 INFO:tasks.workunit.client.0.smithi016.stderr: -38> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 asok(0x55a0697932b0) register_command sync trace show hook 0x7fccc400ad90 2024-09-12T17:21:42.483 INFO:tasks.workunit.client.0.smithi016.stderr: -37> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 asok(0x55a0697932b0) register_command sync trace history hook 0x7fccc400ad90 2024-09-12T17:21:42.483 INFO:tasks.workunit.client.0.smithi016.stderr: -36> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 asok(0x55a0697932b0) register_command sync trace active hook 0x7fccc400ad90 2024-09-12T17:21:42.484 INFO:tasks.workunit.client.0.smithi016.stderr: -35> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 asok(0x55a0697932b0) register_command sync trace active_short hook 0x7fccc400ad90 2024-09-12T17:21:42.484 INFO:tasks.workunit.client.0.smithi016.stderr: -34> 2024-09-12T17:21:42.368+0000 7fccd15329c0 20 init_complete bucket index max shards: 1 2024-09-12T17:21:42.484 INFO:tasks.workunit.client.0.smithi016.stderr: -33> 2024-09-12T17:21:42.368+0000 7fccd15329c0 20 Filter name: none 2024-09-12T17:21:42.484 INFO:tasks.workunit.client.0.smithi016.stderr: -32> 2024-09-12T17:21:42.368+0000 7fcafe7fc640 20 reqs_thread_entry: start 2024-09-12T17:21:42.484 INFO:tasks.workunit.client.0.smithi016.stderr: -31> 2024-09-12T17:21:42.368+0000 7fccd15329c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T17:21:42.484 INFO:tasks.workunit.client.0.smithi016.stderr: -30> 2024-09-12T17:21:42.368+0000 7fccd15329c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.484 INFO:tasks.workunit.client.0.smithi016.stderr: -29> 2024-09-12T17:21:42.368+0000 7fccd15329c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:21:42.484 INFO:tasks.workunit.client.0.smithi016.stderr: -28> 2024-09-12T17:21:42.368+0000 7fccd15329c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T17:21:42.484 INFO:tasks.workunit.client.0.smithi016.stderr: -27> 2024-09-12T17:21:42.368+0000 7fccd15329c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T17:21:42.484 INFO:tasks.workunit.client.0.smithi016.stderr: -26> 2024-09-12T17:21:42.368+0000 7fccd15329c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 : miss 2024-09-12T17:21:42.484 INFO:tasks.workunit.client.0.smithi016.stderr: -25> 2024-09-12T17:21:42.368+0000 7fccd15329c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.484 INFO:tasks.workunit.client.0.smithi016.stderr: -24> 2024-09-12T17:21:42.372+0000 7fccd15329c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:21:42.484 INFO:tasks.workunit.client.0.smithi016.stderr: -23> 2024-09-12T17:21:42.372+0000 7fccd15329c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 info.flags=0x17 2024-09-12T17:21:42.485 INFO:tasks.workunit.client.0.smithi016.stderr: -22> 2024-09-12T17:21:42.372+0000 7fccd15329c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 to cache LRU end 2024-09-12T17:21:42.485 INFO:tasks.workunit.client.0.smithi016.stderr: -21> 2024-09-12T17:21:42.372+0000 7fccd15329c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:21:42.485 INFO:tasks.workunit.client.0.smithi016.stderr: -20> 2024-09-12T17:21:42.372+0000 7fccd15329c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:42.485 INFO:tasks.workunit.client.0.smithi016.stderr: -19> 2024-09-12T17:21:42.372+0000 7fccd15329c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 2024-09-12T17:21:42.485 INFO:tasks.workunit.client.0.smithi016.stderr: -18> 2024-09-12T17:21:42.380+0000 7fccd15329c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 info.flags=0x17 2024-09-12T17:21:42.485 INFO:tasks.workunit.client.0.smithi016.stderr: -17> 2024-09-12T17:21:42.380+0000 7fccd15329c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 to cache LRU end 2024-09-12T17:21:42.485 INFO:tasks.workunit.client.0.smithi016.stderr: -16> 2024-09-12T17:21:42.380+0000 7fccd15329c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:42.485 INFO:tasks.workunit.client.0.smithi016.stderr: -15> 2024-09-12T17:21:42.380+0000 7fccd15329c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39, ofs0, ns] 2024-09-12T17:21:42.485 INFO:tasks.workunit.client.0.smithi016.stderr: -14> 2024-09-12T17:21:42.380+0000 7fcbb2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431671 cookie 94147455871328 notifier 7929 bl.length()=931 2024-09-12T17:21:42.485 INFO:tasks.workunit.client.0.smithi016.stderr: -13> 2024-09-12T17:21:42.380+0000 7fcbb2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 info.flags=0x17 2024-09-12T17:21:42.485 INFO:tasks.workunit.client.0.smithi016.stderr: -12> 2024-09-12T17:21:42.380+0000 7fcbb2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 to cache LRU end 2024-09-12T17:21:42.485 INFO:tasks.workunit.client.0.smithi016.stderr: -11> 2024-09-12T17:21:42.380+0000 7fcbb2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:42.485 INFO:tasks.workunit.client.0.smithi016.stderr: -10> 2024-09-12T17:21:42.384+0000 7fccd15329c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39]): orig_sources= new_sources= 2024-09-12T17:21:42.486 INFO:tasks.workunit.client.0.smithi016.stderr: -9> 2024-09-12T17:21:42.384+0000 7fccd15329c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39]): potential sources added=[] removed=[] 2024-09-12T17:21:42.486 INFO:tasks.workunit.client.0.smithi016.stderr: -8> 2024-09-12T17:21:42.384+0000 7fccd15329c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39]): orig_dests= new_dests= 2024-09-12T17:21:42.486 INFO:tasks.workunit.client.0.smithi016.stderr: -7> 2024-09-12T17:21:42.384+0000 7fccd15329c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39]): potential dests added=[] removed=[] 2024-09-12T17:21:42.486 INFO:tasks.workunit.client.0.smithi016.stderr: -6> 2024-09-12T17:21:42.388+0000 7fccd15329c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39.1.0 2024-09-12T17:21:42.486 INFO:tasks.workunit.client.0.smithi016.stderr: -5> 2024-09-12T17:21:42.388+0000 7fccd15329c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39.1.0 2024-09-12T17:21:42.486 INFO:tasks.workunit.client.0.smithi016.stderr: -4> 2024-09-12T17:21:42.388+0000 7fccd15329c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39.1.1 2024-09-12T17:21:42.486 INFO:tasks.workunit.client.0.smithi016.stderr: -3> 2024-09-12T17:21:42.388+0000 7fccd15329c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39.1.1 2024-09-12T17:21:42.486 INFO:tasks.workunit.client.0.smithi016.stderr: -2> 2024-09-12T17:21:42.388+0000 7fccd15329c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39.0 2024-09-12T17:21:42.486 INFO:tasks.workunit.client.0.smithi016.stderr: -1> 2024-09-12T17:21:42.400+0000 7fccd15329c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fccd15329c0 time 2024-09-12T17:21:42.400515+0000 2024-09-12T17:21:42.486 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:21:42.486 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:42.486 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:21:42.487 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fccd4e0c2eb] 2024-09-12T17:21:42.487 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fccd4e0c49f] 2024-09-12T17:21:42.487 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a0668600c1] 2024-09-12T17:21:42.487 INFO:tasks.workunit.client.0.smithi016.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55a0668714f1] 2024-09-12T17:21:42.487 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55a066872b44] 2024-09-12T17:21:42.487 INFO:tasks.workunit.client.0.smithi016.stderr: 6: main() 2024-09-12T17:21:42.487 INFO:tasks.workunit.client.0.smithi016.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fccd3c72d90] 2024-09-12T17:21:42.487 INFO:tasks.workunit.client.0.smithi016.stderr: 8: __libc_start_main() 2024-09-12T17:21:42.487 INFO:tasks.workunit.client.0.smithi016.stderr: 9: _start() 2024-09-12T17:21:42.487 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:42.487 INFO:tasks.workunit.client.0.smithi016.stderr: 0> 2024-09-12T17:21:42.404+0000 7fccd15329c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:21:42.487 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7fccd15329c0 thread_name:radosgw-admin 2024-09-12T17:21:42.487 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:42.488 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:21:42.488 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fccd3c8b520] 2024-09-12T17:21:42.488 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:21:42.488 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:21:42.488 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:21:42.488 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fccd4e0c345] 2024-09-12T17:21:42.488 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fccd4e0c49f] 2024-09-12T17:21:42.488 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a0668600c1] 2024-09-12T17:21:42.488 INFO:tasks.workunit.client.0.smithi016.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55a0668714f1] 2024-09-12T17:21:42.488 INFO:tasks.workunit.client.0.smithi016.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55a066872b44] 2024-09-12T17:21:42.488 INFO:tasks.workunit.client.0.smithi016.stderr: 10: main() 2024-09-12T17:21:42.488 INFO:tasks.workunit.client.0.smithi016.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fccd3c72d90] 2024-09-12T17:21:42.488 INFO:tasks.workunit.client.0.smithi016.stderr: 12: __libc_start_main() 2024-09-12T17:21:42.489 INFO:tasks.workunit.client.0.smithi016.stderr: 13: _start() 2024-09-12T17:21:42.489 INFO:tasks.workunit.client.0.smithi016.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:21:42.489 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:42.489 INFO:tasks.workunit.client.0.smithi016.stderr:--- logging levels --- 2024-09-12T17:21:42.489 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 none 2024-09-12T17:21:42.489 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 lockdep 2024-09-12T17:21:42.489 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 context 2024-09-12T17:21:42.489 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 crush 2024-09-12T17:21:42.489 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds 2024-09-12T17:21:42.489 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_balancer 2024-09-12T17:21:42.489 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_locker 2024-09-12T17:21:42.489 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log 2024-09-12T17:21:42.489 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log_expire 2024-09-12T17:21:42.490 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_migrator 2024-09-12T17:21:42.490 INFO:tasks.workunit.client.0.smithi016.stderr: 3/ 5 mds_quiesce 2024-09-12T17:21:42.490 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 buffer 2024-09-12T17:21:42.490 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 timer 2024-09-12T17:21:42.490 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 filer 2024-09-12T17:21:42.490 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 striper 2024-09-12T17:21:42.490 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 objecter 2024-09-12T17:21:42.490 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rados 2024-09-12T17:21:42.490 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd 2024-09-12T17:21:42.490 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_mirror 2024-09-12T17:21:42.490 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_replay 2024-09-12T17:21:42.490 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_pwl 2024-09-12T17:21:42.490 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 journaler 2024-09-12T17:21:42.490 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objectcacher 2024-09-12T17:21:42.491 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:21:42.491 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 client 2024-09-12T17:21:42.491 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 osd 2024-09-12T17:21:42.491 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 optracker 2024-09-12T17:21:42.491 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objclass 2024-09-12T17:21:42.491 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 filestore 2024-09-12T17:21:42.491 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 journal 2024-09-12T17:21:42.491 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 ms 2024-09-12T17:21:42.491 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mon 2024-09-12T17:21:42.491 INFO:tasks.workunit.client.0.smithi016.stderr: 0/10 monc 2024-09-12T17:21:42.491 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 paxos 2024-09-12T17:21:42.491 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 tp 2024-09-12T17:21:42.491 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 auth 2024-09-12T17:21:42.492 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 crypto 2024-09-12T17:21:42.492 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 finisher 2024-09-12T17:21:42.492 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 reserver 2024-09-12T17:21:42.492 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 heartbeatmap 2024-09-12T17:21:42.492 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 perfcounter 2024-09-12T17:21:42.492 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw 2024-09-12T17:21:42.492 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_sync 2024-09-12T17:21:42.492 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_datacache 2024-09-12T17:21:42.492 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_access 2024-09-12T17:21:42.492 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:21:42.492 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_flight 2024-09-12T17:21:42.492 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:21:42.492 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw_notification 2024-09-12T17:21:42.493 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 javaclient 2024-09-12T17:21:42.493 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 asok 2024-09-12T17:21:42.493 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 throttle 2024-09-12T17:21:42.493 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 refs 2024-09-12T17:21:42.493 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 compressor 2024-09-12T17:21:42.493 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluestore 2024-09-12T17:21:42.493 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluefs 2024-09-12T17:21:42.493 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 bdev 2024-09-12T17:21:42.493 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 kstore 2024-09-12T17:21:42.493 INFO:tasks.workunit.client.0.smithi016.stderr: 4/ 5 rocksdb 2024-09-12T17:21:42.494 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 fuse 2024-09-12T17:21:42.494 INFO:tasks.workunit.client.0.smithi016.stderr: 2/ 5 mgr 2024-09-12T17:21:42.494 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mgrc 2024-09-12T17:21:42.494 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 dpdk 2024-09-12T17:21:42.494 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 eventtrace 2024-09-12T17:21:42.494 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 prioritycache 2024-09-12T17:21:42.494 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 test 2024-09-12T17:21:42.494 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:21:42.494 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephsqlite 2024-09-12T17:21:42.494 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:21:42.494 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore 2024-09-12T17:21:42.494 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_onode 2024-09-12T17:21:42.494 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_odata 2024-09-12T17:21:42.494 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_omap 2024-09-12T17:21:42.495 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_tm 2024-09-12T17:21:42.495 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_t 2024-09-12T17:21:42.495 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:21:42.495 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_epm 2024-09-12T17:21:42.495 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_lba 2024-09-12T17:21:42.495 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:21:42.495 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cache 2024-09-12T17:21:42.495 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_journal 2024-09-12T17:21:42.495 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_device 2024-09-12T17:21:42.495 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_backref 2024-09-12T17:21:42.495 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 alienstore 2024-09-12T17:21:42.495 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mclock 2024-09-12T17:21:42.495 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cyanstore 2024-09-12T17:21:42.496 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 ceph_exporter 2024-09-12T17:21:42.496 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 memstore 2024-09-12T17:21:42.496 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 trace 2024-09-12T17:21:42.496 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 ceph_dedup 2024-09-12T17:21:42.496 INFO:tasks.workunit.client.0.smithi016.stderr: -2/-2 (syslog threshold) 2024-09-12T17:21:42.496 INFO:tasks.workunit.client.0.smithi016.stderr: 99/99 (stderr threshold) 2024-09-12T17:21:42.496 INFO:tasks.workunit.client.0.smithi016.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:21:42.496 INFO:tasks.workunit.client.0.smithi016.stderr: 7fcafe7fc640 / http_manager 2024-09-12T17:21:42.496 INFO:tasks.workunit.client.0.smithi016.stderr: 7fcb84fe1640 / http_manager 2024-09-12T17:21:42.496 INFO:tasks.workunit.client.0.smithi016.stderr: 7fcb85fe3640 / rgw_dt_lg_renew 2024-09-12T17:21:42.496 INFO:tasks.workunit.client.0.smithi016.stderr: 7fcbb17fa640 / ms_dispatch 2024-09-12T17:21:42.496 INFO:tasks.workunit.client.0.smithi016.stderr: 7fcbb2ffd640 / io_context_pool 2024-09-12T17:21:42.496 INFO:tasks.workunit.client.0.smithi016.stderr: 7fcbb9602640 / ms_dispatch 2024-09-12T17:21:42.497 INFO:tasks.workunit.client.0.smithi016.stderr: 7fcbbbe07640 / ms_dispatch 2024-09-12T17:21:42.497 INFO:tasks.workunit.client.0.smithi016.stderr: 7fcbbd60a640 / io_context_pool 2024-09-12T17:21:42.497 INFO:tasks.workunit.client.0.smithi016.stderr: 7fccce036640 / io_context_pool 2024-09-12T17:21:42.497 INFO:tasks.workunit.client.0.smithi016.stderr: 7fccce837640 / msgr-worker-2 2024-09-12T17:21:42.497 INFO:tasks.workunit.client.0.smithi016.stderr: 7fcccf038640 / msgr-worker-1 2024-09-12T17:21:42.497 INFO:tasks.workunit.client.0.smithi016.stderr: 7fcccf839640 / msgr-worker-0 2024-09-12T17:21:42.497 INFO:tasks.workunit.client.0.smithi016.stderr: 7fccd15329c0 / radosgw-admin 2024-09-12T17:21:42.497 INFO:tasks.workunit.client.0.smithi016.stderr: max_recent 500 2024-09-12T17:21:42.497 INFO:tasks.workunit.client.0.smithi016.stderr: max_new 1000 2024-09-12T17:21:42.497 INFO:tasks.workunit.client.0.smithi016.stderr: log_file /var/log/ceph/ceph-client.admin.132719.log 2024-09-12T17:21:42.497 INFO:tasks.workunit.client.0.smithi016.stderr:--- end dump of recent events --- 2024-09-12T17:21:42.497 INFO:tasks.workunit.client.0.smithi016.stderr:--- begin dump of recent events --- 2024-09-12T17:21:42.497 INFO:tasks.workunit.client.0.smithi016.stderr: -499> 2024-09-12T17:21:42.068+0000 7fcbbd60a640 10 monclient: _finish_auth 0 2024-09-12T17:21:42.497 INFO:tasks.workunit.client.0.smithi016.stderr: -498> 2024-09-12T17:21:42.068+0000 7fcbbd60a640 10 monclient: _check_auth_tickets 2024-09-12T17:21:42.498 INFO:tasks.workunit.client.0.smithi016.stderr: -497> 2024-09-12T17:21:42.068+0000 7fcbbd60a640 10 monclient: handle_config config(0 keys) 2024-09-12T17:21:42.498 INFO:tasks.workunit.client.0.smithi016.stderr: -496> 2024-09-12T17:21:42.068+0000 7fccd15329c0 5 monclient: authenticate success, global_id 7917 2024-09-12T17:21:42.498 INFO:tasks.workunit.client.0.smithi016.stderr: -495> 2024-09-12T17:21:42.068+0000 7fccd15329c0 10 monclient: get_monmap_and_config success 2024-09-12T17:21:42.498 INFO:tasks.workunit.client.0.smithi016.stderr: -494> 2024-09-12T17:21:42.068+0000 7fccd15329c0 4 set_mon_vals no callback set 2024-09-12T17:21:42.498 INFO:tasks.workunit.client.0.smithi016.stderr: -493> 2024-09-12T17:21:42.068+0000 7fcbbd60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:21:42.498 INFO:tasks.workunit.client.0.smithi016.stderr: -492> 2024-09-12T17:21:42.068+0000 7fcbbd60a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:21:42.498 INFO:tasks.workunit.client.0.smithi016.stderr: -491> 2024-09-12T17:21:42.068+0000 7fcbbd60a640 10 monclient: dump: 2024-09-12T17:21:42.498 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:21:42.498 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:21:42.498 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:42.498 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:42.498 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:21:42.498 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:42.499 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:21:42.499 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:21:42.499 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:21:42.499 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:42.499 INFO:tasks.workunit.client.0.smithi016.stderr: -490> 2024-09-12T17:21:42.068+0000 7fccd15329c0 10 monclient: shutdown 2024-09-12T17:21:42.499 INFO:tasks.workunit.client.0.smithi016.stderr: -489> 2024-09-12T17:21:42.068+0000 7fccd15329c0 5 asok(0x55a0697932b0) unregister_commands rotate-key 2024-09-12T17:21:42.499 INFO:tasks.workunit.client.0.smithi016.stderr: -488> 2024-09-12T17:21:42.068+0000 7fccd15329c0 10 monclient: build_initial_monmap 2024-09-12T17:21:42.499 INFO:tasks.workunit.client.0.smithi016.stderr: -487> 2024-09-12T17:21:42.068+0000 7fccd15329c0 1 build_initial for_mkfs: 0 2024-09-12T17:21:42.499 INFO:tasks.workunit.client.0.smithi016.stderr: -486> 2024-09-12T17:21:42.068+0000 7fccd15329c0 10 monclient: monmap: 2024-09-12T17:21:42.499 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:21:42.499 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:21:42.499 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:21:42.499 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:21:42.500 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:21:42.500 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:42.500 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:21:42.500 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:21:42.500 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:21:42.500 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:42.500 INFO:tasks.workunit.client.0.smithi016.stderr: -485> 2024-09-12T17:21:42.068+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a3720) adding auth protocol: cephx 2024-09-12T17:21:42.500 INFO:tasks.workunit.client.0.smithi016.stderr: -484> 2024-09-12T17:21:42.068+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a3720) adding auth protocol: cephx 2024-09-12T17:21:42.500 INFO:tasks.workunit.client.0.smithi016.stderr: -483> 2024-09-12T17:21:42.068+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a3720) adding auth protocol: cephx 2024-09-12T17:21:42.500 INFO:tasks.workunit.client.0.smithi016.stderr: -482> 2024-09-12T17:21:42.068+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a3720) adding con mode: secure 2024-09-12T17:21:42.500 INFO:tasks.workunit.client.0.smithi016.stderr: -481> 2024-09-12T17:21:42.068+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a3720) adding con mode: crc 2024-09-12T17:21:42.500 INFO:tasks.workunit.client.0.smithi016.stderr: -480> 2024-09-12T17:21:42.068+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a3720) adding con mode: secure 2024-09-12T17:21:42.500 INFO:tasks.workunit.client.0.smithi016.stderr: -479> 2024-09-12T17:21:42.068+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a3720) adding con mode: crc 2024-09-12T17:21:42.501 INFO:tasks.workunit.client.0.smithi016.stderr: -478> 2024-09-12T17:21:42.068+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a3720) adding con mode: secure 2024-09-12T17:21:42.501 INFO:tasks.workunit.client.0.smithi016.stderr: -477> 2024-09-12T17:21:42.068+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a3720) adding con mode: crc 2024-09-12T17:21:42.501 INFO:tasks.workunit.client.0.smithi016.stderr: -476> 2024-09-12T17:21:42.068+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a3720) adding con mode: crc 2024-09-12T17:21:42.501 INFO:tasks.workunit.client.0.smithi016.stderr: -475> 2024-09-12T17:21:42.068+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a3720) adding con mode: secure 2024-09-12T17:21:42.501 INFO:tasks.workunit.client.0.smithi016.stderr: -474> 2024-09-12T17:21:42.068+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a3720) adding con mode: crc 2024-09-12T17:21:42.501 INFO:tasks.workunit.client.0.smithi016.stderr: -473> 2024-09-12T17:21:42.068+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a3720) adding con mode: secure 2024-09-12T17:21:42.501 INFO:tasks.workunit.client.0.smithi016.stderr: -472> 2024-09-12T17:21:42.068+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a3720) adding con mode: crc 2024-09-12T17:21:42.501 INFO:tasks.workunit.client.0.smithi016.stderr: -471> 2024-09-12T17:21:42.068+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a3720) adding con mode: secure 2024-09-12T17:21:42.501 INFO:tasks.workunit.client.0.smithi016.stderr: -470> 2024-09-12T17:21:42.072+0000 7fccd15329c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:42.501 INFO:tasks.workunit.client.0.smithi016.stderr: -469> 2024-09-12T17:21:42.072+0000 7fccd15329c0 1 librados: starting msgr at 2024-09-12T17:21:42.501 INFO:tasks.workunit.client.0.smithi016.stderr: -468> 2024-09-12T17:21:42.072+0000 7fccd15329c0 1 librados: starting objecter 2024-09-12T17:21:42.501 INFO:tasks.workunit.client.0.smithi016.stderr: -467> 2024-09-12T17:21:42.072+0000 7fccd15329c0 5 asok(0x55a0697932b0) register_command objecter_requests hook 0x55a0699c9fe0 2024-09-12T17:21:42.502 INFO:tasks.workunit.client.0.smithi016.stderr: -466> 2024-09-12T17:21:42.072+0000 7fccd15329c0 1 librados: setting wanted keys 2024-09-12T17:21:42.502 INFO:tasks.workunit.client.0.smithi016.stderr: -465> 2024-09-12T17:21:42.072+0000 7fccd15329c0 1 librados: calling monclient init 2024-09-12T17:21:42.502 INFO:tasks.workunit.client.0.smithi016.stderr: -464> 2024-09-12T17:21:42.072+0000 7fccd15329c0 10 monclient: init 2024-09-12T17:21:42.502 INFO:tasks.workunit.client.0.smithi016.stderr: -463> 2024-09-12T17:21:42.072+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a0470) adding auth protocol: cephx 2024-09-12T17:21:42.502 INFO:tasks.workunit.client.0.smithi016.stderr: -462> 2024-09-12T17:21:42.072+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a0470) adding auth protocol: cephx 2024-09-12T17:21:42.502 INFO:tasks.workunit.client.0.smithi016.stderr: -461> 2024-09-12T17:21:42.072+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a0470) adding auth protocol: cephx 2024-09-12T17:21:42.502 INFO:tasks.workunit.client.0.smithi016.stderr: -460> 2024-09-12T17:21:42.072+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a0470) adding con mode: secure 2024-09-12T17:21:42.502 INFO:tasks.workunit.client.0.smithi016.stderr: -459> 2024-09-12T17:21:42.072+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a0470) adding con mode: crc 2024-09-12T17:21:42.502 INFO:tasks.workunit.client.0.smithi016.stderr: -458> 2024-09-12T17:21:42.072+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a0470) adding con mode: secure 2024-09-12T17:21:42.502 INFO:tasks.workunit.client.0.smithi016.stderr: -457> 2024-09-12T17:21:42.072+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a0470) adding con mode: crc 2024-09-12T17:21:42.502 INFO:tasks.workunit.client.0.smithi016.stderr: -456> 2024-09-12T17:21:42.072+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a0470) adding con mode: secure 2024-09-12T17:21:42.502 INFO:tasks.workunit.client.0.smithi016.stderr: -455> 2024-09-12T17:21:42.072+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a0470) adding con mode: crc 2024-09-12T17:21:42.502 INFO:tasks.workunit.client.0.smithi016.stderr: -454> 2024-09-12T17:21:42.072+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a0470) adding con mode: crc 2024-09-12T17:21:42.503 INFO:tasks.workunit.client.0.smithi016.stderr: -453> 2024-09-12T17:21:42.072+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a0470) adding con mode: secure 2024-09-12T17:21:42.503 INFO:tasks.workunit.client.0.smithi016.stderr: -452> 2024-09-12T17:21:42.072+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a0470) adding con mode: crc 2024-09-12T17:21:42.503 INFO:tasks.workunit.client.0.smithi016.stderr: -451> 2024-09-12T17:21:42.072+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a0470) adding con mode: secure 2024-09-12T17:21:42.503 INFO:tasks.workunit.client.0.smithi016.stderr: -450> 2024-09-12T17:21:42.072+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a0470) adding con mode: crc 2024-09-12T17:21:42.503 INFO:tasks.workunit.client.0.smithi016.stderr: -449> 2024-09-12T17:21:42.072+0000 7fccd15329c0 5 AuthRegistry(0x55a0699a0470) adding con mode: secure 2024-09-12T17:21:42.503 INFO:tasks.workunit.client.0.smithi016.stderr: -448> 2024-09-12T17:21:42.072+0000 7fccd15329c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:42.503 INFO:tasks.workunit.client.0.smithi016.stderr: -447> 2024-09-12T17:21:42.072+0000 7fccd15329c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:42.503 INFO:tasks.workunit.client.0.smithi016.stderr: -446> 2024-09-12T17:21:42.072+0000 7fccd15329c0 5 asok(0x55a0697932b0) register_command rotate-key hook 0x55a0699a05b8 2024-09-12T17:21:42.503 INFO:tasks.workunit.client.0.smithi016.stderr: -445> 2024-09-12T17:21:42.072+0000 7fccd15329c0 10 monclient: _reopen_session rank -1 2024-09-12T17:21:42.503 INFO:tasks.workunit.client.0.smithi016.stderr: -444> 2024-09-12T17:21:42.072+0000 7fccd15329c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:21:42.503 INFO:tasks.workunit.client.0.smithi016.stderr: -443> 2024-09-12T17:21:42.072+0000 7fccd15329c0 10 monclient(hunting): picked mon.noname-c con 0x55a06985b5b0 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:21:42.503 INFO:tasks.workunit.client.0.smithi016.stderr: -442> 2024-09-12T17:21:42.072+0000 7fccd15329c0 10 monclient(hunting): picked mon.noname-b con 0x55a0698e8720 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:21:42.503 INFO:tasks.workunit.client.0.smithi016.stderr: -441> 2024-09-12T17:21:42.072+0000 7fccd15329c0 10 monclient(hunting): picked mon.noname-a con 0x55a0698e9070 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:21:42.504 INFO:tasks.workunit.client.0.smithi016.stderr: -440> 2024-09-12T17:21:42.072+0000 7fccd15329c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:42.504 INFO:tasks.workunit.client.0.smithi016.stderr: -439> 2024-09-12T17:21:42.072+0000 7fccd15329c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:42.504 INFO:tasks.workunit.client.0.smithi016.stderr: -438> 2024-09-12T17:21:42.072+0000 7fccd15329c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:42.504 INFO:tasks.workunit.client.0.smithi016.stderr: -437> 2024-09-12T17:21:42.072+0000 7fccd15329c0 10 monclient(hunting): _renew_subs 2024-09-12T17:21:42.504 INFO:tasks.workunit.client.0.smithi016.stderr: -436> 2024-09-12T17:21:42.072+0000 7fccd15329c0 10 monclient(hunting): authenticate will time out at 2420.049036s 2024-09-12T17:21:42.504 INFO:tasks.workunit.client.0.smithi016.stderr: -435> 2024-09-12T17:21:42.072+0000 7fcccf038640 10 monclient(hunting): get_auth_request con 0x55a06985b5b0 auth_method 0 2024-09-12T17:21:42.504 INFO:tasks.workunit.client.0.smithi016.stderr: -434> 2024-09-12T17:21:42.072+0000 7fcccf038640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:21:42.504 INFO:tasks.workunit.client.0.smithi016.stderr: -433> 2024-09-12T17:21:42.072+0000 7fcccf038640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:21:42.504 INFO:tasks.workunit.client.0.smithi016.stderr: -432> 2024-09-12T17:21:42.072+0000 7fcccf038640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:21:42.504 INFO:tasks.workunit.client.0.smithi016.stderr: -431> 2024-09-12T17:21:42.072+0000 7fcccf839640 10 monclient(hunting): get_auth_request con 0x55a0698e9070 auth_method 0 2024-09-12T17:21:42.504 INFO:tasks.workunit.client.0.smithi016.stderr: -430> 2024-09-12T17:21:42.072+0000 7fcccf839640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:21:42.504 INFO:tasks.workunit.client.0.smithi016.stderr: -429> 2024-09-12T17:21:42.072+0000 7fcccf839640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:21:42.504 INFO:tasks.workunit.client.0.smithi016.stderr: -428> 2024-09-12T17:21:42.072+0000 7fcccf839640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:21:42.505 INFO:tasks.workunit.client.0.smithi016.stderr: -427> 2024-09-12T17:21:42.072+0000 7fcccf038640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:21:42.505 INFO:tasks.workunit.client.0.smithi016.stderr: -426> 2024-09-12T17:21:42.072+0000 7fcccf038640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:21:42.505 INFO:tasks.workunit.client.0.smithi016.stderr: -425> 2024-09-12T17:21:42.072+0000 7fcccf038640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:21:42.505 INFO:tasks.workunit.client.0.smithi016.stderr: -424> 2024-09-12T17:21:42.072+0000 7fcccf839640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:21:42.505 INFO:tasks.workunit.client.0.smithi016.stderr: -423> 2024-09-12T17:21:42.072+0000 7fcccf839640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:21:42.505 INFO:tasks.workunit.client.0.smithi016.stderr: -422> 2024-09-12T17:21:42.072+0000 7fcccf839640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:21:42.505 INFO:tasks.workunit.client.0.smithi016.stderr: -421> 2024-09-12T17:21:42.072+0000 7fcccf038640 10 monclient(hunting): handle_auth_done global_id 7532 payload 824 2024-09-12T17:21:42.505 INFO:tasks.workunit.client.0.smithi016.stderr: -420> 2024-09-12T17:21:42.072+0000 7fcccf038640 10 monclient: _finish_hunting 0 2024-09-12T17:21:42.505 INFO:tasks.workunit.client.0.smithi016.stderr: -419> 2024-09-12T17:21:42.072+0000 7fcccf038640 1 monclient: found mon.noname-c 2024-09-12T17:21:42.505 INFO:tasks.workunit.client.0.smithi016.stderr: -418> 2024-09-12T17:21:42.072+0000 7fcccf038640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:21:42.505 INFO:tasks.workunit.client.0.smithi016.stderr: -417> 2024-09-12T17:21:42.072+0000 7fccce837640 10 monclient: get_auth_request con 0x55a0698e8720 auth_method 0 2024-09-12T17:21:42.505 INFO:tasks.workunit.client.0.smithi016.stderr: -416> 2024-09-12T17:21:42.072+0000 7fcbbbe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:21:42.505 INFO:tasks.workunit.client.0.smithi016.stderr: -415> 2024-09-12T17:21:42.072+0000 7fcbbbe07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:21:42.506 INFO:tasks.workunit.client.0.smithi016.stderr: -414> 2024-09-12T17:21:42.072+0000 7fcbbbe07640 10 monclient: dump: 2024-09-12T17:21:42.506 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:21:42.506 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:21:42.506 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:42.506 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:42.506 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:21:42.506 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:42.506 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:21:42.506 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:21:42.506 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:21:42.506 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:42.506 INFO:tasks.workunit.client.0.smithi016.stderr: -413> 2024-09-12T17:21:42.072+0000 7fcbbbe07640 10 monclient: _finish_auth 0 2024-09-12T17:21:42.506 INFO:tasks.workunit.client.0.smithi016.stderr: -412> 2024-09-12T17:21:42.072+0000 7fcbbbe07640 10 monclient: _check_auth_tickets 2024-09-12T17:21:42.507 INFO:tasks.workunit.client.0.smithi016.stderr: -411> 2024-09-12T17:21:42.072+0000 7fcbbbe07640 10 monclient: handle_config config(0 keys) 2024-09-12T17:21:42.507 INFO:tasks.workunit.client.0.smithi016.stderr: -410> 2024-09-12T17:21:42.072+0000 7fcbbbe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:21:42.507 INFO:tasks.workunit.client.0.smithi016.stderr: -409> 2024-09-12T17:21:42.072+0000 7fcbbbe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:21:42.507 INFO:tasks.workunit.client.0.smithi016.stderr: -408> 2024-09-12T17:21:42.072+0000 7fcbbbe07640 10 monclient: dump: 2024-09-12T17:21:42.507 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:21:42.507 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:21:42.507 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:42.507 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:42.507 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:21:42.507 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:42.507 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:21:42.507 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:21:42.507 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:21:42.508 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:42.508 INFO:tasks.workunit.client.0.smithi016.stderr: -407> 2024-09-12T17:21:42.072+0000 7fcbbd60a640 4 set_mon_vals no callback set 2024-09-12T17:21:42.508 INFO:tasks.workunit.client.0.smithi016.stderr: -406> 2024-09-12T17:21:42.072+0000 7fccd15329c0 5 monclient: authenticate success, global_id 7532 2024-09-12T17:21:42.508 INFO:tasks.workunit.client.0.smithi016.stderr: -405> 2024-09-12T17:21:42.072+0000 7fccd15329c0 10 monclient: _renew_subs 2024-09-12T17:21:42.508 INFO:tasks.workunit.client.0.smithi016.stderr: -404> 2024-09-12T17:21:42.072+0000 7fccd15329c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:21:42.508 INFO:tasks.workunit.client.0.smithi016.stderr: -403> 2024-09-12T17:21:42.072+0000 7fccd15329c0 10 monclient: _renew_subs 2024-09-12T17:21:42.508 INFO:tasks.workunit.client.0.smithi016.stderr: -402> 2024-09-12T17:21:42.072+0000 7fccd15329c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:21:42.508 INFO:tasks.workunit.client.0.smithi016.stderr: -401> 2024-09-12T17:21:42.072+0000 7fccd15329c0 1 librados: init done 2024-09-12T17:21:42.508 INFO:tasks.workunit.client.0.smithi016.stderr: -400> 2024-09-12T17:21:42.076+0000 7fcbbbe07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:21:42.508 INFO:tasks.workunit.client.0.smithi016.stderr: -399> 2024-09-12T17:21:42.076+0000 7fcbbbe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:21:42.508 INFO:tasks.workunit.client.0.smithi016.stderr: -398> 2024-09-12T17:21:42.076+0000 7fcbbbe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:21:42.508 INFO:tasks.workunit.client.0.smithi016.stderr: -397> 2024-09-12T17:21:42.076+0000 7fccce837640 10 monclient: get_auth_request con 0x7fcbb4070ae0 auth_method 0 2024-09-12T17:21:42.508 INFO:tasks.workunit.client.0.smithi016.stderr: -396> 2024-09-12T17:21:42.076+0000 7fcccf839640 10 monclient: get_auth_request con 0x55a0699cc2a0 auth_method 0 2024-09-12T17:21:42.509 INFO:tasks.workunit.client.0.smithi016.stderr: -395> 2024-09-12T17:21:42.076+0000 7fcccf038640 10 monclient: get_auth_request con 0x55a0699eab50 auth_method 0 2024-09-12T17:21:42.509 INFO:tasks.workunit.client.0.smithi016.stderr: -394> 2024-09-12T17:21:42.076+0000 7fccce837640 10 monclient: get_auth_request con 0x55a0699ef1f0 auth_method 0 2024-09-12T17:21:42.509 INFO:tasks.workunit.client.0.smithi016.stderr: -393> 2024-09-12T17:21:42.080+0000 7fcccf839640 10 monclient: get_auth_request con 0x55a0699f30e0 auth_method 0 2024-09-12T17:21:42.509 INFO:tasks.workunit.client.0.smithi016.stderr: -392> 2024-09-12T17:21:42.084+0000 7fccd15329c0 10 monclient: build_initial_monmap 2024-09-12T17:21:42.509 INFO:tasks.workunit.client.0.smithi016.stderr: -391> 2024-09-12T17:21:42.084+0000 7fccd15329c0 1 build_initial for_mkfs: 0 2024-09-12T17:21:42.509 INFO:tasks.workunit.client.0.smithi016.stderr: -390> 2024-09-12T17:21:42.084+0000 7fccd15329c0 10 monclient: monmap: 2024-09-12T17:21:42.509 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:21:42.509 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:21:42.509 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:21:42.509 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:21:42.509 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:21:42.509 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:42.509 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:21:42.510 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:21:42.510 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:21:42.510 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:42.510 INFO:tasks.workunit.client.0.smithi016.stderr: -389> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f7240) adding auth protocol: cephx 2024-09-12T17:21:42.510 INFO:tasks.workunit.client.0.smithi016.stderr: -388> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f7240) adding auth protocol: cephx 2024-09-12T17:21:42.510 INFO:tasks.workunit.client.0.smithi016.stderr: -387> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f7240) adding auth protocol: cephx 2024-09-12T17:21:42.510 INFO:tasks.workunit.client.0.smithi016.stderr: -386> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f7240) adding con mode: secure 2024-09-12T17:21:42.510 INFO:tasks.workunit.client.0.smithi016.stderr: -385> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f7240) adding con mode: crc 2024-09-12T17:21:42.510 INFO:tasks.workunit.client.0.smithi016.stderr: -384> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f7240) adding con mode: secure 2024-09-12T17:21:42.510 INFO:tasks.workunit.client.0.smithi016.stderr: -383> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f7240) adding con mode: crc 2024-09-12T17:21:42.510 INFO:tasks.workunit.client.0.smithi016.stderr: -382> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f7240) adding con mode: secure 2024-09-12T17:21:42.510 INFO:tasks.workunit.client.0.smithi016.stderr: -381> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f7240) adding con mode: crc 2024-09-12T17:21:42.510 INFO:tasks.workunit.client.0.smithi016.stderr: -380> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f7240) adding con mode: crc 2024-09-12T17:21:42.511 INFO:tasks.workunit.client.0.smithi016.stderr: -379> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f7240) adding con mode: secure 2024-09-12T17:21:42.511 INFO:tasks.workunit.client.0.smithi016.stderr: -378> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f7240) adding con mode: crc 2024-09-12T17:21:42.511 INFO:tasks.workunit.client.0.smithi016.stderr: -377> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f7240) adding con mode: secure 2024-09-12T17:21:42.511 INFO:tasks.workunit.client.0.smithi016.stderr: -376> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f7240) adding con mode: crc 2024-09-12T17:21:42.511 INFO:tasks.workunit.client.0.smithi016.stderr: -375> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f7240) adding con mode: secure 2024-09-12T17:21:42.511 INFO:tasks.workunit.client.0.smithi016.stderr: -374> 2024-09-12T17:21:42.084+0000 7fccd15329c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:42.511 INFO:tasks.workunit.client.0.smithi016.stderr: -373> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 asok(0x55a0697932b0) register_command objecter_requests cmddesc objecter_requests hook 0x55a0699fabb0 EEXIST 2024-09-12T17:21:42.511 INFO:tasks.workunit.client.0.smithi016.stderr: -372> 2024-09-12T17:21:42.084+0000 7fccd15329c0 10 monclient: init 2024-09-12T17:21:42.511 INFO:tasks.workunit.client.0.smithi016.stderr: -371> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f6138) adding auth protocol: cephx 2024-09-12T17:21:42.511 INFO:tasks.workunit.client.0.smithi016.stderr: -370> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f6138) adding auth protocol: cephx 2024-09-12T17:21:42.511 INFO:tasks.workunit.client.0.smithi016.stderr: -369> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f6138) adding auth protocol: cephx 2024-09-12T17:21:42.511 INFO:tasks.workunit.client.0.smithi016.stderr: -368> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f6138) adding con mode: secure 2024-09-12T17:21:42.511 INFO:tasks.workunit.client.0.smithi016.stderr: -367> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f6138) adding con mode: crc 2024-09-12T17:21:42.512 INFO:tasks.workunit.client.0.smithi016.stderr: -366> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f6138) adding con mode: secure 2024-09-12T17:21:42.512 INFO:tasks.workunit.client.0.smithi016.stderr: -365> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f6138) adding con mode: crc 2024-09-12T17:21:42.512 INFO:tasks.workunit.client.0.smithi016.stderr: -364> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f6138) adding con mode: secure 2024-09-12T17:21:42.512 INFO:tasks.workunit.client.0.smithi016.stderr: -363> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f6138) adding con mode: crc 2024-09-12T17:21:42.512 INFO:tasks.workunit.client.0.smithi016.stderr: -362> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f6138) adding con mode: crc 2024-09-12T17:21:42.512 INFO:tasks.workunit.client.0.smithi016.stderr: -361> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f6138) adding con mode: secure 2024-09-12T17:21:42.512 INFO:tasks.workunit.client.0.smithi016.stderr: -360> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f6138) adding con mode: crc 2024-09-12T17:21:42.512 INFO:tasks.workunit.client.0.smithi016.stderr: -359> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f6138) adding con mode: secure 2024-09-12T17:21:42.512 INFO:tasks.workunit.client.0.smithi016.stderr: -358> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f6138) adding con mode: crc 2024-09-12T17:21:42.512 INFO:tasks.workunit.client.0.smithi016.stderr: -357> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 AuthRegistry(0x55a0699f6138) adding con mode: secure 2024-09-12T17:21:42.512 INFO:tasks.workunit.client.0.smithi016.stderr: -356> 2024-09-12T17:21:42.084+0000 7fccd15329c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:42.512 INFO:tasks.workunit.client.0.smithi016.stderr: -355> 2024-09-12T17:21:42.084+0000 7fccd15329c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:42.512 INFO:tasks.workunit.client.0.smithi016.stderr: -354> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 asok(0x55a0697932b0) register_command rotate-key cmddesc rotate-key hook 0x55a0699f6280 EEXIST 2024-09-12T17:21:42.513 INFO:tasks.workunit.client.0.smithi016.stderr: -353> 2024-09-12T17:21:42.084+0000 7fccd15329c0 10 monclient: _reopen_session rank -1 2024-09-12T17:21:42.513 INFO:tasks.workunit.client.0.smithi016.stderr: -352> 2024-09-12T17:21:42.084+0000 7fccd15329c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:21:42.513 INFO:tasks.workunit.client.0.smithi016.stderr: -351> 2024-09-12T17:21:42.084+0000 7fccd15329c0 10 monclient(hunting): picked mon.noname-a con 0x55a069a1ed60 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:21:42.513 INFO:tasks.workunit.client.0.smithi016.stderr: -350> 2024-09-12T17:21:42.084+0000 7fccd15329c0 10 monclient(hunting): picked mon.noname-b con 0x55a069a1e690 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:21:42.513 INFO:tasks.workunit.client.0.smithi016.stderr: -349> 2024-09-12T17:21:42.084+0000 7fccd15329c0 10 monclient(hunting): picked mon.noname-c con 0x55a069a1d070 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:21:42.513 INFO:tasks.workunit.client.0.smithi016.stderr: -348> 2024-09-12T17:21:42.084+0000 7fccd15329c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:42.513 INFO:tasks.workunit.client.0.smithi016.stderr: -347> 2024-09-12T17:21:42.084+0000 7fccd15329c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:42.513 INFO:tasks.workunit.client.0.smithi016.stderr: -346> 2024-09-12T17:21:42.084+0000 7fccd15329c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:42.513 INFO:tasks.workunit.client.0.smithi016.stderr: -345> 2024-09-12T17:21:42.084+0000 7fccd15329c0 10 monclient(hunting): _renew_subs 2024-09-12T17:21:42.513 INFO:tasks.workunit.client.0.smithi016.stderr: -344> 2024-09-12T17:21:42.084+0000 7fccd15329c0 10 monclient(hunting): authenticate will time out at 2420.061583s 2024-09-12T17:21:42.513 INFO:tasks.workunit.client.0.smithi016.stderr: -343> 2024-09-12T17:21:42.084+0000 7fccce837640 10 monclient(hunting): get_auth_request con 0x55a069a1ed60 auth_method 0 2024-09-12T17:21:42.513 INFO:tasks.workunit.client.0.smithi016.stderr: -342> 2024-09-12T17:21:42.084+0000 7fccce837640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:21:42.513 INFO:tasks.workunit.client.0.smithi016.stderr: -341> 2024-09-12T17:21:42.084+0000 7fccce837640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:21:42.514 INFO:tasks.workunit.client.0.smithi016.stderr: -340> 2024-09-12T17:21:42.084+0000 7fccce837640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:21:42.514 INFO:tasks.workunit.client.0.smithi016.stderr: -339> 2024-09-12T17:21:42.084+0000 7fcccf038640 10 monclient(hunting): get_auth_request con 0x55a069a1d070 auth_method 0 2024-09-12T17:21:42.514 INFO:tasks.workunit.client.0.smithi016.stderr: -338> 2024-09-12T17:21:42.084+0000 7fcccf038640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:21:42.514 INFO:tasks.workunit.client.0.smithi016.stderr: -337> 2024-09-12T17:21:42.084+0000 7fcccf038640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:21:42.514 INFO:tasks.workunit.client.0.smithi016.stderr: -336> 2024-09-12T17:21:42.084+0000 7fcccf038640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:21:42.514 INFO:tasks.workunit.client.0.smithi016.stderr: -335> 2024-09-12T17:21:42.084+0000 7fcccf038640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:21:42.514 INFO:tasks.workunit.client.0.smithi016.stderr: -334> 2024-09-12T17:21:42.084+0000 7fcccf038640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:21:42.514 INFO:tasks.workunit.client.0.smithi016.stderr: -333> 2024-09-12T17:21:42.084+0000 7fcccf038640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:21:42.514 INFO:tasks.workunit.client.0.smithi016.stderr: -332> 2024-09-12T17:21:42.084+0000 7fccce837640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:21:42.514 INFO:tasks.workunit.client.0.smithi016.stderr: -331> 2024-09-12T17:21:42.084+0000 7fccce837640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:21:42.514 INFO:tasks.workunit.client.0.smithi016.stderr: -330> 2024-09-12T17:21:42.084+0000 7fccce837640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:21:42.514 INFO:tasks.workunit.client.0.smithi016.stderr: -329> 2024-09-12T17:21:42.084+0000 7fcccf839640 10 monclient(hunting): get_auth_request con 0x55a069a1e690 auth_method 0 2024-09-12T17:21:42.514 INFO:tasks.workunit.client.0.smithi016.stderr: -328> 2024-09-12T17:21:42.084+0000 7fcccf839640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:21:42.515 INFO:tasks.workunit.client.0.smithi016.stderr: -327> 2024-09-12T17:21:42.084+0000 7fcccf839640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:21:42.515 INFO:tasks.workunit.client.0.smithi016.stderr: -326> 2024-09-12T17:21:42.084+0000 7fcccf839640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:21:42.515 INFO:tasks.workunit.client.0.smithi016.stderr: -325> 2024-09-12T17:21:42.084+0000 7fcccf038640 10 monclient(hunting): handle_auth_done global_id 7535 payload 824 2024-09-12T17:21:42.515 INFO:tasks.workunit.client.0.smithi016.stderr: -324> 2024-09-12T17:21:42.084+0000 7fcccf038640 10 monclient: _finish_hunting 0 2024-09-12T17:21:42.515 INFO:tasks.workunit.client.0.smithi016.stderr: -323> 2024-09-12T17:21:42.084+0000 7fcccf038640 1 monclient: found mon.noname-c 2024-09-12T17:21:42.515 INFO:tasks.workunit.client.0.smithi016.stderr: -322> 2024-09-12T17:21:42.084+0000 7fcccf038640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:21:42.515 INFO:tasks.workunit.client.0.smithi016.stderr: -321> 2024-09-12T17:21:42.084+0000 7fcbb9602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:21:42.515 INFO:tasks.workunit.client.0.smithi016.stderr: -320> 2024-09-12T17:21:42.084+0000 7fcbb9602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:21:42.515 INFO:tasks.workunit.client.0.smithi016.stderr: -319> 2024-09-12T17:21:42.084+0000 7fcbb9602640 10 monclient: dump: 2024-09-12T17:21:42.515 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:21:42.515 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:21:42.515 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:42.515 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:42.516 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:21:42.516 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:42.516 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:21:42.516 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:21:42.516 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:21:42.516 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:42.516 INFO:tasks.workunit.client.0.smithi016.stderr: -318> 2024-09-12T17:21:42.084+0000 7fcbb9602640 10 monclient: _finish_auth 0 2024-09-12T17:21:42.516 INFO:tasks.workunit.client.0.smithi016.stderr: -317> 2024-09-12T17:21:42.084+0000 7fcbb9602640 10 monclient: _check_auth_tickets 2024-09-12T17:21:42.516 INFO:tasks.workunit.client.0.smithi016.stderr: -316> 2024-09-12T17:21:42.084+0000 7fcbb9602640 10 monclient: handle_config config(0 keys) 2024-09-12T17:21:42.516 INFO:tasks.workunit.client.0.smithi016.stderr: -315> 2024-09-12T17:21:42.084+0000 7fcbb9602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:21:42.516 INFO:tasks.workunit.client.0.smithi016.stderr: -314> 2024-09-12T17:21:42.084+0000 7fcbb9602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:21:42.516 INFO:tasks.workunit.client.0.smithi016.stderr: -313> 2024-09-12T17:21:42.084+0000 7fcbb9602640 10 monclient: dump: 2024-09-12T17:21:42.516 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:21:42.517 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:21:42.517 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:42.517 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:42.517 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:21:42.517 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:42.517 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:21:42.517 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:21:42.517 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:21:42.517 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:42.517 INFO:tasks.workunit.client.0.smithi016.stderr: -312> 2024-09-12T17:21:42.084+0000 7fccce036640 4 set_mon_vals no callback set 2024-09-12T17:21:42.517 INFO:tasks.workunit.client.0.smithi016.stderr: -311> 2024-09-12T17:21:42.084+0000 7fccd15329c0 5 monclient: authenticate success, global_id 7535 2024-09-12T17:21:42.517 INFO:tasks.workunit.client.0.smithi016.stderr: -310> 2024-09-12T17:21:42.084+0000 7fccd15329c0 10 monclient: _renew_subs 2024-09-12T17:21:42.517 INFO:tasks.workunit.client.0.smithi016.stderr: -309> 2024-09-12T17:21:42.084+0000 7fccd15329c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:21:42.518 INFO:tasks.workunit.client.0.smithi016.stderr: -308> 2024-09-12T17:21:42.084+0000 7fccd15329c0 10 monclient: _renew_subs 2024-09-12T17:21:42.518 INFO:tasks.workunit.client.0.smithi016.stderr: -307> 2024-09-12T17:21:42.084+0000 7fccd15329c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:21:42.518 INFO:tasks.workunit.client.0.smithi016.stderr: -306> 2024-09-12T17:21:42.088+0000 7fcbb9602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:21:42.518 INFO:tasks.workunit.client.0.smithi016.stderr: -305> 2024-09-12T17:21:42.088+0000 7fcbb9602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:21:42.518 INFO:tasks.workunit.client.0.smithi016.stderr: -304> 2024-09-12T17:21:42.088+0000 7fcbb9602640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:21:42.518 INFO:tasks.workunit.client.0.smithi016.stderr: -303> 2024-09-12T17:21:42.088+0000 7fccd15329c0 10 monclient: get_monmap_and_config 2024-09-12T17:21:42.518 INFO:tasks.workunit.client.0.smithi016.stderr: -302> 2024-09-12T17:21:42.088+0000 7fccd15329c0 10 monclient: build_initial_monmap 2024-09-12T17:21:42.518 INFO:tasks.workunit.client.0.smithi016.stderr: -301> 2024-09-12T17:21:42.088+0000 7fccd15329c0 1 build_initial for_mkfs: 0 2024-09-12T17:21:42.518 INFO:tasks.workunit.client.0.smithi016.stderr: -300> 2024-09-12T17:21:42.088+0000 7fccd15329c0 10 monclient: monmap: 2024-09-12T17:21:42.518 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:21:42.518 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:21:42.518 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:21:42.518 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:21:42.519 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:21:42.519 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:42.519 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:21:42.519 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:21:42.519 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:21:42.519 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:42.519 INFO:tasks.workunit.client.0.smithi016.stderr: -299> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a3e130) adding auth protocol: cephx 2024-09-12T17:21:42.519 INFO:tasks.workunit.client.0.smithi016.stderr: -298> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a3e130) adding auth protocol: cephx 2024-09-12T17:21:42.519 INFO:tasks.workunit.client.0.smithi016.stderr: -297> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a3e130) adding auth protocol: cephx 2024-09-12T17:21:42.519 INFO:tasks.workunit.client.0.smithi016.stderr: -296> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a3e130) adding con mode: secure 2024-09-12T17:21:42.519 INFO:tasks.workunit.client.0.smithi016.stderr: -295> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a3e130) adding con mode: crc 2024-09-12T17:21:42.519 INFO:tasks.workunit.client.0.smithi016.stderr: -294> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a3e130) adding con mode: secure 2024-09-12T17:21:42.519 INFO:tasks.workunit.client.0.smithi016.stderr: -293> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a3e130) adding con mode: crc 2024-09-12T17:21:42.519 INFO:tasks.workunit.client.0.smithi016.stderr: -292> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a3e130) adding con mode: secure 2024-09-12T17:21:42.520 INFO:tasks.workunit.client.0.smithi016.stderr: -291> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a3e130) adding con mode: crc 2024-09-12T17:21:42.520 INFO:tasks.workunit.client.0.smithi016.stderr: -290> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a3e130) adding con mode: crc 2024-09-12T17:21:42.520 INFO:tasks.workunit.client.0.smithi016.stderr: -289> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a3e130) adding con mode: secure 2024-09-12T17:21:42.520 INFO:tasks.workunit.client.0.smithi016.stderr: -288> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a3e130) adding con mode: crc 2024-09-12T17:21:42.520 INFO:tasks.workunit.client.0.smithi016.stderr: -287> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a3e130) adding con mode: secure 2024-09-12T17:21:42.520 INFO:tasks.workunit.client.0.smithi016.stderr: -286> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a3e130) adding con mode: crc 2024-09-12T17:21:42.520 INFO:tasks.workunit.client.0.smithi016.stderr: -285> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a3e130) adding con mode: secure 2024-09-12T17:21:42.520 INFO:tasks.workunit.client.0.smithi016.stderr: -284> 2024-09-12T17:21:42.088+0000 7fccce837640 10 monclient: get_auth_request con 0x7fcba8070a20 auth_method 0 2024-09-12T17:21:42.520 INFO:tasks.workunit.client.0.smithi016.stderr: -283> 2024-09-12T17:21:42.088+0000 7fccd15329c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:42.520 INFO:tasks.workunit.client.0.smithi016.stderr: -282> 2024-09-12T17:21:42.088+0000 7fccd15329c0 10 monclient: init 2024-09-12T17:21:42.520 INFO:tasks.workunit.client.0.smithi016.stderr: -281> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b9395a0) adding auth protocol: cephx 2024-09-12T17:21:42.520 INFO:tasks.workunit.client.0.smithi016.stderr: -280> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b9395a0) adding auth protocol: cephx 2024-09-12T17:21:42.521 INFO:tasks.workunit.client.0.smithi016.stderr: -279> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b9395a0) adding auth protocol: cephx 2024-09-12T17:21:42.521 INFO:tasks.workunit.client.0.smithi016.stderr: -278> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b9395a0) adding con mode: secure 2024-09-12T17:21:42.521 INFO:tasks.workunit.client.0.smithi016.stderr: -277> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b9395a0) adding con mode: crc 2024-09-12T17:21:42.521 INFO:tasks.workunit.client.0.smithi016.stderr: -276> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b9395a0) adding con mode: secure 2024-09-12T17:21:42.521 INFO:tasks.workunit.client.0.smithi016.stderr: -275> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b9395a0) adding con mode: crc 2024-09-12T17:21:42.521 INFO:tasks.workunit.client.0.smithi016.stderr: -274> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b9395a0) adding con mode: secure 2024-09-12T17:21:42.521 INFO:tasks.workunit.client.0.smithi016.stderr: -273> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b9395a0) adding con mode: crc 2024-09-12T17:21:42.521 INFO:tasks.workunit.client.0.smithi016.stderr: -272> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b9395a0) adding con mode: crc 2024-09-12T17:21:42.521 INFO:tasks.workunit.client.0.smithi016.stderr: -271> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b9395a0) adding con mode: secure 2024-09-12T17:21:42.521 INFO:tasks.workunit.client.0.smithi016.stderr: -270> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b9395a0) adding con mode: crc 2024-09-12T17:21:42.521 INFO:tasks.workunit.client.0.smithi016.stderr: -269> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b9395a0) adding con mode: secure 2024-09-12T17:21:42.521 INFO:tasks.workunit.client.0.smithi016.stderr: -268> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b9395a0) adding con mode: crc 2024-09-12T17:21:42.521 INFO:tasks.workunit.client.0.smithi016.stderr: -267> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b9395a0) adding con mode: secure 2024-09-12T17:21:42.522 INFO:tasks.workunit.client.0.smithi016.stderr: -266> 2024-09-12T17:21:42.088+0000 7fccd15329c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:42.522 INFO:tasks.workunit.client.0.smithi016.stderr: -265> 2024-09-12T17:21:42.088+0000 7fccd15329c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:42.522 INFO:tasks.workunit.client.0.smithi016.stderr: -264> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 asok(0x55a0697932b0) register_command rotate-key cmddesc rotate-key hook 0x7fff6b9396e8 EEXIST 2024-09-12T17:21:42.522 INFO:tasks.workunit.client.0.smithi016.stderr: -263> 2024-09-12T17:21:42.088+0000 7fccd15329c0 10 monclient: _reopen_session rank -1 2024-09-12T17:21:42.522 INFO:tasks.workunit.client.0.smithi016.stderr: -262> 2024-09-12T17:21:42.088+0000 7fccd15329c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:21:42.522 INFO:tasks.workunit.client.0.smithi016.stderr: -261> 2024-09-12T17:21:42.088+0000 7fccd15329c0 10 monclient(hunting): picked mon.noname-a con 0x55a069a72640 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:21:42.522 INFO:tasks.workunit.client.0.smithi016.stderr: -260> 2024-09-12T17:21:42.088+0000 7fccd15329c0 10 monclient(hunting): picked mon.noname-c con 0x55a069a42420 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:21:42.522 INFO:tasks.workunit.client.0.smithi016.stderr: -259> 2024-09-12T17:21:42.088+0000 7fccd15329c0 10 monclient(hunting): picked mon.noname-b con 0x55a069a6da30 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:21:42.522 INFO:tasks.workunit.client.0.smithi016.stderr: -258> 2024-09-12T17:21:42.088+0000 7fccd15329c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:42.522 INFO:tasks.workunit.client.0.smithi016.stderr: -257> 2024-09-12T17:21:42.088+0000 7fccd15329c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:42.522 INFO:tasks.workunit.client.0.smithi016.stderr: -256> 2024-09-12T17:21:42.088+0000 7fccd15329c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:42.522 INFO:tasks.workunit.client.0.smithi016.stderr: -255> 2024-09-12T17:21:42.088+0000 7fccd15329c0 10 monclient(hunting): _renew_subs 2024-09-12T17:21:42.522 INFO:tasks.workunit.client.0.smithi016.stderr: -254> 2024-09-12T17:21:42.088+0000 7fccd15329c0 10 monclient(hunting): authenticate will time out at 2420.066354s 2024-09-12T17:21:42.523 INFO:tasks.workunit.client.0.smithi016.stderr: -253> 2024-09-12T17:21:42.088+0000 7fcccf839640 10 monclient(hunting): get_auth_request con 0x55a069a42420 auth_method 0 2024-09-12T17:21:42.523 INFO:tasks.workunit.client.0.smithi016.stderr: -252> 2024-09-12T17:21:42.088+0000 7fcccf839640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:21:42.523 INFO:tasks.workunit.client.0.smithi016.stderr: -251> 2024-09-12T17:21:42.088+0000 7fcccf839640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:21:42.523 INFO:tasks.workunit.client.0.smithi016.stderr: -250> 2024-09-12T17:21:42.088+0000 7fcccf839640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:21:42.523 INFO:tasks.workunit.client.0.smithi016.stderr: -249> 2024-09-12T17:21:42.088+0000 7fccce837640 10 monclient(hunting): get_auth_request con 0x55a069a72640 auth_method 0 2024-09-12T17:21:42.523 INFO:tasks.workunit.client.0.smithi016.stderr: -248> 2024-09-12T17:21:42.088+0000 7fccce837640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:21:42.523 INFO:tasks.workunit.client.0.smithi016.stderr: -247> 2024-09-12T17:21:42.088+0000 7fccce837640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:21:42.523 INFO:tasks.workunit.client.0.smithi016.stderr: -246> 2024-09-12T17:21:42.088+0000 7fccce837640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:21:42.523 INFO:tasks.workunit.client.0.smithi016.stderr: -245> 2024-09-12T17:21:42.088+0000 7fcccf839640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:21:42.523 INFO:tasks.workunit.client.0.smithi016.stderr: -244> 2024-09-12T17:21:42.088+0000 7fcccf839640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:21:42.523 INFO:tasks.workunit.client.0.smithi016.stderr: -243> 2024-09-12T17:21:42.088+0000 7fcccf839640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:21:42.523 INFO:tasks.workunit.client.0.smithi016.stderr: -242> 2024-09-12T17:21:42.088+0000 7fccce837640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:21:42.523 INFO:tasks.workunit.client.0.smithi016.stderr: -241> 2024-09-12T17:21:42.088+0000 7fccce837640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:21:42.524 INFO:tasks.workunit.client.0.smithi016.stderr: -240> 2024-09-12T17:21:42.088+0000 7fccce837640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:21:42.524 INFO:tasks.workunit.client.0.smithi016.stderr: -239> 2024-09-12T17:21:42.088+0000 7fcccf038640 10 monclient(hunting): get_auth_request con 0x55a069a6da30 auth_method 0 2024-09-12T17:21:42.524 INFO:tasks.workunit.client.0.smithi016.stderr: -238> 2024-09-12T17:21:42.088+0000 7fcccf038640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:21:42.524 INFO:tasks.workunit.client.0.smithi016.stderr: -237> 2024-09-12T17:21:42.088+0000 7fcccf038640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:21:42.524 INFO:tasks.workunit.client.0.smithi016.stderr: -236> 2024-09-12T17:21:42.088+0000 7fcccf038640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:21:42.524 INFO:tasks.workunit.client.0.smithi016.stderr: -235> 2024-09-12T17:21:42.088+0000 7fccce837640 10 monclient(hunting): handle_auth_done global_id 7926 payload 274 2024-09-12T17:21:42.524 INFO:tasks.workunit.client.0.smithi016.stderr: -234> 2024-09-12T17:21:42.088+0000 7fccce837640 10 monclient: _finish_hunting 0 2024-09-12T17:21:42.524 INFO:tasks.workunit.client.0.smithi016.stderr: -233> 2024-09-12T17:21:42.088+0000 7fccce837640 1 monclient: found mon.noname-a 2024-09-12T17:21:42.524 INFO:tasks.workunit.client.0.smithi016.stderr: -232> 2024-09-12T17:21:42.088+0000 7fccce837640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:21:42.524 INFO:tasks.workunit.client.0.smithi016.stderr: -231> 2024-09-12T17:21:42.088+0000 7fcbb2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:21:42.524 INFO:tasks.workunit.client.0.smithi016.stderr: -230> 2024-09-12T17:21:42.088+0000 7fcbb2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:21:42.524 INFO:tasks.workunit.client.0.smithi016.stderr: -229> 2024-09-12T17:21:42.088+0000 7fcbb2ffd640 10 monclient: dump: 2024-09-12T17:21:42.524 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:21:42.525 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:21:42.525 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:42.525 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:42.525 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:21:42.525 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:42.525 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:21:42.525 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:21:42.525 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:21:42.525 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:42.525 INFO:tasks.workunit.client.0.smithi016.stderr: -228> 2024-09-12T17:21:42.088+0000 7fcbb2ffd640 10 monclient: _finish_auth 0 2024-09-12T17:21:42.525 INFO:tasks.workunit.client.0.smithi016.stderr: -227> 2024-09-12T17:21:42.088+0000 7fcbb2ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:21:42.525 INFO:tasks.workunit.client.0.smithi016.stderr: -226> 2024-09-12T17:21:42.088+0000 7fcbb2ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:21:42.525 INFO:tasks.workunit.client.0.smithi016.stderr: -225> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 monclient: authenticate success, global_id 7926 2024-09-12T17:21:42.526 INFO:tasks.workunit.client.0.smithi016.stderr: -224> 2024-09-12T17:21:42.088+0000 7fccd15329c0 10 monclient: get_monmap_and_config success 2024-09-12T17:21:42.526 INFO:tasks.workunit.client.0.smithi016.stderr: -223> 2024-09-12T17:21:42.088+0000 7fccd15329c0 4 set_mon_vals no callback set 2024-09-12T17:21:42.526 INFO:tasks.workunit.client.0.smithi016.stderr: -222> 2024-09-12T17:21:42.088+0000 7fcbb2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:21:42.526 INFO:tasks.workunit.client.0.smithi016.stderr: -221> 2024-09-12T17:21:42.088+0000 7fcbb2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:21:42.526 INFO:tasks.workunit.client.0.smithi016.stderr: -220> 2024-09-12T17:21:42.088+0000 7fcbb2ffd640 10 monclient: dump: 2024-09-12T17:21:42.526 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:21:42.526 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:21:42.526 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:42.526 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:42.526 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:21:42.526 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:42.526 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:21:42.526 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:21:42.527 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:21:42.527 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:42.527 INFO:tasks.workunit.client.0.smithi016.stderr: -219> 2024-09-12T17:21:42.088+0000 7fccd15329c0 10 monclient: shutdown 2024-09-12T17:21:42.527 INFO:tasks.workunit.client.0.smithi016.stderr: -218> 2024-09-12T17:21:42.088+0000 7fccd15329c0 10 monclient: build_initial_monmap 2024-09-12T17:21:42.527 INFO:tasks.workunit.client.0.smithi016.stderr: -217> 2024-09-12T17:21:42.088+0000 7fccd15329c0 1 build_initial for_mkfs: 0 2024-09-12T17:21:42.527 INFO:tasks.workunit.client.0.smithi016.stderr: -216> 2024-09-12T17:21:42.088+0000 7fccd15329c0 10 monclient: monmap: 2024-09-12T17:21:42.527 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:21:42.527 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:21:42.527 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:21:42.527 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:21:42.527 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:21:42.527 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:42.527 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:21:42.527 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:21:42.528 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:21:42.528 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:42.528 INFO:tasks.workunit.client.0.smithi016.stderr: -215> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a431f0) adding auth protocol: cephx 2024-09-12T17:21:42.528 INFO:tasks.workunit.client.0.smithi016.stderr: -214> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a431f0) adding auth protocol: cephx 2024-09-12T17:21:42.528 INFO:tasks.workunit.client.0.smithi016.stderr: -213> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a431f0) adding auth protocol: cephx 2024-09-12T17:21:42.528 INFO:tasks.workunit.client.0.smithi016.stderr: -212> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a431f0) adding con mode: secure 2024-09-12T17:21:42.528 INFO:tasks.workunit.client.0.smithi016.stderr: -211> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a431f0) adding con mode: crc 2024-09-12T17:21:42.528 INFO:tasks.workunit.client.0.smithi016.stderr: -210> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a431f0) adding con mode: secure 2024-09-12T17:21:42.528 INFO:tasks.workunit.client.0.smithi016.stderr: -209> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a431f0) adding con mode: crc 2024-09-12T17:21:42.528 INFO:tasks.workunit.client.0.smithi016.stderr: -208> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a431f0) adding con mode: secure 2024-09-12T17:21:42.528 INFO:tasks.workunit.client.0.smithi016.stderr: -207> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a431f0) adding con mode: crc 2024-09-12T17:21:42.528 INFO:tasks.workunit.client.0.smithi016.stderr: -206> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a431f0) adding con mode: crc 2024-09-12T17:21:42.528 INFO:tasks.workunit.client.0.smithi016.stderr: -205> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a431f0) adding con mode: secure 2024-09-12T17:21:42.529 INFO:tasks.workunit.client.0.smithi016.stderr: -204> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a431f0) adding con mode: crc 2024-09-12T17:21:42.529 INFO:tasks.workunit.client.0.smithi016.stderr: -203> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a431f0) adding con mode: secure 2024-09-12T17:21:42.529 INFO:tasks.workunit.client.0.smithi016.stderr: -202> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a431f0) adding con mode: crc 2024-09-12T17:21:42.529 INFO:tasks.workunit.client.0.smithi016.stderr: -201> 2024-09-12T17:21:42.088+0000 7fccd15329c0 5 AuthRegistry(0x55a069a431f0) adding con mode: secure 2024-09-12T17:21:42.529 INFO:tasks.workunit.client.0.smithi016.stderr: -200> 2024-09-12T17:21:42.092+0000 7fccd15329c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:42.529 INFO:tasks.workunit.client.0.smithi016.stderr: -199> 2024-09-12T17:21:42.092+0000 7fccd15329c0 1 librados: starting msgr at 2024-09-12T17:21:42.529 INFO:tasks.workunit.client.0.smithi016.stderr: -198> 2024-09-12T17:21:42.092+0000 7fccd15329c0 1 librados: starting objecter 2024-09-12T17:21:42.529 INFO:tasks.workunit.client.0.smithi016.stderr: -197> 2024-09-12T17:21:42.092+0000 7fccd15329c0 5 asok(0x55a0697932b0) register_command objecter_requests cmddesc objecter_requests hook 0x55a069a65570 EEXIST 2024-09-12T17:21:42.529 INFO:tasks.workunit.client.0.smithi016.stderr: -196> 2024-09-12T17:21:42.092+0000 7fccd15329c0 1 librados: setting wanted keys 2024-09-12T17:21:42.529 INFO:tasks.workunit.client.0.smithi016.stderr: -195> 2024-09-12T17:21:42.092+0000 7fccd15329c0 1 librados: calling monclient init 2024-09-12T17:21:42.529 INFO:tasks.workunit.client.0.smithi016.stderr: -194> 2024-09-12T17:21:42.092+0000 7fccd15329c0 10 monclient: init 2024-09-12T17:21:42.529 INFO:tasks.workunit.client.0.smithi016.stderr: -193> 2024-09-12T17:21:42.092+0000 7fccd15329c0 5 AuthRegistry(0x55a069a20b80) adding auth protocol: cephx 2024-09-12T17:21:42.529 INFO:tasks.workunit.client.0.smithi016.stderr: -192> 2024-09-12T17:21:42.092+0000 7fccd15329c0 5 AuthRegistry(0x55a069a20b80) adding auth protocol: cephx 2024-09-12T17:21:42.530 INFO:tasks.workunit.client.0.smithi016.stderr: -191> 2024-09-12T17:21:42.092+0000 7fccd15329c0 5 AuthRegistry(0x55a069a20b80) adding auth protocol: cephx 2024-09-12T17:21:42.530 INFO:tasks.workunit.client.0.smithi016.stderr: -190> 2024-09-12T17:21:42.092+0000 7fccd15329c0 5 AuthRegistry(0x55a069a20b80) adding con mode: secure 2024-09-12T17:21:42.530 INFO:tasks.workunit.client.0.smithi016.stderr: -189> 2024-09-12T17:21:42.092+0000 7fccd15329c0 5 AuthRegistry(0x55a069a20b80) adding con mode: crc 2024-09-12T17:21:42.530 INFO:tasks.workunit.client.0.smithi016.stderr: -188> 2024-09-12T17:21:42.092+0000 7fccd15329c0 5 AuthRegistry(0x55a069a20b80) adding con mode: secure 2024-09-12T17:21:42.530 INFO:tasks.workunit.client.0.smithi016.stderr: -187> 2024-09-12T17:21:42.092+0000 7fccd15329c0 5 AuthRegistry(0x55a069a20b80) adding con mode: crc 2024-09-12T17:21:42.530 INFO:tasks.workunit.client.0.smithi016.stderr: -186> 2024-09-12T17:21:42.092+0000 7fccd15329c0 5 AuthRegistry(0x55a069a20b80) adding con mode: secure 2024-09-12T17:21:42.530 INFO:tasks.workunit.client.0.smithi016.stderr: -185> 2024-09-12T17:21:42.092+0000 7fccd15329c0 5 AuthRegistry(0x55a069a20b80) adding con mode: crc 2024-09-12T17:21:42.530 INFO:tasks.workunit.client.0.smithi016.stderr: -184> 2024-09-12T17:21:42.092+0000 7fccd15329c0 5 AuthRegistry(0x55a069a20b80) adding con mode: crc 2024-09-12T17:21:42.530 INFO:tasks.workunit.client.0.smithi016.stderr: -183> 2024-09-12T17:21:42.092+0000 7fccd15329c0 5 AuthRegistry(0x55a069a20b80) adding con mode: secure 2024-09-12T17:21:42.530 INFO:tasks.workunit.client.0.smithi016.stderr: -182> 2024-09-12T17:21:42.092+0000 7fccd15329c0 5 AuthRegistry(0x55a069a20b80) adding con mode: crc 2024-09-12T17:21:42.530 INFO:tasks.workunit.client.0.smithi016.stderr: -181> 2024-09-12T17:21:42.092+0000 7fccd15329c0 5 AuthRegistry(0x55a069a20b80) adding con mode: secure 2024-09-12T17:21:42.530 INFO:tasks.workunit.client.0.smithi016.stderr: -180> 2024-09-12T17:21:42.092+0000 7fccd15329c0 5 AuthRegistry(0x55a069a20b80) adding con mode: crc 2024-09-12T17:21:42.530 INFO:tasks.workunit.client.0.smithi016.stderr: -179> 2024-09-12T17:21:42.092+0000 7fccd15329c0 5 AuthRegistry(0x55a069a20b80) adding con mode: secure 2024-09-12T17:21:42.531 INFO:tasks.workunit.client.0.smithi016.stderr: -178> 2024-09-12T17:21:42.092+0000 7fccd15329c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:42.531 INFO:tasks.workunit.client.0.smithi016.stderr: -177> 2024-09-12T17:21:42.092+0000 7fccd15329c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:42.531 INFO:tasks.workunit.client.0.smithi016.stderr: -176> 2024-09-12T17:21:42.092+0000 7fccd15329c0 5 asok(0x55a0697932b0) register_command rotate-key cmddesc rotate-key hook 0x55a069a20cc8 EEXIST 2024-09-12T17:21:42.531 INFO:tasks.workunit.client.0.smithi016.stderr: -175> 2024-09-12T17:21:42.092+0000 7fccd15329c0 10 monclient: _reopen_session rank -1 2024-09-12T17:21:42.531 INFO:tasks.workunit.client.0.smithi016.stderr: -174> 2024-09-12T17:21:42.092+0000 7fccd15329c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:21:42.531 INFO:tasks.workunit.client.0.smithi016.stderr: -173> 2024-09-12T17:21:42.092+0000 7fccd15329c0 10 monclient(hunting): picked mon.noname-a con 0x55a069a42420 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:21:42.531 INFO:tasks.workunit.client.0.smithi016.stderr: -172> 2024-09-12T17:21:42.092+0000 7fccd15329c0 10 monclient(hunting): picked mon.noname-c con 0x55a069a6da30 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:21:42.531 INFO:tasks.workunit.client.0.smithi016.stderr: -171> 2024-09-12T17:21:42.092+0000 7fccd15329c0 10 monclient(hunting): picked mon.noname-b con 0x55a069a72640 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:21:42.531 INFO:tasks.workunit.client.0.smithi016.stderr: -170> 2024-09-12T17:21:42.092+0000 7fccd15329c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:42.531 INFO:tasks.workunit.client.0.smithi016.stderr: -169> 2024-09-12T17:21:42.092+0000 7fccd15329c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:42.531 INFO:tasks.workunit.client.0.smithi016.stderr: -168> 2024-09-12T17:21:42.092+0000 7fccd15329c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:21:42.531 INFO:tasks.workunit.client.0.smithi016.stderr: -167> 2024-09-12T17:21:42.092+0000 7fccd15329c0 10 monclient(hunting): _renew_subs 2024-09-12T17:21:42.531 INFO:tasks.workunit.client.0.smithi016.stderr: -166> 2024-09-12T17:21:42.092+0000 7fccd15329c0 10 monclient(hunting): authenticate will time out at 2420.068995s 2024-09-12T17:21:42.531 INFO:tasks.workunit.client.0.smithi016.stderr: -165> 2024-09-12T17:21:42.092+0000 7fcccf839640 10 monclient(hunting): get_auth_request con 0x55a069a6da30 auth_method 0 2024-09-12T17:21:42.532 INFO:tasks.workunit.client.0.smithi016.stderr: -164> 2024-09-12T17:21:42.092+0000 7fcccf839640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:21:42.532 INFO:tasks.workunit.client.0.smithi016.stderr: -163> 2024-09-12T17:21:42.092+0000 7fcccf839640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:21:42.532 INFO:tasks.workunit.client.0.smithi016.stderr: -162> 2024-09-12T17:21:42.092+0000 7fcccf839640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:21:42.532 INFO:tasks.workunit.client.0.smithi016.stderr: -161> 2024-09-12T17:21:42.092+0000 7fccce837640 10 monclient(hunting): get_auth_request con 0x55a069a42420 auth_method 0 2024-09-12T17:21:42.532 INFO:tasks.workunit.client.0.smithi016.stderr: -160> 2024-09-12T17:21:42.092+0000 7fccce837640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:21:42.532 INFO:tasks.workunit.client.0.smithi016.stderr: -159> 2024-09-12T17:21:42.092+0000 7fccce837640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:21:42.532 INFO:tasks.workunit.client.0.smithi016.stderr: -158> 2024-09-12T17:21:42.092+0000 7fccce837640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:21:42.532 INFO:tasks.workunit.client.0.smithi016.stderr: -157> 2024-09-12T17:21:42.092+0000 7fcccf839640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:21:42.532 INFO:tasks.workunit.client.0.smithi016.stderr: -156> 2024-09-12T17:21:42.092+0000 7fcccf839640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:21:42.532 INFO:tasks.workunit.client.0.smithi016.stderr: -155> 2024-09-12T17:21:42.092+0000 7fcccf839640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:21:42.532 INFO:tasks.workunit.client.0.smithi016.stderr: -154> 2024-09-12T17:21:42.092+0000 7fccce837640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:21:42.532 INFO:tasks.workunit.client.0.smithi016.stderr: -153> 2024-09-12T17:21:42.092+0000 7fccce837640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:21:42.533 INFO:tasks.workunit.client.0.smithi016.stderr: -152> 2024-09-12T17:21:42.092+0000 7fccce837640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:21:42.533 INFO:tasks.workunit.client.0.smithi016.stderr: -151> 2024-09-12T17:21:42.092+0000 7fccce837640 10 monclient(hunting): handle_auth_done global_id 7929 payload 824 2024-09-12T17:21:42.533 INFO:tasks.workunit.client.0.smithi016.stderr: -150> 2024-09-12T17:21:42.092+0000 7fccce837640 10 monclient: _finish_hunting 0 2024-09-12T17:21:42.533 INFO:tasks.workunit.client.0.smithi016.stderr: -149> 2024-09-12T17:21:42.092+0000 7fccce837640 1 monclient: found mon.noname-a 2024-09-12T17:21:42.533 INFO:tasks.workunit.client.0.smithi016.stderr: -148> 2024-09-12T17:21:42.092+0000 7fccce837640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:21:42.533 INFO:tasks.workunit.client.0.smithi016.stderr: -147> 2024-09-12T17:21:42.092+0000 7fcbb17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:21:42.533 INFO:tasks.workunit.client.0.smithi016.stderr: -146> 2024-09-12T17:21:42.092+0000 7fcbb17fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:21:42.533 INFO:tasks.workunit.client.0.smithi016.stderr: -145> 2024-09-12T17:21:42.092+0000 7fcbb17fa640 10 monclient: dump: 2024-09-12T17:21:42.533 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:21:42.533 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:21:42.533 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:42.533 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:42.533 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:21:42.534 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:42.534 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:21:42.534 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:21:42.534 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:21:42.534 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:42.534 INFO:tasks.workunit.client.0.smithi016.stderr: -144> 2024-09-12T17:21:42.092+0000 7fcbb17fa640 10 monclient: _finish_auth 0 2024-09-12T17:21:42.534 INFO:tasks.workunit.client.0.smithi016.stderr: -143> 2024-09-12T17:21:42.092+0000 7fcbb17fa640 10 monclient: _check_auth_tickets 2024-09-12T17:21:42.534 INFO:tasks.workunit.client.0.smithi016.stderr: -142> 2024-09-12T17:21:42.092+0000 7fcbb17fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:21:42.534 INFO:tasks.workunit.client.0.smithi016.stderr: -141> 2024-09-12T17:21:42.092+0000 7fcbb17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:21:42.534 INFO:tasks.workunit.client.0.smithi016.stderr: -140> 2024-09-12T17:21:42.092+0000 7fcbb17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:21:42.534 INFO:tasks.workunit.client.0.smithi016.stderr: -139> 2024-09-12T17:21:42.092+0000 7fcbb17fa640 10 monclient: dump: 2024-09-12T17:21:42.534 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:21:42.534 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:21:42.535 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:42.535 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:21:42.535 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:21:42.535 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:21:42.535 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:21:42.535 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:21:42.535 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:21:42.535 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:42.535 INFO:tasks.workunit.client.0.smithi016.stderr: -138> 2024-09-12T17:21:42.092+0000 7fccd15329c0 5 monclient: authenticate success, global_id 7929 2024-09-12T17:21:42.535 INFO:tasks.workunit.client.0.smithi016.stderr: -137> 2024-09-12T17:21:42.092+0000 7fccd15329c0 10 monclient: _renew_subs 2024-09-12T17:21:42.535 INFO:tasks.workunit.client.0.smithi016.stderr: -136> 2024-09-12T17:21:42.092+0000 7fcbb2ffd640 4 set_mon_vals no callback set 2024-09-12T17:21:42.535 INFO:tasks.workunit.client.0.smithi016.stderr: -135> 2024-09-12T17:21:42.092+0000 7fccd15329c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:21:42.536 INFO:tasks.workunit.client.0.smithi016.stderr: -134> 2024-09-12T17:21:42.092+0000 7fccd15329c0 10 monclient: _renew_subs 2024-09-12T17:21:42.536 INFO:tasks.workunit.client.0.smithi016.stderr: -133> 2024-09-12T17:21:42.092+0000 7fccd15329c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:21:42.536 INFO:tasks.workunit.client.0.smithi016.stderr: -132> 2024-09-12T17:21:42.092+0000 7fccd15329c0 1 librados: init done 2024-09-12T17:21:42.536 INFO:tasks.workunit.client.0.smithi016.stderr: -131> 2024-09-12T17:21:42.092+0000 7fccd15329c0 5 asok(0x55a0697932b0) register_command cr dump hook 0x55a069a687b8 2024-09-12T17:21:42.536 INFO:tasks.workunit.client.0.smithi016.stderr: -130> 2024-09-12T17:21:42.092+0000 7fccd15329c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.536 INFO:tasks.workunit.client.0.smithi016.stderr: -129> 2024-09-12T17:21:42.096+0000 7fcbb17fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:21:42.536 INFO:tasks.workunit.client.0.smithi016.stderr: -128> 2024-09-12T17:21:42.096+0000 7fcbb17fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:21:42.536 INFO:tasks.workunit.client.0.smithi016.stderr: -127> 2024-09-12T17:21:42.096+0000 7fcbb17fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:21:42.536 INFO:tasks.workunit.client.0.smithi016.stderr: -126> 2024-09-12T17:21:42.096+0000 7fcccf839640 10 monclient: get_auth_request con 0x7fcb98070ae0 auth_method 0 2024-09-12T17:21:42.536 INFO:tasks.workunit.client.0.smithi016.stderr: -125> 2024-09-12T17:21:42.096+0000 7fcccf038640 10 monclient: get_auth_request con 0x55a069a8c2e0 auth_method 0 2024-09-12T17:21:42.536 INFO:tasks.workunit.client.0.smithi016.stderr: -124> 2024-09-12T17:21:42.096+0000 7fccd15329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:42.536 INFO:tasks.workunit.client.0.smithi016.stderr: -123> 2024-09-12T17:21:42.096+0000 7fccd15329c0 20 realm 2024-09-12T17:21:42.536 INFO:tasks.workunit.client.0.smithi016.stderr: -122> 2024-09-12T17:21:42.096+0000 7fccd15329c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.536 INFO:tasks.workunit.client.0.smithi016.stderr: -121> 2024-09-12T17:21:42.096+0000 7fccd15329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:42.537 INFO:tasks.workunit.client.0.smithi016.stderr: -120> 2024-09-12T17:21:42.096+0000 7fccd15329c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:21:42.537 INFO:tasks.workunit.client.0.smithi016.stderr: -119> 2024-09-12T17:21:42.096+0000 7fccd15329c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.537 INFO:tasks.workunit.client.0.smithi016.stderr: -118> 2024-09-12T17:21:42.096+0000 7fccd15329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:42.537 INFO:tasks.workunit.client.0.smithi016.stderr: -117> 2024-09-12T17:21:42.096+0000 7fccd15329c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.537 INFO:tasks.workunit.client.0.smithi016.stderr: -116> 2024-09-12T17:21:42.096+0000 7fccce837640 10 monclient: get_auth_request con 0x55a069a90610 auth_method 0 2024-09-12T17:21:42.537 INFO:tasks.workunit.client.0.smithi016.stderr: -115> 2024-09-12T17:21:42.096+0000 7fccd15329c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:42.537 INFO:tasks.workunit.client.0.smithi016.stderr: -114> 2024-09-12T17:21:42.096+0000 7fccd15329c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.537 INFO:tasks.workunit.client.0.smithi016.stderr: -113> 2024-09-12T17:21:42.100+0000 7fcccf839640 10 monclient: get_auth_request con 0x55a069a93d30 auth_method 0 2024-09-12T17:21:42.537 INFO:tasks.workunit.client.0.smithi016.stderr: -112> 2024-09-12T17:21:42.100+0000 7fccd15329c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:21:42.537 INFO:tasks.workunit.client.0.smithi016.stderr: -111> 2024-09-12T17:21:42.100+0000 7fccd15329c0 20 searching for the correct realm 2024-09-12T17:21:42.537 INFO:tasks.workunit.client.0.smithi016.stderr: -110> 2024-09-12T17:21:42.100+0000 7fcccf038640 10 monclient: get_auth_request con 0x55a069a98b10 auth_method 0 2024-09-12T17:21:42.537 INFO:tasks.workunit.client.0.smithi016.stderr: -109> 2024-09-12T17:21:42.100+0000 7fccce837640 10 monclient: get_auth_request con 0x7fccc00c1070 auth_method 0 2024-09-12T17:21:42.537 INFO:tasks.workunit.client.0.smithi016.stderr: -108> 2024-09-12T17:21:42.104+0000 7fcccf839640 10 monclient: get_auth_request con 0x7fccc4008070 auth_method 0 2024-09-12T17:21:42.538 INFO:tasks.workunit.client.0.smithi016.stderr: -107> 2024-09-12T17:21:42.104+0000 7fcccf839640 0 -- 172.21.15.16:0/3570144761 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fccc4008070 msgr2=0x7fccc408eaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:42.538 INFO:tasks.workunit.client.0.smithi016.stderr: -106> 2024-09-12T17:21:42.104+0000 7fcbb17fa640 1 client.7929.objecter ms_handle_reset 0x7fccc4008070 session 0x7fccc4026040 osd.2 2024-09-12T17:21:42.538 INFO:tasks.workunit.client.0.smithi016.stderr: -105> 2024-09-12T17:21:42.104+0000 7fcbb17fa640 10 monclient: _renew_subs 2024-09-12T17:21:42.538 INFO:tasks.workunit.client.0.smithi016.stderr: -104> 2024-09-12T17:21:42.104+0000 7fcbb17fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:21:42.538 INFO:tasks.workunit.client.0.smithi016.stderr: -103> 2024-09-12T17:21:42.104+0000 7fcccf839640 10 monclient: get_auth_request con 0x7fcb98080900 auth_method 0 2024-09-12T17:21:42.538 INFO:tasks.workunit.client.0.smithi016.stderr: -102> 2024-09-12T17:21:42.104+0000 7fcccf038640 10 monclient: get_auth_request con 0x7fccc8050040 auth_method 0 2024-09-12T17:21:42.538 INFO:tasks.workunit.client.0.smithi016.stderr: -101> 2024-09-12T17:21:42.112+0000 7fccce837640 0 -- 172.21.15.16:0/3570144761 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fccc803e040 msgr2=0x7fccc8050930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:42.538 INFO:tasks.workunit.client.0.smithi016.stderr: -100> 2024-09-12T17:21:42.112+0000 7fccce837640 10 monclient: get_auth_request con 0x7fccc803e040 auth_method 0 2024-09-12T17:21:42.538 INFO:tasks.workunit.client.0.smithi016.stderr: -99> 2024-09-12T17:21:42.316+0000 7fccce837640 10 monclient: get_auth_request con 0x7fccc803e040 auth_method 0 2024-09-12T17:21:42.538 INFO:tasks.workunit.client.0.smithi016.stderr: -98> 2024-09-12T17:21:42.332+0000 7fccd15329c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:21:42.538 INFO:tasks.workunit.client.0.smithi016.stderr: -97> 2024-09-12T17:21:42.332+0000 7fccd15329c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:21:42.538 INFO:tasks.workunit.client.0.smithi016.stderr: -96> 2024-09-12T17:21:42.332+0000 7fccd15329c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:21:42.538 INFO:tasks.workunit.client.0.smithi016.stderr: -95> 2024-09-12T17:21:42.332+0000 7fccd15329c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:21:42.539 INFO:tasks.workunit.client.0.smithi016.stderr: -94> 2024-09-12T17:21:42.332+0000 7fccd15329c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:21:42.539 INFO:tasks.workunit.client.0.smithi016.stderr: -93> 2024-09-12T17:21:42.332+0000 7fccd15329c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:21:42.539 INFO:tasks.workunit.client.0.smithi016.stderr: -92> 2024-09-12T17:21:42.332+0000 7fccd15329c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.539 INFO:tasks.workunit.client.0.smithi016.stderr: -91> 2024-09-12T17:21:42.332+0000 7fccd15329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:42.539 INFO:tasks.workunit.client.0.smithi016.stderr: -90> 2024-09-12T17:21:42.332+0000 7fccd15329c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.539 INFO:tasks.workunit.client.0.smithi016.stderr: -89> 2024-09-12T17:21:42.332+0000 7fccd15329c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:42.539 INFO:tasks.workunit.client.0.smithi016.stderr: -88> 2024-09-12T17:21:42.332+0000 7fccd15329c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.539 INFO:tasks.workunit.client.0.smithi016.stderr: -87> 2024-09-12T17:21:42.332+0000 7fccd15329c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:21:42.539 INFO:tasks.workunit.client.0.smithi016.stderr: -86> 2024-09-12T17:21:42.332+0000 7fccd15329c0 20 zone default found 2024-09-12T17:21:42.539 INFO:tasks.workunit.client.0.smithi016.stderr: -85> 2024-09-12T17:21:42.332+0000 7fccd15329c0 4 Realm: () 2024-09-12T17:21:42.539 INFO:tasks.workunit.client.0.smithi016.stderr: -84> 2024-09-12T17:21:42.332+0000 7fccd15329c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:21:42.539 INFO:tasks.workunit.client.0.smithi016.stderr: -83> 2024-09-12T17:21:42.332+0000 7fccd15329c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:21:42.539 INFO:tasks.workunit.client.0.smithi016.stderr: -82> 2024-09-12T17:21:42.332+0000 7fccd15329c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:21:42.539 INFO:tasks.workunit.client.0.smithi016.stderr: -81> 2024-09-12T17:21:42.332+0000 7fccd15329c0 20 zonegroup default 2024-09-12T17:21:42.540 INFO:tasks.workunit.client.0.smithi016.stderr: -80> 2024-09-12T17:21:42.332+0000 7fccd15329c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.540 INFO:tasks.workunit.client.0.smithi016.stderr: -79> 2024-09-12T17:21:42.332+0000 7fccd15329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:42.540 INFO:tasks.workunit.client.0.smithi016.stderr: -78> 2024-09-12T17:21:42.332+0000 7fccd15329c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.540 INFO:tasks.workunit.client.0.smithi016.stderr: -77> 2024-09-12T17:21:42.336+0000 7fccd15329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:42.540 INFO:tasks.workunit.client.0.smithi016.stderr: -76> 2024-09-12T17:21:42.336+0000 7fccd15329c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.540 INFO:tasks.workunit.client.0.smithi016.stderr: -75> 2024-09-12T17:21:42.336+0000 7fccd15329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:42.540 INFO:tasks.workunit.client.0.smithi016.stderr: -74> 2024-09-12T17:21:42.336+0000 7fccd15329c0 20 started sync module instance, tier type = 2024-09-12T17:21:42.540 INFO:tasks.workunit.client.0.smithi016.stderr: -73> 2024-09-12T17:21:42.336+0000 7fccd15329c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:21:42.540 INFO:tasks.workunit.client.0.smithi016.stderr: -72> 2024-09-12T17:21:42.360+0000 7fccd15329c0 20 add_watcher() i=0 2024-09-12T17:21:42.540 INFO:tasks.workunit.client.0.smithi016.stderr: -71> 2024-09-12T17:21:42.360+0000 7fccd15329c0 20 add_watcher() i=1 2024-09-12T17:21:42.540 INFO:tasks.workunit.client.0.smithi016.stderr: -70> 2024-09-12T17:21:42.360+0000 7fccd15329c0 20 add_watcher() i=2 2024-09-12T17:21:42.540 INFO:tasks.workunit.client.0.smithi016.stderr: -69> 2024-09-12T17:21:42.360+0000 7fccd15329c0 20 add_watcher() i=3 2024-09-12T17:21:42.540 INFO:tasks.workunit.client.0.smithi016.stderr: -68> 2024-09-12T17:21:42.360+0000 7fccd15329c0 20 add_watcher() i=4 2024-09-12T17:21:42.540 INFO:tasks.workunit.client.0.smithi016.stderr: -67> 2024-09-12T17:21:42.360+0000 7fccd15329c0 20 add_watcher() i=5 2024-09-12T17:21:42.541 INFO:tasks.workunit.client.0.smithi016.stderr: -66> 2024-09-12T17:21:42.360+0000 7fccd15329c0 20 add_watcher() i=6 2024-09-12T17:21:42.541 INFO:tasks.workunit.client.0.smithi016.stderr: -65> 2024-09-12T17:21:42.364+0000 7fccd15329c0 20 add_watcher() i=7 2024-09-12T17:21:42.541 INFO:tasks.workunit.client.0.smithi016.stderr: -64> 2024-09-12T17:21:42.364+0000 7fccd15329c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:21:42.541 INFO:tasks.workunit.client.0.smithi016.stderr: -63> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b939a70) adding auth protocol: cephx 2024-09-12T17:21:42.541 INFO:tasks.workunit.client.0.smithi016.stderr: -62> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b939a70) adding auth protocol: cephx 2024-09-12T17:21:42.541 INFO:tasks.workunit.client.0.smithi016.stderr: -61> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b939a70) adding auth protocol: cephx 2024-09-12T17:21:42.541 INFO:tasks.workunit.client.0.smithi016.stderr: -60> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b939a70) adding con mode: secure 2024-09-12T17:21:42.541 INFO:tasks.workunit.client.0.smithi016.stderr: -59> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b939a70) adding con mode: crc 2024-09-12T17:21:42.541 INFO:tasks.workunit.client.0.smithi016.stderr: -58> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b939a70) adding con mode: secure 2024-09-12T17:21:42.541 INFO:tasks.workunit.client.0.smithi016.stderr: -57> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b939a70) adding con mode: crc 2024-09-12T17:21:42.541 INFO:tasks.workunit.client.0.smithi016.stderr: -56> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b939a70) adding con mode: secure 2024-09-12T17:21:42.541 INFO:tasks.workunit.client.0.smithi016.stderr: -55> 2024-09-12T17:21:42.368+0000 7fcb85fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:42.541 INFO:tasks.workunit.client.0.smithi016.stderr: -54> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b939a70) adding con mode: crc 2024-09-12T17:21:42.542 INFO:tasks.workunit.client.0.smithi016.stderr: -53> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b939a70) adding con mode: crc 2024-09-12T17:21:42.542 INFO:tasks.workunit.client.0.smithi016.stderr: -52> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b939a70) adding con mode: secure 2024-09-12T17:21:42.542 INFO:tasks.workunit.client.0.smithi016.stderr: -51> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b939a70) adding con mode: crc 2024-09-12T17:21:42.542 INFO:tasks.workunit.client.0.smithi016.stderr: -50> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b939a70) adding con mode: secure 2024-09-12T17:21:42.542 INFO:tasks.workunit.client.0.smithi016.stderr: -49> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b939a70) adding con mode: crc 2024-09-12T17:21:42.542 INFO:tasks.workunit.client.0.smithi016.stderr: -48> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 AuthRegistry(0x7fff6b939a70) adding con mode: secure 2024-09-12T17:21:42.542 INFO:tasks.workunit.client.0.smithi016.stderr: -47> 2024-09-12T17:21:42.368+0000 7fccd15329c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:21:42.542 INFO:tasks.workunit.client.0.smithi016.stderr: -46> 2024-09-12T17:21:42.368+0000 7fccd15329c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:21:42.542 INFO:tasks.workunit.client.0.smithi016.stderr: -45> 2024-09-12T17:21:42.368+0000 7fccd15329c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:21:42.542 INFO:tasks.workunit.client.0.smithi016.stderr: -44> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 asok(0x55a0697932b0) register_command cache list hook 0x55a069a410e0 2024-09-12T17:21:42.542 INFO:tasks.workunit.client.0.smithi016.stderr: -43> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 asok(0x55a0697932b0) register_command cache inspect hook 0x55a069a410e0 2024-09-12T17:21:42.542 INFO:tasks.workunit.client.0.smithi016.stderr: -42> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 asok(0x55a0697932b0) register_command cache erase hook 0x55a069a410e0 2024-09-12T17:21:42.542 INFO:tasks.workunit.client.0.smithi016.stderr: -41> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 asok(0x55a0697932b0) register_command cache zap hook 0x55a069a410e0 2024-09-12T17:21:42.542 INFO:tasks.workunit.client.0.smithi016.stderr: -40> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 note: GC not initialized 2024-09-12T17:21:42.543 INFO:tasks.workunit.client.0.smithi016.stderr: -39> 2024-09-12T17:21:42.368+0000 7fcb84fe1640 20 reqs_thread_entry: start 2024-09-12T17:21:42.543 INFO:tasks.workunit.client.0.smithi016.stderr: -38> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 asok(0x55a0697932b0) register_command sync trace show hook 0x7fccc400ad90 2024-09-12T17:21:42.543 INFO:tasks.workunit.client.0.smithi016.stderr: -37> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 asok(0x55a0697932b0) register_command sync trace history hook 0x7fccc400ad90 2024-09-12T17:21:42.543 INFO:tasks.workunit.client.0.smithi016.stderr: -36> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 asok(0x55a0697932b0) register_command sync trace active hook 0x7fccc400ad90 2024-09-12T17:21:42.543 INFO:tasks.workunit.client.0.smithi016.stderr: -35> 2024-09-12T17:21:42.368+0000 7fccd15329c0 5 asok(0x55a0697932b0) register_command sync trace active_short hook 0x7fccc400ad90 2024-09-12T17:21:42.543 INFO:tasks.workunit.client.0.smithi016.stderr: -34> 2024-09-12T17:21:42.368+0000 7fccd15329c0 20 init_complete bucket index max shards: 1 2024-09-12T17:21:42.543 INFO:tasks.workunit.client.0.smithi016.stderr: -33> 2024-09-12T17:21:42.368+0000 7fccd15329c0 20 Filter name: none 2024-09-12T17:21:42.543 INFO:tasks.workunit.client.0.smithi016.stderr: -32> 2024-09-12T17:21:42.368+0000 7fcafe7fc640 20 reqs_thread_entry: start 2024-09-12T17:21:42.543 INFO:tasks.workunit.client.0.smithi016.stderr: -31> 2024-09-12T17:21:42.368+0000 7fccd15329c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T17:21:42.543 INFO:tasks.workunit.client.0.smithi016.stderr: -30> 2024-09-12T17:21:42.368+0000 7fccd15329c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.543 INFO:tasks.workunit.client.0.smithi016.stderr: -29> 2024-09-12T17:21:42.368+0000 7fccd15329c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:21:42.543 INFO:tasks.workunit.client.0.smithi016.stderr: -28> 2024-09-12T17:21:42.368+0000 7fccd15329c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T17:21:42.543 INFO:tasks.workunit.client.0.smithi016.stderr: -27> 2024-09-12T17:21:42.368+0000 7fccd15329c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T17:21:42.543 INFO:tasks.workunit.client.0.smithi016.stderr: -26> 2024-09-12T17:21:42.368+0000 7fccd15329c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 : miss 2024-09-12T17:21:42.544 INFO:tasks.workunit.client.0.smithi016.stderr: -25> 2024-09-12T17:21:42.368+0000 7fccd15329c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.544 INFO:tasks.workunit.client.0.smithi016.stderr: -24> 2024-09-12T17:21:42.372+0000 7fccd15329c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:21:42.544 INFO:tasks.workunit.client.0.smithi016.stderr: -23> 2024-09-12T17:21:42.372+0000 7fccd15329c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 info.flags=0x17 2024-09-12T17:21:42.544 INFO:tasks.workunit.client.0.smithi016.stderr: -22> 2024-09-12T17:21:42.372+0000 7fccd15329c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 to cache LRU end 2024-09-12T17:21:42.544 INFO:tasks.workunit.client.0.smithi016.stderr: -21> 2024-09-12T17:21:42.372+0000 7fccd15329c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:21:42.544 INFO:tasks.workunit.client.0.smithi016.stderr: -20> 2024-09-12T17:21:42.372+0000 7fccd15329c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:42.544 INFO:tasks.workunit.client.0.smithi016.stderr: -19> 2024-09-12T17:21:42.372+0000 7fccd15329c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 2024-09-12T17:21:42.544 INFO:tasks.workunit.client.0.smithi016.stderr: -18> 2024-09-12T17:21:42.380+0000 7fccd15329c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 info.flags=0x17 2024-09-12T17:21:42.544 INFO:tasks.workunit.client.0.smithi016.stderr: -17> 2024-09-12T17:21:42.380+0000 7fccd15329c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 to cache LRU end 2024-09-12T17:21:42.544 INFO:tasks.workunit.client.0.smithi016.stderr: -16> 2024-09-12T17:21:42.380+0000 7fccd15329c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:42.544 INFO:tasks.workunit.client.0.smithi016.stderr: -15> 2024-09-12T17:21:42.380+0000 7fccd15329c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39, ofs0, ns] 2024-09-12T17:21:42.544 INFO:tasks.workunit.client.0.smithi016.stderr: -14> 2024-09-12T17:21:42.380+0000 7fcbb2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431671 cookie 94147455871328 notifier 7929 bl.length()=931 2024-09-12T17:21:42.544 INFO:tasks.workunit.client.0.smithi016.stderr: -13> 2024-09-12T17:21:42.380+0000 7fcbb2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 info.flags=0x17 2024-09-12T17:21:42.545 INFO:tasks.workunit.client.0.smithi016.stderr: -12> 2024-09-12T17:21:42.380+0000 7fcbb2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 to cache LRU end 2024-09-12T17:21:42.545 INFO:tasks.workunit.client.0.smithi016.stderr: -11> 2024-09-12T17:21:42.380+0000 7fcbb2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:42.545 INFO:tasks.workunit.client.0.smithi016.stderr: -10> 2024-09-12T17:21:42.384+0000 7fccd15329c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39]): orig_sources= new_sources= 2024-09-12T17:21:42.545 INFO:tasks.workunit.client.0.smithi016.stderr: -9> 2024-09-12T17:21:42.384+0000 7fccd15329c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39]): potential sources added=[] removed=[] 2024-09-12T17:21:42.545 INFO:tasks.workunit.client.0.smithi016.stderr: -8> 2024-09-12T17:21:42.384+0000 7fccd15329c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39]): orig_dests= new_dests= 2024-09-12T17:21:42.545 INFO:tasks.workunit.client.0.smithi016.stderr: -7> 2024-09-12T17:21:42.384+0000 7fccd15329c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39]): potential dests added=[] removed=[] 2024-09-12T17:21:42.545 INFO:tasks.workunit.client.0.smithi016.stderr: -6> 2024-09-12T17:21:42.388+0000 7fccd15329c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39.1.0 2024-09-12T17:21:42.545 INFO:tasks.workunit.client.0.smithi016.stderr: -5> 2024-09-12T17:21:42.388+0000 7fccd15329c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39.1.0 2024-09-12T17:21:42.545 INFO:tasks.workunit.client.0.smithi016.stderr: -4> 2024-09-12T17:21:42.388+0000 7fccd15329c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39.1.1 2024-09-12T17:21:42.545 INFO:tasks.workunit.client.0.smithi016.stderr: -3> 2024-09-12T17:21:42.388+0000 7fccd15329c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39.1.1 2024-09-12T17:21:42.545 INFO:tasks.workunit.client.0.smithi016.stderr: -2> 2024-09-12T17:21:42.388+0000 7fccd15329c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39.0 2024-09-12T17:21:42.545 INFO:tasks.workunit.client.0.smithi016.stderr: -1> 2024-09-12T17:21:42.400+0000 7fccd15329c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fccd15329c0 time 2024-09-12T17:21:42.400515+0000 2024-09-12T17:21:42.545 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:21:42.546 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:42.546 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:21:42.546 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fccd4e0c2eb] 2024-09-12T17:21:42.546 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fccd4e0c49f] 2024-09-12T17:21:42.546 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a0668600c1] 2024-09-12T17:21:42.546 INFO:tasks.workunit.client.0.smithi016.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55a0668714f1] 2024-09-12T17:21:42.546 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55a066872b44] 2024-09-12T17:21:42.546 INFO:tasks.workunit.client.0.smithi016.stderr: 6: main() 2024-09-12T17:21:42.546 INFO:tasks.workunit.client.0.smithi016.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fccd3c72d90] 2024-09-12T17:21:42.546 INFO:tasks.workunit.client.0.smithi016.stderr: 8: __libc_start_main() 2024-09-12T17:21:42.546 INFO:tasks.workunit.client.0.smithi016.stderr: 9: _start() 2024-09-12T17:21:42.546 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:42.547 INFO:tasks.workunit.client.0.smithi016.stderr: 0> 2024-09-12T17:21:42.404+0000 7fccd15329c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:21:42.547 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7fccd15329c0 thread_name:radosgw-admin 2024-09-12T17:21:42.547 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:42.547 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:21:42.547 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fccd3c8b520] 2024-09-12T17:21:42.547 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:21:42.547 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:21:42.547 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:21:42.547 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fccd4e0c345] 2024-09-12T17:21:42.547 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fccd4e0c49f] 2024-09-12T17:21:42.547 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a0668600c1] 2024-09-12T17:21:42.547 INFO:tasks.workunit.client.0.smithi016.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55a0668714f1] 2024-09-12T17:21:42.547 INFO:tasks.workunit.client.0.smithi016.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55a066872b44] 2024-09-12T17:21:42.547 INFO:tasks.workunit.client.0.smithi016.stderr: 10: main() 2024-09-12T17:21:42.548 INFO:tasks.workunit.client.0.smithi016.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fccd3c72d90] 2024-09-12T17:21:42.548 INFO:tasks.workunit.client.0.smithi016.stderr: 12: __libc_start_main() 2024-09-12T17:21:42.548 INFO:tasks.workunit.client.0.smithi016.stderr: 13: _start() 2024-09-12T17:21:42.548 INFO:tasks.workunit.client.0.smithi016.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:21:42.548 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:42.548 INFO:tasks.workunit.client.0.smithi016.stderr:--- logging levels --- 2024-09-12T17:21:42.548 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 none 2024-09-12T17:21:42.548 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 lockdep 2024-09-12T17:21:42.548 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 context 2024-09-12T17:21:42.548 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 crush 2024-09-12T17:21:42.548 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds 2024-09-12T17:21:42.548 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_balancer 2024-09-12T17:21:42.548 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_locker 2024-09-12T17:21:42.549 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log 2024-09-12T17:21:42.549 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log_expire 2024-09-12T17:21:42.549 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_migrator 2024-09-12T17:21:42.549 INFO:tasks.workunit.client.0.smithi016.stderr: 3/ 5 mds_quiesce 2024-09-12T17:21:42.549 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 buffer 2024-09-12T17:21:42.549 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 timer 2024-09-12T17:21:42.549 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 filer 2024-09-12T17:21:42.549 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 striper 2024-09-12T17:21:42.549 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 objecter 2024-09-12T17:21:42.549 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rados 2024-09-12T17:21:42.549 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd 2024-09-12T17:21:42.549 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_mirror 2024-09-12T17:21:42.549 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_replay 2024-09-12T17:21:42.549 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_pwl 2024-09-12T17:21:42.550 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 journaler 2024-09-12T17:21:42.550 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objectcacher 2024-09-12T17:21:42.550 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:21:42.550 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 client 2024-09-12T17:21:42.550 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 osd 2024-09-12T17:21:42.550 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 optracker 2024-09-12T17:21:42.550 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objclass 2024-09-12T17:21:42.550 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 filestore 2024-09-12T17:21:42.550 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 journal 2024-09-12T17:21:42.550 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 ms 2024-09-12T17:21:42.550 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mon 2024-09-12T17:21:42.550 INFO:tasks.workunit.client.0.smithi016.stderr: 0/10 monc 2024-09-12T17:21:42.550 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 paxos 2024-09-12T17:21:42.551 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 tp 2024-09-12T17:21:42.551 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 auth 2024-09-12T17:21:42.551 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 crypto 2024-09-12T17:21:42.551 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 finisher 2024-09-12T17:21:42.551 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 reserver 2024-09-12T17:21:42.551 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 heartbeatmap 2024-09-12T17:21:42.551 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 perfcounter 2024-09-12T17:21:42.551 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw 2024-09-12T17:21:42.551 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_sync 2024-09-12T17:21:42.551 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_datacache 2024-09-12T17:21:42.551 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_access 2024-09-12T17:21:42.551 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:21:42.551 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_flight 2024-09-12T17:21:42.552 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:21:42.552 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw_notification 2024-09-12T17:21:42.552 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 javaclient 2024-09-12T17:21:42.552 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 asok 2024-09-12T17:21:42.552 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 throttle 2024-09-12T17:21:42.552 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 refs 2024-09-12T17:21:42.552 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 compressor 2024-09-12T17:21:42.552 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluestore 2024-09-12T17:21:42.552 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluefs 2024-09-12T17:21:42.552 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 bdev 2024-09-12T17:21:42.552 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 kstore 2024-09-12T17:21:42.552 INFO:tasks.workunit.client.0.smithi016.stderr: 4/ 5 rocksdb 2024-09-12T17:21:42.552 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 fuse 2024-09-12T17:21:42.553 INFO:tasks.workunit.client.0.smithi016.stderr: 2/ 5 mgr 2024-09-12T17:21:42.553 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mgrc 2024-09-12T17:21:42.553 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 dpdk 2024-09-12T17:21:42.553 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 eventtrace 2024-09-12T17:21:42.553 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 prioritycache 2024-09-12T17:21:42.553 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 test 2024-09-12T17:21:42.553 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:21:42.553 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephsqlite 2024-09-12T17:21:42.553 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:21:42.553 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore 2024-09-12T17:21:42.553 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_onode 2024-09-12T17:21:42.553 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_odata 2024-09-12T17:21:42.553 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_omap 2024-09-12T17:21:42.554 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_tm 2024-09-12T17:21:42.554 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_t 2024-09-12T17:21:42.554 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:21:42.554 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_epm 2024-09-12T17:21:42.554 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_lba 2024-09-12T17:21:42.554 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:21:42.554 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cache 2024-09-12T17:21:42.554 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_journal 2024-09-12T17:21:42.554 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_device 2024-09-12T17:21:42.554 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_backref 2024-09-12T17:21:42.554 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 alienstore 2024-09-12T17:21:42.554 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mclock 2024-09-12T17:21:42.554 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cyanstore 2024-09-12T17:21:42.555 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 ceph_exporter 2024-09-12T17:21:42.555 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 memstore 2024-09-12T17:21:42.555 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 trace 2024-09-12T17:21:42.555 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 ceph_dedup 2024-09-12T17:21:42.555 INFO:tasks.workunit.client.0.smithi016.stderr: -2/-2 (syslog threshold) 2024-09-12T17:21:42.555 INFO:tasks.workunit.client.0.smithi016.stderr: 99/99 (stderr threshold) 2024-09-12T17:21:42.555 INFO:tasks.workunit.client.0.smithi016.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:21:42.555 INFO:tasks.workunit.client.0.smithi016.stderr: 7fcafe7fc640 / http_manager 2024-09-12T17:21:42.555 INFO:tasks.workunit.client.0.smithi016.stderr: 7fcb84fe1640 / http_manager 2024-09-12T17:21:42.555 INFO:tasks.workunit.client.0.smithi016.stderr: 7fcb85fe3640 / rgw_dt_lg_renew 2024-09-12T17:21:42.555 INFO:tasks.workunit.client.0.smithi016.stderr: 7fcbb17fa640 / ms_dispatch 2024-09-12T17:21:42.555 INFO:tasks.workunit.client.0.smithi016.stderr: 7fcbb2ffd640 / io_context_pool 2024-09-12T17:21:42.555 INFO:tasks.workunit.client.0.smithi016.stderr: 7fcbb9602640 / ms_dispatch 2024-09-12T17:21:42.556 INFO:tasks.workunit.client.0.smithi016.stderr: 7fcbbbe07640 / ms_dispatch 2024-09-12T17:21:42.556 INFO:tasks.workunit.client.0.smithi016.stderr: 7fcbbd60a640 / io_context_pool 2024-09-12T17:21:42.556 INFO:tasks.workunit.client.0.smithi016.stderr: 7fccce036640 / io_context_pool 2024-09-12T17:21:42.556 INFO:tasks.workunit.client.0.smithi016.stderr: 7fccce837640 / msgr-worker-2 2024-09-12T17:21:42.556 INFO:tasks.workunit.client.0.smithi016.stderr: 7fcccf038640 / msgr-worker-1 2024-09-12T17:21:42.556 INFO:tasks.workunit.client.0.smithi016.stderr: 7fcccf839640 / msgr-worker-0 2024-09-12T17:21:42.556 INFO:tasks.workunit.client.0.smithi016.stderr: 7fccd15329c0 / radosgw-admin 2024-09-12T17:21:42.556 INFO:tasks.workunit.client.0.smithi016.stderr: max_recent 500 2024-09-12T17:21:42.556 INFO:tasks.workunit.client.0.smithi016.stderr: max_new 1000 2024-09-12T17:21:42.556 INFO:tasks.workunit.client.0.smithi016.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:21:42.407276Z_1f8abf47-54f3-4a6d-93bf-642ea5bf613a/log 2024-09-12T17:21:42.556 INFO:tasks.workunit.client.0.smithi016.stderr:--- end dump of recent events --- 2024-09-12T17:21:42.556 INFO:tasks.workunit.client.0.smithi016.stderr:Aborted 2024-09-12T17:21:42.556 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T17:21:42.558 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:21:42.558 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:21:42.558 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.496+0000 7fe3598419c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.558 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.496+0000 7fe3598419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:42.558 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.496+0000 7fe3598419c0 20 realm 2024-09-12T17:21:42.558 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.496+0000 7fe3598419c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.558 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.496+0000 7fe3598419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:42.558 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.496+0000 7fe3598419c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:21:42.558 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.496+0000 7fe3598419c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.559 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.496+0000 7fe3598419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:42.559 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.496+0000 7fe3598419c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.559 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.500+0000 7fe3598419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:42.559 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.500+0000 7fe3598419c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.559 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.500+0000 7fe3598419c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:21:42.559 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.500+0000 7fe3598419c0 20 searching for the correct realm 2024-09-12T17:21:42.559 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.504+0000 7fe357b48640 0 -- 172.21.15.16:0/789843600 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fe34c12ab90 msgr2=0x7fe34c131270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:42.722 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.720+0000 7fe356b46640 0 -- 172.21.15.16:0/789843600 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fe350064720 msgr2=0x7fe35005af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:42.940 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.940+0000 7fe3598419c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:21:42.940 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.940+0000 7fe3598419c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:21:42.941 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.940+0000 7fe3598419c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:21:42.941 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.940+0000 7fe3598419c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:21:42.941 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.940+0000 7fe3598419c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:21:42.941 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.940+0000 7fe3598419c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:21:42.941 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.940+0000 7fe3598419c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.941 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.940+0000 7fe3598419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:42.941 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.940+0000 7fe3598419c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.942 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.940+0000 7fe3598419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:42.942 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.940+0000 7fe3598419c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.940+0000 7fe3598419c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:21:42.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.940+0000 7fe3598419c0 20 zone default found 2024-09-12T17:21:42.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.940+0000 7fe3598419c0 4 Realm: () 2024-09-12T17:21:42.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.940+0000 7fe3598419c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:21:42.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.940+0000 7fe3598419c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:21:42.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.940+0000 7fe3598419c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:21:42.944 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.940+0000 7fe3598419c0 20 zonegroup default 2024-09-12T17:21:42.944 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.940+0000 7fe3598419c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.944 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.940+0000 7fe3598419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:42.944 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.940+0000 7fe3598419c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.945 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.944+0000 7fe3598419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:42.945 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.944+0000 7fe3598419c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.945 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.944+0000 7fe3598419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:42.945 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.944+0000 7fe3598419c0 20 started sync module instance, tier type = 2024-09-12T17:21:42.945 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.944+0000 7fe3598419c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:21:42.969 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.968+0000 7fe3598419c0 20 add_watcher() i=0 2024-09-12T17:21:42.969 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.968+0000 7fe3598419c0 20 add_watcher() i=1 2024-09-12T17:21:42.969 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.968+0000 7fe3598419c0 20 add_watcher() i=2 2024-09-12T17:21:42.969 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.968+0000 7fe3598419c0 20 add_watcher() i=3 2024-09-12T17:21:42.969 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.968+0000 7fe3598419c0 20 add_watcher() i=4 2024-09-12T17:21:42.970 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.968+0000 7fe3598419c0 20 add_watcher() i=5 2024-09-12T17:21:42.970 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.968+0000 7fe3598419c0 20 add_watcher() i=6 2024-09-12T17:21:42.971 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.968+0000 7fe3598419c0 20 add_watcher() i=7 2024-09-12T17:21:42.971 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.968+0000 7fe3598419c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:21:42.975 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.972+0000 7fe20dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:42.976 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.972+0000 7fe3598419c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:21:42.976 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.972+0000 7fe3598419c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:21:42.976 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.972+0000 7fe3598419c0 5 note: GC not initialized 2024-09-12T17:21:42.976 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.976+0000 7fe20cfe1640 20 reqs_thread_entry: start 2024-09-12T17:21:42.977 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.976+0000 7fe3598419c0 20 init_complete bucket index max shards: 1 2024-09-12T17:21:42.977 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.976+0000 7fe3598419c0 20 Filter name: none 2024-09-12T17:21:42.977 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.976+0000 7fe1867fc640 20 reqs_thread_entry: start 2024-09-12T17:21:42.977 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.976+0000 7fe3598419c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.978 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.976+0000 7fe3598419c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:21:42.978 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.976+0000 7fe3598419c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.980 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.976+0000 7fe3598419c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T17:21:42.980 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.976+0000 7fe3598419c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:21:42.980 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.976+0000 7fe3598419c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.980 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.980+0000 7fe3598419c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:21:42.981 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.980+0000 7fe3598419c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:42.981 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.980+0000 7fe3598419c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T17:21:42.982 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.980+0000 7fe3598419c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:21:42.985 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.984+0000 7fe20dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:42.990 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.988+0000 7fe3598419c0 20 remove_watcher() i=0 2024-09-12T17:21:42.990 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.988+0000 7fe3598419c0 2 removed watcher, disabling cache 2024-09-12T17:21:42.992 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.992+0000 7fe3598419c0 20 remove_watcher() i=1 2024-09-12T17:21:42.995 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.992+0000 7fe3598419c0 20 remove_watcher() i=2 2024-09-12T17:21:42.997 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.996+0000 7fe3598419c0 20 remove_watcher() i=3 2024-09-12T17:21:43.000 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:42.996+0000 7fe3598419c0 20 remove_watcher() i=4 2024-09-12T17:21:43.002 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.000+0000 7fe3598419c0 20 remove_watcher() i=5 2024-09-12T17:21:43.004 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.000+0000 7fe3598419c0 20 remove_watcher() i=6 2024-09-12T17:21:43.006 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.004+0000 7fe3598419c0 20 remove_watcher() i=7 2024-09-12T17:21:43.022 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:43.022 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:21:43.022 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: abort-at-change-reshard-state id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T17:21:43.023 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:21:43.081 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:21:43.114 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:21:43.114 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:21:43.163 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.160+0000 7f852bc519c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:43.165 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.164+0000 7f852bc519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:43.165 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.164+0000 7f852bc519c0 20 realm 2024-09-12T17:21:43.165 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.164+0000 7f852bc519c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:43.166 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.164+0000 7f852bc519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:43.166 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.164+0000 7f852bc519c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:21:43.166 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.164+0000 7f852bc519c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:43.166 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.164+0000 7f852bc519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:43.166 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.164+0000 7f852bc519c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:43.167 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.164+0000 7f852bc519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:43.167 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.164+0000 7f852bc519c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:43.170 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.168+0000 7f852bc519c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:21:43.170 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.168+0000 7f852bc519c0 20 searching for the correct realm 2024-09-12T17:21:43.174 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.172+0000 7f8529f58640 0 -- 172.21.15.16:0/838536699 >> [v2:172.21.15.19:6800/1509147557,v1:172.21.15.19:6801/1509147557] conn(0x55fd779aae50 msgr2=0x55fd779ad240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:21:43.181 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.180+0000 7f8528f56640 0 -- 172.21.15.16:0/838536699 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f8524017040 msgr2=0x7f85240918e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:21:43.399 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.396+0000 7f852bc519c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:21:43.399 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.396+0000 7f852bc519c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:21:43.400 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.396+0000 7f852bc519c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:21:43.400 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.396+0000 7f852bc519c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:21:43.400 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.396+0000 7f852bc519c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:21:43.400 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.396+0000 7f852bc519c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:21:43.400 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.396+0000 7f852bc519c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:43.400 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.396+0000 7f852bc519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:43.400 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.396+0000 7f852bc519c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:43.401 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.400+0000 7f852bc519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:21:43.401 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.400+0000 7f852bc519c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:43.402 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.400+0000 7f852bc519c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:21:43.402 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.400+0000 7f852bc519c0 20 zone default found 2024-09-12T17:21:43.402 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.400+0000 7f852bc519c0 4 Realm: () 2024-09-12T17:21:43.402 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.400+0000 7f852bc519c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:21:43.402 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.400+0000 7f852bc519c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:21:43.402 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.400+0000 7f852bc519c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:21:43.402 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.400+0000 7f852bc519c0 20 zonegroup default 2024-09-12T17:21:43.402 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.400+0000 7f852bc519c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:43.403 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.400+0000 7f852bc519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:43.403 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.400+0000 7f852bc519c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:43.403 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.400+0000 7f852bc519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:43.403 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.400+0000 7f852bc519c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:43.404 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.404+0000 7f852bc519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:21:43.405 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.404+0000 7f852bc519c0 20 started sync module instance, tier type = 2024-09-12T17:21:43.405 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.404+0000 7f852bc519c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:21:43.429 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.428+0000 7f852bc519c0 20 add_watcher() i=0 2024-09-12T17:21:43.429 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.428+0000 7f852bc519c0 20 add_watcher() i=1 2024-09-12T17:21:43.429 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.428+0000 7f852bc519c0 20 add_watcher() i=2 2024-09-12T17:21:43.429 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.428+0000 7f852bc519c0 20 add_watcher() i=3 2024-09-12T17:21:43.429 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.428+0000 7f852bc519c0 20 add_watcher() i=4 2024-09-12T17:21:43.429 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.428+0000 7f852bc519c0 20 add_watcher() i=5 2024-09-12T17:21:43.430 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.428+0000 7f852bc519c0 20 add_watcher() i=6 2024-09-12T17:21:43.432 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.428+0000 7f852bc519c0 20 add_watcher() i=7 2024-09-12T17:21:43.432 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.428+0000 7f852bc519c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:21:43.436 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.436+0000 7f83df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:43.437 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.436+0000 7f852bc519c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:21:43.437 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.436+0000 7f852bc519c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:21:43.437 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.436+0000 7f852bc519c0 5 note: GC not initialized 2024-09-12T17:21:43.438 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.436+0000 7f83de7e4640 20 reqs_thread_entry: start 2024-09-12T17:21:43.438 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.436+0000 7f852bc519c0 20 init_complete bucket index max shards: 1 2024-09-12T17:21:43.439 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.436+0000 7f852bc519c0 20 Filter name: none 2024-09-12T17:21:43.439 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.436+0000 7f834ffff640 20 reqs_thread_entry: start 2024-09-12T17:21:43.439 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.436+0000 7f852bc519c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T17:21:43.439 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.436+0000 7f852bc519c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:43.440 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.436+0000 7f852bc519c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:21:43.440 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.436+0000 7f852bc519c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T17:21:43.440 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.436+0000 7f852bc519c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T17:21:43.440 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.436+0000 7f852bc519c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 : miss 2024-09-12T17:21:43.440 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.436+0000 7f852bc519c0 20 rados->read ofs=0 len=0 2024-09-12T17:21:43.441 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.440+0000 7f852bc519c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T17:21:43.441 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.440+0000 7f852bc519c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 info.flags=0x17 2024-09-12T17:21:43.441 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.440+0000 7f852bc519c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 to cache LRU end 2024-09-12T17:21:43.441 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.440+0000 7f852bc519c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:21:43.441 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.440+0000 7f852bc519c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:21:43.441 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.440+0000 7f852bc519c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 2024-09-12T17:21:43.444 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.440+0000 7f852bc519c0 0 INFO: RGWReshardLock::lock found lock on abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 to be held by another RGW process; skipping for now 2024-09-12T17:21:43.445 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.444+0000 7f83df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:21:43.451 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.448+0000 7f852bc519c0 20 remove_watcher() i=0 2024-09-12T17:21:43.452 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.448+0000 7f852bc519c0 2 removed watcher, disabling cache 2024-09-12T17:21:43.454 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.452+0000 7f852bc519c0 20 remove_watcher() i=1 2024-09-12T17:21:43.456 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.456+0000 7f852bc519c0 20 remove_watcher() i=2 2024-09-12T17:21:43.459 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.456+0000 7f852bc519c0 20 remove_watcher() i=3 2024-09-12T17:21:43.461 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.460+0000 7f852bc519c0 20 remove_watcher() i=4 2024-09-12T17:21:43.463 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.460+0000 7f852bc519c0 20 remove_watcher() i=5 2024-09-12T17:21:43.464 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.464+0000 7f852bc519c0 20 remove_watcher() i=6 2024-09-12T17:21:43.467 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:21:43.464+0000 7f852bc519c0 20 remove_watcher() i=7 2024-09-12T17:21:43.491 INFO:tasks.workunit.client.0.smithi016.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:22:13.523 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:22:13.561 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:22:13.561 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:22:13.610 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.608+0000 7f63b99019c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:13.612 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.612+0000 7f63b99019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:13.612 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.612+0000 7f63b99019c0 20 realm 2024-09-12T17:22:13.612 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.612+0000 7f63b99019c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:13.613 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.612+0000 7f63b99019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:13.613 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.612+0000 7f63b99019c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:22:13.613 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.612+0000 7f63b99019c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:13.613 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.612+0000 7f63b99019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:13.613 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.612+0000 7f63b99019c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:13.614 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.612+0000 7f63b99019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:22:13.614 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.612+0000 7f63b99019c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:13.616 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.616+0000 7f63b99019c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:22:13.616 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.616+0000 7f63b99019c0 20 searching for the correct realm 2024-09-12T17:22:13.620 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.620+0000 7f63b7c08640 0 -- 172.21.15.16:0/3709072836 >> [v2:172.21.15.19:6800/1509147557,v1:172.21.15.19:6801/1509147557] conn(0x56214fe09d30 msgr2=0x56214fe0c120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:22:13.627 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.624+0000 7f63b6c06640 0 -- 172.21.15.16:0/3709072836 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f63b0043950 msgr2=0x7f63b0019430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:22:13.844 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.840+0000 7f63b99019c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:22:13.844 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.840+0000 7f63b99019c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:22:13.844 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.840+0000 7f63b99019c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:22:13.844 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.840+0000 7f63b99019c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:22:13.844 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.840+0000 7f63b99019c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:22:13.844 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.840+0000 7f63b99019c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:22:13.844 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.840+0000 7f63b99019c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:13.845 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.840+0000 7f63b99019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:13.845 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.840+0000 7f63b99019c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:13.845 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.844+0000 7f63b99019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:22:13.845 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.844+0000 7f63b99019c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:13.846 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.844+0000 7f63b99019c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:22:13.846 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.844+0000 7f63b99019c0 20 zone default found 2024-09-12T17:22:13.846 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.844+0000 7f63b99019c0 4 Realm: () 2024-09-12T17:22:13.846 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.844+0000 7f63b99019c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:22:13.846 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.844+0000 7f63b99019c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:22:13.846 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.844+0000 7f63b99019c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:22:13.846 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.844+0000 7f63b99019c0 20 zonegroup default 2024-09-12T17:22:13.846 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.844+0000 7f63b99019c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:13.847 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.844+0000 7f63b99019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:13.847 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.844+0000 7f63b99019c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:13.847 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.844+0000 7f63b99019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:13.847 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.844+0000 7f63b99019c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:13.848 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.848+0000 7f63b99019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:13.848 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.848+0000 7f63b99019c0 20 started sync module instance, tier type = 2024-09-12T17:22:13.848 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.848+0000 7f63b99019c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:22:13.871 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.868+0000 7f63b99019c0 20 add_watcher() i=0 2024-09-12T17:22:13.872 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.868+0000 7f63b99019c0 20 add_watcher() i=1 2024-09-12T17:22:13.872 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.868+0000 7f63b99019c0 20 add_watcher() i=2 2024-09-12T17:22:13.872 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.868+0000 7f63b99019c0 20 add_watcher() i=3 2024-09-12T17:22:13.872 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.868+0000 7f63b99019c0 20 add_watcher() i=4 2024-09-12T17:22:13.872 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.868+0000 7f63b99019c0 20 add_watcher() i=5 2024-09-12T17:22:13.872 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.868+0000 7f63b99019c0 20 add_watcher() i=6 2024-09-12T17:22:13.874 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.872+0000 7f63b99019c0 20 add_watcher() i=7 2024-09-12T17:22:13.874 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.872+0000 7f63b99019c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:22:13.877 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.876+0000 7f626e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:22:13.878 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.876+0000 7f63b99019c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:22:13.878 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.876+0000 7f63b99019c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:22:13.878 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.876+0000 7f63b99019c0 5 note: GC not initialized 2024-09-12T17:22:13.879 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.876+0000 7f626d7e2640 20 reqs_thread_entry: start 2024-09-12T17:22:13.879 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.876+0000 7f63b99019c0 20 init_complete bucket index max shards: 1 2024-09-12T17:22:13.879 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.876+0000 7f63b99019c0 20 Filter name: none 2024-09-12T17:22:13.879 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.876+0000 7f62667fc640 20 reqs_thread_entry: start 2024-09-12T17:22:13.879 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.876+0000 7f63b99019c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T17:22:13.879 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.876+0000 7f63b99019c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:13.880 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.876+0000 7f63b99019c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:22:13.880 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.876+0000 7f63b99019c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T17:22:13.880 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.876+0000 7f63b99019c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T17:22:13.880 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.876+0000 7f63b99019c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 : miss 2024-09-12T17:22:13.880 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.876+0000 7f63b99019c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:13.881 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.880+0000 7f63b99019c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T17:22:13.881 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.880+0000 7f63b99019c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 info.flags=0x17 2024-09-12T17:22:13.881 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.880+0000 7f63b99019c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 to cache LRU end 2024-09-12T17:22:13.881 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.880+0000 7f63b99019c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:22:13.881 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.880+0000 7f63b99019c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:22:13.881 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.880+0000 7f63b99019c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 2024-09-12T17:22:13.884 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.880+0000 7f63b99019c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:22:13.891 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.888+0000 7f63b99019c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 info.flags=0x17 2024-09-12T17:22:13.891 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.888+0000 7f63b99019c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 to cache LRU end 2024-09-12T17:22:13.891 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.888+0000 7f63b99019c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:22:13.891 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.888+0000 7f63b99019c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39, ofs0, ns] 2024-09-12T17:22:13.892 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.892+0000 7f629affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431672 cookie 94701074037664 notifier 7592 bl.length()=931 2024-09-12T17:22:13.892 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.892+0000 7f629affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 info.flags=0x17 2024-09-12T17:22:13.892 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.892+0000 7f629affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 to cache LRU end 2024-09-12T17:22:13.892 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.892+0000 7f629affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:22:13.893 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.892+0000 7f63b99019c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39]): orig_sources= new_sources= 2024-09-12T17:22:13.894 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.892+0000 7f63b99019c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39]): potential sources added=[] removed=[] 2024-09-12T17:22:13.894 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.892+0000 7f63b99019c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39]): orig_dests= new_dests= 2024-09-12T17:22:13.894 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.892+0000 7f63b99019c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39]): potential dests added=[] removed=[] 2024-09-12T17:22:13.902 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.900+0000 7f63b99019c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39.2.0 2024-09-12T17:22:13.903 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.900+0000 7f63b99019c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39.2.0 2024-09-12T17:22:13.903 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.900+0000 7f63b99019c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39.2.1 2024-09-12T17:22:13.903 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.900+0000 7f63b99019c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39.2.1 2024-09-12T17:22:13.903 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.900+0000 7f63b99019c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39.0 2024-09-12T17:22:13.907 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.904+0000 7f63b99019c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 : hit (requested=0x17, cached=0x17) 2024-09-12T17:22:13.907 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.904+0000 7f63b99019c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 2024-09-12T17:22:13.910 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.908+0000 7f63b99019c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 info.flags=0x17 2024-09-12T17:22:13.910 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.908+0000 7f63b99019c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 to cache LRU end 2024-09-12T17:22:13.910 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.908+0000 7f63b99019c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:22:13.910 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.908+0000 7f63b99019c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39, ofs0, ns] 2024-09-12T17:22:13.911 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.908+0000 7f629a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431673 cookie 94701074037664 notifier 7592 bl.length()=931 2024-09-12T17:22:13.911 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.908+0000 7f629a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 info.flags=0x17 2024-09-12T17:22:13.911 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.908+0000 7f629a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 to cache LRU end 2024-09-12T17:22:13.911 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.908+0000 7f629a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:22:13.912 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.912+0000 7f63b99019c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39]): orig_sources= new_sources= 2024-09-12T17:22:13.912 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.912+0000 7f63b99019c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39]): potential sources added=[] removed=[] 2024-09-12T17:22:13.912 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.912+0000 7f63b99019c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39]): orig_dests= new_dests= 2024-09-12T17:22:13.912 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.912+0000 7f63b99019c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39]): potential dests added=[] removed=[] 2024-09-12T17:22:13.915 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.912+0000 7f63b99019c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39.0 2024-09-12T17:22:13.916 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.916+0000 7f63b99019c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 : hit (requested=0x17, cached=0x17) 2024-09-12T17:22:13.916 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.916+0000 7f63b99019c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 2024-09-12T17:22:13.919 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.916+0000 7f63b99019c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 info.flags=0x17 2024-09-12T17:22:13.919 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.916+0000 7f63b99019c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 to cache LRU end 2024-09-12T17:22:13.919 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.916+0000 7f63b99019c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:22:13.919 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.916+0000 7f63b99019c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39, ofs0, ns] 2024-09-12T17:22:13.920 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.920+0000 7f629affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431674 cookie 94701074037664 notifier 7592 bl.length()=899 2024-09-12T17:22:13.920 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.920+0000 7f629affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 info.flags=0x17 2024-09-12T17:22:13.920 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.920+0000 7f629affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 to cache LRU end 2024-09-12T17:22:13.920 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.920+0000 7f629affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:22:13.921 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.920+0000 7f63b99019c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39]): orig_sources= new_sources= 2024-09-12T17:22:13.921 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.920+0000 7f63b99019c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39]): potential sources added=[] removed=[] 2024-09-12T17:22:13.921 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.920+0000 7f63b99019c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39]): orig_dests= new_dests= 2024-09-12T17:22:13.921 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.920+0000 7f63b99019c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39]): potential dests added=[] removed=[] 2024-09-12T17:22:13.924 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.924+0000 7f63b99019c0 1 execute INFO: reshard of bucket "abort-at-change-reshard-state" from 1 shards to 2 shards completed successfully 2024-09-12T17:22:13.929 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.928+0000 7f626e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:22:13.934 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.932+0000 7f63b99019c0 20 remove_watcher() i=0 2024-09-12T17:22:13.934 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.932+0000 7f63b99019c0 2 removed watcher, disabling cache 2024-09-12T17:22:13.937 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.936+0000 7f63b99019c0 20 remove_watcher() i=1 2024-09-12T17:22:13.939 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.936+0000 7f63b99019c0 20 remove_watcher() i=2 2024-09-12T17:22:13.941 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.940+0000 7f63b99019c0 20 remove_watcher() i=3 2024-09-12T17:22:13.944 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.940+0000 7f63b99019c0 20 remove_watcher() i=4 2024-09-12T17:22:13.946 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.944+0000 7f63b99019c0 20 remove_watcher() i=5 2024-09-12T17:22:13.947 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.944+0000 7f63b99019c0 20 remove_watcher() i=6 2024-09-12T17:22:13.949 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:13.948+0000 7f63b99019c0 20 remove_watcher() i=7 2024-09-12T17:22:13.968 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T17:22:14.001 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:22:14.001 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:22:14.048 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.044+0000 7fa2901c49c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:14.050 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.048+0000 7fa2901c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:14.050 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.048+0000 7fa2901c49c0 20 realm 2024-09-12T17:22:14.050 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.048+0000 7fa2901c49c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:14.050 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.048+0000 7fa2901c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:14.050 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.048+0000 7fa2901c49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:22:14.050 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.048+0000 7fa2901c49c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:14.050 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.048+0000 7fa2901c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:14.050 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.048+0000 7fa2901c49c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:14.052 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.048+0000 7fa2901c49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:22:14.052 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.048+0000 7fa2901c49c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:14.054 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.052+0000 7fa2901c49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:22:14.054 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.052+0000 7fa2901c49c0 20 searching for the correct realm 2024-09-12T17:22:14.057 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.056+0000 7fa28e4cb640 0 -- 172.21.15.16:0/1936729634 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fa28407ec20 msgr2=0x7fa284062cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:22:14.065 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.064+0000 7fa28d4c9640 0 -- 172.21.15.16:0/1936729634 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fa288119400 msgr2=0x7fa288001980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:22:14.283 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.280+0000 7fa2901c49c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:22:14.284 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.280+0000 7fa2901c49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:22:14.284 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.280+0000 7fa2901c49c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:22:14.284 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.280+0000 7fa2901c49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:22:14.284 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.280+0000 7fa2901c49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:22:14.284 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.280+0000 7fa2901c49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:22:14.284 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.280+0000 7fa2901c49c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:14.284 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.280+0000 7fa2901c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:14.284 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.280+0000 7fa2901c49c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:14.285 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.284+0000 7fa2901c49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:22:14.285 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.284+0000 7fa2901c49c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:14.286 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.284+0000 7fa2901c49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:22:14.286 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.284+0000 7fa2901c49c0 20 zone default found 2024-09-12T17:22:14.286 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.284+0000 7fa2901c49c0 4 Realm: () 2024-09-12T17:22:14.286 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.284+0000 7fa2901c49c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:22:14.286 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.284+0000 7fa2901c49c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:22:14.286 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.284+0000 7fa2901c49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:22:14.286 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.284+0000 7fa2901c49c0 20 zonegroup default 2024-09-12T17:22:14.286 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.284+0000 7fa2901c49c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:14.287 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.284+0000 7fa2901c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:14.287 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.284+0000 7fa2901c49c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:14.288 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.284+0000 7fa2901c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:14.288 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.284+0000 7fa2901c49c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:14.288 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.288+0000 7fa2901c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:14.289 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.288+0000 7fa2901c49c0 20 started sync module instance, tier type = 2024-09-12T17:22:14.289 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.288+0000 7fa2901c49c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:22:14.313 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.312+0000 7fa2901c49c0 20 add_watcher() i=0 2024-09-12T17:22:14.313 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.312+0000 7fa2901c49c0 20 add_watcher() i=1 2024-09-12T17:22:14.313 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.312+0000 7fa2901c49c0 20 add_watcher() i=2 2024-09-12T17:22:14.313 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.312+0000 7fa2901c49c0 20 add_watcher() i=3 2024-09-12T17:22:14.313 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.312+0000 7fa2901c49c0 20 add_watcher() i=4 2024-09-12T17:22:14.313 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.312+0000 7fa2901c49c0 20 add_watcher() i=5 2024-09-12T17:22:14.313 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.312+0000 7fa2901c49c0 20 add_watcher() i=6 2024-09-12T17:22:14.315 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.312+0000 7fa2901c49c0 20 add_watcher() i=7 2024-09-12T17:22:14.315 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.312+0000 7fa2901c49c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:22:14.319 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.316+0000 7fa13f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:22:14.320 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.320+0000 7fa2901c49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:22:14.320 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.320+0000 7fa2901c49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:22:14.320 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.320+0000 7fa2901c49c0 5 note: GC not initialized 2024-09-12T17:22:14.321 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.320+0000 7fa13e7fc640 20 reqs_thread_entry: start 2024-09-12T17:22:14.321 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.320+0000 7fa2901c49c0 20 init_complete bucket index max shards: 1 2024-09-12T17:22:14.321 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.320+0000 7fa2901c49c0 20 Filter name: none 2024-09-12T17:22:14.321 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.320+0000 7fa0affff640 20 reqs_thread_entry: start 2024-09-12T17:22:14.322 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.320+0000 7fa2901c49c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:14.322 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.320+0000 7fa2901c49c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:22:14.322 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.320+0000 7fa2901c49c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:14.324 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.320+0000 7fa2901c49c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:22:14.324 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.320+0000 7fa2901c49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:22:14.324 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.320+0000 7fa2901c49c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:14.324 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.324+0000 7fa2901c49c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:22:14.324 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.324+0000 7fa2901c49c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:14.325 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.324+0000 7fa2901c49c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:22:14.325 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.324+0000 7fa2901c49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:22:14.328 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.328+0000 7fa13f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:22:14.333 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.332+0000 7fa2901c49c0 20 remove_watcher() i=0 2024-09-12T17:22:14.333 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.332+0000 7fa2901c49c0 2 removed watcher, disabling cache 2024-09-12T17:22:14.336 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.332+0000 7fa2901c49c0 20 remove_watcher() i=1 2024-09-12T17:22:14.338 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.336+0000 7fa2901c49c0 20 remove_watcher() i=2 2024-09-12T17:22:14.340 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.340+0000 7fa2901c49c0 20 remove_watcher() i=3 2024-09-12T17:22:14.343 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.340+0000 7fa2901c49c0 20 remove_watcher() i=4 2024-09-12T17:22:14.345 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.344+0000 7fa2901c49c0 20 remove_watcher() i=5 2024-09-12T17:22:14.347 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.344+0000 7fa2901c49c0 20 remove_watcher() i=6 2024-09-12T17:22:14.349 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.348+0000 7fa2901c49c0 20 remove_watcher() i=7 2024-09-12T17:22:14.366 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:14.366 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:22:14.366 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: abort-at-change-reshard-state id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T17:22:14.367 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:14.449 INFO:tasks.workunit.client.0.smithi016.stderr: test: logrecord could be stopped after reshard failed 2024-09-12T17:22:14.449 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:22:14.482 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:22:14.482 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:22:14.529 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.528+0000 7f60befc89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:14.530 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.528+0000 7f60befc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:14.531 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.528+0000 7f60befc89c0 20 realm 2024-09-12T17:22:14.531 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.528+0000 7f60befc89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:14.531 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.528+0000 7f60befc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:14.531 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.528+0000 7f60befc89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:22:14.531 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.528+0000 7f60befc89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:14.531 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.528+0000 7f60befc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:14.531 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.528+0000 7f60befc89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:14.533 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.532+0000 7f60befc89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:22:14.533 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.532+0000 7f60befc89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:14.534 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.532+0000 7f60befc89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:22:14.534 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.532+0000 7f60befc89c0 20 searching for the correct realm 2024-09-12T17:22:14.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.536+0000 7f60bd2cf640 0 -- 172.21.15.16:0/1347871204 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f60b0072610 msgr2=0x7f60b008aa60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:22:14.545 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.544+0000 7f60bc2cd640 0 -- 172.21.15.16:0/1347871204 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f60b406c840 msgr2=0x7f60b40287a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:22:14.763 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.760+0000 7f60befc89c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:22:14.763 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.760+0000 7f60befc89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:22:14.763 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.760+0000 7f60befc89c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:22:14.763 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.760+0000 7f60befc89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:22:14.763 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.760+0000 7f60befc89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:22:14.763 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.760+0000 7f60befc89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:22:14.763 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.760+0000 7f60befc89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:14.764 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.760+0000 7f60befc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:14.764 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.760+0000 7f60befc89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:14.764 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.764+0000 7f60befc89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:22:14.764 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.764+0000 7f60befc89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:14.765 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.764+0000 7f60befc89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:22:14.765 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.764+0000 7f60befc89c0 20 zone default found 2024-09-12T17:22:14.765 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.764+0000 7f60befc89c0 4 Realm: () 2024-09-12T17:22:14.766 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.764+0000 7f60befc89c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:22:14.766 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.764+0000 7f60befc89c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:22:14.766 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.764+0000 7f60befc89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:22:14.766 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.764+0000 7f60befc89c0 20 zonegroup default 2024-09-12T17:22:14.766 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.764+0000 7f60befc89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:14.766 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.764+0000 7f60befc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:14.766 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.764+0000 7f60befc89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:14.767 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.764+0000 7f60befc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:14.767 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.764+0000 7f60befc89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:14.767 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.764+0000 7f60befc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:14.768 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.764+0000 7f60befc89c0 20 started sync module instance, tier type = 2024-09-12T17:22:14.768 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.764+0000 7f60befc89c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:22:14.793 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.792+0000 7f60befc89c0 20 add_watcher() i=0 2024-09-12T17:22:14.793 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.792+0000 7f60befc89c0 20 add_watcher() i=1 2024-09-12T17:22:14.793 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.792+0000 7f60befc89c0 20 add_watcher() i=2 2024-09-12T17:22:14.793 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.792+0000 7f60befc89c0 20 add_watcher() i=3 2024-09-12T17:22:14.793 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.792+0000 7f60befc89c0 20 add_watcher() i=4 2024-09-12T17:22:14.793 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.792+0000 7f60befc89c0 20 add_watcher() i=5 2024-09-12T17:22:14.794 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.792+0000 7f60befc89c0 20 add_watcher() i=6 2024-09-12T17:22:14.795 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.792+0000 7f60befc89c0 20 add_watcher() i=7 2024-09-12T17:22:14.795 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.792+0000 7f60befc89c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:22:14.799 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.796+0000 7f5f737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:22:14.800 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.796+0000 7f60befc89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:22:14.800 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.796+0000 7f60befc89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:22:14.800 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.796+0000 7f60befc89c0 5 note: GC not initialized 2024-09-12T17:22:14.801 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.800+0000 7f5f727e4640 20 reqs_thread_entry: start 2024-09-12T17:22:14.801 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.800+0000 7f60befc89c0 20 init_complete bucket index max shards: 1 2024-09-12T17:22:14.801 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.800+0000 7f60befc89c0 20 Filter name: none 2024-09-12T17:22:14.801 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.800+0000 7f5f6b7fe640 20 reqs_thread_entry: start 2024-09-12T17:22:14.801 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.800+0000 7f60befc89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:14.802 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.800+0000 7f60befc89c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:22:14.802 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.800+0000 7f60befc89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:14.803 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.800+0000 7f60befc89c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:22:14.803 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.800+0000 7f60befc89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:22:14.804 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.800+0000 7f60befc89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:14.804 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.804+0000 7f60befc89c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:22:14.804 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.804+0000 7f60befc89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:14.805 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.804+0000 7f60befc89c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:22:14.805 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.804+0000 7f60befc89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:22:14.808 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.804+0000 7f5f737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:22:14.813 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.812+0000 7f60befc89c0 20 remove_watcher() i=0 2024-09-12T17:22:14.813 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.812+0000 7f60befc89c0 2 removed watcher, disabling cache 2024-09-12T17:22:14.815 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.812+0000 7f60befc89c0 20 remove_watcher() i=1 2024-09-12T17:22:14.817 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.816+0000 7f60befc89c0 20 remove_watcher() i=2 2024-09-12T17:22:14.819 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.816+0000 7f60befc89c0 20 remove_watcher() i=3 2024-09-12T17:22:14.822 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.820+0000 7f60befc89c0 20 remove_watcher() i=4 2024-09-12T17:22:14.824 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.820+0000 7f60befc89c0 20 remove_watcher() i=5 2024-09-12T17:22:14.825 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.824+0000 7f60befc89c0 20 remove_watcher() i=6 2024-09-12T17:22:14.827 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.824+0000 7f60befc89c0 20 remove_watcher() i=7 2024-09-12T17:22:14.847 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:14.847 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:22:14.847 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: a-bucket id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 num_objects: 8 size_kb: 1 num_shards: 3 2024-09-12T17:22:14.847 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:14.848 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:22:14.874 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:22:14.874 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:22:14.921 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.920+0000 7f38bf4b39c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:14.924 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.920+0000 7f38bf4b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:14.924 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.920+0000 7f38bf4b39c0 20 realm 2024-09-12T17:22:14.924 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.920+0000 7f38bf4b39c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:14.924 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.920+0000 7f38bf4b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:14.924 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.920+0000 7f38bf4b39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:22:14.924 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.920+0000 7f38bf4b39c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:14.924 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.920+0000 7f38bf4b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:14.924 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.920+0000 7f38bf4b39c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:14.925 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.924+0000 7f38bf4b39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:22:14.925 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.924+0000 7f38bf4b39c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:14.927 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.924+0000 7f38bf4b39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:22:14.927 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.924+0000 7f38bf4b39c0 20 searching for the correct realm 2024-09-12T17:22:14.930 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.928+0000 7f38bd7ba640 0 -- 172.21.15.16:0/81841941 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f38b0008070 msgr2=0x7f38b006fef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:22:14.937 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:14.936+0000 7f38bc7b8640 0 -- 172.21.15.16:0/81841941 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f38b4078a30 msgr2=0x7f38b402d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:22:15.156 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.152+0000 7f38bf4b39c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:22:15.156 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.152+0000 7f38bf4b39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:22:15.156 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.152+0000 7f38bf4b39c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:22:15.156 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.152+0000 7f38bf4b39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:22:15.156 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.152+0000 7f38bf4b39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:22:15.156 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.152+0000 7f38bf4b39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:22:15.156 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.152+0000 7f38bf4b39c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.157 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.156+0000 7f38bf4b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:15.157 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.156+0000 7f38bf4b39c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.157 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.156+0000 7f38bf4b39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:22:15.157 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.156+0000 7f38bf4b39c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.158 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.156+0000 7f38bf4b39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:22:15.158 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.156+0000 7f38bf4b39c0 20 zone default found 2024-09-12T17:22:15.158 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.156+0000 7f38bf4b39c0 4 Realm: () 2024-09-12T17:22:15.159 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.156+0000 7f38bf4b39c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:22:15.159 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.156+0000 7f38bf4b39c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:22:15.159 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.156+0000 7f38bf4b39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:22:15.159 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.156+0000 7f38bf4b39c0 20 zonegroup default 2024-09-12T17:22:15.159 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.156+0000 7f38bf4b39c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.159 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.156+0000 7f38bf4b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:15.159 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.156+0000 7f38bf4b39c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.160 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.156+0000 7f38bf4b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:15.160 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.156+0000 7f38bf4b39c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.161 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.160+0000 7f38bf4b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:15.161 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.160+0000 7f38bf4b39c0 20 started sync module instance, tier type = 2024-09-12T17:22:15.161 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.160+0000 7f38bf4b39c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:22:15.183 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.180+0000 7f38bf4b39c0 20 add_watcher() i=0 2024-09-12T17:22:15.183 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.180+0000 7f38bf4b39c0 20 add_watcher() i=1 2024-09-12T17:22:15.183 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.180+0000 7f38bf4b39c0 20 add_watcher() i=2 2024-09-12T17:22:15.183 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.180+0000 7f38bf4b39c0 20 add_watcher() i=3 2024-09-12T17:22:15.183 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.180+0000 7f38bf4b39c0 20 add_watcher() i=4 2024-09-12T17:22:15.183 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.180+0000 7f38bf4b39c0 20 add_watcher() i=5 2024-09-12T17:22:15.183 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.180+0000 7f38bf4b39c0 20 add_watcher() i=6 2024-09-12T17:22:15.184 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.184+0000 7f38bf4b39c0 20 add_watcher() i=7 2024-09-12T17:22:15.185 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.184+0000 7f38bf4b39c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:22:15.188 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.184+0000 7f3772fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:22:15.189 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.188+0000 7f38bf4b39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:22:15.189 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.188+0000 7f38bf4b39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:22:15.189 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.188+0000 7f38bf4b39c0 5 note: GC not initialized 2024-09-12T17:22:15.189 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.188+0000 7f3771fe3640 20 reqs_thread_entry: start 2024-09-12T17:22:15.190 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.188+0000 7f38bf4b39c0 20 init_complete bucket index max shards: 1 2024-09-12T17:22:15.190 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.188+0000 7f38bf4b39c0 20 Filter name: none 2024-09-12T17:22:15.190 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.188+0000 7f36e37fe640 20 reqs_thread_entry: start 2024-09-12T17:22:15.191 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.188+0000 7f38bf4b39c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.192 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.188+0000 7f38bf4b39c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:22:15.192 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.188+0000 7f38bf4b39c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.193 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.192+0000 7f38bf4b39c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:22:15.193 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.192+0000 7f38bf4b39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:22:15.193 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.192+0000 7f38bf4b39c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.194 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.192+0000 7f38bf4b39c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:22:15.194 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.192+0000 7f38bf4b39c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.195 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.192+0000 7f38bf4b39c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:22:15.195 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.192+0000 7f38bf4b39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:22:15.198 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.196+0000 7f3772fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:22:15.203 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.200+0000 7f38bf4b39c0 20 remove_watcher() i=0 2024-09-12T17:22:15.203 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.200+0000 7f38bf4b39c0 2 removed watcher, disabling cache 2024-09-12T17:22:15.205 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.204+0000 7f38bf4b39c0 20 remove_watcher() i=1 2024-09-12T17:22:15.208 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.204+0000 7f38bf4b39c0 20 remove_watcher() i=2 2024-09-12T17:22:15.210 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.208+0000 7f38bf4b39c0 20 remove_watcher() i=3 2024-09-12T17:22:15.212 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.208+0000 7f38bf4b39c0 20 remove_watcher() i=4 2024-09-12T17:22:15.213 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.212+0000 7f38bf4b39c0 20 remove_watcher() i=5 2024-09-12T17:22:15.215 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.212+0000 7f38bf4b39c0 20 remove_watcher() i=6 2024-09-12T17:22:15.216 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.216+0000 7f38bf4b39c0 20 remove_watcher() i=7 2024-09-12T17:22:15.234 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T17:22:15.272 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:22:15.273 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:22:15.319 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.316+0000 7f1cf45299c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.321 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.320+0000 7f1cf45299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:15.321 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.320+0000 7f1cf45299c0 20 realm 2024-09-12T17:22:15.321 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.320+0000 7f1cf45299c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.321 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.320+0000 7f1cf45299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:15.322 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.320+0000 7f1cf45299c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:22:15.322 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.320+0000 7f1cf45299c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.322 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.320+0000 7f1cf45299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:15.322 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.320+0000 7f1cf45299c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.323 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.320+0000 7f1cf45299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:22:15.323 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.320+0000 7f1cf45299c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.325 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.324+0000 7f1cf45299c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:22:15.325 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.324+0000 7f1cf45299c0 20 searching for the correct realm 2024-09-12T17:22:15.330 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.328+0000 7f1cf182e640 0 -- 172.21.15.16:0/4136550951 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7f1ce40d1910 msgr2=0x7f1ce40c4400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:22:15.336 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.332+0000 7f1cf182e640 0 -- 172.21.15.16:0/4136550951 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f1cec015030 msgr2=0x7f1cec05d460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:22:15.551 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.548+0000 7f1cf45299c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:22:15.551 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.548+0000 7f1cf45299c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:22:15.552 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.548+0000 7f1cf45299c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:22:15.552 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.548+0000 7f1cf45299c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:22:15.552 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.548+0000 7f1cf45299c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:22:15.552 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.548+0000 7f1cf45299c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:22:15.552 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.548+0000 7f1cf45299c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.552 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.548+0000 7f1cf45299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:15.552 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.548+0000 7f1cf45299c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.553 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.552+0000 7f1cf45299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:22:15.553 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.552+0000 7f1cf45299c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.554 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.552+0000 7f1cf45299c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:22:15.554 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.552+0000 7f1cf45299c0 20 zone default found 2024-09-12T17:22:15.554 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.552+0000 7f1cf45299c0 4 Realm: () 2024-09-12T17:22:15.554 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.552+0000 7f1cf45299c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:22:15.554 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.552+0000 7f1cf45299c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:22:15.554 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.552+0000 7f1cf45299c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:22:15.554 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.552+0000 7f1cf45299c0 20 zonegroup default 2024-09-12T17:22:15.554 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.552+0000 7f1cf45299c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.555 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.552+0000 7f1cf45299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:15.555 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.552+0000 7f1cf45299c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.555 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.552+0000 7f1cf45299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:15.556 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.552+0000 7f1cf45299c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.556 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.552+0000 7f1cf45299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:15.556 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.552+0000 7f1cf45299c0 20 started sync module instance, tier type = 2024-09-12T17:22:15.556 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.552+0000 7f1cf45299c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:22:15.579 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.576+0000 7f1cf45299c0 20 add_watcher() i=0 2024-09-12T17:22:15.579 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.576+0000 7f1cf45299c0 20 add_watcher() i=1 2024-09-12T17:22:15.579 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.576+0000 7f1cf45299c0 20 add_watcher() i=2 2024-09-12T17:22:15.579 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.576+0000 7f1cf45299c0 20 add_watcher() i=3 2024-09-12T17:22:15.579 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.576+0000 7f1cf45299c0 20 add_watcher() i=4 2024-09-12T17:22:15.579 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.576+0000 7f1cf45299c0 20 add_watcher() i=5 2024-09-12T17:22:15.579 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.576+0000 7f1cf45299c0 20 add_watcher() i=6 2024-09-12T17:22:15.581 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.580+0000 7f1cf45299c0 20 add_watcher() i=7 2024-09-12T17:22:15.581 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.580+0000 7f1cf45299c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:22:15.585 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.584+0000 7f1ba8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:22:15.586 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.584+0000 7f1cf45299c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:22:15.586 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.584+0000 7f1cf45299c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:22:15.586 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 note: GC not initialized 2024-09-12T17:22:15.587 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.584+0000 7f1b237fe640 20 reqs_thread_entry: start 2024-09-12T17:22:15.587 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.584+0000 7f1cf45299c0 20 init_complete bucket index max shards: 1 2024-09-12T17:22:15.587 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.584+0000 7f1cf45299c0 20 Filter name: none 2024-09-12T17:22:15.587 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.584+0000 7f1b217fa640 20 reqs_thread_entry: start 2024-09-12T17:22:15.587 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.584+0000 7f1cf45299c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:22:15.587 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.584+0000 7f1cf45299c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.588+0000 7f1cf45299c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:22:15.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.588+0000 7f1cf45299c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:22:15.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.588+0000 7f1cf45299c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:22:15.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.588+0000 7f1cf45299c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 : miss 2024-09-12T17:22:15.589 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.588+0000 7f1cf45299c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.589 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.588+0000 7f1cf45299c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:22:15.589 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.588+0000 7f1cf45299c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:22:15.589 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.588+0000 7f1cf45299c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:22:15.589 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.588+0000 7f1cf45299c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:22:15.589 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.588+0000 7f1cf45299c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:22:15.589 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.588+0000 7f1cf45299c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 2024-09-12T17:22:15.596 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.596+0000 7f1cf45299c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:22:15.596 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.596+0000 7f1cf45299c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:22:15.597 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.596+0000 7f1cf45299c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:22:15.597 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.596+0000 7f1cf45299c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17, ofs0, ns] 2024-09-12T17:22:15.597 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.596+0000 7f1bd5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431627 cookie 94793561161536 notifier 8052 bl.length()=827 2024-09-12T17:22:15.597 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.596+0000 7f1bd5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:22:15.597 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.596+0000 7f1bd5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:22:15.597 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.596+0000 7f1bd5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:22:15.599 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.596+0000 7f1cf45299c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): orig_sources= new_sources= 2024-09-12T17:22:15.599 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.596+0000 7f1cf45299c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): potential sources added=[] removed=[] 2024-09-12T17:22:15.599 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.596+0000 7f1cf45299c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): orig_dests= new_dests= 2024-09-12T17:22:15.599 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.596+0000 7f1cf45299c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): potential dests added=[] removed=[] 2024-09-12T17:22:15.605 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.604+0000 7f1cf45299c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.3.0 2024-09-12T17:22:15.605 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.604+0000 7f1cf45299c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.3.0 2024-09-12T17:22:15.605 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.604+0000 7f1cf45299c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.3.1 2024-09-12T17:22:15.605 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.604+0000 7f1cf45299c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.3.1 2024-09-12T17:22:15.605 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.604+0000 7f1cf45299c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.3.2 2024-09-12T17:22:15.605 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.604+0000 7f1cf45299c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.3.2 2024-09-12T17:22:15.605 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.604+0000 7f1cf45299c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.3.3 2024-09-12T17:22:15.605 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.604+0000 7f1cf45299c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.3.3 2024-09-12T17:22:15.605 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.604+0000 7f1cf45299c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.0 2024-09-12T17:22:15.606 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.604+0000 7f1cf45299c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.0 2024-09-12T17:22:15.606 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.604+0000 7f1cf45299c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.1 2024-09-12T17:22:15.606 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.604+0000 7f1cf45299c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.1 2024-09-12T17:22:15.606 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.604+0000 7f1cf45299c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.2 2024-09-12T17:22:15.606 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.604+0000 7f1cf45299c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.2 2024-09-12T17:22:15.610 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1cf45299c0 time 2024-09-12T17:22:15.612619+0000 2024-09-12T17:22:15.610 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:22:15.611 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:22:15.611 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f1cf7e032eb] 2024-09-12T17:22:15.611 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1cf7e0349f] 2024-09-12T17:22:15.611 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5636d69820c1] 2024-09-12T17:22:15.611 INFO:tasks.workunit.client.0.smithi016.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5636d69934f1] 2024-09-12T17:22:15.611 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5636d6994b44] 2024-09-12T17:22:15.611 INFO:tasks.workunit.client.0.smithi016.stderr: 6: main() 2024-09-12T17:22:15.612 INFO:tasks.workunit.client.0.smithi016.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1cf6c69d90] 2024-09-12T17:22:15.612 INFO:tasks.workunit.client.0.smithi016.stderr: 8: __libc_start_main() 2024-09-12T17:22:15.612 INFO:tasks.workunit.client.0.smithi016.stderr: 9: _start() 2024-09-12T17:22:15.612 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.608+0000 7f1cf45299c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1cf45299c0 time 2024-09-12T17:22:15.612619+0000 2024-09-12T17:22:15.612 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:22:15.612 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:15.612 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:22:15.612 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f1cf7e032eb] 2024-09-12T17:22:15.612 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1cf7e0349f] 2024-09-12T17:22:15.612 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5636d69820c1] 2024-09-12T17:22:15.612 INFO:tasks.workunit.client.0.smithi016.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5636d69934f1] 2024-09-12T17:22:15.613 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5636d6994b44] 2024-09-12T17:22:15.613 INFO:tasks.workunit.client.0.smithi016.stderr: 6: main() 2024-09-12T17:22:15.613 INFO:tasks.workunit.client.0.smithi016.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1cf6c69d90] 2024-09-12T17:22:15.613 INFO:tasks.workunit.client.0.smithi016.stderr: 8: __libc_start_main() 2024-09-12T17:22:15.613 INFO:tasks.workunit.client.0.smithi016.stderr: 9: _start() 2024-09-12T17:22:15.613 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:15.613 INFO:tasks.workunit.client.0.smithi016.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:22:15.613 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7f1cf45299c0 thread_name:radosgw-admin 2024-09-12T17:22:15.627 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:22:15.627 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1cf6c82520] 2024-09-12T17:22:15.627 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:22:15.627 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:22:15.627 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:22:15.627 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1cf7e03345] 2024-09-12T17:22:15.627 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1cf7e0349f] 2024-09-12T17:22:15.627 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5636d69820c1] 2024-09-12T17:22:15.628 INFO:tasks.workunit.client.0.smithi016.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5636d69934f1] 2024-09-12T17:22:15.628 INFO:tasks.workunit.client.0.smithi016.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5636d6994b44] 2024-09-12T17:22:15.628 INFO:tasks.workunit.client.0.smithi016.stderr: 10: main() 2024-09-12T17:22:15.628 INFO:tasks.workunit.client.0.smithi016.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1cf6c69d90] 2024-09-12T17:22:15.628 INFO:tasks.workunit.client.0.smithi016.stderr: 12: __libc_start_main() 2024-09-12T17:22:15.628 INFO:tasks.workunit.client.0.smithi016.stderr: 13: _start() 2024-09-12T17:22:15.628 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.612+0000 7f1cf45299c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:22:15.628 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7f1cf45299c0 thread_name:radosgw-admin 2024-09-12T17:22:15.628 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:15.628 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:22:15.628 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1cf6c82520] 2024-09-12T17:22:15.628 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:22:15.628 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:22:15.629 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:22:15.629 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1cf7e03345] 2024-09-12T17:22:15.629 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1cf7e0349f] 2024-09-12T17:22:15.629 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5636d69820c1] 2024-09-12T17:22:15.629 INFO:tasks.workunit.client.0.smithi016.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5636d69934f1] 2024-09-12T17:22:15.629 INFO:tasks.workunit.client.0.smithi016.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5636d6994b44] 2024-09-12T17:22:15.629 INFO:tasks.workunit.client.0.smithi016.stderr: 10: main() 2024-09-12T17:22:15.629 INFO:tasks.workunit.client.0.smithi016.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1cf6c69d90] 2024-09-12T17:22:15.629 INFO:tasks.workunit.client.0.smithi016.stderr: 12: __libc_start_main() 2024-09-12T17:22:15.629 INFO:tasks.workunit.client.0.smithi016.stderr: 13: _start() 2024-09-12T17:22:15.629 INFO:tasks.workunit.client.0.smithi016.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:22:15.629 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:15.629 INFO:tasks.workunit.client.0.smithi016.stderr:--- begin dump of recent events --- 2024-09-12T17:22:15.629 INFO:tasks.workunit.client.0.smithi016.stderr: -499> 2024-09-12T17:22:15.292+0000 7f1be0608640 10 monclient: _check_auth_tickets 2024-09-12T17:22:15.630 INFO:tasks.workunit.client.0.smithi016.stderr: -498> 2024-09-12T17:22:15.292+0000 7f1cf45299c0 5 monclient: authenticate success, global_id 7649 2024-09-12T17:22:15.630 INFO:tasks.workunit.client.0.smithi016.stderr: -497> 2024-09-12T17:22:15.292+0000 7f1be0608640 10 monclient: handle_config config(0 keys) 2024-09-12T17:22:15.630 INFO:tasks.workunit.client.0.smithi016.stderr: -496> 2024-09-12T17:22:15.292+0000 7f1cf45299c0 10 monclient: get_monmap_and_config success 2024-09-12T17:22:15.630 INFO:tasks.workunit.client.0.smithi016.stderr: -495> 2024-09-12T17:22:15.292+0000 7f1cf45299c0 4 set_mon_vals no callback set 2024-09-12T17:22:15.630 INFO:tasks.workunit.client.0.smithi016.stderr: -494> 2024-09-12T17:22:15.292+0000 7f1be0608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:22:15.630 INFO:tasks.workunit.client.0.smithi016.stderr: -493> 2024-09-12T17:22:15.292+0000 7f1be0608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:22:15.630 INFO:tasks.workunit.client.0.smithi016.stderr: -492> 2024-09-12T17:22:15.292+0000 7f1be0608640 10 monclient: dump: 2024-09-12T17:22:15.630 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:22:15.630 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:22:15.630 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:15.630 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:15.630 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:22:15.630 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:15.630 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:22:15.631 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:22:15.631 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:22:15.631 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:15.631 INFO:tasks.workunit.client.0.smithi016.stderr: -491> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 10 monclient: shutdown 2024-09-12T17:22:15.631 INFO:tasks.workunit.client.0.smithi016.stderr: -490> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 asok(0x5636d85982b0) unregister_commands rotate-key 2024-09-12T17:22:15.631 INFO:tasks.workunit.client.0.smithi016.stderr: -489> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 10 monclient: build_initial_monmap 2024-09-12T17:22:15.631 INFO:tasks.workunit.client.0.smithi016.stderr: -488> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 1 build_initial for_mkfs: 0 2024-09-12T17:22:15.631 INFO:tasks.workunit.client.0.smithi016.stderr: -487> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 10 monclient: monmap: 2024-09-12T17:22:15.631 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:22:15.631 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:22:15.631 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:22:15.631 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:22:15.631 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:22:15.631 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:15.631 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:22:15.632 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:22:15.632 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:22:15.632 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:15.632 INFO:tasks.workunit.client.0.smithi016.stderr: -486> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87aa520) adding auth protocol: cephx 2024-09-12T17:22:15.632 INFO:tasks.workunit.client.0.smithi016.stderr: -485> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87aa520) adding auth protocol: cephx 2024-09-12T17:22:15.632 INFO:tasks.workunit.client.0.smithi016.stderr: -484> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87aa520) adding auth protocol: cephx 2024-09-12T17:22:15.632 INFO:tasks.workunit.client.0.smithi016.stderr: -483> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87aa520) adding con mode: secure 2024-09-12T17:22:15.632 INFO:tasks.workunit.client.0.smithi016.stderr: -482> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87aa520) adding con mode: crc 2024-09-12T17:22:15.632 INFO:tasks.workunit.client.0.smithi016.stderr: -481> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87aa520) adding con mode: secure 2024-09-12T17:22:15.632 INFO:tasks.workunit.client.0.smithi016.stderr: -480> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87aa520) adding con mode: crc 2024-09-12T17:22:15.632 INFO:tasks.workunit.client.0.smithi016.stderr: -479> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87aa520) adding con mode: secure 2024-09-12T17:22:15.632 INFO:tasks.workunit.client.0.smithi016.stderr: -478> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87aa520) adding con mode: crc 2024-09-12T17:22:15.632 INFO:tasks.workunit.client.0.smithi016.stderr: -477> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87aa520) adding con mode: crc 2024-09-12T17:22:15.633 INFO:tasks.workunit.client.0.smithi016.stderr: -476> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87aa520) adding con mode: secure 2024-09-12T17:22:15.633 INFO:tasks.workunit.client.0.smithi016.stderr: -475> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87aa520) adding con mode: crc 2024-09-12T17:22:15.633 INFO:tasks.workunit.client.0.smithi016.stderr: -474> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87aa520) adding con mode: secure 2024-09-12T17:22:15.633 INFO:tasks.workunit.client.0.smithi016.stderr: -473> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87aa520) adding con mode: crc 2024-09-12T17:22:15.633 INFO:tasks.workunit.client.0.smithi016.stderr: -472> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87aa520) adding con mode: secure 2024-09-12T17:22:15.633 INFO:tasks.workunit.client.0.smithi016.stderr: -471> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:15.633 INFO:tasks.workunit.client.0.smithi016.stderr: -470> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 1 librados: starting msgr at 2024-09-12T17:22:15.633 INFO:tasks.workunit.client.0.smithi016.stderr: -469> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 1 librados: starting objecter 2024-09-12T17:22:15.633 INFO:tasks.workunit.client.0.smithi016.stderr: -468> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 asok(0x5636d85982b0) register_command objecter_requests hook 0x5636d87a66d0 2024-09-12T17:22:15.633 INFO:tasks.workunit.client.0.smithi016.stderr: -467> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 1 librados: setting wanted keys 2024-09-12T17:22:15.633 INFO:tasks.workunit.client.0.smithi016.stderr: -466> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 1 librados: calling monclient init 2024-09-12T17:22:15.633 INFO:tasks.workunit.client.0.smithi016.stderr: -465> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 10 monclient: init 2024-09-12T17:22:15.633 INFO:tasks.workunit.client.0.smithi016.stderr: -464> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87a4d00) adding auth protocol: cephx 2024-09-12T17:22:15.634 INFO:tasks.workunit.client.0.smithi016.stderr: -463> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87a4d00) adding auth protocol: cephx 2024-09-12T17:22:15.634 INFO:tasks.workunit.client.0.smithi016.stderr: -462> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87a4d00) adding auth protocol: cephx 2024-09-12T17:22:15.634 INFO:tasks.workunit.client.0.smithi016.stderr: -461> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87a4d00) adding con mode: secure 2024-09-12T17:22:15.634 INFO:tasks.workunit.client.0.smithi016.stderr: -460> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87a4d00) adding con mode: crc 2024-09-12T17:22:15.634 INFO:tasks.workunit.client.0.smithi016.stderr: -459> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87a4d00) adding con mode: secure 2024-09-12T17:22:15.634 INFO:tasks.workunit.client.0.smithi016.stderr: -458> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87a4d00) adding con mode: crc 2024-09-12T17:22:15.634 INFO:tasks.workunit.client.0.smithi016.stderr: -457> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87a4d00) adding con mode: secure 2024-09-12T17:22:15.634 INFO:tasks.workunit.client.0.smithi016.stderr: -456> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87a4d00) adding con mode: crc 2024-09-12T17:22:15.634 INFO:tasks.workunit.client.0.smithi016.stderr: -455> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87a4d00) adding con mode: crc 2024-09-12T17:22:15.634 INFO:tasks.workunit.client.0.smithi016.stderr: -454> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87a4d00) adding con mode: secure 2024-09-12T17:22:15.634 INFO:tasks.workunit.client.0.smithi016.stderr: -453> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87a4d00) adding con mode: crc 2024-09-12T17:22:15.634 INFO:tasks.workunit.client.0.smithi016.stderr: -452> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87a4d00) adding con mode: secure 2024-09-12T17:22:15.634 INFO:tasks.workunit.client.0.smithi016.stderr: -451> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87a4d00) adding con mode: crc 2024-09-12T17:22:15.635 INFO:tasks.workunit.client.0.smithi016.stderr: -450> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87a4d00) adding con mode: secure 2024-09-12T17:22:15.635 INFO:tasks.workunit.client.0.smithi016.stderr: -449> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:15.635 INFO:tasks.workunit.client.0.smithi016.stderr: -448> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:15.635 INFO:tasks.workunit.client.0.smithi016.stderr: -447> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 asok(0x5636d85982b0) register_command rotate-key hook 0x5636d87a4e48 2024-09-12T17:22:15.635 INFO:tasks.workunit.client.0.smithi016.stderr: -446> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 10 monclient: _reopen_session rank -1 2024-09-12T17:22:15.635 INFO:tasks.workunit.client.0.smithi016.stderr: -445> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:22:15.635 INFO:tasks.workunit.client.0.smithi016.stderr: -444> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 10 monclient(hunting): picked mon.noname-a con 0x5636d8630c70 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:22:15.635 INFO:tasks.workunit.client.0.smithi016.stderr: -443> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 10 monclient(hunting): picked mon.noname-b con 0x5636d865d1e0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:22:15.635 INFO:tasks.workunit.client.0.smithi016.stderr: -442> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 10 monclient(hunting): picked mon.noname-c con 0x5636d87ab8f0 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:22:15.635 INFO:tasks.workunit.client.0.smithi016.stderr: -441> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:15.635 INFO:tasks.workunit.client.0.smithi016.stderr: -440> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:15.635 INFO:tasks.workunit.client.0.smithi016.stderr: -439> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:15.635 INFO:tasks.workunit.client.0.smithi016.stderr: -438> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 10 monclient(hunting): _renew_subs 2024-09-12T17:22:15.635 INFO:tasks.workunit.client.0.smithi016.stderr: -437> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 10 monclient(hunting): authenticate will time out at 2453.273908s 2024-09-12T17:22:15.636 INFO:tasks.workunit.client.0.smithi016.stderr: -436> 2024-09-12T17:22:15.296+0000 7f1cf2830640 10 monclient(hunting): get_auth_request con 0x5636d87ab8f0 auth_method 0 2024-09-12T17:22:15.636 INFO:tasks.workunit.client.0.smithi016.stderr: -435> 2024-09-12T17:22:15.296+0000 7f1cf2830640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:22:15.636 INFO:tasks.workunit.client.0.smithi016.stderr: -434> 2024-09-12T17:22:15.296+0000 7f1cf2830640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:22:15.636 INFO:tasks.workunit.client.0.smithi016.stderr: -433> 2024-09-12T17:22:15.296+0000 7f1cf2830640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:22:15.636 INFO:tasks.workunit.client.0.smithi016.stderr: -432> 2024-09-12T17:22:15.296+0000 7f1cf202f640 10 monclient(hunting): get_auth_request con 0x5636d8630c70 auth_method 0 2024-09-12T17:22:15.636 INFO:tasks.workunit.client.0.smithi016.stderr: -431> 2024-09-12T17:22:15.296+0000 7f1cf202f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:22:15.636 INFO:tasks.workunit.client.0.smithi016.stderr: -430> 2024-09-12T17:22:15.296+0000 7f1cf202f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:22:15.636 INFO:tasks.workunit.client.0.smithi016.stderr: -429> 2024-09-12T17:22:15.296+0000 7f1cf202f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:22:15.636 INFO:tasks.workunit.client.0.smithi016.stderr: -428> 2024-09-12T17:22:15.296+0000 7f1cf2830640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:22:15.636 INFO:tasks.workunit.client.0.smithi016.stderr: -427> 2024-09-12T17:22:15.296+0000 7f1cf2830640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:22:15.636 INFO:tasks.workunit.client.0.smithi016.stderr: -426> 2024-09-12T17:22:15.296+0000 7f1cf2830640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:22:15.636 INFO:tasks.workunit.client.0.smithi016.stderr: -425> 2024-09-12T17:22:15.296+0000 7f1cf202f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:22:15.636 INFO:tasks.workunit.client.0.smithi016.stderr: -424> 2024-09-12T17:22:15.296+0000 7f1cf202f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:22:15.637 INFO:tasks.workunit.client.0.smithi016.stderr: -423> 2024-09-12T17:22:15.296+0000 7f1cf202f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:22:15.637 INFO:tasks.workunit.client.0.smithi016.stderr: -422> 2024-09-12T17:22:15.296+0000 7f1cf182e640 10 monclient(hunting): get_auth_request con 0x5636d865d1e0 auth_method 0 2024-09-12T17:22:15.637 INFO:tasks.workunit.client.0.smithi016.stderr: -421> 2024-09-12T17:22:15.296+0000 7f1cf182e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:22:15.637 INFO:tasks.workunit.client.0.smithi016.stderr: -420> 2024-09-12T17:22:15.296+0000 7f1cf182e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:22:15.637 INFO:tasks.workunit.client.0.smithi016.stderr: -419> 2024-09-12T17:22:15.296+0000 7f1cf182e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:22:15.637 INFO:tasks.workunit.client.0.smithi016.stderr: -418> 2024-09-12T17:22:15.296+0000 7f1cf2830640 10 monclient(hunting): handle_auth_done global_id 7652 payload 824 2024-09-12T17:22:15.637 INFO:tasks.workunit.client.0.smithi016.stderr: -417> 2024-09-12T17:22:15.296+0000 7f1cf2830640 10 monclient: _finish_hunting 0 2024-09-12T17:22:15.637 INFO:tasks.workunit.client.0.smithi016.stderr: -416> 2024-09-12T17:22:15.296+0000 7f1cf2830640 1 monclient: found mon.noname-c 2024-09-12T17:22:15.637 INFO:tasks.workunit.client.0.smithi016.stderr: -415> 2024-09-12T17:22:15.296+0000 7f1cf2830640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:22:15.637 INFO:tasks.workunit.client.0.smithi016.stderr: -414> 2024-09-12T17:22:15.296+0000 7f1bdee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:22:15.637 INFO:tasks.workunit.client.0.smithi016.stderr: -413> 2024-09-12T17:22:15.296+0000 7f1bdee05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:22:15.637 INFO:tasks.workunit.client.0.smithi016.stderr: -412> 2024-09-12T17:22:15.296+0000 7f1bdee05640 10 monclient: dump: 2024-09-12T17:22:15.637 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:22:15.637 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:22:15.637 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:15.638 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:15.638 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:22:15.638 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:15.638 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:22:15.638 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:22:15.638 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:22:15.638 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:15.638 INFO:tasks.workunit.client.0.smithi016.stderr: -411> 2024-09-12T17:22:15.296+0000 7f1bdee05640 10 monclient: _finish_auth 0 2024-09-12T17:22:15.638 INFO:tasks.workunit.client.0.smithi016.stderr: -410> 2024-09-12T17:22:15.296+0000 7f1bdee05640 10 monclient: _check_auth_tickets 2024-09-12T17:22:15.638 INFO:tasks.workunit.client.0.smithi016.stderr: -409> 2024-09-12T17:22:15.296+0000 7f1bdee05640 10 monclient: handle_config config(0 keys) 2024-09-12T17:22:15.638 INFO:tasks.workunit.client.0.smithi016.stderr: -408> 2024-09-12T17:22:15.296+0000 7f1bdee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:22:15.638 INFO:tasks.workunit.client.0.smithi016.stderr: -407> 2024-09-12T17:22:15.296+0000 7f1bdee05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:22:15.638 INFO:tasks.workunit.client.0.smithi016.stderr: -406> 2024-09-12T17:22:15.296+0000 7f1bdee05640 10 monclient: dump: 2024-09-12T17:22:15.639 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:22:15.639 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:22:15.639 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:15.639 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:15.639 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:22:15.639 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:15.639 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:22:15.639 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:22:15.639 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:22:15.639 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:15.639 INFO:tasks.workunit.client.0.smithi016.stderr: -405> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 monclient: authenticate success, global_id 7652 2024-09-12T17:22:15.639 INFO:tasks.workunit.client.0.smithi016.stderr: -404> 2024-09-12T17:22:15.296+0000 7f1be0608640 4 set_mon_vals no callback set 2024-09-12T17:22:15.639 INFO:tasks.workunit.client.0.smithi016.stderr: -403> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 10 monclient: _renew_subs 2024-09-12T17:22:15.639 INFO:tasks.workunit.client.0.smithi016.stderr: -402> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:22:15.640 INFO:tasks.workunit.client.0.smithi016.stderr: -401> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 10 monclient: _renew_subs 2024-09-12T17:22:15.640 INFO:tasks.workunit.client.0.smithi016.stderr: -400> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:22:15.640 INFO:tasks.workunit.client.0.smithi016.stderr: -399> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 1 librados: init done 2024-09-12T17:22:15.640 INFO:tasks.workunit.client.0.smithi016.stderr: -398> 2024-09-12T17:22:15.300+0000 7f1bdee05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:22:15.640 INFO:tasks.workunit.client.0.smithi016.stderr: -397> 2024-09-12T17:22:15.300+0000 7f1bdee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:22:15.640 INFO:tasks.workunit.client.0.smithi016.stderr: -396> 2024-09-12T17:22:15.300+0000 7f1bdee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:22:15.640 INFO:tasks.workunit.client.0.smithi016.stderr: -395> 2024-09-12T17:22:15.300+0000 7f1cf202f640 10 monclient: get_auth_request con 0x7f1bd8070ae0 auth_method 0 2024-09-12T17:22:15.640 INFO:tasks.workunit.client.0.smithi016.stderr: -394> 2024-09-12T17:22:15.300+0000 7f1cf182e640 10 monclient: get_auth_request con 0x5636d87ed5a0 auth_method 0 2024-09-12T17:22:15.640 INFO:tasks.workunit.client.0.smithi016.stderr: -393> 2024-09-12T17:22:15.300+0000 7f1cf202f640 10 monclient: get_auth_request con 0x5636d87f03e0 auth_method 0 2024-09-12T17:22:15.640 INFO:tasks.workunit.client.0.smithi016.stderr: -392> 2024-09-12T17:22:15.304+0000 7f1cf182e640 10 monclient: get_auth_request con 0x5636d87f4660 auth_method 0 2024-09-12T17:22:15.640 INFO:tasks.workunit.client.0.smithi016.stderr: -391> 2024-09-12T17:22:15.304+0000 7f1cf2830640 10 monclient: get_auth_request con 0x5636d87f3c60 auth_method 0 2024-09-12T17:22:15.640 INFO:tasks.workunit.client.0.smithi016.stderr: -390> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 10 monclient: build_initial_monmap 2024-09-12T17:22:15.641 INFO:tasks.workunit.client.0.smithi016.stderr: -389> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 1 build_initial for_mkfs: 0 2024-09-12T17:22:15.641 INFO:tasks.workunit.client.0.smithi016.stderr: -388> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 10 monclient: monmap: 2024-09-12T17:22:15.641 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:22:15.641 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:22:15.641 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:22:15.641 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:22:15.641 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:22:15.641 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:15.641 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:22:15.641 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:22:15.641 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:22:15.641 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:15.641 INFO:tasks.workunit.client.0.smithi016.stderr: -387> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fc7c0) adding auth protocol: cephx 2024-09-12T17:22:15.641 INFO:tasks.workunit.client.0.smithi016.stderr: -386> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fc7c0) adding auth protocol: cephx 2024-09-12T17:22:15.642 INFO:tasks.workunit.client.0.smithi016.stderr: -385> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fc7c0) adding auth protocol: cephx 2024-09-12T17:22:15.642 INFO:tasks.workunit.client.0.smithi016.stderr: -384> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fc7c0) adding con mode: secure 2024-09-12T17:22:15.642 INFO:tasks.workunit.client.0.smithi016.stderr: -383> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fc7c0) adding con mode: crc 2024-09-12T17:22:15.642 INFO:tasks.workunit.client.0.smithi016.stderr: -382> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fc7c0) adding con mode: secure 2024-09-12T17:22:15.642 INFO:tasks.workunit.client.0.smithi016.stderr: -381> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fc7c0) adding con mode: crc 2024-09-12T17:22:15.642 INFO:tasks.workunit.client.0.smithi016.stderr: -380> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fc7c0) adding con mode: secure 2024-09-12T17:22:15.642 INFO:tasks.workunit.client.0.smithi016.stderr: -379> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fc7c0) adding con mode: crc 2024-09-12T17:22:15.642 INFO:tasks.workunit.client.0.smithi016.stderr: -378> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fc7c0) adding con mode: crc 2024-09-12T17:22:15.642 INFO:tasks.workunit.client.0.smithi016.stderr: -377> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fc7c0) adding con mode: secure 2024-09-12T17:22:15.642 INFO:tasks.workunit.client.0.smithi016.stderr: -376> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fc7c0) adding con mode: crc 2024-09-12T17:22:15.642 INFO:tasks.workunit.client.0.smithi016.stderr: -375> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fc7c0) adding con mode: secure 2024-09-12T17:22:15.642 INFO:tasks.workunit.client.0.smithi016.stderr: -374> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fc7c0) adding con mode: crc 2024-09-12T17:22:15.642 INFO:tasks.workunit.client.0.smithi016.stderr: -373> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fc7c0) adding con mode: secure 2024-09-12T17:22:15.643 INFO:tasks.workunit.client.0.smithi016.stderr: -372> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:15.643 INFO:tasks.workunit.client.0.smithi016.stderr: -371> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 asok(0x5636d85982b0) register_command objecter_requests cmddesc objecter_requests hook 0x5636d88001f0 EEXIST 2024-09-12T17:22:15.643 INFO:tasks.workunit.client.0.smithi016.stderr: -370> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 10 monclient: init 2024-09-12T17:22:15.643 INFO:tasks.workunit.client.0.smithi016.stderr: -369> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fb708) adding auth protocol: cephx 2024-09-12T17:22:15.643 INFO:tasks.workunit.client.0.smithi016.stderr: -368> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fb708) adding auth protocol: cephx 2024-09-12T17:22:15.643 INFO:tasks.workunit.client.0.smithi016.stderr: -367> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fb708) adding auth protocol: cephx 2024-09-12T17:22:15.643 INFO:tasks.workunit.client.0.smithi016.stderr: -366> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fb708) adding con mode: secure 2024-09-12T17:22:15.643 INFO:tasks.workunit.client.0.smithi016.stderr: -365> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fb708) adding con mode: crc 2024-09-12T17:22:15.643 INFO:tasks.workunit.client.0.smithi016.stderr: -364> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fb708) adding con mode: secure 2024-09-12T17:22:15.643 INFO:tasks.workunit.client.0.smithi016.stderr: -363> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fb708) adding con mode: crc 2024-09-12T17:22:15.643 INFO:tasks.workunit.client.0.smithi016.stderr: -362> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fb708) adding con mode: secure 2024-09-12T17:22:15.643 INFO:tasks.workunit.client.0.smithi016.stderr: -361> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fb708) adding con mode: crc 2024-09-12T17:22:15.643 INFO:tasks.workunit.client.0.smithi016.stderr: -360> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fb708) adding con mode: crc 2024-09-12T17:22:15.644 INFO:tasks.workunit.client.0.smithi016.stderr: -359> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fb708) adding con mode: secure 2024-09-12T17:22:15.644 INFO:tasks.workunit.client.0.smithi016.stderr: -358> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fb708) adding con mode: crc 2024-09-12T17:22:15.644 INFO:tasks.workunit.client.0.smithi016.stderr: -357> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fb708) adding con mode: secure 2024-09-12T17:22:15.644 INFO:tasks.workunit.client.0.smithi016.stderr: -356> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fb708) adding con mode: crc 2024-09-12T17:22:15.644 INFO:tasks.workunit.client.0.smithi016.stderr: -355> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fb708) adding con mode: secure 2024-09-12T17:22:15.644 INFO:tasks.workunit.client.0.smithi016.stderr: -354> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:15.644 INFO:tasks.workunit.client.0.smithi016.stderr: -353> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:15.644 INFO:tasks.workunit.client.0.smithi016.stderr: -352> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 asok(0x5636d85982b0) register_command rotate-key cmddesc rotate-key hook 0x5636d87fb850 EEXIST 2024-09-12T17:22:15.644 INFO:tasks.workunit.client.0.smithi016.stderr: -351> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 10 monclient: _reopen_session rank -1 2024-09-12T17:22:15.644 INFO:tasks.workunit.client.0.smithi016.stderr: -350> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:22:15.644 INFO:tasks.workunit.client.0.smithi016.stderr: -349> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 10 monclient(hunting): picked mon.noname-c con 0x5636d88243a0 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:22:15.644 INFO:tasks.workunit.client.0.smithi016.stderr: -348> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 10 monclient(hunting): picked mon.noname-b con 0x5636d8823cd0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:22:15.644 INFO:tasks.workunit.client.0.smithi016.stderr: -347> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 10 monclient(hunting): picked mon.noname-a con 0x5636d88226b0 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:22:15.645 INFO:tasks.workunit.client.0.smithi016.stderr: -346> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:15.645 INFO:tasks.workunit.client.0.smithi016.stderr: -345> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:15.645 INFO:tasks.workunit.client.0.smithi016.stderr: -344> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:15.645 INFO:tasks.workunit.client.0.smithi016.stderr: -343> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 10 monclient(hunting): _renew_subs 2024-09-12T17:22:15.645 INFO:tasks.workunit.client.0.smithi016.stderr: -342> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 10 monclient(hunting): authenticate will time out at 2453.285273s 2024-09-12T17:22:15.645 INFO:tasks.workunit.client.0.smithi016.stderr: -341> 2024-09-12T17:22:15.308+0000 7f1cf182e640 10 monclient(hunting): get_auth_request con 0x5636d88243a0 auth_method 0 2024-09-12T17:22:15.645 INFO:tasks.workunit.client.0.smithi016.stderr: -340> 2024-09-12T17:22:15.308+0000 7f1cf182e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:22:15.645 INFO:tasks.workunit.client.0.smithi016.stderr: -339> 2024-09-12T17:22:15.308+0000 7f1cf182e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:22:15.645 INFO:tasks.workunit.client.0.smithi016.stderr: -338> 2024-09-12T17:22:15.308+0000 7f1cf182e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:22:15.645 INFO:tasks.workunit.client.0.smithi016.stderr: -337> 2024-09-12T17:22:15.308+0000 7f1cf202f640 10 monclient(hunting): get_auth_request con 0x5636d88226b0 auth_method 0 2024-09-12T17:22:15.645 INFO:tasks.workunit.client.0.smithi016.stderr: -336> 2024-09-12T17:22:15.308+0000 7f1cf202f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:22:15.645 INFO:tasks.workunit.client.0.smithi016.stderr: -335> 2024-09-12T17:22:15.308+0000 7f1cf202f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:22:15.646 INFO:tasks.workunit.client.0.smithi016.stderr: -334> 2024-09-12T17:22:15.308+0000 7f1cf202f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:22:15.646 INFO:tasks.workunit.client.0.smithi016.stderr: -333> 2024-09-12T17:22:15.308+0000 7f1cf182e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:22:15.646 INFO:tasks.workunit.client.0.smithi016.stderr: -332> 2024-09-12T17:22:15.308+0000 7f1cf182e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:22:15.646 INFO:tasks.workunit.client.0.smithi016.stderr: -331> 2024-09-12T17:22:15.308+0000 7f1cf182e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:22:15.646 INFO:tasks.workunit.client.0.smithi016.stderr: -330> 2024-09-12T17:22:15.308+0000 7f1cf202f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:22:15.646 INFO:tasks.workunit.client.0.smithi016.stderr: -329> 2024-09-12T17:22:15.308+0000 7f1cf202f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:22:15.646 INFO:tasks.workunit.client.0.smithi016.stderr: -328> 2024-09-12T17:22:15.308+0000 7f1cf202f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:22:15.646 INFO:tasks.workunit.client.0.smithi016.stderr: -327> 2024-09-12T17:22:15.308+0000 7f1cf182e640 10 monclient(hunting): handle_auth_done global_id 7655 payload 824 2024-09-12T17:22:15.646 INFO:tasks.workunit.client.0.smithi016.stderr: -326> 2024-09-12T17:22:15.308+0000 7f1cf182e640 10 monclient: _finish_hunting 0 2024-09-12T17:22:15.646 INFO:tasks.workunit.client.0.smithi016.stderr: -325> 2024-09-12T17:22:15.308+0000 7f1cf182e640 1 monclient: found mon.noname-c 2024-09-12T17:22:15.646 INFO:tasks.workunit.client.0.smithi016.stderr: -324> 2024-09-12T17:22:15.308+0000 7f1cf182e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:22:15.646 INFO:tasks.workunit.client.0.smithi016.stderr: -323> 2024-09-12T17:22:15.308+0000 7f1bd7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:22:15.647 INFO:tasks.workunit.client.0.smithi016.stderr: -322> 2024-09-12T17:22:15.308+0000 7f1bd7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:22:15.647 INFO:tasks.workunit.client.0.smithi016.stderr: -321> 2024-09-12T17:22:15.308+0000 7f1bd7fff640 10 monclient: dump: 2024-09-12T17:22:15.647 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:22:15.647 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:22:15.647 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:15.647 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:15.647 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:22:15.647 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:15.647 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:22:15.647 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:22:15.647 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:22:15.647 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:15.647 INFO:tasks.workunit.client.0.smithi016.stderr: -320> 2024-09-12T17:22:15.308+0000 7f1bd7fff640 10 monclient: _finish_auth 0 2024-09-12T17:22:15.647 INFO:tasks.workunit.client.0.smithi016.stderr: -319> 2024-09-12T17:22:15.308+0000 7f1bd7fff640 10 monclient: _check_auth_tickets 2024-09-12T17:22:15.648 INFO:tasks.workunit.client.0.smithi016.stderr: -318> 2024-09-12T17:22:15.308+0000 7f1bd7fff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:22:15.648 INFO:tasks.workunit.client.0.smithi016.stderr: -317> 2024-09-12T17:22:15.308+0000 7f1bd7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:22:15.648 INFO:tasks.workunit.client.0.smithi016.stderr: -316> 2024-09-12T17:22:15.308+0000 7f1bd7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:22:15.648 INFO:tasks.workunit.client.0.smithi016.stderr: -315> 2024-09-12T17:22:15.308+0000 7f1bd7fff640 10 monclient: dump: 2024-09-12T17:22:15.648 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:22:15.648 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:22:15.648 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:15.648 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:15.648 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:22:15.648 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:15.648 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:22:15.648 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:22:15.648 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:22:15.649 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:15.649 INFO:tasks.workunit.client.0.smithi016.stderr: -314> 2024-09-12T17:22:15.308+0000 7f1cf3031640 4 set_mon_vals no callback set 2024-09-12T17:22:15.649 INFO:tasks.workunit.client.0.smithi016.stderr: -313> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 monclient: authenticate success, global_id 7655 2024-09-12T17:22:15.649 INFO:tasks.workunit.client.0.smithi016.stderr: -312> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 10 monclient: _renew_subs 2024-09-12T17:22:15.649 INFO:tasks.workunit.client.0.smithi016.stderr: -311> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:22:15.649 INFO:tasks.workunit.client.0.smithi016.stderr: -310> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 10 monclient: _renew_subs 2024-09-12T17:22:15.649 INFO:tasks.workunit.client.0.smithi016.stderr: -309> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:22:15.649 INFO:tasks.workunit.client.0.smithi016.stderr: -308> 2024-09-12T17:22:15.312+0000 7f1bd7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:22:15.649 INFO:tasks.workunit.client.0.smithi016.stderr: -307> 2024-09-12T17:22:15.312+0000 7f1bd7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:22:15.649 INFO:tasks.workunit.client.0.smithi016.stderr: -306> 2024-09-12T17:22:15.312+0000 7f1bd7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:22:15.649 INFO:tasks.workunit.client.0.smithi016.stderr: -305> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 10 monclient: get_monmap_and_config 2024-09-12T17:22:15.649 INFO:tasks.workunit.client.0.smithi016.stderr: -304> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 10 monclient: build_initial_monmap 2024-09-12T17:22:15.649 INFO:tasks.workunit.client.0.smithi016.stderr: -303> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 1 build_initial for_mkfs: 0 2024-09-12T17:22:15.650 INFO:tasks.workunit.client.0.smithi016.stderr: -302> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 10 monclient: monmap: 2024-09-12T17:22:15.650 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:22:15.650 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:22:15.650 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:22:15.650 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:22:15.650 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:22:15.650 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:15.650 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:22:15.650 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:22:15.650 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:22:15.650 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:15.650 INFO:tasks.workunit.client.0.smithi016.stderr: -301> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843bf0) adding auth protocol: cephx 2024-09-12T17:22:15.650 INFO:tasks.workunit.client.0.smithi016.stderr: -300> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843bf0) adding auth protocol: cephx 2024-09-12T17:22:15.651 INFO:tasks.workunit.client.0.smithi016.stderr: -299> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843bf0) adding auth protocol: cephx 2024-09-12T17:22:15.651 INFO:tasks.workunit.client.0.smithi016.stderr: -298> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843bf0) adding con mode: secure 2024-09-12T17:22:15.651 INFO:tasks.workunit.client.0.smithi016.stderr: -297> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843bf0) adding con mode: crc 2024-09-12T17:22:15.651 INFO:tasks.workunit.client.0.smithi016.stderr: -296> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843bf0) adding con mode: secure 2024-09-12T17:22:15.651 INFO:tasks.workunit.client.0.smithi016.stderr: -295> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843bf0) adding con mode: crc 2024-09-12T17:22:15.651 INFO:tasks.workunit.client.0.smithi016.stderr: -294> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843bf0) adding con mode: secure 2024-09-12T17:22:15.651 INFO:tasks.workunit.client.0.smithi016.stderr: -293> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843bf0) adding con mode: crc 2024-09-12T17:22:15.651 INFO:tasks.workunit.client.0.smithi016.stderr: -292> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843bf0) adding con mode: crc 2024-09-12T17:22:15.651 INFO:tasks.workunit.client.0.smithi016.stderr: -291> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843bf0) adding con mode: secure 2024-09-12T17:22:15.651 INFO:tasks.workunit.client.0.smithi016.stderr: -290> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843bf0) adding con mode: crc 2024-09-12T17:22:15.651 INFO:tasks.workunit.client.0.smithi016.stderr: -289> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843bf0) adding con mode: secure 2024-09-12T17:22:15.651 INFO:tasks.workunit.client.0.smithi016.stderr: -288> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843bf0) adding con mode: crc 2024-09-12T17:22:15.651 INFO:tasks.workunit.client.0.smithi016.stderr: -287> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843bf0) adding con mode: secure 2024-09-12T17:22:15.651 INFO:tasks.workunit.client.0.smithi016.stderr: -286> 2024-09-12T17:22:15.312+0000 7f1cf2830640 10 monclient: get_auth_request con 0x7f1bcc070a20 auth_method 0 2024-09-12T17:22:15.652 INFO:tasks.workunit.client.0.smithi016.stderr: -285> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:15.652 INFO:tasks.workunit.client.0.smithi016.stderr: -284> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 10 monclient: init 2024-09-12T17:22:15.652 INFO:tasks.workunit.client.0.smithi016.stderr: -283> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36370) adding auth protocol: cephx 2024-09-12T17:22:15.652 INFO:tasks.workunit.client.0.smithi016.stderr: -282> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36370) adding auth protocol: cephx 2024-09-12T17:22:15.652 INFO:tasks.workunit.client.0.smithi016.stderr: -281> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36370) adding auth protocol: cephx 2024-09-12T17:22:15.652 INFO:tasks.workunit.client.0.smithi016.stderr: -280> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36370) adding con mode: secure 2024-09-12T17:22:15.652 INFO:tasks.workunit.client.0.smithi016.stderr: -279> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36370) adding con mode: crc 2024-09-12T17:22:15.652 INFO:tasks.workunit.client.0.smithi016.stderr: -278> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36370) adding con mode: secure 2024-09-12T17:22:15.652 INFO:tasks.workunit.client.0.smithi016.stderr: -277> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36370) adding con mode: crc 2024-09-12T17:22:15.652 INFO:tasks.workunit.client.0.smithi016.stderr: -276> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36370) adding con mode: secure 2024-09-12T17:22:15.652 INFO:tasks.workunit.client.0.smithi016.stderr: -275> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36370) adding con mode: crc 2024-09-12T17:22:15.652 INFO:tasks.workunit.client.0.smithi016.stderr: -274> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36370) adding con mode: crc 2024-09-12T17:22:15.652 INFO:tasks.workunit.client.0.smithi016.stderr: -273> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36370) adding con mode: secure 2024-09-12T17:22:15.653 INFO:tasks.workunit.client.0.smithi016.stderr: -272> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36370) adding con mode: crc 2024-09-12T17:22:15.653 INFO:tasks.workunit.client.0.smithi016.stderr: -271> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36370) adding con mode: secure 2024-09-12T17:22:15.653 INFO:tasks.workunit.client.0.smithi016.stderr: -270> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36370) adding con mode: crc 2024-09-12T17:22:15.653 INFO:tasks.workunit.client.0.smithi016.stderr: -269> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36370) adding con mode: secure 2024-09-12T17:22:15.653 INFO:tasks.workunit.client.0.smithi016.stderr: -268> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:15.653 INFO:tasks.workunit.client.0.smithi016.stderr: -267> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:15.653 INFO:tasks.workunit.client.0.smithi016.stderr: -266> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 asok(0x5636d85982b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc4aa364b8 EEXIST 2024-09-12T17:22:15.653 INFO:tasks.workunit.client.0.smithi016.stderr: -265> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 10 monclient: _reopen_session rank -1 2024-09-12T17:22:15.653 INFO:tasks.workunit.client.0.smithi016.stderr: -264> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:22:15.653 INFO:tasks.workunit.client.0.smithi016.stderr: -263> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 10 monclient(hunting): picked mon.noname-a con 0x5636d8878090 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:22:15.653 INFO:tasks.workunit.client.0.smithi016.stderr: -262> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 10 monclient(hunting): picked mon.noname-b con 0x5636d8868d50 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:22:15.653 INFO:tasks.workunit.client.0.smithi016.stderr: -261> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 10 monclient(hunting): picked mon.noname-c con 0x5636d88734d0 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:22:15.653 INFO:tasks.workunit.client.0.smithi016.stderr: -260> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:15.653 INFO:tasks.workunit.client.0.smithi016.stderr: -259> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:15.654 INFO:tasks.workunit.client.0.smithi016.stderr: -258> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:15.654 INFO:tasks.workunit.client.0.smithi016.stderr: -257> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 10 monclient(hunting): _renew_subs 2024-09-12T17:22:15.654 INFO:tasks.workunit.client.0.smithi016.stderr: -256> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 10 monclient(hunting): authenticate will time out at 2453.290119s 2024-09-12T17:22:15.654 INFO:tasks.workunit.client.0.smithi016.stderr: -255> 2024-09-12T17:22:15.312+0000 7f1cf182e640 10 monclient(hunting): get_auth_request con 0x5636d8878090 auth_method 0 2024-09-12T17:22:15.654 INFO:tasks.workunit.client.0.smithi016.stderr: -254> 2024-09-12T17:22:15.312+0000 7f1cf182e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:22:15.654 INFO:tasks.workunit.client.0.smithi016.stderr: -253> 2024-09-12T17:22:15.312+0000 7f1cf182e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:22:15.654 INFO:tasks.workunit.client.0.smithi016.stderr: -252> 2024-09-12T17:22:15.312+0000 7f1cf182e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:22:15.654 INFO:tasks.workunit.client.0.smithi016.stderr: -251> 2024-09-12T17:22:15.312+0000 7f1cf182e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:22:15.654 INFO:tasks.workunit.client.0.smithi016.stderr: -250> 2024-09-12T17:22:15.312+0000 7f1cf182e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:22:15.654 INFO:tasks.workunit.client.0.smithi016.stderr: -249> 2024-09-12T17:22:15.312+0000 7f1cf182e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:22:15.654 INFO:tasks.workunit.client.0.smithi016.stderr: -248> 2024-09-12T17:22:15.312+0000 7f1cf202f640 10 monclient(hunting): get_auth_request con 0x5636d88734d0 auth_method 0 2024-09-12T17:22:15.654 INFO:tasks.workunit.client.0.smithi016.stderr: -247> 2024-09-12T17:22:15.312+0000 7f1cf202f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:22:15.654 INFO:tasks.workunit.client.0.smithi016.stderr: -246> 2024-09-12T17:22:15.312+0000 7f1cf202f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:22:15.655 INFO:tasks.workunit.client.0.smithi016.stderr: -245> 2024-09-12T17:22:15.312+0000 7f1cf202f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:22:15.655 INFO:tasks.workunit.client.0.smithi016.stderr: -244> 2024-09-12T17:22:15.312+0000 7f1cf182e640 10 monclient(hunting): handle_auth_done global_id 8049 payload 274 2024-09-12T17:22:15.655 INFO:tasks.workunit.client.0.smithi016.stderr: -243> 2024-09-12T17:22:15.312+0000 7f1cf182e640 10 monclient: _finish_hunting 0 2024-09-12T17:22:15.655 INFO:tasks.workunit.client.0.smithi016.stderr: -242> 2024-09-12T17:22:15.312+0000 7f1cf182e640 1 monclient: found mon.noname-a 2024-09-12T17:22:15.655 INFO:tasks.workunit.client.0.smithi016.stderr: -241> 2024-09-12T17:22:15.312+0000 7f1cf182e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:22:15.655 INFO:tasks.workunit.client.0.smithi016.stderr: -240> 2024-09-12T17:22:15.312+0000 7f1bd5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:22:15.655 INFO:tasks.workunit.client.0.smithi016.stderr: -239> 2024-09-12T17:22:15.312+0000 7f1bd5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:22:15.655 INFO:tasks.workunit.client.0.smithi016.stderr: -238> 2024-09-12T17:22:15.312+0000 7f1bd5ffb640 10 monclient: dump: 2024-09-12T17:22:15.655 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:22:15.655 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:22:15.655 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:15.655 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:15.655 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:22:15.655 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:15.656 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:22:15.656 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:22:15.656 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:22:15.656 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:15.656 INFO:tasks.workunit.client.0.smithi016.stderr: -237> 2024-09-12T17:22:15.312+0000 7f1bd5ffb640 10 monclient: _finish_auth 0 2024-09-12T17:22:15.656 INFO:tasks.workunit.client.0.smithi016.stderr: -236> 2024-09-12T17:22:15.312+0000 7f1bd5ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:22:15.656 INFO:tasks.workunit.client.0.smithi016.stderr: -235> 2024-09-12T17:22:15.312+0000 7f1bd5ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:22:15.656 INFO:tasks.workunit.client.0.smithi016.stderr: -234> 2024-09-12T17:22:15.312+0000 7f1bd5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:22:15.656 INFO:tasks.workunit.client.0.smithi016.stderr: -233> 2024-09-12T17:22:15.312+0000 7f1bd5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:22:15.656 INFO:tasks.workunit.client.0.smithi016.stderr: -232> 2024-09-12T17:22:15.312+0000 7f1bd5ffb640 10 monclient: dump: 2024-09-12T17:22:15.656 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:22:15.656 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:22:15.656 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:15.656 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:15.657 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:22:15.657 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:15.657 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:22:15.657 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:22:15.657 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:22:15.657 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:15.657 INFO:tasks.workunit.client.0.smithi016.stderr: -231> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 monclient: authenticate success, global_id 8049 2024-09-12T17:22:15.657 INFO:tasks.workunit.client.0.smithi016.stderr: -230> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 10 monclient: get_monmap_and_config success 2024-09-12T17:22:15.657 INFO:tasks.workunit.client.0.smithi016.stderr: -229> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 4 set_mon_vals no callback set 2024-09-12T17:22:15.657 INFO:tasks.workunit.client.0.smithi016.stderr: -228> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 10 monclient: shutdown 2024-09-12T17:22:15.657 INFO:tasks.workunit.client.0.smithi016.stderr: -227> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 10 monclient: build_initial_monmap 2024-09-12T17:22:15.657 INFO:tasks.workunit.client.0.smithi016.stderr: -226> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 1 build_initial for_mkfs: 0 2024-09-12T17:22:15.657 INFO:tasks.workunit.client.0.smithi016.stderr: -225> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 10 monclient: monmap: 2024-09-12T17:22:15.658 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:22:15.658 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:22:15.658 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:22:15.658 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:22:15.658 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:22:15.658 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:15.658 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:22:15.658 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:22:15.658 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:22:15.658 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:15.658 INFO:tasks.workunit.client.0.smithi016.stderr: -224> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843ba0) adding auth protocol: cephx 2024-09-12T17:22:15.658 INFO:tasks.workunit.client.0.smithi016.stderr: -223> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843ba0) adding auth protocol: cephx 2024-09-12T17:22:15.658 INFO:tasks.workunit.client.0.smithi016.stderr: -222> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843ba0) adding auth protocol: cephx 2024-09-12T17:22:15.658 INFO:tasks.workunit.client.0.smithi016.stderr: -221> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843ba0) adding con mode: secure 2024-09-12T17:22:15.659 INFO:tasks.workunit.client.0.smithi016.stderr: -220> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843ba0) adding con mode: crc 2024-09-12T17:22:15.659 INFO:tasks.workunit.client.0.smithi016.stderr: -219> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843ba0) adding con mode: secure 2024-09-12T17:22:15.659 INFO:tasks.workunit.client.0.smithi016.stderr: -218> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843ba0) adding con mode: crc 2024-09-12T17:22:15.659 INFO:tasks.workunit.client.0.smithi016.stderr: -217> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843ba0) adding con mode: secure 2024-09-12T17:22:15.659 INFO:tasks.workunit.client.0.smithi016.stderr: -216> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843ba0) adding con mode: crc 2024-09-12T17:22:15.659 INFO:tasks.workunit.client.0.smithi016.stderr: -215> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843ba0) adding con mode: crc 2024-09-12T17:22:15.659 INFO:tasks.workunit.client.0.smithi016.stderr: -214> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843ba0) adding con mode: secure 2024-09-12T17:22:15.659 INFO:tasks.workunit.client.0.smithi016.stderr: -213> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843ba0) adding con mode: crc 2024-09-12T17:22:15.659 INFO:tasks.workunit.client.0.smithi016.stderr: -212> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843ba0) adding con mode: secure 2024-09-12T17:22:15.659 INFO:tasks.workunit.client.0.smithi016.stderr: -211> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843ba0) adding con mode: crc 2024-09-12T17:22:15.659 INFO:tasks.workunit.client.0.smithi016.stderr: -210> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843ba0) adding con mode: secure 2024-09-12T17:22:15.659 INFO:tasks.workunit.client.0.smithi016.stderr: -209> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:15.659 INFO:tasks.workunit.client.0.smithi016.stderr: -208> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 1 librados: starting msgr at 2024-09-12T17:22:15.659 INFO:tasks.workunit.client.0.smithi016.stderr: -207> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 1 librados: starting objecter 2024-09-12T17:22:15.660 INFO:tasks.workunit.client.0.smithi016.stderr: -206> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 5 asok(0x5636d85982b0) register_command objecter_requests cmddesc objecter_requests hook 0x5636d882a2b0 EEXIST 2024-09-12T17:22:15.660 INFO:tasks.workunit.client.0.smithi016.stderr: -205> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 1 librados: setting wanted keys 2024-09-12T17:22:15.660 INFO:tasks.workunit.client.0.smithi016.stderr: -204> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 1 librados: calling monclient init 2024-09-12T17:22:15.660 INFO:tasks.workunit.client.0.smithi016.stderr: -203> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 10 monclient: init 2024-09-12T17:22:15.660 INFO:tasks.workunit.client.0.smithi016.stderr: -202> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 5 AuthRegistry(0x5636d88261c0) adding auth protocol: cephx 2024-09-12T17:22:15.660 INFO:tasks.workunit.client.0.smithi016.stderr: -201> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 5 AuthRegistry(0x5636d88261c0) adding auth protocol: cephx 2024-09-12T17:22:15.660 INFO:tasks.workunit.client.0.smithi016.stderr: -200> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 5 AuthRegistry(0x5636d88261c0) adding auth protocol: cephx 2024-09-12T17:22:15.660 INFO:tasks.workunit.client.0.smithi016.stderr: -199> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 5 AuthRegistry(0x5636d88261c0) adding con mode: secure 2024-09-12T17:22:15.660 INFO:tasks.workunit.client.0.smithi016.stderr: -198> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 5 AuthRegistry(0x5636d88261c0) adding con mode: crc 2024-09-12T17:22:15.660 INFO:tasks.workunit.client.0.smithi016.stderr: -197> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 5 AuthRegistry(0x5636d88261c0) adding con mode: secure 2024-09-12T17:22:15.660 INFO:tasks.workunit.client.0.smithi016.stderr: -196> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 5 AuthRegistry(0x5636d88261c0) adding con mode: crc 2024-09-12T17:22:15.660 INFO:tasks.workunit.client.0.smithi016.stderr: -195> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 5 AuthRegistry(0x5636d88261c0) adding con mode: secure 2024-09-12T17:22:15.660 INFO:tasks.workunit.client.0.smithi016.stderr: -194> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 5 AuthRegistry(0x5636d88261c0) adding con mode: crc 2024-09-12T17:22:15.661 INFO:tasks.workunit.client.0.smithi016.stderr: -193> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 5 AuthRegistry(0x5636d88261c0) adding con mode: crc 2024-09-12T17:22:15.661 INFO:tasks.workunit.client.0.smithi016.stderr: -192> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 5 AuthRegistry(0x5636d88261c0) adding con mode: secure 2024-09-12T17:22:15.661 INFO:tasks.workunit.client.0.smithi016.stderr: -191> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 5 AuthRegistry(0x5636d88261c0) adding con mode: crc 2024-09-12T17:22:15.661 INFO:tasks.workunit.client.0.smithi016.stderr: -190> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 5 AuthRegistry(0x5636d88261c0) adding con mode: secure 2024-09-12T17:22:15.661 INFO:tasks.workunit.client.0.smithi016.stderr: -189> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 5 AuthRegistry(0x5636d88261c0) adding con mode: crc 2024-09-12T17:22:15.661 INFO:tasks.workunit.client.0.smithi016.stderr: -188> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 5 AuthRegistry(0x5636d88261c0) adding con mode: secure 2024-09-12T17:22:15.661 INFO:tasks.workunit.client.0.smithi016.stderr: -187> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:15.661 INFO:tasks.workunit.client.0.smithi016.stderr: -186> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:15.661 INFO:tasks.workunit.client.0.smithi016.stderr: -185> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 5 asok(0x5636d85982b0) register_command rotate-key cmddesc rotate-key hook 0x5636d8826308 EEXIST 2024-09-12T17:22:15.661 INFO:tasks.workunit.client.0.smithi016.stderr: -184> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 10 monclient: _reopen_session rank -1 2024-09-12T17:22:15.661 INFO:tasks.workunit.client.0.smithi016.stderr: -183> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:22:15.661 INFO:tasks.workunit.client.0.smithi016.stderr: -182> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 10 monclient(hunting): picked mon.noname-a con 0x5636d8868d50 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:22:15.661 INFO:tasks.workunit.client.0.smithi016.stderr: -181> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 10 monclient(hunting): picked mon.noname-c con 0x5636d88734d0 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:22:15.661 INFO:tasks.workunit.client.0.smithi016.stderr: -180> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 10 monclient(hunting): picked mon.noname-b con 0x5636d8878090 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:22:15.662 INFO:tasks.workunit.client.0.smithi016.stderr: -179> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:15.662 INFO:tasks.workunit.client.0.smithi016.stderr: -178> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:15.662 INFO:tasks.workunit.client.0.smithi016.stderr: -177> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:15.662 INFO:tasks.workunit.client.0.smithi016.stderr: -176> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 10 monclient(hunting): _renew_subs 2024-09-12T17:22:15.662 INFO:tasks.workunit.client.0.smithi016.stderr: -175> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 10 monclient(hunting): authenticate will time out at 2453.292804s 2024-09-12T17:22:15.662 INFO:tasks.workunit.client.0.smithi016.stderr: -174> 2024-09-12T17:22:15.316+0000 7f1cf182e640 10 monclient(hunting): get_auth_request con 0x5636d8868d50 auth_method 0 2024-09-12T17:22:15.662 INFO:tasks.workunit.client.0.smithi016.stderr: -173> 2024-09-12T17:22:15.316+0000 7f1cf182e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:22:15.662 INFO:tasks.workunit.client.0.smithi016.stderr: -172> 2024-09-12T17:22:15.316+0000 7f1cf182e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:22:15.662 INFO:tasks.workunit.client.0.smithi016.stderr: -171> 2024-09-12T17:22:15.316+0000 7f1cf182e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:22:15.662 INFO:tasks.workunit.client.0.smithi016.stderr: -170> 2024-09-12T17:22:15.316+0000 7f1cf2830640 10 monclient(hunting): get_auth_request con 0x5636d88734d0 auth_method 0 2024-09-12T17:22:15.662 INFO:tasks.workunit.client.0.smithi016.stderr: -169> 2024-09-12T17:22:15.316+0000 7f1cf2830640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:22:15.662 INFO:tasks.workunit.client.0.smithi016.stderr: -168> 2024-09-12T17:22:15.316+0000 7f1cf2830640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:22:15.662 INFO:tasks.workunit.client.0.smithi016.stderr: -167> 2024-09-12T17:22:15.316+0000 7f1cf2830640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:22:15.663 INFO:tasks.workunit.client.0.smithi016.stderr: -166> 2024-09-12T17:22:15.316+0000 7f1cf182e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:22:15.663 INFO:tasks.workunit.client.0.smithi016.stderr: -165> 2024-09-12T17:22:15.316+0000 7f1cf182e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:22:15.663 INFO:tasks.workunit.client.0.smithi016.stderr: -164> 2024-09-12T17:22:15.316+0000 7f1cf182e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:22:15.663 INFO:tasks.workunit.client.0.smithi016.stderr: -163> 2024-09-12T17:22:15.316+0000 7f1cf2830640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:22:15.663 INFO:tasks.workunit.client.0.smithi016.stderr: -162> 2024-09-12T17:22:15.316+0000 7f1cf2830640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:22:15.663 INFO:tasks.workunit.client.0.smithi016.stderr: -161> 2024-09-12T17:22:15.316+0000 7f1cf2830640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:22:15.663 INFO:tasks.workunit.client.0.smithi016.stderr: -160> 2024-09-12T17:22:15.316+0000 7f1cf182e640 10 monclient(hunting): handle_auth_done global_id 8052 payload 824 2024-09-12T17:22:15.663 INFO:tasks.workunit.client.0.smithi016.stderr: -159> 2024-09-12T17:22:15.316+0000 7f1cf182e640 10 monclient: _finish_hunting 0 2024-09-12T17:22:15.663 INFO:tasks.workunit.client.0.smithi016.stderr: -158> 2024-09-12T17:22:15.316+0000 7f1cf182e640 1 monclient: found mon.noname-a 2024-09-12T17:22:15.663 INFO:tasks.workunit.client.0.smithi016.stderr: -157> 2024-09-12T17:22:15.316+0000 7f1cf182e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:22:15.663 INFO:tasks.workunit.client.0.smithi016.stderr: -156> 2024-09-12T17:22:15.316+0000 7f1bc3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:22:15.663 INFO:tasks.workunit.client.0.smithi016.stderr: -155> 2024-09-12T17:22:15.316+0000 7f1bc3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:22:15.663 INFO:tasks.workunit.client.0.smithi016.stderr: -154> 2024-09-12T17:22:15.316+0000 7f1bc3fff640 10 monclient: dump: 2024-09-12T17:22:15.664 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:22:15.664 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:22:15.664 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:15.664 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:15.664 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:22:15.664 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:15.664 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:22:15.664 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:22:15.664 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:22:15.664 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:15.664 INFO:tasks.workunit.client.0.smithi016.stderr: -153> 2024-09-12T17:22:15.316+0000 7f1bc3fff640 10 monclient: _finish_auth 0 2024-09-12T17:22:15.664 INFO:tasks.workunit.client.0.smithi016.stderr: -152> 2024-09-12T17:22:15.316+0000 7f1bc3fff640 10 monclient: _check_auth_tickets 2024-09-12T17:22:15.665 INFO:tasks.workunit.client.0.smithi016.stderr: -151> 2024-09-12T17:22:15.316+0000 7f1bc3fff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:22:15.665 INFO:tasks.workunit.client.0.smithi016.stderr: -150> 2024-09-12T17:22:15.316+0000 7f1bc3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:22:15.665 INFO:tasks.workunit.client.0.smithi016.stderr: -149> 2024-09-12T17:22:15.316+0000 7f1bc3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:22:15.665 INFO:tasks.workunit.client.0.smithi016.stderr: -148> 2024-09-12T17:22:15.316+0000 7f1bc3fff640 10 monclient: dump: 2024-09-12T17:22:15.665 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:22:15.665 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:22:15.665 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:15.665 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:15.665 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:22:15.665 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:15.665 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:22:15.665 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:22:15.665 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:22:15.666 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:15.666 INFO:tasks.workunit.client.0.smithi016.stderr: -147> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 5 monclient: authenticate success, global_id 8052 2024-09-12T17:22:15.666 INFO:tasks.workunit.client.0.smithi016.stderr: -146> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 10 monclient: _renew_subs 2024-09-12T17:22:15.666 INFO:tasks.workunit.client.0.smithi016.stderr: -145> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:22:15.666 INFO:tasks.workunit.client.0.smithi016.stderr: -144> 2024-09-12T17:22:15.316+0000 7f1bd5ffb640 4 set_mon_vals no callback set 2024-09-12T17:22:15.666 INFO:tasks.workunit.client.0.smithi016.stderr: -143> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 10 monclient: _renew_subs 2024-09-12T17:22:15.666 INFO:tasks.workunit.client.0.smithi016.stderr: -142> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:22:15.666 INFO:tasks.workunit.client.0.smithi016.stderr: -141> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 1 librados: init done 2024-09-12T17:22:15.666 INFO:tasks.workunit.client.0.smithi016.stderr: -140> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 5 asok(0x5636d85982b0) register_command cr dump hook 0x5636d8868c98 2024-09-12T17:22:15.666 INFO:tasks.workunit.client.0.smithi016.stderr: -139> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.666 INFO:tasks.workunit.client.0.smithi016.stderr: -138> 2024-09-12T17:22:15.316+0000 7f1bc3fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:22:15.666 INFO:tasks.workunit.client.0.smithi016.stderr: -137> 2024-09-12T17:22:15.316+0000 7f1bc3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:22:15.666 INFO:tasks.workunit.client.0.smithi016.stderr: -136> 2024-09-12T17:22:15.316+0000 7f1bc3fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:22:15.667 INFO:tasks.workunit.client.0.smithi016.stderr: -135> 2024-09-12T17:22:15.320+0000 7f1cf2830640 10 monclient: get_auth_request con 0x7f1bbc070b10 auth_method 0 2024-09-12T17:22:15.667 INFO:tasks.workunit.client.0.smithi016.stderr: -134> 2024-09-12T17:22:15.320+0000 7f1cf202f640 10 monclient: get_auth_request con 0x5636d8891490 auth_method 0 2024-09-12T17:22:15.667 INFO:tasks.workunit.client.0.smithi016.stderr: -133> 2024-09-12T17:22:15.320+0000 7f1cf45299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:15.667 INFO:tasks.workunit.client.0.smithi016.stderr: -132> 2024-09-12T17:22:15.320+0000 7f1cf45299c0 20 realm 2024-09-12T17:22:15.667 INFO:tasks.workunit.client.0.smithi016.stderr: -131> 2024-09-12T17:22:15.320+0000 7f1cf45299c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.667 INFO:tasks.workunit.client.0.smithi016.stderr: -130> 2024-09-12T17:22:15.320+0000 7f1cf45299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:15.667 INFO:tasks.workunit.client.0.smithi016.stderr: -129> 2024-09-12T17:22:15.320+0000 7f1cf45299c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:22:15.667 INFO:tasks.workunit.client.0.smithi016.stderr: -128> 2024-09-12T17:22:15.320+0000 7f1cf45299c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.667 INFO:tasks.workunit.client.0.smithi016.stderr: -127> 2024-09-12T17:22:15.320+0000 7f1cf45299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:15.667 INFO:tasks.workunit.client.0.smithi016.stderr: -126> 2024-09-12T17:22:15.320+0000 7f1cf45299c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.667 INFO:tasks.workunit.client.0.smithi016.stderr: -125> 2024-09-12T17:22:15.320+0000 7f1cf182e640 10 monclient: get_auth_request con 0x5636d88956d0 auth_method 0 2024-09-12T17:22:15.667 INFO:tasks.workunit.client.0.smithi016.stderr: -124> 2024-09-12T17:22:15.320+0000 7f1cf45299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:22:15.667 INFO:tasks.workunit.client.0.smithi016.stderr: -123> 2024-09-12T17:22:15.320+0000 7f1cf45299c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.667 INFO:tasks.workunit.client.0.smithi016.stderr: -122> 2024-09-12T17:22:15.320+0000 7f1cf2830640 10 monclient: get_auth_request con 0x5636d8898f30 auth_method 0 2024-09-12T17:22:15.668 INFO:tasks.workunit.client.0.smithi016.stderr: -121> 2024-09-12T17:22:15.324+0000 7f1cf45299c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:22:15.668 INFO:tasks.workunit.client.0.smithi016.stderr: -120> 2024-09-12T17:22:15.324+0000 7f1cf45299c0 20 searching for the correct realm 2024-09-12T17:22:15.668 INFO:tasks.workunit.client.0.smithi016.stderr: -119> 2024-09-12T17:22:15.324+0000 7f1cf202f640 10 monclient: get_auth_request con 0x5636d889dcf0 auth_method 0 2024-09-12T17:22:15.668 INFO:tasks.workunit.client.0.smithi016.stderr: -118> 2024-09-12T17:22:15.324+0000 7f1cf182e640 10 monclient: get_auth_request con 0x7f1ce40d1910 auth_method 0 2024-09-12T17:22:15.668 INFO:tasks.workunit.client.0.smithi016.stderr: -117> 2024-09-12T17:22:15.324+0000 7f1cf2830640 10 monclient: get_auth_request con 0x7f1ce8008050 auth_method 0 2024-09-12T17:22:15.668 INFO:tasks.workunit.client.0.smithi016.stderr: -116> 2024-09-12T17:22:15.328+0000 7f1cf182e640 0 -- 172.21.15.16:0/4136550951 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7f1ce40d1910 msgr2=0x7f1ce40c4400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:22:15.668 INFO:tasks.workunit.client.0.smithi016.stderr: -115> 2024-09-12T17:22:15.328+0000 7f1bc3fff640 1 client.8052.objecter ms_handle_reset 0x7f1ce40d1910 session 0x7f1ce40bd070 osd.7 2024-09-12T17:22:15.668 INFO:tasks.workunit.client.0.smithi016.stderr: -114> 2024-09-12T17:22:15.328+0000 7f1bc3fff640 10 monclient: _renew_subs 2024-09-12T17:22:15.668 INFO:tasks.workunit.client.0.smithi016.stderr: -113> 2024-09-12T17:22:15.328+0000 7f1bc3fff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:22:15.668 INFO:tasks.workunit.client.0.smithi016.stderr: -112> 2024-09-12T17:22:15.328+0000 7f1cf182e640 10 monclient: get_auth_request con 0x7f1bbc080930 auth_method 0 2024-09-12T17:22:15.668 INFO:tasks.workunit.client.0.smithi016.stderr: -111> 2024-09-12T17:22:15.328+0000 7f1cf202f640 10 monclient: get_auth_request con 0x7f1cec081c20 auth_method 0 2024-09-12T17:22:15.668 INFO:tasks.workunit.client.0.smithi016.stderr: -110> 2024-09-12T17:22:15.332+0000 7f1cf182e640 10 monclient: get_auth_request con 0x7f1cec015030 auth_method 0 2024-09-12T17:22:15.669 INFO:tasks.workunit.client.0.smithi016.stderr: -109> 2024-09-12T17:22:15.332+0000 7f1cf182e640 0 -- 172.21.15.16:0/4136550951 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f1cec015030 msgr2=0x7f1cec05d460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:22:15.669 INFO:tasks.workunit.client.0.smithi016.stderr: -108> 2024-09-12T17:22:15.536+0000 7f1cf182e640 10 monclient: get_auth_request con 0x7f1cec015030 auth_method 0 2024-09-12T17:22:15.669 INFO:tasks.workunit.client.0.smithi016.stderr: -107> 2024-09-12T17:22:15.548+0000 7f1cf45299c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:22:15.669 INFO:tasks.workunit.client.0.smithi016.stderr: -106> 2024-09-12T17:22:15.548+0000 7f1cf45299c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:22:15.669 INFO:tasks.workunit.client.0.smithi016.stderr: -105> 2024-09-12T17:22:15.548+0000 7f1cf45299c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:22:15.669 INFO:tasks.workunit.client.0.smithi016.stderr: -104> 2024-09-12T17:22:15.548+0000 7f1cf45299c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:22:15.669 INFO:tasks.workunit.client.0.smithi016.stderr: -103> 2024-09-12T17:22:15.548+0000 7f1cf45299c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:22:15.669 INFO:tasks.workunit.client.0.smithi016.stderr: -102> 2024-09-12T17:22:15.548+0000 7f1cf45299c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:22:15.669 INFO:tasks.workunit.client.0.smithi016.stderr: -101> 2024-09-12T17:22:15.548+0000 7f1cf45299c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.669 INFO:tasks.workunit.client.0.smithi016.stderr: -100> 2024-09-12T17:22:15.548+0000 7f1cf45299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:15.669 INFO:tasks.workunit.client.0.smithi016.stderr: -99> 2024-09-12T17:22:15.548+0000 7f1cf45299c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.669 INFO:tasks.workunit.client.0.smithi016.stderr: -98> 2024-09-12T17:22:15.552+0000 7f1cf45299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:22:15.669 INFO:tasks.workunit.client.0.smithi016.stderr: -97> 2024-09-12T17:22:15.552+0000 7f1cf45299c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.669 INFO:tasks.workunit.client.0.smithi016.stderr: -96> 2024-09-12T17:22:15.552+0000 7f1cf45299c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:22:15.670 INFO:tasks.workunit.client.0.smithi016.stderr: -95> 2024-09-12T17:22:15.552+0000 7f1cf45299c0 20 zone default found 2024-09-12T17:22:15.670 INFO:tasks.workunit.client.0.smithi016.stderr: -94> 2024-09-12T17:22:15.552+0000 7f1cf45299c0 4 Realm: () 2024-09-12T17:22:15.670 INFO:tasks.workunit.client.0.smithi016.stderr: -93> 2024-09-12T17:22:15.552+0000 7f1cf45299c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:22:15.670 INFO:tasks.workunit.client.0.smithi016.stderr: -92> 2024-09-12T17:22:15.552+0000 7f1cf45299c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:22:15.670 INFO:tasks.workunit.client.0.smithi016.stderr: -91> 2024-09-12T17:22:15.552+0000 7f1cf45299c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:22:15.670 INFO:tasks.workunit.client.0.smithi016.stderr: -90> 2024-09-12T17:22:15.552+0000 7f1cf45299c0 20 zonegroup default 2024-09-12T17:22:15.670 INFO:tasks.workunit.client.0.smithi016.stderr: -89> 2024-09-12T17:22:15.552+0000 7f1cf45299c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.670 INFO:tasks.workunit.client.0.smithi016.stderr: -88> 2024-09-12T17:22:15.552+0000 7f1cf45299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:15.670 INFO:tasks.workunit.client.0.smithi016.stderr: -87> 2024-09-12T17:22:15.552+0000 7f1cf45299c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.670 INFO:tasks.workunit.client.0.smithi016.stderr: -86> 2024-09-12T17:22:15.552+0000 7f1cf45299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:15.670 INFO:tasks.workunit.client.0.smithi016.stderr: -85> 2024-09-12T17:22:15.552+0000 7f1cf45299c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.670 INFO:tasks.workunit.client.0.smithi016.stderr: -84> 2024-09-12T17:22:15.552+0000 7f1cf45299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:15.670 INFO:tasks.workunit.client.0.smithi016.stderr: -83> 2024-09-12T17:22:15.552+0000 7f1cf45299c0 20 started sync module instance, tier type = 2024-09-12T17:22:15.670 INFO:tasks.workunit.client.0.smithi016.stderr: -82> 2024-09-12T17:22:15.552+0000 7f1cf45299c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:22:15.671 INFO:tasks.workunit.client.0.smithi016.stderr: -81> 2024-09-12T17:22:15.576+0000 7f1cf45299c0 20 add_watcher() i=0 2024-09-12T17:22:15.671 INFO:tasks.workunit.client.0.smithi016.stderr: -80> 2024-09-12T17:22:15.576+0000 7f1cf45299c0 20 add_watcher() i=1 2024-09-12T17:22:15.671 INFO:tasks.workunit.client.0.smithi016.stderr: -79> 2024-09-12T17:22:15.576+0000 7f1cf45299c0 20 add_watcher() i=2 2024-09-12T17:22:15.671 INFO:tasks.workunit.client.0.smithi016.stderr: -78> 2024-09-12T17:22:15.576+0000 7f1cf45299c0 20 add_watcher() i=3 2024-09-12T17:22:15.671 INFO:tasks.workunit.client.0.smithi016.stderr: -77> 2024-09-12T17:22:15.576+0000 7f1cf45299c0 20 add_watcher() i=4 2024-09-12T17:22:15.671 INFO:tasks.workunit.client.0.smithi016.stderr: -76> 2024-09-12T17:22:15.576+0000 7f1cf45299c0 20 add_watcher() i=5 2024-09-12T17:22:15.671 INFO:tasks.workunit.client.0.smithi016.stderr: -75> 2024-09-12T17:22:15.576+0000 7f1cf45299c0 20 add_watcher() i=6 2024-09-12T17:22:15.671 INFO:tasks.workunit.client.0.smithi016.stderr: -74> 2024-09-12T17:22:15.580+0000 7f1cf45299c0 20 add_watcher() i=7 2024-09-12T17:22:15.671 INFO:tasks.workunit.client.0.smithi016.stderr: -73> 2024-09-12T17:22:15.580+0000 7f1cf45299c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:22:15.671 INFO:tasks.workunit.client.0.smithi016.stderr: -72> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36840) adding auth protocol: cephx 2024-09-12T17:22:15.671 INFO:tasks.workunit.client.0.smithi016.stderr: -71> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36840) adding auth protocol: cephx 2024-09-12T17:22:15.672 INFO:tasks.workunit.client.0.smithi016.stderr: -70> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36840) adding auth protocol: cephx 2024-09-12T17:22:15.672 INFO:tasks.workunit.client.0.smithi016.stderr: -69> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36840) adding con mode: secure 2024-09-12T17:22:15.672 INFO:tasks.workunit.client.0.smithi016.stderr: -68> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36840) adding con mode: crc 2024-09-12T17:22:15.672 INFO:tasks.workunit.client.0.smithi016.stderr: -67> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36840) adding con mode: secure 2024-09-12T17:22:15.672 INFO:tasks.workunit.client.0.smithi016.stderr: -66> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36840) adding con mode: crc 2024-09-12T17:22:15.672 INFO:tasks.workunit.client.0.smithi016.stderr: -65> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36840) adding con mode: secure 2024-09-12T17:22:15.672 INFO:tasks.workunit.client.0.smithi016.stderr: -64> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36840) adding con mode: crc 2024-09-12T17:22:15.672 INFO:tasks.workunit.client.0.smithi016.stderr: -63> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36840) adding con mode: crc 2024-09-12T17:22:15.672 INFO:tasks.workunit.client.0.smithi016.stderr: -62> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36840) adding con mode: secure 2024-09-12T17:22:15.672 INFO:tasks.workunit.client.0.smithi016.stderr: -61> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36840) adding con mode: crc 2024-09-12T17:22:15.672 INFO:tasks.workunit.client.0.smithi016.stderr: -60> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36840) adding con mode: secure 2024-09-12T17:22:15.672 INFO:tasks.workunit.client.0.smithi016.stderr: -59> 2024-09-12T17:22:15.584+0000 7f1ba8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:22:15.672 INFO:tasks.workunit.client.0.smithi016.stderr: -58> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36840) adding con mode: crc 2024-09-12T17:22:15.673 INFO:tasks.workunit.client.0.smithi016.stderr: -57> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36840) adding con mode: secure 2024-09-12T17:22:15.673 INFO:tasks.workunit.client.0.smithi016.stderr: -56> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:15.673 INFO:tasks.workunit.client.0.smithi016.stderr: -55> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:22:15.673 INFO:tasks.workunit.client.0.smithi016.stderr: -54> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:22:15.673 INFO:tasks.workunit.client.0.smithi016.stderr: -53> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 asok(0x5636d85982b0) register_command cache list hook 0x5636d8867bc0 2024-09-12T17:22:15.673 INFO:tasks.workunit.client.0.smithi016.stderr: -52> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 asok(0x5636d85982b0) register_command cache inspect hook 0x5636d8867bc0 2024-09-12T17:22:15.673 INFO:tasks.workunit.client.0.smithi016.stderr: -51> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 asok(0x5636d85982b0) register_command cache erase hook 0x5636d8867bc0 2024-09-12T17:22:15.673 INFO:tasks.workunit.client.0.smithi016.stderr: -50> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 asok(0x5636d85982b0) register_command cache zap hook 0x5636d8867bc0 2024-09-12T17:22:15.673 INFO:tasks.workunit.client.0.smithi016.stderr: -49> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 note: GC not initialized 2024-09-12T17:22:15.673 INFO:tasks.workunit.client.0.smithi016.stderr: -48> 2024-09-12T17:22:15.584+0000 7f1b237fe640 20 reqs_thread_entry: start 2024-09-12T17:22:15.673 INFO:tasks.workunit.client.0.smithi016.stderr: -47> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 asok(0x5636d85982b0) register_command sync trace show hook 0x7f1ce40c7040 2024-09-12T17:22:15.674 INFO:tasks.workunit.client.0.smithi016.stderr: -46> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 asok(0x5636d85982b0) register_command sync trace history hook 0x7f1ce40c7040 2024-09-12T17:22:15.674 INFO:tasks.workunit.client.0.smithi016.stderr: -45> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 asok(0x5636d85982b0) register_command sync trace active hook 0x7f1ce40c7040 2024-09-12T17:22:15.674 INFO:tasks.workunit.client.0.smithi016.stderr: -44> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 asok(0x5636d85982b0) register_command sync trace active_short hook 0x7f1ce40c7040 2024-09-12T17:22:15.674 INFO:tasks.workunit.client.0.smithi016.stderr: -43> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 20 init_complete bucket index max shards: 1 2024-09-12T17:22:15.674 INFO:tasks.workunit.client.0.smithi016.stderr: -42> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 20 Filter name: none 2024-09-12T17:22:15.674 INFO:tasks.workunit.client.0.smithi016.stderr: -41> 2024-09-12T17:22:15.584+0000 7f1b217fa640 20 reqs_thread_entry: start 2024-09-12T17:22:15.674 INFO:tasks.workunit.client.0.smithi016.stderr: -40> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:22:15.674 INFO:tasks.workunit.client.0.smithi016.stderr: -39> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.674 INFO:tasks.workunit.client.0.smithi016.stderr: -38> 2024-09-12T17:22:15.588+0000 7f1cf45299c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:22:15.674 INFO:tasks.workunit.client.0.smithi016.stderr: -37> 2024-09-12T17:22:15.588+0000 7f1cf45299c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:22:15.674 INFO:tasks.workunit.client.0.smithi016.stderr: -36> 2024-09-12T17:22:15.588+0000 7f1cf45299c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:22:15.674 INFO:tasks.workunit.client.0.smithi016.stderr: -35> 2024-09-12T17:22:15.588+0000 7f1cf45299c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 : miss 2024-09-12T17:22:15.674 INFO:tasks.workunit.client.0.smithi016.stderr: -34> 2024-09-12T17:22:15.588+0000 7f1cf45299c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.674 INFO:tasks.workunit.client.0.smithi016.stderr: -33> 2024-09-12T17:22:15.588+0000 7f1cf45299c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:22:15.674 INFO:tasks.workunit.client.0.smithi016.stderr: -32> 2024-09-12T17:22:15.588+0000 7f1cf45299c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:22:15.675 INFO:tasks.workunit.client.0.smithi016.stderr: -31> 2024-09-12T17:22:15.588+0000 7f1cf45299c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:22:15.675 INFO:tasks.workunit.client.0.smithi016.stderr: -30> 2024-09-12T17:22:15.588+0000 7f1cf45299c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:22:15.675 INFO:tasks.workunit.client.0.smithi016.stderr: -29> 2024-09-12T17:22:15.588+0000 7f1cf45299c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:22:15.675 INFO:tasks.workunit.client.0.smithi016.stderr: -28> 2024-09-12T17:22:15.588+0000 7f1cf45299c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 2024-09-12T17:22:15.675 INFO:tasks.workunit.client.0.smithi016.stderr: -27> 2024-09-12T17:22:15.596+0000 7f1cf45299c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:22:15.675 INFO:tasks.workunit.client.0.smithi016.stderr: -26> 2024-09-12T17:22:15.596+0000 7f1cf45299c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:22:15.675 INFO:tasks.workunit.client.0.smithi016.stderr: -25> 2024-09-12T17:22:15.596+0000 7f1cf45299c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:22:15.675 INFO:tasks.workunit.client.0.smithi016.stderr: -24> 2024-09-12T17:22:15.596+0000 7f1cf45299c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17, ofs0, ns] 2024-09-12T17:22:15.675 INFO:tasks.workunit.client.0.smithi016.stderr: -23> 2024-09-12T17:22:15.596+0000 7f1bd5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431627 cookie 94793561161536 notifier 8052 bl.length()=827 2024-09-12T17:22:15.675 INFO:tasks.workunit.client.0.smithi016.stderr: -22> 2024-09-12T17:22:15.596+0000 7f1bd5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:22:15.675 INFO:tasks.workunit.client.0.smithi016.stderr: -21> 2024-09-12T17:22:15.596+0000 7f1bd5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:22:15.675 INFO:tasks.workunit.client.0.smithi016.stderr: -20> 2024-09-12T17:22:15.596+0000 7f1bd5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:22:15.675 INFO:tasks.workunit.client.0.smithi016.stderr: -19> 2024-09-12T17:22:15.596+0000 7f1cf45299c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): orig_sources= new_sources= 2024-09-12T17:22:15.676 INFO:tasks.workunit.client.0.smithi016.stderr: -18> 2024-09-12T17:22:15.596+0000 7f1cf45299c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): potential sources added=[] removed=[] 2024-09-12T17:22:15.676 INFO:tasks.workunit.client.0.smithi016.stderr: -17> 2024-09-12T17:22:15.596+0000 7f1cf45299c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): orig_dests= new_dests= 2024-09-12T17:22:15.676 INFO:tasks.workunit.client.0.smithi016.stderr: -16> 2024-09-12T17:22:15.596+0000 7f1cf45299c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): potential dests added=[] removed=[] 2024-09-12T17:22:15.676 INFO:tasks.workunit.client.0.smithi016.stderr: -15> 2024-09-12T17:22:15.604+0000 7f1cf45299c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.3.0 2024-09-12T17:22:15.676 INFO:tasks.workunit.client.0.smithi016.stderr: -14> 2024-09-12T17:22:15.604+0000 7f1cf45299c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.3.0 2024-09-12T17:22:15.676 INFO:tasks.workunit.client.0.smithi016.stderr: -13> 2024-09-12T17:22:15.604+0000 7f1cf45299c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.3.1 2024-09-12T17:22:15.676 INFO:tasks.workunit.client.0.smithi016.stderr: -12> 2024-09-12T17:22:15.604+0000 7f1cf45299c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.3.1 2024-09-12T17:22:15.676 INFO:tasks.workunit.client.0.smithi016.stderr: -11> 2024-09-12T17:22:15.604+0000 7f1cf45299c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.3.2 2024-09-12T17:22:15.676 INFO:tasks.workunit.client.0.smithi016.stderr: -10> 2024-09-12T17:22:15.604+0000 7f1cf45299c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.3.2 2024-09-12T17:22:15.676 INFO:tasks.workunit.client.0.smithi016.stderr: -9> 2024-09-12T17:22:15.604+0000 7f1cf45299c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.3.3 2024-09-12T17:22:15.676 INFO:tasks.workunit.client.0.smithi016.stderr: -8> 2024-09-12T17:22:15.604+0000 7f1cf45299c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.3.3 2024-09-12T17:22:15.676 INFO:tasks.workunit.client.0.smithi016.stderr: -7> 2024-09-12T17:22:15.604+0000 7f1cf45299c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.0 2024-09-12T17:22:15.676 INFO:tasks.workunit.client.0.smithi016.stderr: -6> 2024-09-12T17:22:15.604+0000 7f1cf45299c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.0 2024-09-12T17:22:15.677 INFO:tasks.workunit.client.0.smithi016.stderr: -5> 2024-09-12T17:22:15.604+0000 7f1cf45299c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.1 2024-09-12T17:22:15.677 INFO:tasks.workunit.client.0.smithi016.stderr: -4> 2024-09-12T17:22:15.604+0000 7f1cf45299c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.1 2024-09-12T17:22:15.677 INFO:tasks.workunit.client.0.smithi016.stderr: -3> 2024-09-12T17:22:15.604+0000 7f1cf45299c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.2 2024-09-12T17:22:15.677 INFO:tasks.workunit.client.0.smithi016.stderr: -2> 2024-09-12T17:22:15.604+0000 7f1cf45299c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.2 2024-09-12T17:22:15.677 INFO:tasks.workunit.client.0.smithi016.stderr: -1> 2024-09-12T17:22:15.608+0000 7f1cf45299c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1cf45299c0 time 2024-09-12T17:22:15.612619+0000 2024-09-12T17:22:15.677 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:22:15.677 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:15.677 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:22:15.677 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f1cf7e032eb] 2024-09-12T17:22:15.677 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1cf7e0349f] 2024-09-12T17:22:15.677 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5636d69820c1] 2024-09-12T17:22:15.677 INFO:tasks.workunit.client.0.smithi016.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5636d69934f1] 2024-09-12T17:22:15.677 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5636d6994b44] 2024-09-12T17:22:15.678 INFO:tasks.workunit.client.0.smithi016.stderr: 6: main() 2024-09-12T17:22:15.678 INFO:tasks.workunit.client.0.smithi016.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1cf6c69d90] 2024-09-12T17:22:15.678 INFO:tasks.workunit.client.0.smithi016.stderr: 8: __libc_start_main() 2024-09-12T17:22:15.678 INFO:tasks.workunit.client.0.smithi016.stderr: 9: _start() 2024-09-12T17:22:15.678 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:15.678 INFO:tasks.workunit.client.0.smithi016.stderr: 0> 2024-09-12T17:22:15.612+0000 7f1cf45299c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:22:15.678 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7f1cf45299c0 thread_name:radosgw-admin 2024-09-12T17:22:15.678 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:15.678 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:22:15.678 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1cf6c82520] 2024-09-12T17:22:15.678 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:22:15.678 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:22:15.678 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:22:15.679 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1cf7e03345] 2024-09-12T17:22:15.679 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1cf7e0349f] 2024-09-12T17:22:15.679 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5636d69820c1] 2024-09-12T17:22:15.679 INFO:tasks.workunit.client.0.smithi016.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5636d69934f1] 2024-09-12T17:22:15.679 INFO:tasks.workunit.client.0.smithi016.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5636d6994b44] 2024-09-12T17:22:15.679 INFO:tasks.workunit.client.0.smithi016.stderr: 10: main() 2024-09-12T17:22:15.679 INFO:tasks.workunit.client.0.smithi016.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1cf6c69d90] 2024-09-12T17:22:15.679 INFO:tasks.workunit.client.0.smithi016.stderr: 12: __libc_start_main() 2024-09-12T17:22:15.679 INFO:tasks.workunit.client.0.smithi016.stderr: 13: _start() 2024-09-12T17:22:15.679 INFO:tasks.workunit.client.0.smithi016.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:22:15.679 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:15.679 INFO:tasks.workunit.client.0.smithi016.stderr:--- logging levels --- 2024-09-12T17:22:15.680 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 none 2024-09-12T17:22:15.680 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 lockdep 2024-09-12T17:22:15.680 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 context 2024-09-12T17:22:15.680 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 crush 2024-09-12T17:22:15.680 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds 2024-09-12T17:22:15.680 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_balancer 2024-09-12T17:22:15.680 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_locker 2024-09-12T17:22:15.680 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log 2024-09-12T17:22:15.680 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log_expire 2024-09-12T17:22:15.680 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_migrator 2024-09-12T17:22:15.680 INFO:tasks.workunit.client.0.smithi016.stderr: 3/ 5 mds_quiesce 2024-09-12T17:22:15.680 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 buffer 2024-09-12T17:22:15.680 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 timer 2024-09-12T17:22:15.680 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 filer 2024-09-12T17:22:15.681 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 striper 2024-09-12T17:22:15.681 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 objecter 2024-09-12T17:22:15.681 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rados 2024-09-12T17:22:15.681 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd 2024-09-12T17:22:15.681 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_mirror 2024-09-12T17:22:15.681 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_replay 2024-09-12T17:22:15.681 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_pwl 2024-09-12T17:22:15.681 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 journaler 2024-09-12T17:22:15.681 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objectcacher 2024-09-12T17:22:15.681 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:22:15.681 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 client 2024-09-12T17:22:15.681 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 osd 2024-09-12T17:22:15.681 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 optracker 2024-09-12T17:22:15.681 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objclass 2024-09-12T17:22:15.681 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 filestore 2024-09-12T17:22:15.682 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 journal 2024-09-12T17:22:15.682 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 ms 2024-09-12T17:22:15.682 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mon 2024-09-12T17:22:15.682 INFO:tasks.workunit.client.0.smithi016.stderr: 0/10 monc 2024-09-12T17:22:15.682 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 paxos 2024-09-12T17:22:15.682 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 tp 2024-09-12T17:22:15.682 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 auth 2024-09-12T17:22:15.682 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 crypto 2024-09-12T17:22:15.682 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 finisher 2024-09-12T17:22:15.682 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 reserver 2024-09-12T17:22:15.682 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 heartbeatmap 2024-09-12T17:22:15.682 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 perfcounter 2024-09-12T17:22:15.682 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw 2024-09-12T17:22:15.682 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_sync 2024-09-12T17:22:15.683 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_datacache 2024-09-12T17:22:15.683 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_access 2024-09-12T17:22:15.683 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:22:15.683 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_flight 2024-09-12T17:22:15.683 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:22:15.683 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw_notification 2024-09-12T17:22:15.683 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 javaclient 2024-09-12T17:22:15.683 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 asok 2024-09-12T17:22:15.683 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 throttle 2024-09-12T17:22:15.683 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 refs 2024-09-12T17:22:15.683 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 compressor 2024-09-12T17:22:15.683 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluestore 2024-09-12T17:22:15.683 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluefs 2024-09-12T17:22:15.684 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 bdev 2024-09-12T17:22:15.684 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 kstore 2024-09-12T17:22:15.684 INFO:tasks.workunit.client.0.smithi016.stderr: 4/ 5 rocksdb 2024-09-12T17:22:15.684 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 fuse 2024-09-12T17:22:15.684 INFO:tasks.workunit.client.0.smithi016.stderr: 2/ 5 mgr 2024-09-12T17:22:15.684 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mgrc 2024-09-12T17:22:15.684 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 dpdk 2024-09-12T17:22:15.684 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 eventtrace 2024-09-12T17:22:15.684 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 prioritycache 2024-09-12T17:22:15.684 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 test 2024-09-12T17:22:15.684 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:22:15.684 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephsqlite 2024-09-12T17:22:15.684 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:22:15.684 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore 2024-09-12T17:22:15.684 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_onode 2024-09-12T17:22:15.685 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_odata 2024-09-12T17:22:15.685 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_omap 2024-09-12T17:22:15.685 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_tm 2024-09-12T17:22:15.685 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_t 2024-09-12T17:22:15.685 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:22:15.685 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_epm 2024-09-12T17:22:15.685 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_lba 2024-09-12T17:22:15.685 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:22:15.685 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cache 2024-09-12T17:22:15.685 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_journal 2024-09-12T17:22:15.685 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_device 2024-09-12T17:22:15.685 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_backref 2024-09-12T17:22:15.685 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 alienstore 2024-09-12T17:22:15.685 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mclock 2024-09-12T17:22:15.686 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cyanstore 2024-09-12T17:22:15.686 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 ceph_exporter 2024-09-12T17:22:15.686 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 memstore 2024-09-12T17:22:15.686 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 trace 2024-09-12T17:22:15.686 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 ceph_dedup 2024-09-12T17:22:15.686 INFO:tasks.workunit.client.0.smithi016.stderr: -2/-2 (syslog threshold) 2024-09-12T17:22:15.686 INFO:tasks.workunit.client.0.smithi016.stderr: 99/99 (stderr threshold) 2024-09-12T17:22:15.686 INFO:tasks.workunit.client.0.smithi016.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:22:15.686 INFO:tasks.workunit.client.0.smithi016.stderr: 7f1b217fa640 / http_manager 2024-09-12T17:22:15.686 INFO:tasks.workunit.client.0.smithi016.stderr: 7f1b237fe640 / http_manager 2024-09-12T17:22:15.686 INFO:tasks.workunit.client.0.smithi016.stderr: 7f1ba8fe1640 / rgw_dt_lg_renew 2024-09-12T17:22:15.686 INFO:tasks.workunit.client.0.smithi016.stderr: 7f1bc3fff640 / ms_dispatch 2024-09-12T17:22:15.686 INFO:tasks.workunit.client.0.smithi016.stderr: 7f1bd5ffb640 / io_context_pool 2024-09-12T17:22:15.686 INFO:tasks.workunit.client.0.smithi016.stderr: 7f1bd7fff640 / ms_dispatch 2024-09-12T17:22:15.686 INFO:tasks.workunit.client.0.smithi016.stderr: 7f1bdee05640 / ms_dispatch 2024-09-12T17:22:15.687 INFO:tasks.workunit.client.0.smithi016.stderr: 7f1be0608640 / io_context_pool 2024-09-12T17:22:15.687 INFO:tasks.workunit.client.0.smithi016.stderr: 7f1cf182e640 / msgr-worker-2 2024-09-12T17:22:15.687 INFO:tasks.workunit.client.0.smithi016.stderr: 7f1cf202f640 / msgr-worker-1 2024-09-12T17:22:15.687 INFO:tasks.workunit.client.0.smithi016.stderr: 7f1cf2830640 / msgr-worker-0 2024-09-12T17:22:15.687 INFO:tasks.workunit.client.0.smithi016.stderr: 7f1cf3031640 / io_context_pool 2024-09-12T17:22:15.687 INFO:tasks.workunit.client.0.smithi016.stderr: 7f1cf45299c0 / radosgw-admin 2024-09-12T17:22:15.687 INFO:tasks.workunit.client.0.smithi016.stderr: max_recent 500 2024-09-12T17:22:15.687 INFO:tasks.workunit.client.0.smithi016.stderr: max_new 1000 2024-09-12T17:22:15.687 INFO:tasks.workunit.client.0.smithi016.stderr: log_file /var/log/ceph/ceph-client.admin.136850.log 2024-09-12T17:22:15.687 INFO:tasks.workunit.client.0.smithi016.stderr:--- end dump of recent events --- 2024-09-12T17:22:15.687 INFO:tasks.workunit.client.0.smithi016.stderr:--- begin dump of recent events --- 2024-09-12T17:22:15.687 INFO:tasks.workunit.client.0.smithi016.stderr: -499> 2024-09-12T17:22:15.292+0000 7f1be0608640 10 monclient: _check_auth_tickets 2024-09-12T17:22:15.687 INFO:tasks.workunit.client.0.smithi016.stderr: -498> 2024-09-12T17:22:15.292+0000 7f1cf45299c0 5 monclient: authenticate success, global_id 7649 2024-09-12T17:22:15.687 INFO:tasks.workunit.client.0.smithi016.stderr: -497> 2024-09-12T17:22:15.292+0000 7f1be0608640 10 monclient: handle_config config(0 keys) 2024-09-12T17:22:15.688 INFO:tasks.workunit.client.0.smithi016.stderr: -496> 2024-09-12T17:22:15.292+0000 7f1cf45299c0 10 monclient: get_monmap_and_config success 2024-09-12T17:22:15.688 INFO:tasks.workunit.client.0.smithi016.stderr: -495> 2024-09-12T17:22:15.292+0000 7f1cf45299c0 4 set_mon_vals no callback set 2024-09-12T17:22:15.688 INFO:tasks.workunit.client.0.smithi016.stderr: -494> 2024-09-12T17:22:15.292+0000 7f1be0608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:22:15.688 INFO:tasks.workunit.client.0.smithi016.stderr: -493> 2024-09-12T17:22:15.292+0000 7f1be0608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:22:15.688 INFO:tasks.workunit.client.0.smithi016.stderr: -492> 2024-09-12T17:22:15.292+0000 7f1be0608640 10 monclient: dump: 2024-09-12T17:22:15.688 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:22:15.688 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:22:15.688 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:15.688 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:15.688 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:22:15.688 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:15.688 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:22:15.688 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:22:15.688 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:22:15.689 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:15.689 INFO:tasks.workunit.client.0.smithi016.stderr: -491> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 10 monclient: shutdown 2024-09-12T17:22:15.689 INFO:tasks.workunit.client.0.smithi016.stderr: -490> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 asok(0x5636d85982b0) unregister_commands rotate-key 2024-09-12T17:22:15.689 INFO:tasks.workunit.client.0.smithi016.stderr: -489> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 10 monclient: build_initial_monmap 2024-09-12T17:22:15.689 INFO:tasks.workunit.client.0.smithi016.stderr: -488> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 1 build_initial for_mkfs: 0 2024-09-12T17:22:15.689 INFO:tasks.workunit.client.0.smithi016.stderr: -487> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 10 monclient: monmap: 2024-09-12T17:22:15.689 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:22:15.689 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:22:15.689 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:22:15.689 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:22:15.689 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:22:15.689 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:15.689 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:22:15.690 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:22:15.690 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:22:15.690 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:15.690 INFO:tasks.workunit.client.0.smithi016.stderr: -486> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87aa520) adding auth protocol: cephx 2024-09-12T17:22:15.690 INFO:tasks.workunit.client.0.smithi016.stderr: -485> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87aa520) adding auth protocol: cephx 2024-09-12T17:22:15.690 INFO:tasks.workunit.client.0.smithi016.stderr: -484> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87aa520) adding auth protocol: cephx 2024-09-12T17:22:15.690 INFO:tasks.workunit.client.0.smithi016.stderr: -483> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87aa520) adding con mode: secure 2024-09-12T17:22:15.690 INFO:tasks.workunit.client.0.smithi016.stderr: -482> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87aa520) adding con mode: crc 2024-09-12T17:22:15.690 INFO:tasks.workunit.client.0.smithi016.stderr: -481> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87aa520) adding con mode: secure 2024-09-12T17:22:15.690 INFO:tasks.workunit.client.0.smithi016.stderr: -480> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87aa520) adding con mode: crc 2024-09-12T17:22:15.690 INFO:tasks.workunit.client.0.smithi016.stderr: -479> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87aa520) adding con mode: secure 2024-09-12T17:22:15.691 INFO:tasks.workunit.client.0.smithi016.stderr: -478> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87aa520) adding con mode: crc 2024-09-12T17:22:15.691 INFO:tasks.workunit.client.0.smithi016.stderr: -477> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87aa520) adding con mode: crc 2024-09-12T17:22:15.691 INFO:tasks.workunit.client.0.smithi016.stderr: -476> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87aa520) adding con mode: secure 2024-09-12T17:22:15.691 INFO:tasks.workunit.client.0.smithi016.stderr: -475> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87aa520) adding con mode: crc 2024-09-12T17:22:15.691 INFO:tasks.workunit.client.0.smithi016.stderr: -474> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87aa520) adding con mode: secure 2024-09-12T17:22:15.691 INFO:tasks.workunit.client.0.smithi016.stderr: -473> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87aa520) adding con mode: crc 2024-09-12T17:22:15.691 INFO:tasks.workunit.client.0.smithi016.stderr: -472> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87aa520) adding con mode: secure 2024-09-12T17:22:15.691 INFO:tasks.workunit.client.0.smithi016.stderr: -471> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:15.691 INFO:tasks.workunit.client.0.smithi016.stderr: -470> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 1 librados: starting msgr at 2024-09-12T17:22:15.691 INFO:tasks.workunit.client.0.smithi016.stderr: -469> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 1 librados: starting objecter 2024-09-12T17:22:15.691 INFO:tasks.workunit.client.0.smithi016.stderr: -468> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 asok(0x5636d85982b0) register_command objecter_requests hook 0x5636d87a66d0 2024-09-12T17:22:15.691 INFO:tasks.workunit.client.0.smithi016.stderr: -467> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 1 librados: setting wanted keys 2024-09-12T17:22:15.691 INFO:tasks.workunit.client.0.smithi016.stderr: -466> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 1 librados: calling monclient init 2024-09-12T17:22:15.691 INFO:tasks.workunit.client.0.smithi016.stderr: -465> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 10 monclient: init 2024-09-12T17:22:15.692 INFO:tasks.workunit.client.0.smithi016.stderr: -464> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87a4d00) adding auth protocol: cephx 2024-09-12T17:22:15.692 INFO:tasks.workunit.client.0.smithi016.stderr: -463> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87a4d00) adding auth protocol: cephx 2024-09-12T17:22:15.692 INFO:tasks.workunit.client.0.smithi016.stderr: -462> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87a4d00) adding auth protocol: cephx 2024-09-12T17:22:15.692 INFO:tasks.workunit.client.0.smithi016.stderr: -461> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87a4d00) adding con mode: secure 2024-09-12T17:22:15.692 INFO:tasks.workunit.client.0.smithi016.stderr: -460> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87a4d00) adding con mode: crc 2024-09-12T17:22:15.692 INFO:tasks.workunit.client.0.smithi016.stderr: -459> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87a4d00) adding con mode: secure 2024-09-12T17:22:15.692 INFO:tasks.workunit.client.0.smithi016.stderr: -458> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87a4d00) adding con mode: crc 2024-09-12T17:22:15.692 INFO:tasks.workunit.client.0.smithi016.stderr: -457> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87a4d00) adding con mode: secure 2024-09-12T17:22:15.692 INFO:tasks.workunit.client.0.smithi016.stderr: -456> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87a4d00) adding con mode: crc 2024-09-12T17:22:15.692 INFO:tasks.workunit.client.0.smithi016.stderr: -455> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87a4d00) adding con mode: crc 2024-09-12T17:22:15.692 INFO:tasks.workunit.client.0.smithi016.stderr: -454> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87a4d00) adding con mode: secure 2024-09-12T17:22:15.692 INFO:tasks.workunit.client.0.smithi016.stderr: -453> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87a4d00) adding con mode: crc 2024-09-12T17:22:15.693 INFO:tasks.workunit.client.0.smithi016.stderr: -452> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87a4d00) adding con mode: secure 2024-09-12T17:22:15.693 INFO:tasks.workunit.client.0.smithi016.stderr: -451> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87a4d00) adding con mode: crc 2024-09-12T17:22:15.693 INFO:tasks.workunit.client.0.smithi016.stderr: -450> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87a4d00) adding con mode: secure 2024-09-12T17:22:15.693 INFO:tasks.workunit.client.0.smithi016.stderr: -449> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:15.693 INFO:tasks.workunit.client.0.smithi016.stderr: -448> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:15.693 INFO:tasks.workunit.client.0.smithi016.stderr: -447> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 asok(0x5636d85982b0) register_command rotate-key hook 0x5636d87a4e48 2024-09-12T17:22:15.693 INFO:tasks.workunit.client.0.smithi016.stderr: -446> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 10 monclient: _reopen_session rank -1 2024-09-12T17:22:15.693 INFO:tasks.workunit.client.0.smithi016.stderr: -445> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:22:15.693 INFO:tasks.workunit.client.0.smithi016.stderr: -444> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 10 monclient(hunting): picked mon.noname-a con 0x5636d8630c70 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:22:15.693 INFO:tasks.workunit.client.0.smithi016.stderr: -443> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 10 monclient(hunting): picked mon.noname-b con 0x5636d865d1e0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:22:15.693 INFO:tasks.workunit.client.0.smithi016.stderr: -442> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 10 monclient(hunting): picked mon.noname-c con 0x5636d87ab8f0 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:22:15.693 INFO:tasks.workunit.client.0.smithi016.stderr: -441> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:15.694 INFO:tasks.workunit.client.0.smithi016.stderr: -440> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:15.694 INFO:tasks.workunit.client.0.smithi016.stderr: -439> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:15.694 INFO:tasks.workunit.client.0.smithi016.stderr: -438> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 10 monclient(hunting): _renew_subs 2024-09-12T17:22:15.694 INFO:tasks.workunit.client.0.smithi016.stderr: -437> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 10 monclient(hunting): authenticate will time out at 2453.273908s 2024-09-12T17:22:15.694 INFO:tasks.workunit.client.0.smithi016.stderr: -436> 2024-09-12T17:22:15.296+0000 7f1cf2830640 10 monclient(hunting): get_auth_request con 0x5636d87ab8f0 auth_method 0 2024-09-12T17:22:15.694 INFO:tasks.workunit.client.0.smithi016.stderr: -435> 2024-09-12T17:22:15.296+0000 7f1cf2830640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:22:15.694 INFO:tasks.workunit.client.0.smithi016.stderr: -434> 2024-09-12T17:22:15.296+0000 7f1cf2830640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:22:15.694 INFO:tasks.workunit.client.0.smithi016.stderr: -433> 2024-09-12T17:22:15.296+0000 7f1cf2830640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:22:15.694 INFO:tasks.workunit.client.0.smithi016.stderr: -432> 2024-09-12T17:22:15.296+0000 7f1cf202f640 10 monclient(hunting): get_auth_request con 0x5636d8630c70 auth_method 0 2024-09-12T17:22:15.694 INFO:tasks.workunit.client.0.smithi016.stderr: -431> 2024-09-12T17:22:15.296+0000 7f1cf202f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:22:15.694 INFO:tasks.workunit.client.0.smithi016.stderr: -430> 2024-09-12T17:22:15.296+0000 7f1cf202f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:22:15.694 INFO:tasks.workunit.client.0.smithi016.stderr: -429> 2024-09-12T17:22:15.296+0000 7f1cf202f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:22:15.695 INFO:tasks.workunit.client.0.smithi016.stderr: -428> 2024-09-12T17:22:15.296+0000 7f1cf2830640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:22:15.695 INFO:tasks.workunit.client.0.smithi016.stderr: -427> 2024-09-12T17:22:15.296+0000 7f1cf2830640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:22:15.695 INFO:tasks.workunit.client.0.smithi016.stderr: -426> 2024-09-12T17:22:15.296+0000 7f1cf2830640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:22:15.695 INFO:tasks.workunit.client.0.smithi016.stderr: -425> 2024-09-12T17:22:15.296+0000 7f1cf202f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:22:15.695 INFO:tasks.workunit.client.0.smithi016.stderr: -424> 2024-09-12T17:22:15.296+0000 7f1cf202f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:22:15.695 INFO:tasks.workunit.client.0.smithi016.stderr: -423> 2024-09-12T17:22:15.296+0000 7f1cf202f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:22:15.695 INFO:tasks.workunit.client.0.smithi016.stderr: -422> 2024-09-12T17:22:15.296+0000 7f1cf182e640 10 monclient(hunting): get_auth_request con 0x5636d865d1e0 auth_method 0 2024-09-12T17:22:15.695 INFO:tasks.workunit.client.0.smithi016.stderr: -421> 2024-09-12T17:22:15.296+0000 7f1cf182e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:22:15.695 INFO:tasks.workunit.client.0.smithi016.stderr: -420> 2024-09-12T17:22:15.296+0000 7f1cf182e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:22:15.695 INFO:tasks.workunit.client.0.smithi016.stderr: -419> 2024-09-12T17:22:15.296+0000 7f1cf182e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:22:15.695 INFO:tasks.workunit.client.0.smithi016.stderr: -418> 2024-09-12T17:22:15.296+0000 7f1cf2830640 10 monclient(hunting): handle_auth_done global_id 7652 payload 824 2024-09-12T17:22:15.695 INFO:tasks.workunit.client.0.smithi016.stderr: -417> 2024-09-12T17:22:15.296+0000 7f1cf2830640 10 monclient: _finish_hunting 0 2024-09-12T17:22:15.695 INFO:tasks.workunit.client.0.smithi016.stderr: -416> 2024-09-12T17:22:15.296+0000 7f1cf2830640 1 monclient: found mon.noname-c 2024-09-12T17:22:15.696 INFO:tasks.workunit.client.0.smithi016.stderr: -415> 2024-09-12T17:22:15.296+0000 7f1cf2830640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:22:15.696 INFO:tasks.workunit.client.0.smithi016.stderr: -414> 2024-09-12T17:22:15.296+0000 7f1bdee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:22:15.696 INFO:tasks.workunit.client.0.smithi016.stderr: -413> 2024-09-12T17:22:15.296+0000 7f1bdee05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:22:15.696 INFO:tasks.workunit.client.0.smithi016.stderr: -412> 2024-09-12T17:22:15.296+0000 7f1bdee05640 10 monclient: dump: 2024-09-12T17:22:15.696 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:22:15.696 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:22:15.696 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:15.696 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:15.696 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:22:15.696 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:15.696 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:22:15.696 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:22:15.697 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:22:15.697 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:15.697 INFO:tasks.workunit.client.0.smithi016.stderr: -411> 2024-09-12T17:22:15.296+0000 7f1bdee05640 10 monclient: _finish_auth 0 2024-09-12T17:22:15.697 INFO:tasks.workunit.client.0.smithi016.stderr: -410> 2024-09-12T17:22:15.296+0000 7f1bdee05640 10 monclient: _check_auth_tickets 2024-09-12T17:22:15.697 INFO:tasks.workunit.client.0.smithi016.stderr: -409> 2024-09-12T17:22:15.296+0000 7f1bdee05640 10 monclient: handle_config config(0 keys) 2024-09-12T17:22:15.697 INFO:tasks.workunit.client.0.smithi016.stderr: -408> 2024-09-12T17:22:15.296+0000 7f1bdee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:22:15.697 INFO:tasks.workunit.client.0.smithi016.stderr: -407> 2024-09-12T17:22:15.296+0000 7f1bdee05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:22:15.697 INFO:tasks.workunit.client.0.smithi016.stderr: -406> 2024-09-12T17:22:15.296+0000 7f1bdee05640 10 monclient: dump: 2024-09-12T17:22:15.697 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:22:15.697 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:22:15.697 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:15.697 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:15.698 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:22:15.698 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:15.698 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:22:15.698 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:22:15.698 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:22:15.698 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:15.698 INFO:tasks.workunit.client.0.smithi016.stderr: -405> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 5 monclient: authenticate success, global_id 7652 2024-09-12T17:22:15.698 INFO:tasks.workunit.client.0.smithi016.stderr: -404> 2024-09-12T17:22:15.296+0000 7f1be0608640 4 set_mon_vals no callback set 2024-09-12T17:22:15.698 INFO:tasks.workunit.client.0.smithi016.stderr: -403> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 10 monclient: _renew_subs 2024-09-12T17:22:15.698 INFO:tasks.workunit.client.0.smithi016.stderr: -402> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:22:15.698 INFO:tasks.workunit.client.0.smithi016.stderr: -401> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 10 monclient: _renew_subs 2024-09-12T17:22:15.698 INFO:tasks.workunit.client.0.smithi016.stderr: -400> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:22:15.698 INFO:tasks.workunit.client.0.smithi016.stderr: -399> 2024-09-12T17:22:15.296+0000 7f1cf45299c0 1 librados: init done 2024-09-12T17:22:15.698 INFO:tasks.workunit.client.0.smithi016.stderr: -398> 2024-09-12T17:22:15.300+0000 7f1bdee05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:22:15.699 INFO:tasks.workunit.client.0.smithi016.stderr: -397> 2024-09-12T17:22:15.300+0000 7f1bdee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:22:15.699 INFO:tasks.workunit.client.0.smithi016.stderr: -396> 2024-09-12T17:22:15.300+0000 7f1bdee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:22:15.699 INFO:tasks.workunit.client.0.smithi016.stderr: -395> 2024-09-12T17:22:15.300+0000 7f1cf202f640 10 monclient: get_auth_request con 0x7f1bd8070ae0 auth_method 0 2024-09-12T17:22:15.699 INFO:tasks.workunit.client.0.smithi016.stderr: -394> 2024-09-12T17:22:15.300+0000 7f1cf182e640 10 monclient: get_auth_request con 0x5636d87ed5a0 auth_method 0 2024-09-12T17:22:15.699 INFO:tasks.workunit.client.0.smithi016.stderr: -393> 2024-09-12T17:22:15.300+0000 7f1cf202f640 10 monclient: get_auth_request con 0x5636d87f03e0 auth_method 0 2024-09-12T17:22:15.699 INFO:tasks.workunit.client.0.smithi016.stderr: -392> 2024-09-12T17:22:15.304+0000 7f1cf182e640 10 monclient: get_auth_request con 0x5636d87f4660 auth_method 0 2024-09-12T17:22:15.699 INFO:tasks.workunit.client.0.smithi016.stderr: -391> 2024-09-12T17:22:15.304+0000 7f1cf2830640 10 monclient: get_auth_request con 0x5636d87f3c60 auth_method 0 2024-09-12T17:22:15.699 INFO:tasks.workunit.client.0.smithi016.stderr: -390> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 10 monclient: build_initial_monmap 2024-09-12T17:22:15.699 INFO:tasks.workunit.client.0.smithi016.stderr: -389> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 1 build_initial for_mkfs: 0 2024-09-12T17:22:15.699 INFO:tasks.workunit.client.0.smithi016.stderr: -388> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 10 monclient: monmap: 2024-09-12T17:22:15.699 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:22:15.699 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:22:15.699 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:22:15.700 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:22:15.700 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:22:15.700 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:15.700 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:22:15.700 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:22:15.700 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:22:15.700 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:15.700 INFO:tasks.workunit.client.0.smithi016.stderr: -387> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fc7c0) adding auth protocol: cephx 2024-09-12T17:22:15.700 INFO:tasks.workunit.client.0.smithi016.stderr: -386> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fc7c0) adding auth protocol: cephx 2024-09-12T17:22:15.700 INFO:tasks.workunit.client.0.smithi016.stderr: -385> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fc7c0) adding auth protocol: cephx 2024-09-12T17:22:15.700 INFO:tasks.workunit.client.0.smithi016.stderr: -384> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fc7c0) adding con mode: secure 2024-09-12T17:22:15.700 INFO:tasks.workunit.client.0.smithi016.stderr: -383> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fc7c0) adding con mode: crc 2024-09-12T17:22:15.701 INFO:tasks.workunit.client.0.smithi016.stderr: -382> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fc7c0) adding con mode: secure 2024-09-12T17:22:15.701 INFO:tasks.workunit.client.0.smithi016.stderr: -381> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fc7c0) adding con mode: crc 2024-09-12T17:22:15.701 INFO:tasks.workunit.client.0.smithi016.stderr: -380> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fc7c0) adding con mode: secure 2024-09-12T17:22:15.701 INFO:tasks.workunit.client.0.smithi016.stderr: -379> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fc7c0) adding con mode: crc 2024-09-12T17:22:15.701 INFO:tasks.workunit.client.0.smithi016.stderr: -378> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fc7c0) adding con mode: crc 2024-09-12T17:22:15.701 INFO:tasks.workunit.client.0.smithi016.stderr: -377> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fc7c0) adding con mode: secure 2024-09-12T17:22:15.701 INFO:tasks.workunit.client.0.smithi016.stderr: -376> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fc7c0) adding con mode: crc 2024-09-12T17:22:15.701 INFO:tasks.workunit.client.0.smithi016.stderr: -375> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fc7c0) adding con mode: secure 2024-09-12T17:22:15.701 INFO:tasks.workunit.client.0.smithi016.stderr: -374> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fc7c0) adding con mode: crc 2024-09-12T17:22:15.701 INFO:tasks.workunit.client.0.smithi016.stderr: -373> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fc7c0) adding con mode: secure 2024-09-12T17:22:15.701 INFO:tasks.workunit.client.0.smithi016.stderr: -372> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:15.702 INFO:tasks.workunit.client.0.smithi016.stderr: -371> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 asok(0x5636d85982b0) register_command objecter_requests cmddesc objecter_requests hook 0x5636d88001f0 EEXIST 2024-09-12T17:22:15.702 INFO:tasks.workunit.client.0.smithi016.stderr: -370> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 10 monclient: init 2024-09-12T17:22:15.702 INFO:tasks.workunit.client.0.smithi016.stderr: -369> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fb708) adding auth protocol: cephx 2024-09-12T17:22:15.702 INFO:tasks.workunit.client.0.smithi016.stderr: -368> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fb708) adding auth protocol: cephx 2024-09-12T17:22:15.702 INFO:tasks.workunit.client.0.smithi016.stderr: -367> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fb708) adding auth protocol: cephx 2024-09-12T17:22:15.702 INFO:tasks.workunit.client.0.smithi016.stderr: -366> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fb708) adding con mode: secure 2024-09-12T17:22:15.702 INFO:tasks.workunit.client.0.smithi016.stderr: -365> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fb708) adding con mode: crc 2024-09-12T17:22:15.702 INFO:tasks.workunit.client.0.smithi016.stderr: -364> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fb708) adding con mode: secure 2024-09-12T17:22:15.702 INFO:tasks.workunit.client.0.smithi016.stderr: -363> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fb708) adding con mode: crc 2024-09-12T17:22:15.702 INFO:tasks.workunit.client.0.smithi016.stderr: -362> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fb708) adding con mode: secure 2024-09-12T17:22:15.702 INFO:tasks.workunit.client.0.smithi016.stderr: -361> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fb708) adding con mode: crc 2024-09-12T17:22:15.702 INFO:tasks.workunit.client.0.smithi016.stderr: -360> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fb708) adding con mode: crc 2024-09-12T17:22:15.702 INFO:tasks.workunit.client.0.smithi016.stderr: -359> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fb708) adding con mode: secure 2024-09-12T17:22:15.702 INFO:tasks.workunit.client.0.smithi016.stderr: -358> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fb708) adding con mode: crc 2024-09-12T17:22:15.702 INFO:tasks.workunit.client.0.smithi016.stderr: -357> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fb708) adding con mode: secure 2024-09-12T17:22:15.703 INFO:tasks.workunit.client.0.smithi016.stderr: -356> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fb708) adding con mode: crc 2024-09-12T17:22:15.703 INFO:tasks.workunit.client.0.smithi016.stderr: -355> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 AuthRegistry(0x5636d87fb708) adding con mode: secure 2024-09-12T17:22:15.703 INFO:tasks.workunit.client.0.smithi016.stderr: -354> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:15.703 INFO:tasks.workunit.client.0.smithi016.stderr: -353> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:15.703 INFO:tasks.workunit.client.0.smithi016.stderr: -352> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 asok(0x5636d85982b0) register_command rotate-key cmddesc rotate-key hook 0x5636d87fb850 EEXIST 2024-09-12T17:22:15.703 INFO:tasks.workunit.client.0.smithi016.stderr: -351> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 10 monclient: _reopen_session rank -1 2024-09-12T17:22:15.703 INFO:tasks.workunit.client.0.smithi016.stderr: -350> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:22:15.703 INFO:tasks.workunit.client.0.smithi016.stderr: -349> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 10 monclient(hunting): picked mon.noname-c con 0x5636d88243a0 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:22:15.703 INFO:tasks.workunit.client.0.smithi016.stderr: -348> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 10 monclient(hunting): picked mon.noname-b con 0x5636d8823cd0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:22:15.703 INFO:tasks.workunit.client.0.smithi016.stderr: -347> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 10 monclient(hunting): picked mon.noname-a con 0x5636d88226b0 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:22:15.703 INFO:tasks.workunit.client.0.smithi016.stderr: -346> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:15.703 INFO:tasks.workunit.client.0.smithi016.stderr: -345> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:15.703 INFO:tasks.workunit.client.0.smithi016.stderr: -344> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:15.704 INFO:tasks.workunit.client.0.smithi016.stderr: -343> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 10 monclient(hunting): _renew_subs 2024-09-12T17:22:15.704 INFO:tasks.workunit.client.0.smithi016.stderr: -342> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 10 monclient(hunting): authenticate will time out at 2453.285273s 2024-09-12T17:22:15.704 INFO:tasks.workunit.client.0.smithi016.stderr: -341> 2024-09-12T17:22:15.308+0000 7f1cf182e640 10 monclient(hunting): get_auth_request con 0x5636d88243a0 auth_method 0 2024-09-12T17:22:15.704 INFO:tasks.workunit.client.0.smithi016.stderr: -340> 2024-09-12T17:22:15.308+0000 7f1cf182e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:22:15.704 INFO:tasks.workunit.client.0.smithi016.stderr: -339> 2024-09-12T17:22:15.308+0000 7f1cf182e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:22:15.704 INFO:tasks.workunit.client.0.smithi016.stderr: -338> 2024-09-12T17:22:15.308+0000 7f1cf182e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:22:15.704 INFO:tasks.workunit.client.0.smithi016.stderr: -337> 2024-09-12T17:22:15.308+0000 7f1cf202f640 10 monclient(hunting): get_auth_request con 0x5636d88226b0 auth_method 0 2024-09-12T17:22:15.704 INFO:tasks.workunit.client.0.smithi016.stderr: -336> 2024-09-12T17:22:15.308+0000 7f1cf202f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:22:15.704 INFO:tasks.workunit.client.0.smithi016.stderr: -335> 2024-09-12T17:22:15.308+0000 7f1cf202f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:22:15.704 INFO:tasks.workunit.client.0.smithi016.stderr: -334> 2024-09-12T17:22:15.308+0000 7f1cf202f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:22:15.704 INFO:tasks.workunit.client.0.smithi016.stderr: -333> 2024-09-12T17:22:15.308+0000 7f1cf182e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:22:15.704 INFO:tasks.workunit.client.0.smithi016.stderr: -332> 2024-09-12T17:22:15.308+0000 7f1cf182e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:22:15.705 INFO:tasks.workunit.client.0.smithi016.stderr: -331> 2024-09-12T17:22:15.308+0000 7f1cf182e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:22:15.705 INFO:tasks.workunit.client.0.smithi016.stderr: -330> 2024-09-12T17:22:15.308+0000 7f1cf202f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:22:15.705 INFO:tasks.workunit.client.0.smithi016.stderr: -329> 2024-09-12T17:22:15.308+0000 7f1cf202f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:22:15.705 INFO:tasks.workunit.client.0.smithi016.stderr: -328> 2024-09-12T17:22:15.308+0000 7f1cf202f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:22:15.705 INFO:tasks.workunit.client.0.smithi016.stderr: -327> 2024-09-12T17:22:15.308+0000 7f1cf182e640 10 monclient(hunting): handle_auth_done global_id 7655 payload 824 2024-09-12T17:22:15.705 INFO:tasks.workunit.client.0.smithi016.stderr: -326> 2024-09-12T17:22:15.308+0000 7f1cf182e640 10 monclient: _finish_hunting 0 2024-09-12T17:22:15.705 INFO:tasks.workunit.client.0.smithi016.stderr: -325> 2024-09-12T17:22:15.308+0000 7f1cf182e640 1 monclient: found mon.noname-c 2024-09-12T17:22:15.705 INFO:tasks.workunit.client.0.smithi016.stderr: -324> 2024-09-12T17:22:15.308+0000 7f1cf182e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:22:15.705 INFO:tasks.workunit.client.0.smithi016.stderr: -323> 2024-09-12T17:22:15.308+0000 7f1bd7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:22:15.705 INFO:tasks.workunit.client.0.smithi016.stderr: -322> 2024-09-12T17:22:15.308+0000 7f1bd7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:22:15.705 INFO:tasks.workunit.client.0.smithi016.stderr: -321> 2024-09-12T17:22:15.308+0000 7f1bd7fff640 10 monclient: dump: 2024-09-12T17:22:15.705 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:22:15.706 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:22:15.706 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:15.706 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:15.706 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:22:15.706 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:15.706 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:22:15.706 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:22:15.706 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:22:15.706 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:15.706 INFO:tasks.workunit.client.0.smithi016.stderr: -320> 2024-09-12T17:22:15.308+0000 7f1bd7fff640 10 monclient: _finish_auth 0 2024-09-12T17:22:15.706 INFO:tasks.workunit.client.0.smithi016.stderr: -319> 2024-09-12T17:22:15.308+0000 7f1bd7fff640 10 monclient: _check_auth_tickets 2024-09-12T17:22:15.706 INFO:tasks.workunit.client.0.smithi016.stderr: -318> 2024-09-12T17:22:15.308+0000 7f1bd7fff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:22:15.706 INFO:tasks.workunit.client.0.smithi016.stderr: -317> 2024-09-12T17:22:15.308+0000 7f1bd7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:22:15.707 INFO:tasks.workunit.client.0.smithi016.stderr: -316> 2024-09-12T17:22:15.308+0000 7f1bd7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:22:15.707 INFO:tasks.workunit.client.0.smithi016.stderr: -315> 2024-09-12T17:22:15.308+0000 7f1bd7fff640 10 monclient: dump: 2024-09-12T17:22:15.707 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:22:15.707 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:22:15.707 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:15.707 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:15.707 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:22:15.707 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:15.707 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:22:15.707 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:22:15.707 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:22:15.707 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:15.708 INFO:tasks.workunit.client.0.smithi016.stderr: -314> 2024-09-12T17:22:15.308+0000 7f1cf3031640 4 set_mon_vals no callback set 2024-09-12T17:22:15.708 INFO:tasks.workunit.client.0.smithi016.stderr: -313> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 5 monclient: authenticate success, global_id 7655 2024-09-12T17:22:15.708 INFO:tasks.workunit.client.0.smithi016.stderr: -312> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 10 monclient: _renew_subs 2024-09-12T17:22:15.708 INFO:tasks.workunit.client.0.smithi016.stderr: -311> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:22:15.708 INFO:tasks.workunit.client.0.smithi016.stderr: -310> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 10 monclient: _renew_subs 2024-09-12T17:22:15.708 INFO:tasks.workunit.client.0.smithi016.stderr: -309> 2024-09-12T17:22:15.308+0000 7f1cf45299c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:22:15.708 INFO:tasks.workunit.client.0.smithi016.stderr: -308> 2024-09-12T17:22:15.312+0000 7f1bd7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:22:15.708 INFO:tasks.workunit.client.0.smithi016.stderr: -307> 2024-09-12T17:22:15.312+0000 7f1bd7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:22:15.708 INFO:tasks.workunit.client.0.smithi016.stderr: -306> 2024-09-12T17:22:15.312+0000 7f1bd7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:22:15.708 INFO:tasks.workunit.client.0.smithi016.stderr: -305> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 10 monclient: get_monmap_and_config 2024-09-12T17:22:15.708 INFO:tasks.workunit.client.0.smithi016.stderr: -304> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 10 monclient: build_initial_monmap 2024-09-12T17:22:15.708 INFO:tasks.workunit.client.0.smithi016.stderr: -303> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 1 build_initial for_mkfs: 0 2024-09-12T17:22:15.709 INFO:tasks.workunit.client.0.smithi016.stderr: -302> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 10 monclient: monmap: 2024-09-12T17:22:15.709 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:22:15.709 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:22:15.709 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:22:15.709 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:22:15.709 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:22:15.709 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:15.709 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:22:15.709 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:22:15.709 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:22:15.709 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:15.710 INFO:tasks.workunit.client.0.smithi016.stderr: -301> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843bf0) adding auth protocol: cephx 2024-09-12T17:22:15.710 INFO:tasks.workunit.client.0.smithi016.stderr: -300> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843bf0) adding auth protocol: cephx 2024-09-12T17:22:15.710 INFO:tasks.workunit.client.0.smithi016.stderr: -299> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843bf0) adding auth protocol: cephx 2024-09-12T17:22:15.710 INFO:tasks.workunit.client.0.smithi016.stderr: -298> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843bf0) adding con mode: secure 2024-09-12T17:22:15.710 INFO:tasks.workunit.client.0.smithi016.stderr: -297> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843bf0) adding con mode: crc 2024-09-12T17:22:15.710 INFO:tasks.workunit.client.0.smithi016.stderr: -296> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843bf0) adding con mode: secure 2024-09-12T17:22:15.710 INFO:tasks.workunit.client.0.smithi016.stderr: -295> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843bf0) adding con mode: crc 2024-09-12T17:22:15.710 INFO:tasks.workunit.client.0.smithi016.stderr: -294> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843bf0) adding con mode: secure 2024-09-12T17:22:15.710 INFO:tasks.workunit.client.0.smithi016.stderr: -293> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843bf0) adding con mode: crc 2024-09-12T17:22:15.710 INFO:tasks.workunit.client.0.smithi016.stderr: -292> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843bf0) adding con mode: crc 2024-09-12T17:22:15.710 INFO:tasks.workunit.client.0.smithi016.stderr: -291> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843bf0) adding con mode: secure 2024-09-12T17:22:15.710 INFO:tasks.workunit.client.0.smithi016.stderr: -290> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843bf0) adding con mode: crc 2024-09-12T17:22:15.711 INFO:tasks.workunit.client.0.smithi016.stderr: -289> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843bf0) adding con mode: secure 2024-09-12T17:22:15.711 INFO:tasks.workunit.client.0.smithi016.stderr: -288> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843bf0) adding con mode: crc 2024-09-12T17:22:15.711 INFO:tasks.workunit.client.0.smithi016.stderr: -287> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843bf0) adding con mode: secure 2024-09-12T17:22:15.711 INFO:tasks.workunit.client.0.smithi016.stderr: -286> 2024-09-12T17:22:15.312+0000 7f1cf2830640 10 monclient: get_auth_request con 0x7f1bcc070a20 auth_method 0 2024-09-12T17:22:15.711 INFO:tasks.workunit.client.0.smithi016.stderr: -285> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:15.711 INFO:tasks.workunit.client.0.smithi016.stderr: -284> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 10 monclient: init 2024-09-12T17:22:15.711 INFO:tasks.workunit.client.0.smithi016.stderr: -283> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36370) adding auth protocol: cephx 2024-09-12T17:22:15.711 INFO:tasks.workunit.client.0.smithi016.stderr: -282> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36370) adding auth protocol: cephx 2024-09-12T17:22:15.711 INFO:tasks.workunit.client.0.smithi016.stderr: -281> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36370) adding auth protocol: cephx 2024-09-12T17:22:15.711 INFO:tasks.workunit.client.0.smithi016.stderr: -280> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36370) adding con mode: secure 2024-09-12T17:22:15.711 INFO:tasks.workunit.client.0.smithi016.stderr: -279> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36370) adding con mode: crc 2024-09-12T17:22:15.712 INFO:tasks.workunit.client.0.smithi016.stderr: -278> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36370) adding con mode: secure 2024-09-12T17:22:15.712 INFO:tasks.workunit.client.0.smithi016.stderr: -277> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36370) adding con mode: crc 2024-09-12T17:22:15.712 INFO:tasks.workunit.client.0.smithi016.stderr: -276> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36370) adding con mode: secure 2024-09-12T17:22:15.712 INFO:tasks.workunit.client.0.smithi016.stderr: -275> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36370) adding con mode: crc 2024-09-12T17:22:15.712 INFO:tasks.workunit.client.0.smithi016.stderr: -274> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36370) adding con mode: crc 2024-09-12T17:22:15.712 INFO:tasks.workunit.client.0.smithi016.stderr: -273> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36370) adding con mode: secure 2024-09-12T17:22:15.712 INFO:tasks.workunit.client.0.smithi016.stderr: -272> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36370) adding con mode: crc 2024-09-12T17:22:15.712 INFO:tasks.workunit.client.0.smithi016.stderr: -271> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36370) adding con mode: secure 2024-09-12T17:22:15.712 INFO:tasks.workunit.client.0.smithi016.stderr: -270> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36370) adding con mode: crc 2024-09-12T17:22:15.712 INFO:tasks.workunit.client.0.smithi016.stderr: -269> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36370) adding con mode: secure 2024-09-12T17:22:15.712 INFO:tasks.workunit.client.0.smithi016.stderr: -268> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:15.713 INFO:tasks.workunit.client.0.smithi016.stderr: -267> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:15.713 INFO:tasks.workunit.client.0.smithi016.stderr: -266> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 asok(0x5636d85982b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc4aa364b8 EEXIST 2024-09-12T17:22:15.713 INFO:tasks.workunit.client.0.smithi016.stderr: -265> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 10 monclient: _reopen_session rank -1 2024-09-12T17:22:15.713 INFO:tasks.workunit.client.0.smithi016.stderr: -264> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:22:15.713 INFO:tasks.workunit.client.0.smithi016.stderr: -263> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 10 monclient(hunting): picked mon.noname-a con 0x5636d8878090 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:22:15.713 INFO:tasks.workunit.client.0.smithi016.stderr: -262> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 10 monclient(hunting): picked mon.noname-b con 0x5636d8868d50 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:22:15.713 INFO:tasks.workunit.client.0.smithi016.stderr: -261> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 10 monclient(hunting): picked mon.noname-c con 0x5636d88734d0 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:22:15.713 INFO:tasks.workunit.client.0.smithi016.stderr: -260> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:15.713 INFO:tasks.workunit.client.0.smithi016.stderr: -259> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:15.713 INFO:tasks.workunit.client.0.smithi016.stderr: -258> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:15.713 INFO:tasks.workunit.client.0.smithi016.stderr: -257> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 10 monclient(hunting): _renew_subs 2024-09-12T17:22:15.713 INFO:tasks.workunit.client.0.smithi016.stderr: -256> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 10 monclient(hunting): authenticate will time out at 2453.290119s 2024-09-12T17:22:15.713 INFO:tasks.workunit.client.0.smithi016.stderr: -255> 2024-09-12T17:22:15.312+0000 7f1cf182e640 10 monclient(hunting): get_auth_request con 0x5636d8878090 auth_method 0 2024-09-12T17:22:15.714 INFO:tasks.workunit.client.0.smithi016.stderr: -254> 2024-09-12T17:22:15.312+0000 7f1cf182e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:22:15.714 INFO:tasks.workunit.client.0.smithi016.stderr: -253> 2024-09-12T17:22:15.312+0000 7f1cf182e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:22:15.714 INFO:tasks.workunit.client.0.smithi016.stderr: -252> 2024-09-12T17:22:15.312+0000 7f1cf182e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:22:15.714 INFO:tasks.workunit.client.0.smithi016.stderr: -251> 2024-09-12T17:22:15.312+0000 7f1cf182e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:22:15.714 INFO:tasks.workunit.client.0.smithi016.stderr: -250> 2024-09-12T17:22:15.312+0000 7f1cf182e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:22:15.714 INFO:tasks.workunit.client.0.smithi016.stderr: -249> 2024-09-12T17:22:15.312+0000 7f1cf182e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:22:15.714 INFO:tasks.workunit.client.0.smithi016.stderr: -248> 2024-09-12T17:22:15.312+0000 7f1cf202f640 10 monclient(hunting): get_auth_request con 0x5636d88734d0 auth_method 0 2024-09-12T17:22:15.714 INFO:tasks.workunit.client.0.smithi016.stderr: -247> 2024-09-12T17:22:15.312+0000 7f1cf202f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:22:15.714 INFO:tasks.workunit.client.0.smithi016.stderr: -246> 2024-09-12T17:22:15.312+0000 7f1cf202f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:22:15.714 INFO:tasks.workunit.client.0.smithi016.stderr: -245> 2024-09-12T17:22:15.312+0000 7f1cf202f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:22:15.714 INFO:tasks.workunit.client.0.smithi016.stderr: -244> 2024-09-12T17:22:15.312+0000 7f1cf182e640 10 monclient(hunting): handle_auth_done global_id 8049 payload 274 2024-09-12T17:22:15.714 INFO:tasks.workunit.client.0.smithi016.stderr: -243> 2024-09-12T17:22:15.312+0000 7f1cf182e640 10 monclient: _finish_hunting 0 2024-09-12T17:22:15.714 INFO:tasks.workunit.client.0.smithi016.stderr: -242> 2024-09-12T17:22:15.312+0000 7f1cf182e640 1 monclient: found mon.noname-a 2024-09-12T17:22:15.714 INFO:tasks.workunit.client.0.smithi016.stderr: -241> 2024-09-12T17:22:15.312+0000 7f1cf182e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:22:15.715 INFO:tasks.workunit.client.0.smithi016.stderr: -240> 2024-09-12T17:22:15.312+0000 7f1bd5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:22:15.715 INFO:tasks.workunit.client.0.smithi016.stderr: -239> 2024-09-12T17:22:15.312+0000 7f1bd5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:22:15.715 INFO:tasks.workunit.client.0.smithi016.stderr: -238> 2024-09-12T17:22:15.312+0000 7f1bd5ffb640 10 monclient: dump: 2024-09-12T17:22:15.715 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:22:15.715 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:22:15.715 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:15.715 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:15.715 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:22:15.715 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:15.715 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:22:15.715 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:22:15.715 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:22:15.715 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:15.715 INFO:tasks.workunit.client.0.smithi016.stderr: -237> 2024-09-12T17:22:15.312+0000 7f1bd5ffb640 10 monclient: _finish_auth 0 2024-09-12T17:22:15.715 INFO:tasks.workunit.client.0.smithi016.stderr: -236> 2024-09-12T17:22:15.312+0000 7f1bd5ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:22:15.716 INFO:tasks.workunit.client.0.smithi016.stderr: -235> 2024-09-12T17:22:15.312+0000 7f1bd5ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:22:15.716 INFO:tasks.workunit.client.0.smithi016.stderr: -234> 2024-09-12T17:22:15.312+0000 7f1bd5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:22:15.716 INFO:tasks.workunit.client.0.smithi016.stderr: -233> 2024-09-12T17:22:15.312+0000 7f1bd5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:22:15.716 INFO:tasks.workunit.client.0.smithi016.stderr: -232> 2024-09-12T17:22:15.312+0000 7f1bd5ffb640 10 monclient: dump: 2024-09-12T17:22:15.716 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:22:15.716 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:22:15.716 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:15.716 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:15.716 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:22:15.716 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:15.716 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:22:15.716 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:22:15.716 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:22:15.717 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:15.717 INFO:tasks.workunit.client.0.smithi016.stderr: -231> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 monclient: authenticate success, global_id 8049 2024-09-12T17:22:15.717 INFO:tasks.workunit.client.0.smithi016.stderr: -230> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 10 monclient: get_monmap_and_config success 2024-09-12T17:22:15.717 INFO:tasks.workunit.client.0.smithi016.stderr: -229> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 4 set_mon_vals no callback set 2024-09-12T17:22:15.717 INFO:tasks.workunit.client.0.smithi016.stderr: -228> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 10 monclient: shutdown 2024-09-12T17:22:15.717 INFO:tasks.workunit.client.0.smithi016.stderr: -227> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 10 monclient: build_initial_monmap 2024-09-12T17:22:15.717 INFO:tasks.workunit.client.0.smithi016.stderr: -226> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 1 build_initial for_mkfs: 0 2024-09-12T17:22:15.717 INFO:tasks.workunit.client.0.smithi016.stderr: -225> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 10 monclient: monmap: 2024-09-12T17:22:15.717 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:22:15.717 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:22:15.717 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:22:15.717 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:22:15.717 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:22:15.718 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:15.718 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:22:15.718 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:22:15.718 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:22:15.718 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:15.718 INFO:tasks.workunit.client.0.smithi016.stderr: -224> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843ba0) adding auth protocol: cephx 2024-09-12T17:22:15.718 INFO:tasks.workunit.client.0.smithi016.stderr: -223> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843ba0) adding auth protocol: cephx 2024-09-12T17:22:15.718 INFO:tasks.workunit.client.0.smithi016.stderr: -222> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843ba0) adding auth protocol: cephx 2024-09-12T17:22:15.718 INFO:tasks.workunit.client.0.smithi016.stderr: -221> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843ba0) adding con mode: secure 2024-09-12T17:22:15.718 INFO:tasks.workunit.client.0.smithi016.stderr: -220> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843ba0) adding con mode: crc 2024-09-12T17:22:15.718 INFO:tasks.workunit.client.0.smithi016.stderr: -219> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843ba0) adding con mode: secure 2024-09-12T17:22:15.718 INFO:tasks.workunit.client.0.smithi016.stderr: -218> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843ba0) adding con mode: crc 2024-09-12T17:22:15.718 INFO:tasks.workunit.client.0.smithi016.stderr: -217> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843ba0) adding con mode: secure 2024-09-12T17:22:15.718 INFO:tasks.workunit.client.0.smithi016.stderr: -216> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843ba0) adding con mode: crc 2024-09-12T17:22:15.718 INFO:tasks.workunit.client.0.smithi016.stderr: -215> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843ba0) adding con mode: crc 2024-09-12T17:22:15.719 INFO:tasks.workunit.client.0.smithi016.stderr: -214> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843ba0) adding con mode: secure 2024-09-12T17:22:15.719 INFO:tasks.workunit.client.0.smithi016.stderr: -213> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843ba0) adding con mode: crc 2024-09-12T17:22:15.719 INFO:tasks.workunit.client.0.smithi016.stderr: -212> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843ba0) adding con mode: secure 2024-09-12T17:22:15.719 INFO:tasks.workunit.client.0.smithi016.stderr: -211> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843ba0) adding con mode: crc 2024-09-12T17:22:15.719 INFO:tasks.workunit.client.0.smithi016.stderr: -210> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 5 AuthRegistry(0x5636d8843ba0) adding con mode: secure 2024-09-12T17:22:15.719 INFO:tasks.workunit.client.0.smithi016.stderr: -209> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:15.719 INFO:tasks.workunit.client.0.smithi016.stderr: -208> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 1 librados: starting msgr at 2024-09-12T17:22:15.719 INFO:tasks.workunit.client.0.smithi016.stderr: -207> 2024-09-12T17:22:15.312+0000 7f1cf45299c0 1 librados: starting objecter 2024-09-12T17:22:15.719 INFO:tasks.workunit.client.0.smithi016.stderr: -206> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 5 asok(0x5636d85982b0) register_command objecter_requests cmddesc objecter_requests hook 0x5636d882a2b0 EEXIST 2024-09-12T17:22:15.719 INFO:tasks.workunit.client.0.smithi016.stderr: -205> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 1 librados: setting wanted keys 2024-09-12T17:22:15.719 INFO:tasks.workunit.client.0.smithi016.stderr: -204> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 1 librados: calling monclient init 2024-09-12T17:22:15.719 INFO:tasks.workunit.client.0.smithi016.stderr: -203> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 10 monclient: init 2024-09-12T17:22:15.719 INFO:tasks.workunit.client.0.smithi016.stderr: -202> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 5 AuthRegistry(0x5636d88261c0) adding auth protocol: cephx 2024-09-12T17:22:15.719 INFO:tasks.workunit.client.0.smithi016.stderr: -201> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 5 AuthRegistry(0x5636d88261c0) adding auth protocol: cephx 2024-09-12T17:22:15.720 INFO:tasks.workunit.client.0.smithi016.stderr: -200> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 5 AuthRegistry(0x5636d88261c0) adding auth protocol: cephx 2024-09-12T17:22:15.720 INFO:tasks.workunit.client.0.smithi016.stderr: -199> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 5 AuthRegistry(0x5636d88261c0) adding con mode: secure 2024-09-12T17:22:15.720 INFO:tasks.workunit.client.0.smithi016.stderr: -198> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 5 AuthRegistry(0x5636d88261c0) adding con mode: crc 2024-09-12T17:22:15.720 INFO:tasks.workunit.client.0.smithi016.stderr: -197> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 5 AuthRegistry(0x5636d88261c0) adding con mode: secure 2024-09-12T17:22:15.720 INFO:tasks.workunit.client.0.smithi016.stderr: -196> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 5 AuthRegistry(0x5636d88261c0) adding con mode: crc 2024-09-12T17:22:15.720 INFO:tasks.workunit.client.0.smithi016.stderr: -195> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 5 AuthRegistry(0x5636d88261c0) adding con mode: secure 2024-09-12T17:22:15.720 INFO:tasks.workunit.client.0.smithi016.stderr: -194> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 5 AuthRegistry(0x5636d88261c0) adding con mode: crc 2024-09-12T17:22:15.720 INFO:tasks.workunit.client.0.smithi016.stderr: -193> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 5 AuthRegistry(0x5636d88261c0) adding con mode: crc 2024-09-12T17:22:15.720 INFO:tasks.workunit.client.0.smithi016.stderr: -192> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 5 AuthRegistry(0x5636d88261c0) adding con mode: secure 2024-09-12T17:22:15.720 INFO:tasks.workunit.client.0.smithi016.stderr: -191> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 5 AuthRegistry(0x5636d88261c0) adding con mode: crc 2024-09-12T17:22:15.720 INFO:tasks.workunit.client.0.smithi016.stderr: -190> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 5 AuthRegistry(0x5636d88261c0) adding con mode: secure 2024-09-12T17:22:15.720 INFO:tasks.workunit.client.0.smithi016.stderr: -189> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 5 AuthRegistry(0x5636d88261c0) adding con mode: crc 2024-09-12T17:22:15.721 INFO:tasks.workunit.client.0.smithi016.stderr: -188> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 5 AuthRegistry(0x5636d88261c0) adding con mode: secure 2024-09-12T17:22:15.721 INFO:tasks.workunit.client.0.smithi016.stderr: -187> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:15.721 INFO:tasks.workunit.client.0.smithi016.stderr: -186> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:15.721 INFO:tasks.workunit.client.0.smithi016.stderr: -185> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 5 asok(0x5636d85982b0) register_command rotate-key cmddesc rotate-key hook 0x5636d8826308 EEXIST 2024-09-12T17:22:15.721 INFO:tasks.workunit.client.0.smithi016.stderr: -184> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 10 monclient: _reopen_session rank -1 2024-09-12T17:22:15.721 INFO:tasks.workunit.client.0.smithi016.stderr: -183> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:22:15.721 INFO:tasks.workunit.client.0.smithi016.stderr: -182> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 10 monclient(hunting): picked mon.noname-a con 0x5636d8868d50 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:22:15.721 INFO:tasks.workunit.client.0.smithi016.stderr: -181> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 10 monclient(hunting): picked mon.noname-c con 0x5636d88734d0 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:22:15.721 INFO:tasks.workunit.client.0.smithi016.stderr: -180> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 10 monclient(hunting): picked mon.noname-b con 0x5636d8878090 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:22:15.721 INFO:tasks.workunit.client.0.smithi016.stderr: -179> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:15.721 INFO:tasks.workunit.client.0.smithi016.stderr: -178> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:15.721 INFO:tasks.workunit.client.0.smithi016.stderr: -177> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:15.721 INFO:tasks.workunit.client.0.smithi016.stderr: -176> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 10 monclient(hunting): _renew_subs 2024-09-12T17:22:15.722 INFO:tasks.workunit.client.0.smithi016.stderr: -175> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 10 monclient(hunting): authenticate will time out at 2453.292804s 2024-09-12T17:22:15.722 INFO:tasks.workunit.client.0.smithi016.stderr: -174> 2024-09-12T17:22:15.316+0000 7f1cf182e640 10 monclient(hunting): get_auth_request con 0x5636d8868d50 auth_method 0 2024-09-12T17:22:15.722 INFO:tasks.workunit.client.0.smithi016.stderr: -173> 2024-09-12T17:22:15.316+0000 7f1cf182e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:22:15.722 INFO:tasks.workunit.client.0.smithi016.stderr: -172> 2024-09-12T17:22:15.316+0000 7f1cf182e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:22:15.722 INFO:tasks.workunit.client.0.smithi016.stderr: -171> 2024-09-12T17:22:15.316+0000 7f1cf182e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:22:15.722 INFO:tasks.workunit.client.0.smithi016.stderr: -170> 2024-09-12T17:22:15.316+0000 7f1cf2830640 10 monclient(hunting): get_auth_request con 0x5636d88734d0 auth_method 0 2024-09-12T17:22:15.722 INFO:tasks.workunit.client.0.smithi016.stderr: -169> 2024-09-12T17:22:15.316+0000 7f1cf2830640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:22:15.722 INFO:tasks.workunit.client.0.smithi016.stderr: -168> 2024-09-12T17:22:15.316+0000 7f1cf2830640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:22:15.722 INFO:tasks.workunit.client.0.smithi016.stderr: -167> 2024-09-12T17:22:15.316+0000 7f1cf2830640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:22:15.722 INFO:tasks.workunit.client.0.smithi016.stderr: -166> 2024-09-12T17:22:15.316+0000 7f1cf182e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:22:15.722 INFO:tasks.workunit.client.0.smithi016.stderr: -165> 2024-09-12T17:22:15.316+0000 7f1cf182e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:22:15.722 INFO:tasks.workunit.client.0.smithi016.stderr: -164> 2024-09-12T17:22:15.316+0000 7f1cf182e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:22:15.722 INFO:tasks.workunit.client.0.smithi016.stderr: -163> 2024-09-12T17:22:15.316+0000 7f1cf2830640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:22:15.723 INFO:tasks.workunit.client.0.smithi016.stderr: -162> 2024-09-12T17:22:15.316+0000 7f1cf2830640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:22:15.723 INFO:tasks.workunit.client.0.smithi016.stderr: -161> 2024-09-12T17:22:15.316+0000 7f1cf2830640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:22:15.723 INFO:tasks.workunit.client.0.smithi016.stderr: -160> 2024-09-12T17:22:15.316+0000 7f1cf182e640 10 monclient(hunting): handle_auth_done global_id 8052 payload 824 2024-09-12T17:22:15.723 INFO:tasks.workunit.client.0.smithi016.stderr: -159> 2024-09-12T17:22:15.316+0000 7f1cf182e640 10 monclient: _finish_hunting 0 2024-09-12T17:22:15.723 INFO:tasks.workunit.client.0.smithi016.stderr: -158> 2024-09-12T17:22:15.316+0000 7f1cf182e640 1 monclient: found mon.noname-a 2024-09-12T17:22:15.723 INFO:tasks.workunit.client.0.smithi016.stderr: -157> 2024-09-12T17:22:15.316+0000 7f1cf182e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:22:15.723 INFO:tasks.workunit.client.0.smithi016.stderr: -156> 2024-09-12T17:22:15.316+0000 7f1bc3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:22:15.723 INFO:tasks.workunit.client.0.smithi016.stderr: -155> 2024-09-12T17:22:15.316+0000 7f1bc3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:22:15.723 INFO:tasks.workunit.client.0.smithi016.stderr: -154> 2024-09-12T17:22:15.316+0000 7f1bc3fff640 10 monclient: dump: 2024-09-12T17:22:15.723 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:22:15.723 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:22:15.723 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:15.723 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:15.723 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:22:15.724 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:15.724 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:22:15.724 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:22:15.724 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:22:15.724 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:15.724 INFO:tasks.workunit.client.0.smithi016.stderr: -153> 2024-09-12T17:22:15.316+0000 7f1bc3fff640 10 monclient: _finish_auth 0 2024-09-12T17:22:15.724 INFO:tasks.workunit.client.0.smithi016.stderr: -152> 2024-09-12T17:22:15.316+0000 7f1bc3fff640 10 monclient: _check_auth_tickets 2024-09-12T17:22:15.724 INFO:tasks.workunit.client.0.smithi016.stderr: -151> 2024-09-12T17:22:15.316+0000 7f1bc3fff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:22:15.724 INFO:tasks.workunit.client.0.smithi016.stderr: -150> 2024-09-12T17:22:15.316+0000 7f1bc3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:22:15.724 INFO:tasks.workunit.client.0.smithi016.stderr: -149> 2024-09-12T17:22:15.316+0000 7f1bc3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:22:15.724 INFO:tasks.workunit.client.0.smithi016.stderr: -148> 2024-09-12T17:22:15.316+0000 7f1bc3fff640 10 monclient: dump: 2024-09-12T17:22:15.724 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:22:15.724 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:22:15.724 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:15.725 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:15.725 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:22:15.725 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:15.725 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:22:15.725 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:22:15.725 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:22:15.725 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:15.725 INFO:tasks.workunit.client.0.smithi016.stderr: -147> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 5 monclient: authenticate success, global_id 8052 2024-09-12T17:22:15.725 INFO:tasks.workunit.client.0.smithi016.stderr: -146> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 10 monclient: _renew_subs 2024-09-12T17:22:15.725 INFO:tasks.workunit.client.0.smithi016.stderr: -145> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:22:15.725 INFO:tasks.workunit.client.0.smithi016.stderr: -144> 2024-09-12T17:22:15.316+0000 7f1bd5ffb640 4 set_mon_vals no callback set 2024-09-12T17:22:15.725 INFO:tasks.workunit.client.0.smithi016.stderr: -143> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 10 monclient: _renew_subs 2024-09-12T17:22:15.725 INFO:tasks.workunit.client.0.smithi016.stderr: -142> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:22:15.725 INFO:tasks.workunit.client.0.smithi016.stderr: -141> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 1 librados: init done 2024-09-12T17:22:15.726 INFO:tasks.workunit.client.0.smithi016.stderr: -140> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 5 asok(0x5636d85982b0) register_command cr dump hook 0x5636d8868c98 2024-09-12T17:22:15.726 INFO:tasks.workunit.client.0.smithi016.stderr: -139> 2024-09-12T17:22:15.316+0000 7f1cf45299c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.726 INFO:tasks.workunit.client.0.smithi016.stderr: -138> 2024-09-12T17:22:15.316+0000 7f1bc3fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:22:15.726 INFO:tasks.workunit.client.0.smithi016.stderr: -137> 2024-09-12T17:22:15.316+0000 7f1bc3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:22:15.726 INFO:tasks.workunit.client.0.smithi016.stderr: -136> 2024-09-12T17:22:15.316+0000 7f1bc3fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:22:15.726 INFO:tasks.workunit.client.0.smithi016.stderr: -135> 2024-09-12T17:22:15.320+0000 7f1cf2830640 10 monclient: get_auth_request con 0x7f1bbc070b10 auth_method 0 2024-09-12T17:22:15.726 INFO:tasks.workunit.client.0.smithi016.stderr: -134> 2024-09-12T17:22:15.320+0000 7f1cf202f640 10 monclient: get_auth_request con 0x5636d8891490 auth_method 0 2024-09-12T17:22:15.726 INFO:tasks.workunit.client.0.smithi016.stderr: -133> 2024-09-12T17:22:15.320+0000 7f1cf45299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:15.726 INFO:tasks.workunit.client.0.smithi016.stderr: -132> 2024-09-12T17:22:15.320+0000 7f1cf45299c0 20 realm 2024-09-12T17:22:15.726 INFO:tasks.workunit.client.0.smithi016.stderr: -131> 2024-09-12T17:22:15.320+0000 7f1cf45299c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.726 INFO:tasks.workunit.client.0.smithi016.stderr: -130> 2024-09-12T17:22:15.320+0000 7f1cf45299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:15.726 INFO:tasks.workunit.client.0.smithi016.stderr: -129> 2024-09-12T17:22:15.320+0000 7f1cf45299c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:22:15.726 INFO:tasks.workunit.client.0.smithi016.stderr: -128> 2024-09-12T17:22:15.320+0000 7f1cf45299c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.726 INFO:tasks.workunit.client.0.smithi016.stderr: -127> 2024-09-12T17:22:15.320+0000 7f1cf45299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:15.727 INFO:tasks.workunit.client.0.smithi016.stderr: -126> 2024-09-12T17:22:15.320+0000 7f1cf45299c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.727 INFO:tasks.workunit.client.0.smithi016.stderr: -125> 2024-09-12T17:22:15.320+0000 7f1cf182e640 10 monclient: get_auth_request con 0x5636d88956d0 auth_method 0 2024-09-12T17:22:15.727 INFO:tasks.workunit.client.0.smithi016.stderr: -124> 2024-09-12T17:22:15.320+0000 7f1cf45299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:22:15.727 INFO:tasks.workunit.client.0.smithi016.stderr: -123> 2024-09-12T17:22:15.320+0000 7f1cf45299c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.727 INFO:tasks.workunit.client.0.smithi016.stderr: -122> 2024-09-12T17:22:15.320+0000 7f1cf2830640 10 monclient: get_auth_request con 0x5636d8898f30 auth_method 0 2024-09-12T17:22:15.727 INFO:tasks.workunit.client.0.smithi016.stderr: -121> 2024-09-12T17:22:15.324+0000 7f1cf45299c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:22:15.727 INFO:tasks.workunit.client.0.smithi016.stderr: -120> 2024-09-12T17:22:15.324+0000 7f1cf45299c0 20 searching for the correct realm 2024-09-12T17:22:15.727 INFO:tasks.workunit.client.0.smithi016.stderr: -119> 2024-09-12T17:22:15.324+0000 7f1cf202f640 10 monclient: get_auth_request con 0x5636d889dcf0 auth_method 0 2024-09-12T17:22:15.727 INFO:tasks.workunit.client.0.smithi016.stderr: -118> 2024-09-12T17:22:15.324+0000 7f1cf182e640 10 monclient: get_auth_request con 0x7f1ce40d1910 auth_method 0 2024-09-12T17:22:15.727 INFO:tasks.workunit.client.0.smithi016.stderr: -117> 2024-09-12T17:22:15.324+0000 7f1cf2830640 10 monclient: get_auth_request con 0x7f1ce8008050 auth_method 0 2024-09-12T17:22:15.727 INFO:tasks.workunit.client.0.smithi016.stderr: -116> 2024-09-12T17:22:15.328+0000 7f1cf182e640 0 -- 172.21.15.16:0/4136550951 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7f1ce40d1910 msgr2=0x7f1ce40c4400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:22:15.727 INFO:tasks.workunit.client.0.smithi016.stderr: -115> 2024-09-12T17:22:15.328+0000 7f1bc3fff640 1 client.8052.objecter ms_handle_reset 0x7f1ce40d1910 session 0x7f1ce40bd070 osd.7 2024-09-12T17:22:15.727 INFO:tasks.workunit.client.0.smithi016.stderr: -114> 2024-09-12T17:22:15.328+0000 7f1bc3fff640 10 monclient: _renew_subs 2024-09-12T17:22:15.727 INFO:tasks.workunit.client.0.smithi016.stderr: -113> 2024-09-12T17:22:15.328+0000 7f1bc3fff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:22:15.727 INFO:tasks.workunit.client.0.smithi016.stderr: -112> 2024-09-12T17:22:15.328+0000 7f1cf182e640 10 monclient: get_auth_request con 0x7f1bbc080930 auth_method 0 2024-09-12T17:22:15.728 INFO:tasks.workunit.client.0.smithi016.stderr: -111> 2024-09-12T17:22:15.328+0000 7f1cf202f640 10 monclient: get_auth_request con 0x7f1cec081c20 auth_method 0 2024-09-12T17:22:15.728 INFO:tasks.workunit.client.0.smithi016.stderr: -110> 2024-09-12T17:22:15.332+0000 7f1cf182e640 10 monclient: get_auth_request con 0x7f1cec015030 auth_method 0 2024-09-12T17:22:15.728 INFO:tasks.workunit.client.0.smithi016.stderr: -109> 2024-09-12T17:22:15.332+0000 7f1cf182e640 0 -- 172.21.15.16:0/4136550951 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f1cec015030 msgr2=0x7f1cec05d460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:22:15.728 INFO:tasks.workunit.client.0.smithi016.stderr: -108> 2024-09-12T17:22:15.536+0000 7f1cf182e640 10 monclient: get_auth_request con 0x7f1cec015030 auth_method 0 2024-09-12T17:22:15.728 INFO:tasks.workunit.client.0.smithi016.stderr: -107> 2024-09-12T17:22:15.548+0000 7f1cf45299c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:22:15.728 INFO:tasks.workunit.client.0.smithi016.stderr: -106> 2024-09-12T17:22:15.548+0000 7f1cf45299c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:22:15.728 INFO:tasks.workunit.client.0.smithi016.stderr: -105> 2024-09-12T17:22:15.548+0000 7f1cf45299c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:22:15.728 INFO:tasks.workunit.client.0.smithi016.stderr: -104> 2024-09-12T17:22:15.548+0000 7f1cf45299c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:22:15.728 INFO:tasks.workunit.client.0.smithi016.stderr: -103> 2024-09-12T17:22:15.548+0000 7f1cf45299c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:22:15.728 INFO:tasks.workunit.client.0.smithi016.stderr: -102> 2024-09-12T17:22:15.548+0000 7f1cf45299c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:22:15.728 INFO:tasks.workunit.client.0.smithi016.stderr: -101> 2024-09-12T17:22:15.548+0000 7f1cf45299c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.728 INFO:tasks.workunit.client.0.smithi016.stderr: -100> 2024-09-12T17:22:15.548+0000 7f1cf45299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:15.728 INFO:tasks.workunit.client.0.smithi016.stderr: -99> 2024-09-12T17:22:15.548+0000 7f1cf45299c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.728 INFO:tasks.workunit.client.0.smithi016.stderr: -98> 2024-09-12T17:22:15.552+0000 7f1cf45299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:22:15.729 INFO:tasks.workunit.client.0.smithi016.stderr: -97> 2024-09-12T17:22:15.552+0000 7f1cf45299c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.729 INFO:tasks.workunit.client.0.smithi016.stderr: -96> 2024-09-12T17:22:15.552+0000 7f1cf45299c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:22:15.729 INFO:tasks.workunit.client.0.smithi016.stderr: -95> 2024-09-12T17:22:15.552+0000 7f1cf45299c0 20 zone default found 2024-09-12T17:22:15.729 INFO:tasks.workunit.client.0.smithi016.stderr: -94> 2024-09-12T17:22:15.552+0000 7f1cf45299c0 4 Realm: () 2024-09-12T17:22:15.729 INFO:tasks.workunit.client.0.smithi016.stderr: -93> 2024-09-12T17:22:15.552+0000 7f1cf45299c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:22:15.729 INFO:tasks.workunit.client.0.smithi016.stderr: -92> 2024-09-12T17:22:15.552+0000 7f1cf45299c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:22:15.729 INFO:tasks.workunit.client.0.smithi016.stderr: -91> 2024-09-12T17:22:15.552+0000 7f1cf45299c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:22:15.729 INFO:tasks.workunit.client.0.smithi016.stderr: -90> 2024-09-12T17:22:15.552+0000 7f1cf45299c0 20 zonegroup default 2024-09-12T17:22:15.729 INFO:tasks.workunit.client.0.smithi016.stderr: -89> 2024-09-12T17:22:15.552+0000 7f1cf45299c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.729 INFO:tasks.workunit.client.0.smithi016.stderr: -88> 2024-09-12T17:22:15.552+0000 7f1cf45299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:15.729 INFO:tasks.workunit.client.0.smithi016.stderr: -87> 2024-09-12T17:22:15.552+0000 7f1cf45299c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.729 INFO:tasks.workunit.client.0.smithi016.stderr: -86> 2024-09-12T17:22:15.552+0000 7f1cf45299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:15.729 INFO:tasks.workunit.client.0.smithi016.stderr: -85> 2024-09-12T17:22:15.552+0000 7f1cf45299c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.729 INFO:tasks.workunit.client.0.smithi016.stderr: -84> 2024-09-12T17:22:15.552+0000 7f1cf45299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:15.730 INFO:tasks.workunit.client.0.smithi016.stderr: -83> 2024-09-12T17:22:15.552+0000 7f1cf45299c0 20 started sync module instance, tier type = 2024-09-12T17:22:15.730 INFO:tasks.workunit.client.0.smithi016.stderr: -82> 2024-09-12T17:22:15.552+0000 7f1cf45299c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:22:15.730 INFO:tasks.workunit.client.0.smithi016.stderr: -81> 2024-09-12T17:22:15.576+0000 7f1cf45299c0 20 add_watcher() i=0 2024-09-12T17:22:15.730 INFO:tasks.workunit.client.0.smithi016.stderr: -80> 2024-09-12T17:22:15.576+0000 7f1cf45299c0 20 add_watcher() i=1 2024-09-12T17:22:15.730 INFO:tasks.workunit.client.0.smithi016.stderr: -79> 2024-09-12T17:22:15.576+0000 7f1cf45299c0 20 add_watcher() i=2 2024-09-12T17:22:15.730 INFO:tasks.workunit.client.0.smithi016.stderr: -78> 2024-09-12T17:22:15.576+0000 7f1cf45299c0 20 add_watcher() i=3 2024-09-12T17:22:15.730 INFO:tasks.workunit.client.0.smithi016.stderr: -77> 2024-09-12T17:22:15.576+0000 7f1cf45299c0 20 add_watcher() i=4 2024-09-12T17:22:15.730 INFO:tasks.workunit.client.0.smithi016.stderr: -76> 2024-09-12T17:22:15.576+0000 7f1cf45299c0 20 add_watcher() i=5 2024-09-12T17:22:15.730 INFO:tasks.workunit.client.0.smithi016.stderr: -75> 2024-09-12T17:22:15.576+0000 7f1cf45299c0 20 add_watcher() i=6 2024-09-12T17:22:15.730 INFO:tasks.workunit.client.0.smithi016.stderr: -74> 2024-09-12T17:22:15.580+0000 7f1cf45299c0 20 add_watcher() i=7 2024-09-12T17:22:15.730 INFO:tasks.workunit.client.0.smithi016.stderr: -73> 2024-09-12T17:22:15.580+0000 7f1cf45299c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:22:15.730 INFO:tasks.workunit.client.0.smithi016.stderr: -72> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36840) adding auth protocol: cephx 2024-09-12T17:22:15.730 INFO:tasks.workunit.client.0.smithi016.stderr: -71> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36840) adding auth protocol: cephx 2024-09-12T17:22:15.730 INFO:tasks.workunit.client.0.smithi016.stderr: -70> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36840) adding auth protocol: cephx 2024-09-12T17:22:15.730 INFO:tasks.workunit.client.0.smithi016.stderr: -69> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36840) adding con mode: secure 2024-09-12T17:22:15.731 INFO:tasks.workunit.client.0.smithi016.stderr: -68> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36840) adding con mode: crc 2024-09-12T17:22:15.731 INFO:tasks.workunit.client.0.smithi016.stderr: -67> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36840) adding con mode: secure 2024-09-12T17:22:15.731 INFO:tasks.workunit.client.0.smithi016.stderr: -66> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36840) adding con mode: crc 2024-09-12T17:22:15.731 INFO:tasks.workunit.client.0.smithi016.stderr: -65> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36840) adding con mode: secure 2024-09-12T17:22:15.731 INFO:tasks.workunit.client.0.smithi016.stderr: -64> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36840) adding con mode: crc 2024-09-12T17:22:15.731 INFO:tasks.workunit.client.0.smithi016.stderr: -63> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36840) adding con mode: crc 2024-09-12T17:22:15.731 INFO:tasks.workunit.client.0.smithi016.stderr: -62> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36840) adding con mode: secure 2024-09-12T17:22:15.731 INFO:tasks.workunit.client.0.smithi016.stderr: -61> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36840) adding con mode: crc 2024-09-12T17:22:15.731 INFO:tasks.workunit.client.0.smithi016.stderr: -60> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36840) adding con mode: secure 2024-09-12T17:22:15.731 INFO:tasks.workunit.client.0.smithi016.stderr: -59> 2024-09-12T17:22:15.584+0000 7f1ba8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:22:15.731 INFO:tasks.workunit.client.0.smithi016.stderr: -58> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36840) adding con mode: crc 2024-09-12T17:22:15.731 INFO:tasks.workunit.client.0.smithi016.stderr: -57> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 AuthRegistry(0x7ffc4aa36840) adding con mode: secure 2024-09-12T17:22:15.731 INFO:tasks.workunit.client.0.smithi016.stderr: -56> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:15.732 INFO:tasks.workunit.client.0.smithi016.stderr: -55> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:22:15.732 INFO:tasks.workunit.client.0.smithi016.stderr: -54> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:22:15.732 INFO:tasks.workunit.client.0.smithi016.stderr: -53> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 asok(0x5636d85982b0) register_command cache list hook 0x5636d8867bc0 2024-09-12T17:22:15.732 INFO:tasks.workunit.client.0.smithi016.stderr: -52> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 asok(0x5636d85982b0) register_command cache inspect hook 0x5636d8867bc0 2024-09-12T17:22:15.732 INFO:tasks.workunit.client.0.smithi016.stderr: -51> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 asok(0x5636d85982b0) register_command cache erase hook 0x5636d8867bc0 2024-09-12T17:22:15.732 INFO:tasks.workunit.client.0.smithi016.stderr: -50> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 asok(0x5636d85982b0) register_command cache zap hook 0x5636d8867bc0 2024-09-12T17:22:15.732 INFO:tasks.workunit.client.0.smithi016.stderr: -49> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 note: GC not initialized 2024-09-12T17:22:15.732 INFO:tasks.workunit.client.0.smithi016.stderr: -48> 2024-09-12T17:22:15.584+0000 7f1b237fe640 20 reqs_thread_entry: start 2024-09-12T17:22:15.732 INFO:tasks.workunit.client.0.smithi016.stderr: -47> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 asok(0x5636d85982b0) register_command sync trace show hook 0x7f1ce40c7040 2024-09-12T17:22:15.732 INFO:tasks.workunit.client.0.smithi016.stderr: -46> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 asok(0x5636d85982b0) register_command sync trace history hook 0x7f1ce40c7040 2024-09-12T17:22:15.732 INFO:tasks.workunit.client.0.smithi016.stderr: -45> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 asok(0x5636d85982b0) register_command sync trace active hook 0x7f1ce40c7040 2024-09-12T17:22:15.732 INFO:tasks.workunit.client.0.smithi016.stderr: -44> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 5 asok(0x5636d85982b0) register_command sync trace active_short hook 0x7f1ce40c7040 2024-09-12T17:22:15.732 INFO:tasks.workunit.client.0.smithi016.stderr: -43> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 20 init_complete bucket index max shards: 1 2024-09-12T17:22:15.733 INFO:tasks.workunit.client.0.smithi016.stderr: -42> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 20 Filter name: none 2024-09-12T17:22:15.733 INFO:tasks.workunit.client.0.smithi016.stderr: -41> 2024-09-12T17:22:15.584+0000 7f1b217fa640 20 reqs_thread_entry: start 2024-09-12T17:22:15.733 INFO:tasks.workunit.client.0.smithi016.stderr: -40> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:22:15.733 INFO:tasks.workunit.client.0.smithi016.stderr: -39> 2024-09-12T17:22:15.584+0000 7f1cf45299c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.733 INFO:tasks.workunit.client.0.smithi016.stderr: -38> 2024-09-12T17:22:15.588+0000 7f1cf45299c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:22:15.733 INFO:tasks.workunit.client.0.smithi016.stderr: -37> 2024-09-12T17:22:15.588+0000 7f1cf45299c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:22:15.733 INFO:tasks.workunit.client.0.smithi016.stderr: -36> 2024-09-12T17:22:15.588+0000 7f1cf45299c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:22:15.733 INFO:tasks.workunit.client.0.smithi016.stderr: -35> 2024-09-12T17:22:15.588+0000 7f1cf45299c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 : miss 2024-09-12T17:22:15.733 INFO:tasks.workunit.client.0.smithi016.stderr: -34> 2024-09-12T17:22:15.588+0000 7f1cf45299c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.733 INFO:tasks.workunit.client.0.smithi016.stderr: -33> 2024-09-12T17:22:15.588+0000 7f1cf45299c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:22:15.733 INFO:tasks.workunit.client.0.smithi016.stderr: -32> 2024-09-12T17:22:15.588+0000 7f1cf45299c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:22:15.733 INFO:tasks.workunit.client.0.smithi016.stderr: -31> 2024-09-12T17:22:15.588+0000 7f1cf45299c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:22:15.733 INFO:tasks.workunit.client.0.smithi016.stderr: -30> 2024-09-12T17:22:15.588+0000 7f1cf45299c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:22:15.734 INFO:tasks.workunit.client.0.smithi016.stderr: -29> 2024-09-12T17:22:15.588+0000 7f1cf45299c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:22:15.734 INFO:tasks.workunit.client.0.smithi016.stderr: -28> 2024-09-12T17:22:15.588+0000 7f1cf45299c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 2024-09-12T17:22:15.734 INFO:tasks.workunit.client.0.smithi016.stderr: -27> 2024-09-12T17:22:15.596+0000 7f1cf45299c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:22:15.734 INFO:tasks.workunit.client.0.smithi016.stderr: -26> 2024-09-12T17:22:15.596+0000 7f1cf45299c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:22:15.734 INFO:tasks.workunit.client.0.smithi016.stderr: -25> 2024-09-12T17:22:15.596+0000 7f1cf45299c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:22:15.734 INFO:tasks.workunit.client.0.smithi016.stderr: -24> 2024-09-12T17:22:15.596+0000 7f1cf45299c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17, ofs0, ns] 2024-09-12T17:22:15.734 INFO:tasks.workunit.client.0.smithi016.stderr: -23> 2024-09-12T17:22:15.596+0000 7f1bd5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431627 cookie 94793561161536 notifier 8052 bl.length()=827 2024-09-12T17:22:15.734 INFO:tasks.workunit.client.0.smithi016.stderr: -22> 2024-09-12T17:22:15.596+0000 7f1bd5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:22:15.734 INFO:tasks.workunit.client.0.smithi016.stderr: -21> 2024-09-12T17:22:15.596+0000 7f1bd5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:22:15.734 INFO:tasks.workunit.client.0.smithi016.stderr: -20> 2024-09-12T17:22:15.596+0000 7f1bd5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:22:15.734 INFO:tasks.workunit.client.0.smithi016.stderr: -19> 2024-09-12T17:22:15.596+0000 7f1cf45299c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): orig_sources= new_sources= 2024-09-12T17:22:15.734 INFO:tasks.workunit.client.0.smithi016.stderr: -18> 2024-09-12T17:22:15.596+0000 7f1cf45299c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): potential sources added=[] removed=[] 2024-09-12T17:22:15.734 INFO:tasks.workunit.client.0.smithi016.stderr: -17> 2024-09-12T17:22:15.596+0000 7f1cf45299c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): orig_dests= new_dests= 2024-09-12T17:22:15.735 INFO:tasks.workunit.client.0.smithi016.stderr: -16> 2024-09-12T17:22:15.596+0000 7f1cf45299c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): potential dests added=[] removed=[] 2024-09-12T17:22:15.735 INFO:tasks.workunit.client.0.smithi016.stderr: -15> 2024-09-12T17:22:15.604+0000 7f1cf45299c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.3.0 2024-09-12T17:22:15.735 INFO:tasks.workunit.client.0.smithi016.stderr: -14> 2024-09-12T17:22:15.604+0000 7f1cf45299c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.3.0 2024-09-12T17:22:15.735 INFO:tasks.workunit.client.0.smithi016.stderr: -13> 2024-09-12T17:22:15.604+0000 7f1cf45299c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.3.1 2024-09-12T17:22:15.735 INFO:tasks.workunit.client.0.smithi016.stderr: -12> 2024-09-12T17:22:15.604+0000 7f1cf45299c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.3.1 2024-09-12T17:22:15.735 INFO:tasks.workunit.client.0.smithi016.stderr: -11> 2024-09-12T17:22:15.604+0000 7f1cf45299c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.3.2 2024-09-12T17:22:15.735 INFO:tasks.workunit.client.0.smithi016.stderr: -10> 2024-09-12T17:22:15.604+0000 7f1cf45299c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.3.2 2024-09-12T17:22:15.735 INFO:tasks.workunit.client.0.smithi016.stderr: -9> 2024-09-12T17:22:15.604+0000 7f1cf45299c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.3.3 2024-09-12T17:22:15.735 INFO:tasks.workunit.client.0.smithi016.stderr: -8> 2024-09-12T17:22:15.604+0000 7f1cf45299c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.3.3 2024-09-12T17:22:15.735 INFO:tasks.workunit.client.0.smithi016.stderr: -7> 2024-09-12T17:22:15.604+0000 7f1cf45299c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.0 2024-09-12T17:22:15.735 INFO:tasks.workunit.client.0.smithi016.stderr: -6> 2024-09-12T17:22:15.604+0000 7f1cf45299c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.0 2024-09-12T17:22:15.735 INFO:tasks.workunit.client.0.smithi016.stderr: -5> 2024-09-12T17:22:15.604+0000 7f1cf45299c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.1 2024-09-12T17:22:15.735 INFO:tasks.workunit.client.0.smithi016.stderr: -4> 2024-09-12T17:22:15.604+0000 7f1cf45299c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.1 2024-09-12T17:22:15.735 INFO:tasks.workunit.client.0.smithi016.stderr: -3> 2024-09-12T17:22:15.604+0000 7f1cf45299c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.2 2024-09-12T17:22:15.736 INFO:tasks.workunit.client.0.smithi016.stderr: -2> 2024-09-12T17:22:15.604+0000 7f1cf45299c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.2 2024-09-12T17:22:15.736 INFO:tasks.workunit.client.0.smithi016.stderr: -1> 2024-09-12T17:22:15.608+0000 7f1cf45299c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1cf45299c0 time 2024-09-12T17:22:15.612619+0000 2024-09-12T17:22:15.736 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:22:15.736 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:15.736 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:22:15.736 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f1cf7e032eb] 2024-09-12T17:22:15.736 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1cf7e0349f] 2024-09-12T17:22:15.736 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5636d69820c1] 2024-09-12T17:22:15.736 INFO:tasks.workunit.client.0.smithi016.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5636d69934f1] 2024-09-12T17:22:15.736 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5636d6994b44] 2024-09-12T17:22:15.736 INFO:tasks.workunit.client.0.smithi016.stderr: 6: main() 2024-09-12T17:22:15.736 INFO:tasks.workunit.client.0.smithi016.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1cf6c69d90] 2024-09-12T17:22:15.737 INFO:tasks.workunit.client.0.smithi016.stderr: 8: __libc_start_main() 2024-09-12T17:22:15.737 INFO:tasks.workunit.client.0.smithi016.stderr: 9: _start() 2024-09-12T17:22:15.737 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:15.737 INFO:tasks.workunit.client.0.smithi016.stderr: 0> 2024-09-12T17:22:15.612+0000 7f1cf45299c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:22:15.737 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7f1cf45299c0 thread_name:radosgw-admin 2024-09-12T17:22:15.737 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:15.737 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:22:15.737 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1cf6c82520] 2024-09-12T17:22:15.737 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:22:15.737 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:22:15.737 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:22:15.737 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1cf7e03345] 2024-09-12T17:22:15.737 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1cf7e0349f] 2024-09-12T17:22:15.738 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5636d69820c1] 2024-09-12T17:22:15.738 INFO:tasks.workunit.client.0.smithi016.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5636d69934f1] 2024-09-12T17:22:15.738 INFO:tasks.workunit.client.0.smithi016.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5636d6994b44] 2024-09-12T17:22:15.738 INFO:tasks.workunit.client.0.smithi016.stderr: 10: main() 2024-09-12T17:22:15.738 INFO:tasks.workunit.client.0.smithi016.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1cf6c69d90] 2024-09-12T17:22:15.738 INFO:tasks.workunit.client.0.smithi016.stderr: 12: __libc_start_main() 2024-09-12T17:22:15.738 INFO:tasks.workunit.client.0.smithi016.stderr: 13: _start() 2024-09-12T17:22:15.738 INFO:tasks.workunit.client.0.smithi016.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:22:15.738 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:15.738 INFO:tasks.workunit.client.0.smithi016.stderr:--- logging levels --- 2024-09-12T17:22:15.738 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 none 2024-09-12T17:22:15.738 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 lockdep 2024-09-12T17:22:15.738 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 context 2024-09-12T17:22:15.738 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 crush 2024-09-12T17:22:15.739 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds 2024-09-12T17:22:15.739 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_balancer 2024-09-12T17:22:15.739 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_locker 2024-09-12T17:22:15.739 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log 2024-09-12T17:22:15.739 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log_expire 2024-09-12T17:22:15.739 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_migrator 2024-09-12T17:22:15.739 INFO:tasks.workunit.client.0.smithi016.stderr: 3/ 5 mds_quiesce 2024-09-12T17:22:15.739 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 buffer 2024-09-12T17:22:15.739 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 timer 2024-09-12T17:22:15.739 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 filer 2024-09-12T17:22:15.739 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 striper 2024-09-12T17:22:15.739 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 objecter 2024-09-12T17:22:15.739 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rados 2024-09-12T17:22:15.739 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd 2024-09-12T17:22:15.740 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_mirror 2024-09-12T17:22:15.740 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_replay 2024-09-12T17:22:15.740 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_pwl 2024-09-12T17:22:15.740 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 journaler 2024-09-12T17:22:15.740 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objectcacher 2024-09-12T17:22:15.740 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:22:15.740 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 client 2024-09-12T17:22:15.740 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 osd 2024-09-12T17:22:15.740 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 optracker 2024-09-12T17:22:15.740 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objclass 2024-09-12T17:22:15.740 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 filestore 2024-09-12T17:22:15.740 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 journal 2024-09-12T17:22:15.740 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 ms 2024-09-12T17:22:15.740 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mon 2024-09-12T17:22:15.741 INFO:tasks.workunit.client.0.smithi016.stderr: 0/10 monc 2024-09-12T17:22:15.741 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 paxos 2024-09-12T17:22:15.741 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 tp 2024-09-12T17:22:15.741 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 auth 2024-09-12T17:22:15.741 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 crypto 2024-09-12T17:22:15.741 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 finisher 2024-09-12T17:22:15.741 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 reserver 2024-09-12T17:22:15.741 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 heartbeatmap 2024-09-12T17:22:15.741 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 perfcounter 2024-09-12T17:22:15.741 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw 2024-09-12T17:22:15.741 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_sync 2024-09-12T17:22:15.741 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_datacache 2024-09-12T17:22:15.741 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_access 2024-09-12T17:22:15.741 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:22:15.742 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_flight 2024-09-12T17:22:15.742 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:22:15.742 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw_notification 2024-09-12T17:22:15.742 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 javaclient 2024-09-12T17:22:15.742 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 asok 2024-09-12T17:22:15.742 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 throttle 2024-09-12T17:22:15.742 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 refs 2024-09-12T17:22:15.742 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 compressor 2024-09-12T17:22:15.742 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluestore 2024-09-12T17:22:15.742 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluefs 2024-09-12T17:22:15.742 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 bdev 2024-09-12T17:22:15.742 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 kstore 2024-09-12T17:22:15.742 INFO:tasks.workunit.client.0.smithi016.stderr: 4/ 5 rocksdb 2024-09-12T17:22:15.742 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 fuse 2024-09-12T17:22:15.743 INFO:tasks.workunit.client.0.smithi016.stderr: 2/ 5 mgr 2024-09-12T17:22:15.743 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mgrc 2024-09-12T17:22:15.743 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 dpdk 2024-09-12T17:22:15.743 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 eventtrace 2024-09-12T17:22:15.743 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 prioritycache 2024-09-12T17:22:15.743 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 test 2024-09-12T17:22:15.743 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:22:15.743 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephsqlite 2024-09-12T17:22:15.743 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:22:15.743 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore 2024-09-12T17:22:15.743 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_onode 2024-09-12T17:22:15.743 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_odata 2024-09-12T17:22:15.743 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_omap 2024-09-12T17:22:15.744 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_tm 2024-09-12T17:22:15.744 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_t 2024-09-12T17:22:15.744 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:22:15.744 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_epm 2024-09-12T17:22:15.744 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_lba 2024-09-12T17:22:15.744 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:22:15.744 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cache 2024-09-12T17:22:15.744 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_journal 2024-09-12T17:22:15.744 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_device 2024-09-12T17:22:15.744 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_backref 2024-09-12T17:22:15.744 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 alienstore 2024-09-12T17:22:15.744 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mclock 2024-09-12T17:22:15.745 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cyanstore 2024-09-12T17:22:15.745 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 ceph_exporter 2024-09-12T17:22:15.745 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 memstore 2024-09-12T17:22:15.745 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 trace 2024-09-12T17:22:15.745 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 ceph_dedup 2024-09-12T17:22:15.745 INFO:tasks.workunit.client.0.smithi016.stderr: -2/-2 (syslog threshold) 2024-09-12T17:22:15.745 INFO:tasks.workunit.client.0.smithi016.stderr: 99/99 (stderr threshold) 2024-09-12T17:22:15.745 INFO:tasks.workunit.client.0.smithi016.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:22:15.745 INFO:tasks.workunit.client.0.smithi016.stderr: 7f1b217fa640 / http_manager 2024-09-12T17:22:15.745 INFO:tasks.workunit.client.0.smithi016.stderr: 7f1b237fe640 / http_manager 2024-09-12T17:22:15.745 INFO:tasks.workunit.client.0.smithi016.stderr: 7f1ba8fe1640 / rgw_dt_lg_renew 2024-09-12T17:22:15.745 INFO:tasks.workunit.client.0.smithi016.stderr: 7f1bc3fff640 / ms_dispatch 2024-09-12T17:22:15.745 INFO:tasks.workunit.client.0.smithi016.stderr: 7f1bd5ffb640 / io_context_pool 2024-09-12T17:22:15.745 INFO:tasks.workunit.client.0.smithi016.stderr: 7f1bd7fff640 / ms_dispatch 2024-09-12T17:22:15.746 INFO:tasks.workunit.client.0.smithi016.stderr: 7f1bdee05640 / ms_dispatch 2024-09-12T17:22:15.746 INFO:tasks.workunit.client.0.smithi016.stderr: 7f1be0608640 / io_context_pool 2024-09-12T17:22:15.746 INFO:tasks.workunit.client.0.smithi016.stderr: 7f1cf182e640 / msgr-worker-2 2024-09-12T17:22:15.746 INFO:tasks.workunit.client.0.smithi016.stderr: 7f1cf202f640 / msgr-worker-1 2024-09-12T17:22:15.746 INFO:tasks.workunit.client.0.smithi016.stderr: 7f1cf2830640 / msgr-worker-0 2024-09-12T17:22:15.746 INFO:tasks.workunit.client.0.smithi016.stderr: 7f1cf3031640 / io_context_pool 2024-09-12T17:22:15.746 INFO:tasks.workunit.client.0.smithi016.stderr: 7f1cf45299c0 / radosgw-admin 2024-09-12T17:22:15.746 INFO:tasks.workunit.client.0.smithi016.stderr: max_recent 500 2024-09-12T17:22:15.746 INFO:tasks.workunit.client.0.smithi016.stderr: max_new 1000 2024-09-12T17:22:15.746 INFO:tasks.workunit.client.0.smithi016.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:22:15.615033Z_a761615d-35a2-419c-9a88-c7cddf0f2bae/log 2024-09-12T17:22:15.746 INFO:tasks.workunit.client.0.smithi016.stderr:--- end dump of recent events --- 2024-09-12T17:22:15.746 INFO:tasks.workunit.client.0.smithi016.stderr:Aborted 2024-09-12T17:22:15.746 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:22:15.747 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:22:15.747 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:22:15.898 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.896+0000 7f02361ab640 0 --2- 172.21.15.16:0/2837588611 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x5576b7305370 0x5576b72fa4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T17:22:15.906 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.904+0000 7f02386a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.909 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.908+0000 7f02386a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:15.909 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.908+0000 7f02386a59c0 20 realm 2024-09-12T17:22:15.909 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.908+0000 7f02386a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.909 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.908+0000 7f02386a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:15.909 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.908+0000 7f02386a59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:22:15.909 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.908+0000 7f02386a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.909 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.908+0000 7f02386a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:15.909 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.908+0000 7f02386a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.911 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.908+0000 7f02386a59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:22:15.911 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.908+0000 7f02386a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:15.913 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.912+0000 7f02386a59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:22:15.913 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.912+0000 7f02386a59c0 20 searching for the correct realm 2024-09-12T17:22:15.914 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:15.912+0000 7f02359aa640 0 -- 172.21.15.16:0/2583843603 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7f022803f060 msgr2=0x7f0228064220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:22:16.129 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.128+0000 7f02369ac640 0 -- 172.21.15.16:0/2583843603 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f022c031410 msgr2=0x7f022c031830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:22:16.147 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.144+0000 7f02386a59c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:22:16.147 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.144+0000 7f02386a59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:22:16.147 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.144+0000 7f02386a59c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:22:16.147 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.144+0000 7f02386a59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:22:16.147 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.144+0000 7f02386a59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:22:16.148 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.144+0000 7f02386a59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:22:16.148 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.144+0000 7f02386a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:16.148 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.144+0000 7f02386a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:16.148 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.144+0000 7f02386a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:16.149 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.148+0000 7f02386a59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:22:16.149 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.148+0000 7f02386a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:16.150 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.148+0000 7f02386a59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:22:16.150 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.148+0000 7f02386a59c0 20 zone default found 2024-09-12T17:22:16.150 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.148+0000 7f02386a59c0 4 Realm: () 2024-09-12T17:22:16.150 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.148+0000 7f02386a59c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:22:16.150 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.148+0000 7f02386a59c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:22:16.150 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.148+0000 7f02386a59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:22:16.150 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.148+0000 7f02386a59c0 20 zonegroup default 2024-09-12T17:22:16.150 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.148+0000 7f02386a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:16.151 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.148+0000 7f02386a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:16.151 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.148+0000 7f02386a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:16.152 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.148+0000 7f02386a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:16.152 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.148+0000 7f02386a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:16.152 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.152+0000 7f02386a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:16.153 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.152+0000 7f02386a59c0 20 started sync module instance, tier type = 2024-09-12T17:22:16.153 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.152+0000 7f02386a59c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:22:16.183 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.180+0000 7f02386a59c0 20 add_watcher() i=0 2024-09-12T17:22:16.183 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.180+0000 7f02386a59c0 20 add_watcher() i=1 2024-09-12T17:22:16.184 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.180+0000 7f02386a59c0 20 add_watcher() i=2 2024-09-12T17:22:16.184 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.180+0000 7f02386a59c0 20 add_watcher() i=3 2024-09-12T17:22:16.184 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.180+0000 7f02386a59c0 20 add_watcher() i=4 2024-09-12T17:22:16.184 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.180+0000 7f02386a59c0 20 add_watcher() i=5 2024-09-12T17:22:16.184 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.180+0000 7f02386a59c0 20 add_watcher() i=6 2024-09-12T17:22:16.186 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.184+0000 7f02386a59c0 20 add_watcher() i=7 2024-09-12T17:22:16.186 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.184+0000 7f02386a59c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:22:16.190 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.188+0000 7f00ecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:22:16.191 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.188+0000 7f02386a59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:22:16.191 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.188+0000 7f02386a59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:22:16.191 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.188+0000 7f02386a59c0 5 note: GC not initialized 2024-09-12T17:22:16.192 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.188+0000 7f00677fe640 20 reqs_thread_entry: start 2024-09-12T17:22:16.192 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.188+0000 7f02386a59c0 20 init_complete bucket index max shards: 1 2024-09-12T17:22:16.192 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.188+0000 7f02386a59c0 20 Filter name: none 2024-09-12T17:22:16.192 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.188+0000 7f00657fa640 20 reqs_thread_entry: start 2024-09-12T17:22:16.192 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.192+0000 7f02386a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:16.193 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.192+0000 7f02386a59c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:22:16.193 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.192+0000 7f02386a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:16.194 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.192+0000 7f02386a59c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T17:22:16.194 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.192+0000 7f02386a59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:22:16.194 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.192+0000 7f02386a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:16.195 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.192+0000 7f02386a59c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:22:16.195 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.192+0000 7f02386a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:16.196 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.192+0000 7f02386a59c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T17:22:16.196 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.196+0000 7f02386a59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:22:16.199 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.196+0000 7f00ecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:22:16.203 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.200+0000 7f02386a59c0 20 remove_watcher() i=0 2024-09-12T17:22:16.204 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.200+0000 7f02386a59c0 2 removed watcher, disabling cache 2024-09-12T17:22:16.206 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.204+0000 7f02386a59c0 20 remove_watcher() i=1 2024-09-12T17:22:16.209 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.208+0000 7f02386a59c0 20 remove_watcher() i=2 2024-09-12T17:22:16.211 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.208+0000 7f02386a59c0 20 remove_watcher() i=3 2024-09-12T17:22:16.213 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.212+0000 7f02386a59c0 20 remove_watcher() i=4 2024-09-12T17:22:16.215 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.212+0000 7f02386a59c0 20 remove_watcher() i=5 2024-09-12T17:22:16.216 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.212+0000 7f02386a59c0 20 remove_watcher() i=6 2024-09-12T17:22:16.217 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.216+0000 7f02386a59c0 20 remove_watcher() i=7 2024-09-12T17:22:16.251 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T17:22:16.278 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:22:16.278 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:22:16.325 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.324+0000 7f81452fc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:16.327 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.324+0000 7f81452fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:16.327 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.324+0000 7f81452fc9c0 20 realm 2024-09-12T17:22:16.327 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.324+0000 7f81452fc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:16.327 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.324+0000 7f81452fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:16.327 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.324+0000 7f81452fc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:22:16.327 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.324+0000 7f81452fc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:16.327 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.324+0000 7f81452fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:16.327 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.324+0000 7f81452fc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:16.329 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.328+0000 7f81452fc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:22:16.329 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.328+0000 7f81452fc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:16.331 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.328+0000 7f81452fc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:22:16.331 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.328+0000 7f81452fc9c0 20 searching for the correct realm 2024-09-12T17:22:16.334 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.332+0000 7f8143603640 0 -- 172.21.15.16:0/1253508430 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f813812eb00 msgr2=0x7f81380ba070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:22:16.341 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.340+0000 7f8142601640 0 -- 172.21.15.16:0/1253508430 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f813c024930 msgr2=0x7f813c040400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:22:16.560 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.556+0000 7f81452fc9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:22:16.560 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.556+0000 7f81452fc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:22:16.560 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.556+0000 7f81452fc9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:22:16.560 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.556+0000 7f81452fc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:22:16.561 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.556+0000 7f81452fc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:22:16.561 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.556+0000 7f81452fc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:22:16.561 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.556+0000 7f81452fc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:16.561 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.560+0000 7f81452fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:16.561 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.560+0000 7f81452fc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:16.561 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.560+0000 7f81452fc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:22:16.561 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.560+0000 7f81452fc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:16.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.560+0000 7f81452fc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:22:16.563 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.560+0000 7f81452fc9c0 20 zone default found 2024-09-12T17:22:16.563 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.560+0000 7f81452fc9c0 4 Realm: () 2024-09-12T17:22:16.563 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.560+0000 7f81452fc9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:22:16.563 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.560+0000 7f81452fc9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:22:16.563 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.560+0000 7f81452fc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:22:16.563 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.560+0000 7f81452fc9c0 20 zonegroup default 2024-09-12T17:22:16.563 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.560+0000 7f81452fc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:16.564 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.560+0000 7f81452fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:16.564 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.560+0000 7f81452fc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:16.564 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.560+0000 7f81452fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:16.564 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.560+0000 7f81452fc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:16.564 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.564+0000 7f81452fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:16.565 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.564+0000 7f81452fc9c0 20 started sync module instance, tier type = 2024-09-12T17:22:16.565 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.564+0000 7f81452fc9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:22:16.591 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.588+0000 7f81452fc9c0 20 add_watcher() i=0 2024-09-12T17:22:16.591 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.588+0000 7f81452fc9c0 20 add_watcher() i=1 2024-09-12T17:22:16.592 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.588+0000 7f81452fc9c0 20 add_watcher() i=2 2024-09-12T17:22:16.592 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.588+0000 7f81452fc9c0 20 add_watcher() i=3 2024-09-12T17:22:16.592 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.588+0000 7f81452fc9c0 20 add_watcher() i=4 2024-09-12T17:22:16.592 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.588+0000 7f81452fc9c0 20 add_watcher() i=5 2024-09-12T17:22:16.592 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.588+0000 7f81452fc9c0 20 add_watcher() i=6 2024-09-12T17:22:16.595 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.592+0000 7f81452fc9c0 20 add_watcher() i=7 2024-09-12T17:22:16.595 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.592+0000 7f81452fc9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:22:16.598 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.596+0000 7f7ff97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:22:16.599 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.596+0000 7f81452fc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:22:16.600 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.596+0000 7f81452fc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:22:16.600 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.596+0000 7f81452fc9c0 5 note: GC not initialized 2024-09-12T17:22:16.601 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.600+0000 7f7f73fff640 20 reqs_thread_entry: start 2024-09-12T17:22:16.601 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.600+0000 7f81452fc9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:22:16.601 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.600+0000 7f81452fc9c0 20 Filter name: none 2024-09-12T17:22:16.601 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.600+0000 7f7f71ffb640 20 reqs_thread_entry: start 2024-09-12T17:22:16.601 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.600+0000 7f81452fc9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:22:16.601 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.600+0000 7f81452fc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:16.602 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.600+0000 7f81452fc9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:22:16.602 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.600+0000 7f81452fc9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:22:16.602 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.600+0000 7f81452fc9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:22:16.602 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.600+0000 7f81452fc9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 : miss 2024-09-12T17:22:16.602 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.600+0000 7f81452fc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:16.603 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.600+0000 7f81452fc9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T17:22:16.604 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.600+0000 7f81452fc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:22:16.604 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.600+0000 7f81452fc9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:22:16.604 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.600+0000 7f81452fc9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:22:16.604 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.600+0000 7f81452fc9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:22:16.604 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.600+0000 7f81452fc9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 2024-09-12T17:22:16.604 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.600+0000 7f81452fc9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.0 2024-09-12T17:22:16.604 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.600+0000 7f81452fc9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.0 2024-09-12T17:22:16.604 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.600+0000 7f81452fc9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.1 2024-09-12T17:22:16.604 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.600+0000 7f81452fc9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.1 2024-09-12T17:22:16.605 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.604+0000 7f81452fc9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.2 2024-09-12T17:22:16.605 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.604+0000 7f81452fc9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.2 2024-09-12T17:22:16.607 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.604+0000 7f7ff97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:22:16.612 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.612+0000 7f81452fc9c0 20 remove_watcher() i=0 2024-09-12T17:22:16.612 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.612+0000 7f81452fc9c0 2 removed watcher, disabling cache 2024-09-12T17:22:16.615 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.612+0000 7f81452fc9c0 20 remove_watcher() i=1 2024-09-12T17:22:16.617 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.616+0000 7f81452fc9c0 20 remove_watcher() i=2 2024-09-12T17:22:16.620 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.616+0000 7f81452fc9c0 20 remove_watcher() i=3 2024-09-12T17:22:16.622 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.620+0000 7f81452fc9c0 20 remove_watcher() i=4 2024-09-12T17:22:16.623 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.620+0000 7f81452fc9c0 20 remove_watcher() i=5 2024-09-12T17:22:16.625 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.624+0000 7f81452fc9c0 20 remove_watcher() i=6 2024-09-12T17:22:16.627 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:16.624+0000 7f81452fc9c0 20 remove_watcher() i=7 2024-09-12T17:22:46.675 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:22:46.709 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:22:46.709 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:22:46.755 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:46.752+0000 7fb73c7419c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:46.761 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:46.756+0000 7fb73c7419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:46.761 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:46.756+0000 7fb73c7419c0 20 realm 2024-09-12T17:22:46.761 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:46.756+0000 7fb73c7419c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:46.761 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:46.756+0000 7fb73c7419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:46.761 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:46.756+0000 7fb73c7419c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:22:46.761 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:46.756+0000 7fb73c7419c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:46.761 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:46.756+0000 7fb73c7419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:46.761 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:46.756+0000 7fb73c7419c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:46.761 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:46.756+0000 7fb73c7419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:22:46.762 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:46.756+0000 7fb73c7419c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:46.762 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:46.760+0000 7fb73c7419c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:22:46.762 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:46.760+0000 7fb73c7419c0 20 searching for the correct realm 2024-09-12T17:22:46.765 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:46.764+0000 7fb73aa48640 0 -- 172.21.15.16:0/1068723421 >> [v2:172.21.15.19:6800/1509147557,v1:172.21.15.19:6801/1509147557] conn(0x55830538a970 msgr2=0x55830538cd60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:22:46.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:46.772+0000 7fb739a46640 0 -- 172.21.15.16:0/1068723421 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fb734025040 msgr2=0x7fb734062d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:22:46.991 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:46.988+0000 7fb73c7419c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:22:46.992 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:46.988+0000 7fb73c7419c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:22:46.992 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:46.988+0000 7fb73c7419c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:22:46.992 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:46.988+0000 7fb73c7419c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:22:46.992 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:46.988+0000 7fb73c7419c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:22:46.992 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:46.988+0000 7fb73c7419c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:22:46.992 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:46.988+0000 7fb73c7419c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:46.992 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:46.992+0000 7fb73c7419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:46.993 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:46.992+0000 7fb73c7419c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:46.993 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:46.992+0000 7fb73c7419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:22:46.993 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:46.992+0000 7fb73c7419c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:46.994 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:46.992+0000 7fb73c7419c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:22:46.994 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:46.992+0000 7fb73c7419c0 20 zone default found 2024-09-12T17:22:46.994 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:46.992+0000 7fb73c7419c0 4 Realm: () 2024-09-12T17:22:46.994 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:46.992+0000 7fb73c7419c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:22:46.994 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:46.992+0000 7fb73c7419c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:22:46.994 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:46.992+0000 7fb73c7419c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:22:46.994 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:46.992+0000 7fb73c7419c0 20 zonegroup default 2024-09-12T17:22:46.994 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:46.992+0000 7fb73c7419c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:46.995 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:46.992+0000 7fb73c7419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:46.995 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:46.992+0000 7fb73c7419c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:46.995 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:46.992+0000 7fb73c7419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:46.995 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:46.992+0000 7fb73c7419c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:46.996 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:46.992+0000 7fb73c7419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:46.996 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:46.992+0000 7fb73c7419c0 20 started sync module instance, tier type = 2024-09-12T17:22:46.996 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:46.992+0000 7fb73c7419c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:22:47.031 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.028+0000 7fb73c7419c0 20 add_watcher() i=0 2024-09-12T17:22:47.031 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.028+0000 7fb73c7419c0 20 add_watcher() i=1 2024-09-12T17:22:47.032 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.028+0000 7fb73c7419c0 20 add_watcher() i=2 2024-09-12T17:22:47.032 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.028+0000 7fb73c7419c0 20 add_watcher() i=3 2024-09-12T17:22:47.032 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.028+0000 7fb73c7419c0 20 add_watcher() i=4 2024-09-12T17:22:47.032 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.028+0000 7fb73c7419c0 20 add_watcher() i=5 2024-09-12T17:22:47.032 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.028+0000 7fb73c7419c0 20 add_watcher() i=6 2024-09-12T17:22:47.034 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.032+0000 7fb73c7419c0 20 add_watcher() i=7 2024-09-12T17:22:47.034 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.032+0000 7fb73c7419c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:22:47.038 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.036+0000 7fb5f0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:22:47.039 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.036+0000 7fb73c7419c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:22:47.039 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.036+0000 7fb73c7419c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:22:47.039 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.036+0000 7fb73c7419c0 5 note: GC not initialized 2024-09-12T17:22:47.039 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.036+0000 7fb56b7fe640 20 reqs_thread_entry: start 2024-09-12T17:22:47.040 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.036+0000 7fb73c7419c0 20 init_complete bucket index max shards: 1 2024-09-12T17:22:47.040 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.036+0000 7fb73c7419c0 20 Filter name: none 2024-09-12T17:22:47.040 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.036+0000 7fb5697fa640 20 reqs_thread_entry: start 2024-09-12T17:22:47.040 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.040+0000 7fb73c7419c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:47.041 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.040+0000 7fb73c7419c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:22:47.041 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.040+0000 7fb73c7419c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:47.042 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.040+0000 7fb73c7419c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T17:22:47.042 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.040+0000 7fb73c7419c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:22:47.042 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.040+0000 7fb73c7419c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:47.043 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.040+0000 7fb73c7419c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:22:47.043 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.040+0000 7fb73c7419c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:47.043 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.040+0000 7fb73c7419c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T17:22:47.044 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.040+0000 7fb73c7419c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:22:47.046 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.044+0000 7fb5f0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:22:47.051 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.048+0000 7fb73c7419c0 20 remove_watcher() i=0 2024-09-12T17:22:47.051 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.048+0000 7fb73c7419c0 2 removed watcher, disabling cache 2024-09-12T17:22:47.053 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.052+0000 7fb73c7419c0 20 remove_watcher() i=1 2024-09-12T17:22:47.056 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.052+0000 7fb73c7419c0 20 remove_watcher() i=2 2024-09-12T17:22:47.058 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.056+0000 7fb73c7419c0 20 remove_watcher() i=3 2024-09-12T17:22:47.061 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.060+0000 7fb73c7419c0 20 remove_watcher() i=4 2024-09-12T17:22:47.062 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.060+0000 7fb73c7419c0 20 remove_watcher() i=5 2024-09-12T17:22:47.064 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.064+0000 7fb73c7419c0 20 remove_watcher() i=6 2024-09-12T17:22:47.066 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.064+0000 7fb73c7419c0 20 remove_watcher() i=7 2024-09-12T17:22:47.114 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T17:22:47.145 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:22:47.145 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:22:47.194 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.192+0000 7fe65e9b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:47.196 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.192+0000 7fe65e9b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:47.196 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.192+0000 7fe65e9b69c0 20 realm 2024-09-12T17:22:47.196 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.192+0000 7fe65e9b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:47.196 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.192+0000 7fe65e9b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:47.196 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.192+0000 7fe65e9b69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:22:47.196 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.192+0000 7fe65e9b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:47.196 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.196+0000 7fe65e9b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:47.196 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.196+0000 7fe65e9b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:47.197 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.196+0000 7fe65e9b69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:22:47.198 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.196+0000 7fe65e9b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:47.199 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.196+0000 7fe65e9b69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:22:47.199 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.196+0000 7fe65e9b69c0 20 searching for the correct realm 2024-09-12T17:22:47.202 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.200+0000 7fe65ccbd640 0 -- 172.21.15.16:0/3133849330 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fe6500c9070 msgr2=0x7fe6500fd580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:22:47.210 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.208+0000 7fe65bcbb640 0 -- 172.21.15.16:0/3133849330 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fe654017040 msgr2=0x7fe6540930b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:22:47.428 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.424+0000 7fe65e9b69c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:22:47.428 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.424+0000 7fe65e9b69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:22:47.428 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.424+0000 7fe65e9b69c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:22:47.428 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.424+0000 7fe65e9b69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:22:47.428 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.424+0000 7fe65e9b69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:22:47.428 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.424+0000 7fe65e9b69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:22:47.428 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.424+0000 7fe65e9b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:47.429 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.428+0000 7fe65e9b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:47.429 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.428+0000 7fe65e9b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:47.429 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.428+0000 7fe65e9b69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:22:47.429 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.428+0000 7fe65e9b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:47.430 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.428+0000 7fe65e9b69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:22:47.430 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.428+0000 7fe65e9b69c0 20 zone default found 2024-09-12T17:22:47.430 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.428+0000 7fe65e9b69c0 4 Realm: () 2024-09-12T17:22:47.430 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.428+0000 7fe65e9b69c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:22:47.430 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.428+0000 7fe65e9b69c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:22:47.431 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.428+0000 7fe65e9b69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:22:47.431 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.428+0000 7fe65e9b69c0 20 zonegroup default 2024-09-12T17:22:47.431 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.428+0000 7fe65e9b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:47.431 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.428+0000 7fe65e9b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:47.431 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.428+0000 7fe65e9b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:47.432 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.432+0000 7fe65e9b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:47.432 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.432+0000 7fe65e9b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:47.433 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.432+0000 7fe65e9b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:47.433 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.432+0000 7fe65e9b69c0 20 started sync module instance, tier type = 2024-09-12T17:22:47.433 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.432+0000 7fe65e9b69c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:22:47.457 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.456+0000 7fe65e9b69c0 20 add_watcher() i=0 2024-09-12T17:22:47.457 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.456+0000 7fe65e9b69c0 20 add_watcher() i=1 2024-09-12T17:22:47.457 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.456+0000 7fe65e9b69c0 20 add_watcher() i=2 2024-09-12T17:22:47.457 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.456+0000 7fe65e9b69c0 20 add_watcher() i=3 2024-09-12T17:22:47.458 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.456+0000 7fe65e9b69c0 20 add_watcher() i=4 2024-09-12T17:22:47.458 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.456+0000 7fe65e9b69c0 20 add_watcher() i=5 2024-09-12T17:22:47.458 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.456+0000 7fe65e9b69c0 20 add_watcher() i=6 2024-09-12T17:22:47.459 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.456+0000 7fe65e9b69c0 20 add_watcher() i=7 2024-09-12T17:22:47.460 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.456+0000 7fe65e9b69c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:22:47.464 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.460+0000 7fe512fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:22:47.465 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.464+0000 7fe65e9b69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:22:47.465 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.464+0000 7fe65e9b69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:22:47.465 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.464+0000 7fe65e9b69c0 5 note: GC not initialized 2024-09-12T17:22:47.466 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.464+0000 7fe511fdb640 20 reqs_thread_entry: start 2024-09-12T17:22:47.466 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.464+0000 7fe65e9b69c0 20 init_complete bucket index max shards: 1 2024-09-12T17:22:47.466 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.464+0000 7fe65e9b69c0 20 Filter name: none 2024-09-12T17:22:47.466 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.464+0000 7fe4837fe640 20 reqs_thread_entry: start 2024-09-12T17:22:47.466 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.464+0000 7fe65e9b69c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:22:47.466 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.464+0000 7fe65e9b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:47.467 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.464+0000 7fe65e9b69c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:22:47.467 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.464+0000 7fe65e9b69c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:22:47.467 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.464+0000 7fe65e9b69c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:22:47.467 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.464+0000 7fe65e9b69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 : miss 2024-09-12T17:22:47.468 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.464+0000 7fe65e9b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:47.468 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.468+0000 7fe65e9b69c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:22:47.468 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.468+0000 7fe65e9b69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:22:47.469 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.468+0000 7fe65e9b69c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:22:47.469 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.468+0000 7fe65e9b69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:22:47.469 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.468+0000 7fe65e9b69c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:22:47.469 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.468+0000 7fe65e9b69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 2024-09-12T17:22:47.469 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.468+0000 7fe65e9b69c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.0 2024-09-12T17:22:47.469 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.468+0000 7fe65e9b69c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.0 2024-09-12T17:22:47.469 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.468+0000 7fe65e9b69c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.1 2024-09-12T17:22:47.469 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.468+0000 7fe65e9b69c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.1 2024-09-12T17:22:47.470 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.468+0000 7fe65e9b69c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.2 2024-09-12T17:22:47.470 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.468+0000 7fe65e9b69c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.2 2024-09-12T17:22:47.472 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.472+0000 7fe512fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:22:47.477 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.476+0000 7fe65e9b69c0 20 remove_watcher() i=0 2024-09-12T17:22:47.477 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.476+0000 7fe65e9b69c0 2 removed watcher, disabling cache 2024-09-12T17:22:47.480 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.476+0000 7fe65e9b69c0 20 remove_watcher() i=1 2024-09-12T17:22:47.482 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.480+0000 7fe65e9b69c0 20 remove_watcher() i=2 2024-09-12T17:22:47.484 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.484+0000 7fe65e9b69c0 20 remove_watcher() i=3 2024-09-12T17:22:47.486 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.484+0000 7fe65e9b69c0 20 remove_watcher() i=4 2024-09-12T17:22:47.488 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.488+0000 7fe65e9b69c0 20 remove_watcher() i=5 2024-09-12T17:22:47.490 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.488+0000 7fe65e9b69c0 20 remove_watcher() i=6 2024-09-12T17:22:47.491 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.488+0000 7fe65e9b69c0 20 remove_watcher() i=7 2024-09-12T17:22:47.510 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:22:47.538 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:22:47.538 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:22:47.585 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.584+0000 7f67aab559c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:47.587 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.584+0000 7f67aab559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:47.587 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.584+0000 7f67aab559c0 20 realm 2024-09-12T17:22:47.587 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.584+0000 7f67aab559c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:47.587 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.584+0000 7f67aab559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:47.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.584+0000 7f67aab559c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:22:47.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.584+0000 7f67aab559c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:47.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.584+0000 7f67aab559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:47.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.584+0000 7f67aab559c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:47.589 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.588+0000 7f67aab559c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:22:47.589 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.588+0000 7f67aab559c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:47.591 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.588+0000 7f67aab559c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:22:47.591 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.588+0000 7f67aab559c0 20 searching for the correct realm 2024-09-12T17:22:47.594 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.592+0000 7f67a8e5c640 0 -- 172.21.15.16:0/3991730706 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f679c044bc0 msgr2=0x7f679c05fa80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:22:47.810 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:47.808+0000 7f67a7e5a640 0 -- 172.21.15.16:0/3991730706 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f67a00ce930 msgr2=0x7f67a00db400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:22:48.028 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.024+0000 7f67aab559c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:22:48.028 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.024+0000 7f67aab559c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:22:48.028 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.024+0000 7f67aab559c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:22:48.029 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.024+0000 7f67aab559c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:22:48.029 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.024+0000 7f67aab559c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:22:48.029 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.024+0000 7f67aab559c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:22:48.029 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.024+0000 7f67aab559c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:48.029 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.028+0000 7f67aab559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:48.029 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.028+0000 7f67aab559c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:48.029 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.028+0000 7f67aab559c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:22:48.030 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.028+0000 7f67aab559c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:48.030 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.028+0000 7f67aab559c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:22:48.030 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.028+0000 7f67aab559c0 20 zone default found 2024-09-12T17:22:48.030 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.028+0000 7f67aab559c0 4 Realm: () 2024-09-12T17:22:48.030 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.028+0000 7f67aab559c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:22:48.030 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.028+0000 7f67aab559c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:22:48.030 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.028+0000 7f67aab559c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:22:48.031 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.028+0000 7f67aab559c0 20 zonegroup default 2024-09-12T17:22:48.031 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.028+0000 7f67aab559c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:48.031 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.028+0000 7f67aab559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:48.031 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.028+0000 7f67aab559c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:48.032 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.028+0000 7f67aab559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:48.032 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.028+0000 7f67aab559c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:48.032 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.032+0000 7f67aab559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:48.033 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.032+0000 7f67aab559c0 20 started sync module instance, tier type = 2024-09-12T17:22:48.033 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.032+0000 7f67aab559c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:22:48.055 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.052+0000 7f67aab559c0 20 add_watcher() i=0 2024-09-12T17:22:48.055 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.052+0000 7f67aab559c0 20 add_watcher() i=1 2024-09-12T17:22:48.055 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.052+0000 7f67aab559c0 20 add_watcher() i=2 2024-09-12T17:22:48.055 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.052+0000 7f67aab559c0 20 add_watcher() i=3 2024-09-12T17:22:48.055 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.052+0000 7f67aab559c0 20 add_watcher() i=4 2024-09-12T17:22:48.055 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.052+0000 7f67aab559c0 20 add_watcher() i=5 2024-09-12T17:22:48.056 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.052+0000 7f67aab559c0 20 add_watcher() i=6 2024-09-12T17:22:48.057 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.056+0000 7f67aab559c0 20 add_watcher() i=7 2024-09-12T17:22:48.057 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.056+0000 7f67aab559c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:22:48.061 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.060+0000 7f665efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:22:48.062 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.060+0000 7f67aab559c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:22:48.062 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.060+0000 7f67aab559c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:22:48.062 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.060+0000 7f67aab559c0 5 note: GC not initialized 2024-09-12T17:22:48.062 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.060+0000 7f665dfdb640 20 reqs_thread_entry: start 2024-09-12T17:22:48.063 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.060+0000 7f67aab559c0 20 init_complete bucket index max shards: 1 2024-09-12T17:22:48.063 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.060+0000 7f67aab559c0 20 Filter name: none 2024-09-12T17:22:48.063 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.060+0000 7f65cf7fe640 20 reqs_thread_entry: start 2024-09-12T17:22:48.063 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.060+0000 7f67aab559c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:48.063 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.060+0000 7f67aab559c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:22:48.064 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.060+0000 7f67aab559c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:48.064 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.064+0000 7f67aab559c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:22:48.064 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.064+0000 7f67aab559c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:22:48.064 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.064+0000 7f67aab559c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:48.065 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.064+0000 7f67aab559c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:22:48.065 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.064+0000 7f67aab559c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:48.066 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.064+0000 7f67aab559c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:22:48.066 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.064+0000 7f67aab559c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:22:48.068 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.068+0000 7f665efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:22:48.073 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.072+0000 7f67aab559c0 20 remove_watcher() i=0 2024-09-12T17:22:48.073 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.072+0000 7f67aab559c0 2 removed watcher, disabling cache 2024-09-12T17:22:48.075 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.072+0000 7f67aab559c0 20 remove_watcher() i=1 2024-09-12T17:22:48.077 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.076+0000 7f67aab559c0 20 remove_watcher() i=2 2024-09-12T17:22:48.080 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.076+0000 7f67aab559c0 20 remove_watcher() i=3 2024-09-12T17:22:48.082 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.080+0000 7f67aab559c0 20 remove_watcher() i=4 2024-09-12T17:22:48.083 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.080+0000 7f67aab559c0 20 remove_watcher() i=5 2024-09-12T17:22:48.086 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.084+0000 7f67aab559c0 20 remove_watcher() i=6 2024-09-12T17:22:48.087 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.084+0000 7f67aab559c0 20 remove_watcher() i=7 2024-09-12T17:22:48.105 INFO:tasks.workunit.client.0.smithi016.stderr: test: duplicated entries should be purged before reshard 2024-09-12T17:22:48.105 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:22:48.134 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:22:48.135 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:22:48.183 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.180+0000 7feb4e5fa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:48.184 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.184+0000 7feb4e5fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:48.184 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.184+0000 7feb4e5fa9c0 20 realm 2024-09-12T17:22:48.185 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.184+0000 7feb4e5fa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:48.185 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.184+0000 7feb4e5fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:48.185 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.184+0000 7feb4e5fa9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:22:48.185 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.184+0000 7feb4e5fa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:48.185 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.184+0000 7feb4e5fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:48.185 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.184+0000 7feb4e5fa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:48.187 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.184+0000 7feb4e5fa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:22:48.187 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.184+0000 7feb4e5fa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:48.189 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.188+0000 7feb4e5fa9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:22:48.189 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.188+0000 7feb4e5fa9c0 20 searching for the correct realm 2024-09-12T17:22:48.189 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.188+0000 7feb4c100640 0 -- 172.21.15.16:0/2700293321 >> [v2:172.21.15.16:6824/465585330,v1:172.21.15.16:6825/465585330] conn(0x5622fc1b6380 msgr2=0x5622fc1b8840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:22:48.196 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.192+0000 7feb4c100640 0 -- 172.21.15.16:0/2700293321 >> [v2:172.21.15.19:6802/36415917,v1:172.21.15.19:6804/36415917] conn(0x7feb4402e040 msgr2=0x7feb4403a410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:22:48.419 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.416+0000 7feb4e5fa9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:22:48.419 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.416+0000 7feb4e5fa9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:22:48.419 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.416+0000 7feb4e5fa9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:22:48.419 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.416+0000 7feb4e5fa9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:22:48.419 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.416+0000 7feb4e5fa9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:22:48.419 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.416+0000 7feb4e5fa9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:22:48.419 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.416+0000 7feb4e5fa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:48.419 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.416+0000 7feb4e5fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:48.419 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.416+0000 7feb4e5fa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:48.420 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.416+0000 7feb4e5fa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:22:48.420 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.416+0000 7feb4e5fa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:48.420 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.420+0000 7feb4e5fa9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:22:48.420 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.420+0000 7feb4e5fa9c0 20 zone default found 2024-09-12T17:22:48.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.420+0000 7feb4e5fa9c0 4 Realm: () 2024-09-12T17:22:48.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.420+0000 7feb4e5fa9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:22:48.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.420+0000 7feb4e5fa9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:22:48.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.420+0000 7feb4e5fa9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:22:48.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.420+0000 7feb4e5fa9c0 20 zonegroup default 2024-09-12T17:22:48.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.420+0000 7feb4e5fa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:48.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.420+0000 7feb4e5fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:48.422 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.420+0000 7feb4e5fa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:48.422 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.420+0000 7feb4e5fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:48.422 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.420+0000 7feb4e5fa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:48.423 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.420+0000 7feb4e5fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:48.423 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.420+0000 7feb4e5fa9c0 20 started sync module instance, tier type = 2024-09-12T17:22:48.423 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.420+0000 7feb4e5fa9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:22:48.444 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.444+0000 7feb4e5fa9c0 20 add_watcher() i=0 2024-09-12T17:22:48.444 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.444+0000 7feb4e5fa9c0 20 add_watcher() i=1 2024-09-12T17:22:48.445 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.444+0000 7feb4e5fa9c0 20 add_watcher() i=2 2024-09-12T17:22:48.445 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.444+0000 7feb4e5fa9c0 20 add_watcher() i=3 2024-09-12T17:22:48.445 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.444+0000 7feb4e5fa9c0 20 add_watcher() i=4 2024-09-12T17:22:48.445 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.444+0000 7feb4e5fa9c0 20 add_watcher() i=5 2024-09-12T17:22:48.445 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.444+0000 7feb4e5fa9c0 20 add_watcher() i=6 2024-09-12T17:22:48.446 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.444+0000 7feb4e5fa9c0 20 add_watcher() i=7 2024-09-12T17:22:48.446 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.444+0000 7feb4e5fa9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:22:48.450 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.448+0000 7fea02fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:22:48.451 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.448+0000 7feb4e5fa9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:22:48.451 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.448+0000 7feb4e5fa9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:22:48.451 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.448+0000 7feb4e5fa9c0 5 note: GC not initialized 2024-09-12T17:22:48.452 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.448+0000 7fea01fdb640 20 reqs_thread_entry: start 2024-09-12T17:22:48.452 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.448+0000 7feb4e5fa9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:22:48.452 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.448+0000 7feb4e5fa9c0 20 Filter name: none 2024-09-12T17:22:48.452 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.448+0000 7fe9737fe640 20 reqs_thread_entry: start 2024-09-12T17:22:48.452 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.448+0000 7feb4e5fa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:48.453 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.452+0000 7feb4e5fa9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:22:48.453 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.452+0000 7feb4e5fa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:48.454 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.452+0000 7feb4e5fa9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:22:48.454 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.452+0000 7feb4e5fa9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:22:48.454 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.452+0000 7feb4e5fa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:48.457 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.456+0000 7feb4e5fa9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:22:48.457 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.456+0000 7feb4e5fa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:48.458 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.456+0000 7feb4e5fa9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:22:48.459 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.456+0000 7feb4e5fa9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:22:48.461 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.460+0000 7fea02fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:22:48.466 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.464+0000 7feb4e5fa9c0 20 remove_watcher() i=0 2024-09-12T17:22:48.466 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.464+0000 7feb4e5fa9c0 2 removed watcher, disabling cache 2024-09-12T17:22:48.468 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.468+0000 7feb4e5fa9c0 20 remove_watcher() i=1 2024-09-12T17:22:48.471 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.468+0000 7feb4e5fa9c0 20 remove_watcher() i=2 2024-09-12T17:22:48.473 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.472+0000 7feb4e5fa9c0 20 remove_watcher() i=3 2024-09-12T17:22:48.475 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.472+0000 7feb4e5fa9c0 20 remove_watcher() i=4 2024-09-12T17:22:48.477 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.476+0000 7feb4e5fa9c0 20 remove_watcher() i=5 2024-09-12T17:22:48.478 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.476+0000 7feb4e5fa9c0 20 remove_watcher() i=6 2024-09-12T17:22:48.479 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.476+0000 7feb4e5fa9c0 20 remove_watcher() i=7 2024-09-12T17:22:48.495 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:48.496 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:22:48.496 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: a-bucket id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 num_objects: 10 size_kb: 1 num_shards: 3 2024-09-12T17:22:48.496 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:48.496 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T17:22:48.534 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:22:48.534 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:22:48.579 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.576+0000 7ff2c48f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:48.581 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.580+0000 7ff2c48f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:48.581 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.580+0000 7ff2c48f89c0 20 realm 2024-09-12T17:22:48.581 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.580+0000 7ff2c48f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:48.581 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.580+0000 7ff2c48f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:48.581 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.580+0000 7ff2c48f89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:22:48.582 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.580+0000 7ff2c48f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:48.582 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.580+0000 7ff2c48f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:48.582 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.580+0000 7ff2c48f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:48.583 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.580+0000 7ff2c48f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:22:48.583 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.580+0000 7ff2c48f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:48.585 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.584+0000 7ff2c48f89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:22:48.585 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.584+0000 7ff2c48f89c0 20 searching for the correct realm 2024-09-12T17:22:48.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.588+0000 7ff2c2bff640 0 -- 172.21.15.16:0/2043560097 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7ff2b8047060 msgr2=0x7ff2b8071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:22:48.806 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:48.804+0000 7ff2c1bfd640 0 -- 172.21.15.16:0/2043560097 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7ff2bc0cd890 msgr2=0x7ff2bc1180c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:22:49.024 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.020+0000 7ff2c48f89c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:22:49.024 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.020+0000 7ff2c48f89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:22:49.024 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.020+0000 7ff2c48f89c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:22:49.024 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.020+0000 7ff2c48f89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:22:49.024 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.020+0000 7ff2c48f89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:22:49.024 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.020+0000 7ff2c48f89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:22:49.025 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.020+0000 7ff2c48f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.025 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.024+0000 7ff2c48f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:49.025 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.024+0000 7ff2c48f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.025 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.024+0000 7ff2c48f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:22:49.025 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.024+0000 7ff2c48f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.026 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.024+0000 7ff2c48f89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:22:49.027 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.024+0000 7ff2c48f89c0 20 zone default found 2024-09-12T17:22:49.027 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.024+0000 7ff2c48f89c0 4 Realm: () 2024-09-12T17:22:49.027 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.024+0000 7ff2c48f89c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:22:49.027 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.024+0000 7ff2c48f89c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:22:49.027 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.024+0000 7ff2c48f89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:22:49.027 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.024+0000 7ff2c48f89c0 20 zonegroup default 2024-09-12T17:22:49.027 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.024+0000 7ff2c48f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.027 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.024+0000 7ff2c48f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:49.027 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.024+0000 7ff2c48f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.028 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.024+0000 7ff2c48f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:49.028 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.028+0000 7ff2c48f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.029 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.028+0000 7ff2c48f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:49.029 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.028+0000 7ff2c48f89c0 20 started sync module instance, tier type = 2024-09-12T17:22:49.029 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.028+0000 7ff2c48f89c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:22:49.050 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.048+0000 7ff2c48f89c0 20 add_watcher() i=0 2024-09-12T17:22:49.050 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.048+0000 7ff2c48f89c0 20 add_watcher() i=1 2024-09-12T17:22:49.050 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.048+0000 7ff2c48f89c0 20 add_watcher() i=2 2024-09-12T17:22:49.050 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.048+0000 7ff2c48f89c0 20 add_watcher() i=3 2024-09-12T17:22:49.050 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.048+0000 7ff2c48f89c0 20 add_watcher() i=4 2024-09-12T17:22:49.050 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.048+0000 7ff2c48f89c0 20 add_watcher() i=5 2024-09-12T17:22:49.050 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.048+0000 7ff2c48f89c0 20 add_watcher() i=6 2024-09-12T17:22:49.052 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.048+0000 7ff2c48f89c0 20 add_watcher() i=7 2024-09-12T17:22:49.052 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.048+0000 7ff2c48f89c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:22:49.055 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.052+0000 7ff1797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:22:49.056 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.052+0000 7ff2c48f89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:22:49.056 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.052+0000 7ff2c48f89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:22:49.056 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.056+0000 7ff2c48f89c0 5 note: GC not initialized 2024-09-12T17:22:49.057 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.056+0000 7ff1737fe640 20 reqs_thread_entry: start 2024-09-12T17:22:49.057 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.056+0000 7ff2c48f89c0 20 init_complete bucket index max shards: 1 2024-09-12T17:22:49.057 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.056+0000 7ff2c48f89c0 20 Filter name: none 2024-09-12T17:22:49.057 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.056+0000 7ff1717fa640 20 reqs_thread_entry: start 2024-09-12T17:22:49.057 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.056+0000 7ff2c48f89c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:22:49.057 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.056+0000 7ff2c48f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.058 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.056+0000 7ff2c48f89c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:22:49.058 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.056+0000 7ff2c48f89c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:22:49.058 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.056+0000 7ff2c48f89c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:22:49.058 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.056+0000 7ff2c48f89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 : miss 2024-09-12T17:22:49.058 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.056+0000 7ff2c48f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.059 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.056+0000 7ff2c48f89c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:22:49.059 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.056+0000 7ff2c48f89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:22:49.059 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.056+0000 7ff2c48f89c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:22:49.059 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.056+0000 7ff2c48f89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:22:49.059 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.056+0000 7ff2c48f89c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:22:49.059 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.056+0000 7ff2c48f89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 2024-09-12T17:22:49.066 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.064+0000 7ff2c48f89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:22:49.066 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.064+0000 7ff2c48f89c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:22:49.066 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.064+0000 7ff2c48f89c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:22:49.066 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.064+0000 7ff2c48f89c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17, ofs0, ns] 2024-09-12T17:22:49.066 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.064+0000 7ff1a5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431629 cookie 94465549197920 notifier 7775 bl.length()=827 2024-09-12T17:22:49.067 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.064+0000 7ff1a5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:22:49.067 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.064+0000 7ff1a5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:22:49.067 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.064+0000 7ff1a5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:22:49.068 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.064+0000 7ff2c48f89c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): orig_sources= new_sources= 2024-09-12T17:22:49.068 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.064+0000 7ff2c48f89c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): potential sources added=[] removed=[] 2024-09-12T17:22:49.068 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.064+0000 7ff2c48f89c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): orig_dests= new_dests= 2024-09-12T17:22:49.068 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.064+0000 7ff2c48f89c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): potential dests added=[] removed=[] 2024-09-12T17:22:49.073 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff2c48f89c0 time 2024-09-12T17:22:49.075758+0000 2024-09-12T17:22:49.073 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:22:49.074 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:22:49.074 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff2c81d22eb] 2024-09-12T17:22:49.074 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff2c81d249f] 2024-09-12T17:22:49.075 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ea770dc0c1] 2024-09-12T17:22:49.075 INFO:tasks.workunit.client.0.smithi016.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ea770ee1fa] 2024-09-12T17:22:49.075 INFO:tasks.workunit.client.0.smithi016.stderr: 5: main() 2024-09-12T17:22:49.075 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff2c7038d90] 2024-09-12T17:22:49.075 INFO:tasks.workunit.client.0.smithi016.stderr: 7: __libc_start_main() 2024-09-12T17:22:49.075 INFO:tasks.workunit.client.0.smithi016.stderr: 8: _start() 2024-09-12T17:22:49.075 INFO:tasks.workunit.client.0.smithi016.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:22:49.075 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7ff2c48f89c0 thread_name:radosgw-admin 2024-09-12T17:22:49.075 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.072+0000 7ff2c48f89c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff2c48f89c0 time 2024-09-12T17:22:49.075758+0000 2024-09-12T17:22:49.075 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:22:49.075 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:49.075 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:22:49.075 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff2c81d22eb] 2024-09-12T17:22:49.076 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff2c81d249f] 2024-09-12T17:22:49.076 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ea770dc0c1] 2024-09-12T17:22:49.076 INFO:tasks.workunit.client.0.smithi016.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ea770ee1fa] 2024-09-12T17:22:49.076 INFO:tasks.workunit.client.0.smithi016.stderr: 5: main() 2024-09-12T17:22:49.076 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff2c7038d90] 2024-09-12T17:22:49.076 INFO:tasks.workunit.client.0.smithi016.stderr: 7: __libc_start_main() 2024-09-12T17:22:49.076 INFO:tasks.workunit.client.0.smithi016.stderr: 8: _start() 2024-09-12T17:22:49.076 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:49.092 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:22:49.093 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff2c7051520] 2024-09-12T17:22:49.093 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:22:49.093 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:22:49.093 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:22:49.093 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff2c81d2345] 2024-09-12T17:22:49.093 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff2c81d249f] 2024-09-12T17:22:49.093 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ea770dc0c1] 2024-09-12T17:22:49.093 INFO:tasks.workunit.client.0.smithi016.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ea770ee1fa] 2024-09-12T17:22:49.093 INFO:tasks.workunit.client.0.smithi016.stderr: 9: main() 2024-09-12T17:22:49.093 INFO:tasks.workunit.client.0.smithi016.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff2c7038d90] 2024-09-12T17:22:49.093 INFO:tasks.workunit.client.0.smithi016.stderr: 11: __libc_start_main() 2024-09-12T17:22:49.093 INFO:tasks.workunit.client.0.smithi016.stderr: 12: _start() 2024-09-12T17:22:49.094 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.072+0000 7ff2c48f89c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:22:49.094 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7ff2c48f89c0 thread_name:radosgw-admin 2024-09-12T17:22:49.094 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:49.094 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:22:49.094 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff2c7051520] 2024-09-12T17:22:49.094 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:22:49.094 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:22:49.094 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:22:49.094 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff2c81d2345] 2024-09-12T17:22:49.094 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff2c81d249f] 2024-09-12T17:22:49.094 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ea770dc0c1] 2024-09-12T17:22:49.094 INFO:tasks.workunit.client.0.smithi016.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ea770ee1fa] 2024-09-12T17:22:49.094 INFO:tasks.workunit.client.0.smithi016.stderr: 9: main() 2024-09-12T17:22:49.094 INFO:tasks.workunit.client.0.smithi016.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff2c7038d90] 2024-09-12T17:22:49.095 INFO:tasks.workunit.client.0.smithi016.stderr: 11: __libc_start_main() 2024-09-12T17:22:49.095 INFO:tasks.workunit.client.0.smithi016.stderr: 12: _start() 2024-09-12T17:22:49.095 INFO:tasks.workunit.client.0.smithi016.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:22:49.095 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:49.095 INFO:tasks.workunit.client.0.smithi016.stderr:--- begin dump of recent events --- 2024-09-12T17:22:49.095 INFO:tasks.workunit.client.0.smithi016.stderr: -499> 2024-09-12T17:22:48.552+0000 7ff2c1bfd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:22:49.095 INFO:tasks.workunit.client.0.smithi016.stderr: -498> 2024-09-12T17:22:48.552+0000 7ff2c1bfd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:22:49.095 INFO:tasks.workunit.client.0.smithi016.stderr: -497> 2024-09-12T17:22:48.552+0000 7ff2c1bfd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:22:49.095 INFO:tasks.workunit.client.0.smithi016.stderr: -496> 2024-09-12T17:22:48.552+0000 7ff2c2bff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:22:49.095 INFO:tasks.workunit.client.0.smithi016.stderr: -495> 2024-09-12T17:22:48.552+0000 7ff2c2bff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:22:49.095 INFO:tasks.workunit.client.0.smithi016.stderr: -494> 2024-09-12T17:22:48.552+0000 7ff2c2bff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:22:49.095 INFO:tasks.workunit.client.0.smithi016.stderr: -493> 2024-09-12T17:22:48.552+0000 7ff2c2bff640 10 monclient(hunting): handle_auth_done global_id 7763 payload 274 2024-09-12T17:22:49.095 INFO:tasks.workunit.client.0.smithi016.stderr: -492> 2024-09-12T17:22:48.552+0000 7ff2c2bff640 10 monclient: _finish_hunting 0 2024-09-12T17:22:49.096 INFO:tasks.workunit.client.0.smithi016.stderr: -491> 2024-09-12T17:22:48.552+0000 7ff2c2bff640 1 monclient: found mon.noname-c 2024-09-12T17:22:49.096 INFO:tasks.workunit.client.0.smithi016.stderr: -490> 2024-09-12T17:22:48.552+0000 7ff2c2bff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:22:49.096 INFO:tasks.workunit.client.0.smithi016.stderr: -489> 2024-09-12T17:22:48.556+0000 7ff1b0608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:22:49.096 INFO:tasks.workunit.client.0.smithi016.stderr: -488> 2024-09-12T17:22:48.556+0000 7ff1b0608640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:22:49.096 INFO:tasks.workunit.client.0.smithi016.stderr: -487> 2024-09-12T17:22:48.556+0000 7ff1b0608640 10 monclient: dump: 2024-09-12T17:22:49.096 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:22:49.096 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:22:49.096 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:49.096 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:49.096 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:22:49.096 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:49.096 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:22:49.096 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:22:49.097 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:22:49.097 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:49.097 INFO:tasks.workunit.client.0.smithi016.stderr: -486> 2024-09-12T17:22:48.556+0000 7ff1b0608640 10 monclient: _finish_auth 0 2024-09-12T17:22:49.097 INFO:tasks.workunit.client.0.smithi016.stderr: -485> 2024-09-12T17:22:48.556+0000 7ff1b0608640 10 monclient: _check_auth_tickets 2024-09-12T17:22:49.097 INFO:tasks.workunit.client.0.smithi016.stderr: -484> 2024-09-12T17:22:48.556+0000 7ff1b0608640 10 monclient: handle_config config(0 keys) 2024-09-12T17:22:49.097 INFO:tasks.workunit.client.0.smithi016.stderr: -483> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 monclient: authenticate success, global_id 7763 2024-09-12T17:22:49.097 INFO:tasks.workunit.client.0.smithi016.stderr: -482> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 10 monclient: get_monmap_and_config success 2024-09-12T17:22:49.097 INFO:tasks.workunit.client.0.smithi016.stderr: -481> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 4 set_mon_vals no callback set 2024-09-12T17:22:49.097 INFO:tasks.workunit.client.0.smithi016.stderr: -480> 2024-09-12T17:22:48.556+0000 7ff1b0608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:22:49.097 INFO:tasks.workunit.client.0.smithi016.stderr: -479> 2024-09-12T17:22:48.556+0000 7ff1b0608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:22:49.097 INFO:tasks.workunit.client.0.smithi016.stderr: -478> 2024-09-12T17:22:48.556+0000 7ff1b0608640 10 monclient: dump: 2024-09-12T17:22:49.097 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:22:49.097 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:22:49.098 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:49.098 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:49.098 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:22:49.098 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:49.098 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:22:49.098 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:22:49.098 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:22:49.098 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:49.098 INFO:tasks.workunit.client.0.smithi016.stderr: -477> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 10 monclient: shutdown 2024-09-12T17:22:49.098 INFO:tasks.workunit.client.0.smithi016.stderr: -476> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 asok(0x55ea795042b0) unregister_commands rotate-key 2024-09-12T17:22:49.098 INFO:tasks.workunit.client.0.smithi016.stderr: -475> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 10 monclient: build_initial_monmap 2024-09-12T17:22:49.098 INFO:tasks.workunit.client.0.smithi016.stderr: -474> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 1 build_initial for_mkfs: 0 2024-09-12T17:22:49.098 INFO:tasks.workunit.client.0.smithi016.stderr: -473> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 10 monclient: monmap: 2024-09-12T17:22:49.098 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:22:49.099 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:22:49.099 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:22:49.099 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:22:49.099 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:22:49.099 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:49.099 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:22:49.099 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:22:49.099 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:22:49.099 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:49.099 INFO:tasks.workunit.client.0.smithi016.stderr: -472> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79712e70) adding auth protocol: cephx 2024-09-12T17:22:49.099 INFO:tasks.workunit.client.0.smithi016.stderr: -471> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79712e70) adding auth protocol: cephx 2024-09-12T17:22:49.099 INFO:tasks.workunit.client.0.smithi016.stderr: -470> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79712e70) adding auth protocol: cephx 2024-09-12T17:22:49.099 INFO:tasks.workunit.client.0.smithi016.stderr: -469> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79712e70) adding con mode: secure 2024-09-12T17:22:49.099 INFO:tasks.workunit.client.0.smithi016.stderr: -468> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79712e70) adding con mode: crc 2024-09-12T17:22:49.099 INFO:tasks.workunit.client.0.smithi016.stderr: -467> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79712e70) adding con mode: secure 2024-09-12T17:22:49.100 INFO:tasks.workunit.client.0.smithi016.stderr: -466> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79712e70) adding con mode: crc 2024-09-12T17:22:49.100 INFO:tasks.workunit.client.0.smithi016.stderr: -465> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79712e70) adding con mode: secure 2024-09-12T17:22:49.100 INFO:tasks.workunit.client.0.smithi016.stderr: -464> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79712e70) adding con mode: crc 2024-09-12T17:22:49.100 INFO:tasks.workunit.client.0.smithi016.stderr: -463> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79712e70) adding con mode: crc 2024-09-12T17:22:49.100 INFO:tasks.workunit.client.0.smithi016.stderr: -462> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79712e70) adding con mode: secure 2024-09-12T17:22:49.100 INFO:tasks.workunit.client.0.smithi016.stderr: -461> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79712e70) adding con mode: crc 2024-09-12T17:22:49.100 INFO:tasks.workunit.client.0.smithi016.stderr: -460> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79712e70) adding con mode: secure 2024-09-12T17:22:49.100 INFO:tasks.workunit.client.0.smithi016.stderr: -459> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79712e70) adding con mode: crc 2024-09-12T17:22:49.100 INFO:tasks.workunit.client.0.smithi016.stderr: -458> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79712e70) adding con mode: secure 2024-09-12T17:22:49.100 INFO:tasks.workunit.client.0.smithi016.stderr: -457> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:49.100 INFO:tasks.workunit.client.0.smithi016.stderr: -456> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 1 librados: starting msgr at 2024-09-12T17:22:49.100 INFO:tasks.workunit.client.0.smithi016.stderr: -455> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 1 librados: starting objecter 2024-09-12T17:22:49.100 INFO:tasks.workunit.client.0.smithi016.stderr: -454> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 asok(0x55ea795042b0) register_command objecter_requests hook 0x55ea795348c0 2024-09-12T17:22:49.100 INFO:tasks.workunit.client.0.smithi016.stderr: -453> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 1 librados: setting wanted keys 2024-09-12T17:22:49.101 INFO:tasks.workunit.client.0.smithi016.stderr: -452> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 1 librados: calling monclient init 2024-09-12T17:22:49.101 INFO:tasks.workunit.client.0.smithi016.stderr: -451> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 10 monclient: init 2024-09-12T17:22:49.101 INFO:tasks.workunit.client.0.smithi016.stderr: -450> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7970d970) adding auth protocol: cephx 2024-09-12T17:22:49.101 INFO:tasks.workunit.client.0.smithi016.stderr: -449> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7970d970) adding auth protocol: cephx 2024-09-12T17:22:49.101 INFO:tasks.workunit.client.0.smithi016.stderr: -448> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7970d970) adding auth protocol: cephx 2024-09-12T17:22:49.101 INFO:tasks.workunit.client.0.smithi016.stderr: -447> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7970d970) adding con mode: secure 2024-09-12T17:22:49.101 INFO:tasks.workunit.client.0.smithi016.stderr: -446> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7970d970) adding con mode: crc 2024-09-12T17:22:49.101 INFO:tasks.workunit.client.0.smithi016.stderr: -445> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7970d970) adding con mode: secure 2024-09-12T17:22:49.101 INFO:tasks.workunit.client.0.smithi016.stderr: -444> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7970d970) adding con mode: crc 2024-09-12T17:22:49.101 INFO:tasks.workunit.client.0.smithi016.stderr: -443> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7970d970) adding con mode: secure 2024-09-12T17:22:49.101 INFO:tasks.workunit.client.0.smithi016.stderr: -442> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7970d970) adding con mode: crc 2024-09-12T17:22:49.101 INFO:tasks.workunit.client.0.smithi016.stderr: -441> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7970d970) adding con mode: crc 2024-09-12T17:22:49.101 INFO:tasks.workunit.client.0.smithi016.stderr: -440> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7970d970) adding con mode: secure 2024-09-12T17:22:49.101 INFO:tasks.workunit.client.0.smithi016.stderr: -439> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7970d970) adding con mode: crc 2024-09-12T17:22:49.102 INFO:tasks.workunit.client.0.smithi016.stderr: -438> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7970d970) adding con mode: secure 2024-09-12T17:22:49.102 INFO:tasks.workunit.client.0.smithi016.stderr: -437> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7970d970) adding con mode: crc 2024-09-12T17:22:49.102 INFO:tasks.workunit.client.0.smithi016.stderr: -436> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7970d970) adding con mode: secure 2024-09-12T17:22:49.102 INFO:tasks.workunit.client.0.smithi016.stderr: -435> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:49.102 INFO:tasks.workunit.client.0.smithi016.stderr: -434> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:49.102 INFO:tasks.workunit.client.0.smithi016.stderr: -433> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 asok(0x55ea795042b0) register_command rotate-key hook 0x55ea7970dab8 2024-09-12T17:22:49.102 INFO:tasks.workunit.client.0.smithi016.stderr: -432> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 10 monclient: _reopen_session rank -1 2024-09-12T17:22:49.102 INFO:tasks.workunit.client.0.smithi016.stderr: -431> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:22:49.102 INFO:tasks.workunit.client.0.smithi016.stderr: -430> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 10 monclient(hunting): picked mon.noname-a con 0x55ea795bd990 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:22:49.102 INFO:tasks.workunit.client.0.smithi016.stderr: -429> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 10 monclient(hunting): picked mon.noname-c con 0x55ea79656490 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:22:49.102 INFO:tasks.workunit.client.0.smithi016.stderr: -428> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 10 monclient(hunting): picked mon.noname-b con 0x55ea7973c3f0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:22:49.102 INFO:tasks.workunit.client.0.smithi016.stderr: -427> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:49.102 INFO:tasks.workunit.client.0.smithi016.stderr: -426> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:49.102 INFO:tasks.workunit.client.0.smithi016.stderr: -425> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:49.102 INFO:tasks.workunit.client.0.smithi016.stderr: -424> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 10 monclient(hunting): _renew_subs 2024-09-12T17:22:49.103 INFO:tasks.workunit.client.0.smithi016.stderr: -423> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 10 monclient(hunting): authenticate will time out at 2486.534338s 2024-09-12T17:22:49.103 INFO:tasks.workunit.client.0.smithi016.stderr: -422> 2024-09-12T17:22:48.556+0000 7ff2c23fe640 10 monclient(hunting): get_auth_request con 0x55ea795bd990 auth_method 0 2024-09-12T17:22:49.103 INFO:tasks.workunit.client.0.smithi016.stderr: -421> 2024-09-12T17:22:48.556+0000 7ff2c23fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:22:49.103 INFO:tasks.workunit.client.0.smithi016.stderr: -420> 2024-09-12T17:22:48.556+0000 7ff2c23fe640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:22:49.103 INFO:tasks.workunit.client.0.smithi016.stderr: -419> 2024-09-12T17:22:48.556+0000 7ff2c23fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:22:49.103 INFO:tasks.workunit.client.0.smithi016.stderr: -418> 2024-09-12T17:22:48.556+0000 7ff2c1bfd640 10 monclient(hunting): get_auth_request con 0x55ea79656490 auth_method 0 2024-09-12T17:22:49.103 INFO:tasks.workunit.client.0.smithi016.stderr: -417> 2024-09-12T17:22:48.556+0000 7ff2c1bfd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:22:49.103 INFO:tasks.workunit.client.0.smithi016.stderr: -416> 2024-09-12T17:22:48.556+0000 7ff2c1bfd640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:22:49.103 INFO:tasks.workunit.client.0.smithi016.stderr: -415> 2024-09-12T17:22:48.556+0000 7ff2c1bfd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:22:49.103 INFO:tasks.workunit.client.0.smithi016.stderr: -414> 2024-09-12T17:22:48.556+0000 7ff2c23fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:22:49.103 INFO:tasks.workunit.client.0.smithi016.stderr: -413> 2024-09-12T17:22:48.556+0000 7ff2c23fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:22:49.103 INFO:tasks.workunit.client.0.smithi016.stderr: -412> 2024-09-12T17:22:48.556+0000 7ff2c23fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:22:49.103 INFO:tasks.workunit.client.0.smithi016.stderr: -411> 2024-09-12T17:22:48.556+0000 7ff2c1bfd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:22:49.104 INFO:tasks.workunit.client.0.smithi016.stderr: -410> 2024-09-12T17:22:48.556+0000 7ff2c1bfd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:22:49.104 INFO:tasks.workunit.client.0.smithi016.stderr: -409> 2024-09-12T17:22:48.556+0000 7ff2c1bfd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:22:49.104 INFO:tasks.workunit.client.0.smithi016.stderr: -408> 2024-09-12T17:22:48.556+0000 7ff2c23fe640 10 monclient(hunting): handle_auth_done global_id 8178 payload 824 2024-09-12T17:22:49.104 INFO:tasks.workunit.client.0.smithi016.stderr: -407> 2024-09-12T17:22:48.556+0000 7ff2c23fe640 10 monclient: _finish_hunting 0 2024-09-12T17:22:49.104 INFO:tasks.workunit.client.0.smithi016.stderr: -406> 2024-09-12T17:22:48.556+0000 7ff2c23fe640 1 monclient: found mon.noname-a 2024-09-12T17:22:49.104 INFO:tasks.workunit.client.0.smithi016.stderr: -405> 2024-09-12T17:22:48.556+0000 7ff2c23fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:22:49.104 INFO:tasks.workunit.client.0.smithi016.stderr: -404> 2024-09-12T17:22:48.556+0000 7ff2c2bff640 10 monclient: get_auth_request con 0x55ea7973c3f0 auth_method 0 2024-09-12T17:22:49.104 INFO:tasks.workunit.client.0.smithi016.stderr: -403> 2024-09-12T17:22:48.556+0000 7ff1aee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:22:49.104 INFO:tasks.workunit.client.0.smithi016.stderr: -402> 2024-09-12T17:22:48.556+0000 7ff1aee05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:22:49.104 INFO:tasks.workunit.client.0.smithi016.stderr: -401> 2024-09-12T17:22:48.556+0000 7ff1aee05640 10 monclient: dump: 2024-09-12T17:22:49.104 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:22:49.104 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:22:49.104 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:49.105 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:49.105 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:22:49.105 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:49.105 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:22:49.105 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:22:49.105 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:22:49.105 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:49.105 INFO:tasks.workunit.client.0.smithi016.stderr: -400> 2024-09-12T17:22:48.556+0000 7ff1aee05640 10 monclient: _finish_auth 0 2024-09-12T17:22:49.105 INFO:tasks.workunit.client.0.smithi016.stderr: -399> 2024-09-12T17:22:48.556+0000 7ff1aee05640 10 monclient: _check_auth_tickets 2024-09-12T17:22:49.105 INFO:tasks.workunit.client.0.smithi016.stderr: -398> 2024-09-12T17:22:48.556+0000 7ff1aee05640 10 monclient: handle_config config(0 keys) 2024-09-12T17:22:49.105 INFO:tasks.workunit.client.0.smithi016.stderr: -397> 2024-09-12T17:22:48.556+0000 7ff1aee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:22:49.105 INFO:tasks.workunit.client.0.smithi016.stderr: -396> 2024-09-12T17:22:48.556+0000 7ff1aee05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:22:49.105 INFO:tasks.workunit.client.0.smithi016.stderr: -395> 2024-09-12T17:22:48.556+0000 7ff1aee05640 10 monclient: dump: 2024-09-12T17:22:49.105 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:22:49.106 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:22:49.106 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:49.106 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:49.106 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:22:49.106 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:49.106 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:22:49.106 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:22:49.106 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:22:49.106 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:49.106 INFO:tasks.workunit.client.0.smithi016.stderr: -394> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 monclient: authenticate success, global_id 8178 2024-09-12T17:22:49.106 INFO:tasks.workunit.client.0.smithi016.stderr: -393> 2024-09-12T17:22:48.556+0000 7ff1b0608640 4 set_mon_vals no callback set 2024-09-12T17:22:49.106 INFO:tasks.workunit.client.0.smithi016.stderr: -392> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 10 monclient: _renew_subs 2024-09-12T17:22:49.106 INFO:tasks.workunit.client.0.smithi016.stderr: -391> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:22:49.106 INFO:tasks.workunit.client.0.smithi016.stderr: -390> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 10 monclient: _renew_subs 2024-09-12T17:22:49.106 INFO:tasks.workunit.client.0.smithi016.stderr: -389> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:22:49.107 INFO:tasks.workunit.client.0.smithi016.stderr: -388> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 1 librados: init done 2024-09-12T17:22:49.107 INFO:tasks.workunit.client.0.smithi016.stderr: -387> 2024-09-12T17:22:48.560+0000 7ff1aee05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:22:49.107 INFO:tasks.workunit.client.0.smithi016.stderr: -386> 2024-09-12T17:22:48.560+0000 7ff1aee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:22:49.107 INFO:tasks.workunit.client.0.smithi016.stderr: -385> 2024-09-12T17:22:48.560+0000 7ff1aee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:22:49.107 INFO:tasks.workunit.client.0.smithi016.stderr: -384> 2024-09-12T17:22:48.560+0000 7ff2c1bfd640 10 monclient: get_auth_request con 0x7ff1a8070b10 auth_method 0 2024-09-12T17:22:49.107 INFO:tasks.workunit.client.0.smithi016.stderr: -383> 2024-09-12T17:22:48.560+0000 7ff2c2bff640 10 monclient: get_auth_request con 0x55ea79735690 auth_method 0 2024-09-12T17:22:49.107 INFO:tasks.workunit.client.0.smithi016.stderr: -382> 2024-09-12T17:22:48.560+0000 7ff2c23fe640 10 monclient: get_auth_request con 0x55ea797586b0 auth_method 0 2024-09-12T17:22:49.107 INFO:tasks.workunit.client.0.smithi016.stderr: -381> 2024-09-12T17:22:48.564+0000 7ff2c1bfd640 10 monclient: get_auth_request con 0x55ea7975cb60 auth_method 0 2024-09-12T17:22:49.107 INFO:tasks.workunit.client.0.smithi016.stderr: -380> 2024-09-12T17:22:48.564+0000 7ff2c2bff640 10 monclient: get_auth_request con 0x55ea7975bfc0 auth_method 0 2024-09-12T17:22:49.107 INFO:tasks.workunit.client.0.smithi016.stderr: -379> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 10 monclient: build_initial_monmap 2024-09-12T17:22:49.107 INFO:tasks.workunit.client.0.smithi016.stderr: -378> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 1 build_initial for_mkfs: 0 2024-09-12T17:22:49.107 INFO:tasks.workunit.client.0.smithi016.stderr: -377> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 10 monclient: monmap: 2024-09-12T17:22:49.107 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:22:49.107 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:22:49.108 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:22:49.108 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:22:49.108 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:22:49.108 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:49.108 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:22:49.108 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:22:49.108 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:22:49.108 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:49.108 INFO:tasks.workunit.client.0.smithi016.stderr: -376> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79764d00) adding auth protocol: cephx 2024-09-12T17:22:49.108 INFO:tasks.workunit.client.0.smithi016.stderr: -375> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79764d00) adding auth protocol: cephx 2024-09-12T17:22:49.108 INFO:tasks.workunit.client.0.smithi016.stderr: -374> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79764d00) adding auth protocol: cephx 2024-09-12T17:22:49.108 INFO:tasks.workunit.client.0.smithi016.stderr: -373> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79764d00) adding con mode: secure 2024-09-12T17:22:49.108 INFO:tasks.workunit.client.0.smithi016.stderr: -372> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79764d00) adding con mode: crc 2024-09-12T17:22:49.108 INFO:tasks.workunit.client.0.smithi016.stderr: -371> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79764d00) adding con mode: secure 2024-09-12T17:22:49.109 INFO:tasks.workunit.client.0.smithi016.stderr: -370> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79764d00) adding con mode: crc 2024-09-12T17:22:49.109 INFO:tasks.workunit.client.0.smithi016.stderr: -369> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79764d00) adding con mode: secure 2024-09-12T17:22:49.109 INFO:tasks.workunit.client.0.smithi016.stderr: -368> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79764d00) adding con mode: crc 2024-09-12T17:22:49.109 INFO:tasks.workunit.client.0.smithi016.stderr: -367> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79764d00) adding con mode: crc 2024-09-12T17:22:49.109 INFO:tasks.workunit.client.0.smithi016.stderr: -366> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79764d00) adding con mode: secure 2024-09-12T17:22:49.109 INFO:tasks.workunit.client.0.smithi016.stderr: -365> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79764d00) adding con mode: crc 2024-09-12T17:22:49.109 INFO:tasks.workunit.client.0.smithi016.stderr: -364> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79764d00) adding con mode: secure 2024-09-12T17:22:49.109 INFO:tasks.workunit.client.0.smithi016.stderr: -363> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79764d00) adding con mode: crc 2024-09-12T17:22:49.109 INFO:tasks.workunit.client.0.smithi016.stderr: -362> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79764d00) adding con mode: secure 2024-09-12T17:22:49.109 INFO:tasks.workunit.client.0.smithi016.stderr: -361> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:49.109 INFO:tasks.workunit.client.0.smithi016.stderr: -360> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 asok(0x55ea795042b0) register_command objecter_requests cmddesc objecter_requests hook 0x55ea797686b0 EEXIST 2024-09-12T17:22:49.109 INFO:tasks.workunit.client.0.smithi016.stderr: -359> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 10 monclient: init 2024-09-12T17:22:49.109 INFO:tasks.workunit.client.0.smithi016.stderr: -358> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79763c48) adding auth protocol: cephx 2024-09-12T17:22:49.109 INFO:tasks.workunit.client.0.smithi016.stderr: -357> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79763c48) adding auth protocol: cephx 2024-09-12T17:22:49.109 INFO:tasks.workunit.client.0.smithi016.stderr: -356> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79763c48) adding auth protocol: cephx 2024-09-12T17:22:49.110 INFO:tasks.workunit.client.0.smithi016.stderr: -355> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79763c48) adding con mode: secure 2024-09-12T17:22:49.110 INFO:tasks.workunit.client.0.smithi016.stderr: -354> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79763c48) adding con mode: crc 2024-09-12T17:22:49.110 INFO:tasks.workunit.client.0.smithi016.stderr: -353> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79763c48) adding con mode: secure 2024-09-12T17:22:49.110 INFO:tasks.workunit.client.0.smithi016.stderr: -352> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79763c48) adding con mode: crc 2024-09-12T17:22:49.110 INFO:tasks.workunit.client.0.smithi016.stderr: -351> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79763c48) adding con mode: secure 2024-09-12T17:22:49.110 INFO:tasks.workunit.client.0.smithi016.stderr: -350> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79763c48) adding con mode: crc 2024-09-12T17:22:49.110 INFO:tasks.workunit.client.0.smithi016.stderr: -349> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79763c48) adding con mode: crc 2024-09-12T17:22:49.110 INFO:tasks.workunit.client.0.smithi016.stderr: -348> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79763c48) adding con mode: secure 2024-09-12T17:22:49.110 INFO:tasks.workunit.client.0.smithi016.stderr: -347> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79763c48) adding con mode: crc 2024-09-12T17:22:49.110 INFO:tasks.workunit.client.0.smithi016.stderr: -346> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79763c48) adding con mode: secure 2024-09-12T17:22:49.111 INFO:tasks.workunit.client.0.smithi016.stderr: -345> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79763c48) adding con mode: crc 2024-09-12T17:22:49.111 INFO:tasks.workunit.client.0.smithi016.stderr: -344> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79763c48) adding con mode: secure 2024-09-12T17:22:49.111 INFO:tasks.workunit.client.0.smithi016.stderr: -343> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:49.111 INFO:tasks.workunit.client.0.smithi016.stderr: -342> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:49.111 INFO:tasks.workunit.client.0.smithi016.stderr: -341> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 asok(0x55ea795042b0) register_command rotate-key cmddesc rotate-key hook 0x55ea79763d90 EEXIST 2024-09-12T17:22:49.111 INFO:tasks.workunit.client.0.smithi016.stderr: -340> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 10 monclient: _reopen_session rank -1 2024-09-12T17:22:49.111 INFO:tasks.workunit.client.0.smithi016.stderr: -339> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:22:49.111 INFO:tasks.workunit.client.0.smithi016.stderr: -338> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 10 monclient(hunting): picked mon.noname-b con 0x55ea7978c860 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:22:49.111 INFO:tasks.workunit.client.0.smithi016.stderr: -337> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 10 monclient(hunting): picked mon.noname-c con 0x55ea7978c190 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:22:49.111 INFO:tasks.workunit.client.0.smithi016.stderr: -336> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 10 monclient(hunting): picked mon.noname-a con 0x55ea7978ab70 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:22:49.111 INFO:tasks.workunit.client.0.smithi016.stderr: -335> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:49.111 INFO:tasks.workunit.client.0.smithi016.stderr: -334> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:49.111 INFO:tasks.workunit.client.0.smithi016.stderr: -333> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:49.112 INFO:tasks.workunit.client.0.smithi016.stderr: -332> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 10 monclient(hunting): _renew_subs 2024-09-12T17:22:49.112 INFO:tasks.workunit.client.0.smithi016.stderr: -331> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 10 monclient(hunting): authenticate will time out at 2486.545624s 2024-09-12T17:22:49.112 INFO:tasks.workunit.client.0.smithi016.stderr: -330> 2024-09-12T17:22:48.568+0000 7ff2c23fe640 10 monclient(hunting): get_auth_request con 0x55ea7978ab70 auth_method 0 2024-09-12T17:22:49.112 INFO:tasks.workunit.client.0.smithi016.stderr: -329> 2024-09-12T17:22:48.568+0000 7ff2c23fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:22:49.112 INFO:tasks.workunit.client.0.smithi016.stderr: -328> 2024-09-12T17:22:48.568+0000 7ff2c23fe640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:22:49.112 INFO:tasks.workunit.client.0.smithi016.stderr: -327> 2024-09-12T17:22:48.568+0000 7ff2c23fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:22:49.112 INFO:tasks.workunit.client.0.smithi016.stderr: -326> 2024-09-12T17:22:48.568+0000 7ff2c2bff640 10 monclient(hunting): get_auth_request con 0x55ea7978c190 auth_method 0 2024-09-12T17:22:49.112 INFO:tasks.workunit.client.0.smithi016.stderr: -325> 2024-09-12T17:22:48.568+0000 7ff2c2bff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:22:49.112 INFO:tasks.workunit.client.0.smithi016.stderr: -324> 2024-09-12T17:22:48.568+0000 7ff2c2bff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:22:49.112 INFO:tasks.workunit.client.0.smithi016.stderr: -323> 2024-09-12T17:22:48.568+0000 7ff2c2bff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:22:49.112 INFO:tasks.workunit.client.0.smithi016.stderr: -322> 2024-09-12T17:22:48.568+0000 7ff2c23fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:22:49.112 INFO:tasks.workunit.client.0.smithi016.stderr: -321> 2024-09-12T17:22:48.568+0000 7ff2c23fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:22:49.112 INFO:tasks.workunit.client.0.smithi016.stderr: -320> 2024-09-12T17:22:48.568+0000 7ff2c23fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:22:49.112 INFO:tasks.workunit.client.0.smithi016.stderr: -319> 2024-09-12T17:22:48.568+0000 7ff2c2bff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:22:49.113 INFO:tasks.workunit.client.0.smithi016.stderr: -318> 2024-09-12T17:22:48.568+0000 7ff2c2bff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:22:49.113 INFO:tasks.workunit.client.0.smithi016.stderr: -317> 2024-09-12T17:22:48.568+0000 7ff2c2bff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:22:49.113 INFO:tasks.workunit.client.0.smithi016.stderr: -316> 2024-09-12T17:22:48.568+0000 7ff2c1bfd640 10 monclient(hunting): get_auth_request con 0x55ea7978c860 auth_method 0 2024-09-12T17:22:49.113 INFO:tasks.workunit.client.0.smithi016.stderr: -315> 2024-09-12T17:22:48.568+0000 7ff2c1bfd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:22:49.113 INFO:tasks.workunit.client.0.smithi016.stderr: -314> 2024-09-12T17:22:48.568+0000 7ff2c1bfd640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:22:49.113 INFO:tasks.workunit.client.0.smithi016.stderr: -313> 2024-09-12T17:22:48.568+0000 7ff2c1bfd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:22:49.113 INFO:tasks.workunit.client.0.smithi016.stderr: -312> 2024-09-12T17:22:48.568+0000 7ff2c2bff640 10 monclient(hunting): handle_auth_done global_id 7769 payload 824 2024-09-12T17:22:49.113 INFO:tasks.workunit.client.0.smithi016.stderr: -311> 2024-09-12T17:22:48.568+0000 7ff2c2bff640 10 monclient: _finish_hunting 0 2024-09-12T17:22:49.113 INFO:tasks.workunit.client.0.smithi016.stderr: -310> 2024-09-12T17:22:48.568+0000 7ff2c2bff640 1 monclient: found mon.noname-c 2024-09-12T17:22:49.113 INFO:tasks.workunit.client.0.smithi016.stderr: -309> 2024-09-12T17:22:48.568+0000 7ff2c2bff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:22:49.113 INFO:tasks.workunit.client.0.smithi016.stderr: -308> 2024-09-12T17:22:48.568+0000 7ff1a7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:22:49.114 INFO:tasks.workunit.client.0.smithi016.stderr: -307> 2024-09-12T17:22:48.568+0000 7ff1a7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:22:49.114 INFO:tasks.workunit.client.0.smithi016.stderr: -306> 2024-09-12T17:22:48.568+0000 7ff1a7fff640 10 monclient: dump: 2024-09-12T17:22:49.114 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:22:49.114 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:22:49.114 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:49.114 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:49.114 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:22:49.114 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:49.114 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:22:49.114 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:22:49.114 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:22:49.114 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:49.114 INFO:tasks.workunit.client.0.smithi016.stderr: -305> 2024-09-12T17:22:48.568+0000 7ff1a7fff640 10 monclient: _finish_auth 0 2024-09-12T17:22:49.115 INFO:tasks.workunit.client.0.smithi016.stderr: -304> 2024-09-12T17:22:48.568+0000 7ff1a7fff640 10 monclient: _check_auth_tickets 2024-09-12T17:22:49.115 INFO:tasks.workunit.client.0.smithi016.stderr: -303> 2024-09-12T17:22:48.568+0000 7ff1a7fff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:22:49.115 INFO:tasks.workunit.client.0.smithi016.stderr: -302> 2024-09-12T17:22:48.568+0000 7ff1a7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:22:49.115 INFO:tasks.workunit.client.0.smithi016.stderr: -301> 2024-09-12T17:22:48.568+0000 7ff1a7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:22:49.115 INFO:tasks.workunit.client.0.smithi016.stderr: -300> 2024-09-12T17:22:48.568+0000 7ff1a7fff640 10 monclient: dump: 2024-09-12T17:22:49.115 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:22:49.115 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:22:49.115 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:49.115 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:49.115 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:22:49.115 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:49.115 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:22:49.115 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:22:49.116 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:22:49.116 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:49.116 INFO:tasks.workunit.client.0.smithi016.stderr: -299> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 monclient: authenticate success, global_id 7769 2024-09-12T17:22:49.116 INFO:tasks.workunit.client.0.smithi016.stderr: -298> 2024-09-12T17:22:48.568+0000 7ff2c3400640 4 set_mon_vals no callback set 2024-09-12T17:22:49.116 INFO:tasks.workunit.client.0.smithi016.stderr: -297> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 10 monclient: _renew_subs 2024-09-12T17:22:49.116 INFO:tasks.workunit.client.0.smithi016.stderr: -296> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:22:49.116 INFO:tasks.workunit.client.0.smithi016.stderr: -295> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 10 monclient: _renew_subs 2024-09-12T17:22:49.116 INFO:tasks.workunit.client.0.smithi016.stderr: -294> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:22:49.116 INFO:tasks.workunit.client.0.smithi016.stderr: -293> 2024-09-12T17:22:48.572+0000 7ff1a7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:22:49.116 INFO:tasks.workunit.client.0.smithi016.stderr: -292> 2024-09-12T17:22:48.572+0000 7ff1a7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:22:49.116 INFO:tasks.workunit.client.0.smithi016.stderr: -291> 2024-09-12T17:22:48.572+0000 7ff1a7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:22:49.116 INFO:tasks.workunit.client.0.smithi016.stderr: -290> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 10 monclient: get_monmap_and_config 2024-09-12T17:22:49.117 INFO:tasks.workunit.client.0.smithi016.stderr: -289> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 10 monclient: build_initial_monmap 2024-09-12T17:22:49.117 INFO:tasks.workunit.client.0.smithi016.stderr: -288> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 1 build_initial for_mkfs: 0 2024-09-12T17:22:49.117 INFO:tasks.workunit.client.0.smithi016.stderr: -287> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 10 monclient: monmap: 2024-09-12T17:22:49.117 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:22:49.117 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:22:49.117 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:22:49.117 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:22:49.117 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:22:49.117 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:49.117 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:22:49.117 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:22:49.117 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:22:49.117 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:49.117 INFO:tasks.workunit.client.0.smithi016.stderr: -286> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf90) adding auth protocol: cephx 2024-09-12T17:22:49.118 INFO:tasks.workunit.client.0.smithi016.stderr: -285> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf90) adding auth protocol: cephx 2024-09-12T17:22:49.118 INFO:tasks.workunit.client.0.smithi016.stderr: -284> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf90) adding auth protocol: cephx 2024-09-12T17:22:49.118 INFO:tasks.workunit.client.0.smithi016.stderr: -283> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf90) adding con mode: secure 2024-09-12T17:22:49.118 INFO:tasks.workunit.client.0.smithi016.stderr: -282> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf90) adding con mode: crc 2024-09-12T17:22:49.118 INFO:tasks.workunit.client.0.smithi016.stderr: -281> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf90) adding con mode: secure 2024-09-12T17:22:49.118 INFO:tasks.workunit.client.0.smithi016.stderr: -280> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf90) adding con mode: crc 2024-09-12T17:22:49.118 INFO:tasks.workunit.client.0.smithi016.stderr: -279> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf90) adding con mode: secure 2024-09-12T17:22:49.118 INFO:tasks.workunit.client.0.smithi016.stderr: -278> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf90) adding con mode: crc 2024-09-12T17:22:49.118 INFO:tasks.workunit.client.0.smithi016.stderr: -277> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf90) adding con mode: crc 2024-09-12T17:22:49.118 INFO:tasks.workunit.client.0.smithi016.stderr: -276> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf90) adding con mode: secure 2024-09-12T17:22:49.118 INFO:tasks.workunit.client.0.smithi016.stderr: -275> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf90) adding con mode: crc 2024-09-12T17:22:49.118 INFO:tasks.workunit.client.0.smithi016.stderr: -274> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf90) adding con mode: secure 2024-09-12T17:22:49.118 INFO:tasks.workunit.client.0.smithi016.stderr: -273> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf90) adding con mode: crc 2024-09-12T17:22:49.118 INFO:tasks.workunit.client.0.smithi016.stderr: -272> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf90) adding con mode: secure 2024-09-12T17:22:49.119 INFO:tasks.workunit.client.0.smithi016.stderr: -271> 2024-09-12T17:22:48.572+0000 7ff2c1bfd640 10 monclient: get_auth_request con 0x7ff19c070a20 auth_method 0 2024-09-12T17:22:49.119 INFO:tasks.workunit.client.0.smithi016.stderr: -270> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:49.119 INFO:tasks.workunit.client.0.smithi016.stderr: -269> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 10 monclient: init 2024-09-12T17:22:49.119 INFO:tasks.workunit.client.0.smithi016.stderr: -268> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc858925e0) adding auth protocol: cephx 2024-09-12T17:22:49.119 INFO:tasks.workunit.client.0.smithi016.stderr: -267> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc858925e0) adding auth protocol: cephx 2024-09-12T17:22:49.119 INFO:tasks.workunit.client.0.smithi016.stderr: -266> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc858925e0) adding auth protocol: cephx 2024-09-12T17:22:49.119 INFO:tasks.workunit.client.0.smithi016.stderr: -265> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc858925e0) adding con mode: secure 2024-09-12T17:22:49.119 INFO:tasks.workunit.client.0.smithi016.stderr: -264> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc858925e0) adding con mode: crc 2024-09-12T17:22:49.119 INFO:tasks.workunit.client.0.smithi016.stderr: -263> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc858925e0) adding con mode: secure 2024-09-12T17:22:49.119 INFO:tasks.workunit.client.0.smithi016.stderr: -262> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc858925e0) adding con mode: crc 2024-09-12T17:22:49.119 INFO:tasks.workunit.client.0.smithi016.stderr: -261> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc858925e0) adding con mode: secure 2024-09-12T17:22:49.119 INFO:tasks.workunit.client.0.smithi016.stderr: -260> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc858925e0) adding con mode: crc 2024-09-12T17:22:49.119 INFO:tasks.workunit.client.0.smithi016.stderr: -259> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc858925e0) adding con mode: crc 2024-09-12T17:22:49.120 INFO:tasks.workunit.client.0.smithi016.stderr: -258> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc858925e0) adding con mode: secure 2024-09-12T17:22:49.120 INFO:tasks.workunit.client.0.smithi016.stderr: -257> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc858925e0) adding con mode: crc 2024-09-12T17:22:49.120 INFO:tasks.workunit.client.0.smithi016.stderr: -256> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc858925e0) adding con mode: secure 2024-09-12T17:22:49.120 INFO:tasks.workunit.client.0.smithi016.stderr: -255> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc858925e0) adding con mode: crc 2024-09-12T17:22:49.120 INFO:tasks.workunit.client.0.smithi016.stderr: -254> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc858925e0) adding con mode: secure 2024-09-12T17:22:49.120 INFO:tasks.workunit.client.0.smithi016.stderr: -253> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:49.120 INFO:tasks.workunit.client.0.smithi016.stderr: -252> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:49.120 INFO:tasks.workunit.client.0.smithi016.stderr: -251> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 asok(0x55ea795042b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc85892728 EEXIST 2024-09-12T17:22:49.120 INFO:tasks.workunit.client.0.smithi016.stderr: -250> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 10 monclient: _reopen_session rank -1 2024-09-12T17:22:49.120 INFO:tasks.workunit.client.0.smithi016.stderr: -249> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:22:49.120 INFO:tasks.workunit.client.0.smithi016.stderr: -248> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 10 monclient(hunting): picked mon.noname-a con 0x55ea797da540 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:22:49.120 INFO:tasks.workunit.client.0.smithi016.stderr: -247> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 10 monclient(hunting): picked mon.noname-c con 0x55ea797da920 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:22:49.120 INFO:tasks.workunit.client.0.smithi016.stderr: -246> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 10 monclient(hunting): picked mon.noname-b con 0x55ea797dbda0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:22:49.120 INFO:tasks.workunit.client.0.smithi016.stderr: -245> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:49.121 INFO:tasks.workunit.client.0.smithi016.stderr: -244> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:49.121 INFO:tasks.workunit.client.0.smithi016.stderr: -243> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:49.121 INFO:tasks.workunit.client.0.smithi016.stderr: -242> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 10 monclient(hunting): _renew_subs 2024-09-12T17:22:49.121 INFO:tasks.workunit.client.0.smithi016.stderr: -241> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 10 monclient(hunting): authenticate will time out at 2486.550146s 2024-09-12T17:22:49.121 INFO:tasks.workunit.client.0.smithi016.stderr: -240> 2024-09-12T17:22:48.572+0000 7ff2c1bfd640 10 monclient(hunting): get_auth_request con 0x55ea797da540 auth_method 0 2024-09-12T17:22:49.121 INFO:tasks.workunit.client.0.smithi016.stderr: -239> 2024-09-12T17:22:48.572+0000 7ff2c1bfd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:22:49.121 INFO:tasks.workunit.client.0.smithi016.stderr: -238> 2024-09-12T17:22:48.572+0000 7ff2c1bfd640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:22:49.121 INFO:tasks.workunit.client.0.smithi016.stderr: -237> 2024-09-12T17:22:48.572+0000 7ff2c1bfd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:22:49.121 INFO:tasks.workunit.client.0.smithi016.stderr: -236> 2024-09-12T17:22:48.572+0000 7ff2c2bff640 10 monclient(hunting): get_auth_request con 0x55ea797da920 auth_method 0 2024-09-12T17:22:49.121 INFO:tasks.workunit.client.0.smithi016.stderr: -235> 2024-09-12T17:22:48.572+0000 7ff2c2bff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:22:49.121 INFO:tasks.workunit.client.0.smithi016.stderr: -234> 2024-09-12T17:22:48.572+0000 7ff2c2bff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:22:49.121 INFO:tasks.workunit.client.0.smithi016.stderr: -233> 2024-09-12T17:22:48.572+0000 7ff2c2bff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:22:49.121 INFO:tasks.workunit.client.0.smithi016.stderr: -232> 2024-09-12T17:22:48.572+0000 7ff2c2bff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:22:49.122 INFO:tasks.workunit.client.0.smithi016.stderr: -231> 2024-09-12T17:22:48.572+0000 7ff2c2bff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:22:49.122 INFO:tasks.workunit.client.0.smithi016.stderr: -230> 2024-09-12T17:22:48.572+0000 7ff2c2bff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:22:49.122 INFO:tasks.workunit.client.0.smithi016.stderr: -229> 2024-09-12T17:22:48.572+0000 7ff2c1bfd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:22:49.122 INFO:tasks.workunit.client.0.smithi016.stderr: -228> 2024-09-12T17:22:48.572+0000 7ff2c1bfd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:22:49.122 INFO:tasks.workunit.client.0.smithi016.stderr: -227> 2024-09-12T17:22:48.572+0000 7ff2c1bfd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:22:49.122 INFO:tasks.workunit.client.0.smithi016.stderr: -226> 2024-09-12T17:22:48.572+0000 7ff2c2bff640 10 monclient(hunting): handle_auth_done global_id 7772 payload 274 2024-09-12T17:22:49.122 INFO:tasks.workunit.client.0.smithi016.stderr: -225> 2024-09-12T17:22:48.572+0000 7ff2c2bff640 10 monclient: _finish_hunting 0 2024-09-12T17:22:49.122 INFO:tasks.workunit.client.0.smithi016.stderr: -224> 2024-09-12T17:22:48.572+0000 7ff2c2bff640 1 monclient: found mon.noname-c 2024-09-12T17:22:49.122 INFO:tasks.workunit.client.0.smithi016.stderr: -223> 2024-09-12T17:22:48.572+0000 7ff2c2bff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:22:49.122 INFO:tasks.workunit.client.0.smithi016.stderr: -222> 2024-09-12T17:22:48.572+0000 7ff1a5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:22:49.122 INFO:tasks.workunit.client.0.smithi016.stderr: -221> 2024-09-12T17:22:48.572+0000 7ff1a5ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:22:49.122 INFO:tasks.workunit.client.0.smithi016.stderr: -220> 2024-09-12T17:22:48.572+0000 7ff1a5ffb640 10 monclient: dump: 2024-09-12T17:22:49.122 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:22:49.122 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:22:49.123 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:49.123 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:49.123 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:22:49.123 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:49.123 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:22:49.123 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:22:49.123 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:22:49.123 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:49.123 INFO:tasks.workunit.client.0.smithi016.stderr: -219> 2024-09-12T17:22:48.572+0000 7ff1a5ffb640 10 monclient: _finish_auth 0 2024-09-12T17:22:49.123 INFO:tasks.workunit.client.0.smithi016.stderr: -218> 2024-09-12T17:22:48.572+0000 7ff1a5ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:22:49.123 INFO:tasks.workunit.client.0.smithi016.stderr: -217> 2024-09-12T17:22:48.572+0000 7ff1a5ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:22:49.123 INFO:tasks.workunit.client.0.smithi016.stderr: -216> 2024-09-12T17:22:48.572+0000 7ff1a5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:22:49.123 INFO:tasks.workunit.client.0.smithi016.stderr: -215> 2024-09-12T17:22:48.572+0000 7ff1a5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:22:49.123 INFO:tasks.workunit.client.0.smithi016.stderr: -214> 2024-09-12T17:22:48.572+0000 7ff1a5ffb640 10 monclient: dump: 2024-09-12T17:22:49.124 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:22:49.124 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:22:49.124 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:49.124 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:49.124 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:22:49.124 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:49.124 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:22:49.124 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:22:49.124 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:22:49.124 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:49.124 INFO:tasks.workunit.client.0.smithi016.stderr: -213> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 monclient: authenticate success, global_id 7772 2024-09-12T17:22:49.124 INFO:tasks.workunit.client.0.smithi016.stderr: -212> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 10 monclient: get_monmap_and_config success 2024-09-12T17:22:49.124 INFO:tasks.workunit.client.0.smithi016.stderr: -211> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 4 set_mon_vals no callback set 2024-09-12T17:22:49.125 INFO:tasks.workunit.client.0.smithi016.stderr: -210> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 10 monclient: shutdown 2024-09-12T17:22:49.125 INFO:tasks.workunit.client.0.smithi016.stderr: -209> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 10 monclient: build_initial_monmap 2024-09-12T17:22:49.125 INFO:tasks.workunit.client.0.smithi016.stderr: -208> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 1 build_initial for_mkfs: 0 2024-09-12T17:22:49.125 INFO:tasks.workunit.client.0.smithi016.stderr: -207> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 10 monclient: monmap: 2024-09-12T17:22:49.125 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:22:49.125 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:22:49.125 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:22:49.125 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:22:49.125 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:22:49.125 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:49.125 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:22:49.125 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:22:49.125 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:22:49.125 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:49.125 INFO:tasks.workunit.client.0.smithi016.stderr: -206> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf40) adding auth protocol: cephx 2024-09-12T17:22:49.126 INFO:tasks.workunit.client.0.smithi016.stderr: -205> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf40) adding auth protocol: cephx 2024-09-12T17:22:49.126 INFO:tasks.workunit.client.0.smithi016.stderr: -204> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf40) adding auth protocol: cephx 2024-09-12T17:22:49.126 INFO:tasks.workunit.client.0.smithi016.stderr: -203> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf40) adding con mode: secure 2024-09-12T17:22:49.126 INFO:tasks.workunit.client.0.smithi016.stderr: -202> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf40) adding con mode: crc 2024-09-12T17:22:49.126 INFO:tasks.workunit.client.0.smithi016.stderr: -201> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf40) adding con mode: secure 2024-09-12T17:22:49.126 INFO:tasks.workunit.client.0.smithi016.stderr: -200> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf40) adding con mode: crc 2024-09-12T17:22:49.126 INFO:tasks.workunit.client.0.smithi016.stderr: -199> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf40) adding con mode: secure 2024-09-12T17:22:49.126 INFO:tasks.workunit.client.0.smithi016.stderr: -198> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf40) adding con mode: crc 2024-09-12T17:22:49.126 INFO:tasks.workunit.client.0.smithi016.stderr: -197> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf40) adding con mode: crc 2024-09-12T17:22:49.126 INFO:tasks.workunit.client.0.smithi016.stderr: -196> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf40) adding con mode: secure 2024-09-12T17:22:49.126 INFO:tasks.workunit.client.0.smithi016.stderr: -195> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf40) adding con mode: crc 2024-09-12T17:22:49.126 INFO:tasks.workunit.client.0.smithi016.stderr: -194> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf40) adding con mode: secure 2024-09-12T17:22:49.126 INFO:tasks.workunit.client.0.smithi016.stderr: -193> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf40) adding con mode: crc 2024-09-12T17:22:49.126 INFO:tasks.workunit.client.0.smithi016.stderr: -192> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf40) adding con mode: secure 2024-09-12T17:22:49.126 INFO:tasks.workunit.client.0.smithi016.stderr: -191> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:49.127 INFO:tasks.workunit.client.0.smithi016.stderr: -190> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 1 librados: starting msgr at 2024-09-12T17:22:49.127 INFO:tasks.workunit.client.0.smithi016.stderr: -189> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 1 librados: starting objecter 2024-09-12T17:22:49.127 INFO:tasks.workunit.client.0.smithi016.stderr: -188> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 5 asok(0x55ea795042b0) register_command objecter_requests cmddesc objecter_requests hook 0x55ea797d9c80 EEXIST 2024-09-12T17:22:49.127 INFO:tasks.workunit.client.0.smithi016.stderr: -187> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 1 librados: setting wanted keys 2024-09-12T17:22:49.127 INFO:tasks.workunit.client.0.smithi016.stderr: -186> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 1 librados: calling monclient init 2024-09-12T17:22:49.127 INFO:tasks.workunit.client.0.smithi016.stderr: -185> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 10 monclient: init 2024-09-12T17:22:49.127 INFO:tasks.workunit.client.0.smithi016.stderr: -184> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7978e680) adding auth protocol: cephx 2024-09-12T17:22:49.127 INFO:tasks.workunit.client.0.smithi016.stderr: -183> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7978e680) adding auth protocol: cephx 2024-09-12T17:22:49.127 INFO:tasks.workunit.client.0.smithi016.stderr: -182> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7978e680) adding auth protocol: cephx 2024-09-12T17:22:49.127 INFO:tasks.workunit.client.0.smithi016.stderr: -181> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7978e680) adding con mode: secure 2024-09-12T17:22:49.127 INFO:tasks.workunit.client.0.smithi016.stderr: -180> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7978e680) adding con mode: crc 2024-09-12T17:22:49.127 INFO:tasks.workunit.client.0.smithi016.stderr: -179> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7978e680) adding con mode: secure 2024-09-12T17:22:49.127 INFO:tasks.workunit.client.0.smithi016.stderr: -178> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7978e680) adding con mode: crc 2024-09-12T17:22:49.127 INFO:tasks.workunit.client.0.smithi016.stderr: -177> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7978e680) adding con mode: secure 2024-09-12T17:22:49.128 INFO:tasks.workunit.client.0.smithi016.stderr: -176> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7978e680) adding con mode: crc 2024-09-12T17:22:49.128 INFO:tasks.workunit.client.0.smithi016.stderr: -175> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7978e680) adding con mode: crc 2024-09-12T17:22:49.128 INFO:tasks.workunit.client.0.smithi016.stderr: -174> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7978e680) adding con mode: secure 2024-09-12T17:22:49.128 INFO:tasks.workunit.client.0.smithi016.stderr: -173> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7978e680) adding con mode: crc 2024-09-12T17:22:49.128 INFO:tasks.workunit.client.0.smithi016.stderr: -172> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7978e680) adding con mode: secure 2024-09-12T17:22:49.128 INFO:tasks.workunit.client.0.smithi016.stderr: -171> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7978e680) adding con mode: crc 2024-09-12T17:22:49.128 INFO:tasks.workunit.client.0.smithi016.stderr: -170> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7978e680) adding con mode: secure 2024-09-12T17:22:49.128 INFO:tasks.workunit.client.0.smithi016.stderr: -169> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:49.128 INFO:tasks.workunit.client.0.smithi016.stderr: -168> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:49.128 INFO:tasks.workunit.client.0.smithi016.stderr: -167> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 5 asok(0x55ea795042b0) register_command rotate-key cmddesc rotate-key hook 0x55ea7978e7c8 EEXIST 2024-09-12T17:22:49.128 INFO:tasks.workunit.client.0.smithi016.stderr: -166> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 10 monclient: _reopen_session rank -1 2024-09-12T17:22:49.128 INFO:tasks.workunit.client.0.smithi016.stderr: -165> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:22:49.128 INFO:tasks.workunit.client.0.smithi016.stderr: -164> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 10 monclient(hunting): picked mon.noname-c con 0x55ea797da540 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:22:49.128 INFO:tasks.workunit.client.0.smithi016.stderr: -163> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 10 monclient(hunting): picked mon.noname-a con 0x55ea797dbda0 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:22:49.129 INFO:tasks.workunit.client.0.smithi016.stderr: -162> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 10 monclient(hunting): picked mon.noname-b con 0x55ea797d0040 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:22:49.129 INFO:tasks.workunit.client.0.smithi016.stderr: -161> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:49.129 INFO:tasks.workunit.client.0.smithi016.stderr: -160> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:49.129 INFO:tasks.workunit.client.0.smithi016.stderr: -159> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:49.129 INFO:tasks.workunit.client.0.smithi016.stderr: -158> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 10 monclient(hunting): _renew_subs 2024-09-12T17:22:49.129 INFO:tasks.workunit.client.0.smithi016.stderr: -157> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 10 monclient(hunting): authenticate will time out at 2486.552788s 2024-09-12T17:22:49.129 INFO:tasks.workunit.client.0.smithi016.stderr: -156> 2024-09-12T17:22:48.576+0000 7ff2c1bfd640 10 monclient(hunting): get_auth_request con 0x55ea797da540 auth_method 0 2024-09-12T17:22:49.129 INFO:tasks.workunit.client.0.smithi016.stderr: -155> 2024-09-12T17:22:48.576+0000 7ff2c1bfd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:22:49.129 INFO:tasks.workunit.client.0.smithi016.stderr: -154> 2024-09-12T17:22:48.576+0000 7ff2c1bfd640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:22:49.129 INFO:tasks.workunit.client.0.smithi016.stderr: -153> 2024-09-12T17:22:48.576+0000 7ff2c1bfd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:22:49.129 INFO:tasks.workunit.client.0.smithi016.stderr: -152> 2024-09-12T17:22:48.576+0000 7ff2c2bff640 10 monclient(hunting): get_auth_request con 0x55ea797dbda0 auth_method 0 2024-09-12T17:22:49.129 INFO:tasks.workunit.client.0.smithi016.stderr: -151> 2024-09-12T17:22:48.576+0000 7ff2c2bff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:22:49.130 INFO:tasks.workunit.client.0.smithi016.stderr: -150> 2024-09-12T17:22:48.576+0000 7ff2c2bff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:22:49.130 INFO:tasks.workunit.client.0.smithi016.stderr: -149> 2024-09-12T17:22:48.576+0000 7ff2c2bff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:22:49.130 INFO:tasks.workunit.client.0.smithi016.stderr: -148> 2024-09-12T17:22:48.576+0000 7ff2c1bfd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:22:49.130 INFO:tasks.workunit.client.0.smithi016.stderr: -147> 2024-09-12T17:22:48.576+0000 7ff2c1bfd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:22:49.130 INFO:tasks.workunit.client.0.smithi016.stderr: -146> 2024-09-12T17:22:48.576+0000 7ff2c1bfd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:22:49.130 INFO:tasks.workunit.client.0.smithi016.stderr: -145> 2024-09-12T17:22:48.576+0000 7ff2c2bff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:22:49.130 INFO:tasks.workunit.client.0.smithi016.stderr: -144> 2024-09-12T17:22:48.576+0000 7ff2c2bff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:22:49.130 INFO:tasks.workunit.client.0.smithi016.stderr: -143> 2024-09-12T17:22:48.576+0000 7ff2c2bff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:22:49.130 INFO:tasks.workunit.client.0.smithi016.stderr: -142> 2024-09-12T17:22:48.576+0000 7ff2c1bfd640 10 monclient(hunting): handle_auth_done global_id 7775 payload 824 2024-09-12T17:22:49.130 INFO:tasks.workunit.client.0.smithi016.stderr: -141> 2024-09-12T17:22:48.576+0000 7ff2c1bfd640 10 monclient: _finish_hunting 0 2024-09-12T17:22:49.130 INFO:tasks.workunit.client.0.smithi016.stderr: -140> 2024-09-12T17:22:48.576+0000 7ff2c1bfd640 1 monclient: found mon.noname-c 2024-09-12T17:22:49.130 INFO:tasks.workunit.client.0.smithi016.stderr: -139> 2024-09-12T17:22:48.576+0000 7ff2c1bfd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:22:49.130 INFO:tasks.workunit.client.0.smithi016.stderr: -138> 2024-09-12T17:22:48.576+0000 7ff193fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:22:49.130 INFO:tasks.workunit.client.0.smithi016.stderr: -137> 2024-09-12T17:22:48.576+0000 7ff193fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:22:49.131 INFO:tasks.workunit.client.0.smithi016.stderr: -136> 2024-09-12T17:22:48.576+0000 7ff193fff640 10 monclient: dump: 2024-09-12T17:22:49.131 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:22:49.131 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:22:49.131 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:49.131 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:49.131 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:22:49.131 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:49.131 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:22:49.131 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:22:49.131 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:22:49.131 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:49.131 INFO:tasks.workunit.client.0.smithi016.stderr: -135> 2024-09-12T17:22:48.576+0000 7ff193fff640 10 monclient: _finish_auth 0 2024-09-12T17:22:49.131 INFO:tasks.workunit.client.0.smithi016.stderr: -134> 2024-09-12T17:22:48.576+0000 7ff193fff640 10 monclient: _check_auth_tickets 2024-09-12T17:22:49.131 INFO:tasks.workunit.client.0.smithi016.stderr: -133> 2024-09-12T17:22:48.576+0000 7ff193fff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:22:49.131 INFO:tasks.workunit.client.0.smithi016.stderr: -132> 2024-09-12T17:22:48.576+0000 7ff193fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:22:49.132 INFO:tasks.workunit.client.0.smithi016.stderr: -131> 2024-09-12T17:22:48.576+0000 7ff193fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:22:49.132 INFO:tasks.workunit.client.0.smithi016.stderr: -130> 2024-09-12T17:22:48.576+0000 7ff193fff640 10 monclient: dump: 2024-09-12T17:22:49.132 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:22:49.132 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:22:49.132 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:49.132 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:49.132 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:22:49.132 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:49.132 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:22:49.132 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:22:49.132 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:22:49.132 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:49.133 INFO:tasks.workunit.client.0.smithi016.stderr: -129> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 5 monclient: authenticate success, global_id 7775 2024-09-12T17:22:49.133 INFO:tasks.workunit.client.0.smithi016.stderr: -128> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 10 monclient: _renew_subs 2024-09-12T17:22:49.133 INFO:tasks.workunit.client.0.smithi016.stderr: -127> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:22:49.133 INFO:tasks.workunit.client.0.smithi016.stderr: -126> 2024-09-12T17:22:48.576+0000 7ff1a5ffb640 4 set_mon_vals no callback set 2024-09-12T17:22:49.133 INFO:tasks.workunit.client.0.smithi016.stderr: -125> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 10 monclient: _renew_subs 2024-09-12T17:22:49.133 INFO:tasks.workunit.client.0.smithi016.stderr: -124> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:22:49.133 INFO:tasks.workunit.client.0.smithi016.stderr: -123> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 1 librados: init done 2024-09-12T17:22:49.133 INFO:tasks.workunit.client.0.smithi016.stderr: -122> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 5 asok(0x55ea795042b0) register_command cr dump hook 0x55ea797cfbc8 2024-09-12T17:22:49.133 INFO:tasks.workunit.client.0.smithi016.stderr: -121> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.133 INFO:tasks.workunit.client.0.smithi016.stderr: -120> 2024-09-12T17:22:48.576+0000 7ff193fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:22:49.133 INFO:tasks.workunit.client.0.smithi016.stderr: -119> 2024-09-12T17:22:48.576+0000 7ff193fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:22:49.133 INFO:tasks.workunit.client.0.smithi016.stderr: -118> 2024-09-12T17:22:48.576+0000 7ff193fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:22:49.133 INFO:tasks.workunit.client.0.smithi016.stderr: -117> 2024-09-12T17:22:48.580+0000 7ff2c2bff640 10 monclient: get_auth_request con 0x7ff18c070b10 auth_method 0 2024-09-12T17:22:49.134 INFO:tasks.workunit.client.0.smithi016.stderr: -116> 2024-09-12T17:22:48.580+0000 7ff2c23fe640 10 monclient: get_auth_request con 0x55ea797fb250 auth_method 0 2024-09-12T17:22:49.134 INFO:tasks.workunit.client.0.smithi016.stderr: -115> 2024-09-12T17:22:48.580+0000 7ff2c48f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:49.134 INFO:tasks.workunit.client.0.smithi016.stderr: -114> 2024-09-12T17:22:48.580+0000 7ff2c48f89c0 20 realm 2024-09-12T17:22:49.134 INFO:tasks.workunit.client.0.smithi016.stderr: -113> 2024-09-12T17:22:48.580+0000 7ff2c48f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.134 INFO:tasks.workunit.client.0.smithi016.stderr: -112> 2024-09-12T17:22:48.580+0000 7ff2c48f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:49.134 INFO:tasks.workunit.client.0.smithi016.stderr: -111> 2024-09-12T17:22:48.580+0000 7ff2c48f89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:22:49.134 INFO:tasks.workunit.client.0.smithi016.stderr: -110> 2024-09-12T17:22:48.580+0000 7ff2c48f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.134 INFO:tasks.workunit.client.0.smithi016.stderr: -109> 2024-09-12T17:22:48.580+0000 7ff2c48f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:49.134 INFO:tasks.workunit.client.0.smithi016.stderr: -108> 2024-09-12T17:22:48.580+0000 7ff2c48f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.134 INFO:tasks.workunit.client.0.smithi016.stderr: -107> 2024-09-12T17:22:48.580+0000 7ff2c1bfd640 10 monclient: get_auth_request con 0x55ea797ff460 auth_method 0 2024-09-12T17:22:49.134 INFO:tasks.workunit.client.0.smithi016.stderr: -106> 2024-09-12T17:22:48.580+0000 7ff2c48f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:22:49.134 INFO:tasks.workunit.client.0.smithi016.stderr: -105> 2024-09-12T17:22:48.580+0000 7ff2c48f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.135 INFO:tasks.workunit.client.0.smithi016.stderr: -104> 2024-09-12T17:22:48.580+0000 7ff2c2bff640 10 monclient: get_auth_request con 0x55ea79802ca0 auth_method 0 2024-09-12T17:22:49.135 INFO:tasks.workunit.client.0.smithi016.stderr: -103> 2024-09-12T17:22:48.584+0000 7ff2c48f89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:22:49.135 INFO:tasks.workunit.client.0.smithi016.stderr: -102> 2024-09-12T17:22:48.584+0000 7ff2c48f89c0 20 searching for the correct realm 2024-09-12T17:22:49.135 INFO:tasks.workunit.client.0.smithi016.stderr: -101> 2024-09-12T17:22:48.584+0000 7ff2c23fe640 10 monclient: get_auth_request con 0x55ea79807a60 auth_method 0 2024-09-12T17:22:49.135 INFO:tasks.workunit.client.0.smithi016.stderr: -100> 2024-09-12T17:22:48.584+0000 7ff2c1bfd640 10 monclient: get_auth_request con 0x7ff2b4017070 auth_method 0 2024-09-12T17:22:49.135 INFO:tasks.workunit.client.0.smithi016.stderr: -99> 2024-09-12T17:22:48.584+0000 7ff2c2bff640 10 monclient: get_auth_request con 0x7ff2b8047060 auth_method 0 2024-09-12T17:22:49.135 INFO:tasks.workunit.client.0.smithi016.stderr: -98> 2024-09-12T17:22:48.588+0000 7ff2c2bff640 0 -- 172.21.15.16:0/2043560097 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7ff2b8047060 msgr2=0x7ff2b8071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:22:49.135 INFO:tasks.workunit.client.0.smithi016.stderr: -97> 2024-09-12T17:22:48.792+0000 7ff2c2bff640 10 monclient: get_auth_request con 0x7ff2b8047060 auth_method 0 2024-09-12T17:22:49.135 INFO:tasks.workunit.client.0.smithi016.stderr: -96> 2024-09-12T17:22:48.796+0000 7ff2c23fe640 10 monclient: get_auth_request con 0x7ff2bc134040 auth_method 0 2024-09-12T17:22:49.135 INFO:tasks.workunit.client.0.smithi016.stderr: -95> 2024-09-12T17:22:48.804+0000 7ff2c1bfd640 0 -- 172.21.15.16:0/2043560097 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7ff2bc0cd890 msgr2=0x7ff2bc1180c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:22:49.135 INFO:tasks.workunit.client.0.smithi016.stderr: -94> 2024-09-12T17:22:49.008+0000 7ff2c1bfd640 10 monclient: get_auth_request con 0x7ff2bc0cd890 auth_method 0 2024-09-12T17:22:49.135 INFO:tasks.workunit.client.0.smithi016.stderr: -93> 2024-09-12T17:22:49.020+0000 7ff2c48f89c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:22:49.135 INFO:tasks.workunit.client.0.smithi016.stderr: -92> 2024-09-12T17:22:49.020+0000 7ff2c48f89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:22:49.136 INFO:tasks.workunit.client.0.smithi016.stderr: -91> 2024-09-12T17:22:49.020+0000 7ff2c48f89c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:22:49.136 INFO:tasks.workunit.client.0.smithi016.stderr: -90> 2024-09-12T17:22:49.020+0000 7ff2c48f89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:22:49.136 INFO:tasks.workunit.client.0.smithi016.stderr: -89> 2024-09-12T17:22:49.020+0000 7ff2c48f89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:22:49.136 INFO:tasks.workunit.client.0.smithi016.stderr: -88> 2024-09-12T17:22:49.020+0000 7ff2c48f89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:22:49.136 INFO:tasks.workunit.client.0.smithi016.stderr: -87> 2024-09-12T17:22:49.020+0000 7ff2c48f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.136 INFO:tasks.workunit.client.0.smithi016.stderr: -86> 2024-09-12T17:22:49.024+0000 7ff2c48f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:49.136 INFO:tasks.workunit.client.0.smithi016.stderr: -85> 2024-09-12T17:22:49.024+0000 7ff2c48f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.136 INFO:tasks.workunit.client.0.smithi016.stderr: -84> 2024-09-12T17:22:49.024+0000 7ff2c48f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:22:49.136 INFO:tasks.workunit.client.0.smithi016.stderr: -83> 2024-09-12T17:22:49.024+0000 7ff2c48f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.136 INFO:tasks.workunit.client.0.smithi016.stderr: -82> 2024-09-12T17:22:49.024+0000 7ff2c48f89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:22:49.136 INFO:tasks.workunit.client.0.smithi016.stderr: -81> 2024-09-12T17:22:49.024+0000 7ff2c48f89c0 20 zone default found 2024-09-12T17:22:49.136 INFO:tasks.workunit.client.0.smithi016.stderr: -80> 2024-09-12T17:22:49.024+0000 7ff2c48f89c0 4 Realm: () 2024-09-12T17:22:49.136 INFO:tasks.workunit.client.0.smithi016.stderr: -79> 2024-09-12T17:22:49.024+0000 7ff2c48f89c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:22:49.137 INFO:tasks.workunit.client.0.smithi016.stderr: -78> 2024-09-12T17:22:49.024+0000 7ff2c48f89c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:22:49.137 INFO:tasks.workunit.client.0.smithi016.stderr: -77> 2024-09-12T17:22:49.024+0000 7ff2c48f89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:22:49.137 INFO:tasks.workunit.client.0.smithi016.stderr: -76> 2024-09-12T17:22:49.024+0000 7ff2c48f89c0 20 zonegroup default 2024-09-12T17:22:49.137 INFO:tasks.workunit.client.0.smithi016.stderr: -75> 2024-09-12T17:22:49.024+0000 7ff2c48f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.137 INFO:tasks.workunit.client.0.smithi016.stderr: -74> 2024-09-12T17:22:49.024+0000 7ff2c48f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:49.137 INFO:tasks.workunit.client.0.smithi016.stderr: -73> 2024-09-12T17:22:49.024+0000 7ff2c48f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.137 INFO:tasks.workunit.client.0.smithi016.stderr: -72> 2024-09-12T17:22:49.024+0000 7ff2c48f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:49.137 INFO:tasks.workunit.client.0.smithi016.stderr: -71> 2024-09-12T17:22:49.028+0000 7ff2c48f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.137 INFO:tasks.workunit.client.0.smithi016.stderr: -70> 2024-09-12T17:22:49.028+0000 7ff2c48f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:49.137 INFO:tasks.workunit.client.0.smithi016.stderr: -69> 2024-09-12T17:22:49.028+0000 7ff2c48f89c0 20 started sync module instance, tier type = 2024-09-12T17:22:49.137 INFO:tasks.workunit.client.0.smithi016.stderr: -68> 2024-09-12T17:22:49.028+0000 7ff2c48f89c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:22:49.137 INFO:tasks.workunit.client.0.smithi016.stderr: -67> 2024-09-12T17:22:49.048+0000 7ff2c48f89c0 20 add_watcher() i=0 2024-09-12T17:22:49.137 INFO:tasks.workunit.client.0.smithi016.stderr: -66> 2024-09-12T17:22:49.048+0000 7ff2c48f89c0 20 add_watcher() i=1 2024-09-12T17:22:49.138 INFO:tasks.workunit.client.0.smithi016.stderr: -65> 2024-09-12T17:22:49.048+0000 7ff2c48f89c0 20 add_watcher() i=2 2024-09-12T17:22:49.138 INFO:tasks.workunit.client.0.smithi016.stderr: -64> 2024-09-12T17:22:49.048+0000 7ff2c48f89c0 20 add_watcher() i=3 2024-09-12T17:22:49.138 INFO:tasks.workunit.client.0.smithi016.stderr: -63> 2024-09-12T17:22:49.048+0000 7ff2c48f89c0 20 add_watcher() i=4 2024-09-12T17:22:49.138 INFO:tasks.workunit.client.0.smithi016.stderr: -62> 2024-09-12T17:22:49.048+0000 7ff2c48f89c0 20 add_watcher() i=5 2024-09-12T17:22:49.138 INFO:tasks.workunit.client.0.smithi016.stderr: -61> 2024-09-12T17:22:49.048+0000 7ff2c48f89c0 20 add_watcher() i=6 2024-09-12T17:22:49.138 INFO:tasks.workunit.client.0.smithi016.stderr: -60> 2024-09-12T17:22:49.048+0000 7ff2c48f89c0 20 add_watcher() i=7 2024-09-12T17:22:49.138 INFO:tasks.workunit.client.0.smithi016.stderr: -59> 2024-09-12T17:22:49.048+0000 7ff2c48f89c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:22:49.138 INFO:tasks.workunit.client.0.smithi016.stderr: -58> 2024-09-12T17:22:49.052+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc85892ab0) adding auth protocol: cephx 2024-09-12T17:22:49.138 INFO:tasks.workunit.client.0.smithi016.stderr: -57> 2024-09-12T17:22:49.052+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc85892ab0) adding auth protocol: cephx 2024-09-12T17:22:49.138 INFO:tasks.workunit.client.0.smithi016.stderr: -56> 2024-09-12T17:22:49.052+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc85892ab0) adding auth protocol: cephx 2024-09-12T17:22:49.138 INFO:tasks.workunit.client.0.smithi016.stderr: -55> 2024-09-12T17:22:49.052+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc85892ab0) adding con mode: secure 2024-09-12T17:22:49.138 INFO:tasks.workunit.client.0.smithi016.stderr: -54> 2024-09-12T17:22:49.052+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc85892ab0) adding con mode: crc 2024-09-12T17:22:49.138 INFO:tasks.workunit.client.0.smithi016.stderr: -53> 2024-09-12T17:22:49.052+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc85892ab0) adding con mode: secure 2024-09-12T17:22:49.139 INFO:tasks.workunit.client.0.smithi016.stderr: -52> 2024-09-12T17:22:49.052+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc85892ab0) adding con mode: crc 2024-09-12T17:22:49.139 INFO:tasks.workunit.client.0.smithi016.stderr: -51> 2024-09-12T17:22:49.052+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc85892ab0) adding con mode: secure 2024-09-12T17:22:49.139 INFO:tasks.workunit.client.0.smithi016.stderr: -50> 2024-09-12T17:22:49.052+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc85892ab0) adding con mode: crc 2024-09-12T17:22:49.139 INFO:tasks.workunit.client.0.smithi016.stderr: -49> 2024-09-12T17:22:49.052+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc85892ab0) adding con mode: crc 2024-09-12T17:22:49.139 INFO:tasks.workunit.client.0.smithi016.stderr: -48> 2024-09-12T17:22:49.052+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc85892ab0) adding con mode: secure 2024-09-12T17:22:49.139 INFO:tasks.workunit.client.0.smithi016.stderr: -47> 2024-09-12T17:22:49.052+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc85892ab0) adding con mode: crc 2024-09-12T17:22:49.139 INFO:tasks.workunit.client.0.smithi016.stderr: -46> 2024-09-12T17:22:49.052+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc85892ab0) adding con mode: secure 2024-09-12T17:22:49.139 INFO:tasks.workunit.client.0.smithi016.stderr: -45> 2024-09-12T17:22:49.052+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc85892ab0) adding con mode: crc 2024-09-12T17:22:49.139 INFO:tasks.workunit.client.0.smithi016.stderr: -44> 2024-09-12T17:22:49.052+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc85892ab0) adding con mode: secure 2024-09-12T17:22:49.139 INFO:tasks.workunit.client.0.smithi016.stderr: -43> 2024-09-12T17:22:49.052+0000 7ff1797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:22:49.139 INFO:tasks.workunit.client.0.smithi016.stderr: -42> 2024-09-12T17:22:49.052+0000 7ff2c48f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:49.139 INFO:tasks.workunit.client.0.smithi016.stderr: -41> 2024-09-12T17:22:49.052+0000 7ff2c48f89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:22:49.139 INFO:tasks.workunit.client.0.smithi016.stderr: -40> 2024-09-12T17:22:49.052+0000 7ff2c48f89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:22:49.140 INFO:tasks.workunit.client.0.smithi016.stderr: -39> 2024-09-12T17:22:49.052+0000 7ff2c48f89c0 5 asok(0x55ea795042b0) register_command cache list hook 0x55ea797d1a00 2024-09-12T17:22:49.140 INFO:tasks.workunit.client.0.smithi016.stderr: -38> 2024-09-12T17:22:49.052+0000 7ff2c48f89c0 5 asok(0x55ea795042b0) register_command cache inspect hook 0x55ea797d1a00 2024-09-12T17:22:49.140 INFO:tasks.workunit.client.0.smithi016.stderr: -37> 2024-09-12T17:22:49.052+0000 7ff2c48f89c0 5 asok(0x55ea795042b0) register_command cache erase hook 0x55ea797d1a00 2024-09-12T17:22:49.140 INFO:tasks.workunit.client.0.smithi016.stderr: -36> 2024-09-12T17:22:49.052+0000 7ff2c48f89c0 5 asok(0x55ea795042b0) register_command cache zap hook 0x55ea797d1a00 2024-09-12T17:22:49.140 INFO:tasks.workunit.client.0.smithi016.stderr: -35> 2024-09-12T17:22:49.056+0000 7ff2c48f89c0 5 note: GC not initialized 2024-09-12T17:22:49.140 INFO:tasks.workunit.client.0.smithi016.stderr: -34> 2024-09-12T17:22:49.056+0000 7ff1737fe640 20 reqs_thread_entry: start 2024-09-12T17:22:49.140 INFO:tasks.workunit.client.0.smithi016.stderr: -33> 2024-09-12T17:22:49.056+0000 7ff2c48f89c0 5 asok(0x55ea795042b0) register_command sync trace show hook 0x7ff2bc0cf070 2024-09-12T17:22:49.140 INFO:tasks.workunit.client.0.smithi016.stderr: -32> 2024-09-12T17:22:49.056+0000 7ff2c48f89c0 5 asok(0x55ea795042b0) register_command sync trace history hook 0x7ff2bc0cf070 2024-09-12T17:22:49.140 INFO:tasks.workunit.client.0.smithi016.stderr: -31> 2024-09-12T17:22:49.056+0000 7ff2c48f89c0 5 asok(0x55ea795042b0) register_command sync trace active hook 0x7ff2bc0cf070 2024-09-12T17:22:49.140 INFO:tasks.workunit.client.0.smithi016.stderr: -30> 2024-09-12T17:22:49.056+0000 7ff2c48f89c0 5 asok(0x55ea795042b0) register_command sync trace active_short hook 0x7ff2bc0cf070 2024-09-12T17:22:49.140 INFO:tasks.workunit.client.0.smithi016.stderr: -29> 2024-09-12T17:22:49.056+0000 7ff2c48f89c0 20 init_complete bucket index max shards: 1 2024-09-12T17:22:49.140 INFO:tasks.workunit.client.0.smithi016.stderr: -28> 2024-09-12T17:22:49.056+0000 7ff2c48f89c0 20 Filter name: none 2024-09-12T17:22:49.141 INFO:tasks.workunit.client.0.smithi016.stderr: -27> 2024-09-12T17:22:49.056+0000 7ff1717fa640 20 reqs_thread_entry: start 2024-09-12T17:22:49.141 INFO:tasks.workunit.client.0.smithi016.stderr: -26> 2024-09-12T17:22:49.056+0000 7ff2c48f89c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:22:49.141 INFO:tasks.workunit.client.0.smithi016.stderr: -25> 2024-09-12T17:22:49.056+0000 7ff2c48f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.141 INFO:tasks.workunit.client.0.smithi016.stderr: -24> 2024-09-12T17:22:49.056+0000 7ff2c48f89c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:22:49.141 INFO:tasks.workunit.client.0.smithi016.stderr: -23> 2024-09-12T17:22:49.056+0000 7ff2c48f89c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:22:49.141 INFO:tasks.workunit.client.0.smithi016.stderr: -22> 2024-09-12T17:22:49.056+0000 7ff2c48f89c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:22:49.141 INFO:tasks.workunit.client.0.smithi016.stderr: -21> 2024-09-12T17:22:49.056+0000 7ff2c48f89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 : miss 2024-09-12T17:22:49.141 INFO:tasks.workunit.client.0.smithi016.stderr: -20> 2024-09-12T17:22:49.056+0000 7ff2c48f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.141 INFO:tasks.workunit.client.0.smithi016.stderr: -19> 2024-09-12T17:22:49.056+0000 7ff2c48f89c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:22:49.141 INFO:tasks.workunit.client.0.smithi016.stderr: -18> 2024-09-12T17:22:49.056+0000 7ff2c48f89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:22:49.141 INFO:tasks.workunit.client.0.smithi016.stderr: -17> 2024-09-12T17:22:49.056+0000 7ff2c48f89c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:22:49.141 INFO:tasks.workunit.client.0.smithi016.stderr: -16> 2024-09-12T17:22:49.056+0000 7ff2c48f89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:22:49.141 INFO:tasks.workunit.client.0.smithi016.stderr: -15> 2024-09-12T17:22:49.056+0000 7ff2c48f89c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:22:49.141 INFO:tasks.workunit.client.0.smithi016.stderr: -14> 2024-09-12T17:22:49.056+0000 7ff2c48f89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 2024-09-12T17:22:49.142 INFO:tasks.workunit.client.0.smithi016.stderr: -13> 2024-09-12T17:22:49.064+0000 7ff2c48f89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:22:49.142 INFO:tasks.workunit.client.0.smithi016.stderr: -12> 2024-09-12T17:22:49.064+0000 7ff2c48f89c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:22:49.142 INFO:tasks.workunit.client.0.smithi016.stderr: -11> 2024-09-12T17:22:49.064+0000 7ff2c48f89c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:22:49.142 INFO:tasks.workunit.client.0.smithi016.stderr: -10> 2024-09-12T17:22:49.064+0000 7ff2c48f89c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17, ofs0, ns] 2024-09-12T17:22:49.142 INFO:tasks.workunit.client.0.smithi016.stderr: -9> 2024-09-12T17:22:49.064+0000 7ff1a5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431629 cookie 94465549197920 notifier 7775 bl.length()=827 2024-09-12T17:22:49.142 INFO:tasks.workunit.client.0.smithi016.stderr: -8> 2024-09-12T17:22:49.064+0000 7ff1a5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:22:49.142 INFO:tasks.workunit.client.0.smithi016.stderr: -7> 2024-09-12T17:22:49.064+0000 7ff1a5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:22:49.142 INFO:tasks.workunit.client.0.smithi016.stderr: -6> 2024-09-12T17:22:49.064+0000 7ff1a5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:22:49.142 INFO:tasks.workunit.client.0.smithi016.stderr: -5> 2024-09-12T17:22:49.064+0000 7ff2c48f89c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): orig_sources= new_sources= 2024-09-12T17:22:49.142 INFO:tasks.workunit.client.0.smithi016.stderr: -4> 2024-09-12T17:22:49.064+0000 7ff2c48f89c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): potential sources added=[] removed=[] 2024-09-12T17:22:49.142 INFO:tasks.workunit.client.0.smithi016.stderr: -3> 2024-09-12T17:22:49.064+0000 7ff2c48f89c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): orig_dests= new_dests= 2024-09-12T17:22:49.142 INFO:tasks.workunit.client.0.smithi016.stderr: -2> 2024-09-12T17:22:49.064+0000 7ff2c48f89c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): potential dests added=[] removed=[] 2024-09-12T17:22:49.142 INFO:tasks.workunit.client.0.smithi016.stderr: -1> 2024-09-12T17:22:49.072+0000 7ff2c48f89c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff2c48f89c0 time 2024-09-12T17:22:49.075758+0000 2024-09-12T17:22:49.143 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:22:49.143 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:49.143 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:22:49.143 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff2c81d22eb] 2024-09-12T17:22:49.143 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff2c81d249f] 2024-09-12T17:22:49.143 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ea770dc0c1] 2024-09-12T17:22:49.143 INFO:tasks.workunit.client.0.smithi016.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ea770ee1fa] 2024-09-12T17:22:49.143 INFO:tasks.workunit.client.0.smithi016.stderr: 5: main() 2024-09-12T17:22:49.143 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff2c7038d90] 2024-09-12T17:22:49.143 INFO:tasks.workunit.client.0.smithi016.stderr: 7: __libc_start_main() 2024-09-12T17:22:49.143 INFO:tasks.workunit.client.0.smithi016.stderr: 8: _start() 2024-09-12T17:22:49.143 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:49.144 INFO:tasks.workunit.client.0.smithi016.stderr: 0> 2024-09-12T17:22:49.072+0000 7ff2c48f89c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:22:49.144 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7ff2c48f89c0 thread_name:radosgw-admin 2024-09-12T17:22:49.144 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:49.144 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:22:49.144 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff2c7051520] 2024-09-12T17:22:49.144 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:22:49.144 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:22:49.144 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:22:49.144 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff2c81d2345] 2024-09-12T17:22:49.144 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff2c81d249f] 2024-09-12T17:22:49.144 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ea770dc0c1] 2024-09-12T17:22:49.144 INFO:tasks.workunit.client.0.smithi016.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ea770ee1fa] 2024-09-12T17:22:49.145 INFO:tasks.workunit.client.0.smithi016.stderr: 9: main() 2024-09-12T17:22:49.145 INFO:tasks.workunit.client.0.smithi016.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff2c7038d90] 2024-09-12T17:22:49.145 INFO:tasks.workunit.client.0.smithi016.stderr: 11: __libc_start_main() 2024-09-12T17:22:49.145 INFO:tasks.workunit.client.0.smithi016.stderr: 12: _start() 2024-09-12T17:22:49.145 INFO:tasks.workunit.client.0.smithi016.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:22:49.145 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:49.145 INFO:tasks.workunit.client.0.smithi016.stderr:--- logging levels --- 2024-09-12T17:22:49.145 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 none 2024-09-12T17:22:49.145 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 lockdep 2024-09-12T17:22:49.145 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 context 2024-09-12T17:22:49.145 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 crush 2024-09-12T17:22:49.145 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds 2024-09-12T17:22:49.146 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_balancer 2024-09-12T17:22:49.146 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_locker 2024-09-12T17:22:49.146 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log 2024-09-12T17:22:49.146 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log_expire 2024-09-12T17:22:49.146 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_migrator 2024-09-12T17:22:49.146 INFO:tasks.workunit.client.0.smithi016.stderr: 3/ 5 mds_quiesce 2024-09-12T17:22:49.146 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 buffer 2024-09-12T17:22:49.146 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 timer 2024-09-12T17:22:49.146 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 filer 2024-09-12T17:22:49.146 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 striper 2024-09-12T17:22:49.146 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 objecter 2024-09-12T17:22:49.146 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rados 2024-09-12T17:22:49.146 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd 2024-09-12T17:22:49.147 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_mirror 2024-09-12T17:22:49.147 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_replay 2024-09-12T17:22:49.147 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_pwl 2024-09-12T17:22:49.147 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 journaler 2024-09-12T17:22:49.147 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objectcacher 2024-09-12T17:22:49.147 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:22:49.147 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 client 2024-09-12T17:22:49.147 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 osd 2024-09-12T17:22:49.147 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 optracker 2024-09-12T17:22:49.147 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objclass 2024-09-12T17:22:49.147 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 filestore 2024-09-12T17:22:49.147 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 journal 2024-09-12T17:22:49.147 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 ms 2024-09-12T17:22:49.147 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mon 2024-09-12T17:22:49.148 INFO:tasks.workunit.client.0.smithi016.stderr: 0/10 monc 2024-09-12T17:22:49.148 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 paxos 2024-09-12T17:22:49.148 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 tp 2024-09-12T17:22:49.148 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 auth 2024-09-12T17:22:49.148 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 crypto 2024-09-12T17:22:49.148 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 finisher 2024-09-12T17:22:49.148 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 reserver 2024-09-12T17:22:49.148 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 heartbeatmap 2024-09-12T17:22:49.148 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 perfcounter 2024-09-12T17:22:49.148 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw 2024-09-12T17:22:49.148 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_sync 2024-09-12T17:22:49.148 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_datacache 2024-09-12T17:22:49.148 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_access 2024-09-12T17:22:49.149 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:22:49.149 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_flight 2024-09-12T17:22:49.149 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:22:49.149 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw_notification 2024-09-12T17:22:49.149 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 javaclient 2024-09-12T17:22:49.149 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 asok 2024-09-12T17:22:49.149 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 throttle 2024-09-12T17:22:49.149 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 refs 2024-09-12T17:22:49.149 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 compressor 2024-09-12T17:22:49.149 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluestore 2024-09-12T17:22:49.149 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluefs 2024-09-12T17:22:49.149 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 bdev 2024-09-12T17:22:49.150 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 kstore 2024-09-12T17:22:49.150 INFO:tasks.workunit.client.0.smithi016.stderr: 4/ 5 rocksdb 2024-09-12T17:22:49.150 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 fuse 2024-09-12T17:22:49.150 INFO:tasks.workunit.client.0.smithi016.stderr: 2/ 5 mgr 2024-09-12T17:22:49.150 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mgrc 2024-09-12T17:22:49.150 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 dpdk 2024-09-12T17:22:49.150 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 eventtrace 2024-09-12T17:22:49.150 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 prioritycache 2024-09-12T17:22:49.150 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 test 2024-09-12T17:22:49.150 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:22:49.150 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephsqlite 2024-09-12T17:22:49.151 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:22:49.151 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore 2024-09-12T17:22:49.151 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_onode 2024-09-12T17:22:49.151 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_odata 2024-09-12T17:22:49.151 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_omap 2024-09-12T17:22:49.151 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_tm 2024-09-12T17:22:49.151 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_t 2024-09-12T17:22:49.151 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:22:49.151 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_epm 2024-09-12T17:22:49.151 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_lba 2024-09-12T17:22:49.151 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:22:49.152 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cache 2024-09-12T17:22:49.152 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_journal 2024-09-12T17:22:49.152 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_device 2024-09-12T17:22:49.152 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_backref 2024-09-12T17:22:49.152 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 alienstore 2024-09-12T17:22:49.152 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mclock 2024-09-12T17:22:49.152 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cyanstore 2024-09-12T17:22:49.152 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 ceph_exporter 2024-09-12T17:22:49.152 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 memstore 2024-09-12T17:22:49.152 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 trace 2024-09-12T17:22:49.152 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 ceph_dedup 2024-09-12T17:22:49.152 INFO:tasks.workunit.client.0.smithi016.stderr: -2/-2 (syslog threshold) 2024-09-12T17:22:49.152 INFO:tasks.workunit.client.0.smithi016.stderr: 99/99 (stderr threshold) 2024-09-12T17:22:49.153 INFO:tasks.workunit.client.0.smithi016.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:22:49.153 INFO:tasks.workunit.client.0.smithi016.stderr: 7ff1717fa640 / http_manager 2024-09-12T17:22:49.153 INFO:tasks.workunit.client.0.smithi016.stderr: 7ff1737fe640 / http_manager 2024-09-12T17:22:49.153 INFO:tasks.workunit.client.0.smithi016.stderr: 7ff1797e2640 / rgw_dt_lg_renew 2024-09-12T17:22:49.153 INFO:tasks.workunit.client.0.smithi016.stderr: 7ff193fff640 / ms_dispatch 2024-09-12T17:22:49.153 INFO:tasks.workunit.client.0.smithi016.stderr: 7ff1a5ffb640 / io_context_pool 2024-09-12T17:22:49.153 INFO:tasks.workunit.client.0.smithi016.stderr: 7ff1a7fff640 / ms_dispatch 2024-09-12T17:22:49.153 INFO:tasks.workunit.client.0.smithi016.stderr: 7ff1aee05640 / ms_dispatch 2024-09-12T17:22:49.153 INFO:tasks.workunit.client.0.smithi016.stderr: 7ff1b0608640 / io_context_pool 2024-09-12T17:22:49.153 INFO:tasks.workunit.client.0.smithi016.stderr: 7ff2c1bfd640 / msgr-worker-2 2024-09-12T17:22:49.153 INFO:tasks.workunit.client.0.smithi016.stderr: 7ff2c23fe640 / msgr-worker-1 2024-09-12T17:22:49.153 INFO:tasks.workunit.client.0.smithi016.stderr: 7ff2c2bff640 / msgr-worker-0 2024-09-12T17:22:49.154 INFO:tasks.workunit.client.0.smithi016.stderr: 7ff2c3400640 / io_context_pool 2024-09-12T17:22:49.154 INFO:tasks.workunit.client.0.smithi016.stderr: 7ff2c48f89c0 / radosgw-admin 2024-09-12T17:22:49.154 INFO:tasks.workunit.client.0.smithi016.stderr: max_recent 500 2024-09-12T17:22:49.154 INFO:tasks.workunit.client.0.smithi016.stderr: max_new 1000 2024-09-12T17:22:49.154 INFO:tasks.workunit.client.0.smithi016.stderr: log_file /var/log/ceph/ceph-client.admin.140980.log 2024-09-12T17:22:49.154 INFO:tasks.workunit.client.0.smithi016.stderr:--- end dump of recent events --- 2024-09-12T17:22:49.154 INFO:tasks.workunit.client.0.smithi016.stderr:--- begin dump of recent events --- 2024-09-12T17:22:49.154 INFO:tasks.workunit.client.0.smithi016.stderr: -499> 2024-09-12T17:22:48.552+0000 7ff2c1bfd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:22:49.154 INFO:tasks.workunit.client.0.smithi016.stderr: -498> 2024-09-12T17:22:48.552+0000 7ff2c1bfd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:22:49.154 INFO:tasks.workunit.client.0.smithi016.stderr: -497> 2024-09-12T17:22:48.552+0000 7ff2c1bfd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:22:49.154 INFO:tasks.workunit.client.0.smithi016.stderr: -496> 2024-09-12T17:22:48.552+0000 7ff2c2bff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:22:49.154 INFO:tasks.workunit.client.0.smithi016.stderr: -495> 2024-09-12T17:22:48.552+0000 7ff2c2bff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:22:49.154 INFO:tasks.workunit.client.0.smithi016.stderr: -494> 2024-09-12T17:22:48.552+0000 7ff2c2bff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:22:49.155 INFO:tasks.workunit.client.0.smithi016.stderr: -493> 2024-09-12T17:22:48.552+0000 7ff2c2bff640 10 monclient(hunting): handle_auth_done global_id 7763 payload 274 2024-09-12T17:22:49.155 INFO:tasks.workunit.client.0.smithi016.stderr: -492> 2024-09-12T17:22:48.552+0000 7ff2c2bff640 10 monclient: _finish_hunting 0 2024-09-12T17:22:49.155 INFO:tasks.workunit.client.0.smithi016.stderr: -491> 2024-09-12T17:22:48.552+0000 7ff2c2bff640 1 monclient: found mon.noname-c 2024-09-12T17:22:49.155 INFO:tasks.workunit.client.0.smithi016.stderr: -490> 2024-09-12T17:22:48.552+0000 7ff2c2bff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:22:49.155 INFO:tasks.workunit.client.0.smithi016.stderr: -489> 2024-09-12T17:22:48.556+0000 7ff1b0608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:22:49.155 INFO:tasks.workunit.client.0.smithi016.stderr: -488> 2024-09-12T17:22:48.556+0000 7ff1b0608640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:22:49.155 INFO:tasks.workunit.client.0.smithi016.stderr: -487> 2024-09-12T17:22:48.556+0000 7ff1b0608640 10 monclient: dump: 2024-09-12T17:22:49.155 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:22:49.155 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:22:49.155 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:49.155 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:49.155 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:22:49.155 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:49.155 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:22:49.156 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:22:49.156 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:22:49.156 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:49.156 INFO:tasks.workunit.client.0.smithi016.stderr: -486> 2024-09-12T17:22:48.556+0000 7ff1b0608640 10 monclient: _finish_auth 0 2024-09-12T17:22:49.156 INFO:tasks.workunit.client.0.smithi016.stderr: -485> 2024-09-12T17:22:48.556+0000 7ff1b0608640 10 monclient: _check_auth_tickets 2024-09-12T17:22:49.156 INFO:tasks.workunit.client.0.smithi016.stderr: -484> 2024-09-12T17:22:48.556+0000 7ff1b0608640 10 monclient: handle_config config(0 keys) 2024-09-12T17:22:49.156 INFO:tasks.workunit.client.0.smithi016.stderr: -483> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 monclient: authenticate success, global_id 7763 2024-09-12T17:22:49.156 INFO:tasks.workunit.client.0.smithi016.stderr: -482> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 10 monclient: get_monmap_and_config success 2024-09-12T17:22:49.156 INFO:tasks.workunit.client.0.smithi016.stderr: -481> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 4 set_mon_vals no callback set 2024-09-12T17:22:49.156 INFO:tasks.workunit.client.0.smithi016.stderr: -480> 2024-09-12T17:22:48.556+0000 7ff1b0608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:22:49.156 INFO:tasks.workunit.client.0.smithi016.stderr: -479> 2024-09-12T17:22:48.556+0000 7ff1b0608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:22:49.156 INFO:tasks.workunit.client.0.smithi016.stderr: -478> 2024-09-12T17:22:48.556+0000 7ff1b0608640 10 monclient: dump: 2024-09-12T17:22:49.157 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:22:49.157 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:22:49.157 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:49.157 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:49.157 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:22:49.157 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:49.157 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:22:49.157 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:22:49.157 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:22:49.157 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:49.157 INFO:tasks.workunit.client.0.smithi016.stderr: -477> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 10 monclient: shutdown 2024-09-12T17:22:49.157 INFO:tasks.workunit.client.0.smithi016.stderr: -476> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 asok(0x55ea795042b0) unregister_commands rotate-key 2024-09-12T17:22:49.158 INFO:tasks.workunit.client.0.smithi016.stderr: -475> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 10 monclient: build_initial_monmap 2024-09-12T17:22:49.158 INFO:tasks.workunit.client.0.smithi016.stderr: -474> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 1 build_initial for_mkfs: 0 2024-09-12T17:22:49.158 INFO:tasks.workunit.client.0.smithi016.stderr: -473> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 10 monclient: monmap: 2024-09-12T17:22:49.158 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:22:49.158 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:22:49.158 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:22:49.158 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:22:49.158 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:22:49.158 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:49.158 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:22:49.158 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:22:49.158 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:22:49.158 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:49.158 INFO:tasks.workunit.client.0.smithi016.stderr: -472> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79712e70) adding auth protocol: cephx 2024-09-12T17:22:49.159 INFO:tasks.workunit.client.0.smithi016.stderr: -471> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79712e70) adding auth protocol: cephx 2024-09-12T17:22:49.159 INFO:tasks.workunit.client.0.smithi016.stderr: -470> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79712e70) adding auth protocol: cephx 2024-09-12T17:22:49.159 INFO:tasks.workunit.client.0.smithi016.stderr: -469> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79712e70) adding con mode: secure 2024-09-12T17:22:49.159 INFO:tasks.workunit.client.0.smithi016.stderr: -468> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79712e70) adding con mode: crc 2024-09-12T17:22:49.159 INFO:tasks.workunit.client.0.smithi016.stderr: -467> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79712e70) adding con mode: secure 2024-09-12T17:22:49.159 INFO:tasks.workunit.client.0.smithi016.stderr: -466> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79712e70) adding con mode: crc 2024-09-12T17:22:49.159 INFO:tasks.workunit.client.0.smithi016.stderr: -465> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79712e70) adding con mode: secure 2024-09-12T17:22:49.159 INFO:tasks.workunit.client.0.smithi016.stderr: -464> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79712e70) adding con mode: crc 2024-09-12T17:22:49.159 INFO:tasks.workunit.client.0.smithi016.stderr: -463> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79712e70) adding con mode: crc 2024-09-12T17:22:49.159 INFO:tasks.workunit.client.0.smithi016.stderr: -462> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79712e70) adding con mode: secure 2024-09-12T17:22:49.159 INFO:tasks.workunit.client.0.smithi016.stderr: -461> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79712e70) adding con mode: crc 2024-09-12T17:22:49.159 INFO:tasks.workunit.client.0.smithi016.stderr: -460> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79712e70) adding con mode: secure 2024-09-12T17:22:49.159 INFO:tasks.workunit.client.0.smithi016.stderr: -459> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79712e70) adding con mode: crc 2024-09-12T17:22:49.159 INFO:tasks.workunit.client.0.smithi016.stderr: -458> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79712e70) adding con mode: secure 2024-09-12T17:22:49.160 INFO:tasks.workunit.client.0.smithi016.stderr: -457> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:49.160 INFO:tasks.workunit.client.0.smithi016.stderr: -456> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 1 librados: starting msgr at 2024-09-12T17:22:49.160 INFO:tasks.workunit.client.0.smithi016.stderr: -455> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 1 librados: starting objecter 2024-09-12T17:22:49.160 INFO:tasks.workunit.client.0.smithi016.stderr: -454> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 asok(0x55ea795042b0) register_command objecter_requests hook 0x55ea795348c0 2024-09-12T17:22:49.160 INFO:tasks.workunit.client.0.smithi016.stderr: -453> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 1 librados: setting wanted keys 2024-09-12T17:22:49.160 INFO:tasks.workunit.client.0.smithi016.stderr: -452> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 1 librados: calling monclient init 2024-09-12T17:22:49.160 INFO:tasks.workunit.client.0.smithi016.stderr: -451> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 10 monclient: init 2024-09-12T17:22:49.160 INFO:tasks.workunit.client.0.smithi016.stderr: -450> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7970d970) adding auth protocol: cephx 2024-09-12T17:22:49.160 INFO:tasks.workunit.client.0.smithi016.stderr: -449> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7970d970) adding auth protocol: cephx 2024-09-12T17:22:49.160 INFO:tasks.workunit.client.0.smithi016.stderr: -448> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7970d970) adding auth protocol: cephx 2024-09-12T17:22:49.160 INFO:tasks.workunit.client.0.smithi016.stderr: -447> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7970d970) adding con mode: secure 2024-09-12T17:22:49.160 INFO:tasks.workunit.client.0.smithi016.stderr: -446> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7970d970) adding con mode: crc 2024-09-12T17:22:49.160 INFO:tasks.workunit.client.0.smithi016.stderr: -445> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7970d970) adding con mode: secure 2024-09-12T17:22:49.161 INFO:tasks.workunit.client.0.smithi016.stderr: -444> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7970d970) adding con mode: crc 2024-09-12T17:22:49.161 INFO:tasks.workunit.client.0.smithi016.stderr: -443> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7970d970) adding con mode: secure 2024-09-12T17:22:49.161 INFO:tasks.workunit.client.0.smithi016.stderr: -442> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7970d970) adding con mode: crc 2024-09-12T17:22:49.161 INFO:tasks.workunit.client.0.smithi016.stderr: -441> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7970d970) adding con mode: crc 2024-09-12T17:22:49.161 INFO:tasks.workunit.client.0.smithi016.stderr: -440> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7970d970) adding con mode: secure 2024-09-12T17:22:49.161 INFO:tasks.workunit.client.0.smithi016.stderr: -439> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7970d970) adding con mode: crc 2024-09-12T17:22:49.161 INFO:tasks.workunit.client.0.smithi016.stderr: -438> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7970d970) adding con mode: secure 2024-09-12T17:22:49.161 INFO:tasks.workunit.client.0.smithi016.stderr: -437> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7970d970) adding con mode: crc 2024-09-12T17:22:49.161 INFO:tasks.workunit.client.0.smithi016.stderr: -436> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7970d970) adding con mode: secure 2024-09-12T17:22:49.161 INFO:tasks.workunit.client.0.smithi016.stderr: -435> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:49.161 INFO:tasks.workunit.client.0.smithi016.stderr: -434> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:49.161 INFO:tasks.workunit.client.0.smithi016.stderr: -433> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 asok(0x55ea795042b0) register_command rotate-key hook 0x55ea7970dab8 2024-09-12T17:22:49.162 INFO:tasks.workunit.client.0.smithi016.stderr: -432> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 10 monclient: _reopen_session rank -1 2024-09-12T17:22:49.162 INFO:tasks.workunit.client.0.smithi016.stderr: -431> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:22:49.162 INFO:tasks.workunit.client.0.smithi016.stderr: -430> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 10 monclient(hunting): picked mon.noname-a con 0x55ea795bd990 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:22:49.162 INFO:tasks.workunit.client.0.smithi016.stderr: -429> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 10 monclient(hunting): picked mon.noname-c con 0x55ea79656490 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:22:49.162 INFO:tasks.workunit.client.0.smithi016.stderr: -428> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 10 monclient(hunting): picked mon.noname-b con 0x55ea7973c3f0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:22:49.162 INFO:tasks.workunit.client.0.smithi016.stderr: -427> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:49.162 INFO:tasks.workunit.client.0.smithi016.stderr: -426> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:49.162 INFO:tasks.workunit.client.0.smithi016.stderr: -425> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:49.162 INFO:tasks.workunit.client.0.smithi016.stderr: -424> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 10 monclient(hunting): _renew_subs 2024-09-12T17:22:49.162 INFO:tasks.workunit.client.0.smithi016.stderr: -423> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 10 monclient(hunting): authenticate will time out at 2486.534338s 2024-09-12T17:22:49.162 INFO:tasks.workunit.client.0.smithi016.stderr: -422> 2024-09-12T17:22:48.556+0000 7ff2c23fe640 10 monclient(hunting): get_auth_request con 0x55ea795bd990 auth_method 0 2024-09-12T17:22:49.162 INFO:tasks.workunit.client.0.smithi016.stderr: -421> 2024-09-12T17:22:48.556+0000 7ff2c23fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:22:49.162 INFO:tasks.workunit.client.0.smithi016.stderr: -420> 2024-09-12T17:22:48.556+0000 7ff2c23fe640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:22:49.163 INFO:tasks.workunit.client.0.smithi016.stderr: -419> 2024-09-12T17:22:48.556+0000 7ff2c23fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:22:49.163 INFO:tasks.workunit.client.0.smithi016.stderr: -418> 2024-09-12T17:22:48.556+0000 7ff2c1bfd640 10 monclient(hunting): get_auth_request con 0x55ea79656490 auth_method 0 2024-09-12T17:22:49.163 INFO:tasks.workunit.client.0.smithi016.stderr: -417> 2024-09-12T17:22:48.556+0000 7ff2c1bfd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:22:49.163 INFO:tasks.workunit.client.0.smithi016.stderr: -416> 2024-09-12T17:22:48.556+0000 7ff2c1bfd640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:22:49.163 INFO:tasks.workunit.client.0.smithi016.stderr: -415> 2024-09-12T17:22:48.556+0000 7ff2c1bfd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:22:49.163 INFO:tasks.workunit.client.0.smithi016.stderr: -414> 2024-09-12T17:22:48.556+0000 7ff2c23fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:22:49.163 INFO:tasks.workunit.client.0.smithi016.stderr: -413> 2024-09-12T17:22:48.556+0000 7ff2c23fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:22:49.163 INFO:tasks.workunit.client.0.smithi016.stderr: -412> 2024-09-12T17:22:48.556+0000 7ff2c23fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:22:49.163 INFO:tasks.workunit.client.0.smithi016.stderr: -411> 2024-09-12T17:22:48.556+0000 7ff2c1bfd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:22:49.163 INFO:tasks.workunit.client.0.smithi016.stderr: -410> 2024-09-12T17:22:48.556+0000 7ff2c1bfd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:22:49.163 INFO:tasks.workunit.client.0.smithi016.stderr: -409> 2024-09-12T17:22:48.556+0000 7ff2c1bfd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:22:49.163 INFO:tasks.workunit.client.0.smithi016.stderr: -408> 2024-09-12T17:22:48.556+0000 7ff2c23fe640 10 monclient(hunting): handle_auth_done global_id 8178 payload 824 2024-09-12T17:22:49.163 INFO:tasks.workunit.client.0.smithi016.stderr: -407> 2024-09-12T17:22:48.556+0000 7ff2c23fe640 10 monclient: _finish_hunting 0 2024-09-12T17:22:49.164 INFO:tasks.workunit.client.0.smithi016.stderr: -406> 2024-09-12T17:22:48.556+0000 7ff2c23fe640 1 monclient: found mon.noname-a 2024-09-12T17:22:49.164 INFO:tasks.workunit.client.0.smithi016.stderr: -405> 2024-09-12T17:22:48.556+0000 7ff2c23fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:22:49.164 INFO:tasks.workunit.client.0.smithi016.stderr: -404> 2024-09-12T17:22:48.556+0000 7ff2c2bff640 10 monclient: get_auth_request con 0x55ea7973c3f0 auth_method 0 2024-09-12T17:22:49.164 INFO:tasks.workunit.client.0.smithi016.stderr: -403> 2024-09-12T17:22:48.556+0000 7ff1aee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:22:49.164 INFO:tasks.workunit.client.0.smithi016.stderr: -402> 2024-09-12T17:22:48.556+0000 7ff1aee05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:22:49.164 INFO:tasks.workunit.client.0.smithi016.stderr: -401> 2024-09-12T17:22:48.556+0000 7ff1aee05640 10 monclient: dump: 2024-09-12T17:22:49.164 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:22:49.164 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:22:49.164 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:49.164 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:49.164 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:22:49.164 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:49.165 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:22:49.165 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:22:49.165 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:22:49.165 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:49.165 INFO:tasks.workunit.client.0.smithi016.stderr: -400> 2024-09-12T17:22:48.556+0000 7ff1aee05640 10 monclient: _finish_auth 0 2024-09-12T17:22:49.165 INFO:tasks.workunit.client.0.smithi016.stderr: -399> 2024-09-12T17:22:48.556+0000 7ff1aee05640 10 monclient: _check_auth_tickets 2024-09-12T17:22:49.165 INFO:tasks.workunit.client.0.smithi016.stderr: -398> 2024-09-12T17:22:48.556+0000 7ff1aee05640 10 monclient: handle_config config(0 keys) 2024-09-12T17:22:49.165 INFO:tasks.workunit.client.0.smithi016.stderr: -397> 2024-09-12T17:22:48.556+0000 7ff1aee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:22:49.165 INFO:tasks.workunit.client.0.smithi016.stderr: -396> 2024-09-12T17:22:48.556+0000 7ff1aee05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:22:49.165 INFO:tasks.workunit.client.0.smithi016.stderr: -395> 2024-09-12T17:22:48.556+0000 7ff1aee05640 10 monclient: dump: 2024-09-12T17:22:49.165 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:22:49.165 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:22:49.165 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:49.166 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:49.166 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:22:49.166 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:49.166 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:22:49.166 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:22:49.166 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:22:49.166 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:49.166 INFO:tasks.workunit.client.0.smithi016.stderr: -394> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 5 monclient: authenticate success, global_id 8178 2024-09-12T17:22:49.166 INFO:tasks.workunit.client.0.smithi016.stderr: -393> 2024-09-12T17:22:48.556+0000 7ff1b0608640 4 set_mon_vals no callback set 2024-09-12T17:22:49.166 INFO:tasks.workunit.client.0.smithi016.stderr: -392> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 10 monclient: _renew_subs 2024-09-12T17:22:49.166 INFO:tasks.workunit.client.0.smithi016.stderr: -391> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:22:49.166 INFO:tasks.workunit.client.0.smithi016.stderr: -390> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 10 monclient: _renew_subs 2024-09-12T17:22:49.166 INFO:tasks.workunit.client.0.smithi016.stderr: -389> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:22:49.166 INFO:tasks.workunit.client.0.smithi016.stderr: -388> 2024-09-12T17:22:48.556+0000 7ff2c48f89c0 1 librados: init done 2024-09-12T17:22:49.167 INFO:tasks.workunit.client.0.smithi016.stderr: -387> 2024-09-12T17:22:48.560+0000 7ff1aee05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:22:49.167 INFO:tasks.workunit.client.0.smithi016.stderr: -386> 2024-09-12T17:22:48.560+0000 7ff1aee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:22:49.167 INFO:tasks.workunit.client.0.smithi016.stderr: -385> 2024-09-12T17:22:48.560+0000 7ff1aee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:22:49.167 INFO:tasks.workunit.client.0.smithi016.stderr: -384> 2024-09-12T17:22:48.560+0000 7ff2c1bfd640 10 monclient: get_auth_request con 0x7ff1a8070b10 auth_method 0 2024-09-12T17:22:49.167 INFO:tasks.workunit.client.0.smithi016.stderr: -383> 2024-09-12T17:22:48.560+0000 7ff2c2bff640 10 monclient: get_auth_request con 0x55ea79735690 auth_method 0 2024-09-12T17:22:49.167 INFO:tasks.workunit.client.0.smithi016.stderr: -382> 2024-09-12T17:22:48.560+0000 7ff2c23fe640 10 monclient: get_auth_request con 0x55ea797586b0 auth_method 0 2024-09-12T17:22:49.167 INFO:tasks.workunit.client.0.smithi016.stderr: -381> 2024-09-12T17:22:48.564+0000 7ff2c1bfd640 10 monclient: get_auth_request con 0x55ea7975cb60 auth_method 0 2024-09-12T17:22:49.167 INFO:tasks.workunit.client.0.smithi016.stderr: -380> 2024-09-12T17:22:48.564+0000 7ff2c2bff640 10 monclient: get_auth_request con 0x55ea7975bfc0 auth_method 0 2024-09-12T17:22:49.167 INFO:tasks.workunit.client.0.smithi016.stderr: -379> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 10 monclient: build_initial_monmap 2024-09-12T17:22:49.167 INFO:tasks.workunit.client.0.smithi016.stderr: -378> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 1 build_initial for_mkfs: 0 2024-09-12T17:22:49.167 INFO:tasks.workunit.client.0.smithi016.stderr: -377> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 10 monclient: monmap: 2024-09-12T17:22:49.167 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:22:49.167 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:22:49.167 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:22:49.168 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:22:49.168 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:22:49.168 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:49.168 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:22:49.168 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:22:49.168 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:22:49.168 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:49.168 INFO:tasks.workunit.client.0.smithi016.stderr: -376> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79764d00) adding auth protocol: cephx 2024-09-12T17:22:49.168 INFO:tasks.workunit.client.0.smithi016.stderr: -375> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79764d00) adding auth protocol: cephx 2024-09-12T17:22:49.168 INFO:tasks.workunit.client.0.smithi016.stderr: -374> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79764d00) adding auth protocol: cephx 2024-09-12T17:22:49.168 INFO:tasks.workunit.client.0.smithi016.stderr: -373> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79764d00) adding con mode: secure 2024-09-12T17:22:49.168 INFO:tasks.workunit.client.0.smithi016.stderr: -372> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79764d00) adding con mode: crc 2024-09-12T17:22:49.168 INFO:tasks.workunit.client.0.smithi016.stderr: -371> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79764d00) adding con mode: secure 2024-09-12T17:22:49.169 INFO:tasks.workunit.client.0.smithi016.stderr: -370> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79764d00) adding con mode: crc 2024-09-12T17:22:49.169 INFO:tasks.workunit.client.0.smithi016.stderr: -369> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79764d00) adding con mode: secure 2024-09-12T17:22:49.169 INFO:tasks.workunit.client.0.smithi016.stderr: -368> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79764d00) adding con mode: crc 2024-09-12T17:22:49.169 INFO:tasks.workunit.client.0.smithi016.stderr: -367> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79764d00) adding con mode: crc 2024-09-12T17:22:49.169 INFO:tasks.workunit.client.0.smithi016.stderr: -366> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79764d00) adding con mode: secure 2024-09-12T17:22:49.169 INFO:tasks.workunit.client.0.smithi016.stderr: -365> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79764d00) adding con mode: crc 2024-09-12T17:22:49.169 INFO:tasks.workunit.client.0.smithi016.stderr: -364> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79764d00) adding con mode: secure 2024-09-12T17:22:49.169 INFO:tasks.workunit.client.0.smithi016.stderr: -363> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79764d00) adding con mode: crc 2024-09-12T17:22:49.169 INFO:tasks.workunit.client.0.smithi016.stderr: -362> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79764d00) adding con mode: secure 2024-09-12T17:22:49.169 INFO:tasks.workunit.client.0.smithi016.stderr: -361> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:49.169 INFO:tasks.workunit.client.0.smithi016.stderr: -360> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 asok(0x55ea795042b0) register_command objecter_requests cmddesc objecter_requests hook 0x55ea797686b0 EEXIST 2024-09-12T17:22:49.169 INFO:tasks.workunit.client.0.smithi016.stderr: -359> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 10 monclient: init 2024-09-12T17:22:49.169 INFO:tasks.workunit.client.0.smithi016.stderr: -358> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79763c48) adding auth protocol: cephx 2024-09-12T17:22:49.170 INFO:tasks.workunit.client.0.smithi016.stderr: -357> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79763c48) adding auth protocol: cephx 2024-09-12T17:22:49.170 INFO:tasks.workunit.client.0.smithi016.stderr: -356> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79763c48) adding auth protocol: cephx 2024-09-12T17:22:49.170 INFO:tasks.workunit.client.0.smithi016.stderr: -355> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79763c48) adding con mode: secure 2024-09-12T17:22:49.170 INFO:tasks.workunit.client.0.smithi016.stderr: -354> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79763c48) adding con mode: crc 2024-09-12T17:22:49.170 INFO:tasks.workunit.client.0.smithi016.stderr: -353> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79763c48) adding con mode: secure 2024-09-12T17:22:49.170 INFO:tasks.workunit.client.0.smithi016.stderr: -352> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79763c48) adding con mode: crc 2024-09-12T17:22:49.170 INFO:tasks.workunit.client.0.smithi016.stderr: -351> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79763c48) adding con mode: secure 2024-09-12T17:22:49.170 INFO:tasks.workunit.client.0.smithi016.stderr: -350> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79763c48) adding con mode: crc 2024-09-12T17:22:49.170 INFO:tasks.workunit.client.0.smithi016.stderr: -349> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79763c48) adding con mode: crc 2024-09-12T17:22:49.170 INFO:tasks.workunit.client.0.smithi016.stderr: -348> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79763c48) adding con mode: secure 2024-09-12T17:22:49.170 INFO:tasks.workunit.client.0.smithi016.stderr: -347> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79763c48) adding con mode: crc 2024-09-12T17:22:49.170 INFO:tasks.workunit.client.0.smithi016.stderr: -346> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79763c48) adding con mode: secure 2024-09-12T17:22:49.170 INFO:tasks.workunit.client.0.smithi016.stderr: -345> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79763c48) adding con mode: crc 2024-09-12T17:22:49.171 INFO:tasks.workunit.client.0.smithi016.stderr: -344> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea79763c48) adding con mode: secure 2024-09-12T17:22:49.171 INFO:tasks.workunit.client.0.smithi016.stderr: -343> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:49.171 INFO:tasks.workunit.client.0.smithi016.stderr: -342> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:49.171 INFO:tasks.workunit.client.0.smithi016.stderr: -341> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 asok(0x55ea795042b0) register_command rotate-key cmddesc rotate-key hook 0x55ea79763d90 EEXIST 2024-09-12T17:22:49.171 INFO:tasks.workunit.client.0.smithi016.stderr: -340> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 10 monclient: _reopen_session rank -1 2024-09-12T17:22:49.171 INFO:tasks.workunit.client.0.smithi016.stderr: -339> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:22:49.171 INFO:tasks.workunit.client.0.smithi016.stderr: -338> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 10 monclient(hunting): picked mon.noname-b con 0x55ea7978c860 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:22:49.171 INFO:tasks.workunit.client.0.smithi016.stderr: -337> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 10 monclient(hunting): picked mon.noname-c con 0x55ea7978c190 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:22:49.171 INFO:tasks.workunit.client.0.smithi016.stderr: -336> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 10 monclient(hunting): picked mon.noname-a con 0x55ea7978ab70 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:22:49.171 INFO:tasks.workunit.client.0.smithi016.stderr: -335> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:49.171 INFO:tasks.workunit.client.0.smithi016.stderr: -334> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:49.171 INFO:tasks.workunit.client.0.smithi016.stderr: -333> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:49.172 INFO:tasks.workunit.client.0.smithi016.stderr: -332> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 10 monclient(hunting): _renew_subs 2024-09-12T17:22:49.172 INFO:tasks.workunit.client.0.smithi016.stderr: -331> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 10 monclient(hunting): authenticate will time out at 2486.545624s 2024-09-12T17:22:49.172 INFO:tasks.workunit.client.0.smithi016.stderr: -330> 2024-09-12T17:22:48.568+0000 7ff2c23fe640 10 monclient(hunting): get_auth_request con 0x55ea7978ab70 auth_method 0 2024-09-12T17:22:49.172 INFO:tasks.workunit.client.0.smithi016.stderr: -329> 2024-09-12T17:22:48.568+0000 7ff2c23fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:22:49.172 INFO:tasks.workunit.client.0.smithi016.stderr: -328> 2024-09-12T17:22:48.568+0000 7ff2c23fe640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:22:49.172 INFO:tasks.workunit.client.0.smithi016.stderr: -327> 2024-09-12T17:22:48.568+0000 7ff2c23fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:22:49.172 INFO:tasks.workunit.client.0.smithi016.stderr: -326> 2024-09-12T17:22:48.568+0000 7ff2c2bff640 10 monclient(hunting): get_auth_request con 0x55ea7978c190 auth_method 0 2024-09-12T17:22:49.172 INFO:tasks.workunit.client.0.smithi016.stderr: -325> 2024-09-12T17:22:48.568+0000 7ff2c2bff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:22:49.172 INFO:tasks.workunit.client.0.smithi016.stderr: -324> 2024-09-12T17:22:48.568+0000 7ff2c2bff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:22:49.172 INFO:tasks.workunit.client.0.smithi016.stderr: -323> 2024-09-12T17:22:48.568+0000 7ff2c2bff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:22:49.172 INFO:tasks.workunit.client.0.smithi016.stderr: -322> 2024-09-12T17:22:48.568+0000 7ff2c23fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:22:49.173 INFO:tasks.workunit.client.0.smithi016.stderr: -321> 2024-09-12T17:22:48.568+0000 7ff2c23fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:22:49.173 INFO:tasks.workunit.client.0.smithi016.stderr: -320> 2024-09-12T17:22:48.568+0000 7ff2c23fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:22:49.173 INFO:tasks.workunit.client.0.smithi016.stderr: -319> 2024-09-12T17:22:48.568+0000 7ff2c2bff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:22:49.173 INFO:tasks.workunit.client.0.smithi016.stderr: -318> 2024-09-12T17:22:48.568+0000 7ff2c2bff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:22:49.173 INFO:tasks.workunit.client.0.smithi016.stderr: -317> 2024-09-12T17:22:48.568+0000 7ff2c2bff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:22:49.173 INFO:tasks.workunit.client.0.smithi016.stderr: -316> 2024-09-12T17:22:48.568+0000 7ff2c1bfd640 10 monclient(hunting): get_auth_request con 0x55ea7978c860 auth_method 0 2024-09-12T17:22:49.173 INFO:tasks.workunit.client.0.smithi016.stderr: -315> 2024-09-12T17:22:48.568+0000 7ff2c1bfd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:22:49.173 INFO:tasks.workunit.client.0.smithi016.stderr: -314> 2024-09-12T17:22:48.568+0000 7ff2c1bfd640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:22:49.173 INFO:tasks.workunit.client.0.smithi016.stderr: -313> 2024-09-12T17:22:48.568+0000 7ff2c1bfd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:22:49.173 INFO:tasks.workunit.client.0.smithi016.stderr: -312> 2024-09-12T17:22:48.568+0000 7ff2c2bff640 10 monclient(hunting): handle_auth_done global_id 7769 payload 824 2024-09-12T17:22:49.174 INFO:tasks.workunit.client.0.smithi016.stderr: -311> 2024-09-12T17:22:48.568+0000 7ff2c2bff640 10 monclient: _finish_hunting 0 2024-09-12T17:22:49.174 INFO:tasks.workunit.client.0.smithi016.stderr: -310> 2024-09-12T17:22:48.568+0000 7ff2c2bff640 1 monclient: found mon.noname-c 2024-09-12T17:22:49.174 INFO:tasks.workunit.client.0.smithi016.stderr: -309> 2024-09-12T17:22:48.568+0000 7ff2c2bff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:22:49.174 INFO:tasks.workunit.client.0.smithi016.stderr: -308> 2024-09-12T17:22:48.568+0000 7ff1a7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:22:49.174 INFO:tasks.workunit.client.0.smithi016.stderr: -307> 2024-09-12T17:22:48.568+0000 7ff1a7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:22:49.174 INFO:tasks.workunit.client.0.smithi016.stderr: -306> 2024-09-12T17:22:48.568+0000 7ff1a7fff640 10 monclient: dump: 2024-09-12T17:22:49.174 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:22:49.174 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:22:49.174 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:49.174 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:49.174 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:22:49.174 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:49.174 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:22:49.175 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:22:49.175 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:22:49.175 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:49.175 INFO:tasks.workunit.client.0.smithi016.stderr: -305> 2024-09-12T17:22:48.568+0000 7ff1a7fff640 10 monclient: _finish_auth 0 2024-09-12T17:22:49.175 INFO:tasks.workunit.client.0.smithi016.stderr: -304> 2024-09-12T17:22:48.568+0000 7ff1a7fff640 10 monclient: _check_auth_tickets 2024-09-12T17:22:49.175 INFO:tasks.workunit.client.0.smithi016.stderr: -303> 2024-09-12T17:22:48.568+0000 7ff1a7fff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:22:49.175 INFO:tasks.workunit.client.0.smithi016.stderr: -302> 2024-09-12T17:22:48.568+0000 7ff1a7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:22:49.175 INFO:tasks.workunit.client.0.smithi016.stderr: -301> 2024-09-12T17:22:48.568+0000 7ff1a7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:22:49.175 INFO:tasks.workunit.client.0.smithi016.stderr: -300> 2024-09-12T17:22:48.568+0000 7ff1a7fff640 10 monclient: dump: 2024-09-12T17:22:49.175 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:22:49.175 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:22:49.175 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:49.175 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:49.175 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:22:49.176 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:49.176 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:22:49.176 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:22:49.176 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:22:49.176 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:49.176 INFO:tasks.workunit.client.0.smithi016.stderr: -299> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 5 monclient: authenticate success, global_id 7769 2024-09-12T17:22:49.176 INFO:tasks.workunit.client.0.smithi016.stderr: -298> 2024-09-12T17:22:48.568+0000 7ff2c3400640 4 set_mon_vals no callback set 2024-09-12T17:22:49.176 INFO:tasks.workunit.client.0.smithi016.stderr: -297> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 10 monclient: _renew_subs 2024-09-12T17:22:49.176 INFO:tasks.workunit.client.0.smithi016.stderr: -296> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:22:49.176 INFO:tasks.workunit.client.0.smithi016.stderr: -295> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 10 monclient: _renew_subs 2024-09-12T17:22:49.176 INFO:tasks.workunit.client.0.smithi016.stderr: -294> 2024-09-12T17:22:48.568+0000 7ff2c48f89c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:22:49.176 INFO:tasks.workunit.client.0.smithi016.stderr: -293> 2024-09-12T17:22:48.572+0000 7ff1a7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:22:49.176 INFO:tasks.workunit.client.0.smithi016.stderr: -292> 2024-09-12T17:22:48.572+0000 7ff1a7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:22:49.177 INFO:tasks.workunit.client.0.smithi016.stderr: -291> 2024-09-12T17:22:48.572+0000 7ff1a7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:22:49.177 INFO:tasks.workunit.client.0.smithi016.stderr: -290> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 10 monclient: get_monmap_and_config 2024-09-12T17:22:49.177 INFO:tasks.workunit.client.0.smithi016.stderr: -289> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 10 monclient: build_initial_monmap 2024-09-12T17:22:49.177 INFO:tasks.workunit.client.0.smithi016.stderr: -288> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 1 build_initial for_mkfs: 0 2024-09-12T17:22:49.177 INFO:tasks.workunit.client.0.smithi016.stderr: -287> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 10 monclient: monmap: 2024-09-12T17:22:49.177 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:22:49.177 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:22:49.177 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:22:49.177 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:22:49.177 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:22:49.177 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:49.177 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:22:49.178 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:22:49.178 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:22:49.178 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:49.178 INFO:tasks.workunit.client.0.smithi016.stderr: -286> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf90) adding auth protocol: cephx 2024-09-12T17:22:49.178 INFO:tasks.workunit.client.0.smithi016.stderr: -285> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf90) adding auth protocol: cephx 2024-09-12T17:22:49.178 INFO:tasks.workunit.client.0.smithi016.stderr: -284> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf90) adding auth protocol: cephx 2024-09-12T17:22:49.178 INFO:tasks.workunit.client.0.smithi016.stderr: -283> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf90) adding con mode: secure 2024-09-12T17:22:49.178 INFO:tasks.workunit.client.0.smithi016.stderr: -282> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf90) adding con mode: crc 2024-09-12T17:22:49.178 INFO:tasks.workunit.client.0.smithi016.stderr: -281> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf90) adding con mode: secure 2024-09-12T17:22:49.178 INFO:tasks.workunit.client.0.smithi016.stderr: -280> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf90) adding con mode: crc 2024-09-12T17:22:49.178 INFO:tasks.workunit.client.0.smithi016.stderr: -279> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf90) adding con mode: secure 2024-09-12T17:22:49.178 INFO:tasks.workunit.client.0.smithi016.stderr: -278> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf90) adding con mode: crc 2024-09-12T17:22:49.178 INFO:tasks.workunit.client.0.smithi016.stderr: -277> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf90) adding con mode: crc 2024-09-12T17:22:49.179 INFO:tasks.workunit.client.0.smithi016.stderr: -276> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf90) adding con mode: secure 2024-09-12T17:22:49.179 INFO:tasks.workunit.client.0.smithi016.stderr: -275> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf90) adding con mode: crc 2024-09-12T17:22:49.179 INFO:tasks.workunit.client.0.smithi016.stderr: -274> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf90) adding con mode: secure 2024-09-12T17:22:49.179 INFO:tasks.workunit.client.0.smithi016.stderr: -273> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf90) adding con mode: crc 2024-09-12T17:22:49.179 INFO:tasks.workunit.client.0.smithi016.stderr: -272> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf90) adding con mode: secure 2024-09-12T17:22:49.179 INFO:tasks.workunit.client.0.smithi016.stderr: -271> 2024-09-12T17:22:48.572+0000 7ff2c1bfd640 10 monclient: get_auth_request con 0x7ff19c070a20 auth_method 0 2024-09-12T17:22:49.179 INFO:tasks.workunit.client.0.smithi016.stderr: -270> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:49.179 INFO:tasks.workunit.client.0.smithi016.stderr: -269> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 10 monclient: init 2024-09-12T17:22:49.179 INFO:tasks.workunit.client.0.smithi016.stderr: -268> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc858925e0) adding auth protocol: cephx 2024-09-12T17:22:49.179 INFO:tasks.workunit.client.0.smithi016.stderr: -267> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc858925e0) adding auth protocol: cephx 2024-09-12T17:22:49.179 INFO:tasks.workunit.client.0.smithi016.stderr: -266> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc858925e0) adding auth protocol: cephx 2024-09-12T17:22:49.179 INFO:tasks.workunit.client.0.smithi016.stderr: -265> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc858925e0) adding con mode: secure 2024-09-12T17:22:49.180 INFO:tasks.workunit.client.0.smithi016.stderr: -264> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc858925e0) adding con mode: crc 2024-09-12T17:22:49.180 INFO:tasks.workunit.client.0.smithi016.stderr: -263> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc858925e0) adding con mode: secure 2024-09-12T17:22:49.180 INFO:tasks.workunit.client.0.smithi016.stderr: -262> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc858925e0) adding con mode: crc 2024-09-12T17:22:49.180 INFO:tasks.workunit.client.0.smithi016.stderr: -261> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc858925e0) adding con mode: secure 2024-09-12T17:22:49.180 INFO:tasks.workunit.client.0.smithi016.stderr: -260> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc858925e0) adding con mode: crc 2024-09-12T17:22:49.180 INFO:tasks.workunit.client.0.smithi016.stderr: -259> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc858925e0) adding con mode: crc 2024-09-12T17:22:49.180 INFO:tasks.workunit.client.0.smithi016.stderr: -258> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc858925e0) adding con mode: secure 2024-09-12T17:22:49.180 INFO:tasks.workunit.client.0.smithi016.stderr: -257> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc858925e0) adding con mode: crc 2024-09-12T17:22:49.180 INFO:tasks.workunit.client.0.smithi016.stderr: -256> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc858925e0) adding con mode: secure 2024-09-12T17:22:49.180 INFO:tasks.workunit.client.0.smithi016.stderr: -255> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc858925e0) adding con mode: crc 2024-09-12T17:22:49.180 INFO:tasks.workunit.client.0.smithi016.stderr: -254> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc858925e0) adding con mode: secure 2024-09-12T17:22:49.180 INFO:tasks.workunit.client.0.smithi016.stderr: -253> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:49.180 INFO:tasks.workunit.client.0.smithi016.stderr: -252> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:49.181 INFO:tasks.workunit.client.0.smithi016.stderr: -251> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 asok(0x55ea795042b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc85892728 EEXIST 2024-09-12T17:22:49.181 INFO:tasks.workunit.client.0.smithi016.stderr: -250> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 10 monclient: _reopen_session rank -1 2024-09-12T17:22:49.181 INFO:tasks.workunit.client.0.smithi016.stderr: -249> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:22:49.181 INFO:tasks.workunit.client.0.smithi016.stderr: -248> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 10 monclient(hunting): picked mon.noname-a con 0x55ea797da540 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:22:49.181 INFO:tasks.workunit.client.0.smithi016.stderr: -247> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 10 monclient(hunting): picked mon.noname-c con 0x55ea797da920 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:22:49.181 INFO:tasks.workunit.client.0.smithi016.stderr: -246> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 10 monclient(hunting): picked mon.noname-b con 0x55ea797dbda0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:22:49.181 INFO:tasks.workunit.client.0.smithi016.stderr: -245> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:49.181 INFO:tasks.workunit.client.0.smithi016.stderr: -244> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:49.181 INFO:tasks.workunit.client.0.smithi016.stderr: -243> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:49.181 INFO:tasks.workunit.client.0.smithi016.stderr: -242> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 10 monclient(hunting): _renew_subs 2024-09-12T17:22:49.181 INFO:tasks.workunit.client.0.smithi016.stderr: -241> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 10 monclient(hunting): authenticate will time out at 2486.550146s 2024-09-12T17:22:49.181 INFO:tasks.workunit.client.0.smithi016.stderr: -240> 2024-09-12T17:22:48.572+0000 7ff2c1bfd640 10 monclient(hunting): get_auth_request con 0x55ea797da540 auth_method 0 2024-09-12T17:22:49.182 INFO:tasks.workunit.client.0.smithi016.stderr: -239> 2024-09-12T17:22:48.572+0000 7ff2c1bfd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:22:49.182 INFO:tasks.workunit.client.0.smithi016.stderr: -238> 2024-09-12T17:22:48.572+0000 7ff2c1bfd640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:22:49.182 INFO:tasks.workunit.client.0.smithi016.stderr: -237> 2024-09-12T17:22:48.572+0000 7ff2c1bfd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:22:49.182 INFO:tasks.workunit.client.0.smithi016.stderr: -236> 2024-09-12T17:22:48.572+0000 7ff2c2bff640 10 monclient(hunting): get_auth_request con 0x55ea797da920 auth_method 0 2024-09-12T17:22:49.182 INFO:tasks.workunit.client.0.smithi016.stderr: -235> 2024-09-12T17:22:48.572+0000 7ff2c2bff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:22:49.182 INFO:tasks.workunit.client.0.smithi016.stderr: -234> 2024-09-12T17:22:48.572+0000 7ff2c2bff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:22:49.182 INFO:tasks.workunit.client.0.smithi016.stderr: -233> 2024-09-12T17:22:48.572+0000 7ff2c2bff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:22:49.182 INFO:tasks.workunit.client.0.smithi016.stderr: -232> 2024-09-12T17:22:48.572+0000 7ff2c2bff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:22:49.182 INFO:tasks.workunit.client.0.smithi016.stderr: -231> 2024-09-12T17:22:48.572+0000 7ff2c2bff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:22:49.182 INFO:tasks.workunit.client.0.smithi016.stderr: -230> 2024-09-12T17:22:48.572+0000 7ff2c2bff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:22:49.182 INFO:tasks.workunit.client.0.smithi016.stderr: -229> 2024-09-12T17:22:48.572+0000 7ff2c1bfd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:22:49.182 INFO:tasks.workunit.client.0.smithi016.stderr: -228> 2024-09-12T17:22:48.572+0000 7ff2c1bfd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:22:49.182 INFO:tasks.workunit.client.0.smithi016.stderr: -227> 2024-09-12T17:22:48.572+0000 7ff2c1bfd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:22:49.182 INFO:tasks.workunit.client.0.smithi016.stderr: -226> 2024-09-12T17:22:48.572+0000 7ff2c2bff640 10 monclient(hunting): handle_auth_done global_id 7772 payload 274 2024-09-12T17:22:49.183 INFO:tasks.workunit.client.0.smithi016.stderr: -225> 2024-09-12T17:22:48.572+0000 7ff2c2bff640 10 monclient: _finish_hunting 0 2024-09-12T17:22:49.183 INFO:tasks.workunit.client.0.smithi016.stderr: -224> 2024-09-12T17:22:48.572+0000 7ff2c2bff640 1 monclient: found mon.noname-c 2024-09-12T17:22:49.183 INFO:tasks.workunit.client.0.smithi016.stderr: -223> 2024-09-12T17:22:48.572+0000 7ff2c2bff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:22:49.183 INFO:tasks.workunit.client.0.smithi016.stderr: -222> 2024-09-12T17:22:48.572+0000 7ff1a5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:22:49.183 INFO:tasks.workunit.client.0.smithi016.stderr: -221> 2024-09-12T17:22:48.572+0000 7ff1a5ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:22:49.183 INFO:tasks.workunit.client.0.smithi016.stderr: -220> 2024-09-12T17:22:48.572+0000 7ff1a5ffb640 10 monclient: dump: 2024-09-12T17:22:49.183 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:22:49.183 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:22:49.183 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:49.183 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:49.183 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:22:49.183 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:49.183 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:22:49.184 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:22:49.184 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:22:49.184 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:49.184 INFO:tasks.workunit.client.0.smithi016.stderr: -219> 2024-09-12T17:22:48.572+0000 7ff1a5ffb640 10 monclient: _finish_auth 0 2024-09-12T17:22:49.184 INFO:tasks.workunit.client.0.smithi016.stderr: -218> 2024-09-12T17:22:48.572+0000 7ff1a5ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:22:49.184 INFO:tasks.workunit.client.0.smithi016.stderr: -217> 2024-09-12T17:22:48.572+0000 7ff1a5ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:22:49.184 INFO:tasks.workunit.client.0.smithi016.stderr: -216> 2024-09-12T17:22:48.572+0000 7ff1a5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:22:49.184 INFO:tasks.workunit.client.0.smithi016.stderr: -215> 2024-09-12T17:22:48.572+0000 7ff1a5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:22:49.184 INFO:tasks.workunit.client.0.smithi016.stderr: -214> 2024-09-12T17:22:48.572+0000 7ff1a5ffb640 10 monclient: dump: 2024-09-12T17:22:49.184 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:22:49.184 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:22:49.184 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:49.184 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:49.185 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:22:49.185 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:49.185 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:22:49.185 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:22:49.185 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:22:49.185 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:49.185 INFO:tasks.workunit.client.0.smithi016.stderr: -213> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 monclient: authenticate success, global_id 7772 2024-09-12T17:22:49.185 INFO:tasks.workunit.client.0.smithi016.stderr: -212> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 10 monclient: get_monmap_and_config success 2024-09-12T17:22:49.185 INFO:tasks.workunit.client.0.smithi016.stderr: -211> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 4 set_mon_vals no callback set 2024-09-12T17:22:49.185 INFO:tasks.workunit.client.0.smithi016.stderr: -210> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 10 monclient: shutdown 2024-09-12T17:22:49.185 INFO:tasks.workunit.client.0.smithi016.stderr: -209> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 10 monclient: build_initial_monmap 2024-09-12T17:22:49.185 INFO:tasks.workunit.client.0.smithi016.stderr: -208> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 1 build_initial for_mkfs: 0 2024-09-12T17:22:49.185 INFO:tasks.workunit.client.0.smithi016.stderr: -207> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 10 monclient: monmap: 2024-09-12T17:22:49.186 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:22:49.186 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:22:49.186 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:22:49.186 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:22:49.186 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:22:49.186 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:49.186 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:22:49.186 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:22:49.186 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:22:49.186 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:49.186 INFO:tasks.workunit.client.0.smithi016.stderr: -206> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf40) adding auth protocol: cephx 2024-09-12T17:22:49.186 INFO:tasks.workunit.client.0.smithi016.stderr: -205> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf40) adding auth protocol: cephx 2024-09-12T17:22:49.186 INFO:tasks.workunit.client.0.smithi016.stderr: -204> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf40) adding auth protocol: cephx 2024-09-12T17:22:49.186 INFO:tasks.workunit.client.0.smithi016.stderr: -203> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf40) adding con mode: secure 2024-09-12T17:22:49.187 INFO:tasks.workunit.client.0.smithi016.stderr: -202> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf40) adding con mode: crc 2024-09-12T17:22:49.187 INFO:tasks.workunit.client.0.smithi016.stderr: -201> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf40) adding con mode: secure 2024-09-12T17:22:49.187 INFO:tasks.workunit.client.0.smithi016.stderr: -200> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf40) adding con mode: crc 2024-09-12T17:22:49.187 INFO:tasks.workunit.client.0.smithi016.stderr: -199> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf40) adding con mode: secure 2024-09-12T17:22:49.187 INFO:tasks.workunit.client.0.smithi016.stderr: -198> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf40) adding con mode: crc 2024-09-12T17:22:49.187 INFO:tasks.workunit.client.0.smithi016.stderr: -197> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf40) adding con mode: crc 2024-09-12T17:22:49.187 INFO:tasks.workunit.client.0.smithi016.stderr: -196> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf40) adding con mode: secure 2024-09-12T17:22:49.187 INFO:tasks.workunit.client.0.smithi016.stderr: -195> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf40) adding con mode: crc 2024-09-12T17:22:49.187 INFO:tasks.workunit.client.0.smithi016.stderr: -194> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf40) adding con mode: secure 2024-09-12T17:22:49.187 INFO:tasks.workunit.client.0.smithi016.stderr: -193> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf40) adding con mode: crc 2024-09-12T17:22:49.187 INFO:tasks.workunit.client.0.smithi016.stderr: -192> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea797abf40) adding con mode: secure 2024-09-12T17:22:49.187 INFO:tasks.workunit.client.0.smithi016.stderr: -191> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:49.187 INFO:tasks.workunit.client.0.smithi016.stderr: -190> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 1 librados: starting msgr at 2024-09-12T17:22:49.188 INFO:tasks.workunit.client.0.smithi016.stderr: -189> 2024-09-12T17:22:48.572+0000 7ff2c48f89c0 1 librados: starting objecter 2024-09-12T17:22:49.188 INFO:tasks.workunit.client.0.smithi016.stderr: -188> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 5 asok(0x55ea795042b0) register_command objecter_requests cmddesc objecter_requests hook 0x55ea797d9c80 EEXIST 2024-09-12T17:22:49.188 INFO:tasks.workunit.client.0.smithi016.stderr: -187> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 1 librados: setting wanted keys 2024-09-12T17:22:49.188 INFO:tasks.workunit.client.0.smithi016.stderr: -186> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 1 librados: calling monclient init 2024-09-12T17:22:49.188 INFO:tasks.workunit.client.0.smithi016.stderr: -185> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 10 monclient: init 2024-09-12T17:22:49.188 INFO:tasks.workunit.client.0.smithi016.stderr: -184> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7978e680) adding auth protocol: cephx 2024-09-12T17:22:49.188 INFO:tasks.workunit.client.0.smithi016.stderr: -183> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7978e680) adding auth protocol: cephx 2024-09-12T17:22:49.188 INFO:tasks.workunit.client.0.smithi016.stderr: -182> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7978e680) adding auth protocol: cephx 2024-09-12T17:22:49.188 INFO:tasks.workunit.client.0.smithi016.stderr: -181> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7978e680) adding con mode: secure 2024-09-12T17:22:49.188 INFO:tasks.workunit.client.0.smithi016.stderr: -180> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7978e680) adding con mode: crc 2024-09-12T17:22:49.188 INFO:tasks.workunit.client.0.smithi016.stderr: -179> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7978e680) adding con mode: secure 2024-09-12T17:22:49.188 INFO:tasks.workunit.client.0.smithi016.stderr: -178> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7978e680) adding con mode: crc 2024-09-12T17:22:49.188 INFO:tasks.workunit.client.0.smithi016.stderr: -177> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7978e680) adding con mode: secure 2024-09-12T17:22:49.188 INFO:tasks.workunit.client.0.smithi016.stderr: -176> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7978e680) adding con mode: crc 2024-09-12T17:22:49.189 INFO:tasks.workunit.client.0.smithi016.stderr: -175> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7978e680) adding con mode: crc 2024-09-12T17:22:49.189 INFO:tasks.workunit.client.0.smithi016.stderr: -174> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7978e680) adding con mode: secure 2024-09-12T17:22:49.189 INFO:tasks.workunit.client.0.smithi016.stderr: -173> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7978e680) adding con mode: crc 2024-09-12T17:22:49.189 INFO:tasks.workunit.client.0.smithi016.stderr: -172> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7978e680) adding con mode: secure 2024-09-12T17:22:49.189 INFO:tasks.workunit.client.0.smithi016.stderr: -171> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7978e680) adding con mode: crc 2024-09-12T17:22:49.189 INFO:tasks.workunit.client.0.smithi016.stderr: -170> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 5 AuthRegistry(0x55ea7978e680) adding con mode: secure 2024-09-12T17:22:49.189 INFO:tasks.workunit.client.0.smithi016.stderr: -169> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:49.189 INFO:tasks.workunit.client.0.smithi016.stderr: -168> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:49.189 INFO:tasks.workunit.client.0.smithi016.stderr: -167> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 5 asok(0x55ea795042b0) register_command rotate-key cmddesc rotate-key hook 0x55ea7978e7c8 EEXIST 2024-09-12T17:22:49.189 INFO:tasks.workunit.client.0.smithi016.stderr: -166> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 10 monclient: _reopen_session rank -1 2024-09-12T17:22:49.189 INFO:tasks.workunit.client.0.smithi016.stderr: -165> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:22:49.189 INFO:tasks.workunit.client.0.smithi016.stderr: -164> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 10 monclient(hunting): picked mon.noname-c con 0x55ea797da540 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:22:49.189 INFO:tasks.workunit.client.0.smithi016.stderr: -163> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 10 monclient(hunting): picked mon.noname-a con 0x55ea797dbda0 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:22:49.190 INFO:tasks.workunit.client.0.smithi016.stderr: -162> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 10 monclient(hunting): picked mon.noname-b con 0x55ea797d0040 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:22:49.190 INFO:tasks.workunit.client.0.smithi016.stderr: -161> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:49.190 INFO:tasks.workunit.client.0.smithi016.stderr: -160> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:49.190 INFO:tasks.workunit.client.0.smithi016.stderr: -159> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:22:49.190 INFO:tasks.workunit.client.0.smithi016.stderr: -158> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 10 monclient(hunting): _renew_subs 2024-09-12T17:22:49.190 INFO:tasks.workunit.client.0.smithi016.stderr: -157> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 10 monclient(hunting): authenticate will time out at 2486.552788s 2024-09-12T17:22:49.190 INFO:tasks.workunit.client.0.smithi016.stderr: -156> 2024-09-12T17:22:48.576+0000 7ff2c1bfd640 10 monclient(hunting): get_auth_request con 0x55ea797da540 auth_method 0 2024-09-12T17:22:49.190 INFO:tasks.workunit.client.0.smithi016.stderr: -155> 2024-09-12T17:22:48.576+0000 7ff2c1bfd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:22:49.190 INFO:tasks.workunit.client.0.smithi016.stderr: -154> 2024-09-12T17:22:48.576+0000 7ff2c1bfd640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:22:49.190 INFO:tasks.workunit.client.0.smithi016.stderr: -153> 2024-09-12T17:22:48.576+0000 7ff2c1bfd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:22:49.190 INFO:tasks.workunit.client.0.smithi016.stderr: -152> 2024-09-12T17:22:48.576+0000 7ff2c2bff640 10 monclient(hunting): get_auth_request con 0x55ea797dbda0 auth_method 0 2024-09-12T17:22:49.190 INFO:tasks.workunit.client.0.smithi016.stderr: -151> 2024-09-12T17:22:48.576+0000 7ff2c2bff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:22:49.190 INFO:tasks.workunit.client.0.smithi016.stderr: -150> 2024-09-12T17:22:48.576+0000 7ff2c2bff640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:22:49.190 INFO:tasks.workunit.client.0.smithi016.stderr: -149> 2024-09-12T17:22:48.576+0000 7ff2c2bff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:22:49.191 INFO:tasks.workunit.client.0.smithi016.stderr: -148> 2024-09-12T17:22:48.576+0000 7ff2c1bfd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:22:49.191 INFO:tasks.workunit.client.0.smithi016.stderr: -147> 2024-09-12T17:22:48.576+0000 7ff2c1bfd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:22:49.191 INFO:tasks.workunit.client.0.smithi016.stderr: -146> 2024-09-12T17:22:48.576+0000 7ff2c1bfd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:22:49.191 INFO:tasks.workunit.client.0.smithi016.stderr: -145> 2024-09-12T17:22:48.576+0000 7ff2c2bff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:22:49.191 INFO:tasks.workunit.client.0.smithi016.stderr: -144> 2024-09-12T17:22:48.576+0000 7ff2c2bff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:22:49.191 INFO:tasks.workunit.client.0.smithi016.stderr: -143> 2024-09-12T17:22:48.576+0000 7ff2c2bff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:22:49.191 INFO:tasks.workunit.client.0.smithi016.stderr: -142> 2024-09-12T17:22:48.576+0000 7ff2c1bfd640 10 monclient(hunting): handle_auth_done global_id 7775 payload 824 2024-09-12T17:22:49.191 INFO:tasks.workunit.client.0.smithi016.stderr: -141> 2024-09-12T17:22:48.576+0000 7ff2c1bfd640 10 monclient: _finish_hunting 0 2024-09-12T17:22:49.191 INFO:tasks.workunit.client.0.smithi016.stderr: -140> 2024-09-12T17:22:48.576+0000 7ff2c1bfd640 1 monclient: found mon.noname-c 2024-09-12T17:22:49.191 INFO:tasks.workunit.client.0.smithi016.stderr: -139> 2024-09-12T17:22:48.576+0000 7ff2c1bfd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:22:49.191 INFO:tasks.workunit.client.0.smithi016.stderr: -138> 2024-09-12T17:22:48.576+0000 7ff193fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:22:49.191 INFO:tasks.workunit.client.0.smithi016.stderr: -137> 2024-09-12T17:22:48.576+0000 7ff193fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:22:49.191 INFO:tasks.workunit.client.0.smithi016.stderr: -136> 2024-09-12T17:22:48.576+0000 7ff193fff640 10 monclient: dump: 2024-09-12T17:22:49.192 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:22:49.192 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:22:49.192 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:49.192 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:49.192 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:22:49.192 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:49.192 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:22:49.192 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:22:49.192 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:22:49.192 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:49.192 INFO:tasks.workunit.client.0.smithi016.stderr: -135> 2024-09-12T17:22:48.576+0000 7ff193fff640 10 monclient: _finish_auth 0 2024-09-12T17:22:49.192 INFO:tasks.workunit.client.0.smithi016.stderr: -134> 2024-09-12T17:22:48.576+0000 7ff193fff640 10 monclient: _check_auth_tickets 2024-09-12T17:22:49.192 INFO:tasks.workunit.client.0.smithi016.stderr: -133> 2024-09-12T17:22:48.576+0000 7ff193fff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:22:49.192 INFO:tasks.workunit.client.0.smithi016.stderr: -132> 2024-09-12T17:22:48.576+0000 7ff193fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:22:49.193 INFO:tasks.workunit.client.0.smithi016.stderr: -131> 2024-09-12T17:22:48.576+0000 7ff193fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:22:49.193 INFO:tasks.workunit.client.0.smithi016.stderr: -130> 2024-09-12T17:22:48.576+0000 7ff193fff640 10 monclient: dump: 2024-09-12T17:22:49.193 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:22:49.193 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:22:49.193 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:49.193 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:22:49.193 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:22:49.193 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:22:49.193 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:22:49.193 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:22:49.193 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:22:49.193 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:49.193 INFO:tasks.workunit.client.0.smithi016.stderr: -129> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 5 monclient: authenticate success, global_id 7775 2024-09-12T17:22:49.193 INFO:tasks.workunit.client.0.smithi016.stderr: -128> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 10 monclient: _renew_subs 2024-09-12T17:22:49.194 INFO:tasks.workunit.client.0.smithi016.stderr: -127> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:22:49.194 INFO:tasks.workunit.client.0.smithi016.stderr: -126> 2024-09-12T17:22:48.576+0000 7ff1a5ffb640 4 set_mon_vals no callback set 2024-09-12T17:22:49.194 INFO:tasks.workunit.client.0.smithi016.stderr: -125> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 10 monclient: _renew_subs 2024-09-12T17:22:49.194 INFO:tasks.workunit.client.0.smithi016.stderr: -124> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:22:49.194 INFO:tasks.workunit.client.0.smithi016.stderr: -123> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 1 librados: init done 2024-09-12T17:22:49.194 INFO:tasks.workunit.client.0.smithi016.stderr: -122> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 5 asok(0x55ea795042b0) register_command cr dump hook 0x55ea797cfbc8 2024-09-12T17:22:49.194 INFO:tasks.workunit.client.0.smithi016.stderr: -121> 2024-09-12T17:22:48.576+0000 7ff2c48f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.194 INFO:tasks.workunit.client.0.smithi016.stderr: -120> 2024-09-12T17:22:48.576+0000 7ff193fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:22:49.194 INFO:tasks.workunit.client.0.smithi016.stderr: -119> 2024-09-12T17:22:48.576+0000 7ff193fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:22:49.194 INFO:tasks.workunit.client.0.smithi016.stderr: -118> 2024-09-12T17:22:48.576+0000 7ff193fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:22:49.194 INFO:tasks.workunit.client.0.smithi016.stderr: -117> 2024-09-12T17:22:48.580+0000 7ff2c2bff640 10 monclient: get_auth_request con 0x7ff18c070b10 auth_method 0 2024-09-12T17:22:49.194 INFO:tasks.workunit.client.0.smithi016.stderr: -116> 2024-09-12T17:22:48.580+0000 7ff2c23fe640 10 monclient: get_auth_request con 0x55ea797fb250 auth_method 0 2024-09-12T17:22:49.194 INFO:tasks.workunit.client.0.smithi016.stderr: -115> 2024-09-12T17:22:48.580+0000 7ff2c48f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:49.195 INFO:tasks.workunit.client.0.smithi016.stderr: -114> 2024-09-12T17:22:48.580+0000 7ff2c48f89c0 20 realm 2024-09-12T17:22:49.195 INFO:tasks.workunit.client.0.smithi016.stderr: -113> 2024-09-12T17:22:48.580+0000 7ff2c48f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.195 INFO:tasks.workunit.client.0.smithi016.stderr: -112> 2024-09-12T17:22:48.580+0000 7ff2c48f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:49.195 INFO:tasks.workunit.client.0.smithi016.stderr: -111> 2024-09-12T17:22:48.580+0000 7ff2c48f89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:22:49.195 INFO:tasks.workunit.client.0.smithi016.stderr: -110> 2024-09-12T17:22:48.580+0000 7ff2c48f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.195 INFO:tasks.workunit.client.0.smithi016.stderr: -109> 2024-09-12T17:22:48.580+0000 7ff2c48f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:49.195 INFO:tasks.workunit.client.0.smithi016.stderr: -108> 2024-09-12T17:22:48.580+0000 7ff2c48f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.195 INFO:tasks.workunit.client.0.smithi016.stderr: -107> 2024-09-12T17:22:48.580+0000 7ff2c1bfd640 10 monclient: get_auth_request con 0x55ea797ff460 auth_method 0 2024-09-12T17:22:49.195 INFO:tasks.workunit.client.0.smithi016.stderr: -106> 2024-09-12T17:22:48.580+0000 7ff2c48f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:22:49.195 INFO:tasks.workunit.client.0.smithi016.stderr: -105> 2024-09-12T17:22:48.580+0000 7ff2c48f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.195 INFO:tasks.workunit.client.0.smithi016.stderr: -104> 2024-09-12T17:22:48.580+0000 7ff2c2bff640 10 monclient: get_auth_request con 0x55ea79802ca0 auth_method 0 2024-09-12T17:22:49.195 INFO:tasks.workunit.client.0.smithi016.stderr: -103> 2024-09-12T17:22:48.584+0000 7ff2c48f89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:22:49.195 INFO:tasks.workunit.client.0.smithi016.stderr: -102> 2024-09-12T17:22:48.584+0000 7ff2c48f89c0 20 searching for the correct realm 2024-09-12T17:22:49.195 INFO:tasks.workunit.client.0.smithi016.stderr: -101> 2024-09-12T17:22:48.584+0000 7ff2c23fe640 10 monclient: get_auth_request con 0x55ea79807a60 auth_method 0 2024-09-12T17:22:49.196 INFO:tasks.workunit.client.0.smithi016.stderr: -100> 2024-09-12T17:22:48.584+0000 7ff2c1bfd640 10 monclient: get_auth_request con 0x7ff2b4017070 auth_method 0 2024-09-12T17:22:49.196 INFO:tasks.workunit.client.0.smithi016.stderr: -99> 2024-09-12T17:22:48.584+0000 7ff2c2bff640 10 monclient: get_auth_request con 0x7ff2b8047060 auth_method 0 2024-09-12T17:22:49.196 INFO:tasks.workunit.client.0.smithi016.stderr: -98> 2024-09-12T17:22:48.588+0000 7ff2c2bff640 0 -- 172.21.15.16:0/2043560097 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7ff2b8047060 msgr2=0x7ff2b8071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:22:49.196 INFO:tasks.workunit.client.0.smithi016.stderr: -97> 2024-09-12T17:22:48.792+0000 7ff2c2bff640 10 monclient: get_auth_request con 0x7ff2b8047060 auth_method 0 2024-09-12T17:22:49.196 INFO:tasks.workunit.client.0.smithi016.stderr: -96> 2024-09-12T17:22:48.796+0000 7ff2c23fe640 10 monclient: get_auth_request con 0x7ff2bc134040 auth_method 0 2024-09-12T17:22:49.196 INFO:tasks.workunit.client.0.smithi016.stderr: -95> 2024-09-12T17:22:48.804+0000 7ff2c1bfd640 0 -- 172.21.15.16:0/2043560097 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7ff2bc0cd890 msgr2=0x7ff2bc1180c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:22:49.196 INFO:tasks.workunit.client.0.smithi016.stderr: -94> 2024-09-12T17:22:49.008+0000 7ff2c1bfd640 10 monclient: get_auth_request con 0x7ff2bc0cd890 auth_method 0 2024-09-12T17:22:49.196 INFO:tasks.workunit.client.0.smithi016.stderr: -93> 2024-09-12T17:22:49.020+0000 7ff2c48f89c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:22:49.196 INFO:tasks.workunit.client.0.smithi016.stderr: -92> 2024-09-12T17:22:49.020+0000 7ff2c48f89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:22:49.196 INFO:tasks.workunit.client.0.smithi016.stderr: -91> 2024-09-12T17:22:49.020+0000 7ff2c48f89c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:22:49.196 INFO:tasks.workunit.client.0.smithi016.stderr: -90> 2024-09-12T17:22:49.020+0000 7ff2c48f89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:22:49.196 INFO:tasks.workunit.client.0.smithi016.stderr: -89> 2024-09-12T17:22:49.020+0000 7ff2c48f89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:22:49.196 INFO:tasks.workunit.client.0.smithi016.stderr: -88> 2024-09-12T17:22:49.020+0000 7ff2c48f89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:22:49.197 INFO:tasks.workunit.client.0.smithi016.stderr: -87> 2024-09-12T17:22:49.020+0000 7ff2c48f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.197 INFO:tasks.workunit.client.0.smithi016.stderr: -86> 2024-09-12T17:22:49.024+0000 7ff2c48f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:49.197 INFO:tasks.workunit.client.0.smithi016.stderr: -85> 2024-09-12T17:22:49.024+0000 7ff2c48f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.197 INFO:tasks.workunit.client.0.smithi016.stderr: -84> 2024-09-12T17:22:49.024+0000 7ff2c48f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:22:49.197 INFO:tasks.workunit.client.0.smithi016.stderr: -83> 2024-09-12T17:22:49.024+0000 7ff2c48f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.197 INFO:tasks.workunit.client.0.smithi016.stderr: -82> 2024-09-12T17:22:49.024+0000 7ff2c48f89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:22:49.197 INFO:tasks.workunit.client.0.smithi016.stderr: -81> 2024-09-12T17:22:49.024+0000 7ff2c48f89c0 20 zone default found 2024-09-12T17:22:49.197 INFO:tasks.workunit.client.0.smithi016.stderr: -80> 2024-09-12T17:22:49.024+0000 7ff2c48f89c0 4 Realm: () 2024-09-12T17:22:49.197 INFO:tasks.workunit.client.0.smithi016.stderr: -79> 2024-09-12T17:22:49.024+0000 7ff2c48f89c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:22:49.197 INFO:tasks.workunit.client.0.smithi016.stderr: -78> 2024-09-12T17:22:49.024+0000 7ff2c48f89c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:22:49.197 INFO:tasks.workunit.client.0.smithi016.stderr: -77> 2024-09-12T17:22:49.024+0000 7ff2c48f89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:22:49.197 INFO:tasks.workunit.client.0.smithi016.stderr: -76> 2024-09-12T17:22:49.024+0000 7ff2c48f89c0 20 zonegroup default 2024-09-12T17:22:49.197 INFO:tasks.workunit.client.0.smithi016.stderr: -75> 2024-09-12T17:22:49.024+0000 7ff2c48f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.197 INFO:tasks.workunit.client.0.smithi016.stderr: -74> 2024-09-12T17:22:49.024+0000 7ff2c48f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:49.198 INFO:tasks.workunit.client.0.smithi016.stderr: -73> 2024-09-12T17:22:49.024+0000 7ff2c48f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.198 INFO:tasks.workunit.client.0.smithi016.stderr: -72> 2024-09-12T17:22:49.024+0000 7ff2c48f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:49.198 INFO:tasks.workunit.client.0.smithi016.stderr: -71> 2024-09-12T17:22:49.028+0000 7ff2c48f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.198 INFO:tasks.workunit.client.0.smithi016.stderr: -70> 2024-09-12T17:22:49.028+0000 7ff2c48f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:49.198 INFO:tasks.workunit.client.0.smithi016.stderr: -69> 2024-09-12T17:22:49.028+0000 7ff2c48f89c0 20 started sync module instance, tier type = 2024-09-12T17:22:49.198 INFO:tasks.workunit.client.0.smithi016.stderr: -68> 2024-09-12T17:22:49.028+0000 7ff2c48f89c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:22:49.198 INFO:tasks.workunit.client.0.smithi016.stderr: -67> 2024-09-12T17:22:49.048+0000 7ff2c48f89c0 20 add_watcher() i=0 2024-09-12T17:22:49.198 INFO:tasks.workunit.client.0.smithi016.stderr: -66> 2024-09-12T17:22:49.048+0000 7ff2c48f89c0 20 add_watcher() i=1 2024-09-12T17:22:49.198 INFO:tasks.workunit.client.0.smithi016.stderr: -65> 2024-09-12T17:22:49.048+0000 7ff2c48f89c0 20 add_watcher() i=2 2024-09-12T17:22:49.198 INFO:tasks.workunit.client.0.smithi016.stderr: -64> 2024-09-12T17:22:49.048+0000 7ff2c48f89c0 20 add_watcher() i=3 2024-09-12T17:22:49.198 INFO:tasks.workunit.client.0.smithi016.stderr: -63> 2024-09-12T17:22:49.048+0000 7ff2c48f89c0 20 add_watcher() i=4 2024-09-12T17:22:49.198 INFO:tasks.workunit.client.0.smithi016.stderr: -62> 2024-09-12T17:22:49.048+0000 7ff2c48f89c0 20 add_watcher() i=5 2024-09-12T17:22:49.198 INFO:tasks.workunit.client.0.smithi016.stderr: -61> 2024-09-12T17:22:49.048+0000 7ff2c48f89c0 20 add_watcher() i=6 2024-09-12T17:22:49.198 INFO:tasks.workunit.client.0.smithi016.stderr: -60> 2024-09-12T17:22:49.048+0000 7ff2c48f89c0 20 add_watcher() i=7 2024-09-12T17:22:49.199 INFO:tasks.workunit.client.0.smithi016.stderr: -59> 2024-09-12T17:22:49.048+0000 7ff2c48f89c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:22:49.199 INFO:tasks.workunit.client.0.smithi016.stderr: -58> 2024-09-12T17:22:49.052+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc85892ab0) adding auth protocol: cephx 2024-09-12T17:22:49.199 INFO:tasks.workunit.client.0.smithi016.stderr: -57> 2024-09-12T17:22:49.052+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc85892ab0) adding auth protocol: cephx 2024-09-12T17:22:49.199 INFO:tasks.workunit.client.0.smithi016.stderr: -56> 2024-09-12T17:22:49.052+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc85892ab0) adding auth protocol: cephx 2024-09-12T17:22:49.199 INFO:tasks.workunit.client.0.smithi016.stderr: -55> 2024-09-12T17:22:49.052+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc85892ab0) adding con mode: secure 2024-09-12T17:22:49.199 INFO:tasks.workunit.client.0.smithi016.stderr: -54> 2024-09-12T17:22:49.052+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc85892ab0) adding con mode: crc 2024-09-12T17:22:49.199 INFO:tasks.workunit.client.0.smithi016.stderr: -53> 2024-09-12T17:22:49.052+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc85892ab0) adding con mode: secure 2024-09-12T17:22:49.199 INFO:tasks.workunit.client.0.smithi016.stderr: -52> 2024-09-12T17:22:49.052+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc85892ab0) adding con mode: crc 2024-09-12T17:22:49.199 INFO:tasks.workunit.client.0.smithi016.stderr: -51> 2024-09-12T17:22:49.052+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc85892ab0) adding con mode: secure 2024-09-12T17:22:49.199 INFO:tasks.workunit.client.0.smithi016.stderr: -50> 2024-09-12T17:22:49.052+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc85892ab0) adding con mode: crc 2024-09-12T17:22:49.199 INFO:tasks.workunit.client.0.smithi016.stderr: -49> 2024-09-12T17:22:49.052+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc85892ab0) adding con mode: crc 2024-09-12T17:22:49.199 INFO:tasks.workunit.client.0.smithi016.stderr: -48> 2024-09-12T17:22:49.052+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc85892ab0) adding con mode: secure 2024-09-12T17:22:49.199 INFO:tasks.workunit.client.0.smithi016.stderr: -47> 2024-09-12T17:22:49.052+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc85892ab0) adding con mode: crc 2024-09-12T17:22:49.200 INFO:tasks.workunit.client.0.smithi016.stderr: -46> 2024-09-12T17:22:49.052+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc85892ab0) adding con mode: secure 2024-09-12T17:22:49.200 INFO:tasks.workunit.client.0.smithi016.stderr: -45> 2024-09-12T17:22:49.052+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc85892ab0) adding con mode: crc 2024-09-12T17:22:49.200 INFO:tasks.workunit.client.0.smithi016.stderr: -44> 2024-09-12T17:22:49.052+0000 7ff2c48f89c0 5 AuthRegistry(0x7ffc85892ab0) adding con mode: secure 2024-09-12T17:22:49.200 INFO:tasks.workunit.client.0.smithi016.stderr: -43> 2024-09-12T17:22:49.052+0000 7ff1797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:22:49.200 INFO:tasks.workunit.client.0.smithi016.stderr: -42> 2024-09-12T17:22:49.052+0000 7ff2c48f89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:22:49.200 INFO:tasks.workunit.client.0.smithi016.stderr: -41> 2024-09-12T17:22:49.052+0000 7ff2c48f89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:22:49.200 INFO:tasks.workunit.client.0.smithi016.stderr: -40> 2024-09-12T17:22:49.052+0000 7ff2c48f89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:22:49.200 INFO:tasks.workunit.client.0.smithi016.stderr: -39> 2024-09-12T17:22:49.052+0000 7ff2c48f89c0 5 asok(0x55ea795042b0) register_command cache list hook 0x55ea797d1a00 2024-09-12T17:22:49.200 INFO:tasks.workunit.client.0.smithi016.stderr: -38> 2024-09-12T17:22:49.052+0000 7ff2c48f89c0 5 asok(0x55ea795042b0) register_command cache inspect hook 0x55ea797d1a00 2024-09-12T17:22:49.200 INFO:tasks.workunit.client.0.smithi016.stderr: -37> 2024-09-12T17:22:49.052+0000 7ff2c48f89c0 5 asok(0x55ea795042b0) register_command cache erase hook 0x55ea797d1a00 2024-09-12T17:22:49.200 INFO:tasks.workunit.client.0.smithi016.stderr: -36> 2024-09-12T17:22:49.052+0000 7ff2c48f89c0 5 asok(0x55ea795042b0) register_command cache zap hook 0x55ea797d1a00 2024-09-12T17:22:49.200 INFO:tasks.workunit.client.0.smithi016.stderr: -35> 2024-09-12T17:22:49.056+0000 7ff2c48f89c0 5 note: GC not initialized 2024-09-12T17:22:49.200 INFO:tasks.workunit.client.0.smithi016.stderr: -34> 2024-09-12T17:22:49.056+0000 7ff1737fe640 20 reqs_thread_entry: start 2024-09-12T17:22:49.201 INFO:tasks.workunit.client.0.smithi016.stderr: -33> 2024-09-12T17:22:49.056+0000 7ff2c48f89c0 5 asok(0x55ea795042b0) register_command sync trace show hook 0x7ff2bc0cf070 2024-09-12T17:22:49.201 INFO:tasks.workunit.client.0.smithi016.stderr: -32> 2024-09-12T17:22:49.056+0000 7ff2c48f89c0 5 asok(0x55ea795042b0) register_command sync trace history hook 0x7ff2bc0cf070 2024-09-12T17:22:49.201 INFO:tasks.workunit.client.0.smithi016.stderr: -31> 2024-09-12T17:22:49.056+0000 7ff2c48f89c0 5 asok(0x55ea795042b0) register_command sync trace active hook 0x7ff2bc0cf070 2024-09-12T17:22:49.201 INFO:tasks.workunit.client.0.smithi016.stderr: -30> 2024-09-12T17:22:49.056+0000 7ff2c48f89c0 5 asok(0x55ea795042b0) register_command sync trace active_short hook 0x7ff2bc0cf070 2024-09-12T17:22:49.201 INFO:tasks.workunit.client.0.smithi016.stderr: -29> 2024-09-12T17:22:49.056+0000 7ff2c48f89c0 20 init_complete bucket index max shards: 1 2024-09-12T17:22:49.201 INFO:tasks.workunit.client.0.smithi016.stderr: -28> 2024-09-12T17:22:49.056+0000 7ff2c48f89c0 20 Filter name: none 2024-09-12T17:22:49.201 INFO:tasks.workunit.client.0.smithi016.stderr: -27> 2024-09-12T17:22:49.056+0000 7ff1717fa640 20 reqs_thread_entry: start 2024-09-12T17:22:49.201 INFO:tasks.workunit.client.0.smithi016.stderr: -26> 2024-09-12T17:22:49.056+0000 7ff2c48f89c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:22:49.201 INFO:tasks.workunit.client.0.smithi016.stderr: -25> 2024-09-12T17:22:49.056+0000 7ff2c48f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.201 INFO:tasks.workunit.client.0.smithi016.stderr: -24> 2024-09-12T17:22:49.056+0000 7ff2c48f89c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:22:49.201 INFO:tasks.workunit.client.0.smithi016.stderr: -23> 2024-09-12T17:22:49.056+0000 7ff2c48f89c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:22:49.201 INFO:tasks.workunit.client.0.smithi016.stderr: -22> 2024-09-12T17:22:49.056+0000 7ff2c48f89c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:22:49.201 INFO:tasks.workunit.client.0.smithi016.stderr: -21> 2024-09-12T17:22:49.056+0000 7ff2c48f89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 : miss 2024-09-12T17:22:49.201 INFO:tasks.workunit.client.0.smithi016.stderr: -20> 2024-09-12T17:22:49.056+0000 7ff2c48f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.202 INFO:tasks.workunit.client.0.smithi016.stderr: -19> 2024-09-12T17:22:49.056+0000 7ff2c48f89c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:22:49.202 INFO:tasks.workunit.client.0.smithi016.stderr: -18> 2024-09-12T17:22:49.056+0000 7ff2c48f89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:22:49.202 INFO:tasks.workunit.client.0.smithi016.stderr: -17> 2024-09-12T17:22:49.056+0000 7ff2c48f89c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:22:49.202 INFO:tasks.workunit.client.0.smithi016.stderr: -16> 2024-09-12T17:22:49.056+0000 7ff2c48f89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:22:49.202 INFO:tasks.workunit.client.0.smithi016.stderr: -15> 2024-09-12T17:22:49.056+0000 7ff2c48f89c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:22:49.202 INFO:tasks.workunit.client.0.smithi016.stderr: -14> 2024-09-12T17:22:49.056+0000 7ff2c48f89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 2024-09-12T17:22:49.202 INFO:tasks.workunit.client.0.smithi016.stderr: -13> 2024-09-12T17:22:49.064+0000 7ff2c48f89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:22:49.202 INFO:tasks.workunit.client.0.smithi016.stderr: -12> 2024-09-12T17:22:49.064+0000 7ff2c48f89c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:22:49.202 INFO:tasks.workunit.client.0.smithi016.stderr: -11> 2024-09-12T17:22:49.064+0000 7ff2c48f89c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:22:49.202 INFO:tasks.workunit.client.0.smithi016.stderr: -10> 2024-09-12T17:22:49.064+0000 7ff2c48f89c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17, ofs0, ns] 2024-09-12T17:22:49.202 INFO:tasks.workunit.client.0.smithi016.stderr: -9> 2024-09-12T17:22:49.064+0000 7ff1a5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431629 cookie 94465549197920 notifier 7775 bl.length()=827 2024-09-12T17:22:49.202 INFO:tasks.workunit.client.0.smithi016.stderr: -8> 2024-09-12T17:22:49.064+0000 7ff1a5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:22:49.202 INFO:tasks.workunit.client.0.smithi016.stderr: -7> 2024-09-12T17:22:49.064+0000 7ff1a5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:22:49.203 INFO:tasks.workunit.client.0.smithi016.stderr: -6> 2024-09-12T17:22:49.064+0000 7ff1a5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:22:49.203 INFO:tasks.workunit.client.0.smithi016.stderr: -5> 2024-09-12T17:22:49.064+0000 7ff2c48f89c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): orig_sources= new_sources= 2024-09-12T17:22:49.203 INFO:tasks.workunit.client.0.smithi016.stderr: -4> 2024-09-12T17:22:49.064+0000 7ff2c48f89c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): potential sources added=[] removed=[] 2024-09-12T17:22:49.203 INFO:tasks.workunit.client.0.smithi016.stderr: -3> 2024-09-12T17:22:49.064+0000 7ff2c48f89c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): orig_dests= new_dests= 2024-09-12T17:22:49.203 INFO:tasks.workunit.client.0.smithi016.stderr: -2> 2024-09-12T17:22:49.064+0000 7ff2c48f89c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): potential dests added=[] removed=[] 2024-09-12T17:22:49.203 INFO:tasks.workunit.client.0.smithi016.stderr: -1> 2024-09-12T17:22:49.072+0000 7ff2c48f89c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff2c48f89c0 time 2024-09-12T17:22:49.075758+0000 2024-09-12T17:22:49.203 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:22:49.203 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:49.203 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:22:49.203 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff2c81d22eb] 2024-09-12T17:22:49.203 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff2c81d249f] 2024-09-12T17:22:49.203 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ea770dc0c1] 2024-09-12T17:22:49.203 INFO:tasks.workunit.client.0.smithi016.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ea770ee1fa] 2024-09-12T17:22:49.204 INFO:tasks.workunit.client.0.smithi016.stderr: 5: main() 2024-09-12T17:22:49.204 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff2c7038d90] 2024-09-12T17:22:49.204 INFO:tasks.workunit.client.0.smithi016.stderr: 7: __libc_start_main() 2024-09-12T17:22:49.204 INFO:tasks.workunit.client.0.smithi016.stderr: 8: _start() 2024-09-12T17:22:49.204 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:49.204 INFO:tasks.workunit.client.0.smithi016.stderr: 0> 2024-09-12T17:22:49.072+0000 7ff2c48f89c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:22:49.204 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7ff2c48f89c0 thread_name:radosgw-admin 2024-09-12T17:22:49.204 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:49.204 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:22:49.204 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff2c7051520] 2024-09-12T17:22:49.204 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:22:49.204 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:22:49.204 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:22:49.205 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff2c81d2345] 2024-09-12T17:22:49.205 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff2c81d249f] 2024-09-12T17:22:49.205 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ea770dc0c1] 2024-09-12T17:22:49.205 INFO:tasks.workunit.client.0.smithi016.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ea770ee1fa] 2024-09-12T17:22:49.205 INFO:tasks.workunit.client.0.smithi016.stderr: 9: main() 2024-09-12T17:22:49.205 INFO:tasks.workunit.client.0.smithi016.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff2c7038d90] 2024-09-12T17:22:49.205 INFO:tasks.workunit.client.0.smithi016.stderr: 11: __libc_start_main() 2024-09-12T17:22:49.205 INFO:tasks.workunit.client.0.smithi016.stderr: 12: _start() 2024-09-12T17:22:49.205 INFO:tasks.workunit.client.0.smithi016.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:22:49.205 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:22:49.205 INFO:tasks.workunit.client.0.smithi016.stderr:--- logging levels --- 2024-09-12T17:22:49.205 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 none 2024-09-12T17:22:49.205 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 lockdep 2024-09-12T17:22:49.206 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 context 2024-09-12T17:22:49.206 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 crush 2024-09-12T17:22:49.206 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds 2024-09-12T17:22:49.206 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_balancer 2024-09-12T17:22:49.206 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_locker 2024-09-12T17:22:49.206 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log 2024-09-12T17:22:49.206 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log_expire 2024-09-12T17:22:49.206 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_migrator 2024-09-12T17:22:49.206 INFO:tasks.workunit.client.0.smithi016.stderr: 3/ 5 mds_quiesce 2024-09-12T17:22:49.206 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 buffer 2024-09-12T17:22:49.206 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 timer 2024-09-12T17:22:49.206 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 filer 2024-09-12T17:22:49.206 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 striper 2024-09-12T17:22:49.207 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 objecter 2024-09-12T17:22:49.207 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rados 2024-09-12T17:22:49.207 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd 2024-09-12T17:22:49.207 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_mirror 2024-09-12T17:22:49.207 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_replay 2024-09-12T17:22:49.207 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_pwl 2024-09-12T17:22:49.207 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 journaler 2024-09-12T17:22:49.207 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objectcacher 2024-09-12T17:22:49.207 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:22:49.207 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 client 2024-09-12T17:22:49.207 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 osd 2024-09-12T17:22:49.207 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 optracker 2024-09-12T17:22:49.207 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objclass 2024-09-12T17:22:49.207 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 filestore 2024-09-12T17:22:49.207 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 journal 2024-09-12T17:22:49.208 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 ms 2024-09-12T17:22:49.208 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mon 2024-09-12T17:22:49.208 INFO:tasks.workunit.client.0.smithi016.stderr: 0/10 monc 2024-09-12T17:22:49.208 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 paxos 2024-09-12T17:22:49.208 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 tp 2024-09-12T17:22:49.208 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 auth 2024-09-12T17:22:49.208 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 crypto 2024-09-12T17:22:49.208 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 finisher 2024-09-12T17:22:49.208 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 reserver 2024-09-12T17:22:49.208 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 heartbeatmap 2024-09-12T17:22:49.208 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 perfcounter 2024-09-12T17:22:49.208 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw 2024-09-12T17:22:49.208 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_sync 2024-09-12T17:22:49.209 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_datacache 2024-09-12T17:22:49.209 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_access 2024-09-12T17:22:49.209 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:22:49.209 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_flight 2024-09-12T17:22:49.209 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:22:49.209 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw_notification 2024-09-12T17:22:49.209 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 javaclient 2024-09-12T17:22:49.209 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 asok 2024-09-12T17:22:49.209 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 throttle 2024-09-12T17:22:49.209 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 refs 2024-09-12T17:22:49.209 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 compressor 2024-09-12T17:22:49.209 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluestore 2024-09-12T17:22:49.209 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluefs 2024-09-12T17:22:49.210 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 bdev 2024-09-12T17:22:49.210 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 kstore 2024-09-12T17:22:49.210 INFO:tasks.workunit.client.0.smithi016.stderr: 4/ 5 rocksdb 2024-09-12T17:22:49.210 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 fuse 2024-09-12T17:22:49.210 INFO:tasks.workunit.client.0.smithi016.stderr: 2/ 5 mgr 2024-09-12T17:22:49.210 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mgrc 2024-09-12T17:22:49.210 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 dpdk 2024-09-12T17:22:49.210 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 eventtrace 2024-09-12T17:22:49.210 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 prioritycache 2024-09-12T17:22:49.210 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 test 2024-09-12T17:22:49.210 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:22:49.210 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephsqlite 2024-09-12T17:22:49.210 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:22:49.211 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore 2024-09-12T17:22:49.211 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_onode 2024-09-12T17:22:49.211 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_odata 2024-09-12T17:22:49.211 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_omap 2024-09-12T17:22:49.211 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_tm 2024-09-12T17:22:49.211 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_t 2024-09-12T17:22:49.211 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:22:49.211 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_epm 2024-09-12T17:22:49.211 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_lba 2024-09-12T17:22:49.211 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:22:49.211 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cache 2024-09-12T17:22:49.211 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_journal 2024-09-12T17:22:49.211 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_device 2024-09-12T17:22:49.212 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_backref 2024-09-12T17:22:49.212 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 alienstore 2024-09-12T17:22:49.212 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mclock 2024-09-12T17:22:49.212 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cyanstore 2024-09-12T17:22:49.212 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 ceph_exporter 2024-09-12T17:22:49.212 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 memstore 2024-09-12T17:22:49.212 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 trace 2024-09-12T17:22:49.212 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 ceph_dedup 2024-09-12T17:22:49.212 INFO:tasks.workunit.client.0.smithi016.stderr: -2/-2 (syslog threshold) 2024-09-12T17:22:49.212 INFO:tasks.workunit.client.0.smithi016.stderr: 99/99 (stderr threshold) 2024-09-12T17:22:49.212 INFO:tasks.workunit.client.0.smithi016.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:22:49.212 INFO:tasks.workunit.client.0.smithi016.stderr: 7ff1717fa640 / http_manager 2024-09-12T17:22:49.212 INFO:tasks.workunit.client.0.smithi016.stderr: 7ff1737fe640 / http_manager 2024-09-12T17:22:49.213 INFO:tasks.workunit.client.0.smithi016.stderr: 7ff1797e2640 / rgw_dt_lg_renew 2024-09-12T17:22:49.213 INFO:tasks.workunit.client.0.smithi016.stderr: 7ff193fff640 / ms_dispatch 2024-09-12T17:22:49.213 INFO:tasks.workunit.client.0.smithi016.stderr: 7ff1a5ffb640 / io_context_pool 2024-09-12T17:22:49.213 INFO:tasks.workunit.client.0.smithi016.stderr: 7ff1a7fff640 / ms_dispatch 2024-09-12T17:22:49.213 INFO:tasks.workunit.client.0.smithi016.stderr: 7ff1aee05640 / ms_dispatch 2024-09-12T17:22:49.213 INFO:tasks.workunit.client.0.smithi016.stderr: 7ff1b0608640 / io_context_pool 2024-09-12T17:22:49.213 INFO:tasks.workunit.client.0.smithi016.stderr: 7ff2c1bfd640 / msgr-worker-2 2024-09-12T17:22:49.213 INFO:tasks.workunit.client.0.smithi016.stderr: 7ff2c23fe640 / msgr-worker-1 2024-09-12T17:22:49.213 INFO:tasks.workunit.client.0.smithi016.stderr: 7ff2c2bff640 / msgr-worker-0 2024-09-12T17:22:49.213 INFO:tasks.workunit.client.0.smithi016.stderr: 7ff2c3400640 / io_context_pool 2024-09-12T17:22:49.213 INFO:tasks.workunit.client.0.smithi016.stderr: 7ff2c48f89c0 / radosgw-admin 2024-09-12T17:22:49.213 INFO:tasks.workunit.client.0.smithi016.stderr: max_recent 500 2024-09-12T17:22:49.213 INFO:tasks.workunit.client.0.smithi016.stderr: max_new 1000 2024-09-12T17:22:49.213 INFO:tasks.workunit.client.0.smithi016.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:22:49.078666Z_53706083-2742-4580-97e5-fdbf0d76dc0e/log 2024-09-12T17:22:49.214 INFO:tasks.workunit.client.0.smithi016.stderr:--- end dump of recent events --- 2024-09-12T17:22:49.214 INFO:tasks.workunit.client.0.smithi016.stderr:Aborted 2024-09-12T17:22:49.214 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:22:49.215 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:22:49.215 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:22:49.215 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.160+0000 7f20dd7999c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.216 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.160+0000 7f20dd7999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:49.216 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.160+0000 7f20dd7999c0 20 realm 2024-09-12T17:22:49.216 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.160+0000 7f20dd7999c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.216 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.160+0000 7f20dd7999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:49.216 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.160+0000 7f20dd7999c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:22:49.216 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.160+0000 7f20dd7999c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.216 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.160+0000 7f20dd7999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:49.216 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.160+0000 7f20dd7999c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.216 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.164+0000 7f20dd7999c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:22:49.216 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.164+0000 7f20dd7999c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.216 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.164+0000 7f20dd7999c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:22:49.216 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.164+0000 7f20dd7999c0 20 searching for the correct realm 2024-09-12T17:22:49.217 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.168+0000 7f20dbaa0640 0 -- 172.21.15.16:0/1405238160 >> [v2:172.21.15.19:6800/1509147557,v1:172.21.15.19:6801/1509147557] conn(0x55a12d9f7ff0 msgr2=0x55a12d9fa3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:22:49.217 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.176+0000 7f20daa9e640 0 -- 172.21.15.16:0/1405238160 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f20d40ec910 msgr2=0x7f20d40b63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:22:49.396 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.392+0000 7f20dd7999c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:22:49.396 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.392+0000 7f20dd7999c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:22:49.396 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.392+0000 7f20dd7999c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:22:49.396 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.392+0000 7f20dd7999c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:22:49.396 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.392+0000 7f20dd7999c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:22:49.396 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.392+0000 7f20dd7999c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:22:49.396 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.392+0000 7f20dd7999c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.397 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.396+0000 7f20dd7999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:49.397 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.396+0000 7f20dd7999c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.397 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.396+0000 7f20dd7999c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:22:49.397 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.396+0000 7f20dd7999c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.398 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.396+0000 7f20dd7999c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:22:49.398 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.396+0000 7f20dd7999c0 20 zone default found 2024-09-12T17:22:49.398 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.396+0000 7f20dd7999c0 4 Realm: () 2024-09-12T17:22:49.398 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.396+0000 7f20dd7999c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:22:49.398 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.396+0000 7f20dd7999c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:22:49.398 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.396+0000 7f20dd7999c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:22:49.398 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.396+0000 7f20dd7999c0 20 zonegroup default 2024-09-12T17:22:49.399 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.396+0000 7f20dd7999c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.399 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.396+0000 7f20dd7999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:49.399 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.396+0000 7f20dd7999c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.400 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.396+0000 7f20dd7999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:49.400 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.396+0000 7f20dd7999c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.400 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.400+0000 7f20dd7999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:49.401 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.400+0000 7f20dd7999c0 20 started sync module instance, tier type = 2024-09-12T17:22:49.401 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.400+0000 7f20dd7999c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:22:49.424 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.420+0000 7f20dd7999c0 20 add_watcher() i=0 2024-09-12T17:22:49.424 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.420+0000 7f20dd7999c0 20 add_watcher() i=1 2024-09-12T17:22:49.424 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.420+0000 7f20dd7999c0 20 add_watcher() i=2 2024-09-12T17:22:49.425 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.420+0000 7f20dd7999c0 20 add_watcher() i=3 2024-09-12T17:22:49.425 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.420+0000 7f20dd7999c0 20 add_watcher() i=4 2024-09-12T17:22:49.425 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.420+0000 7f20dd7999c0 20 add_watcher() i=5 2024-09-12T17:22:49.425 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.420+0000 7f20dd7999c0 20 add_watcher() i=6 2024-09-12T17:22:49.425 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.424+0000 7f20dd7999c0 20 add_watcher() i=7 2024-09-12T17:22:49.426 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.424+0000 7f20dd7999c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:22:49.430 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.428+0000 7f1f91fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:22:49.430 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.428+0000 7f20dd7999c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:22:49.431 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.428+0000 7f20dd7999c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:22:49.431 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.428+0000 7f20dd7999c0 5 note: GC not initialized 2024-09-12T17:22:49.431 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.428+0000 7f1f90fe1640 20 reqs_thread_entry: start 2024-09-12T17:22:49.431 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.428+0000 7f20dd7999c0 20 init_complete bucket index max shards: 1 2024-09-12T17:22:49.431 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.428+0000 7f20dd7999c0 20 Filter name: none 2024-09-12T17:22:49.432 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.428+0000 7f1f0a7fc640 20 reqs_thread_entry: start 2024-09-12T17:22:49.432 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.428+0000 7f20dd7999c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.433 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.432+0000 7f20dd7999c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:22:49.433 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.432+0000 7f20dd7999c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.434 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.432+0000 7f20dd7999c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T17:22:49.434 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.432+0000 7f20dd7999c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:22:49.434 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.432+0000 7f20dd7999c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.435 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.432+0000 7f20dd7999c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:22:49.435 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.432+0000 7f20dd7999c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.435 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.432+0000 7f20dd7999c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T17:22:49.435 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.432+0000 7f20dd7999c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:22:49.438 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.436+0000 7f1f91fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:22:49.446 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.444+0000 7f20dd7999c0 20 remove_watcher() i=0 2024-09-12T17:22:49.446 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.444+0000 7f20dd7999c0 2 removed watcher, disabling cache 2024-09-12T17:22:49.448 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.448+0000 7f20dd7999c0 20 remove_watcher() i=1 2024-09-12T17:22:49.450 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.448+0000 7f20dd7999c0 20 remove_watcher() i=2 2024-09-12T17:22:49.452 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.452+0000 7f20dd7999c0 20 remove_watcher() i=3 2024-09-12T17:22:49.455 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.452+0000 7f20dd7999c0 20 remove_watcher() i=4 2024-09-12T17:22:49.456 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.456+0000 7f20dd7999c0 20 remove_watcher() i=5 2024-09-12T17:22:49.458 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.456+0000 7f20dd7999c0 20 remove_watcher() i=6 2024-09-12T17:22:49.459 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.456+0000 7f20dd7999c0 20 remove_watcher() i=7 2024-09-12T17:22:49.501 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T17:22:49.534 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:22:49.534 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:22:49.581 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.580+0000 7f8b8a36b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.583 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.580+0000 7f8b8a36b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:49.583 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.580+0000 7f8b8a36b9c0 20 realm 2024-09-12T17:22:49.583 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.580+0000 7f8b8a36b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.583 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.580+0000 7f8b8a36b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:49.583 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.580+0000 7f8b8a36b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:22:49.583 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.580+0000 7f8b8a36b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.584 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.580+0000 7f8b8a36b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:49.584 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.580+0000 7f8b8a36b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.585 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.584+0000 7f8b8a36b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:22:49.585 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.584+0000 7f8b8a36b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:49.586 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.584+0000 7f8b8a36b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:22:49.587 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.584+0000 7f8b8a36b9c0 20 searching for the correct realm 2024-09-12T17:22:49.589 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.588+0000 7f8b88672640 0 -- 172.21.15.16:0/4100474884 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f8b7c04a060 msgr2=0x7f8b7c09b1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:22:49.805 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:49.804+0000 7f8b87670640 0 -- 172.21.15.16:0/4100474884 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f8b80039bd0 msgr2=0x7f8b80048960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:22:50.024 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.024+0000 7f8b8a36b9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:22:50.025 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.024+0000 7f8b8a36b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:22:50.025 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.024+0000 7f8b8a36b9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:22:50.025 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.024+0000 7f8b8a36b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:22:50.025 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.024+0000 7f8b8a36b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:22:50.025 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.024+0000 7f8b8a36b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:22:50.025 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.024+0000 7f8b8a36b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:50.026 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.024+0000 7f8b8a36b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:50.026 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.024+0000 7f8b8a36b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:50.026 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.024+0000 7f8b8a36b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:22:50.026 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.024+0000 7f8b8a36b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:50.027 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.024+0000 7f8b8a36b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:22:50.027 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.024+0000 7f8b8a36b9c0 20 zone default found 2024-09-12T17:22:50.027 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.024+0000 7f8b8a36b9c0 4 Realm: () 2024-09-12T17:22:50.027 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.024+0000 7f8b8a36b9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:22:50.027 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.024+0000 7f8b8a36b9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:22:50.027 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.024+0000 7f8b8a36b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:22:50.028 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.024+0000 7f8b8a36b9c0 20 zonegroup default 2024-09-12T17:22:50.028 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.024+0000 7f8b8a36b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:50.028 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.024+0000 7f8b8a36b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:50.028 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.024+0000 7f8b8a36b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:50.029 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.028+0000 7f8b8a36b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:50.029 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.028+0000 7f8b8a36b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:50.030 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.028+0000 7f8b8a36b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:22:50.030 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.028+0000 7f8b8a36b9c0 20 started sync module instance, tier type = 2024-09-12T17:22:50.030 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.028+0000 7f8b8a36b9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:22:50.055 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.052+0000 7f8b8a36b9c0 20 add_watcher() i=0 2024-09-12T17:22:50.055 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.052+0000 7f8b8a36b9c0 20 add_watcher() i=1 2024-09-12T17:22:50.055 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.052+0000 7f8b8a36b9c0 20 add_watcher() i=2 2024-09-12T17:22:50.056 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.052+0000 7f8b8a36b9c0 20 add_watcher() i=3 2024-09-12T17:22:50.056 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.052+0000 7f8b8a36b9c0 20 add_watcher() i=4 2024-09-12T17:22:50.056 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.052+0000 7f8b8a36b9c0 20 add_watcher() i=5 2024-09-12T17:22:50.056 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.052+0000 7f8b8a36b9c0 20 add_watcher() i=6 2024-09-12T17:22:50.058 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.056+0000 7f8b8a36b9c0 20 add_watcher() i=7 2024-09-12T17:22:50.058 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.056+0000 7f8b8a36b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:22:50.063 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.060+0000 7f8a3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:22:50.063 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.060+0000 7f8b8a36b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:22:50.064 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.060+0000 7f8b8a36b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:22:50.064 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.060+0000 7f8b8a36b9c0 5 note: GC not initialized 2024-09-12T17:22:50.065 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.064+0000 7f8a3cfe1640 20 reqs_thread_entry: start 2024-09-12T17:22:50.065 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.064+0000 7f8b8a36b9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:22:50.065 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.064+0000 7f8b8a36b9c0 20 Filter name: none 2024-09-12T17:22:50.065 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.064+0000 7f89b67fc640 20 reqs_thread_entry: start 2024-09-12T17:22:50.065 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.064+0000 7f8b8a36b9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:22:50.065 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.064+0000 7f8b8a36b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:50.066 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.064+0000 7f8b8a36b9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:22:50.066 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.064+0000 7f8b8a36b9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:22:50.066 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.064+0000 7f8b8a36b9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:22:50.066 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.064+0000 7f8b8a36b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 : miss 2024-09-12T17:22:50.066 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.064+0000 7f8b8a36b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:22:50.068 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.064+0000 7f8b8a36b9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T17:22:50.068 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.064+0000 7f8b8a36b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:22:50.068 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.064+0000 7f8b8a36b9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:22:50.068 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.064+0000 7f8b8a36b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:22:50.068 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.064+0000 7f8b8a36b9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:22:50.068 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.064+0000 7f8b8a36b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 2024-09-12T17:22:50.068 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.064+0000 7f8b8a36b9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.0 2024-09-12T17:22:50.069 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.064+0000 7f8b8a36b9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.0 2024-09-12T17:22:50.069 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.064+0000 7f8b8a36b9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.1 2024-09-12T17:22:50.069 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.064+0000 7f8b8a36b9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.1 2024-09-12T17:22:50.069 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.068+0000 7f8b8a36b9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.2 2024-09-12T17:22:50.069 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.068+0000 7f8b8a36b9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.2 2024-09-12T17:22:50.071 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.068+0000 7f8a3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:22:50.076 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.072+0000 7f8b8a36b9c0 20 remove_watcher() i=0 2024-09-12T17:22:50.076 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.072+0000 7f8b8a36b9c0 2 removed watcher, disabling cache 2024-09-12T17:22:50.078 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.076+0000 7f8b8a36b9c0 20 remove_watcher() i=1 2024-09-12T17:22:50.080 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.080+0000 7f8b8a36b9c0 20 remove_watcher() i=2 2024-09-12T17:22:50.083 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.080+0000 7f8b8a36b9c0 20 remove_watcher() i=3 2024-09-12T17:22:50.085 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.084+0000 7f8b8a36b9c0 20 remove_watcher() i=4 2024-09-12T17:22:50.087 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.084+0000 7f8b8a36b9c0 20 remove_watcher() i=5 2024-09-12T17:22:50.088 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.088+0000 7f8b8a36b9c0 20 remove_watcher() i=6 2024-09-12T17:22:50.091 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:22:50.088+0000 7f8b8a36b9c0 20 remove_watcher() i=7 2024-09-12T17:23:20.134 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T17:23:20.174 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:20.174 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:20.223 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.219+0000 7fe1c26ac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.225 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.223+0000 7fe1c26ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.225 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.223+0000 7fe1c26ac9c0 20 realm 2024-09-12T17:23:20.225 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.223+0000 7fe1c26ac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.225 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.223+0000 7fe1c26ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.225 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.223+0000 7fe1c26ac9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:20.225 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.223+0000 7fe1c26ac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.225 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.223+0000 7fe1c26ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.225 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.223+0000 7fe1c26ac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.226 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.223+0000 7fe1c26ac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:20.227 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.223+0000 7fe1c26ac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.228 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.227+0000 7fe1c26ac9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:20.229 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.227+0000 7fe1c26ac9c0 20 searching for the correct realm 2024-09-12T17:23:20.232 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.227+0000 7fe1c09b3640 0 -- 172.21.15.16:0/3064311245 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fe1b40dd420 msgr2=0x7fe1b40dd840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:20.445 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.443+0000 7fe1bf9b1640 0 -- 172.21.15.16:0/3064311245 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fe1b8018040 msgr2=0x7fe1b806a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:20.663 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.659+0000 7fe1c26ac9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:23:20.663 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.659+0000 7fe1c26ac9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:20.663 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.659+0000 7fe1c26ac9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:23:20.664 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.659+0000 7fe1c26ac9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:20.664 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.659+0000 7fe1c26ac9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:20.664 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.659+0000 7fe1c26ac9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:20.664 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.659+0000 7fe1c26ac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.664 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.663+0000 7fe1c26ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.664 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.663+0000 7fe1c26ac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.665 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.663+0000 7fe1c26ac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:20.665 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.663+0000 7fe1c26ac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.666 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.663+0000 7fe1c26ac9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:20.667 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.663+0000 7fe1c26ac9c0 20 zone default found 2024-09-12T17:23:20.667 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.663+0000 7fe1c26ac9c0 4 Realm: () 2024-09-12T17:23:20.667 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.663+0000 7fe1c26ac9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:23:20.667 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.663+0000 7fe1c26ac9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:23:20.667 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.663+0000 7fe1c26ac9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:20.667 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.663+0000 7fe1c26ac9c0 20 zonegroup default 2024-09-12T17:23:20.667 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.663+0000 7fe1c26ac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.667 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.663+0000 7fe1c26ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.668 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.663+0000 7fe1c26ac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.668 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.667+0000 7fe1c26ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.668 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.667+0000 7fe1c26ac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.669 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.667+0000 7fe1c26ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.669 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.667+0000 7fe1c26ac9c0 20 started sync module instance, tier type = 2024-09-12T17:23:20.669 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.667+0000 7fe1c26ac9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:23:20.694 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.691+0000 7fe1c26ac9c0 20 add_watcher() i=0 2024-09-12T17:23:20.694 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.691+0000 7fe1c26ac9c0 20 add_watcher() i=1 2024-09-12T17:23:20.694 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.691+0000 7fe1c26ac9c0 20 add_watcher() i=2 2024-09-12T17:23:20.694 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.691+0000 7fe1c26ac9c0 20 add_watcher() i=3 2024-09-12T17:23:20.694 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.691+0000 7fe1c26ac9c0 20 add_watcher() i=4 2024-09-12T17:23:20.694 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.691+0000 7fe1c26ac9c0 20 add_watcher() i=5 2024-09-12T17:23:20.694 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.691+0000 7fe1c26ac9c0 20 add_watcher() i=6 2024-09-12T17:23:20.696 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.695+0000 7fe1c26ac9c0 20 add_watcher() i=7 2024-09-12T17:23:20.696 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.695+0000 7fe1c26ac9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:20.700 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.699+0000 7fe076fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:20.701 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:20.701 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:20.701 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 note: GC not initialized 2024-09-12T17:23:20.702 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.699+0000 7fe075fdb640 20 reqs_thread_entry: start 2024-09-12T17:23:20.702 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:23:20.702 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 20 Filter name: none 2024-09-12T17:23:20.702 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.699+0000 7fdfe77fe640 20 reqs_thread_entry: start 2024-09-12T17:23:20.702 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:23:20.703 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.703 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:23:20.704 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:23:20.704 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:23:20.704 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 : miss 2024-09-12T17:23:20.704 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.704 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.703+0000 7fe1c26ac9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T17:23:20.705 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.703+0000 7fe1c26ac9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:23:20.705 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.703+0000 7fe1c26ac9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:23:20.705 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.703+0000 7fe1c26ac9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:23:20.705 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.703+0000 7fe1c26ac9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:23:20.705 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.703+0000 7fe1c26ac9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 2024-09-12T17:23:20.707 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.703+0000 7fe1c26ac9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:23:20.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.715+0000 7fe1c26ac9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:23:20.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.715+0000 7fe1c26ac9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:23:20.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.715+0000 7fe1c26ac9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:23:20.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.715+0000 7fe1c26ac9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17, ofs0, ns] 2024-09-12T17:23:20.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.715+0000 7fe0977fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431630 cookie 94135717430176 notifier 7829 bl.length()=827 2024-09-12T17:23:20.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.715+0000 7fe0977fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:23:20.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.715+0000 7fe0977fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:23:20.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.715+0000 7fe0977fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:23:20.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.715+0000 7fe1c26ac9c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): orig_sources= new_sources= 2024-09-12T17:23:20.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.715+0000 7fe1c26ac9c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): potential sources added=[] removed=[] 2024-09-12T17:23:20.718 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.715+0000 7fe1c26ac9c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): orig_dests= new_dests= 2024-09-12T17:23:20.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.715+0000 7fe1c26ac9c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): potential dests added=[] removed=[] 2024-09-12T17:23:20.723 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe1c26ac9c0 time 2024-09-12T17:23:20.725729+0000 2024-09-12T17:23:20.723 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:23:20.726 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:23:20.726 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fe1c5f862eb] 2024-09-12T17:23:20.726 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe1c5f8649f] 2024-09-12T17:23:20.727 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559dac3660c1] 2024-09-12T17:23:20.727 INFO:tasks.workunit.client.0.smithi016.stderr: 4: radosgw-admin(+0x14100ec) [0x559dacdbc0ec] 2024-09-12T17:23:20.727 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559dac37818d] 2024-09-12T17:23:20.727 INFO:tasks.workunit.client.0.smithi016.stderr: 6: main() 2024-09-12T17:23:20.727 INFO:tasks.workunit.client.0.smithi016.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe1c4decd90] 2024-09-12T17:23:20.727 INFO:tasks.workunit.client.0.smithi016.stderr: 8: __libc_start_main() 2024-09-12T17:23:20.727 INFO:tasks.workunit.client.0.smithi016.stderr: 9: _start() 2024-09-12T17:23:20.727 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.723+0000 7fe1c26ac9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe1c26ac9c0 time 2024-09-12T17:23:20.725729+0000 2024-09-12T17:23:20.727 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:23:20.727 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:20.727 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:23:20.727 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fe1c5f862eb] 2024-09-12T17:23:20.727 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe1c5f8649f] 2024-09-12T17:23:20.727 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559dac3660c1] 2024-09-12T17:23:20.727 INFO:tasks.workunit.client.0.smithi016.stderr: 4: radosgw-admin(+0x14100ec) [0x559dacdbc0ec] 2024-09-12T17:23:20.728 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559dac37818d] 2024-09-12T17:23:20.728 INFO:tasks.workunit.client.0.smithi016.stderr: 6: main() 2024-09-12T17:23:20.728 INFO:tasks.workunit.client.0.smithi016.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe1c4decd90] 2024-09-12T17:23:20.728 INFO:tasks.workunit.client.0.smithi016.stderr: 8: __libc_start_main() 2024-09-12T17:23:20.728 INFO:tasks.workunit.client.0.smithi016.stderr: 9: _start() 2024-09-12T17:23:20.728 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:20.728 INFO:tasks.workunit.client.0.smithi016.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:23:20.728 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7fe1c26ac9c0 thread_name:radosgw-admin 2024-09-12T17:23:20.730 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:23:20.730 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fe1c4e05520] 2024-09-12T17:23:20.730 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:23:20.730 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:23:20.731 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:23:20.731 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fe1c5f86345] 2024-09-12T17:23:20.731 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe1c5f8649f] 2024-09-12T17:23:20.731 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559dac3660c1] 2024-09-12T17:23:20.731 INFO:tasks.workunit.client.0.smithi016.stderr: 8: radosgw-admin(+0x14100ec) [0x559dacdbc0ec] 2024-09-12T17:23:20.731 INFO:tasks.workunit.client.0.smithi016.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559dac37818d] 2024-09-12T17:23:20.731 INFO:tasks.workunit.client.0.smithi016.stderr: 10: main() 2024-09-12T17:23:20.731 INFO:tasks.workunit.client.0.smithi016.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe1c4decd90] 2024-09-12T17:23:20.731 INFO:tasks.workunit.client.0.smithi016.stderr: 12: __libc_start_main() 2024-09-12T17:23:20.731 INFO:tasks.workunit.client.0.smithi016.stderr: 13: _start() 2024-09-12T17:23:20.731 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.727+0000 7fe1c26ac9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:23:20.731 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7fe1c26ac9c0 thread_name:radosgw-admin 2024-09-12T17:23:20.731 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:20.731 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:23:20.732 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fe1c4e05520] 2024-09-12T17:23:20.732 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:23:20.732 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:23:20.732 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:23:20.732 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fe1c5f86345] 2024-09-12T17:23:20.732 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe1c5f8649f] 2024-09-12T17:23:20.732 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559dac3660c1] 2024-09-12T17:23:20.732 INFO:tasks.workunit.client.0.smithi016.stderr: 8: radosgw-admin(+0x14100ec) [0x559dacdbc0ec] 2024-09-12T17:23:20.732 INFO:tasks.workunit.client.0.smithi016.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559dac37818d] 2024-09-12T17:23:20.732 INFO:tasks.workunit.client.0.smithi016.stderr: 10: main() 2024-09-12T17:23:20.732 INFO:tasks.workunit.client.0.smithi016.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe1c4decd90] 2024-09-12T17:23:20.732 INFO:tasks.workunit.client.0.smithi016.stderr: 12: __libc_start_main() 2024-09-12T17:23:20.732 INFO:tasks.workunit.client.0.smithi016.stderr: 13: _start() 2024-09-12T17:23:20.732 INFO:tasks.workunit.client.0.smithi016.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:23:20.733 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:20.733 INFO:tasks.workunit.client.0.smithi016.stderr:--- begin dump of recent events --- 2024-09-12T17:23:20.756 INFO:tasks.workunit.client.0.smithi016.stderr: -499> 2024-09-12T17:23:20.195+0000 7fe1c01b2640 10 monclient: _finish_hunting 0 2024-09-12T17:23:20.757 INFO:tasks.workunit.client.0.smithi016.stderr: -498> 2024-09-12T17:23:20.195+0000 7fe1c01b2640 1 monclient: found mon.noname-a 2024-09-12T17:23:20.757 INFO:tasks.workunit.client.0.smithi016.stderr: -497> 2024-09-12T17:23:20.195+0000 7fe1c01b2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:23:20.757 INFO:tasks.workunit.client.0.smithi016.stderr: -496> 2024-09-12T17:23:20.195+0000 7fe0ae60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:20.757 INFO:tasks.workunit.client.0.smithi016.stderr: -495> 2024-09-12T17:23:20.195+0000 7fe0ae60c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:23:20.757 INFO:tasks.workunit.client.0.smithi016.stderr: -494> 2024-09-12T17:23:20.195+0000 7fe0ae60c640 10 monclient: dump: 2024-09-12T17:23:20.757 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:23:20.757 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:23:20.757 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:20.757 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:20.758 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:20.758 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:20.758 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:23:20.758 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:23:20.758 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:23:20.758 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:20.758 INFO:tasks.workunit.client.0.smithi016.stderr: -493> 2024-09-12T17:23:20.195+0000 7fe0ae60c640 10 monclient: _finish_auth 0 2024-09-12T17:23:20.758 INFO:tasks.workunit.client.0.smithi016.stderr: -492> 2024-09-12T17:23:20.195+0000 7fe0ae60c640 10 monclient: _check_auth_tickets 2024-09-12T17:23:20.758 INFO:tasks.workunit.client.0.smithi016.stderr: -491> 2024-09-12T17:23:20.195+0000 7fe0ae60c640 10 monclient: handle_config config(0 keys) 2024-09-12T17:23:20.758 INFO:tasks.workunit.client.0.smithi016.stderr: -490> 2024-09-12T17:23:20.195+0000 7fe0ae60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:20.758 INFO:tasks.workunit.client.0.smithi016.stderr: -489> 2024-09-12T17:23:20.195+0000 7fe0ae60c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:23:20.758 INFO:tasks.workunit.client.0.smithi016.stderr: -488> 2024-09-12T17:23:20.195+0000 7fe0ae60c640 10 monclient: dump: 2024-09-12T17:23:20.758 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:23:20.759 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:23:20.759 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:20.759 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:20.759 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:20.759 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:20.759 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:23:20.759 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:23:20.759 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:23:20.759 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:20.759 INFO:tasks.workunit.client.0.smithi016.stderr: -487> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 monclient: authenticate success, global_id 8232 2024-09-12T17:23:20.759 INFO:tasks.workunit.client.0.smithi016.stderr: -486> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 10 monclient: get_monmap_and_config success 2024-09-12T17:23:20.759 INFO:tasks.workunit.client.0.smithi016.stderr: -485> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 4 set_mon_vals no callback set 2024-09-12T17:23:20.759 INFO:tasks.workunit.client.0.smithi016.stderr: -484> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 10 monclient: shutdown 2024-09-12T17:23:20.759 INFO:tasks.workunit.client.0.smithi016.stderr: -483> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 asok(0x559dadcec2b0) unregister_commands rotate-key 2024-09-12T17:23:20.760 INFO:tasks.workunit.client.0.smithi016.stderr: -482> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 10 monclient: build_initial_monmap 2024-09-12T17:23:20.760 INFO:tasks.workunit.client.0.smithi016.stderr: -481> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 1 build_initial for_mkfs: 0 2024-09-12T17:23:20.760 INFO:tasks.workunit.client.0.smithi016.stderr: -480> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 10 monclient: monmap: 2024-09-12T17:23:20.760 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:23:20.760 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:23:20.760 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:23:20.760 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:23:20.760 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:23:20.760 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:20.760 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:23:20.760 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:23:20.760 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:23:20.761 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:20.761 INFO:tasks.workunit.client.0.smithi016.stderr: -479> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadeffb90) adding auth protocol: cephx 2024-09-12T17:23:20.761 INFO:tasks.workunit.client.0.smithi016.stderr: -478> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadeffb90) adding auth protocol: cephx 2024-09-12T17:23:20.761 INFO:tasks.workunit.client.0.smithi016.stderr: -477> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadeffb90) adding auth protocol: cephx 2024-09-12T17:23:20.761 INFO:tasks.workunit.client.0.smithi016.stderr: -476> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadeffb90) adding con mode: secure 2024-09-12T17:23:20.761 INFO:tasks.workunit.client.0.smithi016.stderr: -475> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadeffb90) adding con mode: crc 2024-09-12T17:23:20.761 INFO:tasks.workunit.client.0.smithi016.stderr: -474> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadeffb90) adding con mode: secure 2024-09-12T17:23:20.761 INFO:tasks.workunit.client.0.smithi016.stderr: -473> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadeffb90) adding con mode: crc 2024-09-12T17:23:20.761 INFO:tasks.workunit.client.0.smithi016.stderr: -472> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadeffb90) adding con mode: secure 2024-09-12T17:23:20.761 INFO:tasks.workunit.client.0.smithi016.stderr: -471> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadeffb90) adding con mode: crc 2024-09-12T17:23:20.762 INFO:tasks.workunit.client.0.smithi016.stderr: -470> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadeffb90) adding con mode: crc 2024-09-12T17:23:20.762 INFO:tasks.workunit.client.0.smithi016.stderr: -469> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadeffb90) adding con mode: secure 2024-09-12T17:23:20.762 INFO:tasks.workunit.client.0.smithi016.stderr: -468> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadeffb90) adding con mode: crc 2024-09-12T17:23:20.762 INFO:tasks.workunit.client.0.smithi016.stderr: -467> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadeffb90) adding con mode: secure 2024-09-12T17:23:20.762 INFO:tasks.workunit.client.0.smithi016.stderr: -466> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadeffb90) adding con mode: crc 2024-09-12T17:23:20.762 INFO:tasks.workunit.client.0.smithi016.stderr: -465> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadeffb90) adding con mode: secure 2024-09-12T17:23:20.763 INFO:tasks.workunit.client.0.smithi016.stderr: -464> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.763 INFO:tasks.workunit.client.0.smithi016.stderr: -463> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 1 librados: starting msgr at 2024-09-12T17:23:20.763 INFO:tasks.workunit.client.0.smithi016.stderr: -462> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 1 librados: starting objecter 2024-09-12T17:23:20.763 INFO:tasks.workunit.client.0.smithi016.stderr: -461> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 asok(0x559dadcec2b0) register_command objecter_requests hook 0x559dadccf670 2024-09-12T17:23:20.763 INFO:tasks.workunit.client.0.smithi016.stderr: -460> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 1 librados: setting wanted keys 2024-09-12T17:23:20.763 INFO:tasks.workunit.client.0.smithi016.stderr: -459> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 1 librados: calling monclient init 2024-09-12T17:23:20.764 INFO:tasks.workunit.client.0.smithi016.stderr: -458> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 10 monclient: init 2024-09-12T17:23:20.764 INFO:tasks.workunit.client.0.smithi016.stderr: -457> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadef8f50) adding auth protocol: cephx 2024-09-12T17:23:20.764 INFO:tasks.workunit.client.0.smithi016.stderr: -456> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadef8f50) adding auth protocol: cephx 2024-09-12T17:23:20.764 INFO:tasks.workunit.client.0.smithi016.stderr: -455> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadef8f50) adding auth protocol: cephx 2024-09-12T17:23:20.764 INFO:tasks.workunit.client.0.smithi016.stderr: -454> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadef8f50) adding con mode: secure 2024-09-12T17:23:20.764 INFO:tasks.workunit.client.0.smithi016.stderr: -453> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadef8f50) adding con mode: crc 2024-09-12T17:23:20.764 INFO:tasks.workunit.client.0.smithi016.stderr: -452> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadef8f50) adding con mode: secure 2024-09-12T17:23:20.765 INFO:tasks.workunit.client.0.smithi016.stderr: -451> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadef8f50) adding con mode: crc 2024-09-12T17:23:20.765 INFO:tasks.workunit.client.0.smithi016.stderr: -450> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadef8f50) adding con mode: secure 2024-09-12T17:23:20.765 INFO:tasks.workunit.client.0.smithi016.stderr: -449> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadef8f50) adding con mode: crc 2024-09-12T17:23:20.765 INFO:tasks.workunit.client.0.smithi016.stderr: -448> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadef8f50) adding con mode: crc 2024-09-12T17:23:20.765 INFO:tasks.workunit.client.0.smithi016.stderr: -447> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadef8f50) adding con mode: secure 2024-09-12T17:23:20.765 INFO:tasks.workunit.client.0.smithi016.stderr: -446> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadef8f50) adding con mode: crc 2024-09-12T17:23:20.765 INFO:tasks.workunit.client.0.smithi016.stderr: -445> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadef8f50) adding con mode: secure 2024-09-12T17:23:20.765 INFO:tasks.workunit.client.0.smithi016.stderr: -444> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadef8f50) adding con mode: crc 2024-09-12T17:23:20.766 INFO:tasks.workunit.client.0.smithi016.stderr: -443> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadef8f50) adding con mode: secure 2024-09-12T17:23:20.766 INFO:tasks.workunit.client.0.smithi016.stderr: -442> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.766 INFO:tasks.workunit.client.0.smithi016.stderr: -441> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.766 INFO:tasks.workunit.client.0.smithi016.stderr: -440> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 asok(0x559dadcec2b0) register_command rotate-key hook 0x559dadef9098 2024-09-12T17:23:20.766 INFO:tasks.workunit.client.0.smithi016.stderr: -439> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:23:20.767 INFO:tasks.workunit.client.0.smithi016.stderr: -438> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:23:20.767 INFO:tasks.workunit.client.0.smithi016.stderr: -437> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 10 monclient(hunting): picked mon.noname-a con 0x559daddb45b0 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:23:20.767 INFO:tasks.workunit.client.0.smithi016.stderr: -436> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 10 monclient(hunting): picked mon.noname-c con 0x559dade41720 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:23:20.767 INFO:tasks.workunit.client.0.smithi016.stderr: -435> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 10 monclient(hunting): picked mon.noname-b con 0x559dade42070 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:23:20.767 INFO:tasks.workunit.client.0.smithi016.stderr: -434> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.768 INFO:tasks.workunit.client.0.smithi016.stderr: -433> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.768 INFO:tasks.workunit.client.0.smithi016.stderr: -432> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.768 INFO:tasks.workunit.client.0.smithi016.stderr: -431> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:23:20.768 INFO:tasks.workunit.client.0.smithi016.stderr: -430> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 10 monclient(hunting): authenticate will time out at 2518.175448s 2024-09-12T17:23:20.769 INFO:tasks.workunit.client.0.smithi016.stderr: -429> 2024-09-12T17:23:20.195+0000 7fe1c01b2640 10 monclient(hunting): get_auth_request con 0x559daddb45b0 auth_method 0 2024-09-12T17:23:20.769 INFO:tasks.workunit.client.0.smithi016.stderr: -428> 2024-09-12T17:23:20.195+0000 7fe1c01b2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:20.769 INFO:tasks.workunit.client.0.smithi016.stderr: -427> 2024-09-12T17:23:20.195+0000 7fe1c01b2640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:20.769 INFO:tasks.workunit.client.0.smithi016.stderr: -426> 2024-09-12T17:23:20.195+0000 7fe1c01b2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:20.769 INFO:tasks.workunit.client.0.smithi016.stderr: -425> 2024-09-12T17:23:20.195+0000 7fe1bf9b1640 10 monclient(hunting): get_auth_request con 0x559dade41720 auth_method 0 2024-09-12T17:23:20.769 INFO:tasks.workunit.client.0.smithi016.stderr: -424> 2024-09-12T17:23:20.195+0000 7fe1bf9b1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:20.769 INFO:tasks.workunit.client.0.smithi016.stderr: -423> 2024-09-12T17:23:20.195+0000 7fe1bf9b1640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:20.770 INFO:tasks.workunit.client.0.smithi016.stderr: -422> 2024-09-12T17:23:20.195+0000 7fe1bf9b1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:20.770 INFO:tasks.workunit.client.0.smithi016.stderr: -421> 2024-09-12T17:23:20.195+0000 7fe1c01b2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:20.770 INFO:tasks.workunit.client.0.smithi016.stderr: -420> 2024-09-12T17:23:20.195+0000 7fe1c01b2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:20.770 INFO:tasks.workunit.client.0.smithi016.stderr: -419> 2024-09-12T17:23:20.195+0000 7fe1c01b2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:20.770 INFO:tasks.workunit.client.0.smithi016.stderr: -418> 2024-09-12T17:23:20.195+0000 7fe1bf9b1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:20.770 INFO:tasks.workunit.client.0.smithi016.stderr: -417> 2024-09-12T17:23:20.195+0000 7fe1bf9b1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:20.770 INFO:tasks.workunit.client.0.smithi016.stderr: -416> 2024-09-12T17:23:20.195+0000 7fe1bf9b1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:20.770 INFO:tasks.workunit.client.0.smithi016.stderr: -415> 2024-09-12T17:23:20.195+0000 7fe1c01b2640 10 monclient(hunting): handle_auth_done global_id 8235 payload 824 2024-09-12T17:23:20.770 INFO:tasks.workunit.client.0.smithi016.stderr: -414> 2024-09-12T17:23:20.195+0000 7fe1c01b2640 10 monclient: _finish_hunting 0 2024-09-12T17:23:20.770 INFO:tasks.workunit.client.0.smithi016.stderr: -413> 2024-09-12T17:23:20.195+0000 7fe1c01b2640 1 monclient: found mon.noname-a 2024-09-12T17:23:20.770 INFO:tasks.workunit.client.0.smithi016.stderr: -412> 2024-09-12T17:23:20.195+0000 7fe1c01b2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:23:20.770 INFO:tasks.workunit.client.0.smithi016.stderr: -411> 2024-09-12T17:23:20.195+0000 7fe1c09b3640 10 monclient: get_auth_request con 0x559dade42070 auth_method 0 2024-09-12T17:23:20.771 INFO:tasks.workunit.client.0.smithi016.stderr: -410> 2024-09-12T17:23:20.199+0000 7fe0ace09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:20.771 INFO:tasks.workunit.client.0.smithi016.stderr: -409> 2024-09-12T17:23:20.199+0000 7fe0ace09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:23:20.771 INFO:tasks.workunit.client.0.smithi016.stderr: -408> 2024-09-12T17:23:20.199+0000 7fe0ace09640 10 monclient: dump: 2024-09-12T17:23:20.771 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:23:20.771 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:23:20.771 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:20.771 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:20.771 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:20.771 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:20.771 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:23:20.771 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:23:20.771 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:23:20.771 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:20.772 INFO:tasks.workunit.client.0.smithi016.stderr: -407> 2024-09-12T17:23:20.199+0000 7fe0ace09640 10 monclient: _finish_auth 0 2024-09-12T17:23:20.772 INFO:tasks.workunit.client.0.smithi016.stderr: -406> 2024-09-12T17:23:20.199+0000 7fe0ace09640 10 monclient: _check_auth_tickets 2024-09-12T17:23:20.772 INFO:tasks.workunit.client.0.smithi016.stderr: -405> 2024-09-12T17:23:20.199+0000 7fe0ace09640 10 monclient: handle_config config(0 keys) 2024-09-12T17:23:20.772 INFO:tasks.workunit.client.0.smithi016.stderr: -404> 2024-09-12T17:23:20.199+0000 7fe0ace09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:20.772 INFO:tasks.workunit.client.0.smithi016.stderr: -403> 2024-09-12T17:23:20.199+0000 7fe0ace09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:23:20.772 INFO:tasks.workunit.client.0.smithi016.stderr: -402> 2024-09-12T17:23:20.199+0000 7fe0ace09640 10 monclient: dump: 2024-09-12T17:23:20.772 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:23:20.772 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:23:20.772 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:20.772 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:20.772 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:20.772 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:20.772 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:23:20.773 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:23:20.773 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:23:20.773 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:20.773 INFO:tasks.workunit.client.0.smithi016.stderr: -401> 2024-09-12T17:23:20.199+0000 7fe0ae60c640 4 set_mon_vals no callback set 2024-09-12T17:23:20.773 INFO:tasks.workunit.client.0.smithi016.stderr: -400> 2024-09-12T17:23:20.199+0000 7fe1c26ac9c0 5 monclient: authenticate success, global_id 8235 2024-09-12T17:23:20.773 INFO:tasks.workunit.client.0.smithi016.stderr: -399> 2024-09-12T17:23:20.199+0000 7fe1c26ac9c0 10 monclient: _renew_subs 2024-09-12T17:23:20.773 INFO:tasks.workunit.client.0.smithi016.stderr: -398> 2024-09-12T17:23:20.199+0000 7fe1c26ac9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:23:20.773 INFO:tasks.workunit.client.0.smithi016.stderr: -397> 2024-09-12T17:23:20.199+0000 7fe1c26ac9c0 10 monclient: _renew_subs 2024-09-12T17:23:20.773 INFO:tasks.workunit.client.0.smithi016.stderr: -396> 2024-09-12T17:23:20.199+0000 7fe1c26ac9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:23:20.773 INFO:tasks.workunit.client.0.smithi016.stderr: -395> 2024-09-12T17:23:20.199+0000 7fe1c26ac9c0 1 librados: init done 2024-09-12T17:23:20.773 INFO:tasks.workunit.client.0.smithi016.stderr: -394> 2024-09-12T17:23:20.199+0000 7fe0ace09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:23:20.773 INFO:tasks.workunit.client.0.smithi016.stderr: -393> 2024-09-12T17:23:20.199+0000 7fe0ace09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:23:20.773 INFO:tasks.workunit.client.0.smithi016.stderr: -392> 2024-09-12T17:23:20.199+0000 7fe0ace09640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:23:20.773 INFO:tasks.workunit.client.0.smithi016.stderr: -391> 2024-09-12T17:23:20.199+0000 7fe1bf9b1640 10 monclient: get_auth_request con 0x7fe0a8070b10 auth_method 0 2024-09-12T17:23:20.774 INFO:tasks.workunit.client.0.smithi016.stderr: -390> 2024-09-12T17:23:20.199+0000 7fe1c09b3640 10 monclient: get_auth_request con 0x559dadf40fb0 auth_method 0 2024-09-12T17:23:20.774 INFO:tasks.workunit.client.0.smithi016.stderr: -389> 2024-09-12T17:23:20.203+0000 7fe1c01b2640 10 monclient: get_auth_request con 0x559dadf43df0 auth_method 0 2024-09-12T17:23:20.774 INFO:tasks.workunit.client.0.smithi016.stderr: -388> 2024-09-12T17:23:20.203+0000 7fe1bf9b1640 10 monclient: get_auth_request con 0x559dadf47fe0 auth_method 0 2024-09-12T17:23:20.774 INFO:tasks.workunit.client.0.smithi016.stderr: -387> 2024-09-12T17:23:20.207+0000 7fe1c09b3640 10 monclient: get_auth_request con 0x559dadf476a0 auth_method 0 2024-09-12T17:23:20.774 INFO:tasks.workunit.client.0.smithi016.stderr: -386> 2024-09-12T17:23:20.207+0000 7fe1c26ac9c0 10 monclient: build_initial_monmap 2024-09-12T17:23:20.774 INFO:tasks.workunit.client.0.smithi016.stderr: -385> 2024-09-12T17:23:20.207+0000 7fe1c26ac9c0 1 build_initial for_mkfs: 0 2024-09-12T17:23:20.774 INFO:tasks.workunit.client.0.smithi016.stderr: -384> 2024-09-12T17:23:20.207+0000 7fe1c26ac9c0 10 monclient: monmap: 2024-09-12T17:23:20.775 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:23:20.775 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:23:20.775 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:23:20.776 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:23:20.776 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:23:20.776 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:20.776 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:23:20.776 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:23:20.776 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:23:20.776 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:20.776 INFO:tasks.workunit.client.0.smithi016.stderr: -383> 2024-09-12T17:23:20.207+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4ff80) adding auth protocol: cephx 2024-09-12T17:23:20.776 INFO:tasks.workunit.client.0.smithi016.stderr: -382> 2024-09-12T17:23:20.207+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4ff80) adding auth protocol: cephx 2024-09-12T17:23:20.776 INFO:tasks.workunit.client.0.smithi016.stderr: -381> 2024-09-12T17:23:20.207+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4ff80) adding auth protocol: cephx 2024-09-12T17:23:20.776 INFO:tasks.workunit.client.0.smithi016.stderr: -380> 2024-09-12T17:23:20.207+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4ff80) adding con mode: secure 2024-09-12T17:23:20.776 INFO:tasks.workunit.client.0.smithi016.stderr: -379> 2024-09-12T17:23:20.207+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4ff80) adding con mode: crc 2024-09-12T17:23:20.776 INFO:tasks.workunit.client.0.smithi016.stderr: -378> 2024-09-12T17:23:20.207+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4ff80) adding con mode: secure 2024-09-12T17:23:20.777 INFO:tasks.workunit.client.0.smithi016.stderr: -377> 2024-09-12T17:23:20.207+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4ff80) adding con mode: crc 2024-09-12T17:23:20.777 INFO:tasks.workunit.client.0.smithi016.stderr: -376> 2024-09-12T17:23:20.207+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4ff80) adding con mode: secure 2024-09-12T17:23:20.777 INFO:tasks.workunit.client.0.smithi016.stderr: -375> 2024-09-12T17:23:20.207+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4ff80) adding con mode: crc 2024-09-12T17:23:20.777 INFO:tasks.workunit.client.0.smithi016.stderr: -374> 2024-09-12T17:23:20.207+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4ff80) adding con mode: crc 2024-09-12T17:23:20.777 INFO:tasks.workunit.client.0.smithi016.stderr: -373> 2024-09-12T17:23:20.207+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4ff80) adding con mode: secure 2024-09-12T17:23:20.777 INFO:tasks.workunit.client.0.smithi016.stderr: -372> 2024-09-12T17:23:20.207+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4ff80) adding con mode: crc 2024-09-12T17:23:20.777 INFO:tasks.workunit.client.0.smithi016.stderr: -371> 2024-09-12T17:23:20.207+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4ff80) adding con mode: secure 2024-09-12T17:23:20.777 INFO:tasks.workunit.client.0.smithi016.stderr: -370> 2024-09-12T17:23:20.207+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4ff80) adding con mode: crc 2024-09-12T17:23:20.777 INFO:tasks.workunit.client.0.smithi016.stderr: -369> 2024-09-12T17:23:20.207+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4ff80) adding con mode: secure 2024-09-12T17:23:20.777 INFO:tasks.workunit.client.0.smithi016.stderr: -368> 2024-09-12T17:23:20.207+0000 7fe1c26ac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.777 INFO:tasks.workunit.client.0.smithi016.stderr: -367> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 5 asok(0x559dadcec2b0) register_command objecter_requests cmddesc objecter_requests hook 0x559dadf53970 EEXIST 2024-09-12T17:23:20.777 INFO:tasks.workunit.client.0.smithi016.stderr: -366> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 10 monclient: init 2024-09-12T17:23:20.777 INFO:tasks.workunit.client.0.smithi016.stderr: -365> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4eec8) adding auth protocol: cephx 2024-09-12T17:23:20.778 INFO:tasks.workunit.client.0.smithi016.stderr: -364> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4eec8) adding auth protocol: cephx 2024-09-12T17:23:20.778 INFO:tasks.workunit.client.0.smithi016.stderr: -363> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4eec8) adding auth protocol: cephx 2024-09-12T17:23:20.778 INFO:tasks.workunit.client.0.smithi016.stderr: -362> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4eec8) adding con mode: secure 2024-09-12T17:23:20.778 INFO:tasks.workunit.client.0.smithi016.stderr: -361> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4eec8) adding con mode: crc 2024-09-12T17:23:20.778 INFO:tasks.workunit.client.0.smithi016.stderr: -360> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4eec8) adding con mode: secure 2024-09-12T17:23:20.778 INFO:tasks.workunit.client.0.smithi016.stderr: -359> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4eec8) adding con mode: crc 2024-09-12T17:23:20.778 INFO:tasks.workunit.client.0.smithi016.stderr: -358> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4eec8) adding con mode: secure 2024-09-12T17:23:20.778 INFO:tasks.workunit.client.0.smithi016.stderr: -357> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4eec8) adding con mode: crc 2024-09-12T17:23:20.778 INFO:tasks.workunit.client.0.smithi016.stderr: -356> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4eec8) adding con mode: crc 2024-09-12T17:23:20.778 INFO:tasks.workunit.client.0.smithi016.stderr: -355> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4eec8) adding con mode: secure 2024-09-12T17:23:20.778 INFO:tasks.workunit.client.0.smithi016.stderr: -354> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4eec8) adding con mode: crc 2024-09-12T17:23:20.778 INFO:tasks.workunit.client.0.smithi016.stderr: -353> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4eec8) adding con mode: secure 2024-09-12T17:23:20.778 INFO:tasks.workunit.client.0.smithi016.stderr: -352> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4eec8) adding con mode: crc 2024-09-12T17:23:20.779 INFO:tasks.workunit.client.0.smithi016.stderr: -351> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4eec8) adding con mode: secure 2024-09-12T17:23:20.779 INFO:tasks.workunit.client.0.smithi016.stderr: -350> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.779 INFO:tasks.workunit.client.0.smithi016.stderr: -349> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.779 INFO:tasks.workunit.client.0.smithi016.stderr: -348> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 5 asok(0x559dadcec2b0) register_command rotate-key cmddesc rotate-key hook 0x559dadf4f010 EEXIST 2024-09-12T17:23:20.779 INFO:tasks.workunit.client.0.smithi016.stderr: -347> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:23:20.779 INFO:tasks.workunit.client.0.smithi016.stderr: -346> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:23:20.779 INFO:tasks.workunit.client.0.smithi016.stderr: -345> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 10 monclient(hunting): picked mon.noname-c con 0x559dadf77b20 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:23:20.779 INFO:tasks.workunit.client.0.smithi016.stderr: -344> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 10 monclient(hunting): picked mon.noname-a con 0x559dadf77450 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:23:20.779 INFO:tasks.workunit.client.0.smithi016.stderr: -343> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 10 monclient(hunting): picked mon.noname-b con 0x559dadf75e30 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:23:20.779 INFO:tasks.workunit.client.0.smithi016.stderr: -342> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.779 INFO:tasks.workunit.client.0.smithi016.stderr: -341> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.779 INFO:tasks.workunit.client.0.smithi016.stderr: -340> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.780 INFO:tasks.workunit.client.0.smithi016.stderr: -339> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:23:20.780 INFO:tasks.workunit.client.0.smithi016.stderr: -338> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 10 monclient(hunting): authenticate will time out at 2518.188843s 2024-09-12T17:23:20.780 INFO:tasks.workunit.client.0.smithi016.stderr: -337> 2024-09-12T17:23:20.211+0000 7fe1c09b3640 10 monclient(hunting): get_auth_request con 0x559dadf77450 auth_method 0 2024-09-12T17:23:20.780 INFO:tasks.workunit.client.0.smithi016.stderr: -336> 2024-09-12T17:23:20.211+0000 7fe1c09b3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:20.780 INFO:tasks.workunit.client.0.smithi016.stderr: -335> 2024-09-12T17:23:20.211+0000 7fe1c09b3640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:20.780 INFO:tasks.workunit.client.0.smithi016.stderr: -334> 2024-09-12T17:23:20.211+0000 7fe1c09b3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:20.780 INFO:tasks.workunit.client.0.smithi016.stderr: -333> 2024-09-12T17:23:20.211+0000 7fe1bf9b1640 10 monclient(hunting): get_auth_request con 0x559dadf77b20 auth_method 0 2024-09-12T17:23:20.780 INFO:tasks.workunit.client.0.smithi016.stderr: -332> 2024-09-12T17:23:20.211+0000 7fe1bf9b1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:20.780 INFO:tasks.workunit.client.0.smithi016.stderr: -331> 2024-09-12T17:23:20.211+0000 7fe1bf9b1640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:20.780 INFO:tasks.workunit.client.0.smithi016.stderr: -330> 2024-09-12T17:23:20.211+0000 7fe1bf9b1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:20.780 INFO:tasks.workunit.client.0.smithi016.stderr: -329> 2024-09-12T17:23:20.211+0000 7fe1c09b3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:20.780 INFO:tasks.workunit.client.0.smithi016.stderr: -328> 2024-09-12T17:23:20.211+0000 7fe1c09b3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:20.781 INFO:tasks.workunit.client.0.smithi016.stderr: -327> 2024-09-12T17:23:20.211+0000 7fe1c09b3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:20.781 INFO:tasks.workunit.client.0.smithi016.stderr: -326> 2024-09-12T17:23:20.211+0000 7fe1bf9b1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:20.781 INFO:tasks.workunit.client.0.smithi016.stderr: -325> 2024-09-12T17:23:20.211+0000 7fe1bf9b1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:20.781 INFO:tasks.workunit.client.0.smithi016.stderr: -324> 2024-09-12T17:23:20.211+0000 7fe1bf9b1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:20.781 INFO:tasks.workunit.client.0.smithi016.stderr: -323> 2024-09-12T17:23:20.211+0000 7fe1c01b2640 10 monclient(hunting): get_auth_request con 0x559dadf75e30 auth_method 0 2024-09-12T17:23:20.781 INFO:tasks.workunit.client.0.smithi016.stderr: -322> 2024-09-12T17:23:20.211+0000 7fe1c01b2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:20.781 INFO:tasks.workunit.client.0.smithi016.stderr: -321> 2024-09-12T17:23:20.211+0000 7fe1c01b2640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:20.781 INFO:tasks.workunit.client.0.smithi016.stderr: -320> 2024-09-12T17:23:20.211+0000 7fe1c01b2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:20.781 INFO:tasks.workunit.client.0.smithi016.stderr: -319> 2024-09-12T17:23:20.211+0000 7fe1c09b3640 10 monclient(hunting): handle_auth_done global_id 8238 payload 824 2024-09-12T17:23:20.782 INFO:tasks.workunit.client.0.smithi016.stderr: -318> 2024-09-12T17:23:20.211+0000 7fe1c09b3640 10 monclient: _finish_hunting 0 2024-09-12T17:23:20.782 INFO:tasks.workunit.client.0.smithi016.stderr: -317> 2024-09-12T17:23:20.211+0000 7fe1c09b3640 1 monclient: found mon.noname-a 2024-09-12T17:23:20.782 INFO:tasks.workunit.client.0.smithi016.stderr: -316> 2024-09-12T17:23:20.211+0000 7fe1c09b3640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:23:20.782 INFO:tasks.workunit.client.0.smithi016.stderr: -315> 2024-09-12T17:23:20.211+0000 7fe0a5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:20.782 INFO:tasks.workunit.client.0.smithi016.stderr: -314> 2024-09-12T17:23:20.211+0000 7fe0a5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:23:20.782 INFO:tasks.workunit.client.0.smithi016.stderr: -313> 2024-09-12T17:23:20.211+0000 7fe0a5ffb640 10 monclient: dump: 2024-09-12T17:23:20.782 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:23:20.782 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:23:20.783 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:20.783 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:20.783 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:20.783 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:20.783 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:23:20.783 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:23:20.783 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:23:20.783 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:20.783 INFO:tasks.workunit.client.0.smithi016.stderr: -312> 2024-09-12T17:23:20.211+0000 7fe0a5ffb640 10 monclient: _finish_auth 0 2024-09-12T17:23:20.783 INFO:tasks.workunit.client.0.smithi016.stderr: -311> 2024-09-12T17:23:20.211+0000 7fe0a5ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:23:20.783 INFO:tasks.workunit.client.0.smithi016.stderr: -310> 2024-09-12T17:23:20.211+0000 7fe0a5ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:23:20.783 INFO:tasks.workunit.client.0.smithi016.stderr: -309> 2024-09-12T17:23:20.211+0000 7fe0a5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:20.783 INFO:tasks.workunit.client.0.smithi016.stderr: -308> 2024-09-12T17:23:20.211+0000 7fe0a5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:23:20.783 INFO:tasks.workunit.client.0.smithi016.stderr: -307> 2024-09-12T17:23:20.211+0000 7fe0a5ffb640 10 monclient: dump: 2024-09-12T17:23:20.784 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:23:20.784 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:23:20.784 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:20.784 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:20.784 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:20.784 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:20.784 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:23:20.784 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:23:20.784 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:23:20.784 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:20.784 INFO:tasks.workunit.client.0.smithi016.stderr: -306> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 5 monclient: authenticate success, global_id 8238 2024-09-12T17:23:20.784 INFO:tasks.workunit.client.0.smithi016.stderr: -305> 2024-09-12T17:23:20.211+0000 7fe1c11b4640 4 set_mon_vals no callback set 2024-09-12T17:23:20.784 INFO:tasks.workunit.client.0.smithi016.stderr: -304> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 10 monclient: _renew_subs 2024-09-12T17:23:20.785 INFO:tasks.workunit.client.0.smithi016.stderr: -303> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:23:20.785 INFO:tasks.workunit.client.0.smithi016.stderr: -302> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 10 monclient: _renew_subs 2024-09-12T17:23:20.785 INFO:tasks.workunit.client.0.smithi016.stderr: -301> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:23:20.785 INFO:tasks.workunit.client.0.smithi016.stderr: -300> 2024-09-12T17:23:20.211+0000 7fe0a5ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:23:20.785 INFO:tasks.workunit.client.0.smithi016.stderr: -299> 2024-09-12T17:23:20.211+0000 7fe0a5ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:23:20.785 INFO:tasks.workunit.client.0.smithi016.stderr: -298> 2024-09-12T17:23:20.211+0000 7fe0a5ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:23:20.785 INFO:tasks.workunit.client.0.smithi016.stderr: -297> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 10 monclient: get_monmap_and_config 2024-09-12T17:23:20.785 INFO:tasks.workunit.client.0.smithi016.stderr: -296> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 10 monclient: build_initial_monmap 2024-09-12T17:23:20.785 INFO:tasks.workunit.client.0.smithi016.stderr: -295> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 1 build_initial for_mkfs: 0 2024-09-12T17:23:20.785 INFO:tasks.workunit.client.0.smithi016.stderr: -294> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 10 monclient: monmap: 2024-09-12T17:23:20.785 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:23:20.785 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:23:20.785 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:23:20.785 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:23:20.786 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:23:20.786 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:20.786 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:23:20.786 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:23:20.786 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:23:20.786 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:20.786 INFO:tasks.workunit.client.0.smithi016.stderr: -293> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf97490) adding auth protocol: cephx 2024-09-12T17:23:20.786 INFO:tasks.workunit.client.0.smithi016.stderr: -292> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf97490) adding auth protocol: cephx 2024-09-12T17:23:20.786 INFO:tasks.workunit.client.0.smithi016.stderr: -291> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf97490) adding auth protocol: cephx 2024-09-12T17:23:20.786 INFO:tasks.workunit.client.0.smithi016.stderr: -290> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf97490) adding con mode: secure 2024-09-12T17:23:20.786 INFO:tasks.workunit.client.0.smithi016.stderr: -289> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf97490) adding con mode: crc 2024-09-12T17:23:20.787 INFO:tasks.workunit.client.0.smithi016.stderr: -288> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf97490) adding con mode: secure 2024-09-12T17:23:20.787 INFO:tasks.workunit.client.0.smithi016.stderr: -287> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf97490) adding con mode: crc 2024-09-12T17:23:20.787 INFO:tasks.workunit.client.0.smithi016.stderr: -286> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf97490) adding con mode: secure 2024-09-12T17:23:20.787 INFO:tasks.workunit.client.0.smithi016.stderr: -285> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf97490) adding con mode: crc 2024-09-12T17:23:20.787 INFO:tasks.workunit.client.0.smithi016.stderr: -284> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf97490) adding con mode: crc 2024-09-12T17:23:20.787 INFO:tasks.workunit.client.0.smithi016.stderr: -283> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf97490) adding con mode: secure 2024-09-12T17:23:20.787 INFO:tasks.workunit.client.0.smithi016.stderr: -282> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf97490) adding con mode: crc 2024-09-12T17:23:20.787 INFO:tasks.workunit.client.0.smithi016.stderr: -281> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf97490) adding con mode: secure 2024-09-12T17:23:20.787 INFO:tasks.workunit.client.0.smithi016.stderr: -280> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf97490) adding con mode: crc 2024-09-12T17:23:20.787 INFO:tasks.workunit.client.0.smithi016.stderr: -279> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf97490) adding con mode: secure 2024-09-12T17:23:20.787 INFO:tasks.workunit.client.0.smithi016.stderr: -278> 2024-09-12T17:23:20.215+0000 7fe1bf9b1640 10 monclient: get_auth_request con 0x7fe098070a20 auth_method 0 2024-09-12T17:23:20.787 INFO:tasks.workunit.client.0.smithi016.stderr: -277> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.787 INFO:tasks.workunit.client.0.smithi016.stderr: -276> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 10 monclient: init 2024-09-12T17:23:20.787 INFO:tasks.workunit.client.0.smithi016.stderr: -275> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c6dc0) adding auth protocol: cephx 2024-09-12T17:23:20.788 INFO:tasks.workunit.client.0.smithi016.stderr: -274> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c6dc0) adding auth protocol: cephx 2024-09-12T17:23:20.788 INFO:tasks.workunit.client.0.smithi016.stderr: -273> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c6dc0) adding auth protocol: cephx 2024-09-12T17:23:20.788 INFO:tasks.workunit.client.0.smithi016.stderr: -272> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c6dc0) adding con mode: secure 2024-09-12T17:23:20.788 INFO:tasks.workunit.client.0.smithi016.stderr: -271> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c6dc0) adding con mode: crc 2024-09-12T17:23:20.788 INFO:tasks.workunit.client.0.smithi016.stderr: -270> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c6dc0) adding con mode: secure 2024-09-12T17:23:20.788 INFO:tasks.workunit.client.0.smithi016.stderr: -269> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c6dc0) adding con mode: crc 2024-09-12T17:23:20.788 INFO:tasks.workunit.client.0.smithi016.stderr: -268> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c6dc0) adding con mode: secure 2024-09-12T17:23:20.788 INFO:tasks.workunit.client.0.smithi016.stderr: -267> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c6dc0) adding con mode: crc 2024-09-12T17:23:20.788 INFO:tasks.workunit.client.0.smithi016.stderr: -266> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c6dc0) adding con mode: crc 2024-09-12T17:23:20.788 INFO:tasks.workunit.client.0.smithi016.stderr: -265> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c6dc0) adding con mode: secure 2024-09-12T17:23:20.788 INFO:tasks.workunit.client.0.smithi016.stderr: -264> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c6dc0) adding con mode: crc 2024-09-12T17:23:20.788 INFO:tasks.workunit.client.0.smithi016.stderr: -263> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c6dc0) adding con mode: secure 2024-09-12T17:23:20.788 INFO:tasks.workunit.client.0.smithi016.stderr: -262> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c6dc0) adding con mode: crc 2024-09-12T17:23:20.789 INFO:tasks.workunit.client.0.smithi016.stderr: -261> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c6dc0) adding con mode: secure 2024-09-12T17:23:20.789 INFO:tasks.workunit.client.0.smithi016.stderr: -260> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.789 INFO:tasks.workunit.client.0.smithi016.stderr: -259> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.789 INFO:tasks.workunit.client.0.smithi016.stderr: -258> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 asok(0x559dadcec2b0) register_command rotate-key cmddesc rotate-key hook 0x7fff631c6f08 EEXIST 2024-09-12T17:23:20.789 INFO:tasks.workunit.client.0.smithi016.stderr: -257> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:23:20.789 INFO:tasks.workunit.client.0.smithi016.stderr: -256> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:23:20.789 INFO:tasks.workunit.client.0.smithi016.stderr: -255> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 10 monclient(hunting): picked mon.noname-c con 0x559dadfcb9a0 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:23:20.789 INFO:tasks.workunit.client.0.smithi016.stderr: -254> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 10 monclient(hunting): picked mon.noname-a con 0x559dadfc6e40 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:23:20.789 INFO:tasks.workunit.client.0.smithi016.stderr: -253> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 10 monclient(hunting): picked mon.noname-b con 0x559dadfbd5b0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:23:20.789 INFO:tasks.workunit.client.0.smithi016.stderr: -252> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.789 INFO:tasks.workunit.client.0.smithi016.stderr: -251> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.789 INFO:tasks.workunit.client.0.smithi016.stderr: -250> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.790 INFO:tasks.workunit.client.0.smithi016.stderr: -249> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:23:20.790 INFO:tasks.workunit.client.0.smithi016.stderr: -248> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 10 monclient(hunting): authenticate will time out at 2518.193332s 2024-09-12T17:23:20.790 INFO:tasks.workunit.client.0.smithi016.stderr: -247> 2024-09-12T17:23:20.215+0000 7fe1c09b3640 10 monclient(hunting): get_auth_request con 0x559dadfc6e40 auth_method 0 2024-09-12T17:23:20.790 INFO:tasks.workunit.client.0.smithi016.stderr: -246> 2024-09-12T17:23:20.215+0000 7fe1c09b3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:20.790 INFO:tasks.workunit.client.0.smithi016.stderr: -245> 2024-09-12T17:23:20.215+0000 7fe1c09b3640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:20.790 INFO:tasks.workunit.client.0.smithi016.stderr: -244> 2024-09-12T17:23:20.215+0000 7fe1c09b3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:20.790 INFO:tasks.workunit.client.0.smithi016.stderr: -243> 2024-09-12T17:23:20.215+0000 7fe1bf9b1640 10 monclient(hunting): get_auth_request con 0x559dadfcb9a0 auth_method 0 2024-09-12T17:23:20.790 INFO:tasks.workunit.client.0.smithi016.stderr: -242> 2024-09-12T17:23:20.215+0000 7fe1bf9b1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:20.790 INFO:tasks.workunit.client.0.smithi016.stderr: -241> 2024-09-12T17:23:20.215+0000 7fe1bf9b1640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:20.790 INFO:tasks.workunit.client.0.smithi016.stderr: -240> 2024-09-12T17:23:20.215+0000 7fe1bf9b1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:20.790 INFO:tasks.workunit.client.0.smithi016.stderr: -239> 2024-09-12T17:23:20.215+0000 7fe1c09b3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:20.790 INFO:tasks.workunit.client.0.smithi016.stderr: -238> 2024-09-12T17:23:20.215+0000 7fe1c09b3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:20.790 INFO:tasks.workunit.client.0.smithi016.stderr: -237> 2024-09-12T17:23:20.215+0000 7fe1c09b3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:20.790 INFO:tasks.workunit.client.0.smithi016.stderr: -236> 2024-09-12T17:23:20.215+0000 7fe1bf9b1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:20.791 INFO:tasks.workunit.client.0.smithi016.stderr: -235> 2024-09-12T17:23:20.215+0000 7fe1bf9b1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:20.791 INFO:tasks.workunit.client.0.smithi016.stderr: -234> 2024-09-12T17:23:20.215+0000 7fe1bf9b1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:20.791 INFO:tasks.workunit.client.0.smithi016.stderr: -233> 2024-09-12T17:23:20.215+0000 7fe1c01b2640 10 monclient(hunting): get_auth_request con 0x559dadfbd5b0 auth_method 0 2024-09-12T17:23:20.791 INFO:tasks.workunit.client.0.smithi016.stderr: -232> 2024-09-12T17:23:20.215+0000 7fe1c01b2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:20.791 INFO:tasks.workunit.client.0.smithi016.stderr: -231> 2024-09-12T17:23:20.215+0000 7fe1c01b2640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:20.791 INFO:tasks.workunit.client.0.smithi016.stderr: -230> 2024-09-12T17:23:20.215+0000 7fe1c01b2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:20.791 INFO:tasks.workunit.client.0.smithi016.stderr: -229> 2024-09-12T17:23:20.215+0000 7fe1c09b3640 10 monclient(hunting): handle_auth_done global_id 8241 payload 274 2024-09-12T17:23:20.791 INFO:tasks.workunit.client.0.smithi016.stderr: -228> 2024-09-12T17:23:20.215+0000 7fe1c09b3640 10 monclient: _finish_hunting 0 2024-09-12T17:23:20.791 INFO:tasks.workunit.client.0.smithi016.stderr: -227> 2024-09-12T17:23:20.215+0000 7fe1c09b3640 1 monclient: found mon.noname-a 2024-09-12T17:23:20.791 INFO:tasks.workunit.client.0.smithi016.stderr: -226> 2024-09-12T17:23:20.215+0000 7fe1c09b3640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:23:20.791 INFO:tasks.workunit.client.0.smithi016.stderr: -225> 2024-09-12T17:23:20.215+0000 7fe0977fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:20.791 INFO:tasks.workunit.client.0.smithi016.stderr: -224> 2024-09-12T17:23:20.215+0000 7fe0977fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:23:20.791 INFO:tasks.workunit.client.0.smithi016.stderr: -223> 2024-09-12T17:23:20.215+0000 7fe0977fe640 10 monclient: dump: 2024-09-12T17:23:20.791 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:23:20.792 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:23:20.792 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:20.792 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:20.792 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:20.792 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:20.792 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:23:20.792 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:23:20.792 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:23:20.792 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:20.792 INFO:tasks.workunit.client.0.smithi016.stderr: -222> 2024-09-12T17:23:20.215+0000 7fe0977fe640 10 monclient: _finish_auth 0 2024-09-12T17:23:20.792 INFO:tasks.workunit.client.0.smithi016.stderr: -221> 2024-09-12T17:23:20.215+0000 7fe0977fe640 10 monclient: _check_auth_tickets 2024-09-12T17:23:20.792 INFO:tasks.workunit.client.0.smithi016.stderr: -220> 2024-09-12T17:23:20.215+0000 7fe0977fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:23:20.793 INFO:tasks.workunit.client.0.smithi016.stderr: -219> 2024-09-12T17:23:20.215+0000 7fe0977fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:20.793 INFO:tasks.workunit.client.0.smithi016.stderr: -218> 2024-09-12T17:23:20.215+0000 7fe0977fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:23:20.793 INFO:tasks.workunit.client.0.smithi016.stderr: -217> 2024-09-12T17:23:20.215+0000 7fe0977fe640 10 monclient: dump: 2024-09-12T17:23:20.793 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:23:20.793 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:23:20.793 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:20.793 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:20.793 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:20.793 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:20.793 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:23:20.793 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:23:20.793 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:23:20.793 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:20.793 INFO:tasks.workunit.client.0.smithi016.stderr: -216> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 monclient: authenticate success, global_id 8241 2024-09-12T17:23:20.794 INFO:tasks.workunit.client.0.smithi016.stderr: -215> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 10 monclient: get_monmap_and_config success 2024-09-12T17:23:20.794 INFO:tasks.workunit.client.0.smithi016.stderr: -214> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 4 set_mon_vals no callback set 2024-09-12T17:23:20.794 INFO:tasks.workunit.client.0.smithi016.stderr: -213> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 10 monclient: shutdown 2024-09-12T17:23:20.794 INFO:tasks.workunit.client.0.smithi016.stderr: -212> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 10 monclient: build_initial_monmap 2024-09-12T17:23:20.794 INFO:tasks.workunit.client.0.smithi016.stderr: -211> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 1 build_initial for_mkfs: 0 2024-09-12T17:23:20.794 INFO:tasks.workunit.client.0.smithi016.stderr: -210> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 10 monclient: monmap: 2024-09-12T17:23:20.794 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:23:20.794 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:23:20.794 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:23:20.794 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:23:20.794 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:23:20.794 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:20.794 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:23:20.794 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:23:20.795 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:23:20.795 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:20.795 INFO:tasks.workunit.client.0.smithi016.stderr: -209> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadfc7b90) adding auth protocol: cephx 2024-09-12T17:23:20.795 INFO:tasks.workunit.client.0.smithi016.stderr: -208> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadfc7b90) adding auth protocol: cephx 2024-09-12T17:23:20.795 INFO:tasks.workunit.client.0.smithi016.stderr: -207> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadfc7b90) adding auth protocol: cephx 2024-09-12T17:23:20.795 INFO:tasks.workunit.client.0.smithi016.stderr: -206> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadfc7b90) adding con mode: secure 2024-09-12T17:23:20.795 INFO:tasks.workunit.client.0.smithi016.stderr: -205> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadfc7b90) adding con mode: crc 2024-09-12T17:23:20.795 INFO:tasks.workunit.client.0.smithi016.stderr: -204> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadfc7b90) adding con mode: secure 2024-09-12T17:23:20.795 INFO:tasks.workunit.client.0.smithi016.stderr: -203> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadfc7b90) adding con mode: crc 2024-09-12T17:23:20.795 INFO:tasks.workunit.client.0.smithi016.stderr: -202> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadfc7b90) adding con mode: secure 2024-09-12T17:23:20.795 INFO:tasks.workunit.client.0.smithi016.stderr: -201> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadfc7b90) adding con mode: crc 2024-09-12T17:23:20.796 INFO:tasks.workunit.client.0.smithi016.stderr: -200> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadfc7b90) adding con mode: crc 2024-09-12T17:23:20.796 INFO:tasks.workunit.client.0.smithi016.stderr: -199> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadfc7b90) adding con mode: secure 2024-09-12T17:23:20.796 INFO:tasks.workunit.client.0.smithi016.stderr: -198> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadfc7b90) adding con mode: crc 2024-09-12T17:23:20.796 INFO:tasks.workunit.client.0.smithi016.stderr: -197> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadfc7b90) adding con mode: secure 2024-09-12T17:23:20.796 INFO:tasks.workunit.client.0.smithi016.stderr: -196> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadfc7b90) adding con mode: crc 2024-09-12T17:23:20.796 INFO:tasks.workunit.client.0.smithi016.stderr: -195> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadfc7b90) adding con mode: secure 2024-09-12T17:23:20.796 INFO:tasks.workunit.client.0.smithi016.stderr: -194> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.796 INFO:tasks.workunit.client.0.smithi016.stderr: -193> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 1 librados: starting msgr at 2024-09-12T17:23:20.796 INFO:tasks.workunit.client.0.smithi016.stderr: -192> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 1 librados: starting objecter 2024-09-12T17:23:20.796 INFO:tasks.workunit.client.0.smithi016.stderr: -191> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 asok(0x559dadcec2b0) register_command objecter_requests cmddesc objecter_requests hook 0x559dadfc8bd0 EEXIST 2024-09-12T17:23:20.796 INFO:tasks.workunit.client.0.smithi016.stderr: -190> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 1 librados: setting wanted keys 2024-09-12T17:23:20.797 INFO:tasks.workunit.client.0.smithi016.stderr: -189> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 1 librados: calling monclient init 2024-09-12T17:23:20.797 INFO:tasks.workunit.client.0.smithi016.stderr: -188> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 10 monclient: init 2024-09-12T17:23:20.797 INFO:tasks.workunit.client.0.smithi016.stderr: -187> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf79940) adding auth protocol: cephx 2024-09-12T17:23:20.797 INFO:tasks.workunit.client.0.smithi016.stderr: -186> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf79940) adding auth protocol: cephx 2024-09-12T17:23:20.797 INFO:tasks.workunit.client.0.smithi016.stderr: -185> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf79940) adding auth protocol: cephx 2024-09-12T17:23:20.797 INFO:tasks.workunit.client.0.smithi016.stderr: -184> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf79940) adding con mode: secure 2024-09-12T17:23:20.797 INFO:tasks.workunit.client.0.smithi016.stderr: -183> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf79940) adding con mode: crc 2024-09-12T17:23:20.797 INFO:tasks.workunit.client.0.smithi016.stderr: -182> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf79940) adding con mode: secure 2024-09-12T17:23:20.797 INFO:tasks.workunit.client.0.smithi016.stderr: -181> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf79940) adding con mode: crc 2024-09-12T17:23:20.797 INFO:tasks.workunit.client.0.smithi016.stderr: -180> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf79940) adding con mode: secure 2024-09-12T17:23:20.798 INFO:tasks.workunit.client.0.smithi016.stderr: -179> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf79940) adding con mode: crc 2024-09-12T17:23:20.798 INFO:tasks.workunit.client.0.smithi016.stderr: -178> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf79940) adding con mode: crc 2024-09-12T17:23:20.798 INFO:tasks.workunit.client.0.smithi016.stderr: -177> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf79940) adding con mode: secure 2024-09-12T17:23:20.798 INFO:tasks.workunit.client.0.smithi016.stderr: -176> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf79940) adding con mode: crc 2024-09-12T17:23:20.798 INFO:tasks.workunit.client.0.smithi016.stderr: -175> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf79940) adding con mode: secure 2024-09-12T17:23:20.798 INFO:tasks.workunit.client.0.smithi016.stderr: -174> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf79940) adding con mode: crc 2024-09-12T17:23:20.798 INFO:tasks.workunit.client.0.smithi016.stderr: -173> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf79940) adding con mode: secure 2024-09-12T17:23:20.798 INFO:tasks.workunit.client.0.smithi016.stderr: -172> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.798 INFO:tasks.workunit.client.0.smithi016.stderr: -171> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.798 INFO:tasks.workunit.client.0.smithi016.stderr: -170> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 asok(0x559dadcec2b0) register_command rotate-key cmddesc rotate-key hook 0x559dadf79a88 EEXIST 2024-09-12T17:23:20.798 INFO:tasks.workunit.client.0.smithi016.stderr: -169> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:23:20.798 INFO:tasks.workunit.client.0.smithi016.stderr: -168> 2024-09-12T17:23:20.219+0000 7fe1c26ac9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:23:20.798 INFO:tasks.workunit.client.0.smithi016.stderr: -167> 2024-09-12T17:23:20.219+0000 7fe1c26ac9c0 10 monclient(hunting): picked mon.noname-b con 0x559dadfbd5b0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:23:20.799 INFO:tasks.workunit.client.0.smithi016.stderr: -166> 2024-09-12T17:23:20.219+0000 7fe1c26ac9c0 10 monclient(hunting): picked mon.noname-c con 0x559dadfc6e40 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:23:20.799 INFO:tasks.workunit.client.0.smithi016.stderr: -165> 2024-09-12T17:23:20.219+0000 7fe1c26ac9c0 10 monclient(hunting): picked mon.noname-a con 0x559dadfcb9a0 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:23:20.799 INFO:tasks.workunit.client.0.smithi016.stderr: -164> 2024-09-12T17:23:20.219+0000 7fe1c26ac9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.799 INFO:tasks.workunit.client.0.smithi016.stderr: -163> 2024-09-12T17:23:20.219+0000 7fe1c26ac9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.799 INFO:tasks.workunit.client.0.smithi016.stderr: -162> 2024-09-12T17:23:20.219+0000 7fe1c26ac9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.799 INFO:tasks.workunit.client.0.smithi016.stderr: -161> 2024-09-12T17:23:20.219+0000 7fe1c26ac9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:23:20.799 INFO:tasks.workunit.client.0.smithi016.stderr: -160> 2024-09-12T17:23:20.219+0000 7fe1c26ac9c0 10 monclient(hunting): authenticate will time out at 2518.196077s 2024-09-12T17:23:20.799 INFO:tasks.workunit.client.0.smithi016.stderr: -159> 2024-09-12T17:23:20.219+0000 7fe1c01b2640 10 monclient(hunting): get_auth_request con 0x559dadfcb9a0 auth_method 0 2024-09-12T17:23:20.799 INFO:tasks.workunit.client.0.smithi016.stderr: -158> 2024-09-12T17:23:20.219+0000 7fe1c01b2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:20.799 INFO:tasks.workunit.client.0.smithi016.stderr: -157> 2024-09-12T17:23:20.219+0000 7fe1c01b2640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:20.799 INFO:tasks.workunit.client.0.smithi016.stderr: -156> 2024-09-12T17:23:20.219+0000 7fe1c01b2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:20.800 INFO:tasks.workunit.client.0.smithi016.stderr: -155> 2024-09-12T17:23:20.219+0000 7fe1c09b3640 10 monclient(hunting): get_auth_request con 0x559dadfc6e40 auth_method 0 2024-09-12T17:23:20.800 INFO:tasks.workunit.client.0.smithi016.stderr: -154> 2024-09-12T17:23:20.219+0000 7fe1c09b3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:20.800 INFO:tasks.workunit.client.0.smithi016.stderr: -153> 2024-09-12T17:23:20.219+0000 7fe1c09b3640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:20.800 INFO:tasks.workunit.client.0.smithi016.stderr: -152> 2024-09-12T17:23:20.219+0000 7fe1c09b3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:20.800 INFO:tasks.workunit.client.0.smithi016.stderr: -151> 2024-09-12T17:23:20.219+0000 7fe1c01b2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:20.800 INFO:tasks.workunit.client.0.smithi016.stderr: -150> 2024-09-12T17:23:20.219+0000 7fe1c01b2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:20.800 INFO:tasks.workunit.client.0.smithi016.stderr: -149> 2024-09-12T17:23:20.219+0000 7fe1c01b2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:20.800 INFO:tasks.workunit.client.0.smithi016.stderr: -148> 2024-09-12T17:23:20.219+0000 7fe1c09b3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:20.800 INFO:tasks.workunit.client.0.smithi016.stderr: -147> 2024-09-12T17:23:20.219+0000 7fe1c09b3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:20.800 INFO:tasks.workunit.client.0.smithi016.stderr: -146> 2024-09-12T17:23:20.219+0000 7fe1c09b3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:20.800 INFO:tasks.workunit.client.0.smithi016.stderr: -145> 2024-09-12T17:23:20.219+0000 7fe1c09b3640 10 monclient(hunting): handle_auth_done global_id 7829 payload 824 2024-09-12T17:23:20.801 INFO:tasks.workunit.client.0.smithi016.stderr: -144> 2024-09-12T17:23:20.219+0000 7fe1c09b3640 10 monclient: _finish_hunting 0 2024-09-12T17:23:20.801 INFO:tasks.workunit.client.0.smithi016.stderr: -143> 2024-09-12T17:23:20.219+0000 7fe1c09b3640 1 monclient: found mon.noname-c 2024-09-12T17:23:20.801 INFO:tasks.workunit.client.0.smithi016.stderr: -142> 2024-09-12T17:23:20.219+0000 7fe1c09b3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:23:20.801 INFO:tasks.workunit.client.0.smithi016.stderr: -141> 2024-09-12T17:23:20.219+0000 7fe1bf9b1640 10 monclient: get_auth_request con 0x559dadfbd5b0 auth_method 0 2024-09-12T17:23:20.801 INFO:tasks.workunit.client.0.smithi016.stderr: -140> 2024-09-12T17:23:20.219+0000 7fe095ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:20.801 INFO:tasks.workunit.client.0.smithi016.stderr: -139> 2024-09-12T17:23:20.219+0000 7fe095ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:23:20.801 INFO:tasks.workunit.client.0.smithi016.stderr: -138> 2024-09-12T17:23:20.219+0000 7fe095ffb640 10 monclient: dump: 2024-09-12T17:23:20.801 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:23:20.801 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:23:20.801 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:20.801 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:20.802 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:20.802 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:20.802 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:23:20.802 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:23:20.802 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:23:20.802 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:20.802 INFO:tasks.workunit.client.0.smithi016.stderr: -137> 2024-09-12T17:23:20.219+0000 7fe095ffb640 10 monclient: _finish_auth 0 2024-09-12T17:23:20.802 INFO:tasks.workunit.client.0.smithi016.stderr: -136> 2024-09-12T17:23:20.219+0000 7fe095ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:23:20.802 INFO:tasks.workunit.client.0.smithi016.stderr: -135> 2024-09-12T17:23:20.219+0000 7fe095ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:23:20.802 INFO:tasks.workunit.client.0.smithi016.stderr: -134> 2024-09-12T17:23:20.219+0000 7fe095ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:20.802 INFO:tasks.workunit.client.0.smithi016.stderr: -133> 2024-09-12T17:23:20.219+0000 7fe095ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:23:20.803 INFO:tasks.workunit.client.0.smithi016.stderr: -132> 2024-09-12T17:23:20.219+0000 7fe095ffb640 10 monclient: dump: 2024-09-12T17:23:20.803 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:23:20.803 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:23:20.803 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:20.803 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:20.803 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:20.803 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:20.803 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:23:20.803 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:23:20.803 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:23:20.803 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:20.803 INFO:tasks.workunit.client.0.smithi016.stderr: -131> 2024-09-12T17:23:20.219+0000 7fe1c26ac9c0 5 monclient: authenticate success, global_id 7829 2024-09-12T17:23:20.803 INFO:tasks.workunit.client.0.smithi016.stderr: -130> 2024-09-12T17:23:20.219+0000 7fe0977fe640 4 set_mon_vals no callback set 2024-09-12T17:23:20.804 INFO:tasks.workunit.client.0.smithi016.stderr: -129> 2024-09-12T17:23:20.219+0000 7fe1c26ac9c0 10 monclient: _renew_subs 2024-09-12T17:23:20.804 INFO:tasks.workunit.client.0.smithi016.stderr: -128> 2024-09-12T17:23:20.219+0000 7fe1c26ac9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:23:20.804 INFO:tasks.workunit.client.0.smithi016.stderr: -127> 2024-09-12T17:23:20.219+0000 7fe1c26ac9c0 10 monclient: _renew_subs 2024-09-12T17:23:20.804 INFO:tasks.workunit.client.0.smithi016.stderr: -126> 2024-09-12T17:23:20.219+0000 7fe1c26ac9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:23:20.804 INFO:tasks.workunit.client.0.smithi016.stderr: -125> 2024-09-12T17:23:20.219+0000 7fe1c26ac9c0 1 librados: init done 2024-09-12T17:23:20.804 INFO:tasks.workunit.client.0.smithi016.stderr: -124> 2024-09-12T17:23:20.219+0000 7fe1c26ac9c0 5 asok(0x559dadcec2b0) register_command cr dump hook 0x559dadfc7a08 2024-09-12T17:23:20.804 INFO:tasks.workunit.client.0.smithi016.stderr: -123> 2024-09-12T17:23:20.219+0000 7fe1c26ac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.804 INFO:tasks.workunit.client.0.smithi016.stderr: -122> 2024-09-12T17:23:20.219+0000 7fe095ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:23:20.804 INFO:tasks.workunit.client.0.smithi016.stderr: -121> 2024-09-12T17:23:20.219+0000 7fe095ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:23:20.804 INFO:tasks.workunit.client.0.smithi016.stderr: -120> 2024-09-12T17:23:20.219+0000 7fe095ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:23:20.804 INFO:tasks.workunit.client.0.smithi016.stderr: -119> 2024-09-12T17:23:20.219+0000 7fe1bf9b1640 10 monclient: get_auth_request con 0x7fe088070ae0 auth_method 0 2024-09-12T17:23:20.804 INFO:tasks.workunit.client.0.smithi016.stderr: -118> 2024-09-12T17:23:20.219+0000 7fe1c01b2640 10 monclient: get_auth_request con 0x559dadfe52d0 auth_method 0 2024-09-12T17:23:20.805 INFO:tasks.workunit.client.0.smithi016.stderr: -117> 2024-09-12T17:23:20.223+0000 7fe1c26ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.805 INFO:tasks.workunit.client.0.smithi016.stderr: -116> 2024-09-12T17:23:20.223+0000 7fe1c26ac9c0 20 realm 2024-09-12T17:23:20.805 INFO:tasks.workunit.client.0.smithi016.stderr: -115> 2024-09-12T17:23:20.223+0000 7fe1c26ac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.805 INFO:tasks.workunit.client.0.smithi016.stderr: -114> 2024-09-12T17:23:20.223+0000 7fe1c26ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.805 INFO:tasks.workunit.client.0.smithi016.stderr: -113> 2024-09-12T17:23:20.223+0000 7fe1c26ac9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:20.805 INFO:tasks.workunit.client.0.smithi016.stderr: -112> 2024-09-12T17:23:20.223+0000 7fe1c26ac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.805 INFO:tasks.workunit.client.0.smithi016.stderr: -111> 2024-09-12T17:23:20.223+0000 7fe1c26ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.805 INFO:tasks.workunit.client.0.smithi016.stderr: -110> 2024-09-12T17:23:20.223+0000 7fe1c26ac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.805 INFO:tasks.workunit.client.0.smithi016.stderr: -109> 2024-09-12T17:23:20.223+0000 7fe1bf9b1640 10 monclient: get_auth_request con 0x559dadfe9550 auth_method 0 2024-09-12T17:23:20.805 INFO:tasks.workunit.client.0.smithi016.stderr: -108> 2024-09-12T17:23:20.223+0000 7fe1c26ac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:20.805 INFO:tasks.workunit.client.0.smithi016.stderr: -107> 2024-09-12T17:23:20.223+0000 7fe1c26ac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.805 INFO:tasks.workunit.client.0.smithi016.stderr: -106> 2024-09-12T17:23:20.223+0000 7fe1c09b3640 10 monclient: get_auth_request con 0x559dadfecdb0 auth_method 0 2024-09-12T17:23:20.805 INFO:tasks.workunit.client.0.smithi016.stderr: -105> 2024-09-12T17:23:20.227+0000 7fe1c26ac9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:20.805 INFO:tasks.workunit.client.0.smithi016.stderr: -104> 2024-09-12T17:23:20.227+0000 7fe1c26ac9c0 20 searching for the correct realm 2024-09-12T17:23:20.806 INFO:tasks.workunit.client.0.smithi016.stderr: -103> 2024-09-12T17:23:20.227+0000 7fe1c01b2640 10 monclient: get_auth_request con 0x559dadff1b70 auth_method 0 2024-09-12T17:23:20.806 INFO:tasks.workunit.client.0.smithi016.stderr: -102> 2024-09-12T17:23:20.227+0000 7fe1bf9b1640 10 monclient: get_auth_request con 0x7fe1b0008070 auth_method 0 2024-09-12T17:23:20.806 INFO:tasks.workunit.client.0.smithi016.stderr: -101> 2024-09-12T17:23:20.227+0000 7fe1c09b3640 10 monclient: get_auth_request con 0x7fe1b40dd420 auth_method 0 2024-09-12T17:23:20.806 INFO:tasks.workunit.client.0.smithi016.stderr: -100> 2024-09-12T17:23:20.227+0000 7fe1c09b3640 0 -- 172.21.15.16:0/3064311245 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fe1b40dd420 msgr2=0x7fe1b40dd840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:20.806 INFO:tasks.workunit.client.0.smithi016.stderr: -99> 2024-09-12T17:23:20.431+0000 7fe1c09b3640 10 monclient: get_auth_request con 0x7fe1b40dd420 auth_method 0 2024-09-12T17:23:20.806 INFO:tasks.workunit.client.0.smithi016.stderr: -98> 2024-09-12T17:23:20.435+0000 7fe1c01b2640 10 monclient: get_auth_request con 0x7fe1b8025030 auth_method 0 2024-09-12T17:23:20.806 INFO:tasks.workunit.client.0.smithi016.stderr: -97> 2024-09-12T17:23:20.443+0000 7fe1bf9b1640 0 -- 172.21.15.16:0/3064311245 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fe1b8018040 msgr2=0x7fe1b806a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:20.806 INFO:tasks.workunit.client.0.smithi016.stderr: -96> 2024-09-12T17:23:20.443+0000 7fe1bf9b1640 10 monclient: get_auth_request con 0x7fe1b8018040 auth_method 0 2024-09-12T17:23:20.806 INFO:tasks.workunit.client.0.smithi016.stderr: -95> 2024-09-12T17:23:20.647+0000 7fe1bf9b1640 10 monclient: get_auth_request con 0x7fe1b8018040 auth_method 0 2024-09-12T17:23:20.806 INFO:tasks.workunit.client.0.smithi016.stderr: -94> 2024-09-12T17:23:20.659+0000 7fe1c26ac9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:23:20.806 INFO:tasks.workunit.client.0.smithi016.stderr: -93> 2024-09-12T17:23:20.659+0000 7fe1c26ac9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:20.806 INFO:tasks.workunit.client.0.smithi016.stderr: -92> 2024-09-12T17:23:20.659+0000 7fe1c26ac9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:23:20.806 INFO:tasks.workunit.client.0.smithi016.stderr: -91> 2024-09-12T17:23:20.659+0000 7fe1c26ac9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:20.807 INFO:tasks.workunit.client.0.smithi016.stderr: -90> 2024-09-12T17:23:20.659+0000 7fe1c26ac9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:20.807 INFO:tasks.workunit.client.0.smithi016.stderr: -89> 2024-09-12T17:23:20.659+0000 7fe1c26ac9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:20.807 INFO:tasks.workunit.client.0.smithi016.stderr: -88> 2024-09-12T17:23:20.659+0000 7fe1c26ac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.807 INFO:tasks.workunit.client.0.smithi016.stderr: -87> 2024-09-12T17:23:20.663+0000 7fe1c26ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.807 INFO:tasks.workunit.client.0.smithi016.stderr: -86> 2024-09-12T17:23:20.663+0000 7fe1c26ac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.807 INFO:tasks.workunit.client.0.smithi016.stderr: -85> 2024-09-12T17:23:20.663+0000 7fe1c26ac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:20.807 INFO:tasks.workunit.client.0.smithi016.stderr: -84> 2024-09-12T17:23:20.663+0000 7fe1c26ac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.807 INFO:tasks.workunit.client.0.smithi016.stderr: -83> 2024-09-12T17:23:20.663+0000 7fe1c26ac9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:20.807 INFO:tasks.workunit.client.0.smithi016.stderr: -82> 2024-09-12T17:23:20.663+0000 7fe1c26ac9c0 20 zone default found 2024-09-12T17:23:20.807 INFO:tasks.workunit.client.0.smithi016.stderr: -81> 2024-09-12T17:23:20.663+0000 7fe1c26ac9c0 4 Realm: () 2024-09-12T17:23:20.807 INFO:tasks.workunit.client.0.smithi016.stderr: -80> 2024-09-12T17:23:20.663+0000 7fe1c26ac9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:23:20.807 INFO:tasks.workunit.client.0.smithi016.stderr: -79> 2024-09-12T17:23:20.663+0000 7fe1c26ac9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:23:20.807 INFO:tasks.workunit.client.0.smithi016.stderr: -78> 2024-09-12T17:23:20.663+0000 7fe1c26ac9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:20.807 INFO:tasks.workunit.client.0.smithi016.stderr: -77> 2024-09-12T17:23:20.663+0000 7fe1c26ac9c0 20 zonegroup default 2024-09-12T17:23:20.807 INFO:tasks.workunit.client.0.smithi016.stderr: -76> 2024-09-12T17:23:20.663+0000 7fe1c26ac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.808 INFO:tasks.workunit.client.0.smithi016.stderr: -75> 2024-09-12T17:23:20.663+0000 7fe1c26ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.808 INFO:tasks.workunit.client.0.smithi016.stderr: -74> 2024-09-12T17:23:20.663+0000 7fe1c26ac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.808 INFO:tasks.workunit.client.0.smithi016.stderr: -73> 2024-09-12T17:23:20.667+0000 7fe1c26ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.808 INFO:tasks.workunit.client.0.smithi016.stderr: -72> 2024-09-12T17:23:20.667+0000 7fe1c26ac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.808 INFO:tasks.workunit.client.0.smithi016.stderr: -71> 2024-09-12T17:23:20.667+0000 7fe1c26ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.808 INFO:tasks.workunit.client.0.smithi016.stderr: -70> 2024-09-12T17:23:20.667+0000 7fe1c26ac9c0 20 started sync module instance, tier type = 2024-09-12T17:23:20.808 INFO:tasks.workunit.client.0.smithi016.stderr: -69> 2024-09-12T17:23:20.667+0000 7fe1c26ac9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:23:20.808 INFO:tasks.workunit.client.0.smithi016.stderr: -68> 2024-09-12T17:23:20.691+0000 7fe1c26ac9c0 20 add_watcher() i=0 2024-09-12T17:23:20.808 INFO:tasks.workunit.client.0.smithi016.stderr: -67> 2024-09-12T17:23:20.691+0000 7fe1c26ac9c0 20 add_watcher() i=1 2024-09-12T17:23:20.808 INFO:tasks.workunit.client.0.smithi016.stderr: -66> 2024-09-12T17:23:20.691+0000 7fe1c26ac9c0 20 add_watcher() i=2 2024-09-12T17:23:20.808 INFO:tasks.workunit.client.0.smithi016.stderr: -65> 2024-09-12T17:23:20.691+0000 7fe1c26ac9c0 20 add_watcher() i=3 2024-09-12T17:23:20.809 INFO:tasks.workunit.client.0.smithi016.stderr: -64> 2024-09-12T17:23:20.691+0000 7fe1c26ac9c0 20 add_watcher() i=4 2024-09-12T17:23:20.809 INFO:tasks.workunit.client.0.smithi016.stderr: -63> 2024-09-12T17:23:20.691+0000 7fe1c26ac9c0 20 add_watcher() i=5 2024-09-12T17:23:20.809 INFO:tasks.workunit.client.0.smithi016.stderr: -62> 2024-09-12T17:23:20.691+0000 7fe1c26ac9c0 20 add_watcher() i=6 2024-09-12T17:23:20.809 INFO:tasks.workunit.client.0.smithi016.stderr: -61> 2024-09-12T17:23:20.695+0000 7fe1c26ac9c0 20 add_watcher() i=7 2024-09-12T17:23:20.809 INFO:tasks.workunit.client.0.smithi016.stderr: -60> 2024-09-12T17:23:20.695+0000 7fe1c26ac9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:20.809 INFO:tasks.workunit.client.0.smithi016.stderr: -59> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c7290) adding auth protocol: cephx 2024-09-12T17:23:20.809 INFO:tasks.workunit.client.0.smithi016.stderr: -58> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c7290) adding auth protocol: cephx 2024-09-12T17:23:20.809 INFO:tasks.workunit.client.0.smithi016.stderr: -57> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c7290) adding auth protocol: cephx 2024-09-12T17:23:20.809 INFO:tasks.workunit.client.0.smithi016.stderr: -56> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c7290) adding con mode: secure 2024-09-12T17:23:20.809 INFO:tasks.workunit.client.0.smithi016.stderr: -55> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c7290) adding con mode: crc 2024-09-12T17:23:20.809 INFO:tasks.workunit.client.0.smithi016.stderr: -54> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c7290) adding con mode: secure 2024-09-12T17:23:20.809 INFO:tasks.workunit.client.0.smithi016.stderr: -53> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c7290) adding con mode: crc 2024-09-12T17:23:20.809 INFO:tasks.workunit.client.0.smithi016.stderr: -52> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c7290) adding con mode: secure 2024-09-12T17:23:20.810 INFO:tasks.workunit.client.0.smithi016.stderr: -51> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c7290) adding con mode: crc 2024-09-12T17:23:20.810 INFO:tasks.workunit.client.0.smithi016.stderr: -50> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c7290) adding con mode: crc 2024-09-12T17:23:20.810 INFO:tasks.workunit.client.0.smithi016.stderr: -49> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c7290) adding con mode: secure 2024-09-12T17:23:20.810 INFO:tasks.workunit.client.0.smithi016.stderr: -48> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c7290) adding con mode: crc 2024-09-12T17:23:20.810 INFO:tasks.workunit.client.0.smithi016.stderr: -47> 2024-09-12T17:23:20.699+0000 7fe076fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:20.810 INFO:tasks.workunit.client.0.smithi016.stderr: -46> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c7290) adding con mode: secure 2024-09-12T17:23:20.810 INFO:tasks.workunit.client.0.smithi016.stderr: -45> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c7290) adding con mode: crc 2024-09-12T17:23:20.810 INFO:tasks.workunit.client.0.smithi016.stderr: -44> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c7290) adding con mode: secure 2024-09-12T17:23:20.810 INFO:tasks.workunit.client.0.smithi016.stderr: -43> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.810 INFO:tasks.workunit.client.0.smithi016.stderr: -42> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:20.810 INFO:tasks.workunit.client.0.smithi016.stderr: -41> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:20.810 INFO:tasks.workunit.client.0.smithi016.stderr: -40> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 asok(0x559dadcec2b0) register_command cache list hook 0x559dadfc5070 2024-09-12T17:23:20.810 INFO:tasks.workunit.client.0.smithi016.stderr: -39> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 asok(0x559dadcec2b0) register_command cache inspect hook 0x559dadfc5070 2024-09-12T17:23:20.810 INFO:tasks.workunit.client.0.smithi016.stderr: -38> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 asok(0x559dadcec2b0) register_command cache erase hook 0x559dadfc5070 2024-09-12T17:23:20.810 INFO:tasks.workunit.client.0.smithi016.stderr: -37> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 asok(0x559dadcec2b0) register_command cache zap hook 0x559dadfc5070 2024-09-12T17:23:20.811 INFO:tasks.workunit.client.0.smithi016.stderr: -36> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 note: GC not initialized 2024-09-12T17:23:20.811 INFO:tasks.workunit.client.0.smithi016.stderr: -35> 2024-09-12T17:23:20.699+0000 7fe075fdb640 20 reqs_thread_entry: start 2024-09-12T17:23:20.811 INFO:tasks.workunit.client.0.smithi016.stderr: -34> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 asok(0x559dadcec2b0) register_command sync trace show hook 0x7fe1b4004300 2024-09-12T17:23:20.811 INFO:tasks.workunit.client.0.smithi016.stderr: -33> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 asok(0x559dadcec2b0) register_command sync trace history hook 0x7fe1b4004300 2024-09-12T17:23:20.811 INFO:tasks.workunit.client.0.smithi016.stderr: -32> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 asok(0x559dadcec2b0) register_command sync trace active hook 0x7fe1b4004300 2024-09-12T17:23:20.811 INFO:tasks.workunit.client.0.smithi016.stderr: -31> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 asok(0x559dadcec2b0) register_command sync trace active_short hook 0x7fe1b4004300 2024-09-12T17:23:20.811 INFO:tasks.workunit.client.0.smithi016.stderr: -30> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:23:20.811 INFO:tasks.workunit.client.0.smithi016.stderr: -29> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 20 Filter name: none 2024-09-12T17:23:20.811 INFO:tasks.workunit.client.0.smithi016.stderr: -28> 2024-09-12T17:23:20.699+0000 7fdfe77fe640 20 reqs_thread_entry: start 2024-09-12T17:23:20.811 INFO:tasks.workunit.client.0.smithi016.stderr: -27> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:23:20.811 INFO:tasks.workunit.client.0.smithi016.stderr: -26> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.811 INFO:tasks.workunit.client.0.smithi016.stderr: -25> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:23:20.811 INFO:tasks.workunit.client.0.smithi016.stderr: -24> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:23:20.811 INFO:tasks.workunit.client.0.smithi016.stderr: -23> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:23:20.811 INFO:tasks.workunit.client.0.smithi016.stderr: -22> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 : miss 2024-09-12T17:23:20.812 INFO:tasks.workunit.client.0.smithi016.stderr: -21> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.812 INFO:tasks.workunit.client.0.smithi016.stderr: -20> 2024-09-12T17:23:20.703+0000 7fe1c26ac9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T17:23:20.812 INFO:tasks.workunit.client.0.smithi016.stderr: -19> 2024-09-12T17:23:20.703+0000 7fe1c26ac9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:23:20.812 INFO:tasks.workunit.client.0.smithi016.stderr: -18> 2024-09-12T17:23:20.703+0000 7fe1c26ac9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:23:20.812 INFO:tasks.workunit.client.0.smithi016.stderr: -17> 2024-09-12T17:23:20.703+0000 7fe1c26ac9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:23:20.812 INFO:tasks.workunit.client.0.smithi016.stderr: -16> 2024-09-12T17:23:20.703+0000 7fe1c26ac9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:23:20.812 INFO:tasks.workunit.client.0.smithi016.stderr: -15> 2024-09-12T17:23:20.703+0000 7fe1c26ac9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 2024-09-12T17:23:20.812 INFO:tasks.workunit.client.0.smithi016.stderr: -14> 2024-09-12T17:23:20.703+0000 7fe1c26ac9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:23:20.812 INFO:tasks.workunit.client.0.smithi016.stderr: -13> 2024-09-12T17:23:20.715+0000 7fe1c26ac9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:23:20.812 INFO:tasks.workunit.client.0.smithi016.stderr: -12> 2024-09-12T17:23:20.715+0000 7fe1c26ac9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:23:20.812 INFO:tasks.workunit.client.0.smithi016.stderr: -11> 2024-09-12T17:23:20.715+0000 7fe1c26ac9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:23:20.812 INFO:tasks.workunit.client.0.smithi016.stderr: -10> 2024-09-12T17:23:20.715+0000 7fe1c26ac9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17, ofs0, ns] 2024-09-12T17:23:20.812 INFO:tasks.workunit.client.0.smithi016.stderr: -9> 2024-09-12T17:23:20.715+0000 7fe0977fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431630 cookie 94135717430176 notifier 7829 bl.length()=827 2024-09-12T17:23:20.812 INFO:tasks.workunit.client.0.smithi016.stderr: -8> 2024-09-12T17:23:20.715+0000 7fe0977fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:23:20.813 INFO:tasks.workunit.client.0.smithi016.stderr: -7> 2024-09-12T17:23:20.715+0000 7fe0977fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:23:20.813 INFO:tasks.workunit.client.0.smithi016.stderr: -6> 2024-09-12T17:23:20.715+0000 7fe0977fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:23:20.813 INFO:tasks.workunit.client.0.smithi016.stderr: -5> 2024-09-12T17:23:20.715+0000 7fe1c26ac9c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): orig_sources= new_sources= 2024-09-12T17:23:20.813 INFO:tasks.workunit.client.0.smithi016.stderr: -4> 2024-09-12T17:23:20.715+0000 7fe1c26ac9c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): potential sources added=[] removed=[] 2024-09-12T17:23:20.813 INFO:tasks.workunit.client.0.smithi016.stderr: -3> 2024-09-12T17:23:20.715+0000 7fe1c26ac9c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): orig_dests= new_dests= 2024-09-12T17:23:20.813 INFO:tasks.workunit.client.0.smithi016.stderr: -2> 2024-09-12T17:23:20.715+0000 7fe1c26ac9c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): potential dests added=[] removed=[] 2024-09-12T17:23:20.813 INFO:tasks.workunit.client.0.smithi016.stderr: -1> 2024-09-12T17:23:20.723+0000 7fe1c26ac9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe1c26ac9c0 time 2024-09-12T17:23:20.725729+0000 2024-09-12T17:23:20.813 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:23:20.813 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:20.813 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:23:20.813 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fe1c5f862eb] 2024-09-12T17:23:20.813 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe1c5f8649f] 2024-09-12T17:23:20.813 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559dac3660c1] 2024-09-12T17:23:20.814 INFO:tasks.workunit.client.0.smithi016.stderr: 4: radosgw-admin(+0x14100ec) [0x559dacdbc0ec] 2024-09-12T17:23:20.814 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559dac37818d] 2024-09-12T17:23:20.814 INFO:tasks.workunit.client.0.smithi016.stderr: 6: main() 2024-09-12T17:23:20.814 INFO:tasks.workunit.client.0.smithi016.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe1c4decd90] 2024-09-12T17:23:20.814 INFO:tasks.workunit.client.0.smithi016.stderr: 8: __libc_start_main() 2024-09-12T17:23:20.814 INFO:tasks.workunit.client.0.smithi016.stderr: 9: _start() 2024-09-12T17:23:20.814 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:20.814 INFO:tasks.workunit.client.0.smithi016.stderr: 0> 2024-09-12T17:23:20.727+0000 7fe1c26ac9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:23:20.814 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7fe1c26ac9c0 thread_name:radosgw-admin 2024-09-12T17:23:20.814 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:20.814 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:23:20.814 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fe1c4e05520] 2024-09-12T17:23:20.814 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:23:20.814 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:23:20.814 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:23:20.815 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fe1c5f86345] 2024-09-12T17:23:20.815 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe1c5f8649f] 2024-09-12T17:23:20.815 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559dac3660c1] 2024-09-12T17:23:20.815 INFO:tasks.workunit.client.0.smithi016.stderr: 8: radosgw-admin(+0x14100ec) [0x559dacdbc0ec] 2024-09-12T17:23:20.815 INFO:tasks.workunit.client.0.smithi016.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559dac37818d] 2024-09-12T17:23:20.815 INFO:tasks.workunit.client.0.smithi016.stderr: 10: main() 2024-09-12T17:23:20.815 INFO:tasks.workunit.client.0.smithi016.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe1c4decd90] 2024-09-12T17:23:20.815 INFO:tasks.workunit.client.0.smithi016.stderr: 12: __libc_start_main() 2024-09-12T17:23:20.815 INFO:tasks.workunit.client.0.smithi016.stderr: 13: _start() 2024-09-12T17:23:20.815 INFO:tasks.workunit.client.0.smithi016.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:23:20.815 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:20.815 INFO:tasks.workunit.client.0.smithi016.stderr:--- logging levels --- 2024-09-12T17:23:20.815 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 none 2024-09-12T17:23:20.815 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 lockdep 2024-09-12T17:23:20.815 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 context 2024-09-12T17:23:20.816 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 crush 2024-09-12T17:23:20.816 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds 2024-09-12T17:23:20.816 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_balancer 2024-09-12T17:23:20.816 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_locker 2024-09-12T17:23:20.816 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log 2024-09-12T17:23:20.816 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log_expire 2024-09-12T17:23:20.816 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_migrator 2024-09-12T17:23:20.816 INFO:tasks.workunit.client.0.smithi016.stderr: 3/ 5 mds_quiesce 2024-09-12T17:23:20.816 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 buffer 2024-09-12T17:23:20.816 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 timer 2024-09-12T17:23:20.816 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 filer 2024-09-12T17:23:20.817 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 striper 2024-09-12T17:23:20.817 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 objecter 2024-09-12T17:23:20.817 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rados 2024-09-12T17:23:20.817 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd 2024-09-12T17:23:20.817 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_mirror 2024-09-12T17:23:20.817 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_replay 2024-09-12T17:23:20.817 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_pwl 2024-09-12T17:23:20.817 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 journaler 2024-09-12T17:23:20.817 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objectcacher 2024-09-12T17:23:20.817 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:23:20.817 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 client 2024-09-12T17:23:20.817 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 osd 2024-09-12T17:23:20.817 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 optracker 2024-09-12T17:23:20.818 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objclass 2024-09-12T17:23:20.818 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 filestore 2024-09-12T17:23:20.818 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 journal 2024-09-12T17:23:20.818 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 ms 2024-09-12T17:23:20.818 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mon 2024-09-12T17:23:20.818 INFO:tasks.workunit.client.0.smithi016.stderr: 0/10 monc 2024-09-12T17:23:20.818 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 paxos 2024-09-12T17:23:20.818 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 tp 2024-09-12T17:23:20.818 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 auth 2024-09-12T17:23:20.818 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 crypto 2024-09-12T17:23:20.818 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 finisher 2024-09-12T17:23:20.818 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 reserver 2024-09-12T17:23:20.818 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 heartbeatmap 2024-09-12T17:23:20.818 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 perfcounter 2024-09-12T17:23:20.818 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw 2024-09-12T17:23:20.819 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_sync 2024-09-12T17:23:20.819 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_datacache 2024-09-12T17:23:20.819 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_access 2024-09-12T17:23:20.819 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:23:20.819 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_flight 2024-09-12T17:23:20.819 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:23:20.819 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw_notification 2024-09-12T17:23:20.819 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 javaclient 2024-09-12T17:23:20.819 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 asok 2024-09-12T17:23:20.819 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 throttle 2024-09-12T17:23:20.819 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 refs 2024-09-12T17:23:20.819 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 compressor 2024-09-12T17:23:20.819 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluestore 2024-09-12T17:23:20.819 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluefs 2024-09-12T17:23:20.820 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 bdev 2024-09-12T17:23:20.820 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 kstore 2024-09-12T17:23:20.820 INFO:tasks.workunit.client.0.smithi016.stderr: 4/ 5 rocksdb 2024-09-12T17:23:20.820 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 fuse 2024-09-12T17:23:20.820 INFO:tasks.workunit.client.0.smithi016.stderr: 2/ 5 mgr 2024-09-12T17:23:20.820 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mgrc 2024-09-12T17:23:20.820 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 dpdk 2024-09-12T17:23:20.820 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 eventtrace 2024-09-12T17:23:20.820 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 prioritycache 2024-09-12T17:23:20.820 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 test 2024-09-12T17:23:20.820 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:23:20.820 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephsqlite 2024-09-12T17:23:20.821 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:23:20.821 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore 2024-09-12T17:23:20.821 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_onode 2024-09-12T17:23:20.821 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_odata 2024-09-12T17:23:20.821 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_omap 2024-09-12T17:23:20.821 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_tm 2024-09-12T17:23:20.821 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_t 2024-09-12T17:23:20.821 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:23:20.821 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_epm 2024-09-12T17:23:20.821 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_lba 2024-09-12T17:23:20.822 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:23:20.822 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cache 2024-09-12T17:23:20.822 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_journal 2024-09-12T17:23:20.822 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_device 2024-09-12T17:23:20.822 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_backref 2024-09-12T17:23:20.822 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 alienstore 2024-09-12T17:23:20.822 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mclock 2024-09-12T17:23:20.822 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cyanstore 2024-09-12T17:23:20.822 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 ceph_exporter 2024-09-12T17:23:20.822 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 memstore 2024-09-12T17:23:20.822 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 trace 2024-09-12T17:23:20.822 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 ceph_dedup 2024-09-12T17:23:20.823 INFO:tasks.workunit.client.0.smithi016.stderr: -2/-2 (syslog threshold) 2024-09-12T17:23:20.823 INFO:tasks.workunit.client.0.smithi016.stderr: 99/99 (stderr threshold) 2024-09-12T17:23:20.823 INFO:tasks.workunit.client.0.smithi016.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:23:20.823 INFO:tasks.workunit.client.0.smithi016.stderr: 7fdfe77fe640 / http_manager 2024-09-12T17:23:20.823 INFO:tasks.workunit.client.0.smithi016.stderr: 7fe075fdb640 / http_manager 2024-09-12T17:23:20.823 INFO:tasks.workunit.client.0.smithi016.stderr: 7fe076fdd640 / rgw_dt_lg_renew 2024-09-12T17:23:20.823 INFO:tasks.workunit.client.0.smithi016.stderr: 7fe095ffb640 / ms_dispatch 2024-09-12T17:23:20.823 INFO:tasks.workunit.client.0.smithi016.stderr: 7fe0977fe640 / io_context_pool 2024-09-12T17:23:20.823 INFO:tasks.workunit.client.0.smithi016.stderr: 7fe0a5ffb640 / ms_dispatch 2024-09-12T17:23:20.823 INFO:tasks.workunit.client.0.smithi016.stderr: 7fe0ace09640 / ms_dispatch 2024-09-12T17:23:20.823 INFO:tasks.workunit.client.0.smithi016.stderr: 7fe0ae60c640 / io_context_pool 2024-09-12T17:23:20.823 INFO:tasks.workunit.client.0.smithi016.stderr: 7fe1bf9b1640 / msgr-worker-2 2024-09-12T17:23:20.823 INFO:tasks.workunit.client.0.smithi016.stderr: 7fe1c01b2640 / msgr-worker-1 2024-09-12T17:23:20.823 INFO:tasks.workunit.client.0.smithi016.stderr: 7fe1c09b3640 / msgr-worker-0 2024-09-12T17:23:20.824 INFO:tasks.workunit.client.0.smithi016.stderr: 7fe1c11b4640 / io_context_pool 2024-09-12T17:23:20.824 INFO:tasks.workunit.client.0.smithi016.stderr: 7fe1c26ac9c0 / radosgw-admin 2024-09-12T17:23:20.824 INFO:tasks.workunit.client.0.smithi016.stderr: max_recent 500 2024-09-12T17:23:20.824 INFO:tasks.workunit.client.0.smithi016.stderr: max_new 1000 2024-09-12T17:23:20.824 INFO:tasks.workunit.client.0.smithi016.stderr: log_file /var/log/ceph/ceph-client.admin.142751.log 2024-09-12T17:23:20.824 INFO:tasks.workunit.client.0.smithi016.stderr:--- end dump of recent events --- 2024-09-12T17:23:20.824 INFO:tasks.workunit.client.0.smithi016.stderr:--- begin dump of recent events --- 2024-09-12T17:23:20.824 INFO:tasks.workunit.client.0.smithi016.stderr: -499> 2024-09-12T17:23:20.195+0000 7fe1c01b2640 10 monclient: _finish_hunting 0 2024-09-12T17:23:20.824 INFO:tasks.workunit.client.0.smithi016.stderr: -498> 2024-09-12T17:23:20.195+0000 7fe1c01b2640 1 monclient: found mon.noname-a 2024-09-12T17:23:20.824 INFO:tasks.workunit.client.0.smithi016.stderr: -497> 2024-09-12T17:23:20.195+0000 7fe1c01b2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:23:20.824 INFO:tasks.workunit.client.0.smithi016.stderr: -496> 2024-09-12T17:23:20.195+0000 7fe0ae60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:20.824 INFO:tasks.workunit.client.0.smithi016.stderr: -495> 2024-09-12T17:23:20.195+0000 7fe0ae60c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:23:20.824 INFO:tasks.workunit.client.0.smithi016.stderr: -494> 2024-09-12T17:23:20.195+0000 7fe0ae60c640 10 monclient: dump: 2024-09-12T17:23:20.824 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:23:20.825 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:23:20.825 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:20.825 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:20.825 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:20.825 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:20.825 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:23:20.825 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:23:20.825 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:23:20.825 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:20.825 INFO:tasks.workunit.client.0.smithi016.stderr: -493> 2024-09-12T17:23:20.195+0000 7fe0ae60c640 10 monclient: _finish_auth 0 2024-09-12T17:23:20.825 INFO:tasks.workunit.client.0.smithi016.stderr: -492> 2024-09-12T17:23:20.195+0000 7fe0ae60c640 10 monclient: _check_auth_tickets 2024-09-12T17:23:20.825 INFO:tasks.workunit.client.0.smithi016.stderr: -491> 2024-09-12T17:23:20.195+0000 7fe0ae60c640 10 monclient: handle_config config(0 keys) 2024-09-12T17:23:20.825 INFO:tasks.workunit.client.0.smithi016.stderr: -490> 2024-09-12T17:23:20.195+0000 7fe0ae60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:20.825 INFO:tasks.workunit.client.0.smithi016.stderr: -489> 2024-09-12T17:23:20.195+0000 7fe0ae60c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:23:20.825 INFO:tasks.workunit.client.0.smithi016.stderr: -488> 2024-09-12T17:23:20.195+0000 7fe0ae60c640 10 monclient: dump: 2024-09-12T17:23:20.826 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:23:20.826 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:23:20.826 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:20.826 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:20.826 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:20.826 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:20.826 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:23:20.826 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:23:20.826 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:23:20.826 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:20.826 INFO:tasks.workunit.client.0.smithi016.stderr: -487> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 monclient: authenticate success, global_id 8232 2024-09-12T17:23:20.826 INFO:tasks.workunit.client.0.smithi016.stderr: -486> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 10 monclient: get_monmap_and_config success 2024-09-12T17:23:20.826 INFO:tasks.workunit.client.0.smithi016.stderr: -485> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 4 set_mon_vals no callback set 2024-09-12T17:23:20.826 INFO:tasks.workunit.client.0.smithi016.stderr: -484> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 10 monclient: shutdown 2024-09-12T17:23:20.826 INFO:tasks.workunit.client.0.smithi016.stderr: -483> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 asok(0x559dadcec2b0) unregister_commands rotate-key 2024-09-12T17:23:20.827 INFO:tasks.workunit.client.0.smithi016.stderr: -482> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 10 monclient: build_initial_monmap 2024-09-12T17:23:20.827 INFO:tasks.workunit.client.0.smithi016.stderr: -481> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 1 build_initial for_mkfs: 0 2024-09-12T17:23:20.827 INFO:tasks.workunit.client.0.smithi016.stderr: -480> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 10 monclient: monmap: 2024-09-12T17:23:20.827 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:23:20.827 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:23:20.827 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:23:20.827 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:23:20.827 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:23:20.827 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:20.827 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:23:20.827 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:23:20.827 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:23:20.827 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:20.828 INFO:tasks.workunit.client.0.smithi016.stderr: -479> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadeffb90) adding auth protocol: cephx 2024-09-12T17:23:20.828 INFO:tasks.workunit.client.0.smithi016.stderr: -478> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadeffb90) adding auth protocol: cephx 2024-09-12T17:23:20.828 INFO:tasks.workunit.client.0.smithi016.stderr: -477> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadeffb90) adding auth protocol: cephx 2024-09-12T17:23:20.828 INFO:tasks.workunit.client.0.smithi016.stderr: -476> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadeffb90) adding con mode: secure 2024-09-12T17:23:20.828 INFO:tasks.workunit.client.0.smithi016.stderr: -475> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadeffb90) adding con mode: crc 2024-09-12T17:23:20.828 INFO:tasks.workunit.client.0.smithi016.stderr: -474> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadeffb90) adding con mode: secure 2024-09-12T17:23:20.828 INFO:tasks.workunit.client.0.smithi016.stderr: -473> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadeffb90) adding con mode: crc 2024-09-12T17:23:20.828 INFO:tasks.workunit.client.0.smithi016.stderr: -472> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadeffb90) adding con mode: secure 2024-09-12T17:23:20.828 INFO:tasks.workunit.client.0.smithi016.stderr: -471> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadeffb90) adding con mode: crc 2024-09-12T17:23:20.828 INFO:tasks.workunit.client.0.smithi016.stderr: -470> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadeffb90) adding con mode: crc 2024-09-12T17:23:20.828 INFO:tasks.workunit.client.0.smithi016.stderr: -469> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadeffb90) adding con mode: secure 2024-09-12T17:23:20.828 INFO:tasks.workunit.client.0.smithi016.stderr: -468> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadeffb90) adding con mode: crc 2024-09-12T17:23:20.828 INFO:tasks.workunit.client.0.smithi016.stderr: -467> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadeffb90) adding con mode: secure 2024-09-12T17:23:20.829 INFO:tasks.workunit.client.0.smithi016.stderr: -466> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadeffb90) adding con mode: crc 2024-09-12T17:23:20.829 INFO:tasks.workunit.client.0.smithi016.stderr: -465> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadeffb90) adding con mode: secure 2024-09-12T17:23:20.829 INFO:tasks.workunit.client.0.smithi016.stderr: -464> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.829 INFO:tasks.workunit.client.0.smithi016.stderr: -463> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 1 librados: starting msgr at 2024-09-12T17:23:20.829 INFO:tasks.workunit.client.0.smithi016.stderr: -462> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 1 librados: starting objecter 2024-09-12T17:23:20.829 INFO:tasks.workunit.client.0.smithi016.stderr: -461> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 asok(0x559dadcec2b0) register_command objecter_requests hook 0x559dadccf670 2024-09-12T17:23:20.829 INFO:tasks.workunit.client.0.smithi016.stderr: -460> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 1 librados: setting wanted keys 2024-09-12T17:23:20.829 INFO:tasks.workunit.client.0.smithi016.stderr: -459> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 1 librados: calling monclient init 2024-09-12T17:23:20.829 INFO:tasks.workunit.client.0.smithi016.stderr: -458> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 10 monclient: init 2024-09-12T17:23:20.829 INFO:tasks.workunit.client.0.smithi016.stderr: -457> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadef8f50) adding auth protocol: cephx 2024-09-12T17:23:20.829 INFO:tasks.workunit.client.0.smithi016.stderr: -456> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadef8f50) adding auth protocol: cephx 2024-09-12T17:23:20.829 INFO:tasks.workunit.client.0.smithi016.stderr: -455> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadef8f50) adding auth protocol: cephx 2024-09-12T17:23:20.830 INFO:tasks.workunit.client.0.smithi016.stderr: -454> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadef8f50) adding con mode: secure 2024-09-12T17:23:20.830 INFO:tasks.workunit.client.0.smithi016.stderr: -453> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadef8f50) adding con mode: crc 2024-09-12T17:23:20.830 INFO:tasks.workunit.client.0.smithi016.stderr: -452> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadef8f50) adding con mode: secure 2024-09-12T17:23:20.830 INFO:tasks.workunit.client.0.smithi016.stderr: -451> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadef8f50) adding con mode: crc 2024-09-12T17:23:20.830 INFO:tasks.workunit.client.0.smithi016.stderr: -450> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadef8f50) adding con mode: secure 2024-09-12T17:23:20.830 INFO:tasks.workunit.client.0.smithi016.stderr: -449> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadef8f50) adding con mode: crc 2024-09-12T17:23:20.830 INFO:tasks.workunit.client.0.smithi016.stderr: -448> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadef8f50) adding con mode: crc 2024-09-12T17:23:20.830 INFO:tasks.workunit.client.0.smithi016.stderr: -447> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadef8f50) adding con mode: secure 2024-09-12T17:23:20.830 INFO:tasks.workunit.client.0.smithi016.stderr: -446> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadef8f50) adding con mode: crc 2024-09-12T17:23:20.830 INFO:tasks.workunit.client.0.smithi016.stderr: -445> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadef8f50) adding con mode: secure 2024-09-12T17:23:20.830 INFO:tasks.workunit.client.0.smithi016.stderr: -444> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadef8f50) adding con mode: crc 2024-09-12T17:23:20.830 INFO:tasks.workunit.client.0.smithi016.stderr: -443> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadef8f50) adding con mode: secure 2024-09-12T17:23:20.830 INFO:tasks.workunit.client.0.smithi016.stderr: -442> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.830 INFO:tasks.workunit.client.0.smithi016.stderr: -441> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.830 INFO:tasks.workunit.client.0.smithi016.stderr: -440> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 5 asok(0x559dadcec2b0) register_command rotate-key hook 0x559dadef9098 2024-09-12T17:23:20.831 INFO:tasks.workunit.client.0.smithi016.stderr: -439> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:23:20.831 INFO:tasks.workunit.client.0.smithi016.stderr: -438> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:23:20.831 INFO:tasks.workunit.client.0.smithi016.stderr: -437> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 10 monclient(hunting): picked mon.noname-a con 0x559daddb45b0 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:23:20.831 INFO:tasks.workunit.client.0.smithi016.stderr: -436> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 10 monclient(hunting): picked mon.noname-c con 0x559dade41720 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:23:20.831 INFO:tasks.workunit.client.0.smithi016.stderr: -435> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 10 monclient(hunting): picked mon.noname-b con 0x559dade42070 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:23:20.831 INFO:tasks.workunit.client.0.smithi016.stderr: -434> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.831 INFO:tasks.workunit.client.0.smithi016.stderr: -433> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.831 INFO:tasks.workunit.client.0.smithi016.stderr: -432> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.831 INFO:tasks.workunit.client.0.smithi016.stderr: -431> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:23:20.831 INFO:tasks.workunit.client.0.smithi016.stderr: -430> 2024-09-12T17:23:20.195+0000 7fe1c26ac9c0 10 monclient(hunting): authenticate will time out at 2518.175448s 2024-09-12T17:23:20.831 INFO:tasks.workunit.client.0.smithi016.stderr: -429> 2024-09-12T17:23:20.195+0000 7fe1c01b2640 10 monclient(hunting): get_auth_request con 0x559daddb45b0 auth_method 0 2024-09-12T17:23:20.831 INFO:tasks.workunit.client.0.smithi016.stderr: -428> 2024-09-12T17:23:20.195+0000 7fe1c01b2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:20.832 INFO:tasks.workunit.client.0.smithi016.stderr: -427> 2024-09-12T17:23:20.195+0000 7fe1c01b2640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:20.832 INFO:tasks.workunit.client.0.smithi016.stderr: -426> 2024-09-12T17:23:20.195+0000 7fe1c01b2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:20.832 INFO:tasks.workunit.client.0.smithi016.stderr: -425> 2024-09-12T17:23:20.195+0000 7fe1bf9b1640 10 monclient(hunting): get_auth_request con 0x559dade41720 auth_method 0 2024-09-12T17:23:20.832 INFO:tasks.workunit.client.0.smithi016.stderr: -424> 2024-09-12T17:23:20.195+0000 7fe1bf9b1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:20.832 INFO:tasks.workunit.client.0.smithi016.stderr: -423> 2024-09-12T17:23:20.195+0000 7fe1bf9b1640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:20.832 INFO:tasks.workunit.client.0.smithi016.stderr: -422> 2024-09-12T17:23:20.195+0000 7fe1bf9b1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:20.832 INFO:tasks.workunit.client.0.smithi016.stderr: -421> 2024-09-12T17:23:20.195+0000 7fe1c01b2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:20.832 INFO:tasks.workunit.client.0.smithi016.stderr: -420> 2024-09-12T17:23:20.195+0000 7fe1c01b2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:20.832 INFO:tasks.workunit.client.0.smithi016.stderr: -419> 2024-09-12T17:23:20.195+0000 7fe1c01b2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:20.832 INFO:tasks.workunit.client.0.smithi016.stderr: -418> 2024-09-12T17:23:20.195+0000 7fe1bf9b1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:20.832 INFO:tasks.workunit.client.0.smithi016.stderr: -417> 2024-09-12T17:23:20.195+0000 7fe1bf9b1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:20.832 INFO:tasks.workunit.client.0.smithi016.stderr: -416> 2024-09-12T17:23:20.195+0000 7fe1bf9b1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:20.832 INFO:tasks.workunit.client.0.smithi016.stderr: -415> 2024-09-12T17:23:20.195+0000 7fe1c01b2640 10 monclient(hunting): handle_auth_done global_id 8235 payload 824 2024-09-12T17:23:20.833 INFO:tasks.workunit.client.0.smithi016.stderr: -414> 2024-09-12T17:23:20.195+0000 7fe1c01b2640 10 monclient: _finish_hunting 0 2024-09-12T17:23:20.833 INFO:tasks.workunit.client.0.smithi016.stderr: -413> 2024-09-12T17:23:20.195+0000 7fe1c01b2640 1 monclient: found mon.noname-a 2024-09-12T17:23:20.833 INFO:tasks.workunit.client.0.smithi016.stderr: -412> 2024-09-12T17:23:20.195+0000 7fe1c01b2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:23:20.833 INFO:tasks.workunit.client.0.smithi016.stderr: -411> 2024-09-12T17:23:20.195+0000 7fe1c09b3640 10 monclient: get_auth_request con 0x559dade42070 auth_method 0 2024-09-12T17:23:20.833 INFO:tasks.workunit.client.0.smithi016.stderr: -410> 2024-09-12T17:23:20.199+0000 7fe0ace09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:20.833 INFO:tasks.workunit.client.0.smithi016.stderr: -409> 2024-09-12T17:23:20.199+0000 7fe0ace09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:23:20.833 INFO:tasks.workunit.client.0.smithi016.stderr: -408> 2024-09-12T17:23:20.199+0000 7fe0ace09640 10 monclient: dump: 2024-09-12T17:23:20.833 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:23:20.833 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:23:20.833 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:20.833 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:20.833 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:20.833 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:20.833 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:23:20.834 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:23:20.834 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:23:20.834 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:20.834 INFO:tasks.workunit.client.0.smithi016.stderr: -407> 2024-09-12T17:23:20.199+0000 7fe0ace09640 10 monclient: _finish_auth 0 2024-09-12T17:23:20.834 INFO:tasks.workunit.client.0.smithi016.stderr: -406> 2024-09-12T17:23:20.199+0000 7fe0ace09640 10 monclient: _check_auth_tickets 2024-09-12T17:23:20.834 INFO:tasks.workunit.client.0.smithi016.stderr: -405> 2024-09-12T17:23:20.199+0000 7fe0ace09640 10 monclient: handle_config config(0 keys) 2024-09-12T17:23:20.834 INFO:tasks.workunit.client.0.smithi016.stderr: -404> 2024-09-12T17:23:20.199+0000 7fe0ace09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:20.834 INFO:tasks.workunit.client.0.smithi016.stderr: -403> 2024-09-12T17:23:20.199+0000 7fe0ace09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:23:20.834 INFO:tasks.workunit.client.0.smithi016.stderr: -402> 2024-09-12T17:23:20.199+0000 7fe0ace09640 10 monclient: dump: 2024-09-12T17:23:20.834 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:23:20.834 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:23:20.834 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:20.834 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:20.835 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:20.835 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:20.835 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:23:20.835 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:23:20.835 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:23:20.835 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:20.835 INFO:tasks.workunit.client.0.smithi016.stderr: -401> 2024-09-12T17:23:20.199+0000 7fe0ae60c640 4 set_mon_vals no callback set 2024-09-12T17:23:20.835 INFO:tasks.workunit.client.0.smithi016.stderr: -400> 2024-09-12T17:23:20.199+0000 7fe1c26ac9c0 5 monclient: authenticate success, global_id 8235 2024-09-12T17:23:20.835 INFO:tasks.workunit.client.0.smithi016.stderr: -399> 2024-09-12T17:23:20.199+0000 7fe1c26ac9c0 10 monclient: _renew_subs 2024-09-12T17:23:20.835 INFO:tasks.workunit.client.0.smithi016.stderr: -398> 2024-09-12T17:23:20.199+0000 7fe1c26ac9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:23:20.835 INFO:tasks.workunit.client.0.smithi016.stderr: -397> 2024-09-12T17:23:20.199+0000 7fe1c26ac9c0 10 monclient: _renew_subs 2024-09-12T17:23:20.836 INFO:tasks.workunit.client.0.smithi016.stderr: -396> 2024-09-12T17:23:20.199+0000 7fe1c26ac9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:23:20.836 INFO:tasks.workunit.client.0.smithi016.stderr: -395> 2024-09-12T17:23:20.199+0000 7fe1c26ac9c0 1 librados: init done 2024-09-12T17:23:20.836 INFO:tasks.workunit.client.0.smithi016.stderr: -394> 2024-09-12T17:23:20.199+0000 7fe0ace09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:23:20.836 INFO:tasks.workunit.client.0.smithi016.stderr: -393> 2024-09-12T17:23:20.199+0000 7fe0ace09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:23:20.836 INFO:tasks.workunit.client.0.smithi016.stderr: -392> 2024-09-12T17:23:20.199+0000 7fe0ace09640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:23:20.837 INFO:tasks.workunit.client.0.smithi016.stderr: -391> 2024-09-12T17:23:20.199+0000 7fe1bf9b1640 10 monclient: get_auth_request con 0x7fe0a8070b10 auth_method 0 2024-09-12T17:23:20.837 INFO:tasks.workunit.client.0.smithi016.stderr: -390> 2024-09-12T17:23:20.199+0000 7fe1c09b3640 10 monclient: get_auth_request con 0x559dadf40fb0 auth_method 0 2024-09-12T17:23:20.837 INFO:tasks.workunit.client.0.smithi016.stderr: -389> 2024-09-12T17:23:20.203+0000 7fe1c01b2640 10 monclient: get_auth_request con 0x559dadf43df0 auth_method 0 2024-09-12T17:23:20.837 INFO:tasks.workunit.client.0.smithi016.stderr: -388> 2024-09-12T17:23:20.203+0000 7fe1bf9b1640 10 monclient: get_auth_request con 0x559dadf47fe0 auth_method 0 2024-09-12T17:23:20.837 INFO:tasks.workunit.client.0.smithi016.stderr: -387> 2024-09-12T17:23:20.207+0000 7fe1c09b3640 10 monclient: get_auth_request con 0x559dadf476a0 auth_method 0 2024-09-12T17:23:20.837 INFO:tasks.workunit.client.0.smithi016.stderr: -386> 2024-09-12T17:23:20.207+0000 7fe1c26ac9c0 10 monclient: build_initial_monmap 2024-09-12T17:23:20.837 INFO:tasks.workunit.client.0.smithi016.stderr: -385> 2024-09-12T17:23:20.207+0000 7fe1c26ac9c0 1 build_initial for_mkfs: 0 2024-09-12T17:23:20.837 INFO:tasks.workunit.client.0.smithi016.stderr: -384> 2024-09-12T17:23:20.207+0000 7fe1c26ac9c0 10 monclient: monmap: 2024-09-12T17:23:20.837 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:23:20.838 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:23:20.838 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:23:20.838 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:23:20.838 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:23:20.838 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:20.838 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:23:20.838 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:23:20.838 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:23:20.838 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:20.838 INFO:tasks.workunit.client.0.smithi016.stderr: -383> 2024-09-12T17:23:20.207+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4ff80) adding auth protocol: cephx 2024-09-12T17:23:20.838 INFO:tasks.workunit.client.0.smithi016.stderr: -382> 2024-09-12T17:23:20.207+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4ff80) adding auth protocol: cephx 2024-09-12T17:23:20.838 INFO:tasks.workunit.client.0.smithi016.stderr: -381> 2024-09-12T17:23:20.207+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4ff80) adding auth protocol: cephx 2024-09-12T17:23:20.838 INFO:tasks.workunit.client.0.smithi016.stderr: -380> 2024-09-12T17:23:20.207+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4ff80) adding con mode: secure 2024-09-12T17:23:20.839 INFO:tasks.workunit.client.0.smithi016.stderr: -379> 2024-09-12T17:23:20.207+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4ff80) adding con mode: crc 2024-09-12T17:23:20.839 INFO:tasks.workunit.client.0.smithi016.stderr: -378> 2024-09-12T17:23:20.207+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4ff80) adding con mode: secure 2024-09-12T17:23:20.839 INFO:tasks.workunit.client.0.smithi016.stderr: -377> 2024-09-12T17:23:20.207+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4ff80) adding con mode: crc 2024-09-12T17:23:20.839 INFO:tasks.workunit.client.0.smithi016.stderr: -376> 2024-09-12T17:23:20.207+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4ff80) adding con mode: secure 2024-09-12T17:23:20.839 INFO:tasks.workunit.client.0.smithi016.stderr: -375> 2024-09-12T17:23:20.207+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4ff80) adding con mode: crc 2024-09-12T17:23:20.839 INFO:tasks.workunit.client.0.smithi016.stderr: -374> 2024-09-12T17:23:20.207+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4ff80) adding con mode: crc 2024-09-12T17:23:20.839 INFO:tasks.workunit.client.0.smithi016.stderr: -373> 2024-09-12T17:23:20.207+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4ff80) adding con mode: secure 2024-09-12T17:23:20.839 INFO:tasks.workunit.client.0.smithi016.stderr: -372> 2024-09-12T17:23:20.207+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4ff80) adding con mode: crc 2024-09-12T17:23:20.839 INFO:tasks.workunit.client.0.smithi016.stderr: -371> 2024-09-12T17:23:20.207+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4ff80) adding con mode: secure 2024-09-12T17:23:20.839 INFO:tasks.workunit.client.0.smithi016.stderr: -370> 2024-09-12T17:23:20.207+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4ff80) adding con mode: crc 2024-09-12T17:23:20.839 INFO:tasks.workunit.client.0.smithi016.stderr: -369> 2024-09-12T17:23:20.207+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4ff80) adding con mode: secure 2024-09-12T17:23:20.839 INFO:tasks.workunit.client.0.smithi016.stderr: -368> 2024-09-12T17:23:20.207+0000 7fe1c26ac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.839 INFO:tasks.workunit.client.0.smithi016.stderr: -367> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 5 asok(0x559dadcec2b0) register_command objecter_requests cmddesc objecter_requests hook 0x559dadf53970 EEXIST 2024-09-12T17:23:20.839 INFO:tasks.workunit.client.0.smithi016.stderr: -366> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 10 monclient: init 2024-09-12T17:23:20.839 INFO:tasks.workunit.client.0.smithi016.stderr: -365> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4eec8) adding auth protocol: cephx 2024-09-12T17:23:20.840 INFO:tasks.workunit.client.0.smithi016.stderr: -364> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4eec8) adding auth protocol: cephx 2024-09-12T17:23:20.840 INFO:tasks.workunit.client.0.smithi016.stderr: -363> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4eec8) adding auth protocol: cephx 2024-09-12T17:23:20.840 INFO:tasks.workunit.client.0.smithi016.stderr: -362> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4eec8) adding con mode: secure 2024-09-12T17:23:20.840 INFO:tasks.workunit.client.0.smithi016.stderr: -361> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4eec8) adding con mode: crc 2024-09-12T17:23:20.840 INFO:tasks.workunit.client.0.smithi016.stderr: -360> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4eec8) adding con mode: secure 2024-09-12T17:23:20.840 INFO:tasks.workunit.client.0.smithi016.stderr: -359> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4eec8) adding con mode: crc 2024-09-12T17:23:20.840 INFO:tasks.workunit.client.0.smithi016.stderr: -358> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4eec8) adding con mode: secure 2024-09-12T17:23:20.840 INFO:tasks.workunit.client.0.smithi016.stderr: -357> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4eec8) adding con mode: crc 2024-09-12T17:23:20.840 INFO:tasks.workunit.client.0.smithi016.stderr: -356> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4eec8) adding con mode: crc 2024-09-12T17:23:20.840 INFO:tasks.workunit.client.0.smithi016.stderr: -355> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4eec8) adding con mode: secure 2024-09-12T17:23:20.840 INFO:tasks.workunit.client.0.smithi016.stderr: -354> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4eec8) adding con mode: crc 2024-09-12T17:23:20.840 INFO:tasks.workunit.client.0.smithi016.stderr: -353> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4eec8) adding con mode: secure 2024-09-12T17:23:20.841 INFO:tasks.workunit.client.0.smithi016.stderr: -352> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4eec8) adding con mode: crc 2024-09-12T17:23:20.841 INFO:tasks.workunit.client.0.smithi016.stderr: -351> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf4eec8) adding con mode: secure 2024-09-12T17:23:20.841 INFO:tasks.workunit.client.0.smithi016.stderr: -350> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.841 INFO:tasks.workunit.client.0.smithi016.stderr: -349> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.841 INFO:tasks.workunit.client.0.smithi016.stderr: -348> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 5 asok(0x559dadcec2b0) register_command rotate-key cmddesc rotate-key hook 0x559dadf4f010 EEXIST 2024-09-12T17:23:20.841 INFO:tasks.workunit.client.0.smithi016.stderr: -347> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:23:20.841 INFO:tasks.workunit.client.0.smithi016.stderr: -346> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:23:20.841 INFO:tasks.workunit.client.0.smithi016.stderr: -345> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 10 monclient(hunting): picked mon.noname-c con 0x559dadf77b20 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:23:20.841 INFO:tasks.workunit.client.0.smithi016.stderr: -344> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 10 monclient(hunting): picked mon.noname-a con 0x559dadf77450 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:23:20.841 INFO:tasks.workunit.client.0.smithi016.stderr: -343> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 10 monclient(hunting): picked mon.noname-b con 0x559dadf75e30 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:23:20.841 INFO:tasks.workunit.client.0.smithi016.stderr: -342> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.841 INFO:tasks.workunit.client.0.smithi016.stderr: -341> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.841 INFO:tasks.workunit.client.0.smithi016.stderr: -340> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.842 INFO:tasks.workunit.client.0.smithi016.stderr: -339> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:23:20.842 INFO:tasks.workunit.client.0.smithi016.stderr: -338> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 10 monclient(hunting): authenticate will time out at 2518.188843s 2024-09-12T17:23:20.842 INFO:tasks.workunit.client.0.smithi016.stderr: -337> 2024-09-12T17:23:20.211+0000 7fe1c09b3640 10 monclient(hunting): get_auth_request con 0x559dadf77450 auth_method 0 2024-09-12T17:23:20.842 INFO:tasks.workunit.client.0.smithi016.stderr: -336> 2024-09-12T17:23:20.211+0000 7fe1c09b3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:20.842 INFO:tasks.workunit.client.0.smithi016.stderr: -335> 2024-09-12T17:23:20.211+0000 7fe1c09b3640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:20.842 INFO:tasks.workunit.client.0.smithi016.stderr: -334> 2024-09-12T17:23:20.211+0000 7fe1c09b3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:20.842 INFO:tasks.workunit.client.0.smithi016.stderr: -333> 2024-09-12T17:23:20.211+0000 7fe1bf9b1640 10 monclient(hunting): get_auth_request con 0x559dadf77b20 auth_method 0 2024-09-12T17:23:20.842 INFO:tasks.workunit.client.0.smithi016.stderr: -332> 2024-09-12T17:23:20.211+0000 7fe1bf9b1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:20.842 INFO:tasks.workunit.client.0.smithi016.stderr: -331> 2024-09-12T17:23:20.211+0000 7fe1bf9b1640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:20.842 INFO:tasks.workunit.client.0.smithi016.stderr: -330> 2024-09-12T17:23:20.211+0000 7fe1bf9b1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:20.842 INFO:tasks.workunit.client.0.smithi016.stderr: -329> 2024-09-12T17:23:20.211+0000 7fe1c09b3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:20.842 INFO:tasks.workunit.client.0.smithi016.stderr: -328> 2024-09-12T17:23:20.211+0000 7fe1c09b3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:20.842 INFO:tasks.workunit.client.0.smithi016.stderr: -327> 2024-09-12T17:23:20.211+0000 7fe1c09b3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:20.842 INFO:tasks.workunit.client.0.smithi016.stderr: -326> 2024-09-12T17:23:20.211+0000 7fe1bf9b1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:20.843 INFO:tasks.workunit.client.0.smithi016.stderr: -325> 2024-09-12T17:23:20.211+0000 7fe1bf9b1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:20.843 INFO:tasks.workunit.client.0.smithi016.stderr: -324> 2024-09-12T17:23:20.211+0000 7fe1bf9b1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:20.843 INFO:tasks.workunit.client.0.smithi016.stderr: -323> 2024-09-12T17:23:20.211+0000 7fe1c01b2640 10 monclient(hunting): get_auth_request con 0x559dadf75e30 auth_method 0 2024-09-12T17:23:20.843 INFO:tasks.workunit.client.0.smithi016.stderr: -322> 2024-09-12T17:23:20.211+0000 7fe1c01b2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:20.843 INFO:tasks.workunit.client.0.smithi016.stderr: -321> 2024-09-12T17:23:20.211+0000 7fe1c01b2640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:20.843 INFO:tasks.workunit.client.0.smithi016.stderr: -320> 2024-09-12T17:23:20.211+0000 7fe1c01b2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:20.843 INFO:tasks.workunit.client.0.smithi016.stderr: -319> 2024-09-12T17:23:20.211+0000 7fe1c09b3640 10 monclient(hunting): handle_auth_done global_id 8238 payload 824 2024-09-12T17:23:20.843 INFO:tasks.workunit.client.0.smithi016.stderr: -318> 2024-09-12T17:23:20.211+0000 7fe1c09b3640 10 monclient: _finish_hunting 0 2024-09-12T17:23:20.843 INFO:tasks.workunit.client.0.smithi016.stderr: -317> 2024-09-12T17:23:20.211+0000 7fe1c09b3640 1 monclient: found mon.noname-a 2024-09-12T17:23:20.843 INFO:tasks.workunit.client.0.smithi016.stderr: -316> 2024-09-12T17:23:20.211+0000 7fe1c09b3640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:23:20.843 INFO:tasks.workunit.client.0.smithi016.stderr: -315> 2024-09-12T17:23:20.211+0000 7fe0a5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:20.843 INFO:tasks.workunit.client.0.smithi016.stderr: -314> 2024-09-12T17:23:20.211+0000 7fe0a5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:23:20.843 INFO:tasks.workunit.client.0.smithi016.stderr: -313> 2024-09-12T17:23:20.211+0000 7fe0a5ffb640 10 monclient: dump: 2024-09-12T17:23:20.843 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:23:20.844 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:23:20.844 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:20.844 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:20.844 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:20.844 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:20.844 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:23:20.844 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:23:20.844 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:23:20.844 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:20.844 INFO:tasks.workunit.client.0.smithi016.stderr: -312> 2024-09-12T17:23:20.211+0000 7fe0a5ffb640 10 monclient: _finish_auth 0 2024-09-12T17:23:20.844 INFO:tasks.workunit.client.0.smithi016.stderr: -311> 2024-09-12T17:23:20.211+0000 7fe0a5ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:23:20.844 INFO:tasks.workunit.client.0.smithi016.stderr: -310> 2024-09-12T17:23:20.211+0000 7fe0a5ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:23:20.844 INFO:tasks.workunit.client.0.smithi016.stderr: -309> 2024-09-12T17:23:20.211+0000 7fe0a5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:20.845 INFO:tasks.workunit.client.0.smithi016.stderr: -308> 2024-09-12T17:23:20.211+0000 7fe0a5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:23:20.845 INFO:tasks.workunit.client.0.smithi016.stderr: -307> 2024-09-12T17:23:20.211+0000 7fe0a5ffb640 10 monclient: dump: 2024-09-12T17:23:20.845 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:23:20.845 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:23:20.845 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:20.845 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:20.845 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:20.845 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:20.845 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:23:20.845 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:23:20.845 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:23:20.845 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:20.845 INFO:tasks.workunit.client.0.smithi016.stderr: -306> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 5 monclient: authenticate success, global_id 8238 2024-09-12T17:23:20.845 INFO:tasks.workunit.client.0.smithi016.stderr: -305> 2024-09-12T17:23:20.211+0000 7fe1c11b4640 4 set_mon_vals no callback set 2024-09-12T17:23:20.846 INFO:tasks.workunit.client.0.smithi016.stderr: -304> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 10 monclient: _renew_subs 2024-09-12T17:23:20.846 INFO:tasks.workunit.client.0.smithi016.stderr: -303> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:23:20.846 INFO:tasks.workunit.client.0.smithi016.stderr: -302> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 10 monclient: _renew_subs 2024-09-12T17:23:20.846 INFO:tasks.workunit.client.0.smithi016.stderr: -301> 2024-09-12T17:23:20.211+0000 7fe1c26ac9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:23:20.846 INFO:tasks.workunit.client.0.smithi016.stderr: -300> 2024-09-12T17:23:20.211+0000 7fe0a5ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:23:20.846 INFO:tasks.workunit.client.0.smithi016.stderr: -299> 2024-09-12T17:23:20.211+0000 7fe0a5ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:23:20.846 INFO:tasks.workunit.client.0.smithi016.stderr: -298> 2024-09-12T17:23:20.211+0000 7fe0a5ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:23:20.846 INFO:tasks.workunit.client.0.smithi016.stderr: -297> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 10 monclient: get_monmap_and_config 2024-09-12T17:23:20.846 INFO:tasks.workunit.client.0.smithi016.stderr: -296> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 10 monclient: build_initial_monmap 2024-09-12T17:23:20.846 INFO:tasks.workunit.client.0.smithi016.stderr: -295> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 1 build_initial for_mkfs: 0 2024-09-12T17:23:20.847 INFO:tasks.workunit.client.0.smithi016.stderr: -294> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 10 monclient: monmap: 2024-09-12T17:23:20.847 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:23:20.847 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:23:20.847 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:23:20.847 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:23:20.847 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:23:20.847 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:20.847 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:23:20.847 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:23:20.847 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:23:20.847 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:20.847 INFO:tasks.workunit.client.0.smithi016.stderr: -293> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf97490) adding auth protocol: cephx 2024-09-12T17:23:20.847 INFO:tasks.workunit.client.0.smithi016.stderr: -292> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf97490) adding auth protocol: cephx 2024-09-12T17:23:20.847 INFO:tasks.workunit.client.0.smithi016.stderr: -291> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf97490) adding auth protocol: cephx 2024-09-12T17:23:20.848 INFO:tasks.workunit.client.0.smithi016.stderr: -290> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf97490) adding con mode: secure 2024-09-12T17:23:20.848 INFO:tasks.workunit.client.0.smithi016.stderr: -289> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf97490) adding con mode: crc 2024-09-12T17:23:20.848 INFO:tasks.workunit.client.0.smithi016.stderr: -288> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf97490) adding con mode: secure 2024-09-12T17:23:20.848 INFO:tasks.workunit.client.0.smithi016.stderr: -287> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf97490) adding con mode: crc 2024-09-12T17:23:20.848 INFO:tasks.workunit.client.0.smithi016.stderr: -286> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf97490) adding con mode: secure 2024-09-12T17:23:20.848 INFO:tasks.workunit.client.0.smithi016.stderr: -285> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf97490) adding con mode: crc 2024-09-12T17:23:20.848 INFO:tasks.workunit.client.0.smithi016.stderr: -284> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf97490) adding con mode: crc 2024-09-12T17:23:20.848 INFO:tasks.workunit.client.0.smithi016.stderr: -283> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf97490) adding con mode: secure 2024-09-12T17:23:20.848 INFO:tasks.workunit.client.0.smithi016.stderr: -282> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf97490) adding con mode: crc 2024-09-12T17:23:20.848 INFO:tasks.workunit.client.0.smithi016.stderr: -281> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf97490) adding con mode: secure 2024-09-12T17:23:20.848 INFO:tasks.workunit.client.0.smithi016.stderr: -280> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf97490) adding con mode: crc 2024-09-12T17:23:20.848 INFO:tasks.workunit.client.0.smithi016.stderr: -279> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf97490) adding con mode: secure 2024-09-12T17:23:20.849 INFO:tasks.workunit.client.0.smithi016.stderr: -278> 2024-09-12T17:23:20.215+0000 7fe1bf9b1640 10 monclient: get_auth_request con 0x7fe098070a20 auth_method 0 2024-09-12T17:23:20.849 INFO:tasks.workunit.client.0.smithi016.stderr: -277> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.849 INFO:tasks.workunit.client.0.smithi016.stderr: -276> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 10 monclient: init 2024-09-12T17:23:20.849 INFO:tasks.workunit.client.0.smithi016.stderr: -275> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c6dc0) adding auth protocol: cephx 2024-09-12T17:23:20.849 INFO:tasks.workunit.client.0.smithi016.stderr: -274> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c6dc0) adding auth protocol: cephx 2024-09-12T17:23:20.849 INFO:tasks.workunit.client.0.smithi016.stderr: -273> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c6dc0) adding auth protocol: cephx 2024-09-12T17:23:20.849 INFO:tasks.workunit.client.0.smithi016.stderr: -272> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c6dc0) adding con mode: secure 2024-09-12T17:23:20.849 INFO:tasks.workunit.client.0.smithi016.stderr: -271> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c6dc0) adding con mode: crc 2024-09-12T17:23:20.849 INFO:tasks.workunit.client.0.smithi016.stderr: -270> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c6dc0) adding con mode: secure 2024-09-12T17:23:20.849 INFO:tasks.workunit.client.0.smithi016.stderr: -269> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c6dc0) adding con mode: crc 2024-09-12T17:23:20.849 INFO:tasks.workunit.client.0.smithi016.stderr: -268> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c6dc0) adding con mode: secure 2024-09-12T17:23:20.850 INFO:tasks.workunit.client.0.smithi016.stderr: -267> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c6dc0) adding con mode: crc 2024-09-12T17:23:20.850 INFO:tasks.workunit.client.0.smithi016.stderr: -266> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c6dc0) adding con mode: crc 2024-09-12T17:23:20.850 INFO:tasks.workunit.client.0.smithi016.stderr: -265> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c6dc0) adding con mode: secure 2024-09-12T17:23:20.850 INFO:tasks.workunit.client.0.smithi016.stderr: -264> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c6dc0) adding con mode: crc 2024-09-12T17:23:20.850 INFO:tasks.workunit.client.0.smithi016.stderr: -263> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c6dc0) adding con mode: secure 2024-09-12T17:23:20.850 INFO:tasks.workunit.client.0.smithi016.stderr: -262> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c6dc0) adding con mode: crc 2024-09-12T17:23:20.850 INFO:tasks.workunit.client.0.smithi016.stderr: -261> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c6dc0) adding con mode: secure 2024-09-12T17:23:20.850 INFO:tasks.workunit.client.0.smithi016.stderr: -260> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.850 INFO:tasks.workunit.client.0.smithi016.stderr: -259> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.850 INFO:tasks.workunit.client.0.smithi016.stderr: -258> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 asok(0x559dadcec2b0) register_command rotate-key cmddesc rotate-key hook 0x7fff631c6f08 EEXIST 2024-09-12T17:23:20.850 INFO:tasks.workunit.client.0.smithi016.stderr: -257> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:23:20.851 INFO:tasks.workunit.client.0.smithi016.stderr: -256> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:23:20.851 INFO:tasks.workunit.client.0.smithi016.stderr: -255> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 10 monclient(hunting): picked mon.noname-c con 0x559dadfcb9a0 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:23:20.851 INFO:tasks.workunit.client.0.smithi016.stderr: -254> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 10 monclient(hunting): picked mon.noname-a con 0x559dadfc6e40 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:23:20.851 INFO:tasks.workunit.client.0.smithi016.stderr: -253> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 10 monclient(hunting): picked mon.noname-b con 0x559dadfbd5b0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:23:20.851 INFO:tasks.workunit.client.0.smithi016.stderr: -252> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.851 INFO:tasks.workunit.client.0.smithi016.stderr: -251> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.851 INFO:tasks.workunit.client.0.smithi016.stderr: -250> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.851 INFO:tasks.workunit.client.0.smithi016.stderr: -249> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:23:20.851 INFO:tasks.workunit.client.0.smithi016.stderr: -248> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 10 monclient(hunting): authenticate will time out at 2518.193332s 2024-09-12T17:23:20.851 INFO:tasks.workunit.client.0.smithi016.stderr: -247> 2024-09-12T17:23:20.215+0000 7fe1c09b3640 10 monclient(hunting): get_auth_request con 0x559dadfc6e40 auth_method 0 2024-09-12T17:23:20.851 INFO:tasks.workunit.client.0.smithi016.stderr: -246> 2024-09-12T17:23:20.215+0000 7fe1c09b3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:20.851 INFO:tasks.workunit.client.0.smithi016.stderr: -245> 2024-09-12T17:23:20.215+0000 7fe1c09b3640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:20.851 INFO:tasks.workunit.client.0.smithi016.stderr: -244> 2024-09-12T17:23:20.215+0000 7fe1c09b3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:20.851 INFO:tasks.workunit.client.0.smithi016.stderr: -243> 2024-09-12T17:23:20.215+0000 7fe1bf9b1640 10 monclient(hunting): get_auth_request con 0x559dadfcb9a0 auth_method 0 2024-09-12T17:23:20.852 INFO:tasks.workunit.client.0.smithi016.stderr: -242> 2024-09-12T17:23:20.215+0000 7fe1bf9b1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:20.852 INFO:tasks.workunit.client.0.smithi016.stderr: -241> 2024-09-12T17:23:20.215+0000 7fe1bf9b1640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:20.852 INFO:tasks.workunit.client.0.smithi016.stderr: -240> 2024-09-12T17:23:20.215+0000 7fe1bf9b1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:20.852 INFO:tasks.workunit.client.0.smithi016.stderr: -239> 2024-09-12T17:23:20.215+0000 7fe1c09b3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:20.852 INFO:tasks.workunit.client.0.smithi016.stderr: -238> 2024-09-12T17:23:20.215+0000 7fe1c09b3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:20.852 INFO:tasks.workunit.client.0.smithi016.stderr: -237> 2024-09-12T17:23:20.215+0000 7fe1c09b3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:20.852 INFO:tasks.workunit.client.0.smithi016.stderr: -236> 2024-09-12T17:23:20.215+0000 7fe1bf9b1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:20.852 INFO:tasks.workunit.client.0.smithi016.stderr: -235> 2024-09-12T17:23:20.215+0000 7fe1bf9b1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:20.852 INFO:tasks.workunit.client.0.smithi016.stderr: -234> 2024-09-12T17:23:20.215+0000 7fe1bf9b1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:20.852 INFO:tasks.workunit.client.0.smithi016.stderr: -233> 2024-09-12T17:23:20.215+0000 7fe1c01b2640 10 monclient(hunting): get_auth_request con 0x559dadfbd5b0 auth_method 0 2024-09-12T17:23:20.852 INFO:tasks.workunit.client.0.smithi016.stderr: -232> 2024-09-12T17:23:20.215+0000 7fe1c01b2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:20.852 INFO:tasks.workunit.client.0.smithi016.stderr: -231> 2024-09-12T17:23:20.215+0000 7fe1c01b2640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:20.852 INFO:tasks.workunit.client.0.smithi016.stderr: -230> 2024-09-12T17:23:20.215+0000 7fe1c01b2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:20.853 INFO:tasks.workunit.client.0.smithi016.stderr: -229> 2024-09-12T17:23:20.215+0000 7fe1c09b3640 10 monclient(hunting): handle_auth_done global_id 8241 payload 274 2024-09-12T17:23:20.853 INFO:tasks.workunit.client.0.smithi016.stderr: -228> 2024-09-12T17:23:20.215+0000 7fe1c09b3640 10 monclient: _finish_hunting 0 2024-09-12T17:23:20.853 INFO:tasks.workunit.client.0.smithi016.stderr: -227> 2024-09-12T17:23:20.215+0000 7fe1c09b3640 1 monclient: found mon.noname-a 2024-09-12T17:23:20.853 INFO:tasks.workunit.client.0.smithi016.stderr: -226> 2024-09-12T17:23:20.215+0000 7fe1c09b3640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:23:20.853 INFO:tasks.workunit.client.0.smithi016.stderr: -225> 2024-09-12T17:23:20.215+0000 7fe0977fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:20.853 INFO:tasks.workunit.client.0.smithi016.stderr: -224> 2024-09-12T17:23:20.215+0000 7fe0977fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:23:20.853 INFO:tasks.workunit.client.0.smithi016.stderr: -223> 2024-09-12T17:23:20.215+0000 7fe0977fe640 10 monclient: dump: 2024-09-12T17:23:20.853 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:23:20.853 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:23:20.853 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:20.853 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:20.853 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:20.853 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:20.854 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:23:20.854 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:23:20.854 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:23:20.854 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:20.854 INFO:tasks.workunit.client.0.smithi016.stderr: -222> 2024-09-12T17:23:20.215+0000 7fe0977fe640 10 monclient: _finish_auth 0 2024-09-12T17:23:20.854 INFO:tasks.workunit.client.0.smithi016.stderr: -221> 2024-09-12T17:23:20.215+0000 7fe0977fe640 10 monclient: _check_auth_tickets 2024-09-12T17:23:20.854 INFO:tasks.workunit.client.0.smithi016.stderr: -220> 2024-09-12T17:23:20.215+0000 7fe0977fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:23:20.854 INFO:tasks.workunit.client.0.smithi016.stderr: -219> 2024-09-12T17:23:20.215+0000 7fe0977fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:20.854 INFO:tasks.workunit.client.0.smithi016.stderr: -218> 2024-09-12T17:23:20.215+0000 7fe0977fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:23:20.855 INFO:tasks.workunit.client.0.smithi016.stderr: -217> 2024-09-12T17:23:20.215+0000 7fe0977fe640 10 monclient: dump: 2024-09-12T17:23:20.855 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:23:20.855 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:23:20.855 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:20.855 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:20.855 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:20.855 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:20.855 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:23:20.856 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:23:20.856 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:23:20.856 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:20.856 INFO:tasks.workunit.client.0.smithi016.stderr: -216> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 monclient: authenticate success, global_id 8241 2024-09-12T17:23:20.856 INFO:tasks.workunit.client.0.smithi016.stderr: -215> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 10 monclient: get_monmap_and_config success 2024-09-12T17:23:20.856 INFO:tasks.workunit.client.0.smithi016.stderr: -214> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 4 set_mon_vals no callback set 2024-09-12T17:23:20.856 INFO:tasks.workunit.client.0.smithi016.stderr: -213> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 10 monclient: shutdown 2024-09-12T17:23:20.856 INFO:tasks.workunit.client.0.smithi016.stderr: -212> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 10 monclient: build_initial_monmap 2024-09-12T17:23:20.856 INFO:tasks.workunit.client.0.smithi016.stderr: -211> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 1 build_initial for_mkfs: 0 2024-09-12T17:23:20.856 INFO:tasks.workunit.client.0.smithi016.stderr: -210> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 10 monclient: monmap: 2024-09-12T17:23:20.856 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:23:20.856 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:23:20.856 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:23:20.857 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:23:20.857 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:23:20.857 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:20.857 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:23:20.857 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:23:20.857 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:23:20.857 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:20.857 INFO:tasks.workunit.client.0.smithi016.stderr: -209> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadfc7b90) adding auth protocol: cephx 2024-09-12T17:23:20.857 INFO:tasks.workunit.client.0.smithi016.stderr: -208> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadfc7b90) adding auth protocol: cephx 2024-09-12T17:23:20.857 INFO:tasks.workunit.client.0.smithi016.stderr: -207> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadfc7b90) adding auth protocol: cephx 2024-09-12T17:23:20.857 INFO:tasks.workunit.client.0.smithi016.stderr: -206> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadfc7b90) adding con mode: secure 2024-09-12T17:23:20.857 INFO:tasks.workunit.client.0.smithi016.stderr: -205> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadfc7b90) adding con mode: crc 2024-09-12T17:23:20.858 INFO:tasks.workunit.client.0.smithi016.stderr: -204> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadfc7b90) adding con mode: secure 2024-09-12T17:23:20.858 INFO:tasks.workunit.client.0.smithi016.stderr: -203> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadfc7b90) adding con mode: crc 2024-09-12T17:23:20.858 INFO:tasks.workunit.client.0.smithi016.stderr: -202> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadfc7b90) adding con mode: secure 2024-09-12T17:23:20.858 INFO:tasks.workunit.client.0.smithi016.stderr: -201> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadfc7b90) adding con mode: crc 2024-09-12T17:23:20.858 INFO:tasks.workunit.client.0.smithi016.stderr: -200> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadfc7b90) adding con mode: crc 2024-09-12T17:23:20.858 INFO:tasks.workunit.client.0.smithi016.stderr: -199> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadfc7b90) adding con mode: secure 2024-09-12T17:23:20.858 INFO:tasks.workunit.client.0.smithi016.stderr: -198> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadfc7b90) adding con mode: crc 2024-09-12T17:23:20.858 INFO:tasks.workunit.client.0.smithi016.stderr: -197> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadfc7b90) adding con mode: secure 2024-09-12T17:23:20.858 INFO:tasks.workunit.client.0.smithi016.stderr: -196> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadfc7b90) adding con mode: crc 2024-09-12T17:23:20.858 INFO:tasks.workunit.client.0.smithi016.stderr: -195> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadfc7b90) adding con mode: secure 2024-09-12T17:23:20.858 INFO:tasks.workunit.client.0.smithi016.stderr: -194> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.858 INFO:tasks.workunit.client.0.smithi016.stderr: -193> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 1 librados: starting msgr at 2024-09-12T17:23:20.858 INFO:tasks.workunit.client.0.smithi016.stderr: -192> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 1 librados: starting objecter 2024-09-12T17:23:20.859 INFO:tasks.workunit.client.0.smithi016.stderr: -191> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 asok(0x559dadcec2b0) register_command objecter_requests cmddesc objecter_requests hook 0x559dadfc8bd0 EEXIST 2024-09-12T17:23:20.859 INFO:tasks.workunit.client.0.smithi016.stderr: -190> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 1 librados: setting wanted keys 2024-09-12T17:23:20.859 INFO:tasks.workunit.client.0.smithi016.stderr: -189> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 1 librados: calling monclient init 2024-09-12T17:23:20.859 INFO:tasks.workunit.client.0.smithi016.stderr: -188> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 10 monclient: init 2024-09-12T17:23:20.859 INFO:tasks.workunit.client.0.smithi016.stderr: -187> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf79940) adding auth protocol: cephx 2024-09-12T17:23:20.859 INFO:tasks.workunit.client.0.smithi016.stderr: -186> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf79940) adding auth protocol: cephx 2024-09-12T17:23:20.859 INFO:tasks.workunit.client.0.smithi016.stderr: -185> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf79940) adding auth protocol: cephx 2024-09-12T17:23:20.859 INFO:tasks.workunit.client.0.smithi016.stderr: -184> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf79940) adding con mode: secure 2024-09-12T17:23:20.859 INFO:tasks.workunit.client.0.smithi016.stderr: -183> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf79940) adding con mode: crc 2024-09-12T17:23:20.859 INFO:tasks.workunit.client.0.smithi016.stderr: -182> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf79940) adding con mode: secure 2024-09-12T17:23:20.859 INFO:tasks.workunit.client.0.smithi016.stderr: -181> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf79940) adding con mode: crc 2024-09-12T17:23:20.859 INFO:tasks.workunit.client.0.smithi016.stderr: -180> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf79940) adding con mode: secure 2024-09-12T17:23:20.859 INFO:tasks.workunit.client.0.smithi016.stderr: -179> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf79940) adding con mode: crc 2024-09-12T17:23:20.859 INFO:tasks.workunit.client.0.smithi016.stderr: -178> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf79940) adding con mode: crc 2024-09-12T17:23:20.860 INFO:tasks.workunit.client.0.smithi016.stderr: -177> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf79940) adding con mode: secure 2024-09-12T17:23:20.860 INFO:tasks.workunit.client.0.smithi016.stderr: -176> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf79940) adding con mode: crc 2024-09-12T17:23:20.860 INFO:tasks.workunit.client.0.smithi016.stderr: -175> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf79940) adding con mode: secure 2024-09-12T17:23:20.860 INFO:tasks.workunit.client.0.smithi016.stderr: -174> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf79940) adding con mode: crc 2024-09-12T17:23:20.860 INFO:tasks.workunit.client.0.smithi016.stderr: -173> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 AuthRegistry(0x559dadf79940) adding con mode: secure 2024-09-12T17:23:20.860 INFO:tasks.workunit.client.0.smithi016.stderr: -172> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.860 INFO:tasks.workunit.client.0.smithi016.stderr: -171> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.860 INFO:tasks.workunit.client.0.smithi016.stderr: -170> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 5 asok(0x559dadcec2b0) register_command rotate-key cmddesc rotate-key hook 0x559dadf79a88 EEXIST 2024-09-12T17:23:20.860 INFO:tasks.workunit.client.0.smithi016.stderr: -169> 2024-09-12T17:23:20.215+0000 7fe1c26ac9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:23:20.860 INFO:tasks.workunit.client.0.smithi016.stderr: -168> 2024-09-12T17:23:20.219+0000 7fe1c26ac9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:23:20.860 INFO:tasks.workunit.client.0.smithi016.stderr: -167> 2024-09-12T17:23:20.219+0000 7fe1c26ac9c0 10 monclient(hunting): picked mon.noname-b con 0x559dadfbd5b0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:23:20.860 INFO:tasks.workunit.client.0.smithi016.stderr: -166> 2024-09-12T17:23:20.219+0000 7fe1c26ac9c0 10 monclient(hunting): picked mon.noname-c con 0x559dadfc6e40 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:23:20.860 INFO:tasks.workunit.client.0.smithi016.stderr: -165> 2024-09-12T17:23:20.219+0000 7fe1c26ac9c0 10 monclient(hunting): picked mon.noname-a con 0x559dadfcb9a0 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:23:20.861 INFO:tasks.workunit.client.0.smithi016.stderr: -164> 2024-09-12T17:23:20.219+0000 7fe1c26ac9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.861 INFO:tasks.workunit.client.0.smithi016.stderr: -163> 2024-09-12T17:23:20.219+0000 7fe1c26ac9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.861 INFO:tasks.workunit.client.0.smithi016.stderr: -162> 2024-09-12T17:23:20.219+0000 7fe1c26ac9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:20.861 INFO:tasks.workunit.client.0.smithi016.stderr: -161> 2024-09-12T17:23:20.219+0000 7fe1c26ac9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:23:20.861 INFO:tasks.workunit.client.0.smithi016.stderr: -160> 2024-09-12T17:23:20.219+0000 7fe1c26ac9c0 10 monclient(hunting): authenticate will time out at 2518.196077s 2024-09-12T17:23:20.861 INFO:tasks.workunit.client.0.smithi016.stderr: -159> 2024-09-12T17:23:20.219+0000 7fe1c01b2640 10 monclient(hunting): get_auth_request con 0x559dadfcb9a0 auth_method 0 2024-09-12T17:23:20.861 INFO:tasks.workunit.client.0.smithi016.stderr: -158> 2024-09-12T17:23:20.219+0000 7fe1c01b2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:20.861 INFO:tasks.workunit.client.0.smithi016.stderr: -157> 2024-09-12T17:23:20.219+0000 7fe1c01b2640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:20.861 INFO:tasks.workunit.client.0.smithi016.stderr: -156> 2024-09-12T17:23:20.219+0000 7fe1c01b2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:20.861 INFO:tasks.workunit.client.0.smithi016.stderr: -155> 2024-09-12T17:23:20.219+0000 7fe1c09b3640 10 monclient(hunting): get_auth_request con 0x559dadfc6e40 auth_method 0 2024-09-12T17:23:20.861 INFO:tasks.workunit.client.0.smithi016.stderr: -154> 2024-09-12T17:23:20.219+0000 7fe1c09b3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:20.861 INFO:tasks.workunit.client.0.smithi016.stderr: -153> 2024-09-12T17:23:20.219+0000 7fe1c09b3640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:20.862 INFO:tasks.workunit.client.0.smithi016.stderr: -152> 2024-09-12T17:23:20.219+0000 7fe1c09b3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:20.862 INFO:tasks.workunit.client.0.smithi016.stderr: -151> 2024-09-12T17:23:20.219+0000 7fe1c01b2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:20.862 INFO:tasks.workunit.client.0.smithi016.stderr: -150> 2024-09-12T17:23:20.219+0000 7fe1c01b2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:20.862 INFO:tasks.workunit.client.0.smithi016.stderr: -149> 2024-09-12T17:23:20.219+0000 7fe1c01b2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:20.862 INFO:tasks.workunit.client.0.smithi016.stderr: -148> 2024-09-12T17:23:20.219+0000 7fe1c09b3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:20.862 INFO:tasks.workunit.client.0.smithi016.stderr: -147> 2024-09-12T17:23:20.219+0000 7fe1c09b3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:20.862 INFO:tasks.workunit.client.0.smithi016.stderr: -146> 2024-09-12T17:23:20.219+0000 7fe1c09b3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:20.862 INFO:tasks.workunit.client.0.smithi016.stderr: -145> 2024-09-12T17:23:20.219+0000 7fe1c09b3640 10 monclient(hunting): handle_auth_done global_id 7829 payload 824 2024-09-12T17:23:20.862 INFO:tasks.workunit.client.0.smithi016.stderr: -144> 2024-09-12T17:23:20.219+0000 7fe1c09b3640 10 monclient: _finish_hunting 0 2024-09-12T17:23:20.862 INFO:tasks.workunit.client.0.smithi016.stderr: -143> 2024-09-12T17:23:20.219+0000 7fe1c09b3640 1 monclient: found mon.noname-c 2024-09-12T17:23:20.862 INFO:tasks.workunit.client.0.smithi016.stderr: -142> 2024-09-12T17:23:20.219+0000 7fe1c09b3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:23:20.862 INFO:tasks.workunit.client.0.smithi016.stderr: -141> 2024-09-12T17:23:20.219+0000 7fe1bf9b1640 10 monclient: get_auth_request con 0x559dadfbd5b0 auth_method 0 2024-09-12T17:23:20.862 INFO:tasks.workunit.client.0.smithi016.stderr: -140> 2024-09-12T17:23:20.219+0000 7fe095ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:20.863 INFO:tasks.workunit.client.0.smithi016.stderr: -139> 2024-09-12T17:23:20.219+0000 7fe095ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:23:20.863 INFO:tasks.workunit.client.0.smithi016.stderr: -138> 2024-09-12T17:23:20.219+0000 7fe095ffb640 10 monclient: dump: 2024-09-12T17:23:20.863 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:23:20.863 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:23:20.863 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:20.863 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:20.863 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:20.863 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:20.863 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:23:20.863 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:23:20.863 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:23:20.863 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:20.863 INFO:tasks.workunit.client.0.smithi016.stderr: -137> 2024-09-12T17:23:20.219+0000 7fe095ffb640 10 monclient: _finish_auth 0 2024-09-12T17:23:20.863 INFO:tasks.workunit.client.0.smithi016.stderr: -136> 2024-09-12T17:23:20.219+0000 7fe095ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:23:20.864 INFO:tasks.workunit.client.0.smithi016.stderr: -135> 2024-09-12T17:23:20.219+0000 7fe095ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:23:20.864 INFO:tasks.workunit.client.0.smithi016.stderr: -134> 2024-09-12T17:23:20.219+0000 7fe095ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:20.864 INFO:tasks.workunit.client.0.smithi016.stderr: -133> 2024-09-12T17:23:20.219+0000 7fe095ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:23:20.864 INFO:tasks.workunit.client.0.smithi016.stderr: -132> 2024-09-12T17:23:20.219+0000 7fe095ffb640 10 monclient: dump: 2024-09-12T17:23:20.864 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:23:20.864 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:23:20.864 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:20.864 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:20.864 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:20.864 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:20.864 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:23:20.864 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:23:20.864 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:23:20.865 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:20.865 INFO:tasks.workunit.client.0.smithi016.stderr: -131> 2024-09-12T17:23:20.219+0000 7fe1c26ac9c0 5 monclient: authenticate success, global_id 7829 2024-09-12T17:23:20.865 INFO:tasks.workunit.client.0.smithi016.stderr: -130> 2024-09-12T17:23:20.219+0000 7fe0977fe640 4 set_mon_vals no callback set 2024-09-12T17:23:20.865 INFO:tasks.workunit.client.0.smithi016.stderr: -129> 2024-09-12T17:23:20.219+0000 7fe1c26ac9c0 10 monclient: _renew_subs 2024-09-12T17:23:20.865 INFO:tasks.workunit.client.0.smithi016.stderr: -128> 2024-09-12T17:23:20.219+0000 7fe1c26ac9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:23:20.865 INFO:tasks.workunit.client.0.smithi016.stderr: -127> 2024-09-12T17:23:20.219+0000 7fe1c26ac9c0 10 monclient: _renew_subs 2024-09-12T17:23:20.865 INFO:tasks.workunit.client.0.smithi016.stderr: -126> 2024-09-12T17:23:20.219+0000 7fe1c26ac9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.16:3301/0 2024-09-12T17:23:20.865 INFO:tasks.workunit.client.0.smithi016.stderr: -125> 2024-09-12T17:23:20.219+0000 7fe1c26ac9c0 1 librados: init done 2024-09-12T17:23:20.865 INFO:tasks.workunit.client.0.smithi016.stderr: -124> 2024-09-12T17:23:20.219+0000 7fe1c26ac9c0 5 asok(0x559dadcec2b0) register_command cr dump hook 0x559dadfc7a08 2024-09-12T17:23:20.865 INFO:tasks.workunit.client.0.smithi016.stderr: -123> 2024-09-12T17:23:20.219+0000 7fe1c26ac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.866 INFO:tasks.workunit.client.0.smithi016.stderr: -122> 2024-09-12T17:23:20.219+0000 7fe095ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:23:20.866 INFO:tasks.workunit.client.0.smithi016.stderr: -121> 2024-09-12T17:23:20.219+0000 7fe095ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:23:20.866 INFO:tasks.workunit.client.0.smithi016.stderr: -120> 2024-09-12T17:23:20.219+0000 7fe095ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:23:20.866 INFO:tasks.workunit.client.0.smithi016.stderr: -119> 2024-09-12T17:23:20.219+0000 7fe1bf9b1640 10 monclient: get_auth_request con 0x7fe088070ae0 auth_method 0 2024-09-12T17:23:20.866 INFO:tasks.workunit.client.0.smithi016.stderr: -118> 2024-09-12T17:23:20.219+0000 7fe1c01b2640 10 monclient: get_auth_request con 0x559dadfe52d0 auth_method 0 2024-09-12T17:23:20.866 INFO:tasks.workunit.client.0.smithi016.stderr: -117> 2024-09-12T17:23:20.223+0000 7fe1c26ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.866 INFO:tasks.workunit.client.0.smithi016.stderr: -116> 2024-09-12T17:23:20.223+0000 7fe1c26ac9c0 20 realm 2024-09-12T17:23:20.866 INFO:tasks.workunit.client.0.smithi016.stderr: -115> 2024-09-12T17:23:20.223+0000 7fe1c26ac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.866 INFO:tasks.workunit.client.0.smithi016.stderr: -114> 2024-09-12T17:23:20.223+0000 7fe1c26ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.866 INFO:tasks.workunit.client.0.smithi016.stderr: -113> 2024-09-12T17:23:20.223+0000 7fe1c26ac9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:20.866 INFO:tasks.workunit.client.0.smithi016.stderr: -112> 2024-09-12T17:23:20.223+0000 7fe1c26ac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.867 INFO:tasks.workunit.client.0.smithi016.stderr: -111> 2024-09-12T17:23:20.223+0000 7fe1c26ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.867 INFO:tasks.workunit.client.0.smithi016.stderr: -110> 2024-09-12T17:23:20.223+0000 7fe1c26ac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.867 INFO:tasks.workunit.client.0.smithi016.stderr: -109> 2024-09-12T17:23:20.223+0000 7fe1bf9b1640 10 monclient: get_auth_request con 0x559dadfe9550 auth_method 0 2024-09-12T17:23:20.867 INFO:tasks.workunit.client.0.smithi016.stderr: -108> 2024-09-12T17:23:20.223+0000 7fe1c26ac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:20.867 INFO:tasks.workunit.client.0.smithi016.stderr: -107> 2024-09-12T17:23:20.223+0000 7fe1c26ac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.868 INFO:tasks.workunit.client.0.smithi016.stderr: -106> 2024-09-12T17:23:20.223+0000 7fe1c09b3640 10 monclient: get_auth_request con 0x559dadfecdb0 auth_method 0 2024-09-12T17:23:20.868 INFO:tasks.workunit.client.0.smithi016.stderr: -105> 2024-09-12T17:23:20.227+0000 7fe1c26ac9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:20.868 INFO:tasks.workunit.client.0.smithi016.stderr: -104> 2024-09-12T17:23:20.227+0000 7fe1c26ac9c0 20 searching for the correct realm 2024-09-12T17:23:20.868 INFO:tasks.workunit.client.0.smithi016.stderr: -103> 2024-09-12T17:23:20.227+0000 7fe1c01b2640 10 monclient: get_auth_request con 0x559dadff1b70 auth_method 0 2024-09-12T17:23:20.868 INFO:tasks.workunit.client.0.smithi016.stderr: -102> 2024-09-12T17:23:20.227+0000 7fe1bf9b1640 10 monclient: get_auth_request con 0x7fe1b0008070 auth_method 0 2024-09-12T17:23:20.868 INFO:tasks.workunit.client.0.smithi016.stderr: -101> 2024-09-12T17:23:20.227+0000 7fe1c09b3640 10 monclient: get_auth_request con 0x7fe1b40dd420 auth_method 0 2024-09-12T17:23:20.869 INFO:tasks.workunit.client.0.smithi016.stderr: -100> 2024-09-12T17:23:20.227+0000 7fe1c09b3640 0 -- 172.21.15.16:0/3064311245 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fe1b40dd420 msgr2=0x7fe1b40dd840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:20.869 INFO:tasks.workunit.client.0.smithi016.stderr: -99> 2024-09-12T17:23:20.431+0000 7fe1c09b3640 10 monclient: get_auth_request con 0x7fe1b40dd420 auth_method 0 2024-09-12T17:23:20.869 INFO:tasks.workunit.client.0.smithi016.stderr: -98> 2024-09-12T17:23:20.435+0000 7fe1c01b2640 10 monclient: get_auth_request con 0x7fe1b8025030 auth_method 0 2024-09-12T17:23:20.869 INFO:tasks.workunit.client.0.smithi016.stderr: -97> 2024-09-12T17:23:20.443+0000 7fe1bf9b1640 0 -- 172.21.15.16:0/3064311245 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fe1b8018040 msgr2=0x7fe1b806a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:20.869 INFO:tasks.workunit.client.0.smithi016.stderr: -96> 2024-09-12T17:23:20.443+0000 7fe1bf9b1640 10 monclient: get_auth_request con 0x7fe1b8018040 auth_method 0 2024-09-12T17:23:20.870 INFO:tasks.workunit.client.0.smithi016.stderr: -95> 2024-09-12T17:23:20.647+0000 7fe1bf9b1640 10 monclient: get_auth_request con 0x7fe1b8018040 auth_method 0 2024-09-12T17:23:20.870 INFO:tasks.workunit.client.0.smithi016.stderr: -94> 2024-09-12T17:23:20.659+0000 7fe1c26ac9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:23:20.870 INFO:tasks.workunit.client.0.smithi016.stderr: -93> 2024-09-12T17:23:20.659+0000 7fe1c26ac9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:20.870 INFO:tasks.workunit.client.0.smithi016.stderr: -92> 2024-09-12T17:23:20.659+0000 7fe1c26ac9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:23:20.870 INFO:tasks.workunit.client.0.smithi016.stderr: -91> 2024-09-12T17:23:20.659+0000 7fe1c26ac9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:20.871 INFO:tasks.workunit.client.0.smithi016.stderr: -90> 2024-09-12T17:23:20.659+0000 7fe1c26ac9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:20.871 INFO:tasks.workunit.client.0.smithi016.stderr: -89> 2024-09-12T17:23:20.659+0000 7fe1c26ac9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:20.871 INFO:tasks.workunit.client.0.smithi016.stderr: -88> 2024-09-12T17:23:20.659+0000 7fe1c26ac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.872 INFO:tasks.workunit.client.0.smithi016.stderr: -87> 2024-09-12T17:23:20.663+0000 7fe1c26ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.872 INFO:tasks.workunit.client.0.smithi016.stderr: -86> 2024-09-12T17:23:20.663+0000 7fe1c26ac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.872 INFO:tasks.workunit.client.0.smithi016.stderr: -85> 2024-09-12T17:23:20.663+0000 7fe1c26ac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:20.872 INFO:tasks.workunit.client.0.smithi016.stderr: -84> 2024-09-12T17:23:20.663+0000 7fe1c26ac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.873 INFO:tasks.workunit.client.0.smithi016.stderr: -83> 2024-09-12T17:23:20.663+0000 7fe1c26ac9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:20.873 INFO:tasks.workunit.client.0.smithi016.stderr: -82> 2024-09-12T17:23:20.663+0000 7fe1c26ac9c0 20 zone default found 2024-09-12T17:23:20.873 INFO:tasks.workunit.client.0.smithi016.stderr: -81> 2024-09-12T17:23:20.663+0000 7fe1c26ac9c0 4 Realm: () 2024-09-12T17:23:20.873 INFO:tasks.workunit.client.0.smithi016.stderr: -80> 2024-09-12T17:23:20.663+0000 7fe1c26ac9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:23:20.874 INFO:tasks.workunit.client.0.smithi016.stderr: -79> 2024-09-12T17:23:20.663+0000 7fe1c26ac9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:23:20.874 INFO:tasks.workunit.client.0.smithi016.stderr: -78> 2024-09-12T17:23:20.663+0000 7fe1c26ac9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:20.874 INFO:tasks.workunit.client.0.smithi016.stderr: -77> 2024-09-12T17:23:20.663+0000 7fe1c26ac9c0 20 zonegroup default 2024-09-12T17:23:20.874 INFO:tasks.workunit.client.0.smithi016.stderr: -76> 2024-09-12T17:23:20.663+0000 7fe1c26ac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.875 INFO:tasks.workunit.client.0.smithi016.stderr: -75> 2024-09-12T17:23:20.663+0000 7fe1c26ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.875 INFO:tasks.workunit.client.0.smithi016.stderr: -74> 2024-09-12T17:23:20.663+0000 7fe1c26ac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.875 INFO:tasks.workunit.client.0.smithi016.stderr: -73> 2024-09-12T17:23:20.667+0000 7fe1c26ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.875 INFO:tasks.workunit.client.0.smithi016.stderr: -72> 2024-09-12T17:23:20.667+0000 7fe1c26ac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.875 INFO:tasks.workunit.client.0.smithi016.stderr: -71> 2024-09-12T17:23:20.667+0000 7fe1c26ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.876 INFO:tasks.workunit.client.0.smithi016.stderr: -70> 2024-09-12T17:23:20.667+0000 7fe1c26ac9c0 20 started sync module instance, tier type = 2024-09-12T17:23:20.876 INFO:tasks.workunit.client.0.smithi016.stderr: -69> 2024-09-12T17:23:20.667+0000 7fe1c26ac9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:23:20.876 INFO:tasks.workunit.client.0.smithi016.stderr: -68> 2024-09-12T17:23:20.691+0000 7fe1c26ac9c0 20 add_watcher() i=0 2024-09-12T17:23:20.876 INFO:tasks.workunit.client.0.smithi016.stderr: -67> 2024-09-12T17:23:20.691+0000 7fe1c26ac9c0 20 add_watcher() i=1 2024-09-12T17:23:20.877 INFO:tasks.workunit.client.0.smithi016.stderr: -66> 2024-09-12T17:23:20.691+0000 7fe1c26ac9c0 20 add_watcher() i=2 2024-09-12T17:23:20.877 INFO:tasks.workunit.client.0.smithi016.stderr: -65> 2024-09-12T17:23:20.691+0000 7fe1c26ac9c0 20 add_watcher() i=3 2024-09-12T17:23:20.877 INFO:tasks.workunit.client.0.smithi016.stderr: -64> 2024-09-12T17:23:20.691+0000 7fe1c26ac9c0 20 add_watcher() i=4 2024-09-12T17:23:20.877 INFO:tasks.workunit.client.0.smithi016.stderr: -63> 2024-09-12T17:23:20.691+0000 7fe1c26ac9c0 20 add_watcher() i=5 2024-09-12T17:23:20.877 INFO:tasks.workunit.client.0.smithi016.stderr: -62> 2024-09-12T17:23:20.691+0000 7fe1c26ac9c0 20 add_watcher() i=6 2024-09-12T17:23:20.877 INFO:tasks.workunit.client.0.smithi016.stderr: -61> 2024-09-12T17:23:20.695+0000 7fe1c26ac9c0 20 add_watcher() i=7 2024-09-12T17:23:20.877 INFO:tasks.workunit.client.0.smithi016.stderr: -60> 2024-09-12T17:23:20.695+0000 7fe1c26ac9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:20.877 INFO:tasks.workunit.client.0.smithi016.stderr: -59> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c7290) adding auth protocol: cephx 2024-09-12T17:23:20.877 INFO:tasks.workunit.client.0.smithi016.stderr: -58> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c7290) adding auth protocol: cephx 2024-09-12T17:23:20.877 INFO:tasks.workunit.client.0.smithi016.stderr: -57> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c7290) adding auth protocol: cephx 2024-09-12T17:23:20.877 INFO:tasks.workunit.client.0.smithi016.stderr: -56> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c7290) adding con mode: secure 2024-09-12T17:23:20.878 INFO:tasks.workunit.client.0.smithi016.stderr: -55> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c7290) adding con mode: crc 2024-09-12T17:23:20.878 INFO:tasks.workunit.client.0.smithi016.stderr: -54> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c7290) adding con mode: secure 2024-09-12T17:23:20.878 INFO:tasks.workunit.client.0.smithi016.stderr: -53> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c7290) adding con mode: crc 2024-09-12T17:23:20.878 INFO:tasks.workunit.client.0.smithi016.stderr: -52> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c7290) adding con mode: secure 2024-09-12T17:23:20.878 INFO:tasks.workunit.client.0.smithi016.stderr: -51> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c7290) adding con mode: crc 2024-09-12T17:23:20.878 INFO:tasks.workunit.client.0.smithi016.stderr: -50> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c7290) adding con mode: crc 2024-09-12T17:23:20.878 INFO:tasks.workunit.client.0.smithi016.stderr: -49> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c7290) adding con mode: secure 2024-09-12T17:23:20.878 INFO:tasks.workunit.client.0.smithi016.stderr: -48> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c7290) adding con mode: crc 2024-09-12T17:23:20.878 INFO:tasks.workunit.client.0.smithi016.stderr: -47> 2024-09-12T17:23:20.699+0000 7fe076fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:20.878 INFO:tasks.workunit.client.0.smithi016.stderr: -46> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c7290) adding con mode: secure 2024-09-12T17:23:20.878 INFO:tasks.workunit.client.0.smithi016.stderr: -45> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c7290) adding con mode: crc 2024-09-12T17:23:20.878 INFO:tasks.workunit.client.0.smithi016.stderr: -44> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 AuthRegistry(0x7fff631c7290) adding con mode: secure 2024-09-12T17:23:20.878 INFO:tasks.workunit.client.0.smithi016.stderr: -43> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:20.879 INFO:tasks.workunit.client.0.smithi016.stderr: -42> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:20.879 INFO:tasks.workunit.client.0.smithi016.stderr: -41> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:20.879 INFO:tasks.workunit.client.0.smithi016.stderr: -40> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 asok(0x559dadcec2b0) register_command cache list hook 0x559dadfc5070 2024-09-12T17:23:20.879 INFO:tasks.workunit.client.0.smithi016.stderr: -39> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 asok(0x559dadcec2b0) register_command cache inspect hook 0x559dadfc5070 2024-09-12T17:23:20.879 INFO:tasks.workunit.client.0.smithi016.stderr: -38> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 asok(0x559dadcec2b0) register_command cache erase hook 0x559dadfc5070 2024-09-12T17:23:20.879 INFO:tasks.workunit.client.0.smithi016.stderr: -37> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 asok(0x559dadcec2b0) register_command cache zap hook 0x559dadfc5070 2024-09-12T17:23:20.879 INFO:tasks.workunit.client.0.smithi016.stderr: -36> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 note: GC not initialized 2024-09-12T17:23:20.879 INFO:tasks.workunit.client.0.smithi016.stderr: -35> 2024-09-12T17:23:20.699+0000 7fe075fdb640 20 reqs_thread_entry: start 2024-09-12T17:23:20.879 INFO:tasks.workunit.client.0.smithi016.stderr: -34> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 asok(0x559dadcec2b0) register_command sync trace show hook 0x7fe1b4004300 2024-09-12T17:23:20.879 INFO:tasks.workunit.client.0.smithi016.stderr: -33> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 asok(0x559dadcec2b0) register_command sync trace history hook 0x7fe1b4004300 2024-09-12T17:23:20.879 INFO:tasks.workunit.client.0.smithi016.stderr: -32> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 asok(0x559dadcec2b0) register_command sync trace active hook 0x7fe1b4004300 2024-09-12T17:23:20.879 INFO:tasks.workunit.client.0.smithi016.stderr: -31> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 5 asok(0x559dadcec2b0) register_command sync trace active_short hook 0x7fe1b4004300 2024-09-12T17:23:20.880 INFO:tasks.workunit.client.0.smithi016.stderr: -30> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:23:20.880 INFO:tasks.workunit.client.0.smithi016.stderr: -29> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 20 Filter name: none 2024-09-12T17:23:20.880 INFO:tasks.workunit.client.0.smithi016.stderr: -28> 2024-09-12T17:23:20.699+0000 7fdfe77fe640 20 reqs_thread_entry: start 2024-09-12T17:23:20.880 INFO:tasks.workunit.client.0.smithi016.stderr: -27> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:23:20.880 INFO:tasks.workunit.client.0.smithi016.stderr: -26> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.880 INFO:tasks.workunit.client.0.smithi016.stderr: -25> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:23:20.880 INFO:tasks.workunit.client.0.smithi016.stderr: -24> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:23:20.880 INFO:tasks.workunit.client.0.smithi016.stderr: -23> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:23:20.880 INFO:tasks.workunit.client.0.smithi016.stderr: -22> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 : miss 2024-09-12T17:23:20.881 INFO:tasks.workunit.client.0.smithi016.stderr: -21> 2024-09-12T17:23:20.699+0000 7fe1c26ac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.881 INFO:tasks.workunit.client.0.smithi016.stderr: -20> 2024-09-12T17:23:20.703+0000 7fe1c26ac9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T17:23:20.881 INFO:tasks.workunit.client.0.smithi016.stderr: -19> 2024-09-12T17:23:20.703+0000 7fe1c26ac9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:23:20.881 INFO:tasks.workunit.client.0.smithi016.stderr: -18> 2024-09-12T17:23:20.703+0000 7fe1c26ac9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:23:20.881 INFO:tasks.workunit.client.0.smithi016.stderr: -17> 2024-09-12T17:23:20.703+0000 7fe1c26ac9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:23:20.881 INFO:tasks.workunit.client.0.smithi016.stderr: -16> 2024-09-12T17:23:20.703+0000 7fe1c26ac9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:23:20.881 INFO:tasks.workunit.client.0.smithi016.stderr: -15> 2024-09-12T17:23:20.703+0000 7fe1c26ac9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 2024-09-12T17:23:20.881 INFO:tasks.workunit.client.0.smithi016.stderr: -14> 2024-09-12T17:23:20.703+0000 7fe1c26ac9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:23:20.881 INFO:tasks.workunit.client.0.smithi016.stderr: -13> 2024-09-12T17:23:20.715+0000 7fe1c26ac9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:23:20.881 INFO:tasks.workunit.client.0.smithi016.stderr: -12> 2024-09-12T17:23:20.715+0000 7fe1c26ac9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:23:20.881 INFO:tasks.workunit.client.0.smithi016.stderr: -11> 2024-09-12T17:23:20.715+0000 7fe1c26ac9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:23:20.882 INFO:tasks.workunit.client.0.smithi016.stderr: -10> 2024-09-12T17:23:20.715+0000 7fe1c26ac9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17, ofs0, ns] 2024-09-12T17:23:20.882 INFO:tasks.workunit.client.0.smithi016.stderr: -9> 2024-09-12T17:23:20.715+0000 7fe0977fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431630 cookie 94135717430176 notifier 7829 bl.length()=827 2024-09-12T17:23:20.882 INFO:tasks.workunit.client.0.smithi016.stderr: -8> 2024-09-12T17:23:20.715+0000 7fe0977fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:23:20.882 INFO:tasks.workunit.client.0.smithi016.stderr: -7> 2024-09-12T17:23:20.715+0000 7fe0977fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:23:20.882 INFO:tasks.workunit.client.0.smithi016.stderr: -6> 2024-09-12T17:23:20.715+0000 7fe0977fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:23:20.882 INFO:tasks.workunit.client.0.smithi016.stderr: -5> 2024-09-12T17:23:20.715+0000 7fe1c26ac9c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): orig_sources= new_sources= 2024-09-12T17:23:20.882 INFO:tasks.workunit.client.0.smithi016.stderr: -4> 2024-09-12T17:23:20.715+0000 7fe1c26ac9c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): potential sources added=[] removed=[] 2024-09-12T17:23:20.882 INFO:tasks.workunit.client.0.smithi016.stderr: -3> 2024-09-12T17:23:20.715+0000 7fe1c26ac9c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): orig_dests= new_dests= 2024-09-12T17:23:20.882 INFO:tasks.workunit.client.0.smithi016.stderr: -2> 2024-09-12T17:23:20.715+0000 7fe1c26ac9c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): potential dests added=[] removed=[] 2024-09-12T17:23:20.882 INFO:tasks.workunit.client.0.smithi016.stderr: -1> 2024-09-12T17:23:20.723+0000 7fe1c26ac9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe1c26ac9c0 time 2024-09-12T17:23:20.725729+0000 2024-09-12T17:23:20.882 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:23:20.882 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:20.882 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:23:20.883 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fe1c5f862eb] 2024-09-12T17:23:20.883 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe1c5f8649f] 2024-09-12T17:23:20.883 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559dac3660c1] 2024-09-12T17:23:20.883 INFO:tasks.workunit.client.0.smithi016.stderr: 4: radosgw-admin(+0x14100ec) [0x559dacdbc0ec] 2024-09-12T17:23:20.883 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559dac37818d] 2024-09-12T17:23:20.883 INFO:tasks.workunit.client.0.smithi016.stderr: 6: main() 2024-09-12T17:23:20.883 INFO:tasks.workunit.client.0.smithi016.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe1c4decd90] 2024-09-12T17:23:20.883 INFO:tasks.workunit.client.0.smithi016.stderr: 8: __libc_start_main() 2024-09-12T17:23:20.883 INFO:tasks.workunit.client.0.smithi016.stderr: 9: _start() 2024-09-12T17:23:20.883 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:20.883 INFO:tasks.workunit.client.0.smithi016.stderr: 0> 2024-09-12T17:23:20.727+0000 7fe1c26ac9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:23:20.883 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7fe1c26ac9c0 thread_name:radosgw-admin 2024-09-12T17:23:20.884 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:20.884 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:23:20.884 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fe1c4e05520] 2024-09-12T17:23:20.884 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:23:20.884 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:23:20.884 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:23:20.884 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fe1c5f86345] 2024-09-12T17:23:20.884 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe1c5f8649f] 2024-09-12T17:23:20.884 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559dac3660c1] 2024-09-12T17:23:20.884 INFO:tasks.workunit.client.0.smithi016.stderr: 8: radosgw-admin(+0x14100ec) [0x559dacdbc0ec] 2024-09-12T17:23:20.884 INFO:tasks.workunit.client.0.smithi016.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559dac37818d] 2024-09-12T17:23:20.884 INFO:tasks.workunit.client.0.smithi016.stderr: 10: main() 2024-09-12T17:23:20.884 INFO:tasks.workunit.client.0.smithi016.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe1c4decd90] 2024-09-12T17:23:20.885 INFO:tasks.workunit.client.0.smithi016.stderr: 12: __libc_start_main() 2024-09-12T17:23:20.885 INFO:tasks.workunit.client.0.smithi016.stderr: 13: _start() 2024-09-12T17:23:20.885 INFO:tasks.workunit.client.0.smithi016.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:23:20.885 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:20.885 INFO:tasks.workunit.client.0.smithi016.stderr:--- logging levels --- 2024-09-12T17:23:20.885 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 none 2024-09-12T17:23:20.885 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 lockdep 2024-09-12T17:23:20.885 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 context 2024-09-12T17:23:20.885 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 crush 2024-09-12T17:23:20.885 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds 2024-09-12T17:23:20.885 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_balancer 2024-09-12T17:23:20.885 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_locker 2024-09-12T17:23:20.886 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log 2024-09-12T17:23:20.886 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log_expire 2024-09-12T17:23:20.886 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_migrator 2024-09-12T17:23:20.886 INFO:tasks.workunit.client.0.smithi016.stderr: 3/ 5 mds_quiesce 2024-09-12T17:23:20.886 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 buffer 2024-09-12T17:23:20.886 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 timer 2024-09-12T17:23:20.886 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 filer 2024-09-12T17:23:20.886 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 striper 2024-09-12T17:23:20.886 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 objecter 2024-09-12T17:23:20.886 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rados 2024-09-12T17:23:20.886 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd 2024-09-12T17:23:20.886 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_mirror 2024-09-12T17:23:20.886 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_replay 2024-09-12T17:23:20.886 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_pwl 2024-09-12T17:23:20.887 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 journaler 2024-09-12T17:23:20.887 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objectcacher 2024-09-12T17:23:20.887 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:23:20.887 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 client 2024-09-12T17:23:20.887 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 osd 2024-09-12T17:23:20.887 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 optracker 2024-09-12T17:23:20.887 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objclass 2024-09-12T17:23:20.887 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 filestore 2024-09-12T17:23:20.887 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 journal 2024-09-12T17:23:20.887 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 ms 2024-09-12T17:23:20.887 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mon 2024-09-12T17:23:20.887 INFO:tasks.workunit.client.0.smithi016.stderr: 0/10 monc 2024-09-12T17:23:20.887 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 paxos 2024-09-12T17:23:20.887 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 tp 2024-09-12T17:23:20.888 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 auth 2024-09-12T17:23:20.888 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 crypto 2024-09-12T17:23:20.888 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 finisher 2024-09-12T17:23:20.888 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 reserver 2024-09-12T17:23:20.888 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 heartbeatmap 2024-09-12T17:23:20.888 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 perfcounter 2024-09-12T17:23:20.888 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw 2024-09-12T17:23:20.888 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_sync 2024-09-12T17:23:20.888 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_datacache 2024-09-12T17:23:20.888 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_access 2024-09-12T17:23:20.888 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:23:20.888 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_flight 2024-09-12T17:23:20.889 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:23:20.889 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw_notification 2024-09-12T17:23:20.889 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 javaclient 2024-09-12T17:23:20.889 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 asok 2024-09-12T17:23:20.889 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 throttle 2024-09-12T17:23:20.889 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 refs 2024-09-12T17:23:20.889 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 compressor 2024-09-12T17:23:20.889 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluestore 2024-09-12T17:23:20.889 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluefs 2024-09-12T17:23:20.889 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 bdev 2024-09-12T17:23:20.889 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 kstore 2024-09-12T17:23:20.889 INFO:tasks.workunit.client.0.smithi016.stderr: 4/ 5 rocksdb 2024-09-12T17:23:20.889 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 fuse 2024-09-12T17:23:20.890 INFO:tasks.workunit.client.0.smithi016.stderr: 2/ 5 mgr 2024-09-12T17:23:20.890 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mgrc 2024-09-12T17:23:20.890 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 dpdk 2024-09-12T17:23:20.890 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 eventtrace 2024-09-12T17:23:20.890 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 prioritycache 2024-09-12T17:23:20.890 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 test 2024-09-12T17:23:20.890 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:23:20.890 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephsqlite 2024-09-12T17:23:20.890 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:23:20.890 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore 2024-09-12T17:23:20.890 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_onode 2024-09-12T17:23:20.890 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_odata 2024-09-12T17:23:20.890 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_omap 2024-09-12T17:23:20.890 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_tm 2024-09-12T17:23:20.890 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_t 2024-09-12T17:23:20.890 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:23:20.891 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_epm 2024-09-12T17:23:20.891 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_lba 2024-09-12T17:23:20.891 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:23:20.891 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cache 2024-09-12T17:23:20.891 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_journal 2024-09-12T17:23:20.891 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_device 2024-09-12T17:23:20.891 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_backref 2024-09-12T17:23:20.891 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 alienstore 2024-09-12T17:23:20.891 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mclock 2024-09-12T17:23:20.891 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cyanstore 2024-09-12T17:23:20.891 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 ceph_exporter 2024-09-12T17:23:20.891 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 memstore 2024-09-12T17:23:20.892 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 trace 2024-09-12T17:23:20.892 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 ceph_dedup 2024-09-12T17:23:20.892 INFO:tasks.workunit.client.0.smithi016.stderr: -2/-2 (syslog threshold) 2024-09-12T17:23:20.892 INFO:tasks.workunit.client.0.smithi016.stderr: 99/99 (stderr threshold) 2024-09-12T17:23:20.892 INFO:tasks.workunit.client.0.smithi016.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:23:20.892 INFO:tasks.workunit.client.0.smithi016.stderr: 7fdfe77fe640 / http_manager 2024-09-12T17:23:20.892 INFO:tasks.workunit.client.0.smithi016.stderr: 7fe075fdb640 / http_manager 2024-09-12T17:23:20.892 INFO:tasks.workunit.client.0.smithi016.stderr: 7fe076fdd640 / rgw_dt_lg_renew 2024-09-12T17:23:20.892 INFO:tasks.workunit.client.0.smithi016.stderr: 7fe095ffb640 / ms_dispatch 2024-09-12T17:23:20.892 INFO:tasks.workunit.client.0.smithi016.stderr: 7fe0977fe640 / io_context_pool 2024-09-12T17:23:20.892 INFO:tasks.workunit.client.0.smithi016.stderr: 7fe0a5ffb640 / ms_dispatch 2024-09-12T17:23:20.893 INFO:tasks.workunit.client.0.smithi016.stderr: 7fe0ace09640 / ms_dispatch 2024-09-12T17:23:20.893 INFO:tasks.workunit.client.0.smithi016.stderr: 7fe0ae60c640 / io_context_pool 2024-09-12T17:23:20.893 INFO:tasks.workunit.client.0.smithi016.stderr: 7fe1bf9b1640 / msgr-worker-2 2024-09-12T17:23:20.893 INFO:tasks.workunit.client.0.smithi016.stderr: 7fe1c01b2640 / msgr-worker-1 2024-09-12T17:23:20.893 INFO:tasks.workunit.client.0.smithi016.stderr: 7fe1c09b3640 / msgr-worker-0 2024-09-12T17:23:20.893 INFO:tasks.workunit.client.0.smithi016.stderr: 7fe1c11b4640 / io_context_pool 2024-09-12T17:23:20.893 INFO:tasks.workunit.client.0.smithi016.stderr: 7fe1c26ac9c0 / radosgw-admin 2024-09-12T17:23:20.893 INFO:tasks.workunit.client.0.smithi016.stderr: max_recent 500 2024-09-12T17:23:20.893 INFO:tasks.workunit.client.0.smithi016.stderr: max_new 1000 2024-09-12T17:23:20.893 INFO:tasks.workunit.client.0.smithi016.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:23:20.732791Z_d3478d75-6ea3-4d84-b31a-563c7d3d5997/log 2024-09-12T17:23:20.893 INFO:tasks.workunit.client.0.smithi016.stderr:--- end dump of recent events --- 2024-09-12T17:23:20.893 INFO:tasks.workunit.client.0.smithi016.stderr:Aborted 2024-09-12T17:23:20.893 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T17:23:20.896 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:20.896 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:20.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.823+0000 7fc97a8059c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.827+0000 7fc97a8059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.827+0000 7fc97a8059c0 20 realm 2024-09-12T17:23:20.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.827+0000 7fc97a8059c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.827+0000 7fc97a8059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.827+0000 7fc97a8059c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:20.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.827+0000 7fc97a8059c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.827+0000 7fc97a8059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:20.897 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.827+0000 7fc97a8059c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.897 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.827+0000 7fc97a8059c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:20.897 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.827+0000 7fc97a8059c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:20.897 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.831+0000 7fc97a8059c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:20.897 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.831+0000 7fc97a8059c0 20 searching for the correct realm 2024-09-12T17:23:20.897 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.835+0000 7fc978b0c640 0 -- 172.21.15.16:0/1970492674 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fc96c001660 msgr2=0x7fc96c011400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:20.897 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:20.843+0000 7fc977b0a640 0 -- 172.21.15.16:0/1970492674 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fc9700df920 msgr2=0x7fc9700ef400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:23:21.064 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.059+0000 7fc97a8059c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:23:21.064 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.059+0000 7fc97a8059c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:21.064 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.059+0000 7fc97a8059c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:23:21.064 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.059+0000 7fc97a8059c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:21.064 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.059+0000 7fc97a8059c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:21.064 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.059+0000 7fc97a8059c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:21.064 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.059+0000 7fc97a8059c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:21.065 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.063+0000 7fc97a8059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:21.065 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.063+0000 7fc97a8059c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:21.065 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.063+0000 7fc97a8059c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:21.066 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.063+0000 7fc97a8059c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:21.066 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.063+0000 7fc97a8059c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:21.067 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.063+0000 7fc97a8059c0 20 zone default found 2024-09-12T17:23:21.067 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.063+0000 7fc97a8059c0 4 Realm: () 2024-09-12T17:23:21.067 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.063+0000 7fc97a8059c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:23:21.067 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.063+0000 7fc97a8059c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:23:21.067 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.063+0000 7fc97a8059c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:21.067 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.063+0000 7fc97a8059c0 20 zonegroup default 2024-09-12T17:23:21.067 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.063+0000 7fc97a8059c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:21.068 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.063+0000 7fc97a8059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:21.068 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.063+0000 7fc97a8059c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:21.068 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.067+0000 7fc97a8059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:21.068 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.067+0000 7fc97a8059c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:21.069 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.067+0000 7fc97a8059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:21.069 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.067+0000 7fc97a8059c0 20 started sync module instance, tier type = 2024-09-12T17:23:21.069 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.067+0000 7fc97a8059c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:23:21.092 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.091+0000 7fc97a8059c0 20 add_watcher() i=0 2024-09-12T17:23:21.092 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.091+0000 7fc97a8059c0 20 add_watcher() i=1 2024-09-12T17:23:21.093 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.091+0000 7fc97a8059c0 20 add_watcher() i=2 2024-09-12T17:23:21.093 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.091+0000 7fc97a8059c0 20 add_watcher() i=3 2024-09-12T17:23:21.093 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.091+0000 7fc97a8059c0 20 add_watcher() i=4 2024-09-12T17:23:21.093 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.091+0000 7fc97a8059c0 20 add_watcher() i=5 2024-09-12T17:23:21.093 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.091+0000 7fc97a8059c0 20 add_watcher() i=6 2024-09-12T17:23:21.095 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.091+0000 7fc97a8059c0 20 add_watcher() i=7 2024-09-12T17:23:21.095 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.091+0000 7fc97a8059c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:21.099 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.095+0000 7fc82f7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:21.101 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.095+0000 7fc97a8059c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:21.101 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.095+0000 7fc97a8059c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:21.101 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.095+0000 7fc97a8059c0 5 note: GC not initialized 2024-09-12T17:23:21.102 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.099+0000 7fc82e7dc640 20 reqs_thread_entry: start 2024-09-12T17:23:21.102 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.099+0000 7fc97a8059c0 20 init_complete bucket index max shards: 1 2024-09-12T17:23:21.102 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.099+0000 7fc97a8059c0 20 Filter name: none 2024-09-12T17:23:21.102 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.099+0000 7fc8277fe640 20 reqs_thread_entry: start 2024-09-12T17:23:21.102 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.099+0000 7fc97a8059c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:23:21.102 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.099+0000 7fc97a8059c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:21.103 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.099+0000 7fc97a8059c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:23:21.103 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.099+0000 7fc97a8059c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:23:21.104 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.099+0000 7fc97a8059c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:23:21.104 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.099+0000 7fc97a8059c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 : miss 2024-09-12T17:23:21.104 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.099+0000 7fc97a8059c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:21.104 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.099+0000 7fc97a8059c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T17:23:21.104 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.099+0000 7fc97a8059c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:23:21.104 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.099+0000 7fc97a8059c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:23:21.104 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.099+0000 7fc97a8059c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:23:21.104 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.099+0000 7fc97a8059c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:23:21.104 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.099+0000 7fc97a8059c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 2024-09-12T17:23:21.104 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.099+0000 7fc97a8059c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.0 2024-09-12T17:23:21.104 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.099+0000 7fc97a8059c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.0 2024-09-12T17:23:21.105 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.103+0000 7fc97a8059c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.1 2024-09-12T17:23:21.105 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.103+0000 7fc97a8059c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.1 2024-09-12T17:23:21.105 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.103+0000 7fc97a8059c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.2 2024-09-12T17:23:21.105 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.103+0000 7fc97a8059c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.2 2024-09-12T17:23:21.107 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.103+0000 7fc82f7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:21.113 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.111+0000 7fc97a8059c0 20 remove_watcher() i=0 2024-09-12T17:23:21.113 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.111+0000 7fc97a8059c0 2 removed watcher, disabling cache 2024-09-12T17:23:21.116 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.111+0000 7fc97a8059c0 20 remove_watcher() i=1 2024-09-12T17:23:21.118 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.115+0000 7fc97a8059c0 20 remove_watcher() i=2 2024-09-12T17:23:21.121 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.119+0000 7fc97a8059c0 20 remove_watcher() i=3 2024-09-12T17:23:21.123 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.119+0000 7fc97a8059c0 20 remove_watcher() i=4 2024-09-12T17:23:21.125 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.123+0000 7fc97a8059c0 20 remove_watcher() i=5 2024-09-12T17:23:21.126 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.123+0000 7fc97a8059c0 20 remove_watcher() i=6 2024-09-12T17:23:21.128 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:21.127+0000 7fc97a8059c0 20 remove_watcher() i=7 2024-09-12T17:23:21.149 INFO:tasks.workunit.client.0.smithi016.stderr: test: duplicated entries can be purged manually 2024-09-12T17:23:51.171 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:23:51.205 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:51.205 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:51.253 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.250+0000 7f45531359c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.255 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.250+0000 7f45531359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:51.255 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.250+0000 7f45531359c0 20 realm 2024-09-12T17:23:51.255 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.250+0000 7f45531359c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.255 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.250+0000 7f45531359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:51.256 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.250+0000 7f45531359c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:51.256 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.250+0000 7f45531359c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.256 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.250+0000 7f45531359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:51.256 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.250+0000 7f45531359c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.257 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.254+0000 7f45531359c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:51.257 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.254+0000 7f45531359c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.259 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.254+0000 7f45531359c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:51.259 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.254+0000 7f45531359c0 20 searching for the correct realm 2024-09-12T17:23:51.264 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.258+0000 7f455043a640 0 -- 172.21.15.16:0/2471535290 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7f4548008050 msgr2=0x7f4548014900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:51.270 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.266+0000 7f455043a640 0 -- 172.21.15.16:0/2471535290 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f4540071190 msgr2=0x7f4540094810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:51.488 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.486+0000 7f45531359c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:23:51.488 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.486+0000 7f45531359c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:51.489 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.486+0000 7f45531359c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:23:51.489 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.486+0000 7f45531359c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:51.489 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.486+0000 7f45531359c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:51.489 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.486+0000 7f45531359c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:51.489 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.486+0000 7f45531359c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.489 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.486+0000 7f45531359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:51.489 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.486+0000 7f45531359c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.490 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.486+0000 7f45531359c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:51.490 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.486+0000 7f45531359c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.491 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.486+0000 7f45531359c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:51.491 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.486+0000 7f45531359c0 20 zone default found 2024-09-12T17:23:51.491 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.486+0000 7f45531359c0 4 Realm: () 2024-09-12T17:23:51.491 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.486+0000 7f45531359c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:23:51.491 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.486+0000 7f45531359c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:23:51.491 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.486+0000 7f45531359c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:51.491 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.486+0000 7f45531359c0 20 zonegroup default 2024-09-12T17:23:51.491 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.486+0000 7f45531359c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.492 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.486+0000 7f45531359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:51.492 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.486+0000 7f45531359c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.493 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.490+0000 7f45531359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:51.493 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.490+0000 7f45531359c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.493 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.490+0000 7f45531359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:51.494 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.490+0000 7f45531359c0 20 started sync module instance, tier type = 2024-09-12T17:23:51.494 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.490+0000 7f45531359c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:23:51.519 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.514+0000 7f45531359c0 20 add_watcher() i=0 2024-09-12T17:23:51.519 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.514+0000 7f45531359c0 20 add_watcher() i=1 2024-09-12T17:23:51.519 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.514+0000 7f45531359c0 20 add_watcher() i=2 2024-09-12T17:23:51.519 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.514+0000 7f45531359c0 20 add_watcher() i=3 2024-09-12T17:23:51.519 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.514+0000 7f45531359c0 20 add_watcher() i=4 2024-09-12T17:23:51.520 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.514+0000 7f45531359c0 20 add_watcher() i=5 2024-09-12T17:23:51.520 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.514+0000 7f45531359c0 20 add_watcher() i=6 2024-09-12T17:23:51.521 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.518+0000 7f45531359c0 20 add_watcher() i=7 2024-09-12T17:23:51.521 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.518+0000 7f45531359c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:51.525 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.522+0000 7f44077e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:51.526 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.522+0000 7f45531359c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:51.526 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.522+0000 7f45531359c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:51.526 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.522+0000 7f45531359c0 5 note: GC not initialized 2024-09-12T17:23:51.527 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.522+0000 7f44067e4640 20 reqs_thread_entry: start 2024-09-12T17:23:51.527 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.522+0000 7f45531359c0 20 init_complete bucket index max shards: 1 2024-09-12T17:23:51.528 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.522+0000 7f45531359c0 20 Filter name: none 2024-09-12T17:23:51.528 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.522+0000 7f43ff7fe640 20 reqs_thread_entry: start 2024-09-12T17:23:51.528 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.522+0000 7f45531359c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.529 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.522+0000 7f45531359c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:23:51.529 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.522+0000 7f45531359c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.529 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.526+0000 7f45531359c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T17:23:51.530 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.526+0000 7f45531359c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:23:51.530 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.526+0000 7f45531359c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.531 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.526+0000 7f45531359c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:23:51.531 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.526+0000 7f45531359c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.531 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.526+0000 7f45531359c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T17:23:51.531 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.526+0000 7f45531359c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:23:51.533 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.530+0000 7f44077e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:51.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.534+0000 7f45531359c0 20 remove_watcher() i=0 2024-09-12T17:23:51.538 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.534+0000 7f45531359c0 2 removed watcher, disabling cache 2024-09-12T17:23:51.540 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.538+0000 7f45531359c0 20 remove_watcher() i=1 2024-09-12T17:23:51.543 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.538+0000 7f45531359c0 20 remove_watcher() i=2 2024-09-12T17:23:51.545 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.542+0000 7f45531359c0 20 remove_watcher() i=3 2024-09-12T17:23:51.548 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.546+0000 7f45531359c0 20 remove_watcher() i=4 2024-09-12T17:23:51.549 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.546+0000 7f45531359c0 20 remove_watcher() i=5 2024-09-12T17:23:51.551 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.546+0000 7f45531359c0 20 remove_watcher() i=6 2024-09-12T17:23:51.552 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.550+0000 7f45531359c0 20 remove_watcher() i=7 2024-09-12T17:23:51.569 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:51.569 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:23:51.569 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: a-bucket id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 num_objects: 11 size_kb: 1 num_shards: 3 2024-09-12T17:23:51.569 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:51.570 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T17:23:51.602 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:51.603 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:51.649 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.646+0000 7f771c6a99c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.651 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.646+0000 7f771c6a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:51.651 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.646+0000 7f771c6a99c0 20 realm 2024-09-12T17:23:51.651 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.646+0000 7f771c6a99c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.651 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.646+0000 7f771c6a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:51.652 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.646+0000 7f771c6a99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:51.652 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.646+0000 7f771c6a99c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.652 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.646+0000 7f771c6a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:51.652 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.646+0000 7f771c6a99c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.653 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.650+0000 7f771c6a99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:51.653 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.650+0000 7f771c6a99c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:51.655 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.650+0000 7f771c6a99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:51.655 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.650+0000 7f771c6a99c0 20 searching for the correct realm 2024-09-12T17:23:51.658 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.654+0000 7f771a9b0640 0 -- 172.21.15.16:0/835741528 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f771002a070 msgr2=0x7f7710008930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:51.874 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:51.870+0000 7f77199ae640 0 -- 172.21.15.16:0/835741528 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f7714006650 msgr2=0x7f771411c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:52.093 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:23:52.093 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:52.093 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:23:52.093 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:52.093 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:52.093 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:52.093 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.094 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:52.094 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.094 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:52.094 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.095 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:52.095 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 zone default found 2024-09-12T17:23:52.095 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.090+0000 7f771c6a99c0 4 Realm: () 2024-09-12T17:23:52.095 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.090+0000 7f771c6a99c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:23:52.096 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.090+0000 7f771c6a99c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:23:52.096 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.090+0000 7f771c6a99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:52.096 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 zonegroup default 2024-09-12T17:23:52.096 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.096 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:52.096 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.097 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.094+0000 7f771c6a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:52.097 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.094+0000 7f771c6a99c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.098 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.094+0000 7f771c6a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:52.098 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.094+0000 7f771c6a99c0 20 started sync module instance, tier type = 2024-09-12T17:23:52.098 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.094+0000 7f771c6a99c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:23:52.121 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.118+0000 7f771c6a99c0 20 add_watcher() i=0 2024-09-12T17:23:52.122 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.118+0000 7f771c6a99c0 20 add_watcher() i=1 2024-09-12T17:23:52.122 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.118+0000 7f771c6a99c0 20 add_watcher() i=2 2024-09-12T17:23:52.122 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.118+0000 7f771c6a99c0 20 add_watcher() i=3 2024-09-12T17:23:52.122 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.118+0000 7f771c6a99c0 20 add_watcher() i=4 2024-09-12T17:23:52.122 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.118+0000 7f771c6a99c0 20 add_watcher() i=5 2024-09-12T17:23:52.122 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.118+0000 7f771c6a99c0 20 add_watcher() i=6 2024-09-12T17:23:52.124 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.122+0000 7f771c6a99c0 20 add_watcher() i=7 2024-09-12T17:23:52.124 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.122+0000 7f771c6a99c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:52.129 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.126+0000 7f75d17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:52.130 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.126+0000 7f771c6a99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:52.130 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.126+0000 7f771c6a99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:52.130 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 note: GC not initialized 2024-09-12T17:23:52.131 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.126+0000 7f75cb7fe640 20 reqs_thread_entry: start 2024-09-12T17:23:52.131 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.126+0000 7f771c6a99c0 20 init_complete bucket index max shards: 1 2024-09-12T17:23:52.131 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.126+0000 7f771c6a99c0 20 Filter name: none 2024-09-12T17:23:52.132 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.126+0000 7f75c97fa640 20 reqs_thread_entry: start 2024-09-12T17:23:52.132 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.126+0000 7f771c6a99c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:23:52.132 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.126+0000 7f771c6a99c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.133 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.130+0000 7f771c6a99c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:23:52.133 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.130+0000 7f771c6a99c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:23:52.133 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.130+0000 7f771c6a99c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:23:52.133 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.130+0000 7f771c6a99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 : miss 2024-09-12T17:23:52.133 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.130+0000 7f771c6a99c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.134 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.130+0000 7f771c6a99c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T17:23:52.134 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.130+0000 7f771c6a99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:23:52.134 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.130+0000 7f771c6a99c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:23:52.135 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.130+0000 7f771c6a99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:23:52.135 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.130+0000 7f771c6a99c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:23:52.135 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.130+0000 7f771c6a99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 2024-09-12T17:23:52.136 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.134+0000 7f771c6a99c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:23:52.146 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.142+0000 7f771c6a99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:23:52.146 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.142+0000 7f771c6a99c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:23:52.146 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.142+0000 7f771c6a99c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:23:52.146 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.142+0000 7f771c6a99c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17, ofs0, ns] 2024-09-12T17:23:52.147 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.142+0000 7f75fdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431631 cookie 93874296660144 notifier 8298 bl.length()=827 2024-09-12T17:23:52.147 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.142+0000 7f75fdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:23:52.147 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.142+0000 7f75fdffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:23:52.147 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.142+0000 7f75fdffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:23:52.148 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.146+0000 7f771c6a99c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): orig_sources= new_sources= 2024-09-12T17:23:52.148 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.146+0000 7f771c6a99c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): potential sources added=[] removed=[] 2024-09-12T17:23:52.148 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.146+0000 7f771c6a99c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): orig_dests= new_dests= 2024-09-12T17:23:52.149 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.146+0000 7f771c6a99c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): potential dests added=[] removed=[] 2024-09-12T17:23:52.153 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f771c6a99c0 time 2024-09-12T17:23:52.156215+0000 2024-09-12T17:23:52.153 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:23:52.156 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:23:52.156 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f771ff832eb] 2024-09-12T17:23:52.156 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f771ff8349f] 2024-09-12T17:23:52.156 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5560cecef0c1] 2024-09-12T17:23:52.156 INFO:tasks.workunit.client.0.smithi016.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5560ced011fa] 2024-09-12T17:23:52.156 INFO:tasks.workunit.client.0.smithi016.stderr: 5: main() 2024-09-12T17:23:52.156 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f771ede9d90] 2024-09-12T17:23:52.157 INFO:tasks.workunit.client.0.smithi016.stderr: 7: __libc_start_main() 2024-09-12T17:23:52.157 INFO:tasks.workunit.client.0.smithi016.stderr: 8: _start() 2024-09-12T17:23:52.157 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.150+0000 7f771c6a99c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f771c6a99c0 time 2024-09-12T17:23:52.156215+0000 2024-09-12T17:23:52.157 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:23:52.157 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:52.157 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:23:52.157 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f771ff832eb] 2024-09-12T17:23:52.157 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f771ff8349f] 2024-09-12T17:23:52.157 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5560cecef0c1] 2024-09-12T17:23:52.157 INFO:tasks.workunit.client.0.smithi016.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5560ced011fa] 2024-09-12T17:23:52.157 INFO:tasks.workunit.client.0.smithi016.stderr: 5: main() 2024-09-12T17:23:52.158 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f771ede9d90] 2024-09-12T17:23:52.158 INFO:tasks.workunit.client.0.smithi016.stderr: 7: __libc_start_main() 2024-09-12T17:23:52.158 INFO:tasks.workunit.client.0.smithi016.stderr: 8: _start() 2024-09-12T17:23:52.158 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:52.158 INFO:tasks.workunit.client.0.smithi016.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:23:52.158 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7f771c6a99c0 thread_name:radosgw-admin 2024-09-12T17:23:52.159 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:23:52.159 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f771ee02520] 2024-09-12T17:23:52.159 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:23:52.159 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:23:52.159 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:23:52.160 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f771ff83345] 2024-09-12T17:23:52.160 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f771ff8349f] 2024-09-12T17:23:52.160 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5560cecef0c1] 2024-09-12T17:23:52.160 INFO:tasks.workunit.client.0.smithi016.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5560ced011fa] 2024-09-12T17:23:52.160 INFO:tasks.workunit.client.0.smithi016.stderr: 9: main() 2024-09-12T17:23:52.160 INFO:tasks.workunit.client.0.smithi016.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f771ede9d90] 2024-09-12T17:23:52.160 INFO:tasks.workunit.client.0.smithi016.stderr: 11: __libc_start_main() 2024-09-12T17:23:52.160 INFO:tasks.workunit.client.0.smithi016.stderr: 12: _start() 2024-09-12T17:23:52.160 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.154+0000 7f771c6a99c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:23:52.160 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7f771c6a99c0 thread_name:radosgw-admin 2024-09-12T17:23:52.160 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:52.160 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:23:52.161 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f771ee02520] 2024-09-12T17:23:52.161 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:23:52.161 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:23:52.161 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:23:52.161 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f771ff83345] 2024-09-12T17:23:52.161 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f771ff8349f] 2024-09-12T17:23:52.161 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5560cecef0c1] 2024-09-12T17:23:52.161 INFO:tasks.workunit.client.0.smithi016.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5560ced011fa] 2024-09-12T17:23:52.161 INFO:tasks.workunit.client.0.smithi016.stderr: 9: main() 2024-09-12T17:23:52.161 INFO:tasks.workunit.client.0.smithi016.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f771ede9d90] 2024-09-12T17:23:52.161 INFO:tasks.workunit.client.0.smithi016.stderr: 11: __libc_start_main() 2024-09-12T17:23:52.161 INFO:tasks.workunit.client.0.smithi016.stderr: 12: _start() 2024-09-12T17:23:52.161 INFO:tasks.workunit.client.0.smithi016.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:23:52.162 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:52.162 INFO:tasks.workunit.client.0.smithi016.stderr:--- begin dump of recent events --- 2024-09-12T17:23:52.193 INFO:tasks.workunit.client.0.smithi016.stderr: -499> 2024-09-12T17:23:51.622+0000 7f7608608640 10 monclient: _finish_auth 0 2024-09-12T17:23:52.193 INFO:tasks.workunit.client.0.smithi016.stderr: -498> 2024-09-12T17:23:51.622+0000 7f7608608640 10 monclient: _check_auth_tickets 2024-09-12T17:23:52.193 INFO:tasks.workunit.client.0.smithi016.stderr: -497> 2024-09-12T17:23:51.622+0000 7f7608608640 10 monclient: handle_config config(0 keys) 2024-09-12T17:23:52.193 INFO:tasks.workunit.client.0.smithi016.stderr: -496> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 monclient: authenticate success, global_id 8286 2024-09-12T17:23:52.193 INFO:tasks.workunit.client.0.smithi016.stderr: -495> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 10 monclient: get_monmap_and_config success 2024-09-12T17:23:52.193 INFO:tasks.workunit.client.0.smithi016.stderr: -494> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 4 set_mon_vals no callback set 2024-09-12T17:23:52.194 INFO:tasks.workunit.client.0.smithi016.stderr: -493> 2024-09-12T17:23:51.622+0000 7f7608608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:52.194 INFO:tasks.workunit.client.0.smithi016.stderr: -492> 2024-09-12T17:23:51.622+0000 7f7608608640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:23:52.194 INFO:tasks.workunit.client.0.smithi016.stderr: -491> 2024-09-12T17:23:51.622+0000 7f7608608640 10 monclient: dump: 2024-09-12T17:23:52.194 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:23:52.194 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:23:52.194 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:52.194 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:52.194 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:52.194 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:52.194 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:23:52.194 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:23:52.194 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:23:52.194 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:52.195 INFO:tasks.workunit.client.0.smithi016.stderr: -490> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 10 monclient: shutdown 2024-09-12T17:23:52.195 INFO:tasks.workunit.client.0.smithi016.stderr: -489> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 asok(0x5560cfeab2b0) unregister_commands rotate-key 2024-09-12T17:23:52.195 INFO:tasks.workunit.client.0.smithi016.stderr: -488> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 10 monclient: build_initial_monmap 2024-09-12T17:23:52.195 INFO:tasks.workunit.client.0.smithi016.stderr: -487> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 1 build_initial for_mkfs: 0 2024-09-12T17:23:52.195 INFO:tasks.workunit.client.0.smithi016.stderr: -486> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 10 monclient: monmap: 2024-09-12T17:23:52.195 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:23:52.195 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:23:52.195 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:23:52.195 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:23:52.195 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:23:52.195 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:52.195 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:23:52.196 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:23:52.196 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:23:52.196 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:52.196 INFO:tasks.workunit.client.0.smithi016.stderr: -485> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00bb660) adding auth protocol: cephx 2024-09-12T17:23:52.196 INFO:tasks.workunit.client.0.smithi016.stderr: -484> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00bb660) adding auth protocol: cephx 2024-09-12T17:23:52.196 INFO:tasks.workunit.client.0.smithi016.stderr: -483> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00bb660) adding auth protocol: cephx 2024-09-12T17:23:52.196 INFO:tasks.workunit.client.0.smithi016.stderr: -482> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00bb660) adding con mode: secure 2024-09-12T17:23:52.196 INFO:tasks.workunit.client.0.smithi016.stderr: -481> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00bb660) adding con mode: crc 2024-09-12T17:23:52.196 INFO:tasks.workunit.client.0.smithi016.stderr: -480> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00bb660) adding con mode: secure 2024-09-12T17:23:52.196 INFO:tasks.workunit.client.0.smithi016.stderr: -479> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00bb660) adding con mode: crc 2024-09-12T17:23:52.196 INFO:tasks.workunit.client.0.smithi016.stderr: -478> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00bb660) adding con mode: secure 2024-09-12T17:23:52.196 INFO:tasks.workunit.client.0.smithi016.stderr: -477> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00bb660) adding con mode: crc 2024-09-12T17:23:52.197 INFO:tasks.workunit.client.0.smithi016.stderr: -476> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00bb660) adding con mode: crc 2024-09-12T17:23:52.197 INFO:tasks.workunit.client.0.smithi016.stderr: -475> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00bb660) adding con mode: secure 2024-09-12T17:23:52.197 INFO:tasks.workunit.client.0.smithi016.stderr: -474> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00bb660) adding con mode: crc 2024-09-12T17:23:52.197 INFO:tasks.workunit.client.0.smithi016.stderr: -473> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00bb660) adding con mode: secure 2024-09-12T17:23:52.197 INFO:tasks.workunit.client.0.smithi016.stderr: -472> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00bb660) adding con mode: crc 2024-09-12T17:23:52.197 INFO:tasks.workunit.client.0.smithi016.stderr: -471> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00bb660) adding con mode: secure 2024-09-12T17:23:52.197 INFO:tasks.workunit.client.0.smithi016.stderr: -470> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:52.197 INFO:tasks.workunit.client.0.smithi016.stderr: -469> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 1 librados: starting msgr at 2024-09-12T17:23:52.197 INFO:tasks.workunit.client.0.smithi016.stderr: -468> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 1 librados: starting objecter 2024-09-12T17:23:52.197 INFO:tasks.workunit.client.0.smithi016.stderr: -467> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 asok(0x5560cfeab2b0) register_command objecter_requests hook 0x5560d00ba8e0 2024-09-12T17:23:52.197 INFO:tasks.workunit.client.0.smithi016.stderr: -466> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 1 librados: setting wanted keys 2024-09-12T17:23:52.197 INFO:tasks.workunit.client.0.smithi016.stderr: -465> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 1 librados: calling monclient init 2024-09-12T17:23:52.198 INFO:tasks.workunit.client.0.smithi016.stderr: -464> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 10 monclient: init 2024-09-12T17:23:52.198 INFO:tasks.workunit.client.0.smithi016.stderr: -463> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00b5e40) adding auth protocol: cephx 2024-09-12T17:23:52.198 INFO:tasks.workunit.client.0.smithi016.stderr: -462> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00b5e40) adding auth protocol: cephx 2024-09-12T17:23:52.198 INFO:tasks.workunit.client.0.smithi016.stderr: -461> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00b5e40) adding auth protocol: cephx 2024-09-12T17:23:52.198 INFO:tasks.workunit.client.0.smithi016.stderr: -460> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00b5e40) adding con mode: secure 2024-09-12T17:23:52.198 INFO:tasks.workunit.client.0.smithi016.stderr: -459> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00b5e40) adding con mode: crc 2024-09-12T17:23:52.198 INFO:tasks.workunit.client.0.smithi016.stderr: -458> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00b5e40) adding con mode: secure 2024-09-12T17:23:52.198 INFO:tasks.workunit.client.0.smithi016.stderr: -457> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00b5e40) adding con mode: crc 2024-09-12T17:23:52.198 INFO:tasks.workunit.client.0.smithi016.stderr: -456> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00b5e40) adding con mode: secure 2024-09-12T17:23:52.198 INFO:tasks.workunit.client.0.smithi016.stderr: -455> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00b5e40) adding con mode: crc 2024-09-12T17:23:52.198 INFO:tasks.workunit.client.0.smithi016.stderr: -454> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00b5e40) adding con mode: crc 2024-09-12T17:23:52.198 INFO:tasks.workunit.client.0.smithi016.stderr: -453> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00b5e40) adding con mode: secure 2024-09-12T17:23:52.198 INFO:tasks.workunit.client.0.smithi016.stderr: -452> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00b5e40) adding con mode: crc 2024-09-12T17:23:52.199 INFO:tasks.workunit.client.0.smithi016.stderr: -451> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00b5e40) adding con mode: secure 2024-09-12T17:23:52.199 INFO:tasks.workunit.client.0.smithi016.stderr: -450> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00b5e40) adding con mode: crc 2024-09-12T17:23:52.199 INFO:tasks.workunit.client.0.smithi016.stderr: -449> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00b5e40) adding con mode: secure 2024-09-12T17:23:52.199 INFO:tasks.workunit.client.0.smithi016.stderr: -448> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:52.199 INFO:tasks.workunit.client.0.smithi016.stderr: -447> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:52.199 INFO:tasks.workunit.client.0.smithi016.stderr: -446> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 asok(0x5560cfeab2b0) register_command rotate-key hook 0x5560d00b5f88 2024-09-12T17:23:52.199 INFO:tasks.workunit.client.0.smithi016.stderr: -445> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 10 monclient: _reopen_session rank -1 2024-09-12T17:23:52.199 INFO:tasks.workunit.client.0.smithi016.stderr: -444> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:23:52.199 INFO:tasks.workunit.client.0.smithi016.stderr: -443> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 10 monclient(hunting): picked mon.noname-c con 0x5560cff435f0 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:23:52.199 INFO:tasks.workunit.client.0.smithi016.stderr: -442> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 10 monclient(hunting): picked mon.noname-b con 0x5560cff6e690 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:23:52.199 INFO:tasks.workunit.client.0.smithi016.stderr: -441> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 10 monclient(hunting): picked mon.noname-a con 0x5560cfffb750 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:23:52.199 INFO:tasks.workunit.client.0.smithi016.stderr: -440> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:52.199 INFO:tasks.workunit.client.0.smithi016.stderr: -439> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:52.200 INFO:tasks.workunit.client.0.smithi016.stderr: -438> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:52.200 INFO:tasks.workunit.client.0.smithi016.stderr: -437> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 10 monclient(hunting): _renew_subs 2024-09-12T17:23:52.200 INFO:tasks.workunit.client.0.smithi016.stderr: -436> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 10 monclient(hunting): authenticate will time out at 2549.603343s 2024-09-12T17:23:52.200 INFO:tasks.workunit.client.0.smithi016.stderr: -435> 2024-09-12T17:23:51.622+0000 7f771a9b0640 10 monclient(hunting): get_auth_request con 0x5560cfffb750 auth_method 0 2024-09-12T17:23:52.200 INFO:tasks.workunit.client.0.smithi016.stderr: -434> 2024-09-12T17:23:51.622+0000 7f771a9b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:52.200 INFO:tasks.workunit.client.0.smithi016.stderr: -433> 2024-09-12T17:23:51.622+0000 7f771a9b0640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:52.200 INFO:tasks.workunit.client.0.smithi016.stderr: -432> 2024-09-12T17:23:51.622+0000 7f771a9b0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:52.200 INFO:tasks.workunit.client.0.smithi016.stderr: -431> 2024-09-12T17:23:51.622+0000 7f771a1af640 10 monclient(hunting): get_auth_request con 0x5560cff435f0 auth_method 0 2024-09-12T17:23:52.200 INFO:tasks.workunit.client.0.smithi016.stderr: -430> 2024-09-12T17:23:51.622+0000 7f771a1af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:52.200 INFO:tasks.workunit.client.0.smithi016.stderr: -429> 2024-09-12T17:23:51.622+0000 7f771a1af640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:52.200 INFO:tasks.workunit.client.0.smithi016.stderr: -428> 2024-09-12T17:23:51.622+0000 7f771a1af640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:52.200 INFO:tasks.workunit.client.0.smithi016.stderr: -427> 2024-09-12T17:23:51.622+0000 7f771a9b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:52.200 INFO:tasks.workunit.client.0.smithi016.stderr: -426> 2024-09-12T17:23:51.622+0000 7f771a9b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:52.201 INFO:tasks.workunit.client.0.smithi016.stderr: -425> 2024-09-12T17:23:51.622+0000 7f771a9b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:52.201 INFO:tasks.workunit.client.0.smithi016.stderr: -424> 2024-09-12T17:23:51.622+0000 7f771a1af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:52.201 INFO:tasks.workunit.client.0.smithi016.stderr: -423> 2024-09-12T17:23:51.622+0000 7f771a1af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:52.201 INFO:tasks.workunit.client.0.smithi016.stderr: -422> 2024-09-12T17:23:51.622+0000 7f771a1af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:52.201 INFO:tasks.workunit.client.0.smithi016.stderr: -421> 2024-09-12T17:23:51.622+0000 7f77199ae640 10 monclient(hunting): get_auth_request con 0x5560cff6e690 auth_method 0 2024-09-12T17:23:52.201 INFO:tasks.workunit.client.0.smithi016.stderr: -420> 2024-09-12T17:23:51.622+0000 7f77199ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:52.201 INFO:tasks.workunit.client.0.smithi016.stderr: -419> 2024-09-12T17:23:51.622+0000 7f77199ae640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:52.201 INFO:tasks.workunit.client.0.smithi016.stderr: -418> 2024-09-12T17:23:51.622+0000 7f77199ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:52.201 INFO:tasks.workunit.client.0.smithi016.stderr: -417> 2024-09-12T17:23:51.622+0000 7f771a9b0640 10 monclient(hunting): handle_auth_done global_id 8289 payload 824 2024-09-12T17:23:52.201 INFO:tasks.workunit.client.0.smithi016.stderr: -416> 2024-09-12T17:23:51.622+0000 7f771a9b0640 10 monclient: _finish_hunting 0 2024-09-12T17:23:52.201 INFO:tasks.workunit.client.0.smithi016.stderr: -415> 2024-09-12T17:23:51.622+0000 7f771a9b0640 1 monclient: found mon.noname-a 2024-09-12T17:23:52.201 INFO:tasks.workunit.client.0.smithi016.stderr: -414> 2024-09-12T17:23:51.622+0000 7f771a9b0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:23:52.201 INFO:tasks.workunit.client.0.smithi016.stderr: -413> 2024-09-12T17:23:51.626+0000 7f7606e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:52.202 INFO:tasks.workunit.client.0.smithi016.stderr: -412> 2024-09-12T17:23:51.626+0000 7f7606e05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:23:52.202 INFO:tasks.workunit.client.0.smithi016.stderr: -411> 2024-09-12T17:23:51.626+0000 7f7606e05640 10 monclient: dump: 2024-09-12T17:23:52.202 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:23:52.202 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:23:52.202 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:52.202 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:52.202 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:52.202 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:52.202 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:23:52.202 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:23:52.202 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:23:52.202 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:52.202 INFO:tasks.workunit.client.0.smithi016.stderr: -410> 2024-09-12T17:23:51.626+0000 7f7606e05640 10 monclient: _finish_auth 0 2024-09-12T17:23:52.203 INFO:tasks.workunit.client.0.smithi016.stderr: -409> 2024-09-12T17:23:51.626+0000 7f7606e05640 10 monclient: _check_auth_tickets 2024-09-12T17:23:52.203 INFO:tasks.workunit.client.0.smithi016.stderr: -408> 2024-09-12T17:23:51.626+0000 7f7606e05640 10 monclient: handle_config config(0 keys) 2024-09-12T17:23:52.203 INFO:tasks.workunit.client.0.smithi016.stderr: -407> 2024-09-12T17:23:51.626+0000 7f7606e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:52.203 INFO:tasks.workunit.client.0.smithi016.stderr: -406> 2024-09-12T17:23:51.626+0000 7f7606e05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:23:52.203 INFO:tasks.workunit.client.0.smithi016.stderr: -405> 2024-09-12T17:23:51.626+0000 7f7606e05640 10 monclient: dump: 2024-09-12T17:23:52.203 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:23:52.203 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:23:52.203 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:52.203 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:52.203 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:52.203 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:52.203 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:23:52.204 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:23:52.204 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:23:52.204 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:52.204 INFO:tasks.workunit.client.0.smithi016.stderr: -404> 2024-09-12T17:23:51.626+0000 7f771c6a99c0 5 monclient: authenticate success, global_id 8289 2024-09-12T17:23:52.204 INFO:tasks.workunit.client.0.smithi016.stderr: -403> 2024-09-12T17:23:51.626+0000 7f771c6a99c0 10 monclient: _renew_subs 2024-09-12T17:23:52.204 INFO:tasks.workunit.client.0.smithi016.stderr: -402> 2024-09-12T17:23:51.626+0000 7f7608608640 4 set_mon_vals no callback set 2024-09-12T17:23:52.204 INFO:tasks.workunit.client.0.smithi016.stderr: -401> 2024-09-12T17:23:51.626+0000 7f771c6a99c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:23:52.204 INFO:tasks.workunit.client.0.smithi016.stderr: -400> 2024-09-12T17:23:51.626+0000 7f771c6a99c0 10 monclient: _renew_subs 2024-09-12T17:23:52.204 INFO:tasks.workunit.client.0.smithi016.stderr: -399> 2024-09-12T17:23:51.626+0000 7f771c6a99c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:23:52.204 INFO:tasks.workunit.client.0.smithi016.stderr: -398> 2024-09-12T17:23:51.626+0000 7f771c6a99c0 1 librados: init done 2024-09-12T17:23:52.204 INFO:tasks.workunit.client.0.smithi016.stderr: -397> 2024-09-12T17:23:51.626+0000 7f7606e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:23:52.204 INFO:tasks.workunit.client.0.smithi016.stderr: -396> 2024-09-12T17:23:51.626+0000 7f7606e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:23:52.205 INFO:tasks.workunit.client.0.smithi016.stderr: -395> 2024-09-12T17:23:51.626+0000 7f7606e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:23:52.205 INFO:tasks.workunit.client.0.smithi016.stderr: -394> 2024-09-12T17:23:51.626+0000 7f771a1af640 10 monclient: get_auth_request con 0x7f7600070ae0 auth_method 0 2024-09-12T17:23:52.205 INFO:tasks.workunit.client.0.smithi016.stderr: -393> 2024-09-12T17:23:51.626+0000 7f77199ae640 10 monclient: get_auth_request con 0x5560d00fe1d0 auth_method 0 2024-09-12T17:23:52.205 INFO:tasks.workunit.client.0.smithi016.stderr: -392> 2024-09-12T17:23:51.630+0000 7f771a1af640 10 monclient: get_auth_request con 0x5560d01013b0 auth_method 0 2024-09-12T17:23:52.205 INFO:tasks.workunit.client.0.smithi016.stderr: -391> 2024-09-12T17:23:51.630+0000 7f77199ae640 10 monclient: get_auth_request con 0x5560d01055a0 auth_method 0 2024-09-12T17:23:52.205 INFO:tasks.workunit.client.0.smithi016.stderr: -390> 2024-09-12T17:23:51.634+0000 7f771a9b0640 10 monclient: get_auth_request con 0x5560d0104c40 auth_method 0 2024-09-12T17:23:52.205 INFO:tasks.workunit.client.0.smithi016.stderr: -389> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 10 monclient: build_initial_monmap 2024-09-12T17:23:52.205 INFO:tasks.workunit.client.0.smithi016.stderr: -388> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 1 build_initial for_mkfs: 0 2024-09-12T17:23:52.205 INFO:tasks.workunit.client.0.smithi016.stderr: -387> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 10 monclient: monmap: 2024-09-12T17:23:52.205 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:23:52.206 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:23:52.206 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:23:52.206 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:23:52.206 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:23:52.206 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:52.206 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:23:52.206 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:23:52.206 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:23:52.206 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:52.206 INFO:tasks.workunit.client.0.smithi016.stderr: -386> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010d380) adding auth protocol: cephx 2024-09-12T17:23:52.206 INFO:tasks.workunit.client.0.smithi016.stderr: -385> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010d380) adding auth protocol: cephx 2024-09-12T17:23:52.206 INFO:tasks.workunit.client.0.smithi016.stderr: -384> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010d380) adding auth protocol: cephx 2024-09-12T17:23:52.206 INFO:tasks.workunit.client.0.smithi016.stderr: -383> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010d380) adding con mode: secure 2024-09-12T17:23:52.206 INFO:tasks.workunit.client.0.smithi016.stderr: -382> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010d380) adding con mode: crc 2024-09-12T17:23:52.207 INFO:tasks.workunit.client.0.smithi016.stderr: -381> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010d380) adding con mode: secure 2024-09-12T17:23:52.207 INFO:tasks.workunit.client.0.smithi016.stderr: -380> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010d380) adding con mode: crc 2024-09-12T17:23:52.207 INFO:tasks.workunit.client.0.smithi016.stderr: -379> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010d380) adding con mode: secure 2024-09-12T17:23:52.207 INFO:tasks.workunit.client.0.smithi016.stderr: -378> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010d380) adding con mode: crc 2024-09-12T17:23:52.207 INFO:tasks.workunit.client.0.smithi016.stderr: -377> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010d380) adding con mode: crc 2024-09-12T17:23:52.207 INFO:tasks.workunit.client.0.smithi016.stderr: -376> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010d380) adding con mode: secure 2024-09-12T17:23:52.207 INFO:tasks.workunit.client.0.smithi016.stderr: -375> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010d380) adding con mode: crc 2024-09-12T17:23:52.207 INFO:tasks.workunit.client.0.smithi016.stderr: -374> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010d380) adding con mode: secure 2024-09-12T17:23:52.207 INFO:tasks.workunit.client.0.smithi016.stderr: -373> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010d380) adding con mode: crc 2024-09-12T17:23:52.207 INFO:tasks.workunit.client.0.smithi016.stderr: -372> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010d380) adding con mode: secure 2024-09-12T17:23:52.207 INFO:tasks.workunit.client.0.smithi016.stderr: -371> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:52.207 INFO:tasks.workunit.client.0.smithi016.stderr: -370> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 asok(0x5560cfeab2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5560d0110df0 EEXIST 2024-09-12T17:23:52.207 INFO:tasks.workunit.client.0.smithi016.stderr: -369> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 10 monclient: init 2024-09-12T17:23:52.208 INFO:tasks.workunit.client.0.smithi016.stderr: -368> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010c338) adding auth protocol: cephx 2024-09-12T17:23:52.208 INFO:tasks.workunit.client.0.smithi016.stderr: -367> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010c338) adding auth protocol: cephx 2024-09-12T17:23:52.208 INFO:tasks.workunit.client.0.smithi016.stderr: -366> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010c338) adding auth protocol: cephx 2024-09-12T17:23:52.208 INFO:tasks.workunit.client.0.smithi016.stderr: -365> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010c338) adding con mode: secure 2024-09-12T17:23:52.208 INFO:tasks.workunit.client.0.smithi016.stderr: -364> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010c338) adding con mode: crc 2024-09-12T17:23:52.208 INFO:tasks.workunit.client.0.smithi016.stderr: -363> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010c338) adding con mode: secure 2024-09-12T17:23:52.208 INFO:tasks.workunit.client.0.smithi016.stderr: -362> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010c338) adding con mode: crc 2024-09-12T17:23:52.208 INFO:tasks.workunit.client.0.smithi016.stderr: -361> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010c338) adding con mode: secure 2024-09-12T17:23:52.208 INFO:tasks.workunit.client.0.smithi016.stderr: -360> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010c338) adding con mode: crc 2024-09-12T17:23:52.208 INFO:tasks.workunit.client.0.smithi016.stderr: -359> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010c338) adding con mode: crc 2024-09-12T17:23:52.208 INFO:tasks.workunit.client.0.smithi016.stderr: -358> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010c338) adding con mode: secure 2024-09-12T17:23:52.208 INFO:tasks.workunit.client.0.smithi016.stderr: -357> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010c338) adding con mode: crc 2024-09-12T17:23:52.208 INFO:tasks.workunit.client.0.smithi016.stderr: -356> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010c338) adding con mode: secure 2024-09-12T17:23:52.208 INFO:tasks.workunit.client.0.smithi016.stderr: -355> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010c338) adding con mode: crc 2024-09-12T17:23:52.209 INFO:tasks.workunit.client.0.smithi016.stderr: -354> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010c338) adding con mode: secure 2024-09-12T17:23:52.209 INFO:tasks.workunit.client.0.smithi016.stderr: -353> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:52.209 INFO:tasks.workunit.client.0.smithi016.stderr: -352> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:52.209 INFO:tasks.workunit.client.0.smithi016.stderr: -351> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 asok(0x5560cfeab2b0) register_command rotate-key cmddesc rotate-key hook 0x5560d010c480 EEXIST 2024-09-12T17:23:52.209 INFO:tasks.workunit.client.0.smithi016.stderr: -350> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 10 monclient: _reopen_session rank -1 2024-09-12T17:23:52.209 INFO:tasks.workunit.client.0.smithi016.stderr: -349> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:23:52.209 INFO:tasks.workunit.client.0.smithi016.stderr: -348> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 10 monclient(hunting): picked mon.noname-c con 0x5560d0134fa0 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:23:52.209 INFO:tasks.workunit.client.0.smithi016.stderr: -347> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 10 monclient(hunting): picked mon.noname-a con 0x5560d01348d0 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:23:52.209 INFO:tasks.workunit.client.0.smithi016.stderr: -346> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 10 monclient(hunting): picked mon.noname-b con 0x5560d01332b0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:23:52.209 INFO:tasks.workunit.client.0.smithi016.stderr: -345> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:52.209 INFO:tasks.workunit.client.0.smithi016.stderr: -344> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:52.209 INFO:tasks.workunit.client.0.smithi016.stderr: -343> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:52.210 INFO:tasks.workunit.client.0.smithi016.stderr: -342> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 10 monclient(hunting): _renew_subs 2024-09-12T17:23:52.210 INFO:tasks.workunit.client.0.smithi016.stderr: -341> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 10 monclient(hunting): authenticate will time out at 2549.615232s 2024-09-12T17:23:52.210 INFO:tasks.workunit.client.0.smithi016.stderr: -340> 2024-09-12T17:23:51.634+0000 7f77199ae640 10 monclient(hunting): get_auth_request con 0x5560d0134fa0 auth_method 0 2024-09-12T17:23:52.210 INFO:tasks.workunit.client.0.smithi016.stderr: -339> 2024-09-12T17:23:51.634+0000 7f77199ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:52.210 INFO:tasks.workunit.client.0.smithi016.stderr: -338> 2024-09-12T17:23:51.634+0000 7f77199ae640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:52.210 INFO:tasks.workunit.client.0.smithi016.stderr: -337> 2024-09-12T17:23:51.634+0000 7f77199ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:52.210 INFO:tasks.workunit.client.0.smithi016.stderr: -336> 2024-09-12T17:23:51.634+0000 7f771a9b0640 10 monclient(hunting): get_auth_request con 0x5560d01348d0 auth_method 0 2024-09-12T17:23:52.210 INFO:tasks.workunit.client.0.smithi016.stderr: -335> 2024-09-12T17:23:51.634+0000 7f771a9b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:52.210 INFO:tasks.workunit.client.0.smithi016.stderr: -334> 2024-09-12T17:23:51.634+0000 7f771a9b0640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:52.210 INFO:tasks.workunit.client.0.smithi016.stderr: -333> 2024-09-12T17:23:51.634+0000 7f771a9b0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:52.210 INFO:tasks.workunit.client.0.smithi016.stderr: -332> 2024-09-12T17:23:51.634+0000 7f77199ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:52.210 INFO:tasks.workunit.client.0.smithi016.stderr: -331> 2024-09-12T17:23:51.634+0000 7f77199ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:52.210 INFO:tasks.workunit.client.0.smithi016.stderr: -330> 2024-09-12T17:23:51.634+0000 7f77199ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:52.211 INFO:tasks.workunit.client.0.smithi016.stderr: -329> 2024-09-12T17:23:51.634+0000 7f771a9b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:52.211 INFO:tasks.workunit.client.0.smithi016.stderr: -328> 2024-09-12T17:23:51.634+0000 7f771a9b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:52.211 INFO:tasks.workunit.client.0.smithi016.stderr: -327> 2024-09-12T17:23:51.634+0000 7f771a9b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:52.211 INFO:tasks.workunit.client.0.smithi016.stderr: -326> 2024-09-12T17:23:51.634+0000 7f771a1af640 10 monclient(hunting): get_auth_request con 0x5560d01332b0 auth_method 0 2024-09-12T17:23:52.211 INFO:tasks.workunit.client.0.smithi016.stderr: -325> 2024-09-12T17:23:51.634+0000 7f771a1af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:52.211 INFO:tasks.workunit.client.0.smithi016.stderr: -324> 2024-09-12T17:23:51.634+0000 7f771a1af640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:52.211 INFO:tasks.workunit.client.0.smithi016.stderr: -323> 2024-09-12T17:23:51.634+0000 7f771a1af640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:52.211 INFO:tasks.workunit.client.0.smithi016.stderr: -322> 2024-09-12T17:23:51.634+0000 7f771a9b0640 10 monclient(hunting): handle_auth_done global_id 8292 payload 824 2024-09-12T17:23:52.211 INFO:tasks.workunit.client.0.smithi016.stderr: -321> 2024-09-12T17:23:51.634+0000 7f771a9b0640 10 monclient: _finish_hunting 0 2024-09-12T17:23:52.211 INFO:tasks.workunit.client.0.smithi016.stderr: -320> 2024-09-12T17:23:51.634+0000 7f771a9b0640 1 monclient: found mon.noname-a 2024-09-12T17:23:52.211 INFO:tasks.workunit.client.0.smithi016.stderr: -319> 2024-09-12T17:23:51.634+0000 7f771a9b0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:23:52.211 INFO:tasks.workunit.client.0.smithi016.stderr: -318> 2024-09-12T17:23:51.638+0000 7f75fffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:52.211 INFO:tasks.workunit.client.0.smithi016.stderr: -317> 2024-09-12T17:23:51.638+0000 7f75fffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:23:52.211 INFO:tasks.workunit.client.0.smithi016.stderr: -316> 2024-09-12T17:23:51.638+0000 7f75fffff640 10 monclient: dump: 2024-09-12T17:23:52.212 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:23:52.212 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:23:52.212 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:52.212 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:52.212 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:52.212 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:52.212 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:23:52.212 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:23:52.212 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:23:52.212 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:52.212 INFO:tasks.workunit.client.0.smithi016.stderr: -315> 2024-09-12T17:23:51.638+0000 7f75fffff640 10 monclient: _finish_auth 0 2024-09-12T17:23:52.212 INFO:tasks.workunit.client.0.smithi016.stderr: -314> 2024-09-12T17:23:51.638+0000 7f75fffff640 10 monclient: _check_auth_tickets 2024-09-12T17:23:52.212 INFO:tasks.workunit.client.0.smithi016.stderr: -313> 2024-09-12T17:23:51.638+0000 7f75fffff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:23:52.213 INFO:tasks.workunit.client.0.smithi016.stderr: -312> 2024-09-12T17:23:51.638+0000 7f75fffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:52.213 INFO:tasks.workunit.client.0.smithi016.stderr: -311> 2024-09-12T17:23:51.638+0000 7f75fffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:23:52.213 INFO:tasks.workunit.client.0.smithi016.stderr: -310> 2024-09-12T17:23:51.638+0000 7f75fffff640 10 monclient: dump: 2024-09-12T17:23:52.213 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:23:52.213 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:23:52.213 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:52.213 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:52.213 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:52.213 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:52.213 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:23:52.213 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:23:52.213 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:23:52.213 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:52.214 INFO:tasks.workunit.client.0.smithi016.stderr: -309> 2024-09-12T17:23:51.638+0000 7f771b1b1640 4 set_mon_vals no callback set 2024-09-12T17:23:52.214 INFO:tasks.workunit.client.0.smithi016.stderr: -308> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 monclient: authenticate success, global_id 8292 2024-09-12T17:23:52.214 INFO:tasks.workunit.client.0.smithi016.stderr: -307> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 10 monclient: _renew_subs 2024-09-12T17:23:52.214 INFO:tasks.workunit.client.0.smithi016.stderr: -306> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:23:52.214 INFO:tasks.workunit.client.0.smithi016.stderr: -305> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 10 monclient: _renew_subs 2024-09-12T17:23:52.214 INFO:tasks.workunit.client.0.smithi016.stderr: -304> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:23:52.214 INFO:tasks.workunit.client.0.smithi016.stderr: -303> 2024-09-12T17:23:51.638+0000 7f75fffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:23:52.214 INFO:tasks.workunit.client.0.smithi016.stderr: -302> 2024-09-12T17:23:51.638+0000 7f75fffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:23:52.214 INFO:tasks.workunit.client.0.smithi016.stderr: -301> 2024-09-12T17:23:51.638+0000 7f75fffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:23:52.214 INFO:tasks.workunit.client.0.smithi016.stderr: -300> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 10 monclient: get_monmap_and_config 2024-09-12T17:23:52.214 INFO:tasks.workunit.client.0.smithi016.stderr: -299> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 10 monclient: build_initial_monmap 2024-09-12T17:23:52.214 INFO:tasks.workunit.client.0.smithi016.stderr: -298> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 1 build_initial for_mkfs: 0 2024-09-12T17:23:52.214 INFO:tasks.workunit.client.0.smithi016.stderr: -297> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 10 monclient: monmap: 2024-09-12T17:23:52.214 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:23:52.215 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:23:52.215 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:23:52.215 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:23:52.215 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:23:52.215 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:52.215 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:23:52.215 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:23:52.215 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:23:52.215 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:52.215 INFO:tasks.workunit.client.0.smithi016.stderr: -296> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0154220) adding auth protocol: cephx 2024-09-12T17:23:52.215 INFO:tasks.workunit.client.0.smithi016.stderr: -295> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0154220) adding auth protocol: cephx 2024-09-12T17:23:52.215 INFO:tasks.workunit.client.0.smithi016.stderr: -294> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0154220) adding auth protocol: cephx 2024-09-12T17:23:52.215 INFO:tasks.workunit.client.0.smithi016.stderr: -293> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0154220) adding con mode: secure 2024-09-12T17:23:52.216 INFO:tasks.workunit.client.0.smithi016.stderr: -292> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0154220) adding con mode: crc 2024-09-12T17:23:52.216 INFO:tasks.workunit.client.0.smithi016.stderr: -291> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0154220) adding con mode: secure 2024-09-12T17:23:52.216 INFO:tasks.workunit.client.0.smithi016.stderr: -290> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0154220) adding con mode: crc 2024-09-12T17:23:52.216 INFO:tasks.workunit.client.0.smithi016.stderr: -289> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0154220) adding con mode: secure 2024-09-12T17:23:52.216 INFO:tasks.workunit.client.0.smithi016.stderr: -288> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0154220) adding con mode: crc 2024-09-12T17:23:52.216 INFO:tasks.workunit.client.0.smithi016.stderr: -287> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0154220) adding con mode: crc 2024-09-12T17:23:52.216 INFO:tasks.workunit.client.0.smithi016.stderr: -286> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0154220) adding con mode: secure 2024-09-12T17:23:52.216 INFO:tasks.workunit.client.0.smithi016.stderr: -285> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0154220) adding con mode: crc 2024-09-12T17:23:52.216 INFO:tasks.workunit.client.0.smithi016.stderr: -284> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0154220) adding con mode: secure 2024-09-12T17:23:52.216 INFO:tasks.workunit.client.0.smithi016.stderr: -283> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0154220) adding con mode: crc 2024-09-12T17:23:52.216 INFO:tasks.workunit.client.0.smithi016.stderr: -282> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0154220) adding con mode: secure 2024-09-12T17:23:52.216 INFO:tasks.workunit.client.0.smithi016.stderr: -281> 2024-09-12T17:23:51.638+0000 7f77199ae640 10 monclient: get_auth_request con 0x7f75f4070a20 auth_method 0 2024-09-12T17:23:52.217 INFO:tasks.workunit.client.0.smithi016.stderr: -280> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:52.217 INFO:tasks.workunit.client.0.smithi016.stderr: -279> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 10 monclient: init 2024-09-12T17:23:52.217 INFO:tasks.workunit.client.0.smithi016.stderr: -278> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a0c0) adding auth protocol: cephx 2024-09-12T17:23:52.217 INFO:tasks.workunit.client.0.smithi016.stderr: -277> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a0c0) adding auth protocol: cephx 2024-09-12T17:23:52.217 INFO:tasks.workunit.client.0.smithi016.stderr: -276> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a0c0) adding auth protocol: cephx 2024-09-12T17:23:52.217 INFO:tasks.workunit.client.0.smithi016.stderr: -275> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a0c0) adding con mode: secure 2024-09-12T17:23:52.217 INFO:tasks.workunit.client.0.smithi016.stderr: -274> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a0c0) adding con mode: crc 2024-09-12T17:23:52.217 INFO:tasks.workunit.client.0.smithi016.stderr: -273> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a0c0) adding con mode: secure 2024-09-12T17:23:52.217 INFO:tasks.workunit.client.0.smithi016.stderr: -272> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a0c0) adding con mode: crc 2024-09-12T17:23:52.217 INFO:tasks.workunit.client.0.smithi016.stderr: -271> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a0c0) adding con mode: secure 2024-09-12T17:23:52.217 INFO:tasks.workunit.client.0.smithi016.stderr: -270> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a0c0) adding con mode: crc 2024-09-12T17:23:52.217 INFO:tasks.workunit.client.0.smithi016.stderr: -269> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a0c0) adding con mode: crc 2024-09-12T17:23:52.217 INFO:tasks.workunit.client.0.smithi016.stderr: -268> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a0c0) adding con mode: secure 2024-09-12T17:23:52.217 INFO:tasks.workunit.client.0.smithi016.stderr: -267> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a0c0) adding con mode: crc 2024-09-12T17:23:52.218 INFO:tasks.workunit.client.0.smithi016.stderr: -266> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a0c0) adding con mode: secure 2024-09-12T17:23:52.218 INFO:tasks.workunit.client.0.smithi016.stderr: -265> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a0c0) adding con mode: crc 2024-09-12T17:23:52.218 INFO:tasks.workunit.client.0.smithi016.stderr: -264> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a0c0) adding con mode: secure 2024-09-12T17:23:52.218 INFO:tasks.workunit.client.0.smithi016.stderr: -263> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:52.218 INFO:tasks.workunit.client.0.smithi016.stderr: -262> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:52.218 INFO:tasks.workunit.client.0.smithi016.stderr: -261> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 asok(0x5560cfeab2b0) register_command rotate-key cmddesc rotate-key hook 0x7fff2691a208 EEXIST 2024-09-12T17:23:52.218 INFO:tasks.workunit.client.0.smithi016.stderr: -260> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 10 monclient: _reopen_session rank -1 2024-09-12T17:23:52.218 INFO:tasks.workunit.client.0.smithi016.stderr: -259> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:23:52.218 INFO:tasks.workunit.client.0.smithi016.stderr: -258> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient(hunting): picked mon.noname-b con 0x5560d0188600 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:23:52.218 INFO:tasks.workunit.client.0.smithi016.stderr: -257> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient(hunting): picked mon.noname-c con 0x5560d0159600 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:23:52.218 INFO:tasks.workunit.client.0.smithi016.stderr: -256> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient(hunting): picked mon.noname-a con 0x5560d0183ed0 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:23:52.218 INFO:tasks.workunit.client.0.smithi016.stderr: -255> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:52.218 INFO:tasks.workunit.client.0.smithi016.stderr: -254> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:52.219 INFO:tasks.workunit.client.0.smithi016.stderr: -253> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:52.219 INFO:tasks.workunit.client.0.smithi016.stderr: -252> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient(hunting): _renew_subs 2024-09-12T17:23:52.219 INFO:tasks.workunit.client.0.smithi016.stderr: -251> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient(hunting): authenticate will time out at 2549.620069s 2024-09-12T17:23:52.219 INFO:tasks.workunit.client.0.smithi016.stderr: -250> 2024-09-12T17:23:51.642+0000 7f771a9b0640 10 monclient(hunting): get_auth_request con 0x5560d0159600 auth_method 0 2024-09-12T17:23:52.219 INFO:tasks.workunit.client.0.smithi016.stderr: -249> 2024-09-12T17:23:51.642+0000 7f771a9b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:52.219 INFO:tasks.workunit.client.0.smithi016.stderr: -248> 2024-09-12T17:23:51.642+0000 7f771a9b0640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:52.219 INFO:tasks.workunit.client.0.smithi016.stderr: -247> 2024-09-12T17:23:51.642+0000 7f771a9b0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:52.219 INFO:tasks.workunit.client.0.smithi016.stderr: -246> 2024-09-12T17:23:51.642+0000 7f771a1af640 10 monclient(hunting): get_auth_request con 0x5560d0183ed0 auth_method 0 2024-09-12T17:23:52.219 INFO:tasks.workunit.client.0.smithi016.stderr: -245> 2024-09-12T17:23:51.642+0000 7f771a1af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:52.219 INFO:tasks.workunit.client.0.smithi016.stderr: -244> 2024-09-12T17:23:51.642+0000 7f771a1af640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:52.219 INFO:tasks.workunit.client.0.smithi016.stderr: -243> 2024-09-12T17:23:51.642+0000 7f771a1af640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:52.219 INFO:tasks.workunit.client.0.smithi016.stderr: -242> 2024-09-12T17:23:51.642+0000 7f771a9b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:52.219 INFO:tasks.workunit.client.0.smithi016.stderr: -241> 2024-09-12T17:23:51.642+0000 7f771a9b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:52.220 INFO:tasks.workunit.client.0.smithi016.stderr: -240> 2024-09-12T17:23:51.642+0000 7f771a9b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:52.220 INFO:tasks.workunit.client.0.smithi016.stderr: -239> 2024-09-12T17:23:51.642+0000 7f771a1af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:52.220 INFO:tasks.workunit.client.0.smithi016.stderr: -238> 2024-09-12T17:23:51.642+0000 7f771a1af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:52.220 INFO:tasks.workunit.client.0.smithi016.stderr: -237> 2024-09-12T17:23:51.642+0000 7f771a1af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:52.220 INFO:tasks.workunit.client.0.smithi016.stderr: -236> 2024-09-12T17:23:51.642+0000 7f77199ae640 10 monclient(hunting): get_auth_request con 0x5560d0188600 auth_method 0 2024-09-12T17:23:52.220 INFO:tasks.workunit.client.0.smithi016.stderr: -235> 2024-09-12T17:23:51.642+0000 7f77199ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:52.220 INFO:tasks.workunit.client.0.smithi016.stderr: -234> 2024-09-12T17:23:51.642+0000 7f77199ae640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:52.220 INFO:tasks.workunit.client.0.smithi016.stderr: -233> 2024-09-12T17:23:51.642+0000 7f77199ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:52.220 INFO:tasks.workunit.client.0.smithi016.stderr: -232> 2024-09-12T17:23:51.642+0000 7f771a9b0640 10 monclient(hunting): handle_auth_done global_id 7877 payload 274 2024-09-12T17:23:52.220 INFO:tasks.workunit.client.0.smithi016.stderr: -231> 2024-09-12T17:23:51.642+0000 7f771a9b0640 10 monclient: _finish_hunting 0 2024-09-12T17:23:52.220 INFO:tasks.workunit.client.0.smithi016.stderr: -230> 2024-09-12T17:23:51.642+0000 7f771a9b0640 1 monclient: found mon.noname-c 2024-09-12T17:23:52.220 INFO:tasks.workunit.client.0.smithi016.stderr: -229> 2024-09-12T17:23:51.642+0000 7f771a9b0640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:23:52.220 INFO:tasks.workunit.client.0.smithi016.stderr: -228> 2024-09-12T17:23:51.642+0000 7f75fdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:52.220 INFO:tasks.workunit.client.0.smithi016.stderr: -227> 2024-09-12T17:23:51.642+0000 7f75fdffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:23:52.221 INFO:tasks.workunit.client.0.smithi016.stderr: -226> 2024-09-12T17:23:51.642+0000 7f75fdffb640 10 monclient: dump: 2024-09-12T17:23:52.221 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:23:52.221 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:23:52.221 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:52.221 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:52.221 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:52.221 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:52.221 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:23:52.221 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:23:52.221 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:23:52.221 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:52.221 INFO:tasks.workunit.client.0.smithi016.stderr: -225> 2024-09-12T17:23:51.642+0000 7f75fdffb640 10 monclient: _finish_auth 0 2024-09-12T17:23:52.221 INFO:tasks.workunit.client.0.smithi016.stderr: -224> 2024-09-12T17:23:51.642+0000 7f75fdffb640 10 monclient: _check_auth_tickets 2024-09-12T17:23:52.222 INFO:tasks.workunit.client.0.smithi016.stderr: -223> 2024-09-12T17:23:51.642+0000 7f75fdffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:23:52.222 INFO:tasks.workunit.client.0.smithi016.stderr: -222> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 monclient: authenticate success, global_id 7877 2024-09-12T17:23:52.222 INFO:tasks.workunit.client.0.smithi016.stderr: -221> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient: get_monmap_and_config success 2024-09-12T17:23:52.222 INFO:tasks.workunit.client.0.smithi016.stderr: -220> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 4 set_mon_vals no callback set 2024-09-12T17:23:52.222 INFO:tasks.workunit.client.0.smithi016.stderr: -219> 2024-09-12T17:23:51.642+0000 7f75fdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:52.222 INFO:tasks.workunit.client.0.smithi016.stderr: -218> 2024-09-12T17:23:51.642+0000 7f75fdffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:23:52.222 INFO:tasks.workunit.client.0.smithi016.stderr: -217> 2024-09-12T17:23:51.642+0000 7f75fdffb640 10 monclient: dump: 2024-09-12T17:23:52.222 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:23:52.222 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:23:52.222 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:52.222 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:52.222 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:52.222 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:52.223 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:23:52.223 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:23:52.223 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:23:52.223 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:52.223 INFO:tasks.workunit.client.0.smithi016.stderr: -216> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient: shutdown 2024-09-12T17:23:52.223 INFO:tasks.workunit.client.0.smithi016.stderr: -215> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient: build_initial_monmap 2024-09-12T17:23:52.223 INFO:tasks.workunit.client.0.smithi016.stderr: -214> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 1 build_initial for_mkfs: 0 2024-09-12T17:23:52.223 INFO:tasks.workunit.client.0.smithi016.stderr: -213> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient: monmap: 2024-09-12T17:23:52.223 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:23:52.223 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:23:52.223 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:23:52.223 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:23:52.223 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:23:52.224 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:52.224 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:23:52.224 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:23:52.224 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:23:52.224 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:52.224 INFO:tasks.workunit.client.0.smithi016.stderr: -212> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0178e00) adding auth protocol: cephx 2024-09-12T17:23:52.224 INFO:tasks.workunit.client.0.smithi016.stderr: -211> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0178e00) adding auth protocol: cephx 2024-09-12T17:23:52.224 INFO:tasks.workunit.client.0.smithi016.stderr: -210> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0178e00) adding auth protocol: cephx 2024-09-12T17:23:52.224 INFO:tasks.workunit.client.0.smithi016.stderr: -209> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0178e00) adding con mode: secure 2024-09-12T17:23:52.224 INFO:tasks.workunit.client.0.smithi016.stderr: -208> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0178e00) adding con mode: crc 2024-09-12T17:23:52.224 INFO:tasks.workunit.client.0.smithi016.stderr: -207> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0178e00) adding con mode: secure 2024-09-12T17:23:52.224 INFO:tasks.workunit.client.0.smithi016.stderr: -206> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0178e00) adding con mode: crc 2024-09-12T17:23:52.224 INFO:tasks.workunit.client.0.smithi016.stderr: -205> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0178e00) adding con mode: secure 2024-09-12T17:23:52.225 INFO:tasks.workunit.client.0.smithi016.stderr: -204> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0178e00) adding con mode: crc 2024-09-12T17:23:52.225 INFO:tasks.workunit.client.0.smithi016.stderr: -203> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0178e00) adding con mode: crc 2024-09-12T17:23:52.225 INFO:tasks.workunit.client.0.smithi016.stderr: -202> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0178e00) adding con mode: secure 2024-09-12T17:23:52.225 INFO:tasks.workunit.client.0.smithi016.stderr: -201> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0178e00) adding con mode: crc 2024-09-12T17:23:52.225 INFO:tasks.workunit.client.0.smithi016.stderr: -200> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0178e00) adding con mode: secure 2024-09-12T17:23:52.225 INFO:tasks.workunit.client.0.smithi016.stderr: -199> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0178e00) adding con mode: crc 2024-09-12T17:23:52.225 INFO:tasks.workunit.client.0.smithi016.stderr: -198> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0178e00) adding con mode: secure 2024-09-12T17:23:52.225 INFO:tasks.workunit.client.0.smithi016.stderr: -197> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:52.225 INFO:tasks.workunit.client.0.smithi016.stderr: -196> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 1 librados: starting msgr at 2024-09-12T17:23:52.225 INFO:tasks.workunit.client.0.smithi016.stderr: -195> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 1 librados: starting objecter 2024-09-12T17:23:52.225 INFO:tasks.workunit.client.0.smithi016.stderr: -194> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 asok(0x5560cfeab2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5560d0137b00 EEXIST 2024-09-12T17:23:52.225 INFO:tasks.workunit.client.0.smithi016.stderr: -193> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 1 librados: setting wanted keys 2024-09-12T17:23:52.225 INFO:tasks.workunit.client.0.smithi016.stderr: -192> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 1 librados: calling monclient init 2024-09-12T17:23:52.226 INFO:tasks.workunit.client.0.smithi016.stderr: -191> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient: init 2024-09-12T17:23:52.226 INFO:tasks.workunit.client.0.smithi016.stderr: -190> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0136dc0) adding auth protocol: cephx 2024-09-12T17:23:52.226 INFO:tasks.workunit.client.0.smithi016.stderr: -189> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0136dc0) adding auth protocol: cephx 2024-09-12T17:23:52.226 INFO:tasks.workunit.client.0.smithi016.stderr: -188> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0136dc0) adding auth protocol: cephx 2024-09-12T17:23:52.226 INFO:tasks.workunit.client.0.smithi016.stderr: -187> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0136dc0) adding con mode: secure 2024-09-12T17:23:52.226 INFO:tasks.workunit.client.0.smithi016.stderr: -186> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0136dc0) adding con mode: crc 2024-09-12T17:23:52.226 INFO:tasks.workunit.client.0.smithi016.stderr: -185> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0136dc0) adding con mode: secure 2024-09-12T17:23:52.226 INFO:tasks.workunit.client.0.smithi016.stderr: -184> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0136dc0) adding con mode: crc 2024-09-12T17:23:52.226 INFO:tasks.workunit.client.0.smithi016.stderr: -183> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0136dc0) adding con mode: secure 2024-09-12T17:23:52.226 INFO:tasks.workunit.client.0.smithi016.stderr: -182> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0136dc0) adding con mode: crc 2024-09-12T17:23:52.226 INFO:tasks.workunit.client.0.smithi016.stderr: -181> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0136dc0) adding con mode: crc 2024-09-12T17:23:52.226 INFO:tasks.workunit.client.0.smithi016.stderr: -180> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0136dc0) adding con mode: secure 2024-09-12T17:23:52.226 INFO:tasks.workunit.client.0.smithi016.stderr: -179> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0136dc0) adding con mode: crc 2024-09-12T17:23:52.226 INFO:tasks.workunit.client.0.smithi016.stderr: -178> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0136dc0) adding con mode: secure 2024-09-12T17:23:52.227 INFO:tasks.workunit.client.0.smithi016.stderr: -177> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0136dc0) adding con mode: crc 2024-09-12T17:23:52.227 INFO:tasks.workunit.client.0.smithi016.stderr: -176> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0136dc0) adding con mode: secure 2024-09-12T17:23:52.227 INFO:tasks.workunit.client.0.smithi016.stderr: -175> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:52.227 INFO:tasks.workunit.client.0.smithi016.stderr: -174> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:52.227 INFO:tasks.workunit.client.0.smithi016.stderr: -173> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 asok(0x5560cfeab2b0) register_command rotate-key cmddesc rotate-key hook 0x5560d0136f08 EEXIST 2024-09-12T17:23:52.227 INFO:tasks.workunit.client.0.smithi016.stderr: -172> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient: _reopen_session rank -1 2024-09-12T17:23:52.227 INFO:tasks.workunit.client.0.smithi016.stderr: -171> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:23:52.227 INFO:tasks.workunit.client.0.smithi016.stderr: -170> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient(hunting): picked mon.noname-b con 0x5560d0159600 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:23:52.227 INFO:tasks.workunit.client.0.smithi016.stderr: -169> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient(hunting): picked mon.noname-a con 0x5560d0183ed0 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:23:52.227 INFO:tasks.workunit.client.0.smithi016.stderr: -168> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient(hunting): picked mon.noname-c con 0x5560d0188600 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:23:52.227 INFO:tasks.workunit.client.0.smithi016.stderr: -167> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:52.227 INFO:tasks.workunit.client.0.smithi016.stderr: -166> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:52.227 INFO:tasks.workunit.client.0.smithi016.stderr: -165> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:52.227 INFO:tasks.workunit.client.0.smithi016.stderr: -164> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient(hunting): _renew_subs 2024-09-12T17:23:52.227 INFO:tasks.workunit.client.0.smithi016.stderr: -163> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient(hunting): authenticate will time out at 2549.622675s 2024-09-12T17:23:52.228 INFO:tasks.workunit.client.0.smithi016.stderr: -162> 2024-09-12T17:23:51.642+0000 7f771a9b0640 10 monclient(hunting): get_auth_request con 0x5560d0183ed0 auth_method 0 2024-09-12T17:23:52.228 INFO:tasks.workunit.client.0.smithi016.stderr: -161> 2024-09-12T17:23:51.642+0000 7f771a9b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:52.228 INFO:tasks.workunit.client.0.smithi016.stderr: -160> 2024-09-12T17:23:51.642+0000 7f771a9b0640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:52.228 INFO:tasks.workunit.client.0.smithi016.stderr: -159> 2024-09-12T17:23:51.642+0000 7f771a9b0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:52.228 INFO:tasks.workunit.client.0.smithi016.stderr: -158> 2024-09-12T17:23:51.642+0000 7f771a1af640 10 monclient(hunting): get_auth_request con 0x5560d0188600 auth_method 0 2024-09-12T17:23:52.228 INFO:tasks.workunit.client.0.smithi016.stderr: -157> 2024-09-12T17:23:51.642+0000 7f771a1af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:52.228 INFO:tasks.workunit.client.0.smithi016.stderr: -156> 2024-09-12T17:23:51.642+0000 7f771a1af640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:52.228 INFO:tasks.workunit.client.0.smithi016.stderr: -155> 2024-09-12T17:23:51.642+0000 7f771a1af640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:52.228 INFO:tasks.workunit.client.0.smithi016.stderr: -154> 2024-09-12T17:23:51.642+0000 7f771a1af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:52.228 INFO:tasks.workunit.client.0.smithi016.stderr: -153> 2024-09-12T17:23:51.642+0000 7f771a1af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:52.228 INFO:tasks.workunit.client.0.smithi016.stderr: -152> 2024-09-12T17:23:51.642+0000 7f771a1af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:52.228 INFO:tasks.workunit.client.0.smithi016.stderr: -151> 2024-09-12T17:23:51.642+0000 7f771a9b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:52.228 INFO:tasks.workunit.client.0.smithi016.stderr: -150> 2024-09-12T17:23:51.642+0000 7f771a9b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:52.229 INFO:tasks.workunit.client.0.smithi016.stderr: -149> 2024-09-12T17:23:51.642+0000 7f771a9b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:52.229 INFO:tasks.workunit.client.0.smithi016.stderr: -148> 2024-09-12T17:23:51.642+0000 7f77199ae640 10 monclient(hunting): get_auth_request con 0x5560d0159600 auth_method 0 2024-09-12T17:23:52.229 INFO:tasks.workunit.client.0.smithi016.stderr: -147> 2024-09-12T17:23:51.642+0000 7f77199ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:52.229 INFO:tasks.workunit.client.0.smithi016.stderr: -146> 2024-09-12T17:23:51.642+0000 7f77199ae640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:52.229 INFO:tasks.workunit.client.0.smithi016.stderr: -145> 2024-09-12T17:23:51.642+0000 7f77199ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:52.229 INFO:tasks.workunit.client.0.smithi016.stderr: -144> 2024-09-12T17:23:51.642+0000 7f771a9b0640 10 monclient(hunting): handle_auth_done global_id 8298 payload 824 2024-09-12T17:23:52.229 INFO:tasks.workunit.client.0.smithi016.stderr: -143> 2024-09-12T17:23:51.642+0000 7f771a9b0640 10 monclient: _finish_hunting 0 2024-09-12T17:23:52.229 INFO:tasks.workunit.client.0.smithi016.stderr: -142> 2024-09-12T17:23:51.642+0000 7f771a9b0640 1 monclient: found mon.noname-a 2024-09-12T17:23:52.229 INFO:tasks.workunit.client.0.smithi016.stderr: -141> 2024-09-12T17:23:51.642+0000 7f771a9b0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:23:52.229 INFO:tasks.workunit.client.0.smithi016.stderr: -140> 2024-09-12T17:23:51.642+0000 7f75ebfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:52.229 INFO:tasks.workunit.client.0.smithi016.stderr: -139> 2024-09-12T17:23:51.642+0000 7f75ebfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:23:52.230 INFO:tasks.workunit.client.0.smithi016.stderr: -138> 2024-09-12T17:23:51.642+0000 7f75ebfff640 10 monclient: dump: 2024-09-12T17:23:52.230 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:23:52.230 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:23:52.230 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:52.230 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:52.230 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:52.230 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:52.230 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:23:52.230 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:23:52.230 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:23:52.230 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:52.230 INFO:tasks.workunit.client.0.smithi016.stderr: -137> 2024-09-12T17:23:51.642+0000 7f75ebfff640 10 monclient: _finish_auth 0 2024-09-12T17:23:52.230 INFO:tasks.workunit.client.0.smithi016.stderr: -136> 2024-09-12T17:23:51.642+0000 7f75ebfff640 10 monclient: _check_auth_tickets 2024-09-12T17:23:52.230 INFO:tasks.workunit.client.0.smithi016.stderr: -135> 2024-09-12T17:23:51.642+0000 7f75ebfff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:23:52.231 INFO:tasks.workunit.client.0.smithi016.stderr: -134> 2024-09-12T17:23:51.642+0000 7f75ebfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:52.231 INFO:tasks.workunit.client.0.smithi016.stderr: -133> 2024-09-12T17:23:51.642+0000 7f75ebfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:23:52.231 INFO:tasks.workunit.client.0.smithi016.stderr: -132> 2024-09-12T17:23:51.642+0000 7f75ebfff640 10 monclient: dump: 2024-09-12T17:23:52.231 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:23:52.231 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:23:52.231 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:52.231 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:52.231 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:52.231 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:52.231 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:23:52.231 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:23:52.231 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:23:52.231 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:52.232 INFO:tasks.workunit.client.0.smithi016.stderr: -131> 2024-09-12T17:23:51.642+0000 7f75fdffb640 4 set_mon_vals no callback set 2024-09-12T17:23:52.232 INFO:tasks.workunit.client.0.smithi016.stderr: -130> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 monclient: authenticate success, global_id 8298 2024-09-12T17:23:52.232 INFO:tasks.workunit.client.0.smithi016.stderr: -129> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient: _renew_subs 2024-09-12T17:23:52.232 INFO:tasks.workunit.client.0.smithi016.stderr: -128> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:23:52.232 INFO:tasks.workunit.client.0.smithi016.stderr: -127> 2024-09-12T17:23:51.646+0000 7f771c6a99c0 10 monclient: _renew_subs 2024-09-12T17:23:52.232 INFO:tasks.workunit.client.0.smithi016.stderr: -126> 2024-09-12T17:23:51.646+0000 7f771c6a99c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:23:52.232 INFO:tasks.workunit.client.0.smithi016.stderr: -125> 2024-09-12T17:23:51.646+0000 7f771c6a99c0 1 librados: init done 2024-09-12T17:23:52.232 INFO:tasks.workunit.client.0.smithi016.stderr: -124> 2024-09-12T17:23:51.646+0000 7f771c6a99c0 5 asok(0x5560cfeab2b0) register_command cr dump hook 0x7f77140f8e48 2024-09-12T17:23:52.232 INFO:tasks.workunit.client.0.smithi016.stderr: -123> 2024-09-12T17:23:51.646+0000 7f771c6a99c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.232 INFO:tasks.workunit.client.0.smithi016.stderr: -122> 2024-09-12T17:23:51.646+0000 7f75ebfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:23:52.232 INFO:tasks.workunit.client.0.smithi016.stderr: -121> 2024-09-12T17:23:51.646+0000 7f75ebfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:23:52.232 INFO:tasks.workunit.client.0.smithi016.stderr: -120> 2024-09-12T17:23:51.646+0000 7f75ebfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:23:52.232 INFO:tasks.workunit.client.0.smithi016.stderr: -119> 2024-09-12T17:23:51.646+0000 7f771a1af640 10 monclient: get_auth_request con 0x5560d01a1860 auth_method 0 2024-09-12T17:23:52.233 INFO:tasks.workunit.client.0.smithi016.stderr: -118> 2024-09-12T17:23:51.646+0000 7f77199ae640 10 monclient: get_auth_request con 0x7f75e4070b10 auth_method 0 2024-09-12T17:23:52.233 INFO:tasks.workunit.client.0.smithi016.stderr: -117> 2024-09-12T17:23:51.646+0000 7f771c6a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:52.233 INFO:tasks.workunit.client.0.smithi016.stderr: -116> 2024-09-12T17:23:51.646+0000 7f771c6a99c0 20 realm 2024-09-12T17:23:52.233 INFO:tasks.workunit.client.0.smithi016.stderr: -115> 2024-09-12T17:23:51.646+0000 7f771c6a99c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.233 INFO:tasks.workunit.client.0.smithi016.stderr: -114> 2024-09-12T17:23:51.646+0000 7f771c6a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:52.233 INFO:tasks.workunit.client.0.smithi016.stderr: -113> 2024-09-12T17:23:51.646+0000 7f771c6a99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:52.233 INFO:tasks.workunit.client.0.smithi016.stderr: -112> 2024-09-12T17:23:51.646+0000 7f771c6a99c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.233 INFO:tasks.workunit.client.0.smithi016.stderr: -111> 2024-09-12T17:23:51.646+0000 7f771c6a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:52.233 INFO:tasks.workunit.client.0.smithi016.stderr: -110> 2024-09-12T17:23:51.646+0000 7f771c6a99c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.233 INFO:tasks.workunit.client.0.smithi016.stderr: -109> 2024-09-12T17:23:51.650+0000 7f77199ae640 10 monclient: get_auth_request con 0x5560d01a5860 auth_method 0 2024-09-12T17:23:52.233 INFO:tasks.workunit.client.0.smithi016.stderr: -108> 2024-09-12T17:23:51.650+0000 7f771c6a99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:52.233 INFO:tasks.workunit.client.0.smithi016.stderr: -107> 2024-09-12T17:23:51.650+0000 7f771c6a99c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.233 INFO:tasks.workunit.client.0.smithi016.stderr: -106> 2024-09-12T17:23:51.650+0000 7f771a9b0640 10 monclient: get_auth_request con 0x5560d01a9150 auth_method 0 2024-09-12T17:23:52.234 INFO:tasks.workunit.client.0.smithi016.stderr: -105> 2024-09-12T17:23:51.650+0000 7f771c6a99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:52.234 INFO:tasks.workunit.client.0.smithi016.stderr: -104> 2024-09-12T17:23:51.650+0000 7f771c6a99c0 20 searching for the correct realm 2024-09-12T17:23:52.234 INFO:tasks.workunit.client.0.smithi016.stderr: -103> 2024-09-12T17:23:51.650+0000 7f771a1af640 10 monclient: get_auth_request con 0x5560d01adef0 auth_method 0 2024-09-12T17:23:52.234 INFO:tasks.workunit.client.0.smithi016.stderr: -102> 2024-09-12T17:23:51.654+0000 7f77199ae640 10 monclient: get_auth_request con 0x7f770c01bbf0 auth_method 0 2024-09-12T17:23:52.234 INFO:tasks.workunit.client.0.smithi016.stderr: -101> 2024-09-12T17:23:51.654+0000 7f771a9b0640 10 monclient: get_auth_request con 0x7f771002a070 auth_method 0 2024-09-12T17:23:52.234 INFO:tasks.workunit.client.0.smithi016.stderr: -100> 2024-09-12T17:23:51.654+0000 7f771a9b0640 0 -- 172.21.15.16:0/835741528 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f771002a070 msgr2=0x7f7710008930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:52.234 INFO:tasks.workunit.client.0.smithi016.stderr: -99> 2024-09-12T17:23:51.858+0000 7f771a9b0640 10 monclient: get_auth_request con 0x7f771002a070 auth_method 0 2024-09-12T17:23:52.234 INFO:tasks.workunit.client.0.smithi016.stderr: -98> 2024-09-12T17:23:51.862+0000 7f771a1af640 10 monclient: get_auth_request con 0x7f77140c2040 auth_method 0 2024-09-12T17:23:52.234 INFO:tasks.workunit.client.0.smithi016.stderr: -97> 2024-09-12T17:23:51.870+0000 7f77199ae640 0 -- 172.21.15.16:0/835741528 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f7714006650 msgr2=0x7f771411c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:52.234 INFO:tasks.workunit.client.0.smithi016.stderr: -96> 2024-09-12T17:23:51.870+0000 7f77199ae640 10 monclient: get_auth_request con 0x7f7714006650 auth_method 0 2024-09-12T17:23:52.234 INFO:tasks.workunit.client.0.smithi016.stderr: -95> 2024-09-12T17:23:52.074+0000 7f77199ae640 10 monclient: get_auth_request con 0x7f7714006650 auth_method 0 2024-09-12T17:23:52.234 INFO:tasks.workunit.client.0.smithi016.stderr: -94> 2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:23:52.234 INFO:tasks.workunit.client.0.smithi016.stderr: -93> 2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:52.235 INFO:tasks.workunit.client.0.smithi016.stderr: -92> 2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:23:52.235 INFO:tasks.workunit.client.0.smithi016.stderr: -91> 2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:52.235 INFO:tasks.workunit.client.0.smithi016.stderr: -90> 2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:52.235 INFO:tasks.workunit.client.0.smithi016.stderr: -89> 2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:52.235 INFO:tasks.workunit.client.0.smithi016.stderr: -88> 2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.235 INFO:tasks.workunit.client.0.smithi016.stderr: -87> 2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:52.235 INFO:tasks.workunit.client.0.smithi016.stderr: -86> 2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.235 INFO:tasks.workunit.client.0.smithi016.stderr: -85> 2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:52.235 INFO:tasks.workunit.client.0.smithi016.stderr: -84> 2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.235 INFO:tasks.workunit.client.0.smithi016.stderr: -83> 2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:52.235 INFO:tasks.workunit.client.0.smithi016.stderr: -82> 2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 zone default found 2024-09-12T17:23:52.235 INFO:tasks.workunit.client.0.smithi016.stderr: -81> 2024-09-12T17:23:52.090+0000 7f771c6a99c0 4 Realm: () 2024-09-12T17:23:52.235 INFO:tasks.workunit.client.0.smithi016.stderr: -80> 2024-09-12T17:23:52.090+0000 7f771c6a99c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:23:52.235 INFO:tasks.workunit.client.0.smithi016.stderr: -79> 2024-09-12T17:23:52.090+0000 7f771c6a99c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:23:52.236 INFO:tasks.workunit.client.0.smithi016.stderr: -78> 2024-09-12T17:23:52.090+0000 7f771c6a99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:52.236 INFO:tasks.workunit.client.0.smithi016.stderr: -77> 2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 zonegroup default 2024-09-12T17:23:52.236 INFO:tasks.workunit.client.0.smithi016.stderr: -76> 2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.236 INFO:tasks.workunit.client.0.smithi016.stderr: -75> 2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:52.236 INFO:tasks.workunit.client.0.smithi016.stderr: -74> 2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.236 INFO:tasks.workunit.client.0.smithi016.stderr: -73> 2024-09-12T17:23:52.094+0000 7f771c6a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:52.236 INFO:tasks.workunit.client.0.smithi016.stderr: -72> 2024-09-12T17:23:52.094+0000 7f771c6a99c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.236 INFO:tasks.workunit.client.0.smithi016.stderr: -71> 2024-09-12T17:23:52.094+0000 7f771c6a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:52.236 INFO:tasks.workunit.client.0.smithi016.stderr: -70> 2024-09-12T17:23:52.094+0000 7f771c6a99c0 20 started sync module instance, tier type = 2024-09-12T17:23:52.236 INFO:tasks.workunit.client.0.smithi016.stderr: -69> 2024-09-12T17:23:52.094+0000 7f771c6a99c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:23:52.236 INFO:tasks.workunit.client.0.smithi016.stderr: -68> 2024-09-12T17:23:52.118+0000 7f771c6a99c0 20 add_watcher() i=0 2024-09-12T17:23:52.237 INFO:tasks.workunit.client.0.smithi016.stderr: -67> 2024-09-12T17:23:52.118+0000 7f771c6a99c0 20 add_watcher() i=1 2024-09-12T17:23:52.237 INFO:tasks.workunit.client.0.smithi016.stderr: -66> 2024-09-12T17:23:52.118+0000 7f771c6a99c0 20 add_watcher() i=2 2024-09-12T17:23:52.237 INFO:tasks.workunit.client.0.smithi016.stderr: -65> 2024-09-12T17:23:52.118+0000 7f771c6a99c0 20 add_watcher() i=3 2024-09-12T17:23:52.237 INFO:tasks.workunit.client.0.smithi016.stderr: -64> 2024-09-12T17:23:52.118+0000 7f771c6a99c0 20 add_watcher() i=4 2024-09-12T17:23:52.237 INFO:tasks.workunit.client.0.smithi016.stderr: -63> 2024-09-12T17:23:52.118+0000 7f771c6a99c0 20 add_watcher() i=5 2024-09-12T17:23:52.237 INFO:tasks.workunit.client.0.smithi016.stderr: -62> 2024-09-12T17:23:52.118+0000 7f771c6a99c0 20 add_watcher() i=6 2024-09-12T17:23:52.237 INFO:tasks.workunit.client.0.smithi016.stderr: -61> 2024-09-12T17:23:52.122+0000 7f771c6a99c0 20 add_watcher() i=7 2024-09-12T17:23:52.237 INFO:tasks.workunit.client.0.smithi016.stderr: -60> 2024-09-12T17:23:52.122+0000 7f771c6a99c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:52.237 INFO:tasks.workunit.client.0.smithi016.stderr: -59> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a590) adding auth protocol: cephx 2024-09-12T17:23:52.237 INFO:tasks.workunit.client.0.smithi016.stderr: -58> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a590) adding auth protocol: cephx 2024-09-12T17:23:52.237 INFO:tasks.workunit.client.0.smithi016.stderr: -57> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a590) adding auth protocol: cephx 2024-09-12T17:23:52.237 INFO:tasks.workunit.client.0.smithi016.stderr: -56> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a590) adding con mode: secure 2024-09-12T17:23:52.238 INFO:tasks.workunit.client.0.smithi016.stderr: -55> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a590) adding con mode: crc 2024-09-12T17:23:52.238 INFO:tasks.workunit.client.0.smithi016.stderr: -54> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a590) adding con mode: secure 2024-09-12T17:23:52.238 INFO:tasks.workunit.client.0.smithi016.stderr: -53> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a590) adding con mode: crc 2024-09-12T17:23:52.238 INFO:tasks.workunit.client.0.smithi016.stderr: -52> 2024-09-12T17:23:52.126+0000 7f75d17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:52.238 INFO:tasks.workunit.client.0.smithi016.stderr: -51> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a590) adding con mode: secure 2024-09-12T17:23:52.238 INFO:tasks.workunit.client.0.smithi016.stderr: -50> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a590) adding con mode: crc 2024-09-12T17:23:52.238 INFO:tasks.workunit.client.0.smithi016.stderr: -49> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a590) adding con mode: crc 2024-09-12T17:23:52.238 INFO:tasks.workunit.client.0.smithi016.stderr: -48> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a590) adding con mode: secure 2024-09-12T17:23:52.238 INFO:tasks.workunit.client.0.smithi016.stderr: -47> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a590) adding con mode: crc 2024-09-12T17:23:52.238 INFO:tasks.workunit.client.0.smithi016.stderr: -46> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a590) adding con mode: secure 2024-09-12T17:23:52.238 INFO:tasks.workunit.client.0.smithi016.stderr: -45> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a590) adding con mode: crc 2024-09-12T17:23:52.238 INFO:tasks.workunit.client.0.smithi016.stderr: -44> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a590) adding con mode: secure 2024-09-12T17:23:52.238 INFO:tasks.workunit.client.0.smithi016.stderr: -43> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:52.239 INFO:tasks.workunit.client.0.smithi016.stderr: -42> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:52.239 INFO:tasks.workunit.client.0.smithi016.stderr: -41> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:52.239 INFO:tasks.workunit.client.0.smithi016.stderr: -40> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 asok(0x5560cfeab2b0) register_command cache list hook 0x5560d01556e0 2024-09-12T17:23:52.239 INFO:tasks.workunit.client.0.smithi016.stderr: -39> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 asok(0x5560cfeab2b0) register_command cache inspect hook 0x5560d01556e0 2024-09-12T17:23:52.239 INFO:tasks.workunit.client.0.smithi016.stderr: -38> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 asok(0x5560cfeab2b0) register_command cache erase hook 0x5560d01556e0 2024-09-12T17:23:52.239 INFO:tasks.workunit.client.0.smithi016.stderr: -37> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 asok(0x5560cfeab2b0) register_command cache zap hook 0x5560d01556e0 2024-09-12T17:23:52.239 INFO:tasks.workunit.client.0.smithi016.stderr: -36> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 note: GC not initialized 2024-09-12T17:23:52.239 INFO:tasks.workunit.client.0.smithi016.stderr: -35> 2024-09-12T17:23:52.126+0000 7f75cb7fe640 20 reqs_thread_entry: start 2024-09-12T17:23:52.239 INFO:tasks.workunit.client.0.smithi016.stderr: -34> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 asok(0x5560cfeab2b0) register_command sync trace show hook 0x7f7714121020 2024-09-12T17:23:52.239 INFO:tasks.workunit.client.0.smithi016.stderr: -33> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 asok(0x5560cfeab2b0) register_command sync trace history hook 0x7f7714121020 2024-09-12T17:23:52.239 INFO:tasks.workunit.client.0.smithi016.stderr: -32> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 asok(0x5560cfeab2b0) register_command sync trace active hook 0x7f7714121020 2024-09-12T17:23:52.239 INFO:tasks.workunit.client.0.smithi016.stderr: -31> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 asok(0x5560cfeab2b0) register_command sync trace active_short hook 0x7f7714121020 2024-09-12T17:23:52.239 INFO:tasks.workunit.client.0.smithi016.stderr: -30> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 20 init_complete bucket index max shards: 1 2024-09-12T17:23:52.240 INFO:tasks.workunit.client.0.smithi016.stderr: -29> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 20 Filter name: none 2024-09-12T17:23:52.240 INFO:tasks.workunit.client.0.smithi016.stderr: -28> 2024-09-12T17:23:52.126+0000 7f75c97fa640 20 reqs_thread_entry: start 2024-09-12T17:23:52.240 INFO:tasks.workunit.client.0.smithi016.stderr: -27> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:23:52.240 INFO:tasks.workunit.client.0.smithi016.stderr: -26> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.240 INFO:tasks.workunit.client.0.smithi016.stderr: -25> 2024-09-12T17:23:52.130+0000 7f771c6a99c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:23:52.240 INFO:tasks.workunit.client.0.smithi016.stderr: -24> 2024-09-12T17:23:52.130+0000 7f771c6a99c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:23:52.240 INFO:tasks.workunit.client.0.smithi016.stderr: -23> 2024-09-12T17:23:52.130+0000 7f771c6a99c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:23:52.240 INFO:tasks.workunit.client.0.smithi016.stderr: -22> 2024-09-12T17:23:52.130+0000 7f771c6a99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 : miss 2024-09-12T17:23:52.240 INFO:tasks.workunit.client.0.smithi016.stderr: -21> 2024-09-12T17:23:52.130+0000 7f771c6a99c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.240 INFO:tasks.workunit.client.0.smithi016.stderr: -20> 2024-09-12T17:23:52.130+0000 7f771c6a99c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T17:23:52.240 INFO:tasks.workunit.client.0.smithi016.stderr: -19> 2024-09-12T17:23:52.130+0000 7f771c6a99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:23:52.240 INFO:tasks.workunit.client.0.smithi016.stderr: -18> 2024-09-12T17:23:52.130+0000 7f771c6a99c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:23:52.240 INFO:tasks.workunit.client.0.smithi016.stderr: -17> 2024-09-12T17:23:52.130+0000 7f771c6a99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:23:52.240 INFO:tasks.workunit.client.0.smithi016.stderr: -16> 2024-09-12T17:23:52.130+0000 7f771c6a99c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:23:52.241 INFO:tasks.workunit.client.0.smithi016.stderr: -15> 2024-09-12T17:23:52.130+0000 7f771c6a99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 2024-09-12T17:23:52.241 INFO:tasks.workunit.client.0.smithi016.stderr: -14> 2024-09-12T17:23:52.134+0000 7f771c6a99c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:23:52.241 INFO:tasks.workunit.client.0.smithi016.stderr: -13> 2024-09-12T17:23:52.142+0000 7f771c6a99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:23:52.241 INFO:tasks.workunit.client.0.smithi016.stderr: -12> 2024-09-12T17:23:52.142+0000 7f771c6a99c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:23:52.241 INFO:tasks.workunit.client.0.smithi016.stderr: -11> 2024-09-12T17:23:52.142+0000 7f771c6a99c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:23:52.241 INFO:tasks.workunit.client.0.smithi016.stderr: -10> 2024-09-12T17:23:52.142+0000 7f771c6a99c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17, ofs0, ns] 2024-09-12T17:23:52.241 INFO:tasks.workunit.client.0.smithi016.stderr: -9> 2024-09-12T17:23:52.142+0000 7f75fdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431631 cookie 93874296660144 notifier 8298 bl.length()=827 2024-09-12T17:23:52.241 INFO:tasks.workunit.client.0.smithi016.stderr: -8> 2024-09-12T17:23:52.142+0000 7f75fdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:23:52.241 INFO:tasks.workunit.client.0.smithi016.stderr: -7> 2024-09-12T17:23:52.142+0000 7f75fdffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:23:52.241 INFO:tasks.workunit.client.0.smithi016.stderr: -6> 2024-09-12T17:23:52.142+0000 7f75fdffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:23:52.241 INFO:tasks.workunit.client.0.smithi016.stderr: -5> 2024-09-12T17:23:52.146+0000 7f771c6a99c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): orig_sources= new_sources= 2024-09-12T17:23:52.241 INFO:tasks.workunit.client.0.smithi016.stderr: -4> 2024-09-12T17:23:52.146+0000 7f771c6a99c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): potential sources added=[] removed=[] 2024-09-12T17:23:52.241 INFO:tasks.workunit.client.0.smithi016.stderr: -3> 2024-09-12T17:23:52.146+0000 7f771c6a99c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): orig_dests= new_dests= 2024-09-12T17:23:52.242 INFO:tasks.workunit.client.0.smithi016.stderr: -2> 2024-09-12T17:23:52.146+0000 7f771c6a99c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): potential dests added=[] removed=[] 2024-09-12T17:23:52.242 INFO:tasks.workunit.client.0.smithi016.stderr: -1> 2024-09-12T17:23:52.150+0000 7f771c6a99c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f771c6a99c0 time 2024-09-12T17:23:52.156215+0000 2024-09-12T17:23:52.242 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:23:52.242 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:52.242 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:23:52.242 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f771ff832eb] 2024-09-12T17:23:52.242 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f771ff8349f] 2024-09-12T17:23:52.242 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5560cecef0c1] 2024-09-12T17:23:52.242 INFO:tasks.workunit.client.0.smithi016.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5560ced011fa] 2024-09-12T17:23:52.242 INFO:tasks.workunit.client.0.smithi016.stderr: 5: main() 2024-09-12T17:23:52.242 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f771ede9d90] 2024-09-12T17:23:52.242 INFO:tasks.workunit.client.0.smithi016.stderr: 7: __libc_start_main() 2024-09-12T17:23:52.242 INFO:tasks.workunit.client.0.smithi016.stderr: 8: _start() 2024-09-12T17:23:52.243 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:52.243 INFO:tasks.workunit.client.0.smithi016.stderr: 0> 2024-09-12T17:23:52.154+0000 7f771c6a99c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:23:52.243 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7f771c6a99c0 thread_name:radosgw-admin 2024-09-12T17:23:52.243 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:52.243 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:23:52.243 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f771ee02520] 2024-09-12T17:23:52.243 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:23:52.243 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:23:52.243 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:23:52.243 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f771ff83345] 2024-09-12T17:23:52.243 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f771ff8349f] 2024-09-12T17:23:52.243 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5560cecef0c1] 2024-09-12T17:23:52.243 INFO:tasks.workunit.client.0.smithi016.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5560ced011fa] 2024-09-12T17:23:52.243 INFO:tasks.workunit.client.0.smithi016.stderr: 9: main() 2024-09-12T17:23:52.244 INFO:tasks.workunit.client.0.smithi016.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f771ede9d90] 2024-09-12T17:23:52.244 INFO:tasks.workunit.client.0.smithi016.stderr: 11: __libc_start_main() 2024-09-12T17:23:52.244 INFO:tasks.workunit.client.0.smithi016.stderr: 12: _start() 2024-09-12T17:23:52.244 INFO:tasks.workunit.client.0.smithi016.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:23:52.244 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:52.244 INFO:tasks.workunit.client.0.smithi016.stderr:--- logging levels --- 2024-09-12T17:23:52.244 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 none 2024-09-12T17:23:52.244 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 lockdep 2024-09-12T17:23:52.244 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 context 2024-09-12T17:23:52.244 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 crush 2024-09-12T17:23:52.244 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds 2024-09-12T17:23:52.244 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_balancer 2024-09-12T17:23:52.244 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_locker 2024-09-12T17:23:52.245 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log 2024-09-12T17:23:52.245 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log_expire 2024-09-12T17:23:52.245 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_migrator 2024-09-12T17:23:52.245 INFO:tasks.workunit.client.0.smithi016.stderr: 3/ 5 mds_quiesce 2024-09-12T17:23:52.245 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 buffer 2024-09-12T17:23:52.245 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 timer 2024-09-12T17:23:52.245 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 filer 2024-09-12T17:23:52.245 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 striper 2024-09-12T17:23:52.245 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 objecter 2024-09-12T17:23:52.245 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rados 2024-09-12T17:23:52.245 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd 2024-09-12T17:23:52.245 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_mirror 2024-09-12T17:23:52.245 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_replay 2024-09-12T17:23:52.245 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_pwl 2024-09-12T17:23:52.246 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 journaler 2024-09-12T17:23:52.246 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objectcacher 2024-09-12T17:23:52.246 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:23:52.246 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 client 2024-09-12T17:23:52.246 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 osd 2024-09-12T17:23:52.246 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 optracker 2024-09-12T17:23:52.246 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objclass 2024-09-12T17:23:52.246 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 filestore 2024-09-12T17:23:52.246 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 journal 2024-09-12T17:23:52.246 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 ms 2024-09-12T17:23:52.246 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mon 2024-09-12T17:23:52.246 INFO:tasks.workunit.client.0.smithi016.stderr: 0/10 monc 2024-09-12T17:23:52.246 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 paxos 2024-09-12T17:23:52.246 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 tp 2024-09-12T17:23:52.247 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 auth 2024-09-12T17:23:52.247 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 crypto 2024-09-12T17:23:52.247 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 finisher 2024-09-12T17:23:52.247 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 reserver 2024-09-12T17:23:52.247 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 heartbeatmap 2024-09-12T17:23:52.247 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 perfcounter 2024-09-12T17:23:52.247 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw 2024-09-12T17:23:52.247 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_sync 2024-09-12T17:23:52.247 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_datacache 2024-09-12T17:23:52.247 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_access 2024-09-12T17:23:52.247 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:23:52.247 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_flight 2024-09-12T17:23:52.247 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:23:52.247 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw_notification 2024-09-12T17:23:52.248 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 javaclient 2024-09-12T17:23:52.248 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 asok 2024-09-12T17:23:52.248 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 throttle 2024-09-12T17:23:52.248 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 refs 2024-09-12T17:23:52.248 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 compressor 2024-09-12T17:23:52.248 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluestore 2024-09-12T17:23:52.248 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluefs 2024-09-12T17:23:52.248 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 bdev 2024-09-12T17:23:52.248 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 kstore 2024-09-12T17:23:52.248 INFO:tasks.workunit.client.0.smithi016.stderr: 4/ 5 rocksdb 2024-09-12T17:23:52.248 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 fuse 2024-09-12T17:23:52.248 INFO:tasks.workunit.client.0.smithi016.stderr: 2/ 5 mgr 2024-09-12T17:23:52.248 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mgrc 2024-09-12T17:23:52.249 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 dpdk 2024-09-12T17:23:52.249 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 eventtrace 2024-09-12T17:23:52.249 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 prioritycache 2024-09-12T17:23:52.249 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 test 2024-09-12T17:23:52.249 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:23:52.249 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephsqlite 2024-09-12T17:23:52.249 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:23:52.249 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore 2024-09-12T17:23:52.249 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_onode 2024-09-12T17:23:52.249 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_odata 2024-09-12T17:23:52.249 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_omap 2024-09-12T17:23:52.249 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_tm 2024-09-12T17:23:52.249 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_t 2024-09-12T17:23:52.250 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:23:52.250 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_epm 2024-09-12T17:23:52.250 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_lba 2024-09-12T17:23:52.250 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:23:52.250 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cache 2024-09-12T17:23:52.250 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_journal 2024-09-12T17:23:52.250 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_device 2024-09-12T17:23:52.250 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_backref 2024-09-12T17:23:52.250 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 alienstore 2024-09-12T17:23:52.250 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mclock 2024-09-12T17:23:52.251 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cyanstore 2024-09-12T17:23:52.251 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 ceph_exporter 2024-09-12T17:23:52.251 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 memstore 2024-09-12T17:23:52.251 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 trace 2024-09-12T17:23:52.251 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 ceph_dedup 2024-09-12T17:23:52.251 INFO:tasks.workunit.client.0.smithi016.stderr: -2/-2 (syslog threshold) 2024-09-12T17:23:52.251 INFO:tasks.workunit.client.0.smithi016.stderr: 99/99 (stderr threshold) 2024-09-12T17:23:52.251 INFO:tasks.workunit.client.0.smithi016.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:23:52.251 INFO:tasks.workunit.client.0.smithi016.stderr: 7f75c97fa640 / http_manager 2024-09-12T17:23:52.251 INFO:tasks.workunit.client.0.smithi016.stderr: 7f75cb7fe640 / http_manager 2024-09-12T17:23:52.251 INFO:tasks.workunit.client.0.smithi016.stderr: 7f75d17e2640 / rgw_dt_lg_renew 2024-09-12T17:23:52.251 INFO:tasks.workunit.client.0.smithi016.stderr: 7f75ebfff640 / ms_dispatch 2024-09-12T17:23:52.251 INFO:tasks.workunit.client.0.smithi016.stderr: 7f75fdffb640 / io_context_pool 2024-09-12T17:23:52.252 INFO:tasks.workunit.client.0.smithi016.stderr: 7f75fffff640 / ms_dispatch 2024-09-12T17:23:52.252 INFO:tasks.workunit.client.0.smithi016.stderr: 7f7606e05640 / ms_dispatch 2024-09-12T17:23:52.252 INFO:tasks.workunit.client.0.smithi016.stderr: 7f7608608640 / io_context_pool 2024-09-12T17:23:52.252 INFO:tasks.workunit.client.0.smithi016.stderr: 7f77199ae640 / msgr-worker-2 2024-09-12T17:23:52.252 INFO:tasks.workunit.client.0.smithi016.stderr: 7f771a1af640 / msgr-worker-1 2024-09-12T17:23:52.252 INFO:tasks.workunit.client.0.smithi016.stderr: 7f771a9b0640 / msgr-worker-0 2024-09-12T17:23:52.252 INFO:tasks.workunit.client.0.smithi016.stderr: 7f771b1b1640 / io_context_pool 2024-09-12T17:23:52.252 INFO:tasks.workunit.client.0.smithi016.stderr: 7f771c6a99c0 / radosgw-admin 2024-09-12T17:23:52.252 INFO:tasks.workunit.client.0.smithi016.stderr: max_recent 500 2024-09-12T17:23:52.252 INFO:tasks.workunit.client.0.smithi016.stderr: max_new 1000 2024-09-12T17:23:52.252 INFO:tasks.workunit.client.0.smithi016.stderr: log_file /var/log/ceph/ceph-client.admin.144521.log 2024-09-12T17:23:52.252 INFO:tasks.workunit.client.0.smithi016.stderr:--- end dump of recent events --- 2024-09-12T17:23:52.252 INFO:tasks.workunit.client.0.smithi016.stderr:--- begin dump of recent events --- 2024-09-12T17:23:52.253 INFO:tasks.workunit.client.0.smithi016.stderr: -499> 2024-09-12T17:23:51.622+0000 7f7608608640 10 monclient: _finish_auth 0 2024-09-12T17:23:52.253 INFO:tasks.workunit.client.0.smithi016.stderr: -498> 2024-09-12T17:23:51.622+0000 7f7608608640 10 monclient: _check_auth_tickets 2024-09-12T17:23:52.253 INFO:tasks.workunit.client.0.smithi016.stderr: -497> 2024-09-12T17:23:51.622+0000 7f7608608640 10 monclient: handle_config config(0 keys) 2024-09-12T17:23:52.253 INFO:tasks.workunit.client.0.smithi016.stderr: -496> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 monclient: authenticate success, global_id 8286 2024-09-12T17:23:52.253 INFO:tasks.workunit.client.0.smithi016.stderr: -495> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 10 monclient: get_monmap_and_config success 2024-09-12T17:23:52.253 INFO:tasks.workunit.client.0.smithi016.stderr: -494> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 4 set_mon_vals no callback set 2024-09-12T17:23:52.253 INFO:tasks.workunit.client.0.smithi016.stderr: -493> 2024-09-12T17:23:51.622+0000 7f7608608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:52.253 INFO:tasks.workunit.client.0.smithi016.stderr: -492> 2024-09-12T17:23:51.622+0000 7f7608608640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:23:52.253 INFO:tasks.workunit.client.0.smithi016.stderr: -491> 2024-09-12T17:23:51.622+0000 7f7608608640 10 monclient: dump: 2024-09-12T17:23:52.253 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:23:52.253 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:23:52.253 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:52.253 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:52.254 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:52.254 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:52.254 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:23:52.254 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:23:52.254 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:23:52.254 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:52.254 INFO:tasks.workunit.client.0.smithi016.stderr: -490> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 10 monclient: shutdown 2024-09-12T17:23:52.254 INFO:tasks.workunit.client.0.smithi016.stderr: -489> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 asok(0x5560cfeab2b0) unregister_commands rotate-key 2024-09-12T17:23:52.254 INFO:tasks.workunit.client.0.smithi016.stderr: -488> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 10 monclient: build_initial_monmap 2024-09-12T17:23:52.254 INFO:tasks.workunit.client.0.smithi016.stderr: -487> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 1 build_initial for_mkfs: 0 2024-09-12T17:23:52.254 INFO:tasks.workunit.client.0.smithi016.stderr: -486> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 10 monclient: monmap: 2024-09-12T17:23:52.254 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:23:52.254 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:23:52.255 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:23:52.255 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:23:52.255 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:23:52.255 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:52.255 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:23:52.255 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:23:52.255 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:23:52.255 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:52.255 INFO:tasks.workunit.client.0.smithi016.stderr: -485> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00bb660) adding auth protocol: cephx 2024-09-12T17:23:52.255 INFO:tasks.workunit.client.0.smithi016.stderr: -484> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00bb660) adding auth protocol: cephx 2024-09-12T17:23:52.255 INFO:tasks.workunit.client.0.smithi016.stderr: -483> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00bb660) adding auth protocol: cephx 2024-09-12T17:23:52.255 INFO:tasks.workunit.client.0.smithi016.stderr: -482> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00bb660) adding con mode: secure 2024-09-12T17:23:52.255 INFO:tasks.workunit.client.0.smithi016.stderr: -481> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00bb660) adding con mode: crc 2024-09-12T17:23:52.255 INFO:tasks.workunit.client.0.smithi016.stderr: -480> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00bb660) adding con mode: secure 2024-09-12T17:23:52.256 INFO:tasks.workunit.client.0.smithi016.stderr: -479> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00bb660) adding con mode: crc 2024-09-12T17:23:52.256 INFO:tasks.workunit.client.0.smithi016.stderr: -478> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00bb660) adding con mode: secure 2024-09-12T17:23:52.256 INFO:tasks.workunit.client.0.smithi016.stderr: -477> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00bb660) adding con mode: crc 2024-09-12T17:23:52.256 INFO:tasks.workunit.client.0.smithi016.stderr: -476> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00bb660) adding con mode: crc 2024-09-12T17:23:52.256 INFO:tasks.workunit.client.0.smithi016.stderr: -475> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00bb660) adding con mode: secure 2024-09-12T17:23:52.256 INFO:tasks.workunit.client.0.smithi016.stderr: -474> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00bb660) adding con mode: crc 2024-09-12T17:23:52.256 INFO:tasks.workunit.client.0.smithi016.stderr: -473> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00bb660) adding con mode: secure 2024-09-12T17:23:52.256 INFO:tasks.workunit.client.0.smithi016.stderr: -472> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00bb660) adding con mode: crc 2024-09-12T17:23:52.256 INFO:tasks.workunit.client.0.smithi016.stderr: -471> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00bb660) adding con mode: secure 2024-09-12T17:23:52.256 INFO:tasks.workunit.client.0.smithi016.stderr: -470> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:52.256 INFO:tasks.workunit.client.0.smithi016.stderr: -469> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 1 librados: starting msgr at 2024-09-12T17:23:52.256 INFO:tasks.workunit.client.0.smithi016.stderr: -468> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 1 librados: starting objecter 2024-09-12T17:23:52.256 INFO:tasks.workunit.client.0.smithi016.stderr: -467> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 asok(0x5560cfeab2b0) register_command objecter_requests hook 0x5560d00ba8e0 2024-09-12T17:23:52.257 INFO:tasks.workunit.client.0.smithi016.stderr: -466> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 1 librados: setting wanted keys 2024-09-12T17:23:52.257 INFO:tasks.workunit.client.0.smithi016.stderr: -465> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 1 librados: calling monclient init 2024-09-12T17:23:52.257 INFO:tasks.workunit.client.0.smithi016.stderr: -464> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 10 monclient: init 2024-09-12T17:23:52.257 INFO:tasks.workunit.client.0.smithi016.stderr: -463> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00b5e40) adding auth protocol: cephx 2024-09-12T17:23:52.257 INFO:tasks.workunit.client.0.smithi016.stderr: -462> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00b5e40) adding auth protocol: cephx 2024-09-12T17:23:52.257 INFO:tasks.workunit.client.0.smithi016.stderr: -461> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00b5e40) adding auth protocol: cephx 2024-09-12T17:23:52.257 INFO:tasks.workunit.client.0.smithi016.stderr: -460> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00b5e40) adding con mode: secure 2024-09-12T17:23:52.257 INFO:tasks.workunit.client.0.smithi016.stderr: -459> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00b5e40) adding con mode: crc 2024-09-12T17:23:52.257 INFO:tasks.workunit.client.0.smithi016.stderr: -458> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00b5e40) adding con mode: secure 2024-09-12T17:23:52.257 INFO:tasks.workunit.client.0.smithi016.stderr: -457> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00b5e40) adding con mode: crc 2024-09-12T17:23:52.257 INFO:tasks.workunit.client.0.smithi016.stderr: -456> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00b5e40) adding con mode: secure 2024-09-12T17:23:52.257 INFO:tasks.workunit.client.0.smithi016.stderr: -455> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00b5e40) adding con mode: crc 2024-09-12T17:23:52.257 INFO:tasks.workunit.client.0.smithi016.stderr: -454> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00b5e40) adding con mode: crc 2024-09-12T17:23:52.258 INFO:tasks.workunit.client.0.smithi016.stderr: -453> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00b5e40) adding con mode: secure 2024-09-12T17:23:52.258 INFO:tasks.workunit.client.0.smithi016.stderr: -452> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00b5e40) adding con mode: crc 2024-09-12T17:23:52.258 INFO:tasks.workunit.client.0.smithi016.stderr: -451> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00b5e40) adding con mode: secure 2024-09-12T17:23:52.258 INFO:tasks.workunit.client.0.smithi016.stderr: -450> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00b5e40) adding con mode: crc 2024-09-12T17:23:52.258 INFO:tasks.workunit.client.0.smithi016.stderr: -449> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 AuthRegistry(0x5560d00b5e40) adding con mode: secure 2024-09-12T17:23:52.258 INFO:tasks.workunit.client.0.smithi016.stderr: -448> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:52.258 INFO:tasks.workunit.client.0.smithi016.stderr: -447> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:52.258 INFO:tasks.workunit.client.0.smithi016.stderr: -446> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 5 asok(0x5560cfeab2b0) register_command rotate-key hook 0x5560d00b5f88 2024-09-12T17:23:52.258 INFO:tasks.workunit.client.0.smithi016.stderr: -445> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 10 monclient: _reopen_session rank -1 2024-09-12T17:23:52.258 INFO:tasks.workunit.client.0.smithi016.stderr: -444> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:23:52.258 INFO:tasks.workunit.client.0.smithi016.stderr: -443> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 10 monclient(hunting): picked mon.noname-c con 0x5560cff435f0 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:23:52.258 INFO:tasks.workunit.client.0.smithi016.stderr: -442> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 10 monclient(hunting): picked mon.noname-b con 0x5560cff6e690 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:23:52.258 INFO:tasks.workunit.client.0.smithi016.stderr: -441> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 10 monclient(hunting): picked mon.noname-a con 0x5560cfffb750 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:23:52.259 INFO:tasks.workunit.client.0.smithi016.stderr: -440> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:52.259 INFO:tasks.workunit.client.0.smithi016.stderr: -439> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:52.259 INFO:tasks.workunit.client.0.smithi016.stderr: -438> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:52.259 INFO:tasks.workunit.client.0.smithi016.stderr: -437> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 10 monclient(hunting): _renew_subs 2024-09-12T17:23:52.259 INFO:tasks.workunit.client.0.smithi016.stderr: -436> 2024-09-12T17:23:51.622+0000 7f771c6a99c0 10 monclient(hunting): authenticate will time out at 2549.603343s 2024-09-12T17:23:52.259 INFO:tasks.workunit.client.0.smithi016.stderr: -435> 2024-09-12T17:23:51.622+0000 7f771a9b0640 10 monclient(hunting): get_auth_request con 0x5560cfffb750 auth_method 0 2024-09-12T17:23:52.259 INFO:tasks.workunit.client.0.smithi016.stderr: -434> 2024-09-12T17:23:51.622+0000 7f771a9b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:52.259 INFO:tasks.workunit.client.0.smithi016.stderr: -433> 2024-09-12T17:23:51.622+0000 7f771a9b0640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:52.259 INFO:tasks.workunit.client.0.smithi016.stderr: -432> 2024-09-12T17:23:51.622+0000 7f771a9b0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:52.259 INFO:tasks.workunit.client.0.smithi016.stderr: -431> 2024-09-12T17:23:51.622+0000 7f771a1af640 10 monclient(hunting): get_auth_request con 0x5560cff435f0 auth_method 0 2024-09-12T17:23:52.259 INFO:tasks.workunit.client.0.smithi016.stderr: -430> 2024-09-12T17:23:51.622+0000 7f771a1af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:52.259 INFO:tasks.workunit.client.0.smithi016.stderr: -429> 2024-09-12T17:23:51.622+0000 7f771a1af640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:52.259 INFO:tasks.workunit.client.0.smithi016.stderr: -428> 2024-09-12T17:23:51.622+0000 7f771a1af640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:52.260 INFO:tasks.workunit.client.0.smithi016.stderr: -427> 2024-09-12T17:23:51.622+0000 7f771a9b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:52.260 INFO:tasks.workunit.client.0.smithi016.stderr: -426> 2024-09-12T17:23:51.622+0000 7f771a9b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:52.260 INFO:tasks.workunit.client.0.smithi016.stderr: -425> 2024-09-12T17:23:51.622+0000 7f771a9b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:52.260 INFO:tasks.workunit.client.0.smithi016.stderr: -424> 2024-09-12T17:23:51.622+0000 7f771a1af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:52.260 INFO:tasks.workunit.client.0.smithi016.stderr: -423> 2024-09-12T17:23:51.622+0000 7f771a1af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:52.260 INFO:tasks.workunit.client.0.smithi016.stderr: -422> 2024-09-12T17:23:51.622+0000 7f771a1af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:52.260 INFO:tasks.workunit.client.0.smithi016.stderr: -421> 2024-09-12T17:23:51.622+0000 7f77199ae640 10 monclient(hunting): get_auth_request con 0x5560cff6e690 auth_method 0 2024-09-12T17:23:52.260 INFO:tasks.workunit.client.0.smithi016.stderr: -420> 2024-09-12T17:23:51.622+0000 7f77199ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:52.260 INFO:tasks.workunit.client.0.smithi016.stderr: -419> 2024-09-12T17:23:51.622+0000 7f77199ae640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:52.260 INFO:tasks.workunit.client.0.smithi016.stderr: -418> 2024-09-12T17:23:51.622+0000 7f77199ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:52.260 INFO:tasks.workunit.client.0.smithi016.stderr: -417> 2024-09-12T17:23:51.622+0000 7f771a9b0640 10 monclient(hunting): handle_auth_done global_id 8289 payload 824 2024-09-12T17:23:52.260 INFO:tasks.workunit.client.0.smithi016.stderr: -416> 2024-09-12T17:23:51.622+0000 7f771a9b0640 10 monclient: _finish_hunting 0 2024-09-12T17:23:52.260 INFO:tasks.workunit.client.0.smithi016.stderr: -415> 2024-09-12T17:23:51.622+0000 7f771a9b0640 1 monclient: found mon.noname-a 2024-09-12T17:23:52.261 INFO:tasks.workunit.client.0.smithi016.stderr: -414> 2024-09-12T17:23:51.622+0000 7f771a9b0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:23:52.261 INFO:tasks.workunit.client.0.smithi016.stderr: -413> 2024-09-12T17:23:51.626+0000 7f7606e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:52.261 INFO:tasks.workunit.client.0.smithi016.stderr: -412> 2024-09-12T17:23:51.626+0000 7f7606e05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:23:52.261 INFO:tasks.workunit.client.0.smithi016.stderr: -411> 2024-09-12T17:23:51.626+0000 7f7606e05640 10 monclient: dump: 2024-09-12T17:23:52.261 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:23:52.261 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:23:52.261 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:52.261 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:52.261 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:52.261 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:52.261 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:23:52.261 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:23:52.261 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:23:52.262 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:52.262 INFO:tasks.workunit.client.0.smithi016.stderr: -410> 2024-09-12T17:23:51.626+0000 7f7606e05640 10 monclient: _finish_auth 0 2024-09-12T17:23:52.262 INFO:tasks.workunit.client.0.smithi016.stderr: -409> 2024-09-12T17:23:51.626+0000 7f7606e05640 10 monclient: _check_auth_tickets 2024-09-12T17:23:52.262 INFO:tasks.workunit.client.0.smithi016.stderr: -408> 2024-09-12T17:23:51.626+0000 7f7606e05640 10 monclient: handle_config config(0 keys) 2024-09-12T17:23:52.262 INFO:tasks.workunit.client.0.smithi016.stderr: -407> 2024-09-12T17:23:51.626+0000 7f7606e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:52.262 INFO:tasks.workunit.client.0.smithi016.stderr: -406> 2024-09-12T17:23:51.626+0000 7f7606e05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:23:52.262 INFO:tasks.workunit.client.0.smithi016.stderr: -405> 2024-09-12T17:23:51.626+0000 7f7606e05640 10 monclient: dump: 2024-09-12T17:23:52.262 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:23:52.262 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:23:52.262 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:52.262 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:52.262 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:52.262 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:52.263 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:23:52.263 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:23:52.263 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:23:52.263 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:52.263 INFO:tasks.workunit.client.0.smithi016.stderr: -404> 2024-09-12T17:23:51.626+0000 7f771c6a99c0 5 monclient: authenticate success, global_id 8289 2024-09-12T17:23:52.263 INFO:tasks.workunit.client.0.smithi016.stderr: -403> 2024-09-12T17:23:51.626+0000 7f771c6a99c0 10 monclient: _renew_subs 2024-09-12T17:23:52.263 INFO:tasks.workunit.client.0.smithi016.stderr: -402> 2024-09-12T17:23:51.626+0000 7f7608608640 4 set_mon_vals no callback set 2024-09-12T17:23:52.263 INFO:tasks.workunit.client.0.smithi016.stderr: -401> 2024-09-12T17:23:51.626+0000 7f771c6a99c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:23:52.263 INFO:tasks.workunit.client.0.smithi016.stderr: -400> 2024-09-12T17:23:51.626+0000 7f771c6a99c0 10 monclient: _renew_subs 2024-09-12T17:23:52.263 INFO:tasks.workunit.client.0.smithi016.stderr: -399> 2024-09-12T17:23:51.626+0000 7f771c6a99c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:23:52.263 INFO:tasks.workunit.client.0.smithi016.stderr: -398> 2024-09-12T17:23:51.626+0000 7f771c6a99c0 1 librados: init done 2024-09-12T17:23:52.263 INFO:tasks.workunit.client.0.smithi016.stderr: -397> 2024-09-12T17:23:51.626+0000 7f7606e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:23:52.263 INFO:tasks.workunit.client.0.smithi016.stderr: -396> 2024-09-12T17:23:51.626+0000 7f7606e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:23:52.263 INFO:tasks.workunit.client.0.smithi016.stderr: -395> 2024-09-12T17:23:51.626+0000 7f7606e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:23:52.264 INFO:tasks.workunit.client.0.smithi016.stderr: -394> 2024-09-12T17:23:51.626+0000 7f771a1af640 10 monclient: get_auth_request con 0x7f7600070ae0 auth_method 0 2024-09-12T17:23:52.264 INFO:tasks.workunit.client.0.smithi016.stderr: -393> 2024-09-12T17:23:51.626+0000 7f77199ae640 10 monclient: get_auth_request con 0x5560d00fe1d0 auth_method 0 2024-09-12T17:23:52.264 INFO:tasks.workunit.client.0.smithi016.stderr: -392> 2024-09-12T17:23:51.630+0000 7f771a1af640 10 monclient: get_auth_request con 0x5560d01013b0 auth_method 0 2024-09-12T17:23:52.264 INFO:tasks.workunit.client.0.smithi016.stderr: -391> 2024-09-12T17:23:51.630+0000 7f77199ae640 10 monclient: get_auth_request con 0x5560d01055a0 auth_method 0 2024-09-12T17:23:52.264 INFO:tasks.workunit.client.0.smithi016.stderr: -390> 2024-09-12T17:23:51.634+0000 7f771a9b0640 10 monclient: get_auth_request con 0x5560d0104c40 auth_method 0 2024-09-12T17:23:52.264 INFO:tasks.workunit.client.0.smithi016.stderr: -389> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 10 monclient: build_initial_monmap 2024-09-12T17:23:52.264 INFO:tasks.workunit.client.0.smithi016.stderr: -388> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 1 build_initial for_mkfs: 0 2024-09-12T17:23:52.264 INFO:tasks.workunit.client.0.smithi016.stderr: -387> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 10 monclient: monmap: 2024-09-12T17:23:52.264 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:23:52.264 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:23:52.264 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:23:52.264 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:23:52.264 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:23:52.265 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:52.265 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:23:52.265 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:23:52.265 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:23:52.265 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:52.265 INFO:tasks.workunit.client.0.smithi016.stderr: -386> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010d380) adding auth protocol: cephx 2024-09-12T17:23:52.265 INFO:tasks.workunit.client.0.smithi016.stderr: -385> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010d380) adding auth protocol: cephx 2024-09-12T17:23:52.265 INFO:tasks.workunit.client.0.smithi016.stderr: -384> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010d380) adding auth protocol: cephx 2024-09-12T17:23:52.265 INFO:tasks.workunit.client.0.smithi016.stderr: -383> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010d380) adding con mode: secure 2024-09-12T17:23:52.265 INFO:tasks.workunit.client.0.smithi016.stderr: -382> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010d380) adding con mode: crc 2024-09-12T17:23:52.265 INFO:tasks.workunit.client.0.smithi016.stderr: -381> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010d380) adding con mode: secure 2024-09-12T17:23:52.265 INFO:tasks.workunit.client.0.smithi016.stderr: -380> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010d380) adding con mode: crc 2024-09-12T17:23:52.265 INFO:tasks.workunit.client.0.smithi016.stderr: -379> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010d380) adding con mode: secure 2024-09-12T17:23:52.266 INFO:tasks.workunit.client.0.smithi016.stderr: -378> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010d380) adding con mode: crc 2024-09-12T17:23:52.266 INFO:tasks.workunit.client.0.smithi016.stderr: -377> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010d380) adding con mode: crc 2024-09-12T17:23:52.266 INFO:tasks.workunit.client.0.smithi016.stderr: -376> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010d380) adding con mode: secure 2024-09-12T17:23:52.266 INFO:tasks.workunit.client.0.smithi016.stderr: -375> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010d380) adding con mode: crc 2024-09-12T17:23:52.266 INFO:tasks.workunit.client.0.smithi016.stderr: -374> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010d380) adding con mode: secure 2024-09-12T17:23:52.266 INFO:tasks.workunit.client.0.smithi016.stderr: -373> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010d380) adding con mode: crc 2024-09-12T17:23:52.266 INFO:tasks.workunit.client.0.smithi016.stderr: -372> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010d380) adding con mode: secure 2024-09-12T17:23:52.266 INFO:tasks.workunit.client.0.smithi016.stderr: -371> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:52.266 INFO:tasks.workunit.client.0.smithi016.stderr: -370> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 asok(0x5560cfeab2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5560d0110df0 EEXIST 2024-09-12T17:23:52.266 INFO:tasks.workunit.client.0.smithi016.stderr: -369> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 10 monclient: init 2024-09-12T17:23:52.266 INFO:tasks.workunit.client.0.smithi016.stderr: -368> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010c338) adding auth protocol: cephx 2024-09-12T17:23:52.266 INFO:tasks.workunit.client.0.smithi016.stderr: -367> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010c338) adding auth protocol: cephx 2024-09-12T17:23:52.266 INFO:tasks.workunit.client.0.smithi016.stderr: -366> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010c338) adding auth protocol: cephx 2024-09-12T17:23:52.267 INFO:tasks.workunit.client.0.smithi016.stderr: -365> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010c338) adding con mode: secure 2024-09-12T17:23:52.267 INFO:tasks.workunit.client.0.smithi016.stderr: -364> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010c338) adding con mode: crc 2024-09-12T17:23:52.267 INFO:tasks.workunit.client.0.smithi016.stderr: -363> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010c338) adding con mode: secure 2024-09-12T17:23:52.267 INFO:tasks.workunit.client.0.smithi016.stderr: -362> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010c338) adding con mode: crc 2024-09-12T17:23:52.267 INFO:tasks.workunit.client.0.smithi016.stderr: -361> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010c338) adding con mode: secure 2024-09-12T17:23:52.267 INFO:tasks.workunit.client.0.smithi016.stderr: -360> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010c338) adding con mode: crc 2024-09-12T17:23:52.267 INFO:tasks.workunit.client.0.smithi016.stderr: -359> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010c338) adding con mode: crc 2024-09-12T17:23:52.267 INFO:tasks.workunit.client.0.smithi016.stderr: -358> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010c338) adding con mode: secure 2024-09-12T17:23:52.267 INFO:tasks.workunit.client.0.smithi016.stderr: -357> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010c338) adding con mode: crc 2024-09-12T17:23:52.267 INFO:tasks.workunit.client.0.smithi016.stderr: -356> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010c338) adding con mode: secure 2024-09-12T17:23:52.267 INFO:tasks.workunit.client.0.smithi016.stderr: -355> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010c338) adding con mode: crc 2024-09-12T17:23:52.267 INFO:tasks.workunit.client.0.smithi016.stderr: -354> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 AuthRegistry(0x5560d010c338) adding con mode: secure 2024-09-12T17:23:52.267 INFO:tasks.workunit.client.0.smithi016.stderr: -353> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:52.268 INFO:tasks.workunit.client.0.smithi016.stderr: -352> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:52.268 INFO:tasks.workunit.client.0.smithi016.stderr: -351> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 5 asok(0x5560cfeab2b0) register_command rotate-key cmddesc rotate-key hook 0x5560d010c480 EEXIST 2024-09-12T17:23:52.268 INFO:tasks.workunit.client.0.smithi016.stderr: -350> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 10 monclient: _reopen_session rank -1 2024-09-12T17:23:52.268 INFO:tasks.workunit.client.0.smithi016.stderr: -349> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:23:52.268 INFO:tasks.workunit.client.0.smithi016.stderr: -348> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 10 monclient(hunting): picked mon.noname-c con 0x5560d0134fa0 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:23:52.268 INFO:tasks.workunit.client.0.smithi016.stderr: -347> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 10 monclient(hunting): picked mon.noname-a con 0x5560d01348d0 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:23:52.268 INFO:tasks.workunit.client.0.smithi016.stderr: -346> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 10 monclient(hunting): picked mon.noname-b con 0x5560d01332b0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:23:52.268 INFO:tasks.workunit.client.0.smithi016.stderr: -345> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:52.268 INFO:tasks.workunit.client.0.smithi016.stderr: -344> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:52.268 INFO:tasks.workunit.client.0.smithi016.stderr: -343> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:52.268 INFO:tasks.workunit.client.0.smithi016.stderr: -342> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 10 monclient(hunting): _renew_subs 2024-09-12T17:23:52.268 INFO:tasks.workunit.client.0.smithi016.stderr: -341> 2024-09-12T17:23:51.634+0000 7f771c6a99c0 10 monclient(hunting): authenticate will time out at 2549.615232s 2024-09-12T17:23:52.268 INFO:tasks.workunit.client.0.smithi016.stderr: -340> 2024-09-12T17:23:51.634+0000 7f77199ae640 10 monclient(hunting): get_auth_request con 0x5560d0134fa0 auth_method 0 2024-09-12T17:23:52.268 INFO:tasks.workunit.client.0.smithi016.stderr: -339> 2024-09-12T17:23:51.634+0000 7f77199ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:52.269 INFO:tasks.workunit.client.0.smithi016.stderr: -338> 2024-09-12T17:23:51.634+0000 7f77199ae640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:52.269 INFO:tasks.workunit.client.0.smithi016.stderr: -337> 2024-09-12T17:23:51.634+0000 7f77199ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:52.269 INFO:tasks.workunit.client.0.smithi016.stderr: -336> 2024-09-12T17:23:51.634+0000 7f771a9b0640 10 monclient(hunting): get_auth_request con 0x5560d01348d0 auth_method 0 2024-09-12T17:23:52.269 INFO:tasks.workunit.client.0.smithi016.stderr: -335> 2024-09-12T17:23:51.634+0000 7f771a9b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:52.269 INFO:tasks.workunit.client.0.smithi016.stderr: -334> 2024-09-12T17:23:51.634+0000 7f771a9b0640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:52.269 INFO:tasks.workunit.client.0.smithi016.stderr: -333> 2024-09-12T17:23:51.634+0000 7f771a9b0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:52.269 INFO:tasks.workunit.client.0.smithi016.stderr: -332> 2024-09-12T17:23:51.634+0000 7f77199ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:52.269 INFO:tasks.workunit.client.0.smithi016.stderr: -331> 2024-09-12T17:23:51.634+0000 7f77199ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:52.270 INFO:tasks.workunit.client.0.smithi016.stderr: -330> 2024-09-12T17:23:51.634+0000 7f77199ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:52.270 INFO:tasks.workunit.client.0.smithi016.stderr: -329> 2024-09-12T17:23:51.634+0000 7f771a9b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:52.270 INFO:tasks.workunit.client.0.smithi016.stderr: -328> 2024-09-12T17:23:51.634+0000 7f771a9b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:52.270 INFO:tasks.workunit.client.0.smithi016.stderr: -327> 2024-09-12T17:23:51.634+0000 7f771a9b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:52.270 INFO:tasks.workunit.client.0.smithi016.stderr: -326> 2024-09-12T17:23:51.634+0000 7f771a1af640 10 monclient(hunting): get_auth_request con 0x5560d01332b0 auth_method 0 2024-09-12T17:23:52.270 INFO:tasks.workunit.client.0.smithi016.stderr: -325> 2024-09-12T17:23:51.634+0000 7f771a1af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:52.270 INFO:tasks.workunit.client.0.smithi016.stderr: -324> 2024-09-12T17:23:51.634+0000 7f771a1af640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:52.270 INFO:tasks.workunit.client.0.smithi016.stderr: -323> 2024-09-12T17:23:51.634+0000 7f771a1af640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:52.270 INFO:tasks.workunit.client.0.smithi016.stderr: -322> 2024-09-12T17:23:51.634+0000 7f771a9b0640 10 monclient(hunting): handle_auth_done global_id 8292 payload 824 2024-09-12T17:23:52.270 INFO:tasks.workunit.client.0.smithi016.stderr: -321> 2024-09-12T17:23:51.634+0000 7f771a9b0640 10 monclient: _finish_hunting 0 2024-09-12T17:23:52.270 INFO:tasks.workunit.client.0.smithi016.stderr: -320> 2024-09-12T17:23:51.634+0000 7f771a9b0640 1 monclient: found mon.noname-a 2024-09-12T17:23:52.270 INFO:tasks.workunit.client.0.smithi016.stderr: -319> 2024-09-12T17:23:51.634+0000 7f771a9b0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:23:52.270 INFO:tasks.workunit.client.0.smithi016.stderr: -318> 2024-09-12T17:23:51.638+0000 7f75fffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:52.271 INFO:tasks.workunit.client.0.smithi016.stderr: -317> 2024-09-12T17:23:51.638+0000 7f75fffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:23:52.271 INFO:tasks.workunit.client.0.smithi016.stderr: -316> 2024-09-12T17:23:51.638+0000 7f75fffff640 10 monclient: dump: 2024-09-12T17:23:52.271 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:23:52.271 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:23:52.271 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:52.271 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:52.271 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:52.271 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:52.271 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:23:52.271 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:23:52.271 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:23:52.271 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:52.271 INFO:tasks.workunit.client.0.smithi016.stderr: -315> 2024-09-12T17:23:51.638+0000 7f75fffff640 10 monclient: _finish_auth 0 2024-09-12T17:23:52.271 INFO:tasks.workunit.client.0.smithi016.stderr: -314> 2024-09-12T17:23:51.638+0000 7f75fffff640 10 monclient: _check_auth_tickets 2024-09-12T17:23:52.272 INFO:tasks.workunit.client.0.smithi016.stderr: -313> 2024-09-12T17:23:51.638+0000 7f75fffff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:23:52.272 INFO:tasks.workunit.client.0.smithi016.stderr: -312> 2024-09-12T17:23:51.638+0000 7f75fffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:52.272 INFO:tasks.workunit.client.0.smithi016.stderr: -311> 2024-09-12T17:23:51.638+0000 7f75fffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:23:52.272 INFO:tasks.workunit.client.0.smithi016.stderr: -310> 2024-09-12T17:23:51.638+0000 7f75fffff640 10 monclient: dump: 2024-09-12T17:23:52.272 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:23:52.272 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:23:52.272 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:52.272 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:52.272 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:52.272 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:52.272 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:23:52.272 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:23:52.272 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:23:52.273 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:52.273 INFO:tasks.workunit.client.0.smithi016.stderr: -309> 2024-09-12T17:23:51.638+0000 7f771b1b1640 4 set_mon_vals no callback set 2024-09-12T17:23:52.273 INFO:tasks.workunit.client.0.smithi016.stderr: -308> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 monclient: authenticate success, global_id 8292 2024-09-12T17:23:52.273 INFO:tasks.workunit.client.0.smithi016.stderr: -307> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 10 monclient: _renew_subs 2024-09-12T17:23:52.273 INFO:tasks.workunit.client.0.smithi016.stderr: -306> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:23:52.273 INFO:tasks.workunit.client.0.smithi016.stderr: -305> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 10 monclient: _renew_subs 2024-09-12T17:23:52.273 INFO:tasks.workunit.client.0.smithi016.stderr: -304> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:23:52.273 INFO:tasks.workunit.client.0.smithi016.stderr: -303> 2024-09-12T17:23:51.638+0000 7f75fffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:23:52.273 INFO:tasks.workunit.client.0.smithi016.stderr: -302> 2024-09-12T17:23:51.638+0000 7f75fffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:23:52.273 INFO:tasks.workunit.client.0.smithi016.stderr: -301> 2024-09-12T17:23:51.638+0000 7f75fffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:23:52.273 INFO:tasks.workunit.client.0.smithi016.stderr: -300> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 10 monclient: get_monmap_and_config 2024-09-12T17:23:52.273 INFO:tasks.workunit.client.0.smithi016.stderr: -299> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 10 monclient: build_initial_monmap 2024-09-12T17:23:52.273 INFO:tasks.workunit.client.0.smithi016.stderr: -298> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 1 build_initial for_mkfs: 0 2024-09-12T17:23:52.274 INFO:tasks.workunit.client.0.smithi016.stderr: -297> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 10 monclient: monmap: 2024-09-12T17:23:52.274 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:23:52.274 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:23:52.274 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:23:52.274 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:23:52.274 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:23:52.274 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:52.274 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:23:52.274 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:23:52.274 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:23:52.274 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:52.274 INFO:tasks.workunit.client.0.smithi016.stderr: -296> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0154220) adding auth protocol: cephx 2024-09-12T17:23:52.274 INFO:tasks.workunit.client.0.smithi016.stderr: -295> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0154220) adding auth protocol: cephx 2024-09-12T17:23:52.275 INFO:tasks.workunit.client.0.smithi016.stderr: -294> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0154220) adding auth protocol: cephx 2024-09-12T17:23:52.275 INFO:tasks.workunit.client.0.smithi016.stderr: -293> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0154220) adding con mode: secure 2024-09-12T17:23:52.275 INFO:tasks.workunit.client.0.smithi016.stderr: -292> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0154220) adding con mode: crc 2024-09-12T17:23:52.275 INFO:tasks.workunit.client.0.smithi016.stderr: -291> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0154220) adding con mode: secure 2024-09-12T17:23:52.275 INFO:tasks.workunit.client.0.smithi016.stderr: -290> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0154220) adding con mode: crc 2024-09-12T17:23:52.275 INFO:tasks.workunit.client.0.smithi016.stderr: -289> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0154220) adding con mode: secure 2024-09-12T17:23:52.275 INFO:tasks.workunit.client.0.smithi016.stderr: -288> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0154220) adding con mode: crc 2024-09-12T17:23:52.275 INFO:tasks.workunit.client.0.smithi016.stderr: -287> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0154220) adding con mode: crc 2024-09-12T17:23:52.275 INFO:tasks.workunit.client.0.smithi016.stderr: -286> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0154220) adding con mode: secure 2024-09-12T17:23:52.275 INFO:tasks.workunit.client.0.smithi016.stderr: -285> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0154220) adding con mode: crc 2024-09-12T17:23:52.275 INFO:tasks.workunit.client.0.smithi016.stderr: -284> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0154220) adding con mode: secure 2024-09-12T17:23:52.275 INFO:tasks.workunit.client.0.smithi016.stderr: -283> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0154220) adding con mode: crc 2024-09-12T17:23:52.275 INFO:tasks.workunit.client.0.smithi016.stderr: -282> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0154220) adding con mode: secure 2024-09-12T17:23:52.276 INFO:tasks.workunit.client.0.smithi016.stderr: -281> 2024-09-12T17:23:51.638+0000 7f77199ae640 10 monclient: get_auth_request con 0x7f75f4070a20 auth_method 0 2024-09-12T17:23:52.276 INFO:tasks.workunit.client.0.smithi016.stderr: -280> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:52.276 INFO:tasks.workunit.client.0.smithi016.stderr: -279> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 10 monclient: init 2024-09-12T17:23:52.276 INFO:tasks.workunit.client.0.smithi016.stderr: -278> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a0c0) adding auth protocol: cephx 2024-09-12T17:23:52.276 INFO:tasks.workunit.client.0.smithi016.stderr: -277> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a0c0) adding auth protocol: cephx 2024-09-12T17:23:52.276 INFO:tasks.workunit.client.0.smithi016.stderr: -276> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a0c0) adding auth protocol: cephx 2024-09-12T17:23:52.276 INFO:tasks.workunit.client.0.smithi016.stderr: -275> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a0c0) adding con mode: secure 2024-09-12T17:23:52.276 INFO:tasks.workunit.client.0.smithi016.stderr: -274> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a0c0) adding con mode: crc 2024-09-12T17:23:52.276 INFO:tasks.workunit.client.0.smithi016.stderr: -273> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a0c0) adding con mode: secure 2024-09-12T17:23:52.276 INFO:tasks.workunit.client.0.smithi016.stderr: -272> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a0c0) adding con mode: crc 2024-09-12T17:23:52.276 INFO:tasks.workunit.client.0.smithi016.stderr: -271> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a0c0) adding con mode: secure 2024-09-12T17:23:52.276 INFO:tasks.workunit.client.0.smithi016.stderr: -270> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a0c0) adding con mode: crc 2024-09-12T17:23:52.276 INFO:tasks.workunit.client.0.smithi016.stderr: -269> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a0c0) adding con mode: crc 2024-09-12T17:23:52.277 INFO:tasks.workunit.client.0.smithi016.stderr: -268> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a0c0) adding con mode: secure 2024-09-12T17:23:52.277 INFO:tasks.workunit.client.0.smithi016.stderr: -267> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a0c0) adding con mode: crc 2024-09-12T17:23:52.277 INFO:tasks.workunit.client.0.smithi016.stderr: -266> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a0c0) adding con mode: secure 2024-09-12T17:23:52.277 INFO:tasks.workunit.client.0.smithi016.stderr: -265> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a0c0) adding con mode: crc 2024-09-12T17:23:52.277 INFO:tasks.workunit.client.0.smithi016.stderr: -264> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a0c0) adding con mode: secure 2024-09-12T17:23:52.277 INFO:tasks.workunit.client.0.smithi016.stderr: -263> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:52.277 INFO:tasks.workunit.client.0.smithi016.stderr: -262> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:52.277 INFO:tasks.workunit.client.0.smithi016.stderr: -261> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 5 asok(0x5560cfeab2b0) register_command rotate-key cmddesc rotate-key hook 0x7fff2691a208 EEXIST 2024-09-12T17:23:52.277 INFO:tasks.workunit.client.0.smithi016.stderr: -260> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 10 monclient: _reopen_session rank -1 2024-09-12T17:23:52.277 INFO:tasks.workunit.client.0.smithi016.stderr: -259> 2024-09-12T17:23:51.638+0000 7f771c6a99c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:23:52.277 INFO:tasks.workunit.client.0.smithi016.stderr: -258> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient(hunting): picked mon.noname-b con 0x5560d0188600 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:23:52.277 INFO:tasks.workunit.client.0.smithi016.stderr: -257> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient(hunting): picked mon.noname-c con 0x5560d0159600 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:23:52.277 INFO:tasks.workunit.client.0.smithi016.stderr: -256> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient(hunting): picked mon.noname-a con 0x5560d0183ed0 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:23:52.278 INFO:tasks.workunit.client.0.smithi016.stderr: -255> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:52.278 INFO:tasks.workunit.client.0.smithi016.stderr: -254> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:52.278 INFO:tasks.workunit.client.0.smithi016.stderr: -253> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:52.278 INFO:tasks.workunit.client.0.smithi016.stderr: -252> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient(hunting): _renew_subs 2024-09-12T17:23:52.278 INFO:tasks.workunit.client.0.smithi016.stderr: -251> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient(hunting): authenticate will time out at 2549.620069s 2024-09-12T17:23:52.278 INFO:tasks.workunit.client.0.smithi016.stderr: -250> 2024-09-12T17:23:51.642+0000 7f771a9b0640 10 monclient(hunting): get_auth_request con 0x5560d0159600 auth_method 0 2024-09-12T17:23:52.278 INFO:tasks.workunit.client.0.smithi016.stderr: -249> 2024-09-12T17:23:51.642+0000 7f771a9b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:52.278 INFO:tasks.workunit.client.0.smithi016.stderr: -248> 2024-09-12T17:23:51.642+0000 7f771a9b0640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:52.278 INFO:tasks.workunit.client.0.smithi016.stderr: -247> 2024-09-12T17:23:51.642+0000 7f771a9b0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:52.278 INFO:tasks.workunit.client.0.smithi016.stderr: -246> 2024-09-12T17:23:51.642+0000 7f771a1af640 10 monclient(hunting): get_auth_request con 0x5560d0183ed0 auth_method 0 2024-09-12T17:23:52.278 INFO:tasks.workunit.client.0.smithi016.stderr: -245> 2024-09-12T17:23:51.642+0000 7f771a1af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:52.278 INFO:tasks.workunit.client.0.smithi016.stderr: -244> 2024-09-12T17:23:51.642+0000 7f771a1af640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:52.278 INFO:tasks.workunit.client.0.smithi016.stderr: -243> 2024-09-12T17:23:51.642+0000 7f771a1af640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:52.278 INFO:tasks.workunit.client.0.smithi016.stderr: -242> 2024-09-12T17:23:51.642+0000 7f771a9b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:52.279 INFO:tasks.workunit.client.0.smithi016.stderr: -241> 2024-09-12T17:23:51.642+0000 7f771a9b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:52.279 INFO:tasks.workunit.client.0.smithi016.stderr: -240> 2024-09-12T17:23:51.642+0000 7f771a9b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:52.279 INFO:tasks.workunit.client.0.smithi016.stderr: -239> 2024-09-12T17:23:51.642+0000 7f771a1af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:52.279 INFO:tasks.workunit.client.0.smithi016.stderr: -238> 2024-09-12T17:23:51.642+0000 7f771a1af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:52.279 INFO:tasks.workunit.client.0.smithi016.stderr: -237> 2024-09-12T17:23:51.642+0000 7f771a1af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:52.279 INFO:tasks.workunit.client.0.smithi016.stderr: -236> 2024-09-12T17:23:51.642+0000 7f77199ae640 10 monclient(hunting): get_auth_request con 0x5560d0188600 auth_method 0 2024-09-12T17:23:52.279 INFO:tasks.workunit.client.0.smithi016.stderr: -235> 2024-09-12T17:23:51.642+0000 7f77199ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:52.279 INFO:tasks.workunit.client.0.smithi016.stderr: -234> 2024-09-12T17:23:51.642+0000 7f77199ae640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:52.279 INFO:tasks.workunit.client.0.smithi016.stderr: -233> 2024-09-12T17:23:51.642+0000 7f77199ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:52.279 INFO:tasks.workunit.client.0.smithi016.stderr: -232> 2024-09-12T17:23:51.642+0000 7f771a9b0640 10 monclient(hunting): handle_auth_done global_id 7877 payload 274 2024-09-12T17:23:52.279 INFO:tasks.workunit.client.0.smithi016.stderr: -231> 2024-09-12T17:23:51.642+0000 7f771a9b0640 10 monclient: _finish_hunting 0 2024-09-12T17:23:52.279 INFO:tasks.workunit.client.0.smithi016.stderr: -230> 2024-09-12T17:23:51.642+0000 7f771a9b0640 1 monclient: found mon.noname-c 2024-09-12T17:23:52.279 INFO:tasks.workunit.client.0.smithi016.stderr: -229> 2024-09-12T17:23:51.642+0000 7f771a9b0640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.16:3301/0 2024-09-12T17:23:52.280 INFO:tasks.workunit.client.0.smithi016.stderr: -228> 2024-09-12T17:23:51.642+0000 7f75fdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:52.280 INFO:tasks.workunit.client.0.smithi016.stderr: -227> 2024-09-12T17:23:51.642+0000 7f75fdffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:23:52.280 INFO:tasks.workunit.client.0.smithi016.stderr: -226> 2024-09-12T17:23:51.642+0000 7f75fdffb640 10 monclient: dump: 2024-09-12T17:23:52.280 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:23:52.280 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:23:52.280 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:52.280 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:52.280 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:52.280 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:52.280 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:23:52.280 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:23:52.280 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:23:52.280 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:52.281 INFO:tasks.workunit.client.0.smithi016.stderr: -225> 2024-09-12T17:23:51.642+0000 7f75fdffb640 10 monclient: _finish_auth 0 2024-09-12T17:23:52.281 INFO:tasks.workunit.client.0.smithi016.stderr: -224> 2024-09-12T17:23:51.642+0000 7f75fdffb640 10 monclient: _check_auth_tickets 2024-09-12T17:23:52.281 INFO:tasks.workunit.client.0.smithi016.stderr: -223> 2024-09-12T17:23:51.642+0000 7f75fdffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:23:52.281 INFO:tasks.workunit.client.0.smithi016.stderr: -222> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 monclient: authenticate success, global_id 7877 2024-09-12T17:23:52.281 INFO:tasks.workunit.client.0.smithi016.stderr: -221> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient: get_monmap_and_config success 2024-09-12T17:23:52.281 INFO:tasks.workunit.client.0.smithi016.stderr: -220> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 4 set_mon_vals no callback set 2024-09-12T17:23:52.281 INFO:tasks.workunit.client.0.smithi016.stderr: -219> 2024-09-12T17:23:51.642+0000 7f75fdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:52.281 INFO:tasks.workunit.client.0.smithi016.stderr: -218> 2024-09-12T17:23:51.642+0000 7f75fdffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:23:52.281 INFO:tasks.workunit.client.0.smithi016.stderr: -217> 2024-09-12T17:23:51.642+0000 7f75fdffb640 10 monclient: dump: 2024-09-12T17:23:52.281 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:23:52.281 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:23:52.281 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:52.281 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:52.282 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:52.282 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:52.282 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:23:52.282 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:23:52.282 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:23:52.282 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:52.282 INFO:tasks.workunit.client.0.smithi016.stderr: -216> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient: shutdown 2024-09-12T17:23:52.282 INFO:tasks.workunit.client.0.smithi016.stderr: -215> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient: build_initial_monmap 2024-09-12T17:23:52.282 INFO:tasks.workunit.client.0.smithi016.stderr: -214> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 1 build_initial for_mkfs: 0 2024-09-12T17:23:52.282 INFO:tasks.workunit.client.0.smithi016.stderr: -213> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient: monmap: 2024-09-12T17:23:52.282 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 0 2024-09-12T17:23:52.282 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:23:52.282 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 0.000000 2024-09-12T17:23:52.283 INFO:tasks.workunit.client.0.smithi016.stderr:created 0.000000 2024-09-12T17:23:52.283 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 0 (unknown) 2024-09-12T17:23:52.283 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:52.283 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.noname-a 2024-09-12T17:23:52.283 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-b 2024-09-12T17:23:52.283 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.noname-c 2024-09-12T17:23:52.283 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:52.283 INFO:tasks.workunit.client.0.smithi016.stderr: -212> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0178e00) adding auth protocol: cephx 2024-09-12T17:23:52.283 INFO:tasks.workunit.client.0.smithi016.stderr: -211> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0178e00) adding auth protocol: cephx 2024-09-12T17:23:52.283 INFO:tasks.workunit.client.0.smithi016.stderr: -210> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0178e00) adding auth protocol: cephx 2024-09-12T17:23:52.283 INFO:tasks.workunit.client.0.smithi016.stderr: -209> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0178e00) adding con mode: secure 2024-09-12T17:23:52.283 INFO:tasks.workunit.client.0.smithi016.stderr: -208> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0178e00) adding con mode: crc 2024-09-12T17:23:52.283 INFO:tasks.workunit.client.0.smithi016.stderr: -207> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0178e00) adding con mode: secure 2024-09-12T17:23:52.284 INFO:tasks.workunit.client.0.smithi016.stderr: -206> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0178e00) adding con mode: crc 2024-09-12T17:23:52.284 INFO:tasks.workunit.client.0.smithi016.stderr: -205> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0178e00) adding con mode: secure 2024-09-12T17:23:52.284 INFO:tasks.workunit.client.0.smithi016.stderr: -204> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0178e00) adding con mode: crc 2024-09-12T17:23:52.284 INFO:tasks.workunit.client.0.smithi016.stderr: -203> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0178e00) adding con mode: crc 2024-09-12T17:23:52.284 INFO:tasks.workunit.client.0.smithi016.stderr: -202> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0178e00) adding con mode: secure 2024-09-12T17:23:52.284 INFO:tasks.workunit.client.0.smithi016.stderr: -201> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0178e00) adding con mode: crc 2024-09-12T17:23:52.284 INFO:tasks.workunit.client.0.smithi016.stderr: -200> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0178e00) adding con mode: secure 2024-09-12T17:23:52.284 INFO:tasks.workunit.client.0.smithi016.stderr: -199> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0178e00) adding con mode: crc 2024-09-12T17:23:52.284 INFO:tasks.workunit.client.0.smithi016.stderr: -198> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0178e00) adding con mode: secure 2024-09-12T17:23:52.284 INFO:tasks.workunit.client.0.smithi016.stderr: -197> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:52.284 INFO:tasks.workunit.client.0.smithi016.stderr: -196> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 1 librados: starting msgr at 2024-09-12T17:23:52.284 INFO:tasks.workunit.client.0.smithi016.stderr: -195> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 1 librados: starting objecter 2024-09-12T17:23:52.285 INFO:tasks.workunit.client.0.smithi016.stderr: -194> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 asok(0x5560cfeab2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5560d0137b00 EEXIST 2024-09-12T17:23:52.285 INFO:tasks.workunit.client.0.smithi016.stderr: -193> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 1 librados: setting wanted keys 2024-09-12T17:23:52.285 INFO:tasks.workunit.client.0.smithi016.stderr: -192> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 1 librados: calling monclient init 2024-09-12T17:23:52.285 INFO:tasks.workunit.client.0.smithi016.stderr: -191> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient: init 2024-09-12T17:23:52.285 INFO:tasks.workunit.client.0.smithi016.stderr: -190> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0136dc0) adding auth protocol: cephx 2024-09-12T17:23:52.285 INFO:tasks.workunit.client.0.smithi016.stderr: -189> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0136dc0) adding auth protocol: cephx 2024-09-12T17:23:52.285 INFO:tasks.workunit.client.0.smithi016.stderr: -188> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0136dc0) adding auth protocol: cephx 2024-09-12T17:23:52.285 INFO:tasks.workunit.client.0.smithi016.stderr: -187> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0136dc0) adding con mode: secure 2024-09-12T17:23:52.285 INFO:tasks.workunit.client.0.smithi016.stderr: -186> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0136dc0) adding con mode: crc 2024-09-12T17:23:52.285 INFO:tasks.workunit.client.0.smithi016.stderr: -185> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0136dc0) adding con mode: secure 2024-09-12T17:23:52.285 INFO:tasks.workunit.client.0.smithi016.stderr: -184> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0136dc0) adding con mode: crc 2024-09-12T17:23:52.285 INFO:tasks.workunit.client.0.smithi016.stderr: -183> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0136dc0) adding con mode: secure 2024-09-12T17:23:52.285 INFO:tasks.workunit.client.0.smithi016.stderr: -182> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0136dc0) adding con mode: crc 2024-09-12T17:23:52.286 INFO:tasks.workunit.client.0.smithi016.stderr: -181> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0136dc0) adding con mode: crc 2024-09-12T17:23:52.286 INFO:tasks.workunit.client.0.smithi016.stderr: -180> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0136dc0) adding con mode: secure 2024-09-12T17:23:52.286 INFO:tasks.workunit.client.0.smithi016.stderr: -179> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0136dc0) adding con mode: crc 2024-09-12T17:23:52.286 INFO:tasks.workunit.client.0.smithi016.stderr: -178> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0136dc0) adding con mode: secure 2024-09-12T17:23:52.286 INFO:tasks.workunit.client.0.smithi016.stderr: -177> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0136dc0) adding con mode: crc 2024-09-12T17:23:52.286 INFO:tasks.workunit.client.0.smithi016.stderr: -176> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 AuthRegistry(0x5560d0136dc0) adding con mode: secure 2024-09-12T17:23:52.286 INFO:tasks.workunit.client.0.smithi016.stderr: -175> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:52.286 INFO:tasks.workunit.client.0.smithi016.stderr: -174> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:52.286 INFO:tasks.workunit.client.0.smithi016.stderr: -173> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 asok(0x5560cfeab2b0) register_command rotate-key cmddesc rotate-key hook 0x5560d0136f08 EEXIST 2024-09-12T17:23:52.286 INFO:tasks.workunit.client.0.smithi016.stderr: -172> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient: _reopen_session rank -1 2024-09-12T17:23:52.286 INFO:tasks.workunit.client.0.smithi016.stderr: -171> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:23:52.286 INFO:tasks.workunit.client.0.smithi016.stderr: -170> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient(hunting): picked mon.noname-b con 0x5560d0159600 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T17:23:52.286 INFO:tasks.workunit.client.0.smithi016.stderr: -169> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient(hunting): picked mon.noname-a con 0x5560d0183ed0 addr [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] 2024-09-12T17:23:52.287 INFO:tasks.workunit.client.0.smithi016.stderr: -168> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient(hunting): picked mon.noname-c con 0x5560d0188600 addr [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] 2024-09-12T17:23:52.287 INFO:tasks.workunit.client.0.smithi016.stderr: -167> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:52.287 INFO:tasks.workunit.client.0.smithi016.stderr: -166> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:52.287 INFO:tasks.workunit.client.0.smithi016.stderr: -165> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:23:52.287 INFO:tasks.workunit.client.0.smithi016.stderr: -164> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient(hunting): _renew_subs 2024-09-12T17:23:52.287 INFO:tasks.workunit.client.0.smithi016.stderr: -163> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient(hunting): authenticate will time out at 2549.622675s 2024-09-12T17:23:52.287 INFO:tasks.workunit.client.0.smithi016.stderr: -162> 2024-09-12T17:23:51.642+0000 7f771a9b0640 10 monclient(hunting): get_auth_request con 0x5560d0183ed0 auth_method 0 2024-09-12T17:23:52.287 INFO:tasks.workunit.client.0.smithi016.stderr: -161> 2024-09-12T17:23:51.642+0000 7f771a9b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:52.287 INFO:tasks.workunit.client.0.smithi016.stderr: -160> 2024-09-12T17:23:51.642+0000 7f771a9b0640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:52.287 INFO:tasks.workunit.client.0.smithi016.stderr: -159> 2024-09-12T17:23:51.642+0000 7f771a9b0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:52.287 INFO:tasks.workunit.client.0.smithi016.stderr: -158> 2024-09-12T17:23:51.642+0000 7f771a1af640 10 monclient(hunting): get_auth_request con 0x5560d0188600 auth_method 0 2024-09-12T17:23:52.287 INFO:tasks.workunit.client.0.smithi016.stderr: -157> 2024-09-12T17:23:51.642+0000 7f771a1af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:52.287 INFO:tasks.workunit.client.0.smithi016.stderr: -156> 2024-09-12T17:23:51.642+0000 7f771a1af640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:52.288 INFO:tasks.workunit.client.0.smithi016.stderr: -155> 2024-09-12T17:23:51.642+0000 7f771a1af640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:52.288 INFO:tasks.workunit.client.0.smithi016.stderr: -154> 2024-09-12T17:23:51.642+0000 7f771a1af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:52.288 INFO:tasks.workunit.client.0.smithi016.stderr: -153> 2024-09-12T17:23:51.642+0000 7f771a1af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:52.288 INFO:tasks.workunit.client.0.smithi016.stderr: -152> 2024-09-12T17:23:51.642+0000 7f771a1af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:52.288 INFO:tasks.workunit.client.0.smithi016.stderr: -151> 2024-09-12T17:23:51.642+0000 7f771a9b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:23:52.288 INFO:tasks.workunit.client.0.smithi016.stderr: -150> 2024-09-12T17:23:51.642+0000 7f771a9b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:23:52.288 INFO:tasks.workunit.client.0.smithi016.stderr: -149> 2024-09-12T17:23:51.642+0000 7f771a9b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:23:52.288 INFO:tasks.workunit.client.0.smithi016.stderr: -148> 2024-09-12T17:23:51.642+0000 7f77199ae640 10 monclient(hunting): get_auth_request con 0x5560d0159600 auth_method 0 2024-09-12T17:23:52.288 INFO:tasks.workunit.client.0.smithi016.stderr: -147> 2024-09-12T17:23:51.642+0000 7f77199ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:23:52.288 INFO:tasks.workunit.client.0.smithi016.stderr: -146> 2024-09-12T17:23:51.642+0000 7f77199ae640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:23:52.288 INFO:tasks.workunit.client.0.smithi016.stderr: -145> 2024-09-12T17:23:51.642+0000 7f77199ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:23:52.288 INFO:tasks.workunit.client.0.smithi016.stderr: -144> 2024-09-12T17:23:51.642+0000 7f771a9b0640 10 monclient(hunting): handle_auth_done global_id 8298 payload 824 2024-09-12T17:23:52.288 INFO:tasks.workunit.client.0.smithi016.stderr: -143> 2024-09-12T17:23:51.642+0000 7f771a9b0640 10 monclient: _finish_hunting 0 2024-09-12T17:23:52.289 INFO:tasks.workunit.client.0.smithi016.stderr: -142> 2024-09-12T17:23:51.642+0000 7f771a9b0640 1 monclient: found mon.noname-a 2024-09-12T17:23:52.289 INFO:tasks.workunit.client.0.smithi016.stderr: -141> 2024-09-12T17:23:51.642+0000 7f771a9b0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.16:3300/0 2024-09-12T17:23:52.289 INFO:tasks.workunit.client.0.smithi016.stderr: -140> 2024-09-12T17:23:51.642+0000 7f75ebfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:52.289 INFO:tasks.workunit.client.0.smithi016.stderr: -139> 2024-09-12T17:23:51.642+0000 7f75ebfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:23:52.289 INFO:tasks.workunit.client.0.smithi016.stderr: -138> 2024-09-12T17:23:51.642+0000 7f75ebfff640 10 monclient: dump: 2024-09-12T17:23:52.289 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:23:52.289 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:23:52.289 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:52.289 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:52.289 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:52.289 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:52.289 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:23:52.289 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:23:52.289 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:23:52.290 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:52.290 INFO:tasks.workunit.client.0.smithi016.stderr: -137> 2024-09-12T17:23:51.642+0000 7f75ebfff640 10 monclient: _finish_auth 0 2024-09-12T17:23:52.290 INFO:tasks.workunit.client.0.smithi016.stderr: -136> 2024-09-12T17:23:51.642+0000 7f75ebfff640 10 monclient: _check_auth_tickets 2024-09-12T17:23:52.290 INFO:tasks.workunit.client.0.smithi016.stderr: -135> 2024-09-12T17:23:51.642+0000 7f75ebfff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:23:52.290 INFO:tasks.workunit.client.0.smithi016.stderr: -134> 2024-09-12T17:23:51.642+0000 7f75ebfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:23:52.290 INFO:tasks.workunit.client.0.smithi016.stderr: -133> 2024-09-12T17:23:51.642+0000 7f75ebfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:23:52.290 INFO:tasks.workunit.client.0.smithi016.stderr: -132> 2024-09-12T17:23:51.642+0000 7f75ebfff640 10 monclient: dump: 2024-09-12T17:23:52.290 INFO:tasks.workunit.client.0.smithi016.stderr:epoch 1 2024-09-12T17:23:52.290 INFO:tasks.workunit.client.0.smithi016.stderr:fsid 78b0e714-9967-46cd-8c81-870ee811f04f 2024-09-12T17:23:52.290 INFO:tasks.workunit.client.0.smithi016.stderr:last_changed 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:52.290 INFO:tasks.workunit.client.0.smithi016.stderr:created 2024-09-12T16:57:10.607775+0000 2024-09-12T17:23:52.290 INFO:tasks.workunit.client.0.smithi016.stderr:min_mon_release 19 (squid) 2024-09-12T17:23:52.290 INFO:tasks.workunit.client.0.smithi016.stderr:election_strategy: 1 2024-09-12T17:23:52.290 INFO:tasks.workunit.client.0.smithi016.stderr:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-09-12T17:23:52.291 INFO:tasks.workunit.client.0.smithi016.stderr:1: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.b 2024-09-12T17:23:52.291 INFO:tasks.workunit.client.0.smithi016.stderr:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-09-12T17:23:52.291 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:52.291 INFO:tasks.workunit.client.0.smithi016.stderr: -131> 2024-09-12T17:23:51.642+0000 7f75fdffb640 4 set_mon_vals no callback set 2024-09-12T17:23:52.291 INFO:tasks.workunit.client.0.smithi016.stderr: -130> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 5 monclient: authenticate success, global_id 8298 2024-09-12T17:23:52.291 INFO:tasks.workunit.client.0.smithi016.stderr: -129> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient: _renew_subs 2024-09-12T17:23:52.291 INFO:tasks.workunit.client.0.smithi016.stderr: -128> 2024-09-12T17:23:51.642+0000 7f771c6a99c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:23:52.291 INFO:tasks.workunit.client.0.smithi016.stderr: -127> 2024-09-12T17:23:51.646+0000 7f771c6a99c0 10 monclient: _renew_subs 2024-09-12T17:23:52.291 INFO:tasks.workunit.client.0.smithi016.stderr: -126> 2024-09-12T17:23:51.646+0000 7f771c6a99c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.16:3300/0 2024-09-12T17:23:52.291 INFO:tasks.workunit.client.0.smithi016.stderr: -125> 2024-09-12T17:23:51.646+0000 7f771c6a99c0 1 librados: init done 2024-09-12T17:23:52.291 INFO:tasks.workunit.client.0.smithi016.stderr: -124> 2024-09-12T17:23:51.646+0000 7f771c6a99c0 5 asok(0x5560cfeab2b0) register_command cr dump hook 0x7f77140f8e48 2024-09-12T17:23:52.291 INFO:tasks.workunit.client.0.smithi016.stderr: -123> 2024-09-12T17:23:51.646+0000 7f771c6a99c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.291 INFO:tasks.workunit.client.0.smithi016.stderr: -122> 2024-09-12T17:23:51.646+0000 7f75ebfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:23:52.292 INFO:tasks.workunit.client.0.smithi016.stderr: -121> 2024-09-12T17:23:51.646+0000 7f75ebfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:23:52.292 INFO:tasks.workunit.client.0.smithi016.stderr: -120> 2024-09-12T17:23:51.646+0000 7f75ebfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.19:6832/1425282402,v1:172.21.15.19:6833/1425282402] 2024-09-12T17:23:52.292 INFO:tasks.workunit.client.0.smithi016.stderr: -119> 2024-09-12T17:23:51.646+0000 7f771a1af640 10 monclient: get_auth_request con 0x5560d01a1860 auth_method 0 2024-09-12T17:23:52.292 INFO:tasks.workunit.client.0.smithi016.stderr: -118> 2024-09-12T17:23:51.646+0000 7f77199ae640 10 monclient: get_auth_request con 0x7f75e4070b10 auth_method 0 2024-09-12T17:23:52.292 INFO:tasks.workunit.client.0.smithi016.stderr: -117> 2024-09-12T17:23:51.646+0000 7f771c6a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:52.292 INFO:tasks.workunit.client.0.smithi016.stderr: -116> 2024-09-12T17:23:51.646+0000 7f771c6a99c0 20 realm 2024-09-12T17:23:52.292 INFO:tasks.workunit.client.0.smithi016.stderr: -115> 2024-09-12T17:23:51.646+0000 7f771c6a99c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.292 INFO:tasks.workunit.client.0.smithi016.stderr: -114> 2024-09-12T17:23:51.646+0000 7f771c6a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:52.292 INFO:tasks.workunit.client.0.smithi016.stderr: -113> 2024-09-12T17:23:51.646+0000 7f771c6a99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:52.292 INFO:tasks.workunit.client.0.smithi016.stderr: -112> 2024-09-12T17:23:51.646+0000 7f771c6a99c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.292 INFO:tasks.workunit.client.0.smithi016.stderr: -111> 2024-09-12T17:23:51.646+0000 7f771c6a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:52.292 INFO:tasks.workunit.client.0.smithi016.stderr: -110> 2024-09-12T17:23:51.646+0000 7f771c6a99c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.292 INFO:tasks.workunit.client.0.smithi016.stderr: -109> 2024-09-12T17:23:51.650+0000 7f77199ae640 10 monclient: get_auth_request con 0x5560d01a5860 auth_method 0 2024-09-12T17:23:52.293 INFO:tasks.workunit.client.0.smithi016.stderr: -108> 2024-09-12T17:23:51.650+0000 7f771c6a99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:52.293 INFO:tasks.workunit.client.0.smithi016.stderr: -107> 2024-09-12T17:23:51.650+0000 7f771c6a99c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.293 INFO:tasks.workunit.client.0.smithi016.stderr: -106> 2024-09-12T17:23:51.650+0000 7f771a9b0640 10 monclient: get_auth_request con 0x5560d01a9150 auth_method 0 2024-09-12T17:23:52.293 INFO:tasks.workunit.client.0.smithi016.stderr: -105> 2024-09-12T17:23:51.650+0000 7f771c6a99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:52.293 INFO:tasks.workunit.client.0.smithi016.stderr: -104> 2024-09-12T17:23:51.650+0000 7f771c6a99c0 20 searching for the correct realm 2024-09-12T17:23:52.293 INFO:tasks.workunit.client.0.smithi016.stderr: -103> 2024-09-12T17:23:51.650+0000 7f771a1af640 10 monclient: get_auth_request con 0x5560d01adef0 auth_method 0 2024-09-12T17:23:52.293 INFO:tasks.workunit.client.0.smithi016.stderr: -102> 2024-09-12T17:23:51.654+0000 7f77199ae640 10 monclient: get_auth_request con 0x7f770c01bbf0 auth_method 0 2024-09-12T17:23:52.293 INFO:tasks.workunit.client.0.smithi016.stderr: -101> 2024-09-12T17:23:51.654+0000 7f771a9b0640 10 monclient: get_auth_request con 0x7f771002a070 auth_method 0 2024-09-12T17:23:52.293 INFO:tasks.workunit.client.0.smithi016.stderr: -100> 2024-09-12T17:23:51.654+0000 7f771a9b0640 0 -- 172.21.15.16:0/835741528 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f771002a070 msgr2=0x7f7710008930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:52.293 INFO:tasks.workunit.client.0.smithi016.stderr: -99> 2024-09-12T17:23:51.858+0000 7f771a9b0640 10 monclient: get_auth_request con 0x7f771002a070 auth_method 0 2024-09-12T17:23:52.293 INFO:tasks.workunit.client.0.smithi016.stderr: -98> 2024-09-12T17:23:51.862+0000 7f771a1af640 10 monclient: get_auth_request con 0x7f77140c2040 auth_method 0 2024-09-12T17:23:52.293 INFO:tasks.workunit.client.0.smithi016.stderr: -97> 2024-09-12T17:23:51.870+0000 7f77199ae640 0 -- 172.21.15.16:0/835741528 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f7714006650 msgr2=0x7f771411c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:52.293 INFO:tasks.workunit.client.0.smithi016.stderr: -96> 2024-09-12T17:23:51.870+0000 7f77199ae640 10 monclient: get_auth_request con 0x7f7714006650 auth_method 0 2024-09-12T17:23:52.293 INFO:tasks.workunit.client.0.smithi016.stderr: -95> 2024-09-12T17:23:52.074+0000 7f77199ae640 10 monclient: get_auth_request con 0x7f7714006650 auth_method 0 2024-09-12T17:23:52.294 INFO:tasks.workunit.client.0.smithi016.stderr: -94> 2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:23:52.294 INFO:tasks.workunit.client.0.smithi016.stderr: -93> 2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:52.294 INFO:tasks.workunit.client.0.smithi016.stderr: -92> 2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:23:52.294 INFO:tasks.workunit.client.0.smithi016.stderr: -91> 2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:52.294 INFO:tasks.workunit.client.0.smithi016.stderr: -90> 2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:52.294 INFO:tasks.workunit.client.0.smithi016.stderr: -89> 2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:52.294 INFO:tasks.workunit.client.0.smithi016.stderr: -88> 2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.294 INFO:tasks.workunit.client.0.smithi016.stderr: -87> 2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:52.294 INFO:tasks.workunit.client.0.smithi016.stderr: -86> 2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.294 INFO:tasks.workunit.client.0.smithi016.stderr: -85> 2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:52.294 INFO:tasks.workunit.client.0.smithi016.stderr: -84> 2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.294 INFO:tasks.workunit.client.0.smithi016.stderr: -83> 2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:52.294 INFO:tasks.workunit.client.0.smithi016.stderr: -82> 2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 zone default found 2024-09-12T17:23:52.295 INFO:tasks.workunit.client.0.smithi016.stderr: -81> 2024-09-12T17:23:52.090+0000 7f771c6a99c0 4 Realm: () 2024-09-12T17:23:52.295 INFO:tasks.workunit.client.0.smithi016.stderr: -80> 2024-09-12T17:23:52.090+0000 7f771c6a99c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:23:52.295 INFO:tasks.workunit.client.0.smithi016.stderr: -79> 2024-09-12T17:23:52.090+0000 7f771c6a99c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:23:52.295 INFO:tasks.workunit.client.0.smithi016.stderr: -78> 2024-09-12T17:23:52.090+0000 7f771c6a99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:52.295 INFO:tasks.workunit.client.0.smithi016.stderr: -77> 2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 zonegroup default 2024-09-12T17:23:52.295 INFO:tasks.workunit.client.0.smithi016.stderr: -76> 2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.295 INFO:tasks.workunit.client.0.smithi016.stderr: -75> 2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:52.295 INFO:tasks.workunit.client.0.smithi016.stderr: -74> 2024-09-12T17:23:52.090+0000 7f771c6a99c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.295 INFO:tasks.workunit.client.0.smithi016.stderr: -73> 2024-09-12T17:23:52.094+0000 7f771c6a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:52.295 INFO:tasks.workunit.client.0.smithi016.stderr: -72> 2024-09-12T17:23:52.094+0000 7f771c6a99c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.295 INFO:tasks.workunit.client.0.smithi016.stderr: -71> 2024-09-12T17:23:52.094+0000 7f771c6a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:52.295 INFO:tasks.workunit.client.0.smithi016.stderr: -70> 2024-09-12T17:23:52.094+0000 7f771c6a99c0 20 started sync module instance, tier type = 2024-09-12T17:23:52.295 INFO:tasks.workunit.client.0.smithi016.stderr: -69> 2024-09-12T17:23:52.094+0000 7f771c6a99c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:23:52.295 INFO:tasks.workunit.client.0.smithi016.stderr: -68> 2024-09-12T17:23:52.118+0000 7f771c6a99c0 20 add_watcher() i=0 2024-09-12T17:23:52.296 INFO:tasks.workunit.client.0.smithi016.stderr: -67> 2024-09-12T17:23:52.118+0000 7f771c6a99c0 20 add_watcher() i=1 2024-09-12T17:23:52.296 INFO:tasks.workunit.client.0.smithi016.stderr: -66> 2024-09-12T17:23:52.118+0000 7f771c6a99c0 20 add_watcher() i=2 2024-09-12T17:23:52.296 INFO:tasks.workunit.client.0.smithi016.stderr: -65> 2024-09-12T17:23:52.118+0000 7f771c6a99c0 20 add_watcher() i=3 2024-09-12T17:23:52.296 INFO:tasks.workunit.client.0.smithi016.stderr: -64> 2024-09-12T17:23:52.118+0000 7f771c6a99c0 20 add_watcher() i=4 2024-09-12T17:23:52.296 INFO:tasks.workunit.client.0.smithi016.stderr: -63> 2024-09-12T17:23:52.118+0000 7f771c6a99c0 20 add_watcher() i=5 2024-09-12T17:23:52.296 INFO:tasks.workunit.client.0.smithi016.stderr: -62> 2024-09-12T17:23:52.118+0000 7f771c6a99c0 20 add_watcher() i=6 2024-09-12T17:23:52.296 INFO:tasks.workunit.client.0.smithi016.stderr: -61> 2024-09-12T17:23:52.122+0000 7f771c6a99c0 20 add_watcher() i=7 2024-09-12T17:23:52.296 INFO:tasks.workunit.client.0.smithi016.stderr: -60> 2024-09-12T17:23:52.122+0000 7f771c6a99c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:52.296 INFO:tasks.workunit.client.0.smithi016.stderr: -59> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a590) adding auth protocol: cephx 2024-09-12T17:23:52.296 INFO:tasks.workunit.client.0.smithi016.stderr: -58> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a590) adding auth protocol: cephx 2024-09-12T17:23:52.296 INFO:tasks.workunit.client.0.smithi016.stderr: -57> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a590) adding auth protocol: cephx 2024-09-12T17:23:52.296 INFO:tasks.workunit.client.0.smithi016.stderr: -56> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a590) adding con mode: secure 2024-09-12T17:23:52.296 INFO:tasks.workunit.client.0.smithi016.stderr: -55> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a590) adding con mode: crc 2024-09-12T17:23:52.297 INFO:tasks.workunit.client.0.smithi016.stderr: -54> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a590) adding con mode: secure 2024-09-12T17:23:52.297 INFO:tasks.workunit.client.0.smithi016.stderr: -53> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a590) adding con mode: crc 2024-09-12T17:23:52.297 INFO:tasks.workunit.client.0.smithi016.stderr: -52> 2024-09-12T17:23:52.126+0000 7f75d17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:52.297 INFO:tasks.workunit.client.0.smithi016.stderr: -51> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a590) adding con mode: secure 2024-09-12T17:23:52.297 INFO:tasks.workunit.client.0.smithi016.stderr: -50> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a590) adding con mode: crc 2024-09-12T17:23:52.297 INFO:tasks.workunit.client.0.smithi016.stderr: -49> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a590) adding con mode: crc 2024-09-12T17:23:52.297 INFO:tasks.workunit.client.0.smithi016.stderr: -48> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a590) adding con mode: secure 2024-09-12T17:23:52.297 INFO:tasks.workunit.client.0.smithi016.stderr: -47> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a590) adding con mode: crc 2024-09-12T17:23:52.297 INFO:tasks.workunit.client.0.smithi016.stderr: -46> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a590) adding con mode: secure 2024-09-12T17:23:52.297 INFO:tasks.workunit.client.0.smithi016.stderr: -45> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a590) adding con mode: crc 2024-09-12T17:23:52.297 INFO:tasks.workunit.client.0.smithi016.stderr: -44> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 AuthRegistry(0x7fff2691a590) adding con mode: secure 2024-09-12T17:23:52.297 INFO:tasks.workunit.client.0.smithi016.stderr: -43> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:23:52.297 INFO:tasks.workunit.client.0.smithi016.stderr: -42> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:52.297 INFO:tasks.workunit.client.0.smithi016.stderr: -41> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:52.298 INFO:tasks.workunit.client.0.smithi016.stderr: -40> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 asok(0x5560cfeab2b0) register_command cache list hook 0x5560d01556e0 2024-09-12T17:23:52.298 INFO:tasks.workunit.client.0.smithi016.stderr: -39> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 asok(0x5560cfeab2b0) register_command cache inspect hook 0x5560d01556e0 2024-09-12T17:23:52.298 INFO:tasks.workunit.client.0.smithi016.stderr: -38> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 asok(0x5560cfeab2b0) register_command cache erase hook 0x5560d01556e0 2024-09-12T17:23:52.298 INFO:tasks.workunit.client.0.smithi016.stderr: -37> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 asok(0x5560cfeab2b0) register_command cache zap hook 0x5560d01556e0 2024-09-12T17:23:52.298 INFO:tasks.workunit.client.0.smithi016.stderr: -36> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 note: GC not initialized 2024-09-12T17:23:52.298 INFO:tasks.workunit.client.0.smithi016.stderr: -35> 2024-09-12T17:23:52.126+0000 7f75cb7fe640 20 reqs_thread_entry: start 2024-09-12T17:23:52.298 INFO:tasks.workunit.client.0.smithi016.stderr: -34> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 asok(0x5560cfeab2b0) register_command sync trace show hook 0x7f7714121020 2024-09-12T17:23:52.298 INFO:tasks.workunit.client.0.smithi016.stderr: -33> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 asok(0x5560cfeab2b0) register_command sync trace history hook 0x7f7714121020 2024-09-12T17:23:52.298 INFO:tasks.workunit.client.0.smithi016.stderr: -32> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 asok(0x5560cfeab2b0) register_command sync trace active hook 0x7f7714121020 2024-09-12T17:23:52.298 INFO:tasks.workunit.client.0.smithi016.stderr: -31> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 5 asok(0x5560cfeab2b0) register_command sync trace active_short hook 0x7f7714121020 2024-09-12T17:23:52.298 INFO:tasks.workunit.client.0.smithi016.stderr: -30> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 20 init_complete bucket index max shards: 1 2024-09-12T17:23:52.298 INFO:tasks.workunit.client.0.smithi016.stderr: -29> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 20 Filter name: none 2024-09-12T17:23:52.298 INFO:tasks.workunit.client.0.smithi016.stderr: -28> 2024-09-12T17:23:52.126+0000 7f75c97fa640 20 reqs_thread_entry: start 2024-09-12T17:23:52.299 INFO:tasks.workunit.client.0.smithi016.stderr: -27> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:23:52.299 INFO:tasks.workunit.client.0.smithi016.stderr: -26> 2024-09-12T17:23:52.126+0000 7f771c6a99c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.299 INFO:tasks.workunit.client.0.smithi016.stderr: -25> 2024-09-12T17:23:52.130+0000 7f771c6a99c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:23:52.299 INFO:tasks.workunit.client.0.smithi016.stderr: -24> 2024-09-12T17:23:52.130+0000 7f771c6a99c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:23:52.299 INFO:tasks.workunit.client.0.smithi016.stderr: -23> 2024-09-12T17:23:52.130+0000 7f771c6a99c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:23:52.299 INFO:tasks.workunit.client.0.smithi016.stderr: -22> 2024-09-12T17:23:52.130+0000 7f771c6a99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 : miss 2024-09-12T17:23:52.299 INFO:tasks.workunit.client.0.smithi016.stderr: -21> 2024-09-12T17:23:52.130+0000 7f771c6a99c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.299 INFO:tasks.workunit.client.0.smithi016.stderr: -20> 2024-09-12T17:23:52.130+0000 7f771c6a99c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T17:23:52.299 INFO:tasks.workunit.client.0.smithi016.stderr: -19> 2024-09-12T17:23:52.130+0000 7f771c6a99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:23:52.299 INFO:tasks.workunit.client.0.smithi016.stderr: -18> 2024-09-12T17:23:52.130+0000 7f771c6a99c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:23:52.299 INFO:tasks.workunit.client.0.smithi016.stderr: -17> 2024-09-12T17:23:52.130+0000 7f771c6a99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:23:52.299 INFO:tasks.workunit.client.0.smithi016.stderr: -16> 2024-09-12T17:23:52.130+0000 7f771c6a99c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:23:52.299 INFO:tasks.workunit.client.0.smithi016.stderr: -15> 2024-09-12T17:23:52.130+0000 7f771c6a99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 2024-09-12T17:23:52.299 INFO:tasks.workunit.client.0.smithi016.stderr: -14> 2024-09-12T17:23:52.134+0000 7f771c6a99c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:23:52.300 INFO:tasks.workunit.client.0.smithi016.stderr: -13> 2024-09-12T17:23:52.142+0000 7f771c6a99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:23:52.300 INFO:tasks.workunit.client.0.smithi016.stderr: -12> 2024-09-12T17:23:52.142+0000 7f771c6a99c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:23:52.300 INFO:tasks.workunit.client.0.smithi016.stderr: -11> 2024-09-12T17:23:52.142+0000 7f771c6a99c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:23:52.300 INFO:tasks.workunit.client.0.smithi016.stderr: -10> 2024-09-12T17:23:52.142+0000 7f771c6a99c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17, ofs0, ns] 2024-09-12T17:23:52.300 INFO:tasks.workunit.client.0.smithi016.stderr: -9> 2024-09-12T17:23:52.142+0000 7f75fdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431631 cookie 93874296660144 notifier 8298 bl.length()=827 2024-09-12T17:23:52.300 INFO:tasks.workunit.client.0.smithi016.stderr: -8> 2024-09-12T17:23:52.142+0000 7f75fdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:23:52.300 INFO:tasks.workunit.client.0.smithi016.stderr: -7> 2024-09-12T17:23:52.142+0000 7f75fdffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:23:52.300 INFO:tasks.workunit.client.0.smithi016.stderr: -6> 2024-09-12T17:23:52.142+0000 7f75fdffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:23:52.300 INFO:tasks.workunit.client.0.smithi016.stderr: -5> 2024-09-12T17:23:52.146+0000 7f771c6a99c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): orig_sources= new_sources= 2024-09-12T17:23:52.300 INFO:tasks.workunit.client.0.smithi016.stderr: -4> 2024-09-12T17:23:52.146+0000 7f771c6a99c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): potential sources added=[] removed=[] 2024-09-12T17:23:52.300 INFO:tasks.workunit.client.0.smithi016.stderr: -3> 2024-09-12T17:23:52.146+0000 7f771c6a99c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): orig_dests= new_dests= 2024-09-12T17:23:52.300 INFO:tasks.workunit.client.0.smithi016.stderr: -2> 2024-09-12T17:23:52.146+0000 7f771c6a99c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): potential dests added=[] removed=[] 2024-09-12T17:23:52.300 INFO:tasks.workunit.client.0.smithi016.stderr: -1> 2024-09-12T17:23:52.150+0000 7f771c6a99c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f771c6a99c0 time 2024-09-12T17:23:52.156215+0000 2024-09-12T17:23:52.301 INFO:tasks.workunit.client.0.smithi016.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:23:52.301 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:52.301 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:23:52.301 INFO:tasks.workunit.client.0.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f771ff832eb] 2024-09-12T17:23:52.301 INFO:tasks.workunit.client.0.smithi016.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f771ff8349f] 2024-09-12T17:23:52.301 INFO:tasks.workunit.client.0.smithi016.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5560cecef0c1] 2024-09-12T17:23:52.301 INFO:tasks.workunit.client.0.smithi016.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5560ced011fa] 2024-09-12T17:23:52.301 INFO:tasks.workunit.client.0.smithi016.stderr: 5: main() 2024-09-12T17:23:52.301 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f771ede9d90] 2024-09-12T17:23:52.301 INFO:tasks.workunit.client.0.smithi016.stderr: 7: __libc_start_main() 2024-09-12T17:23:52.301 INFO:tasks.workunit.client.0.smithi016.stderr: 8: _start() 2024-09-12T17:23:52.301 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:52.301 INFO:tasks.workunit.client.0.smithi016.stderr: 0> 2024-09-12T17:23:52.154+0000 7f771c6a99c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:23:52.302 INFO:tasks.workunit.client.0.smithi016.stderr: in thread 7f771c6a99c0 thread_name:radosgw-admin 2024-09-12T17:23:52.302 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:52.302 INFO:tasks.workunit.client.0.smithi016.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:23:52.302 INFO:tasks.workunit.client.0.smithi016.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f771ee02520] 2024-09-12T17:23:52.302 INFO:tasks.workunit.client.0.smithi016.stderr: 2: pthread_kill() 2024-09-12T17:23:52.302 INFO:tasks.workunit.client.0.smithi016.stderr: 3: raise() 2024-09-12T17:23:52.302 INFO:tasks.workunit.client.0.smithi016.stderr: 4: abort() 2024-09-12T17:23:52.302 INFO:tasks.workunit.client.0.smithi016.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f771ff83345] 2024-09-12T17:23:52.302 INFO:tasks.workunit.client.0.smithi016.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f771ff8349f] 2024-09-12T17:23:52.302 INFO:tasks.workunit.client.0.smithi016.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5560cecef0c1] 2024-09-12T17:23:52.302 INFO:tasks.workunit.client.0.smithi016.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5560ced011fa] 2024-09-12T17:23:52.302 INFO:tasks.workunit.client.0.smithi016.stderr: 9: main() 2024-09-12T17:23:52.302 INFO:tasks.workunit.client.0.smithi016.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f771ede9d90] 2024-09-12T17:23:52.303 INFO:tasks.workunit.client.0.smithi016.stderr: 11: __libc_start_main() 2024-09-12T17:23:52.303 INFO:tasks.workunit.client.0.smithi016.stderr: 12: _start() 2024-09-12T17:23:52.303 INFO:tasks.workunit.client.0.smithi016.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:23:52.303 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:23:52.303 INFO:tasks.workunit.client.0.smithi016.stderr:--- logging levels --- 2024-09-12T17:23:52.303 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 none 2024-09-12T17:23:52.303 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 lockdep 2024-09-12T17:23:52.303 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 context 2024-09-12T17:23:52.303 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 crush 2024-09-12T17:23:52.303 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds 2024-09-12T17:23:52.303 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_balancer 2024-09-12T17:23:52.303 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_locker 2024-09-12T17:23:52.303 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log 2024-09-12T17:23:52.303 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_log_expire 2024-09-12T17:23:52.304 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mds_migrator 2024-09-12T17:23:52.304 INFO:tasks.workunit.client.0.smithi016.stderr: 3/ 5 mds_quiesce 2024-09-12T17:23:52.304 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 buffer 2024-09-12T17:23:52.304 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 timer 2024-09-12T17:23:52.304 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 filer 2024-09-12T17:23:52.304 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 striper 2024-09-12T17:23:52.304 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 1 objecter 2024-09-12T17:23:52.304 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rados 2024-09-12T17:23:52.304 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd 2024-09-12T17:23:52.304 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_mirror 2024-09-12T17:23:52.304 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_replay 2024-09-12T17:23:52.304 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 rbd_pwl 2024-09-12T17:23:52.304 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 journaler 2024-09-12T17:23:52.305 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objectcacher 2024-09-12T17:23:52.305 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:23:52.305 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 client 2024-09-12T17:23:52.305 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 osd 2024-09-12T17:23:52.305 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 optracker 2024-09-12T17:23:52.305 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 objclass 2024-09-12T17:23:52.305 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 filestore 2024-09-12T17:23:52.305 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 journal 2024-09-12T17:23:52.305 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 ms 2024-09-12T17:23:52.305 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mon 2024-09-12T17:23:52.305 INFO:tasks.workunit.client.0.smithi016.stderr: 0/10 monc 2024-09-12T17:23:52.305 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 paxos 2024-09-12T17:23:52.305 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 tp 2024-09-12T17:23:52.306 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 auth 2024-09-12T17:23:52.306 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 crypto 2024-09-12T17:23:52.306 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 finisher 2024-09-12T17:23:52.306 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 reserver 2024-09-12T17:23:52.306 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 heartbeatmap 2024-09-12T17:23:52.306 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 perfcounter 2024-09-12T17:23:52.306 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw 2024-09-12T17:23:52.306 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_sync 2024-09-12T17:23:52.306 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_datacache 2024-09-12T17:23:52.306 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_access 2024-09-12T17:23:52.306 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:23:52.306 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_flight 2024-09-12T17:23:52.306 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:23:52.306 INFO:tasks.workunit.client.0.smithi016.stderr: 20/20 rgw_notification 2024-09-12T17:23:52.307 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 javaclient 2024-09-12T17:23:52.307 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 asok 2024-09-12T17:23:52.307 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 1 throttle 2024-09-12T17:23:52.307 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 0 refs 2024-09-12T17:23:52.307 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 compressor 2024-09-12T17:23:52.307 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluestore 2024-09-12T17:23:52.307 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 bluefs 2024-09-12T17:23:52.307 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 3 bdev 2024-09-12T17:23:52.307 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 kstore 2024-09-12T17:23:52.307 INFO:tasks.workunit.client.0.smithi016.stderr: 4/ 5 rocksdb 2024-09-12T17:23:52.307 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 fuse 2024-09-12T17:23:52.307 INFO:tasks.workunit.client.0.smithi016.stderr: 2/ 5 mgr 2024-09-12T17:23:52.307 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mgrc 2024-09-12T17:23:52.307 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 dpdk 2024-09-12T17:23:52.308 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 eventtrace 2024-09-12T17:23:52.308 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 prioritycache 2024-09-12T17:23:52.308 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 test 2024-09-12T17:23:52.308 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:23:52.308 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cephsqlite 2024-09-12T17:23:52.308 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:23:52.308 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore 2024-09-12T17:23:52.308 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_onode 2024-09-12T17:23:52.308 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_odata 2024-09-12T17:23:52.308 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_omap 2024-09-12T17:23:52.308 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_tm 2024-09-12T17:23:52.308 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_t 2024-09-12T17:23:52.308 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:23:52.309 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_epm 2024-09-12T17:23:52.309 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_lba 2024-09-12T17:23:52.309 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:23:52.309 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_cache 2024-09-12T17:23:52.309 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_journal 2024-09-12T17:23:52.309 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_device 2024-09-12T17:23:52.309 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 seastore_backref 2024-09-12T17:23:52.309 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 alienstore 2024-09-12T17:23:52.309 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 mclock 2024-09-12T17:23:52.309 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 cyanstore 2024-09-12T17:23:52.309 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 ceph_exporter 2024-09-12T17:23:52.309 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 memstore 2024-09-12T17:23:52.309 INFO:tasks.workunit.client.0.smithi016.stderr: 1/ 5 trace 2024-09-12T17:23:52.309 INFO:tasks.workunit.client.0.smithi016.stderr: 0/ 5 ceph_dedup 2024-09-12T17:23:52.310 INFO:tasks.workunit.client.0.smithi016.stderr: -2/-2 (syslog threshold) 2024-09-12T17:23:52.310 INFO:tasks.workunit.client.0.smithi016.stderr: 99/99 (stderr threshold) 2024-09-12T17:23:52.310 INFO:tasks.workunit.client.0.smithi016.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:23:52.310 INFO:tasks.workunit.client.0.smithi016.stderr: 7f75c97fa640 / http_manager 2024-09-12T17:23:52.310 INFO:tasks.workunit.client.0.smithi016.stderr: 7f75cb7fe640 / http_manager 2024-09-12T17:23:52.310 INFO:tasks.workunit.client.0.smithi016.stderr: 7f75d17e2640 / rgw_dt_lg_renew 2024-09-12T17:23:52.310 INFO:tasks.workunit.client.0.smithi016.stderr: 7f75ebfff640 / ms_dispatch 2024-09-12T17:23:52.310 INFO:tasks.workunit.client.0.smithi016.stderr: 7f75fdffb640 / io_context_pool 2024-09-12T17:23:52.310 INFO:tasks.workunit.client.0.smithi016.stderr: 7f75fffff640 / ms_dispatch 2024-09-12T17:23:52.310 INFO:tasks.workunit.client.0.smithi016.stderr: 7f7606e05640 / ms_dispatch 2024-09-12T17:23:52.310 INFO:tasks.workunit.client.0.smithi016.stderr: 7f7608608640 / io_context_pool 2024-09-12T17:23:52.310 INFO:tasks.workunit.client.0.smithi016.stderr: 7f77199ae640 / msgr-worker-2 2024-09-12T17:23:52.310 INFO:tasks.workunit.client.0.smithi016.stderr: 7f771a1af640 / msgr-worker-1 2024-09-12T17:23:52.310 INFO:tasks.workunit.client.0.smithi016.stderr: 7f771a9b0640 / msgr-worker-0 2024-09-12T17:23:52.311 INFO:tasks.workunit.client.0.smithi016.stderr: 7f771b1b1640 / io_context_pool 2024-09-12T17:23:52.311 INFO:tasks.workunit.client.0.smithi016.stderr: 7f771c6a99c0 / radosgw-admin 2024-09-12T17:23:52.311 INFO:tasks.workunit.client.0.smithi016.stderr: max_recent 500 2024-09-12T17:23:52.311 INFO:tasks.workunit.client.0.smithi016.stderr: max_new 1000 2024-09-12T17:23:52.311 INFO:tasks.workunit.client.0.smithi016.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:23:52.161850Z_273ee00f-6760-4770-9d65-14802c36aba5/log 2024-09-12T17:23:52.311 INFO:tasks.workunit.client.0.smithi016.stderr:--- end dump of recent events --- 2024-09-12T17:23:52.311 INFO:tasks.workunit.client.0.smithi016.stderr:Aborted 2024-09-12T17:23:52.311 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:23:52.312 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:52.312 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:52.313 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.246+0000 7f1d940309c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.313 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.246+0000 7f1d940309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:52.313 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.246+0000 7f1d940309c0 20 realm 2024-09-12T17:23:52.313 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.246+0000 7f1d940309c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.313 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.246+0000 7f1d940309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:52.313 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.246+0000 7f1d940309c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:52.313 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.246+0000 7f1d940309c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.313 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.246+0000 7f1d940309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:52.313 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.246+0000 7f1d940309c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.313 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.250+0000 7f1d940309c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:52.313 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.250+0000 7f1d940309c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.313 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.250+0000 7f1d940309c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:52.313 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.250+0000 7f1d940309c0 20 searching for the correct realm 2024-09-12T17:23:52.314 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.254+0000 7f1d92337640 0 -- 172.21.15.16:0/77891455 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f1d880c6040 msgr2=0x7f1d881390b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:23:52.475 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.470+0000 7f1d91335640 0 -- 172.21.15.16:0/77891455 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f1d8c018040 msgr2=0x7f1d8c046940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:23:52.691 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.686+0000 7f1d940309c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:23:52.691 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.686+0000 7f1d940309c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:52.691 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.686+0000 7f1d940309c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:23:52.691 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.686+0000 7f1d940309c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:52.692 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.686+0000 7f1d940309c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:52.692 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.686+0000 7f1d940309c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:52.692 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.686+0000 7f1d940309c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.692 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.686+0000 7f1d940309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:52.692 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.686+0000 7f1d940309c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.692 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.690+0000 7f1d940309c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:52.693 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.690+0000 7f1d940309c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.694 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.690+0000 7f1d940309c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:52.694 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.690+0000 7f1d940309c0 20 zone default found 2024-09-12T17:23:52.694 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.690+0000 7f1d940309c0 4 Realm: () 2024-09-12T17:23:52.694 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.690+0000 7f1d940309c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:23:52.694 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.690+0000 7f1d940309c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:23:52.694 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.690+0000 7f1d940309c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:52.694 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.690+0000 7f1d940309c0 20 zonegroup default 2024-09-12T17:23:52.694 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.690+0000 7f1d940309c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.695 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.690+0000 7f1d940309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:52.695 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.690+0000 7f1d940309c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.696 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.690+0000 7f1d940309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:52.696 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.690+0000 7f1d940309c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.697 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.694+0000 7f1d940309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:52.697 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.694+0000 7f1d940309c0 20 started sync module instance, tier type = 2024-09-12T17:23:52.697 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.694+0000 7f1d940309c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:23:52.722 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.718+0000 7f1d940309c0 20 add_watcher() i=0 2024-09-12T17:23:52.722 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.718+0000 7f1d940309c0 20 add_watcher() i=1 2024-09-12T17:23:52.722 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.718+0000 7f1d940309c0 20 add_watcher() i=2 2024-09-12T17:23:52.722 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.718+0000 7f1d940309c0 20 add_watcher() i=3 2024-09-12T17:23:52.722 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.718+0000 7f1d940309c0 20 add_watcher() i=4 2024-09-12T17:23:52.722 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.718+0000 7f1d940309c0 20 add_watcher() i=5 2024-09-12T17:23:52.723 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.718+0000 7f1d940309c0 20 add_watcher() i=6 2024-09-12T17:23:52.724 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.722+0000 7f1d940309c0 20 add_watcher() i=7 2024-09-12T17:23:52.724 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.722+0000 7f1d940309c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:52.728 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.726+0000 7f1c437fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:52.729 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.726+0000 7f1d940309c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:52.729 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.726+0000 7f1d940309c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:52.730 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.726+0000 7f1d940309c0 5 note: GC not initialized 2024-09-12T17:23:52.730 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.726+0000 7f1c427fc640 20 reqs_thread_entry: start 2024-09-12T17:23:52.730 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.726+0000 7f1d940309c0 20 init_complete bucket index max shards: 1 2024-09-12T17:23:52.730 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.726+0000 7f1d940309c0 20 Filter name: none 2024-09-12T17:23:52.731 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.726+0000 7f1bb3fff640 20 reqs_thread_entry: start 2024-09-12T17:23:52.731 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.726+0000 7f1d940309c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.731 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.726+0000 7f1d940309c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:23:52.732 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.726+0000 7f1d940309c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.733 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.730+0000 7f1d940309c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T17:23:52.733 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.730+0000 7f1d940309c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:23:52.733 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.730+0000 7f1d940309c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.733 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.730+0000 7f1d940309c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:23:52.734 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.730+0000 7f1d940309c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.734 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.730+0000 7f1d940309c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T17:23:52.734 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.730+0000 7f1d940309c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:23:52.736 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.734+0000 7f1c437fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:52.741 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.738+0000 7f1d940309c0 20 remove_watcher() i=0 2024-09-12T17:23:52.741 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.738+0000 7f1d940309c0 2 removed watcher, disabling cache 2024-09-12T17:23:52.744 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.738+0000 7f1d940309c0 20 remove_watcher() i=1 2024-09-12T17:23:52.746 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.742+0000 7f1d940309c0 20 remove_watcher() i=2 2024-09-12T17:23:52.749 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.746+0000 7f1d940309c0 20 remove_watcher() i=3 2024-09-12T17:23:52.752 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.746+0000 7f1d940309c0 20 remove_watcher() i=4 2024-09-12T17:23:52.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.750+0000 7f1d940309c0 20 remove_watcher() i=5 2024-09-12T17:23:52.755 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.750+0000 7f1d940309c0 20 remove_watcher() i=6 2024-09-12T17:23:52.756 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.754+0000 7f1d940309c0 20 remove_watcher() i=7 2024-09-12T17:23:52.788 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T17:23:52.820 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:52.820 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:52.868 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.862+0000 7f236f6f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.870 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.866+0000 7f236f6f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:52.870 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.866+0000 7f236f6f89c0 20 realm 2024-09-12T17:23:52.870 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.866+0000 7f236f6f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.870 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.866+0000 7f236f6f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:52.870 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.866+0000 7f236f6f89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:23:52.870 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.866+0000 7f236f6f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.870 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.866+0000 7f236f6f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:52.870 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.866+0000 7f236f6f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.871 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.866+0000 7f236f6f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:52.871 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.866+0000 7f236f6f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:52.873 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.870+0000 7f236f6f89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:23:52.873 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.870+0000 7f236f6f89c0 20 searching for the correct realm 2024-09-12T17:23:52.878 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.874+0000 7f236c9fd640 0 -- 172.21.15.16:0/2096925073 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7f2360027040 msgr2=0x7f2360019410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:52.884 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:52.878+0000 7f236c9fd640 0 -- 172.21.15.16:0/2096925073 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f23680fb2f0 msgr2=0x7f2368101900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:23:53.105 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.102+0000 7f236f6f89c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:23:53.106 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.102+0000 7f236f6f89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:23:53.106 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.102+0000 7f236f6f89c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:23:53.106 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.102+0000 7f236f6f89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:23:53.106 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.102+0000 7f236f6f89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:23:53.106 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.102+0000 7f236f6f89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:23:53.106 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.102+0000 7f236f6f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:53.106 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.102+0000 7f236f6f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:53.107 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.102+0000 7f236f6f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:53.107 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.102+0000 7f236f6f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:23:53.107 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.102+0000 7f236f6f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:53.108 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.102+0000 7f236f6f89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:23:53.108 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.102+0000 7f236f6f89c0 20 zone default found 2024-09-12T17:23:53.108 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.102+0000 7f236f6f89c0 4 Realm: () 2024-09-12T17:23:53.108 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.102+0000 7f236f6f89c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:23:53.108 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.102+0000 7f236f6f89c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:23:53.108 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.106+0000 7f236f6f89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:23:53.109 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.106+0000 7f236f6f89c0 20 zonegroup default 2024-09-12T17:23:53.109 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.106+0000 7f236f6f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:53.109 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.106+0000 7f236f6f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:53.109 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.106+0000 7f236f6f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:53.110 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.106+0000 7f236f6f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:53.110 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.106+0000 7f236f6f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:53.110 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.106+0000 7f236f6f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:23:53.110 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.106+0000 7f236f6f89c0 20 started sync module instance, tier type = 2024-09-12T17:23:53.111 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.106+0000 7f236f6f89c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:23:53.133 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.130+0000 7f236f6f89c0 20 add_watcher() i=0 2024-09-12T17:23:53.134 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.130+0000 7f236f6f89c0 20 add_watcher() i=1 2024-09-12T17:23:53.134 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.130+0000 7f236f6f89c0 20 add_watcher() i=2 2024-09-12T17:23:53.134 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.130+0000 7f236f6f89c0 20 add_watcher() i=3 2024-09-12T17:23:53.134 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.130+0000 7f236f6f89c0 20 add_watcher() i=4 2024-09-12T17:23:53.134 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.130+0000 7f236f6f89c0 20 add_watcher() i=5 2024-09-12T17:23:53.134 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.130+0000 7f236f6f89c0 20 add_watcher() i=6 2024-09-12T17:23:53.136 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.130+0000 7f236f6f89c0 20 add_watcher() i=7 2024-09-12T17:23:53.136 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.130+0000 7f236f6f89c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:23:53.140 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.134+0000 7f2223fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:53.141 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.138+0000 7f236f6f89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:23:53.141 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.138+0000 7f236f6f89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:23:53.141 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.138+0000 7f236f6f89c0 5 note: GC not initialized 2024-09-12T17:23:53.142 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.138+0000 7f2222fe5640 20 reqs_thread_entry: start 2024-09-12T17:23:53.142 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.138+0000 7f236f6f89c0 20 init_complete bucket index max shards: 1 2024-09-12T17:23:53.142 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.138+0000 7f236f6f89c0 20 Filter name: none 2024-09-12T17:23:53.142 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.138+0000 7f2220fe1640 20 reqs_thread_entry: start 2024-09-12T17:23:53.142 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.138+0000 7f236f6f89c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:23:53.142 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.138+0000 7f236f6f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:53.143 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.138+0000 7f236f6f89c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:23:53.143 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.138+0000 7f236f6f89c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:23:53.143 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.138+0000 7f236f6f89c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:23:53.143 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.138+0000 7f236f6f89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 : miss 2024-09-12T17:23:53.143 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.138+0000 7f236f6f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:23:53.144 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.138+0000 7f236f6f89c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T17:23:53.144 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.142+0000 7f236f6f89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:23:53.144 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.142+0000 7f236f6f89c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:23:53.144 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.142+0000 7f236f6f89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:23:53.144 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.142+0000 7f236f6f89c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:23:53.144 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.142+0000 7f236f6f89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 2024-09-12T17:23:53.145 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.142+0000 7f236f6f89c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.0 2024-09-12T17:23:53.145 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.142+0000 7f236f6f89c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.0 2024-09-12T17:23:53.145 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.142+0000 7f236f6f89c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.1 2024-09-12T17:23:53.145 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.142+0000 7f236f6f89c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.1 2024-09-12T17:23:53.145 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.142+0000 7f236f6f89c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.2 2024-09-12T17:23:53.145 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.142+0000 7f236f6f89c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.2 2024-09-12T17:23:53.147 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.142+0000 7f2223fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:23:53.152 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.150+0000 7f236f6f89c0 20 remove_watcher() i=0 2024-09-12T17:23:53.152 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.150+0000 7f236f6f89c0 2 removed watcher, disabling cache 2024-09-12T17:23:53.154 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.150+0000 7f236f6f89c0 20 remove_watcher() i=1 2024-09-12T17:23:53.156 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.154+0000 7f236f6f89c0 20 remove_watcher() i=2 2024-09-12T17:23:53.158 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.154+0000 7f236f6f89c0 20 remove_watcher() i=3 2024-09-12T17:23:53.161 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.158+0000 7f236f6f89c0 20 remove_watcher() i=4 2024-09-12T17:23:53.162 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.158+0000 7f236f6f89c0 20 remove_watcher() i=5 2024-09-12T17:23:53.163 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.158+0000 7f236f6f89c0 20 remove_watcher() i=6 2024-09-12T17:23:53.165 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:23:53.162+0000 7f236f6f89c0 20 remove_watcher() i=7 2024-09-12T17:24:23.214 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin reshardlog purge --bucket a-bucket 2024-09-12T17:24:23.247 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:23.248 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:23.296 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.298+0000 7f06b5e179c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:23.298 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.298+0000 7f06b5e179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:23.298 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.298+0000 7f06b5e179c0 20 realm 2024-09-12T17:24:23.298 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.298+0000 7f06b5e179c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:23.299 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.298+0000 7f06b5e179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:23.299 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.298+0000 7f06b5e179c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:23.299 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.298+0000 7f06b5e179c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:23.299 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.298+0000 7f06b5e179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:23.299 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.298+0000 7f06b5e179c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:23.300 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.302+0000 7f06b5e179c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:23.300 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.302+0000 7f06b5e179c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:23.302 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.302+0000 7f06b5e179c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:23.302 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.302+0000 7f06b5e179c0 20 searching for the correct realm 2024-09-12T17:24:23.306 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.306+0000 7f06b411e640 0 -- 172.21.15.16:0/1259134881 >> [v2:172.21.15.19:6800/1509147557,v1:172.21.15.19:6801/1509147557] conn(0x55b08ccf3090 msgr2=0x55b08ccf54a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:24:23.315 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.314+0000 7f06b311c640 0 -- 172.21.15.16:0/1259134881 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f06ac097070 msgr2=0x7f06ac069460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:23.532 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.530+0000 7f06b5e179c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:24:23.532 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.530+0000 7f06b5e179c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:23.532 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.530+0000 7f06b5e179c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:24:23.532 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.530+0000 7f06b5e179c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:23.532 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.530+0000 7f06b5e179c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:23.532 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.530+0000 7f06b5e179c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:23.533 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.530+0000 7f06b5e179c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:23.533 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.534+0000 7f06b5e179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:23.533 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.534+0000 7f06b5e179c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:23.533 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.534+0000 7f06b5e179c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:23.533 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.534+0000 7f06b5e179c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:23.535 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.534+0000 7f06b5e179c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:23.535 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.534+0000 7f06b5e179c0 20 zone default found 2024-09-12T17:24:23.535 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.534+0000 7f06b5e179c0 4 Realm: () 2024-09-12T17:24:23.535 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.534+0000 7f06b5e179c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:24:23.535 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.534+0000 7f06b5e179c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:24:23.535 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.534+0000 7f06b5e179c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:23.535 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.534+0000 7f06b5e179c0 20 zonegroup default 2024-09-12T17:24:23.535 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.534+0000 7f06b5e179c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:23.536 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.534+0000 7f06b5e179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:23.536 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.534+0000 7f06b5e179c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:23.536 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.538+0000 7f06b5e179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:23.536 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.538+0000 7f06b5e179c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:23.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.538+0000 7f06b5e179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:23.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.538+0000 7f06b5e179c0 20 started sync module instance, tier type = 2024-09-12T17:24:23.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.538+0000 7f06b5e179c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:24:23.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.562+0000 7f06b5e179c0 20 add_watcher() i=0 2024-09-12T17:24:23.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.562+0000 7f06b5e179c0 20 add_watcher() i=1 2024-09-12T17:24:23.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.562+0000 7f06b5e179c0 20 add_watcher() i=2 2024-09-12T17:24:23.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.562+0000 7f06b5e179c0 20 add_watcher() i=3 2024-09-12T17:24:23.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.562+0000 7f06b5e179c0 20 add_watcher() i=4 2024-09-12T17:24:23.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.562+0000 7f06b5e179c0 20 add_watcher() i=5 2024-09-12T17:24:23.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.562+0000 7f06b5e179c0 20 add_watcher() i=6 2024-09-12T17:24:23.565 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.566+0000 7f06b5e179c0 20 add_watcher() i=7 2024-09-12T17:24:23.565 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.566+0000 7f06b5e179c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:23.569 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.570+0000 7f056a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:23.573 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.570+0000 7f06b5e179c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:23.573 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.570+0000 7f06b5e179c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:23.573 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.570+0000 7f06b5e179c0 5 note: GC not initialized 2024-09-12T17:24:23.573 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.570+0000 7f05697e2640 20 reqs_thread_entry: start 2024-09-12T17:24:23.573 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.570+0000 7f06b5e179c0 20 init_complete bucket index max shards: 1 2024-09-12T17:24:23.573 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.570+0000 7f06b5e179c0 20 Filter name: none 2024-09-12T17:24:23.573 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.570+0000 7f05627fc640 20 reqs_thread_entry: start 2024-09-12T17:24:23.574 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.570+0000 7f06b5e179c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:24:23.574 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.570+0000 7f06b5e179c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:23.574 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.570+0000 7f06b5e179c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:24:23.574 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.570+0000 7f06b5e179c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:24:23.574 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.570+0000 7f06b5e179c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:24:23.574 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.570+0000 7f06b5e179c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 : miss 2024-09-12T17:24:23.574 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.570+0000 7f06b5e179c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:23.574 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.574+0000 7f06b5e179c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T17:24:23.574 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.574+0000 7f06b5e179c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:24:23.574 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.574+0000 7f06b5e179c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:24:23.574 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.574+0000 7f06b5e179c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:24:23.574 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.574+0000 7f06b5e179c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:24:23.574 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.574+0000 7f06b5e179c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 2024-09-12T17:24:23.578 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.578+0000 7f056a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:23.583 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.582+0000 7f06b5e179c0 20 remove_watcher() i=0 2024-09-12T17:24:23.583 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.582+0000 7f06b5e179c0 2 removed watcher, disabling cache 2024-09-12T17:24:23.585 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.586+0000 7f06b5e179c0 20 remove_watcher() i=1 2024-09-12T17:24:23.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.590+0000 7f06b5e179c0 20 remove_watcher() i=2 2024-09-12T17:24:23.590 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.590+0000 7f06b5e179c0 20 remove_watcher() i=3 2024-09-12T17:24:23.593 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.594+0000 7f06b5e179c0 20 remove_watcher() i=4 2024-09-12T17:24:23.594 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.594+0000 7f06b5e179c0 20 remove_watcher() i=5 2024-09-12T17:24:23.596 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.594+0000 7f06b5e179c0 20 remove_watcher() i=6 2024-09-12T17:24:23.597 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.598+0000 7f06b5e179c0 20 remove_watcher() i=7 2024-09-12T17:24:23.614 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T17:24:23.642 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:23.642 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:23.688 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.686+0000 7f30ae3f39c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:23.689 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.690+0000 7f30ae3f39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:23.690 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.690+0000 7f30ae3f39c0 20 realm 2024-09-12T17:24:23.690 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.690+0000 7f30ae3f39c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:23.690 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.690+0000 7f30ae3f39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:23.690 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.690+0000 7f30ae3f39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:23.690 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.690+0000 7f30ae3f39c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:23.690 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.690+0000 7f30ae3f39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:23.690 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.690+0000 7f30ae3f39c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:23.691 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.690+0000 7f30ae3f39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:23.691 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.690+0000 7f30ae3f39c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:23.693 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.694+0000 7f30ae3f39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:23.693 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.694+0000 7f30ae3f39c0 20 searching for the correct realm 2024-09-12T17:24:23.696 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.698+0000 7f30ac6fa640 0 -- 172.21.15.16:0/4107457462 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f30a00bf020 msgr2=0x7f30a010e000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:23.704 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.702+0000 7f30ab6f8640 0 -- 172.21.15.16:0/4107457462 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f30a4015a70 msgr2=0x7f30a407d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:23.919 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.918+0000 7f30ae3f39c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:24:23.919 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.918+0000 7f30ae3f39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:23.919 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.918+0000 7f30ae3f39c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:24:23.920 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.918+0000 7f30ae3f39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:23.920 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.918+0000 7f30ae3f39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:23.920 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.918+0000 7f30ae3f39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:23.920 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.918+0000 7f30ae3f39c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:23.922 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.918+0000 7f30ae3f39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:23.922 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.918+0000 7f30ae3f39c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:23.923 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.922+0000 7f30ae3f39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:23.923 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.922+0000 7f30ae3f39c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:23.923 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.922+0000 7f30ae3f39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:23.923 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.922+0000 7f30ae3f39c0 20 zone default found 2024-09-12T17:24:23.923 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.922+0000 7f30ae3f39c0 4 Realm: () 2024-09-12T17:24:23.923 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.922+0000 7f30ae3f39c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:24:23.923 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.922+0000 7f30ae3f39c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:24:23.923 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.922+0000 7f30ae3f39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:23.923 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.922+0000 7f30ae3f39c0 20 zonegroup default 2024-09-12T17:24:23.924 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.922+0000 7f30ae3f39c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:23.924 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.922+0000 7f30ae3f39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:23.924 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.922+0000 7f30ae3f39c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:23.925 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.922+0000 7f30ae3f39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:23.925 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.922+0000 7f30ae3f39c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:23.925 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.922+0000 7f30ae3f39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:23.925 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.922+0000 7f30ae3f39c0 20 started sync module instance, tier type = 2024-09-12T17:24:23.925 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.922+0000 7f30ae3f39c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:24:23.948 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.946+0000 7f30ae3f39c0 20 add_watcher() i=0 2024-09-12T17:24:23.948 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.946+0000 7f30ae3f39c0 20 add_watcher() i=1 2024-09-12T17:24:23.948 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.946+0000 7f30ae3f39c0 20 add_watcher() i=2 2024-09-12T17:24:23.948 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.946+0000 7f30ae3f39c0 20 add_watcher() i=3 2024-09-12T17:24:23.948 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.946+0000 7f30ae3f39c0 20 add_watcher() i=4 2024-09-12T17:24:23.948 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.946+0000 7f30ae3f39c0 20 add_watcher() i=5 2024-09-12T17:24:23.949 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.946+0000 7f30ae3f39c0 20 add_watcher() i=6 2024-09-12T17:24:23.950 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.950+0000 7f30ae3f39c0 20 add_watcher() i=7 2024-09-12T17:24:23.950 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.950+0000 7f30ae3f39c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:23.954 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.954+0000 7f2f627e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:23.955 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.954+0000 7f30ae3f39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:23.955 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.954+0000 7f30ae3f39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:23.955 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.954+0000 7f30ae3f39c0 5 note: GC not initialized 2024-09-12T17:24:23.956 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.954+0000 7f2f617e2640 20 reqs_thread_entry: start 2024-09-12T17:24:23.956 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.954+0000 7f30ae3f39c0 20 init_complete bucket index max shards: 1 2024-09-12T17:24:23.956 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.954+0000 7f30ae3f39c0 20 Filter name: none 2024-09-12T17:24:23.956 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.954+0000 7f2f5a7fc640 20 reqs_thread_entry: start 2024-09-12T17:24:23.956 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.954+0000 7f30ae3f39c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:24:23.956 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.954+0000 7f30ae3f39c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:23.957 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.958+0000 7f30ae3f39c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:24:23.957 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.958+0000 7f30ae3f39c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:24:23.957 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.958+0000 7f30ae3f39c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:24:23.957 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.958+0000 7f30ae3f39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 : miss 2024-09-12T17:24:23.958 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.958+0000 7f30ae3f39c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:23.958 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.958+0000 7f30ae3f39c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T17:24:23.958 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.958+0000 7f30ae3f39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:24:23.959 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.958+0000 7f30ae3f39c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:24:23.959 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.958+0000 7f30ae3f39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:24:23.959 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.958+0000 7f30ae3f39c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:24:23.959 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.958+0000 7f30ae3f39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 2024-09-12T17:24:23.959 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.958+0000 7f30ae3f39c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.0 2024-09-12T17:24:23.959 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.958+0000 7f30ae3f39c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.0 2024-09-12T17:24:23.959 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.958+0000 7f30ae3f39c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.1 2024-09-12T17:24:23.959 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.958+0000 7f30ae3f39c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.1 2024-09-12T17:24:23.960 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.958+0000 7f30ae3f39c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.2 2024-09-12T17:24:23.960 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.958+0000 7f30ae3f39c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.2 2024-09-12T17:24:23.961 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.962+0000 7f2f627e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:23.966 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.966+0000 7f30ae3f39c0 20 remove_watcher() i=0 2024-09-12T17:24:23.966 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.966+0000 7f30ae3f39c0 2 removed watcher, disabling cache 2024-09-12T17:24:23.969 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.970+0000 7f30ae3f39c0 20 remove_watcher() i=1 2024-09-12T17:24:23.971 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.970+0000 7f30ae3f39c0 20 remove_watcher() i=2 2024-09-12T17:24:23.974 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.974+0000 7f30ae3f39c0 20 remove_watcher() i=3 2024-09-12T17:24:23.976 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.974+0000 7f30ae3f39c0 20 remove_watcher() i=4 2024-09-12T17:24:23.977 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.978+0000 7f30ae3f39c0 20 remove_watcher() i=5 2024-09-12T17:24:23.979 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.978+0000 7f30ae3f39c0 20 remove_watcher() i=6 2024-09-12T17:24:23.981 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:23.982+0000 7f30ae3f39c0 20 remove_watcher() i=7 2024-09-12T17:24:23.998 INFO:tasks.workunit.client.0.smithi016.stderr:check reshard logrecord successfully 2024-09-12T17:24:23.998 INFO:tasks.workunit.client.0.smithi016.stderr: test: reshard versioned bucket 2024-09-12T17:24:23.998 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T17:24:24.031 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:24.031 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:24.076 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.078+0000 7fcfa78229c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:24.079 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.078+0000 7fcfa78229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:24.079 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.078+0000 7fcfa78229c0 20 realm 2024-09-12T17:24:24.079 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.078+0000 7fcfa78229c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:24.079 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.078+0000 7fcfa78229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:24.079 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.078+0000 7fcfa78229c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:24.079 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.078+0000 7fcfa78229c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:24.079 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.078+0000 7fcfa78229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:24.079 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.078+0000 7fcfa78229c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:24.081 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.082+0000 7fcfa78229c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:24.081 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.082+0000 7fcfa78229c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:24.082 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.082+0000 7fcfa78229c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:24.082 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.082+0000 7fcfa78229c0 20 searching for the correct realm 2024-09-12T17:24:24.085 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.086+0000 7fcfa5b29640 0 -- 172.21.15.16:0/1056052255 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fcf90052040 msgr2=0x7fcf90052930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:24.094 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.094+0000 7fcfa4b27640 0 -- 172.21.15.16:0/1056052255 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fcfa0064960 msgr2=0x7fcfa0092040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:24:24.314 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.314+0000 7fcfa78229c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:24:24.314 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.314+0000 7fcfa78229c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:24.314 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.314+0000 7fcfa78229c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:24:24.314 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.314+0000 7fcfa78229c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:24.314 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.314+0000 7fcfa78229c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:24.314 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.314+0000 7fcfa78229c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:24.314 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.314+0000 7fcfa78229c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:24.315 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.314+0000 7fcfa78229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:24.315 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.314+0000 7fcfa78229c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:24.315 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.314+0000 7fcfa78229c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:24.315 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.314+0000 7fcfa78229c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:24.316 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.314+0000 7fcfa78229c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:24.316 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.314+0000 7fcfa78229c0 20 zone default found 2024-09-12T17:24:24.316 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.314+0000 7fcfa78229c0 4 Realm: () 2024-09-12T17:24:24.316 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.314+0000 7fcfa78229c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:24:24.317 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.314+0000 7fcfa78229c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:24:24.317 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.314+0000 7fcfa78229c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:24.317 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.314+0000 7fcfa78229c0 20 zonegroup default 2024-09-12T17:24:24.317 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.314+0000 7fcfa78229c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:24.317 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.318+0000 7fcfa78229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:24.317 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.318+0000 7fcfa78229c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:24.318 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.318+0000 7fcfa78229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:24.318 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.318+0000 7fcfa78229c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:24.318 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.318+0000 7fcfa78229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:24.318 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.318+0000 7fcfa78229c0 20 started sync module instance, tier type = 2024-09-12T17:24:24.318 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.318+0000 7fcfa78229c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:24:24.343 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.342+0000 7fcfa78229c0 20 add_watcher() i=0 2024-09-12T17:24:24.343 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.342+0000 7fcfa78229c0 20 add_watcher() i=1 2024-09-12T17:24:24.343 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.342+0000 7fcfa78229c0 20 add_watcher() i=2 2024-09-12T17:24:24.343 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.342+0000 7fcfa78229c0 20 add_watcher() i=3 2024-09-12T17:24:24.343 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.342+0000 7fcfa78229c0 20 add_watcher() i=4 2024-09-12T17:24:24.343 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.342+0000 7fcfa78229c0 20 add_watcher() i=5 2024-09-12T17:24:24.343 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.342+0000 7fcfa78229c0 20 add_watcher() i=6 2024-09-12T17:24:24.345 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.346+0000 7fcfa78229c0 20 add_watcher() i=7 2024-09-12T17:24:24.346 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.346+0000 7fcfa78229c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:24.350 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.350+0000 7fce5bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:24.350 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.350+0000 7fcfa78229c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:24.351 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.350+0000 7fcfa78229c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:24.351 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.350+0000 7fcfa78229c0 5 note: GC not initialized 2024-09-12T17:24:24.351 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.350+0000 7fce5afe5640 20 reqs_thread_entry: start 2024-09-12T17:24:24.351 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.350+0000 7fcfa78229c0 20 init_complete bucket index max shards: 1 2024-09-12T17:24:24.351 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.350+0000 7fcfa78229c0 20 Filter name: none 2024-09-12T17:24:24.352 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.350+0000 7fce58fe1640 20 reqs_thread_entry: start 2024-09-12T17:24:24.352 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.350+0000 7fcfa78229c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:24.353 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.354+0000 7fcfa78229c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T17:24:24.353 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.354+0000 7fcfa78229c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:24.355 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.354+0000 7fcfa78229c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T17:24:24.355 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.354+0000 7fcfa78229c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:24.355 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.354+0000 7fcfa78229c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:24.356 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.354+0000 7fcfa78229c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T17:24:24.356 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.354+0000 7fcfa78229c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:24.357 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.358+0000 7fcfa78229c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T17:24:24.357 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.358+0000 7fcfa78229c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:24.359 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.358+0000 7fce5bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:24.365 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.366+0000 7fcfa78229c0 20 remove_watcher() i=0 2024-09-12T17:24:24.365 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.366+0000 7fcfa78229c0 2 removed watcher, disabling cache 2024-09-12T17:24:24.368 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.366+0000 7fcfa78229c0 20 remove_watcher() i=1 2024-09-12T17:24:24.370 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.370+0000 7fcfa78229c0 20 remove_watcher() i=2 2024-09-12T17:24:24.373 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.374+0000 7fcfa78229c0 20 remove_watcher() i=3 2024-09-12T17:24:24.375 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.374+0000 7fcfa78229c0 20 remove_watcher() i=4 2024-09-12T17:24:24.377 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.378+0000 7fcfa78229c0 20 remove_watcher() i=5 2024-09-12T17:24:24.379 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.378+0000 7fcfa78229c0 20 remove_watcher() i=6 2024-09-12T17:24:24.381 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.382+0000 7fcfa78229c0 20 remove_watcher() i=7 2024-09-12T17:24:24.398 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:24:24.399 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:24:24.399 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: myver id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 num_objects: 0 size_kb: 0 num_shards: 1 2024-09-12T17:24:24.399 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:24:24.399 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 2 2024-09-12T17:24:24.429 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:24.429 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:24.477 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.478+0000 7f9740cee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:24.479 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.478+0000 7f9740cee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:24.479 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.478+0000 7f9740cee9c0 20 realm 2024-09-12T17:24:24.479 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.478+0000 7f9740cee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:24.479 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.478+0000 7f9740cee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:24.480 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.478+0000 7f9740cee9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:24.480 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.478+0000 7f9740cee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:24.480 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.478+0000 7f9740cee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:24.480 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.478+0000 7f9740cee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:24.481 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.482+0000 7f9740cee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:24.481 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.482+0000 7f9740cee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:24.483 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.482+0000 7f9740cee9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:24.483 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.482+0000 7f9740cee9c0 20 searching for the correct realm 2024-09-12T17:24:24.486 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.486+0000 7f973eff5640 0 -- 172.21.15.16:0/1609688401 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f9728008040 msgr2=0x7f9728089230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:24.494 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.494+0000 7f973dff3640 0 -- 172.21.15.16:0/1609688401 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f9730031070 msgr2=0x7f9730023970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:24.712 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.710+0000 7f9740cee9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:24:24.712 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.710+0000 7f9740cee9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:24.712 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.710+0000 7f9740cee9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:24:24.712 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.710+0000 7f9740cee9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:24.712 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.710+0000 7f9740cee9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:24.712 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.710+0000 7f9740cee9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:24.712 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.710+0000 7f9740cee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:24.713 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.710+0000 7f9740cee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:24.713 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.710+0000 7f9740cee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:24.713 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.714+0000 7f9740cee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:24.713 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.714+0000 7f9740cee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:24.714 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.714+0000 7f9740cee9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:24.714 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.714+0000 7f9740cee9c0 20 zone default found 2024-09-12T17:24:24.714 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.714+0000 7f9740cee9c0 4 Realm: () 2024-09-12T17:24:24.714 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.714+0000 7f9740cee9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:24:24.714 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.714+0000 7f9740cee9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:24:24.714 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.714+0000 7f9740cee9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:24.714 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.714+0000 7f9740cee9c0 20 zonegroup default 2024-09-12T17:24:24.715 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.714+0000 7f9740cee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:24.715 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.714+0000 7f9740cee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:24.715 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.714+0000 7f9740cee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:24.716 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.714+0000 7f9740cee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:24.716 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.714+0000 7f9740cee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:24.716 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.718+0000 7f9740cee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:24.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.718+0000 7f9740cee9c0 20 started sync module instance, tier type = 2024-09-12T17:24:24.717 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.718+0000 7f9740cee9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:24:24.740 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.738+0000 7f9740cee9c0 20 add_watcher() i=0 2024-09-12T17:24:24.740 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.738+0000 7f9740cee9c0 20 add_watcher() i=1 2024-09-12T17:24:24.741 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.738+0000 7f9740cee9c0 20 add_watcher() i=2 2024-09-12T17:24:24.741 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.738+0000 7f9740cee9c0 20 add_watcher() i=3 2024-09-12T17:24:24.741 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.738+0000 7f9740cee9c0 20 add_watcher() i=4 2024-09-12T17:24:24.741 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.738+0000 7f9740cee9c0 20 add_watcher() i=5 2024-09-12T17:24:24.741 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.738+0000 7f9740cee9c0 20 add_watcher() i=6 2024-09-12T17:24:24.742 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.742+0000 7f9740cee9c0 20 add_watcher() i=7 2024-09-12T17:24:24.743 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.742+0000 7f9740cee9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:24.747 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.746+0000 7f95f4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:24.748 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.746+0000 7f9740cee9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:24.748 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.746+0000 7f9740cee9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:24.748 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.746+0000 7f9740cee9c0 5 note: GC not initialized 2024-09-12T17:24:24.749 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.750+0000 7f956f7fe640 20 reqs_thread_entry: start 2024-09-12T17:24:24.749 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.750+0000 7f9740cee9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:24:24.749 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.750+0000 7f9740cee9c0 20 Filter name: none 2024-09-12T17:24:24.749 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.750+0000 7f956d7fa640 20 reqs_thread_entry: start 2024-09-12T17:24:24.749 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.750+0000 7f9740cee9c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T17:24:24.749 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.750+0000 7f9740cee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:24.750 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.750+0000 7f9740cee9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T17:24:24.750 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.750+0000 7f9740cee9c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T17:24:24.750 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.750+0000 7f9740cee9c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T17:24:24.750 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.750+0000 7f9740cee9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 : miss 2024-09-12T17:24:24.750 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.750+0000 7f9740cee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:24.751 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.750+0000 7f9740cee9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T17:24:24.751 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.750+0000 7f9740cee9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 info.flags=0x17 2024-09-12T17:24:24.751 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.750+0000 7f9740cee9c0 10 adding default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 to cache LRU end 2024-09-12T17:24:24.751 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.750+0000 7f9740cee9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:24:24.751 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.750+0000 7f9740cee9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:24:24.751 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.750+0000 7f9740cee9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 2024-09-12T17:24:24.761 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.762+0000 7f9740cee9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 info.flags=0x17 2024-09-12T17:24:24.761 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.762+0000 7f9740cee9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 to cache LRU end 2024-09-12T17:24:24.761 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.762+0000 7f9740cee9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:24:24.761 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.762+0000 7f9740cee9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18, ofs0, ns] 2024-09-12T17:24:24.761 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.762+0000 7f9621ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431600 cookie 94853656245680 notifier 8403 bl.length()=821 2024-09-12T17:24:24.762 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.762+0000 7f9621ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 info.flags=0x17 2024-09-12T17:24:24.762 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.762+0000 7f9621ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 to cache LRU end 2024-09-12T17:24:24.762 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.762+0000 7f9621ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:24:24.762 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.762+0000 7f9740cee9c0 20 handle_bi_update(): bucket=:myver[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18]): orig_sources= new_sources= 2024-09-12T17:24:24.762 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.762+0000 7f9740cee9c0 20 handle_bi_update(): bucket=:myver[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18]): potential sources added=[] removed=[] 2024-09-12T17:24:24.762 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.762+0000 7f9740cee9c0 20 handle_bi_update(): bucket=:myver[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18]): orig_dests= new_dests= 2024-09-12T17:24:24.762 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.762+0000 7f9740cee9c0 20 handle_bi_update(): bucket=:myver[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18]): potential dests added=[] removed=[] 2024-09-12T17:24:24.768 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.766+0000 7f9740cee9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.1.0 2024-09-12T17:24:24.768 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.766+0000 7f9740cee9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.1.0 2024-09-12T17:24:24.768 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.766+0000 7f9740cee9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.1.1 2024-09-12T17:24:24.768 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.766+0000 7f9740cee9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.1.1 2024-09-12T17:24:24.768 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.766+0000 7f9740cee9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.0 2024-09-12T17:24:24.769 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.770+0000 7f9740cee9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 : hit (requested=0x17, cached=0x17) 2024-09-12T17:24:24.769 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.770+0000 7f9740cee9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 2024-09-12T17:24:24.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.774+0000 7f9740cee9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 info.flags=0x17 2024-09-12T17:24:24.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.774+0000 7f9740cee9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 to cache LRU end 2024-09-12T17:24:24.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.774+0000 7f9740cee9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:24:24.773 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.774+0000 7f9740cee9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18, ofs0, ns] 2024-09-12T17:24:24.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.774+0000 7f96217fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431601 cookie 94853656245680 notifier 8403 bl.length()=821 2024-09-12T17:24:24.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.774+0000 7f96217fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 info.flags=0x17 2024-09-12T17:24:24.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.774+0000 7f96217fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 to cache LRU end 2024-09-12T17:24:24.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.774+0000 7f96217fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:24:24.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.774+0000 7f9740cee9c0 20 handle_bi_update(): bucket=:myver[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18]): orig_sources= new_sources= 2024-09-12T17:24:24.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.774+0000 7f9740cee9c0 20 handle_bi_update(): bucket=:myver[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18]): potential sources added=[] removed=[] 2024-09-12T17:24:24.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.774+0000 7f9740cee9c0 20 handle_bi_update(): bucket=:myver[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18]): orig_dests= new_dests= 2024-09-12T17:24:24.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.774+0000 7f9740cee9c0 20 handle_bi_update(): bucket=:myver[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18]): potential dests added=[] removed=[] 2024-09-12T17:24:24.777 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.778+0000 7f9740cee9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.0 2024-09-12T17:24:24.779 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.778+0000 7f9740cee9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 : hit (requested=0x17, cached=0x17) 2024-09-12T17:24:24.779 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.778+0000 7f9740cee9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 2024-09-12T17:24:24.781 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.782+0000 7f9740cee9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 info.flags=0x17 2024-09-12T17:24:24.781 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.782+0000 7f9740cee9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 to cache LRU end 2024-09-12T17:24:24.781 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.782+0000 7f9740cee9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:24:24.781 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.782+0000 7f9740cee9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18, ofs0, ns] 2024-09-12T17:24:24.782 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.782+0000 7f9621ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431602 cookie 94853656245680 notifier 8403 bl.length()=789 2024-09-12T17:24:24.782 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.782+0000 7f9621ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 info.flags=0x17 2024-09-12T17:24:24.782 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.782+0000 7f9621ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 to cache LRU end 2024-09-12T17:24:24.782 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.782+0000 7f9621ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:24:24.782 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.782+0000 7f9740cee9c0 20 handle_bi_update(): bucket=:myver[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18]): orig_sources= new_sources= 2024-09-12T17:24:24.782 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.782+0000 7f9740cee9c0 20 handle_bi_update(): bucket=:myver[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18]): potential sources added=[] removed=[] 2024-09-12T17:24:24.782 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.782+0000 7f9740cee9c0 20 handle_bi_update(): bucket=:myver[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18]): orig_dests= new_dests= 2024-09-12T17:24:24.782 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.782+0000 7f9740cee9c0 20 handle_bi_update(): bucket=:myver[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18]): potential dests added=[] removed=[] 2024-09-12T17:24:24.785 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.786+0000 7f9740cee9c0 1 execute INFO: reshard of bucket "myver" from 1 shards to 2 shards completed successfully 2024-09-12T17:24:24.789 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.790+0000 7f95f4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:24.794 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.794+0000 7f9740cee9c0 20 remove_watcher() i=0 2024-09-12T17:24:24.794 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.794+0000 7f9740cee9c0 2 removed watcher, disabling cache 2024-09-12T17:24:24.796 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.798+0000 7f9740cee9c0 20 remove_watcher() i=1 2024-09-12T17:24:24.799 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.798+0000 7f9740cee9c0 20 remove_watcher() i=2 2024-09-12T17:24:24.801 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.802+0000 7f9740cee9c0 20 remove_watcher() i=3 2024-09-12T17:24:24.804 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.802+0000 7f9740cee9c0 20 remove_watcher() i=4 2024-09-12T17:24:24.805 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.806+0000 7f9740cee9c0 20 remove_watcher() i=5 2024-09-12T17:24:24.806 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.806+0000 7f9740cee9c0 20 remove_watcher() i=6 2024-09-12T17:24:24.808 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.806+0000 7f9740cee9c0 20 remove_watcher() i=7 2024-09-12T17:24:24.825 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T17:24:24.857 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:24.857 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:24.904 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.902+0000 7fc6f836b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:24.906 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.906+0000 7fc6f836b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:24.906 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.906+0000 7fc6f836b9c0 20 realm 2024-09-12T17:24:24.906 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.906+0000 7fc6f836b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:24.906 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.906+0000 7fc6f836b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:24.906 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.906+0000 7fc6f836b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:24.906 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.906+0000 7fc6f836b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:24.906 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.906+0000 7fc6f836b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:24.906 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.906+0000 7fc6f836b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:24.908 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.906+0000 7fc6f836b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:24.908 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.906+0000 7fc6f836b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:24.910 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.910+0000 7fc6f836b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:24.910 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.910+0000 7fc6f836b9c0 20 searching for the correct realm 2024-09-12T17:24:24.913 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.914+0000 7fc6f6672640 0 -- 172.21.15.16:0/818568320 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fc6ec047bd0 msgr2=0x7fc6ec01e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:24:24.921 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:24.922+0000 7fc6f5670640 0 -- 172.21.15.16:0/818568320 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fc6f0018040 msgr2=0x7fc6f00616a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:25.141 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.142+0000 7fc6f836b9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:24:25.141 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.142+0000 7fc6f836b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:25.141 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.142+0000 7fc6f836b9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:24:25.141 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.142+0000 7fc6f836b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:25.141 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.142+0000 7fc6f836b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:25.141 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.142+0000 7fc6f836b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:25.141 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.142+0000 7fc6f836b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:25.141 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.142+0000 7fc6f836b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:25.142 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.142+0000 7fc6f836b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:25.142 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.142+0000 7fc6f836b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:25.142 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.142+0000 7fc6f836b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:25.143 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.142+0000 7fc6f836b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:25.143 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.142+0000 7fc6f836b9c0 20 zone default found 2024-09-12T17:24:25.143 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.142+0000 7fc6f836b9c0 4 Realm: () 2024-09-12T17:24:25.144 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.142+0000 7fc6f836b9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:24:25.144 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.142+0000 7fc6f836b9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:24:25.144 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.142+0000 7fc6f836b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:25.144 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.142+0000 7fc6f836b9c0 20 zonegroup default 2024-09-12T17:24:25.144 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.142+0000 7fc6f836b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:25.144 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.142+0000 7fc6f836b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:25.144 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.142+0000 7fc6f836b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:25.145 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.146+0000 7fc6f836b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:25.145 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.146+0000 7fc6f836b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:25.146 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.146+0000 7fc6f836b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:25.146 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.146+0000 7fc6f836b9c0 20 started sync module instance, tier type = 2024-09-12T17:24:25.146 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.146+0000 7fc6f836b9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:24:25.171 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.170+0000 7fc6f836b9c0 20 add_watcher() i=0 2024-09-12T17:24:25.171 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.170+0000 7fc6f836b9c0 20 add_watcher() i=1 2024-09-12T17:24:25.171 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.170+0000 7fc6f836b9c0 20 add_watcher() i=2 2024-09-12T17:24:25.171 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.170+0000 7fc6f836b9c0 20 add_watcher() i=3 2024-09-12T17:24:25.171 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.170+0000 7fc6f836b9c0 20 add_watcher() i=4 2024-09-12T17:24:25.171 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.170+0000 7fc6f836b9c0 20 add_watcher() i=5 2024-09-12T17:24:25.171 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.170+0000 7fc6f836b9c0 20 add_watcher() i=6 2024-09-12T17:24:25.173 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.174+0000 7fc6f836b9c0 20 add_watcher() i=7 2024-09-12T17:24:25.173 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.174+0000 7fc6f836b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:25.178 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.178+0000 7fc5a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:25.179 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.178+0000 7fc6f836b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:25.179 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.178+0000 7fc6f836b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:25.179 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.178+0000 7fc6f836b9c0 5 note: GC not initialized 2024-09-12T17:24:25.179 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.178+0000 7fc5a67fc640 20 reqs_thread_entry: start 2024-09-12T17:24:25.179 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.178+0000 7fc6f836b9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:24:25.180 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.178+0000 7fc6f836b9c0 20 Filter name: none 2024-09-12T17:24:25.180 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.178+0000 7fc517fff640 20 reqs_thread_entry: start 2024-09-12T17:24:25.180 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.178+0000 7fc6f836b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:25.181 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.182+0000 7fc6f836b9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T17:24:25.181 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.182+0000 7fc6f836b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:25.183 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.182+0000 7fc6f836b9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T17:24:25.183 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.182+0000 7fc6f836b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:25.183 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.182+0000 7fc6f836b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:25.184 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.182+0000 7fc6f836b9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T17:24:25.184 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.182+0000 7fc6f836b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:25.185 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.186+0000 7fc6f836b9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T17:24:25.185 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.186+0000 7fc6f836b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:25.188 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.186+0000 7fc5a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:25.193 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.194+0000 7fc6f836b9c0 20 remove_watcher() i=0 2024-09-12T17:24:25.193 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.194+0000 7fc6f836b9c0 2 removed watcher, disabling cache 2024-09-12T17:24:25.196 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.198+0000 7fc6f836b9c0 20 remove_watcher() i=1 2024-09-12T17:24:25.199 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.198+0000 7fc6f836b9c0 20 remove_watcher() i=2 2024-09-12T17:24:25.201 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.202+0000 7fc6f836b9c0 20 remove_watcher() i=3 2024-09-12T17:24:25.204 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.202+0000 7fc6f836b9c0 20 remove_watcher() i=4 2024-09-12T17:24:25.205 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.206+0000 7fc6f836b9c0 20 remove_watcher() i=5 2024-09-12T17:24:25.207 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.206+0000 7fc6f836b9c0 20 remove_watcher() i=6 2024-09-12T17:24:25.209 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.210+0000 7fc6f836b9c0 20 remove_watcher() i=7 2024-09-12T17:24:25.225 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:24:25.225 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:24:25.225 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: myver id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 num_objects: 0 size_kb: 0 num_shards: 2 2024-09-12T17:24:25.225 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:24:25.273 INFO:tasks.workunit.client.0.smithi016.stderr: test: reshard removes olh entries with empty name 2024-09-12T17:24:25.425 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:24:25.457 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:25.457 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:25.504 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.502+0000 7f9e5f6f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:25.506 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.506+0000 7f9e5f6f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:25.506 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.506+0000 7f9e5f6f69c0 20 realm 2024-09-12T17:24:25.506 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.506+0000 7f9e5f6f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:25.506 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.506+0000 7f9e5f6f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:25.507 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.506+0000 7f9e5f6f69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:25.507 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.506+0000 7f9e5f6f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:25.507 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.506+0000 7f9e5f6f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:25.507 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.506+0000 7f9e5f6f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:25.508 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.506+0000 7f9e5f6f69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:25.508 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.506+0000 7f9e5f6f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:25.510 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.510+0000 7f9e5f6f69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:25.510 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.510+0000 7f9e5f6f69c0 20 searching for the correct realm 2024-09-12T17:24:25.513 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.514+0000 7f9e5d9fd640 0 -- 172.21.15.16:0/3915050042 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f9e480ee020 msgr2=0x7f9e480ef3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:25.730 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.730+0000 7f9e5c9fb640 0 -- 172.21.15.16:0/3915050042 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f9e5803b550 msgr2=0x7f9e5802c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:25.949 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.950+0000 7f9e5f6f69c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:24:25.949 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.950+0000 7f9e5f6f69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:25.949 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.950+0000 7f9e5f6f69c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:24:25.949 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.950+0000 7f9e5f6f69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:25.949 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.950+0000 7f9e5f6f69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:25.949 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.950+0000 7f9e5f6f69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:25.949 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.950+0000 7f9e5f6f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:25.949 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.950+0000 7f9e5f6f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:25.950 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.950+0000 7f9e5f6f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:25.950 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.950+0000 7f9e5f6f69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:25.950 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.950+0000 7f9e5f6f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:25.951 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.950+0000 7f9e5f6f69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:25.951 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.950+0000 7f9e5f6f69c0 20 zone default found 2024-09-12T17:24:25.951 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.950+0000 7f9e5f6f69c0 4 Realm: () 2024-09-12T17:24:25.951 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.950+0000 7f9e5f6f69c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:24:25.951 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.950+0000 7f9e5f6f69c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:24:25.952 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.950+0000 7f9e5f6f69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:25.952 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.950+0000 7f9e5f6f69c0 20 zonegroup default 2024-09-12T17:24:25.952 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.950+0000 7f9e5f6f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:25.952 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.950+0000 7f9e5f6f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:25.952 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.950+0000 7f9e5f6f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:25.953 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.954+0000 7f9e5f6f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:25.953 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.954+0000 7f9e5f6f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:25.953 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.954+0000 7f9e5f6f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:25.953 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.954+0000 7f9e5f6f69c0 20 started sync module instance, tier type = 2024-09-12T17:24:25.953 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.954+0000 7f9e5f6f69c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:24:25.978 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.978+0000 7f9e5f6f69c0 20 add_watcher() i=0 2024-09-12T17:24:25.978 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.978+0000 7f9e5f6f69c0 20 add_watcher() i=1 2024-09-12T17:24:25.978 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.978+0000 7f9e5f6f69c0 20 add_watcher() i=2 2024-09-12T17:24:25.979 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.978+0000 7f9e5f6f69c0 20 add_watcher() i=3 2024-09-12T17:24:25.979 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.978+0000 7f9e5f6f69c0 20 add_watcher() i=4 2024-09-12T17:24:25.979 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.978+0000 7f9e5f6f69c0 20 add_watcher() i=5 2024-09-12T17:24:25.979 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.978+0000 7f9e5f6f69c0 20 add_watcher() i=6 2024-09-12T17:24:25.981 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.982+0000 7f9e5f6f69c0 20 add_watcher() i=7 2024-09-12T17:24:25.981 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.982+0000 7f9e5f6f69c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:25.985 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.986+0000 7f9d137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:25.986 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.986+0000 7f9e5f6f69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:25.986 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.986+0000 7f9e5f6f69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:25.987 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.986+0000 7f9e5f6f69c0 5 note: GC not initialized 2024-09-12T17:24:25.987 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.986+0000 7f9d127e4640 20 reqs_thread_entry: start 2024-09-12T17:24:25.987 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.986+0000 7f9e5f6f69c0 20 init_complete bucket index max shards: 1 2024-09-12T17:24:25.988 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.986+0000 7f9e5f6f69c0 20 Filter name: none 2024-09-12T17:24:25.988 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.986+0000 7f9c83fff640 20 reqs_thread_entry: start 2024-09-12T17:24:25.988 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.986+0000 7f9e5f6f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:25.989 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.990+0000 7f9e5f6f69c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:24:25.989 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.990+0000 7f9e5f6f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:25.989 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.990+0000 7f9e5f6f69c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:24:25.989 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.990+0000 7f9e5f6f69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:25.990 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.990+0000 7f9e5f6f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:25.991 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.990+0000 7f9e5f6f69c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:24:25.991 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.990+0000 7f9e5f6f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:25.991 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.990+0000 7f9e5f6f69c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:24:25.991 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.990+0000 7f9e5f6f69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:25.994 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.994+0000 7f9d137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:25.999 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.998+0000 7f9e5f6f69c0 20 remove_watcher() i=0 2024-09-12T17:24:25.999 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:25.998+0000 7f9e5f6f69c0 2 removed watcher, disabling cache 2024-09-12T17:24:26.001 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.002+0000 7f9e5f6f69c0 20 remove_watcher() i=1 2024-09-12T17:24:26.004 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.002+0000 7f9e5f6f69c0 20 remove_watcher() i=2 2024-09-12T17:24:26.006 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.006+0000 7f9e5f6f69c0 20 remove_watcher() i=3 2024-09-12T17:24:26.008 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.010+0000 7f9e5f6f69c0 20 remove_watcher() i=4 2024-09-12T17:24:26.010 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.010+0000 7f9e5f6f69c0 20 remove_watcher() i=5 2024-09-12T17:24:26.011 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.010+0000 7f9e5f6f69c0 20 remove_watcher() i=6 2024-09-12T17:24:26.013 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.014+0000 7f9e5f6f69c0 20 remove_watcher() i=7 2024-09-12T17:24:26.029 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:24:26.029 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:24:26.029 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: a-bucket id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 num_objects: 0 size_kb: 0 num_shards: 3 2024-09-12T17:24:26.029 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:24:26.029 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-09-12T17:24:26.061 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:26.062 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:26.110 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.110+0000 7fb6d98579c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:26.112 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.110+0000 7fb6d98579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:26.113 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.110+0000 7fb6d98579c0 20 realm 2024-09-12T17:24:26.113 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.110+0000 7fb6d98579c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:26.113 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.114+0000 7fb6d98579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:26.113 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.114+0000 7fb6d98579c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:26.113 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.114+0000 7fb6d98579c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:26.113 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.114+0000 7fb6d98579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:26.113 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.114+0000 7fb6d98579c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:26.114 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.114+0000 7fb6d98579c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:26.114 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.114+0000 7fb6d98579c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:26.116 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.114+0000 7fb6d98579c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:26.116 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.114+0000 7fb6d98579c0 20 searching for the correct realm 2024-09-12T17:24:26.117 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.118+0000 7fb6d6b5c640 0 -- 172.21.15.16:0/2196746259 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7fb6c801fbc0 msgr2=0x7fb6c801e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:24:26.333 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.334+0000 7fb6d7b5e640 0 -- 172.21.15.16:0/2196746259 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fb6cc021060 msgr2=0x7fb6cc05c2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:26.351 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.350+0000 7fb6d98579c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:24:26.351 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.350+0000 7fb6d98579c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:26.351 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.350+0000 7fb6d98579c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:24:26.351 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.350+0000 7fb6d98579c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:26.351 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.350+0000 7fb6d98579c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:26.351 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.350+0000 7fb6d98579c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:26.351 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.350+0000 7fb6d98579c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:26.352 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.350+0000 7fb6d98579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:26.352 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.350+0000 7fb6d98579c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:26.352 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.354+0000 7fb6d98579c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:26.352 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.354+0000 7fb6d98579c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:26.353 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.354+0000 7fb6d98579c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:26.354 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.354+0000 7fb6d98579c0 20 zone default found 2024-09-12T17:24:26.354 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.354+0000 7fb6d98579c0 4 Realm: () 2024-09-12T17:24:26.354 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.354+0000 7fb6d98579c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:24:26.354 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.354+0000 7fb6d98579c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:24:26.354 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.354+0000 7fb6d98579c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:26.354 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.354+0000 7fb6d98579c0 20 zonegroup default 2024-09-12T17:24:26.354 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.354+0000 7fb6d98579c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:26.354 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.354+0000 7fb6d98579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:26.355 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.354+0000 7fb6d98579c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:26.355 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.354+0000 7fb6d98579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:26.355 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.354+0000 7fb6d98579c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:26.356 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.354+0000 7fb6d98579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:26.356 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.354+0000 7fb6d98579c0 20 started sync module instance, tier type = 2024-09-12T17:24:26.357 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.354+0000 7fb6d98579c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:24:26.379 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.378+0000 7fb6d98579c0 20 add_watcher() i=0 2024-09-12T17:24:26.379 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.378+0000 7fb6d98579c0 20 add_watcher() i=1 2024-09-12T17:24:26.379 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.378+0000 7fb6d98579c0 20 add_watcher() i=2 2024-09-12T17:24:26.380 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.378+0000 7fb6d98579c0 20 add_watcher() i=3 2024-09-12T17:24:26.380 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.378+0000 7fb6d98579c0 20 add_watcher() i=4 2024-09-12T17:24:26.380 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.378+0000 7fb6d98579c0 20 add_watcher() i=5 2024-09-12T17:24:26.380 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.378+0000 7fb6d98579c0 20 add_watcher() i=6 2024-09-12T17:24:26.382 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.382+0000 7fb6d98579c0 20 add_watcher() i=7 2024-09-12T17:24:26.382 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.382+0000 7fb6d98579c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:26.385 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.386+0000 7fb58dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:26.386 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.386+0000 7fb6d98579c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:26.386 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.386+0000 7fb6d98579c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:26.386 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.386+0000 7fb6d98579c0 5 note: GC not initialized 2024-09-12T17:24:26.387 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.386+0000 7fb58cfe1640 20 reqs_thread_entry: start 2024-09-12T17:24:26.387 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.386+0000 7fb6d98579c0 20 init_complete bucket index max shards: 1 2024-09-12T17:24:26.387 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.386+0000 7fb6d98579c0 20 Filter name: none 2024-09-12T17:24:26.387 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.386+0000 7fb5067fc640 20 reqs_thread_entry: start 2024-09-12T17:24:26.387 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.386+0000 7fb6d98579c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:26.387 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.386+0000 7fb6d98579c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:24:26.387 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.386+0000 7fb6d98579c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:26.388 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.390+0000 7fb6d98579c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:24:26.388 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.390+0000 7fb6d98579c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:26.390 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.390+0000 7fb58dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:26.395 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.394+0000 7fb6d98579c0 20 remove_watcher() i=0 2024-09-12T17:24:26.395 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.394+0000 7fb6d98579c0 2 removed watcher, disabling cache 2024-09-12T17:24:26.397 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.398+0000 7fb6d98579c0 20 remove_watcher() i=1 2024-09-12T17:24:26.399 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.398+0000 7fb6d98579c0 20 remove_watcher() i=2 2024-09-12T17:24:26.402 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.402+0000 7fb6d98579c0 20 remove_watcher() i=3 2024-09-12T17:24:26.404 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.402+0000 7fb6d98579c0 20 remove_watcher() i=4 2024-09-12T17:24:26.405 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.406+0000 7fb6d98579c0 20 remove_watcher() i=5 2024-09-12T17:24:26.407 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.406+0000 7fb6d98579c0 20 remove_watcher() i=6 2024-09-12T17:24:26.409 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.410+0000 7fb6d98579c0 20 remove_watcher() i=7 2024-09-12T17:24:26.426 INFO:tasks.workunit.client.0.smithi016.stderr:rados -p default.rgw.buckets.index setomapval .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-09-12T17:24:26.453 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:26.453 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:26.473 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T17:24:26.500 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:26.500 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:26.545 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.546+0000 7f23e0e809c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:26.547 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.546+0000 7f23e0e809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:26.547 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.546+0000 7f23e0e809c0 20 realm 2024-09-12T17:24:26.547 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.546+0000 7f23e0e809c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:26.547 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.546+0000 7f23e0e809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:26.548 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.546+0000 7f23e0e809c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:26.548 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.546+0000 7f23e0e809c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:26.548 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.546+0000 7f23e0e809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:26.548 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.546+0000 7f23e0e809c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:26.549 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.550+0000 7f23e0e809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:26.549 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.550+0000 7f23e0e809c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:26.551 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.550+0000 7f23e0e809c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:26.551 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.550+0000 7f23e0e809c0 20 searching for the correct realm 2024-09-12T17:24:26.554 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.554+0000 7f23df187640 0 -- 172.21.15.16:0/2644295015 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f23d4017020 msgr2=0x7f23d40857b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:26.562 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.562+0000 7f23de185640 0 -- 172.21.15.16:0/2644295015 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f23d804b040 msgr2=0x7f23d804b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:26.780 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.778+0000 7f23e0e809c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:24:26.780 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.778+0000 7f23e0e809c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:26.780 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.778+0000 7f23e0e809c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:24:26.780 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.778+0000 7f23e0e809c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:26.780 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.778+0000 7f23e0e809c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:26.780 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.778+0000 7f23e0e809c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:26.780 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.778+0000 7f23e0e809c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:26.781 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.778+0000 7f23e0e809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:26.781 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.778+0000 7f23e0e809c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:26.781 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.782+0000 7f23e0e809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:26.781 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.782+0000 7f23e0e809c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:26.782 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.782+0000 7f23e0e809c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:26.782 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.782+0000 7f23e0e809c0 20 zone default found 2024-09-12T17:24:26.782 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.782+0000 7f23e0e809c0 4 Realm: () 2024-09-12T17:24:26.782 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.782+0000 7f23e0e809c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:24:26.782 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.782+0000 7f23e0e809c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:24:26.782 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.782+0000 7f23e0e809c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:26.782 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.782+0000 7f23e0e809c0 20 zonegroup default 2024-09-12T17:24:26.782 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.782+0000 7f23e0e809c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:26.783 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.782+0000 7f23e0e809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:26.783 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.782+0000 7f23e0e809c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:26.783 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.782+0000 7f23e0e809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:26.783 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.782+0000 7f23e0e809c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:26.784 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.782+0000 7f23e0e809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:26.784 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.782+0000 7f23e0e809c0 20 started sync module instance, tier type = 2024-09-12T17:24:26.784 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.782+0000 7f23e0e809c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:24:26.808 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.806+0000 7f23e0e809c0 20 add_watcher() i=0 2024-09-12T17:24:26.808 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.806+0000 7f23e0e809c0 20 add_watcher() i=1 2024-09-12T17:24:26.808 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.806+0000 7f23e0e809c0 20 add_watcher() i=2 2024-09-12T17:24:26.808 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.806+0000 7f23e0e809c0 20 add_watcher() i=3 2024-09-12T17:24:26.808 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.806+0000 7f23e0e809c0 20 add_watcher() i=4 2024-09-12T17:24:26.808 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.806+0000 7f23e0e809c0 20 add_watcher() i=5 2024-09-12T17:24:26.808 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.806+0000 7f23e0e809c0 20 add_watcher() i=6 2024-09-12T17:24:26.811 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.810+0000 7f23e0e809c0 20 add_watcher() i=7 2024-09-12T17:24:26.811 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.810+0000 7f23e0e809c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:26.815 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.814+0000 7f2295fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:26.816 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.814+0000 7f23e0e809c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:26.816 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.814+0000 7f23e0e809c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:26.816 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.814+0000 7f23e0e809c0 5 note: GC not initialized 2024-09-12T17:24:26.817 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.818+0000 7f2294fe1640 20 reqs_thread_entry: start 2024-09-12T17:24:26.817 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.818+0000 7f23e0e809c0 20 init_complete bucket index max shards: 1 2024-09-12T17:24:26.817 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.818+0000 7f23e0e809c0 20 Filter name: none 2024-09-12T17:24:26.817 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.818+0000 7f228dffb640 20 reqs_thread_entry: start 2024-09-12T17:24:26.817 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.818+0000 7f23e0e809c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:26.818 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.818+0000 7f23e0e809c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:24:26.818 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.818+0000 7f23e0e809c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:26.819 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.818+0000 7f23e0e809c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:24:26.819 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.818+0000 7f23e0e809c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:26.819 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.818+0000 7f23e0e809c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-12T17:24:26.820 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.818+0000 7f23e0e809c0 20 INFO: main: starting shard=0 2024-09-12T17:24:26.820 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.818+0000 7f23e0e809c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.0 2024-09-12T17:24:26.820 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.818+0000 7f23e0e809c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.0 2024-09-12T17:24:26.820 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.818+0000 7f23e0e809c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:24:26.820 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.822+0000 7f23e0e809c0 20 INFO: main: starting shard=1 2024-09-12T17:24:26.820 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.822+0000 7f23e0e809c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.1 2024-09-12T17:24:26.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.822+0000 7f23e0e809c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.1 2024-09-12T17:24:26.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.822+0000 7f23e0e809c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:26.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.822+0000 7f23e0e809c0 20 INFO: main: starting shard=2 2024-09-12T17:24:26.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.822+0000 7f23e0e809c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.2 2024-09-12T17:24:26.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.822+0000 7f23e0e809c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.2 2024-09-12T17:24:26.822 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.822+0000 7f23e0e809c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:26.822 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.822+0000 7f23e0e809c0 20 INFO: main: done 2024-09-12T17:24:26.824 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.822+0000 7f2295fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:26.829 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.830+0000 7f23e0e809c0 20 remove_watcher() i=0 2024-09-12T17:24:26.829 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.830+0000 7f23e0e809c0 2 removed watcher, disabling cache 2024-09-12T17:24:26.831 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.830+0000 7f23e0e809c0 20 remove_watcher() i=1 2024-09-12T17:24:26.834 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.834+0000 7f23e0e809c0 20 remove_watcher() i=2 2024-09-12T17:24:26.836 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.834+0000 7f23e0e809c0 20 remove_watcher() i=3 2024-09-12T17:24:26.838 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.838+0000 7f23e0e809c0 20 remove_watcher() i=4 2024-09-12T17:24:26.840 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.842+0000 7f23e0e809c0 20 remove_watcher() i=5 2024-09-12T17:24:26.842 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.842+0000 7f23e0e809c0 20 remove_watcher() i=6 2024-09-12T17:24:26.843 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.842+0000 7f23e0e809c0 20 remove_watcher() i=7 2024-09-12T17:24:26.870 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-09-12T17:24:26.903 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:26.904 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:26.952 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.950+0000 7f563b89b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:26.954 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.954+0000 7f563b89b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:26.954 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.954+0000 7f563b89b9c0 20 realm 2024-09-12T17:24:26.954 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.954+0000 7f563b89b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:26.954 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.954+0000 7f563b89b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:26.954 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.954+0000 7f563b89b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:26.954 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.954+0000 7f563b89b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:26.954 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.954+0000 7f563b89b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:26.954 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.954+0000 7f563b89b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:26.956 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.954+0000 7f563b89b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:26.956 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.954+0000 7f563b89b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:26.958 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.958+0000 7f563b89b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:26.958 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:26.958+0000 7f563b89b9c0 20 searching for the correct realm 2024-09-12T17:24:27.164 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.162+0000 7f5639ba2640 0 -- 172.21.15.16:0/2221739033 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f563004a070 msgr2=0x7f5630072040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:24:27.378 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.378+0000 7f5638ba0640 0 -- 172.21.15.16:0/2221739033 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f56340d9920 msgr2=0x7f56340be3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:27.597 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.598+0000 7f563b89b9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:24:27.597 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.598+0000 7f563b89b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:27.597 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.598+0000 7f563b89b9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:24:27.597 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.598+0000 7f563b89b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:27.597 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.598+0000 7f563b89b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:27.597 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.598+0000 7f563b89b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:27.598 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.598+0000 7f563b89b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:27.598 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.598+0000 7f563b89b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:27.598 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.598+0000 7f563b89b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:27.599 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.598+0000 7f563b89b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:27.599 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.598+0000 7f563b89b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:27.600 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.598+0000 7f563b89b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:27.600 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.598+0000 7f563b89b9c0 20 zone default found 2024-09-12T17:24:27.600 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.598+0000 7f563b89b9c0 4 Realm: () 2024-09-12T17:24:27.600 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.598+0000 7f563b89b9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:24:27.600 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.598+0000 7f563b89b9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:24:27.600 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.598+0000 7f563b89b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:27.600 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.598+0000 7f563b89b9c0 20 zonegroup default 2024-09-12T17:24:27.600 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.598+0000 7f563b89b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:27.601 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.602+0000 7f563b89b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:27.601 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.602+0000 7f563b89b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:27.601 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.602+0000 7f563b89b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:27.601 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.602+0000 7f563b89b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:27.602 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.602+0000 7f563b89b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:27.602 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.602+0000 7f563b89b9c0 20 started sync module instance, tier type = 2024-09-12T17:24:27.602 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.602+0000 7f563b89b9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:24:27.628 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.626+0000 7f563b89b9c0 20 add_watcher() i=0 2024-09-12T17:24:27.628 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.626+0000 7f563b89b9c0 20 add_watcher() i=1 2024-09-12T17:24:27.628 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.626+0000 7f563b89b9c0 20 add_watcher() i=2 2024-09-12T17:24:27.628 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.626+0000 7f563b89b9c0 20 add_watcher() i=3 2024-09-12T17:24:27.628 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.626+0000 7f563b89b9c0 20 add_watcher() i=4 2024-09-12T17:24:27.628 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.626+0000 7f563b89b9c0 20 add_watcher() i=5 2024-09-12T17:24:27.628 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.626+0000 7f563b89b9c0 20 add_watcher() i=6 2024-09-12T17:24:27.630 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.630+0000 7f563b89b9c0 20 add_watcher() i=7 2024-09-12T17:24:27.630 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.630+0000 7f563b89b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:27.634 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.634+0000 7f54ef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:27.635 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.634+0000 7f563b89b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:27.635 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.634+0000 7f563b89b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:27.635 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.634+0000 7f563b89b9c0 5 note: GC not initialized 2024-09-12T17:24:27.636 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.634+0000 7f54ee7e4640 20 reqs_thread_entry: start 2024-09-12T17:24:27.636 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.634+0000 7f563b89b9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:24:27.637 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.638+0000 7f563b89b9c0 20 Filter name: none 2024-09-12T17:24:27.637 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.638+0000 7f545ffff640 20 reqs_thread_entry: start 2024-09-12T17:24:27.637 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.638+0000 7f563b89b9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:24:27.637 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.638+0000 7f563b89b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:27.638 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.638+0000 7f563b89b9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:24:27.638 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.638+0000 7f563b89b9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:24:27.638 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.638+0000 7f563b89b9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:24:27.638 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.638+0000 7f563b89b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 : miss 2024-09-12T17:24:27.638 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.638+0000 7f563b89b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:27.639 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.638+0000 7f563b89b9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:24:27.639 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.638+0000 7f563b89b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:24:27.639 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.638+0000 7f563b89b9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:24:27.639 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.638+0000 7f563b89b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:24:27.639 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.638+0000 7f563b89b9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:24:27.639 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.638+0000 7f563b89b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 2024-09-12T17:24:27.645 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.646+0000 7f563b89b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:24:27.645 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.646+0000 7f563b89b9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:24:27.646 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.646+0000 7f563b89b9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:24:27.646 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.646+0000 7f563b89b9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17, ofs0, ns] 2024-09-12T17:24:27.646 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.646+0000 7f550bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431633 cookie 94706485381344 notifier 8517 bl.length()=827 2024-09-12T17:24:27.646 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.646+0000 7f550bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:24:27.646 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.646+0000 7f550bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:24:27.646 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.646+0000 7f550bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:24:27.647 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.646+0000 7f563b89b9c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): orig_sources= new_sources= 2024-09-12T17:24:27.647 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.646+0000 7f563b89b9c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): potential sources added=[] removed=[] 2024-09-12T17:24:27.647 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.646+0000 7f563b89b9c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): orig_dests= new_dests= 2024-09-12T17:24:27.647 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.646+0000 7f563b89b9c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): potential dests added=[] removed=[] 2024-09-12T17:24:27.652 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.654+0000 7f563b89b9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.3.0 2024-09-12T17:24:27.653 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.654+0000 7f563b89b9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.3.0 2024-09-12T17:24:27.653 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.654+0000 7f563b89b9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.0 2024-09-12T17:24:27.653 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.654+0000 7f563b89b9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.0 2024-09-12T17:24:27.653 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.654+0000 7f563b89b9c0 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-09-12T17:24:27.653 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.654+0000 7f563b89b9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.1 2024-09-12T17:24:27.654 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.654+0000 7f563b89b9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.1 2024-09-12T17:24:27.654 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.654+0000 7f563b89b9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.2 2024-09-12T17:24:27.654 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.654+0000 7f563b89b9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.2 2024-09-12T17:24:27.655 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.654+0000 7f563b89b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 : hit (requested=0x17, cached=0x17) 2024-09-12T17:24:27.655 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.654+0000 7f563b89b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 2024-09-12T17:24:27.657 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.658+0000 7f563b89b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:24:27.657 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.658+0000 7f563b89b9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:24:27.657 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.658+0000 7f563b89b9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:24:27.657 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.658+0000 7f563b89b9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17, ofs0, ns] 2024-09-12T17:24:27.658 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.658+0000 7f550bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431634 cookie 94706485381344 notifier 8517 bl.length()=827 2024-09-12T17:24:27.658 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.658+0000 7f550bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:24:27.658 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.658+0000 7f550bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:24:27.658 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.658+0000 7f550bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:24:27.659 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.658+0000 7f563b89b9c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): orig_sources= new_sources= 2024-09-12T17:24:27.659 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.658+0000 7f563b89b9c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): potential sources added=[] removed=[] 2024-09-12T17:24:27.659 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.658+0000 7f563b89b9c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): orig_dests= new_dests= 2024-09-12T17:24:27.659 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.658+0000 7f563b89b9c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): potential dests added=[] removed=[] 2024-09-12T17:24:27.662 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.662+0000 7f563b89b9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.0 2024-09-12T17:24:27.662 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.662+0000 7f563b89b9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.0 2024-09-12T17:24:27.662 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.662+0000 7f563b89b9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.1 2024-09-12T17:24:27.662 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.662+0000 7f563b89b9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.1 2024-09-12T17:24:27.663 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.662+0000 7f563b89b9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.2 2024-09-12T17:24:27.663 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.662+0000 7f563b89b9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.2.2 2024-09-12T17:24:27.664 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.662+0000 7f563b89b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 : hit (requested=0x17, cached=0x17) 2024-09-12T17:24:27.664 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.662+0000 7f563b89b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 2024-09-12T17:24:27.666 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.666+0000 7f563b89b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:24:27.666 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.666+0000 7f563b89b9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:24:27.666 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.666+0000 7f563b89b9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:24:27.666 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.666+0000 7f563b89b9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17, ofs0, ns] 2024-09-12T17:24:27.667 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.666+0000 7f551cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431635 cookie 94706485381344 notifier 8517 bl.length()=795 2024-09-12T17:24:27.667 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.666+0000 7f551cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 info.flags=0x17 2024-09-12T17:24:27.667 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.666+0000 7f551cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17 to cache LRU end 2024-09-12T17:24:27.667 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.666+0000 7f551cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:24:27.668 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.670+0000 7f563b89b9c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): orig_sources= new_sources= 2024-09-12T17:24:27.668 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.670+0000 7f563b89b9c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): potential sources added=[] removed=[] 2024-09-12T17:24:27.668 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.670+0000 7f563b89b9c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): orig_dests= new_dests= 2024-09-12T17:24:27.668 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.670+0000 7f563b89b9c0 20 handle_bi_update(): bucket=:a-bucket[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17]): potential dests added=[] removed=[] 2024-09-12T17:24:27.672 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.670+0000 7f563b89b9c0 1 execute INFO: reshard of bucket "a-bucket" from 3 shards to 1 shards completed successfully 2024-09-12T17:24:27.674 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.674+0000 7f54ef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:27.680 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.678+0000 7f563b89b9c0 20 remove_watcher() i=0 2024-09-12T17:24:27.680 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.678+0000 7f563b89b9c0 2 removed watcher, disabling cache 2024-09-12T17:24:27.682 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.682+0000 7f563b89b9c0 20 remove_watcher() i=1 2024-09-12T17:24:27.684 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.682+0000 7f563b89b9c0 20 remove_watcher() i=2 2024-09-12T17:24:27.686 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.686+0000 7f563b89b9c0 20 remove_watcher() i=3 2024-09-12T17:24:27.688 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.686+0000 7f563b89b9c0 20 remove_watcher() i=4 2024-09-12T17:24:27.689 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.690+0000 7f563b89b9c0 20 remove_watcher() i=5 2024-09-12T17:24:27.690 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.690+0000 7f563b89b9c0 20 remove_watcher() i=6 2024-09-12T17:24:27.692 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.694+0000 7f563b89b9c0 20 remove_watcher() i=7 2024-09-12T17:24:27.707 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T17:24:27.738 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:27.738 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:27.784 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.786+0000 7f18df9189c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:27.787 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.786+0000 7f18df9189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:27.787 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.786+0000 7f18df9189c0 20 realm 2024-09-12T17:24:27.787 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.786+0000 7f18df9189c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:27.787 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.786+0000 7f18df9189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:27.787 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.786+0000 7f18df9189c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:27.787 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.786+0000 7f18df9189c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:27.787 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.786+0000 7f18df9189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:27.787 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.786+0000 7f18df9189c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:27.789 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.790+0000 7f18df9189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:27.789 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.790+0000 7f18df9189c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:27.790 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.790+0000 7f18df9189c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:27.790 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.790+0000 7f18df9189c0 20 searching for the correct realm 2024-09-12T17:24:27.793 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.794+0000 7f18ddc1f640 0 -- 172.21.15.16:0/1003065501 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f18d4008050 msgr2=0x7f18d4008ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:27.803 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:27.802+0000 7f18dcc1d640 0 -- 172.21.15.16:0/1003065501 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f18d8024040 msgr2=0x7f18d8060950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:24:28.021 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.018+0000 7f18df9189c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:24:28.021 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.018+0000 7f18df9189c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:28.021 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.018+0000 7f18df9189c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:24:28.021 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.018+0000 7f18df9189c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:28.021 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.018+0000 7f18df9189c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:28.021 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.018+0000 7f18df9189c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:28.021 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.022+0000 7f18df9189c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.021 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.022+0000 7f18df9189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:28.021 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.022+0000 7f18df9189c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.022 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.022+0000 7f18df9189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:28.022 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.022+0000 7f18df9189c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.023 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.022+0000 7f18df9189c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:28.023 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.022+0000 7f18df9189c0 20 zone default found 2024-09-12T17:24:28.023 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.022+0000 7f18df9189c0 4 Realm: () 2024-09-12T17:24:28.023 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.022+0000 7f18df9189c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:24:28.023 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.022+0000 7f18df9189c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:24:28.023 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.022+0000 7f18df9189c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:28.024 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.022+0000 7f18df9189c0 20 zonegroup default 2024-09-12T17:24:28.024 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.022+0000 7f18df9189c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.024 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.022+0000 7f18df9189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:28.024 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.022+0000 7f18df9189c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.025 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.026+0000 7f18df9189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:28.025 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.026+0000 7f18df9189c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.025 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.026+0000 7f18df9189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:28.025 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.026+0000 7f18df9189c0 20 started sync module instance, tier type = 2024-09-12T17:24:28.026 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.026+0000 7f18df9189c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:24:28.050 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.050+0000 7f18df9189c0 20 add_watcher() i=0 2024-09-12T17:24:28.051 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.050+0000 7f18df9189c0 20 add_watcher() i=1 2024-09-12T17:24:28.051 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.050+0000 7f18df9189c0 20 add_watcher() i=2 2024-09-12T17:24:28.051 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.050+0000 7f18df9189c0 20 add_watcher() i=3 2024-09-12T17:24:28.051 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.050+0000 7f18df9189c0 20 add_watcher() i=4 2024-09-12T17:24:28.051 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.050+0000 7f18df9189c0 20 add_watcher() i=5 2024-09-12T17:24:28.051 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.050+0000 7f18df9189c0 20 add_watcher() i=6 2024-09-12T17:24:28.053 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.054+0000 7f18df9189c0 20 add_watcher() i=7 2024-09-12T17:24:28.053 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.054+0000 7f18df9189c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:28.058 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.058+0000 7f1793fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:28.059 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.058+0000 7f18df9189c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:28.059 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.058+0000 7f18df9189c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:28.059 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.058+0000 7f18df9189c0 5 note: GC not initialized 2024-09-12T17:24:28.060 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.058+0000 7f1792fe5640 20 reqs_thread_entry: start 2024-09-12T17:24:28.060 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.058+0000 7f18df9189c0 20 init_complete bucket index max shards: 1 2024-09-12T17:24:28.060 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.058+0000 7f18df9189c0 20 Filter name: none 2024-09-12T17:24:28.060 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.058+0000 7f1790fe1640 20 reqs_thread_entry: start 2024-09-12T17:24:28.060 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.058+0000 7f18df9189c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.061 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.062+0000 7f18df9189c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:24:28.061 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.062+0000 7f18df9189c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.062 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.062+0000 7f18df9189c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:24:28.062 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.062+0000 7f18df9189c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:28.062 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.062+0000 7f18df9189c0 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-09-12T17:24:28.062 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.062+0000 7f18df9189c0 20 INFO: main: starting shard=0 2024-09-12T17:24:28.062 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.062+0000 7f18df9189c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.3.0 2024-09-12T17:24:28.062 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.062+0000 7f18df9189c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17.3.0 2024-09-12T17:24:28.064 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.062+0000 7f18df9189c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:28.064 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.062+0000 7f18df9189c0 20 INFO: main: done 2024-09-12T17:24:28.065 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.066+0000 7f1793fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:28.070 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.070+0000 7f18df9189c0 20 remove_watcher() i=0 2024-09-12T17:24:28.070 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.070+0000 7f18df9189c0 2 removed watcher, disabling cache 2024-09-12T17:24:28.073 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.074+0000 7f18df9189c0 20 remove_watcher() i=1 2024-09-12T17:24:28.075 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.074+0000 7f18df9189c0 20 remove_watcher() i=2 2024-09-12T17:24:28.078 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.078+0000 7f18df9189c0 20 remove_watcher() i=3 2024-09-12T17:24:28.080 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.078+0000 7f18df9189c0 20 remove_watcher() i=4 2024-09-12T17:24:28.082 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.082+0000 7f18df9189c0 20 remove_watcher() i=5 2024-09-12T17:24:28.084 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.082+0000 7f18df9189c0 20 remove_watcher() i=6 2024-09-12T17:24:28.086 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.086+0000 7f18df9189c0 20 remove_watcher() i=7 2024-09-12T17:24:28.107 INFO:tasks.workunit.client.0.smithi016.stderr: test: PUT succeeds during reshard 2024-09-12T17:24:28.108 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T17:24:28.136 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:28.136 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:28.185 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.186+0000 7f5ece87c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.187 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.186+0000 7f5ece87c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:28.187 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.186+0000 7f5ece87c9c0 20 realm 2024-09-12T17:24:28.187 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.186+0000 7f5ece87c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.187 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.186+0000 7f5ece87c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:28.187 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.186+0000 7f5ece87c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:28.187 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.186+0000 7f5ece87c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.188 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.186+0000 7f5ece87c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:28.188 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.186+0000 7f5ece87c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.189 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.190+0000 7f5ece87c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:28.189 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.190+0000 7f5ece87c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.191 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.190+0000 7f5ece87c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:28.191 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.190+0000 7f5ece87c9c0 20 searching for the correct realm 2024-09-12T17:24:28.195 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.194+0000 7f5eccb83640 0 -- 172.21.15.16:0/2141424284 >> [v2:172.21.15.19:6800/1509147557,v1:172.21.15.19:6801/1509147557] conn(0x55ff3f8f9860 msgr2=0x55ff3f8fbc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:28.201 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.202+0000 7f5ecbb81640 0 -- 172.21.15.16:0/2141424284 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f5ec4123030 msgr2=0x7f5ec40c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:28.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.422+0000 7f5ece87c9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:24:28.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.422+0000 7f5ece87c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:28.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.422+0000 7f5ece87c9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:24:28.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.422+0000 7f5ece87c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:28.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.422+0000 7f5ece87c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:28.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.422+0000 7f5ece87c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:28.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.422+0000 7f5ece87c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.422 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.422+0000 7f5ece87c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:28.422 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.422+0000 7f5ece87c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.422 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.422+0000 7f5ece87c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:28.422 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.422+0000 7f5ece87c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.423 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.422+0000 7f5ece87c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:28.423 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.422+0000 7f5ece87c9c0 20 zone default found 2024-09-12T17:24:28.423 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.422+0000 7f5ece87c9c0 4 Realm: () 2024-09-12T17:24:28.423 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.422+0000 7f5ece87c9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:24:28.424 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.422+0000 7f5ece87c9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:24:28.424 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.422+0000 7f5ece87c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:28.424 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.422+0000 7f5ece87c9c0 20 zonegroup default 2024-09-12T17:24:28.424 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.422+0000 7f5ece87c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.424 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.422+0000 7f5ece87c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:28.424 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.422+0000 7f5ece87c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.424 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.426+0000 7f5ece87c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:28.425 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.426+0000 7f5ece87c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.425 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.426+0000 7f5ece87c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:28.425 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.426+0000 7f5ece87c9c0 20 started sync module instance, tier type = 2024-09-12T17:24:28.425 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.426+0000 7f5ece87c9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:24:28.450 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.450+0000 7f5ece87c9c0 20 add_watcher() i=0 2024-09-12T17:24:28.450 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.450+0000 7f5ece87c9c0 20 add_watcher() i=1 2024-09-12T17:24:28.450 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.450+0000 7f5ece87c9c0 20 add_watcher() i=2 2024-09-12T17:24:28.450 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.450+0000 7f5ece87c9c0 20 add_watcher() i=3 2024-09-12T17:24:28.450 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.450+0000 7f5ece87c9c0 20 add_watcher() i=4 2024-09-12T17:24:28.450 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.450+0000 7f5ece87c9c0 20 add_watcher() i=5 2024-09-12T17:24:28.450 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.450+0000 7f5ece87c9c0 20 add_watcher() i=6 2024-09-12T17:24:28.453 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.454+0000 7f5ece87c9c0 20 add_watcher() i=7 2024-09-12T17:24:28.453 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.454+0000 7f5ece87c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:28.457 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.458+0000 7f5d827e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:28.458 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.458+0000 7f5ece87c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:28.458 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.458+0000 7f5ece87c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:28.458 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.458+0000 7f5ece87c9c0 5 note: GC not initialized 2024-09-12T17:24:28.459 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.458+0000 7f5d817e2640 20 reqs_thread_entry: start 2024-09-12T17:24:28.459 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.458+0000 7f5ece87c9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:24:28.459 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.458+0000 7f5ece87c9c0 20 Filter name: none 2024-09-12T17:24:28.459 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.458+0000 7f5cf2ffd640 20 reqs_thread_entry: start 2024-09-12T17:24:28.459 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.458+0000 7f5ece87c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.460 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.458+0000 7f5ece87c9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T17:24:28.460 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.458+0000 7f5ece87c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.462 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.462+0000 7f5ece87c9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T17:24:28.462 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.462+0000 7f5ece87c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:28.462 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.462+0000 7f5ece87c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.462 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.462+0000 7f5ece87c9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T17:24:28.462 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.462+0000 7f5ece87c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.463 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.462+0000 7f5ece87c9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T17:24:28.463 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.462+0000 7f5ece87c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:28.466 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.466+0000 7f5d827e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:28.471 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.470+0000 7f5ece87c9c0 20 remove_watcher() i=0 2024-09-12T17:24:28.471 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.470+0000 7f5ece87c9c0 2 removed watcher, disabling cache 2024-09-12T17:24:28.474 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.474+0000 7f5ece87c9c0 20 remove_watcher() i=1 2024-09-12T17:24:28.476 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.474+0000 7f5ece87c9c0 20 remove_watcher() i=2 2024-09-12T17:24:28.478 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.478+0000 7f5ece87c9c0 20 remove_watcher() i=3 2024-09-12T17:24:28.481 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.482+0000 7f5ece87c9c0 20 remove_watcher() i=4 2024-09-12T17:24:28.483 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.482+0000 7f5ece87c9c0 20 remove_watcher() i=5 2024-09-12T17:24:28.485 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.486+0000 7f5ece87c9c0 20 remove_watcher() i=6 2024-09-12T17:24:28.487 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.486+0000 7f5ece87c9c0 20 remove_watcher() i=7 2024-09-12T17:24:28.503 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:24:28.503 INFO:tasks.workunit.client.0.smithi016.stderr:BUCKET_STATS: 2024-09-12T17:24:28.503 INFO:tasks.workunit.client.0.smithi016.stderr:bucket: myver id: 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 num_objects: 0 size_kb: 0 num_shards: 2 2024-09-12T17:24:28.503 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:24:28.503 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 3 2024-09-12T17:24:28.535 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:28.536 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:28.584 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.582+0000 7f20c7e309c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.585 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.586+0000 7f20c7e309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:28.585 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.586+0000 7f20c7e309c0 20 realm 2024-09-12T17:24:28.585 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.586+0000 7f20c7e309c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.585 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.586+0000 7f20c7e309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:28.586 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.586+0000 7f20c7e309c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:28.586 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.586+0000 7f20c7e309c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.586 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.586+0000 7f20c7e309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:28.586 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.586+0000 7f20c7e309c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.587 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.586+0000 7f20c7e309c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:28.587 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.586+0000 7f20c7e309c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.589 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.590+0000 7f20c7e309c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:28.589 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.590+0000 7f20c7e309c0 20 searching for the correct realm 2024-09-12T17:24:28.590 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.590+0000 7f20c5135640 0 -- 172.21.15.16:0/3276901433 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7f20b802f040 msgr2=0x7f20b8022410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:24:28.804 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.802+0000 7f20c6137640 0 -- 172.21.15.16:0/3276901433 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f20bc0b9020 msgr2=0x7f20bc0bb400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:28.823 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.822+0000 7f20c7e309c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:24:28.824 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.822+0000 7f20c7e309c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:28.824 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.822+0000 7f20c7e309c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:24:28.824 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.822+0000 7f20c7e309c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:28.824 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.822+0000 7f20c7e309c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:28.824 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.822+0000 7f20c7e309c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:28.824 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.822+0000 7f20c7e309c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.824 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.822+0000 7f20c7e309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:28.824 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.822+0000 7f20c7e309c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.825 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.822+0000 7f20c7e309c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:28.825 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.822+0000 7f20c7e309c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.825 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.826+0000 7f20c7e309c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:28.825 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.826+0000 7f20c7e309c0 20 zone default found 2024-09-12T17:24:28.825 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.826+0000 7f20c7e309c0 4 Realm: () 2024-09-12T17:24:28.825 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.826+0000 7f20c7e309c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:24:28.826 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.826+0000 7f20c7e309c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:24:28.826 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.826+0000 7f20c7e309c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:28.826 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.826+0000 7f20c7e309c0 20 zonegroup default 2024-09-12T17:24:28.826 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.826+0000 7f20c7e309c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.826 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.826+0000 7f20c7e309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:28.826 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.826+0000 7f20c7e309c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.827 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.826+0000 7f20c7e309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:28.827 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.826+0000 7f20c7e309c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.827 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.826+0000 7f20c7e309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:28.827 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.826+0000 7f20c7e309c0 20 started sync module instance, tier type = 2024-09-12T17:24:28.827 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.826+0000 7f20c7e309c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:24:28.850 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.850+0000 7f20c7e309c0 20 add_watcher() i=0 2024-09-12T17:24:28.850 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.850+0000 7f20c7e309c0 20 add_watcher() i=1 2024-09-12T17:24:28.850 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.850+0000 7f20c7e309c0 20 add_watcher() i=2 2024-09-12T17:24:28.850 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.850+0000 7f20c7e309c0 20 add_watcher() i=3 2024-09-12T17:24:28.850 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.850+0000 7f20c7e309c0 20 add_watcher() i=4 2024-09-12T17:24:28.850 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.850+0000 7f20c7e309c0 20 add_watcher() i=5 2024-09-12T17:24:28.851 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.850+0000 7f20c7e309c0 20 add_watcher() i=6 2024-09-12T17:24:28.852 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.850+0000 7f20c7e309c0 20 add_watcher() i=7 2024-09-12T17:24:28.852 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.850+0000 7f20c7e309c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:28.856 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.854+0000 7f1f7bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:28.857 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.858+0000 7f20c7e309c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:28.857 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.858+0000 7f20c7e309c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:28.857 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.858+0000 7f20c7e309c0 5 note: GC not initialized 2024-09-12T17:24:28.858 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.858+0000 7f1f7afe5640 20 reqs_thread_entry: start 2024-09-12T17:24:28.858 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.858+0000 7f20c7e309c0 20 init_complete bucket index max shards: 1 2024-09-12T17:24:28.858 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.858+0000 7f20c7e309c0 20 Filter name: none 2024-09-12T17:24:28.858 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.858+0000 7f1f78fe1640 20 reqs_thread_entry: start 2024-09-12T17:24:28.858 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.858+0000 7f20c7e309c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T17:24:28.858 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.858+0000 7f20c7e309c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.859 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.858+0000 7f20c7e309c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T17:24:28.859 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.858+0000 7f20c7e309c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T17:24:28.859 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.858+0000 7f20c7e309c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T17:24:28.859 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.858+0000 7f20c7e309c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 : miss 2024-09-12T17:24:28.859 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.858+0000 7f20c7e309c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:28.860 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.858+0000 7f20c7e309c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T17:24:28.860 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.858+0000 7f20c7e309c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 info.flags=0x17 2024-09-12T17:24:28.860 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.858+0000 7f20c7e309c0 10 adding default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 to cache LRU end 2024-09-12T17:24:28.860 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.858+0000 7f20c7e309c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:24:28.860 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.858+0000 7f20c7e309c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:24:28.860 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.858+0000 7f20c7e309c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 2024-09-12T17:24:28.869 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.870+0000 7f20c7e309c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 info.flags=0x17 2024-09-12T17:24:28.869 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.870+0000 7f20c7e309c0 10 moving default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 to cache LRU end 2024-09-12T17:24:28.869 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.870+0000 7f20c7e309c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:24:28.869 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.870+0000 7f20c7e309c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18, ofs0, ns] 2024-09-12T17:24:28.870 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.870+0000 7f1fa8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431603 cookie 94369343708544 notifier 8117 bl.length()=821 2024-09-12T17:24:28.870 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.870+0000 7f1fa8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 info.flags=0x17 2024-09-12T17:24:28.870 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.870+0000 7f1fa8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 to cache LRU end 2024-09-12T17:24:28.870 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.870+0000 7f1fa8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:24:28.870 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.870+0000 7f20c7e309c0 20 handle_bi_update(): bucket=:myver[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18]): orig_sources= new_sources= 2024-09-12T17:24:28.870 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.870+0000 7f20c7e309c0 20 handle_bi_update(): bucket=:myver[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18]): potential sources added=[] removed=[] 2024-09-12T17:24:28.870 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.870+0000 7f20c7e309c0 20 handle_bi_update(): bucket=:myver[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18]): orig_dests= new_dests= 2024-09-12T17:24:28.870 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.870+0000 7f20c7e309c0 20 handle_bi_update(): bucket=:myver[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18]): potential dests added=[] removed=[] 2024-09-12T17:24:28.877 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:28.878+0000 7f20c7e309c0 -1 Injecting delay=5.000000000s at location=do_reshard 2024-09-12T17:24:29.541 INFO:tasks.workunit.client.0.smithi016.stderr:put object successful 2024-09-12T17:24:33.878 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.878+0000 7f20c7e309c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.2.0 2024-09-12T17:24:33.878 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.878+0000 7f20c7e309c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.2.0 2024-09-12T17:24:33.878 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.878+0000 7f20c7e309c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.2.1 2024-09-12T17:24:33.878 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.878+0000 7f20c7e309c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.2.1 2024-09-12T17:24:33.878 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.878+0000 7f20c7e309c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.2.2 2024-09-12T17:24:33.878 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.878+0000 7f20c7e309c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.2.2 2024-09-12T17:24:33.878 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.878+0000 7f20c7e309c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.1.0 2024-09-12T17:24:33.879 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.878+0000 7f20c7e309c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.1.0 2024-09-12T17:24:33.879 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.878+0000 7f20c7e309c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.1.1 2024-09-12T17:24:33.879 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.878+0000 7f20c7e309c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.1.1 2024-09-12T17:24:33.885 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.886+0000 7f20c7e309c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 : hit (requested=0x17, cached=0x17) 2024-09-12T17:24:33.885 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.886+0000 7f20c7e309c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 2024-09-12T17:24:33.889 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.890+0000 7f20c7e309c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 info.flags=0x17 2024-09-12T17:24:33.889 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.890+0000 7f20c7e309c0 10 moving default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 to cache LRU end 2024-09-12T17:24:33.889 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.890+0000 7f20c7e309c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:24:33.889 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.890+0000 7f20c7e309c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18, ofs0, ns] 2024-09-12T17:24:33.890 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.890+0000 7f1fa8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431604 cookie 94369343708544 notifier 8117 bl.length()=821 2024-09-12T17:24:33.890 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.890+0000 7f1fa8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 info.flags=0x17 2024-09-12T17:24:33.890 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.890+0000 7f1fa8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 to cache LRU end 2024-09-12T17:24:33.890 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.890+0000 7f1fa8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:24:33.891 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.890+0000 7f20c7e309c0 20 handle_bi_update(): bucket=:myver[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18]): orig_sources= new_sources= 2024-09-12T17:24:33.891 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.890+0000 7f20c7e309c0 20 handle_bi_update(): bucket=:myver[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18]): potential sources added=[] removed=[] 2024-09-12T17:24:33.891 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.890+0000 7f20c7e309c0 20 handle_bi_update(): bucket=:myver[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18]): orig_dests= new_dests= 2024-09-12T17:24:33.891 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.890+0000 7f20c7e309c0 20 handle_bi_update(): bucket=:myver[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18]): potential dests added=[] removed=[] 2024-09-12T17:24:33.895 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.894+0000 7f20c7e309c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.1.0 2024-09-12T17:24:33.895 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.894+0000 7f20c7e309c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.1.0 2024-09-12T17:24:33.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.894+0000 7f20c7e309c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.1.1 2024-09-12T17:24:33.896 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.894+0000 7f20c7e309c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.1.1 2024-09-12T17:24:33.901 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.902+0000 7f20c7e309c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 : hit (requested=0x17, cached=0x17) 2024-09-12T17:24:33.901 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.902+0000 7f20c7e309c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 2024-09-12T17:24:33.905 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.906+0000 7f20c7e309c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 info.flags=0x17 2024-09-12T17:24:33.905 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.906+0000 7f20c7e309c0 10 moving default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 to cache LRU end 2024-09-12T17:24:33.905 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.906+0000 7f20c7e309c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:24:33.905 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.906+0000 7f20c7e309c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18, ofs0, ns] 2024-09-12T17:24:33.906 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.906+0000 7f1fa8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431605 cookie 94369343708544 notifier 8117 bl.length()=789 2024-09-12T17:24:33.906 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.906+0000 7f1fa8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 info.flags=0x17 2024-09-12T17:24:33.906 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.906+0000 7f1fa8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 to cache LRU end 2024-09-12T17:24:33.906 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.906+0000 7f1fa8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:24:33.907 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.906+0000 7f20c7e309c0 20 handle_bi_update(): bucket=:myver[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18]): orig_sources= new_sources= 2024-09-12T17:24:33.907 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.906+0000 7f20c7e309c0 20 handle_bi_update(): bucket=:myver[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18]): potential sources added=[] removed=[] 2024-09-12T17:24:33.907 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.906+0000 7f20c7e309c0 20 handle_bi_update(): bucket=:myver[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18]): orig_dests= new_dests= 2024-09-12T17:24:33.907 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.906+0000 7f20c7e309c0 20 handle_bi_update(): bucket=:myver[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18]): potential dests added=[] removed=[] 2024-09-12T17:24:33.911 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.910+0000 7f20c7e309c0 1 execute INFO: reshard of bucket "myver" from 2 shards to 3 shards completed successfully 2024-09-12T17:24:33.916 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.914+0000 7f1f7bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:33.922 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.922+0000 7f20c7e309c0 20 remove_watcher() i=0 2024-09-12T17:24:33.922 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.922+0000 7f20c7e309c0 2 removed watcher, disabling cache 2024-09-12T17:24:33.925 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.926+0000 7f20c7e309c0 20 remove_watcher() i=1 2024-09-12T17:24:33.928 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.926+0000 7f20c7e309c0 20 remove_watcher() i=2 2024-09-12T17:24:33.930 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.930+0000 7f20c7e309c0 20 remove_watcher() i=3 2024-09-12T17:24:33.934 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.934+0000 7f20c7e309c0 20 remove_watcher() i=4 2024-09-12T17:24:33.936 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.938+0000 7f20c7e309c0 20 remove_watcher() i=5 2024-09-12T17:24:33.938 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.938+0000 7f20c7e309c0 20 remove_watcher() i=6 2024-09-12T17:24:33.941 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:33.942+0000 7f20c7e309c0 20 remove_watcher() i=7 2024-09-12T17:24:34.545 INFO:tasks.workunit.client.0.smithi016.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-09-12T17:24:34.545 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:24:34.742 INFO:tasks.workunit.client.0.smithi016.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T17:24:35.190 INFO:tasks.workunit.client.0.smithi016.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T17:24:36.714 INFO:tasks.workunit.client.0.smithi016.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:24:36.714 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bi list --bucket myver --object x 2024-09-12T17:24:36.752 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:36.752 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:36.799 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:36.797+0000 7f537d8f59c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:36.801 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:36.801+0000 7f537d8f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:36.801 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:36.801+0000 7f537d8f59c0 20 realm 2024-09-12T17:24:36.801 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:36.801+0000 7f537d8f59c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:36.801 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:36.801+0000 7f537d8f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:36.801 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:36.801+0000 7f537d8f59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:36.801 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:36.801+0000 7f537d8f59c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:36.801 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:36.801+0000 7f537d8f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:36.802 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:36.801+0000 7f537d8f59c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:36.803 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:36.801+0000 7f537d8f59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:36.803 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:36.801+0000 7f537d8f59c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:36.805 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:36.805+0000 7f537d8f59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:36.805 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:36.805+0000 7f537d8f59c0 20 searching for the correct realm 2024-09-12T17:24:36.807 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:36.805+0000 7f537bbfc640 0 -- 172.21.15.16:0/168955912 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f5364008070 msgr2=0x7f536406f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:36.815 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:36.813+0000 7f537abfa640 0 -- 172.21.15.16:0/168955912 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f536c0e8950 msgr2=0x7f536c0b7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:37.031 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.029+0000 7f537d8f59c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:24:37.032 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.029+0000 7f537d8f59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:37.032 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.029+0000 7f537d8f59c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:24:37.032 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.029+0000 7f537d8f59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:37.032 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.029+0000 7f537d8f59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:37.032 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.029+0000 7f537d8f59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:37.032 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.029+0000 7f537d8f59c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.032 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.029+0000 7f537d8f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.032 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.029+0000 7f537d8f59c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.033 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.033+0000 7f537d8f59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:37.033 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.033+0000 7f537d8f59c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.034 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.033+0000 7f537d8f59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:37.034 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.033+0000 7f537d8f59c0 20 zone default found 2024-09-12T17:24:37.034 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.033+0000 7f537d8f59c0 4 Realm: () 2024-09-12T17:24:37.034 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.033+0000 7f537d8f59c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:24:37.034 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.033+0000 7f537d8f59c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:24:37.034 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.033+0000 7f537d8f59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:37.034 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.033+0000 7f537d8f59c0 20 zonegroup default 2024-09-12T17:24:37.034 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.033+0000 7f537d8f59c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.035 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.033+0000 7f537d8f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.035 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.033+0000 7f537d8f59c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.035 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.033+0000 7f537d8f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.035 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.033+0000 7f537d8f59c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.036 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.033+0000 7f537d8f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.036 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.037+0000 7f537d8f59c0 20 started sync module instance, tier type = 2024-09-12T17:24:37.036 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.037+0000 7f537d8f59c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:24:37.061 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.061+0000 7f537d8f59c0 20 add_watcher() i=0 2024-09-12T17:24:37.061 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.061+0000 7f537d8f59c0 20 add_watcher() i=1 2024-09-12T17:24:37.061 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.061+0000 7f537d8f59c0 20 add_watcher() i=2 2024-09-12T17:24:37.061 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.061+0000 7f537d8f59c0 20 add_watcher() i=3 2024-09-12T17:24:37.061 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.061+0000 7f537d8f59c0 20 add_watcher() i=4 2024-09-12T17:24:37.061 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.061+0000 7f537d8f59c0 20 add_watcher() i=5 2024-09-12T17:24:37.061 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.061+0000 7f537d8f59c0 20 add_watcher() i=6 2024-09-12T17:24:37.063 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.061+0000 7f537d8f59c0 20 add_watcher() i=7 2024-09-12T17:24:37.063 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.061+0000 7f537d8f59c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:37.068 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.065+0000 7f5231fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:37.069 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.069+0000 7f537d8f59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:37.069 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.069+0000 7f537d8f59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:37.069 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.069+0000 7f537d8f59c0 5 note: GC not initialized 2024-09-12T17:24:37.070 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.069+0000 7f5230fe1640 20 reqs_thread_entry: start 2024-09-12T17:24:37.070 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.069+0000 7f537d8f59c0 20 init_complete bucket index max shards: 1 2024-09-12T17:24:37.070 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.069+0000 7f537d8f59c0 20 Filter name: none 2024-09-12T17:24:37.071 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.069+0000 7f51aa7fc640 20 reqs_thread_entry: start 2024-09-12T17:24:37.071 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.069+0000 7f537d8f59c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.072 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.069+0000 7f537d8f59c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T17:24:37.073 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.073+0000 7f537d8f59c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.074 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.073+0000 7f537d8f59c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T17:24:37.074 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.073+0000 7f537d8f59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:37.074 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.073+0000 7f537d8f59c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-12T17:24:37.074 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.073+0000 7f537d8f59c0 20 INFO: main: starting shard=0 2024-09-12T17:24:37.074 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.073+0000 7f537d8f59c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.2.0 2024-09-12T17:24:37.074 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.073+0000 7f537d8f59c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.2.0 2024-09-12T17:24:37.075 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.073+0000 7f537d8f59c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:24:37.075 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.073+0000 7f537d8f59c0 20 INFO: main: starting shard=1 2024-09-12T17:24:37.075 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.073+0000 7f537d8f59c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.2.1 2024-09-12T17:24:37.075 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.073+0000 7f537d8f59c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.2.1 2024-09-12T17:24:37.076 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.073+0000 7f537d8f59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:37.076 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.073+0000 7f537d8f59c0 20 INFO: main: starting shard=2 2024-09-12T17:24:37.076 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.073+0000 7f537d8f59c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.2.2 2024-09-12T17:24:37.076 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.073+0000 7f537d8f59c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.2.2 2024-09-12T17:24:37.077 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.077+0000 7f537d8f59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:37.077 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.077+0000 7f537d8f59c0 20 INFO: main: done 2024-09-12T17:24:37.079 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.077+0000 7f5231fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:37.084 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.081+0000 7f537d8f59c0 20 remove_watcher() i=0 2024-09-12T17:24:37.084 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.081+0000 7f537d8f59c0 2 removed watcher, disabling cache 2024-09-12T17:24:37.087 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.085+0000 7f537d8f59c0 20 remove_watcher() i=1 2024-09-12T17:24:37.089 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.089+0000 7f537d8f59c0 20 remove_watcher() i=2 2024-09-12T17:24:37.092 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.089+0000 7f537d8f59c0 20 remove_watcher() i=3 2024-09-12T17:24:37.094 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.093+0000 7f537d8f59c0 20 remove_watcher() i=4 2024-09-12T17:24:37.096 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.093+0000 7f537d8f59c0 20 remove_watcher() i=5 2024-09-12T17:24:37.098 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.097+0000 7f537d8f59c0 20 remove_watcher() i=6 2024-09-12T17:24:37.099 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.097+0000 7f537d8f59c0 20 remove_watcher() i=7 2024-09-12T17:24:37.181 INFO:tasks.workunit.client.0.smithi016.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:24:37.181 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bi list --bucket myver --object y 2024-09-12T17:24:37.218 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:37.218 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:37.265 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.265+0000 7fb2422339c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.267 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.265+0000 7fb2422339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.267 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.265+0000 7fb2422339c0 20 realm 2024-09-12T17:24:37.267 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.265+0000 7fb2422339c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.268 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.265+0000 7fb2422339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.268 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.265+0000 7fb2422339c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:37.268 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.265+0000 7fb2422339c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.268 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.265+0000 7fb2422339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.268 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.265+0000 7fb2422339c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.269 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.269+0000 7fb2422339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:37.270 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.269+0000 7fb2422339c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.271 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.269+0000 7fb2422339c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:37.271 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.269+0000 7fb2422339c0 20 searching for the correct realm 2024-09-12T17:24:37.275 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.273+0000 7fb24053a640 0 -- 172.21.15.16:0/3969149820 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fb2340ac490 msgr2=0x7fb23411ea90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:24:37.893 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.893+0000 7fb23f538640 0 -- 172.21.15.16:0/3969149820 >> [v2:172.21.15.19:6824/2441769319,v1:172.21.15.19:6825/2441769319] conn(0x5629c6a8af10 msgr2=0x5629c6a8d300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:37.909 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.909+0000 7fb2422339c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:24:37.909 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.909+0000 7fb2422339c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:37.909 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.909+0000 7fb2422339c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:24:37.910 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.909+0000 7fb2422339c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:37.910 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.909+0000 7fb2422339c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:37.910 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.909+0000 7fb2422339c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:37.910 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.909+0000 7fb2422339c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.910 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.909+0000 7fb2422339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.910 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.909+0000 7fb2422339c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.911 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.909+0000 7fb2422339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:37.911 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.909+0000 7fb2422339c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.912 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.909+0000 7fb2422339c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:37.912 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.909+0000 7fb2422339c0 20 zone default found 2024-09-12T17:24:37.912 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.909+0000 7fb2422339c0 4 Realm: () 2024-09-12T17:24:37.912 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.909+0000 7fb2422339c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:24:37.912 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.909+0000 7fb2422339c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:24:37.912 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.909+0000 7fb2422339c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:37.913 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.909+0000 7fb2422339c0 20 zonegroup default 2024-09-12T17:24:37.913 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.909+0000 7fb2422339c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.913 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.913+0000 7fb2422339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.913 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.913+0000 7fb2422339c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.914 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.913+0000 7fb2422339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.914 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.913+0000 7fb2422339c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.914 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.913+0000 7fb2422339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:37.914 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.913+0000 7fb2422339c0 20 started sync module instance, tier type = 2024-09-12T17:24:37.914 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.913+0000 7fb2422339c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:24:37.936 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.937+0000 7fb2422339c0 20 add_watcher() i=0 2024-09-12T17:24:37.936 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.937+0000 7fb2422339c0 20 add_watcher() i=1 2024-09-12T17:24:37.936 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.937+0000 7fb2422339c0 20 add_watcher() i=2 2024-09-12T17:24:37.936 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.937+0000 7fb2422339c0 20 add_watcher() i=3 2024-09-12T17:24:37.937 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.937+0000 7fb2422339c0 20 add_watcher() i=4 2024-09-12T17:24:37.937 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.937+0000 7fb2422339c0 20 add_watcher() i=5 2024-09-12T17:24:37.937 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.937+0000 7fb2422339c0 20 add_watcher() i=6 2024-09-12T17:24:37.939 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.937+0000 7fb2422339c0 20 add_watcher() i=7 2024-09-12T17:24:37.939 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.937+0000 7fb2422339c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:37.943 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.941+0000 7fb0f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:37.944 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.941+0000 7fb2422339c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:37.945 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.941+0000 7fb2422339c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:37.945 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.941+0000 7fb2422339c0 5 note: GC not initialized 2024-09-12T17:24:37.945 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.941+0000 7fb0f4fe1640 20 reqs_thread_entry: start 2024-09-12T17:24:37.945 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.941+0000 7fb2422339c0 20 init_complete bucket index max shards: 1 2024-09-12T17:24:37.945 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.941+0000 7fb2422339c0 20 Filter name: none 2024-09-12T17:24:37.945 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.945+0000 7fb06e7fc640 20 reqs_thread_entry: start 2024-09-12T17:24:37.945 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.945+0000 7fb2422339c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.946 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.945+0000 7fb2422339c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T17:24:37.946 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.945+0000 7fb2422339c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:37.947 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.945+0000 7fb2422339c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T17:24:37.947 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.945+0000 7fb2422339c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:37.947 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.945+0000 7fb2422339c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-12T17:24:37.947 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.945+0000 7fb2422339c0 20 INFO: main: starting shard=0 2024-09-12T17:24:37.947 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.945+0000 7fb2422339c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.2.0 2024-09-12T17:24:37.947 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.945+0000 7fb2422339c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.2.0 2024-09-12T17:24:37.948 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.949+0000 7fb2422339c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:37.948 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.949+0000 7fb2422339c0 20 INFO: main: starting shard=1 2024-09-12T17:24:37.949 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.949+0000 7fb2422339c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.2.1 2024-09-12T17:24:37.949 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.949+0000 7fb2422339c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.2.1 2024-09-12T17:24:37.949 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.949+0000 7fb2422339c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:37.949 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.949+0000 7fb2422339c0 20 INFO: main: starting shard=2 2024-09-12T17:24:37.950 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.949+0000 7fb2422339c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.2.2 2024-09-12T17:24:37.950 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.949+0000 7fb2422339c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.2.2 2024-09-12T17:24:37.950 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.949+0000 7fb2422339c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:24:37.951 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.949+0000 7fb2422339c0 20 INFO: main: done 2024-09-12T17:24:37.952 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.949+0000 7fb0f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:37.957 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.957+0000 7fb2422339c0 20 remove_watcher() i=0 2024-09-12T17:24:37.957 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.957+0000 7fb2422339c0 2 removed watcher, disabling cache 2024-09-12T17:24:37.959 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.957+0000 7fb2422339c0 20 remove_watcher() i=1 2024-09-12T17:24:37.962 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.961+0000 7fb2422339c0 20 remove_watcher() i=2 2024-09-12T17:24:37.964 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.961+0000 7fb2422339c0 20 remove_watcher() i=3 2024-09-12T17:24:37.966 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.965+0000 7fb2422339c0 20 remove_watcher() i=4 2024-09-12T17:24:37.968 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.965+0000 7fb2422339c0 20 remove_watcher() i=5 2024-09-12T17:24:37.969 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.969+0000 7fb2422339c0 20 remove_watcher() i=6 2024-09-12T17:24:37.971 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:37.969+0000 7fb2422339c0 20 remove_watcher() i=7 2024-09-12T17:24:38.057 INFO:tasks.workunit.client.0.smithi016.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:24:38.058 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bi list --bucket myver --object z 2024-09-12T17:24:38.094 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:38.095 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:38.144 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.141+0000 7f6ee63c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:38.146 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.145+0000 7f6ee63c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:38.146 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.145+0000 7f6ee63c89c0 20 realm 2024-09-12T17:24:38.146 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.145+0000 7f6ee63c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:38.146 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.145+0000 7f6ee63c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:38.146 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.145+0000 7f6ee63c89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:38.147 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.145+0000 7f6ee63c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:38.147 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.145+0000 7f6ee63c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:38.147 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.145+0000 7f6ee63c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:38.148 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.145+0000 7f6ee63c89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:38.148 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.145+0000 7f6ee63c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:38.150 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.149+0000 7f6ee63c89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:38.150 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.149+0000 7f6ee63c89c0 20 searching for the correct realm 2024-09-12T17:24:38.154 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.153+0000 7f6ee46cf640 0 -- 172.21.15.16:0/92150894 >> [v2:172.21.15.19:6800/1509147557,v1:172.21.15.19:6801/1509147557] conn(0x55e0e57bb770 msgr2=0x55e0e57bdb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:38.161 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.161+0000 7f6ee36cd640 0 -- 172.21.15.16:0/92150894 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f6edc008030 msgr2=0x7f6edc07f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:38.380 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.377+0000 7f6ee63c89c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:24:38.381 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.377+0000 7f6ee63c89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:38.381 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.377+0000 7f6ee63c89c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:24:38.381 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.377+0000 7f6ee63c89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:38.381 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.377+0000 7f6ee63c89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:38.381 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.377+0000 7f6ee63c89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:38.381 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.377+0000 7f6ee63c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:38.381 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.381+0000 7f6ee63c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:38.381 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.381+0000 7f6ee63c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:38.382 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.381+0000 7f6ee63c89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:38.382 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.381+0000 7f6ee63c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:38.383 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.381+0000 7f6ee63c89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:38.383 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.381+0000 7f6ee63c89c0 20 zone default found 2024-09-12T17:24:38.383 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.381+0000 7f6ee63c89c0 4 Realm: () 2024-09-12T17:24:38.384 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.381+0000 7f6ee63c89c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:24:38.384 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.381+0000 7f6ee63c89c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:24:38.384 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.381+0000 7f6ee63c89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:38.384 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.381+0000 7f6ee63c89c0 20 zonegroup default 2024-09-12T17:24:38.384 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.381+0000 7f6ee63c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:38.384 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.381+0000 7f6ee63c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:38.384 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.381+0000 7f6ee63c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:38.385 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.385+0000 7f6ee63c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:38.385 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.385+0000 7f6ee63c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:38.385 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.385+0000 7f6ee63c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:38.385 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.385+0000 7f6ee63c89c0 20 started sync module instance, tier type = 2024-09-12T17:24:38.385 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.385+0000 7f6ee63c89c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:24:38.409 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.409+0000 7f6ee63c89c0 20 add_watcher() i=0 2024-09-12T17:24:38.410 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.409+0000 7f6ee63c89c0 20 add_watcher() i=1 2024-09-12T17:24:38.410 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.409+0000 7f6ee63c89c0 20 add_watcher() i=2 2024-09-12T17:24:38.410 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.409+0000 7f6ee63c89c0 20 add_watcher() i=3 2024-09-12T17:24:38.410 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.409+0000 7f6ee63c89c0 20 add_watcher() i=4 2024-09-12T17:24:38.410 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.409+0000 7f6ee63c89c0 20 add_watcher() i=5 2024-09-12T17:24:38.410 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.409+0000 7f6ee63c89c0 20 add_watcher() i=6 2024-09-12T17:24:38.412 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.409+0000 7f6ee63c89c0 20 add_watcher() i=7 2024-09-12T17:24:38.412 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.409+0000 7f6ee63c89c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:38.416 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.413+0000 7f6d99fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:38.417 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.417+0000 7f6ee63c89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:38.417 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.417+0000 7f6ee63c89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:38.417 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.417+0000 7f6ee63c89c0 5 note: GC not initialized 2024-09-12T17:24:38.418 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.417+0000 7f6d98fe1640 20 reqs_thread_entry: start 2024-09-12T17:24:38.418 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.417+0000 7f6ee63c89c0 20 init_complete bucket index max shards: 1 2024-09-12T17:24:38.418 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.417+0000 7f6ee63c89c0 20 Filter name: none 2024-09-12T17:24:38.418 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.417+0000 7f6d127fc640 20 reqs_thread_entry: start 2024-09-12T17:24:38.418 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.417+0000 7f6ee63c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:38.419 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.417+0000 7f6ee63c89c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T17:24:38.419 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.417+0000 7f6ee63c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:38.420 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.417+0000 7f6ee63c89c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T17:24:38.420 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.417+0000 7f6ee63c89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:38.420 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.417+0000 7f6ee63c89c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-12T17:24:38.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.417+0000 7f6ee63c89c0 20 INFO: main: starting shard=0 2024-09-12T17:24:38.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.421+0000 7f6ee63c89c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.2.0 2024-09-12T17:24:38.421 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.421+0000 7f6ee63c89c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.2.0 2024-09-12T17:24:38.422 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.421+0000 7f6ee63c89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:38.422 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.421+0000 7f6ee63c89c0 20 INFO: main: starting shard=1 2024-09-12T17:24:38.422 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.421+0000 7f6ee63c89c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.2.1 2024-09-12T17:24:38.422 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.421+0000 7f6ee63c89c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.2.1 2024-09-12T17:24:38.423 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.421+0000 7f6ee63c89c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:24:38.423 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.421+0000 7f6ee63c89c0 20 INFO: main: starting shard=2 2024-09-12T17:24:38.423 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.421+0000 7f6ee63c89c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.2.2 2024-09-12T17:24:38.423 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.421+0000 7f6ee63c89c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.2.2 2024-09-12T17:24:38.424 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.421+0000 7f6ee63c89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:24:38.424 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.421+0000 7f6ee63c89c0 20 INFO: main: done 2024-09-12T17:24:38.426 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.425+0000 7f6d99fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:38.431 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.429+0000 7f6ee63c89c0 20 remove_watcher() i=0 2024-09-12T17:24:38.431 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.429+0000 7f6ee63c89c0 2 removed watcher, disabling cache 2024-09-12T17:24:38.433 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.433+0000 7f6ee63c89c0 20 remove_watcher() i=1 2024-09-12T17:24:38.435 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.433+0000 7f6ee63c89c0 20 remove_watcher() i=2 2024-09-12T17:24:38.438 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.437+0000 7f6ee63c89c0 20 remove_watcher() i=3 2024-09-12T17:24:38.440 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.437+0000 7f6ee63c89c0 20 remove_watcher() i=4 2024-09-12T17:24:38.441 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.441+0000 7f6ee63c89c0 20 remove_watcher() i=5 2024-09-12T17:24:38.443 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.441+0000 7f6ee63c89c0 20 remove_watcher() i=6 2024-09-12T17:24:38.444 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:38.445+0000 7f6ee63c89c0 20 remove_watcher() i=7 2024-09-12T17:24:38.468 INFO:tasks.workunit.client.0.smithi016.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T17:24:38.911 INFO:tasks.workunit.client.0.smithi016.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T17:24:39.352 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-09-12T17:24:39.387 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:39.387 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:39.434 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.433+0000 7f22ca45d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:39.435 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.433+0000 7f22ca45d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:39.435 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.433+0000 7f22ca45d9c0 20 realm 2024-09-12T17:24:39.435 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.433+0000 7f22ca45d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:39.436 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.433+0000 7f22ca45d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:39.436 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.433+0000 7f22ca45d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:39.436 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.433+0000 7f22ca45d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:39.436 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.433+0000 7f22ca45d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:39.436 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.433+0000 7f22ca45d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:39.437 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.437+0000 7f22ca45d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:39.437 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.437+0000 7f22ca45d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:39.440 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.437+0000 7f22ca45d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:39.440 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.437+0000 7f22ca45d9c0 20 searching for the correct realm 2024-09-12T17:24:39.443 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.441+0000 7f22c8764640 0 -- 172.21.15.16:0/2130417322 >> [v2:172.21.15.19:6800/1509147557,v1:172.21.15.19:6801/1509147557] conn(0x56292a602400 msgr2=0x56292a604810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:39.450 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.449+0000 7f22bf762640 0 -- 172.21.15.16:0/2130417322 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f22c002f410 msgr2=0x7f22c002f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:39.669 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.669+0000 7f22ca45d9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:24:39.669 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.669+0000 7f22ca45d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:39.669 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.669+0000 7f22ca45d9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:24:39.670 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.669+0000 7f22ca45d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:39.670 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.669+0000 7f22ca45d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:39.670 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.669+0000 7f22ca45d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:39.670 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.669+0000 7f22ca45d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:39.670 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.669+0000 7f22ca45d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:39.670 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.669+0000 7f22ca45d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:39.670 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.669+0000 7f22ca45d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:39.670 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.669+0000 7f22ca45d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:39.671 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.669+0000 7f22ca45d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:39.671 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.669+0000 7f22ca45d9c0 20 zone default found 2024-09-12T17:24:39.672 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.669+0000 7f22ca45d9c0 4 Realm: () 2024-09-12T17:24:39.672 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.669+0000 7f22ca45d9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:24:39.672 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.669+0000 7f22ca45d9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:24:39.672 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.669+0000 7f22ca45d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:39.672 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.669+0000 7f22ca45d9c0 20 zonegroup default 2024-09-12T17:24:39.672 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.669+0000 7f22ca45d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:39.672 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.669+0000 7f22ca45d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:39.672 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.669+0000 7f22ca45d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:39.673 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.673+0000 7f22ca45d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:39.673 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.673+0000 7f22ca45d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:39.674 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.673+0000 7f22ca45d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:39.674 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.673+0000 7f22ca45d9c0 20 started sync module instance, tier type = 2024-09-12T17:24:39.674 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.673+0000 7f22ca45d9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:24:39.699 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.697+0000 7f22ca45d9c0 20 add_watcher() i=0 2024-09-12T17:24:39.699 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.697+0000 7f22ca45d9c0 20 add_watcher() i=1 2024-09-12T17:24:39.699 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.697+0000 7f22ca45d9c0 20 add_watcher() i=2 2024-09-12T17:24:39.699 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.697+0000 7f22ca45d9c0 20 add_watcher() i=3 2024-09-12T17:24:39.699 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.697+0000 7f22ca45d9c0 20 add_watcher() i=4 2024-09-12T17:24:39.699 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.697+0000 7f22ca45d9c0 20 add_watcher() i=5 2024-09-12T17:24:39.700 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.697+0000 7f22ca45d9c0 20 add_watcher() i=6 2024-09-12T17:24:39.701 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.701+0000 7f22ca45d9c0 20 add_watcher() i=7 2024-09-12T17:24:39.702 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.701+0000 7f22ca45d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:39.706 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.705+0000 7f217dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:39.707 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.705+0000 7f22ca45d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:39.707 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.705+0000 7f22ca45d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:39.707 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.705+0000 7f22ca45d9c0 5 note: GC not initialized 2024-09-12T17:24:39.707 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.705+0000 7f217cfe1640 20 reqs_thread_entry: start 2024-09-12T17:24:39.708 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.705+0000 7f22ca45d9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:24:39.708 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.705+0000 7f22ca45d9c0 20 Filter name: none 2024-09-12T17:24:39.708 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.705+0000 7f20f67fc640 20 reqs_thread_entry: start 2024-09-12T17:24:39.708 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.705+0000 7f22ca45d9c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T17:24:39.708 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.705+0000 7f22ca45d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:39.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.709+0000 7f22ca45d9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T17:24:39.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.709+0000 7f22ca45d9c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T17:24:39.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.709+0000 7f22ca45d9c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T17:24:39.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.709+0000 7f22ca45d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 : miss 2024-09-12T17:24:39.709 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.709+0000 7f22ca45d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:39.710 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.709+0000 7f22ca45d9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T17:24:39.710 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.709+0000 7f22ca45d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 info.flags=0x17 2024-09-12T17:24:39.710 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.709+0000 7f22ca45d9c0 10 adding default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 to cache LRU end 2024-09-12T17:24:39.710 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.709+0000 7f22ca45d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:24:39.710 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.709+0000 7f22ca45d9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:24:39.710 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.709+0000 7f22ca45d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 2024-09-12T17:24:39.724 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.721+0000 7f22ca45d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 info.flags=0x17 2024-09-12T17:24:39.724 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.721+0000 7f22ca45d9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 to cache LRU end 2024-09-12T17:24:39.724 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.721+0000 7f22ca45d9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:24:39.724 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.721+0000 7f22ca45d9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18, ofs0, ns] 2024-09-12T17:24:39.724 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.721+0000 7f21a6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431606 cookie 94734804627664 notifier 8198 bl.length()=821 2024-09-12T17:24:39.724 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.721+0000 7f21a6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 info.flags=0x17 2024-09-12T17:24:39.725 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.721+0000 7f21a6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 to cache LRU end 2024-09-12T17:24:39.725 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.721+0000 7f21a6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:24:39.725 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.725+0000 7f22ca45d9c0 20 handle_bi_update(): bucket=:myver[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18]): orig_sources= new_sources= 2024-09-12T17:24:39.725 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.725+0000 7f22ca45d9c0 20 handle_bi_update(): bucket=:myver[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18]): potential sources added=[] removed=[] 2024-09-12T17:24:39.725 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.725+0000 7f22ca45d9c0 20 handle_bi_update(): bucket=:myver[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18]): orig_dests= new_dests= 2024-09-12T17:24:39.725 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.725+0000 7f22ca45d9c0 20 handle_bi_update(): bucket=:myver[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18]): potential dests added=[] removed=[] 2024-09-12T17:24:39.732 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.729+0000 7f22ca45d9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.0 2024-09-12T17:24:39.732 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.729+0000 7f22ca45d9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.0 2024-09-12T17:24:39.732 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.729+0000 7f22ca45d9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.1 2024-09-12T17:24:39.732 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.729+0000 7f22ca45d9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.1 2024-09-12T17:24:39.732 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.729+0000 7f22ca45d9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.2 2024-09-12T17:24:39.732 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.729+0000 7f22ca45d9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.2 2024-09-12T17:24:39.732 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.729+0000 7f22ca45d9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.3 2024-09-12T17:24:39.732 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.729+0000 7f22ca45d9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.3 2024-09-12T17:24:39.732 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.729+0000 7f22ca45d9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.4 2024-09-12T17:24:39.732 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.729+0000 7f22ca45d9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.4 2024-09-12T17:24:39.733 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.729+0000 7f22ca45d9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.5 2024-09-12T17:24:39.733 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.729+0000 7f22ca45d9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.5 2024-09-12T17:24:39.733 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.729+0000 7f22ca45d9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.6 2024-09-12T17:24:39.733 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.729+0000 7f22ca45d9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.6 2024-09-12T17:24:39.733 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.729+0000 7f22ca45d9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.7 2024-09-12T17:24:39.733 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.729+0000 7f22ca45d9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.7 2024-09-12T17:24:39.733 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.729+0000 7f22ca45d9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.8 2024-09-12T17:24:39.733 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.729+0000 7f22ca45d9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.8 2024-09-12T17:24:39.733 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.729+0000 7f22ca45d9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.9 2024-09-12T17:24:39.733 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.729+0000 7f22ca45d9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.9 2024-09-12T17:24:39.733 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.729+0000 7f22ca45d9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.10 2024-09-12T17:24:39.733 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.729+0000 7f22ca45d9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.10 2024-09-12T17:24:39.734 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.729+0000 7f22ca45d9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.11 2024-09-12T17:24:39.734 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.729+0000 7f22ca45d9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.11 2024-09-12T17:24:39.734 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.729+0000 7f22ca45d9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.12 2024-09-12T17:24:39.734 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.729+0000 7f22ca45d9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.12 2024-09-12T17:24:39.734 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.729+0000 7f22ca45d9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.13 2024-09-12T17:24:39.734 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.729+0000 7f22ca45d9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.13 2024-09-12T17:24:39.734 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.729+0000 7f22ca45d9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.14 2024-09-12T17:24:39.734 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.729+0000 7f22ca45d9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.14 2024-09-12T17:24:39.734 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.729+0000 7f22ca45d9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.15 2024-09-12T17:24:39.734 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.729+0000 7f22ca45d9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.15 2024-09-12T17:24:39.734 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.729+0000 7f22ca45d9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.16 2024-09-12T17:24:39.734 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.729+0000 7f22ca45d9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.16 2024-09-12T17:24:39.734 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.729+0000 7f22ca45d9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.2.0 2024-09-12T17:24:39.734 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.729+0000 7f22ca45d9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.2.0 2024-09-12T17:24:39.735 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.733+0000 7f22ca45d9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.2.1 2024-09-12T17:24:39.735 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.733+0000 7f22ca45d9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.2.1 2024-09-12T17:24:39.735 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.733+0000 7f22ca45d9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.2.2 2024-09-12T17:24:39.735 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.733+0000 7f22ca45d9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.2.2 2024-09-12T17:24:39.738 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.737+0000 7f22ca45d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 : hit (requested=0x17, cached=0x17) 2024-09-12T17:24:39.739 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.737+0000 7f22ca45d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 2024-09-12T17:24:39.742 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.741+0000 7f22ca45d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 info.flags=0x17 2024-09-12T17:24:39.742 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.741+0000 7f22ca45d9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 to cache LRU end 2024-09-12T17:24:39.742 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.741+0000 7f22ca45d9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:24:39.742 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.741+0000 7f22ca45d9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18, ofs0, ns] 2024-09-12T17:24:39.743 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.741+0000 7f21a6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431607 cookie 94734804627664 notifier 8198 bl.length()=821 2024-09-12T17:24:39.743 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.741+0000 7f21a6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 info.flags=0x17 2024-09-12T17:24:39.743 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.741+0000 7f21a6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 to cache LRU end 2024-09-12T17:24:39.743 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.741+0000 7f21a6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:24:39.743 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.741+0000 7f22ca45d9c0 20 handle_bi_update(): bucket=:myver[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18]): orig_sources= new_sources= 2024-09-12T17:24:39.743 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.741+0000 7f22ca45d9c0 20 handle_bi_update(): bucket=:myver[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18]): potential sources added=[] removed=[] 2024-09-12T17:24:39.743 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.741+0000 7f22ca45d9c0 20 handle_bi_update(): bucket=:myver[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18]): orig_dests= new_dests= 2024-09-12T17:24:39.743 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.741+0000 7f22ca45d9c0 20 handle_bi_update(): bucket=:myver[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18]): potential dests added=[] removed=[] 2024-09-12T17:24:39.746 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.745+0000 7f22ca45d9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.2.0 2024-09-12T17:24:39.746 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.745+0000 7f22ca45d9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.2.0 2024-09-12T17:24:39.747 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.745+0000 7f22ca45d9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.2.1 2024-09-12T17:24:39.747 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.745+0000 7f22ca45d9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.2.1 2024-09-12T17:24:39.748 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.745+0000 7f22ca45d9c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.2.2 2024-09-12T17:24:39.748 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.745+0000 7f22ca45d9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.2.2 2024-09-12T17:24:39.748 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.749+0000 7f22ca45d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 : hit (requested=0x17, cached=0x17) 2024-09-12T17:24:39.749 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.749+0000 7f22ca45d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 2024-09-12T17:24:39.752 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.749+0000 7f22ca45d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 info.flags=0x17 2024-09-12T17:24:39.752 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.749+0000 7f22ca45d9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 to cache LRU end 2024-09-12T17:24:39.752 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.749+0000 7f22ca45d9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:24:39.752 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.749+0000 7f22ca45d9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18, ofs0, ns] 2024-09-12T17:24:39.752 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.753+0000 7f21a6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431608 cookie 94734804627664 notifier 8198 bl.length()=789 2024-09-12T17:24:39.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.753+0000 7f21a6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 info.flags=0x17 2024-09-12T17:24:39.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.753+0000 7f21a6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 to cache LRU end 2024-09-12T17:24:39.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.753+0000 7f21a6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:24:39.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.753+0000 7f22ca45d9c0 20 handle_bi_update(): bucket=:myver[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18]): orig_sources= new_sources= 2024-09-12T17:24:39.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.753+0000 7f22ca45d9c0 20 handle_bi_update(): bucket=:myver[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18]): potential sources added=[] removed=[] 2024-09-12T17:24:39.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.753+0000 7f22ca45d9c0 20 handle_bi_update(): bucket=:myver[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18]): orig_dests= new_dests= 2024-09-12T17:24:39.753 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.753+0000 7f22ca45d9c0 20 handle_bi_update(): bucket=:myver[4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18]): potential dests added=[] removed=[] 2024-09-12T17:24:39.756 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.753+0000 7f22ca45d9c0 1 execute INFO: reshard of bucket "myver" from 3 shards to 17 shards completed successfully 2024-09-12T17:24:39.759 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.757+0000 7f217dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:39.765 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.765+0000 7f22ca45d9c0 20 remove_watcher() i=0 2024-09-12T17:24:39.765 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.765+0000 7f22ca45d9c0 2 removed watcher, disabling cache 2024-09-12T17:24:39.768 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.765+0000 7f22ca45d9c0 20 remove_watcher() i=1 2024-09-12T17:24:39.770 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.769+0000 7f22ca45d9c0 20 remove_watcher() i=2 2024-09-12T17:24:39.772 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.769+0000 7f22ca45d9c0 20 remove_watcher() i=3 2024-09-12T17:24:39.774 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.773+0000 7f22ca45d9c0 20 remove_watcher() i=4 2024-09-12T17:24:39.776 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.773+0000 7f22ca45d9c0 20 remove_watcher() i=5 2024-09-12T17:24:39.778 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.777+0000 7f22ca45d9c0 20 remove_watcher() i=6 2024-09-12T17:24:39.779 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.777+0000 7f22ca45d9c0 20 remove_watcher() i=7 2024-09-12T17:24:39.801 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T17:24:39.839 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:39.840 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:39.889 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.889+0000 7f1933bd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:39.891 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.889+0000 7f1933bd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:39.891 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.889+0000 7f1933bd09c0 20 realm 2024-09-12T17:24:39.891 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.889+0000 7f1933bd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:39.891 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.889+0000 7f1933bd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:39.891 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.889+0000 7f1933bd09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:39.891 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.889+0000 7f1933bd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:39.891 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.889+0000 7f1933bd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:39.891 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.889+0000 7f1933bd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:39.892 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.893+0000 7f1933bd09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:39.893 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.893+0000 7f1933bd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:39.894 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.893+0000 7f1933bd09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:39.895 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.893+0000 7f1933bd09c0 20 searching for the correct realm 2024-09-12T17:24:39.898 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.897+0000 7f1931ed7640 0 -- 172.21.15.16:0/3308360015 >> [v2:172.21.15.19:6800/1509147557,v1:172.21.15.19:6801/1509147557] conn(0x55eb79391a50 msgr2=0x55eb79393e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:39.906 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:39.905+0000 7f1930ed5640 0 -- 172.21.15.16:0/3308360015 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f192c070b60 msgr2=0x7f192c06d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:24:40.124 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.121+0000 7f1933bd09c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:24:40.124 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.121+0000 7f1933bd09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:40.124 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.121+0000 7f1933bd09c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:24:40.124 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.121+0000 7f1933bd09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:40.124 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.121+0000 7f1933bd09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:40.124 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.121+0000 7f1933bd09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:40.124 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.121+0000 7f1933bd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.124 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.121+0000 7f1933bd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:40.125 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.121+0000 7f1933bd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.125 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.125+0000 7f1933bd09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:40.125 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.125+0000 7f1933bd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.126 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.125+0000 7f1933bd09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:40.126 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.125+0000 7f1933bd09c0 20 zone default found 2024-09-12T17:24:40.126 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.125+0000 7f1933bd09c0 4 Realm: () 2024-09-12T17:24:40.126 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.125+0000 7f1933bd09c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:24:40.127 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.125+0000 7f1933bd09c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:24:40.127 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.125+0000 7f1933bd09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:40.127 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.125+0000 7f1933bd09c0 20 zonegroup default 2024-09-12T17:24:40.127 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.125+0000 7f1933bd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.127 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.125+0000 7f1933bd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:40.127 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.125+0000 7f1933bd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.127 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.125+0000 7f1933bd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:40.128 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.125+0000 7f1933bd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.128 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.129+0000 7f1933bd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:40.128 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.129+0000 7f1933bd09c0 20 started sync module instance, tier type = 2024-09-12T17:24:40.129 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.129+0000 7f1933bd09c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:24:40.152 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.149+0000 7f1933bd09c0 20 add_watcher() i=0 2024-09-12T17:24:40.152 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.149+0000 7f1933bd09c0 20 add_watcher() i=1 2024-09-12T17:24:40.153 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.149+0000 7f1933bd09c0 20 add_watcher() i=2 2024-09-12T17:24:40.153 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.149+0000 7f1933bd09c0 20 add_watcher() i=3 2024-09-12T17:24:40.153 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.149+0000 7f1933bd09c0 20 add_watcher() i=4 2024-09-12T17:24:40.153 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.149+0000 7f1933bd09c0 20 add_watcher() i=5 2024-09-12T17:24:40.153 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.149+0000 7f1933bd09c0 20 add_watcher() i=6 2024-09-12T17:24:40.155 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.153+0000 7f1933bd09c0 20 add_watcher() i=7 2024-09-12T17:24:40.155 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.153+0000 7f1933bd09c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:40.159 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.157+0000 7f17e77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:40.160 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.157+0000 7f1933bd09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:40.160 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.157+0000 7f1933bd09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:40.160 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.157+0000 7f1933bd09c0 5 note: GC not initialized 2024-09-12T17:24:40.161 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.161+0000 7f17e67e4640 20 reqs_thread_entry: start 2024-09-12T17:24:40.161 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.161+0000 7f1933bd09c0 20 init_complete bucket index max shards: 1 2024-09-12T17:24:40.161 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.161+0000 7f1933bd09c0 20 Filter name: none 2024-09-12T17:24:40.161 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.161+0000 7f1757fff640 20 reqs_thread_entry: start 2024-09-12T17:24:40.161 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.161+0000 7f1933bd09c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T17:24:40.162 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.161+0000 7f1933bd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.162 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.161+0000 7f1933bd09c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T17:24:40.162 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.161+0000 7f1933bd09c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T17:24:40.162 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.161+0000 7f1933bd09c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T17:24:40.162 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.161+0000 7f1933bd09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 : miss 2024-09-12T17:24:40.162 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.161+0000 7f1933bd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.163 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.161+0000 7f1933bd09c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T17:24:40.163 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.161+0000 7f1933bd09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 info.flags=0x17 2024-09-12T17:24:40.164 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.161+0000 7f1933bd09c0 10 adding default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 to cache LRU end 2024-09-12T17:24:40.164 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.161+0000 7f1933bd09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:24:40.164 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.161+0000 7f1933bd09c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:24:40.164 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.161+0000 7f1933bd09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18 2024-09-12T17:24:40.164 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.161+0000 7f1933bd09c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.0 2024-09-12T17:24:40.164 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.161+0000 7f1933bd09c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.0 2024-09-12T17:24:40.164 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.161+0000 7f1933bd09c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T17:24:40.164 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.161+0000 7f1933bd09c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.1 2024-09-12T17:24:40.165 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.161+0000 7f1933bd09c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.1 2024-09-12T17:24:40.166 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.165+0000 7f1933bd09c0 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-12T17:24:40.166 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.165+0000 7f1933bd09c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.2 2024-09-12T17:24:40.166 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.165+0000 7f1933bd09c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.2 2024-09-12T17:24:40.166 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.165+0000 7f1933bd09c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T17:24:40.166 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.165+0000 7f1933bd09c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.3 2024-09-12T17:24:40.167 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.165+0000 7f1933bd09c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.3 2024-09-12T17:24:40.167 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.165+0000 7f1933bd09c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T17:24:40.168 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.165+0000 7f1933bd09c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.4 2024-09-12T17:24:40.168 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.165+0000 7f1933bd09c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.4 2024-09-12T17:24:40.168 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.169+0000 7f1933bd09c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T17:24:40.168 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.169+0000 7f1933bd09c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.5 2024-09-12T17:24:40.169 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.169+0000 7f1933bd09c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.5 2024-09-12T17:24:40.169 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.169+0000 7f1933bd09c0 1 NOTICE: finished shard 5 (0 entries removed) 2024-09-12T17:24:40.170 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.169+0000 7f1933bd09c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.6 2024-09-12T17:24:40.170 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.169+0000 7f1933bd09c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.6 2024-09-12T17:24:40.171 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.169+0000 7f1933bd09c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T17:24:40.171 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.169+0000 7f1933bd09c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.7 2024-09-12T17:24:40.171 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.169+0000 7f1933bd09c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.7 2024-09-12T17:24:40.172 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.169+0000 7f1933bd09c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T17:24:40.172 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.169+0000 7f1933bd09c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.8 2024-09-12T17:24:40.172 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.169+0000 7f1933bd09c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.8 2024-09-12T17:24:40.173 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.173+0000 7f1933bd09c0 1 NOTICE: finished shard 8 (0 entries removed) 2024-09-12T17:24:40.173 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.173+0000 7f1933bd09c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.9 2024-09-12T17:24:40.173 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.173+0000 7f1933bd09c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.9 2024-09-12T17:24:40.174 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.173+0000 7f1933bd09c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.10 2024-09-12T17:24:40.174 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.173+0000 7f1933bd09c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.10 2024-09-12T17:24:40.175 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.173+0000 7f1933bd09c0 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-12T17:24:40.175 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.173+0000 7f1933bd09c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.11 2024-09-12T17:24:40.176 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.173+0000 7f1933bd09c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.11 2024-09-12T17:24:40.177 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.177+0000 7f1933bd09c0 1 NOTICE: finished shard 11 (0 entries removed) 2024-09-12T17:24:40.177 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.177+0000 7f1933bd09c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.12 2024-09-12T17:24:40.177 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.177+0000 7f1933bd09c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.12 2024-09-12T17:24:40.179 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.177+0000 7f1933bd09c0 1 NOTICE: finished shard 12 (0 entries removed) 2024-09-12T17:24:40.179 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.177+0000 7f1933bd09c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.13 2024-09-12T17:24:40.179 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.177+0000 7f1933bd09c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.13 2024-09-12T17:24:40.179 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.177+0000 7f1933bd09c0 1 NOTICE: finished shard 13 (0 entries removed) 2024-09-12T17:24:40.180 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.177+0000 7f1933bd09c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.14 2024-09-12T17:24:40.180 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.177+0000 7f1933bd09c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.14 2024-09-12T17:24:40.180 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.181+0000 7f1933bd09c0 1 NOTICE: finished shard 14 (0 entries removed) 2024-09-12T17:24:40.180 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.181+0000 7f1933bd09c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.15 2024-09-12T17:24:40.180 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.181+0000 7f1933bd09c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.15 2024-09-12T17:24:40.181 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.181+0000 7f1933bd09c0 1 NOTICE: finished shard 15 (0 entries removed) 2024-09-12T17:24:40.181 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.181+0000 7f1933bd09c0 10 bucket_obj is .dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.16 2024-09-12T17:24:40.181 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.181+0000 7f1933bd09c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.16 2024-09-12T17:24:40.182 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.181+0000 7f1933bd09c0 1 NOTICE: finished shard 16 (0 entries removed) 2024-09-12T17:24:40.182 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.181+0000 7f1933bd09c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.9 2024-09-12T17:24:40.183 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.181+0000 7f1933bd09c0 20 get_obj_state: octx=0x55eb79118110 obj=myver:x state=0x55eb793cd098 s->prefetch_data=0 2024-09-12T17:24:40.184 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.181+0000 7f1933bd09c0 20 get_obj_state: setting s->obj_tag to ge6v65r069oty475p33sz3sam2kh39lc 2024-09-12T17:24:40.184 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.181+0000 7f1933bd09c0 20 get_obj_state_impl: setting s->olh_tag to pum29khdru3ryz5oilocaq2g3ema9tm2 2024-09-12T17:24:40.184 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.181+0000 7f1933bd09c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=pum29khdru3ryz5oilocaq2g3ema9tm2 2024-09-12T17:24:40.186 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.185+0000 7f1933bd09c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.9 2024-09-12T17:24:40.189 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.189+0000 7f1933bd09c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.9 2024-09-12T17:24:40.189 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.189+0000 7f1933bd09c0 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-09-12T17:24:40.189 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.189+0000 7f1933bd09c0 20 olh_log_entry: epoch=2 op=3 key=x[HvlSDbR7KKmF5tY7PNfXByzurxaSkLo] 2024-09-12T17:24:40.189 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.189+0000 7f1933bd09c0 20 get_obj_state: octx=0x55eb79118110 obj=myver:_:HvlSDbR7KKmF5tY7PNfXByzurxaSkLo_x state=0x55eb793c75f8 s->prefetch_data=0 2024-09-12T17:24:40.190 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.189+0000 7f1933bd09c0 10 manifest: total_size = 9 2024-09-12T17:24:40.191 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.189+0000 7f1933bd09c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6539164729248490160 2024-09-12T17:24:40.191 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.189+0000 7f1933bd09c0 20 get_obj_state: octx=0x55eb79118110 obj=myver:_:HvlSDbR7KKmF5tY7PNfXByzurxaSkLo_x state=0x55eb793c75f8 s->prefetch_data=0 2024-09-12T17:24:40.191 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.189+0000 7f1933bd09c0 20 prepare_atomic_modification: state is not atomic. state=0x55eb793c75f8 2024-09-12T17:24:40.191 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.189+0000 7f1933bd09c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.9 2024-09-12T17:24:40.196 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.193+0000 7f1933bd09c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:24:40.196 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.193+0000 7f1933bd09c0 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-12T17:24:40.196 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.193+0000 7f1933bd09c0 0 deleting objects inline since gc isn't initialized 2024-09-12T17:24:40.196 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.193+0000 7f1933bd09c0 5 delete_objs_inline: removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18__shadow:HvlSDbR7KKmF5tY7PNfXByzurxaSkLo_.KJw5oJ98BtM4FyxKeBVT1r6uLgJu2DP_0 2024-09-12T17:24:40.198 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.197+0000 7f1814ff9640 20 handle_completion(): completion ok for obj=x[HvlSDbR7KKmF5tY7PNfXByzurxaSkLo] 2024-09-12T17:24:40.198 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.197+0000 7f1933bd09c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:24:40.201 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.201+0000 7f1933bd09c0 20 get_obj_state: octx=0x55eb79118110 obj=myver:x state=0x55eb793cd098 s->prefetch_data=0 2024-09-12T17:24:40.201 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.201+0000 7f1933bd09c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=pum29khdru3ryz5oilocaq2g3ema9tm2 2024-09-12T17:24:40.206 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.205+0000 7f1933bd09c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.9 2024-09-12T17:24:40.208 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.209+0000 7f1933bd09c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.9 2024-09-12T17:24:40.209 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.209+0000 7f1933bd09c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.9 2024-09-12T17:24:40.210 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.209+0000 7f1933bd09c0 20 get_obj_state: octx=0x55eb79118110 obj=myver:y state=0x55eb793cd098 s->prefetch_data=0 2024-09-12T17:24:40.211 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.209+0000 7f1933bd09c0 20 get_obj_state: setting s->obj_tag to 8nartrl0tmi0j6fo15tnu3uu21ax1p37 2024-09-12T17:24:40.211 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.209+0000 7f1933bd09c0 20 get_obj_state_impl: setting s->olh_tag to wudr6ra4lxvqdrfq2wct2tn61wwcaazv 2024-09-12T17:24:40.211 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.209+0000 7f1933bd09c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=wudr6ra4lxvqdrfq2wct2tn61wwcaazv 2024-09-12T17:24:40.213 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.213+0000 7f1933bd09c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.9 2024-09-12T17:24:40.216 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.217+0000 7f1933bd09c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.9 2024-09-12T17:24:40.217 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.217+0000 7f1933bd09c0 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-09-12T17:24:40.217 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.217+0000 7f1933bd09c0 20 olh_log_entry: epoch=2 op=3 key=y[axjOxKWZOR.Qdjb0q7gVGTcj1StS7Vu] 2024-09-12T17:24:40.217 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.217+0000 7f1933bd09c0 20 get_obj_state: octx=0x55eb79118110 obj=myver:_:axjOxKWZOR.Qdjb0q7gVGTcj1StS7Vu_y state=0x55eb793c25a8 s->prefetch_data=0 2024-09-12T17:24:40.218 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.217+0000 7f1933bd09c0 10 manifest: total_size = 9 2024-09-12T17:24:40.218 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.217+0000 7f1933bd09c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16393746516928777401 2024-09-12T17:24:40.218 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.217+0000 7f1933bd09c0 20 get_obj_state: octx=0x55eb79118110 obj=myver:_:axjOxKWZOR.Qdjb0q7gVGTcj1StS7Vu_y state=0x55eb793c25a8 s->prefetch_data=0 2024-09-12T17:24:40.218 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.217+0000 7f1933bd09c0 20 prepare_atomic_modification: state is not atomic. state=0x55eb793c25a8 2024-09-12T17:24:40.218 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.217+0000 7f1933bd09c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.9 2024-09-12T17:24:40.222 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.221+0000 7f1933bd09c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:24:40.223 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.221+0000 7f1933bd09c0 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-12T17:24:40.223 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.221+0000 7f1933bd09c0 0 deleting objects inline since gc isn't initialized 2024-09-12T17:24:40.223 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.221+0000 7f1933bd09c0 5 delete_objs_inline: removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18__shadow:axjOxKWZOR.Qdjb0q7gVGTcj1StS7Vu_.XIKzkzMlq-AoQNnczhfaM5nG1xabeMK_0 2024-09-12T17:24:40.225 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.225+0000 7f1814ff9640 20 handle_completion(): completion ok for obj=y[axjOxKWZOR.Qdjb0q7gVGTcj1StS7Vu] 2024-09-12T17:24:40.225 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.225+0000 7f1933bd09c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:24:40.228 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.225+0000 7f1933bd09c0 20 get_obj_state: octx=0x55eb79118110 obj=myver:y state=0x55eb793cd098 s->prefetch_data=0 2024-09-12T17:24:40.228 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.229+0000 7f1933bd09c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=wudr6ra4lxvqdrfq2wct2tn61wwcaazv 2024-09-12T17:24:40.234 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.233+0000 7f1933bd09c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.9 2024-09-12T17:24:40.237 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.237+0000 7f1933bd09c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.9 2024-09-12T17:24:40.238 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.237+0000 7f1933bd09c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.9 2024-09-12T17:24:40.239 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.237+0000 7f1933bd09c0 20 get_obj_state: octx=0x55eb79118110 obj=myver:z state=0x55eb793c7638 s->prefetch_data=0 2024-09-12T17:24:40.240 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.237+0000 7f1933bd09c0 20 get_obj_state: setting s->obj_tag to 19jq4h9z5fzb3s8t1wrdjdt0ljcdbrki 2024-09-12T17:24:40.240 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.237+0000 7f1933bd09c0 20 get_obj_state_impl: setting s->olh_tag to 1d0nntqlzhlerjqv6lq3rgdpw599se7h 2024-09-12T17:24:40.240 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.237+0000 7f1933bd09c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=1d0nntqlzhlerjqv6lq3rgdpw599se7h 2024-09-12T17:24:40.243 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.241+0000 7f1933bd09c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.9 2024-09-12T17:24:40.246 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.245+0000 7f1933bd09c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.9 2024-09-12T17:24:40.246 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.245+0000 7f1933bd09c0 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-09-12T17:24:40.247 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.245+0000 7f1933bd09c0 20 olh_log_entry: epoch=2 op=3 key=z[vaaC-UT8oqwJrzZLdO64TkrSGc8jZsD] 2024-09-12T17:24:40.247 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.245+0000 7f1933bd09c0 20 get_obj_state: octx=0x55eb79118110 obj=myver:_:vaaC-UT8oqwJrzZLdO64TkrSGc8jZsD_z state=0x55eb793cabe8 s->prefetch_data=0 2024-09-12T17:24:40.247 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.245+0000 7f1933bd09c0 10 manifest: total_size = 22 2024-09-12T17:24:40.248 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.245+0000 7f1933bd09c0 20 get_obj_state: setting s->obj_tag to 4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16751784146928709658 2024-09-12T17:24:40.248 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.245+0000 7f1933bd09c0 20 get_obj_state: octx=0x55eb79118110 obj=myver:_:vaaC-UT8oqwJrzZLdO64TkrSGc8jZsD_z state=0x55eb793cabe8 s->prefetch_data=0 2024-09-12T17:24:40.248 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.245+0000 7f1933bd09c0 20 prepare_atomic_modification: state is not atomic. state=0x55eb793cabe8 2024-09-12T17:24:40.248 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.245+0000 7f1933bd09c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.9 2024-09-12T17:24:40.253 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.253+0000 7f1933bd09c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:24:40.254 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.253+0000 7f1933bd09c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T17:24:40.254 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.253+0000 7f1933bd09c0 0 deleting objects inline since gc isn't initialized 2024-09-12T17:24:40.254 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.253+0000 7f1933bd09c0 5 delete_objs_inline: removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18__shadow:vaaC-UT8oqwJrzZLdO64TkrSGc8jZsD_.5Z0dfhPt_30tluhHfc7JNeO0LFyD6DV_0 2024-09-12T17:24:40.256 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.257+0000 7f1814ff9640 20 handle_completion(): completion ok for obj=z[vaaC-UT8oqwJrzZLdO64TkrSGc8jZsD] 2024-09-12T17:24:40.257 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.257+0000 7f1933bd09c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:24:40.260 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.257+0000 7f1933bd09c0 20 get_obj_state: octx=0x55eb79118110 obj=myver:z state=0x55eb793c7638 s->prefetch_data=0 2024-09-12T17:24:40.260 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.257+0000 7f1933bd09c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=1d0nntqlzhlerjqv6lq3rgdpw599se7h 2024-09-12T17:24:40.265 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.265+0000 7f1933bd09c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.9 2024-09-12T17:24:40.269 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.269+0000 7f1933bd09c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18.3.9 2024-09-12T17:24:40.269 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.269+0000 7f1933bd09c0 1 NOTICE: finished shard 9 (3 entries removed) 2024-09-12T17:24:40.269 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.269+0000 7f1933bd09c0 1 NOTICE: finished all shards (3 entries removed) 2024-09-12T17:24:40.270 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.269+0000 7f17e77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:40.276 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.273+0000 7f1933bd09c0 20 remove_watcher() i=0 2024-09-12T17:24:40.276 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.273+0000 7f1933bd09c0 2 removed watcher, disabling cache 2024-09-12T17:24:40.278 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.277+0000 7f1933bd09c0 20 remove_watcher() i=1 2024-09-12T17:24:40.281 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.281+0000 7f1933bd09c0 20 remove_watcher() i=2 2024-09-12T17:24:40.284 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.281+0000 7f1933bd09c0 20 remove_watcher() i=3 2024-09-12T17:24:40.286 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.285+0000 7f1933bd09c0 20 remove_watcher() i=4 2024-09-12T17:24:40.288 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.289+0000 7f1933bd09c0 20 remove_watcher() i=5 2024-09-12T17:24:40.290 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.289+0000 7f1933bd09c0 20 remove_watcher() i=6 2024-09-12T17:24:40.292 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.293+0000 7f1933bd09c0 20 remove_watcher() i=7 2024-09-12T17:24:40.370 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T17:24:40.402 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:40.402 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:40.449 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.449+0000 7fd1d61ee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.452 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.449+0000 7fd1d61ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:40.452 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.449+0000 7fd1d61ee9c0 20 realm 2024-09-12T17:24:40.452 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.449+0000 7fd1d61ee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.452 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.449+0000 7fd1d61ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:40.452 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.449+0000 7fd1d61ee9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:24:40.452 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.449+0000 7fd1d61ee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.452 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.449+0000 7fd1d61ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:40.452 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.449+0000 7fd1d61ee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.453 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.453+0000 7fd1d61ee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:40.454 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.453+0000 7fd1d61ee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.455 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.453+0000 7fd1d61ee9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:24:40.455 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.453+0000 7fd1d61ee9c0 20 searching for the correct realm 2024-09-12T17:24:40.458 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.457+0000 7fd1d44f5640 0 -- 172.21.15.16:0/2458254477 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fd1bc018070 msgr2=0x7fd1bc092050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:40.467 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.465+0000 7fd1cb4f3640 0 -- 172.21.15.16:0/2458254477 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fd1cc063600 msgr2=0x7fd1cc069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:24:40.684 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.681+0000 7fd1d61ee9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:24:40.684 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.681+0000 7fd1d61ee9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:24:40.684 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.681+0000 7fd1d61ee9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:24:40.684 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.681+0000 7fd1d61ee9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:24:40.684 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.681+0000 7fd1d61ee9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:24:40.684 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.681+0000 7fd1d61ee9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:24:40.684 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.681+0000 7fd1d61ee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.684 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.681+0000 7fd1d61ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:40.684 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.681+0000 7fd1d61ee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.685 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.685+0000 7fd1d61ee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:24:40.685 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.685+0000 7fd1d61ee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.686 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.685+0000 7fd1d61ee9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:24:40.686 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.685+0000 7fd1d61ee9c0 20 zone default found 2024-09-12T17:24:40.686 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.685+0000 7fd1d61ee9c0 4 Realm: () 2024-09-12T17:24:40.686 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.685+0000 7fd1d61ee9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:24:40.686 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.685+0000 7fd1d61ee9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:24:40.686 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.685+0000 7fd1d61ee9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:24:40.686 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.685+0000 7fd1d61ee9c0 20 zonegroup default 2024-09-12T17:24:40.686 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.685+0000 7fd1d61ee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.687 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.685+0000 7fd1d61ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:40.687 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.685+0000 7fd1d61ee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.687 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.685+0000 7fd1d61ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:40.687 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.685+0000 7fd1d61ee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.688 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.685+0000 7fd1d61ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:24:40.688 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.685+0000 7fd1d61ee9c0 20 started sync module instance, tier type = 2024-09-12T17:24:40.688 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.685+0000 7fd1d61ee9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:24:40.713 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.713+0000 7fd1d61ee9c0 20 add_watcher() i=0 2024-09-12T17:24:40.713 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.713+0000 7fd1d61ee9c0 20 add_watcher() i=1 2024-09-12T17:24:40.713 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.713+0000 7fd1d61ee9c0 20 add_watcher() i=2 2024-09-12T17:24:40.713 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.713+0000 7fd1d61ee9c0 20 add_watcher() i=3 2024-09-12T17:24:40.713 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.713+0000 7fd1d61ee9c0 20 add_watcher() i=4 2024-09-12T17:24:40.713 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.713+0000 7fd1d61ee9c0 20 add_watcher() i=5 2024-09-12T17:24:40.713 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.713+0000 7fd1d61ee9c0 20 add_watcher() i=6 2024-09-12T17:24:40.715 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.713+0000 7fd1d61ee9c0 20 add_watcher() i=7 2024-09-12T17:24:40.715 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.713+0000 7fd1d61ee9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:24:40.719 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.717+0000 7fd089fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:40.720 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.721+0000 7fd1d61ee9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:24:40.721 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.721+0000 7fd1d61ee9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:24:40.721 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.721+0000 7fd1d61ee9c0 5 note: GC not initialized 2024-09-12T17:24:40.721 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.721+0000 7fd088fe1640 20 reqs_thread_entry: start 2024-09-12T17:24:40.721 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.721+0000 7fd1d61ee9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:24:40.722 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.721+0000 7fd1d61ee9c0 20 Filter name: none 2024-09-12T17:24:40.722 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.721+0000 7fd0027fc640 20 reqs_thread_entry: start 2024-09-12T17:24:40.722 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.721+0000 7fd1d61ee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.722 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.721+0000 7fd1d61ee9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T17:24:40.722 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.721+0000 7fd1d61ee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.723 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.721+0000 7fd1d61ee9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T17:24:40.724 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.721+0000 7fd1d61ee9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:40.724 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.721+0000 7fd1d61ee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.724 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.721+0000 7fd1d61ee9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T17:24:40.724 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.721+0000 7fd1d61ee9c0 20 rados->read ofs=0 len=0 2024-09-12T17:24:40.725 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.725+0000 7fd1d61ee9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T17:24:40.725 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.725+0000 7fd1d61ee9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:24:40.729 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.729+0000 7fd089fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:24:40.734 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.733+0000 7fd1d61ee9c0 20 remove_watcher() i=0 2024-09-12T17:24:40.734 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.733+0000 7fd1d61ee9c0 2 removed watcher, disabling cache 2024-09-12T17:24:40.736 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.737+0000 7fd1d61ee9c0 20 remove_watcher() i=1 2024-09-12T17:24:40.739 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.737+0000 7fd1d61ee9c0 20 remove_watcher() i=2 2024-09-12T17:24:40.741 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.741+0000 7fd1d61ee9c0 20 remove_watcher() i=3 2024-09-12T17:24:40.745 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.745+0000 7fd1d61ee9c0 20 remove_watcher() i=4 2024-09-12T17:24:40.746 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.745+0000 7fd1d61ee9c0 20 remove_watcher() i=5 2024-09-12T17:24:40.748 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.745+0000 7fd1d61ee9c0 20 remove_watcher() i=6 2024-09-12T17:24:40.749 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:24:40.749+0000 7fd1d61ee9c0 20 remove_watcher() i=7 2024-09-12T17:24:40.767 INFO:tasks.workunit.client.0.smithi016.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T17:24:40.767 INFO:tasks.workunit.client.0.smithi016.stderr:Deleting bucket a-bucket 2024-09-12T17:24:40.798 INFO:tasks.workunit.client.0.smithi016.stderr:Deleting bucket myver 2024-09-12T17:24:40.942 INFO:tasks.workunit.client.0.smithi016.stderr:Completed resharding tests 2024-09-12T17:24:40.942 INFO:tasks.workunit.client.0.smithi016.stdout:connected to http://localhost:80 2024-09-12T17:24:41.065 INFO:tasks.workunit.client.0.smithi016.stderr:+ deactivate 2024-09-12T17:24:41.065 INFO:tasks.workunit.client.0.smithi016.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-12T17:24:41.065 INFO:tasks.workunit.client.0.smithi016.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T17:24:41.065 INFO:tasks.workunit.client.0.smithi016.stderr:+ export PATH 2024-09-12T17:24:41.065 INFO:tasks.workunit.client.0.smithi016.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T17:24:41.066 INFO:tasks.workunit.client.0.smithi016.stderr:+ '[' -n '' ']' 2024-09-12T17:24:41.066 INFO:tasks.workunit.client.0.smithi016.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:24:41.066 INFO:tasks.workunit.client.0.smithi016.stderr:+ hash -r 2024-09-12T17:24:41.066 INFO:tasks.workunit.client.0.smithi016.stderr:+ '[' -n '' ']' 2024-09-12T17:24:41.066 INFO:tasks.workunit.client.0.smithi016.stderr:+ unset VIRTUAL_ENV 2024-09-12T17:24:41.066 INFO:tasks.workunit.client.0.smithi016.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-12T17:24:41.066 INFO:tasks.workunit.client.0.smithi016.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T17:24:41.066 INFO:tasks.workunit.client.0.smithi016.stderr:+ unset -f deactivate 2024-09-12T17:24:41.066 INFO:tasks.workunit.client.0.smithi016.stderr:+ echo OK. 2024-09-12T17:24:41.067 INFO:tasks.workunit.client.0.smithi016.stdout:OK. 2024-09-12T17:24:41.068 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:24:41.068 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:24:41.122 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-09-12T17:24:41.122 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:24:41.558 DEBUG:teuthology.parallel:result is None 2024-09-12T17:24:41.558 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:24:41.571 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:24:41.571 DEBUG:teuthology.orchestra.run.smithi016:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:24:41.617 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:24:41.617 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-09-12T17:24:41.632 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-09-12T17:24:41.633 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-09-12T17:24:41.633 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-09-12T17:24:41.633 DEBUG:teuthology.orchestra.run.smithi016:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-09-12T17:24:41.665 INFO:teuthology.orchestra.run.smithi016.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-09-12T17:24:46.513 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-09-12T17:24:46.514 DEBUG:teuthology.orchestra.run.smithi016:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-09-12T17:24:46.606 INFO:teuthology.orchestra.run.smithi016.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required DEB packages. Installing via sudo. 2024-09-12T17:24:46.668 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2024-09-12T17:24:46.866 INFO:teuthology.orchestra.run.smithi016.stdout:Building dependency tree... 2024-09-12T17:24:46.866 INFO:teuthology.orchestra.run.smithi016.stdout:Reading state information... 2024-09-12T17:24:47.061 INFO:teuthology.orchestra.run.smithi016.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:24:47.061 INFO:teuthology.orchestra.run.smithi016.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:24:47.061 INFO:teuthology.orchestra.run.smithi016.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:24:47.061 INFO:teuthology.orchestra.run.smithi016.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:24:47.062 INFO:teuthology.orchestra.run.smithi016.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T17:24:47.062 INFO:teuthology.orchestra.run.smithi016.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T17:24:47.062 INFO:teuthology.orchestra.run.smithi016.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:24:47.062 INFO:teuthology.orchestra.run.smithi016.stdout:The following additional packages will be installed: 2024-09-12T17:24:47.063 INFO:teuthology.orchestra.run.smithi016.stdout: libgail-common libgail18 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common 2024-09-12T17:24:47.063 INFO:teuthology.orchestra.run.smithi016.stdout: openjdk-8-jdk-headless openjdk-8-jre openjdk-8-jre-headless 2024-09-12T17:24:47.065 INFO:teuthology.orchestra.run.smithi016.stdout:Suggested packages: 2024-09-12T17:24:47.065 INFO:teuthology.orchestra.run.smithi016.stdout: gvfs openjdk-8-demo openjdk-8-source visualvm libnss-mdns fonts-nanum 2024-09-12T17:24:47.065 INFO:teuthology.orchestra.run.smithi016.stdout: fonts-ipafont-gothic fonts-ipafont-mincho fonts-wqy-microhei 2024-09-12T17:24:47.065 INFO:teuthology.orchestra.run.smithi016.stdout: fonts-wqy-zenhei fonts-indic 2024-09-12T17:24:47.102 INFO:teuthology.orchestra.run.smithi016.stdout:The following NEW packages will be installed: 2024-09-12T17:24:47.102 INFO:teuthology.orchestra.run.smithi016.stdout: libgail-common libgail18 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common 2024-09-12T17:24:47.103 INFO:teuthology.orchestra.run.smithi016.stdout: openjdk-8-jdk openjdk-8-jdk-headless openjdk-8-jre openjdk-8-jre-headless 2024-09-12T17:24:47.156 INFO:teuthology.orchestra.run.smithi016.stdout:0 upgraded, 9 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T17:24:47.156 INFO:teuthology.orchestra.run.smithi016.stdout:Need to get 46.0 MB of archives. 2024-09-12T17:24:47.156 INFO:teuthology.orchestra.run.smithi016.stdout:After this operation, 155 MB of additional disk space will be used. 2024-09-12T17:24:47.156 INFO:teuthology.orchestra.run.smithi016.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-common all 2.24.33-2ubuntu2.1 [125 kB] 2024-09-12T17:24:48.371 INFO:teuthology.orchestra.run.smithi016.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-0 amd64 2.24.33-2ubuntu2.1 [2,038 kB] 2024-09-12T17:24:48.457 INFO:teuthology.orchestra.run.smithi016.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgail18 amd64 2.24.33-2ubuntu2.1 [15.9 kB] 2024-09-12T17:24:48.457 INFO:teuthology.orchestra.run.smithi016.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgail-common amd64 2.24.33-2ubuntu2.1 [132 kB] 2024-09-12T17:24:48.461 INFO:teuthology.orchestra.run.smithi016.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-bin amd64 2.24.33-2ubuntu2.1 [7,936 B] 2024-09-12T17:24:48.461 INFO:teuthology.orchestra.run.smithi016.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jre-headless amd64 8u422-b05-1~22.04 [30.8 MB] 2024-09-12T17:24:48.900 INFO:teuthology.orchestra.run.smithi016.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jre amd64 8u422-b05-1~22.04 [75.5 kB] 2024-09-12T17:24:48.900 INFO:teuthology.orchestra.run.smithi016.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jdk-headless amd64 8u422-b05-1~22.04 [8,843 kB] 2024-09-12T17:24:48.986 INFO:teuthology.orchestra.run.smithi016.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jdk amd64 8u422-b05-1~22.04 [4,012 kB] 2024-09-12T17:24:49.332 INFO:teuthology.orchestra.run.smithi016.stderr:debconf: unable to initialize frontend: Dialog 2024-09-12T17:24:49.333 INFO:teuthology.orchestra.run.smithi016.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2024-09-12T17:24:49.333 INFO:teuthology.orchestra.run.smithi016.stderr:debconf: falling back to frontend: Readline 2024-09-12T17:24:49.345 INFO:teuthology.orchestra.run.smithi016.stderr:debconf: unable to initialize frontend: Readline 2024-09-12T17:24:49.345 INFO:teuthology.orchestra.run.smithi016.stderr:debconf: (This frontend requires a controlling tty.) 2024-09-12T17:24:49.345 INFO:teuthology.orchestra.run.smithi016.stderr:debconf: falling back to frontend: Teletype 2024-09-12T17:24:49.348 INFO:teuthology.orchestra.run.smithi016.stderr:dpkg-preconfigure: unable to re-open stdin: 2024-09-12T17:24:49.384 INFO:teuthology.orchestra.run.smithi016.stdout:Fetched 46.0 MB in 2s (24.2 MB/s) 2024-09-12T17:24:49.494 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libgtk2.0-common. 2024-09-12T17:24:49.586 INFO:teuthology.orchestra.run.smithi016.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 177243 files and directories currently installed.) 2024-09-12T17:24:49.591 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../0-libgtk2.0-common_2.24.33-2ubuntu2.1_all.deb ... 2024-09-12T17:24:49.635 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libgtk2.0-common (2.24.33-2ubuntu2.1) ... 2024-09-12T17:24:49.997 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libgtk2.0-0:amd64. 2024-09-12T17:24:50.027 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../1-libgtk2.0-0_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T17:24:50.122 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libgtk2.0-0:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T17:24:50.577 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libgail18:amd64. 2024-09-12T17:24:50.606 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../2-libgail18_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T17:24:50.643 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libgail18:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T17:24:50.879 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libgail-common:amd64. 2024-09-12T17:24:50.896 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../3-libgail-common_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T17:24:50.929 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libgail-common:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T17:24:51.174 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libgtk2.0-bin. 2024-09-12T17:24:51.192 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../4-libgtk2.0-bin_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T17:24:51.232 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libgtk2.0-bin (2.24.33-2ubuntu2.1) ... 2024-09-12T17:24:51.669 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package openjdk-8-jre-headless:amd64. 2024-09-12T17:24:51.699 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../5-openjdk-8-jre-headless_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T17:24:51.747 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking openjdk-8-jre-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T17:24:53.366 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package openjdk-8-jre:amd64. 2024-09-12T17:24:53.395 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../6-openjdk-8-jre_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T17:24:53.436 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking openjdk-8-jre:amd64 (8u422-b05-1~22.04) ... 2024-09-12T17:24:53.913 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package openjdk-8-jdk-headless:amd64. 2024-09-12T17:24:53.942 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../7-openjdk-8-jdk-headless_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T17:24:53.982 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking openjdk-8-jdk-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T17:24:54.775 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package openjdk-8-jdk:amd64. 2024-09-12T17:24:54.804 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../8-openjdk-8-jdk_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T17:24:54.845 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking openjdk-8-jdk:amd64 (8u422-b05-1~22.04) ... 2024-09-12T17:24:55.230 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up openjdk-8-jre-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T17:24:56.292 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/orbd to provide /usr/bin/orbd (orbd) in auto mode 2024-09-12T17:24:56.318 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/servertool to provide /usr/bin/servertool (servertool) in auto mode 2024-09-12T17:24:56.343 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/tnameserv to provide /usr/bin/tnameserv (tnameserv) in auto mode 2024-09-12T17:24:56.717 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libgtk2.0-common (2.24.33-2ubuntu2.1) ... 2024-09-12T17:24:56.885 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libgtk2.0-0:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T17:24:57.237 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up openjdk-8-jre:amd64 (8u422-b05-1~22.04) ... 2024-09-12T17:24:57.330 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/policytool to provide /usr/bin/policytool (policytool) in auto mode 2024-09-12T17:24:57.389 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up openjdk-8-jdk-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T17:24:57.482 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/clhsdb to provide /usr/bin/clhsdb (clhsdb) in auto mode 2024-09-12T17:24:57.510 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/extcheck to provide /usr/bin/extcheck (extcheck) in auto mode 2024-09-12T17:24:57.537 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/hsdb to provide /usr/bin/hsdb (hsdb) in auto mode 2024-09-12T17:24:57.561 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/idlj to provide /usr/bin/idlj (idlj) in auto mode 2024-09-12T17:24:57.671 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/javah to provide /usr/bin/javah (javah) in auto mode 2024-09-12T17:24:57.823 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jhat to provide /usr/bin/jhat (jhat) in auto mode 2024-09-12T17:24:57.934 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jsadebugd to provide /usr/bin/jsadebugd (jsadebugd) in auto mode 2024-09-12T17:24:58.035 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/native2ascii to provide /usr/bin/native2ascii (native2ascii) in auto mode 2024-09-12T17:24:58.086 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/schemagen to provide /usr/bin/schemagen (schemagen) in auto mode 2024-09-12T17:24:58.179 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsgen to provide /usr/bin/wsgen (wsgen) in auto mode 2024-09-12T17:24:58.205 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsimport to provide /usr/bin/wsimport (wsimport) in auto mode 2024-09-12T17:24:58.231 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/xjc to provide /usr/bin/xjc (xjc) in auto mode 2024-09-12T17:24:58.312 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libgail18:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T17:24:58.413 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libgtk2.0-bin (2.24.33-2ubuntu2.1) ... 2024-09-12T17:24:58.530 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up openjdk-8-jdk:amd64 (8u422-b05-1~22.04) ... 2024-09-12T17:24:58.615 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/appletviewer to provide /usr/bin/appletviewer (appletviewer) in auto mode 2024-09-12T17:24:58.699 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libgail-common:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T17:24:58.818 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T17:24:59.928 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T17:25:00.037 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-12T17:25:00.297 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T17:25:00.771 INFO:teuthology.orchestra.run.smithi016.stdout: Gradle will be installed under /opt/gradle 2024-09-12T17:25:00.816 INFO:teuthology.orchestra.run.smithi016.stderr:--2024-09-12 17:25:00-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-09-12T17:25:00.819 INFO:teuthology.orchestra.run.smithi016.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.72.101, 104.16.73.101, 2606:4700::6810:4965, ... 2024-09-12T17:25:00.828 INFO:teuthology.orchestra.run.smithi016.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.72.101|:443... connected. 2024-09-12T17:25:00.872 INFO:teuthology.orchestra.run.smithi016.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-09-12T17:25:00.872 INFO:teuthology.orchestra.run.smithi016.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-09-12T17:25:00.872 INFO:teuthology.orchestra.run.smithi016.stderr:--2024-09-12 17:25:00-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-09-12T17:25:00.873 INFO:teuthology.orchestra.run.smithi016.stderr:Resolving github.com (github.com)... 140.82.113.3 2024-09-12T17:25:00.886 INFO:teuthology.orchestra.run.smithi016.stderr:Connecting to github.com (github.com)|140.82.113.3|:443... connected. 2024-09-12T17:25:01.002 INFO:teuthology.orchestra.run.smithi016.stderr:HTTP request sent, awaiting response... 302 Found 2024-09-12T17:25:01.002 INFO:teuthology.orchestra.run.smithi016.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T172500Z&X-Amz-Expires=300&X-Amz-Signature=f5503fe0273973d1ea99efac9e76c02daebb119ce1c75b7f69a6ffb11c3da79e&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-09-12T17:25:01.002 INFO:teuthology.orchestra.run.smithi016.stderr:--2024-09-12 17:25:01-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T172500Z&X-Amz-Expires=300&X-Amz-Signature=f5503fe0273973d1ea99efac9e76c02daebb119ce1c75b7f69a6ffb11c3da79e&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-09-12T17:25:01.004 INFO:teuthology.orchestra.run.smithi016.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.110.133, 185.199.111.133, 185.199.109.133, ... 2024-09-12T17:25:01.016 INFO:teuthology.orchestra.run.smithi016.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.110.133|:443... connected. 2024-09-12T17:25:01.107 INFO:teuthology.orchestra.run.smithi016.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-12T17:25:01.107 INFO:teuthology.orchestra.run.smithi016.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-09-12T17:25:01.107 INFO:teuthology.orchestra.run.smithi016.stderr:Saving to: 'gradle-6.0.1-bin.zip' 2024-09-12T17:25:01.107 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-09-12T17:25:01.119 INFO:teuthology.orchestra.run.smithi016.stderr: 0K .......... .......... .......... .......... .......... 0% 3.70M 25s 2024-09-12T17:25:01.131 INFO:teuthology.orchestra.run.smithi016.stderr: 50K .......... .......... .......... .......... .......... 0% 3.95M 24s 2024-09-12T17:25:01.133 INFO:teuthology.orchestra.run.smithi016.stderr: 100K .......... .......... .......... .......... .......... 0% 24.8M 17s 2024-09-12T17:25:01.136 INFO:teuthology.orchestra.run.smithi016.stderr: 150K .......... .......... .......... .......... .......... 0% 20.3M 14s 2024-09-12T17:25:01.144 INFO:teuthology.orchestra.run.smithi016.stderr: 200K .......... .......... .......... .......... .......... 0% 5.94M 14s 2024-09-12T17:25:01.147 INFO:teuthology.orchestra.run.smithi016.stderr: 250K .......... .......... .......... .......... .......... 0% 40.1M 12s 2024-09-12T17:25:01.147 INFO:teuthology.orchestra.run.smithi016.stderr: 300K .......... .......... .......... .......... .......... 0% 36.7M 11s 2024-09-12T17:25:01.149 INFO:teuthology.orchestra.run.smithi016.stderr: 350K .......... .......... .......... .......... .......... 0% 33.5M 10s 2024-09-12T17:25:01.149 INFO:teuthology.orchestra.run.smithi016.stderr: 400K .......... .......... .......... .......... .......... 0% 87.8M 9s 2024-09-12T17:25:01.164 INFO:teuthology.orchestra.run.smithi016.stderr: 450K .......... .......... .......... .......... .......... 0% 5.49M 10s 2024-09-12T17:25:01.164 INFO:teuthology.orchestra.run.smithi016.stderr: 500K .......... .......... .......... .......... .......... 0% 69.6M 9s 2024-09-12T17:25:01.165 INFO:teuthology.orchestra.run.smithi016.stderr: 550K .......... .......... .......... .......... .......... 0% 51.5M 8s 2024-09-12T17:25:01.165 INFO:teuthology.orchestra.run.smithi016.stderr: 600K .......... .......... .......... .......... .......... 0% 126M 8s 2024-09-12T17:25:01.165 INFO:teuthology.orchestra.run.smithi016.stderr: 650K .......... .......... .......... .......... .......... 0% 110M 7s 2024-09-12T17:25:01.165 INFO:teuthology.orchestra.run.smithi016.stderr: 700K .......... .......... .......... .......... .......... 0% 58.1M 7s 2024-09-12T17:25:01.165 INFO:teuthology.orchestra.run.smithi016.stderr: 750K .......... .......... .......... .......... .......... 0% 65.0M 6s 2024-09-12T17:25:01.165 INFO:teuthology.orchestra.run.smithi016.stderr: 800K .......... .......... .......... .......... .......... 0% 78.9M 6s 2024-09-12T17:25:01.165 INFO:teuthology.orchestra.run.smithi016.stderr: 850K .......... .......... .......... .......... .......... 0% 126M 6s 2024-09-12T17:25:01.165 INFO:teuthology.orchestra.run.smithi016.stderr: 900K .......... .......... .......... .......... .......... 1% 59.8M 6s 2024-09-12T17:25:02.296 INFO:teuthology.orchestra.run.smithi016.stderr: 950K .......... .......... .......... .......... .......... 1% 7.11M 6s 2024-09-12T17:25:02.297 INFO:teuthology.orchestra.run.smithi016.stderr: 1000K .......... .......... .......... .......... .......... 1% 101M 6s 2024-09-12T17:25:02.297 INFO:teuthology.orchestra.run.smithi016.stderr: 1050K .......... .......... .......... .......... .......... 1% 126M 5s 2024-09-12T17:25:02.297 INFO:teuthology.orchestra.run.smithi016.stderr: 1100K .......... .......... .......... .......... .......... 1% 80.3M 5s 2024-09-12T17:25:02.297 INFO:teuthology.orchestra.run.smithi016.stderr: 1150K .......... .......... .......... .......... .......... 1% 84.7M 5s 2024-09-12T17:25:02.297 INFO:teuthology.orchestra.run.smithi016.stderr: 1200K .......... .......... .......... .......... .......... 1% 74.9M 5s 2024-09-12T17:25:02.297 INFO:teuthology.orchestra.run.smithi016.stderr: 1250K .......... .......... .......... .......... .......... 1% 92.1M 5s 2024-09-12T17:25:02.297 INFO:teuthology.orchestra.run.smithi016.stderr: 1300K .......... .......... .......... .......... .......... 1% 106M 5s 2024-09-12T17:25:02.297 INFO:teuthology.orchestra.run.smithi016.stderr: 1350K .......... .......... .......... .......... .......... 1% 99.5M 4s 2024-09-12T17:25:02.297 INFO:teuthology.orchestra.run.smithi016.stderr: 1400K .......... .......... .......... .......... .......... 1% 120M 4s 2024-09-12T17:25:02.297 INFO:teuthology.orchestra.run.smithi016.stderr: 1450K .......... .......... .......... .......... .......... 1% 121M 4s 2024-09-12T17:25:02.297 INFO:teuthology.orchestra.run.smithi016.stderr: 1500K .......... .......... .......... .......... .......... 1% 80.1M 4s 2024-09-12T17:25:02.297 INFO:teuthology.orchestra.run.smithi016.stderr: 1550K .......... .......... .......... .......... .......... 1% 91.1M 4s 2024-09-12T17:25:02.298 INFO:teuthology.orchestra.run.smithi016.stderr: 1600K .......... .......... .......... .......... .......... 1% 80.4M 4s 2024-09-12T17:25:02.298 INFO:teuthology.orchestra.run.smithi016.stderr: 1650K .......... .......... .......... .......... .......... 1% 85.6M 4s 2024-09-12T17:25:02.298 INFO:teuthology.orchestra.run.smithi016.stderr: 1700K .......... .......... .......... .......... .......... 1% 93.7M 4s 2024-09-12T17:25:02.298 INFO:teuthology.orchestra.run.smithi016.stderr: 1750K .......... .......... .......... .......... .......... 1% 102M 4s 2024-09-12T17:25:02.298 INFO:teuthology.orchestra.run.smithi016.stderr: 1800K .......... .......... .......... .......... .......... 1% 131M 4s 2024-09-12T17:25:02.298 INFO:teuthology.orchestra.run.smithi016.stderr: 1850K .......... .......... .......... .......... .......... 2% 126M 4s 2024-09-12T17:25:02.298 INFO:teuthology.orchestra.run.smithi016.stderr: 1900K .......... .......... .......... .......... .......... 2% 104M 3s 2024-09-12T17:25:02.298 INFO:teuthology.orchestra.run.smithi016.stderr: 1950K .......... .......... .......... .......... .......... 2% 17.6M 3s 2024-09-12T17:25:02.298 INFO:teuthology.orchestra.run.smithi016.stderr: 2000K .......... .......... .......... .......... .......... 2% 105M 3s 2024-09-12T17:25:02.298 INFO:teuthology.orchestra.run.smithi016.stderr: 2050K .......... .......... .......... .......... .......... 2% 120M 3s 2024-09-12T17:25:02.298 INFO:teuthology.orchestra.run.smithi016.stderr: 2100K .......... .......... .......... .......... .......... 2% 108M 3s 2024-09-12T17:25:02.298 INFO:teuthology.orchestra.run.smithi016.stderr: 2150K .......... .......... .......... .......... .......... 2% 115M 3s 2024-09-12T17:25:02.298 INFO:teuthology.orchestra.run.smithi016.stderr: 2200K .......... .......... .......... .......... .......... 2% 109M 3s 2024-09-12T17:25:02.299 INFO:teuthology.orchestra.run.smithi016.stderr: 2250K .......... .......... .......... .......... .......... 2% 113M 3s 2024-09-12T17:25:02.299 INFO:teuthology.orchestra.run.smithi016.stderr: 2300K .......... .......... .......... .......... .......... 2% 95.0M 3s 2024-09-12T17:25:02.299 INFO:teuthology.orchestra.run.smithi016.stderr: 2350K .......... .......... .......... .......... .......... 2% 64.9M 3s 2024-09-12T17:25:02.299 INFO:teuthology.orchestra.run.smithi016.stderr: 2400K .......... .......... .......... .......... .......... 2% 72.2M 3s 2024-09-12T17:25:02.299 INFO:teuthology.orchestra.run.smithi016.stderr: 2450K .......... .......... .......... .......... .......... 2% 75.4M 3s 2024-09-12T17:25:02.299 INFO:teuthology.orchestra.run.smithi016.stderr: 2500K .......... .......... .......... .......... .......... 2% 65.3M 3s 2024-09-12T17:25:02.299 INFO:teuthology.orchestra.run.smithi016.stderr: 2550K .......... .......... .......... .......... .......... 2% 74.3M 3s 2024-09-12T17:25:02.299 INFO:teuthology.orchestra.run.smithi016.stderr: 2600K .......... .......... .......... .......... .......... 2% 72.6M 3s 2024-09-12T17:25:02.299 INFO:teuthology.orchestra.run.smithi016.stderr: 2650K .......... .......... .......... .......... .......... 2% 75.5M 3s 2024-09-12T17:25:02.299 INFO:teuthology.orchestra.run.smithi016.stderr: 2700K .......... .......... .......... .......... .......... 2% 65.9M 3s 2024-09-12T17:25:02.299 INFO:teuthology.orchestra.run.smithi016.stderr: 2750K .......... .......... .......... .......... .......... 3% 82.4M 3s 2024-09-12T17:25:02.299 INFO:teuthology.orchestra.run.smithi016.stderr: 2800K .......... .......... .......... .......... .......... 3% 81.8M 3s 2024-09-12T17:25:02.299 INFO:teuthology.orchestra.run.smithi016.stderr: 2850K .......... .......... .......... .......... .......... 3% 77.4M 3s 2024-09-12T17:25:02.300 INFO:teuthology.orchestra.run.smithi016.stderr: 2900K .......... .......... .......... .......... .......... 3% 71.0M 3s 2024-09-12T17:25:02.300 INFO:teuthology.orchestra.run.smithi016.stderr: 2950K .......... .......... .......... .......... .......... 3% 82.4M 3s 2024-09-12T17:25:02.300 INFO:teuthology.orchestra.run.smithi016.stderr: 3000K .......... .......... .......... .......... .......... 3% 82.5M 3s 2024-09-12T17:25:02.300 INFO:teuthology.orchestra.run.smithi016.stderr: 3050K .......... .......... .......... .......... .......... 3% 83.0M 3s 2024-09-12T17:25:02.300 INFO:teuthology.orchestra.run.smithi016.stderr: 3100K .......... .......... .......... .......... .......... 3% 66.2M 3s 2024-09-12T17:25:02.300 INFO:teuthology.orchestra.run.smithi016.stderr: 3150K .......... .......... .......... .......... .......... 3% 72.6M 3s 2024-09-12T17:25:02.300 INFO:teuthology.orchestra.run.smithi016.stderr: 3200K .......... .......... .......... .......... .......... 3% 78.1M 3s 2024-09-12T17:25:02.300 INFO:teuthology.orchestra.run.smithi016.stderr: 3250K .......... .......... .......... .......... .......... 3% 73.5M 3s 2024-09-12T17:25:02.300 INFO:teuthology.orchestra.run.smithi016.stderr: 3300K .......... .......... .......... .......... .......... 3% 69.6M 2s 2024-09-12T17:25:02.300 INFO:teuthology.orchestra.run.smithi016.stderr: 3350K .......... .......... .......... .......... .......... 3% 76.7M 2s 2024-09-12T17:25:02.300 INFO:teuthology.orchestra.run.smithi016.stderr: 3400K .......... .......... .......... .......... .......... 3% 73.0M 2s 2024-09-12T17:25:02.300 INFO:teuthology.orchestra.run.smithi016.stderr: 3450K .......... .......... .......... .......... .......... 3% 71.5M 2s 2024-09-12T17:25:02.301 INFO:teuthology.orchestra.run.smithi016.stderr: 3500K .......... .......... .......... .......... .......... 3% 64.6M 2s 2024-09-12T17:25:02.301 INFO:teuthology.orchestra.run.smithi016.stderr: 3550K .......... .......... .......... .......... .......... 3% 83.7M 2s 2024-09-12T17:25:02.301 INFO:teuthology.orchestra.run.smithi016.stderr: 3600K .......... .......... .......... .......... .......... 3% 78.9M 2s 2024-09-12T17:25:02.301 INFO:teuthology.orchestra.run.smithi016.stderr: 3650K .......... .......... .......... .......... .......... 3% 80.4M 2s 2024-09-12T17:25:02.301 INFO:teuthology.orchestra.run.smithi016.stderr: 3700K .......... .......... .......... .......... .......... 4% 71.6M 2s 2024-09-12T17:25:02.301 INFO:teuthology.orchestra.run.smithi016.stderr: 3750K .......... .......... .......... .......... .......... 4% 75.2M 2s 2024-09-12T17:25:02.301 INFO:teuthology.orchestra.run.smithi016.stderr: 3800K .......... .......... .......... .......... .......... 4% 78.6M 2s 2024-09-12T17:25:02.301 INFO:teuthology.orchestra.run.smithi016.stderr: 3850K .......... .......... .......... .......... .......... 4% 82.4M 2s 2024-09-12T17:25:02.301 INFO:teuthology.orchestra.run.smithi016.stderr: 3900K .......... .......... .......... .......... .......... 4% 66.7M 2s 2024-09-12T17:25:02.301 INFO:teuthology.orchestra.run.smithi016.stderr: 3950K .......... .......... .......... .......... .......... 4% 80.0M 2s 2024-09-12T17:25:02.301 INFO:teuthology.orchestra.run.smithi016.stderr: 4000K .......... .......... .......... .......... .......... 4% 83.4M 2s 2024-09-12T17:25:02.301 INFO:teuthology.orchestra.run.smithi016.stderr: 4050K .......... .......... .......... .......... .......... 4% 77.3M 2s 2024-09-12T17:25:02.301 INFO:teuthology.orchestra.run.smithi016.stderr: 4100K .......... .......... .......... .......... .......... 4% 72.0M 2s 2024-09-12T17:25:02.302 INFO:teuthology.orchestra.run.smithi016.stderr: 4150K .......... .......... .......... .......... .......... 4% 84.9M 2s 2024-09-12T17:25:02.302 INFO:teuthology.orchestra.run.smithi016.stderr: 4200K .......... .......... .......... .......... .......... 4% 80.6M 2s 2024-09-12T17:25:02.302 INFO:teuthology.orchestra.run.smithi016.stderr: 4250K .......... .......... .......... .......... .......... 4% 82.8M 2s 2024-09-12T17:25:02.302 INFO:teuthology.orchestra.run.smithi016.stderr: 4300K .......... .......... .......... .......... .......... 4% 65.0M 2s 2024-09-12T17:25:02.302 INFO:teuthology.orchestra.run.smithi016.stderr: 4350K .......... .......... .......... .......... .......... 4% 76.4M 2s 2024-09-12T17:25:02.302 INFO:teuthology.orchestra.run.smithi016.stderr: 4400K .......... .......... .......... .......... .......... 4% 72.4M 2s 2024-09-12T17:25:02.302 INFO:teuthology.orchestra.run.smithi016.stderr: 4450K .......... .......... .......... .......... .......... 4% 75.7M 2s 2024-09-12T17:25:02.302 INFO:teuthology.orchestra.run.smithi016.stderr: 4500K .......... .......... .......... .......... .......... 4% 67.1M 2s 2024-09-12T17:25:02.302 INFO:teuthology.orchestra.run.smithi016.stderr: 4550K .......... .......... .......... .......... .......... 4% 84.0M 2s 2024-09-12T17:25:02.302 INFO:teuthology.orchestra.run.smithi016.stderr: 4600K .......... .......... .......... .......... .......... 5% 80.2M 2s 2024-09-12T17:25:02.302 INFO:teuthology.orchestra.run.smithi016.stderr: 4650K .......... .......... .......... .......... .......... 5% 77.8M 2s 2024-09-12T17:25:02.302 INFO:teuthology.orchestra.run.smithi016.stderr: 4700K .......... .......... .......... .......... .......... 5% 60.3M 2s 2024-09-12T17:25:02.302 INFO:teuthology.orchestra.run.smithi016.stderr: 4750K .......... .......... .......... .......... .......... 5% 86.4M 2s 2024-09-12T17:25:02.303 INFO:teuthology.orchestra.run.smithi016.stderr: 4800K .......... .......... .......... .......... .......... 5% 85.1M 2s 2024-09-12T17:25:02.303 INFO:teuthology.orchestra.run.smithi016.stderr: 4850K .......... .......... .......... .......... .......... 5% 84.6M 2s 2024-09-12T17:25:02.303 INFO:teuthology.orchestra.run.smithi016.stderr: 4900K .......... .......... .......... .......... .......... 5% 79.2M 2s 2024-09-12T17:25:02.303 INFO:teuthology.orchestra.run.smithi016.stderr: 4950K .......... .......... .......... .......... .......... 5% 81.5M 2s 2024-09-12T17:25:02.303 INFO:teuthology.orchestra.run.smithi016.stderr: 5000K .......... .......... .......... .......... .......... 5% 79.3M 2s 2024-09-12T17:25:02.303 INFO:teuthology.orchestra.run.smithi016.stderr: 5050K .......... .......... .......... .......... .......... 5% 88.6M 2s 2024-09-12T17:25:02.303 INFO:teuthology.orchestra.run.smithi016.stderr: 5100K .......... .......... .......... .......... .......... 5% 78.8M 2s 2024-09-12T17:25:02.303 INFO:teuthology.orchestra.run.smithi016.stderr: 5150K .......... .......... .......... .......... .......... 5% 86.5M 2s 2024-09-12T17:25:02.303 INFO:teuthology.orchestra.run.smithi016.stderr: 5200K .......... .......... .......... .......... .......... 5% 87.2M 2s 2024-09-12T17:25:02.303 INFO:teuthology.orchestra.run.smithi016.stderr: 5250K .......... .......... .......... .......... .......... 5% 92.6M 2s 2024-09-12T17:25:02.303 INFO:teuthology.orchestra.run.smithi016.stderr: 5300K .......... .......... .......... .......... .......... 5% 81.7M 2s 2024-09-12T17:25:02.303 INFO:teuthology.orchestra.run.smithi016.stderr: 5350K .......... .......... .......... .......... .......... 5% 92.0M 2s 2024-09-12T17:25:02.303 INFO:teuthology.orchestra.run.smithi016.stderr: 5400K .......... .......... .......... .......... .......... 5% 90.4M 2s 2024-09-12T17:25:02.303 INFO:teuthology.orchestra.run.smithi016.stderr: 5450K .......... .......... .......... .......... .......... 5% 89.3M 2s 2024-09-12T17:25:02.304 INFO:teuthology.orchestra.run.smithi016.stderr: 5500K .......... .......... .......... .......... .......... 5% 79.1M 2s 2024-09-12T17:25:02.304 INFO:teuthology.orchestra.run.smithi016.stderr: 5550K .......... .......... .......... .......... .......... 6% 97.1M 2s 2024-09-12T17:25:02.304 INFO:teuthology.orchestra.run.smithi016.stderr: 5600K .......... .......... .......... .......... .......... 6% 99.0M 2s 2024-09-12T17:25:02.304 INFO:teuthology.orchestra.run.smithi016.stderr: 5650K .......... .......... .......... .......... .......... 6% 99.1M 2s 2024-09-12T17:25:02.304 INFO:teuthology.orchestra.run.smithi016.stderr: 5700K .......... .......... .......... .......... .......... 6% 87.7M 2s 2024-09-12T17:25:02.304 INFO:teuthology.orchestra.run.smithi016.stderr: 5750K .......... .......... .......... .......... .......... 6% 99.1M 2s 2024-09-12T17:25:02.304 INFO:teuthology.orchestra.run.smithi016.stderr: 5800K .......... .......... .......... .......... .......... 6% 155M 2s 2024-09-12T17:25:02.304 INFO:teuthology.orchestra.run.smithi016.stderr: 5850K .......... .......... .......... .......... .......... 6% 141M 2s 2024-09-12T17:25:02.304 INFO:teuthology.orchestra.run.smithi016.stderr: 5900K .......... .......... .......... .......... .......... 6% 154M 2s 2024-09-12T17:25:02.304 INFO:teuthology.orchestra.run.smithi016.stderr: 5950K .......... .......... .......... .......... .......... 6% 186M 2s 2024-09-12T17:25:02.304 INFO:teuthology.orchestra.run.smithi016.stderr: 6000K .......... .......... .......... .......... .......... 6% 165M 2s 2024-09-12T17:25:02.304 INFO:teuthology.orchestra.run.smithi016.stderr: 6050K .......... .......... .......... .......... .......... 6% 199M 2s 2024-09-12T17:25:02.304 INFO:teuthology.orchestra.run.smithi016.stderr: 6100K .......... .......... .......... .......... .......... 6% 168M 2s 2024-09-12T17:25:02.304 INFO:teuthology.orchestra.run.smithi016.stderr: 6150K .......... .......... .......... .......... .......... 6% 162M 2s 2024-09-12T17:25:02.305 INFO:teuthology.orchestra.run.smithi016.stderr: 6200K .......... .......... .......... .......... .......... 6% 174M 2s 2024-09-12T17:25:02.305 INFO:teuthology.orchestra.run.smithi016.stderr: 6250K .......... .......... .......... .......... .......... 6% 161M 2s 2024-09-12T17:25:02.305 INFO:teuthology.orchestra.run.smithi016.stderr: 6300K .......... .......... .......... .......... .......... 6% 149M 2s 2024-09-12T17:25:02.305 INFO:teuthology.orchestra.run.smithi016.stderr: 6350K .......... .......... .......... .......... .......... 6% 185M 2s 2024-09-12T17:25:02.305 INFO:teuthology.orchestra.run.smithi016.stderr: 6400K .......... .......... .......... .......... .......... 6% 158M 2s 2024-09-12T17:25:02.305 INFO:teuthology.orchestra.run.smithi016.stderr: 6450K .......... .......... .......... .......... .......... 6% 160M 2s 2024-09-12T17:25:02.305 INFO:teuthology.orchestra.run.smithi016.stderr: 6500K .......... .......... .......... .......... .......... 7% 149M 2s 2024-09-12T17:25:02.305 INFO:teuthology.orchestra.run.smithi016.stderr: 6550K .......... .......... .......... .......... .......... 7% 146M 2s 2024-09-12T17:25:02.305 INFO:teuthology.orchestra.run.smithi016.stderr: 6600K .......... .......... .......... .......... .......... 7% 182M 2s 2024-09-12T17:25:02.305 INFO:teuthology.orchestra.run.smithi016.stderr: 6650K .......... .......... .......... .......... .......... 7% 189M 2s 2024-09-12T17:25:02.305 INFO:teuthology.orchestra.run.smithi016.stderr: 6700K .......... .......... .......... .......... .......... 7% 152M 2s 2024-09-12T17:25:02.305 INFO:teuthology.orchestra.run.smithi016.stderr: 6750K .......... .......... .......... .......... .......... 7% 199M 2s 2024-09-12T17:25:02.306 INFO:teuthology.orchestra.run.smithi016.stderr: 6800K .......... .......... .......... .......... .......... 7% 198M 2s 2024-09-12T17:25:02.306 INFO:teuthology.orchestra.run.smithi016.stderr: 6850K .......... .......... .......... .......... .......... 7% 199M 2s 2024-09-12T17:25:02.306 INFO:teuthology.orchestra.run.smithi016.stderr: 6900K .......... .......... .......... .......... .......... 7% 176M 2s 2024-09-12T17:25:02.306 INFO:teuthology.orchestra.run.smithi016.stderr: 6950K .......... .......... .......... .......... .......... 7% 173M 2s 2024-09-12T17:25:02.306 INFO:teuthology.orchestra.run.smithi016.stderr: 7000K .......... .......... .......... .......... .......... 7% 195M 2s 2024-09-12T17:25:02.306 INFO:teuthology.orchestra.run.smithi016.stderr: 7050K .......... .......... .......... .......... .......... 7% 184M 2s 2024-09-12T17:25:02.306 INFO:teuthology.orchestra.run.smithi016.stderr: 7100K .......... .......... .......... .......... .......... 7% 146M 2s 2024-09-12T17:25:02.306 INFO:teuthology.orchestra.run.smithi016.stderr: 7150K .......... .......... .......... .......... .......... 7% 157M 2s 2024-09-12T17:25:02.306 INFO:teuthology.orchestra.run.smithi016.stderr: 7200K .......... .......... .......... .......... .......... 7% 201M 2s 2024-09-12T17:25:02.306 INFO:teuthology.orchestra.run.smithi016.stderr: 7250K .......... .......... .......... .......... .......... 7% 204M 2s 2024-09-12T17:25:02.306 INFO:teuthology.orchestra.run.smithi016.stderr: 7300K .......... .......... .......... .......... .......... 7% 177M 2s 2024-09-12T17:25:02.306 INFO:teuthology.orchestra.run.smithi016.stderr: 7350K .......... .......... .......... .......... .......... 7% 178M 2s 2024-09-12T17:25:02.306 INFO:teuthology.orchestra.run.smithi016.stderr: 7400K .......... .......... .......... .......... .......... 8% 193M 2s 2024-09-12T17:25:02.306 INFO:teuthology.orchestra.run.smithi016.stderr: 7450K .......... .......... .......... .......... .......... 8% 187M 2s 2024-09-12T17:25:02.307 INFO:teuthology.orchestra.run.smithi016.stderr: 7500K .......... .......... .......... .......... .......... 8% 172M 2s 2024-09-12T17:25:02.307 INFO:teuthology.orchestra.run.smithi016.stderr: 7550K .......... .......... .......... .......... .......... 8% 166M 1s 2024-09-12T17:25:02.307 INFO:teuthology.orchestra.run.smithi016.stderr: 7600K .......... .......... .......... .......... .......... 8% 186M 1s 2024-09-12T17:25:02.307 INFO:teuthology.orchestra.run.smithi016.stderr: 7650K .......... .......... .......... .......... .......... 8% 207M 1s 2024-09-12T17:25:02.307 INFO:teuthology.orchestra.run.smithi016.stderr: 7700K .......... .......... .......... .......... .......... 8% 186M 1s 2024-09-12T17:25:02.307 INFO:teuthology.orchestra.run.smithi016.stderr: 7750K .......... .......... .......... .......... .......... 8% 210M 1s 2024-09-12T17:25:02.307 INFO:teuthology.orchestra.run.smithi016.stderr: 7800K .......... .......... .......... .......... .......... 8% 208M 1s 2024-09-12T17:25:02.307 INFO:teuthology.orchestra.run.smithi016.stderr: 7850K .......... .......... .......... .......... .......... 8% 183M 1s 2024-09-12T17:25:02.307 INFO:teuthology.orchestra.run.smithi016.stderr: 7900K .......... .......... .......... .......... .......... 8% 148M 1s 2024-09-12T17:25:02.307 INFO:teuthology.orchestra.run.smithi016.stderr: 7950K .......... .......... .......... .......... .......... 8% 216M 1s 2024-09-12T17:25:02.307 INFO:teuthology.orchestra.run.smithi016.stderr: 8000K .......... .......... .......... .......... .......... 8% 220M 1s 2024-09-12T17:25:02.307 INFO:teuthology.orchestra.run.smithi016.stderr: 8050K .......... .......... .......... .......... .......... 8% 217M 1s 2024-09-12T17:25:02.307 INFO:teuthology.orchestra.run.smithi016.stderr: 8100K .......... .......... .......... .......... .......... 8% 147M 1s 2024-09-12T17:25:02.308 INFO:teuthology.orchestra.run.smithi016.stderr: 8150K .......... .......... .......... .......... .......... 8% 220M 1s 2024-09-12T17:25:02.308 INFO:teuthology.orchestra.run.smithi016.stderr: 8200K .......... .......... .......... .......... .......... 8% 214M 1s 2024-09-12T17:25:02.308 INFO:teuthology.orchestra.run.smithi016.stderr: 8250K .......... .......... .......... .......... .......... 8% 220M 1s 2024-09-12T17:25:02.308 INFO:teuthology.orchestra.run.smithi016.stderr: 8300K .......... .......... .......... .......... .......... 8% 185M 1s 2024-09-12T17:25:02.308 INFO:teuthology.orchestra.run.smithi016.stderr: 8350K .......... .......... .......... .......... .......... 9% 209M 1s 2024-09-12T17:25:02.308 INFO:teuthology.orchestra.run.smithi016.stderr: 8400K .......... .......... .......... .......... .......... 9% 217M 1s 2024-09-12T17:25:02.308 INFO:teuthology.orchestra.run.smithi016.stderr: 8450K .......... .......... .......... .......... .......... 9% 221M 1s 2024-09-12T17:25:02.308 INFO:teuthology.orchestra.run.smithi016.stderr: 8500K .......... .......... .......... .......... .......... 9% 193M 1s 2024-09-12T17:25:02.308 INFO:teuthology.orchestra.run.smithi016.stderr: 8550K .......... .......... .......... .......... .......... 9% 224M 1s 2024-09-12T17:25:02.308 INFO:teuthology.orchestra.run.smithi016.stderr: 8600K .......... .......... .......... .......... .......... 9% 217M 1s 2024-09-12T17:25:02.308 INFO:teuthology.orchestra.run.smithi016.stderr: 8650K .......... .......... .......... .......... .......... 9% 218M 1s 2024-09-12T17:25:02.308 INFO:teuthology.orchestra.run.smithi016.stderr: 8700K .......... .......... .......... .......... .......... 9% 160M 1s 2024-09-12T17:25:02.308 INFO:teuthology.orchestra.run.smithi016.stderr: 8750K .......... .......... .......... .......... .......... 9% 214M 1s 2024-09-12T17:25:02.309 INFO:teuthology.orchestra.run.smithi016.stderr: 8800K .......... .......... .......... .......... .......... 9% 203M 1s 2024-09-12T17:25:02.309 INFO:teuthology.orchestra.run.smithi016.stderr: 8850K .......... .......... .......... .......... .......... 9% 205M 1s 2024-09-12T17:25:02.309 INFO:teuthology.orchestra.run.smithi016.stderr: 8900K .......... .......... .......... .......... .......... 9% 198M 1s 2024-09-12T17:25:02.309 INFO:teuthology.orchestra.run.smithi016.stderr: 8950K .......... .......... .......... .......... .......... 9% 209M 1s 2024-09-12T17:25:02.309 INFO:teuthology.orchestra.run.smithi016.stderr: 9000K .......... .......... .......... .......... .......... 9% 223M 1s 2024-09-12T17:25:02.309 INFO:teuthology.orchestra.run.smithi016.stderr: 9050K .......... .......... .......... .......... .......... 9% 218M 1s 2024-09-12T17:25:02.309 INFO:teuthology.orchestra.run.smithi016.stderr: 9100K .......... .......... .......... .......... .......... 9% 172M 1s 2024-09-12T17:25:02.309 INFO:teuthology.orchestra.run.smithi016.stderr: 9150K .......... .......... .......... .......... .......... 9% 228M 1s 2024-09-12T17:25:02.309 INFO:teuthology.orchestra.run.smithi016.stderr: 9200K .......... .......... .......... .......... .......... 9% 215M 1s 2024-09-12T17:25:02.309 INFO:teuthology.orchestra.run.smithi016.stderr: 9250K .......... .......... .......... .......... .......... 10% 227M 1s 2024-09-12T17:25:02.309 INFO:teuthology.orchestra.run.smithi016.stderr: 9300K .......... .......... .......... .......... .......... 10% 204M 1s 2024-09-12T17:25:02.309 INFO:teuthology.orchestra.run.smithi016.stderr: 9350K .......... .......... .......... .......... .......... 10% 220M 1s 2024-09-12T17:25:02.309 INFO:teuthology.orchestra.run.smithi016.stderr: 9400K .......... .......... .......... .......... .......... 10% 206M 1s 2024-09-12T17:25:02.310 INFO:teuthology.orchestra.run.smithi016.stderr: 9450K .......... .......... .......... .......... .......... 10% 231M 1s 2024-09-12T17:25:02.310 INFO:teuthology.orchestra.run.smithi016.stderr: 9500K .......... .......... .......... .......... .......... 10% 162M 1s 2024-09-12T17:25:02.310 INFO:teuthology.orchestra.run.smithi016.stderr: 9550K .......... .......... .......... .......... .......... 10% 213M 1s 2024-09-12T17:25:02.310 INFO:teuthology.orchestra.run.smithi016.stderr: 9600K .......... .......... .......... .......... .......... 10% 176M 1s 2024-09-12T17:25:02.310 INFO:teuthology.orchestra.run.smithi016.stderr: 9650K .......... .......... .......... .......... .......... 10% 235M 1s 2024-09-12T17:25:02.310 INFO:teuthology.orchestra.run.smithi016.stderr: 9700K .......... .......... .......... .......... .......... 10% 220M 1s 2024-09-12T17:25:02.310 INFO:teuthology.orchestra.run.smithi016.stderr: 9750K .......... .......... .......... .......... .......... 10% 232M 1s 2024-09-12T17:25:02.310 INFO:teuthology.orchestra.run.smithi016.stderr: 9800K .......... .......... .......... .......... .......... 10% 219M 1s 2024-09-12T17:25:02.310 INFO:teuthology.orchestra.run.smithi016.stderr: 9850K .......... .......... .......... .......... .......... 10% 211M 1s 2024-09-12T17:25:02.310 INFO:teuthology.orchestra.run.smithi016.stderr: 9900K .......... .......... .......... .......... .......... 10% 145M 1s 2024-09-12T17:25:02.310 INFO:teuthology.orchestra.run.smithi016.stderr: 9950K .......... .......... .......... .......... .......... 10% 215M 1s 2024-09-12T17:25:02.310 INFO:teuthology.orchestra.run.smithi016.stderr: 10000K .......... .......... .......... .......... .......... 10% 234M 1s 2024-09-12T17:25:02.310 INFO:teuthology.orchestra.run.smithi016.stderr: 10050K .......... .......... .......... .......... .......... 10% 233M 1s 2024-09-12T17:25:02.310 INFO:teuthology.orchestra.run.smithi016.stderr: 10100K .......... .......... .......... .......... .......... 10% 210M 1s 2024-09-12T17:25:02.311 INFO:teuthology.orchestra.run.smithi016.stderr: 10150K .......... .......... .......... .......... .......... 10% 244M 1s 2024-09-12T17:25:02.311 INFO:teuthology.orchestra.run.smithi016.stderr: 10200K .......... .......... .......... .......... .......... 11% 220M 1s 2024-09-12T17:25:02.311 INFO:teuthology.orchestra.run.smithi016.stderr: 10250K .......... .......... .......... .......... .......... 11% 263M 1s 2024-09-12T17:25:02.311 INFO:teuthology.orchestra.run.smithi016.stderr: 10300K .......... .......... .......... .......... .......... 11% 226M 1s 2024-09-12T17:25:02.311 INFO:teuthology.orchestra.run.smithi016.stderr: 10350K .......... .......... .......... .......... .......... 11% 192M 1s 2024-09-12T17:25:02.311 INFO:teuthology.orchestra.run.smithi016.stderr: 10400K .......... .......... .......... .......... .......... 11% 216M 1s 2024-09-12T17:25:02.311 INFO:teuthology.orchestra.run.smithi016.stderr: 10450K .......... .......... .......... .......... .......... 11% 226M 1s 2024-09-12T17:25:02.311 INFO:teuthology.orchestra.run.smithi016.stderr: 10500K .......... .......... .......... .......... .......... 11% 260M 1s 2024-09-12T17:25:02.311 INFO:teuthology.orchestra.run.smithi016.stderr: 10550K .......... .......... .......... .......... .......... 11% 210M 1s 2024-09-12T17:25:02.311 INFO:teuthology.orchestra.run.smithi016.stderr: 10600K .......... .......... .......... .......... .......... 11% 241M 1s 2024-09-12T17:25:02.311 INFO:teuthology.orchestra.run.smithi016.stderr: 10650K .......... .......... .......... .......... .......... 11% 240M 1s 2024-09-12T17:25:02.311 INFO:teuthology.orchestra.run.smithi016.stderr: 10700K .......... .......... .......... .......... .......... 11% 261M 1s 2024-09-12T17:25:02.311 INFO:teuthology.orchestra.run.smithi016.stderr: 10750K .......... .......... .......... .......... .......... 11% 203M 1s 2024-09-12T17:25:02.312 INFO:teuthology.orchestra.run.smithi016.stderr: 10800K .......... .......... .......... .......... .......... 11% 249M 1s 2024-09-12T17:25:02.312 INFO:teuthology.orchestra.run.smithi016.stderr: 10850K .......... .......... .......... .......... .......... 11% 251M 1s 2024-09-12T17:25:02.312 INFO:teuthology.orchestra.run.smithi016.stderr: 10900K .......... .......... .......... .......... .......... 11% 269M 1s 2024-09-12T17:25:02.312 INFO:teuthology.orchestra.run.smithi016.stderr: 10950K .......... .......... .......... .......... .......... 11% 232M 1s 2024-09-12T17:25:02.312 INFO:teuthology.orchestra.run.smithi016.stderr: 11000K .......... .......... .......... .......... .......... 11% 57.0M 1s 2024-09-12T17:25:02.312 INFO:teuthology.orchestra.run.smithi016.stderr: 11050K .......... .......... .......... .......... .......... 11% 229M 1s 2024-09-12T17:25:02.312 INFO:teuthology.orchestra.run.smithi016.stderr: 11100K .......... .......... .......... .......... .......... 12% 234M 1s 2024-09-12T17:25:02.312 INFO:teuthology.orchestra.run.smithi016.stderr: 11150K .......... .......... .......... .......... .......... 12% 186M 1s 2024-09-12T17:25:02.312 INFO:teuthology.orchestra.run.smithi016.stderr: 11200K .......... .......... .......... .......... .......... 12% 240M 1s 2024-09-12T17:25:02.312 INFO:teuthology.orchestra.run.smithi016.stderr: 11250K .......... .......... .......... .......... .......... 12% 233M 1s 2024-09-12T17:25:02.312 INFO:teuthology.orchestra.run.smithi016.stderr: 11300K .......... .......... .......... .......... .......... 12% 260M 1s 2024-09-12T17:25:02.312 INFO:teuthology.orchestra.run.smithi016.stderr: 11350K .......... .......... .......... .......... .......... 12% 232M 1s 2024-09-12T17:25:02.312 INFO:teuthology.orchestra.run.smithi016.stderr: 11400K .......... .......... .......... .......... .......... 12% 266M 1s 2024-09-12T17:25:02.312 INFO:teuthology.orchestra.run.smithi016.stderr: 11450K .......... .......... .......... .......... .......... 12% 18.9M 1s 2024-09-12T17:25:02.313 INFO:teuthology.orchestra.run.smithi016.stderr: 11500K .......... .......... .......... .......... .......... 12% 209M 1s 2024-09-12T17:25:02.313 INFO:teuthology.orchestra.run.smithi016.stderr: 11550K .......... .......... .......... .......... .......... 12% 176M 1s 2024-09-12T17:25:02.313 INFO:teuthology.orchestra.run.smithi016.stderr: 11600K .......... .......... .......... .......... .......... 12% 225M 1s 2024-09-12T17:25:02.313 INFO:teuthology.orchestra.run.smithi016.stderr: 11650K .......... .......... .......... .......... .......... 12% 250M 1s 2024-09-12T17:25:02.313 INFO:teuthology.orchestra.run.smithi016.stderr: 11700K .......... .......... .......... .......... .......... 12% 221M 1s 2024-09-12T17:25:02.313 INFO:teuthology.orchestra.run.smithi016.stderr: 11750K .......... .......... .......... .......... .......... 12% 214M 1s 2024-09-12T17:25:02.313 INFO:teuthology.orchestra.run.smithi016.stderr: 11800K .......... .......... .......... .......... .......... 12% 226M 1s 2024-09-12T17:25:02.313 INFO:teuthology.orchestra.run.smithi016.stderr: 11850K .......... .......... .......... .......... .......... 12% 264M 1s 2024-09-12T17:25:02.313 INFO:teuthology.orchestra.run.smithi016.stderr: 11900K .......... .......... .......... .......... .......... 12% 242M 1s 2024-09-12T17:25:02.313 INFO:teuthology.orchestra.run.smithi016.stderr: 11950K .......... .......... .......... .......... .......... 12% 204M 1s 2024-09-12T17:25:02.313 INFO:teuthology.orchestra.run.smithi016.stderr: 12000K .......... .......... .......... .......... .......... 12% 256M 1s 2024-09-12T17:25:02.313 INFO:teuthology.orchestra.run.smithi016.stderr: 12050K .......... .......... .......... .......... .......... 13% 250M 1s 2024-09-12T17:25:02.314 INFO:teuthology.orchestra.run.smithi016.stderr: 12100K .......... .......... .......... .......... .......... 13% 253M 1s 2024-09-12T17:25:02.314 INFO:teuthology.orchestra.run.smithi016.stderr: 12150K .......... .......... .......... .......... .......... 13% 231M 1s 2024-09-12T17:25:02.314 INFO:teuthology.orchestra.run.smithi016.stderr: 12200K .......... .......... .......... .......... .......... 13% 257M 1s 2024-09-12T17:25:02.314 INFO:teuthology.orchestra.run.smithi016.stderr: 12250K .......... .......... .......... .......... .......... 13% 252M 1s 2024-09-12T17:25:02.314 INFO:teuthology.orchestra.run.smithi016.stderr: 12300K .......... .......... .......... .......... .......... 13% 269M 1s 2024-09-12T17:25:02.314 INFO:teuthology.orchestra.run.smithi016.stderr: 12350K .......... .......... .......... .......... .......... 13% 202M 1s 2024-09-12T17:25:02.314 INFO:teuthology.orchestra.run.smithi016.stderr: 12400K .......... .......... .......... .......... .......... 13% 244M 1s 2024-09-12T17:25:02.314 INFO:teuthology.orchestra.run.smithi016.stderr: 12450K .......... .......... .......... .......... .......... 13% 146M 1s 2024-09-12T17:25:02.314 INFO:teuthology.orchestra.run.smithi016.stderr: 12500K .......... .......... .......... .......... .......... 13% 202M 1s 2024-09-12T17:25:02.314 INFO:teuthology.orchestra.run.smithi016.stderr: 12550K .......... .......... .......... .......... .......... 13% 208M 1s 2024-09-12T17:25:02.314 INFO:teuthology.orchestra.run.smithi016.stderr: 12600K .......... .......... .......... .......... .......... 13% 229M 1s 2024-09-12T17:25:02.314 INFO:teuthology.orchestra.run.smithi016.stderr: 12650K .......... .......... .......... .......... .......... 13% 230M 1s 2024-09-12T17:25:02.314 INFO:teuthology.orchestra.run.smithi016.stderr: 12700K .......... .......... .......... .......... .......... 13% 242M 1s 2024-09-12T17:25:02.314 INFO:teuthology.orchestra.run.smithi016.stderr: 12750K .......... .......... .......... .......... .......... 13% 148M 1s 2024-09-12T17:25:02.315 INFO:teuthology.orchestra.run.smithi016.stderr: 12800K .......... .......... .......... .......... .......... 13% 193M 1s 2024-09-12T17:25:02.315 INFO:teuthology.orchestra.run.smithi016.stderr: 12850K .......... .......... .......... .......... .......... 13% 225M 1s 2024-09-12T17:25:02.315 INFO:teuthology.orchestra.run.smithi016.stderr: 12900K .......... .......... .......... .......... .......... 13% 229M 1s 2024-09-12T17:25:02.315 INFO:teuthology.orchestra.run.smithi016.stderr: 12950K .......... .......... .......... .......... .......... 13% 214M 1s 2024-09-12T17:25:02.315 INFO:teuthology.orchestra.run.smithi016.stderr: 13000K .......... .......... .......... .......... .......... 14% 237M 1s 2024-09-12T17:25:02.315 INFO:teuthology.orchestra.run.smithi016.stderr: 13050K .......... .......... .......... .......... .......... 14% 214M 1s 2024-09-12T17:25:02.315 INFO:teuthology.orchestra.run.smithi016.stderr: 13100K .......... .......... .......... .......... .......... 14% 230M 1s 2024-09-12T17:25:02.315 INFO:teuthology.orchestra.run.smithi016.stderr: 13150K .......... .......... .......... .......... .......... 14% 193M 1s 2024-09-12T17:25:02.315 INFO:teuthology.orchestra.run.smithi016.stderr: 13200K .......... .......... .......... .......... .......... 14% 96.6M 1s 2024-09-12T17:25:02.315 INFO:teuthology.orchestra.run.smithi016.stderr: 13250K .......... .......... .......... .......... .......... 14% 186M 1s 2024-09-12T17:25:02.315 INFO:teuthology.orchestra.run.smithi016.stderr: 13300K .......... .......... .......... .......... .......... 14% 190M 1s 2024-09-12T17:25:02.315 INFO:teuthology.orchestra.run.smithi016.stderr: 13350K .......... .......... .......... .......... .......... 14% 204M 1s 2024-09-12T17:25:02.315 INFO:teuthology.orchestra.run.smithi016.stderr: 13400K .......... .......... .......... .......... .......... 14% 112M 1s 2024-09-12T17:25:02.315 INFO:teuthology.orchestra.run.smithi016.stderr: 13450K .......... .......... .......... .......... .......... 14% 210M 1s 2024-09-12T17:25:02.316 INFO:teuthology.orchestra.run.smithi016.stderr: 13500K .......... .......... .......... .......... .......... 14% 234M 1s 2024-09-12T17:25:02.316 INFO:teuthology.orchestra.run.smithi016.stderr: 13550K .......... .......... .......... .......... .......... 14% 47.2M 1s 2024-09-12T17:25:02.316 INFO:teuthology.orchestra.run.smithi016.stderr: 13600K .......... .......... .......... .......... .......... 14% 213M 1s 2024-09-12T17:25:02.316 INFO:teuthology.orchestra.run.smithi016.stderr: 13650K .......... .......... .......... .......... .......... 14% 166M 1s 2024-09-12T17:25:02.316 INFO:teuthology.orchestra.run.smithi016.stderr: 13700K .......... .......... .......... .......... .......... 14% 210M 1s 2024-09-12T17:25:02.316 INFO:teuthology.orchestra.run.smithi016.stderr: 13750K .......... .......... .......... .......... .......... 14% 82.9M 1s 2024-09-12T17:25:02.316 INFO:teuthology.orchestra.run.smithi016.stderr: 13800K .......... .......... .......... .......... .......... 14% 215M 1s 2024-09-12T17:25:02.316 INFO:teuthology.orchestra.run.smithi016.stderr: 13850K .......... .......... .......... .......... .......... 14% 63.7M 1s 2024-09-12T17:25:02.316 INFO:teuthology.orchestra.run.smithi016.stderr: 13900K .......... .......... .......... .......... .......... 15% 138M 1s 2024-09-12T17:25:02.316 INFO:teuthology.orchestra.run.smithi016.stderr: 13950K .......... .......... .......... .......... .......... 15% 179M 1s 2024-09-12T17:25:02.316 INFO:teuthology.orchestra.run.smithi016.stderr: 14000K .......... .......... .......... .......... .......... 15% 195M 1s 2024-09-12T17:25:02.316 INFO:teuthology.orchestra.run.smithi016.stderr: 14050K .......... .......... .......... .......... .......... 15% 234M 1s 2024-09-12T17:25:02.316 INFO:teuthology.orchestra.run.smithi016.stderr: 14100K .......... .......... .......... .......... .......... 15% 210M 1s 2024-09-12T17:25:02.317 INFO:teuthology.orchestra.run.smithi016.stderr: 14150K .......... .......... .......... .......... .......... 15% 198M 1s 2024-09-12T17:25:02.317 INFO:teuthology.orchestra.run.smithi016.stderr: 14200K .......... .......... .......... .......... .......... 15% 209M 1s 2024-09-12T17:25:02.317 INFO:teuthology.orchestra.run.smithi016.stderr: 14250K .......... .......... .......... .......... .......... 15% 218M 1s 2024-09-12T17:25:02.317 INFO:teuthology.orchestra.run.smithi016.stderr: 14300K .......... .......... .......... .......... .......... 15% 240M 1s 2024-09-12T17:25:02.317 INFO:teuthology.orchestra.run.smithi016.stderr: 14350K .......... .......... .......... .......... .......... 15% 30.0M 1s 2024-09-12T17:25:02.317 INFO:teuthology.orchestra.run.smithi016.stderr: 14400K .......... .......... .......... .......... .......... 15% 173M 1s 2024-09-12T17:25:02.317 INFO:teuthology.orchestra.run.smithi016.stderr: 14450K .......... .......... .......... .......... .......... 15% 208M 1s 2024-09-12T17:25:02.317 INFO:teuthology.orchestra.run.smithi016.stderr: 14500K .......... .......... .......... .......... .......... 15% 217M 1s 2024-09-12T17:25:02.317 INFO:teuthology.orchestra.run.smithi016.stderr: 14550K .......... .......... .......... .......... .......... 15% 172M 1s 2024-09-12T17:25:02.317 INFO:teuthology.orchestra.run.smithi016.stderr: 14600K .......... .......... .......... .......... .......... 15% 213M 1s 2024-09-12T17:25:02.317 INFO:teuthology.orchestra.run.smithi016.stderr: 14650K .......... .......... .......... .......... .......... 15% 215M 1s 2024-09-12T17:25:02.317 INFO:teuthology.orchestra.run.smithi016.stderr: 14700K .......... .......... .......... .......... .......... 15% 225M 1s 2024-09-12T17:25:02.317 INFO:teuthology.orchestra.run.smithi016.stderr: 14750K .......... .......... .......... .......... .......... 15% 194M 1s 2024-09-12T17:25:02.318 INFO:teuthology.orchestra.run.smithi016.stderr: 14800K .......... .......... .......... .......... .......... 15% 204M 1s 2024-09-12T17:25:02.318 INFO:teuthology.orchestra.run.smithi016.stderr: 14850K .......... .......... .......... .......... .......... 16% 233M 1s 2024-09-12T17:25:02.318 INFO:teuthology.orchestra.run.smithi016.stderr: 14900K .......... .......... .......... .......... .......... 16% 214M 1s 2024-09-12T17:25:02.318 INFO:teuthology.orchestra.run.smithi016.stderr: 14950K .......... .......... .......... .......... .......... 16% 197M 1s 2024-09-12T17:25:02.318 INFO:teuthology.orchestra.run.smithi016.stderr: 15000K .......... .......... .......... .......... .......... 16% 208M 1s 2024-09-12T17:25:02.318 INFO:teuthology.orchestra.run.smithi016.stderr: 15050K .......... .......... .......... .......... .......... 16% 206M 1s 2024-09-12T17:25:02.318 INFO:teuthology.orchestra.run.smithi016.stderr: 15100K .......... .......... .......... .......... .......... 16% 197M 1s 2024-09-12T17:25:02.318 INFO:teuthology.orchestra.run.smithi016.stderr: 15150K .......... .......... .......... .......... .......... 16% 113M 1s 2024-09-12T17:25:02.318 INFO:teuthology.orchestra.run.smithi016.stderr: 15200K .......... .......... .......... .......... .......... 16% 189M 1s 2024-09-12T17:25:02.318 INFO:teuthology.orchestra.run.smithi016.stderr: 15250K .......... .......... .......... .......... .......... 16% 205M 1s 2024-09-12T17:25:02.318 INFO:teuthology.orchestra.run.smithi016.stderr: 15300K .......... .......... .......... .......... .......... 16% 95.4M 1s 2024-09-12T17:25:02.318 INFO:teuthology.orchestra.run.smithi016.stderr: 15350K .......... .......... .......... .......... .......... 16% 161M 1s 2024-09-12T17:25:02.318 INFO:teuthology.orchestra.run.smithi016.stderr: 15400K .......... .......... .......... .......... .......... 16% 208M 1s 2024-09-12T17:25:02.318 INFO:teuthology.orchestra.run.smithi016.stderr: 15450K .......... .......... .......... .......... .......... 16% 222M 1s 2024-09-12T17:25:02.319 INFO:teuthology.orchestra.run.smithi016.stderr: 15500K .......... .......... .......... .......... .......... 16% 55.9M 1s 2024-09-12T17:25:02.319 INFO:teuthology.orchestra.run.smithi016.stderr: 15550K .......... .......... .......... .......... .......... 16% 163M 1s 2024-09-12T17:25:02.319 INFO:teuthology.orchestra.run.smithi016.stderr: 15600K .......... .......... .......... .......... .......... 16% 233M 1s 2024-09-12T17:25:02.319 INFO:teuthology.orchestra.run.smithi016.stderr: 15650K .......... .......... .......... .......... .......... 16% 215M 1s 2024-09-12T17:25:02.319 INFO:teuthology.orchestra.run.smithi016.stderr: 15700K .......... .......... .......... .......... .......... 16% 196M 1s 2024-09-12T17:25:02.319 INFO:teuthology.orchestra.run.smithi016.stderr: 15750K .......... .......... .......... .......... .......... 17% 191M 1s 2024-09-12T17:25:02.319 INFO:teuthology.orchestra.run.smithi016.stderr: 15800K .......... .......... .......... .......... .......... 17% 236M 1s 2024-09-12T17:25:02.319 INFO:teuthology.orchestra.run.smithi016.stderr: 15850K .......... .......... .......... .......... .......... 17% 228M 1s 2024-09-12T17:25:02.319 INFO:teuthology.orchestra.run.smithi016.stderr: 15900K .......... .......... .......... .......... .......... 17% 217M 1s 2024-09-12T17:25:02.319 INFO:teuthology.orchestra.run.smithi016.stderr: 15950K .......... .......... .......... .......... .......... 17% 202M 1s 2024-09-12T17:25:02.319 INFO:teuthology.orchestra.run.smithi016.stderr: 16000K .......... .......... .......... .......... .......... 17% 221M 1s 2024-09-12T17:25:02.319 INFO:teuthology.orchestra.run.smithi016.stderr: 16050K .......... .......... .......... .......... .......... 17% 189M 1s 2024-09-12T17:25:02.319 INFO:teuthology.orchestra.run.smithi016.stderr: 16100K .......... .......... .......... .......... .......... 17% 234M 1s 2024-09-12T17:25:02.319 INFO:teuthology.orchestra.run.smithi016.stderr: 16150K .......... .......... .......... .......... .......... 17% 69.3M 1s 2024-09-12T17:25:02.320 INFO:teuthology.orchestra.run.smithi016.stderr: 16200K .......... .......... .......... .......... .......... 17% 208M 1s 2024-09-12T17:25:02.320 INFO:teuthology.orchestra.run.smithi016.stderr: 16250K .......... .......... .......... .......... .......... 17% 211M 1s 2024-09-12T17:25:02.320 INFO:teuthology.orchestra.run.smithi016.stderr: 16300K .......... .......... .......... .......... .......... 17% 142M 1s 2024-09-12T17:25:02.320 INFO:teuthology.orchestra.run.smithi016.stderr: 16350K .......... .......... .......... .......... .......... 17% 95.7M 1s 2024-09-12T17:25:02.320 INFO:teuthology.orchestra.run.smithi016.stderr: 16400K .......... .......... .......... .......... .......... 17% 202M 1s 2024-09-12T17:25:02.320 INFO:teuthology.orchestra.run.smithi016.stderr: 16450K .......... .......... .......... .......... .......... 17% 230M 1s 2024-09-12T17:25:02.320 INFO:teuthology.orchestra.run.smithi016.stderr: 16500K .......... .......... .......... .......... .......... 17% 176M 1s 2024-09-12T17:25:02.320 INFO:teuthology.orchestra.run.smithi016.stderr: 16550K .......... .......... .......... .......... .......... 17% 47.1M 1s 2024-09-12T17:25:02.320 INFO:teuthology.orchestra.run.smithi016.stderr: 16600K .......... .......... .......... .......... .......... 17% 205M 1s 2024-09-12T17:25:02.320 INFO:teuthology.orchestra.run.smithi016.stderr: 16650K .......... .......... .......... .......... .......... 17% 196M 1s 2024-09-12T17:25:02.320 INFO:teuthology.orchestra.run.smithi016.stderr: 16700K .......... .......... .......... .......... .......... 18% 236M 1s 2024-09-12T17:25:02.320 INFO:teuthology.orchestra.run.smithi016.stderr: 16750K .......... .......... .......... .......... .......... 18% 178M 1s 2024-09-12T17:25:02.320 INFO:teuthology.orchestra.run.smithi016.stderr: 16800K .......... .......... .......... .......... .......... 18% 67.9M 1s 2024-09-12T17:25:02.320 INFO:teuthology.orchestra.run.smithi016.stderr: 16850K .......... .......... .......... .......... .......... 18% 203M 1s 2024-09-12T17:25:02.321 INFO:teuthology.orchestra.run.smithi016.stderr: 16900K .......... .......... .......... .......... .......... 18% 204M 1s 2024-09-12T17:25:02.321 INFO:teuthology.orchestra.run.smithi016.stderr: 16950K .......... .......... .......... .......... .......... 18% 179M 1s 2024-09-12T17:25:02.321 INFO:teuthology.orchestra.run.smithi016.stderr: 17000K .......... .......... .......... .......... .......... 18% 75.7M 1s 2024-09-12T17:25:02.321 INFO:teuthology.orchestra.run.smithi016.stderr: 17050K .......... .......... .......... .......... .......... 18% 165M 1s 2024-09-12T17:25:02.321 INFO:teuthology.orchestra.run.smithi016.stderr: 17100K .......... .......... .......... .......... .......... 18% 213M 1s 2024-09-12T17:25:02.321 INFO:teuthology.orchestra.run.smithi016.stderr: 17150K .......... .......... .......... .......... .......... 18% 130M 1s 2024-09-12T17:25:02.321 INFO:teuthology.orchestra.run.smithi016.stderr: 17200K .......... .......... .......... .......... .......... 18% 149M 1s 2024-09-12T17:25:02.321 INFO:teuthology.orchestra.run.smithi016.stderr: 17250K .......... .......... .......... .......... .......... 18% 186M 1s 2024-09-12T17:25:02.321 INFO:teuthology.orchestra.run.smithi016.stderr: 17300K .......... .......... .......... .......... .......... 18% 25.5M 1s 2024-09-12T17:25:02.321 INFO:teuthology.orchestra.run.smithi016.stderr: 17350K .......... .......... .......... .......... .......... 18% 176M 1s 2024-09-12T17:25:02.321 INFO:teuthology.orchestra.run.smithi016.stderr: 17400K .......... .......... .......... .......... .......... 18% 219M 1s 2024-09-12T17:25:02.321 INFO:teuthology.orchestra.run.smithi016.stderr: 17450K .......... .......... .......... .......... .......... 18% 89.1M 1s 2024-09-12T17:25:02.321 INFO:teuthology.orchestra.run.smithi016.stderr: 17500K .......... .......... .......... .......... .......... 18% 155M 1s 2024-09-12T17:25:02.322 INFO:teuthology.orchestra.run.smithi016.stderr: 17550K .......... .......... .......... .......... .......... 18% 166M 1s 2024-09-12T17:25:02.322 INFO:teuthology.orchestra.run.smithi016.stderr: 17600K .......... .......... .......... .......... .......... 18% 216M 1s 2024-09-12T17:25:02.322 INFO:teuthology.orchestra.run.smithi016.stderr: 17650K .......... .......... .......... .......... .......... 19% 173M 1s 2024-09-12T17:25:02.322 INFO:teuthology.orchestra.run.smithi016.stderr: 17700K .......... .......... .......... .......... .......... 19% 177M 1s 2024-09-12T17:25:02.322 INFO:teuthology.orchestra.run.smithi016.stderr: 17750K .......... .......... .......... .......... .......... 19% 200M 1s 2024-09-12T17:25:02.322 INFO:teuthology.orchestra.run.smithi016.stderr: 17800K .......... .......... .......... .......... .......... 19% 224M 1s 2024-09-12T17:25:02.322 INFO:teuthology.orchestra.run.smithi016.stderr: 17850K .......... .......... .......... .......... .......... 19% 230M 1s 2024-09-12T17:25:02.322 INFO:teuthology.orchestra.run.smithi016.stderr: 17900K .......... .......... .......... .......... .......... 19% 227M 1s 2024-09-12T17:25:02.322 INFO:teuthology.orchestra.run.smithi016.stderr: 17950K .......... .......... .......... .......... .......... 19% 177M 1s 2024-09-12T17:25:02.322 INFO:teuthology.orchestra.run.smithi016.stderr: 18000K .......... .......... .......... .......... .......... 19% 206M 1s 2024-09-12T17:25:02.322 INFO:teuthology.orchestra.run.smithi016.stderr: 18050K .......... .......... .......... .......... .......... 19% 227M 1s 2024-09-12T17:25:02.322 INFO:teuthology.orchestra.run.smithi016.stderr: 18100K .......... .......... .......... .......... .......... 19% 179M 1s 2024-09-12T17:25:02.322 INFO:teuthology.orchestra.run.smithi016.stderr: 18150K .......... .......... .......... .......... .......... 19% 200M 1s 2024-09-12T17:25:02.322 INFO:teuthology.orchestra.run.smithi016.stderr: 18200K .......... .......... .......... .......... .......... 19% 168M 1s 2024-09-12T17:25:02.322 INFO:teuthology.orchestra.run.smithi016.stderr: 18250K .......... .......... .......... .......... .......... 19% 78.6M 1s 2024-09-12T17:25:02.323 INFO:teuthology.orchestra.run.smithi016.stderr: 18300K .......... .......... .......... .......... .......... 19% 189M 1s 2024-09-12T17:25:02.323 INFO:teuthology.orchestra.run.smithi016.stderr: 18350K .......... .......... .......... .......... .......... 19% 99.7M 1s 2024-09-12T17:25:02.323 INFO:teuthology.orchestra.run.smithi016.stderr: 18400K .......... .......... .......... .......... .......... 19% 176M 1s 2024-09-12T17:25:02.323 INFO:teuthology.orchestra.run.smithi016.stderr: 18450K .......... .......... .......... .......... .......... 19% 45.3M 1s 2024-09-12T17:25:02.323 INFO:teuthology.orchestra.run.smithi016.stderr: 18500K .......... .......... .......... .......... .......... 19% 179M 1s 2024-09-12T17:25:02.323 INFO:teuthology.orchestra.run.smithi016.stderr: 18550K .......... .......... .......... .......... .......... 20% 195M 1s 2024-09-12T17:25:02.323 INFO:teuthology.orchestra.run.smithi016.stderr: 18600K .......... .......... .......... .......... .......... 20% 214M 1s 2024-09-12T17:25:02.323 INFO:teuthology.orchestra.run.smithi016.stderr: 18650K .......... .......... .......... .......... .......... 20% 200M 1s 2024-09-12T17:25:02.323 INFO:teuthology.orchestra.run.smithi016.stderr: 18700K .......... .......... .......... .......... .......... 20% 207M 1s 2024-09-12T17:25:02.323 INFO:teuthology.orchestra.run.smithi016.stderr: 18750K .......... .......... .......... .......... .......... 20% 169M 1s 2024-09-12T17:25:02.323 INFO:teuthology.orchestra.run.smithi016.stderr: 18800K .......... .......... .......... .......... .......... 20% 207M 1s 2024-09-12T17:25:02.323 INFO:teuthology.orchestra.run.smithi016.stderr: 18850K .......... .......... .......... .......... .......... 20% 210M 1s 2024-09-12T17:25:02.323 INFO:teuthology.orchestra.run.smithi016.stderr: 18900K .......... .......... .......... .......... .......... 20% 212M 1s 2024-09-12T17:25:02.324 INFO:teuthology.orchestra.run.smithi016.stderr: 18950K .......... .......... .......... .......... .......... 20% 187M 1s 2024-09-12T17:25:02.324 INFO:teuthology.orchestra.run.smithi016.stderr: 19000K .......... .......... .......... .......... .......... 20% 224M 1s 2024-09-12T17:25:02.324 INFO:teuthology.orchestra.run.smithi016.stderr: 19050K .......... .......... .......... .......... .......... 20% 225M 1s 2024-09-12T17:25:02.324 INFO:teuthology.orchestra.run.smithi016.stderr: 19100K .......... .......... .......... .......... .......... 20% 222M 1s 2024-09-12T17:25:02.324 INFO:teuthology.orchestra.run.smithi016.stderr: 19150K .......... .......... .......... .......... .......... 20% 181M 1s 2024-09-12T17:25:02.324 INFO:teuthology.orchestra.run.smithi016.stderr: 19200K .......... .......... .......... .......... .......... 20% 215M 1s 2024-09-12T17:25:02.324 INFO:teuthology.orchestra.run.smithi016.stderr: 19250K .......... .......... .......... .......... .......... 20% 223M 1s 2024-09-12T17:25:02.324 INFO:teuthology.orchestra.run.smithi016.stderr: 19300K .......... .......... .......... .......... .......... 20% 219M 1s 2024-09-12T17:25:02.324 INFO:teuthology.orchestra.run.smithi016.stderr: 19350K .......... .......... .......... .......... .......... 20% 92.4M 1s 2024-09-12T17:25:02.324 INFO:teuthology.orchestra.run.smithi016.stderr: 19400K .......... .......... .......... .......... .......... 20% 63.5M 1s 2024-09-12T17:25:02.324 INFO:teuthology.orchestra.run.smithi016.stderr: 19450K .......... .......... .......... .......... .......... 20% 190M 1s 2024-09-12T17:25:02.324 INFO:teuthology.orchestra.run.smithi016.stderr: 19500K .......... .......... .......... .......... .......... 21% 230M 1s 2024-09-12T17:25:02.324 INFO:teuthology.orchestra.run.smithi016.stderr: 19550K .......... .......... .......... .......... .......... 21% 61.8M 1s 2024-09-12T17:25:02.325 INFO:teuthology.orchestra.run.smithi016.stderr: 19600K .......... .......... .......... .......... .......... 21% 199M 1s 2024-09-12T17:25:02.325 INFO:teuthology.orchestra.run.smithi016.stderr: 19650K .......... .......... .......... .......... .......... 21% 213M 1s 2024-09-12T17:25:02.325 INFO:teuthology.orchestra.run.smithi016.stderr: 19700K .......... .......... .......... .......... .......... 21% 200M 1s 2024-09-12T17:25:02.325 INFO:teuthology.orchestra.run.smithi016.stderr: 19750K .......... .......... .......... .......... .......... 21% 204M 1s 2024-09-12T17:25:02.325 INFO:teuthology.orchestra.run.smithi016.stderr: 19800K .......... .......... .......... .......... .......... 21% 236M 1s 2024-09-12T17:25:02.325 INFO:teuthology.orchestra.run.smithi016.stderr: 19850K .......... .......... .......... .......... .......... 21% 157M 1s 2024-09-12T17:25:02.325 INFO:teuthology.orchestra.run.smithi016.stderr: 19900K .......... .......... .......... .......... .......... 21% 183M 1s 2024-09-12T17:25:02.325 INFO:teuthology.orchestra.run.smithi016.stderr: 19950K .......... .......... .......... .......... .......... 21% 81.6M 1s 2024-09-12T17:25:02.325 INFO:teuthology.orchestra.run.smithi016.stderr: 20000K .......... .......... .......... .......... .......... 21% 191M 1s 2024-09-12T17:25:02.325 INFO:teuthology.orchestra.run.smithi016.stderr: 20050K .......... .......... .......... .......... .......... 21% 157M 1s 2024-09-12T17:25:02.325 INFO:teuthology.orchestra.run.smithi016.stderr: 20100K .......... .......... .......... .......... .......... 21% 223M 1s 2024-09-12T17:25:02.325 INFO:teuthology.orchestra.run.smithi016.stderr: 20150K .......... .......... .......... .......... .......... 21% 127M 1s 2024-09-12T17:25:02.325 INFO:teuthology.orchestra.run.smithi016.stderr: 20200K .......... .......... .......... .......... .......... 21% 210M 1s 2024-09-12T17:25:02.326 INFO:teuthology.orchestra.run.smithi016.stderr: 20250K .......... .......... .......... .......... .......... 21% 97.3M 1s 2024-09-12T17:25:02.326 INFO:teuthology.orchestra.run.smithi016.stderr: 20300K .......... .......... .......... .......... .......... 21% 21.8M 1s 2024-09-12T17:25:02.326 INFO:teuthology.orchestra.run.smithi016.stderr: 20350K .......... .......... .......... .......... .......... 21% 106M 1s 2024-09-12T17:25:02.326 INFO:teuthology.orchestra.run.smithi016.stderr: 20400K .......... .......... .......... .......... .......... 22% 72.1M 1s 2024-09-12T17:25:02.326 INFO:teuthology.orchestra.run.smithi016.stderr: 20450K .......... .......... .......... .......... .......... 22% 186M 1s 2024-09-12T17:25:02.326 INFO:teuthology.orchestra.run.smithi016.stderr: 20500K .......... .......... .......... .......... .......... 22% 67.7M 1s 2024-09-12T17:25:02.326 INFO:teuthology.orchestra.run.smithi016.stderr: 20550K .......... .......... .......... .......... .......... 22% 138M 1s 2024-09-12T17:25:02.326 INFO:teuthology.orchestra.run.smithi016.stderr: 20600K .......... .......... .......... .......... .......... 22% 222M 1s 2024-09-12T17:25:02.326 INFO:teuthology.orchestra.run.smithi016.stderr: 20650K .......... .......... .......... .......... .......... 22% 214M 1s 2024-09-12T17:25:02.326 INFO:teuthology.orchestra.run.smithi016.stderr: 20700K .......... .......... .......... .......... .......... 22% 166M 1s 2024-09-12T17:25:02.326 INFO:teuthology.orchestra.run.smithi016.stderr: 20750K .......... .......... .......... .......... .......... 22% 227M 1s 2024-09-12T17:25:02.326 INFO:teuthology.orchestra.run.smithi016.stderr: 20800K .......... .......... .......... .......... .......... 22% 213M 1s 2024-09-12T17:25:02.326 INFO:teuthology.orchestra.run.smithi016.stderr: 20850K .......... .......... .......... .......... .......... 22% 222M 1s 2024-09-12T17:25:02.327 INFO:teuthology.orchestra.run.smithi016.stderr: 20900K .......... .......... .......... .......... .......... 22% 188M 1s 2024-09-12T17:25:02.327 INFO:teuthology.orchestra.run.smithi016.stderr: 20950K .......... .......... .......... .......... .......... 22% 209M 1s 2024-09-12T17:25:02.327 INFO:teuthology.orchestra.run.smithi016.stderr: 21000K .......... .......... .......... .......... .......... 22% 211M 1s 2024-09-12T17:25:02.327 INFO:teuthology.orchestra.run.smithi016.stderr: 21050K .......... .......... .......... .......... .......... 22% 226M 1s 2024-09-12T17:25:02.327 INFO:teuthology.orchestra.run.smithi016.stderr: 21100K .......... .......... .......... .......... .......... 22% 180M 1s 2024-09-12T17:25:02.327 INFO:teuthology.orchestra.run.smithi016.stderr: 21150K .......... .......... .......... .......... .......... 22% 215M 1s 2024-09-12T17:25:02.327 INFO:teuthology.orchestra.run.smithi016.stderr: 21200K .......... .......... .......... .......... .......... 22% 227M 1s 2024-09-12T17:25:02.327 INFO:teuthology.orchestra.run.smithi016.stderr: 21250K .......... .......... .......... .......... .......... 22% 200M 1s 2024-09-12T17:25:02.327 INFO:teuthology.orchestra.run.smithi016.stderr: 21300K .......... .......... .......... .......... .......... 22% 187M 1s 2024-09-12T17:25:02.327 INFO:teuthology.orchestra.run.smithi016.stderr: 21350K .......... .......... .......... .......... .......... 23% 86.9M 1s 2024-09-12T17:25:02.327 INFO:teuthology.orchestra.run.smithi016.stderr: 21400K .......... .......... .......... .......... .......... 23% 208M 1s 2024-09-12T17:25:02.327 INFO:teuthology.orchestra.run.smithi016.stderr: 21450K .......... .......... .......... .......... .......... 23% 43.5M 1s 2024-09-12T17:25:02.327 INFO:teuthology.orchestra.run.smithi016.stderr: 21500K .......... .......... .......... .......... .......... 23% 71.8M 1s 2024-09-12T17:25:02.327 INFO:teuthology.orchestra.run.smithi016.stderr: 21550K .......... .......... .......... .......... .......... 23% 210M 1s 2024-09-12T17:25:02.328 INFO:teuthology.orchestra.run.smithi016.stderr: 21600K .......... .......... .......... .......... .......... 23% 119M 1s 2024-09-12T17:25:02.328 INFO:teuthology.orchestra.run.smithi016.stderr: 21650K .......... .......... .......... .......... .......... 23% 200M 1s 2024-09-12T17:25:02.328 INFO:teuthology.orchestra.run.smithi016.stderr: 21700K .......... .......... .......... .......... .......... 23% 119M 1s 2024-09-12T17:25:02.328 INFO:teuthology.orchestra.run.smithi016.stderr: 21750K .......... .......... .......... .......... .......... 23% 219M 1s 2024-09-12T17:25:02.328 INFO:teuthology.orchestra.run.smithi016.stderr: 21800K .......... .......... .......... .......... .......... 23% 176M 1s 2024-09-12T17:25:02.328 INFO:teuthology.orchestra.run.smithi016.stderr: 21850K .......... .......... .......... .......... .......... 23% 221M 1s 2024-09-12T17:25:02.328 INFO:teuthology.orchestra.run.smithi016.stderr: 21900K .......... .......... .......... .......... .......... 23% 180M 1s 2024-09-12T17:25:02.328 INFO:teuthology.orchestra.run.smithi016.stderr: 21950K .......... .......... .......... .......... .......... 23% 175M 1s 2024-09-12T17:25:02.328 INFO:teuthology.orchestra.run.smithi016.stderr: 22000K .......... .......... .......... .......... .......... 23% 212M 1s 2024-09-12T17:25:02.328 INFO:teuthology.orchestra.run.smithi016.stderr: 22050K .......... .......... .......... .......... .......... 23% 228M 1s 2024-09-12T17:25:02.328 INFO:teuthology.orchestra.run.smithi016.stderr: 22100K .......... .......... .......... .......... .......... 23% 202M 1s 2024-09-12T17:25:02.328 INFO:teuthology.orchestra.run.smithi016.stderr: 22150K .......... .......... .......... .......... .......... 23% 222M 1s 2024-09-12T17:25:02.328 INFO:teuthology.orchestra.run.smithi016.stderr: 22200K .......... .......... .......... .......... .......... 23% 123M 1s 2024-09-12T17:25:02.328 INFO:teuthology.orchestra.run.smithi016.stderr: 22250K .......... .......... .......... .......... .......... 24% 146M 1s 2024-09-12T17:25:02.329 INFO:teuthology.orchestra.run.smithi016.stderr: 22300K .......... .......... .......... .......... .......... 24% 125M 1s 2024-09-12T17:25:02.329 INFO:teuthology.orchestra.run.smithi016.stderr: 22350K .......... .......... .......... .......... .......... 24% 202M 1s 2024-09-12T17:25:02.329 INFO:teuthology.orchestra.run.smithi016.stderr: 22400K .......... .......... .......... .......... .......... 24% 141M 1s 2024-09-12T17:25:02.329 INFO:teuthology.orchestra.run.smithi016.stderr: 22450K .......... .......... .......... .......... .......... 24% 79.6M 1s 2024-09-12T17:25:02.329 INFO:teuthology.orchestra.run.smithi016.stderr: 22500K .......... .......... .......... .......... .......... 24% 70.9M 1s 2024-09-12T17:25:02.329 INFO:teuthology.orchestra.run.smithi016.stderr: 22550K .......... .......... .......... .......... .......... 24% 204M 1s 2024-09-12T17:25:02.329 INFO:teuthology.orchestra.run.smithi016.stderr: 22600K .......... .......... .......... .......... .......... 24% 221M 1s 2024-09-12T17:25:02.329 INFO:teuthology.orchestra.run.smithi016.stderr: 22650K .......... .......... .......... .......... .......... 24% 215M 1s 2024-09-12T17:25:02.329 INFO:teuthology.orchestra.run.smithi016.stderr: 22700K .......... .......... .......... .......... .......... 24% 186M 1s 2024-09-12T17:25:02.329 INFO:teuthology.orchestra.run.smithi016.stderr: 22750K .......... .......... .......... .......... .......... 24% 182M 1s 2024-09-12T17:25:02.329 INFO:teuthology.orchestra.run.smithi016.stderr: 22800K .......... .......... .......... .......... .......... 24% 203M 1s 2024-09-12T17:25:02.329 INFO:teuthology.orchestra.run.smithi016.stderr: 22850K .......... .......... .......... .......... .......... 24% 218M 1s 2024-09-12T17:25:02.329 INFO:teuthology.orchestra.run.smithi016.stderr: 22900K .......... .......... .......... .......... .......... 24% 209M 1s 2024-09-12T17:25:02.330 INFO:teuthology.orchestra.run.smithi016.stderr: 22950K .......... .......... .......... .......... .......... 24% 194M 1s 2024-09-12T17:25:02.330 INFO:teuthology.orchestra.run.smithi016.stderr: 23000K .......... .......... .......... .......... .......... 24% 234M 1s 2024-09-12T17:25:02.330 INFO:teuthology.orchestra.run.smithi016.stderr: 23050K .......... .......... .......... .......... .......... 24% 227M 1s 2024-09-12T17:25:02.330 INFO:teuthology.orchestra.run.smithi016.stderr: 23100K .......... .......... .......... .......... .......... 24% 176M 1s 2024-09-12T17:25:02.330 INFO:teuthology.orchestra.run.smithi016.stderr: 23150K .......... .......... .......... .......... .......... 24% 223M 1s 2024-09-12T17:25:02.330 INFO:teuthology.orchestra.run.smithi016.stderr: 23200K .......... .......... .......... .......... .......... 25% 206M 1s 2024-09-12T17:25:02.330 INFO:teuthology.orchestra.run.smithi016.stderr: 23250K .......... .......... .......... .......... .......... 25% 232M 1s 2024-09-12T17:25:02.330 INFO:teuthology.orchestra.run.smithi016.stderr: 23300K .......... .......... .......... .......... .......... 25% 35.8M 1s 2024-09-12T17:25:02.330 INFO:teuthology.orchestra.run.smithi016.stderr: 23350K .......... .......... .......... .......... .......... 25% 74.4M 1s 2024-09-12T17:25:02.330 INFO:teuthology.orchestra.run.smithi016.stderr: 23400K .......... .......... .......... .......... .......... 25% 58.5M 1s 2024-09-12T17:25:02.330 INFO:teuthology.orchestra.run.smithi016.stderr: 23450K .......... .......... .......... .......... .......... 25% 201M 1s 2024-09-12T17:25:02.330 INFO:teuthology.orchestra.run.smithi016.stderr: 23500K .......... .......... .......... .......... .......... 25% 28.2M 1s 2024-09-12T17:25:02.330 INFO:teuthology.orchestra.run.smithi016.stderr: 23550K .......... .......... .......... .......... .......... 25% 91.8M 1s 2024-09-12T17:25:02.331 INFO:teuthology.orchestra.run.smithi016.stderr: 23600K .......... .......... .......... .......... .......... 25% 63.5M 1s 2024-09-12T17:25:02.331 INFO:teuthology.orchestra.run.smithi016.stderr: 23650K .......... .......... .......... .......... .......... 25% 126M 1s 2024-09-12T17:25:02.331 INFO:teuthology.orchestra.run.smithi016.stderr: 23700K .......... .......... .......... .......... .......... 25% 139M 1s 2024-09-12T17:25:02.331 INFO:teuthology.orchestra.run.smithi016.stderr: 23750K .......... .......... .......... .......... .......... 25% 219M 1s 2024-09-12T17:25:02.331 INFO:teuthology.orchestra.run.smithi016.stderr: 23800K .......... .......... .......... .......... .......... 25% 129M 1s 2024-09-12T17:25:02.331 INFO:teuthology.orchestra.run.smithi016.stderr: 23850K .......... .......... .......... .......... .......... 25% 221M 1s 2024-09-12T17:25:02.331 INFO:teuthology.orchestra.run.smithi016.stderr: 23900K .......... .......... .......... .......... .......... 25% 110M 1s 2024-09-12T17:25:02.331 INFO:teuthology.orchestra.run.smithi016.stderr: 23950K .......... .......... .......... .......... .......... 25% 188M 1s 2024-09-12T17:25:02.331 INFO:teuthology.orchestra.run.smithi016.stderr: 24000K .......... .......... .......... .......... .......... 25% 228M 1s 2024-09-12T17:25:02.331 INFO:teuthology.orchestra.run.smithi016.stderr: 24050K .......... .......... .......... .......... .......... 25% 232M 1s 2024-09-12T17:25:02.331 INFO:teuthology.orchestra.run.smithi016.stderr: 24100K .......... .......... .......... .......... .......... 25% 191M 1s 2024-09-12T17:25:02.331 INFO:teuthology.orchestra.run.smithi016.stderr: 24150K .......... .......... .......... .......... .......... 26% 221M 1s 2024-09-12T17:25:02.331 INFO:teuthology.orchestra.run.smithi016.stderr: 24200K .......... .......... .......... .......... .......... 26% 220M 1s 2024-09-12T17:25:02.331 INFO:teuthology.orchestra.run.smithi016.stderr: 24250K .......... .......... .......... .......... .......... 26% 217M 1s 2024-09-12T17:25:02.331 INFO:teuthology.orchestra.run.smithi016.stderr: 24300K .......... .......... .......... .......... .......... 26% 195M 1s 2024-09-12T17:25:02.332 INFO:teuthology.orchestra.run.smithi016.stderr: 24350K .......... .......... .......... .......... .......... 26% 223M 1s 2024-09-12T17:25:02.332 INFO:teuthology.orchestra.run.smithi016.stderr: 24400K .......... .......... .......... .......... .......... 26% 56.4M 1s 2024-09-12T17:25:02.332 INFO:teuthology.orchestra.run.smithi016.stderr: 24450K .......... .......... .......... .......... .......... 26% 201M 1s 2024-09-12T17:25:02.332 INFO:teuthology.orchestra.run.smithi016.stderr: 24500K .......... .......... .......... .......... .......... 26% 48.4M 1s 2024-09-12T17:25:02.332 INFO:teuthology.orchestra.run.smithi016.stderr: 24550K .......... .......... .......... .......... .......... 26% 173M 1s 2024-09-12T17:25:02.332 INFO:teuthology.orchestra.run.smithi016.stderr: 24600K .......... .......... .......... .......... .......... 26% 222M 1s 2024-09-12T17:25:02.332 INFO:teuthology.orchestra.run.smithi016.stderr: 24650K .......... .......... .......... .......... .......... 26% 183M 1s 2024-09-12T17:25:02.332 INFO:teuthology.orchestra.run.smithi016.stderr: 24700K .......... .......... .......... .......... .......... 26% 109M 1s 2024-09-12T17:25:02.332 INFO:teuthology.orchestra.run.smithi016.stderr: 24750K .......... .......... .......... .......... .......... 26% 219M 1s 2024-09-12T17:25:02.332 INFO:teuthology.orchestra.run.smithi016.stderr: 24800K .......... .......... .......... .......... .......... 26% 186M 1s 2024-09-12T17:25:02.332 INFO:teuthology.orchestra.run.smithi016.stderr: 24850K .......... .......... .......... .......... .......... 26% 186M 1s 2024-09-12T17:25:02.332 INFO:teuthology.orchestra.run.smithi016.stderr: 24900K .......... .......... .......... .......... .......... 26% 181M 1s 2024-09-12T17:25:02.332 INFO:teuthology.orchestra.run.smithi016.stderr: 24950K .......... .......... .......... .......... .......... 26% 138M 1s 2024-09-12T17:25:02.333 INFO:teuthology.orchestra.run.smithi016.stderr: 25000K .......... .......... .......... .......... .......... 26% 193M 1s 2024-09-12T17:25:02.333 INFO:teuthology.orchestra.run.smithi016.stderr: 25050K .......... .......... .......... .......... .......... 27% 212M 1s 2024-09-12T17:25:02.333 INFO:teuthology.orchestra.run.smithi016.stderr: 25100K .......... .......... .......... .......... .......... 27% 175M 1s 2024-09-12T17:25:02.333 INFO:teuthology.orchestra.run.smithi016.stderr: 25150K .......... .......... .......... .......... .......... 27% 232M 1s 2024-09-12T17:25:02.333 INFO:teuthology.orchestra.run.smithi016.stderr: 25200K .......... .......... .......... .......... .......... 27% 84.5M 1s 2024-09-12T17:25:02.333 INFO:teuthology.orchestra.run.smithi016.stderr: 25250K .......... .......... .......... .......... .......... 27% 211M 1s 2024-09-12T17:25:02.333 INFO:teuthology.orchestra.run.smithi016.stderr: 25300K .......... .......... .......... .......... .......... 27% 57.6M 1s 2024-09-12T17:25:02.333 INFO:teuthology.orchestra.run.smithi016.stderr: 25350K .......... .......... .......... .......... .......... 27% 222M 1s 2024-09-12T17:25:02.333 INFO:teuthology.orchestra.run.smithi016.stderr: 25400K .......... .......... .......... .......... .......... 27% 233M 1s 2024-09-12T17:25:02.333 INFO:teuthology.orchestra.run.smithi016.stderr: 25450K .......... .......... .......... .......... .......... 27% 144M 1s 2024-09-12T17:25:02.333 INFO:teuthology.orchestra.run.smithi016.stderr: 25500K .......... .......... .......... .......... .......... 27% 61.4M 1s 2024-09-12T17:25:02.333 INFO:teuthology.orchestra.run.smithi016.stderr: 25550K .......... .......... .......... .......... .......... 27% 134M 1s 2024-09-12T17:25:02.333 INFO:teuthology.orchestra.run.smithi016.stderr: 25600K .......... .......... .......... .......... .......... 27% 154M 1s 2024-09-12T17:25:02.334 INFO:teuthology.orchestra.run.smithi016.stderr: 25650K .......... .......... .......... .......... .......... 27% 228M 1s 2024-09-12T17:25:02.334 INFO:teuthology.orchestra.run.smithi016.stderr: 25700K .......... .......... .......... .......... .......... 27% 153M 1s 2024-09-12T17:25:02.334 INFO:teuthology.orchestra.run.smithi016.stderr: 25750K .......... .......... .......... .......... .......... 27% 192M 1s 2024-09-12T17:25:02.334 INFO:teuthology.orchestra.run.smithi016.stderr: 25800K .......... .......... .......... .......... .......... 27% 216M 1s 2024-09-12T17:25:02.334 INFO:teuthology.orchestra.run.smithi016.stderr: 25850K .......... .......... .......... .......... .......... 27% 217M 1s 2024-09-12T17:25:02.334 INFO:teuthology.orchestra.run.smithi016.stderr: 25900K .......... .......... .......... .......... .......... 27% 188M 1s 2024-09-12T17:25:02.334 INFO:teuthology.orchestra.run.smithi016.stderr: 25950K .......... .......... .......... .......... .......... 27% 222M 1s 2024-09-12T17:25:02.334 INFO:teuthology.orchestra.run.smithi016.stderr: 26000K .......... .......... .......... .......... .......... 28% 217M 1s 2024-09-12T17:25:02.334 INFO:teuthology.orchestra.run.smithi016.stderr: 26050K .......... .......... .......... .......... .......... 28% 223M 1s 2024-09-12T17:25:02.334 INFO:teuthology.orchestra.run.smithi016.stderr: 26100K .......... .......... .......... .......... .......... 28% 209M 1s 2024-09-12T17:25:02.334 INFO:teuthology.orchestra.run.smithi016.stderr: 26150K .......... .......... .......... .......... .......... 28% 230M 1s 2024-09-12T17:25:02.334 INFO:teuthology.orchestra.run.smithi016.stderr: 26200K .......... .......... .......... .......... .......... 28% 117M 1s 2024-09-12T17:25:02.334 INFO:teuthology.orchestra.run.smithi016.stderr: 26250K .......... .......... .......... .......... .......... 28% 203M 1s 2024-09-12T17:25:02.335 INFO:teuthology.orchestra.run.smithi016.stderr: 26300K .......... .......... .......... .......... .......... 28% 161M 1s 2024-09-12T17:25:02.335 INFO:teuthology.orchestra.run.smithi016.stderr: 26350K .......... .......... .......... .......... .......... 28% 236M 1s 2024-09-12T17:25:02.335 INFO:teuthology.orchestra.run.smithi016.stderr: 26400K .......... .......... .......... .......... .......... 28% 47.5M 1s 2024-09-12T17:25:02.335 INFO:teuthology.orchestra.run.smithi016.stderr: 26450K .......... .......... .......... .......... .......... 28% 34.0M 1s 2024-09-12T17:25:02.335 INFO:teuthology.orchestra.run.smithi016.stderr: 26500K .......... .......... .......... .......... .......... 28% 63.7M 1s 2024-09-12T17:25:02.335 INFO:teuthology.orchestra.run.smithi016.stderr: 26550K .......... .......... .......... .......... .......... 28% 219M 1s 2024-09-12T17:25:02.335 INFO:teuthology.orchestra.run.smithi016.stderr: 26600K .......... .......... .......... .......... .......... 28% 54.5M 1s 2024-09-12T17:25:02.335 INFO:teuthology.orchestra.run.smithi016.stderr: 26650K .......... .......... .......... .......... .......... 28% 126M 1s 2024-09-12T17:25:02.335 INFO:teuthology.orchestra.run.smithi016.stderr: 26700K .......... .......... .......... .......... .......... 28% 163M 1s 2024-09-12T17:25:02.335 INFO:teuthology.orchestra.run.smithi016.stderr: 26750K .......... .......... .......... .......... .......... 28% 163M 1s 2024-09-12T17:25:02.335 INFO:teuthology.orchestra.run.smithi016.stderr: 26800K .......... .......... .......... .......... .......... 28% 202M 1s 2024-09-12T17:25:02.335 INFO:teuthology.orchestra.run.smithi016.stderr: 26850K .......... .......... .......... .......... .......... 28% 106M 1s 2024-09-12T17:25:02.335 INFO:teuthology.orchestra.run.smithi016.stderr: 26900K .......... .......... .......... .......... .......... 29% 122M 1s 2024-09-12T17:25:02.336 INFO:teuthology.orchestra.run.smithi016.stderr: 26950K .......... .......... .......... .......... .......... 29% 195M 1s 2024-09-12T17:25:02.336 INFO:teuthology.orchestra.run.smithi016.stderr: 27000K .......... .......... .......... .......... .......... 29% 203M 1s 2024-09-12T17:25:02.336 INFO:teuthology.orchestra.run.smithi016.stderr: 27050K .......... .......... .......... .......... .......... 29% 217M 1s 2024-09-12T17:25:02.336 INFO:teuthology.orchestra.run.smithi016.stderr: 27100K .......... .......... .......... .......... .......... 29% 186M 1s 2024-09-12T17:25:02.336 INFO:teuthology.orchestra.run.smithi016.stderr: 27150K .......... .......... .......... .......... .......... 29% 233M 1s 2024-09-12T17:25:02.336 INFO:teuthology.orchestra.run.smithi016.stderr: 27200K .......... .......... .......... .......... .......... 29% 224M 1s 2024-09-12T17:25:02.336 INFO:teuthology.orchestra.run.smithi016.stderr: 27250K .......... .......... .......... .......... .......... 29% 229M 1s 2024-09-12T17:25:02.336 INFO:teuthology.orchestra.run.smithi016.stderr: 27300K .......... .......... .......... .......... .......... 29% 211M 1s 2024-09-12T17:25:02.336 INFO:teuthology.orchestra.run.smithi016.stderr: 27350K .......... .......... .......... .......... .......... 29% 42.8M 1s 2024-09-12T17:25:02.336 INFO:teuthology.orchestra.run.smithi016.stderr: 27400K .......... .......... .......... .......... .......... 29% 203M 1s 2024-09-12T17:25:02.336 INFO:teuthology.orchestra.run.smithi016.stderr: 27450K .......... .......... .......... .......... .......... 29% 230M 1s 2024-09-12T17:25:02.336 INFO:teuthology.orchestra.run.smithi016.stderr: 27500K .......... .......... .......... .......... .......... 29% 78.7M 1s 2024-09-12T17:25:02.336 INFO:teuthology.orchestra.run.smithi016.stderr: 27550K .......... .......... .......... .......... .......... 29% 93.0M 1s 2024-09-12T17:25:02.337 INFO:teuthology.orchestra.run.smithi016.stderr: 27600K .......... .......... .......... .......... .......... 29% 144M 1s 2024-09-12T17:25:02.337 INFO:teuthology.orchestra.run.smithi016.stderr: 27650K .......... .......... .......... .......... .......... 29% 206M 1s 2024-09-12T17:25:02.337 INFO:teuthology.orchestra.run.smithi016.stderr: 27700K .......... .......... .......... .......... .......... 29% 195M 1s 2024-09-12T17:25:02.337 INFO:teuthology.orchestra.run.smithi016.stderr: 27750K .......... .......... .......... .......... .......... 29% 179M 1s 2024-09-12T17:25:02.337 INFO:teuthology.orchestra.run.smithi016.stderr: 27800K .......... .......... .......... .......... .......... 29% 229M 1s 2024-09-12T17:25:02.337 INFO:teuthology.orchestra.run.smithi016.stderr: 27850K .......... .......... .......... .......... .......... 30% 230M 1s 2024-09-12T17:25:02.337 INFO:teuthology.orchestra.run.smithi016.stderr: 27900K .......... .......... .......... .......... .......... 30% 148M 1s 2024-09-12T17:25:02.337 INFO:teuthology.orchestra.run.smithi016.stderr: 27950K .......... .......... .......... .......... .......... 30% 213M 1s 2024-09-12T17:25:02.337 INFO:teuthology.orchestra.run.smithi016.stderr: 28000K .......... .......... .......... .......... .......... 30% 198M 1s 2024-09-12T17:25:02.337 INFO:teuthology.orchestra.run.smithi016.stderr: 28050K .......... .......... .......... .......... .......... 30% 223M 1s 2024-09-12T17:25:02.337 INFO:teuthology.orchestra.run.smithi016.stderr: 28100K .......... .......... .......... .......... .......... 30% 202M 1s 2024-09-12T17:25:02.337 INFO:teuthology.orchestra.run.smithi016.stderr: 28150K .......... .......... .......... .......... .......... 30% 170M 1s 2024-09-12T17:25:02.337 INFO:teuthology.orchestra.run.smithi016.stderr: 28200K .......... .......... .......... .......... .......... 30% 214M 1s 2024-09-12T17:25:02.338 INFO:teuthology.orchestra.run.smithi016.stderr: 28250K .......... .......... .......... .......... .......... 30% 160M 1s 2024-09-12T17:25:02.338 INFO:teuthology.orchestra.run.smithi016.stderr: 28300K .......... .......... .......... .......... .......... 30% 117M 1s 2024-09-12T17:25:02.338 INFO:teuthology.orchestra.run.smithi016.stderr: 28350K .......... .......... .......... .......... .......... 30% 156M 1s 2024-09-12T17:25:02.338 INFO:teuthology.orchestra.run.smithi016.stderr: 28400K .......... .......... .......... .......... .......... 30% 218M 1s 2024-09-12T17:25:02.338 INFO:teuthology.orchestra.run.smithi016.stderr: 28450K .......... .......... .......... .......... .......... 30% 265M 1s 2024-09-12T17:25:02.338 INFO:teuthology.orchestra.run.smithi016.stderr: 28500K .......... .......... .......... .......... .......... 30% 236M 1s 2024-09-12T17:25:02.338 INFO:teuthology.orchestra.run.smithi016.stderr: 28550K .......... .......... .......... .......... .......... 30% 257M 1s 2024-09-12T17:25:02.338 INFO:teuthology.orchestra.run.smithi016.stderr: 28600K .......... .......... .......... .......... .......... 30% 239M 1s 2024-09-12T17:25:02.338 INFO:teuthology.orchestra.run.smithi016.stderr: 28650K .......... .......... .......... .......... .......... 30% 247M 1s 2024-09-12T17:25:02.338 INFO:teuthology.orchestra.run.smithi016.stderr: 28700K .......... .......... .......... .......... .......... 30% 224M 1s 2024-09-12T17:25:02.338 INFO:teuthology.orchestra.run.smithi016.stderr: 28750K .......... .......... .......... .......... .......... 31% 226M 1s 2024-09-12T17:25:02.338 INFO:teuthology.orchestra.run.smithi016.stderr: 28800K .......... .......... .......... .......... .......... 31% 266M 1s 2024-09-12T17:25:02.339 INFO:teuthology.orchestra.run.smithi016.stderr: 28850K .......... .......... .......... .......... .......... 31% 210M 1s 2024-09-12T17:25:02.339 INFO:teuthology.orchestra.run.smithi016.stderr: 28900K .......... .......... .......... .......... .......... 31% 184M 1s 2024-09-12T17:25:02.339 INFO:teuthology.orchestra.run.smithi016.stderr: 28950K .......... .......... .......... .......... .......... 31% 262M 1s 2024-09-12T17:25:02.339 INFO:teuthology.orchestra.run.smithi016.stderr: 29000K .......... .......... .......... .......... .......... 31% 269M 1s 2024-09-12T17:25:02.339 INFO:teuthology.orchestra.run.smithi016.stderr: 29050K .......... .......... .......... .......... .......... 31% 82.5M 1s 2024-09-12T17:25:02.339 INFO:teuthology.orchestra.run.smithi016.stderr: 29100K .......... .......... .......... .......... .......... 31% 137M 1s 2024-09-12T17:25:02.339 INFO:teuthology.orchestra.run.smithi016.stderr: 29150K .......... .......... .......... .......... .......... 31% 224M 1s 2024-09-12T17:25:02.339 INFO:teuthology.orchestra.run.smithi016.stderr: 29200K .......... .......... .......... .......... .......... 31% 228M 1s 2024-09-12T17:25:02.339 INFO:teuthology.orchestra.run.smithi016.stderr: 29250K .......... .......... .......... .......... .......... 31% 206M 1s 2024-09-12T17:25:02.339 INFO:teuthology.orchestra.run.smithi016.stderr: 29300K .......... .......... .......... .......... .......... 31% 227M 1s 2024-09-12T17:25:02.339 INFO:teuthology.orchestra.run.smithi016.stderr: 29350K .......... .......... .......... .......... .......... 31% 254M 1s 2024-09-12T17:25:02.339 INFO:teuthology.orchestra.run.smithi016.stderr: 29400K .......... .......... .......... .......... .......... 31% 104M 1s 2024-09-12T17:25:02.339 INFO:teuthology.orchestra.run.smithi016.stderr: 29450K .......... .......... .......... .......... .......... 31% 28.9M 1s 2024-09-12T17:25:02.339 INFO:teuthology.orchestra.run.smithi016.stderr: 29500K .......... .......... .......... .......... .......... 31% 154M 1s 2024-09-12T17:25:02.340 INFO:teuthology.orchestra.run.smithi016.stderr: 29550K .......... .......... .......... .......... .......... 31% 59.8M 1s 2024-09-12T17:25:02.340 INFO:teuthology.orchestra.run.smithi016.stderr: 29600K .......... .......... .......... .......... .......... 31% 165M 1s 2024-09-12T17:25:02.340 INFO:teuthology.orchestra.run.smithi016.stderr: 29650K .......... .......... .......... .......... .......... 31% 210M 1s 2024-09-12T17:25:02.340 INFO:teuthology.orchestra.run.smithi016.stderr: 29700K .......... .......... .......... .......... .......... 32% 137M 1s 2024-09-12T17:25:02.340 INFO:teuthology.orchestra.run.smithi016.stderr: 29750K .......... .......... .......... .......... .......... 32% 218M 1s 2024-09-12T17:25:02.340 INFO:teuthology.orchestra.run.smithi016.stderr: 29800K .......... .......... .......... .......... .......... 32% 233M 1s 2024-09-12T17:25:02.340 INFO:teuthology.orchestra.run.smithi016.stderr: 29850K .......... .......... .......... .......... .......... 32% 182M 1s 2024-09-12T17:25:02.340 INFO:teuthology.orchestra.run.smithi016.stderr: 29900K .......... .......... .......... .......... .......... 32% 175M 1s 2024-09-12T17:25:02.340 INFO:teuthology.orchestra.run.smithi016.stderr: 29950K .......... .......... .......... .......... .......... 32% 204M 1s 2024-09-12T17:25:02.340 INFO:teuthology.orchestra.run.smithi016.stderr: 30000K .......... .......... .......... .......... .......... 32% 167M 1s 2024-09-12T17:25:02.340 INFO:teuthology.orchestra.run.smithi016.stderr: 30050K .......... .......... .......... .......... .......... 32% 233M 1s 2024-09-12T17:25:02.340 INFO:teuthology.orchestra.run.smithi016.stderr: 30100K .......... .......... .......... .......... .......... 32% 123M 1s 2024-09-12T17:25:02.340 INFO:teuthology.orchestra.run.smithi016.stderr: 30150K .......... .......... .......... .......... .......... 32% 183M 1s 2024-09-12T17:25:02.340 INFO:teuthology.orchestra.run.smithi016.stderr: 30200K .......... .......... .......... .......... .......... 32% 29.7M 1s 2024-09-12T17:25:02.341 INFO:teuthology.orchestra.run.smithi016.stderr: 30250K .......... .......... .......... .......... .......... 32% 185M 1s 2024-09-12T17:25:02.341 INFO:teuthology.orchestra.run.smithi016.stderr: 30300K .......... .......... .......... .......... .......... 32% 213M 1s 2024-09-12T17:25:02.341 INFO:teuthology.orchestra.run.smithi016.stderr: 30350K .......... .......... .......... .......... .......... 32% 177M 1s 2024-09-12T17:25:02.341 INFO:teuthology.orchestra.run.smithi016.stderr: 30400K .......... .......... .......... .......... .......... 32% 56.4M 1s 2024-09-12T17:25:02.341 INFO:teuthology.orchestra.run.smithi016.stderr: 30450K .......... .......... .......... .......... .......... 32% 185M 1s 2024-09-12T17:25:02.341 INFO:teuthology.orchestra.run.smithi016.stderr: 30500K .......... .......... .......... .......... .......... 32% 237M 1s 2024-09-12T17:25:02.341 INFO:teuthology.orchestra.run.smithi016.stderr: 30550K .......... .......... .......... .......... .......... 32% 189M 1s 2024-09-12T17:25:02.341 INFO:teuthology.orchestra.run.smithi016.stderr: 30600K .......... .......... .......... .......... .......... 32% 112M 1s 2024-09-12T17:25:02.341 INFO:teuthology.orchestra.run.smithi016.stderr: 30650K .......... .......... .......... .......... .......... 33% 99.3M 1s 2024-09-12T17:25:02.341 INFO:teuthology.orchestra.run.smithi016.stderr: 30700K .......... .......... .......... .......... .......... 33% 242M 1s 2024-09-12T17:25:02.341 INFO:teuthology.orchestra.run.smithi016.stderr: 30750K .......... .......... .......... .......... .......... 33% 143M 1s 2024-09-12T17:25:02.341 INFO:teuthology.orchestra.run.smithi016.stderr: 30800K .......... .......... .......... .......... .......... 33% 212M 1s 2024-09-12T17:25:02.341 INFO:teuthology.orchestra.run.smithi016.stderr: 30850K .......... .......... .......... .......... .......... 33% 211M 1s 2024-09-12T17:25:02.342 INFO:teuthology.orchestra.run.smithi016.stderr: 30900K .......... .......... .......... .......... .......... 33% 279M 1s 2024-09-12T17:25:02.342 INFO:teuthology.orchestra.run.smithi016.stderr: 30950K .......... .......... .......... .......... .......... 33% 240M 1s 2024-09-12T17:25:02.342 INFO:teuthology.orchestra.run.smithi016.stderr: 31000K .......... .......... .......... .......... .......... 33% 251M 1s 2024-09-12T17:25:02.342 INFO:teuthology.orchestra.run.smithi016.stderr: 31050K .......... .......... .......... .......... .......... 33% 255M 1s 2024-09-12T17:25:02.342 INFO:teuthology.orchestra.run.smithi016.stderr: 31100K .......... .......... .......... .......... .......... 33% 265M 1s 2024-09-12T17:25:02.342 INFO:teuthology.orchestra.run.smithi016.stderr: 31150K .......... .......... .......... .......... .......... 33% 214M 1s 2024-09-12T17:25:02.342 INFO:teuthology.orchestra.run.smithi016.stderr: 31200K .......... .......... .......... .......... .......... 33% 270M 1s 2024-09-12T17:25:02.342 INFO:teuthology.orchestra.run.smithi016.stderr: 31250K .......... .......... .......... .......... .......... 33% 262M 1s 2024-09-12T17:25:02.342 INFO:teuthology.orchestra.run.smithi016.stderr: 31300K .......... .......... .......... .......... .......... 33% 263M 1s 2024-09-12T17:25:02.342 INFO:teuthology.orchestra.run.smithi016.stderr: 31350K .......... .......... .......... .......... .......... 33% 238M 1s 2024-09-12T17:25:02.342 INFO:teuthology.orchestra.run.smithi016.stderr: 31400K .......... .......... .......... .......... .......... 33% 262M 1s 2024-09-12T17:25:02.342 INFO:teuthology.orchestra.run.smithi016.stderr: 31450K .......... .......... .......... .......... .......... 33% 259M 1s 2024-09-12T17:25:02.342 INFO:teuthology.orchestra.run.smithi016.stderr: 31500K .......... .......... .......... .......... .......... 33% 274M 1s 2024-09-12T17:25:02.343 INFO:teuthology.orchestra.run.smithi016.stderr: 31550K .......... .......... .......... .......... .......... 34% 158M 1s 2024-09-12T17:25:02.343 INFO:teuthology.orchestra.run.smithi016.stderr: 31600K .......... .......... .......... .......... .......... 34% 240M 1s 2024-09-12T17:25:02.343 INFO:teuthology.orchestra.run.smithi016.stderr: 31650K .......... .......... .......... .......... .......... 34% 259M 1s 2024-09-12T17:25:02.343 INFO:teuthology.orchestra.run.smithi016.stderr: 31700K .......... .......... .......... .......... .......... 34% 276M 1s 2024-09-12T17:25:02.343 INFO:teuthology.orchestra.run.smithi016.stderr: 31750K .......... .......... .......... .......... .......... 34% 133M 1s 2024-09-12T17:25:02.343 INFO:teuthology.orchestra.run.smithi016.stderr: 31800K .......... .......... .......... .......... .......... 34% 50.5M 1s 2024-09-12T17:25:02.343 INFO:teuthology.orchestra.run.smithi016.stderr: 31850K .......... .......... .......... .......... .......... 34% 218M 1s 2024-09-12T17:25:02.343 INFO:teuthology.orchestra.run.smithi016.stderr: 31900K .......... .......... .......... .......... .......... 34% 249M 1s 2024-09-12T17:25:02.343 INFO:teuthology.orchestra.run.smithi016.stderr: 31950K .......... .......... .......... .......... .......... 34% 66.1M 1s 2024-09-12T17:25:02.343 INFO:teuthology.orchestra.run.smithi016.stderr: 32000K .......... .......... .......... .......... .......... 34% 224M 1s 2024-09-12T17:25:02.343 INFO:teuthology.orchestra.run.smithi016.stderr: 32050K .......... .......... .......... .......... .......... 34% 225M 1s 2024-09-12T17:25:02.343 INFO:teuthology.orchestra.run.smithi016.stderr: 32100K .......... .......... .......... .......... .......... 34% 205M 1s 2024-09-12T17:25:02.343 INFO:teuthology.orchestra.run.smithi016.stderr: 32150K .......... .......... .......... .......... .......... 34% 210M 1s 2024-09-12T17:25:02.343 INFO:teuthology.orchestra.run.smithi016.stderr: 32200K .......... .......... .......... .......... .......... 34% 225M 1s 2024-09-12T17:25:02.344 INFO:teuthology.orchestra.run.smithi016.stderr: 32250K .......... .......... .......... .......... .......... 34% 225M 1s 2024-09-12T17:25:02.344 INFO:teuthology.orchestra.run.smithi016.stderr: 32300K .......... .......... .......... .......... .......... 34% 220M 1s 2024-09-12T17:25:02.344 INFO:teuthology.orchestra.run.smithi016.stderr: 32350K .......... .......... .......... .......... .......... 34% 156M 1s 2024-09-12T17:25:02.344 INFO:teuthology.orchestra.run.smithi016.stderr: 32400K .......... .......... .......... .......... .......... 34% 235M 1s 2024-09-12T17:25:02.344 INFO:teuthology.orchestra.run.smithi016.stderr: 32450K .......... .......... .......... .......... .......... 34% 62.2M 1s 2024-09-12T17:25:02.344 INFO:teuthology.orchestra.run.smithi016.stderr: 32500K .......... .......... .......... .......... .......... 35% 166M 1s 2024-09-12T17:25:02.344 INFO:teuthology.orchestra.run.smithi016.stderr: 32550K .......... .......... .......... .......... .......... 35% 32.9M 1s 2024-09-12T17:25:02.344 INFO:teuthology.orchestra.run.smithi016.stderr: 32600K .......... .......... .......... .......... .......... 35% 206M 1s 2024-09-12T17:25:02.344 INFO:teuthology.orchestra.run.smithi016.stderr: 32650K .......... .......... .......... .......... .......... 35% 62.3M 1s 2024-09-12T17:25:02.344 INFO:teuthology.orchestra.run.smithi016.stderr: 32700K .......... .......... .......... .......... .......... 35% 81.9M 1s 2024-09-12T17:25:02.344 INFO:teuthology.orchestra.run.smithi016.stderr: 32750K .......... .......... .......... .......... .......... 35% 115M 1s 2024-09-12T17:25:02.344 INFO:teuthology.orchestra.run.smithi016.stderr: 32800K .......... .......... .......... .......... .......... 35% 207M 1s 2024-09-12T17:25:02.344 INFO:teuthology.orchestra.run.smithi016.stderr: 32850K .......... .......... .......... .......... .......... 35% 217M 1s 2024-09-12T17:25:02.345 INFO:teuthology.orchestra.run.smithi016.stderr: 32900K .......... .......... .......... .......... .......... 35% 74.7M 1s 2024-09-12T17:25:02.345 INFO:teuthology.orchestra.run.smithi016.stderr: 32950K .......... .......... .......... .......... .......... 35% 90.0M 1s 2024-09-12T17:25:02.345 INFO:teuthology.orchestra.run.smithi016.stderr: 33000K .......... .......... .......... .......... .......... 35% 111M 1s 2024-09-12T17:25:02.345 INFO:teuthology.orchestra.run.smithi016.stderr: 33050K .......... .......... .......... .......... .......... 35% 218M 1s 2024-09-12T17:25:02.345 INFO:teuthology.orchestra.run.smithi016.stderr: 33100K .......... .......... .......... .......... .......... 35% 152M 1s 2024-09-12T17:25:02.345 INFO:teuthology.orchestra.run.smithi016.stderr: 33150K .......... .......... .......... .......... .......... 35% 117M 1s 2024-09-12T17:25:02.345 INFO:teuthology.orchestra.run.smithi016.stderr: 33200K .......... .......... .......... .......... .......... 35% 36.5M 1s 2024-09-12T17:25:02.345 INFO:teuthology.orchestra.run.smithi016.stderr: 33250K .......... .......... .......... .......... .......... 35% 170M 1s 2024-09-12T17:25:02.345 INFO:teuthology.orchestra.run.smithi016.stderr: 33300K .......... .......... .......... .......... .......... 35% 209M 1s 2024-09-12T17:25:02.345 INFO:teuthology.orchestra.run.smithi016.stderr: 33350K .......... .......... .......... .......... .......... 35% 195M 1s 2024-09-12T17:25:02.345 INFO:teuthology.orchestra.run.smithi016.stderr: 33400K .......... .......... .......... .......... .......... 36% 223M 1s 2024-09-12T17:25:02.345 INFO:teuthology.orchestra.run.smithi016.stderr: 33450K .......... .......... .......... .......... .......... 36% 204M 1s 2024-09-12T17:25:02.346 INFO:teuthology.orchestra.run.smithi016.stderr: 33500K .......... .......... .......... .......... .......... 36% 228M 1s 2024-09-12T17:25:02.346 INFO:teuthology.orchestra.run.smithi016.stderr: 33550K .......... .......... .......... .......... .......... 36% 175M 1s 2024-09-12T17:25:02.346 INFO:teuthology.orchestra.run.smithi016.stderr: 33600K .......... .......... .......... .......... .......... 36% 222M 1s 2024-09-12T17:25:02.346 INFO:teuthology.orchestra.run.smithi016.stderr: 33650K .......... .......... .......... .......... .......... 36% 166M 1s 2024-09-12T17:25:02.346 INFO:teuthology.orchestra.run.smithi016.stderr: 33700K .......... .......... .......... .......... .......... 36% 122M 1s 2024-09-12T17:25:02.346 INFO:teuthology.orchestra.run.smithi016.stderr: 33750K .......... .......... .......... .......... .......... 36% 185M 1s 2024-09-12T17:25:02.346 INFO:teuthology.orchestra.run.smithi016.stderr: 33800K .......... .......... .......... .......... .......... 36% 138M 1s 2024-09-12T17:25:02.346 INFO:teuthology.orchestra.run.smithi016.stderr: 33850K .......... .......... .......... .......... .......... 36% 143M 1s 2024-09-12T17:25:02.346 INFO:teuthology.orchestra.run.smithi016.stderr: 33900K .......... .......... .......... .......... .......... 36% 158M 1s 2024-09-12T17:25:02.346 INFO:teuthology.orchestra.run.smithi016.stderr: 33950K .......... .......... .......... .......... .......... 36% 166M 1s 2024-09-12T17:25:02.346 INFO:teuthology.orchestra.run.smithi016.stderr: 34000K .......... .......... .......... .......... .......... 36% 78.9M 1s 2024-09-12T17:25:02.346 INFO:teuthology.orchestra.run.smithi016.stderr: 34050K .......... .......... .......... .......... .......... 36% 176M 1s 2024-09-12T17:25:02.346 INFO:teuthology.orchestra.run.smithi016.stderr: 34100K .......... .......... .......... .......... .......... 36% 181M 1s 2024-09-12T17:25:02.347 INFO:teuthology.orchestra.run.smithi016.stderr: 34150K .......... .......... .......... .......... .......... 36% 179M 1s 2024-09-12T17:25:02.347 INFO:teuthology.orchestra.run.smithi016.stderr: 34200K .......... .......... .......... .......... .......... 36% 215M 1s 2024-09-12T17:25:02.347 INFO:teuthology.orchestra.run.smithi016.stderr: 34250K .......... .......... .......... .......... .......... 36% 213M 1s 2024-09-12T17:25:02.347 INFO:teuthology.orchestra.run.smithi016.stderr: 34300K .......... .......... .......... .......... .......... 36% 136M 1s 2024-09-12T17:25:02.347 INFO:teuthology.orchestra.run.smithi016.stderr: 34350K .......... .......... .......... .......... .......... 37% 176M 1s 2024-09-12T17:25:02.347 INFO:teuthology.orchestra.run.smithi016.stderr: 34400K .......... .......... .......... .......... .......... 37% 223M 1s 2024-09-12T17:25:02.347 INFO:teuthology.orchestra.run.smithi016.stderr: 34450K .......... .......... .......... .......... .......... 37% 216M 1s 2024-09-12T17:25:02.347 INFO:teuthology.orchestra.run.smithi016.stderr: 34500K .......... .......... .......... .......... .......... 37% 139M 1s 2024-09-12T17:25:02.347 INFO:teuthology.orchestra.run.smithi016.stderr: 34550K .......... .......... .......... .......... .......... 37% 192M 1s 2024-09-12T17:25:02.347 INFO:teuthology.orchestra.run.smithi016.stderr: 34600K .......... .......... .......... .......... .......... 37% 225M 1s 2024-09-12T17:25:02.347 INFO:teuthology.orchestra.run.smithi016.stderr: 34650K .......... .......... .......... .......... .......... 37% 216M 1s 2024-09-12T17:25:02.347 INFO:teuthology.orchestra.run.smithi016.stderr: 34700K .......... .......... .......... .......... .......... 37% 225M 1s 2024-09-12T17:25:02.347 INFO:teuthology.orchestra.run.smithi016.stderr: 34750K .......... .......... .......... .......... .......... 37% 183M 1s 2024-09-12T17:25:02.347 INFO:teuthology.orchestra.run.smithi016.stderr: 34800K .......... .......... .......... .......... .......... 37% 221M 1s 2024-09-12T17:25:02.348 INFO:teuthology.orchestra.run.smithi016.stderr: 34850K .......... .......... .......... .......... .......... 37% 225M 1s 2024-09-12T17:25:02.348 INFO:teuthology.orchestra.run.smithi016.stderr: 34900K .......... .......... .......... .......... .......... 37% 110M 1s 2024-09-12T17:25:02.348 INFO:teuthology.orchestra.run.smithi016.stderr: 34950K .......... .......... .......... .......... .......... 37% 154M 1s 2024-09-12T17:25:02.348 INFO:teuthology.orchestra.run.smithi016.stderr: 35000K .......... .......... .......... .......... .......... 37% 47.9M 1s 2024-09-12T17:25:02.348 INFO:teuthology.orchestra.run.smithi016.stderr: 35050K .......... .......... .......... .......... .......... 37% 219M 1s 2024-09-12T17:25:02.348 INFO:teuthology.orchestra.run.smithi016.stderr: 35100K .......... .......... .......... .......... .......... 37% 196M 1s 2024-09-12T17:25:02.348 INFO:teuthology.orchestra.run.smithi016.stderr: 35150K .......... .......... .......... .......... .......... 37% 178M 1s 2024-09-12T17:25:02.348 INFO:teuthology.orchestra.run.smithi016.stderr: 35200K .......... .......... .......... .......... .......... 37% 218M 1s 2024-09-12T17:25:02.348 INFO:teuthology.orchestra.run.smithi016.stderr: 35250K .......... .......... .......... .......... .......... 37% 215M 1s 2024-09-12T17:25:02.348 INFO:teuthology.orchestra.run.smithi016.stderr: 35300K .......... .......... .......... .......... .......... 38% 223M 1s 2024-09-12T17:25:02.348 INFO:teuthology.orchestra.run.smithi016.stderr: 35350K .......... .......... .......... .......... .......... 38% 82.7M 1s 2024-09-12T17:25:02.348 INFO:teuthology.orchestra.run.smithi016.stderr: 35400K .......... .......... .......... .......... .......... 38% 208M 1s 2024-09-12T17:25:02.348 INFO:teuthology.orchestra.run.smithi016.stderr: 35450K .......... .......... .......... .......... .......... 38% 223M 1s 2024-09-12T17:25:02.349 INFO:teuthology.orchestra.run.smithi016.stderr: 35500K .......... .......... .......... .......... .......... 38% 45.6M 1s 2024-09-12T17:25:02.349 INFO:teuthology.orchestra.run.smithi016.stderr: 35550K .......... .......... .......... .......... .......... 38% 172M 1s 2024-09-12T17:25:02.349 INFO:teuthology.orchestra.run.smithi016.stderr: 35600K .......... .......... .......... .......... .......... 38% 90.3M 1s 2024-09-12T17:25:02.349 INFO:teuthology.orchestra.run.smithi016.stderr: 35650K .......... .......... .......... .......... .......... 38% 196M 1s 2024-09-12T17:25:02.349 INFO:teuthology.orchestra.run.smithi016.stderr: 35700K .......... .......... .......... .......... .......... 38% 43.3M 1s 2024-09-12T17:25:02.349 INFO:teuthology.orchestra.run.smithi016.stderr: 35750K .......... .......... .......... .......... .......... 38% 191M 1s 2024-09-12T17:25:02.349 INFO:teuthology.orchestra.run.smithi016.stderr: 35800K .......... .......... .......... .......... .......... 38% 68.3M 1s 2024-09-12T17:25:02.349 INFO:teuthology.orchestra.run.smithi016.stderr: 35850K .......... .......... .......... .......... .......... 38% 208M 1s 2024-09-12T17:25:02.349 INFO:teuthology.orchestra.run.smithi016.stderr: 35900K .......... .......... .......... .......... .......... 38% 123M 1s 2024-09-12T17:25:02.349 INFO:teuthology.orchestra.run.smithi016.stderr: 35950K .......... .......... .......... .......... .......... 38% 47.7M 1s 2024-09-12T17:25:02.349 INFO:teuthology.orchestra.run.smithi016.stderr: 36000K .......... .......... .......... .......... .......... 38% 31.4M 1s 2024-09-12T17:25:02.349 INFO:teuthology.orchestra.run.smithi016.stderr: 36050K .......... .......... .......... .......... .......... 38% 104M 1s 2024-09-12T17:25:02.349 INFO:teuthology.orchestra.run.smithi016.stderr: 36100K .......... .......... .......... .......... .......... 38% 202M 1s 2024-09-12T17:25:02.350 INFO:teuthology.orchestra.run.smithi016.stderr: 36150K .......... .......... .......... .......... .......... 38% 72.4M 1s 2024-09-12T17:25:02.350 INFO:teuthology.orchestra.run.smithi016.stderr: 36200K .......... .......... .......... .......... .......... 39% 26.1M 1s 2024-09-12T17:25:02.350 INFO:teuthology.orchestra.run.smithi016.stderr: 36250K .......... .......... .......... .......... .......... 39% 148M 1s 2024-09-12T17:25:02.350 INFO:teuthology.orchestra.run.smithi016.stderr: 36300K .......... .......... .......... .......... .......... 39% 164M 1s 2024-09-12T17:25:02.350 INFO:teuthology.orchestra.run.smithi016.stderr: 36350K .......... .......... .......... .......... .......... 39% 175M 1s 2024-09-12T17:25:02.350 INFO:teuthology.orchestra.run.smithi016.stderr: 36400K .......... .......... .......... .......... .......... 39% 220M 1s 2024-09-12T17:25:02.350 INFO:teuthology.orchestra.run.smithi016.stderr: 36450K .......... .......... .......... .......... .......... 39% 209M 1s 2024-09-12T17:25:02.350 INFO:teuthology.orchestra.run.smithi016.stderr: 36500K .......... .......... .......... .......... .......... 39% 220M 1s 2024-09-12T17:25:02.350 INFO:teuthology.orchestra.run.smithi016.stderr: 36550K .......... .......... .......... .......... .......... 39% 185M 1s 2024-09-12T17:25:02.350 INFO:teuthology.orchestra.run.smithi016.stderr: 36600K .......... .......... .......... .......... .......... 39% 205M 1s 2024-09-12T17:25:02.350 INFO:teuthology.orchestra.run.smithi016.stderr: 36650K .......... .......... .......... .......... .......... 39% 226M 1s 2024-09-12T17:25:02.350 INFO:teuthology.orchestra.run.smithi016.stderr: 36700K .......... .......... .......... .......... .......... 39% 200M 1s 2024-09-12T17:25:02.350 INFO:teuthology.orchestra.run.smithi016.stderr: 36750K .......... .......... .......... .......... .......... 39% 175M 1s 2024-09-12T17:25:02.351 INFO:teuthology.orchestra.run.smithi016.stderr: 36800K .......... .......... .......... .......... .......... 39% 202M 1s 2024-09-12T17:25:02.351 INFO:teuthology.orchestra.run.smithi016.stderr: 36850K .......... .......... .......... .......... .......... 39% 186M 1s 2024-09-12T17:25:02.351 INFO:teuthology.orchestra.run.smithi016.stderr: 36900K .......... .......... .......... .......... .......... 39% 199M 1s 2024-09-12T17:25:02.351 INFO:teuthology.orchestra.run.smithi016.stderr: 36950K .......... .......... .......... .......... .......... 39% 201M 1s 2024-09-12T17:25:02.351 INFO:teuthology.orchestra.run.smithi016.stderr: 37000K .......... .......... .......... .......... .......... 39% 215M 0s 2024-09-12T17:25:02.351 INFO:teuthology.orchestra.run.smithi016.stderr: 37050K .......... .......... .......... .......... .......... 39% 211M 0s 2024-09-12T17:25:02.351 INFO:teuthology.orchestra.run.smithi016.stderr: 37100K .......... .......... .......... .......... .......... 39% 214M 0s 2024-09-12T17:25:02.351 INFO:teuthology.orchestra.run.smithi016.stderr: 37150K .......... .......... .......... .......... .......... 40% 180M 0s 2024-09-12T17:25:02.351 INFO:teuthology.orchestra.run.smithi016.stderr: 37200K .......... .......... .......... .......... .......... 40% 200M 0s 2024-09-12T17:25:02.351 INFO:teuthology.orchestra.run.smithi016.stderr: 37250K .......... .......... .......... .......... .......... 40% 216M 0s 2024-09-12T17:25:02.351 INFO:teuthology.orchestra.run.smithi016.stderr: 37300K .......... .......... .......... .......... .......... 40% 228M 0s 2024-09-12T17:25:02.351 INFO:teuthology.orchestra.run.smithi016.stderr: 37350K .......... .......... .......... .......... .......... 40% 187M 0s 2024-09-12T17:25:02.351 INFO:teuthology.orchestra.run.smithi016.stderr: 37400K .......... .......... .......... .......... .......... 40% 176M 0s 2024-09-12T17:25:02.352 INFO:teuthology.orchestra.run.smithi016.stderr: 37450K .......... .......... .......... .......... .......... 40% 212M 0s 2024-09-12T17:25:02.352 INFO:teuthology.orchestra.run.smithi016.stderr: 37500K .......... .......... .......... .......... .......... 40% 208M 0s 2024-09-12T17:25:02.352 INFO:teuthology.orchestra.run.smithi016.stderr: 37550K .......... .......... .......... .......... .......... 40% 169M 0s 2024-09-12T17:25:02.352 INFO:teuthology.orchestra.run.smithi016.stderr: 37600K .......... .......... .......... .......... .......... 40% 180M 0s 2024-09-12T17:25:02.352 INFO:teuthology.orchestra.run.smithi016.stderr: 37650K .......... .......... .......... .......... .......... 40% 184M 0s 2024-09-12T17:25:02.352 INFO:teuthology.orchestra.run.smithi016.stderr: 37700K .......... .......... .......... .......... .......... 40% 221M 0s 2024-09-12T17:25:02.352 INFO:teuthology.orchestra.run.smithi016.stderr: 37750K .......... .......... .......... .......... .......... 40% 183M 0s 2024-09-12T17:25:02.352 INFO:teuthology.orchestra.run.smithi016.stderr: 37800K .......... .......... .......... .......... .......... 40% 193M 0s 2024-09-12T17:25:02.352 INFO:teuthology.orchestra.run.smithi016.stderr: 37850K .......... .......... .......... .......... .......... 40% 188M 0s 2024-09-12T17:25:02.352 INFO:teuthology.orchestra.run.smithi016.stderr: 37900K .......... .......... .......... .......... .......... 40% 213M 0s 2024-09-12T17:25:02.352 INFO:teuthology.orchestra.run.smithi016.stderr: 37950K .......... .......... .......... .......... .......... 40% 75.7M 0s 2024-09-12T17:25:02.352 INFO:teuthology.orchestra.run.smithi016.stderr: 38000K .......... .......... .......... .......... .......... 40% 189M 0s 2024-09-12T17:25:02.352 INFO:teuthology.orchestra.run.smithi016.stderr: 38050K .......... .......... .......... .......... .......... 41% 216M 0s 2024-09-12T17:25:02.353 INFO:teuthology.orchestra.run.smithi016.stderr: 38100K .......... .......... .......... .......... .......... 41% 43.8M 0s 2024-09-12T17:25:02.353 INFO:teuthology.orchestra.run.smithi016.stderr: 38150K .......... .......... .......... .......... .......... 41% 67.4M 0s 2024-09-12T17:25:02.353 INFO:teuthology.orchestra.run.smithi016.stderr: 38200K .......... .......... .......... .......... .......... 41% 235M 0s 2024-09-12T17:25:02.353 INFO:teuthology.orchestra.run.smithi016.stderr: 38250K .......... .......... .......... .......... .......... 41% 226M 0s 2024-09-12T17:25:02.353 INFO:teuthology.orchestra.run.smithi016.stderr: 38300K .......... .......... .......... .......... .......... 41% 74.9M 0s 2024-09-12T17:25:02.353 INFO:teuthology.orchestra.run.smithi016.stderr: 38350K .......... .......... .......... .......... .......... 41% 181M 0s 2024-09-12T17:25:02.353 INFO:teuthology.orchestra.run.smithi016.stderr: 38400K .......... .......... .......... .......... .......... 41% 39.8M 0s 2024-09-12T17:25:02.353 INFO:teuthology.orchestra.run.smithi016.stderr: 38450K .......... .......... .......... .......... .......... 41% 205M 0s 2024-09-12T17:25:02.353 INFO:teuthology.orchestra.run.smithi016.stderr: 38500K .......... .......... .......... .......... .......... 41% 232M 0s 2024-09-12T17:25:02.353 INFO:teuthology.orchestra.run.smithi016.stderr: 38550K .......... .......... .......... .......... .......... 41% 56.2M 0s 2024-09-12T17:25:02.353 INFO:teuthology.orchestra.run.smithi016.stderr: 38600K .......... .......... .......... .......... .......... 41% 161M 0s 2024-09-12T17:25:02.353 INFO:teuthology.orchestra.run.smithi016.stderr: 38650K .......... .......... .......... .......... .......... 41% 186M 0s 2024-09-12T17:25:02.353 INFO:teuthology.orchestra.run.smithi016.stderr: 38700K .......... .......... .......... .......... .......... 41% 231M 0s 2024-09-12T17:25:02.354 INFO:teuthology.orchestra.run.smithi016.stderr: 38750K .......... .......... .......... .......... .......... 41% 184M 0s 2024-09-12T17:25:02.354 INFO:teuthology.orchestra.run.smithi016.stderr: 38800K .......... .......... .......... .......... .......... 41% 59.4M 0s 2024-09-12T17:25:02.354 INFO:teuthology.orchestra.run.smithi016.stderr: 38850K .......... .......... .......... .......... .......... 41% 204M 0s 2024-09-12T17:25:02.354 INFO:teuthology.orchestra.run.smithi016.stderr: 38900K .......... .......... .......... .......... .......... 41% 227M 0s 2024-09-12T17:25:02.354 INFO:teuthology.orchestra.run.smithi016.stderr: 38950K .......... .......... .......... .......... .......... 41% 55.1M 0s 2024-09-12T17:25:02.354 INFO:teuthology.orchestra.run.smithi016.stderr: 39000K .......... .......... .......... .......... .......... 42% 25.2M 0s 2024-09-12T17:25:02.354 INFO:teuthology.orchestra.run.smithi016.stderr: 39050K .......... .......... .......... .......... .......... 42% 207M 0s 2024-09-12T17:25:02.354 INFO:teuthology.orchestra.run.smithi016.stderr: 39100K .......... .......... .......... .......... .......... 42% 225M 0s 2024-09-12T17:25:02.354 INFO:teuthology.orchestra.run.smithi016.stderr: 39150K .......... .......... .......... .......... .......... 42% 132M 0s 2024-09-12T17:25:02.354 INFO:teuthology.orchestra.run.smithi016.stderr: 39200K .......... .......... .......... .......... .......... 42% 21.3M 0s 2024-09-12T17:25:02.354 INFO:teuthology.orchestra.run.smithi016.stderr: 39250K .......... .......... .......... .......... .......... 42% 130M 0s 2024-09-12T17:25:02.354 INFO:teuthology.orchestra.run.smithi016.stderr: 39300K .......... .......... .......... .......... .......... 42% 218M 0s 2024-09-12T17:25:02.354 INFO:teuthology.orchestra.run.smithi016.stderr: 39350K .......... .......... .......... .......... .......... 42% 199M 0s 2024-09-12T17:25:02.355 INFO:teuthology.orchestra.run.smithi016.stderr: 39400K .......... .......... .......... .......... .......... 42% 223M 0s 2024-09-12T17:25:02.355 INFO:teuthology.orchestra.run.smithi016.stderr: 39450K .......... .......... .......... .......... .......... 42% 223M 0s 2024-09-12T17:25:02.355 INFO:teuthology.orchestra.run.smithi016.stderr: 39500K .......... .......... .......... .......... .......... 42% 173M 0s 2024-09-12T17:25:02.355 INFO:teuthology.orchestra.run.smithi016.stderr: 39550K .......... .......... .......... .......... .......... 42% 186M 0s 2024-09-12T17:25:02.355 INFO:teuthology.orchestra.run.smithi016.stderr: 39600K .......... .......... .......... .......... .......... 42% 199M 0s 2024-09-12T17:25:02.355 INFO:teuthology.orchestra.run.smithi016.stderr: 39650K .......... .......... .......... .......... .......... 42% 193M 0s 2024-09-12T17:25:02.355 INFO:teuthology.orchestra.run.smithi016.stderr: 39700K .......... .......... .......... .......... .......... 42% 202M 0s 2024-09-12T17:25:02.355 INFO:teuthology.orchestra.run.smithi016.stderr: 39750K .......... .......... .......... .......... .......... 42% 133M 0s 2024-09-12T17:25:02.355 INFO:teuthology.orchestra.run.smithi016.stderr: 39800K .......... .......... .......... .......... .......... 42% 207M 0s 2024-09-12T17:25:02.355 INFO:teuthology.orchestra.run.smithi016.stderr: 39850K .......... .......... .......... .......... .......... 42% 166M 0s 2024-09-12T17:25:02.355 INFO:teuthology.orchestra.run.smithi016.stderr: 39900K .......... .......... .......... .......... .......... 43% 160M 0s 2024-09-12T17:25:02.355 INFO:teuthology.orchestra.run.smithi016.stderr: 39950K .......... .......... .......... .......... .......... 43% 169M 0s 2024-09-12T17:25:02.355 INFO:teuthology.orchestra.run.smithi016.stderr: 40000K .......... .......... .......... .......... .......... 43% 182M 0s 2024-09-12T17:25:02.356 INFO:teuthology.orchestra.run.smithi016.stderr: 40050K .......... .......... .......... .......... .......... 43% 234M 0s 2024-09-12T17:25:02.356 INFO:teuthology.orchestra.run.smithi016.stderr: 40100K .......... .......... .......... .......... .......... 43% 236M 0s 2024-09-12T17:25:02.356 INFO:teuthology.orchestra.run.smithi016.stderr: 40150K .......... .......... .......... .......... .......... 43% 202M 0s 2024-09-12T17:25:02.356 INFO:teuthology.orchestra.run.smithi016.stderr: 40200K .......... .......... .......... .......... .......... 43% 235M 0s 2024-09-12T17:25:02.356 INFO:teuthology.orchestra.run.smithi016.stderr: 40250K .......... .......... .......... .......... .......... 43% 217M 0s 2024-09-12T17:25:02.356 INFO:teuthology.orchestra.run.smithi016.stderr: 40300K .......... .......... .......... .......... .......... 43% 238M 0s 2024-09-12T17:25:02.356 INFO:teuthology.orchestra.run.smithi016.stderr: 40350K .......... .......... .......... .......... .......... 43% 185M 0s 2024-09-12T17:25:02.356 INFO:teuthology.orchestra.run.smithi016.stderr: 40400K .......... .......... .......... .......... .......... 43% 233M 0s 2024-09-12T17:25:02.356 INFO:teuthology.orchestra.run.smithi016.stderr: 40450K .......... .......... .......... .......... .......... 43% 225M 0s 2024-09-12T17:25:02.356 INFO:teuthology.orchestra.run.smithi016.stderr: 40500K .......... .......... .......... .......... .......... 43% 223M 0s 2024-09-12T17:25:02.356 INFO:teuthology.orchestra.run.smithi016.stderr: 40550K .......... .......... .......... .......... .......... 43% 186M 0s 2024-09-12T17:25:02.356 INFO:teuthology.orchestra.run.smithi016.stderr: 40600K .......... .......... .......... .......... .......... 43% 218M 0s 2024-09-12T17:25:02.356 INFO:teuthology.orchestra.run.smithi016.stderr: 40650K .......... .......... .......... .......... .......... 43% 223M 0s 2024-09-12T17:25:02.356 INFO:teuthology.orchestra.run.smithi016.stderr: 40700K .......... .......... .......... .......... .......... 43% 218M 0s 2024-09-12T17:25:02.357 INFO:teuthology.orchestra.run.smithi016.stderr: 40750K .......... .......... .......... .......... .......... 43% 176M 0s 2024-09-12T17:25:02.357 INFO:teuthology.orchestra.run.smithi016.stderr: 40800K .......... .......... .......... .......... .......... 43% 231M 0s 2024-09-12T17:25:02.357 INFO:teuthology.orchestra.run.smithi016.stderr: 40850K .......... .......... .......... .......... .......... 44% 208M 0s 2024-09-12T17:25:02.357 INFO:teuthology.orchestra.run.smithi016.stderr: 40900K .......... .......... .......... .......... .......... 44% 233M 0s 2024-09-12T17:25:02.357 INFO:teuthology.orchestra.run.smithi016.stderr: 40950K .......... .......... .......... .......... .......... 44% 206M 0s 2024-09-12T17:25:02.357 INFO:teuthology.orchestra.run.smithi016.stderr: 41000K .......... .......... .......... .......... .......... 44% 240M 0s 2024-09-12T17:25:02.357 INFO:teuthology.orchestra.run.smithi016.stderr: 41050K .......... .......... .......... .......... .......... 44% 234M 0s 2024-09-12T17:25:02.357 INFO:teuthology.orchestra.run.smithi016.stderr: 41100K .......... .......... .......... .......... .......... 44% 58.3M 0s 2024-09-12T17:25:02.357 INFO:teuthology.orchestra.run.smithi016.stderr: 41150K .......... .......... .......... .......... .......... 44% 83.4M 0s 2024-09-12T17:25:02.357 INFO:teuthology.orchestra.run.smithi016.stderr: 41200K .......... .......... .......... .......... .......... 44% 83.2M 0s 2024-09-12T17:25:02.357 INFO:teuthology.orchestra.run.smithi016.stderr: 41250K .......... .......... .......... .......... .......... 44% 184M 0s 2024-09-12T17:25:02.357 INFO:teuthology.orchestra.run.smithi016.stderr: 41300K .......... .......... .......... .......... .......... 44% 235M 0s 2024-09-12T17:25:02.357 INFO:teuthology.orchestra.run.smithi016.stderr: 41350K .......... .......... .......... .......... .......... 44% 125M 0s 2024-09-12T17:25:02.358 INFO:teuthology.orchestra.run.smithi016.stderr: 41400K .......... .......... .......... .......... .......... 44% 56.1M 0s 2024-09-12T17:25:02.358 INFO:teuthology.orchestra.run.smithi016.stderr: 41450K .......... .......... .......... .......... .......... 44% 213M 0s 2024-09-12T17:25:02.358 INFO:teuthology.orchestra.run.smithi016.stderr: 41500K .......... .......... .......... .......... .......... 44% 63.2M 0s 2024-09-12T17:25:02.358 INFO:teuthology.orchestra.run.smithi016.stderr: 41550K .......... .......... .......... .......... .......... 44% 176M 0s 2024-09-12T17:25:02.358 INFO:teuthology.orchestra.run.smithi016.stderr: 41600K .......... .......... .......... .......... .......... 44% 216M 0s 2024-09-12T17:25:02.358 INFO:teuthology.orchestra.run.smithi016.stderr: 41650K .......... .......... .......... .......... .......... 44% 233M 0s 2024-09-12T17:25:02.358 INFO:teuthology.orchestra.run.smithi016.stderr: 41700K .......... .......... .......... .......... .......... 44% 213M 0s 2024-09-12T17:25:02.358 INFO:teuthology.orchestra.run.smithi016.stderr: 41750K .......... .......... .......... .......... .......... 44% 194M 0s 2024-09-12T17:25:02.358 INFO:teuthology.orchestra.run.smithi016.stderr: 41800K .......... .......... .......... .......... .......... 45% 70.1M 0s 2024-09-12T17:25:02.358 INFO:teuthology.orchestra.run.smithi016.stderr: 41850K .......... .......... .......... .......... .......... 45% 43.8M 0s 2024-09-12T17:25:02.358 INFO:teuthology.orchestra.run.smithi016.stderr: 41900K .......... .......... .......... .......... .......... 45% 133M 0s 2024-09-12T17:25:02.358 INFO:teuthology.orchestra.run.smithi016.stderr: 41950K .......... .......... .......... .......... .......... 45% 40.0M 0s 2024-09-12T17:25:02.358 INFO:teuthology.orchestra.run.smithi016.stderr: 42000K .......... .......... .......... .......... .......... 45% 129M 0s 2024-09-12T17:25:02.358 INFO:teuthology.orchestra.run.smithi016.stderr: 42050K .......... .......... .......... .......... .......... 45% 205M 0s 2024-09-12T17:25:02.359 INFO:teuthology.orchestra.run.smithi016.stderr: 42100K .......... .......... .......... .......... .......... 45% 201M 0s 2024-09-12T17:25:02.359 INFO:teuthology.orchestra.run.smithi016.stderr: 42150K .......... .......... .......... .......... .......... 45% 26.0M 0s 2024-09-12T17:25:02.359 INFO:teuthology.orchestra.run.smithi016.stderr: 42200K .......... .......... .......... .......... .......... 45% 164M 0s 2024-09-12T17:25:02.359 INFO:teuthology.orchestra.run.smithi016.stderr: 42250K .......... .......... .......... .......... .......... 45% 186M 0s 2024-09-12T17:25:02.359 INFO:teuthology.orchestra.run.smithi016.stderr: 42300K .......... .......... .......... .......... .......... 45% 193M 0s 2024-09-12T17:25:02.359 INFO:teuthology.orchestra.run.smithi016.stderr: 42350K .......... .......... .......... .......... .......... 45% 161M 0s 2024-09-12T17:25:02.359 INFO:teuthology.orchestra.run.smithi016.stderr: 42400K .......... .......... .......... .......... .......... 45% 190M 0s 2024-09-12T17:25:02.359 INFO:teuthology.orchestra.run.smithi016.stderr: 42450K .......... .......... .......... .......... .......... 45% 203M 0s 2024-09-12T17:25:02.359 INFO:teuthology.orchestra.run.smithi016.stderr: 42500K .......... .......... .......... .......... .......... 45% 196M 0s 2024-09-12T17:25:02.359 INFO:teuthology.orchestra.run.smithi016.stderr: 42550K .......... .......... .......... .......... .......... 45% 177M 0s 2024-09-12T17:25:02.359 INFO:teuthology.orchestra.run.smithi016.stderr: 42600K .......... .......... .......... .......... .......... 45% 189M 0s 2024-09-12T17:25:02.359 INFO:teuthology.orchestra.run.smithi016.stderr: 42650K .......... .......... .......... .......... .......... 45% 186M 0s 2024-09-12T17:25:02.359 INFO:teuthology.orchestra.run.smithi016.stderr: 42700K .......... .......... .......... .......... .......... 46% 149M 0s 2024-09-12T17:25:02.359 INFO:teuthology.orchestra.run.smithi016.stderr: 42750K .......... .......... .......... .......... .......... 46% 171M 0s 2024-09-12T17:25:02.360 INFO:teuthology.orchestra.run.smithi016.stderr: 42800K .......... .......... .......... .......... .......... 46% 204M 0s 2024-09-12T17:25:02.360 INFO:teuthology.orchestra.run.smithi016.stderr: 42850K .......... .......... .......... .......... .......... 46% 109M 0s 2024-09-12T17:25:02.360 INFO:teuthology.orchestra.run.smithi016.stderr: 42900K .......... .......... .......... .......... .......... 46% 187M 0s 2024-09-12T17:25:02.360 INFO:teuthology.orchestra.run.smithi016.stderr: 42950K .......... .......... .......... .......... .......... 46% 88.6M 0s 2024-09-12T17:25:02.360 INFO:teuthology.orchestra.run.smithi016.stderr: 43000K .......... .......... .......... .......... .......... 46% 111M 0s 2024-09-12T17:25:02.360 INFO:teuthology.orchestra.run.smithi016.stderr: 43050K .......... .......... .......... .......... .......... 46% 61.6M 0s 2024-09-12T17:25:02.360 INFO:teuthology.orchestra.run.smithi016.stderr: 43100K .......... .......... .......... .......... .......... 46% 163M 0s 2024-09-12T17:25:02.360 INFO:teuthology.orchestra.run.smithi016.stderr: 43150K .......... .......... .......... .......... .......... 46% 138M 0s 2024-09-12T17:25:02.360 INFO:teuthology.orchestra.run.smithi016.stderr: 43200K .......... .......... .......... .......... .......... 46% 177M 0s 2024-09-12T17:25:02.360 INFO:teuthology.orchestra.run.smithi016.stderr: 43250K .......... .......... .......... .......... .......... 46% 117M 0s 2024-09-12T17:25:02.360 INFO:teuthology.orchestra.run.smithi016.stderr: 43300K .......... .......... .......... .......... .......... 46% 186M 0s 2024-09-12T17:25:02.360 INFO:teuthology.orchestra.run.smithi016.stderr: 43350K .......... .......... .......... .......... .......... 46% 140M 0s 2024-09-12T17:25:02.360 INFO:teuthology.orchestra.run.smithi016.stderr: 43400K .......... .......... .......... .......... .......... 46% 192M 0s 2024-09-12T17:25:02.360 INFO:teuthology.orchestra.run.smithi016.stderr: 43450K .......... .......... .......... .......... .......... 46% 167M 0s 2024-09-12T17:25:02.361 INFO:teuthology.orchestra.run.smithi016.stderr: 43500K .......... .......... .......... .......... .......... 46% 175M 0s 2024-09-12T17:25:02.361 INFO:teuthology.orchestra.run.smithi016.stderr: 43550K .......... .......... .......... .......... .......... 46% 152M 0s 2024-09-12T17:25:02.361 INFO:teuthology.orchestra.run.smithi016.stderr: 43600K .......... .......... .......... .......... .......... 46% 193M 0s 2024-09-12T17:25:02.361 INFO:teuthology.orchestra.run.smithi016.stderr: 43650K .......... .......... .......... .......... .......... 47% 182M 0s 2024-09-12T17:25:02.361 INFO:teuthology.orchestra.run.smithi016.stderr: 43700K .......... .......... .......... .......... .......... 47% 191M 0s 2024-09-12T17:25:02.361 INFO:teuthology.orchestra.run.smithi016.stderr: 43750K .......... .......... .......... .......... .......... 47% 181M 0s 2024-09-12T17:25:02.361 INFO:teuthology.orchestra.run.smithi016.stderr: 43800K .......... .......... .......... .......... .......... 47% 198M 0s 2024-09-12T17:25:02.361 INFO:teuthology.orchestra.run.smithi016.stderr: 43850K .......... .......... .......... .......... .......... 47% 159M 0s 2024-09-12T17:25:02.361 INFO:teuthology.orchestra.run.smithi016.stderr: 43900K .......... .......... .......... .......... .......... 47% 205M 0s 2024-09-12T17:25:02.361 INFO:teuthology.orchestra.run.smithi016.stderr: 43950K .......... .......... .......... .......... .......... 47% 180M 0s 2024-09-12T17:25:02.361 INFO:teuthology.orchestra.run.smithi016.stderr: 44000K .......... .......... .......... .......... .......... 47% 194M 0s 2024-09-12T17:25:02.361 INFO:teuthology.orchestra.run.smithi016.stderr: 44050K .......... .......... .......... .......... .......... 47% 210M 0s 2024-09-12T17:25:02.361 INFO:teuthology.orchestra.run.smithi016.stderr: 44100K .......... .......... .......... .......... .......... 47% 194M 0s 2024-09-12T17:25:02.362 INFO:teuthology.orchestra.run.smithi016.stderr: 44150K .......... .......... .......... .......... .......... 47% 183M 0s 2024-09-12T17:25:02.362 INFO:teuthology.orchestra.run.smithi016.stderr: 44200K .......... .......... .......... .......... .......... 47% 47.3M 0s 2024-09-12T17:25:02.362 INFO:teuthology.orchestra.run.smithi016.stderr: 44250K .......... .......... .......... .......... .......... 47% 193M 0s 2024-09-12T17:25:02.362 INFO:teuthology.orchestra.run.smithi016.stderr: 44300K .......... .......... .......... .......... .......... 47% 43.9M 0s 2024-09-12T17:25:02.362 INFO:teuthology.orchestra.run.smithi016.stderr: 44350K .......... .......... .......... .......... .......... 47% 151M 0s 2024-09-12T17:25:02.362 INFO:teuthology.orchestra.run.smithi016.stderr: 44400K .......... .......... .......... .......... .......... 47% 191M 0s 2024-09-12T17:25:02.362 INFO:teuthology.orchestra.run.smithi016.stderr: 44450K .......... .......... .......... .......... .......... 47% 53.2M 0s 2024-09-12T17:25:02.362 INFO:teuthology.orchestra.run.smithi016.stderr: 44500K .......... .......... .......... .......... .......... 47% 178M 0s 2024-09-12T17:25:02.362 INFO:teuthology.orchestra.run.smithi016.stderr: 44550K .......... .......... .......... .......... .......... 48% 82.6M 0s 2024-09-12T17:25:02.362 INFO:teuthology.orchestra.run.smithi016.stderr: 44600K .......... .......... .......... .......... .......... 48% 155M 0s 2024-09-12T17:25:02.362 INFO:teuthology.orchestra.run.smithi016.stderr: 44650K .......... .......... .......... .......... .......... 48% 207M 0s 2024-09-12T17:25:02.362 INFO:teuthology.orchestra.run.smithi016.stderr: 44700K .......... .......... .......... .......... .......... 48% 211M 0s 2024-09-12T17:25:02.362 INFO:teuthology.orchestra.run.smithi016.stderr: 44750K .......... .......... .......... .......... .......... 48% 160M 0s 2024-09-12T17:25:02.362 INFO:teuthology.orchestra.run.smithi016.stderr: 44800K .......... .......... .......... .......... .......... 48% 203M 0s 2024-09-12T17:25:02.363 INFO:teuthology.orchestra.run.smithi016.stderr: 44850K .......... .......... .......... .......... .......... 48% 181M 0s 2024-09-12T17:25:02.363 INFO:teuthology.orchestra.run.smithi016.stderr: 44900K .......... .......... .......... .......... .......... 48% 77.6M 0s 2024-09-12T17:25:02.363 INFO:teuthology.orchestra.run.smithi016.stderr: 44950K .......... .......... .......... .......... .......... 48% 178M 0s 2024-09-12T17:25:02.363 INFO:teuthology.orchestra.run.smithi016.stderr: 45000K .......... .......... .......... .......... .......... 48% 180M 0s 2024-09-12T17:25:02.363 INFO:teuthology.orchestra.run.smithi016.stderr: 45050K .......... .......... .......... .......... .......... 48% 199M 0s 2024-09-12T17:25:02.363 INFO:teuthology.orchestra.run.smithi016.stderr: 45100K .......... .......... .......... .......... .......... 48% 19.1M 0s 2024-09-12T17:25:02.363 INFO:teuthology.orchestra.run.smithi016.stderr: 45150K .......... .......... .......... .......... .......... 48% 166M 0s 2024-09-12T17:25:02.363 INFO:teuthology.orchestra.run.smithi016.stderr: 45200K .......... .......... .......... .......... .......... 48% 153M 0s 2024-09-12T17:25:02.363 INFO:teuthology.orchestra.run.smithi016.stderr: 45250K .......... .......... .......... .......... .......... 48% 185M 0s 2024-09-12T17:25:02.363 INFO:teuthology.orchestra.run.smithi016.stderr: 45300K .......... .......... .......... .......... .......... 48% 182M 0s 2024-09-12T17:25:02.363 INFO:teuthology.orchestra.run.smithi016.stderr: 45350K .......... .......... .......... .......... .......... 48% 78.8M 0s 2024-09-12T17:25:02.363 INFO:teuthology.orchestra.run.smithi016.stderr: 45400K .......... .......... .......... .......... .......... 48% 46.0M 0s 2024-09-12T17:25:02.363 INFO:teuthology.orchestra.run.smithi016.stderr: 45450K .......... .......... .......... .......... .......... 48% 187M 0s 2024-09-12T17:25:02.364 INFO:teuthology.orchestra.run.smithi016.stderr: 45500K .......... .......... .......... .......... .......... 49% 106M 0s 2024-09-12T17:25:02.364 INFO:teuthology.orchestra.run.smithi016.stderr: 45550K .......... .......... .......... .......... .......... 49% 112M 0s 2024-09-12T17:25:02.364 INFO:teuthology.orchestra.run.smithi016.stderr: 45600K .......... .......... .......... .......... .......... 49% 101M 0s 2024-09-12T17:25:02.364 INFO:teuthology.orchestra.run.smithi016.stderr: 45650K .......... .......... .......... .......... .......... 49% 123M 0s 2024-09-12T17:25:02.364 INFO:teuthology.orchestra.run.smithi016.stderr: 45700K .......... .......... .......... .......... .......... 49% 196M 0s 2024-09-12T17:25:02.364 INFO:teuthology.orchestra.run.smithi016.stderr: 45750K .......... .......... .......... .......... .......... 49% 58.3M 0s 2024-09-12T17:25:02.364 INFO:teuthology.orchestra.run.smithi016.stderr: 45800K .......... .......... .......... .......... .......... 49% 33.7M 0s 2024-09-12T17:25:02.364 INFO:teuthology.orchestra.run.smithi016.stderr: 45850K .......... .......... .......... .......... .......... 49% 1.73M 0s 2024-09-12T17:25:02.364 INFO:teuthology.orchestra.run.smithi016.stderr: 45900K .......... .......... .......... .......... .......... 49% 157M 0s 2024-09-12T17:25:02.364 INFO:teuthology.orchestra.run.smithi016.stderr: 45950K .......... .......... .......... .......... .......... 49% 131M 0s 2024-09-12T17:25:02.364 INFO:teuthology.orchestra.run.smithi016.stderr: 46000K .......... .......... .......... .......... .......... 49% 188M 0s 2024-09-12T17:25:02.364 INFO:teuthology.orchestra.run.smithi016.stderr: 46050K .......... .......... .......... .......... .......... 49% 190M 0s 2024-09-12T17:25:02.364 INFO:teuthology.orchestra.run.smithi016.stderr: 46100K .......... .......... .......... .......... .......... 49% 192M 0s 2024-09-12T17:25:02.364 INFO:teuthology.orchestra.run.smithi016.stderr: 46150K .......... .......... .......... .......... .......... 49% 46.6M 0s 2024-09-12T17:25:02.365 INFO:teuthology.orchestra.run.smithi016.stderr: 46200K .......... .......... .......... .......... .......... 49% 154M 0s 2024-09-12T17:25:02.365 INFO:teuthology.orchestra.run.smithi016.stderr: 46250K .......... .......... .......... .......... .......... 49% 176M 0s 2024-09-12T17:25:02.365 INFO:teuthology.orchestra.run.smithi016.stderr: 46300K .......... .......... .......... .......... .......... 49% 180M 0s 2024-09-12T17:25:02.365 INFO:teuthology.orchestra.run.smithi016.stderr: 46350K .......... .......... .......... .......... .......... 49% 150M 0s 2024-09-12T17:25:02.365 INFO:teuthology.orchestra.run.smithi016.stderr: 46400K .......... .......... .......... .......... .......... 49% 177M 0s 2024-09-12T17:25:02.365 INFO:teuthology.orchestra.run.smithi016.stderr: 46450K .......... .......... .......... .......... .......... 50% 162M 0s 2024-09-12T17:25:02.365 INFO:teuthology.orchestra.run.smithi016.stderr: 46500K .......... .......... .......... .......... .......... 50% 180M 0s 2024-09-12T17:25:02.365 INFO:teuthology.orchestra.run.smithi016.stderr: 46550K .......... .......... .......... .......... .......... 50% 161M 0s 2024-09-12T17:25:02.365 INFO:teuthology.orchestra.run.smithi016.stderr: 46600K .......... .......... .......... .......... .......... 50% 182M 0s 2024-09-12T17:25:02.365 INFO:teuthology.orchestra.run.smithi016.stderr: 46650K .......... .......... .......... .......... .......... 50% 179M 0s 2024-09-12T17:25:02.365 INFO:teuthology.orchestra.run.smithi016.stderr: 46700K .......... .......... .......... .......... .......... 50% 181M 0s 2024-09-12T17:25:02.365 INFO:teuthology.orchestra.run.smithi016.stderr: 46750K .......... .......... .......... .......... .......... 50% 145M 0s 2024-09-12T17:25:02.365 INFO:teuthology.orchestra.run.smithi016.stderr: 46800K .......... .......... .......... .......... .......... 50% 92.3M 0s 2024-09-12T17:25:02.365 INFO:teuthology.orchestra.run.smithi016.stderr: 46850K .......... .......... .......... .......... .......... 50% 98.8M 0s 2024-09-12T17:25:02.366 INFO:teuthology.orchestra.run.smithi016.stderr: 46900K .......... .......... .......... .......... .......... 50% 96.6M 0s 2024-09-12T17:25:02.366 INFO:teuthology.orchestra.run.smithi016.stderr: 46950K .......... .......... .......... .......... .......... 50% 91.2M 0s 2024-09-12T17:25:02.366 INFO:teuthology.orchestra.run.smithi016.stderr: 47000K .......... .......... .......... .......... .......... 50% 97.1M 0s 2024-09-12T17:25:02.366 INFO:teuthology.orchestra.run.smithi016.stderr: 47050K .......... .......... .......... .......... .......... 50% 98.5M 0s 2024-09-12T17:25:02.366 INFO:teuthology.orchestra.run.smithi016.stderr: 47100K .......... .......... .......... .......... .......... 50% 100M 0s 2024-09-12T17:25:02.366 INFO:teuthology.orchestra.run.smithi016.stderr: 47150K .......... .......... .......... .......... .......... 50% 82.6M 0s 2024-09-12T17:25:02.366 INFO:teuthology.orchestra.run.smithi016.stderr: 47200K .......... .......... .......... .......... .......... 50% 100M 0s 2024-09-12T17:25:02.366 INFO:teuthology.orchestra.run.smithi016.stderr: 47250K .......... .......... .......... .......... .......... 50% 102M 0s 2024-09-12T17:25:02.366 INFO:teuthology.orchestra.run.smithi016.stderr: 47300K .......... .......... .......... .......... .......... 50% 102M 0s 2024-09-12T17:25:02.366 INFO:teuthology.orchestra.run.smithi016.stderr: 47350K .......... .......... .......... .......... .......... 51% 90.8M 0s 2024-09-12T17:25:02.366 INFO:teuthology.orchestra.run.smithi016.stderr: 47400K .......... .......... .......... .......... .......... 51% 95.2M 0s 2024-09-12T17:25:02.366 INFO:teuthology.orchestra.run.smithi016.stderr: 47450K .......... .......... .......... .......... .......... 51% 101M 0s 2024-09-12T17:25:02.366 INFO:teuthology.orchestra.run.smithi016.stderr: 47500K .......... .......... .......... .......... .......... 51% 99.6M 0s 2024-09-12T17:25:02.366 INFO:teuthology.orchestra.run.smithi016.stderr: 47550K .......... .......... .......... .......... .......... 51% 84.4M 0s 2024-09-12T17:25:02.367 INFO:teuthology.orchestra.run.smithi016.stderr: 47600K .......... .......... .......... .......... .......... 51% 102M 0s 2024-09-12T17:25:02.367 INFO:teuthology.orchestra.run.smithi016.stderr: 47650K .......... .......... .......... .......... .......... 51% 97.7M 0s 2024-09-12T17:25:02.367 INFO:teuthology.orchestra.run.smithi016.stderr: 47700K .......... .......... .......... .......... .......... 51% 101M 0s 2024-09-12T17:25:02.367 INFO:teuthology.orchestra.run.smithi016.stderr: 47750K .......... .......... .......... .......... .......... 51% 88.6M 0s 2024-09-12T17:25:02.367 INFO:teuthology.orchestra.run.smithi016.stderr: 47800K .......... .......... .......... .......... .......... 51% 97.2M 0s 2024-09-12T17:25:02.367 INFO:teuthology.orchestra.run.smithi016.stderr: 47850K .......... .......... .......... .......... .......... 51% 99.1M 0s 2024-09-12T17:25:02.367 INFO:teuthology.orchestra.run.smithi016.stderr: 47900K .......... .......... .......... .......... .......... 51% 93.6M 0s 2024-09-12T17:25:02.367 INFO:teuthology.orchestra.run.smithi016.stderr: 47950K .......... .......... .......... .......... .......... 51% 90.2M 0s 2024-09-12T17:25:02.367 INFO:teuthology.orchestra.run.smithi016.stderr: 48000K .......... .......... .......... .......... .......... 51% 94.3M 0s 2024-09-12T17:25:02.367 INFO:teuthology.orchestra.run.smithi016.stderr: 48050K .......... .......... .......... .......... .......... 51% 101M 0s 2024-09-12T17:25:02.367 INFO:teuthology.orchestra.run.smithi016.stderr: 48100K .......... .......... .......... .......... .......... 51% 89.3M 0s 2024-09-12T17:25:02.367 INFO:teuthology.orchestra.run.smithi016.stderr: 48150K .......... .......... .......... .......... .......... 51% 77.2M 0s 2024-09-12T17:25:02.367 INFO:teuthology.orchestra.run.smithi016.stderr: 48200K .......... .......... .......... .......... .......... 51% 76.5M 0s 2024-09-12T17:25:02.367 INFO:teuthology.orchestra.run.smithi016.stderr: 48250K .......... .......... .......... .......... .......... 51% 93.3M 0s 2024-09-12T17:25:02.368 INFO:teuthology.orchestra.run.smithi016.stderr: 48300K .......... .......... .......... .......... .......... 52% 93.2M 0s 2024-09-12T17:25:02.368 INFO:teuthology.orchestra.run.smithi016.stderr: 48350K .......... .......... .......... .......... .......... 52% 77.8M 0s 2024-09-12T17:25:02.368 INFO:teuthology.orchestra.run.smithi016.stderr: 48400K .......... .......... .......... .......... .......... 52% 91.7M 0s 2024-09-12T17:25:02.368 INFO:teuthology.orchestra.run.smithi016.stderr: 48450K .......... .......... .......... .......... .......... 52% 90.5M 0s 2024-09-12T17:25:02.368 INFO:teuthology.orchestra.run.smithi016.stderr: 48500K .......... .......... .......... .......... .......... 52% 94.2M 0s 2024-09-12T17:25:02.368 INFO:teuthology.orchestra.run.smithi016.stderr: 48550K .......... .......... .......... .......... .......... 52% 88.2M 0s 2024-09-12T17:25:02.368 INFO:teuthology.orchestra.run.smithi016.stderr: 48600K .......... .......... .......... .......... .......... 52% 99.0M 0s 2024-09-12T17:25:02.368 INFO:teuthology.orchestra.run.smithi016.stderr: 48650K .......... .......... .......... .......... .......... 52% 99.7M 0s 2024-09-12T17:25:02.368 INFO:teuthology.orchestra.run.smithi016.stderr: 48700K .......... .......... .......... .......... .......... 52% 105M 0s 2024-09-12T17:25:02.368 INFO:teuthology.orchestra.run.smithi016.stderr: 48750K .......... .......... .......... .......... .......... 52% 85.8M 0s 2024-09-12T17:25:02.368 INFO:teuthology.orchestra.run.smithi016.stderr: 48800K .......... .......... .......... .......... .......... 52% 107M 0s 2024-09-12T17:25:02.368 INFO:teuthology.orchestra.run.smithi016.stderr: 48850K .......... .......... .......... .......... .......... 52% 106M 0s 2024-09-12T17:25:02.368 INFO:teuthology.orchestra.run.smithi016.stderr: 48900K .......... .......... .......... .......... .......... 52% 97.0M 0s 2024-09-12T17:25:02.369 INFO:teuthology.orchestra.run.smithi016.stderr: 48950K .......... .......... .......... .......... .......... 52% 99.2M 0s 2024-09-12T17:25:02.369 INFO:teuthology.orchestra.run.smithi016.stderr: 49000K .......... .......... .......... .......... .......... 52% 112M 0s 2024-09-12T17:25:02.369 INFO:teuthology.orchestra.run.smithi016.stderr: 49050K .......... .......... .......... .......... .......... 52% 113M 0s 2024-09-12T17:25:02.369 INFO:teuthology.orchestra.run.smithi016.stderr: 49100K .......... .......... .......... .......... .......... 52% 114M 0s 2024-09-12T17:25:02.369 INFO:teuthology.orchestra.run.smithi016.stderr: 49150K .......... .......... .......... .......... .......... 52% 92.9M 0s 2024-09-12T17:25:02.369 INFO:teuthology.orchestra.run.smithi016.stderr: 49200K .......... .......... .......... .......... .......... 53% 112M 0s 2024-09-12T17:25:02.369 INFO:teuthology.orchestra.run.smithi016.stderr: 49250K .......... .......... .......... .......... .......... 53% 115M 0s 2024-09-12T17:25:02.369 INFO:teuthology.orchestra.run.smithi016.stderr: 49300K .......... .......... .......... .......... .......... 53% 115M 0s 2024-09-12T17:25:02.369 INFO:teuthology.orchestra.run.smithi016.stderr: 49350K .......... .......... .......... .......... .......... 53% 95.7M 0s 2024-09-12T17:25:02.369 INFO:teuthology.orchestra.run.smithi016.stderr: 49400K .......... .......... .......... .......... .......... 53% 122M 0s 2024-09-12T17:25:02.369 INFO:teuthology.orchestra.run.smithi016.stderr: 49450K .......... .......... .......... .......... .......... 53% 114M 0s 2024-09-12T17:25:02.369 INFO:teuthology.orchestra.run.smithi016.stderr: 49500K .......... .......... .......... .......... .......... 53% 116M 0s 2024-09-12T17:25:02.369 INFO:teuthology.orchestra.run.smithi016.stderr: 49550K .......... .......... .......... .......... .......... 53% 95.9M 0s 2024-09-12T17:25:02.369 INFO:teuthology.orchestra.run.smithi016.stderr: 49600K .......... .......... .......... .......... .......... 53% 110M 0s 2024-09-12T17:25:02.370 INFO:teuthology.orchestra.run.smithi016.stderr: 49650K .......... .......... .......... .......... .......... 53% 111M 0s 2024-09-12T17:25:02.370 INFO:teuthology.orchestra.run.smithi016.stderr: 49700K .......... .......... .......... .......... .......... 53% 106M 0s 2024-09-12T17:25:02.370 INFO:teuthology.orchestra.run.smithi016.stderr: 49750K .......... .......... .......... .......... .......... 53% 98.9M 0s 2024-09-12T17:25:02.370 INFO:teuthology.orchestra.run.smithi016.stderr: 49800K .......... .......... .......... .......... .......... 53% 101M 0s 2024-09-12T17:25:02.370 INFO:teuthology.orchestra.run.smithi016.stderr: 49850K .......... .......... .......... .......... .......... 53% 108M 0s 2024-09-12T17:25:02.370 INFO:teuthology.orchestra.run.smithi016.stderr: 49900K .......... .......... .......... .......... .......... 53% 116M 0s 2024-09-12T17:25:02.370 INFO:teuthology.orchestra.run.smithi016.stderr: 49950K .......... .......... .......... .......... .......... 53% 90.1M 0s 2024-09-12T17:25:02.370 INFO:teuthology.orchestra.run.smithi016.stderr: 50000K .......... .......... .......... .......... .......... 53% 110M 0s 2024-09-12T17:25:02.370 INFO:teuthology.orchestra.run.smithi016.stderr: 50050K .......... .......... .......... .......... .......... 53% 112M 0s 2024-09-12T17:25:02.370 INFO:teuthology.orchestra.run.smithi016.stderr: 50100K .......... .......... .......... .......... .......... 53% 117M 0s 2024-09-12T17:25:02.370 INFO:teuthology.orchestra.run.smithi016.stderr: 50150K .......... .......... .......... .......... .......... 54% 97.0M 0s 2024-09-12T17:25:02.370 INFO:teuthology.orchestra.run.smithi016.stderr: 50200K .......... .......... .......... .......... .......... 54% 108M 0s 2024-09-12T17:25:02.370 INFO:teuthology.orchestra.run.smithi016.stderr: 50250K .......... .......... .......... .......... .......... 54% 117M 0s 2024-09-12T17:25:02.370 INFO:teuthology.orchestra.run.smithi016.stderr: 50300K .......... .......... .......... .......... .......... 54% 120M 0s 2024-09-12T17:25:02.371 INFO:teuthology.orchestra.run.smithi016.stderr: 50350K .......... .......... .......... .......... .......... 54% 102M 0s 2024-09-12T17:25:02.371 INFO:teuthology.orchestra.run.smithi016.stderr: 50400K .......... .......... .......... .......... .......... 54% 120M 0s 2024-09-12T17:25:02.371 INFO:teuthology.orchestra.run.smithi016.stderr: 50450K .......... .......... .......... .......... .......... 54% 123M 0s 2024-09-12T17:25:02.371 INFO:teuthology.orchestra.run.smithi016.stderr: 50500K .......... .......... .......... .......... .......... 54% 120M 0s 2024-09-12T17:25:02.371 INFO:teuthology.orchestra.run.smithi016.stderr: 50550K .......... .......... .......... .......... .......... 54% 116M 0s 2024-09-12T17:25:02.371 INFO:teuthology.orchestra.run.smithi016.stderr: 50600K .......... .......... .......... .......... .......... 54% 132M 0s 2024-09-12T17:25:02.371 INFO:teuthology.orchestra.run.smithi016.stderr: 50650K .......... .......... .......... .......... .......... 54% 126M 0s 2024-09-12T17:25:02.371 INFO:teuthology.orchestra.run.smithi016.stderr: 50700K .......... .......... .......... .......... .......... 54% 125M 0s 2024-09-12T17:25:02.371 INFO:teuthology.orchestra.run.smithi016.stderr: 50750K .......... .......... .......... .......... .......... 54% 104M 0s 2024-09-12T17:25:02.371 INFO:teuthology.orchestra.run.smithi016.stderr: 50800K .......... .......... .......... .......... .......... 54% 132M 0s 2024-09-12T17:25:02.371 INFO:teuthology.orchestra.run.smithi016.stderr: 50850K .......... .......... .......... .......... .......... 54% 134M 0s 2024-09-12T17:25:02.371 INFO:teuthology.orchestra.run.smithi016.stderr: 50900K .......... .......... .......... .......... .......... 54% 107M 0s 2024-09-12T17:25:02.371 INFO:teuthology.orchestra.run.smithi016.stderr: 50950K .......... .......... .......... .......... .......... 54% 117M 0s 2024-09-12T17:25:02.372 INFO:teuthology.orchestra.run.smithi016.stderr: 51000K .......... .......... .......... .......... .......... 54% 136M 0s 2024-09-12T17:25:02.372 INFO:teuthology.orchestra.run.smithi016.stderr: 51050K .......... .......... .......... .......... .......... 55% 136M 0s 2024-09-12T17:25:02.372 INFO:teuthology.orchestra.run.smithi016.stderr: 51100K .......... .......... .......... .......... .......... 55% 133M 0s 2024-09-12T17:25:02.372 INFO:teuthology.orchestra.run.smithi016.stderr: 51150K .......... .......... .......... .......... .......... 55% 117M 0s 2024-09-12T17:25:02.372 INFO:teuthology.orchestra.run.smithi016.stderr: 51200K .......... .......... .......... .......... .......... 55% 126M 0s 2024-09-12T17:25:02.372 INFO:teuthology.orchestra.run.smithi016.stderr: 51250K .......... .......... .......... .......... .......... 55% 134M 0s 2024-09-12T17:25:02.372 INFO:teuthology.orchestra.run.smithi016.stderr: 51300K .......... .......... .......... .......... .......... 55% 118M 0s 2024-09-12T17:25:02.372 INFO:teuthology.orchestra.run.smithi016.stderr: 51350K .......... .......... .......... .......... .......... 55% 137M 0s 2024-09-12T17:25:02.372 INFO:teuthology.orchestra.run.smithi016.stderr: 51400K .......... .......... .......... .......... .......... 55% 136M 0s 2024-09-12T17:25:02.372 INFO:teuthology.orchestra.run.smithi016.stderr: 51450K .......... .......... .......... .......... .......... 55% 135M 0s 2024-09-12T17:25:02.372 INFO:teuthology.orchestra.run.smithi016.stderr: 51500K .......... .......... .......... .......... .......... 55% 113M 0s 2024-09-12T17:25:02.372 INFO:teuthology.orchestra.run.smithi016.stderr: 51550K .......... .......... .......... .......... .......... 55% 141M 0s 2024-09-12T17:25:02.372 INFO:teuthology.orchestra.run.smithi016.stderr: 51600K .......... .......... .......... .......... .......... 55% 138M 0s 2024-09-12T17:25:02.372 INFO:teuthology.orchestra.run.smithi016.stderr: 51650K .......... .......... .......... .......... .......... 55% 133M 0s 2024-09-12T17:25:02.373 INFO:teuthology.orchestra.run.smithi016.stderr: 51700K .......... .......... .......... .......... .......... 55% 105M 0s 2024-09-12T17:25:02.373 INFO:teuthology.orchestra.run.smithi016.stderr: 51750K .......... .......... .......... .......... .......... 55% 121M 0s 2024-09-12T17:25:02.373 INFO:teuthology.orchestra.run.smithi016.stderr: 51800K .......... .......... .......... .......... .......... 55% 136M 0s 2024-09-12T17:25:02.373 INFO:teuthology.orchestra.run.smithi016.stderr: 51850K .......... .......... .......... .......... .......... 55% 137M 0s 2024-09-12T17:25:02.373 INFO:teuthology.orchestra.run.smithi016.stderr: 51900K .......... .......... .......... .......... .......... 55% 113M 0s 2024-09-12T17:25:02.373 INFO:teuthology.orchestra.run.smithi016.stderr: 51950K .......... .......... .......... .......... .......... 55% 132M 0s 2024-09-12T17:25:02.373 INFO:teuthology.orchestra.run.smithi016.stderr: 52000K .......... .......... .......... .......... .......... 56% 139M 0s 2024-09-12T17:25:02.373 INFO:teuthology.orchestra.run.smithi016.stderr: 52050K .......... .......... .......... .......... .......... 56% 138M 0s 2024-09-12T17:25:02.373 INFO:teuthology.orchestra.run.smithi016.stderr: 52100K .......... .......... .......... .......... .......... 56% 122M 0s 2024-09-12T17:25:02.373 INFO:teuthology.orchestra.run.smithi016.stderr: 52150K .......... .......... .......... .......... .......... 56% 144M 0s 2024-09-12T17:25:02.373 INFO:teuthology.orchestra.run.smithi016.stderr: 52200K .......... .......... .......... .......... .......... 56% 137M 0s 2024-09-12T17:25:02.373 INFO:teuthology.orchestra.run.smithi016.stderr: 52250K .......... .......... .......... .......... .......... 56% 148M 0s 2024-09-12T17:25:02.374 INFO:teuthology.orchestra.run.smithi016.stderr: 52300K .......... .......... .......... .......... .......... 56% 112M 0s 2024-09-12T17:25:02.374 INFO:teuthology.orchestra.run.smithi016.stderr: 52350K .......... .......... .......... .......... .......... 56% 138M 0s 2024-09-12T17:25:02.374 INFO:teuthology.orchestra.run.smithi016.stderr: 52400K .......... .......... .......... .......... .......... 56% 141M 0s 2024-09-12T17:25:02.374 INFO:teuthology.orchestra.run.smithi016.stderr: 52450K .......... .......... .......... .......... .......... 56% 147M 0s 2024-09-12T17:25:02.374 INFO:teuthology.orchestra.run.smithi016.stderr: 52500K .......... .......... .......... .......... .......... 56% 131M 0s 2024-09-12T17:25:02.374 INFO:teuthology.orchestra.run.smithi016.stderr: 52550K .......... .......... .......... .......... .......... 56% 142M 0s 2024-09-12T17:25:02.374 INFO:teuthology.orchestra.run.smithi016.stderr: 52600K .......... .......... .......... .......... .......... 56% 143M 0s 2024-09-12T17:25:02.374 INFO:teuthology.orchestra.run.smithi016.stderr: 52650K .......... .......... .......... .......... .......... 56% 138M 0s 2024-09-12T17:25:02.374 INFO:teuthology.orchestra.run.smithi016.stderr: 52700K .......... .......... .......... .......... .......... 56% 118M 0s 2024-09-12T17:25:02.374 INFO:teuthology.orchestra.run.smithi016.stderr: 52750K .......... .......... .......... .......... .......... 56% 150M 0s 2024-09-12T17:25:02.374 INFO:teuthology.orchestra.run.smithi016.stderr: 52800K .......... .......... .......... .......... .......... 56% 140M 0s 2024-09-12T17:25:02.374 INFO:teuthology.orchestra.run.smithi016.stderr: 52850K .......... .......... .......... .......... .......... 56% 126M 0s 2024-09-12T17:25:02.374 INFO:teuthology.orchestra.run.smithi016.stderr: 52900K .......... .......... .......... .......... .......... 56% 134M 0s 2024-09-12T17:25:02.374 INFO:teuthology.orchestra.run.smithi016.stderr: 52950K .......... .......... .......... .......... .......... 57% 150M 0s 2024-09-12T17:25:02.375 INFO:teuthology.orchestra.run.smithi016.stderr: 53000K .......... .......... .......... .......... .......... 57% 153M 0s 2024-09-12T17:25:02.375 INFO:teuthology.orchestra.run.smithi016.stderr: 53050K .......... .......... .......... .......... .......... 57% 140M 0s 2024-09-12T17:25:02.375 INFO:teuthology.orchestra.run.smithi016.stderr: 53100K .......... .......... .......... .......... .......... 57% 128M 0s 2024-09-12T17:25:02.375 INFO:teuthology.orchestra.run.smithi016.stderr: 53150K .......... .......... .......... .......... .......... 57% 164M 0s 2024-09-12T17:25:02.375 INFO:teuthology.orchestra.run.smithi016.stderr: 53200K .......... .......... .......... .......... .......... 57% 165M 0s 2024-09-12T17:25:02.375 INFO:teuthology.orchestra.run.smithi016.stderr: 53250K .......... .......... .......... .......... .......... 57% 150M 0s 2024-09-12T17:25:02.375 INFO:teuthology.orchestra.run.smithi016.stderr: 53300K .......... .......... .......... .......... .......... 57% 147M 0s 2024-09-12T17:25:02.375 INFO:teuthology.orchestra.run.smithi016.stderr: 53350K .......... .......... .......... .......... .......... 57% 165M 0s 2024-09-12T17:25:02.375 INFO:teuthology.orchestra.run.smithi016.stderr: 53400K .......... .......... .......... .......... .......... 57% 166M 0s 2024-09-12T17:25:02.375 INFO:teuthology.orchestra.run.smithi016.stderr: 53450K .......... .......... .......... .......... .......... 57% 155M 0s 2024-09-12T17:25:02.375 INFO:teuthology.orchestra.run.smithi016.stderr: 53500K .......... .......... .......... .......... .......... 57% 134M 0s 2024-09-12T17:25:02.375 INFO:teuthology.orchestra.run.smithi016.stderr: 53550K .......... .......... .......... .......... .......... 57% 167M 0s 2024-09-12T17:25:02.375 INFO:teuthology.orchestra.run.smithi016.stderr: 53600K .......... .......... .......... .......... .......... 57% 162M 0s 2024-09-12T17:25:02.376 INFO:teuthology.orchestra.run.smithi016.stderr: 53650K .......... .......... .......... .......... .......... 57% 172M 0s 2024-09-12T17:25:02.376 INFO:teuthology.orchestra.run.smithi016.stderr: 53700K .......... .......... .......... .......... .......... 57% 149M 0s 2024-09-12T17:25:02.376 INFO:teuthology.orchestra.run.smithi016.stderr: 53750K .......... .......... .......... .......... .......... 57% 160M 0s 2024-09-12T17:25:02.376 INFO:teuthology.orchestra.run.smithi016.stderr: 53800K .......... .......... .......... .......... .......... 57% 170M 0s 2024-09-12T17:25:02.376 INFO:teuthology.orchestra.run.smithi016.stderr: 53850K .......... .......... .......... .......... .......... 58% 170M 0s 2024-09-12T17:25:02.376 INFO:teuthology.orchestra.run.smithi016.stderr: 53900K .......... .......... .......... .......... .......... 58% 6.49M 0s 2024-09-12T17:25:02.376 INFO:teuthology.orchestra.run.smithi016.stderr: 53950K .......... .......... .......... .......... .......... 58% 154M 0s 2024-09-12T17:25:02.376 INFO:teuthology.orchestra.run.smithi016.stderr: 54000K .......... .......... .......... .......... .......... 58% 156M 0s 2024-09-12T17:25:02.376 INFO:teuthology.orchestra.run.smithi016.stderr: 54050K .......... .......... .......... .......... .......... 58% 153M 0s 2024-09-12T17:25:02.376 INFO:teuthology.orchestra.run.smithi016.stderr: 54100K .......... .......... .......... .......... .......... 58% 142M 0s 2024-09-12T17:25:02.376 INFO:teuthology.orchestra.run.smithi016.stderr: 54150K .......... .......... .......... .......... .......... 58% 155M 0s 2024-09-12T17:25:02.376 INFO:teuthology.orchestra.run.smithi016.stderr: 54200K .......... .......... .......... .......... .......... 58% 151M 0s 2024-09-12T17:25:02.376 INFO:teuthology.orchestra.run.smithi016.stderr: 54250K .......... .......... .......... .......... .......... 58% 153M 0s 2024-09-12T17:25:02.377 INFO:teuthology.orchestra.run.smithi016.stderr: 54300K .......... .......... .......... .......... .......... 58% 129M 0s 2024-09-12T17:25:02.377 INFO:teuthology.orchestra.run.smithi016.stderr: 54350K .......... .......... .......... .......... .......... 58% 154M 0s 2024-09-12T17:25:02.377 INFO:teuthology.orchestra.run.smithi016.stderr: 54400K .......... .......... .......... .......... .......... 58% 152M 0s 2024-09-12T17:25:02.377 INFO:teuthology.orchestra.run.smithi016.stderr: 54450K .......... .......... .......... .......... .......... 58% 160M 0s 2024-09-12T17:25:02.377 INFO:teuthology.orchestra.run.smithi016.stderr: 54500K .......... .......... .......... .......... .......... 58% 134M 0s 2024-09-12T17:25:02.377 INFO:teuthology.orchestra.run.smithi016.stderr: 54550K .......... .......... .......... .......... .......... 58% 160M 0s 2024-09-12T17:25:02.377 INFO:teuthology.orchestra.run.smithi016.stderr: 54600K .......... .......... .......... .......... .......... 58% 154M 0s 2024-09-12T17:25:02.377 INFO:teuthology.orchestra.run.smithi016.stderr: 54650K .......... .......... .......... .......... .......... 58% 159M 0s 2024-09-12T17:25:02.377 INFO:teuthology.orchestra.run.smithi016.stderr: 54700K .......... .......... .......... .......... .......... 58% 140M 0s 2024-09-12T17:25:02.377 INFO:teuthology.orchestra.run.smithi016.stderr: 54750K .......... .......... .......... .......... .......... 58% 152M 0s 2024-09-12T17:25:02.377 INFO:teuthology.orchestra.run.smithi016.stderr: 54800K .......... .......... .......... .......... .......... 59% 173M 0s 2024-09-12T17:25:02.377 INFO:teuthology.orchestra.run.smithi016.stderr: 54850K .......... .......... .......... .......... .......... 59% 146M 0s 2024-09-12T17:25:02.377 INFO:teuthology.orchestra.run.smithi016.stderr: 54900K .......... .......... .......... .......... .......... 59% 144M 0s 2024-09-12T17:25:02.377 INFO:teuthology.orchestra.run.smithi016.stderr: 54950K .......... .......... .......... .......... .......... 59% 159M 0s 2024-09-12T17:25:02.378 INFO:teuthology.orchestra.run.smithi016.stderr: 55000K .......... .......... .......... .......... .......... 59% 129M 0s 2024-09-12T17:25:02.378 INFO:teuthology.orchestra.run.smithi016.stderr: 55050K .......... .......... .......... .......... .......... 59% 164M 0s 2024-09-12T17:25:02.378 INFO:teuthology.orchestra.run.smithi016.stderr: 55100K .......... .......... .......... .......... .......... 59% 130M 0s 2024-09-12T17:25:02.378 INFO:teuthology.orchestra.run.smithi016.stderr: 55150K .......... .......... .......... .......... .......... 59% 147M 0s 2024-09-12T17:25:02.378 INFO:teuthology.orchestra.run.smithi016.stderr: 55200K .......... .......... .......... .......... .......... 59% 150M 0s 2024-09-12T17:25:02.378 INFO:teuthology.orchestra.run.smithi016.stderr: 55250K .......... .......... .......... .......... .......... 59% 151M 0s 2024-09-12T17:25:02.378 INFO:teuthology.orchestra.run.smithi016.stderr: 55300K .......... .......... .......... .......... .......... 59% 144M 0s 2024-09-12T17:25:02.378 INFO:teuthology.orchestra.run.smithi016.stderr: 55350K .......... .......... .......... .......... .......... 59% 165M 0s 2024-09-12T17:25:02.378 INFO:teuthology.orchestra.run.smithi016.stderr: 55400K .......... .......... .......... .......... .......... 59% 160M 0s 2024-09-12T17:25:02.378 INFO:teuthology.orchestra.run.smithi016.stderr: 55450K .......... .......... .......... .......... .......... 59% 150M 0s 2024-09-12T17:25:02.378 INFO:teuthology.orchestra.run.smithi016.stderr: 55500K .......... .......... .......... .......... .......... 59% 128M 0s 2024-09-12T17:25:02.378 INFO:teuthology.orchestra.run.smithi016.stderr: 55550K .......... .......... .......... .......... .......... 59% 168M 0s 2024-09-12T17:25:02.378 INFO:teuthology.orchestra.run.smithi016.stderr: 55600K .......... .......... .......... .......... .......... 59% 160M 0s 2024-09-12T17:25:02.378 INFO:teuthology.orchestra.run.smithi016.stderr: 55650K .......... .......... .......... .......... .......... 59% 167M 0s 2024-09-12T17:25:02.378 INFO:teuthology.orchestra.run.smithi016.stderr: 55700K .......... .......... .......... .......... .......... 60% 148M 0s 2024-09-12T17:25:02.379 INFO:teuthology.orchestra.run.smithi016.stderr: 55750K .......... .......... .......... .......... .......... 60% 155M 0s 2024-09-12T17:25:02.379 INFO:teuthology.orchestra.run.smithi016.stderr: 55800K .......... .......... .......... .......... .......... 60% 170M 0s 2024-09-12T17:25:02.379 INFO:teuthology.orchestra.run.smithi016.stderr: 55850K .......... .......... .......... .......... .......... 60% 173M 0s 2024-09-12T17:25:02.379 INFO:teuthology.orchestra.run.smithi016.stderr: 55900K .......... .......... .......... .......... .......... 60% 142M 0s 2024-09-12T17:25:02.379 INFO:teuthology.orchestra.run.smithi016.stderr: 55950K .......... .......... .......... .......... .......... 60% 167M 0s 2024-09-12T17:25:02.379 INFO:teuthology.orchestra.run.smithi016.stderr: 56000K .......... .......... .......... .......... .......... 60% 163M 0s 2024-09-12T17:25:02.379 INFO:teuthology.orchestra.run.smithi016.stderr: 56050K .......... .......... .......... .......... .......... 60% 171M 0s 2024-09-12T17:25:02.379 INFO:teuthology.orchestra.run.smithi016.stderr: 56100K .......... .......... .......... .......... .......... 60% 98.6M 0s 2024-09-12T17:25:02.379 INFO:teuthology.orchestra.run.smithi016.stderr: 56150K .......... .......... .......... .......... .......... 60% 141M 0s 2024-09-12T17:25:02.379 INFO:teuthology.orchestra.run.smithi016.stderr: 56200K .......... .......... .......... .......... .......... 60% 147M 0s 2024-09-12T17:25:02.379 INFO:teuthology.orchestra.run.smithi016.stderr: 56250K .......... .......... .......... .......... .......... 60% 146M 0s 2024-09-12T17:25:02.379 INFO:teuthology.orchestra.run.smithi016.stderr: 56300K .......... .......... .......... .......... .......... 60% 122M 0s 2024-09-12T17:25:02.379 INFO:teuthology.orchestra.run.smithi016.stderr: 56350K .......... .......... .......... .......... .......... 60% 7.55M 0s 2024-09-12T17:25:02.379 INFO:teuthology.orchestra.run.smithi016.stderr: 56400K .......... .......... .......... .......... .......... 60% 232M 0s 2024-09-12T17:25:02.379 INFO:teuthology.orchestra.run.smithi016.stderr: 56450K .......... .......... .......... .......... .......... 60% 262M 0s 2024-09-12T17:25:02.380 INFO:teuthology.orchestra.run.smithi016.stderr: 56500K .......... .......... .......... .......... .......... 60% 182M 0s 2024-09-12T17:25:02.380 INFO:teuthology.orchestra.run.smithi016.stderr: 56550K .......... .......... .......... .......... .......... 60% 196M 0s 2024-09-12T17:25:02.380 INFO:teuthology.orchestra.run.smithi016.stderr: 56600K .......... .......... .......... .......... .......... 60% 191M 0s 2024-09-12T17:25:02.380 INFO:teuthology.orchestra.run.smithi016.stderr: 56650K .......... .......... .......... .......... .......... 61% 197M 0s 2024-09-12T17:25:02.380 INFO:teuthology.orchestra.run.smithi016.stderr: 56700K .......... .......... .......... .......... .......... 61% 225M 0s 2024-09-12T17:25:02.380 INFO:teuthology.orchestra.run.smithi016.stderr: 56750K .......... .......... .......... .......... .......... 61% 120M 0s 2024-09-12T17:25:02.380 INFO:teuthology.orchestra.run.smithi016.stderr: 56800K .......... .......... .......... .......... .......... 61% 174M 0s 2024-09-12T17:25:02.380 INFO:teuthology.orchestra.run.smithi016.stderr: 56850K .......... .......... .......... .......... .......... 61% 174M 0s 2024-09-12T17:25:02.380 INFO:teuthology.orchestra.run.smithi016.stderr: 56900K .......... .......... .......... .......... .......... 61% 106M 0s 2024-09-12T17:25:02.380 INFO:teuthology.orchestra.run.smithi016.stderr: 56950K .......... .......... .......... .......... .......... 61% 77.3M 0s 2024-09-12T17:25:02.380 INFO:teuthology.orchestra.run.smithi016.stderr: 57000K .......... .......... .......... .......... .......... 61% 107M 0s 2024-09-12T17:25:02.380 INFO:teuthology.orchestra.run.smithi016.stderr: 57050K .......... .......... .......... .......... .......... 61% 114M 0s 2024-09-12T17:25:02.380 INFO:teuthology.orchestra.run.smithi016.stderr: 57100K .......... .......... .......... .......... .......... 61% 101M 0s 2024-09-12T17:25:02.380 INFO:teuthology.orchestra.run.smithi016.stderr: 57150K .......... .......... .......... .......... .......... 61% 136M 0s 2024-09-12T17:25:02.381 INFO:teuthology.orchestra.run.smithi016.stderr: 57200K .......... .......... .......... .......... .......... 61% 100M 0s 2024-09-12T17:25:02.381 INFO:teuthology.orchestra.run.smithi016.stderr: 57250K .......... .......... .......... .......... .......... 61% 119M 0s 2024-09-12T17:25:02.381 INFO:teuthology.orchestra.run.smithi016.stderr: 57300K .......... .......... .......... .......... .......... 61% 90.7M 0s 2024-09-12T17:25:02.381 INFO:teuthology.orchestra.run.smithi016.stderr: 57350K .......... .......... .......... .......... .......... 61% 118M 0s 2024-09-12T17:25:02.381 INFO:teuthology.orchestra.run.smithi016.stderr: 57400K .......... .......... .......... .......... .......... 61% 114M 0s 2024-09-12T17:25:02.381 INFO:teuthology.orchestra.run.smithi016.stderr: 57450K .......... .......... .......... .......... .......... 61% 104M 0s 2024-09-12T17:25:02.381 INFO:teuthology.orchestra.run.smithi016.stderr: 57500K .......... .......... .......... .......... .......... 61% 82.8M 0s 2024-09-12T17:25:02.381 INFO:teuthology.orchestra.run.smithi016.stderr: 57550K .......... .......... .......... .......... .......... 62% 96.2M 0s 2024-09-12T17:25:02.381 INFO:teuthology.orchestra.run.smithi016.stderr: 57600K .......... .......... .......... .......... .......... 62% 100M 0s 2024-09-12T17:25:02.381 INFO:teuthology.orchestra.run.smithi016.stderr: 57650K .......... .......... .......... .......... .......... 62% 115M 0s 2024-09-12T17:25:02.381 INFO:teuthology.orchestra.run.smithi016.stderr: 57700K .......... .......... .......... .......... .......... 62% 98.3M 0s 2024-09-12T17:25:02.381 INFO:teuthology.orchestra.run.smithi016.stderr: 57750K .......... .......... .......... .......... .......... 62% 104M 0s 2024-09-12T17:25:02.381 INFO:teuthology.orchestra.run.smithi016.stderr: 57800K .......... .......... .......... .......... .......... 62% 92.7M 0s 2024-09-12T17:25:02.381 INFO:teuthology.orchestra.run.smithi016.stderr: 57850K .......... .......... .......... .......... .......... 62% 92.7M 0s 2024-09-12T17:25:02.382 INFO:teuthology.orchestra.run.smithi016.stderr: 57900K .......... .......... .......... .......... .......... 62% 74.9M 0s 2024-09-12T17:25:02.382 INFO:teuthology.orchestra.run.smithi016.stderr: 57950K .......... .......... .......... .......... .......... 62% 115M 0s 2024-09-12T17:25:02.382 INFO:teuthology.orchestra.run.smithi016.stderr: 58000K .......... .......... .......... .......... .......... 62% 160M 0s 2024-09-12T17:25:02.382 INFO:teuthology.orchestra.run.smithi016.stderr: 58050K .......... .......... .......... .......... .......... 62% 160M 0s 2024-09-12T17:25:02.382 INFO:teuthology.orchestra.run.smithi016.stderr: 58100K .......... .......... .......... .......... .......... 62% 143M 0s 2024-09-12T17:25:02.382 INFO:teuthology.orchestra.run.smithi016.stderr: 58150K .......... .......... .......... .......... .......... 62% 161M 0s 2024-09-12T17:25:02.382 INFO:teuthology.orchestra.run.smithi016.stderr: 58200K .......... .......... .......... .......... .......... 62% 161M 0s 2024-09-12T17:25:02.382 INFO:teuthology.orchestra.run.smithi016.stderr: 58250K .......... .......... .......... .......... .......... 62% 159M 0s 2024-09-12T17:25:02.382 INFO:teuthology.orchestra.run.smithi016.stderr: 58300K .......... .......... .......... .......... .......... 62% 135M 0s 2024-09-12T17:25:02.382 INFO:teuthology.orchestra.run.smithi016.stderr: 58350K .......... .......... .......... .......... .......... 62% 160M 0s 2024-09-12T17:25:02.382 INFO:teuthology.orchestra.run.smithi016.stderr: 58400K .......... .......... .......... .......... .......... 62% 140M 0s 2024-09-12T17:25:02.382 INFO:teuthology.orchestra.run.smithi016.stderr: 58450K .......... .......... .......... .......... .......... 62% 121M 0s 2024-09-12T17:25:02.382 INFO:teuthology.orchestra.run.smithi016.stderr: 58500K .......... .......... .......... .......... .......... 63% 113M 0s 2024-09-12T17:25:02.382 INFO:teuthology.orchestra.run.smithi016.stderr: 58550K .......... .......... .......... .......... .......... 63% 111M 0s 2024-09-12T17:25:02.382 INFO:teuthology.orchestra.run.smithi016.stderr: 58600K .......... .......... .......... .......... .......... 63% 88.5M 0s 2024-09-12T17:25:02.383 INFO:teuthology.orchestra.run.smithi016.stderr: 58650K .......... .......... .......... .......... .......... 63% 111M 0s 2024-09-12T17:25:02.383 INFO:teuthology.orchestra.run.smithi016.stderr: 58700K .......... .......... .......... .......... .......... 63% 93.9M 0s 2024-09-12T17:25:02.383 INFO:teuthology.orchestra.run.smithi016.stderr: 58750K .......... .......... .......... .......... .......... 63% 131M 0s 2024-09-12T17:25:02.383 INFO:teuthology.orchestra.run.smithi016.stderr: 58800K .......... .......... .......... .......... .......... 63% 100M 0s 2024-09-12T17:25:02.383 INFO:teuthology.orchestra.run.smithi016.stderr: 58850K .......... .......... .......... .......... .......... 63% 87.0M 0s 2024-09-12T17:25:02.383 INFO:teuthology.orchestra.run.smithi016.stderr: 58900K .......... .......... .......... .......... .......... 63% 95.7M 0s 2024-09-12T17:25:02.383 INFO:teuthology.orchestra.run.smithi016.stderr: 58950K .......... .......... .......... .......... .......... 63% 118M 0s 2024-09-12T17:25:02.383 INFO:teuthology.orchestra.run.smithi016.stderr: 59000K .......... .......... .......... .......... .......... 63% 81.3M 0s 2024-09-12T17:25:02.383 INFO:teuthology.orchestra.run.smithi016.stderr: 59050K .......... .......... .......... .......... .......... 63% 89.1M 0s 2024-09-12T17:25:02.383 INFO:teuthology.orchestra.run.smithi016.stderr: 59100K .......... .......... .......... .......... .......... 63% 158M 0s 2024-09-12T17:25:02.383 INFO:teuthology.orchestra.run.smithi016.stderr: 59150K .......... .......... .......... .......... .......... 63% 111M 0s 2024-09-12T17:25:02.383 INFO:teuthology.orchestra.run.smithi016.stderr: 59200K .......... .......... .......... .......... .......... 63% 114M 0s 2024-09-12T17:25:02.383 INFO:teuthology.orchestra.run.smithi016.stderr: 59250K .......... .......... .......... .......... .......... 63% 115M 0s 2024-09-12T17:25:02.384 INFO:teuthology.orchestra.run.smithi016.stderr: 59300K .......... .......... .......... .......... .......... 63% 126M 0s 2024-09-12T17:25:02.384 INFO:teuthology.orchestra.run.smithi016.stderr: 59350K .......... .......... .......... .......... .......... 63% 125M 0s 2024-09-12T17:25:02.384 INFO:teuthology.orchestra.run.smithi016.stderr: 59400K .......... .......... .......... .......... .......... 63% 134M 0s 2024-09-12T17:25:02.384 INFO:teuthology.orchestra.run.smithi016.stderr: 59450K .......... .......... .......... .......... .......... 64% 120M 0s 2024-09-12T17:25:02.384 INFO:teuthology.orchestra.run.smithi016.stderr: 59500K .......... .......... .......... .......... .......... 64% 87.3M 0s 2024-09-12T17:25:02.384 INFO:teuthology.orchestra.run.smithi016.stderr: 59550K .......... .......... .......... .......... .......... 64% 110M 0s 2024-09-12T17:25:02.384 INFO:teuthology.orchestra.run.smithi016.stderr: 59600K .......... .......... .......... .......... .......... 64% 126M 0s 2024-09-12T17:25:02.384 INFO:teuthology.orchestra.run.smithi016.stderr: 59650K .......... .......... .......... .......... .......... 64% 111M 0s 2024-09-12T17:25:02.384 INFO:teuthology.orchestra.run.smithi016.stderr: 59700K .......... .......... .......... .......... .......... 64% 106M 0s 2024-09-12T17:25:02.384 INFO:teuthology.orchestra.run.smithi016.stderr: 59750K .......... .......... .......... .......... .......... 64% 118M 0s 2024-09-12T17:25:02.384 INFO:teuthology.orchestra.run.smithi016.stderr: 59800K .......... .......... .......... .......... .......... 64% 145M 0s 2024-09-12T17:25:02.384 INFO:teuthology.orchestra.run.smithi016.stderr: 59850K .......... .......... .......... .......... .......... 64% 163M 0s 2024-09-12T17:25:02.384 INFO:teuthology.orchestra.run.smithi016.stderr: 59900K .......... .......... .......... .......... .......... 64% 167M 0s 2024-09-12T17:25:02.385 INFO:teuthology.orchestra.run.smithi016.stderr: 59950K .......... .......... .......... .......... .......... 64% 161M 0s 2024-09-12T17:25:02.385 INFO:teuthology.orchestra.run.smithi016.stderr: 60000K .......... .......... .......... .......... .......... 64% 124M 0s 2024-09-12T17:25:02.385 INFO:teuthology.orchestra.run.smithi016.stderr: 60050K .......... .......... .......... .......... .......... 64% 103M 0s 2024-09-12T17:25:02.385 INFO:teuthology.orchestra.run.smithi016.stderr: 60100K .......... .......... .......... .......... .......... 64% 114M 0s 2024-09-12T17:25:02.385 INFO:teuthology.orchestra.run.smithi016.stderr: 60150K .......... .......... .......... .......... .......... 64% 104M 0s 2024-09-12T17:25:02.385 INFO:teuthology.orchestra.run.smithi016.stderr: 60200K .......... .......... .......... .......... .......... 64% 87.9M 0s 2024-09-12T17:25:02.385 INFO:teuthology.orchestra.run.smithi016.stderr: 60250K .......... .......... .......... .......... .......... 64% 127M 0s 2024-09-12T17:25:02.385 INFO:teuthology.orchestra.run.smithi016.stderr: 60300K .......... .......... .......... .......... .......... 64% 112M 0s 2024-09-12T17:25:02.385 INFO:teuthology.orchestra.run.smithi016.stderr: 60350K .......... .......... .......... .......... .......... 65% 112M 0s 2024-09-12T17:25:02.385 INFO:teuthology.orchestra.run.smithi016.stderr: 60400K .......... .......... .......... .......... .......... 65% 88.5M 0s 2024-09-12T17:25:02.385 INFO:teuthology.orchestra.run.smithi016.stderr: 60450K .......... .......... .......... .......... .......... 65% 103M 0s 2024-09-12T17:25:02.385 INFO:teuthology.orchestra.run.smithi016.stderr: 60500K .......... .......... .......... .......... .......... 65% 119M 0s 2024-09-12T17:25:02.385 INFO:teuthology.orchestra.run.smithi016.stderr: 60550K .......... .......... .......... .......... .......... 65% 168M 0s 2024-09-12T17:25:02.386 INFO:teuthology.orchestra.run.smithi016.stderr: 60600K .......... .......... .......... .......... .......... 65% 94.1M 0s 2024-09-12T17:25:02.386 INFO:teuthology.orchestra.run.smithi016.stderr: 60650K .......... .......... .......... .......... .......... 65% 133M 0s 2024-09-12T17:25:02.386 INFO:teuthology.orchestra.run.smithi016.stderr: 60700K .......... .......... .......... .......... .......... 65% 157M 0s 2024-09-12T17:25:02.386 INFO:teuthology.orchestra.run.smithi016.stderr: 60750K .......... .......... .......... .......... .......... 65% 161M 0s 2024-09-12T17:25:02.386 INFO:teuthology.orchestra.run.smithi016.stderr: 60800K .......... .......... .......... .......... .......... 65% 147M 0s 2024-09-12T17:25:02.386 INFO:teuthology.orchestra.run.smithi016.stderr: 60850K .......... .......... .......... .......... .......... 65% 122M 0s 2024-09-12T17:25:02.386 INFO:teuthology.orchestra.run.smithi016.stderr: 60900K .......... .......... .......... .......... .......... 65% 164M 0s 2024-09-12T17:25:02.386 INFO:teuthology.orchestra.run.smithi016.stderr: 60950K .......... .......... .......... .......... .......... 65% 106M 0s 2024-09-12T17:25:02.386 INFO:teuthology.orchestra.run.smithi016.stderr: 61000K .......... .......... .......... .......... .......... 65% 136M 0s 2024-09-12T17:25:02.386 INFO:teuthology.orchestra.run.smithi016.stderr: 61050K .......... .......... .......... .......... .......... 65% 131M 0s 2024-09-12T17:25:02.386 INFO:teuthology.orchestra.run.smithi016.stderr: 61100K .......... .......... .......... .......... .......... 65% 117M 0s 2024-09-12T17:25:02.386 INFO:teuthology.orchestra.run.smithi016.stderr: 61150K .......... .......... .......... .......... .......... 65% 131M 0s 2024-09-12T17:25:02.386 INFO:teuthology.orchestra.run.smithi016.stderr: 61200K .......... .......... .......... .......... .......... 65% 135M 0s 2024-09-12T17:25:02.387 INFO:teuthology.orchestra.run.smithi016.stderr: 61250K .......... .......... .......... .......... .......... 65% 127M 0s 2024-09-12T17:25:02.387 INFO:teuthology.orchestra.run.smithi016.stderr: 61300K .......... .......... .......... .......... .......... 66% 125M 0s 2024-09-12T17:25:02.387 INFO:teuthology.orchestra.run.smithi016.stderr: 61350K .......... .......... .......... .......... .......... 66% 181M 0s 2024-09-12T17:25:02.387 INFO:teuthology.orchestra.run.smithi016.stderr: 61400K .......... .......... .......... .......... .......... 66% 103M 0s 2024-09-12T17:25:02.387 INFO:teuthology.orchestra.run.smithi016.stderr: 61450K .......... .......... .......... .......... .......... 66% 139M 0s 2024-09-12T17:25:02.387 INFO:teuthology.orchestra.run.smithi016.stderr: 61500K .......... .......... .......... .......... .......... 66% 194M 0s 2024-09-12T17:25:02.387 INFO:teuthology.orchestra.run.smithi016.stderr: 61550K .......... .......... .......... .......... .......... 66% 203M 0s 2024-09-12T17:25:02.387 INFO:teuthology.orchestra.run.smithi016.stderr: 61600K .......... .......... .......... .......... .......... 66% 154M 0s 2024-09-12T17:25:02.387 INFO:teuthology.orchestra.run.smithi016.stderr: 61650K .......... .......... .......... .......... .......... 66% 197M 0s 2024-09-12T17:25:02.387 INFO:teuthology.orchestra.run.smithi016.stderr: 61700K .......... .......... .......... .......... .......... 66% 196M 0s 2024-09-12T17:25:02.387 INFO:teuthology.orchestra.run.smithi016.stderr: 61750K .......... .......... .......... .......... .......... 66% 141M 0s 2024-09-12T17:25:02.387 INFO:teuthology.orchestra.run.smithi016.stderr: 61800K .......... .......... .......... .......... .......... 66% 137M 0s 2024-09-12T17:25:02.387 INFO:teuthology.orchestra.run.smithi016.stderr: 61850K .......... .......... .......... .......... .......... 66% 111M 0s 2024-09-12T17:25:02.388 INFO:teuthology.orchestra.run.smithi016.stderr: 61900K .......... .......... .......... .......... .......... 66% 149M 0s 2024-09-12T17:25:02.388 INFO:teuthology.orchestra.run.smithi016.stderr: 61950K .......... .......... .......... .......... .......... 66% 159M 0s 2024-09-12T17:25:02.388 INFO:teuthology.orchestra.run.smithi016.stderr: 62000K .......... .......... .......... .......... .......... 66% 138M 0s 2024-09-12T17:25:02.388 INFO:teuthology.orchestra.run.smithi016.stderr: 62050K .......... .......... .......... .......... .......... 66% 153M 0s 2024-09-12T17:25:02.388 INFO:teuthology.orchestra.run.smithi016.stderr: 62100K .......... .......... .......... .......... .......... 66% 206M 0s 2024-09-12T17:25:02.388 INFO:teuthology.orchestra.run.smithi016.stderr: 62150K .......... .......... .......... .......... .......... 66% 240M 0s 2024-09-12T17:25:02.388 INFO:teuthology.orchestra.run.smithi016.stderr: 62200K .......... .......... .......... .......... .......... 67% 380M 0s 2024-09-12T17:25:02.388 INFO:teuthology.orchestra.run.smithi016.stderr: 62250K .......... .......... .......... .......... .......... 67% 266M 0s 2024-09-12T17:25:02.388 INFO:teuthology.orchestra.run.smithi016.stderr: 62300K .......... .......... .......... .......... .......... 67% 366M 0s 2024-09-12T17:25:02.388 INFO:teuthology.orchestra.run.smithi016.stderr: 62350K .......... .......... .......... .......... .......... 67% 326M 0s 2024-09-12T17:25:02.388 INFO:teuthology.orchestra.run.smithi016.stderr: 62400K .......... .......... .......... .......... .......... 67% 270M 0s 2024-09-12T17:25:02.388 INFO:teuthology.orchestra.run.smithi016.stderr: 62450K .......... .......... .......... .......... .......... 67% 372M 0s 2024-09-12T17:25:02.388 INFO:teuthology.orchestra.run.smithi016.stderr: 62500K .......... .......... .......... .......... .......... 67% 363M 0s 2024-09-12T17:25:02.388 INFO:teuthology.orchestra.run.smithi016.stderr: 62550K .......... .......... .......... .......... .......... 67% 228M 0s 2024-09-12T17:25:02.389 INFO:teuthology.orchestra.run.smithi016.stderr: 62600K .......... .......... .......... .......... .......... 67% 366M 0s 2024-09-12T17:25:02.389 INFO:teuthology.orchestra.run.smithi016.stderr: 62650K .......... .......... .......... .......... .......... 67% 381M 0s 2024-09-12T17:25:02.389 INFO:teuthology.orchestra.run.smithi016.stderr: 62700K .......... .......... .......... .......... .......... 67% 234M 0s 2024-09-12T17:25:02.389 INFO:teuthology.orchestra.run.smithi016.stderr: 62750K .......... .......... .......... .......... .......... 67% 293M 0s 2024-09-12T17:25:02.389 INFO:teuthology.orchestra.run.smithi016.stderr: 62800K .......... .......... .......... .......... .......... 67% 370M 0s 2024-09-12T17:25:02.389 INFO:teuthology.orchestra.run.smithi016.stderr: 62850K .......... .......... .......... .......... .......... 67% 393M 0s 2024-09-12T17:25:02.389 INFO:teuthology.orchestra.run.smithi016.stderr: 62900K .......... .......... .......... .......... .......... 67% 213M 0s 2024-09-12T17:25:02.389 INFO:teuthology.orchestra.run.smithi016.stderr: 62950K .......... .......... .......... .......... .......... 67% 343M 0s 2024-09-12T17:25:02.389 INFO:teuthology.orchestra.run.smithi016.stderr: 63000K .......... .......... .......... .......... .......... 67% 393M 0s 2024-09-12T17:25:02.389 INFO:teuthology.orchestra.run.smithi016.stderr: 63050K .......... .......... .......... .......... .......... 67% 335M 0s 2024-09-12T17:25:02.389 INFO:teuthology.orchestra.run.smithi016.stderr: 63100K .......... .......... .......... .......... .......... 67% 271M 0s 2024-09-12T17:25:02.389 INFO:teuthology.orchestra.run.smithi016.stderr: 63150K .......... .......... .......... .......... .......... 68% 233M 0s 2024-09-12T17:25:02.390 INFO:teuthology.orchestra.run.smithi016.stderr: 63200K .......... .......... .......... .......... .......... 68% 380M 0s 2024-09-12T17:25:02.390 INFO:teuthology.orchestra.run.smithi016.stderr: 63250K .......... .......... .......... .......... .......... 68% 278M 0s 2024-09-12T17:25:02.390 INFO:teuthology.orchestra.run.smithi016.stderr: 63300K .......... .......... .......... .......... .......... 68% 285M 0s 2024-09-12T17:25:02.390 INFO:teuthology.orchestra.run.smithi016.stderr: 63350K .......... .......... .......... .......... .......... 68% 347M 0s 2024-09-12T17:25:02.390 INFO:teuthology.orchestra.run.smithi016.stderr: 63400K .......... .......... .......... .......... .......... 68% 378M 0s 2024-09-12T17:25:02.390 INFO:teuthology.orchestra.run.smithi016.stderr: 63450K .......... .......... .......... .......... .......... 68% 392M 0s 2024-09-12T17:25:02.390 INFO:teuthology.orchestra.run.smithi016.stderr: 63500K .......... .......... .......... .......... .......... 68% 390M 0s 2024-09-12T17:25:02.390 INFO:teuthology.orchestra.run.smithi016.stderr: 63550K .......... .......... .......... .......... .......... 68% 217M 0s 2024-09-12T17:25:02.390 INFO:teuthology.orchestra.run.smithi016.stderr: 63600K .......... .......... .......... .......... .......... 68% 282M 0s 2024-09-12T17:25:02.390 INFO:teuthology.orchestra.run.smithi016.stderr: 63650K .......... .......... .......... .......... .......... 68% 232M 0s 2024-09-12T17:25:02.390 INFO:teuthology.orchestra.run.smithi016.stderr: 63700K .......... .......... .......... .......... .......... 68% 385M 0s 2024-09-12T17:25:02.390 INFO:teuthology.orchestra.run.smithi016.stderr: 63750K .......... .......... .......... .......... .......... 68% 355M 0s 2024-09-12T17:25:02.390 INFO:teuthology.orchestra.run.smithi016.stderr: 63800K .......... .......... .......... .......... .......... 68% 256M 0s 2024-09-12T17:25:02.391 INFO:teuthology.orchestra.run.smithi016.stderr: 63850K .......... .......... .......... .......... .......... 68% 339M 0s 2024-09-12T17:25:02.391 INFO:teuthology.orchestra.run.smithi016.stderr: 63900K .......... .......... .......... .......... .......... 68% 274M 0s 2024-09-12T17:25:02.391 INFO:teuthology.orchestra.run.smithi016.stderr: 63950K .......... .......... .......... .......... .......... 68% 221M 0s 2024-09-12T17:25:02.391 INFO:teuthology.orchestra.run.smithi016.stderr: 64000K .......... .......... .......... .......... .......... 68% 339M 0s 2024-09-12T17:25:02.391 INFO:teuthology.orchestra.run.smithi016.stderr: 64050K .......... .......... .......... .......... .......... 68% 378M 0s 2024-09-12T17:25:02.391 INFO:teuthology.orchestra.run.smithi016.stderr: 64100K .......... .......... .......... .......... .......... 69% 290M 0s 2024-09-12T17:25:02.391 INFO:teuthology.orchestra.run.smithi016.stderr: 64150K .......... .......... .......... .......... .......... 69% 265M 0s 2024-09-12T17:25:02.391 INFO:teuthology.orchestra.run.smithi016.stderr: 64200K .......... .......... .......... .......... .......... 69% 306M 0s 2024-09-12T17:25:02.391 INFO:teuthology.orchestra.run.smithi016.stderr: 64250K .......... .......... .......... .......... .......... 69% 325M 0s 2024-09-12T17:25:02.391 INFO:teuthology.orchestra.run.smithi016.stderr: 64300K .......... .......... .......... .......... .......... 69% 393M 0s 2024-09-12T17:25:02.391 INFO:teuthology.orchestra.run.smithi016.stderr: 64350K .......... .......... .......... .......... .......... 69% 333M 0s 2024-09-12T17:25:02.391 INFO:teuthology.orchestra.run.smithi016.stderr: 64400K .......... .......... .......... .......... .......... 69% 285M 0s 2024-09-12T17:25:02.391 INFO:teuthology.orchestra.run.smithi016.stderr: 64450K .......... .......... .......... .......... .......... 69% 381M 0s 2024-09-12T17:25:02.391 INFO:teuthology.orchestra.run.smithi016.stderr: 64500K .......... .......... .......... .......... .......... 69% 392M 0s 2024-09-12T17:25:02.391 INFO:teuthology.orchestra.run.smithi016.stderr: 64550K .......... .......... .......... .......... .......... 69% 283M 0s 2024-09-12T17:25:02.392 INFO:teuthology.orchestra.run.smithi016.stderr: 64600K .......... .......... .......... .......... .......... 69% 345M 0s 2024-09-12T17:25:02.392 INFO:teuthology.orchestra.run.smithi016.stderr: 64650K .......... .......... .......... .......... .......... 69% 299M 0s 2024-09-12T17:25:02.392 INFO:teuthology.orchestra.run.smithi016.stderr: 64700K .......... .......... .......... .......... .......... 69% 340M 0s 2024-09-12T17:25:02.392 INFO:teuthology.orchestra.run.smithi016.stderr: 64750K .......... .......... .......... .......... .......... 69% 336M 0s 2024-09-12T17:25:02.392 INFO:teuthology.orchestra.run.smithi016.stderr: 64800K .......... .......... .......... .......... .......... 69% 146M 0s 2024-09-12T17:25:02.392 INFO:teuthology.orchestra.run.smithi016.stderr: 64850K .......... .......... .......... .......... .......... 69% 292M 0s 2024-09-12T17:25:02.392 INFO:teuthology.orchestra.run.smithi016.stderr: 64900K .......... .......... .......... .......... .......... 69% 28.7M 0s 2024-09-12T17:25:02.392 INFO:teuthology.orchestra.run.smithi016.stderr: 64950K .......... .......... .......... .......... .......... 69% 276M 0s 2024-09-12T17:25:02.392 INFO:teuthology.orchestra.run.smithi016.stderr: 65000K .......... .......... .......... .......... .......... 70% 236M 0s 2024-09-12T17:25:02.392 INFO:teuthology.orchestra.run.smithi016.stderr: 65050K .......... .......... .......... .......... .......... 70% 303M 0s 2024-09-12T17:25:02.392 INFO:teuthology.orchestra.run.smithi016.stderr: 65100K .......... .......... .......... .......... .......... 70% 300M 0s 2024-09-12T17:25:02.392 INFO:teuthology.orchestra.run.smithi016.stderr: 65150K .......... .......... .......... .......... .......... 70% 209M 0s 2024-09-12T17:25:02.392 INFO:teuthology.orchestra.run.smithi016.stderr: 65200K .......... .......... .......... .......... .......... 70% 286M 0s 2024-09-12T17:25:02.392 INFO:teuthology.orchestra.run.smithi016.stderr: 65250K .......... .......... .......... .......... .......... 70% 257M 0s 2024-09-12T17:25:02.392 INFO:teuthology.orchestra.run.smithi016.stderr: 65300K .......... .......... .......... .......... .......... 70% 355M 0s 2024-09-12T17:25:02.393 INFO:teuthology.orchestra.run.smithi016.stderr: 65350K .......... .......... .......... .......... .......... 70% 350M 0s 2024-09-12T17:25:02.393 INFO:teuthology.orchestra.run.smithi016.stderr: 65400K .......... .......... .......... .......... .......... 70% 66.0M 0s 2024-09-12T17:25:02.393 INFO:teuthology.orchestra.run.smithi016.stderr: 65450K .......... .......... .......... .......... .......... 70% 217M 0s 2024-09-12T17:25:02.393 INFO:teuthology.orchestra.run.smithi016.stderr: 65500K .......... .......... .......... .......... .......... 70% 283M 0s 2024-09-12T17:25:02.393 INFO:teuthology.orchestra.run.smithi016.stderr: 65550K .......... .......... .......... .......... .......... 70% 212M 0s 2024-09-12T17:25:02.393 INFO:teuthology.orchestra.run.smithi016.stderr: 65600K .......... .......... .......... .......... .......... 70% 377M 0s 2024-09-12T17:25:02.393 INFO:teuthology.orchestra.run.smithi016.stderr: 65650K .......... .......... .......... .......... .......... 70% 128M 0s 2024-09-12T17:25:02.393 INFO:teuthology.orchestra.run.smithi016.stderr: 65700K .......... .......... .......... .......... .......... 70% 203M 0s 2024-09-12T17:25:02.393 INFO:teuthology.orchestra.run.smithi016.stderr: 65750K .......... .......... .......... .......... .......... 70% 214M 0s 2024-09-12T17:25:02.393 INFO:teuthology.orchestra.run.smithi016.stderr: 65800K .......... .......... .......... .......... .......... 70% 230M 0s 2024-09-12T17:25:02.393 INFO:teuthology.orchestra.run.smithi016.stderr: 65850K .......... .......... .......... .......... .......... 70% 221M 0s 2024-09-12T17:25:02.393 INFO:teuthology.orchestra.run.smithi016.stderr: 65900K .......... .......... .......... .......... .......... 70% 336M 0s 2024-09-12T17:25:02.394 INFO:teuthology.orchestra.run.smithi016.stderr: 65950K .......... .......... .......... .......... .......... 71% 316M 0s 2024-09-12T17:25:02.394 INFO:teuthology.orchestra.run.smithi016.stderr: 66000K .......... .......... .......... .......... .......... 71% 246M 0s 2024-09-12T17:25:02.394 INFO:teuthology.orchestra.run.smithi016.stderr: 66050K .......... .......... .......... .......... .......... 71% 279M 0s 2024-09-12T17:25:02.394 INFO:teuthology.orchestra.run.smithi016.stderr: 66100K .......... .......... .......... .......... .......... 71% 258M 0s 2024-09-12T17:25:02.394 INFO:teuthology.orchestra.run.smithi016.stderr: 66150K .......... .......... .......... .......... .......... 71% 216M 0s 2024-09-12T17:25:02.394 INFO:teuthology.orchestra.run.smithi016.stderr: 66200K .......... .......... .......... .......... .......... 71% 351M 0s 2024-09-12T17:25:02.394 INFO:teuthology.orchestra.run.smithi016.stderr: 66250K .......... .......... .......... .......... .......... 71% 399M 0s 2024-09-12T17:25:02.394 INFO:teuthology.orchestra.run.smithi016.stderr: 66300K .......... .......... .......... .......... .......... 71% 265M 0s 2024-09-12T17:25:02.394 INFO:teuthology.orchestra.run.smithi016.stderr: 66350K .......... .......... .......... .......... .......... 71% 198M 0s 2024-09-12T17:25:02.394 INFO:teuthology.orchestra.run.smithi016.stderr: 66400K .......... .......... .......... .......... .......... 71% 271M 0s 2024-09-12T17:25:02.394 INFO:teuthology.orchestra.run.smithi016.stderr: 66450K .......... .......... .......... .......... .......... 71% 265M 0s 2024-09-12T17:25:02.394 INFO:teuthology.orchestra.run.smithi016.stderr: 66500K .......... .......... .......... .......... .......... 71% 243M 0s 2024-09-12T17:25:02.394 INFO:teuthology.orchestra.run.smithi016.stderr: 66550K .......... .......... .......... .......... .......... 71% 247M 0s 2024-09-12T17:25:02.395 INFO:teuthology.orchestra.run.smithi016.stderr: 66600K .......... .......... .......... .......... .......... 71% 286M 0s 2024-09-12T17:25:02.395 INFO:teuthology.orchestra.run.smithi016.stderr: 66650K .......... .......... .......... .......... .......... 71% 235M 0s 2024-09-12T17:25:02.395 INFO:teuthology.orchestra.run.smithi016.stderr: 66700K .......... .......... .......... .......... .......... 71% 249M 0s 2024-09-12T17:25:02.395 INFO:teuthology.orchestra.run.smithi016.stderr: 66750K .......... .......... .......... .......... .......... 71% 313M 0s 2024-09-12T17:25:02.395 INFO:teuthology.orchestra.run.smithi016.stderr: 66800K .......... .......... .......... .......... .......... 71% 294M 0s 2024-09-12T17:25:02.395 INFO:teuthology.orchestra.run.smithi016.stderr: 66850K .......... .......... .......... .......... .......... 72% 222M 0s 2024-09-12T17:25:02.395 INFO:teuthology.orchestra.run.smithi016.stderr: 66900K .......... .......... .......... .......... .......... 72% 375M 0s 2024-09-12T17:25:02.395 INFO:teuthology.orchestra.run.smithi016.stderr: 66950K .......... .......... .......... .......... .......... 72% 313M 0s 2024-09-12T17:25:02.395 INFO:teuthology.orchestra.run.smithi016.stderr: 67000K .......... .......... .......... .......... .......... 72% 314M 0s 2024-09-12T17:25:02.395 INFO:teuthology.orchestra.run.smithi016.stderr: 67050K .......... .......... .......... .......... .......... 72% 250M 0s 2024-09-12T17:25:02.395 INFO:teuthology.orchestra.run.smithi016.stderr: 67100K .......... .......... .......... .......... .......... 72% 273M 0s 2024-09-12T17:25:02.395 INFO:teuthology.orchestra.run.smithi016.stderr: 67150K .......... .......... .......... .......... .......... 72% 210M 0s 2024-09-12T17:25:02.395 INFO:teuthology.orchestra.run.smithi016.stderr: 67200K .......... .......... .......... .......... .......... 72% 298M 0s 2024-09-12T17:25:02.395 INFO:teuthology.orchestra.run.smithi016.stderr: 67250K .......... .......... .......... .......... .......... 72% 232M 0s 2024-09-12T17:25:02.396 INFO:teuthology.orchestra.run.smithi016.stderr: 67300K .......... .......... .......... .......... .......... 72% 352M 0s 2024-09-12T17:25:02.396 INFO:teuthology.orchestra.run.smithi016.stderr: 67350K .......... .......... .......... .......... .......... 72% 250M 0s 2024-09-12T17:25:02.396 INFO:teuthology.orchestra.run.smithi016.stderr: 67400K .......... .......... .......... .......... .......... 72% 282M 0s 2024-09-12T17:25:02.396 INFO:teuthology.orchestra.run.smithi016.stderr: 67450K .......... .......... .......... .......... .......... 72% 308M 0s 2024-09-12T17:25:02.396 INFO:teuthology.orchestra.run.smithi016.stderr: 67500K .......... .......... .......... .......... .......... 72% 404M 0s 2024-09-12T17:25:02.396 INFO:teuthology.orchestra.run.smithi016.stderr: 67550K .......... .......... .......... .......... .......... 72% 274M 0s 2024-09-12T17:25:02.396 INFO:teuthology.orchestra.run.smithi016.stderr: 67600K .......... .......... .......... .......... .......... 72% 313M 0s 2024-09-12T17:25:02.396 INFO:teuthology.orchestra.run.smithi016.stderr: 67650K .......... .......... .......... .......... .......... 72% 273M 0s 2024-09-12T17:25:02.396 INFO:teuthology.orchestra.run.smithi016.stderr: 67700K .......... .......... .......... .......... .......... 72% 392M 0s 2024-09-12T17:25:02.396 INFO:teuthology.orchestra.run.smithi016.stderr: 67750K .......... .......... .......... .......... .......... 72% 223M 0s 2024-09-12T17:25:02.396 INFO:teuthology.orchestra.run.smithi016.stderr: 67800K .......... .......... .......... .......... .......... 73% 354M 0s 2024-09-12T17:25:02.396 INFO:teuthology.orchestra.run.smithi016.stderr: 67850K .......... .......... .......... .......... .......... 73% 399M 0s 2024-09-12T17:25:02.397 INFO:teuthology.orchestra.run.smithi016.stderr: 67900K .......... .......... .......... .......... .......... 73% 51.9M 0s 2024-09-12T17:25:02.397 INFO:teuthology.orchestra.run.smithi016.stderr: 67950K .......... .......... .......... .......... .......... 73% 134M 0s 2024-09-12T17:25:02.397 INFO:teuthology.orchestra.run.smithi016.stderr: 68000K .......... .......... .......... .......... .......... 73% 197M 0s 2024-09-12T17:25:02.397 INFO:teuthology.orchestra.run.smithi016.stderr: 68050K .......... .......... .......... .......... .......... 73% 275M 0s 2024-09-12T17:25:02.397 INFO:teuthology.orchestra.run.smithi016.stderr: 68100K .......... .......... .......... .......... .......... 73% 330M 0s 2024-09-12T17:25:02.397 INFO:teuthology.orchestra.run.smithi016.stderr: 68150K .......... .......... .......... .......... .......... 73% 123M 0s 2024-09-12T17:25:02.397 INFO:teuthology.orchestra.run.smithi016.stderr: 68200K .......... .......... .......... .......... .......... 73% 321M 0s 2024-09-12T17:25:02.397 INFO:teuthology.orchestra.run.smithi016.stderr: 68250K .......... .......... .......... .......... .......... 73% 150M 0s 2024-09-12T17:25:02.397 INFO:teuthology.orchestra.run.smithi016.stderr: 68300K .......... .......... .......... .......... .......... 73% 223M 0s 2024-09-12T17:25:02.397 INFO:teuthology.orchestra.run.smithi016.stderr: 68350K .......... .......... .......... .......... .......... 73% 82.9M 0s 2024-09-12T17:25:02.397 INFO:teuthology.orchestra.run.smithi016.stderr: 68400K .......... .......... .......... .......... .......... 73% 275M 0s 2024-09-12T17:25:02.397 INFO:teuthology.orchestra.run.smithi016.stderr: 68450K .......... .......... .......... .......... .......... 73% 214M 0s 2024-09-12T17:25:02.397 INFO:teuthology.orchestra.run.smithi016.stderr: 68500K .......... .......... .......... .......... .......... 73% 231M 0s 2024-09-12T17:25:02.398 INFO:teuthology.orchestra.run.smithi016.stderr: 68550K .......... .......... .......... .......... .......... 73% 290M 0s 2024-09-12T17:25:02.398 INFO:teuthology.orchestra.run.smithi016.stderr: 68600K .......... .......... .......... .......... .......... 73% 101M 0s 2024-09-12T17:25:02.398 INFO:teuthology.orchestra.run.smithi016.stderr: 68650K .......... .......... .......... .......... .......... 73% 247M 0s 2024-09-12T17:25:02.398 INFO:teuthology.orchestra.run.smithi016.stderr: 68700K .......... .......... .......... .......... .......... 74% 155M 0s 2024-09-12T17:25:02.398 INFO:teuthology.orchestra.run.smithi016.stderr: 68750K .......... .......... .......... .......... .......... 74% 168M 0s 2024-09-12T17:25:02.398 INFO:teuthology.orchestra.run.smithi016.stderr: 68800K .......... .......... .......... .......... .......... 74% 301M 0s 2024-09-12T17:25:02.398 INFO:teuthology.orchestra.run.smithi016.stderr: 68850K .......... .......... .......... .......... .......... 74% 235M 0s 2024-09-12T17:25:02.398 INFO:teuthology.orchestra.run.smithi016.stderr: 68900K .......... .......... .......... .......... .......... 74% 212M 0s 2024-09-12T17:25:02.398 INFO:teuthology.orchestra.run.smithi016.stderr: 68950K .......... .......... .......... .......... .......... 74% 190M 0s 2024-09-12T17:25:02.398 INFO:teuthology.orchestra.run.smithi016.stderr: 69000K .......... .......... .......... .......... .......... 74% 314M 0s 2024-09-12T17:25:02.398 INFO:teuthology.orchestra.run.smithi016.stderr: 69050K .......... .......... .......... .......... .......... 74% 207M 0s 2024-09-12T17:25:02.398 INFO:teuthology.orchestra.run.smithi016.stderr: 69100K .......... .......... .......... .......... .......... 74% 331M 0s 2024-09-12T17:25:02.398 INFO:teuthology.orchestra.run.smithi016.stderr: 69150K .......... .......... .......... .......... .......... 74% 136M 0s 2024-09-12T17:25:02.398 INFO:teuthology.orchestra.run.smithi016.stderr: 69200K .......... .......... .......... .......... .......... 74% 226M 0s 2024-09-12T17:25:02.399 INFO:teuthology.orchestra.run.smithi016.stderr: 69250K .......... .......... .......... .......... .......... 74% 345M 0s 2024-09-12T17:25:02.399 INFO:teuthology.orchestra.run.smithi016.stderr: 69300K .......... .......... .......... .......... .......... 74% 207M 0s 2024-09-12T17:25:02.399 INFO:teuthology.orchestra.run.smithi016.stderr: 69350K .......... .......... .......... .......... .......... 74% 207M 0s 2024-09-12T17:25:02.399 INFO:teuthology.orchestra.run.smithi016.stderr: 69400K .......... .......... .......... .......... .......... 74% 344M 0s 2024-09-12T17:25:02.399 INFO:teuthology.orchestra.run.smithi016.stderr: 69450K .......... .......... .......... .......... .......... 74% 247M 0s 2024-09-12T17:25:02.399 INFO:teuthology.orchestra.run.smithi016.stderr: 69500K .......... .......... .......... .......... .......... 74% 214M 0s 2024-09-12T17:25:02.399 INFO:teuthology.orchestra.run.smithi016.stderr: 69550K .......... .......... .......... .......... .......... 74% 260M 0s 2024-09-12T17:25:02.399 INFO:teuthology.orchestra.run.smithi016.stderr: 69600K .......... .......... .......... .......... .......... 74% 226M 0s 2024-09-12T17:25:02.399 INFO:teuthology.orchestra.run.smithi016.stderr: 69650K .......... .......... .......... .......... .......... 75% 197M 0s 2024-09-12T17:25:02.399 INFO:teuthology.orchestra.run.smithi016.stderr: 69700K .......... .......... .......... .......... .......... 75% 239M 0s 2024-09-12T17:25:02.399 INFO:teuthology.orchestra.run.smithi016.stderr: 69750K .......... .......... .......... .......... .......... 75% 196M 0s 2024-09-12T17:25:02.399 INFO:teuthology.orchestra.run.smithi016.stderr: 69800K .......... .......... .......... .......... .......... 75% 231M 0s 2024-09-12T17:25:02.399 INFO:teuthology.orchestra.run.smithi016.stderr: 69850K .......... .......... .......... .......... .......... 75% 197M 0s 2024-09-12T17:25:02.400 INFO:teuthology.orchestra.run.smithi016.stderr: 69900K .......... .......... .......... .......... .......... 75% 289M 0s 2024-09-12T17:25:02.400 INFO:teuthology.orchestra.run.smithi016.stderr: 69950K .......... .......... .......... .......... .......... 75% 204M 0s 2024-09-12T17:25:02.400 INFO:teuthology.orchestra.run.smithi016.stderr: 70000K .......... .......... .......... .......... .......... 75% 265M 0s 2024-09-12T17:25:02.400 INFO:teuthology.orchestra.run.smithi016.stderr: 70050K .......... .......... .......... .......... .......... 75% 244M 0s 2024-09-12T17:25:02.400 INFO:teuthology.orchestra.run.smithi016.stderr: 70100K .......... .......... .......... .......... .......... 75% 238M 0s 2024-09-12T17:25:02.400 INFO:teuthology.orchestra.run.smithi016.stderr: 70150K .......... .......... .......... .......... .......... 75% 232M 0s 2024-09-12T17:25:02.400 INFO:teuthology.orchestra.run.smithi016.stderr: 70200K .......... .......... .......... .......... .......... 75% 254M 0s 2024-09-12T17:25:02.400 INFO:teuthology.orchestra.run.smithi016.stderr: 70250K .......... .......... .......... .......... .......... 75% 264M 0s 2024-09-12T17:25:02.400 INFO:teuthology.orchestra.run.smithi016.stderr: 70300K .......... .......... .......... .......... .......... 75% 312M 0s 2024-09-12T17:25:02.400 INFO:teuthology.orchestra.run.smithi016.stderr: 70350K .......... .......... .......... .......... .......... 75% 208M 0s 2024-09-12T17:25:02.400 INFO:teuthology.orchestra.run.smithi016.stderr: 70400K .......... .......... .......... .......... .......... 75% 234M 0s 2024-09-12T17:25:02.400 INFO:teuthology.orchestra.run.smithi016.stderr: 70450K .......... .......... .......... .......... .......... 75% 213M 0s 2024-09-12T17:25:02.400 INFO:teuthology.orchestra.run.smithi016.stderr: 70500K .......... .......... .......... .......... .......... 75% 219M 0s 2024-09-12T17:25:02.401 INFO:teuthology.orchestra.run.smithi016.stderr: 70550K .......... .......... .......... .......... .......... 75% 303M 0s 2024-09-12T17:25:02.401 INFO:teuthology.orchestra.run.smithi016.stderr: 70600K .......... .......... .......... .......... .......... 76% 357M 0s 2024-09-12T17:25:02.401 INFO:teuthology.orchestra.run.smithi016.stderr: 70650K .......... .......... .......... .......... .......... 76% 356M 0s 2024-09-12T17:25:02.401 INFO:teuthology.orchestra.run.smithi016.stderr: 70700K .......... .......... .......... .......... .......... 76% 339M 0s 2024-09-12T17:25:02.401 INFO:teuthology.orchestra.run.smithi016.stderr: 70750K .......... .......... .......... .......... .......... 76% 292M 0s 2024-09-12T17:25:02.401 INFO:teuthology.orchestra.run.smithi016.stderr: 70800K .......... .......... .......... .......... .......... 76% 226M 0s 2024-09-12T17:25:02.401 INFO:teuthology.orchestra.run.smithi016.stderr: 70850K .......... .......... .......... .......... .......... 76% 250M 0s 2024-09-12T17:25:02.401 INFO:teuthology.orchestra.run.smithi016.stderr: 70900K .......... .......... .......... .......... .......... 76% 286M 0s 2024-09-12T17:25:02.401 INFO:teuthology.orchestra.run.smithi016.stderr: 70950K .......... .......... .......... .......... .......... 76% 227M 0s 2024-09-12T17:25:02.401 INFO:teuthology.orchestra.run.smithi016.stderr: 71000K .......... .......... .......... .......... .......... 76% 329M 0s 2024-09-12T17:25:02.401 INFO:teuthology.orchestra.run.smithi016.stderr: 71050K .......... .......... .......... .......... .......... 76% 263M 0s 2024-09-12T17:25:02.401 INFO:teuthology.orchestra.run.smithi016.stderr: 71100K .......... .......... .......... .......... .......... 76% 258M 0s 2024-09-12T17:25:02.401 INFO:teuthology.orchestra.run.smithi016.stderr: 71150K .......... .......... .......... .......... .......... 76% 224M 0s 2024-09-12T17:25:02.402 INFO:teuthology.orchestra.run.smithi016.stderr: 71200K .......... .......... .......... .......... .......... 76% 312M 0s 2024-09-12T17:25:02.402 INFO:teuthology.orchestra.run.smithi016.stderr: 71250K .......... .......... .......... .......... .......... 76% 279M 0s 2024-09-12T17:25:02.402 INFO:teuthology.orchestra.run.smithi016.stderr: 71300K .......... .......... .......... .......... .......... 76% 257M 0s 2024-09-12T17:25:02.402 INFO:teuthology.orchestra.run.smithi016.stderr: 71350K .......... .......... .......... .......... .......... 76% 191M 0s 2024-09-12T17:25:02.402 INFO:teuthology.orchestra.run.smithi016.stderr: 71400K .......... .......... .......... .......... .......... 76% 239M 0s 2024-09-12T17:25:02.402 INFO:teuthology.orchestra.run.smithi016.stderr: 71450K .......... .......... .......... .......... .......... 76% 290M 0s 2024-09-12T17:25:02.402 INFO:teuthology.orchestra.run.smithi016.stderr: 71500K .......... .......... .......... .......... .......... 77% 112M 0s 2024-09-12T17:25:02.402 INFO:teuthology.orchestra.run.smithi016.stderr: 71550K .......... .......... .......... .......... .......... 77% 212M 0s 2024-09-12T17:25:02.402 INFO:teuthology.orchestra.run.smithi016.stderr: 71600K .......... .......... .......... .......... .......... 77% 248M 0s 2024-09-12T17:25:02.402 INFO:teuthology.orchestra.run.smithi016.stderr: 71650K .......... .......... .......... .......... .......... 77% 343M 0s 2024-09-12T17:25:02.402 INFO:teuthology.orchestra.run.smithi016.stderr: 71700K .......... .......... .......... .......... .......... 77% 168M 0s 2024-09-12T17:25:02.402 INFO:teuthology.orchestra.run.smithi016.stderr: 71750K .......... .......... .......... .......... .......... 77% 135M 0s 2024-09-12T17:25:02.402 INFO:teuthology.orchestra.run.smithi016.stderr: 71800K .......... .......... .......... .......... .......... 77% 224M 0s 2024-09-12T17:25:02.402 INFO:teuthology.orchestra.run.smithi016.stderr: 71850K .......... .......... .......... .......... .......... 77% 287M 0s 2024-09-12T17:25:02.403 INFO:teuthology.orchestra.run.smithi016.stderr: 71900K .......... .......... .......... .......... .......... 77% 189M 0s 2024-09-12T17:25:02.403 INFO:teuthology.orchestra.run.smithi016.stderr: 71950K .......... .......... .......... .......... .......... 77% 222M 0s 2024-09-12T17:25:02.403 INFO:teuthology.orchestra.run.smithi016.stderr: 72000K .......... .......... .......... .......... .......... 77% 238M 0s 2024-09-12T17:25:02.403 INFO:teuthology.orchestra.run.smithi016.stderr: 72050K .......... .......... .......... .......... .......... 77% 256M 0s 2024-09-12T17:25:02.403 INFO:teuthology.orchestra.run.smithi016.stderr: 72100K .......... .......... .......... .......... .......... 77% 292M 0s 2024-09-12T17:25:02.403 INFO:teuthology.orchestra.run.smithi016.stderr: 72150K .......... .......... .......... .......... .......... 77% 128M 0s 2024-09-12T17:25:02.403 INFO:teuthology.orchestra.run.smithi016.stderr: 72200K .......... .......... .......... .......... .......... 77% 132M 0s 2024-09-12T17:25:02.403 INFO:teuthology.orchestra.run.smithi016.stderr: 72250K .......... .......... .......... .......... .......... 77% 232M 0s 2024-09-12T17:25:02.403 INFO:teuthology.orchestra.run.smithi016.stderr: 72300K .......... .......... .......... .......... .......... 77% 348M 0s 2024-09-12T17:25:02.403 INFO:teuthology.orchestra.run.smithi016.stderr: 72350K .......... .......... .......... .......... .......... 77% 151M 0s 2024-09-12T17:25:02.403 INFO:teuthology.orchestra.run.smithi016.stderr: 72400K .......... .......... .......... .......... .......... 77% 119M 0s 2024-09-12T17:25:02.403 INFO:teuthology.orchestra.run.smithi016.stderr: 72450K .......... .......... .......... .......... .......... 78% 220M 0s 2024-09-12T17:25:02.403 INFO:teuthology.orchestra.run.smithi016.stderr: 72500K .......... .......... .......... .......... .......... 78% 239M 0s 2024-09-12T17:25:02.404 INFO:teuthology.orchestra.run.smithi016.stderr: 72550K .......... .......... .......... .......... .......... 78% 218M 0s 2024-09-12T17:25:02.404 INFO:teuthology.orchestra.run.smithi016.stderr: 72600K .......... .......... .......... .......... .......... 78% 226M 0s 2024-09-12T17:25:02.404 INFO:teuthology.orchestra.run.smithi016.stderr: 72650K .......... .......... .......... .......... .......... 78% 269M 0s 2024-09-12T17:25:02.404 INFO:teuthology.orchestra.run.smithi016.stderr: 72700K .......... .......... .......... .......... .......... 78% 252M 0s 2024-09-12T17:25:02.404 INFO:teuthology.orchestra.run.smithi016.stderr: 72750K .......... .......... .......... .......... .......... 78% 233M 0s 2024-09-12T17:25:02.404 INFO:teuthology.orchestra.run.smithi016.stderr: 72800K .......... .......... .......... .......... .......... 78% 261M 0s 2024-09-12T17:25:02.404 INFO:teuthology.orchestra.run.smithi016.stderr: 72850K .......... .......... .......... .......... .......... 78% 249M 0s 2024-09-12T17:25:02.404 INFO:teuthology.orchestra.run.smithi016.stderr: 72900K .......... .......... .......... .......... .......... 78% 339M 0s 2024-09-12T17:25:02.404 INFO:teuthology.orchestra.run.smithi016.stderr: 72950K .......... .......... .......... .......... .......... 78% 250M 0s 2024-09-12T17:25:02.404 INFO:teuthology.orchestra.run.smithi016.stderr: 73000K .......... .......... .......... .......... .......... 78% 320M 0s 2024-09-12T17:25:02.404 INFO:teuthology.orchestra.run.smithi016.stderr: 73050K .......... .......... .......... .......... .......... 78% 147M 0s 2024-09-12T17:25:02.404 INFO:teuthology.orchestra.run.smithi016.stderr: 73100K .......... .......... .......... .......... .......... 78% 234M 0s 2024-09-12T17:25:02.404 INFO:teuthology.orchestra.run.smithi016.stderr: 73150K .......... .......... .......... .......... .......... 78% 212M 0s 2024-09-12T17:25:02.404 INFO:teuthology.orchestra.run.smithi016.stderr: 73200K .......... .......... .......... .......... .......... 78% 255M 0s 2024-09-12T17:25:02.405 INFO:teuthology.orchestra.run.smithi016.stderr: 73250K .......... .......... .......... .......... .......... 78% 261M 0s 2024-09-12T17:25:02.405 INFO:teuthology.orchestra.run.smithi016.stderr: 73300K .......... .......... .......... .......... .......... 78% 257M 0s 2024-09-12T17:25:02.405 INFO:teuthology.orchestra.run.smithi016.stderr: 73350K .......... .......... .......... .......... .......... 79% 246M 0s 2024-09-12T17:25:02.405 INFO:teuthology.orchestra.run.smithi016.stderr: 73400K .......... .......... .......... .......... .......... 79% 266M 0s 2024-09-12T17:25:02.405 INFO:teuthology.orchestra.run.smithi016.stderr: 73450K .......... .......... .......... .......... .......... 79% 290M 0s 2024-09-12T17:25:02.405 INFO:teuthology.orchestra.run.smithi016.stderr: 73500K .......... .......... .......... .......... .......... 79% 345M 0s 2024-09-12T17:25:02.405 INFO:teuthology.orchestra.run.smithi016.stderr: 73550K .......... .......... .......... .......... .......... 79% 290M 0s 2024-09-12T17:25:02.405 INFO:teuthology.orchestra.run.smithi016.stderr: 73600K .......... .......... .......... .......... .......... 79% 142M 0s 2024-09-12T17:25:02.405 INFO:teuthology.orchestra.run.smithi016.stderr: 73650K .......... .......... .......... .......... .......... 79% 151M 0s 2024-09-12T17:25:02.405 INFO:teuthology.orchestra.run.smithi016.stderr: 73700K .......... .......... .......... .......... .......... 79% 246M 0s 2024-09-12T17:25:02.405 INFO:teuthology.orchestra.run.smithi016.stderr: 73750K .......... .......... .......... .......... .......... 79% 187M 0s 2024-09-12T17:25:02.405 INFO:teuthology.orchestra.run.smithi016.stderr: 73800K .......... .......... .......... .......... .......... 79% 232M 0s 2024-09-12T17:25:02.405 INFO:teuthology.orchestra.run.smithi016.stderr: 73850K .......... .......... .......... .......... .......... 79% 285M 0s 2024-09-12T17:25:02.406 INFO:teuthology.orchestra.run.smithi016.stderr: 73900K .......... .......... .......... .......... .......... 79% 256M 0s 2024-09-12T17:25:02.406 INFO:teuthology.orchestra.run.smithi016.stderr: 73950K .......... .......... .......... .......... .......... 79% 279M 0s 2024-09-12T17:25:02.406 INFO:teuthology.orchestra.run.smithi016.stderr: 74000K .......... .......... .......... .......... .......... 79% 194M 0s 2024-09-12T17:25:02.406 INFO:teuthology.orchestra.run.smithi016.stderr: 74050K .......... .......... .......... .......... .......... 79% 236M 0s 2024-09-12T17:25:02.406 INFO:teuthology.orchestra.run.smithi016.stderr: 74100K .......... .......... .......... .......... .......... 79% 226M 0s 2024-09-12T17:25:02.406 INFO:teuthology.orchestra.run.smithi016.stderr: 74150K .......... .......... .......... .......... .......... 79% 196M 0s 2024-09-12T17:25:02.406 INFO:teuthology.orchestra.run.smithi016.stderr: 74200K .......... .......... .......... .......... .......... 79% 225M 0s 2024-09-12T17:25:02.406 INFO:teuthology.orchestra.run.smithi016.stderr: 74250K .......... .......... .......... .......... .......... 79% 253M 0s 2024-09-12T17:25:02.406 INFO:teuthology.orchestra.run.smithi016.stderr: 74300K .......... .......... .......... .......... .......... 80% 264M 0s 2024-09-12T17:25:02.406 INFO:teuthology.orchestra.run.smithi016.stderr: 74350K .......... .......... .......... .......... .......... 80% 218M 0s 2024-09-12T17:25:02.406 INFO:teuthology.orchestra.run.smithi016.stderr: 74400K .......... .......... .......... .......... .......... 80% 155M 0s 2024-09-12T17:25:02.406 INFO:teuthology.orchestra.run.smithi016.stderr: 74450K .......... .......... .......... .......... .......... 80% 228M 0s 2024-09-12T17:25:02.406 INFO:teuthology.orchestra.run.smithi016.stderr: 74500K .......... .......... .......... .......... .......... 80% 293M 0s 2024-09-12T17:25:02.406 INFO:teuthology.orchestra.run.smithi016.stderr: 74550K .......... .......... .......... .......... .......... 80% 246M 0s 2024-09-12T17:25:02.407 INFO:teuthology.orchestra.run.smithi016.stderr: 74600K .......... .......... .......... .......... .......... 80% 153M 0s 2024-09-12T17:25:02.407 INFO:teuthology.orchestra.run.smithi016.stderr: 74650K .......... .......... .......... .......... .......... 80% 261M 0s 2024-09-12T17:25:02.407 INFO:teuthology.orchestra.run.smithi016.stderr: 74700K .......... .......... .......... .......... .......... 80% 273M 0s 2024-09-12T17:25:02.407 INFO:teuthology.orchestra.run.smithi016.stderr: 74750K .......... .......... .......... .......... .......... 80% 229M 0s 2024-09-12T17:25:02.407 INFO:teuthology.orchestra.run.smithi016.stderr: 74800K .......... .......... .......... .......... .......... 80% 261M 0s 2024-09-12T17:25:02.407 INFO:teuthology.orchestra.run.smithi016.stderr: 74850K .......... .......... .......... .......... .......... 80% 275M 0s 2024-09-12T17:25:02.407 INFO:teuthology.orchestra.run.smithi016.stderr: 74900K .......... .......... .......... .......... .......... 80% 258M 0s 2024-09-12T17:25:02.407 INFO:teuthology.orchestra.run.smithi016.stderr: 74950K .......... .......... .......... .......... .......... 80% 262M 0s 2024-09-12T17:25:02.407 INFO:teuthology.orchestra.run.smithi016.stderr: 75000K .......... .......... .......... .......... .......... 80% 316M 0s 2024-09-12T17:25:02.407 INFO:teuthology.orchestra.run.smithi016.stderr: 75050K .......... .......... .......... .......... .......... 80% 321M 0s 2024-09-12T17:25:02.407 INFO:teuthology.orchestra.run.smithi016.stderr: 75100K .......... .......... .......... .......... .......... 80% 284M 0s 2024-09-12T17:25:02.407 INFO:teuthology.orchestra.run.smithi016.stderr: 75150K .......... .......... .......... .......... .......... 80% 257M 0s 2024-09-12T17:25:02.407 INFO:teuthology.orchestra.run.smithi016.stderr: 75200K .......... .......... .......... .......... .......... 81% 288M 0s 2024-09-12T17:25:02.407 INFO:teuthology.orchestra.run.smithi016.stderr: 75250K .......... .......... .......... .......... .......... 81% 225M 0s 2024-09-12T17:25:02.408 INFO:teuthology.orchestra.run.smithi016.stderr: 75300K .......... .......... .......... .......... .......... 81% 118M 0s 2024-09-12T17:25:02.408 INFO:teuthology.orchestra.run.smithi016.stderr: 75350K .......... .......... .......... .......... .......... 81% 252M 0s 2024-09-12T17:25:02.408 INFO:teuthology.orchestra.run.smithi016.stderr: 75400K .......... .......... .......... .......... .......... 81% 154M 0s 2024-09-12T17:25:02.408 INFO:teuthology.orchestra.run.smithi016.stderr: 75450K .......... .......... .......... .......... .......... 81% 84.4M 0s 2024-09-12T17:25:02.408 INFO:teuthology.orchestra.run.smithi016.stderr: 75500K .......... .......... .......... .......... .......... 81% 203M 0s 2024-09-12T17:25:02.408 INFO:teuthology.orchestra.run.smithi016.stderr: 75550K .......... .......... .......... .......... .......... 81% 186M 0s 2024-09-12T17:25:02.408 INFO:teuthology.orchestra.run.smithi016.stderr: 75600K .......... .......... .......... .......... .......... 81% 243M 0s 2024-09-12T17:25:02.408 INFO:teuthology.orchestra.run.smithi016.stderr: 75650K .......... .......... .......... .......... .......... 81% 90.1M 0s 2024-09-12T17:25:02.408 INFO:teuthology.orchestra.run.smithi016.stderr: 75700K .......... .......... .......... .......... .......... 81% 127M 0s 2024-09-12T17:25:02.408 INFO:teuthology.orchestra.run.smithi016.stderr: 75750K .......... .......... .......... .......... .......... 81% 200M 0s 2024-09-12T17:25:02.408 INFO:teuthology.orchestra.run.smithi016.stderr: 75800K .......... .......... .......... .......... .......... 81% 298M 0s 2024-09-12T17:25:02.408 INFO:teuthology.orchestra.run.smithi016.stderr: 75850K .......... .......... .......... .......... .......... 81% 92.5M 0s 2024-09-12T17:25:02.408 INFO:teuthology.orchestra.run.smithi016.stderr: 75900K .......... .......... .......... .......... .......... 81% 67.2M 0s 2024-09-12T17:25:02.409 INFO:teuthology.orchestra.run.smithi016.stderr: 75950K .......... .......... .......... .......... .......... 81% 250M 0s 2024-09-12T17:25:02.409 INFO:teuthology.orchestra.run.smithi016.stderr: 76000K .......... .......... .......... .......... .......... 81% 118M 0s 2024-09-12T17:25:02.409 INFO:teuthology.orchestra.run.smithi016.stderr: 76050K .......... .......... .......... .......... .......... 81% 192M 0s 2024-09-12T17:25:02.409 INFO:teuthology.orchestra.run.smithi016.stderr: 76100K .......... .......... .......... .......... .......... 81% 116M 0s 2024-09-12T17:25:02.409 INFO:teuthology.orchestra.run.smithi016.stderr: 76150K .......... .......... .......... .......... .......... 82% 93.5M 0s 2024-09-12T17:25:02.409 INFO:teuthology.orchestra.run.smithi016.stderr: 76200K .......... .......... .......... .......... .......... 82% 132M 0s 2024-09-12T17:25:02.409 INFO:teuthology.orchestra.run.smithi016.stderr: 76250K .......... .......... .......... .......... .......... 82% 96.4M 0s 2024-09-12T17:25:02.409 INFO:teuthology.orchestra.run.smithi016.stderr: 76300K .......... .......... .......... .......... .......... 82% 77.8M 0s 2024-09-12T17:25:02.409 INFO:teuthology.orchestra.run.smithi016.stderr: 76350K .......... .......... .......... .......... .......... 82% 178M 0s 2024-09-12T17:25:02.409 INFO:teuthology.orchestra.run.smithi016.stderr: 76400K .......... .......... .......... .......... .......... 82% 240M 0s 2024-09-12T17:25:02.409 INFO:teuthology.orchestra.run.smithi016.stderr: 76450K .......... .......... .......... .......... .......... 82% 66.4M 0s 2024-09-12T17:25:02.409 INFO:teuthology.orchestra.run.smithi016.stderr: 76500K .......... .......... .......... .......... .......... 82% 196M 0s 2024-09-12T17:25:02.409 INFO:teuthology.orchestra.run.smithi016.stderr: 76550K .......... .......... .......... .......... .......... 82% 239M 0s 2024-09-12T17:25:02.410 INFO:teuthology.orchestra.run.smithi016.stderr: 76600K .......... .......... .......... .......... .......... 82% 252M 0s 2024-09-12T17:25:02.410 INFO:teuthology.orchestra.run.smithi016.stderr: 76650K .......... .......... .......... .......... .......... 82% 232M 0s 2024-09-12T17:25:02.410 INFO:teuthology.orchestra.run.smithi016.stderr: 76700K .......... .......... .......... .......... .......... 82% 228M 0s 2024-09-12T17:25:02.410 INFO:teuthology.orchestra.run.smithi016.stderr: 76750K .......... .......... .......... .......... .......... 82% 351M 0s 2024-09-12T17:25:02.410 INFO:teuthology.orchestra.run.smithi016.stderr: 76800K .......... .......... .......... .......... .......... 82% 232M 0s 2024-09-12T17:25:02.410 INFO:teuthology.orchestra.run.smithi016.stderr: 76850K .......... .......... .......... .......... .......... 82% 232M 0s 2024-09-12T17:25:02.410 INFO:teuthology.orchestra.run.smithi016.stderr: 76900K .......... .......... .......... .......... .......... 82% 227M 0s 2024-09-12T17:25:02.410 INFO:teuthology.orchestra.run.smithi016.stderr: 76950K .......... .......... .......... .......... .......... 82% 307M 0s 2024-09-12T17:25:02.410 INFO:teuthology.orchestra.run.smithi016.stderr: 77000K .......... .......... .......... .......... .......... 82% 355M 0s 2024-09-12T17:25:02.410 INFO:teuthology.orchestra.run.smithi016.stderr: 77050K .......... .......... .......... .......... .......... 82% 250M 0s 2024-09-12T17:25:02.410 INFO:teuthology.orchestra.run.smithi016.stderr: 77100K .......... .......... .......... .......... .......... 83% 139M 0s 2024-09-12T17:25:02.410 INFO:teuthology.orchestra.run.smithi016.stderr: 77150K .......... .......... .......... .......... .......... 83% 178M 0s 2024-09-12T17:25:02.410 INFO:teuthology.orchestra.run.smithi016.stderr: 77200K .......... .......... .......... .......... .......... 83% 247M 0s 2024-09-12T17:25:02.410 INFO:teuthology.orchestra.run.smithi016.stderr: 77250K .......... .......... .......... .......... .......... 83% 245M 0s 2024-09-12T17:25:02.411 INFO:teuthology.orchestra.run.smithi016.stderr: 77300K .......... .......... .......... .......... .......... 83% 200M 0s 2024-09-12T17:25:02.411 INFO:teuthology.orchestra.run.smithi016.stderr: 77350K .......... .......... .......... .......... .......... 83% 289M 0s 2024-09-12T17:25:02.411 INFO:teuthology.orchestra.run.smithi016.stderr: 77400K .......... .......... .......... .......... .......... 83% 267M 0s 2024-09-12T17:25:02.411 INFO:teuthology.orchestra.run.smithi016.stderr: 77450K .......... .......... .......... .......... .......... 83% 347M 0s 2024-09-12T17:25:02.411 INFO:teuthology.orchestra.run.smithi016.stderr: 77500K .......... .......... .......... .......... .......... 83% 129M 0s 2024-09-12T17:25:02.411 INFO:teuthology.orchestra.run.smithi016.stderr: 77550K .......... .......... .......... .......... .......... 83% 220M 0s 2024-09-12T17:25:02.411 INFO:teuthology.orchestra.run.smithi016.stderr: 77600K .......... .......... .......... .......... .......... 83% 338M 0s 2024-09-12T17:25:02.411 INFO:teuthology.orchestra.run.smithi016.stderr: 77650K .......... .......... .......... .......... .......... 83% 265M 0s 2024-09-12T17:25:02.411 INFO:teuthology.orchestra.run.smithi016.stderr: 77700K .......... .......... .......... .......... .......... 83% 199M 0s 2024-09-12T17:25:02.411 INFO:teuthology.orchestra.run.smithi016.stderr: 77750K .......... .......... .......... .......... .......... 83% 291M 0s 2024-09-12T17:25:02.411 INFO:teuthology.orchestra.run.smithi016.stderr: 77800K .......... .......... .......... .......... .......... 83% 274M 0s 2024-09-12T17:25:02.411 INFO:teuthology.orchestra.run.smithi016.stderr: 77850K .......... .......... .......... .......... .......... 83% 159M 0s 2024-09-12T17:25:02.411 INFO:teuthology.orchestra.run.smithi016.stderr: 77900K .......... .......... .......... .......... .......... 83% 147M 0s 2024-09-12T17:25:02.411 INFO:teuthology.orchestra.run.smithi016.stderr: 77950K .......... .......... .......... .......... .......... 83% 242M 0s 2024-09-12T17:25:02.412 INFO:teuthology.orchestra.run.smithi016.stderr: 78000K .......... .......... .......... .......... .......... 84% 214M 0s 2024-09-12T17:25:02.412 INFO:teuthology.orchestra.run.smithi016.stderr: 78050K .......... .......... .......... .......... .......... 84% 231M 0s 2024-09-12T17:25:02.412 INFO:teuthology.orchestra.run.smithi016.stderr: 78100K .......... .......... .......... .......... .......... 84% 215M 0s 2024-09-12T17:25:02.412 INFO:teuthology.orchestra.run.smithi016.stderr: 78150K .......... .......... .......... .......... .......... 84% 282M 0s 2024-09-12T17:25:02.412 INFO:teuthology.orchestra.run.smithi016.stderr: 78200K .......... .......... .......... .......... .......... 84% 316M 0s 2024-09-12T17:25:02.412 INFO:teuthology.orchestra.run.smithi016.stderr: 78250K .......... .......... .......... .......... .......... 84% 232M 0s 2024-09-12T17:25:02.412 INFO:teuthology.orchestra.run.smithi016.stderr: 78300K .......... .......... .......... .......... .......... 84% 222M 0s 2024-09-12T17:25:02.412 INFO:teuthology.orchestra.run.smithi016.stderr: 78350K .......... .......... .......... .......... .......... 84% 255M 0s 2024-09-12T17:25:02.412 INFO:teuthology.orchestra.run.smithi016.stderr: 78400K .......... .......... .......... .......... .......... 84% 300M 0s 2024-09-12T17:25:02.412 INFO:teuthology.orchestra.run.smithi016.stderr: 78450K .......... .......... .......... .......... .......... 84% 67.7M 0s 2024-09-12T17:25:02.412 INFO:teuthology.orchestra.run.smithi016.stderr: 78500K .......... .......... .......... .......... .......... 84% 193M 0s 2024-09-12T17:25:02.412 INFO:teuthology.orchestra.run.smithi016.stderr: 78550K .......... .......... .......... .......... .......... 84% 234M 0s 2024-09-12T17:25:02.412 INFO:teuthology.orchestra.run.smithi016.stderr: 78600K .......... .......... .......... .......... .......... 84% 324M 0s 2024-09-12T17:25:02.413 INFO:teuthology.orchestra.run.smithi016.stderr: 78650K .......... .......... .......... .......... .......... 84% 79.3M 0s 2024-09-12T17:25:02.413 INFO:teuthology.orchestra.run.smithi016.stderr: 78700K .......... .......... .......... .......... .......... 84% 95.0M 0s 2024-09-12T17:25:02.413 INFO:teuthology.orchestra.run.smithi016.stderr: 78750K .......... .......... .......... .......... .......... 84% 86.9M 0s 2024-09-12T17:25:02.413 INFO:teuthology.orchestra.run.smithi016.stderr: 78800K .......... .......... .......... .......... .......... 84% 49.9M 0s 2024-09-12T17:25:02.413 INFO:teuthology.orchestra.run.smithi016.stderr: 78850K .......... .......... .......... .......... .......... 84% 150M 0s 2024-09-12T17:25:02.413 INFO:teuthology.orchestra.run.smithi016.stderr: 78900K .......... .......... .......... .......... .......... 84% 230M 0s 2024-09-12T17:25:02.413 INFO:teuthology.orchestra.run.smithi016.stderr: 78950K .......... .......... .......... .......... .......... 85% 349M 0s 2024-09-12T17:25:02.413 INFO:teuthology.orchestra.run.smithi016.stderr: 79000K .......... .......... .......... .......... .......... 85% 252M 0s 2024-09-12T17:25:02.413 INFO:teuthology.orchestra.run.smithi016.stderr: 79050K .......... .......... .......... .......... .......... 85% 297M 0s 2024-09-12T17:25:02.413 INFO:teuthology.orchestra.run.smithi016.stderr: 79100K .......... .......... .......... .......... .......... 85% 158M 0s 2024-09-12T17:25:02.413 INFO:teuthology.orchestra.run.smithi016.stderr: 79150K .......... .......... .......... .......... .......... 85% 171M 0s 2024-09-12T17:25:02.413 INFO:teuthology.orchestra.run.smithi016.stderr: 79200K .......... .......... .......... .......... .......... 85% 323M 0s 2024-09-12T17:25:02.414 INFO:teuthology.orchestra.run.smithi016.stderr: 79250K .......... .......... .......... .......... .......... 85% 204M 0s 2024-09-12T17:25:02.414 INFO:teuthology.orchestra.run.smithi016.stderr: 79300K .......... .......... .......... .......... .......... 85% 229M 0s 2024-09-12T17:25:02.414 INFO:teuthology.orchestra.run.smithi016.stderr: 79350K .......... .......... .......... .......... .......... 85% 128M 0s 2024-09-12T17:25:02.414 INFO:teuthology.orchestra.run.smithi016.stderr: 79400K .......... .......... .......... .......... .......... 85% 277M 0s 2024-09-12T17:25:02.414 INFO:teuthology.orchestra.run.smithi016.stderr: 79450K .......... .......... .......... .......... .......... 85% 272M 0s 2024-09-12T17:25:02.414 INFO:teuthology.orchestra.run.smithi016.stderr: 79500K .......... .......... .......... .......... .......... 85% 141M 0s 2024-09-12T17:25:02.414 INFO:teuthology.orchestra.run.smithi016.stderr: 79550K .......... .......... .......... .......... .......... 85% 193M 0s 2024-09-12T17:25:02.414 INFO:teuthology.orchestra.run.smithi016.stderr: 79600K .......... .......... .......... .......... .......... 85% 233M 0s 2024-09-12T17:25:02.414 INFO:teuthology.orchestra.run.smithi016.stderr: 79650K .......... .......... .......... .......... .......... 85% 155M 0s 2024-09-12T17:25:02.414 INFO:teuthology.orchestra.run.smithi016.stderr: 79700K .......... .......... .......... .......... .......... 85% 113M 0s 2024-09-12T17:25:02.414 INFO:teuthology.orchestra.run.smithi016.stderr: 79750K .......... .......... .......... .......... .......... 85% 145M 0s 2024-09-12T17:25:02.414 INFO:teuthology.orchestra.run.smithi016.stderr: 79800K .......... .......... .......... .......... .......... 85% 177M 0s 2024-09-12T17:25:02.414 INFO:teuthology.orchestra.run.smithi016.stderr: 79850K .......... .......... .......... .......... .......... 86% 175M 0s 2024-09-12T17:25:02.414 INFO:teuthology.orchestra.run.smithi016.stderr: 79900K .......... .......... .......... .......... .......... 86% 145M 0s 2024-09-12T17:25:02.415 INFO:teuthology.orchestra.run.smithi016.stderr: 79950K .......... .......... .......... .......... .......... 86% 170M 0s 2024-09-12T17:25:02.415 INFO:teuthology.orchestra.run.smithi016.stderr: 80000K .......... .......... .......... .......... .......... 86% 184M 0s 2024-09-12T17:25:02.415 INFO:teuthology.orchestra.run.smithi016.stderr: 80050K .......... .......... .......... .......... .......... 86% 180M 0s 2024-09-12T17:25:02.415 INFO:teuthology.orchestra.run.smithi016.stderr: 80100K .......... .......... .......... .......... .......... 86% 157M 0s 2024-09-12T17:25:02.415 INFO:teuthology.orchestra.run.smithi016.stderr: 80150K .......... .......... .......... .......... .......... 86% 186M 0s 2024-09-12T17:25:02.415 INFO:teuthology.orchestra.run.smithi016.stderr: 80200K .......... .......... .......... .......... .......... 86% 181M 0s 2024-09-12T17:25:02.415 INFO:teuthology.orchestra.run.smithi016.stderr: 80250K .......... .......... .......... .......... .......... 86% 179M 0s 2024-09-12T17:25:02.415 INFO:teuthology.orchestra.run.smithi016.stderr: 80300K .......... .......... .......... .......... .......... 86% 147M 0s 2024-09-12T17:25:02.415 INFO:teuthology.orchestra.run.smithi016.stderr: 80350K .......... .......... .......... .......... .......... 86% 173M 0s 2024-09-12T17:25:02.415 INFO:teuthology.orchestra.run.smithi016.stderr: 80400K .......... .......... .......... .......... .......... 86% 185M 0s 2024-09-12T17:25:02.415 INFO:teuthology.orchestra.run.smithi016.stderr: 80450K .......... .......... .......... .......... .......... 86% 173M 0s 2024-09-12T17:25:02.415 INFO:teuthology.orchestra.run.smithi016.stderr: 80500K .......... .......... .......... .......... .......... 86% 157M 0s 2024-09-12T17:25:02.415 INFO:teuthology.orchestra.run.smithi016.stderr: 80550K .......... .......... .......... .......... .......... 86% 177M 0s 2024-09-12T17:25:02.415 INFO:teuthology.orchestra.run.smithi016.stderr: 80600K .......... .......... .......... .......... .......... 86% 171M 0s 2024-09-12T17:25:02.416 INFO:teuthology.orchestra.run.smithi016.stderr: 80650K .......... .......... .......... .......... .......... 86% 161M 0s 2024-09-12T17:25:02.416 INFO:teuthology.orchestra.run.smithi016.stderr: 80700K .......... .......... .......... .......... .......... 86% 151M 0s 2024-09-12T17:25:02.416 INFO:teuthology.orchestra.run.smithi016.stderr: 80750K .......... .......... .......... .......... .......... 86% 181M 0s 2024-09-12T17:25:02.416 INFO:teuthology.orchestra.run.smithi016.stderr: 80800K .......... .......... .......... .......... .......... 87% 182M 0s 2024-09-12T17:25:02.416 INFO:teuthology.orchestra.run.smithi016.stderr: 80850K .......... .......... .......... .......... .......... 87% 173M 0s 2024-09-12T17:25:02.416 INFO:teuthology.orchestra.run.smithi016.stderr: 80900K .......... .......... .......... .......... .......... 87% 168M 0s 2024-09-12T17:25:02.416 INFO:teuthology.orchestra.run.smithi016.stderr: 80950K .......... .......... .......... .......... .......... 87% 179M 0s 2024-09-12T17:25:02.416 INFO:teuthology.orchestra.run.smithi016.stderr: 81000K .......... .......... .......... .......... .......... 87% 178M 0s 2024-09-12T17:25:02.416 INFO:teuthology.orchestra.run.smithi016.stderr: 81050K .......... .......... .......... .......... .......... 87% 186M 0s 2024-09-12T17:25:02.416 INFO:teuthology.orchestra.run.smithi016.stderr: 81100K .......... .......... .......... .......... .......... 87% 153M 0s 2024-09-12T17:25:02.416 INFO:teuthology.orchestra.run.smithi016.stderr: 81150K .......... .......... .......... .......... .......... 87% 178M 0s 2024-09-12T17:25:02.416 INFO:teuthology.orchestra.run.smithi016.stderr: 81200K .......... .......... .......... .......... .......... 87% 179M 0s 2024-09-12T17:25:02.416 INFO:teuthology.orchestra.run.smithi016.stderr: 81250K .......... .......... .......... .......... .......... 87% 181M 0s 2024-09-12T17:25:02.416 INFO:teuthology.orchestra.run.smithi016.stderr: 81300K .......... .......... .......... .......... .......... 87% 174M 0s 2024-09-12T17:25:02.417 INFO:teuthology.orchestra.run.smithi016.stderr: 81350K .......... .......... .......... .......... .......... 87% 210M 0s 2024-09-12T17:25:02.417 INFO:teuthology.orchestra.run.smithi016.stderr: 81400K .......... .......... .......... .......... .......... 87% 263M 0s 2024-09-12T17:25:02.417 INFO:teuthology.orchestra.run.smithi016.stderr: 81450K .......... .......... .......... .......... .......... 87% 239M 0s 2024-09-12T17:25:02.417 INFO:teuthology.orchestra.run.smithi016.stderr: 81500K .......... .......... .......... .......... .......... 87% 161M 0s 2024-09-12T17:25:02.417 INFO:teuthology.orchestra.run.smithi016.stderr: 81550K .......... .......... .......... .......... .......... 87% 247M 0s 2024-09-12T17:25:02.417 INFO:teuthology.orchestra.run.smithi016.stderr: 81600K .......... .......... .......... .......... .......... 87% 231M 0s 2024-09-12T17:25:02.417 INFO:teuthology.orchestra.run.smithi016.stderr: 81650K .......... .......... .......... .......... .......... 87% 202M 0s 2024-09-12T17:25:02.417 INFO:teuthology.orchestra.run.smithi016.stderr: 81700K .......... .......... .......... .......... .......... 87% 183M 0s 2024-09-12T17:25:02.417 INFO:teuthology.orchestra.run.smithi016.stderr: 81750K .......... .......... .......... .......... .......... 88% 188M 0s 2024-09-12T17:25:02.417 INFO:teuthology.orchestra.run.smithi016.stderr: 81800K .......... .......... .......... .......... .......... 88% 246M 0s 2024-09-12T17:25:02.417 INFO:teuthology.orchestra.run.smithi016.stderr: 81850K .......... .......... .......... .......... .......... 88% 250M 0s 2024-09-12T17:25:02.417 INFO:teuthology.orchestra.run.smithi016.stderr: 81900K .......... .......... .......... .......... .......... 88% 252M 0s 2024-09-12T17:25:02.417 INFO:teuthology.orchestra.run.smithi016.stderr: 81950K .......... .......... .......... .......... .......... 88% 192M 0s 2024-09-12T17:25:02.418 INFO:teuthology.orchestra.run.smithi016.stderr: 82000K .......... .......... .......... .......... .......... 88% 199M 0s 2024-09-12T17:25:02.418 INFO:teuthology.orchestra.run.smithi016.stderr: 82050K .......... .......... .......... .......... .......... 88% 186M 0s 2024-09-12T17:25:02.418 INFO:teuthology.orchestra.run.smithi016.stderr: 82100K .......... .......... .......... .......... .......... 88% 236M 0s 2024-09-12T17:25:02.418 INFO:teuthology.orchestra.run.smithi016.stderr: 82150K .......... .......... .......... .......... .......... 88% 210M 0s 2024-09-12T17:25:02.418 INFO:teuthology.orchestra.run.smithi016.stderr: 82200K .......... .......... .......... .......... .......... 88% 292M 0s 2024-09-12T17:25:02.418 INFO:teuthology.orchestra.run.smithi016.stderr: 82250K .......... .......... .......... .......... .......... 88% 188M 0s 2024-09-12T17:25:02.418 INFO:teuthology.orchestra.run.smithi016.stderr: 82300K .......... .......... .......... .......... .......... 88% 189M 0s 2024-09-12T17:25:02.418 INFO:teuthology.orchestra.run.smithi016.stderr: 82350K .......... .......... .......... .......... .......... 88% 185M 0s 2024-09-12T17:25:02.418 INFO:teuthology.orchestra.run.smithi016.stderr: 82400K .......... .......... .......... .......... .......... 88% 222M 0s 2024-09-12T17:25:02.418 INFO:teuthology.orchestra.run.smithi016.stderr: 82450K .......... .......... .......... .......... .......... 88% 174M 0s 2024-09-12T17:25:02.418 INFO:teuthology.orchestra.run.smithi016.stderr: 82500K .......... .......... .......... .......... .......... 88% 201M 0s 2024-09-12T17:25:02.418 INFO:teuthology.orchestra.run.smithi016.stderr: 82550K .......... .......... .......... .......... .......... 88% 233M 0s 2024-09-12T17:25:02.418 INFO:teuthology.orchestra.run.smithi016.stderr: 82600K .......... .......... .......... .......... .......... 88% 191M 0s 2024-09-12T17:25:02.418 INFO:teuthology.orchestra.run.smithi016.stderr: 82650K .......... .......... .......... .......... .......... 89% 214M 0s 2024-09-12T17:25:02.419 INFO:teuthology.orchestra.run.smithi016.stderr: 82700K .......... .......... .......... .......... .......... 89% 231M 0s 2024-09-12T17:25:02.419 INFO:teuthology.orchestra.run.smithi016.stderr: 82750K .......... .......... .......... .......... .......... 89% 193M 0s 2024-09-12T17:25:02.419 INFO:teuthology.orchestra.run.smithi016.stderr: 82800K .......... .......... .......... .......... .......... 89% 220M 0s 2024-09-12T17:25:02.419 INFO:teuthology.orchestra.run.smithi016.stderr: 82850K .......... .......... .......... .......... .......... 89% 255M 0s 2024-09-12T17:25:02.419 INFO:teuthology.orchestra.run.smithi016.stderr: 82900K .......... .......... .......... .......... .......... 89% 260M 0s 2024-09-12T17:25:02.419 INFO:teuthology.orchestra.run.smithi016.stderr: 82950K .......... .......... .......... .......... .......... 89% 246M 0s 2024-09-12T17:25:02.419 INFO:teuthology.orchestra.run.smithi016.stderr: 83000K .......... .......... .......... .......... .......... 89% 252M 0s 2024-09-12T17:25:02.419 INFO:teuthology.orchestra.run.smithi016.stderr: 83050K .......... .......... .......... .......... .......... 89% 197M 0s 2024-09-12T17:25:02.419 INFO:teuthology.orchestra.run.smithi016.stderr: 83100K .......... .......... .......... .......... .......... 89% 296M 0s 2024-09-12T17:25:02.419 INFO:teuthology.orchestra.run.smithi016.stderr: 83150K .......... .......... .......... .......... .......... 89% 253M 0s 2024-09-12T17:25:02.419 INFO:teuthology.orchestra.run.smithi016.stderr: 83200K .......... .......... .......... .......... .......... 89% 306M 0s 2024-09-12T17:25:02.419 INFO:teuthology.orchestra.run.smithi016.stderr: 83250K .......... .......... .......... .......... .......... 89% 311M 0s 2024-09-12T17:25:02.419 INFO:teuthology.orchestra.run.smithi016.stderr: 83300K .......... .......... .......... .......... .......... 89% 380M 0s 2024-09-12T17:25:02.419 INFO:teuthology.orchestra.run.smithi016.stderr: 83350K .......... .......... .......... .......... .......... 89% 374M 0s 2024-09-12T17:25:02.420 INFO:teuthology.orchestra.run.smithi016.stderr: 83400K .......... .......... .......... .......... .......... 89% 325M 0s 2024-09-12T17:25:02.420 INFO:teuthology.orchestra.run.smithi016.stderr: 83450K .......... .......... .......... .......... .......... 89% 322M 0s 2024-09-12T17:25:02.420 INFO:teuthology.orchestra.run.smithi016.stderr: 83500K .......... .......... .......... .......... .......... 89% 360M 0s 2024-09-12T17:25:02.420 INFO:teuthology.orchestra.run.smithi016.stderr: 83550K .......... .......... .......... .......... .......... 89% 345M 0s 2024-09-12T17:25:02.420 INFO:teuthology.orchestra.run.smithi016.stderr: 83600K .......... .......... .......... .......... .......... 90% 371M 0s 2024-09-12T17:25:02.420 INFO:teuthology.orchestra.run.smithi016.stderr: 83650K .......... .......... .......... .......... .......... 90% 251M 0s 2024-09-12T17:25:02.420 INFO:teuthology.orchestra.run.smithi016.stderr: 83700K .......... .......... .......... .......... .......... 90% 396M 0s 2024-09-12T17:25:02.420 INFO:teuthology.orchestra.run.smithi016.stderr: 83750K .......... .......... .......... .......... .......... 90% 367M 0s 2024-09-12T17:25:02.420 INFO:teuthology.orchestra.run.smithi016.stderr: 83800K .......... .......... .......... .......... .......... 90% 395M 0s 2024-09-12T17:25:02.420 INFO:teuthology.orchestra.run.smithi016.stderr: 83850K .......... .......... .......... .......... .......... 90% 338M 0s 2024-09-12T17:25:02.420 INFO:teuthology.orchestra.run.smithi016.stderr: 83900K .......... .......... .......... .......... .......... 90% 395M 0s 2024-09-12T17:25:02.420 INFO:teuthology.orchestra.run.smithi016.stderr: 83950K .......... .......... .......... .......... .......... 90% 398M 0s 2024-09-12T17:25:02.420 INFO:teuthology.orchestra.run.smithi016.stderr: 84000K .......... .......... .......... .......... .......... 90% 401M 0s 2024-09-12T17:25:02.421 INFO:teuthology.orchestra.run.smithi016.stderr: 84050K .......... .......... .......... .......... .......... 90% 338M 0s 2024-09-12T17:25:02.421 INFO:teuthology.orchestra.run.smithi016.stderr: 84100K .......... .......... .......... .......... .......... 90% 378M 0s 2024-09-12T17:25:02.421 INFO:teuthology.orchestra.run.smithi016.stderr: 84150K .......... .......... .......... .......... .......... 90% 326M 0s 2024-09-12T17:25:02.421 INFO:teuthology.orchestra.run.smithi016.stderr: 84200K .......... .......... .......... .......... .......... 90% 335M 0s 2024-09-12T17:25:02.421 INFO:teuthology.orchestra.run.smithi016.stderr: 84250K .......... .......... .......... .......... .......... 90% 285M 0s 2024-09-12T17:25:02.421 INFO:teuthology.orchestra.run.smithi016.stderr: 84300K .......... .......... .......... .......... .......... 90% 386M 0s 2024-09-12T17:25:02.421 INFO:teuthology.orchestra.run.smithi016.stderr: 84350K .......... .......... .......... .......... .......... 90% 408M 0s 2024-09-12T17:25:02.421 INFO:teuthology.orchestra.run.smithi016.stderr: 84400K .......... .......... .......... .......... .......... 90% 221M 0s 2024-09-12T17:25:02.421 INFO:teuthology.orchestra.run.smithi016.stderr: 84450K .......... .......... .......... .......... .......... 90% 205M 0s 2024-09-12T17:25:02.421 INFO:teuthology.orchestra.run.smithi016.stderr: 84500K .......... .......... .......... .......... .......... 91% 269M 0s 2024-09-12T17:25:02.421 INFO:teuthology.orchestra.run.smithi016.stderr: 84550K .......... .......... .......... .......... .......... 91% 294M 0s 2024-09-12T17:25:02.421 INFO:teuthology.orchestra.run.smithi016.stderr: 84600K .......... .......... .......... .......... .......... 91% 118M 0s 2024-09-12T17:25:02.421 INFO:teuthology.orchestra.run.smithi016.stderr: 84650K .......... .......... .......... .......... .......... 91% 210M 0s 2024-09-12T17:25:02.422 INFO:teuthology.orchestra.run.smithi016.stderr: 84700K .......... .......... .......... .......... .......... 91% 270M 0s 2024-09-12T17:25:02.422 INFO:teuthology.orchestra.run.smithi016.stderr: 84750K .......... .......... .......... .......... .......... 91% 180M 0s 2024-09-12T17:25:02.422 INFO:teuthology.orchestra.run.smithi016.stderr: 84800K .......... .......... .......... .......... .......... 91% 379M 0s 2024-09-12T17:25:02.422 INFO:teuthology.orchestra.run.smithi016.stderr: 84850K .......... .......... .......... .......... .......... 91% 112M 0s 2024-09-12T17:25:02.422 INFO:teuthology.orchestra.run.smithi016.stderr: 84900K .......... .......... .......... .......... .......... 91% 256M 0s 2024-09-12T17:25:02.422 INFO:teuthology.orchestra.run.smithi016.stderr: 84950K .......... .......... .......... .......... .......... 91% 404M 0s 2024-09-12T17:25:02.422 INFO:teuthology.orchestra.run.smithi016.stderr: 85000K .......... .......... .......... .......... .......... 91% 169M 0s 2024-09-12T17:25:02.422 INFO:teuthology.orchestra.run.smithi016.stderr: 85050K .......... .......... .......... .......... .......... 91% 50.3M 0s 2024-09-12T17:25:02.422 INFO:teuthology.orchestra.run.smithi016.stderr: 85100K .......... .......... .......... .......... .......... 91% 287M 0s 2024-09-12T17:25:02.422 INFO:teuthology.orchestra.run.smithi016.stderr: 85150K .......... .......... .......... .......... .......... 91% 377M 0s 2024-09-12T17:25:02.422 INFO:teuthology.orchestra.run.smithi016.stderr: 85200K .......... .......... .......... .......... .......... 91% 396M 0s 2024-09-12T17:25:02.422 INFO:teuthology.orchestra.run.smithi016.stderr: 85250K .......... .......... .......... .......... .......... 91% 367M 0s 2024-09-12T17:25:02.422 INFO:teuthology.orchestra.run.smithi016.stderr: 85300K .......... .......... .......... .......... .......... 91% 217M 0s 2024-09-12T17:25:02.422 INFO:teuthology.orchestra.run.smithi016.stderr: 85350K .......... .......... .......... .......... .......... 91% 379M 0s 2024-09-12T17:25:02.423 INFO:teuthology.orchestra.run.smithi016.stderr: 85400K .......... .......... .......... .......... .......... 91% 369M 0s 2024-09-12T17:25:02.423 INFO:teuthology.orchestra.run.smithi016.stderr: 85450K .......... .......... .......... .......... .......... 92% 196M 0s 2024-09-12T17:25:02.423 INFO:teuthology.orchestra.run.smithi016.stderr: 85500K .......... .......... .......... .......... .......... 92% 218M 0s 2024-09-12T17:25:02.423 INFO:teuthology.orchestra.run.smithi016.stderr: 85550K .......... .......... .......... .......... .......... 92% 140M 0s 2024-09-12T17:25:02.423 INFO:teuthology.orchestra.run.smithi016.stderr: 85600K .......... .......... .......... .......... .......... 92% 365M 0s 2024-09-12T17:25:02.423 INFO:teuthology.orchestra.run.smithi016.stderr: 85650K .......... .......... .......... .......... .......... 92% 351M 0s 2024-09-12T17:25:02.423 INFO:teuthology.orchestra.run.smithi016.stderr: 85700K .......... .......... .......... .......... .......... 92% 200M 0s 2024-09-12T17:25:02.423 INFO:teuthology.orchestra.run.smithi016.stderr: 85750K .......... .......... .......... .......... .......... 92% 111M 0s 2024-09-12T17:25:02.423 INFO:teuthology.orchestra.run.smithi016.stderr: 85800K .......... .......... .......... .......... .......... 92% 171M 0s 2024-09-12T17:25:02.423 INFO:teuthology.orchestra.run.smithi016.stderr: 85850K .......... .......... .......... .......... .......... 92% 315M 0s 2024-09-12T17:25:02.423 INFO:teuthology.orchestra.run.smithi016.stderr: 85900K .......... .......... .......... .......... .......... 92% 364M 0s 2024-09-12T17:25:02.423 INFO:teuthology.orchestra.run.smithi016.stderr: 85950K .......... .......... .......... .......... .......... 92% 381M 0s 2024-09-12T17:25:02.423 INFO:teuthology.orchestra.run.smithi016.stderr: 86000K .......... .......... .......... .......... .......... 92% 360M 0s 2024-09-12T17:25:02.424 INFO:teuthology.orchestra.run.smithi016.stderr: 86050K .......... .......... .......... .......... .......... 92% 324M 0s 2024-09-12T17:25:02.424 INFO:teuthology.orchestra.run.smithi016.stderr: 86100K .......... .......... .......... .......... .......... 92% 372M 0s 2024-09-12T17:25:02.424 INFO:teuthology.orchestra.run.smithi016.stderr: 86150K .......... .......... .......... .......... .......... 92% 339M 0s 2024-09-12T17:25:02.424 INFO:teuthology.orchestra.run.smithi016.stderr: 86200K .......... .......... .......... .......... .......... 92% 298M 0s 2024-09-12T17:25:02.424 INFO:teuthology.orchestra.run.smithi016.stderr: 86250K .......... .......... .......... .......... .......... 92% 312M 0s 2024-09-12T17:25:02.424 INFO:teuthology.orchestra.run.smithi016.stderr: 86300K .......... .......... .......... .......... .......... 92% 381M 0s 2024-09-12T17:25:02.424 INFO:teuthology.orchestra.run.smithi016.stderr: 86350K .......... .......... .......... .......... .......... 93% 396M 0s 2024-09-12T17:25:02.424 INFO:teuthology.orchestra.run.smithi016.stderr: 86400K .......... .......... .......... .......... .......... 93% 401M 0s 2024-09-12T17:25:02.424 INFO:teuthology.orchestra.run.smithi016.stderr: 86450K .......... .......... .......... .......... .......... 93% 364M 0s 2024-09-12T17:25:02.424 INFO:teuthology.orchestra.run.smithi016.stderr: 86500K .......... .......... .......... .......... .......... 93% 370M 0s 2024-09-12T17:25:02.424 INFO:teuthology.orchestra.run.smithi016.stderr: 86550K .......... .......... .......... .......... .......... 93% 407M 0s 2024-09-12T17:25:02.424 INFO:teuthology.orchestra.run.smithi016.stderr: 86600K .......... .......... .......... .......... .......... 93% 260M 0s 2024-09-12T17:25:02.424 INFO:teuthology.orchestra.run.smithi016.stderr: 86650K .......... .......... .......... .......... .......... 93% 304M 0s 2024-09-12T17:25:02.425 INFO:teuthology.orchestra.run.smithi016.stderr: 86700K .......... .......... .......... .......... .......... 93% 377M 0s 2024-09-12T17:25:02.425 INFO:teuthology.orchestra.run.smithi016.stderr: 86750K .......... .......... .......... .......... .......... 93% 138M 0s 2024-09-12T17:25:02.425 INFO:teuthology.orchestra.run.smithi016.stderr: 86800K .......... .......... .......... .......... .......... 93% 365M 0s 2024-09-12T17:25:02.425 INFO:teuthology.orchestra.run.smithi016.stderr: 86850K .......... .......... .......... .......... .......... 93% 349M 0s 2024-09-12T17:25:02.425 INFO:teuthology.orchestra.run.smithi016.stderr: 86900K .......... .......... .......... .......... .......... 93% 88.7M 0s 2024-09-12T17:25:02.425 INFO:teuthology.orchestra.run.smithi016.stderr: 86950K .......... .......... .......... .......... .......... 93% 348M 0s 2024-09-12T17:25:02.425 INFO:teuthology.orchestra.run.smithi016.stderr: 87000K .......... .......... .......... .......... .......... 93% 388M 0s 2024-09-12T17:25:02.425 INFO:teuthology.orchestra.run.smithi016.stderr: 87050K .......... .......... .......... .......... .......... 93% 294M 0s 2024-09-12T17:25:02.425 INFO:teuthology.orchestra.run.smithi016.stderr: 87100K .......... .......... .......... .......... .......... 93% 363M 0s 2024-09-12T17:25:02.425 INFO:teuthology.orchestra.run.smithi016.stderr: 87150K .......... .......... .......... .......... .......... 93% 358M 0s 2024-09-12T17:25:02.425 INFO:teuthology.orchestra.run.smithi016.stderr: 87200K .......... .......... .......... .......... .......... 93% 165M 0s 2024-09-12T17:25:02.425 INFO:teuthology.orchestra.run.smithi016.stderr: 87250K .......... .......... .......... .......... .......... 93% 316M 0s 2024-09-12T17:25:02.425 INFO:teuthology.orchestra.run.smithi016.stderr: 87300K .......... .......... .......... .......... .......... 94% 324M 0s 2024-09-12T17:25:02.426 INFO:teuthology.orchestra.run.smithi016.stderr: 87350K .......... .......... .......... .......... .......... 94% 370M 0s 2024-09-12T17:25:02.426 INFO:teuthology.orchestra.run.smithi016.stderr: 87400K .......... .......... .......... .......... .......... 94% 354M 0s 2024-09-12T17:25:02.426 INFO:teuthology.orchestra.run.smithi016.stderr: 87450K .......... .......... .......... .......... .......... 94% 101M 0s 2024-09-12T17:25:02.426 INFO:teuthology.orchestra.run.smithi016.stderr: 87500K .......... .......... .......... .......... .......... 94% 350M 0s 2024-09-12T17:25:02.426 INFO:teuthology.orchestra.run.smithi016.stderr: 87550K .......... .......... .......... .......... .......... 94% 302M 0s 2024-09-12T17:25:02.426 INFO:teuthology.orchestra.run.smithi016.stderr: 87600K .......... .......... .......... .......... .......... 94% 103M 0s 2024-09-12T17:25:02.426 INFO:teuthology.orchestra.run.smithi016.stderr: 87650K .......... .......... .......... .......... .......... 94% 299M 0s 2024-09-12T17:25:02.426 INFO:teuthology.orchestra.run.smithi016.stderr: 87700K .......... .......... .......... .......... .......... 94% 349M 0s 2024-09-12T17:25:02.426 INFO:teuthology.orchestra.run.smithi016.stderr: 87750K .......... .......... .......... .......... .......... 94% 135M 0s 2024-09-12T17:25:02.426 INFO:teuthology.orchestra.run.smithi016.stderr: 87800K .......... .......... .......... .......... .......... 94% 98.4M 0s 2024-09-12T17:25:02.426 INFO:teuthology.orchestra.run.smithi016.stderr: 87850K .......... .......... .......... .......... .......... 94% 184M 0s 2024-09-12T17:25:02.426 INFO:teuthology.orchestra.run.smithi016.stderr: 87900K .......... .......... .......... .......... .......... 94% 287M 0s 2024-09-12T17:25:02.426 INFO:teuthology.orchestra.run.smithi016.stderr: 87950K .......... .......... .......... .......... .......... 94% 218M 0s 2024-09-12T17:25:02.426 INFO:teuthology.orchestra.run.smithi016.stderr: 88000K .......... .......... .......... .......... .......... 94% 333M 0s 2024-09-12T17:25:02.426 INFO:teuthology.orchestra.run.smithi016.stderr: 88050K .......... .......... .......... .......... .......... 94% 36.5M 0s 2024-09-12T17:25:02.427 INFO:teuthology.orchestra.run.smithi016.stderr: 88100K .......... .......... .......... .......... .......... 94% 105M 0s 2024-09-12T17:25:02.427 INFO:teuthology.orchestra.run.smithi016.stderr: 88150K .......... .......... .......... .......... .......... 94% 331M 0s 2024-09-12T17:25:02.427 INFO:teuthology.orchestra.run.smithi016.stderr: 88200K .......... .......... .......... .......... .......... 94% 222M 0s 2024-09-12T17:25:02.427 INFO:teuthology.orchestra.run.smithi016.stderr: 88250K .......... .......... .......... .......... .......... 95% 176M 0s 2024-09-12T17:25:02.427 INFO:teuthology.orchestra.run.smithi016.stderr: 88300K .......... .......... .......... .......... .......... 95% 253M 0s 2024-09-12T17:25:02.427 INFO:teuthology.orchestra.run.smithi016.stderr: 88350K .......... .......... .......... .......... .......... 95% 323M 0s 2024-09-12T17:25:02.427 INFO:teuthology.orchestra.run.smithi016.stderr: 88400K .......... .......... .......... .......... .......... 95% 152M 0s 2024-09-12T17:25:02.427 INFO:teuthology.orchestra.run.smithi016.stderr: 88450K .......... .......... .......... .......... .......... 95% 176M 0s 2024-09-12T17:25:02.427 INFO:teuthology.orchestra.run.smithi016.stderr: 88500K .......... .......... .......... .......... .......... 95% 172M 0s 2024-09-12T17:25:02.427 INFO:teuthology.orchestra.run.smithi016.stderr: 88550K .......... .......... .......... .......... .......... 95% 253M 0s 2024-09-12T17:25:02.427 INFO:teuthology.orchestra.run.smithi016.stderr: 88600K .......... .......... .......... .......... .......... 95% 239M 0s 2024-09-12T17:25:02.427 INFO:teuthology.orchestra.run.smithi016.stderr: 88650K .......... .......... .......... .......... .......... 95% 290M 0s 2024-09-12T17:25:02.427 INFO:teuthology.orchestra.run.smithi016.stderr: 88700K .......... .......... .......... .......... .......... 95% 375M 0s 2024-09-12T17:25:02.428 INFO:teuthology.orchestra.run.smithi016.stderr: 88750K .......... .......... .......... .......... .......... 95% 136M 0s 2024-09-12T17:25:02.428 INFO:teuthology.orchestra.run.smithi016.stderr: 88800K .......... .......... .......... .......... .......... 95% 77.5M 0s 2024-09-12T17:25:02.428 INFO:teuthology.orchestra.run.smithi016.stderr: 88850K .......... .......... .......... .......... .......... 95% 235M 0s 2024-09-12T17:25:02.428 INFO:teuthology.orchestra.run.smithi016.stderr: 88900K .......... .......... .......... .......... .......... 95% 384M 0s 2024-09-12T17:25:02.428 INFO:teuthology.orchestra.run.smithi016.stderr: 88950K .......... .......... .......... .......... .......... 95% 161M 0s 2024-09-12T17:25:02.428 INFO:teuthology.orchestra.run.smithi016.stderr: 89000K .......... .......... .......... .......... .......... 95% 363M 0s 2024-09-12T17:25:02.428 INFO:teuthology.orchestra.run.smithi016.stderr: 89050K .......... .......... .......... .......... .......... 95% 267M 0s 2024-09-12T17:25:02.428 INFO:teuthology.orchestra.run.smithi016.stderr: 89100K .......... .......... .......... .......... .......... 95% 319M 0s 2024-09-12T17:25:02.428 INFO:teuthology.orchestra.run.smithi016.stderr: 89150K .......... .......... .......... .......... .......... 96% 382M 0s 2024-09-12T17:25:02.428 INFO:teuthology.orchestra.run.smithi016.stderr: 89200K .......... .......... .......... .......... .......... 96% 342M 0s 2024-09-12T17:25:02.428 INFO:teuthology.orchestra.run.smithi016.stderr: 89250K .......... .......... .......... .......... .......... 96% 317M 0s 2024-09-12T17:25:02.428 INFO:teuthology.orchestra.run.smithi016.stderr: 89300K .......... .......... .......... .......... .......... 96% 361M 0s 2024-09-12T17:25:02.428 INFO:teuthology.orchestra.run.smithi016.stderr: 89350K .......... .......... .......... .......... .......... 96% 342M 0s 2024-09-12T17:25:02.428 INFO:teuthology.orchestra.run.smithi016.stderr: 89400K .......... .......... .......... .......... .......... 96% 363M 0s 2024-09-12T17:25:02.429 INFO:teuthology.orchestra.run.smithi016.stderr: 89450K .......... .......... .......... .......... .......... 96% 285M 0s 2024-09-12T17:25:02.429 INFO:teuthology.orchestra.run.smithi016.stderr: 89500K .......... .......... .......... .......... .......... 96% 361M 0s 2024-09-12T17:25:02.429 INFO:teuthology.orchestra.run.smithi016.stderr: 89550K .......... .......... .......... .......... .......... 96% 255M 0s 2024-09-12T17:25:02.429 INFO:teuthology.orchestra.run.smithi016.stderr: 89600K .......... .......... .......... .......... .......... 96% 268M 0s 2024-09-12T17:25:02.429 INFO:teuthology.orchestra.run.smithi016.stderr: 89650K .......... .......... .......... .......... .......... 96% 310M 0s 2024-09-12T17:25:02.429 INFO:teuthology.orchestra.run.smithi016.stderr: 89700K .......... .......... .......... .......... .......... 96% 263M 0s 2024-09-12T17:25:02.429 INFO:teuthology.orchestra.run.smithi016.stderr: 89750K .......... .......... .......... .......... .......... 96% 271M 0s 2024-09-12T17:25:02.429 INFO:teuthology.orchestra.run.smithi016.stderr: 89800K .......... .......... .......... .......... .......... 96% 291M 0s 2024-09-12T17:25:02.429 INFO:teuthology.orchestra.run.smithi016.stderr: 89850K .......... .......... .......... .......... .......... 96% 270M 0s 2024-09-12T17:25:02.429 INFO:teuthology.orchestra.run.smithi016.stderr: 89900K .......... .......... .......... .......... .......... 96% 305M 0s 2024-09-12T17:25:02.429 INFO:teuthology.orchestra.run.smithi016.stderr: 89950K .......... .......... .......... .......... .......... 96% 309M 0s 2024-09-12T17:25:02.429 INFO:teuthology.orchestra.run.smithi016.stderr: 90000K .......... .......... .......... .......... .......... 96% 334M 0s 2024-09-12T17:25:02.429 INFO:teuthology.orchestra.run.smithi016.stderr: 90050K .......... .......... .......... .......... .......... 96% 304M 0s 2024-09-12T17:25:02.430 INFO:teuthology.orchestra.run.smithi016.stderr: 90100K .......... .......... .......... .......... .......... 97% 360M 0s 2024-09-12T17:25:02.430 INFO:teuthology.orchestra.run.smithi016.stderr: 90150K .......... .......... .......... .......... .......... 97% 380M 0s 2024-09-12T17:25:02.430 INFO:teuthology.orchestra.run.smithi016.stderr: 90200K .......... .......... .......... .......... .......... 97% 335M 0s 2024-09-12T17:25:02.430 INFO:teuthology.orchestra.run.smithi016.stderr: 90250K .......... .......... .......... .......... .......... 97% 303M 0s 2024-09-12T17:25:02.430 INFO:teuthology.orchestra.run.smithi016.stderr: 90300K .......... .......... .......... .......... .......... 97% 387M 0s 2024-09-12T17:25:02.430 INFO:teuthology.orchestra.run.smithi016.stderr: 90350K .......... .......... .......... .......... .......... 97% 150M 0s 2024-09-12T17:25:02.430 INFO:teuthology.orchestra.run.smithi016.stderr: 90400K .......... .......... .......... .......... .......... 97% 89.2M 0s 2024-09-12T17:25:02.430 INFO:teuthology.orchestra.run.smithi016.stderr: 90450K .......... .......... .......... .......... .......... 97% 318M 0s 2024-09-12T17:25:02.430 INFO:teuthology.orchestra.run.smithi016.stderr: 90500K .......... .......... .......... .......... .......... 97% 350M 0s 2024-09-12T17:25:02.430 INFO:teuthology.orchestra.run.smithi016.stderr: 90550K .......... .......... .......... .......... .......... 97% 358M 0s 2024-09-12T17:25:02.430 INFO:teuthology.orchestra.run.smithi016.stderr: 90600K .......... .......... .......... .......... .......... 97% 356M 0s 2024-09-12T17:25:02.430 INFO:teuthology.orchestra.run.smithi016.stderr: 90650K .......... .......... .......... .......... .......... 97% 284M 0s 2024-09-12T17:25:02.430 INFO:teuthology.orchestra.run.smithi016.stderr: 90700K .......... .......... .......... .......... .......... 97% 357M 0s 2024-09-12T17:25:02.431 INFO:teuthology.orchestra.run.smithi016.stderr: 90750K .......... .......... .......... .......... .......... 97% 386M 0s 2024-09-12T17:25:02.431 INFO:teuthology.orchestra.run.smithi016.stderr: 90800K .......... .......... .......... .......... .......... 97% 236M 0s 2024-09-12T17:25:02.431 INFO:teuthology.orchestra.run.smithi016.stderr: 90850K .......... .......... .......... .......... .......... 97% 88.4M 0s 2024-09-12T17:25:02.431 INFO:teuthology.orchestra.run.smithi016.stderr: 90900K .......... .......... .......... .......... .......... 97% 207M 0s 2024-09-12T17:25:02.431 INFO:teuthology.orchestra.run.smithi016.stderr: 90950K .......... .......... .......... .......... .......... 97% 105M 0s 2024-09-12T17:25:02.431 INFO:teuthology.orchestra.run.smithi016.stderr: 91000K .......... .......... .......... .......... .......... 98% 267M 0s 2024-09-12T17:25:02.431 INFO:teuthology.orchestra.run.smithi016.stderr: 91050K .......... .......... .......... .......... .......... 98% 28.2M 0s 2024-09-12T17:25:02.431 INFO:teuthology.orchestra.run.smithi016.stderr: 91100K .......... .......... .......... .......... .......... 98% 257M 0s 2024-09-12T17:25:02.431 INFO:teuthology.orchestra.run.smithi016.stderr: 91150K .......... .......... .......... .......... .......... 98% 351M 0s 2024-09-12T17:25:02.431 INFO:teuthology.orchestra.run.smithi016.stderr: 91200K .......... .......... .......... .......... .......... 98% 376M 0s 2024-09-12T17:25:02.431 INFO:teuthology.orchestra.run.smithi016.stderr: 91250K .......... .......... .......... .......... .......... 98% 348M 0s 2024-09-12T17:25:02.431 INFO:teuthology.orchestra.run.smithi016.stderr: 91300K .......... .......... .......... .......... .......... 98% 186M 0s 2024-09-12T17:25:02.431 INFO:teuthology.orchestra.run.smithi016.stderr: 91350K .......... .......... .......... .......... .......... 98% 336M 0s 2024-09-12T17:25:02.431 INFO:teuthology.orchestra.run.smithi016.stderr: 91400K .......... .......... .......... .......... .......... 98% 129M 0s 2024-09-12T17:25:02.432 INFO:teuthology.orchestra.run.smithi016.stderr: 91450K .......... .......... .......... .......... .......... 98% 86.1M 0s 2024-09-12T17:25:02.432 INFO:teuthology.orchestra.run.smithi016.stderr: 91500K .......... .......... .......... .......... .......... 98% 298M 0s 2024-09-12T17:25:02.432 INFO:teuthology.orchestra.run.smithi016.stderr: 91550K .......... .......... .......... .......... .......... 98% 262M 0s 2024-09-12T17:25:02.432 INFO:teuthology.orchestra.run.smithi016.stderr: 91600K .......... .......... .......... .......... .......... 98% 195M 0s 2024-09-12T17:25:02.432 INFO:teuthology.orchestra.run.smithi016.stderr: 91650K .......... .......... .......... .......... .......... 98% 152M 0s 2024-09-12T17:25:02.432 INFO:teuthology.orchestra.run.smithi016.stderr: 91700K .......... .......... .......... .......... .......... 98% 227M 0s 2024-09-12T17:25:02.432 INFO:teuthology.orchestra.run.smithi016.stderr: 91750K .......... .......... .......... .......... .......... 98% 340M 0s 2024-09-12T17:25:02.432 INFO:teuthology.orchestra.run.smithi016.stderr: 91800K .......... .......... .......... .......... .......... 98% 136M 0s 2024-09-12T17:25:02.432 INFO:teuthology.orchestra.run.smithi016.stderr: 91850K .......... .......... .......... .......... .......... 98% 43.8M 0s 2024-09-12T17:25:02.432 INFO:teuthology.orchestra.run.smithi016.stderr: 91900K .......... .......... .......... .......... .......... 98% 338M 0s 2024-09-12T17:25:02.432 INFO:teuthology.orchestra.run.smithi016.stderr: 91950K .......... .......... .......... .......... .......... 99% 363M 0s 2024-09-12T17:25:02.432 INFO:teuthology.orchestra.run.smithi016.stderr: 92000K .......... .......... .......... .......... .......... 99% 285M 0s 2024-09-12T17:25:02.432 INFO:teuthology.orchestra.run.smithi016.stderr: 92050K .......... .......... .......... .......... .......... 99% 159M 0s 2024-09-12T17:25:02.433 INFO:teuthology.orchestra.run.smithi016.stderr: 92100K .......... .......... .......... .......... .......... 99% 199M 0s 2024-09-12T17:25:02.433 INFO:teuthology.orchestra.run.smithi016.stderr: 92150K .......... .......... .......... .......... .......... 99% 367M 0s 2024-09-12T17:25:02.433 INFO:teuthology.orchestra.run.smithi016.stderr: 92200K .......... .......... .......... .......... .......... 99% 325M 0s 2024-09-12T17:25:02.433 INFO:teuthology.orchestra.run.smithi016.stderr: 92250K .......... .......... .......... .......... .......... 99% 121M 0s 2024-09-12T17:25:02.433 INFO:teuthology.orchestra.run.smithi016.stderr: 92300K .......... .......... .......... .......... .......... 99% 344M 0s 2024-09-12T17:25:02.433 INFO:teuthology.orchestra.run.smithi016.stderr: 92350K .......... .......... .......... .......... .......... 99% 242M 0s 2024-09-12T17:25:02.433 INFO:teuthology.orchestra.run.smithi016.stderr: 92400K .......... .......... .......... .......... .......... 99% 339M 0s 2024-09-12T17:25:02.433 INFO:teuthology.orchestra.run.smithi016.stderr: 92450K .......... .......... .......... .......... .......... 99% 280M 0s 2024-09-12T17:25:02.433 INFO:teuthology.orchestra.run.smithi016.stderr: 92500K .......... .......... .......... .......... .......... 99% 192M 0s 2024-09-12T17:25:02.433 INFO:teuthology.orchestra.run.smithi016.stderr: 92550K .......... .......... .......... .......... .......... 99% 225M 0s 2024-09-12T17:25:02.433 INFO:teuthology.orchestra.run.smithi016.stderr: 92600K .......... .......... .......... .......... .......... 99% 359M 0s 2024-09-12T17:25:02.433 INFO:teuthology.orchestra.run.smithi016.stderr: 92650K .......... .......... .......... .......... .......... 99% 261M 0s 2024-09-12T17:25:02.433 INFO:teuthology.orchestra.run.smithi016.stderr: 92700K .......... .......... .......... .......... .......... 99% 156M 0s 2024-09-12T17:25:02.434 INFO:teuthology.orchestra.run.smithi016.stderr: 92750K .......... .......... .......... .......... .......... 99% 290M 0s 2024-09-12T17:25:02.434 INFO:teuthology.orchestra.run.smithi016.stderr: 92800K .......... .......... .......... .......... .......... 99% 364M 0s 2024-09-12T17:25:02.434 INFO:teuthology.orchestra.run.smithi016.stderr: 92850K .......... .......... .......... .......... .......... 99% 392M 0s 2024-09-12T17:25:02.434 INFO:teuthology.orchestra.run.smithi016.stderr: 92900K 100% 134G=0.7s 2024-09-12T17:25:02.434 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-09-12T17:25:02.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12 17:25:01 (127 MB/s) - 'gradle-6.0.1-bin.zip' saved [95129672/95129672] 2024-09-12T17:25:02.434 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-09-12T17:25:02.461 INFO:teuthology.orchestra.run.smithi016.stdout:Archive: gradle-6.0.1-bin.zip 2024-09-12T17:25:02.461 INFO:teuthology.orchestra.run.smithi016.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-09-12T17:25:02.462 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-09-12T17:25:02.462 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-09-12T17:25:02.462 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-09-12T17:25:02.462 INFO:teuthology.orchestra.run.smithi016.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-09-12T17:25:02.462 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-09-12T17:25:02.462 INFO:teuthology.orchestra.run.smithi016.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-09-12T17:25:02.462 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-09-12T17:25:02.462 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-09-12T17:25:02.462 INFO:teuthology.orchestra.run.smithi016.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-09-12T17:25:02.462 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-09-12T17:25:02.462 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-09-12T17:25:02.462 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-09-12T17:25:02.462 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-09-12T17:25:02.463 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-09-12T17:25:02.463 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-09-12T17:25:02.463 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-09-12T17:25:02.463 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-09-12T17:25:02.463 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-09-12T17:25:02.463 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-09-12T17:25:02.463 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-09-12T17:25:02.463 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-09-12T17:25:02.463 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-09-12T17:25:02.463 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-09-12T17:25:02.463 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-09-12T17:25:02.463 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-09-12T17:25:02.463 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-09-12T17:25:02.464 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-09-12T17:25:02.464 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-09-12T17:25:02.464 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-09-12T17:25:02.464 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-09-12T17:25:02.464 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-09-12T17:25:02.464 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-09-12T17:25:02.464 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-09-12T17:25:02.464 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-09-12T17:25:02.464 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-09-12T17:25:02.464 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-09-12T17:25:02.464 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-09-12T17:25:02.464 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-09-12T17:25:02.464 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-09-12T17:25:02.465 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-09-12T17:25:02.465 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-09-12T17:25:02.465 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-09-12T17:25:02.465 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-09-12T17:25:02.465 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-09-12T17:25:02.465 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-09-12T17:25:02.465 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-09-12T17:25:02.465 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-09-12T17:25:02.465 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-09-12T17:25:02.465 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-09-12T17:25:02.465 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-09-12T17:25:02.465 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-09-12T17:25:02.465 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-09-12T17:25:02.466 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-09-12T17:25:02.466 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-09-12T17:25:02.466 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-09-12T17:25:02.466 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-09-12T17:25:02.466 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-09-12T17:25:02.466 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-09-12T17:25:02.466 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-09-12T17:25:02.466 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-09-12T17:25:02.466 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-09-12T17:25:02.466 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-09-12T17:25:02.466 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-09-12T17:25:02.466 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-09-12T17:25:02.466 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-09-12T17:25:02.466 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-09-12T17:25:02.466 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-09-12T17:25:02.467 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-09-12T17:25:02.467 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-09-12T17:25:02.467 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-09-12T17:25:02.467 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-09-12T17:25:02.467 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-09-12T17:25:02.467 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-09-12T17:25:02.467 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-09-12T17:25:02.467 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-09-12T17:25:02.467 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-09-12T17:25:02.467 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-09-12T17:25:02.467 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-09-12T17:25:02.467 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-09-12T17:25:02.467 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-09-12T17:25:02.467 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-09-12T17:25:02.467 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-09-12T17:25:02.468 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-09-12T17:25:02.468 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-09-12T17:25:02.468 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-09-12T17:25:02.468 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-09-12T17:25:02.468 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-09-12T17:25:02.468 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-09-12T17:25:02.468 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-09-12T17:25:02.468 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-09-12T17:25:02.468 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-09-12T17:25:02.468 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-09-12T17:25:02.468 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-09-12T17:25:02.468 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-09-12T17:25:02.468 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-09-12T17:25:02.469 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-09-12T17:25:02.469 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-09-12T17:25:02.469 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-09-12T17:25:02.469 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-09-12T17:25:02.469 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-09-12T17:25:02.469 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-09-12T17:25:02.469 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-09-12T17:25:02.469 INFO:teuthology.orchestra.run.smithi016.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-09-12T17:25:02.469 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-09-12T17:25:02.469 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-09-12T17:25:02.469 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-09-12T17:25:02.469 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-09-12T17:25:02.469 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-09-12T17:25:02.470 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-09-12T17:25:02.470 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-09-12T17:25:02.470 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-09-12T17:25:02.470 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-09-12T17:25:02.470 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-09-12T17:25:02.470 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-09-12T17:25:02.470 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-09-12T17:25:02.470 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-09-12T17:25:02.470 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-09-12T17:25:02.470 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-09-12T17:25:02.470 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-09-12T17:25:02.470 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-09-12T17:25:02.470 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-09-12T17:25:02.471 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-09-12T17:25:02.471 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-09-12T17:25:02.471 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-09-12T17:25:02.471 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-09-12T17:25:02.471 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-09-12T17:25:02.471 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-09-12T17:25:02.471 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-09-12T17:25:02.471 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-09-12T17:25:02.471 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-09-12T17:25:02.471 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-09-12T17:25:02.471 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-09-12T17:25:02.471 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-09-12T17:25:02.471 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-09-12T17:25:02.472 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-09-12T17:25:02.472 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-09-12T17:25:02.472 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-09-12T17:25:02.472 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-09-12T17:25:02.472 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-09-12T17:25:02.472 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-09-12T17:25:02.472 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-09-12T17:25:02.472 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-09-12T17:25:02.472 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-09-12T17:25:02.472 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-09-12T17:25:02.472 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-09-12T17:25:02.472 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-09-12T17:25:02.472 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-09-12T17:25:02.473 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-09-12T17:25:02.473 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-09-12T17:25:02.473 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-09-12T17:25:02.473 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-09-12T17:25:02.473 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-09-12T17:25:02.473 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-09-12T17:25:02.473 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-09-12T17:25:02.473 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-09-12T17:25:02.473 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-09-12T17:25:02.473 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-09-12T17:25:02.473 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-09-12T17:25:02.473 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-09-12T17:25:02.473 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-09-12T17:25:02.474 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-09-12T17:25:02.474 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-09-12T17:25:02.474 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-09-12T17:25:02.474 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-09-12T17:25:02.474 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-09-12T17:25:02.474 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-09-12T17:25:02.474 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-09-12T17:25:02.474 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-09-12T17:25:02.474 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-09-12T17:25:02.474 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-09-12T17:25:02.474 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-09-12T17:25:02.474 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-09-12T17:25:02.474 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-09-12T17:25:02.475 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-09-12T17:25:02.475 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-09-12T17:25:02.475 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-09-12T17:25:02.475 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-09-12T17:25:02.475 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-09-12T17:25:02.475 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-09-12T17:25:02.475 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-09-12T17:25:02.475 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-09-12T17:25:02.475 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-09-12T17:25:02.476 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-09-12T17:25:02.476 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-09-12T17:25:02.476 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-09-12T17:25:02.476 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-09-12T17:25:02.481 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-09-12T17:25:02.483 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-09-12T17:25:02.490 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-09-12T17:25:02.490 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-09-12T17:25:02.499 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-09-12T17:25:02.501 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-09-12T17:25:02.502 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-09-12T17:25:02.506 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-09-12T17:25:02.512 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-09-12T17:25:02.542 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-09-12T17:25:02.544 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-09-12T17:25:02.544 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-09-12T17:25:02.545 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-09-12T17:25:02.546 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-09-12T17:25:02.546 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-09-12T17:25:02.547 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-09-12T17:25:02.547 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-09-12T17:25:02.549 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-09-12T17:25:02.550 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-09-12T17:25:02.551 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-09-12T17:25:02.551 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-09-12T17:25:02.552 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-09-12T17:25:02.553 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-09-12T17:25:02.553 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-09-12T17:25:02.554 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-09-12T17:25:02.554 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-09-12T17:25:02.555 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-09-12T17:25:02.555 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-09-12T17:25:02.555 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-09-12T17:25:02.555 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-09-12T17:25:02.555 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-09-12T17:25:02.556 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-09-12T17:25:02.557 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-09-12T17:25:02.558 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-09-12T17:25:02.562 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-09-12T17:25:02.563 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-09-12T17:25:02.564 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-09-12T17:25:02.564 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-09-12T17:25:02.564 INFO:teuthology.orchestra.run.smithi016.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-09-12T17:25:02.598 INFO:teuthology.orchestra.run.smithi016.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2024-09-12T17:25:03.040 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:25:03.040 INFO:teuthology.orchestra.run.smithi016.stdout:Welcome to Gradle 6.0.1! 2024-09-12T17:25:03.040 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:25:03.040 INFO:teuthology.orchestra.run.smithi016.stdout:Here are the highlights of this release: 2024-09-12T17:25:03.040 INFO:teuthology.orchestra.run.smithi016.stdout: - Substantial improvements in dependency management, including 2024-09-12T17:25:03.040 INFO:teuthology.orchestra.run.smithi016.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-09-12T17:25:03.041 INFO:teuthology.orchestra.run.smithi016.stdout: - Advanced control of transitive versions 2024-09-12T17:25:03.041 INFO:teuthology.orchestra.run.smithi016.stdout: - Support for optional features and dependencies 2024-09-12T17:25:03.041 INFO:teuthology.orchestra.run.smithi016.stdout: - Rules to tweak published metadata 2024-09-12T17:25:03.041 INFO:teuthology.orchestra.run.smithi016.stdout: - Support for Java 13 2024-09-12T17:25:03.041 INFO:teuthology.orchestra.run.smithi016.stdout: - Faster incremental Java and Groovy compilation 2024-09-12T17:25:03.041 INFO:teuthology.orchestra.run.smithi016.stdout: - New Zinc compiler for Scala 2024-09-12T17:25:03.041 INFO:teuthology.orchestra.run.smithi016.stdout: - VS2019 support 2024-09-12T17:25:03.041 INFO:teuthology.orchestra.run.smithi016.stdout: - Support for Gradle Enterprise plugin 3.0 2024-09-12T17:25:03.041 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:25:03.041 INFO:teuthology.orchestra.run.smithi016.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-09-12T17:25:03.041 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:25:03.041 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:25:03.041 INFO:teuthology.orchestra.run.smithi016.stdout:------------------------------------------------------------ 2024-09-12T17:25:03.042 INFO:teuthology.orchestra.run.smithi016.stdout:Gradle 6.0.1 2024-09-12T17:25:03.042 INFO:teuthology.orchestra.run.smithi016.stdout:------------------------------------------------------------ 2024-09-12T17:25:03.042 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:25:03.042 INFO:teuthology.orchestra.run.smithi016.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-09-12T17:25:03.042 INFO:teuthology.orchestra.run.smithi016.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-09-12T17:25:03.042 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:25:03.042 INFO:teuthology.orchestra.run.smithi016.stdout:Kotlin: 1.3.50 2024-09-12T17:25:03.042 INFO:teuthology.orchestra.run.smithi016.stdout:Groovy: 2.5.8 2024-09-12T17:25:03.042 INFO:teuthology.orchestra.run.smithi016.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-09-12T17:25:03.042 INFO:teuthology.orchestra.run.smithi016.stdout:JVM: 11.0.17 (Ubuntu 11.0.17+8-post-Ubuntu-1ubuntu222.04) 2024-09-12T17:25:03.042 INFO:teuthology.orchestra.run.smithi016.stdout:OS: Linux 5.15.0-119-generic amd64 2024-09-12T17:25:03.042 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:25:03.048 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-09-12T17:25:03.048 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T17:25:03.048 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi016.front.sepia.ceph.com 2024-09-12T17:25:03.048 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T17:25:03.048 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T17:25:03.048 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-09-12T17:25:03.248 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-09-12T17:25:03.248 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-09-12T17:25:03.249 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'VFZWMWFJNIWLYWEBUCBF', 'access_secret': '+V/v+c1r//lBP/YwjK5wTMopb9/oK14EbSvoqgrGErS3/swA8rZrJg==', 'region': 'mexico', 'endpoint': 'smithi016.front.sepia.ceph.com:80', 'port': 80, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': False, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi016.front.sepia.ceph.com'} 2024-09-12T17:25:03.249 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-09-12T17:25:03.249 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'VFZWMWFJNIWLYWEBUCBF', '--secret', '+V/v+c1r//lBP/YwjK5wTMopb9/oK14EbSvoqgrGErS3/swA8rZrJg==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-09-12T17:25:03.249 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key VFZWMWFJNIWLYWEBUCBF --secret +V/v+c1r//lBP/YwjK5wTMopb9/oK14EbSvoqgrGErS3/swA8rZrJg== --email tester.client.0_test@test.test --cluster ceph 2024-09-12T17:25:03.294 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:25:03.294 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:25:03.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.337+0000 7fdb802399c0 20 rados->read ofs=0 len=0 2024-09-12T17:25:03.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.337+0000 7fdb802399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:03.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.337+0000 7fdb802399c0 20 realm 2024-09-12T17:25:03.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.337+0000 7fdb802399c0 20 rados->read ofs=0 len=0 2024-09-12T17:25:03.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.337+0000 7fdb802399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:03.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.337+0000 7fdb802399c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:25:03.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.337+0000 7fdb802399c0 20 rados->read ofs=0 len=0 2024-09-12T17:25:03.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.337+0000 7fdb802399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:03.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.337+0000 7fdb802399c0 20 rados->read ofs=0 len=0 2024-09-12T17:25:03.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.341+0000 7fdb802399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:03.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.341+0000 7fdb802399c0 20 rados->read ofs=0 len=0 2024-09-12T17:25:03.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.341+0000 7fdb802399c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:25:03.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.341+0000 7fdb802399c0 20 searching for the correct realm 2024-09-12T17:25:03.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.345+0000 7fdb7e540640 0 -- 172.21.15.16:0/3017346998 >> [v2:172.21.15.19:6800/1509147557,v1:172.21.15.19:6801/1509147557] conn(0x560b7c175f20 msgr2=0x560b7c178330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:03.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.353+0000 7fdb7553e640 0 -- 172.21.15.16:0/3017346998 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fdb78050910 msgr2=0x7fdb780363c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:25:03.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.569+0000 7fdb802399c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:25:03.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.569+0000 7fdb802399c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:25:03.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.569+0000 7fdb802399c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:25:03.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.569+0000 7fdb802399c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:25:03.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.569+0000 7fdb802399c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:25:03.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.569+0000 7fdb802399c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:25:03.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.569+0000 7fdb802399c0 20 rados->read ofs=0 len=0 2024-09-12T17:25:03.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.569+0000 7fdb802399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:03.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.569+0000 7fdb802399c0 20 rados->read ofs=0 len=0 2024-09-12T17:25:03.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.569+0000 7fdb802399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:03.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.569+0000 7fdb802399c0 20 rados->read ofs=0 len=0 2024-09-12T17:25:03.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.573+0000 7fdb802399c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:25:03.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.573+0000 7fdb802399c0 20 zone default found 2024-09-12T17:25:03.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.573+0000 7fdb802399c0 4 Realm: () 2024-09-12T17:25:03.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.573+0000 7fdb802399c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:25:03.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.573+0000 7fdb802399c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:25:03.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.573+0000 7fdb802399c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:25:03.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.573+0000 7fdb802399c0 20 zonegroup default 2024-09-12T17:25:03.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.573+0000 7fdb802399c0 20 rados->read ofs=0 len=0 2024-09-12T17:25:03.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.573+0000 7fdb802399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:03.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.573+0000 7fdb802399c0 20 rados->read ofs=0 len=0 2024-09-12T17:25:03.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.573+0000 7fdb802399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:03.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.573+0000 7fdb802399c0 20 rados->read ofs=0 len=0 2024-09-12T17:25:03.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.573+0000 7fdb802399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:03.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.573+0000 7fdb802399c0 20 started sync module instance, tier type = 2024-09-12T17:25:03.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.573+0000 7fdb802399c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:25:03.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.605+0000 7fdb802399c0 20 add_watcher() i=0 2024-09-12T17:25:03.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.605+0000 7fdb802399c0 20 add_watcher() i=1 2024-09-12T17:25:03.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.605+0000 7fdb802399c0 20 add_watcher() i=2 2024-09-12T17:25:03.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.605+0000 7fdb802399c0 20 add_watcher() i=3 2024-09-12T17:25:03.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.605+0000 7fdb802399c0 20 add_watcher() i=4 2024-09-12T17:25:03.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.605+0000 7fdb802399c0 20 add_watcher() i=5 2024-09-12T17:25:03.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.605+0000 7fdb802399c0 20 add_watcher() i=6 2024-09-12T17:25:03.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.609+0000 7fdb802399c0 20 add_watcher() i=7 2024-09-12T17:25:03.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.609+0000 7fdb802399c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:25:03.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.613+0000 7fda33fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:03.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.613+0000 7fdb802399c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:25:03.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.613+0000 7fdb802399c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:25:03.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.613+0000 7fdb802399c0 5 note: GC not initialized 2024-09-12T17:25:03.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.613+0000 7fda32fe5640 20 reqs_thread_entry: start 2024-09-12T17:25:03.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.613+0000 7fdb802399c0 20 init_complete bucket index max shards: 1 2024-09-12T17:25:03.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.613+0000 7fdb802399c0 20 Filter name: none 2024-09-12T17:25:03.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.613+0000 7fda30fe1640 20 reqs_thread_entry: start 2024-09-12T17:25:03.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.613+0000 7fdb802399c0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T17:25:03.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.613+0000 7fdb802399c0 20 rados->read ofs=0 len=0 2024-09-12T17:25:03.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.617+0000 7fdb802399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:03.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.617+0000 7fdb802399c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-09-12T17:25:03.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.617+0000 7fdb802399c0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T17:25:03.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.617+0000 7fdb802399c0 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-09-12T17:25:03.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.617+0000 7fdb802399c0 20 rados->read ofs=0 len=0 2024-09-12T17:25:03.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.617+0000 7fdb802399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:03.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.617+0000 7fdb802399c0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-09-12T17:25:03.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.617+0000 7fdb802399c0 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T17:25:03.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.617+0000 7fdb802399c0 10 cache get: name=default.rgw.meta+users.keys+VFZWMWFJNIWLYWEBUCBF : miss 2024-09-12T17:25:03.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.617+0000 7fdb802399c0 20 rados->read ofs=0 len=0 2024-09-12T17:25:03.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.617+0000 7fdb802399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:03.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.617+0000 7fdb802399c0 10 cache put: name=default.rgw.meta+users.keys+VFZWMWFJNIWLYWEBUCBF info.flags=0x0 2024-09-12T17:25:03.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.617+0000 7fdb802399c0 10 adding default.rgw.meta+users.keys+VFZWMWFJNIWLYWEBUCBF to cache LRU end 2024-09-12T17:25:03.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.617+0000 7fdb802399c0 10 cache get: name=default.rgw.meta+users.keys+VFZWMWFJNIWLYWEBUCBF : hit (negative entry) 2024-09-12T17:25:03.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.617+0000 7fdb802399c0 10 cache get: name=default.rgw.meta+users.keys+VFZWMWFJNIWLYWEBUCBF : hit (negative entry) 2024-09-12T17:25:03.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.621+0000 7fdb802399c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T17:25:03.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.621+0000 7fdb802399c0 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T17:25:03.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.621+0000 7fdb802399c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T17:25:03.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.621+0000 7fda617fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431590 cookie 94607326582800 notifier 8724 bl.length()=670 2024-09-12T17:25:03.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.621+0000 7fda617fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T17:25:03.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.621+0000 7fda617fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T17:25:03.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.625+0000 7fdb802399c0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T17:25:03.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.625+0000 7fdb802399c0 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T17:25:03.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.625+0000 7fdb802399c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T17:25:03.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.625+0000 7fda617fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431611 cookie 94607326573056 notifier 8724 bl.length()=200 2024-09-12T17:25:03.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.625+0000 7fda617fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T17:25:03.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.625+0000 7fda617fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T17:25:03.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.629+0000 7fdb802399c0 10 cache put: name=default.rgw.meta+users.keys+VFZWMWFJNIWLYWEBUCBF info.flags=0x7 2024-09-12T17:25:03.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.629+0000 7fdb802399c0 10 moving default.rgw.meta+users.keys+VFZWMWFJNIWLYWEBUCBF to cache LRU end 2024-09-12T17:25:03.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.629+0000 7fdb802399c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:VFZWMWFJNIWLYWEBUCBF, ofs0, ns] 2024-09-12T17:25:03.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.629+0000 7fda617fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431612 cookie 94607326573056 notifier 8724 bl.length()=189 2024-09-12T17:25:03.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.629+0000 7fda617fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+VFZWMWFJNIWLYWEBUCBF info.flags=0x7 2024-09-12T17:25:03.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.629+0000 7fda617fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+VFZWMWFJNIWLYWEBUCBF to cache LRU end 2024-09-12T17:25:03.630 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-12T17:25:03.630 INFO:teuthology.orchestra.run.smithi016.stdout: "user_id": "tester.client.0", 2024-09-12T17:25:03.630 INFO:teuthology.orchestra.run.smithi016.stdout: "display_name": "Ms. tester.client.0", 2024-09-12T17:25:03.630 INFO:teuthology.orchestra.run.smithi016.stdout: "email": "tester.client.0_test@test.test", 2024-09-12T17:25:03.631 INFO:teuthology.orchestra.run.smithi016.stdout: "suspended": 0, 2024-09-12T17:25:03.631 INFO:teuthology.orchestra.run.smithi016.stdout: "max_buckets": 1000, 2024-09-12T17:25:03.631 INFO:teuthology.orchestra.run.smithi016.stdout: "subusers": [], 2024-09-12T17:25:03.631 INFO:teuthology.orchestra.run.smithi016.stdout: "keys": [ 2024-09-12T17:25:03.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-12T17:25:03.631 INFO:teuthology.orchestra.run.smithi016.stdout: "user": "tester.client.0", 2024-09-12T17:25:03.631 INFO:teuthology.orchestra.run.smithi016.stdout: "access_key": "VFZWMWFJNIWLYWEBUCBF", 2024-09-12T17:25:03.631 INFO:teuthology.orchestra.run.smithi016.stdout: "secret_key": "+V/v+c1r//lBP/YwjK5wTMopb9/oK14EbSvoqgrGErS3/swA8rZrJg==", 2024-09-12T17:25:03.631 INFO:teuthology.orchestra.run.smithi016.stdout: "active": true, 2024-09-12T17:25:03.631 INFO:teuthology.orchestra.run.smithi016.stdout: "create_date": "2024-09-12T17:25:03.620734Z" 2024-09-12T17:25:03.631 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-12T17:25:03.631 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-12T17:25:03.631 INFO:teuthology.orchestra.run.smithi016.stdout: "swift_keys": [], 2024-09-12T17:25:03.632 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": [], 2024-09-12T17:25:03.632 INFO:teuthology.orchestra.run.smithi016.stdout: "op_mask": "read, write, delete", 2024-09-12T17:25:03.632 INFO:teuthology.orchestra.run.smithi016.stdout: "default_placement": "", 2024-09-12T17:25:03.632 INFO:teuthology.orchestra.run.smithi016.stdout: "default_storage_class": "", 2024-09-12T17:25:03.632 INFO:teuthology.orchestra.run.smithi016.stdout: "placement_tags": [], 2024-09-12T17:25:03.632 INFO:teuthology.orchestra.run.smithi016.stdout: "bucket_quota": { 2024-09-12T17:25:03.632 INFO:teuthology.orchestra.run.smithi016.stdout: "enabled": false, 2024-09-12T17:25:03.632 INFO:teuthology.orchestra.run.smithi016.stdout: "check_on_raw": false, 2024-09-12T17:25:03.632 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size": -1, 2024-09-12T17:25:03.632 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size_kb": 0, 2024-09-12T17:25:03.632 INFO:teuthology.orchestra.run.smithi016.stdout: "max_objects": -1 2024-09-12T17:25:03.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-12T17:25:03.632 INFO:teuthology.orchestra.run.smithi016.stdout: "user_quota": { 2024-09-12T17:25:03.633 INFO:teuthology.orchestra.run.smithi016.stdout: "enabled": false, 2024-09-12T17:25:03.633 INFO:teuthology.orchestra.run.smithi016.stdout: "check_on_raw": false, 2024-09-12T17:25:03.633 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size": -1, 2024-09-12T17:25:03.633 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size_kb": 0, 2024-09-12T17:25:03.633 INFO:teuthology.orchestra.run.smithi016.stdout: "max_objects": -1 2024-09-12T17:25:03.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-12T17:25:03.633 INFO:teuthology.orchestra.run.smithi016.stdout: "temp_url_keys": [], 2024-09-12T17:25:03.633 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "rgw", 2024-09-12T17:25:03.633 INFO:teuthology.orchestra.run.smithi016.stdout: "mfa_ids": [], 2024-09-12T17:25:03.633 INFO:teuthology.orchestra.run.smithi016.stdout: "account_id": "", 2024-09-12T17:25:03.633 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-12T17:25:03.633 INFO:teuthology.orchestra.run.smithi016.stdout: "create_date": "2024-09-12T17:25:03.620687Z", 2024-09-12T17:25:03.633 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-12T17:25:03.633 INFO:teuthology.orchestra.run.smithi016.stdout: "group_ids": [] 2024-09-12T17:25:03.634 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-12T17:25:03.634 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:25:03.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.629+0000 7fda33fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:03.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.637+0000 7fdb802399c0 20 remove_watcher() i=0 2024-09-12T17:25:03.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.637+0000 7fdb802399c0 2 removed watcher, disabling cache 2024-09-12T17:25:03.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.641+0000 7fdb802399c0 20 remove_watcher() i=1 2024-09-12T17:25:03.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.641+0000 7fdb802399c0 20 remove_watcher() i=2 2024-09-12T17:25:03.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.645+0000 7fdb802399c0 20 remove_watcher() i=3 2024-09-12T17:25:03.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.645+0000 7fdb802399c0 20 remove_watcher() i=4 2024-09-12T17:25:03.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.649+0000 7fdb802399c0 20 remove_watcher() i=5 2024-09-12T17:25:03.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.649+0000 7fdb802399c0 20 remove_watcher() i=6 2024-09-12T17:25:03.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.653+0000 7fdb802399c0 20 remove_watcher() i=7 2024-09-12T17:25:03.669 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-12T17:25:03.669 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-09-12T17:25:03.719 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-09-12T17:25:03.720 DEBUG:teuthology.orchestra.run.smithi016:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-09-12T17:25:03.770 DEBUG:teuthology.orchestra.run.smithi016:> radosgw-admin gc process --include-all 2024-09-12T17:25:03.839 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:25:03.839 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:25:03.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.885+0000 7f4c3e9129c0 20 rados->read ofs=0 len=0 2024-09-12T17:25:03.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.889+0000 7f4c3e9129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:03.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.889+0000 7f4c3e9129c0 20 realm 2024-09-12T17:25:03.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.889+0000 7f4c3e9129c0 20 rados->read ofs=0 len=0 2024-09-12T17:25:03.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.889+0000 7f4c3e9129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:03.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.889+0000 7f4c3e9129c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:25:03.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.889+0000 7f4c3e9129c0 20 rados->read ofs=0 len=0 2024-09-12T17:25:03.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.889+0000 7f4c3e9129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:03.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.889+0000 7f4c3e9129c0 20 rados->read ofs=0 len=0 2024-09-12T17:25:03.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.889+0000 7f4c3e9129c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:03.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.889+0000 7f4c3e9129c0 20 rados->read ofs=0 len=0 2024-09-12T17:25:03.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.893+0000 7f4c3e9129c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:25:03.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.893+0000 7f4c3e9129c0 20 searching for the correct realm 2024-09-12T17:25:03.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.897+0000 7f4c3cc19640 0 -- 172.21.15.16:0/1701269250 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f4c300c1070 msgr2=0x7f4c30106a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:03.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:03.901+0000 7f4c3bc17640 0 -- 172.21.15.16:0/1701269250 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f4c3400a040 msgr2=0x7f4c3409a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:04.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.121+0000 7f4c3e9129c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:25:04.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.121+0000 7f4c3e9129c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:25:04.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.121+0000 7f4c3e9129c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:25:04.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.121+0000 7f4c3e9129c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:25:04.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.121+0000 7f4c3e9129c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:25:04.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.121+0000 7f4c3e9129c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:25:04.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.121+0000 7f4c3e9129c0 20 rados->read ofs=0 len=0 2024-09-12T17:25:04.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.121+0000 7f4c3e9129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:04.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.121+0000 7f4c3e9129c0 20 rados->read ofs=0 len=0 2024-09-12T17:25:04.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.125+0000 7f4c3e9129c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:04.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.125+0000 7f4c3e9129c0 20 rados->read ofs=0 len=0 2024-09-12T17:25:04.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.125+0000 7f4c3e9129c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:25:04.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.125+0000 7f4c3e9129c0 20 zone default found 2024-09-12T17:25:04.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.125+0000 7f4c3e9129c0 4 Realm: () 2024-09-12T17:25:04.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.125+0000 7f4c3e9129c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:25:04.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.125+0000 7f4c3e9129c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:25:04.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.125+0000 7f4c3e9129c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:25:04.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.125+0000 7f4c3e9129c0 20 zonegroup default 2024-09-12T17:25:04.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.125+0000 7f4c3e9129c0 20 rados->read ofs=0 len=0 2024-09-12T17:25:04.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.125+0000 7f4c3e9129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:04.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.125+0000 7f4c3e9129c0 20 rados->read ofs=0 len=0 2024-09-12T17:25:04.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.125+0000 7f4c3e9129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:04.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.125+0000 7f4c3e9129c0 20 rados->read ofs=0 len=0 2024-09-12T17:25:04.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.125+0000 7f4c3e9129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:04.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.125+0000 7f4c3e9129c0 20 started sync module instance, tier type = 2024-09-12T17:25:04.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.125+0000 7f4c3e9129c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:25:04.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.149+0000 7f4c3e9129c0 20 add_watcher() i=0 2024-09-12T17:25:04.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.149+0000 7f4c3e9129c0 20 add_watcher() i=1 2024-09-12T17:25:04.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.149+0000 7f4c3e9129c0 20 add_watcher() i=2 2024-09-12T17:25:04.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.149+0000 7f4c3e9129c0 20 add_watcher() i=3 2024-09-12T17:25:04.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.149+0000 7f4c3e9129c0 20 add_watcher() i=4 2024-09-12T17:25:04.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.149+0000 7f4c3e9129c0 20 add_watcher() i=5 2024-09-12T17:25:04.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.153+0000 7f4c3e9129c0 20 add_watcher() i=6 2024-09-12T17:25:04.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.153+0000 7f4c3e9129c0 20 add_watcher() i=7 2024-09-12T17:25:04.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.153+0000 7f4c3e9129c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:25:04.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.157+0000 7f4af37de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:04.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.157+0000 7f4c3e9129c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:25:04.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.157+0000 7f4c3e9129c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:25:04.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.253+0000 7f4af27dc640 20 reqs_thread_entry: start 2024-09-12T17:25:04.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.253+0000 7f4c3e9129c0 20 init_complete bucket index max shards: 1 2024-09-12T17:25:04.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.253+0000 7f4c3e9129c0 20 Filter name: none 2024-09-12T17:25:04.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.253+0000 7f4aeb7fe640 20 reqs_thread_entry: start 2024-09-12T17:25:04.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.253+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:25:04.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.257+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:04.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.257+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:04.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.257+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T17:25:04.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.257+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3204554331829301028', time=2024-09-12T19:15:53.668723+0000, chain.objs.size()=5 2024-09-12T17:25:04.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.257+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14__multipart_foo-FROZEN.2~_4B2ZHpxBIc-2ah6OFy6pGDPZFpBqnE.1 2024-09-12T17:25:04.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.257+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14__shadow_foo-FROZEN.2~_4B2ZHpxBIc-2ah6OFy6pGDPZFpBqnE.1_1 2024-09-12T17:25:04.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.257+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14__multipart_foo-FROZEN.2~_4B2ZHpxBIc-2ah6OFy6pGDPZFpBqnE.2 2024-09-12T17:25:04.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.257+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14__shadow_foo-FROZEN.2~_4B2ZHpxBIc-2ah6OFy6pGDPZFpBqnE.2_1 2024-09-12T17:25:04.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.257+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14__multipart_foo-FROZEN.2~_4B2ZHpxBIc-2ah6OFy6pGDPZFpBqnE.3 2024-09-12T17:25:04.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.257+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7912709036309557461', time=2024-09-12T19:15:53.931396+0000, chain.objs.size()=1 2024-09-12T17:25:04.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.257+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8__shadow_.xbD-3FHWR1LY-ELRZN4xRYulW4L-BLw_0 2024-09-12T17:25:04.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.257+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4576652185665165243', time=2024-09-12T19:17:54.742953+0000, chain.objs.size()=1 2024-09-12T17:25:04.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.257+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22__shadow_.NpJlxZEusVi2dW3vqkbZwILditTXNok_0 2024-09-12T17:25:04.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.257+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10633009068349200358', time=2024-09-12T19:18:33.433019+0000, chain.objs.size()=1 2024-09-12T17:25:04.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.257+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25__shadow_.fb9ptHNqILORs4juBKDecc8Xm9Km2f8_0 2024-09-12T17:25:04.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.257+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14189398142624608746', time=2024-09-12T19:19:11.763288+0000, chain.objs.size()=1 2024-09-12T17:25:04.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.257+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28__shadow_.cWSdp0TMNQCI9NGqriZIQL9FNjzNldY_0 2024-09-12T17:25:04.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.257+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9058832716816423279', time=2024-09-12T19:19:44.762264+0000, chain.objs.size()=1 2024-09-12T17:25:04.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.257+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29__shadow_.VcP3WyKtNRxDhhIVYpyaSOknH92S901_0 2024-09-12T17:25:04.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.257+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11437881204325564842', time=2024-09-12T19:19:44.783690+0000, chain.objs.size()=1 2024-09-12T17:25:04.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.257+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29__shadow_.f4_wSK9vA-cAtNcZb2nyI-o3zWfxNkK_0 2024-09-12T17:25:04.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.257+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11433738890701521052', time=2024-09-12T19:19:47.183352+0000, chain.objs.size()=1 2024-09-12T17:25:04.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.257+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30__shadow_.cCFilOGdBgw18Y_siAqutZp0gCPZiW0_0 2024-09-12T17:25:04.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.265+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4722575350413080203', time=2024-09-12T19:19:47.189016+0000, chain.objs.size()=1 2024-09-12T17:25:04.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.265+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30__shadow_.RmoGXJcf4HwzfB1T-cOHlcRGKopuatI_0 2024-09-12T17:25:04.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.265+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5120071430766396155', time=2024-09-12T19:20:58.904889+0000, chain.objs.size()=1 2024-09-12T17:25:04.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.265+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34__shadow_.O5o9IoqtQu7qPqcpvxDV2GstuF-qZXk_0 2024-09-12T17:25:04.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.265+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14941240142931398408', time=2024-09-12T19:21:00.839889+0000, chain.objs.size()=1 2024-09-12T17:25:04.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.265+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35__shadow_.NI4Bt_TNqFw50X5mcrKzmy4xzxcR34l_0 2024-09-12T17:25:04.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.265+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17854408298777002864', time=2024-09-12T19:21:38.721119+0000, chain.objs.size()=1 2024-09-12T17:25:04.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.265+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37__shadow_.aSWpGzfGNfimyXNjy_tybsbu1MWWHt6_0 2024-09-12T17:25:04.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.265+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17021780284236518307', time=2024-09-12T19:22:14.398749+0000, chain.objs.size()=1 2024-09-12T17:25:04.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.265+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39__shadow_.F8Z19nSi4m94NLDrSe0rMVHCbKKz0r4_0 2024-09-12T17:25:04.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.269+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:25:04.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.273+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:25:04.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.277+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:04.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.277+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:04.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.277+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T17:25:04.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.277+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14820083171041765646', time=2024-09-12T19:15:53.273205+0000, chain.objs.size()=7 2024-09-12T17:25:04.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.277+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10__multipart_foo.2~Zl9iCHbLxZkDMl19wv0gwN3yUOpjNg-.1 2024-09-12T17:25:04.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.277+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10__shadow_foo.2~Zl9iCHbLxZkDMl19wv0gwN3yUOpjNg-.1_1 2024-09-12T17:25:04.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.277+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10__multipart_foo.2~Zl9iCHbLxZkDMl19wv0gwN3yUOpjNg-.2 2024-09-12T17:25:04.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.277+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10__shadow_foo.2~Zl9iCHbLxZkDMl19wv0gwN3yUOpjNg-.2_1 2024-09-12T17:25:04.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.277+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10__multipart_foo.2~Zl9iCHbLxZkDMl19wv0gwN3yUOpjNg-.3 2024-09-12T17:25:04.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.277+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10__shadow_foo.2~Zl9iCHbLxZkDMl19wv0gwN3yUOpjNg-.3_1 2024-09-12T17:25:04.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.277+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10__multipart_foo.2~Zl9iCHbLxZkDMl19wv0gwN3yUOpjNg-.4 2024-09-12T17:25:04.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.277+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8610589648112763892', time=2024-09-12T19:15:53.627572+0000, chain.objs.size()=3 2024-09-12T17:25:04.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.277+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__multipart_foo-STANDARD.2~PePFprsWFGn9I7tkYsRwqWOKGV5h6gp.1 2024-09-12T17:25:04.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.277+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__multipart_foo-STANDARD.2~PePFprsWFGn9I7tkYsRwqWOKGV5h6gp.2 2024-09-12T17:25:04.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.277+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__multipart_foo-STANDARD.2~PePFprsWFGn9I7tkYsRwqWOKGV5h6gp.3 2024-09-12T17:25:04.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.277+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17261983413312887982', time=2024-09-12T19:17:18.443574+0000, chain.objs.size()=1 2024-09-12T17:25:04.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.277+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20__shadow_.Heg6W1y_iyi1B8UxEmOO30fPwRg_a-b_0 2024-09-12T17:25:04.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.277+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3328671781271110413', time=2024-09-12T19:17:54.735695+0000, chain.objs.size()=1 2024-09-12T17:25:04.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.277+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22__shadow_._qTrDpUhXMkDaoEtfb_wueG4gbYSODU_0 2024-09-12T17:25:04.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.285+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2476093113855950196', time=2024-09-12T19:18:30.802659+0000, chain.objs.size()=1 2024-09-12T17:25:04.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.285+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24__shadow_.26wcR_h_bbRyt1QoyEm9_RNJ5NHA0TJ_0 2024-09-12T17:25:04.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.285+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8597223631062490640', time=2024-09-12T19:18:34.986641+0000, chain.objs.size()=1 2024-09-12T17:25:04.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.285+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26__shadow_.4s6xUgIDIOfLID_qdfvGW13JhQZHWZB_0 2024-09-12T17:25:04.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.285+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2183032108711359447', time=2024-09-12T19:18:35.003121+0000, chain.objs.size()=1 2024-09-12T17:25:04.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.285+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26__shadow_.zcAVE1l8qVwJPIxM6LIOxJ_4OxypKhx_0 2024-09-12T17:25:04.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.285+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5008676158411529739', time=2024-09-12T19:19:44.766679+0000, chain.objs.size()=1 2024-09-12T17:25:04.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.285+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29__shadow_.vcfBt-3kOnM7eJpL4hByP9HdTVvIGoG_0 2024-09-12T17:25:04.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.285+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14850974574214987278', time=2024-09-12T19:19:48.924905+0000, chain.objs.size()=1 2024-09-12T17:25:04.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.285+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31__shadow_.HE7Zcr2VkQgpnkEoaNZrQ8CuCrGX4gv_0 2024-09-12T17:25:04.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.285+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9536202649848486500', time=2024-09-12T19:20:22.069926+0000, chain.objs.size()=1 2024-09-12T17:25:04.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.285+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32__shadow_.amfJm5B7Ni6yUzEe3IZFehoi3nYW10r_0 2024-09-12T17:25:04.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.285+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3746423335008418557', time=2024-09-12T19:20:22.080338+0000, chain.objs.size()=1 2024-09-12T17:25:04.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.285+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32__shadow_.usrHpcn7mSM9dtAFbFIyx6vQvUsBQms_0 2024-09-12T17:25:04.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.285+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7685095547034656148', time=2024-09-12T19:20:25.195678+0000, chain.objs.size()=1 2024-09-12T17:25:04.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.285+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33__shadow_.JfEhS_7oT_9iETwnz57JLJ7JsxLJig0_0 2024-09-12T17:25:04.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.285+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13655200921604253050', time=2024-09-12T19:20:27.116814+0000, chain.objs.size()=1 2024-09-12T17:25:04.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.285+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34__shadow_.d-J01umq8hpM3sXLefda7tY_NDwXkFa_0 2024-09-12T17:25:04.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.285+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18311572855315624670', time=2024-09-12T19:21:35.864390+0000, chain.objs.size()=1 2024-09-12T17:25:04.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.285+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36__shadow_.plvETSd6B-yQZBYAo2zuOCP1hUZvFIG_0 2024-09-12T17:25:04.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.285+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18161841639684209889', time=2024-09-12T19:21:38.719429+0000, chain.objs.size()=1 2024-09-12T17:25:04.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.285+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37__shadow_.khG9MrLtmg4gG8ABI2lT9Bpv7nZGEu5_0 2024-09-12T17:25:04.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.289+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11210009828163764118', time=2024-09-12T19:21:38.724570+0000, chain.objs.size()=1 2024-09-12T17:25:04.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.289+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37__shadow_.gJdZ34zn1J1klb2sV2M9RFCZ4okHS5Y_0 2024-09-12T17:25:04.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.289+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5366262534141256300', time=2024-09-12T19:21:43.032459+0000, chain.objs.size()=1 2024-09-12T17:25:04.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.289+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39__shadow_.mQ6a1PXtxKgsX1OwWjLWcxN1K24Z5Am_0 2024-09-12T17:25:04.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.293+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:25:04.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.297+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:25:04.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.297+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:04.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.301+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:04.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.301+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T17:25:04.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.301+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5551827395456209444', time=2024-09-12T19:15:53.727649+0000, chain.objs.size()=3 2024-09-12T17:25:04.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.301+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13__shadow_.V2i3dAZNr2eten9trRV6XOH7EhXEDWK_0 2024-09-12T17:25:04.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.301+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13__shadow_.V2i3dAZNr2eten9trRV6XOH7EhXEDWK_1 2024-09-12T17:25:04.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.301+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13__shadow_.V2i3dAZNr2eten9trRV6XOH7EhXEDWK_2 2024-09-12T17:25:04.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.301+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17897114684650717209', time=2024-09-12T19:17:56.714216+0000, chain.objs.size()=1 2024-09-12T17:25:04.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.301+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23__shadow_.25x1eDV3jICZUq05tfySdtt8njQD0ni_0 2024-09-12T17:25:04.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.301+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12376784686930610073', time=2024-09-12T19:18:30.809710+0000, chain.objs.size()=1 2024-09-12T17:25:04.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.301+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24__shadow_.KBjjJFTshg48eYv2T6VB8zJeCVErY4H_0 2024-09-12T17:25:04.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.301+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15230479168504534371', time=2024-09-12T19:18:34.996211+0000, chain.objs.size()=1 2024-09-12T17:25:04.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.301+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26__shadow_.xPdUSfykeX7M2arVKN_0ZzJhaxS48QO_0 2024-09-12T17:25:04.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.301+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14666940820593094480', time=2024-09-12T19:19:47.214279+0000, chain.objs.size()=1 2024-09-12T17:25:04.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.301+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30__shadow_.7diNOm3q37c6ptgy3mQIkdc2wFuv9Uj_0 2024-09-12T17:25:04.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.301+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17473759196268462650', time=2024-09-12T19:20:22.074362+0000, chain.objs.size()=1 2024-09-12T17:25:04.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.301+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32__shadow_.6CVaUaW5-wDTjgBVzqfJPNoMMP11G9j_0 2024-09-12T17:25:04.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.301+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3367814372962849156', time=2024-09-12T19:20:58.886145+0000, chain.objs.size()=1 2024-09-12T17:25:04.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.301+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34__shadow_.nU4Y4pl5r4JFAzjtZCCZHREvPHrfPM4_0 2024-09-12T17:25:04.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.301+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5670744311770667105', time=2024-09-12T19:21:01.976947+0000, chain.objs.size()=1 2024-09-12T17:25:04.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.301+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35__shadow_.9TfGaCvTdRLKZx_2x22dbOQNYSQzqYY_0 2024-09-12T17:25:04.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.301+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5323777194784170151', time=2024-09-12T19:21:35.878146+0000, chain.objs.size()=1 2024-09-12T17:25:04.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.301+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36__shadow_.UKewiWSJ_VneeSr-fWyFLm6IS9Le--e_0 2024-09-12T17:25:04.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.301+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14540968201344849337', time=2024-09-12T19:21:40.881599+0000, chain.objs.size()=1 2024-09-12T17:25:04.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.301+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38__shadow_.QNDgCAWPZV2Z1gikIEXPvWkz2_f6olH_0 2024-09-12T17:25:04.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.305+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9106137893305505612', time=2024-09-12T19:21:40.917304+0000, chain.objs.size()=1 2024-09-12T17:25:04.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.305+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38__shadow_.6lgrQxvVWO64b-PdLvV31U6OaqTZZoU_0 2024-09-12T17:25:04.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.305+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8391125147809838226', time=2024-09-12T19:24:25.410651+0000, chain.objs.size()=1 2024-09-12T17:25:04.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.305+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17__shadow_.lLT2XPBAXYgDwLqy0ekxAOICdISHDGx_0 2024-09-12T17:25:04.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.305+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14758224222919277620', time=2024-09-12T19:24:25.413908+0000, chain.objs.size()=1 2024-09-12T17:25:04.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.305+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17__shadow_.Eq5wn0oL7V-nd0faWfcGj9UX66EP9fg_0 2024-09-12T17:25:04.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.309+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:25:04.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.313+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:25:04.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.313+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:04.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.313+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:04.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.317+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T17:25:04.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.317+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13449270531802092370', time=2024-09-12T19:15:53.121833+0000, chain.objs.size()=1 2024-09-12T17:25:04.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.317+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4__shadow_.n-VYIk04vBoMynIoYJB4cqu1zIS32hP_0 2024-09-12T17:25:04.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.317+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16491159834743392499', time=2024-09-12T19:15:53.598141+0000, chain.objs.size()=3 2024-09-12T17:25:04.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.317+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__multipart_foo-STANDARD.2~PePFprsWFGn9I7tkYsRwqWOKGV5h6gp.1 2024-09-12T17:25:04.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.317+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__multipart_foo-STANDARD.2~PePFprsWFGn9I7tkYsRwqWOKGV5h6gp.2 2024-09-12T17:25:04.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.317+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__multipart_foo-STANDARD.2~PePFprsWFGn9I7tkYsRwqWOKGV5h6gp.3 2024-09-12T17:25:04.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.317+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17364181503872102680', time=2024-09-12T19:15:53.963264+0000, chain.objs.size()=1 2024-09-12T17:25:04.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.317+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8__shadow_.dpQpDj2yFYAsmpMgKhuWEiEt7VNxbaL_0 2024-09-12T17:25:04.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.317+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14802649912688284578', time=2024-09-12T19:17:54.732509+0000, chain.objs.size()=1 2024-09-12T17:25:04.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.317+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22__shadow_.Iv2IG2yzYueycT6m8R1acr_8PBNh3dV_0 2024-09-12T17:25:04.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.317+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10683673732269644426', time=2024-09-12T19:17:56.744754+0000, chain.objs.size()=1 2024-09-12T17:25:04.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.317+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23__shadow_.6XLrPLCQQvTro0wg2B0aLtdN52dJrpA_0 2024-09-12T17:25:04.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.317+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12317545251270840889', time=2024-09-12T19:18:33.437330+0000, chain.objs.size()=1 2024-09-12T17:25:04.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.317+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25__shadow_.tllcy9lCczC5vWimwtgfuZxR1zhgQeH_0 2024-09-12T17:25:04.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.317+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14633182940257541747', time=2024-09-12T19:18:34.992294+0000, chain.objs.size()=1 2024-09-12T17:25:04.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.317+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26__shadow_.eGruO_qd3Vrbgb1oIbNAtfpDtT3Y9GI_0 2024-09-12T17:25:04.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.317+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13853410400879788616', time=2024-09-12T19:18:35.003857+0000, chain.objs.size()=1 2024-09-12T17:25:04.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.317+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26__shadow_._TVQt3ofE2bwh0nTVIxj4i9LZLyAz2__0 2024-09-12T17:25:04.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.317+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11018447584350835911', time=2024-09-12T19:18:35.005452+0000, chain.objs.size()=1 2024-09-12T17:25:04.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.317+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26__shadow_.6_OgSN7AffbbSWX4fYuB1Q1-1ORk3Bh_0 2024-09-12T17:25:04.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.317+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15212011807077849365', time=2024-09-12T19:19:08.306688+0000, chain.objs.size()=1 2024-09-12T17:25:04.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.317+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27__shadow_.iBYuB5Y_Gtv59deLRnmOXaTV549jhZX_0 2024-09-12T17:25:04.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.321+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.223969460181000725', time=2024-09-12T19:19:08.311231+0000, chain.objs.size()=1 2024-09-12T17:25:04.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.321+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27__shadow_.CandB3QhPWRJM1x8k07ix-Ae7v2AkdS_0 2024-09-12T17:25:04.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.321+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6848243296022846757', time=2024-09-12T19:19:47.198037+0000, chain.objs.size()=1 2024-09-12T17:25:04.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.321+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30__shadow_.X6pFt2djZQvAhq98ZbAnbLK_SsSIeju_0 2024-09-12T17:25:04.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.321+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9984813267549694549', time=2024-09-12T19:19:47.198875+0000, chain.objs.size()=1 2024-09-12T17:25:04.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.321+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30__shadow_.yopokT7LktzwhD0DjFYzqB9xbd2GKzV_0 2024-09-12T17:25:04.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.321+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10973055345430375036', time=2024-09-12T19:20:20.927364+0000, chain.objs.size()=1 2024-09-12T17:25:04.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.321+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32__shadow_.s9Rx90QMTXy9c-fMqlrkeIMmJaeR-_D_0 2024-09-12T17:25:04.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.321+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10288454519944252095', time=2024-09-12T19:20:22.058513+0000, chain.objs.size()=1 2024-09-12T17:25:04.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.321+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32__shadow_.EZ69wN-S1lkhlxQJCYUpsSqgrd797RU_0 2024-09-12T17:25:04.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.321+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8268738796335809330', time=2024-09-12T19:20:58.894732+0000, chain.objs.size()=1 2024-09-12T17:25:04.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.321+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34__shadow_.FMAUhY6Irt7e-bVqvVYuAh_QNrSH3zk_0 2024-09-12T17:25:04.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.321+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11312271420311374026', time=2024-09-12T19:21:01.964554+0000, chain.objs.size()=1 2024-09-12T17:25:04.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.321+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35__shadow_.4pLWjpBfQ7cLu8s1i3qy-KrMbvU7QKR_0 2024-09-12T17:25:04.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.321+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13173717320456705413', time=2024-09-12T19:21:35.853911+0000, chain.objs.size()=1 2024-09-12T17:25:04.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.321+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36__shadow_.E1j_oTOnlsBCKwZhG7-9ftZU4hXO1mp_0 2024-09-12T17:25:04.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.321+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5881845270626358800', time=2024-09-12T19:22:14.398245+0000, chain.objs.size()=1 2024-09-12T17:25:04.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.321+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39__shadow_.v6Q1CYnNkO5VgfTr-mGn-SGGl8sY6pO_0 2024-09-12T17:25:04.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.325+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:25:04.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.333+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:25:04.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.333+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:04.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.333+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:04.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.337+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T17:25:04.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.337+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='_PQtLRKIMAmoMUzlzAsSt6NnHQC_zBhO', time=2024-09-12T19:15:53.386412+0000, chain.objs.size()=2 2024-09-12T17:25:04.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.337+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15__shadow_.OJNTCvTd-ZdkKEyIaNXftj6dP5iE8g8_0 2024-09-12T17:25:04.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.337+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15__shadow_.OJNTCvTd-ZdkKEyIaNXftj6dP5iE8g8_1 2024-09-12T17:25:04.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.337+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='_kRDl7Q0Bp-PDXsTLI2r3ODXX-24q12h', time=2024-09-12T19:15:53.416726+0000, chain.objs.size()=2 2024-09-12T17:25:04.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.337+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15__shadow_.3X0mwqfIVqQqrVNtvfB4qZCVwW2blka_0 2024-09-12T17:25:04.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.337+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15__shadow_.3X0mwqfIVqQqrVNtvfB4qZCVwW2blka_1 2024-09-12T17:25:04.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.337+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6932524109543963270', time=2024-09-12T19:17:16.464970+0000, chain.objs.size()=1 2024-09-12T17:25:04.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.337+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19__shadow_.oqkDof-0_00eatkpsBlQ4y_qaTppAjQ_0 2024-09-12T17:25:04.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.337+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11975140552684522656', time=2024-09-12T19:17:51.894985+0000, chain.objs.size()=1 2024-09-12T17:25:04.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.337+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21__shadow_.r44mGkI4NgkFW-WkwOA4GJ8Bv5eI6fX_0 2024-09-12T17:25:04.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.337+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13251339003510205401', time=2024-09-12T19:17:54.728464+0000, chain.objs.size()=1 2024-09-12T17:25:04.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.337+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22__shadow_.27krx1p5R2S9BjW6_-VtoVb2S1lFn0L_0 2024-09-12T17:25:04.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.337+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7076403581863124542', time=2024-09-12T19:17:54.749653+0000, chain.objs.size()=1 2024-09-12T17:25:04.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.337+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22__shadow_.59veHcM8oc7zCT5RP7Dpx1qcCsg82GC_0 2024-09-12T17:25:04.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.337+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13706953659579302658', time=2024-09-12T19:17:56.703127+0000, chain.objs.size()=1 2024-09-12T17:25:04.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.337+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23__shadow_.bwpeB3Ra40wRJlZx9cu4v1NuJF8Qh7a_0 2024-09-12T17:25:04.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.337+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7140611743008813659', time=2024-09-12T19:18:30.804833+0000, chain.objs.size()=1 2024-09-12T17:25:04.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.337+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24__shadow_.5oYqLy71Mollh7EMsNE0x8w2WmoMRDS_0 2024-09-12T17:25:04.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.337+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9321228089805450805', time=2024-09-12T19:18:30.824051+0000, chain.objs.size()=1 2024-09-12T17:25:04.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.337+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24__shadow_.YfMVHsXI0Ow_tYv9RvmN2zrygWkpBjB_0 2024-09-12T17:25:04.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.337+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14653473359916405608', time=2024-09-12T19:19:11.763318+0000, chain.objs.size()=1 2024-09-12T17:25:04.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.337+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28__shadow_._QYO1US20W0kLYTVXF0wtQdTWUxHdqy_0 2024-09-12T17:25:04.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.337+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2331549559234171857', time=2024-09-12T19:19:11.764943+0000, chain.objs.size()=1 2024-09-12T17:25:04.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.337+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28__shadow_.K0DjlRDYSrYhE1fPGz-JY-Lzrg51vpJ_0 2024-09-12T17:25:04.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.337+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5087697947335456167', time=2024-09-12T19:19:44.781942+0000, chain.objs.size()=1 2024-09-12T17:25:04.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.337+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29__shadow_.Ew14iqzvqo3QPOop-GO6I3VcNslVKPJ_0 2024-09-12T17:25:04.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.345+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18241848186415931221', time=2024-09-12T19:19:47.203870+0000, chain.objs.size()=1 2024-09-12T17:25:04.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.345+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30__shadow_.RMe5YeyQPSiBkp4zFfF0g50lukJe6I0_0 2024-09-12T17:25:04.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.345+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16827797545417852580', time=2024-09-12T19:19:48.920297+0000, chain.objs.size()=1 2024-09-12T17:25:04.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.345+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31__shadow_.1KSP0WJ2e71_dJpKoNQbc-Iuwci70Gb_0 2024-09-12T17:25:04.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.345+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1218591046790296707', time=2024-09-12T19:19:48.928581+0000, chain.objs.size()=1 2024-09-12T17:25:04.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.345+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31__shadow_.MsGYcY3Vvf4AZigT2x3aA7U1GlisBIW_0 2024-09-12T17:25:04.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.345+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6734714965155409124', time=2024-09-12T19:20:25.203042+0000, chain.objs.size()=1 2024-09-12T17:25:04.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.345+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33__shadow_.iMsj_8AzzSpYFi8uK-0hBEvi3lzzg3p_0 2024-09-12T17:25:04.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.345+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4861693550085099054', time=2024-09-12T19:21:38.721572+0000, chain.objs.size()=1 2024-09-12T17:25:04.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.345+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37__shadow_.swZS7FL35NgW2_pQ4_XHYhZyVV9OLrV_0 2024-09-12T17:25:04.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.345+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7527427781766111904', time=2024-09-12T19:21:40.893908+0000, chain.objs.size()=1 2024-09-12T17:25:04.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.345+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38__shadow_.xPjyDreWc2IGkZpc_6QbHxZWjFiGnhw_0 2024-09-12T17:25:04.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.345+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4487086998451528239', time=2024-09-12T19:24:25.415928+0000, chain.objs.size()=1 2024-09-12T17:25:04.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.345+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17__shadow_.EyUOp7FFrXQpmoviCLnl_w7VkjZlYnY_0 2024-09-12T17:25:04.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.349+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:25:04.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.353+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:25:04.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.357+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:04.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.357+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:04.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.361+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T17:25:04.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.361+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13521043063576385620', time=2024-09-12T19:17:51.898578+0000, chain.objs.size()=1 2024-09-12T17:25:04.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.361+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21__shadow_.WClbFom847tVJ7gI5-BLtqUZ0kS-eg1_0 2024-09-12T17:25:04.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.361+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13800202797920244714', time=2024-09-12T19:17:54.756017+0000, chain.objs.size()=1 2024-09-12T17:25:04.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.361+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22__shadow_.SRd456JUd2ywwIIplrnJoCoqfiPWiaI_0 2024-09-12T17:25:04.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.361+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15167803283292168838', time=2024-09-12T19:17:56.740168+0000, chain.objs.size()=1 2024-09-12T17:25:04.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.361+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23__shadow_.Reb56DJPZsiPMNWgxpugzkfeYQ7wM4l_0 2024-09-12T17:25:04.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.361+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16124724034851421646', time=2024-09-12T19:19:44.781497+0000, chain.objs.size()=1 2024-09-12T17:25:04.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.361+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29__shadow_.PEr-pt0L-5mBuRL89qZiVlp1Xwk3URO_0 2024-09-12T17:25:04.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.361+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9623467071649142093', time=2024-09-12T19:20:22.080133+0000, chain.objs.size()=1 2024-09-12T17:25:04.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.361+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32__shadow_.H3swvJY9Q13t1JH-P8HCM7qXAHJtuqJ_0 2024-09-12T17:25:04.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.361+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2700748543664184964', time=2024-09-12T19:20:25.184616+0000, chain.objs.size()=1 2024-09-12T17:25:04.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.361+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33__shadow_.Kx6SpF6F_iVIKQd0Od6iaqW_0nUxQgj_0 2024-09-12T17:25:04.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.361+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2712818572108511381', time=2024-09-12T19:20:25.186700+0000, chain.objs.size()=1 2024-09-12T17:25:04.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.361+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33__shadow_.9ntWCy0en8P7nR1N4FyTNZep5Uc9EHe_0 2024-09-12T17:25:04.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.361+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14977973786727352218', time=2024-09-12T19:20:58.892172+0000, chain.objs.size()=1 2024-09-12T17:25:04.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.361+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34__shadow_.6sQJIdUNZ8yqI-zSgn2g50trsFzGHwR_0 2024-09-12T17:25:04.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.361+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15449655991794259804', time=2024-09-12T19:21:38.712568+0000, chain.objs.size()=1 2024-09-12T17:25:04.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.361+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37__shadow_.pd9nnV3kQt7PwDtMcUWVdwACMN7xjvL_0 2024-09-12T17:25:04.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.361+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2068906656752929740', time=2024-09-12T19:21:40.890862+0000, chain.objs.size()=1 2024-09-12T17:25:04.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.361+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38__shadow_.I7N0NrwoRnFOLfySXzZSUbS3mj96LgH_0 2024-09-12T17:25:04.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.365+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:25:04.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.373+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:25:04.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.373+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:04.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.377+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:04.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.377+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T17:25:04.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.377+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.227293945502479013', time=2024-09-12T19:15:53.523173+0000, chain.objs.size()=5 2024-09-12T17:25:04.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.377+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__multipart_foo-FROZEN.2~fuvyDC5qsq_81fDJByuyHxTIMW1uFCs.1 2024-09-12T17:25:04.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.377+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__shadow_foo-FROZEN.2~fuvyDC5qsq_81fDJByuyHxTIMW1uFCs.1_1 2024-09-12T17:25:04.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.377+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__multipart_foo-FROZEN.2~fuvyDC5qsq_81fDJByuyHxTIMW1uFCs.2 2024-09-12T17:25:04.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.377+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__shadow_foo-FROZEN.2~fuvyDC5qsq_81fDJByuyHxTIMW1uFCs.2_1 2024-09-12T17:25:04.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.377+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__multipart_foo-FROZEN.2~fuvyDC5qsq_81fDJByuyHxTIMW1uFCs.3 2024-09-12T17:25:04.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.377+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12129352938183977356', time=2024-09-12T19:15:53.941991+0000, chain.objs.size()=1 2024-09-12T17:25:04.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.377+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8__shadow_.xvLW7x_ji3fEjnsUmChvQuKmi4DisZd_0 2024-09-12T17:25:04.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.377+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16301497441631341974', time=2024-09-12T19:17:16.478712+0000, chain.objs.size()=1 2024-09-12T17:25:04.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.377+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19__shadow_.G7VZnH4_4hRLlIqnUNal3dPaW0K2xOp_0 2024-09-12T17:25:04.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.377+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1120557464272290748', time=2024-09-12T19:17:54.717542+0000, chain.objs.size()=1 2024-09-12T17:25:04.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.377+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22__shadow_.1HvdoX1SaOs_k5najOAd_hYUsP0kApP_0 2024-09-12T17:25:04.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.377+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10275935090522594115', time=2024-09-12T19:17:54.726805+0000, chain.objs.size()=1 2024-09-12T17:25:04.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.377+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22__shadow_.BpleF8axW9TWa51XJyAAAEeZg09k1nt_0 2024-09-12T17:25:04.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.377+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6290902260754072582', time=2024-09-12T19:18:30.801318+0000, chain.objs.size()=1 2024-09-12T17:25:04.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.377+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24__shadow_.QpXSXmozBrK-R7vAIjIqB1sJESFxiyd_0 2024-09-12T17:25:04.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.377+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8654768598669706156', time=2024-09-12T19:18:30.835689+0000, chain.objs.size()=1 2024-09-12T17:25:04.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.377+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24__shadow_.4ICu40U0lf8nCFw-hVQFbjKC5G5jB3c_0 2024-09-12T17:25:04.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.377+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15662407744985758894', time=2024-09-12T19:18:35.024688+0000, chain.objs.size()=1 2024-09-12T17:25:04.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.377+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26__shadow_.WOklzWSQ3mZ09FTB4SoYcRzMxnE_ss1_0 2024-09-12T17:25:04.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.381+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17715073068414186121', time=2024-09-12T19:19:44.766743+0000, chain.objs.size()=1 2024-09-12T17:25:04.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.381+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29__shadow_.SGWiBHJLI8rT9XeRqglWcGXh8B3zQdO_0 2024-09-12T17:25:04.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.381+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11992212695951812250', time=2024-09-12T19:19:44.771697+0000, chain.objs.size()=1 2024-09-12T17:25:04.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.381+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29__shadow_.dV5si5y40TElQUjRcejEDhj_xScRrNx_0 2024-09-12T17:25:04.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.381+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2922684617271122755', time=2024-09-12T19:20:22.062405+0000, chain.objs.size()=1 2024-09-12T17:25:04.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.381+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32__shadow_.xfR2C5CT1jcfSa35-nDqdbvg0NvV_JA_0 2024-09-12T17:25:04.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.381+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2227244257477821444', time=2024-09-12T19:21:38.714458+0000, chain.objs.size()=1 2024-09-12T17:25:04.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.381+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37__shadow_.ub38Oz0ie-CBd0x9SiZAsy3zEQJZjQO_0 2024-09-12T17:25:04.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.381+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8838289610788406156', time=2024-09-12T19:21:40.882228+0000, chain.objs.size()=1 2024-09-12T17:25:04.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.381+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38__shadow_.u017NSuymkCnODt0_JY-jmVpTcpG_5y_0 2024-09-12T17:25:04.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.381+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15407275933646881980', time=2024-09-12T19:21:40.895468+0000, chain.objs.size()=1 2024-09-12T17:25:04.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.381+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38__shadow_.1EI1QdzN1MmjxPD0NrPDgN14RU-7W5q_0 2024-09-12T17:25:04.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.381+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12262012203823143313', time=2024-09-12T19:22:14.386309+0000, chain.objs.size()=1 2024-09-12T17:25:04.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.381+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39__shadow_.o2u1BT7nuoAMhTtpxc52_YhysSX6OAW_0 2024-09-12T17:25:04.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.381+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5310438708689687553', time=2024-09-12T19:22:14.400234+0000, chain.objs.size()=1 2024-09-12T17:25:04.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.381+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39__shadow_.DXKDBpeFVH5YrgwwIhGAQjo0E5LTxGh_0 2024-09-12T17:25:04.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.385+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:25:04.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.389+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:25:04.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.393+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:04.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.397+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:04.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.397+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T17:25:04.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.397+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='_nJha90E2jK_xb9VeTVx439whAGmPa4w', time=2024-09-12T19:15:53.563816+0000, chain.objs.size()=3 2024-09-12T17:25:04.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.397+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__shadow_.eizR4ixH16WDRcWq4Ax-uNa7EGwRF9R_0 2024-09-12T17:25:04.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.397+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__shadow_.eizR4ixH16WDRcWq4Ax-uNa7EGwRF9R_1 2024-09-12T17:25:04.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.397+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__shadow_.eizR4ixH16WDRcWq4Ax-uNa7EGwRF9R_2 2024-09-12T17:25:04.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.397+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13936637674301101088', time=2024-09-12T19:15:53.950131+0000, chain.objs.size()=1 2024-09-12T17:25:04.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.397+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8__shadow_.uBOXcBRohTBfuo-xQEaohyEbjnKg3Kd_0 2024-09-12T17:25:04.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.397+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6397503465982378814', time=2024-09-12T19:17:16.464089+0000, chain.objs.size()=1 2024-09-12T17:25:04.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.397+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19__shadow_.kQwOoOrdcqbragDoJE4dNJtqoEuoCa-_0 2024-09-12T17:25:04.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.397+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6118996900343834641', time=2024-09-12T19:17:18.421191+0000, chain.objs.size()=1 2024-09-12T17:25:04.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.397+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20__shadow_.1YXpBoDNYmGXVUitEkjucoad-XSHIgw_0 2024-09-12T17:25:04.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.397+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16150991227446413129', time=2024-09-12T19:17:51.888547+0000, chain.objs.size()=1 2024-09-12T17:25:04.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.397+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21__shadow_.UuqkOoMUvP9GcfBYqXqYS18svoWdbTo_0 2024-09-12T17:25:04.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.397+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10635468388015627665', time=2024-09-12T19:17:51.890920+0000, chain.objs.size()=1 2024-09-12T17:25:04.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.397+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21__shadow_.CKpe2GYCjp5OS7fTTmhiXUv1vbNHHAr_0 2024-09-12T17:25:04.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.397+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9831522881304779475', time=2024-09-12T19:17:51.893361+0000, chain.objs.size()=1 2024-09-12T17:25:04.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.397+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21__shadow_.E6OE1Uq0c6S_ANiXKJBD5PkQSWDp_N9_0 2024-09-12T17:25:04.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.397+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4455121374749156982', time=2024-09-12T19:18:30.801018+0000, chain.objs.size()=1 2024-09-12T17:25:04.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.397+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24__shadow_.wB9UG2SaGZvnj6wyiIB4tL3_gJw1sFh_0 2024-09-12T17:25:04.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.397+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2450594058550559054', time=2024-09-12T19:18:33.446556+0000, chain.objs.size()=1 2024-09-12T17:25:04.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.397+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25__shadow_.2ITdOjqPko2KCQq9VuVatlY2IRZEeu-_0 2024-09-12T17:25:04.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.397+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1784984150806595225', time=2024-09-12T19:18:35.002040+0000, chain.objs.size()=1 2024-09-12T17:25:04.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.397+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26__shadow_.9GHArTNElPHwhrj-aRt52lQIK2gKWa1_0 2024-09-12T17:25:04.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.405+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4581717782749019553', time=2024-09-12T19:19:11.772476+0000, chain.objs.size()=1 2024-09-12T17:25:04.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.405+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28__shadow_.GcMIkSlYepzNbocgDSdgRn8H5JF7dun_0 2024-09-12T17:25:04.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.405+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14644525309648340032', time=2024-09-12T19:19:13.465656+0000, chain.objs.size()=1 2024-09-12T17:25:04.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.405+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29__shadow_.VeXRLkxsDhRrgtvhMFTG71JhX169LVV_0 2024-09-12T17:25:04.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.405+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4021364467922141489', time=2024-09-12T19:19:44.766126+0000, chain.objs.size()=1 2024-09-12T17:25:04.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.405+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29__shadow_.CUPsIH9PJMbZnaoJMVC-F8S_bJkl1m3_0 2024-09-12T17:25:04.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.405+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8529109767892669273', time=2024-09-12T19:19:48.938397+0000, chain.objs.size()=1 2024-09-12T17:25:04.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.405+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31__shadow_.c4xUBYkjYyFMhc0kMgevLfU8t_1ytlE_0 2024-09-12T17:25:04.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.405+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12182615837132668748', time=2024-09-12T19:20:25.191522+0000, chain.objs.size()=1 2024-09-12T17:25:04.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.405+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33__shadow_.XREg32qaVvCyPBJH_As_mWR8h58ytyO_0 2024-09-12T17:25:04.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.405+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15755431909031744217', time=2024-09-12T19:20:58.874175+0000, chain.objs.size()=1 2024-09-12T17:25:04.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.405+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34__shadow_.q6AW2BXe_lGQuFeDamVk-P-cNneIb1V_0 2024-09-12T17:25:04.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.405+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8563083411893752628', time=2024-09-12T19:20:58.881356+0000, chain.objs.size()=1 2024-09-12T17:25:04.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.405+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34__shadow_.PZGmF4b5_TOOxlhKhzCFZ7d_G4uBwP7_0 2024-09-12T17:25:04.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.405+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14205847139242916359', time=2024-09-12T19:21:40.896105+0000, chain.objs.size()=1 2024-09-12T17:25:04.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.405+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38__shadow_.JgQZcp647qW_X3910W06zjKx7NDNdFt_0 2024-09-12T17:25:04.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.413+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:25:04.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.417+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:25:04.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.421+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:04.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.421+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:04.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.421+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T17:25:04.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.421+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1924398050553506717', time=2024-09-12T19:15:53.511599+0000, chain.objs.size()=5 2024-09-12T17:25:04.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.421+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__multipart_foo-FROZEN.2~fuvyDC5qsq_81fDJByuyHxTIMW1uFCs.1 2024-09-12T17:25:04.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.421+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__shadow_foo-FROZEN.2~fuvyDC5qsq_81fDJByuyHxTIMW1uFCs.1_1 2024-09-12T17:25:04.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.421+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__multipart_foo-FROZEN.2~fuvyDC5qsq_81fDJByuyHxTIMW1uFCs.2 2024-09-12T17:25:04.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.421+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__shadow_foo-FROZEN.2~fuvyDC5qsq_81fDJByuyHxTIMW1uFCs.2_1 2024-09-12T17:25:04.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.421+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__multipart_foo-FROZEN.2~fuvyDC5qsq_81fDJByuyHxTIMW1uFCs.3 2024-09-12T17:25:04.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.421+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3535519989144428728', time=2024-09-12T19:17:16.466521+0000, chain.objs.size()=1 2024-09-12T17:25:04.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.421+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19__shadow_.puVXSEM9_wqb9WLnI1y02igQDLwLI2s_0 2024-09-12T17:25:04.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.421+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15533555583182426598', time=2024-09-12T19:17:16.471727+0000, chain.objs.size()=1 2024-09-12T17:25:04.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.421+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19__shadow_.OlC8t71y57UL4MRy_cb8QBHi65AHSoC_0 2024-09-12T17:25:04.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.421+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12822995964653043105', time=2024-09-12T19:17:18.451895+0000, chain.objs.size()=1 2024-09-12T17:25:04.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.421+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20__shadow_.SD6yotO6Ed3KwkMGonF6biURysOunK2_0 2024-09-12T17:25:04.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.421+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8895794467382177344', time=2024-09-12T19:18:30.836795+0000, chain.objs.size()=1 2024-09-12T17:25:04.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.421+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24__shadow_.iV8Lo3ex_EcLn6KrNC3aMWYQCC5uweZ_0 2024-09-12T17:25:04.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.421+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16658121576095523336', time=2024-09-12T19:18:35.009352+0000, chain.objs.size()=1 2024-09-12T17:25:04.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.421+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26__shadow_.4Di_PYCw_NOscSwG1FNo6QYig60AEL__0 2024-09-12T17:25:04.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.421+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4732155420802016362', time=2024-09-12T19:19:11.764606+0000, chain.objs.size()=1 2024-09-12T17:25:04.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.421+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28__shadow_.u-xlX3TAG-3puwlGnHQM4VuzPKPYwUD_0 2024-09-12T17:25:04.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.421+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3311963877703171408', time=2024-09-12T19:20:25.200117+0000, chain.objs.size()=1 2024-09-12T17:25:04.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.421+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33__shadow_.R-0VvWuGIi90DG5evB0gWURjUOgQ5xH_0 2024-09-12T17:25:04.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.425+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1260789110716750528', time=2024-09-12T19:20:25.207248+0000, chain.objs.size()=1 2024-09-12T17:25:04.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.425+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33__shadow_.n7uEHpr9vzAopg690DOIRTUIT6gF_ZV_0 2024-09-12T17:25:04.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.425+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5527500516765631069', time=2024-09-12T19:21:35.883594+0000, chain.objs.size()=1 2024-09-12T17:25:04.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.425+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36__shadow_.-DKONC2yg9haUX3CDNBaH_6IfGmQtZQ_0 2024-09-12T17:25:04.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.429+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3959461465975360621', time=2024-09-12T19:21:37.806617+0000, chain.objs.size()=1 2024-09-12T17:25:04.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.429+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37__shadow_.cWNpd2nMfxVIRBYbHAvwog6BRV8qW8r_0 2024-09-12T17:25:04.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.429+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9468768369639568760', time=2024-09-12T19:22:14.390644+0000, chain.objs.size()=1 2024-09-12T17:25:04.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.429+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39__shadow_.x6ZofKXEMfg0LeUoczd06CvBihQ5jdo_0 2024-09-12T17:25:04.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.429+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14622299463796094091', time=2024-09-12T19:22:14.400208+0000, chain.objs.size()=1 2024-09-12T17:25:04.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.429+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39__shadow_.C3o_HxZvyCG3COBoGDbeLQDDrw6IgZA_0 2024-09-12T17:25:04.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.429+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9929971824770419688', time=2024-09-12T19:24:25.410572+0000, chain.objs.size()=1 2024-09-12T17:25:04.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.429+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17__shadow_.d6a0F-oGQZOTUYzWrPsmdGxQ1H38KJ__0 2024-09-12T17:25:04.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.433+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:25:04.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.437+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:25:04.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.441+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:04.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.441+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:04.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.441+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T17:25:04.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.441+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16574692706069185489', time=2024-09-12T19:15:53.423032+0000, chain.objs.size()=2 2024-09-12T17:25:04.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.441+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15__shadow_.gNEl_t_G4qGLCCwWX4kky53MX7zSYVS_0 2024-09-12T17:25:04.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.441+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15__shadow_.gNEl_t_G4qGLCCwWX4kky53MX7zSYVS_1 2024-09-12T17:25:04.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.441+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7168167979193286975', time=2024-09-12T19:15:53.887366+0000, chain.objs.size()=1 2024-09-12T17:25:04.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.441+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7__shadow_.WiavqF4yUgAHlK5AF7hEUeYevxyt6iH_0 2024-09-12T17:25:04.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.441+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14815113066860554887', time=2024-09-12T19:17:16.484232+0000, chain.objs.size()=1 2024-09-12T17:25:04.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.441+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19__shadow_.DaCC-XkOYdB-K1W6OzzXDFdu_Yfazuk_0 2024-09-12T17:25:04.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.441+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7183628861460608451', time=2024-09-12T19:17:56.714721+0000, chain.objs.size()=1 2024-09-12T17:25:04.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.441+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23__shadow_.MICIFuigbB0EBIpeP0MpL3c83Xa8kM-_0 2024-09-12T17:25:04.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.441+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2739844023491002599', time=2024-09-12T19:17:56.719247+0000, chain.objs.size()=1 2024-09-12T17:25:04.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.441+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23__shadow_.JYlIUM5EEvA4o6Pu6pfepuvtn1E94EF_0 2024-09-12T17:25:04.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.441+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5647215555918497504', time=2024-09-12T19:17:56.735851+0000, chain.objs.size()=1 2024-09-12T17:25:04.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.441+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23__shadow_.X1_Gmr5CRLO_ocft5MxhLSjUFoA6l4__0 2024-09-12T17:25:04.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.441+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10595084618371987200', time=2024-09-12T19:18:30.825216+0000, chain.objs.size()=1 2024-09-12T17:25:04.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.441+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24__shadow_.NeZ-ABs5N0G5oCYNXuboyqm0kWVFGJD_0 2024-09-12T17:25:04.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.445+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15339690467258572587', time=2024-09-12T19:20:25.195709+0000, chain.objs.size()=1 2024-09-12T17:25:04.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.445+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33__shadow_.jOXR3R3kAMUXVCMuqpGyXxndSiE_0UX_0 2024-09-12T17:25:04.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.445+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1292834335818429942', time=2024-09-12T19:20:58.893531+0000, chain.objs.size()=1 2024-09-12T17:25:04.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.445+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34__shadow_._HNfzdtEVbsoCLTb8--EwYvJqqaHFzu_0 2024-09-12T17:25:04.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.445+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17089459154009547288', time=2024-09-12T19:21:04.306938+0000, chain.objs.size()=1 2024-09-12T17:25:04.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.445+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36__shadow_.RHAbSGvUwsAzZ1J06e-Xb9tuBXt4HTe_0 2024-09-12T17:25:04.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.445+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11154898493970040770', time=2024-09-12T19:21:35.876697+0000, chain.objs.size()=1 2024-09-12T17:25:04.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.445+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36__shadow_.ax0LjKHtHZEvbfZE0esJqxzPcRpmCzR_0 2024-09-12T17:25:04.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.449+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3609446526150745369', time=2024-09-12T19:21:35.878612+0000, chain.objs.size()=1 2024-09-12T17:25:04.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.449+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36__shadow_.AEUxBsYk12h5zr7ueWYwqlRRGHUlL9L_0 2024-09-12T17:25:04.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.449+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2398274159263337175', time=2024-09-12T19:21:38.717761+0000, chain.objs.size()=1 2024-09-12T17:25:04.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.449+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37__shadow_.pxfCjhRB_ktplu76hHt6R1reuoLoaAN_0 2024-09-12T17:25:04.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.449+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12658863999680518405', time=2024-09-12T19:21:38.722098+0000, chain.objs.size()=1 2024-09-12T17:25:04.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.449+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37__shadow_.1RfbEYjZCPjIz43ym8gCcCPcLqGIc4a_0 2024-09-12T17:25:04.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.449+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4595768120146195750', time=2024-09-12T19:21:40.874406+0000, chain.objs.size()=1 2024-09-12T17:25:04.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.449+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38__shadow_.qjnCKAGeCNztLtUR5NJfOCwcFPefjIy_0 2024-09-12T17:25:04.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.449+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7763367353637845509', time=2024-09-12T19:21:40.883230+0000, chain.objs.size()=1 2024-09-12T17:25:04.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.449+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38__shadow_.kKMaOLfj9NIUR6jQscTwFK2_2R_GJLH_0 2024-09-12T17:25:04.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.449+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12650985069628026579', time=2024-09-12T19:22:14.395845+0000, chain.objs.size()=1 2024-09-12T17:25:04.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.449+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39__shadow_.kW7H1NgRqENjwZnCWAU5i3drbftcv0m_0 2024-09-12T17:25:04.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.453+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:25:04.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.457+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:25:04.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.461+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:04.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.461+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:04.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.465+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-12T17:25:04.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.465+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3352295246188258220', time=2024-09-12T19:15:53.876106+0000, chain.objs.size()=1 2024-09-12T17:25:04.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.465+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7__shadow_.rwezzUmKduC5ae7BLm5PJsPeuywwcw7_0 2024-09-12T17:25:04.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.465+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18148210202315431296', time=2024-09-12T19:17:54.714429+0000, chain.objs.size()=1 2024-09-12T17:25:04.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.465+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22__shadow_.fuxsc49m89iS9STDbuAElRhhEajvYyg_0 2024-09-12T17:25:04.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.465+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6130894432961757480', time=2024-09-12T19:17:56.725878+0000, chain.objs.size()=1 2024-09-12T17:25:04.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.465+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23__shadow_.84B_w_e0D9WcBLWXT9NOmESZogPq42M_0 2024-09-12T17:25:04.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.465+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.148128634828260883', time=2024-09-12T19:18:30.812315+0000, chain.objs.size()=1 2024-09-12T17:25:04.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.465+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24__shadow_.fRdS3h77aj2dGVRjtad53Bj-HDxiett_0 2024-09-12T17:25:04.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.465+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7940501033683779735', time=2024-09-12T19:18:30.826889+0000, chain.objs.size()=1 2024-09-12T17:25:04.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.465+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24__shadow_.ygkV5edvLHTDLri4P2J_ED8YotF2UCp_0 2024-09-12T17:25:04.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.465+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.241622659088393500', time=2024-09-12T19:18:35.003112+0000, chain.objs.size()=1 2024-09-12T17:25:04.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.465+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26__shadow_.9LeXlL9bexZy0a55dSIljZ-IdBQN05d_0 2024-09-12T17:25:04.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.465+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13071486353813055738', time=2024-09-12T19:18:35.022768+0000, chain.objs.size()=1 2024-09-12T17:25:04.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.465+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26__shadow_.ksgC5vfSSNfONL7wA-xiII208LBDDou_0 2024-09-12T17:25:04.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.465+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11157845693526916494', time=2024-09-12T19:19:11.781723+0000, chain.objs.size()=1 2024-09-12T17:25:04.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.465+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28__shadow_.zVSeZI2y5cR_v0KczOA_EXFP2tPkPfT_0 2024-09-12T17:25:04.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.465+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10449250753135426146', time=2024-09-12T19:19:44.778866+0000, chain.objs.size()=1 2024-09-12T17:25:04.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.465+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29__shadow_.bEyzTtZkTEgSW8jWaYt-LMzrARxue9A_0 2024-09-12T17:25:04.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.465+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16211376268697906917', time=2024-09-12T19:19:47.181859+0000, chain.objs.size()=1 2024-09-12T17:25:04.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.465+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30__shadow_.alwpBMHSll6LRbN4gfNhfNDJ6VetaLN_0 2024-09-12T17:25:04.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.465+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.459585395144431806', time=2024-09-12T19:19:48.919207+0000, chain.objs.size()=1 2024-09-12T17:25:04.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.465+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31__shadow_.C-zQCqnG2QZX5T_LYQ7WIhhdmvbQGS9_0 2024-09-12T17:25:04.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.465+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13085960704437191326', time=2024-09-12T19:19:48.938088+0000, chain.objs.size()=1 2024-09-12T17:25:04.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.465+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31__shadow_.-TVEtUrxZUwcMbwWlwJwwLFNwyPata2_0 2024-09-12T17:25:04.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.469+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.969278596604325709', time=2024-09-12T19:19:48.943853+0000, chain.objs.size()=1 2024-09-12T17:25:04.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.469+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31__shadow_.WcyGbHAz8YkoNOY9HX71UkY5OUyHomG_0 2024-09-12T17:25:04.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.469+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12833543277836079500', time=2024-09-12T19:19:48.952393+0000, chain.objs.size()=1 2024-09-12T17:25:04.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.469+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31__shadow_.TRsL3AdhOe32l3upeZnvyzq4hpiBJfT_0 2024-09-12T17:25:04.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.469+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2663792818256384612', time=2024-09-12T19:19:48.954458+0000, chain.objs.size()=1 2024-09-12T17:25:04.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.469+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31__shadow_.Xni-OjRoxQfjXM7AObnXrcJdjRc389l_0 2024-09-12T17:25:04.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.469+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12997132144239007794', time=2024-09-12T19:20:22.055676+0000, chain.objs.size()=1 2024-09-12T17:25:04.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.469+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32__shadow_.R5nMNGAihhtrlLF9edBtW23qmN0ylh2_0 2024-09-12T17:25:04.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.469+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7473708081553527911', time=2024-09-12T19:20:25.185180+0000, chain.objs.size()=1 2024-09-12T17:25:04.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.469+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33__shadow_.-Quj0pTYzplqH31-RVaxKiueXbGiMGV_0 2024-09-12T17:25:04.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.469+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4315177199157853947', time=2024-09-12T19:21:01.968087+0000, chain.objs.size()=1 2024-09-12T17:25:04.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.469+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35__shadow_.AR8jhavddpaKDxuTGaSczA--9C4chIB_0 2024-09-12T17:25:04.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.469+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16058345178100205228', time=2024-09-12T19:21:01.983915+0000, chain.objs.size()=1 2024-09-12T17:25:04.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.469+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35__shadow_.ZyZR_f2MK_phsEPQAV4cmZq7pnF79A0_0 2024-09-12T17:25:04.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.469+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13230839133837142738', time=2024-09-12T19:21:38.713034+0000, chain.objs.size()=1 2024-09-12T17:25:04.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.469+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37__shadow_.cktUazMUC30-7qCynHUEUDmIQZoGeY-_0 2024-09-12T17:25:04.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.469+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2145337093387560709', time=2024-09-12T19:21:40.886144+0000, chain.objs.size()=1 2024-09-12T17:25:04.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.469+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38__shadow_.3Km56Vg8EOS25AKJXtvT58Fu7kC95_N_0 2024-09-12T17:25:04.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.473+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:25:04.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.481+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:25:04.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.481+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:04.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.485+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:04.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.485+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T17:25:04.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.485+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7927202697257783231', time=2024-09-12T19:15:53.146091+0000, chain.objs.size()=1 2024-09-12T17:25:04.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.485+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4__shadow_.-aAnzc_Ypzh1a6QDcoW35-p_LtB54Gr_0 2024-09-12T17:25:04.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.485+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='_tcS6ze1S_kxS4L8dvmfWYNNg5azt3gM', time=2024-09-12T19:15:53.452520+0000, chain.objs.size()=1 2024-09-12T17:25:04.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.485+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15__shadow_.1uMa75mmUpM9dPj-AXhiBAemXjhJkcb_0 2024-09-12T17:25:04.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.485+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='_7m7Q1FG_X_ueOlxyEtobmYpKGVl9J9I', time=2024-09-12T19:15:53.542257+0000, chain.objs.size()=3 2024-09-12T17:25:04.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.485+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__shadow_.fNrXldopP9dzg5qJoeKuX76snjIYTT4_0 2024-09-12T17:25:04.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.485+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__shadow_.fNrXldopP9dzg5qJoeKuX76snjIYTT4_1 2024-09-12T17:25:04.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.485+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__shadow_.fNrXldopP9dzg5qJoeKuX76snjIYTT4_2 2024-09-12T17:25:04.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.485+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11816978565956692286', time=2024-09-12T19:17:16.468908+0000, chain.objs.size()=1 2024-09-12T17:25:04.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.485+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19__shadow_.xmT56m98TH8JyQUkdcnF0Nx6dADseT1_0 2024-09-12T17:25:04.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.485+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4894054410508376308', time=2024-09-12T19:17:16.473296+0000, chain.objs.size()=1 2024-09-12T17:25:04.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.485+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19__shadow_.Js7L_ELNXfv8eOIGzD0bE03e1rI0r-J_0 2024-09-12T17:25:04.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.485+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15431399645909587031', time=2024-09-12T19:18:33.452457+0000, chain.objs.size()=1 2024-09-12T17:25:04.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.485+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25__shadow_.5cMcvaHUjIFsKv4IiomSBGBFU9Rf1bo_0 2024-09-12T17:25:04.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.485+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3510232748251218335', time=2024-09-12T19:19:08.315692+0000, chain.objs.size()=1 2024-09-12T17:25:04.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.485+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27__shadow_.n1nNqcASDkBr5G_B1215JQc4w95Ha_G_0 2024-09-12T17:25:04.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.485+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5939470687895561408', time=2024-09-12T19:19:10.660627+0000, chain.objs.size()=1 2024-09-12T17:25:04.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.485+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28__shadow_.PUkV0xLleCd4RaqG3Kg3j_SmhiujWVY_0 2024-09-12T17:25:04.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.485+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.788415998919067452', time=2024-09-12T19:19:11.774610+0000, chain.objs.size()=1 2024-09-12T17:25:04.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.485+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28__shadow_.yjP7Uwjb7zTPMYW1nwYwZeXuAgK4oAr_0 2024-09-12T17:25:04.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.485+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6333946701854130893', time=2024-09-12T19:19:47.188669+0000, chain.objs.size()=1 2024-09-12T17:25:04.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.485+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30__shadow_.OtshLYoxTJLzjd_U4N0mBgFyHCKZtS__0 2024-09-12T17:25:04.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.489+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8557148012701352504', time=2024-09-12T19:20:25.178133+0000, chain.objs.size()=1 2024-09-12T17:25:04.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.489+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33__shadow_.271c48uyD8rMEN2dzKtWhxWAM05sCaK_0 2024-09-12T17:25:04.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.489+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13718653473978001434', time=2024-09-12T19:20:25.192696+0000, chain.objs.size()=1 2024-09-12T17:25:04.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.489+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33__shadow_.j3xvOKfG-Wr3Wr_3POhACa0a7tWse1y_0 2024-09-12T17:25:04.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.493+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15842173639959608263', time=2024-09-12T19:20:58.912460+0000, chain.objs.size()=1 2024-09-12T17:25:04.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.493+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34__shadow_.Zeaj2jjRoEN60BXvbouzZ4C0vLimRbI_0 2024-09-12T17:25:04.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.493+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1633247504762031470', time=2024-09-12T19:24:40.346896+0000, chain.objs.size()=1 2024-09-12T17:25:04.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.493+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18__shadow:OIGkGGIUP2HR4Ymi1Lnzu-41pdSdgUh_.7rmrlWm4vvHaBhN8QxHTMJD597y8OdF_0 2024-09-12T17:25:04.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.493+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:25:04.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.501+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:25:04.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.501+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:04.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.501+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:04.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.501+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T17:25:04.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.501+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='_cFdunakWtLePCzwytjH51LbaZ0OsDF9', time=2024-09-12T19:15:53.397397+0000, chain.objs.size()=2 2024-09-12T17:25:04.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.501+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15__shadow_.dxzZ1Nm6uAxAc0f7SeaOpQk7NrapbH3_0 2024-09-12T17:25:04.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.505+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15__shadow_.dxzZ1Nm6uAxAc0f7SeaOpQk7NrapbH3_1 2024-09-12T17:25:04.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.505+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14351286534416233137', time=2024-09-12T19:15:53.867969+0000, chain.objs.size()=1 2024-09-12T17:25:04.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.505+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7__shadow_.VQUQsD5b1aoHpuU1P62fs27wlRWxaKP_0 2024-09-12T17:25:04.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.505+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11376679494421750172', time=2024-09-12T19:17:54.721937+0000, chain.objs.size()=1 2024-09-12T17:25:04.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.505+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22__shadow_.6hRlVWLf_mpSRhXViu3-InswM6MVT06_0 2024-09-12T17:25:04.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.505+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12509781174565927426', time=2024-09-12T19:17:54.743848+0000, chain.objs.size()=1 2024-09-12T17:25:04.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.505+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22__shadow_.yarklSHRFbz-0fvX9hq0RvVUD0PNF23_0 2024-09-12T17:25:04.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.505+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14611369504687324444', time=2024-09-12T19:18:33.425371+0000, chain.objs.size()=1 2024-09-12T17:25:04.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.505+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25__shadow_.bwzhEl53nuKiAzAfzTKCUcrhQaXGyQS_0 2024-09-12T17:25:04.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.505+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9031294075103144586', time=2024-09-12T19:18:33.443534+0000, chain.objs.size()=1 2024-09-12T17:25:04.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.505+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25__shadow_.hHaQjhkLL_dEqaapIPDzQ6iNo8QCcZr_0 2024-09-12T17:25:04.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.505+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9230065445724757567', time=2024-09-12T19:19:08.330550+0000, chain.objs.size()=1 2024-09-12T17:25:04.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.505+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27__shadow_.mTUpl3IaIrsYpeELYwoM5ZVPoE-r9LN_0 2024-09-12T17:25:04.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.505+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.392301313264714145', time=2024-09-12T19:19:48.942012+0000, chain.objs.size()=1 2024-09-12T17:25:04.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.505+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31__shadow_.f-nWxCym0HlYkJYgOH7sIB4JiAwbfLG_0 2024-09-12T17:25:04.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.505+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13998744334453359017', time=2024-09-12T19:20:22.052251+0000, chain.objs.size()=1 2024-09-12T17:25:04.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.505+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32__shadow_.gXg1stqyNaZYyTaMFcyqG5-blmvaL8k_0 2024-09-12T17:25:04.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.505+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4885319570527785931', time=2024-09-12T19:20:25.186807+0000, chain.objs.size()=1 2024-09-12T17:25:04.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.505+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33__shadow_.6SXYBMmsVauck9fk8cfl3AHyu_mLzoe_0 2024-09-12T17:25:04.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.505+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7984511345325148815', time=2024-09-12T19:20:58.895098+0000, chain.objs.size()=1 2024-09-12T17:25:04.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.505+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34__shadow_.-5WApia_UALBouQY5cdFMylRVhxaWXP_0 2024-09-12T17:25:04.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.509+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10295309637745710759', time=2024-09-12T19:21:01.974781+0000, chain.objs.size()=1 2024-09-12T17:25:04.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.509+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35__shadow_.K_BEjHTU-VvW0erSeZZZ99HeFuEL6OS_0 2024-09-12T17:25:04.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.509+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16976309255671954121', time=2024-09-12T19:21:35.862118+0000, chain.objs.size()=1 2024-09-12T17:25:04.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.509+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36__shadow_.kT0yDWA9PKR5_YxgeVgNPBMg4CNhrLv_0 2024-09-12T17:25:04.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.509+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1861623919342900081', time=2024-09-12T19:21:38.729396+0000, chain.objs.size()=1 2024-09-12T17:25:04.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.509+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37__shadow_.Zn49U5bY41Bt5Y6eSd3B8v7wfYv6SKj_0 2024-09-12T17:25:04.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.509+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10918176076578121033', time=2024-09-12T19:21:40.887456+0000, chain.objs.size()=1 2024-09-12T17:25:04.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.509+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38__shadow_.jVKiFCXA-Y8Foa27ZvtouEKLeaFYhsP_0 2024-09-12T17:25:04.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.509+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16835749103935664866', time=2024-09-12T19:22:14.400427+0000, chain.objs.size()=1 2024-09-12T17:25:04.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.509+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39__shadow_.qe67sNmSIm38cPsopZpOCn9GIoROYoP_0 2024-09-12T17:25:04.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.509+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12067953192230871579', time=2024-09-12T19:24:25.411747+0000, chain.objs.size()=1 2024-09-12T17:25:04.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.509+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17__shadow_.T3PS-0qSfep3fydwFS2_ggT4zPpi_9A_0 2024-09-12T17:25:04.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.509+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3594011005863790629', time=2024-09-12T19:24:25.421502+0000, chain.objs.size()=1 2024-09-12T17:25:04.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.509+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17__shadow_.LeGC-jPudVD2oxHm2-WZytbfHA1nGGh_0 2024-09-12T17:25:04.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.517+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:25:04.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.521+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:25:04.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.521+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:04.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.525+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:04.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.525+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-12T17:25:04.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.525+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11067979933559858992', time=2024-09-12T19:17:18.428423+0000, chain.objs.size()=1 2024-09-12T17:25:04.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.525+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20__shadow_.Abxn_FmVNrIaOuQ7z0p2anYwSp7pohJ_0 2024-09-12T17:25:04.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.525+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13021587007514083610', time=2024-09-12T19:17:18.441229+0000, chain.objs.size()=1 2024-09-12T17:25:04.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.525+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20__shadow_.WwSHTSHhHSYD-fAqPJltSPG74OXXEmp_0 2024-09-12T17:25:04.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.525+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14611998990757643681', time=2024-09-12T19:17:51.899994+0000, chain.objs.size()=1 2024-09-12T17:25:04.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.525+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21__shadow_.14YBHOVVGv2tEL4cgcioSpN5YNbEQJN_0 2024-09-12T17:25:04.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.525+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9421247148162396462', time=2024-09-12T19:18:30.824162+0000, chain.objs.size()=1 2024-09-12T17:25:04.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.525+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24__shadow_.km1OCNEg2TWupGo5Yw2NSL-BVnHRTNa_0 2024-09-12T17:25:04.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.525+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12081109407076888543', time=2024-09-12T19:18:34.988949+0000, chain.objs.size()=1 2024-09-12T17:25:04.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.525+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26__shadow_.KXe6fvCVvz_9stQxRIlQwtKaw6aDBhg_0 2024-09-12T17:25:04.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.525+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13936665207404409001', time=2024-09-12T19:19:47.214216+0000, chain.objs.size()=1 2024-09-12T17:25:04.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.525+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30__shadow_.qnRMrpQWJDH7uH9TXXzgjorZE1WbnXY_0 2024-09-12T17:25:04.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.525+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4881471795180889709', time=2024-09-12T19:20:22.057790+0000, chain.objs.size()=1 2024-09-12T17:25:04.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.525+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32__shadow_.D7KJaTMQVJ_dexCd83j9PIzIlnZyxv__0 2024-09-12T17:25:04.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.525+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14612150404572100158', time=2024-09-12T19:24:25.411978+0000, chain.objs.size()=1 2024-09-12T17:25:04.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.525+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17__shadow_.CY0JLb8XjBVWtorwp3P4qOov-ZDcIDL_0 2024-09-12T17:25:04.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.529+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:25:04.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.533+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:25:04.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.537+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:04.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.537+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:04.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.537+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T17:25:04.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.537+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13048624585831616113', time=2024-09-12T19:15:53.366027+0000, chain.objs.size()=2 2024-09-12T17:25:04.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.537+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15__shadow_.utusUk9Jsewa_Yz-LHSUEX5P9LD3Zmh_0 2024-09-12T17:25:04.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.537+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15__shadow_.utusUk9Jsewa_Yz-LHSUEX5P9LD3Zmh_1 2024-09-12T17:25:04.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.537+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='_Et2elVde-lJVlb7IxtP-eu5mB-zidlh', time=2024-09-12T19:15:53.609180+0000, chain.objs.size()=1 2024-09-12T17:25:04.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.537+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__shadow_.ibEhIh8IRbNE7dlTnWWUQSGPptc0ZH2_0 2024-09-12T17:25:04.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.537+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2620504910734951979', time=2024-09-12T19:15:53.678381+0000, chain.objs.size()=5 2024-09-12T17:25:04.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.537+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14__multipart_foo-LUKEWARM.2~GQyIHZktKzIuST1-RyMnDOE92SLDINa.1 2024-09-12T17:25:04.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.537+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14__shadow_foo-LUKEWARM.2~GQyIHZktKzIuST1-RyMnDOE92SLDINa.1_1 2024-09-12T17:25:04.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.537+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14__multipart_foo-LUKEWARM.2~GQyIHZktKzIuST1-RyMnDOE92SLDINa.2 2024-09-12T17:25:04.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.537+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14__shadow_foo-LUKEWARM.2~GQyIHZktKzIuST1-RyMnDOE92SLDINa.2_1 2024-09-12T17:25:04.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.537+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14__multipart_foo-LUKEWARM.2~GQyIHZktKzIuST1-RyMnDOE92SLDINa.3 2024-09-12T17:25:04.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.537+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6306743141079068761', time=2024-09-12T19:17:51.894516+0000, chain.objs.size()=1 2024-09-12T17:25:04.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.537+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21__shadow_.YU1dewx8VQ2JOTU478y1rfZbZZVtMMf_0 2024-09-12T17:25:04.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.537+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16166205185816614147', time=2024-09-12T19:17:56.709519+0000, chain.objs.size()=1 2024-09-12T17:25:04.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.537+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23__shadow_.hHzVnZEz5u02d1OnSkVSBlIFD7mAWVk_0 2024-09-12T17:25:04.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.537+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12862652672248281372', time=2024-09-12T19:17:56.734479+0000, chain.objs.size()=1 2024-09-12T17:25:04.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.537+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23__shadow_.A8NigKB5gqxbQLgm158n8z0Pg_sY_mB_0 2024-09-12T17:25:04.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.537+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12777664839300490510', time=2024-09-12T19:17:56.736679+0000, chain.objs.size()=1 2024-09-12T17:25:04.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.537+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23__shadow_.WgWmGb2MCM9KoxPNqO2ihOPge6wpWR5_0 2024-09-12T17:25:04.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.541+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13480024509978808367', time=2024-09-12T19:17:58.846473+0000, chain.objs.size()=1 2024-09-12T17:25:04.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.541+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24__shadow_.zm4DSDLbPFmFD2Qyqr0Et9kezRFhXfg_0 2024-09-12T17:25:04.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.541+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16332461816869956546', time=2024-09-12T19:19:11.782121+0000, chain.objs.size()=1 2024-09-12T17:25:04.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.541+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28__shadow_.vEK4lnVlebfSYpX0ZZBaIKWKeYrP7LE_0 2024-09-12T17:25:04.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.541+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11816903302508299189', time=2024-09-12T19:19:44.777239+0000, chain.objs.size()=1 2024-09-12T17:25:04.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.541+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29__shadow_.N4ukYNMMhv3FvSKFJZjo1psB2H_st8d_0 2024-09-12T17:25:04.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.545+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10424901508227629776', time=2024-09-12T19:20:58.882035+0000, chain.objs.size()=1 2024-09-12T17:25:04.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.545+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34__shadow_.2HSVUAKlTf8kJcplYPk_jfIEz5miGHW_0 2024-09-12T17:25:04.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.545+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12240171286689612163', time=2024-09-12T19:20:58.889728+0000, chain.objs.size()=1 2024-09-12T17:25:04.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.545+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34__shadow_.npidalucGoO1eFtawJJJTg0QTqERXOa_0 2024-09-12T17:25:04.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.545+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7749745180586004352', time=2024-09-12T19:21:01.976158+0000, chain.objs.size()=1 2024-09-12T17:25:04.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.545+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35__shadow_.lRW5CG-74AU-AwXp4U-9oVez7ue719Q_0 2024-09-12T17:25:04.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.545+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7034402452318212633', time=2024-09-12T19:21:01.979062+0000, chain.objs.size()=1 2024-09-12T17:25:04.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.545+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35__shadow_.rAgmJXdzC6p_V3i6EuSeZW1z2dJ9Ju4_0 2024-09-12T17:25:04.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.545+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10087516630605526511', time=2024-09-12T19:21:35.856358+0000, chain.objs.size()=1 2024-09-12T17:25:04.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.545+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36__shadow_.DimbyD86yl9fQ9CH1OpqidVbI-1HQry_0 2024-09-12T17:25:04.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.545+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5722844837444096869', time=2024-09-12T19:21:35.862727+0000, chain.objs.size()=1 2024-09-12T17:25:04.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.545+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36__shadow_.2vPTPA15ILuLkMoIQxtkNU05YJKFOmx_0 2024-09-12T17:25:04.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.545+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2558633116264737301', time=2024-09-12T19:21:35.867957+0000, chain.objs.size()=1 2024-09-12T17:25:04.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.545+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36__shadow_.LyZ3rAb_020OCrcEXaMOlj93xHJ__G-_0 2024-09-12T17:25:04.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.545+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5259420299904589901', time=2024-09-12T19:21:38.726107+0000, chain.objs.size()=1 2024-09-12T17:25:04.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.545+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37__shadow_.h77ZbtWqhhzoHBHQ4_9LLJOjRdj5Yl__0 2024-09-12T17:25:04.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.545+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8042834586424086026', time=2024-09-12T19:22:14.396210+0000, chain.objs.size()=1 2024-09-12T17:25:04.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.545+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39__shadow_.rQXkps7F6zr-PykBumEK0ObpWACzG9I_0 2024-09-12T17:25:04.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.549+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10138025091785520718', time=2024-09-12T19:22:14.401578+0000, chain.objs.size()=1 2024-09-12T17:25:04.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.549+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39__shadow_.33QCxB6WWb4dsQyDT6k3XVsAi6DbTuE_0 2024-09-12T17:25:04.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.549+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:25:04.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.553+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:25:04.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.557+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:04.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.557+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:04.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.557+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T17:25:04.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.557+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9168035861511241454', time=2024-09-12T19:15:53.094554+0000, chain.objs.size()=1 2024-09-12T17:25:04.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.557+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4__shadow_.OYgGr2tkLz6Zq04gAlbBReOcOstzJpR_0 2024-09-12T17:25:04.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.557+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7203141660467888329', time=2024-09-12T19:15:53.159004+0000, chain.objs.size()=1 2024-09-12T17:25:04.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.557+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4__shadow_._JqhpD1Rwlk51QB61IcrRsZc22T5Ovm_0 2024-09-12T17:25:04.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.557+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='_ttkyIaTuDYcwpGLfBpllEr0O_sMRi6r', time=2024-09-12T19:15:53.534264+0000, chain.objs.size()=3 2024-09-12T17:25:04.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.557+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__shadow_.pKAZf3LC92a2mi7DnryHieTis3abdOG_0 2024-09-12T17:25:04.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.557+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__shadow_.pKAZf3LC92a2mi7DnryHieTis3abdOG_1 2024-09-12T17:25:04.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.557+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__shadow_.pKAZf3LC92a2mi7DnryHieTis3abdOG_2 2024-09-12T17:25:04.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.557+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1079196777345026088', time=2024-09-12T19:17:18.447860+0000, chain.objs.size()=1 2024-09-12T17:25:04.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.557+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20__shadow_.1QqGoQ7d-DaWdkCgtYTIjYF0nkzhII0_0 2024-09-12T17:25:04.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.557+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1362379319060219975', time=2024-09-12T19:17:18.455157+0000, chain.objs.size()=1 2024-09-12T17:25:04.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.557+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20__shadow_.iq2abcMp07rWQKi_gMku2JBFRgFxl2i_0 2024-09-12T17:25:04.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.557+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16747526173225268194', time=2024-09-12T19:17:18.466625+0000, chain.objs.size()=1 2024-09-12T17:25:04.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.557+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20__shadow_.4BVF5Tia0t50rbCS36Nk4hxgOapi5gH_0 2024-09-12T17:25:04.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.557+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5031623770576077586', time=2024-09-12T19:17:51.901987+0000, chain.objs.size()=1 2024-09-12T17:25:04.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.557+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21__shadow_.v5fPG6qaEny2V-JQ4dShsiqIWGzU9qO_0 2024-09-12T17:25:04.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.557+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6117924440765039670', time=2024-09-12T19:17:51.908854+0000, chain.objs.size()=1 2024-09-12T17:25:04.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.557+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21__shadow_.iXTNLZTfIdncKyzMVVBXgmWIrxjq2k6_0 2024-09-12T17:25:04.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.561+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16739567820016022616', time=2024-09-12T19:18:33.434285+0000, chain.objs.size()=1 2024-09-12T17:25:04.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.561+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25__shadow_.O-CtrQzXvEuVG1o6ALeXq8MT_BJ-c7T_0 2024-09-12T17:25:04.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.561+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16876340597003139921', time=2024-09-12T19:19:08.304273+0000, chain.objs.size()=1 2024-09-12T17:25:04.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.561+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27__shadow_.-f_eH_ySp8BJh48sQA-J-vBfjo-xg1E_0 2024-09-12T17:25:04.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.561+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10606155545852993126', time=2024-09-12T19:19:08.317891+0000, chain.objs.size()=1 2024-09-12T17:25:04.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.561+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27__shadow_.NkZfbh6TLMYcc2hmoQ1v8d3sp3H4rsU_0 2024-09-12T17:25:04.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.561+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15731549723997504429', time=2024-09-12T19:19:47.184797+0000, chain.objs.size()=1 2024-09-12T17:25:04.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.561+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30__shadow_.aEzP04faZPuBHWYKvMNc9mXci6pIR-V_0 2024-09-12T17:25:04.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.565+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4250678294368317713', time=2024-09-12T19:19:48.940279+0000, chain.objs.size()=1 2024-09-12T17:25:04.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.565+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31__shadow_.BHjT-BWheW5T7yT4XQ9G_WDVo6a9TiC_0 2024-09-12T17:25:04.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.565+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7244546392629460825', time=2024-09-12T19:19:48.956714+0000, chain.objs.size()=1 2024-09-12T17:25:04.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.565+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31__shadow_.74pmhXU1OGPxKaAf4nTHVnt2Ts-xrDE_0 2024-09-12T17:25:04.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.565+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4150149705021356493', time=2024-09-12T19:21:01.962796+0000, chain.objs.size()=1 2024-09-12T17:25:04.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.565+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35__shadow_.xUmDgg1kkEoVTeiuC1Rf5edOXmIazqb_0 2024-09-12T17:25:04.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.565+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15884916496833532713', time=2024-09-12T19:21:01.966474+0000, chain.objs.size()=1 2024-09-12T17:25:04.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.565+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35__shadow_.bgxgp3H6BU_MCoXiqFJatibE1bBnYq4_0 2024-09-12T17:25:04.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.565+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7559980413979842058', time=2024-09-12T19:21:01.975048+0000, chain.objs.size()=1 2024-09-12T17:25:04.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.565+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35__shadow_.c4ZKsXVr2MW5vy8r7x3le_L184qf0aP_0 2024-09-12T17:25:04.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.565+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18258079673450839923', time=2024-09-12T19:21:40.909692+0000, chain.objs.size()=1 2024-09-12T17:25:04.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.565+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38__shadow_.mRJMI0B-J5w4vDubxX1dkL9Lh4Ss4eI_0 2024-09-12T17:25:04.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.565+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5671889225867245843', time=2024-09-12T19:21:40.922631+0000, chain.objs.size()=1 2024-09-12T17:25:04.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.565+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38__shadow_.qLaA04sjW1ZdU1v0XXfXmgvjtPoBKUR_0 2024-09-12T17:25:04.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.569+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:25:04.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.573+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:25:04.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.573+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:04.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.577+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:04.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.577+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T17:25:04.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.577+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.208577650118266347', time=2024-09-12T19:17:16.478876+0000, chain.objs.size()=1 2024-09-12T17:25:04.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.577+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19__shadow_.7O8SmeJ1-o9XdWrEmnddDO5b6SrUZaW_0 2024-09-12T17:25:04.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.577+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4415558126373650081', time=2024-09-12T19:17:51.909995+0000, chain.objs.size()=1 2024-09-12T17:25:04.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.577+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21__shadow_.3PkX1hqbGptl-u9wnhSVLb4p3zY1GDc_0 2024-09-12T17:25:04.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.577+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6376614417687204873', time=2024-09-12T19:17:56.705475+0000, chain.objs.size()=1 2024-09-12T17:25:04.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.577+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23__shadow_.InLC11IrwsGGG_mhRUeAr7XYCt10uK1_0 2024-09-12T17:25:04.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.577+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2823511910317776152', time=2024-09-12T19:18:30.818712+0000, chain.objs.size()=1 2024-09-12T17:25:04.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.577+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24__shadow_.6bee4AEB03uA2YPQOLtAgMKJ1CiETAl_0 2024-09-12T17:25:04.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.577+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16235814862509550805', time=2024-09-12T19:19:08.299793+0000, chain.objs.size()=1 2024-09-12T17:25:04.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.577+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27__shadow_.W6YM6NdgcuhIEvoy9zhgu-0Lk-yL_rB_0 2024-09-12T17:25:04.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.577+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15365700578279317728', time=2024-09-12T19:20:25.201563+0000, chain.objs.size()=1 2024-09-12T17:25:04.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.577+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33__shadow_.0KExRoxv21D66SV6xQL67T9qN_VlC2T_0 2024-09-12T17:25:04.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.577+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18318304143945945642', time=2024-09-12T19:20:58.875407+0000, chain.objs.size()=1 2024-09-12T17:25:04.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.577+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34__shadow_.Uu5LDvUGY5v1CTgFH4VjAI_S99L0w5U_0 2024-09-12T17:25:04.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.577+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9411238129590443112', time=2024-09-12T19:20:58.894778+0000, chain.objs.size()=1 2024-09-12T17:25:04.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.577+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34__shadow_.2TovXgLTzgmhFCldImNvVJHoWbZ8K47_0 2024-09-12T17:25:04.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.577+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14790084971289526169', time=2024-09-12T19:21:35.854044+0000, chain.objs.size()=1 2024-09-12T17:25:04.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.577+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36__shadow_.hI2cHUTvkCFX3FI66NqV6XEqRq-hKO8_0 2024-09-12T17:25:04.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.577+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15437652675451505832', time=2024-09-12T19:22:14.397265+0000, chain.objs.size()=1 2024-09-12T17:25:04.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.577+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39__shadow_.2i2tlhsarudFlkj8zQu-Q7Ezze0HLDC_0 2024-09-12T17:25:04.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.581+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:25:04.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.585+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:25:04.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.589+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:04.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.593+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:04.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.593+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T17:25:04.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.593+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1852825290008853792', time=2024-09-12T19:15:53.082404+0000, chain.objs.size()=1 2024-09-12T17:25:04.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.593+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4__shadow_.OjOs3xsDCE01TcoK81hz7Gyj0eNQuaw_0 2024-09-12T17:25:04.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.593+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8254609845389550162', time=2024-09-12T19:15:53.224631+0000, chain.objs.size()=4 2024-09-12T17:25:04.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.593+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12__multipart_foo.2~6jI0yQTY73MqvLSr7XTATmJ_oy_BhQq.1 2024-09-12T17:25:04.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.593+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12__multipart_foo.2~6jI0yQTY73MqvLSr7XTATmJ_oy_BhQq.2 2024-09-12T17:25:04.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.593+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12__multipart_foo.2~6jI0yQTY73MqvLSr7XTATmJ_oy_BhQq.3 2024-09-12T17:25:04.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.593+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12__multipart_foo.2~6jI0yQTY73MqvLSr7XTATmJ_oy_BhQq.4 2024-09-12T17:25:04.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.593+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11182571932139253820', time=2024-09-12T19:15:53.373446+0000, chain.objs.size()=2 2024-09-12T17:25:04.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.593+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15__shadow_.utusUk9Jsewa_Yz-LHSUEX5P9LD3Zmh_0 2024-09-12T17:25:04.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.593+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15__shadow_.utusUk9Jsewa_Yz-LHSUEX5P9LD3Zmh_1 2024-09-12T17:25:04.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.593+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18096450869366490525', time=2024-09-12T19:15:53.552919+0000, chain.objs.size()=5 2024-09-12T17:25:04.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.593+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__multipart_foo-LUKEWARM.2~MbdvBIPWuandBJkHTE3p6BjlCNRHUdB.1 2024-09-12T17:25:04.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.593+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__shadow_foo-LUKEWARM.2~MbdvBIPWuandBJkHTE3p6BjlCNRHUdB.1_1 2024-09-12T17:25:04.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.593+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__multipart_foo-LUKEWARM.2~MbdvBIPWuandBJkHTE3p6BjlCNRHUdB.2 2024-09-12T17:25:04.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.593+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__shadow_foo-LUKEWARM.2~MbdvBIPWuandBJkHTE3p6BjlCNRHUdB.2_1 2024-09-12T17:25:04.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.593+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__multipart_foo-LUKEWARM.2~MbdvBIPWuandBJkHTE3p6BjlCNRHUdB.3 2024-09-12T17:25:04.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.597+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16554624496872212156', time=2024-09-12T19:15:53.746373+0000, chain.objs.size()=1 2024-09-12T17:25:04.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.597+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13__shadow_.DD32OSbQfK6fAbTk8hoZaf0qj7kOt9h_0 2024-09-12T17:25:04.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.597+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2221378561855124794', time=2024-09-12T19:17:16.486124+0000, chain.objs.size()=1 2024-09-12T17:25:04.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.597+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19__shadow_.yUgFr3pn3MYJ4sFI4tYCXc3oZXiRHm__0 2024-09-12T17:25:04.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.597+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5553842051531304506', time=2024-09-12T19:17:16.492208+0000, chain.objs.size()=1 2024-09-12T17:25:04.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.597+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19__shadow_.Ya4cKteiX2n5J-ZI_dd_5zEybeR1gP1_0 2024-09-12T17:25:04.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.597+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5265944479296222647', time=2024-09-12T19:17:18.428454+0000, chain.objs.size()=1 2024-09-12T17:25:04.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.597+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20__shadow_.Wp7rtthQYmvj_mYSuZVCETILq_vBznM_0 2024-09-12T17:25:04.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.597+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4512827915995472118', time=2024-09-12T19:17:54.746404+0000, chain.objs.size()=1 2024-09-12T17:25:04.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.597+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22__shadow_.nRjLb356g5PBuVPRhgt5Fz53hhFiuGm_0 2024-09-12T17:25:04.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.601+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11522041779296301079', time=2024-09-12T19:18:35.007931+0000, chain.objs.size()=1 2024-09-12T17:25:04.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.601+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26__shadow_.5Wtu4fyCjNByMbqYTq-FCgvpWb3HmB7_0 2024-09-12T17:25:04.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.601+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11307131380124316471', time=2024-09-12T19:19:11.763714+0000, chain.objs.size()=1 2024-09-12T17:25:04.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.601+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28__shadow_.MpbhLhSjE7_xHJQTjGKZHq7fFqQ8aeB_0 2024-09-12T17:25:04.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.601+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15018229511656465752', time=2024-09-12T19:20:25.182776+0000, chain.objs.size()=1 2024-09-12T17:25:04.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.601+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33__shadow_.nb6PdiVUj-uv2iYkPsKPvBHVcly_aTI_0 2024-09-12T17:25:04.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.601+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6810376663200329718', time=2024-09-12T19:20:58.879452+0000, chain.objs.size()=1 2024-09-12T17:25:04.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.601+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34__shadow_.cw3tguerjoauekUC9YYpraDwADkRYt7_0 2024-09-12T17:25:04.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.601+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7087878254461831251', time=2024-09-12T19:21:01.955536+0000, chain.objs.size()=1 2024-09-12T17:25:04.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.601+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35__shadow_._hNu6koA5qnnRrN1XSdkWuQG6lzpIIl_0 2024-09-12T17:25:04.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.601+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1380118181760682920', time=2024-09-12T19:21:01.963547+0000, chain.objs.size()=1 2024-09-12T17:25:04.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.601+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35__shadow_.sPLnN25mY2oXMyGpNEgIKNtt_aU0Wbf_0 2024-09-12T17:25:04.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.605+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:25:04.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.613+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:25:04.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.613+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:04.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.617+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:04.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.617+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T17:25:04.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.617+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6498210937822074028', time=2024-09-12T19:15:53.139758+0000, chain.objs.size()=1 2024-09-12T17:25:04.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.617+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4__shadow_.eQ01vGBJcC653pdQuMFuzeZI-JQ_uOv_0 2024-09-12T17:25:04.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.617+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12848053652780314163', time=2024-09-12T19:17:54.724724+0000, chain.objs.size()=1 2024-09-12T17:25:04.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.617+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22__shadow_.H84552Oeq_2angDlvT_dOgXHdYpI59i_0 2024-09-12T17:25:04.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.617+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4929806094689625473', time=2024-09-12T19:18:30.819907+0000, chain.objs.size()=1 2024-09-12T17:25:04.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.617+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24__shadow_.pS9ub6mFU2fpa8XMvLIBxL6jhRoxdoa_0 2024-09-12T17:25:04.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.617+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14066757894319505307', time=2024-09-12T19:18:33.429902+0000, chain.objs.size()=1 2024-09-12T17:25:04.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.617+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25__shadow_.NBARyBb-6eeXEJ-cG4SexYAnVIbLp4O_0 2024-09-12T17:25:04.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.617+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3687843274330290270', time=2024-09-12T19:19:47.181048+0000, chain.objs.size()=1 2024-09-12T17:25:04.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.617+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30__shadow_.AfubzDIPhjvUre-FGNnFcLdERoJ1XUz_0 2024-09-12T17:25:04.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.617+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7190203846417958271', time=2024-09-12T19:19:47.200379+0000, chain.objs.size()=1 2024-09-12T17:25:04.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.617+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30__shadow_.Qgr7lzHDy8gB6uy2MbnfY6uum9OMqsd_0 2024-09-12T17:25:04.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.617+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8709940891811288362', time=2024-09-12T19:20:22.067668+0000, chain.objs.size()=1 2024-09-12T17:25:04.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.617+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32__shadow_.c51rKQMlFd6VYbgI9S-qySmVKRekx7V_0 2024-09-12T17:25:04.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.617+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4770790083539077480', time=2024-09-12T19:20:22.072113+0000, chain.objs.size()=1 2024-09-12T17:25:04.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.617+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32__shadow_.nzVfxmLroqXeDsocxBE6tMQ-Un2rrQt_0 2024-09-12T17:25:04.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.617+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.268812306208020645', time=2024-09-12T19:21:01.972503+0000, chain.objs.size()=1 2024-09-12T17:25:04.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.617+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35__shadow_.8uuoIduW0w5qaBI_TZEEF7tmtxuJxUI_0 2024-09-12T17:25:04.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.617+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16623198947349207957', time=2024-09-12T19:21:40.877335+0000, chain.objs.size()=1 2024-09-12T17:25:04.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.617+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38__shadow_.gvNyPS410Em3pbSIMzk07SKawKJ2vU1_0 2024-09-12T17:25:04.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.617+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2169435005579823418', time=2024-09-12T19:21:40.888244+0000, chain.objs.size()=1 2024-09-12T17:25:04.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.617+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38__shadow_.6ITTFNgKYsLAJISCdYm6SgJ0q-yCS8W_0 2024-09-12T17:25:04.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.617+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10276692451654904496', time=2024-09-12T19:22:14.392329+0000, chain.objs.size()=1 2024-09-12T17:25:04.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.617+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39__shadow_.ahBXrr-KsxcK1exxN1dIry39n0u9Lrq_0 2024-09-12T17:25:04.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.621+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4164223415813479948', time=2024-09-12T19:22:14.398988+0000, chain.objs.size()=1 2024-09-12T17:25:04.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.621+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39__shadow_.47x5cDSzcW7tj7lQH4NA5ufrc_i4h3__0 2024-09-12T17:25:04.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.625+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:25:04.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.629+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:25:04.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.629+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:04.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.633+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:04.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.633+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T17:25:04.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.633+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9411390627892628354', time=2024-09-12T19:15:53.854271+0000, chain.objs.size()=1 2024-09-12T17:25:04.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.633+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7__shadow_.b8GHddobR4UJg28dOs1GKld7cei20nR_0 2024-09-12T17:25:04.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.633+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1536015313578123751', time=2024-09-12T19:17:18.456623+0000, chain.objs.size()=1 2024-09-12T17:25:04.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.633+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20__shadow_.U_y0xYZqmeqriY8VdcNnWOkTCLt5B_i_0 2024-09-12T17:25:04.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.633+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11322752798788001962', time=2024-09-12T19:17:18.458032+0000, chain.objs.size()=1 2024-09-12T17:25:04.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.633+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20__shadow_.N9PR9lHIhACDEyYNw0FZbxtoINzVfrM_0 2024-09-12T17:25:04.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.633+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17774665782930993782', time=2024-09-12T19:17:51.900138+0000, chain.objs.size()=1 2024-09-12T17:25:04.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.633+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21__shadow_.hxiCjMA-ZbwmIutYNqDJB-FJjW0jhsW_0 2024-09-12T17:25:04.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.633+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14878692721196131335', time=2024-09-12T19:18:33.436324+0000, chain.objs.size()=1 2024-09-12T17:25:04.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.633+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25__shadow_.-0AozOlQn-cHJCg5hPt9EscbenhUYg2_0 2024-09-12T17:25:04.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.633+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18433663371422232386', time=2024-09-12T19:18:33.442660+0000, chain.objs.size()=1 2024-09-12T17:25:04.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.633+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25__shadow_.34Gbvi1AMyjeiQR45HihjgLclE_kDFH_0 2024-09-12T17:25:04.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.633+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13699958005053181962', time=2024-09-12T19:18:35.003181+0000, chain.objs.size()=1 2024-09-12T17:25:04.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.633+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26__shadow_.ER9YzRqxG3roJmhGyC2XS4mA0t6Q4WI_0 2024-09-12T17:25:04.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.633+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3383348993953225293', time=2024-09-12T19:19:08.307558+0000, chain.objs.size()=1 2024-09-12T17:25:04.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.633+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27__shadow_.pfrBklQNvby3qBTFWczQFPCeLBIW7pZ_0 2024-09-12T17:25:04.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.633+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18279723933230370792', time=2024-09-12T19:19:11.765810+0000, chain.objs.size()=1 2024-09-12T17:25:04.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.633+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28__shadow_.-OjqpSivljforY729RsLKPwIbxVJuuY_0 2024-09-12T17:25:04.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.633+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3357290422437257754', time=2024-09-12T19:19:11.778632+0000, chain.objs.size()=1 2024-09-12T17:25:04.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.633+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28__shadow_.HshSG7p5LNAeZTj5TGWEEAgeAS7pjUv_0 2024-09-12T17:25:04.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.633+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12076119000426395122', time=2024-09-12T19:20:58.879828+0000, chain.objs.size()=1 2024-09-12T17:25:04.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.633+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34__shadow_.55j8ilCCPR0LAa5a8uQ02STwUVWLa1F_0 2024-09-12T17:25:04.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.633+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9558978457681776635', time=2024-09-12T19:21:35.885468+0000, chain.objs.size()=1 2024-09-12T17:25:04.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.633+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36__shadow_.Nl_dMYUSymaXz3_l-QCrs8H_YcnULVA_0 2024-09-12T17:25:04.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.637+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8029367014077373598', time=2024-09-12T19:21:38.724485+0000, chain.objs.size()=1 2024-09-12T17:25:04.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.637+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37__shadow_.34oqXwoTLD_0LS33msxgBrjLyZr21Wg_0 2024-09-12T17:25:04.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.641+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:25:04.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.649+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:25:04.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.653+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:04.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.653+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:04.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.653+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T17:25:04.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.653+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='_5Kv8Gp7BxyA5ZmY6nS94UZqRmCqqiAj', time=2024-09-12T19:15:53.435281+0000, chain.objs.size()=2 2024-09-12T17:25:04.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.653+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15__shadow_.VTjf7ChGdoT_AzEzGrwdFM1i4QClA3E_0 2024-09-12T17:25:04.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.653+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15__shadow_.VTjf7ChGdoT_AzEzGrwdFM1i4QClA3E_1 2024-09-12T17:25:04.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.653+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5490147441496478968', time=2024-09-12T19:17:51.903169+0000, chain.objs.size()=1 2024-09-12T17:25:04.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.653+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21__shadow_.IHCzjaRcNFj5fhVJ5CSXUOD1XLqJCEN_0 2024-09-12T17:25:04.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.653+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8942199781051389575', time=2024-09-12T19:17:51.906336+0000, chain.objs.size()=1 2024-09-12T17:25:04.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.653+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21__shadow_.zsY99D3cFz1KSoTowpZX7qXJamArnY__0 2024-09-12T17:25:04.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.653+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9011102245042594308', time=2024-09-12T19:17:54.732197+0000, chain.objs.size()=1 2024-09-12T17:25:04.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.653+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22__shadow_.DyOiXmAaHOhlYiPQTVsYKZY9NhJX4g__0 2024-09-12T17:25:04.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.653+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7400911134080574206', time=2024-09-12T19:17:56.703849+0000, chain.objs.size()=1 2024-09-12T17:25:04.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.653+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23__shadow_.JxQHJx6BX1KpsAJM0fH5vihjpMMcDLo_0 2024-09-12T17:25:04.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.653+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17938531011167235452', time=2024-09-12T19:19:08.320074+0000, chain.objs.size()=1 2024-09-12T17:25:04.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.653+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27__shadow_.rKEaTrIDc8TCseYMQaVJV3gjXtZcHTI_0 2024-09-12T17:25:04.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.653+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13273706232202291856', time=2024-09-12T19:19:11.781656+0000, chain.objs.size()=1 2024-09-12T17:25:04.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.653+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28__shadow_.-dXk2cCIC-yX_CBRjL0s75OzarD_bDa_0 2024-09-12T17:25:04.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.653+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7688045272052064600', time=2024-09-12T19:19:44.773547+0000, chain.objs.size()=1 2024-09-12T17:25:04.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.653+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29__shadow_.c3iplij21VBYm9K_EiZUEEqDr734r3E_0 2024-09-12T17:25:04.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.653+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18302691349644096205', time=2024-09-12T19:19:47.183754+0000, chain.objs.size()=1 2024-09-12T17:25:04.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.653+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30__shadow_.UVyRPy1FEsYoa58lod8i2Z7x22acc0u_0 2024-09-12T17:25:04.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.653+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.788424788638421581', time=2024-09-12T19:20:22.062709+0000, chain.objs.size()=1 2024-09-12T17:25:04.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.653+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32__shadow_.a6HxkZVVOrHdDOBc-XTU0603plwCKxl_0 2024-09-12T17:25:04.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.653+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12928236298844199207', time=2024-09-12T19:20:22.072453+0000, chain.objs.size()=1 2024-09-12T17:25:04.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.653+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32__shadow_.birXI-6szItSv6R0WtRfoPsWLWV6sZK_0 2024-09-12T17:25:04.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.657+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6365808989982204243', time=2024-09-12T19:20:58.876123+0000, chain.objs.size()=1 2024-09-12T17:25:04.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.657+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34__shadow_.cQTHSEQngCjk11U8PisFsHCKcCPbpLP_0 2024-09-12T17:25:04.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.657+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13606205877008587375', time=2024-09-12T19:21:35.867846+0000, chain.objs.size()=1 2024-09-12T17:25:04.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.657+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36__shadow_.Y_mAs4IHPq1qrmhB0JZykteGcjQH3gf_0 2024-09-12T17:25:04.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.657+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8938402648060175999', time=2024-09-12T19:21:38.718559+0000, chain.objs.size()=1 2024-09-12T17:25:04.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.657+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37__shadow_.6eV3DeLHCZSqwW0XhFrku4zaRlutU3H_0 2024-09-12T17:25:04.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.657+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12564840403956142829', time=2024-09-12T19:22:14.392096+0000, chain.objs.size()=1 2024-09-12T17:25:04.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.657+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39__shadow_.iBVEo5fxW9NNPzD-V5JPspE4eBMnrdG_0 2024-09-12T17:25:04.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.661+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14389292177090573319', time=2024-09-12T19:24:25.413618+0000, chain.objs.size()=1 2024-09-12T17:25:04.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.661+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17__shadow_.WuM-bAfWX21V2wbDNJzaccGvng3R8Zq_0 2024-09-12T17:25:04.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.661+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12149079630383893293', time=2024-09-12T19:24:25.417865+0000, chain.objs.size()=1 2024-09-12T17:25:04.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.661+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17__shadow_.Na2DobCl1uSxJTKo17QAuQTi_OeyjSB_0 2024-09-12T17:25:04.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.661+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7617811976260046301', time=2024-09-12T19:24:34.583940+0000, chain.objs.size()=1 2024-09-12T17:25:04.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.661+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18__shadow:-8fxGuyy901OFe-mgpf5ocYIRqhXIuV_.bGIzYEgQwLgtB7ox8OiagwgWjCcXdQs_0 2024-09-12T17:25:04.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.665+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:25:04.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.669+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:25:04.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.673+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:04.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.673+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:04.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.673+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T17:25:04.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.673+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.666103890830699672', time=2024-09-12T19:15:53.735764+0000, chain.objs.size()=3 2024-09-12T17:25:04.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.673+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13__shadow_.5GF_yVHQpAsmfqo-Or-Mzm4bgj2ulCD_0 2024-09-12T17:25:04.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.677+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13__shadow_.5GF_yVHQpAsmfqo-Or-Mzm4bgj2ulCD_1 2024-09-12T17:25:04.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.677+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13__shadow_.5GF_yVHQpAsmfqo-Or-Mzm4bgj2ulCD_2 2024-09-12T17:25:04.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.677+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8030396360437074141', time=2024-09-12T19:17:16.483252+0000, chain.objs.size()=1 2024-09-12T17:25:04.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.677+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19__shadow_.tEchlrmlUoYt3y3BN-98oA5pUn_V4cZ_0 2024-09-12T17:25:04.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.677+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10539121151703462128', time=2024-09-12T19:17:18.434686+0000, chain.objs.size()=1 2024-09-12T17:25:04.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.677+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20__shadow_.GH_PzDwL_9A0D33cocSlPN1D8f3QcZ3_0 2024-09-12T17:25:04.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.677+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11573716646757407648', time=2024-09-12T19:17:20.136508+0000, chain.objs.size()=1 2024-09-12T17:25:04.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.677+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21__shadow_.77IC8-NyFPFw5w5ng-JHOydbiwryEo4_0 2024-09-12T17:25:04.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.677+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8247478041482209719', time=2024-09-12T19:18:30.812905+0000, chain.objs.size()=1 2024-09-12T17:25:04.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.677+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24__shadow_.9X006-QCg6PokA3xc1RFqzi_zszUClW_0 2024-09-12T17:25:04.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.677+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15249749235535594853', time=2024-09-12T19:18:32.303214+0000, chain.objs.size()=1 2024-09-12T17:25:04.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.677+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25__shadow_.sqHplgYxDLubrWJ8__gzS3hshkevv4W_0 2024-09-12T17:25:04.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.677+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10915123975919117165', time=2024-09-12T19:19:08.305095+0000, chain.objs.size()=1 2024-09-12T17:25:04.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.677+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27__shadow_.0QZNxt-PbsqRme05Mpwfoz786s8VX6E_0 2024-09-12T17:25:04.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.677+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1538864114664243015', time=2024-09-12T19:19:08.309655+0000, chain.objs.size()=1 2024-09-12T17:25:04.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.677+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27__shadow_.kfuerEL0QqTKKiVVz5GngIPSKAWQajf_0 2024-09-12T17:25:04.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.677+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4734931821057846378', time=2024-09-12T19:19:08.322810+0000, chain.objs.size()=1 2024-09-12T17:25:04.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.677+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27__shadow_.vqPwJoO_8sVGBt-XUOQVOSYsTQ4CnZo_0 2024-09-12T17:25:04.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.677+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15121534537766764689', time=2024-09-12T19:19:47.182119+0000, chain.objs.size()=1 2024-09-12T17:25:04.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.677+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30__shadow_.j7y1st4zQQK8QgiqWLscfoanczZuEf1_0 2024-09-12T17:25:04.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.681+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16250572285905932200', time=2024-09-12T19:21:01.974937+0000, chain.objs.size()=1 2024-09-12T17:25:04.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.681+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35__shadow_.WnZLu2oHYXUtqzmlUmU13u8AwMsH0Z4_0 2024-09-12T17:25:04.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.681+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4784115652418335283', time=2024-09-12T19:21:35.857353+0000, chain.objs.size()=1 2024-09-12T17:25:04.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.681+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36__shadow_.l2xUkfgrc4rUYtLxLAoV0X_W2wYQlpY_0 2024-09-12T17:25:04.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.685+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:25:04.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.689+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:25:04.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.693+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:04.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.693+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:04.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.693+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T17:25:04.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.693+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='_aGuxXVwPfIJzGRilXurnGUipB6ZK4Fp', time=2024-09-12T19:15:53.461255+0000, chain.objs.size()=1 2024-09-12T17:25:04.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.693+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15__shadow_.LsY80oeYzSgoh_xIeJexfyzdJMK4Ngi_0 2024-09-12T17:25:04.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.693+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4926913302056726504', time=2024-09-12T19:15:53.574178+0000, chain.objs.size()=5 2024-09-12T17:25:04.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.693+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__multipart_foo-LUKEWARM.2~MbdvBIPWuandBJkHTE3p6BjlCNRHUdB.1 2024-09-12T17:25:04.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.693+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__shadow_foo-LUKEWARM.2~MbdvBIPWuandBJkHTE3p6BjlCNRHUdB.1_1 2024-09-12T17:25:04.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.693+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__multipart_foo-LUKEWARM.2~MbdvBIPWuandBJkHTE3p6BjlCNRHUdB.2 2024-09-12T17:25:04.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.693+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__shadow_foo-LUKEWARM.2~MbdvBIPWuandBJkHTE3p6BjlCNRHUdB.2_1 2024-09-12T17:25:04.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.693+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__multipart_foo-LUKEWARM.2~MbdvBIPWuandBJkHTE3p6BjlCNRHUdB.3 2024-09-12T17:25:04.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.693+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3761543320906296748', time=2024-09-12T19:17:18.450911+0000, chain.objs.size()=1 2024-09-12T17:25:04.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.693+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20__shadow_.VIojY9lPIxwiPQOuc0q2uKD4iibunFb_0 2024-09-12T17:25:04.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.693+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13494375888284503816', time=2024-09-12T19:17:53.830315+0000, chain.objs.size()=1 2024-09-12T17:25:04.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.693+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22__shadow_._uGMvu6I5XFLEiJ_Rglf6CJuV0moszX_0 2024-09-12T17:25:04.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.693+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11528029517369741719', time=2024-09-12T19:17:54.726686+0000, chain.objs.size()=1 2024-09-12T17:25:04.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.693+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22__shadow_.c3aVcsNKe8dwJzHbeEnR-Om5n_mqfix_0 2024-09-12T17:25:04.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.693+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16751281348352614250', time=2024-09-12T19:17:54.745016+0000, chain.objs.size()=1 2024-09-12T17:25:04.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.693+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22__shadow_.eqG1HedsAIgxYNwf2BvmwzZQB2JgLs6_0 2024-09-12T17:25:04.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.693+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12626598310034816752', time=2024-09-12T19:17:56.713139+0000, chain.objs.size()=1 2024-09-12T17:25:04.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.697+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23__shadow_.E-NA-LZrbKkCiIVPl6d8Cz6emKTdbLX_0 2024-09-12T17:25:04.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.697+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11768764751960872087', time=2024-09-12T19:17:56.715014+0000, chain.objs.size()=1 2024-09-12T17:25:04.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.697+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23__shadow_.GQ3Si9SS4E_za6EveK0UIP_Etq1y3G0_0 2024-09-12T17:25:04.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.697+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11282657406242692602', time=2024-09-12T19:17:56.717086+0000, chain.objs.size()=1 2024-09-12T17:25:04.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.697+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23__shadow_.aDPbZA_sGxY7nN0t40MavidHSmUuznG_0 2024-09-12T17:25:04.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.701+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1185571623140549790', time=2024-09-12T19:17:56.727092+0000, chain.objs.size()=1 2024-09-12T17:25:04.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.701+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23__shadow_.yQgwFsTfZkaOGTK2GS9_0mgMBj9-JvC_0 2024-09-12T17:25:04.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.701+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17126275811583012266', time=2024-09-12T19:18:33.443539+0000, chain.objs.size()=1 2024-09-12T17:25:04.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.701+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25__shadow_.bRM4LCygw1hVq8y71eMoZ3i7qB5X1_p_0 2024-09-12T17:25:04.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.701+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16111456435599408931', time=2024-09-12T19:18:33.451903+0000, chain.objs.size()=1 2024-09-12T17:25:04.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.701+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25__shadow_.VJc7044RlBHmBILqIJJhByAdaA9UTjQ_0 2024-09-12T17:25:04.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.701+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16098003337405749723', time=2024-09-12T19:19:08.304953+0000, chain.objs.size()=1 2024-09-12T17:25:04.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.701+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27__shadow_.Nb_lPIRJ2RQmtZdubIaAbafKbkgucrw_0 2024-09-12T17:25:04.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.701+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8840984000149436555', time=2024-09-12T19:19:44.786638+0000, chain.objs.size()=1 2024-09-12T17:25:04.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.701+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29__shadow_.MkN2_TperxywgmMjMqlJpJvR_v6lpoc_0 2024-09-12T17:25:04.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.701+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.623500048103616077', time=2024-09-12T19:19:46.512848+0000, chain.objs.size()=1 2024-09-12T17:25:04.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.701+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30__shadow_.0LxCjCH4n49YmDyAUtfAFMl550xcLmi_0 2024-09-12T17:25:04.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.701+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6322161494247402219', time=2024-09-12T19:19:47.207697+0000, chain.objs.size()=1 2024-09-12T17:25:04.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.701+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30__shadow_.CAoJAPpgcriGTFhWArTpqAQFGBLKP49_0 2024-09-12T17:25:04.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.701+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6894050522225863064', time=2024-09-12T19:19:48.950490+0000, chain.objs.size()=1 2024-09-12T17:25:04.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.701+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31__shadow_.NbKBhu6kB9EZGmsh-jNsOUeNhcDrx8k_0 2024-09-12T17:25:04.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.701+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3013979538789735787', time=2024-09-12T19:21:01.954945+0000, chain.objs.size()=1 2024-09-12T17:25:04.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.701+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35__shadow_.z4BKprq8pGGLO9mowOJucMCfV82ySRL_0 2024-09-12T17:25:04.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.701+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3650457898506807790', time=2024-09-12T19:21:40.890871+0000, chain.objs.size()=1 2024-09-12T17:25:04.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.701+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38__shadow_.8md0vXSLN6W5hEn3Dz0M13Vidz6FTkJ_0 2024-09-12T17:25:04.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.709+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:25:04.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.713+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:25:04.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.717+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:04.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.717+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:04.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.717+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-12T17:25:04.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.717+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7055576976438622482', time=2024-09-12T19:15:53.445431+0000, chain.objs.size()=1 2024-09-12T17:25:04.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.717+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15__shadow_.2ctIW1yUCwFapgTVqIhDSvbPLTENBgJ_0 2024-09-12T17:25:04.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.717+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2153452184064885751', time=2024-09-12T19:15:53.688399+0000, chain.objs.size()=3 2024-09-12T17:25:04.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.717+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14__multipart_foo-STANDARD.2~e8ZRvt4Ap1AW4PK7MST6jOuFpJeem0p.1 2024-09-12T17:25:04.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.717+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14__multipart_foo-STANDARD.2~e8ZRvt4Ap1AW4PK7MST6jOuFpJeem0p.2 2024-09-12T17:25:04.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.717+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14__multipart_foo-STANDARD.2~e8ZRvt4Ap1AW4PK7MST6jOuFpJeem0p.3 2024-09-12T17:25:04.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.717+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1704058952773540494', time=2024-09-12T19:17:16.479165+0000, chain.objs.size()=1 2024-09-12T17:25:04.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.717+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19__shadow_.WgXTFEe_ungTQeujkWDRQ5lQfgz0mDv_0 2024-09-12T17:25:04.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.717+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13934349132460698153', time=2024-09-12T19:17:18.426393+0000, chain.objs.size()=1 2024-09-12T17:25:04.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.717+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20__shadow_.fkELbx10tYFBSRTnjnqMAY6mjk8fKjq_0 2024-09-12T17:25:04.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.717+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13535139954488381951', time=2024-09-12T19:17:18.435946+0000, chain.objs.size()=1 2024-09-12T17:25:04.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.717+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20__shadow_.QaDsuMyfIczc6sNSZJv0m4qefCa2lnU_0 2024-09-12T17:25:04.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.717+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8450939830120985226', time=2024-09-12T19:17:51.906264+0000, chain.objs.size()=1 2024-09-12T17:25:04.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.717+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21__shadow_.QIezZoZyE7FMlo5ixysu9twuzm-BzT4_0 2024-09-12T17:25:04.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.717+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8115643254954512205', time=2024-09-12T19:17:51.910069+0000, chain.objs.size()=1 2024-09-12T17:25:04.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.717+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21__shadow_.fYmm9oA4D8Gj7lVxr9aVsFKqkHZqg-0_0 2024-09-12T17:25:04.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.717+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9662901626764985257', time=2024-09-12T19:18:33.443351+0000, chain.objs.size()=1 2024-09-12T17:25:04.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.717+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25__shadow_._33oqyjYUiHDcVsAb-BKre1qhOGvJk-_0 2024-09-12T17:25:04.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.717+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2456490368939696866', time=2024-09-12T19:18:34.999438+0000, chain.objs.size()=1 2024-09-12T17:25:04.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.717+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26__shadow_.k1kYRJWQsOcMmg-IO_AKhsm9w78E5eR_0 2024-09-12T17:25:04.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.717+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2230588055270873561', time=2024-09-12T19:18:35.000850+0000, chain.objs.size()=1 2024-09-12T17:25:04.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.717+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26__shadow_.ZoH0UN6YUSEylviPP-zbZ9DrA_7l1mJ_0 2024-09-12T17:25:04.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.721+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3328894691818131813', time=2024-09-12T19:19:11.773809+0000, chain.objs.size()=1 2024-09-12T17:25:04.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.721+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28__shadow_.gIKfXWi4INpAdBmKdmkYlwmmAEBM3ty_0 2024-09-12T17:25:04.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.721+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.530718072716235541', time=2024-09-12T19:19:11.788874+0000, chain.objs.size()=1 2024-09-12T17:25:04.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.721+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28__shadow_.wLLavl4qdPqONt4kgNvP2WeVnoVPNKU_0 2024-09-12T17:25:04.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.721+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16951226267841829464', time=2024-09-12T19:19:44.785486+0000, chain.objs.size()=1 2024-09-12T17:25:04.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.721+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29__shadow_.ea4QP2HJcFdV_LuQs3MWRC5FcUbUj5b_0 2024-09-12T17:25:04.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.721+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8677235578757834461', time=2024-09-12T19:19:47.213482+0000, chain.objs.size()=1 2024-09-12T17:25:04.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.721+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30__shadow_.6ZDdEiojQblHvmxkFWhiupwOkAtsBvG_0 2024-09-12T17:25:04.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.721+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11045228280811664201', time=2024-09-12T19:20:22.068944+0000, chain.objs.size()=1 2024-09-12T17:25:04.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.721+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32__shadow_.UVBlRClPaiRoJjWoiDOat0Qg_YgOZdd_0 2024-09-12T17:25:04.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.721+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13790878685962817978', time=2024-09-12T19:21:35.860712+0000, chain.objs.size()=1 2024-09-12T17:25:04.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.721+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36__shadow_._eQGG3kOI7EHxvfLh9kGTcAhk5Ngw80_0 2024-09-12T17:25:04.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.721+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12051162410177949945', time=2024-09-12T19:21:35.874844+0000, chain.objs.size()=1 2024-09-12T17:25:04.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.721+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36__shadow_.vMhScuPsDqsGimL1yUcthybukR7qESV_0 2024-09-12T17:25:04.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.721+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17953935044802548306', time=2024-09-12T19:21:35.890672+0000, chain.objs.size()=1 2024-09-12T17:25:04.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.721+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36__shadow_.T_g-z0bvvkEf7zINdjaT6eADJH-Eqlz_0 2024-09-12T17:25:04.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.721+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7787758341659430487', time=2024-09-12T19:21:38.725150+0000, chain.objs.size()=1 2024-09-12T17:25:04.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.721+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37__shadow_.VMe3ApwJ8G5zlV6CQQOHi2HmPY3dGKc_0 2024-09-12T17:25:04.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.721+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4060824410788356825', time=2024-09-12T19:21:38.730232+0000, chain.objs.size()=1 2024-09-12T17:25:04.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.721+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37__shadow_.e1nX1JTTnXM1IwVJGmR2sOhg_O43iWx_0 2024-09-12T17:25:04.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.725+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.677988650115928067', time=2024-09-12T19:21:40.907150+0000, chain.objs.size()=1 2024-09-12T17:25:04.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.725+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38__shadow_.ICZmSFujo-FelAXvEcdk7sYBHF5RReo_0 2024-09-12T17:25:04.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.725+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1939787796868305762', time=2024-09-12T19:24:25.418593+0000, chain.objs.size()=1 2024-09-12T17:25:04.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.725+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17__shadow_.B9pmplb0W54hlBG0y3GLzz92ZLBTO7o_0 2024-09-12T17:25:04.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.729+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:25:04.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.733+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:25:04.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.737+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:04.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.737+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:04.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.737+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T17:25:04.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.737+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5356194588156872630', time=2024-09-12T19:17:16.492292+0000, chain.objs.size()=1 2024-09-12T17:25:04.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.737+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19__shadow_.qlXt904ZAeWtARqCQRHUE9BhT5hiK1U_0 2024-09-12T17:25:04.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.737+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4868339106202335360', time=2024-09-12T19:17:18.433435+0000, chain.objs.size()=1 2024-09-12T17:25:04.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.737+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20__shadow_.o5t3NAclA8tsnP2DLHKMYUN2vI5p-wX_0 2024-09-12T17:25:04.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.737+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4589131746740896472', time=2024-09-12T19:17:51.888524+0000, chain.objs.size()=1 2024-09-12T17:25:04.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.737+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21__shadow_.bHdsRuHv7YxOqigo_krrEk4UvngUy8O_0 2024-09-12T17:25:04.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.737+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17681948176722191468', time=2024-09-12T19:17:56.711194+0000, chain.objs.size()=1 2024-09-12T17:25:04.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.737+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23__shadow_.pl75CaML4GnCPmoM2fZaW7QCL7nNM4S_0 2024-09-12T17:25:04.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.737+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1775842767515213806', time=2024-09-12T19:18:30.802116+0000, chain.objs.size()=1 2024-09-12T17:25:04.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.737+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24__shadow_.E7XAq2X1JTJWIEs-YLqZeL97gq7iUdb_0 2024-09-12T17:25:04.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.737+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13625915389204879312', time=2024-09-12T19:19:11.773843+0000, chain.objs.size()=1 2024-09-12T17:25:04.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.737+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28__shadow_.ya7rqMgtD2hgqEjC1eL_zShMZsoo6eX_0 2024-09-12T17:25:04.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.741+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13198911797920348018', time=2024-09-12T19:19:44.768583+0000, chain.objs.size()=1 2024-09-12T17:25:04.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.741+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29__shadow_.m9e7op5jYNHiljkkcGPFWUJrJHS9EE5_0 2024-09-12T17:25:04.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.741+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17223244994091423363', time=2024-09-12T19:19:48.922166+0000, chain.objs.size()=1 2024-09-12T17:25:04.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.741+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31__shadow_.K13xY-ppT6yY3rC_LM-bMehkWjcuUzh_0 2024-09-12T17:25:04.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.741+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18328287074682395948', time=2024-09-12T19:19:48.924772+0000, chain.objs.size()=1 2024-09-12T17:25:04.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.741+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31__shadow_.Jk6YjMTwfEPbQhenf2ggjNVRsSCP5lr_0 2024-09-12T17:25:04.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.741+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3168585866067306519', time=2024-09-12T19:19:48.957299+0000, chain.objs.size()=1 2024-09-12T17:25:04.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.741+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31__shadow_.g_BpyfL_fkfF15OtAqzJicMKKKLLmQX_0 2024-09-12T17:25:04.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.741+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2875870073768052779', time=2024-09-12T19:20:25.189561+0000, chain.objs.size()=1 2024-09-12T17:25:04.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.741+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33__shadow_.KDagk7nkYmlupdhlN4UZjd6mn8-mBoo_0 2024-09-12T17:25:04.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.741+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8989651427808885579', time=2024-09-12T19:21:01.970538+0000, chain.objs.size()=1 2024-09-12T17:25:04.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.741+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35__shadow_.N1wzmlQ2yo87zOLEN2KW19-3o1s_nyq_0 2024-09-12T17:25:04.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.745+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16529536047948435520', time=2024-09-12T19:21:38.731352+0000, chain.objs.size()=1 2024-09-12T17:25:04.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.745+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37__shadow_.iPSRMynzkV86yWRfLXZSEc3VdSz0eaG_0 2024-09-12T17:25:04.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.745+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3707180403505497036', time=2024-09-12T19:21:38.734789+0000, chain.objs.size()=1 2024-09-12T17:25:04.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.745+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37__shadow_.FIk44bkxytEjFYfm-VsGbODzemv-GEh_0 2024-09-12T17:25:04.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.745+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15846181212962729474', time=2024-09-12T19:24:25.408243+0000, chain.objs.size()=1 2024-09-12T17:25:04.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.745+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17__shadow_.YipPXhumhy7gcOWca60Kqkn4HtA-07b_0 2024-09-12T17:25:04.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.749+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:25:04.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.753+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:25:04.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.757+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:04.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.757+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:04.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.757+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T17:25:04.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.757+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='_Gi7C4iKCjemNJKVChAu0rc6Ky7tZjDq', time=2024-09-12T19:15:53.618984+0000, chain.objs.size()=1 2024-09-12T17:25:04.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.757+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__shadow_.5yZn2Cz-VFgXaU-_l7WePUcuqVM4Bfo_0 2024-09-12T17:25:04.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.757+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9385720992331220904', time=2024-09-12T19:17:51.890545+0000, chain.objs.size()=1 2024-09-12T17:25:04.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.757+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21__shadow_.KnWpLFI81UPsjtWrnmc4FZkFddwWLCW_0 2024-09-12T17:25:04.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.757+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8957304313536007978', time=2024-09-12T19:17:54.724002+0000, chain.objs.size()=1 2024-09-12T17:25:04.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.757+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22__shadow_.0kHpHotvG6LReFaLtpE4oPnbLQEd5iU_0 2024-09-12T17:25:04.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.757+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15646271576905957050', time=2024-09-12T19:17:56.742125+0000, chain.objs.size()=1 2024-09-12T17:25:04.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.757+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23__shadow_.wGhs2U4nTJUAUxkjjBvZHQ3G10LwLfN_0 2024-09-12T17:25:04.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.757+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8062687231673070866', time=2024-09-12T19:18:33.426485+0000, chain.objs.size()=1 2024-09-12T17:25:04.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.757+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25__shadow_.auTIsv1WoeSkC92E-bPcHN3Do5bTmdB_0 2024-09-12T17:25:04.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.757+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15891642758165310018', time=2024-09-12T19:19:11.760869+0000, chain.objs.size()=1 2024-09-12T17:25:04.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.757+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28__shadow_.P4lXMXH0WWJCQ1gmnwaNUOhCggp3Aw0_0 2024-09-12T17:25:04.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.757+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13581934867689811054', time=2024-09-12T19:20:22.057195+0000, chain.objs.size()=1 2024-09-12T17:25:04.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.757+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32__shadow_.YYK7zA7986bQjOShZ0-a9rGMtvzphy-_0 2024-09-12T17:25:04.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.757+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11832190561511479262', time=2024-09-12T19:20:25.212205+0000, chain.objs.size()=1 2024-09-12T17:25:04.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.757+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33__shadow_.oOVOrpYFDFYGq1UmWMt17Zw45AN5CI9_0 2024-09-12T17:25:04.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.757+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6454289816169535750', time=2024-09-12T19:20:58.895644+0000, chain.objs.size()=1 2024-09-12T17:25:04.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.757+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34__shadow_.D7W2eOPIKLLHcsO8WQS0uX-zmW24ngH_0 2024-09-12T17:25:04.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.757+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9325112387692551198', time=2024-09-12T19:21:40.898349+0000, chain.objs.size()=1 2024-09-12T17:25:04.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.757+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38__shadow_.TbXTiNZazkiCo4ucUwnfe9qhxEi5pRz_0 2024-09-12T17:25:04.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.757+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11983586021274055383', time=2024-09-12T19:22:14.416481+0000, chain.objs.size()=1 2024-09-12T17:25:04.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.757+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39__shadow_.cIWaILWwb3A1poLc6JO4exxmnN-Vpx0_0 2024-09-12T17:25:04.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.757+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15974927215228668168', time=2024-09-12T19:22:14.418347+0000, chain.objs.size()=1 2024-09-12T17:25:04.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.757+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39__shadow_.s9L6whBB98QKiuXvl2oMF-2jKzcRZGQ_0 2024-09-12T17:25:04.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.761+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10814135142865053991', time=2024-09-12T19:24:25.410067+0000, chain.objs.size()=1 2024-09-12T17:25:04.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.761+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17__shadow_.UGvG9AdYUNcT076b1GKIsif39hRiq-3_0 2024-09-12T17:25:04.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.765+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:25:04.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.773+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:25:04.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.773+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:04.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.777+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:04.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.777+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T17:25:04.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.777+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18338925916482239656', time=2024-09-12T19:17:16.466544+0000, chain.objs.size()=1 2024-09-12T17:25:04.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.777+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19__shadow_.TOgpvqnAAMplhNRFsp6hUDAW0n4SE9b_0 2024-09-12T17:25:04.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.777+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3981563319446434442', time=2024-09-12T19:19:11.767173+0000, chain.objs.size()=1 2024-09-12T17:25:04.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.777+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28__shadow_.iEdeCpzoxLQ3QhcYoXzGzH_Wg3CyUxu_0 2024-09-12T17:25:04.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.777+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1867727996105881543', time=2024-09-12T19:19:44.761378+0000, chain.objs.size()=1 2024-09-12T17:25:04.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.777+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29__shadow_.VJDy1Mcf-Fvk9m80va_Iv3NaScOwiNc_0 2024-09-12T17:25:04.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.777+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6380300106142393208', time=2024-09-12T19:20:23.875432+0000, chain.objs.size()=1 2024-09-12T17:25:04.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.777+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33__shadow_.nWXHuy-OGQO1h4jQ1xdWG9KAvbJw73q_0 2024-09-12T17:25:04.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.777+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16434914287447864518', time=2024-09-12T19:20:58.874838+0000, chain.objs.size()=1 2024-09-12T17:25:04.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.777+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34__shadow_.pqUvrRqxHag9ed-F47XQh3wGY7lRAyn_0 2024-09-12T17:25:04.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.777+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6061085509029291029', time=2024-09-12T19:21:35.875302+0000, chain.objs.size()=1 2024-09-12T17:25:04.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.777+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36__shadow_.CTFSNI9cPVP2CjGaRiuv5-8oEnBakts_0 2024-09-12T17:25:04.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.777+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5776722673147538423', time=2024-09-12T19:21:38.720351+0000, chain.objs.size()=1 2024-09-12T17:25:04.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.777+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37__shadow_.fojxii3NbwK7bXxInhnZbvccE54OjXB_0 2024-09-12T17:25:04.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.781+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:25:04.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.785+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:25:04.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.789+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:04.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.789+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:04.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.789+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-12T17:25:04.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.789+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15684031463923456818', time=2024-09-12T19:15:53.111354+0000, chain.objs.size()=1 2024-09-12T17:25:04.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.789+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4__shadow_.dF4WGEOLPIkBA2_GwmmfofevS_m0Pcg_0 2024-09-12T17:25:04.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.789+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17206564256404214808', time=2024-09-12T19:17:15.343698+0000, chain.objs.size()=1 2024-09-12T17:25:04.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.789+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19__shadow_.VUYW8VHhFadbOQl8ZXTk07AMq8iq8X2_0 2024-09-12T17:25:04.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.789+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15650706053671664196', time=2024-09-12T19:17:18.427115+0000, chain.objs.size()=1 2024-09-12T17:25:04.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.789+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20__shadow_.h-fE0OT_-kDG94jwczXpxTxb6D2XExu_0 2024-09-12T17:25:04.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.789+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5802367636076241356', time=2024-09-12T19:17:54.722890+0000, chain.objs.size()=1 2024-09-12T17:25:04.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.789+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22__shadow_.oI-3D9qrbLCDHth2Hru5H_axjLW9iEt_0 2024-09-12T17:25:04.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.789+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4929225157162047207', time=2024-09-12T19:17:56.701880+0000, chain.objs.size()=1 2024-09-12T17:25:04.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.789+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23__shadow_.4RQkZYfJt7w-QcHloiKjTu7vDeO_2Qm_0 2024-09-12T17:25:04.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.789+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4618958691922027818', time=2024-09-12T19:18:30.811533+0000, chain.objs.size()=1 2024-09-12T17:25:04.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.789+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24__shadow_.eIzbdkg5U2jWzMZk28epSRqobSrSlWg_0 2024-09-12T17:25:04.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.789+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12213789026725348034', time=2024-09-12T19:18:34.988319+0000, chain.objs.size()=1 2024-09-12T17:25:04.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.789+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26__shadow_.dClRZ_4YMcospO1RaoA80AqiGlWERtQ_0 2024-09-12T17:25:04.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.789+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7165429355617925682', time=2024-09-12T19:18:35.002559+0000, chain.objs.size()=1 2024-09-12T17:25:04.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.789+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26__shadow_.9iJdgGswXnLXYFiWtnPrqbxIBHwhXl5_0 2024-09-12T17:25:04.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.789+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6454312601149342080', time=2024-09-12T19:18:35.016572+0000, chain.objs.size()=1 2024-09-12T17:25:04.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.789+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26__shadow_.o1B7yxeK9GbN90EBbvej1dryGbIOf0u_0 2024-09-12T17:25:04.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.789+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15189119100057383369', time=2024-09-12T19:18:37.181638+0000, chain.objs.size()=1 2024-09-12T17:25:04.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.789+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27__shadow_.P0bErtU-ufkubdsaZs5yDNhMkoOfT7R_0 2024-09-12T17:25:04.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.789+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10307715217430836138', time=2024-09-12T19:19:08.302677+0000, chain.objs.size()=1 2024-09-12T17:25:04.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.789+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27__shadow_.T5UuJQgbgbi9NcCkAEIo9-wRwP1CSBw_0 2024-09-12T17:25:04.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.789+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4489354868452570596', time=2024-09-12T19:19:08.320059+0000, chain.objs.size()=1 2024-09-12T17:25:04.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.789+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27__shadow_.gTajtClZjJfszOXLAnGe1aPlNJl1x7A_0 2024-09-12T17:25:04.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.793+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7336424528026132303', time=2024-09-12T19:19:44.761801+0000, chain.objs.size()=1 2024-09-12T17:25:04.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.793+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29__shadow_.GJRIyKiW2-Q0ESKmuB7LoYMfzMQPMii_0 2024-09-12T17:25:04.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.797+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16384051409235574938', time=2024-09-12T19:19:44.787521+0000, chain.objs.size()=1 2024-09-12T17:25:04.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.797+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29__shadow_.zmkhU069AvD4PzGjcEscMHGaI7uSf1u_0 2024-09-12T17:25:04.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.797+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14563376666340634298', time=2024-09-12T19:20:22.076803+0000, chain.objs.size()=1 2024-09-12T17:25:04.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.797+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32__shadow_.vPVt4zcyh4L8XMkRkab6x6fiinxo8PP_0 2024-09-12T17:25:04.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.797+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6163254556792379355', time=2024-09-12T19:20:25.211299+0000, chain.objs.size()=1 2024-09-12T17:25:04.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.797+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33__shadow_.sme0Sheo3Brfufyos9-oK5EBQMgHpf2_0 2024-09-12T17:25:04.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.797+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15630656697381150944', time=2024-09-12T19:20:58.873034+0000, chain.objs.size()=1 2024-09-12T17:25:04.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.797+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.34__shadow_.1l_j6p0uIRz4QTGwR4ovlfz5u1hF7K0_0 2024-09-12T17:25:04.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.797+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12607549068327854613', time=2024-09-12T19:21:40.886146+0000, chain.objs.size()=1 2024-09-12T17:25:04.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.797+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38__shadow_.MGJI0zQEJhrJ4JCz4JdsgKzKc-FmjWN_0 2024-09-12T17:25:04.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.797+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2416999257251906688', time=2024-09-12T19:21:40.907261+0000, chain.objs.size()=1 2024-09-12T17:25:04.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.797+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.38__shadow_.t7f8i_2bSgclmn5TL6aSAFJUhrgwJAw_0 2024-09-12T17:25:04.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.797+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12175887984503072576', time=2024-09-12T19:22:14.394336+0000, chain.objs.size()=1 2024-09-12T17:25:04.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.797+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39__shadow_.gbrVYilcqZjInzgHaE6cycghLVfbyxb_0 2024-09-12T17:25:04.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.797+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13787180741722544372', time=2024-09-12T19:22:14.407945+0000, chain.objs.size()=1 2024-09-12T17:25:04.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.797+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39__shadow_.s1xT1d41dqwNULdH2IQhwtRy-L4LLVr_0 2024-09-12T17:25:04.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.801+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:25:04.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.805+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:25:04.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.809+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:04.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.809+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:04.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.813+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T17:25:04.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.813+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18385800555637969578', time=2024-09-12T19:15:53.100736+0000, chain.objs.size()=1 2024-09-12T17:25:04.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.813+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4__shadow_.aWawq9jhJExKZgp9IgmVcPRGqAh7WLf_0 2024-09-12T17:25:04.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.813+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.685641654530745675', time=2024-09-12T19:15:53.190749+0000, chain.objs.size()=7 2024-09-12T17:25:04.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.813+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11__multipart_foo.2~XlrIrIScTl2tZbJxmdGdEq-Viu3jvgw.1 2024-09-12T17:25:04.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.813+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11__shadow_foo.2~XlrIrIScTl2tZbJxmdGdEq-Viu3jvgw.1_1 2024-09-12T17:25:04.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.813+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11__multipart_foo.2~XlrIrIScTl2tZbJxmdGdEq-Viu3jvgw.2 2024-09-12T17:25:04.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.813+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11__shadow_foo.2~XlrIrIScTl2tZbJxmdGdEq-Viu3jvgw.2_1 2024-09-12T17:25:04.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.813+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11__multipart_foo.2~XlrIrIScTl2tZbJxmdGdEq-Viu3jvgw.3 2024-09-12T17:25:04.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.813+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11__shadow_foo.2~XlrIrIScTl2tZbJxmdGdEq-Viu3jvgw.3_1 2024-09-12T17:25:04.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.813+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11__multipart_foo.2~XlrIrIScTl2tZbJxmdGdEq-Viu3jvgw.4 2024-09-12T17:25:04.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.813+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18034227417402079385', time=2024-09-12T19:17:16.466041+0000, chain.objs.size()=1 2024-09-12T17:25:04.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.813+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19__shadow_.6KOlCX9clOEAN277mt4vc7HeMFwK21R_0 2024-09-12T17:25:04.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.813+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10017366954186147126', time=2024-09-12T19:17:18.458967+0000, chain.objs.size()=1 2024-09-12T17:25:04.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.813+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20__shadow_.xYq5epA3qtOTZ9TG5VBMZPyTPdspRka_0 2024-09-12T17:25:04.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.813+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8805420709740427721', time=2024-09-12T19:18:30.809140+0000, chain.objs.size()=1 2024-09-12T17:25:04.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.813+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24__shadow_.yl3kA7g7sk43wFYQeQp4c0kwBsoqjOL_0 2024-09-12T17:25:04.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.813+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7576110747300913101', time=2024-09-12T19:18:33.441058+0000, chain.objs.size()=1 2024-09-12T17:25:04.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.813+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25__shadow_.sJwklnwQ5C86xhNFKOEHNOl0jCVPWTh_0 2024-09-12T17:25:04.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.817+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8427637996346700035', time=2024-09-12T19:19:08.299961+0000, chain.objs.size()=1 2024-09-12T17:25:04.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.817+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27__shadow_._0H9PTHKiOCxmBcW-z9ig9d8zqEMHuD_0 2024-09-12T17:25:04.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.821+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11223330225861914291', time=2024-09-12T19:19:47.196681+0000, chain.objs.size()=1 2024-09-12T17:25:04.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.821+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30__shadow_.0rD3_fMlAqYKMfSc_IE0sRxUBJaYavw_0 2024-09-12T17:25:04.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.821+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14826970099767434599', time=2024-09-12T19:19:48.940393+0000, chain.objs.size()=1 2024-09-12T17:25:04.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.821+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31__shadow_.rgEaJgEmcbSS-eItOVGZlihZQ34tkxv_0 2024-09-12T17:25:04.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.821+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2021767222201309494', time=2024-09-12T19:20:22.062637+0000, chain.objs.size()=1 2024-09-12T17:25:04.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.821+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32__shadow_.R8niZQRPiIbcZe5UvpPsWjMZk-pwo5A_0 2024-09-12T17:25:04.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.821+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4730457411521215697', time=2024-09-12T19:21:01.964727+0000, chain.objs.size()=1 2024-09-12T17:25:04.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.821+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35__shadow_.PVVTf05XGKdjBMYHsoJWnl9JEqAs1LH_0 2024-09-12T17:25:04.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.821+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11376097259803898294', time=2024-09-12T19:21:01.989091+0000, chain.objs.size()=1 2024-09-12T17:25:04.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.821+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35__shadow_.hFja_44BXnt5WAb_Tr0DKn31Q-zWApT_0 2024-09-12T17:25:04.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.825+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:25:04.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.829+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:25:04.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.833+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:04.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.833+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:04.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.833+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-12T17:25:04.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.833+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17655400658008050371', time=2024-09-12T19:15:53.327545+0000, chain.objs.size()=4 2024-09-12T17:25:04.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.833+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9__multipart_foo.2~4FS_tgtQo81zJMYD_VBsjlE7-HuWZlC.1 2024-09-12T17:25:04.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.833+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9__multipart_foo.2~4FS_tgtQo81zJMYD_VBsjlE7-HuWZlC.2 2024-09-12T17:25:04.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.833+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9__multipart_foo.2~4FS_tgtQo81zJMYD_VBsjlE7-HuWZlC.3 2024-09-12T17:25:04.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.833+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9__multipart_foo.2~4FS_tgtQo81zJMYD_VBsjlE7-HuWZlC.4 2024-09-12T17:25:04.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.833+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9183638150240891621', time=2024-09-12T19:17:16.477666+0000, chain.objs.size()=1 2024-09-12T17:25:04.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.833+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19__shadow_.WAfa0DFAX-R7-MUDHne5KehNRpNPPJL_0 2024-09-12T17:25:04.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.833+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5042895918849546418', time=2024-09-12T19:17:51.906456+0000, chain.objs.size()=1 2024-09-12T17:25:04.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.833+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21__shadow_.SoypbA3VASeHMuNg2hmi9G2hhflD2fU_0 2024-09-12T17:25:04.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.833+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1873869480179270618', time=2024-09-12T19:18:35.020853+0000, chain.objs.size()=1 2024-09-12T17:25:04.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.833+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.26__shadow_.k6JQiK3szEu7NkuaBvrou0g0tEI_u33_0 2024-09-12T17:25:04.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.833+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18097243507488742337', time=2024-09-12T19:19:08.310761+0000, chain.objs.size()=1 2024-09-12T17:25:04.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.833+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27__shadow_.3DHdkR3QoCPQKvtbUQpXa2bkWpMs3w8_0 2024-09-12T17:25:04.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.833+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9896911757527099293', time=2024-09-12T19:19:08.311834+0000, chain.objs.size()=1 2024-09-12T17:25:04.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.833+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27__shadow_.MCLy_vg5catPzCLGETY6_7vTIZ4YLeF_0 2024-09-12T17:25:04.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.833+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15156317085058530878', time=2024-09-12T19:19:11.790735+0000, chain.objs.size()=1 2024-09-12T17:25:04.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.833+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28__shadow_.zzHvKRf9kGl6iU6CsLmay-Oaf1FRLwV_0 2024-09-12T17:25:04.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.833+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16158746040562706561', time=2024-09-12T19:20:25.207844+0000, chain.objs.size()=1 2024-09-12T17:25:04.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.833+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33__shadow_.QYBu0M9uWleXsAvXarM9AiGWS9bp2FP_0 2024-09-12T17:25:04.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.833+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.51132694464222212', time=2024-09-12T19:20:25.217628+0000, chain.objs.size()=1 2024-09-12T17:25:04.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.833+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.33__shadow_.khIpRR18pNYPQfh6J80B3ry5bJCPD0C_0 2024-09-12T17:25:04.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.841+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:25:04.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.845+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:25:04.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.849+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:04.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.849+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:04.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.849+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T17:25:04.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.849+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3809414696627365214', time=2024-09-12T19:15:53.128797+0000, chain.objs.size()=1 2024-09-12T17:25:04.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.849+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4__shadow_.a02GljzmJnmfjj0vCADyowEVxkI75HC_0 2024-09-12T17:25:04.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.849+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3107612948714270822', time=2024-09-12T19:15:53.404338+0000, chain.objs.size()=2 2024-09-12T17:25:04.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.849+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15__shadow_.gNEl_t_G4qGLCCwWX4kky53MX7zSYVS_0 2024-09-12T17:25:04.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.849+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15__shadow_.gNEl_t_G4qGLCCwWX4kky53MX7zSYVS_1 2024-09-12T17:25:04.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.849+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1456882589075796249', time=2024-09-12T19:15:53.470580+0000, chain.objs.size()=1 2024-09-12T17:25:04.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.849+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15__shadow_.2ctIW1yUCwFapgTVqIhDSvbPLTENBgJ_0 2024-09-12T17:25:04.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.849+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13289166375729440694', time=2024-09-12T19:17:16.481103+0000, chain.objs.size()=1 2024-09-12T17:25:04.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.849+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19__shadow_.EXGBNppd2uhCVN3mnFbQ_zMi9l9p8Uo_0 2024-09-12T17:25:04.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.849+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11926948142825734314', time=2024-09-12T19:17:18.437211+0000, chain.objs.size()=1 2024-09-12T17:25:04.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.849+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20__shadow_.Mh99Ay2r9QisdWUDPF2tawv4uRDZ0al_0 2024-09-12T17:25:04.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.849+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14441939205121817494', time=2024-09-12T19:17:18.451029+0000, chain.objs.size()=1 2024-09-12T17:25:04.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.849+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.20__shadow_.P2eYllvR_XLcQvP6v0vqwSRWZsbtPyV_0 2024-09-12T17:25:04.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.849+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4912107441787627694', time=2024-09-12T19:18:30.826275+0000, chain.objs.size()=1 2024-09-12T17:25:04.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.849+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.24__shadow_.POC8Bdwoy7YKiGef01tDssTNLeeR17A_0 2024-09-12T17:25:04.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.849+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5361568115330699416', time=2024-09-12T19:18:33.430683+0000, chain.objs.size()=1 2024-09-12T17:25:04.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.849+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25__shadow_.InDdHKY2I1Wfx4bRaHAahAVKjQLfBpS_0 2024-09-12T17:25:04.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.849+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16036804189469975482', time=2024-09-12T19:18:33.436174+0000, chain.objs.size()=1 2024-09-12T17:25:04.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.849+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25__shadow_.XICKCQjjrWg0iFghF8q6T9kizOd4e5Q_0 2024-09-12T17:25:04.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.849+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3589269473040795378', time=2024-09-12T19:19:08.297861+0000, chain.objs.size()=1 2024-09-12T17:25:04.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.849+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.27__shadow_.VxhkfTOuUczNFgGCMoXOWciz2KrWPaB_0 2024-09-12T17:25:04.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.849+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8386581268781070254', time=2024-09-12T19:19:44.765420+0000, chain.objs.size()=1 2024-09-12T17:25:04.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.849+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29__shadow_.F9MTMNsdOJpLxMntSZ7pD74_YD8PcTK_0 2024-09-12T17:25:04.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.857+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14342146070255062408', time=2024-09-12T19:19:47.198341+0000, chain.objs.size()=1 2024-09-12T17:25:04.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.857+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30__shadow_.gq9000v74JC_eABH66R809fF6WXn-lJ_0 2024-09-12T17:25:04.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.857+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.468202530625193253', time=2024-09-12T19:19:48.932309+0000, chain.objs.size()=1 2024-09-12T17:25:04.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.857+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31__shadow_.JNg6PLTu49DFeZ7uDpVmBzIjkBAZfUd_0 2024-09-12T17:25:04.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.857+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17397560060465122952', time=2024-09-12T19:21:01.949806+0000, chain.objs.size()=1 2024-09-12T17:25:04.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.857+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.35__shadow_.NLqhw-LZoeszESPEXTwSE3c9uqZpUyX_0 2024-09-12T17:25:04.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.857+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16602124934840000320', time=2024-09-12T19:21:38.732232+0000, chain.objs.size()=1 2024-09-12T17:25:04.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.857+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37__shadow_.zPmAee68TD7Aw-55D8oF8CXSA9B3rEx_0 2024-09-12T17:25:04.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.857+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8888953961173800892', time=2024-09-12T19:24:40.345690+0000, chain.objs.size()=1 2024-09-12T17:25:04.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.857+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18__shadow:YpfAgUtQ24whG8q3P.TS6uy7azG4AYQ_.25mi3UM-YqCM4dsTZiCMH0jhf8dQGh3_0 2024-09-12T17:25:04.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.861+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:25:04.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.869+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:25:04.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.869+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:04.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.873+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:04.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.873+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T17:25:04.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.873+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='_zy-nq8PiCK04aj7zzybwRKKRZg41tpN', time=2024-09-12T19:15:53.587516+0000, chain.objs.size()=3 2024-09-12T17:25:04.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.873+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__shadow_.4xJ49Rooxz0Ox9zoS1tbn01vv2arIP7_0 2024-09-12T17:25:04.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.873+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__shadow_.4xJ49Rooxz0Ox9zoS1tbn01vv2arIP7_1 2024-09-12T17:25:04.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.873+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16__shadow_.4xJ49Rooxz0Ox9zoS1tbn01vv2arIP7_2 2024-09-12T17:25:04.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.873+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13600546798847008826', time=2024-09-12T19:17:16.467629+0000, chain.objs.size()=1 2024-09-12T17:25:04.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.873+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.19__shadow_.pwFOX5_DFSRnAYcOu-wZjzUwVIr42-Z_0 2024-09-12T17:25:04.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.873+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14855621458103000201', time=2024-09-12T19:17:51.902812+0000, chain.objs.size()=1 2024-09-12T17:25:04.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.873+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.21__shadow_.5981Xd35KsTDmnud8a6Ln5OQ_tsm454_0 2024-09-12T17:25:04.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.873+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6947819069483750995', time=2024-09-12T19:17:54.740822+0000, chain.objs.size()=1 2024-09-12T17:25:04.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.873+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22__shadow_.32hGhOuu06aYnUrUoD183VdWcR_1wOY_0 2024-09-12T17:25:04.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.873+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11153157901902757568', time=2024-09-12T19:18:33.433768+0000, chain.objs.size()=1 2024-09-12T17:25:04.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.873+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25__shadow_.hj1xm1oR-UE6BH7CZiKhD-TvujTQkCK_0 2024-09-12T17:25:04.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.873+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1513309557209627282', time=2024-09-12T19:18:33.435519+0000, chain.objs.size()=1 2024-09-12T17:25:04.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.873+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.25__shadow_.ngn0YczVRaBmrweq3UAgQqIxN0ddvMf_0 2024-09-12T17:25:04.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.873+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7816290277494787953', time=2024-09-12T19:19:11.761100+0000, chain.objs.size()=1 2024-09-12T17:25:04.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.873+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.28__shadow_.VmihK7n5JU6jNISffEnTCoEGg5sPahv_0 2024-09-12T17:25:04.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.873+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1963215731869191113', time=2024-09-12T19:19:44.800200+0000, chain.objs.size()=1 2024-09-12T17:25:04.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.873+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.29__shadow_.XRUpotAEGVn4wO4y70zXHkWSbwHysxt_0 2024-09-12T17:25:04.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.873+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11873410348786522139', time=2024-09-12T19:19:47.186670+0000, chain.objs.size()=1 2024-09-12T17:25:04.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.873+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30__shadow_.xLRglTDZSYS6XiC51_419J0mjuuuTPe_0 2024-09-12T17:25:04.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.873+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11471805584666256377', time=2024-09-12T19:19:48.920363+0000, chain.objs.size()=1 2024-09-12T17:25:04.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.873+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31__shadow_.7inViYtJmoxdAGQvFSY6UeXtrNleAY3_0 2024-09-12T17:25:04.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.877+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12553590478017361641', time=2024-09-12T19:19:48.943903+0000, chain.objs.size()=1 2024-09-12T17:25:04.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.877+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31__shadow_.O1b6nTM8y5MGidV0B_YSp77OuKcWZb8_0 2024-09-12T17:25:04.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.877+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1489237565347832283', time=2024-09-12T19:20:22.057656+0000, chain.objs.size()=1 2024-09-12T17:25:04.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.877+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32__shadow_.N9TpGjyBmwk-O2cvz8OVP7lecTPGU4G_0 2024-09-12T17:25:04.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.877+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1893534393086137845', time=2024-09-12T19:20:22.063073+0000, chain.objs.size()=1 2024-09-12T17:25:04.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.877+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.32__shadow_.5YJUGivf9E-whz8jRiLHWMCjLCDhgUr_0 2024-09-12T17:25:04.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.877+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10634130712130870388', time=2024-09-12T19:21:35.873057+0000, chain.objs.size()=1 2024-09-12T17:25:04.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.877+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.36__shadow_.tWC_YUwwUeo4TzrnVqVij3c_QBVZ5Xt_0 2024-09-12T17:25:04.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.881+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13138858661453883998', time=2024-09-12T19:22:14.386447+0000, chain.objs.size()=1 2024-09-12T17:25:04.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.881+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.39__shadow_.QSWSUvRIM1l3HdKDYt5ELkotNJpeitc_0 2024-09-12T17:25:04.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.881+0000 7f4c3e9129c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13800921055216806418', time=2024-09-12T19:24:40.347226+0000, chain.objs.size()=1 2024-09-12T17:25:04.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.881+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18__shadow:mPPcFBGCf2xwfHLZax0fRwAeKocyCQc_.u7sUpdkbKTruAoU5br14mc9d3tGRC3O_0 2024-09-12T17:25:04.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.881+0000 7f4c3e9129c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:25:04.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.889+0000 7f4af37de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:04.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.893+0000 7f4c3e9129c0 20 remove_watcher() i=0 2024-09-12T17:25:04.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.893+0000 7f4c3e9129c0 2 removed watcher, disabling cache 2024-09-12T17:25:04.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.897+0000 7f4c3e9129c0 20 remove_watcher() i=1 2024-09-12T17:25:04.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.901+0000 7f4c3e9129c0 20 remove_watcher() i=2 2024-09-12T17:25:04.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.901+0000 7f4c3e9129c0 20 remove_watcher() i=3 2024-09-12T17:25:04.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.905+0000 7f4c3e9129c0 20 remove_watcher() i=4 2024-09-12T17:25:04.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.905+0000 7f4c3e9129c0 20 remove_watcher() i=5 2024-09-12T17:25:04.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.909+0000 7f4c3e9129c0 20 remove_watcher() i=6 2024-09-12T17:25:04.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:04.909+0000 7f4c3e9129c0 20 remove_watcher() i=7 2024-09-12T17:25:04.929 DEBUG:teuthology.orchestra.run.smithi016:> radosgw-admin gc process --include-all 2024-09-12T17:25:05.005 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:25:05.005 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:25:05.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.053+0000 7f280f0be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:25:05.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.053+0000 7f280f0be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:05.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.053+0000 7f280f0be9c0 20 realm 2024-09-12T17:25:05.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.053+0000 7f280f0be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:25:05.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.053+0000 7f280f0be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:05.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.053+0000 7f280f0be9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:25:05.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.053+0000 7f280f0be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:25:05.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.053+0000 7f280f0be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:05.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.053+0000 7f280f0be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:25:05.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.057+0000 7f280f0be9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:05.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.057+0000 7f280f0be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:25:05.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.057+0000 7f280f0be9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:25:05.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.057+0000 7f280f0be9c0 20 searching for the correct realm 2024-09-12T17:25:05.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.061+0000 7f280d3c5640 0 -- 172.21.15.16:0/1212384394 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f2800044700 msgr2=0x7f280005cf20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:25:05.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.069+0000 7f280c3c3640 0 -- 172.21.15.16:0/1212384394 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f2804070310 msgr2=0x7f2804068840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:25:05.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.285+0000 7f280f0be9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:25:05.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.285+0000 7f280f0be9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:25:05.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.285+0000 7f280f0be9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:25:05.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.285+0000 7f280f0be9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:25:05.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.285+0000 7f280f0be9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:25:05.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.285+0000 7f280f0be9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:25:05.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.285+0000 7f280f0be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:25:05.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.289+0000 7f280f0be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:05.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.289+0000 7f280f0be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:25:05.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.289+0000 7f280f0be9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:25:05.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.289+0000 7f280f0be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:25:05.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.289+0000 7f280f0be9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:25:05.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.289+0000 7f280f0be9c0 20 zone default found 2024-09-12T17:25:05.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.289+0000 7f280f0be9c0 4 Realm: () 2024-09-12T17:25:05.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.289+0000 7f280f0be9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:25:05.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.289+0000 7f280f0be9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:25:05.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.289+0000 7f280f0be9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:25:05.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.289+0000 7f280f0be9c0 20 zonegroup default 2024-09-12T17:25:05.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.289+0000 7f280f0be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:25:05.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.289+0000 7f280f0be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:05.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.289+0000 7f280f0be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:25:05.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.293+0000 7f280f0be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:05.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.293+0000 7f280f0be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:25:05.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.293+0000 7f280f0be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:25:05.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.293+0000 7f280f0be9c0 20 started sync module instance, tier type = 2024-09-12T17:25:05.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.293+0000 7f280f0be9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:25:05.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.317+0000 7f280f0be9c0 20 add_watcher() i=0 2024-09-12T17:25:05.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.321+0000 7f280f0be9c0 20 add_watcher() i=1 2024-09-12T17:25:05.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.321+0000 7f280f0be9c0 20 add_watcher() i=2 2024-09-12T17:25:05.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.321+0000 7f280f0be9c0 20 add_watcher() i=3 2024-09-12T17:25:05.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.321+0000 7f280f0be9c0 20 add_watcher() i=4 2024-09-12T17:25:05.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.321+0000 7f280f0be9c0 20 add_watcher() i=5 2024-09-12T17:25:05.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.321+0000 7f280f0be9c0 20 add_watcher() i=6 2024-09-12T17:25:05.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.325+0000 7f280f0be9c0 20 add_watcher() i=7 2024-09-12T17:25:05.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.325+0000 7f280f0be9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:25:05.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.329+0000 7f26c2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:05.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.329+0000 7f280f0be9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:25:05.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.329+0000 7f280f0be9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:25:05.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.421+0000 7f26c1fe3640 20 reqs_thread_entry: start 2024-09-12T17:25:05.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.421+0000 7f280f0be9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:25:05.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.421+0000 7f280f0be9c0 20 Filter name: none 2024-09-12T17:25:05.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.425+0000 7f26337fe640 20 reqs_thread_entry: start 2024-09-12T17:25:05.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.425+0000 7f280f0be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:25:05.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.425+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.429+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:05.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.429+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.429+0000 7f280f0be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:25:05.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.433+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.437+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:05.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.437+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.437+0000 7f280f0be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:25:05.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.441+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.445+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:05.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.445+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.449+0000 7f280f0be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:25:05.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.449+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.453+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:05.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.453+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.457+0000 7f280f0be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:25:05.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.461+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.461+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:05.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.461+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.461+0000 7f280f0be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:25:05.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.465+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.469+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:05.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.469+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.473+0000 7f280f0be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:25:05.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.477+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.477+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:05.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.477+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.477+0000 7f280f0be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:25:05.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.481+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.485+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:05.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.485+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.485+0000 7f280f0be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:25:05.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.489+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.493+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:05.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.493+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.497+0000 7f280f0be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:25:05.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.501+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.501+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:05.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.501+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.505+0000 7f280f0be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:25:05.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.509+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.509+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:05.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.509+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.513+0000 7f280f0be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:25:05.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.517+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.517+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:05.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.521+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.521+0000 7f280f0be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:25:05.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.525+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.525+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:05.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.529+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.529+0000 7f280f0be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:25:05.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.533+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.533+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:05.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.537+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.537+0000 7f280f0be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:25:05.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.541+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.545+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:05.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.545+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.549+0000 7f280f0be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:25:05.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.553+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.553+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:05.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.553+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.557+0000 7f280f0be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:25:05.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.561+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.565+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:05.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.565+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.569+0000 7f280f0be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:25:05.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.573+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.573+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:05.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.573+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.577+0000 7f280f0be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:25:05.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.581+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.581+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:05.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.585+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.585+0000 7f280f0be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:25:05.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.589+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.593+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:05.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.593+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.593+0000 7f280f0be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:25:05.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.597+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.601+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:05.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.601+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.605+0000 7f280f0be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:25:05.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.609+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.609+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:05.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.609+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.613+0000 7f280f0be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:25:05.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.617+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.621+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:05.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.621+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.625+0000 7f280f0be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:25:05.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.629+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.629+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:05.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.629+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.633+0000 7f280f0be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:25:05.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.637+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.637+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:05.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.637+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.641+0000 7f280f0be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:25:05.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.645+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.649+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:05.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.649+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.653+0000 7f280f0be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:25:05.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.653+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.657+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:05.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.657+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.661+0000 7f280f0be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:25:05.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.665+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.665+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:05.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.665+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.669+0000 7f280f0be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:25:05.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.673+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.673+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:05.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.673+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.677+0000 7f280f0be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:25:05.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.681+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.685+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:05.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.685+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.689+0000 7f280f0be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:25:05.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.693+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.693+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:05.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.693+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.697+0000 7f280f0be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:25:05.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.701+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.701+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:25:05.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.705+0000 7f280f0be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:25:05.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.709+0000 7f26c2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:25:05.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.713+0000 7f280f0be9c0 20 remove_watcher() i=0 2024-09-12T17:25:05.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.713+0000 7f280f0be9c0 2 removed watcher, disabling cache 2024-09-12T17:25:05.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.717+0000 7f280f0be9c0 20 remove_watcher() i=1 2024-09-12T17:25:05.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.721+0000 7f280f0be9c0 20 remove_watcher() i=2 2024-09-12T17:25:05.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.721+0000 7f280f0be9c0 20 remove_watcher() i=3 2024-09-12T17:25:05.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.725+0000 7f280f0be9c0 20 remove_watcher() i=4 2024-09-12T17:25:05.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.729+0000 7f280f0be9c0 20 remove_watcher() i=5 2024-09-12T17:25:05.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.729+0000 7f280f0be9c0 20 remove_watcher() i=6 2024-09-12T17:25:05.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:25:05.733+0000 7f280f0be9c0 20 remove_watcher() i=7 2024-09-12T17:25:05.754 DEBUG:teuthology.orchestra.run.smithi016:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-09-12T17:25:06.380 INFO:teuthology.orchestra.run.smithi016.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-09-12T17:25:11.181 INFO:teuthology.orchestra.run.smithi016.stdout:> Task :clean UP-TO-DATE 2024-09-12T17:25:30.681 INFO:teuthology.orchestra.run.smithi016.stdout:> Task :compileJava 2024-09-12T17:25:30.682 INFO:teuthology.orchestra.run.smithi016.stdout:> Task :processResources 2024-09-12T17:25:30.682 INFO:teuthology.orchestra.run.smithi016.stdout:> Task :classes 2024-09-12T17:25:31.580 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:25:31.580 INFO:teuthology.orchestra.run.smithi016.stdout:> Task :compileTestJava 2024-09-12T17:25:31.581 INFO:teuthology.orchestra.run.smithi016.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T17:25:31.581 INFO:teuthology.orchestra.run.smithi016.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T17:25:31.581 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:25:31.582 INFO:teuthology.orchestra.run.smithi016.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T17:25:31.582 INFO:teuthology.orchestra.run.smithi016.stdout:> Task :testClasses 2024-09-12T17:25:38.780 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:25:38.780 INFO:teuthology.orchestra.run.smithi016.stdout:> Task :test 2024-09-12T17:25:38.780 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:25:38.780 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-09-12T17:25:39.680 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:25:39.680 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-09-12T17:25:39.879 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:25:39.880 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-09-12T17:25:39.979 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:25:39.980 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-09-12T17:25:40.280 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:25:40.280 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-09-12T17:25:40.879 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:25:40.879 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-09-12T17:25:41.080 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:25:41.080 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T17:25:41.080 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:25:41.080 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T17:25:41.179 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:25:41.180 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-09-12T17:25:41.279 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:25:41.280 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-09-12T17:25:41.479 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:25:41.480 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-09-12T17:25:41.980 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:25:41.980 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-09-12T17:25:42.479 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:25:42.480 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-09-12T17:25:42.680 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:25:42.680 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-09-12T17:25:42.680 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12 17:25:42,659 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T17:25:48.780 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:25:48.780 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-09-12T17:25:49.180 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:25:49.180 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-09-12T17:25:49.180 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:25:49.180 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-09-12T17:25:49.480 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:25:49.480 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-09-12T17:25:49.480 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:25:49.480 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-09-12T17:25:49.879 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:25:49.879 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-09-12T17:25:50.379 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:25:50.380 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-09-12T17:25:50.579 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:25:50.579 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T17:25:50.679 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:25:50.680 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T17:25:50.780 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:25:50.780 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-09-12T17:25:53.380 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:25:53.380 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-09-12T17:25:53.579 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:25:53.580 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T17:25:54.079 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:25:54.080 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T17:25:54.379 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:25:54.380 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-09-12T17:25:55.280 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:25:55.280 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-09-12T17:25:55.479 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:25:55.479 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-09-12T17:26:06.480 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:06.480 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-09-12T17:26:06.679 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:06.680 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-09-12T17:26:08.280 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:08.280 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-09-12T17:26:08.479 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:08.480 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-09-12T17:26:09.379 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:09.380 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-09-12T17:26:09.579 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:09.580 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-09-12T17:26:10.079 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:10.080 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-09-12T17:26:10.279 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:10.280 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-09-12T17:26:10.379 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:10.380 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-09-12T17:26:10.579 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:10.580 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-09-12T17:26:10.679 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:10.680 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-09-12T17:26:10.879 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:10.880 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-09-12T17:26:10.880 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:10.880 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-09-12T17:26:11.179 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:11.180 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-09-12T17:26:11.180 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:11.180 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-09-12T17:26:11.480 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:11.480 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-09-12T17:26:11.480 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:11.480 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-09-12T17:26:11.779 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:11.780 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-09-12T17:26:11.780 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:11.780 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-09-12T17:26:12.079 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:12.080 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-09-12T17:26:12.080 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:12.080 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-09-12T17:26:12.279 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:12.279 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-09-12T17:26:13.079 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:13.080 INFO:teuthology.orchestra.run.smithi016.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-09-12T17:26:13.380 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:13.380 INFO:teuthology.orchestra.run.smithi016.stdout:---------------------------------------------------------------------- 2024-09-12T17:26:13.380 INFO:teuthology.orchestra.run.smithi016.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-09-12T17:26:13.380 INFO:teuthology.orchestra.run.smithi016.stdout:---------------------------------------------------------------------- 2024-09-12T17:26:13.380 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:13.380 INFO:teuthology.orchestra.run.smithi016.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T17:26:13.381 INFO:teuthology.orchestra.run.smithi016.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T17:26:13.381 INFO:teuthology.orchestra.run.smithi016.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T17:26:13.381 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:13.381 INFO:teuthology.orchestra.run.smithi016.stdout:BUILD SUCCESSFUL in 1m 7s 2024-09-12T17:26:13.381 INFO:teuthology.orchestra.run.smithi016.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-09-12T17:26:13.718 DEBUG:teuthology.orchestra.run.smithi016:> radosgw-admin gc process --include-all 2024-09-12T17:26:13.748 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:13.748 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:13.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:13.792+0000 7f63686c29c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:13.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:13.796+0000 7f63686c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:13.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:13.796+0000 7f63686c29c0 20 realm 2024-09-12T17:26:13.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:13.796+0000 7f63686c29c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:13.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:13.796+0000 7f63686c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:13.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:13.796+0000 7f63686c29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:13.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:13.796+0000 7f63686c29c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:13.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:13.796+0000 7f63686c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:13.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:13.796+0000 7f63686c29c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:13.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:13.796+0000 7f63686c29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:13.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:13.796+0000 7f63686c29c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:13.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:13.800+0000 7f63686c29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:13.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:13.800+0000 7f63686c29c0 20 searching for the correct realm 2024-09-12T17:26:13.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:13.800+0000 7f63669c9640 0 -- 172.21.15.16:0/4203613278 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f635c10b500 msgr2=0x7f635c1351a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:13.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:13.808+0000 7f63659c7640 0 -- 172.21.15.16:0/4203613278 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f63600800a0 msgr2=0x7f6360092840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:14.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.024+0000 7f63686c29c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:26:14.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.024+0000 7f63686c29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:14.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.024+0000 7f63686c29c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:26:14.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.024+0000 7f63686c29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:14.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.024+0000 7f63686c29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:14.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.024+0000 7f63686c29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:14.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.024+0000 7f63686c29c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:14.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.024+0000 7f63686c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:14.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.024+0000 7f63686c29c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:14.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.028+0000 7f63686c29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:14.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.028+0000 7f63686c29c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:14.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.028+0000 7f63686c29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:14.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.028+0000 7f63686c29c0 20 zone default found 2024-09-12T17:26:14.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.028+0000 7f63686c29c0 4 Realm: () 2024-09-12T17:26:14.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.028+0000 7f63686c29c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:26:14.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.028+0000 7f63686c29c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:26:14.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.028+0000 7f63686c29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:14.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.028+0000 7f63686c29c0 20 zonegroup default 2024-09-12T17:26:14.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.028+0000 7f63686c29c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:14.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.028+0000 7f63686c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:14.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.028+0000 7f63686c29c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:14.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.028+0000 7f63686c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:14.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.028+0000 7f63686c29c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:14.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.028+0000 7f63686c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:14.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.032+0000 7f63686c29c0 20 started sync module instance, tier type = 2024-09-12T17:26:14.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.032+0000 7f63686c29c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:26:14.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.052+0000 7f63686c29c0 20 add_watcher() i=0 2024-09-12T17:26:14.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.052+0000 7f63686c29c0 20 add_watcher() i=1 2024-09-12T17:26:14.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.052+0000 7f63686c29c0 20 add_watcher() i=2 2024-09-12T17:26:14.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.052+0000 7f63686c29c0 20 add_watcher() i=3 2024-09-12T17:26:14.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.052+0000 7f63686c29c0 20 add_watcher() i=4 2024-09-12T17:26:14.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.052+0000 7f63686c29c0 20 add_watcher() i=5 2024-09-12T17:26:14.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.052+0000 7f63686c29c0 20 add_watcher() i=6 2024-09-12T17:26:14.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.056+0000 7f63686c29c0 20 add_watcher() i=7 2024-09-12T17:26:14.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.056+0000 7f63686c29c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:14.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.060+0000 7f621d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:14.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.060+0000 7f63686c29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:14.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.060+0000 7f63686c29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:14.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.152+0000 7f62177fe640 20 reqs_thread_entry: start 2024-09-12T17:26:14.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.152+0000 7f63686c29c0 20 init_complete bucket index max shards: 1 2024-09-12T17:26:14.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.152+0000 7f63686c29c0 20 Filter name: none 2024-09-12T17:26:14.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.152+0000 7f62157fa640 20 reqs_thread_entry: start 2024-09-12T17:26:14.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.152+0000 7f63686c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:26:14.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.160+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:14.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.160+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:14.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.160+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:26:14.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.160+0000 7f63686c29c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6162407380748623155', time=2024-09-12T19:25:46.568686+0000, chain.objs.size()=9 2024-09-12T17:26:14.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.160+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__multipart_key1.2~ev7244vUeMSZlPxeKxku_5nU4U_UrBu.1 2024-09-12T17:26:14.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.160+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__shadow_key1.2~ev7244vUeMSZlPxeKxku_5nU4U_UrBu.1_1 2024-09-12T17:26:14.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.160+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__multipart_key1.2~ev7244vUeMSZlPxeKxku_5nU4U_UrBu.2 2024-09-12T17:26:14.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.160+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__shadow_key1.2~ev7244vUeMSZlPxeKxku_5nU4U_UrBu.2_1 2024-09-12T17:26:14.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.160+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__multipart_key1.2~ev7244vUeMSZlPxeKxku_5nU4U_UrBu.3 2024-09-12T17:26:14.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.160+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__shadow_key1.2~ev7244vUeMSZlPxeKxku_5nU4U_UrBu.3_1 2024-09-12T17:26:14.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.160+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__multipart_key1.2~ev7244vUeMSZlPxeKxku_5nU4U_UrBu.4 2024-09-12T17:26:14.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.160+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__shadow_key1.2~ev7244vUeMSZlPxeKxku_5nU4U_UrBu.4_1 2024-09-12T17:26:14.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.160+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__multipart_key1.2~ev7244vUeMSZlPxeKxku_5nU4U_UrBu.5 2024-09-12T17:26:14.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.160+0000 7f63686c29c0 20 garbage collection: RGWGC::process iterating over entry tag='2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR', time=2024-09-12T19:26:10.186807+0000, chain.objs.size()=92 2024-09-12T17:26:14.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.160+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.1 2024-09-12T17:26:14.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.160+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.2 2024-09-12T17:26:14.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.160+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.3 2024-09-12T17:26:14.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.164+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.4 2024-09-12T17:26:14.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.172+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.5 2024-09-12T17:26:14.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.172+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.6 2024-09-12T17:26:14.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.172+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.7 2024-09-12T17:26:14.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.172+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.8 2024-09-12T17:26:14.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.172+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.9 2024-09-12T17:26:14.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.172+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.10 2024-09-12T17:26:14.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.172+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.11 2024-09-12T17:26:14.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.172+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.12 2024-09-12T17:26:14.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.172+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.13 2024-09-12T17:26:14.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.172+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.14 2024-09-12T17:26:14.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.172+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.15 2024-09-12T17:26:14.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.176+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.16 2024-09-12T17:26:14.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.176+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.17 2024-09-12T17:26:14.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.176+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.18 2024-09-12T17:26:14.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.176+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.19 2024-09-12T17:26:14.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.176+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.20 2024-09-12T17:26:14.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.176+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.21 2024-09-12T17:26:14.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.176+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.22 2024-09-12T17:26:14.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.176+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.23 2024-09-12T17:26:14.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.180+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.24 2024-09-12T17:26:14.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.180+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.25 2024-09-12T17:26:14.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.180+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.26 2024-09-12T17:26:14.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.180+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.27 2024-09-12T17:26:14.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.180+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.28 2024-09-12T17:26:14.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.180+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.29 2024-09-12T17:26:14.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.180+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.30 2024-09-12T17:26:14.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.180+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.31 2024-09-12T17:26:14.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.180+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.32 2024-09-12T17:26:14.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.180+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.33 2024-09-12T17:26:14.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.180+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.34 2024-09-12T17:26:14.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.180+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.35 2024-09-12T17:26:14.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.180+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.36 2024-09-12T17:26:14.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.184+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.37 2024-09-12T17:26:14.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.184+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.38 2024-09-12T17:26:14.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.184+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.39 2024-09-12T17:26:14.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.188+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.40 2024-09-12T17:26:14.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.188+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.41 2024-09-12T17:26:14.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.188+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.42 2024-09-12T17:26:14.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.188+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.43 2024-09-12T17:26:14.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.188+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.44 2024-09-12T17:26:14.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.188+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.45 2024-09-12T17:26:14.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.188+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.46 2024-09-12T17:26:14.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.188+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.47 2024-09-12T17:26:14.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.188+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.48 2024-09-12T17:26:14.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.188+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.49 2024-09-12T17:26:14.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.188+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.50 2024-09-12T17:26:14.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.188+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.51 2024-09-12T17:26:14.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.192+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.52 2024-09-12T17:26:14.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.192+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.53 2024-09-12T17:26:14.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.192+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.54 2024-09-12T17:26:14.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.192+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.55 2024-09-12T17:26:14.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.192+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.56 2024-09-12T17:26:14.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.192+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.57 2024-09-12T17:26:14.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.196+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.58 2024-09-12T17:26:14.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.196+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.59 2024-09-12T17:26:14.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.196+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.60 2024-09-12T17:26:14.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.196+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.61 2024-09-12T17:26:14.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.196+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.62 2024-09-12T17:26:14.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.196+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.63 2024-09-12T17:26:14.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.196+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.64 2024-09-12T17:26:14.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.196+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.65 2024-09-12T17:26:14.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.196+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.66 2024-09-12T17:26:14.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.200+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.67 2024-09-12T17:26:14.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.200+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.68 2024-09-12T17:26:14.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.200+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.69 2024-09-12T17:26:14.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.200+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.70 2024-09-12T17:26:14.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.200+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.71 2024-09-12T17:26:14.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.200+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.72 2024-09-12T17:26:14.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.200+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.73 2024-09-12T17:26:14.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.200+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.74 2024-09-12T17:26:14.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.204+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.75 2024-09-12T17:26:14.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.204+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.76 2024-09-12T17:26:14.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.204+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.77 2024-09-12T17:26:14.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.204+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.78 2024-09-12T17:26:14.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.204+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.79 2024-09-12T17:26:14.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.204+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.80 2024-09-12T17:26:14.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.204+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.81 2024-09-12T17:26:14.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.204+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.82 2024-09-12T17:26:14.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.204+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.83 2024-09-12T17:26:14.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.204+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.84 2024-09-12T17:26:14.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.208+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.85 2024-09-12T17:26:14.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.208+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.86 2024-09-12T17:26:14.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.208+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.87 2024-09-12T17:26:14.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.208+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.88 2024-09-12T17:26:14.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.208+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.89 2024-09-12T17:26:14.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.208+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.90 2024-09-12T17:26:14.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.208+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.91 2024-09-12T17:26:14.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.208+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.58__multipart_key1.2~2ridT4DFUJtjs0GUa9z1VCX3kGJEIHR.92 2024-09-12T17:26:14.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.212+0000 7f63686c29c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6397553878555512989', time=2024-09-12T19:26:13.093122+0000, chain.objs.size()=21 2024-09-12T17:26:14.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.212+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.66__multipart_key1.2~EoJYTHCcRWUULFc8TaHCydUk051ZQhq.1 2024-09-12T17:26:14.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.212+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.66__shadow_key1.2~EoJYTHCcRWUULFc8TaHCydUk051ZQhq.1_1 2024-09-12T17:26:14.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.212+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.66__multipart_key1.2~EoJYTHCcRWUULFc8TaHCydUk051ZQhq.2 2024-09-12T17:26:14.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.212+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.66__shadow_key1.2~EoJYTHCcRWUULFc8TaHCydUk051ZQhq.2_1 2024-09-12T17:26:14.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.212+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.66__multipart_key1.2~EoJYTHCcRWUULFc8TaHCydUk051ZQhq.3 2024-09-12T17:26:14.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.212+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.66__shadow_key1.2~EoJYTHCcRWUULFc8TaHCydUk051ZQhq.3_1 2024-09-12T17:26:14.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.212+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.66__multipart_key1.2~EoJYTHCcRWUULFc8TaHCydUk051ZQhq.4 2024-09-12T17:26:14.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.212+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.66__shadow_key1.2~EoJYTHCcRWUULFc8TaHCydUk051ZQhq.4_1 2024-09-12T17:26:14.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.212+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.66__multipart_key1.2~EoJYTHCcRWUULFc8TaHCydUk051ZQhq.5 2024-09-12T17:26:14.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.216+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.66__shadow_key1.2~EoJYTHCcRWUULFc8TaHCydUk051ZQhq.5_1 2024-09-12T17:26:14.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.216+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.66__multipart_key1.2~EoJYTHCcRWUULFc8TaHCydUk051ZQhq.6 2024-09-12T17:26:14.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.220+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.66__shadow_key1.2~EoJYTHCcRWUULFc8TaHCydUk051ZQhq.6_1 2024-09-12T17:26:14.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.220+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.66__multipart_key1.2~EoJYTHCcRWUULFc8TaHCydUk051ZQhq.7 2024-09-12T17:26:14.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.220+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.66__shadow_key1.2~EoJYTHCcRWUULFc8TaHCydUk051ZQhq.7_1 2024-09-12T17:26:14.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.220+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.66__multipart_key1.2~EoJYTHCcRWUULFc8TaHCydUk051ZQhq.8 2024-09-12T17:26:14.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.220+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.66__shadow_key1.2~EoJYTHCcRWUULFc8TaHCydUk051ZQhq.8_1 2024-09-12T17:26:14.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.220+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.66__multipart_key1.2~EoJYTHCcRWUULFc8TaHCydUk051ZQhq.9 2024-09-12T17:26:14.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.220+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.66__shadow_key1.2~EoJYTHCcRWUULFc8TaHCydUk051ZQhq.9_1 2024-09-12T17:26:14.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.220+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.66__multipart_key1.2~EoJYTHCcRWUULFc8TaHCydUk051ZQhq.10 2024-09-12T17:26:14.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.220+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.66__shadow_key1.2~EoJYTHCcRWUULFc8TaHCydUk051ZQhq.10_1 2024-09-12T17:26:14.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.224+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.66__multipart_key1.2~EoJYTHCcRWUULFc8TaHCydUk051ZQhq.11 2024-09-12T17:26:14.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.232+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:26:14.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.240+0000 7f63686c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:26:14.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.240+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:14.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.244+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:14.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.244+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:26:14.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.244+0000 7f63686c29c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1887022304122072295', time=2024-09-12T19:25:54.231788+0000, chain.objs.size()=1 2024-09-12T17:26:14.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.244+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.53__shadow_.gcAA7H3CWUk1ChBcGpKF86CegzN83H2_0 2024-09-12T17:26:14.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.244+0000 7f63686c29c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13033222115576633043', time=2024-09-12T19:26:08.285080+0000, chain.objs.size()=9 2024-09-12T17:26:14.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.244+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.56__multipart_key1.2~HFTh34FK57KfLO40E1Qq-IMuEI1kWXf.1 2024-09-12T17:26:14.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.244+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.56__shadow_key1.2~HFTh34FK57KfLO40E1Qq-IMuEI1kWXf.1_1 2024-09-12T17:26:14.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.244+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.56__multipart_key1.2~HFTh34FK57KfLO40E1Qq-IMuEI1kWXf.2 2024-09-12T17:26:14.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.244+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.56__shadow_key1.2~HFTh34FK57KfLO40E1Qq-IMuEI1kWXf.2_1 2024-09-12T17:26:14.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.244+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.56__multipart_key1.2~HFTh34FK57KfLO40E1Qq-IMuEI1kWXf.3 2024-09-12T17:26:14.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.244+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.56__shadow_key1.2~HFTh34FK57KfLO40E1Qq-IMuEI1kWXf.3_1 2024-09-12T17:26:14.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.244+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.56__multipart_key1.2~HFTh34FK57KfLO40E1Qq-IMuEI1kWXf.4 2024-09-12T17:26:14.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.244+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.56__shadow_key1.2~HFTh34FK57KfLO40E1Qq-IMuEI1kWXf.4_1 2024-09-12T17:26:14.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.244+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.56__multipart_key1.2~HFTh34FK57KfLO40E1Qq-IMuEI1kWXf.5 2024-09-12T17:26:14.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.244+0000 7f63686c29c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16241536748616895051', time=2024-09-12T19:26:11.836706+0000, chain.objs.size()=1 2024-09-12T17:26:14.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.244+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.64__shadow_.w_LqAYKMmKw3cgrdhk4gFxVRFkiMcuK_0 2024-09-12T17:26:14.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.256+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:26:14.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.260+0000 7f63686c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:26:14.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.264+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:14.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.264+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:14.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.264+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:14.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.268+0000 7f63686c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:26:14.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.272+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:14.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.272+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:14.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.272+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:14.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.276+0000 7f63686c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:26:14.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.276+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:14.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.280+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:14.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.280+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:14.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.280+0000 7f63686c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:26:14.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.284+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:14.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.284+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:14.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.284+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:26:14.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.284+0000 7f63686c29c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12407649879860786034', time=2024-09-12T19:25:48.985636+0000, chain.objs.size()=6 2024-09-12T17:26:14.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.284+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.46__shadow_.iM4AODVHJoCiGU0ywWQpROl0xgdFOBL_0 2024-09-12T17:26:14.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.284+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.46__shadow_.iM4AODVHJoCiGU0ywWQpROl0xgdFOBL_1 2024-09-12T17:26:14.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.284+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.46__shadow_.iM4AODVHJoCiGU0ywWQpROl0xgdFOBL_2 2024-09-12T17:26:14.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.284+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.46__shadow_.iM4AODVHJoCiGU0ywWQpROl0xgdFOBL_3 2024-09-12T17:26:14.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.284+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.46__shadow_.iM4AODVHJoCiGU0ywWQpROl0xgdFOBL_4 2024-09-12T17:26:14.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.284+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.46__shadow_.iM4AODVHJoCiGU0ywWQpROl0xgdFOBL_5 2024-09-12T17:26:14.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.284+0000 7f63686c29c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16900968417817216710', time=2024-09-12T19:26:10.400388+0000, chain.objs.size()=1 2024-09-12T17:26:14.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.284+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.59__shadow_.UIQt2ntuX0MOGFlFUCqNaTlps8nHtB8_0 2024-09-12T17:26:14.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.292+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:26:14.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.296+0000 7f63686c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:26:14.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.300+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:14.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.300+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:14.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.304+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:26:14.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.304+0000 7f63686c29c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8904785100436725457', time=2024-09-12T19:26:06.500780+0000, chain.objs.size()=16 2024-09-12T17:26:14.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.304+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~oqfDBfdB6UshH9VlfQSo5dKpSEXQNmb.1 2024-09-12T17:26:14.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.304+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~oqfDBfdB6UshH9VlfQSo5dKpSEXQNmb.1_1 2024-09-12T17:26:14.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.304+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~oqfDBfdB6UshH9VlfQSo5dKpSEXQNmb.1_2 2024-09-12T17:26:14.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.304+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~oqfDBfdB6UshH9VlfQSo5dKpSEXQNmb.2 2024-09-12T17:26:14.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.304+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~oqfDBfdB6UshH9VlfQSo5dKpSEXQNmb.2_1 2024-09-12T17:26:14.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.304+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~oqfDBfdB6UshH9VlfQSo5dKpSEXQNmb.2_2 2024-09-12T17:26:14.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.304+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~oqfDBfdB6UshH9VlfQSo5dKpSEXQNmb.3 2024-09-12T17:26:14.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.304+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~oqfDBfdB6UshH9VlfQSo5dKpSEXQNmb.3_1 2024-09-12T17:26:14.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.304+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~oqfDBfdB6UshH9VlfQSo5dKpSEXQNmb.3_2 2024-09-12T17:26:14.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.304+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~oqfDBfdB6UshH9VlfQSo5dKpSEXQNmb.4 2024-09-12T17:26:14.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.304+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~oqfDBfdB6UshH9VlfQSo5dKpSEXQNmb.4_1 2024-09-12T17:26:14.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.304+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~oqfDBfdB6UshH9VlfQSo5dKpSEXQNmb.4_2 2024-09-12T17:26:14.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.312+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~oqfDBfdB6UshH9VlfQSo5dKpSEXQNmb.5 2024-09-12T17:26:14.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.312+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~oqfDBfdB6UshH9VlfQSo5dKpSEXQNmb.5_1 2024-09-12T17:26:14.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.312+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~oqfDBfdB6UshH9VlfQSo5dKpSEXQNmb.5_2 2024-09-12T17:26:14.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.312+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~oqfDBfdB6UshH9VlfQSo5dKpSEXQNmb.6 2024-09-12T17:26:14.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.320+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:26:14.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.324+0000 7f63686c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:26:14.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.328+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:14.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.328+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:14.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.328+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:26:14.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.328+0000 7f63686c29c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15145514524266635003', time=2024-09-12T19:26:11.261668+0000, chain.objs.size()=1 2024-09-12T17:26:14.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.328+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.62__shadow_.ybIZs7xKt-9CzDkLad1PW773bGoCKxA_0 2024-09-12T17:26:14.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.328+0000 7f63686c29c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12148471688038118552', time=2024-09-12T19:26:11.546660+0000, chain.objs.size()=1 2024-09-12T17:26:14.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.328+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.63__shadow_.o2QE1a0-Y5Tag84wOzD80NpyeGxhTex_0 2024-09-12T17:26:14.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.332+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:26:14.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.340+0000 7f63686c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:26:14.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.340+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:14.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.344+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:14.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.344+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:26:14.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.344+0000 7f63686c29c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13962578543464723344', time=2024-09-12T19:25:48.656723+0000, chain.objs.size()=7 2024-09-12T17:26:14.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.344+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__multipart_key1.2~wNUtmjXQhi8BTSIDk0h3V6xzKJm-AwV.1 2024-09-12T17:26:14.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.344+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__shadow_key1.2~wNUtmjXQhi8BTSIDk0h3V6xzKJm-AwV.1_1 2024-09-12T17:26:14.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.344+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__shadow_key1.2~wNUtmjXQhi8BTSIDk0h3V6xzKJm-AwV.1_2 2024-09-12T17:26:14.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.344+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__multipart_key1.2~wNUtmjXQhi8BTSIDk0h3V6xzKJm-AwV.2 2024-09-12T17:26:14.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.344+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__shadow_key1.2~wNUtmjXQhi8BTSIDk0h3V6xzKJm-AwV.2_1 2024-09-12T17:26:14.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.344+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__shadow_key1.2~wNUtmjXQhi8BTSIDk0h3V6xzKJm-AwV.2_2 2024-09-12T17:26:14.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.344+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__multipart_key1.2~wNUtmjXQhi8BTSIDk0h3V6xzKJm-AwV.3 2024-09-12T17:26:14.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.348+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:26:14.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.356+0000 7f63686c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:26:14.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.360+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:14.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.360+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:14.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.360+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T17:26:14.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.360+0000 7f63686c29c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6152625864079676525', time=2024-09-12T19:25:47.973345+0000, chain.objs.size()=7 2024-09-12T17:26:14.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.360+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__multipart_key1.2~xlYFdXSRNE2NemlhF_u9NS4tWGp1JaW.1 2024-09-12T17:26:14.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.360+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__shadow_key1.2~xlYFdXSRNE2NemlhF_u9NS4tWGp1JaW.1_1 2024-09-12T17:26:14.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.360+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__shadow_key1.2~xlYFdXSRNE2NemlhF_u9NS4tWGp1JaW.1_2 2024-09-12T17:26:14.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.360+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__multipart_key1.2~xlYFdXSRNE2NemlhF_u9NS4tWGp1JaW.2 2024-09-12T17:26:14.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.360+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__shadow_key1.2~xlYFdXSRNE2NemlhF_u9NS4tWGp1JaW.2_1 2024-09-12T17:26:14.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.360+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__shadow_key1.2~xlYFdXSRNE2NemlhF_u9NS4tWGp1JaW.2_2 2024-09-12T17:26:14.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.360+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__multipart_key1.2~xlYFdXSRNE2NemlhF_u9NS4tWGp1JaW.3 2024-09-12T17:26:14.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.360+0000 7f63686c29c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7483639749306647848', time=2024-09-12T19:25:54.193536+0000, chain.objs.size()=1 2024-09-12T17:26:14.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.360+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.53__shadow_.dkCDePIpxuPk3z8koMWKz9bkACMp_le_0 2024-09-12T17:26:14.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.360+0000 7f63686c29c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1501183159025893262', time=2024-09-12T19:26:00.843255+0000, chain.objs.size()=21 2024-09-12T17:26:14.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.360+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~9zjBK852JxDrRwaJnRN_tjWdzaZSoe8.1 2024-09-12T17:26:14.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.360+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~9zjBK852JxDrRwaJnRN_tjWdzaZSoe8.1_1 2024-09-12T17:26:14.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.360+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~9zjBK852JxDrRwaJnRN_tjWdzaZSoe8.2 2024-09-12T17:26:14.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.360+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~9zjBK852JxDrRwaJnRN_tjWdzaZSoe8.2_1 2024-09-12T17:26:14.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.368+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~9zjBK852JxDrRwaJnRN_tjWdzaZSoe8.3 2024-09-12T17:26:14.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.368+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~9zjBK852JxDrRwaJnRN_tjWdzaZSoe8.3_1 2024-09-12T17:26:14.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.368+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~9zjBK852JxDrRwaJnRN_tjWdzaZSoe8.4 2024-09-12T17:26:14.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.372+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~9zjBK852JxDrRwaJnRN_tjWdzaZSoe8.4_1 2024-09-12T17:26:14.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.372+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~9zjBK852JxDrRwaJnRN_tjWdzaZSoe8.5 2024-09-12T17:26:14.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.372+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~9zjBK852JxDrRwaJnRN_tjWdzaZSoe8.5_1 2024-09-12T17:26:14.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.372+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~9zjBK852JxDrRwaJnRN_tjWdzaZSoe8.6 2024-09-12T17:26:14.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.372+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~9zjBK852JxDrRwaJnRN_tjWdzaZSoe8.6_1 2024-09-12T17:26:14.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.372+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~9zjBK852JxDrRwaJnRN_tjWdzaZSoe8.7 2024-09-12T17:26:14.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.372+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~9zjBK852JxDrRwaJnRN_tjWdzaZSoe8.7_1 2024-09-12T17:26:14.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.372+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~9zjBK852JxDrRwaJnRN_tjWdzaZSoe8.8 2024-09-12T17:26:14.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.372+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~9zjBK852JxDrRwaJnRN_tjWdzaZSoe8.8_1 2024-09-12T17:26:14.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.376+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~9zjBK852JxDrRwaJnRN_tjWdzaZSoe8.9 2024-09-12T17:26:14.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.376+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~9zjBK852JxDrRwaJnRN_tjWdzaZSoe8.9_1 2024-09-12T17:26:14.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.376+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~9zjBK852JxDrRwaJnRN_tjWdzaZSoe8.10 2024-09-12T17:26:14.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.380+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~9zjBK852JxDrRwaJnRN_tjWdzaZSoe8.10_1 2024-09-12T17:26:14.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.380+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~9zjBK852JxDrRwaJnRN_tjWdzaZSoe8.11 2024-09-12T17:26:14.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.380+0000 7f63686c29c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3040766033501787177', time=2024-09-12T19:26:10.973744+0000, chain.objs.size()=1 2024-09-12T17:26:14.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.380+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.61__shadow_.e-F1H97LHXfmaT9mIUaBbH_kqEToVsz_0 2024-09-12T17:26:14.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.384+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:26:14.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.392+0000 7f63686c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:26:14.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.392+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:14.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.396+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:14.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.396+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:26:14.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.396+0000 7f63686c29c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10915449889177883063', time=2024-09-12T19:25:50.402012+0000, chain.objs.size()=9 2024-09-12T17:26:14.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.396+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.51__multipart_key1.2~OU8aJUFYM-_8h2mupugyWh8JPgLtNwn.1 2024-09-12T17:26:14.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.396+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.51__shadow_key1.2~OU8aJUFYM-_8h2mupugyWh8JPgLtNwn.1_1 2024-09-12T17:26:14.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.396+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.51__multipart_key1.2~OU8aJUFYM-_8h2mupugyWh8JPgLtNwn.2 2024-09-12T17:26:14.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.396+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.51__shadow_key1.2~OU8aJUFYM-_8h2mupugyWh8JPgLtNwn.2_1 2024-09-12T17:26:14.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.396+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.51__multipart_key1.2~OU8aJUFYM-_8h2mupugyWh8JPgLtNwn.3 2024-09-12T17:26:14.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.396+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.51__shadow_key1.2~OU8aJUFYM-_8h2mupugyWh8JPgLtNwn.3_1 2024-09-12T17:26:14.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.396+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.51__multipart_key1.2~OU8aJUFYM-_8h2mupugyWh8JPgLtNwn.4 2024-09-12T17:26:14.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.396+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.51__shadow_key1.2~OU8aJUFYM-_8h2mupugyWh8JPgLtNwn.4_1 2024-09-12T17:26:14.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.396+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.51__multipart_key1.2~OU8aJUFYM-_8h2mupugyWh8JPgLtNwn.5 2024-09-12T17:26:14.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.396+0000 7f63686c29c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17797470577725398511', time=2024-09-12T19:25:54.177957+0000, chain.objs.size()=9 2024-09-12T17:26:14.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.396+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.53__multipart_file.mpg.2~Sr0BF_5EF1hbjhka12hE5nJsAQzTMjp.1 2024-09-12T17:26:14.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.396+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.53__shadow_file.mpg.2~Sr0BF_5EF1hbjhka12hE5nJsAQzTMjp.1_1 2024-09-12T17:26:14.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.396+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.53__multipart_file.mpg.2~Sr0BF_5EF1hbjhka12hE5nJsAQzTMjp.2 2024-09-12T17:26:14.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.404+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.53__shadow_file.mpg.2~Sr0BF_5EF1hbjhka12hE5nJsAQzTMjp.2_1 2024-09-12T17:26:14.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.404+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.53__multipart_file.mpg.2~Sr0BF_5EF1hbjhka12hE5nJsAQzTMjp.3 2024-09-12T17:26:14.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.408+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.53__shadow_file.mpg.2~Sr0BF_5EF1hbjhka12hE5nJsAQzTMjp.3_1 2024-09-12T17:26:14.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.408+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.53__multipart_file.mpg.2~Sr0BF_5EF1hbjhka12hE5nJsAQzTMjp.4 2024-09-12T17:26:14.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.408+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.53__shadow_file.mpg.2~Sr0BF_5EF1hbjhka12hE5nJsAQzTMjp.4_1 2024-09-12T17:26:14.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.408+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.53__multipart_file.mpg.2~Sr0BF_5EF1hbjhka12hE5nJsAQzTMjp.5 2024-09-12T17:26:14.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.412+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:26:14.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.416+0000 7f63686c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:26:14.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.420+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:14.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.424+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:14.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.424+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:14.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.428+0000 7f63686c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:26:14.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.428+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:14.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.432+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:14.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.432+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:14.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.436+0000 7f63686c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:26:14.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.436+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:14.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.440+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:14.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.440+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:14.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.444+0000 7f63686c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:26:14.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.448+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:14.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.448+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:14.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.448+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:26:14.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.448+0000 7f63686c29c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8985129710984775761', time=2024-09-12T19:25:53.402357+0000, chain.objs.size()=9 2024-09-12T17:26:14.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.448+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.52__multipart_key1.2~XgtuAuGDG8jQXLrHVlPc7riwrEk9pFp.1 2024-09-12T17:26:14.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.448+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.52__shadow_key1.2~XgtuAuGDG8jQXLrHVlPc7riwrEk9pFp.1_1 2024-09-12T17:26:14.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.448+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.52__multipart_key1.2~XgtuAuGDG8jQXLrHVlPc7riwrEk9pFp.2 2024-09-12T17:26:14.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.448+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.52__shadow_key1.2~XgtuAuGDG8jQXLrHVlPc7riwrEk9pFp.2_1 2024-09-12T17:26:14.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.448+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.52__multipart_key1.2~XgtuAuGDG8jQXLrHVlPc7riwrEk9pFp.3 2024-09-12T17:26:14.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.448+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.52__shadow_key1.2~XgtuAuGDG8jQXLrHVlPc7riwrEk9pFp.3_1 2024-09-12T17:26:14.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.448+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.52__multipart_key1.2~XgtuAuGDG8jQXLrHVlPc7riwrEk9pFp.4 2024-09-12T17:26:14.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.448+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.52__shadow_key1.2~XgtuAuGDG8jQXLrHVlPc7riwrEk9pFp.4_1 2024-09-12T17:26:14.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.448+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.52__multipart_key1.2~XgtuAuGDG8jQXLrHVlPc7riwrEk9pFp.5 2024-09-12T17:26:14.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.448+0000 7f63686c29c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18159347131075359724', time=2024-09-12T19:26:06.334220+0000, chain.objs.size()=16 2024-09-12T17:26:14.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.448+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~E-kXmQRbz4kdlaGyCDNiJLrkPFKCGjq.1 2024-09-12T17:26:14.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.448+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~E-kXmQRbz4kdlaGyCDNiJLrkPFKCGjq.1_1 2024-09-12T17:26:14.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.448+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~E-kXmQRbz4kdlaGyCDNiJLrkPFKCGjq.1_2 2024-09-12T17:26:14.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.456+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~E-kXmQRbz4kdlaGyCDNiJLrkPFKCGjq.2 2024-09-12T17:26:14.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.456+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~E-kXmQRbz4kdlaGyCDNiJLrkPFKCGjq.2_1 2024-09-12T17:26:14.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.456+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~E-kXmQRbz4kdlaGyCDNiJLrkPFKCGjq.2_2 2024-09-12T17:26:14.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.456+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~E-kXmQRbz4kdlaGyCDNiJLrkPFKCGjq.3 2024-09-12T17:26:14.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.460+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~E-kXmQRbz4kdlaGyCDNiJLrkPFKCGjq.3_1 2024-09-12T17:26:14.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.460+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~E-kXmQRbz4kdlaGyCDNiJLrkPFKCGjq.3_2 2024-09-12T17:26:14.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.460+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~E-kXmQRbz4kdlaGyCDNiJLrkPFKCGjq.4 2024-09-12T17:26:14.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.460+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~E-kXmQRbz4kdlaGyCDNiJLrkPFKCGjq.4_1 2024-09-12T17:26:14.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.464+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~E-kXmQRbz4kdlaGyCDNiJLrkPFKCGjq.4_2 2024-09-12T17:26:14.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.464+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~E-kXmQRbz4kdlaGyCDNiJLrkPFKCGjq.5 2024-09-12T17:26:14.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.464+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~E-kXmQRbz4kdlaGyCDNiJLrkPFKCGjq.5_1 2024-09-12T17:26:14.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.464+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~E-kXmQRbz4kdlaGyCDNiJLrkPFKCGjq.5_2 2024-09-12T17:26:14.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.472+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~E-kXmQRbz4kdlaGyCDNiJLrkPFKCGjq.6 2024-09-12T17:26:14.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.476+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:26:14.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.484+0000 7f63686c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:26:14.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.484+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:14.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.488+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:14.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.488+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:26:14.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.488+0000 7f63686c29c0 20 garbage collection: RGWGC::process iterating over entry tag='2~EdpwTvleIn5Bxtj0hLIABqjafhYdsvF', time=2024-09-12T19:25:39.589241+0000, chain.objs.size()=9 2024-09-12T17:26:14.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.488+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.40__multipart_key1.2~EdpwTvleIn5Bxtj0hLIABqjafhYdsvF.1 2024-09-12T17:26:14.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.488+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.40__shadow_key1.2~EdpwTvleIn5Bxtj0hLIABqjafhYdsvF.1_1 2024-09-12T17:26:14.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.488+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.40__multipart_key1.2~EdpwTvleIn5Bxtj0hLIABqjafhYdsvF.2 2024-09-12T17:26:14.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.488+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.40__shadow_key1.2~EdpwTvleIn5Bxtj0hLIABqjafhYdsvF.2_1 2024-09-12T17:26:14.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.488+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.40__multipart_key1.2~EdpwTvleIn5Bxtj0hLIABqjafhYdsvF.3 2024-09-12T17:26:14.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.488+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.40__shadow_key1.2~EdpwTvleIn5Bxtj0hLIABqjafhYdsvF.3_1 2024-09-12T17:26:14.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.488+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.40__multipart_key1.2~EdpwTvleIn5Bxtj0hLIABqjafhYdsvF.4 2024-09-12T17:26:14.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.488+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.40__shadow_key1.2~EdpwTvleIn5Bxtj0hLIABqjafhYdsvF.4_1 2024-09-12T17:26:14.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.488+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.40__multipart_key1.2~EdpwTvleIn5Bxtj0hLIABqjafhYdsvF.5 2024-09-12T17:26:14.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.488+0000 7f63686c29c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7428016852587480399', time=2024-09-12T19:26:10.678608+0000, chain.objs.size()=1 2024-09-12T17:26:14.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.488+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.60__shadow_.Rk9kt6yMizw7UU26XogONGZGPp9d1pd_0 2024-09-12T17:26:14.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.496+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:26:14.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.504+0000 7f63686c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:26:14.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.508+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:14.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.508+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:14.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.508+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:26:14.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.508+0000 7f63686c29c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13031878991483226505', time=2024-09-12T19:25:42.247200+0000, chain.objs.size()=9 2024-09-12T17:26:14.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.508+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.44__multipart_key1.2~1Ezg6h1udRV36KgvKQXUFam_uU3xGYR.1 2024-09-12T17:26:14.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.508+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.44__shadow_key1.2~1Ezg6h1udRV36KgvKQXUFam_uU3xGYR.1_1 2024-09-12T17:26:14.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.508+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.44__multipart_key1.2~1Ezg6h1udRV36KgvKQXUFam_uU3xGYR.2 2024-09-12T17:26:14.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.508+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.44__shadow_key1.2~1Ezg6h1udRV36KgvKQXUFam_uU3xGYR.2_1 2024-09-12T17:26:14.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.508+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.44__multipart_key1.2~1Ezg6h1udRV36KgvKQXUFam_uU3xGYR.3 2024-09-12T17:26:14.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.508+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.44__shadow_key1.2~1Ezg6h1udRV36KgvKQXUFam_uU3xGYR.3_1 2024-09-12T17:26:14.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.508+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.44__multipart_key1.2~1Ezg6h1udRV36KgvKQXUFam_uU3xGYR.4 2024-09-12T17:26:14.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.508+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.44__shadow_key1.2~1Ezg6h1udRV36KgvKQXUFam_uU3xGYR.4_1 2024-09-12T17:26:14.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.508+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.44__multipart_key1.2~1Ezg6h1udRV36KgvKQXUFam_uU3xGYR.5 2024-09-12T17:26:14.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.516+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:26:14.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.520+0000 7f63686c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:26:14.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.524+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:14.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.528+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:14.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.528+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:14.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.532+0000 7f63686c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:26:14.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.532+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:14.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.536+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:14.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.536+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:14.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.540+0000 7f63686c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:26:14.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.544+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:14.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.544+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:14.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.544+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:26:14.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.544+0000 7f63686c29c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9858503815002863197', time=2024-09-12T19:25:47.246995+0000, chain.objs.size()=9 2024-09-12T17:26:14.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.544+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__multipart_key1.2~RjsK2Dk25K3sGc-du-fE0FYSruZZ85X.1 2024-09-12T17:26:14.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.544+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__shadow_key1.2~RjsK2Dk25K3sGc-du-fE0FYSruZZ85X.1_1 2024-09-12T17:26:14.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.544+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__multipart_key1.2~RjsK2Dk25K3sGc-du-fE0FYSruZZ85X.2 2024-09-12T17:26:14.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.544+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__shadow_key1.2~RjsK2Dk25K3sGc-du-fE0FYSruZZ85X.2_1 2024-09-12T17:26:14.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.544+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__multipart_key1.2~RjsK2Dk25K3sGc-du-fE0FYSruZZ85X.3 2024-09-12T17:26:14.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.544+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__shadow_key1.2~RjsK2Dk25K3sGc-du-fE0FYSruZZ85X.3_1 2024-09-12T17:26:14.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.544+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__multipart_key1.2~RjsK2Dk25K3sGc-du-fE0FYSruZZ85X.4 2024-09-12T17:26:14.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.544+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__shadow_key1.2~RjsK2Dk25K3sGc-du-fE0FYSruZZ85X.4_1 2024-09-12T17:26:14.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.544+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__multipart_key1.2~RjsK2Dk25K3sGc-du-fE0FYSruZZ85X.5 2024-09-12T17:26:14.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.556+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:26:14.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.560+0000 7f63686c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:26:14.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.564+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:14.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.564+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:14.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.564+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:26:14.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.568+0000 7f63686c29c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5497233540151678212', time=2024-09-12T19:26:03.861944+0000, chain.objs.size()=19 2024-09-12T17:26:14.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.568+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~dgt9xKfQg_gY9-YlwhYqtaN2liEfa2i.1 2024-09-12T17:26:14.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.568+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~dgt9xKfQg_gY9-YlwhYqtaN2liEfa2i.1_1 2024-09-12T17:26:14.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.568+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~dgt9xKfQg_gY9-YlwhYqtaN2liEfa2i.2 2024-09-12T17:26:14.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.568+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~dgt9xKfQg_gY9-YlwhYqtaN2liEfa2i.2_1 2024-09-12T17:26:14.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.568+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~dgt9xKfQg_gY9-YlwhYqtaN2liEfa2i.3 2024-09-12T17:26:14.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.568+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~dgt9xKfQg_gY9-YlwhYqtaN2liEfa2i.3_1 2024-09-12T17:26:14.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.568+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~dgt9xKfQg_gY9-YlwhYqtaN2liEfa2i.4 2024-09-12T17:26:14.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.568+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~dgt9xKfQg_gY9-YlwhYqtaN2liEfa2i.4_1 2024-09-12T17:26:14.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.568+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~dgt9xKfQg_gY9-YlwhYqtaN2liEfa2i.5 2024-09-12T17:26:14.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.568+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~dgt9xKfQg_gY9-YlwhYqtaN2liEfa2i.5_1 2024-09-12T17:26:14.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.568+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~dgt9xKfQg_gY9-YlwhYqtaN2liEfa2i.6 2024-09-12T17:26:14.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.568+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~dgt9xKfQg_gY9-YlwhYqtaN2liEfa2i.6_1 2024-09-12T17:26:14.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.576+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~dgt9xKfQg_gY9-YlwhYqtaN2liEfa2i.7 2024-09-12T17:26:14.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.576+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~dgt9xKfQg_gY9-YlwhYqtaN2liEfa2i.7_1 2024-09-12T17:26:14.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.576+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~dgt9xKfQg_gY9-YlwhYqtaN2liEfa2i.8 2024-09-12T17:26:14.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.576+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~dgt9xKfQg_gY9-YlwhYqtaN2liEfa2i.8_1 2024-09-12T17:26:14.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.576+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~dgt9xKfQg_gY9-YlwhYqtaN2liEfa2i.9 2024-09-12T17:26:14.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.576+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~dgt9xKfQg_gY9-YlwhYqtaN2liEfa2i.9_1 2024-09-12T17:26:14.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.576+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~dgt9xKfQg_gY9-YlwhYqtaN2liEfa2i.10 2024-09-12T17:26:14.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.576+0000 7f63686c29c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6759162522633943834', time=2024-09-12T19:26:09.413650+0000, chain.objs.size()=9 2024-09-12T17:26:14.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.576+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.57__multipart_key1.2~k4MD6r4vXOFofrn2ZYvrlT8nRLyv0Tq.1 2024-09-12T17:26:14.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.576+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.57__shadow_key1.2~k4MD6r4vXOFofrn2ZYvrlT8nRLyv0Tq.1_1 2024-09-12T17:26:14.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.576+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.57__multipart_key1.2~k4MD6r4vXOFofrn2ZYvrlT8nRLyv0Tq.2 2024-09-12T17:26:14.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.576+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.57__shadow_key1.2~k4MD6r4vXOFofrn2ZYvrlT8nRLyv0Tq.2_1 2024-09-12T17:26:14.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.584+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.57__multipart_key1.2~k4MD6r4vXOFofrn2ZYvrlT8nRLyv0Tq.3 2024-09-12T17:26:14.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.584+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.57__shadow_key1.2~k4MD6r4vXOFofrn2ZYvrlT8nRLyv0Tq.3_1 2024-09-12T17:26:14.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.584+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.57__multipart_key1.2~k4MD6r4vXOFofrn2ZYvrlT8nRLyv0Tq.4 2024-09-12T17:26:14.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.584+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.57__shadow_key1.2~k4MD6r4vXOFofrn2ZYvrlT8nRLyv0Tq.4_1 2024-09-12T17:26:14.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.584+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.57__multipart_key1.2~k4MD6r4vXOFofrn2ZYvrlT8nRLyv0Tq.5 2024-09-12T17:26:14.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.596+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:26:14.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.600+0000 7f63686c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:26:14.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.604+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:14.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.608+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:14.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.608+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:14.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.608+0000 7f63686c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:26:14.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.612+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:14.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.616+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:14.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.616+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:26:14.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.616+0000 7f63686c29c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9115420687354216628', time=2024-09-12T19:26:02.498595+0000, chain.objs.size()=21 2024-09-12T17:26:14.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.616+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~doZwwnprwkm1F0DA1QuLgbiyX5e2vuF.1 2024-09-12T17:26:14.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.616+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~doZwwnprwkm1F0DA1QuLgbiyX5e2vuF.1_1 2024-09-12T17:26:14.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.616+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~doZwwnprwkm1F0DA1QuLgbiyX5e2vuF.2 2024-09-12T17:26:14.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.616+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~doZwwnprwkm1F0DA1QuLgbiyX5e2vuF.2_1 2024-09-12T17:26:14.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.616+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~doZwwnprwkm1F0DA1QuLgbiyX5e2vuF.3 2024-09-12T17:26:14.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.616+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~doZwwnprwkm1F0DA1QuLgbiyX5e2vuF.3_1 2024-09-12T17:26:14.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.616+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~doZwwnprwkm1F0DA1QuLgbiyX5e2vuF.4 2024-09-12T17:26:14.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.616+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~doZwwnprwkm1F0DA1QuLgbiyX5e2vuF.4_1 2024-09-12T17:26:14.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.616+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~doZwwnprwkm1F0DA1QuLgbiyX5e2vuF.5 2024-09-12T17:26:14.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.616+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~doZwwnprwkm1F0DA1QuLgbiyX5e2vuF.5_1 2024-09-12T17:26:14.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.616+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~doZwwnprwkm1F0DA1QuLgbiyX5e2vuF.6 2024-09-12T17:26:14.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.616+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~doZwwnprwkm1F0DA1QuLgbiyX5e2vuF.6_1 2024-09-12T17:26:14.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.624+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~doZwwnprwkm1F0DA1QuLgbiyX5e2vuF.7 2024-09-12T17:26:14.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.624+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~doZwwnprwkm1F0DA1QuLgbiyX5e2vuF.7_1 2024-09-12T17:26:14.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.624+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~doZwwnprwkm1F0DA1QuLgbiyX5e2vuF.8 2024-09-12T17:26:14.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.624+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~doZwwnprwkm1F0DA1QuLgbiyX5e2vuF.8_1 2024-09-12T17:26:14.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.628+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~doZwwnprwkm1F0DA1QuLgbiyX5e2vuF.9 2024-09-12T17:26:14.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.628+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~doZwwnprwkm1F0DA1QuLgbiyX5e2vuF.9_1 2024-09-12T17:26:14.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.628+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~doZwwnprwkm1F0DA1QuLgbiyX5e2vuF.10 2024-09-12T17:26:14.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.628+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~doZwwnprwkm1F0DA1QuLgbiyX5e2vuF.10_1 2024-09-12T17:26:14.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.628+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~doZwwnprwkm1F0DA1QuLgbiyX5e2vuF.11 2024-09-12T17:26:14.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.628+0000 7f63686c29c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11195744710656264773', time=2024-09-12T19:26:05.116275+0000, chain.objs.size()=16 2024-09-12T17:26:14.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.628+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~gC6v5Xzj8vjir4ZMnKGp2iw82B-Kiiy.1 2024-09-12T17:26:14.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.628+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~gC6v5Xzj8vjir4ZMnKGp2iw82B-Kiiy.1_1 2024-09-12T17:26:14.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.628+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~gC6v5Xzj8vjir4ZMnKGp2iw82B-Kiiy.1_2 2024-09-12T17:26:14.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.632+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~gC6v5Xzj8vjir4ZMnKGp2iw82B-Kiiy.2 2024-09-12T17:26:14.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.632+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~gC6v5Xzj8vjir4ZMnKGp2iw82B-Kiiy.2_1 2024-09-12T17:26:14.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.632+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~gC6v5Xzj8vjir4ZMnKGp2iw82B-Kiiy.2_2 2024-09-12T17:26:14.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.636+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~gC6v5Xzj8vjir4ZMnKGp2iw82B-Kiiy.3 2024-09-12T17:26:14.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.636+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~gC6v5Xzj8vjir4ZMnKGp2iw82B-Kiiy.3_1 2024-09-12T17:26:14.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.636+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~gC6v5Xzj8vjir4ZMnKGp2iw82B-Kiiy.3_2 2024-09-12T17:26:14.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.636+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~gC6v5Xzj8vjir4ZMnKGp2iw82B-Kiiy.4 2024-09-12T17:26:14.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.636+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~gC6v5Xzj8vjir4ZMnKGp2iw82B-Kiiy.4_1 2024-09-12T17:26:14.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.636+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~gC6v5Xzj8vjir4ZMnKGp2iw82B-Kiiy.4_2 2024-09-12T17:26:14.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.636+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~gC6v5Xzj8vjir4ZMnKGp2iw82B-Kiiy.5 2024-09-12T17:26:14.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.640+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~gC6v5Xzj8vjir4ZMnKGp2iw82B-Kiiy.5_1 2024-09-12T17:26:14.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.640+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__shadow_key1.2~gC6v5Xzj8vjir4ZMnKGp2iw82B-Kiiy.5_2 2024-09-12T17:26:14.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.640+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55__multipart_key1.2~gC6v5Xzj8vjir4ZMnKGp2iw82B-Kiiy.6 2024-09-12T17:26:14.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.648+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:26:14.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.656+0000 7f63686c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:26:14.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.660+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:14.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.660+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:14.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.660+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:14.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.664+0000 7f63686c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:26:14.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.668+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:14.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.668+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:14.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.672+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:14.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.672+0000 7f63686c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:26:14.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.676+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:14.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.680+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:14.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.680+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:26:14.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.680+0000 7f63686c29c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15015174836144418737', time=2024-09-12T19:25:44.707669+0000, chain.objs.size()=9 2024-09-12T17:26:14.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.680+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__multipart_key1.2~AV2gcvWjDv1BnNMcTItL9tCvNsXhRWA.1 2024-09-12T17:26:14.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.680+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__shadow_key1.2~AV2gcvWjDv1BnNMcTItL9tCvNsXhRWA.1_1 2024-09-12T17:26:14.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.680+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__multipart_key1.2~AV2gcvWjDv1BnNMcTItL9tCvNsXhRWA.2 2024-09-12T17:26:14.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.680+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__shadow_key1.2~AV2gcvWjDv1BnNMcTItL9tCvNsXhRWA.2_1 2024-09-12T17:26:14.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.680+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__multipart_key1.2~AV2gcvWjDv1BnNMcTItL9tCvNsXhRWA.3 2024-09-12T17:26:14.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.680+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__shadow_key1.2~AV2gcvWjDv1BnNMcTItL9tCvNsXhRWA.3_1 2024-09-12T17:26:14.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.680+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__multipart_key1.2~AV2gcvWjDv1BnNMcTItL9tCvNsXhRWA.4 2024-09-12T17:26:14.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.680+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__shadow_key1.2~AV2gcvWjDv1BnNMcTItL9tCvNsXhRWA.4_1 2024-09-12T17:26:14.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.680+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__multipart_key1.2~AV2gcvWjDv1BnNMcTItL9tCvNsXhRWA.5 2024-09-12T17:26:14.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.680+0000 7f63686c29c0 20 garbage collection: RGWGC::process iterating over entry tag='2~xkOzseycpaERccVDqg90kq-dvywLWR5', time=2024-09-12T19:25:55.381636+0000, chain.objs.size()=5 2024-09-12T17:26:14.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.680+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.54__multipart_key1.2~xkOzseycpaERccVDqg90kq-dvywLWR5.7 2024-09-12T17:26:14.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.680+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.54__shadow_key1.2~xkOzseycpaERccVDqg90kq-dvywLWR5.7_1 2024-09-12T17:26:14.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.680+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.54__multipart_key1.2~xkOzseycpaERccVDqg90kq-dvywLWR5.10 2024-09-12T17:26:14.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.688+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.54__shadow_key1.2~xkOzseycpaERccVDqg90kq-dvywLWR5.10_1 2024-09-12T17:26:14.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.688+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.54__multipart_key1.2~xkOzseycpaERccVDqg90kq-dvywLWR5.13 2024-09-12T17:26:14.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.688+0000 7f63686c29c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4592936788976278447', time=2024-09-12T19:26:07.598532+0000, chain.objs.size()=1 2024-09-12T17:26:14.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.688+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.56__shadow_.5jnpuzME1e3GHLM-LQbR19SrRruGEG1_0 2024-09-12T17:26:14.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.692+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:26:14.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.700+0000 7f63686c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:26:14.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.704+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:14.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.704+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:14.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.704+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:26:14.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.704+0000 7f63686c29c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15484821191454260604', time=2024-09-12T19:25:40.902684+0000, chain.objs.size()=9 2024-09-12T17:26:14.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.704+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.42__multipart_key1.2~tIn9237sSl-R3uSzQcbl5P6cSyaQB-d.1 2024-09-12T17:26:14.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.704+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.42__shadow_key1.2~tIn9237sSl-R3uSzQcbl5P6cSyaQB-d.1_1 2024-09-12T17:26:14.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.708+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.42__multipart_key1.2~tIn9237sSl-R3uSzQcbl5P6cSyaQB-d.2 2024-09-12T17:26:14.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.708+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.42__shadow_key1.2~tIn9237sSl-R3uSzQcbl5P6cSyaQB-d.2_1 2024-09-12T17:26:14.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.708+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.42__multipart_key1.2~tIn9237sSl-R3uSzQcbl5P6cSyaQB-d.3 2024-09-12T17:26:14.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.708+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.42__shadow_key1.2~tIn9237sSl-R3uSzQcbl5P6cSyaQB-d.3_1 2024-09-12T17:26:14.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.708+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.42__multipart_key1.2~tIn9237sSl-R3uSzQcbl5P6cSyaQB-d.4 2024-09-12T17:26:14.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.708+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.42__shadow_key1.2~tIn9237sSl-R3uSzQcbl5P6cSyaQB-d.4_1 2024-09-12T17:26:14.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.708+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.42__multipart_key1.2~tIn9237sSl-R3uSzQcbl5P6cSyaQB-d.5 2024-09-12T17:26:14.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.716+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:26:14.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.724+0000 7f63686c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:26:14.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.728+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:14.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.728+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:14.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.732+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:14.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.732+0000 7f63686c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:26:14.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.736+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:14.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.740+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:14.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.740+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:14.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.744+0000 7f63686c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:26:14.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.748+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:14.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.748+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:14.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.748+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:26:14.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.748+0000 7f63686c29c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16416605591944648964', time=2024-09-12T19:25:42.091641+0000, chain.objs.size()=9 2024-09-12T17:26:14.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.748+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.44__multipart_key1.2~1Ezg6h1udRV36KgvKQXUFam_uU3xGYR.1 2024-09-12T17:26:14.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.748+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.44__shadow_key1.2~1Ezg6h1udRV36KgvKQXUFam_uU3xGYR.1_1 2024-09-12T17:26:14.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.748+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.44__multipart_key1.2~1Ezg6h1udRV36KgvKQXUFam_uU3xGYR.2 2024-09-12T17:26:14.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.748+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.44__shadow_key1.2~1Ezg6h1udRV36KgvKQXUFam_uU3xGYR.2_1 2024-09-12T17:26:14.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.748+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.44__multipart_key1.2~1Ezg6h1udRV36KgvKQXUFam_uU3xGYR.3 2024-09-12T17:26:14.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.748+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.44__shadow_key1.2~1Ezg6h1udRV36KgvKQXUFam_uU3xGYR.3_1 2024-09-12T17:26:14.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.748+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.44__multipart_key1.2~1Ezg6h1udRV36KgvKQXUFam_uU3xGYR.4 2024-09-12T17:26:14.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.748+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.44__shadow_key1.2~1Ezg6h1udRV36KgvKQXUFam_uU3xGYR.4_1 2024-09-12T17:26:14.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.748+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.44__multipart_key1.2~1Ezg6h1udRV36KgvKQXUFam_uU3xGYR.5 2024-09-12T17:26:14.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.748+0000 7f63686c29c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2613460739878597107', time=2024-09-12T19:25:48.833503+0000, chain.objs.size()=7 2024-09-12T17:26:14.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.748+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__multipart_key1.2~07S2w8zsNTIFW0Vj59lbvfF8hod5Jj3.1 2024-09-12T17:26:14.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.748+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__shadow_key1.2~07S2w8zsNTIFW0Vj59lbvfF8hod5Jj3.1_1 2024-09-12T17:26:14.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.748+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__shadow_key1.2~07S2w8zsNTIFW0Vj59lbvfF8hod5Jj3.1_2 2024-09-12T17:26:14.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.760+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__multipart_key1.2~07S2w8zsNTIFW0Vj59lbvfF8hod5Jj3.2 2024-09-12T17:26:14.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.760+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__shadow_key1.2~07S2w8zsNTIFW0Vj59lbvfF8hod5Jj3.2_1 2024-09-12T17:26:14.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.760+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__shadow_key1.2~07S2w8zsNTIFW0Vj59lbvfF8hod5Jj3.2_2 2024-09-12T17:26:14.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.760+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.47__multipart_key1.2~07S2w8zsNTIFW0Vj59lbvfF8hod5Jj3.3 2024-09-12T17:26:14.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.760+0000 7f63686c29c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10359627241957002921', time=2024-09-12T19:25:54.218720+0000, chain.objs.size()=1 2024-09-12T17:26:14.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.760+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.53__shadow_.TCS4rDxK4fVZ7pA-jmNxAnAXwE4UnQW_0 2024-09-12T17:26:14.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.768+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:26:14.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.772+0000 7f63686c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:26:14.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.776+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:14.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.780+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:14.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.780+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:14.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.780+0000 7f63686c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:26:14.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.784+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:14.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.788+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:14.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.788+0000 7f63686c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:26:14.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.788+0000 7f63686c29c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9394963293111390152', time=2024-09-12T19:25:54.205882+0000, chain.objs.size()=9 2024-09-12T17:26:14.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.788+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.53__multipart_file2.mpg.2~ZEUaory22YpE3C3vDuu36gC4ck3pr6l.1 2024-09-12T17:26:14.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.788+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.53__shadow_file2.mpg.2~ZEUaory22YpE3C3vDuu36gC4ck3pr6l.1_1 2024-09-12T17:26:14.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.788+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.53__multipart_file2.mpg.2~ZEUaory22YpE3C3vDuu36gC4ck3pr6l.2 2024-09-12T17:26:14.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.788+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.53__shadow_file2.mpg.2~ZEUaory22YpE3C3vDuu36gC4ck3pr6l.2_1 2024-09-12T17:26:14.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.788+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.53__multipart_file2.mpg.2~ZEUaory22YpE3C3vDuu36gC4ck3pr6l.3 2024-09-12T17:26:14.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.788+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.53__shadow_file2.mpg.2~ZEUaory22YpE3C3vDuu36gC4ck3pr6l.3_1 2024-09-12T17:26:14.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.788+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.53__multipart_file2.mpg.2~ZEUaory22YpE3C3vDuu36gC4ck3pr6l.4 2024-09-12T17:26:14.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.788+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.53__shadow_file2.mpg.2~ZEUaory22YpE3C3vDuu36gC4ck3pr6l.4_1 2024-09-12T17:26:14.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.788+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.53__multipart_file2.mpg.2~ZEUaory22YpE3C3vDuu36gC4ck3pr6l.5 2024-09-12T17:26:14.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.796+0000 7f63686c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:26:14.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.804+0000 7f621d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:14.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.816+0000 7f63686c29c0 20 remove_watcher() i=0 2024-09-12T17:26:14.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.816+0000 7f63686c29c0 2 removed watcher, disabling cache 2024-09-12T17:26:14.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.820+0000 7f63686c29c0 20 remove_watcher() i=1 2024-09-12T17:26:14.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.820+0000 7f63686c29c0 20 remove_watcher() i=2 2024-09-12T17:26:14.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.824+0000 7f63686c29c0 20 remove_watcher() i=3 2024-09-12T17:26:14.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.828+0000 7f63686c29c0 20 remove_watcher() i=4 2024-09-12T17:26:14.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.828+0000 7f63686c29c0 20 remove_watcher() i=5 2024-09-12T17:26:14.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.832+0000 7f63686c29c0 20 remove_watcher() i=6 2024-09-12T17:26:14.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.832+0000 7f63686c29c0 20 remove_watcher() i=7 2024-09-12T17:26:14.856 DEBUG:teuthology.orchestra.run.smithi016:> radosgw-admin gc process --include-all 2024-09-12T17:26:14.928 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:14.929 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:14.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.976+0000 7f3d611379c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:14.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.980+0000 7f3d611379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:14.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.980+0000 7f3d611379c0 20 realm 2024-09-12T17:26:14.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.980+0000 7f3d611379c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:14.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.980+0000 7f3d611379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:14.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.980+0000 7f3d611379c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:14.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.980+0000 7f3d611379c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:14.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.980+0000 7f3d611379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:14.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.980+0000 7f3d611379c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:14.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.980+0000 7f3d611379c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:14.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.980+0000 7f3d611379c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:14.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.984+0000 7f3d611379c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:14.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.984+0000 7f3d611379c0 20 searching for the correct realm 2024-09-12T17:26:14.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.988+0000 7f3d5f43e640 0 -- 172.21.15.16:0/3438410695 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f3d54008040 msgr2=0x7f3d54064820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:14.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:14.996+0000 7f3d5e43c640 0 -- 172.21.15.16:0/3438410695 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f3d58038040 msgr2=0x7f3d580384c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:15.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.216+0000 7f3d611379c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:26:15.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.216+0000 7f3d611379c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:15.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.216+0000 7f3d611379c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:26:15.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.216+0000 7f3d611379c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:15.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.216+0000 7f3d611379c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:15.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.216+0000 7f3d611379c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:15.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.216+0000 7f3d611379c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:15.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.216+0000 7f3d611379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:15.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.216+0000 7f3d611379c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:15.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.216+0000 7f3d611379c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:15.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.216+0000 7f3d611379c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:15.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.216+0000 7f3d611379c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:15.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.216+0000 7f3d611379c0 20 zone default found 2024-09-12T17:26:15.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.216+0000 7f3d611379c0 4 Realm: () 2024-09-12T17:26:15.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.216+0000 7f3d611379c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:26:15.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.216+0000 7f3d611379c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:26:15.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.216+0000 7f3d611379c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:15.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.216+0000 7f3d611379c0 20 zonegroup default 2024-09-12T17:26:15.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.216+0000 7f3d611379c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:15.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.216+0000 7f3d611379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:15.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.220+0000 7f3d611379c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:15.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.220+0000 7f3d611379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:15.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.220+0000 7f3d611379c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:15.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.220+0000 7f3d611379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:15.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.220+0000 7f3d611379c0 20 started sync module instance, tier type = 2024-09-12T17:26:15.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.220+0000 7f3d611379c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:26:15.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.244+0000 7f3d611379c0 20 add_watcher() i=0 2024-09-12T17:26:15.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.244+0000 7f3d611379c0 20 add_watcher() i=1 2024-09-12T17:26:15.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.244+0000 7f3d611379c0 20 add_watcher() i=2 2024-09-12T17:26:15.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.244+0000 7f3d611379c0 20 add_watcher() i=3 2024-09-12T17:26:15.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.244+0000 7f3d611379c0 20 add_watcher() i=4 2024-09-12T17:26:15.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.244+0000 7f3d611379c0 20 add_watcher() i=5 2024-09-12T17:26:15.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.244+0000 7f3d611379c0 20 add_watcher() i=6 2024-09-12T17:26:15.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.244+0000 7f3d611379c0 20 add_watcher() i=7 2024-09-12T17:26:15.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.244+0000 7f3d611379c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:15.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.248+0000 7f3c157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:15.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.252+0000 7f3d611379c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:15.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.252+0000 7f3d611379c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:15.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.340+0000 7f3b8ffff640 20 reqs_thread_entry: start 2024-09-12T17:26:15.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.340+0000 7f3d611379c0 20 init_complete bucket index max shards: 1 2024-09-12T17:26:15.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.340+0000 7f3d611379c0 20 Filter name: none 2024-09-12T17:26:15.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.340+0000 7f3b8dffb640 20 reqs_thread_entry: start 2024-09-12T17:26:15.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.340+0000 7f3d611379c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:26:15.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.344+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.348+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:15.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.348+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.352+0000 7f3d611379c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:26:15.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.352+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.352+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:15.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.356+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.356+0000 7f3d611379c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:26:15.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.360+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.364+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:15.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.364+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.368+0000 7f3d611379c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:26:15.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.368+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.372+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:15.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.372+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.376+0000 7f3d611379c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:26:15.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.380+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.380+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:15.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.380+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.380+0000 7f3d611379c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:26:15.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.384+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.388+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:15.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.388+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.392+0000 7f3d611379c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:26:15.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.396+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.396+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:15.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.396+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.396+0000 7f3d611379c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:26:15.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.400+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.400+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:15.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.400+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.404+0000 7f3d611379c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:26:15.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.408+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.408+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:15.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.408+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.408+0000 7f3d611379c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:26:15.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.412+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.416+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:15.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.416+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.420+0000 7f3d611379c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:26:15.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.424+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.424+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:15.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.424+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.428+0000 7f3d611379c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:26:15.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.428+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.432+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:15.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.432+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.436+0000 7f3d611379c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:26:15.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.436+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.436+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:15.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.436+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.440+0000 7f3d611379c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:26:15.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.440+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.440+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:15.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.444+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.444+0000 7f3d611379c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:26:15.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.448+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.448+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:15.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.448+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.452+0000 7f3d611379c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:26:15.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.456+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.456+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:15.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.456+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.460+0000 7f3d611379c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:26:15.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.460+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.464+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:15.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.464+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.464+0000 7f3d611379c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:26:15.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.468+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.468+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:15.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.468+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.472+0000 7f3d611379c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:26:15.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.476+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.476+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:15.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.476+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.480+0000 7f3d611379c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:26:15.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.484+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.484+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:15.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.484+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.488+0000 7f3d611379c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:26:15.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.492+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.492+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:15.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.492+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.496+0000 7f3d611379c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:26:15.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.500+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.500+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:15.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.500+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.504+0000 7f3d611379c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:26:15.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.504+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.508+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:15.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.508+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.512+0000 7f3d611379c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:26:15.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.516+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.516+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:15.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.516+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.520+0000 7f3d611379c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:26:15.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.524+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.528+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:15.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.528+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.528+0000 7f3d611379c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:26:15.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.532+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.532+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:15.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.536+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.536+0000 7f3d611379c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:26:15.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.540+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.544+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:15.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.544+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.548+0000 7f3d611379c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:26:15.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.552+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.552+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:15.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.552+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.556+0000 7f3d611379c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:26:15.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.560+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.560+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:15.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.564+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.564+0000 7f3d611379c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:26:15.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.568+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.572+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:15.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.572+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.572+0000 7f3d611379c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:26:15.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.576+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.580+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:15.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.580+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.584+0000 7f3d611379c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:26:15.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.588+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.588+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:15.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.588+0000 7f3d611379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:15.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.596+0000 7f3c157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:15.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.600+0000 7f3d611379c0 20 remove_watcher() i=0 2024-09-12T17:26:15.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.600+0000 7f3d611379c0 2 removed watcher, disabling cache 2024-09-12T17:26:15.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.604+0000 7f3d611379c0 20 remove_watcher() i=1 2024-09-12T17:26:15.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.608+0000 7f3d611379c0 20 remove_watcher() i=2 2024-09-12T17:26:15.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.612+0000 7f3d611379c0 20 remove_watcher() i=3 2024-09-12T17:26:15.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.612+0000 7f3d611379c0 20 remove_watcher() i=4 2024-09-12T17:26:15.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.616+0000 7f3d611379c0 20 remove_watcher() i=5 2024-09-12T17:26:15.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.620+0000 7f3d611379c0 20 remove_watcher() i=6 2024-09-12T17:26:15.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.620+0000 7f3d611379c0 20 remove_watcher() i=7 2024-09-12T17:26:15.646 DEBUG:teuthology.orchestra.run.smithi016:> radosgw-admin gc process --include-all 2024-09-12T17:26:15.725 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:15.725 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:15.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.772+0000 7f8760fde9c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:15.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.772+0000 7f8760fde9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:15.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.772+0000 7f8760fde9c0 20 realm 2024-09-12T17:26:15.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.772+0000 7f8760fde9c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:15.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.772+0000 7f8760fde9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:15.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.772+0000 7f8760fde9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:15.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.772+0000 7f8760fde9c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:15.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.772+0000 7f8760fde9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:15.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.772+0000 7f8760fde9c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:15.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.776+0000 7f8760fde9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:15.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.776+0000 7f8760fde9c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:15.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.776+0000 7f8760fde9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:15.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.776+0000 7f8760fde9c0 20 searching for the correct realm 2024-09-12T17:26:15.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.780+0000 7f875f2e5640 0 -- 172.21.15.16:0/835997892 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f87540e1070 msgr2=0x7f87540e2400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:15.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:15.996+0000 7f875e2e3640 0 -- 172.21.15.16:0/835997892 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f875802d940 msgr2=0x7f87580433f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:16.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.216+0000 7f8760fde9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:26:16.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.216+0000 7f8760fde9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:16.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.216+0000 7f8760fde9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:26:16.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.216+0000 7f8760fde9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:16.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.216+0000 7f8760fde9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:16.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.216+0000 7f8760fde9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:16.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.216+0000 7f8760fde9c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:16.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.216+0000 7f8760fde9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:16.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.216+0000 7f8760fde9c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:16.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.216+0000 7f8760fde9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:16.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.216+0000 7f8760fde9c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:16.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.216+0000 7f8760fde9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:16.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.216+0000 7f8760fde9c0 20 zone default found 2024-09-12T17:26:16.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.216+0000 7f8760fde9c0 4 Realm: () 2024-09-12T17:26:16.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.216+0000 7f8760fde9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:26:16.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.216+0000 7f8760fde9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:26:16.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.216+0000 7f8760fde9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:16.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.216+0000 7f8760fde9c0 20 zonegroup default 2024-09-12T17:26:16.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.216+0000 7f8760fde9c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:16.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.220+0000 7f8760fde9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:16.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.220+0000 7f8760fde9c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:16.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.220+0000 7f8760fde9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:16.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.220+0000 7f8760fde9c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:16.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.220+0000 7f8760fde9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:16.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.220+0000 7f8760fde9c0 20 started sync module instance, tier type = 2024-09-12T17:26:16.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.220+0000 7f8760fde9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:26:16.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.244+0000 7f8760fde9c0 20 add_watcher() i=0 2024-09-12T17:26:16.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.244+0000 7f8760fde9c0 20 add_watcher() i=1 2024-09-12T17:26:16.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.244+0000 7f8760fde9c0 20 add_watcher() i=2 2024-09-12T17:26:16.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.244+0000 7f8760fde9c0 20 add_watcher() i=3 2024-09-12T17:26:16.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.244+0000 7f8760fde9c0 20 add_watcher() i=4 2024-09-12T17:26:16.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.244+0000 7f8760fde9c0 20 add_watcher() i=5 2024-09-12T17:26:16.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.244+0000 7f8760fde9c0 20 add_watcher() i=6 2024-09-12T17:26:16.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.248+0000 7f8760fde9c0 20 add_watcher() i=7 2024-09-12T17:26:16.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.248+0000 7f8760fde9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:16.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.252+0000 7f86157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:16.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.252+0000 7f8760fde9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:16.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.252+0000 7f8760fde9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:16.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.360+0000 7f858ffff640 20 reqs_thread_entry: start 2024-09-12T17:26:16.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.360+0000 7f8760fde9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:26:16.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.360+0000 7f8760fde9c0 20 Filter name: none 2024-09-12T17:26:16.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.360+0000 7f858dffb640 20 reqs_thread_entry: start 2024-09-12T17:26:16.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.360+0000 7f8760fde9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:26:16.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.364+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.364+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:16.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.364+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.364+0000 7f8760fde9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:26:16.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.368+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.372+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:16.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.372+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.372+0000 7f8760fde9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:26:16.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.376+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.376+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:16.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.380+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.380+0000 7f8760fde9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:26:16.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.384+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.384+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:16.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.388+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.388+0000 7f8760fde9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:26:16.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.392+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.396+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:16.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.396+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.400+0000 7f8760fde9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:26:16.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.404+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.404+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:16.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.408+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.408+0000 7f8760fde9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:26:16.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.412+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.412+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:16.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.416+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.416+0000 7f8760fde9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:26:16.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.420+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.424+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:16.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.424+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.428+0000 7f8760fde9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:26:16.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.432+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.432+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:16.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.432+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.436+0000 7f8760fde9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:26:16.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.440+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.440+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:16.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.440+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.444+0000 7f8760fde9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:26:16.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.448+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.448+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:16.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.452+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.456+0000 7f8760fde9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:26:16.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.460+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.460+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:16.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.464+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.464+0000 7f8760fde9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:26:16.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.468+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.472+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:16.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.472+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.472+0000 7f8760fde9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:26:16.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.480+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.480+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:16.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.480+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.484+0000 7f8760fde9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:26:16.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.488+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.492+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:16.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.492+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.496+0000 7f8760fde9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:26:16.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.500+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.500+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:16.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.500+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.504+0000 7f8760fde9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:26:16.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.508+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.512+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:16.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.512+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.516+0000 7f8760fde9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:26:16.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.516+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.520+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:16.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.520+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.524+0000 7f8760fde9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:26:16.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.524+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.528+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:16.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.528+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.532+0000 7f8760fde9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:26:16.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.536+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.536+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:16.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.536+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.540+0000 7f8760fde9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:26:16.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.544+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.544+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:16.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.544+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.548+0000 7f8760fde9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:26:16.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.552+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.552+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:16.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.552+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.556+0000 7f8760fde9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:26:16.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.560+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.564+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:16.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.564+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.568+0000 7f8760fde9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:26:16.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.568+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.572+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:16.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.572+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.576+0000 7f8760fde9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:26:16.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.576+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.580+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:16.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.580+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.584+0000 7f8760fde9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:26:16.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.588+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.588+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:16.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.588+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.592+0000 7f8760fde9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:26:16.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.596+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.596+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:16.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.596+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.600+0000 7f8760fde9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:26:16.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.604+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.604+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:16.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.608+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.608+0000 7f8760fde9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:26:16.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.612+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.616+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:16.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.616+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.616+0000 7f8760fde9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:26:16.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.620+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.620+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:16.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.624+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.624+0000 7f8760fde9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:26:16.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.628+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.632+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:16.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.632+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.636+0000 7f8760fde9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:26:16.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.636+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.640+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:16.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.640+0000 7f8760fde9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:16.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.644+0000 7f86157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:16.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.652+0000 7f8760fde9c0 20 remove_watcher() i=0 2024-09-12T17:26:16.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.652+0000 7f8760fde9c0 2 removed watcher, disabling cache 2024-09-12T17:26:16.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.652+0000 7f8760fde9c0 20 remove_watcher() i=1 2024-09-12T17:26:16.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.656+0000 7f8760fde9c0 20 remove_watcher() i=2 2024-09-12T17:26:16.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.660+0000 7f8760fde9c0 20 remove_watcher() i=3 2024-09-12T17:26:16.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.664+0000 7f8760fde9c0 20 remove_watcher() i=4 2024-09-12T17:26:16.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.664+0000 7f8760fde9c0 20 remove_watcher() i=5 2024-09-12T17:26:16.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.668+0000 7f8760fde9c0 20 remove_watcher() i=6 2024-09-12T17:26:16.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.668+0000 7f8760fde9c0 20 remove_watcher() i=7 2024-09-12T17:26:16.699 DEBUG:teuthology.orchestra.run.smithi016:> radosgw-admin gc process --include-all 2024-09-12T17:26:16.773 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:16.773 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:16.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.816+0000 7f30f10c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:16.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.820+0000 7f30f10c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:16.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.820+0000 7f30f10c09c0 20 realm 2024-09-12T17:26:16.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.820+0000 7f30f10c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:16.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.820+0000 7f30f10c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:16.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.820+0000 7f30f10c09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:16.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.820+0000 7f30f10c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:16.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.820+0000 7f30f10c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:16.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.820+0000 7f30f10c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:16.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.820+0000 7f30f10c09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:16.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.820+0000 7f30f10c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:16.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.824+0000 7f30f10c09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:16.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.824+0000 7f30f10c09c0 20 searching for the correct realm 2024-09-12T17:26:16.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.828+0000 7f30ef3c7640 0 -- 172.21.15.16:0/1071075400 >> [v2:172.21.15.19:6800/1509147557,v1:172.21.15.19:6801/1509147557] conn(0x55d6de82a350 msgr2=0x55d6de82c740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:16.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:16.836+0000 7f30ee3c5640 0 -- 172.21.15.16:0/1071075400 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f30e8139130 msgr2=0x7f30e80f20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:26:17.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.052+0000 7f30f10c09c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:26:17.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.052+0000 7f30f10c09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:17.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.052+0000 7f30f10c09c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:26:17.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.052+0000 7f30f10c09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:17.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.052+0000 7f30f10c09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:17.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.052+0000 7f30f10c09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:17.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.052+0000 7f30f10c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:17.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.056+0000 7f30f10c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:17.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.056+0000 7f30f10c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:17.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.056+0000 7f30f10c09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:17.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.056+0000 7f30f10c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:17.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.056+0000 7f30f10c09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:17.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.056+0000 7f30f10c09c0 20 zone default found 2024-09-12T17:26:17.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.056+0000 7f30f10c09c0 4 Realm: () 2024-09-12T17:26:17.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.056+0000 7f30f10c09c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:26:17.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.056+0000 7f30f10c09c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:26:17.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.056+0000 7f30f10c09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:17.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.056+0000 7f30f10c09c0 20 zonegroup default 2024-09-12T17:26:17.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.056+0000 7f30f10c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:17.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.056+0000 7f30f10c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:17.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.056+0000 7f30f10c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:17.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.056+0000 7f30f10c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:17.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.056+0000 7f30f10c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:17.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.060+0000 7f30f10c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:17.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.060+0000 7f30f10c09c0 20 started sync module instance, tier type = 2024-09-12T17:26:17.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.060+0000 7f30f10c09c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:26:17.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.084+0000 7f30f10c09c0 20 add_watcher() i=0 2024-09-12T17:26:17.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.084+0000 7f30f10c09c0 20 add_watcher() i=1 2024-09-12T17:26:17.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.084+0000 7f30f10c09c0 20 add_watcher() i=2 2024-09-12T17:26:17.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.084+0000 7f30f10c09c0 20 add_watcher() i=3 2024-09-12T17:26:17.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.084+0000 7f30f10c09c0 20 add_watcher() i=4 2024-09-12T17:26:17.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.084+0000 7f30f10c09c0 20 add_watcher() i=5 2024-09-12T17:26:17.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.084+0000 7f30f10c09c0 20 add_watcher() i=6 2024-09-12T17:26:17.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.084+0000 7f30f10c09c0 20 add_watcher() i=7 2024-09-12T17:26:17.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.084+0000 7f30f10c09c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:17.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.092+0000 7f2fa57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:17.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.092+0000 7f30f10c09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:17.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.092+0000 7f30f10c09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:17.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.188+0000 7f2f1ffff640 20 reqs_thread_entry: start 2024-09-12T17:26:17.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.188+0000 7f30f10c09c0 20 init_complete bucket index max shards: 1 2024-09-12T17:26:17.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.188+0000 7f30f10c09c0 20 Filter name: none 2024-09-12T17:26:17.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.188+0000 7f2f1dffb640 20 reqs_thread_entry: start 2024-09-12T17:26:17.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.188+0000 7f30f10c09c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:26:17.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.192+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.192+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:17.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.192+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.196+0000 7f30f10c09c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:26:17.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.200+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.200+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:17.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.200+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.200+0000 7f30f10c09c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:26:17.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.204+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.208+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:17.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.208+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.212+0000 7f30f10c09c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:26:17.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.212+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.216+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:17.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.216+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.216+0000 7f30f10c09c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:26:17.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.220+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.220+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:17.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.224+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.224+0000 7f30f10c09c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:26:17.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.228+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.228+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:17.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.228+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.232+0000 7f30f10c09c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:26:17.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.232+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.236+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:17.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.236+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.236+0000 7f30f10c09c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:26:17.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.240+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.240+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:17.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.244+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.244+0000 7f30f10c09c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:26:17.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.248+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.248+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:17.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.248+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.252+0000 7f30f10c09c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:26:17.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.256+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.256+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:17.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.256+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.260+0000 7f30f10c09c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:26:17.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.260+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.260+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:17.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.264+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.264+0000 7f30f10c09c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:26:17.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.268+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.268+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:17.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.272+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.272+0000 7f30f10c09c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:26:17.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.276+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.276+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:17.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.280+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.280+0000 7f30f10c09c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:26:17.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.284+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.284+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:17.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.284+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.288+0000 7f30f10c09c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:26:17.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.292+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.292+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:17.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.292+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.292+0000 7f30f10c09c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:26:17.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.296+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.300+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:17.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.300+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.304+0000 7f30f10c09c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:26:17.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.308+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.308+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:17.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.308+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.312+0000 7f30f10c09c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:26:17.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.316+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.320+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:17.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.320+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.320+0000 7f30f10c09c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:26:17.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.324+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.324+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:17.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.324+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.328+0000 7f30f10c09c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:26:17.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.332+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.332+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:17.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.336+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.336+0000 7f30f10c09c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:26:17.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.340+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.340+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:17.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.344+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.344+0000 7f30f10c09c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:26:17.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.348+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.348+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:17.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.352+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.352+0000 7f30f10c09c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:26:17.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.356+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.360+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:17.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.360+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.368+0000 7f30f10c09c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:26:17.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.372+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.372+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:17.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.376+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.376+0000 7f30f10c09c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:26:17.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.380+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.384+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:17.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.384+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.388+0000 7f30f10c09c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:26:17.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.392+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.392+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:17.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.392+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.396+0000 7f30f10c09c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:26:17.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.400+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.400+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:17.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.400+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.404+0000 7f30f10c09c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:26:17.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.408+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.412+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:17.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.412+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.416+0000 7f30f10c09c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:26:17.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.420+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.420+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:17.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.424+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.424+0000 7f30f10c09c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:26:17.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.428+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.432+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:17.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.432+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.432+0000 7f30f10c09c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:26:17.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.436+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.440+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:17.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.440+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.444+0000 7f30f10c09c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:26:17.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.448+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.448+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:17.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.448+0000 7f30f10c09c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:17.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.456+0000 7f2fa57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:17.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.460+0000 7f30f10c09c0 20 remove_watcher() i=0 2024-09-12T17:26:17.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.460+0000 7f30f10c09c0 2 removed watcher, disabling cache 2024-09-12T17:26:17.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.464+0000 7f30f10c09c0 20 remove_watcher() i=1 2024-09-12T17:26:17.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.464+0000 7f30f10c09c0 20 remove_watcher() i=2 2024-09-12T17:26:17.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.468+0000 7f30f10c09c0 20 remove_watcher() i=3 2024-09-12T17:26:17.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.472+0000 7f30f10c09c0 20 remove_watcher() i=4 2024-09-12T17:26:17.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.476+0000 7f30f10c09c0 20 remove_watcher() i=5 2024-09-12T17:26:17.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.476+0000 7f30f10c09c0 20 remove_watcher() i=6 2024-09-12T17:26:17.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:17.480+0000 7f30f10c09c0 20 remove_watcher() i=7 2024-09-12T17:26:17.501 DEBUG:teuthology.orchestra.run.smithi016:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-09-12T17:26:18.208 INFO:teuthology.orchestra.run.smithi016.stdout:> Task :clean 2024-09-12T17:26:19.006 INFO:teuthology.orchestra.run.smithi016.stdout:> Task :compileJava 2024-09-12T17:26:19.006 INFO:teuthology.orchestra.run.smithi016.stdout:> Task :processResources 2024-09-12T17:26:19.006 INFO:teuthology.orchestra.run.smithi016.stdout:> Task :classes 2024-09-12T17:26:19.506 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:19.506 INFO:teuthology.orchestra.run.smithi016.stdout:> Task :compileTestJava 2024-09-12T17:26:19.507 INFO:teuthology.orchestra.run.smithi016.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T17:26:19.507 INFO:teuthology.orchestra.run.smithi016.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T17:26:19.507 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:19.508 INFO:teuthology.orchestra.run.smithi016.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T17:26:19.508 INFO:teuthology.orchestra.run.smithi016.stdout:> Task :testClasses 2024-09-12T17:26:21.508 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:21.509 INFO:teuthology.orchestra.run.smithi016.stdout:> Task :test 2024-09-12T17:26:21.509 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:21.509 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Bucket tests STANDARD_OUT 2024-09-12T17:26:21.509 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12 17:26:20,899 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T17:26:21.509 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:21.509 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-09-12T17:26:21.509 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:21.509 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-09-12T17:26:21.509 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:21.509 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-09-12T17:26:21.509 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:21.510 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-09-12T17:26:21.606 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:21.606 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-09-12T17:26:21.606 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:21.606 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-09-12T17:26:21.806 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:21.806 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-09-12T17:26:21.906 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:21.906 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-09-12T17:26:22.006 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:22.006 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-09-12T17:26:22.106 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:22.106 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-09-12T17:26:22.406 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:22.406 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-09-12T17:26:22.506 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:22.506 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-09-12T17:26:22.606 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:22.606 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-09-12T17:26:22.706 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:22.706 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-09-12T17:26:23.106 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:23.106 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-09-12T17:26:23.206 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:23.206 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-09-12T17:26:23.406 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:23.406 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-09-12T17:26:23.406 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:23.406 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-09-12T17:26:23.558 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:23.558 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------- 2024-09-12T17:26:23.558 INFO:teuthology.orchestra.run.smithi016.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-09-12T17:26:23.558 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------- 2024-09-12T17:26:23.558 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:23.558 INFO:teuthology.orchestra.run.smithi016.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T17:26:23.558 INFO:teuthology.orchestra.run.smithi016.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T17:26:23.558 INFO:teuthology.orchestra.run.smithi016.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T17:26:23.558 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:23.558 INFO:teuthology.orchestra.run.smithi016.stdout:BUILD SUCCESSFUL in 5s 2024-09-12T17:26:23.559 INFO:teuthology.orchestra.run.smithi016.stdout:5 actionable tasks: 5 executed 2024-09-12T17:26:23.565 DEBUG:teuthology.orchestra.run.smithi016:> radosgw-admin gc process --include-all 2024-09-12T17:26:23.592 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:23.592 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:23.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.636+0000 7fd4f08589c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.640+0000 7fd4f08589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:23.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.640+0000 7fd4f08589c0 20 realm 2024-09-12T17:26:23.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.640+0000 7fd4f08589c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.640+0000 7fd4f08589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:23.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.640+0000 7fd4f08589c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:23.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.640+0000 7fd4f08589c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.640+0000 7fd4f08589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:23.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.640+0000 7fd4f08589c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.640+0000 7fd4f08589c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:23.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.640+0000 7fd4f08589c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.644+0000 7fd4f08589c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:23.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.644+0000 7fd4f08589c0 20 searching for the correct realm 2024-09-12T17:26:23.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.644+0000 7fd4e7fff640 0 -- 172.21.15.16:0/2232427202 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7fd4e0008040 msgr2=0x7fd4e005c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:23.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.860+0000 7fd4eeb5f640 0 -- 172.21.15.16:0/2232427202 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fd4d8027040 msgr2=0x7fd4d803e3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:23.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.876+0000 7fd4f08589c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:26:23.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.876+0000 7fd4f08589c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:23.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.876+0000 7fd4f08589c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:26:23.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.876+0000 7fd4f08589c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:23.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.876+0000 7fd4f08589c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:23.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.876+0000 7fd4f08589c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:23.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.876+0000 7fd4f08589c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.876+0000 7fd4f08589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:23.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.876+0000 7fd4f08589c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.880+0000 7fd4f08589c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:23.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.880+0000 7fd4f08589c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.880+0000 7fd4f08589c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:23.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.880+0000 7fd4f08589c0 20 zone default found 2024-09-12T17:26:23.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.880+0000 7fd4f08589c0 4 Realm: () 2024-09-12T17:26:23.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.880+0000 7fd4f08589c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:26:23.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.880+0000 7fd4f08589c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:26:23.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.880+0000 7fd4f08589c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:23.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.880+0000 7fd4f08589c0 20 zonegroup default 2024-09-12T17:26:23.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.880+0000 7fd4f08589c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.880+0000 7fd4f08589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:23.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.880+0000 7fd4f08589c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.880+0000 7fd4f08589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:23.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.880+0000 7fd4f08589c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:23.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.884+0000 7fd4f08589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:23.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.884+0000 7fd4f08589c0 20 started sync module instance, tier type = 2024-09-12T17:26:23.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.884+0000 7fd4f08589c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:26:23.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.908+0000 7fd4f08589c0 20 add_watcher() i=0 2024-09-12T17:26:23.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.908+0000 7fd4f08589c0 20 add_watcher() i=1 2024-09-12T17:26:23.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.908+0000 7fd4f08589c0 20 add_watcher() i=2 2024-09-12T17:26:23.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.908+0000 7fd4f08589c0 20 add_watcher() i=3 2024-09-12T17:26:23.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.908+0000 7fd4f08589c0 20 add_watcher() i=4 2024-09-12T17:26:23.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.908+0000 7fd4f08589c0 20 add_watcher() i=5 2024-09-12T17:26:23.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.908+0000 7fd4f08589c0 20 add_watcher() i=6 2024-09-12T17:26:23.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.908+0000 7fd4f08589c0 20 add_watcher() i=7 2024-09-12T17:26:23.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.908+0000 7fd4f08589c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:23.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.912+0000 7fd3a4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:23.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.912+0000 7fd4f08589c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:23.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:23.912+0000 7fd4f08589c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:24.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.012+0000 7fd31f7fe640 20 reqs_thread_entry: start 2024-09-12T17:26:24.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.016+0000 7fd4f08589c0 20 init_complete bucket index max shards: 1 2024-09-12T17:26:24.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.016+0000 7fd4f08589c0 20 Filter name: none 2024-09-12T17:26:24.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.016+0000 7fd31d7fa640 20 reqs_thread_entry: start 2024-09-12T17:26:24.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.016+0000 7fd4f08589c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:26:24.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.016+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.016+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:24.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.020+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.020+0000 7fd4f08589c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:26:24.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.024+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.028+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:24.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.028+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.028+0000 7fd4f08589c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:26:24.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.032+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.032+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:24.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.032+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.036+0000 7fd4f08589c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:26:24.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.036+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.040+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:24.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.040+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.040+0000 7fd4f08589c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:26:24.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.044+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.044+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:24.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.048+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.048+0000 7fd4f08589c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:26:24.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.052+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.056+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:24.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.056+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.060+0000 7fd4f08589c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:26:24.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.064+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.064+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:24.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.064+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.068+0000 7fd4f08589c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:26:24.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.072+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.076+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:24.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.076+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.080+0000 7fd4f08589c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:26:24.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.080+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.084+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:24.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.084+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.084+0000 7fd4f08589c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:26:24.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.088+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.092+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:24.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.092+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.096+0000 7fd4f08589c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:26:24.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.100+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.100+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:24.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.100+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.104+0000 7fd4f08589c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:26:24.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.108+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.108+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:24.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.108+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.112+0000 7fd4f08589c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:26:24.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.116+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.116+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:24.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.116+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.120+0000 7fd4f08589c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:26:24.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.124+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.124+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:24.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.124+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.128+0000 7fd4f08589c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:26:24.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.132+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.132+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:24.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.132+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.136+0000 7fd4f08589c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:26:24.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.140+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.144+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:24.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.144+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.148+0000 7fd4f08589c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:26:24.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.152+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.152+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:24.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.152+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.156+0000 7fd4f08589c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:26:24.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.160+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.160+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:24.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.160+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:26:24.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.160+0000 7fd4f08589c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17433402371312989170', time=2024-09-12T19:26:22.217037+0000, chain.objs.size()=1 2024-09-12T17:26:24.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.160+0000 7fd4f08589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.71__shadow_.c_qi9cSiqb8VlCnWUKESaT_Mex9Ugs__0 2024-09-12T17:26:24.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.164+0000 7fd4f08589c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:26:24.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.168+0000 7fd4f08589c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:26:24.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.172+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.172+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:24.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.176+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.176+0000 7fd4f08589c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:26:24.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.180+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.180+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:24.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.184+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.184+0000 7fd4f08589c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:26:24.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.188+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.188+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:24.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.192+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.192+0000 7fd4f08589c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:26:24.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.196+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.200+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:24.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.200+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.204+0000 7fd4f08589c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:26:24.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.204+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.208+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:24.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.208+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.208+0000 7fd4f08589c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:26:24.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.212+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.216+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:24.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.216+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.216+0000 7fd4f08589c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:26:24.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.220+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.220+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:24.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.224+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.224+0000 7fd4f08589c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:26:24.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.228+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.232+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:24.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.232+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.232+0000 7fd4f08589c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:26:24.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.236+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.240+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:24.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.240+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.244+0000 7fd4f08589c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:26:24.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.248+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.248+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:24.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.248+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.252+0000 7fd4f08589c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:26:24.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.256+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.256+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:24.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.260+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.260+0000 7fd4f08589c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:26:24.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.264+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.264+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:24.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.268+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.268+0000 7fd4f08589c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:26:24.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.276+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.276+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:24.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.276+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.280+0000 7fd4f08589c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:26:24.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.284+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:24.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.284+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:24.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.288+0000 7fd4f08589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:26:24.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.288+0000 7fd4f08589c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6422732266945761718', time=2024-09-12T19:26:22.736471+0000, chain.objs.size()=1 2024-09-12T17:26:24.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.288+0000 7fd4f08589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.72__shadow_.ZtIkmfmkVBNiKuvCXsJ7dypuqWYXSes_0 2024-09-12T17:26:24.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.288+0000 7fd4f08589c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:26:24.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.296+0000 7fd3a4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:24.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.304+0000 7fd4f08589c0 20 remove_watcher() i=0 2024-09-12T17:26:24.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.304+0000 7fd4f08589c0 2 removed watcher, disabling cache 2024-09-12T17:26:24.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.304+0000 7fd4f08589c0 20 remove_watcher() i=1 2024-09-12T17:26:24.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.308+0000 7fd4f08589c0 20 remove_watcher() i=2 2024-09-12T17:26:24.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.312+0000 7fd4f08589c0 20 remove_watcher() i=3 2024-09-12T17:26:24.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.312+0000 7fd4f08589c0 20 remove_watcher() i=4 2024-09-12T17:26:24.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.316+0000 7fd4f08589c0 20 remove_watcher() i=5 2024-09-12T17:26:24.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.320+0000 7fd4f08589c0 20 remove_watcher() i=6 2024-09-12T17:26:24.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.320+0000 7fd4f08589c0 20 remove_watcher() i=7 2024-09-12T17:26:24.349 DEBUG:teuthology.orchestra.run.smithi016:> radosgw-admin gc process --include-all 2024-09-12T17:26:24.430 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:24.430 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:24.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.480+0000 7f57ac92f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.480+0000 7f57ac92f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.480+0000 7f57ac92f9c0 20 realm 2024-09-12T17:26:24.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.480+0000 7f57ac92f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.480+0000 7f57ac92f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.480+0000 7f57ac92f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:24.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.480+0000 7f57ac92f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.480+0000 7f57ac92f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.480+0000 7f57ac92f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.484+0000 7f57ac92f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:24.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.484+0000 7f57ac92f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.484+0000 7f57ac92f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:24.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.484+0000 7f57ac92f9c0 20 searching for the correct realm 2024-09-12T17:26:24.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.488+0000 7f57aac36640 0 -- 172.21.15.16:0/1359801220 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f57a00c4c20 msgr2=0x7f57a00d1970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:24.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.704+0000 7f57a9c34640 0 -- 172.21.15.16:0/1359801220 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f57a4008040 msgr2=0x7f57a4024920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:24.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.920+0000 7f57ac92f9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:26:24.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.920+0000 7f57ac92f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:24.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.920+0000 7f57ac92f9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:26:24.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.920+0000 7f57ac92f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:24.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.920+0000 7f57ac92f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:24.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.920+0000 7f57ac92f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:24.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.920+0000 7f57ac92f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.924+0000 7f57ac92f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.924+0000 7f57ac92f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.924+0000 7f57ac92f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:24.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.924+0000 7f57ac92f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.924+0000 7f57ac92f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:24.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.924+0000 7f57ac92f9c0 20 zone default found 2024-09-12T17:26:24.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.924+0000 7f57ac92f9c0 4 Realm: () 2024-09-12T17:26:24.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.924+0000 7f57ac92f9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:26:24.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.924+0000 7f57ac92f9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:26:24.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.924+0000 7f57ac92f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:24.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.924+0000 7f57ac92f9c0 20 zonegroup default 2024-09-12T17:26:24.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.924+0000 7f57ac92f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.924+0000 7f57ac92f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.924+0000 7f57ac92f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.928+0000 7f57ac92f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.928+0000 7f57ac92f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:24.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.928+0000 7f57ac92f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:24.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.928+0000 7f57ac92f9c0 20 started sync module instance, tier type = 2024-09-12T17:26:24.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.928+0000 7f57ac92f9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:26:24.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.952+0000 7f57ac92f9c0 20 add_watcher() i=0 2024-09-12T17:26:24.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.952+0000 7f57ac92f9c0 20 add_watcher() i=1 2024-09-12T17:26:24.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.952+0000 7f57ac92f9c0 20 add_watcher() i=2 2024-09-12T17:26:24.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.952+0000 7f57ac92f9c0 20 add_watcher() i=3 2024-09-12T17:26:24.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.952+0000 7f57ac92f9c0 20 add_watcher() i=4 2024-09-12T17:26:24.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.952+0000 7f57ac92f9c0 20 add_watcher() i=5 2024-09-12T17:26:24.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.952+0000 7f57ac92f9c0 20 add_watcher() i=6 2024-09-12T17:26:24.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.952+0000 7f57ac92f9c0 20 add_watcher() i=7 2024-09-12T17:26:24.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.952+0000 7f57ac92f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:24.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.956+0000 7f56617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:24.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.956+0000 7f57ac92f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:24.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:24.956+0000 7f57ac92f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:25.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.052+0000 7f565bfff640 20 reqs_thread_entry: start 2024-09-12T17:26:25.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.052+0000 7f57ac92f9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:26:25.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.052+0000 7f57ac92f9c0 20 Filter name: none 2024-09-12T17:26:25.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.052+0000 7f5659ffb640 20 reqs_thread_entry: start 2024-09-12T17:26:25.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.052+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:26:25.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.056+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.056+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:25.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.060+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.060+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:26:25.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.064+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.064+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:25.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.064+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.068+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:26:25.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.068+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.072+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:25.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.072+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.072+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:26:25.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.076+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.076+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:25.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.076+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.080+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:26:25.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.088+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.088+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:25.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.092+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.092+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:26:25.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.096+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.096+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:25.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.096+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.100+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:26:25.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.104+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.104+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:25.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.108+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.108+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:26:25.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.112+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.112+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:25.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.112+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.116+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:26:25.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.120+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.120+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:25.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.120+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.124+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:26:25.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.128+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.128+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:25.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.128+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.132+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:26:25.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.136+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.136+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:25.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.140+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.140+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:26:25.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.144+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.148+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:25.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.148+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.148+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:26:25.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.152+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.156+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:25.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.156+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.156+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:26:25.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.160+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.164+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:25.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.164+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.168+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:26:25.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.172+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.172+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:25.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.172+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.176+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:26:25.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.180+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.184+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:25.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.184+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.184+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:26:25.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.188+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.192+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:25.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.192+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.196+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:26:25.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.200+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.200+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:25.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.204+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.208+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:26:25.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.212+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.212+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:25.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.212+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.216+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:26:25.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.220+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.224+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:25.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.224+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.224+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:26:25.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.228+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.232+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:25.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.232+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.236+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:26:25.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.240+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.240+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:25.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.240+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.244+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:26:25.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.248+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.248+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:25.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.248+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.252+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:26:25.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.256+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.260+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:25.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.260+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.264+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:26:25.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.268+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.268+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:25.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.268+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.272+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:26:25.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.276+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.276+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:25.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.279+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.279+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:26:25.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.283+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.287+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:25.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.287+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.291+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:26:25.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.295+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.295+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:25.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.295+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.299+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:26:25.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.303+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.307+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:25.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.307+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.307+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:26:25.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.311+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.315+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:25.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.315+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.319+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:26:25.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.323+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.323+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:25.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.323+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.327+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:26:25.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.331+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.335+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:25.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.335+0000 7f57ac92f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:25.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.339+0000 7f56617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:25.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.347+0000 7f57ac92f9c0 20 remove_watcher() i=0 2024-09-12T17:26:25.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.347+0000 7f57ac92f9c0 2 removed watcher, disabling cache 2024-09-12T17:26:25.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.347+0000 7f57ac92f9c0 20 remove_watcher() i=1 2024-09-12T17:26:25.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.351+0000 7f57ac92f9c0 20 remove_watcher() i=2 2024-09-12T17:26:25.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.351+0000 7f57ac92f9c0 20 remove_watcher() i=3 2024-09-12T17:26:25.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.355+0000 7f57ac92f9c0 20 remove_watcher() i=4 2024-09-12T17:26:25.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.355+0000 7f57ac92f9c0 20 remove_watcher() i=5 2024-09-12T17:26:25.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.359+0000 7f57ac92f9c0 20 remove_watcher() i=6 2024-09-12T17:26:25.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.359+0000 7f57ac92f9c0 20 remove_watcher() i=7 2024-09-12T17:26:25.384 DEBUG:teuthology.orchestra.run.smithi016:> radosgw-admin gc process --include-all 2024-09-12T17:26:25.458 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:25.458 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:25.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.503+0000 7fdef2a749c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:25.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.503+0000 7fdef2a749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:25.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.503+0000 7fdef2a749c0 20 realm 2024-09-12T17:26:25.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.503+0000 7fdef2a749c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:25.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.503+0000 7fdef2a749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:25.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.503+0000 7fdef2a749c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:25.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.503+0000 7fdef2a749c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:25.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.503+0000 7fdef2a749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:25.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.503+0000 7fdef2a749c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:25.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.507+0000 7fdef2a749c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:25.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.507+0000 7fdef2a749c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:25.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.507+0000 7fdef2a749c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:25.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.507+0000 7fdef2a749c0 20 searching for the correct realm 2024-09-12T17:26:25.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.511+0000 7fdef0d7b640 0 -- 172.21.15.16:0/597949353 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fded8067c20 msgr2=0x7fded80a2ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:26:25.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.727+0000 7fdeefd79640 0 -- 172.21.15.16:0/597949353 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fdee001e070 msgr2=0x7fdee0048940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:25.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.947+0000 7fdef2a749c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:26:25.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.947+0000 7fdef2a749c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:25.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.947+0000 7fdef2a749c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:26:25.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.947+0000 7fdef2a749c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:25.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.947+0000 7fdef2a749c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:25.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.947+0000 7fdef2a749c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:25.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.947+0000 7fdef2a749c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:25.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.947+0000 7fdef2a749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:25.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.947+0000 7fdef2a749c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:25.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.947+0000 7fdef2a749c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:25.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.947+0000 7fdef2a749c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:25.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.947+0000 7fdef2a749c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:25.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.947+0000 7fdef2a749c0 20 zone default found 2024-09-12T17:26:25.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.947+0000 7fdef2a749c0 4 Realm: () 2024-09-12T17:26:25.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.947+0000 7fdef2a749c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:26:25.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.947+0000 7fdef2a749c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:26:25.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.947+0000 7fdef2a749c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:25.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.947+0000 7fdef2a749c0 20 zonegroup default 2024-09-12T17:26:25.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.947+0000 7fdef2a749c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:25.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.947+0000 7fdef2a749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:25.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.947+0000 7fdef2a749c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:25.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.951+0000 7fdef2a749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:25.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.951+0000 7fdef2a749c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:25.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.951+0000 7fdef2a749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:25.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.951+0000 7fdef2a749c0 20 started sync module instance, tier type = 2024-09-12T17:26:25.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.951+0000 7fdef2a749c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:26:25.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.975+0000 7fdef2a749c0 20 add_watcher() i=0 2024-09-12T17:26:25.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.975+0000 7fdef2a749c0 20 add_watcher() i=1 2024-09-12T17:26:25.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.975+0000 7fdef2a749c0 20 add_watcher() i=2 2024-09-12T17:26:25.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.975+0000 7fdef2a749c0 20 add_watcher() i=3 2024-09-12T17:26:25.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.975+0000 7fdef2a749c0 20 add_watcher() i=4 2024-09-12T17:26:25.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.975+0000 7fdef2a749c0 20 add_watcher() i=5 2024-09-12T17:26:25.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.975+0000 7fdef2a749c0 20 add_watcher() i=6 2024-09-12T17:26:25.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.979+0000 7fdef2a749c0 20 add_watcher() i=7 2024-09-12T17:26:25.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.979+0000 7fdef2a749c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:25.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.983+0000 7fdda6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:25.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.983+0000 7fdef2a749c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:25.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:25.983+0000 7fdef2a749c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:26.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.079+0000 7fdda5fdb640 20 reqs_thread_entry: start 2024-09-12T17:26:26.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.079+0000 7fdef2a749c0 20 init_complete bucket index max shards: 1 2024-09-12T17:26:26.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.079+0000 7fdef2a749c0 20 Filter name: none 2024-09-12T17:26:26.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.079+0000 7fdd177fe640 20 reqs_thread_entry: start 2024-09-12T17:26:26.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.079+0000 7fdef2a749c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:26:26.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.083+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.083+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:26.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.087+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.087+0000 7fdef2a749c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:26:26.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.091+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.091+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:26.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.091+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.095+0000 7fdef2a749c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:26:26.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.099+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.099+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:26.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.099+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.103+0000 7fdef2a749c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:26:26.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.107+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.107+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:26.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.107+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.111+0000 7fdef2a749c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:26:26.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.115+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.115+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:26.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.115+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.119+0000 7fdef2a749c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:26:26.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.123+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.123+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:26.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.123+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.127+0000 7fdef2a749c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:26:26.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.131+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.135+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:26.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.135+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.139+0000 7fdef2a749c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:26:26.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.143+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.143+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:26.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.143+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.147+0000 7fdef2a749c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:26:26.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.151+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.151+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:26.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.151+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.155+0000 7fdef2a749c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:26:26.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.159+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.159+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:26.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.163+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.163+0000 7fdef2a749c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:26:26.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.167+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.171+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:26.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.171+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.171+0000 7fdef2a749c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:26:26.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.175+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.179+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:26.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.179+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.183+0000 7fdef2a749c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:26:26.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.187+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.187+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:26.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.187+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.191+0000 7fdef2a749c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:26:26.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.195+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.195+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:26.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.199+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.203+0000 7fdef2a749c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:26:26.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.203+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.207+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:26.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.207+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.211+0000 7fdef2a749c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:26:26.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.215+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.215+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:26.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.215+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.219+0000 7fdef2a749c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:26:26.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.223+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.223+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:26.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.223+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.227+0000 7fdef2a749c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:26:26.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.231+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.231+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:26.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.231+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.235+0000 7fdef2a749c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:26:26.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.239+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.243+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:26.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.243+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.247+0000 7fdef2a749c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:26:26.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.251+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.251+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:26.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.251+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.255+0000 7fdef2a749c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:26:26.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.259+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.259+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:26.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.263+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.263+0000 7fdef2a749c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:26:26.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.267+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.267+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:26.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.271+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.271+0000 7fdef2a749c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:26:26.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.275+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.279+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:26.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.279+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.283+0000 7fdef2a749c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:26:26.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.283+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.287+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:26.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.287+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.291+0000 7fdef2a749c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:26:26.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.295+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.295+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:26.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.299+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.299+0000 7fdef2a749c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:26:26.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.303+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.307+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:26.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.307+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.307+0000 7fdef2a749c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:26:26.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.311+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.315+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:26.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.315+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.319+0000 7fdef2a749c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:26:26.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.323+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.323+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:26.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.323+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.327+0000 7fdef2a749c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:26:26.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.331+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.331+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:26.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.331+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.335+0000 7fdef2a749c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:26:26.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.339+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.339+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:26.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.339+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.343+0000 7fdef2a749c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:26:26.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.347+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.347+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:26.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.347+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.351+0000 7fdef2a749c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:26:26.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.355+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.355+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:26.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.359+0000 7fdef2a749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.363+0000 7fdda6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:26.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.367+0000 7fdef2a749c0 20 remove_watcher() i=0 2024-09-12T17:26:26.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.367+0000 7fdef2a749c0 2 removed watcher, disabling cache 2024-09-12T17:26:26.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.371+0000 7fdef2a749c0 20 remove_watcher() i=1 2024-09-12T17:26:26.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.371+0000 7fdef2a749c0 20 remove_watcher() i=2 2024-09-12T17:26:26.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.375+0000 7fdef2a749c0 20 remove_watcher() i=3 2024-09-12T17:26:26.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.379+0000 7fdef2a749c0 20 remove_watcher() i=4 2024-09-12T17:26:26.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.379+0000 7fdef2a749c0 20 remove_watcher() i=5 2024-09-12T17:26:26.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.379+0000 7fdef2a749c0 20 remove_watcher() i=6 2024-09-12T17:26:26.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.383+0000 7fdef2a749c0 20 remove_watcher() i=7 2024-09-12T17:26:26.405 DEBUG:teuthology.orchestra.run.smithi016:> radosgw-admin gc process --include-all 2024-09-12T17:26:26.480 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:26.481 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:26.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.527+0000 7fd7a8dc19c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:26.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.527+0000 7fd7a8dc19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:26.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.527+0000 7fd7a8dc19c0 20 realm 2024-09-12T17:26:26.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.527+0000 7fd7a8dc19c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:26.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.527+0000 7fd7a8dc19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:26.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.527+0000 7fd7a8dc19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:26.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.527+0000 7fd7a8dc19c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:26.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.527+0000 7fd7a8dc19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:26.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.527+0000 7fd7a8dc19c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:26.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.531+0000 7fd7a8dc19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:26.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.531+0000 7fd7a8dc19c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:26.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.531+0000 7fd7a8dc19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:26.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.531+0000 7fd7a8dc19c0 20 searching for the correct realm 2024-09-12T17:26:26.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.535+0000 7fd7a70c8640 0 -- 172.21.15.16:0/2571995125 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fd79c0c1040 msgr2=0x7fd79c12fae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:26.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.543+0000 7fd7a60c6640 0 -- 172.21.15.16:0/2571995125 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fd7a0090310 msgr2=0x7fd7a0082910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:26:26.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.763+0000 7fd7a8dc19c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:26:26.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.763+0000 7fd7a8dc19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:26.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.763+0000 7fd7a8dc19c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:26:26.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.763+0000 7fd7a8dc19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:26.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.763+0000 7fd7a8dc19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:26.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.763+0000 7fd7a8dc19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:26.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.763+0000 7fd7a8dc19c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:26.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.763+0000 7fd7a8dc19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:26.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.763+0000 7fd7a8dc19c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:26.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.763+0000 7fd7a8dc19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:26.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.763+0000 7fd7a8dc19c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:26.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.763+0000 7fd7a8dc19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:26.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.763+0000 7fd7a8dc19c0 20 zone default found 2024-09-12T17:26:26.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.763+0000 7fd7a8dc19c0 4 Realm: () 2024-09-12T17:26:26.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.763+0000 7fd7a8dc19c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:26:26.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.763+0000 7fd7a8dc19c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:26:26.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.763+0000 7fd7a8dc19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:26.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.763+0000 7fd7a8dc19c0 20 zonegroup default 2024-09-12T17:26:26.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.763+0000 7fd7a8dc19c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:26.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.767+0000 7fd7a8dc19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:26.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.767+0000 7fd7a8dc19c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:26.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.767+0000 7fd7a8dc19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:26.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.767+0000 7fd7a8dc19c0 20 rados->read ofs=0 len=0 2024-09-12T17:26:26.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.767+0000 7fd7a8dc19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:26.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.767+0000 7fd7a8dc19c0 20 started sync module instance, tier type = 2024-09-12T17:26:26.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.767+0000 7fd7a8dc19c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:26:26.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.795+0000 7fd7a8dc19c0 20 add_watcher() i=0 2024-09-12T17:26:26.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.795+0000 7fd7a8dc19c0 20 add_watcher() i=1 2024-09-12T17:26:26.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.795+0000 7fd7a8dc19c0 20 add_watcher() i=2 2024-09-12T17:26:26.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.795+0000 7fd7a8dc19c0 20 add_watcher() i=3 2024-09-12T17:26:26.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.795+0000 7fd7a8dc19c0 20 add_watcher() i=4 2024-09-12T17:26:26.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.795+0000 7fd7a8dc19c0 20 add_watcher() i=5 2024-09-12T17:26:26.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.795+0000 7fd7a8dc19c0 20 add_watcher() i=6 2024-09-12T17:26:26.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.795+0000 7fd7a8dc19c0 20 add_watcher() i=7 2024-09-12T17:26:26.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.795+0000 7fd7a8dc19c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:26.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.799+0000 7fd65d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:26.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.799+0000 7fd7a8dc19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:26.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.799+0000 7fd7a8dc19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:26.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.899+0000 7fd5d7fff640 20 reqs_thread_entry: start 2024-09-12T17:26:26.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.899+0000 7fd7a8dc19c0 20 init_complete bucket index max shards: 1 2024-09-12T17:26:26.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.899+0000 7fd7a8dc19c0 20 Filter name: none 2024-09-12T17:26:26.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.899+0000 7fd5d5ffb640 20 reqs_thread_entry: start 2024-09-12T17:26:26.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.899+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:26:26.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.903+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.903+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:26.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.903+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.907+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:26:26.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.911+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.911+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:26.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.911+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.915+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:26:26.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.919+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.919+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:26.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.919+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.923+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:26:26.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.927+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.927+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:26.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.927+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.931+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:26:26.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.931+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.931+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:26.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.935+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.935+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:26:26.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.939+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.939+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:26.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.943+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.943+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:26:26.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.947+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.947+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:26.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.951+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.951+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:26:26.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.955+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.955+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:26.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.959+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.959+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:26:26.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.963+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.967+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:26.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.967+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.967+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:26:26.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.971+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.971+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:26.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.975+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.975+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:26:26.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.979+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.979+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:26.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.983+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.983+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:26:26.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.987+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.991+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:26.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.991+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:26.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.991+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:26:26.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.995+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:27.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.995+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:27.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.999+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:27.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:26.999+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:26:27.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.003+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:27.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.003+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:27.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.003+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:27.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.007+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:26:27.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.011+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:27.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.011+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:27.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.011+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:27.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.015+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:26:27.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.019+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:27.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.019+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:27.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.019+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:27.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.023+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:26:27.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.027+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:27.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.027+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:27.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.027+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:27.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.031+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:26:27.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.035+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:27.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.035+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:27.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.039+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:27.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.039+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:26:27.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.043+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:27.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.043+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:27.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.047+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:27.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.047+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:26:27.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.051+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:27.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.055+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:27.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.055+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:27.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.059+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:26:27.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.059+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:27.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.059+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:27.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.059+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:27.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.063+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:26:27.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.067+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:27.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.067+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:27.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.067+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:27.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.071+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:26:27.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.075+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:27.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.075+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:27.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.075+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:27.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.079+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:26:27.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.083+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:27.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.083+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:27.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.083+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:27.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.083+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:26:27.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.087+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:27.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.091+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:27.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.091+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:27.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.095+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:26:27.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.099+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:27.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.099+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:27.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.099+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:27.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.103+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:26:27.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.103+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:27.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.107+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:27.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.107+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:27.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.111+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:26:27.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.115+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:27.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.115+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:27.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.115+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:27.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.119+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:26:27.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.123+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:27.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.127+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:27.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.127+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:27.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.131+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:26:27.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.131+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:27.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.135+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:27.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.135+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:27.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.139+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:26:27.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.139+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:27.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.143+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:27.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.143+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:27.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.147+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:26:27.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.151+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:27.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.151+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:26:27.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.151+0000 7fd7a8dc19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:26:27.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.155+0000 7fd65d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:27.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.163+0000 7fd7a8dc19c0 20 remove_watcher() i=0 2024-09-12T17:26:27.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.163+0000 7fd7a8dc19c0 2 removed watcher, disabling cache 2024-09-12T17:26:27.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.167+0000 7fd7a8dc19c0 20 remove_watcher() i=1 2024-09-12T17:26:27.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.167+0000 7fd7a8dc19c0 20 remove_watcher() i=2 2024-09-12T17:26:27.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.171+0000 7fd7a8dc19c0 20 remove_watcher() i=3 2024-09-12T17:26:27.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.171+0000 7fd7a8dc19c0 20 remove_watcher() i=4 2024-09-12T17:26:27.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.175+0000 7fd7a8dc19c0 20 remove_watcher() i=5 2024-09-12T17:26:27.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.175+0000 7fd7a8dc19c0 20 remove_watcher() i=6 2024-09-12T17:26:27.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:26:27.179+0000 7fd7a8dc19c0 20 remove_watcher() i=7 2024-09-12T17:26:27.201 DEBUG:teuthology.orchestra.run.smithi016:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-09-12T17:26:27.904 INFO:teuthology.orchestra.run.smithi016.stdout:> Task :clean 2024-09-12T17:26:28.600 INFO:teuthology.orchestra.run.smithi016.stdout:> Task :compileJava 2024-09-12T17:26:28.601 INFO:teuthology.orchestra.run.smithi016.stdout:> Task :processResources 2024-09-12T17:26:28.601 INFO:teuthology.orchestra.run.smithi016.stdout:> Task :classes 2024-09-12T17:26:29.100 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:29.101 INFO:teuthology.orchestra.run.smithi016.stdout:> Task :compileTestJava 2024-09-12T17:26:29.101 INFO:teuthology.orchestra.run.smithi016.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T17:26:29.101 INFO:teuthology.orchestra.run.smithi016.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T17:26:29.102 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:29.102 INFO:teuthology.orchestra.run.smithi016.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T17:26:29.102 INFO:teuthology.orchestra.run.smithi016.stdout:> Task :testClasses 2024-09-12T17:26:31.101 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:31.101 INFO:teuthology.orchestra.run.smithi016.stdout:> Task :test 2024-09-12T17:26:31.101 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:31.101 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests STANDARD_OUT 2024-09-12T17:26:31.102 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12 17:26:30,442 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T17:26:31.102 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:31.103 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-09-12T17:26:31.103 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:31.103 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-09-12T17:26:31.103 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:31.103 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-09-12T17:26:31.201 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:31.201 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-09-12T17:26:31.401 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:31.401 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-09-12T17:26:31.501 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:31.501 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-09-12T17:26:31.700 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:31.701 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-09-12T17:26:32.501 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:32.501 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-09-12T17:26:32.701 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:32.701 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-09-12T17:26:32.801 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:32.801 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-09-12T17:26:33.001 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:33.001 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-09-12T17:26:33.201 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:33.201 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-09-12T17:26:33.401 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:33.401 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-09-12T17:26:33.501 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:33.501 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-09-12T17:26:33.601 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:33.601 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-09-12T17:26:33.601 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:33.601 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-09-12T17:26:33.801 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:33.801 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-09-12T17:26:34.101 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:34.101 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-09-12T17:26:34.301 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:34.301 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-09-12T17:26:34.401 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:34.401 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-09-12T17:26:34.601 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:34.601 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-09-12T17:26:34.701 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:34.701 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-09-12T17:26:34.901 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:34.901 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-09-12T17:26:35.001 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:35.001 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-09-12T17:26:35.201 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:35.201 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-09-12T17:26:35.301 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:35.301 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-09-12T17:26:35.501 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:35.501 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-09-12T17:26:35.601 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:35.601 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-09-12T17:26:35.801 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:35.801 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-09-12T17:26:35.901 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:35.901 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-09-12T17:26:36.101 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:36.101 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-09-12T17:26:36.301 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:36.301 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-09-12T17:26:36.501 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:36.501 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-09-12T17:26:37.001 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:37.001 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-09-12T17:26:37.401 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:37.401 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-09-12T17:26:42.901 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:42.901 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-09-12T17:26:43.301 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:43.301 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-09-12T17:26:43.301 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:43.301 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-09-12T17:26:43.500 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:43.501 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-09-12T17:26:43.600 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:43.601 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-09-12T17:26:44.001 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:44.001 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-09-12T17:26:44.401 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:44.401 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-09-12T17:26:44.701 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:44.701 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-09-12T17:26:44.701 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:44.701 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-09-12T17:26:44.801 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:44.801 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-09-12T17:26:45.801 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:45.801 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-09-12T17:26:46.001 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:46.001 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T17:26:46.701 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:46.701 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T17:26:47.001 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:47.001 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-09-12T17:26:47.801 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:47.801 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-09-12T17:26:48.001 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:48.001 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-09-12T17:26:51.901 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:51.901 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-09-12T17:26:52.101 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:52.101 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-09-12T17:26:53.601 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:53.601 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-09-12T17:26:53.801 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:53.801 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-09-12T17:26:54.601 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:54.601 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-09-12T17:26:54.801 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:54.801 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-09-12T17:26:55.400 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:55.401 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-09-12T17:26:55.700 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:55.700 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-09-12T17:26:55.800 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:55.800 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-09-12T17:26:55.900 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:55.901 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-09-12T17:26:55.901 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:55.901 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-09-12T17:26:56.100 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:56.101 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-09-12T17:26:56.201 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:56.201 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-09-12T17:26:56.400 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:56.401 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-09-12T17:26:56.501 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:56.501 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-09-12T17:26:56.700 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:56.701 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-09-12T17:26:56.800 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:56.801 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-09-12T17:26:57.000 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:57.001 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-09-12T17:26:57.100 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:57.101 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-09-12T17:26:57.300 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:57.301 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-09-12T17:26:57.401 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:57.401 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-09-12T17:26:57.601 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:57.601 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-09-12T17:26:57.700 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:57.701 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-09-12T17:26:58.000 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:58.001 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-09-12T17:26:58.100 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:58.101 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-09-12T17:26:58.401 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:58.401 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-09-12T17:26:58.500 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:58.501 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-09-12T17:26:58.801 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:58.801 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-09-12T17:26:59.002 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:59.002 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-09-12T17:26:59.201 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:59.201 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-09-12T17:26:59.401 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:59.401 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-09-12T17:26:59.600 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:59.600 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-09-12T17:26:59.800 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:26:59.801 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-09-12T17:27:00.100 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:00.101 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-09-12T17:27:00.200 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:00.201 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-09-12T17:27:00.500 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:00.501 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-09-12T17:27:00.600 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:00.601 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-09-12T17:27:00.901 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:00.901 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-09-12T17:27:01.000 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:01.001 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-09-12T17:27:01.301 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:01.301 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-09-12T17:27:01.400 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:01.401 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-09-12T17:27:01.701 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:01.701 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-09-12T17:27:01.801 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:01.801 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-09-12T17:27:02.101 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:02.101 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-09-12T17:27:02.200 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:02.201 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-09-12T17:27:02.501 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:02.501 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-09-12T17:27:02.601 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:02.601 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-09-12T17:27:02.800 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:02.801 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-09-12T17:27:03.000 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:03.001 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-09-12T17:27:03.301 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:03.301 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-09-12T17:27:03.401 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:03.401 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-09-12T17:27:03.701 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:03.701 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-09-12T17:27:03.801 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:03.801 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-09-12T17:27:04.102 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:04.102 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-09-12T17:27:04.200 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:04.201 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-09-12T17:27:04.500 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:04.501 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-09-12T17:27:04.600 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:04.601 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-09-12T17:27:04.900 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:04.901 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-09-12T17:27:05.001 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:05.001 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-09-12T17:27:05.200 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:05.201 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-09-12T17:27:05.401 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:05.401 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-09-12T17:27:05.600 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:05.601 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-09-12T17:27:05.700 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:05.701 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-09-12T17:27:06.000 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:06.001 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-09-12T17:27:06.100 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:06.101 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-09-12T17:27:06.401 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:06.401 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-09-12T17:27:06.401 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:06.401 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-09-12T17:27:06.701 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:06.701 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-09-12T17:27:06.701 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:06.701 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-09-12T17:27:07.001 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:07.001 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-09-12T17:27:07.001 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:07.001 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-09-12T17:27:07.200 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:07.201 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-09-12T17:27:07.301 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:07.301 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-09-12T17:27:07.501 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:07.501 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-09-12T17:27:07.700 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:07.701 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-09-12T17:27:07.900 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:07.901 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-09-12T17:27:08.000 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:08.001 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-09-12T17:27:08.100 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:08.101 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-09-12T17:27:08.101 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:08.101 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-09-12T17:27:08.400 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:08.401 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-09-12T17:27:08.501 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:08.501 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-09-12T17:27:08.700 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:08.701 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-09-12T17:27:08.800 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:08.801 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-09-12T17:27:09.000 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:09.001 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-09-12T17:27:09.100 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:09.101 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-09-12T17:27:09.300 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:09.301 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-09-12T17:27:09.701 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:09.701 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-09-12T17:27:10.001 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:10.001 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-09-12T17:27:10.400 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:10.401 INFO:teuthology.orchestra.run.smithi016.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-09-12T17:27:10.700 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:10.701 INFO:teuthology.orchestra.run.smithi016.stdout:---------------------------------------------------------------------- 2024-09-12T17:27:10.701 INFO:teuthology.orchestra.run.smithi016.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-09-12T17:27:10.701 INFO:teuthology.orchestra.run.smithi016.stdout:---------------------------------------------------------------------- 2024-09-12T17:27:10.801 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:10.801 INFO:teuthology.orchestra.run.smithi016.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T17:27:10.802 INFO:teuthology.orchestra.run.smithi016.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T17:27:10.802 INFO:teuthology.orchestra.run.smithi016.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T17:27:10.802 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:10.802 INFO:teuthology.orchestra.run.smithi016.stdout:BUILD SUCCESSFUL in 43s 2024-09-12T17:27:10.802 INFO:teuthology.orchestra.run.smithi016.stdout:5 actionable tasks: 5 executed 2024-09-12T17:27:10.880 DEBUG:teuthology.orchestra.run.smithi016:> radosgw-admin gc process --include-all 2024-09-12T17:27:10.913 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:10.913 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:10.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:10.959+0000 7fd39a14b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:10.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:10.959+0000 7fd39a14b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:10.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:10.959+0000 7fd39a14b9c0 20 realm 2024-09-12T17:27:10.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:10.959+0000 7fd39a14b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:10.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:10.959+0000 7fd39a14b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:10.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:10.959+0000 7fd39a14b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:10.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:10.959+0000 7fd39a14b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:10.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:10.959+0000 7fd39a14b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:10.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:10.959+0000 7fd39a14b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:10.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:10.963+0000 7fd39a14b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:10.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:10.963+0000 7fd39a14b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:10.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:10.963+0000 7fd39a14b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:10.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:10.963+0000 7fd39a14b9c0 20 searching for the correct realm 2024-09-12T17:27:10.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:10.967+0000 7fd398452640 0 -- 172.21.15.16:0/2754063343 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fd38012d2c0 msgr2=0x7fd3800fc990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:11.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.183+0000 7fd397450640 0 -- 172.21.15.16:0/2754063343 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fd390008050 msgr2=0x7fd390062050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:11.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.403+0000 7fd39a14b9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:27:11.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.403+0000 7fd39a14b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:11.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.403+0000 7fd39a14b9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:27:11.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.403+0000 7fd39a14b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:11.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.403+0000 7fd39a14b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:11.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.403+0000 7fd39a14b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:11.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.403+0000 7fd39a14b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:11.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.403+0000 7fd39a14b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:11.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.403+0000 7fd39a14b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:11.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.403+0000 7fd39a14b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:11.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.403+0000 7fd39a14b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:11.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.403+0000 7fd39a14b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:11.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.403+0000 7fd39a14b9c0 20 zone default found 2024-09-12T17:27:11.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.403+0000 7fd39a14b9c0 4 Realm: () 2024-09-12T17:27:11.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.403+0000 7fd39a14b9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:27:11.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.403+0000 7fd39a14b9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:27:11.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.403+0000 7fd39a14b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:11.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.403+0000 7fd39a14b9c0 20 zonegroup default 2024-09-12T17:27:11.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.403+0000 7fd39a14b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:11.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.403+0000 7fd39a14b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:11.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.403+0000 7fd39a14b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:11.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.407+0000 7fd39a14b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:11.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.407+0000 7fd39a14b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:11.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.407+0000 7fd39a14b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:11.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.407+0000 7fd39a14b9c0 20 started sync module instance, tier type = 2024-09-12T17:27:11.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.407+0000 7fd39a14b9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:27:11.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.431+0000 7fd39a14b9c0 20 add_watcher() i=0 2024-09-12T17:27:11.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.431+0000 7fd39a14b9c0 20 add_watcher() i=1 2024-09-12T17:27:11.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.431+0000 7fd39a14b9c0 20 add_watcher() i=2 2024-09-12T17:27:11.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.431+0000 7fd39a14b9c0 20 add_watcher() i=3 2024-09-12T17:27:11.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.431+0000 7fd39a14b9c0 20 add_watcher() i=4 2024-09-12T17:27:11.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.431+0000 7fd39a14b9c0 20 add_watcher() i=5 2024-09-12T17:27:11.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.431+0000 7fd39a14b9c0 20 add_watcher() i=6 2024-09-12T17:27:11.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.435+0000 7fd39a14b9c0 20 add_watcher() i=7 2024-09-12T17:27:11.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.435+0000 7fd39a14b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:11.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.439+0000 7fd24e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:11.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.439+0000 7fd39a14b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:11.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.439+0000 7fd39a14b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:11.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.547+0000 7fd24d7e2640 20 reqs_thread_entry: start 2024-09-12T17:27:11.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.547+0000 7fd39a14b9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:27:11.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.547+0000 7fd39a14b9c0 20 Filter name: none 2024-09-12T17:27:11.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.547+0000 7fd2467fc640 20 reqs_thread_entry: start 2024-09-12T17:27:11.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.547+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:27:11.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.551+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:11.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.555+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:11.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.555+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T17:27:11.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.555+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10505070103196050841', time=2024-09-12T19:26:50.177229+0000, chain.objs.size()=9 2024-09-12T17:27:11.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.555+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__multipart_key1.2~S4UGVh3gFRknlDUBDDvpTM6YFWjHbrx.1 2024-09-12T17:27:11.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.555+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__shadow_key1.2~S4UGVh3gFRknlDUBDDvpTM6YFWjHbrx.1_1 2024-09-12T17:27:11.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.555+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__multipart_key1.2~S4UGVh3gFRknlDUBDDvpTM6YFWjHbrx.2 2024-09-12T17:27:11.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.555+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__shadow_key1.2~S4UGVh3gFRknlDUBDDvpTM6YFWjHbrx.2_1 2024-09-12T17:27:11.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.555+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__multipart_key1.2~S4UGVh3gFRknlDUBDDvpTM6YFWjHbrx.3 2024-09-12T17:27:11.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.555+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__shadow_key1.2~S4UGVh3gFRknlDUBDDvpTM6YFWjHbrx.3_1 2024-09-12T17:27:11.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.555+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__multipart_key1.2~S4UGVh3gFRknlDUBDDvpTM6YFWjHbrx.4 2024-09-12T17:27:11.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.555+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__shadow_key1.2~S4UGVh3gFRknlDUBDDvpTM6YFWjHbrx.4_1 2024-09-12T17:27:11.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.555+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__multipart_key1.2~S4UGVh3gFRknlDUBDDvpTM6YFWjHbrx.5 2024-09-12T17:27:11.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.555+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16739744127655713463', time=2024-09-12T19:27:00.700108+0000, chain.objs.size()=1 2024-09-12T17:27:11.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.555+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.119__shadow_.c-BTvBmEBQlx-Rz9GgEJ6VC3fmR1JEw_0 2024-09-12T17:27:11.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.555+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7248079187642397372', time=2024-09-12T19:27:01.879426+0000, chain.objs.size()=1 2024-09-12T17:27:11.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.555+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.122__shadow_.CcGYPjgTg92sCT0MAQ7uqbrKs1np-K0_0 2024-09-12T17:27:11.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.555+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6264885659986958475', time=2024-09-12T19:27:04.267141+0000, chain.objs.size()=1 2024-09-12T17:27:11.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.555+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.128__shadow_.mx3ubG5rhmZsBZ-otbKt3iESJOmWbBO_0 2024-09-12T17:27:11.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.563+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3069843455927244785', time=2024-09-12T19:27:05.786123+0000, chain.objs.size()=1 2024-09-12T17:27:11.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.563+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.132__shadow_.mH9rUlH193yKdTKXjg0CD47Vb4lPIhh_0 2024-09-12T17:27:11.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.567+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:27:11.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.571+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:27:11.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.571+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:11.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.575+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:11.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.575+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:27:11.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.575+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1930772418166020924', time=2024-09-12T19:26:59.035285+0000, chain.objs.size()=1 2024-09-12T17:27:11.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.575+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.115__shadow_.B1HWtC4VTvPU7HAV_hb9-1DUthaWKGL_0 2024-09-12T17:27:11.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.575+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8878778945111831548', time=2024-09-12T19:26:59.832644+0000, chain.objs.size()=1 2024-09-12T17:27:11.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.575+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.117__shadow_.xqMz3SVJ12Axjszlhm8OvV5cOrvlkS3_0 2024-09-12T17:27:11.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.575+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:27:11.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.579+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:27:11.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.583+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:11.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.583+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:11.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.587+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T17:27:11.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.587+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13204344044199077989', time=2024-09-12T19:26:39.600884+0000, chain.objs.size()=9 2024-09-12T17:27:11.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.587+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__multipart_key1.2~_rqslO2--SIuCfWcMNTh0D35w4J_d0R.1 2024-09-12T17:27:11.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.587+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__shadow_key1.2~_rqslO2--SIuCfWcMNTh0D35w4J_d0R.1_1 2024-09-12T17:27:11.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.587+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__multipart_key1.2~_rqslO2--SIuCfWcMNTh0D35w4J_d0R.2 2024-09-12T17:27:11.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.587+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__shadow_key1.2~_rqslO2--SIuCfWcMNTh0D35w4J_d0R.2_1 2024-09-12T17:27:11.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.587+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__multipart_key1.2~_rqslO2--SIuCfWcMNTh0D35w4J_d0R.3 2024-09-12T17:27:11.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.587+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__shadow_key1.2~_rqslO2--SIuCfWcMNTh0D35w4J_d0R.3_1 2024-09-12T17:27:11.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.587+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__multipart_key1.2~_rqslO2--SIuCfWcMNTh0D35w4J_d0R.4 2024-09-12T17:27:11.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.587+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__shadow_key1.2~_rqslO2--SIuCfWcMNTh0D35w4J_d0R.4_1 2024-09-12T17:27:11.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.587+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__multipart_key1.2~_rqslO2--SIuCfWcMNTh0D35w4J_d0R.5 2024-09-12T17:27:11.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.587+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11556825758970869419', time=2024-09-12T19:26:46.789667+0000, chain.objs.size()=1 2024-09-12T17:27:11.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.587+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.100__shadow_.nKMrrAYoJkm2RR-vaw3LfZZuk06kVDQ_0 2024-09-12T17:27:11.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.587+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16177006020018145810', time=2024-09-12T19:27:00.655930+0000, chain.objs.size()=1 2024-09-12T17:27:11.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.587+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.119__shadow_.mkh8_K-hPZCr8SwX7LvJEMisySQpJRz_0 2024-09-12T17:27:11.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.587+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15639382754084888551', time=2024-09-12T19:27:01.864498+0000, chain.objs.size()=1 2024-09-12T17:27:11.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.587+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.122__shadow_.wbVw7p9w9xfu__v-bNCaQI11ILcuwLK_0 2024-09-12T17:27:11.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.591+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4349032131481379109', time=2024-09-12T19:27:03.050657+0000, chain.objs.size()=1 2024-09-12T17:27:11.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.591+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.125__shadow_.XksY8l397eGC3oDY0ioJCxPuSf8RnAC_0 2024-09-12T17:27:11.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.591+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18284046909625040919', time=2024-09-12T19:27:06.190013+0000, chain.objs.size()=1 2024-09-12T17:27:11.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.591+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.133__shadow_.PGAgW9kVG-L10a_tMEB2aBCvumQkxgy_0 2024-09-12T17:27:11.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.591+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11307023103151459405', time=2024-09-12T19:27:08.516499+0000, chain.objs.size()=1 2024-09-12T17:27:11.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.591+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.140__shadow_.P9vRT1-WPDLHQ2VT8A5MgPsw5uj0wOc_0 2024-09-12T17:27:11.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.595+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:27:11.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.599+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:27:11.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.603+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:11.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.603+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:11.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.603+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T17:27:11.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.603+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.89940432852809218', time=2024-09-12T19:26:55.931331+0000, chain.objs.size()=1 2024-09-12T17:27:11.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.603+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.106__shadow_.bQtvyMfiQrFAH1C02Fj6SRN3OQrK0OH_0 2024-09-12T17:27:11.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.603+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16148859304961564743', time=2024-09-12T19:26:57.806320+0000, chain.objs.size()=1 2024-09-12T17:27:11.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.603+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.112__shadow_.itADSh-EPhLl8ce2uxvlra9O1tjnrf8_0 2024-09-12T17:27:11.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.603+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7083560962500860215', time=2024-09-12T19:26:59.464029+0000, chain.objs.size()=1 2024-09-12T17:27:11.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.603+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.116__shadow_.FF1WPfXGsePztBHatW-EM80SaKOm-nj_0 2024-09-12T17:27:11.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.603+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7956487694929527366', time=2024-09-12T19:27:01.892401+0000, chain.objs.size()=1 2024-09-12T17:27:11.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.603+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.122__shadow_.KEumsBLrARn-lAQXOBWZp_U0ipC7qW1_0 2024-09-12T17:27:11.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.603+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7176649066225333160', time=2024-09-12T19:27:04.678493+0000, chain.objs.size()=1 2024-09-12T17:27:11.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.603+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.129__shadow_.4Dk_h-9kGUDILTlMQC18d4akqIbprLC_0 2024-09-12T17:27:11.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.607+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:27:11.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.611+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:27:11.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.615+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:11.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.615+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:11.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.615+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T17:27:11.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.615+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12622785212525235574', time=2024-09-12T19:26:34.721777+0000, chain.objs.size()=1 2024-09-12T17:27:11.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.615+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.85__shadow_.1U1B8g2V3Bk2BywSwY6aZyDyh9EJAQ__0 2024-09-12T17:27:11.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.615+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8756432245086166844', time=2024-09-12T19:26:57.821271+0000, chain.objs.size()=1 2024-09-12T17:27:11.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.615+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.112__shadow_.i7SOXjyJ_MoxHz7rjTHwI7mJrABeUES_0 2024-09-12T17:27:11.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.615+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5817633712134953037', time=2024-09-12T19:26:58.224796+0000, chain.objs.size()=1 2024-09-12T17:27:11.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.615+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.113__shadow_.Fpht3SALMPKfSHELb5tKkDR8dsFqX3b_0 2024-09-12T17:27:11.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.615+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2407812845171043571', time=2024-09-12T19:27:00.673196+0000, chain.objs.size()=1 2024-09-12T17:27:11.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.615+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.119__shadow_.NIwcg5XDFA3sjLhkjl89eJVtskAu6Df_0 2024-09-12T17:27:11.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.615+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15105099641636431474', time=2024-09-12T19:27:03.454913+0000, chain.objs.size()=1 2024-09-12T17:27:11.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.615+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.126__shadow_.8vykTOU-1LZJ7f2DXYPjoW8tluUMdI1_0 2024-09-12T17:27:11.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.615+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1796141122188251502', time=2024-09-12T19:27:05.032443+0000, chain.objs.size()=1 2024-09-12T17:27:11.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.615+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.130__shadow_.UT4_Ls6Ah2yvLPXiEiWOyIGIHck1O-U_0 2024-09-12T17:27:11.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.619+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:27:11.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.623+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:27:11.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.627+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:11.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.627+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:11.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.627+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T17:27:11.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.627+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9260892861974464805', time=2024-09-12T19:26:42.773308+0000, chain.objs.size()=7 2024-09-12T17:27:11.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.627+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__multipart_key1.2~MF4nD8cVJXV1bkjTf5dSIu89aHLFyfo.1 2024-09-12T17:27:11.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.627+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__shadow_key1.2~MF4nD8cVJXV1bkjTf5dSIu89aHLFyfo.1_1 2024-09-12T17:27:11.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.627+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__shadow_key1.2~MF4nD8cVJXV1bkjTf5dSIu89aHLFyfo.1_2 2024-09-12T17:27:11.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.627+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__multipart_key1.2~MF4nD8cVJXV1bkjTf5dSIu89aHLFyfo.2 2024-09-12T17:27:11.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.627+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__shadow_key1.2~MF4nD8cVJXV1bkjTf5dSIu89aHLFyfo.2_1 2024-09-12T17:27:11.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.627+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__shadow_key1.2~MF4nD8cVJXV1bkjTf5dSIu89aHLFyfo.2_2 2024-09-12T17:27:11.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.627+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__multipart_key1.2~MF4nD8cVJXV1bkjTf5dSIu89aHLFyfo.3 2024-09-12T17:27:11.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.627+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16918998363466615152', time=2024-09-12T19:26:51.915663+0000, chain.objs.size()=7 2024-09-12T17:27:11.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.627+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__multipart_key1.2~w4gNf30LMHLhigMWgTPsQ7xjKcfwdQS.1 2024-09-12T17:27:11.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.627+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__shadow_key1.2~w4gNf30LMHLhigMWgTPsQ7xjKcfwdQS.1_1 2024-09-12T17:27:11.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.627+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__shadow_key1.2~w4gNf30LMHLhigMWgTPsQ7xjKcfwdQS.1_2 2024-09-12T17:27:11.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.627+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__multipart_key1.2~w4gNf30LMHLhigMWgTPsQ7xjKcfwdQS.2 2024-09-12T17:27:11.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.627+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__shadow_key1.2~w4gNf30LMHLhigMWgTPsQ7xjKcfwdQS.2_1 2024-09-12T17:27:11.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.631+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__shadow_key1.2~w4gNf30LMHLhigMWgTPsQ7xjKcfwdQS.2_2 2024-09-12T17:27:11.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.631+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__multipart_key1.2~w4gNf30LMHLhigMWgTPsQ7xjKcfwdQS.3 2024-09-12T17:27:11.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.631+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16167677157789717038', time=2024-09-12T19:26:58.608645+0000, chain.objs.size()=1 2024-09-12T17:27:11.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.631+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.114__shadow_.Tm3zJXht4F3K6Z6xecy6s0DqQYT2AvY_0 2024-09-12T17:27:11.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.631+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9551369550041260929', time=2024-09-12T19:27:04.668120+0000, chain.objs.size()=1 2024-09-12T17:27:11.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.631+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.129__shadow_.se4za6bFRmCoHkTmCG-Ovus9lW2Ppc-_0 2024-09-12T17:27:11.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.635+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:27:11.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.643+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:27:11.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.643+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:11.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.643+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:11.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.643+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T17:27:11.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.643+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~r40vyd4GRw4uOcuNwBwL7wPo7ZF7EAt', time=2024-09-12T19:26:47.864602+0000, chain.objs.size()=9 2024-09-12T17:27:11.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.643+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.101__multipart_key1.2~r40vyd4GRw4uOcuNwBwL7wPo7ZF7EAt.7 2024-09-12T17:27:11.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.643+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.101__shadow_key1.2~r40vyd4GRw4uOcuNwBwL7wPo7ZF7EAt.7_1 2024-09-12T17:27:11.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.643+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.101__multipart_key1.2~r40vyd4GRw4uOcuNwBwL7wPo7ZF7EAt.8 2024-09-12T17:27:11.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.643+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.101__shadow_key1.2~r40vyd4GRw4uOcuNwBwL7wPo7ZF7EAt.8_1 2024-09-12T17:27:11.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.643+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.101__multipart_key1.2~r40vyd4GRw4uOcuNwBwL7wPo7ZF7EAt.9 2024-09-12T17:27:11.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.643+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.101__shadow_key1.2~r40vyd4GRw4uOcuNwBwL7wPo7ZF7EAt.9_1 2024-09-12T17:27:11.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.643+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.101__multipart_key1.2~r40vyd4GRw4uOcuNwBwL7wPo7ZF7EAt.10 2024-09-12T17:27:11.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.643+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.101__shadow_key1.2~r40vyd4GRw4uOcuNwBwL7wPo7ZF7EAt.10_1 2024-09-12T17:27:11.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.643+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.101__multipart_key1.2~r40vyd4GRw4uOcuNwBwL7wPo7ZF7EAt.11 2024-09-12T17:27:11.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.643+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8346408153899365918', time=2024-09-12T19:26:59.007583+0000, chain.objs.size()=1 2024-09-12T17:27:11.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.643+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.115__shadow_.RZsZlec9zyQprlHmlrEWExeS0l4rEo6_0 2024-09-12T17:27:11.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.643+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9707383894580926953', time=2024-09-12T19:26:59.021593+0000, chain.objs.size()=1 2024-09-12T17:27:11.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.643+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.115__shadow_.bIw3txXK1VETWx5cpp3Jun38iroc5gE_0 2024-09-12T17:27:11.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.643+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4242056395731551512', time=2024-09-12T19:26:59.424523+0000, chain.objs.size()=1 2024-09-12T17:27:11.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.643+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.116__shadow_.VUB4wjPkcI2OPngdgmiAOI3rLs0Mbbd_0 2024-09-12T17:27:11.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.647+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13656856444736074757', time=2024-09-12T19:27:02.632222+0000, chain.objs.size()=1 2024-09-12T17:27:11.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.647+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.124__shadow_.HNKPBb_J1VC7aSSZTVXvBfFgPZZmfvW_0 2024-09-12T17:27:11.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.647+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15236350439038390203', time=2024-09-12T19:27:05.046743+0000, chain.objs.size()=1 2024-09-12T17:27:11.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.647+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.130__shadow_.WdRuJs7qCnpURF2jA8AV9jhVqmgQyS6_0 2024-09-12T17:27:11.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.651+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:27:11.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.655+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:27:11.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.659+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:11.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.659+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:11.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.663+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:27:11.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.663+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12990013704226986370', time=2024-09-12T19:26:37.071335+0000, chain.objs.size()=9 2024-09-12T17:27:11.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.663+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.91__multipart_key1.2~2Af7tMPIbzkypK315yGzinwR728dfJq.1 2024-09-12T17:27:11.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.663+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.91__shadow_key1.2~2Af7tMPIbzkypK315yGzinwR728dfJq.1_1 2024-09-12T17:27:11.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.663+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.91__multipart_key1.2~2Af7tMPIbzkypK315yGzinwR728dfJq.2 2024-09-12T17:27:11.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.663+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.91__shadow_key1.2~2Af7tMPIbzkypK315yGzinwR728dfJq.2_1 2024-09-12T17:27:11.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.663+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.91__multipart_key1.2~2Af7tMPIbzkypK315yGzinwR728dfJq.3 2024-09-12T17:27:11.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.663+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.91__shadow_key1.2~2Af7tMPIbzkypK315yGzinwR728dfJq.3_1 2024-09-12T17:27:11.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.663+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.91__multipart_key1.2~2Af7tMPIbzkypK315yGzinwR728dfJq.4 2024-09-12T17:27:11.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.663+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.91__shadow_key1.2~2Af7tMPIbzkypK315yGzinwR728dfJq.4_1 2024-09-12T17:27:11.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.663+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.91__multipart_key1.2~2Af7tMPIbzkypK315yGzinwR728dfJq.5 2024-09-12T17:27:11.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.663+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5395899176422210985', time=2024-09-12T19:26:40.516012+0000, chain.objs.size()=9 2024-09-12T17:27:11.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.663+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__multipart_key1.2~Qj_jptPlHoGB6FLKOFFYZshuG66rX0-.1 2024-09-12T17:27:11.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.663+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__shadow_key1.2~Qj_jptPlHoGB6FLKOFFYZshuG66rX0-.1_1 2024-09-12T17:27:11.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.663+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__multipart_key1.2~Qj_jptPlHoGB6FLKOFFYZshuG66rX0-.2 2024-09-12T17:27:11.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.663+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__shadow_key1.2~Qj_jptPlHoGB6FLKOFFYZshuG66rX0-.2_1 2024-09-12T17:27:11.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.667+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__multipart_key1.2~Qj_jptPlHoGB6FLKOFFYZshuG66rX0-.3 2024-09-12T17:27:11.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.667+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__shadow_key1.2~Qj_jptPlHoGB6FLKOFFYZshuG66rX0-.3_1 2024-09-12T17:27:11.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.667+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__multipart_key1.2~Qj_jptPlHoGB6FLKOFFYZshuG66rX0-.4 2024-09-12T17:27:11.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.667+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__shadow_key1.2~Qj_jptPlHoGB6FLKOFFYZshuG66rX0-.4_1 2024-09-12T17:27:11.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.667+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__multipart_key1.2~Qj_jptPlHoGB6FLKOFFYZshuG66rX0-.5 2024-09-12T17:27:11.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.667+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2154701967051085838', time=2024-09-12T19:27:05.800169+0000, chain.objs.size()=1 2024-09-12T17:27:11.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.667+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.132__shadow_.vSUWQSapYD2yhIJPyfcMKNLGO4wvmth_0 2024-09-12T17:27:11.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.675+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:27:11.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.679+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:27:11.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.679+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:11.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.683+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:11.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.683+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:27:11.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.683+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3643729178287028606', time=2024-09-12T19:26:57.795068+0000, chain.objs.size()=1 2024-09-12T17:27:11.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.683+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.112__shadow_.0SuM9_Fu41ccR8wfBJSsnef4KXW1hHq_0 2024-09-12T17:27:11.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.683+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13141839392082832864', time=2024-09-12T19:27:02.281793+0000, chain.objs.size()=1 2024-09-12T17:27:11.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.683+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.123__shadow_.VWslg6f8SgFLXnzB-ttli3E-FxOKByB_0 2024-09-12T17:27:11.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.683+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15013930563644381048', time=2024-09-12T19:27:02.658529+0000, chain.objs.size()=1 2024-09-12T17:27:11.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.683+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.124__shadow_.Nc4sog1BBjRFDgVE0dltEvihKFI2mxB_0 2024-09-12T17:27:11.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.687+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:27:11.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.691+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:27:11.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.691+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:11.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.695+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:11.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.695+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:27:11.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.695+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.396828360184948309', time=2024-09-12T19:27:04.652873+0000, chain.objs.size()=1 2024-09-12T17:27:11.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.695+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.129__shadow_.besslqX13fBAJhC3IX3KYitihregzTR_0 2024-09-12T17:27:11.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.695+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:27:11.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.703+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:27:11.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.703+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:11.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.703+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:11.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.703+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T17:27:11.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.703+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17894016666137027295', time=2024-09-12T19:27:01.477745+0000, chain.objs.size()=1 2024-09-12T17:27:11.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.703+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.121__shadow_.dyUIgguA-HC6sOtr6PZ-MepO3HobQJZ_0 2024-09-12T17:27:11.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.703+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10835800091663949062', time=2024-09-12T19:27:04.241254+0000, chain.objs.size()=1 2024-09-12T17:27:11.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.703+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.128__shadow_.ySrAJZi4yd9hD0FihqZ-PsQ06vhhNhK_0 2024-09-12T17:27:11.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.703+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17413284273532992194', time=2024-09-12T19:27:05.060585+0000, chain.objs.size()=1 2024-09-12T17:27:11.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.703+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.130__shadow_.7Nc7Ps3N46HXGSabbI0vHvP-F-YqJ3Y_0 2024-09-12T17:27:11.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.703+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17566453839254904229', time=2024-09-12T19:27:06.163662+0000, chain.objs.size()=1 2024-09-12T17:27:11.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.703+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.133__shadow_.ok02tvpJm0zXRap2c6bY6G3srhgOCDW_0 2024-09-12T17:27:11.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.707+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:27:11.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.711+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:27:11.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.715+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:11.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.715+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:11.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.715+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T17:27:11.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.715+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13300716002536458462', time=2024-09-12T19:26:33.252817+0000, chain.objs.size()=1 2024-09-12T17:27:11.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.715+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.81__shadow_.yer9xCd0ZC48UM4oBiw4V-nxGurn2xx_0 2024-09-12T17:27:11.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.715+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5429767543508570115', time=2024-09-12T19:26:44.470234+0000, chain.objs.size()=9 2024-09-12T17:27:11.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.715+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.98__multipart_key1.2~RqPsObZfaTODOMDJsJzKJOsCJIJMRO7.1 2024-09-12T17:27:11.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.715+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.98__shadow_key1.2~RqPsObZfaTODOMDJsJzKJOsCJIJMRO7.1_1 2024-09-12T17:27:11.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.715+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.98__multipart_key1.2~RqPsObZfaTODOMDJsJzKJOsCJIJMRO7.2 2024-09-12T17:27:11.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.715+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.98__shadow_key1.2~RqPsObZfaTODOMDJsJzKJOsCJIJMRO7.2_1 2024-09-12T17:27:11.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.715+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.98__multipart_key1.2~RqPsObZfaTODOMDJsJzKJOsCJIJMRO7.3 2024-09-12T17:27:11.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.715+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.98__shadow_key1.2~RqPsObZfaTODOMDJsJzKJOsCJIJMRO7.3_1 2024-09-12T17:27:11.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.715+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.98__multipart_key1.2~RqPsObZfaTODOMDJsJzKJOsCJIJMRO7.4 2024-09-12T17:27:11.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.715+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.98__shadow_key1.2~RqPsObZfaTODOMDJsJzKJOsCJIJMRO7.4_1 2024-09-12T17:27:11.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.715+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.98__multipart_key1.2~RqPsObZfaTODOMDJsJzKJOsCJIJMRO7.5 2024-09-12T17:27:11.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.715+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2594439656197574704', time=2024-09-12T19:26:59.450650+0000, chain.objs.size()=1 2024-09-12T17:27:11.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.715+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.116__shadow_.vwlX2rLYwcE5OvDPVM80Up-Kl1p9otg_0 2024-09-12T17:27:11.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.715+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12513499689713040319', time=2024-09-12T19:27:07.502339+0000, chain.objs.size()=1 2024-09-12T17:27:11.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.715+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.138__shadow_.9kYIoKiPmwsPsUhk7qyGjaIBbXwD36e_0 2024-09-12T17:27:11.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.727+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:27:11.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.731+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:27:11.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.735+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:11.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.735+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:11.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.739+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T17:27:11.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.739+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13271021137223222041', time=2024-09-12T19:26:50.722801+0000, chain.objs.size()=9 2024-09-12T17:27:11.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.739+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__multipart_key1.2~lAe3ucFb9kM6LhO3z9V3giaGWBMJH_r.1 2024-09-12T17:27:11.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.739+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__shadow_key1.2~lAe3ucFb9kM6LhO3z9V3giaGWBMJH_r.1_1 2024-09-12T17:27:11.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.739+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__multipart_key1.2~lAe3ucFb9kM6LhO3z9V3giaGWBMJH_r.2 2024-09-12T17:27:11.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.739+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__shadow_key1.2~lAe3ucFb9kM6LhO3z9V3giaGWBMJH_r.2_1 2024-09-12T17:27:11.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.739+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__multipart_key1.2~lAe3ucFb9kM6LhO3z9V3giaGWBMJH_r.3 2024-09-12T17:27:11.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.739+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__shadow_key1.2~lAe3ucFb9kM6LhO3z9V3giaGWBMJH_r.3_1 2024-09-12T17:27:11.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.739+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__multipart_key1.2~lAe3ucFb9kM6LhO3z9V3giaGWBMJH_r.4 2024-09-12T17:27:11.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.739+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__shadow_key1.2~lAe3ucFb9kM6LhO3z9V3giaGWBMJH_r.4_1 2024-09-12T17:27:11.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.739+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__multipart_key1.2~lAe3ucFb9kM6LhO3z9V3giaGWBMJH_r.5 2024-09-12T17:27:11.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.739+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1474523931633188011', time=2024-09-12T19:27:03.466425+0000, chain.objs.size()=1 2024-09-12T17:27:11.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.739+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.126__shadow_.b7yCOrfoJdtbn5IEBXYdh1COdjukoa2_0 2024-09-12T17:27:11.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.739+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11965843881487884354', time=2024-09-12T19:27:06.175363+0000, chain.objs.size()=1 2024-09-12T17:27:11.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.739+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.133__shadow_.iXFITNtv9Mv9fWInjhpEgaTtXN9vx3f_0 2024-09-12T17:27:11.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.739+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8528800379649889210', time=2024-09-12T19:27:10.493019+0000, chain.objs.size()=9 2024-09-12T17:27:11.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.739+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.144__multipart_key1/data/file.mpg.2~LWFjvqbKWq3bplr7oEfEd3qszj2hcfn.1 2024-09-12T17:27:11.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.743+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.144__shadow_key1/data/file.mpg.2~LWFjvqbKWq3bplr7oEfEd3qszj2hcfn.1_1 2024-09-12T17:27:11.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.743+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.144__multipart_key1/data/file.mpg.2~LWFjvqbKWq3bplr7oEfEd3qszj2hcfn.2 2024-09-12T17:27:11.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.743+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.144__shadow_key1/data/file.mpg.2~LWFjvqbKWq3bplr7oEfEd3qszj2hcfn.2_1 2024-09-12T17:27:11.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.743+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.144__multipart_key1/data/file.mpg.2~LWFjvqbKWq3bplr7oEfEd3qszj2hcfn.3 2024-09-12T17:27:11.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.743+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.144__shadow_key1/data/file.mpg.2~LWFjvqbKWq3bplr7oEfEd3qszj2hcfn.3_1 2024-09-12T17:27:11.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.747+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.144__multipart_key1/data/file.mpg.2~LWFjvqbKWq3bplr7oEfEd3qszj2hcfn.4 2024-09-12T17:27:11.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.751+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.144__shadow_key1/data/file.mpg.2~LWFjvqbKWq3bplr7oEfEd3qszj2hcfn.4_1 2024-09-12T17:27:11.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.751+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.144__multipart_key1/data/file.mpg.2~LWFjvqbKWq3bplr7oEfEd3qszj2hcfn.5 2024-09-12T17:27:11.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.755+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:27:11.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.759+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:27:11.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.763+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:11.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.767+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:11.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.767+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T17:27:11.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.767+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5392630444507493483', time=2024-09-12T19:26:52.920437+0000, chain.objs.size()=1 2024-09-12T17:27:11.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.767+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.103__shadow_.XJkgYp74xAHG2YxnHrbwVjWTBLf6Tai_0 2024-09-12T17:27:11.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.767+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1522642969991515961', time=2024-09-12T19:26:54.619311+0000, chain.objs.size()=9 2024-09-12T17:27:11.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.767+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.104__multipart_key1.2~E7ffTA49KrGM1MEZ1pRPWiO5Vz_-0-Q.1 2024-09-12T17:27:11.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.767+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.104__shadow_key1.2~E7ffTA49KrGM1MEZ1pRPWiO5Vz_-0-Q.1_1 2024-09-12T17:27:11.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.767+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.104__multipart_key1.2~E7ffTA49KrGM1MEZ1pRPWiO5Vz_-0-Q.2 2024-09-12T17:27:11.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.767+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.104__shadow_key1.2~E7ffTA49KrGM1MEZ1pRPWiO5Vz_-0-Q.2_1 2024-09-12T17:27:11.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.767+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.104__multipart_key1.2~E7ffTA49KrGM1MEZ1pRPWiO5Vz_-0-Q.3 2024-09-12T17:27:11.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.767+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.104__shadow_key1.2~E7ffTA49KrGM1MEZ1pRPWiO5Vz_-0-Q.3_1 2024-09-12T17:27:11.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.767+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.104__multipart_key1.2~E7ffTA49KrGM1MEZ1pRPWiO5Vz_-0-Q.4 2024-09-12T17:27:11.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.767+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.104__shadow_key1.2~E7ffTA49KrGM1MEZ1pRPWiO5Vz_-0-Q.4_1 2024-09-12T17:27:11.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.767+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.104__multipart_key1.2~E7ffTA49KrGM1MEZ1pRPWiO5Vz_-0-Q.5 2024-09-12T17:27:11.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.767+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15925379313821364461', time=2024-09-12T19:26:59.872060+0000, chain.objs.size()=1 2024-09-12T17:27:11.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.767+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.117__shadow_.zUJ8JPk1mB_D4eicB0HSC-5-zuOfN-Y_0 2024-09-12T17:27:11.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.767+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4055704544220537946', time=2024-09-12T19:27:05.423998+0000, chain.objs.size()=1 2024-09-12T17:27:11.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.767+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.131__shadow_.ZoZ28LHdDXB-DnOgb0VkMavlhWvOg9L_0 2024-09-12T17:27:11.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.775+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12957339841317666654', time=2024-09-12T19:27:05.813437+0000, chain.objs.size()=1 2024-09-12T17:27:11.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.775+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.132__shadow_.vCZaat5Tu84nOhj9yg0F96j-_JmZGDf_0 2024-09-12T17:27:11.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.779+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:27:11.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.783+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:27:11.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.787+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:11.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.787+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:11.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.787+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T17:27:11.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.787+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14382880170237619381', time=2024-09-12T19:26:51.755662+0000, chain.objs.size()=7 2024-09-12T17:27:11.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.787+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__multipart_key1.2~gTJzybM60_13S1BIazV2VLydKZFkE3Y.1 2024-09-12T17:27:11.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.787+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__shadow_key1.2~gTJzybM60_13S1BIazV2VLydKZFkE3Y.1_1 2024-09-12T17:27:11.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.787+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__shadow_key1.2~gTJzybM60_13S1BIazV2VLydKZFkE3Y.1_2 2024-09-12T17:27:11.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.787+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__multipart_key1.2~gTJzybM60_13S1BIazV2VLydKZFkE3Y.2 2024-09-12T17:27:11.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.787+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__shadow_key1.2~gTJzybM60_13S1BIazV2VLydKZFkE3Y.2_1 2024-09-12T17:27:11.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.787+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__shadow_key1.2~gTJzybM60_13S1BIazV2VLydKZFkE3Y.2_2 2024-09-12T17:27:11.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.787+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__multipart_key1.2~gTJzybM60_13S1BIazV2VLydKZFkE3Y.3 2024-09-12T17:27:11.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.787+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11018070494008757764', time=2024-09-12T19:27:04.640587+0000, chain.objs.size()=1 2024-09-12T17:27:11.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.787+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.129__shadow_.ygN2U1GSoMdnDg3AJNeeRkWow-dCenl_0 2024-09-12T17:27:11.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.787+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14823989341220996650', time=2024-09-12T19:27:05.438472+0000, chain.objs.size()=1 2024-09-12T17:27:11.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.787+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.131__shadow_.TB2a8S3lkRkgglBIhAsa4_0RQjtzX1K_0 2024-09-12T17:27:11.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.787+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4248913122010849473', time=2024-09-12T19:27:10.507591+0000, chain.objs.size()=1 2024-09-12T17:27:11.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.787+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.144__shadow_.1k5AXWK5BvpZ_r3dkWBCPG7eth1gmoG_0 2024-09-12T17:27:11.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.799+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:27:11.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.803+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:27:11.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.807+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:11.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.807+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:11.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.807+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:27:11.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.807+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8608237383491435894', time=2024-09-12T19:27:03.857873+0000, chain.objs.size()=1 2024-09-12T17:27:11.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.807+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.127__shadow_.fg3Av2eI5KoV8WyX3VsapOyAMdkXOvX_0 2024-09-12T17:27:11.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.811+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:27:11.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.815+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:27:11.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.819+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:11.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.819+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:11.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.823+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:27:11.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.823+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6663194524164292638', time=2024-09-12T19:26:34.429649+0000, chain.objs.size()=1 2024-09-12T17:27:11.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.823+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.84__shadow_.HK9LY6j7Tuk95nliaf-aXn08vgIV8hE_0 2024-09-12T17:27:11.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.823+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4933499750371494438', time=2024-09-12T19:27:01.111390+0000, chain.objs.size()=1 2024-09-12T17:27:11.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.823+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.120__shadow_.acMe0WlzhNHLiJc6hjU6oK38Q9saiRt_0 2024-09-12T17:27:11.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.823+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7969453458697870025', time=2024-09-12T19:27:02.645370+0000, chain.objs.size()=1 2024-09-12T17:27:11.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.823+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.124__shadow_.14_VQFPTeGbuT9iEzFtYUPI8qeLmAE__0 2024-09-12T17:27:11.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.823+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:27:11.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.831+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:27:11.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.831+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:11.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.835+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:11.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.835+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:27:11.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.835+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10925923970447954899', time=2024-09-12T19:26:42.941846+0000, chain.objs.size()=7 2024-09-12T17:27:11.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.835+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__multipart_key1.2~otrtBwWuhz3LsgkkpYZevefTneMb7Ru.1 2024-09-12T17:27:11.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.835+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__shadow_key1.2~otrtBwWuhz3LsgkkpYZevefTneMb7Ru.1_1 2024-09-12T17:27:11.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.835+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__shadow_key1.2~otrtBwWuhz3LsgkkpYZevefTneMb7Ru.1_2 2024-09-12T17:27:11.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.835+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__multipart_key1.2~otrtBwWuhz3LsgkkpYZevefTneMb7Ru.2 2024-09-12T17:27:11.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.835+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__shadow_key1.2~otrtBwWuhz3LsgkkpYZevefTneMb7Ru.2_1 2024-09-12T17:27:11.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.835+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__shadow_key1.2~otrtBwWuhz3LsgkkpYZevefTneMb7Ru.2_2 2024-09-12T17:27:11.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.835+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__multipart_key1.2~otrtBwWuhz3LsgkkpYZevefTneMb7Ru.3 2024-09-12T17:27:11.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.835+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12326871993916322550', time=2024-09-12T19:27:00.687253+0000, chain.objs.size()=1 2024-09-12T17:27:11.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.835+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.119__shadow_.mWd1ZLQgB4DrRr3qFEWOq4YeAXtEevV_0 2024-09-12T17:27:11.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.835+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4989555310449462768', time=2024-09-12T19:27:01.084286+0000, chain.objs.size()=1 2024-09-12T17:27:11.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.835+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.120__shadow_.qoOIIneV1mVQlOt1w3IOMcEh61Wz8v1_0 2024-09-12T17:27:11.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.843+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:27:11.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.847+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:27:11.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.851+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:11.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.851+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:11.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.855+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T17:27:11.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.855+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4016487301118035211', time=2024-09-12T19:26:58.594034+0000, chain.objs.size()=1 2024-09-12T17:27:11.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.855+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.114__shadow_.hwj7tffpihMvVZLvYDXSH_a30fOJMkX_0 2024-09-12T17:27:11.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.855+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.325452076604257613', time=2024-09-12T19:27:02.253961+0000, chain.objs.size()=1 2024-09-12T17:27:11.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.855+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.123__shadow_.QBn6806UtNOpT85eohuWgS8jaFN5zG3_0 2024-09-12T17:27:11.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.855+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12087481367341411743', time=2024-09-12T19:27:03.831249+0000, chain.objs.size()=1 2024-09-12T17:27:11.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.855+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.127__shadow_.0peLdEY7s4DnHtA8cCb7BpDXWjMYl9T_0 2024-09-12T17:27:11.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.855+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8843123670815919365', time=2024-09-12T19:27:03.870991+0000, chain.objs.size()=1 2024-09-12T17:27:11.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.855+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.127__shadow_.W0OCes7YLjwbUO3KL4o6_K3nm2xwB7o_0 2024-09-12T17:27:11.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.855+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:27:11.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.863+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:27:11.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.863+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:11.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.867+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:11.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.867+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:27:11.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.867+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.759233641031457646', time=2024-09-12T19:26:53.603421+0000, chain.objs.size()=9 2024-09-12T17:27:11.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.867+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.103__multipart_key1.2~YHRu7-L_0c0wssPG4COEzcmJUPkPTcZ.1 2024-09-12T17:27:11.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.867+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.103__shadow_key1.2~YHRu7-L_0c0wssPG4COEzcmJUPkPTcZ.1_1 2024-09-12T17:27:11.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.867+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.103__multipart_key1.2~YHRu7-L_0c0wssPG4COEzcmJUPkPTcZ.2 2024-09-12T17:27:11.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.867+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.103__shadow_key1.2~YHRu7-L_0c0wssPG4COEzcmJUPkPTcZ.2_1 2024-09-12T17:27:11.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.867+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.103__multipart_key1.2~YHRu7-L_0c0wssPG4COEzcmJUPkPTcZ.3 2024-09-12T17:27:11.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.867+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.103__shadow_key1.2~YHRu7-L_0c0wssPG4COEzcmJUPkPTcZ.3_1 2024-09-12T17:27:11.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.867+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.103__multipart_key1.2~YHRu7-L_0c0wssPG4COEzcmJUPkPTcZ.4 2024-09-12T17:27:11.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.867+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.103__shadow_key1.2~YHRu7-L_0c0wssPG4COEzcmJUPkPTcZ.4_1 2024-09-12T17:27:11.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.867+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.103__multipart_key1.2~YHRu7-L_0c0wssPG4COEzcmJUPkPTcZ.5 2024-09-12T17:27:11.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.867+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17458293550845136420', time=2024-09-12T19:27:03.062192+0000, chain.objs.size()=1 2024-09-12T17:27:11.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.867+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.125__shadow_.QQkRcilBRA7CZKRTStlvQuIq8muQiFe_0 2024-09-12T17:27:11.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.867+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17785249101106625175', time=2024-09-12T19:27:09.789734+0000, chain.objs.size()=9 2024-09-12T17:27:11.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.867+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.143__multipart_key1.2~K75Hp4IvcJBTiBpI5DF_7Y7iIO5Dges.1 2024-09-12T17:27:11.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.867+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.143__shadow_key1.2~K75Hp4IvcJBTiBpI5DF_7Y7iIO5Dges.1_1 2024-09-12T17:27:11.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.875+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.143__multipart_key1.2~K75Hp4IvcJBTiBpI5DF_7Y7iIO5Dges.2 2024-09-12T17:27:11.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.875+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.143__shadow_key1.2~K75Hp4IvcJBTiBpI5DF_7Y7iIO5Dges.2_1 2024-09-12T17:27:11.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.875+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.143__multipart_key1.2~K75Hp4IvcJBTiBpI5DF_7Y7iIO5Dges.3 2024-09-12T17:27:11.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.875+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.143__shadow_key1.2~K75Hp4IvcJBTiBpI5DF_7Y7iIO5Dges.3_1 2024-09-12T17:27:11.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.875+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.143__multipart_key1.2~K75Hp4IvcJBTiBpI5DF_7Y7iIO5Dges.4 2024-09-12T17:27:11.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.875+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.143__shadow_key1.2~K75Hp4IvcJBTiBpI5DF_7Y7iIO5Dges.4_1 2024-09-12T17:27:11.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.875+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.143__multipart_key1.2~K75Hp4IvcJBTiBpI5DF_7Y7iIO5Dges.5 2024-09-12T17:27:11.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.883+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:27:11.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.887+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:27:11.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.891+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:11.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.895+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:11.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.895+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:27:11.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.895+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~4esnvuNO-qthqLQ2Zl9h0_e7khRkLS4', time=2024-09-12T19:26:32.416633+0000, chain.objs.size()=9 2024-09-12T17:27:11.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.895+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.79__multipart_key1.2~4esnvuNO-qthqLQ2Zl9h0_e7khRkLS4.1 2024-09-12T17:27:11.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.895+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.79__shadow_key1.2~4esnvuNO-qthqLQ2Zl9h0_e7khRkLS4.1_1 2024-09-12T17:27:11.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.895+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.79__multipart_key1.2~4esnvuNO-qthqLQ2Zl9h0_e7khRkLS4.2 2024-09-12T17:27:11.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.895+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.79__shadow_key1.2~4esnvuNO-qthqLQ2Zl9h0_e7khRkLS4.2_1 2024-09-12T17:27:11.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.895+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.79__multipart_key1.2~4esnvuNO-qthqLQ2Zl9h0_e7khRkLS4.3 2024-09-12T17:27:11.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.895+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.79__shadow_key1.2~4esnvuNO-qthqLQ2Zl9h0_e7khRkLS4.3_1 2024-09-12T17:27:11.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.895+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.79__multipart_key1.2~4esnvuNO-qthqLQ2Zl9h0_e7khRkLS4.4 2024-09-12T17:27:11.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.895+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.79__shadow_key1.2~4esnvuNO-qthqLQ2Zl9h0_e7khRkLS4.4_1 2024-09-12T17:27:11.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.895+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.79__multipart_key1.2~4esnvuNO-qthqLQ2Zl9h0_e7khRkLS4.5 2024-09-12T17:27:11.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.895+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5623359402884748982', time=2024-09-12T19:27:04.254665+0000, chain.objs.size()=1 2024-09-12T17:27:11.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.895+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.128__shadow_.k30wpGUTbmgi0taS5kHigt1_oQJ6eFq_0 2024-09-12T17:27:11.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.895+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1154884039235339194', time=2024-09-12T19:27:05.412291+0000, chain.objs.size()=1 2024-09-12T17:27:11.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.895+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.131__shadow_.AdEHfqIopG4Va0Cep_NMxA8CBBO33ih_0 2024-09-12T17:27:11.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.903+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:27:11.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.907+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:27:11.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.911+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:11.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.911+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:11.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.915+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:27:11.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.915+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10890655834648740450', time=2024-09-12T19:26:43.087661+0000, chain.objs.size()=6 2024-09-12T17:27:11.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.915+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.93__shadow_.b70Lexp-KvbUtn-Nxa3cA3XZ_KXhPi4_0 2024-09-12T17:27:11.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.915+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.93__shadow_.b70Lexp-KvbUtn-Nxa3cA3XZ_KXhPi4_1 2024-09-12T17:27:11.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.915+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.93__shadow_.b70Lexp-KvbUtn-Nxa3cA3XZ_KXhPi4_2 2024-09-12T17:27:11.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.915+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.93__shadow_.b70Lexp-KvbUtn-Nxa3cA3XZ_KXhPi4_3 2024-09-12T17:27:11.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.915+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.93__shadow_.b70Lexp-KvbUtn-Nxa3cA3XZ_KXhPi4_4 2024-09-12T17:27:11.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.915+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.93__shadow_.b70Lexp-KvbUtn-Nxa3cA3XZ_KXhPi4_5 2024-09-12T17:27:11.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.915+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8518531758338174502', time=2024-09-12T19:27:07.022356+0000, chain.objs.size()=1 2024-09-12T17:27:11.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.915+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.136__shadow_.SBeBrO3YxDhcFnq8DL87Kp2dbqZLt5r_0 2024-09-12T17:27:11.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.923+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:27:11.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.931+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:27:11.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.935+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:11.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.935+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:11.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.935+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T17:27:11.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.935+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3582516011468297181', time=2024-09-12T19:26:46.748989+0000, chain.objs.size()=1 2024-09-12T17:27:11.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.935+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.100__shadow_.BmXlIYerh_RO3XVY9cEytlWtGyxOoH3_0 2024-09-12T17:27:11.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.935+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3255536441414241621', time=2024-09-12T19:26:49.500948+0000, chain.objs.size()=9 2024-09-12T17:27:11.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.935+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__multipart_key1.2~Muyx-cSAfkQXIVAI_v2_tcMzPCd_961.1 2024-09-12T17:27:11.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.935+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__shadow_key1.2~Muyx-cSAfkQXIVAI_v2_tcMzPCd_961.1_1 2024-09-12T17:27:11.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.935+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__multipart_key1.2~Muyx-cSAfkQXIVAI_v2_tcMzPCd_961.2 2024-09-12T17:27:11.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.935+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__shadow_key1.2~Muyx-cSAfkQXIVAI_v2_tcMzPCd_961.2_1 2024-09-12T17:27:11.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.935+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__multipart_key1.2~Muyx-cSAfkQXIVAI_v2_tcMzPCd_961.3 2024-09-12T17:27:11.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.935+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__shadow_key1.2~Muyx-cSAfkQXIVAI_v2_tcMzPCd_961.3_1 2024-09-12T17:27:11.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.935+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__multipart_key1.2~Muyx-cSAfkQXIVAI_v2_tcMzPCd_961.4 2024-09-12T17:27:11.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.935+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__shadow_key1.2~Muyx-cSAfkQXIVAI_v2_tcMzPCd_961.4_1 2024-09-12T17:27:11.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.935+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__multipart_key1.2~Muyx-cSAfkQXIVAI_v2_tcMzPCd_961.5 2024-09-12T17:27:11.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.935+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5367380531467157136', time=2024-09-12T19:27:01.098288+0000, chain.objs.size()=1 2024-09-12T17:27:11.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.935+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.120__shadow_.X3OmBfowGqKiRqacKdRsLGBJ_MfVeR-_0 2024-09-12T17:27:11.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.935+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15683804329243027561', time=2024-09-12T19:27:03.037249+0000, chain.objs.size()=1 2024-09-12T17:27:11.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.935+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.125__shadow_.54DA6pgOXpqccTQuJICMxflddAUlPZc_0 2024-09-12T17:27:11.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.943+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:27:11.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.951+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:27:11.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.955+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:11.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.955+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:11.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.955+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:27:11.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.955+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15991209812774358270', time=2024-09-12T19:26:59.436106+0000, chain.objs.size()=1 2024-09-12T17:27:11.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.955+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.116__shadow_.gh6HxpUnQ3X8YbfTlPUDI_LJ96ymFyj_0 2024-09-12T17:27:11.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.959+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:27:11.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.963+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:27:11.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.967+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:11.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.967+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:11.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.971+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:27:11.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.971+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.964523360580956671', time=2024-09-12T19:26:31.227435+0000, chain.objs.size()=1 2024-09-12T17:27:11.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.971+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.77__shadow_.4cNBAyUYcEVbhkh_ZX3bkMKPZPai3-v_0 2024-09-12T17:27:11.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.971+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.37509194257101101', time=2024-09-12T19:26:46.773450+0000, chain.objs.size()=1 2024-09-12T17:27:11.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.971+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.100__shadow_.mP6PgiE-JWPbEbrgQhSdt88V0webbS6_0 2024-09-12T17:27:11.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.971+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6743343123755979014', time=2024-09-12T19:27:00.240224+0000, chain.objs.size()=1 2024-09-12T17:27:11.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.971+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.118__shadow_.YWp8p-XbneVn6lJlvWfnV1C032n5G_r_0 2024-09-12T17:27:11.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.971+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:27:11.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.979+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:27:11.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.983+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:11.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.983+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:11.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.983+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T17:27:11.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.983+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17700489903942080217', time=2024-09-12T19:26:42.076390+0000, chain.objs.size()=7 2024-09-12T17:27:11.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.983+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__multipart_key1.2~EXZ8V73bGwUl7gJlQgRm4qJAI2n8xoF.1 2024-09-12T17:27:11.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.983+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__shadow_key1.2~EXZ8V73bGwUl7gJlQgRm4qJAI2n8xoF.1_1 2024-09-12T17:27:11.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.983+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__shadow_key1.2~EXZ8V73bGwUl7gJlQgRm4qJAI2n8xoF.1_2 2024-09-12T17:27:11.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.983+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__multipart_key1.2~EXZ8V73bGwUl7gJlQgRm4qJAI2n8xoF.2 2024-09-12T17:27:11.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.983+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__shadow_key1.2~EXZ8V73bGwUl7gJlQgRm4qJAI2n8xoF.2_1 2024-09-12T17:27:11.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.983+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__shadow_key1.2~EXZ8V73bGwUl7gJlQgRm4qJAI2n8xoF.2_2 2024-09-12T17:27:11.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.983+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__multipart_key1.2~EXZ8V73bGwUl7gJlQgRm4qJAI2n8xoF.3 2024-09-12T17:27:11.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.983+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18192536958886052191', time=2024-09-12T19:27:03.023259+0000, chain.objs.size()=1 2024-09-12T17:27:11.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.983+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.125__shadow_.j9Ko5zled7kTIKHtSRYlBigoA6R2zef_0 2024-09-12T17:27:11.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.983+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.151099828407697976', time=2024-09-12T19:27:03.427674+0000, chain.objs.size()=1 2024-09-12T17:27:11.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.983+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.126__shadow_.8mZk_wUhzMfWSxkmWqxoAXvrDwM-Mis_0 2024-09-12T17:27:11.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.983+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6506883884692091686', time=2024-09-12T19:27:04.282447+0000, chain.objs.size()=1 2024-09-12T17:27:11.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.983+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.128__shadow_.JMJmPcvKxHshXksLN3NRFDKbbV3BrDw_0 2024-09-12T17:27:11.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.983+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11752488369281492967', time=2024-09-12T19:27:07.264467+0000, chain.objs.size()=1 2024-09-12T17:27:11.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.983+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.137__shadow_.J5JC4u311GERAZDTNG94Wem0Sf3KXHO_0 2024-09-12T17:27:11.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.983+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17169579870455351912', time=2024-09-12T19:27:08.183348+0000, chain.objs.size()=1 2024-09-12T17:27:11.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.983+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.139__shadow_.D2TUnOoJ31ClmCfe-mkvQr70d9tGEB7_0 2024-09-12T17:27:11.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.995+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:27:12.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:11.999+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:27:12.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.003+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:12.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.007+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:12.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.007+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T17:27:12.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.007+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4884652833914592150', time=2024-09-12T19:26:37.223406+0000, chain.objs.size()=9 2024-09-12T17:27:12.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.007+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.91__multipart_key1.2~2Af7tMPIbzkypK315yGzinwR728dfJq.1 2024-09-12T17:27:12.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.007+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.91__shadow_key1.2~2Af7tMPIbzkypK315yGzinwR728dfJq.1_1 2024-09-12T17:27:12.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.007+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.91__multipart_key1.2~2Af7tMPIbzkypK315yGzinwR728dfJq.2 2024-09-12T17:27:12.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.007+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.91__shadow_key1.2~2Af7tMPIbzkypK315yGzinwR728dfJq.2_1 2024-09-12T17:27:12.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.007+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.91__multipart_key1.2~2Af7tMPIbzkypK315yGzinwR728dfJq.3 2024-09-12T17:27:12.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.007+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.91__shadow_key1.2~2Af7tMPIbzkypK315yGzinwR728dfJq.3_1 2024-09-12T17:27:12.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.007+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.91__multipart_key1.2~2Af7tMPIbzkypK315yGzinwR728dfJq.4 2024-09-12T17:27:12.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.007+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.91__shadow_key1.2~2Af7tMPIbzkypK315yGzinwR728dfJq.4_1 2024-09-12T17:27:12.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.007+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.91__multipart_key1.2~2Af7tMPIbzkypK315yGzinwR728dfJq.5 2024-09-12T17:27:12.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.007+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17266418933763798480', time=2024-09-12T19:26:41.177176+0000, chain.objs.size()=9 2024-09-12T17:27:12.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.007+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__multipart_key1.2~H51Vw0ovXMuewN2mHn02EbA3-2EpJ2c.1 2024-09-12T17:27:12.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.007+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__shadow_key1.2~H51Vw0ovXMuewN2mHn02EbA3-2EpJ2c.1_1 2024-09-12T17:27:12.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.007+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__multipart_key1.2~H51Vw0ovXMuewN2mHn02EbA3-2EpJ2c.2 2024-09-12T17:27:12.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.015+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__shadow_key1.2~H51Vw0ovXMuewN2mHn02EbA3-2EpJ2c.2_1 2024-09-12T17:27:12.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.015+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__multipart_key1.2~H51Vw0ovXMuewN2mHn02EbA3-2EpJ2c.3 2024-09-12T17:27:12.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.015+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__shadow_key1.2~H51Vw0ovXMuewN2mHn02EbA3-2EpJ2c.3_1 2024-09-12T17:27:12.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.015+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__multipart_key1.2~H51Vw0ovXMuewN2mHn02EbA3-2EpJ2c.4 2024-09-12T17:27:12.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.015+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__shadow_key1.2~H51Vw0ovXMuewN2mHn02EbA3-2EpJ2c.4_1 2024-09-12T17:27:12.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.015+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.94__multipart_key1.2~H51Vw0ovXMuewN2mHn02EbA3-2EpJ2c.5 2024-09-12T17:27:12.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.015+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1667895730195446609', time=2024-09-12T19:26:46.760231+0000, chain.objs.size()=9 2024-09-12T17:27:12.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.015+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.100__multipart_file2.mpg.2~Av41AaAzgCGdprMYEAhEjo_tbGe6KOf.1 2024-09-12T17:27:12.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.015+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.100__shadow_file2.mpg.2~Av41AaAzgCGdprMYEAhEjo_tbGe6KOf.1_1 2024-09-12T17:27:12.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.015+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.100__multipart_file2.mpg.2~Av41AaAzgCGdprMYEAhEjo_tbGe6KOf.2 2024-09-12T17:27:12.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.015+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.100__shadow_file2.mpg.2~Av41AaAzgCGdprMYEAhEjo_tbGe6KOf.2_1 2024-09-12T17:27:12.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.015+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.100__multipart_file2.mpg.2~Av41AaAzgCGdprMYEAhEjo_tbGe6KOf.3 2024-09-12T17:27:12.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.027+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.100__shadow_file2.mpg.2~Av41AaAzgCGdprMYEAhEjo_tbGe6KOf.3_1 2024-09-12T17:27:12.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.027+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.100__multipart_file2.mpg.2~Av41AaAzgCGdprMYEAhEjo_tbGe6KOf.4 2024-09-12T17:27:12.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.027+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.100__shadow_file2.mpg.2~Av41AaAzgCGdprMYEAhEjo_tbGe6KOf.4_1 2024-09-12T17:27:12.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.027+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.100__multipart_file2.mpg.2~Av41AaAzgCGdprMYEAhEjo_tbGe6KOf.5 2024-09-12T17:27:12.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.027+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9', time=2024-09-12T19:26:55.569210+0000, chain.objs.size()=83 2024-09-12T17:27:12.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.027+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.1 2024-09-12T17:27:12.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.027+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.2 2024-09-12T17:27:12.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.027+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.3 2024-09-12T17:27:12.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.027+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.4 2024-09-12T17:27:12.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.027+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.5 2024-09-12T17:27:12.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.027+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.6 2024-09-12T17:27:12.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.027+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.7 2024-09-12T17:27:12.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.035+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.8 2024-09-12T17:27:12.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.035+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.9 2024-09-12T17:27:12.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.035+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.10 2024-09-12T17:27:12.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.035+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.11 2024-09-12T17:27:12.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.035+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.12 2024-09-12T17:27:12.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.035+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.13 2024-09-12T17:27:12.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.035+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.14 2024-09-12T17:27:12.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.035+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.15 2024-09-12T17:27:12.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.035+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.16 2024-09-12T17:27:12.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.035+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.17 2024-09-12T17:27:12.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.035+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.18 2024-09-12T17:27:12.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.039+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.19 2024-09-12T17:27:12.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.039+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.20 2024-09-12T17:27:12.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.039+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.21 2024-09-12T17:27:12.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.039+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.22 2024-09-12T17:27:12.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.039+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.23 2024-09-12T17:27:12.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.039+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.24 2024-09-12T17:27:12.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.039+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.25 2024-09-12T17:27:12.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.043+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.26 2024-09-12T17:27:12.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.043+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.27 2024-09-12T17:27:12.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.043+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.28 2024-09-12T17:27:12.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.043+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.29 2024-09-12T17:27:12.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.043+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.30 2024-09-12T17:27:12.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.043+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.31 2024-09-12T17:27:12.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.043+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.32 2024-09-12T17:27:12.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.043+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.33 2024-09-12T17:27:12.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.047+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.34 2024-09-12T17:27:12.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.047+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.35 2024-09-12T17:27:12.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.047+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.36 2024-09-12T17:27:12.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.047+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.37 2024-09-12T17:27:12.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.047+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.38 2024-09-12T17:27:12.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.047+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.39 2024-09-12T17:27:12.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.047+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.40 2024-09-12T17:27:12.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.047+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.41 2024-09-12T17:27:12.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.051+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.42 2024-09-12T17:27:12.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.051+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.43 2024-09-12T17:27:12.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.051+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.44 2024-09-12T17:27:12.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.051+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.45 2024-09-12T17:27:12.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.055+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.46 2024-09-12T17:27:12.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.055+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.47 2024-09-12T17:27:12.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.055+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.48 2024-09-12T17:27:12.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.055+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.49 2024-09-12T17:27:12.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.055+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.50 2024-09-12T17:27:12.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.055+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.51 2024-09-12T17:27:12.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.055+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.52 2024-09-12T17:27:12.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.055+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.53 2024-09-12T17:27:12.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.055+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.54 2024-09-12T17:27:12.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.055+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.55 2024-09-12T17:27:12.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.055+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.56 2024-09-12T17:27:12.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.059+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.57 2024-09-12T17:27:12.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.059+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.58 2024-09-12T17:27:12.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.059+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.59 2024-09-12T17:27:12.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.059+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.60 2024-09-12T17:27:12.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.059+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.61 2024-09-12T17:27:12.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.059+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.62 2024-09-12T17:27:12.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.063+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.63 2024-09-12T17:27:12.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.063+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.64 2024-09-12T17:27:12.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.063+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.65 2024-09-12T17:27:12.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.063+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.66 2024-09-12T17:27:12.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.063+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.67 2024-09-12T17:27:12.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.063+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.68 2024-09-12T17:27:12.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.063+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.69 2024-09-12T17:27:12.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.067+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.70 2024-09-12T17:27:12.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.067+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.71 2024-09-12T17:27:12.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.067+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.72 2024-09-12T17:27:12.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.067+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.73 2024-09-12T17:27:12.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.067+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.74 2024-09-12T17:27:12.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.067+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.75 2024-09-12T17:27:12.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.067+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.76 2024-09-12T17:27:12.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.067+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.77 2024-09-12T17:27:12.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.067+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.78 2024-09-12T17:27:12.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.067+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.79 2024-09-12T17:27:12.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.067+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.80 2024-09-12T17:27:12.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.071+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.81 2024-09-12T17:27:12.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.071+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.82 2024-09-12T17:27:12.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.071+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.105__multipart_key1.2~Xvyl13tmNE1KjvQHfJ6XfCSJcW_19z9.83 2024-09-12T17:27:12.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.071+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12800039382379103077', time=2024-09-12T19:26:59.858712+0000, chain.objs.size()=1 2024-09-12T17:27:12.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.071+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.117__shadow_.cVgL6Z3356BmCiQ35XOS9ic-xQQ1E9M_0 2024-09-12T17:27:12.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.071+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.498532491279932147', time=2024-09-12T19:27:01.462238+0000, chain.objs.size()=1 2024-09-12T17:27:12.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.071+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.121__shadow_.AXTU_c31T-RrZkHx-56TZp6w4ZDfAr2_0 2024-09-12T17:27:12.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.075+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:27:12.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.079+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:27:12.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.083+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:12.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.083+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:12.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.087+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-12T17:27:12.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.087+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8597568919070343504', time=2024-09-12T19:26:45.824131+0000, chain.objs.size()=9 2024-09-12T17:27:12.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.087+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.99__multipart_key1.2~SP3O9yaII9A7i5ADrCJBQCjrLDYbT9W.1 2024-09-12T17:27:12.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.087+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.99__shadow_key1.2~SP3O9yaII9A7i5ADrCJBQCjrLDYbT9W.1_1 2024-09-12T17:27:12.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.087+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.99__multipart_key1.2~SP3O9yaII9A7i5ADrCJBQCjrLDYbT9W.2 2024-09-12T17:27:12.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.087+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.99__shadow_key1.2~SP3O9yaII9A7i5ADrCJBQCjrLDYbT9W.2_1 2024-09-12T17:27:12.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.087+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.99__multipart_key1.2~SP3O9yaII9A7i5ADrCJBQCjrLDYbT9W.3 2024-09-12T17:27:12.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.087+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.99__shadow_key1.2~SP3O9yaII9A7i5ADrCJBQCjrLDYbT9W.3_1 2024-09-12T17:27:12.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.087+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.99__multipart_key1.2~SP3O9yaII9A7i5ADrCJBQCjrLDYbT9W.4 2024-09-12T17:27:12.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.087+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.99__shadow_key1.2~SP3O9yaII9A7i5ADrCJBQCjrLDYbT9W.4_1 2024-09-12T17:27:12.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.087+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.99__multipart_key1.2~SP3O9yaII9A7i5ADrCJBQCjrLDYbT9W.5 2024-09-12T17:27:12.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.087+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7933170371234474686', time=2024-09-12T19:26:46.734282+0000, chain.objs.size()=9 2024-09-12T17:27:12.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.087+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.100__multipart_file.mpg.2~g4TXuyKmh5jEwJIevAvRxiMMfuWgPso.1 2024-09-12T17:27:12.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.087+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.100__shadow_file.mpg.2~g4TXuyKmh5jEwJIevAvRxiMMfuWgPso.1_1 2024-09-12T17:27:12.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.087+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.100__multipart_file.mpg.2~g4TXuyKmh5jEwJIevAvRxiMMfuWgPso.2 2024-09-12T17:27:12.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.091+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.100__shadow_file.mpg.2~g4TXuyKmh5jEwJIevAvRxiMMfuWgPso.2_1 2024-09-12T17:27:12.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.091+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.100__multipart_file.mpg.2~g4TXuyKmh5jEwJIevAvRxiMMfuWgPso.3 2024-09-12T17:27:12.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.091+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.100__shadow_file.mpg.2~g4TXuyKmh5jEwJIevAvRxiMMfuWgPso.3_1 2024-09-12T17:27:12.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.091+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.100__multipart_file.mpg.2~g4TXuyKmh5jEwJIevAvRxiMMfuWgPso.4 2024-09-12T17:27:12.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.095+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.100__shadow_file.mpg.2~g4TXuyKmh5jEwJIevAvRxiMMfuWgPso.4_1 2024-09-12T17:27:12.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.095+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.100__multipart_file.mpg.2~g4TXuyKmh5jEwJIevAvRxiMMfuWgPso.5 2024-09-12T17:27:12.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.095+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8771557105810073345', time=2024-09-12T19:26:58.622393+0000, chain.objs.size()=1 2024-09-12T17:27:12.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.095+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.114__shadow_.B3MJbqaUNmh1g-SQ0xwYHd2sS1_dbNG_0 2024-09-12T17:27:12.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.095+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10868979933597535079', time=2024-09-12T19:26:59.049483+0000, chain.objs.size()=1 2024-09-12T17:27:12.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.095+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.115__shadow_.GKjaxuuYv3WCQhkt_z4bS6mT7m0mcY4_0 2024-09-12T17:27:12.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.095+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4708381527773120005', time=2024-09-12T19:27:00.270323+0000, chain.objs.size()=1 2024-09-12T17:27:12.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.095+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.118__shadow_.kQrHrzG4UAb8bCr8Olbua2lMcqYe-W3_0 2024-09-12T17:27:12.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.095+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9858048783279360674', time=2024-09-12T19:27:00.283227+0000, chain.objs.size()=1 2024-09-12T17:27:12.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.095+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.118__shadow_.p_M6ZFzQxKhvMj6FseadU2MwluNTUBs_0 2024-09-12T17:27:12.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.095+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14923672962154650548', time=2024-09-12T19:27:01.490567+0000, chain.objs.size()=1 2024-09-12T17:27:12.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.095+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.121__shadow_.8ZGzyxGX3_YI4wVhWk00M4wF736QZvC_0 2024-09-12T17:27:12.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.095+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.422843876464333651', time=2024-09-12T19:27:01.907565+0000, chain.objs.size()=1 2024-09-12T17:27:12.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.095+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.122__shadow_.GoWUgShs7XjLxpBV_PdQ5l2Y_7-k35T_0 2024-09-12T17:27:12.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.095+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17912376783538589934', time=2024-09-12T19:27:02.268699+0000, chain.objs.size()=1 2024-09-12T17:27:12.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.095+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.123__shadow_.ldJU5XRqX7JFtfEPDdninkE_F0LKt7i_0 2024-09-12T17:27:12.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.099+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:27:12.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.103+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:27:12.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.107+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:12.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.107+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:12.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.107+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T17:27:12.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.107+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.465598237498168016', time=2024-09-12T19:26:34.137727+0000, chain.objs.size()=3 2024-09-12T17:27:12.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.107+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.83__shadow_.HvD05hp5ju6N1tVZv4XM1aktu3xcAyi_0 2024-09-12T17:27:12.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.107+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.83__shadow_.HvD05hp5ju6N1tVZv4XM1aktu3xcAyi_1 2024-09-12T17:27:12.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.107+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.83__shadow_.HvD05hp5ju6N1tVZv4XM1aktu3xcAyi_2 2024-09-12T17:27:12.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.107+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9995497187531530374', time=2024-09-12T19:26:57.780858+0000, chain.objs.size()=1 2024-09-12T17:27:12.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.107+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.112__shadow_.fmhZXHqL60_Qm7F35oCJLA3RrQnx4dx_0 2024-09-12T17:27:12.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.107+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15863836475618057582', time=2024-09-12T19:26:58.184829+0000, chain.objs.size()=1 2024-09-12T17:27:12.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.107+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.113__shadow_.F0gfk_-5xdaM3yNoCo47jxUeTGZ734O_0 2024-09-12T17:27:12.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.107+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9650547537698221459', time=2024-09-12T19:27:03.441508+0000, chain.objs.size()=1 2024-09-12T17:27:12.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.107+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.126__shadow_.nv6ncZJ1G1gb2EjPudIFrWXZjGvEoKT_0 2024-09-12T17:27:12.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.107+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16582637588008089398', time=2024-09-12T19:27:03.846439+0000, chain.objs.size()=1 2024-09-12T17:27:12.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.107+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.127__shadow_.qib9atMWRUYAOYA-gdyAmHy-jsihgmk_0 2024-09-12T17:27:12.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.115+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:27:12.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.119+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:27:12.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.119+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:12.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.123+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:12.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.123+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:27:12.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.123+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16219841535094115851', time=2024-09-12T19:26:36.117787+0000, chain.objs.size()=1 2024-09-12T17:27:12.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.123+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.90__shadow_.EcyRt8fwHZek5xiqV6meoV8I5-0JMzN_0 2024-09-12T17:27:12.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.123+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10878067459725038905', time=2024-09-12T19:26:58.197995+0000, chain.objs.size()=1 2024-09-12T17:27:12.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.123+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.113__shadow_.1JjIiDboAQsr446SCPPzBcOgLh8MuMk_0 2024-09-12T17:27:12.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.127+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:27:12.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.131+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:27:12.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.131+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:12.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.135+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:12.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.135+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T17:27:12.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.135+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17586707742816065278', time=2024-09-12T19:26:51.187293+0000, chain.objs.size()=7 2024-09-12T17:27:12.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.135+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__multipart_key1.2~9jyJAJxt_3vPAWdwarQ41s2_8-sZW_N.1 2024-09-12T17:27:12.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.135+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__shadow_key1.2~9jyJAJxt_3vPAWdwarQ41s2_8-sZW_N.1_1 2024-09-12T17:27:12.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.135+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__shadow_key1.2~9jyJAJxt_3vPAWdwarQ41s2_8-sZW_N.1_2 2024-09-12T17:27:12.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.135+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__multipart_key1.2~9jyJAJxt_3vPAWdwarQ41s2_8-sZW_N.2 2024-09-12T17:27:12.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.135+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__shadow_key1.2~9jyJAJxt_3vPAWdwarQ41s2_8-sZW_N.2_1 2024-09-12T17:27:12.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.135+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__shadow_key1.2~9jyJAJxt_3vPAWdwarQ41s2_8-sZW_N.2_2 2024-09-12T17:27:12.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.135+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.102__multipart_key1.2~9jyJAJxt_3vPAWdwarQ41s2_8-sZW_N.3 2024-09-12T17:27:12.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.135+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.123080840235576796', time=2024-09-12T19:26:58.210469+0000, chain.objs.size()=1 2024-09-12T17:27:12.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.135+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.113__shadow_.SVm4mEZwqrD3siBPm5RgHrvka2NdzXg_0 2024-09-12T17:27:12.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.135+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7789756264411012579', time=2024-09-12T19:26:58.633922+0000, chain.objs.size()=1 2024-09-12T17:27:12.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.135+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.114__shadow_.TYffhmR8jAt1zaL6MYgopopnyZeJDeO_0 2024-09-12T17:27:12.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.135+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7913166080241001251', time=2024-09-12T19:27:07.568128+0000, chain.objs.size()=1 2024-09-12T17:27:12.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.135+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.138__shadow_.A6iK3LJU6d3m3-OIAgoY6lopsGIEBv8_0 2024-09-12T17:27:12.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.139+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:27:12.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.143+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:27:12.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.147+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:12.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.147+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:12.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.147+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T17:27:12.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.147+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15929930829361743301', time=2024-09-12T19:26:59.846499+0000, chain.objs.size()=1 2024-09-12T17:27:12.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.147+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.117__shadow_.pOV1XluCSkJU5jYWXdtl-Zx5N0YusQN_0 2024-09-12T17:27:12.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.147+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17548652512208748067', time=2024-09-12T19:27:00.255224+0000, chain.objs.size()=1 2024-09-12T17:27:12.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.147+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.118__shadow_.jlEZwy7WmqfxrFY02KBrFQHETCOewzE_0 2024-09-12T17:27:12.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.147+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13235263362730688168', time=2024-09-12T19:27:01.071320+0000, chain.objs.size()=1 2024-09-12T17:27:12.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.147+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.120__shadow_.r31X3B2KKlQu8Xc6_rBuAv48uYLY70M_0 2024-09-12T17:27:12.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.147+0000 7fd39a14b9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3841177553336947405', time=2024-09-12T19:27:01.502741+0000, chain.objs.size()=1 2024-09-12T17:27:12.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.147+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.121__shadow_.hgKpsdroICuY-smD4uhJxeAP2QI8dtq_0 2024-09-12T17:27:12.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.151+0000 7fd39a14b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:27:12.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.159+0000 7fd24e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:12.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.163+0000 7fd39a14b9c0 20 remove_watcher() i=0 2024-09-12T17:27:12.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.163+0000 7fd39a14b9c0 2 removed watcher, disabling cache 2024-09-12T17:27:12.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.167+0000 7fd39a14b9c0 20 remove_watcher() i=1 2024-09-12T17:27:12.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.167+0000 7fd39a14b9c0 20 remove_watcher() i=2 2024-09-12T17:27:12.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.171+0000 7fd39a14b9c0 20 remove_watcher() i=3 2024-09-12T17:27:12.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.171+0000 7fd39a14b9c0 20 remove_watcher() i=4 2024-09-12T17:27:12.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.175+0000 7fd39a14b9c0 20 remove_watcher() i=5 2024-09-12T17:27:12.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.175+0000 7fd39a14b9c0 20 remove_watcher() i=6 2024-09-12T17:27:12.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.179+0000 7fd39a14b9c0 20 remove_watcher() i=7 2024-09-12T17:27:12.200 DEBUG:teuthology.orchestra.run.smithi016:> radosgw-admin gc process --include-all 2024-09-12T17:27:12.278 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:12.278 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:12.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.323+0000 7fefef2369c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:12.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.323+0000 7fefef2369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:12.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.323+0000 7fefef2369c0 20 realm 2024-09-12T17:27:12.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.323+0000 7fefef2369c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:12.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.323+0000 7fefef2369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:12.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.323+0000 7fefef2369c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:12.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.323+0000 7fefef2369c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:12.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.323+0000 7fefef2369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:12.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.323+0000 7fefef2369c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:12.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.327+0000 7fefef2369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:12.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.327+0000 7fefef2369c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:12.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.327+0000 7fefef2369c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:12.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.327+0000 7fefef2369c0 20 searching for the correct realm 2024-09-12T17:27:12.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.331+0000 7fefed53d640 0 -- 172.21.15.16:0/2009511345 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fefe0039400 msgr2=0x7fefe0039820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:12.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.547+0000 7fefec53b640 0 -- 172.21.15.16:0/2009511345 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fefe40c1060 msgr2=0x7fefe410c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:27:12.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.767+0000 7fefef2369c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:27:12.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.767+0000 7fefef2369c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:12.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.767+0000 7fefef2369c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:27:12.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.767+0000 7fefef2369c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:12.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.767+0000 7fefef2369c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:12.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.767+0000 7fefef2369c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:12.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.767+0000 7fefef2369c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:12.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.767+0000 7fefef2369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:12.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.767+0000 7fefef2369c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:12.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.767+0000 7fefef2369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:12.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.767+0000 7fefef2369c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:12.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.767+0000 7fefef2369c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:12.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.767+0000 7fefef2369c0 20 zone default found 2024-09-12T17:27:12.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.767+0000 7fefef2369c0 4 Realm: () 2024-09-12T17:27:12.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.767+0000 7fefef2369c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:27:12.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.767+0000 7fefef2369c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:27:12.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.767+0000 7fefef2369c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:12.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.767+0000 7fefef2369c0 20 zonegroup default 2024-09-12T17:27:12.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.767+0000 7fefef2369c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:12.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.767+0000 7fefef2369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:12.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.767+0000 7fefef2369c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:12.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.771+0000 7fefef2369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:12.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.771+0000 7fefef2369c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:12.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.771+0000 7fefef2369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:12.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.771+0000 7fefef2369c0 20 started sync module instance, tier type = 2024-09-12T17:27:12.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.771+0000 7fefef2369c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:27:12.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.791+0000 7fefef2369c0 20 add_watcher() i=0 2024-09-12T17:27:12.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.791+0000 7fefef2369c0 20 add_watcher() i=1 2024-09-12T17:27:12.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.791+0000 7fefef2369c0 20 add_watcher() i=2 2024-09-12T17:27:12.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.791+0000 7fefef2369c0 20 add_watcher() i=3 2024-09-12T17:27:12.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.791+0000 7fefef2369c0 20 add_watcher() i=4 2024-09-12T17:27:12.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.791+0000 7fefef2369c0 20 add_watcher() i=5 2024-09-12T17:27:12.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.791+0000 7fefef2369c0 20 add_watcher() i=6 2024-09-12T17:27:12.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.795+0000 7fefef2369c0 20 add_watcher() i=7 2024-09-12T17:27:12.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.795+0000 7fefef2369c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:12.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.799+0000 7feea2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:12.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.799+0000 7fefef2369c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:12.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.799+0000 7fefef2369c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:12.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.899+0000 7feea1fe3640 20 reqs_thread_entry: start 2024-09-12T17:27:12.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.899+0000 7fefef2369c0 20 init_complete bucket index max shards: 1 2024-09-12T17:27:12.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.899+0000 7fefef2369c0 20 Filter name: none 2024-09-12T17:27:12.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.899+0000 7fee137fe640 20 reqs_thread_entry: start 2024-09-12T17:27:12.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.899+0000 7fefef2369c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:27:12.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.903+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:12.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.903+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:12.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.903+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:12.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.903+0000 7fefef2369c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:27:12.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.907+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:12.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.911+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:12.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.911+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:12.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.915+0000 7fefef2369c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:27:12.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.915+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:12.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.919+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:12.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.919+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:12.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.919+0000 7fefef2369c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:27:12.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.923+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:12.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.923+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:12.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.923+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:12.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.927+0000 7fefef2369c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:27:12.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.927+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:12.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.931+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:12.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.931+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:12.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.935+0000 7fefef2369c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:27:12.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.939+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:12.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.939+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:12.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.939+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:12.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.943+0000 7fefef2369c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:27:12.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.947+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:12.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.947+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:12.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.947+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:12.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.951+0000 7fefef2369c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:27:12.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.955+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:12.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.955+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:12.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.955+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:12.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.959+0000 7fefef2369c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:27:12.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.963+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:12.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.963+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:12.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.963+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:12.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.963+0000 7fefef2369c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:27:12.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.967+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:12.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.971+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:12.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.971+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:12.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.975+0000 7fefef2369c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:27:12.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.979+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:12.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.979+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:12.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.979+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:12.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.983+0000 7fefef2369c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:27:12.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.983+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:12.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.987+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:12.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.987+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:12.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.987+0000 7fefef2369c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:27:12.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.991+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:12.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.995+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:12.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.995+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:13.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:12.999+0000 7fefef2369c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:27:13.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.003+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:13.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.003+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:13.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.003+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:13.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.007+0000 7fefef2369c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:27:13.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.011+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:13.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.011+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:13.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.011+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:13.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.015+0000 7fefef2369c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:27:13.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.019+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:13.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.019+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:13.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.019+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:13.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.019+0000 7fefef2369c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:27:13.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.023+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:13.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.027+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:13.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.027+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:13.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.031+0000 7fefef2369c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:27:13.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.035+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:13.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.035+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:13.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.035+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:13.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.039+0000 7fefef2369c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:27:13.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.043+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:13.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.043+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:13.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.047+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:13.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.047+0000 7fefef2369c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:27:13.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.051+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:13.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.055+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:13.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.055+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:13.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.059+0000 7fefef2369c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:27:13.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.059+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:13.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.063+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:13.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.063+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:13.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.067+0000 7fefef2369c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:27:13.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.071+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:13.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.071+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:13.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.071+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:13.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.075+0000 7fefef2369c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:27:13.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.079+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:13.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.079+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:13.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.079+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:13.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.083+0000 7fefef2369c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:27:13.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.087+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:13.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.087+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:13.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.087+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:13.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.091+0000 7fefef2369c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:27:13.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.095+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:13.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.095+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:13.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.099+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:13.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.099+0000 7fefef2369c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:27:13.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.103+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:13.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.107+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:13.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.107+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:13.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.111+0000 7fefef2369c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:27:13.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.111+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:13.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.115+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:13.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.115+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:13.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.119+0000 7fefef2369c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:27:13.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.123+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:13.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.123+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:13.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.127+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:13.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.127+0000 7fefef2369c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:27:13.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.131+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:13.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.135+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:13.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.135+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:13.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.135+0000 7fefef2369c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:27:13.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.139+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:13.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.143+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:13.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.143+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:13.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.147+0000 7fefef2369c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:27:13.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.151+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:13.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.155+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:13.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.155+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:13.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.159+0000 7fefef2369c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:27:13.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.163+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:13.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.163+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:27:13.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.163+0000 7fefef2369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:27:13.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.171+0000 7feea2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:13.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.175+0000 7fefef2369c0 20 remove_watcher() i=0 2024-09-12T17:27:13.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.175+0000 7fefef2369c0 2 removed watcher, disabling cache 2024-09-12T17:27:13.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.179+0000 7fefef2369c0 20 remove_watcher() i=1 2024-09-12T17:27:13.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.183+0000 7fefef2369c0 20 remove_watcher() i=2 2024-09-12T17:27:13.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.183+0000 7fefef2369c0 20 remove_watcher() i=3 2024-09-12T17:27:13.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.187+0000 7fefef2369c0 20 remove_watcher() i=4 2024-09-12T17:27:13.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.191+0000 7fefef2369c0 20 remove_watcher() i=5 2024-09-12T17:27:13.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.191+0000 7fefef2369c0 20 remove_watcher() i=6 2024-09-12T17:27:13.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:13.195+0000 7fefef2369c0 20 remove_watcher() i=7 2024-09-12T17:27:13.218 INFO:teuthology.run_tasks:Running task s3tests... 2024-09-12T17:27:13.237 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'storage classes': 'LUKEWARM, FROZEN'}} 2024-09-12T17:27:13.237 INFO:tasks.s3tests:Downloading s3-tests... 2024-09-12T17:27:13.238 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-09-12T17:27:13.238 DEBUG:teuthology.orchestra.run.smithi016:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T17:27:13.266 INFO:teuthology.orchestra.run.smithi016.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-09-12T17:27:14.114 INFO:tasks.s3tests:Creating rgw users... 2024-09-12T17:27:14.114 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW11111111111111111 --account-name Mr.RGW11111111111111111 --email RGW11111111111111111+test@test.test 2024-09-12T17:27:14.202 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:14.203 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:14.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.243+0000 7f3f3f05b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:14.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.447+0000 7f3f3f05b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:14.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.447+0000 7f3f3f05b9c0 20 realm 2024-09-12T17:27:14.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.447+0000 7f3f3f05b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:14.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.447+0000 7f3f3f05b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:14.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.447+0000 7f3f3f05b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:14.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.447+0000 7f3f3f05b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:14.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.451+0000 7f3f3f05b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:14.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.451+0000 7f3f3f05b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:14.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.451+0000 7f3f3f05b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:14.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.451+0000 7f3f3f05b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:14.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.455+0000 7f3f3f05b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:14.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.455+0000 7f3f3f05b9c0 20 searching for the correct realm 2024-09-12T17:27:14.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.459+0000 7f3f3d362640 0 -- 172.21.15.16:0/1167078406 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f3f240a9400 msgr2=0x7f3f240a9860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:14.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.675+0000 7f3f3c360640 0 -- 172.21.15.16:0/1167078406 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7f3f2c039060 msgr2=0x7f3f2c063bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:14.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.691+0000 7f3f3f05b9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:27:14.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.691+0000 7f3f3f05b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:14.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.691+0000 7f3f3f05b9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:27:14.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.691+0000 7f3f3f05b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:14.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.691+0000 7f3f3f05b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:14.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.691+0000 7f3f3f05b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:14.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.691+0000 7f3f3f05b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:14.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.691+0000 7f3f3f05b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:14.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.691+0000 7f3f3f05b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:14.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.691+0000 7f3f3f05b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:14.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.691+0000 7f3f3f05b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:14.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.691+0000 7f3f3f05b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:14.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.691+0000 7f3f3f05b9c0 20 zone default found 2024-09-12T17:27:14.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.691+0000 7f3f3f05b9c0 4 Realm: () 2024-09-12T17:27:14.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.691+0000 7f3f3f05b9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:27:14.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.691+0000 7f3f3f05b9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:27:14.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.691+0000 7f3f3f05b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:14.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.691+0000 7f3f3f05b9c0 20 zonegroup default 2024-09-12T17:27:14.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.691+0000 7f3f3f05b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:14.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.695+0000 7f3f3f05b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:14.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.695+0000 7f3f3f05b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:14.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.695+0000 7f3f3f05b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:14.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.695+0000 7f3f3f05b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:14.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.695+0000 7f3f3f05b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:14.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.695+0000 7f3f3f05b9c0 20 started sync module instance, tier type = 2024-09-12T17:27:14.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.695+0000 7f3f3f05b9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:27:14.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.719+0000 7f3f3f05b9c0 20 add_watcher() i=0 2024-09-12T17:27:14.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.719+0000 7f3f3f05b9c0 20 add_watcher() i=1 2024-09-12T17:27:14.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.719+0000 7f3f3f05b9c0 20 add_watcher() i=2 2024-09-12T17:27:14.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.719+0000 7f3f3f05b9c0 20 add_watcher() i=3 2024-09-12T17:27:14.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.719+0000 7f3f3f05b9c0 20 add_watcher() i=4 2024-09-12T17:27:14.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.719+0000 7f3f3f05b9c0 20 add_watcher() i=5 2024-09-12T17:27:14.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.719+0000 7f3f3f05b9c0 20 add_watcher() i=6 2024-09-12T17:27:14.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.723+0000 7f3f3f05b9c0 20 add_watcher() i=7 2024-09-12T17:27:14.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.723+0000 7f3f3f05b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:14.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.723+0000 7f3df2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:14.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.727+0000 7f3f3f05b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:14.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.727+0000 7f3f3f05b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:14.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.727+0000 7f3f3f05b9c0 5 note: GC not initialized 2024-09-12T17:27:14.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.727+0000 7f3df1fe3640 20 reqs_thread_entry: start 2024-09-12T17:27:14.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.727+0000 7f3f3f05b9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:27:14.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.727+0000 7f3f3f05b9c0 20 Filter name: none 2024-09-12T17:27:14.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.727+0000 7f3d637fe640 20 reqs_thread_entry: start 2024-09-12T17:27:14.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.727+0000 7f3f3f05b9c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 : miss 2024-09-12T17:27:14.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.727+0000 7f3f3f05b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:14.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.727+0000 7f3f3f05b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:14.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.727+0000 7f3f3f05b9c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x0 2024-09-12T17:27:14.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.727+0000 7f3f3f05b9c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-12T17:27:14.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.727+0000 7f3f3f05b9c0 20 failed to read name.$Mr.RGW11111111111111111 with: (2) No such file or directory 2024-09-12T17:27:14.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.727+0000 7f3f3f05b9c0 10 cache get: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test : miss 2024-09-12T17:27:14.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.727+0000 7f3f3f05b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:14.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.727+0000 7f3f3f05b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:14.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.727+0000 7f3f3f05b9c0 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x0 2024-09-12T17:27:14.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.727+0000 7f3f3f05b9c0 10 adding default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-12T17:27:14.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.727+0000 7f3f3f05b9c0 20 failed to read rgw11111111111111111+test@test.test with: (2) No such file or directory 2024-09-12T17:27:14.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.731+0000 7f3f3f05b9c0 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-12T17:27:14.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.731+0000 7f3f3f05b9c0 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-12T17:27:14.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.731+0000 7f3f3f05b9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW11111111111111111, ofs0, ns] 2024-09-12T17:27:14.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.731+0000 7f3e13fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431738 cookie 93831536286992 notifier 8961 bl.length()=384 2024-09-12T17:27:14.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.731+0000 7f3e13fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-12T17:27:14.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.731+0000 7f3e13fff640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-12T17:27:14.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.735+0000 7f3f3f05b9c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-12T17:27:14.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.735+0000 7f3f3f05b9c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-12T17:27:14.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.735+0000 7f3f3f05b9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW11111111111111111, ofs0, ns] 2024-09-12T17:27:14.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.735+0000 7f3e13fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431731 cookie 93831536294336 notifier 8961 bl.length()=225 2024-09-12T17:27:14.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.735+0000 7f3e13fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-12T17:27:14.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.735+0000 7f3e13fff640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-12T17:27:14.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.739+0000 7f3f3f05b9c0 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-12T17:27:14.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.739+0000 7f3f3f05b9c0 10 moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-12T17:27:14.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.739+0000 7f3f3f05b9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw11111111111111111+test@test.test, ofs0, ns] 2024-09-12T17:27:14.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.739+0000 7f3e137fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431655 cookie 93831536289616 notifier 8961 bl.length()=234 2024-09-12T17:27:14.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.739+0000 7f3e137fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-12T17:27:14.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.739+0000 7f3e137fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-12T17:27:14.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.739+0000 7f3df2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:14.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.747+0000 7f3f3f05b9c0 20 remove_watcher() i=0 2024-09-12T17:27:14.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.747+0000 7f3f3f05b9c0 2 removed watcher, disabling cache 2024-09-12T17:27:14.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.747+0000 7f3f3f05b9c0 20 remove_watcher() i=1 2024-09-12T17:27:14.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.751+0000 7f3f3f05b9c0 20 remove_watcher() i=2 2024-09-12T17:27:14.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.751+0000 7f3f3f05b9c0 20 remove_watcher() i=3 2024-09-12T17:27:14.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.755+0000 7f3f3f05b9c0 20 remove_watcher() i=4 2024-09-12T17:27:14.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.755+0000 7f3f3f05b9c0 20 remove_watcher() i=5 2024-09-12T17:27:14.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.755+0000 7f3f3f05b9c0 20 remove_watcher() i=6 2024-09-12T17:27:14.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.759+0000 7f3f3f05b9c0 20 remove_watcher() i=7 2024-09-12T17:27:14.776 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-12T17:27:14.776 INFO:teuthology.orchestra.run.smithi016.stdout: "id": "RGW11111111111111111", 2024-09-12T17:27:14.776 INFO:teuthology.orchestra.run.smithi016.stdout: "tenant": "", 2024-09-12T17:27:14.776 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "Mr.RGW11111111111111111", 2024-09-12T17:27:14.776 INFO:teuthology.orchestra.run.smithi016.stdout: "email": "RGW11111111111111111+test@test.test", 2024-09-12T17:27:14.777 INFO:teuthology.orchestra.run.smithi016.stdout: "quota": { 2024-09-12T17:27:14.777 INFO:teuthology.orchestra.run.smithi016.stdout: "enabled": false, 2024-09-12T17:27:14.777 INFO:teuthology.orchestra.run.smithi016.stdout: "check_on_raw": false, 2024-09-12T17:27:14.777 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size": -1, 2024-09-12T17:27:14.777 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size_kb": 0, 2024-09-12T17:27:14.777 INFO:teuthology.orchestra.run.smithi016.stdout: "max_objects": -1 2024-09-12T17:27:14.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-12T17:27:14.777 INFO:teuthology.orchestra.run.smithi016.stdout: "bucket_quota": { 2024-09-12T17:27:14.777 INFO:teuthology.orchestra.run.smithi016.stdout: "enabled": false, 2024-09-12T17:27:14.777 INFO:teuthology.orchestra.run.smithi016.stdout: "check_on_raw": false, 2024-09-12T17:27:14.777 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size": -1, 2024-09-12T17:27:14.777 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size_kb": 0, 2024-09-12T17:27:14.777 INFO:teuthology.orchestra.run.smithi016.stdout: "max_objects": -1 2024-09-12T17:27:14.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-12T17:27:14.778 INFO:teuthology.orchestra.run.smithi016.stdout: "max_users": 1000, 2024-09-12T17:27:14.778 INFO:teuthology.orchestra.run.smithi016.stdout: "max_roles": 1000, 2024-09-12T17:27:14.778 INFO:teuthology.orchestra.run.smithi016.stdout: "max_groups": 1000, 2024-09-12T17:27:14.778 INFO:teuthology.orchestra.run.smithi016.stdout: "max_buckets": 1000, 2024-09-12T17:27:14.778 INFO:teuthology.orchestra.run.smithi016.stdout: "max_access_keys": 4 2024-09-12T17:27:14.778 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-12T17:27:14.779 DEBUG:tasks.s3tests:Creating user RGW11111111111111111 on client.0 2024-09-12T17:27:14.780 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.RGW11111111111111111 --email foo+test@test.test --access-key PUQIZYJONGWLKBNYVYJQ --secret dRoMT6xs6MEVqF6Mgil4XwYxNQxNfEVYgzU6llh395xAiKBgBD5Y9Q== --cluster ceph --account-id RGW11111111111111111 --account-root 2024-09-12T17:27:14.867 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:14.867 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:14.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.907+0000 7fe8a08f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:14.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.911+0000 7fe8a08f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:14.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.911+0000 7fe8a08f69c0 20 realm 2024-09-12T17:27:14.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.911+0000 7fe8a08f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:14.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.911+0000 7fe8a08f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:14.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.911+0000 7fe8a08f69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:14.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.911+0000 7fe8a08f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:14.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.911+0000 7fe8a08f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:14.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.911+0000 7fe8a08f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:14.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.911+0000 7fe8a08f69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:14.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.911+0000 7fe8a08f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:14.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.915+0000 7fe8a08f69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:14.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.915+0000 7fe8a08f69c0 20 searching for the correct realm 2024-09-12T17:27:14.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:14.915+0000 7fe89dbfb640 0 -- 172.21.15.16:0/2870321916 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7fe890101730 msgr2=0x7fe8900f76b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:15.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.127+0000 7fe89ebfd640 0 -- 172.21.15.16:0/2870321916 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fe8940444c0 msgr2=0x7fe89402ba80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:15.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.147+0000 7fe8a08f69c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:27:15.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.147+0000 7fe8a08f69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:15.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.147+0000 7fe8a08f69c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:27:15.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.147+0000 7fe8a08f69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:15.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.147+0000 7fe8a08f69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:15.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.147+0000 7fe8a08f69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:15.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.147+0000 7fe8a08f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:15.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.147+0000 7fe8a08f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:15.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.147+0000 7fe8a08f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:15.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.151+0000 7fe8a08f69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:15.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.151+0000 7fe8a08f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:15.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.151+0000 7fe8a08f69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:15.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.151+0000 7fe8a08f69c0 20 zone default found 2024-09-12T17:27:15.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.151+0000 7fe8a08f69c0 4 Realm: () 2024-09-12T17:27:15.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.151+0000 7fe8a08f69c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:27:15.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.151+0000 7fe8a08f69c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:27:15.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.151+0000 7fe8a08f69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:15.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.151+0000 7fe8a08f69c0 20 zonegroup default 2024-09-12T17:27:15.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.151+0000 7fe8a08f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:15.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.151+0000 7fe8a08f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:15.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.151+0000 7fe8a08f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:15.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.151+0000 7fe8a08f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:15.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.151+0000 7fe8a08f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:15.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.155+0000 7fe8a08f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:15.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.155+0000 7fe8a08f69c0 20 started sync module instance, tier type = 2024-09-12T17:27:15.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.155+0000 7fe8a08f69c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:27:15.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.175+0000 7fe8a08f69c0 20 add_watcher() i=0 2024-09-12T17:27:15.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.175+0000 7fe8a08f69c0 20 add_watcher() i=1 2024-09-12T17:27:15.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.175+0000 7fe8a08f69c0 20 add_watcher() i=2 2024-09-12T17:27:15.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.175+0000 7fe8a08f69c0 20 add_watcher() i=3 2024-09-12T17:27:15.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.175+0000 7fe8a08f69c0 20 add_watcher() i=4 2024-09-12T17:27:15.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.175+0000 7fe8a08f69c0 20 add_watcher() i=5 2024-09-12T17:27:15.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.175+0000 7fe8a08f69c0 20 add_watcher() i=6 2024-09-12T17:27:15.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.175+0000 7fe8a08f69c0 20 add_watcher() i=7 2024-09-12T17:27:15.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.175+0000 7fe8a08f69c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:15.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.179+0000 7fe7557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:15.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.179+0000 7fe8a08f69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:15.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.179+0000 7fe8a08f69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:15.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.179+0000 7fe8a08f69c0 5 note: GC not initialized 2024-09-12T17:27:15.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.183+0000 7fe74f7fe640 20 reqs_thread_entry: start 2024-09-12T17:27:15.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.183+0000 7fe8a08f69c0 20 init_complete bucket index max shards: 1 2024-09-12T17:27:15.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.183+0000 7fe8a08f69c0 20 Filter name: none 2024-09-12T17:27:15.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.183+0000 7fe74d7fa640 20 reqs_thread_entry: start 2024-09-12T17:27:15.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.183+0000 7fe8a08f69c0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T17:27:15.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.183+0000 7fe8a08f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:15.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.183+0000 7fe8a08f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:15.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.183+0000 7fe8a08f69c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-09-12T17:27:15.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.183+0000 7fe8a08f69c0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T17:27:15.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.183+0000 7fe8a08f69c0 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-09-12T17:27:15.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.183+0000 7fe8a08f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:15.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.183+0000 7fe8a08f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:15.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.183+0000 7fe8a08f69c0 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-09-12T17:27:15.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.183+0000 7fe8a08f69c0 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T17:27:15.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.183+0000 7fe8a08f69c0 10 cache get: name=default.rgw.meta+users.keys+PUQIZYJONGWLKBNYVYJQ : miss 2024-09-12T17:27:15.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.183+0000 7fe8a08f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:15.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.183+0000 7fe8a08f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:15.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.183+0000 7fe8a08f69c0 10 cache put: name=default.rgw.meta+users.keys+PUQIZYJONGWLKBNYVYJQ info.flags=0x0 2024-09-12T17:27:15.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.183+0000 7fe8a08f69c0 10 adding default.rgw.meta+users.keys+PUQIZYJONGWLKBNYVYJQ to cache LRU end 2024-09-12T17:27:15.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.183+0000 7fe8a08f69c0 10 cache get: name=default.rgw.meta+accounts+account.RGW11111111111111111 : miss 2024-09-12T17:27:15.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.183+0000 7fe8a08f69c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:15.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.187+0000 7fe8a08f69c0 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T17:27:15.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.187+0000 7fe8a08f69c0 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-12T17:27:15.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.187+0000 7fe8a08f69c0 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-12T17:27:15.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.187+0000 7fe8a08f69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:27:15.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.187+0000 7fe8a08f69c0 10 cache get: name=default.rgw.meta+users.keys+PUQIZYJONGWLKBNYVYJQ : hit (negative entry) 2024-09-12T17:27:15.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.187+0000 7fe8a08f69c0 10 cache get: name=default.rgw.meta+users.keys+PUQIZYJONGWLKBNYVYJQ : hit (negative entry) 2024-09-12T17:27:15.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.187+0000 7fe8a08f69c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T17:27:15.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.187+0000 7fe8a08f69c0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T17:27:15.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.187+0000 7fe8a08f69c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T17:27:15.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.187+0000 7fe781ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431732 cookie 94664537691520 notifier 8489 bl.length()=673 2024-09-12T17:27:15.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.187+0000 7fe781ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T17:27:15.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.187+0000 7fe781ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T17:27:15.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.191+0000 7fe8a08f69c0 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T17:27:15.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.191+0000 7fe8a08f69c0 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T17:27:15.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.191+0000 7fe8a08f69c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-09-12T17:27:15.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.195+0000 7fe781ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431733 cookie 94664537747696 notifier 8489 bl.length()=185 2024-09-12T17:27:15.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.195+0000 7fe781ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T17:27:15.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.195+0000 7fe781ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T17:27:15.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.199+0000 7fe8a08f69c0 10 cache put: name=default.rgw.meta+users.keys+PUQIZYJONGWLKBNYVYJQ info.flags=0x7 2024-09-12T17:27:15.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.199+0000 7fe8a08f69c0 10 moving default.rgw.meta+users.keys+PUQIZYJONGWLKBNYVYJQ to cache LRU end 2024-09-12T17:27:15.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.199+0000 7fe8a08f69c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:PUQIZYJONGWLKBNYVYJQ, ofs0, ns] 2024-09-12T17:27:15.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.199+0000 7fe781ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431739 cookie 94664537739680 notifier 8489 bl.length()=186 2024-09-12T17:27:15.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.199+0000 7fe781ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+PUQIZYJONGWLKBNYVYJQ info.flags=0x7 2024-09-12T17:27:15.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.199+0000 7fe781ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+PUQIZYJONGWLKBNYVYJQ to cache LRU end 2024-09-12T17:27:15.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.203+0000 7fe8a08f69c0 20 linked user foo.client.0 to account RGW11111111111111111 2024-09-12T17:27:15.206 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-12T17:27:15.206 INFO:teuthology.orchestra.run.smithi016.stdout: "user_id": "foo.client.0", 2024-09-12T17:27:15.206 INFO:teuthology.orchestra.run.smithi016.stdout: "display_name": "Mr.RGW11111111111111111", 2024-09-12T17:27:15.206 INFO:teuthology.orchestra.run.smithi016.stdout: "email": "foo+test@test.test", 2024-09-12T17:27:15.207 INFO:teuthology.orchestra.run.smithi016.stdout: "suspended": 0, 2024-09-12T17:27:15.207 INFO:teuthology.orchestra.run.smithi016.stdout: "max_buckets": 1000, 2024-09-12T17:27:15.207 INFO:teuthology.orchestra.run.smithi016.stdout: "subusers": [], 2024-09-12T17:27:15.207 INFO:teuthology.orchestra.run.smithi016.stdout: "keys": [ 2024-09-12T17:27:15.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-12T17:27:15.207 INFO:teuthology.orchestra.run.smithi016.stdout: "user": "foo.client.0", 2024-09-12T17:27:15.207 INFO:teuthology.orchestra.run.smithi016.stdout: "access_key": "PUQIZYJONGWLKBNYVYJQ", 2024-09-12T17:27:15.207 INFO:teuthology.orchestra.run.smithi016.stdout: "secret_key": "dRoMT6xs6MEVqF6Mgil4XwYxNQxNfEVYgzU6llh395xAiKBgBD5Y9Q==", 2024-09-12T17:27:15.207 INFO:teuthology.orchestra.run.smithi016.stdout: "active": true, 2024-09-12T17:27:15.207 INFO:teuthology.orchestra.run.smithi016.stdout: "create_date": "2024-09-12T17:27:15.191320Z" 2024-09-12T17:27:15.207 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-12T17:27:15.208 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-12T17:27:15.208 INFO:teuthology.orchestra.run.smithi016.stdout: "swift_keys": [], 2024-09-12T17:27:15.208 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": [], 2024-09-12T17:27:15.208 INFO:teuthology.orchestra.run.smithi016.stdout: "op_mask": "read, write, delete", 2024-09-12T17:27:15.208 INFO:teuthology.orchestra.run.smithi016.stdout: "default_placement": "", 2024-09-12T17:27:15.208 INFO:teuthology.orchestra.run.smithi016.stdout: "default_storage_class": "", 2024-09-12T17:27:15.208 INFO:teuthology.orchestra.run.smithi016.stdout: "placement_tags": [], 2024-09-12T17:27:15.208 INFO:teuthology.orchestra.run.smithi016.stdout: "bucket_quota": { 2024-09-12T17:27:15.208 INFO:teuthology.orchestra.run.smithi016.stdout: "enabled": false, 2024-09-12T17:27:15.208 INFO:teuthology.orchestra.run.smithi016.stdout: "check_on_raw": false, 2024-09-12T17:27:15.208 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size": -1, 2024-09-12T17:27:15.208 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size_kb": 0, 2024-09-12T17:27:15.209 INFO:teuthology.orchestra.run.smithi016.stdout: "max_objects": -1 2024-09-12T17:27:15.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-12T17:27:15.209 INFO:teuthology.orchestra.run.smithi016.stdout: "user_quota": { 2024-09-12T17:27:15.209 INFO:teuthology.orchestra.run.smithi016.stdout: "enabled": false, 2024-09-12T17:27:15.209 INFO:teuthology.orchestra.run.smithi016.stdout: "check_on_raw": false, 2024-09-12T17:27:15.209 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size": -1, 2024-09-12T17:27:15.209 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size_kb": 0, 2024-09-12T17:27:15.209 INFO:teuthology.orchestra.run.smithi016.stdout: "max_objects": -1 2024-09-12T17:27:15.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-12T17:27:15.209 INFO:teuthology.orchestra.run.smithi016.stdout: "temp_url_keys": [], 2024-09-12T17:27:15.209 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "root", 2024-09-12T17:27:15.209 INFO:teuthology.orchestra.run.smithi016.stdout: "mfa_ids": [], 2024-09-12T17:27:15.209 INFO:teuthology.orchestra.run.smithi016.stdout: "account_id": "RGW11111111111111111", 2024-09-12T17:27:15.210 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-12T17:27:15.210 INFO:teuthology.orchestra.run.smithi016.stdout: "create_date": "2024-09-12T17:27:15.191284Z", 2024-09-12T17:27:15.210 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-12T17:27:15.210 INFO:teuthology.orchestra.run.smithi016.stdout: "group_ids": [] 2024-09-12T17:27:15.210 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-12T17:27:15.210 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:15.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.203+0000 7fe7557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:15.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.211+0000 7fe8a08f69c0 20 remove_watcher() i=0 2024-09-12T17:27:15.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.211+0000 7fe8a08f69c0 2 removed watcher, disabling cache 2024-09-12T17:27:15.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.211+0000 7fe8a08f69c0 20 remove_watcher() i=1 2024-09-12T17:27:15.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.215+0000 7fe8a08f69c0 20 remove_watcher() i=2 2024-09-12T17:27:15.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.215+0000 7fe8a08f69c0 20 remove_watcher() i=3 2024-09-12T17:27:15.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.219+0000 7fe8a08f69c0 20 remove_watcher() i=4 2024-09-12T17:27:15.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.219+0000 7fe8a08f69c0 20 remove_watcher() i=5 2024-09-12T17:27:15.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.223+0000 7fe8a08f69c0 20 remove_watcher() i=6 2024-09-12T17:27:15.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.223+0000 7fe8a08f69c0 20 remove_watcher() i=7 2024-09-12T17:27:15.243 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 7498986467 --totp-seed CY7EKFXV7FKX32DZ7EYRIVBKXF6ICKKBNM2PH264KPC72TEKOETGC6553CAJNZ3A --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T17:27:15.291 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:15.292 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:15.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.331+0000 7f034921e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:15.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.331+0000 7f034921e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:15.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.331+0000 7f034921e9c0 20 realm 2024-09-12T17:27:15.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.331+0000 7f034921e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:15.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.331+0000 7f034921e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:15.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.331+0000 7f034921e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:15.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.331+0000 7f034921e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:15.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.331+0000 7f034921e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:15.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.331+0000 7f034921e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:15.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.335+0000 7f034921e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:15.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.335+0000 7f034921e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:15.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.335+0000 7f034921e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:15.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.335+0000 7f034921e9c0 20 searching for the correct realm 2024-09-12T17:27:15.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.339+0000 7f0346523640 0 -- 172.21.15.16:0/1502270014 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7f033802f910 msgr2=0x7f03380203e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:15.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.347+0000 7f0346523640 0 -- 172.21.15.16:0/1502270014 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f034012b1e0 msgr2=0x7f03401242e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:15.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.563+0000 7f034921e9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:27:15.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.563+0000 7f034921e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:15.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.563+0000 7f034921e9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:27:15.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.563+0000 7f034921e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:15.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.563+0000 7f034921e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:15.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.563+0000 7f034921e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:15.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.563+0000 7f034921e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:15.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.563+0000 7f034921e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:15.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.563+0000 7f034921e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:15.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.567+0000 7f034921e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:15.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.567+0000 7f034921e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:15.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.567+0000 7f034921e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:15.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.567+0000 7f034921e9c0 20 zone default found 2024-09-12T17:27:15.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.567+0000 7f034921e9c0 4 Realm: () 2024-09-12T17:27:15.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.567+0000 7f034921e9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:27:15.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.567+0000 7f034921e9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:27:15.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.567+0000 7f034921e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:15.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.567+0000 7f034921e9c0 20 zonegroup default 2024-09-12T17:27:15.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.567+0000 7f034921e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:15.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.567+0000 7f034921e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:15.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.567+0000 7f034921e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:15.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.567+0000 7f034921e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:15.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.567+0000 7f034921e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:15.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.567+0000 7f034921e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:15.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.567+0000 7f034921e9c0 20 started sync module instance, tier type = 2024-09-12T17:27:15.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.567+0000 7f034921e9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:27:15.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.591+0000 7f034921e9c0 20 add_watcher() i=0 2024-09-12T17:27:15.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.591+0000 7f034921e9c0 20 add_watcher() i=1 2024-09-12T17:27:15.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.591+0000 7f034921e9c0 20 add_watcher() i=2 2024-09-12T17:27:15.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.591+0000 7f034921e9c0 20 add_watcher() i=3 2024-09-12T17:27:15.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.591+0000 7f034921e9c0 20 add_watcher() i=4 2024-09-12T17:27:15.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.591+0000 7f034921e9c0 20 add_watcher() i=5 2024-09-12T17:27:15.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.591+0000 7f034921e9c0 20 add_watcher() i=6 2024-09-12T17:27:15.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.595+0000 7f034921e9c0 20 add_watcher() i=7 2024-09-12T17:27:15.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.595+0000 7f034921e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:15.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.599+0000 7f01fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:15.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.599+0000 7f034921e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:15.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.599+0000 7f034921e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:15.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.599+0000 7f034921e9c0 5 note: GC not initialized 2024-09-12T17:27:15.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.599+0000 7f01fcfe1640 20 reqs_thread_entry: start 2024-09-12T17:27:15.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.599+0000 7f034921e9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:27:15.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.599+0000 7f034921e9c0 20 Filter name: none 2024-09-12T17:27:15.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.599+0000 7f01f5ffb640 20 reqs_thread_entry: start 2024-09-12T17:27:15.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.599+0000 7f034921e9c0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T17:27:15.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.599+0000 7f034921e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:15.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.603+0000 7f034921e9c0 20 rados_obj.operate() r=0 bl.length=488 2024-09-12T17:27:15.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.603+0000 7f034921e9c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-09-12T17:27:15.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.603+0000 7f034921e9c0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T17:27:15.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:15.603+0000 7f034921e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:27:17.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:17.427+0000 7f034921e9c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T17:27:17.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:17.427+0000 7f034921e9c0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T17:27:17.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:17.427+0000 7f034921e9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T17:27:17.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:17.427+0000 7f0229ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366326 cookie 94362380322160 notifier 9000 bl.length()=687 2024-09-12T17:27:17.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:17.427+0000 7f0229ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T17:27:17.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:17.427+0000 7f0229ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T17:27:17.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:17.431+0000 7f01fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:17.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:17.435+0000 7f034921e9c0 20 remove_watcher() i=0 2024-09-12T17:27:17.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:17.435+0000 7f034921e9c0 2 removed watcher, disabling cache 2024-09-12T17:27:17.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:17.439+0000 7f034921e9c0 20 remove_watcher() i=1 2024-09-12T17:27:17.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:17.439+0000 7f034921e9c0 20 remove_watcher() i=2 2024-09-12T17:27:17.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:17.443+0000 7f034921e9c0 20 remove_watcher() i=3 2024-09-12T17:27:17.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:17.447+0000 7f034921e9c0 20 remove_watcher() i=4 2024-09-12T17:27:17.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:17.447+0000 7f034921e9c0 20 remove_watcher() i=5 2024-09-12T17:27:17.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:17.451+0000 7f034921e9c0 20 remove_watcher() i=6 2024-09-12T17:27:17.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:17.451+0000 7f034921e9c0 20 remove_watcher() i=7 2024-09-12T17:27:17.475 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-09-12T17:27:17.475 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key IVVWMYORBCEYCFSQEAHD --secret XMOAxFu2LS2xowfmDr7w3IEkwitTpoSPmXLXTWJjI4gWcb6bIZLlxg== --cluster ceph 2024-09-12T17:27:17.521 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:17.521 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:17.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:17.563+0000 7febbd0049c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:17.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:17.563+0000 7febbd0049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:17.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:17.563+0000 7febbd0049c0 20 realm 2024-09-12T17:27:17.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:17.563+0000 7febbd0049c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:17.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:17.563+0000 7febbd0049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:17.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:17.563+0000 7febbd0049c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:17.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:17.563+0000 7febbd0049c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:17.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:17.563+0000 7febbd0049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:17.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:17.563+0000 7febbd0049c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:17.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:17.567+0000 7febbd0049c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:17.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:17.567+0000 7febbd0049c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:17.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:17.567+0000 7febbd0049c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:17.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:17.567+0000 7febbd0049c0 20 searching for the correct realm 2024-09-12T17:27:17.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:17.571+0000 7febbb30b640 0 -- 172.21.15.16:0/3019857772 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7febb0008040 msgr2=0x7febb0061f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:17.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:17.787+0000 7febba309640 0 -- 172.21.15.16:0/3019857772 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7febb4091bf0 msgr2=0x7febb40a0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:27:18.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.003+0000 7febbd0049c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:27:18.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.003+0000 7febbd0049c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:18.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.003+0000 7febbd0049c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:27:18.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.003+0000 7febbd0049c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:18.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.003+0000 7febbd0049c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:18.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.003+0000 7febbd0049c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:18.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.003+0000 7febbd0049c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:18.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.003+0000 7febbd0049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:18.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.003+0000 7febbd0049c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:18.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.007+0000 7febbd0049c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:18.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.007+0000 7febbd0049c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:18.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.007+0000 7febbd0049c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:18.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.007+0000 7febbd0049c0 20 zone default found 2024-09-12T17:27:18.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.007+0000 7febbd0049c0 4 Realm: () 2024-09-12T17:27:18.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.007+0000 7febbd0049c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:27:18.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.007+0000 7febbd0049c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:27:18.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.007+0000 7febbd0049c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:18.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.007+0000 7febbd0049c0 20 zonegroup default 2024-09-12T17:27:18.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.007+0000 7febbd0049c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:18.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.007+0000 7febbd0049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:18.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.007+0000 7febbd0049c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:18.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.007+0000 7febbd0049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:18.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.007+0000 7febbd0049c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:18.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.011+0000 7febbd0049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:18.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.011+0000 7febbd0049c0 20 started sync module instance, tier type = 2024-09-12T17:27:18.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.011+0000 7febbd0049c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:27:18.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.031+0000 7febbd0049c0 20 add_watcher() i=0 2024-09-12T17:27:18.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.031+0000 7febbd0049c0 20 add_watcher() i=1 2024-09-12T17:27:18.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.031+0000 7febbd0049c0 20 add_watcher() i=2 2024-09-12T17:27:18.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.031+0000 7febbd0049c0 20 add_watcher() i=3 2024-09-12T17:27:18.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.031+0000 7febbd0049c0 20 add_watcher() i=4 2024-09-12T17:27:18.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.031+0000 7febbd0049c0 20 add_watcher() i=5 2024-09-12T17:27:18.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.031+0000 7febbd0049c0 20 add_watcher() i=6 2024-09-12T17:27:18.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.035+0000 7febbd0049c0 20 add_watcher() i=7 2024-09-12T17:27:18.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.035+0000 7febbd0049c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:18.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.039+0000 7fea71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:18.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.039+0000 7febbd0049c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:18.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.039+0000 7febbd0049c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:18.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.039+0000 7febbd0049c0 5 note: GC not initialized 2024-09-12T17:27:18.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.039+0000 7fea70fe1640 20 reqs_thread_entry: start 2024-09-12T17:27:18.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.039+0000 7febbd0049c0 20 init_complete bucket index max shards: 1 2024-09-12T17:27:18.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.039+0000 7febbd0049c0 20 Filter name: none 2024-09-12T17:27:18.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.039+0000 7fea69ffb640 20 reqs_thread_entry: start 2024-09-12T17:27:18.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.039+0000 7febbd0049c0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T17:27:18.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.039+0000 7febbd0049c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:18.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.043+0000 7febbd0049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:18.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.043+0000 7febbd0049c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-09-12T17:27:18.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.043+0000 7febbd0049c0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T17:27:18.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.043+0000 7febbd0049c0 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-09-12T17:27:18.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.043+0000 7febbd0049c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:18.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.043+0000 7febbd0049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:18.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.043+0000 7febbd0049c0 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-09-12T17:27:18.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.043+0000 7febbd0049c0 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T17:27:18.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.043+0000 7febbd0049c0 10 cache get: name=default.rgw.meta+users.keys+IVVWMYORBCEYCFSQEAHD : miss 2024-09-12T17:27:18.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.043+0000 7febbd0049c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:18.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.043+0000 7febbd0049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:18.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.043+0000 7febbd0049c0 10 cache put: name=default.rgw.meta+users.keys+IVVWMYORBCEYCFSQEAHD info.flags=0x0 2024-09-12T17:27:18.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.043+0000 7febbd0049c0 10 adding default.rgw.meta+users.keys+IVVWMYORBCEYCFSQEAHD to cache LRU end 2024-09-12T17:27:18.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.043+0000 7febbd0049c0 10 cache get: name=default.rgw.meta+users.keys+IVVWMYORBCEYCFSQEAHD : hit (negative entry) 2024-09-12T17:27:18.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.043+0000 7febbd0049c0 10 cache get: name=default.rgw.meta+users.keys+IVVWMYORBCEYCFSQEAHD : hit (negative entry) 2024-09-12T17:27:18.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.047+0000 7febbd0049c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T17:27:18.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.047+0000 7febbd0049c0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T17:27:18.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.047+0000 7febbd0049c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T17:27:18.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.047+0000 7fea9e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366332 cookie 94882365934256 notifier 8519 bl.length()=645 2024-09-12T17:27:18.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.047+0000 7fea9e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T17:27:18.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.047+0000 7fea9e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T17:27:18.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.051+0000 7febbd0049c0 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T17:27:18.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.051+0000 7febbd0049c0 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T17:27:18.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.051+0000 7febbd0049c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-09-12T17:27:18.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.051+0000 7fea9e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366285 cookie 94882365946064 notifier 8519 bl.length()=185 2024-09-12T17:27:18.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.051+0000 7fea9e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T17:27:18.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.051+0000 7fea9e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T17:27:18.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.055+0000 7febbd0049c0 10 cache put: name=default.rgw.meta+users.keys+IVVWMYORBCEYCFSQEAHD info.flags=0x7 2024-09-12T17:27:18.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.055+0000 7febbd0049c0 10 moving default.rgw.meta+users.keys+IVVWMYORBCEYCFSQEAHD to cache LRU end 2024-09-12T17:27:18.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.055+0000 7febbd0049c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:IVVWMYORBCEYCFSQEAHD, ofs0, ns] 2024-09-12T17:27:18.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.055+0000 7fea9dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366333 cookie 94882365934256 notifier 8519 bl.length()=186 2024-09-12T17:27:18.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.055+0000 7fea9dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+IVVWMYORBCEYCFSQEAHD info.flags=0x7 2024-09-12T17:27:18.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.055+0000 7fea9dffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+IVVWMYORBCEYCFSQEAHD to cache LRU end 2024-09-12T17:27:18.059 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-12T17:27:18.059 INFO:teuthology.orchestra.run.smithi016.stdout: "user_id": "bar.client.0", 2024-09-12T17:27:18.059 INFO:teuthology.orchestra.run.smithi016.stdout: "display_name": "Mr.bar.client.0", 2024-09-12T17:27:18.059 INFO:teuthology.orchestra.run.smithi016.stdout: "email": "bar+test@test.test", 2024-09-12T17:27:18.059 INFO:teuthology.orchestra.run.smithi016.stdout: "suspended": 0, 2024-09-12T17:27:18.059 INFO:teuthology.orchestra.run.smithi016.stdout: "max_buckets": 1000, 2024-09-12T17:27:18.059 INFO:teuthology.orchestra.run.smithi016.stdout: "subusers": [], 2024-09-12T17:27:18.059 INFO:teuthology.orchestra.run.smithi016.stdout: "keys": [ 2024-09-12T17:27:18.060 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-12T17:27:18.060 INFO:teuthology.orchestra.run.smithi016.stdout: "user": "bar.client.0", 2024-09-12T17:27:18.060 INFO:teuthology.orchestra.run.smithi016.stdout: "access_key": "IVVWMYORBCEYCFSQEAHD", 2024-09-12T17:27:18.060 INFO:teuthology.orchestra.run.smithi016.stdout: "secret_key": "XMOAxFu2LS2xowfmDr7w3IEkwitTpoSPmXLXTWJjI4gWcb6bIZLlxg==", 2024-09-12T17:27:18.060 INFO:teuthology.orchestra.run.smithi016.stdout: "active": true, 2024-09-12T17:27:18.060 INFO:teuthology.orchestra.run.smithi016.stdout: "create_date": "2024-09-12T17:27:18.048391Z" 2024-09-12T17:27:18.060 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-12T17:27:18.060 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-12T17:27:18.060 INFO:teuthology.orchestra.run.smithi016.stdout: "swift_keys": [], 2024-09-12T17:27:18.060 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": [], 2024-09-12T17:27:18.060 INFO:teuthology.orchestra.run.smithi016.stdout: "op_mask": "read, write, delete", 2024-09-12T17:27:18.060 INFO:teuthology.orchestra.run.smithi016.stdout: "default_placement": "", 2024-09-12T17:27:18.060 INFO:teuthology.orchestra.run.smithi016.stdout: "default_storage_class": "", 2024-09-12T17:27:18.060 INFO:teuthology.orchestra.run.smithi016.stdout: "placement_tags": [], 2024-09-12T17:27:18.061 INFO:teuthology.orchestra.run.smithi016.stdout: "bucket_quota": { 2024-09-12T17:27:18.061 INFO:teuthology.orchestra.run.smithi016.stdout: "enabled": false, 2024-09-12T17:27:18.061 INFO:teuthology.orchestra.run.smithi016.stdout: "check_on_raw": false, 2024-09-12T17:27:18.061 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size": -1, 2024-09-12T17:27:18.061 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size_kb": 0, 2024-09-12T17:27:18.061 INFO:teuthology.orchestra.run.smithi016.stdout: "max_objects": -1 2024-09-12T17:27:18.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-12T17:27:18.061 INFO:teuthology.orchestra.run.smithi016.stdout: "user_quota": { 2024-09-12T17:27:18.061 INFO:teuthology.orchestra.run.smithi016.stdout: "enabled": false, 2024-09-12T17:27:18.061 INFO:teuthology.orchestra.run.smithi016.stdout: "check_on_raw": false, 2024-09-12T17:27:18.061 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size": -1, 2024-09-12T17:27:18.061 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size_kb": 0, 2024-09-12T17:27:18.062 INFO:teuthology.orchestra.run.smithi016.stdout: "max_objects": -1 2024-09-12T17:27:18.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-12T17:27:18.062 INFO:teuthology.orchestra.run.smithi016.stdout: "temp_url_keys": [], 2024-09-12T17:27:18.062 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "rgw", 2024-09-12T17:27:18.062 INFO:teuthology.orchestra.run.smithi016.stdout: "mfa_ids": [], 2024-09-12T17:27:18.062 INFO:teuthology.orchestra.run.smithi016.stdout: "account_id": "", 2024-09-12T17:27:18.062 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-12T17:27:18.062 INFO:teuthology.orchestra.run.smithi016.stdout: "create_date": "2024-09-12T17:27:18.048355Z", 2024-09-12T17:27:18.062 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-12T17:27:18.062 INFO:teuthology.orchestra.run.smithi016.stdout: "group_ids": [] 2024-09-12T17:27:18.062 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-12T17:27:18.062 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:18.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.059+0000 7fea71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:18.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.063+0000 7febbd0049c0 20 remove_watcher() i=0 2024-09-12T17:27:18.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.063+0000 7febbd0049c0 2 removed watcher, disabling cache 2024-09-12T17:27:18.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.063+0000 7febbd0049c0 20 remove_watcher() i=1 2024-09-12T17:27:18.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.067+0000 7febbd0049c0 20 remove_watcher() i=2 2024-09-12T17:27:18.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.071+0000 7febbd0049c0 20 remove_watcher() i=3 2024-09-12T17:27:18.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.071+0000 7febbd0049c0 20 remove_watcher() i=4 2024-09-12T17:27:18.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.075+0000 7febbd0049c0 20 remove_watcher() i=5 2024-09-12T17:27:18.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.075+0000 7febbd0049c0 20 remove_watcher() i=6 2024-09-12T17:27:18.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.075+0000 7febbd0049c0 20 remove_watcher() i=7 2024-09-12T17:27:18.097 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 3358734346 --totp-seed I2ESTCSQRL5HBVVCZWYFMBEXQN3SQDBFECALJPNFE7KAG7AFKKMEFXVOCHUV6JRC --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T17:27:18.145 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:18.146 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:18.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.183+0000 7f55b27a29c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:18.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.187+0000 7f55b27a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:18.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.187+0000 7f55b27a29c0 20 realm 2024-09-12T17:27:18.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.187+0000 7f55b27a29c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:18.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.187+0000 7f55b27a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:18.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.187+0000 7f55b27a29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:18.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.187+0000 7f55b27a29c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:18.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.187+0000 7f55b27a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:18.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.187+0000 7f55b27a29c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:18.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.187+0000 7f55b27a29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:18.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.187+0000 7f55b27a29c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:18.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.191+0000 7f55b27a29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:18.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.191+0000 7f55b27a29c0 20 searching for the correct realm 2024-09-12T17:27:18.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.195+0000 7f55afaa7640 0 -- 172.21.15.16:0/4271696965 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7f55a80cc3f0 msgr2=0x7f55a80cc810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:18.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.203+0000 7f55afaa7640 0 -- 172.21.15.16:0/4271696965 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f55a0078b90 msgr2=0x7f55a0077a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:18.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.459+0000 7f55b27a29c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:27:18.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.459+0000 7f55b27a29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:18.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.459+0000 7f55b27a29c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:27:18.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.459+0000 7f55b27a29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:18.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.459+0000 7f55b27a29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:18.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.459+0000 7f55b27a29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:18.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.459+0000 7f55b27a29c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:18.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.459+0000 7f55b27a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:18.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.459+0000 7f55b27a29c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:18.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.459+0000 7f55b27a29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:18.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.459+0000 7f55b27a29c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:18.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.459+0000 7f55b27a29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:18.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.459+0000 7f55b27a29c0 20 zone default found 2024-09-12T17:27:18.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.459+0000 7f55b27a29c0 4 Realm: () 2024-09-12T17:27:18.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.459+0000 7f55b27a29c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:27:18.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.459+0000 7f55b27a29c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:27:18.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.459+0000 7f55b27a29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:18.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.459+0000 7f55b27a29c0 20 zonegroup default 2024-09-12T17:27:18.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.459+0000 7f55b27a29c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:18.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.463+0000 7f55b27a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:18.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.463+0000 7f55b27a29c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:18.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.463+0000 7f55b27a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:18.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.463+0000 7f55b27a29c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:18.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.463+0000 7f55b27a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:18.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.463+0000 7f55b27a29c0 20 started sync module instance, tier type = 2024-09-12T17:27:18.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.463+0000 7f55b27a29c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:27:18.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.487+0000 7f55b27a29c0 20 add_watcher() i=0 2024-09-12T17:27:18.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.487+0000 7f55b27a29c0 20 add_watcher() i=1 2024-09-12T17:27:18.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.487+0000 7f55b27a29c0 20 add_watcher() i=2 2024-09-12T17:27:18.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.487+0000 7f55b27a29c0 20 add_watcher() i=3 2024-09-12T17:27:18.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.487+0000 7f55b27a29c0 20 add_watcher() i=4 2024-09-12T17:27:18.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.487+0000 7f55b27a29c0 20 add_watcher() i=5 2024-09-12T17:27:18.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.487+0000 7f55b27a29c0 20 add_watcher() i=6 2024-09-12T17:27:18.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.487+0000 7f55b27a29c0 20 add_watcher() i=7 2024-09-12T17:27:18.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.487+0000 7f55b27a29c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:18.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.491+0000 7f5466fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:18.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.491+0000 7f55b27a29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:18.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.491+0000 7f55b27a29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:18.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.491+0000 7f55b27a29c0 5 note: GC not initialized 2024-09-12T17:27:18.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.491+0000 7f5465fdb640 20 reqs_thread_entry: start 2024-09-12T17:27:18.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.491+0000 7f55b27a29c0 20 init_complete bucket index max shards: 1 2024-09-12T17:27:18.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.491+0000 7f55b27a29c0 20 Filter name: none 2024-09-12T17:27:18.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.491+0000 7f53d77fe640 20 reqs_thread_entry: start 2024-09-12T17:27:18.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.495+0000 7f55b27a29c0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T17:27:18.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.495+0000 7f55b27a29c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:18.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.495+0000 7f55b27a29c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T17:27:18.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.495+0000 7f55b27a29c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-09-12T17:27:18.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.495+0000 7f55b27a29c0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T17:27:18.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.495+0000 7f55b27a29c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:27:18.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.503+0000 7f55b27a29c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T17:27:18.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.503+0000 7f55b27a29c0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T17:27:18.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.503+0000 7f55b27a29c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T17:27:18.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.503+0000 7f54877fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333630 cookie 94818921395456 notifier 9036 bl.length()=659 2024-09-12T17:27:18.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.503+0000 7f54877fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T17:27:18.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.503+0000 7f54877fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T17:27:18.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.503+0000 7f5466fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:18.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.511+0000 7f55b27a29c0 20 remove_watcher() i=0 2024-09-12T17:27:18.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.511+0000 7f55b27a29c0 2 removed watcher, disabling cache 2024-09-12T17:27:18.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.511+0000 7f55b27a29c0 20 remove_watcher() i=1 2024-09-12T17:27:18.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.515+0000 7f55b27a29c0 20 remove_watcher() i=2 2024-09-12T17:27:18.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.515+0000 7f55b27a29c0 20 remove_watcher() i=3 2024-09-12T17:27:18.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.519+0000 7f55b27a29c0 20 remove_watcher() i=4 2024-09-12T17:27:18.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.519+0000 7f55b27a29c0 20 remove_watcher() i=5 2024-09-12T17:27:18.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.523+0000 7f55b27a29c0 20 remove_watcher() i=6 2024-09-12T17:27:18.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.523+0000 7f55b27a29c0 20 remove_watcher() i=7 2024-09-12T17:27:18.543 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW33333333333333333 --account-name Mr.RGW33333333333333333 --email RGW33333333333333333+test@test.test --tenant testx 2024-09-12T17:27:18.580 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:18.580 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:18.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.619+0000 7f3a3dce99c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:18.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.623+0000 7f3a3dce99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:18.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.623+0000 7f3a3dce99c0 20 realm 2024-09-12T17:27:18.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.623+0000 7f3a3dce99c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:18.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.623+0000 7f3a3dce99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:18.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.623+0000 7f3a3dce99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:18.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.623+0000 7f3a3dce99c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:18.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.623+0000 7f3a3dce99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:18.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.623+0000 7f3a3dce99c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:18.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.623+0000 7f3a3dce99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:18.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.623+0000 7f3a3dce99c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:18.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.627+0000 7f3a3dce99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:18.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.627+0000 7f3a3dce99c0 20 searching for the correct realm 2024-09-12T17:27:18.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.627+0000 7f3a3afee640 0 -- 172.21.15.16:0/98278692 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x55765d43d3a0 msgr2=0x7f3a2c0861f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:18.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.843+0000 7f3a3bff0640 0 -- 172.21.15.16:0/98278692 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f3a30106ed0 msgr2=0x7f3a300fce50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:18.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.859+0000 7f3a3dce99c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:27:18.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.859+0000 7f3a3dce99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:18.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.859+0000 7f3a3dce99c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:27:18.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.859+0000 7f3a3dce99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:18.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.859+0000 7f3a3dce99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:18.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.859+0000 7f3a3dce99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:18.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.859+0000 7f3a3dce99c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:18.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.859+0000 7f3a3dce99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:18.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.859+0000 7f3a3dce99c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:18.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.863+0000 7f3a3dce99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:18.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.863+0000 7f3a3dce99c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:18.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.863+0000 7f3a3dce99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:18.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.863+0000 7f3a3dce99c0 20 zone default found 2024-09-12T17:27:18.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.863+0000 7f3a3dce99c0 4 Realm: () 2024-09-12T17:27:18.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.863+0000 7f3a3dce99c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:27:18.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.863+0000 7f3a3dce99c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:27:18.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.863+0000 7f3a3dce99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:18.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.863+0000 7f3a3dce99c0 20 zonegroup default 2024-09-12T17:27:18.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.863+0000 7f3a3dce99c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:18.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.863+0000 7f3a3dce99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:18.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.863+0000 7f3a3dce99c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:18.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.863+0000 7f3a3dce99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:18.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.863+0000 7f3a3dce99c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:18.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.867+0000 7f3a3dce99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:18.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.867+0000 7f3a3dce99c0 20 started sync module instance, tier type = 2024-09-12T17:27:18.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.867+0000 7f3a3dce99c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:27:18.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.887+0000 7f3a3dce99c0 20 add_watcher() i=0 2024-09-12T17:27:18.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.887+0000 7f3a3dce99c0 20 add_watcher() i=1 2024-09-12T17:27:18.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.887+0000 7f3a3dce99c0 20 add_watcher() i=2 2024-09-12T17:27:18.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.887+0000 7f3a3dce99c0 20 add_watcher() i=3 2024-09-12T17:27:18.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.887+0000 7f3a3dce99c0 20 add_watcher() i=4 2024-09-12T17:27:18.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.887+0000 7f3a3dce99c0 20 add_watcher() i=5 2024-09-12T17:27:18.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.887+0000 7f3a3dce99c0 20 add_watcher() i=6 2024-09-12T17:27:18.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.891+0000 7f3a3dce99c0 20 add_watcher() i=7 2024-09-12T17:27:18.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.891+0000 7f3a3dce99c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:18.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.895+0000 7f38f27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:18.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.895+0000 7f3a3dce99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:18.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.895+0000 7f3a3dce99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:18.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.895+0000 7f3a3dce99c0 5 note: GC not initialized 2024-09-12T17:27:18.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.895+0000 7f38f17e2640 20 reqs_thread_entry: start 2024-09-12T17:27:18.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.895+0000 7f3a3dce99c0 20 init_complete bucket index max shards: 1 2024-09-12T17:27:18.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.895+0000 7f3a3dce99c0 20 Filter name: none 2024-09-12T17:27:18.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.895+0000 7f38ea7fc640 20 reqs_thread_entry: start 2024-09-12T17:27:18.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.895+0000 7f3a3dce99c0 10 cache get: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 : miss 2024-09-12T17:27:18.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.895+0000 7f3a3dce99c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:18.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.895+0000 7f3a3dce99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:18.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.895+0000 7f3a3dce99c0 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x0 2024-09-12T17:27:18.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.895+0000 7f3a3dce99c0 10 adding default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-12T17:27:18.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.895+0000 7f3a3dce99c0 20 failed to read name.testx$Mr.RGW33333333333333333 with: (2) No such file or directory 2024-09-12T17:27:18.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.895+0000 7f3a3dce99c0 10 cache get: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test : miss 2024-09-12T17:27:18.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.895+0000 7f3a3dce99c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:18.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.899+0000 7f3a3dce99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:18.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.899+0000 7f3a3dce99c0 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x0 2024-09-12T17:27:18.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.899+0000 7f3a3dce99c0 10 adding default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-12T17:27:18.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.899+0000 7f3a3dce99c0 20 failed to read rgw33333333333333333+test@test.test with: (2) No such file or directory 2024-09-12T17:27:18.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.899+0000 7f3a3dce99c0 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-12T17:27:18.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.899+0000 7f3a3dce99c0 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-12T17:27:18.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.899+0000 7f3a3dce99c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW33333333333333333, ofs0, ns] 2024-09-12T17:27:18.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.903+0000 7f391effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333631 cookie 93966859399376 notifier 8552 bl.length()=389 2024-09-12T17:27:18.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.903+0000 7f391effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-12T17:27:18.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.903+0000 7f391effd640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-12T17:27:18.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.907+0000 7f3a3dce99c0 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-12T17:27:18.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.907+0000 7f3a3dce99c0 10 moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-12T17:27:18.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.907+0000 7f3a3dce99c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.testx$Mr.RGW33333333333333333, ofs0, ns] 2024-09-12T17:27:18.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.907+0000 7f391e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333623 cookie 93966859407056 notifier 8552 bl.length()=230 2024-09-12T17:27:18.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.907+0000 7f391e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-12T17:27:18.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.907+0000 7f391e7fc640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-12T17:27:18.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.911+0000 7f3a3dce99c0 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-12T17:27:18.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.911+0000 7f3a3dce99c0 10 moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-12T17:27:18.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.911+0000 7f3a3dce99c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw33333333333333333+test@test.test, ofs0, ns] 2024-09-12T17:27:18.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.911+0000 7f391e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333544 cookie 93966859397248 notifier 8552 bl.length()=234 2024-09-12T17:27:18.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.911+0000 7f391e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-12T17:27:18.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.911+0000 7f391e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-12T17:27:18.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.911+0000 7f38f27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:18.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.919+0000 7f3a3dce99c0 20 remove_watcher() i=0 2024-09-12T17:27:18.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.919+0000 7f3a3dce99c0 2 removed watcher, disabling cache 2024-09-12T17:27:18.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.919+0000 7f3a3dce99c0 20 remove_watcher() i=1 2024-09-12T17:27:18.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.923+0000 7f3a3dce99c0 20 remove_watcher() i=2 2024-09-12T17:27:18.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.927+0000 7f3a3dce99c0 20 remove_watcher() i=3 2024-09-12T17:27:18.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.927+0000 7f3a3dce99c0 20 remove_watcher() i=4 2024-09-12T17:27:18.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.931+0000 7f3a3dce99c0 20 remove_watcher() i=5 2024-09-12T17:27:18.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.931+0000 7f3a3dce99c0 20 remove_watcher() i=6 2024-09-12T17:27:18.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:18.931+0000 7f3a3dce99c0 20 remove_watcher() i=7 2024-09-12T17:27:18.949 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-12T17:27:18.949 INFO:teuthology.orchestra.run.smithi016.stdout: "id": "RGW33333333333333333", 2024-09-12T17:27:18.949 INFO:teuthology.orchestra.run.smithi016.stdout: "tenant": "testx", 2024-09-12T17:27:18.949 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "Mr.RGW33333333333333333", 2024-09-12T17:27:18.949 INFO:teuthology.orchestra.run.smithi016.stdout: "email": "RGW33333333333333333+test@test.test", 2024-09-12T17:27:18.949 INFO:teuthology.orchestra.run.smithi016.stdout: "quota": { 2024-09-12T17:27:18.949 INFO:teuthology.orchestra.run.smithi016.stdout: "enabled": false, 2024-09-12T17:27:18.949 INFO:teuthology.orchestra.run.smithi016.stdout: "check_on_raw": false, 2024-09-12T17:27:18.949 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size": -1, 2024-09-12T17:27:18.949 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size_kb": 0, 2024-09-12T17:27:18.949 INFO:teuthology.orchestra.run.smithi016.stdout: "max_objects": -1 2024-09-12T17:27:18.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-12T17:27:18.950 INFO:teuthology.orchestra.run.smithi016.stdout: "bucket_quota": { 2024-09-12T17:27:18.950 INFO:teuthology.orchestra.run.smithi016.stdout: "enabled": false, 2024-09-12T17:27:18.950 INFO:teuthology.orchestra.run.smithi016.stdout: "check_on_raw": false, 2024-09-12T17:27:18.950 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size": -1, 2024-09-12T17:27:18.950 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size_kb": 0, 2024-09-12T17:27:18.950 INFO:teuthology.orchestra.run.smithi016.stdout: "max_objects": -1 2024-09-12T17:27:18.950 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-12T17:27:18.950 INFO:teuthology.orchestra.run.smithi016.stdout: "max_users": 1000, 2024-09-12T17:27:18.950 INFO:teuthology.orchestra.run.smithi016.stdout: "max_roles": 1000, 2024-09-12T17:27:18.950 INFO:teuthology.orchestra.run.smithi016.stdout: "max_groups": 1000, 2024-09-12T17:27:18.950 INFO:teuthology.orchestra.run.smithi016.stdout: "max_buckets": 1000, 2024-09-12T17:27:18.950 INFO:teuthology.orchestra.run.smithi016.stdout: "max_access_keys": 4 2024-09-12T17:27:18.950 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-12T17:27:18.952 DEBUG:tasks.s3tests:Creating user RGW33333333333333333 on client.0 2024-09-12T17:27:18.952 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name Mr.RGW33333333333333333 --email 'testx$tenanteduser+test@test.test' --access-key ARDZTKXCJTNVLZYTYVWN --secret 75QSohjUkFjzHccBwbDI/M1NSiY/V/ajS+w+hzw7eq14qax2taTtMw== --cluster ceph --account-id RGW33333333333333333 --account-root 2024-09-12T17:27:19.038 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:19.038 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:19.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.079+0000 7fe2fc3c49c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:19.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.079+0000 7fe2fc3c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:19.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.079+0000 7fe2fc3c49c0 20 realm 2024-09-12T17:27:19.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.079+0000 7fe2fc3c49c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:19.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.079+0000 7fe2fc3c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:19.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.079+0000 7fe2fc3c49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:19.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.079+0000 7fe2fc3c49c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:19.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.079+0000 7fe2fc3c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:19.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.079+0000 7fe2fc3c49c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:19.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.083+0000 7fe2fc3c49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:19.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.083+0000 7fe2fc3c49c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:19.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.083+0000 7fe2fc3c49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:19.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.083+0000 7fe2fc3c49c0 20 searching for the correct realm 2024-09-12T17:27:19.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.087+0000 7fe2fa6cb640 0 -- 172.21.15.16:0/2550312388 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fe2f004cb30 msgr2=0x7fe2f0017930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:19.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.303+0000 7fe2f96c9640 0 -- 172.21.15.16:0/2550312388 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fe2f40e2920 msgr2=0x7fe2f40d33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:19.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.519+0000 7fe2fc3c49c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:27:19.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.519+0000 7fe2fc3c49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:19.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.519+0000 7fe2fc3c49c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:27:19.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.519+0000 7fe2fc3c49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:19.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.519+0000 7fe2fc3c49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:19.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.519+0000 7fe2fc3c49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:19.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.519+0000 7fe2fc3c49c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:19.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.523+0000 7fe2fc3c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:19.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.523+0000 7fe2fc3c49c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:19.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.523+0000 7fe2fc3c49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:19.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.523+0000 7fe2fc3c49c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:19.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.523+0000 7fe2fc3c49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:19.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.523+0000 7fe2fc3c49c0 20 zone default found 2024-09-12T17:27:19.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.523+0000 7fe2fc3c49c0 4 Realm: () 2024-09-12T17:27:19.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.523+0000 7fe2fc3c49c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:27:19.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.523+0000 7fe2fc3c49c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:27:19.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.523+0000 7fe2fc3c49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:19.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.523+0000 7fe2fc3c49c0 20 zonegroup default 2024-09-12T17:27:19.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.523+0000 7fe2fc3c49c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:19.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.523+0000 7fe2fc3c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:19.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.523+0000 7fe2fc3c49c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:19.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.527+0000 7fe2fc3c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:19.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.527+0000 7fe2fc3c49c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:19.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.527+0000 7fe2fc3c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:19.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.527+0000 7fe2fc3c49c0 20 started sync module instance, tier type = 2024-09-12T17:27:19.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.527+0000 7fe2fc3c49c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:27:19.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.551+0000 7fe2fc3c49c0 20 add_watcher() i=0 2024-09-12T17:27:19.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.551+0000 7fe2fc3c49c0 20 add_watcher() i=1 2024-09-12T17:27:19.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.551+0000 7fe2fc3c49c0 20 add_watcher() i=2 2024-09-12T17:27:19.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.551+0000 7fe2fc3c49c0 20 add_watcher() i=3 2024-09-12T17:27:19.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.551+0000 7fe2fc3c49c0 20 add_watcher() i=4 2024-09-12T17:27:19.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.551+0000 7fe2fc3c49c0 20 add_watcher() i=5 2024-09-12T17:27:19.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.551+0000 7fe2fc3c49c0 20 add_watcher() i=6 2024-09-12T17:27:19.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.551+0000 7fe2fc3c49c0 20 add_watcher() i=7 2024-09-12T17:27:19.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.551+0000 7fe2fc3c49c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:19.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.555+0000 7fe1ab7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:19.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.559+0000 7fe2fc3c49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:19.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.559+0000 7fe2fc3c49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:19.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.559+0000 7fe2fc3c49c0 5 note: GC not initialized 2024-09-12T17:27:19.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.559+0000 7fe1aa7fc640 20 reqs_thread_entry: start 2024-09-12T17:27:19.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.559+0000 7fe2fc3c49c0 20 init_complete bucket index max shards: 1 2024-09-12T17:27:19.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.559+0000 7fe2fc3c49c0 20 Filter name: none 2024-09-12T17:27:19.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.559+0000 7fe11bfff640 20 reqs_thread_entry: start 2024-09-12T17:27:19.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.559+0000 7fe2fc3c49c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T17:27:19.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.559+0000 7fe2fc3c49c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:19.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.559+0000 7fe2fc3c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:19.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.559+0000 7fe2fc3c49c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-09-12T17:27:19.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.559+0000 7fe2fc3c49c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T17:27:19.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.559+0000 7fe2fc3c49c0 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-09-12T17:27:19.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.559+0000 7fe2fc3c49c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:19.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.559+0000 7fe2fc3c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:19.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.559+0000 7fe2fc3c49c0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-09-12T17:27:19.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.559+0000 7fe2fc3c49c0 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T17:27:19.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.559+0000 7fe2fc3c49c0 10 cache get: name=default.rgw.meta+users.keys+ARDZTKXCJTNVLZYTYVWN : miss 2024-09-12T17:27:19.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.559+0000 7fe2fc3c49c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:19.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.559+0000 7fe2fc3c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:19.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.559+0000 7fe2fc3c49c0 10 cache put: name=default.rgw.meta+users.keys+ARDZTKXCJTNVLZYTYVWN info.flags=0x0 2024-09-12T17:27:19.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.559+0000 7fe2fc3c49c0 10 adding default.rgw.meta+users.keys+ARDZTKXCJTNVLZYTYVWN to cache LRU end 2024-09-12T17:27:19.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.563+0000 7fe2fc3c49c0 10 cache get: name=default.rgw.meta+accounts+account.RGW33333333333333333 : miss 2024-09-12T17:27:19.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.563+0000 7fe2fc3c49c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:19.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.563+0000 7fe2fc3c49c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:27:19.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.563+0000 7fe2fc3c49c0 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-12T17:27:19.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.563+0000 7fe2fc3c49c0 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-12T17:27:19.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.563+0000 7fe2fc3c49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:27:19.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.563+0000 7fe2fc3c49c0 10 cache get: name=default.rgw.meta+users.keys+ARDZTKXCJTNVLZYTYVWN : hit (negative entry) 2024-09-12T17:27:19.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.563+0000 7fe2fc3c49c0 10 cache get: name=default.rgw.meta+users.keys+ARDZTKXCJTNVLZYTYVWN : hit (negative entry) 2024-09-12T17:27:19.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.567+0000 7fe2fc3c49c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T17:27:19.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.567+0000 7fe2fc3c49c0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T17:27:19.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.567+0000 7fe2fc3c49c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T17:27:19.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.567+0000 7fe1dd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333582 cookie 94191135063632 notifier 9075 bl.length()=732 2024-09-12T17:27:19.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.567+0000 7fe1dd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T17:27:19.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.567+0000 7fe1dd7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T17:27:19.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.571+0000 7fe2fc3c49c0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T17:27:19.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.571+0000 7fe2fc3c49c0 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T17:27:19.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.571+0000 7fe2fc3c49c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-09-12T17:27:19.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.571+0000 7fe1dcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333551 cookie 94191135072176 notifier 9075 bl.length()=215 2024-09-12T17:27:19.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.571+0000 7fe1dcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T17:27:19.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.571+0000 7fe1dcff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T17:27:19.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.575+0000 7fe2fc3c49c0 10 cache put: name=default.rgw.meta+users.keys+ARDZTKXCJTNVLZYTYVWN info.flags=0x7 2024-09-12T17:27:19.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.575+0000 7fe2fc3c49c0 10 moving default.rgw.meta+users.keys+ARDZTKXCJTNVLZYTYVWN to cache LRU end 2024-09-12T17:27:19.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.575+0000 7fe2fc3c49c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:ARDZTKXCJTNVLZYTYVWN, ofs0, ns] 2024-09-12T17:27:19.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.575+0000 7fe1dd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333552 cookie 94191135072176 notifier 9075 bl.length()=201 2024-09-12T17:27:19.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.575+0000 7fe1dd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ARDZTKXCJTNVLZYTYVWN info.flags=0x7 2024-09-12T17:27:19.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.575+0000 7fe1dd7fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ARDZTKXCJTNVLZYTYVWN to cache LRU end 2024-09-12T17:27:19.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.575+0000 7fe2fc3c49c0 20 linked user testx$tenanteduser.client.0 to account RGW33333333333333333 2024-09-12T17:27:19.581 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-12T17:27:19.581 INFO:teuthology.orchestra.run.smithi016.stdout: "user_id": "testx$tenanteduser.client.0", 2024-09-12T17:27:19.581 INFO:teuthology.orchestra.run.smithi016.stdout: "display_name": "Mr.RGW33333333333333333", 2024-09-12T17:27:19.581 INFO:teuthology.orchestra.run.smithi016.stdout: "email": "testx$tenanteduser+test@test.test", 2024-09-12T17:27:19.581 INFO:teuthology.orchestra.run.smithi016.stdout: "suspended": 0, 2024-09-12T17:27:19.581 INFO:teuthology.orchestra.run.smithi016.stdout: "max_buckets": 1000, 2024-09-12T17:27:19.581 INFO:teuthology.orchestra.run.smithi016.stdout: "subusers": [], 2024-09-12T17:27:19.581 INFO:teuthology.orchestra.run.smithi016.stdout: "keys": [ 2024-09-12T17:27:19.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-12T17:27:19.581 INFO:teuthology.orchestra.run.smithi016.stdout: "user": "testx$tenanteduser.client.0", 2024-09-12T17:27:19.582 INFO:teuthology.orchestra.run.smithi016.stdout: "access_key": "ARDZTKXCJTNVLZYTYVWN", 2024-09-12T17:27:19.582 INFO:teuthology.orchestra.run.smithi016.stdout: "secret_key": "75QSohjUkFjzHccBwbDI/M1NSiY/V/ajS+w+hzw7eq14qax2taTtMw==", 2024-09-12T17:27:19.582 INFO:teuthology.orchestra.run.smithi016.stdout: "active": true, 2024-09-12T17:27:19.582 INFO:teuthology.orchestra.run.smithi016.stdout: "create_date": "2024-09-12T17:27:19.568754Z" 2024-09-12T17:27:19.582 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-12T17:27:19.582 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-12T17:27:19.582 INFO:teuthology.orchestra.run.smithi016.stdout: "swift_keys": [], 2024-09-12T17:27:19.582 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": [], 2024-09-12T17:27:19.582 INFO:teuthology.orchestra.run.smithi016.stdout: "op_mask": "read, write, delete", 2024-09-12T17:27:19.582 INFO:teuthology.orchestra.run.smithi016.stdout: "default_placement": "", 2024-09-12T17:27:19.582 INFO:teuthology.orchestra.run.smithi016.stdout: "default_storage_class": "", 2024-09-12T17:27:19.582 INFO:teuthology.orchestra.run.smithi016.stdout: "placement_tags": [], 2024-09-12T17:27:19.582 INFO:teuthology.orchestra.run.smithi016.stdout: "bucket_quota": { 2024-09-12T17:27:19.582 INFO:teuthology.orchestra.run.smithi016.stdout: "enabled": false, 2024-09-12T17:27:19.583 INFO:teuthology.orchestra.run.smithi016.stdout: "check_on_raw": false, 2024-09-12T17:27:19.583 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size": -1, 2024-09-12T17:27:19.583 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size_kb": 0, 2024-09-12T17:27:19.583 INFO:teuthology.orchestra.run.smithi016.stdout: "max_objects": -1 2024-09-12T17:27:19.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-12T17:27:19.583 INFO:teuthology.orchestra.run.smithi016.stdout: "user_quota": { 2024-09-12T17:27:19.583 INFO:teuthology.orchestra.run.smithi016.stdout: "enabled": false, 2024-09-12T17:27:19.583 INFO:teuthology.orchestra.run.smithi016.stdout: "check_on_raw": false, 2024-09-12T17:27:19.583 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size": -1, 2024-09-12T17:27:19.583 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size_kb": 0, 2024-09-12T17:27:19.583 INFO:teuthology.orchestra.run.smithi016.stdout: "max_objects": -1 2024-09-12T17:27:19.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-12T17:27:19.583 INFO:teuthology.orchestra.run.smithi016.stdout: "temp_url_keys": [], 2024-09-12T17:27:19.584 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "root", 2024-09-12T17:27:19.584 INFO:teuthology.orchestra.run.smithi016.stdout: "mfa_ids": [], 2024-09-12T17:27:19.584 INFO:teuthology.orchestra.run.smithi016.stdout: "account_id": "RGW33333333333333333", 2024-09-12T17:27:19.584 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-12T17:27:19.584 INFO:teuthology.orchestra.run.smithi016.stdout: "create_date": "2024-09-12T17:27:19.568708Z", 2024-09-12T17:27:19.584 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-12T17:27:19.584 INFO:teuthology.orchestra.run.smithi016.stdout: "group_ids": [] 2024-09-12T17:27:19.584 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-12T17:27:19.584 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:19.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.579+0000 7fe1ab7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:19.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.583+0000 7fe2fc3c49c0 20 remove_watcher() i=0 2024-09-12T17:27:19.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.583+0000 7fe2fc3c49c0 2 removed watcher, disabling cache 2024-09-12T17:27:19.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.587+0000 7fe2fc3c49c0 20 remove_watcher() i=1 2024-09-12T17:27:19.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.587+0000 7fe2fc3c49c0 20 remove_watcher() i=2 2024-09-12T17:27:19.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.591+0000 7fe2fc3c49c0 20 remove_watcher() i=3 2024-09-12T17:27:19.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.591+0000 7fe2fc3c49c0 20 remove_watcher() i=4 2024-09-12T17:27:19.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.595+0000 7fe2fc3c49c0 20 remove_watcher() i=5 2024-09-12T17:27:19.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.595+0000 7fe2fc3c49c0 20 remove_watcher() i=6 2024-09-12T17:27:19.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.599+0000 7fe2fc3c49c0 20 remove_watcher() i=7 2024-09-12T17:27:19.621 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 7642604960 --totp-seed PKR5SBUCVO3SCEOKR4LGS7XOTTWKP2YD7P6EHLHAAFRUKEER2N2I6X4GBNULRUFG --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T17:27:19.664 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:19.664 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:19.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.703+0000 7f7c6eca59c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:19.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.707+0000 7f7c6eca59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:19.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.707+0000 7f7c6eca59c0 20 realm 2024-09-12T17:27:19.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.707+0000 7f7c6eca59c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:19.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.707+0000 7f7c6eca59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:19.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.707+0000 7f7c6eca59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:19.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.707+0000 7f7c6eca59c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:19.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.707+0000 7f7c6eca59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:19.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.707+0000 7f7c6eca59c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:19.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.707+0000 7f7c6eca59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:19.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.707+0000 7f7c6eca59c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:19.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.711+0000 7f7c6eca59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:19.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.711+0000 7f7c6eca59c0 20 searching for the correct realm 2024-09-12T17:27:19.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.715+0000 7f7c6cfac640 0 -- 172.21.15.16:0/1498141734 >> [v2:172.21.15.19:6800/1509147557,v1:172.21.15.19:6801/1509147557] conn(0x55720d0d5380 msgr2=0x55720d0d7790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:19.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.719+0000 7f7c6bfaa640 0 -- 172.21.15.16:0/1498141734 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f7c64014ab0 msgr2=0x7f7c64034440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:19.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.939+0000 7f7c6eca59c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:27:19.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.939+0000 7f7c6eca59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:19.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.939+0000 7f7c6eca59c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:27:19.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.939+0000 7f7c6eca59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:19.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.939+0000 7f7c6eca59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:19.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.939+0000 7f7c6eca59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:19.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.939+0000 7f7c6eca59c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:19.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.939+0000 7f7c6eca59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:19.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.939+0000 7f7c6eca59c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:19.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.939+0000 7f7c6eca59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:19.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.939+0000 7f7c6eca59c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:19.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.939+0000 7f7c6eca59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:19.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.939+0000 7f7c6eca59c0 20 zone default found 2024-09-12T17:27:19.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.939+0000 7f7c6eca59c0 4 Realm: () 2024-09-12T17:27:19.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.939+0000 7f7c6eca59c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:27:19.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.939+0000 7f7c6eca59c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:27:19.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.939+0000 7f7c6eca59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:19.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.939+0000 7f7c6eca59c0 20 zonegroup default 2024-09-12T17:27:19.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.939+0000 7f7c6eca59c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:19.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.939+0000 7f7c6eca59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:19.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.943+0000 7f7c6eca59c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:19.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.943+0000 7f7c6eca59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:19.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.943+0000 7f7c6eca59c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:19.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.943+0000 7f7c6eca59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:19.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.943+0000 7f7c6eca59c0 20 started sync module instance, tier type = 2024-09-12T17:27:19.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.943+0000 7f7c6eca59c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:27:19.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.963+0000 7f7c6eca59c0 20 add_watcher() i=0 2024-09-12T17:27:19.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.963+0000 7f7c6eca59c0 20 add_watcher() i=1 2024-09-12T17:27:19.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.963+0000 7f7c6eca59c0 20 add_watcher() i=2 2024-09-12T17:27:19.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.963+0000 7f7c6eca59c0 20 add_watcher() i=3 2024-09-12T17:27:19.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.963+0000 7f7c6eca59c0 20 add_watcher() i=4 2024-09-12T17:27:19.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.963+0000 7f7c6eca59c0 20 add_watcher() i=5 2024-09-12T17:27:19.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.963+0000 7f7c6eca59c0 20 add_watcher() i=6 2024-09-12T17:27:19.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.967+0000 7f7c6eca59c0 20 add_watcher() i=7 2024-09-12T17:27:19.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.967+0000 7f7c6eca59c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:19.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.971+0000 7f7b22fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:19.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.971+0000 7f7c6eca59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:19.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.971+0000 7f7c6eca59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:19.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.971+0000 7f7c6eca59c0 5 note: GC not initialized 2024-09-12T17:27:19.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.971+0000 7f7b21fdb640 20 reqs_thread_entry: start 2024-09-12T17:27:19.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.971+0000 7f7c6eca59c0 20 init_complete bucket index max shards: 1 2024-09-12T17:27:19.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.971+0000 7f7c6eca59c0 20 Filter name: none 2024-09-12T17:27:19.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.971+0000 7f7a937fe640 20 reqs_thread_entry: start 2024-09-12T17:27:19.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.971+0000 7f7c6eca59c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T17:27:19.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.971+0000 7f7c6eca59c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:19.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.975+0000 7f7c6eca59c0 20 rados_obj.operate() r=0 bl.length=532 2024-09-12T17:27:19.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.975+0000 7f7c6eca59c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-09-12T17:27:19.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.975+0000 7f7c6eca59c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T17:27:19.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.975+0000 7f7c6eca59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:27:19.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.979+0000 7f7c6eca59c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T17:27:19.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.979+0000 7f7c6eca59c0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T17:27:19.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.979+0000 7f7c6eca59c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T17:27:19.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.979+0000 7f7b437fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333583 cookie 93948333655056 notifier 8588 bl.length()=746 2024-09-12T17:27:19.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.979+0000 7f7b437fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T17:27:19.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.979+0000 7f7b437fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T17:27:19.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.983+0000 7f7b22fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:19.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.987+0000 7f7c6eca59c0 20 remove_watcher() i=0 2024-09-12T17:27:19.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.987+0000 7f7c6eca59c0 2 removed watcher, disabling cache 2024-09-12T17:27:19.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.991+0000 7f7c6eca59c0 20 remove_watcher() i=1 2024-09-12T17:27:19.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.991+0000 7f7c6eca59c0 20 remove_watcher() i=2 2024-09-12T17:27:19.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.995+0000 7f7c6eca59c0 20 remove_watcher() i=3 2024-09-12T17:27:20.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.995+0000 7f7c6eca59c0 20 remove_watcher() i=4 2024-09-12T17:27:20.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.999+0000 7f7c6eca59c0 20 remove_watcher() i=5 2024-09-12T17:27:20.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:19.999+0000 7f7c6eca59c0 20 remove_watcher() i=6 2024-09-12T17:27:20.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.003+0000 7f7c6eca59c0 20 remove_watcher() i=7 2024-09-12T17:27:20.023 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-09-12T17:27:20.023 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key NDRXVNIQBZWHZOEWDOUB --secret gmay/HJCN+O5mTOqjuJ6u/r7UULH206IHoVKkvK9C98PMgD06nrcmA== --cluster ceph 2024-09-12T17:27:20.111 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:20.112 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:20.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.151+0000 7fd1ed3d89c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:20.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.155+0000 7fd1ed3d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:20.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.155+0000 7fd1ed3d89c0 20 realm 2024-09-12T17:27:20.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.155+0000 7fd1ed3d89c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:20.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.155+0000 7fd1ed3d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:20.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.155+0000 7fd1ed3d89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:20.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.155+0000 7fd1ed3d89c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:20.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.155+0000 7fd1ed3d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:20.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.155+0000 7fd1ed3d89c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:20.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.155+0000 7fd1ed3d89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:20.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.155+0000 7fd1ed3d89c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:20.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.159+0000 7fd1ed3d89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:20.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.159+0000 7fd1ed3d89c0 20 searching for the correct realm 2024-09-12T17:27:20.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.363+0000 7fd1eb6df640 0 -- 172.21.15.16:0/1645101383 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fd1e00ca020 msgr2=0x7fd1e0100ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:20.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.575+0000 7fd1ea6dd640 0 -- 172.21.15.16:0/1645101383 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7fd0b4081660 msgr2=0x7fd0b4083a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:20.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.595+0000 7fd1ed3d89c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:27:20.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.595+0000 7fd1ed3d89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:20.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.595+0000 7fd1ed3d89c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:27:20.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.595+0000 7fd1ed3d89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:20.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.595+0000 7fd1ed3d89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:20.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.595+0000 7fd1ed3d89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:20.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.595+0000 7fd1ed3d89c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:20.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.595+0000 7fd1ed3d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:20.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.595+0000 7fd1ed3d89c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:20.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.595+0000 7fd1ed3d89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:20.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.595+0000 7fd1ed3d89c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:20.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.599+0000 7fd1ed3d89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:20.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.599+0000 7fd1ed3d89c0 20 zone default found 2024-09-12T17:27:20.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.599+0000 7fd1ed3d89c0 4 Realm: () 2024-09-12T17:27:20.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.599+0000 7fd1ed3d89c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:27:20.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.599+0000 7fd1ed3d89c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:27:20.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.599+0000 7fd1ed3d89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:20.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.599+0000 7fd1ed3d89c0 20 zonegroup default 2024-09-12T17:27:20.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.599+0000 7fd1ed3d89c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:20.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.599+0000 7fd1ed3d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:20.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.599+0000 7fd1ed3d89c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:20.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.599+0000 7fd1ed3d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:20.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.599+0000 7fd1ed3d89c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:20.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.599+0000 7fd1ed3d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:20.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.599+0000 7fd1ed3d89c0 20 started sync module instance, tier type = 2024-09-12T17:27:20.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.599+0000 7fd1ed3d89c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:27:20.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.623+0000 7fd1ed3d89c0 20 add_watcher() i=0 2024-09-12T17:27:20.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.623+0000 7fd1ed3d89c0 20 add_watcher() i=1 2024-09-12T17:27:20.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.623+0000 7fd1ed3d89c0 20 add_watcher() i=2 2024-09-12T17:27:20.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.623+0000 7fd1ed3d89c0 20 add_watcher() i=3 2024-09-12T17:27:20.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.623+0000 7fd1ed3d89c0 20 add_watcher() i=4 2024-09-12T17:27:20.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.623+0000 7fd1ed3d89c0 20 add_watcher() i=5 2024-09-12T17:27:20.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.623+0000 7fd1ed3d89c0 20 add_watcher() i=6 2024-09-12T17:27:20.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.627+0000 7fd1ed3d89c0 20 add_watcher() i=7 2024-09-12T17:27:20.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.627+0000 7fd1ed3d89c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:20.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.631+0000 7fd0a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:20.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.631+0000 7fd1ed3d89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:20.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.631+0000 7fd1ed3d89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:20.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.631+0000 7fd1ed3d89c0 5 note: GC not initialized 2024-09-12T17:27:20.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.631+0000 7fd01bfff640 20 reqs_thread_entry: start 2024-09-12T17:27:20.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.631+0000 7fd1ed3d89c0 20 init_complete bucket index max shards: 1 2024-09-12T17:27:20.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.631+0000 7fd1ed3d89c0 20 Filter name: none 2024-09-12T17:27:20.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.631+0000 7fd019ffb640 20 reqs_thread_entry: start 2024-09-12T17:27:20.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.631+0000 7fd1ed3d89c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T17:27:20.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.631+0000 7fd1ed3d89c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:20.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.635+0000 7fd1ed3d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:20.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.635+0000 7fd1ed3d89c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-09-12T17:27:20.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.635+0000 7fd1ed3d89c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:27:20.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.635+0000 7fd1ed3d89c0 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-09-12T17:27:20.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.635+0000 7fd1ed3d89c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:20.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.635+0000 7fd1ed3d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:20.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.635+0000 7fd1ed3d89c0 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-09-12T17:27:20.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.635+0000 7fd1ed3d89c0 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T17:27:20.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.635+0000 7fd1ed3d89c0 10 cache get: name=default.rgw.meta+users.keys+NDRXVNIQBZWHZOEWDOUB : miss 2024-09-12T17:27:20.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.635+0000 7fd1ed3d89c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:20.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.635+0000 7fd1ed3d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:20.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.635+0000 7fd1ed3d89c0 10 cache put: name=default.rgw.meta+users.keys+NDRXVNIQBZWHZOEWDOUB info.flags=0x0 2024-09-12T17:27:20.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.635+0000 7fd1ed3d89c0 10 adding default.rgw.meta+users.keys+NDRXVNIQBZWHZOEWDOUB to cache LRU end 2024-09-12T17:27:20.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.635+0000 7fd1ed3d89c0 10 cache get: name=default.rgw.meta+users.keys+NDRXVNIQBZWHZOEWDOUB : hit (negative entry) 2024-09-12T17:27:20.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.635+0000 7fd1ed3d89c0 10 cache get: name=default.rgw.meta+users.keys+NDRXVNIQBZWHZOEWDOUB : hit (negative entry) 2024-09-12T17:27:20.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.639+0000 7fd1ed3d89c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T17:27:20.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.639+0000 7fd1ed3d89c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:27:20.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.639+0000 7fd1ed3d89c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T17:27:20.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.639+0000 7fd0cdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333553 cookie 93985110940704 notifier 9114 bl.length()=660 2024-09-12T17:27:20.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.639+0000 7fd0cdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T17:27:20.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.639+0000 7fd0cdffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:27:20.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.643+0000 7fd1ed3d89c0 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T17:27:20.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.643+0000 7fd1ed3d89c0 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T17:27:20.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.643+0000 7fd1ed3d89c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-09-12T17:27:20.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.643+0000 7fd0cdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333632 cookie 93985110916416 notifier 9114 bl.length()=191 2024-09-12T17:27:20.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.643+0000 7fd0cdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T17:27:20.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.643+0000 7fd0cdffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T17:27:20.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.647+0000 7fd1ed3d89c0 10 cache put: name=default.rgw.meta+users.keys+NDRXVNIQBZWHZOEWDOUB info.flags=0x7 2024-09-12T17:27:20.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.647+0000 7fd1ed3d89c0 10 moving default.rgw.meta+users.keys+NDRXVNIQBZWHZOEWDOUB to cache LRU end 2024-09-12T17:27:20.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.647+0000 7fd1ed3d89c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:NDRXVNIQBZWHZOEWDOUB, ofs0, ns] 2024-09-12T17:27:20.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.647+0000 7fd0ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333584 cookie 93985110937104 notifier 9114 bl.length()=189 2024-09-12T17:27:20.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.647+0000 7fd0ce7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NDRXVNIQBZWHZOEWDOUB info.flags=0x7 2024-09-12T17:27:20.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.647+0000 7fd0ce7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NDRXVNIQBZWHZOEWDOUB to cache LRU end 2024-09-12T17:27:20.651 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-12T17:27:20.651 INFO:teuthology.orchestra.run.smithi016.stdout: "user_id": "foobar.client.0", 2024-09-12T17:27:20.651 INFO:teuthology.orchestra.run.smithi016.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T17:27:20.651 INFO:teuthology.orchestra.run.smithi016.stdout: "email": "foobar+test@test.test", 2024-09-12T17:27:20.652 INFO:teuthology.orchestra.run.smithi016.stdout: "suspended": 0, 2024-09-12T17:27:20.652 INFO:teuthology.orchestra.run.smithi016.stdout: "max_buckets": 1000, 2024-09-12T17:27:20.652 INFO:teuthology.orchestra.run.smithi016.stdout: "subusers": [], 2024-09-12T17:27:20.652 INFO:teuthology.orchestra.run.smithi016.stdout: "keys": [ 2024-09-12T17:27:20.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-12T17:27:20.652 INFO:teuthology.orchestra.run.smithi016.stdout: "user": "foobar.client.0", 2024-09-12T17:27:20.652 INFO:teuthology.orchestra.run.smithi016.stdout: "access_key": "NDRXVNIQBZWHZOEWDOUB", 2024-09-12T17:27:20.652 INFO:teuthology.orchestra.run.smithi016.stdout: "secret_key": "gmay/HJCN+O5mTOqjuJ6u/r7UULH206IHoVKkvK9C98PMgD06nrcmA==", 2024-09-12T17:27:20.652 INFO:teuthology.orchestra.run.smithi016.stdout: "active": true, 2024-09-12T17:27:20.652 INFO:teuthology.orchestra.run.smithi016.stdout: "create_date": "2024-09-12T17:27:20.640720Z" 2024-09-12T17:27:20.652 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-12T17:27:20.653 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-12T17:27:20.653 INFO:teuthology.orchestra.run.smithi016.stdout: "swift_keys": [], 2024-09-12T17:27:20.653 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": [], 2024-09-12T17:27:20.653 INFO:teuthology.orchestra.run.smithi016.stdout: "op_mask": "read, write, delete", 2024-09-12T17:27:20.654 INFO:teuthology.orchestra.run.smithi016.stdout: "default_placement": "", 2024-09-12T17:27:20.654 INFO:teuthology.orchestra.run.smithi016.stdout: "default_storage_class": "", 2024-09-12T17:27:20.654 INFO:teuthology.orchestra.run.smithi016.stdout: "placement_tags": [], 2024-09-12T17:27:20.654 INFO:teuthology.orchestra.run.smithi016.stdout: "bucket_quota": { 2024-09-12T17:27:20.654 INFO:teuthology.orchestra.run.smithi016.stdout: "enabled": false, 2024-09-12T17:27:20.654 INFO:teuthology.orchestra.run.smithi016.stdout: "check_on_raw": false, 2024-09-12T17:27:20.654 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size": -1, 2024-09-12T17:27:20.654 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size_kb": 0, 2024-09-12T17:27:20.654 INFO:teuthology.orchestra.run.smithi016.stdout: "max_objects": -1 2024-09-12T17:27:20.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-12T17:27:20.655 INFO:teuthology.orchestra.run.smithi016.stdout: "user_quota": { 2024-09-12T17:27:20.655 INFO:teuthology.orchestra.run.smithi016.stdout: "enabled": false, 2024-09-12T17:27:20.655 INFO:teuthology.orchestra.run.smithi016.stdout: "check_on_raw": false, 2024-09-12T17:27:20.655 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size": -1, 2024-09-12T17:27:20.655 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size_kb": 0, 2024-09-12T17:27:20.655 INFO:teuthology.orchestra.run.smithi016.stdout: "max_objects": -1 2024-09-12T17:27:20.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-12T17:27:20.655 INFO:teuthology.orchestra.run.smithi016.stdout: "temp_url_keys": [], 2024-09-12T17:27:20.655 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "rgw", 2024-09-12T17:27:20.655 INFO:teuthology.orchestra.run.smithi016.stdout: "mfa_ids": [], 2024-09-12T17:27:20.655 INFO:teuthology.orchestra.run.smithi016.stdout: "account_id": "", 2024-09-12T17:27:20.655 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-12T17:27:20.655 INFO:teuthology.orchestra.run.smithi016.stdout: "create_date": "2024-09-12T17:27:20.640680Z", 2024-09-12T17:27:20.655 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-12T17:27:20.656 INFO:teuthology.orchestra.run.smithi016.stdout: "group_ids": [] 2024-09-12T17:27:20.656 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-12T17:27:20.656 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:20.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.647+0000 7fd0a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:20.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.655+0000 7fd1ed3d89c0 20 remove_watcher() i=0 2024-09-12T17:27:20.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.655+0000 7fd1ed3d89c0 2 removed watcher, disabling cache 2024-09-12T17:27:20.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.659+0000 7fd1ed3d89c0 20 remove_watcher() i=1 2024-09-12T17:27:20.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.659+0000 7fd1ed3d89c0 20 remove_watcher() i=2 2024-09-12T17:27:20.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.663+0000 7fd1ed3d89c0 20 remove_watcher() i=3 2024-09-12T17:27:20.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.667+0000 7fd1ed3d89c0 20 remove_watcher() i=4 2024-09-12T17:27:20.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.667+0000 7fd1ed3d89c0 20 remove_watcher() i=5 2024-09-12T17:27:20.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.671+0000 7fd1ed3d89c0 20 remove_watcher() i=6 2024-09-12T17:27:20.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.671+0000 7fd1ed3d89c0 20 remove_watcher() i=7 2024-09-12T17:27:20.692 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 8431519255 --totp-seed P266QSYGQNJLO2FPS64TRGZKKK23INDIF534PFUEY6566VQY2CP5XI3EWIACX6HW --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T17:27:20.738 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:20.738 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:20.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.775+0000 7fa6542db9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:20.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.779+0000 7fa6542db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:20.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.779+0000 7fa6542db9c0 20 realm 2024-09-12T17:27:20.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.779+0000 7fa6542db9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:20.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.779+0000 7fa6542db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:20.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.779+0000 7fa6542db9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:20.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.779+0000 7fa6542db9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:20.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.779+0000 7fa6542db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:20.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.779+0000 7fa6542db9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:20.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.779+0000 7fa6542db9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:20.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.779+0000 7fa6542db9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:20.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.783+0000 7fa6542db9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:20.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.783+0000 7fa6542db9c0 20 searching for the correct realm 2024-09-12T17:27:20.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.787+0000 7fa6525e2640 0 -- 172.21.15.16:0/98564529 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fa63c008030 msgr2=0x7fa63c064d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:20.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:20.795+0000 7fa64bfff640 0 -- 172.21.15.16:0/98564529 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fa64c019040 msgr2=0x7fa64c0194a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:27:21.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.011+0000 7fa6542db9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:27:21.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.011+0000 7fa6542db9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:21.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.011+0000 7fa6542db9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:27:21.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.011+0000 7fa6542db9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:21.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.011+0000 7fa6542db9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:21.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.011+0000 7fa6542db9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:21.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.011+0000 7fa6542db9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:21.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.011+0000 7fa6542db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:21.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.011+0000 7fa6542db9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:21.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.015+0000 7fa6542db9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:21.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.015+0000 7fa6542db9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:21.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.015+0000 7fa6542db9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:21.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.015+0000 7fa6542db9c0 20 zone default found 2024-09-12T17:27:21.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.015+0000 7fa6542db9c0 4 Realm: () 2024-09-12T17:27:21.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.015+0000 7fa6542db9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:27:21.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.015+0000 7fa6542db9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:27:21.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.015+0000 7fa6542db9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:21.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.015+0000 7fa6542db9c0 20 zonegroup default 2024-09-12T17:27:21.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.015+0000 7fa6542db9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:21.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.015+0000 7fa6542db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:21.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.015+0000 7fa6542db9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:21.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.015+0000 7fa6542db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:21.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.015+0000 7fa6542db9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:21.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.019+0000 7fa6542db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:21.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.019+0000 7fa6542db9c0 20 started sync module instance, tier type = 2024-09-12T17:27:21.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.019+0000 7fa6542db9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:27:21.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.039+0000 7fa6542db9c0 20 add_watcher() i=0 2024-09-12T17:27:21.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.039+0000 7fa6542db9c0 20 add_watcher() i=1 2024-09-12T17:27:21.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.039+0000 7fa6542db9c0 20 add_watcher() i=2 2024-09-12T17:27:21.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.039+0000 7fa6542db9c0 20 add_watcher() i=3 2024-09-12T17:27:21.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.039+0000 7fa6542db9c0 20 add_watcher() i=4 2024-09-12T17:27:21.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.039+0000 7fa6542db9c0 20 add_watcher() i=5 2024-09-12T17:27:21.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.039+0000 7fa6542db9c0 20 add_watcher() i=6 2024-09-12T17:27:21.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.043+0000 7fa6542db9c0 20 add_watcher() i=7 2024-09-12T17:27:21.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.043+0000 7fa6542db9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:21.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.047+0000 7fa507fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:21.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.047+0000 7fa6542db9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:21.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.047+0000 7fa6542db9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:21.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.047+0000 7fa6542db9c0 5 note: GC not initialized 2024-09-12T17:27:21.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.047+0000 7fa506fe5640 20 reqs_thread_entry: start 2024-09-12T17:27:21.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.047+0000 7fa6542db9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:27:21.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.047+0000 7fa6542db9c0 20 Filter name: none 2024-09-12T17:27:21.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.047+0000 7fa504fe1640 20 reqs_thread_entry: start 2024-09-12T17:27:21.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.047+0000 7fa6542db9c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T17:27:21.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.047+0000 7fa6542db9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:21.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.047+0000 7fa6542db9c0 20 rados_obj.operate() r=0 bl.length=472 2024-09-12T17:27:21.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.047+0000 7fa6542db9c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T17:27:21.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.047+0000 7fa6542db9c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:27:21.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.047+0000 7fa6542db9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:27:21.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.051+0000 7fa6542db9c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T17:27:21.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.051+0000 7fa6542db9c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:27:21.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.051+0000 7fa6542db9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T17:27:21.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.051+0000 7fa5357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333554 cookie 93950602836048 notifier 8624 bl.length()=674 2024-09-12T17:27:21.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.051+0000 7fa5357fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T17:27:21.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.051+0000 7fa5357fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:27:21.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.055+0000 7fa507fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:21.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.059+0000 7fa6542db9c0 20 remove_watcher() i=0 2024-09-12T17:27:21.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.059+0000 7fa6542db9c0 2 removed watcher, disabling cache 2024-09-12T17:27:21.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.063+0000 7fa6542db9c0 20 remove_watcher() i=1 2024-09-12T17:27:21.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.063+0000 7fa6542db9c0 20 remove_watcher() i=2 2024-09-12T17:27:21.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.067+0000 7fa6542db9c0 20 remove_watcher() i=3 2024-09-12T17:27:21.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.071+0000 7fa6542db9c0 20 remove_watcher() i=4 2024-09-12T17:27:21.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.071+0000 7fa6542db9c0 20 remove_watcher() i=5 2024-09-12T17:27:21.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.071+0000 7fa6542db9c0 20 remove_watcher() i=6 2024-09-12T17:27:21.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.075+0000 7fa6542db9c0 20 remove_watcher() i=7 2024-09-12T17:27:21.094 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-09-12T17:27:21.175 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:21.175 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:21.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.215+0000 7fccc5e229c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:21.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.219+0000 7fccc5e229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:21.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.219+0000 7fccc5e229c0 20 realm 2024-09-12T17:27:21.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.219+0000 7fccc5e229c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:21.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.219+0000 7fccc5e229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:21.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.219+0000 7fccc5e229c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:21.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.219+0000 7fccc5e229c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:21.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.219+0000 7fccc5e229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:21.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.219+0000 7fccc5e229c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:21.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.219+0000 7fccc5e229c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:21.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.219+0000 7fccc5e229c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:21.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.223+0000 7fccc5e229c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:21.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.223+0000 7fccc5e229c0 20 searching for the correct realm 2024-09-12T17:27:21.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.223+0000 7fccc4129640 0 -- 172.21.15.16:0/1367328009 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fccac018040 msgr2=0x7fccac036990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:21.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.439+0000 7fccc3127640 0 -- 172.21.15.16:0/1367328009 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fccb4112020 msgr2=0x7fccb4114c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:27:21.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.659+0000 7fccc5e229c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:27:21.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.659+0000 7fccc5e229c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:21.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.659+0000 7fccc5e229c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:27:21.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.659+0000 7fccc5e229c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:21.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.659+0000 7fccc5e229c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:21.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.659+0000 7fccc5e229c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:21.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.659+0000 7fccc5e229c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:21.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.659+0000 7fccc5e229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:21.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.659+0000 7fccc5e229c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:21.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.659+0000 7fccc5e229c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:21.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.659+0000 7fccc5e229c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:21.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.663+0000 7fccc5e229c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:21.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.663+0000 7fccc5e229c0 20 zone default found 2024-09-12T17:27:21.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.663+0000 7fccc5e229c0 4 Realm: () 2024-09-12T17:27:21.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.663+0000 7fccc5e229c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:27:21.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.663+0000 7fccc5e229c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:27:21.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.663+0000 7fccc5e229c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:21.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.663+0000 7fccc5e229c0 20 zonegroup default 2024-09-12T17:27:21.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.663+0000 7fccc5e229c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:21.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.663+0000 7fccc5e229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:21.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.663+0000 7fccc5e229c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:21.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.663+0000 7fccc5e229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:21.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.663+0000 7fccc5e229c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:21.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.663+0000 7fccc5e229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:21.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.663+0000 7fccc5e229c0 20 started sync module instance, tier type = 2024-09-12T17:27:21.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.663+0000 7fccc5e229c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:27:21.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.687+0000 7fccc5e229c0 20 add_watcher() i=0 2024-09-12T17:27:21.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.687+0000 7fccc5e229c0 20 add_watcher() i=1 2024-09-12T17:27:21.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.687+0000 7fccc5e229c0 20 add_watcher() i=2 2024-09-12T17:27:21.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.687+0000 7fccc5e229c0 20 add_watcher() i=3 2024-09-12T17:27:21.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.687+0000 7fccc5e229c0 20 add_watcher() i=4 2024-09-12T17:27:21.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.687+0000 7fccc5e229c0 20 add_watcher() i=5 2024-09-12T17:27:21.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.687+0000 7fccc5e229c0 20 add_watcher() i=6 2024-09-12T17:27:21.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.691+0000 7fccc5e229c0 20 add_watcher() i=7 2024-09-12T17:27:21.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.691+0000 7fccc5e229c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:21.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.695+0000 7fcb79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:21.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.695+0000 7fccc5e229c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:21.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.695+0000 7fccc5e229c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:21.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.695+0000 7fccc5e229c0 5 note: GC not initialized 2024-09-12T17:27:21.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.695+0000 7fcb78fe1640 20 reqs_thread_entry: start 2024-09-12T17:27:21.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.699+0000 7fccc5e229c0 20 init_complete bucket index max shards: 1 2024-09-12T17:27:21.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.699+0000 7fccc5e229c0 20 Filter name: none 2024-09-12T17:27:21.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.699+0000 7fcaf27fc640 20 reqs_thread_entry: start 2024-09-12T17:27:21.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.699+0000 7fccc5e229c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T17:27:21.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.699+0000 7fccc5e229c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:21.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.699+0000 7fccc5e229c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T17:27:21.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.699+0000 7fccc5e229c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T17:27:21.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.699+0000 7fccc5e229c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:27:21.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.699+0000 7fccc5e229c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:27:21.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.699+0000 7fccc5e229c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T17:27:21.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.699+0000 7fccc5e229c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:27:21.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.699+0000 7fccc5e229c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T17:27:21.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.703+0000 7fcba2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333555 cookie 94203214212192 notifier 8639 bl.length()=727 2024-09-12T17:27:21.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.703+0000 7fcba2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T17:27:21.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.703+0000 7fcba2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:27:21.706 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-12T17:27:21.706 INFO:teuthology.orchestra.run.smithi016.stdout: "user_id": "foobar.client.0", 2024-09-12T17:27:21.706 INFO:teuthology.orchestra.run.smithi016.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T17:27:21.706 INFO:teuthology.orchestra.run.smithi016.stdout: "email": "foobar+test@test.test", 2024-09-12T17:27:21.706 INFO:teuthology.orchestra.run.smithi016.stdout: "suspended": 0, 2024-09-12T17:27:21.706 INFO:teuthology.orchestra.run.smithi016.stdout: "max_buckets": 1000, 2024-09-12T17:27:21.706 INFO:teuthology.orchestra.run.smithi016.stdout: "subusers": [], 2024-09-12T17:27:21.706 INFO:teuthology.orchestra.run.smithi016.stdout: "keys": [ 2024-09-12T17:27:21.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-12T17:27:21.706 INFO:teuthology.orchestra.run.smithi016.stdout: "user": "foobar.client.0", 2024-09-12T17:27:21.706 INFO:teuthology.orchestra.run.smithi016.stdout: "access_key": "NDRXVNIQBZWHZOEWDOUB", 2024-09-12T17:27:21.706 INFO:teuthology.orchestra.run.smithi016.stdout: "secret_key": "gmay/HJCN+O5mTOqjuJ6u/r7UULH206IHoVKkvK9C98PMgD06nrcmA==", 2024-09-12T17:27:21.707 INFO:teuthology.orchestra.run.smithi016.stdout: "active": true, 2024-09-12T17:27:21.707 INFO:teuthology.orchestra.run.smithi016.stdout: "create_date": "2024-09-12T17:27:20.640720Z" 2024-09-12T17:27:21.707 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-12T17:27:21.707 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-12T17:27:21.707 INFO:teuthology.orchestra.run.smithi016.stdout: "swift_keys": [], 2024-09-12T17:27:21.707 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": [ 2024-09-12T17:27:21.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-12T17:27:21.707 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "oidc-provider", 2024-09-12T17:27:21.707 INFO:teuthology.orchestra.run.smithi016.stdout: "perm": "*" 2024-09-12T17:27:21.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-12T17:27:21.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-12T17:27:21.708 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "roles", 2024-09-12T17:27:21.708 INFO:teuthology.orchestra.run.smithi016.stdout: "perm": "*" 2024-09-12T17:27:21.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-12T17:27:21.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-12T17:27:21.708 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "user-policy", 2024-09-12T17:27:21.708 INFO:teuthology.orchestra.run.smithi016.stdout: "perm": "*" 2024-09-12T17:27:21.708 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-12T17:27:21.708 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-12T17:27:21.708 INFO:teuthology.orchestra.run.smithi016.stdout: "op_mask": "read, write, delete", 2024-09-12T17:27:21.708 INFO:teuthology.orchestra.run.smithi016.stdout: "default_placement": "", 2024-09-12T17:27:21.708 INFO:teuthology.orchestra.run.smithi016.stdout: "default_storage_class": "", 2024-09-12T17:27:21.708 INFO:teuthology.orchestra.run.smithi016.stdout: "placement_tags": [], 2024-09-12T17:27:21.709 INFO:teuthology.orchestra.run.smithi016.stdout: "bucket_quota": { 2024-09-12T17:27:21.709 INFO:teuthology.orchestra.run.smithi016.stdout: "enabled": false, 2024-09-12T17:27:21.709 INFO:teuthology.orchestra.run.smithi016.stdout: "check_on_raw": false, 2024-09-12T17:27:21.709 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size": -1, 2024-09-12T17:27:21.709 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size_kb": 0, 2024-09-12T17:27:21.709 INFO:teuthology.orchestra.run.smithi016.stdout: "max_objects": -1 2024-09-12T17:27:21.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-12T17:27:21.709 INFO:teuthology.orchestra.run.smithi016.stdout: "user_quota": { 2024-09-12T17:27:21.709 INFO:teuthology.orchestra.run.smithi016.stdout: "enabled": false, 2024-09-12T17:27:21.709 INFO:teuthology.orchestra.run.smithi016.stdout: "check_on_raw": false, 2024-09-12T17:27:21.709 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size": -1, 2024-09-12T17:27:21.709 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size_kb": 0, 2024-09-12T17:27:21.710 INFO:teuthology.orchestra.run.smithi016.stdout: "max_objects": -1 2024-09-12T17:27:21.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-12T17:27:21.710 INFO:teuthology.orchestra.run.smithi016.stdout: "temp_url_keys": [], 2024-09-12T17:27:21.710 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "rgw", 2024-09-12T17:27:21.710 INFO:teuthology.orchestra.run.smithi016.stdout: "mfa_ids": [ 2024-09-12T17:27:21.710 INFO:teuthology.orchestra.run.smithi016.stdout: "8431519255" 2024-09-12T17:27:21.710 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-12T17:27:21.710 INFO:teuthology.orchestra.run.smithi016.stdout: "account_id": "", 2024-09-12T17:27:21.710 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-12T17:27:21.710 INFO:teuthology.orchestra.run.smithi016.stdout: "create_date": "2024-09-12T17:27:20.640680Z", 2024-09-12T17:27:21.710 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-12T17:27:21.710 INFO:teuthology.orchestra.run.smithi016.stdout: "group_ids": [] 2024-09-12T17:27:21.710 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-12T17:27:21.711 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:21.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.703+0000 7fcb79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:21.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.707+0000 7fccc5e229c0 20 remove_watcher() i=0 2024-09-12T17:27:21.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.707+0000 7fccc5e229c0 2 removed watcher, disabling cache 2024-09-12T17:27:21.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.711+0000 7fccc5e229c0 20 remove_watcher() i=1 2024-09-12T17:27:21.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.715+0000 7fccc5e229c0 20 remove_watcher() i=2 2024-09-12T17:27:21.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.715+0000 7fccc5e229c0 20 remove_watcher() i=3 2024-09-12T17:27:21.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.719+0000 7fccc5e229c0 20 remove_watcher() i=4 2024-09-12T17:27:21.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.719+0000 7fccc5e229c0 20 remove_watcher() i=5 2024-09-12T17:27:21.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.723+0000 7fccc5e229c0 20 remove_watcher() i=6 2024-09-12T17:27:21.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.723+0000 7fccc5e229c0 20 remove_watcher() i=7 2024-09-12T17:27:21.743 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name Mr.RGW88888888888888888 --email RGW88888888888888888+test@test.test 2024-09-12T17:27:21.825 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:21.825 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:21.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.867+0000 7f74c3f549c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:21.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.867+0000 7f74c3f549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:21.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.867+0000 7f74c3f549c0 20 realm 2024-09-12T17:27:21.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.867+0000 7f74c3f549c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:21.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.867+0000 7f74c3f549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:21.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.867+0000 7f74c3f549c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:21.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.867+0000 7f74c3f549c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:21.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.867+0000 7f74c3f549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:21.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.867+0000 7f74c3f549c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:21.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.871+0000 7f74c3f549c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:21.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.871+0000 7f74c3f549c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:21.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.871+0000 7f74c3f549c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:21.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.871+0000 7f74c3f549c0 20 searching for the correct realm 2024-09-12T17:27:21.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:21.871+0000 7f74c1259640 0 -- 172.21.15.16:0/506844191 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7f74b4033040 msgr2=0x7f74b4018920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:27:22.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.087+0000 7f74c225b640 0 -- 172.21.15.16:0/506844191 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f74b8109040 msgr2=0x7f74b80f51e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:22.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.103+0000 7f74c3f549c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:27:22.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.103+0000 7f74c3f549c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:22.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.103+0000 7f74c3f549c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:27:22.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.103+0000 7f74c3f549c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:22.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.103+0000 7f74c3f549c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:22.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.103+0000 7f74c3f549c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:22.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.103+0000 7f74c3f549c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:22.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.103+0000 7f74c3f549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:22.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.103+0000 7f74c3f549c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:22.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.107+0000 7f74c3f549c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:22.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.107+0000 7f74c3f549c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:22.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.107+0000 7f74c3f549c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:22.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.107+0000 7f74c3f549c0 20 zone default found 2024-09-12T17:27:22.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.107+0000 7f74c3f549c0 4 Realm: () 2024-09-12T17:27:22.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.107+0000 7f74c3f549c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:27:22.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.107+0000 7f74c3f549c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:27:22.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.107+0000 7f74c3f549c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:22.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.107+0000 7f74c3f549c0 20 zonegroup default 2024-09-12T17:27:22.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.107+0000 7f74c3f549c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:22.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.107+0000 7f74c3f549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:22.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.107+0000 7f74c3f549c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:22.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.107+0000 7f74c3f549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:22.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.107+0000 7f74c3f549c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:22.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.107+0000 7f74c3f549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:22.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.107+0000 7f74c3f549c0 20 started sync module instance, tier type = 2024-09-12T17:27:22.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.107+0000 7f74c3f549c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:27:22.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.131+0000 7f74c3f549c0 20 add_watcher() i=0 2024-09-12T17:27:22.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.131+0000 7f74c3f549c0 20 add_watcher() i=1 2024-09-12T17:27:22.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.131+0000 7f74c3f549c0 20 add_watcher() i=2 2024-09-12T17:27:22.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.131+0000 7f74c3f549c0 20 add_watcher() i=3 2024-09-12T17:27:22.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.131+0000 7f74c3f549c0 20 add_watcher() i=4 2024-09-12T17:27:22.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.131+0000 7f74c3f549c0 20 add_watcher() i=5 2024-09-12T17:27:22.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.131+0000 7f74c3f549c0 20 add_watcher() i=6 2024-09-12T17:27:22.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.135+0000 7f74c3f549c0 20 add_watcher() i=7 2024-09-12T17:27:22.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.135+0000 7f74c3f549c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:22.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.139+0000 7f73737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:22.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.139+0000 7f74c3f549c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:22.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.139+0000 7f74c3f549c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:22.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.139+0000 7f74c3f549c0 5 note: GC not initialized 2024-09-12T17:27:22.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.139+0000 7f73727fc640 20 reqs_thread_entry: start 2024-09-12T17:27:22.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.139+0000 7f74c3f549c0 20 init_complete bucket index max shards: 1 2024-09-12T17:27:22.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.139+0000 7f74c3f549c0 20 Filter name: none 2024-09-12T17:27:22.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.143+0000 7f72e3fff640 20 reqs_thread_entry: start 2024-09-12T17:27:22.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.143+0000 7f74c3f549c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 : miss 2024-09-12T17:27:22.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.143+0000 7f74c3f549c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:22.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.143+0000 7f74c3f549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:22.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.143+0000 7f74c3f549c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x0 2024-09-12T17:27:22.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.143+0000 7f74c3f549c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T17:27:22.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.143+0000 7f74c3f549c0 20 failed to read name.$Mr.RGW88888888888888888 with: (2) No such file or directory 2024-09-12T17:27:22.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.143+0000 7f74c3f549c0 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-09-12T17:27:22.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.143+0000 7f74c3f549c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:22.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.143+0000 7f74c3f549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:22.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.143+0000 7f74c3f549c0 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-09-12T17:27:22.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.143+0000 7f74c3f549c0 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T17:27:22.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.143+0000 7f74c3f549c0 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-09-12T17:27:22.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.147+0000 7f74c3f549c0 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T17:27:22.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.147+0000 7f74c3f549c0 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T17:27:22.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.147+0000 7f74c3f549c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-09-12T17:27:22.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.147+0000 7f73a57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333633 cookie 94665470204624 notifier 8654 bl.length()=384 2024-09-12T17:27:22.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.147+0000 7f73a57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T17:27:22.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.147+0000 7f73a57fa640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T17:27:22.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.151+0000 7f74c3f549c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T17:27:22.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.151+0000 7f74c3f549c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T17:27:22.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.151+0000 7f74c3f549c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW88888888888888888, ofs0, ns] 2024-09-12T17:27:22.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.151+0000 7f73a57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333624 cookie 94665470221264 notifier 8654 bl.length()=225 2024-09-12T17:27:22.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.151+0000 7f73a57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T17:27:22.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.151+0000 7f73a57fa640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T17:27:22.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.155+0000 7f74c3f549c0 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T17:27:22.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.155+0000 7f74c3f549c0 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T17:27:22.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.155+0000 7f74c3f549c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-09-12T17:27:22.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.155+0000 7f73a4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333545 cookie 94665470218960 notifier 8654 bl.length()=234 2024-09-12T17:27:22.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.155+0000 7f73a4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T17:27:22.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.155+0000 7f73a4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T17:27:22.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.159+0000 7f73737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:22.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.163+0000 7f74c3f549c0 20 remove_watcher() i=0 2024-09-12T17:27:22.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.163+0000 7f74c3f549c0 2 removed watcher, disabling cache 2024-09-12T17:27:22.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.167+0000 7f74c3f549c0 20 remove_watcher() i=1 2024-09-12T17:27:22.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.167+0000 7f74c3f549c0 20 remove_watcher() i=2 2024-09-12T17:27:22.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.171+0000 7f74c3f549c0 20 remove_watcher() i=3 2024-09-12T17:27:22.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.171+0000 7f74c3f549c0 20 remove_watcher() i=4 2024-09-12T17:27:22.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.175+0000 7f74c3f549c0 20 remove_watcher() i=5 2024-09-12T17:27:22.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.175+0000 7f74c3f549c0 20 remove_watcher() i=6 2024-09-12T17:27:22.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.179+0000 7f74c3f549c0 20 remove_watcher() i=7 2024-09-12T17:27:22.194 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-12T17:27:22.194 INFO:teuthology.orchestra.run.smithi016.stdout: "id": "RGW88888888888888888", 2024-09-12T17:27:22.194 INFO:teuthology.orchestra.run.smithi016.stdout: "tenant": "", 2024-09-12T17:27:22.195 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "Mr.RGW88888888888888888", 2024-09-12T17:27:22.195 INFO:teuthology.orchestra.run.smithi016.stdout: "email": "RGW88888888888888888+test@test.test", 2024-09-12T17:27:22.195 INFO:teuthology.orchestra.run.smithi016.stdout: "quota": { 2024-09-12T17:27:22.195 INFO:teuthology.orchestra.run.smithi016.stdout: "enabled": false, 2024-09-12T17:27:22.195 INFO:teuthology.orchestra.run.smithi016.stdout: "check_on_raw": false, 2024-09-12T17:27:22.195 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size": -1, 2024-09-12T17:27:22.195 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size_kb": 0, 2024-09-12T17:27:22.195 INFO:teuthology.orchestra.run.smithi016.stdout: "max_objects": -1 2024-09-12T17:27:22.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-12T17:27:22.195 INFO:teuthology.orchestra.run.smithi016.stdout: "bucket_quota": { 2024-09-12T17:27:22.195 INFO:teuthology.orchestra.run.smithi016.stdout: "enabled": false, 2024-09-12T17:27:22.195 INFO:teuthology.orchestra.run.smithi016.stdout: "check_on_raw": false, 2024-09-12T17:27:22.196 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size": -1, 2024-09-12T17:27:22.196 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size_kb": 0, 2024-09-12T17:27:22.196 INFO:teuthology.orchestra.run.smithi016.stdout: "max_objects": -1 2024-09-12T17:27:22.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-12T17:27:22.196 INFO:teuthology.orchestra.run.smithi016.stdout: "max_users": 1000, 2024-09-12T17:27:22.196 INFO:teuthology.orchestra.run.smithi016.stdout: "max_roles": 1000, 2024-09-12T17:27:22.196 INFO:teuthology.orchestra.run.smithi016.stdout: "max_groups": 1000, 2024-09-12T17:27:22.196 INFO:teuthology.orchestra.run.smithi016.stdout: "max_buckets": 1000, 2024-09-12T17:27:22.196 INFO:teuthology.orchestra.run.smithi016.stdout: "max_access_keys": 4 2024-09-12T17:27:22.196 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-12T17:27:22.197 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-09-12T17:27:22.198 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key FWPLXIQUJSRRWFFSEJEX --secret RkXRInYd37QErYCMSUVoftuZIiphNfgEdUbJj79KCKUn43GgQmFjfA== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-09-12T17:27:22.285 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:22.285 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:22.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.327+0000 7f6469a2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:22.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.327+0000 7f6469a2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:22.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.327+0000 7f6469a2e9c0 20 realm 2024-09-12T17:27:22.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.327+0000 7f6469a2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:22.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.327+0000 7f6469a2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:22.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.327+0000 7f6469a2e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:22.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.327+0000 7f6469a2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:22.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.327+0000 7f6469a2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:22.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.327+0000 7f6469a2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:22.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.331+0000 7f6469a2e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:22.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.331+0000 7f6469a2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:22.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.331+0000 7f6469a2e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:22.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.331+0000 7f6469a2e9c0 20 searching for the correct realm 2024-09-12T17:27:22.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.335+0000 7f6466d33640 0 -- 172.21.15.16:0/4053394935 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7f6458082040 msgr2=0x7f645805ce10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:22.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.339+0000 7f6467d35640 0 -- 172.21.15.16:0/4053394935 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f645c0c32c0 msgr2=0x7f645c0e4b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:22.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.351+0000 7f6469a2e9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:27:22.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.351+0000 7f6469a2e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:22.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.351+0000 7f6469a2e9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:27:22.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.351+0000 7f6469a2e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:22.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.351+0000 7f6469a2e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:22.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.351+0000 7f6469a2e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:22.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.351+0000 7f6469a2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:22.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.351+0000 7f6469a2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:22.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.351+0000 7f6469a2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:22.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.351+0000 7f6469a2e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:22.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.351+0000 7f6469a2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:22.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.355+0000 7f6469a2e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:22.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.355+0000 7f6469a2e9c0 20 zone default found 2024-09-12T17:27:22.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.355+0000 7f6469a2e9c0 4 Realm: () 2024-09-12T17:27:22.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.355+0000 7f6469a2e9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:27:22.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.355+0000 7f6469a2e9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:27:22.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.355+0000 7f6469a2e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:22.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.355+0000 7f6469a2e9c0 20 zonegroup default 2024-09-12T17:27:22.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.355+0000 7f6469a2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:22.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.355+0000 7f6469a2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:22.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.355+0000 7f6469a2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:22.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.355+0000 7f6469a2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:22.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.355+0000 7f6469a2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:22.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.355+0000 7f6469a2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:22.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.355+0000 7f6469a2e9c0 20 started sync module instance, tier type = 2024-09-12T17:27:22.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.355+0000 7f6469a2e9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:27:22.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.371+0000 7f6469a2e9c0 20 add_watcher() i=0 2024-09-12T17:27:22.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.371+0000 7f6469a2e9c0 20 add_watcher() i=1 2024-09-12T17:27:22.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.371+0000 7f6469a2e9c0 20 add_watcher() i=2 2024-09-12T17:27:22.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.371+0000 7f6469a2e9c0 20 add_watcher() i=3 2024-09-12T17:27:22.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.371+0000 7f6469a2e9c0 20 add_watcher() i=4 2024-09-12T17:27:22.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.371+0000 7f6469a2e9c0 20 add_watcher() i=5 2024-09-12T17:27:22.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.371+0000 7f6469a2e9c0 20 add_watcher() i=6 2024-09-12T17:27:22.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.371+0000 7f6469a2e9c0 20 add_watcher() i=7 2024-09-12T17:27:22.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.371+0000 7f6469a2e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:22.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.375+0000 7f631dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:22.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.375+0000 7f6469a2e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:22.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.375+0000 7f6469a2e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:22.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.375+0000 7f6469a2e9c0 5 note: GC not initialized 2024-09-12T17:27:22.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.375+0000 7f631cfe1640 20 reqs_thread_entry: start 2024-09-12T17:27:22.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.375+0000 7f6469a2e9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:27:22.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.375+0000 7f6469a2e9c0 20 Filter name: none 2024-09-12T17:27:22.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.375+0000 7f62967fc640 20 reqs_thread_entry: start 2024-09-12T17:27:22.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.375+0000 7f6469a2e9c0 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T17:27:22.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.375+0000 7f6469a2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:22.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.375+0000 7f6469a2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:22.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.375+0000 7f6469a2e9c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-09-12T17:27:22.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.375+0000 7f6469a2e9c0 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T17:27:22.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.375+0000 7f6469a2e9c0 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-09-12T17:27:22.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.375+0000 7f6469a2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:22.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.375+0000 7f6469a2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:22.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.375+0000 7f6469a2e9c0 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-09-12T17:27:22.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.375+0000 7f6469a2e9c0 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T17:27:22.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.375+0000 7f6469a2e9c0 10 cache get: name=default.rgw.meta+users.keys+FWPLXIQUJSRRWFFSEJEX : miss 2024-09-12T17:27:22.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.375+0000 7f6469a2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:22.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.375+0000 7f6469a2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:22.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.375+0000 7f6469a2e9c0 10 cache put: name=default.rgw.meta+users.keys+FWPLXIQUJSRRWFFSEJEX info.flags=0x0 2024-09-12T17:27:22.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.375+0000 7f6469a2e9c0 10 adding default.rgw.meta+users.keys+FWPLXIQUJSRRWFFSEJEX to cache LRU end 2024-09-12T17:27:22.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.375+0000 7f6469a2e9c0 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-09-12T17:27:22.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.375+0000 7f6469a2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:22.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.379+0000 7f6469a2e9c0 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T17:27:22.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.379+0000 7f6469a2e9c0 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T17:27:22.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.379+0000 7f6469a2e9c0 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T17:27:22.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.379+0000 7f6469a2e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:27:22.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.379+0000 7f6469a2e9c0 10 cache get: name=default.rgw.meta+users.keys+FWPLXIQUJSRRWFFSEJEX : hit (negative entry) 2024-09-12T17:27:22.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.379+0000 7f6469a2e9c0 10 cache get: name=default.rgw.meta+users.keys+FWPLXIQUJSRRWFFSEJEX : hit (negative entry) 2024-09-12T17:27:22.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.379+0000 7f6469a2e9c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T17:27:22.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.379+0000 7f6469a2e9c0 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T17:27:22.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.379+0000 7f6469a2e9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T17:27:22.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.379+0000 7f634affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333634 cookie 94348234925936 notifier 8669 bl.length()=681 2024-09-12T17:27:22.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.379+0000 7f634affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T17:27:22.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.379+0000 7f634affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T17:27:22.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.383+0000 7f6469a2e9c0 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T17:27:22.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.383+0000 7f6469a2e9c0 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T17:27:22.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.383+0000 7f6469a2e9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-09-12T17:27:22.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.383+0000 7f634a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333585 cookie 94348234937776 notifier 8669 bl.length()=189 2024-09-12T17:27:22.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.383+0000 7f634a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T17:27:22.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.383+0000 7f634a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T17:27:22.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.387+0000 7f6469a2e9c0 10 cache put: name=default.rgw.meta+users.keys+FWPLXIQUJSRRWFFSEJEX info.flags=0x7 2024-09-12T17:27:22.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.387+0000 7f6469a2e9c0 10 moving default.rgw.meta+users.keys+FWPLXIQUJSRRWFFSEJEX to cache LRU end 2024-09-12T17:27:22.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.387+0000 7f6469a2e9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:FWPLXIQUJSRRWFFSEJEX, ofs0, ns] 2024-09-12T17:27:22.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.387+0000 7f634affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333625 cookie 94348234934224 notifier 8669 bl.length()=188 2024-09-12T17:27:22.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.387+0000 7f634affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+FWPLXIQUJSRRWFFSEJEX info.flags=0x7 2024-09-12T17:27:22.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.387+0000 7f634affd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+FWPLXIQUJSRRWFFSEJEX to cache LRU end 2024-09-12T17:27:22.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.391+0000 7f6469a2e9c0 20 linked user root1.client.0 to account RGW88888888888888888 2024-09-12T17:27:22.396 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-12T17:27:22.396 INFO:teuthology.orchestra.run.smithi016.stdout: "user_id": "root1.client.0", 2024-09-12T17:27:22.396 INFO:teuthology.orchestra.run.smithi016.stdout: "display_name": "Mr.RGW88888888888888888", 2024-09-12T17:27:22.396 INFO:teuthology.orchestra.run.smithi016.stdout: "email": "root1+test@test.test", 2024-09-12T17:27:22.396 INFO:teuthology.orchestra.run.smithi016.stdout: "suspended": 0, 2024-09-12T17:27:22.396 INFO:teuthology.orchestra.run.smithi016.stdout: "max_buckets": 1000, 2024-09-12T17:27:22.396 INFO:teuthology.orchestra.run.smithi016.stdout: "subusers": [], 2024-09-12T17:27:22.396 INFO:teuthology.orchestra.run.smithi016.stdout: "keys": [ 2024-09-12T17:27:22.396 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-12T17:27:22.396 INFO:teuthology.orchestra.run.smithi016.stdout: "user": "root1.client.0", 2024-09-12T17:27:22.396 INFO:teuthology.orchestra.run.smithi016.stdout: "access_key": "FWPLXIQUJSRRWFFSEJEX", 2024-09-12T17:27:22.396 INFO:teuthology.orchestra.run.smithi016.stdout: "secret_key": "RkXRInYd37QErYCMSUVoftuZIiphNfgEdUbJj79KCKUn43GgQmFjfA==", 2024-09-12T17:27:22.396 INFO:teuthology.orchestra.run.smithi016.stdout: "active": true, 2024-09-12T17:27:22.397 INFO:teuthology.orchestra.run.smithi016.stdout: "create_date": "2024-09-12T17:27:22.383388Z" 2024-09-12T17:27:22.397 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-12T17:27:22.397 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-12T17:27:22.397 INFO:teuthology.orchestra.run.smithi016.stdout: "swift_keys": [], 2024-09-12T17:27:22.397 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": [], 2024-09-12T17:27:22.397 INFO:teuthology.orchestra.run.smithi016.stdout: "op_mask": "read, write, delete", 2024-09-12T17:27:22.397 INFO:teuthology.orchestra.run.smithi016.stdout: "default_placement": "", 2024-09-12T17:27:22.397 INFO:teuthology.orchestra.run.smithi016.stdout: "default_storage_class": "", 2024-09-12T17:27:22.397 INFO:teuthology.orchestra.run.smithi016.stdout: "placement_tags": [], 2024-09-12T17:27:22.397 INFO:teuthology.orchestra.run.smithi016.stdout: "bucket_quota": { 2024-09-12T17:27:22.397 INFO:teuthology.orchestra.run.smithi016.stdout: "enabled": false, 2024-09-12T17:27:22.397 INFO:teuthology.orchestra.run.smithi016.stdout: "check_on_raw": false, 2024-09-12T17:27:22.397 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size": -1, 2024-09-12T17:27:22.397 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size_kb": 0, 2024-09-12T17:27:22.398 INFO:teuthology.orchestra.run.smithi016.stdout: "max_objects": -1 2024-09-12T17:27:22.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-12T17:27:22.398 INFO:teuthology.orchestra.run.smithi016.stdout: "user_quota": { 2024-09-12T17:27:22.398 INFO:teuthology.orchestra.run.smithi016.stdout: "enabled": false, 2024-09-12T17:27:22.398 INFO:teuthology.orchestra.run.smithi016.stdout: "check_on_raw": false, 2024-09-12T17:27:22.398 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size": -1, 2024-09-12T17:27:22.398 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size_kb": 0, 2024-09-12T17:27:22.398 INFO:teuthology.orchestra.run.smithi016.stdout: "max_objects": -1 2024-09-12T17:27:22.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-12T17:27:22.398 INFO:teuthology.orchestra.run.smithi016.stdout: "temp_url_keys": [], 2024-09-12T17:27:22.398 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "root", 2024-09-12T17:27:22.398 INFO:teuthology.orchestra.run.smithi016.stdout: "mfa_ids": [], 2024-09-12T17:27:22.398 INFO:teuthology.orchestra.run.smithi016.stdout: "account_id": "RGW88888888888888888", 2024-09-12T17:27:22.398 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-12T17:27:22.399 INFO:teuthology.orchestra.run.smithi016.stdout: "create_date": "2024-09-12T17:27:22.383369Z", 2024-09-12T17:27:22.399 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-12T17:27:22.399 INFO:teuthology.orchestra.run.smithi016.stdout: "group_ids": [] 2024-09-12T17:27:22.399 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-12T17:27:22.399 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:22.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.395+0000 7f631dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:22.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.399+0000 7f6469a2e9c0 20 remove_watcher() i=0 2024-09-12T17:27:22.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.399+0000 7f6469a2e9c0 2 removed watcher, disabling cache 2024-09-12T17:27:22.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.399+0000 7f6469a2e9c0 20 remove_watcher() i=1 2024-09-12T17:27:22.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.403+0000 7f6469a2e9c0 20 remove_watcher() i=2 2024-09-12T17:27:22.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.407+0000 7f6469a2e9c0 20 remove_watcher() i=3 2024-09-12T17:27:22.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.407+0000 7f6469a2e9c0 20 remove_watcher() i=4 2024-09-12T17:27:22.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.407+0000 7f6469a2e9c0 20 remove_watcher() i=5 2024-09-12T17:27:22.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.411+0000 7f6469a2e9c0 20 remove_watcher() i=6 2024-09-12T17:27:22.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.411+0000 7f6469a2e9c0 20 remove_watcher() i=7 2024-09-12T17:27:22.430 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 3351529688 --totp-seed N4B452DUMGGELZTYRNPPKSGD5UL2EAW2ZDCGDD2SDIGSP7CDAG4EKTW67UKTD6WD --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T17:27:22.473 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:22.473 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:22.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.511+0000 7f028658c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:22.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.515+0000 7f028658c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:22.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.515+0000 7f028658c9c0 20 realm 2024-09-12T17:27:22.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.515+0000 7f028658c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:22.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.515+0000 7f028658c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:22.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.515+0000 7f028658c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:22.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.515+0000 7f028658c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:22.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.515+0000 7f028658c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:22.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.515+0000 7f028658c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:22.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.515+0000 7f028658c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:22.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.515+0000 7f028658c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:22.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.519+0000 7f028658c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:22.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.519+0000 7f028658c9c0 20 searching for the correct realm 2024-09-12T17:27:22.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.523+0000 7f0284893640 0 -- 172.21.15.16:0/3042853646 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f0278037040 msgr2=0x7f0278037930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:27:22.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.739+0000 7f0283891640 0 -- 172.21.15.16:0/3042853646 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f027c0a1130 msgr2=0x7f027c00c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:22.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.959+0000 7f028658c9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:27:22.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.959+0000 7f028658c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:22.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.959+0000 7f028658c9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:27:22.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.959+0000 7f028658c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:22.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.959+0000 7f028658c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:22.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.959+0000 7f028658c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:22.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.959+0000 7f028658c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:22.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.959+0000 7f028658c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:22.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.959+0000 7f028658c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:22.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.959+0000 7f028658c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:22.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.959+0000 7f028658c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:22.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.963+0000 7f028658c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:22.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.963+0000 7f028658c9c0 20 zone default found 2024-09-12T17:27:22.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.963+0000 7f028658c9c0 4 Realm: () 2024-09-12T17:27:22.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.963+0000 7f028658c9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:27:22.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.963+0000 7f028658c9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:27:22.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.963+0000 7f028658c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:22.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.963+0000 7f028658c9c0 20 zonegroup default 2024-09-12T17:27:22.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.963+0000 7f028658c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:22.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.963+0000 7f028658c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:22.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.963+0000 7f028658c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:22.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.963+0000 7f028658c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:22.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.963+0000 7f028658c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:22.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.963+0000 7f028658c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:22.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.963+0000 7f028658c9c0 20 started sync module instance, tier type = 2024-09-12T17:27:22.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.963+0000 7f028658c9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:27:22.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.983+0000 7f028658c9c0 20 add_watcher() i=0 2024-09-12T17:27:22.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.983+0000 7f028658c9c0 20 add_watcher() i=1 2024-09-12T17:27:22.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.983+0000 7f028658c9c0 20 add_watcher() i=2 2024-09-12T17:27:22.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.983+0000 7f028658c9c0 20 add_watcher() i=3 2024-09-12T17:27:22.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.983+0000 7f028658c9c0 20 add_watcher() i=4 2024-09-12T17:27:22.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.983+0000 7f028658c9c0 20 add_watcher() i=5 2024-09-12T17:27:22.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.983+0000 7f028658c9c0 20 add_watcher() i=6 2024-09-12T17:27:22.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.987+0000 7f028658c9c0 20 add_watcher() i=7 2024-09-12T17:27:22.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.987+0000 7f028658c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:22.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.991+0000 7f013afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:22.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.991+0000 7f028658c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:22.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.991+0000 7f028658c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:22.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.991+0000 7f028658c9c0 5 note: GC not initialized 2024-09-12T17:27:22.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.991+0000 7f0139fdb640 20 reqs_thread_entry: start 2024-09-12T17:27:22.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.991+0000 7f028658c9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:27:22.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.991+0000 7f028658c9c0 20 Filter name: none 2024-09-12T17:27:22.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.991+0000 7f00ab7fe640 20 reqs_thread_entry: start 2024-09-12T17:27:22.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.991+0000 7f028658c9c0 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T17:27:22.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.991+0000 7f028658c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:22.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.991+0000 7f028658c9c0 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T17:27:22.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.995+0000 7f028658c9c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-09-12T17:27:22.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.995+0000 7f028658c9c0 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T17:27:22.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.995+0000 7f028658c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:27:23.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.999+0000 7f028658c9c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T17:27:23.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.999+0000 7f028658c9c0 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T17:27:23.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.999+0000 7f028658c9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T17:27:23.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.999+0000 7f015b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333635 cookie 94793354253696 notifier 9207 bl.length()=695 2024-09-12T17:27:23.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.999+0000 7f015b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T17:27:23.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:22.999+0000 7f015b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T17:27:23.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.003+0000 7f013afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:23.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.007+0000 7f028658c9c0 20 remove_watcher() i=0 2024-09-12T17:27:23.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.007+0000 7f028658c9c0 2 removed watcher, disabling cache 2024-09-12T17:27:23.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.011+0000 7f028658c9c0 20 remove_watcher() i=1 2024-09-12T17:27:23.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.011+0000 7f028658c9c0 20 remove_watcher() i=2 2024-09-12T17:27:23.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.015+0000 7f028658c9c0 20 remove_watcher() i=3 2024-09-12T17:27:23.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.019+0000 7f028658c9c0 20 remove_watcher() i=4 2024-09-12T17:27:23.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.019+0000 7f028658c9c0 20 remove_watcher() i=5 2024-09-12T17:27:23.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.019+0000 7f028658c9c0 20 remove_watcher() i=6 2024-09-12T17:27:23.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.023+0000 7f028658c9c0 20 remove_watcher() i=7 2024-09-12T17:27:23.045 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name Mr.RGW99999999999999999 --email RGW99999999999999999+test@test.test 2024-09-12T17:27:23.084 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:23.085 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:23.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.123+0000 7f9cb72189c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:23.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.331+0000 7f9cb72189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:23.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.331+0000 7f9cb72189c0 20 realm 2024-09-12T17:27:23.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.331+0000 7f9cb72189c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:23.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.331+0000 7f9cb72189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:23.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.331+0000 7f9cb72189c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:23.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.331+0000 7f9cb72189c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:23.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.331+0000 7f9cb72189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:23.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.331+0000 7f9cb72189c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:23.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.335+0000 7f9cb72189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:23.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.335+0000 7f9cb72189c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:23.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.339+0000 7f9cb72189c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:23.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.339+0000 7f9cb72189c0 20 searching for the correct realm 2024-09-12T17:27:23.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.343+0000 7f9cb551f640 0 -- 172.21.15.16:0/640028363 >> [v2:172.21.15.19:6800/1509147557,v1:172.21.15.19:6801/1509147557] conn(0x5556959eb660 msgr2=0x5556959eda70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:23.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.355+0000 7f9cb451d640 0 -- 172.21.15.16:0/640028363 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f9cac046a20 msgr2=0x7f9cac054400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:23.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.571+0000 7f9cb72189c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:27:23.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.571+0000 7f9cb72189c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:23.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.571+0000 7f9cb72189c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:27:23.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.571+0000 7f9cb72189c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:23.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.571+0000 7f9cb72189c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:23.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.571+0000 7f9cb72189c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:23.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.571+0000 7f9cb72189c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:23.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.575+0000 7f9cb72189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:23.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.575+0000 7f9cb72189c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:23.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.575+0000 7f9cb72189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:23.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.575+0000 7f9cb72189c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:23.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.575+0000 7f9cb72189c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:23.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.575+0000 7f9cb72189c0 20 zone default found 2024-09-12T17:27:23.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.575+0000 7f9cb72189c0 4 Realm: () 2024-09-12T17:27:23.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.575+0000 7f9cb72189c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:27:23.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.575+0000 7f9cb72189c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:27:23.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.575+0000 7f9cb72189c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:23.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.575+0000 7f9cb72189c0 20 zonegroup default 2024-09-12T17:27:23.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.575+0000 7f9cb72189c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:23.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.575+0000 7f9cb72189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:23.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.575+0000 7f9cb72189c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:23.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.579+0000 7f9cb72189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:23.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.579+0000 7f9cb72189c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:23.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.579+0000 7f9cb72189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:23.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.579+0000 7f9cb72189c0 20 started sync module instance, tier type = 2024-09-12T17:27:23.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.579+0000 7f9cb72189c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:27:23.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.603+0000 7f9cb72189c0 20 add_watcher() i=0 2024-09-12T17:27:23.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.603+0000 7f9cb72189c0 20 add_watcher() i=1 2024-09-12T17:27:23.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.603+0000 7f9cb72189c0 20 add_watcher() i=2 2024-09-12T17:27:23.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.603+0000 7f9cb72189c0 20 add_watcher() i=3 2024-09-12T17:27:23.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.603+0000 7f9cb72189c0 20 add_watcher() i=4 2024-09-12T17:27:23.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.603+0000 7f9cb72189c0 20 add_watcher() i=5 2024-09-12T17:27:23.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.603+0000 7f9cb72189c0 20 add_watcher() i=6 2024-09-12T17:27:23.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.607+0000 7f9cb72189c0 20 add_watcher() i=7 2024-09-12T17:27:23.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.607+0000 7f9cb72189c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:23.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.611+0000 7f9b6afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:23.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.611+0000 7f9cb72189c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:23.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.611+0000 7f9cb72189c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:23.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.611+0000 7f9cb72189c0 5 note: GC not initialized 2024-09-12T17:27:23.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.611+0000 7f9b69fe3640 20 reqs_thread_entry: start 2024-09-12T17:27:23.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.611+0000 7f9cb72189c0 20 init_complete bucket index max shards: 1 2024-09-12T17:27:23.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.611+0000 7f9cb72189c0 20 Filter name: none 2024-09-12T17:27:23.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.611+0000 7f9adb7fe640 20 reqs_thread_entry: start 2024-09-12T17:27:23.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.611+0000 7f9cb72189c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 : miss 2024-09-12T17:27:23.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.611+0000 7f9cb72189c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:23.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.611+0000 7f9cb72189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:23.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.611+0000 7f9cb72189c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x0 2024-09-12T17:27:23.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.611+0000 7f9cb72189c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T17:27:23.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.611+0000 7f9cb72189c0 20 failed to read name.$Mr.RGW99999999999999999 with: (2) No such file or directory 2024-09-12T17:27:23.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.611+0000 7f9cb72189c0 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-09-12T17:27:23.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.611+0000 7f9cb72189c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:23.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.611+0000 7f9cb72189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:23.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.611+0000 7f9cb72189c0 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-09-12T17:27:23.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.611+0000 7f9cb72189c0 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T17:27:23.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.611+0000 7f9cb72189c0 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-09-12T17:27:23.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.615+0000 7f9cb72189c0 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T17:27:23.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.615+0000 7f9cb72189c0 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T17:27:23.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.615+0000 7f9cb72189c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-09-12T17:27:23.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.619+0000 7f9b8bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333636 cookie 93830365760880 notifier 9225 bl.length()=384 2024-09-12T17:27:23.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.619+0000 7f9b8bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T17:27:23.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.619+0000 7f9b8bfff640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T17:27:23.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.619+0000 7f9cb72189c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T17:27:23.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.619+0000 7f9cb72189c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T17:27:23.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.619+0000 7f9cb72189c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW99999999999999999, ofs0, ns] 2024-09-12T17:27:23.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.623+0000 7f9b8bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333626 cookie 93830365799728 notifier 9225 bl.length()=225 2024-09-12T17:27:23.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.623+0000 7f9b8bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T17:27:23.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.623+0000 7f9b8bfff640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T17:27:23.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.627+0000 7f9cb72189c0 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T17:27:23.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.627+0000 7f9cb72189c0 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T17:27:23.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.627+0000 7f9cb72189c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-09-12T17:27:23.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.627+0000 7f9b8b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333546 cookie 93830365796096 notifier 9225 bl.length()=234 2024-09-12T17:27:23.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.627+0000 7f9b8b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T17:27:23.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.627+0000 7f9b8b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T17:27:23.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.627+0000 7f9b6afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:23.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.635+0000 7f9cb72189c0 20 remove_watcher() i=0 2024-09-12T17:27:23.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.635+0000 7f9cb72189c0 2 removed watcher, disabling cache 2024-09-12T17:27:23.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.635+0000 7f9cb72189c0 20 remove_watcher() i=1 2024-09-12T17:27:23.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.639+0000 7f9cb72189c0 20 remove_watcher() i=2 2024-09-12T17:27:23.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.639+0000 7f9cb72189c0 20 remove_watcher() i=3 2024-09-12T17:27:23.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.643+0000 7f9cb72189c0 20 remove_watcher() i=4 2024-09-12T17:27:23.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.643+0000 7f9cb72189c0 20 remove_watcher() i=5 2024-09-12T17:27:23.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.647+0000 7f9cb72189c0 20 remove_watcher() i=6 2024-09-12T17:27:23.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.647+0000 7f9cb72189c0 20 remove_watcher() i=7 2024-09-12T17:27:23.664 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-12T17:27:23.664 INFO:teuthology.orchestra.run.smithi016.stdout: "id": "RGW99999999999999999", 2024-09-12T17:27:23.664 INFO:teuthology.orchestra.run.smithi016.stdout: "tenant": "", 2024-09-12T17:27:23.664 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "Mr.RGW99999999999999999", 2024-09-12T17:27:23.664 INFO:teuthology.orchestra.run.smithi016.stdout: "email": "RGW99999999999999999+test@test.test", 2024-09-12T17:27:23.664 INFO:teuthology.orchestra.run.smithi016.stdout: "quota": { 2024-09-12T17:27:23.665 INFO:teuthology.orchestra.run.smithi016.stdout: "enabled": false, 2024-09-12T17:27:23.665 INFO:teuthology.orchestra.run.smithi016.stdout: "check_on_raw": false, 2024-09-12T17:27:23.665 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size": -1, 2024-09-12T17:27:23.665 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size_kb": 0, 2024-09-12T17:27:23.665 INFO:teuthology.orchestra.run.smithi016.stdout: "max_objects": -1 2024-09-12T17:27:23.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-12T17:27:23.665 INFO:teuthology.orchestra.run.smithi016.stdout: "bucket_quota": { 2024-09-12T17:27:23.665 INFO:teuthology.orchestra.run.smithi016.stdout: "enabled": false, 2024-09-12T17:27:23.665 INFO:teuthology.orchestra.run.smithi016.stdout: "check_on_raw": false, 2024-09-12T17:27:23.665 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size": -1, 2024-09-12T17:27:23.666 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size_kb": 0, 2024-09-12T17:27:23.666 INFO:teuthology.orchestra.run.smithi016.stdout: "max_objects": -1 2024-09-12T17:27:23.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-12T17:27:23.666 INFO:teuthology.orchestra.run.smithi016.stdout: "max_users": 1000, 2024-09-12T17:27:23.666 INFO:teuthology.orchestra.run.smithi016.stdout: "max_roles": 1000, 2024-09-12T17:27:23.666 INFO:teuthology.orchestra.run.smithi016.stdout: "max_groups": 1000, 2024-09-12T17:27:23.666 INFO:teuthology.orchestra.run.smithi016.stdout: "max_buckets": 1000, 2024-09-12T17:27:23.666 INFO:teuthology.orchestra.run.smithi016.stdout: "max_access_keys": 4 2024-09-12T17:27:23.666 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-12T17:27:23.667 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-09-12T17:27:23.668 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key GBSLOCUGKKCJSRRWDPAW --secret 0piywm6Ml6rkpkRIA4dVcJpbPjlFlXtUxtVX3CrNFzizdTsGGL6dqQ== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-09-12T17:27:23.761 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:23.761 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:23.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.799+0000 7f73335c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:23.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.803+0000 7f73335c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:23.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.803+0000 7f73335c09c0 20 realm 2024-09-12T17:27:23.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.803+0000 7f73335c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:23.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.803+0000 7f73335c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:23.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.803+0000 7f73335c09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:23.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.803+0000 7f73335c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:23.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.803+0000 7f73335c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:23.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.803+0000 7f73335c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:23.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.807+0000 7f73335c09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:23.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.807+0000 7f73335c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:23.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.807+0000 7f73335c09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:23.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.807+0000 7f73335c09c0 20 searching for the correct realm 2024-09-12T17:27:23.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:23.811+0000 7f73318c7640 0 -- 172.21.15.16:0/3221469661 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f7328032060 msgr2=0x7f7328062610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:24.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.027+0000 7f73308c5640 0 -- 172.21.15.16:0/3221469661 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f732c0df070 msgr2=0x7f732c127130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:27:24.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.243+0000 7f73335c09c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:27:24.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.243+0000 7f73335c09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:24.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.243+0000 7f73335c09c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:27:24.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.243+0000 7f73335c09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:24.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.243+0000 7f73335c09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:24.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.243+0000 7f73335c09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:24.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.243+0000 7f73335c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:24.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.247+0000 7f73335c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:24.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.247+0000 7f73335c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:24.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.247+0000 7f73335c09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:24.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.247+0000 7f73335c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:24.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.247+0000 7f73335c09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:24.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.247+0000 7f73335c09c0 20 zone default found 2024-09-12T17:27:24.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.247+0000 7f73335c09c0 4 Realm: () 2024-09-12T17:27:24.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.247+0000 7f73335c09c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:27:24.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.247+0000 7f73335c09c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:27:24.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.247+0000 7f73335c09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:24.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.247+0000 7f73335c09c0 20 zonegroup default 2024-09-12T17:27:24.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.247+0000 7f73335c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:24.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.247+0000 7f73335c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:24.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.247+0000 7f73335c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:24.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.251+0000 7f73335c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:24.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.251+0000 7f73335c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:24.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.251+0000 7f73335c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:24.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.251+0000 7f73335c09c0 20 started sync module instance, tier type = 2024-09-12T17:27:24.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.251+0000 7f73335c09c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:27:24.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.275+0000 7f73335c09c0 20 add_watcher() i=0 2024-09-12T17:27:24.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.275+0000 7f73335c09c0 20 add_watcher() i=1 2024-09-12T17:27:24.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.275+0000 7f73335c09c0 20 add_watcher() i=2 2024-09-12T17:27:24.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.275+0000 7f73335c09c0 20 add_watcher() i=3 2024-09-12T17:27:24.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.275+0000 7f73335c09c0 20 add_watcher() i=4 2024-09-12T17:27:24.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.275+0000 7f73335c09c0 20 add_watcher() i=5 2024-09-12T17:27:24.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.275+0000 7f73335c09c0 20 add_watcher() i=6 2024-09-12T17:27:24.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.279+0000 7f73335c09c0 20 add_watcher() i=7 2024-09-12T17:27:24.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.279+0000 7f73335c09c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:24.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.283+0000 7f71e7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:24.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.283+0000 7f73335c09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:24.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.283+0000 7f73335c09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:24.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.283+0000 7f73335c09c0 5 note: GC not initialized 2024-09-12T17:27:24.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.283+0000 7f71e6fe5640 20 reqs_thread_entry: start 2024-09-12T17:27:24.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.283+0000 7f73335c09c0 20 init_complete bucket index max shards: 1 2024-09-12T17:27:24.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.283+0000 7f73335c09c0 20 Filter name: none 2024-09-12T17:27:24.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.283+0000 7f71e4fe1640 20 reqs_thread_entry: start 2024-09-12T17:27:24.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.283+0000 7f73335c09c0 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T17:27:24.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.283+0000 7f73335c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:24.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.283+0000 7f73335c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:24.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.283+0000 7f73335c09c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-09-12T17:27:24.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.283+0000 7f73335c09c0 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T17:27:24.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.283+0000 7f73335c09c0 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-09-12T17:27:24.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.283+0000 7f73335c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:24.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.283+0000 7f73335c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:24.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.283+0000 7f73335c09c0 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-09-12T17:27:24.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.283+0000 7f73335c09c0 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T17:27:24.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.283+0000 7f73335c09c0 10 cache get: name=default.rgw.meta+users.keys+GBSLOCUGKKCJSRRWDPAW : miss 2024-09-12T17:27:24.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.283+0000 7f73335c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:24.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.283+0000 7f73335c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:24.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.287+0000 7f73335c09c0 10 cache put: name=default.rgw.meta+users.keys+GBSLOCUGKKCJSRRWDPAW info.flags=0x0 2024-09-12T17:27:24.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.287+0000 7f73335c09c0 10 adding default.rgw.meta+users.keys+GBSLOCUGKKCJSRRWDPAW to cache LRU end 2024-09-12T17:27:24.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.287+0000 7f73335c09c0 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-09-12T17:27:24.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.287+0000 7f73335c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:24.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.287+0000 7f73335c09c0 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T17:27:24.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.287+0000 7f73335c09c0 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T17:27:24.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.287+0000 7f73335c09c0 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T17:27:24.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.287+0000 7f73335c09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:27:24.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.287+0000 7f73335c09c0 10 cache get: name=default.rgw.meta+users.keys+GBSLOCUGKKCJSRRWDPAW : hit (negative entry) 2024-09-12T17:27:24.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.287+0000 7f73335c09c0 10 cache get: name=default.rgw.meta+users.keys+GBSLOCUGKKCJSRRWDPAW : hit (negative entry) 2024-09-12T17:27:24.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.291+0000 7f73335c09c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T17:27:24.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.291+0000 7f73335c09c0 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T17:27:24.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.291+0000 7f73335c09c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T17:27:24.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.291+0000 7f7214ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333637 cookie 94401982955312 notifier 8720 bl.length()=681 2024-09-12T17:27:24.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.291+0000 7f7214ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T17:27:24.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.291+0000 7f7214ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T17:27:24.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.295+0000 7f73335c09c0 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T17:27:24.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.295+0000 7f73335c09c0 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T17:27:24.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.295+0000 7f73335c09c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-09-12T17:27:24.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.295+0000 7f7214ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333586 cookie 94401982966512 notifier 8720 bl.length()=189 2024-09-12T17:27:24.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.295+0000 7f7214ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T17:27:24.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.295+0000 7f7214ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T17:27:24.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.299+0000 7f73335c09c0 10 cache put: name=default.rgw.meta+users.keys+GBSLOCUGKKCJSRRWDPAW info.flags=0x7 2024-09-12T17:27:24.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.299+0000 7f73335c09c0 10 moving default.rgw.meta+users.keys+GBSLOCUGKKCJSRRWDPAW to cache LRU end 2024-09-12T17:27:24.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.299+0000 7f73335c09c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:GBSLOCUGKKCJSRRWDPAW, ofs0, ns] 2024-09-12T17:27:24.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.299+0000 7f7203fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333587 cookie 94401982966512 notifier 8720 bl.length()=188 2024-09-12T17:27:24.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.299+0000 7f7203fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+GBSLOCUGKKCJSRRWDPAW info.flags=0x7 2024-09-12T17:27:24.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.299+0000 7f7203fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+GBSLOCUGKKCJSRRWDPAW to cache LRU end 2024-09-12T17:27:24.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.303+0000 7f73335c09c0 20 linked user root2.client.0 to account RGW99999999999999999 2024-09-12T17:27:24.307 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-12T17:27:24.307 INFO:teuthology.orchestra.run.smithi016.stdout: "user_id": "root2.client.0", 2024-09-12T17:27:24.307 INFO:teuthology.orchestra.run.smithi016.stdout: "display_name": "Mr.RGW99999999999999999", 2024-09-12T17:27:24.307 INFO:teuthology.orchestra.run.smithi016.stdout: "email": "root2+test@test.test", 2024-09-12T17:27:24.307 INFO:teuthology.orchestra.run.smithi016.stdout: "suspended": 0, 2024-09-12T17:27:24.307 INFO:teuthology.orchestra.run.smithi016.stdout: "max_buckets": 1000, 2024-09-12T17:27:24.307 INFO:teuthology.orchestra.run.smithi016.stdout: "subusers": [], 2024-09-12T17:27:24.307 INFO:teuthology.orchestra.run.smithi016.stdout: "keys": [ 2024-09-12T17:27:24.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-09-12T17:27:24.307 INFO:teuthology.orchestra.run.smithi016.stdout: "user": "root2.client.0", 2024-09-12T17:27:24.307 INFO:teuthology.orchestra.run.smithi016.stdout: "access_key": "GBSLOCUGKKCJSRRWDPAW", 2024-09-12T17:27:24.307 INFO:teuthology.orchestra.run.smithi016.stdout: "secret_key": "0piywm6Ml6rkpkRIA4dVcJpbPjlFlXtUxtVX3CrNFzizdTsGGL6dqQ==", 2024-09-12T17:27:24.308 INFO:teuthology.orchestra.run.smithi016.stdout: "active": true, 2024-09-12T17:27:24.308 INFO:teuthology.orchestra.run.smithi016.stdout: "create_date": "2024-09-12T17:27:24.292731Z" 2024-09-12T17:27:24.308 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-12T17:27:24.308 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-09-12T17:27:24.308 INFO:teuthology.orchestra.run.smithi016.stdout: "swift_keys": [], 2024-09-12T17:27:24.308 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": [], 2024-09-12T17:27:24.308 INFO:teuthology.orchestra.run.smithi016.stdout: "op_mask": "read, write, delete", 2024-09-12T17:27:24.308 INFO:teuthology.orchestra.run.smithi016.stdout: "default_placement": "", 2024-09-12T17:27:24.308 INFO:teuthology.orchestra.run.smithi016.stdout: "default_storage_class": "", 2024-09-12T17:27:24.308 INFO:teuthology.orchestra.run.smithi016.stdout: "placement_tags": [], 2024-09-12T17:27:24.308 INFO:teuthology.orchestra.run.smithi016.stdout: "bucket_quota": { 2024-09-12T17:27:24.308 INFO:teuthology.orchestra.run.smithi016.stdout: "enabled": false, 2024-09-12T17:27:24.308 INFO:teuthology.orchestra.run.smithi016.stdout: "check_on_raw": false, 2024-09-12T17:27:24.308 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size": -1, 2024-09-12T17:27:24.309 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size_kb": 0, 2024-09-12T17:27:24.309 INFO:teuthology.orchestra.run.smithi016.stdout: "max_objects": -1 2024-09-12T17:27:24.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-12T17:27:24.309 INFO:teuthology.orchestra.run.smithi016.stdout: "user_quota": { 2024-09-12T17:27:24.309 INFO:teuthology.orchestra.run.smithi016.stdout: "enabled": false, 2024-09-12T17:27:24.309 INFO:teuthology.orchestra.run.smithi016.stdout: "check_on_raw": false, 2024-09-12T17:27:24.309 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size": -1, 2024-09-12T17:27:24.309 INFO:teuthology.orchestra.run.smithi016.stdout: "max_size_kb": 0, 2024-09-12T17:27:24.309 INFO:teuthology.orchestra.run.smithi016.stdout: "max_objects": -1 2024-09-12T17:27:24.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-12T17:27:24.309 INFO:teuthology.orchestra.run.smithi016.stdout: "temp_url_keys": [], 2024-09-12T17:27:24.309 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "root", 2024-09-12T17:27:24.309 INFO:teuthology.orchestra.run.smithi016.stdout: "mfa_ids": [], 2024-09-12T17:27:24.310 INFO:teuthology.orchestra.run.smithi016.stdout: "account_id": "RGW99999999999999999", 2024-09-12T17:27:24.310 INFO:teuthology.orchestra.run.smithi016.stdout: "path": "/", 2024-09-12T17:27:24.310 INFO:teuthology.orchestra.run.smithi016.stdout: "create_date": "2024-09-12T17:27:24.292679Z", 2024-09-12T17:27:24.310 INFO:teuthology.orchestra.run.smithi016.stdout: "tags": [], 2024-09-12T17:27:24.310 INFO:teuthology.orchestra.run.smithi016.stdout: "group_ids": [] 2024-09-12T17:27:24.310 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-12T17:27:24.310 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:27:24.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.303+0000 7f71e7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:24.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.311+0000 7f73335c09c0 20 remove_watcher() i=0 2024-09-12T17:27:24.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.311+0000 7f73335c09c0 2 removed watcher, disabling cache 2024-09-12T17:27:24.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.311+0000 7f73335c09c0 20 remove_watcher() i=1 2024-09-12T17:27:24.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.315+0000 7f73335c09c0 20 remove_watcher() i=2 2024-09-12T17:27:24.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.319+0000 7f73335c09c0 20 remove_watcher() i=3 2024-09-12T17:27:24.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.319+0000 7f73335c09c0 20 remove_watcher() i=4 2024-09-12T17:27:24.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.323+0000 7f73335c09c0 20 remove_watcher() i=5 2024-09-12T17:27:24.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.323+0000 7f73335c09c0 20 remove_watcher() i=6 2024-09-12T17:27:24.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.323+0000 7f73335c09c0 20 remove_watcher() i=7 2024-09-12T17:27:24.352 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 9648727221 --totp-seed 2HOWBW74YI3EJF37WELBLEFB6WOULIEF4UY7CEYLWQTJY2OCE7UDE7OZ4YC6BI25 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T17:27:24.401 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:27:24.401 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:27:24.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.443+0000 7fdd147c99c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:24.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.443+0000 7fdd147c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:24.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.443+0000 7fdd147c99c0 20 realm 2024-09-12T17:27:24.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.443+0000 7fdd147c99c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:24.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.443+0000 7fdd147c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:24.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.443+0000 7fdd147c99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:27:24.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.443+0000 7fdd147c99c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:24.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.443+0000 7fdd147c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:24.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.443+0000 7fdd147c99c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:24.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.447+0000 7fdd147c99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:24.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.447+0000 7fdd147c99c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:24.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.447+0000 7fdd147c99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:27:24.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.447+0000 7fdd147c99c0 20 searching for the correct realm 2024-09-12T17:27:24.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.451+0000 7fdd11ace640 0 -- 172.21.15.16:0/521916498 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7fdd04124e70 msgr2=0x7fdd041243d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:24.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.663+0000 7fdd12ad0640 0 -- 172.21.15.16:0/521916498 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fdcfc003100 msgr2=0x7fdd0807f050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:27:24.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.683+0000 7fdd147c99c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:27:24.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.683+0000 7fdd147c99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:27:24.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.683+0000 7fdd147c99c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:27:24.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.683+0000 7fdd147c99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:27:24.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.683+0000 7fdd147c99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:27:24.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.683+0000 7fdd147c99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:27:24.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.683+0000 7fdd147c99c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:24.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.683+0000 7fdd147c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:24.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.683+0000 7fdd147c99c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:24.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.687+0000 7fdd147c99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:27:24.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.687+0000 7fdd147c99c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:24.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.687+0000 7fdd147c99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:27:24.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.687+0000 7fdd147c99c0 20 zone default found 2024-09-12T17:27:24.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.687+0000 7fdd147c99c0 4 Realm: () 2024-09-12T17:27:24.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.687+0000 7fdd147c99c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:27:24.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.687+0000 7fdd147c99c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:27:24.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.687+0000 7fdd147c99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:27:24.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.687+0000 7fdd147c99c0 20 zonegroup default 2024-09-12T17:27:24.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.687+0000 7fdd147c99c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:24.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.687+0000 7fdd147c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:24.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.687+0000 7fdd147c99c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:24.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.687+0000 7fdd147c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:24.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.687+0000 7fdd147c99c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:24.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.687+0000 7fdd147c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:27:24.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.687+0000 7fdd147c99c0 20 started sync module instance, tier type = 2024-09-12T17:27:24.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.687+0000 7fdd147c99c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:27:24.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.715+0000 7fdd147c99c0 20 add_watcher() i=0 2024-09-12T17:27:24.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.715+0000 7fdd147c99c0 20 add_watcher() i=1 2024-09-12T17:27:24.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.715+0000 7fdd147c99c0 20 add_watcher() i=2 2024-09-12T17:27:24.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.715+0000 7fdd147c99c0 20 add_watcher() i=3 2024-09-12T17:27:24.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.715+0000 7fdd147c99c0 20 add_watcher() i=4 2024-09-12T17:27:24.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.715+0000 7fdd147c99c0 20 add_watcher() i=5 2024-09-12T17:27:24.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.715+0000 7fdd147c99c0 20 add_watcher() i=6 2024-09-12T17:27:24.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.715+0000 7fdd147c99c0 20 add_watcher() i=7 2024-09-12T17:27:24.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.715+0000 7fdd147c99c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:27:24.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.723+0000 7fdbc97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:24.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.723+0000 7fdd147c99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:27:24.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.723+0000 7fdd147c99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:27:24.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.723+0000 7fdd147c99c0 5 note: GC not initialized 2024-09-12T17:27:24.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.723+0000 7fdbc37fe640 20 reqs_thread_entry: start 2024-09-12T17:27:24.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.723+0000 7fdd147c99c0 20 init_complete bucket index max shards: 1 2024-09-12T17:27:24.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.723+0000 7fdd147c99c0 20 Filter name: none 2024-09-12T17:27:24.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.723+0000 7fdbc17fa640 20 reqs_thread_entry: start 2024-09-12T17:27:24.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.723+0000 7fdd147c99c0 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T17:27:24.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.723+0000 7fdd147c99c0 20 rados->read ofs=0 len=0 2024-09-12T17:27:24.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.723+0000 7fdd147c99c0 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T17:27:24.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.723+0000 7fdd147c99c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-09-12T17:27:24.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.723+0000 7fdd147c99c0 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T17:27:24.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.723+0000 7fdd147c99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:27:24.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.731+0000 7fdd147c99c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T17:27:24.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.731+0000 7fdd147c99c0 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T17:27:24.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.731+0000 7fdd147c99c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T17:27:24.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.731+0000 7fdbf5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333638 cookie 94546516215296 notifier 9261 bl.length()=695 2024-09-12T17:27:24.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.731+0000 7fdbf5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T17:27:24.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.731+0000 7fdbf5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T17:27:24.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.735+0000 7fdbc97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:27:24.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.739+0000 7fdd147c99c0 20 remove_watcher() i=0 2024-09-12T17:27:24.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.739+0000 7fdd147c99c0 2 removed watcher, disabling cache 2024-09-12T17:27:24.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.743+0000 7fdd147c99c0 20 remove_watcher() i=1 2024-09-12T17:27:24.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.743+0000 7fdd147c99c0 20 remove_watcher() i=2 2024-09-12T17:27:24.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.747+0000 7fdd147c99c0 20 remove_watcher() i=3 2024-09-12T17:27:24.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.751+0000 7fdd147c99c0 20 remove_watcher() i=4 2024-09-12T17:27:24.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.751+0000 7fdd147c99c0 20 remove_watcher() i=5 2024-09-12T17:27:24.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.755+0000 7fdd147c99c0 20 remove_watcher() i=6 2024-09-12T17:27:24.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:27:24.755+0000 7fdd147c99c0 20 remove_watcher() i=7 2024-09-12T17:27:24.785 INFO:tasks.s3tests:Configuring s3-tests... 2024-09-12T17:27:24.786 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-12T17:27:24.786 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-09-12T17:27:24.792 INFO:tasks.s3tests:Configuring boto... 2024-09-12T17:27:24.793 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-12T17:27:24.793 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T17:27:24.842 DEBUG:teuthology.orchestra.run.smithi016:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T17:27:25.022 INFO:teuthology.orchestra.run.smithi016.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-09-12T17:27:25.225 INFO:teuthology.orchestra.run.smithi016.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-09-12T17:27:25.553 INFO:teuthology.orchestra.run.smithi016.stdout:py installdeps: -rrequirements.txt 2024-09-12T17:29:32.080 INFO:teuthology.orchestra.run.smithi016.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-09-12T17:29:34.069 INFO:teuthology.orchestra.run.smithi016.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.5.0,certifi==2024.8.30,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.2,filelock==3.16.0,gevent==24.2.1,greenlet==3.1.0,httplib2==0.22.0,idna==3.8,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.3.0,munch==4.0.0,packaging==24.1,platformdirs==4.3.2,pluggy==1.5.0,pyparsing==3.1.4,pyproject-api==1.7.1,pytest==8.3.3,python-dateutil==2.9.0.post0,pytz==2024.2,PyYAML==6.0.2,requests==2.32.3,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=facc60bc1eb4a32fff728b7d187a93333a91609a4987aa1def81286c7b291ad3,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.18.1,urllib3==1.26.20,virtualenv==20.26.4,zope.event==5.0,zope.interface==7.0.3 2024-09-12T17:29:34.069 INFO:teuthology.orchestra.run.smithi016.stdout:py run-test-pre: PYTHONHASHSEED='2180216597' 2024-09-12T17:29:34.069 INFO:teuthology.orchestra.run.smithi016.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T17:29:34.245 INFO:teuthology.orchestra.run.smithi016.stdout:============================= test session starts ============================== 2024-09-12T17:29:34.245 INFO:teuthology.orchestra.run.smithi016.stdout:platform linux -- Python 3.10.6, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-09-12T17:29:34.245 INFO:teuthology.orchestra.run.smithi016.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T17:29:34.245 INFO:teuthology.orchestra.run.smithi016.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T17:29:34.245 INFO:teuthology.orchestra.run.smithi016.stdout:configfile: pytest.ini 2024-09-12T17:29:36.103 INFO:teuthology.orchestra.run.smithi016.stdout:collecting ... collected 872 items / 126 deselected / 746 selected 2024-09-12T17:29:36.103 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:29:36.266 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-09-12T17:29:36.420 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-09-12T17:29:36.636 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-09-12T17:29:36.854 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-09-12T17:29:37.009 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-09-12T17:29:37.170 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-09-12T17:29:37.401 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-09-12T17:29:37.557 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-09-12T17:29:37.653 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-09-12T17:29:37.749 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-09-12T17:29:38.116 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-09-12T17:29:38.284 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-09-12T17:29:38.443 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-09-12T17:29:38.603 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 1%] 2024-09-12T17:29:38.705 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-09-12T17:29:38.801 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-09-12T17:29:38.857 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-09-12T17:29:38.912 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-09-12T17:29:38.969 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-09-12T17:29:39.024 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-09-12T17:29:39.081 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-09-12T17:29:39.136 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 2%] 2024-09-12T17:29:39.193 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T17:29:39.249 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T17:29:39.305 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T17:29:39.361 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T17:29:39.417 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-09-12T17:29:39.473 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-09-12T17:29:39.529 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-09-12T17:29:39.584 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-09-12T17:29:39.640 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T17:29:39.692 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T17:29:39.744 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T17:29:39.800 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T17:29:39.856 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T17:29:39.912 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T17:29:39.968 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 4%] 2024-09-12T17:29:40.024 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-09-12T17:29:40.081 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-09-12T17:29:40.137 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-09-12T17:29:40.193 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-09-12T17:29:40.249 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T17:29:40.308 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T17:29:40.368 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 5%] 2024-09-12T17:29:40.425 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-09-12T17:29:40.481 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-09-12T17:29:40.537 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-09-12T17:29:40.592 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T17:29:40.648 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T17:29:40.704 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T17:29:40.760 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T17:29:40.817 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 6%] 2024-09-12T17:29:40.873 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-09-12T17:29:41.209 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-09-12T17:29:42.092 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-09-12T17:29:43.909 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-09-12T17:29:45.484 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-09-12T17:29:48.181 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-09-12T17:29:48.989 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 7%] 2024-09-12T17:29:50.101 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-09-12T17:29:50.450 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-09-12T17:29:50.568 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-09-12T17:29:50.814 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-09-12T17:29:51.068 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-09-12T17:29:51.322 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-09-12T17:29:51.514 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 8%] 2024-09-12T17:29:51.640 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 8%] 2024-09-12T17:29:51.642 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T17:29:51.645 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T17:29:51.647 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-09-12T17:29:51.649 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-09-12T17:29:51.651 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T17:29:51.654 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T17:29:51.656 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 9%] 2024-09-12T17:29:51.659 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-09-12T17:29:51.661 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T17:29:51.663 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T17:29:51.668 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T17:29:51.669 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-09-12T17:29:51.670 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T17:29:51.674 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T17:29:51.674 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T17:29:51.676 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T17:29:51.679 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T17:29:51.681 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T17:29:51.683 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T17:29:51.685 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-09-12T17:29:51.687 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 11%] 2024-09-12T17:29:51.689 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 11%] 2024-09-12T17:29:51.691 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-09-12T17:29:51.693 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-09-12T17:29:51.695 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-09-12T17:29:51.697 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-09-12T17:29:51.698 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-09-12T17:29:51.808 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 12%] 2024-09-12T17:29:51.820 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 12%] 2024-09-12T17:29:52.182 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-09-12T17:29:55.411 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-09-12T17:29:55.650 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-09-12T17:29:55.987 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-09-12T17:29:56.324 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-09-12T17:29:56.659 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 13%] 2024-09-12T17:29:56.990 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 13%] 2024-09-12T17:29:57.239 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 13%] 2024-09-12T17:29:57.611 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-09-12T17:29:57.909 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-09-12T17:29:58.208 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-09-12T17:29:58.456 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-09-12T17:29:58.679 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 14%] 2024-09-12T17:29:58.901 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 14%] 2024-09-12T17:29:59.008 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 14%] 2024-09-12T17:29:59.241 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-09-12T17:29:59.562 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-09-12T17:29:59.918 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-09-12T17:30:00.163 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-09-12T17:30:00.409 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-09-12T17:30:00.655 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 15%] 2024-09-12T17:30:00.891 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 15%] 2024-09-12T17:30:01.130 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 15%] 2024-09-12T17:30:01.354 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-09-12T17:30:01.572 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-09-12T17:30:01.682 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-09-12T17:30:01.814 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-09-12T17:30:01.896 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-09-12T17:30:01.977 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 16%] 2024-09-12T17:30:02.057 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-09-12T17:30:02.249 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-09-12T17:30:02.337 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-09-12T17:30:02.438 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-09-12T17:30:02.693 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-09-12T17:30:02.944 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 17%] 2024-09-12T17:30:03.089 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 17%] 2024-09-12T17:30:03.322 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 17%] 2024-09-12T17:30:03.569 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 17%] 2024-09-12T17:30:03.938 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T17:30:04.134 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-09-12T17:30:04.382 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-09-12T17:30:04.623 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 18%] 2024-09-12T17:30:05.123 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T17:30:05.452 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T17:30:05.814 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T17:30:06.123 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T17:30:06.615 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T17:30:07.097 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T17:30:07.689 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T17:30:08.080 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T17:30:08.545 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T17:30:08.928 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 19%] 2024-09-12T17:30:09.384 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 19%] 2024-09-12T17:30:09.645 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-09-12T17:30:10.578 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-09-12T17:30:11.186 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-09-12T17:30:11.951 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 20%] 2024-09-12T17:30:13.663 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 20%] 2024-09-12T17:30:16.011 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 20%] 2024-09-12T17:30:17.285 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 20%] 2024-09-12T17:30:18.404 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-09-12T17:30:19.170 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-09-12T17:30:19.627 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-09-12T17:30:20.597 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 21%] 2024-09-12T17:30:21.249 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 21%] 2024-09-12T17:30:22.174 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 21%] 2024-09-12T17:30:22.776 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 21%] 2024-09-12T17:30:24.050 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 21%] 2024-09-12T17:30:24.880 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-09-12T17:30:26.226 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-09-12T17:30:27.555 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 22%] 2024-09-12T17:30:28.424 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 22%] 2024-09-12T17:30:29.176 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 22%] 2024-09-12T17:30:29.792 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 22%] 2024-09-12T17:30:31.496 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 22%] 2024-09-12T17:30:32.694 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-09-12T17:30:34.069 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-09-12T17:30:35.370 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-09-12T17:30:36.561 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 23%] 2024-09-12T17:30:37.745 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 23%] 2024-09-12T17:30:38.632 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 23%] 2024-09-12T17:30:39.247 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 23%] 2024-09-12T17:30:39.984 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 23%] 2024-09-12T17:30:41.521 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-09-12T17:30:43.566 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-09-12T17:30:44.323 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 24%] 2024-09-12T17:30:45.569 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 24%] 2024-09-12T17:30:46.806 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 24%] 2024-09-12T17:30:47.861 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 24%] 2024-09-12T17:30:48.983 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 24%] 2024-09-12T17:30:50.183 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-09-12T17:30:51.277 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-09-12T17:30:52.354 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 25%] 2024-09-12T17:30:53.091 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 25%] 2024-09-12T17:30:53.682 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_new_client_id_to_oidc PASSED [ 25%] 2024-09-12T17:30:54.272 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_existing_client_id_to_oidc PASSED [ 25%] 2024-09-12T17:30:54.924 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_verify_update_thumbprintlist_of_oidc PASSED [ 25%] 2024-09-12T17:30:55.900 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-09-12T17:30:56.933 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-09-12T17:30:57.961 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-09-12T17:30:58.953 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-09-12T17:30:59.980 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-09-12T17:31:01.024 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-09-12T17:31:02.017 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 26%] 2024-09-12T17:31:03.052 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 26%] 2024-09-12T17:31:04.046 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-09-12T17:31:05.066 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T17:31:06.118 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-09-12T17:31:07.152 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-09-12T17:31:07.717 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-09-12T17:31:08.287 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 27%] 2024-09-12T17:31:09.020 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T17:31:09.583 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-09-12T17:31:09.877 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-09-12T17:31:10.348 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-09-12T17:31:10.753 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-09-12T17:31:11.159 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-09-12T17:31:11.558 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 28%] 2024-09-12T17:31:11.933 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 28%] 2024-09-12T17:31:12.354 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 28%] 2024-09-12T17:31:12.725 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-09-12T17:31:13.102 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-09-12T17:31:13.593 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-09-12T17:31:14.097 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-09-12T17:31:14.418 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T17:31:14.789 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T17:31:15.164 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 29%] 2024-09-12T17:31:15.532 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-09-12T17:31:16.034 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T17:31:16.535 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T17:31:16.969 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-09-12T17:31:17.324 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-09-12T17:31:17.700 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 30%] 2024-09-12T17:31:18.076 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 30%] 2024-09-12T17:31:18.450 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 30%] 2024-09-12T17:31:18.827 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-09-12T17:31:19.203 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-09-12T17:31:19.622 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-09-12T17:31:20.000 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-09-12T17:31:20.381 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 31%] 2024-09-12T17:31:20.764 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 31%] 2024-09-12T17:31:21.137 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 31%] 2024-09-12T17:31:21.501 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-09-12T17:31:21.855 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-09-12T17:31:22.259 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-09-12T17:31:22.648 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-09-12T17:31:23.029 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 32%] 2024-09-12T17:31:44.607 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 32%] 2024-09-12T17:31:44.891 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 32%] 2024-09-12T17:31:45.244 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 32%] 2024-09-12T17:31:45.609 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-09-12T17:31:45.965 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-09-12T17:31:46.314 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-09-12T17:31:46.718 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 33%] 2024-09-12T17:31:47.079 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 33%] 2024-09-12T17:31:47.443 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 33%] 2024-09-12T17:31:47.803 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 33%] 2024-09-12T17:31:48.153 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-09-12T17:31:48.509 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-09-12T17:31:48.864 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-09-12T17:31:49.301 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T17:31:49.679 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T17:31:50.059 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T17:31:50.389 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T17:31:50.763 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 34%] 2024-09-12T17:31:51.142 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-09-12T17:31:51.576 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T17:31:51.961 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T17:31:52.334 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T17:31:52.713 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T17:31:53.141 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 35%] 2024-09-12T17:31:53.574 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 35%] 2024-09-12T17:31:53.952 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-09-12T17:31:54.374 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-09-12T17:31:54.748 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-09-12T17:31:55.121 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 36%] 2024-09-12T17:31:55.237 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 36%] 2024-09-12T17:31:55.555 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 36%] 2024-09-12T17:31:56.619 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 36%] 2024-09-12T17:31:57.731 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 36%] 2024-09-12T17:31:58.113 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-09-12T17:31:58.494 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-09-12T17:31:58.877 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 37%] 2024-09-12T17:31:59.253 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 37%] 2024-09-12T17:31:59.677 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 37%] 2024-09-12T17:32:00.141 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 37%] 2024-09-12T17:32:00.516 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 37%] 2024-09-12T17:32:00.890 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-09-12T17:32:01.268 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-09-12T17:32:01.648 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-09-12T17:32:02.022 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 38%] 2024-09-12T17:32:02.448 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 38%] 2024-09-12T17:32:03.016 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 38%] 2024-09-12T17:32:03.755 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 38%] 2024-09-12T17:32:04.024 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-09-12T17:32:04.290 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-09-12T17:32:04.535 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-09-12T17:32:04.775 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 39%] 2024-09-12T17:32:04.886 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 39%] 2024-09-12T17:32:05.032 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 39%] 2024-09-12T17:32:05.120 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 39%] 2024-09-12T17:32:05.429 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 39%] 2024-09-12T17:32:05.752 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-09-12T17:32:05.873 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-09-12T17:32:06.167 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 40%] 2024-09-12T17:32:06.409 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 40%] 2024-09-12T17:32:06.656 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 40%] 2024-09-12T17:32:06.953 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 40%] 2024-09-12T17:32:07.620 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 40%] 2024-09-12T17:32:08.124 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-09-12T17:32:08.627 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-09-12T17:32:30.223 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 41%] 2024-09-12T17:32:52.078 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 41%] 2024-09-12T17:32:52.358 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 41%] 2024-09-12T17:32:52.726 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 41%] 2024-09-12T17:32:53.012 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 41%] 2024-09-12T17:32:53.327 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 41%] 2024-09-12T17:32:53.732 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-09-12T17:32:54.058 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-09-12T17:32:54.375 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 42%] 2024-09-12T17:32:54.743 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 42%] 2024-09-12T17:32:55.083 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 42%] 2024-09-12T17:32:55.454 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 42%] 2024-09-12T17:32:55.864 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 42%] 2024-09-12T17:32:56.182 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-09-12T17:32:56.526 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-09-12T17:32:56.761 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 43%] 2024-09-12T17:32:57.055 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 43%] 2024-09-12T17:32:57.352 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 43%] 2024-09-12T17:32:57.709 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 43%] 2024-09-12T17:32:58.030 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 43%] 2024-09-12T17:32:58.334 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 43%] 2024-09-12T17:32:58.693 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-09-12T17:32:59.022 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 44%] 2024-09-12T17:32:59.372 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 44%] 2024-09-12T17:32:59.617 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 44%] 2024-09-12T17:32:59.869 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 44%] 2024-09-12T17:33:00.088 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 44%] 2024-09-12T17:33:00.331 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 44%] 2024-09-12T17:33:00.635 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-09-12T17:33:00.808 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 45%] 2024-09-12T17:33:01.170 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 45%] 2024-09-12T17:33:01.418 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 45%] 2024-09-12T17:33:01.660 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 45%] 2024-09-12T17:33:01.896 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 45%] 2024-09-12T17:33:02.137 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 45%] 2024-09-12T17:33:02.506 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 45%] 2024-09-12T17:33:02.747 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-09-12T17:33:02.987 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 46%] 2024-09-12T17:33:03.228 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 46%] 2024-09-12T17:33:03.579 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 46%] 2024-09-12T17:33:03.762 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 46%] 2024-09-12T17:33:04.006 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 46%] 2024-09-12T17:33:04.256 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 46%] 2024-09-12T17:33:04.653 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-09-12T17:33:04.895 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 47%] 2024-09-12T17:33:05.253 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 47%] 2024-09-12T17:33:05.623 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 47%] 2024-09-12T17:33:06.005 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 47%] 2024-09-12T17:33:06.344 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 47%] 2024-09-12T17:33:06.705 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 47%] 2024-09-12T17:33:08.044 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 47%] 2024-09-12T17:33:08.411 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 48%] 2024-09-12T17:33:08.774 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 48%] 2024-09-12T17:33:09.207 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 48%] 2024-09-12T17:33:09.674 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 48%] 2024-09-12T17:33:10.108 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 48%] 2024-09-12T17:33:10.520 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 48%] 2024-09-12T17:33:10.952 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 48%] 2024-09-12T17:33:11.423 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 49%] 2024-09-12T17:33:11.791 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 49%] 2024-09-12T17:33:12.259 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 49%] 2024-09-12T17:33:12.569 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 49%] 2024-09-12T17:33:12.803 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 49%] 2024-09-12T17:33:13.038 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 49%] 2024-09-12T17:33:13.358 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 49%] 2024-09-12T17:33:13.606 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-09-12T17:33:13.718 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 50%] 2024-09-12T17:33:14.123 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 50%] 2024-09-12T17:33:14.432 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 50%] 2024-09-12T17:33:14.749 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 50%] 2024-09-12T17:33:17.375 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 50%] 2024-09-12T17:33:17.693 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 50%] 2024-09-12T17:33:18.066 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 50%] 2024-09-12T17:33:18.377 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 51%] 2024-09-12T17:33:18.690 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 51%] 2024-09-12T17:33:18.964 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 51%] 2024-09-12T17:33:19.291 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 51%] 2024-09-12T17:33:19.599 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 51%] 2024-09-12T17:33:19.916 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 51%] 2024-09-12T17:33:20.229 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 51%] 2024-09-12T17:33:20.544 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 52%] 2024-09-12T17:33:20.901 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 52%] 2024-09-12T17:33:21.217 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 52%] 2024-09-12T17:33:21.557 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 52%] 2024-09-12T17:33:21.868 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 52%] 2024-09-12T17:33:22.176 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 52%] 2024-09-12T17:33:22.479 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 52%] 2024-09-12T17:33:22.793 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 52%] 2024-09-12T17:33:22.912 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 53%] 2024-09-12T17:33:23.071 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 53%] 2024-09-12T17:33:23.147 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 53%] 2024-09-12T17:33:23.346 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 53%] 2024-09-12T17:33:23.570 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 53%] 2024-09-12T17:33:23.799 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 53%] 2024-09-12T17:33:24.025 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 53%] 2024-09-12T17:33:24.311 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 54%] 2024-09-12T17:33:24.425 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 54%] 2024-09-12T17:33:24.526 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 54%] 2024-09-12T17:33:24.745 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 54%] 2024-09-12T17:33:24.862 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 54%] 2024-09-12T17:33:24.971 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 54%] 2024-09-12T17:33:25.076 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 54%] 2024-09-12T17:33:25.181 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 54%] 2024-09-12T17:33:25.431 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 55%] 2024-09-12T17:33:25.764 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 55%] 2024-09-12T17:33:26.010 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 55%] 2024-09-12T17:33:26.291 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 55%] 2024-09-12T17:33:26.572 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 55%] 2024-09-12T17:33:26.820 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 55%] 2024-09-12T17:33:27.105 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 55%] 2024-09-12T17:33:27.448 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 56%] 2024-09-12T17:33:27.728 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T17:33:28.021 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T17:33:28.434 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 56%] 2024-09-12T17:33:28.790 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 56%] 2024-09-12T17:33:29.216 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 56%] 2024-09-12T17:33:29.570 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T17:33:29.934 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T17:33:30.363 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 57%] 2024-09-12T17:33:30.787 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 57%] 2024-09-12T17:33:31.176 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 57%] 2024-09-12T17:33:31.583 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 57%] 2024-09-12T17:33:31.835 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 57%] 2024-09-12T17:33:32.450 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 57%] 2024-09-12T17:33:32.675 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 57%] 2024-09-12T17:33:33.103 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 58%] 2024-09-12T17:33:33.536 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 58%] 2024-09-12T17:33:33.956 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 58%] 2024-09-12T17:33:34.401 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 58%] 2024-09-12T17:33:34.811 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 58%] 2024-09-12T17:33:35.183 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 58%] 2024-09-12T17:33:35.630 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 58%] 2024-09-12T17:33:36.015 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 58%] 2024-09-12T17:33:36.271 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 59%] 2024-09-12T17:33:36.693 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 59%] 2024-09-12T17:33:37.062 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 59%] 2024-09-12T17:33:37.375 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 59%] 2024-09-12T17:33:37.648 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 59%] 2024-09-12T17:33:38.066 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 59%] 2024-09-12T17:33:38.637 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 59%] 2024-09-12T17:33:39.198 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 60%] 2024-09-12T17:33:39.812 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 60%] 2024-09-12T17:33:40.384 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 60%] 2024-09-12T17:33:40.948 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 60%] 2024-09-12T17:33:41.509 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 60%] 2024-09-12T17:33:42.070 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 60%] 2024-09-12T17:33:42.689 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 60%] 2024-09-12T17:33:43.256 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 60%] 2024-09-12T17:33:43.806 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 61%] 2024-09-12T17:33:44.351 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 61%] 2024-09-12T17:33:44.896 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 61%] 2024-09-12T17:33:45.632 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 61%] 2024-09-12T17:33:46.423 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 61%] 2024-09-12T17:33:46.498 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 61%] 2024-09-12T17:33:46.588 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 61%] 2024-09-12T17:33:46.679 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 62%] 2024-09-12T17:33:46.923 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 62%] 2024-09-12T17:33:47.188 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 62%] 2024-09-12T17:33:47.423 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 62%] 2024-09-12T17:33:47.662 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 62%] 2024-09-12T17:33:48.065 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 62%] 2024-09-12T17:33:49.374 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 62%] 2024-09-12T17:33:49.806 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 63%] 2024-09-12T17:33:50.210 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 63%] 2024-09-12T17:33:50.914 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 63%] 2024-09-12T17:33:51.345 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 63%] 2024-09-12T17:33:51.771 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 63%] 2024-09-12T17:33:52.212 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 63%] 2024-09-12T17:33:52.577 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 63%] 2024-09-12T17:33:53.182 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 63%] 2024-09-12T17:33:53.608 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 64%] 2024-09-12T17:33:54.060 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 64%] 2024-09-12T17:33:54.538 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 64%] 2024-09-12T17:33:55.286 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 64%] 2024-09-12T17:33:56.026 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 64%] 2024-09-12T17:33:56.275 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 64%] 2024-09-12T17:33:56.522 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 64%] 2024-09-12T17:33:57.850 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 65%] 2024-09-12T17:33:58.331 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 65%] 2024-09-12T17:34:00.686 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 65%] 2024-09-12T17:34:01.041 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 65%] 2024-09-12T17:34:01.403 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 65%] 2024-09-12T17:34:02.301 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 65%] 2024-09-12T17:34:02.709 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2024-09-12T17:34:03.456 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2024-09-12T17:34:05.640 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 66%] 2024-09-12T17:34:07.430 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 66%] 2024-09-12T17:34:11.054 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 66%] 2024-09-12T17:34:19.911 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 66%] 2024-09-12T17:34:22.140 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 66%] 2024-09-12T17:34:25.094 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 66%] 2024-09-12T17:34:25.653 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2024-09-12T17:34:26.627 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 67%] 2024-09-12T17:34:27.567 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 67%] 2024-09-12T17:34:28.182 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 67%] 2024-09-12T17:34:28.541 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 67%] 2024-09-12T17:34:29.478 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 67%] 2024-09-12T17:34:29.910 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2024-09-12T17:34:30.267 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2024-09-12T17:34:30.623 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2024-09-12T17:34:44.474 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 68%] 2024-09-12T17:34:46.501 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part PASSED [ 68%] 2024-09-12T17:34:46.910 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 68%] 2024-09-12T17:34:47.158 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 68%] 2024-09-12T17:34:47.527 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 68%] 2024-09-12T17:34:50.940 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2024-09-12T17:34:54.219 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2024-09-12T17:34:57.499 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 69%] 2024-09-12T17:34:57.879 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 69%] 2024-09-12T17:34:58.196 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 69%] 2024-09-12T17:34:58.516 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 69%] 2024-09-12T17:34:58.841 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 69%] 2024-09-12T17:34:59.158 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 69%] 2024-09-12T17:34:59.473 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 69%] 2024-09-12T17:34:59.836 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 69%] 2024-09-12T17:35:00.294 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 70%] 2024-09-12T17:35:00.937 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 70%] 2024-09-12T17:35:01.666 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 70%] 2024-09-12T17:35:02.192 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 70%] 2024-09-12T17:35:03.000 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 70%] 2024-09-12T17:35:04.008 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 70%] 2024-09-12T17:35:04.610 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 70%] 2024-09-12T17:35:05.508 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 71%] 2024-09-12T17:35:06.649 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 71%] 2024-09-12T17:35:07.100 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 71%] 2024-09-12T17:35:07.579 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 71%] 2024-09-12T17:35:08.239 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 71%] 2024-09-12T17:35:08.598 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 71%] 2024-09-12T17:35:13.626 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 71%] 2024-09-12T17:35:13.985 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-09-12T17:35:14.343 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 72%] 2024-09-12T17:35:14.712 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 72%] 2024-09-12T17:35:15.073 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 72%] 2024-09-12T17:35:15.608 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 72%] 2024-09-12T17:35:23.692 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 72%] 2024-09-12T17:35:24.394 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 72%] 2024-09-12T17:35:24.834 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-09-12T17:35:25.489 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 73%] 2024-09-12T17:35:26.186 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 73%] 2024-09-12T17:35:29.562 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 73%] 2024-09-12T17:35:30.224 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 73%] 2024-09-12T17:35:34.308 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 73%] 2024-09-12T17:35:49.757 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 73%] 2024-09-12T17:35:52.979 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-09-12T17:35:54.318 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-09-12T17:35:55.819 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 74%] 2024-09-12T17:35:56.407 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 74%] 2024-09-12T17:35:57.024 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 74%] 2024-09-12T17:35:57.516 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 74%] 2024-09-12T17:35:58.216 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 74%] 2024-09-12T17:35:58.793 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-09-12T17:35:59.397 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-09-12T17:35:59.670 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 75%] 2024-09-12T17:35:59.995 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 75%] 2024-09-12T17:36:00.319 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 75%] 2024-09-12T17:36:00.568 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 75%] 2024-09-12T17:36:00.865 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-09-12T17:36:01.217 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-09-12T17:36:01.485 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-09-12T17:36:01.735 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 76%] 2024-09-12T17:36:02.100 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 76%] 2024-09-12T17:36:02.380 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 76%] 2024-09-12T17:36:02.656 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 76%] 2024-09-12T17:36:02.934 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-09-12T17:36:03.202 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-09-12T17:36:03.488 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-09-12T17:36:03.848 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-09-12T17:36:04.207 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 77%] 2024-09-12T17:36:04.580 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 77%] 2024-09-12T17:36:04.936 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 77%] 2024-09-12T17:36:05.264 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-09-12T17:36:05.631 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-09-12T17:36:06.009 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-09-12T17:36:06.354 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-09-12T17:36:06.657 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 78%] 2024-09-12T17:36:06.955 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 78%] 2024-09-12T17:36:07.247 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-09-12T17:36:09.947 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-09-12T17:36:12.825 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-09-12T17:36:14.423 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-09-12T17:36:14.743 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-09-12T17:37:15.702 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_enforced_with_bucket_policy PASSED [ 78%] 2024-09-12T17:38:16.963 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_deny_algo_with_bucket_policy PASSED [ 79%] 2024-09-12T17:38:17.299 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 79%] 2024-09-12T17:38:17.660 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 79%] 2024-09-12T17:38:17.960 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-09-12T17:38:18.210 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-09-12T17:38:20.496 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-09-12T17:38:21.932 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-09-12T17:38:23.440 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 80%] 2024-09-12T17:38:23.755 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 80%] 2024-09-12T17:38:24.123 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 80%] 2024-09-12T17:38:24.485 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-09-12T17:38:24.857 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-09-12T17:38:25.218 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-09-12T17:38:25.585 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-09-12T17:38:25.939 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-09-12T17:38:26.331 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 81%] 2024-09-12T17:38:26.707 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-09-12T17:38:27.087 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-09-12T17:38:27.424 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_different_tenant PASSED [ 81%] 2024-09-12T17:38:27.751 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_tenanted_bucket PASSED [ 81%] 2024-09-12T17:38:28.363 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-09-12T17:38:28.972 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-09-12T17:38:29.570 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 82%] 2024-09-12T17:38:30.084 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 82%] 2024-09-12T17:38:30.630 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-09-12T17:38:31.175 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-09-12T17:38:31.733 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-09-12T17:38:32.265 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-09-12T17:38:32.767 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-09-12T17:38:33.511 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-09-12T17:38:34.148 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 83%] 2024-09-12T17:38:34.546 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-09-12T17:38:34.868 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-09-12T17:38:35.282 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-09-12T17:38:35.812 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-09-12T17:38:36.366 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-09-12T17:38:37.020 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-09-12T17:38:37.931 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 84%] 2024-09-12T17:38:41.837 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-09-12T17:38:42.330 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-09-12T17:38:42.907 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T17:38:43.438 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T17:38:44.270 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-09-12T17:38:44.940 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-09-12T17:38:45.331 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 84%] 2024-09-12T17:38:45.929 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-09-12T17:38:46.182 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-09-12T17:38:46.428 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-09-12T17:38:46.675 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-09-12T17:38:46.964 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-09-12T17:38:47.316 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-09-12T17:38:47.625 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 85%] 2024-09-12T17:38:48.210 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-09-12T17:38:48.514 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-09-12T17:38:48.800 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-09-12T17:38:49.083 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-09-12T17:38:49.371 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-09-12T17:38:49.663 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 86%] 2024-09-12T17:38:50.055 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 86%] 2024-09-12T17:38:50.342 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 86%] 2024-09-12T17:38:50.627 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-09-12T17:38:50.919 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-09-12T17:38:51.198 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-09-12T17:38:51.575 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-09-12T17:38:51.937 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 87%] 2024-09-12T17:38:52.359 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 87%] 2024-09-12T17:38:52.738 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 87%] 2024-09-12T17:38:53.130 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-09-12T17:38:53.481 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-09-12T17:38:53.943 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-09-12T17:38:54.327 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-09-12T17:38:54.719 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 88%] 2024-09-12T17:38:55.100 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 88%] 2024-09-12T17:38:55.488 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 88%] 2024-09-12T17:38:55.858 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-09-12T17:38:56.353 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention PASSED [ 89%] 2024-09-12T17:38:56.832 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-09-12T17:38:57.248 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-09-12T17:38:57.659 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 89%] 2024-09-12T17:38:58.011 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 89%] 2024-09-12T17:38:58.382 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 89%] 2024-09-12T17:38:58.835 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 89%] 2024-09-12T17:38:59.195 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-09-12T17:38:59.600 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T17:39:00.118 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T17:39:00.444 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-09-12T17:39:00.807 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 90%] 2024-09-12T17:39:01.188 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 90%] 2024-09-12T17:39:11.400 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 90%] 2024-09-12T17:39:11.771 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-09-12T17:39:21.176 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-09-12T17:39:21.599 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-09-12T17:39:22.023 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 91%] 2024-09-12T17:39:22.272 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 91%] 2024-09-12T17:39:22.580 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T17:39:22.886 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T17:39:23.220 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T17:39:23.526 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-09-12T17:39:23.827 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_principal_bucket_policy_status PASSED [ 92%] 2024-09-12T17:39:24.078 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_allow_notprincipal PASSED [ 92%] 2024-09-12T17:39:24.385 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 92%] 2024-09-12T17:39:24.751 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 92%] 2024-09-12T17:39:25.054 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 92%] 2024-09-12T17:39:25.510 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 92%] 2024-09-12T17:39:25.989 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-09-12T17:39:26.268 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-09-12T17:39:26.531 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy_with_principal PASSED [ 93%] 2024-09-12T17:39:27.042 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-09-12T17:39:28.838 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-09-12T17:39:29.095 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 93%] 2024-09-12T17:39:29.407 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 93%] 2024-09-12T17:39:29.743 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 93%] 2024-09-12T17:39:30.116 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-09-12T17:39:30.664 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-09-12T17:39:31.050 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_object_checksum_sha256 PASSED [ 94%] 2024-09-12T17:39:31.771 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_sha256 PASSED [ 94%] 2024-09-12T17:39:32.623 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_3parts PASSED [ 94%] 2024-09-12T17:39:33.005 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_checksum PASSED [ 94%] 2024-09-12T17:39:34.492 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-09-12T17:39:35.728 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-09-12T17:39:35.888 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-09-12T17:39:36.169 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-09-12T17:39:37.541 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-09-12T17:39:39.047 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-09-12T17:39:39.704 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-09-12T17:39:40.073 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-09-12T17:39:40.427 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 95%] 2024-09-12T17:39:40.831 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-09-12T17:39:40.993 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-09-12T17:39:41.501 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-09-12T17:39:42.119 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-09-12T17:39:44.266 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-09-12T17:39:44.804 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-09-12T17:39:45.142 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 96%] 2024-09-12T17:39:45.453 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-09-12T17:39:45.703 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-09-12T17:39:46.309 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-09-12T17:39:46.921 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-09-12T17:39:47.212 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-09-12T17:39:47.567 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 97%] 2024-09-12T17:39:48.003 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 97%] 2024-09-12T17:39:48.605 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 97%] 2024-09-12T17:39:49.066 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-09-12T17:39:49.462 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-09-12T17:39:49.529 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-09-12T17:39:50.042 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-09-12T17:39:50.928 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 98%] 2024-09-12T17:39:51.438 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 98%] 2024-09-12T17:39:51.858 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 98%] 2024-09-12T17:39:52.241 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-09-12T17:40:02.823 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-09-12T17:40:02.918 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-09-12T17:40:03.592 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic PASSED [ 99%] 2024-09-12T17:40:04.169 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic PASSED [ 99%] 2024-09-12T17:40:04.661 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic_publish PASSED [ 99%] 2024-09-12T17:40:05.293 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish PASSED [ 99%] 2024-09-12T17:40:05.338 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-09-12T17:40:05.338 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:40:05.338 INFO:teuthology.orchestra.run.smithi016.stdout:=============================== warnings summary =============================== 2024-09-12T17:40:05.338 INFO:teuthology.orchestra.run.smithi016.stdout:.tox/py/lib/python3.10/site-packages/boto/plugin.py:40 2024-09-12T17:40:05.338 INFO:teuthology.orchestra.run.smithi016.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.10/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses 2024-09-12T17:40:05.338 INFO:teuthology.orchestra.run.smithi016.stdout: import imp 2024-09-12T17:40:05.338 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:40:05.339 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py:120 2024-09-12T17:40:05.339 INFO:teuthology.orchestra.run.smithi016.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T17:40:05.339 INFO:teuthology.orchestra.run.smithi016.stdout: if boto_type is 'S3Connection': 2024-09-12T17:40:05.339 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:40:05.339 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_headers.py:124 2024-09-12T17:40:05.339 INFO:teuthology.orchestra.run.smithi016.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T17:40:05.339 INFO:teuthology.orchestra.run.smithi016.stdout: elif boto_type is 'HTTPRequest': 2024-09-12T17:40:05.339 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:40:05.340 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_s3.py:359 2024-09-12T17:40:05.340 INFO:teuthology.orchestra.run.smithi016.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence '\W' 2024-09-12T17:40:05.340 INFO:teuthology.orchestra.run.smithi016.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-09-12T17:40:05.340 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:40:05.340 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_s3_website.py:176 2024-09-12T17:40:05.340 INFO:teuthology.orchestra.run.smithi016.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T17:40:05.340 INFO:teuthology.orchestra.run.smithi016.stdout: if k is 'BucketName': 2024-09-12T17:40:05.340 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:40:05.340 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_s3_website.py:253 2024-09-12T17:40:05.341 INFO:teuthology.orchestra.run.smithi016.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-09-12T17:40:05.341 INFO:teuthology.orchestra.run.smithi016.stdout: @pytest.mark.timeout(10) 2024-09-12T17:40:05.341 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:40:05.341 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests/functional/test_s3_website.py:1077 2024-09-12T17:40:05.341 INFO:teuthology.orchestra.run.smithi016.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-09-12T17:40:05.341 INFO:teuthology.orchestra.run.smithi016.stdout: @pytest.mark.s3website_routing_rules 2024-09-12T17:40:05.341 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:40:05.341 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py:2214 2024-09-12T17:40:05.341 INFO:teuthology.orchestra.run.smithi016.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2214: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T17:40:05.341 INFO:teuthology.orchestra.run.smithi016.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T17:40:05.341 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:40:05.342 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py:2229 2024-09-12T17:40:05.342 INFO:teuthology.orchestra.run.smithi016.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2229: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T17:40:05.342 INFO:teuthology.orchestra.run.smithi016.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T17:40:05.342 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:40:05.342 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py:2235 2024-09-12T17:40:05.342 INFO:teuthology.orchestra.run.smithi016.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2235: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T17:40:05.342 INFO:teuthology.orchestra.run.smithi016.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-09-12T17:40:05.342 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:40:05.342 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py:2292 2024-09-12T17:40:05.342 INFO:teuthology.orchestra.run.smithi016.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2292: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T17:40:05.342 INFO:teuthology.orchestra.run.smithi016.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T17:40:05.342 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:40:05.343 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py:2307 2024-09-12T17:40:05.343 INFO:teuthology.orchestra.run.smithi016.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2307: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T17:40:05.343 INFO:teuthology.orchestra.run.smithi016.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T17:40:05.343 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:40:05.343 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py:2325 2024-09-12T17:40:05.343 INFO:teuthology.orchestra.run.smithi016.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2325: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T17:40:05.343 INFO:teuthology.orchestra.run.smithi016.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T17:40:05.343 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:40:05.343 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py:2340 2024-09-12T17:40:05.344 INFO:teuthology.orchestra.run.smithi016.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2340: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T17:40:05.344 INFO:teuthology.orchestra.run.smithi016.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-09-12T17:40:05.344 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:40:05.344 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py:2358 2024-09-12T17:40:05.344 INFO:teuthology.orchestra.run.smithi016.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2358: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T17:40:05.344 INFO:teuthology.orchestra.run.smithi016.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T17:40:05.344 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:40:05.345 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py:2373 2024-09-12T17:40:05.345 INFO:teuthology.orchestra.run.smithi016.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2373: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T17:40:05.345 INFO:teuthology.orchestra.run.smithi016.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T17:40:05.345 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:40:05.345 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py:2423 2024-09-12T17:40:05.345 INFO:teuthology.orchestra.run.smithi016.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2423: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T17:40:05.345 INFO:teuthology.orchestra.run.smithi016.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T17:40:05.345 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:40:05.345 INFO:teuthology.orchestra.run.smithi016.stdout:s3tests_boto3/functional/test_s3.py:2455 2024-09-12T17:40:05.345 INFO:teuthology.orchestra.run.smithi016.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2455: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T17:40:05.345 INFO:teuthology.orchestra.run.smithi016.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T17:40:05.345 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:40:05.346 INFO:teuthology.orchestra.run.smithi016.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-12T17:40:05.346 INFO:teuthology.orchestra.run.smithi016.stdout:= 680 passed, 65 skipped, 126 deselected, 1 xfailed, 18 warnings in 631.09s (0:10:31) = 2024-09-12T17:40:05.518 INFO:teuthology.orchestra.run.smithi016.stdout:___________________________________ summary ____________________________________ 2024-09-12T17:40:05.518 INFO:teuthology.orchestra.run.smithi016.stdout: py: commands succeeded 2024-09-12T17:40:05.518 INFO:teuthology.orchestra.run.smithi016.stdout: congratulations :) 2024-09-12T17:40:05.557 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2024-09-12T17:40:05.558 DEBUG:teuthology.orchestra.run.smithi016:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T17:40:05.655 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:40:05.656 INFO:tasks.s3tests:Cleaning up boto... 2024-09-12T17:40:05.656 DEBUG:teuthology.orchestra.run.smithi016:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T17:40:05.661 INFO:tasks.s3tests:Removing s3-tests... 2024-09-12T17:40:05.661 DEBUG:teuthology.orchestra.run.smithi016:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T17:40:05.850 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:40:06.090 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:40:06.090 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:40:06.090 DEBUG:teuthology.orchestra.run.smithi016:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:40:06.103 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:40:06.104 INFO:teuthology.orchestra.run.smithi016.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:40:06.104 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:40:06.157 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:40:06.158 DEBUG:teuthology.orchestra.run.smithi016:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:40:06.207 INFO:tasks.workunit:timeout=3h 2024-09-12T17:40:06.207 INFO:tasks.workunit:cleanup=True 2024-09-12T17:40:06.208 DEBUG:teuthology.orchestra.run.smithi016:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:40:06.264 INFO:tasks.workunit.client.0.smithi016.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:41:03.790 INFO:tasks.workunit.client.0.smithi016.stderr:Updating files: 95% (12070/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-12T17:41:04.656 INFO:tasks.workunit.client.0.smithi016.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:41:04.656 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:41:04.656 INFO:tasks.workunit.client.0.smithi016.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:41:04.656 INFO:tasks.workunit.client.0.smithi016.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:41:04.656 INFO:tasks.workunit.client.0.smithi016.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:41:04.656 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:41:04.656 INFO:tasks.workunit.client.0.smithi016.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:41:04.656 INFO:tasks.workunit.client.0.smithi016.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:41:04.657 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:41:04.657 INFO:tasks.workunit.client.0.smithi016.stderr: git switch -c 2024-09-12T17:41:04.657 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:41:04.657 INFO:tasks.workunit.client.0.smithi016.stderr:Or undo this operation with: 2024-09-12T17:41:04.657 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:41:04.657 INFO:tasks.workunit.client.0.smithi016.stderr: git switch - 2024-09-12T17:41:04.657 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:41:04.657 INFO:tasks.workunit.client.0.smithi016.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:41:04.657 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:41:04.657 INFO:tasks.workunit.client.0.smithi016.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:41:04.664 DEBUG:teuthology.orchestra.run.smithi016:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:41:04.716 INFO:tasks.workunit.client.0.smithi016.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:41:04.720 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:41:04.720 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:41:04.775 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:41:04.829 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:41:04.875 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:41:04.876 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:41:04.876 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:41:04.925 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:41:04.929 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-12T17:41:04.929 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:41:04.974 INFO:tasks.workunit:Running workunits matching rgw/run-versioning.sh on client.0... 2024-09-12T17:41:04.976 INFO:tasks.workunit:Running workunit rgw/run-versioning.sh... 2024-09-12T17:41:04.976 DEBUG:teuthology.orchestra.run.smithi016:workunit test rgw/run-versioning.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T17:41:05.027 INFO:tasks.workunit.client.0.smithi016.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T17:41:05.028 INFO:tasks.workunit.client.0.smithi016.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:41:05.028 INFO:tasks.workunit.client.0.smithi016.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:41:08.037 INFO:tasks.workunit.client.0.smithi016.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T17:41:08.038 INFO:tasks.workunit.client.0.smithi016.stderr:++ deactivate nondestructive 2024-09-12T17:41:08.038 INFO:tasks.workunit.client.0.smithi016.stderr:++ '[' -n '' ']' 2024-09-12T17:41:08.038 INFO:tasks.workunit.client.0.smithi016.stderr:++ '[' -n '' ']' 2024-09-12T17:41:08.038 INFO:tasks.workunit.client.0.smithi016.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:41:08.038 INFO:tasks.workunit.client.0.smithi016.stderr:++ hash -r 2024-09-12T17:41:08.039 INFO:tasks.workunit.client.0.smithi016.stderr:++ '[' -n '' ']' 2024-09-12T17:41:08.040 INFO:tasks.workunit.client.0.smithi016.stderr:++ unset VIRTUAL_ENV 2024-09-12T17:41:08.040 INFO:tasks.workunit.client.0.smithi016.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-12T17:41:08.040 INFO:tasks.workunit.client.0.smithi016.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T17:41:08.040 INFO:tasks.workunit.client.0.smithi016.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:41:08.040 INFO:tasks.workunit.client.0.smithi016.stderr:++ export VIRTUAL_ENV 2024-09-12T17:41:08.040 INFO:tasks.workunit.client.0.smithi016.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T17:41:08.040 INFO:tasks.workunit.client.0.smithi016.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T17:41:08.040 INFO:tasks.workunit.client.0.smithi016.stderr:++ export PATH 2024-09-12T17:41:08.040 INFO:tasks.workunit.client.0.smithi016.stderr:++ '[' -n '' ']' 2024-09-12T17:41:08.040 INFO:tasks.workunit.client.0.smithi016.stderr:++ '[' -z '' ']' 2024-09-12T17:41:08.040 INFO:tasks.workunit.client.0.smithi016.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T17:41:08.040 INFO:tasks.workunit.client.0.smithi016.stderr:++ PS1='(rgw) ' 2024-09-12T17:41:08.041 INFO:tasks.workunit.client.0.smithi016.stderr:++ export PS1 2024-09-12T17:41:08.041 INFO:tasks.workunit.client.0.smithi016.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-12T17:41:08.041 INFO:tasks.workunit.client.0.smithi016.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-12T17:41:08.041 INFO:tasks.workunit.client.0.smithi016.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:41:08.041 INFO:tasks.workunit.client.0.smithi016.stderr:++ hash -r 2024-09-12T17:41:08.041 INFO:tasks.workunit.client.0.smithi016.stderr:+ pip install pip --upgrade 2024-09-12T17:41:08.410 INFO:tasks.workunit.client.0.smithi016.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T17:41:08.624 INFO:tasks.workunit.client.0.smithi016.stdout:Collecting pip 2024-09-12T17:41:08.630 INFO:tasks.workunit.client.0.smithi016.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T17:41:08.665 INFO:tasks.workunit.client.0.smithi016.stdout:Installing collected packages: pip 2024-09-12T17:41:08.665 INFO:tasks.workunit.client.0.smithi016.stdout: Attempting uninstall: pip 2024-09-12T17:41:08.666 INFO:tasks.workunit.client.0.smithi016.stdout: Found existing installation: pip 22.0.2 2024-09-12T17:41:08.935 INFO:tasks.workunit.client.0.smithi016.stdout: Uninstalling pip-22.0.2: 2024-09-12T17:41:08.942 INFO:tasks.workunit.client.0.smithi016.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T17:41:09.723 INFO:tasks.workunit.client.0.smithi016.stdout:Successfully installed pip-24.2 2024-09-12T17:41:09.788 INFO:tasks.workunit.client.0.smithi016.stderr:+ pip install boto3 2024-09-12T17:41:10.851 INFO:tasks.workunit.client.0.smithi016.stdout:Collecting boto3 2024-09-12T17:41:10.852 INFO:tasks.workunit.client.0.smithi016.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T17:41:11.449 INFO:tasks.workunit.client.0.smithi016.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T17:41:11.450 INFO:tasks.workunit.client.0.smithi016.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T17:41:11.498 INFO:tasks.workunit.client.0.smithi016.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T17:41:11.499 INFO:tasks.workunit.client.0.smithi016.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T17:41:11.544 INFO:tasks.workunit.client.0.smithi016.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T17:41:11.546 INFO:tasks.workunit.client.0.smithi016.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T17:41:11.596 INFO:tasks.workunit.client.0.smithi016.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:41:11.597 INFO:tasks.workunit.client.0.smithi016.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T17:41:11.676 INFO:tasks.workunit.client.0.smithi016.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:41:11.677 INFO:tasks.workunit.client.0.smithi016.stdout: Using cached urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB) 2024-09-12T17:41:11.835 INFO:tasks.workunit.client.0.smithi016.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:41:11.836 INFO:tasks.workunit.client.0.smithi016.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T17:41:11.839 INFO:tasks.workunit.client.0.smithi016.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T17:41:11.841 INFO:tasks.workunit.client.0.smithi016.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T17:41:11.850 INFO:tasks.workunit.client.0.smithi016.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T17:41:11.851 INFO:tasks.workunit.client.0.smithi016.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T17:41:11.852 INFO:tasks.workunit.client.0.smithi016.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T17:41:11.854 INFO:tasks.workunit.client.0.smithi016.stdout:Using cached urllib3-2.2.3-py3-none-any.whl (126 kB) 2024-09-12T17:41:11.855 INFO:tasks.workunit.client.0.smithi016.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T17:41:11.926 INFO:tasks.workunit.client.0.smithi016.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T17:41:13.149 INFO:tasks.workunit.client.0.smithi016.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.3 2024-09-12T17:41:13.352 INFO:tasks.workunit.client.0.smithi016.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_versioning.py 2024-09-12T17:41:13.497 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin user create --uid versioning-tester --display-name "Versioning Testing" --access-key LTA662PVVDTDWX6M2AB0 --secret pvtchqajgzqx5581t6qbddbkj0bgf3a69qdkjcea 2024-09-12T17:41:13.538 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:13.538 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:13.584 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.581+0000 7f7eb68e49c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:13.586 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.585+0000 7f7eb68e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:13.586 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.585+0000 7f7eb68e49c0 20 realm 2024-09-12T17:41:13.586 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.585+0000 7f7eb68e49c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:13.586 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.585+0000 7f7eb68e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:13.586 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.585+0000 7f7eb68e49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:13.586 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.585+0000 7f7eb68e49c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:13.587 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.585+0000 7f7eb68e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:13.587 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.585+0000 7f7eb68e49c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:13.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.585+0000 7f7eb68e49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:13.588 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.585+0000 7f7eb68e49c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:13.589 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.589+0000 7f7eb68e49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:13.590 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.589+0000 7f7eb68e49c0 20 searching for the correct realm 2024-09-12T17:41:13.593 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.589+0000 7f7eb4beb640 0 -- 172.21.15.16:0/919170580 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f7e9c081cd0 msgr2=0x7f7e9c015750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:13.600 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.597+0000 7f7eb3be9640 0 -- 172.21.15.16:0/919170580 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f7eac107560 msgr2=0x7f7eac11f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:13.816 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.813+0000 7f7eb68e49c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:41:13.816 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.813+0000 7f7eb68e49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:13.816 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.813+0000 7f7eb68e49c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:41:13.816 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.813+0000 7f7eb68e49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:13.817 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.813+0000 7f7eb68e49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:13.817 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.813+0000 7f7eb68e49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:13.817 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.813+0000 7f7eb68e49c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:13.818 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.817+0000 7f7eb68e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:13.818 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.817+0000 7f7eb68e49c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:13.819 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.817+0000 7f7eb68e49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:13.819 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.817+0000 7f7eb68e49c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:13.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.817+0000 7f7eb68e49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:13.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.817+0000 7f7eb68e49c0 20 zone default found 2024-09-12T17:41:13.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.817+0000 7f7eb68e49c0 4 Realm: () 2024-09-12T17:41:13.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.817+0000 7f7eb68e49c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:41:13.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.817+0000 7f7eb68e49c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:41:13.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.817+0000 7f7eb68e49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:13.825 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.817+0000 7f7eb68e49c0 20 zonegroup default 2024-09-12T17:41:13.825 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.817+0000 7f7eb68e49c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:13.826 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.817+0000 7f7eb68e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:13.826 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.817+0000 7f7eb68e49c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:13.826 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.821+0000 7f7eb68e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:13.826 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.821+0000 7f7eb68e49c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:13.826 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.821+0000 7f7eb68e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:13.826 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.821+0000 7f7eb68e49c0 20 started sync module instance, tier type = 2024-09-12T17:41:13.826 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.821+0000 7f7eb68e49c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:41:13.846 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.845+0000 7f7eb68e49c0 20 add_watcher() i=0 2024-09-12T17:41:13.846 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.845+0000 7f7eb68e49c0 20 add_watcher() i=1 2024-09-12T17:41:13.846 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.845+0000 7f7eb68e49c0 20 add_watcher() i=2 2024-09-12T17:41:13.846 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.845+0000 7f7eb68e49c0 20 add_watcher() i=3 2024-09-12T17:41:13.846 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.845+0000 7f7eb68e49c0 20 add_watcher() i=4 2024-09-12T17:41:13.846 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.845+0000 7f7eb68e49c0 20 add_watcher() i=5 2024-09-12T17:41:13.846 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.845+0000 7f7eb68e49c0 20 add_watcher() i=6 2024-09-12T17:41:13.848 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.845+0000 7f7eb68e49c0 20 add_watcher() i=7 2024-09-12T17:41:13.848 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.845+0000 7f7eb68e49c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:13.852 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.849+0000 7f7d6afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:13.853 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.849+0000 7f7eb68e49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:13.853 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.849+0000 7f7eb68e49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:13.853 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.849+0000 7f7eb68e49c0 5 note: GC not initialized 2024-09-12T17:41:13.854 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.853+0000 7f7d69fdb640 20 reqs_thread_entry: start 2024-09-12T17:41:13.854 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.853+0000 7f7eb68e49c0 20 init_complete bucket index max shards: 1 2024-09-12T17:41:13.854 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.853+0000 7f7eb68e49c0 20 Filter name: none 2024-09-12T17:41:13.854 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.853+0000 7f7cdb7fe640 20 reqs_thread_entry: start 2024-09-12T17:41:13.855 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.853+0000 7f7eb68e49c0 10 cache get: name=default.rgw.meta+users.uid+versioning-tester : miss 2024-09-12T17:41:13.855 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.853+0000 7f7eb68e49c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:13.855 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.853+0000 7f7eb68e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:13.855 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.853+0000 7f7eb68e49c0 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x0 2024-09-12T17:41:13.856 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.853+0000 7f7eb68e49c0 10 adding default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T17:41:13.856 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.853+0000 7f7eb68e49c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : miss 2024-09-12T17:41:13.856 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.853+0000 7f7eb68e49c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:13.856 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.853+0000 7f7eb68e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:13.856 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.853+0000 7f7eb68e49c0 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x0 2024-09-12T17:41:13.856 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.853+0000 7f7eb68e49c0 10 adding default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T17:41:13.856 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.853+0000 7f7eb68e49c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T17:41:13.857 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.853+0000 7f7eb68e49c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T17:41:13.859 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.857+0000 7f7eb68e49c0 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T17:41:13.859 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.857+0000 7f7eb68e49c0 10 moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T17:41:13.859 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.857+0000 7f7eb68e49c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:versioning-tester, ofs0, ns] 2024-09-12T17:41:13.860 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.857+0000 7f7d8affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333773 cookie 94858460842912 notifier 9279 bl.length()=613 2024-09-12T17:41:13.860 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.857+0000 7f7d8affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T17:41:13.860 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.857+0000 7f7d8affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T17:41:13.863 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.861+0000 7f7eb68e49c0 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T17:41:13.863 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.861+0000 7f7eb68e49c0 10 moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T17:41:13.863 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.861+0000 7f7eb68e49c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LTA662PVVDTDWX6M2AB0, ofs0, ns] 2024-09-12T17:41:13.864 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.861+0000 7f7d8affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333849 cookie 94858460840416 notifier 9279 bl.length()=191 2024-09-12T17:41:13.864 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.861+0000 7f7d8affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T17:41:13.864 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.861+0000 7f7d8affd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T17:41:13.866 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.865+0000 7f7d6afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:13.870 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.869+0000 7f7eb68e49c0 20 remove_watcher() i=0 2024-09-12T17:41:13.871 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.869+0000 7f7eb68e49c0 2 removed watcher, disabling cache 2024-09-12T17:41:13.873 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.869+0000 7f7eb68e49c0 20 remove_watcher() i=1 2024-09-12T17:41:13.876 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.873+0000 7f7eb68e49c0 20 remove_watcher() i=2 2024-09-12T17:41:13.880 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.877+0000 7f7eb68e49c0 20 remove_watcher() i=3 2024-09-12T17:41:13.882 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.881+0000 7f7eb68e49c0 20 remove_watcher() i=4 2024-09-12T17:41:13.884 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.881+0000 7f7eb68e49c0 20 remove_watcher() i=5 2024-09-12T17:41:13.885 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.885+0000 7f7eb68e49c0 20 remove_watcher() i=6 2024-09-12T17:41:13.887 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:13.885+0000 7f7eb68e49c0 20 remove_watcher() i=7 2024-09-12T17:41:14.118 INFO:tasks.workunit.client.0.smithi016.stderr:TEST: verify that index entries and OLH objects are cleaned up after redundant deletes 2024-09-12T17:41:14.118 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:41:14.171 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T17:41:14.204 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:14.205 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:14.250 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.249+0000 7fe16e0a89c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:14.252 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.249+0000 7fe16e0a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:14.252 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.249+0000 7fe16e0a89c0 20 realm 2024-09-12T17:41:14.252 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.249+0000 7fe16e0a89c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:14.252 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.249+0000 7fe16e0a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:14.252 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.249+0000 7fe16e0a89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:14.253 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.249+0000 7fe16e0a89c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:14.253 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.249+0000 7fe16e0a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:14.253 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.249+0000 7fe16e0a89c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:14.254 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.253+0000 7fe16e0a89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:14.254 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.253+0000 7fe16e0a89c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:14.256 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.253+0000 7fe16e0a89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:14.256 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.253+0000 7fe16e0a89c0 20 searching for the correct realm 2024-09-12T17:41:14.259 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.257+0000 7fe16c3af640 0 -- 172.21.15.16:0/657327616 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fe160083040 msgr2=0x7fe160090970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:41:14.268 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.265+0000 7fe16b3ad640 0 -- 172.21.15.16:0/657327616 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fe16410db20 msgr2=0x7fe1640d7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:14.485 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.481+0000 7fe16e0a89c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:41:14.485 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.481+0000 7fe16e0a89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:14.485 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.481+0000 7fe16e0a89c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:41:14.485 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.481+0000 7fe16e0a89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:14.485 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.481+0000 7fe16e0a89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:14.485 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.481+0000 7fe16e0a89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:14.486 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.481+0000 7fe16e0a89c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:14.486 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.485+0000 7fe16e0a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:14.486 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.485+0000 7fe16e0a89c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:14.486 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.485+0000 7fe16e0a89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:14.486 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.485+0000 7fe16e0a89c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:14.488 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.485+0000 7fe16e0a89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:14.488 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.485+0000 7fe16e0a89c0 20 zone default found 2024-09-12T17:41:14.488 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.485+0000 7fe16e0a89c0 4 Realm: () 2024-09-12T17:41:14.488 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.485+0000 7fe16e0a89c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:41:14.488 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.485+0000 7fe16e0a89c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:41:14.488 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.485+0000 7fe16e0a89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:14.488 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.485+0000 7fe16e0a89c0 20 zonegroup default 2024-09-12T17:41:14.488 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.485+0000 7fe16e0a89c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:14.488 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.485+0000 7fe16e0a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:14.489 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.485+0000 7fe16e0a89c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:14.489 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.485+0000 7fe16e0a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:14.489 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.485+0000 7fe16e0a89c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:14.490 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.489+0000 7fe16e0a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:14.490 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.489+0000 7fe16e0a89c0 20 started sync module instance, tier type = 2024-09-12T17:41:14.490 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.489+0000 7fe16e0a89c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:41:14.515 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.513+0000 7fe16e0a89c0 20 add_watcher() i=0 2024-09-12T17:41:14.515 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.513+0000 7fe16e0a89c0 20 add_watcher() i=1 2024-09-12T17:41:14.515 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.513+0000 7fe16e0a89c0 20 add_watcher() i=2 2024-09-12T17:41:14.515 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.513+0000 7fe16e0a89c0 20 add_watcher() i=3 2024-09-12T17:41:14.515 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.513+0000 7fe16e0a89c0 20 add_watcher() i=4 2024-09-12T17:41:14.515 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.513+0000 7fe16e0a89c0 20 add_watcher() i=5 2024-09-12T17:41:14.515 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.513+0000 7fe16e0a89c0 20 add_watcher() i=6 2024-09-12T17:41:14.517 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.513+0000 7fe16e0a89c0 20 add_watcher() i=7 2024-09-12T17:41:14.517 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.513+0000 7fe16e0a89c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:14.521 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.517+0000 7fe021fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:14.522 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.521+0000 7fe16e0a89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:14.522 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.521+0000 7fe16e0a89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:14.523 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.521+0000 7fe16e0a89c0 5 note: GC not initialized 2024-09-12T17:41:14.523 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.521+0000 7fe020fe1640 20 reqs_thread_entry: start 2024-09-12T17:41:14.523 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.521+0000 7fe16e0a89c0 20 init_complete bucket index max shards: 1 2024-09-12T17:41:14.524 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.521+0000 7fe16e0a89c0 20 Filter name: none 2024-09-12T17:41:14.524 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.521+0000 7fdf9a7fc640 20 reqs_thread_entry: start 2024-09-12T17:41:14.524 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.521+0000 7fe16e0a89c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:14.525 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.521+0000 7fe16e0a89c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T17:41:14.525 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.521+0000 7fe16e0a89c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:14.526 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.525+0000 7fe16e0a89c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T17:41:14.526 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.525+0000 7fe16e0a89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:14.527 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.525+0000 7fe16e0a89c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T17:41:14.527 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.525+0000 7fe16e0a89c0 20 INFO: main: starting shard=0 2024-09-12T17:41:14.527 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.525+0000 7fe16e0a89c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.782.0 2024-09-12T17:41:14.527 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.525+0000 7fe16e0a89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:14.528 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.525+0000 7fe16e0a89c0 20 INFO: main: done 2024-09-12T17:41:14.529 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.525+0000 7fe021fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:14.534 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.533+0000 7fe16e0a89c0 20 remove_watcher() i=0 2024-09-12T17:41:14.534 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.533+0000 7fe16e0a89c0 2 removed watcher, disabling cache 2024-09-12T17:41:14.537 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.533+0000 7fe16e0a89c0 20 remove_watcher() i=1 2024-09-12T17:41:14.539 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.537+0000 7fe16e0a89c0 20 remove_watcher() i=2 2024-09-12T17:41:14.541 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.537+0000 7fe16e0a89c0 20 remove_watcher() i=3 2024-09-12T17:41:14.544 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.541+0000 7fe16e0a89c0 20 remove_watcher() i=4 2024-09-12T17:41:14.545 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.545+0000 7fe16e0a89c0 20 remove_watcher() i=5 2024-09-12T17:41:14.547 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.545+0000 7fe16e0a89c0 20 remove_watcher() i=6 2024-09-12T17:41:14.548 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.545+0000 7fe16e0a89c0 20 remove_watcher() i=7 2024-09-12T17:41:14.565 INFO:tasks.workunit.client.0.smithi016.stderr:rados -p default.rgw.buckets.data ls | grep 14ab7681-4fcb-4b60-8fbd-4f43876eb771 2024-09-12T17:41:14.587 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:14.588 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:14.738 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:14.737+0000 7f0ae5600640 0 -- 172.21.15.16:0/3932600688 >> [v2:172.21.15.16:6824/465585330,v1:172.21.15.16:6825/465585330] conn(0x7f0ad8008030 msgr2=0x7f0ad80147e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:14.765 INFO:tasks.workunit.client.0.smithi016.stderr:TEST: verify that index entries and OLH objects are cleaned up after index linking error 2024-09-12T17:41:14.765 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:41:14.765 INFO:tasks.workunit.client.0.smithi016.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T17:41:16.241 INFO:tasks.workunit.client.0.smithi016.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T17:41:16.683 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T17:41:16.713 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:16.713 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:16.757 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.753+0000 7f2a803a79c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:16.758 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.757+0000 7f2a803a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:16.758 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.757+0000 7f2a803a79c0 20 realm 2024-09-12T17:41:16.758 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.757+0000 7f2a803a79c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:16.759 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.757+0000 7f2a803a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:16.759 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.757+0000 7f2a803a79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:16.759 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.757+0000 7f2a803a79c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:16.759 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.757+0000 7f2a803a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:16.759 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.757+0000 7f2a803a79c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:16.760 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.757+0000 7f2a803a79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:16.760 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.757+0000 7f2a803a79c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:16.762 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.761+0000 7f2a803a79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:16.762 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.761+0000 7f2a803a79c0 20 searching for the correct realm 2024-09-12T17:41:16.764 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.761+0000 7f2a7d6ac640 0 -- 172.21.15.16:0/1481850242 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7f2a700d0040 msgr2=0x7f2a700a59c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:16.771 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.769+0000 7f2a7dead640 0 -- 172.21.15.16:0/1481850242 >> [v2:172.21.15.16:6816/1659555054,v1:172.21.15.16:6817/1659555054] conn(0x5572581cde50 msgr2=0x5572581d0270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:16.782 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.781+0000 7f2a803a79c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:41:16.782 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.781+0000 7f2a803a79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:16.782 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.781+0000 7f2a803a79c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:41:16.782 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.781+0000 7f2a803a79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:16.782 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.781+0000 7f2a803a79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:16.782 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.781+0000 7f2a803a79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:16.782 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.781+0000 7f2a803a79c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:16.782 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.781+0000 7f2a803a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:16.783 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.781+0000 7f2a803a79c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:16.783 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.781+0000 7f2a803a79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:16.783 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.781+0000 7f2a803a79c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:16.784 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.781+0000 7f2a803a79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:16.784 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.781+0000 7f2a803a79c0 20 zone default found 2024-09-12T17:41:16.784 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.781+0000 7f2a803a79c0 4 Realm: () 2024-09-12T17:41:16.784 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.781+0000 7f2a803a79c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:41:16.784 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.781+0000 7f2a803a79c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:41:16.784 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.781+0000 7f2a803a79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:16.784 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.781+0000 7f2a803a79c0 20 zonegroup default 2024-09-12T17:41:16.784 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.781+0000 7f2a803a79c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:16.784 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.781+0000 7f2a803a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:16.784 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.781+0000 7f2a803a79c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:16.785 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.781+0000 7f2a803a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:16.785 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.781+0000 7f2a803a79c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:16.785 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.781+0000 7f2a803a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:16.785 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.781+0000 7f2a803a79c0 20 started sync module instance, tier type = 2024-09-12T17:41:16.785 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.781+0000 7f2a803a79c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:41:16.799 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.797+0000 7f2a803a79c0 20 add_watcher() i=0 2024-09-12T17:41:16.799 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.797+0000 7f2a803a79c0 20 add_watcher() i=1 2024-09-12T17:41:16.799 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.797+0000 7f2a803a79c0 20 add_watcher() i=2 2024-09-12T17:41:16.799 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.797+0000 7f2a803a79c0 20 add_watcher() i=3 2024-09-12T17:41:16.800 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.797+0000 7f2a803a79c0 20 add_watcher() i=4 2024-09-12T17:41:16.800 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.797+0000 7f2a803a79c0 20 add_watcher() i=5 2024-09-12T17:41:16.800 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.797+0000 7f2a803a79c0 20 add_watcher() i=6 2024-09-12T17:41:16.800 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.797+0000 7f2a803a79c0 20 add_watcher() i=7 2024-09-12T17:41:16.800 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.797+0000 7f2a803a79c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:16.804 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.801+0000 7f292f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:16.804 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.801+0000 7f2a803a79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:16.804 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.801+0000 7f2a803a79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:16.804 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.801+0000 7f2a803a79c0 5 note: GC not initialized 2024-09-12T17:41:16.804 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.801+0000 7f292e7fc640 20 reqs_thread_entry: start 2024-09-12T17:41:16.804 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.801+0000 7f2a803a79c0 20 init_complete bucket index max shards: 1 2024-09-12T17:41:16.805 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.801+0000 7f2a803a79c0 20 Filter name: none 2024-09-12T17:41:16.805 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.801+0000 7f289ffff640 20 reqs_thread_entry: start 2024-09-12T17:41:16.805 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.801+0000 7f2a803a79c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:16.805 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.801+0000 7f2a803a79c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T17:41:16.806 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.801+0000 7f2a803a79c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:16.806 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.801+0000 7f2a803a79c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T17:41:16.806 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.801+0000 7f2a803a79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:41:16.806 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.801+0000 7f2a803a79c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T17:41:16.806 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.801+0000 7f2a803a79c0 20 INFO: main: starting shard=0 2024-09-12T17:41:16.806 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.801+0000 7f2a803a79c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.782.0 2024-09-12T17:41:16.806 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.801+0000 7f2a803a79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:41:16.806 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.801+0000 7f2a803a79c0 20 INFO: main: done 2024-09-12T17:41:16.806 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.805+0000 7f292f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:16.811 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.809+0000 7f2a803a79c0 20 remove_watcher() i=0 2024-09-12T17:41:16.811 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.809+0000 7f2a803a79c0 2 removed watcher, disabling cache 2024-09-12T17:41:16.813 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.809+0000 7f2a803a79c0 20 remove_watcher() i=1 2024-09-12T17:41:16.816 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.813+0000 7f2a803a79c0 20 remove_watcher() i=2 2024-09-12T17:41:16.817 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.817+0000 7f2a803a79c0 20 remove_watcher() i=3 2024-09-12T17:41:16.819 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.817+0000 7f2a803a79c0 20 remove_watcher() i=4 2024-09-12T17:41:16.820 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.817+0000 7f2a803a79c0 20 remove_watcher() i=5 2024-09-12T17:41:16.821 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.821+0000 7f2a803a79c0 20 remove_watcher() i=6 2024-09-12T17:41:16.822 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:16.821+0000 7f2a803a79c0 20 remove_watcher() i=7 2024-09-12T17:41:16.834 INFO:tasks.workunit.client.0.smithi016.stderr:rados -p default.rgw.buckets.data ls | grep d7b747b4-c002-47c0-8e57-59b5b80ac876 2024-09-12T17:41:16.855 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:16.855 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:17.008 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:17.005+0000 7fd952f74640 0 -- 172.21.15.16:0/139413136 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fd93c008240 msgr2=0x7fd93c008680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:17.027 INFO:tasks.workunit.client.0.smithi016.stderr:TEST: verify that original null object version is intact after failed olh upgrade 2024-09-12T17:41:17.027 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:41:17.058 INFO:tasks.workunit.client.0.smithi016.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T17:41:18.586 INFO:tasks.workunit.client.0.smithi016.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:41:18.587 INFO:tasks.workunit.client.0.smithi016.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T17:41:19.056 INFO:tasks.workunit.client.0.smithi016.stderr:TEST: verify that concurrent delete requests do not leave behind olh entries 2024-09-12T17:41:19.056 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-09-12T17:41:19.182 INFO:tasks.workunit.client.0.smithi016.stderr:ceph config set client rgw_debug_inject_latency_bi_unlink 2 2024-09-12T17:41:22.659 INFO:tasks.workunit.client.0.smithi016.stderr:ceph config rm client rgw_debug_inject_latency_bi_unlink 2024-09-12T17:41:23.112 INFO:tasks.workunit.client.0.smithi016.stderr:radosgw-admin bucket check olh --bucket versioning-bucket --dump-keys 2024-09-12T17:41:23.145 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:23.145 INFO:tasks.workunit.client.0.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:23.192 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.189+0000 7f3fe700c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.194 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.189+0000 7f3fe700c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:23.194 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.189+0000 7f3fe700c9c0 20 realm 2024-09-12T17:41:23.194 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.193+0000 7f3fe700c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.194 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.193+0000 7f3fe700c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:23.194 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.193+0000 7f3fe700c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:23.194 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.193+0000 7f3fe700c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.194 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.193+0000 7f3fe700c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:23.194 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.193+0000 7f3fe700c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.196 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.193+0000 7f3fe700c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:23.196 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.193+0000 7f3fe700c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.198 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.197+0000 7f3fe700c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:23.198 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.197+0000 7f3fe700c9c0 20 searching for the correct realm 2024-09-12T17:41:23.200 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.197+0000 7f3fe5313640 0 -- 172.21.15.16:0/2820602340 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f3fd8041060 msgr2=0x7f3fd80678b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:23.415 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.413+0000 7f3fe4311640 0 -- 172.21.15.16:0/2820602340 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f3fdc11c130 msgr2=0x7f3fdc0f8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:41:23.633 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.629+0000 7f3fe700c9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:41:23.633 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.629+0000 7f3fe700c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:23.634 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.629+0000 7f3fe700c9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:41:23.634 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.629+0000 7f3fe700c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:23.634 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.629+0000 7f3fe700c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:23.634 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.629+0000 7f3fe700c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:23.634 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.629+0000 7f3fe700c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.634 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.633+0000 7f3fe700c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:23.634 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.633+0000 7f3fe700c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.634 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.633+0000 7f3fe700c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:23.635 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.633+0000 7f3fe700c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.636 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.633+0000 7f3fe700c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:23.636 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.633+0000 7f3fe700c9c0 20 zone default found 2024-09-12T17:41:23.636 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.633+0000 7f3fe700c9c0 4 Realm: () 2024-09-12T17:41:23.637 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.633+0000 7f3fe700c9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:41:23.637 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.633+0000 7f3fe700c9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:41:23.637 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.633+0000 7f3fe700c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:23.637 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.633+0000 7f3fe700c9c0 20 zonegroup default 2024-09-12T17:41:23.637 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.633+0000 7f3fe700c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.637 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.633+0000 7f3fe700c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:23.637 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.633+0000 7f3fe700c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.638 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.633+0000 7f3fe700c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:23.638 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.633+0000 7f3fe700c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.638 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.637+0000 7f3fe700c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:23.638 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.637+0000 7f3fe700c9c0 20 started sync module instance, tier type = 2024-09-12T17:41:23.638 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.637+0000 7f3fe700c9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:41:23.661 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.657+0000 7f3fe700c9c0 20 add_watcher() i=0 2024-09-12T17:41:23.662 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.657+0000 7f3fe700c9c0 20 add_watcher() i=1 2024-09-12T17:41:23.662 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.657+0000 7f3fe700c9c0 20 add_watcher() i=2 2024-09-12T17:41:23.662 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.657+0000 7f3fe700c9c0 20 add_watcher() i=3 2024-09-12T17:41:23.662 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.657+0000 7f3fe700c9c0 20 add_watcher() i=4 2024-09-12T17:41:23.662 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.657+0000 7f3fe700c9c0 20 add_watcher() i=5 2024-09-12T17:41:23.662 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.657+0000 7f3fe700c9c0 20 add_watcher() i=6 2024-09-12T17:41:23.663 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.661+0000 7f3fe700c9c0 20 add_watcher() i=7 2024-09-12T17:41:23.663 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.661+0000 7f3fe700c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:23.667 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.665+0000 7f3e9b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:23.668 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.665+0000 7f3fe700c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:23.668 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.665+0000 7f3fe700c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:23.668 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.665+0000 7f3fe700c9c0 5 note: GC not initialized 2024-09-12T17:41:23.669 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.665+0000 7f3e9a7e4640 20 reqs_thread_entry: start 2024-09-12T17:41:23.669 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.665+0000 7f3fe700c9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:41:23.669 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.665+0000 7f3fe700c9c0 20 Filter name: none 2024-09-12T17:41:23.670 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.665+0000 7f3e937fe640 20 reqs_thread_entry: start 2024-09-12T17:41:23.670 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.665+0000 7f3fe700c9c0 10 cache get: name=default.rgw.meta+root+versioning-bucket : miss 2024-09-12T17:41:23.670 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.665+0000 7f3fe700c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.670 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.669+0000 7f3fe700c9c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T17:41:23.671 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.669+0000 7f3fe700c9c0 10 cache put: name=default.rgw.meta+root+versioning-bucket info.flags=0x11 2024-09-12T17:41:23.671 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.669+0000 7f3fe700c9c0 10 adding default.rgw.meta+root+versioning-bucket to cache LRU end 2024-09-12T17:41:23.671 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.669+0000 7f3fe700c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.782 : miss 2024-09-12T17:41:23.671 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.669+0000 7f3fe700c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:23.672 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.669+0000 7f3fe700c9c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T17:41:23.672 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.669+0000 7f3fe700c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.782 info.flags=0x17 2024-09-12T17:41:23.672 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.669+0000 7f3fe700c9c0 10 adding default.rgw.meta+root+.bucket.meta.versioning-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.782 to cache LRU end 2024-09-12T17:41:23.672 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.669+0000 7f3fe700c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:41:23.672 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.669+0000 7f3fe700c9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:41:23.672 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.669+0000 7f3fe700c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.versioning-bucket:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.782 2024-09-12T17:41:23.672 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.669+0000 7f3fe700c9c0 20 bucket index object: :.dir.4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.782.0 2024-09-12T17:41:23.673 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.669+0000 7f3fe700c9c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T17:41:23.673 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.669+0000 7f3fe700c9c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T17:41:23.674 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.673+0000 7f3e9b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:23.679 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.677+0000 7f3fe700c9c0 20 remove_watcher() i=0 2024-09-12T17:41:23.680 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.677+0000 7f3fe700c9c0 2 removed watcher, disabling cache 2024-09-12T17:41:23.682 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.681+0000 7f3fe700c9c0 20 remove_watcher() i=1 2024-09-12T17:41:23.685 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.681+0000 7f3fe700c9c0 20 remove_watcher() i=2 2024-09-12T17:41:23.687 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.685+0000 7f3fe700c9c0 20 remove_watcher() i=3 2024-09-12T17:41:23.689 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.685+0000 7f3fe700c9c0 20 remove_watcher() i=4 2024-09-12T17:41:23.691 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.689+0000 7f3fe700c9c0 20 remove_watcher() i=5 2024-09-12T17:41:23.692 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.689+0000 7f3fe700c9c0 20 remove_watcher() i=6 2024-09-12T17:41:23.695 INFO:tasks.workunit.client.0.smithi016.stderr:2024-09-12T17:41:23.693+0000 7f3fe700c9c0 20 remove_watcher() i=7 2024-09-12T17:41:23.715 INFO:tasks.workunit.client.0.smithi016.stderr:Deleting bucket versioning-bucket 2024-09-12T17:41:23.752 INFO:tasks.workunit.client.0.smithi016.stderr:Completed bucket versioning tests 2024-09-12T17:41:23.752 INFO:tasks.workunit.client.0.smithi016.stdout:connected to http://localhost:80 2024-09-12T17:41:23.844 INFO:tasks.workunit.client.0.smithi016.stderr:+ deactivate 2024-09-12T17:41:23.844 INFO:tasks.workunit.client.0.smithi016.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-12T17:41:23.844 INFO:tasks.workunit.client.0.smithi016.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T17:41:23.844 INFO:tasks.workunit.client.0.smithi016.stderr:+ export PATH 2024-09-12T17:41:23.844 INFO:tasks.workunit.client.0.smithi016.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T17:41:23.845 INFO:tasks.workunit.client.0.smithi016.stderr:+ '[' -n '' ']' 2024-09-12T17:41:23.845 INFO:tasks.workunit.client.0.smithi016.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:41:23.845 INFO:tasks.workunit.client.0.smithi016.stderr:+ hash -r 2024-09-12T17:41:23.845 INFO:tasks.workunit.client.0.smithi016.stderr:+ '[' -n '' ']' 2024-09-12T17:41:23.845 INFO:tasks.workunit.client.0.smithi016.stderr:+ unset VIRTUAL_ENV 2024-09-12T17:41:23.845 INFO:tasks.workunit.client.0.smithi016.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-12T17:41:23.846 INFO:tasks.workunit.client.0.smithi016.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T17:41:23.846 INFO:tasks.workunit.client.0.smithi016.stderr:+ unset -f deactivate 2024-09-12T17:41:23.846 INFO:tasks.workunit.client.0.smithi016.stdout:OK. 2024-09-12T17:41:23.847 INFO:tasks.workunit.client.0.smithi016.stderr:+ echo OK. 2024-09-12T17:41:23.847 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:41:23.847 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:41:23.903 INFO:tasks.workunit:Stopping ['rgw/run-versioning.sh'] on client.0... 2024-09-12T17:41:23.903 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:41:24.296 DEBUG:teuthology.parallel:result is None 2024-09-12T17:41:24.297 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:41:24.309 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:41:24.309 DEBUG:teuthology.orchestra.run.smithi016:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:41:24.363 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:41:24.363 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-09-12T17:41:24.381 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-09-12T17:41:24.406 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-09-12T17:41:24.406 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-09-12T17:41:24.407 DEBUG:teuthology.orchestra.run.smithi016:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-09-12T17:41:24.459 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-09-12T17:41:24.459 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-09-12T17:41:24.492 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:24.492 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:24.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.529+0000 7f3f282059c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.533+0000 7f3f282059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:24.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.533+0000 7f3f282059c0 20 realm 2024-09-12T17:41:24.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.533+0000 7f3f282059c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.533+0000 7f3f282059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:24.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.533+0000 7f3f282059c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:24.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.533+0000 7f3f282059c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.533+0000 7f3f282059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:24.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.533+0000 7f3f282059c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.533+0000 7f3f282059c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:24.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.533+0000 7f3f282059c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.537+0000 7f3f282059c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:24.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.537+0000 7f3f282059c0 20 searching for the correct realm 2024-09-12T17:41:24.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.541+0000 7f3f2650c640 0 -- 172.21.15.16:0/3297895953 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7f3f100e7060 msgr2=0x7f3f100df090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:24.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.549+0000 7f3f2550a640 0 -- 172.21.15.16:0/3297895953 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7f3f180503f0 msgr2=0x7f3f18050850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:41:24.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.769+0000 7f3f282059c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:41:24.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.769+0000 7f3f282059c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:24.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.769+0000 7f3f282059c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:41:24.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.769+0000 7f3f282059c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:24.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.769+0000 7f3f282059c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:24.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.769+0000 7f3f282059c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:24.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.769+0000 7f3f282059c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.769+0000 7f3f282059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:24.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.769+0000 7f3f282059c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.769+0000 7f3f282059c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:24.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.769+0000 7f3f282059c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.769+0000 7f3f282059c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:24.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.769+0000 7f3f282059c0 20 zone default found 2024-09-12T17:41:24.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.769+0000 7f3f282059c0 4 Realm: () 2024-09-12T17:41:24.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.769+0000 7f3f282059c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:41:24.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.769+0000 7f3f282059c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:41:24.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.769+0000 7f3f282059c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:24.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.769+0000 7f3f282059c0 20 zonegroup default 2024-09-12T17:41:24.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.769+0000 7f3f282059c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.769+0000 7f3f282059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:24.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.769+0000 7f3f282059c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.773+0000 7f3f282059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:24.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.773+0000 7f3f282059c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.773+0000 7f3f282059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:24.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.773+0000 7f3f282059c0 20 started sync module instance, tier type = 2024-09-12T17:41:24.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.773+0000 7f3f282059c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:41:24.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.797+0000 7f3f282059c0 20 add_watcher() i=0 2024-09-12T17:41:24.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.797+0000 7f3f282059c0 20 add_watcher() i=1 2024-09-12T17:41:24.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.797+0000 7f3f282059c0 20 add_watcher() i=2 2024-09-12T17:41:24.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.797+0000 7f3f282059c0 20 add_watcher() i=3 2024-09-12T17:41:24.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.797+0000 7f3f282059c0 20 add_watcher() i=4 2024-09-12T17:41:24.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.797+0000 7f3f282059c0 20 add_watcher() i=5 2024-09-12T17:41:24.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.797+0000 7f3f282059c0 20 add_watcher() i=6 2024-09-12T17:41:24.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.801+0000 7f3f282059c0 20 add_watcher() i=7 2024-09-12T17:41:24.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.801+0000 7f3f282059c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:24.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.801+0000 7f3dd77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:24.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.801+0000 7f3f282059c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:24.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.805+0000 7f3f282059c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:24.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.905+0000 7f3dd67fc640 20 reqs_thread_entry: start 2024-09-12T17:41:24.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.905+0000 7f3f282059c0 20 init_complete bucket index max shards: 1 2024-09-12T17:41:24.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.905+0000 7f3f282059c0 20 Filter name: none 2024-09-12T17:41:24.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.905+0000 7f3d47fff640 20 reqs_thread_entry: start 2024-09-12T17:41:24.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.905+0000 7f3f282059c0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T17:41:24.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.905+0000 7f3f282059c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:24.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.909+0000 7f3f282059c0 20 rados_obj.operate() r=0 bl.length=482 2024-09-12T17:41:24.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.909+0000 7f3f282059c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-09-12T17:41:24.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.909+0000 7f3f282059c0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T17:41:24.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.909+0000 7f3f282059c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:41:24.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.909+0000 7f3f282059c0 10 removing key index: VFZWMWFJNIWLYWEBUCBF 2024-09-12T17:41:24.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.913+0000 7f3f282059c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:VFZWMWFJNIWLYWEBUCBF, ofs0, ns] 2024-09-12T17:41:24.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.913+0000 7f3e097fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333728 cookie 94327338574576 notifier 9402 bl.length()=170 2024-09-12T17:41:24.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.913+0000 7f3f282059c0 10 removing email index: tester.client.0_test@test.test 2024-09-12T17:41:24.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.917+0000 7f3f282059c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T17:41:24.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.917+0000 7f3e097fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333729 cookie 94327338574576 notifier 9402 bl.length()=181 2024-09-12T17:41:24.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.917+0000 7f3f282059c0 10 removing user buckets index 2024-09-12T17:41:24.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.921+0000 7f3f282059c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-09-12T17:41:24.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.921+0000 7f3e08ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333774 cookie 94327338584448 notifier 9402 bl.length()=172 2024-09-12T17:41:24.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.921+0000 7f3f282059c0 10 removing user index: tester.client.0 2024-09-12T17:41:24.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.925+0000 7f3f282059c0 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-09-12T17:41:24.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.925+0000 7f3f282059c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T17:41:24.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.925+0000 7f3e08ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333852 cookie 94327338581744 notifier 9402 bl.length()=164 2024-09-12T17:41:24.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.925+0000 7f3dd77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:24.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.933+0000 7f3f282059c0 20 remove_watcher() i=0 2024-09-12T17:41:24.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.933+0000 7f3f282059c0 2 removed watcher, disabling cache 2024-09-12T17:41:24.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.933+0000 7f3f282059c0 20 remove_watcher() i=1 2024-09-12T17:41:24.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.937+0000 7f3f282059c0 20 remove_watcher() i=2 2024-09-12T17:41:24.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.937+0000 7f3f282059c0 20 remove_watcher() i=3 2024-09-12T17:41:24.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.941+0000 7f3f282059c0 20 remove_watcher() i=4 2024-09-12T17:41:24.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.941+0000 7f3f282059c0 20 remove_watcher() i=5 2024-09-12T17:41:24.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.945+0000 7f3f282059c0 20 remove_watcher() i=6 2024-09-12T17:41:24.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:24.945+0000 7f3f282059c0 20 remove_watcher() i=7 2024-09-12T17:41:24.966 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-09-12T17:41:24.979 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-09-12T17:41:24.996 DEBUG:teuthology.orchestra.run.smithi016:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-09-12T17:41:25.056 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-12T17:41:25.068 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-12T17:41:25.068 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T17:41:25.068 INFO:tasks.rgw.client.0.smithi016.stdout:2024-09-12T17:41:25.065+0000 7f1b510c5640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 37186) UID: 0 2024-09-12T17:41:25.069 INFO:tasks.rgw.client.0.smithi016.stdout:2024-09-12T17:41:25.065+0000 7f1b5490da40 -1 shutting down 2024-09-12T17:41:29.851 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-09-12T17:41:31.169 INFO:tasks.rgw.client.0:Stopped 2024-09-12T17:41:31.170 DEBUG:teuthology.orchestra.run.smithi016:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-12T17:41:31.177 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f /etc/ceph/vault-root-token 2024-09-12T17:41:31.239 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-12T17:41:31.295 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-12T17:41:31.295 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-12T17:41:31.295 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-12T17:41:31.376 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:31.376 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:31.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.416+0000 7fd765adf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:31.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.420+0000 7fd765adf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:31.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.420+0000 7fd765adf9c0 20 realm 2024-09-12T17:41:31.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.420+0000 7fd765adf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:31.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.420+0000 7fd765adf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:31.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.420+0000 7fd765adf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:41:31.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.420+0000 7fd765adf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:31.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.420+0000 7fd765adf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:31.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.420+0000 7fd765adf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:31.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.420+0000 7fd765adf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:31.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.420+0000 7fd765adf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:31.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.424+0000 7fd765adf9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:41:31.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.424+0000 7fd765adf9c0 20 searching for the correct realm 2024-09-12T17:41:31.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.424+0000 7fd763de6640 0 -- 172.21.15.16:0/1166938650 >> [v2:172.21.15.16:6800/1359899637,v1:172.21.15.16:6801/1359899637] conn(0x7fd74c06e910 msgr2=0x7fd74c0663d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:31.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.640+0000 7fd762de4640 0 -- 172.21.15.16:0/1166938650 >> [v2:172.21.15.16:6808/2391470178,v1:172.21.15.16:6809/2391470178] conn(0x7fd75c0ff250 msgr2=0x7fd75c11d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:41:31.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.860+0000 7fd765adf9c0 20 RGWRados::pool_iterate: got zonegroup_info.ee6c94f1-75d2-4899-b2f5-b50367bbb3a6 2024-09-12T17:41:31.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.860+0000 7fd765adf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:41:31.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.860+0000 7fd765adf9c0 20 RGWRados::pool_iterate: got zone_info.4327bd0c-d98b-4f4e-a078-83290070ac8d 2024-09-12T17:41:31.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.860+0000 7fd765adf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:41:31.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.860+0000 7fd765adf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:41:31.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.860+0000 7fd765adf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:41:31.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.860+0000 7fd765adf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:31.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.860+0000 7fd765adf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:31.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.860+0000 7fd765adf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:31.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.860+0000 7fd765adf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:41:31.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.860+0000 7fd765adf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:31.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.864+0000 7fd765adf9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:41:31.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.864+0000 7fd765adf9c0 20 zone default found 2024-09-12T17:41:31.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.864+0000 7fd765adf9c0 4 Realm: () 2024-09-12T17:41:31.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.864+0000 7fd765adf9c0 4 ZoneGroup: default (ee6c94f1-75d2-4899-b2f5-b50367bbb3a6) 2024-09-12T17:41:31.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.864+0000 7fd765adf9c0 4 Zone: default (4327bd0c-d98b-4f4e-a078-83290070ac8d) 2024-09-12T17:41:31.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.864+0000 7fd765adf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:41:31.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.864+0000 7fd765adf9c0 20 zonegroup default 2024-09-12T17:41:31.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.864+0000 7fd765adf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:31.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.864+0000 7fd765adf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:31.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.864+0000 7fd765adf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:31.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.864+0000 7fd765adf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:31.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.864+0000 7fd765adf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:41:31.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.864+0000 7fd765adf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:41:31.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.864+0000 7fd765adf9c0 20 started sync module instance, tier type = 2024-09-12T17:41:31.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.864+0000 7fd765adf9c0 20 started zone id=4327bd0c-d98b-4f4e-a078-83290070ac8d (name=default) with tier type = 2024-09-12T17:41:31.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.892+0000 7fd765adf9c0 20 add_watcher() i=0 2024-09-12T17:41:31.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.892+0000 7fd765adf9c0 20 add_watcher() i=1 2024-09-12T17:41:31.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.892+0000 7fd765adf9c0 20 add_watcher() i=2 2024-09-12T17:41:31.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.892+0000 7fd765adf9c0 20 add_watcher() i=3 2024-09-12T17:41:31.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.892+0000 7fd765adf9c0 20 add_watcher() i=4 2024-09-12T17:41:31.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.892+0000 7fd765adf9c0 20 add_watcher() i=5 2024-09-12T17:41:31.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.892+0000 7fd765adf9c0 20 add_watcher() i=6 2024-09-12T17:41:31.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.892+0000 7fd765adf9c0 20 add_watcher() i=7 2024-09-12T17:41:31.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.892+0000 7fd765adf9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:41:31.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.896+0000 7fd619fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:31.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.900+0000 7fd765adf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:41:31.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.900+0000 7fd765adf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:41:31.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.992+0000 7fd618fe1640 20 reqs_thread_entry: start 2024-09-12T17:41:31.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.992+0000 7fd765adf9c0 20 init_complete bucket index max shards: 1 2024-09-12T17:41:31.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.992+0000 7fd765adf9c0 20 Filter name: none 2024-09-12T17:41:31.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.992+0000 7fd5927fc640 20 reqs_thread_entry: start 2024-09-12T17:41:31.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.992+0000 7fd765adf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:41:32.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:31.996+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:41:32.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.000+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:41:32.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.000+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46278' 2024-09-12T17:41:32.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.000+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13439474072824993766', time=2024-09-12T19:31:11.796906+0000, chain.objs.size()=1 2024-09-12T17:41:32.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.000+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.233__shadow_.jVf1YbI1FkWr4vJibN0mnOXSOQsE87l_0 2024-09-12T17:41:32.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.000+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14093818167421841920', time=2024-09-12T19:31:12.593819+0000, chain.objs.size()=1 2024-09-12T17:41:32.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.000+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.235__shadow_.6rQpIwnaestb0IXAiW3OXjqB1aqW78j_0 2024-09-12T17:41:32.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.000+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2688993463341311427', time=2024-09-12T19:31:19.491011+0000, chain.objs.size()=1 2024-09-12T17:41:32.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.000+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.252__shadow_.nEl-mz5qgZgCHA6QZUqNuM_JLTXlA6U_0 2024-09-12T17:41:32.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.000+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17593854551309070832', time=2024-09-12T19:31:42.350186+0000, chain.objs.size()=1 2024-09-12T17:41:32.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.000+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.k4QTYUqOLwP0eDSemBjxHii0ETRdC76_0 2024-09-12T17:41:32.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.000+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12557152109666381072', time=2024-09-12T19:31:42.371792+0000, chain.objs.size()=1 2024-09-12T17:41:32.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.000+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.7RpCqwfAv9lY5AgYMe9HpdLCQzgpjZ9_0 2024-09-12T17:41:32.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.000+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2269647918802661385', time=2024-09-12T19:31:42.391323+0000, chain.objs.size()=1 2024-09-12T17:41:32.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.000+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.scIQMUClZpy_gMZhfUFMJ8_zQK8B2rd_0 2024-09-12T17:41:32.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.000+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17864568490643345149', time=2024-09-12T19:31:42.400238+0000, chain.objs.size()=1 2024-09-12T17:41:32.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.000+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.RmTfSSHh3YvKuLA5LO4YDUIjys4Vssp_0 2024-09-12T17:41:32.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.000+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2395861337276718224', time=2024-09-12T19:31:42.411623+0000, chain.objs.size()=1 2024-09-12T17:41:32.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.000+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.0QMW465udz17utbUwNLuSl89lJYRtqI_0 2024-09-12T17:41:32.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.000+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2952231500475643399', time=2024-09-12T19:31:42.428683+0000, chain.objs.size()=1 2024-09-12T17:41:32.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.000+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.-7PNa-CkhdnaI_raDYTXA6vWeoUIi7L_0 2024-09-12T17:41:32.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.000+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3490706933243692824', time=2024-09-12T19:31:42.448038+0000, chain.objs.size()=1 2024-09-12T17:41:32.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.000+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.env_Ulk-JhKA0w79kscaEetNC0vCxQ7_0 2024-09-12T17:41:32.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.000+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.963319321501889131', time=2024-09-12T19:31:42.476084+0000, chain.objs.size()=1 2024-09-12T17:41:32.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.000+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.WXbb3_fzMlOHbUVNYXfI0obfkIAbY-o_0 2024-09-12T17:41:32.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.004+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10450555035388139273', time=2024-09-12T19:31:42.553508+0000, chain.objs.size()=1 2024-09-12T17:41:32.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.004+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.YeU0qfDlOhObt38FOT3jbF-d1458_za_0 2024-09-12T17:41:32.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.004+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.296038813025423082', time=2024-09-12T19:31:42.664065+0000, chain.objs.size()=1 2024-09-12T17:41:32.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.004+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.o9etprqbUBLTOJnVkLWxkvJ0KdZ8TrS_0 2024-09-12T17:41:32.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.008+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.591756113020508463', time=2024-09-12T19:31:42.680628+0000, chain.objs.size()=1 2024-09-12T17:41:32.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.008+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_._PXhdExAwaCqzT2IVXmb1NsY8Op9cXy_0 2024-09-12T17:41:32.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.008+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12615125679709057652', time=2024-09-12T19:31:42.771242+0000, chain.objs.size()=1 2024-09-12T17:41:32.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.008+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.0prmegRQMNZHelHa4sAFqT4ttXRq7nU_0 2024-09-12T17:41:32.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.008+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17515626072675038005', time=2024-09-12T19:31:42.793527+0000, chain.objs.size()=1 2024-09-12T17:41:32.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.008+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Kcp1xKjtJ-Qg_R9rwa4leJhqcEDxOg6_0 2024-09-12T17:41:32.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.008+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9968806305982147903', time=2024-09-12T19:31:42.807819+0000, chain.objs.size()=1 2024-09-12T17:41:32.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.008+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.AwwqF7nAVpB8E-abSBXAxuEycBy9448_0 2024-09-12T17:41:32.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.008+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15273399499110895647', time=2024-09-12T19:31:42.817115+0000, chain.objs.size()=1 2024-09-12T17:41:32.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.008+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.fYhKVuq277fxnpo3KC4FUe_yWWUg4RA_0 2024-09-12T17:41:32.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.008+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16922436932602158612', time=2024-09-12T19:31:42.829885+0000, chain.objs.size()=1 2024-09-12T17:41:32.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.008+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.9uE1feZzDLfERyL633gHeFZlIT88OI-_0 2024-09-12T17:41:32.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.008+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16955441246438718221', time=2024-09-12T19:31:42.834011+0000, chain.objs.size()=1 2024-09-12T17:41:32.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.008+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.mW612O6dREaYuJlhKzmjpYrj_0kHdcL_0 2024-09-12T17:41:32.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.008+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1425467870107168053', time=2024-09-12T19:31:43.088066+0000, chain.objs.size()=1 2024-09-12T17:41:32.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.008+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.KWLvz9Lfwo0glLThrHvgh4VcvmUNC2P_0 2024-09-12T17:41:32.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.008+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14205430496237494858', time=2024-09-12T19:31:43.426300+0000, chain.objs.size()=1 2024-09-12T17:41:32.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.008+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.yp2DzBAP7CKgzE38_FmDzOrvpueO_J7_0 2024-09-12T17:41:32.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.008+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13053494146189117865', time=2024-09-12T19:31:43.532055+0000, chain.objs.size()=1 2024-09-12T17:41:32.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.008+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.bKj_R0J9j7ogWpOvT1GGgXFjHD4Hrpo_0 2024-09-12T17:41:32.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.012+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15920816672081121822', time=2024-09-12T19:31:43.550086+0000, chain.objs.size()=1 2024-09-12T17:41:32.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.012+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.tZ_cLbZjQIj-w3I4rxkd43_gXgWs4w9_0 2024-09-12T17:41:32.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.012+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14928147000173686054', time=2024-09-12T19:31:43.591793+0000, chain.objs.size()=1 2024-09-12T17:41:32.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.012+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.fHKkEXIYAkTTwWTcLmAX34dWMsnpA9j_0 2024-09-12T17:41:32.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.012+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7521929295835909148', time=2024-09-12T19:31:43.620029+0000, chain.objs.size()=1 2024-09-12T17:41:32.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.012+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.b3wxUPqrckXdf7RUBcugm8IbtCnNIwm_0 2024-09-12T17:41:32.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.012+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10143825447559417584', time=2024-09-12T19:31:43.815054+0000, chain.objs.size()=1 2024-09-12T17:41:32.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.012+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.eTvVtMBJOu7tVYnFBlUOceqeAkY1Dfz_0 2024-09-12T17:41:32.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.012+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15767202324655352627', time=2024-09-12T19:31:43.879577+0000, chain.objs.size()=1 2024-09-12T17:41:32.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.012+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.gTaKKrCfXXVPL6wLDVT5d4rifJeLRvh_0 2024-09-12T17:41:32.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.012+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15142544000707356052', time=2024-09-12T19:31:43.903890+0000, chain.objs.size()=1 2024-09-12T17:41:32.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.012+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.VDYm9siKL0IA1QoDu4kzC1SF-8i_MWE_0 2024-09-12T17:41:32.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.012+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13172569608167036416', time=2024-09-12T19:31:44.145268+0000, chain.objs.size()=1 2024-09-12T17:41:32.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.012+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.6hLBbEzjJ-kkhtitXd0a87P0w5hG0uV_0 2024-09-12T17:41:32.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.012+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16059505431792519745', time=2024-09-12T19:31:44.179923+0000, chain.objs.size()=1 2024-09-12T17:41:32.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.012+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.g5mOXX50_77d72PvvQ5u7HIqVcxxl29_0 2024-09-12T17:41:32.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.012+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8668595969684849175', time=2024-09-12T19:31:44.271866+0000, chain.objs.size()=1 2024-09-12T17:41:32.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.012+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.zcQeSfZrVJkEXMFs4zoaExpfCaNOfDd_0 2024-09-12T17:41:32.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.012+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9259914722763082853', time=2024-09-12T19:31:44.377837+0000, chain.objs.size()=1 2024-09-12T17:41:32.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.012+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.huB8ytUEEZS4lcx79p7u3iYtL3H3Ec6_0 2024-09-12T17:41:32.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.016+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8369616225656372676', time=2024-09-12T19:31:44.422778+0000, chain.objs.size()=1 2024-09-12T17:41:32.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.016+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.X_JRXK2WyHLs7Brem72NsNzNzZ9wlKy_0 2024-09-12T17:41:32.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.016+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1688387432924286513', time=2024-09-12T19:31:44.425814+0000, chain.objs.size()=1 2024-09-12T17:41:32.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.016+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.qa_wvQOVQSv94jr2mD1m3Zg83dDR9mu_0 2024-09-12T17:41:32.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.016+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5855554807716458609', time=2024-09-12T19:31:44.469359+0000, chain.objs.size()=1 2024-09-12T17:41:32.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.016+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.nf-c70BZi_Dm31wTqa37Vrc97E7m-bG_0 2024-09-12T17:41:32.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.016+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1231846819757314751', time=2024-09-12T19:31:44.471104+0000, chain.objs.size()=1 2024-09-12T17:41:32.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.016+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.ji_bUc1ME5aZS1lhvj2WQfh2xZMT_UY_0 2024-09-12T17:41:32.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.020+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1329241898850582520', time=2024-09-12T19:31:45.830101+0000, chain.objs.size()=1 2024-09-12T17:41:32.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.020+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.266__shadow_._1YfCjvr5DKneY6c03gbmBp3MR12rdt_0 2024-09-12T17:41:32.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.020+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16523960569831991808', time=2024-09-12T19:31:51.820474+0000, chain.objs.size()=1 2024-09-12T17:41:32.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.020+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.282__shadow_.Vj1DnPDQ6zTK64lNpE4Gu9DJaC0Mv1N_0 2024-09-12T17:41:32.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.020+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4276263994874502852', time=2024-09-12T19:31:58.358120+0000, chain.objs.size()=1 2024-09-12T17:41:32.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.020+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.295__shadow_.oYpRGSYBKjdmp1QzHA7aqRvDA7KPr79_0 2024-09-12T17:41:32.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.020+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1684098580311814556', time=2024-09-12T19:31:59.544110+0000, chain.objs.size()=1 2024-09-12T17:41:32.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.020+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.298__shadow_.TdYuaBuQt_5yko8SDTZbxJ4MgbZp7U-_0 2024-09-12T17:41:32.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.020+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4490600238325339768', time=2024-09-12T19:32:27.934284+0000, chain.objs.size()=1 2024-09-12T17:41:32.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.020+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.hx1VafYMMZ5NVqmsvd61ALF4Ky5GZuc_0 2024-09-12T17:41:32.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.020+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6315967514525456365', time=2024-09-12T19:32:28.261303+0000, chain.objs.size()=1 2024-09-12T17:41:32.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.020+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.xNZpEFhmQbbC4jVKkApaFkjFK491T_r_0 2024-09-12T17:41:32.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.020+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17784673375562646340', time=2024-09-12T19:32:28.380691+0000, chain.objs.size()=1 2024-09-12T17:41:32.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.020+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.ijNp8Tik-O0gbye5V2X63Sb3k7cWBax_0 2024-09-12T17:41:32.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.020+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9488359694148413036', time=2024-09-12T19:32:28.442680+0000, chain.objs.size()=1 2024-09-12T17:41:32.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.020+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.yMpiSA5jluizD6D37wB9Zr4jhsg25K9_0 2024-09-12T17:41:32.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.020+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9319466308351214658', time=2024-09-12T19:32:28.448300+0000, chain.objs.size()=1 2024-09-12T17:41:32.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.020+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.J_ywcgLkOcMbKKXtVZCImrEtmYbvYFY_0 2024-09-12T17:41:32.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.020+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5840047172216774870', time=2024-09-12T19:32:28.457545+0000, chain.objs.size()=1 2024-09-12T17:41:32.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.020+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.7-FKoE6L1DvFIhCAdPgEqoQhHJGBVFI_0 2024-09-12T17:41:32.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.020+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6524489151389390307', time=2024-09-12T19:32:28.516736+0000, chain.objs.size()=1 2024-09-12T17:41:32.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.020+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.TAuT0VPtC9UdDrK2zCAIfv1aRw0vn4v_0 2024-09-12T17:41:32.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.020+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9276083485604760331', time=2024-09-12T19:32:28.563782+0000, chain.objs.size()=1 2024-09-12T17:41:32.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.020+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.pPTrKhisE0jctdJQP2Ta7smUZlVphO7_0 2024-09-12T17:41:32.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.024+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9161519093143672011', time=2024-09-12T19:32:28.688004+0000, chain.objs.size()=1 2024-09-12T17:41:32.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.024+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.DuJ9BNlrpymHH5mAbD-59PHz4m7yUYq_0 2024-09-12T17:41:32.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.024+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5145270246180953820', time=2024-09-12T19:32:28.699255+0000, chain.objs.size()=1 2024-09-12T17:41:32.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.024+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.ZQd_EW7bAyzr5edkwLRD9znJ5GAfasw_0 2024-09-12T17:41:32.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.024+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12783642778329364111', time=2024-09-12T19:32:28.738983+0000, chain.objs.size()=1 2024-09-12T17:41:32.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.024+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.VGkGq9stJ_cBlIBW_9s4sfALCMr0bh8_0 2024-09-12T17:41:32.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.024+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7667791495193430278', time=2024-09-12T19:32:28.783385+0000, chain.objs.size()=1 2024-09-12T17:41:32.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.024+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.rtHkgDMpCBrRt7BiNZZhUUYN6r3gw7S_0 2024-09-12T17:41:32.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.024+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7291915470142022626', time=2024-09-12T19:32:28.834537+0000, chain.objs.size()=1 2024-09-12T17:41:32.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.024+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.DGPb_OfJ59uhthgIFfoYKSXZCgNUusv_0 2024-09-12T17:41:32.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.028+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5082151381017611194', time=2024-09-12T19:32:29.151508+0000, chain.objs.size()=1 2024-09-12T17:41:32.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.028+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_._ALe55PfhtXkWKpA0x0QjcjrSiBaq5e_0 2024-09-12T17:41:32.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.028+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9188172043392553143', time=2024-09-12T19:32:29.211279+0000, chain.objs.size()=1 2024-09-12T17:41:32.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.028+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.rDdj1rr0u6vWj3vttRsxHIY1F2s0msO_0 2024-09-12T17:41:32.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.028+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16656074990983693070', time=2024-09-12T19:32:29.345807+0000, chain.objs.size()=1 2024-09-12T17:41:32.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.028+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.FWlJXu9T6esgBnq9z5N0LlukFbMgJnX_0 2024-09-12T17:41:32.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.028+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16079808094351466159', time=2024-09-12T19:32:29.406923+0000, chain.objs.size()=1 2024-09-12T17:41:32.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.028+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.KFPXkX-w3CVsrUH7WK3N4GyR5tJKpHP_0 2024-09-12T17:41:32.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.028+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16866701822541820554', time=2024-09-12T19:32:29.437270+0000, chain.objs.size()=1 2024-09-12T17:41:32.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.028+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.JgWIPL3aq0rVlk8KfbtqGn0siEDmGmh_0 2024-09-12T17:41:32.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.028+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17026027696532748723', time=2024-09-12T19:32:29.447851+0000, chain.objs.size()=1 2024-09-12T17:41:32.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.028+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.LvuKiEg0WkNnvpBEOQhEZxZG007STBx_0 2024-09-12T17:41:32.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.028+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10779104348815905102', time=2024-09-12T19:32:29.773760+0000, chain.objs.size()=1 2024-09-12T17:41:32.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.028+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.aYNhilTU390zeM4uROcpXBqFkL7-pU5_0 2024-09-12T17:41:32.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.032+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15068648793585148228', time=2024-09-12T19:32:29.774547+0000, chain.objs.size()=1 2024-09-12T17:41:32.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.032+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.SKTUDWyhT4mrxGVXENaDkTZHjMGi9e7_0 2024-09-12T17:41:32.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.032+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2637001008480695241', time=2024-09-12T19:32:29.816477+0000, chain.objs.size()=1 2024-09-12T17:41:32.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.032+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.WT8j9d3ksB3i4HHQ_ZC15DirW3dE7Iz_0 2024-09-12T17:41:32.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.032+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1919000046169499831', time=2024-09-12T19:32:29.840996+0000, chain.objs.size()=1 2024-09-12T17:41:32.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.032+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.8DyG5Nt17vp7yt_DaXGGRFUTJ4IcSkr_0 2024-09-12T17:41:32.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.032+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9686428812794323715', time=2024-09-12T19:32:29.846568+0000, chain.objs.size()=1 2024-09-12T17:41:32.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.032+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.EDMLLuQRYOLdYGTEFEBT0UJ5lB2gNDR_0 2024-09-12T17:41:32.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.032+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5092511056348549908', time=2024-09-12T19:32:29.850724+0000, chain.objs.size()=1 2024-09-12T17:41:32.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.032+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.3wrtvXKYE99UyZJADPaHFVHgZxWWA7N_0 2024-09-12T17:41:32.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.032+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13455802349852819631', time=2024-09-12T19:32:30.032787+0000, chain.objs.size()=1 2024-09-12T17:41:32.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.032+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.4JVqJuwKXeM3y8IxyI3myexWMOQ9ct6_0 2024-09-12T17:41:32.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.032+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16759706724927908709', time=2024-09-12T19:32:30.079218+0000, chain.objs.size()=1 2024-09-12T17:41:32.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.032+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.DyWfdGCkvDhg3SDy_TUWBmSilXaQLSK_0 2024-09-12T17:41:32.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.032+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11036220695388523300', time=2024-09-12T19:32:30.088800+0000, chain.objs.size()=1 2024-09-12T17:41:32.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.032+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.nANFmY4QHeRyQ8KtF4-jdQGzpP8WiRK_0 2024-09-12T17:41:32.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.032+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5761845000463291293', time=2024-09-12T19:32:49.527434+0000, chain.objs.size()=1 2024-09-12T17:41:32.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.032+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.a45ZPpld-CKDzRJsnkZLXJ6K_EWPBoq_0 2024-09-12T17:41:32.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.032+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8457644360895678624', time=2024-09-12T19:32:49.535998+0000, chain.objs.size()=1 2024-09-12T17:41:32.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.032+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.tBgGkzpphpA8azSoK7dnr2ojY2m0_ah_0 2024-09-12T17:41:32.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.032+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14645656664427058528', time=2024-09-12T19:32:49.655481+0000, chain.objs.size()=1 2024-09-12T17:41:32.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.032+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.8CZ6JXJ7uK-TMDrNBlto70OULLuvb8n_0 2024-09-12T17:41:32.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.036+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3708882460824634800', time=2024-09-12T19:32:49.680357+0000, chain.objs.size()=1 2024-09-12T17:41:32.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.036+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.OcQrEe2mK_EfBQXoIeIVp_NZDmUoDHa_0 2024-09-12T17:41:32.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.036+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9837746245275440534', time=2024-09-12T19:32:49.711977+0000, chain.objs.size()=1 2024-09-12T17:41:32.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.036+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.kM_XhgzTY4HWWC_Tct44DXrKSQaLvR1_0 2024-09-12T17:41:32.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.036+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2605749325598958352', time=2024-09-12T19:32:49.822887+0000, chain.objs.size()=1 2024-09-12T17:41:32.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.036+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.pcUEnwQm9Z69tazVJCJtX_cU72b0x4p_0 2024-09-12T17:41:32.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.036+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10693034003839715582', time=2024-09-12T19:32:49.826322+0000, chain.objs.size()=1 2024-09-12T17:41:32.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.036+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.m3cMnmHzFxv-kS7SXnBHsuGeNv9uxVj_0 2024-09-12T17:41:32.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.036+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.500008534913893926', time=2024-09-12T19:32:49.860074+0000, chain.objs.size()=1 2024-09-12T17:41:32.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.036+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.zN_YzLFLP7yIhPU7REiUYeCD-AdMpMO_0 2024-09-12T17:41:32.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.036+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9643320021843191259', time=2024-09-12T19:32:49.948232+0000, chain.objs.size()=1 2024-09-12T17:41:32.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.036+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.2uT7ZKqNMzFbyTxkCVsegjwyPiwXNBk_0 2024-09-12T17:41:32.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.036+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15731152659753729735', time=2024-09-12T19:32:49.954393+0000, chain.objs.size()=1 2024-09-12T17:41:32.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.036+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.h_Uoe_9rF-rN62nfrYDKNKHtjiYkb_k_0 2024-09-12T17:41:32.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.040+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9994540222674615002', time=2024-09-12T19:32:49.957184+0000, chain.objs.size()=1 2024-09-12T17:41:32.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.040+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.P5TUxpyulDDx6-3AwosIG0af3tTI4Jk_0 2024-09-12T17:41:32.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.040+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3447628151463890590', time=2024-09-12T19:32:49.960479+0000, chain.objs.size()=1 2024-09-12T17:41:32.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.040+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.t0RytlVGCztflZvcbRxlDQCScZ9sm4Z_0 2024-09-12T17:41:32.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.040+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9399369240333562387', time=2024-09-12T19:32:50.131268+0000, chain.objs.size()=1 2024-09-12T17:41:32.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.040+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.XTtd4mW-qk4fL6T2XcCo67qQUgH48fP_0 2024-09-12T17:41:32.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.040+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6651904472179547145', time=2024-09-12T19:32:50.182990+0000, chain.objs.size()=1 2024-09-12T17:41:32.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.040+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.KQGsQu8Vo3ll7HQc1A0_S--0qMIdlKq_0 2024-09-12T17:41:32.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.040+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7744150085052922485', time=2024-09-12T19:32:50.210354+0000, chain.objs.size()=1 2024-09-12T17:41:32.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.040+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.1iLdsx3SHkIQw21_ZlvDe9jJ9TTILk3_0 2024-09-12T17:41:32.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.040+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14242456161440065320', time=2024-09-12T19:32:50.214576+0000, chain.objs.size()=1 2024-09-12T17:41:32.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.040+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.NDScB7bxocCfvWvIwnUTSaxXHa5khkF_0 2024-09-12T17:41:32.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.040+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14812777503350249870', time=2024-09-12T19:32:50.248564+0000, chain.objs.size()=1 2024-09-12T17:41:32.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.040+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.aIMG_GuFpV3_HouvXOGqkz5Cn6kRkVr_0 2024-09-12T17:41:32.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.044+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5692406150988906232', time=2024-09-12T19:32:50.283786+0000, chain.objs.size()=1 2024-09-12T17:41:32.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.044+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.pIbjdWNT3SaTambU_GZftDz1woZwq7C_0 2024-09-12T17:41:32.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.044+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13296908765555613521', time=2024-09-12T19:32:50.570278+0000, chain.objs.size()=1 2024-09-12T17:41:32.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.044+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.EbsXlDNyGwg8fuknlQVorB_wdtc0OPl_0 2024-09-12T17:41:32.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.044+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10377208742266771385', time=2024-09-12T19:32:50.608839+0000, chain.objs.size()=1 2024-09-12T17:41:32.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.044+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Yt-7_TsYCJpy94tx4TvwA3dlsBdat5U_0 2024-09-12T17:41:32.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.044+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1352343731612662109', time=2024-09-12T19:32:50.624335+0000, chain.objs.size()=1 2024-09-12T17:41:32.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.044+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.TaTtD9gfEwr8mOde-UTLsj7NlGvIXdG_0 2024-09-12T17:41:32.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.044+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10694578576360616238', time=2024-09-12T19:32:50.634748+0000, chain.objs.size()=1 2024-09-12T17:41:32.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.044+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.pxGeW3YmL5jNlfDGoEpWfVFXt2oRbEq_0 2024-09-12T17:41:32.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.044+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9270965508837340092', time=2024-09-12T19:32:50.897545+0000, chain.objs.size()=1 2024-09-12T17:41:32.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.044+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.LxGB3LBo3r5p2I1vdTIgkT9UK40lMUr_0 2024-09-12T17:41:32.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.044+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.969590621977662056', time=2024-09-12T19:32:50.905787+0000, chain.objs.size()=1 2024-09-12T17:41:32.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.044+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.ObXoDMVgqyeDW3iajMWzl7R20Kdeakc_0 2024-09-12T17:41:32.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.044+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5028879387404501347', time=2024-09-12T19:32:50.950243+0000, chain.objs.size()=1 2024-09-12T17:41:32.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.044+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.iYlpzl6pB5WhioLaVKnZ9-er_YpQH2F_0 2024-09-12T17:41:32.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.044+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3242075726036475622', time=2024-09-12T19:32:50.998944+0000, chain.objs.size()=1 2024-09-12T17:41:32.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.044+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.P4fUqGzXEsv26ol44IF29K63WESiI0m_0 2024-09-12T17:41:32.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.044+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7088817702157551502', time=2024-09-12T19:32:51.021101+0000, chain.objs.size()=1 2024-09-12T17:41:32.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.044+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.b-v6WOrIFEEMBh-Li2lFyLDYsaI600P_0 2024-09-12T17:41:32.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.044+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9524922942373406302', time=2024-09-12T19:32:51.177538+0000, chain.objs.size()=1 2024-09-12T17:41:32.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.044+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.LjTTdG5C0AMT6wNhr1o6vFtULBrC9sK_0 2024-09-12T17:41:32.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.048+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9266141597896967761', time=2024-09-12T19:32:51.207071+0000, chain.objs.size()=1 2024-09-12T17:41:32.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.048+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.nM3EPYsNQGn8_uECoseZoYu5QNNIchG_0 2024-09-12T17:41:32.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.048+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17045297134346176476', time=2024-09-12T19:32:51.281041+0000, chain.objs.size()=1 2024-09-12T17:41:32.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.048+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.aPwdlzbqVGCz1NccM_vorInmquL6qQ-_0 2024-09-12T17:41:32.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.048+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17046681226305724895', time=2024-09-12T19:32:51.548800+0000, chain.objs.size()=1 2024-09-12T17:41:32.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.048+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Xsce6pzD-8deQq2YWzrq89iMs6sHht-_0 2024-09-12T17:41:32.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.048+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/46278 2024-09-12T17:41:32.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.056+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T17:41:32.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.056+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1482206515719245241', time=2024-09-12T19:32:51.583098+0000, chain.objs.size()=1 2024-09-12T17:41:32.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.056+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.jutdTLMXkn2JbxPJ8Hyw9nvU9L5mec5_0 2024-09-12T17:41:32.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.056+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17106533541414810267', time=2024-09-12T19:32:51.594792+0000, chain.objs.size()=1 2024-09-12T17:41:32.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.056+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.sd5HETFictF5SKMkITvI2Q41fFrr78b_0 2024-09-12T17:41:32.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.056+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13567111440867006704', time=2024-09-12T19:32:51.946163+0000, chain.objs.size()=1 2024-09-12T17:41:32.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.056+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Lg4r9jQI03sFwWy5wynb0sM3RwXi6sO_0 2024-09-12T17:41:32.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.056+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.219631453430660051', time=2024-09-12T19:32:51.971204+0000, chain.objs.size()=1 2024-09-12T17:41:32.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.056+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.gNcDCcktYHNOkppQYWGh2Uz91VReKBL_0 2024-09-12T17:41:32.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.056+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3084350100663209393', time=2024-09-12T19:32:53.190412+0000, chain.objs.size()=1 2024-09-12T17:41:32.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.056+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.328__shadow_.LCkrLqSQYB04FfSayxhGsNLnKk0CJZB_0 2024-09-12T17:41:32.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.056+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11545230478451704518', time=2024-09-12T19:32:53.914558+0000, chain.objs.size()=1 2024-09-12T17:41:32.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.056+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.330__shadow_.rdJse2NIQlHWlYwR_4mEsp2buLufoVt_0 2024-09-12T17:41:32.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.056+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7196859257414773394', time=2024-09-12T19:33:39.059361+0000, chain.objs.size()=1 2024-09-12T17:41:32.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.056+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.456__shadow_.cNMo0JTMOFQlt3G6NK7eYvhTW7-hyHR_0 2024-09-12T17:41:32.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.056+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13818667021848784693', time=2024-09-12T19:33:44.216151+0000, chain.objs.size()=1 2024-09-12T17:41:32.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.056+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.465__shadow_.Tw3fCq0vKHHduq5aCOcy6BJju1kXz6V_0 2024-09-12T17:41:32.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.056+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8843587423538761521', time=2024-09-12T19:34:15.327275+0000, chain.objs.size()=6 2024-09-12T17:41:32.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.056+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__multipart_mymultipart.2~ZFBZtWsOVsSWug56Gu6jAG_MQ7cWBO9.1 2024-09-12T17:41:32.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.056+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__multipart_mymultipart.v1wqrQ2-JrmVcaCfwaFLDn7Ur0aEWDz1.2 2024-09-12T17:41:32.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.056+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__multipart_mymultipart.2~ZFBZtWsOVsSWug56Gu6jAG_MQ7cWBO9.3 2024-09-12T17:41:32.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.056+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__multipart_mymultipart.2~ZFBZtWsOVsSWug56Gu6jAG_MQ7cWBO9.4 2024-09-12T17:41:32.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.056+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__multipart_mymultipart.2~ZFBZtWsOVsSWug56Gu6jAG_MQ7cWBO9.5 2024-09-12T17:41:32.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.060+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__multipart_mymultipart.2~ZFBZtWsOVsSWug56Gu6jAG_MQ7cWBO9.6 2024-09-12T17:41:32.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.060+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11901028613374096713', time=2024-09-12T19:34:27.212666+0000, chain.objs.size()=2 2024-09-12T17:41:32.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.060+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.528__shadow_.SzKuedVGa1_Ltgnmlo3FERZWGTlT4zD_0 2024-09-12T17:41:32.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.060+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.528__shadow_.SzKuedVGa1_Ltgnmlo3FERZWGTlT4zD_1 2024-09-12T17:41:32.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.060+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.918386847395962803', time=2024-09-12T19:35:26.755281+0000, chain.objs.size()=1 2024-09-12T17:41:32.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.060+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.574__shadow_.PN64go8QH6uNUC7NKVnc_Vh8YXR560A_0 2024-09-12T17:41:32.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.060+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1260849955847102183', time=2024-09-12T19:35:41.312361+0000, chain.objs.size()=1 2024-09-12T17:41:32.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.060+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.577__shadow:6f7DiuNNc9dm-8z79qvrJ5MjX.zeVlH_.2ojfi5WeW5fYRXuuOFBUwJsAO4h2M9o_0 2024-09-12T17:41:32.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.060+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15574099962237446480', time=2024-09-12T19:35:54.200001+0000, chain.objs.size()=1 2024-09-12T17:41:32.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.060+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.579__shadow:4K-fPIix3v40CU18Pasgx37VS-Mh2Cb_.z1rXwwxgNXj1yg7hfbhNsokKtRD_0Fs_0 2024-09-12T17:41:32.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.060+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2254122334494208278', time=2024-09-12T19:35:59.108642+0000, chain.objs.size()=1 2024-09-12T17:41:32.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.060+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.587__shadow:pJBQQQpjBLe6M-.pcQRDi8ss3QBByjY_.Y830xHWExOGyf7bYwQ-ys_x7ptPeN8T_0 2024-09-12T17:41:32.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.060+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1089966706867521822', time=2024-09-12T19:38:34.726626+0000, chain.objs.size()=1 2024-09-12T17:41:32.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.060+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.652__shadow_.xVmtSTMn4PASmqccXwz3b0fiG-M3Xke_0 2024-09-12T17:41:32.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.064+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7725056787374150245', time=2024-09-12T19:38:36.879246+0000, chain.objs.size()=1 2024-09-12T17:41:32.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.064+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.656__shadow_.ltOlG0UVEjTfZCgv1QZjJlzx_oGT5NP_0 2024-09-12T17:41:32.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.064+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10441127276468848945', time=2024-09-12T19:38:48.073675+0000, chain.objs.size()=1 2024-09-12T17:41:32.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.064+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.679__shadow_.HdNDvGMO-XyaXJlMy35LN5A3-F6x9TJ_0 2024-09-12T17:41:32.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.064+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:41:32.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.068+0000 7fd765adf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:41:32.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.072+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:41:32.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.072+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:41:32.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.076+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45817' 2024-09-12T17:41:32.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.076+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9525051328540505260', time=2024-09-12T19:29:43.865314+0000, chain.objs.size()=3 2024-09-12T17:41:32.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.076+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.159__multipart_mymultipart-STANDARD.2~pH4xL_C0n0hQtPLlR5BVGb5GpEEsZGk.1 2024-09-12T17:41:32.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.076+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.159__multipart_mymultipart-STANDARD.2~pH4xL_C0n0hQtPLlR5BVGb5GpEEsZGk.2 2024-09-12T17:41:32.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.076+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.159__multipart_mymultipart-STANDARD.2~pH4xL_C0n0hQtPLlR5BVGb5GpEEsZGk.3 2024-09-12T17:41:32.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.076+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7745778704299069008', time=2024-09-12T19:29:45.131255+0000, chain.objs.size()=3 2024-09-12T17:41:32.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.076+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.160__shadow_.I2TXuEHjetAsHgyCEE-uBqFCLMzoqY7_0 2024-09-12T17:41:32.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.076+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.160__shadow_.I2TXuEHjetAsHgyCEE-uBqFCLMzoqY7_1 2024-09-12T17:41:32.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.076+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.160__shadow_.I2TXuEHjetAsHgyCEE-uBqFCLMzoqY7_2 2024-09-12T17:41:32.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.076+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12537413934781542944', time=2024-09-12T19:29:50.199100+0000, chain.objs.size()=1 2024-09-12T17:41:32.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.076+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.166__shadow_.PZGtaPvFDP6LEb6kdHahEmUhi7lbwCA_0 2024-09-12T17:41:32.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.076+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10611353525602289427', time=2024-09-12T19:31:13.461495+0000, chain.objs.size()=1 2024-09-12T17:41:32.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.076+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.237__shadow_.W2_fhQhfBuckmTCrjuX7Vh32wEEZf6-_0 2024-09-12T17:41:32.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.076+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17999746716331502323', time=2024-09-12T19:31:13.967724+0000, chain.objs.size()=1 2024-09-12T17:41:32.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.076+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.238__shadow_.5q3d1GyJo8mDHP1V30ju2ZPy5SoflY5_0 2024-09-12T17:41:32.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.076+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3754884935621354220', time=2024-09-12T19:31:16.414550+0000, chain.objs.size()=1 2024-09-12T17:41:32.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.076+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.244__shadow_.5qT-9jRGImV134q6tZ91DRoPUGqJ8bl_0 2024-09-12T17:41:32.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.076+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6216907830520951152', time=2024-09-12T19:31:20.631706+0000, chain.objs.size()=1 2024-09-12T17:41:32.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.076+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.255__shadow_.obtkL3HhszjlK8GZ8AutxJyG86wfD3o_0 2024-09-12T17:41:32.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.076+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10104611339807576229', time=2024-09-12T19:31:42.341127+0000, chain.objs.size()=1 2024-09-12T17:41:32.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.076+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.MgUcDbmFjCt44Mp4qqwb74Qks6R7DXK_0 2024-09-12T17:41:32.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.080+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5512925444075232069', time=2024-09-12T19:31:42.617499+0000, chain.objs.size()=1 2024-09-12T17:41:32.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.080+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.XHgg8FcYaJXynKgAaPeJ1-ZaJbgZdAs_0 2024-09-12T17:41:32.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.080+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14807912330336173597', time=2024-09-12T19:31:42.630812+0000, chain.objs.size()=1 2024-09-12T17:41:32.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.080+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.e0BA4RR90YVKFraVtUToWmUIXpCH3Wr_0 2024-09-12T17:41:32.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.080+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16211630925744141822', time=2024-09-12T19:31:42.648118+0000, chain.objs.size()=1 2024-09-12T17:41:32.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.080+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.A0RwvRiTHi30HmihuGlhoCVnMht0mCT_0 2024-09-12T17:41:32.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.080+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8692082200733031664', time=2024-09-12T19:31:42.796286+0000, chain.objs.size()=1 2024-09-12T17:41:32.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.080+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.i7vGo6tnbH0HX8AW7oh6K9hXJPfpCsU_0 2024-09-12T17:41:32.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.080+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3894354028277408265', time=2024-09-12T19:31:42.841191+0000, chain.objs.size()=1 2024-09-12T17:41:32.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.080+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.beeQ3FypjKC-2OhunKYp1mCbWGDri6g_0 2024-09-12T17:41:32.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.080+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14461998781366969767', time=2024-09-12T19:31:42.869050+0000, chain.objs.size()=1 2024-09-12T17:41:32.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.080+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.FWfAQFUIWqW-UmMeXWV10Aagaet_1WS_0 2024-09-12T17:41:32.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.080+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5551910621836265459', time=2024-09-12T19:31:43.081985+0000, chain.objs.size()=1 2024-09-12T17:41:32.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.080+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.JtqXPHf_nlQVwZIJ6B6IZ0Nhz8d71hM_0 2024-09-12T17:41:32.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.080+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16987966326221636385', time=2024-09-12T19:31:43.145901+0000, chain.objs.size()=1 2024-09-12T17:41:32.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.080+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.oXZ92p1rtnkzVGWYN_ZiThorSoqq4pQ_0 2024-09-12T17:41:32.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.080+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13055112023637998482', time=2024-09-12T19:31:43.168244+0000, chain.objs.size()=1 2024-09-12T17:41:32.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.080+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Pqqvx9GTaW4H0S9mrRot-aLzKIAhJrS_0 2024-09-12T17:41:32.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.080+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11842154718798952636', time=2024-09-12T19:31:43.277852+0000, chain.objs.size()=1 2024-09-12T17:41:32.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.080+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.TCF9yepgGTVkRG4quJLIcejzF9V9S7C_0 2024-09-12T17:41:32.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.080+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16170432643538635287', time=2024-09-12T19:31:43.420179+0000, chain.objs.size()=1 2024-09-12T17:41:32.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.080+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.nqAtvnxDFbzQCFu_tmiXOj39vvkOFYQ_0 2024-09-12T17:41:32.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.084+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5482024596195018143', time=2024-09-12T19:31:43.480028+0000, chain.objs.size()=1 2024-09-12T17:41:32.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.084+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.8V9XxN6ZRdbfBAojCTi9gRz4w_MVytf_0 2024-09-12T17:41:32.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.084+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9179972747074965518', time=2024-09-12T19:31:43.573700+0000, chain.objs.size()=1 2024-09-12T17:41:32.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.084+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.0zVZdT9cqyQaweuACrIcWQdafYrY7Hn_0 2024-09-12T17:41:32.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.084+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2871965086861588184', time=2024-09-12T19:31:43.747018+0000, chain.objs.size()=1 2024-09-12T17:41:32.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.084+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.5IU3jDSAvsSf9FcHc4DH3cc317Sql8b_0 2024-09-12T17:41:32.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.084+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5904639680108572821', time=2024-09-12T19:31:43.904417+0000, chain.objs.size()=1 2024-09-12T17:41:32.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.084+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.k0bqhdI-itSsW00IxxL2BXWRYf0o6wF_0 2024-09-12T17:41:32.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.084+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16274742646173477317', time=2024-09-12T19:31:44.090860+0000, chain.objs.size()=1 2024-09-12T17:41:32.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.084+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.yzcbld9qU28Y9YxewQSuimoEKnOKjSC_0 2024-09-12T17:41:32.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.084+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12064976067255200106', time=2024-09-12T19:31:44.127120+0000, chain.objs.size()=1 2024-09-12T17:41:32.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.084+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.xtOo99xAUKOsIDK0YKpv20deKMg2IqP_0 2024-09-12T17:41:32.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.084+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3648362646739711638', time=2024-09-12T19:31:44.154017+0000, chain.objs.size()=1 2024-09-12T17:41:32.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.084+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.milVEHtvs9CaUPlvCVsgYnUT-c6t67W_0 2024-09-12T17:41:32.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.084+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8673147541060239793', time=2024-09-12T19:31:44.176644+0000, chain.objs.size()=1 2024-09-12T17:41:32.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.084+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.6jXMh5L8SebFrNP_poArBr7QRxjuHUN_0 2024-09-12T17:41:32.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.084+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11412918555978341752', time=2024-09-12T19:31:44.200398+0000, chain.objs.size()=1 2024-09-12T17:41:32.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.084+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.aFblrlgpCmY-cA3WXFyHoNbTYSjXVCr_0 2024-09-12T17:41:32.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.084+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18201995704089395662', time=2024-09-12T19:31:45.831487+0000, chain.objs.size()=1 2024-09-12T17:41:32.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.084+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.266__shadow_.Si8EFXsSSyFFQkbi4znVobxBxhzqm70_0 2024-09-12T17:41:32.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.084+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6359844818578751631', time=2024-09-12T19:31:47.662819+0000, chain.objs.size()=1 2024-09-12T17:41:32.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.084+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.271__shadow_.G10pEtRg0NWu6Q0NLqW5gcR2F8fL97V_0 2024-09-12T17:41:32.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.088+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1301550786752641280', time=2024-09-12T19:31:48.373421+0000, chain.objs.size()=1 2024-09-12T17:41:32.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.088+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.273__shadow_.kL8XiJQC1jr5z7-BunBoWPZ2LKU2Q9v_0 2024-09-12T17:41:32.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.088+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11732349266799548392', time=2024-09-12T19:31:53.819824+0000, chain.objs.size()=1 2024-09-12T17:41:32.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.088+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.287__shadow_.LwJV8JhPpbDPZZNLInZzRNgrhkdN7GF_0 2024-09-12T17:41:32.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.088+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6950714018207104776', time=2024-09-12T19:31:56.513672+0000, chain.objs.size()=1 2024-09-12T17:41:32.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.088+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.292__shadow_.pFXd92sqK9omYKcYQooq8L3E2aFu386_0 2024-09-12T17:41:32.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.088+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3926131481547586303', time=2024-09-12T19:32:27.913222+0000, chain.objs.size()=1 2024-09-12T17:41:32.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.088+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.8dJnUlkbBtvo1OrCx9W7dB6HxmCzgmg_0 2024-09-12T17:41:32.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.088+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15247249877870721814', time=2024-09-12T19:32:27.972898+0000, chain.objs.size()=1 2024-09-12T17:41:32.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.088+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.F0LtEdh_c29zZASIr8eUKh-rJKhJ2Sn_0 2024-09-12T17:41:32.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.088+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10925648824099897921', time=2024-09-12T19:32:27.996687+0000, chain.objs.size()=1 2024-09-12T17:41:32.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.088+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.29rxMX-3Ur9iGMjA5SM14TJR_w_ah06_0 2024-09-12T17:41:32.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.088+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11037834733106593953', time=2024-09-12T19:32:28.052887+0000, chain.objs.size()=1 2024-09-12T17:41:32.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.088+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.P2KBPqY8MexmkdwU4joZjU8KtL5kUzg_0 2024-09-12T17:41:32.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.088+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2229499437898670218', time=2024-09-12T19:32:28.221792+0000, chain.objs.size()=1 2024-09-12T17:41:32.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.088+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.OJa6yxcJ1lU9NBbdLZHvV-WgPqaH707_0 2024-09-12T17:41:32.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.088+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17440014898873275142', time=2024-09-12T19:32:28.296959+0000, chain.objs.size()=1 2024-09-12T17:41:32.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.088+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.LcA0wn-VVY_NCYsSCNNBN9IYt_d_G47_0 2024-09-12T17:41:32.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.088+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13544461416430249685', time=2024-09-12T19:32:28.315384+0000, chain.objs.size()=1 2024-09-12T17:41:32.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.088+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.z2q_MZRcAMl5LklxNH87VeANSdubEIQ_0 2024-09-12T17:41:32.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.088+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3534702195201887280', time=2024-09-12T19:32:28.410462+0000, chain.objs.size()=1 2024-09-12T17:41:32.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.088+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.esZfLbXfSRSeEcwAvUhpKS7QcLOV3dr_0 2024-09-12T17:41:32.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.092+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7444844846528268423', time=2024-09-12T19:32:28.471588+0000, chain.objs.size()=1 2024-09-12T17:41:32.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.092+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.o8cwRYLF7kxOqrGbQROMXnjIp_yqR1A_0 2024-09-12T17:41:32.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.092+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11516580981999048473', time=2024-09-12T19:32:28.526526+0000, chain.objs.size()=1 2024-09-12T17:41:32.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.092+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.ANd94HSkHRpCwOkSrxxuaspJy8pnTVG_0 2024-09-12T17:41:32.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.092+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14286075368151399975', time=2024-09-12T19:32:28.768366+0000, chain.objs.size()=1 2024-09-12T17:41:32.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.092+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.hNHDWaSq5RPTdSAu_kLtbk961Dwdyqt_0 2024-09-12T17:41:32.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.092+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10914976251510438942', time=2024-09-12T19:32:28.833220+0000, chain.objs.size()=1 2024-09-12T17:41:32.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.092+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.67gOmKxD-FS1HHDaRI9qcxwkkRax6gs_0 2024-09-12T17:41:32.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.092+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7556866306392758268', time=2024-09-12T19:32:28.840576+0000, chain.objs.size()=1 2024-09-12T17:41:32.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.092+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.gweD8rhH9TsT4Z2x-mfLZhqq3PotfP0_0 2024-09-12T17:41:32.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.092+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4122336350755129134', time=2024-09-12T19:32:28.852209+0000, chain.objs.size()=1 2024-09-12T17:41:32.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.092+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.dFU7BEA9dSy__FopJeRXsLzfa-yRtYt_0 2024-09-12T17:41:32.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.096+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12747741056881448842', time=2024-09-12T19:32:28.885320+0000, chain.objs.size()=1 2024-09-12T17:41:32.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.096+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.nSzBAeGvVR1TdeSlWTe6NY1C7Pgs9KT_0 2024-09-12T17:41:32.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.096+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9249412554334569424', time=2024-09-12T19:32:29.107415+0000, chain.objs.size()=1 2024-09-12T17:41:32.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.096+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Cuvch2PffAmnnPtJXpDIqLXYe-fQKt0_0 2024-09-12T17:41:32.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.096+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2560799909861941501', time=2024-09-12T19:32:29.201240+0000, chain.objs.size()=1 2024-09-12T17:41:32.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.096+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.5N7Y8YZfVBU2Y4Rc4yODLV3hQx8u7s__0 2024-09-12T17:41:32.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.096+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13094180565219116879', time=2024-09-12T19:32:29.209333+0000, chain.objs.size()=1 2024-09-12T17:41:32.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.096+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.dy7JE68Fz5P7GZm-10jeP6HVBRLCBcV_0 2024-09-12T17:41:32.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.096+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14531370600909715339', time=2024-09-12T19:32:29.240103+0000, chain.objs.size()=1 2024-09-12T17:41:32.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.096+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.QJ-QAWP5WXmaxdtlt45NtQwxXIwWCkK_0 2024-09-12T17:41:32.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.096+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8578811015864837157', time=2024-09-12T19:32:29.240631+0000, chain.objs.size()=1 2024-09-12T17:41:32.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.096+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.STstjNGIu7YurEPAAa_HSInyfQBafZ7_0 2024-09-12T17:41:32.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.096+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2803062122502777902', time=2024-09-12T19:32:29.438906+0000, chain.objs.size()=1 2024-09-12T17:41:32.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.096+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.i49M1GY1eJ1jsiCSQ5PiToq9gEbDP1f_0 2024-09-12T17:41:32.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.100+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7963062742164390323', time=2024-09-12T19:32:29.472630+0000, chain.objs.size()=1 2024-09-12T17:41:32.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.100+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.rBwj9CkZezrmDJewYfckaQH_EWRIYti_0 2024-09-12T17:41:32.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.100+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.703923688815837234', time=2024-09-12T19:32:29.482845+0000, chain.objs.size()=1 2024-09-12T17:41:32.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.100+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.bdBEyFrSda9U3IMZC8uFSSjTJ8-sRg1_0 2024-09-12T17:41:32.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.100+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5523848028667446114', time=2024-09-12T19:32:29.497403+0000, chain.objs.size()=1 2024-09-12T17:41:32.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.100+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.ULK3sxwkv9x8aa2eSOmRVCxPHBB-3zr_0 2024-09-12T17:41:32.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.100+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14061973447994957757', time=2024-09-12T19:32:29.686141+0000, chain.objs.size()=1 2024-09-12T17:41:32.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.100+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.9dOzFiBFs8m-sB726NE8tIsfCEtdLJj_0 2024-09-12T17:41:32.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.100+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11275450729732058314', time=2024-09-12T19:32:29.705557+0000, chain.objs.size()=1 2024-09-12T17:41:32.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.100+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Sfbh881YNedjc1BpBK11BFRbj-CG3sq_0 2024-09-12T17:41:32.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.100+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6096296987324053979', time=2024-09-12T19:32:29.730476+0000, chain.objs.size()=1 2024-09-12T17:41:32.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.100+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.xWv9miVYxjQVFeYfmjcWI4x3JzyTuYE_0 2024-09-12T17:41:32.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.100+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9943224855379359251', time=2024-09-12T19:32:29.782589+0000, chain.objs.size()=1 2024-09-12T17:41:32.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.100+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.x5qZfGExTEI2BhnTGJzYeWIg6qz2k2f_0 2024-09-12T17:41:32.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.100+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.23793497560531794', time=2024-09-12T19:32:30.132747+0000, chain.objs.size()=1 2024-09-12T17:41:32.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.100+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.1gBav4PuWqlgmTnDIk6Avzaq5p9-eHM_0 2024-09-12T17:41:32.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.100+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9518509595480169692', time=2024-09-12T19:32:30.156434+0000, chain.objs.size()=1 2024-09-12T17:41:32.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.100+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Bt_BplRXDuHwjrl76TkZs7R_YgAmlcN_0 2024-09-12T17:41:32.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.100+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12173640414823829234', time=2024-09-12T19:32:49.587530+0000, chain.objs.size()=1 2024-09-12T17:41:32.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.100+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.gU6Z0xwYdXLNTF8uPPhbRHnlEkYWimn_0 2024-09-12T17:41:32.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.100+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9272664430805816476', time=2024-09-12T19:32:49.588767+0000, chain.objs.size()=1 2024-09-12T17:41:32.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.100+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.zCcV2_smVxEdD_1yk8rYp6TTOh4Pyre_0 2024-09-12T17:41:32.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.104+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3028187412525159964', time=2024-09-12T19:32:49.728014+0000, chain.objs.size()=1 2024-09-12T17:41:32.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.104+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_._bQPP1b034oDQQ-Y8BHYvcax0IcCsLa_0 2024-09-12T17:41:32.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.104+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4373308449421292052', time=2024-09-12T19:32:49.728966+0000, chain.objs.size()=1 2024-09-12T17:41:32.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.104+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.9T1DsnI7RCjUmSE5o1Paus4XLpxFyQq_0 2024-09-12T17:41:32.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.104+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7157775874458024314', time=2024-09-12T19:32:49.753868+0000, chain.objs.size()=1 2024-09-12T17:41:32.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.104+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.8Hn69kiSpo6ZveNUtWRtlZZFPgUMYrw_0 2024-09-12T17:41:32.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.104+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10435705346782295186', time=2024-09-12T19:32:49.824110+0000, chain.objs.size()=1 2024-09-12T17:41:32.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.104+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.u80Sjer_RhyxO5JSmfrK8_efUfhYsNw_0 2024-09-12T17:41:32.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.104+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10779753817377956310', time=2024-09-12T19:32:49.892637+0000, chain.objs.size()=1 2024-09-12T17:41:32.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.104+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.ryOdP-OBmbB1xNi40f945002B7KqV7a_0 2024-09-12T17:41:32.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.104+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17314104621563180589', time=2024-09-12T19:32:49.914806+0000, chain.objs.size()=1 2024-09-12T17:41:32.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.104+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.LDUfV53uH8lQCY1SSX8301i9GRxTK3N_0 2024-09-12T17:41:32.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.104+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8724515290186545120', time=2024-09-12T19:32:49.925766+0000, chain.objs.size()=1 2024-09-12T17:41:32.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.104+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.aJdYbXtqzlnhOJrDN4peL1emdeOO1iD_0 2024-09-12T17:41:32.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.104+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3570029726568630803', time=2024-09-12T19:32:49.964605+0000, chain.objs.size()=1 2024-09-12T17:41:32.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.104+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.J_3mIk9i4e4OgzLPM1r10HuRJ3bnvGP_0 2024-09-12T17:41:32.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.104+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8904410065252597637', time=2024-09-12T19:32:50.124613+0000, chain.objs.size()=1 2024-09-12T17:41:32.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.104+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.8BhYvtzB9SUt58kMoFynQ5G_jKYT_nn_0 2024-09-12T17:41:32.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.104+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12050882994598992403', time=2024-09-12T19:32:50.223390+0000, chain.objs.size()=1 2024-09-12T17:41:32.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.104+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.j6cqafNppBBrQFJewpe6WKTxEC1COdk_0 2024-09-12T17:41:32.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.104+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5311821610933985010', time=2024-09-12T19:32:50.297707+0000, chain.objs.size()=1 2024-09-12T17:41:32.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.104+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.lbaBh2fD-RAK2uJy0RusY4hY1ychL4h_0 2024-09-12T17:41:32.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.104+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12863917335265120296', time=2024-09-12T19:32:50.592197+0000, chain.objs.size()=1 2024-09-12T17:41:32.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.104+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.s44GlyywO1VMY6GTQ3TbznFvG6_z2n__0 2024-09-12T17:41:32.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.108+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.192402915077829076', time=2024-09-12T19:32:50.606491+0000, chain.objs.size()=1 2024-09-12T17:41:32.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.108+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.sOs_vC1wQoEa-oCv4c8EQO6CB5f9Uzu_0 2024-09-12T17:41:32.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.108+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12147009077019507094', time=2024-09-12T19:32:50.631755+0000, chain.objs.size()=1 2024-09-12T17:41:32.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.108+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.dn9CdKMUg6qt2Gcv_AWBbbzF9p9UGwY_0 2024-09-12T17:41:32.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.108+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3287166739363361481', time=2024-09-12T19:32:50.643171+0000, chain.objs.size()=1 2024-09-12T17:41:32.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.108+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.fSaF10dvoa6fKOAOOSiylOO7abUZ-JX_0 2024-09-12T17:41:32.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.108+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15949614397605062545', time=2024-09-12T19:32:50.646716+0000, chain.objs.size()=1 2024-09-12T17:41:32.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.108+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.n4ey7drVgT9Dl15a5h9cLsyjJrO5U43_0 2024-09-12T17:41:32.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.108+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3224579653294727498', time=2024-09-12T19:32:50.677704+0000, chain.objs.size()=1 2024-09-12T17:41:32.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.108+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.2CUAzXWucc_c_c3F_kE6MYc40JDoaIx_0 2024-09-12T17:41:32.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.108+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15414173035082196794', time=2024-09-12T19:32:50.831934+0000, chain.objs.size()=1 2024-09-12T17:41:32.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.108+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.fI-BD11-zRIWZr7qZHpWqsOr9RUx7DX_0 2024-09-12T17:41:32.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.108+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8080265729777222842', time=2024-09-12T19:32:50.926749+0000, chain.objs.size()=1 2024-09-12T17:41:32.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.108+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.P-c4EbHfxY8FEbyUIz9diPzesaZ0Dlq_0 2024-09-12T17:41:32.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.108+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5035551729294887922', time=2024-09-12T19:32:50.932846+0000, chain.objs.size()=1 2024-09-12T17:41:32.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.108+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.TddB8fg2YRbtefU6JABD7gFxfOQLx3h_0 2024-09-12T17:41:32.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.108+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16588621430515708296', time=2024-09-12T19:32:51.015181+0000, chain.objs.size()=1 2024-09-12T17:41:32.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.108+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.tgx7bh3t37nqF0Ywu9c1ev8-bZmN9pm_0 2024-09-12T17:41:32.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.108+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18003186934747410493', time=2024-09-12T19:32:51.165727+0000, chain.objs.size()=1 2024-09-12T17:41:32.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.108+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.JdSLijMjGiK9_odoCUKTG5OC-mWGZF5_0 2024-09-12T17:41:32.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.112+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10324100624413229968', time=2024-09-12T19:32:51.290705+0000, chain.objs.size()=1 2024-09-12T17:41:32.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.112+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.cfNzV3oVxqVFl4N54zSrDh8kL8FY5Jw_0 2024-09-12T17:41:32.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.112+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6675957943997435472', time=2024-09-12T19:32:51.305850+0000, chain.objs.size()=1 2024-09-12T17:41:32.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.112+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.n4ArI_d6590uGeu7Cb2_fLjpJrnHWh7_0 2024-09-12T17:41:32.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.112+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8310652267059730232', time=2024-09-12T19:32:51.377554+0000, chain.objs.size()=1 2024-09-12T17:41:32.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.112+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.I7NCLOHqChLXuO6KqBeGnOByLMKrfsP_0 2024-09-12T17:41:32.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.112+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2648645249862671283', time=2024-09-12T19:32:51.502145+0000, chain.objs.size()=1 2024-09-12T17:41:32.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.112+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.BBEGEO7R3T_bcdW7b1EqD_m-RwQd4ON_0 2024-09-12T17:41:32.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.112+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16958229870267126713', time=2024-09-12T19:32:51.522534+0000, chain.objs.size()=1 2024-09-12T17:41:32.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.112+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.SQH-OCqLoVZJX90GhLbtsG6l_KTuFlu_0 2024-09-12T17:41:32.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.112+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8598268216085388865', time=2024-09-12T19:32:51.573819+0000, chain.objs.size()=1 2024-09-12T17:41:32.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.112+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.ejgBQnIe8C3JgDrYY9byQ05o0khbEZj_0 2024-09-12T17:41:32.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.112+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7016794303675322892', time=2024-09-12T19:32:51.853881+0000, chain.objs.size()=1 2024-09-12T17:41:32.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.112+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.inYpWyaVkqsfcChMoelLwI1J9XKHc4N_0 2024-09-12T17:41:32.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.112+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15987715464462048588', time=2024-09-12T19:32:51.897880+0000, chain.objs.size()=1 2024-09-12T17:41:32.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.112+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Hf8fI0i7PJNnh6xEUU137q5_PFhdDR5_0 2024-09-12T17:41:32.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.112+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8580707980325106007', time=2024-09-12T19:32:51.920815+0000, chain.objs.size()=1 2024-09-12T17:41:32.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.112+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.OxQy20HjFp2gvV2AQsOPIdclDZVtZHm_0 2024-09-12T17:41:32.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.112+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.625155272732874817', time=2024-09-12T19:32:52.002157+0000, chain.objs.size()=1 2024-09-12T17:41:32.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.112+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.t_wcE-pbF75cQfP8TQIo1PbiQJLrIJ3_0 2024-09-12T17:41:32.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.112+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10608652809704924490', time=2024-09-12T19:32:53.537119+0000, chain.objs.size()=1 2024-09-12T17:41:32.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.112+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.329__shadow_.MKqzlJuPQHUR91QQ7nEudK7CjOpvSP6_0 2024-09-12T17:41:32.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.112+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8459889100169324912', time=2024-09-12T19:33:09.067170+0000, chain.objs.size()=1 2024-09-12T17:41:32.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.112+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.377__shadow_.hBzpbvYzkg8M7mSvoG7ziVVlm3l9lZH_0 2024-09-12T17:41:32.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.116+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.313887329246533466', time=2024-09-12T19:33:09.539387+0000, chain.objs.size()=1 2024-09-12T17:41:32.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.116+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.378__shadow_.GbttBgW2Kc8n4UrIojqjIfgWMvzDIBZ_0 2024-09-12T17:41:32.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.116+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45817 2024-09-12T17:41:32.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.120+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T17:41:32.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.120+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12610933024379377830', time=2024-09-12T19:33:49.659920+0000, chain.objs.size()=1 2024-09-12T17:41:32.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.120+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.484__shadow_.6eeeXDuLU0-CLgkxaMaWD-z39WNc0ud_0 2024-09-12T17:41:32.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.120+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17001732259396302721', time=2024-09-12T19:35:17.815441+0000, chain.objs.size()=1 2024-09-12T17:41:32.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.120+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.569__shadow:FCpCZf1Xci0bDa0NfutlY2Cy6ktOEC9_.QbrgUOnkOszdV28V7fiYVQtzLgJ79vU_0 2024-09-12T17:41:32.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.120+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15574521237401345102', time=2024-09-12T19:35:20.653819+0000, chain.objs.size()=1 2024-09-12T17:41:32.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.120+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.569__shadow:G0U7k1YL-ehK8lWiHtABlU1SScwr1Hc_.3iYlyTBbbIvxew4TSZ2DnRvFBZppTa8_0 2024-09-12T17:41:32.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.120+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13512838924645276480', time=2024-09-12T19:35:31.308514+0000, chain.objs.size()=1 2024-09-12T17:41:32.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.120+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.576__shadow:fjX09-k-UGYCu6z3Tff-V52EMr83LF-_.vvS_RznlxE6GnWrp6ebUgmNUqWd1aAz_0 2024-09-12T17:41:32.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.120+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11117681063419501961', time=2024-09-12T19:35:59.146744+0000, chain.objs.size()=1 2024-09-12T17:41:32.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.120+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.587__shadow:7iGBrW45-tR5OY6op1tjSnz8Ag1pRTy_.xytY9GKp_DEkyaw0quGMr5aImyOi9wE_0 2024-09-12T17:41:32.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.120+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14551813276203213253', time=2024-09-12T19:37:15.388967+0000, chain.objs.size()=1 2024-09-12T17:41:32.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.120+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.617__shadow_.tXFYXmRU7JSuTWPxCk9cxljhKA2GqTv_0 2024-09-12T17:41:32.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.120+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6997909450980537450', time=2024-09-12T19:38:17.159133+0000, chain.objs.size()=1 2024-09-12T17:41:32.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.120+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.619__shadow_.TvIceDDG_owQIRh__32fN_u7V5ppnF9_0 2024-09-12T17:41:32.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.120+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14327243815133112981', time=2024-09-12T19:38:23.614011+0000, chain.objs.size()=1 2024-09-12T17:41:32.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.120+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.626__shadow_.NkyVlNKlL19jV06oQxMt_4Kh-8GxS1Y_0 2024-09-12T17:41:32.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.120+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8129404448595695576', time=2024-09-12T19:38:23.983695+0000, chain.objs.size()=1 2024-09-12T17:41:32.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.120+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.627__shadow_.BfwmlCHklnmz6xpsNVvCMNUe-ErwhxY_0 2024-09-12T17:41:32.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.120+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16231049402236525034', time=2024-09-12T19:38:44.130065+0000, chain.objs.size()=1 2024-09-12T17:41:32.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.120+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.666__shadow_.hPlfQ5Wd8KHJdVMm1h5m4-aWYGV12sX_0 2024-09-12T17:41:32.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.124+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:41:32.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.128+0000 7fd765adf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:41:32.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.128+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:41:32.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.128+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:41:32.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.132+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44554' 2024-09-12T17:41:32.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.132+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15037366122271874549', time=2024-09-12T19:29:42.020390+0000, chain.objs.size()=3 2024-09-12T17:41:32.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.132+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.158__shadow_.RgvU2C2qVXZdG1coQqZ0Bf4gXIarmzB_0 2024-09-12T17:41:32.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.132+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.158__shadow_.RgvU2C2qVXZdG1coQqZ0Bf4gXIarmzB_1 2024-09-12T17:41:32.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.132+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.158__shadow_.RgvU2C2qVXZdG1coQqZ0Bf4gXIarmzB_2 2024-09-12T17:41:32.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.132+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14770498695554246896', time=2024-09-12T19:31:10.621286+0000, chain.objs.size()=1 2024-09-12T17:41:32.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.132+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.230__shadow_.XrOgSdkbUGH8A-7xllzaWVZ5fAuBDsX_0 2024-09-12T17:41:32.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.132+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10909553578788745251', time=2024-09-12T19:31:12.962841+0000, chain.objs.size()=1 2024-09-12T17:41:32.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.132+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.236__shadow_.7YzAX3TrQP_yAhlWxGLuvasxbPgwUj9_0 2024-09-12T17:41:32.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.132+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10305226064688115755', time=2024-09-12T19:31:15.402570+0000, chain.objs.size()=1 2024-09-12T17:41:32.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.132+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.242__shadow_.7Qy1xcJuN9pG8f1fqh1x2rDYSxEhrpq_0 2024-09-12T17:41:32.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.132+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8069708106444511594', time=2024-09-12T19:31:18.690756+0000, chain.objs.size()=1 2024-09-12T17:41:32.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.132+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.250__shadow_.CVI9RBH82QutE7zaIEsZs8j-yepBYns_0 2024-09-12T17:41:32.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.132+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18257437265870294985', time=2024-09-12T19:31:20.246072+0000, chain.objs.size()=1 2024-09-12T17:41:32.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.132+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.254__shadow_.OHiTEv2qT5oZaXpHyqRcg18E4cy9B0E_0 2024-09-12T17:41:32.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.132+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14975614942164619422', time=2024-09-12T19:31:21.721945+0000, chain.objs.size()=1 2024-09-12T17:41:32.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.132+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.258__shadow_.-z2-GprjDc8820nzDuLUYEuiMGRGJQ2_0 2024-09-12T17:41:32.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.132+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8737740959492229816', time=2024-09-12T19:31:22.894752+0000, chain.objs.size()=1 2024-09-12T17:41:32.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.132+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.261__shadow_.r5CHTWpw504iI8TQWNe9meGk8rqqe62_0 2024-09-12T17:41:32.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.132+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.903328986538689449', time=2024-09-12T19:31:42.421404+0000, chain.objs.size()=1 2024-09-12T17:41:32.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.132+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.oGjXc6L0TUSUQ3-6wcbi--Lmslz8Le-_0 2024-09-12T17:41:32.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.132+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6376370571158250370', time=2024-09-12T19:31:42.467276+0000, chain.objs.size()=1 2024-09-12T17:41:32.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.132+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Gqd_aeSEU_TwEeQHo9R_v4jT6DkKLKK_0 2024-09-12T17:41:32.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.136+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14801287869115887110', time=2024-09-12T19:31:42.532445+0000, chain.objs.size()=1 2024-09-12T17:41:32.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.136+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.S0KbtnT8x1tAfNoBe65HCC9u1OiwtAR_0 2024-09-12T17:41:32.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.136+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2939254616949955106', time=2024-09-12T19:31:42.560426+0000, chain.objs.size()=1 2024-09-12T17:41:32.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.136+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.OLWIEMi7x2qsbhUXDPZ5mK7wI3awWAa_0 2024-09-12T17:41:32.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.136+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12878428562767051606', time=2024-09-12T19:31:42.584817+0000, chain.objs.size()=1 2024-09-12T17:41:32.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.136+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.4xBeqGvVgHNbB4DiQeqFZtoRnavrtv5_0 2024-09-12T17:41:32.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.136+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14401644116509383664', time=2024-09-12T19:31:42.770488+0000, chain.objs.size()=1 2024-09-12T17:41:32.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.136+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.QN5cNybRTXT4dOEpVfxvfcBvIK7PONC_0 2024-09-12T17:41:32.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.136+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14252341537673420389', time=2024-09-12T19:31:42.814312+0000, chain.objs.size()=1 2024-09-12T17:41:32.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.136+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Hs5k8kxqyR7fdWdY7rBrrN40D4V2b0D_0 2024-09-12T17:41:32.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.136+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2303887165659788586', time=2024-09-12T19:31:42.853920+0000, chain.objs.size()=1 2024-09-12T17:41:32.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.136+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.WYwwAs19iaRZqiO-IciaxUzEdnCsHbH_0 2024-09-12T17:41:32.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.136+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6541837437444947071', time=2024-09-12T19:31:42.856737+0000, chain.objs.size()=1 2024-09-12T17:41:32.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.136+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.KG1cgGVktvj1CbSGHjBiDEI0u-PuHoX_0 2024-09-12T17:41:32.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.136+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11432420527293934', time=2024-09-12T19:31:42.930361+0000, chain.objs.size()=1 2024-09-12T17:41:32.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.136+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.CnqFzIxRG51cZpVyJT8EcHhQy6tlpbo_0 2024-09-12T17:41:32.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.136+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10761052191569321281', time=2024-09-12T19:31:43.127967+0000, chain.objs.size()=1 2024-09-12T17:41:32.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.136+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.i2fxFQ7xkcCkrEMYg17YDuygbVbcOy8_0 2024-09-12T17:41:32.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.136+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2906394290871302306', time=2024-09-12T19:31:43.162044+0000, chain.objs.size()=1 2024-09-12T17:41:32.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.136+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.NW9eGG3oIIuzRSVWuW07ImtFpyBlLMn_0 2024-09-12T17:41:32.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.140+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4900984656465682724', time=2024-09-12T19:31:43.198496+0000, chain.objs.size()=1 2024-09-12T17:41:32.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.140+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.H2dniIAMEqqPJQ2gNJ---mAYT6WpRDd_0 2024-09-12T17:41:32.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.140+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9194772978745377015', time=2024-09-12T19:31:43.211680+0000, chain.objs.size()=1 2024-09-12T17:41:32.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.140+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.K3VyC0Rim1-Nk01H88Fvc7JWJKi7Txl_0 2024-09-12T17:41:32.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.140+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8971068015457703647', time=2024-09-12T19:31:43.240813+0000, chain.objs.size()=1 2024-09-12T17:41:32.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.140+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.lq0w9eAg34iFF7PGkdT4tCNBbEXN_Pg_0 2024-09-12T17:41:32.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.140+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7651027848956232752', time=2024-09-12T19:31:43.542116+0000, chain.objs.size()=1 2024-09-12T17:41:32.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.140+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.YARXho-N416p3fPm8mUIfhl9ornSp8O_0 2024-09-12T17:41:32.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.140+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12716637802788521954', time=2024-09-12T19:31:43.561530+0000, chain.objs.size()=1 2024-09-12T17:41:32.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.140+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.bCdgpK49miExRs4YxuSkgKznHQyCrAb_0 2024-09-12T17:41:32.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.140+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3596688266761191094', time=2024-09-12T19:31:43.567390+0000, chain.objs.size()=1 2024-09-12T17:41:32.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.140+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Oz9477-KdyhJsZ4ixjarNwMzxbM5QaG_0 2024-09-12T17:41:32.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.140+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7275863623667524633', time=2024-09-12T19:31:43.734446+0000, chain.objs.size()=1 2024-09-12T17:41:32.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.140+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.-JizEi_zWv6n9Sx_QFxvxrPAgbsl3oC_0 2024-09-12T17:41:32.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.140+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16567947712090956665', time=2024-09-12T19:31:43.764098+0000, chain.objs.size()=1 2024-09-12T17:41:32.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.140+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.FrnGNAO0JdECC0RT50kQhsysif9cSTG_0 2024-09-12T17:41:32.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.140+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11026994393486745708', time=2024-09-12T19:31:43.818473+0000, chain.objs.size()=1 2024-09-12T17:41:32.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.140+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.n41JXa8X0HzrutfoNnmp3wsbTkLICtT_0 2024-09-12T17:41:32.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.140+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9860140019220609716', time=2024-09-12T19:31:43.836730+0000, chain.objs.size()=1 2024-09-12T17:41:32.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.140+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.o9lXZu1qW8x2p2GwRuYFFc78SISRLFx_0 2024-09-12T17:41:32.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.140+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6882100053721773775', time=2024-09-12T19:31:43.856424+0000, chain.objs.size()=1 2024-09-12T17:41:32.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.140+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.iwIDNu8uCz2sd8X0KEoMvQoXL89uKjj_0 2024-09-12T17:41:32.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.140+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13748313685076427794', time=2024-09-12T19:31:43.869683+0000, chain.objs.size()=1 2024-09-12T17:41:32.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.140+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.KSv-l2M_U2UjFhI4ieE0nkdWb4jxBCp_0 2024-09-12T17:41:32.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.140+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3483359477340845315', time=2024-09-12T19:31:43.881678+0000, chain.objs.size()=1 2024-09-12T17:41:32.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.140+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.ptBSbeX0D5THaME5zTWYYMb1LxnK0f7_0 2024-09-12T17:41:32.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.144+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5168488273750060686', time=2024-09-12T19:31:43.932117+0000, chain.objs.size()=1 2024-09-12T17:41:32.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.144+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Aq8_xgYxuBjJu-aefCYMpX1kMY5SYBH_0 2024-09-12T17:41:32.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.144+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13543533533024468839', time=2024-09-12T19:31:44.109860+0000, chain.objs.size()=1 2024-09-12T17:41:32.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.144+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.4ocR19aTQ86OmX4LTxToYqQRTldL2TQ_0 2024-09-12T17:41:32.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.144+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5119611255779308697', time=2024-09-12T19:31:44.383512+0000, chain.objs.size()=1 2024-09-12T17:41:32.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.144+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.6559GuU259EO3AZPcZUOGOsrj2MQT4u_0 2024-09-12T17:41:32.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.144+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14712120706078744097', time=2024-09-12T19:31:44.400289+0000, chain.objs.size()=1 2024-09-12T17:41:32.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.144+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.t-BYj2I6xbZ9bJJgCB_yQ9M7eG4MKh__0 2024-09-12T17:41:32.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.144+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16814660866383456557', time=2024-09-12T19:31:44.418511+0000, chain.objs.size()=1 2024-09-12T17:41:32.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.144+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.rghWjw5Opl4M8y8EwxSvJi--Y-L2B9v_0 2024-09-12T17:41:32.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.144+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12789584587810599634', time=2024-09-12T19:31:44.430520+0000, chain.objs.size()=1 2024-09-12T17:41:32.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.144+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.jcFH43akuQFVsTxeqWFtA9rFGG80um6_0 2024-09-12T17:41:32.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.144+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16480495420508171273', time=2024-09-12T19:31:44.477221+0000, chain.objs.size()=1 2024-09-12T17:41:32.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.144+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.ONYRT-WGrVhcZ9YGhjIt9G2vnsBS78N_0 2024-09-12T17:41:32.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.144+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11772230272227117503', time=2024-09-12T19:31:44.544271+0000, chain.objs.size()=1 2024-09-12T17:41:32.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.144+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.xK1bmoG2Ln-WQRzmOiYFWhAz67NxDyp_0 2024-09-12T17:41:32.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.144+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4186106355235875402', time=2024-09-12T19:31:45.469150+0000, chain.objs.size()=1 2024-09-12T17:41:32.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.144+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.265__shadow_.xPYSGLf1RtEX7-rBLpFEKPmJ6QQERyG_0 2024-09-12T17:41:32.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.144+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12122959202264877542', time=2024-09-12T19:31:46.180806+0000, chain.objs.size()=1 2024-09-12T17:41:32.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.144+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.267__shadow_.nZ0-OPPHkF9mkbN1wM2-RKXKkfL-qSo_0 2024-09-12T17:41:32.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.144+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6641025161868961503', time=2024-09-12T19:31:49.925531+0000, chain.objs.size()=1 2024-09-12T17:41:32.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.144+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.277__shadow_.JsNUJVH4hqC4Dp_g8eWY0GXjwXHoTjO_0 2024-09-12T17:41:32.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.148+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5047569083848103155', time=2024-09-12T19:31:53.814844+0000, chain.objs.size()=1 2024-09-12T17:41:32.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.148+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.287__shadow_.D7dYSpd2RR__nngqNy4m0yn3HsK6Geb_0 2024-09-12T17:41:32.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.148+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10941997296222000604', time=2024-09-12T19:31:56.460251+0000, chain.objs.size()=1 2024-09-12T17:41:32.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.148+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.292__shadow_.JWD2U5CY_cLBTe58G5OHRrcbRtONwMz_0 2024-09-12T17:41:32.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.148+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5229757002848012580', time=2024-09-12T19:31:56.502413+0000, chain.objs.size()=1 2024-09-12T17:41:32.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.148+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.292__shadow_.zPPYH3UcnKVNRlt_X9a_2DpEPIYG9Ei_0 2024-09-12T17:41:32.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.148+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.459014132106394305', time=2024-09-12T19:31:57.556699+0000, chain.objs.size()=1 2024-09-12T17:41:32.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.148+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.293__shadow_.QSklhJjAh4cnug5oy8frOJT3cimzvPV_0 2024-09-12T17:41:32.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.148+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8496914234939283483', time=2024-09-12T19:32:00.004469+0000, chain.objs.size()=1 2024-09-12T17:41:32.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.148+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.299__shadow_.B7LCDHOmhRIfkGIUC2AZx8LgekFeToz_0 2024-09-12T17:41:32.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.148+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13065253446350381547', time=2024-09-12T19:32:27.940842+0000, chain.objs.size()=1 2024-09-12T17:41:32.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.148+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.r27AuT1-HXJ6BAeKFr1dw4GxR7jcGqp_0 2024-09-12T17:41:32.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.148+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16894848039378296525', time=2024-09-12T19:32:27.951444+0000, chain.objs.size()=1 2024-09-12T17:41:32.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.148+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.oY8vVrgKhHKAW6HhP2cT3WSGBfvxblN_0 2024-09-12T17:41:32.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.148+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12129056684053967841', time=2024-09-12T19:32:28.024443+0000, chain.objs.size()=1 2024-09-12T17:41:32.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.148+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.p4LWNf8uW3wFVllldHAE2bJtGecH6-C_0 2024-09-12T17:41:32.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.148+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9321781992449826254', time=2024-09-12T19:32:28.057327+0000, chain.objs.size()=1 2024-09-12T17:41:32.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.148+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.gjomnXkw7FQD0PotRPfCwgGkZQ1guXf_0 2024-09-12T17:41:32.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.148+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17199896598212299420', time=2024-09-12T19:32:28.150279+0000, chain.objs.size()=1 2024-09-12T17:41:32.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.148+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.HTY8wFeNvfRs2Ih6vQfGqYdK6d639uW_0 2024-09-12T17:41:32.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.148+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6230315612160034348', time=2024-09-12T19:32:28.154467+0000, chain.objs.size()=1 2024-09-12T17:41:32.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.148+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.OLQYRmrxPOdOZaied6-tQyS24DI_sOE_0 2024-09-12T17:41:32.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.152+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11275986485997605913', time=2024-09-12T19:32:28.163147+0000, chain.objs.size()=1 2024-09-12T17:41:32.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.152+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.nTkcOeQhmYNkcByIca_7vdcUWZq5adu_0 2024-09-12T17:41:32.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.152+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1175528639701448598', time=2024-09-12T19:32:28.173364+0000, chain.objs.size()=1 2024-09-12T17:41:32.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.152+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.uQOCTSOsPpUqos9RPE21LzXkv3ISuI4_0 2024-09-12T17:41:32.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.152+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10782473285249276843', time=2024-09-12T19:32:28.185420+0000, chain.objs.size()=1 2024-09-12T17:41:32.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.152+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.cRFqi9BTuq1zOqh2XNTplwXV87Bukpx_0 2024-09-12T17:41:32.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.152+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8571363684010921524', time=2024-09-12T19:32:28.228109+0000, chain.objs.size()=1 2024-09-12T17:41:32.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.152+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.l-ApfKdSxbNjTPPYeueM7cFHd8w-I3x_0 2024-09-12T17:41:32.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.152+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2072478499766603186', time=2024-09-12T19:32:28.259982+0000, chain.objs.size()=1 2024-09-12T17:41:32.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.152+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.r3XxD9UQo91HmPdPMlzW_2o5joPxKWn_0 2024-09-12T17:41:32.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.152+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16523385741943202327', time=2024-09-12T19:32:28.294649+0000, chain.objs.size()=1 2024-09-12T17:41:32.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.152+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.fE3mKVKwded45zG3Be58YhZx641xT0s_0 2024-09-12T17:41:32.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.152+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16440495026940418080', time=2024-09-12T19:32:28.426062+0000, chain.objs.size()=1 2024-09-12T17:41:32.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.152+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.LeBkQeOqJGVvrCzER4R4QIwENlwBCFU_0 2024-09-12T17:41:32.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.152+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12619845746117507909', time=2024-09-12T19:32:28.452251+0000, chain.objs.size()=1 2024-09-12T17:41:32.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.152+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.n_pL-drRcuRBsCoWTck2wddiN3Ggrlg_0 2024-09-12T17:41:32.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.152+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12488288350075840758', time=2024-09-12T19:32:28.477623+0000, chain.objs.size()=1 2024-09-12T17:41:32.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.152+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.4qojzYgg76-MXkVbqCcFYIkIaDm7QHH_0 2024-09-12T17:41:32.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.152+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15811471676391364379', time=2024-09-12T19:32:28.497905+0000, chain.objs.size()=1 2024-09-12T17:41:32.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.152+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.k74j9LBqyw_hR8lZYnmKgpTCkwDy1ph_0 2024-09-12T17:41:32.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.152+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6928785281190048644', time=2024-09-12T19:32:28.529734+0000, chain.objs.size()=1 2024-09-12T17:41:32.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.152+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.4G7hNqh3mZk7CNy8at-aX7n4xESm2aJ_0 2024-09-12T17:41:32.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.152+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4436287613237648863', time=2024-09-12T19:32:28.553356+0000, chain.objs.size()=1 2024-09-12T17:41:32.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.152+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.3q5FAeEfjrBHzAX76PbtpfG-EgSCZ8x_0 2024-09-12T17:41:32.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.152+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4825466937588633515', time=2024-09-12T19:32:28.716115+0000, chain.objs.size()=1 2024-09-12T17:41:32.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.152+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.D4eKG9ksfVmFIDNn0o7ABfj-3x7tWr3_0 2024-09-12T17:41:32.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.152+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15340447136895737102', time=2024-09-12T19:32:28.722821+0000, chain.objs.size()=1 2024-09-12T17:41:32.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.152+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.uGvV7eK-2y0d4kMFEezPFTe-gnBk64b_0 2024-09-12T17:41:32.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.152+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15434942272179597412', time=2024-09-12T19:32:28.884447+0000, chain.objs.size()=1 2024-09-12T17:41:32.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.152+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.6hfnrcH4gq58yGzBINXlM0CMXsICV4O_0 2024-09-12T17:41:32.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.152+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5656587870671109084', time=2024-09-12T19:32:29.040367+0000, chain.objs.size()=1 2024-09-12T17:41:32.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.152+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.CjWtlVYbheXJZo0WGj5psnfHMqzQiht_0 2024-09-12T17:41:32.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.152+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18208714419104564319', time=2024-09-12T19:32:29.120218+0000, chain.objs.size()=1 2024-09-12T17:41:32.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.152+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.HQzzbJ3-i_-LvcgQeZkevcajJOprQSs_0 2024-09-12T17:41:32.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.156+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14149710826705413870', time=2024-09-12T19:32:29.199437+0000, chain.objs.size()=1 2024-09-12T17:41:32.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.156+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.KlSDOYWIW34m0ubzrRklhCBDXr1TR67_0 2024-09-12T17:41:32.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.156+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6424751192251757344', time=2024-09-12T19:32:29.235708+0000, chain.objs.size()=1 2024-09-12T17:41:32.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.156+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.WTn4au2bVDlGUiLfEwrsX5GwcsZOlH__0 2024-09-12T17:41:32.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.156+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4506786544098217803', time=2024-09-12T19:32:29.378410+0000, chain.objs.size()=1 2024-09-12T17:41:32.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.156+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.guU1EWzp-P1nsVZeZyMSs0mmsbgrZK2_0 2024-09-12T17:41:32.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.156+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1191646538994879965', time=2024-09-12T19:32:29.395606+0000, chain.objs.size()=1 2024-09-12T17:41:32.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.156+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.ro2hp9u_UegWmDV0JzYN9_e8BRVODCH_0 2024-09-12T17:41:32.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.156+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2214836459424711310', time=2024-09-12T19:32:29.431258+0000, chain.objs.size()=1 2024-09-12T17:41:32.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.156+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.TFj9Cp3dE1MUQr3kDQFQ3_bo8-230Zd_0 2024-09-12T17:41:32.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.156+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15075584161331051855', time=2024-09-12T19:32:29.462669+0000, chain.objs.size()=1 2024-09-12T17:41:32.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.156+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.fSOfV9NryTpcfOQBY2r0bJ28hHLEY78_0 2024-09-12T17:41:32.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.156+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12058343915835774620', time=2024-09-12T19:32:29.492952+0000, chain.objs.size()=1 2024-09-12T17:41:32.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.156+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.NfX6f-ysqbKO_7tuqcq4ZwDOvSJ_nb1_0 2024-09-12T17:41:32.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.156+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.716700582066805384', time=2024-09-12T19:32:29.526223+0000, chain.objs.size()=1 2024-09-12T17:41:32.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.156+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.KPGNI3Bv7nKZTcIIZp3hIZXk5brEsih_0 2024-09-12T17:41:32.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.156+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14907227225442030589', time=2024-09-12T19:32:29.538814+0000, chain.objs.size()=1 2024-09-12T17:41:32.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.156+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Z0zbJ_7rXgnrUng7UtP624BXMS40SP8_0 2024-09-12T17:41:32.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.160+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16034414755910790154', time=2024-09-12T19:32:29.669771+0000, chain.objs.size()=1 2024-09-12T17:41:32.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.160+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_._qm8azXY8NtEFM7HwuuGflo9Ak63qI4_0 2024-09-12T17:41:32.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.160+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12109637067238844086', time=2024-09-12T19:32:29.686512+0000, chain.objs.size()=1 2024-09-12T17:41:32.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.160+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Da4vei4qbpYY1Wvy3DOh8HMbfzCygxX_0 2024-09-12T17:41:32.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.160+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.816503408603121665', time=2024-09-12T19:32:29.736070+0000, chain.objs.size()=1 2024-09-12T17:41:32.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.160+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Mo1NLsoDj8iiv2e0x4AXNR1u-7tPEZK_0 2024-09-12T17:41:32.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.160+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12903968839343654889', time=2024-09-12T19:32:29.751636+0000, chain.objs.size()=1 2024-09-12T17:41:32.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.160+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.oeIsFPbH_ddkOHWgKJGsKkJbhxf4xat_0 2024-09-12T17:41:32.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.160+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5040044789872952908', time=2024-09-12T19:32:29.752615+0000, chain.objs.size()=1 2024-09-12T17:41:32.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.160+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.O2rvwv08NpArtK1WcVRVFtoRlwPkTwl_0 2024-09-12T17:41:32.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.160+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16122762071994941845', time=2024-09-12T19:32:29.886013+0000, chain.objs.size()=1 2024-09-12T17:41:32.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.160+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.R2CcadYZZEvFrqjVEgbd6H7_y0NpLMO_0 2024-09-12T17:41:32.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.160+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12600541782939280469', time=2024-09-12T19:32:30.133929+0000, chain.objs.size()=1 2024-09-12T17:41:32.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.160+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.M639ut_Ub1WPO9go1zdm-8Ly5mYk0iU_0 2024-09-12T17:41:32.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.160+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4222458302301279380', time=2024-09-12T19:32:49.530119+0000, chain.objs.size()=1 2024-09-12T17:41:32.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.160+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.3WVOkTZ58YQcBbv3V1LyN9l1PmKhmln_0 2024-09-12T17:41:32.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.160+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11745941810787639508', time=2024-09-12T19:32:49.608599+0000, chain.objs.size()=1 2024-09-12T17:41:32.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.160+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.olxmTqQVI_BhhTbXJI61NzVJA6jQhq7_0 2024-09-12T17:41:32.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.160+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10166167569823691210', time=2024-09-12T19:32:49.636601+0000, chain.objs.size()=1 2024-09-12T17:41:32.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.160+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.ScZtPSxg6YVgabXspJxkE1uXUz_swCA_0 2024-09-12T17:41:32.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.160+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5623060812274246603', time=2024-09-12T19:32:49.646863+0000, chain.objs.size()=1 2024-09-12T17:41:32.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.160+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.1NKagVDKAWZAG6tD21CJWqBPDct1urM_0 2024-09-12T17:41:32.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.160+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3966823224231208304', time=2024-09-12T19:32:49.647796+0000, chain.objs.size()=1 2024-09-12T17:41:32.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.160+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.HhUJ3p0EqsEeCgCJCzFzPY47R9Wn5By_0 2024-09-12T17:41:32.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.160+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1132912745201805961', time=2024-09-12T19:32:49.692110+0000, chain.objs.size()=1 2024-09-12T17:41:32.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.160+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.ILrIcC7ppC0doP8JqjUSI2eNvilZK8-_0 2024-09-12T17:41:32.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.160+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15113060582583722917', time=2024-09-12T19:32:49.740443+0000, chain.objs.size()=1 2024-09-12T17:41:32.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.160+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.esqK5LKCRfXsLYvPv1hWk0QpZqRVIf2_0 2024-09-12T17:41:32.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.164+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17321575206552001306', time=2024-09-12T19:32:49.894790+0000, chain.objs.size()=1 2024-09-12T17:41:32.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.164+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.8KniNQdiqTklDrgtcZfUfeKQXwhisXx_0 2024-09-12T17:41:32.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.164+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8889394276076699006', time=2024-09-12T19:32:49.981748+0000, chain.objs.size()=1 2024-09-12T17:41:32.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.164+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Kd8fru1Ib58tya8rXGN-YvI2nplT_fD_0 2024-09-12T17:41:32.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.164+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6788303030032708770', time=2024-09-12T19:32:50.133585+0000, chain.objs.size()=1 2024-09-12T17:41:32.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.164+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.VFepntw9SaUtpom86qeIKxSrPdodaln_0 2024-09-12T17:41:32.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.164+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13049495796700459095', time=2024-09-12T19:32:50.145983+0000, chain.objs.size()=1 2024-09-12T17:41:32.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.164+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.IA1UFJTwEZNOnfZ4v_HwivAONHAm6Yt_0 2024-09-12T17:41:32.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.164+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2534982305076820992', time=2024-09-12T19:32:50.201931+0000, chain.objs.size()=1 2024-09-12T17:41:32.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.164+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.0AlhNZi53hr-wlS4c8DbYFq5VF7qj2K_0 2024-09-12T17:41:32.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.164+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/44554 2024-09-12T17:41:32.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.168+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=41, truncated=0, next_marker='' 2024-09-12T17:41:32.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.168+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7950809997939021307', time=2024-09-12T19:32:50.214953+0000, chain.objs.size()=1 2024-09-12T17:41:32.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.168+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.dTkYodnX0sRbL3ibLf04G4h_iaxt5-s_0 2024-09-12T17:41:32.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.168+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5871645191086585687', time=2024-09-12T19:32:50.217193+0000, chain.objs.size()=1 2024-09-12T17:41:32.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.168+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.S8UWDo-MWgAvNl5zA_hT72gK9YYH_TX_0 2024-09-12T17:41:32.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.168+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6847594005703349954', time=2024-09-12T19:32:50.224944+0000, chain.objs.size()=1 2024-09-12T17:41:32.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.168+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.KmqJFif22_qM1ltdYsl0QCbevjobfQt_0 2024-09-12T17:41:32.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.168+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16885774525691248524', time=2024-09-12T19:32:50.282727+0000, chain.objs.size()=1 2024-09-12T17:41:32.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.168+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.2ZtgeLepWJx-j3bEfGjoEuHZtB4OeAJ_0 2024-09-12T17:41:32.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.168+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12352900687258487500', time=2024-09-12T19:32:50.331386+0000, chain.objs.size()=1 2024-09-12T17:41:32.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.168+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.JonbqGeS26gL3xQUsciBp9KXP7WhL3Y_0 2024-09-12T17:41:32.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.168+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9314890837443265797', time=2024-09-12T19:32:50.463238+0000, chain.objs.size()=1 2024-09-12T17:41:32.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.168+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.5J44B4Qi91EQFqB4BUdmqfZLfJgCfpm_0 2024-09-12T17:41:32.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.168+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5711066916306405224', time=2024-09-12T19:32:50.931765+0000, chain.objs.size()=1 2024-09-12T17:41:32.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.168+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.wIcOrif6UkbX7zQJGL-IhxYtaZHI9fO_0 2024-09-12T17:41:32.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.168+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2706417828895433428', time=2024-09-12T19:32:50.947542+0000, chain.objs.size()=1 2024-09-12T17:41:32.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.168+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.mLawRnoI1Bi2247282JfraZdhq8QBzA_0 2024-09-12T17:41:32.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.168+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2932983314326698534', time=2024-09-12T19:32:50.995376+0000, chain.objs.size()=1 2024-09-12T17:41:32.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.168+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.fB_Vf6x2PEmQfm9i7v5RQ5b2ehZFwMS_0 2024-09-12T17:41:32.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.168+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.276048534472405472', time=2024-09-12T19:32:51.191224+0000, chain.objs.size()=1 2024-09-12T17:41:32.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.168+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.5P7MSRUfHF7wLK9jcFt-EnHqCC990nl_0 2024-09-12T17:41:32.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.168+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11743249410012028587', time=2024-09-12T19:32:51.208691+0000, chain.objs.size()=1 2024-09-12T17:41:32.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.168+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.w6sVt-LseF72vMKPe4huF2pbCPlTaHh_0 2024-09-12T17:41:32.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.168+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11399136950345369422', time=2024-09-12T19:32:51.272139+0000, chain.objs.size()=1 2024-09-12T17:41:32.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.168+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.zehhYE04Uf2vrmJp_hy5ZKadL03ZEFf_0 2024-09-12T17:41:32.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.172+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10431214199627133823', time=2024-09-12T19:32:51.372925+0000, chain.objs.size()=1 2024-09-12T17:41:32.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.172+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.ZEj46pShYpyX61_HKPQiw6z1kYoEm3f_0 2024-09-12T17:41:32.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.172+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.511979911482393623', time=2024-09-12T19:32:51.376363+0000, chain.objs.size()=1 2024-09-12T17:41:32.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.172+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.IsTGadjeB5Zf2FNc2qnPile2HIXrFQR_0 2024-09-12T17:41:32.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.172+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2423683025992203676', time=2024-09-12T19:32:51.501341+0000, chain.objs.size()=1 2024-09-12T17:41:32.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.172+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.iX7CZ5F8hW09jpAxRZv_CAJ7ELebkj9_0 2024-09-12T17:41:32.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.172+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18244620222950840741', time=2024-09-12T19:32:51.588919+0000, chain.objs.size()=1 2024-09-12T17:41:32.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.172+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.MwvqvVLOEsSQVj9hoVNYRNtYvdjnhc1_0 2024-09-12T17:41:32.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.172+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5423479498971765149', time=2024-09-12T19:32:51.634745+0000, chain.objs.size()=1 2024-09-12T17:41:32.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.172+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.jVrk4NANz_9N0UExuqyxy0fdYDHXlYP_0 2024-09-12T17:41:32.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.172+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4380974152006288249', time=2024-09-12T19:32:51.694716+0000, chain.objs.size()=1 2024-09-12T17:41:32.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.172+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.qAN9flJqn9xa8GTvJMYHgtOT1rzJhII_0 2024-09-12T17:41:32.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.172+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10239549487830090721', time=2024-09-12T19:32:51.917567+0000, chain.objs.size()=1 2024-09-12T17:41:32.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.172+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.lhN3KtRVTE9n-WPriKUBinAYDpYnwvo_0 2024-09-12T17:41:32.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.172+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15669428639084703699', time=2024-09-12T19:32:51.978006+0000, chain.objs.size()=1 2024-09-12T17:41:32.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.172+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.T9KxcoMBGg8sHSCWtu8xq7g6Afc1LJp_0 2024-09-12T17:41:32.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.172+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3064666863134959911', time=2024-09-12T19:32:53.466338+0000, chain.objs.size()=1 2024-09-12T17:41:32.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.172+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.329__shadow_.mv-LVUTU3dGRbdS0XYnRrC8Sgdrc3Hf_0 2024-09-12T17:41:32.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.172+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6402769542971039745', time=2024-09-12T19:32:54.486844+0000, chain.objs.size()=1 2024-09-12T17:41:32.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.172+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.332__shadow_.1rUfcBffBsK2gTVElGmRqWYo3GyyqFx_0 2024-09-12T17:41:32.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.172+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4457318619902784722', time=2024-09-12T19:32:54.946340+0000, chain.objs.size()=1 2024-09-12T17:41:32.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.172+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.333__shadow_.gqw_peGG8IY5f0XSXKdfVqqfFzOGjeP_0 2024-09-12T17:41:32.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.176+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11816193832783607967', time=2024-09-12T19:33:40.242775+0000, chain.objs.size()=1 2024-09-12T17:41:32.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.176+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.458__shadow_.fWxST_oOeKip4Rg8bue8QwlJhpVzCkk_0 2024-09-12T17:41:32.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.176+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4671979402212114423', time=2024-09-12T19:33:49.244230+0000, chain.objs.size()=1 2024-09-12T17:41:32.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.176+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.483__shadow_.5bY8sMEyM_r8_WWwQwcKnej2x8T9jgB_0 2024-09-12T17:41:32.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.176+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4864639394569172129', time=2024-09-12T19:33:49.249479+0000, chain.objs.size()=1 2024-09-12T17:41:32.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.176+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.483__shadow_.4fD5-bP6ZP4Ek0xcB9Q75Nw1KTeGNgM_0 2024-09-12T17:41:32.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.176+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17076773976207925862', time=2024-09-12T19:33:49.260694+0000, chain.objs.size()=1 2024-09-12T17:41:32.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.176+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.483__shadow_.87Xe5oJo_oNe1NATZsNMvibHHtENZsc_0 2024-09-12T17:41:32.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.176+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13080282002416473263', time=2024-09-12T19:33:54.233290+0000, chain.objs.size()=1 2024-09-12T17:41:32.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.176+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.496__shadow_.mH3ExzquKA50T1_O-2b9TiKhR4LxAe8_0 2024-09-12T17:41:32.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.176+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17151876847389932278', time=2024-09-12T19:34:00.418589+0000, chain.objs.size()=6 2024-09-12T17:41:32.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.176+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.507__multipart_srcmultipart.2~PH2AaCAKTBRXF-9QaLILt69t4ifQcL6.1 2024-09-12T17:41:32.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.176+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.507__multipart_srcmultipart.2~PH2AaCAKTBRXF-9QaLILt69t4ifQcL6.2 2024-09-12T17:41:32.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.176+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.507__multipart_srcmultipart.2~PH2AaCAKTBRXF-9QaLILt69t4ifQcL6.3 2024-09-12T17:41:32.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.176+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.507__multipart_srcmultipart.2~PH2AaCAKTBRXF-9QaLILt69t4ifQcL6.4 2024-09-12T17:41:32.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.176+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.507__multipart_srcmultipart.2~PH2AaCAKTBRXF-9QaLILt69t4ifQcL6.5 2024-09-12T17:41:32.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.176+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.507__multipart_srcmultipart.2~PH2AaCAKTBRXF-9QaLILt69t4ifQcL6.6 2024-09-12T17:41:32.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.176+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4465282483598192698', time=2024-09-12T19:34:24.956412+0000, chain.objs.size()=2 2024-09-12T17:41:32.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.176+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.525__multipart_mymultipart.2~S0-NArDdT6aFI7Qe5uBVx7KSP7VinWf.1 2024-09-12T17:41:32.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.176+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.525__multipart_mymultipart.2~S0-NArDdT6aFI7Qe5uBVx7KSP7VinWf.2 2024-09-12T17:41:32.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.180+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15107256299031497514', time=2024-09-12T19:35:03.752798+0000, chain.objs.size()=1 2024-09-12T17:41:32.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.180+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.555__shadow_.2Fz5jPCvGogfKqZYAbSgbr6OKXd0c0K_0 2024-09-12T17:41:32.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.180+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2084827415504775707', time=2024-09-12T19:35:04.475958+0000, chain.objs.size()=1 2024-09-12T17:41:32.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.180+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.556__shadow_.GY0_enOKmA1dsQGX81XofJvV_2B2fOC_0 2024-09-12T17:41:32.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.180+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4992428444863198169', time=2024-09-12T19:35:05.103473+0000, chain.objs.size()=1 2024-09-12T17:41:32.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.180+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.557__shadow_.7PPX-5vuon5DewwKADHB0i9w7T1SKve_0 2024-09-12T17:41:32.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.180+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1850954613101630115', time=2024-09-12T19:35:16.230548+0000, chain.objs.size()=1 2024-09-12T17:41:32.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.180+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.569__shadow:pssKwTnlctK6KUgv0jLNwJCOmzs5otW_.qgNVW85u3-2mcBFAFIAOJXfOmlYU2LZ_0 2024-09-12T17:41:32.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.180+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5739451095520594478', time=2024-09-12T19:35:25.873249+0000, chain.objs.size()=1 2024-09-12T17:41:32.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.180+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.573__shadow_.rhECPTPTP1z7VuVKAO1PTRtcdTpA-Ec_0 2024-09-12T17:41:32.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.180+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10077520054651197843', time=2024-09-12T19:35:40.984786+0000, chain.objs.size()=1 2024-09-12T17:41:32.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.180+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.577__shadow:tAaZqSD2ipgkcHaup0QPtuxfGHF9I.3_.g8DebPvrn3NkV637B9PVrdMZHl_6moJ_0 2024-09-12T17:41:32.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.180+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.335941480290061604', time=2024-09-12T19:35:56.046759+0000, chain.objs.size()=1 2024-09-12T17:41:32.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.180+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.582__shadow:ZB3fv.f1mBD3bX3qs6f.G3oDDfeh9QW_.w4OpouDI23jcEDWTkazYZII8xNyhCY3_0 2024-09-12T17:41:32.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.180+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1726585184546667522', time=2024-09-12T19:38:28.694259+0000, chain.objs.size()=1 2024-09-12T17:41:32.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.180+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.640__shadow_._dKW7Fdvst-m9mTrYnadVOoW3fbDzAX_0 2024-09-12T17:41:32.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.180+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17063485971406591935', time=2024-09-12T19:38:55.649876+0000, chain.objs.size()=1 2024-09-12T17:41:32.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.180+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.701__shadow:T7yjL72fGDpJr0F.uXNRKApDXPQlblE_.x-VVxFUDl1Uongt-irqrMbYc_amD5bC_0 2024-09-12T17:41:32.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.180+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2611790953048766574', time=2024-09-12T19:38:59.997174+0000, chain.objs.size()=1 2024-09-12T17:41:32.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.180+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.711__multipart_file1.2~y9Tu8eIrj3BMBC_pwMICw3Ix_x0EMXA.1 2024-09-12T17:41:32.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.180+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5760827160411017924', time=2024-09-12T19:39:21.883532+0000, chain.objs.size()=1 2024-09-12T17:41:32.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.180+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.719__shadow_.UXSjbKc3IyTuLU3cXByTtAnpWRTkxeZ_0 2024-09-12T17:41:32.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.184+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:41:32.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.188+0000 7fd765adf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:41:32.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.188+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:41:32.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.188+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:41:32.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.188+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51398' 2024-09-12T17:41:32.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.188+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16284108947924803691', time=2024-09-12T19:31:16.404172+0000, chain.objs.size()=1 2024-09-12T17:41:32.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.188+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.244__shadow_.KfMISwG1gQMYSg8jYyHWrT4_y79br-7_0 2024-09-12T17:41:32.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.188+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10364288539868039574', time=2024-09-12T19:31:17.568291+0000, chain.objs.size()=1 2024-09-12T17:41:32.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.188+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.247__shadow_.3DjdmrmWhV2pNIeZqiXTzeDZOLx7eR9_0 2024-09-12T17:41:32.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.188+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9634107491861801950', time=2024-09-12T19:31:17.945723+0000, chain.objs.size()=1 2024-09-12T17:41:32.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.188+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.248__shadow_.tpCeSTBFK5gLhC--9b4j9ErRncykCto_0 2024-09-12T17:41:32.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.188+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9400122849782581377', time=2024-09-12T19:31:42.240817+0000, chain.objs.size()=1 2024-09-12T17:41:32.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.188+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.PMBwAKg9kDuuWH4ymmP8WKxgLQUkMd5_0 2024-09-12T17:41:32.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.188+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1142146629927699902', time=2024-09-12T19:31:42.258947+0000, chain.objs.size()=1 2024-09-12T17:41:32.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.188+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.9p_kKAsRg0asikFzTAeC78SJzmnZwvj_0 2024-09-12T17:41:32.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.188+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.100135590321527249', time=2024-09-12T19:31:42.353588+0000, chain.objs.size()=1 2024-09-12T17:41:32.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.188+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.2YmOwCJFtBN4QIQd_FircCrSMMsLBmG_0 2024-09-12T17:41:32.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.188+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15240112282154659630', time=2024-09-12T19:31:42.412646+0000, chain.objs.size()=1 2024-09-12T17:41:32.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.188+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.qIBKao-JpTX4MH-8O4loNm9XnCiFmgT_0 2024-09-12T17:41:32.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.188+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18248406964187362250', time=2024-09-12T19:31:42.422630+0000, chain.objs.size()=1 2024-09-12T17:41:32.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.188+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.3Uv1mYAEAEd-UOrSxVND-xfage-WYVR_0 2024-09-12T17:41:32.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.188+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12953368522417192989', time=2024-09-12T19:31:42.601166+0000, chain.objs.size()=1 2024-09-12T17:41:32.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.188+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.uilemN7Nk8UouB-HEP2CiXkO4cC7Nfi_0 2024-09-12T17:41:32.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.188+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8490591793887722816', time=2024-09-12T19:31:42.608615+0000, chain.objs.size()=1 2024-09-12T17:41:32.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.188+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.P6TNBFIXpX6TmOHjS5tXlumucHEPLT2_0 2024-09-12T17:41:32.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.188+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.636429491196780341', time=2024-09-12T19:31:42.666573+0000, chain.objs.size()=1 2024-09-12T17:41:32.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.188+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.7XqmbF-74qpMFSPdxHvPqO2DifJ7FeP_0 2024-09-12T17:41:32.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.188+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12672363969219064791', time=2024-09-12T19:31:42.786920+0000, chain.objs.size()=1 2024-09-12T17:41:32.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.188+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.IIKqkkroxLogBucf0G60g6oC1UQSzCu_0 2024-09-12T17:41:32.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.192+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1397565918562234920', time=2024-09-12T19:31:42.880417+0000, chain.objs.size()=1 2024-09-12T17:41:32.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.192+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.5i1g58pyr-gMlY5pUoNGT1Mqx_eU3IV_0 2024-09-12T17:41:32.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.192+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8589066956186393706', time=2024-09-12T19:31:42.883066+0000, chain.objs.size()=1 2024-09-12T17:41:32.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.192+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.kwUeGXQ25MBWylEF9-6AATwSsgYzwkR_0 2024-09-12T17:41:32.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.192+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10795335180863175639', time=2024-09-12T19:31:42.894135+0000, chain.objs.size()=1 2024-09-12T17:41:32.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.192+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.-xhFxfqlPpBZaCFmH02un7Ghl5Vt_5c_0 2024-09-12T17:41:32.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.192+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11437844937337914578', time=2024-09-12T19:31:42.936721+0000, chain.objs.size()=1 2024-09-12T17:41:32.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.192+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.C1dwvlDZ1WTN2zHMWd71VdouqmdS9cG_0 2024-09-12T17:41:32.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.192+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12395280730373345347', time=2024-09-12T19:31:42.940485+0000, chain.objs.size()=1 2024-09-12T17:41:32.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.192+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.FQuhxM6jgHcVBOcz10-Fp17cWaaC4jb_0 2024-09-12T17:41:32.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.192+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4215000939472747784', time=2024-09-12T19:31:42.951187+0000, chain.objs.size()=1 2024-09-12T17:41:32.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.192+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.NTWQ4DDgUUlmJ_F9nzQoxRPDMf3q2Mw_0 2024-09-12T17:41:32.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.192+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5582597220038768128', time=2024-09-12T19:31:43.140882+0000, chain.objs.size()=1 2024-09-12T17:41:32.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.192+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.CJGk7VHu9RF6aZjZvnRSOOdK63yoozQ_0 2024-09-12T17:41:32.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.192+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16740357110185068201', time=2024-09-12T19:31:43.188932+0000, chain.objs.size()=1 2024-09-12T17:41:32.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.192+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.OxtgG0gF0xt-k9-un7FKVL6lzJY0Rif_0 2024-09-12T17:41:32.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.192+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8614625241701795847', time=2024-09-12T19:31:43.193361+0000, chain.objs.size()=1 2024-09-12T17:41:32.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.192+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.crL5uz7qu2VSMEAzHm81R7K6ArV7-DC_0 2024-09-12T17:41:32.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.192+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9349721452237671485', time=2024-09-12T19:31:43.495309+0000, chain.objs.size()=1 2024-09-12T17:41:32.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.192+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.ojj6Pc27peuTFmLb0Vl2iWIHSVhXF6s_0 2024-09-12T17:41:32.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.192+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14703264832972622640', time=2024-09-12T19:31:43.526524+0000, chain.objs.size()=1 2024-09-12T17:41:32.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.192+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.1Nf8z8h5H0FspWY-p4MJ1GciiHHJe9f_0 2024-09-12T17:41:32.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.196+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13312180607653041507', time=2024-09-12T19:31:43.806286+0000, chain.objs.size()=1 2024-09-12T17:41:32.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.196+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.tWEvTNModUWLhV4LcDiB9J20cVEn_aB_0 2024-09-12T17:41:32.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.196+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.802824584489330368', time=2024-09-12T19:31:44.103418+0000, chain.objs.size()=1 2024-09-12T17:41:32.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.196+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.APU2zSXIQfcc39KotjvUHydNOl_8N6c_0 2024-09-12T17:41:32.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.196+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16844001037636855974', time=2024-09-12T19:31:44.124812+0000, chain.objs.size()=1 2024-09-12T17:41:32.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.196+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.lKEDzPG5-11lxnEuVmlniTDOt1jiNli_0 2024-09-12T17:41:32.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.196+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18075911915185183262', time=2024-09-12T19:31:44.190070+0000, chain.objs.size()=1 2024-09-12T17:41:32.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.196+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.QN2ZAUbCzwWCFj3WDqa_rFgWwLGqrSI_0 2024-09-12T17:41:32.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.196+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13585204834417289031', time=2024-09-12T19:31:44.260730+0000, chain.objs.size()=1 2024-09-12T17:41:32.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.196+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.bYMzQB0Awxyuq3hpudph8RrpR3cAXjr_0 2024-09-12T17:41:32.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.196+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1771544897548356508', time=2024-09-12T19:31:44.272171+0000, chain.objs.size()=1 2024-09-12T17:41:32.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.196+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.O1HhhED50QAR5Cvm6xyJ9cHt4RodVKf_0 2024-09-12T17:41:32.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.196+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.82476799322954862', time=2024-09-12T19:31:44.435412+0000, chain.objs.size()=1 2024-09-12T17:41:32.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.196+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.kxasjJMCUAK8-Zj-VcaRGcHX71CH-Oo_0 2024-09-12T17:41:32.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.196+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16460770117741048427', time=2024-09-12T19:31:44.446918+0000, chain.objs.size()=1 2024-09-12T17:41:32.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.196+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.zRppktRpexhoFfYfdGPqJFvQ1Z78dDb_0 2024-09-12T17:41:32.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.196+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4863924837415907750', time=2024-09-12T19:31:44.447857+0000, chain.objs.size()=1 2024-09-12T17:41:32.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.196+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.cwYQ5vV00A-7XDLsmyeOrdrxTbEgoaB_0 2024-09-12T17:41:32.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.196+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1570078278565565541', time=2024-09-12T19:31:44.456912+0000, chain.objs.size()=1 2024-09-12T17:41:32.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.196+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.hnzPzO2FEdyCDMQY94KCQLU4tr1ddQ8_0 2024-09-12T17:41:32.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.196+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15260055562660280141', time=2024-09-12T19:31:44.754675+0000, chain.objs.size()=1 2024-09-12T17:41:32.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.196+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.263__shadow_.MzmYiNbCQ_gxYJXnwR6vUDPmPlLXD7L_0 2024-09-12T17:41:32.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.196+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4271252306494520201', time=2024-09-12T19:31:46.944028+0000, chain.objs.size()=1 2024-09-12T17:41:32.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.196+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.269__shadow_.zOOyT5q-BX_w1xdz9UvSrBqOLiRDARM_0 2024-09-12T17:41:32.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.196+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13392377133012337484', time=2024-09-12T19:31:49.923075+0000, chain.objs.size()=1 2024-09-12T17:41:32.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.196+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.277__shadow_.r_fgq7UBCfUbmqQj6UXmhDqJPTZtAnN_0 2024-09-12T17:41:32.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.196+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15001894246662165825', time=2024-09-12T19:31:50.627508+0000, chain.objs.size()=1 2024-09-12T17:41:32.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.196+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.279__shadow_.easyL56uLUSPS7D9-C2IsPwRJqWJBHI_0 2024-09-12T17:41:32.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.196+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7098180050360543903', time=2024-09-12T19:31:51.002391+0000, chain.objs.size()=1 2024-09-12T17:41:32.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.196+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.280__shadow_.ElCl77Pam1RiBtFi-BCB-_vxE9BJlKt_0 2024-09-12T17:41:32.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.196+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14844550848452061319', time=2024-09-12T19:31:57.571461+0000, chain.objs.size()=1 2024-09-12T17:41:32.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.196+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.293__shadow_.TMvFbcybBFvIXB6BQkxfTb4O1aCX2fI_0 2024-09-12T17:41:32.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.196+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9934268466367017870', time=2024-09-12T19:31:57.588817+0000, chain.objs.size()=1 2024-09-12T17:41:32.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.196+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.293__shadow_.ZyDlfarGE3AxylRdAsDLF6FEjeNsI0N_0 2024-09-12T17:41:32.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.200+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15836391230846997118', time=2024-09-12T19:32:27.899636+0000, chain.objs.size()=1 2024-09-12T17:41:32.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.200+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.plUztYcuqlbGlNfbOilG-f5QpgJxTF9_0 2024-09-12T17:41:32.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.200+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14834253012544167193', time=2024-09-12T19:32:27.941948+0000, chain.objs.size()=1 2024-09-12T17:41:32.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.200+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.eLa0olpM-l1CFPAoqdFHkKHcoV6k291_0 2024-09-12T17:41:32.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.200+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8710614603505953487', time=2024-09-12T19:32:28.001156+0000, chain.objs.size()=1 2024-09-12T17:41:32.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.200+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.obHhNNafavhcbLABiEW1-5T1GFR4zdM_0 2024-09-12T17:41:32.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.200+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16184151806300935736', time=2024-09-12T19:32:28.029362+0000, chain.objs.size()=1 2024-09-12T17:41:32.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.200+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.C6bpgcTgt8O1Dp25ObdiqrUL3YSbz9__0 2024-09-12T17:41:32.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.200+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13111743163229898037', time=2024-09-12T19:32:28.379423+0000, chain.objs.size()=1 2024-09-12T17:41:32.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.200+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Av6TFwQqD5JJ1nKn-CHwWauspPKgGDj_0 2024-09-12T17:41:32.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.200+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12768757484165992478', time=2024-09-12T19:32:28.502476+0000, chain.objs.size()=1 2024-09-12T17:41:32.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.200+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.8I8lOvRlJ9vuSezI2kp9xM2HonVzGpN_0 2024-09-12T17:41:32.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.200+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.454409785907371212', time=2024-09-12T19:32:28.697751+0000, chain.objs.size()=1 2024-09-12T17:41:32.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.200+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.nHxM6FFxJcihrti1Gj1hr1ZVlYCMi3G_0 2024-09-12T17:41:32.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.200+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18424135788091868000', time=2024-09-12T19:32:28.867255+0000, chain.objs.size()=1 2024-09-12T17:41:32.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.200+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.KOgqVruh-4078DwpSb8ICMPHuiqgxgX_0 2024-09-12T17:41:32.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.200+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11596971566236796601', time=2024-09-12T19:32:28.877167+0000, chain.objs.size()=1 2024-09-12T17:41:32.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.200+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.RM5ngIOc4XB_xLiBsLovztAyjcPCi00_0 2024-09-12T17:41:32.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.200+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11808263113610191593', time=2024-09-12T19:32:29.054166+0000, chain.objs.size()=1 2024-09-12T17:41:32.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.200+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.uJnpJAPFmfSOgqEiUNOoJwKluklvw1n_0 2024-09-12T17:41:32.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.200+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11791702994580943495', time=2024-09-12T19:32:29.128460+0000, chain.objs.size()=1 2024-09-12T17:41:32.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.200+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.-mEBiJHbxLPyvCMR6QmDiN4e106__eH_0 2024-09-12T17:41:32.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.200+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16588931516696135584', time=2024-09-12T19:32:29.224359+0000, chain.objs.size()=1 2024-09-12T17:41:32.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.200+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.iZoOu-pnzHuUOKcj0_g-hbnUmAcWJSZ_0 2024-09-12T17:41:32.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.200+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15509647280247660618', time=2024-09-12T19:32:29.365843+0000, chain.objs.size()=1 2024-09-12T17:41:32.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.200+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.EHuud_4qYPY3Do46K4whmrKeL3Uf4kX_0 2024-09-12T17:41:32.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.200+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16165355372642301663', time=2024-09-12T19:32:29.403743+0000, chain.objs.size()=1 2024-09-12T17:41:32.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.200+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.y9ezYcUPJhKpDEFinnSYNfUk4sbFzCl_0 2024-09-12T17:41:32.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.200+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8021068097361271756', time=2024-09-12T19:32:29.407573+0000, chain.objs.size()=1 2024-09-12T17:41:32.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.200+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.1KU0AYXJSGWrHxEnJVXm_A2X0EDpyRb_0 2024-09-12T17:41:32.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.200+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15956396962103716604', time=2024-09-12T19:32:29.472804+0000, chain.objs.size()=1 2024-09-12T17:41:32.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.200+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.upUlhCiqF6qIE4q_CmHNLEU7I1JK5HB_0 2024-09-12T17:41:32.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.200+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.974278192409257517', time=2024-09-12T19:32:29.506091+0000, chain.objs.size()=1 2024-09-12T17:41:32.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.200+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.JKfDGw7elW0j501WzoXGM8LvP7lJH5t_0 2024-09-12T17:41:32.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.204+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5244821389959162601', time=2024-09-12T19:32:29.524786+0000, chain.objs.size()=1 2024-09-12T17:41:32.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.204+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.WHJ_bAdB8m_qO1Nq6vUNuclJZyl6YSU_0 2024-09-12T17:41:32.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.204+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1959808144722683084', time=2024-09-12T19:32:29.728152+0000, chain.objs.size()=1 2024-09-12T17:41:32.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.204+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.FB9IgYp15MH8WdojwTU47_MVr9qm2SO_0 2024-09-12T17:41:32.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.204+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14514891844230130052', time=2024-09-12T19:32:29.744068+0000, chain.objs.size()=1 2024-09-12T17:41:32.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.204+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.JqGcBZ-m6OxUUsfx537Y46vw9jQR4yW_0 2024-09-12T17:41:32.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.204+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12188147385979845892', time=2024-09-12T19:32:29.785059+0000, chain.objs.size()=1 2024-09-12T17:41:32.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.204+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.kW8S7RoPlveB_1yKeQ4ujIipk4rETW__0 2024-09-12T17:41:32.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.204+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4458560890932400215', time=2024-09-12T19:32:29.795701+0000, chain.objs.size()=1 2024-09-12T17:41:32.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.204+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.DBqxabpMjvKspTEBaFKJ5_rLxbQhGW__0 2024-09-12T17:41:32.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.204+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5562224566145057538', time=2024-09-12T19:32:29.801714+0000, chain.objs.size()=1 2024-09-12T17:41:32.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.204+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.wYHd6ZYgz5W8TpHXrUjP8AizPOc7YLO_0 2024-09-12T17:41:32.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.204+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17708473168156580595', time=2024-09-12T19:32:29.811449+0000, chain.objs.size()=1 2024-09-12T17:41:32.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.204+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.SCrSTuOcIsBf6HeOnE3VmhqjTM26Qkx_0 2024-09-12T17:41:32.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.204+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9750290221336851022', time=2024-09-12T19:32:29.812217+0000, chain.objs.size()=1 2024-09-12T17:41:32.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.204+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.xqIYEoM4Fn6Jg-g7UMxo9twWI8GBcYJ_0 2024-09-12T17:41:32.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.204+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13346659071028146543', time=2024-09-12T19:32:29.818286+0000, chain.objs.size()=1 2024-09-12T17:41:32.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.204+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.7FoS8DAc5Av6OBnfvgLbvFbeBfriJFj_0 2024-09-12T17:41:32.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.204+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9327587727712357885', time=2024-09-12T19:32:29.839867+0000, chain.objs.size()=1 2024-09-12T17:41:32.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.204+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.mhMzzGxSAxgZoCf8RSm4by6eeeKjloN_0 2024-09-12T17:41:32.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.204+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16571565402091818014', time=2024-09-12T19:32:30.093559+0000, chain.objs.size()=1 2024-09-12T17:41:32.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.204+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.fwhqPmP2UPB0Jk5_XA5VVS0dAttdIgC_0 2024-09-12T17:41:32.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.204+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4817795387359903799', time=2024-09-12T19:32:30.107191+0000, chain.objs.size()=1 2024-09-12T17:41:32.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.204+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.8U4uDiqjebzhRpt-48eI69JP1E1u-hk_0 2024-09-12T17:41:32.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.204+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4220465065395702540', time=2024-09-12T19:32:49.619008+0000, chain.objs.size()=1 2024-09-12T17:41:32.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.204+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.lTCN-QUDAJP4eE4BQPSiynX2QVgxQIp_0 2024-09-12T17:41:32.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.204+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16573142257987028619', time=2024-09-12T19:32:49.623460+0000, chain.objs.size()=1 2024-09-12T17:41:32.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.204+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.oVJy_I-MDarU9TgpC1hUiFgzbdm7nT9_0 2024-09-12T17:41:32.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.208+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11962674980426742269', time=2024-09-12T19:32:49.678572+0000, chain.objs.size()=1 2024-09-12T17:41:32.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.208+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.WoX1cRr6BRposkXAS7lv8-i4Ckns2ww_0 2024-09-12T17:41:32.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.208+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1733556623857663384', time=2024-09-12T19:32:49.685955+0000, chain.objs.size()=1 2024-09-12T17:41:32.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.208+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.4Erac1n_fWN96nqiu4aMdVJhZY4lk7-_0 2024-09-12T17:41:32.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.208+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4459103523494398320', time=2024-09-12T19:32:49.731793+0000, chain.objs.size()=1 2024-09-12T17:41:32.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.208+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.qOyWwLAXOq-WNO6DV3ymIvr4kKjjXIx_0 2024-09-12T17:41:32.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.208+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8071897809576548398', time=2024-09-12T19:32:49.878503+0000, chain.objs.size()=1 2024-09-12T17:41:32.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.208+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.DwJiczRQ3OymS3PYCTUSAxPVAYXR8lO_0 2024-09-12T17:41:32.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.208+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13767255014885626683', time=2024-09-12T19:32:49.879787+0000, chain.objs.size()=1 2024-09-12T17:41:32.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.208+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.KVqa0qNgPjyyiaL2mih8yetvNUbfaEc_0 2024-09-12T17:41:32.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.208+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10516118451857293925', time=2024-09-12T19:32:49.926960+0000, chain.objs.size()=1 2024-09-12T17:41:32.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.208+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Itnbc5kELrOrj3-ILGx3PhH3n0A3f7i_0 2024-09-12T17:41:32.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.208+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3595322415670490457', time=2024-09-12T19:32:50.157109+0000, chain.objs.size()=1 2024-09-12T17:41:32.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.208+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.qvgv0NqudligbYld18Kor3nvloG24RN_0 2024-09-12T17:41:32.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.208+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8115623942482938376', time=2024-09-12T19:32:50.183422+0000, chain.objs.size()=1 2024-09-12T17:41:32.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.208+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.zpmF2pN7GloKhV1mk4znDUoRY7N1FzT_0 2024-09-12T17:41:32.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.208+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11243020058364054936', time=2024-09-12T19:32:50.189691+0000, chain.objs.size()=1 2024-09-12T17:41:32.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.208+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.jXO3DUbEwyaU0iT8E4POIoQfxU4FUa2_0 2024-09-12T17:41:32.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.208+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13597203954544157841', time=2024-09-12T19:32:50.197638+0000, chain.objs.size()=1 2024-09-12T17:41:32.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.208+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Ndsc3mVP18MQjQOf3auXoZe2DaZtdCl_0 2024-09-12T17:41:32.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.208+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4982345363295621755', time=2024-09-12T19:32:50.335158+0000, chain.objs.size()=1 2024-09-12T17:41:32.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.208+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.XgIk3LWzrSwJ33br8wdZ4g13lm9WgFl_0 2024-09-12T17:41:32.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.208+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12419582343721094177', time=2024-09-12T19:32:50.538590+0000, chain.objs.size()=1 2024-09-12T17:41:32.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.208+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.EUQG-iiD3_ibbavWlk_LHXg7hWRbGgI_0 2024-09-12T17:41:32.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.208+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13675020576951278904', time=2024-09-12T19:32:50.652348+0000, chain.objs.size()=1 2024-09-12T17:41:32.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.208+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.MU1t6iOdYicDIfVhWkTZUg36lK9lxzM_0 2024-09-12T17:41:32.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.208+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15535399968241587390', time=2024-09-12T19:32:50.653581+0000, chain.objs.size()=1 2024-09-12T17:41:32.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.208+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.o_2qFjGIK_YKthxchlqLNGRWHnMUzQU_0 2024-09-12T17:41:32.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.208+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17650068547527960143', time=2024-09-12T19:32:50.831801+0000, chain.objs.size()=1 2024-09-12T17:41:32.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.208+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.IZ6B2D3KvCjzO9Qi-MVKEOB-F1o0HPF_0 2024-09-12T17:41:32.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.208+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15679319102746631925', time=2024-09-12T19:32:50.878224+0000, chain.objs.size()=1 2024-09-12T17:41:32.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.208+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.FbqS6acPDRjR18Iqb2jFB-dm86zKa26_0 2024-09-12T17:41:32.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.208+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14383218090171418002', time=2024-09-12T19:32:51.162241+0000, chain.objs.size()=1 2024-09-12T17:41:32.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.208+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.KAquIADS6v7P2NxOEr5THxmCsT9Umtu_0 2024-09-12T17:41:32.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.212+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4440771323598741487', time=2024-09-12T19:32:51.225328+0000, chain.objs.size()=1 2024-09-12T17:41:32.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.212+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Qlq3qsQIPtLotbd96YzEpcTs1VBZiXC_0 2024-09-12T17:41:32.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.212+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17862733009121045689', time=2024-09-12T19:32:51.276633+0000, chain.objs.size()=1 2024-09-12T17:41:32.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.212+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.JOHsBCcGQN43PFYlh4HT38VzAy2aGa5_0 2024-09-12T17:41:32.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.212+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14409789160523027150', time=2024-09-12T19:32:51.522761+0000, chain.objs.size()=1 2024-09-12T17:41:32.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.212+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.gSq6D3sn00-Rm4zYYMRDUoHkZfhRoYc_0 2024-09-12T17:41:32.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.212+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3130397546266915086', time=2024-09-12T19:32:51.538774+0000, chain.objs.size()=1 2024-09-12T17:41:32.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.212+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.i7GFAjXT8iPpQTG0nC6TJUachjG8oy3_0 2024-09-12T17:41:32.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.212+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3651464966696808911', time=2024-09-12T19:32:51.621638+0000, chain.objs.size()=1 2024-09-12T17:41:32.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.212+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.HEDTdK85vuF1fINRAoAnzqFTmeo9M6k_0 2024-09-12T17:41:32.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.212+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.665226611125593318', time=2024-09-12T19:32:51.709785+0000, chain.objs.size()=1 2024-09-12T17:41:32.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.212+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.kAf3bPukI1u9YnW58_mmXMxxM6jPtZh_0 2024-09-12T17:41:32.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.212+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17012568619697828363', time=2024-09-12T19:32:51.711821+0000, chain.objs.size()=1 2024-09-12T17:41:32.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.212+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.jyW-esoWuLxTZ13clbQxcGYQG92k5iw_0 2024-09-12T17:41:32.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.212+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3853127134923366411', time=2024-09-12T19:32:51.851535+0000, chain.objs.size()=1 2024-09-12T17:41:32.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.212+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.ns3HGH1ltwtNPS0x35tgml0uvx4tpwF_0 2024-09-12T17:41:32.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.212+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1283632296376770344', time=2024-09-12T19:32:51.998162+0000, chain.objs.size()=1 2024-09-12T17:41:32.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.212+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.ZcUPaTwcbBEgixsnLqwPJ414PWxkZrp_0 2024-09-12T17:41:32.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.212+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15847062214286120877', time=2024-09-12T19:33:34.263679+0000, chain.objs.size()=1 2024-09-12T17:41:32.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.212+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.444__shadow_.2JRdF78Mvb3vqvgy5coTjIkxaNYVzxG_0 2024-09-12T17:41:32.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.212+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12680352262879626095', time=2024-09-12T19:33:38.496098+0000, chain.objs.size()=1 2024-09-12T17:41:32.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.212+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.455__shadow_.rtuIDAUtE87Xzw79u6j8K1YG-jTpZFb_0 2024-09-12T17:41:32.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.212+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6133416494001419635', time=2024-09-12T19:33:42.553046+0000, chain.objs.size()=1 2024-09-12T17:41:32.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.212+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.462__shadow_.5Px_wU5kL1asAVArqbTjNjHOnOXU9JW_0 2024-09-12T17:41:32.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.216+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/51398 2024-09-12T17:41:32.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.216+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T17:41:32.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.216+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3701585881355036120', time=2024-09-12T19:33:49.668563+0000, chain.objs.size()=1 2024-09-12T17:41:32.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.216+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.484__shadow_.zPJ1AFM62S3ngCSblKuoQiTKcK1Lud5_0 2024-09-12T17:41:32.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.216+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9135945311265001022', time=2024-09-12T19:33:54.397786+0000, chain.objs.size()=1 2024-09-12T17:41:32.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.216+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.496__shadow_.mH3ExzquKA50T1_O-2b9TiKhR4LxAe8_0 2024-09-12T17:41:32.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.216+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15185659124637324405', time=2024-09-12T19:34:00.284067+0000, chain.objs.size()=6 2024-09-12T17:41:32.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.216+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.507__multipart_srcmultipart.2~PH2AaCAKTBRXF-9QaLILt69t4ifQcL6.1 2024-09-12T17:41:32.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.216+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.507__multipart_srcmultipart.2~PH2AaCAKTBRXF-9QaLILt69t4ifQcL6.2 2024-09-12T17:41:32.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.216+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.507__multipart_srcmultipart.2~PH2AaCAKTBRXF-9QaLILt69t4ifQcL6.3 2024-09-12T17:41:32.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.216+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.507__multipart_srcmultipart.2~PH2AaCAKTBRXF-9QaLILt69t4ifQcL6.4 2024-09-12T17:41:32.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.216+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.507__multipart_srcmultipart.2~PH2AaCAKTBRXF-9QaLILt69t4ifQcL6.5 2024-09-12T17:41:32.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.216+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.507__multipart_srcmultipart.2~PH2AaCAKTBRXF-9QaLILt69t4ifQcL6.6 2024-09-12T17:41:32.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.216+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8178939883762869618', time=2024-09-12T19:34:24.648211+0000, chain.objs.size()=3 2024-09-12T17:41:32.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.216+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.525__multipart_mymultipart.2~tecB3GcFpXBvzUeNSAOLKNr-Hsvei2X.1 2024-09-12T17:41:32.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.216+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.525__multipart_mymultipart.2~tecB3GcFpXBvzUeNSAOLKNr-Hsvei2X.2 2024-09-12T17:41:32.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.216+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.525__multipart_mymultipart.2~tecB3GcFpXBvzUeNSAOLKNr-Hsvei2X.3 2024-09-12T17:41:32.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.216+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15129364178388859259', time=2024-09-12T19:35:06.507321+0000, chain.objs.size()=1 2024-09-12T17:41:32.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.216+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.558__shadow_.moHhFlvHsZmSi20jcVsA-5RjpIM-4Xv_0 2024-09-12T17:41:32.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.220+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10108796891205740721', time=2024-09-12T19:35:16.910056+0000, chain.objs.size()=1 2024-09-12T17:41:32.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.220+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.569__shadow:IBvBTU-oBjpkS2hql.fR590R.1crPZn_.svrPfr1gdKZT6V1m-n2aQ-3LpSst7_r_0 2024-09-12T17:41:32.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.220+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7571512238008104456', time=2024-09-12T19:35:18.508538+0000, chain.objs.size()=1 2024-09-12T17:41:32.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.220+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.569__shadow:j4I-SwwabFyf29g81UXkp-5zlt9Zq7u_.tlwgloznjtABpWGepRHY2-BjR-fc7mB_0 2024-09-12T17:41:32.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.220+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17088851005503729059', time=2024-09-12T19:35:23.025121+0000, chain.objs.size()=1 2024-09-12T17:41:32.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.220+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.569__shadow:oUklnPb.t9FFmw75xfw2QoQ53UOr6CE_.8P_I0RrOaaEBFKjErjEFS9g6j205ku6_0 2024-09-12T17:41:32.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.220+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.45277145781182793', time=2024-09-12T19:35:41.593962+0000, chain.objs.size()=1 2024-09-12T17:41:32.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.220+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.577__shadow:Baiam-V4CPVGM2UEWzz2tmH4mGuTNO6_.jhkz20bWc2_sI_fHYtRDPaZ7Tmmlz4__0 2024-09-12T17:41:32.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.220+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9543784063040685641', time=2024-09-12T19:35:47.738731+0000, chain.objs.size()=1 2024-09-12T17:41:32.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.220+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.577__shadow:7k80eJhR5x7M4Ug9vIJeN2iRLYjrSrO_._6BXTLATy3KphdUeUbJ-7bswcNtsT9C_0 2024-09-12T17:41:32.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.220+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17958265696363837455', time=2024-09-12T19:38:34.008836+0000, chain.objs.size()=2 2024-09-12T17:41:32.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.220+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.650__shadow_.lT5FqQ1RdYRieail_HquRge55_4vFiB_0 2024-09-12T17:41:32.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.220+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.650__shadow_.lT5FqQ1RdYRieail_HquRge55_4vFiB_1 2024-09-12T17:41:32.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.220+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8115122344359613001', time=2024-09-12T19:38:43.998357+0000, chain.objs.size()=1 2024-09-12T17:41:32.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.220+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.666__shadow_.SrWLRz954oaTO3HQvFZtH4Ab2bQ9rYD_0 2024-09-12T17:41:32.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.220+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8265338426938323834', time=2024-09-12T19:38:45.192100+0000, chain.objs.size()=1 2024-09-12T17:41:32.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.220+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.670__shadow_.HIEJd7kjbawMWREFOuOhgjGWLYRw32L_0 2024-09-12T17:41:32.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.224+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:41:32.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.224+0000 7fd765adf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:41:32.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.228+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:41:32.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.228+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:41:32.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.228+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/52555' 2024-09-12T17:41:32.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.228+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11082843941698723683', time=2024-09-12T19:29:47.796386+0000, chain.objs.size()=5 2024-09-12T17:41:32.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.228+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.161__multipart_foo-FROZEN.2~MkFENcyUb8E2hFbH2y6sGcgyNZ66dGc.1 2024-09-12T17:41:32.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.228+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.161__shadow_foo-FROZEN.2~MkFENcyUb8E2hFbH2y6sGcgyNZ66dGc.1_1 2024-09-12T17:41:32.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.228+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.161__multipart_foo-FROZEN.2~MkFENcyUb8E2hFbH2y6sGcgyNZ66dGc.2 2024-09-12T17:41:32.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.228+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.161__shadow_foo-FROZEN.2~MkFENcyUb8E2hFbH2y6sGcgyNZ66dGc.2_1 2024-09-12T17:41:32.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.228+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.161__multipart_foo-FROZEN.2~MkFENcyUb8E2hFbH2y6sGcgyNZ66dGc.3 2024-09-12T17:41:32.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.228+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6187035008287659174', time=2024-09-12T19:31:10.620067+0000, chain.objs.size()=1 2024-09-12T17:41:32.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.228+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.230__shadow_.49sADu7sr0Emb5yzV4Vp7YLmln2BbBj_0 2024-09-12T17:41:32.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.228+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7811399701697869949', time=2024-09-12T19:31:12.594657+0000, chain.objs.size()=1 2024-09-12T17:41:32.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.228+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.235__shadow_.BtI6alqJiek21heGtxI2UwpAiJQpy2s_0 2024-09-12T17:41:32.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.228+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4059416455803774670', time=2024-09-12T19:31:19.864822+0000, chain.objs.size()=1 2024-09-12T17:41:32.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.228+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.253__shadow_.zfEWWAK51G29ULv_u2NWEWgrH1Nr53F_0 2024-09-12T17:41:32.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.228+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.626229209791981452', time=2024-09-12T19:31:42.286290+0000, chain.objs.size()=1 2024-09-12T17:41:32.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.228+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.0qbH-FSlsyv2SzS2_YwtRI387wQES6B_0 2024-09-12T17:41:32.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.228+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2869244004069926995', time=2024-09-12T19:31:42.416230+0000, chain.objs.size()=1 2024-09-12T17:41:32.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.228+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.W6AAXGpblOxmVcUGzXQFMuIpSbBr0mf_0 2024-09-12T17:41:32.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.228+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5105771704141596262', time=2024-09-12T19:31:42.467264+0000, chain.objs.size()=1 2024-09-12T17:41:32.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.228+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.0XORNNUk6B0t8mqqX8Il-5X1J-e2ZtZ_0 2024-09-12T17:41:32.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.228+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4933278965849921508', time=2024-09-12T19:31:42.564019+0000, chain.objs.size()=1 2024-09-12T17:41:32.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.228+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.WC_jZdKw58Z0mkdwEB4iBSijkCC58V9_0 2024-09-12T17:41:32.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.232+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7138057297662320264', time=2024-09-12T19:31:42.629764+0000, chain.objs.size()=1 2024-09-12T17:41:32.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.232+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.0Dlpbq4IOUSG_4H1tURfk3tl55QWOay_0 2024-09-12T17:41:32.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.232+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10061232195729397891', time=2024-09-12T19:31:42.689441+0000, chain.objs.size()=1 2024-09-12T17:41:32.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.232+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.RIMzi92aY8VQ8xiNyOqJ99DRoxR5OJa_0 2024-09-12T17:41:32.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.232+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12167059470552722339', time=2024-09-12T19:31:42.708438+0000, chain.objs.size()=1 2024-09-12T17:41:32.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.232+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.V15ka36oM4CLxKwSRLh7ayFTjwN0i8H_0 2024-09-12T17:41:32.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.232+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5099612320651948238', time=2024-09-12T19:31:42.772991+0000, chain.objs.size()=1 2024-09-12T17:41:32.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.232+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.s-Cs_lABujp9oMPtftLz8DRJkxoG-HA_0 2024-09-12T17:41:32.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.232+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8852683108020503100', time=2024-09-12T19:31:42.863173+0000, chain.objs.size()=1 2024-09-12T17:41:32.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.232+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.4vu-wEaKo-WJeUWVLHMmHtfyO13Qbwx_0 2024-09-12T17:41:32.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.232+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11074876661330094984', time=2024-09-12T19:31:43.170535+0000, chain.objs.size()=1 2024-09-12T17:41:32.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.232+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.9hQeymWMIKFN2SlkiFeALSdjLoccfra_0 2024-09-12T17:41:32.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.232+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.862368982393445982', time=2024-09-12T19:31:43.204837+0000, chain.objs.size()=1 2024-09-12T17:41:32.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.232+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.R5crP0Za9O1iVd8RwNDqlIMso6Ha1up_0 2024-09-12T17:41:32.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.232+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13046979677794533585', time=2024-09-12T19:31:43.216889+0000, chain.objs.size()=1 2024-09-12T17:41:32.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.232+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.ip-HLE5606xQAhyrQvbg6y2jyubqM2g_0 2024-09-12T17:41:32.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.232+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10860530867944743577', time=2024-09-12T19:31:43.492444+0000, chain.objs.size()=1 2024-09-12T17:41:32.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.232+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Ppbwb2wauSwXAiZUl3AOQi3TiUX9SxY_0 2024-09-12T17:41:32.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.232+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11516490387544938215', time=2024-09-12T19:31:43.562949+0000, chain.objs.size()=1 2024-09-12T17:41:32.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.232+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.KqdY0MEQoBvgZivayVZUsFXuPQ5E051_0 2024-09-12T17:41:32.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.232+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15973032782671433405', time=2024-09-12T19:31:43.578288+0000, chain.objs.size()=1 2024-09-12T17:41:32.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.232+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.wI7JJGCHFlCgmJVikZTDmXXsKF56cFC_0 2024-09-12T17:41:32.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.236+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9229678425340584748', time=2024-09-12T19:31:43.603382+0000, chain.objs.size()=1 2024-09-12T17:41:32.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.236+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.pF3O0CCrbbzKElP7Q_-azD9CzUHJYk2_0 2024-09-12T17:41:32.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.236+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8631016657390457171', time=2024-09-12T19:31:43.775777+0000, chain.objs.size()=1 2024-09-12T17:41:32.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.236+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.K6cePtAf8ysk1qpWs_4s6YPnk-CmaiI_0 2024-09-12T17:41:32.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.236+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10431808206842485853', time=2024-09-12T19:31:43.777202+0000, chain.objs.size()=1 2024-09-12T17:41:32.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.236+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.4iukIELyWyq3B9Hb6LmXlUCq8PItSaM_0 2024-09-12T17:41:32.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.236+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13490927915244459863', time=2024-09-12T19:31:43.842277+0000, chain.objs.size()=1 2024-09-12T17:41:32.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.236+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.tdtnm7rD_7xemfSKWj5iwcyptNLorDC_0 2024-09-12T17:41:32.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.236+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14634088343628597395', time=2024-09-12T19:31:43.893609+0000, chain.objs.size()=1 2024-09-12T17:41:32.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.236+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.xHzBrObsIiIfDUPblbuxipeYP9D8r9M_0 2024-09-12T17:41:32.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.236+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10752851903106541176', time=2024-09-12T19:31:44.196356+0000, chain.objs.size()=1 2024-09-12T17:41:32.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.236+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.47C1vUU-w4qwu9ttJindNQqVTj_G0Be_0 2024-09-12T17:41:32.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.236+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.557656374235326307', time=2024-09-12T19:31:44.398537+0000, chain.objs.size()=1 2024-09-12T17:41:32.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.236+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.ac-W5NKyXhMePvynmpKO4APXZ3MHUjg_0 2024-09-12T17:41:32.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.236+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9878842619994433601', time=2024-09-12T19:31:44.441310+0000, chain.objs.size()=1 2024-09-12T17:41:32.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.236+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.gy2D7BC7n9aPGa03rmVV_ManUj9dMDV_0 2024-09-12T17:41:32.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.236+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7033566664469358692', time=2024-09-12T19:31:44.485796+0000, chain.objs.size()=1 2024-09-12T17:41:32.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.236+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.rRhuItXWcfSc9F9zSCN7SRLwKR5UOA5_0 2024-09-12T17:41:32.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.236+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13300556045965216757', time=2024-09-12T19:31:44.492924+0000, chain.objs.size()=1 2024-09-12T17:41:32.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.236+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.n3KzgiWqJdJbCHORhKGHtY0V5mbLQ6S_0 2024-09-12T17:41:32.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.236+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4820402869525084935', time=2024-09-12T19:31:44.497161+0000, chain.objs.size()=1 2024-09-12T17:41:32.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.236+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.YTW_qef09D24T_JNS2Apa677HGFMpqM_0 2024-09-12T17:41:32.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.240+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12751484444378808381', time=2024-09-12T19:31:44.524722+0000, chain.objs.size()=1 2024-09-12T17:41:32.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.240+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.vsdxXbaAX-UrpK62NyA2MblKSTyDOs1_0 2024-09-12T17:41:32.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.240+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17244273883321095758', time=2024-09-12T19:31:44.528501+0000, chain.objs.size()=1 2024-09-12T17:41:32.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.240+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.nkhuZikE4lUxb6b-xly_FKTuHunPJRu_0 2024-09-12T17:41:32.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.240+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6867622943559539276', time=2024-09-12T19:31:46.583980+0000, chain.objs.size()=1 2024-09-12T17:41:32.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.240+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.268__shadow_.hUxBO-mHDsfFiji5YzLxTk7TYxzfwjj_0 2024-09-12T17:41:32.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.240+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7417622952541839030', time=2024-09-12T19:31:50.259466+0000, chain.objs.size()=1 2024-09-12T17:41:32.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.240+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.278__shadow_.RAXnIKVIfgoQdLlS7DpI7FA4kfo-aZV_0 2024-09-12T17:41:32.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.240+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10577423080720318620', time=2024-09-12T19:31:54.616115+0000, chain.objs.size()=1 2024-09-12T17:41:32.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.240+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.289__shadow_.pJB5qcXKuBQ1V3ZB47EIs0jHn_FeB9C_0 2024-09-12T17:41:32.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.240+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4113380964625499304', time=2024-09-12T19:31:54.989564+0000, chain.objs.size()=1 2024-09-12T17:41:32.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.240+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.290__shadow_.NR1wNWU0KiwcUZn9O9Ijr3TuM30fJ4P_0 2024-09-12T17:41:32.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.240+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17919740285564822259', time=2024-09-12T19:31:58.353979+0000, chain.objs.size()=1 2024-09-12T17:41:32.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.240+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.295__shadow_.k54tSTzuclntURSEDYT13es5jRfaQUX_0 2024-09-12T17:41:32.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.240+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11984155564164230031', time=2024-09-12T19:31:59.115990+0000, chain.objs.size()=1 2024-09-12T17:41:32.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.240+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.297__shadow_.MbbLFotQi4qumWb1pNyAGc2zmnhFDK__0 2024-09-12T17:41:32.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.240+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6028135402399182852', time=2024-09-12T19:32:02.874750+0000, chain.objs.size()=1 2024-09-12T17:41:32.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.240+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.306__shadow_.xVWfSEnIOKuKVitN8aXkh5J4bOiwrBq_0 2024-09-12T17:41:32.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.240+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11039415052920052053', time=2024-09-12T19:32:27.856903+0000, chain.objs.size()=1 2024-09-12T17:41:32.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.240+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.uSd0Og_GYU9xRPqQXl4vkqMKTUzQdTk_0 2024-09-12T17:41:32.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.240+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1405091290582612573', time=2024-09-12T19:32:27.924825+0000, chain.objs.size()=1 2024-09-12T17:41:32.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.240+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.9QXU3Ez6Sp7BFBGji9ybL3E0stOuSav_0 2024-09-12T17:41:32.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.240+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4694530680283024790', time=2024-09-12T19:32:28.051896+0000, chain.objs.size()=1 2024-09-12T17:41:32.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.240+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.4izm_TI6ssMLm7JYbQcZr4UnFpXHueM_0 2024-09-12T17:41:32.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.240+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1184584986269875317', time=2024-09-12T19:32:28.078406+0000, chain.objs.size()=1 2024-09-12T17:41:32.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.240+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.MM9B_FisCi7QINO3XfWH89h-_SqunwY_0 2024-09-12T17:41:32.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.240+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13571585560491059424', time=2024-09-12T19:32:28.281577+0000, chain.objs.size()=1 2024-09-12T17:41:32.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.240+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.aKp3ZPooa2HlhohvlzdDK1mNbGy6K6P_0 2024-09-12T17:41:32.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.240+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11174713411931067306', time=2024-09-12T19:32:28.288189+0000, chain.objs.size()=1 2024-09-12T17:41:32.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.240+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Df8BWEhIEXG7d8HSLrP_2YLpZ9aZ3Le_0 2024-09-12T17:41:32.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.240+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1427780382347610568', time=2024-09-12T19:32:28.536010+0000, chain.objs.size()=1 2024-09-12T17:41:32.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.240+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.smPKT_JTzn-IOAKq2EH3gsn9_AbS-cA_0 2024-09-12T17:41:32.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.240+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9496428181918407525', time=2024-09-12T19:32:28.702231+0000, chain.objs.size()=1 2024-09-12T17:41:32.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.240+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.KXd-EO2UoMV0JB5sgBe2PpdPDJI146U_0 2024-09-12T17:41:32.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.240+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8583568968476296046', time=2024-09-12T19:32:28.866013+0000, chain.objs.size()=1 2024-09-12T17:41:32.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.240+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.7tOb7emhiILWnX3C0NpCWAZlZbT3Fj8_0 2024-09-12T17:41:32.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.240+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4374589545111597332', time=2024-09-12T19:32:28.872191+0000, chain.objs.size()=1 2024-09-12T17:41:32.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.240+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.LDy03HmN1QdS75vs2QOK0JUILdXeFOc_0 2024-09-12T17:41:32.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.240+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14752101699127404888', time=2024-09-12T19:32:29.226046+0000, chain.objs.size()=1 2024-09-12T17:41:32.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.240+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Da80tTei8lYKYy-mLzVp6WmDOG0iuMY_0 2024-09-12T17:41:32.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.240+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2134502788243985394', time=2024-09-12T19:32:29.389519+0000, chain.objs.size()=1 2024-09-12T17:41:32.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.240+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.mphA6DJGdQGsBxnHaKJ7q1_8gUv0dVO_0 2024-09-12T17:41:32.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.244+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10091872023519534673', time=2024-09-12T19:32:29.669035+0000, chain.objs.size()=1 2024-09-12T17:41:32.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.244+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.M8TzHZ22mWKskQQQkJX9wlKKBxO0TrQ_0 2024-09-12T17:41:32.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.244+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5736194020238335860', time=2024-09-12T19:32:29.777184+0000, chain.objs.size()=1 2024-09-12T17:41:32.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.244+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.TwCYWEh7zp-1xZldCrmrGJbNl4kOqa2_0 2024-09-12T17:41:32.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.244+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9493019587594170233', time=2024-09-12T19:32:29.843725+0000, chain.objs.size()=1 2024-09-12T17:41:32.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.244+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.FOpoVpNkPssbZhurg2XxRYyT72PPbGs_0 2024-09-12T17:41:32.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.244+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16208782771055658911', time=2024-09-12T19:32:29.885434+0000, chain.objs.size()=1 2024-09-12T17:41:32.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.244+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.354BIHjTrNXGWfmJ1zJY7CWnfMMlnb0_0 2024-09-12T17:41:32.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.244+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9319416351048176519', time=2024-09-12T19:32:30.067139+0000, chain.objs.size()=1 2024-09-12T17:41:32.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.244+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.lxEM0jtXOeQZcXysBWcbEek_SBGT9Ho_0 2024-09-12T17:41:32.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.244+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9306971283124704570', time=2024-09-12T19:32:30.067981+0000, chain.objs.size()=1 2024-09-12T17:41:32.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.244+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.7C3z6g1pOaw2aUwu3hiqUB83uk71LY2_0 2024-09-12T17:41:32.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.244+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6648285053440837937', time=2024-09-12T19:32:30.087759+0000, chain.objs.size()=1 2024-09-12T17:41:32.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.244+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.tLok693OQWIyPc9gVC3-IzdaGOW_z5m_0 2024-09-12T17:41:32.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.244+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4015011480824137350', time=2024-09-12T19:32:30.135565+0000, chain.objs.size()=1 2024-09-12T17:41:32.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.244+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.P_pf5_-XnByPDSd7k2KrU9Gy5gTTZqH_0 2024-09-12T17:41:32.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.244+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5883927332445672626', time=2024-09-12T19:32:30.157588+0000, chain.objs.size()=1 2024-09-12T17:41:32.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.244+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.gDbUBs2J3hOAkax6L39HKm1iLGXCMZn_0 2024-09-12T17:41:32.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.244+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12729638244394179657', time=2024-09-12T19:32:49.670544+0000, chain.objs.size()=1 2024-09-12T17:41:32.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.244+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.0ZF-IpyJi2lNBnJlhh5yxm3NzfC8Rau_0 2024-09-12T17:41:32.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.244+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16638417269440329471', time=2024-09-12T19:32:49.741163+0000, chain.objs.size()=1 2024-09-12T17:41:32.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.244+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.oe77pXMougPobofMqjTf0OZAtZ-bNik_0 2024-09-12T17:41:32.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.244+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2919858173812236480', time=2024-09-12T19:32:49.772604+0000, chain.objs.size()=1 2024-09-12T17:41:32.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.244+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.guAHy_omqvvZ02bcXtT0fh4C6ir_zca_0 2024-09-12T17:41:32.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.244+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5287871154712843899', time=2024-09-12T19:32:49.846344+0000, chain.objs.size()=1 2024-09-12T17:41:32.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.244+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.JaUoNNcj6adTMlDVTjA8HW0hIdUDsJT_0 2024-09-12T17:41:32.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.244+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9397052379404685741', time=2024-09-12T19:32:49.958629+0000, chain.objs.size()=1 2024-09-12T17:41:32.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.244+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.tzerXC6Q18zqlJhS7yangrUQJzMC4al_0 2024-09-12T17:41:32.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.244+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12252656742654103683', time=2024-09-12T19:32:49.977626+0000, chain.objs.size()=1 2024-09-12T17:41:32.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.244+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.jQrnsbsn8-MltNlUXs72ihFmU8V3vzu_0 2024-09-12T17:41:32.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.244+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8438894603159407312', time=2024-09-12T19:32:49.993300+0000, chain.objs.size()=1 2024-09-12T17:41:32.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.244+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.2caoy6d5MttFg1wNX1cQ__BWqaEVjHM_0 2024-09-12T17:41:32.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.244+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6537334771097355816', time=2024-09-12T19:32:50.287369+0000, chain.objs.size()=1 2024-09-12T17:41:32.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.244+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.uA1JpkEAwN87Ccoc9z2jBvv1U7ZN0i0_0 2024-09-12T17:41:32.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.244+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5693023125721586291', time=2024-09-12T19:32:50.462975+0000, chain.objs.size()=1 2024-09-12T17:41:32.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.244+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.1CsuKzQXCtOeRFjVUD4Uoj4boVmUmC9_0 2024-09-12T17:41:32.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.248+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6559356351001513303', time=2024-09-12T19:32:50.522620+0000, chain.objs.size()=1 2024-09-12T17:41:32.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.248+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.vkovO2QlVNxdk_jlPdl7zLqP1O-Jt2B_0 2024-09-12T17:41:32.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.248+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11538886231680544089', time=2024-09-12T19:32:50.548309+0000, chain.objs.size()=1 2024-09-12T17:41:32.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.248+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.RrU7MqWLyb51QHHuMpv6Aro4zD266R7_0 2024-09-12T17:41:32.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.248+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4914805814761998408', time=2024-09-12T19:32:50.579319+0000, chain.objs.size()=1 2024-09-12T17:41:32.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.248+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.M6cxGto7wNeRLqlahwqfN4-nG66JANG_0 2024-09-12T17:41:32.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.248+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4009849587672453261', time=2024-09-12T19:32:50.848544+0000, chain.objs.size()=1 2024-09-12T17:41:32.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.248+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.14-blA0CMOFCqSkxHREHyrHXycClWUK_0 2024-09-12T17:41:32.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.248+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11437027633025459608', time=2024-09-12T19:32:50.928357+0000, chain.objs.size()=1 2024-09-12T17:41:32.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.248+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.AW-3YhI23BOpo3h1uiEf9raGSw_iLTv_0 2024-09-12T17:41:32.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.248+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17952848544865808427', time=2024-09-12T19:32:50.940498+0000, chain.objs.size()=1 2024-09-12T17:41:32.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.248+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.BLqi8CDNwxwPge_Lqe5s0YLYPNTfSx6_0 2024-09-12T17:41:32.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.248+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5980676761232711427', time=2024-09-12T19:32:50.973015+0000, chain.objs.size()=1 2024-09-12T17:41:32.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.248+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.PmmrwCtV1_uJHTMn47pkSI5YXFyPKEZ_0 2024-09-12T17:41:32.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.248+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4541119845032685045', time=2024-09-12T19:32:51.019220+0000, chain.objs.size()=1 2024-09-12T17:41:32.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.248+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.XwVgq92PJOwuPg8U0canUPLAD_FwKsf_0 2024-09-12T17:41:32.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.248+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11736319973662392952', time=2024-09-12T19:32:51.154900+0000, chain.objs.size()=1 2024-09-12T17:41:32.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.248+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.eMdtngSz81XvDBrz1i83DTUeNmj8d26_0 2024-09-12T17:41:32.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.248+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2129728969899179741', time=2024-09-12T19:32:51.206104+0000, chain.objs.size()=1 2024-09-12T17:41:32.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.248+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.HhOQtOYmch5d9Tvbzn9c_0zaEDFSpR5_0 2024-09-12T17:41:32.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.248+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7620709843436515709', time=2024-09-12T19:32:51.349044+0000, chain.objs.size()=1 2024-09-12T17:41:32.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.248+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Rd0ClHRffXA3hIdGoP4ThIiRvog4Ezx_0 2024-09-12T17:41:32.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.248+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.204618144617784635', time=2024-09-12T19:32:51.361324+0000, chain.objs.size()=1 2024-09-12T17:41:32.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.248+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.EkSSwgtw1LFYssUe3h5rh6ttMkyAJSH_0 2024-09-12T17:41:32.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.248+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11198040852500754069', time=2024-09-12T19:32:51.500826+0000, chain.objs.size()=1 2024-09-12T17:41:32.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.248+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.pXRorNK3iZWxPC0mn-SkvzlzqZ6r0nt_0 2024-09-12T17:41:32.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.248+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9924849726949630142', time=2024-09-12T19:32:51.580450+0000, chain.objs.size()=1 2024-09-12T17:41:32.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.248+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.YY854CaBVU2Oz8dUagPNlhDwr4dyeMB_0 2024-09-12T17:41:32.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.248+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.534358143966801250', time=2024-09-12T19:32:51.666615+0000, chain.objs.size()=1 2024-09-12T17:41:32.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.248+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.MpoMDmsrFHarQ6BslVxWkdOGvP6Nl8T_0 2024-09-12T17:41:32.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.252+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1541250988402871561', time=2024-09-12T19:32:51.709463+0000, chain.objs.size()=1 2024-09-12T17:41:32.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.252+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.jRaw2G0dCpc776omvsQvcYKrmriSwTI_0 2024-09-12T17:41:32.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.252+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1168244062611864929', time=2024-09-12T19:32:51.721463+0000, chain.objs.size()=1 2024-09-12T17:41:32.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.252+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.2uLT1mjnxJxc49LYQGHKyummm8ClIuL_0 2024-09-12T17:41:32.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.252+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7095068736671549466', time=2024-09-12T19:32:51.972584+0000, chain.objs.size()=1 2024-09-12T17:41:32.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.252+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.iswD5-eQL491cYe8EILIcV1o0etOXH0_0 2024-09-12T17:41:32.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.252+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2192187324053158639', time=2024-09-12T19:32:52.530112+0000, chain.objs.size()=1 2024-09-12T17:41:32.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.252+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.326__shadow_.GKKOjcPUvJ1cHB16c-EbwX271gpPrz1_0 2024-09-12T17:41:32.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.252+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12411249528710341730', time=2024-09-12T19:32:52.873540+0000, chain.objs.size()=1 2024-09-12T17:41:32.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.252+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.327__shadow_.9ztBStIVfRxMw2sahofU4uDCku9dxys_0 2024-09-12T17:41:32.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.252+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13145280858196504227', time=2024-09-12T19:33:22.037854+0000, chain.objs.size()=1 2024-09-12T17:41:32.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.252+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.409__shadow_.DP12trZUfCQu6mz7GLFyE3lyWRDb4Rg_0 2024-09-12T17:41:32.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.252+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10870085200540750531', time=2024-09-12T19:33:43.960906+0000, chain.objs.size()=1 2024-09-12T17:41:32.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.252+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.465__shadow_.1SnGU1wrmzggeb17z62gTqq5TddessC_0 2024-09-12T17:41:32.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.252+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.997617714816492858', time=2024-09-12T19:33:44.216148+0000, chain.objs.size()=1 2024-09-12T17:41:32.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.252+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.465__shadow_.5M3iFycAWbLwck6YnTy5VCcC7IUAHhN_0 2024-09-12T17:41:32.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.252+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13370126620969888385', time=2024-09-12T19:34:00.545283+0000, chain.objs.size()=6 2024-09-12T17:41:32.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.252+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.507__multipart_srcmultipart.2~PH2AaCAKTBRXF-9QaLILt69t4ifQcL6.1 2024-09-12T17:41:32.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.252+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.507__multipart_srcmultipart.2~PH2AaCAKTBRXF-9QaLILt69t4ifQcL6.2 2024-09-12T17:41:32.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.252+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.507__multipart_srcmultipart.2~PH2AaCAKTBRXF-9QaLILt69t4ifQcL6.3 2024-09-12T17:41:32.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.252+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.507__multipart_srcmultipart.2~PH2AaCAKTBRXF-9QaLILt69t4ifQcL6.4 2024-09-12T17:41:32.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.256+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.507__multipart_srcmultipart.2~PH2AaCAKTBRXF-9QaLILt69t4ifQcL6.5 2024-09-12T17:41:32.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.256+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.507__multipart_srcmultipart.2~PH2AaCAKTBRXF-9QaLILt69t4ifQcL6.6 2024-09-12T17:41:32.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.256+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3648566775247771100', time=2024-09-12T19:34:05.099855+0000, chain.objs.size()=1 2024-09-12T17:41:32.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.256+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.518__multipart_mymultipart.2~TZfRNY4YjMWaEiy430oiq5n6GFCIYQP.1 2024-09-12T17:41:32.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.256+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4207112397208228330', time=2024-09-12T19:35:02.863501+0000, chain.objs.size()=1 2024-09-12T17:41:32.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.256+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.554__shadow_.1ADOabCGBV_OKh4nHOmpt7v5QE-5hlV_0 2024-09-12T17:41:32.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.256+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4753314753504221689', time=2024-09-12T19:35:14.570740+0000, chain.objs.size()=1 2024-09-12T17:41:32.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.256+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.566__shadow_.HojUHU06SIRJPZnm6JDh2f9JZeHso3e_0 2024-09-12T17:41:32.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.256+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6259692926581285659', time=2024-09-12T19:35:17.535704+0000, chain.objs.size()=1 2024-09-12T17:41:32.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.256+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.569__shadow:2fG5ZyB6sxRIzqSysF9WUznbDl8C6dr_.7qqmQh4EoyLrfWYEm7bUvNbeP0yEkIO_0 2024-09-12T17:41:32.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.256+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17792283861615978195', time=2024-09-12T19:35:30.741393+0000, chain.objs.size()=1 2024-09-12T17:41:32.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.256+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.576__shadow:AALGFLzhRyHrN4lnyHPaZRLQo.Ihjo9_.jxqseczwny94CXrbrPrbR3RhkZ7SZYj_0 2024-09-12T17:41:32.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.256+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11261190624490616271', time=2024-09-12T19:35:42.001969+0000, chain.objs.size()=1 2024-09-12T17:41:32.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.256+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.577__shadow:VhnFk6kWKatFyq5vHu96zQruPP4giNL_.Myf8j02mUCCStPllf4fAuDsPV5KHCDH_0 2024-09-12T17:41:32.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.256+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16996615253299104044', time=2024-09-12T19:35:45.093438+0000, chain.objs.size()=1 2024-09-12T17:41:32.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.256+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.577__shadow:LpM6zpgIz1O0M8-ePi8DvzNxnZDmCH5_.t62mVfANTX2iui5O2yza58taRhDRf2y_0 2024-09-12T17:41:32.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.256+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/52555 2024-09-12T17:41:32.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.260+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:41:32.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.260+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7694138422332741198', time=2024-09-12T19:38:16.821688+0000, chain.objs.size()=1 2024-09-12T17:41:32.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.260+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.618__shadow_.7msm8bdlHCrpOgXJrvEm6mrrPSRjs20_0 2024-09-12T17:41:32.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.260+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14632069768365158802', time=2024-09-12T19:38:35.143009+0000, chain.objs.size()=1 2024-09-12T17:41:32.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.260+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.653__shadow_.nR9i5bizHzGr99dsBUrqbYskKQklaEl_0 2024-09-12T17:41:32.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.260+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5798441603665337361', time=2024-09-12T19:39:29.979294+0000, chain.objs.size()=1 2024-09-12T17:41:32.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.260+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.739__shadow_.763pkBHfuUXfDxjn9-ZqipobewR1Tdt_0 2024-09-12T17:41:32.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.260+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:41:32.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.264+0000 7fd765adf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:41:32.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.264+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:41:32.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.264+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:41:32.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.268+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/53167' 2024-09-12T17:41:32.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.268+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5847270229860881448', time=2024-09-12T19:29:36.591868+0000, chain.objs.size()=1 2024-09-12T17:41:32.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.268+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.147__shadow_.eIgpc160WlgwmLNjgNBvIbbxdJm9cwu_0 2024-09-12T17:41:32.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.268+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3142113149088961124', time=2024-09-12T19:29:49.940892+0000, chain.objs.size()=3 2024-09-12T17:41:32.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.268+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.164__multipart_foo.2~RQYMJVQlRjvrHT7vIvw-T_d-KNBr-PW.1 2024-09-12T17:41:32.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.268+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.164__shadow_foo.2~RQYMJVQlRjvrHT7vIvw-T_d-KNBr-PW.1_1 2024-09-12T17:41:32.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.268+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.164__multipart_foo.2~RQYMJVQlRjvrHT7vIvw-T_d-KNBr-PW.2 2024-09-12T17:41:32.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.268+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4589999549526503737', time=2024-09-12T19:31:13.965431+0000, chain.objs.size()=1 2024-09-12T17:41:32.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.268+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.238__shadow_.KjUZDtIreI8RjhyPPWNU29cOseX-ADN_0 2024-09-12T17:41:32.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.268+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.211150123731062677', time=2024-09-12T19:31:22.128000+0000, chain.objs.size()=1 2024-09-12T17:41:32.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.268+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.259__shadow_.wR6BDg1NNPhGFlON8jy8BetvKd2yD-7_0 2024-09-12T17:41:32.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.268+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4459977377936298945', time=2024-09-12T19:31:42.256846+0000, chain.objs.size()=1 2024-09-12T17:41:32.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.268+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.lEpVOYI5L1tHQyH7l8rQut2wyFgCwK8_0 2024-09-12T17:41:32.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.268+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16283540240412305260', time=2024-09-12T19:31:42.329769+0000, chain.objs.size()=1 2024-09-12T17:41:32.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.268+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.UJwAumpoDJ-BPaRudu4aodUnREQbI9c_0 2024-09-12T17:41:32.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.268+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9127737618220642167', time=2024-09-12T19:31:42.440506+0000, chain.objs.size()=1 2024-09-12T17:41:32.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.268+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.-tx7393XDruiihA9QnsitPaBkSGLJ1__0 2024-09-12T17:41:32.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.268+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5577784834733327048', time=2024-09-12T19:31:42.445063+0000, chain.objs.size()=1 2024-09-12T17:41:32.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.268+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.cXqgrYQMCaDUY_TRsPLaiA1Jei6E4Yg_0 2024-09-12T17:41:32.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.268+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13928388777165550522', time=2024-09-12T19:31:42.470579+0000, chain.objs.size()=1 2024-09-12T17:41:32.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.268+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.m3aTtp4T4gPOOziH9EUJsmesdYJpbx0_0 2024-09-12T17:41:32.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.268+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8353920170614443170', time=2024-09-12T19:31:42.532517+0000, chain.objs.size()=1 2024-09-12T17:41:32.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.268+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.2-8X96CS9CPWkmJ4NnMzmT8Pc1YDSZu_0 2024-09-12T17:41:32.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.268+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9547439491067007559', time=2024-09-12T19:31:42.551436+0000, chain.objs.size()=1 2024-09-12T17:41:32.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.268+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Fe-c27O2EOCAkEY6wVxG5Idt3oNB4OJ_0 2024-09-12T17:41:32.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.268+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14278218628221105804', time=2024-09-12T19:31:42.593311+0000, chain.objs.size()=1 2024-09-12T17:41:32.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.268+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.7QtCSyBi4TKOMwhzPZQ_YYL74Z8vuDl_0 2024-09-12T17:41:32.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.268+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15041736880551623926', time=2024-09-12T19:31:42.626412+0000, chain.objs.size()=1 2024-09-12T17:41:32.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.268+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.kflR38NEc0PslT3irDGgZiX5DhdTzzy_0 2024-09-12T17:41:32.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.272+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10261098959087109817', time=2024-09-12T19:31:42.661585+0000, chain.objs.size()=1 2024-09-12T17:41:32.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.272+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.n1tC6wYVnpwj4pnDCBirzZvqWa693Sc_0 2024-09-12T17:41:32.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.272+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17101421882593739560', time=2024-09-12T19:31:42.682861+0000, chain.objs.size()=1 2024-09-12T17:41:32.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.272+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.DPxjDyRFUwvR-sewTl9HXTgvALS8vom_0 2024-09-12T17:41:32.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.272+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5245825516073543112', time=2024-09-12T19:31:42.713395+0000, chain.objs.size()=1 2024-09-12T17:41:32.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.272+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Rigi4h12yKYnJNDxVpocUdvbymi41Dp_0 2024-09-12T17:41:32.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.272+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12299206035491187299', time=2024-09-12T19:31:42.810837+0000, chain.objs.size()=1 2024-09-12T17:41:32.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.272+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.zmZkZPkhDqbxvJhyrmceDOrklYEjVHp_0 2024-09-12T17:41:32.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.272+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17333048738827967472', time=2024-09-12T19:31:42.847918+0000, chain.objs.size()=1 2024-09-12T17:41:32.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.272+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.61ROJz0sw1CzzEAFqLg2tt7_7i2-kXy_0 2024-09-12T17:41:32.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.272+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6622168396332617654', time=2024-09-12T19:31:42.852899+0000, chain.objs.size()=1 2024-09-12T17:41:32.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.272+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.6HV1n79ULjT6CtSimhxBytaYmklME6w_0 2024-09-12T17:41:32.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.272+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3621067565937827199', time=2024-09-12T19:31:42.874543+0000, chain.objs.size()=1 2024-09-12T17:41:32.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.272+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.elr76iptviA6fv47hyIXv1cz_3YBGoN_0 2024-09-12T17:41:32.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.272+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6582988118155412408', time=2024-09-12T19:31:42.888390+0000, chain.objs.size()=1 2024-09-12T17:41:32.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.272+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.9jyOOfq1kbYpcrUEB5rVEYVHUMIDlCm_0 2024-09-12T17:41:32.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.272+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2617904500288745766', time=2024-09-12T19:31:42.907013+0000, chain.objs.size()=1 2024-09-12T17:41:32.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.272+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.YrabIpD1UtZWNZHMB8pvu37PtMnnsW3_0 2024-09-12T17:41:32.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.272+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6453653432327744671', time=2024-09-12T19:31:43.075576+0000, chain.objs.size()=1 2024-09-12T17:41:32.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.272+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.VFb1zI_NFqFG2Ju17wPaJ4_6et3rwkw_0 2024-09-12T17:41:32.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.272+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12779562364258377593', time=2024-09-12T19:31:43.246375+0000, chain.objs.size()=1 2024-09-12T17:41:32.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.272+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Lq3Pwyim3__uKGMXZH1dG0VZKJ2SsaM_0 2024-09-12T17:41:32.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.272+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9536129787305599857', time=2024-09-12T19:31:43.247093+0000, chain.objs.size()=1 2024-09-12T17:41:32.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.272+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.QKZlrSB_uwf-H-GKVjezCB8C67apcZj_0 2024-09-12T17:41:32.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.272+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1154102245990391838', time=2024-09-12T19:31:43.249434+0000, chain.objs.size()=1 2024-09-12T17:41:32.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.272+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.o1agdbjpys0gdhb7dT6A8JvhCaE_shT_0 2024-09-12T17:41:32.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.272+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10679510012361085132', time=2024-09-12T19:31:43.254808+0000, chain.objs.size()=1 2024-09-12T17:41:32.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.272+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.GlN2Nnr6wDlvWdMRUFcPWA_LB2XAu9n_0 2024-09-12T17:41:32.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.272+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1060830245359610338', time=2024-09-12T19:31:43.265047+0000, chain.objs.size()=1 2024-09-12T17:41:32.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.272+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.iNIFInpeYO1fOKX_IEKwx_2c2QwJ6xy_0 2024-09-12T17:41:32.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.272+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15163014492574204869', time=2024-09-12T19:31:43.268550+0000, chain.objs.size()=1 2024-09-12T17:41:32.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.272+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.QldzPVyrMwL4PnY9EekncXhCqQMAnwx_0 2024-09-12T17:41:32.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.276+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17712322008663701505', time=2024-09-12T19:31:43.437442+0000, chain.objs.size()=1 2024-09-12T17:41:32.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.276+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.AX8dg7mkMT_2nwqe1aubPhJ0dcfrLsB_0 2024-09-12T17:41:32.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.276+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4990285638846053979', time=2024-09-12T19:31:43.456164+0000, chain.objs.size()=1 2024-09-12T17:41:32.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.276+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.KPuxLw_Cu_UnB7NcgP4QAggBb2SymD8_0 2024-09-12T17:41:32.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.276+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10413494181243145953', time=2024-09-12T19:31:43.501176+0000, chain.objs.size()=1 2024-09-12T17:41:32.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.276+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_._9ZptqK-62LMKsF0ZFE1-NbdPyHPHkU_0 2024-09-12T17:41:32.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.276+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17166802673476853833', time=2024-09-12T19:31:43.514418+0000, chain.objs.size()=1 2024-09-12T17:41:32.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.276+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.oUokEytUs4VsOO4dPVJ_fbpOkiLJzKC_0 2024-09-12T17:41:32.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.276+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7689157559174260909', time=2024-09-12T19:31:43.526566+0000, chain.objs.size()=1 2024-09-12T17:41:32.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.276+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.bZIX8CL9bhdXkjNEPqyb_vGyemn_CSB_0 2024-09-12T17:41:32.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.276+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1518171377975479616', time=2024-09-12T19:31:43.591087+0000, chain.objs.size()=1 2024-09-12T17:41:32.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.276+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.G9Fa7FIZK67t-W3NGePK0Eq7Xm9jMka_0 2024-09-12T17:41:32.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.276+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10621898190917250467', time=2024-09-12T19:31:43.625665+0000, chain.objs.size()=1 2024-09-12T17:41:32.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.276+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.C8JQwuzOr1SggUYfFvUWg4AXAIoMjxP_0 2024-09-12T17:41:32.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.276+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13676075869411452593', time=2024-09-12T19:31:43.829929+0000, chain.objs.size()=1 2024-09-12T17:41:32.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.276+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.aYKNDQNj_KwI_q12sdHVT7YW9EBcYTb_0 2024-09-12T17:41:32.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.276+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11200836732733193248', time=2024-09-12T19:31:43.898449+0000, chain.objs.size()=1 2024-09-12T17:41:32.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.276+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.atIga7K2YNnuEy4tZw8vO73o7MXK6u1_0 2024-09-12T17:41:32.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.276+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2174381433568539852', time=2024-09-12T19:31:43.928794+0000, chain.objs.size()=1 2024-09-12T17:41:32.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.276+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.XuW7-n0TkGhorjS3WzAXaxqJzwvxK7p_0 2024-09-12T17:41:32.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.276+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8367685251231429665', time=2024-09-12T19:31:44.059150+0000, chain.objs.size()=1 2024-09-12T17:41:32.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.276+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.HiQFULo9ao1wphXvOQdYxIEYKQsdhFf_0 2024-09-12T17:41:32.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.276+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15874650138987295467', time=2024-09-12T19:31:44.253951+0000, chain.objs.size()=1 2024-09-12T17:41:32.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.276+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.IdcwWud0aYjxPPaUjd9z5SZw-3hqbqB_0 2024-09-12T17:41:32.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.276+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14533921249475407830', time=2024-09-12T19:31:53.441108+0000, chain.objs.size()=1 2024-09-12T17:41:32.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.276+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.286__shadow_.G_eKqg9yVUYOhnd6sgi4Jr915Qoz2wf_0 2024-09-12T17:41:32.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.276+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2890884342513630686', time=2024-09-12T19:31:57.975364+0000, chain.objs.size()=1 2024-09-12T17:41:32.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.276+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.294__shadow_.eMle5hYTBu2_dnc9sPoz1dXDCilL0Ne_0 2024-09-12T17:41:32.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.276+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17255915285707489740', time=2024-09-12T19:32:01.887423+0000, chain.objs.size()=1 2024-09-12T17:41:32.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.276+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.304__shadow_.m2RWl1kqoA-8hnRuqntTKgMmyDMdq0v_0 2024-09-12T17:41:32.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.276+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11430319889590105328', time=2024-09-12T19:32:07.350779+0000, chain.objs.size()=1 2024-09-12T17:41:32.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.276+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.319__shadow:5CPhpDqCZ-o1yPx6QkSDtSfJcNfiT9t_.BkEQiHybpxIhRqiF_5nTl4DD_iRMgEL_0 2024-09-12T17:41:32.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.276+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3074031305150910793', time=2024-09-12T19:32:27.964717+0000, chain.objs.size()=1 2024-09-12T17:41:32.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.276+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.gmVUxXItAvRGUKy7xX_DdR0NncJCghF_0 2024-09-12T17:41:32.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.280+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6610493050554063554', time=2024-09-12T19:32:28.033596+0000, chain.objs.size()=1 2024-09-12T17:41:32.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.280+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.X0Hn7ZOJNX9FOZx8fbPhG9sdNikT0nm_0 2024-09-12T17:41:32.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.280+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15345590647443543511', time=2024-09-12T19:32:28.182010+0000, chain.objs.size()=1 2024-09-12T17:41:32.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.280+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.tX4zraWunJTUgmUDH79vJk8OOBzXjxC_0 2024-09-12T17:41:32.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.280+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4872022314294500480', time=2024-09-12T19:32:28.298606+0000, chain.objs.size()=1 2024-09-12T17:41:32.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.280+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.CCN74cE5c3l61gyjakWjjN-99HRizz5_0 2024-09-12T17:41:32.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.280+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1307390957184936766', time=2024-09-12T19:32:28.380341+0000, chain.objs.size()=1 2024-09-12T17:41:32.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.280+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.d9jcLrTNRHuE64WnLBVjNVYijIv_Cq7_0 2024-09-12T17:41:32.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.280+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8719151194834707910', time=2024-09-12T19:32:28.404377+0000, chain.objs.size()=1 2024-09-12T17:41:32.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.280+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.nmjR-_cfzxNugeFOYp-UTf4-hhSZmBv_0 2024-09-12T17:41:32.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.280+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1672341865741096286', time=2024-09-12T19:32:28.409031+0000, chain.objs.size()=1 2024-09-12T17:41:32.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.280+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.lOkjpfbxVMCNmq5WcYHN3wMkiTxOR6E_0 2024-09-12T17:41:32.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.280+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17079615374859966829', time=2024-09-12T19:32:28.442437+0000, chain.objs.size()=1 2024-09-12T17:41:32.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.280+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.tCTPtHfC2enU7uOUtUTy2D-DKIEJA3v_0 2024-09-12T17:41:32.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.280+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13366945266553602547', time=2024-09-12T19:32:28.486548+0000, chain.objs.size()=1 2024-09-12T17:41:32.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.280+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.DbwxVXRB0RKXUjvO1xr05OBdG2exisY_0 2024-09-12T17:41:32.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.280+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1513962238432339372', time=2024-09-12T19:32:28.498088+0000, chain.objs.size()=1 2024-09-12T17:41:32.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.280+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.a0XWCUsHGDb59aEoJaRsw35L9A_aHCp_0 2024-09-12T17:41:32.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.280+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11203046276621915319', time=2024-09-12T19:32:28.517817+0000, chain.objs.size()=1 2024-09-12T17:41:32.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.280+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.U_x9DPKEIb9RFNAwel4ESImTJxV3sk3_0 2024-09-12T17:41:32.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.280+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2342634505598134967', time=2024-09-12T19:32:28.558822+0000, chain.objs.size()=1 2024-09-12T17:41:32.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.280+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.ncf-0gfGmoHqAlvkaSCBeVb2-6LaDqk_0 2024-09-12T17:41:32.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.280+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14113014678267369440', time=2024-09-12T19:32:28.696419+0000, chain.objs.size()=1 2024-09-12T17:41:32.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.280+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.bBYQHPcKwY6qxB6Bac1Pd5yTK12Sfov_0 2024-09-12T17:41:32.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.280+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5945897512501641046', time=2024-09-12T19:32:28.781639+0000, chain.objs.size()=1 2024-09-12T17:41:32.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.280+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.MEn6PIvFWtfj69eDWRn1FTJ1Hv4U7Za_0 2024-09-12T17:41:32.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.280+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7749688883861628957', time=2024-09-12T19:32:28.834976+0000, chain.objs.size()=1 2024-09-12T17:41:32.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.280+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.eq7KP6zQ8s3I3JYfo-TNcC9qzH6zE4L_0 2024-09-12T17:41:32.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.280+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16888899211865563792', time=2024-09-12T19:32:29.031390+0000, chain.objs.size()=1 2024-09-12T17:41:32.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.280+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.TH0V0RqNvjL4O_SAqaEiV5I9C5-BiKu_0 2024-09-12T17:41:32.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.280+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12962244335065037357', time=2024-09-12T19:32:29.033947+0000, chain.objs.size()=1 2024-09-12T17:41:32.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.280+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.yFIBdrCDSH0G3yyYGCRrv3eUJzB3qe6_0 2024-09-12T17:41:32.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.280+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13718427928447907397', time=2024-09-12T19:32:29.048857+0000, chain.objs.size()=1 2024-09-12T17:41:32.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.280+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.kt4lMLPoGe-_iRuM5SytTNdIVEKlg2J_0 2024-09-12T17:41:32.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.280+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12426285369097953216', time=2024-09-12T19:32:29.072450+0000, chain.objs.size()=1 2024-09-12T17:41:32.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.280+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.DNBzONDYXz4CXjcNx0Ut2DFEG4K418n_0 2024-09-12T17:41:32.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.280+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5444781848761655723', time=2024-09-12T19:32:29.127066+0000, chain.objs.size()=1 2024-09-12T17:41:32.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.280+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.qiZIsLOBDHnOdvHm490rNTWLE8OxKRO_0 2024-09-12T17:41:32.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.280+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15118853812951116729', time=2024-09-12T19:32:29.130437+0000, chain.objs.size()=1 2024-09-12T17:41:32.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.280+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.mci0nYdUjvsJ_QQV9KnUL0pnioXFdWQ_0 2024-09-12T17:41:32.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.280+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14105469577160330076', time=2024-09-12T19:32:29.134649+0000, chain.objs.size()=1 2024-09-12T17:41:32.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.280+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.CcJmRsLUTb4VikD8WWcOmyP3FLotTjk_0 2024-09-12T17:41:32.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.284+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.512968397350974935', time=2024-09-12T19:32:29.192470+0000, chain.objs.size()=1 2024-09-12T17:41:32.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.284+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Ktdco3FncBA8oTo6It-x_N1bRTEEA7Z_0 2024-09-12T17:41:32.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.284+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9008589078949808479', time=2024-09-12T19:32:29.229727+0000, chain.objs.size()=1 2024-09-12T17:41:32.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.284+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.lki7v8I_MheL5cqc2ij4YEsoYj76DUG_0 2024-09-12T17:41:32.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.284+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10477944464474925814', time=2024-09-12T19:32:29.342946+0000, chain.objs.size()=1 2024-09-12T17:41:32.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.284+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.YyBYzM6MAefgxVQnTP9Tf7JBbX6lc8I_0 2024-09-12T17:41:32.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.284+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9102740908368734044', time=2024-09-12T19:32:29.447825+0000, chain.objs.size()=1 2024-09-12T17:41:32.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.284+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.JppTcfgnOIeq5onSwbXso4uWLGj53mY_0 2024-09-12T17:41:32.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.284+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14158043895121236577', time=2024-09-12T19:32:29.696087+0000, chain.objs.size()=1 2024-09-12T17:41:32.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.284+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.KHbQP_xYbgEJQeZmoxwrxWMzUjBpyG8_0 2024-09-12T17:41:32.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.284+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14639289224650988893', time=2024-09-12T19:32:29.726342+0000, chain.objs.size()=1 2024-09-12T17:41:32.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.284+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.UMiRQUI8QslSPQC2durseO3-NnkQY7O_0 2024-09-12T17:41:32.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.284+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17376918668364707136', time=2024-09-12T19:32:29.764121+0000, chain.objs.size()=1 2024-09-12T17:41:32.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.284+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.4IW5NcgvIwh9Ya4ydJDv2YuqPtYbnjL_0 2024-09-12T17:41:32.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.284+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15328630380359853405', time=2024-09-12T19:32:29.879528+0000, chain.objs.size()=1 2024-09-12T17:41:32.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.284+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.MaMX36N6XysRKrTX4a4VGia6ZK_v_Uc_0 2024-09-12T17:41:32.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.284+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8225725970737436891', time=2024-09-12T19:32:29.992968+0000, chain.objs.size()=1 2024-09-12T17:41:32.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.284+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.yZqApAz4YlAl6NocCNXm_egH0Qka4Nd_0 2024-09-12T17:41:32.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.284+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10226455035097102037', time=2024-09-12T19:32:30.049063+0000, chain.objs.size()=1 2024-09-12T17:41:32.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.284+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.5fmRtCoWgNfmPRjSVBNSvXIrg4366xs_0 2024-09-12T17:41:32.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.284+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6215959670415876274', time=2024-09-12T19:32:30.121146+0000, chain.objs.size()=1 2024-09-12T17:41:32.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.284+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.achZloDgPwqH_k59a_TuUQLzwzWzXRd_0 2024-09-12T17:41:32.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.284+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6883638297558839440', time=2024-09-12T19:32:30.159325+0000, chain.objs.size()=1 2024-09-12T17:41:32.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.284+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.9VvGOiju0T4v18C6PsYpgHzC89v1h21_0 2024-09-12T17:41:32.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.284+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14778049277082442316', time=2024-09-12T19:32:49.611185+0000, chain.objs.size()=1 2024-09-12T17:41:32.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.284+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.ERtrHBUvBJyhNdJuCybZAjgRR-F2xQX_0 2024-09-12T17:41:32.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.284+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10433044675325877340', time=2024-09-12T19:32:49.761358+0000, chain.objs.size()=1 2024-09-12T17:41:32.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.284+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.910-1BKjQXxRhGIJ0mv-NMkmTE-QEsQ_0 2024-09-12T17:41:32.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.284+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16034045418045364143', time=2024-09-12T19:32:49.771620+0000, chain.objs.size()=1 2024-09-12T17:41:32.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.284+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.V7Kgo23eGipZ6cPSXcvLGDVIvNBtPJa_0 2024-09-12T17:41:32.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.288+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9424100416049441160', time=2024-09-12T19:32:49.822124+0000, chain.objs.size()=1 2024-09-12T17:41:32.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.288+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.pBqjBry9BgsbL-gzx1U4QveE_bFsQzK_0 2024-09-12T17:41:32.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.288+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13963200017210869244', time=2024-09-12T19:32:49.853880+0000, chain.objs.size()=1 2024-09-12T17:41:32.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.288+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.gtAzYpJ15atE_Uhd93xs-UyKZqb-w_c_0 2024-09-12T17:41:32.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.288+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2378366666852765909', time=2024-09-12T19:32:49.939333+0000, chain.objs.size()=1 2024-09-12T17:41:32.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.288+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.1vVOe19EiXJUaAuibGnlshO-SaUiOs1_0 2024-09-12T17:41:32.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.288+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17574998784360420822', time=2024-09-12T19:32:50.566788+0000, chain.objs.size()=1 2024-09-12T17:41:32.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.288+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.LqMjXfXaGORi5VAbm-bBtVD-kerlflZ_0 2024-09-12T17:41:32.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.288+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16437380670243281742', time=2024-09-12T19:32:50.569852+0000, chain.objs.size()=1 2024-09-12T17:41:32.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.288+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Ptn8ciOOq9_UM8qmUywND8s3NSx5_Je_0 2024-09-12T17:41:32.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.288+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2890278768860855604', time=2024-09-12T19:32:50.570691+0000, chain.objs.size()=1 2024-09-12T17:41:32.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.288+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.VzVsW5sHoKaxRkDXEBw1e0IcnOk2Ius_0 2024-09-12T17:41:32.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.288+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8444513392064987128', time=2024-09-12T19:32:50.582139+0000, chain.objs.size()=1 2024-09-12T17:41:32.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.288+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.BMTxYY_cPZxlkaPQElocceIoHjbyEIt_0 2024-09-12T17:41:32.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.288+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13479841285240141601', time=2024-09-12T19:32:50.688138+0000, chain.objs.size()=1 2024-09-12T17:41:32.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.288+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.7bePWOd_l7vrtfNtWoh8Oin79Mx0t2S_0 2024-09-12T17:41:32.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.288+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6301098459760510318', time=2024-09-12T19:32:50.865714+0000, chain.objs.size()=1 2024-09-12T17:41:32.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.288+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.OkT8v0EsONThOEMpS4GtSJ6lluXbn0d_0 2024-09-12T17:41:32.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.288+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4455607553819246623', time=2024-09-12T19:32:50.882664+0000, chain.objs.size()=1 2024-09-12T17:41:32.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.288+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.VQ6gJu5M_RQWuF4RU_N1aPVj4lzJ7CO_0 2024-09-12T17:41:32.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.288+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5050583770754214857', time=2024-09-12T19:32:50.954884+0000, chain.objs.size()=1 2024-09-12T17:41:32.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.288+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.dnG25VWMYjTyblDePoVG04GI7y6lZXz_0 2024-09-12T17:41:32.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.288+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1019775188549316185', time=2024-09-12T19:32:50.989079+0000, chain.objs.size()=1 2024-09-12T17:41:32.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.288+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.dQhLG2BMDz84rJ15h9gxNqXpxUj1Qsc_0 2024-09-12T17:41:32.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.288+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3119872380256067286', time=2024-09-12T19:32:51.010477+0000, chain.objs.size()=1 2024-09-12T17:41:32.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.288+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.a4rpq8Q24GFS70-vkQ2CKAaRWuOuIGs_0 2024-09-12T17:41:32.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.288+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5074133857728384107', time=2024-09-12T19:32:51.027210+0000, chain.objs.size()=1 2024-09-12T17:41:32.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.288+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_._eB3UKbCh1TJLb_TY2RZbVa6nWoHnUW_0 2024-09-12T17:41:32.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.288+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7184523943944470175', time=2024-09-12T19:32:51.215131+0000, chain.objs.size()=1 2024-09-12T17:41:32.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.288+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.61SUe39hvvbfdcWKVcjLbMhNokHZboL_0 2024-09-12T17:41:32.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.288+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6769137028726100215', time=2024-09-12T19:32:51.235426+0000, chain.objs.size()=1 2024-09-12T17:41:32.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.288+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.bi2P8TrfneU6s-ZK51fGURBauIGcFTM_0 2024-09-12T17:41:32.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.288+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10139126220495363239', time=2024-09-12T19:32:51.267996+0000, chain.objs.size()=1 2024-09-12T17:41:32.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.288+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.95JN3mAYBJZGE45AdNNNlPIN1vEiPMi_0 2024-09-12T17:41:32.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.288+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16421168583727448636', time=2024-09-12T19:32:51.337367+0000, chain.objs.size()=1 2024-09-12T17:41:32.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.288+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Z_ucSux7cz_QY-u2b2ss-RYs5lXf30O_0 2024-09-12T17:41:32.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.292+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/53167 2024-09-12T17:41:32.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.292+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-12T17:41:32.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.292+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10933543050798116466', time=2024-09-12T19:32:51.653692+0000, chain.objs.size()=1 2024-09-12T17:41:32.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.292+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.H3Tr2qdr8dzhkadzKbLitZNfYipaq6I_0 2024-09-12T17:41:32.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.292+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.326584125025622428', time=2024-09-12T19:32:51.715020+0000, chain.objs.size()=1 2024-09-12T17:41:32.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.292+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.wVLu7tKPQ6mCuetGDxkZOQBJXJInSVP_0 2024-09-12T17:41:32.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.292+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8111305252499189243', time=2024-09-12T19:32:51.836387+0000, chain.objs.size()=1 2024-09-12T17:41:32.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.292+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.e43lmQb-wUrhlVvrMbeHWGUSYpSS_Au_0 2024-09-12T17:41:32.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.292+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5742786676976913417', time=2024-09-12T19:32:51.841367+0000, chain.objs.size()=1 2024-09-12T17:41:32.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.292+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.6FEKh0KSjvSUB2iqc30Ec591mXe9BsJ_0 2024-09-12T17:41:32.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.292+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11131565822089250499', time=2024-09-12T19:32:51.902638+0000, chain.objs.size()=1 2024-09-12T17:41:32.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.292+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.i-axkxC37tIjnR7FWrqx_kR-d-Wf6DW_0 2024-09-12T17:41:32.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.292+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18208152106848414922', time=2024-09-12T19:32:51.921160+0000, chain.objs.size()=1 2024-09-12T17:41:32.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.292+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.vBYviuE-whXT2KQCuh8EnudnUFOJ2kM_0 2024-09-12T17:41:32.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.292+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13773175248429827721', time=2024-09-12T19:32:51.940513+0000, chain.objs.size()=1 2024-09-12T17:41:32.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.292+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.XrLhZtkrnplHaiFGpk4XJtMO5VvXMvc_0 2024-09-12T17:41:32.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.292+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16922686072719729760', time=2024-09-12T19:32:52.008775+0000, chain.objs.size()=1 2024-09-12T17:41:32.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.292+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.4MCGhSQmdUeeDLXOfUel0u3BHe5yXQd_0 2024-09-12T17:41:32.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.292+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11689718795066847597', time=2024-09-12T19:32:52.010945+0000, chain.objs.size()=1 2024-09-12T17:41:32.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.292+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.auhX9OvWUVq06H6mQZUXKrgFFJoFl82_0 2024-09-12T17:41:32.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.292+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15419498728830950264', time=2024-09-12T19:33:10.810109+0000, chain.objs.size()=1 2024-09-12T17:41:32.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.292+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.381__shadow_.znEgM4AknogcmckN9ARjlqUJmcOPTDD_0 2024-09-12T17:41:32.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.292+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11968119662880595563', time=2024-09-12T19:33:21.418282+0000, chain.objs.size()=1 2024-09-12T17:41:32.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.292+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.407__shadow_.m8Tk6WbWI8DUDWlKB6mg8Ulnx7cSkvz_0 2024-09-12T17:41:32.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.292+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10960197036142215944', time=2024-09-12T19:33:40.809635+0000, chain.objs.size()=1 2024-09-12T17:41:32.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.292+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.459__shadow_.ZMsScsKvtllaP4QKRE-MqrY6wxkmDHd_0 2024-09-12T17:41:32.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.296+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15884666871380859187', time=2024-09-12T19:33:49.244893+0000, chain.objs.size()=1 2024-09-12T17:41:32.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.296+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.483__shadow_.oTos5beAHwTnUS12--HHlhITG2r3aC1_0 2024-09-12T17:41:32.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.296+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10934917038768033520', time=2024-09-12T19:33:53.044114+0000, chain.objs.size()=1 2024-09-12T17:41:32.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.296+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.491__shadow_.sBGcmJwmq5VbYXBnh0dacjksL9aFKIA_0 2024-09-12T17:41:32.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.296+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8276792928065275514', time=2024-09-12T19:33:53.923746+0000, chain.objs.size()=1 2024-09-12T17:41:32.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.296+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.495__shadow_.C4H4py8t846rNX7NG7m89gYCrp1a-_a_0 2024-09-12T17:41:32.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.296+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6260683701685333063', time=2024-09-12T19:34:03.181998+0000, chain.objs.size()=1 2024-09-12T17:41:32.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.296+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.515__shadow_._76JfW_STUzO8MDfpfvE5kJ2eOmHoYk_0 2024-09-12T17:41:32.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.296+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14728911174596599593', time=2024-09-12T19:34:10.911317+0000, chain.objs.size()=3 2024-09-12T17:41:32.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.296+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.521__multipart_mymultipart.2~nC-woEiwQcPBJJxoryYKXTYuKsSKkOA.1 2024-09-12T17:41:32.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.296+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.521__multipart_mymultipart.2~nC-woEiwQcPBJJxoryYKXTYuKsSKkOA.2 2024-09-12T17:41:32.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.296+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.521__multipart_mymultipart.2~nC-woEiwQcPBJJxoryYKXTYuKsSKkOA.3 2024-09-12T17:41:32.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.296+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~M_SXawQyEWAILrgeQxMqN-zQ4C1EFSr', time=2024-09-12T19:34:15.312113+0000, chain.objs.size()=2 2024-09-12T17:41:32.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.296+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__multipart_mymultipart.2~M_SXawQyEWAILrgeQxMqN-zQ4C1EFSr.3 2024-09-12T17:41:32.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.296+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__shadow_mymultipart.2~M_SXawQyEWAILrgeQxMqN-zQ4C1EFSr.3_1 2024-09-12T17:41:32.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.300+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17354256600745409693', time=2024-09-12T19:35:18.035937+0000, chain.objs.size()=1 2024-09-12T17:41:32.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.300+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.569__shadow:-KvzT3Jtbye861tM.BB2rLDmBwQjOF0_.7aJRAhDjrGsP3IzmzTcTkfCUHExZgZ6_0 2024-09-12T17:41:32.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.300+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5664104560347155258', time=2024-09-12T19:35:20.829083+0000, chain.objs.size()=1 2024-09-12T17:41:32.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.300+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.569__shadow:Gtrka79WdItK7UIXN4tXwFTxJQHPQhC_.qVXckoMLe3StReOGGXEVaeC7-SdyjPt_0 2024-09-12T17:41:32.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.300+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3066365901068477563', time=2024-09-12T19:35:27.004917+0000, chain.objs.size()=1 2024-09-12T17:41:32.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.300+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.574__shadow:uteB4daTVuWDQXGR5iMQb3BqLVostgY_.glFoLdDmBEqLR2-j3BYk3zZWSMWEnxe_0 2024-09-12T17:41:32.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.300+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~qdzrCiiJOhOF-8YN3LOCwzBrPyhgmn0', time=2024-09-12T19:39:31.650459+0000, chain.objs.size()=1 2024-09-12T17:41:32.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.300+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.742__multipart_mymultipart.2~qdzrCiiJOhOF-8YN3LOCwzBrPyhgmn0.1 2024-09-12T17:41:32.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.300+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16976085662219771861', time=2024-09-12T19:39:32.484578+0000, chain.objs.size()=3 2024-09-12T17:41:32.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.300+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.743__multipart_mymultipart3.2~lQnvJTVEY9gegQab2lS9RNes46dPGiD.1 2024-09-12T17:41:32.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.300+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.743__multipart_mymultipart3.2~lQnvJTVEY9gegQab2lS9RNes46dPGiD.2 2024-09-12T17:41:32.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.300+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.743__multipart_mymultipart3.2~lQnvJTVEY9gegQab2lS9RNes46dPGiD.3 2024-09-12T17:41:32.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.304+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:41:32.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.304+0000 7fd765adf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:41:32.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.308+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:41:32.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.308+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:41:32.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.308+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46832' 2024-09-12T17:41:32.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.308+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7619335687961563321', time=2024-09-12T19:31:12.597113+0000, chain.objs.size()=1 2024-09-12T17:41:32.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.308+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.235__shadow_.R8pFBjAIiyGB7onUjfkE6Yq4159PWdJ_0 2024-09-12T17:41:32.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.308+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2102708397637734545', time=2024-09-12T19:31:13.465265+0000, chain.objs.size()=1 2024-09-12T17:41:32.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.308+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.237__shadow_.m1ceBWeTqUPHfFVk8znJDNznt6CX5jG_0 2024-09-12T17:41:32.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.308+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2075025046606430447', time=2024-09-12T19:31:16.402631+0000, chain.objs.size()=1 2024-09-12T17:41:32.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.308+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.244__shadow_.NEQ79y620DPYkyuYFKgavuC_ONLpMjp_0 2024-09-12T17:41:32.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.308+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8270959803581949515', time=2024-09-12T19:31:42.532745+0000, chain.objs.size()=1 2024-09-12T17:41:32.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.308+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.LHjhAz-ZJwfY3q__DyyYXLAF5gBxcXC_0 2024-09-12T17:41:32.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.308+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10408697910781104185', time=2024-09-12T19:31:42.579619+0000, chain.objs.size()=1 2024-09-12T17:41:32.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.308+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.AiZxxzGQqQgo3fSsh_H29PbGIBWB190_0 2024-09-12T17:41:32.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.308+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2184901413365793657', time=2024-09-12T19:31:42.618385+0000, chain.objs.size()=1 2024-09-12T17:41:32.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.308+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Q44K2oAJdHWiymRncKn4v4JiGm1ZaJH_0 2024-09-12T17:41:32.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.308+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1885596355231177647', time=2024-09-12T19:31:42.620068+0000, chain.objs.size()=1 2024-09-12T17:41:32.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.308+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.TFQ5KApWTcA7IrLQRohQK_746qSipb9_0 2024-09-12T17:41:32.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.308+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10468430713194979201', time=2024-09-12T19:31:42.695296+0000, chain.objs.size()=1 2024-09-12T17:41:32.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.308+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.YhuPRYmFnO6-jJqrpce5e5CwMxZLls6_0 2024-09-12T17:41:32.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.308+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7193066183199415988', time=2024-09-12T19:31:42.718843+0000, chain.objs.size()=1 2024-09-12T17:41:32.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.308+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.i4o17IyLVWjjghLzpixwh3iz_qnBW0T_0 2024-09-12T17:41:32.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.308+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18139600484301234511', time=2024-09-12T19:31:43.100715+0000, chain.objs.size()=1 2024-09-12T17:41:32.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.308+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.gPrJ7Leg6e_nnN4AFycLrMJ8ZGeESC6_0 2024-09-12T17:41:32.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.308+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12178818523751417120', time=2024-09-12T19:31:43.136338+0000, chain.objs.size()=1 2024-09-12T17:41:32.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.308+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.2Cde533tMZ9V8Ma_qXoMQlcFVqe-Pp8_0 2024-09-12T17:41:32.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.308+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.995397766288076002', time=2024-09-12T19:31:43.151172+0000, chain.objs.size()=1 2024-09-12T17:41:32.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.308+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.6XejGDlVTiHMuzaOTVTAmEIah8eVb2X_0 2024-09-12T17:41:32.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.312+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3528765561196726681', time=2024-09-12T19:31:43.234898+0000, chain.objs.size()=1 2024-09-12T17:41:32.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.312+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.wUtd7SgjYtmFtFUGw5SHwe5AOc2D86r_0 2024-09-12T17:41:32.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.312+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11942772045012132269', time=2024-09-12T19:31:43.419105+0000, chain.objs.size()=1 2024-09-12T17:41:32.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.312+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.a-x56xib4JSDMtSVoqHZI6cz-6kMkND_0 2024-09-12T17:41:32.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.312+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17895988346433056921', time=2024-09-12T19:31:43.556415+0000, chain.objs.size()=1 2024-09-12T17:41:32.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.312+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.izw4evlXb5KdOXdcX3S5s2K4kau_GZx_0 2024-09-12T17:41:32.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.312+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14734005258273979754', time=2024-09-12T19:31:43.562320+0000, chain.objs.size()=1 2024-09-12T17:41:32.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.312+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.oQm00oUAsx55z2DrUNQkMNlFmSHwc___0 2024-09-12T17:41:32.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.312+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3275321700246511774', time=2024-09-12T19:31:43.720778+0000, chain.objs.size()=1 2024-09-12T17:41:32.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.312+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_._I-r9EkILdw2pYfmxHc6smvXTRXWlM-_0 2024-09-12T17:41:32.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.312+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17950407017240634225', time=2024-09-12T19:31:43.721789+0000, chain.objs.size()=1 2024-09-12T17:41:32.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.312+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Sep2mEJFmSUY8bHMq4myZJfUeA9ICbt_0 2024-09-12T17:41:32.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.312+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9229563924911431694', time=2024-09-12T19:31:43.751929+0000, chain.objs.size()=1 2024-09-12T17:41:32.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.312+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.22jg-qWkZCpDm-hI6D5AbpvWPDV7wMM_0 2024-09-12T17:41:32.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.312+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15808054562932846842', time=2024-09-12T19:31:43.825532+0000, chain.objs.size()=1 2024-09-12T17:41:32.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.312+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.MlMxOk9JrJWRv-RB6y8cTsOdRU1ybv4_0 2024-09-12T17:41:32.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.312+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.852883767099535639', time=2024-09-12T19:31:43.833651+0000, chain.objs.size()=1 2024-09-12T17:41:32.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.312+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.vRldvloXWBDtuyR5t5M46lyltTnL0p3_0 2024-09-12T17:41:32.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.312+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13153726309606016524', time=2024-09-12T19:31:43.848846+0000, chain.objs.size()=1 2024-09-12T17:41:32.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.312+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.IRKOAoBBF8WGktiP7w9cTETkjsTMXVG_0 2024-09-12T17:41:32.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.312+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16502966440044651671', time=2024-09-12T19:31:43.854272+0000, chain.objs.size()=1 2024-09-12T17:41:32.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.312+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.90IlTrI6RY6prEP_Te9GZvIQ3PBMkmx_0 2024-09-12T17:41:32.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.312+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6726886890061144791', time=2024-09-12T19:31:43.895447+0000, chain.objs.size()=1 2024-09-12T17:41:32.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.312+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.8nmrQY6-YWvZuK5VZHP1029aK2rlbaE_0 2024-09-12T17:41:32.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.312+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13757905401360320572', time=2024-09-12T19:31:43.925639+0000, chain.objs.size()=1 2024-09-12T17:41:32.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.312+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.G_R5BIHfgda2940kGfAp6NOULM1GjRt_0 2024-09-12T17:41:32.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.312+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9494246665058097557', time=2024-09-12T19:31:44.135925+0000, chain.objs.size()=1 2024-09-12T17:41:32.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.312+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.TqW940THlZgWi32sCA5shj9u-HBLqTQ_0 2024-09-12T17:41:32.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.316+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15631878962296563095', time=2024-09-12T19:31:44.412001+0000, chain.objs.size()=1 2024-09-12T17:41:32.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.316+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.PfnG2s7PPKpCQwBvZDgCJKDN5VxguyJ_0 2024-09-12T17:41:32.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.316+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8353536392955954381', time=2024-09-12T19:31:44.441072+0000, chain.objs.size()=1 2024-09-12T17:41:32.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.316+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.RpXJUSlpXZa6H9L4zegPB5oAXAYcOSW_0 2024-09-12T17:41:32.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.316+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14724086239298527987', time=2024-09-12T19:31:44.488184+0000, chain.objs.size()=1 2024-09-12T17:41:32.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.316+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.1LdpOLVtFE6P_orrc_dtFTv2IRJCOT9_0 2024-09-12T17:41:32.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.316+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16673741860878969643', time=2024-09-12T19:31:44.500519+0000, chain.objs.size()=1 2024-09-12T17:41:32.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.316+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.rMntdZRVdVdjy_1c1DZAA1drlWwgQhR_0 2024-09-12T17:41:32.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.316+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14321068080575015815', time=2024-09-12T19:31:52.575055+0000, chain.objs.size()=1 2024-09-12T17:41:32.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.316+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.284__shadow_.d2kpUOO0j_syDTeR1TwcMURbaPEavRj_0 2024-09-12T17:41:32.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.316+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16747578467008799197', time=2024-09-12T19:31:52.577132+0000, chain.objs.size()=1 2024-09-12T17:41:32.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.316+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.284__shadow_.-YcvcyaIMjxGa6OA7YPLteC7oZW86qV_0 2024-09-12T17:41:32.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.316+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4378342100288407534', time=2024-09-12T19:31:57.570847+0000, chain.objs.size()=1 2024-09-12T17:41:32.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.316+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.293__shadow_.V-DnXkWFwjBmHwmqXP1LFHifHxnsraT_0 2024-09-12T17:41:32.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.316+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7796045399878047669', time=2024-09-12T19:32:00.004004+0000, chain.objs.size()=1 2024-09-12T17:41:32.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.316+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.299__shadow_.g77Q-nYrenEkXucrOydriRDVMBh-hXp_0 2024-09-12T17:41:32.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.316+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18406195275098851549', time=2024-09-12T19:32:00.382972+0000, chain.objs.size()=1 2024-09-12T17:41:32.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.316+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.300__shadow_.bZPfwG_n_2a40xr9S8H09QaAq349_3T_0 2024-09-12T17:41:32.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.316+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16068176957017254323', time=2024-09-12T19:32:00.755719+0000, chain.objs.size()=1 2024-09-12T17:41:32.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.316+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.301__shadow_.KV4bWEEW6f2_BUciCcWXvKmQj93gRBJ_0 2024-09-12T17:41:32.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.316+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7812508434706816543', time=2024-09-12T19:32:01.133798+0000, chain.objs.size()=1 2024-09-12T17:41:32.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.316+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.302__shadow_.iI0DQX20w0WEqfXEVQN205VXNfbjl2P_0 2024-09-12T17:41:32.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.316+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16830719675054439982', time=2024-09-12T19:32:27.854722+0000, chain.objs.size()=1 2024-09-12T17:41:32.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.316+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.OtVeekkVSoxWsYyMqHWCRALg5CqSlUg_0 2024-09-12T17:41:32.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.316+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17737017851554627069', time=2024-09-12T19:32:27.964063+0000, chain.objs.size()=1 2024-09-12T17:41:32.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.316+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.oIKubMqtl4vLqpCP2HdotuG1nEGha6q_0 2024-09-12T17:41:32.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.316+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16847190314182312929', time=2024-09-12T19:32:28.013149+0000, chain.objs.size()=1 2024-09-12T17:41:32.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.316+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.vDwkbScMFM2iuVVCKjGrKpDD0XlHJnB_0 2024-09-12T17:41:32.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.316+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9614782493916654181', time=2024-09-12T19:32:28.048494+0000, chain.objs.size()=1 2024-09-12T17:41:32.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.316+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.cI1yU_z-7nnvgDG1abKd2MoCy9Devgn_0 2024-09-12T17:41:32.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.320+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1975328978760134155', time=2024-09-12T19:32:28.066237+0000, chain.objs.size()=1 2024-09-12T17:41:32.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.320+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.WMySu4THVftc-snI1Y7LD0vp2R-JFpi_0 2024-09-12T17:41:32.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.320+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11783798294523015669', time=2024-09-12T19:32:28.160861+0000, chain.objs.size()=1 2024-09-12T17:41:32.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.320+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.kMScYWZL9anfpLZkC1lbuErn4m430as_0 2024-09-12T17:41:32.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.320+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10042352499183200102', time=2024-09-12T19:32:28.171169+0000, chain.objs.size()=1 2024-09-12T17:41:32.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.320+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.gRA-3A_sOBhNUj5E8OTvvPR3mD8t0yS_0 2024-09-12T17:41:32.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.320+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18437132523111727019', time=2024-09-12T19:32:28.196056+0000, chain.objs.size()=1 2024-09-12T17:41:32.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.320+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.mj5p005FmWcDJ7vgZPpqerYHpRI7frf_0 2024-09-12T17:41:32.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.320+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8023494914608342908', time=2024-09-12T19:32:28.220224+0000, chain.objs.size()=1 2024-09-12T17:41:32.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.320+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.lzQgwfGOt10lux28OHKCsipiiMaeqla_0 2024-09-12T17:41:32.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.320+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5360084933405248671', time=2024-09-12T19:32:28.293748+0000, chain.objs.size()=1 2024-09-12T17:41:32.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.320+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.HXGkoO3Qf192roVNtU-hPcZ8bjLlz1a_0 2024-09-12T17:41:32.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.320+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14044830714240277600', time=2024-09-12T19:32:28.385282+0000, chain.objs.size()=1 2024-09-12T17:41:32.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.320+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.pay5JMVmHKu9a9ytYEnDxENsMe_wUB7_0 2024-09-12T17:41:32.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.320+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7691428890946016696', time=2024-09-12T19:32:28.392784+0000, chain.objs.size()=1 2024-09-12T17:41:32.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.320+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.xc5MYlRUDij62WchDhafcIO8Swm-wej_0 2024-09-12T17:41:32.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.320+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7911609990675154350', time=2024-09-12T19:32:28.467860+0000, chain.objs.size()=1 2024-09-12T17:41:32.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.320+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.__P5fiYKTgeoO1xRA1NRRcfxOvyvqeu_0 2024-09-12T17:41:32.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.320+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10722401665246413852', time=2024-09-12T19:32:28.473304+0000, chain.objs.size()=1 2024-09-12T17:41:32.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.320+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.AkkvRVHL4GkvCXGhoRup1nE-4KVI-bp_0 2024-09-12T17:41:32.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.320+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6123135292632051253', time=2024-09-12T19:32:28.538110+0000, chain.objs.size()=1 2024-09-12T17:41:32.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.320+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Fm3BBbyG5ew0irOm52mqmNC9cE6K83-_0 2024-09-12T17:41:32.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.320+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15709737952740138201', time=2024-09-12T19:32:28.557728+0000, chain.objs.size()=1 2024-09-12T17:41:32.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.320+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.iyEgSU_9sWl4D8i_cNOHJeOK9ejOE69_0 2024-09-12T17:41:32.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.320+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15621214344048782028', time=2024-09-12T19:32:28.560736+0000, chain.objs.size()=1 2024-09-12T17:41:32.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.320+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.QWKLpg5syYl6c7cNyqBLfN0Kw0-hrfq_0 2024-09-12T17:41:32.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.320+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15607223065061563784', time=2024-09-12T19:32:28.741453+0000, chain.objs.size()=1 2024-09-12T17:41:32.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.320+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_._eaDJN7xooUGWTVO_T38xfr5ftVSNEF_0 2024-09-12T17:41:32.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.320+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6480511891927493350', time=2024-09-12T19:32:28.809712+0000, chain.objs.size()=1 2024-09-12T17:41:32.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.320+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Tcn9e9dWLRjUVyrdKiahowrP7UbtOmz_0 2024-09-12T17:41:32.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.320+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5215304938983561420', time=2024-09-12T19:32:28.893434+0000, chain.objs.size()=1 2024-09-12T17:41:32.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.320+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.QEeAAhJowKKiybXz8ZIRccnkpG7oNYD_0 2024-09-12T17:41:32.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.320+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10194872076647968109', time=2024-09-12T19:32:29.086839+0000, chain.objs.size()=1 2024-09-12T17:41:32.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.320+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.jk8g-8zpkGdVK4tC3LkoHaB2yeL745A_0 2024-09-12T17:41:32.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.320+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5978426947415494700', time=2024-09-12T19:32:29.120626+0000, chain.objs.size()=1 2024-09-12T17:41:32.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.320+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.B8yDVpJGvkUFB15nC0SvJ6-diq0hNcr_0 2024-09-12T17:41:32.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.320+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13229113426095516085', time=2024-09-12T19:32:29.149753+0000, chain.objs.size()=1 2024-09-12T17:41:32.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.320+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.dPlK6nafmbdhKnwXAnTH1waRoEuntfz_0 2024-09-12T17:41:32.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.324+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2058465168097216279', time=2024-09-12T19:32:29.161710+0000, chain.objs.size()=1 2024-09-12T17:41:32.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.324+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.jKmYQ0p6YVlU25Ylg24VvAdiLW16TCP_0 2024-09-12T17:41:32.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.324+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11370382617215582017', time=2024-09-12T19:32:29.162771+0000, chain.objs.size()=1 2024-09-12T17:41:32.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.324+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.YHQXnjlzkU-qgQaU5UOiSavb0fMKSdi_0 2024-09-12T17:41:32.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.324+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5858401199307052801', time=2024-09-12T19:32:29.207955+0000, chain.objs.size()=1 2024-09-12T17:41:32.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.324+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.ypTV9vRBHe2T5_B17YITGqbxAYfI_VI_0 2024-09-12T17:41:32.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.324+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3439939034681455334', time=2024-09-12T19:32:29.226454+0000, chain.objs.size()=1 2024-09-12T17:41:32.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.324+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Cw50zJruK8bBtFDz4F_9M7hRqFY0Xez_0 2024-09-12T17:41:32.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.324+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11246932570112106843', time=2024-09-12T19:32:29.369428+0000, chain.objs.size()=1 2024-09-12T17:41:32.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.324+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.XnsFYfnwVeF3KYY0E1-f9pR0kH2RFio_0 2024-09-12T17:41:32.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.324+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.241538030390541676', time=2024-09-12T19:32:29.464234+0000, chain.objs.size()=1 2024-09-12T17:41:32.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.324+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.fOeoVmKsgyXOlCzR3p5JB8j3iw8pSQ4_0 2024-09-12T17:41:32.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.324+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1964254404823359035', time=2024-09-12T19:32:29.534487+0000, chain.objs.size()=1 2024-09-12T17:41:32.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.324+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.ETs0Hs-6OGGam5UQscTKSYrUMmpRqfo_0 2024-09-12T17:41:32.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.324+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5999143847779338449', time=2024-09-12T19:32:29.666029+0000, chain.objs.size()=1 2024-09-12T17:41:32.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.324+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.jOgJ2pEOmdIa4HUoKgQ0RoqapOBqFJv_0 2024-09-12T17:41:32.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.324+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1532001965946301229', time=2024-09-12T19:32:29.827405+0000, chain.objs.size()=1 2024-09-12T17:41:32.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.324+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Nluhu7Gkzng5xl9ii2Fvj3-r6pOhEMZ_0 2024-09-12T17:41:32.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.324+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7210698699529945920', time=2024-09-12T19:32:29.986444+0000, chain.objs.size()=1 2024-09-12T17:41:32.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.324+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.J9GVwJqG-_B_14hKCxCqTy4DrctUSuL_0 2024-09-12T17:41:32.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.324+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9713323857211789702', time=2024-09-12T19:32:30.007224+0000, chain.objs.size()=1 2024-09-12T17:41:32.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.324+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.TWQ1iE3xZoh0b52fRoPx9IN55uKVJ8E_0 2024-09-12T17:41:32.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.324+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5942237954831964815', time=2024-09-12T19:32:30.118427+0000, chain.objs.size()=1 2024-09-12T17:41:32.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.324+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.V7v9r5UkYqmk3KjvF9kir0fMM97137N_0 2024-09-12T17:41:32.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.324+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15541144525511213957', time=2024-09-12T19:32:49.558889+0000, chain.objs.size()=1 2024-09-12T17:41:32.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.324+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.pm4y71MwCLi4VULVtV3sEkG-KKRauYZ_0 2024-09-12T17:41:32.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.324+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17518431066899399716', time=2024-09-12T19:32:49.641156+0000, chain.objs.size()=1 2024-09-12T17:41:32.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.324+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.eVNTiEoJ9yVSkDuD_ec30fX2f44HvyA_0 2024-09-12T17:41:32.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.324+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16960811045551758599', time=2024-09-12T19:32:49.656546+0000, chain.objs.size()=1 2024-09-12T17:41:32.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.324+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.pnoIewnX0J5odlQPCAHIYqSmYWiVo3y_0 2024-09-12T17:41:32.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.328+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15109664982784743534', time=2024-09-12T19:32:49.671475+0000, chain.objs.size()=1 2024-09-12T17:41:32.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.328+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Aje7x5V7eEIcgxWmUAERLR59ryCCt3m_0 2024-09-12T17:41:32.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.328+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6955193448599777765', time=2024-09-12T19:32:49.690295+0000, chain.objs.size()=1 2024-09-12T17:41:32.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.328+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.H-iUlm6qC8SDWOKccVOT4t2VbInb0UN_0 2024-09-12T17:41:32.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.328+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6090790360219633900', time=2024-09-12T19:32:49.703612+0000, chain.objs.size()=1 2024-09-12T17:41:32.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.328+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.KOwgfLAY9H9NDu4Rowgqq5_mcM18YpV_0 2024-09-12T17:41:32.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.328+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.501417168508619229', time=2024-09-12T19:32:49.827185+0000, chain.objs.size()=1 2024-09-12T17:41:32.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.328+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.rCV78UxhJG0N3AQmpqq8PyifizBURLk_0 2024-09-12T17:41:32.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.328+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13712840052811348516', time=2024-09-12T19:32:49.848480+0000, chain.objs.size()=1 2024-09-12T17:41:32.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.328+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.7APTckoLLFl3R-jVYAxb5yGsginnmgQ_0 2024-09-12T17:41:32.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.328+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11003129326178616783', time=2024-09-12T19:32:49.909245+0000, chain.objs.size()=1 2024-09-12T17:41:32.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.328+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.dUn8TQ3LsxxPnjk9DSZVYOnVbmojxOZ_0 2024-09-12T17:41:32.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.328+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4469090362681673086', time=2024-09-12T19:32:49.930313+0000, chain.objs.size()=1 2024-09-12T17:41:32.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.328+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.IKXcEybulxDFBnSGRgizegZxpR0qpkb_0 2024-09-12T17:41:32.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.328+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16523583745779986639', time=2024-09-12T19:32:49.945298+0000, chain.objs.size()=1 2024-09-12T17:41:32.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.328+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.qgHzVm1PyU4AaAL6WkOLeNxV2UIMbdL_0 2024-09-12T17:41:32.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.328+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17457927180825336455', time=2024-09-12T19:32:49.998129+0000, chain.objs.size()=1 2024-09-12T17:41:32.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.328+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.ixhKP6-KbTKY5nZWYMHENyBBSnLhiPI_0 2024-09-12T17:41:32.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.328+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13933669714857346213', time=2024-09-12T19:32:50.001538+0000, chain.objs.size()=1 2024-09-12T17:41:32.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.328+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.kX-0OeUXcdvcAsschKzDo6mFuhr_HSi_0 2024-09-12T17:41:32.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.328+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13580830111851703416', time=2024-09-12T19:32:50.178169+0000, chain.objs.size()=1 2024-09-12T17:41:32.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.328+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.h-89JrfpADJ00ol_DUXfmHMeZmXfGPD_0 2024-09-12T17:41:32.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.328+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.243538635370172759', time=2024-09-12T19:32:50.216544+0000, chain.objs.size()=1 2024-09-12T17:41:32.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.328+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.DJa4BdvXu5WSvBMlXewaKT6Q5SzcjwD_0 2024-09-12T17:41:32.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.328+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8031173951023651782', time=2024-09-12T19:32:50.484567+0000, chain.objs.size()=1 2024-09-12T17:41:32.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.328+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.TBGnUyZd1wlcCXvntHWVYcEyJSdaAXR_0 2024-09-12T17:41:32.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.328+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18389006569801957215', time=2024-09-12T19:32:50.530080+0000, chain.objs.size()=1 2024-09-12T17:41:32.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.328+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.0RUQIwxVT8Ma7HrZPArsKNLKAJE1jAO_0 2024-09-12T17:41:32.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.328+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15931966384911263765', time=2024-09-12T19:32:50.615360+0000, chain.objs.size()=1 2024-09-12T17:41:32.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.328+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.-CYV2WIgh2lmzZYW7XhkzRwwZZkxZUs_0 2024-09-12T17:41:32.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.332+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10229108662752034043', time=2024-09-12T19:32:50.628574+0000, chain.objs.size()=1 2024-09-12T17:41:32.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.332+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.o0G4SPsvJ50it3fkIu2GkVHWKGOhGqz_0 2024-09-12T17:41:32.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.332+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2307642501849685423', time=2024-09-12T19:32:50.842088+0000, chain.objs.size()=1 2024-09-12T17:41:32.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.332+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.C1OsWP0cCNgaURwSmpcLtPSS8POYh-b_0 2024-09-12T17:41:32.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.332+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10117389665441363336', time=2024-09-12T19:32:50.951297+0000, chain.objs.size()=1 2024-09-12T17:41:32.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.332+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.D5ROA5wwHNAxVQe7aOE_St8oYKKozGt_0 2024-09-12T17:41:32.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.332+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10307514973751096153', time=2024-09-12T19:32:51.029982+0000, chain.objs.size()=1 2024-09-12T17:41:32.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.332+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.fWUOQuMPag3AALUlqH0a_Y4nczZFuiK_0 2024-09-12T17:41:32.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.332+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16758161866789447804', time=2024-09-12T19:32:51.160810+0000, chain.objs.size()=1 2024-09-12T17:41:32.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.332+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.80AeCNGP2dMR_u8rTvynYtPtJ-Cg-9V_0 2024-09-12T17:41:32.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.332+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6446765543669373227', time=2024-09-12T19:32:51.194269+0000, chain.objs.size()=1 2024-09-12T17:41:32.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.332+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.PW58Qj6DZKV6yRBqCzJZ4AaZSc-KnXv_0 2024-09-12T17:41:32.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.332+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15059102683768375811', time=2024-09-12T19:32:51.260674+0000, chain.objs.size()=1 2024-09-12T17:41:32.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.332+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.4jkriJkbM7utGQiEVXdRvx8xPs3CAvX_0 2024-09-12T17:41:32.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.332+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16561430063248218298', time=2024-09-12T19:32:51.288808+0000, chain.objs.size()=1 2024-09-12T17:41:32.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.332+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.OGaPqFbv7CXMbcFoL91qaeZLTc5t_f7_0 2024-09-12T17:41:32.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.332+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9743167905086511933', time=2024-09-12T19:32:51.335376+0000, chain.objs.size()=1 2024-09-12T17:41:32.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.332+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.qQaeh165qiLTd0Pug48ICWVmi4PyVID_0 2024-09-12T17:41:32.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.332+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9081104690978399660', time=2024-09-12T19:32:51.503834+0000, chain.objs.size()=1 2024-09-12T17:41:32.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.332+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.H5fAtU6gt9Uxg2CcntE1fLFNLHdZzmy_0 2024-09-12T17:41:32.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.332+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/46832 2024-09-12T17:41:32.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.336+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T17:41:32.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.336+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5778097389120109044', time=2024-09-12T19:32:51.642879+0000, chain.objs.size()=1 2024-09-12T17:41:32.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.336+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.fjRRnSxhOJ3yBLg5n5UuVrDw4MQqdjj_0 2024-09-12T17:41:32.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.336+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7615584623150067501', time=2024-09-12T19:32:51.724790+0000, chain.objs.size()=1 2024-09-12T17:41:32.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.336+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.2cUHYG8Lo6Q4l3ALdlzRH4YBPSPgIQX_0 2024-09-12T17:41:32.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.336+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6945284366108922029', time=2024-09-12T19:32:51.865900+0000, chain.objs.size()=1 2024-09-12T17:41:32.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.336+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.P98ySPN91fTMmpi1hJdQZ87uhgBX7df_0 2024-09-12T17:41:32.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.336+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5525065564786843953', time=2024-09-12T19:32:51.945136+0000, chain.objs.size()=1 2024-09-12T17:41:32.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.336+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.7gLf96Xof4HywAue_YHRPf5xe3CcJbT_0 2024-09-12T17:41:32.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.336+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5329066623692757004', time=2024-09-12T19:32:51.969066+0000, chain.objs.size()=1 2024-09-12T17:41:32.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.336+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.rev7DnjTA2mWF7clbJsCXIQcZvI-3Ll_0 2024-09-12T17:41:32.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.336+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16431146747012893282', time=2024-09-12T19:32:52.005742+0000, chain.objs.size()=1 2024-09-12T17:41:32.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.336+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.IQkBdv5QFVL0oiElqe8R52uePdW4n-1_0 2024-09-12T17:41:32.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.336+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4524603019612569427', time=2024-09-12T19:33:04.518430+0000, chain.objs.size()=2 2024-09-12T17:41:32.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.336+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.367__shadow_.gCGGehARrCyjMdz44EjKC3arVAvXrkU_0 2024-09-12T17:41:32.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.336+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.367__shadow_.gCGGehARrCyjMdz44EjKC3arVAvXrkU_1 2024-09-12T17:41:32.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.336+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13473524023959673570', time=2024-09-12T19:33:22.356669+0000, chain.objs.size()=1 2024-09-12T17:41:32.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.336+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.410__shadow_.QNJpY7FqsAgkm4xPjh0L5WNbSjazhyp_0 2024-09-12T17:41:32.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.336+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15469564502120028986', time=2024-09-12T19:33:30.067646+0000, chain.objs.size()=1 2024-09-12T17:41:32.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.336+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.434__shadow_.9HcE9uW7Y2JkqoxYEYAv3E6yZUbRX5__0 2024-09-12T17:41:32.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.336+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11345904060568008252', time=2024-09-12T19:33:35.492206+0000, chain.objs.size()=1 2024-09-12T17:41:32.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.336+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.447__shadow_.3t6NM81fkgsVynT3SW-Y9bGHfElX-a9_0 2024-09-12T17:41:32.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.336+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4414374067638797253', time=2024-09-12T19:33:44.218093+0000, chain.objs.size()=1 2024-09-12T17:41:32.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.336+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.465__shadow_.z3xjWSZEA4UFTrVF8Y7bn-XWhh1gId1_0 2024-09-12T17:41:32.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.336+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6891469589608782367', time=2024-09-12T19:34:02.021612+0000, chain.objs.size()=2 2024-09-12T17:41:32.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.336+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.512__shadow_.548FwVIHN2X0JPAdSZHaRNNdLJHmyQP_0 2024-09-12T17:41:32.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.336+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.512__shadow_.548FwVIHN2X0JPAdSZHaRNNdLJHmyQP_1 2024-09-12T17:41:32.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.336+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~uINHNUTEYXVxParu3B5Wh7MFbBIegbB', time=2024-09-12T19:34:29.247564+0000, chain.objs.size()=2 2024-09-12T17:41:32.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.336+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.531__multipart_mymultipart.2~uINHNUTEYXVxParu3B5Wh7MFbBIegbB.1 2024-09-12T17:41:32.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.340+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.531__shadow_mymultipart.2~uINHNUTEYXVxParu3B5Wh7MFbBIegbB.1_1 2024-09-12T17:41:32.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.340+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3568003244208541070', time=2024-09-12T19:35:16.732851+0000, chain.objs.size()=1 2024-09-12T17:41:32.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.340+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.569__shadow:Ph60Ex5FPzF8XnFIISSB.olTlW7bBE._.rkD8Ekb4AOPrF1TxtVMtT6ytrH97lQE_0 2024-09-12T17:41:32.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.340+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13688401508392215047', time=2024-09-12T19:35:24.131012+0000, chain.objs.size()=1 2024-09-12T17:41:32.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.340+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.570__shadow:pOJZvw7NdqBNjRALbxnewqxMZRDS7tf_.z6F36cJLcLt95YhK0mve_6OCclL0BFz_0 2024-09-12T17:41:32.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.340+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16340703433978971442', time=2024-09-12T19:35:27.915671+0000, chain.objs.size()=1 2024-09-12T17:41:32.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.340+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.574__shadow:PDSkTO-KxIe2arJq0qUSxymTAN4fhCu_.UsI_hiO2F5JX9O8wq8mMktWMa_cHVBo_0 2024-09-12T17:41:32.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.340+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12138503235749739178', time=2024-09-12T19:35:28.617939+0000, chain.objs.size()=1 2024-09-12T17:41:32.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.340+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.574__shadow:521mT.F74XwTAWvwRh.QdvihHsLkSnD_.UDsh5xL48A_tI8rUFtXZXtRjy2PKPQu_0 2024-09-12T17:41:32.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.340+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8289121178406588816', time=2024-09-12T19:35:48.864942+0000, chain.objs.size()=1 2024-09-12T17:41:32.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.340+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.577__shadow:VwDZeAfjgyvKkgPHYmlED60V7fKX4XS_.OkQfdns4Yis4bB_6yonAM_59fo2r-Vd_0 2024-09-12T17:41:32.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.340+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17264158921466930456', time=2024-09-12T19:35:55.516926+0000, chain.objs.size()=1 2024-09-12T17:41:32.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.340+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.580__shadow:9cx0qT15wcNHqXpzLww1IY7EUW93xsO_.t382k31759m1WVTIZZ-F3kEbGUitOA9_0 2024-09-12T17:41:32.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.340+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8017612762689674919', time=2024-09-12T19:38:44.130916+0000, chain.objs.size()=1 2024-09-12T17:41:32.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.340+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.666__shadow_.6yM3IhvPKvvcxqZCaull2b-TeKhjMky_0 2024-09-12T17:41:32.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.344+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:41:32.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.344+0000 7fd765adf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:41:32.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.344+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:41:32.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.348+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:41:32.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.348+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46394' 2024-09-12T17:41:32.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.348+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4135159670818407497', time=2024-09-12T19:29:37.353933+0000, chain.objs.size()=1 2024-09-12T17:41:32.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.348+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.151__shadow_.5hog1huePBc5vKijCKVgw2HQBVCr2AL_0 2024-09-12T17:41:32.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.348+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14725799717025074805', time=2024-09-12T19:31:11.798510+0000, chain.objs.size()=1 2024-09-12T17:41:32.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.348+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.233__shadow_.-hu7gZ_g5mOyKdVg04csG7RPJYaaSaT_0 2024-09-12T17:41:32.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.348+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2071043780483858486', time=2024-09-12T19:31:12.221774+0000, chain.objs.size()=1 2024-09-12T17:41:32.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.348+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.234__shadow_.3KFAJ8mL8bcqKFl4K6tVhAYKcBhXFfX_0 2024-09-12T17:41:32.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.348+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7771703222394242122', time=2024-09-12T19:31:19.071529+0000, chain.objs.size()=1 2024-09-12T17:41:32.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.348+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.251__shadow_.pE0Ee3RZFbQUF2_wKrqZkmEr0vtf8EA_0 2024-09-12T17:41:32.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.348+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1341859939345541807', time=2024-09-12T19:31:22.509102+0000, chain.objs.size()=1 2024-09-12T17:41:32.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.348+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.260__shadow_.3XbC5WsGyfZkfOHgX9QgpY3Z_UFXEM7_0 2024-09-12T17:41:32.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.348+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1193295385547793295', time=2024-09-12T19:31:22.903465+0000, chain.objs.size()=1 2024-09-12T17:41:32.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.348+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.261__shadow_.AEZY-jQu0YmukwAb8WAdohpeyjpLd6l_0 2024-09-12T17:41:32.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.348+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5992041230550654729', time=2024-09-12T19:31:42.240818+0000, chain.objs.size()=1 2024-09-12T17:41:32.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.348+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.0S8AAfLFtXjALcDIkUHpoUla3Xx7to6_0 2024-09-12T17:41:32.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.348+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12439088298644430344', time=2024-09-12T19:31:42.243731+0000, chain.objs.size()=1 2024-09-12T17:41:32.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.348+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.pWMad8TiMNf8a4SJEov8ovsdBkKZvdu_0 2024-09-12T17:41:32.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.348+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13889019589815979419', time=2024-09-12T19:31:42.252005+0000, chain.objs.size()=1 2024-09-12T17:41:32.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.348+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.fg28k9N6ZWIK6uAN_7vKI1lN4uugD3-_0 2024-09-12T17:41:32.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.348+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14542586452458808776', time=2024-09-12T19:31:42.314605+0000, chain.objs.size()=1 2024-09-12T17:41:32.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.348+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.IFoMS1sC1mxfPG9K0l4Y5ESpuYLtb84_0 2024-09-12T17:41:32.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.348+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14430144241420530841', time=2024-09-12T19:31:42.317802+0000, chain.objs.size()=1 2024-09-12T17:41:32.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.348+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.L2Yim9q5DbYynuRQLXBg-rOfoqONvtw_0 2024-09-12T17:41:32.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.348+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8451811689534965014', time=2024-09-12T19:31:42.364907+0000, chain.objs.size()=1 2024-09-12T17:41:32.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.348+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.ZPN38PAafNvM6bv9qhjWnaYddJeHH22_0 2024-09-12T17:41:32.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.348+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5558596877382087021', time=2024-09-12T19:31:42.375035+0000, chain.objs.size()=1 2024-09-12T17:41:32.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.348+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.PXFTAKqRDSmhnW8tNFfPZG6SuU_JKwj_0 2024-09-12T17:41:32.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.348+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8233495981714436204', time=2024-09-12T19:31:42.445665+0000, chain.objs.size()=1 2024-09-12T17:41:32.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.348+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.6yLjIOm8b62k-xBzpGHaALKHsFRxRXL_0 2024-09-12T17:41:32.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.348+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17813657126165827735', time=2024-09-12T19:31:42.542400+0000, chain.objs.size()=1 2024-09-12T17:41:32.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.348+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.4pYXOsTpx_nkWZKkSpzo_aqZO1YsK8W_0 2024-09-12T17:41:32.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.348+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2538592983488686490', time=2024-09-12T19:31:42.572232+0000, chain.objs.size()=1 2024-09-12T17:41:32.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.348+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.oeMtIMmkJR7qHmSC6Mf9HzCbwJuCXRH_0 2024-09-12T17:41:32.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.348+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3177450009197689285', time=2024-09-12T19:31:42.592883+0000, chain.objs.size()=1 2024-09-12T17:41:32.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.348+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.KtEZJNJwVHr6BygMffZoIkwClLZxJxK_0 2024-09-12T17:41:32.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.348+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4874420829633101545', time=2024-09-12T19:31:42.802279+0000, chain.objs.size()=1 2024-09-12T17:41:32.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.348+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.9VONOuNjlYNhcnHr8P0MRiT0rQNLQic_0 2024-09-12T17:41:32.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.348+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12835786090801819447', time=2024-09-12T19:31:42.850028+0000, chain.objs.size()=1 2024-09-12T17:41:32.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.348+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.01ZMJEjcY6yHxfjy5fj5YG7xmuCs9pf_0 2024-09-12T17:41:32.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.348+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6909852416827635481', time=2024-09-12T19:31:42.857998+0000, chain.objs.size()=1 2024-09-12T17:41:32.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.348+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.weKpQOi1EIfrFSzd7emvDT3HaaD_gSl_0 2024-09-12T17:41:32.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.348+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6187744484454851755', time=2024-09-12T19:31:42.870115+0000, chain.objs.size()=1 2024-09-12T17:41:32.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.348+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.yM_SrGdwvDQRzvvogQIoC95abUvW6IB_0 2024-09-12T17:41:32.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.348+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7060188351406645050', time=2024-09-12T19:31:42.910594+0000, chain.objs.size()=1 2024-09-12T17:41:32.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.348+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.LZP_9FVZPJtthY8yw_my7mqblKTKwp6_0 2024-09-12T17:41:32.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.352+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13474341003999560137', time=2024-09-12T19:31:43.093913+0000, chain.objs.size()=1 2024-09-12T17:41:32.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.352+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.k6tfy-ASI1eVuh69mn-mQaEIxeWomSG_0 2024-09-12T17:41:32.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.352+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17946151382165169272', time=2024-09-12T19:31:43.177211+0000, chain.objs.size()=1 2024-09-12T17:41:32.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.352+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.35ta5N6hl_vSIA_22MXAypMCHSFmvJL_0 2024-09-12T17:41:32.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.352+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8061561093172952707', time=2024-09-12T19:31:43.178643+0000, chain.objs.size()=1 2024-09-12T17:41:32.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.352+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.JO86wE7fdoTIMySlHCTDQHJBikCVkyF_0 2024-09-12T17:41:32.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.352+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5981982123678135607', time=2024-09-12T19:31:43.216424+0000, chain.objs.size()=1 2024-09-12T17:41:32.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.352+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.t_zC_QJ461fAwWeQw4T1Dy_16FfpaWJ_0 2024-09-12T17:41:32.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.352+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12268472029068684202', time=2024-09-12T19:31:43.465452+0000, chain.objs.size()=1 2024-09-12T17:41:32.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.352+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.2Xm87bki_T_nEry3vfhtLGNlskGy50U_0 2024-09-12T17:41:32.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.352+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.619043389805746700', time=2024-09-12T19:31:43.551606+0000, chain.objs.size()=1 2024-09-12T17:41:32.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.352+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.zJEZM_JR6gtMrZHrxROyWxj_tdb50NY_0 2024-09-12T17:41:32.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.352+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15374920459154740850', time=2024-09-12T19:31:43.615121+0000, chain.objs.size()=1 2024-09-12T17:41:32.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.352+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.HAfqBwUHp03pYCmqRP8ZFCFvsZnBmEO_0 2024-09-12T17:41:32.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.352+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13717968041225880641', time=2024-09-12T19:31:43.617613+0000, chain.objs.size()=1 2024-09-12T17:41:32.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.352+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.PeoGBP15WZO8H0ib-0CTzGAl4nybUfM_0 2024-09-12T17:41:32.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.352+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17947966374385646659', time=2024-09-12T19:31:43.800359+0000, chain.objs.size()=1 2024-09-12T17:41:32.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.352+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.eucUbljEbc33TFKt3O_E0r4OQFfGmvD_0 2024-09-12T17:41:32.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.352+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3945511247196803737', time=2024-09-12T19:31:43.821764+0000, chain.objs.size()=1 2024-09-12T17:41:32.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.352+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.EPotonuwalQOcsUmIEuQyIHi00lv0r2_0 2024-09-12T17:41:32.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.352+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.928315274570899163', time=2024-09-12T19:31:43.852229+0000, chain.objs.size()=1 2024-09-12T17:41:32.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.352+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.rArhDAE14nW7sjaXG_xzkqXfS4GT7dZ_0 2024-09-12T17:41:32.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.352+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7278783496281135932', time=2024-09-12T19:31:43.876097+0000, chain.objs.size()=1 2024-09-12T17:41:32.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.352+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_._n49osezu_NeOCxm0rn7Vd5DNKnqADH_0 2024-09-12T17:41:32.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.352+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5320115296338983344', time=2024-09-12T19:31:43.888756+0000, chain.objs.size()=1 2024-09-12T17:41:32.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.352+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.qAzivbL7Ca529pnj6vpnpdWd31G1p1S_0 2024-09-12T17:41:32.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.352+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2637201121162924399', time=2024-09-12T19:31:44.205416+0000, chain.objs.size()=1 2024-09-12T17:41:32.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.352+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.AIGOAQ5SLeex-BOVCDpWrNzvyDUZCS1_0 2024-09-12T17:41:32.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.352+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17319644960129711862', time=2024-09-12T19:31:44.384549+0000, chain.objs.size()=1 2024-09-12T17:41:32.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.352+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.MEbH2xMphQfsfcAOiLJ3LhDB8UKAMrm_0 2024-09-12T17:41:32.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.356+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12749822431500617708', time=2024-09-12T19:31:44.522408+0000, chain.objs.size()=1 2024-09-12T17:41:32.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.356+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.-eFWjY6SXF_7NUlQSNEcDcu6P3ZTqoX_0 2024-09-12T17:41:32.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.356+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3899203591110691681', time=2024-09-12T19:31:44.535562+0000, chain.objs.size()=1 2024-09-12T17:41:32.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.356+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.lOqIKBdrwbsObXwO2UlOiRgXMfHM0kk_0 2024-09-12T17:41:32.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.356+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16332303550381571352', time=2024-09-12T19:31:46.183034+0000, chain.objs.size()=1 2024-09-12T17:41:32.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.356+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.267__shadow_.CgYOBN56G-BkTnEgKv3BupKY084YS1z_0 2024-09-12T17:41:32.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.356+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2136817158072319754', time=2024-09-12T19:31:49.162364+0000, chain.objs.size()=1 2024-09-12T17:41:32.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.356+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.275__shadow_.hU24R8DD7ae4QVMh23cxKXDMwgxLLfQ_0 2024-09-12T17:41:32.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.356+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12625855339303058730', time=2024-09-12T19:31:50.629262+0000, chain.objs.size()=1 2024-09-12T17:41:32.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.356+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.279__shadow_.twPacbAv7MtI5_dkkIRYTX6ssZypp-T_0 2024-09-12T17:41:32.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.356+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15780628811023398259', time=2024-09-12T19:31:56.474648+0000, chain.objs.size()=1 2024-09-12T17:41:32.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.356+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.292__shadow_.bMd9eA6Ui_TQL-uLDY_PLMlKbUI9tJ7_0 2024-09-12T17:41:32.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.356+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13302651946277449715', time=2024-09-12T19:32:01.135951+0000, chain.objs.size()=1 2024-09-12T17:41:32.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.356+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.302__shadow_.67h2me68vfQNNFZJYjD5yzQaZA07wcc_0 2024-09-12T17:41:32.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.356+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8434543019911202772', time=2024-09-12T19:32:07.363713+0000, chain.objs.size()=1 2024-09-12T17:41:32.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.356+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.319__shadow:mSuR6aAXLo1SdReJr-OuRBlPb5QcIDx_.Xdom5PsH421qEPQfiACAGEUCJVy2t3y_0 2024-09-12T17:41:32.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.356+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11751812426333857175', time=2024-09-12T19:32:28.088956+0000, chain.objs.size()=1 2024-09-12T17:41:32.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.356+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.yo2HXUFew9-kj-O83KoC43Eu1aOxkZn_0 2024-09-12T17:41:32.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.356+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9437663028176201556', time=2024-09-12T19:32:28.194762+0000, chain.objs.size()=1 2024-09-12T17:41:32.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.356+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.a1xstmbhmB13Wi5zw8wLzg_oyZ2EKGv_0 2024-09-12T17:41:32.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.356+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10340520024180294335', time=2024-09-12T19:32:28.200008+0000, chain.objs.size()=1 2024-09-12T17:41:32.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.356+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.e6MPMjajws4VUzPbIse14SSXRrml4aN_0 2024-09-12T17:41:32.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.356+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13150805399749703232', time=2024-09-12T19:32:28.216080+0000, chain.objs.size()=1 2024-09-12T17:41:32.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.356+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.GSQump2xd9Dep8trFiTST_feMI_2Dry_0 2024-09-12T17:41:32.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.356+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14281415693750688984', time=2024-09-12T19:32:28.239638+0000, chain.objs.size()=1 2024-09-12T17:41:32.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.356+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.yLw-1vJJLWzfPyBqLceA5x0ICIRP84X_0 2024-09-12T17:41:32.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.356+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4306486163891503864', time=2024-09-12T19:32:28.445107+0000, chain.objs.size()=1 2024-09-12T17:41:32.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.356+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.xrc0UpmpT9eu50P-YPrzL2yIVzG7hNH_0 2024-09-12T17:41:32.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.356+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13489383686323631687', time=2024-09-12T19:32:28.510482+0000, chain.objs.size()=1 2024-09-12T17:41:32.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.356+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Rpo_qX1nlTzi_zjrYQev9Djo1PPs2bR_0 2024-09-12T17:41:32.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.356+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.391297964545514426', time=2024-09-12T19:32:28.534545+0000, chain.objs.size()=1 2024-09-12T17:41:32.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.356+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.o6T0cFkSe4i-PD6ipM5nj3vRWqE7Hfm_0 2024-09-12T17:41:32.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.356+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10481557180864721209', time=2024-09-12T19:32:28.704185+0000, chain.objs.size()=1 2024-09-12T17:41:32.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.356+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.nPQaX45EVVtEbpad6a0jM2qHclgNDOH_0 2024-09-12T17:41:32.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.356+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11287577366288325811', time=2024-09-12T19:32:28.751909+0000, chain.objs.size()=1 2024-09-12T17:41:32.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.356+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.yvLUVdzUtRCmWNliTVTkWHgn_mldSjX_0 2024-09-12T17:41:32.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.360+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6702069994717184070', time=2024-09-12T19:32:28.812465+0000, chain.objs.size()=1 2024-09-12T17:41:32.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.360+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.5Tb6l_ZlzSwBqqj_ka4WiJ0UMkBMnQx_0 2024-09-12T17:41:32.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.360+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11242874616748358252', time=2024-09-12T19:32:28.819832+0000, chain.objs.size()=1 2024-09-12T17:41:32.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.360+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Fi97eU18IgZiskpzjS6vtRztvbJIHmr_0 2024-09-12T17:41:32.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.360+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17817533345156223942', time=2024-09-12T19:32:28.896043+0000, chain.objs.size()=1 2024-09-12T17:41:32.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.360+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.GDv18lneWByLmzGjzUeHL-B-2aOESU2_0 2024-09-12T17:41:32.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.360+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8467952721703276097', time=2024-09-12T19:32:29.145360+0000, chain.objs.size()=1 2024-09-12T17:41:32.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.360+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.uCP4GIOzbsFyKgjAs_H3MlNVH5S3srp_0 2024-09-12T17:41:32.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.360+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18075698694160188992', time=2024-09-12T19:32:29.168322+0000, chain.objs.size()=1 2024-09-12T17:41:32.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.360+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.L5spCELuSi_AfSVvTPJdi4tPIK4ZKgL_0 2024-09-12T17:41:32.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.360+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10403474977076544024', time=2024-09-12T19:32:29.193111+0000, chain.objs.size()=1 2024-09-12T17:41:32.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.360+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.jbRN5jgB0JCv1AHJWSGmEe-iuFMmlzc_0 2024-09-12T17:41:32.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.360+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17023449147641154050', time=2024-09-12T19:32:29.206838+0000, chain.objs.size()=1 2024-09-12T17:41:32.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.360+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.CJ7YK4J8UkSNn588NzbMDy5K5h4NXDE_0 2024-09-12T17:41:32.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.360+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2541181045807287953', time=2024-09-12T19:32:29.210300+0000, chain.objs.size()=1 2024-09-12T17:41:32.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.360+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.MCLTv_WybpCiNkXCF-jfsJow9-3Uvfo_0 2024-09-12T17:41:32.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.360+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5600951053854005289', time=2024-09-12T19:32:29.351720+0000, chain.objs.size()=1 2024-09-12T17:41:32.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.360+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.bmNr2CPTp69nR1V0BxvQR-2ljXtiiAF_0 2024-09-12T17:41:32.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.360+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9691933019665733263', time=2024-09-12T19:32:29.508442+0000, chain.objs.size()=1 2024-09-12T17:41:32.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.360+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.kYmckWbBAtpLRZww5Yu-CvstV0HC6EV_0 2024-09-12T17:41:32.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.360+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10544181762291264572', time=2024-09-12T19:32:29.512614+0000, chain.objs.size()=1 2024-09-12T17:41:32.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.360+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.cuT779fjeOV-q_0YePTrQmJtkez5l6q_0 2024-09-12T17:41:32.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.360+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3090963759956217290', time=2024-09-12T19:32:29.530020+0000, chain.objs.size()=1 2024-09-12T17:41:32.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.360+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.C3MQVarrI1uRTqP-5A1BQm0Kk9wJ3GP_0 2024-09-12T17:41:32.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.360+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16351335667919921269', time=2024-09-12T19:32:29.786242+0000, chain.objs.size()=1 2024-09-12T17:41:32.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.360+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.WffeyB9-ENiYN1CtByJeir8cw22xOGA_0 2024-09-12T17:41:32.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.360+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6256058587009412201', time=2024-09-12T19:32:29.833648+0000, chain.objs.size()=1 2024-09-12T17:41:32.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.360+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.8k9_6AQhmf9lwXVsVmu5d76zROsQykv_0 2024-09-12T17:41:32.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.360+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1765970780947183192', time=2024-09-12T19:32:30.054418+0000, chain.objs.size()=1 2024-09-12T17:41:32.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.360+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.nL66O_LsMsTF0mM0G0ZCoS_5oM5jyY__0 2024-09-12T17:41:32.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.360+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3887727080251597204', time=2024-09-12T19:32:30.093947+0000, chain.objs.size()=1 2024-09-12T17:41:32.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.360+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.sYTdApLImaPSDfHPIETAq17Oo81CF1t_0 2024-09-12T17:41:32.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.364+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2220632932517789152', time=2024-09-12T19:32:30.095133+0000, chain.objs.size()=1 2024-09-12T17:41:32.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.364+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.hSQfZ0N95sdtyfLoLqdHMrbWBXWNaIx_0 2024-09-12T17:41:32.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.364+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12914998356573425616', time=2024-09-12T19:32:30.099699+0000, chain.objs.size()=1 2024-09-12T17:41:32.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.364+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.UJojlgQJoWgMR2ynm409e4esO-HsM0o_0 2024-09-12T17:41:32.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.364+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12526560330051396518', time=2024-09-12T19:32:30.100778+0000, chain.objs.size()=1 2024-09-12T17:41:32.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.364+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.gvCavU1qR3LaO2gVwEwnTTlQ-omOtWd_0 2024-09-12T17:41:32.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.364+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12114788837073392733', time=2024-09-12T19:32:30.113887+0000, chain.objs.size()=1 2024-09-12T17:41:32.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.364+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.gfkTHeyrDcblhLLDQQuJWZgUVxSs4e0_0 2024-09-12T17:41:32.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.364+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3593851251157574700', time=2024-09-12T19:32:30.140195+0000, chain.objs.size()=1 2024-09-12T17:41:32.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.364+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Nz-U6olXfm9SQJhLe0AlhCwoszBEZFD_0 2024-09-12T17:41:32.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.364+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11685228025871782768', time=2024-09-12T19:32:49.630509+0000, chain.objs.size()=1 2024-09-12T17:41:32.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.364+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.lL_jofxHL7XWwO1Q9qFpWnpb4TQE2d5_0 2024-09-12T17:41:32.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.364+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13520708154438222105', time=2024-09-12T19:32:49.652247+0000, chain.objs.size()=1 2024-09-12T17:41:32.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.364+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_._I8yyeHffKS0ChUzuUQmuc_bvAZp4V7_0 2024-09-12T17:41:32.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.364+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5473187911005444241', time=2024-09-12T19:32:49.718348+0000, chain.objs.size()=1 2024-09-12T17:41:32.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.364+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.1myNP5HnjBG5MPpjDqaDLgAT5zndBwh_0 2024-09-12T17:41:32.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.364+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8158159855475692675', time=2024-09-12T19:32:49.733539+0000, chain.objs.size()=1 2024-09-12T17:41:32.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.364+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.1RaSF3GS1EG3f5VjWJTigz7K7-LIlOl_0 2024-09-12T17:41:32.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.364+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10596908943629416519', time=2024-09-12T19:32:49.757366+0000, chain.objs.size()=1 2024-09-12T17:41:32.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.364+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.v5GdhtDaCSbqbbu4r0QzszkJdHD3nDa_0 2024-09-12T17:41:32.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.364+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7556289395428529377', time=2024-09-12T19:32:49.763392+0000, chain.objs.size()=1 2024-09-12T17:41:32.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.364+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.p7w9M2QX5-zxNoXT6t_KIMuihdcPZtg_0 2024-09-12T17:41:32.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.364+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14782165515755985780', time=2024-09-12T19:32:49.840573+0000, chain.objs.size()=1 2024-09-12T17:41:32.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.364+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.En-7QfEPSJN5RxbQqEysC1yUmk2R97i_0 2024-09-12T17:41:32.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.364+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6822550237674015242', time=2024-09-12T19:32:49.857076+0000, chain.objs.size()=1 2024-09-12T17:41:32.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.364+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.607388R6PpVZQghanjP80ro_UASTr_x_0 2024-09-12T17:41:32.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.364+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9783090329355301249', time=2024-09-12T19:32:49.907027+0000, chain.objs.size()=1 2024-09-12T17:41:32.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.364+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Dm59sNUVg3uNqw2s4YdPDd0znjbcn2u_0 2024-09-12T17:41:32.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.368+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13679289663969581449', time=2024-09-12T19:32:49.945098+0000, chain.objs.size()=1 2024-09-12T17:41:32.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.368+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.cr527c13nlgTb-ryWFYw8HsE3Ms4akI_0 2024-09-12T17:41:32.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.368+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5854915138198974440', time=2024-09-12T19:32:49.970134+0000, chain.objs.size()=1 2024-09-12T17:41:32.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.368+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.ijseXKpFLilFHEZG7rZsd8IeVP2vAV7_0 2024-09-12T17:41:32.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.368+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9749285266287295653', time=2024-09-12T19:32:49.971548+0000, chain.objs.size()=1 2024-09-12T17:41:32.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.368+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.eAr-boIe6Mn_vak-7z-2J3Ti0XmbRPr_0 2024-09-12T17:41:32.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.368+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11145063541047322141', time=2024-09-12T19:32:49.974341+0000, chain.objs.size()=1 2024-09-12T17:41:32.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.368+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Paq5CtWAXEXaQ_JZl33GB4kxxbcRvFq_0 2024-09-12T17:41:32.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.368+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10865650223407454642', time=2024-09-12T19:32:49.979503+0000, chain.objs.size()=1 2024-09-12T17:41:32.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.368+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.wDLKRX62mnVlEvoht4XQC3GeZPVjFd4_0 2024-09-12T17:41:32.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.368+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7003881486530665754', time=2024-09-12T19:32:49.989473+0000, chain.objs.size()=1 2024-09-12T17:41:32.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.368+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.ykPiiQ8oCpRV2uQzPS2__KLyhbpqPtl_0 2024-09-12T17:41:32.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.368+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1811146115879372902', time=2024-09-12T19:32:49.997961+0000, chain.objs.size()=1 2024-09-12T17:41:32.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.368+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Zn6iqUd5_QtFe6xo1UwgU8J8mF5Wucz_0 2024-09-12T17:41:32.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.368+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15521258430795173189', time=2024-09-12T19:32:50.134356+0000, chain.objs.size()=1 2024-09-12T17:41:32.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.368+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.qVTnUIE2rBfXz8SIL8foQjp6y7tagte_0 2024-09-12T17:41:32.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.368+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9259437438639869538', time=2024-09-12T19:32:50.167697+0000, chain.objs.size()=1 2024-09-12T17:41:32.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.368+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.GtixUxm_dFJH5dvWGQQzf-mHzQ63NHy_0 2024-09-12T17:41:32.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.368+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17682260837755661903', time=2024-09-12T19:32:50.251891+0000, chain.objs.size()=1 2024-09-12T17:41:32.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.368+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.tQzzv20PZPsUw_oKmpYXWN-ki7BdGCT_0 2024-09-12T17:41:32.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.368+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4429837039424059498', time=2024-09-12T19:32:50.265899+0000, chain.objs.size()=1 2024-09-12T17:41:32.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.368+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.cpWpd8jfiECpI-wymO4SmiMnd6W1vR-_0 2024-09-12T17:41:32.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.368+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7534044076042175632', time=2024-09-12T19:32:50.307681+0000, chain.objs.size()=1 2024-09-12T17:41:32.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.368+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.fI8Paj0X2P4v2k479PJB6UWnuPYxyjj_0 2024-09-12T17:41:32.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.368+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15715549859918971754', time=2024-09-12T19:32:50.318278+0000, chain.objs.size()=1 2024-09-12T17:41:32.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.368+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.l0l0JboXy2BC6PndfmLXWm-_jkYcJou_0 2024-09-12T17:41:32.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.368+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10220642455750626695', time=2024-09-12T19:32:50.482224+0000, chain.objs.size()=1 2024-09-12T17:41:32.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.368+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.0O7G7rsM4U5_98wFTxIyDmo_mP695dU_0 2024-09-12T17:41:32.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.368+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14669954777349052162', time=2024-09-12T19:32:50.611582+0000, chain.objs.size()=1 2024-09-12T17:41:32.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.368+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.C3OXWZe-dIYoC-mfwTLCAAdLXbMq7BI_0 2024-09-12T17:41:32.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.372+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/46394 2024-09-12T17:41:32.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.372+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=37, truncated=0, next_marker='' 2024-09-12T17:41:32.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.372+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5251168129978348963', time=2024-09-12T19:32:50.653738+0000, chain.objs.size()=1 2024-09-12T17:41:32.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.372+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.x0xLihgXUB5DudikKRuixL6drNhNXJ2_0 2024-09-12T17:41:32.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.372+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5446676775243994676', time=2024-09-12T19:32:50.835555+0000, chain.objs.size()=1 2024-09-12T17:41:32.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.372+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.9W4b6HBb_MJRfQ5hmzSEexnDd9sedLp_0 2024-09-12T17:41:32.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.372+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6196035045246707780', time=2024-09-12T19:32:50.872894+0000, chain.objs.size()=1 2024-09-12T17:41:32.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.372+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.t7aB6UuWxetnbMokLA-Ylr5uiBNgiN9_0 2024-09-12T17:41:32.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.372+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13415389949733139770', time=2024-09-12T19:32:50.885511+0000, chain.objs.size()=1 2024-09-12T17:41:32.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.372+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.5164ULLjfNwi6Ns0EkTM5vfG7Qpcryx_0 2024-09-12T17:41:32.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.372+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6745360732644213757', time=2024-09-12T19:32:50.904768+0000, chain.objs.size()=1 2024-09-12T17:41:32.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.372+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.fF3CEo5e1kfJltrBUOjM6D7UD5rbhSu_0 2024-09-12T17:41:32.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.372+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9546521582800814092', time=2024-09-12T19:32:50.906066+0000, chain.objs.size()=1 2024-09-12T17:41:32.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.372+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.7ovcQSQARfuWILZERCWJaTUY8akMQjE_0 2024-09-12T17:41:32.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.372+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5562951166480862341', time=2024-09-12T19:32:50.958150+0000, chain.objs.size()=1 2024-09-12T17:41:32.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.372+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.hlULK3Xxib5TOsdngIDWR3pN1g5sPvP_0 2024-09-12T17:41:32.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.372+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12801760425749762620', time=2024-09-12T19:32:51.279530+0000, chain.objs.size()=1 2024-09-12T17:41:32.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.372+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.swNWz9LsDl2wqi5ycwklVX6AxWfyqfT_0 2024-09-12T17:41:32.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.372+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9733934512138221729', time=2024-09-12T19:32:51.290257+0000, chain.objs.size()=1 2024-09-12T17:41:32.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.372+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.rvmR8BoCy9yWwotOJRibkE2JtgpTCfa_0 2024-09-12T17:41:32.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.372+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8450100677138921434', time=2024-09-12T19:32:51.308820+0000, chain.objs.size()=1 2024-09-12T17:41:32.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.372+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.zu5j8BMwcUVfSJvLhXhVmH34bgHuHGo_0 2024-09-12T17:41:32.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.372+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7575237595091677413', time=2024-09-12T19:32:51.310561+0000, chain.objs.size()=1 2024-09-12T17:41:32.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.372+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.hvP7XBIzewky4XwuiLJCHFiWxh3RiJu_0 2024-09-12T17:41:32.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.372+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4763439700593129338', time=2024-09-12T19:32:51.630148+0000, chain.objs.size()=1 2024-09-12T17:41:32.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.372+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.KEaDbjoQ3_MRlfBWbe-Sx1gMOHf9d0q_0 2024-09-12T17:41:32.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.376+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1408311450332084121', time=2024-09-12T19:32:51.704844+0000, chain.objs.size()=1 2024-09-12T17:41:32.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.376+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.sB0HV0HWiwB7cXxaK6jzqs6j2yUiBXE_0 2024-09-12T17:41:32.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.376+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18087959010472172092', time=2024-09-12T19:32:51.714368+0000, chain.objs.size()=1 2024-09-12T17:41:32.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.376+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.MnpCRq8WdTHEloKwoTLaJJ62MhZRMDS_0 2024-09-12T17:41:32.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.376+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.348602795066649294', time=2024-09-12T19:32:51.879257+0000, chain.objs.size()=1 2024-09-12T17:41:32.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.376+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.RpP0NvxBkK6McsLdRdQjehUTz2jJogL_0 2024-09-12T17:41:32.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.376+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11546905749997692013', time=2024-09-12T19:32:51.937940+0000, chain.objs.size()=1 2024-09-12T17:41:32.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.376+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.JYSB9QSUWkhDZObQU0palajVMXja4zK_0 2024-09-12T17:41:32.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.376+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6535338143288563689', time=2024-09-12T19:32:52.000605+0000, chain.objs.size()=1 2024-09-12T17:41:32.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.376+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.-pcCI0GACVw_JEqHAGzGFZ1mUySZTRE_0 2024-09-12T17:41:32.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.376+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7410523913048910008', time=2024-09-12T19:32:58.194734+0000, chain.objs.size()=1 2024-09-12T17:41:32.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.376+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.343__shadow_.LAMPWIquvhOY24BGTRXf-IEfCbuV93M_0 2024-09-12T17:41:32.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.376+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3291753330028655976', time=2024-09-12T19:33:13.987216+0000, chain.objs.size()=1 2024-09-12T17:41:32.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.376+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.390__shadow_.jjwODcoIiEjjamDN1sVHFBwoVvvHULn_0 2024-09-12T17:41:32.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.376+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.822165993632956769', time=2024-09-12T19:33:43.666316+0000, chain.objs.size()=1 2024-09-12T17:41:32.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.376+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.464__shadow_.OMk0Bm_uL3wfqSqUT9vlN1klmvof9Q0_0 2024-09-12T17:41:32.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.376+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17670381694184118103', time=2024-09-12T19:33:44.764116+0000, chain.objs.size()=1 2024-09-12T17:41:32.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.376+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.466__shadow_.JgCW6KJXz6fBWbmFkThg4eDkHnQEAw4_0 2024-09-12T17:41:32.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.376+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3776349561282975739', time=2024-09-12T19:33:57.709912+0000, chain.objs.size()=1 2024-09-12T17:41:32.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.376+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.503__shadow:5PZwxWS6kVU04L4agSYet4YqDKg.iTJ_.vEQTiH10KZ8H36ScYyTe7asHZOEv9fv_0 2024-09-12T17:41:32.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.376+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10163719563189667113', time=2024-09-12T19:34:05.371287+0000, chain.objs.size()=1 2024-09-12T17:41:32.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.376+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.517__shadow_.YSUrbRSUppuZWT2BGxoczm9pspaSAAb_0 2024-09-12T17:41:32.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.376+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9315427510691506827', time=2024-09-12T19:35:00.158490+0000, chain.objs.size()=1 2024-09-12T17:41:32.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.376+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.550__shadow_.e8w6FLajPPzCNCxJRXPCUzO-PIdrxwn_0 2024-09-12T17:41:32.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.376+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11322789035710645884', time=2024-09-12T19:35:00.600148+0000, chain.objs.size()=1 2024-09-12T17:41:32.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.376+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.551__shadow_.vIldq_Mzs4zWEqOgPpsMhqvZCl_ZetY_0 2024-09-12T17:41:32.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.376+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5939959493358688262', time=2024-09-12T19:35:02.705659+0000, chain.objs.size()=1 2024-09-12T17:41:32.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.376+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.554__shadow_.Nck_blcSFs7cnwDAu76WIZLFnAXViFi_0 2024-09-12T17:41:32.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.380+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5510306968855215220', time=2024-09-12T19:35:05.359847+0000, chain.objs.size()=1 2024-09-12T17:41:32.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.380+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.557__shadow_.i7lYI7dtbKaY1b6QDR33rvKcH71KGZv_0 2024-09-12T17:41:32.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.380+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10250851832107429186', time=2024-09-12T19:35:07.757069+0000, chain.objs.size()=1 2024-09-12T17:41:32.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.380+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.561__multipart_mymultipart.2~Y6TjVPY27GNrtuOiK7AUd-O9fBVdK2q.1 2024-09-12T17:41:32.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.380+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5417930652008439090', time=2024-09-12T19:35:19.105604+0000, chain.objs.size()=1 2024-09-12T17:41:32.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.380+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.569__shadow:cldth8.vTFGsdRAXUHwqJyohdirGiCL_.W0EpSthShVPOevRkan3cpD7lyGUZZRp_0 2024-09-12T17:41:32.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.380+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11049891365443094556', time=2024-09-12T19:35:28.897119+0000, chain.objs.size()=1 2024-09-12T17:41:32.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.380+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.574__shadow:bm9dhF01H3yGDA3dhBsiPxDyplPBVfZ_.vslQguhmK8GTU5LVibuJ8gAtT2HfJqL_0 2024-09-12T17:41:32.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.380+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11701315709833840425', time=2024-09-12T19:35:38.227065+0000, chain.objs.size()=1 2024-09-12T17:41:32.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.380+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.577__shadow:defflaVSE6rkwhxjX3jbjzAc96kZpJN_.tD-ravFamHGQfCyHGPiqmEwCAYHT9_X_0 2024-09-12T17:41:32.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.380+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8203280115611264747', time=2024-09-12T19:35:55.519665+0000, chain.objs.size()=1 2024-09-12T17:41:32.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.380+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.580__shadow:BFTAQ4IF8eJdkkNWZJ-bQMjdGNIHr0S_.cjZDqMRElJLlRbutnNcGae9WqGEup7R_0 2024-09-12T17:41:32.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.380+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7340338759922047063', time=2024-09-12T19:36:01.953019+0000, chain.objs.size()=1 2024-09-12T17:41:32.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.380+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.596__shadow_.Tc_NJzA0VYmqLDy82Hw_2PFq_3IIu6D_0 2024-09-12T17:41:32.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.380+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~2Tixzsng3JXtpgS4KZcvWfVOLOiE6DH', time=2024-09-12T19:38:23.340365+0000, chain.objs.size()=12 2024-09-12T17:41:32.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.380+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.625__multipart_multipart_enc.2~2Tixzsng3JXtpgS4KZcvWfVOLOiE6DH.1 2024-09-12T17:41:32.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.380+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.625__shadow_multipart_enc.2~2Tixzsng3JXtpgS4KZcvWfVOLOiE6DH.1_1 2024-09-12T17:41:32.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.380+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.625__multipart_multipart_enc.2~2Tixzsng3JXtpgS4KZcvWfVOLOiE6DH.2 2024-09-12T17:41:32.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.380+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.625__shadow_multipart_enc.2~2Tixzsng3JXtpgS4KZcvWfVOLOiE6DH.2_1 2024-09-12T17:41:32.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.380+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.625__multipart_multipart_enc.2~2Tixzsng3JXtpgS4KZcvWfVOLOiE6DH.3 2024-09-12T17:41:32.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.380+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.625__shadow_multipart_enc.2~2Tixzsng3JXtpgS4KZcvWfVOLOiE6DH.3_1 2024-09-12T17:41:32.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.380+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.625__multipart_multipart_enc.2~2Tixzsng3JXtpgS4KZcvWfVOLOiE6DH.4 2024-09-12T17:41:32.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.380+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.625__shadow_multipart_enc.2~2Tixzsng3JXtpgS4KZcvWfVOLOiE6DH.4_1 2024-09-12T17:41:32.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.380+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.625__multipart_multipart_enc.2~2Tixzsng3JXtpgS4KZcvWfVOLOiE6DH.5 2024-09-12T17:41:32.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.380+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.625__shadow_multipart_enc.2~2Tixzsng3JXtpgS4KZcvWfVOLOiE6DH.5_1 2024-09-12T17:41:32.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.380+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.625__multipart_multipart_enc.2~2Tixzsng3JXtpgS4KZcvWfVOLOiE6DH.6 2024-09-12T17:41:32.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.380+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.625__shadow_multipart_enc.2~2Tixzsng3JXtpgS4KZcvWfVOLOiE6DH.6_1 2024-09-12T17:41:32.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.384+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17331097590783768979', time=2024-09-12T19:38:41.446742+0000, chain.objs.size()=6 2024-09-12T17:41:32.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.384+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.660__multipart_bar.2~hC7FyiVrA4BqgQOHiJepYl1ESdQ2OEU.1 2024-09-12T17:41:32.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.384+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.660__multipart_bar.2~hC7FyiVrA4BqgQOHiJepYl1ESdQ2OEU.2 2024-09-12T17:41:32.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.384+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.660__multipart_bar.2~hC7FyiVrA4BqgQOHiJepYl1ESdQ2OEU.3 2024-09-12T17:41:32.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.384+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.660__multipart_bar.2~hC7FyiVrA4BqgQOHiJepYl1ESdQ2OEU.4 2024-09-12T17:41:32.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.384+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.660__multipart_bar.2~hC7FyiVrA4BqgQOHiJepYl1ESdQ2OEU.5 2024-09-12T17:41:32.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.384+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.660__multipart_bar.2~hC7FyiVrA4BqgQOHiJepYl1ESdQ2OEU.6 2024-09-12T17:41:32.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.384+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10792245198296180851', time=2024-09-12T19:38:44.668342+0000, chain.objs.size()=1 2024-09-12T17:41:32.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.384+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.668__shadow_.s8fwqLrHhZgwPJ307Oa0f80z875uZ61_0 2024-09-12T17:41:32.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.384+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18049201429104165354', time=2024-09-12T19:38:58.704075+0000, chain.objs.size()=1 2024-09-12T17:41:32.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.384+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.708__shadow:LYQp4USQag4hZSlFXhODGyEFKlWJhDI_.Ou7IekRheGHLzDVk3_m7qgmtpenyhL3_0 2024-09-12T17:41:32.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.388+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:41:32.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.392+0000 7fd765adf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:41:32.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.392+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:41:32.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.392+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:41:32.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.392+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43414' 2024-09-12T17:41:32.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.392+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='_tMNYvkbDtQ_dzwGw83Uxm6SausMVPwF', time=2024-09-12T19:29:45.426466+0000, chain.objs.size()=3 2024-09-12T17:41:32.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.392+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.160__shadow_.0iSsaBvdXUcQE7XUAywwCqsAS2jY10c_0 2024-09-12T17:41:32.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.392+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.160__shadow_.0iSsaBvdXUcQE7XUAywwCqsAS2jY10c_1 2024-09-12T17:41:32.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.392+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.160__shadow_.0iSsaBvdXUcQE7XUAywwCqsAS2jY10c_2 2024-09-12T17:41:32.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.392+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9133189612913537926', time=2024-09-12T19:31:12.960763+0000, chain.objs.size()=1 2024-09-12T17:41:32.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.392+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.236__shadow_.GR9hWvj-FSDnNCuq74w8AV8WO8bAlw4_0 2024-09-12T17:41:32.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.392+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1391637288291262652', time=2024-09-12T19:31:15.904295+0000, chain.objs.size()=1 2024-09-12T17:41:32.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.392+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.243__shadow_.n1tRlQzhtJwOhBLMYKlgEK698hm12b__0 2024-09-12T17:41:32.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.392+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1918304870207823777', time=2024-09-12T19:31:15.906045+0000, chain.objs.size()=1 2024-09-12T17:41:32.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.392+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.243__shadow_.R-v8CW9HqZ9aWLope5m8u_okc-cc0Ex_0 2024-09-12T17:41:32.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.392+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3044310616144710241', time=2024-09-12T19:31:16.779726+0000, chain.objs.size()=1 2024-09-12T17:41:32.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.392+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.245__shadow_.Wc_UjpV7kvF38fxR9dQzKfnXPR_VCkb_0 2024-09-12T17:41:32.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.392+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9507169798794930907', time=2024-09-12T19:31:18.315434+0000, chain.objs.size()=1 2024-09-12T17:41:32.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.392+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.249__shadow_.bLPjXtEB8i2lxXLhvrKKNmbUVVJhsje_0 2024-09-12T17:41:32.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.392+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15480851543309139373', time=2024-09-12T19:31:19.867901+0000, chain.objs.size()=1 2024-09-12T17:41:32.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.392+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.253__shadow_.f2KYAugIzltikj4hfBUDo78aNsgKfVh_0 2024-09-12T17:41:32.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.392+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13513501402765071962', time=2024-09-12T19:31:42.379763+0000, chain.objs.size()=1 2024-09-12T17:41:32.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.392+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.ai7XTi_sFqclyplBNFFdqcPEhOqqp2-_0 2024-09-12T17:41:32.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.392+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1704505001502648118', time=2024-09-12T19:31:42.404535+0000, chain.objs.size()=1 2024-09-12T17:41:32.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.392+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.v1pvIc2XCFW8zBIDBR5lmX63uUzlBel_0 2024-09-12T17:41:32.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.392+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.320742410540484429', time=2024-09-12T19:31:42.415257+0000, chain.objs.size()=1 2024-09-12T17:41:32.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.392+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.ungtRKJwnqxoeRyRgD4dqUFs11tr3eD_0 2024-09-12T17:41:32.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.396+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.89958087454033331', time=2024-09-12T19:31:42.460818+0000, chain.objs.size()=1 2024-09-12T17:41:32.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.396+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.wYtKWvn8kwZ_jR6bGLb-nn3iS0QaE_5_0 2024-09-12T17:41:32.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.396+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8321283815948035552', time=2024-09-12T19:31:42.564214+0000, chain.objs.size()=1 2024-09-12T17:41:32.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.396+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.8aWyQ62HaHOi8DMFz9qWRMQCOu44O0-_0 2024-09-12T17:41:32.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.396+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9336838880489394399', time=2024-09-12T19:31:42.614072+0000, chain.objs.size()=1 2024-09-12T17:41:32.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.396+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.fKLNTvziFbvXcxSoCgX-dq0JkLqXqJc_0 2024-09-12T17:41:32.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.396+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1738190852525506778', time=2024-09-12T19:31:42.639945+0000, chain.objs.size()=1 2024-09-12T17:41:32.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.396+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.1l_ZAXXqmNqeKmPymumU6GuOsV6pcVg_0 2024-09-12T17:41:32.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.396+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8134445467536865301', time=2024-09-12T19:31:42.686001+0000, chain.objs.size()=1 2024-09-12T17:41:32.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.396+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.H-HqPVB0ZULDJm2Z-ZED9fMLMcCXs5s_0 2024-09-12T17:41:32.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.396+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17953404180543049447', time=2024-09-12T19:31:42.715349+0000, chain.objs.size()=1 2024-09-12T17:41:32.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.396+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.E-yHcJg9FUHo3dRhYVZ3dKFoJ-fs8o3_0 2024-09-12T17:41:32.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.396+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8570555330480354658', time=2024-09-12T19:31:42.821239+0000, chain.objs.size()=1 2024-09-12T17:41:32.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.396+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.CEjc1_50fGom_A5L0IZ1JF8IWc4MXg5_0 2024-09-12T17:41:32.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.396+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4883498838038597675', time=2024-09-12T19:31:42.829091+0000, chain.objs.size()=1 2024-09-12T17:41:32.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.396+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.mHM5S9ApXoSgypJeSquHVlcW6wpm2ao_0 2024-09-12T17:41:32.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.396+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15501967277457147894', time=2024-09-12T19:31:42.940359+0000, chain.objs.size()=1 2024-09-12T17:41:32.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.396+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Tqlp1G88EBZJ-PHPfSYJBArUmY7ZDyq_0 2024-09-12T17:41:32.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.396+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8018569555746570857', time=2024-09-12T19:31:43.236057+0000, chain.objs.size()=1 2024-09-12T17:41:32.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.396+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.87PNB3vZY_1aOnzc3qIVKUvgCrX2YiN_0 2024-09-12T17:41:32.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.396+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6648391593085811720', time=2024-09-12T19:31:43.463855+0000, chain.objs.size()=1 2024-09-12T17:41:32.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.396+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.tjEidndsMRrnMp3FN4TiDACBbN9lxXL_0 2024-09-12T17:41:32.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.400+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3739880691407890917', time=2024-09-12T19:31:43.497719+0000, chain.objs.size()=1 2024-09-12T17:41:32.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.400+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.h3YTiAVXgQXK_xEhaQi3YAvCsroQE6G_0 2024-09-12T17:41:32.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.400+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8493291182629807799', time=2024-09-12T19:31:43.503518+0000, chain.objs.size()=1 2024-09-12T17:41:32.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.400+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.7IAVHuGsWjwGkPEmi1kVmW8qZqA8iij_0 2024-09-12T17:41:32.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.400+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.701237758459091202', time=2024-09-12T19:31:43.554733+0000, chain.objs.size()=1 2024-09-12T17:41:32.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.400+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.fnlGqMTtBNrxf_niWDt3lUTibwniJs9_0 2024-09-12T17:41:32.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.400+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14834230951272013524', time=2024-09-12T19:31:43.569796+0000, chain.objs.size()=1 2024-09-12T17:41:32.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.400+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.CoO1rayhPISlmwCrhhLRc1ks6Gtd_IT_0 2024-09-12T17:41:32.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.400+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12566988894406986110', time=2024-09-12T19:31:43.593521+0000, chain.objs.size()=1 2024-09-12T17:41:32.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.400+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.HkJMwaP2JQ21Hm3HVB_UQUxCPUPRqbH_0 2024-09-12T17:41:32.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.400+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11276342339707687537', time=2024-09-12T19:31:43.796126+0000, chain.objs.size()=1 2024-09-12T17:41:32.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.400+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.GNJf-w9q8ZrNWMXeNgttwxJW1i2zFVy_0 2024-09-12T17:41:32.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.400+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6215035744853430307', time=2024-09-12T19:31:43.827275+0000, chain.objs.size()=1 2024-09-12T17:41:32.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.400+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.q8jhNms8xQduHVADed3IAEuHkTRJz0Z_0 2024-09-12T17:41:32.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.400+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12215834465071936398', time=2024-09-12T19:31:43.934652+0000, chain.objs.size()=1 2024-09-12T17:41:32.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.400+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.NxYJjTvybv7cWJ78roCEXF3wzgaXN_k_0 2024-09-12T17:41:32.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.400+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11656405028562511141', time=2024-09-12T19:31:44.189717+0000, chain.objs.size()=1 2024-09-12T17:41:32.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.400+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.saSiTo01dgvxjfD-To0Xv5SR3802HG7_0 2024-09-12T17:41:32.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.400+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11535398778992188990', time=2024-09-12T19:31:44.210512+0000, chain.objs.size()=1 2024-09-12T17:41:32.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.400+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.azz4bnhBcxR3Jr0WLiWYvRaE0H1Gbbz_0 2024-09-12T17:41:32.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.400+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1344118572947119005', time=2024-09-12T19:31:44.455608+0000, chain.objs.size()=1 2024-09-12T17:41:32.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.400+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.OPE8DdVXkX_JkbqPPgMkWjo3S2KIq3m_0 2024-09-12T17:41:32.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.400+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6871860007051086685', time=2024-09-12T19:31:44.472639+0000, chain.objs.size()=1 2024-09-12T17:41:32.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.400+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.nTE_iI6aAUeNwH6OHRHHSaJOBgPs4yp_0 2024-09-12T17:41:32.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.400+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1994422875591532782', time=2024-09-12T19:31:44.517418+0000, chain.objs.size()=1 2024-09-12T17:41:32.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.400+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.pbOnjQ21XL6vbMPlAG77dm_ZYehEx6W_0 2024-09-12T17:41:32.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.400+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8652155818620907469', time=2024-09-12T19:31:44.524561+0000, chain.objs.size()=1 2024-09-12T17:41:32.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.400+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.lNX1lIk92MX6NS9VpuqcpLf8mkjhM6G_0 2024-09-12T17:41:32.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.404+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12942190153341006214', time=2024-09-12T19:31:44.539564+0000, chain.objs.size()=1 2024-09-12T17:41:32.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.404+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.WydJV00Tzt111TMMJuTkinpDwACTSF1_0 2024-09-12T17:41:32.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.404+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11026067671878693129', time=2024-09-12T19:31:45.468604+0000, chain.objs.size()=1 2024-09-12T17:41:32.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.404+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.265__shadow_.ZiUUOqTP21MctDbcBPWXFSEgoYuGEky_0 2024-09-12T17:41:32.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.404+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7691912016270462171', time=2024-09-12T19:31:47.305214+0000, chain.objs.size()=1 2024-09-12T17:41:32.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.404+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.270__shadow_.3unok-_cBUkbhG86AnuQd9MEO5j8RXe_0 2024-09-12T17:41:32.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.404+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9386642858440749250', time=2024-09-12T19:31:55.408998+0000, chain.objs.size()=1 2024-09-12T17:41:32.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.404+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.291__shadow_.YLA39Ch9W963Y-8RCJC6WlxGQ2ffvky_0 2024-09-12T17:41:32.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.404+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2501936336173991348', time=2024-09-12T19:31:56.468355+0000, chain.objs.size()=1 2024-09-12T17:41:32.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.404+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.292__shadow_.eMuoK8-Kju5InPFXv0wdXjO6DZVgB_q_0 2024-09-12T17:41:32.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.404+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.855355273831033721', time=2024-09-12T19:31:57.584256+0000, chain.objs.size()=1 2024-09-12T17:41:32.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.404+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.293__shadow_.Se-Gc7Zltj9HpNTgg3nn5oLkLXbRbZU_0 2024-09-12T17:41:32.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.404+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7646592989935461778', time=2024-09-12T19:31:57.619575+0000, chain.objs.size()=1 2024-09-12T17:41:32.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.404+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.293__shadow_.J9DDB-GOZuAUo3ffx9KJeKMxSObeW-E_0 2024-09-12T17:41:32.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.404+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5330276168962969230', time=2024-09-12T19:31:59.121314+0000, chain.objs.size()=1 2024-09-12T17:41:32.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.404+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.297__shadow_.Dt1Fjs3UUgmZLLnIFW-m134IUdETHCu_0 2024-09-12T17:41:32.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.404+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4217696488484022803', time=2024-09-12T19:32:05.290896+0000, chain.objs.size()=1 2024-09-12T17:41:32.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.404+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.313__shadow_.R8RH3tNwOGyVdwUfjJQi30Rpwyorn7F_0 2024-09-12T17:41:32.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.404+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4658634368388767434', time=2024-09-12T19:32:27.856957+0000, chain.objs.size()=1 2024-09-12T17:41:32.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.404+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.t-cqSzqOOU7Us_i91PkBbGoqGY-rZfj_0 2024-09-12T17:41:32.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.404+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17810784627412226422', time=2024-09-12T19:32:27.860710+0000, chain.objs.size()=1 2024-09-12T17:41:32.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.404+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.fqAOHeKIRYK50RZrX1--CdQuRfGDf7M_0 2024-09-12T17:41:32.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.404+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4493640033806747946', time=2024-09-12T19:32:27.868336+0000, chain.objs.size()=1 2024-09-12T17:41:32.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.404+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.IaI8TSyR_4s1yaAw65e7x3EDrBqU0bc_0 2024-09-12T17:41:32.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.404+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11550376383462516022', time=2024-09-12T19:32:27.871291+0000, chain.objs.size()=1 2024-09-12T17:41:32.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.404+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.9HMoM5ZWHZ8mw0CR4JGEEpaH6h-NGQm_0 2024-09-12T17:41:32.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.404+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6065138849562066576', time=2024-09-12T19:32:27.983116+0000, chain.objs.size()=1 2024-09-12T17:41:32.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.404+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.cgB0uFs-j4Lohj8Ybzvhw6Zo3iup4hr_0 2024-09-12T17:41:32.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.404+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10817711860704755747', time=2024-09-12T19:32:28.076697+0000, chain.objs.size()=1 2024-09-12T17:41:32.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.404+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.rvpa7t5O9xX1PsP-js7GHj-A9090szU_0 2024-09-12T17:41:32.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.404+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4636880671986134879', time=2024-09-12T19:32:28.205149+0000, chain.objs.size()=1 2024-09-12T17:41:32.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.404+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.nSI_mGqPTwETvRp_PYXS_P3Wy0lKUXP_0 2024-09-12T17:41:32.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.404+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6408614607556867618', time=2024-09-12T19:32:28.284798+0000, chain.objs.size()=1 2024-09-12T17:41:32.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.404+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.pTT8115MU4BiooTInil_9cBhKm64Dnx_0 2024-09-12T17:41:32.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.404+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6541928025456555970', time=2024-09-12T19:32:28.314237+0000, chain.objs.size()=1 2024-09-12T17:41:32.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.404+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.5fCLu3O3cpKwyOjV6QLy766RUvFBNZr_0 2024-09-12T17:41:32.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.404+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6683575581227275817', time=2024-09-12T19:32:28.317804+0000, chain.objs.size()=1 2024-09-12T17:41:32.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.404+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.aUtB50bzCrDxc5yNN554TK1JnDZ9QQB_0 2024-09-12T17:41:32.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.404+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8537909518221952028', time=2024-09-12T19:32:28.326782+0000, chain.objs.size()=1 2024-09-12T17:41:32.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.404+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.kc8g6Ir7neLLeBOmfOtND-oZuaZZ7be_0 2024-09-12T17:41:32.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.408+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18091440265474236639', time=2024-09-12T19:32:28.387656+0000, chain.objs.size()=1 2024-09-12T17:41:32.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.408+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.yC5wiUo6Sk0d35WOtKViwTdO18J_nyP_0 2024-09-12T17:41:32.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.408+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.91076894387604948', time=2024-09-12T19:32:28.404172+0000, chain.objs.size()=1 2024-09-12T17:41:32.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.408+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.uEFUVBgtv0Do10dOJsZzJTFmhdCbTuN_0 2024-09-12T17:41:32.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.408+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11627437506620236261', time=2024-09-12T19:32:28.475487+0000, chain.objs.size()=1 2024-09-12T17:41:32.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.408+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.ILDPqrLbYGU1GCwOo7MnUVPOnZKC3Tp_0 2024-09-12T17:41:32.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.408+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9174835999006102412', time=2024-09-12T19:32:28.484372+0000, chain.objs.size()=1 2024-09-12T17:41:32.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.408+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_._knF66ZiHSfbQBHN_hKW8kPHk2W26Sk_0 2024-09-12T17:41:32.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.408+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16923246868840559339', time=2024-09-12T19:32:28.493177+0000, chain.objs.size()=1 2024-09-12T17:41:32.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.408+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.ovXwT1jcJ1pUJlwPksnu8oyHUsuw1TI_0 2024-09-12T17:41:32.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.408+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.115887216232695842', time=2024-09-12T19:32:28.541923+0000, chain.objs.size()=1 2024-09-12T17:41:32.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.408+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.czKfeOpOz45VCe_uhxcVO1zmjEINBGx_0 2024-09-12T17:41:32.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.408+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9622173541931197137', time=2024-09-12T19:32:28.549208+0000, chain.objs.size()=1 2024-09-12T17:41:32.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.408+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.4allaqVfxpGLfBQm9fVYFpOByO5uV-D_0 2024-09-12T17:41:32.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.408+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9191835425760552973', time=2024-09-12T19:32:28.849376+0000, chain.objs.size()=1 2024-09-12T17:41:32.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.408+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.J_3bElQJinhCnuKuSTrC5otzkR_cLBd_0 2024-09-12T17:41:32.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.408+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16674935360025797053', time=2024-09-12T19:32:29.137416+0000, chain.objs.size()=1 2024-09-12T17:41:32.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.408+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.pyE-rR1_adx3E2Jee7MwJdw0bkSiaG4_0 2024-09-12T17:41:32.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.408+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10470817297021063398', time=2024-09-12T19:32:29.138499+0000, chain.objs.size()=1 2024-09-12T17:41:32.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.408+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Y4FWua0-nEb_IWr-NaxfvLdIw-CYYOQ_0 2024-09-12T17:41:32.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.408+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11789682325504563227', time=2024-09-12T19:32:29.171360+0000, chain.objs.size()=1 2024-09-12T17:41:32.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.408+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.cXZcUfi8nxKQ_SZm3ChPmvMNqtDwJyz_0 2024-09-12T17:41:32.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.408+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10630728989808099502', time=2024-09-12T19:32:29.181722+0000, chain.objs.size()=1 2024-09-12T17:41:32.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.408+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.nry79dA0VifmFtov4vdFcgTGwBhtG7G_0 2024-09-12T17:41:32.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.408+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3450759230747071245', time=2024-09-12T19:32:29.196673+0000, chain.objs.size()=1 2024-09-12T17:41:32.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.408+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.-n95h0OyjdiS-_WQ7cFKu6Zo7BYhRNY_0 2024-09-12T17:41:32.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.408+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1074707412615240715', time=2024-09-12T19:32:29.528156+0000, chain.objs.size()=1 2024-09-12T17:41:32.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.408+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.APODfe_gFqYGuZ5qsLZZxCSHiIlLRrS_0 2024-09-12T17:41:32.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.408+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14758947984259500363', time=2024-09-12T19:32:29.725137+0000, chain.objs.size()=1 2024-09-12T17:41:32.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.408+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.6hWiiJeLjiZ_puJajVjBLTDLbWtC938_0 2024-09-12T17:41:32.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.408+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10233975274591413826', time=2024-09-12T19:32:29.807456+0000, chain.objs.size()=1 2024-09-12T17:41:32.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.408+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.sWOfgH82FWzZ3YYOKRt-Yaij9RyXzBx_0 2024-09-12T17:41:32.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.408+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13005961772742093138', time=2024-09-12T19:32:29.848258+0000, chain.objs.size()=1 2024-09-12T17:41:32.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.408+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.5PgWmU7pojjxAO90pripHx2xzd-eRUi_0 2024-09-12T17:41:32.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.412+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7036384668251464677', time=2024-09-12T19:32:29.853579+0000, chain.objs.size()=1 2024-09-12T17:41:32.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.412+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.GbT0ZKt1ou-k2Jk38QxOGx9OF5qpMkk_0 2024-09-12T17:41:32.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.412+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13555937242236699655', time=2024-09-12T19:32:29.867629+0000, chain.objs.size()=1 2024-09-12T17:41:32.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.412+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.P7UPY1Hq7xtNZlVTQRLNbzk3zwzM4FE_0 2024-09-12T17:41:32.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.412+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5075539742522529570', time=2024-09-12T19:32:29.985814+0000, chain.objs.size()=1 2024-09-12T17:41:32.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.412+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.jFzyeDzgdJPS-mUBoCBEYlx7dwwywTW_0 2024-09-12T17:41:32.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.412+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.686616495181448625', time=2024-09-12T19:32:30.019610+0000, chain.objs.size()=1 2024-09-12T17:41:32.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.412+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.6UcTswriy6LI66OhCUZojWNHxeqmdoj_0 2024-09-12T17:41:32.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.412+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1532298587298888207', time=2024-09-12T19:32:30.043199+0000, chain.objs.size()=1 2024-09-12T17:41:32.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.412+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.eGwUr3IRQ_jrRCZmMB9U-mBP4woIHVC_0 2024-09-12T17:41:32.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.412+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12460386415710928055', time=2024-09-12T19:32:30.135107+0000, chain.objs.size()=1 2024-09-12T17:41:32.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.412+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.rYiyYOBV8SAkQi9y0J_xUhhX5Y2U7cT_0 2024-09-12T17:41:32.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.412+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8508772077453833976', time=2024-09-12T19:32:30.155156+0000, chain.objs.size()=1 2024-09-12T17:41:32.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.412+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Z55rn0-pkWf1va0pqjhYQ0wbFBQ-j_y_0 2024-09-12T17:41:32.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.412+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16928273123716131495', time=2024-09-12T19:32:49.659449+0000, chain.objs.size()=1 2024-09-12T17:41:32.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.412+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.iDGR-weiQh1_ZBVWmZRq9KySh_TCVW5_0 2024-09-12T17:41:32.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.412+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16368185849835372883', time=2024-09-12T19:32:49.722580+0000, chain.objs.size()=1 2024-09-12T17:41:32.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.412+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.khkwXO-L945HcUvcf1k2hPskXDVY78-_0 2024-09-12T17:41:32.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.412+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2079940718093659015', time=2024-09-12T19:32:49.735154+0000, chain.objs.size()=1 2024-09-12T17:41:32.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.412+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.FRMY0_cxws3bYedzVogD76xj_9gyT4E_0 2024-09-12T17:41:32.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.412+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8921973717686101218', time=2024-09-12T19:32:49.753648+0000, chain.objs.size()=1 2024-09-12T17:41:32.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.412+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_._975lzRHR475w5tjmL24W_AfazkAxe0_0 2024-09-12T17:41:32.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.412+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12912782522655876708', time=2024-09-12T19:32:49.840926+0000, chain.objs.size()=1 2024-09-12T17:41:32.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.412+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.2QeGApEcT0T9yyMiEJF4Hzyv-msJdNo_0 2024-09-12T17:41:32.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.412+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9677916294945647422', time=2024-09-12T19:32:49.863498+0000, chain.objs.size()=1 2024-09-12T17:41:32.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.412+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.r-vqpDwV68SERW_TvIXc4wMbAP2qlRw_0 2024-09-12T17:41:32.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.412+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10170715144700755601', time=2024-09-12T19:32:49.865127+0000, chain.objs.size()=1 2024-09-12T17:41:32.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.412+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.OEzc4IsNNnZRmdyr864HGsd1uRZs2-z_0 2024-09-12T17:41:32.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.412+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9376190149095168864', time=2024-09-12T19:32:49.921547+0000, chain.objs.size()=1 2024-09-12T17:41:32.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.412+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.MA4zhWngNhaCR2RVBMTGXzL_lqoNxVG_0 2024-09-12T17:41:32.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.412+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12896113121623576346', time=2024-09-12T19:32:49.932447+0000, chain.objs.size()=1 2024-09-12T17:41:32.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.412+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.khv9-OV2ISREpA3i6bvqMJBojXl0-zy_0 2024-09-12T17:41:32.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.416+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10818475836138461368', time=2024-09-12T19:32:49.980406+0000, chain.objs.size()=1 2024-09-12T17:41:32.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.416+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.hXZP9mWgnHwWEV-myeW82neSXHvWa3R_0 2024-09-12T17:41:32.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.416+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5449813553993360787', time=2024-09-12T19:32:49.992093+0000, chain.objs.size()=1 2024-09-12T17:41:32.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.416+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.bh_oAq52OzbV-Y_61cOOQZs_rljxPzP_0 2024-09-12T17:41:32.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.416+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17158193728562820128', time=2024-09-12T19:32:50.122891+0000, chain.objs.size()=1 2024-09-12T17:41:32.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.416+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.vwNp129XjvzzYGHHaxNQOSKDb0pv1L5_0 2024-09-12T17:41:32.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.416+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16564910789965154601', time=2024-09-12T19:32:50.188380+0000, chain.objs.size()=1 2024-09-12T17:41:32.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.416+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.bTpTBFx4D4WAsRcmWJ2iQ5bfZVegB3U_0 2024-09-12T17:41:32.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.416+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4882023571799816688', time=2024-09-12T19:32:50.300828+0000, chain.objs.size()=1 2024-09-12T17:41:32.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.416+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.m64QfdvswS7z2T-InzffntYP9-hKnwX_0 2024-09-12T17:41:32.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.416+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3140907327584517594', time=2024-09-12T19:32:50.467826+0000, chain.objs.size()=1 2024-09-12T17:41:32.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.416+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.oO7uv9UTS5Q-L89FbXccxVXzRYUV7b6_0 2024-09-12T17:41:32.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.416+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11389444666615262654', time=2024-09-12T19:32:50.531334+0000, chain.objs.size()=1 2024-09-12T17:41:32.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.416+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.YWFc77dcQF6fOibZ9lWibphYmY5tb2U_0 2024-09-12T17:41:32.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.416+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11998222950567502595', time=2024-09-12T19:32:50.557682+0000, chain.objs.size()=1 2024-09-12T17:41:32.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.416+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.16875Vq2PuqIpRRj7q_oWHNtspCFOKQ_0 2024-09-12T17:41:32.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.416+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18394563514989491537', time=2024-09-12T19:32:50.638725+0000, chain.objs.size()=1 2024-09-12T17:41:32.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.416+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.hufpek5ymg_uWgSHKWb-0NmqrU2BUDC_0 2024-09-12T17:41:32.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.416+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16870367794795349896', time=2024-09-12T19:32:50.878183+0000, chain.objs.size()=1 2024-09-12T17:41:32.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.416+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.VLvhqd_VM6xdtL7WGOUiUgmHuIRWFFo_0 2024-09-12T17:41:32.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.416+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15696563273685226343', time=2024-09-12T19:32:51.156250+0000, chain.objs.size()=1 2024-09-12T17:41:32.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.416+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.WsjEygQRjKlkfhRvVwuiuxJWtS0-g9c_0 2024-09-12T17:41:32.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.416+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17146256836556594705', time=2024-09-12T19:32:51.169461+0000, chain.objs.size()=1 2024-09-12T17:41:32.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.416+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.OdOU2UqnJUo2Arfss57_4jsg9dMPDJu_0 2024-09-12T17:41:32.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.420+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/43414 2024-09-12T17:41:32.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.420+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-12T17:41:32.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.420+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16298080068325269624', time=2024-09-12T19:32:51.172896+0000, chain.objs.size()=1 2024-09-12T17:41:32.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.420+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.8NQ6T2HALANQyHxmGk3pp6_T-ANS5eI_0 2024-09-12T17:41:32.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.420+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1654779959225460994', time=2024-09-12T19:32:51.228838+0000, chain.objs.size()=1 2024-09-12T17:41:32.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.420+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Oz5l_geSkjMt0hmkq3OWt09pkcMwbBh_0 2024-09-12T17:41:32.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.420+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5613289970830068642', time=2024-09-12T19:32:51.297395+0000, chain.objs.size()=1 2024-09-12T17:41:32.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.420+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.dUDTd3PjSy-a0pXdZwPNTxiwrehVNtn_0 2024-09-12T17:41:32.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.420+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9278473402351530778', time=2024-09-12T19:32:51.319511+0000, chain.objs.size()=1 2024-09-12T17:41:32.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.420+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.KXbxI0o4hTgDPmJv8HNmTzQbr7i01jM_0 2024-09-12T17:41:32.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.420+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.726010544143747303', time=2024-09-12T19:32:51.353234+0000, chain.objs.size()=1 2024-09-12T17:41:32.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.420+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.XSxFsChA_cF1AFyIpCjIyew9Dhz0Ff9_0 2024-09-12T17:41:32.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.420+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9142040892516190416', time=2024-09-12T19:32:51.518818+0000, chain.objs.size()=1 2024-09-12T17:41:32.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.420+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Xo3l_tOnEp7eDKOfz7mkc92LOCkxkDL_0 2024-09-12T17:41:32.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.420+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14332033228626208320', time=2024-09-12T19:32:51.539489+0000, chain.objs.size()=1 2024-09-12T17:41:32.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.420+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.OSNIPKhi_bWytkrXQVbgVQf31V6ylKP_0 2024-09-12T17:41:32.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.420+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9255218107059579356', time=2024-09-12T19:32:51.702850+0000, chain.objs.size()=1 2024-09-12T17:41:32.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.420+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.JVP_3ozgDYOqeJAcQDKcCR_fhrpestN_0 2024-09-12T17:41:32.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.420+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15699073035989794167', time=2024-09-12T19:32:51.838332+0000, chain.objs.size()=1 2024-09-12T17:41:32.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.420+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_._cl067NAy50kmxwSpImRbXf2sMwwPfP_0 2024-09-12T17:41:32.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.420+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9056017917104993170', time=2024-09-12T19:32:51.940533+0000, chain.objs.size()=1 2024-09-12T17:41:32.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.420+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Od10YY5XKJBoKzUHqAmQJlBqhqoqeC5_0 2024-09-12T17:41:32.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.420+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14822345343724106194', time=2024-09-12T19:32:51.962122+0000, chain.objs.size()=1 2024-09-12T17:41:32.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.420+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.V-xRq1zNj0W39fJF04710JSMtPh-lZB_0 2024-09-12T17:41:32.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.420+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4731572185448936580', time=2024-09-12T19:32:52.012758+0000, chain.objs.size()=1 2024-09-12T17:41:32.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.420+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.x1mbN5oFeww2ZsV8Ah-BAuuLBRCIJID_0 2024-09-12T17:41:32.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.424+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17626349190273084527', time=2024-09-12T19:32:57.569220+0000, chain.objs.size()=1 2024-09-12T17:41:32.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.424+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.341__shadow_.Nl5cCUJlQxTuQtc82_mP0Op3IFNtKX1_0 2024-09-12T17:41:32.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.424+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10518743831291250363', time=2024-09-12T19:33:39.059517+0000, chain.objs.size()=1 2024-09-12T17:41:32.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.424+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.456__shadow_.qi1s9y9P4QQqsYZX-XPla1k-4P5Rnng_0 2024-09-12T17:41:32.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.424+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.146630622264681720', time=2024-09-12T19:33:49.235018+0000, chain.objs.size()=1 2024-09-12T17:41:32.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.424+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.483__shadow_.2wADAIkbninQLVV-v87um3zJj6Aoqja_0 2024-09-12T17:41:32.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.424+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4422152591307609064', time=2024-09-12T19:34:07.293986+0000, chain.objs.size()=6 2024-09-12T17:41:32.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.424+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.519__multipart_mymultipart.2~zhq5J6qVfh91ATEFXfalajGoPj-N_ba.1 2024-09-12T17:41:32.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.424+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.519__multipart_mymultipart.2~zhq5J6qVfh91ATEFXfalajGoPj-N_ba.2 2024-09-12T17:41:32.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.424+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.519__multipart_mymultipart.2~zhq5J6qVfh91ATEFXfalajGoPj-N_ba.3 2024-09-12T17:41:32.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.424+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.519__multipart_mymultipart.2~zhq5J6qVfh91ATEFXfalajGoPj-N_ba.4 2024-09-12T17:41:32.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.424+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.519__multipart_mymultipart.2~zhq5J6qVfh91ATEFXfalajGoPj-N_ba.5 2024-09-12T17:41:32.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.424+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.519__multipart_mymultipart.2~zhq5J6qVfh91ATEFXfalajGoPj-N_ba.6 2024-09-12T17:41:32.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.424+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4331199373618592839', time=2024-09-12T19:35:18.213078+0000, chain.objs.size()=1 2024-09-12T17:41:32.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.424+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.569__shadow:8wP4Z-9DWbB62mKPOxLAXhniI8k3TTO_.TfHaBbUiwLr20RC5ClkyyzGwZqpfWgp_0 2024-09-12T17:41:32.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.424+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9029952855842656665', time=2024-09-12T19:35:32.720759+0000, chain.objs.size()=1 2024-09-12T17:41:32.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.424+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.576__shadow:N8pWL-auqQ2YbcDN1mGghhmo9iXaY-s_.eOiA2lvtqqkfCCPnm1JBER-QuuesaVl_0 2024-09-12T17:41:32.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.424+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11843247674122071039', time=2024-09-12T19:35:44.394096+0000, chain.objs.size()=1 2024-09-12T17:41:32.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.424+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.577__shadow:o7FxFucgf4qaBSgzSP6NfkfuO7Hzxmw_.fHTfKqF6KF45WUTRBPP1jJ4wkRrgQhg_0 2024-09-12T17:41:32.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.424+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3066160778267691556', time=2024-09-12T19:35:45.768474+0000, chain.objs.size()=1 2024-09-12T17:41:32.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.424+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.577__shadow:rFxjIyWwMfmhkJJ03-ClyzPpZp0KoBV_.Wt9_UYPGzfLGVpDoZsUjtWf12AxDUkL_0 2024-09-12T17:41:32.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.424+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12666067815720549297', time=2024-09-12T19:38:42.770735+0000, chain.objs.size()=1 2024-09-12T17:41:32.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.424+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.664__shadow_.xirg8DKHqkn7qImLnp1kPg0dsiiIMbk_0 2024-09-12T17:41:32.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.424+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16845686018032408288', time=2024-09-12T19:38:55.279798+0000, chain.objs.size()=1 2024-09-12T17:41:32.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.424+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.700__shadow:Rca-juzeD4yK8pKPVWNrQDNRqQbOC6d_.rhEoKY694wkXyJEf01WgOs9VB_AEOi8_0 2024-09-12T17:41:32.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.428+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:41:32.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.428+0000 7fd765adf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:41:32.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.432+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:41:32.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.432+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:41:32.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.432+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/54264' 2024-09-12T17:41:32.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.432+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='__PVzgGs7DyPwlkOcgti8joRLpLza5jb', time=2024-09-12T19:29:50.058153+0000, chain.objs.size()=3 2024-09-12T17:41:32.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.432+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.165__shadow_.UPLJR-4Jhj10bQU14kUrVJ2LBz5-7Xm_0 2024-09-12T17:41:32.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.432+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.165__shadow_.UPLJR-4Jhj10bQU14kUrVJ2LBz5-7Xm_1 2024-09-12T17:41:32.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.432+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.165__shadow_.UPLJR-4Jhj10bQU14kUrVJ2LBz5-7Xm_2 2024-09-12T17:41:32.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.432+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6725331571447977323', time=2024-09-12T19:31:15.911531+0000, chain.objs.size()=1 2024-09-12T17:41:32.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.432+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.243__shadow_.OVF2TVah43TISLlLesoORPCdSbPxGOg_0 2024-09-12T17:41:32.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.432+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9230419952952055160', time=2024-09-12T19:31:18.316338+0000, chain.objs.size()=1 2024-09-12T17:41:32.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.432+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.249__shadow_.Od9xwm5mManikIcuCa3f6d6olfau8Gw_0 2024-09-12T17:41:32.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.432+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11666826079456396595', time=2024-09-12T19:31:21.003786+0000, chain.objs.size()=1 2024-09-12T17:41:32.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.432+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.256__shadow_.QAOhgMV1SEl_Au0JSmghtkieQke4zT9_0 2024-09-12T17:41:32.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.432+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8731957921161985942', time=2024-09-12T19:31:42.300635+0000, chain.objs.size()=1 2024-09-12T17:41:32.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.432+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.uj2xHqCCeE3RuN_g8q7KaZUw92xifkI_0 2024-09-12T17:41:32.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.432+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8633963766752297063', time=2024-09-12T19:31:42.304020+0000, chain.objs.size()=1 2024-09-12T17:41:32.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.432+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Q92tlJKYnpeI6XxE2cDtkhPemVlkk56_0 2024-09-12T17:41:32.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.432+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2425571518563185441', time=2024-09-12T19:31:42.356028+0000, chain.objs.size()=1 2024-09-12T17:41:32.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.432+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.wH-ncUsAgiiY5HT7QOR4yXGQI-EImNs_0 2024-09-12T17:41:32.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.432+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11920024094554718450', time=2024-09-12T19:31:42.416955+0000, chain.objs.size()=1 2024-09-12T17:41:32.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.432+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.ROtAgK3V6bNj-U_eWd-lM7PhKZnGViy_0 2024-09-12T17:41:32.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.432+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15889110968948578967', time=2024-09-12T19:31:42.423821+0000, chain.objs.size()=1 2024-09-12T17:41:32.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.432+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.1Mt28fiY61COMAZ7KZPEWZ8BF9N6C5k_0 2024-09-12T17:41:32.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.432+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10492265260226670090', time=2024-09-12T19:31:42.437995+0000, chain.objs.size()=1 2024-09-12T17:41:32.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.432+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.6FUCmE4yN-mmpWa-19MlrDzGqLHNv5E_0 2024-09-12T17:41:32.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.436+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12872845254863956256', time=2024-09-12T19:31:42.538212+0000, chain.objs.size()=1 2024-09-12T17:41:32.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.436+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.EydpvnoaQ-xg2yyQxTwBdrPPP-2skqp_0 2024-09-12T17:41:32.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.436+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6858315887050710266', time=2024-09-12T19:31:42.558526+0000, chain.objs.size()=1 2024-09-12T17:41:32.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.436+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Y4D56MDx3A16kUYrzMRtzgdxC8-G2Z8_0 2024-09-12T17:41:32.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.436+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5832640009358832602', time=2024-09-12T19:31:42.624360+0000, chain.objs.size()=1 2024-09-12T17:41:32.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.436+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.1AHSTkeakeyfh9nNBKeMgPamEiryju-_0 2024-09-12T17:41:32.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.436+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.320674306858618440', time=2024-09-12T19:31:42.704398+0000, chain.objs.size()=1 2024-09-12T17:41:32.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.436+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.0J64ScK01ZMJbdC3u4z1-oKkX9G-ZGV_0 2024-09-12T17:41:32.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.436+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9995749132284693140', time=2024-09-12T19:31:42.707124+0000, chain.objs.size()=1 2024-09-12T17:41:32.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.436+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.P2TUS1ZubClP_6EYHzXWwZfOfMb2dtD_0 2024-09-12T17:41:32.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.436+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10863000841360918217', time=2024-09-12T19:31:42.818423+0000, chain.objs.size()=1 2024-09-12T17:41:32.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.436+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Dtxp5IxNDLrg6sN6Rj2QD28j1DDEHkM_0 2024-09-12T17:41:32.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.436+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5648498824879278026', time=2024-09-12T19:31:42.826586+0000, chain.objs.size()=1 2024-09-12T17:41:32.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.436+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.vo8Qz6oz753T09Oo-p0i-QitWPQPd_o_0 2024-09-12T17:41:32.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.436+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.176479961580520143', time=2024-09-12T19:31:42.847151+0000, chain.objs.size()=1 2024-09-12T17:41:32.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.436+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Xzjd9WKbwVfBaoN9Zgi2i0F3SXPL5p9_0 2024-09-12T17:41:32.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.436+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8508769478978285846', time=2024-09-12T19:31:43.114384+0000, chain.objs.size()=1 2024-09-12T17:41:32.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.436+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.4US9nnkRFs3BjiPk9auIuEMCl1qneVl_0 2024-09-12T17:41:32.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.436+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17561599268450581223', time=2024-09-12T19:31:43.164291+0000, chain.objs.size()=1 2024-09-12T17:41:32.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.436+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.TdUa2dkh6CqMXeQPqTmV-twuSen2Bwv_0 2024-09-12T17:41:32.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.436+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11517069312864592020', time=2024-09-12T19:31:43.175839+0000, chain.objs.size()=1 2024-09-12T17:41:32.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.436+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Azge4jXKY8IBXAz9Xr6By1ui0pcRz5h_0 2024-09-12T17:41:32.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.436+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2633286884971991927', time=2024-09-12T19:31:43.201110+0000, chain.objs.size()=1 2024-09-12T17:41:32.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.436+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.-fw3rUPKENY_oCpv9RAbqwipNKdmB78_0 2024-09-12T17:41:32.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.436+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12798047947226406304', time=2024-09-12T19:31:43.259414+0000, chain.objs.size()=1 2024-09-12T17:41:32.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.436+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.0DMkfxljdEI4MZ5BB-0scK8TzwVZobU_0 2024-09-12T17:41:32.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.436+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5434167125539399658', time=2024-09-12T19:31:43.267083+0000, chain.objs.size()=1 2024-09-12T17:41:32.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.436+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.6CZpHdEecoADFnxDqczJMW2c6I6uPsm_0 2024-09-12T17:41:32.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.436+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6622894403958297429', time=2024-09-12T19:31:43.272738+0000, chain.objs.size()=1 2024-09-12T17:41:32.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.436+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.8BEwgRcjWjMcUYSIsP1aKTunjcMzOXA_0 2024-09-12T17:41:32.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.440+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4127034624328982347', time=2024-09-12T19:31:43.278433+0000, chain.objs.size()=1 2024-09-12T17:41:32.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.440+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.VOgDPx6ea72sSPaR3EijnphIWZkmyIg_0 2024-09-12T17:41:32.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.440+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17852569475743998536', time=2024-09-12T19:31:43.401182+0000, chain.objs.size()=1 2024-09-12T17:41:32.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.440+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Y1RXtUWYmT8uLNMGuZQ8c8h0nb31mIZ_0 2024-09-12T17:41:32.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.440+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6236718328926045414', time=2024-09-12T19:31:43.418996+0000, chain.objs.size()=1 2024-09-12T17:41:32.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.440+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.uHR6ymwZjG_PZiEjUFoM72_wDEY8mTW_0 2024-09-12T17:41:32.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.440+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13731754358474846853', time=2024-09-12T19:31:43.534809+0000, chain.objs.size()=1 2024-09-12T17:41:32.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.440+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.oFZ7w17YyXTg0T2GGD7Rinuog606jVe_0 2024-09-12T17:41:32.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.440+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8707368474033503810', time=2024-09-12T19:31:43.545913+0000, chain.objs.size()=1 2024-09-12T17:41:32.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.440+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.ZHD2vOn3q_goAMYdjees730e4ZAw5R6_0 2024-09-12T17:41:32.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.440+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17557551955951577247', time=2024-09-12T19:31:43.577651+0000, chain.objs.size()=1 2024-09-12T17:41:32.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.440+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.4GsPtlzSwlrp-Diy64ZbXv_Tn5xtq2l_0 2024-09-12T17:41:32.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.440+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.114549808785495190', time=2024-09-12T19:31:43.587840+0000, chain.objs.size()=1 2024-09-12T17:41:32.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.440+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.i68av0Rq2Dq36xcmEFUcSL_eBn5n_j6_0 2024-09-12T17:41:32.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.440+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18274750294263414395', time=2024-09-12T19:31:43.608946+0000, chain.objs.size()=1 2024-09-12T17:41:32.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.440+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.cUFzx-zZoI_DB5iFaRheEov7DrU3I3a_0 2024-09-12T17:41:32.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.440+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2430646951199131297', time=2024-09-12T19:31:43.735726+0000, chain.objs.size()=1 2024-09-12T17:41:32.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.440+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.omW1cDDP1TS4MdwWQtYAaal617oTCeX_0 2024-09-12T17:41:32.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.440+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7938457478695088652', time=2024-09-12T19:31:43.867973+0000, chain.objs.size()=1 2024-09-12T17:41:32.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.440+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.b0A5DL5FYRLHfpAkpR1iDZ7N0Ie0Too_0 2024-09-12T17:41:32.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.440+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17284581807543737169', time=2024-09-12T19:31:43.898331+0000, chain.objs.size()=1 2024-09-12T17:41:32.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.440+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.PLviLOoH6hBX1QYjGQFysYNxbj0HW14_0 2024-09-12T17:41:32.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.440+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9428890355680130678', time=2024-09-12T19:31:44.141090+0000, chain.objs.size()=1 2024-09-12T17:41:32.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.440+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Gux6Eml9K2O2x36PWOqZ8H7q86H6_GY_0 2024-09-12T17:41:32.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.444+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9252217969469036729', time=2024-09-12T19:31:44.218507+0000, chain.objs.size()=1 2024-09-12T17:41:32.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.444+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.BO5wWK-OyawdRYFCF3PelKlextrss4C_0 2024-09-12T17:41:32.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.444+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9046743998675654403', time=2024-09-12T19:31:44.754375+0000, chain.objs.size()=1 2024-09-12T17:41:32.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.444+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.263__shadow_.riLG4vJE2FaYjUWknl4JRY4y3YoI3Y-_0 2024-09-12T17:41:32.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.444+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7739847505617554952', time=2024-09-12T19:31:45.109155+0000, chain.objs.size()=1 2024-09-12T17:41:32.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.444+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.264__shadow_.E9Kxkk0_b7_5BRg4Quhre6Y9iQJGA7z_0 2024-09-12T17:41:32.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.444+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7691320126490573605', time=2024-09-12T19:31:48.375354+0000, chain.objs.size()=1 2024-09-12T17:41:32.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.444+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.273__shadow_.LjfVu9sXSZAIuUGN76lH4oW-7rlYBe9_0 2024-09-12T17:41:32.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.444+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4018508968782126124', time=2024-09-12T19:31:48.728212+0000, chain.objs.size()=1 2024-09-12T17:41:32.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.444+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.274__shadow_.8sdM8BdFV1wbqiyvQAntjC0T363cw4k_0 2024-09-12T17:41:32.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.444+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18297091793752556651', time=2024-09-12T19:31:53.005807+0000, chain.objs.size()=1 2024-09-12T17:41:32.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.444+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.285__shadow_.qjgyT7fCgtWgA3CDvVdi3vKZD22u4WM_0 2024-09-12T17:41:32.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.444+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.949467456096596000', time=2024-09-12T19:31:54.992360+0000, chain.objs.size()=1 2024-09-12T17:41:32.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.444+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.290__shadow_.wkA6nsGI2NlfcZgbCp25dvh5u6Rg-kN_0 2024-09-12T17:41:32.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.444+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7151928413261674087', time=2024-09-12T19:31:56.492703+0000, chain.objs.size()=1 2024-09-12T17:41:32.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.444+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.292__shadow_.hfTHoQtHVXYluLIhWxhrwJZ88wMgmqX_0 2024-09-12T17:41:32.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.444+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5338799351298895121', time=2024-09-12T19:32:01.511976+0000, chain.objs.size()=1 2024-09-12T17:41:32.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.444+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.303__shadow_.DxXUTr5lJz5Jnr9aQmyY5fMyBstHE8z_0 2024-09-12T17:41:32.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.444+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2905852306854441007', time=2024-09-12T19:32:02.320101+0000, chain.objs.size()=1 2024-09-12T17:41:32.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.444+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.305__shadow_.DB_7LZh_1noNehEDH8VkS7XjxcwJ-N__0 2024-09-12T17:41:32.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.444+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17739650040712536776', time=2024-09-12T19:32:27.848696+0000, chain.objs.size()=1 2024-09-12T17:41:32.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.444+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.aA5Iw0Nm_adxl_USbX3eYEFqSztBgHu_0 2024-09-12T17:41:32.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.444+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15189867068022712328', time=2024-09-12T19:32:27.973368+0000, chain.objs.size()=1 2024-09-12T17:41:32.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.444+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.gNZqUYn82PhVD79rXY-uoJyY1rgvCTC_0 2024-09-12T17:41:32.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.444+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2571165993334231967', time=2024-09-12T19:32:28.041821+0000, chain.objs.size()=1 2024-09-12T17:41:32.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.444+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.oe9EQpcd4pjU4ADFzQstirQ13YqY-Qh_0 2024-09-12T17:41:32.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.448+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9653399119797427358', time=2024-09-12T19:32:28.162117+0000, chain.objs.size()=1 2024-09-12T17:41:32.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.448+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.oPE2fbr1ILDdL5x61sMUvLXIq1Q-V_W_0 2024-09-12T17:41:32.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.448+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2062630563056145719', time=2024-09-12T19:32:28.205247+0000, chain.objs.size()=1 2024-09-12T17:41:32.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.448+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.f5gsvZg86l-SdNTmVbIRVvmCSwKckDc_0 2024-09-12T17:41:32.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.448+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13076037259463305926', time=2024-09-12T19:32:28.216773+0000, chain.objs.size()=1 2024-09-12T17:41:32.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.448+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.J4m3wDLNkFaC61oMkR96GoAjJyGFv4k_0 2024-09-12T17:41:32.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.448+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14275714004885105203', time=2024-09-12T19:32:28.235089+0000, chain.objs.size()=1 2024-09-12T17:41:32.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.448+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.k77jkMeM8BHOqlhcPzL_-mQDYPwCj87_0 2024-09-12T17:41:32.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.448+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15577906638720673188', time=2024-09-12T19:32:28.334041+0000, chain.objs.size()=1 2024-09-12T17:41:32.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.448+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.9141bGRzmAV3rabT3E3FhRKf0ApI60F_0 2024-09-12T17:41:32.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.448+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17386051551849278775', time=2024-09-12T19:32:28.388562+0000, chain.objs.size()=1 2024-09-12T17:41:32.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.448+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.6nRheb_V_28IuQQ3Fn0u8fjOfu97UaF_0 2024-09-12T17:41:32.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.448+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5773128657191687752', time=2024-09-12T19:32:28.425433+0000, chain.objs.size()=1 2024-09-12T17:41:32.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.448+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.KdJzdXEd5ytAABXnrztH62klMbDED8R_0 2024-09-12T17:41:32.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.448+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6878726663372479318', time=2024-09-12T19:32:28.429666+0000, chain.objs.size()=1 2024-09-12T17:41:32.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.448+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Xca3hsIA76yyp_XbDwRju44q8a_A6mT_0 2024-09-12T17:41:32.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.448+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18441275813848493730', time=2024-09-12T19:32:28.714809+0000, chain.objs.size()=1 2024-09-12T17:41:32.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.448+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.DxQ8uL-Dwue1UzqItHh3VQNzLlmuPfx_0 2024-09-12T17:41:32.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.448+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17318406350588351928', time=2024-09-12T19:32:28.725610+0000, chain.objs.size()=1 2024-09-12T17:41:32.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.448+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.OcKU_0DSu0kplMUfSV_JxcnfrPr8N5X_0 2024-09-12T17:41:32.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.448+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1551555189502108379', time=2024-09-12T19:32:28.803876+0000, chain.objs.size()=1 2024-09-12T17:41:32.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.448+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.g6Bok3bPRiBLFfdEAJ4LS43drK59WSX_0 2024-09-12T17:41:32.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.448+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14761337688403725963', time=2024-09-12T19:32:28.876834+0000, chain.objs.size()=1 2024-09-12T17:41:32.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.448+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.r7NX4ojf3ij5b0PV-AYTO8vRcQafNef_0 2024-09-12T17:41:32.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.448+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7385443031916729744', time=2024-09-12T19:32:29.100165+0000, chain.objs.size()=1 2024-09-12T17:41:32.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.448+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.XCt-KLMlWXoGnfWYZ_Tx_v0WHBMwEv-_0 2024-09-12T17:41:32.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.448+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9502320491514201398', time=2024-09-12T19:32:29.124665+0000, chain.objs.size()=1 2024-09-12T17:41:32.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.448+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.PBPPR-fe71N1E4YfOj8h-InbKE-XXL7_0 2024-09-12T17:41:32.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.448+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11054285344645242222', time=2024-09-12T19:32:29.236528+0000, chain.objs.size()=1 2024-09-12T17:41:32.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.448+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.WyDl0xr02EmaOqFxrPxmc0R8pELeG8P_0 2024-09-12T17:41:32.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.448+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17492055532906554383', time=2024-09-12T19:32:29.413161+0000, chain.objs.size()=1 2024-09-12T17:41:32.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.448+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.NXzcGriOHOz5U4pByJz1gXaYxrPeRem_0 2024-09-12T17:41:32.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.448+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14212667360162013773', time=2024-09-12T19:32:29.419263+0000, chain.objs.size()=1 2024-09-12T17:41:32.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.448+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.xyMbr-xUEmsx9Bqm6QJ0nnF-kWk6Xk9_0 2024-09-12T17:41:32.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.448+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5341439838398555220', time=2024-09-12T19:32:29.424891+0000, chain.objs.size()=1 2024-09-12T17:41:32.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.448+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.WlpPYnACKbGnS0lAGxIOx7vlA--QEE0_0 2024-09-12T17:41:32.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.448+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16532559455853886855', time=2024-09-12T19:32:29.438991+0000, chain.objs.size()=1 2024-09-12T17:41:32.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.448+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.luaYBZZYT5jw4RBoQqDS9DP8CX14agE_0 2024-09-12T17:41:32.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.448+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15760696328150055432', time=2024-09-12T19:32:29.462532+0000, chain.objs.size()=1 2024-09-12T17:41:32.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.448+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.2WS8uVcbzWjEvdGj4NTp2kFrE55_NmA_0 2024-09-12T17:41:32.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.452+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7390688842943615714', time=2024-09-12T19:32:29.504750+0000, chain.objs.size()=1 2024-09-12T17:41:32.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.452+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.2FI4QrRoJTYEtUUXJNWHlKY2K2qufh7_0 2024-09-12T17:41:32.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.452+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6966180919918179205', time=2024-09-12T19:32:29.549788+0000, chain.objs.size()=1 2024-09-12T17:41:32.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.452+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.1W6FvkT7P_-GklRWVfCFUtT99f7xSzO_0 2024-09-12T17:41:32.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.452+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4477416052285922479', time=2024-09-12T19:32:29.765569+0000, chain.objs.size()=1 2024-09-12T17:41:32.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.452+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.RSbM0z0Vu_yroDZ2AHvXViUTxcBkNpK_0 2024-09-12T17:41:32.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.452+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.794014429520352828', time=2024-09-12T19:32:29.808839+0000, chain.objs.size()=1 2024-09-12T17:41:32.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.452+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.1VtzdAr9onZJaF1Cya_gMh5xcQE2-Yc_0 2024-09-12T17:41:32.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.452+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6349820196268506783', time=2024-09-12T19:32:29.861494+0000, chain.objs.size()=1 2024-09-12T17:41:32.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.452+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.VJHNwKI9enIxteeVhC1R3tzgiQYfj1M_0 2024-09-12T17:41:32.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.452+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10275101690694243910', time=2024-09-12T19:32:30.124051+0000, chain.objs.size()=1 2024-09-12T17:41:32.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.452+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.6J9y1wgLSE384Y-V2xysEbH0yrtn2eD_0 2024-09-12T17:41:32.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.452+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3321109190920365011', time=2024-09-12T19:32:30.158789+0000, chain.objs.size()=1 2024-09-12T17:41:32.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.452+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.4FvOnSd-aWjtKXfl5aZ-fbIeaU0Gpnr_0 2024-09-12T17:41:32.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.452+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2937588040633301808', time=2024-09-12T19:32:49.597735+0000, chain.objs.size()=1 2024-09-12T17:41:32.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.452+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.hInD9VNm9oo9AeldLKGDqWxOgR9o07A_0 2024-09-12T17:41:32.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.452+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7145953789973499918', time=2024-09-12T19:32:49.622455+0000, chain.objs.size()=1 2024-09-12T17:41:32.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.452+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.lHsZsqYWn6mnglv1Q_GBRWe9hC6zHSO_0 2024-09-12T17:41:32.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.452+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16859416102982012695', time=2024-09-12T19:32:49.651712+0000, chain.objs.size()=1 2024-09-12T17:41:32.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.452+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.w92AOabIxS7SMG1EV-8334-hAxwJv1y_0 2024-09-12T17:41:32.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.452+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16522269920035260380', time=2024-09-12T19:32:50.163097+0000, chain.objs.size()=1 2024-09-12T17:41:32.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.452+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Yt7WoTWPsH296K2Kdh4S_vWOcO8R5pI_0 2024-09-12T17:41:32.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.452+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5730368263829064104', time=2024-09-12T19:32:50.233571+0000, chain.objs.size()=1 2024-09-12T17:41:32.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.452+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.sptASantprOCMHzTd1QfCKAHcy1PfhL_0 2024-09-12T17:41:32.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.452+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4607444750130020744', time=2024-09-12T19:32:50.257023+0000, chain.objs.size()=1 2024-09-12T17:41:32.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.452+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.-e8Mvt5-zWa27sjrjuRUJYvZfX0moP5_0 2024-09-12T17:41:32.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.456+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4404320868540041140', time=2024-09-12T19:32:50.327171+0000, chain.objs.size()=1 2024-09-12T17:41:32.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.456+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Ca9a5matdpmcN8Ff1v74MKssnU9y43i_0 2024-09-12T17:41:32.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.456+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1135627686142171570', time=2024-09-12T19:32:50.555002+0000, chain.objs.size()=1 2024-09-12T17:41:32.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.456+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.2-T_T3NQladx6XobsAqWagBVT_psScB_0 2024-09-12T17:41:32.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.456+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17327333372531998534', time=2024-09-12T19:32:50.684494+0000, chain.objs.size()=1 2024-09-12T17:41:32.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.456+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.eVrxphXgEvnjnDwyh4n0u7mWZxWt_oA_0 2024-09-12T17:41:32.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.456+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8877621734427642126', time=2024-09-12T19:32:50.831603+0000, chain.objs.size()=1 2024-09-12T17:41:32.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.456+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.kAST-ppQnh3gyGcgTc_W2Wv90ha89Ul_0 2024-09-12T17:41:32.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.456+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.353763092625496804', time=2024-09-12T19:32:50.890042+0000, chain.objs.size()=1 2024-09-12T17:41:32.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.456+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Ys_b5oqYOqM0fsFo1_MNuizCyzeqFkd_0 2024-09-12T17:41:32.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.456+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15823385620207765850', time=2024-09-12T19:32:50.925530+0000, chain.objs.size()=1 2024-09-12T17:41:32.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.456+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.XPlmUSwgWDrufeEp8ugsw2n9y2WZ3GZ_0 2024-09-12T17:41:32.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.456+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7419751915771046376', time=2024-09-12T19:32:50.962797+0000, chain.objs.size()=1 2024-09-12T17:41:32.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.456+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.15eRLEOQjIyTibSZfFkcRGRdTkmH9qV_0 2024-09-12T17:41:32.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.456+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11665359388186907631', time=2024-09-12T19:32:51.001688+0000, chain.objs.size()=1 2024-09-12T17:41:32.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.456+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Zp_FMnZ-Zy8zs6THQBzIIGnF55wNfN0_0 2024-09-12T17:41:32.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.456+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17878038139622995628', time=2024-09-12T19:32:51.179718+0000, chain.objs.size()=1 2024-09-12T17:41:32.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.456+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.ASUSyCd2d482HKzP_apW2sMzFxg7dba_0 2024-09-12T17:41:32.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.456+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17593566618743316692', time=2024-09-12T19:32:51.244521+0000, chain.objs.size()=1 2024-09-12T17:41:32.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.456+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.YaoWA4F6YMjx5qvFnVz1gLcFOP4wTRi_0 2024-09-12T17:41:32.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.456+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6306341824784397127', time=2024-09-12T19:32:51.331130+0000, chain.objs.size()=1 2024-09-12T17:41:32.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.456+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.bjoyyNCnwATQTEPzZLKD4lz7mXcyaEN_0 2024-09-12T17:41:32.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.456+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12529327609872802643', time=2024-09-12T19:32:51.379624+0000, chain.objs.size()=1 2024-09-12T17:41:32.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.456+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.k3sjng6-FGjdw-zegAPVuFJgyi3KxYj_0 2024-09-12T17:41:32.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.456+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12933615025116622706', time=2024-09-12T19:32:51.567298+0000, chain.objs.size()=1 2024-09-12T17:41:32.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.456+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.JMg540UqkAzwz25Okw5h7ie4dwLz0Yt_0 2024-09-12T17:41:32.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.456+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11620473317270769727', time=2024-09-12T19:32:51.651674+0000, chain.objs.size()=1 2024-09-12T17:41:32.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.456+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.lxkhRwIfyIsf44p3vbNxtK9ZbC991c0_0 2024-09-12T17:41:32.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.456+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13826059435673615757', time=2024-09-12T19:32:51.847919+0000, chain.objs.size()=1 2024-09-12T17:41:32.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.456+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.2xhsZVEmT-F2aeQ4u0TfZ083mf702TA_0 2024-09-12T17:41:32.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.456+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6451190279373008759', time=2024-09-12T19:32:51.912498+0000, chain.objs.size()=1 2024-09-12T17:41:32.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.456+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.DekOkZmpLhx0yqXH6GbvK97nn0D3mEo_0 2024-09-12T17:41:32.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.460+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2074143261445373699', time=2024-09-12T19:32:51.947340+0000, chain.objs.size()=1 2024-09-12T17:41:32.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.460+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.RYyAS6QdxacTKGny4Li0pWq1xZHbVPs_0 2024-09-12T17:41:32.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.460+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/54264 2024-09-12T17:41:32.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.460+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T17:41:32.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.460+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8210493911085900730', time=2024-09-12T19:32:52.004414+0000, chain.objs.size()=1 2024-09-12T17:41:32.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.460+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.jjAn4VjrGk8J8RJbgsi00lFdU3DzfL3_0 2024-09-12T17:41:32.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.460+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3385942991963062042', time=2024-09-12T19:32:52.005654+0000, chain.objs.size()=1 2024-09-12T17:41:32.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.460+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.90yhscKqWXJSi5lQglpjAj62GPbtCh5_0 2024-09-12T17:41:32.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.460+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17835740818225587341', time=2024-09-12T19:33:44.582934+0000, chain.objs.size()=1 2024-09-12T17:41:32.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.460+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.466__shadow_.rgwUIyEoI5eHKYNpvvKdrtjFILBWFtx_0 2024-09-12T17:41:32.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.460+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17582132428675649486', time=2024-09-12T19:33:53.925578+0000, chain.objs.size()=1 2024-09-12T17:41:32.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.460+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.495__shadow_.C4H4py8t846rNX7NG7m89gYCrp1a-_a_0 2024-09-12T17:41:32.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.460+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17225512561294885041', time=2024-09-12T19:33:57.454527+0000, chain.objs.size()=1 2024-09-12T17:41:32.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.460+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.503__shadow:5PZwxWS6kVU04L4agSYet4YqDKg.iTJ_.vEQTiH10KZ8H36ScYyTe7asHZOEv9fv_0 2024-09-12T17:41:32.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.460+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3081953324799975258', time=2024-09-12T19:34:23.328315+0000, chain.objs.size()=2 2024-09-12T17:41:32.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.460+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.525__multipart_mymultipart.2~zdhyrxHuWPYAY3cUkZcCmxtViaNLAOz.1 2024-09-12T17:41:32.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.460+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.525__multipart_mymultipart.2~zdhyrxHuWPYAY3cUkZcCmxtViaNLAOz.2 2024-09-12T17:41:32.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.460+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2835027881497694504', time=2024-09-12T19:34:46.771050+0000, chain.objs.size()=1 2024-09-12T17:41:32.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.460+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.537__shadow_.U8qMBwmwACcozNTyVtaEQhgboqfYnX9_0 2024-09-12T17:41:32.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.460+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6668491868759549249', time=2024-09-12T19:35:19.806582+0000, chain.objs.size()=1 2024-09-12T17:41:32.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.460+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.569__shadow:gxPMqBzU3uHJ9SPInpCKFMZ4cW6tAp1_.jYY9X_eg5YLiAmiXZpoDEgPgBL5jTIR_0 2024-09-12T17:41:32.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.460+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13592387074520268632', time=2024-09-12T19:35:21.951426+0000, chain.objs.size()=1 2024-09-12T17:41:32.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.460+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.569__shadow:MokkP5rqLCePJ2QgrDIk9BbmioRWQ4E_.9Yo1iLrVeUIBbpNutkHT1Lif3dikSwA_0 2024-09-12T17:41:32.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.460+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8569955024646190785', time=2024-09-12T19:35:25.732098+0000, chain.objs.size()=1 2024-09-12T17:41:32.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.460+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.573__shadow_.tZmq3Qx48hzfdgXyGdX5VjN6T7ddcdW_0 2024-09-12T17:41:32.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.460+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.340439692721696531', time=2024-09-12T19:35:37.550637+0000, chain.objs.size()=1 2024-09-12T17:41:32.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.460+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.577__shadow:p95MyxkwqVHhY1dXC5UXBbsWwpGgUp-_.JgWRv7Vyb1iAXsCWZwNCRzXGf-RUNFs_0 2024-09-12T17:41:32.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.464+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14024829504909937414', time=2024-09-12T19:35:39.715504+0000, chain.objs.size()=1 2024-09-12T17:41:32.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.464+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.577__shadow:wM.cveegUpI8arlZjF8CCqG9k5d6DZn_.dw92dJ_YHEfE8GcYwr-xxjziOUYfa4r_0 2024-09-12T17:41:32.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.464+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12266057149776631277', time=2024-09-12T19:35:54.192317+0000, chain.objs.size()=1 2024-09-12T17:41:32.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.464+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.579__shadow:0DmV8-9sN4lbuk6TkzS3S8m-tGf3JV5_.ZkW25Xrq78bsUQskE5wVtqHJK0pJZ39_0 2024-09-12T17:41:32.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.464+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6122045030274500912', time=2024-09-12T19:35:59.007876+0000, chain.objs.size()=1 2024-09-12T17:41:32.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.464+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.587__shadow:e-oG7eoy5iVxgJ8kSFMEDh3tXg7qaut_.4AANttxQ2Q8sfdhg_UqP0VttmQ7YX_u_0 2024-09-12T17:41:32.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.464+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11882247867206288611', time=2024-09-12T19:36:05.869336+0000, chain.objs.size()=1 2024-09-12T17:41:32.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.464+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.608__shadow_.XilnvRcTMnjc4tZcc3LxQYD2-WT6VxC_0 2024-09-12T17:41:32.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.464+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2015816704605720250', time=2024-09-12T19:38:42.195044+0000, chain.objs.size()=1 2024-09-12T17:41:32.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.464+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.663__shadow_.r8eiRFWtwqtcA4MKiXdgXxnDalV3TDU_0 2024-09-12T17:41:32.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.464+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15720290018341660279', time=2024-09-12T19:38:57.032509+0000, chain.objs.size()=1 2024-09-12T17:41:32.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.464+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.704__shadow:faJLVwFJh2acprz5tsRGfvfrGOpPSOc_.SJEvIDHutVBq63FPL3J-VYDMdeeYPPH_0 2024-09-12T17:41:32.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.464+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13756480098867079083', time=2024-09-12T19:41:19.138333+0000, chain.objs.size()=1 2024-09-12T17:41:32.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.464+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.782__shadow_.oEF7v4UGOmeIOnJfrDJzp4KOx4fwVtB_0 2024-09-12T17:41:32.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.464+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:41:32.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.468+0000 7fd765adf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:41:32.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.468+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:41:32.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.472+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:41:32.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.472+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47319' 2024-09-12T17:41:32.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.472+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='_-s0CXNfbfvyeYmYflgfqNdooFO9P5xT', time=2024-09-12T19:29:44.377189+0000, chain.objs.size()=1 2024-09-12T17:41:32.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.472+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.160__shadow_.FsrIiPWl2zwMpyEuWkzqc1ZUu1JW5hU_0 2024-09-12T17:41:32.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.472+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17310197317503710401', time=2024-09-12T19:31:11.026594+0000, chain.objs.size()=1 2024-09-12T17:41:32.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.472+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.231__shadow_.MnDhNmrqUhV-UhPT7r3GpjsOsraDobU_0 2024-09-12T17:41:32.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.472+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17149454099656236367', time=2024-09-12T19:31:11.798667+0000, chain.objs.size()=1 2024-09-12T17:41:32.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.472+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.233__shadow_.KYlDHjmBPa1rtsG2yFxtfJamBkG5i1W_0 2024-09-12T17:41:32.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.472+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2679676395185370531', time=2024-09-12T19:31:13.967414+0000, chain.objs.size()=1 2024-09-12T17:41:32.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.472+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.238__shadow_.3XWjEjlHfJ3xE3J2lgcYplZj7rNNydo_0 2024-09-12T17:41:32.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.472+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1992759149007980615', time=2024-09-12T19:31:17.569645+0000, chain.objs.size()=1 2024-09-12T17:41:32.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.472+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.247__shadow_.JnYbsB4ceYET5dN618ZZknci5io-hHS_0 2024-09-12T17:41:32.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.472+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17002601578317229804', time=2024-09-12T19:31:18.317665+0000, chain.objs.size()=1 2024-09-12T17:41:32.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.472+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.249__shadow_.UkkeNI3Fjo74kULTxjVrFzBv-5vQyPX_0 2024-09-12T17:41:32.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.472+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11300732883196695550', time=2024-09-12T19:31:21.004673+0000, chain.objs.size()=1 2024-09-12T17:41:32.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.472+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.256__shadow_.XXLeRXMahXUZjWB0IixMJO2JA2qNABI_0 2024-09-12T17:41:32.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.472+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3848259992651374737', time=2024-09-12T19:31:21.362530+0000, chain.objs.size()=1 2024-09-12T17:41:32.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.472+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.257__shadow_.5r3edsA4MdfZ2VGfkv1DJF_SnWUmqsK_0 2024-09-12T17:41:32.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.472+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14577719834752097928', time=2024-09-12T19:31:42.405378+0000, chain.objs.size()=1 2024-09-12T17:41:32.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.472+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.626BMmBRZLa3CjDJtzJIaJPJwpvqr7H_0 2024-09-12T17:41:32.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.472+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15602360660175571428', time=2024-09-12T19:31:42.455456+0000, chain.objs.size()=1 2024-09-12T17:41:32.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.472+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.tkTk8uewQK4TZeqXfrXiZJvJIV_mDjx_0 2024-09-12T17:41:32.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.472+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6740731870580002410', time=2024-09-12T19:31:42.479349+0000, chain.objs.size()=1 2024-09-12T17:41:32.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.472+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.SSS2iuTvh4rVVLAbi1WvNVoDBpKxHKV_0 2024-09-12T17:41:32.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.472+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4263152905455504777', time=2024-09-12T19:31:42.569133+0000, chain.objs.size()=1 2024-09-12T17:41:32.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.472+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.WWyzDbVGlHdKtl_8vwzs88QRNgAZ98l_0 2024-09-12T17:41:32.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.472+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2249947632268315536', time=2024-09-12T19:31:42.575148+0000, chain.objs.size()=1 2024-09-12T17:41:32.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.472+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.USyq6KUaCU4w7ye7-rG3q4JM3oo0-6W_0 2024-09-12T17:41:32.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.472+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6580489346758163038', time=2024-09-12T19:31:42.711182+0000, chain.objs.size()=1 2024-09-12T17:41:32.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.472+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.bVvqyTmOryeyq8JMNOxAChfOcztE5iH_0 2024-09-12T17:41:32.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.472+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13173483004534761324', time=2024-09-12T19:31:42.784368+0000, chain.objs.size()=1 2024-09-12T17:41:32.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.472+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.cAb5Gngqnuj9gvcpX6bdM3cmKjeXk_I_0 2024-09-12T17:41:32.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.476+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6689146680590312668', time=2024-09-12T19:31:42.787539+0000, chain.objs.size()=1 2024-09-12T17:41:32.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.476+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.u6pkB3ruKMD8fo87i65QF4i8Nf_4No-_0 2024-09-12T17:41:32.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.476+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5678811553990398854', time=2024-09-12T19:31:42.799696+0000, chain.objs.size()=1 2024-09-12T17:41:32.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.476+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.0edPw2iPVmBqL8qiVK0goOLYiuoottM_0 2024-09-12T17:41:32.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.476+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.146924288656645370', time=2024-09-12T19:31:42.802974+0000, chain.objs.size()=1 2024-09-12T17:41:32.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.476+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.8YmAlnuxJF8miZmYljq12_Hu4670FgQ_0 2024-09-12T17:41:32.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.476+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15348484359206619558', time=2024-09-12T19:31:42.811565+0000, chain.objs.size()=1 2024-09-12T17:41:32.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.476+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Up9LxbmN1XLQgrUPFTcYpqXK1J9b2ac_0 2024-09-12T17:41:32.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.476+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12915937969626697554', time=2024-09-12T19:31:42.888367+0000, chain.objs.size()=1 2024-09-12T17:41:32.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.476+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.RExRhFfAGG6S_oPZ8M2_ZoPa5gvUT4s_0 2024-09-12T17:41:32.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.476+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15114277848118080484', time=2024-09-12T19:31:42.939993+0000, chain.objs.size()=1 2024-09-12T17:41:32.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.476+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.UDQOTyueyxne_EJBEZG9jcUUtT-XdM4_0 2024-09-12T17:41:32.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.476+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.342612550860180003', time=2024-09-12T19:31:43.150654+0000, chain.objs.size()=1 2024-09-12T17:41:32.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.476+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.z-0_W3qcTHAxemk5V9jiBZrxXJj09AF_0 2024-09-12T17:41:32.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.476+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12156743406660983149', time=2024-09-12T19:31:43.152710+0000, chain.objs.size()=1 2024-09-12T17:41:32.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.476+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.VNH-7bdG2qnruVZdINx0xJyayVcbENR_0 2024-09-12T17:41:32.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.476+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1323433002467384073', time=2024-09-12T19:31:43.184512+0000, chain.objs.size()=1 2024-09-12T17:41:32.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.476+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.p0k5Pr3JOYPpfUX-d2yw5cpJi6HVGmJ_0 2024-09-12T17:41:32.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.476+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7298970923965757560', time=2024-09-12T19:31:43.241707+0000, chain.objs.size()=1 2024-09-12T17:41:32.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.476+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.mBBdGi4p7FmR9NBTEAZFlaLpkncZhM5_0 2024-09-12T17:41:32.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.476+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12339727616681414939', time=2024-09-12T19:31:43.255853+0000, chain.objs.size()=1 2024-09-12T17:41:32.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.476+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.u50fuPbhYmlBi2mbAiw15ZTZ-tj-quv_0 2024-09-12T17:41:32.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.476+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4497165349075606694', time=2024-09-12T19:31:43.275132+0000, chain.objs.size()=1 2024-09-12T17:41:32.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.476+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.b6e9TbuSnFhtVlQ55LlbMjjBIpUmASm_0 2024-09-12T17:41:32.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.476+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.483150531801775680', time=2024-09-12T19:31:43.470782+0000, chain.objs.size()=1 2024-09-12T17:41:32.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.476+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.oK_JLErXXYa29my3Jl_kRHMBr6nbtnk_0 2024-09-12T17:41:32.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.476+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17668983171021525524', time=2024-09-12T19:31:43.524449+0000, chain.objs.size()=1 2024-09-12T17:41:32.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.476+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.-wYF52U0otZ7Cg3oTBar8RUgZWjRu6U_0 2024-09-12T17:41:32.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.476+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3198741320835234633', time=2024-09-12T19:31:43.532686+0000, chain.objs.size()=1 2024-09-12T17:41:32.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.476+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.FnezYvzZOJgpdrAHvykt7jab9-J4xxU_0 2024-09-12T17:41:32.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.476+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4916693783342869641', time=2024-09-12T19:31:43.613164+0000, chain.objs.size()=1 2024-09-12T17:41:32.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.476+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_._XBKh3CrqVHkCV51m2W61MCqWMwIE_f_0 2024-09-12T17:41:32.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.476+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8586264661370101416', time=2024-09-12T19:31:43.726571+0000, chain.objs.size()=1 2024-09-12T17:41:32.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.476+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.hwRuUtgjMsa8aY7MjfOg4r5IV0ky6AQ_0 2024-09-12T17:41:32.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.476+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5228770492679848028', time=2024-09-12T19:31:43.774135+0000, chain.objs.size()=1 2024-09-12T17:41:32.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.476+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Yr7yN_jBzaw_n2X1CWN8L44ePUcMhMs_0 2024-09-12T17:41:32.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.476+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1012300727322177803', time=2024-09-12T19:31:44.095281+0000, chain.objs.size()=1 2024-09-12T17:41:32.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.476+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Jr3VGiyE_6tSHsFvv2RK0QahkCaqnXC_0 2024-09-12T17:41:32.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.480+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2170256349340630481', time=2024-09-12T19:31:44.105013+0000, chain.objs.size()=1 2024-09-12T17:41:32.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.480+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.F09OPuYqrj3QMZIa65fOqDWLuV5NeY0_0 2024-09-12T17:41:32.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.480+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2605454299839207953', time=2024-09-12T19:31:44.166712+0000, chain.objs.size()=1 2024-09-12T17:41:32.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.480+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.7-e2xoL_Fx11oTXzufu9KWFxUo9dgSv_0 2024-09-12T17:41:32.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.480+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15258424525328623540', time=2024-09-12T19:31:44.204845+0000, chain.objs.size()=1 2024-09-12T17:41:32.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.480+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.5cTYV6qAIJEODHU02h6uaRoe4eWhIrA_0 2024-09-12T17:41:32.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.480+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18348804586071680006', time=2024-09-12T19:31:44.213959+0000, chain.objs.size()=1 2024-09-12T17:41:32.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.480+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.NC2c_AkXRBPk1xld8wi2fB40ubCmwig_0 2024-09-12T17:41:32.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.480+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3425010283698933599', time=2024-09-12T19:31:44.238856+0000, chain.objs.size()=1 2024-09-12T17:41:32.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.480+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.ZCfNnaBdOiLb2VmlmcmnpuMqwqy3uhL_0 2024-09-12T17:41:32.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.480+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6240168105866453081', time=2024-09-12T19:31:44.392954+0000, chain.objs.size()=1 2024-09-12T17:41:32.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.480+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.LO_ArvyHQk31O1CWOR9pFJ63VqFjoFx_0 2024-09-12T17:41:32.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.480+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10588861709671422177', time=2024-09-12T19:31:44.433636+0000, chain.objs.size()=1 2024-09-12T17:41:32.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.480+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.FF2iox6dveu4n45XmQp1zylyYK3bGwd_0 2024-09-12T17:41:32.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.480+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8246661795887478078', time=2024-09-12T19:31:44.495735+0000, chain.objs.size()=1 2024-09-12T17:41:32.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.480+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.0Gsf3613w8PFEpMTZu60Ic7j3P9zBvg_0 2024-09-12T17:41:32.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.480+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2519931039193438801', time=2024-09-12T19:31:44.512235+0000, chain.objs.size()=1 2024-09-12T17:41:32.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.480+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.zgHzGgrnN9xUxrXLOn7Btm0KfcEX82L_0 2024-09-12T17:41:32.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.480+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17282577081510736779', time=2024-09-12T19:31:44.543317+0000, chain.objs.size()=1 2024-09-12T17:41:32.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.480+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.ozGVIEdApIkhnnqmKFwELR44k_t6chF_0 2024-09-12T17:41:32.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.480+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6307060146505955615', time=2024-09-12T19:31:46.182286+0000, chain.objs.size()=1 2024-09-12T17:41:32.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.480+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.267__shadow_.4O6wHdvKRoTlMjlySCgVFsyRwtIiwJ8_0 2024-09-12T17:41:32.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.480+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14841564064019335446', time=2024-09-12T19:31:46.942265+0000, chain.objs.size()=1 2024-09-12T17:41:32.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.480+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.269__shadow_.rfV9EPjczE9P3Zw18a1s52QwByPFXWK_0 2024-09-12T17:41:32.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.480+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3753753574400134365', time=2024-09-12T19:31:47.306325+0000, chain.objs.size()=1 2024-09-12T17:41:32.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.480+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.270__shadow_.0gqVtRVNBqt1--kzLNIKsimvsNCpP7D_0 2024-09-12T17:41:32.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.480+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10493583685917366675', time=2024-09-12T19:31:51.007251+0000, chain.objs.size()=1 2024-09-12T17:41:32.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.480+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.280__shadow_.HjtJtNdOqG0I-OkO0D0OC84e6GQJseJ_0 2024-09-12T17:41:32.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.480+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10013063238723039956', time=2024-09-12T19:31:51.444577+0000, chain.objs.size()=1 2024-09-12T17:41:32.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.480+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.281__shadow_.9R3gMlvAYYyP_sqy2dCl-IaHHbSWiRc_0 2024-09-12T17:41:32.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.480+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8393186754687354033', time=2024-09-12T19:31:57.599755+0000, chain.objs.size()=1 2024-09-12T17:41:32.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.480+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.293__shadow_.nq-gSWPVgnXluTGlkdLMPS-Tx84OxSw_0 2024-09-12T17:41:32.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.480+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1517993088192870650', time=2024-09-12T19:31:59.120382+0000, chain.objs.size()=1 2024-09-12T17:41:32.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.480+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.297__shadow_.oHSgtQIAU2pGVgTA4lxN479WiU9RIVf_0 2024-09-12T17:41:32.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.480+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3878656197252604128', time=2024-09-12T19:32:07.350191+0000, chain.objs.size()=1 2024-09-12T17:41:32.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.480+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.319__shadow:R1mKf.5iwikkvxx-681QNKAJhcNPhTu_.r8DrmDGdUJXml1OFEo6fONKSpL2DdhX_0 2024-09-12T17:41:32.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.484+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17525401063090107968', time=2024-09-12T19:32:27.841903+0000, chain.objs.size()=1 2024-09-12T17:41:32.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.484+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Shi2Q4HBWBBRi0mAefdKQoALQECyFXD_0 2024-09-12T17:41:32.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.484+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7476703294925531809', time=2024-09-12T19:32:27.846070+0000, chain.objs.size()=1 2024-09-12T17:41:32.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.484+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.nxT3kf9Vd1leccV4GN4B8aWk6jDCCK1_0 2024-09-12T17:41:32.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.484+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5222592945631368530', time=2024-09-12T19:32:27.866775+0000, chain.objs.size()=1 2024-09-12T17:41:32.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.484+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.kO-Qb36jxWws-Zth8FnrA2wYsgqw6bH_0 2024-09-12T17:41:32.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.484+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3479822118889446143', time=2024-09-12T19:32:27.933255+0000, chain.objs.size()=1 2024-09-12T17:41:32.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.484+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Ww6tQMT_zC7AIauVl_l1b9CRCGzCLJm_0 2024-09-12T17:41:32.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.484+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11653985356049447120', time=2024-09-12T19:32:27.955899+0000, chain.objs.size()=1 2024-09-12T17:41:32.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.484+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.KOpNAwmGFG3AUIozVPE-8m8xAjSFw6s_0 2024-09-12T17:41:32.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.484+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17175680706640149797', time=2024-09-12T19:32:28.010752+0000, chain.objs.size()=1 2024-09-12T17:41:32.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.484+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.EXKLOLWF2molGhDYmJLgRg4YKxsFadi_0 2024-09-12T17:41:32.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.484+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4585318213288723335', time=2024-09-12T19:32:28.065698+0000, chain.objs.size()=1 2024-09-12T17:41:32.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.484+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.J5eBAfdRNtfnvIIAirOVjBzBuo-HY4a_0 2024-09-12T17:41:32.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.484+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4568706131191013996', time=2024-09-12T19:32:28.085438+0000, chain.objs.size()=1 2024-09-12T17:41:32.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.484+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.J9dPIVObXwnp-HyL-CGov5ZnB5fOYQk_0 2024-09-12T17:41:32.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.484+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7189052350232491088', time=2024-09-12T19:32:28.199856+0000, chain.objs.size()=1 2024-09-12T17:41:32.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.484+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.YIfaXL_wvXHlksdZGbhnmbxtCNAOpmT_0 2024-09-12T17:41:32.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.484+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11623820070024445172', time=2024-09-12T19:32:28.210995+0000, chain.objs.size()=1 2024-09-12T17:41:32.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.484+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.RBUtyp3oW-UBtiF6mkNm2FW9z40MxbF_0 2024-09-12T17:41:32.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.484+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11139186281134702892', time=2024-09-12T19:32:28.265509+0000, chain.objs.size()=1 2024-09-12T17:41:32.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.484+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.jRuC5RLYfQj5ohsOj2AjtQEbkdx2OMU_0 2024-09-12T17:41:32.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.484+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3591530086637807048', time=2024-09-12T19:32:28.268073+0000, chain.objs.size()=1 2024-09-12T17:41:32.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.484+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.0l4Hvc6bEoI8l5dNSHulluBDBhve3uW_0 2024-09-12T17:41:32.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.484+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16441135989253158149', time=2024-09-12T19:32:28.311132+0000, chain.objs.size()=1 2024-09-12T17:41:32.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.484+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.c00C91ISqHc7Zj_KzdeW_XAN0m3-2hw_0 2024-09-12T17:41:32.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.484+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5480465313296014437', time=2024-09-12T19:32:28.385202+0000, chain.objs.size()=1 2024-09-12T17:41:32.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.484+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.gAOIMNJ2gRrCdugzVzoL-Ynkqt9eNg8_0 2024-09-12T17:41:32.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.488+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14660858510894704626', time=2024-09-12T19:32:28.391208+0000, chain.objs.size()=1 2024-09-12T17:41:32.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.488+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.AkCPssD0kL6sb9npJp8eCqfGn3lX1Tb_0 2024-09-12T17:41:32.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.488+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3454198304545221160', time=2024-09-12T19:32:28.423639+0000, chain.objs.size()=1 2024-09-12T17:41:32.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.488+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.qzXwLWiZZqMogP_OFW7BuKtn9b-5YRE_0 2024-09-12T17:41:32.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.488+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6523999493368566806', time=2024-09-12T19:32:28.439248+0000, chain.objs.size()=1 2024-09-12T17:41:32.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.488+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.GAsSN_jdipT63tEdu4gjXg9eUm91yyf_0 2024-09-12T17:41:32.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.488+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.701829405571428579', time=2024-09-12T19:32:28.467888+0000, chain.objs.size()=1 2024-09-12T17:41:32.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.488+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.MiLQFzzfhS1a9RPATmDYekHrsZ91sx6_0 2024-09-12T17:41:32.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.488+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12086898499210909424', time=2024-09-12T19:32:28.702157+0000, chain.objs.size()=1 2024-09-12T17:41:32.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.488+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.nGrKVcN6FfU0QThkr873N1B-MqP_Faq_0 2024-09-12T17:41:32.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.488+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17285382112242606191', time=2024-09-12T19:32:28.733933+0000, chain.objs.size()=1 2024-09-12T17:41:32.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.488+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_._UEVvsGJXjTt6bLY2A0x6w50ZyZBhQu_0 2024-09-12T17:41:32.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.488+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6640598835784014231', time=2024-09-12T19:32:28.860657+0000, chain.objs.size()=1 2024-09-12T17:41:32.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.488+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.vs7awuETRyQMu9lWL_ouB5tb2IG5T-8_0 2024-09-12T17:41:32.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.488+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9038305543822601174', time=2024-09-12T19:32:28.868860+0000, chain.objs.size()=1 2024-09-12T17:41:32.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.488+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.DBoxPimeQZ3PysXQ087jRhnpXiac5x9_0 2024-09-12T17:41:32.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.488+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5229807239326109609', time=2024-09-12T19:32:29.148501+0000, chain.objs.size()=1 2024-09-12T17:41:32.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.488+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.71w2pOJCw5gJMhXPf9gA7qtUT-HiS61_0 2024-09-12T17:41:32.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.488+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7187846666168076550', time=2024-09-12T19:32:29.217040+0000, chain.objs.size()=1 2024-09-12T17:41:32.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.488+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.xhMrEzIeFMwSTZXqTBR54niNQRO2xf6_0 2024-09-12T17:41:32.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.488+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12645576304119266516', time=2024-09-12T19:32:29.345225+0000, chain.objs.size()=1 2024-09-12T17:41:32.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.488+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.HPU28KghNaY6XYuyinzS98TjsC13ZPs_0 2024-09-12T17:41:32.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.488+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11715220790300375702', time=2024-09-12T19:32:29.368395+0000, chain.objs.size()=1 2024-09-12T17:41:32.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.488+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.eAC4lyj72ZriEKbVrFDu7Z_ZtdqOh2O_0 2024-09-12T17:41:32.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.488+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.516703529856609948', time=2024-09-12T19:32:29.542321+0000, chain.objs.size()=1 2024-09-12T17:41:32.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.488+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.u1MbxI1UZphybudT1BlAbfZM4qALNeS_0 2024-09-12T17:41:32.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.488+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17143171915648167638', time=2024-09-12T19:32:29.666983+0000, chain.objs.size()=1 2024-09-12T17:41:32.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.488+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.INxWPe-1SCa9puXgd9lbr18TrIe1-3x_0 2024-09-12T17:41:32.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.488+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17925448395456760510', time=2024-09-12T19:32:29.697208+0000, chain.objs.size()=1 2024-09-12T17:41:32.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.488+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.v99I9ivKwI5QpMYWm5uH5K7fchUc-7X_0 2024-09-12T17:41:32.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.488+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1098148486023914326', time=2024-09-12T19:32:29.880770+0000, chain.objs.size()=1 2024-09-12T17:41:32.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.488+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.ZTgs__FgovIKSyi5WZZzEg5tbQNP7Kn_0 2024-09-12T17:41:32.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.488+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13884263928587520687', time=2024-09-12T19:32:30.060309+0000, chain.objs.size()=1 2024-09-12T17:41:32.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.488+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.ZCUkLFrzpJCYXmGvLjeJc1-5Vu8LTlR_0 2024-09-12T17:41:32.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.488+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.520437685249522040', time=2024-09-12T19:32:30.068802+0000, chain.objs.size()=1 2024-09-12T17:41:32.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.488+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.cLViermbX_dUjb1b7Jj3GHlgVYZQojx_0 2024-09-12T17:41:32.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.488+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9725201536188024556', time=2024-09-12T19:32:30.162508+0000, chain.objs.size()=1 2024-09-12T17:41:32.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.488+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.AqcIpvaoTyJOFv2NjY95P98l8AW6-MN_0 2024-09-12T17:41:32.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.488+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14058292546318279159', time=2024-09-12T19:32:49.538645+0000, chain.objs.size()=1 2024-09-12T17:41:32.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.488+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.mrRJYxNvPRil7M3-7P_06bmXV5VMKW8_0 2024-09-12T17:41:32.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.492+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3269048817062904988', time=2024-09-12T19:32:49.633706+0000, chain.objs.size()=1 2024-09-12T17:41:32.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.492+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.nPep0_1gDj8QqMTk176TH5C4ExCQQg1_0 2024-09-12T17:41:32.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.492+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7009556696715647239', time=2024-09-12T19:32:49.866088+0000, chain.objs.size()=1 2024-09-12T17:41:32.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.492+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.1pJcZ2LVffAd0anXdiflMcOuPTTPNTT_0 2024-09-12T17:41:32.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.492+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4252684590224149246', time=2024-09-12T19:32:49.957508+0000, chain.objs.size()=1 2024-09-12T17:41:32.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.492+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.nmmt5LUwTalxrsx0WQwL8FGagOSkFPs_0 2024-09-12T17:41:32.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.492+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.98240893621753573', time=2024-09-12T19:32:50.000733+0000, chain.objs.size()=1 2024-09-12T17:41:32.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.492+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.2lyTWXXWrqg_o8M4wZh6fXklH9bwPmf_0 2024-09-12T17:41:32.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.492+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12854137543039054231', time=2024-09-12T19:32:50.173417+0000, chain.objs.size()=1 2024-09-12T17:41:32.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.492+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.E2JTt0RnHVRy--GF-4_DsCenMd8k4iX_0 2024-09-12T17:41:32.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.492+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9207727710803875807', time=2024-09-12T19:32:50.300966+0000, chain.objs.size()=1 2024-09-12T17:41:32.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.492+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.eMSCnjY8PmnaDy50tapvB29fST9ZhmF_0 2024-09-12T17:41:32.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.492+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6238940122157351397', time=2024-09-12T19:32:50.620813+0000, chain.objs.size()=1 2024-09-12T17:41:32.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.492+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.96tKSKYMXCbhW0XwYhak7Wo37ugbptg_0 2024-09-12T17:41:32.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.492+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.337877735418618542', time=2024-09-12T19:32:50.893975+0000, chain.objs.size()=1 2024-09-12T17:41:32.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.492+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.48By5W9CDafmubh61EBxHcB3g8AQAQ9_0 2024-09-12T17:41:32.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.492+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13896589773728326629', time=2024-09-12T19:32:50.915210+0000, chain.objs.size()=1 2024-09-12T17:41:32.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.492+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.HBa_qOuLS-qKnEN06s6if_deRVikdyg_0 2024-09-12T17:41:32.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.492+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4976917235922777444', time=2024-09-12T19:32:50.920232+0000, chain.objs.size()=1 2024-09-12T17:41:32.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.492+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_._ajLvcPhYvt6zVze0lA1i3TEEzGFn3-_0 2024-09-12T17:41:32.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.492+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3525293619904126795', time=2024-09-12T19:32:50.973999+0000, chain.objs.size()=1 2024-09-12T17:41:32.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.492+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.GFVUGkVX-hSdfgkxCQSpk9wW6HTtvAF_0 2024-09-12T17:41:32.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.492+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8427333390587428803', time=2024-09-12T19:32:51.013963+0000, chain.objs.size()=1 2024-09-12T17:41:32.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.492+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.X45I0GrHtR1mQM6We3SCDV_5aHsg6wt_0 2024-09-12T17:41:32.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.492+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18236482821891309482', time=2024-09-12T19:32:51.187505+0000, chain.objs.size()=1 2024-09-12T17:41:32.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.492+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.2OOpTwYTMiiM4CtqVU3MrNb4Yw8zFzf_0 2024-09-12T17:41:32.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.492+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2129418054783577595', time=2024-09-12T19:32:51.344996+0000, chain.objs.size()=1 2024-09-12T17:41:32.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.492+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_._ujVzrK_GNd-u1K7QZEZQMj8suDVn0Q_0 2024-09-12T17:41:32.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.496+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47319 2024-09-12T17:41:32.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.496+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-12T17:41:32.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.496+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3143565525120413584', time=2024-09-12T19:32:51.347208+0000, chain.objs.size()=1 2024-09-12T17:41:32.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.496+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.WHRZvmoo37LUgK1Rh8_KuCRhb57hz_h_0 2024-09-12T17:41:32.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.496+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13237488091595113402', time=2024-09-12T19:32:51.361492+0000, chain.objs.size()=1 2024-09-12T17:41:32.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.496+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.UNc-Q_MXNeb0kkmP6SMSxoXNdmUwTKU_0 2024-09-12T17:41:32.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.496+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16494279388391641903', time=2024-09-12T19:32:51.526163+0000, chain.objs.size()=1 2024-09-12T17:41:32.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.496+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.9zB6EwqGbwz0EIE9aKW8O_3SW5UWiEn_0 2024-09-12T17:41:32.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.496+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2269815552688039371', time=2024-09-12T19:32:51.619647+0000, chain.objs.size()=1 2024-09-12T17:41:32.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.496+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.dW-rbZMTb6-EL2MUfuMR4Eniyvg7ItA_0 2024-09-12T17:41:32.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.496+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3915244429497867596', time=2024-09-12T19:32:51.641023+0000, chain.objs.size()=1 2024-09-12T17:41:32.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.496+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.UJDiWgr8m-4J429dfAm3ke0mtBJSwHE_0 2024-09-12T17:41:32.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.496+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17759345804610911801', time=2024-09-12T19:32:51.667102+0000, chain.objs.size()=1 2024-09-12T17:41:32.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.496+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.D4ex72Q7QO0re9G1HdtmFryVRQmOZK1_0 2024-09-12T17:41:32.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.496+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3515142372377171255', time=2024-09-12T19:32:51.697798+0000, chain.objs.size()=1 2024-09-12T17:41:32.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.496+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.6wJgIHif8PrpRNuAOoz1Tvk32q9I1Qg_0 2024-09-12T17:41:32.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.496+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9565029106780987910', time=2024-09-12T19:32:51.714268+0000, chain.objs.size()=1 2024-09-12T17:41:32.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.496+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.PzsJXN4ocInJltRc3nf5UyDDKy2vkMX_0 2024-09-12T17:41:32.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.496+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15839656709298528325', time=2024-09-12T19:32:51.855739+0000, chain.objs.size()=1 2024-09-12T17:41:32.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.496+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Emp6FSsx7zJT_qmSiGTJfzZhnOjKwkV_0 2024-09-12T17:41:32.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.496+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16991526287115303382', time=2024-09-12T19:32:51.925697+0000, chain.objs.size()=1 2024-09-12T17:41:32.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.496+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.RPvqZ_6TJ7Iryg9CTmN4jKRrE18Qx16_0 2024-09-12T17:41:32.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.496+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7301095852041630525', time=2024-09-12T19:32:51.929562+0000, chain.objs.size()=1 2024-09-12T17:41:32.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.496+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.NkOh5PQHZynGvIq0O9WyIDQgMVfHEGD_0 2024-09-12T17:41:32.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.496+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17261906947264241205', time=2024-09-12T19:32:51.976120+0000, chain.objs.size()=1 2024-09-12T17:41:32.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.496+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.envEGokegLXcq5R8jmO9YBN6KUFPCmG_0 2024-09-12T17:41:32.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.500+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18342448016942903457', time=2024-09-12T19:33:05.114968+0000, chain.objs.size()=1 2024-09-12T17:41:32.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.500+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.369__shadow_.CFHuDXKkWmM0RSj2rIVctpZrQKss8DC_0 2024-09-12T17:41:32.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.500+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16970778282354881575', time=2024-09-12T19:33:33.820032+0000, chain.objs.size()=1 2024-09-12T17:41:32.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.500+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.443__shadow_.CTGOfZ7ADbnsyccRiFehldFJlP5JJ71_0 2024-09-12T17:41:32.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.500+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11164177847723026080', time=2024-09-12T19:33:50.780933+0000, chain.objs.size()=1 2024-09-12T17:41:32.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.500+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.486__shadow_.tiLpJlO_9bpE2kYIp-B2lb00Y0hNJVH_0 2024-09-12T17:41:32.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.500+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~Y1welDbiA7hHGp-Q1c8WnwxIKrl65Vh', time=2024-09-12T19:34:29.265715+0000, chain.objs.size()=2 2024-09-12T17:41:32.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.500+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.531__multipart_mymultipart.2~Y1welDbiA7hHGp-Q1c8WnwxIKrl65Vh.1 2024-09-12T17:41:32.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.500+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.531__multipart_mymultipart.2~Y1welDbiA7hHGp-Q1c8WnwxIKrl65Vh.2 2024-09-12T17:41:32.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.500+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5620625415762882522', time=2024-09-12T19:35:14.206385+0000, chain.objs.size()=1 2024-09-12T17:41:32.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.500+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.565__shadow_.cFWoMc3GpK-c32ElxDLHuGe4UJr0hf5_0 2024-09-12T17:41:32.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.500+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2963383204038688467', time=2024-09-12T19:35:29.909834+0000, chain.objs.size()=1 2024-09-12T17:41:32.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.500+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.575__shadow_.2JfX8uJKphm_KkDYUg9VKPZNF_-1kk1_0 2024-09-12T17:41:32.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.500+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13222313226323141990', time=2024-09-12T19:38:42.196695+0000, chain.objs.size()=1 2024-09-12T17:41:32.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.500+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.663__shadow_.ME3AU9zqaoPafP3WBJLvacG1bAiTzjj_0 2024-09-12T17:41:32.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.500+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.272703349394043911', time=2024-09-12T19:38:56.146126+0000, chain.objs.size()=1 2024-09-12T17:41:32.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.500+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.702__multipart_file1.2~eiuxVb5ftMGI0YM4NQ5FrYeKKXO0F_4.1 2024-09-12T17:41:32.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.500+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12303996477636999625', time=2024-09-12T19:38:58.254366+0000, chain.objs.size()=1 2024-09-12T17:41:32.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.500+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.707__shadow:mlq2lF9K7ONI1AU6vTCx3QjhhzHfvMV_.7EIgJm8dAgqm0OuqIDF0ar1sNqsB4V6_0 2024-09-12T17:41:32.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.500+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17434782685819240762', time=2024-09-12T19:39:00.229901+0000, chain.objs.size()=1 2024-09-12T17:41:32.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.500+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.712__shadow:w1S6kB0.R3BDSvPQfMipCwmaQib3aEa_.3WpDzgeGt1xMRe9Lu7kuLD-oR6BvepX_0 2024-09-12T17:41:32.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.500+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4514386593299364884', time=2024-09-12T19:39:28.696651+0000, chain.objs.size()=10 2024-09-12T17:41:32.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.500+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.735__multipart_foo.2~QeLWD3AmloCghf-VW71D5aV1ukLkZbS.1 2024-09-12T17:41:32.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.500+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.735__multipart_foo.2~QeLWD3AmloCghf-VW71D5aV1ukLkZbS.2 2024-09-12T17:41:32.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.500+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.735__multipart_foo.2~QeLWD3AmloCghf-VW71D5aV1ukLkZbS.3 2024-09-12T17:41:32.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.504+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.735__multipart_foo.2~QeLWD3AmloCghf-VW71D5aV1ukLkZbS.4 2024-09-12T17:41:32.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.504+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.735__multipart_foo.2~QeLWD3AmloCghf-VW71D5aV1ukLkZbS.5 2024-09-12T17:41:32.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.504+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.735__multipart_foo.2~QeLWD3AmloCghf-VW71D5aV1ukLkZbS.6 2024-09-12T17:41:32.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.504+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.735__multipart_foo.2~QeLWD3AmloCghf-VW71D5aV1ukLkZbS.7 2024-09-12T17:41:32.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.504+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.735__multipart_foo.2~QeLWD3AmloCghf-VW71D5aV1ukLkZbS.8 2024-09-12T17:41:32.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.504+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.735__multipart_foo.2~QeLWD3AmloCghf-VW71D5aV1ukLkZbS.9 2024-09-12T17:41:32.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.504+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.735__multipart_foo.2~QeLWD3AmloCghf-VW71D5aV1ukLkZbS.10 2024-09-12T17:41:32.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.508+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:41:32.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.508+0000 7fd765adf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:41:32.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.512+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:41:32.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.512+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:41:32.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.512+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/52361' 2024-09-12T17:41:32.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.512+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9299247376834930714', time=2024-09-12T19:31:15.405815+0000, chain.objs.size()=1 2024-09-12T17:41:32.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.512+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.242__shadow_.zpcbxb5XwlhBAx1nwzlLTpneBpAwWL-_0 2024-09-12T17:41:32.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.512+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5019344685110135266', time=2024-09-12T19:31:15.408004+0000, chain.objs.size()=1 2024-09-12T17:41:32.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.512+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.242__shadow_.qlT470QgIN2qyTZn7RLhl8JbWhdOHCl_0 2024-09-12T17:41:32.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.512+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13130953866905936240', time=2024-09-12T19:31:22.505467+0000, chain.objs.size()=1 2024-09-12T17:41:32.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.512+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.260__shadow_.88JSLg7E1KJNNNTysvdtZRwC2AKZAiA_0 2024-09-12T17:41:32.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.512+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10101916514503953871', time=2024-09-12T19:31:42.423442+0000, chain.objs.size()=1 2024-09-12T17:41:32.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.512+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.yx7959bSGXWIgmeQrBYyjHnjcEkHBq0_0 2024-09-12T17:41:32.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.512+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4539187691629993337', time=2024-09-12T19:31:42.437631+0000, chain.objs.size()=1 2024-09-12T17:41:32.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.512+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.zKYH2AC1JS9IdqhxyUbHGuZMHyF4bS6_0 2024-09-12T17:41:32.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.512+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17866973034015717785', time=2024-09-12T19:31:42.675557+0000, chain.objs.size()=1 2024-09-12T17:41:32.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.512+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.PpioDy65PjU87_KnKwz1zEa-wDWZurd_0 2024-09-12T17:41:32.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.512+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17640752550974745294', time=2024-09-12T19:31:42.772019+0000, chain.objs.size()=1 2024-09-12T17:41:32.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.512+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.I65Q5WB-OD7N9InkwK7BBmHl8XMPDH0_0 2024-09-12T17:41:32.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.512+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13743467150218799914', time=2024-09-12T19:31:42.792413+0000, chain.objs.size()=1 2024-09-12T17:41:32.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.512+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.NU5FkMpRX048tUa94IHgV4zSADFblOv_0 2024-09-12T17:41:32.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.512+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12826174078491145366', time=2024-09-12T19:31:42.825330+0000, chain.objs.size()=1 2024-09-12T17:41:32.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.512+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.1ctSddpegZHLfwtr4f6gRI1ndu8ceIP_0 2024-09-12T17:41:32.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.512+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5428098149671322481', time=2024-09-12T19:31:42.839057+0000, chain.objs.size()=1 2024-09-12T17:41:32.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.512+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.q7_J24BOp2cSyoEOYng_sr3K-9gDieA_0 2024-09-12T17:41:32.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.512+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15296908300388855972', time=2024-09-12T19:31:42.840250+0000, chain.objs.size()=1 2024-09-12T17:41:32.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.512+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.YsGEQrQPdFcSzMCAamFzeq_cIntloqs_0 2024-09-12T17:41:32.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.512+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.811010720924142009', time=2024-09-12T19:31:42.842298+0000, chain.objs.size()=1 2024-09-12T17:41:32.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.512+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.RJ_mPqO4hI5rY4cgxc3izqSnzBfrmzs_0 2024-09-12T17:41:32.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.516+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.477092832458577206', time=2024-09-12T19:31:42.853073+0000, chain.objs.size()=1 2024-09-12T17:41:32.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.516+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.DuVdeGlRnvXcmZoRr9iNdOSJwUrWPi9_0 2024-09-12T17:41:32.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.516+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13367231382333990255', time=2024-09-12T19:31:42.923848+0000, chain.objs.size()=1 2024-09-12T17:41:32.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.516+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.05jorgIKDOPawi5mFXE-X2ByW72pnxW_0 2024-09-12T17:41:32.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.516+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8408942097921789963', time=2024-09-12T19:31:43.080990+0000, chain.objs.size()=1 2024-09-12T17:41:32.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.516+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.73dtRJSNYIQd9kPcLS3OEiMy4mtzZpR_0 2024-09-12T17:41:32.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.516+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12427280817163003154', time=2024-09-12T19:31:43.090896+0000, chain.objs.size()=1 2024-09-12T17:41:32.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.516+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.mD5F49pBPc7G2XBOg7VJorqYjylv6dL_0 2024-09-12T17:41:32.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.516+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18197606258260704279', time=2024-09-12T19:31:43.094213+0000, chain.objs.size()=1 2024-09-12T17:41:32.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.516+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.vRfn-a5TGyjyI0ebG5E_IROOkdG3YZt_0 2024-09-12T17:41:32.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.516+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12743500688386704266', time=2024-09-12T19:31:43.108811+0000, chain.objs.size()=1 2024-09-12T17:41:32.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.516+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.pP1ta4nwBjvAlCbiPOj08lX42mx43qa_0 2024-09-12T17:41:32.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.516+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13707543298778716480', time=2024-09-12T19:31:43.120135+0000, chain.objs.size()=1 2024-09-12T17:41:32.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.516+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.WdaSlzZmn5RmRpfbpwdGmxM-94IjPHw_0 2024-09-12T17:41:32.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.516+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5700298962484326250', time=2024-09-12T19:31:43.126079+0000, chain.objs.size()=1 2024-09-12T17:41:32.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.516+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.R5doaZE3sPAZvtxl1ZWEpyaJshdokvn_0 2024-09-12T17:41:32.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.516+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3683965449009538413', time=2024-09-12T19:31:43.156804+0000, chain.objs.size()=1 2024-09-12T17:41:32.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.516+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.iMZMICYBXIwW64_qK3p1oc6bIqu5Z6A_0 2024-09-12T17:41:32.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.516+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6284442953056140866', time=2024-09-12T19:31:43.190613+0000, chain.objs.size()=1 2024-09-12T17:41:32.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.516+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.5BGZeK70wfDTMohNUyYZEltSwyIQn7M_0 2024-09-12T17:41:32.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.516+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11945642071992728985', time=2024-09-12T19:31:43.251592+0000, chain.objs.size()=1 2024-09-12T17:41:32.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.516+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.1uxVVqj0tr5uvsi4vM4blqAQVrQ3TvC_0 2024-09-12T17:41:32.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.516+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4956210123865981663', time=2024-09-12T19:31:43.252189+0000, chain.objs.size()=1 2024-09-12T17:41:32.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.516+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.7HF9qS1ju5QMIRoH5OdRKT6_WgoRT-p_0 2024-09-12T17:41:32.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.516+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6583028332248895286', time=2024-09-12T19:31:43.276890+0000, chain.objs.size()=1 2024-09-12T17:41:32.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.516+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.-Csswfe75sUULb1WFpALFlI26_pt4mW_0 2024-09-12T17:41:32.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.516+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9512700649704460826', time=2024-09-12T19:31:43.434582+0000, chain.objs.size()=1 2024-09-12T17:41:32.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.516+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.vZOBE3W0aMg1VJVibudi9pdo9cpA4Vm_0 2024-09-12T17:41:32.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.520+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17863023104219756000', time=2024-09-12T19:31:43.455729+0000, chain.objs.size()=1 2024-09-12T17:41:32.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.520+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.fEVQc2IGwLfCR3iqk2thTetryoDX_2W_0 2024-09-12T17:41:32.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.520+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16756179315846108286', time=2024-09-12T19:31:43.464096+0000, chain.objs.size()=1 2024-09-12T17:41:32.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.520+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.8rca4xVL1VxS3tJumtgqB9H8bcx_vAy_0 2024-09-12T17:41:32.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.520+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1502757525968095646', time=2024-09-12T19:31:43.471988+0000, chain.objs.size()=1 2024-09-12T17:41:32.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.520+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.r99sX2wwwRXzQVv3B0RKFsp5GH0dkoQ_0 2024-09-12T17:41:32.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.520+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2641178156709587144', time=2024-09-12T19:31:43.514813+0000, chain.objs.size()=1 2024-09-12T17:41:32.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.520+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Idmn_Y64VFVeUCJ10fUaMWj9741vUel_0 2024-09-12T17:41:32.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.520+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13490008097850380485', time=2024-09-12T19:31:43.727893+0000, chain.objs.size()=1 2024-09-12T17:41:32.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.520+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.pSWxe-yx3yhqmJqBMW2rYMTPbR3Ma5K_0 2024-09-12T17:41:32.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.520+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12371889524072707655', time=2024-09-12T19:31:43.910601+0000, chain.objs.size()=1 2024-09-12T17:41:32.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.520+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.nP-68yZSL30hfQM-IZxZE2FrgLzouWS_0 2024-09-12T17:41:32.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.520+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1338242483422246641', time=2024-09-12T19:31:44.118578+0000, chain.objs.size()=1 2024-09-12T17:41:32.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.520+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.jxxG_VV8JiYndY8LLAmjFnWAhgcMSUW_0 2024-09-12T17:41:32.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.520+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.196952186480234531', time=2024-09-12T19:31:44.153216+0000, chain.objs.size()=1 2024-09-12T17:41:32.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.520+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.wDFBzg4fzOFe9vPu_JtjQYrN9uh5zll_0 2024-09-12T17:41:32.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.520+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16149473606056180817', time=2024-09-12T19:31:44.235604+0000, chain.objs.size()=1 2024-09-12T17:41:32.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.520+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.nB1_EBSYqU5sYEoN7FX6cdhUI47W-83_0 2024-09-12T17:41:32.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.520+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.224555540972163926', time=2024-09-12T19:31:44.256370+0000, chain.objs.size()=1 2024-09-12T17:41:32.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.520+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.9W61gVbykVkF_unO_UfQ_ChyEpAJGPb_0 2024-09-12T17:41:32.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.520+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12684848117355780434', time=2024-09-12T19:31:44.426092+0000, chain.objs.size()=1 2024-09-12T17:41:32.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.520+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.7JnLRhzHcC9M_NNf7IqkARiNn_e967d_0 2024-09-12T17:41:32.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.520+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8108518344523625892', time=2024-09-12T19:31:44.453510+0000, chain.objs.size()=1 2024-09-12T17:41:32.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.520+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.thDN_w4FixiSsAzlxgrdfjZa2J8yLsP_0 2024-09-12T17:41:32.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.520+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12893495730891288262', time=2024-09-12T19:31:44.458332+0000, chain.objs.size()=1 2024-09-12T17:41:32.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.520+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.EtMhv3oRpMR1catvSNQE0A81W4jjBqT_0 2024-09-12T17:41:32.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.520+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9726504177750391591', time=2024-09-12T19:31:44.465500+0000, chain.objs.size()=1 2024-09-12T17:41:32.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.520+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.hiSn0jMdBA0sAV6acKxW2Y4jQB10NLw_0 2024-09-12T17:41:32.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.520+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17189395174966459988', time=2024-09-12T19:31:44.487313+0000, chain.objs.size()=1 2024-09-12T17:41:32.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.520+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.NWQEHEgf-9vygeDWr97wIloaEqh8uiO_0 2024-09-12T17:41:32.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.520+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11061369018772430029', time=2024-09-12T19:31:50.260433+0000, chain.objs.size()=1 2024-09-12T17:41:32.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.520+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.278__shadow_.wIQVVr_HkatUQo78M2YjOGsBKI1H4iB_0 2024-09-12T17:41:32.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.520+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5406322248114022712', time=2024-09-12T19:31:52.203422+0000, chain.objs.size()=1 2024-09-12T17:41:32.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.520+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.283__shadow_.omANrQT0ycQ9rMYqts_hn8v09raI10M_0 2024-09-12T17:41:32.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.520+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13719771750478961160', time=2024-09-12T19:31:53.436629+0000, chain.objs.size()=1 2024-09-12T17:41:32.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.520+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.286__shadow_.jnP1tNSudHEqUZHwu7ZHox-vfUCnIqw_0 2024-09-12T17:41:32.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.520+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8252120404881769077', time=2024-09-12T19:31:54.241022+0000, chain.objs.size()=1 2024-09-12T17:41:32.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.520+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.288__shadow_.83jyVWsTS97RtAaeSWUfblCzNImbEnl_0 2024-09-12T17:41:32.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.524+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15952327332780005052', time=2024-09-12T19:31:56.452171+0000, chain.objs.size()=1 2024-09-12T17:41:32.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.524+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.292__shadow_.vf4fvYOsrcbIArjC7AU0xTi_WIFKzL3_0 2024-09-12T17:41:32.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.524+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12246084594544852276', time=2024-09-12T19:31:57.613290+0000, chain.objs.size()=1 2024-09-12T17:41:32.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.524+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.293__shadow_.dEeovvbimEzO0hJKHT_SSH_8FmQviKg_0 2024-09-12T17:41:32.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.524+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3414340760560117880', time=2024-09-12T19:31:58.740950+0000, chain.objs.size()=1 2024-09-12T17:41:32.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.524+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.296__shadow_.WwrpDKGS2w8sYM2Dm-FI7Hc-QZd6t0R_0 2024-09-12T17:41:32.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.524+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.906959645294769659', time=2024-09-12T19:32:02.319967+0000, chain.objs.size()=1 2024-09-12T17:41:32.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.524+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.305__shadow_.qUdGWZd6KB4krQtxflFJve908bnSHHc_0 2024-09-12T17:41:32.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.524+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11350313503920917971', time=2024-09-12T19:32:27.994750+0000, chain.objs.size()=1 2024-09-12T17:41:32.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.524+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.G8TJjuVzGsRChUANHLM7uAJQJSl5B00_0 2024-09-12T17:41:32.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.524+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11153118667069481258', time=2024-09-12T19:32:28.149104+0000, chain.objs.size()=1 2024-09-12T17:41:32.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.524+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.QZcz2en9fbLWW9_IoQFNX81DlDuNbEM_0 2024-09-12T17:41:32.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.524+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15968089663980915044', time=2024-09-12T19:32:28.171654+0000, chain.objs.size()=1 2024-09-12T17:41:32.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.524+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.NC3WDpF4rf7MrwQ3Z75axqqHH8AV_3c_0 2024-09-12T17:41:32.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.524+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13962356421050351389', time=2024-09-12T19:32:28.220992+0000, chain.objs.size()=1 2024-09-12T17:41:32.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.524+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.HpJBncJdoLBAM279fH1oGfVHIEbhcnM_0 2024-09-12T17:41:32.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.524+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18330393055361755288', time=2024-09-12T19:32:28.250045+0000, chain.objs.size()=1 2024-09-12T17:41:32.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.524+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_._47e1jT2A4kw__QMciDXEYfi2DRhDWV_0 2024-09-12T17:41:32.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.524+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5908867221583094822', time=2024-09-12T19:32:28.320010+0000, chain.objs.size()=1 2024-09-12T17:41:32.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.524+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.EekPSu0C1sBQLCcuCOlec54H4Y7oQup_0 2024-09-12T17:41:32.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.524+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2247119822999141153', time=2024-09-12T19:32:28.438386+0000, chain.objs.size()=1 2024-09-12T17:41:32.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.524+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.cL3nGLtp_LasSHDf6r3-LVcAmU5NTG3_0 2024-09-12T17:41:32.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.524+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8470725329473322921', time=2024-09-12T19:32:28.462233+0000, chain.objs.size()=1 2024-09-12T17:41:32.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.524+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.BbgdI-FuLoVnbsMgjhOX9dWRNlZbPGE_0 2024-09-12T17:41:32.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.524+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8099714597696000104', time=2024-09-12T19:32:28.483527+0000, chain.objs.size()=1 2024-09-12T17:41:32.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.524+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.mNnf1BMIIBn4Q7l4RZnf_xz_Ik2ZvhV_0 2024-09-12T17:41:32.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.524+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8845123247142833461', time=2024-09-12T19:32:28.548977+0000, chain.objs.size()=1 2024-09-12T17:41:32.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.524+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.JMtXrWd-e_ur4asGYcZ9urMY-wvfxDM_0 2024-09-12T17:41:32.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.524+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14961429529136433172', time=2024-09-12T19:32:28.741947+0000, chain.objs.size()=1 2024-09-12T17:41:32.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.524+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.pJekUfeDFnkeBBh-LoVk0XtUqe0HgWS_0 2024-09-12T17:41:32.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.524+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14664014550575650500', time=2024-09-12T19:32:28.750050+0000, chain.objs.size()=1 2024-09-12T17:41:32.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.524+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.GEPQjY21oKe31T8DWnxeJ5yFPdPCMey_0 2024-09-12T17:41:32.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.524+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12989778877199934467', time=2024-09-12T19:32:28.872079+0000, chain.objs.size()=1 2024-09-12T17:41:32.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.524+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.NGTP046UvYDPlXeLb65aFHD0JGW1vkP_0 2024-09-12T17:41:32.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.524+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4817384168940626576', time=2024-09-12T19:32:29.041046+0000, chain.objs.size()=1 2024-09-12T17:41:32.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.524+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.IBpaaNiWzplxhHx6d0gm-9ZDY_Y0_hA_0 2024-09-12T17:41:32.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.524+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5571667336092514336', time=2024-09-12T19:32:29.136168+0000, chain.objs.size()=1 2024-09-12T17:41:32.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.524+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.D-Pzi-fkAtdyAcBFEbBX4Vpjam8nfei_0 2024-09-12T17:41:32.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.524+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12091158833017365541', time=2024-09-12T19:32:29.158743+0000, chain.objs.size()=1 2024-09-12T17:41:32.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.524+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.pLG7hGJOvIDEvspge4y1s1KE6y39k1F_0 2024-09-12T17:41:32.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.528+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10843592307795632395', time=2024-09-12T19:32:29.184168+0000, chain.objs.size()=1 2024-09-12T17:41:32.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.528+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.IFV-I9Vkb-XO-tmVeIS5YZJgs5z2hj9_0 2024-09-12T17:41:32.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.528+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16571660272219330195', time=2024-09-12T19:32:29.349780+0000, chain.objs.size()=1 2024-09-12T17:41:32.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.528+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.WPsscWnG8A28I5s8SxWbmBnVoGhmCwV_0 2024-09-12T17:41:32.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.528+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3890378699993605655', time=2024-09-12T19:32:29.354255+0000, chain.objs.size()=1 2024-09-12T17:41:32.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.528+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.v1_YXd7xcqHgZmchGKOYGdpkYlEAQmc_0 2024-09-12T17:41:32.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.528+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.591942148837268206', time=2024-09-12T19:32:29.452363+0000, chain.objs.size()=1 2024-09-12T17:41:32.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.528+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.w14KPb1W5WUZorlKmBBEKSATtwqOzur_0 2024-09-12T17:41:32.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.528+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14874268460090095916', time=2024-09-12T19:32:29.514804+0000, chain.objs.size()=1 2024-09-12T17:41:32.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.528+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.RCIDwkCfaKax1DYg4-ZiSRD4teZyEAw_0 2024-09-12T17:41:32.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.528+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2228569935277531004', time=2024-09-12T19:32:29.539040+0000, chain.objs.size()=1 2024-09-12T17:41:32.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.528+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.movMTnF2xZ1XuZBzaTkXwXkmDlMudom_0 2024-09-12T17:41:32.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.528+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3908480084393073595', time=2024-09-12T19:32:29.783759+0000, chain.objs.size()=1 2024-09-12T17:41:32.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.528+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Nm-nCZHAfPaXkXGiIt3mEq8qyUDBrwx_0 2024-09-12T17:41:32.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.528+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4383705937940207190', time=2024-09-12T19:32:29.800484+0000, chain.objs.size()=1 2024-09-12T17:41:32.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.528+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.xeKCbgvShBrT9toy4TxHoViD7WRZCkc_0 2024-09-12T17:41:32.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.528+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4479634723051569800', time=2024-09-12T19:32:29.871367+0000, chain.objs.size()=1 2024-09-12T17:41:32.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.528+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.76QFAijgZMUslegmK18IvID8eYpLa2M_0 2024-09-12T17:41:32.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.528+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.240668275527022634', time=2024-09-12T19:32:30.037057+0000, chain.objs.size()=1 2024-09-12T17:41:32.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.528+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.HKfnItDzwbf-ayb4o0CLhbW5yDeNpF5_0 2024-09-12T17:41:32.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.528+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6758371941817125996', time=2024-09-12T19:32:30.064655+0000, chain.objs.size()=1 2024-09-12T17:41:32.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.528+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Ax31hRmGGVBf8RGsnv7RMXrdrj3wSIZ_0 2024-09-12T17:41:32.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.528+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16808707505497284347', time=2024-09-12T19:32:30.080271+0000, chain.objs.size()=1 2024-09-12T17:41:32.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.528+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.5A8eQAEuZMMMK3UXgxMOoaN7cOoESp3_0 2024-09-12T17:41:32.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.528+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4285024430912992536', time=2024-09-12T19:32:30.150112+0000, chain.objs.size()=1 2024-09-12T17:41:32.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.528+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.YEkzwqnoU9qorKZE-ISEmO1_B5NZRVi_0 2024-09-12T17:41:32.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.528+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8487678859848075160', time=2024-09-12T19:32:49.516579+0000, chain.objs.size()=1 2024-09-12T17:41:32.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.528+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.E-qlateQyLP1Eei4DgL73OON00jxq9j_0 2024-09-12T17:41:32.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.528+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3843541122400676801', time=2024-09-12T19:32:49.683208+0000, chain.objs.size()=1 2024-09-12T17:41:32.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.528+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.HV57fkx9mM4ifq7oQLB21WgkvuvfBj__0 2024-09-12T17:41:32.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.528+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17264094623155850377', time=2024-09-12T19:32:49.858389+0000, chain.objs.size()=1 2024-09-12T17:41:32.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.528+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.JYs6Y51B6_453DPVH_gzEB03e8-BNVs_0 2024-09-12T17:41:32.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.528+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5499791133733835705', time=2024-09-12T19:32:50.324243+0000, chain.objs.size()=1 2024-09-12T17:41:32.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.528+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.WuXSuY5CvSDaxIlApys8SOm8O2MQKFo_0 2024-09-12T17:41:32.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.532+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9301929972123473237', time=2024-09-12T19:32:50.468997+0000, chain.objs.size()=1 2024-09-12T17:41:32.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.532+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.SE-mXbEgNowN3_KmVhxKbmYGxcDOKJK_0 2024-09-12T17:41:32.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.532+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13875117146480000426', time=2024-09-12T19:32:50.507756+0000, chain.objs.size()=1 2024-09-12T17:41:32.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.532+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.PYoG0IBKpjDKvQddxFfH8QSiNxB5LaL_0 2024-09-12T17:41:32.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.532+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3118877604358659137', time=2024-09-12T19:32:50.536839+0000, chain.objs.size()=1 2024-09-12T17:41:32.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.532+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.pS2E32G8ZvUQoiYVreZp6yCVOcndZ8Y_0 2024-09-12T17:41:32.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.532+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1437610752504362495', time=2024-09-12T19:32:50.557187+0000, chain.objs.size()=1 2024-09-12T17:41:32.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.532+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.HXdTtLjiQeCBSqn8iSIiSD1TOqkJJf3_0 2024-09-12T17:41:32.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.532+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10957115168979433043', time=2024-09-12T19:32:50.586317+0000, chain.objs.size()=1 2024-09-12T17:41:32.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.532+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.-Y1N621-57IUBCrqUKpbhav1Kf50SSJ_0 2024-09-12T17:41:32.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.532+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7712912695934200764', time=2024-09-12T19:32:50.841879+0000, chain.objs.size()=1 2024-09-12T17:41:32.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.532+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.P4EuAL-EPOA1t-hPyTIZsPs8RFIfrMT_0 2024-09-12T17:41:32.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.532+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13170521489739882708', time=2024-09-12T19:32:50.990211+0000, chain.objs.size()=1 2024-09-12T17:41:32.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.532+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.AD-Bs0AX5ijH9KRatBpfJjIeX3ECV-b_0 2024-09-12T17:41:32.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.532+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10098109576025671897', time=2024-09-12T19:32:51.022702+0000, chain.objs.size()=1 2024-09-12T17:41:32.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.532+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.l_SwjwihiJosMW35m-GkIMARIK3llgX_0 2024-09-12T17:41:32.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.532+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16717647335843207363', time=2024-09-12T19:32:51.163533+0000, chain.objs.size()=1 2024-09-12T17:41:32.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.532+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.RvGYIoDnD49NKImON21mHMBgbODR9nB_0 2024-09-12T17:41:32.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.532+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.856671399548745143', time=2024-09-12T19:32:51.186224+0000, chain.objs.size()=1 2024-09-12T17:41:32.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.532+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.1agsnN3qEmpBY1vnt5NfbhegpjVQNVP_0 2024-09-12T17:41:32.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.532+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12488442787570935059', time=2024-09-12T19:32:51.201585+0000, chain.objs.size()=1 2024-09-12T17:41:32.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.532+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_._o-hQLT9wWniC8TcHgRIunZtbBOfl_y_0 2024-09-12T17:41:32.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.532+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17424673675331211632', time=2024-09-12T19:32:51.335452+0000, chain.objs.size()=1 2024-09-12T17:41:32.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.532+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.j0gdfgTuhchn2UaQEHlj-ZROI0Fcg8L_0 2024-09-12T17:41:32.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.532+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18134660009183773793', time=2024-09-12T19:32:51.508556+0000, chain.objs.size()=1 2024-09-12T17:41:32.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.532+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.QByTxteVWUSrbZT7vBUHNxL3jsFwhjp_0 2024-09-12T17:41:32.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.532+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6925688304214078435', time=2024-09-12T19:32:51.549287+0000, chain.objs.size()=1 2024-09-12T17:41:32.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.532+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.RQyIiPnlMVqUUuHRlBS1nu9fy56pFSK_0 2024-09-12T17:41:32.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.532+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11848206162473348327', time=2024-09-12T19:32:51.570302+0000, chain.objs.size()=1 2024-09-12T17:41:32.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.532+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Rw0gH1HUVZyZ8L130-Y0sz4_GkUXZU6_0 2024-09-12T17:41:32.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.536+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4094860123995033239', time=2024-09-12T19:32:51.580045+0000, chain.objs.size()=1 2024-09-12T17:41:32.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.536+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.kK-uJQNgd300E3vQgIx0Jj6UAHxzD-C_0 2024-09-12T17:41:32.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.536+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4551621476586085224', time=2024-09-12T19:32:51.606416+0000, chain.objs.size()=1 2024-09-12T17:41:32.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.536+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.E27faDEk_U5JYCNSiOJ-0dJRIGR3Vdj_0 2024-09-12T17:41:32.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.536+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10002087711802158102', time=2024-09-12T19:32:51.616353+0000, chain.objs.size()=1 2024-09-12T17:41:32.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.536+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.6rhlbBAQVP7AZecjH_R2YFtAyqCkWDe_0 2024-09-12T17:41:32.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.536+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/52361 2024-09-12T17:41:32.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.540+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=29, truncated=0, next_marker='' 2024-09-12T17:41:32.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.540+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15563103117079567695', time=2024-09-12T19:32:51.648538+0000, chain.objs.size()=1 2024-09-12T17:41:32.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.540+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.okW2H1w5A7C9EE7XgyOFNuKqK7uDfDP_0 2024-09-12T17:41:32.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.540+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2688042775628220174', time=2024-09-12T19:32:51.655965+0000, chain.objs.size()=1 2024-09-12T17:41:32.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.540+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.0y3T2vITfRUleRCZwuJweVKBonrHE_H_0 2024-09-12T17:41:32.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.540+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2475203879015821991', time=2024-09-12T19:32:51.866603+0000, chain.objs.size()=1 2024-09-12T17:41:32.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.540+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.lsivgt7O54jaGBAqFK-EBRWQhA_UT9d_0 2024-09-12T17:41:32.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.540+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6439697576360515468', time=2024-09-12T19:32:51.924939+0000, chain.objs.size()=1 2024-09-12T17:41:32.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.540+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.eU5JvP2x2sJdfrqvdzapt751fCmRGa2_0 2024-09-12T17:41:32.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.540+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13166795969446275323', time=2024-09-12T19:32:51.932547+0000, chain.objs.size()=1 2024-09-12T17:41:32.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.540+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.hwxV25DFwiVmoD0PFNwh3co9GCBaVly_0 2024-09-12T17:41:32.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.540+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6890154679376327343', time=2024-09-12T19:33:06.565984+0000, chain.objs.size()=1 2024-09-12T17:41:32.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.540+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.373__shadow_.0fvCfsnHZlvbJwnOmWLUfIsCILH3jFb_0 2024-09-12T17:41:32.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.540+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15763095429756280166', time=2024-09-12T19:33:10.650864+0000, chain.objs.size()=1 2024-09-12T17:41:32.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.540+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.381__shadow_.sce7suzmedeUB835SbEH9vXhHN_oaL2_0 2024-09-12T17:41:32.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.540+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12498134635358449868', time=2024-09-12T19:33:29.790663+0000, chain.objs.size()=1 2024-09-12T17:41:32.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.540+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.433__shadow_.39muyAvAW6dycWXyFtTCvH09b-HV3nV_0 2024-09-12T17:41:32.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.540+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7830254390601275747', time=2024-09-12T19:33:30.493662+0000, chain.objs.size()=1 2024-09-12T17:41:32.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.540+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.435__shadow_.DA5SnfWNCiHxgELw5JZgjcFVhzhXC9t_0 2024-09-12T17:41:32.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.540+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1981752440380521201', time=2024-09-12T19:33:36.553667+0000, chain.objs.size()=1 2024-09-12T17:41:32.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.540+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.450__shadow_.lLMllkQMOK6amncwgjeIKyQiqsFhB5n_0 2024-09-12T17:41:32.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.540+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15369106569832989178', time=2024-09-12T19:33:43.117189+0000, chain.objs.size()=1 2024-09-12T17:41:32.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.540+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.463__shadow_.N767sBrtzSypXKcSHuBUA5oAfea-gnz_0 2024-09-12T17:41:32.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.540+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.589458575300724717', time=2024-09-12T19:33:52.282303+0000, chain.objs.size()=1 2024-09-12T17:41:32.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.540+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.490__shadow_.qj5nnm0PAjbvsSvXzWxXhasAG4fo_ZI_0 2024-09-12T17:41:32.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.540+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.589458575300724717', time=2024-09-12T19:33:52.439376+0000, chain.objs.size()=1 2024-09-12T17:41:32.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.544+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.490__shadow_.qj5nnm0PAjbvsSvXzWxXhasAG4fo_ZI_0 2024-09-12T17:41:32.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.544+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16447960118623080023', time=2024-09-12T19:34:04.681012+0000, chain.objs.size()=1 2024-09-12T17:41:32.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.544+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.518__multipart_mymultipart.2~heBJ1CMMBo3jobdkFzCzTHCcQ5yajMa.1 2024-09-12T17:41:32.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.544+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.817559156333391390', time=2024-09-12T19:34:19.769145+0000, chain.objs.size()=6 2024-09-12T17:41:32.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.544+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__multipart_mymultipart.KivG91eniVkFgbj1dNXxyNI7wivNQv28.1 2024-09-12T17:41:32.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.544+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__multipart_mymultipart.1I2i9QM3nRaDXrFQnXFdgqvPUm4cXgUq.2 2024-09-12T17:41:32.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.544+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__multipart_mymultipart.JrYQdTE9VGbRBb8b4tvjXCAYqVciDltC.3 2024-09-12T17:41:32.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.544+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__multipart_mymultipart.nHbXjJjNllnIwijEjvCFyh4MtwOumm4o.4 2024-09-12T17:41:32.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.544+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__multipart_mymultipart.044DuNZcEQosURiwkjTbaRSlDAp_mVHN.5 2024-09-12T17:41:32.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.544+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__multipart_mymultipart.n9BT72zidsW6IwUnZiyph-WnqLrPyozm.6 2024-09-12T17:41:32.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.544+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2680269386633008292', time=2024-09-12T19:34:21.896826+0000, chain.objs.size()=3 2024-09-12T17:41:32.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.544+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.523__multipart_mymultipart.2~TXvIWiw_bPVPFtSNZRF_axfu6P98Yiv.1 2024-09-12T17:41:32.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.544+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.523__multipart_mymultipart.2~TXvIWiw_bPVPFtSNZRF_axfu6P98Yiv.2 2024-09-12T17:41:32.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.544+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.523__multipart_mymultipart.2~TXvIWiw_bPVPFtSNZRF_axfu6P98Yiv.3 2024-09-12T17:41:32.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.544+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9658208827169786741', time=2024-09-12T19:34:23.014014+0000, chain.objs.size()=2 2024-09-12T17:41:32.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.544+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.525__multipart_mymultipart.2~rPki1aRhboGd1PMihiBQoa_X_ejHByA.1 2024-09-12T17:41:32.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.544+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.525__shadow_mymultipart.2~rPki1aRhboGd1PMihiBQoa_X_ejHByA.1_1 2024-09-12T17:41:32.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.544+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16299565874496273935', time=2024-09-12T19:34:26.489912+0000, chain.objs.size()=4 2024-09-12T17:41:32.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.544+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.527__multipart_mymultipart.2~Bfp2duBtXjTOwejR8fJ8ZH4qLzJgEIo.1 2024-09-12T17:41:32.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.544+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.527__multipart_mymultipart.2~Bfp2duBtXjTOwejR8fJ8ZH4qLzJgEIo.2 2024-09-12T17:41:32.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.544+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.527__multipart_mymultipart.2~Bfp2duBtXjTOwejR8fJ8ZH4qLzJgEIo.3 2024-09-12T17:41:32.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.544+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.527__multipart_mymultipart.2~Bfp2duBtXjTOwejR8fJ8ZH4qLzJgEIo.4 2024-09-12T17:41:32.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.544+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.118653349288860065', time=2024-09-12T19:35:19.510718+0000, chain.objs.size()=1 2024-09-12T17:41:32.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.544+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.569__shadow:n3fveGjOgcM.wFH2ZEPPxqjK8MVhg.H_.AUgmRaPbwUq7skWI2MmkUmPPYtjSkrD_0 2024-09-12T17:41:32.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.544+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6178655766464596514', time=2024-09-12T19:35:25.181023+0000, chain.objs.size()=1 2024-09-12T17:41:32.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.544+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.572__shadow_.tSWHqbpm102Aqz9sGXnI0pkEujktx3c_0 2024-09-12T17:41:32.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.544+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14125064535239940828', time=2024-09-12T19:35:33.695844+0000, chain.objs.size()=1 2024-09-12T17:41:32.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.544+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.576__shadow:zkSHgNRfer8AZ7sisj9ktX30ji.lRXL_.DWjBOUwglB4qgILCyuiNx5XU_P-KKi0_0 2024-09-12T17:41:32.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.544+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12016538440762151441', time=2024-09-12T19:35:37.224157+0000, chain.objs.size()=1 2024-09-12T17:41:32.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.544+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.577__shadow:TurtBTgQ0aMCuLpxRj-oPsCjA7jRFEE_.VFUbQz2lP_bbSn8sW_L8fo0KWj1WgqD_0 2024-09-12T17:41:32.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.544+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5014917718153529067', time=2024-09-12T19:35:46.752654+0000, chain.objs.size()=1 2024-09-12T17:41:32.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.544+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.577__shadow:51oImUPAf7l9S87Zd9ZV4kHMpoO4C8j_._tEhHfzrUzJ2t3iEdQ4_H76xcC7aEOc_0 2024-09-12T17:41:32.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.548+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14436601914870634630', time=2024-09-12T19:35:54.160539+0000, chain.objs.size()=1 2024-09-12T17:41:32.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.548+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.579__shadow:0QNjgnOIvSVDbN.vKlUp6B02eDvxzp1_.H3x3En25mfVJYzb-SnAq3xLMozfmi5N_0 2024-09-12T17:41:32.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.548+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12316039277923082455', time=2024-09-12T19:35:58.997440+0000, chain.objs.size()=1 2024-09-12T17:41:32.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.548+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.587__shadow:2icug-ayCbvA1eaj3-jg4tVD5tgypEV_.beRlU6KMdRgd1wg1JBu72vdBjwXBq_n_0 2024-09-12T17:41:32.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.548+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11477136155388521804', time=2024-09-12T19:36:03.710998+0000, chain.objs.size()=1 2024-09-12T17:41:32.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.548+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.602__shadow_.tGzF3ORcLRSNeeAbD2hQ1ICYCM8Wrnx_0 2024-09-12T17:41:32.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.548+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6490034344879275519', time=2024-09-12T19:36:05.487609+0000, chain.objs.size()=1 2024-09-12T17:41:32.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.548+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.607__shadow_.q87zJcVRDsUJbqvc6gQ-1fNTyR-pPRg_0 2024-09-12T17:41:32.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.548+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10972274589428129673', time=2024-09-12T19:38:51.363357+0000, chain.objs.size()=1 2024-09-12T17:41:32.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.548+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.690__shadow:U0tWcCRmdgkjMCzjdnpQxgBiOtIoSWp_.mQtleQMO1y8wKJQKmrcgYmNnRQCHY9K_0 2024-09-12T17:41:32.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.548+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12900332315763837536', time=2024-09-12T19:38:52.229565+0000, chain.objs.size()=1 2024-09-12T17:41:32.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.548+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.692__shadow:pPCC6ZDPcjN9cQiGZAEsU9MsSmoiCZU_.liILl0paJabmtin-s3XjagOSarenFGE_0 2024-09-12T17:41:32.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.548+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:41:32.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.552+0000 7fd765adf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:41:32.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.552+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:41:32.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.556+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:41:32.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.556+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50671' 2024-09-12T17:41:32.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.556+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~FB4fa_qLPXOZKxKQzcaFp6sRbwhT4eT', time=2024-09-12T19:30:06.928256+0000, chain.objs.size()=1 2024-09-12T17:41:32.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.556+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.201__multipart_mymultipart.2~FB4fa_qLPXOZKxKQzcaFp6sRbwhT4eT.1 2024-09-12T17:41:32.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.556+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3730119556665760516', time=2024-09-12T19:31:12.221193+0000, chain.objs.size()=1 2024-09-12T17:41:32.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.556+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.234__shadow_.WgOUMpYphIv-x-8o3hYTclKwcwF0xwy_0 2024-09-12T17:41:32.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.556+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1953113593382594777', time=2024-09-12T19:31:15.899753+0000, chain.objs.size()=1 2024-09-12T17:41:32.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.556+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.243__shadow_._08gayFSbuH4TiTgMBs7RX0c6F1KEUp_0 2024-09-12T17:41:32.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.556+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9505428951175093798', time=2024-09-12T19:31:15.901750+0000, chain.objs.size()=1 2024-09-12T17:41:32.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.556+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.243__shadow_.xNeYLxvqktGhst4OhRe9VTmug5OhkA-_0 2024-09-12T17:41:32.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.556+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12188075393174659520', time=2024-09-12T19:31:42.251539+0000, chain.objs.size()=1 2024-09-12T17:41:32.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.556+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.c-0CIXE1NAVpnAsajzpGWQJQe7BqKDF_0 2024-09-12T17:41:32.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.556+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13976765096815650137', time=2024-09-12T19:31:42.270748+0000, chain.objs.size()=1 2024-09-12T17:41:32.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.556+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.w21sWCfO_jjhEOp42g_TqUSYcgHwyRJ_0 2024-09-12T17:41:32.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.556+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1998879484496891740', time=2024-09-12T19:31:42.276386+0000, chain.objs.size()=1 2024-09-12T17:41:32.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.556+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.YDTQ3J6ANMkgJFxl6PZ9efoXDc9Q11D_0 2024-09-12T17:41:32.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.556+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5444892335512462120', time=2024-09-12T19:31:42.361232+0000, chain.objs.size()=1 2024-09-12T17:41:32.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.556+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.fuoTdrflB5G_RA_RFq9i37NrdwwxUlM_0 2024-09-12T17:41:32.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.556+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16612904171629459356', time=2024-09-12T19:31:42.378214+0000, chain.objs.size()=1 2024-09-12T17:41:32.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.556+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.SMl0GRh8l69yFhZis2lO4lyFlNI-mY1_0 2024-09-12T17:41:32.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.556+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11992728778965709916', time=2024-09-12T19:31:42.412580+0000, chain.objs.size()=1 2024-09-12T17:41:32.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.556+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.LjEwTS2kvHiE9rzKFFL2UudvqwSa03G_0 2024-09-12T17:41:32.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.556+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14090343251841114629', time=2024-09-12T19:31:42.463345+0000, chain.objs.size()=1 2024-09-12T17:41:32.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.556+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Urb4mdloSJqdGuvT27VNoAvNr3unMXm_0 2024-09-12T17:41:32.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.556+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9503681487106377802', time=2024-09-12T19:31:42.551779+0000, chain.objs.size()=1 2024-09-12T17:41:32.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.556+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.1vEW9V3qwZ2O8i6YekvMDlNxt8CX7k6_0 2024-09-12T17:41:32.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.556+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6411882766088964169', time=2024-09-12T19:31:42.599160+0000, chain.objs.size()=1 2024-09-12T17:41:32.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.556+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Xrm8eqRrdPOQGjGquPENvMjjBkeP_Xg_0 2024-09-12T17:41:32.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.556+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10869740243247967429', time=2024-09-12T19:31:42.655361+0000, chain.objs.size()=1 2024-09-12T17:41:32.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.556+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.4QnxzJjWAqDVemIcdDWL1Y0MTCi-vuz_0 2024-09-12T17:41:32.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.556+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16416607711527596075', time=2024-09-12T19:31:42.765699+0000, chain.objs.size()=1 2024-09-12T17:41:32.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.556+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.dzcTy0Gi-GKlu4CKwdmbpQvvu9v56Y0_0 2024-09-12T17:41:32.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.556+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324152770110094087', time=2024-09-12T19:31:42.848867+0000, chain.objs.size()=1 2024-09-12T17:41:32.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.556+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.qnOzzUYSEjjsj_s33fMzsHkf91PyAmB_0 2024-09-12T17:41:32.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.556+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4153170400633735689', time=2024-09-12T19:31:42.851802+0000, chain.objs.size()=1 2024-09-12T17:41:32.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.556+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.S8G0eLkKBTWlO85slj86etD7xhPXuun_0 2024-09-12T17:41:32.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.556+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11981868684489194524', time=2024-09-12T19:31:42.905369+0000, chain.objs.size()=1 2024-09-12T17:41:32.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.560+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.dJEEbVknXaG50ddOSSZD_qNWEa2mUiB_0 2024-09-12T17:41:32.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.560+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10016855421725709367', time=2024-09-12T19:31:43.071227+0000, chain.objs.size()=1 2024-09-12T17:41:32.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.560+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.TjcsySg27EK4ZjK5z6nqJjRxK9phDyX_0 2024-09-12T17:41:32.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.560+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12299958060084871975', time=2024-09-12T19:31:43.174199+0000, chain.objs.size()=1 2024-09-12T17:41:32.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.560+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.CO4zdr3j4jjk6XP-h5Nhcq8-OlIdjIv_0 2024-09-12T17:41:32.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.560+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7653362312946322639', time=2024-09-12T19:31:43.186270+0000, chain.objs.size()=1 2024-09-12T17:41:32.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.560+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.4JP0NkRnMSowbnl9vu8SVjQpTYDN2T-_0 2024-09-12T17:41:32.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.560+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10500393373346742124', time=2024-09-12T19:31:43.189783+0000, chain.objs.size()=1 2024-09-12T17:41:32.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.560+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.sgzWIqqUlUhTqMR8xBQiK5Ys_5laVrL_0 2024-09-12T17:41:32.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.560+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6955200249733712416', time=2024-09-12T19:31:43.221552+0000, chain.objs.size()=1 2024-09-12T17:41:32.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.560+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.k3TVXxhRNKPz0rWCij8Od9fG3zZGMGg_0 2024-09-12T17:41:32.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.560+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2426800004787409933', time=2024-09-12T19:31:43.442675+0000, chain.objs.size()=1 2024-09-12T17:41:32.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.560+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.kLk0XSdIUOrUsCMiGIJhXu0spnTsP1r_0 2024-09-12T17:41:32.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.560+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.778876290801145428', time=2024-09-12T19:31:43.510542+0000, chain.objs.size()=1 2024-09-12T17:41:32.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.560+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.TsGsBXwYefiIKkG08_qcJ4w0oiLN0O1_0 2024-09-12T17:41:32.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.560+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15881563286545995097', time=2024-09-12T19:31:43.546698+0000, chain.objs.size()=1 2024-09-12T17:41:32.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.560+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.JSHhyhNqwr8j0Nyone7rPX8XSd9o6-u_0 2024-09-12T17:41:32.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.560+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2507112044196089586', time=2024-09-12T19:31:43.584876+0000, chain.objs.size()=1 2024-09-12T17:41:32.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.560+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.jqCR9nNvGtTqhgg3MS5Q8JonVJjZTHt_0 2024-09-12T17:41:32.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.560+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.173503113632390301', time=2024-09-12T19:31:43.620939+0000, chain.objs.size()=1 2024-09-12T17:41:32.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.560+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.pDYqN9uCH9ja0UOtl28vSYWfDfoS0Nq_0 2024-09-12T17:41:32.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.560+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13386022737154036177', time=2024-09-12T19:31:43.736506+0000, chain.objs.size()=1 2024-09-12T17:41:32.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.560+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.s86WU-mFsGT9SKx9PK1h64CSksBc1pr_0 2024-09-12T17:41:32.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.560+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9288345543539594008', time=2024-09-12T19:31:43.859749+0000, chain.objs.size()=1 2024-09-12T17:41:32.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.560+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.X54lDX_stv_sUUDi9dZcQtPNupAmoVp_0 2024-09-12T17:41:32.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.560+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2561118412096644096', time=2024-09-12T19:31:43.862759+0000, chain.objs.size()=1 2024-09-12T17:41:32.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.560+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.F57ZltzkdvyWAPpZXlKtXZVo4wwc5cf_0 2024-09-12T17:41:32.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.560+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2342190709596985734', time=2024-09-12T19:31:43.887362+0000, chain.objs.size()=1 2024-09-12T17:41:32.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.560+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.pbJNrUecctgXMF8FV8mrRonsmCqEM2e_0 2024-09-12T17:41:32.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.560+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6428433369543721830', time=2024-09-12T19:31:43.906936+0000, chain.objs.size()=1 2024-09-12T17:41:32.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.560+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.yzLY00a4d1ZsqLgQlSB935fMb7H4LSW_0 2024-09-12T17:41:32.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.560+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17730525830982277998', time=2024-09-12T19:31:43.921809+0000, chain.objs.size()=1 2024-09-12T17:41:32.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.560+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.RWnDKXVrklG7y-5XpDsdQY3ywTgUHpu_0 2024-09-12T17:41:32.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.560+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3212768332082490344', time=2024-09-12T19:31:44.080268+0000, chain.objs.size()=1 2024-09-12T17:41:32.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.560+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.3ftNKmaisA7MP2p-wz5iPQLEjeqM0A7_0 2024-09-12T17:41:32.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.560+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10285941622289022891', time=2024-09-12T19:31:44.090095+0000, chain.objs.size()=1 2024-09-12T17:41:32.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.560+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.NTyD-yg4IskVniz3UXxdR4f5kylkE_S_0 2024-09-12T17:41:32.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.560+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3459832439489054920', time=2024-09-12T19:31:44.158404+0000, chain.objs.size()=1 2024-09-12T17:41:32.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.560+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.nko85ZZMrz8_dEZ42917RtXQJZZLnju_0 2024-09-12T17:41:32.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.564+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17677722361838033679', time=2024-09-12T19:31:44.159263+0000, chain.objs.size()=1 2024-09-12T17:41:32.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.564+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.aSuWZ-o_faFe3wGB7_3PIu-0Ax4FGAH_0 2024-09-12T17:41:32.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.564+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6570155516595176179', time=2024-09-12T19:31:44.174265+0000, chain.objs.size()=1 2024-09-12T17:41:32.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.564+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.xneAyWAEdjWi4CbIJABuwYrcdozaozX_0 2024-09-12T17:41:32.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.564+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6135495746890157743', time=2024-09-12T19:31:44.180761+0000, chain.objs.size()=1 2024-09-12T17:41:32.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.564+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.zi2cQzhSp7oB9wO58K9RYifm4sKuASw_0 2024-09-12T17:41:32.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.564+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16175168195572852127', time=2024-09-12T19:31:44.186110+0000, chain.objs.size()=1 2024-09-12T17:41:32.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.564+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.K7rmd3Kjp6Q0crPWHeup_d8fIByLavh_0 2024-09-12T17:41:32.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.564+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6574130544228932175', time=2024-09-12T19:31:44.196462+0000, chain.objs.size()=1 2024-09-12T17:41:32.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.564+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.qo1ZBAORZKZYi-I2v1Im1r5ihfXRFgr_0 2024-09-12T17:41:32.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.564+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17502565554744224433', time=2024-09-12T19:31:44.402762+0000, chain.objs.size()=1 2024-09-12T17:41:32.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.564+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.FvGxKXWenBykl3XydEZNSU3v_cUiODk_0 2024-09-12T17:41:32.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.564+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7284242219092934134', time=2024-09-12T19:31:44.480180+0000, chain.objs.size()=1 2024-09-12T17:41:32.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.564+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_._cpwLFoijsIIhasz_r0c2CLXRkByw8O_0 2024-09-12T17:41:32.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.564+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7043837916469128325', time=2024-09-12T19:31:44.481059+0000, chain.objs.size()=1 2024-09-12T17:41:32.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.564+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_._dwWXKV6Bqv_x3rIqmHUnS9rR6UvqIP_0 2024-09-12T17:41:32.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.564+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5359408769265083026', time=2024-09-12T19:31:44.494223+0000, chain.objs.size()=1 2024-09-12T17:41:32.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.564+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.yRpxBAVLjKOyZBUEhwNWz83PynrnefE_0 2024-09-12T17:41:32.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.564+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3530212096026946981', time=2024-09-12T19:31:44.496326+0000, chain.objs.size()=1 2024-09-12T17:41:32.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.564+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.mSewBhff5yLEKg1wwpyBWQ9ffRHoyzV_0 2024-09-12T17:41:32.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.564+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9909629373323080090', time=2024-09-12T19:31:44.503405+0000, chain.objs.size()=1 2024-09-12T17:41:32.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.564+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.RyoLNZrvKZ-LNkWFzYdFc2Ajyh8CYCB_0 2024-09-12T17:41:32.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.564+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.41879870931833264', time=2024-09-12T19:31:45.107750+0000, chain.objs.size()=1 2024-09-12T17:41:32.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.564+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.264__shadow_.K-RDNXJGjcz7Boa-fHwDe0w5HchE40D_0 2024-09-12T17:41:32.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.564+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7558423830488907773', time=2024-09-12T19:31:53.437372+0000, chain.objs.size()=1 2024-09-12T17:41:32.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.564+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.286__shadow_.JXt_KN0HCKOuA2pkQ7iuF9wVX2VIF6f_0 2024-09-12T17:41:32.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.564+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2021857591167872187', time=2024-09-12T19:31:58.739281+0000, chain.objs.size()=1 2024-09-12T17:41:32.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.564+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.296__shadow_.TMZaAeMlXHiqxTWkl_aVXuZL2gCkmeG_0 2024-09-12T17:41:32.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.568+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2250914935192428456', time=2024-09-12T19:32:01.886759+0000, chain.objs.size()=1 2024-09-12T17:41:32.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.568+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.304__shadow_.h_-_rYSd4JVfELON2VumwNBDlt27jNS_0 2024-09-12T17:41:32.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.568+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12599277375474995452', time=2024-09-12T19:32:02.319867+0000, chain.objs.size()=1 2024-09-12T17:41:32.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.568+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.305__shadow_.TthINXW1b5vTe9Ln2JgiWzIuSPM6eAi_0 2024-09-12T17:41:32.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.568+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10055232981413536419', time=2024-09-12T19:32:08.257494+0000, chain.objs.size()=1 2024-09-12T17:41:32.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.568+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.322__shadow_.MBhvA1Gzbz35u6rNh9M2WjkkHRnnvUS_0 2024-09-12T17:41:32.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.568+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6225849859197746516', time=2024-09-12T19:32:27.972763+0000, chain.objs.size()=1 2024-09-12T17:41:32.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.568+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.i9z9qPLlI7L6XKAYHoCd94ttCJXx7_8_0 2024-09-12T17:41:32.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.568+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8020807313496244442', time=2024-09-12T19:32:28.010019+0000, chain.objs.size()=1 2024-09-12T17:41:32.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.568+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.VQF8hSVi8a8dSYghHf9zugIz6ShNTtk_0 2024-09-12T17:41:32.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.568+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8200568932796691888', time=2024-09-12T19:32:28.053272+0000, chain.objs.size()=1 2024-09-12T17:41:32.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.568+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.gxQqyqlVJ9Z0jxrlQjmNpEwfJ9zywBu_0 2024-09-12T17:41:32.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.568+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5292212788591449690', time=2024-09-12T19:32:28.073015+0000, chain.objs.size()=1 2024-09-12T17:41:32.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.568+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.vqQgcG60apgUGsoIw8p3YR34-dCrfh8_0 2024-09-12T17:41:32.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.568+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11776828298332307417', time=2024-09-12T19:32:28.151318+0000, chain.objs.size()=1 2024-09-12T17:41:32.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.568+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Z4zmzWmQLkCea-fXaug658T2u0ggSkf_0 2024-09-12T17:41:32.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.568+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.877021300675156198', time=2024-09-12T19:32:28.160222+0000, chain.objs.size()=1 2024-09-12T17:41:32.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.568+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.wKHkeWRHBnzLqtXBh7nBH1qRjWCr0SP_0 2024-09-12T17:41:32.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.568+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.523968603347062665', time=2024-09-12T19:32:28.172077+0000, chain.objs.size()=1 2024-09-12T17:41:32.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.568+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.AcJAhZFsZdi8uePlB-1HczIfh7aFrIV_0 2024-09-12T17:41:32.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.568+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6572771760562222361', time=2024-09-12T19:32:28.185901+0000, chain.objs.size()=1 2024-09-12T17:41:32.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.568+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.W_d7On2NdXprw3HaJkiyGFtsQ6yw1E2_0 2024-09-12T17:41:32.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.568+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16904615208596699856', time=2024-09-12T19:32:28.236302+0000, chain.objs.size()=1 2024-09-12T17:41:32.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.568+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.2RZaoaiDC5p1MPbaExaABOTERsXufrz_0 2024-09-12T17:41:32.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.568+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15201049401384735341', time=2024-09-12T19:32:28.256967+0000, chain.objs.size()=1 2024-09-12T17:41:32.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.568+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Ru7XBNhImv_XGGgpaWCzaLth4EjBPX1_0 2024-09-12T17:41:32.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.568+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12315126706195514693', time=2024-09-12T19:32:28.453999+0000, chain.objs.size()=1 2024-09-12T17:41:32.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.568+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.KD14qwa6ACD6oQkzr7NJZ_PEngQ4tdQ_0 2024-09-12T17:41:32.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.568+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7802285870837300520', time=2024-09-12T19:32:28.458262+0000, chain.objs.size()=1 2024-09-12T17:41:32.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.568+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.7m-zEnlPRajt6yLtWknlQsMdnfBcHWH_0 2024-09-12T17:41:32.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.568+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16808131187243180484', time=2024-09-12T19:32:28.466689+0000, chain.objs.size()=1 2024-09-12T17:41:32.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.568+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.J8dqUNh5RaLlr1JBzkuDFVf_VGzvbpc_0 2024-09-12T17:41:32.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.568+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.877306389950310566', time=2024-09-12T19:32:28.494004+0000, chain.objs.size()=1 2024-09-12T17:41:32.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.568+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.eUDJ6l4ZvvMPqS5ahKfc3JMyAJ-Mtdw_0 2024-09-12T17:41:32.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.568+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7058541968036751311', time=2024-09-12T19:32:28.503122+0000, chain.objs.size()=1 2024-09-12T17:41:32.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.568+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.XMgUaRNS-Enqdt95C-cVtfFVAzt8odH_0 2024-09-12T17:41:32.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.568+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16817074493682745383', time=2024-09-12T19:32:28.685709+0000, chain.objs.size()=1 2024-09-12T17:41:32.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.568+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.UEmXZdZXwt_C6rqGgyxZe5dmnpTbOw7_0 2024-09-12T17:41:32.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.568+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14335290172910939305', time=2024-09-12T19:32:28.689688+0000, chain.objs.size()=1 2024-09-12T17:41:32.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.568+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.2cLxyOMJWyUD9BJPYQ2az55LOv8LZb8_0 2024-09-12T17:41:32.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.568+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8593888618693774940', time=2024-09-12T19:32:28.701592+0000, chain.objs.size()=1 2024-09-12T17:41:32.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.568+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.n-WFlQnL0cGCaPya5SHInFUoTNPGMRa_0 2024-09-12T17:41:32.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.568+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8675639549978562666', time=2024-09-12T19:32:28.740457+0000, chain.objs.size()=1 2024-09-12T17:41:32.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.572+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Ro5Ftd7N8FNIKKQy5wXCuwBYH_gyszB_0 2024-09-12T17:41:32.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.572+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4727427408641873199', time=2024-09-12T19:32:28.768943+0000, chain.objs.size()=1 2024-09-12T17:41:32.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.572+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.ew9EifXYDJdDx0QNAI_tIyesk19_3XB_0 2024-09-12T17:41:32.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.572+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9638028486236660013', time=2024-09-12T19:32:28.772772+0000, chain.objs.size()=1 2024-09-12T17:41:32.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.572+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.QQ-JAVCkBVCbx8eh-FhYeHsyI-RHhRL_0 2024-09-12T17:41:32.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.572+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5949147449492393892', time=2024-09-12T19:32:28.782371+0000, chain.objs.size()=1 2024-09-12T17:41:32.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.572+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.pzy0Ig0HH2p4Iwu3hzhSEhKOZu40O3V_0 2024-09-12T17:41:32.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.572+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7911051992747415030', time=2024-09-12T19:32:28.878428+0000, chain.objs.size()=1 2024-09-12T17:41:32.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.572+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.uhwFDQYRnyDxmg5hdV9C1cCbCJGxNez_0 2024-09-12T17:41:32.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.572+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12932026033696335392', time=2024-09-12T19:32:29.142301+0000, chain.objs.size()=1 2024-09-12T17:41:32.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.572+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.SPEy9g7rEDcyVCUqqEkdZuVQPJ4WBeW_0 2024-09-12T17:41:32.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.572+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2829546332903564559', time=2024-09-12T19:32:29.152265+0000, chain.objs.size()=1 2024-09-12T17:41:32.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.572+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.nx82XaH27l-yG1cUnDwd0jZsYdqHgZ-_0 2024-09-12T17:41:32.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.572+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14636083906277164834', time=2024-09-12T19:32:29.443445+0000, chain.objs.size()=1 2024-09-12T17:41:32.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.572+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.212wWEdbd1H4LoQ20dEb2g9kyzx66sk_0 2024-09-12T17:41:32.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.572+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8213897531799088874', time=2024-09-12T19:32:29.477659+0000, chain.objs.size()=1 2024-09-12T17:41:32.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.572+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.rK6ATafrze5kynVPisMMShmYO7o4uBP_0 2024-09-12T17:41:32.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.572+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13921023099721359308', time=2024-09-12T19:32:29.480592+0000, chain.objs.size()=1 2024-09-12T17:41:32.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.572+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.jh8A-QNJwcwm7wDdF-_NqIfoRWerRF5_0 2024-09-12T17:41:32.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.572+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5287587847863065521', time=2024-09-12T19:32:29.500088+0000, chain.objs.size()=1 2024-09-12T17:41:32.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.572+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.CEPpqQjWy--1K0u7LzmT2p7Xq4eYYhd_0 2024-09-12T17:41:32.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.572+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5307491371692782837', time=2024-09-12T19:32:29.510875+0000, chain.objs.size()=1 2024-09-12T17:41:32.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.572+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.dH2kmxrM0ACvwsrIuNLyG2NeL-eelPT_0 2024-09-12T17:41:32.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.572+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3252276106226295349', time=2024-09-12T19:32:29.735380+0000, chain.objs.size()=1 2024-09-12T17:41:32.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.572+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.vLX4oajRBmaqi8vLk-Xxp1QVLpUW_Fo_0 2024-09-12T17:41:32.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.572+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18381873674964386648', time=2024-09-12T19:32:29.803050+0000, chain.objs.size()=1 2024-09-12T17:41:32.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.572+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.l0F5gK72T5PExLd8XCKu8Cw2DEfcoiW_0 2024-09-12T17:41:32.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.572+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12678281909232782025', time=2024-09-12T19:32:29.863823+0000, chain.objs.size()=1 2024-09-12T17:41:32.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.572+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.djtfmea87L3tAcEwGesUfcryEoHPkDo_0 2024-09-12T17:41:32.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.572+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18256631699795316113', time=2024-09-12T19:32:29.865623+0000, chain.objs.size()=1 2024-09-12T17:41:32.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.572+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.-lstT4iH6ZXzkmvbJkW_LW3xGhj9Ppb_0 2024-09-12T17:41:32.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.572+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1419011618302364150', time=2024-09-12T19:32:29.874965+0000, chain.objs.size()=1 2024-09-12T17:41:32.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.572+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.phMjiWY4S9lBpAf3oV_dBTms4KOmw3E_0 2024-09-12T17:41:32.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.572+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14273413093442109794', time=2024-09-12T19:32:29.994183+0000, chain.objs.size()=1 2024-09-12T17:41:32.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.572+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.n7WIJRLbraVY17Zw5yopwwSo7q29Phs_0 2024-09-12T17:41:32.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.572+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17917368543114368745', time=2024-09-12T19:32:30.021036+0000, chain.objs.size()=1 2024-09-12T17:41:32.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.572+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.w9xdOLEhbTrY48SN2yx2-jyyluc89_f_0 2024-09-12T17:41:32.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.572+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7516339470268922137', time=2024-09-12T19:32:30.026889+0000, chain.objs.size()=1 2024-09-12T17:41:32.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.572+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.cd4-1G36M6Ldj0tj3l9okN7XhlUSk5C_0 2024-09-12T17:41:32.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.576+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15994599133282029887', time=2024-09-12T19:32:49.508680+0000, chain.objs.size()=1 2024-09-12T17:41:32.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.576+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.avyXr5-OVi3CJEnRq5bItjtkgbSK4G-_0 2024-09-12T17:41:32.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.576+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12899420770541503114', time=2024-09-12T19:32:49.591500+0000, chain.objs.size()=1 2024-09-12T17:41:32.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.576+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.XmzXqDvujCND_vMukQau-yo7Q4KZAS5_0 2024-09-12T17:41:32.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.576+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5120518113008154220', time=2024-09-12T19:32:49.603633+0000, chain.objs.size()=1 2024-09-12T17:41:32.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.576+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.ke2PEIN2DdEDMGVhH0itkWifWp3cRmi_0 2024-09-12T17:41:32.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.576+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8055809066896750606', time=2024-09-12T19:32:49.696939+0000, chain.objs.size()=1 2024-09-12T17:41:32.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.576+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.de3b4lB0DNoi-dRhGm14CeeljPI3DyC_0 2024-09-12T17:41:32.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.576+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10471982906579507697', time=2024-09-12T19:32:49.711059+0000, chain.objs.size()=1 2024-09-12T17:41:32.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.576+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.c8GcIYNkqxMrxQ6yjU_U985gLCSVKTz_0 2024-09-12T17:41:32.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.576+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11636870851188204842', time=2024-09-12T19:32:49.737115+0000, chain.objs.size()=1 2024-09-12T17:41:32.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.576+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.WMW_Tupa2ktIqb99bCbbGXj58wo4jcX_0 2024-09-12T17:41:32.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.576+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12358079019526139304', time=2024-09-12T19:32:49.767134+0000, chain.objs.size()=1 2024-09-12T17:41:32.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.576+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.QtXVdFp_kQj7O625R6_ZdQgCZ6jrrBw_0 2024-09-12T17:41:32.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.576+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9560728745713588326', time=2024-09-12T19:32:49.853683+0000, chain.objs.size()=1 2024-09-12T17:41:32.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.576+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.EtZngu9z2kUhMXzLejlG7lmJM0TadVe_0 2024-09-12T17:41:32.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.580+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/50671 2024-09-12T17:41:32.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.580+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=50, truncated=0, next_marker='' 2024-09-12T17:41:32.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.580+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6358587862941021718', time=2024-09-12T19:32:49.870821+0000, chain.objs.size()=1 2024-09-12T17:41:32.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.580+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.hDfQSXdMP2j7b29D4p3TL7jq5JzYnWE_0 2024-09-12T17:41:32.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.580+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4233625500080109649', time=2024-09-12T19:32:49.881579+0000, chain.objs.size()=1 2024-09-12T17:41:32.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.580+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.h4v-8CxmqZ8mdUtxnrxCGrTGRH0ZB_A_0 2024-09-12T17:41:32.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.580+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9952058716605837458', time=2024-09-12T19:32:49.933767+0000, chain.objs.size()=1 2024-09-12T17:41:32.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.580+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.h5xoR-2eKaCyjxPYq8nqjDBLyXEJzyZ_0 2024-09-12T17:41:32.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.580+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12561079673245124862', time=2024-09-12T19:32:49.953117+0000, chain.objs.size()=1 2024-09-12T17:41:32.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.580+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.FeaWaq53eUn-_vlOBRiPyHJVHAzo4qe_0 2024-09-12T17:41:32.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.580+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16688167620010355200', time=2024-09-12T19:32:49.986126+0000, chain.objs.size()=1 2024-09-12T17:41:32.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.580+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.J1eGkQ40qPhcBv77szSmVC0lLGPsQO6_0 2024-09-12T17:41:32.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.580+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7607317897465756129', time=2024-09-12T19:32:50.209296+0000, chain.objs.size()=1 2024-09-12T17:41:32.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.580+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.FqBxK112W691yCqF_dTrHrLLNH6BXcq_0 2024-09-12T17:41:32.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.580+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16307360624678508614', time=2024-09-12T19:32:50.310245+0000, chain.objs.size()=1 2024-09-12T17:41:32.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.580+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.uXfYiJo5MUKMXmne46Zfx7hywPfR1-f_0 2024-09-12T17:41:32.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.580+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7443494852580912738', time=2024-09-12T19:32:50.328896+0000, chain.objs.size()=1 2024-09-12T17:41:32.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.580+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.pzSbNutb62z9f600S1A4E2zSVzLEK--_0 2024-09-12T17:41:32.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.580+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10308318918463233010', time=2024-09-12T19:32:50.486999+0000, chain.objs.size()=1 2024-09-12T17:41:32.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.580+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.swlu6mJrpM5EPctxtjZDp5Sn50pOVVM_0 2024-09-12T17:41:32.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.580+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15407554290508116193', time=2024-09-12T19:32:50.601099+0000, chain.objs.size()=1 2024-09-12T17:41:32.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.580+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.8v5gUSgBZmK3g_OT-6N20iU7FdwP8c3_0 2024-09-12T17:41:32.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.580+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1536534499730176002', time=2024-09-12T19:32:50.829899+0000, chain.objs.size()=1 2024-09-12T17:41:32.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.580+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.qTRrQE15ftpRyKOrRbMzARyY_9LgKL6_0 2024-09-12T17:41:32.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.580+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14169581066425626945', time=2024-09-12T19:32:50.838708+0000, chain.objs.size()=1 2024-09-12T17:41:32.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.580+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.-1IiXEJLCtLILMgbdyRkX6EkgozRJEQ_0 2024-09-12T17:41:32.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.584+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4550992411425837969', time=2024-09-12T19:32:51.014421+0000, chain.objs.size()=1 2024-09-12T17:41:32.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.584+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.LfM4QdqLdaQ335kZmwpsAYGFGGbRTkC_0 2024-09-12T17:41:32.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.584+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.424643211258991409', time=2024-09-12T19:32:51.032006+0000, chain.objs.size()=1 2024-09-12T17:41:32.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.584+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.a2Zgycr2rPpbhXOCvhFyIMzJ9Dz-MOa_0 2024-09-12T17:41:32.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.584+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6904562171868876488', time=2024-09-12T19:32:51.257870+0000, chain.objs.size()=1 2024-09-12T17:41:32.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.584+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.3WDhdbM6usn4bi8AHsfZgoM4eHVVm4t_0 2024-09-12T17:41:32.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.584+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16794722739878940052', time=2024-09-12T19:32:51.293209+0000, chain.objs.size()=1 2024-09-12T17:41:32.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.584+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.a662-5rPRUFm3C9Oq2Y_xiVmI3MkD1o_0 2024-09-12T17:41:32.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.584+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4694446077355178402', time=2024-09-12T19:32:51.348042+0000, chain.objs.size()=1 2024-09-12T17:41:32.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.584+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.CkMnJoDiFy5_cEygiwqs77kZvzizG8C_0 2024-09-12T17:41:32.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.584+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1141903026066296588', time=2024-09-12T19:32:51.565977+0000, chain.objs.size()=1 2024-09-12T17:41:32.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.584+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.hf9rgIsb7tkUMlvXj1hfawjHCR2irfm_0 2024-09-12T17:41:32.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.588+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1312582417122857759', time=2024-09-12T19:32:51.580338+0000, chain.objs.size()=1 2024-09-12T17:41:32.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.588+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.k_Vm2LfvgXiwiRkklKQkmqsffbibzJb_0 2024-09-12T17:41:32.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.588+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12854291615459054716', time=2024-09-12T19:32:51.610964+0000, chain.objs.size()=1 2024-09-12T17:41:32.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.588+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Y2xpWO22wEtdzmSCyXE8H21aB5Zll9-_0 2024-09-12T17:41:32.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.588+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7745388293011680902', time=2024-09-12T19:32:51.612114+0000, chain.objs.size()=1 2024-09-12T17:41:32.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.588+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.hwaUcTyy_lFRF829ReLkyHIcLP5LMtY_0 2024-09-12T17:41:32.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.588+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3625388354029535719', time=2024-09-12T19:32:51.687845+0000, chain.objs.size()=1 2024-09-12T17:41:32.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.588+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.-j2gpg-5Zztg9tdwIiIwA91B1ieKkz-_0 2024-09-12T17:41:32.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.588+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.990572906152520251', time=2024-09-12T19:32:51.690753+0000, chain.objs.size()=1 2024-09-12T17:41:32.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.588+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.iGFxiBFlFKVRcMIXzVNIJstSv7K4POz_0 2024-09-12T17:41:32.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.588+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3936306330104520313', time=2024-09-12T19:32:51.721539+0000, chain.objs.size()=1 2024-09-12T17:41:32.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.588+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.JDs-0lmXPiby4NXftoClrsI2jGZj1dQ_0 2024-09-12T17:41:32.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.588+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1122090221245715804', time=2024-09-12T19:32:51.888669+0000, chain.objs.size()=1 2024-09-12T17:41:32.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.588+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.JGkS8Ztlsq707kn8gQGxMjKPoa03EkT_0 2024-09-12T17:41:32.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.588+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1321832878404748407', time=2024-09-12T19:32:51.913673+0000, chain.objs.size()=1 2024-09-12T17:41:32.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.588+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.B0ybjTWV0lM5aaxnxdBP63GBI2ryt9G_0 2024-09-12T17:41:32.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.588+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15248095189884084810', time=2024-09-12T19:32:51.937141+0000, chain.objs.size()=1 2024-09-12T17:41:32.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.588+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.W1fQiS97M56FignY-5tEGs2TKRVVTfA_0 2024-09-12T17:41:32.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.588+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10021647541069375486', time=2024-09-12T19:32:51.982789+0000, chain.objs.size()=1 2024-09-12T17:41:32.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.588+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.1TXxr6FXkRFNm-UvxV1f_QbIpLmKsuV_0 2024-09-12T17:41:32.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.588+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17455980832444650417', time=2024-09-12T19:32:51.994437+0000, chain.objs.size()=1 2024-09-12T17:41:32.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.588+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.MLbryj5kxqGHv1VsXhj5z38FOhO8Pm-_0 2024-09-12T17:41:32.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.588+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16141910483125339877', time=2024-09-12T19:32:58.551726+0000, chain.objs.size()=1 2024-09-12T17:41:32.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.588+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.344__shadow_.bI6U-vJUmtqVjG-c2eDzoEYusuhm7s4_0 2024-09-12T17:41:32.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.588+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11977501467437692144', time=2024-09-12T19:33:01.032373+0000, chain.objs.size()=1 2024-09-12T17:41:32.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.588+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.353__shadow_.G14CbMQK4X3hLzqrBqE7njfC4_NDkqA_0 2024-09-12T17:41:32.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.588+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15316439039614920212', time=2024-09-12T19:33:44.763200+0000, chain.objs.size()=1 2024-09-12T17:41:32.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.588+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.466__shadow_.5U4kWVYYcm8EwL-02GQrSRk4t8yO581_0 2024-09-12T17:41:32.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.588+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1526275497072990281', time=2024-09-12T19:33:49.235249+0000, chain.objs.size()=1 2024-09-12T17:41:32.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.588+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.483__shadow_.YvS5ikubGTQr3qRSb7Pk2s_U1TU2g-E_0 2024-09-12T17:41:32.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.588+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4904789767421079195', time=2024-09-12T19:34:19.158316+0000, chain.objs.size()=6 2024-09-12T17:41:32.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.588+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__multipart_mymultipart.2~P_ZFJPFVA8vkldt3Ue7XLIqHokQb14b.1 2024-09-12T17:41:32.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.588+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__multipart_mymultipart.Te6Xf0lu7v6PXT4y4gtf-dmoYu-52SuZ.2 2024-09-12T17:41:32.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.588+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__multipart_mymultipart.l4BLHoaidSJMpc6e9I9xKEwfs8jDlIkg.3 2024-09-12T17:41:32.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.588+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__multipart_mymultipart.2~P_ZFJPFVA8vkldt3Ue7XLIqHokQb14b.4 2024-09-12T17:41:32.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.588+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__multipart_mymultipart.2~P_ZFJPFVA8vkldt3Ue7XLIqHokQb14b.5 2024-09-12T17:41:32.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.588+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__multipart_mymultipart.2~P_ZFJPFVA8vkldt3Ue7XLIqHokQb14b.6 2024-09-12T17:41:32.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.592+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18369346216038534901', time=2024-09-12T19:35:00.021829+0000, chain.objs.size()=1 2024-09-12T17:41:32.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.592+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.550__shadow_.ZBc-A5fkBZGjwjKuLWOHVKZ4_SPhpRb_0 2024-09-12T17:41:32.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.592+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15268992336403467014', time=2024-09-12T19:35:01.531313+0000, chain.objs.size()=1 2024-09-12T17:41:32.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.592+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.552__shadow_.OrGG9dzHkxL92VnRY4UbW6Ogp93K6l0_0 2024-09-12T17:41:32.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.592+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16319114435828597622', time=2024-09-12T19:35:04.932801+0000, chain.objs.size()=1 2024-09-12T17:41:32.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.592+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.557__shadow_.viElMuOOnZKhhkMXCWwqRQTr-CatBmM_0 2024-09-12T17:41:32.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.592+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17184399644379885709', time=2024-09-12T19:35:23.248823+0000, chain.objs.size()=1 2024-09-12T17:41:32.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.592+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.569__shadow:Z6y.QPpYHLGMOHtH7FuRPBF9pImR12O_.FFwaIPYm5iWMFjVenA0SC9cMIOVQWlB_0 2024-09-12T17:41:32.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.592+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2218385244726020895', time=2024-09-12T19:35:23.429355+0000, chain.objs.size()=1 2024-09-12T17:41:32.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.592+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.569__shadow:CjH6TwJgldVjJoHl5zw1rCQPCcsTXTn_.o3d9kYgOeZYbR-d411Dz8kB1HHTqRfC_0 2024-09-12T17:41:32.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.592+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11879102356720063796', time=2024-09-12T19:35:33.091645+0000, chain.objs.size()=1 2024-09-12T17:41:32.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.592+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.576__shadow:mgOO4eNIrYWfulbMLrCHf8vr-Y4XauH_.2vyP7zxUb6EGfYbXdsKTIKgbXn7puvK_0 2024-09-12T17:41:32.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.592+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12338809706267737825', time=2024-09-12T19:35:37.821264+0000, chain.objs.size()=1 2024-09-12T17:41:32.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.592+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.577__shadow:uxEAW1xszvEHIv.w2fWa8k7Nui6Zi0G_.exvgBtQ7S1dcUbz28aivtQfYi_o6uoW_0 2024-09-12T17:41:32.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.592+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2567779032929575003', time=2024-09-12T19:35:55.519550+0000, chain.objs.size()=1 2024-09-12T17:41:32.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.592+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.580__shadow:BFTAQ4IF8eJdkkNWZJ-bQMjdGNIHr0S_.cjZDqMRElJLlRbutnNcGae9WqGEup7R_0 2024-09-12T17:41:32.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.592+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15980360110052534945', time=2024-09-12T19:35:56.035278+0000, chain.objs.size()=1 2024-09-12T17:41:32.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.592+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.582__shadow:8FElVSH1hAtrTeTXO9LA07FEDnLvNAZ_.1NOMoIwVzD5HjrhOFGEmPP71XBvZm2c_0 2024-09-12T17:41:32.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.592+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11406528722067565039', time=2024-09-12T19:35:58.084188+0000, chain.objs.size()=1 2024-09-12T17:41:32.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.592+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.585__shadow:1OY-aRxQwtYHb1wL0vb7Jo.dFjw.TH-_.KzrjZaFRMPrFdp6fFimyqLUurRmrZp__0 2024-09-12T17:41:32.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.592+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7112303288955614897', time=2024-09-12T19:35:58.650695+0000, chain.objs.size()=1 2024-09-12T17:41:32.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.592+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.586__shadow:V4LGYosO4FCUYAdVqr.92X-zAtn.r-T_.U9ucEasZ9UcxP_2L0QcdHaAnVLBqqzQ_0 2024-09-12T17:41:32.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.592+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17091626140881792258', time=2024-09-12T19:36:01.951250+0000, chain.objs.size()=1 2024-09-12T17:41:32.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.592+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.596__shadow_.raCQdcf4-5oUnPnw0iWfqAktrQAKMz7_0 2024-09-12T17:41:32.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.592+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1639593291291016700', time=2024-09-12T19:36:14.606571+0000, chain.objs.size()=1 2024-09-12T17:41:32.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.592+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.616__shadow_.LFqJIm0VUR59UlxNkbJ1qCTfQwwZ1XM_0 2024-09-12T17:41:32.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.592+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8250904603942720456', time=2024-09-12T19:38:33.372410+0000, chain.objs.size()=1 2024-09-12T17:41:32.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.592+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.649__shadow_.CvR1e7AxRRhaBblF0vwL15aZ0kyhMH4_0 2024-09-12T17:41:32.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.592+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8083966478653088066', time=2024-09-12T19:38:43.998009+0000, chain.objs.size()=1 2024-09-12T17:41:32.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.592+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.666__shadow_.hPlfQ5Wd8KHJdVMm1h5m4-aWYGV12sX_0 2024-09-12T17:41:32.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.592+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12736270666398645415', time=2024-09-12T19:38:59.059294+0000, chain.objs.size()=1 2024-09-12T17:41:32.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.592+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.709__shadow_.M6lz81FRbbYZNNxJsjTXqBiuUoubP1Z_0 2024-09-12T17:41:32.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.596+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:41:32.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.600+0000 7fd765adf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:41:32.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.600+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:41:32.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.600+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:41:32.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.600+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46434' 2024-09-12T17:41:32.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.600+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.834036242257624243', time=2024-09-12T19:29:43.837282+0000, chain.objs.size()=5 2024-09-12T17:41:32.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.600+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.159__multipart_mymultipart-FROZEN.2~3vPKebQfftloHrmnDhgGnIlNS8Aj0WX.1 2024-09-12T17:41:32.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.600+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.159__shadow_mymultipart-FROZEN.2~3vPKebQfftloHrmnDhgGnIlNS8Aj0WX.1_1 2024-09-12T17:41:32.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.600+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.159__multipart_mymultipart-FROZEN.2~3vPKebQfftloHrmnDhgGnIlNS8Aj0WX.2 2024-09-12T17:41:32.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.600+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.159__shadow_mymultipart-FROZEN.2~3vPKebQfftloHrmnDhgGnIlNS8Aj0WX.2_1 2024-09-12T17:41:32.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.600+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.159__multipart_mymultipart-FROZEN.2~3vPKebQfftloHrmnDhgGnIlNS8Aj0WX.3 2024-09-12T17:41:32.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.600+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14234447801535271184', time=2024-09-12T19:29:56.191957+0000, chain.objs.size()=1 2024-09-12T17:41:32.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.600+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.177__shadow_.2zZ5vUlTkYlxTe4JRN4pW3z6igR9Nb8_0 2024-09-12T17:41:32.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.600+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10865625930882330306', time=2024-09-12T19:31:10.130025+0000, chain.objs.size()=1 2024-09-12T17:41:32.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.600+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.228__shadow_.Lc7WQ1VICsDmWpKM04lroAOWT0oTkhP_0 2024-09-12T17:41:32.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.600+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17749523386648354139', time=2024-09-12T19:31:13.463804+0000, chain.objs.size()=1 2024-09-12T17:41:32.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.600+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.237__shadow_.udlaWDjqZKDcIoWzxkvu3U-CJQYpKQ2_0 2024-09-12T17:41:32.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.600+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11455427159207835250', time=2024-09-12T19:31:13.967189+0000, chain.objs.size()=1 2024-09-12T17:41:32.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.600+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.238__shadow_.T_CMaS2i4utm2fbf974qV0H6UYT6y0q_0 2024-09-12T17:41:32.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.600+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9484830738866286453', time=2024-09-12T19:31:19.073832+0000, chain.objs.size()=1 2024-09-12T17:41:32.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.600+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.251__shadow_.r-AwVgAd7RK8nSzIQyM_R1vmKiNWMxl_0 2024-09-12T17:41:32.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.600+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3795362890339862359', time=2024-09-12T19:31:20.252394+0000, chain.objs.size()=1 2024-09-12T17:41:32.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.600+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.254__shadow_.uMrW96e3MpxcocdJf8zECfwUQvLhYHb_0 2024-09-12T17:41:32.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.600+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13528910367061424904', time=2024-09-12T19:31:20.629079+0000, chain.objs.size()=1 2024-09-12T17:41:32.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.600+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.255__shadow_.XOvdz6Rkz5fzIwmhGb8BJiNi7nHDdD__0 2024-09-12T17:41:32.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.604+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13781837721940152904', time=2024-09-12T19:31:21.003527+0000, chain.objs.size()=1 2024-09-12T17:41:32.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.604+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.256__shadow_.8PQ7pEhO6wc34OGglp4FyYYyEXUv-6M_0 2024-09-12T17:41:32.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.604+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11241045367272390204', time=2024-09-12T19:31:21.363029+0000, chain.objs.size()=1 2024-09-12T17:41:32.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.604+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.257__shadow_.dmoECga8-lo-cpulY8kWyg_BQ647oSe_0 2024-09-12T17:41:32.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.604+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3505342204666790320', time=2024-09-12T19:31:22.509897+0000, chain.objs.size()=1 2024-09-12T17:41:32.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.604+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.260__shadow_.Q7NPOBY0zKVtTSi_iXFlzDQiNHqeOXZ_0 2024-09-12T17:41:32.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.604+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16183078668111997617', time=2024-09-12T19:31:42.545531+0000, chain.objs.size()=1 2024-09-12T17:41:32.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.604+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.kYH10RHfhgvMoRBYKWlk6Q2h8UV0eIW_0 2024-09-12T17:41:32.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.604+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13934546638077377369', time=2024-09-12T19:31:42.588273+0000, chain.objs.size()=1 2024-09-12T17:41:32.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.604+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.J6zI05HqgnWspL-t7GMP-85H6180I4o_0 2024-09-12T17:41:32.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.604+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4389838366004169158', time=2024-09-12T19:31:42.630756+0000, chain.objs.size()=1 2024-09-12T17:41:32.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.604+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.7XgdmyGFfKK4UBO1cdhQFvOPLixxP8i_0 2024-09-12T17:41:32.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.604+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12548731081779520744', time=2024-09-12T19:31:42.659296+0000, chain.objs.size()=1 2024-09-12T17:41:32.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.604+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.N0kHa8c3eBZfSEU5w9v9AOQdatPGdTg_0 2024-09-12T17:41:32.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.604+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6145972615615817573', time=2024-09-12T19:31:42.715109+0000, chain.objs.size()=1 2024-09-12T17:41:32.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.604+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Ui9R-M8kqIlKrR_rp7Ti1stKaAb47gI_0 2024-09-12T17:41:32.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.604+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11204509153930599755', time=2024-09-12T19:31:42.764155+0000, chain.objs.size()=1 2024-09-12T17:41:32.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.604+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.tIMQsKR44-8K5K6fp3C6v8hb4zUV_WZ_0 2024-09-12T17:41:32.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.604+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1050264175907617441', time=2024-09-12T19:31:42.783012+0000, chain.objs.size()=1 2024-09-12T17:41:32.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.604+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.qxUIg1QtwHQ8VwleSzFq4FgD3UeHYlS_0 2024-09-12T17:41:32.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.604+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8651099697225558922', time=2024-09-12T19:31:42.871914+0000, chain.objs.size()=1 2024-09-12T17:41:32.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.604+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.4JdquKhqLhe_5gyGc9QrKwPIa4v-fsM_0 2024-09-12T17:41:32.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.604+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7967694264981662937', time=2024-09-12T19:31:42.946916+0000, chain.objs.size()=1 2024-09-12T17:41:32.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.604+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.3l9Jun1JVroIwXj0CrllmPwD7WiVM3C_0 2024-09-12T17:41:32.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.604+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5301291095499508787', time=2024-09-12T19:31:42.952399+0000, chain.objs.size()=1 2024-09-12T17:41:32.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.604+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.cLxhaAaMOVz74G0V2cGPMghq3ReO712_0 2024-09-12T17:41:32.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.604+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7884814416331170870', time=2024-09-12T19:31:43.079639+0000, chain.objs.size()=1 2024-09-12T17:41:32.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.604+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.D_aJ6EpkxHokJ-dicmjJ_OiUhFU2LfQ_0 2024-09-12T17:41:32.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.608+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13244829403499148072', time=2024-09-12T19:31:43.229720+0000, chain.objs.size()=1 2024-09-12T17:41:32.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.608+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.b2Dcrv5l-m6si7KDYOCdttZlVCUNs3t_0 2024-09-12T17:41:32.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.608+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6070577282789584834', time=2024-09-12T19:31:43.260203+0000, chain.objs.size()=1 2024-09-12T17:41:32.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.608+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.uJeJGClqY42jU15TDTwHivdCNGhv-4i_0 2024-09-12T17:41:32.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.608+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3519800781900115429', time=2024-09-12T19:31:43.487149+0000, chain.objs.size()=1 2024-09-12T17:41:32.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.608+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.wRrdZBdimHhA8_Xp26HpY0gwo1Rpg9d_0 2024-09-12T17:41:32.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.608+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6901193347105528303', time=2024-09-12T19:31:43.556469+0000, chain.objs.size()=1 2024-09-12T17:41:32.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.608+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.dQxhk57xF847Wvyqqs-PQYaYzH3xwGS_0 2024-09-12T17:41:32.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.608+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7513725743172423677', time=2024-09-12T19:31:43.745204+0000, chain.objs.size()=1 2024-09-12T17:41:32.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.608+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.6dRoBUZ2Y6DjhfzUyWrS8Q14b6TqsAX_0 2024-09-12T17:41:32.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.608+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.175371559286643311', time=2024-09-12T19:31:43.870372+0000, chain.objs.size()=1 2024-09-12T17:41:32.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.608+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.km_1EPLT2nC7Hw9D2wBYDcFefcfxbjL_0 2024-09-12T17:41:32.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.608+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6604714300782224321', time=2024-09-12T19:31:43.875876+0000, chain.objs.size()=1 2024-09-12T17:41:32.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.608+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.3h6tXT1jl-fToZFNYpTA7OZ48LR7BNu_0 2024-09-12T17:41:32.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.608+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5368568395572795874', time=2024-09-12T19:31:43.912278+0000, chain.objs.size()=1 2024-09-12T17:41:32.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.608+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.7TNATdPlaEqYbXSuzeglxG1ebA8LFOM_0 2024-09-12T17:41:32.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.608+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8153977740078252983', time=2024-09-12T19:31:44.078357+0000, chain.objs.size()=1 2024-09-12T17:41:32.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.608+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.1jp1vfqh15IcEmS6rVFLcKW-ysSZUiH_0 2024-09-12T17:41:32.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.608+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11843439452355042104', time=2024-09-12T19:31:44.097874+0000, chain.objs.size()=1 2024-09-12T17:41:32.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.608+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.5waXCnql2lRxezi-ogKwGOawUgNt5_J_0 2024-09-12T17:41:32.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.608+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17236639828450275422', time=2024-09-12T19:31:44.137505+0000, chain.objs.size()=1 2024-09-12T17:41:32.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.608+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_._qLx6w-5fKyXOMlsYhii1sGtFOCmNqZ_0 2024-09-12T17:41:32.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.608+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8263835627596234934', time=2024-09-12T19:31:44.139790+0000, chain.objs.size()=1 2024-09-12T17:41:32.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.608+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.QyBbd8tGafk7e_XCp-vVRx4eaBXcqvO_0 2024-09-12T17:41:32.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.608+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6919846271898873392', time=2024-09-12T19:31:44.188975+0000, chain.objs.size()=1 2024-09-12T17:41:32.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.608+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.5wnjF2IZpW5MbEeM4siU3ESjl-8BfvZ_0 2024-09-12T17:41:32.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.608+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14291301499484134653', time=2024-09-12T19:31:44.222223+0000, chain.objs.size()=1 2024-09-12T17:41:32.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.608+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.z7kzZ5-_0HTzO_NXYfyMvObn8Yyv02e_0 2024-09-12T17:41:32.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.608+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.59288218280076338', time=2024-09-12T19:31:44.233651+0000, chain.objs.size()=1 2024-09-12T17:41:32.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.608+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.o89Irbjp-ITUF8winQigLAdEVMFITPB_0 2024-09-12T17:41:32.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.608+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8395645642706190287', time=2024-09-12T19:31:44.246418+0000, chain.objs.size()=1 2024-09-12T17:41:32.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.608+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Jd-swa-osylFFCE9qFQ0hBFUubIzVE6_0 2024-09-12T17:41:32.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.608+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9091529912318164840', time=2024-09-12T19:31:54.616537+0000, chain.objs.size()=1 2024-09-12T17:41:32.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.608+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.289__shadow_.IZHJ9mt03CsA2vDb8sERA_iaJDDr1Os_0 2024-09-12T17:41:32.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.608+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17403571019460961881', time=2024-09-12T19:31:57.613764+0000, chain.objs.size()=1 2024-09-12T17:41:32.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.608+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.293__shadow_.-B-nMVpHhWFWwldu-9xHZ8iIuex2P4m_0 2024-09-12T17:41:32.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.608+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6480735435987165191', time=2024-09-12T19:31:57.975388+0000, chain.objs.size()=1 2024-09-12T17:41:32.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.608+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.294__shadow_.9sMVBeDbb5U0qeP9r1QYLuM5Dp4-sJJ_0 2024-09-12T17:41:32.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.608+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15125606673223504892', time=2024-09-12T19:32:00.384235+0000, chain.objs.size()=1 2024-09-12T17:41:32.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.608+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.300__shadow_.Nx97RhIz2FKZ6Jnsd7nFmZlkzMWu2Py_0 2024-09-12T17:41:32.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.612+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.501507320577636169', time=2024-09-12T19:32:27.882085+0000, chain.objs.size()=1 2024-09-12T17:41:32.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.612+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.nQtK61P3FoPgmjy1sMasArBB3am6gU4_0 2024-09-12T17:41:32.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.612+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15533580691757723074', time=2024-09-12T19:32:27.956386+0000, chain.objs.size()=1 2024-09-12T17:41:32.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.612+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.D6HImEgM4LZfhurS_XUZZepYV4hPW9__0 2024-09-12T17:41:32.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.612+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10332672499174427181', time=2024-09-12T19:32:27.986236+0000, chain.objs.size()=1 2024-09-12T17:41:32.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.612+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.5GjRnJ8RcMF9AlPROWXovKmNDczs-Fw_0 2024-09-12T17:41:32.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.612+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10936860455810601213', time=2024-09-12T19:32:28.189338+0000, chain.objs.size()=1 2024-09-12T17:41:32.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.612+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.mqVo60grThJYiTJLBndQ7jWvPvucg4j_0 2024-09-12T17:41:32.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.612+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15261160711490970678', time=2024-09-12T19:32:28.241811+0000, chain.objs.size()=1 2024-09-12T17:41:32.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.612+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.PBIqh3TAFUrI8osi7PBEyk7zDvatMnL_0 2024-09-12T17:41:32.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.612+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13668873238791671757', time=2024-09-12T19:32:28.288469+0000, chain.objs.size()=1 2024-09-12T17:41:32.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.612+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.mw9xcOQ3PFEJXzx6XPlKb-kC9AaH9ZW_0 2024-09-12T17:41:32.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.612+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.893118210299159943', time=2024-09-12T19:32:28.304153+0000, chain.objs.size()=1 2024-09-12T17:41:32.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.612+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.ThbPWnH43jypKI3IRQi31oTAOdyhbwN_0 2024-09-12T17:41:32.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.612+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11942452320849671917', time=2024-09-12T19:32:28.307628+0000, chain.objs.size()=1 2024-09-12T17:41:32.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.612+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.MDKbVf9VWQEvUeya6A2Yl7bhdO5uAVm_0 2024-09-12T17:41:32.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.612+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18119083329397025651', time=2024-09-12T19:32:28.312619+0000, chain.objs.size()=1 2024-09-12T17:41:32.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.612+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.yUs0hVNBJNpZgk8M1joQE-aiKKZaeNR_0 2024-09-12T17:41:32.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.612+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1344419302468072572', time=2024-09-12T19:32:28.379110+0000, chain.objs.size()=1 2024-09-12T17:41:32.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.612+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.YylYJPpQOFWW5OmE8TDWkfTLfHeInxU_0 2024-09-12T17:41:32.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.612+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4034810384874285865', time=2024-09-12T19:32:28.421233+0000, chain.objs.size()=1 2024-09-12T17:41:32.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.612+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.EUh8WUjSOJ5AaNEXK7X2nufUpcXRvI2_0 2024-09-12T17:41:32.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.612+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14729205502418702767', time=2024-09-12T19:32:28.469438+0000, chain.objs.size()=1 2024-09-12T17:41:32.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.612+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.1uRPYclvNJBqul44oO8s9kuXWpVw5R9_0 2024-09-12T17:41:32.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.612+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13088414288129908670', time=2024-09-12T19:32:28.484564+0000, chain.objs.size()=1 2024-09-12T17:41:32.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.612+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.y7iVfYc9Ih-MyBFlATSbIwVo88BtWRL_0 2024-09-12T17:41:32.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.612+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10355773043436234970', time=2024-09-12T19:32:28.523349+0000, chain.objs.size()=1 2024-09-12T17:41:32.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.612+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.kJtErKoAPBMc6U-P6Dubzlyk8U58VoV_0 2024-09-12T17:41:32.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.612+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17904709715143305629', time=2024-09-12T19:32:28.708301+0000, chain.objs.size()=1 2024-09-12T17:41:32.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.612+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.gcN29DcvB58TuzyzMAbsYvISIYKuH1B_0 2024-09-12T17:41:32.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.612+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15412191710361632745', time=2024-09-12T19:32:28.800552+0000, chain.objs.size()=1 2024-09-12T17:41:32.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.612+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.5BbkyPenYQJalgMkJXEiQ1mqAXnxRi4_0 2024-09-12T17:41:32.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.612+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14902007059865554345', time=2024-09-12T19:32:28.874360+0000, chain.objs.size()=1 2024-09-12T17:41:32.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.612+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.bTnwQ53L-PWS559I30gAIrjxDaMzHo-_0 2024-09-12T17:41:32.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.612+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13132426070809088055', time=2024-09-12T19:32:29.057700+0000, chain.objs.size()=1 2024-09-12T17:41:32.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.612+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.m9NB76ixZLbPCUP_uBSLBV5n0MK1hVi_0 2024-09-12T17:41:32.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.612+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12328721107771497654', time=2024-09-12T19:32:29.107415+0000, chain.objs.size()=1 2024-09-12T17:41:32.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.612+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.hgFdgSnlZrpm7u6b73GBD6zO6ePVn8j_0 2024-09-12T17:41:32.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.612+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12656205903077143706', time=2024-09-12T19:32:29.120398+0000, chain.objs.size()=1 2024-09-12T17:41:32.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.612+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.iPFjvOMhdnWSxHKbAfFF22yo9C0w4Hk_0 2024-09-12T17:41:32.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.612+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3387737761171773528', time=2024-09-12T19:32:29.134538+0000, chain.objs.size()=1 2024-09-12T17:41:32.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.612+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.N35UQ8Jx09RACJ0dO-k07B2ucGNJACR_0 2024-09-12T17:41:32.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.616+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1676765336566965001', time=2024-09-12T19:32:29.187896+0000, chain.objs.size()=1 2024-09-12T17:41:32.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.616+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Q_QtQavJcxHBcYeNsAT5vQcxKn2ngwU_0 2024-09-12T17:41:32.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.616+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12411359933856130913', time=2024-09-12T19:32:29.197660+0000, chain.objs.size()=1 2024-09-12T17:41:32.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.616+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.RsPzor-q6ApQgKb3AJXZSLHHryQY53C_0 2024-09-12T17:41:32.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.616+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13933803197043003334', time=2024-09-12T19:32:29.384746+0000, chain.objs.size()=1 2024-09-12T17:41:32.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.616+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.zj44pu218vDMV31_lwugm6kgN7oFyiO_0 2024-09-12T17:41:32.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.616+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1583622082883358563', time=2024-09-12T19:32:29.438759+0000, chain.objs.size()=1 2024-09-12T17:41:32.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.616+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.w_m-DoyA7oL4oTL3mnN1TqUaQHIeWiR_0 2024-09-12T17:41:32.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.616+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4920108169475828674', time=2024-09-12T19:32:29.456528+0000, chain.objs.size()=1 2024-09-12T17:41:32.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.616+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.mk6sEOF5FVdmxfUDjBmSsfK1PqBbCHw_0 2024-09-12T17:41:32.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.616+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1399414789749858835', time=2024-09-12T19:32:29.486945+0000, chain.objs.size()=1 2024-09-12T17:41:32.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.616+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.qeZHTMUnN6O494WK3bZxFfrtAeuoD-8_0 2024-09-12T17:41:32.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.616+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12350325610875125328', time=2024-09-12T19:32:29.531486+0000, chain.objs.size()=1 2024-09-12T17:41:32.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.616+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.6oKLeTmpImCcWKJWYPh-Faojr9TzprO_0 2024-09-12T17:41:32.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.616+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6065526864238932328', time=2024-09-12T19:32:29.771896+0000, chain.objs.size()=1 2024-09-12T17:41:32.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.616+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.u1szLu415XbgUQiZRnctgvGRFw075a1_0 2024-09-12T17:41:32.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.616+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12166884655425829521', time=2024-09-12T19:32:29.869466+0000, chain.objs.size()=1 2024-09-12T17:41:32.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.616+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.c8cbbU7GXI0QouTyXhVsGvv5goGtLsc_0 2024-09-12T17:41:32.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.616+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16589452923363656237', time=2024-09-12T19:32:29.884953+0000, chain.objs.size()=1 2024-09-12T17:41:32.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.616+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.xQCGdrXT13P-A3Wv3Wzk5RHoGljE5FO_0 2024-09-12T17:41:32.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.616+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17332064423405265886', time=2024-09-12T19:32:30.030518+0000, chain.objs.size()=1 2024-09-12T17:41:32.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.616+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.UGLtwPRLFcTkWVxvQHzy308s4ldfjno_0 2024-09-12T17:41:32.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.616+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17852780184193462796', time=2024-09-12T19:32:30.119881+0000, chain.objs.size()=1 2024-09-12T17:41:32.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.616+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.uslcnMybfO2x1UJcgwAOt2qipM-TKxp_0 2024-09-12T17:41:32.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.616+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6544892886057157166', time=2024-09-12T19:32:30.148091+0000, chain.objs.size()=1 2024-09-12T17:41:32.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.616+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.YUsrAf5Y2LElezKlLbBAC8t0B9UfgId_0 2024-09-12T17:41:32.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.616+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17328932686986963419', time=2024-09-12T19:32:49.704037+0000, chain.objs.size()=1 2024-09-12T17:41:32.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.616+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.m7mchWgIi9Po6L-dzQ4jyNs6KH6offX_0 2024-09-12T17:41:32.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.620+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16903431446216926348', time=2024-09-12T19:32:49.827869+0000, chain.objs.size()=1 2024-09-12T17:41:32.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.620+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.OnZe_qNL33PXKxu9tOOBdohpnuv-9w2_0 2024-09-12T17:41:32.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.620+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12870096059143864844', time=2024-09-12T19:32:49.943651+0000, chain.objs.size()=1 2024-09-12T17:41:32.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.620+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.CoAs3nnhq4-rXBmBfCGEdhI6MCso_Vf_0 2024-09-12T17:41:32.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.620+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.433002809895410478', time=2024-09-12T19:32:49.977157+0000, chain.objs.size()=1 2024-09-12T17:41:32.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.620+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.YH33t1PNS6mt2RLLqlIKKh_0siI01Xf_0 2024-09-12T17:41:32.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.620+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6367275245309101248', time=2024-09-12T19:32:49.989757+0000, chain.objs.size()=1 2024-09-12T17:41:32.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.620+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.shLwI6yySidFT9Jn3u2NnlFqgn0Z8dR_0 2024-09-12T17:41:32.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.620+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.774342666087040531', time=2024-09-12T19:32:50.242293+0000, chain.objs.size()=1 2024-09-12T17:41:32.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.620+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.L4iujaimyZ7wk3UjFpatHIQNs4mhaXc_0 2024-09-12T17:41:32.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.620+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2864735799318684259', time=2024-09-12T19:32:50.331733+0000, chain.objs.size()=1 2024-09-12T17:41:32.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.620+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.48bks_wFTr74KJk_4rCezNOn-9WB-qm_0 2024-09-12T17:41:32.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.620+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17055947744448502624', time=2024-09-12T19:32:50.543424+0000, chain.objs.size()=1 2024-09-12T17:41:32.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.620+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.QS5pVXkLs8Tqmra-B_67y7XKDlg_3-l_0 2024-09-12T17:41:32.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.620+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1000794505794316071', time=2024-09-12T19:32:50.561772+0000, chain.objs.size()=1 2024-09-12T17:41:32.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.620+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.6CQMtiMqa_EHDfjyaQaSb0j-88Hr2-6_0 2024-09-12T17:41:32.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.620+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5301853830813247425', time=2024-09-12T19:32:50.603769+0000, chain.objs.size()=1 2024-09-12T17:41:32.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.620+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.nHlrn2erXcuGQ46XygGLDAo-a_hkqFK_0 2024-09-12T17:41:32.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.620+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7935309910903429863', time=2024-09-12T19:32:50.630643+0000, chain.objs.size()=1 2024-09-12T17:41:32.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.620+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.odgcqCoq_SjiCgEptxL7CyR2Vjx15l7_0 2024-09-12T17:41:32.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.620+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11365261865877576502', time=2024-09-12T19:32:50.635113+0000, chain.objs.size()=1 2024-09-12T17:41:32.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.620+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.b2dSvJ44XXY9kJbYP7ETdCHlbrjVMiy_0 2024-09-12T17:41:32.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.620+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14730220786945437066', time=2024-09-12T19:32:50.899106+0000, chain.objs.size()=1 2024-09-12T17:41:32.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.620+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.LVIW6snMNP33d2F4P69-3WaxaMrdlwb_0 2024-09-12T17:41:32.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.620+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6513095778862833272', time=2024-09-12T19:32:50.910919+0000, chain.objs.size()=1 2024-09-12T17:41:32.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.620+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.5jqruox1dKUzc6ZofMTqantkE1xGmJd_0 2024-09-12T17:41:32.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.620+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14720755889153295750', time=2024-09-12T19:32:50.938145+0000, chain.objs.size()=1 2024-09-12T17:41:32.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.620+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.MpYlYUI9TOUDR9g0wGBIStNx_-o1rWs_0 2024-09-12T17:41:32.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.620+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10882676573375084464', time=2024-09-12T19:32:51.003787+0000, chain.objs.size()=1 2024-09-12T17:41:32.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.620+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.pdk629a82vF1z_87Fqs0M7PSDuKOUez_0 2024-09-12T17:41:32.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.620+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17454107793286928440', time=2024-09-12T19:32:51.007076+0000, chain.objs.size()=1 2024-09-12T17:41:32.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.620+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Xi5QZ9o9g3hO7_XSey4Lby0UpPztgYz_0 2024-09-12T17:41:32.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.620+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2323092328784658049', time=2024-09-12T19:32:51.247113+0000, chain.objs.size()=1 2024-09-12T17:41:32.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.620+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.igeXspHCIMguUb8Phxv63RNwGMi1SY8_0 2024-09-12T17:41:32.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.620+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2515975147936236294', time=2024-09-12T19:32:51.261919+0000, chain.objs.size()=1 2024-09-12T17:41:32.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.620+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.89BQeR9L5JN2AB_vDmZZEkV78J7R4jU_0 2024-09-12T17:41:32.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.620+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7120804704226949180', time=2024-09-12T19:32:51.315270+0000, chain.objs.size()=1 2024-09-12T17:41:32.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.620+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.xlehwq88fD3p5u6HjWrxU48ZlZG9HYE_0 2024-09-12T17:41:32.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.620+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6459884518710034718', time=2024-09-12T19:32:51.316281+0000, chain.objs.size()=1 2024-09-12T17:41:32.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.620+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.uyv_qX-zEQTHsZnz5PcLUgz0fk_c9CG_0 2024-09-12T17:41:32.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.620+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6514199967760821318', time=2024-09-12T19:32:51.347313+0000, chain.objs.size()=1 2024-09-12T17:41:32.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.620+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.FvQBJ4b_R1fCyaV0Ps_uQvTIO26n3ag_0 2024-09-12T17:41:32.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.620+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16289586968175689357', time=2024-09-12T19:32:51.367049+0000, chain.objs.size()=1 2024-09-12T17:41:32.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.620+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.kWGNlHHwew0hW2eSkLPHNHCkIJQEQLj_0 2024-09-12T17:41:32.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.624+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7197082545921891328', time=2024-09-12T19:32:51.383983+0000, chain.objs.size()=1 2024-09-12T17:41:32.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.624+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.L_K79H_bFjTU3xLFpUjuH9b_LT-4QCW_0 2024-09-12T17:41:32.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.624+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/46434 2024-09-12T17:41:32.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.628+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=31, truncated=0, next_marker='' 2024-09-12T17:41:32.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.628+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7231522661381390337', time=2024-09-12T19:32:51.559548+0000, chain.objs.size()=1 2024-09-12T17:41:32.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.628+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.OM2R4JXHMm_xkV0GSep72yd7gO8F2qb_0 2024-09-12T17:41:32.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.628+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9063953012884332758', time=2024-09-12T19:32:51.625613+0000, chain.objs.size()=1 2024-09-12T17:41:32.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.628+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.elSZmCEgJSa_bx1TqegfZ5U-A4mGFWd_0 2024-09-12T17:41:32.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.628+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2468773837454063759', time=2024-09-12T19:32:51.628922+0000, chain.objs.size()=1 2024-09-12T17:41:32.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.628+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Sch3GmMsaxLpa-Dr9mfgDN48Xw3ghhC_0 2024-09-12T17:41:32.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.628+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.403850815516705639', time=2024-09-12T19:32:51.649281+0000, chain.objs.size()=1 2024-09-12T17:41:32.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.628+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Mvtv9NpPeZ5AceXDkGriu4t1a05HqfE_0 2024-09-12T17:41:32.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.628+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8579763851078398216', time=2024-09-12T19:32:51.657066+0000, chain.objs.size()=1 2024-09-12T17:41:32.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.628+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.eTDC3Qz3i3kLq4Ebzy1JAkhbRPMmLzY_0 2024-09-12T17:41:32.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.628+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17974811493712581302', time=2024-09-12T19:32:51.661971+0000, chain.objs.size()=1 2024-09-12T17:41:32.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.628+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.S-rBgZAxByuGWaGeGcmNsCKx9dkyHVW_0 2024-09-12T17:41:32.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.628+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6803235315800976143', time=2024-09-12T19:32:51.667047+0000, chain.objs.size()=1 2024-09-12T17:41:32.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.628+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.lhyJ40Rmb-pXIbDs2GhhHJ69mnvFkVh_0 2024-09-12T17:41:32.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.628+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10221410588745209324', time=2024-09-12T19:32:51.671275+0000, chain.objs.size()=1 2024-09-12T17:41:32.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.628+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.FAOZWWfkPjYHvU0hzmMcI0thHi1C8UF_0 2024-09-12T17:41:32.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.628+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17550148720871963516', time=2024-09-12T19:32:51.686127+0000, chain.objs.size()=1 2024-09-12T17:41:32.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.628+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.lkfbSIfp43de_vA91b4MKUNMltxHImH_0 2024-09-12T17:41:32.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.628+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14628575441527836844', time=2024-09-12T19:32:51.864104+0000, chain.objs.size()=1 2024-09-12T17:41:32.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.628+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.BhGfGRnRPt_azgK8CzlFaWxv_s_k6cX_0 2024-09-12T17:41:32.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.628+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3558882043126433751', time=2024-09-12T19:32:51.894399+0000, chain.objs.size()=1 2024-09-12T17:41:32.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.628+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.1mKWuWlYB5nYwLkzNPcFpCYLu84A_2z_0 2024-09-12T17:41:32.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.628+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1932066246386528847', time=2024-09-12T19:32:51.990069+0000, chain.objs.size()=1 2024-09-12T17:41:32.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.628+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.YJbxxYmOMMHyeOFAwNmyEGhDNGeH3Ov_0 2024-09-12T17:41:32.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.628+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5576411314918508748', time=2024-09-12T19:32:52.002922+0000, chain.objs.size()=1 2024-09-12T17:41:32.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.628+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.I7UWveBZ26lXBY8KmPJktJRO7E0OUjy_0 2024-09-12T17:41:32.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.632+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15954756499392571786', time=2024-09-12T19:32:52.017362+0000, chain.objs.size()=1 2024-09-12T17:41:32.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.632+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.84aWoo3s3ddkH8LrgmmTqYEoTqeHgp__0 2024-09-12T17:41:32.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.632+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5802063515652072502', time=2024-09-12T19:33:08.639818+0000, chain.objs.size()=1 2024-09-12T17:41:32.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.632+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.376__shadow_.smZutHybhbigWiIiKwTRAPCG4bJ7sCG_0 2024-09-12T17:41:32.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.632+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15102265188000855509', time=2024-09-12T19:33:09.971259+0000, chain.objs.size()=1 2024-09-12T17:41:32.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.632+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.379__shadow_.GHw-HIp1ngAO7YWE_Y0EsCnhO_ZbPdE_0 2024-09-12T17:41:32.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.632+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.892365410457828540', time=2024-09-12T19:33:43.119499+0000, chain.objs.size()=1 2024-09-12T17:41:32.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.632+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.463__shadow_.VgoKJbi-b1sxGuuH5Di2oCeUQ6O-5jx_0 2024-09-12T17:41:32.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.632+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2084007605059292086', time=2024-09-12T19:33:49.249986+0000, chain.objs.size()=1 2024-09-12T17:41:32.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.632+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.483__shadow_.wxJlZ8tUqdeUAu_-0ySXEljPf2Nf0_e_0 2024-09-12T17:41:32.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.632+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4212749910170274659', time=2024-09-12T19:33:50.782069+0000, chain.objs.size()=1 2024-09-12T17:41:32.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.632+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.486__shadow_.tiLpJlO_9bpE2kYIp-B2lb00Y0hNJVH_0 2024-09-12T17:41:32.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.632+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7768171924189121316', time=2024-09-12T19:33:55.752937+0000, chain.objs.size()=1 2024-09-12T17:41:32.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.632+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.499__shadow_.rxuYRxjit1YLQ_f8hlQ34HPMFzPS-vs_0 2024-09-12T17:41:32.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.632+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6277746638618180646', time=2024-09-12T19:34:10.766723+0000, chain.objs.size()=1 2024-09-12T17:41:32.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.632+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.520__shadow:vnTHmsIJiT-Hz88eG2.lx-Whk0Nk.OS_.TcA4J15nwFjt9uV9r-Id1OMLNM0auQH_0 2024-09-12T17:41:32.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.632+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~ZFBZtWsOVsSWug56Gu6jAG_MQ7cWBO9', time=2024-09-12T19:34:13.658702+0000, chain.objs.size()=1 2024-09-12T17:41:32.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.632+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__multipart_mymultipart.2~ZFBZtWsOVsSWug56Gu6jAG_MQ7cWBO9.2 2024-09-12T17:41:32.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.632+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6649184450253109738', time=2024-09-12T19:35:05.936098+0000, chain.objs.size()=1 2024-09-12T17:41:32.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.632+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.558__shadow_.uMebDNk8_56GiW3NlOXP7wLomRAlafM_0 2024-09-12T17:41:32.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.632+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6612483613821576409', time=2024-09-12T19:35:42.981415+0000, chain.objs.size()=1 2024-09-12T17:41:32.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.632+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.577__shadow:016FLBDhPdVXev-mKbPby1U3K.8wrc0_.7iorLn7JCiUvriN7fpGPhu9e9ytA67y_0 2024-09-12T17:41:32.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.632+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7094533210188550338', time=2024-09-12T19:35:43.501729+0000, chain.objs.size()=1 2024-09-12T17:41:32.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.632+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.577__shadow:J9ZjgH0-qI-aqzDgkrg0659M1GHi4is_.LLiycaLEMc1w8xNWP6uBFVXyuyv_P-e_0 2024-09-12T17:41:32.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.632+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14653658547470486416', time=2024-09-12T19:35:54.121585+0000, chain.objs.size()=1 2024-09-12T17:41:32.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.632+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.579__shadow:M2GNyqQxg0yUAdpEyZcYEpWsP4fwBVv_.IKvswOXr8B8o6PX09va5kxiFfLeVLnq_0 2024-09-12T17:41:32.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.632+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13977776603889087609', time=2024-09-12T19:35:59.018551+0000, chain.objs.size()=1 2024-09-12T17:41:32.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.632+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.587__shadow:GCVF0QMrs1fJTSperDWbd-e3t-okyON_.VnTiNh7po6gzNqdSafWguK07rXFbWxq_0 2024-09-12T17:41:32.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.632+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12788226459131527985', time=2024-09-12T19:38:28.082822+0000, chain.objs.size()=1 2024-09-12T17:41:32.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.632+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.638__shadow_.hfSbzeKDHuG1RoypxoZ4Za8B-xAMSjH_0 2024-09-12T17:41:32.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.632+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9203675652328887507', time=2024-09-12T19:38:54.516819+0000, chain.objs.size()=1 2024-09-12T17:41:32.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.632+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.698__shadow:5f.jW87xpmnWShCc7U2oOvff4AxnA1R_.5AuKfT6mmD8wBEGNR-0mlYwvcPQN5ZP_0 2024-09-12T17:41:32.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.632+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15381746727435113912', time=2024-09-12T19:38:56.981037+0000, chain.objs.size()=1 2024-09-12T17:41:32.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.632+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.704__shadow:sSIKmAet3l3vI6IO5WTD.pWD3qxdY6p_.sqOyg5Qs9EUgQPecU27qrbsTUCXVCFJ_0 2024-09-12T17:41:32.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.636+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7637774481189722068', time=2024-09-12T19:39:21.039229+0000, chain.objs.size()=1 2024-09-12T17:41:32.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.636+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.717__shadow:jZXv-bXJomswDVPyioJ93nCaRghk8ek_.t-jHotGAAbWHF7z9ioohfghbMxdwOZC_0 2024-09-12T17:41:32.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.636+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:41:32.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.636+0000 7fd765adf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:41:32.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.640+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:41:32.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.640+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:41:32.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.640+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/52076' 2024-09-12T17:41:32.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.640+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8421709320978235060', time=2024-09-12T19:29:43.850304+0000, chain.objs.size()=5 2024-09-12T17:41:32.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.640+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.159__multipart_mymultipart-LUKEWARM.2~ObIy7mcmAhjiYLUGyAmS75MIkTkS0a5.1 2024-09-12T17:41:32.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.640+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.159__shadow_mymultipart-LUKEWARM.2~ObIy7mcmAhjiYLUGyAmS75MIkTkS0a5.1_1 2024-09-12T17:41:32.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.640+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.159__multipart_mymultipart-LUKEWARM.2~ObIy7mcmAhjiYLUGyAmS75MIkTkS0a5.2 2024-09-12T17:41:32.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.640+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.159__shadow_mymultipart-LUKEWARM.2~ObIy7mcmAhjiYLUGyAmS75MIkTkS0a5.2_1 2024-09-12T17:41:32.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.640+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.159__multipart_mymultipart-LUKEWARM.2~ObIy7mcmAhjiYLUGyAmS75MIkTkS0a5.3 2024-09-12T17:41:32.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.640+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='_PQULCfeC2b1R9cG6zjCf52mB3vfqLiP', time=2024-09-12T19:29:45.440255+0000, chain.objs.size()=1 2024-09-12T17:41:32.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.640+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.160__shadow_.PTaEzA0gxdTg1wyqgRAVUrqPnMX34tE_0 2024-09-12T17:41:32.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.640+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9987163468423087214', time=2024-09-12T19:29:46.207937+0000, chain.objs.size()=5 2024-09-12T17:41:32.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.640+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.161__multipart_foo-STANDARD.2~G1qnVuOkLMJwjIZvj_CzIq5TMlltK69.1 2024-09-12T17:41:32.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.640+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.161__shadow_foo-STANDARD.2~G1qnVuOkLMJwjIZvj_CzIq5TMlltK69.1_1 2024-09-12T17:41:32.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.640+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.161__multipart_foo-STANDARD.2~G1qnVuOkLMJwjIZvj_CzIq5TMlltK69.2 2024-09-12T17:41:32.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.640+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.161__shadow_foo-STANDARD.2~G1qnVuOkLMJwjIZvj_CzIq5TMlltK69.2_1 2024-09-12T17:41:32.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.640+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.161__multipart_foo-STANDARD.2~G1qnVuOkLMJwjIZvj_CzIq5TMlltK69.3 2024-09-12T17:41:32.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.640+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7919309679602319725', time=2024-09-12T19:29:46.983062+0000, chain.objs.size()=5 2024-09-12T17:41:32.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.640+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.161__multipart_foo-LUKEWARM.2~bVqEd_dwZkcwq6QJQ-gnQ5T_VQPmUTr.1 2024-09-12T17:41:32.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.644+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.161__shadow_foo-LUKEWARM.2~bVqEd_dwZkcwq6QJQ-gnQ5T_VQPmUTr.1_1 2024-09-12T17:41:32.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.644+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.161__multipart_foo-LUKEWARM.2~bVqEd_dwZkcwq6QJQ-gnQ5T_VQPmUTr.2 2024-09-12T17:41:32.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.644+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.161__shadow_foo-LUKEWARM.2~bVqEd_dwZkcwq6QJQ-gnQ5T_VQPmUTr.2_1 2024-09-12T17:41:32.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.644+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.161__multipart_foo-LUKEWARM.2~bVqEd_dwZkcwq6QJQ-gnQ5T_VQPmUTr.3 2024-09-12T17:41:32.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.644+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2159287879106237185', time=2024-09-12T19:31:20.248169+0000, chain.objs.size()=1 2024-09-12T17:41:32.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.644+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.254__shadow_.aU-vpeGNe705HQ3Rr0UoudZPbUxyRBo_0 2024-09-12T17:41:32.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.644+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9896027915060608571', time=2024-09-12T19:31:21.720520+0000, chain.objs.size()=1 2024-09-12T17:41:32.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.644+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.258__shadow_.wjetZhwhFyN-hMTFsGLm89oPOUmCMJi_0 2024-09-12T17:41:32.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.644+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2315952171100555436', time=2024-09-12T19:31:42.451118+0000, chain.objs.size()=1 2024-09-12T17:41:32.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.644+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.EmVaT9Am8nZBR32w56RlktPK56aMvjE_0 2024-09-12T17:41:32.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.644+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11425624596746864073', time=2024-09-12T19:31:42.541151+0000, chain.objs.size()=1 2024-09-12T17:41:32.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.644+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Vir_Vv8wG0laJWzuzK5OFjdQVt70f_D_0 2024-09-12T17:41:32.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.644+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1227166705447292106', time=2024-09-12T19:31:42.543326+0000, chain.objs.size()=1 2024-09-12T17:41:32.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.644+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.08q7bw5yZRb8O1EumKyZgSVXxFRr8M0_0 2024-09-12T17:41:32.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.644+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2577744025594724594', time=2024-09-12T19:31:42.565592+0000, chain.objs.size()=1 2024-09-12T17:41:32.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.644+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.LVPNTqqhtrtg4MbKFvtVDB0CE02V5gz_0 2024-09-12T17:41:32.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.644+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17580747868561002313', time=2024-09-12T19:31:42.573845+0000, chain.objs.size()=1 2024-09-12T17:41:32.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.644+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_._fHmzsx5GZtW-sYUJeSPP0XSnuvTC7d_0 2024-09-12T17:41:32.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.648+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8366339752002522109', time=2024-09-12T19:31:42.592001+0000, chain.objs.size()=1 2024-09-12T17:41:32.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.648+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.lUiN3YGL3D1D6nn9M0oqTWyal1C_Vn8_0 2024-09-12T17:41:32.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.648+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13071287213948531789', time=2024-09-12T19:31:42.602795+0000, chain.objs.size()=1 2024-09-12T17:41:32.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.648+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.frV-scdwdQK8aWqIT3OWfUjp12fhpDL_0 2024-09-12T17:41:32.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.648+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9364044455619881445', time=2024-09-12T19:31:42.603523+0000, chain.objs.size()=1 2024-09-12T17:41:32.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.648+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.4k9ZX1DytYWbVDCs6Zi3JkKUiOJFWS__0 2024-09-12T17:41:32.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.648+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6292407589851711922', time=2024-09-12T19:31:42.604865+0000, chain.objs.size()=1 2024-09-12T17:41:32.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.648+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.yIBIhvS_5MksFpacF7IjskLiQUWeCCI_0 2024-09-12T17:41:32.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.648+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17966773880556599594', time=2024-09-12T19:31:42.611070+0000, chain.objs.size()=1 2024-09-12T17:41:32.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.648+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.rs57__gcWqVHCTaJvgHpjt90sdlXc-8_0 2024-09-12T17:41:32.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.648+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.195135136954339976', time=2024-09-12T19:31:42.677828+0000, chain.objs.size()=1 2024-09-12T17:41:32.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.648+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.E1ZUxRx-Ip_3yLclkimobssb3HP30Vw_0 2024-09-12T17:41:32.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.648+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12059625806101264316', time=2024-09-12T19:31:42.689348+0000, chain.objs.size()=1 2024-09-12T17:41:32.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.648+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.em7YFLDDrJ2GXYEliXoiGFJR8dCS_UK_0 2024-09-12T17:41:32.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.648+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2151720237834426327', time=2024-09-12T19:31:42.864875+0000, chain.objs.size()=1 2024-09-12T17:41:32.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.648+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.6nzRgxv9AoK8nWSkmGsFg-2vDNrAF0B_0 2024-09-12T17:41:32.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.648+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18169299651057878291', time=2024-09-12T19:31:42.879050+0000, chain.objs.size()=1 2024-09-12T17:41:32.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.648+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.UBFrnRB1lNxC4eq3JeGd_fe9f4WKza__0 2024-09-12T17:41:32.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.648+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5198665534237588562', time=2024-09-12T19:31:42.903463+0000, chain.objs.size()=1 2024-09-12T17:41:32.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.648+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Xd0ZHqUlsaojR6fzUD8zyqoPkAoQL4t_0 2024-09-12T17:41:32.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.648+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.745437161810347838', time=2024-09-12T19:31:43.095001+0000, chain.objs.size()=1 2024-09-12T17:41:32.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.648+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.CUvIrNJGN1npn6Tyrn2z_Yah6FGUDJP_0 2024-09-12T17:41:32.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.652+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2686649932604325780', time=2024-09-12T19:31:43.159401+0000, chain.objs.size()=1 2024-09-12T17:41:32.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.652+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.4JrtyDxws3s1vceAbniOuysUsf84lA8_0 2024-09-12T17:41:32.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.652+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17444426543414149186', time=2024-09-12T19:31:43.221079+0000, chain.objs.size()=1 2024-09-12T17:41:32.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.652+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.bf_QIBRGHygJRG08Qag4Ke3x-3w5uz8_0 2024-09-12T17:41:32.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.652+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8743705815948326935', time=2024-09-12T19:31:43.414881+0000, chain.objs.size()=1 2024-09-12T17:41:32.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.652+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.OCFQEzrG_Ryupn8h-1ZlwMPuWl7L-_J_0 2024-09-12T17:41:32.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.652+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2730284635678929283', time=2024-09-12T19:31:43.474450+0000, chain.objs.size()=1 2024-09-12T17:41:32.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.652+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.onGr6LPH533h7CM6w55GY5ACGZDs49T_0 2024-09-12T17:41:32.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.652+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14763680368730549028', time=2024-09-12T19:31:43.519176+0000, chain.objs.size()=1 2024-09-12T17:41:32.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.652+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.RxU3JnaQyfokQ8eWFEBl5c9XJwNo_Ob_0 2024-09-12T17:41:32.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.652+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12196789213420815933', time=2024-09-12T19:31:43.550472+0000, chain.objs.size()=1 2024-09-12T17:41:32.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.652+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.OYTRJkw25iBm5i-1x88042y4KWUwwnW_0 2024-09-12T17:41:32.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.652+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17118315351675822295', time=2024-09-12T19:31:43.589379+0000, chain.objs.size()=1 2024-09-12T17:41:32.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.652+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.vQwuGoR5Omd2hshgmVzOhfO4IRfMmcX_0 2024-09-12T17:41:32.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.652+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10312335882485818384', time=2024-09-12T19:31:43.736573+0000, chain.objs.size()=1 2024-09-12T17:41:32.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.652+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.VAOlv2FKGrJAtCygPs2jGZ3XI-lmLCk_0 2024-09-12T17:41:32.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.652+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14798480138975948277', time=2024-09-12T19:31:43.804473+0000, chain.objs.size()=1 2024-09-12T17:41:32.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.652+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.pglQsrNLsO1Q8IbYg49-kx7PUesPIZX_0 2024-09-12T17:41:32.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.652+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15150906120509290137', time=2024-09-12T19:31:43.903178+0000, chain.objs.size()=1 2024-09-12T17:41:32.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.652+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.99bO4O5dSVT_Xdc_UszDLfz-NMzCHTB_0 2024-09-12T17:41:32.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.652+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.751218535827740637', time=2024-09-12T19:31:44.062777+0000, chain.objs.size()=1 2024-09-12T17:41:32.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.652+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.5CIm9VzReaZI4bwq0LMpxbxa2DC2qMQ_0 2024-09-12T17:41:32.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.652+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7905701282765884563', time=2024-09-12T19:31:44.129946+0000, chain.objs.size()=1 2024-09-12T17:41:32.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.652+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.pDv4GIna-olieXCx4DdKobW7lg7qA4T_0 2024-09-12T17:41:32.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.652+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17199661769037763870', time=2024-09-12T19:31:44.163449+0000, chain.objs.size()=1 2024-09-12T17:41:32.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.652+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.RCCwXqGnfu48VlKTZL9mdO_YyabOn4K_0 2024-09-12T17:41:32.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.652+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18267148318754360973', time=2024-09-12T19:31:44.183147+0000, chain.objs.size()=1 2024-09-12T17:41:32.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.652+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.0-4fW0oKBxLdK9pFknqH7VsySJgGirv_0 2024-09-12T17:41:32.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.652+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8253106723922376506', time=2024-09-12T19:31:44.210769+0000, chain.objs.size()=1 2024-09-12T17:41:32.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.652+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.LC6isG1M24VWQ8nSIbuokgnxxYfbMkm_0 2024-09-12T17:41:32.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.652+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8084062383875818593', time=2024-09-12T19:31:44.237509+0000, chain.objs.size()=1 2024-09-12T17:41:32.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.652+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.3Rf1qgm_XnVJ0DiSypve-xvL98b5R8t_0 2024-09-12T17:41:32.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.652+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9411355651552750343', time=2024-09-12T19:31:44.519793+0000, chain.objs.size()=1 2024-09-12T17:41:32.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.652+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Goh6b4trMx7KoYPGmt75AgFU5b_KrBd_0 2024-09-12T17:41:32.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.652+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9549462095041279174', time=2024-09-12T19:31:46.943080+0000, chain.objs.size()=1 2024-09-12T17:41:32.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.652+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.269__shadow_.xSzfY8hcc_N-iPrw_LDkrmz8uDe_mDl_0 2024-09-12T17:41:32.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.652+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11064268655489272709', time=2024-09-12T19:31:54.234203+0000, chain.objs.size()=1 2024-09-12T17:41:32.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.652+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.288__shadow_.On4QvSoAcyTvpYR8JcXIrvivlhUbzsg_0 2024-09-12T17:41:32.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.652+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9981663517897575512', time=2024-09-12T19:31:54.989428+0000, chain.objs.size()=1 2024-09-12T17:41:32.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.652+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.290__shadow_.bZodnIS-dsnQhOv-GaO2gEtQsDSUW4T_0 2024-09-12T17:41:32.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.652+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6404969369420211991', time=2024-09-12T19:31:56.476331+0000, chain.objs.size()=1 2024-09-12T17:41:32.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.652+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.292__shadow_.cocEzSX6wXLnyYP40DvbkzqtX6XOIis_0 2024-09-12T17:41:32.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.652+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6182630289435746055', time=2024-09-12T19:31:56.516584+0000, chain.objs.size()=1 2024-09-12T17:41:32.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.652+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.292__shadow_.V4_QuwLl5GTrStACSPIonkm6k97RkxM_0 2024-09-12T17:41:32.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.656+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5373202424523097139', time=2024-09-12T19:31:57.562933+0000, chain.objs.size()=1 2024-09-12T17:41:32.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.656+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.293__shadow_.6RSpqtVLWWxqGrrfqhqwTx6BY-5kat3_0 2024-09-12T17:41:32.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.656+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16037321861634208368', time=2024-09-12T19:31:58.353612+0000, chain.objs.size()=1 2024-09-12T17:41:32.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.656+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.295__shadow_.gqzP671PlCdO-l2W2RCzJHvlYu2oftd_0 2024-09-12T17:41:32.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.656+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5926738192068941774', time=2024-09-12T19:32:00.002814+0000, chain.objs.size()=1 2024-09-12T17:41:32.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.656+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.299__shadow_.950ckwvN_XquBpLI5Jph78IfgJqtxQO_0 2024-09-12T17:41:32.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.656+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8835782086179310358', time=2024-09-12T19:32:01.509764+0000, chain.objs.size()=1 2024-09-12T17:41:32.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.656+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.303__shadow_.x1vdOWRmmgt02MnQkKQAAZX4YroV1lI_0 2024-09-12T17:41:32.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.656+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17216483599652234978', time=2024-09-12T19:32:06.029217+0000, chain.objs.size()=1 2024-09-12T17:41:32.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.656+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.315__shadow_.24yErm0935xCtEAPM-xFBBZR6TQowia_0 2024-09-12T17:41:32.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.656+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11334700207103945726', time=2024-09-12T19:32:27.884594+0000, chain.objs.size()=1 2024-09-12T17:41:32.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.656+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.maUCjrLECsWrkDPhkcKDG7jArqeM0lB_0 2024-09-12T17:41:32.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.656+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1620502729527821582', time=2024-09-12T19:32:27.906119+0000, chain.objs.size()=1 2024-09-12T17:41:32.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.656+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.NuTEwV7zlvdnhCWr1up_pkUEdm4DFmx_0 2024-09-12T17:41:32.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.656+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7548955466631035315', time=2024-09-12T19:32:28.001299+0000, chain.objs.size()=1 2024-09-12T17:41:32.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.656+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.UerkguIWCsB0I9CTOpgo4Cq-h517cqC_0 2024-09-12T17:41:32.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.656+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2781781638562516580', time=2024-09-12T19:32:28.069920+0000, chain.objs.size()=1 2024-09-12T17:41:32.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.656+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.qcYMhHokx-afpuDE0dSmR9STDspdZKy_0 2024-09-12T17:41:32.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.656+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4812085196540026591', time=2024-09-12T19:32:28.269942+0000, chain.objs.size()=1 2024-09-12T17:41:32.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.656+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.TDNuiY0p9A_uQj7v-Lhs3CNwxC0yt5r_0 2024-09-12T17:41:32.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.656+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7780302151366146229', time=2024-09-12T19:32:28.381268+0000, chain.objs.size()=1 2024-09-12T17:41:32.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.656+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.SA-WaG4leIYgHgZ5iKi3E_bvvZOhE8c_0 2024-09-12T17:41:32.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.656+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9250005352507166415', time=2024-09-12T19:32:28.401205+0000, chain.objs.size()=1 2024-09-12T17:41:32.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.656+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.vRHYre636mo39UI95WxXhkT7ag1nkMN_0 2024-09-12T17:41:32.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.656+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4651618018400781177', time=2024-09-12T19:32:28.760435+0000, chain.objs.size()=1 2024-09-12T17:41:32.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.656+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.F0CvD7CPSRAvayS7oEAYwf9B2XyDmKm_0 2024-09-12T17:41:32.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.660+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9796755452416202406', time=2024-09-12T19:32:28.779869+0000, chain.objs.size()=1 2024-09-12T17:41:32.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.660+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.-o9d0hnHizxqF-hUU4EVnt7-G156TRL_0 2024-09-12T17:41:32.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.660+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15707980723986845608', time=2024-09-12T19:32:28.818932+0000, chain.objs.size()=1 2024-09-12T17:41:32.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.660+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.xq5kA_4F5f9lTlpmg8rgyuCYUqr3ZqF_0 2024-09-12T17:41:32.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.660+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3885126598937892848', time=2024-09-12T19:32:29.034345+0000, chain.objs.size()=1 2024-09-12T17:41:32.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.660+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.YP1bU31L7qJQHw9dJTnHkFu6wZhAg8n_0 2024-09-12T17:41:32.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.660+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5000428047261144971', time=2024-09-12T19:32:29.057107+0000, chain.objs.size()=1 2024-09-12T17:41:32.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.660+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.CgwqPMFhiCJYpzuU6NL2-e_5eehLymp_0 2024-09-12T17:41:32.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.660+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10141573228541693497', time=2024-09-12T19:32:29.093652+0000, chain.objs.size()=1 2024-09-12T17:41:32.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.660+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.5DddWMM0qSI_swFIg2OazE_ewAZp1GF_0 2024-09-12T17:41:32.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.660+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.788227744734339760', time=2024-09-12T19:32:29.152059+0000, chain.objs.size()=1 2024-09-12T17:41:32.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.660+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.5bQwPVmMNT3Uy24jOTcONwve1FzNkEP_0 2024-09-12T17:41:32.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.660+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9578528676884450038', time=2024-09-12T19:32:29.230258+0000, chain.objs.size()=1 2024-09-12T17:41:32.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.660+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.4_la3Mq9-8w-anZ-SzOu6V5bVqqaboP_0 2024-09-12T17:41:32.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.660+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7094978908875100929', time=2024-09-12T19:32:29.416425+0000, chain.objs.size()=1 2024-09-12T17:41:32.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.660+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.lREQMYLSVuJ9IozVIZsud4ju8TkGnqC_0 2024-09-12T17:41:32.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.660+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12539477996252076530', time=2024-09-12T19:32:29.496188+0000, chain.objs.size()=1 2024-09-12T17:41:32.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.660+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.u4EqmVWVQxOUtTj1lhibfCC1ii5YwYv_0 2024-09-12T17:41:32.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.660+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12831931671088521643', time=2024-09-12T19:32:29.552637+0000, chain.objs.size()=1 2024-09-12T17:41:32.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.660+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.TRd0lTQBakh7N4avfPRNgMFZYZefKTq_0 2024-09-12T17:41:32.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.660+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7069905670697032892', time=2024-09-12T19:32:29.685958+0000, chain.objs.size()=1 2024-09-12T17:41:32.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.660+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.S43JSK33Rg8kdWVBhl5y_c2iP8N3vd5_0 2024-09-12T17:41:32.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.660+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6618750095306332802', time=2024-09-12T19:32:29.733161+0000, chain.objs.size()=1 2024-09-12T17:41:32.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.660+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.pT6s7a29IdBkaeo-ISwbjfGRZp0YpvL_0 2024-09-12T17:41:32.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.660+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14612506601882254262', time=2024-09-12T19:32:29.744458+0000, chain.objs.size()=1 2024-09-12T17:41:32.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.660+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.o3NkQHWwta1x-vV-6tSwejK-qmHW16B_0 2024-09-12T17:41:32.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.660+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10741124100334421645', time=2024-09-12T19:32:29.835860+0000, chain.objs.size()=1 2024-09-12T17:41:32.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.660+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.I9f0IQBsz_iZvhxV-yPwePJeSsUxV0a_0 2024-09-12T17:41:32.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.660+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7321158675307467734', time=2024-09-12T19:32:29.873009+0000, chain.objs.size()=1 2024-09-12T17:41:32.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.660+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.S5TB7pvSYVebR4rQhWH4wtFpu062JAY_0 2024-09-12T17:41:32.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.660+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14844986095253890353', time=2024-09-12T19:32:30.026598+0000, chain.objs.size()=1 2024-09-12T17:41:32.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.660+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.lM2kjTABdXlmSbywBE0GeIQraLouOGs_0 2024-09-12T17:41:32.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.660+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17746727446285885470', time=2024-09-12T19:32:30.061274+0000, chain.objs.size()=1 2024-09-12T17:41:32.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.660+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.1JeWa3aW2c15MoCBfPvSTB2xgyXUdtT_0 2024-09-12T17:41:32.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.660+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3604364878648488531', time=2024-09-12T19:32:30.079964+0000, chain.objs.size()=1 2024-09-12T17:41:32.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.660+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.S73DooPNaWQtJZmtVQVVwLbGo7F-Pnu_0 2024-09-12T17:41:32.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.660+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3244009612472032901', time=2024-09-12T19:32:49.506918+0000, chain.objs.size()=1 2024-09-12T17:41:32.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.660+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.jd6Vzl7lwHSqGPfxIYZtUGdDoxwkIx0_0 2024-09-12T17:41:32.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.660+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1341214658409373949', time=2024-09-12T19:32:49.511029+0000, chain.objs.size()=1 2024-09-12T17:41:32.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.660+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.gEejeG9w7m_i2rm9kRcf2XmVrNSPx1__0 2024-09-12T17:41:32.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.660+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10973697628455893700', time=2024-09-12T19:32:49.522780+0000, chain.objs.size()=1 2024-09-12T17:41:32.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.660+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.UIK7PbY5dXBF_grgdodUbEeJsWcj7dZ_0 2024-09-12T17:41:32.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.664+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11461067453182968214', time=2024-09-12T19:32:49.569672+0000, chain.objs.size()=1 2024-09-12T17:41:32.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.664+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.lkqrnBv3sB_LVY11vq98V6ZXJEa4B-F_0 2024-09-12T17:41:32.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.664+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7616998475170893594', time=2024-09-12T19:32:49.578779+0000, chain.objs.size()=1 2024-09-12T17:41:32.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.664+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.jpEtdFa5AOF4Tmc61q6sM0CokMjHUZL_0 2024-09-12T17:41:32.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.664+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6517244575790744669', time=2024-09-12T19:32:49.768959+0000, chain.objs.size()=1 2024-09-12T17:41:32.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.664+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.UE7z3aRVfVTuYbUQ9OqZ603yMV2eGKQ_0 2024-09-12T17:41:32.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.664+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14185323314202300481', time=2024-09-12T19:32:49.839081+0000, chain.objs.size()=1 2024-09-12T17:41:32.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.664+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.onjnXmbty9yG0p8U5mGhCNy75zOSPHa_0 2024-09-12T17:41:32.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.664+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5838366546952158046', time=2024-09-12T19:32:49.866192+0000, chain.objs.size()=1 2024-09-12T17:41:32.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.664+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.XbbUP69As3X5osZXmBH79jxXzak8LVI_0 2024-09-12T17:41:32.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.664+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17922107984271905968', time=2024-09-12T19:32:49.945408+0000, chain.objs.size()=1 2024-09-12T17:41:32.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.664+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.GwnNg0norXuqvlEYZF98Qnkzq6hhgnH_0 2024-09-12T17:41:32.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.664+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16565062609657196695', time=2024-09-12T19:32:49.993831+0000, chain.objs.size()=1 2024-09-12T17:41:32.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.664+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.42YRs_YXpHZ7aVjkiwFhL5UzhiSPEeS_0 2024-09-12T17:41:32.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.664+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9784500309432810583', time=2024-09-12T19:32:50.132519+0000, chain.objs.size()=1 2024-09-12T17:41:32.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.664+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.ItM54qSmf90eeu7KETe74yyrcsukDbD_0 2024-09-12T17:41:32.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.664+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1227077532638481734', time=2024-09-12T19:32:50.269003+0000, chain.objs.size()=1 2024-09-12T17:41:32.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.664+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.WQtUZaD1-n2q0BcE289sTfi971LJaiw_0 2024-09-12T17:41:32.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.664+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14128491550823063954', time=2024-09-12T19:32:50.486045+0000, chain.objs.size()=1 2024-09-12T17:41:32.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.664+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.qfRAkOLt4wWvv6oiJ8yvAO9rUt7EKE2_0 2024-09-12T17:41:32.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.664+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.578060757448229972', time=2024-09-12T19:32:50.507119+0000, chain.objs.size()=1 2024-09-12T17:41:32.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.664+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.J7O31ScsE7AapI7BHZJBmsgd-oodSCh_0 2024-09-12T17:41:32.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.664+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2127093181530527612', time=2024-09-12T19:32:50.512434+0000, chain.objs.size()=1 2024-09-12T17:41:32.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.664+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.uf2wMRGkL9qju9GNRsF89PW0YASbrEt_0 2024-09-12T17:41:32.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.668+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12775232393454732045', time=2024-09-12T19:32:50.576026+0000, chain.objs.size()=1 2024-09-12T17:41:32.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.668+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.-SwzO-NV8sgww1DRN8ikr_voLXYDU25_0 2024-09-12T17:41:32.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.668+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2609596826065796590', time=2024-09-12T19:32:50.664661+0000, chain.objs.size()=1 2024-09-12T17:41:32.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.668+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.VjNEH0qvProV06C4miTEfxCp5s0VEjP_0 2024-09-12T17:41:32.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.668+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14649217548745920315', time=2024-09-12T19:32:50.672253+0000, chain.objs.size()=1 2024-09-12T17:41:32.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.668+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Tu0-BPfr06dq7hMv8PqVSvCMKsKE-Os_0 2024-09-12T17:41:32.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.668+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15278506966011098904', time=2024-09-12T19:32:50.686472+0000, chain.objs.size()=1 2024-09-12T17:41:32.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.668+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.BmS6QcWm_mIIjJR80IWm8RIqsAnqE5G_0 2024-09-12T17:41:32.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.668+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2155043451835636439', time=2024-09-12T19:32:50.841685+0000, chain.objs.size()=1 2024-09-12T17:41:32.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.668+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.3_wDm94urh13x3jv7mOcm9xs9Pj71rx_0 2024-09-12T17:41:32.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.668+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5125104922718494921', time=2024-09-12T19:32:50.867257+0000, chain.objs.size()=1 2024-09-12T17:41:32.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.668+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.YnlkrI0IFWRE8-gnbpwVVdkN2IcWbpc_0 2024-09-12T17:41:32.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.668+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7555828108036190459', time=2024-09-12T19:32:50.870507+0000, chain.objs.size()=1 2024-09-12T17:41:32.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.668+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.fUo1Kup5RpScR0O4C2T4-7BNcMIuKU4_0 2024-09-12T17:41:32.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.668+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13909622969010876682', time=2024-09-12T19:32:50.979027+0000, chain.objs.size()=1 2024-09-12T17:41:32.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.668+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.A9NMKHhTx3dvAble54AccVkk2fdr1OH_0 2024-09-12T17:41:32.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.668+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11158248581791919724', time=2024-09-12T19:32:50.985442+0000, chain.objs.size()=1 2024-09-12T17:41:32.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.668+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.ZBjMn5WBTeYQ4-7c8io_VXNEekiJ_FJ_0 2024-09-12T17:41:32.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.668+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16195146465303353367', time=2024-09-12T19:32:50.993830+0000, chain.objs.size()=1 2024-09-12T17:41:32.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.668+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.iK1KLSujbHPccSGTTjITn-ga394ZwGx_0 2024-09-12T17:41:32.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.672+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/52076 2024-09-12T17:41:32.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.672+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=32, truncated=0, next_marker='' 2024-09-12T17:41:32.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.672+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5076354671699483522', time=2024-09-12T19:32:51.324011+0000, chain.objs.size()=1 2024-09-12T17:41:32.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.672+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.HMRcqBGPSe6yv2QXzDdFu4PKk31ZptU_0 2024-09-12T17:41:32.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.672+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11637519989035186288', time=2024-09-12T19:32:51.532587+0000, chain.objs.size()=1 2024-09-12T17:41:32.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.672+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.FHJ6oHqddztx3YZ5eMuvDwaMxmOWoUI_0 2024-09-12T17:41:32.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.672+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11348199373477322690', time=2024-09-12T19:32:51.603403+0000, chain.objs.size()=1 2024-09-12T17:41:32.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.672+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.sG8c93RgMScpq-Bw01FPF1HJGHGs9An_0 2024-09-12T17:41:32.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.672+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5225933913018823593', time=2024-09-12T19:32:51.680277+0000, chain.objs.size()=1 2024-09-12T17:41:32.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.672+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.qbwuwvhVoBjcfEXEvrPUECyoJ1mKPzf_0 2024-09-12T17:41:32.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.672+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17452217344343033992', time=2024-09-12T19:32:51.685559+0000, chain.objs.size()=1 2024-09-12T17:41:32.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.672+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.VMDO8cCdD4ySwR0TJpXNv_2FIflJLlZ_0 2024-09-12T17:41:32.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.672+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9761262164079476819', time=2024-09-12T19:32:51.690952+0000, chain.objs.size()=1 2024-09-12T17:41:32.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.672+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.JI-5AEjtr7y5SMmbnFICOX_n47VgWUl_0 2024-09-12T17:41:32.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.672+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15898852726794138755', time=2024-09-12T19:32:51.855926+0000, chain.objs.size()=1 2024-09-12T17:41:32.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.672+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.ZH6u6XQUhsqg1Jyf21a6k7Re1Q3nRCs_0 2024-09-12T17:41:32.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.672+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8509331503469374541', time=2024-09-12T19:32:57.889426+0000, chain.objs.size()=1 2024-09-12T17:41:32.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.672+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.342__shadow_.uFSnMDhI59LEA5J0ivZfnQyPFM5Prc7_0 2024-09-12T17:41:32.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.672+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11413617981843431099', time=2024-09-12T19:33:07.906464+0000, chain.objs.size()=1 2024-09-12T17:41:32.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.672+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.374__shadow_.DXF_269gFcNJIBLoo_rnbJ_YpM8ph-l_0 2024-09-12T17:41:32.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.672+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6462752245717646271', time=2024-09-12T19:33:13.985557+0000, chain.objs.size()=1 2024-09-12T17:41:32.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.672+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.390__shadow_.DMxfdHR4Tc09nyLJr799-gF0C-Lwuyj_0 2024-09-12T17:41:32.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.672+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10219856350324752909', time=2024-09-12T19:33:31.038436+0000, chain.objs.size()=1 2024-09-12T17:41:32.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.672+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.436__shadow_._qWTM-cb0KacMDuTGtioQ6Oar2lq7zh_0 2024-09-12T17:41:32.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.672+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12394527131661845428', time=2024-09-12T19:33:44.505816+0000, chain.objs.size()=1 2024-09-12T17:41:32.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.672+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.466__shadow_.7vIlRqUWObU5ShDRNjjezIsnjvfWv_7_0 2024-09-12T17:41:32.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.676+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~g1cbBQ_YqvlW5lXI1BfXcCj9ioBH5-L', time=2024-09-12T19:34:19.125574+0000, chain.objs.size()=1 2024-09-12T17:41:32.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.676+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__multipart_mymultipart.2~g1cbBQ_YqvlW5lXI1BfXcCj9ioBH5-L.1 2024-09-12T17:41:32.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.676+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~g1cbBQ_YqvlW5lXI1BfXcCj9ioBH5-L', time=2024-09-12T19:34:19.129240+0000, chain.objs.size()=1 2024-09-12T17:41:32.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.676+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__multipart_mymultipart.2~g1cbBQ_YqvlW5lXI1BfXcCj9ioBH5-L.2 2024-09-12T17:41:32.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.676+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~g1cbBQ_YqvlW5lXI1BfXcCj9ioBH5-L', time=2024-09-12T19:34:19.132583+0000, chain.objs.size()=1 2024-09-12T17:41:32.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.676+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__multipart_mymultipart.2~g1cbBQ_YqvlW5lXI1BfXcCj9ioBH5-L.3 2024-09-12T17:41:32.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.676+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~g1cbBQ_YqvlW5lXI1BfXcCj9ioBH5-L', time=2024-09-12T19:34:19.136069+0000, chain.objs.size()=1 2024-09-12T17:41:32.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.676+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__multipart_mymultipart.2~g1cbBQ_YqvlW5lXI1BfXcCj9ioBH5-L.4 2024-09-12T17:41:32.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.676+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~g1cbBQ_YqvlW5lXI1BfXcCj9ioBH5-L', time=2024-09-12T19:34:19.139963+0000, chain.objs.size()=1 2024-09-12T17:41:32.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.676+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__multipart_mymultipart.2~g1cbBQ_YqvlW5lXI1BfXcCj9ioBH5-L.5 2024-09-12T17:41:32.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.676+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~g1cbBQ_YqvlW5lXI1BfXcCj9ioBH5-L', time=2024-09-12T19:34:19.143417+0000, chain.objs.size()=1 2024-09-12T17:41:32.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.676+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__multipart_mymultipart.2~g1cbBQ_YqvlW5lXI1BfXcCj9ioBH5-L.6 2024-09-12T17:41:32.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.676+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8110242093744856215', time=2024-09-12T19:34:21.559467+0000, chain.objs.size()=3 2024-09-12T17:41:32.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.676+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.523__multipart_mymultipart.2~ZXlWyK9cIeqGydcwC060PTFKPrRI0im.1 2024-09-12T17:41:32.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.676+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.523__multipart_mymultipart.2~ZXlWyK9cIeqGydcwC060PTFKPrRI0im.2 2024-09-12T17:41:32.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.676+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.523__multipart_mymultipart.2~ZXlWyK9cIeqGydcwC060PTFKPrRI0im.3 2024-09-12T17:41:32.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.676+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6408843032885069128', time=2024-09-12T19:35:18.831988+0000, chain.objs.size()=1 2024-09-12T17:41:32.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.676+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.569__shadow:MvKmEYOVMPvPaRzgXqX2yZyF19pceHG_.XFlstZ2waTxbsQYFdTmQuWszy_DN6ty_0 2024-09-12T17:41:32.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.676+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13436260334101876688', time=2024-09-12T19:35:20.417916+0000, chain.objs.size()=1 2024-09-12T17:41:32.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.676+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.569__shadow:Uv3EbuDAX2w6OPc02sLlw5rexGzdzBC_.uUrOMW9tmx21FNNpg_sjJQggjoN9_kv_0 2024-09-12T17:41:32.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.676+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6027364956546612342', time=2024-09-12T19:35:21.723697+0000, chain.objs.size()=1 2024-09-12T17:41:32.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.676+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.569__shadow:hhOdL2qE6zA5cIFF3gzuFZATB9GA6Hp_.J666MlJxAeBMm5mIaJOXKaRGvuu9q56_0 2024-09-12T17:41:32.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.676+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5477799623131037930', time=2024-09-12T19:35:22.752390+0000, chain.objs.size()=1 2024-09-12T17:41:32.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.676+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.569__shadow:9LIViWgh2sQJtD-DcyRAhwWHafwlQlm_.biOCiQlGIQkbFBiPPkqtY4RGxBofljZ_0 2024-09-12T17:41:32.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.680+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10662638641058663767', time=2024-09-12T19:35:24.165078+0000, chain.objs.size()=1 2024-09-12T17:41:32.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.680+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.570__shadow:F2zOyguZKp5GIfVy9IZ273YlYMzl1iz_.3e9KfVB1sPt5DI9WNpSka0g3ynRUf4U_0 2024-09-12T17:41:32.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.680+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4290437832875247432', time=2024-09-12T19:35:33.924873+0000, chain.objs.size()=1 2024-09-12T17:41:32.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.680+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.576__shadow:jxJmnPMY82YHnXoldPsrqMZPOVwmlnf_.nzUSwb2wMYIUHXzBBkBUmsWIdWhA2SC_0 2024-09-12T17:41:32.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.680+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13990289633759378843', time=2024-09-12T19:35:49.143348+0000, chain.objs.size()=1 2024-09-12T17:41:32.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.680+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.577__shadow:JvqgNSac9tJ8NhFSjCAosTi5UUw8inj_.o34S3go64F52fg4q8-VLp6NW7Fgx6_D_0 2024-09-12T17:41:32.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.680+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17103453712229957263', time=2024-09-12T19:35:56.664149+0000, chain.objs.size()=1 2024-09-12T17:41:32.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.680+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.583__shadow:ah1TSMXe2lRcisF6K1AcbL7uG-b9wiZ_.Qpa6RBanIOzpViPuHp19vxUq7mAgCTy_0 2024-09-12T17:41:32.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.680+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9625599419339063367', time=2024-09-12T19:35:58.668937+0000, chain.objs.size()=1 2024-09-12T17:41:32.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.680+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.586__shadow:2W6oae7GhdoLVw6r0FxHZjC5TkYUsT8_.2DLTfWtBUIwVheQfg4R-ea1Qn_hLwcN_0 2024-09-12T17:41:32.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.680+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18360889956259242655', time=2024-09-12T19:36:04.438249+0000, chain.objs.size()=1 2024-09-12T17:41:32.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.680+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.604__shadow_.4-gkOECMFOM073FCMIbrxEoVkvIabU2_0 2024-09-12T17:41:32.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.680+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12044078355943181957', time=2024-09-12T19:38:24.714439+0000, chain.objs.size()=1 2024-09-12T17:41:32.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.680+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.629__shadow_.XPZ5-BEg02V2ulCkqfOH0VLU0N9f9qA_0 2024-09-12T17:41:32.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.680+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13388310763594313586', time=2024-09-12T19:38:26.192228+0000, chain.objs.size()=1 2024-09-12T17:41:32.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.680+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.633__shadow_.LVBcvmbMKWcy-yv3kV7PYiekC-50gVF_0 2024-09-12T17:41:32.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.680+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13132832697872379958', time=2024-09-12T19:38:48.074184+0000, chain.objs.size()=1 2024-09-12T17:41:32.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.680+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.679__shadow_.EKMSVr7Iwo9iiH70n2MSIPuDTjodPLz_0 2024-09-12T17:41:32.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.680+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:41:32.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.684+0000 7fd765adf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:41:32.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.684+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:41:32.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.688+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:41:32.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.688+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50261' 2024-09-12T17:41:32.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.688+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3625305477692053543', time=2024-09-12T19:30:05.242155+0000, chain.objs.size()=1 2024-09-12T17:41:32.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.688+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.197__shadow_.ELBsReBWQiJmlNQOQ0FiWpGMv0DVm4i_0 2024-09-12T17:41:32.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.688+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14773680507388112417', time=2024-09-12T19:31:10.625999+0000, chain.objs.size()=1 2024-09-12T17:41:32.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.688+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.230__shadow_.Rmh3ii_-lni_rMPSsEy2i6zyB2OY-r__0 2024-09-12T17:41:32.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.688+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11800034780938978955', time=2024-09-12T19:31:42.349488+0000, chain.objs.size()=1 2024-09-12T17:41:32.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.688+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.WC-oe_fLFV2KoRpo7-n_ZDUNgmJqhGQ_0 2024-09-12T17:41:32.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.688+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15322840409898147247', time=2024-09-12T19:31:42.477806+0000, chain.objs.size()=1 2024-09-12T17:41:32.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.688+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.4Ee2We73YKzpfXWPoAdVf-ENBmDf87T_0 2024-09-12T17:41:32.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.688+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.687992695076832269', time=2024-09-12T19:31:42.579648+0000, chain.objs.size()=1 2024-09-12T17:41:32.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.688+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.9yDXV-6ELEm7mQHsxf9hpwSBtfPl6JX_0 2024-09-12T17:41:32.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.688+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12548126227539380611', time=2024-09-12T19:31:42.626885+0000, chain.objs.size()=1 2024-09-12T17:41:32.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.688+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.2m9kHzcdDocbeq1mL1Hxs_kac1xlDx0_0 2024-09-12T17:41:32.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.688+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6310317913283360099', time=2024-09-12T19:31:42.913815+0000, chain.objs.size()=1 2024-09-12T17:41:32.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.688+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.R2qpJuJ4storgL0JyBFHAUOZC_FO8AI_0 2024-09-12T17:41:32.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.688+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5109023187332675268', time=2024-09-12T19:31:43.173722+0000, chain.objs.size()=1 2024-09-12T17:41:32.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.688+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.iLXP8O8cPX0uYSc5UJk6ATg3oIsreNi_0 2024-09-12T17:41:32.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.688+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7843371608986566684', time=2024-09-12T19:31:43.435087+0000, chain.objs.size()=1 2024-09-12T17:41:32.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.688+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.YfrPMQwD_n9JdR59YAw_MjHih1hl-WC_0 2024-09-12T17:41:32.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.688+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17195978032660470506', time=2024-09-12T19:31:43.479004+0000, chain.objs.size()=1 2024-09-12T17:41:32.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.688+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.EowEUryBLc0opYHYTleo92i6Qc2Vden_0 2024-09-12T17:41:32.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.688+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.385310507794633129', time=2024-09-12T19:31:43.490286+0000, chain.objs.size()=1 2024-09-12T17:41:32.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.688+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.hQnCEU8BeaVI17XXtJT9M30WDt8aIPz_0 2024-09-12T17:41:32.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.688+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10141597888289395296', time=2024-09-12T19:31:43.510229+0000, chain.objs.size()=1 2024-09-12T17:41:32.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.688+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.WI8-zD0BzPabBedHlhFcfqyjI-hA29V_0 2024-09-12T17:41:32.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.688+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4657918703125252501', time=2024-09-12T19:31:43.566295+0000, chain.objs.size()=1 2024-09-12T17:41:32.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.688+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.-L6MUzLrwJBKQZODzz7T9AkBVljmFKx_0 2024-09-12T17:41:32.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.688+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15756300916565105615', time=2024-09-12T19:31:43.617352+0000, chain.objs.size()=1 2024-09-12T17:41:32.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.688+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_._pezM5zjVtGMi51m5kMKc_Rniug4DK7_0 2024-09-12T17:41:32.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.688+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.560744430494414754', time=2024-09-12T19:31:43.778505+0000, chain.objs.size()=1 2024-09-12T17:41:32.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.688+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.CvM-1o0M6G6gafmY3z1QnIN3TqQMthn_0 2024-09-12T17:41:32.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.688+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5910286627040092373', time=2024-09-12T19:31:43.790404+0000, chain.objs.size()=1 2024-09-12T17:41:32.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.688+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.7axC0HwNLvgAXEBdDl74b1uPhfG3Bst_0 2024-09-12T17:41:32.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.688+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17659850238144443466', time=2024-09-12T19:31:43.795699+0000, chain.objs.size()=1 2024-09-12T17:41:32.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.688+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_._KYZF1hQzjUTabEu6VSORxULVHF6PMI_0 2024-09-12T17:41:32.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.688+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3301521781304846554', time=2024-09-12T19:31:43.803698+0000, chain.objs.size()=1 2024-09-12T17:41:32.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.688+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Wz-1BYR-1Y1vjPBF6WjKnl2tN_h8u39_0 2024-09-12T17:41:32.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.688+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5273596555990844559', time=2024-09-12T19:31:43.892679+0000, chain.objs.size()=1 2024-09-12T17:41:32.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.688+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.5-MT13KZIU_sKxfy_v7d0Iaz-IjRxL0_0 2024-09-12T17:41:32.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.688+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18055339086331730377', time=2024-09-12T19:31:44.057129+0000, chain.objs.size()=1 2024-09-12T17:41:32.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.688+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.HfH7v41OfxLRpCEyKxxLOnsRzZScfnj_0 2024-09-12T17:41:32.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.688+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13740562101800815674', time=2024-09-12T19:31:44.079163+0000, chain.objs.size()=1 2024-09-12T17:41:32.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.688+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.AwbTwyhBfLGcIGTGMvvjM4k7wej7DSC_0 2024-09-12T17:41:32.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.692+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14034576998729207165', time=2024-09-12T19:31:44.107562+0000, chain.objs.size()=1 2024-09-12T17:41:32.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.692+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.axwedUs8_cLe4KXGTJTlcuM7zWbyfMr_0 2024-09-12T17:41:32.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.692+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12745060748680888764', time=2024-09-12T19:31:44.197353+0000, chain.objs.size()=1 2024-09-12T17:41:32.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.692+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.8sP5MC2YAVHjE_JZQf0PC6Ev-aBioLm_0 2024-09-12T17:41:32.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.692+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1164713842451971529', time=2024-09-12T19:31:44.263518+0000, chain.objs.size()=1 2024-09-12T17:41:32.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.692+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.NlGlfMSgEfRS3-io5wtkecFPpg8XWe8_0 2024-09-12T17:41:32.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.692+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14146210209839265075', time=2024-09-12T19:31:44.421989+0000, chain.objs.size()=1 2024-09-12T17:41:32.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.692+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.3yWyhIoXB9pgNyp7SBjro-tfzQ6YCyn_0 2024-09-12T17:41:32.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.692+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15461370866613635469', time=2024-09-12T19:31:56.502097+0000, chain.objs.size()=1 2024-09-12T17:41:32.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.692+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.292__shadow_.YjiLr9oRRx_FQ8zduqZBc_2b7qUgrq5_0 2024-09-12T17:41:32.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.692+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3552823478340552718', time=2024-09-12T19:31:57.556448+0000, chain.objs.size()=1 2024-09-12T17:41:32.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.692+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.293__shadow_._1HsNdNy1hUkfIdJSjSp_wVkU-oFdpl_0 2024-09-12T17:41:32.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.692+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2594258999869449726', time=2024-09-12T19:31:57.616945+0000, chain.objs.size()=1 2024-09-12T17:41:32.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.692+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.293__shadow_.m26IAaOy6_LX8RWxiLZ297rauJe8-EJ_0 2024-09-12T17:41:32.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.692+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16865065798714112087', time=2024-09-12T19:31:59.543614+0000, chain.objs.size()=1 2024-09-12T17:41:32.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.692+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.298__shadow_.PAPYGWvLvtln9qCgEO-xStpYuq-W30o_0 2024-09-12T17:41:32.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.692+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11413129408310336363', time=2024-09-12T19:32:00.756153+0000, chain.objs.size()=1 2024-09-12T17:41:32.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.692+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.301__shadow_.RyG8NS-mLrbwtjZtPrsrW6AidgqTxOh_0 2024-09-12T17:41:32.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.692+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1795446562559205459', time=2024-09-12T19:32:01.887656+0000, chain.objs.size()=1 2024-09-12T17:41:32.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.692+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.304__shadow_.cXeRAuId4-FrTaEux8Lh2VM24o4lELY_0 2024-09-12T17:41:32.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.692+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12797592958452912841', time=2024-09-12T19:32:08.259939+0000, chain.objs.size()=1 2024-09-12T17:41:32.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.692+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.322__shadow_.uKDk6w0DdFkhOndaAiDFV_37TgvDi13_0 2024-09-12T17:41:32.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.692+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18013247057387643884', time=2024-09-12T19:32:27.978793+0000, chain.objs.size()=1 2024-09-12T17:41:32.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.692+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.ilN4lm2bqv41zviKECctV1hWuoZpXwH_0 2024-09-12T17:41:32.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.692+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13812986097165080969', time=2024-09-12T19:32:27.995678+0000, chain.objs.size()=1 2024-09-12T17:41:32.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.692+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.LwDtq3nAKNVCPvw9lZiWFHHlkVQvmQ1_0 2024-09-12T17:41:32.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.696+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.809879477815447069', time=2024-09-12T19:32:28.022123+0000, chain.objs.size()=1 2024-09-12T17:41:32.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.696+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.u9X8agOFjRTtYjacAofdR9BPhxnp6F__0 2024-09-12T17:41:32.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.696+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2400785356098207603', time=2024-09-12T19:32:28.069527+0000, chain.objs.size()=1 2024-09-12T17:41:32.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.696+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.WSBbRxHJgEx8XbyMRQlF0tLhmcgbCDa_0 2024-09-12T17:41:32.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.696+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11980181762753249504', time=2024-09-12T19:32:28.149653+0000, chain.objs.size()=1 2024-09-12T17:41:32.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.696+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.lU_L2-7-j-_lTjOj1puzCtX-ShQx3Bi_0 2024-09-12T17:41:32.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.696+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1171051631689269787', time=2024-09-12T19:32:28.184717+0000, chain.objs.size()=1 2024-09-12T17:41:32.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.696+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.CnMNOR4N3RVo-mLRHiGrZqCGv6Uz1g4_0 2024-09-12T17:41:32.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.696+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17374297356296591874', time=2024-09-12T19:32:28.206211+0000, chain.objs.size()=1 2024-09-12T17:41:32.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.696+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.gDPd9LAYRXSWrJItCxA7R5YKRHYyaYm_0 2024-09-12T17:41:32.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.696+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3265713609271664871', time=2024-09-12T19:32:28.310357+0000, chain.objs.size()=1 2024-09-12T17:41:32.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.696+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.1bPNEg4K9tRR-_JPjy1-SH6jZ2YX_EK_0 2024-09-12T17:41:32.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.696+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2714371663763725894', time=2024-09-12T19:32:28.331670+0000, chain.objs.size()=1 2024-09-12T17:41:32.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.696+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.dFBEsZlIQaxA-R7ezjr2mMaxvtaKM1-_0 2024-09-12T17:41:32.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.696+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8546981835751247708', time=2024-09-12T19:32:28.503245+0000, chain.objs.size()=1 2024-09-12T17:41:32.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.696+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.R7Z7xxBx_ivSbF_CJWnOs0y-aCmm2WM_0 2024-09-12T17:41:32.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.696+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16427634591626810518', time=2024-09-12T19:32:28.522010+0000, chain.objs.size()=1 2024-09-12T17:41:32.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.696+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.yGp9ThTXEzC9x5O2UJ7b-rLKJViBKz9_0 2024-09-12T17:41:32.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.696+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4684250153228798650', time=2024-09-12T19:32:28.545969+0000, chain.objs.size()=1 2024-09-12T17:41:32.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.696+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.DeCMtLnGd4AweR-dTyieD5uuHDMCuEj_0 2024-09-12T17:41:32.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.696+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16318086831091781268', time=2024-09-12T19:32:28.720278+0000, chain.objs.size()=1 2024-09-12T17:41:32.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.696+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.X5r6T_0_6Z6Twb9q40xj_YSQ2fPuTro_0 2024-09-12T17:41:32.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.696+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10544750351691238088', time=2024-09-12T19:32:28.724720+0000, chain.objs.size()=1 2024-09-12T17:41:32.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.696+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.VzQvZJmcgV8kWX4gAhQH2B4jZM4b7No_0 2024-09-12T17:41:32.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.696+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5628207176850155049', time=2024-09-12T19:32:28.762441+0000, chain.objs.size()=1 2024-09-12T17:41:32.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.696+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.ODGvlN9bIXPUg560zEAF9lp-vXqgFEc_0 2024-09-12T17:41:32.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.696+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1680627105026812971', time=2024-09-12T19:32:28.796664+0000, chain.objs.size()=1 2024-09-12T17:41:32.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.696+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.qi07kF-dK-FBi3JvvdJ4UQWWBajCmWe_0 2024-09-12T17:41:32.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.696+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5762131717543789035', time=2024-09-12T19:32:28.831081+0000, chain.objs.size()=1 2024-09-12T17:41:32.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.696+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_._ae-5ChUlHJ3J5mTlhX5_ho3QGKuWoq_0 2024-09-12T17:41:32.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.696+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10919068253493869848', time=2024-09-12T19:32:28.848039+0000, chain.objs.size()=1 2024-09-12T17:41:32.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.696+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.iStHuEsFLy3jy3chtdN7bjr3gQWPjep_0 2024-09-12T17:41:32.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.696+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17858671065701455424', time=2024-09-12T19:32:28.886627+0000, chain.objs.size()=1 2024-09-12T17:41:32.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.696+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.-neaI1jYUMavpKtJn9XlV5uUk2HNylZ_0 2024-09-12T17:41:32.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.696+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11730790849343227245', time=2024-09-12T19:32:29.083256+0000, chain.objs.size()=1 2024-09-12T17:41:32.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.696+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.mG_W1NbC5fNNg2jqY-zvP8KuGEVhMc4_0 2024-09-12T17:41:32.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.700+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11566778970448533852', time=2024-09-12T19:32:29.672094+0000, chain.objs.size()=1 2024-09-12T17:41:32.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.700+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.ivuorrQQ3Sj1n1GbMASpGEPVvrYL1D3_0 2024-09-12T17:41:32.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.700+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8047554846107577053', time=2024-09-12T19:32:29.823915+0000, chain.objs.size()=1 2024-09-12T17:41:32.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.700+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.7bn4Utg_veeD3Im9Nz3fRdF2JoAvp1X_0 2024-09-12T17:41:32.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.700+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13940231415376893775', time=2024-09-12T19:32:30.019438+0000, chain.objs.size()=1 2024-09-12T17:41:32.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.700+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.oOggXmXqwTRvru4EAzBa7oYajXUd_3E_0 2024-09-12T17:41:32.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.700+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5318095853485378545', time=2024-09-12T19:32:30.053819+0000, chain.objs.size()=1 2024-09-12T17:41:32.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.700+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.PkzcHgKuZs1KopZv2fM6iO12CRFgnLY_0 2024-09-12T17:41:32.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.700+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18191075513960186712', time=2024-09-12T19:32:30.089453+0000, chain.objs.size()=1 2024-09-12T17:41:32.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.700+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.dUyb-IYExMP9DilNsV4aiGRV4jQUAO7_0 2024-09-12T17:41:32.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.700+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16374439109159840155', time=2024-09-12T19:32:30.117141+0000, chain.objs.size()=1 2024-09-12T17:41:32.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.700+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.3C8wUFYuYek8oRyqAaKCuUxVAFU9G-U_0 2024-09-12T17:41:32.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.700+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7649343905803416043', time=2024-09-12T19:32:30.126315+0000, chain.objs.size()=1 2024-09-12T17:41:32.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.700+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.YVMMyO2MUI3hwDPNRE5NlBm1bRNEb0Z_0 2024-09-12T17:41:32.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.700+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9436297668863104656', time=2024-09-12T19:32:30.141301+0000, chain.objs.size()=1 2024-09-12T17:41:32.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.700+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.caBgrcnV7Xa1qQrxeme8YQo520IjXZw_0 2024-09-12T17:41:32.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.700+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15346077906706344205', time=2024-09-12T19:32:30.145169+0000, chain.objs.size()=1 2024-09-12T17:41:32.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.700+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.2k15zHregcGrM_wRUAOE6ffhaGIc1u__0 2024-09-12T17:41:32.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.700+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5354336697467346115', time=2024-09-12T19:32:30.165840+0000, chain.objs.size()=1 2024-09-12T17:41:32.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.700+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.nuK-mUXDbCErK9DvhjGqQpdOQ4Wcvec_0 2024-09-12T17:41:32.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.700+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13140444304920965085', time=2024-09-12T19:32:49.570452+0000, chain.objs.size()=1 2024-09-12T17:41:32.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.700+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.BXIMDEF5O5VWZiyyI8sfNUKaXsmZRIK_0 2024-09-12T17:41:32.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.700+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.288547401577209171', time=2024-09-12T19:32:49.836136+0000, chain.objs.size()=1 2024-09-12T17:41:32.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.700+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.TK-qtKWxObBjy1B-btOlxplbw8mhEW5_0 2024-09-12T17:41:32.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.700+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12103857593759352192', time=2024-09-12T19:32:49.885440+0000, chain.objs.size()=1 2024-09-12T17:41:32.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.700+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.hOjtTa6FB1M9HPxNrZ_Vzuq1u78rYc8_0 2024-09-12T17:41:32.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.700+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4626055817992053217', time=2024-09-12T19:32:49.891108+0000, chain.objs.size()=1 2024-09-12T17:41:32.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.700+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.DkVYJuufU7Gd8OL1gyVzCOlNy-KHNt4_0 2024-09-12T17:41:32.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.700+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5823684548066703723', time=2024-09-12T19:32:49.900270+0000, chain.objs.size()=1 2024-09-12T17:41:32.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.700+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.1CpXuGCtTtTcJn-dSsOIwIxrUSrdwAn_0 2024-09-12T17:41:32.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.700+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10099808714891710840', time=2024-09-12T19:32:49.997439+0000, chain.objs.size()=1 2024-09-12T17:41:32.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.700+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.YOhItK0Uea_i1f9LGgyu5_19S4Mk0a5_0 2024-09-12T17:41:32.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.700+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13084932040982651643', time=2024-09-12T19:32:50.244619+0000, chain.objs.size()=1 2024-09-12T17:41:32.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.700+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.UwE3Kz-A445vftAKzAsnV-K5Vj6-7Je_0 2024-09-12T17:41:32.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.704+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11225631259712452327', time=2024-09-12T19:32:50.258490+0000, chain.objs.size()=1 2024-09-12T17:41:32.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.704+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.6QP5mRhRypTFLiLTxUqqVl-2UZPtP2o_0 2024-09-12T17:41:32.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.704+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7961240929482491014', time=2024-09-12T19:32:50.273806+0000, chain.objs.size()=1 2024-09-12T17:41:32.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.704+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.8asvU85weVLVyMCOJHnWp12gVVtPF4k_0 2024-09-12T17:41:32.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.704+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3642386715623761592', time=2024-09-12T19:32:50.321777+0000, chain.objs.size()=1 2024-09-12T17:41:32.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.704+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.XrCbHlsis2eKe4tnLC-p69XeWPP0CeO_0 2024-09-12T17:41:32.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.704+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16767830126431986861', time=2024-09-12T19:32:50.517229+0000, chain.objs.size()=1 2024-09-12T17:41:32.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.704+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.o_hszC1aoCm9UayLkSluoj9AETz8Y5K_0 2024-09-12T17:41:32.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.704+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4176862433092864139', time=2024-09-12T19:32:50.531778+0000, chain.objs.size()=1 2024-09-12T17:41:32.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.704+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_._ZYfdK1-XMFGQWhlO4C_Z-E4h7Wqgvw_0 2024-09-12T17:41:32.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.704+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5169397974269505981', time=2024-09-12T19:32:50.546549+0000, chain.objs.size()=1 2024-09-12T17:41:32.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.704+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.kT0TP0Gw-B3zgc_wL21x8Jjmac0ZpPC_0 2024-09-12T17:41:32.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.704+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15581342244305608314', time=2024-09-12T19:32:50.565137+0000, chain.objs.size()=1 2024-09-12T17:41:32.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.704+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.AwcPZhSGz36c27XhOx032kV3znzWxOF_0 2024-09-12T17:41:32.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.704+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6451993345757460339', time=2024-09-12T19:32:50.574720+0000, chain.objs.size()=1 2024-09-12T17:41:32.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.704+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Vtm9owg18y4TXizZIgdnQBmsw9P7vge_0 2024-09-12T17:41:32.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.704+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10547931182117413394', time=2024-09-12T19:32:50.680998+0000, chain.objs.size()=1 2024-09-12T17:41:32.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.704+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.CZUTEAA8jHQV5imWUj1ItZWDqoOVvS8_0 2024-09-12T17:41:32.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.704+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2826167316103066436', time=2024-09-12T19:32:50.852092+0000, chain.objs.size()=1 2024-09-12T17:41:32.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.704+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.54tUZQmT6lihsdMjqrppXTCPUDRapxv_0 2024-09-12T17:41:32.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.704+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4759365389718430246', time=2024-09-12T19:32:50.977635+0000, chain.objs.size()=1 2024-09-12T17:41:32.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.704+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.t2-Rsr5r7uZVun4HP4rRKG7U9woHfHO_0 2024-09-12T17:41:32.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.704+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3226546216097177625', time=2024-09-12T19:32:50.982874+0000, chain.objs.size()=1 2024-09-12T17:41:32.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.704+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.oa-oib1rvzzfyl5nkdWVdDAYbOLypb4_0 2024-09-12T17:41:32.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.704+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6610262793407975635', time=2024-09-12T19:32:51.195580+0000, chain.objs.size()=1 2024-09-12T17:41:32.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.704+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.kqA1ZvksqEQsMlSzh1yHzmOX7oU6k9n_0 2024-09-12T17:41:32.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.704+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6077854908420202142', time=2024-09-12T19:32:51.234230+0000, chain.objs.size()=1 2024-09-12T17:41:32.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.704+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.TITJZPo6PrY2lYHvQmnqdSKkYHJYgc8_0 2024-09-12T17:41:32.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.704+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12954238814155825281', time=2024-09-12T19:32:51.262097+0000, chain.objs.size()=1 2024-09-12T17:41:32.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.704+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.tF4QrGkQRb2rjudB8ZeaPIRO9xgf2vb_0 2024-09-12T17:41:32.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.704+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12935994840021279047', time=2024-09-12T19:32:51.355129+0000, chain.objs.size()=1 2024-09-12T17:41:32.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.704+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.z_gQDSKvqLeKP3oLA0yeFkp4Fngp3TH_0 2024-09-12T17:41:32.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.704+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15741128654063700045', time=2024-09-12T19:32:51.360775+0000, chain.objs.size()=1 2024-09-12T17:41:32.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.704+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.fzIywVw2leoc7cBcJDdvyw1C_Aqg4SD_0 2024-09-12T17:41:32.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.704+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18234215405012879514', time=2024-09-12T19:32:51.543325+0000, chain.objs.size()=1 2024-09-12T17:41:32.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.704+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.gkyci8_8auBAnSm9ln9tcNX9uUDq62U_0 2024-09-12T17:41:32.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.708+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12786533784241869378', time=2024-09-12T19:32:51.575306+0000, chain.objs.size()=1 2024-09-12T17:41:32.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.708+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.9omBPsE4tN-vZkJq9y1zFUGGVb3PZ14_0 2024-09-12T17:41:32.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.708+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15192326542309172251', time=2024-09-12T19:32:51.606165+0000, chain.objs.size()=1 2024-09-12T17:41:32.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.708+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.ke_RO_Kbp3wY6nTrVI1Hd7ueUhrICgP_0 2024-09-12T17:41:32.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.708+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.85981212969904561', time=2024-09-12T19:32:51.639358+0000, chain.objs.size()=1 2024-09-12T17:41:32.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.708+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.c-SLD3uKhmcMDAwRTIYxdHROALvbKPw_0 2024-09-12T17:41:32.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.708+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2213141914062158140', time=2024-09-12T19:32:51.681329+0000, chain.objs.size()=1 2024-09-12T17:41:32.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.708+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.d76gqz6RD4b70Z2uh9lDYHgwpqfotEI_0 2024-09-12T17:41:32.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.708+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4999055723604078992', time=2024-09-12T19:32:51.720467+0000, chain.objs.size()=1 2024-09-12T17:41:32.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.708+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.46793VYpLKh8ChrdGr1WFPEYbR-iIEv_0 2024-09-12T17:41:32.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.708+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7127026528439785438', time=2024-09-12T19:32:51.857416+0000, chain.objs.size()=1 2024-09-12T17:41:32.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.708+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Z8kVfqc1A_-u6PfirbgIFib-QZOIvqF_0 2024-09-12T17:41:32.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.708+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4059175632955457991', time=2024-09-12T19:32:51.907329+0000, chain.objs.size()=1 2024-09-12T17:41:32.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.708+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.8_Jqo8VOW88xHRNGbk_mdgLSHwC6IU-_0 2024-09-12T17:41:32.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.708+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8868976844651042913', time=2024-09-12T19:33:05.804833+0000, chain.objs.size()=1 2024-09-12T17:41:32.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.708+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.371__shadow_.v0tDEU33CVl0PCSpL8k9dE0uY4fL50u_0 2024-09-12T17:41:32.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.708+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2411844450851717499', time=2024-09-12T19:33:09.811367+0000, chain.objs.size()=1 2024-09-12T17:41:32.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.708+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.379__shadow_.gsOUzk55lZlvK2MAa_22cK82TLQ4IHd_0 2024-09-12T17:41:32.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.708+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1023848863763881189', time=2024-09-12T19:33:32.959180+0000, chain.objs.size()=1 2024-09-12T17:41:32.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.708+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.441__shadow_.tdE1jsQD7h2KIDBv9_C71MPkyGRJte__0 2024-09-12T17:41:32.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.708+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1519483938842439058', time=2024-09-12T19:33:43.406183+0000, chain.objs.size()=1 2024-09-12T17:41:32.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.708+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.464__shadow_.CBUzY-Sbo-oxxjtt972V7FAAkea4qlq_0 2024-09-12T17:41:32.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.708+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3543892217231011890', time=2024-09-12T19:33:47.932149+0000, chain.objs.size()=1 2024-09-12T17:41:32.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.708+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.481__shadow_.AaOYdED0QstWf1p7IXZ8TziCYlBAI8c_0 2024-09-12T17:41:32.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.708+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13267681142653472187', time=2024-09-12T19:33:55.751438+0000, chain.objs.size()=1 2024-09-12T17:41:32.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.708+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.499__shadow_.rxuYRxjit1YLQ_f8hlQ34HPMFzPS-vs_0 2024-09-12T17:41:32.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.712+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/50261 2024-09-12T17:41:32.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.712+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-12T17:41:32.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.712+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3190226247461019270', time=2024-09-12T19:35:04.264584+0000, chain.objs.size()=1 2024-09-12T17:41:32.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.712+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.556__shadow_.aFHpMl9D0W1i-NByfu8j7sF2vuwDz4i_0 2024-09-12T17:41:32.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.712+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14516201486643973867', time=2024-09-12T19:35:34.879614+0000, chain.objs.size()=1 2024-09-12T17:41:32.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.712+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.577__shadow:yYUF.0MQWQMQS0x6RjM4eBq3Ft9YOfS_.14wJHFxWRg0pgd3E5hDWbQr-LxPg414_0 2024-09-12T17:41:32.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.712+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17724252217648517192', time=2024-09-12T19:35:47.269484+0000, chain.objs.size()=1 2024-09-12T17:41:32.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.712+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.577__shadow:wihsV0m714ab3A9pe18XMx9Cci3KGUW_.XuDoV30-zlMdFIXvhB3kQPj2skcgSqr_0 2024-09-12T17:41:32.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.712+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.292217668831644513', time=2024-09-12T19:35:49.369531+0000, chain.objs.size()=1 2024-09-12T17:41:32.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.712+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.577__shadow:.IlnVrTq1OByWFxQafqfFHPuarmi2Gf_.piiUPu1rp067tAstdgyud6gRowokb99_0 2024-09-12T17:41:32.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.712+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10846302081849908086', time=2024-09-12T19:36:14.283560+0000, chain.objs.size()=12 2024-09-12T17:41:32.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.712+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.615__multipart_multipart_enc.2~rDL3vBCD31L_1ItzUi9yQdAmlxfd8D3.1 2024-09-12T17:41:32.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.712+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.615__shadow_multipart_enc.2~rDL3vBCD31L_1ItzUi9yQdAmlxfd8D3.1_1 2024-09-12T17:41:32.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.712+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.615__multipart_multipart_enc.2~rDL3vBCD31L_1ItzUi9yQdAmlxfd8D3.2 2024-09-12T17:41:32.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.712+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.615__shadow_multipart_enc.2~rDL3vBCD31L_1ItzUi9yQdAmlxfd8D3.2_1 2024-09-12T17:41:32.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.712+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.615__multipart_multipart_enc.2~rDL3vBCD31L_1ItzUi9yQdAmlxfd8D3.3 2024-09-12T17:41:32.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.712+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.615__shadow_multipart_enc.2~rDL3vBCD31L_1ItzUi9yQdAmlxfd8D3.3_1 2024-09-12T17:41:32.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.712+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.615__multipart_multipart_enc.2~rDL3vBCD31L_1ItzUi9yQdAmlxfd8D3.4 2024-09-12T17:41:32.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.712+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.615__shadow_multipart_enc.2~rDL3vBCD31L_1ItzUi9yQdAmlxfd8D3.4_1 2024-09-12T17:41:32.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.716+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.615__multipart_multipart_enc.2~rDL3vBCD31L_1ItzUi9yQdAmlxfd8D3.5 2024-09-12T17:41:32.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.716+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.615__shadow_multipart_enc.2~rDL3vBCD31L_1ItzUi9yQdAmlxfd8D3.5_1 2024-09-12T17:41:32.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.716+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.615__multipart_multipart_enc.2~rDL3vBCD31L_1ItzUi9yQdAmlxfd8D3.6 2024-09-12T17:41:32.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.716+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.615__shadow_multipart_enc.2~rDL3vBCD31L_1ItzUi9yQdAmlxfd8D3.6_1 2024-09-12T17:41:32.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.720+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15906439392772462740', time=2024-09-12T19:38:28.221226+0000, chain.objs.size()=1 2024-09-12T17:41:32.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.720+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.639__shadow_.j9HJoWBb5XA215qoSdZdwN_F-mvDlNp_0 2024-09-12T17:41:32.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.720+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17493296019363310239', time=2024-09-12T19:39:11.270130+0000, chain.objs.size()=1 2024-09-12T17:41:32.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.720+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.715__shadow:0MhRXToubg62a4sUeqfX7YvjMcPha-E_.Ze218O9kD9z2EdiRhaFiy2CTqT8ICzP_0 2024-09-12T17:41:32.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.720+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12167464459073168603', time=2024-09-12T19:39:30.906477+0000, chain.objs.size()=1 2024-09-12T17:41:32.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.720+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.741__shadow_.m5M1g27HM3kkvYdAXEVkc7JVa1fudlv_0 2024-09-12T17:41:32.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.720+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:41:32.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.724+0000 7fd765adf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:41:32.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.724+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:41:32.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.724+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:41:32.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.724+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43017' 2024-09-12T17:41:32.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.724+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='_M-4z-uAlyTkPLPcqk7yepptyd4WOUg1', time=2024-09-12T19:29:45.238708+0000, chain.objs.size()=3 2024-09-12T17:41:32.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.724+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.160__shadow_._-eG608agxFo7rlcaGlUpkNbGcmGT13_0 2024-09-12T17:41:32.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.724+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.160__shadow_._-eG608agxFo7rlcaGlUpkNbGcmGT13_1 2024-09-12T17:41:32.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.724+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.160__shadow_._-eG608agxFo7rlcaGlUpkNbGcmGT13_2 2024-09-12T17:41:32.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.724+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='_z52o0n7hYY72EIDeTfEGbk6dZyKtS0q', time=2024-09-12T19:29:50.042109+0000, chain.objs.size()=3 2024-09-12T17:41:32.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.724+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.165__shadow_.Hcn2o-2sgVc-zPBZ3lE2ksEnvE8JBQw_0 2024-09-12T17:41:32.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.724+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.165__shadow_.Hcn2o-2sgVc-zPBZ3lE2ksEnvE8JBQw_1 2024-09-12T17:41:32.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.724+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.165__shadow_.Hcn2o-2sgVc-zPBZ3lE2ksEnvE8JBQw_2 2024-09-12T17:41:32.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.724+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9891605466444955484', time=2024-09-12T19:31:15.410369+0000, chain.objs.size()=1 2024-09-12T17:41:32.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.724+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.242__shadow_.-5fnvTX1G21vhwA4qT77h5jbgpXV91H_0 2024-09-12T17:41:32.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.724+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13880694142879281215', time=2024-09-12T19:31:42.291657+0000, chain.objs.size()=1 2024-09-12T17:41:32.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.724+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.QxQxqaCJoVul3tTgmmDBsZuwQCnOVVz_0 2024-09-12T17:41:32.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.724+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12095538230691437337', time=2024-09-12T19:31:42.392254+0000, chain.objs.size()=1 2024-09-12T17:41:32.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.724+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.LP6dTsCuzrrk2xsP9FIh9SQhqWRgbhS_0 2024-09-12T17:41:32.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.728+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12700194907219018120', time=2024-09-12T19:31:42.462765+0000, chain.objs.size()=1 2024-09-12T17:41:32.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.728+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.ZPII1v8WrHZ1JwJbPRVHg-qg8nFlXcz_0 2024-09-12T17:41:32.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.728+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18417172784162651522', time=2024-09-12T19:31:42.463645+0000, chain.objs.size()=1 2024-09-12T17:41:32.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.728+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.91JI5cch2FI7R1j9BNMM2crEqHqLLJw_0 2024-09-12T17:41:32.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.728+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6516690660261366502', time=2024-09-12T19:31:42.535000+0000, chain.objs.size()=1 2024-09-12T17:41:32.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.728+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.a_YVpgw-LgmJDweBwJvUDR0W1PgmQ7-_0 2024-09-12T17:41:32.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.728+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11251214005258014138', time=2024-09-12T19:31:42.912473+0000, chain.objs.size()=1 2024-09-12T17:41:32.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.728+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.vwUWmXv6EO1ijrMwrC81u8VbbNcKS60_0 2024-09-12T17:41:32.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.728+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7784228001239528525', time=2024-09-12T19:31:43.146013+0000, chain.objs.size()=1 2024-09-12T17:41:32.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.728+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.bwCRddW8fUNq8IOXM6Mjv5DWquBV-rY_0 2024-09-12T17:41:32.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.728+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7857791449606720579', time=2024-09-12T19:31:43.180476+0000, chain.objs.size()=1 2024-09-12T17:41:32.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.728+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.MaMKLLtU8pwuUXBnj-my3vd33duauG9_0 2024-09-12T17:41:32.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.728+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10183966180281774327', time=2024-09-12T19:31:43.598019+0000, chain.objs.size()=1 2024-09-12T17:41:32.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.728+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.l4FkS-93glmGhELW_OVlhY2vnintIVc_0 2024-09-12T17:41:32.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.728+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14028830918881759421', time=2024-09-12T19:31:43.861824+0000, chain.objs.size()=1 2024-09-12T17:41:32.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.728+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.V39XAoSzDikd1SCPdvQQWplGm57-ypf_0 2024-09-12T17:41:32.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.728+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5463185571159916527', time=2024-09-12T19:31:43.874945+0000, chain.objs.size()=1 2024-09-12T17:41:32.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.728+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.WH8EFa-OfOl9DuEnh5bN03YBotmL6cI_0 2024-09-12T17:41:32.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.728+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17353600365409447888', time=2024-09-12T19:31:43.892544+0000, chain.objs.size()=1 2024-09-12T17:41:32.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.728+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.vgcWbOFTttjqdL_Rw8luEZ1C_6zlUQI_0 2024-09-12T17:41:32.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.728+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4131788412937062869', time=2024-09-12T19:31:44.056608+0000, chain.objs.size()=1 2024-09-12T17:41:32.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.728+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.YrmtBrDpXbSQzmNTCfK6Nt4Eui6UV38_0 2024-09-12T17:41:32.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.732+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17329189805068717462', time=2024-09-12T19:31:44.111689+0000, chain.objs.size()=1 2024-09-12T17:41:32.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.732+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.z-ftuyEBnVWYIqI60O4jVcwwidFTdSU_0 2024-09-12T17:41:32.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.732+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12831131707842224648', time=2024-09-12T19:31:44.115134+0000, chain.objs.size()=1 2024-09-12T17:41:32.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.732+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.uYeYepI3o-3zKyUvxcz_QKHXGXvaKS6_0 2024-09-12T17:41:32.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.732+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14056669096105723007', time=2024-09-12T19:31:44.120277+0000, chain.objs.size()=1 2024-09-12T17:41:32.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.732+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.38Cp0frf3QC4vsGg8YYXsa5PKZJySnw_0 2024-09-12T17:41:32.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.732+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3250222153040410840', time=2024-09-12T19:31:44.130707+0000, chain.objs.size()=1 2024-09-12T17:41:32.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.732+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.L-RjflJvXp344vf7B5QU_OPZ3C35vTX_0 2024-09-12T17:41:32.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.732+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9019021438581079431', time=2024-09-12T19:31:44.238497+0000, chain.objs.size()=1 2024-09-12T17:41:32.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.732+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Y-m7zStGEdwyeNjBmelk9FtQwG7UXd__0 2024-09-12T17:41:32.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.732+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12887719929637570998', time=2024-09-12T19:31:44.463008+0000, chain.objs.size()=1 2024-09-12T17:41:32.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.732+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.eyytOwbtrlrQaJMTJEyD1E7fQCbW8UW_0 2024-09-12T17:41:32.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.732+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16194941647447631686', time=2024-09-12T19:31:45.829266+0000, chain.objs.size()=1 2024-09-12T17:41:32.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.732+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.266__shadow_.ZL9BS5FtqdHuTOeZx6GR-TChHhx5BQe_0 2024-09-12T17:41:32.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.732+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13038550951118549252', time=2024-09-12T19:31:49.545476+0000, chain.objs.size()=1 2024-09-12T17:41:32.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.732+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.276__shadow_.-vq4JytynfFUAwBjC8gsjo4o-gxCejf_0 2024-09-12T17:41:32.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.732+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9258310084654494981', time=2024-09-12T19:31:52.204858+0000, chain.objs.size()=1 2024-09-12T17:41:32.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.732+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.283__shadow_.eAvSFUJ9HCmppgmJz5gMPDrxCAI8lXv_0 2024-09-12T17:41:32.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.732+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13700298424677507875', time=2024-09-12T19:31:53.817288+0000, chain.objs.size()=1 2024-09-12T17:41:32.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.732+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.287__shadow_.YtXBX9nj4d_4rX1NG3-CGvA4mIjW1WO_0 2024-09-12T17:41:32.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.732+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6110789842959609874', time=2024-09-12T19:31:56.456340+0000, chain.objs.size()=1 2024-09-12T17:41:32.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.732+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.292__shadow_.ozpXEi_QXUDIi2dbvA-CKy_KYx1rr02_0 2024-09-12T17:41:32.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.732+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.849309873222929578', time=2024-09-12T19:31:59.118719+0000, chain.objs.size()=1 2024-09-12T17:41:32.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.732+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.297__shadow_.4_t03KNmUB_uVIOEZd5AfEJEAzOAMKB_0 2024-09-12T17:41:32.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.732+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1165563462351243243', time=2024-09-12T19:32:01.133130+0000, chain.objs.size()=1 2024-09-12T17:41:32.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.732+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.302__shadow_.9ZHvhKYTxiBGdfXZ3axf-zb9QxVBV8F_0 2024-09-12T17:41:32.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.732+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8999897277025796675', time=2024-09-12T19:32:01.509485+0000, chain.objs.size()=1 2024-09-12T17:41:32.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.732+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.303__shadow_.BCTENE0qpWk__8_vUTX8TolEaDSBlWB_0 2024-09-12T17:41:32.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.732+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15207308708070478261', time=2024-09-12T19:32:08.258274+0000, chain.objs.size()=1 2024-09-12T17:41:32.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.732+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.322__shadow_.Zj9HipkhSfWwiTPXgNolZ2qrv9ihTjt_0 2024-09-12T17:41:32.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.736+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5941066188389704959', time=2024-09-12T19:32:27.851549+0000, chain.objs.size()=1 2024-09-12T17:41:32.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.736+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.EWaY__Dv5Reuq5qrRsufYDbEE1Ovsmy_0 2024-09-12T17:41:32.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.736+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.207017340714029301', time=2024-09-12T19:32:27.993691+0000, chain.objs.size()=1 2024-09-12T17:41:32.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.736+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.v6XSmxHJsNHHaGu_YQqgFX_9BasuzLJ_0 2024-09-12T17:41:32.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.736+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12936646436756262372', time=2024-09-12T19:32:28.077370+0000, chain.objs.size()=1 2024-09-12T17:41:32.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.736+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.eiOpCQjPCdfm6TqYZftmo3c49_ozSIm_0 2024-09-12T17:41:32.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.736+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.523845525801100329', time=2024-09-12T19:32:28.090246+0000, chain.objs.size()=1 2024-09-12T17:41:32.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.736+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.XsYmC8flWz2K0ItNl4BnA5kLNlisYWy_0 2024-09-12T17:41:32.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.736+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10303810672909464861', time=2024-09-12T19:32:28.204141+0000, chain.objs.size()=1 2024-09-12T17:41:32.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.736+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.2bsh0ZF3U1itcVPOb9IldllX_wFAzGc_0 2024-09-12T17:41:32.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.736+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11770509578899031799', time=2024-09-12T19:32:28.205633+0000, chain.objs.size()=1 2024-09-12T17:41:32.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.736+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.7lrY-HqP_8eHD840hm1FEcQtovpC4a9_0 2024-09-12T17:41:32.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.736+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1918362212764919783', time=2024-09-12T19:32:28.210603+0000, chain.objs.size()=1 2024-09-12T17:41:32.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.736+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.nIx88bnC1-BqwbXb2OjMwlzohQybnNu_0 2024-09-12T17:41:32.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.736+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15666772387184218127', time=2024-09-12T19:32:28.274939+0000, chain.objs.size()=1 2024-09-12T17:41:32.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.736+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.SH2X2OQFWb6IzLNOhQm7fY1mqzqVnAB_0 2024-09-12T17:41:32.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.736+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1327161273709054945', time=2024-09-12T19:32:28.276800+0000, chain.objs.size()=1 2024-09-12T17:41:32.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.736+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.ybmEN2xEkX74sZcqRxKSO1B5MwZO-v3_0 2024-09-12T17:41:32.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.736+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6586163770957978725', time=2024-09-12T19:32:28.398473+0000, chain.objs.size()=1 2024-09-12T17:41:32.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.736+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_._A6sqTb3EN0aHYJDXcGbx_ASgghnD49_0 2024-09-12T17:41:32.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.736+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8842984375346519167', time=2024-09-12T19:32:28.413785+0000, chain.objs.size()=1 2024-09-12T17:41:32.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.736+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.kLGAcYfieVN8uGPGDy2OXjq3HFb-OLU_0 2024-09-12T17:41:32.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.736+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.31951731521957606', time=2024-09-12T19:32:28.418222+0000, chain.objs.size()=1 2024-09-12T17:41:32.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.736+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.YP40q_oD8l2WvJZXH_p9BmuqJXol3pY_0 2024-09-12T17:41:32.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.736+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10475352955418097286', time=2024-09-12T19:32:28.442180+0000, chain.objs.size()=1 2024-09-12T17:41:32.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.736+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.8i1NXRZdztc9r4A1mSwR6mzjzJ41ojG_0 2024-09-12T17:41:32.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.736+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3050527864034081156', time=2024-09-12T19:32:28.529902+0000, chain.objs.size()=1 2024-09-12T17:41:32.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.736+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.TXbtJRQe5XokVMOgk3CAtkbq6H3BsXl_0 2024-09-12T17:41:32.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.736+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3565854380092618967', time=2024-09-12T19:32:28.686178+0000, chain.objs.size()=1 2024-09-12T17:41:32.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.736+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.CzIc4-3vT-ZF7LKNtB5ZpbD1sGfbFN-_0 2024-09-12T17:41:32.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.736+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6253277468695086944', time=2024-09-12T19:32:28.740401+0000, chain.objs.size()=1 2024-09-12T17:41:32.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.736+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.IRUo4Ttt6IgIKhrRL1RLxN3ecrS_cVg_0 2024-09-12T17:41:32.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.736+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9651349987750043028', time=2024-09-12T19:32:28.751255+0000, chain.objs.size()=1 2024-09-12T17:41:32.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.736+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.fB9o47cg0U9jipv30YvqQr47sJsJ8Pw_0 2024-09-12T17:41:32.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.740+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17720733851691141158', time=2024-09-12T19:32:28.760605+0000, chain.objs.size()=1 2024-09-12T17:41:32.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.740+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.aoEyceJzZqJbjpXnWlRd1ZB07b4cb1i_0 2024-09-12T17:41:32.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.740+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8762119487716186488', time=2024-09-12T19:32:28.768528+0000, chain.objs.size()=1 2024-09-12T17:41:32.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.740+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.FuzCwQtw3N0BQjQSDK-02qxyHkqQtCm_0 2024-09-12T17:41:32.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.740+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5457076366165836495', time=2024-09-12T19:32:28.771118+0000, chain.objs.size()=1 2024-09-12T17:41:32.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.740+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_._bmFm1iX-rf7QYp6cs3TaQzsHGB0n0B_0 2024-09-12T17:41:32.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.740+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7592394240354308910', time=2024-09-12T19:32:28.808396+0000, chain.objs.size()=1 2024-09-12T17:41:32.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.740+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.1z4DVG_LqWJ5Y403HIzRutO5QYIQl3C_0 2024-09-12T17:41:32.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.740+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14497240958180725158', time=2024-09-12T19:32:28.832452+0000, chain.objs.size()=1 2024-09-12T17:41:32.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.740+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.6F8JN_B1MgR-_ntSnJMNCVkyycPoiGH_0 2024-09-12T17:41:32.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.740+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7969614630754368128', time=2024-09-12T19:32:28.845203+0000, chain.objs.size()=1 2024-09-12T17:41:32.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.740+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Ib1HERwxjUN08cEIeCbUdO5nrvSelJT_0 2024-09-12T17:41:32.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.740+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5811007968856879303', time=2024-09-12T19:32:29.076330+0000, chain.objs.size()=1 2024-09-12T17:41:32.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.740+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.a6x5TY3apwK7zu2RCXBX9fFDyA8rqSc_0 2024-09-12T17:41:32.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.740+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16471467992180844652', time=2024-09-12T19:32:29.109283+0000, chain.objs.size()=1 2024-09-12T17:41:32.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.740+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.DSqmZHie6vmXrVh_whMR1Onfwq-N-ai_0 2024-09-12T17:41:32.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.740+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15561599699257348331', time=2024-09-12T19:32:29.144579+0000, chain.objs.size()=1 2024-09-12T17:41:32.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.740+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.5cOzSAoXqHAtsEbEBQpu0vc5o2cDp0w_0 2024-09-12T17:41:32.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.740+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4492888947670778037', time=2024-09-12T19:32:29.211109+0000, chain.objs.size()=1 2024-09-12T17:41:32.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.740+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.w3qDqL3kWcTpak36XMaMjIfwrSP5UyD_0 2024-09-12T17:41:32.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.740+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17283449434849803951', time=2024-09-12T19:32:29.464385+0000, chain.objs.size()=1 2024-09-12T17:41:32.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.740+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.-WMnWTEPWCmveEzKvi-WH_L6Gl1mFT1_0 2024-09-12T17:41:32.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.740+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9355082858918958345', time=2024-09-12T19:32:29.512429+0000, chain.objs.size()=1 2024-09-12T17:41:32.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.740+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.pBarr6QC0GvB-N-Gdap1vMYMR89DH01_0 2024-09-12T17:41:32.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.740+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5626842659357235725', time=2024-09-12T19:32:29.544145+0000, chain.objs.size()=1 2024-09-12T17:41:32.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.740+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.a9M8gOrBvUmiXdQa53YFdDVnIyP6Olr_0 2024-09-12T17:41:32.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.740+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10072860023765411654', time=2024-09-12T19:32:29.797006+0000, chain.objs.size()=1 2024-09-12T17:41:32.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.740+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.AtPGfQQvUunLeY7sFjMUFI3tlUcWxwY_0 2024-09-12T17:41:32.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.740+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3373342518021808295', time=2024-09-12T19:32:29.801340+0000, chain.objs.size()=1 2024-09-12T17:41:32.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.740+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.SzgQdWaOfuDPyj0kHcPeaAtJiofdyEr_0 2024-09-12T17:41:32.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.740+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11509684509781366388', time=2024-09-12T19:32:29.873421+0000, chain.objs.size()=1 2024-09-12T17:41:32.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.740+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.ndOxdyBxAo14sQeJ-FE1DXQOi7mYpkr_0 2024-09-12T17:41:32.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.740+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10138902807433219031', time=2024-09-12T19:32:30.050379+0000, chain.objs.size()=1 2024-09-12T17:41:32.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.740+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.xQkJ9zt3QcfBpMzQCeWwFtSSk40USNi_0 2024-09-12T17:41:32.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.740+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5027881164768866133', time=2024-09-12T19:32:30.062683+0000, chain.objs.size()=1 2024-09-12T17:41:32.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.740+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.xs0TzYAW4TJftNCwezvibHlHjhDnlCF_0 2024-09-12T17:41:32.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.740+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16665675048159345300', time=2024-09-12T19:32:30.094412+0000, chain.objs.size()=1 2024-09-12T17:41:32.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.740+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.KosLLTdZwTUe4rIO4lAz4oOiiZYjJkj_0 2024-09-12T17:41:32.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.740+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1622486240403863591', time=2024-09-12T19:32:49.512556+0000, chain.objs.size()=1 2024-09-12T17:41:32.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.740+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.fvSspWMFmpI3VNOiyXtwwWauTE8TNVi_0 2024-09-12T17:41:32.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.740+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15663398193669754248', time=2024-09-12T19:32:49.526966+0000, chain.objs.size()=1 2024-09-12T17:41:32.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.740+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.T2HXCUhNVz_dcebPojAnJ4SnfwD5D-Y_0 2024-09-12T17:41:32.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.740+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16071108230710770599', time=2024-09-12T19:32:49.718415+0000, chain.objs.size()=1 2024-09-12T17:41:32.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.740+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.H_Low-0fEgZd-iKUl1zw912X-LcBsXT_0 2024-09-12T17:41:32.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.740+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8838456851681201243', time=2024-09-12T19:32:49.743403+0000, chain.objs.size()=1 2024-09-12T17:41:32.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.740+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.id25EoY2qgbBPREHtLIZmRIDJsdAfHV_0 2024-09-12T17:41:32.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.744+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3707571375290503375', time=2024-09-12T19:32:49.756064+0000, chain.objs.size()=1 2024-09-12T17:41:32.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.744+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.DSsqcFmq5htcXF7GyBW06UxaR0Mwx8Y_0 2024-09-12T17:41:32.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.744+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11932395140285059136', time=2024-09-12T19:32:49.860222+0000, chain.objs.size()=1 2024-09-12T17:41:32.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.744+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.zVzR4H348aeGs6241MhiNPBSL_QsMpA_0 2024-09-12T17:41:32.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.744+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18029836592878097176', time=2024-09-12T19:32:49.880146+0000, chain.objs.size()=1 2024-09-12T17:41:32.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.744+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.udJxpeoQfDYJEywPbGTK_AemCx0o_JG_0 2024-09-12T17:41:32.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.744+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14684321495250500196', time=2024-09-12T19:32:49.966834+0000, chain.objs.size()=1 2024-09-12T17:41:32.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.744+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.HRguyUq3NYlA2hQlpBaka0k16o99E2H_0 2024-09-12T17:41:32.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.744+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4111632248564019209', time=2024-09-12T19:32:49.974826+0000, chain.objs.size()=1 2024-09-12T17:41:32.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.744+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.EjL9kNaRCulibmqE1Lhcx3JWej0fXFl_0 2024-09-12T17:41:32.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.744+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13872764950578686924', time=2024-09-12T19:32:50.118791+0000, chain.objs.size()=1 2024-09-12T17:41:32.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.744+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.q444RFdTBl6Ydiz4EXAcab0sgQGz8k__0 2024-09-12T17:41:32.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.744+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12947719425837719984', time=2024-09-12T19:32:50.153203+0000, chain.objs.size()=1 2024-09-12T17:41:32.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.744+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.GUYGV23gZF2-w-1UGTyaQ7-blwXs3Su_0 2024-09-12T17:41:32.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.744+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8856253660386404293', time=2024-09-12T19:32:50.188584+0000, chain.objs.size()=1 2024-09-12T17:41:32.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.744+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.gEnfDzeakDCDSwOO1b83mp6ddWaXf-A_0 2024-09-12T17:41:32.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.744+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13344061740097589932', time=2024-09-12T19:32:50.271316+0000, chain.objs.size()=1 2024-09-12T17:41:32.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.744+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.YhQDtTfclV5gmLbmpNlbIbkrUqRRw6F_0 2024-09-12T17:41:32.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.744+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14594886285501797823', time=2024-09-12T19:32:50.312938+0000, chain.objs.size()=1 2024-09-12T17:41:32.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.744+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.WxpHZVg5tONvV3PGSBsASsCE0qmzrpx_0 2024-09-12T17:41:32.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.744+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5242382155864472203', time=2024-09-12T19:32:50.317747+0000, chain.objs.size()=1 2024-09-12T17:41:32.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.744+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.26hsxCo9kozyzCzcFv3egRKnN87EzLL_0 2024-09-12T17:41:32.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.744+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12930994683718729006', time=2024-09-12T19:32:50.621906+0000, chain.objs.size()=1 2024-09-12T17:41:32.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.744+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.bqjk3rsw3MCFyA3r2aE7j6eGM6YnUp2_0 2024-09-12T17:41:32.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.748+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.78942582664718429', time=2024-09-12T19:32:50.668700+0000, chain.objs.size()=1 2024-09-12T17:41:32.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.748+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.ObNMMWuQMHeinypyJ7kM9v0wc00fOFJ_0 2024-09-12T17:41:32.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.748+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11213703402240615869', time=2024-09-12T19:32:50.960493+0000, chain.objs.size()=1 2024-09-12T17:41:32.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.748+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.0qlvjCZYniMROaROJ45Yd_rkUmu45b6_0 2024-09-12T17:41:32.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.748+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4268736778151236072', time=2024-09-12T19:32:50.961436+0000, chain.objs.size()=1 2024-09-12T17:41:32.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.748+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.6BNrLScjKV7sS3p_O5IAcyT5wQgUqf7_0 2024-09-12T17:41:32.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.748+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16486327548551270274', time=2024-09-12T19:32:51.002728+0000, chain.objs.size()=1 2024-09-12T17:41:32.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.748+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.AJBcl6FLIC-cRfctKSMNR-U_hV3_WQU_0 2024-09-12T17:41:32.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.748+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13966580786371720209', time=2024-09-12T19:32:51.014667+0000, chain.objs.size()=1 2024-09-12T17:41:32.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.748+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.sYz9OkrsQEq4GWLemqaZjTmBR8SW_u__0 2024-09-12T17:41:32.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.748+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15805313851987045233', time=2024-09-12T19:32:51.028254+0000, chain.objs.size()=1 2024-09-12T17:41:32.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.748+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.lev0z4pXhFN8HDw-2ygqtLwNzzdW9th_0 2024-09-12T17:41:32.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.748+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15950248902383940443', time=2024-09-12T19:32:51.518631+0000, chain.objs.size()=1 2024-09-12T17:41:32.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.748+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Hkg0lpBgwkKh2lwjMMGEOF8j4b2OFEv_0 2024-09-12T17:41:32.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.748+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4760981690901978361', time=2024-09-12T19:32:51.526240+0000, chain.objs.size()=1 2024-09-12T17:41:32.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.748+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.ZtXRHj5zkXKmaBWCveCqpwdpjq0165__0 2024-09-12T17:41:32.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.748+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10014359641796591026', time=2024-09-12T19:32:51.603583+0000, chain.objs.size()=1 2024-09-12T17:41:32.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.748+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.b6ismKwXWfuI9OEBDxFgiREHHSKJnE0_0 2024-09-12T17:41:32.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.748+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17160887157991148036', time=2024-09-12T19:32:51.610714+0000, chain.objs.size()=1 2024-09-12T17:41:32.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.748+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.7FdmvfY_mAOm5zvATEu2xyRkV5vFrux_0 2024-09-12T17:41:32.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.748+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17661649448384074950', time=2024-09-12T19:32:51.658621+0000, chain.objs.size()=1 2024-09-12T17:41:32.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.748+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.GNnd2NjVJarq0ZGCpOLAv1Ab56Bbg9j_0 2024-09-12T17:41:32.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.748+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4753878480963169613', time=2024-09-12T19:32:51.675773+0000, chain.objs.size()=1 2024-09-12T17:41:32.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.748+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.vn9Y9PqbaJwdk6Pd0cSuJJ3dvSaRl-u_0 2024-09-12T17:41:32.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.752+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18340902510259305746', time=2024-09-12T19:32:51.838038+0000, chain.objs.size()=1 2024-09-12T17:41:32.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.752+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.sZdh31OVrxh1A0CBngElmIbPQiNlRuH_0 2024-09-12T17:41:32.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.752+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13133659876391917822', time=2024-09-12T19:32:51.912287+0000, chain.objs.size()=1 2024-09-12T17:41:32.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.752+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.7E4Z0yvy6tv8ShokotJutJ70j1nrkne_0 2024-09-12T17:41:32.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.752+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13639731833737717467', time=2024-09-12T19:32:59.233907+0000, chain.objs.size()=1 2024-09-12T17:41:32.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.752+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.346__shadow_.djPhv8yRAdaEk-PyHMEASYucwxmXx_G_0 2024-09-12T17:41:32.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.752+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1272059083572260471', time=2024-09-12T19:33:08.911549+0000, chain.objs.size()=1 2024-09-12T17:41:32.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.752+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.377__shadow_.jM7GQ29OIYQ08mAr6il6-xtUA2zDCtZ_0 2024-09-12T17:41:32.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.752+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11729462113502855807', time=2024-09-12T19:33:28.297043+0000, chain.objs.size()=1 2024-09-12T17:41:32.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.752+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.429__shadow_.ZypDQEfSn01AwoN_FRm9qt3jdx09R-E_0 2024-09-12T17:41:32.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.752+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/43017 2024-09-12T17:41:32.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.756+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T17:41:32.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.756+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9078650308415513800', time=2024-09-12T19:33:28.654089+0000, chain.objs.size()=1 2024-09-12T17:41:32.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.756+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.430__shadow_.sj8-RDPRBS4LHJ-AexTJMnzWuyhFVjX_0 2024-09-12T17:41:32.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.756+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2812825076177808800', time=2024-09-12T19:33:47.929602+0000, chain.objs.size()=1 2024-09-12T17:41:32.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.756+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.481__shadow_.0VR_decj9A1xj3oeCZS0K0c2RxJhcyc_0 2024-09-12T17:41:32.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.756+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9960017102027589831', time=2024-09-12T19:33:53.382994+0000, chain.objs.size()=1 2024-09-12T17:41:32.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.756+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.493__shadow_.TFUueHMERUNSwNMgV8kWRfi6rYB1tuv_0 2024-09-12T17:41:32.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.756+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9927246167802793609', time=2024-09-12T19:33:55.007238+0000, chain.objs.size()=1 2024-09-12T17:41:32.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.756+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.497__shadow_.5fEIl21DgEg1vKpQ9briYc771P9lfnS_0 2024-09-12T17:41:32.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.756+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13424413712277193120', time=2024-09-12T19:34:09.820489+0000, chain.objs.size()=3 2024-09-12T17:41:32.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.756+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.521__multipart_mymultipart.2~HRuR7Q9uJoaR3Qdxj3cHg57HhXueZZq.1 2024-09-12T17:41:32.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.756+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.521__multipart_mymultipart.2~HRuR7Q9uJoaR3Qdxj3cHg57HhXueZZq.2 2024-09-12T17:41:32.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.756+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.521__multipart_mymultipart.2~HRuR7Q9uJoaR3Qdxj3cHg57HhXueZZq.3 2024-09-12T17:41:32.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.756+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~yppf9Blt80zUleMXAaz0VITaklI2GA_', time=2024-09-12T19:34:12.044611+0000, chain.objs.size()=1 2024-09-12T17:41:32.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.756+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__multipart_mymultipart.2~yppf9Blt80zUleMXAaz0VITaklI2GA_.1 2024-09-12T17:41:32.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.756+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7081971391255450591', time=2024-09-12T19:35:04.186911+0000, chain.objs.size()=1 2024-09-12T17:41:32.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.756+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.556__shadow_.v0uoalp2uzPpreZ9NLxhJgnw92TlKqi_0 2024-09-12T17:41:32.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.756+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14693133396137346025', time=2024-09-12T19:35:13.846057+0000, chain.objs.size()=1 2024-09-12T17:41:32.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.756+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.564__shadow_.o1i9yCVJMB-K9Uh0j8J_N2UgiOhqKtZ_0 2024-09-12T17:41:32.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.756+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13239113936270674649', time=2024-09-12T19:35:15.902080+0000, chain.objs.size()=1 2024-09-12T17:41:32.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.756+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.569__shadow:K85LS.NR7d3DwD68JMbuc5J8HwmBBCw_.QbWWP9MtaxmC6qRUq0M8GY7VgJsNC_T_0 2024-09-12T17:41:32.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.756+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6952106663660957494', time=2024-09-12T19:35:36.852487+0000, chain.objs.size()=1 2024-09-12T17:41:32.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.756+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.577__shadow:9aebMd.RBUvqs79muODqHof2Me1Vnhy_.X7m3q8d_ryG2uK486CwhpjM6KmasTuo_0 2024-09-12T17:41:32.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.756+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3156140576951304717', time=2024-09-12T19:36:05.125935+0000, chain.objs.size()=1 2024-09-12T17:41:32.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.756+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.606__shadow_.07xXvpFDEg5hxY0nSqJ78FEzB9M8mCo_0 2024-09-12T17:41:32.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.756+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4747639594859234270', time=2024-09-12T19:36:09.805831+0000, chain.objs.size()=12 2024-09-12T17:41:32.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.756+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.613__multipart_multipart_enc.2~SmzQjPnPh2-NQJRFM3UaZstR6ah6Keo.1 2024-09-12T17:41:32.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.756+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.613__shadow_multipart_enc.2~SmzQjPnPh2-NQJRFM3UaZstR6ah6Keo.1_1 2024-09-12T17:41:32.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.756+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.613__multipart_multipart_enc.2~SmzQjPnPh2-NQJRFM3UaZstR6ah6Keo.2 2024-09-12T17:41:32.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.756+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.613__shadow_multipart_enc.2~SmzQjPnPh2-NQJRFM3UaZstR6ah6Keo.2_1 2024-09-12T17:41:32.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.756+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.613__multipart_multipart_enc.2~SmzQjPnPh2-NQJRFM3UaZstR6ah6Keo.3 2024-09-12T17:41:32.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.756+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.613__shadow_multipart_enc.2~SmzQjPnPh2-NQJRFM3UaZstR6ah6Keo.3_1 2024-09-12T17:41:32.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.756+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.613__multipart_multipart_enc.2~SmzQjPnPh2-NQJRFM3UaZstR6ah6Keo.4 2024-09-12T17:41:32.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.756+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.613__shadow_multipart_enc.2~SmzQjPnPh2-NQJRFM3UaZstR6ah6Keo.4_1 2024-09-12T17:41:32.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.756+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.613__multipart_multipart_enc.2~SmzQjPnPh2-NQJRFM3UaZstR6ah6Keo.5 2024-09-12T17:41:32.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.756+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.613__shadow_multipart_enc.2~SmzQjPnPh2-NQJRFM3UaZstR6ah6Keo.5_1 2024-09-12T17:41:32.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.760+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.613__multipart_multipart_enc.2~SmzQjPnPh2-NQJRFM3UaZstR6ah6Keo.6 2024-09-12T17:41:32.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.760+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.613__shadow_multipart_enc.2~SmzQjPnPh2-NQJRFM3UaZstR6ah6Keo.6_1 2024-09-12T17:41:32.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.760+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17209969973077828274', time=2024-09-12T19:38:26.946036+0000, chain.objs.size()=1 2024-09-12T17:41:32.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.760+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.635__shadow_.PpgtO4DWmmN7_WwTfU4GwmcBQfQDUcK_0 2024-09-12T17:41:32.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.760+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17262570866356840650', time=2024-09-12T19:39:21.460337+0000, chain.objs.size()=1 2024-09-12T17:41:32.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.760+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.718__shadow_.pssHo_V092VODVAe6zh5fhNek9CrYch_0 2024-09-12T17:41:32.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.760+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14524821766065381700', time=2024-09-12T19:39:36.045709+0000, chain.objs.size()=1 2024-09-12T17:41:32.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.760+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.745__shadow_.qRgMJRsm8eVjoyLvMn4_d4jRFPNrRn4_0 2024-09-12T17:41:32.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.764+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:41:32.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.764+0000 7fd765adf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:41:32.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.768+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:41:32.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.768+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:41:32.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.768+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46152' 2024-09-12T17:41:32.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.768+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='_1D79uGzzV4fI81ZLGLLqrcytLwWMaJk', time=2024-09-12T19:29:46.324245+0000, chain.objs.size()=3 2024-09-12T17:41:32.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.768+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.161__shadow_.AWLN7Db9GHMSksMJWOSuIAwZGQUw3q4_0 2024-09-12T17:41:32.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.768+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.161__shadow_.AWLN7Db9GHMSksMJWOSuIAwZGQUw3q4_1 2024-09-12T17:41:32.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.768+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.161__shadow_.AWLN7Db9GHMSksMJWOSuIAwZGQUw3q4_2 2024-09-12T17:41:32.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.768+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='_dgoDnkBnIYG2WebnlfuRH71Fv1VPIjG', time=2024-09-12T19:29:48.942380+0000, chain.objs.size()=1 2024-09-12T17:41:32.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.768+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.163__shadow_.tEa1zt3KgZ_jkhzjwD3dFtzGOOz4i90_0 2024-09-12T17:41:32.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.768+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13445172931284980493', time=2024-09-12T19:30:08.380543+0000, chain.objs.size()=1 2024-09-12T17:41:32.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.768+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.204__shadow_.LxeDswvUX6m3pTnz_proKCZIrzAwjqX_0 2024-09-12T17:41:32.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.768+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5928422577606851801', time=2024-09-12T19:31:12.961091+0000, chain.objs.size()=1 2024-09-12T17:41:32.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.768+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.236__shadow_.yMLe3xsM3N7qYAdSvs5JS993KwQydoG_0 2024-09-12T17:41:32.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.768+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8682527045644351211', time=2024-09-12T19:31:19.489594+0000, chain.objs.size()=1 2024-09-12T17:41:32.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.768+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.252__shadow_.O-jwIvg-WHijG9peSWbeYl6azC6o508_0 2024-09-12T17:41:32.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.768+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1018510091737368949', time=2024-09-12T19:31:42.267892+0000, chain.objs.size()=1 2024-09-12T17:41:32.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.768+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.8hpi3loQiJ9VuFarmh167PFYYZxN4sZ_0 2024-09-12T17:41:32.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.768+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5462311134745409945', time=2024-09-12T19:31:42.377687+0000, chain.objs.size()=1 2024-09-12T17:41:32.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.768+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.XjHBLBFyi7hmPbRmTKB8rEEiA95NM09_0 2024-09-12T17:41:32.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.768+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.743487461181454667', time=2024-09-12T19:31:42.399313+0000, chain.objs.size()=1 2024-09-12T17:41:32.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.768+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.J1oPG07EiCsLH6IZW9dm7wrxnnGDo8d_0 2024-09-12T17:41:32.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.768+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6268516110435511550', time=2024-09-12T19:31:42.444767+0000, chain.objs.size()=1 2024-09-12T17:41:32.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.768+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.C5wdDiYvcy6Fk54HP96WG8W52Rvb1Ff_0 2024-09-12T17:41:32.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.768+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6691752285840097882', time=2024-09-12T19:31:42.539729+0000, chain.objs.size()=1 2024-09-12T17:41:32.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.768+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.-eUjrm_vMD-ggbHCyCGDjTSDJTa6rBk_0 2024-09-12T17:41:32.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.772+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.55532377427573046', time=2024-09-12T19:31:42.545760+0000, chain.objs.size()=1 2024-09-12T17:41:32.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.772+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.uf70UOpWzjMoJocsg--aml0dZTmcgbL_0 2024-09-12T17:41:32.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.772+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15241134784430416462', time=2024-09-12T19:31:42.642622+0000, chain.objs.size()=1 2024-09-12T17:41:32.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.772+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.EPhIEclEp70EJMCBUMdPAw2KG0qmUQZ_0 2024-09-12T17:41:32.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.772+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12396515798686458284', time=2024-09-12T19:31:42.674144+0000, chain.objs.size()=1 2024-09-12T17:41:32.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.772+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.rDLHfLHSGGfHrjMUKxc84iVqfZPaF_C_0 2024-09-12T17:41:32.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.772+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14768664959949815725', time=2024-09-12T19:31:42.777339+0000, chain.objs.size()=1 2024-09-12T17:41:32.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.772+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.dKKhedNqPeANNSfLZ-B1PT2M0DYRbFE_0 2024-09-12T17:41:32.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.772+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2236469517841879331', time=2024-09-12T19:31:42.787411+0000, chain.objs.size()=1 2024-09-12T17:41:32.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.772+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.ICM4B_SR0z2P8cpWjuSaM9QxMwvWr97_0 2024-09-12T17:41:32.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.772+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6188522105106435738', time=2024-09-12T19:31:42.946638+0000, chain.objs.size()=1 2024-09-12T17:41:32.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.772+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.nXkvRAdh3Au1l9i3hIAcReHNDVyjc50_0 2024-09-12T17:41:32.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.772+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17804838361867534118', time=2024-09-12T19:31:43.168402+0000, chain.objs.size()=1 2024-09-12T17:41:32.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.772+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.I_ZpERXahPS6NYxaZi1WaecF1PiiSCS_0 2024-09-12T17:41:32.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.772+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10264948123866799130', time=2024-09-12T19:31:43.253395+0000, chain.objs.size()=1 2024-09-12T17:41:32.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.772+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.qOZo0umwZckS49ERzsrHKq7Y89lnyk0_0 2024-09-12T17:41:32.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.772+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9208937994814260671', time=2024-09-12T19:31:43.403962+0000, chain.objs.size()=1 2024-09-12T17:41:32.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.772+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.IzSnnTyd2S7JBO7mzRcdca_wTMw_V2m_0 2024-09-12T17:41:32.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.772+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4601068879267189437', time=2024-09-12T19:31:43.414226+0000, chain.objs.size()=1 2024-09-12T17:41:32.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.772+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.a-Rt34vIXHyzZUEtcQtminPLfisxa3G_0 2024-09-12T17:41:32.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.772+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1989477600810559609', time=2024-09-12T19:31:43.453153+0000, chain.objs.size()=1 2024-09-12T17:41:32.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.772+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.B-NmvQOw2u2E9RtmC_Idf0dpaIZcpi6_0 2024-09-12T17:41:32.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.772+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2189216373141272735', time=2024-09-12T19:31:43.475141+0000, chain.objs.size()=1 2024-09-12T17:41:32.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.772+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.NUbXMbBGr2j6TlU64MkNKgf6XErzLjB_0 2024-09-12T17:41:32.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.772+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13654344756127550', time=2024-09-12T19:31:43.538291+0000, chain.objs.size()=1 2024-09-12T17:41:32.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.772+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.tCEL5lwQOlZjmq4RgbWxuj4cX6JXW-a_0 2024-09-12T17:41:32.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.772+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10207485467804446651', time=2024-09-12T19:31:43.539705+0000, chain.objs.size()=1 2024-09-12T17:41:32.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.772+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.oGH80D2OH9LLgcbGn-FBUwaNj3DhEsG_0 2024-09-12T17:41:32.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.772+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11991590983833132873', time=2024-09-12T19:31:43.559930+0000, chain.objs.size()=1 2024-09-12T17:41:32.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.772+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.WrVLniVjCWr_L8_4fgawXSjAwh4ZJbi_0 2024-09-12T17:41:32.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.772+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16042900069223727843', time=2024-09-12T19:31:43.578402+0000, chain.objs.size()=1 2024-09-12T17:41:32.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.772+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.b4Bwo_auOBK86rqA4Fv7NWn8k6gzOqT_0 2024-09-12T17:41:32.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.772+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11996311804014242133', time=2024-09-12T19:31:43.721307+0000, chain.objs.size()=1 2024-09-12T17:41:32.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.772+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.HdW2Pk4tpD33paDYh2YU-ARQ3xZtaYy_0 2024-09-12T17:41:32.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.772+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8126559100690304736', time=2024-09-12T19:31:43.810767+0000, chain.objs.size()=1 2024-09-12T17:41:32.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.772+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.eOZOr12uEgyM4e9viG-EGspl8aGxxnD_0 2024-09-12T17:41:32.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.772+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6705033665602534304', time=2024-09-12T19:31:43.815408+0000, chain.objs.size()=1 2024-09-12T17:41:32.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.772+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.aoevEN-Q988XfBknt6cTTI-rsI9NLoL_0 2024-09-12T17:41:32.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.772+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9163348248129636933', time=2024-09-12T19:31:43.867726+0000, chain.objs.size()=1 2024-09-12T17:41:32.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.772+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_._Klkp48BgByBL5ju5mc4f8dVWGNcyKz_0 2024-09-12T17:41:32.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.772+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8344914648939237602', time=2024-09-12T19:31:43.909443+0000, chain.objs.size()=1 2024-09-12T17:41:32.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.772+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.1uUTELqeRvfy5cN5TB4cIvbKiYdH0VN_0 2024-09-12T17:41:32.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.776+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1759724769436761601', time=2024-09-12T19:31:43.914027+0000, chain.objs.size()=1 2024-09-12T17:41:32.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.776+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.YS-sdeVCN5IhsZLhE2-ghlUc_czIWxi_0 2024-09-12T17:41:32.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.776+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14833450805159896813', time=2024-09-12T19:31:44.202829+0000, chain.objs.size()=1 2024-09-12T17:41:32.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.776+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.8487rhWFqYeWXBuPz8S9BUTxct1_tXj_0 2024-09-12T17:41:32.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.776+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11111583332520359114', time=2024-09-12T19:31:44.208026+0000, chain.objs.size()=1 2024-09-12T17:41:32.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.776+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.7_4kRuolQJONqefdbazblUERpgmbXRY_0 2024-09-12T17:41:32.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.776+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13486208871046225234', time=2024-09-12T19:31:44.226767+0000, chain.objs.size()=1 2024-09-12T17:41:32.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.776+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.j_hqupQdo9yPYekb3wwsRjhMrJ1TPoH_0 2024-09-12T17:41:32.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.776+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15887417737856303033', time=2024-09-12T19:31:44.244818+0000, chain.objs.size()=1 2024-09-12T17:41:32.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.776+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.FEqGrJJtzigNmrK2ueDTp7DMkT4tWsK_0 2024-09-12T17:41:32.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.776+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16582413595120822880', time=2024-09-12T19:31:44.252298+0000, chain.objs.size()=1 2024-09-12T17:41:32.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.776+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.mclL7F9qArgy1vpeRUQrxVwIJlshDFt_0 2024-09-12T17:41:32.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.776+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17181177341424962067', time=2024-09-12T19:31:44.264710+0000, chain.objs.size()=1 2024-09-12T17:41:32.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.776+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.pGVcl4lVSjH3cNM2azVTv0XG9Yr_Q4H_0 2024-09-12T17:41:32.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.776+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10933124249554756506', time=2024-09-12T19:31:44.270041+0000, chain.objs.size()=1 2024-09-12T17:41:32.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.776+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.u9-b_9FD0_ZkaeE1GuKOzE_RafgoKCt_0 2024-09-12T17:41:32.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.776+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9257352855655007084', time=2024-09-12T19:31:44.453806+0000, chain.objs.size()=1 2024-09-12T17:41:32.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.776+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.KPXDo_6Y1En_k_irK4zsbuNtkL1aG7v_0 2024-09-12T17:41:32.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.776+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1656075638591359403', time=2024-09-12T19:31:44.460069+0000, chain.objs.size()=1 2024-09-12T17:41:32.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.776+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.bveQOlXjqjjgoqgymOxkhcQErtsSgV3_0 2024-09-12T17:41:32.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.776+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8364028268414796581', time=2024-09-12T19:31:44.500128+0000, chain.objs.size()=1 2024-09-12T17:41:32.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.776+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.sh2KSfv3ymUaA5OPafA27JNTZCbB-aw_0 2024-09-12T17:41:32.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.776+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17789349001596722215', time=2024-09-12T19:31:44.525158+0000, chain.objs.size()=1 2024-09-12T17:41:32.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.776+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.ezK1Dh0VQ4R5n9x-lfT3sXHsJ6J2Y-M_0 2024-09-12T17:41:32.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.780+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11172628609901158646', time=2024-09-12T19:31:44.536252+0000, chain.objs.size()=1 2024-09-12T17:41:32.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.780+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.DddPKmdvQQlnVfHLfkaiA5at_c-rduR_0 2024-09-12T17:41:32.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.780+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11966571701603963267', time=2024-09-12T19:31:49.161261+0000, chain.objs.size()=1 2024-09-12T17:41:32.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.780+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.275__shadow_.woT0rrmSTJNx5xSDcNxSJ0iL6GfdzcP_0 2024-09-12T17:41:32.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.780+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10003754004648768410', time=2024-09-12T19:31:49.164645+0000, chain.objs.size()=1 2024-09-12T17:41:32.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.780+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.275__shadow_.FRl-jZUHSb9OgBU2qfFx7NtJ23uJD8T_0 2024-09-12T17:41:32.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.780+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2933159396478841816', time=2024-09-12T19:31:49.546210+0000, chain.objs.size()=1 2024-09-12T17:41:32.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.780+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.276__shadow_.2jciY5L9b8K3kAi4To8ObNVYwilZaPH_0 2024-09-12T17:41:32.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.780+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3165997309823617672', time=2024-09-12T19:31:50.626237+0000, chain.objs.size()=1 2024-09-12T17:41:32.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.780+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.279__shadow_.1xITtVIMekodATB1W-a19QA9gTqsB5W_0 2024-09-12T17:41:32.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.780+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15124537872985481833', time=2024-09-12T19:31:51.005533+0000, chain.objs.size()=1 2024-09-12T17:41:32.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.780+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.280__shadow_.K5vNCVsggZjCc5Vn61ElRNnXQstEo-3_0 2024-09-12T17:41:32.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.780+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9996295434924965422', time=2024-09-12T19:31:52.573139+0000, chain.objs.size()=1 2024-09-12T17:41:32.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.780+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.284__shadow_.IBnr_Fn5XHrle7ek0P2gmaA_x4MMk_d_0 2024-09-12T17:41:32.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.780+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17154379894460600377', time=2024-09-12T19:31:59.542961+0000, chain.objs.size()=1 2024-09-12T17:41:32.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.780+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.298__shadow_.nIEMW-OJoX-OAdi2qkgdYYU3cH0t4Ii_0 2024-09-12T17:41:32.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.780+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3150281008147417282', time=2024-09-12T19:32:01.133994+0000, chain.objs.size()=1 2024-09-12T17:41:32.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.780+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.302__shadow_.2vCxu160caiuPFaWWJW7ZcKjhC-j8ny_0 2024-09-12T17:41:32.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.780+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13624100433491926432', time=2024-09-12T19:32:07.758654+0000, chain.objs.size()=1 2024-09-12T17:41:32.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.780+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.321__shadow_.8Efmial-lZZ_pv34TNP1wXkgSSBBmT8_0 2024-09-12T17:41:32.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.780+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3828126273953082639', time=2024-09-12T19:32:27.873554+0000, chain.objs.size()=1 2024-09-12T17:41:32.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.780+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.kbAESsp3oPV56Zn5vY9ipcZdJvIZNZG_0 2024-09-12T17:41:32.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.780+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6446092858479941442', time=2024-09-12T19:32:27.985419+0000, chain.objs.size()=1 2024-09-12T17:41:32.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.780+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.oarXPihtiN57fym2bOuIAR4ZWTWNMmw_0 2024-09-12T17:41:32.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.780+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17660997976204117899', time=2024-09-12T19:32:28.006815+0000, chain.objs.size()=1 2024-09-12T17:41:32.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.780+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.WiaIPR8H5po8jQrqZXEprvIOjh5gl3r_0 2024-09-12T17:41:32.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.780+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1797210626806423145', time=2024-09-12T19:32:28.093659+0000, chain.objs.size()=1 2024-09-12T17:41:32.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.780+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.xLZTFkJaD6VTllIv9YH7sqWzAKuhHoX_0 2024-09-12T17:41:32.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.780+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6404396996124440289', time=2024-09-12T19:32:28.161938+0000, chain.objs.size()=1 2024-09-12T17:41:32.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.780+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.c35HzTLU7h3DaFQ0S0nAV4qBjKQEJaC_0 2024-09-12T17:41:32.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.780+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2645265296751992458', time=2024-09-12T19:32:28.188413+0000, chain.objs.size()=1 2024-09-12T17:41:32.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.780+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.HTX0zhbR0zwcCqEEEc5JNz3hLxf2DsK_0 2024-09-12T17:41:32.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.780+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8514649393201481809', time=2024-09-12T19:32:28.215687+0000, chain.objs.size()=1 2024-09-12T17:41:32.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.780+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.LYpUunE4fYeqhTMmR3hoS60nci-I06N_0 2024-09-12T17:41:32.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.780+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14425168128533052588', time=2024-09-12T19:32:28.218376+0000, chain.objs.size()=1 2024-09-12T17:41:32.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.780+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.x_Voau5kchdyA5nibVql-iASf0VEV1x_0 2024-09-12T17:41:32.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.780+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6287127032267496412', time=2024-09-12T19:32:28.318354+0000, chain.objs.size()=1 2024-09-12T17:41:32.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.780+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.dNh2tDjTrXBQfuWIjMp8u2ekSjVMHBM_0 2024-09-12T17:41:32.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.780+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1148547448303293710', time=2024-09-12T19:32:28.390331+0000, chain.objs.size()=1 2024-09-12T17:41:32.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.780+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.V_adrlbfLWJbbBPsR03TVKAhoS4pGP9_0 2024-09-12T17:41:32.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.780+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8807102183267723480', time=2024-09-12T19:32:28.417765+0000, chain.objs.size()=1 2024-09-12T17:41:32.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.780+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.UenX3UeYbQRLICIgsqR9dlgJQlwjZ-a_0 2024-09-12T17:41:32.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.784+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8605848542642375594', time=2024-09-12T19:32:28.432742+0000, chain.objs.size()=1 2024-09-12T17:41:32.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.784+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.r1y3IUaY_yscxBaHRcMFWu8upVVorX-_0 2024-09-12T17:41:32.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.784+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17181588111016644613', time=2024-09-12T19:32:28.439423+0000, chain.objs.size()=1 2024-09-12T17:41:32.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.784+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.gUex6BahslaSH04prDWduJJsLvRghmh_0 2024-09-12T17:41:32.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.784+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.680283125500082641', time=2024-09-12T19:32:28.490608+0000, chain.objs.size()=1 2024-09-12T17:41:32.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.784+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.sTTBiNVtXp0i5TBV7_x1RzwS8JQvXT2_0 2024-09-12T17:41:32.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.784+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1666668083643916046', time=2024-09-12T19:32:28.532590+0000, chain.objs.size()=1 2024-09-12T17:41:32.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.784+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.72tvtbB48rajcx7rDGMwo42TypM1vFh_0 2024-09-12T17:41:32.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.784+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10897762330263242288', time=2024-09-12T19:32:28.553485+0000, chain.objs.size()=1 2024-09-12T17:41:32.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.784+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.UkWwkcMMKQzxRtmnHSZK6XHbv7aj6Vt_0 2024-09-12T17:41:32.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.784+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4623778239141479653', time=2024-09-12T19:32:28.796096+0000, chain.objs.size()=1 2024-09-12T17:41:32.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.784+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.mY5MeI_GYkECrogvjiwjzWE-6D762p__0 2024-09-12T17:41:32.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.784+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12930451290941570539', time=2024-09-12T19:32:28.849822+0000, chain.objs.size()=1 2024-09-12T17:41:32.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.784+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Ygh2ZnYXwG27agq9QjG-SGJOAjIFRiv_0 2024-09-12T17:41:32.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.784+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9019251534664633375', time=2024-09-12T19:32:29.118311+0000, chain.objs.size()=1 2024-09-12T17:41:32.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.784+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.tkK_MvoR-bFIqYpoq1cTwjlK88irvvR_0 2024-09-12T17:41:32.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.784+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13803674919602882652', time=2024-09-12T19:32:29.125424+0000, chain.objs.size()=1 2024-09-12T17:41:32.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.784+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.iq2hCJXaC7wOK-gWXBupUUFiBTlB3M5_0 2024-09-12T17:41:32.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.784+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13386459433518687792', time=2024-09-12T19:32:29.153746+0000, chain.objs.size()=1 2024-09-12T17:41:32.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.784+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.psLuamlOSmBQS02bidcLZwL3ctcmNID_0 2024-09-12T17:41:32.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.784+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3557470892661160726', time=2024-09-12T19:32:29.174200+0000, chain.objs.size()=1 2024-09-12T17:41:32.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.784+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.UOi0DsbjvGVr5oDsdz7po-32e7VsPs-_0 2024-09-12T17:41:32.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.784+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2945827699221903568', time=2024-09-12T19:32:29.416555+0000, chain.objs.size()=1 2024-09-12T17:41:32.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.784+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.wdL7I0eDB4YZofIXWAIa9WqwFdlDs8A_0 2024-09-12T17:41:32.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.784+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4345112071269234907', time=2024-09-12T19:32:29.443772+0000, chain.objs.size()=1 2024-09-12T17:41:32.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.784+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.OkSzzEV4ujrHVOGpTzCei-HvGpajPxO_0 2024-09-12T17:41:32.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.788+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13994829690237357281', time=2024-09-12T19:32:29.490353+0000, chain.objs.size()=1 2024-09-12T17:41:32.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.788+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.pf9RPIrQXeyRCP1aD_j8WjHkwRxz6Hl_0 2024-09-12T17:41:32.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.788+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13583543208089179898', time=2024-09-12T19:32:29.499353+0000, chain.objs.size()=1 2024-09-12T17:41:32.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.788+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.D3MeZcUaEIldLIeQR23-yBu2788PoOE_0 2024-09-12T17:41:32.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.788+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11599381282937760514', time=2024-09-12T19:32:29.520590+0000, chain.objs.size()=1 2024-09-12T17:41:32.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.788+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.oK4bezNTXqWNXxEtoMgk9dCP1YOhfRE_0 2024-09-12T17:41:32.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.788+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2286135907586694119', time=2024-09-12T19:32:29.694680+0000, chain.objs.size()=1 2024-09-12T17:41:32.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.788+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.FfkfBFLEFQUh2PIOaKS4hZOaRrZowAc_0 2024-09-12T17:41:32.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.788+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14054786169855915418', time=2024-09-12T19:32:29.739916+0000, chain.objs.size()=1 2024-09-12T17:41:32.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.788+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.IgpggTVjy5G8zaulrRpnK_AXwk7siXl_0 2024-09-12T17:41:32.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.788+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2343157707576034328', time=2024-09-12T19:32:29.757243+0000, chain.objs.size()=1 2024-09-12T17:41:32.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.788+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.tLePGB9lvZM8IB22QETdfj-9n7BEHvI_0 2024-09-12T17:41:32.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.788+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14252699508818965477', time=2024-09-12T19:32:29.813693+0000, chain.objs.size()=1 2024-09-12T17:41:32.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.788+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.5Em26WJIOap49ns3wHhsca9ngK1rUfs_0 2024-09-12T17:41:32.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.788+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5354743640213221415', time=2024-09-12T19:32:30.043356+0000, chain.objs.size()=1 2024-09-12T17:41:32.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.788+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.F1ULXsEpBIyIXAOo7uv3SOkP26TuVNn_0 2024-09-12T17:41:32.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.788+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3710539330439240538', time=2024-09-12T19:32:30.075660+0000, chain.objs.size()=1 2024-09-12T17:41:32.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.788+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.OrIRoiUKfP_OxirayZYh4rdxstDlCZK_0 2024-09-12T17:41:32.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.788+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5750051222182254696', time=2024-09-12T19:32:30.131670+0000, chain.objs.size()=1 2024-09-12T17:41:32.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.788+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.3MhU-V5DEAEXi_CxuMIXjsu7bOyBeE7_0 2024-09-12T17:41:32.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.788+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6025499839518061482', time=2024-09-12T19:32:49.708215+0000, chain.objs.size()=1 2024-09-12T17:41:32.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.788+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.X8AILT_ajcZB4xKQ_PVtkh1rFs2ORfG_0 2024-09-12T17:41:32.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.788+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4667972436951638217', time=2024-09-12T19:32:49.766063+0000, chain.objs.size()=1 2024-09-12T17:41:32.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.788+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.b7We004JpbMHkHyUBnWPW9t5TaRQLaQ_0 2024-09-12T17:41:32.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.788+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14706707409344011398', time=2024-09-12T19:32:49.907682+0000, chain.objs.size()=1 2024-09-12T17:41:32.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.788+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.O6mAos9PaUF_8Erer5zzVtvk8ycBAFY_0 2024-09-12T17:41:32.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.788+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9471583349741036921', time=2024-09-12T19:32:49.920818+0000, chain.objs.size()=1 2024-09-12T17:41:32.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.788+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.tRFTR3kGgFdTKHE-O6FABH5sStVJKXQ_0 2024-09-12T17:41:32.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.788+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.656486273543843261', time=2024-09-12T19:32:50.226004+0000, chain.objs.size()=1 2024-09-12T17:41:32.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.788+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.wuHC9_t8uSKn0mOeKumDpwE0DOE0Aie_0 2024-09-12T17:41:32.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.788+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15553844057205880041', time=2024-09-12T19:32:50.255510+0000, chain.objs.size()=1 2024-09-12T17:41:32.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.788+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.fG8ewv8c0AHTG-HMvmF39jkExQdg0eu_0 2024-09-12T17:41:32.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.788+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13426780455346592050', time=2024-09-12T19:32:50.276232+0000, chain.objs.size()=1 2024-09-12T17:41:32.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.788+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.XxZxgKaZ9WpMpypO31GA5cGfXMc099s_0 2024-09-12T17:41:32.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.788+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8133289326307918279', time=2024-09-12T19:32:50.468215+0000, chain.objs.size()=1 2024-09-12T17:41:32.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.788+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.4ORKOTgnDwaPNAVHifl22dw7zrmyQRK_0 2024-09-12T17:41:32.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.788+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15269519047397106577', time=2024-09-12T19:32:50.474509+0000, chain.objs.size()=1 2024-09-12T17:41:32.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.788+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.___9yjbXUgi_6ANiBXhjxWxLuLTdap6_0 2024-09-12T17:41:32.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.788+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2940174619029090248', time=2024-09-12T19:32:50.537123+0000, chain.objs.size()=1 2024-09-12T17:41:32.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.788+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.FHs4U0ZnCNQgK0RWN51go8x88cUSCAG_0 2024-09-12T17:41:32.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.788+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7532138940342683117', time=2024-09-12T19:32:50.597781+0000, chain.objs.size()=1 2024-09-12T17:41:32.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.788+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.VNbcaForFN_D1NzcPt0BqB9rJ6PE3ZI_0 2024-09-12T17:41:32.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.788+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14385595323780529837', time=2024-09-12T19:32:50.656596+0000, chain.objs.size()=1 2024-09-12T17:41:32.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.788+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.dfJtHZzr2LdsRJcCF7pcF8l9b8bvjPR_0 2024-09-12T17:41:32.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.792+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7381409948755744152', time=2024-09-12T19:32:50.659091+0000, chain.objs.size()=1 2024-09-12T17:41:32.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.792+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.THYfPvjfhQvOD8R04AYmVdCcDMVBbKp_0 2024-09-12T17:41:32.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.792+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/46152 2024-09-12T17:41:32.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.796+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=32, truncated=0, next_marker='' 2024-09-12T17:41:32.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.796+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4113323596298397862', time=2024-09-12T19:32:50.660500+0000, chain.objs.size()=1 2024-09-12T17:41:32.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.796+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.xJGfeNlAOs4RjMD2jrD8229FHmxzO-u_0 2024-09-12T17:41:32.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.796+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1493229474482632506', time=2024-09-12T19:32:50.664698+0000, chain.objs.size()=1 2024-09-12T17:41:32.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.796+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.CpCYMj-jE1uctEW4rBWfiaIbwtqgwr1_0 2024-09-12T17:41:32.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.796+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8438214326555857366', time=2024-09-12T19:32:50.900734+0000, chain.objs.size()=1 2024-09-12T17:41:32.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.796+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.rBThaecVrTO8goaQsRzaQdSyfHGMZIg_0 2024-09-12T17:41:32.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.796+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14856217849043838255', time=2024-09-12T19:32:51.155739+0000, chain.objs.size()=1 2024-09-12T17:41:32.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.796+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.yXGRJT7nPxELJApQD9My_YIDU9mX7AD_0 2024-09-12T17:41:32.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.796+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17207216338474300511', time=2024-09-12T19:32:51.305785+0000, chain.objs.size()=1 2024-09-12T17:41:32.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.796+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.2XYhdVLeRcneewjvMq2hkjBHFxkf311_0 2024-09-12T17:41:32.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.796+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.437891921097019536', time=2024-09-12T19:32:51.319560+0000, chain.objs.size()=1 2024-09-12T17:41:32.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.796+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.lEcs5dBu0HFDYj54-mtK9lDCdi2T1r3_0 2024-09-12T17:41:32.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.796+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6478997197580395283', time=2024-09-12T19:32:51.328620+0000, chain.objs.size()=1 2024-09-12T17:41:32.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.796+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.mlNKxwi2SOmGhFnOkU-it2AygunyR9R_0 2024-09-12T17:41:32.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.796+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9499422229197665444', time=2024-09-12T19:32:51.353365+0000, chain.objs.size()=1 2024-09-12T17:41:32.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.796+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.VZsNdkGQu-ydV-ajgTbtD4MR_3Lb6-t_0 2024-09-12T17:41:32.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.796+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10027213151421237663', time=2024-09-12T19:32:51.371042+0000, chain.objs.size()=1 2024-09-12T17:41:32.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.796+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.oss2hEu58Eu4A-zq-Wg76qXr3IRLESH_0 2024-09-12T17:41:32.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.796+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3154300757478090197', time=2024-09-12T19:32:51.589412+0000, chain.objs.size()=1 2024-09-12T17:41:32.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.796+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.CAjJ3a9nKkI2GifyveKOEdcKkPnIpQP_0 2024-09-12T17:41:32.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.796+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3425994283439051788', time=2024-09-12T19:32:51.700576+0000, chain.objs.size()=1 2024-09-12T17:41:32.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.796+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.QqUq_bn9XIZahmFXKIJcg2HJRmJ9QC7_0 2024-09-12T17:41:32.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.796+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3846994681089399007', time=2024-09-12T19:32:51.897191+0000, chain.objs.size()=1 2024-09-12T17:41:32.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.796+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.QEjZxRnV-8-nV0J7U33nfWps8J0dWut_0 2024-09-12T17:41:32.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.796+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12110988375456477007', time=2024-09-12T19:32:52.012944+0000, chain.objs.size()=1 2024-09-12T17:41:32.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.796+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.rw-igrljCK4z7I-7Ws6g2iPXTJ3cL_6_0 2024-09-12T17:41:32.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.796+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11042356250213161642', time=2024-09-12T19:32:54.238468+0000, chain.objs.size()=1 2024-09-12T17:41:32.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.796+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.331__shadow_.0pB05GAkG8r2oNe48zdiKyV4JEsfh-x_0 2024-09-12T17:41:32.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.796+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10357414079530000739', time=2024-09-12T19:33:06.205605+0000, chain.objs.size()=1 2024-09-12T17:41:32.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.796+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.372__shadow_.mJ46RlJOf5WNCm6jgrhNVOgq7tYcO-R_0 2024-09-12T17:41:32.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.796+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9639326673883070720', time=2024-09-12T19:33:21.725400+0000, chain.objs.size()=1 2024-09-12T17:41:32.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.796+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.408__shadow_.XuNbH4tt3ZXmhc_s0J7bqQSbKGDcMsZ_0 2024-09-12T17:41:32.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.796+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15220671407232551628', time=2024-09-12T19:33:38.497006+0000, chain.objs.size()=1 2024-09-12T17:41:32.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.796+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.455__shadow_.AIEFrZGMLYW7aZq1zdHRWPlx-HLPVOR_0 2024-09-12T17:41:32.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.796+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3853510809501816650', time=2024-09-12T19:33:41.935902+0000, chain.objs.size()=1 2024-09-12T17:41:32.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.796+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.461__shadow_.R0Nwj7Q0smWBclxScB-qFfT00N6bouv_0 2024-09-12T17:41:32.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.796+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16086364353104865819', time=2024-09-12T19:33:44.037882+0000, chain.objs.size()=1 2024-09-12T17:41:32.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.796+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.465__shadow_.3O_gW4Fw5d2uRAFciErY7_kOIDwaVKU_0 2024-09-12T17:41:32.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.796+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2022924746420548248', time=2024-09-12T19:33:49.253468+0000, chain.objs.size()=1 2024-09-12T17:41:32.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.796+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.483__shadow_.UgdVR_sCIISVjxGhV2dETVtwIi_46gf_0 2024-09-12T17:41:32.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.796+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15336330187399543695', time=2024-09-12T19:33:49.658609+0000, chain.objs.size()=1 2024-09-12T17:41:32.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.796+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.484__shadow_.rxsdP19r7CBL6AIca_G3c7RxF0I6rTk_0 2024-09-12T17:41:32.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.800+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15208336156039761546', time=2024-09-12T19:33:55.144052+0000, chain.objs.size()=1 2024-09-12T17:41:32.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.800+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.498__shadow_.kjuwG94bplErST5QQ76FPV4snbqqwDZ_0 2024-09-12T17:41:32.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.800+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10688367659302597573', time=2024-09-12T19:34:05.368311+0000, chain.objs.size()=1 2024-09-12T17:41:32.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.800+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.517__shadow_.WlHpBzwAnZlHMI0sUXVP7ppSHuJw3DL_0 2024-09-12T17:41:32.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.800+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~ef4HU3fc3LoDJ7OsMfj_w0riug2kRVi', time=2024-09-12T19:34:25.543235+0000, chain.objs.size()=10 2024-09-12T17:41:32.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.800+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.526__multipart_mymultipart.2~ef4HU3fc3LoDJ7OsMfj_w0riug2kRVi.1 2024-09-12T17:41:32.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.800+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.526__multipart_mymultipart.2~ef4HU3fc3LoDJ7OsMfj_w0riug2kRVi.2 2024-09-12T17:41:32.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.800+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.526__multipart_mymultipart.2~ef4HU3fc3LoDJ7OsMfj_w0riug2kRVi.3 2024-09-12T17:41:32.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.800+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.526__multipart_mymultipart.2~ef4HU3fc3LoDJ7OsMfj_w0riug2kRVi.4 2024-09-12T17:41:32.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.800+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.526__multipart_mymultipart.2~ef4HU3fc3LoDJ7OsMfj_w0riug2kRVi.5 2024-09-12T17:41:32.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.800+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.526__multipart_mymultipart.2~ef4HU3fc3LoDJ7OsMfj_w0riug2kRVi.6 2024-09-12T17:41:32.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.800+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.526__multipart_mymultipart.2~ef4HU3fc3LoDJ7OsMfj_w0riug2kRVi.7 2024-09-12T17:41:32.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.800+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.526__multipart_mymultipart.2~ef4HU3fc3LoDJ7OsMfj_w0riug2kRVi.8 2024-09-12T17:41:32.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.800+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.526__multipart_mymultipart.2~ef4HU3fc3LoDJ7OsMfj_w0riug2kRVi.9 2024-09-12T17:41:32.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.800+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.526__multipart_mymultipart.2~ef4HU3fc3LoDJ7OsMfj_w0riug2kRVi.10 2024-09-12T17:41:32.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.800+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15626993257030655689', time=2024-09-12T19:35:03.875403+0000, chain.objs.size()=1 2024-09-12T17:41:32.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.800+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.555__shadow_.vzzGRe9xkxWs8goApwfNYQ9vUBmYN3h_0 2024-09-12T17:41:32.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.800+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10418099337049856633', time=2024-09-12T19:35:13.489133+0000, chain.objs.size()=2 2024-09-12T17:41:32.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.800+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.563__shadow_.4KsTN4kl2IMWCVwMEIpVaCp8whICUWR_0 2024-09-12T17:41:32.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.800+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.563__shadow_.4KsTN4kl2IMWCVwMEIpVaCp8whICUWR_1 2024-09-12T17:41:32.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.800+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15379096452028405845', time=2024-09-12T19:35:20.140270+0000, chain.objs.size()=1 2024-09-12T17:41:32.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.800+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.569__shadow:sIiRzSFgHg-UreSvyFOrk7IUf6Rfkrx_.Cyq45O37y1FpmJTrJhI7YKYAUed61ny_0 2024-09-12T17:41:32.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.804+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15388363620863804027', time=2024-09-12T19:35:41.819551+0000, chain.objs.size()=1 2024-09-12T17:41:32.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.804+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.577__shadow:BMU9ZUisChxU5h0eaC9zYeq7RZw5acN_.Tc4gAGTQjiXo4uoi74INxadXvjqAViK_0 2024-09-12T17:41:32.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.804+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11627276884323837320', time=2024-09-12T19:35:52.299079+0000, chain.objs.size()=4 2024-09-12T17:41:32.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.804+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.578__multipart_testobj.2~347rOST9zm6oTaAU1D2SbWAjtc0Zw0S.1 2024-09-12T17:41:32.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.804+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.578__multipart_testobj.2~347rOST9zm6oTaAU1D2SbWAjtc0Zw0S.2 2024-09-12T17:41:32.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.804+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.578__multipart_testobj.2~347rOST9zm6oTaAU1D2SbWAjtc0Zw0S.3 2024-09-12T17:41:32.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.804+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.578__multipart_testobj.2~347rOST9zm6oTaAU1D2SbWAjtc0Zw0S.4 2024-09-12T17:41:32.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.804+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9407414230153583344', time=2024-09-12T19:38:17.521707+0000, chain.objs.size()=1 2024-09-12T17:41:32.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.804+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.620__shadow_.x-6qL7akxi_pagUro_06IubTPUQb5Ia_0 2024-09-12T17:41:32.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.804+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12887978331924595935', time=2024-09-12T19:38:25.795298+0000, chain.objs.size()=1 2024-09-12T17:41:32.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.804+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.632__shadow_.xPeBonV1t_UPNUqVBoYgLtFGl0NAPNN_0 2024-09-12T17:41:32.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.804+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17239237483653400436', time=2024-09-12T19:38:54.122993+0000, chain.objs.size()=1 2024-09-12T17:41:32.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.804+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.697__shadow:qpH0-edcVczLjvvVw1nHQuydHZDb9h0_.muYO4LgKP8J3l6IxX-S0IJipCTuSP38_0 2024-09-12T17:41:32.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.808+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:41:32.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.808+0000 7fd765adf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:41:32.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.808+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:41:32.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.812+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:41:32.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.812+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/54495' 2024-09-12T17:41:32.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.812+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='_LPRplQVqHiLOl5VoozajAlFWFlkYAPS', time=2024-09-12T19:29:48.105751+0000, chain.objs.size()=3 2024-09-12T17:41:32.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.812+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.161__shadow_.zxrzDdBLyHaP9yBWoU2H0ZHRYCJA745_0 2024-09-12T17:41:32.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.812+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.161__shadow_.zxrzDdBLyHaP9yBWoU2H0ZHRYCJA745_1 2024-09-12T17:41:32.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.812+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.161__shadow_.zxrzDdBLyHaP9yBWoU2H0ZHRYCJA745_2 2024-09-12T17:41:32.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.812+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13504021307112224765', time=2024-09-12T19:29:50.406518+0000, chain.objs.size()=1 2024-09-12T17:41:32.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.812+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.166__shadow_.xmmLIJuCdVnrjQBolfAx1hPv-xGPd8R_0 2024-09-12T17:41:32.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.812+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10708866296310383408', time=2024-09-12T19:29:55.850717+0000, chain.objs.size()=1 2024-09-12T17:41:32.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.812+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.176__shadow_._B1b0SXnqCcRlKvXZGWlqd6Wred4mjm_0 2024-09-12T17:41:32.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.812+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4482548361471366040', time=2024-09-12T19:30:07.914006+0000, chain.objs.size()=1 2024-09-12T17:41:32.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.812+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.203__shadow_.qd0TetgnwxsiT_ctA7Cmi3xz_RY5u_7_0 2024-09-12T17:41:32.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.812+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13020598309042957451', time=2024-09-12T19:31:22.129619+0000, chain.objs.size()=1 2024-09-12T17:41:32.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.812+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.259__shadow_.eER7VVE-hgUJPjvU_S7Xj0mt6pjPDAm_0 2024-09-12T17:41:32.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.812+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8483209067437435235', time=2024-09-12T19:31:42.279717+0000, chain.objs.size()=1 2024-09-12T17:41:32.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.812+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.kAKtaZhvpWdju2pJaA_8a5iNKSVsZ8U_0 2024-09-12T17:41:32.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.812+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17433096449135940249', time=2024-09-12T19:31:42.305510+0000, chain.objs.size()=1 2024-09-12T17:41:32.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.812+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.13d6DRA-vv1RvAX0kQTnAPRftl-rt3Z_0 2024-09-12T17:41:32.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.812+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.233180351619527589', time=2024-09-12T19:31:42.440022+0000, chain.objs.size()=1 2024-09-12T17:41:32.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.812+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Z_lFAT1-Ea4H75TWAmr-xaIu16vzWBP_0 2024-09-12T17:41:32.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.812+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17834909937415268505', time=2024-09-12T19:31:42.479589+0000, chain.objs.size()=1 2024-09-12T17:41:32.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.812+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.lDtXUloHyjaN9fhqGrHJSATFdJut32R_0 2024-09-12T17:41:32.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.812+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6730041389984265864', time=2024-09-12T19:31:42.486126+0000, chain.objs.size()=1 2024-09-12T17:41:32.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.812+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.nVyDt8mk4lfWmf32Gf45EfsXu06_C5d_0 2024-09-12T17:41:32.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.816+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17431517080665199634', time=2024-09-12T19:31:42.576843+0000, chain.objs.size()=1 2024-09-12T17:41:32.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.816+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Bxk9rf4Ir_P2a1yWu8cLL3H48fpu6-P_0 2024-09-12T17:41:32.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.816+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14784745597962903895', time=2024-09-12T19:31:42.603909+0000, chain.objs.size()=1 2024-09-12T17:41:32.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.816+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.S1Lgk2kpkJqq8f_GS6gZvm2Am_Lb6wV_0 2024-09-12T17:41:32.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.816+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6052117712494543312', time=2024-09-12T19:31:42.611619+0000, chain.objs.size()=1 2024-09-12T17:41:32.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.816+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.0ABsIiwobx1ArkXm6xAmOQYAlLcLT9I_0 2024-09-12T17:41:32.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.816+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17915378697112007192', time=2024-09-12T19:31:42.690246+0000, chain.objs.size()=1 2024-09-12T17:41:32.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.816+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.FGs1LsCGqVeYjveSSU4LDjaRwYBsMQr_0 2024-09-12T17:41:32.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.816+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9874471887484689660', time=2024-09-12T19:31:42.702151+0000, chain.objs.size()=1 2024-09-12T17:41:32.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.816+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.jrR-zNnQ6NSn1ZHWS4QefnUkbczn8e0_0 2024-09-12T17:41:32.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.816+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8251539411519179033', time=2024-09-12T19:31:42.719732+0000, chain.objs.size()=1 2024-09-12T17:41:32.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.816+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.AFMWFRIi-GkTch4fSiYddfZGJFXppxY_0 2024-09-12T17:41:32.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.816+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10440643247046712757', time=2024-09-12T19:31:42.819378+0000, chain.objs.size()=1 2024-09-12T17:41:32.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.816+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.HyNQEvIbxuM8L8z5KnrLZiffcx6JKat_0 2024-09-12T17:41:32.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.816+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8948484838415064418', time=2024-09-12T19:31:42.920954+0000, chain.objs.size()=1 2024-09-12T17:41:32.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.816+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.CcmT6YjDeMaQALdcBcskd1v6J4e7MP0_0 2024-09-12T17:41:32.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.816+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14256132784365892292', time=2024-09-12T19:31:42.938561+0000, chain.objs.size()=1 2024-09-12T17:41:32.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.816+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.93i0uMfu8GBDOfRU6oMrN_Jpjwn9I-H_0 2024-09-12T17:41:32.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.816+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1634899974148209011', time=2024-09-12T19:31:43.138839+0000, chain.objs.size()=1 2024-09-12T17:41:32.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.816+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.yD0nEVAU8wBI0kxkLZpcNoMxMvtRIwA_0 2024-09-12T17:41:32.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.816+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8873788815488879758', time=2024-09-12T19:31:43.230855+0000, chain.objs.size()=1 2024-09-12T17:41:32.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.816+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.YvlHvlVejTmap9SwyZqKlVG-NJ42oz__0 2024-09-12T17:41:32.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.816+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8125615875541287658', time=2024-09-12T19:31:43.284711+0000, chain.objs.size()=1 2024-09-12T17:41:32.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.816+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Cwx5dWFNe1F7B7QFfWen3vm3AoNj3HB_0 2024-09-12T17:41:32.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.816+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12863928644002505794', time=2024-09-12T19:31:43.444771+0000, chain.objs.size()=1 2024-09-12T17:41:32.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.816+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.MCYPN207anwCapLkyiUUAcdl3_zeSZ6_0 2024-09-12T17:41:32.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.816+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3066975726772149585', time=2024-09-12T19:31:43.818692+0000, chain.objs.size()=1 2024-09-12T17:41:32.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.816+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.IIU00Q1EU2772BfnRfsQgXDnom9THEM_0 2024-09-12T17:41:32.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.816+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7596311800875925820', time=2024-09-12T19:31:43.829068+0000, chain.objs.size()=1 2024-09-12T17:41:32.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.816+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Msu8z_GMJ76g4ztvYwXqfho1qCQNSYO_0 2024-09-12T17:41:32.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.816+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9247087245138927482', time=2024-09-12T19:31:43.945523+0000, chain.objs.size()=1 2024-09-12T17:41:32.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.816+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.ei_C6Y3JHhSNYE9_vtyYVvo7PvFQq6F_0 2024-09-12T17:41:32.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.816+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12706974581182045635', time=2024-09-12T19:31:44.174142+0000, chain.objs.size()=1 2024-09-12T17:41:32.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.816+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.JPcvoJj445DwZOzcdB6bPt1_-oQqDn-_0 2024-09-12T17:41:32.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.816+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.762294142712250456', time=2024-09-12T19:31:44.188072+0000, chain.objs.size()=1 2024-09-12T17:41:32.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.816+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.UIVoIMO1TBFvk09reGatMfXngL3lpbw_0 2024-09-12T17:41:32.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.816+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12941439060762534946', time=2024-09-12T19:31:44.431302+0000, chain.objs.size()=1 2024-09-12T17:41:32.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.816+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.5xk-LREc9aGsfR_-E2Qcjjl64Z1kLDv_0 2024-09-12T17:41:32.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.816+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4877620929580841620', time=2024-09-12T19:31:44.528545+0000, chain.objs.size()=1 2024-09-12T17:41:32.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.816+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.xjPoOOOxZiut_3iDqW0XXlv9f1kuACP_0 2024-09-12T17:41:32.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.816+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15502793695761525396', time=2024-09-12T19:31:46.584698+0000, chain.objs.size()=1 2024-09-12T17:41:32.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.816+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.268__shadow_.fu1szGXiQHD-2T4DakSsfNYrq5de8l5_0 2024-09-12T17:41:32.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.816+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16001564518789248742', time=2024-09-12T19:31:46.590376+0000, chain.objs.size()=1 2024-09-12T17:41:32.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.816+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.268__shadow_.55zOJR5pm4Leib33RK4vWeW6mWKGHfb_0 2024-09-12T17:41:32.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.820+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3651747513331426927', time=2024-09-12T19:31:48.021556+0000, chain.objs.size()=1 2024-09-12T17:41:32.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.820+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.272__shadow_.jyhJxuxsb0I94TV9GOm21iNV3d-B1SF_0 2024-09-12T17:41:32.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.820+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.831822665363051438', time=2024-09-12T19:31:51.002766+0000, chain.objs.size()=1 2024-09-12T17:41:32.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.820+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.280__shadow_.s2qHufQLmJeYnVJKTufwxeMH9JGmGxe_0 2024-09-12T17:41:32.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.820+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2838276942308245720', time=2024-09-12T19:31:57.571215+0000, chain.objs.size()=1 2024-09-12T17:41:32.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.820+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.293__shadow_.HLE73vxdUJxL0oqVXO791s7oWrXfYY4_0 2024-09-12T17:41:32.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.820+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16181660445927749669', time=2024-09-12T19:32:27.905371+0000, chain.objs.size()=1 2024-09-12T17:41:32.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.820+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.VQxXU6jVdg8tTPJIZ_HEXckMbHMZbqk_0 2024-09-12T17:41:32.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.820+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13204730873455693685', time=2024-09-12T19:32:27.910738+0000, chain.objs.size()=1 2024-09-12T17:41:32.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.820+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.hDt7dyGQwARXLkRiUXsqmjwW7l4dDbp_0 2024-09-12T17:41:32.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.820+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11912152412316272305', time=2024-09-12T19:32:27.950605+0000, chain.objs.size()=1 2024-09-12T17:41:32.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.820+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.hdwQ6idb8tynlqm4g9bCrhJKM-QG5hV_0 2024-09-12T17:41:32.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.820+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8162684147152845640', time=2024-09-12T19:32:28.069278+0000, chain.objs.size()=1 2024-09-12T17:41:32.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.820+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.GIfG_Ye1kf3jWmsUsFOQe7NGXRyxmA__0 2024-09-12T17:41:32.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.820+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7503242921575508131', time=2024-09-12T19:32:28.147041+0000, chain.objs.size()=1 2024-09-12T17:41:32.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.820+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.vGyXuvm5ZNimgEj5Y8nIY6_WyA_jvUH_0 2024-09-12T17:41:32.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.820+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10794598581765261668', time=2024-09-12T19:32:28.172348+0000, chain.objs.size()=1 2024-09-12T17:41:32.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.820+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.-0iB_goRJmnFaXjsu_RcHErWDHivrFW_0 2024-09-12T17:41:32.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.820+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17631810653295477563', time=2024-09-12T19:32:28.182996+0000, chain.objs.size()=1 2024-09-12T17:41:32.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.820+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.VtfPiXfxXSXcg8IVco-KeHV3fAci0yi_0 2024-09-12T17:41:32.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.820+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10629174639717619531', time=2024-09-12T19:32:28.240291+0000, chain.objs.size()=1 2024-09-12T17:41:32.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.820+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.VeEFbN7kO6bGgXR0YGjySSU0kzxquTY_0 2024-09-12T17:41:32.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.820+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6392497026093503295', time=2024-09-12T19:32:28.527387+0000, chain.objs.size()=1 2024-09-12T17:41:32.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.820+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Djbi4k3qPhwW5Sj-oA3oPgyi3q4NLQH_0 2024-09-12T17:41:32.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.820+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11774815182015037156', time=2024-09-12T19:32:28.772595+0000, chain.objs.size()=1 2024-09-12T17:41:32.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.820+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.pGsxewEAkrc912xynEv0veQvOiTl0tD_0 2024-09-12T17:41:32.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.820+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13764264714994659249', time=2024-09-12T19:32:29.194139+0000, chain.objs.size()=1 2024-09-12T17:41:32.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.820+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.uabBQcJEGdqFGaX_uj7c1r6vhP9RUQI_0 2024-09-12T17:41:32.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.820+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10786920112290072386', time=2024-09-12T19:32:29.203981+0000, chain.objs.size()=1 2024-09-12T17:41:32.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.820+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.kEMzyvOxXadqDeiqTxsO3Plvp5OuV7L_0 2024-09-12T17:41:32.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.820+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15398614168811723093', time=2024-09-12T19:32:29.378894+0000, chain.objs.size()=1 2024-09-12T17:41:32.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.820+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.dAFP1mTR9gYK0VBaUFTaVZGb-d6ONX7_0 2024-09-12T17:41:32.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.820+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8795531437941250910', time=2024-09-12T19:32:29.677673+0000, chain.objs.size()=1 2024-09-12T17:41:32.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.820+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.2UaMWrgi-_qN1r6cK4rMKU-1IHhB7L7_0 2024-09-12T17:41:32.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.820+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12323753404495793349', time=2024-09-12T19:32:29.719072+0000, chain.objs.size()=1 2024-09-12T17:41:32.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.820+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.hlr1WeZKzeoReSe8ec-_ruxTltpdBPY_0 2024-09-12T17:41:32.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.820+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.422902790991761253', time=2024-09-12T19:32:29.720679+0000, chain.objs.size()=1 2024-09-12T17:41:32.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.820+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Iq5dU1N2nH0_G51NtVOnyB-r8I2ouUZ_0 2024-09-12T17:41:32.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.820+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1986304174965946247', time=2024-09-12T19:32:29.819526+0000, chain.objs.size()=1 2024-09-12T17:41:32.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.820+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.wfElUTe7dobrbPQSGitk1Gwtmn-7Kvh_0 2024-09-12T17:41:32.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.824+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11914757270235899875', time=2024-09-12T19:32:29.864824+0000, chain.objs.size()=1 2024-09-12T17:41:32.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.824+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.p4MpHStMSNSIExbGLXcOzCCDW2rF6DE_0 2024-09-12T17:41:32.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.824+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3084061620484839738', time=2024-09-12T19:32:29.995264+0000, chain.objs.size()=1 2024-09-12T17:41:32.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.824+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.ZTwPLyV2RTGcjmkYyLnc8NjemxbcGtX_0 2024-09-12T17:41:32.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.824+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3410445864758281932', time=2024-09-12T19:32:30.007434+0000, chain.objs.size()=1 2024-09-12T17:41:32.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.824+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_._jPLEqrbwfZQTd2uB0-aNUdnF-BL1xd_0 2024-09-12T17:41:32.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.824+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4318854989106376148', time=2024-09-12T19:32:30.061005+0000, chain.objs.size()=1 2024-09-12T17:41:32.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.824+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.X0WaTqi12Q7ONg6MZAXyq26xM40MDCF_0 2024-09-12T17:41:32.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.824+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.150990458357127139', time=2024-09-12T19:32:30.085325+0000, chain.objs.size()=1 2024-09-12T17:41:32.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.824+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.QhKFBUmZPwtXWPm8n_j80sQ6RS53f1i_0 2024-09-12T17:41:32.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.824+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6083819968888859102', time=2024-09-12T19:32:30.088497+0000, chain.objs.size()=1 2024-09-12T17:41:32.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.824+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.q6L99UJQjUpsC_82G7PUgW4OoURbU8z_0 2024-09-12T17:41:32.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.824+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11945930925836177462', time=2024-09-12T19:32:30.099406+0000, chain.objs.size()=1 2024-09-12T17:41:32.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.824+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.bPFMM90_zBnPigZf-AOM0BMOaR2DCLD_0 2024-09-12T17:41:32.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.824+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18097499927632849155', time=2024-09-12T19:32:49.533912+0000, chain.objs.size()=1 2024-09-12T17:41:32.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.824+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Oum0irjb2l3r3zLSiytA-bQBe2BiWlO_0 2024-09-12T17:41:32.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.824+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13171216135268946871', time=2024-09-12T19:32:49.598276+0000, chain.objs.size()=1 2024-09-12T17:41:32.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.824+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.lauzEyZfkY62csd2opEq7XB75xqDaqe_0 2024-09-12T17:41:32.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.824+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12246046328234263463', time=2024-09-12T19:32:49.640664+0000, chain.objs.size()=1 2024-09-12T17:41:32.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.824+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_._nKFkvsYHjB_DkqIOU9gayDw_ax5FU__0 2024-09-12T17:41:32.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.824+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15322437562435635818', time=2024-09-12T19:32:49.664503+0000, chain.objs.size()=1 2024-09-12T17:41:32.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.824+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.UZIKcS2wRbC99kmxykpsAMIloKKS53e_0 2024-09-12T17:41:32.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.824+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3927446990932667714', time=2024-09-12T19:32:49.669808+0000, chain.objs.size()=1 2024-09-12T17:41:32.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.824+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.ITFv3mv5DCuaz-kfRybRRnW5rEgIJOh_0 2024-09-12T17:41:32.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.824+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14709822942871412786', time=2024-09-12T19:32:49.722871+0000, chain.objs.size()=1 2024-09-12T17:41:32.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.824+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.vCwFG4v6aDOdD2ofqqCmfm_1X_Igs0v_0 2024-09-12T17:41:32.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.824+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11448360566299250605', time=2024-09-12T19:32:49.917476+0000, chain.objs.size()=1 2024-09-12T17:41:32.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.824+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.d61wc2BXnOfpWfjRf4lfyEHsbXbhU2__0 2024-09-12T17:41:32.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.824+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15090587535806814887', time=2024-09-12T19:32:49.922527+0000, chain.objs.size()=1 2024-09-12T17:41:32.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.824+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.R_jm5tHLVi1aPfrIu1oXGJK8UENOHcq_0 2024-09-12T17:41:32.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.824+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13280460024489859815', time=2024-09-12T19:32:50.147375+0000, chain.objs.size()=1 2024-09-12T17:41:32.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.824+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.N6DHOKVlJp-iOlsDYy2PS3INP19o9YT_0 2024-09-12T17:41:32.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.828+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7552089513759842016', time=2024-09-12T19:32:50.275160+0000, chain.objs.size()=1 2024-09-12T17:41:32.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.828+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.yzli4Ld1m_-nu_CLZHVsFQl-kZPxMv5_0 2024-09-12T17:41:32.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.828+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12849225432107576737', time=2024-09-12T19:32:50.605715+0000, chain.objs.size()=1 2024-09-12T17:41:32.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.828+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.QmRlSzrBNg1aakEnXox1G9AouEwnSUz_0 2024-09-12T17:41:32.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.828+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7422143350800653900', time=2024-09-12T19:32:50.617760+0000, chain.objs.size()=1 2024-09-12T17:41:32.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.828+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.tMr5f-9gZTILfQwj3o6QAly2ae6GduE_0 2024-09-12T17:41:32.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.828+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1259887190591446452', time=2024-09-12T19:32:50.674477+0000, chain.objs.size()=1 2024-09-12T17:41:32.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.828+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.GEN94omOFcsZTmR41_G5TruK0Q0Ftzc_0 2024-09-12T17:41:32.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.828+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1745528260273734700', time=2024-09-12T19:32:50.863950+0000, chain.objs.size()=1 2024-09-12T17:41:32.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.828+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.EmuYDgnVJEbj-y_NbrMnx-KS5X0BJ8e_0 2024-09-12T17:41:32.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.828+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10152380915417153877', time=2024-09-12T19:32:51.213045+0000, chain.objs.size()=1 2024-09-12T17:41:32.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.828+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.x-yajtAxvHlxmM6YHFF-lOu1y9LbPbd_0 2024-09-12T17:41:32.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.828+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2381738158811676720', time=2024-09-12T19:32:51.225902+0000, chain.objs.size()=1 2024-09-12T17:41:32.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.828+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.giT-NyWl6Y3cmIcEugvpwy077uiI3lU_0 2024-09-12T17:41:32.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.828+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18000194289785948383', time=2024-09-12T19:32:51.269623+0000, chain.objs.size()=1 2024-09-12T17:41:32.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.828+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.FYU3-FD9K41yMxTpLTGBfK0qW2koKGq_0 2024-09-12T17:41:32.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.828+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15059947488971648705', time=2024-09-12T19:32:51.326577+0000, chain.objs.size()=1 2024-09-12T17:41:32.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.828+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.OIWdTp1HIYksF9MflV3GP_6OiNiGyH5_0 2024-09-12T17:41:32.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.828+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11862149988143039824', time=2024-09-12T19:32:51.359479+0000, chain.objs.size()=1 2024-09-12T17:41:32.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.828+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.kfq_613WWaO5OEqBJRtfn6d1vrdDwv2_0 2024-09-12T17:41:32.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.828+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15497902926689566622', time=2024-09-12T19:32:51.372075+0000, chain.objs.size()=1 2024-09-12T17:41:32.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.828+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.deLw_Ty0K2hEItCLIUSCRnUiyunFs_N_0 2024-09-12T17:41:32.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.828+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1135303568193784380', time=2024-09-12T19:32:51.633954+0000, chain.objs.size()=1 2024-09-12T17:41:32.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.828+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.MfcK7MSxjlWi97ocTQBxG8kqONzWK-__0 2024-09-12T17:41:32.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.828+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10577883882777555160', time=2024-09-12T19:32:51.637293+0000, chain.objs.size()=1 2024-09-12T17:41:32.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.828+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.swlMDmXrj6PBKmm7egFgUM7Xf2bH8Hc_0 2024-09-12T17:41:32.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.828+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2585461412073123142', time=2024-09-12T19:32:51.692963+0000, chain.objs.size()=1 2024-09-12T17:41:32.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.828+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.7ABVUBDDwe-_6sWf3FXq1XGSr7KbWsR_0 2024-09-12T17:41:32.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.828+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5789291873039695131', time=2024-09-12T19:32:51.695731+0000, chain.objs.size()=1 2024-09-12T17:41:32.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.828+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.p8oVtKXhgxf9kGjEe5WOoiQkStNAUGZ_0 2024-09-12T17:41:32.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.828+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13728217848286126616', time=2024-09-12T19:32:51.699076+0000, chain.objs.size()=1 2024-09-12T17:41:32.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.828+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.EXZhNI10bMkC-sd-u-jaj3bMYG5BhAr_0 2024-09-12T17:41:32.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.828+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13800637754809529399', time=2024-09-12T19:32:51.833354+0000, chain.objs.size()=1 2024-09-12T17:41:32.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.828+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.c6maXoXsixvMnGsQhWsAos2YA3DPsHZ_0 2024-09-12T17:41:32.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.828+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3047733592279481274', time=2024-09-12T19:32:51.891798+0000, chain.objs.size()=1 2024-09-12T17:41:32.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.828+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.-fN8ptt6J9jLqqJC-F2d_3AqOQPSfv1_0 2024-09-12T17:41:32.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.828+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15785688350008474656', time=2024-09-12T19:32:51.901344+0000, chain.objs.size()=1 2024-09-12T17:41:32.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.828+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.US840YgdA-F98jQynHz6ao4dv2z3Ml2_0 2024-09-12T17:41:32.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.828+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4936358818657279495', time=2024-09-12T19:32:51.926269+0000, chain.objs.size()=1 2024-09-12T17:41:32.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.828+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.ZzCrxtJg4qjPEAKTejUb2r5hHkwws5K_0 2024-09-12T17:41:32.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.832+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10160786088308186512', time=2024-09-12T19:32:51.942457+0000, chain.objs.size()=1 2024-09-12T17:41:32.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.832+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.c2C55yQauP5x8vew0YqAJBqHkzEn-xK_0 2024-09-12T17:41:32.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.832+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16858731937255142366', time=2024-09-12T19:32:51.988985+0000, chain.objs.size()=1 2024-09-12T17:41:32.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.832+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.f2kYkSP3YL8_Zvpb05G8Tew0KfvhH1M_0 2024-09-12T17:41:32.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.832+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15034473452046518207', time=2024-09-12T19:33:49.258616+0000, chain.objs.size()=1 2024-09-12T17:41:32.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.832+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.483__shadow_.GhagirW-hC9JJIvLQmJ7UqtSoMVkbnB_0 2024-09-12T17:41:32.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.832+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17062779437315019964', time=2024-09-12T19:33:49.664329+0000, chain.objs.size()=1 2024-09-12T17:41:32.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.832+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.484__shadow_.OhIaU1YbQ9g-B2TcxqegI4GZiTfBJaC_0 2024-09-12T17:41:32.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.832+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1687359881874964678', time=2024-09-12T19:33:52.910905+0000, chain.objs.size()=1 2024-09-12T17:41:32.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.832+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.491__shadow_.sBGcmJwmq5VbYXBnh0dacjksL9aFKIA_0 2024-09-12T17:41:32.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.832+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.85726418483640664', time=2024-09-12T19:33:55.009436+0000, chain.objs.size()=1 2024-09-12T17:41:32.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.832+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.497__shadow_.5fEIl21DgEg1vKpQ9briYc771P9lfnS_0 2024-09-12T17:41:32.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.832+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~P_ZFJPFVA8vkldt3Ue7XLIqHokQb14b', time=2024-09-12T19:34:17.038107+0000, chain.objs.size()=1 2024-09-12T17:41:32.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.832+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__multipart_mymultipart.2~P_ZFJPFVA8vkldt3Ue7XLIqHokQb14b.2 2024-09-12T17:41:32.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.832+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~P_ZFJPFVA8vkldt3Ue7XLIqHokQb14b', time=2024-09-12T19:34:17.041776+0000, chain.objs.size()=1 2024-09-12T17:41:32.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.832+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__multipart_mymultipart.2~P_ZFJPFVA8vkldt3Ue7XLIqHokQb14b.3 2024-09-12T17:41:32.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.832+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2311101317619499767', time=2024-09-12T19:34:44.347384+0000, chain.objs.size()=4 2024-09-12T17:41:32.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.832+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.535__multipart_mymultipart.2~3P4AOmJiDuMjH07TGGWY3pTmfVwYSL-.1 2024-09-12T17:41:32.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.832+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.535__multipart_mymultipart.2~3P4AOmJiDuMjH07TGGWY3pTmfVwYSL-.2 2024-09-12T17:41:32.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.832+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.535__multipart_mymultipart.mWISPQgyxQYmrJGYsbs9u8vpbG9Z2ITT.3 2024-09-12T17:41:32.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.832+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.535__multipart_mymultipart.2~3P4AOmJiDuMjH07TGGWY3pTmfVwYSL-.4 2024-09-12T17:41:32.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.832+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3935532293631192387', time=2024-09-12T19:35:06.244728+0000, chain.objs.size()=1 2024-09-12T17:41:32.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.832+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.558__shadow_.rfpRavBce1iiVHkoiS0Bv237e36Tjty_0 2024-09-12T17:41:32.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.832+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5825017544547957107', time=2024-09-12T19:35:06.856369+0000, chain.objs.size()=1 2024-09-12T17:41:32.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.832+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.559__shadow_.2EK6SPYq4cjoe6o15sU5sFitMt1DhVq_0 2024-09-12T17:41:32.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.832+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8218774370035609037', time=2024-09-12T19:35:25.098639+0000, chain.objs.size()=1 2024-09-12T17:41:32.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.832+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.572__shadow:z8EV9QVCiKbJ9tWBlS4WmUnDw8Zimor_.zq5i-epmAlNJ-eNfcH0X4MInYY3vhsO_0 2024-09-12T17:41:32.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.836+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/54495 2024-09-12T17:41:32.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.836+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-12T17:41:32.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.836+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11393206075936423769', time=2024-09-12T19:35:26.641279+0000, chain.objs.size()=1 2024-09-12T17:41:32.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.836+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.574__shadow_.3oL-WFF9Cq7NCET6_cXyiEnXbZ48qC2_0 2024-09-12T17:41:32.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.836+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11941458399657444062', time=2024-09-12T19:35:28.289340+0000, chain.objs.size()=1 2024-09-12T17:41:32.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.836+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.574__shadow:lRnDG.YLACttBC.rvdRqd4p1O49Nm-M_.OY63WYBQ6tsXvAqqB9NTsjrJnVBeiq4_0 2024-09-12T17:41:32.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.836+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10595671465820812122', time=2024-09-12T19:35:29.991683+0000, chain.objs.size()=1 2024-09-12T17:41:32.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.836+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.575__shadow_.2JfX8uJKphm_KkDYUg9VKPZNF_-1kk1_0 2024-09-12T17:41:32.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.836+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13811650865135839206', time=2024-09-12T19:35:52.564845+0000, chain.objs.size()=4 2024-09-12T17:41:32.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.836+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.578__multipart_testobj.2~EiMts48vhi4F7W8GNVZb3PNbJAa_AOT.1 2024-09-12T17:41:32.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.836+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.578__multipart_testobj.2~EiMts48vhi4F7W8GNVZb3PNbJAa_AOT.2 2024-09-12T17:41:32.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.836+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.578__multipart_testobj.2~EiMts48vhi4F7W8GNVZb3PNbJAa_AOT.3 2024-09-12T17:41:32.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.836+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.578__multipart_testobj.2~EiMts48vhi4F7W8GNVZb3PNbJAa_AOT.4 2024-09-12T17:41:32.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.836+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6093234239357804137', time=2024-09-12T19:35:58.069733+0000, chain.objs.size()=1 2024-09-12T17:41:32.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.836+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.585__shadow:5.W0.QB2ChCltlbtRyuMwSvcX7113P8_.2IT_f5sBz21krlo7tOxQy5CWiMOzaQr_0 2024-09-12T17:41:32.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.836+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8249678022551414581', time=2024-09-12T19:38:31.035359+0000, chain.objs.size()=1 2024-09-12T17:41:32.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.836+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.645__shadow_.dxCqtPp2Zy_O3oeJLyn5l2oHWh6284a_0 2024-09-12T17:41:32.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.836+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6094306348894025269', time=2024-09-12T19:38:57.875389+0000, chain.objs.size()=1 2024-09-12T17:41:32.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.836+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.706__shadow_.K3AS7OZVA2XjDGoz8mK-8Ign_u8DIXc_0 2024-09-12T17:41:32.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.836+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17087296157193143992', time=2024-09-12T19:39:00.935858+0000, chain.objs.size()=1 2024-09-12T17:41:32.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.836+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.714__shadow:gsxzYcgQW7KBByBMqnfLemoJaBaBOJv_.mqt9Gx0HiF96iNmFaDgf3KxjfB1wywb_0 2024-09-12T17:41:32.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.836+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3379569378123206838', time=2024-09-12T19:39:31.603691+0000, chain.objs.size()=1 2024-09-12T17:41:32.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.836+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.742__multipart_mymultipart3.2~23xhBuvACwlSyd4poon0LIAoK4S8KKj.1 2024-09-12T17:41:32.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.840+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:41:32.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.844+0000 7fd765adf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:41:32.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.844+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:41:32.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.848+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:41:32.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.848+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/71605' 2024-09-12T17:41:32.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.848+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2038024391194135623', time=2024-09-12T19:29:36.807814+0000, chain.objs.size()=1 2024-09-12T17:41:32.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.848+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.148__shadow_.3yK3_WT_Rh3SyO5w9BsQM1nBO25y8Uq_0 2024-09-12T17:41:32.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.848+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13770218093060851889', time=2024-09-12T19:29:48.835575+0000, chain.objs.size()=1 2024-09-12T17:41:32.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.848+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.162__shadow_.gA2cP1GSMACR7i_Cw-jfCEt4W0vQlJ0_0 2024-09-12T17:41:32.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.848+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18331745978499728865', time=2024-09-12T19:30:06.485554+0000, chain.objs.size()=1 2024-09-12T17:41:32.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.848+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.200__shadow_.zPxKCdeE2PHCOhcc5CVTGVGEnejaRY1_0 2024-09-12T17:41:32.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.848+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~tTdIsUjH3Z5KwX4uGE4aihIFv4xK96S', time=2024-09-12T19:30:07.528260+0000, chain.objs.size()=2 2024-09-12T17:41:32.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.848+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.202__multipart_mymultipart.2~tTdIsUjH3Z5KwX4uGE4aihIFv4xK96S.1 2024-09-12T17:41:32.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.848+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.202__shadow_mymultipart.2~tTdIsUjH3Z5KwX4uGE4aihIFv4xK96S.1_1 2024-09-12T17:41:32.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.848+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1610176703381497731', time=2024-09-12T19:31:11.024097+0000, chain.objs.size()=1 2024-09-12T17:41:32.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.848+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.231__shadow_.kpQ6GkRh15Z9jk--7JgruzORwJIHUGg_0 2024-09-12T17:41:32.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.848+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17398627982375460734', time=2024-09-12T19:31:12.964847+0000, chain.objs.size()=1 2024-09-12T17:41:32.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.848+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.236__shadow_.agOtIFPbRsMf3jAvMkqIQKJxnleGU5-_0 2024-09-12T17:41:32.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.848+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13170124850701180902', time=2024-09-12T19:31:15.029078+0000, chain.objs.size()=1 2024-09-12T17:41:32.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.848+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.241__shadow_.2XPCj91F5a2EPajQWqFnECv3_NKypxC_0 2024-09-12T17:41:32.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.848+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2567823572088970223', time=2024-09-12T19:31:17.184777+0000, chain.objs.size()=1 2024-09-12T17:41:32.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.848+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.246__shadow_.U-Zml9748vVONFx6F72YwC2F80EtV_J_0 2024-09-12T17:41:32.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.848+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8715335423687062747', time=2024-09-12T19:31:17.186837+0000, chain.objs.size()=1 2024-09-12T17:41:32.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.848+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.246__shadow_.cE8m5TWpcopVgFuIyXNqr3Lq42U_OCI_0 2024-09-12T17:41:32.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.848+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11332303156360653607', time=2024-09-12T19:31:42.255695+0000, chain.objs.size()=1 2024-09-12T17:41:32.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.848+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.j6jJz16jbDJPa0kMoPSSU1I3GEIgHkJ_0 2024-09-12T17:41:32.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.848+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17566574951837968876', time=2024-09-12T19:31:42.321502+0000, chain.objs.size()=1 2024-09-12T17:41:32.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.848+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.3Oc7hdIATwdbGHkDQCGjQgacTvwndwG_0 2024-09-12T17:41:32.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.848+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6108652933978709622', time=2024-09-12T19:31:42.369714+0000, chain.objs.size()=1 2024-09-12T17:41:32.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.848+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.q59cIdq98RT8VRmT9fBZF7A5yd26IPs_0 2024-09-12T17:41:32.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.848+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3345943487460513197', time=2024-09-12T19:31:42.428072+0000, chain.objs.size()=1 2024-09-12T17:41:32.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.848+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.0U2XLq8I6SNWvaOqmG8SiDz0y2Z98qR_0 2024-09-12T17:41:32.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.848+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11723950605129906059', time=2024-09-12T19:31:42.452313+0000, chain.objs.size()=1 2024-09-12T17:41:32.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.848+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.yO5Rq6bmzKk33hG1J-YRFBZiYafvrpQ_0 2024-09-12T17:41:32.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.852+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17495357003465677870', time=2024-09-12T19:31:42.459947+0000, chain.objs.size()=1 2024-09-12T17:41:32.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.852+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.3ZdtSft9vGKjL6Igiz7p5DR2hmpk7zY_0 2024-09-12T17:41:32.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.852+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2730975080697107378', time=2024-09-12T19:31:42.565404+0000, chain.objs.size()=1 2024-09-12T17:41:32.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.852+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.-YDx4NlpiLbedEGRfq17urB8zDhd7uW_0 2024-09-12T17:41:32.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.852+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16542383074269214550', time=2024-09-12T19:31:42.589673+0000, chain.objs.size()=1 2024-09-12T17:41:32.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.852+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.hICNzzgZAKcL841lW978o_NeXKlilWz_0 2024-09-12T17:41:32.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.852+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5736197374634043446', time=2024-09-12T19:31:42.692146+0000, chain.objs.size()=1 2024-09-12T17:41:32.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.852+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.yF4yGLl3DpV26kjEPCmeKkFf0xvWnik_0 2024-09-12T17:41:32.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.852+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.142082044504905778', time=2024-09-12T19:31:42.810945+0000, chain.objs.size()=1 2024-09-12T17:41:32.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.852+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.piQpX7xMkwi27ve4DrgZtHQJV7ql3Ih_0 2024-09-12T17:41:32.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.852+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17521980573760861509', time=2024-09-12T19:31:42.870334+0000, chain.objs.size()=1 2024-09-12T17:41:32.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.852+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.OgUyvWLH3apCjVyabiYKF09Gh-BEOl4_0 2024-09-12T17:41:32.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.852+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15552731791558671456', time=2024-09-12T19:31:42.881770+0000, chain.objs.size()=1 2024-09-12T17:41:32.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.852+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.RlGoY1rspe_dDBnisgIgZcClcRg5oEi_0 2024-09-12T17:41:32.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.852+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9878005835705369468', time=2024-09-12T19:31:42.924408+0000, chain.objs.size()=1 2024-09-12T17:41:32.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.852+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.1iCI144d8ICxf_V21D1dUZJGSqN39Nw_0 2024-09-12T17:41:32.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.852+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17927242692215355530', time=2024-09-12T19:31:43.074735+0000, chain.objs.size()=1 2024-09-12T17:41:32.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.852+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.aqtsKiCrkQjd1OVZ9PeWj-FCZqg5zjt_0 2024-09-12T17:41:32.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.852+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3187210770274740864', time=2024-09-12T19:31:43.127431+0000, chain.objs.size()=1 2024-09-12T17:41:32.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.852+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.ayOR3tYlVH5tKU4NMWcLZgNxPPIJ7Ke_0 2024-09-12T17:41:32.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.852+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4202049493089942082', time=2024-09-12T19:31:43.140340+0000, chain.objs.size()=1 2024-09-12T17:41:32.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.852+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.5wGjmnF0Fps9ZZqF1BdyxcztObQObuI_0 2024-09-12T17:41:32.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.856+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2528791391985522022', time=2024-09-12T19:31:43.141421+0000, chain.objs.size()=1 2024-09-12T17:41:32.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.856+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.vmBgN1uMqPvT05IWEDSjwPXefA_Yqtv_0 2024-09-12T17:41:32.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.856+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15189346821005436295', time=2024-09-12T19:31:43.263861+0000, chain.objs.size()=1 2024-09-12T17:41:32.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.856+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.ngrz9WBIZomhTOT4iOfhhOeaBDV-1g7_0 2024-09-12T17:41:32.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.856+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4336372687177685982', time=2024-09-12T19:31:43.506750+0000, chain.objs.size()=1 2024-09-12T17:41:32.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.856+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.WbpAIfb3UlcOKC7a7Az78Tp_rkmAuZ-_0 2024-09-12T17:41:32.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.856+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9633544196050445079', time=2024-09-12T19:31:43.572913+0000, chain.objs.size()=1 2024-09-12T17:41:32.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.856+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.TSt1vQTAOUjpPbvDhbkefMq1612_5HY_0 2024-09-12T17:41:32.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.856+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13733142358885219732', time=2024-09-12T19:31:43.744488+0000, chain.objs.size()=1 2024-09-12T17:41:32.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.856+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.scf5HrTf7i2RzmSFlOjQKOLWX8j10NG_0 2024-09-12T17:41:32.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.856+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15456063087313677731', time=2024-09-12T19:31:43.807137+0000, chain.objs.size()=1 2024-09-12T17:41:32.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.856+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.19yFRv6GQhT0AMrzhte6VuBw9MJgAhZ_0 2024-09-12T17:41:32.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.856+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14125481970673029486', time=2024-09-12T19:31:43.839087+0000, chain.objs.size()=1 2024-09-12T17:41:32.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.856+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.nUi4bHBP_RBe7uH6qoXWvhbnbzRqJzv_0 2024-09-12T17:41:32.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.856+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5212374111970156174', time=2024-09-12T19:31:43.929104+0000, chain.objs.size()=1 2024-09-12T17:41:32.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.856+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.q-0gxCIjcuJOzt0QrJFzGbS-Boa0gO8_0 2024-09-12T17:41:32.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.856+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8632800257449295798', time=2024-09-12T19:31:44.070832+0000, chain.objs.size()=1 2024-09-12T17:41:32.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.856+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.TjawtAUrb5XTub3qqgaABon2aZOHYe6_0 2024-09-12T17:41:32.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.856+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13751389341667917425', time=2024-09-12T19:31:44.075009+0000, chain.objs.size()=1 2024-09-12T17:41:32.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.856+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Ll7EUmX62MvEhcOzOJ4LT0xrgBZq554_0 2024-09-12T17:41:32.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.856+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.567430237212641639', time=2024-09-12T19:31:44.116823+0000, chain.objs.size()=1 2024-09-12T17:41:32.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.856+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.6GAPZMdqW4ypqZfBej3Fxah46LX80UF_0 2024-09-12T17:41:32.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.856+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3611788461294894437', time=2024-09-12T19:31:44.142189+0000, chain.objs.size()=1 2024-09-12T17:41:32.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.856+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.7sJ9_RWylaCdY7i-bYIAzaFEK4wenyI_0 2024-09-12T17:41:32.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.856+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9370875978833862998', time=2024-09-12T19:31:44.165850+0000, chain.objs.size()=1 2024-09-12T17:41:32.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.856+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.ESspwGjmqCshAXeMT-MLQQolUh1vbXE_0 2024-09-12T17:41:32.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.856+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5520100535149203633', time=2024-09-12T19:31:44.182872+0000, chain.objs.size()=1 2024-09-12T17:41:32.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.856+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.7QA2W62lKwuPXPf17rqhwzF36LBic4y_0 2024-09-12T17:41:32.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.856+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14537629065775280683', time=2024-09-12T19:31:44.231768+0000, chain.objs.size()=1 2024-09-12T17:41:32.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.856+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.tBeQQ7ydXY8SZcRDiQ3_h-yGmMB1pVV_0 2024-09-12T17:41:32.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.856+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2101678819347985078', time=2024-09-12T19:31:44.369706+0000, chain.objs.size()=1 2024-09-12T17:41:32.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.856+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.i15lP89ZQQ_k-iLmwfc_5mqsFGDxqSg_0 2024-09-12T17:41:32.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.856+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16776698989768348515', time=2024-09-12T19:31:44.382201+0000, chain.objs.size()=1 2024-09-12T17:41:32.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.856+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.sx4DzIbyEZBC_zM8-i7bGYfitX4vJU8_0 2024-09-12T17:41:32.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.856+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13672558970196869152', time=2024-09-12T19:31:44.437728+0000, chain.objs.size()=1 2024-09-12T17:41:32.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.856+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.xfLUCHbpTzJWF3JHzhk8kb86gu47-Y6_0 2024-09-12T17:41:32.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.856+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.512391935214340721', time=2024-09-12T19:31:44.450394+0000, chain.objs.size()=1 2024-09-12T17:41:32.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.856+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.4f_o3mmdbm3o-BI1ely9OilwVIjawZz_0 2024-09-12T17:41:32.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.856+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.274260111127532601', time=2024-09-12T19:31:44.518647+0000, chain.objs.size()=1 2024-09-12T17:41:32.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.856+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.zCH3jAR51Ya5eJ6L3_uAWFutNEqnyJV_0 2024-09-12T17:41:32.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.856+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18020539086303782657', time=2024-09-12T19:31:44.529823+0000, chain.objs.size()=1 2024-09-12T17:41:32.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.856+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.fYhVBo8oMTm_ww-Q7fHBltc8wlEYCkq_0 2024-09-12T17:41:32.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.856+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18326622843436237326', time=2024-09-12T19:31:44.551284+0000, chain.objs.size()=1 2024-09-12T17:41:32.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.856+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.h-YQbJfSDE1k5k6QV0mDEvhJqMrTBCB_0 2024-09-12T17:41:32.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.860+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12691893250292321444', time=2024-09-12T19:31:54.615330+0000, chain.objs.size()=1 2024-09-12T17:41:32.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.860+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.289__shadow_.XVbu56P09URND9jUQNko2aeHHcpifBQ_0 2024-09-12T17:41:32.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.860+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3238139881696001870', time=2024-09-12T19:31:57.576363+0000, chain.objs.size()=1 2024-09-12T17:41:32.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.860+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.293__shadow_.lviJJqSlwRos5sMPD4STv_t6z8pyQY2_0 2024-09-12T17:41:32.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.860+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14915912176839597323', time=2024-09-12T19:31:57.974991+0000, chain.objs.size()=1 2024-09-12T17:41:32.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.860+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.294__shadow_.FGUDCx0cu5xPfK4QkuvZguCNioDLbU8_0 2024-09-12T17:41:32.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.860+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18228249247171491071', time=2024-09-12T19:32:02.874697+0000, chain.objs.size()=1 2024-09-12T17:41:32.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.860+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.306__shadow_.2whfxIieonotWxr5lWD7RpmpjGfEMjD_0 2024-09-12T17:41:32.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.860+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17454397957105653247', time=2024-09-12T19:32:27.886717+0000, chain.objs.size()=1 2024-09-12T17:41:32.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.860+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.rQKxWBVzLxEHKwTq2NjhWp6x1r1xMZ5_0 2024-09-12T17:41:32.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.860+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18059137185698147803', time=2024-09-12T19:32:27.979147+0000, chain.objs.size()=1 2024-09-12T17:41:32.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.860+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.q4c4dr752LoDMTrbTSGsu3cJuBNsc6b_0 2024-09-12T17:41:32.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.860+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9120317091467380880', time=2024-09-12T19:32:28.006021+0000, chain.objs.size()=1 2024-09-12T17:41:32.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.860+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.lECzEEYeThsUVgfquXwVZPX37FpDowU_0 2024-09-12T17:41:32.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.860+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15557645605458008179', time=2024-09-12T19:32:28.012125+0000, chain.objs.size()=1 2024-09-12T17:41:32.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.860+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.f0YpgDrsYWHiRnJd2hckKCAvmIkkQIO_0 2024-09-12T17:41:32.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.860+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11231945664817317868', time=2024-09-12T19:32:28.050084+0000, chain.objs.size()=1 2024-09-12T17:41:32.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.860+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.EWE9Pj5ICEjbyzpfdi_xmdT8AN43iP1_0 2024-09-12T17:41:32.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.860+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15061785390726941890', time=2024-09-12T19:32:28.192148+0000, chain.objs.size()=1 2024-09-12T17:41:32.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.860+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.PyZ4Dj4p3pvb0KdURsU9uZkBdzAnb5g_0 2024-09-12T17:41:32.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.860+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17334720213593154063', time=2024-09-12T19:32:28.212472+0000, chain.objs.size()=1 2024-09-12T17:41:32.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.860+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.5qmOtoeRiLN_rLdkWDiEo9kbVpyAK3M_0 2024-09-12T17:41:32.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.860+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.445508664966688239', time=2024-09-12T19:32:28.237098+0000, chain.objs.size()=1 2024-09-12T17:41:32.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.860+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.a5sfPW23D7OZ7mQEL65Mb-b5fheyBIu_0 2024-09-12T17:41:32.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.860+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12988535274720021308', time=2024-09-12T19:32:28.245883+0000, chain.objs.size()=1 2024-09-12T17:41:32.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.860+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Xq6qZEFAafosZlQMf4zBZl_tHghAsZi_0 2024-09-12T17:41:32.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.860+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6163849719362958293', time=2024-09-12T19:32:28.253817+0000, chain.objs.size()=1 2024-09-12T17:41:32.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.860+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.ghXJEIOsFqp3ozl8X3wyGshJn8rj_zV_0 2024-09-12T17:41:32.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.860+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11477688567667582871', time=2024-09-12T19:32:28.264410+0000, chain.objs.size()=1 2024-09-12T17:41:32.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.860+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.g9EoUWDCAb-50j2CJygxgAmVgGnUJVL_0 2024-09-12T17:41:32.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.860+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9092711437002466322', time=2024-09-12T19:32:28.279433+0000, chain.objs.size()=1 2024-09-12T17:41:32.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.860+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.QVRQU8KUkVnJ_DyqJI1NrS8g7Q5-KTw_0 2024-09-12T17:41:32.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.860+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17749856081713550611', time=2024-09-12T19:32:28.290686+0000, chain.objs.size()=1 2024-09-12T17:41:32.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.860+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.j7tdinmW743NCxxpGWQsIfk4eXOnjNb_0 2024-09-12T17:41:32.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.860+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6775450231230712076', time=2024-09-12T19:32:28.329939+0000, chain.objs.size()=1 2024-09-12T17:41:32.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.860+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Jtz0OOysRBVBehVV359QEfbKHZ23KiM_0 2024-09-12T17:41:32.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.860+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11207101444677576369', time=2024-09-12T19:32:28.390613+0000, chain.objs.size()=1 2024-09-12T17:41:32.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.860+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_._BGPARWD6H0ERBE0Yj52a0c9DcnVrqa_0 2024-09-12T17:41:32.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.860+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18395973402724481392', time=2024-09-12T19:32:28.742994+0000, chain.objs.size()=1 2024-09-12T17:41:32.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.860+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Km7GX-XRV4EugM9nM5-yDk42K30iZmE_0 2024-09-12T17:41:32.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.864+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14970314878833789313', time=2024-09-12T19:32:28.823438+0000, chain.objs.size()=1 2024-09-12T17:41:32.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.864+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Cfjh_xreUDdLLBrut6a3up1mla0_dUT_0 2024-09-12T17:41:32.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.864+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9642821636380526766', time=2024-09-12T19:32:28.827089+0000, chain.objs.size()=1 2024-09-12T17:41:32.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.864+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.4ShbbOxRnaC-VynAjIrQlPDpSMvJXa3_0 2024-09-12T17:41:32.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.864+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3638010902127945853', time=2024-09-12T19:32:28.855375+0000, chain.objs.size()=1 2024-09-12T17:41:32.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.864+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.nAsVU9gHJhOpH4Qg8oD5Uo5b4I-A0IH_0 2024-09-12T17:41:32.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.864+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.30199087682148974', time=2024-09-12T19:32:29.101373+0000, chain.objs.size()=1 2024-09-12T17:41:32.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.864+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.mHBb_Irl0rinUsWTp2teTg7Rp4QBVl9_0 2024-09-12T17:41:32.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.864+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6410085544434752163', time=2024-09-12T19:32:29.103204+0000, chain.objs.size()=1 2024-09-12T17:41:32.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.864+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.8Hv7OcktjDWkFCBVcownlLIT-Qe5GUP_0 2024-09-12T17:41:32.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.864+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17505420935771714883', time=2024-09-12T19:32:29.133466+0000, chain.objs.size()=1 2024-09-12T17:41:32.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.864+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.MjjEquBr_G0aQAJBzzW9b9Gh0ccB4ln_0 2024-09-12T17:41:32.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.864+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7209491211565167668', time=2024-09-12T19:32:29.171200+0000, chain.objs.size()=1 2024-09-12T17:41:32.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.864+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.jXelM4GAoQi5KBKSk3bX4MzEPPiCLIv_0 2024-09-12T17:41:32.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.864+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.590958950114802180', time=2024-09-12T19:32:29.374089+0000, chain.objs.size()=1 2024-09-12T17:41:32.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.864+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.OYyKAmzJ6HgAy7uxk6d-BA8bIKgchUN_0 2024-09-12T17:41:32.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.864+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2183409491113499202', time=2024-09-12T19:32:29.461256+0000, chain.objs.size()=1 2024-09-12T17:41:32.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.864+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.y12JvW7Kg771O-VaGsdQwR4duaFoY6X_0 2024-09-12T17:41:32.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.864+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11388923023722692171', time=2024-09-12T19:32:29.517895+0000, chain.objs.size()=1 2024-09-12T17:41:32.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.864+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Kaf0bbjQUJ8MYNaQ9Naeq_M68ADNGKA_0 2024-09-12T17:41:32.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.864+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15587240631327684177', time=2024-09-12T19:32:29.556313+0000, chain.objs.size()=1 2024-09-12T17:41:32.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.864+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.31CQShBBJHLlfs2NFgOZsdAoCYCfwKQ_0 2024-09-12T17:41:32.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.864+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13629524160636342546', time=2024-09-12T19:32:29.758027+0000, chain.objs.size()=1 2024-09-12T17:41:32.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.864+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_._eoH5me7o7fgxPnz0bnmZMN83tGcuCY_0 2024-09-12T17:41:32.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.864+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6857191805856026081', time=2024-09-12T19:32:29.820580+0000, chain.objs.size()=1 2024-09-12T17:41:32.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.864+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.eW-yhBTHpMyeKcHaAwvdIjTxWwEChKH_0 2024-09-12T17:41:32.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.864+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17532995915340141983', time=2024-09-12T19:32:29.828930+0000, chain.objs.size()=1 2024-09-12T17:41:32.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.864+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.54nkCfN81_vQmz9jRNU9r8vRStZPZ0i_0 2024-09-12T17:41:32.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.868+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11138420229068059220', time=2024-09-12T19:32:29.834178+0000, chain.objs.size()=1 2024-09-12T17:41:32.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.868+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.fEa76D9LuFdAw3RCy1YnzMowdecNzHi_0 2024-09-12T17:41:32.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.868+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6603349776846803638', time=2024-09-12T19:32:30.031623+0000, chain.objs.size()=1 2024-09-12T17:41:32.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.868+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.fyXQbwZ8k9q2IIKULsJfVuBmQO2Xwem_0 2024-09-12T17:41:32.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.868+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4510827635288409438', time=2024-09-12T19:32:30.037412+0000, chain.objs.size()=1 2024-09-12T17:41:32.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.868+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.RWgUhOccOWpQ1MJprEcTHBvUVijqZdV_0 2024-09-12T17:41:32.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.868+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15226881362210384155', time=2024-09-12T19:32:30.161696+0000, chain.objs.size()=1 2024-09-12T17:41:32.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.868+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.ewpnw8VPt9eQ3snYOU0FflCLxKyNeRP_0 2024-09-12T17:41:32.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.868+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11126968073011602216', time=2024-09-12T19:32:49.664869+0000, chain.objs.size()=1 2024-09-12T17:41:32.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.868+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.VlQ9SM6w-pDEyh4YmDuoKBYttn0e63m_0 2024-09-12T17:41:32.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.868+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12575764502536176239', time=2024-09-12T19:32:49.705266+0000, chain.objs.size()=1 2024-09-12T17:41:32.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.868+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.gPim5xtQHE1Jy6vpZuHGOUx-cxKx2Kv_0 2024-09-12T17:41:32.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.868+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16469188171339781350', time=2024-09-12T19:32:49.714965+0000, chain.objs.size()=1 2024-09-12T17:41:32.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.868+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.2CLpAneE3jHe3Lz_EbDObFvQp9z7F8f_0 2024-09-12T17:41:32.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.868+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10020899805034095451', time=2024-09-12T19:32:49.741072+0000, chain.objs.size()=1 2024-09-12T17:41:32.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.868+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.pOaymdz2exUv8pDen6pWBBBVYI2RX0h_0 2024-09-12T17:41:32.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.868+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2213832150772809100', time=2024-09-12T19:32:49.870645+0000, chain.objs.size()=1 2024-09-12T17:41:32.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.868+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.I4sYy79cUdhSt698EAOvqm9gh1BVwqt_0 2024-09-12T17:41:32.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.868+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8367538581245473865', time=2024-09-12T19:32:49.901629+0000, chain.objs.size()=1 2024-09-12T17:41:32.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.868+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.-fdOPD0QbRJYVVWl-lKWCMyT7ymQIjT_0 2024-09-12T17:41:32.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.868+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8437059894737270932', time=2024-09-12T19:32:49.902352+0000, chain.objs.size()=1 2024-09-12T17:41:32.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.868+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.qgR3CYo-mVPZ78zkHyayqgoZRHagxhD_0 2024-09-12T17:41:32.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.868+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10894797269945098963', time=2024-09-12T19:32:49.932270+0000, chain.objs.size()=1 2024-09-12T17:41:32.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.868+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Ul5bRboZMqNLhFgRDaCkFJoL8RBJsZP_0 2024-09-12T17:41:32.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.868+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11161250488922835623', time=2024-09-12T19:32:49.984302+0000, chain.objs.size()=1 2024-09-12T17:41:32.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.868+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.pW73S7pB1vCHABQWTyMimADjBC9h_Wh_0 2024-09-12T17:41:32.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.868+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7898670636867399491', time=2024-09-12T19:32:50.118445+0000, chain.objs.size()=1 2024-09-12T17:41:32.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.868+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.t50FKqdQZo9OsJC7lD-HtVpaScn9uzY_0 2024-09-12T17:41:32.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.868+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12241859872738408258', time=2024-09-12T19:32:50.193690+0000, chain.objs.size()=1 2024-09-12T17:41:32.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.868+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.UCxrFMwnx6_RTglpaBmFAz8GUJFwV7q_0 2024-09-12T17:41:32.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.868+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3291003667685469600', time=2024-09-12T19:32:50.258729+0000, chain.objs.size()=1 2024-09-12T17:41:32.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.868+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.INLw92DrE6L9voV5UliawuJLmZBrDqG_0 2024-09-12T17:41:32.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.872+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16079782985776169683', time=2024-09-12T19:32:50.260049+0000, chain.objs.size()=1 2024-09-12T17:41:32.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.872+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.N6jKrTX1hW7YjvWFLtpS2X9WNN-OGSP_0 2024-09-12T17:41:32.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.872+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16621902924383237068', time=2024-09-12T19:32:50.263215+0000, chain.objs.size()=1 2024-09-12T17:41:32.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.872+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.sQ6CMssr4J2UczLsxdiMubcweXJTmfc_0 2024-09-12T17:41:32.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.872+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3020999550265977603', time=2024-09-12T19:32:50.273086+0000, chain.objs.size()=1 2024-09-12T17:41:32.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.872+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.mrOmSgMWoXPl__z0072zuS6JyYYPUBi_0 2024-09-12T17:41:32.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.872+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/71605 2024-09-12T17:41:32.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.876+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=34, truncated=0, next_marker='' 2024-09-12T17:41:32.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.876+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11970195234953540423', time=2024-09-12T19:32:50.292060+0000, chain.objs.size()=1 2024-09-12T17:41:32.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.876+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.HZKpSVVG4ul5x00QR6vfXzEC5LJoczQ_0 2024-09-12T17:41:32.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.876+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17349072508881542943', time=2024-09-12T19:32:50.320284+0000, chain.objs.size()=1 2024-09-12T17:41:32.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.876+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.m0fiLpLtXByqZeS-YI2CFDVgXm-RVNq_0 2024-09-12T17:41:32.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.876+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15061714957007084396', time=2024-09-12T19:32:50.324483+0000, chain.objs.size()=1 2024-09-12T17:41:32.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.876+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.i0LfFrjABEFr90VCAarWUBKBUQozZNy_0 2024-09-12T17:41:32.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.876+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4332932921884390201', time=2024-09-12T19:32:50.595299+0000, chain.objs.size()=1 2024-09-12T17:41:32.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.876+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.ReFAGstz2p_LXCHBN00DOVaFmQfKvM__0 2024-09-12T17:41:32.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.876+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15488800035196304775', time=2024-09-12T19:32:50.638133+0000, chain.objs.size()=1 2024-09-12T17:41:32.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.876+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.6WSAb7o7A0JtVDk7CwKhDlbsA_6LpoG_0 2024-09-12T17:41:32.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.876+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2197601718160622821', time=2024-09-12T19:32:50.818943+0000, chain.objs.size()=1 2024-09-12T17:41:32.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.876+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.XJcqxbn9_xtgSetvZH6F0bv1hyRbXZM_0 2024-09-12T17:41:32.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.876+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.503297532790386389', time=2024-09-12T19:32:50.882894+0000, chain.objs.size()=1 2024-09-12T17:41:32.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.876+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.AcYSYN5YA69OgWj0mYcBwucnPpaNfC-_0 2024-09-12T17:41:32.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.876+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8455180516445796846', time=2024-09-12T19:32:50.968273+0000, chain.objs.size()=1 2024-09-12T17:41:32.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.876+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.bbwBYsYZpmaC9ueESCv6F-qgguUg3OH_0 2024-09-12T17:41:32.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.876+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12753003667804378631', time=2024-09-12T19:32:50.973665+0000, chain.objs.size()=1 2024-09-12T17:41:32.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.876+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.haMvGmJjP04bzMVC1jKKJcpI-7I_2ML_0 2024-09-12T17:41:32.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.876+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8894565339055317405', time=2024-09-12T19:32:50.987751+0000, chain.objs.size()=1 2024-09-12T17:41:32.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.876+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.mTMLNIua8AiZaHJJPtSnbxA00kF_4a5_0 2024-09-12T17:41:32.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.876+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11155706360018004805', time=2024-09-12T19:32:51.216546+0000, chain.objs.size()=1 2024-09-12T17:41:32.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.876+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.4YmxyJYp5jLFQmujdUsWtDvSIP_ujYu_0 2024-09-12T17:41:32.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.876+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8584709600456971502', time=2024-09-12T19:32:51.252439+0000, chain.objs.size()=1 2024-09-12T17:41:32.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.876+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.dzPnCICkLMApYnRH4aMvTmx9Mfrsjo0_0 2024-09-12T17:41:32.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.876+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18180073480441213479', time=2024-09-12T19:32:51.299382+0000, chain.objs.size()=1 2024-09-12T17:41:32.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.876+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.TxPlMv8JoEn_6ZSkDn0GfRKn05SoB83_0 2024-09-12T17:41:32.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.876+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4845358729623376092', time=2024-09-12T19:32:51.302896+0000, chain.objs.size()=1 2024-09-12T17:41:32.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.876+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.fccVfUIbO0dSR2WDU8CmENiPqH8W0fB_0 2024-09-12T17:41:32.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.876+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3304827186084799937', time=2024-09-12T19:32:51.343493+0000, chain.objs.size()=1 2024-09-12T17:41:32.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.876+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.0lGo9nRTJhhQ_AX9vOmR8e2rM7j0KoN_0 2024-09-12T17:41:32.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.876+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13843402258488036896', time=2024-09-12T19:32:51.379818+0000, chain.objs.size()=1 2024-09-12T17:41:32.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.876+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.BI9wDd_1QKeBeiZIMRdPvvAvkJiO_mg_0 2024-09-12T17:41:32.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.876+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17460000077112716877', time=2024-09-12T19:32:51.629081+0000, chain.objs.size()=1 2024-09-12T17:41:32.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.876+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Q-w69iecdiiq99K3TCXKjSmdPZodvCe_0 2024-09-12T17:41:32.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.876+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17689465336700853655', time=2024-09-12T19:32:51.676954+0000, chain.objs.size()=1 2024-09-12T17:41:32.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.876+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.vbpog4OnEEkmvFyCA9XlvQKVba-0Ndo_0 2024-09-12T17:41:32.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.876+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9283021917833793583', time=2024-09-12T19:32:51.706959+0000, chain.objs.size()=1 2024-09-12T17:41:32.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.876+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Jd87ZlBLaFiArxFR1mQpCZugC0J-S9J_0 2024-09-12T17:41:32.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.876+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5582806401615410305', time=2024-09-12T19:32:51.887923+0000, chain.objs.size()=1 2024-09-12T17:41:32.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.876+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.7i2SWdYWWdKzWWGKCBtj8uGBCL9eQ4-_0 2024-09-12T17:41:32.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.876+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16640600781328560276', time=2024-09-12T19:32:51.955221+0000, chain.objs.size()=1 2024-09-12T17:41:32.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.876+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.BSo007QWLit8RfST7LrXopiwjOX7W2j_0 2024-09-12T17:41:32.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.876+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5218291536583747882', time=2024-09-12T19:32:51.964920+0000, chain.objs.size()=1 2024-09-12T17:41:32.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.876+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.iRa-pEXeqj3n6ZvmkjZhKLWJeU_e-0i_0 2024-09-12T17:41:32.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.876+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10145244180848773346', time=2024-09-12T19:33:33.386937+0000, chain.objs.size()=1 2024-09-12T17:41:32.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.876+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.442__shadow_.6BdBO709AlUdNBNgvY-gx3NgNuPCj_O_0 2024-09-12T17:41:32.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.880+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9003778108847165926', time=2024-09-12T19:33:40.243799+0000, chain.objs.size()=1 2024-09-12T17:41:32.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.880+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.458__shadow_.RfonBEwzCMML2okOY6fzpZ_a16QkpAd_0 2024-09-12T17:41:32.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.880+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15326318918247115601', time=2024-09-12T19:34:02.558570+0000, chain.objs.size()=1 2024-09-12T17:41:32.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.880+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.514__shadow_.X3jKpcGd8eeAZqnjhKDvM2pRH4i7GHK_0 2024-09-12T17:41:32.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.880+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2434868969302488182', time=2024-09-12T19:34:03.316654+0000, chain.objs.size()=1 2024-09-12T17:41:32.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.880+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.516__multipart_mymultipartcopy.2~ycKBMArzzJcIVQllPFn3lcG4H28-YXf.1 2024-09-12T17:41:32.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.880+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.669982472071594179', time=2024-09-12T19:34:20.717518+0000, chain.objs.size()=2 2024-09-12T17:41:32.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.880+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.523__multipart_mymultipart.2~ACQ836S2Mrnb82i48VKUfkOZr9QNtnJ.1 2024-09-12T17:41:32.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.880+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.523__multipart_mymultipart.2~ACQ836S2Mrnb82i48VKUfkOZr9QNtnJ.2 2024-09-12T17:41:32.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.880+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4671196507299417872', time=2024-09-12T19:35:38.046607+0000, chain.objs.size()=1 2024-09-12T17:41:32.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.880+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.577__shadow:FbycD4mrxeF00fH3bWO45WBqirIrIly_.s3_dCYgghr0rWzWghDKFtwfwXolNU_C_0 2024-09-12T17:41:32.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.880+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14952770401431830569', time=2024-09-12T19:35:55.537292+0000, chain.objs.size()=1 2024-09-12T17:41:32.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.880+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.580__shadow:poCnLVLzAbdV6gjPIQFyco37HLje8y9_.n23XEbNh5XDaH_EAtK2tTLLFrN38shm_0 2024-09-12T17:41:32.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.880+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10989405344425299802', time=2024-09-12T19:38:42.769718+0000, chain.objs.size()=1 2024-09-12T17:41:32.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.880+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.664__shadow_.U2VaY9Br203h9-HxFcp9DiJS5_U5FlT_0 2024-09-12T17:41:32.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.880+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4343771676648904132', time=2024-09-12T19:38:45.792243+0000, chain.objs.size()=1 2024-09-12T17:41:32.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.880+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.672__shadow_.zN6UbV-wHrTiOGiN2MA2iJgHhehAZuT_0 2024-09-12T17:41:32.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.880+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16020109095742238622', time=2024-09-12T19:38:52.870801+0000, chain.objs.size()=1 2024-09-12T17:41:32.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.880+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.694__shadow:sKqi3.mtZA0ks.4ABbtcFWaKqqLb-eX_.0EL5rP_fcz8sZ5C4RhhiOuz7uqQuOWI_0 2024-09-12T17:41:32.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.880+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.686402638496320267', time=2024-09-12T19:39:11.645555+0000, chain.objs.size()=1 2024-09-12T17:41:32.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.880+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.716__shadow:pthxlKdhCx9R3pfLHG-zuRSBjKKxCz7_.wBiSgsE7WtvrN6aKFNz0_o77uchjtjx_0 2024-09-12T17:41:32.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.880+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1521190608992549866', time=2024-09-12T19:39:21.884212+0000, chain.objs.size()=1 2024-09-12T17:41:32.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.880+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.719__shadow_.UXSjbKc3IyTuLU3cXByTtAnpWRTkxeZ_0 2024-09-12T17:41:32.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.884+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:41:32.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.888+0000 7fd765adf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:41:32.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.888+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:41:32.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.888+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:41:32.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.888+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=99, truncated=0, next_marker='' 2024-09-12T17:41:32.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.888+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='_8qJ-7rCOHCRJB3jSl__D3RSMCk0Fp1T', time=2024-09-12T19:29:48.137131+0000, chain.objs.size()=3 2024-09-12T17:41:32.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.888+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.161__shadow_.MrqOybjTrkSjXJ129KGpsMjQPo9VMHc_0 2024-09-12T17:41:32.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.888+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.161__shadow_.MrqOybjTrkSjXJ129KGpsMjQPo9VMHc_1 2024-09-12T17:41:32.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.888+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.161__shadow_.MrqOybjTrkSjXJ129KGpsMjQPo9VMHc_2 2024-09-12T17:41:32.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.888+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14833398436213849955', time=2024-09-12T19:29:56.522683+0000, chain.objs.size()=1 2024-09-12T17:41:32.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.888+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.178__shadow_.anOO9Qe_wpCzEB7fKoi679epDgs_pdO_0 2024-09-12T17:41:32.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.888+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9501022211525254406', time=2024-09-12T19:29:59.783691+0000, chain.objs.size()=1 2024-09-12T17:41:32.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.888+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.189__shadow_.1S9sZJzxvDX0H507WPyS3SA-FJS2xO8_0 2024-09-12T17:41:32.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.888+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2489592681811928677', time=2024-09-12T19:31:12.595259+0000, chain.objs.size()=1 2024-09-12T17:41:32.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.888+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.235__shadow_.QaguI9V0Mh_MsRnFzlkFaZW-cEeGqce_0 2024-09-12T17:41:32.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.888+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15307863368072922095', time=2024-09-12T19:31:17.947689+0000, chain.objs.size()=1 2024-09-12T17:41:32.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.888+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.248__shadow_.OSb6DWdm_ITawrQW8oftDjGXMQLUKRk_0 2024-09-12T17:41:32.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.888+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2783606986030161527', time=2024-09-12T19:31:21.362139+0000, chain.objs.size()=1 2024-09-12T17:41:32.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.888+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.257__shadow_.FomOxgMEvr_69O6Eyjf9uZc9-HqOU06_0 2024-09-12T17:41:32.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.888+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1000241189417564291', time=2024-09-12T19:31:42.245969+0000, chain.objs.size()=1 2024-09-12T17:41:32.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.888+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Tjn2X1vBzf9VyG8C_niVwMGhy7Qj0zj_0 2024-09-12T17:41:32.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.888+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4598811379545851423', time=2024-09-12T19:31:42.393128+0000, chain.objs.size()=1 2024-09-12T17:41:32.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.888+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.59K_iP5EsJPSfinfMsEe43trIA-udSQ_0 2024-09-12T17:41:32.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.888+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11099397362674075680', time=2024-09-12T19:31:42.534007+0000, chain.objs.size()=1 2024-09-12T17:41:32.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.888+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.G2hLTXQxrXyi5ZEN6rnrEbjFOYxL-Jo_0 2024-09-12T17:41:32.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.888+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4660393020934843560', time=2024-09-12T19:31:42.614803+0000, chain.objs.size()=1 2024-09-12T17:41:32.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.888+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.7e1oTt-A1QYgFVYJGKYUnD8cJ6Cuauw_0 2024-09-12T17:41:32.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.892+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9110225387685485671', time=2024-09-12T19:31:42.672965+0000, chain.objs.size()=1 2024-09-12T17:41:32.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.892+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.jNQXSIKRL5ZFu078dF38URxLCmnwlBd_0 2024-09-12T17:41:32.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.892+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11815911236756479532', time=2024-09-12T19:31:42.799410+0000, chain.objs.size()=1 2024-09-12T17:41:33.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.892+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.MEfSP1LIHBcnsgCRS5avc6cRyAzG_ua_0 2024-09-12T17:41:33.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.892+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4521711309319915576', time=2024-09-12T19:31:42.827703+0000, chain.objs.size()=1 2024-09-12T17:41:33.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.892+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.sXccbaVtKwQ24YsV3ftoqf6jLSH_oba_0 2024-09-12T17:41:33.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.892+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5195074073807276961', time=2024-09-12T19:31:42.865879+0000, chain.objs.size()=1 2024-09-12T17:41:33.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.892+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.O4hpz-Uip9sA2k6UgXgCaADRJSQjBAA_0 2024-09-12T17:41:33.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.892+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10733795819463118973', time=2024-09-12T19:31:42.876395+0000, chain.objs.size()=1 2024-09-12T17:41:33.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.892+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.RZei2dCqD_KgegWxir3IU8_z-HRj7ur_0 2024-09-12T17:41:33.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.892+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9736659713835751772', time=2024-09-12T19:31:42.880119+0000, chain.objs.size()=1 2024-09-12T17:41:33.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.892+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.VUsPgFH9rBzq9QNS4rkiuSwtjh45l9p_0 2024-09-12T17:41:33.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.892+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3525429966855405024', time=2024-09-12T19:31:42.918675+0000, chain.objs.size()=1 2024-09-12T17:41:33.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.892+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.qfD71D_8skyKsmU1DzKKmJlcIUNJw8i_0 2024-09-12T17:41:33.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.892+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7623298262240175564', time=2024-09-12T19:31:42.933411+0000, chain.objs.size()=1 2024-09-12T17:41:33.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.892+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.QOgjEiPAuy641ozGfTYtl_45JL_epCQ_0 2024-09-12T17:41:33.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.892+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14708406805910087895', time=2024-09-12T19:31:43.229786+0000, chain.objs.size()=1 2024-09-12T17:41:33.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.892+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.hVoQrafFSPw4TCuADwie3rM_wblPqgt_0 2024-09-12T17:41:33.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.892+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17718484246181451566', time=2024-09-12T19:31:43.231841+0000, chain.objs.size()=1 2024-09-12T17:41:33.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.892+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.w87Q_gGJtkcM6RBGf7LQjIPzZ4lRWD0_0 2024-09-12T17:41:33.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.892+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18021028426494539114', time=2024-09-12T19:31:43.259249+0000, chain.objs.size()=1 2024-09-12T17:41:33.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.892+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.qNyHY9aNzK30eJX8r-gG9T1khsdSokV_0 2024-09-12T17:41:33.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.892+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5428097533338692470', time=2024-09-12T19:31:43.448681+0000, chain.objs.size()=1 2024-09-12T17:41:33.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.892+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.hWbYWWXt_EJYz4MgDRVCyDpxjx_-RoP_0 2024-09-12T17:41:33.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.896+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4684561854329566594', time=2024-09-12T19:31:43.616711+0000, chain.objs.size()=1 2024-09-12T17:41:33.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.896+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.nlnJ5TvEf36CsdLQRRP-XmaknVUVq9j_0 2024-09-12T17:41:33.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.896+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14559318805319405186', time=2024-09-12T19:31:43.793628+0000, chain.objs.size()=1 2024-09-12T17:41:33.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.896+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.tMGBjVQhb4q2w4Tmo-C7n7NwdH4NCO3_0 2024-09-12T17:41:33.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.896+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12726296323516523462', time=2024-09-12T19:31:43.884385+0000, chain.objs.size()=1 2024-09-12T17:41:33.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.896+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.X3x-pNjDWLF_XOUEDuCEQ7Wkc83Tud3_0 2024-09-12T17:41:33.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.896+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5600924910183490467', time=2024-09-12T19:31:44.115330+0000, chain.objs.size()=1 2024-09-12T17:41:33.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.896+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.cGokKChnncuzjAcFblv2emJiXWftN5q_0 2024-09-12T17:41:33.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.896+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15887865474520783521', time=2024-09-12T19:31:44.173873+0000, chain.objs.size()=1 2024-09-12T17:41:33.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.896+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.SVhLvn9GsXVdGcGXTSUxKy6eU7Hs4Q6_0 2024-09-12T17:41:33.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.896+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1212216088615141119', time=2024-09-12T19:31:44.202113+0000, chain.objs.size()=1 2024-09-12T17:41:33.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.896+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.SNTZI8WNdUhYwyski-ULdoEJMtMctqM_0 2024-09-12T17:41:33.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.896+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2079519543862281684', time=2024-09-12T19:31:44.376013+0000, chain.objs.size()=1 2024-09-12T17:41:33.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.896+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.oenYgYYWzjY7oGnQVLC0R7cOawz3FPc_0 2024-09-12T17:41:33.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.896+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13725600275016316833', time=2024-09-12T19:31:44.385890+0000, chain.objs.size()=1 2024-09-12T17:41:33.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.896+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.zKHOxMt67Nb5j4F2DOfm1dLIA2wHL6K_0 2024-09-12T17:41:33.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.896+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.229124696081280514', time=2024-09-12T19:31:44.539096+0000, chain.objs.size()=1 2024-09-12T17:41:33.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.896+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.IxhbLqaH0dVW4shqulqaUFlKfDr54HK_0 2024-09-12T17:41:33.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.896+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17171291484151505526', time=2024-09-12T19:31:45.109946+0000, chain.objs.size()=1 2024-09-12T17:41:33.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.896+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.264__shadow_.ljiuRQiF9jRl_Utqlil6eue02XxQChW_0 2024-09-12T17:41:33.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.896+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4021543378332398178', time=2024-09-12T19:31:49.168796+0000, chain.objs.size()=1 2024-09-12T17:41:33.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.896+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.275__shadow_.u-ZC6R2EOTEZ8ZbKGPCwGktb_7QQAoh_0 2024-09-12T17:41:33.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.896+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6638584306411429090', time=2024-09-12T19:31:51.445270+0000, chain.objs.size()=1 2024-09-12T17:41:33.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.896+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.281__shadow_.7Wk-FduXs_Qkg8rCwt6HKfo_Ua2_I9T_0 2024-09-12T17:41:33.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.896+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10444129578739831390', time=2024-09-12T19:31:56.477096+0000, chain.objs.size()=1 2024-09-12T17:41:33.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.896+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.292__shadow_.vwN0ldoT5_ndsmrkIFyPBKMxyWz-DSl_0 2024-09-12T17:41:33.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.896+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1647065858422755536', time=2024-09-12T19:31:57.558078+0000, chain.objs.size()=1 2024-09-12T17:41:33.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.896+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.293__shadow_.lYI4EIa70x3WRFwKDNH5wEPDZ3papnL_0 2024-09-12T17:41:33.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.896+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9414386726034818888', time=2024-09-12T19:32:27.925610+0000, chain.objs.size()=1 2024-09-12T17:41:33.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.896+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.n45pvvxm7q1-74sQFqOWS_J42C1Ucu-_0 2024-09-12T17:41:33.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.896+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3153010202048272646', time=2024-09-12T19:32:28.089621+0000, chain.objs.size()=1 2024-09-12T17:41:33.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.896+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.4pdDrQdkpc32DqQpKeJgnMpSLV4ZTqo_0 2024-09-12T17:41:33.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.900+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7323150198507683080', time=2024-09-12T19:32:28.230955+0000, chain.objs.size()=1 2024-09-12T17:41:33.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.900+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.tM6foUzpJ9Mcc59symck4Ak0GXnzeiQ_0 2024-09-12T17:41:33.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.900+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.675371319513669473', time=2024-09-12T19:32:28.429959+0000, chain.objs.size()=1 2024-09-12T17:41:33.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.900+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Z9n-psWUlaFYbTXvMCBXM0vBVLWQlwX_0 2024-09-12T17:41:33.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.900+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9714441379940090425', time=2024-09-12T19:32:28.790039+0000, chain.objs.size()=1 2024-09-12T17:41:33.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.900+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.X1KVUXPKHNHXXz4wHJ1UmxAwKDclzQX_0 2024-09-12T17:41:33.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.900+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3720139804229980650', time=2024-09-12T19:32:28.799333+0000, chain.objs.size()=1 2024-09-12T17:41:33.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.900+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.vsGzwMMtF-orVYZoZJhv6txoXjo3vdj_0 2024-09-12T17:41:33.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.900+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7548659818096153546', time=2024-09-12T19:32:28.863292+0000, chain.objs.size()=1 2024-09-12T17:41:33.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.900+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.I6Wl-muW7D_IRH8xgErsxBExR9hBtp3_0 2024-09-12T17:41:33.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.900+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14191001477200421647', time=2024-09-12T19:32:29.245268+0000, chain.objs.size()=1 2024-09-12T17:41:33.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.900+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.iPe5yKpnLIZqx2BkdGzicwLZDSlVidO_0 2024-09-12T17:41:33.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.900+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15244050426468118545', time=2024-09-12T19:32:29.436511+0000, chain.objs.size()=1 2024-09-12T17:41:33.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.900+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.l7AgQTIZ2lkDqgBvyQ2MZLVRsQKd654_0 2024-09-12T17:41:33.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.900+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3537738881102639514', time=2024-09-12T19:32:29.458568+0000, chain.objs.size()=1 2024-09-12T17:41:33.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.900+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.z3vON6srDMA2GhmMsMWjZBDAAGg1ABi_0 2024-09-12T17:41:33.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.900+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9176966164835563438', time=2024-09-12T19:32:29.510297+0000, chain.objs.size()=1 2024-09-12T17:41:33.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.900+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.k-65p0NlJZHBNXM3HR6IXYefGxOUZ2f_0 2024-09-12T17:41:33.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.900+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7625596865120200804', time=2024-09-12T19:32:29.540492+0000, chain.objs.size()=1 2024-09-12T17:41:33.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.900+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.tG8fQiK-jA9E_oH6AEeuMxxgQz8uYy2_0 2024-09-12T17:41:33.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.900+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3643973250303530674', time=2024-09-12T19:32:29.557616+0000, chain.objs.size()=1 2024-09-12T17:41:33.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.900+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.God57b1K3EgTW9SRLVZ26WrthzfCuKS_0 2024-09-12T17:41:33.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.900+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5604955768534006751', time=2024-09-12T19:32:29.558350+0000, chain.objs.size()=1 2024-09-12T17:41:33.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.900+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.8URmHg3DERxGX_cvAnoSD5ET9cEYCU4_0 2024-09-12T17:41:33.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.900+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12181045327101296758', time=2024-09-12T19:32:29.681780+0000, chain.objs.size()=1 2024-09-12T17:41:33.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.900+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.KAHQfArs6LMuxdS3vmjOyj7lWh1IJpS_0 2024-09-12T17:41:33.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.900+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6478224252037297481', time=2024-09-12T19:32:29.687793+0000, chain.objs.size()=1 2024-09-12T17:41:33.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.900+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.-4OdtMUDxlp6e4F4F965KDLVWtRLyCm_0 2024-09-12T17:41:33.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.900+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1107630022649548680', time=2024-09-12T19:32:29.765014+0000, chain.objs.size()=1 2024-09-12T17:41:33.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.900+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.ezO6MWlR_IPLVP9GWFf-Rn9-S-NgVdx_0 2024-09-12T17:41:33.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.900+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11386304840562736930', time=2024-09-12T19:32:29.780617+0000, chain.objs.size()=1 2024-09-12T17:41:33.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.900+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.nUfKx163Nhf3gUMqJR1da2jHv3obcmj_0 2024-09-12T17:41:33.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.900+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9569760144769252544', time=2024-09-12T19:32:29.824449+0000, chain.objs.size()=1 2024-09-12T17:41:33.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.900+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.WEZcjf2JSocgk2LzJL_q2vfmkyLf6vV_0 2024-09-12T17:41:33.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.900+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15895370668626904786', time=2024-09-12T19:32:30.129396+0000, chain.objs.size()=1 2024-09-12T17:41:33.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.900+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.6x4nktj80Sxs2kuu1kX3k8FsLemLxVg_0 2024-09-12T17:41:33.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.900+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5720278765530150932', time=2024-09-12T19:32:49.518753+0000, chain.objs.size()=1 2024-09-12T17:41:33.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.900+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.wK_YpfNBbE_-ukbnaAkEfrnMBchZLmP_0 2024-09-12T17:41:33.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.900+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5583964187829704325', time=2024-09-12T19:32:49.619748+0000, chain.objs.size()=1 2024-09-12T17:41:33.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.900+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.OILzPvG-txNoV-miZxWI0vx_g3yrKlw_0 2024-09-12T17:41:33.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.900+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11343146972783752065', time=2024-09-12T19:32:49.659402+0000, chain.objs.size()=1 2024-09-12T17:41:33.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.900+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.m0Zq7yCuDNtWwgmBy_azVNuVo_UjEKJ_0 2024-09-12T17:41:33.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.900+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6396643067778333493', time=2024-09-12T19:32:49.670889+0000, chain.objs.size()=1 2024-09-12T17:41:33.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.904+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.jQ4mvLYwFrZ4f4mVHmTsxXk3OTDE4ZY_0 2024-09-12T17:41:33.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.904+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4740507528956838561', time=2024-09-12T19:32:49.690291+0000, chain.objs.size()=1 2024-09-12T17:41:33.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.904+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.2hsQ8TuLDESB9nXI_GtsVNWq3h4DA6D_0 2024-09-12T17:41:33.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.904+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5977014126194869241', time=2024-09-12T19:32:49.873670+0000, chain.objs.size()=1 2024-09-12T17:41:33.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.904+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.MOlur_-iIOG3CdY1tqoho80GlJWDX0F_0 2024-09-12T17:41:33.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.904+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8227300271107108426', time=2024-09-12T19:32:49.898524+0000, chain.objs.size()=1 2024-09-12T17:41:33.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.904+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.4OrmaUBIkEoyT4RykRm4Qzt4QpY_i4N_0 2024-09-12T17:41:33.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.904+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15219294945342112718', time=2024-09-12T19:32:49.909196+0000, chain.objs.size()=1 2024-09-12T17:41:33.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.904+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.9LfPPUATwD3huy-J-Sei9eFF9Hd2zl0_0 2024-09-12T17:41:33.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.904+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12888541322790888480', time=2024-09-12T19:32:49.951850+0000, chain.objs.size()=1 2024-09-12T17:41:33.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.904+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.AVKQW2e5pXkdWScPOCucVGrA9q0XxLb_0 2024-09-12T17:41:33.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.904+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15866329107311511825', time=2024-09-12T19:32:50.141588+0000, chain.objs.size()=1 2024-09-12T17:41:33.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.904+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.B_1BgOSPZkWDS85I4bFYRfFa4gKB3Td_0 2024-09-12T17:41:33.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.904+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3661964450749739284', time=2024-09-12T19:32:50.231126+0000, chain.objs.size()=1 2024-09-12T17:41:33.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.904+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.34y1cQSoM5zicwAlLWvDLkGy4Y7-xyx_0 2024-09-12T17:41:33.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.904+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17270191742017380925', time=2024-09-12T19:32:50.251774+0000, chain.objs.size()=1 2024-09-12T17:41:33.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.904+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.JW227r4EvpvbYtHWgJFEQmvC238XBgR_0 2024-09-12T17:41:33.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.904+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16242738837765534461', time=2024-09-12T19:32:50.280497+0000, chain.objs.size()=1 2024-09-12T17:41:33.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.904+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.GWO1uNvmv1rTLVRa8cDuGnPHQbaEuFq_0 2024-09-12T17:41:33.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.904+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14124277935888979658', time=2024-09-12T19:32:50.497894+0000, chain.objs.size()=1 2024-09-12T17:41:33.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.904+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.YYLA_GdaHFswwWL3fvXVbw8M9iYoO-Z_0 2024-09-12T17:41:33.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.904+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.824783094452666892', time=2024-09-12T19:32:50.499477+0000, chain.objs.size()=1 2024-09-12T17:41:33.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.904+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.MZSNxnEeXDcG1vIY5h134q3y9lFYR1L_0 2024-09-12T17:41:33.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.904+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16771474192033395150', time=2024-09-12T19:32:50.616537+0000, chain.objs.size()=1 2024-09-12T17:41:33.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.904+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.N5GYAIef8kwkoJNJ5iv6tIjomRtQg0R_0 2024-09-12T17:41:33.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.904+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10946590108196107440', time=2024-09-12T19:32:50.624900+0000, chain.objs.size()=1 2024-09-12T17:41:33.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.904+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Mz4jcQVIrbrUYrM4DicVLFwWnF49pu3_0 2024-09-12T17:41:33.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.904+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9161164074811266604', time=2024-09-12T19:32:50.826107+0000, chain.objs.size()=1 2024-09-12T17:41:33.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.904+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.mbAEhtKlizRih4UA3pqgspwioNMuK6f_0 2024-09-12T17:41:33.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.908+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8393111413928961434', time=2024-09-12T19:32:50.923729+0000, chain.objs.size()=1 2024-09-12T17:41:33.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.908+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.PByEA-3DzOB9roF2q_Eq6x_7D2pNq0s_0 2024-09-12T17:41:33.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.908+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8007889048142938043', time=2024-09-12T19:32:50.939733+0000, chain.objs.size()=1 2024-09-12T17:41:33.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.908+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.gCHkia2I8uTXF87AYLLO9gfuKlEI9cJ_0 2024-09-12T17:41:33.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.908+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11320003852177963098', time=2024-09-12T19:32:50.944005+0000, chain.objs.size()=1 2024-09-12T17:41:33.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.908+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.HEY5g5pfnKirNcViZTVgE2oxrlm3wAf_0 2024-09-12T17:41:33.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.908+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4084881430276993508', time=2024-09-12T19:32:50.944663+0000, chain.objs.size()=1 2024-09-12T17:41:33.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.908+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Fg4Dz_fPz8d7KlkqSv_gtQOoSuKYQ5k_0 2024-09-12T17:41:33.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.908+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10494686878375144529', time=2024-09-12T19:32:50.973421+0000, chain.objs.size()=1 2024-09-12T17:41:33.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.908+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.X2o0M6i8iXV6EKwlN_FvFQjM9hr6Ag6_0 2024-09-12T17:41:33.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.908+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12737176114867193770', time=2024-09-12T19:32:51.229640+0000, chain.objs.size()=1 2024-09-12T17:41:33.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.908+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.dY7xp3UqzFg9PxzVXxhiHc1GDPb8oGH_0 2024-09-12T17:41:33.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.908+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7618275359612827347', time=2024-09-12T19:32:51.341586+0000, chain.objs.size()=1 2024-09-12T17:41:33.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.908+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.vEHRegfIsXM5AnN1xCZROBH-p6ZvdLy_0 2024-09-12T17:41:33.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.908+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2049806152062637232', time=2024-09-12T19:32:51.587482+0000, chain.objs.size()=1 2024-09-12T17:41:33.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.908+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.0jouPcHbfuwmbvXXHThgMN5gl0Eg8u6_0 2024-09-12T17:41:33.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.908+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3761347299212430555', time=2024-09-12T19:32:51.599606+0000, chain.objs.size()=1 2024-09-12T17:41:33.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.908+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.3FXorUuEaN0p9Vkx2ZTSLhhwOivcgmb_0 2024-09-12T17:41:33.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.908+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2966562844749612811', time=2024-09-12T19:32:51.706783+0000, chain.objs.size()=1 2024-09-12T17:41:33.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.908+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.VLWlCdCjwlxSSLwamn6M0dUzS_AEulf_0 2024-09-12T17:41:33.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.908+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13535260641866356904', time=2024-09-12T19:32:51.894050+0000, chain.objs.size()=1 2024-09-12T17:41:33.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.908+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.l1NiyH3JDa95wDIorFkBO03sCcPOhNg_0 2024-09-12T17:41:33.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.908+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1139123516229810628', time=2024-09-12T19:32:51.952228+0000, chain.objs.size()=1 2024-09-12T17:41:33.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.908+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.rCkOZ4M0ZUVhLD8UgYImKVsbfnnLpnK_0 2024-09-12T17:41:33.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.908+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10054045018522876843', time=2024-09-12T19:32:51.979646+0000, chain.objs.size()=1 2024-09-12T17:41:33.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.908+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.d1Uq_8Yhq4nZ-KB02XDVyIdXCTbl_Rr_0 2024-09-12T17:41:33.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.908+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7097688558374350346', time=2024-09-12T19:32:51.985914+0000, chain.objs.size()=1 2024-09-12T17:41:33.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.908+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.k7CEURqO904ZFn94p2ohkry6gOfx-Op_0 2024-09-12T17:41:33.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.908+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8138803701593972782', time=2024-09-12T19:32:51.987656+0000, chain.objs.size()=1 2024-09-12T17:41:33.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.908+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.EDkiPVHWgRtneZiyFx_UfshAPQHUBeH_0 2024-09-12T17:41:33.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.908+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8950628018097287430', time=2024-09-12T19:33:39.676183+0000, chain.objs.size()=1 2024-09-12T17:41:33.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.908+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.457__shadow_.DCm7hAxGJVoe-Qc92OTgBNk0J5Q6uDg_0 2024-09-12T17:41:33.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.908+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13079363421982638007', time=2024-09-12T19:33:55.886441+0000, chain.objs.size()=1 2024-09-12T17:41:33.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.908+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.500__shadow_.vcrNgBTm03A6jfUQ1BA-4QkK9biseU3_0 2024-09-12T17:41:33.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.908+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3329942727874274815', time=2024-09-12T19:34:05.368316+0000, chain.objs.size()=1 2024-09-12T17:41:33.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.908+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.517__shadow_.5-EFyPPIgmDwhJxIrpBCs2rLK_hQcio_0 2024-09-12T17:41:33.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.908+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3780295801673159270', time=2024-09-12T19:35:21.121647+0000, chain.objs.size()=1 2024-09-12T17:41:33.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.908+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.569__shadow:nVMd9ZinD714PRCndVn9ZduooiofxW3_.adF_IYnbQ17bReHr4ALAzZLw2eP13k2_0 2024-09-12T17:41:33.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.908+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5485649834659971787', time=2024-09-12T19:35:33.418192+0000, chain.objs.size()=1 2024-09-12T17:41:33.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.908+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.576__shadow:QXZAs.cj5Gj2OegbGA2fnEd0DxvNdWn_.tKmn9KER_j_z24arS6DTy_I4ALDX1Ay_0 2024-09-12T17:41:33.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.912+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13434297424197697114', time=2024-09-12T19:35:40.611924+0000, chain.objs.size()=1 2024-09-12T17:41:33.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.912+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.577__shadow:T1Kp7rblrLb5zPT5n6r4J7TsGl41FGC_.QeCt0yJIjjzHH8g9B-TEO8JjHrzaxE4_0 2024-09-12T17:41:33.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.912+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13913963773954307615', time=2024-09-12T19:35:45.369391+0000, chain.objs.size()=1 2024-09-12T17:41:33.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.912+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.577__shadow:J3R9TJRid-QKlv0oBNEavv3I9WkUvBn_.WiJRb8aHQ-aonMB6h8cBVCIapQx0gJz_0 2024-09-12T17:41:33.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.912+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17331955439904776589', time=2024-09-12T19:35:54.176001+0000, chain.objs.size()=1 2024-09-12T17:41:33.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.912+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.579__shadow:RUNHqGbCuk74vhZULfj0szvyS7zQX4k_.KYWqEHE0W-p9jud2ie6lXF3gmuo3O8h_0 2024-09-12T17:41:33.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.912+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12138459321512958975', time=2024-09-12T19:35:59.116584+0000, chain.objs.size()=1 2024-09-12T17:41:33.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.912+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.587__shadow:1JDcnqlkberfyIDVrJRJKpoWk9S4qaK_.FBEa7L_Eeh6hCeImJ0HHFepdJ9kP5A0_0 2024-09-12T17:41:33.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.912+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~y2geowdYVvFBtctmnGWhPS88WFdLr-2', time=2024-09-12T19:38:21.830908+0000, chain.objs.size()=12 2024-09-12T17:41:33.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.912+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.624__multipart_multipart_enc.2~y2geowdYVvFBtctmnGWhPS88WFdLr-2.1 2024-09-12T17:41:33.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.912+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.624__shadow_multipart_enc.2~y2geowdYVvFBtctmnGWhPS88WFdLr-2.1_1 2024-09-12T17:41:33.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.912+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.624__multipart_multipart_enc.2~y2geowdYVvFBtctmnGWhPS88WFdLr-2.2 2024-09-12T17:41:33.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.912+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.624__shadow_multipart_enc.2~y2geowdYVvFBtctmnGWhPS88WFdLr-2.2_1 2024-09-12T17:41:33.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.912+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.624__multipart_multipart_enc.2~y2geowdYVvFBtctmnGWhPS88WFdLr-2.3 2024-09-12T17:41:33.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.912+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.624__shadow_multipart_enc.2~y2geowdYVvFBtctmnGWhPS88WFdLr-2.3_1 2024-09-12T17:41:33.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.912+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.624__multipart_multipart_enc.2~y2geowdYVvFBtctmnGWhPS88WFdLr-2.4 2024-09-12T17:41:33.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.912+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.624__shadow_multipart_enc.2~y2geowdYVvFBtctmnGWhPS88WFdLr-2.4_1 2024-09-12T17:41:33.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.912+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.624__multipart_multipart_enc.2~y2geowdYVvFBtctmnGWhPS88WFdLr-2.5 2024-09-12T17:41:33.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.916+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.624__shadow_multipart_enc.2~y2geowdYVvFBtctmnGWhPS88WFdLr-2.5_1 2024-09-12T17:41:33.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.916+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.624__multipart_multipart_enc.2~y2geowdYVvFBtctmnGWhPS88WFdLr-2.6 2024-09-12T17:41:33.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.916+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.624__shadow_multipart_enc.2~y2geowdYVvFBtctmnGWhPS88WFdLr-2.6_1 2024-09-12T17:41:33.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.916+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:41:33.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.920+0000 7fd765adf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:41:33.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.920+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:41:33.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.920+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:41:33.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.924+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/80310' 2024-09-12T17:41:33.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.924+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8020265037419321535', time=2024-09-12T19:29:42.047879+0000, chain.objs.size()=1 2024-09-12T17:41:33.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.924+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.158__shadow_.KlrzTEB6mkbVpv-iF0RcAy5psaUPG5N_0 2024-09-12T17:41:33.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.924+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='_kuBvsx3PBygJXRlDX9_UhXIstbLUcpc', time=2024-09-12T19:29:44.834520+0000, chain.objs.size()=3 2024-09-12T17:41:33.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.924+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.160__shadow_.iXkHWoA9JTM1w19ztq-PaokoZOXEAMC_0 2024-09-12T17:41:33.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.924+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.160__shadow_.iXkHWoA9JTM1w19ztq-PaokoZOXEAMC_1 2024-09-12T17:41:33.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.924+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.160__shadow_.iXkHWoA9JTM1w19ztq-PaokoZOXEAMC_2 2024-09-12T17:41:33.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.924+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17005117890498196084', time=2024-09-12T19:29:56.855554+0000, chain.objs.size()=1 2024-09-12T17:41:33.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.924+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.179__shadow_._pw_J3KAZkN4d5Jjd8rRjzyGdhUeoRH_0 2024-09-12T17:41:33.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.924+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5323882619876408827', time=2024-09-12T19:29:57.478713+0000, chain.objs.size()=1 2024-09-12T17:41:33.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.924+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.181__shadow_.c1vy1GAo8pVPxRTfo9kxcI309dZSERl_0 2024-09-12T17:41:33.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.924+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3134184792166043050', time=2024-09-12T19:29:59.426647+0000, chain.objs.size()=1 2024-09-12T17:41:33.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.924+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.188__shadow_.NzNL7Pgk4Qut1WwEonoItwQnq_JyYgM_0 2024-09-12T17:41:33.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.924+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13990193741421651034', time=2024-09-12T19:31:11.800772+0000, chain.objs.size()=1 2024-09-12T17:41:33.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.924+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.233__shadow_.BGkolspSGl54WaPJ7RPgW-TzxjAU6XB_0 2024-09-12T17:41:33.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.924+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7580991292123231948', time=2024-09-12T19:31:15.029834+0000, chain.objs.size()=1 2024-09-12T17:41:33.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.924+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.241__shadow_.iQs7iU7_4fUQC6x-luz4s1aipQSoy4r_0 2024-09-12T17:41:33.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.924+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17823508896164593807', time=2024-09-12T19:31:16.409398+0000, chain.objs.size()=1 2024-09-12T17:41:33.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.924+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.244__shadow_.TSJM1-nOiz6xl1ZKU71Ev6xlWA2scdj_0 2024-09-12T17:41:33.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.924+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16461756423896653138', time=2024-09-12T19:31:17.191435+0000, chain.objs.size()=1 2024-09-12T17:41:33.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.924+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.246__shadow_.o68_hti2YreoD461OV-9jyUZjyCpyFh_0 2024-09-12T17:41:33.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.924+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2939154927831426393', time=2024-09-12T19:31:17.568216+0000, chain.objs.size()=1 2024-09-12T17:41:33.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.924+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.247__shadow_.mktf1NhG3a0giB8VS5IvcRj4q54gEUv_0 2024-09-12T17:41:33.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.924+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10304973608829845175', time=2024-09-12T19:31:22.905852+0000, chain.objs.size()=1 2024-09-12T17:41:33.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.924+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.261__shadow_.kOL8-eHb_thR8KMBJyM0obeEuOim1w5_0 2024-09-12T17:41:33.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.924+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11773966053893369179', time=2024-09-12T19:31:42.275814+0000, chain.objs.size()=1 2024-09-12T17:41:33.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.924+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.uC51aUHNH93x9XgF_9BNqqJtt_4TCXD_0 2024-09-12T17:41:33.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.924+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10333918427397330939', time=2024-09-12T19:31:42.331404+0000, chain.objs.size()=1 2024-09-12T17:41:33.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.924+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.jzQ7a2TBEDjrLwhelZVAHqgSeord5MV_0 2024-09-12T17:41:33.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.924+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3749841842194746897', time=2024-09-12T19:31:42.343239+0000, chain.objs.size()=1 2024-09-12T17:41:33.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.924+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.3pJ5Y6NQnG6jvfc00JoqXxTG8u31atI_0 2024-09-12T17:41:33.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.924+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10045090935926021984', time=2024-09-12T19:31:42.344211+0000, chain.objs.size()=1 2024-09-12T17:41:33.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.924+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Wi2MMecD2LbLnYGkte4L3LyH78su9Cq_0 2024-09-12T17:41:33.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.928+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6965501109322244366', time=2024-09-12T19:31:42.346475+0000, chain.objs.size()=1 2024-09-12T17:41:33.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.928+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.yeOgM1p5LRP6r3NHQtZwQhhilFXXzSl_0 2024-09-12T17:41:33.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.928+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4872839163336859414', time=2024-09-12T19:31:42.439573+0000, chain.objs.size()=1 2024-09-12T17:41:33.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.928+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.tUD1ITYrl33RaWJ8CFJ06Ugxy3ljJQE_0 2024-09-12T17:41:33.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.928+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9749741953733664245', time=2024-09-12T19:31:42.545460+0000, chain.objs.size()=1 2024-09-12T17:41:33.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.928+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.tQO0_uVdkBIbqBa42vf49JwIzQFjdoV_0 2024-09-12T17:41:33.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.928+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12707565498144228992', time=2024-09-12T19:31:42.667894+0000, chain.objs.size()=1 2024-09-12T17:41:33.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.928+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.T9qpsyq0koePNkqAM453DoiCaamzBSM_0 2024-09-12T17:41:33.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.928+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14565007553347259189', time=2024-09-12T19:31:42.698110+0000, chain.objs.size()=1 2024-09-12T17:41:33.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.928+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.sWxbGgUiUWjRtt9gz1bO1woDMI-_WG5_0 2024-09-12T17:41:33.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.928+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1047735313734020635', time=2024-09-12T19:31:42.706730+0000, chain.objs.size()=1 2024-09-12T17:41:33.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.928+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_._3nwf_fUtIDQk27ZoUwjboRdHdlfOed_0 2024-09-12T17:41:33.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.928+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9428050242765364395', time=2024-09-12T19:31:42.714669+0000, chain.objs.size()=1 2024-09-12T17:41:33.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.928+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.VtyqUCfW82kDjFNSICDyuWi8CGvFbxq_0 2024-09-12T17:41:33.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.928+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15016187408378080897', time=2024-09-12T19:31:42.771761+0000, chain.objs.size()=1 2024-09-12T17:41:33.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.928+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.fS9lrXHxa3yWi4JyXLMi8g7mf8T30xo_0 2024-09-12T17:41:33.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.928+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9734397496055918517', time=2024-09-12T19:31:42.774548+0000, chain.objs.size()=1 2024-09-12T17:41:33.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.928+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.VXvxTgil6f8ZV6-OEvs6XINJW91fjJZ_0 2024-09-12T17:41:33.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.928+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1044658963499901491', time=2024-09-12T19:31:43.196588+0000, chain.objs.size()=1 2024-09-12T17:41:33.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.928+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.uHnDkdFCTnWED0lvz7tBtMpDFzlZcO0_0 2024-09-12T17:41:33.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.928+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3003525798643954767', time=2024-09-12T19:31:43.216917+0000, chain.objs.size()=1 2024-09-12T17:41:33.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.928+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.DGJnZ0RE6ME-VoAJRUTR0CkHamT8_Y9_0 2024-09-12T17:41:33.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.928+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6495144648627577189', time=2024-09-12T19:31:43.241836+0000, chain.objs.size()=1 2024-09-12T17:41:33.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.928+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.LAvlcb856wjMEvdrMBfyQXIS0Jg6uCB_0 2024-09-12T17:41:33.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.928+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17148410545433538776', time=2024-09-12T19:31:43.275964+0000, chain.objs.size()=1 2024-09-12T17:41:33.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.928+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.7JYYskc6e_-smP0LiFFxtWq5a2eqzma_0 2024-09-12T17:41:33.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.928+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3414255208437071266', time=2024-09-12T19:31:43.487633+0000, chain.objs.size()=1 2024-09-12T17:41:33.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.928+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.i4fzaffq4NUa-YPqdB2WfmE4FJM0EjM_0 2024-09-12T17:41:33.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.928+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8906234145694992120', time=2024-09-12T19:31:43.521543+0000, chain.objs.size()=1 2024-09-12T17:41:33.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.928+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.YFdEyFXBdIEL3j6YpUf8gY89vmy0RH-_0 2024-09-12T17:41:33.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.928+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11101533687534835910', time=2024-09-12T19:31:43.533063+0000, chain.objs.size()=1 2024-09-12T17:41:33.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.928+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.3JhuCHD6bLEfN8NJKZmZi9ZzDaVESVS_0 2024-09-12T17:41:33.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.928+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15589305740778438827', time=2024-09-12T19:31:43.737659+0000, chain.objs.size()=1 2024-09-12T17:41:33.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.928+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.tjU8QEijScDjqL8oyPURzTlHWvVX49W_0 2024-09-12T17:41:33.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.932+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3861372241720617432', time=2024-09-12T19:31:43.791809+0000, chain.objs.size()=1 2024-09-12T17:41:33.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.932+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.bmOsDkj1Rc_AmaAzIpsbaJjxcjlh-jk_0 2024-09-12T17:41:33.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.932+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1383403140188823290', time=2024-09-12T19:31:43.826770+0000, chain.objs.size()=1 2024-09-12T17:41:33.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.932+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.85PSwnfvZ4o65sYuAvmk1C3MONc0l9r_0 2024-09-12T17:41:33.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.932+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3589732362468472234', time=2024-09-12T19:31:43.831975+0000, chain.objs.size()=1 2024-09-12T17:41:33.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.932+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.tzovrWtvUwMt1vccBtAicMfT2mmF95c_0 2024-09-12T17:41:33.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.932+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12244753657516516513', time=2024-09-12T19:31:43.856320+0000, chain.objs.size()=1 2024-09-12T17:41:33.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.932+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.G_pYDEn9nMLcAwpK7rPMSHds7znkU4n_0 2024-09-12T17:41:33.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.932+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16840836163139063264', time=2024-09-12T19:31:43.888929+0000, chain.objs.size()=1 2024-09-12T17:41:33.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.932+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.RoeGwTnfCWm1Bm3-MsXyhAzGSReJE7h_0 2024-09-12T17:41:33.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.932+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2689630669675776005', time=2024-09-12T19:31:44.148227+0000, chain.objs.size()=1 2024-09-12T17:41:33.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.932+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.NNZ-_3QOfYQ4i_M5seb6sFs5mWXgVSu_0 2024-09-12T17:41:33.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.932+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9751341710573722448', time=2024-09-12T19:31:44.165894+0000, chain.objs.size()=1 2024-09-12T17:41:33.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.932+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.owUrM6pAdhtJFxjYiXWp7qRTSIyV675_0 2024-09-12T17:41:33.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.932+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15218927241724531440', time=2024-09-12T19:31:44.176069+0000, chain.objs.size()=1 2024-09-12T17:41:33.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.932+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.lFmEcXc138jzJE3B0lAytOcdXEgjl92_0 2024-09-12T17:41:33.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.932+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.544119594391515048', time=2024-09-12T19:31:44.213815+0000, chain.objs.size()=1 2024-09-12T17:41:33.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.932+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.vWI0IH5bx_Irt9_cjqRfSGUG-hVsM6O_0 2024-09-12T17:41:33.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.932+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1937073534538083301', time=2024-09-12T19:31:44.245214+0000, chain.objs.size()=1 2024-09-12T17:41:33.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.932+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.lr1xULIF-ArS_14R7YSHKBERBOtI8VO_0 2024-09-12T17:41:33.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.932+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14850411645626207870', time=2024-09-12T19:31:44.270799+0000, chain.objs.size()=1 2024-09-12T17:41:33.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.932+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.EMBgiL29MYJv8dDppr65KDk2yFWFXAE_0 2024-09-12T17:41:33.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.932+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4850548413578422454', time=2024-09-12T19:31:44.446426+0000, chain.objs.size()=1 2024-09-12T17:41:33.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.932+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.fhuK6Df2Bp8pZ-P-FnVRqh6hhJbuT4d_0 2024-09-12T17:41:33.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.932+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15799861520136578353', time=2024-09-12T19:31:48.021610+0000, chain.objs.size()=1 2024-09-12T17:41:33.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.932+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.272__shadow_.vX3T5wf3KwJg2lKxqsqSk0cjub_aThQ_0 2024-09-12T17:41:33.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.932+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1414683554479120866', time=2024-09-12T19:31:49.548013+0000, chain.objs.size()=1 2024-09-12T17:41:33.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.932+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.276__shadow_.i8aiYPJv7DlSJscdiPi0MP7wf2nahd8_0 2024-09-12T17:41:33.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.936+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13945497105815473166', time=2024-09-12T19:31:49.923490+0000, chain.objs.size()=1 2024-09-12T17:41:33.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.936+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.277__shadow_.xpOLoDsnkbxsUMrj2PRSF94tSwzIvCC_0 2024-09-12T17:41:33.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.936+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10720570596837545307', time=2024-09-12T19:31:56.521613+0000, chain.objs.size()=1 2024-09-12T17:41:33.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.936+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.292__shadow_.x8rxSTqElu8gV0CCi29HrjL4Wf2w6Le_0 2024-09-12T17:41:33.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.936+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11358123847103925077', time=2024-09-12T19:31:58.739316+0000, chain.objs.size()=1 2024-09-12T17:41:33.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.936+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.296__shadow_.OoGlrttaANU5po0eXXBuYv8WF9QtLHJ_0 2024-09-12T17:41:33.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.936+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7992898953809959557', time=2024-09-12T19:32:00.385321+0000, chain.objs.size()=1 2024-09-12T17:41:33.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.936+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.300__shadow_.KdJfjf5l_nP1jK9O1RPPAH6p3r5OqHw_0 2024-09-12T17:41:33.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.936+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5954734403851258436', time=2024-09-12T19:32:27.919843+0000, chain.objs.size()=1 2024-09-12T17:41:33.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.936+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Hg0NJyYNZh427p_UUe2tYpz7GJK9Wv1_0 2024-09-12T17:41:33.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.936+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16322393422057978199', time=2024-09-12T19:32:28.031905+0000, chain.objs.size()=1 2024-09-12T17:41:33.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.936+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.d848419QF_5_FNuk0N8gNsRuE2J_cWK_0 2024-09-12T17:41:33.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.936+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4629659888545024834', time=2024-09-12T19:32:28.033321+0000, chain.objs.size()=1 2024-09-12T17:41:33.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.936+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.tfiu86MAIztmlXTNjQnjrijXeNT_X9g_0 2024-09-12T17:41:33.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.936+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16808280109957094675', time=2024-09-12T19:32:28.036966+0000, chain.objs.size()=1 2024-09-12T17:41:33.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.936+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.IFUbTeYr1U-3n7llnbBoaIdFf_ZnB59_0 2024-09-12T17:41:33.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.936+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9177409842724187756', time=2024-09-12T19:32:28.162001+0000, chain.objs.size()=1 2024-09-12T17:41:33.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.936+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.4zf9czgM3j656CI-8E1TSPIdockciKg_0 2024-09-12T17:41:33.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.936+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14246974274758415004', time=2024-09-12T19:32:28.298554+0000, chain.objs.size()=1 2024-09-12T17:41:33.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.936+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.eVKAaFS2kPL_iqEZudkNHfaL5-DZnxW_0 2024-09-12T17:41:33.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.936+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15233032411250774086', time=2024-09-12T19:32:28.397542+0000, chain.objs.size()=1 2024-09-12T17:41:33.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.936+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.9P-LdrGGTzlbjLpV0rjB0-0mTSSxPFo_0 2024-09-12T17:41:33.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.936+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15851690919582799155', time=2024-09-12T19:32:28.449001+0000, chain.objs.size()=1 2024-09-12T17:41:33.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.936+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.OVRh1SXkzFv-ysQEpSNsTNQck4-7xvY_0 2024-09-12T17:41:33.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.936+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16358149811412736693', time=2024-09-12T19:32:28.458858+0000, chain.objs.size()=1 2024-09-12T17:41:33.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.936+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Rj5CCm7H_9B3vZ0QWAWD2upJuzN2FuY_0 2024-09-12T17:41:33.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.936+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15835131629488725915', time=2024-09-12T19:32:28.474057+0000, chain.objs.size()=1 2024-09-12T17:41:33.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.936+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.XsFVke3EwsTqNxeYgXW8QP3DYqDEXrB_0 2024-09-12T17:41:33.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.936+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13046143005175493008', time=2024-09-12T19:32:28.478571+0000, chain.objs.size()=1 2024-09-12T17:41:33.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.936+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.qwhTGhMDSIy2Z2y8zG6F302zwlrSku3_0 2024-09-12T17:41:33.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.936+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12018402460417970818', time=2024-09-12T19:32:28.511624+0000, chain.objs.size()=1 2024-09-12T17:41:33.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.936+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.bBpCbr7NHvBRh9KxovagPPOTVPwUne0_0 2024-09-12T17:41:33.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.936+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9676414187098704388', time=2024-09-12T19:32:28.513846+0000, chain.objs.size()=1 2024-09-12T17:41:33.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.936+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.8ic_3EH_MobgX268hpEK0BxNwdqPAoL_0 2024-09-12T17:41:33.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.936+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14788931984738744604', time=2024-09-12T19:32:28.756473+0000, chain.objs.size()=1 2024-09-12T17:41:33.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.936+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.gSDwAkg-jz2tSFh_OhLfkXQ_TVTxQqf_0 2024-09-12T17:41:33.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.936+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13052959425018788612', time=2024-09-12T19:32:28.780203+0000, chain.objs.size()=1 2024-09-12T17:41:33.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.940+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.RM934Ujn9o03Ryd2s4wwzbZyhXuomHS_0 2024-09-12T17:41:33.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.940+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17067112468306811037', time=2024-09-12T19:32:28.860778+0000, chain.objs.size()=1 2024-09-12T17:41:33.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.940+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_._haGw47fW6ENYDfXBm-f6ziH6hiCrxZ_0 2024-09-12T17:41:33.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.940+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12772300670933621092', time=2024-09-12T19:32:29.171341+0000, chain.objs.size()=1 2024-09-12T17:41:33.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.940+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.cb03yWIdVmnsyOKHFZx3qzOTbsIsXBQ_0 2024-09-12T17:41:33.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.940+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13037694169305266783', time=2024-09-12T19:32:29.182406+0000, chain.objs.size()=1 2024-09-12T17:41:33.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.940+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.tiZ6sYmAWS-XWxmFNVQrd2j-lPjwwAL_0 2024-09-12T17:41:33.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.940+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15393179914620069567', time=2024-09-12T19:32:29.186967+0000, chain.objs.size()=1 2024-09-12T17:41:33.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.940+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.n8B6L_DL58e-ctsdhmbCeUYrSFL39S7_0 2024-09-12T17:41:33.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.940+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10721321431715979021', time=2024-09-12T19:32:29.234377+0000, chain.objs.size()=1 2024-09-12T17:41:33.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.940+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.rO3YV19nkJ4xP7NtU3yntzaKKKvKotf_0 2024-09-12T17:41:33.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.940+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15075552565156870060', time=2024-09-12T19:32:29.407894+0000, chain.objs.size()=1 2024-09-12T17:41:33.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.940+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.RSjmfdsv5drr8o7PdZj1Z_HnLFImMyc_0 2024-09-12T17:41:33.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.940+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16246182509362171055', time=2024-09-12T19:32:29.408962+0000, chain.objs.size()=1 2024-09-12T17:41:33.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.940+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.MU0WDZyfD-G3ujsbBnI1HKfNs-zTeYi_0 2024-09-12T17:41:33.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.940+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2240162104068539508', time=2024-09-12T19:32:29.417586+0000, chain.objs.size()=1 2024-09-12T17:41:33.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.940+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.DlT3z4G0lCeDpxaUtevS9xaN1wN9qr3_0 2024-09-12T17:41:33.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.940+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10613566922106824180', time=2024-09-12T19:32:29.474236+0000, chain.objs.size()=1 2024-09-12T17:41:33.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.940+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.sHZM7a6gmfJLVVQSIF7Z5DmylYNwX5s_0 2024-09-12T17:41:33.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.940+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6566319885363341672', time=2024-09-12T19:32:29.488851+0000, chain.objs.size()=1 2024-09-12T17:41:33.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.940+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.dT2w3JqlUyFySK7WjBG4V42iAwU5vGb_0 2024-09-12T17:41:33.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.940+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4814645264042705940', time=2024-09-12T19:32:29.500622+0000, chain.objs.size()=1 2024-09-12T17:41:33.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.940+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.TB8bSqPjxCfBNBjNfcASF-fD5pP_icj_0 2024-09-12T17:41:33.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.940+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5118853514539418135', time=2024-09-12T19:32:29.557479+0000, chain.objs.size()=1 2024-09-12T17:41:33.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.940+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.sODHJEz5rNZ_rSHKRN2u-OHMA4Bbaiq_0 2024-09-12T17:41:33.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.940+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5296874651295122288', time=2024-09-12T19:32:29.679454+0000, chain.objs.size()=1 2024-09-12T17:41:33.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.940+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.AhpEyN0xfxeOk07oXqm0LZezYlAiBpx_0 2024-09-12T17:41:33.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.940+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.556828278733095012', time=2024-09-12T19:32:30.017068+0000, chain.objs.size()=1 2024-09-12T17:41:33.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.940+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.pP_28r6pGeG20RZwULSvdNs_JQ98UyF_0 2024-09-12T17:41:33.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.940+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7011236155887534890', time=2024-09-12T19:32:30.105260+0000, chain.objs.size()=1 2024-09-12T17:41:33.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.940+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.KM1b9mF0OZnIhdLoY9k0sJYtrTSlf6M_0 2024-09-12T17:41:33.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.940+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.369249847978259218', time=2024-09-12T19:32:30.127936+0000, chain.objs.size()=1 2024-09-12T17:41:33.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.940+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.n3HAVwv3ab33NMTOnBucGDM6mbFdBrO_0 2024-09-12T17:41:33.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.940+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8040369071218851814', time=2024-09-12T19:32:30.146018+0000, chain.objs.size()=1 2024-09-12T17:41:33.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.940+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.iJjJLC7HITdNNuA_VfNkxSAHbnqYdW7_0 2024-09-12T17:41:33.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.944+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18160189894005685009', time=2024-09-12T19:32:49.642141+0000, chain.objs.size()=1 2024-09-12T17:41:33.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.944+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.1RnE6J2pkHRf10Wz0yR8udR7lL_VFD3_0 2024-09-12T17:41:33.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.944+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18038472959225415238', time=2024-09-12T19:32:49.711235+0000, chain.objs.size()=1 2024-09-12T17:41:33.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.944+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.NFSfddlT7qXCRQtNQb3zuUhg7K1nTyL_0 2024-09-12T17:41:33.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.944+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10428256655560592804', time=2024-09-12T19:32:49.823342+0000, chain.objs.size()=1 2024-09-12T17:41:33.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.944+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.fmypncGLT_XNstUz53xmonEqyeFsULq_0 2024-09-12T17:41:33.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.944+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9549637365438268028', time=2024-09-12T19:32:49.834518+0000, chain.objs.size()=1 2024-09-12T17:41:33.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.944+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.oCJ_lVkyYyquqOkOK36arWFDtzW8Wpc_0 2024-09-12T17:41:33.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.944+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14369167160064116777', time=2024-09-12T19:32:49.849185+0000, chain.objs.size()=1 2024-09-12T17:41:33.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.944+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.4uRxjWGBHftk1fa3BpBRV5LqHqFV4kd_0 2024-09-12T17:41:33.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.944+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.296300382875616194', time=2024-09-12T19:32:50.126777+0000, chain.objs.size()=1 2024-09-12T17:41:33.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.944+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.EiW9WEV0WIgKdgSHBXMMXCoS1YruoiR_0 2024-09-12T17:41:33.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.944+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1391356058074422325', time=2024-09-12T19:32:50.154533+0000, chain.objs.size()=1 2024-09-12T17:41:33.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.944+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.FIo2EReToCqKskquVQO3qHqiCsdA7tJ_0 2024-09-12T17:41:33.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.944+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13631665390388154234', time=2024-09-12T19:32:50.168155+0000, chain.objs.size()=1 2024-09-12T17:41:33.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.944+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.RePScF9RGTJi59aAys4gCoQ_3ASvuil_0 2024-09-12T17:41:33.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.944+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14366163601505352521', time=2024-09-12T19:32:50.261465+0000, chain.objs.size()=1 2024-09-12T17:41:33.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.944+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Q_GSvKq_AlzsOjK0TwAhjvxn5c4AqlZ_0 2024-09-12T17:41:33.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.944+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6690088378866507663', time=2024-09-12T19:32:50.263270+0000, chain.objs.size()=1 2024-09-12T17:41:33.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.944+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.YumTCThB63rwk_JVp7MVeGZiDZ9VAMY_0 2024-09-12T17:41:33.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.944+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9934660305742207221', time=2024-09-12T19:32:50.266026+0000, chain.objs.size()=1 2024-09-12T17:41:33.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.944+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.s3pj1j0OokwwaEQInkQ-j_1V0nG0C5f_0 2024-09-12T17:41:33.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.944+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7020905847912876098', time=2024-09-12T19:32:50.288357+0000, chain.objs.size()=1 2024-09-12T17:41:33.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.944+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.pVClP6bHvs8CIIfwBTF2zOexQ43gcnA_0 2024-09-12T17:41:33.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.944+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17714427106720391468', time=2024-09-12T19:32:50.304916+0000, chain.objs.size()=1 2024-09-12T17:41:33.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.944+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.-Cy1BZo1z1r5QxRRc8uyPKIY2MgAiks_0 2024-09-12T17:41:33.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.944+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13183428976788415500', time=2024-09-12T19:32:50.311810+0000, chain.objs.size()=1 2024-09-12T17:41:33.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.944+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.u5Rgs_GhLu3RT7SccEZpAysag-ZPyh6_0 2024-09-12T17:41:33.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.944+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16422853796053049874', time=2024-09-12T19:32:50.612167+0000, chain.objs.size()=1 2024-09-12T17:41:33.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.944+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.ALZVo3gzRn_dc-WIe1buC11ydcdE_4W_0 2024-09-12T17:41:33.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.944+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17832104135730719660', time=2024-09-12T19:32:50.640888+0000, chain.objs.size()=1 2024-09-12T17:41:33.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.944+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.2pRbYN2DzoPikpVJU0ZMV2oFICgGGv4_0 2024-09-12T17:41:33.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.944+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4260768557177408959', time=2024-09-12T19:32:50.651208+0000, chain.objs.size()=1 2024-09-12T17:41:33.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.944+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.ztrlrGKIdOqfR8y1nxlYm9sl_lgFx3P_0 2024-09-12T17:41:33.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.944+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7858748057978560753', time=2024-09-12T19:32:50.678442+0000, chain.objs.size()=1 2024-09-12T17:41:33.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.944+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.M_UbD_YlFccWX5uDcbkY5WgPlgGsiVb_0 2024-09-12T17:41:33.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.948+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/80310 2024-09-12T17:41:33.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.948+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=28, truncated=0, next_marker='' 2024-09-12T17:41:33.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.948+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10266255118412584396', time=2024-09-12T19:32:50.828910+0000, chain.objs.size()=1 2024-09-12T17:41:33.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.948+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.k5scscUKjqwuN3aX3JUGGYdFYQT4ynM_0 2024-09-12T17:41:33.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.948+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13053941283700971966', time=2024-09-12T19:32:50.914625+0000, chain.objs.size()=1 2024-09-12T17:41:33.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.948+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.wz8_ZoT-l3np5OcX-FxQKPpmQRpQVFN_0 2024-09-12T17:41:33.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.948+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3402964666822205683', time=2024-09-12T19:32:50.915703+0000, chain.objs.size()=1 2024-09-12T17:41:33.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.948+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.rZ3IyDatAqtkn9tf2bPMGfVcqoUVO_s_0 2024-09-12T17:41:33.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.948+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6008990021391924003', time=2024-09-12T19:32:50.919654+0000, chain.objs.size()=1 2024-09-12T17:41:33.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.948+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.YutqenBknfs4uKWFZNTrcqFxfJD5Kvo_0 2024-09-12T17:41:33.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.948+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11946375074027384181', time=2024-09-12T19:32:50.950162+0000, chain.objs.size()=1 2024-09-12T17:41:33.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.948+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.UOHybZAaNKBNC4RbO8StWOKrDgwLgRX_0 2024-09-12T17:41:33.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.948+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12370121177709586687', time=2024-09-12T19:32:51.171184+0000, chain.objs.size()=1 2024-09-12T17:41:33.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.948+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.trrIs9DfSsAFY-ywmf2XvLPiBoV-fHg_0 2024-09-12T17:41:33.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.948+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13898316179407600507', time=2024-09-12T19:32:51.248527+0000, chain.objs.size()=1 2024-09-12T17:41:33.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.948+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.T3t0tPO6ZmYTQOvwZUNEKTMdHwVCdju_0 2024-09-12T17:41:33.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.948+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7166774648686789750', time=2024-09-12T19:32:51.251133+0000, chain.objs.size()=1 2024-09-12T17:41:33.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.948+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.SO8UtLtvq3-hhdW9DNXrnHd2ZN8Slg4_0 2024-09-12T17:41:33.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.948+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16351431062037543982', time=2024-09-12T19:32:51.628694+0000, chain.objs.size()=1 2024-09-12T17:41:33.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.948+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.gtFFY_Bj-PJxDjmW6iTPUWT1E0utpC7_0 2024-09-12T17:41:33.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.948+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15334869760388876132', time=2024-09-12T19:32:51.945860+0000, chain.objs.size()=1 2024-09-12T17:41:33.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.948+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.L3i5-3OblRz2DGgY-d_KNwRpvBVtPI1_0 2024-09-12T17:41:33.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.948+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1237615590094548893', time=2024-09-12T19:32:52.011528+0000, chain.objs.size()=1 2024-09-12T17:41:33.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.948+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.5hLj9v0yZEckFcFphEhksKqGSWKyX3__0 2024-09-12T17:41:33.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.948+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17834500656041399888', time=2024-09-12T19:33:42.554100+0000, chain.objs.size()=1 2024-09-12T17:41:33.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.948+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.462__shadow_.RoSH9A_CVHJZCtNFaOGd3CmBjz_8Uit_0 2024-09-12T17:41:33.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.952+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13069194440396941593', time=2024-09-12T19:34:10.511817+0000, chain.objs.size()=3 2024-09-12T17:41:33.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.952+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.521__multipart_mymultipart.2~TDNOHfz7ymLfYa-ko8pexCa-apNizPB.1 2024-09-12T17:41:33.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.952+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.521__multipart_mymultipart.2~TDNOHfz7ymLfYa-ko8pexCa-apNizPB.2 2024-09-12T17:41:33.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.952+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.521__multipart_mymultipart.2~TDNOHfz7ymLfYa-ko8pexCa-apNizPB.3 2024-09-12T17:41:33.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.952+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7777622141668165924', time=2024-09-12T19:34:10.779090+0000, chain.objs.size()=1 2024-09-12T17:41:33.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.952+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.520__shadow:zTWRYubgr5IFvEHSbuTBniXV9SQAnG8_.D7f9SBl_O8JkErcr7bZvOA5cQ_kza58_0 2024-09-12T17:41:33.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.952+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~El3pwWRISxK-rlPTWyQebQsn6Buct2X', time=2024-09-12T19:34:30.162275+0000, chain.objs.size()=1 2024-09-12T17:41:33.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.952+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.533__multipart_mymultipart.2~El3pwWRISxK-rlPTWyQebQsn6Buct2X.1 2024-09-12T17:41:33.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.952+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11414359586764901013', time=2024-09-12T19:35:00.799034+0000, chain.objs.size()=1 2024-09-12T17:41:33.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.952+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.551__shadow_.1KsKpOgyPKJHSQEwVT8EggbtwePqugr_0 2024-09-12T17:41:33.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.952+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10076894283756662296', time=2024-09-12T19:35:16.506014+0000, chain.objs.size()=1 2024-09-12T17:41:33.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.952+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.569__shadow:2Wp8MrjFm3d9cPkGzzNsbh-coIzyrFt_.ptW-zXzQg_iJ-vPsZMS-DXmCxTbHIy__0 2024-09-12T17:41:33.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.952+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1452303491039582271', time=2024-09-12T19:35:27.486955+0000, chain.objs.size()=1 2024-09-12T17:41:33.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.952+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.574__shadow:u7.O8z1Mpzk7yyixXOfqAoMxrvyLUcu_.K8YO2VBGrhj4lmIhMKF8CQLMSsAG2Wz_0 2024-09-12T17:41:33.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.952+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13859315829555866672', time=2024-09-12T19:35:35.446030+0000, chain.objs.size()=1 2024-09-12T17:41:33.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.952+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.577__shadow:n2Jjre3hPM.tPXdl0FUrbM22ORe4cwK_.GOyaIB1tI3U-gUwzu2X0OCYJL4SNT_M_0 2024-09-12T17:41:33.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.952+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16681240591008727378', time=2024-09-12T19:35:44.770122+0000, chain.objs.size()=1 2024-09-12T17:41:33.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.952+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.577__shadow:eTW1ymnmOzwmJVt45PVdtO487JGIyXU_.wX2Q7TzJqIVyD-VgrK0rpx3H6740U-3_0 2024-09-12T17:41:33.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.952+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9976876245462448620', time=2024-09-12T19:35:48.163096+0000, chain.objs.size()=1 2024-09-12T17:41:33.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.952+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.577__shadow:qybjBNEWOkdWMqkomkbBx3.1fRItQmy_.niqUomJKQwW1gPwfvm1KIEWfmgr0nK1_0 2024-09-12T17:41:33.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.952+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6693174010597584673', time=2024-09-12T19:35:55.689879+0000, chain.objs.size()=1 2024-09-12T17:41:33.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.952+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.580__shadow:BFTAQ4IF8eJdkkNWZJ-bQMjdGNIHr0S_.cjZDqMRElJLlRbutnNcGae9WqGEup7R_0 2024-09-12T17:41:33.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.952+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10858869666821724138', time=2024-09-12T19:38:25.079633+0000, chain.objs.size()=1 2024-09-12T17:41:33.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.952+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.630__shadow_.nfWr5Pl4HM21LaYmL2-1htlb-WSSSjU_0 2024-09-12T17:41:33.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.956+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4087910784611199200', time=2024-09-12T19:38:31.595855+0000, chain.objs.size()=1 2024-09-12T17:41:33.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.956+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.646__shadow_.b2uECIX45uQGhk0wpCQRmZwiijuUWsB_0 2024-09-12T17:41:33.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.956+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6445654547194949171', time=2024-09-12T19:38:42.196321+0000, chain.objs.size()=1 2024-09-12T17:41:33.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.956+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.663__shadow_._mSPfZcitQupB9MPphcx7smUGFM2yzq_0 2024-09-12T17:41:33.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.956+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7796660199192768839', time=2024-09-12T19:38:43.301632+0000, chain.objs.size()=1 2024-09-12T17:41:33.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.956+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.665__shadow_.0BZxC6aiMZjAqg15229YSOxhsNBahX5_0 2024-09-12T17:41:33.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.956+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17526707067638167595', time=2024-09-12T19:38:54.891442+0000, chain.objs.size()=1 2024-09-12T17:41:33.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.956+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.699__shadow:eCBPQfW7t3IUI4hZWOt85P445ynkPBG_.sXD0pulFsupuVtdthZjYQIs1eTtkJQn_0 2024-09-12T17:41:33.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.956+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.146205513812474493', time=2024-09-12T19:39:21.461167+0000, chain.objs.size()=1 2024-09-12T17:41:33.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.956+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.718__shadow_.pssHo_V092VODVAe6zh5fhNek9CrYch_0 2024-09-12T17:41:33.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.956+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:41:33.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.960+0000 7fd765adf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:41:33.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.960+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:41:33.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.960+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:41:33.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.960+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47961' 2024-09-12T17:41:33.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.960+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.838248834981492911', time=2024-09-12T19:29:44.305460+0000, chain.objs.size()=1 2024-09-12T17:41:33.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.960+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.160__shadow_._LrncG3egAA_fWKBbbkwz4M4QpMElqI_0 2024-09-12T17:41:33.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.960+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='_6dxAKrYBCitk7_w6NN3-lpko3gWDxJH', time=2024-09-12T19:29:48.929809+0000, chain.objs.size()=1 2024-09-12T17:41:33.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.960+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.163__shadow_.qBuhROPIe6dYjdr9cOZMBTW6lCzM0-1_0 2024-09-12T17:41:33.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.960+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.816734733056934725', time=2024-09-12T19:31:12.223598+0000, chain.objs.size()=1 2024-09-12T17:41:33.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.960+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.234__shadow_.WbbHzMXiG3W5ZrYRO1WG3xkl5CPCR2F_0 2024-09-12T17:41:33.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.960+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12640506850124581812', time=2024-09-12T19:31:13.461163+0000, chain.objs.size()=1 2024-09-12T17:41:33.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.960+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.237__shadow_.dGzquwusFeXSiT5LsXJANKj5yCm6CgC_0 2024-09-12T17:41:33.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.960+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10493718894693388008', time=2024-09-12T19:31:18.693264+0000, chain.objs.size()=1 2024-09-12T17:41:33.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.960+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.250__shadow_.BXw5_zTxT8kmhTGF8IUg43aMMyem3Bz_0 2024-09-12T17:41:33.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.960+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1763278378024088624', time=2024-09-12T19:31:42.269372+0000, chain.objs.size()=1 2024-09-12T17:41:33.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.960+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Jpgdgo1WVUphrrEWrNQnhysZSB4FvrN_0 2024-09-12T17:41:33.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.960+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1843702205568849192', time=2024-09-12T19:31:42.334845+0000, chain.objs.size()=1 2024-09-12T17:41:33.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.960+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.m8UrAsuhnG2bkuVo1FsaSBl0yu1bcq6_0 2024-09-12T17:41:33.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.960+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9330298798856907188', time=2024-09-12T19:31:42.399859+0000, chain.objs.size()=1 2024-09-12T17:41:33.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.960+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.9D7alCfGRlgMHCTSVFfHqS5biUGyHqU_0 2024-09-12T17:41:33.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.960+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8838797215470515378', time=2024-09-12T19:31:42.403691+0000, chain.objs.size()=1 2024-09-12T17:41:33.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.960+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Ogt6Ql0301u7HzP2qABFVmLICHPrL9u_0 2024-09-12T17:41:33.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.960+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.477651154658884929', time=2024-09-12T19:31:42.430577+0000, chain.objs.size()=1 2024-09-12T17:41:33.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.960+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.mz5SdX12rX7ow7ziFH6JgcuNUnpuxr2_0 2024-09-12T17:41:33.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.960+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16948809462241870198', time=2024-09-12T19:31:42.557981+0000, chain.objs.size()=1 2024-09-12T17:41:33.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.960+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.jOR-DTy3f36EmNYY3RtaTGHoJWYXP4a_0 2024-09-12T17:41:33.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.960+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6231696373346396970', time=2024-09-12T19:31:42.625300+0000, chain.objs.size()=1 2024-09-12T17:41:33.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.960+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.tcjGArFCfQkh4BP6SfqkqyTh_xpsG63_0 2024-09-12T17:41:33.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.964+0000 7fd762de4640 0 -- 172.21.15.16:0/1166938650 >> [v2:172.21.15.19:6824/2441769319,v1:172.21.15.19:6825/2441769319] conn(0x55ae10394550 msgr2=0x55ae103969a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:33.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.964+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17863451747457708865', time=2024-09-12T19:31:42.639087+0000, chain.objs.size()=1 2024-09-12T17:41:33.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.964+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.lINVUmSZTrHgs1AkHPIuREkRPzC94Km_0 2024-09-12T17:41:33.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.964+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1702215480402055421', time=2024-09-12T19:31:42.766229+0000, chain.objs.size()=1 2024-09-12T17:41:33.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.964+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.ncynnXpXsW2819qiEY1-HkQYIs3GeG5_0 2024-09-12T17:41:33.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.964+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12853813676348203236', time=2024-09-12T19:31:42.784109+0000, chain.objs.size()=1 2024-09-12T17:41:33.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.964+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.EpxjJHM6RJYsUcjt2IPWTbuTArMLoDk_0 2024-09-12T17:41:33.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.964+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7759321355409118769', time=2024-09-12T19:31:42.792693+0000, chain.objs.size()=1 2024-09-12T17:41:33.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.964+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Gkag789ytYWx8PPFPpG7Wiikii3Os_a_0 2024-09-12T17:41:33.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.964+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16956504662893088803', time=2024-09-12T19:31:42.808105+0000, chain.objs.size()=1 2024-09-12T17:41:33.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.964+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.YqpB3pAjS0BieMNZ1lSnqaIkAmZN_k1_0 2024-09-12T17:41:33.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.964+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12063889045475833342', time=2024-09-12T19:31:42.886608+0000, chain.objs.size()=1 2024-09-12T17:41:33.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.964+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.KvOQfJxa-7haUls_LaHKun2ERQgH29F_0 2024-09-12T17:41:33.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.964+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10680208446080965193', time=2024-09-12T19:31:42.959366+0000, chain.objs.size()=1 2024-09-12T17:41:33.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.964+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.fDrQ6QcFSMKPXzcIHpUd_WAgeF7ULWf_0 2024-09-12T17:41:33.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.964+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1787442504097818682', time=2024-09-12T19:31:43.132655+0000, chain.objs.size()=1 2024-09-12T17:41:33.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.964+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.655btTXnzsJu5HfJhubrFKjaO07F3kX_0 2024-09-12T17:41:33.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.964+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14399866911706894071', time=2024-09-12T19:31:43.209898+0000, chain.objs.size()=1 2024-09-12T17:41:33.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.964+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Gu9YepLmqGaLNbuUNFChjvu3kfSkwOZ_0 2024-09-12T17:41:33.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.964+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7565900099911427581', time=2024-09-12T19:31:43.226987+0000, chain.objs.size()=1 2024-09-12T17:41:33.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.964+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.WXsm0l4OR7DnM9HjdEP3D1iLwVMB4fh_0 2024-09-12T17:41:33.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.964+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13181139238790260244', time=2024-09-12T19:31:43.407783+0000, chain.objs.size()=1 2024-09-12T17:41:33.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.964+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.-g_BcyZWYHoTPaheSXWDulgzNH81UVi_0 2024-09-12T17:41:33.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.968+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1560713069891952938', time=2024-09-12T19:31:43.460385+0000, chain.objs.size()=1 2024-09-12T17:41:33.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.968+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.I0mwGheGXUWgT9SVCNkSKhy8NI0FPDb_0 2024-09-12T17:41:33.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.968+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1688100305671202248', time=2024-09-12T19:31:43.485831+0000, chain.objs.size()=1 2024-09-12T17:41:33.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.968+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.cOOxNmf_f1VOEahTIiEH4P0OJWBp1p7_0 2024-09-12T17:41:33.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.968+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12520136636500960548', time=2024-09-12T19:31:43.544857+0000, chain.objs.size()=1 2024-09-12T17:41:33.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.968+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.v6r0RkqHNMwxCklPzZMFzruzhhiA_To_0 2024-09-12T17:41:33.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.968+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12260869761499569172', time=2024-09-12T19:31:43.588098+0000, chain.objs.size()=1 2024-09-12T17:41:33.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.968+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.OVZrfsn0lPoF6H8sfT2kNYvBuG41TYr_0 2024-09-12T17:41:33.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.968+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3424398121514768713', time=2024-09-12T19:31:43.604455+0000, chain.objs.size()=1 2024-09-12T17:41:33.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.968+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.sNr410C17QfkZd4OHc1wNKs7QyBZVrI_0 2024-09-12T17:41:33.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.968+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6222663745920473636', time=2024-09-12T19:31:43.738062+0000, chain.objs.size()=1 2024-09-12T17:41:33.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.968+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.gJk3l5O4Qb6QUqTIlIME95pGFO_5lw4_0 2024-09-12T17:41:33.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.968+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1544357538935878050', time=2024-09-12T19:31:43.763428+0000, chain.objs.size()=1 2024-09-12T17:41:33.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.968+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.NvxsRSTO-J-3Fx9eaoJtHktyBREoFFJ_0 2024-09-12T17:41:33.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.968+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8568475974511611612', time=2024-09-12T19:31:43.783890+0000, chain.objs.size()=1 2024-09-12T17:41:33.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.968+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.7L0HxIhtyjivtFfyZHjm1R7xGgGgCDv_0 2024-09-12T17:41:33.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.968+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4928869223994432016', time=2024-09-12T19:31:43.835117+0000, chain.objs.size()=1 2024-09-12T17:41:33.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.968+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.DBgZ8HJ6LPgTmXjzAI5zNuEW6qr1m5d_0 2024-09-12T17:41:33.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.968+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3580643434023172599', time=2024-09-12T19:31:43.873030+0000, chain.objs.size()=1 2024-09-12T17:41:33.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.968+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.UBEZkToHQmjtSEq1Fvj8R-L6NlEmjy3_0 2024-09-12T17:41:33.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.968+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9417826547163126447', time=2024-09-12T19:31:43.923421+0000, chain.objs.size()=1 2024-09-12T17:41:33.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.968+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.cR5LmbtKRmEag9yOO6cpX93q52KXHP7_0 2024-09-12T17:41:33.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.968+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2992725039604938959', time=2024-09-12T19:31:44.162573+0000, chain.objs.size()=1 2024-09-12T17:41:33.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.968+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.0hSxNsbXh37wHt1JGpLjNgtsiJMz0oG_0 2024-09-12T17:41:33.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.968+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6155585918574263907', time=2024-09-12T19:31:44.226915+0000, chain.objs.size()=1 2024-09-12T17:41:33.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.968+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Dz7CdaMnfyL7Aj5p5tV6x_pAtSLBPbD_0 2024-09-12T17:41:33.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.968+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10871268750317979192', time=2024-09-12T19:31:44.230325+0000, chain.objs.size()=1 2024-09-12T17:41:33.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.968+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.GVdEUPmk-Zpnm-jcmaKlylpN6_kpJw6_0 2024-09-12T17:41:33.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.968+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3356520730357346247', time=2024-09-12T19:31:44.255866+0000, chain.objs.size()=1 2024-09-12T17:41:33.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.968+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.RGFbKow8_YuaXtswBTx6LxeeNexwgov_0 2024-09-12T17:41:33.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.968+0000 7fd762de4640 0 -- 172.21.15.16:0/1166938650 >> [v2:172.21.15.19:6816/2884335714,v1:172.21.15.19:6817/2884335714] conn(0x7fd75c0ff250 msgr2=0x7fd62c0876d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:33.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.972+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1409419996508491304', time=2024-09-12T19:31:44.257831+0000, chain.objs.size()=1 2024-09-12T17:41:33.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.972+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.M-xw9NqbKHDQ4GpwlNXFp1VD3csEnf__0 2024-09-12T17:41:33.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.972+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6050065803729090059', time=2024-09-12T19:31:44.376885+0000, chain.objs.size()=1 2024-09-12T17:41:33.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.972+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.O5Oz_Ecge7n515i4Bm1jIgqZxzbgzNX_0 2024-09-12T17:41:33.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.972+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16886095295686429487', time=2024-09-12T19:31:49.921708+0000, chain.objs.size()=1 2024-09-12T17:41:33.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.972+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.277__shadow_._CJ9mzkuPL85ld1Ow6xwxZ3i_WGbxjr_0 2024-09-12T17:41:33.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.972+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17265416615844799395', time=2024-09-12T19:31:51.820409+0000, chain.objs.size()=1 2024-09-12T17:41:33.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.972+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.282__shadow_.2_06LZ7GkJuKYeGgnTTn_rYE7iViWOs_0 2024-09-12T17:41:33.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.972+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9288224323581523517', time=2024-09-12T19:31:56.447808+0000, chain.objs.size()=1 2024-09-12T17:41:33.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.972+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.292__shadow_.S_zvq4N11hG0Utuf3Dzzf2B15CY55vB_0 2024-09-12T17:41:33.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.972+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10371302147497947350', time=2024-09-12T19:32:00.756564+0000, chain.objs.size()=1 2024-09-12T17:41:33.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.972+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.301__shadow_.SICLxMipInYpBlUlZ6NrWn0rWFqapYJ_0 2024-09-12T17:41:33.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.972+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7104237195648625503', time=2024-09-12T19:32:03.632683+0000, chain.objs.size()=1 2024-09-12T17:41:33.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.972+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.307__shadow:6zkehWCDAsECGZoHmThzblikHBJp7fU_.VnY6TMnehJkR7ReZBYHOsQC3sJ4l1yB_0 2024-09-12T17:41:33.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.972+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18344232780947004416', time=2024-09-12T19:32:07.759804+0000, chain.objs.size()=1 2024-09-12T17:41:33.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.972+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.321__shadow_.YFUiIcjCytt32Ya5fSM3aDdJnG7uvEW_0 2024-09-12T17:41:33.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.972+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6901600957724044486', time=2024-09-12T19:32:07.761694+0000, chain.objs.size()=1 2024-09-12T17:41:33.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.972+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.321__shadow_.RFY9RMfDcTDTypt15ZFKUtS2du8x8x0_0 2024-09-12T17:41:33.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.972+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13808175610250057147', time=2024-09-12T19:32:27.921842+0000, chain.objs.size()=1 2024-09-12T17:41:33.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.972+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.y9un8Je6nBTfwrqHpsfM9JZEa_3SzW2_0 2024-09-12T17:41:33.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.972+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13973638179388364202', time=2024-09-12T19:32:27.960258+0000, chain.objs.size()=1 2024-09-12T17:41:33.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.972+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.sN0JvZzquhYBmVjQFgJiUDp7vDHwvvR_0 2024-09-12T17:41:33.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.972+0000 7fd7635e5640 0 -- 172.21.15.16:0/1166938650 >> [v2:172.21.15.19:6802/36415917,v1:172.21.15.19:6804/36415917] conn(0x7fd75c0f9b70 msgr2=0x7fd75c0f7510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:33.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.972+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3326842976327719330', time=2024-09-12T19:32:28.002173+0000, chain.objs.size()=1 2024-09-12T17:41:33.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.972+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.7IBVPQNyo_Csr70vudo4Vw1JJ0xaxJC_0 2024-09-12T17:41:33.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.972+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15861220029785985624', time=2024-09-12T19:32:28.024750+0000, chain.objs.size()=1 2024-09-12T17:41:33.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.972+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.sLIxkbn2InBhiYNprf7ESjp5zBgAGEi_0 2024-09-12T17:41:33.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.972+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10924385943508434987', time=2024-09-12T19:32:28.029573+0000, chain.objs.size()=1 2024-09-12T17:41:33.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.972+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.gwTrQJ9mJZq6mx8Dqz_V7qaymXaOhtM_0 2024-09-12T17:41:33.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.972+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13996558509707140331', time=2024-09-12T19:32:28.043772+0000, chain.objs.size()=1 2024-09-12T17:41:33.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.972+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.4pBGDRCzLU57bqOslpL4rrBDG-0wlaG_0 2024-09-12T17:41:33.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.972+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6505124501995861540', time=2024-09-12T19:32:28.063565+0000, chain.objs.size()=1 2024-09-12T17:41:33.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.972+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Co7xbW4YbjyzGDCUfBWJYzlMEEhtweB_0 2024-09-12T17:41:33.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.972+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7123218829746343102', time=2024-09-12T19:32:28.065474+0000, chain.objs.size()=1 2024-09-12T17:41:33.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.972+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.KWsr5RcEkr6e6wHzYhnigIfqHnx5AUx_0 2024-09-12T17:41:33.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.972+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11390551161928737222', time=2024-09-12T19:32:28.149963+0000, chain.objs.size()=1 2024-09-12T17:41:33.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.972+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.HWBWDKhYyKA4AyDhyk3Y_QRU7KKqDad_0 2024-09-12T17:41:33.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.972+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7768153459980226422', time=2024-09-12T19:32:28.161992+0000, chain.objs.size()=1 2024-09-12T17:41:33.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.972+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_._9JNSab_MjCCJV0q7Eb_LmVkxlwuQFr_0 2024-09-12T17:41:33.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.972+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3016349743629848147', time=2024-09-12T19:32:28.226860+0000, chain.objs.size()=1 2024-09-12T17:41:33.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.972+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.DSKUAtA4y32m73xG2H4XilTsxM_P99f_0 2024-09-12T17:41:33.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.972+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4410431117219324524', time=2024-09-12T19:32:28.229844+0000, chain.objs.size()=1 2024-09-12T17:41:33.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.972+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Qlm21_OdoD-sk4UyZkB4k7rSaWqEGIK_0 2024-09-12T17:41:33.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.972+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16755855316010246011', time=2024-09-12T19:32:28.234447+0000, chain.objs.size()=1 2024-09-12T17:41:33.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.972+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.g1JEAEzsFsgH5KowmWAuHHiQzuNUjvz_0 2024-09-12T17:41:33.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.976+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.22371474300482036', time=2024-09-12T19:32:28.272737+0000, chain.objs.size()=1 2024-09-12T17:41:33.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.976+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.KCrRdkeqnN4tqSWuhlJEvLugeqRH_He_0 2024-09-12T17:41:33.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.976+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8058582849349528415', time=2024-09-12T19:32:28.417765+0000, chain.objs.size()=1 2024-09-12T17:41:33.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.976+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Qm1h8M8TvC08axbi51ggtvBknKVwtGw_0 2024-09-12T17:41:33.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.976+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7317583516553094856', time=2024-09-12T19:32:28.435331+0000, chain.objs.size()=1 2024-09-12T17:41:33.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.976+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.xBZ2Zzwg9Jh3Q-3Nd6YOyKk-AVgfS1N_0 2024-09-12T17:41:33.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.976+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8023687996374072138', time=2024-09-12T19:32:28.454114+0000, chain.objs.size()=1 2024-09-12T17:41:33.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.976+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.KyeA0wSKcYkgn1BUY78Pr_ZAcoZA3tS_0 2024-09-12T17:41:33.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.976+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5783081847194364461', time=2024-09-12T19:32:28.510214+0000, chain.objs.size()=1 2024-09-12T17:41:33.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.976+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.BD2FU_TgbA4CqtzwvVxQz0rmv62vlfY_0 2024-09-12T17:41:33.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.976+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11478492301924675334', time=2024-09-12T19:32:28.521177+0000, chain.objs.size()=1 2024-09-12T17:41:33.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.976+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.TsMzZj4kKQDAaVU_PtXR7XOEy9IbMYJ_0 2024-09-12T17:41:33.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.976+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10632154835618955600', time=2024-09-12T19:32:28.757022+0000, chain.objs.size()=1 2024-09-12T17:41:33.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.976+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.KA3hmGi9-Z-Acb8hH-a8eUVPRdwcdj5_0 2024-09-12T17:41:33.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.976+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5430501048058348119', time=2024-09-12T19:32:28.806814+0000, chain.objs.size()=1 2024-09-12T17:41:33.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.976+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.65uvarQMI59sAA9xhmBjEXW1NcPdet5_0 2024-09-12T17:41:33.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.976+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4558194790788082610', time=2024-09-12T19:32:28.847835+0000, chain.objs.size()=1 2024-09-12T17:41:33.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.976+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.e5BHV9mWJHclzBZmCmtQcigHtua2JEp_0 2024-09-12T17:41:33.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.976+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12237362059741857589', time=2024-09-12T19:32:28.856928+0000, chain.objs.size()=1 2024-09-12T17:41:33.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.976+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.ckE6dH4EK89UgY3b_L2rhk8yuF_Sq2i_0 2024-09-12T17:41:33.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.976+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13582589281945388715', time=2024-09-12T19:32:28.883538+0000, chain.objs.size()=1 2024-09-12T17:41:33.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.976+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.8gS_k9IOy-I0D4JNYjhQrU_DFH8MRUk_0 2024-09-12T17:41:33.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.980+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7719949668369020374', time=2024-09-12T19:32:29.062714+0000, chain.objs.size()=1 2024-09-12T17:41:33.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.980+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.7xvxjgMkjSQrpK0r2h8Vo1NLDhLKyr8_0 2024-09-12T17:41:33.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.980+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3518694585089203828', time=2024-09-12T19:32:29.064185+0000, chain.objs.size()=1 2024-09-12T17:41:33.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.980+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.FN6KnrL8k78lB4_pDT_auOiD6-djn7h_0 2024-09-12T17:41:33.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.980+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3660940711513738330', time=2024-09-12T19:32:29.067874+0000, chain.objs.size()=1 2024-09-12T17:41:33.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.980+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.8CoA9u7GuxLLikkry1QmIROKuGwPvAj_0 2024-09-12T17:41:33.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.980+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14460125009911610123', time=2024-09-12T19:32:29.075469+0000, chain.objs.size()=1 2024-09-12T17:41:33.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.980+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.xjT89baS44VvGS_PHuLjF2LtLr9COSU_0 2024-09-12T17:41:33.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.980+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13410593176756008806', time=2024-09-12T19:32:29.087826+0000, chain.objs.size()=1 2024-09-12T17:41:33.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.980+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.iXSo4Z65Xoo2zg2C6VkG9CFfejN6Yyl_0 2024-09-12T17:41:33.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.980+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15236233576358738849', time=2024-09-12T19:32:29.111918+0000, chain.objs.size()=1 2024-09-12T17:41:33.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.980+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.iQHxMHZ7H6TQiWIio1g19isCN6bAr7k_0 2024-09-12T17:41:33.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.980+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.777482736954601091', time=2024-09-12T19:32:29.365372+0000, chain.objs.size()=1 2024-09-12T17:41:33.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.980+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.S0zUN5Kc8KRIDdB3gF0CU4EtLmLpy0y_0 2024-09-12T17:41:33.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.980+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4529823073519022115', time=2024-09-12T19:32:29.379472+0000, chain.objs.size()=1 2024-09-12T17:41:33.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.980+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.-c973KaI2POjsDB55f044u9nh2Yp59j_0 2024-09-12T17:41:33.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.980+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14890671053518615105', time=2024-09-12T19:32:29.520960+0000, chain.objs.size()=1 2024-09-12T17:41:33.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.980+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.8hzBGm4HXTY2zKmHQ9CamJ2wJFDHWQe_0 2024-09-12T17:41:33.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.980+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13093601639899463074', time=2024-09-12T19:32:29.549533+0000, chain.objs.size()=1 2024-09-12T17:41:33.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.980+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.itxpwnHvIjqPMhurvuuRf3_hXzgvvWL_0 2024-09-12T17:41:33.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.980+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16248444054974362521', time=2024-09-12T19:32:30.002226+0000, chain.objs.size()=1 2024-09-12T17:41:33.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.980+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.EokfPzHpi1qP1erM4nVXQ34ex_iRNLc_0 2024-09-12T17:41:33.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.980+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1663437358192215738', time=2024-09-12T19:32:30.040054+0000, chain.objs.size()=1 2024-09-12T17:41:33.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.980+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.DwGhZG8IFvFzNsz_3MG9-UIrs5P_ubY_0 2024-09-12T17:41:33.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.984+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2577199692212367713', time=2024-09-12T19:32:30.104167+0000, chain.objs.size()=1 2024-09-12T17:41:33.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.984+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.CXKya87TGofir-657a9LPFZ1BiXd4KK_0 2024-09-12T17:41:33.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.984+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8139639558162841219', time=2024-09-12T19:32:30.110555+0000, chain.objs.size()=1 2024-09-12T17:41:33.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.984+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Ng7_qYVeZ3BgalPUlX1uqXow8p0-G5h_0 2024-09-12T17:41:33.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.984+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17474106417026723214', time=2024-09-12T19:32:30.118318+0000, chain.objs.size()=1 2024-09-12T17:41:33.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.984+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.qiibb5cCcaK9iuPmIYRl_yjCMJ0ov9I_0 2024-09-12T17:41:33.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.984+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2865231959970879444', time=2024-09-12T19:32:30.151342+0000, chain.objs.size()=1 2024-09-12T17:41:33.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.984+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.4SalpsSKiZg03Y9VWwsLlGo1LrZQ5Si_0 2024-09-12T17:41:33.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.984+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12237132824805985298', time=2024-09-12T19:32:49.612019+0000, chain.objs.size()=1 2024-09-12T17:41:33.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.984+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.nDvDauixCC4Z4UrzKMBwqLujNgBZ2f7_0 2024-09-12T17:41:33.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.984+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1727644572290205082', time=2024-09-12T19:32:49.841800+0000, chain.objs.size()=1 2024-09-12T17:41:33.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.984+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.G3jFDkdvs3sOnePzU4Byrb8h78FIaNx_0 2024-09-12T17:41:33.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.984+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.326238845607754570', time=2024-09-12T19:32:49.885694+0000, chain.objs.size()=1 2024-09-12T17:41:33.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.984+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.DMGJ9NND9-tDRn3GP4-aygW4pUyy_Af_0 2024-09-12T17:41:33.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.984+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4519990596664325795', time=2024-09-12T19:32:49.888185+0000, chain.objs.size()=1 2024-09-12T17:41:33.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.984+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.XwK2ZuCW27gPR8xi68NKUgFeM2jJJLG_0 2024-09-12T17:41:33.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.984+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10549991287892095748', time=2024-09-12T19:32:49.897537+0000, chain.objs.size()=1 2024-09-12T17:41:33.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.984+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.hOiFr6UJ18flE2rPTRbX1s75nwdY7HT_0 2024-09-12T17:41:33.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.984+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17581166126486764470', time=2024-09-12T19:32:50.006087+0000, chain.objs.size()=1 2024-09-12T17:41:33.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.984+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.1Zt8SpI_EVU8NkWEg3GGKp0Y-sL9LxJ_0 2024-09-12T17:41:33.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.984+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.840841415641047486', time=2024-09-12T19:32:50.205196+0000, chain.objs.size()=1 2024-09-12T17:41:33.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.984+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.-FWMILNOK68FAvvS074D5pDFvcvUIT-_0 2024-09-12T17:41:33.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.984+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14389081964713730508', time=2024-09-12T19:32:50.243403+0000, chain.objs.size()=1 2024-09-12T17:41:33.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.984+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.r2T7vQ_ff8asiM3LMzF69zeA-ytNe1y_0 2024-09-12T17:41:33.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.984+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9783623661092837411', time=2024-09-12T19:32:50.282292+0000, chain.objs.size()=1 2024-09-12T17:41:33.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.984+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.FdbrY4twMpsaCl3s1fg-ZrjjsLpEov4_0 2024-09-12T17:41:33.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.984+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2325946262396843177', time=2024-09-12T19:32:50.582415+0000, chain.objs.size()=1 2024-09-12T17:41:33.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.984+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.hIB1RWEVGA6J0P44JHYMa6ZRm8fSR6A_0 2024-09-12T17:41:33.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.984+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17625181905664270082', time=2024-09-12T19:32:50.895044+0000, chain.objs.size()=1 2024-09-12T17:41:33.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.984+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.CJiChbw6LfCHsZpmiTF5rEcg9X2g-xe_0 2024-09-12T17:41:33.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.988+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2065811208797265261', time=2024-09-12T19:32:50.907231+0000, chain.objs.size()=1 2024-09-12T17:41:33.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.988+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.zbGGItzk7AgACxjBC64IwkBvf-GnvkQ_0 2024-09-12T17:41:33.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.988+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12515989379330873952', time=2024-09-12T19:32:50.937827+0000, chain.objs.size()=1 2024-09-12T17:41:33.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.988+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.hK9DKOPeCQW2D82-EO1tMfEkxjpU-JS_0 2024-09-12T17:41:33.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.988+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47961 2024-09-12T17:41:33.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.988+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=37, truncated=0, next_marker='' 2024-09-12T17:41:33.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.988+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10666082645517853770', time=2024-09-12T19:32:50.964709+0000, chain.objs.size()=1 2024-09-12T17:41:33.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.988+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.VTBllqh04zLgrsdZ6379L11kabsUU6V_0 2024-09-12T17:41:33.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.988+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12818590872136051164', time=2024-09-12T19:32:50.984845+0000, chain.objs.size()=1 2024-09-12T17:41:33.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.988+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.A9plMUjHDAoHHbve3oW0qhMBFc-w8VV_0 2024-09-12T17:41:33.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.988+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16217050329970162853', time=2024-09-12T19:32:51.166522+0000, chain.objs.size()=1 2024-09-12T17:41:33.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.988+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.SGbOxbHr3TIBpDe4fTXY7XeSP-Zl4ZJ_0 2024-09-12T17:41:33.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.988+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16602120901834149586', time=2024-09-12T19:32:51.315627+0000, chain.objs.size()=1 2024-09-12T17:41:33.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.988+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Dr4In0zQIzZ240XGNqW8uXoGu3kN8Ni_0 2024-09-12T17:41:33.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.988+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17729774787796317149', time=2024-09-12T19:32:51.323929+0000, chain.objs.size()=1 2024-09-12T17:41:33.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.988+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.ovXQ9GwMQDgD4FV1TgcbPP4wzW9fMf7_0 2024-09-12T17:41:33.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.988+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14111986457197923075', time=2024-09-12T19:32:51.513628+0000, chain.objs.size()=1 2024-09-12T17:41:33.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.988+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.9ZAaNb3DVVC0bPyBUtQpTBFxPEP9-nx_0 2024-09-12T17:41:33.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.988+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1503008360463524211', time=2024-09-12T19:32:51.647490+0000, chain.objs.size()=1 2024-09-12T17:41:33.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.988+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.eOVkfoJlFqm_UWgKqZpWTttMN53APZq_0 2024-09-12T17:41:33.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.988+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14532634937506502213', time=2024-09-12T19:32:51.852308+0000, chain.objs.size()=1 2024-09-12T17:41:33.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.988+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.9N5Jh7-o5eF36yEO-O_YISlUoR3zIkh_0 2024-09-12T17:41:33.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.988+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15095977536456633442', time=2024-09-12T19:32:51.905550+0000, chain.objs.size()=1 2024-09-12T17:41:33.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.988+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.aEP8DXMGnpURPD6rCqGVgvlZ7F4yFXm_0 2024-09-12T17:41:33.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.988+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14983672857789883792', time=2024-09-12T19:32:51.931975+0000, chain.objs.size()=1 2024-09-12T17:41:33.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.988+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.8YTqnexW2CtWkYqu1if8cKvYXn86Fes_0 2024-09-12T17:41:33.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.988+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.783118579161294986', time=2024-09-12T19:32:51.936435+0000, chain.objs.size()=1 2024-09-12T17:41:33.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.988+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.vXY4GiB6zzKRojc_N9vMncbQenDYYuZ_0 2024-09-12T17:41:33.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.988+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17315509235037057876', time=2024-09-12T19:32:51.966968+0000, chain.objs.size()=1 2024-09-12T17:41:33.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.988+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.IUc6mcLrZR9Ht38FKHZJEaHX8adlJZy_0 2024-09-12T17:41:33.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.992+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3599410103325511286', time=2024-09-12T19:32:51.992400+0000, chain.objs.size()=1 2024-09-12T17:41:33.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.992+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.JaMIUoN9JSwfG7ZRDqp8R7Ta8M9yh7p_0 2024-09-12T17:41:33.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.992+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17575525501796561744', time=2024-09-12T19:32:57.215866+0000, chain.objs.size()=1 2024-09-12T17:41:33.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.992+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.340__shadow_.03MRsJzheWvCE8tBPt9zg_b76QhUpIg_0 2024-09-12T17:41:33.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.992+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12040060041142811646', time=2024-09-12T19:33:08.271980+0000, chain.objs.size()=1 2024-09-12T17:41:33.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.992+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.375__shadow_.6S4LywhTiDIawrYBBowAb26a78uFmQC_0 2024-09-12T17:41:33.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.992+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.935534187539114645', time=2024-09-12T19:33:29.435518+0000, chain.objs.size()=1 2024-09-12T17:41:33.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.992+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.432__shadow_.KBmuAxUCCon1nPR_D2_liz-ITmetpyJ_0 2024-09-12T17:41:33.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.992+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14610884665657517475', time=2024-09-12T19:33:37.931535+0000, chain.objs.size()=1 2024-09-12T17:41:33.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.992+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.454__shadow_.DGUBL-Prs9xpah_ltcHUVBZ8pslXEEA_0 2024-09-12T17:41:33.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.992+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14621493055900937643', time=2024-09-12T19:33:41.372201+0000, chain.objs.size()=1 2024-09-12T17:41:33.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.992+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.460__shadow_.OcpJBXtJJPESjathSsGjlaWOHZda91O_0 2024-09-12T17:41:33.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.992+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17571483042648598354', time=2024-09-12T19:33:43.666993+0000, chain.objs.size()=1 2024-09-12T17:41:33.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.992+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.464__shadow_.E9FBTcF7KuvDH60-jJLEELsI15UlHpt_0 2024-09-12T17:41:33.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.992+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8140563520232794887', time=2024-09-12T19:33:51.208764+0000, chain.objs.size()=1 2024-09-12T17:41:33.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.992+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.487__shadow_.JZCl85gKY01vnh_owsvoriOAzF_0HP2_0 2024-09-12T17:41:33.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.992+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16019378133832996970', time=2024-09-12T19:33:51.210367+0000, chain.objs.size()=1 2024-09-12T17:41:33.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.992+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.487__shadow_.JZCl85gKY01vnh_owsvoriOAzF_0HP2_0 2024-09-12T17:41:33.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.992+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14411236019625815853', time=2024-09-12T19:33:51.647158+0000, chain.objs.size()=1 2024-09-12T17:41:33.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.992+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.488__shadow_.MyWObROKuDaZ9tItgIBYoKUO7lcOMQZ_0 2024-09-12T17:41:33.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.992+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15419972104503339119', time=2024-09-12T19:33:52.012611+0000, chain.objs.size()=1 2024-09-12T17:41:33.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.992+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.489__shadow_.cZZyBrcyT3Mdl_wXNXlrlwOPpfbOIC0_0 2024-09-12T17:41:33.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.992+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4559358879916206185', time=2024-09-12T19:34:01.263911+0000, chain.objs.size()=1 2024-09-12T17:41:33.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.992+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.511__multipart_mymultipart.2~P3SwejCECONnaZ5i0bjO2b0D1ZcZPxa.1 2024-09-12T17:41:33.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.996+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5174465708116327832', time=2024-09-12T19:34:24.276818+0000, chain.objs.size()=3 2024-09-12T17:41:33.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.996+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.525__multipart_mymultipart.2~tUPYXRUKwZTGWI5jJU0qi-LojEXX3YL.1 2024-09-12T17:41:33.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.996+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.525__multipart_mymultipart.2~tUPYXRUKwZTGWI5jJU0qi-LojEXX3YL.2 2024-09-12T17:41:33.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.996+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.525__multipart_mymultipart.2~tUPYXRUKwZTGWI5jJU0qi-LojEXX3YL.3 2024-09-12T17:41:33.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.996+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.457228805457191466', time=2024-09-12T19:35:17.200520+0000, chain.objs.size()=1 2024-09-12T17:41:33.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.996+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.569__shadow:Gn-ypIUzyFRqsVNLsijyZH3PfrzsSHy_.JQgbjUyUJ28gSQdxN2lHWUEnntE8lgt_0 2024-09-12T17:41:33.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.996+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15697853071047367179', time=2024-09-12T19:35:26.683781+0000, chain.objs.size()=1 2024-09-12T17:41:33.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.996+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.574__shadow_.61wbCiUUburA-lRJjmz6m3uMBuk25Ds_0 2024-09-12T17:41:33.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.996+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13490125615517670004', time=2024-09-12T19:35:42.418252+0000, chain.objs.size()=1 2024-09-12T17:41:33.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.996+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.577__shadow:ugPTRfPaFgfTMdz9yYwOI0G9ggE5NCW_.o0fhVOsWU6XUSfKNDEHeLaxaI6NOB64_0 2024-09-12T17:41:33.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.996+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8374055124125495743', time=2024-09-12T19:35:54.133329+0000, chain.objs.size()=1 2024-09-12T17:41:33.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.996+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.579__shadow:n2dIKGyqYaefzWhHg57fFXjIP1g7Pp-_.SGk1FPoY8K15eUpCLzolDvsbFH4bYTV_0 2024-09-12T17:41:33.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.996+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8803103260396443759', time=2024-09-12T19:35:55.520279+0000, chain.objs.size()=1 2024-09-12T17:41:33.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.996+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.580__shadow:poCnLVLzAbdV6gjPIQFyco37HLje8y9_.n23XEbNh5XDaH_EAtK2tTLLFrN38shm_0 2024-09-12T17:41:33.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.996+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6996704151318720805', time=2024-09-12T19:35:58.641283+0000, chain.objs.size()=1 2024-09-12T17:41:33.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.996+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.586__shadow:fxzrbvCO7ZAAy68TVtnU0ao2QAdYK3k_.b3dUPNp4blO8VxeQHxsp_HsKSRKcpd2_0 2024-09-12T17:41:33.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.996+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6357595649011653998', time=2024-09-12T19:36:04.071514+0000, chain.objs.size()=1 2024-09-12T17:41:33.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.996+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.603__shadow_.voaoB6NLqnvvFKJQldSSv2Tm5F_q2t2_0 2024-09-12T17:41:33.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.996+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12234110795595824789', time=2024-09-12T19:36:12.687503+0000, chain.objs.size()=12 2024-09-12T17:41:33.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.996+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.614__multipart_multipart_enc.2~UWQoCSr6TszTstuJDKVpsbp_nOZx0IK.1 2024-09-12T17:41:33.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.996+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.614__shadow_multipart_enc.2~UWQoCSr6TszTstuJDKVpsbp_nOZx0IK.1_1 2024-09-12T17:41:33.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.996+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.614__multipart_multipart_enc.2~UWQoCSr6TszTstuJDKVpsbp_nOZx0IK.2 2024-09-12T17:41:33.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.996+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.614__shadow_multipart_enc.2~UWQoCSr6TszTstuJDKVpsbp_nOZx0IK.2_1 2024-09-12T17:41:33.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.996+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.614__multipart_multipart_enc.2~UWQoCSr6TszTstuJDKVpsbp_nOZx0IK.3 2024-09-12T17:41:33.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.996+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.614__shadow_multipart_enc.2~UWQoCSr6TszTstuJDKVpsbp_nOZx0IK.3_1 2024-09-12T17:41:33.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:32.996+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.614__multipart_multipart_enc.2~UWQoCSr6TszTstuJDKVpsbp_nOZx0IK.4 2024-09-12T17:41:33.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.000+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.614__shadow_multipart_enc.2~UWQoCSr6TszTstuJDKVpsbp_nOZx0IK.4_1 2024-09-12T17:41:33.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.000+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.614__multipart_multipart_enc.2~UWQoCSr6TszTstuJDKVpsbp_nOZx0IK.5 2024-09-12T17:41:33.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.000+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.614__shadow_multipart_enc.2~UWQoCSr6TszTstuJDKVpsbp_nOZx0IK.5_1 2024-09-12T17:41:33.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.000+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.614__multipart_multipart_enc.2~UWQoCSr6TszTstuJDKVpsbp_nOZx0IK.6 2024-09-12T17:41:33.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.000+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.614__shadow_multipart_enc.2~UWQoCSr6TszTstuJDKVpsbp_nOZx0IK.6_1 2024-09-12T17:41:33.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.000+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17083954459655534909', time=2024-09-12T19:38:27.283443+0000, chain.objs.size()=1 2024-09-12T17:41:33.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.000+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.636__shadow_.zhc7tmv6pUgFzCmeCaRYXx9blxFBd6S_0 2024-09-12T17:41:33.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.000+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10815712733205436328', time=2024-09-12T19:38:36.226749+0000, chain.objs.size()=1 2024-09-12T17:41:33.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.000+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.655__shadow_.QAWBoDWB9kOGhJEabiQKz4x5gmcckZ9_0 2024-09-12T17:41:33.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.000+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18135730817334720407', time=2024-09-12T19:38:43.997581+0000, chain.objs.size()=1 2024-09-12T17:41:33.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.000+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.666__shadow_.6yM3IhvPKvvcxqZCaull2b-TeKhjMky_0 2024-09-12T17:41:33.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.000+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3368272786999581960', time=2024-09-12T19:39:30.522306+0000, chain.objs.size()=1 2024-09-12T17:41:33.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.000+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.740__shadow_.ChIrimT6K8rS2asQ68NMiyNIpoC-cKE_0 2024-09-12T17:41:33.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.004+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:41:33.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.008+0000 7fd765adf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:41:33.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.008+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:41:33.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.008+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:41:33.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.012+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46580' 2024-09-12T17:41:33.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.012+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14755510160306597288', time=2024-09-12T19:29:44.707187+0000, chain.objs.size()=3 2024-09-12T17:41:33.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.012+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.160__shadow_.i_PxUNpxsgh9YfFs0Sz5eTB0i_Q6K-w_0 2024-09-12T17:41:33.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.012+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.160__shadow_.i_PxUNpxsgh9YfFs0Sz5eTB0i_Q6K-w_1 2024-09-12T17:41:33.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.012+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.160__shadow_.i_PxUNpxsgh9YfFs0Sz5eTB0i_Q6K-w_2 2024-09-12T17:41:33.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.012+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14447415236787283682', time=2024-09-12T19:29:51.277099+0000, chain.objs.size()=1 2024-09-12T17:41:33.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.012+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.170__shadow_.qnhcT0V94swDVE-UQ9juwMptzrecbMV_0 2024-09-12T17:41:33.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.012+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11360659626376497802', time=2024-09-12T19:30:05.951603+0000, chain.objs.size()=1 2024-09-12T17:41:33.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.012+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.199__shadow_._CV6r3jbsbred_5gX6oJof_JYVwS34P_0 2024-09-12T17:41:33.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.012+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4078236237087316953', time=2024-09-12T19:31:15.028199+0000, chain.objs.size()=1 2024-09-12T17:41:33.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.012+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.241__shadow_.t05L2z5_wEZ1D_N-uPOOIbJqcs0Fanf_0 2024-09-12T17:41:33.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.012+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12106875845516215874', time=2024-09-12T19:31:16.402818+0000, chain.objs.size()=1 2024-09-12T17:41:33.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.012+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.244__shadow_.HbAzJlPD9lxoNh04vlo55feEKPOT1ZH_0 2024-09-12T17:41:33.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.012+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10998403987656537605', time=2024-09-12T19:31:19.070922+0000, chain.objs.size()=1 2024-09-12T17:41:33.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.012+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.251__shadow_._PRdl354R6OUZAnWjeAOcRQRICt_fd9_0 2024-09-12T17:41:33.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.012+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13502102002204743356', time=2024-09-12T19:31:20.245831+0000, chain.objs.size()=1 2024-09-12T17:41:33.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.012+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.254__shadow_.gW_FO6uC3ajpaE816D1n1chpVBMb8-c_0 2024-09-12T17:41:33.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.012+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5937308127021750071', time=2024-09-12T19:31:21.721693+0000, chain.objs.size()=1 2024-09-12T17:41:33.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.012+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.258__shadow_.Qee1Pfzy2_vHeZwmBOFAnSNeE2Ofh6U_0 2024-09-12T17:41:33.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.012+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9691778549958148973', time=2024-09-12T19:31:42.371323+0000, chain.objs.size()=1 2024-09-12T17:41:33.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.012+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.e5zGWMs8PnUPx45eg250JpUjaPvNd38_0 2024-09-12T17:41:33.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.012+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8422975296117867573', time=2024-09-12T19:31:42.392751+0000, chain.objs.size()=1 2024-09-12T17:41:33.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.012+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.U5h1rNdiZzTrekWOKkikeyAd6FsFg3q_0 2024-09-12T17:41:33.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.012+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4943984451031323165', time=2024-09-12T19:31:42.406007+0000, chain.objs.size()=1 2024-09-12T17:41:33.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.012+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.TigOZho2EnP-g5S-EF-vBPWAcOJ-IOh_0 2024-09-12T17:41:33.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.012+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.180890203803598378', time=2024-09-12T19:31:42.412232+0000, chain.objs.size()=1 2024-09-12T17:41:33.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.012+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.BV7Gw9ZwqTX5IfRtW3NhuyZ8UeGgAl3_0 2024-09-12T17:41:33.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.012+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2883421157811371007', time=2024-09-12T19:31:42.432943+0000, chain.objs.size()=1 2024-09-12T17:41:33.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.012+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.EPKjBFXR3J9zHp_THXehEh3BLbaWocR_0 2024-09-12T17:41:33.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.012+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4169863980373653184', time=2024-09-12T19:31:42.453600+0000, chain.objs.size()=1 2024-09-12T17:41:33.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.012+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.g0AGSFaxwplI4tyAd9ATvrUJ3_wWPj7_0 2024-09-12T17:41:33.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.012+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17627809039606113427', time=2024-09-12T19:31:42.473094+0000, chain.objs.size()=1 2024-09-12T17:41:33.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.012+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.TyucDI2lWcc3mtsKRaLb-tGJkSETorx_0 2024-09-12T17:41:33.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.012+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17008195960880178081', time=2024-09-12T19:31:42.582216+0000, chain.objs.size()=1 2024-09-12T17:41:33.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.012+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.53MRYaKx2yugf0cpVpi1UIC4u_uWDeJ_0 2024-09-12T17:41:33.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.012+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4560345098024292323', time=2024-09-12T19:31:42.596683+0000, chain.objs.size()=1 2024-09-12T17:41:33.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.012+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.U3hlRZpYdr8ukbt0344zvPYL-VaVLZN_0 2024-09-12T17:41:33.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.012+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14275674065671680309', time=2024-09-12T19:31:42.608965+0000, chain.objs.size()=1 2024-09-12T17:41:33.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.012+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.oI0pQ49qBoN_iliIEh1ZW5g03ePFFEA_0 2024-09-12T17:41:33.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.012+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11255629790179761566', time=2024-09-12T19:31:42.613890+0000, chain.objs.size()=1 2024-09-12T17:41:33.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.012+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.4L8FIa0GigTxoLb3IpHe00tZBLnuS2Y_0 2024-09-12T17:41:33.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.012+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11257472614006109833', time=2024-09-12T19:31:42.668721+0000, chain.objs.size()=1 2024-09-12T17:41:33.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.012+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.DnS3NJK3KBo2Cd-GNhAM-YAj1BnSJYy_0 2024-09-12T17:41:33.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.012+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4790337233963620352', time=2024-09-12T19:31:42.798227+0000, chain.objs.size()=1 2024-09-12T17:41:33.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.012+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_._-S7LSjiATc0fVMxFg15xK_sR51kWHr_0 2024-09-12T17:41:33.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.016+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14221832385285865463', time=2024-09-12T19:31:42.831385+0000, chain.objs.size()=1 2024-09-12T17:41:33.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.016+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.hIGTfb4owxL1eB4NUslA3o5v-lUwOUQ_0 2024-09-12T17:41:33.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.016+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4298277186641874115', time=2024-09-12T19:31:42.832921+0000, chain.objs.size()=1 2024-09-12T17:41:33.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.016+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.FngHOyQo_1S9yfGGzkXm3v7PntceV4O_0 2024-09-12T17:41:33.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.016+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15744818205872220133', time=2024-09-12T19:31:42.859713+0000, chain.objs.size()=1 2024-09-12T17:41:33.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.016+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.9WGYLxTLAzydabB18pgfuLngw1HnXgz_0 2024-09-12T17:41:33.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.016+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4179234321573331651', time=2024-09-12T19:31:42.906787+0000, chain.objs.size()=1 2024-09-12T17:41:33.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.016+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.eKLKCLaFTzyWgKwEONfmaoyU2iif2vg_0 2024-09-12T17:41:33.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.016+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12094490705740402149', time=2024-09-12T19:31:43.122236+0000, chain.objs.size()=1 2024-09-12T17:41:33.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.016+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.KRfLvCtrS42tN_UtzUppEZkhaAmW2pI_0 2024-09-12T17:41:33.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.016+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.200477377194067005', time=2024-09-12T19:31:43.201755+0000, chain.objs.size()=1 2024-09-12T17:41:33.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.016+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.QfVjNL1gQoqWpRP2CxmKuiHkok6SmqU_0 2024-09-12T17:41:33.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.016+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3369152403185181178', time=2024-09-12T19:31:43.263921+0000, chain.objs.size()=1 2024-09-12T17:41:33.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.016+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.xDkOfQuJzx3T3iUXfvqJwzgxEL00Qhm_0 2024-09-12T17:41:33.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.016+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7395098842499142760', time=2024-09-12T19:31:43.446870+0000, chain.objs.size()=1 2024-09-12T17:41:33.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.016+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.pxStbIADnfFe7Ci63lIc_LIWRHzDFRf_0 2024-09-12T17:41:33.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.016+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15678771103581001773', time=2024-09-12T19:31:43.573729+0000, chain.objs.size()=1 2024-09-12T17:41:33.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.016+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.PmAELRQIhyW6m6MexDnrTgDXYa0K0dF_0 2024-09-12T17:41:33.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.016+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16021073714290768486', time=2024-09-12T19:31:43.603522+0000, chain.objs.size()=1 2024-09-12T17:41:33.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.016+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.1JTqMkoYiRGGLnMIh9614GwygECgLeN_0 2024-09-12T17:41:33.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.016+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13399678640995492605', time=2024-09-12T19:31:43.604312+0000, chain.objs.size()=1 2024-09-12T17:41:33.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.016+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.QzqJoAe_dSj6Y8HNvG8eNwLPDMwLjY9_0 2024-09-12T17:41:33.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.016+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9123514315912014388', time=2024-09-12T19:31:43.774274+0000, chain.objs.size()=1 2024-09-12T17:41:33.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.016+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.KutcT1xO77rWl4jvfWF0uepOCUGauCj_0 2024-09-12T17:41:33.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.020+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9861111213415543472', time=2024-09-12T19:31:43.917265+0000, chain.objs.size()=1 2024-09-12T17:41:33.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.020+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.G-6MxcpmYEAqmQ7YBmQzfYBqt2moPle_0 2024-09-12T17:41:33.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.020+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14195782135334153299', time=2024-09-12T19:31:43.918021+0000, chain.objs.size()=1 2024-09-12T17:41:33.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.020+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.knKsvs_cn6uAMZ6pp8_j3W2KX7aLUcn_0 2024-09-12T17:41:33.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.020+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16400794776625994785', time=2024-09-12T19:31:44.089485+0000, chain.objs.size()=1 2024-09-12T17:41:33.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.020+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.TrQRWSWejJdl6i-yPbYg4S1_30i9_dW_0 2024-09-12T17:41:33.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.020+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5801096691620560601', time=2024-09-12T19:31:44.128885+0000, chain.objs.size()=1 2024-09-12T17:41:33.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.020+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.fIW-5poRzqEA_my33TSCcjQD5M8rhsT_0 2024-09-12T17:41:33.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.020+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14167664853918797856', time=2024-09-12T19:31:44.218558+0000, chain.objs.size()=1 2024-09-12T17:41:33.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.020+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.h9ycYYyN8xJCef_X7my9Uj4bwbTTyH3_0 2024-09-12T17:41:33.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.020+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17861165056762696416', time=2024-09-12T19:31:44.388351+0000, chain.objs.size()=1 2024-09-12T17:41:33.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.020+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.uJn4NXZ8KXKzsX3esMIQvZ1bX0uq3Z4_0 2024-09-12T17:41:33.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.020+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1517385532397177449', time=2024-09-12T19:31:44.418685+0000, chain.objs.size()=1 2024-09-12T17:41:33.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.020+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.HfXvKGG6aFKUmcZOFdYt4zxHP2c9p3s_0 2024-09-12T17:41:33.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.020+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17640535889654025318', time=2024-09-12T19:31:44.532454+0000, chain.objs.size()=1 2024-09-12T17:41:33.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.020+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.hNJXjbelfMzRbj1NaB4Y_WC_2OF4AbV_0 2024-09-12T17:41:33.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.020+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4758408396943992179', time=2024-09-12T19:31:47.304953+0000, chain.objs.size()=1 2024-09-12T17:41:33.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.020+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.270__shadow_.48njql136lvQWQS-8GZhPxN1DnMLTt3_0 2024-09-12T17:41:33.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.020+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12527323676267469410', time=2024-09-12T19:31:48.727651+0000, chain.objs.size()=1 2024-09-12T17:41:33.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.020+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.274__shadow_.tRZ5n4RB2JycNOsJ6JybPh_0Vfm2JRQ_0 2024-09-12T17:41:33.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.020+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10483900344379129393', time=2024-09-12T19:31:51.443567+0000, chain.objs.size()=1 2024-09-12T17:41:33.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.020+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.281__shadow_.rAeA03TW8pOWipNPPdicID0IVQvqhPO_0 2024-09-12T17:41:33.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.020+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1476442764090569760', time=2024-09-12T19:31:52.202328+0000, chain.objs.size()=1 2024-09-12T17:41:33.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.020+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.283__shadow_.eSFn8c9IMktZ-IKiz9QuQ-BNKo2vh75_0 2024-09-12T17:41:33.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.020+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14010201315943333912', time=2024-09-12T19:31:53.439065+0000, chain.objs.size()=1 2024-09-12T17:41:33.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.020+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.286__shadow_.XplHmfohL4K-WhQxQ_2twvM8VZS1-Vf_0 2024-09-12T17:41:33.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.020+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7304082960746924801', time=2024-09-12T19:31:56.450552+0000, chain.objs.size()=1 2024-09-12T17:41:33.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.020+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.292__shadow_.Yuwcgb0311hy6salfF5a75y_so13Iwd_0 2024-09-12T17:41:33.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.020+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3065523911238315358', time=2024-09-12T19:32:00.001817+0000, chain.objs.size()=1 2024-09-12T17:41:33.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.020+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.299__shadow_.RQUqVd3ixNqpxBImO2N8Hy97zHEtQel_0 2024-09-12T17:41:33.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.020+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10536955386758974915', time=2024-09-12T19:32:03.631252+0000, chain.objs.size()=1 2024-09-12T17:41:33.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.020+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.307__shadow:EOdp1OiN4LT7XoF6t6I.AuxaiTQmN5u_.oTTXGe36W6JXqx5yOxlWNgf29kHen3H_0 2024-09-12T17:41:33.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.020+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.937839948038132928', time=2024-09-12T19:32:27.868921+0000, chain.objs.size()=1 2024-09-12T17:41:33.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.020+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.NIQ607QZKsNeNxDul42CXDssExmwhEW_0 2024-09-12T17:41:33.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.020+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2121563050033632642', time=2024-09-12T19:32:27.963333+0000, chain.objs.size()=1 2024-09-12T17:41:33.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.020+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.J0boqgh4qbU2o0sxk2ad0I67Tss6b8m_0 2024-09-12T17:41:33.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.024+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17472340428619082834', time=2024-09-12T19:32:28.096855+0000, chain.objs.size()=1 2024-09-12T17:41:33.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.024+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.e-_FNRP56usNGoaJHl0UVy6imUo3hgK_0 2024-09-12T17:41:33.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.024+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11984205545089773153', time=2024-09-12T19:32:28.226961+0000, chain.objs.size()=1 2024-09-12T17:41:33.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.024+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.4BxsKBiBzcHUo_oe6IwrupGQ9mFT6k7_0 2024-09-12T17:41:33.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.024+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9496822971959202492', time=2024-09-12T19:32:28.249053+0000, chain.objs.size()=1 2024-09-12T17:41:33.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.024+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.j0pxoCMOwICfReFq9i7Skhwpi5BzRK5_0 2024-09-12T17:41:33.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.024+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17721814838994234992', time=2024-09-12T19:32:28.384478+0000, chain.objs.size()=1 2024-09-12T17:41:33.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.024+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.CAbotZuvX_-QJ9g_xTuT4vhZQ1U_Lt2_0 2024-09-12T17:41:33.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.024+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8739024660100584585', time=2024-09-12T19:32:28.428208+0000, chain.objs.size()=1 2024-09-12T17:41:33.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.024+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.TxprihnK6ajOw1evjz1vlmGuEkXSRjC_0 2024-09-12T17:41:33.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.024+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14755892937229858173', time=2024-09-12T19:32:28.489521+0000, chain.objs.size()=1 2024-09-12T17:41:33.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.024+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.0jTdXRR24vY3T8rIiUkyCDkO8CgBFmm_0 2024-09-12T17:41:33.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.024+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12323585289570313891', time=2024-09-12T19:32:28.506603+0000, chain.objs.size()=1 2024-09-12T17:41:33.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.024+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.bBoRiflN2EKcxWTUx0lNQ0prgAvdTcd_0 2024-09-12T17:41:33.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.024+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13927192954423216160', time=2024-09-12T19:32:28.555595+0000, chain.objs.size()=1 2024-09-12T17:41:33.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.024+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.QCzGpN6Eg1s7BksWurcSAr6JiCq_ymA_0 2024-09-12T17:41:33.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.024+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12428934557869448871', time=2024-09-12T19:32:28.816401+0000, chain.objs.size()=1 2024-09-12T17:41:33.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.024+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.s3tTvqP1c6DNBiMp7QFlOBbVvRDtXTG_0 2024-09-12T17:41:33.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.024+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17648823053100164697', time=2024-09-12T19:32:28.821799+0000, chain.objs.size()=1 2024-09-12T17:41:33.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.024+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.SV11VfuEe3FvYKCr2MWjqLV5TlcmQTI_0 2024-09-12T17:41:33.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.024+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8023017050660007283', time=2024-09-12T19:32:28.840318+0000, chain.objs.size()=1 2024-09-12T17:41:33.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.024+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.QsW2jrDiVMAEdP3T_4s2jwi-V57OthL_0 2024-09-12T17:41:33.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.024+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17869956511297729232', time=2024-09-12T19:32:28.870386+0000, chain.objs.size()=1 2024-09-12T17:41:33.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.024+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.HwhC7Q7cXk7hj2tmN-hKUbBMsq9XlYe_0 2024-09-12T17:41:33.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.024+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14313730380766726285', time=2024-09-12T19:32:29.098380+0000, chain.objs.size()=1 2024-09-12T17:41:33.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.024+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.4OU0nBcYAe8DeuDFWp7wS4rdLJKsuI4_0 2024-09-12T17:41:33.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.024+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3114265436962969412', time=2024-09-12T19:32:29.366781+0000, chain.objs.size()=1 2024-09-12T17:41:33.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.024+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.RXlpydh7huJXQyASzyQkABZc0mVUXVz_0 2024-09-12T17:41:33.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.024+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10429503165756102519', time=2024-09-12T19:32:29.428374+0000, chain.objs.size()=1 2024-09-12T17:41:33.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.024+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Stt7EaBMiRqKX3Y7ch-nVjVYlf1VDiz_0 2024-09-12T17:41:33.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.024+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1149096388074122276', time=2024-09-12T19:32:29.453152+0000, chain.objs.size()=1 2024-09-12T17:41:33.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.024+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.gcv_BkXRyzuRkxVcZ-XRTjij83dwmQM_0 2024-09-12T17:41:33.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.024+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18273422393800719174', time=2024-09-12T19:32:29.487974+0000, chain.objs.size()=1 2024-09-12T17:41:33.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.024+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.qN71hXn2sK33SgX109K9UCWUnKlpuZ1_0 2024-09-12T17:41:33.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.024+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11129612593117113049', time=2024-09-12T19:32:29.511382+0000, chain.objs.size()=1 2024-09-12T17:41:33.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.024+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.G1iJdv1viU2iAl6jkSrL_rl4FZ5pJvF_0 2024-09-12T17:41:33.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.024+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15143593116956210107', time=2024-09-12T19:32:29.758764+0000, chain.objs.size()=1 2024-09-12T17:41:33.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.024+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.yHLm0COIpO_YGWv6HdKfil5vTJuYM39_0 2024-09-12T17:41:33.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.024+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10747104053718720160', time=2024-09-12T19:32:29.767784+0000, chain.objs.size()=1 2024-09-12T17:41:33.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.024+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.rOHQndbHRvJJid851iwy90VoasEGrm9_0 2024-09-12T17:41:33.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.024+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14209040345714185498', time=2024-09-12T19:32:29.803584+0000, chain.objs.size()=1 2024-09-12T17:41:33.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.024+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_._hjYB4xtnviVOFpQs0vYWRgLwy_Sgxe_0 2024-09-12T17:41:33.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.024+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5474829065211734925', time=2024-09-12T19:32:29.842802+0000, chain.objs.size()=1 2024-09-12T17:41:33.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.024+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.UjjtKVGkyP48udrMqKFkX4TqJrdHxQA_0 2024-09-12T17:41:33.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.028+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2911143350683368516', time=2024-09-12T19:32:29.848412+0000, chain.objs.size()=1 2024-09-12T17:41:33.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.028+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.AVZ5Gm0HNwucyqMsGkrH2KovP0cVDtQ_0 2024-09-12T17:41:33.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.028+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5643143300201748739', time=2024-09-12T19:32:29.860338+0000, chain.objs.size()=1 2024-09-12T17:41:33.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.028+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.S9761TLHFiVJp4NMnRxjMqNL77JDMXH_0 2024-09-12T17:41:33.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.028+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6449031057862418643', time=2024-09-12T19:32:30.152732+0000, chain.objs.size()=1 2024-09-12T17:41:33.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.028+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.gdADei1kIKXIZYTHmWlbcRyzuYNIXMZ_0 2024-09-12T17:41:33.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.028+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8980240838155700180', time=2024-09-12T19:32:49.549792+0000, chain.objs.size()=1 2024-09-12T17:41:33.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.028+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.cPVdP-d-Z32rM2QsPBY9vKta-LQDUlg_0 2024-09-12T17:41:33.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.028+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5361368674816128853', time=2024-09-12T19:32:49.603990+0000, chain.objs.size()=1 2024-09-12T17:41:33.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.028+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.LvPtVO_u6daZ-F6zwvuEvpRg2srqvUb_0 2024-09-12T17:41:33.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.028+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14090289136977199482', time=2024-09-12T19:32:49.666629+0000, chain.objs.size()=1 2024-09-12T17:41:33.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.028+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Lrc5x5e8Z-kqMdAp7KWrZCze1Ku4Z_l_0 2024-09-12T17:41:33.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.028+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11012482562537187105', time=2024-09-12T19:32:49.686483+0000, chain.objs.size()=1 2024-09-12T17:41:33.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.028+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.TMdO6BdxGJtKd9RQURFwR0qFrphxv8S_0 2024-09-12T17:41:33.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.028+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18330196818917860601', time=2024-09-12T19:32:49.697342+0000, chain.objs.size()=1 2024-09-12T17:41:33.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.028+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.ksmtY7HcCdIgcQld_HnOfGRIFEfz1-Z_0 2024-09-12T17:41:33.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.028+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8896779895210096778', time=2024-09-12T19:32:49.735719+0000, chain.objs.size()=1 2024-09-12T17:41:33.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.028+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.7lFdawYMPovRwGjvxKXVAobJFLlPv3v_0 2024-09-12T17:41:33.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.028+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17025676973201249316', time=2024-09-12T19:32:49.756403+0000, chain.objs.size()=1 2024-09-12T17:41:33.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.028+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.OVIw6CgkIVDJhBlxvfsU6BUprONUod5_0 2024-09-12T17:41:33.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.028+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18405443143130144223', time=2024-09-12T19:32:49.827441+0000, chain.objs.size()=1 2024-09-12T17:41:33.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.028+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_._xXvP_s8dspFXvF6iDMtaHWkBxwlsRd_0 2024-09-12T17:41:33.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.028+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7787490705120474456', time=2024-09-12T19:32:49.830397+0000, chain.objs.size()=1 2024-09-12T17:41:33.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.028+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.5GQz0SJcMXDZKo1srv50KoAWrWAM2i6_0 2024-09-12T17:41:33.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.032+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14145965276675098160', time=2024-09-12T19:32:49.837069+0000, chain.objs.size()=1 2024-09-12T17:41:33.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.032+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Fsi36jfK_k7QstlKH813XLaoI4h39vw_0 2024-09-12T17:41:33.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.032+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1318724199698809801', time=2024-09-12T19:32:49.986232+0000, chain.objs.size()=1 2024-09-12T17:41:33.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.032+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.pDqhnxyVLAOqNiWIdVAOqYiqOCAs0kq_0 2024-09-12T17:41:33.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.032+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3403623318096193919', time=2024-09-12T19:32:50.137864+0000, chain.objs.size()=1 2024-09-12T17:41:33.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.032+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.MLRTypfms7mWIj_bgKvF3j7J8c23Xqy_0 2024-09-12T17:41:33.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.032+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4140398356438790413', time=2024-09-12T19:32:50.228237+0000, chain.objs.size()=1 2024-09-12T17:41:33.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.032+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.FOzMFEjAaouUoCXqWjvVXSPTlTP1Rt0_0 2024-09-12T17:41:33.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.032+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8285775194458058739', time=2024-09-12T19:32:50.236107+0000, chain.objs.size()=1 2024-09-12T17:41:33.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.032+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.ATEIG0qAxM8LJ3D8qKwl6iPQGqAijhz_0 2024-09-12T17:41:33.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.032+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8114575668054261897', time=2024-09-12T19:32:50.292179+0000, chain.objs.size()=1 2024-09-12T17:41:33.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.032+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.oxML9lgC-JbAUUbf-jbu6C4f76u75kJ_0 2024-09-12T17:41:33.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.032+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8838534492412579005', time=2024-09-12T19:32:50.314032+0000, chain.objs.size()=1 2024-09-12T17:41:33.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.032+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.iV8Ij1be6PjJXBRaEKyMGWReJ5ZX8fC_0 2024-09-12T17:41:33.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.032+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12307935526048149253', time=2024-09-12T19:32:50.497377+0000, chain.objs.size()=1 2024-09-12T17:41:33.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.032+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.8D52VT81grPsJej0WGRuVzC-9mYqWNA_0 2024-09-12T17:41:33.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.032+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5572036356127873303', time=2024-09-12T19:32:50.627164+0000, chain.objs.size()=1 2024-09-12T17:41:33.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.032+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.8a0ZaSxr18HqxccbYudm_Fagcsw6hEH_0 2024-09-12T17:41:33.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.032+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2873559444885507545', time=2024-09-12T19:32:50.660581+0000, chain.objs.size()=1 2024-09-12T17:41:33.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.032+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.sLmHUuefd-RsSKhBT10eouMWJfEq-Aq_0 2024-09-12T17:41:33.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.032+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14474790427946066833', time=2024-09-12T19:32:50.925412+0000, chain.objs.size()=1 2024-09-12T17:41:33.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.032+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.6QF_cavZHQ_m0Y2LGEMydChutsg6XDL_0 2024-09-12T17:41:33.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.032+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5507565459039245095', time=2024-09-12T19:32:50.934442+0000, chain.objs.size()=1 2024-09-12T17:41:33.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.032+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.0YyBXMVUoUWTDuZwzgUZWHYPWaptfZu_0 2024-09-12T17:41:33.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.032+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12816077968038320601', time=2024-09-12T19:32:50.996506+0000, chain.objs.size()=1 2024-09-12T17:41:33.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.032+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.2zQH7hX4MSfcGHFdks6lwOEd1F_N8Xx_0 2024-09-12T17:41:33.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.032+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9773041350094935281', time=2024-09-12T19:32:51.201203+0000, chain.objs.size()=1 2024-09-12T17:41:33.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.032+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.3-MqlsihK-nn2X7wdko2hjpkiXwJv43_0 2024-09-12T17:41:33.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.036+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17087538607846804045', time=2024-09-12T19:32:51.221551+0000, chain.objs.size()=1 2024-09-12T17:41:33.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.036+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.8IzgNfnoc9tLtbyP3ZC1uaUvmGbeHHU_0 2024-09-12T17:41:33.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.036+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/46580 2024-09-12T17:41:33.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.036+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-12T17:41:33.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.036+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11059180675008179974', time=2024-09-12T19:32:51.239286+0000, chain.objs.size()=1 2024-09-12T17:41:33.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.036+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.lOwNRW_2r48VtVVbIpGdy8xukIz25UJ_0 2024-09-12T17:41:33.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.036+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4109524687324309655', time=2024-09-12T19:32:51.252983+0000, chain.objs.size()=1 2024-09-12T17:41:33.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.036+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.HLfk6uJbEvYgucLUvLnldnHvJPoXCgj_0 2024-09-12T17:41:33.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.036+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10121536916168948573', time=2024-09-12T19:32:51.256047+0000, chain.objs.size()=1 2024-09-12T17:41:33.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.036+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.t4ulXzodt47UGtN3doxalBk3fsqDFbX_0 2024-09-12T17:41:33.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.036+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12823793103936244405', time=2024-09-12T19:32:51.272897+0000, chain.objs.size()=1 2024-09-12T17:41:33.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.036+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.34Lt2T0_TfAR-4UQNuHsU7_8X37B3Ld_0 2024-09-12T17:41:33.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.036+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16267835015543441444', time=2024-09-12T19:32:51.866839+0000, chain.objs.size()=1 2024-09-12T17:41:33.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.036+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.OM0s3iEXtaz5EpPXf0sdnApGHfmOG9d_0 2024-09-12T17:41:33.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.036+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5043003070532149306', time=2024-09-12T19:32:51.877726+0000, chain.objs.size()=1 2024-09-12T17:41:33.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.036+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.QUtiiGGFQmRwteRbpNAuq_fImLwhKFJ_0 2024-09-12T17:41:33.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.040+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1532547708088955278', time=2024-09-12T19:32:51.958385+0000, chain.objs.size()=1 2024-09-12T17:41:33.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.040+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.1dLZwWU2eMfmofqKURSmBwDmAAajp-K_0 2024-09-12T17:41:33.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.040+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9536231269587023631', time=2024-09-12T19:32:55.313735+0000, chain.objs.size()=1 2024-09-12T17:41:33.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.040+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.334__shadow_.uK0yl4wC0Czbqo1CEvATL0KzNCm7ZVG_0 2024-09-12T17:41:33.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.040+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.147786943883666794', time=2024-09-12T19:33:13.985041+0000, chain.objs.size()=1 2024-09-12T17:41:33.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.040+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.390__shadow_.xy43vA3PapWwYjOoS0pIuCXp_DC7vLu_0 2024-09-12T17:41:33.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.040+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17321357172978491863', time=2024-09-12T19:33:32.118346+0000, chain.objs.size()=1 2024-09-12T17:41:33.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.040+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.439__shadow_.xzzPJo44_dtpFnHgz5hvFrUaQFDRl5B_0 2024-09-12T17:41:33.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.040+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8805494489266007795', time=2024-09-12T19:33:49.239768+0000, chain.objs.size()=1 2024-09-12T17:41:33.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.040+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.483__shadow_.jW0UK05ZdnufZh6z1aHIBWVFzQVee___0 2024-09-12T17:41:33.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.040+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16548422221355999557', time=2024-09-12T19:33:57.585871+0000, chain.objs.size()=1 2024-09-12T17:41:33.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.040+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.503__shadow:5PZwxWS6kVU04L4agSYet4YqDKg.iTJ_.vEQTiH10KZ8H36ScYyTe7asHZOEv9fv_0 2024-09-12T17:41:33.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.040+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10682318120461120499', time=2024-09-12T19:34:04.260047+0000, chain.objs.size()=1 2024-09-12T17:41:33.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.040+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.518__multipart_mymultipart.2~MgTpoklpsAWUJIh2ePcdI-fVztH-3zZ.1 2024-09-12T17:41:33.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.040+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10085111458015521146', time=2024-09-12T19:35:01.403179+0000, chain.objs.size()=1 2024-09-12T17:41:33.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.040+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.552__shadow_.HxtJZiJVzpsrOpJBzc-lIGyRCBPEtXg_0 2024-09-12T17:41:33.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.040+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18324340679672179801', time=2024-09-12T19:35:01.920037+0000, chain.objs.size()=1 2024-09-12T17:41:33.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.040+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.553__shadow_.QJCx7Z1bVhz5knbdg8LmEu_wdZz3720_0 2024-09-12T17:41:33.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.040+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7726827453037760453', time=2024-09-12T19:35:05.205749+0000, chain.objs.size()=1 2024-09-12T17:41:33.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.040+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.557__shadow_.M2EGeuxybcyCqHeW4TR76YyAvoQn6f2_0 2024-09-12T17:41:33.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.040+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~KeDl-fd4I1zgzBv76lP-lgdgM7oz3Gp', time=2024-09-12T19:35:07.871334+0000, chain.objs.size()=1 2024-09-12T17:41:33.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.040+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.561__multipart_mymultipart.2~KeDl-fd4I1zgzBv76lP-lgdgM7oz3Gp.1 2024-09-12T17:41:33.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.040+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13605437748309022458', time=2024-09-12T19:35:36.432546+0000, chain.objs.size()=1 2024-09-12T17:41:33.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.040+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.577__shadow:9bO6UnOeTgmmex4PrWFZRV11t445Xti_.sAak5vmSQm58WYQHagMZypbLkWWidiS_0 2024-09-12T17:41:33.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.040+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12796730344028383218', time=2024-09-12T19:35:40.185582+0000, chain.objs.size()=1 2024-09-12T17:41:33.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.040+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.577__shadow:lGtT2uBvrXkPeZ4Ycr-shlaZmFAVOMn_.fVm_KWTCFUafuTj0JgJaQ5nsgVl0-t3_0 2024-09-12T17:41:33.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.040+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1757251280562345400', time=2024-09-12T19:38:29.939649+0000, chain.objs.size()=1 2024-09-12T17:41:33.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.040+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.643__shadow_.cyCNM9HsOvodRprfrOv-NOpQI7bgYJW_0 2024-09-12T17:41:33.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.040+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17992276412665240949', time=2024-09-12T19:38:44.805173+0000, chain.objs.size()=1 2024-09-12T17:41:33.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.040+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.668__shadow_.ZJg8_3wtWU_7GynajawKXjbh7_koieE_0 2024-09-12T17:41:33.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.040+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.437181989659730919', time=2024-09-12T19:38:57.526524+0000, chain.objs.size()=1 2024-09-12T17:41:33.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.040+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.705__shadow:IdoE8-33cxYraMI7uOddFrtXZ2cS4Zy_.QNpIgMSkpzQ557a_Jd2xt6D-flI_J-8_0 2024-09-12T17:41:33.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.040+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11110342433743516282', time=2024-09-12T19:38:59.471403+0000, chain.objs.size()=1 2024-09-12T17:41:33.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.040+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.710__shadow:VXmkTnsLuzZuShNZ9.hYf6qQdeVoZk._.bCIOsltFO7-qP9vb4szVWkVPhKwpNoF_0 2024-09-12T17:41:33.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.044+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:41:33.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.044+0000 7fd765adf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:41:33.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.048+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:41:33.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.048+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:41:33.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.048+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45711' 2024-09-12T17:41:33.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.048+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8382340707011284908', time=2024-09-12T19:31:18.692400+0000, chain.objs.size()=1 2024-09-12T17:41:33.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.048+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.250__shadow_.pajLkKpK1J6e8tZkywS9HJNQvnDXt-X_0 2024-09-12T17:41:33.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.048+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12473246977727045538', time=2024-09-12T19:31:19.870286+0000, chain.objs.size()=1 2024-09-12T17:41:33.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.048+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.253__shadow_.n9-ehCTj5_MQaH2YfLY5JGrNhiCT__I_0 2024-09-12T17:41:33.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.048+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16170345143632660996', time=2024-09-12T19:31:42.321775+0000, chain.objs.size()=1 2024-09-12T17:41:33.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.048+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.44XGRRbC4ZBZ-A0orH1cG2VK5X8JZYg_0 2024-09-12T17:41:33.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.048+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4059123182404393919', time=2024-09-12T19:31:42.322724+0000, chain.objs.size()=1 2024-09-12T17:41:33.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.048+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.rrlJkwDoThYEIgMxdmPKcPY48nKnBLM_0 2024-09-12T17:41:33.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.048+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5957264288235070870', time=2024-09-12T19:31:42.544757+0000, chain.objs.size()=1 2024-09-12T17:41:33.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.048+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.f2QlCNetvLW4f0rwg4nixwFxS18uwyi_0 2024-09-12T17:41:33.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.048+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12544130626851301681', time=2024-09-12T19:31:42.603084+0000, chain.objs.size()=1 2024-09-12T17:41:33.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.048+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.nbB68alyD0CkrW3EM3VyndIfvl632i7_0 2024-09-12T17:41:33.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.048+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16895536613923580057', time=2024-09-12T19:31:42.651018+0000, chain.objs.size()=1 2024-09-12T17:41:33.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.048+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Npuuhw3KeHg3LTRtPaRfAnUZIpN3Jkz_0 2024-09-12T17:41:33.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.048+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11473169161553977287', time=2024-09-12T19:31:42.765821+0000, chain.objs.size()=1 2024-09-12T17:41:33.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.048+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.zptNlcipvhqGZnU59DmI5T6svBX5rk-_0 2024-09-12T17:41:33.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.048+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6565033045109307811', time=2024-09-12T19:31:42.767044+0000, chain.objs.size()=1 2024-09-12T17:41:33.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.048+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.JFrnHUqGP6n1aJoIWkvcDTH2YybFGYR_0 2024-09-12T17:41:33.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.048+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3683985231783728255', time=2024-09-12T19:31:42.775999+0000, chain.objs.size()=1 2024-09-12T17:41:33.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.048+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.6HIVyqiuTKdytq_P24ySJf5SgwIu9XN_0 2024-09-12T17:41:33.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.048+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5093820561322364731', time=2024-09-12T19:31:42.863429+0000, chain.objs.size()=1 2024-09-12T17:41:33.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.048+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.v-fId6m-if9xuBLuDWzkkW7aZHbItBJ_0 2024-09-12T17:41:33.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.048+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2521321309511790501', time=2024-09-12T19:31:42.894896+0000, chain.objs.size()=1 2024-09-12T17:41:33.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.048+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.FOhAf59r-DTbUoPEgzaLOt7lU1dmRf8_0 2024-09-12T17:41:33.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.052+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1052138479943106235', time=2024-09-12T19:31:43.090097+0000, chain.objs.size()=1 2024-09-12T17:41:33.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.052+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.nMxcQ4p7R4nQmNUSzBBsh-xMLlciL1O_0 2024-09-12T17:41:33.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.052+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11431223991575869652', time=2024-09-12T19:31:43.101520+0000, chain.objs.size()=1 2024-09-12T17:41:33.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.052+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.vyJj57wJTopwYrnQLBuA0vWYW5QOslN_0 2024-09-12T17:41:33.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.052+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13798661442355022652', time=2024-09-12T19:31:43.114628+0000, chain.objs.size()=1 2024-09-12T17:41:33.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.052+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.ORmqXDFoS8fuLgI23S4csrnT50OKWuv_0 2024-09-12T17:41:33.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.052+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5244193699199222072', time=2024-09-12T19:31:43.115909+0000, chain.objs.size()=1 2024-09-12T17:41:33.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.052+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.wLLG2UoK8r6SoaCWBx6X7WPKLRWCuF4_0 2024-09-12T17:41:33.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.052+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8190004770325101255', time=2024-09-12T19:31:43.161583+0000, chain.objs.size()=1 2024-09-12T17:41:33.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.052+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.lSs8SXblz8j-GeTDMX0znVUlT0bV83x_0 2024-09-12T17:41:33.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.052+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16506110631965581538', time=2024-09-12T19:31:43.243271+0000, chain.objs.size()=1 2024-09-12T17:41:33.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.052+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.-guGKD1m_AIHduczadutiUf5TRwBnl4_0 2024-09-12T17:41:33.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.052+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2200207641240475079', time=2024-09-12T19:31:43.248627+0000, chain.objs.size()=1 2024-09-12T17:41:33.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.052+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.o4-qvOU9mK1fYYmCSpu9e7prsVKJMdL_0 2024-09-12T17:41:33.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.052+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7104536439099282400', time=2024-09-12T19:31:43.429617+0000, chain.objs.size()=1 2024-09-12T17:41:33.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.052+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.rpgNPm29GEPWQ3-7Q2K7-icztYo2xrY_0 2024-09-12T17:41:33.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.052+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6137326478141455167', time=2024-09-12T19:31:43.478541+0000, chain.objs.size()=1 2024-09-12T17:41:33.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.052+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.zxyli2hYVo9cywhamBCmhPRKXHRb9PA_0 2024-09-12T17:41:33.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.052+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8681374602411184255', time=2024-09-12T19:31:43.757137+0000, chain.objs.size()=1 2024-09-12T17:41:33.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.052+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Do545EANjOUwFG3LnblTXFQCE6x80tx_0 2024-09-12T17:41:33.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.052+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17242516207887725747', time=2024-09-12T19:31:43.844473+0000, chain.objs.size()=1 2024-09-12T17:41:33.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.052+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.AipJ6WL3qVDxev8JYZMl_sWZJ0pahC4_0 2024-09-12T17:41:33.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.052+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4754079703903116166', time=2024-09-12T19:31:43.881144+0000, chain.objs.size()=1 2024-09-12T17:41:33.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.052+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.hpJqi1BRh4d3jkDXi6gjx6jigvZqKi-_0 2024-09-12T17:41:33.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.056+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6199330277317015302', time=2024-09-12T19:31:43.926997+0000, chain.objs.size()=1 2024-09-12T17:41:33.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.056+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.YlO4JNZKQeeoijELeeEbqnE-gk0JfeD_0 2024-09-12T17:41:33.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.056+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3205373100737064944', time=2024-09-12T19:31:44.158463+0000, chain.objs.size()=1 2024-09-12T17:41:33.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.056+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.3YpPamE9APugYrxOsXCmOT0VSLH9a2B_0 2024-09-12T17:41:33.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.056+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8458339163192275856', time=2024-09-12T19:31:44.433590+0000, chain.objs.size()=1 2024-09-12T17:41:33.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.056+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.wI-hJyOUfyNVatNu4rsjGrSuq6kNyXN_0 2024-09-12T17:41:33.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.056+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17734475374228158243', time=2024-09-12T19:31:44.439573+0000, chain.objs.size()=1 2024-09-12T17:41:33.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.056+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.88p2rRPcBBeL-e_6MKDLyhWxApgFVLC_0 2024-09-12T17:41:33.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.056+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13057401246236028212', time=2024-09-12T19:31:44.477115+0000, chain.objs.size()=1 2024-09-12T17:41:33.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.056+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.U30Ms7L-qkO4EX8VFgNpWEfdcQaD8gr_0 2024-09-12T17:41:33.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.056+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15339882095166511942', time=2024-09-12T19:31:44.502339+0000, chain.objs.size()=1 2024-09-12T17:41:33.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.056+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.MDj1P2WNHkgxuwJBQzI3VHOMmjl-Xg5_0 2024-09-12T17:41:33.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.056+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10896060951554247672', time=2024-09-12T19:31:47.663376+0000, chain.objs.size()=1 2024-09-12T17:41:33.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.056+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.271__shadow_.URNMPrC6hWd2A3KGIhsuy81W-2hmqse_0 2024-09-12T17:41:33.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.056+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14472385858803688761', time=2024-09-12T19:31:56.528909+0000, chain.objs.size()=1 2024-09-12T17:41:33.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.056+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.292__shadow_.PUAEZskmsWjezX77_5ahyZbltTWLTO9_0 2024-09-12T17:41:33.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.056+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1758524346748456913', time=2024-09-12T19:31:57.562956+0000, chain.objs.size()=1 2024-09-12T17:41:33.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.056+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.293__shadow_.oUX4LfmwgsogliGZkVMMVu6-gO78FEu_0 2024-09-12T17:41:33.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.056+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13834227271109550126', time=2024-09-12T19:31:58.741276+0000, chain.objs.size()=1 2024-09-12T17:41:33.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.056+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.296__shadow_.XCFD_B80OBrSI-bb7KS_wB-7TAAfdCR_0 2024-09-12T17:41:33.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.056+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5655425155943258623', time=2024-09-12T19:31:59.543506+0000, chain.objs.size()=1 2024-09-12T17:41:33.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.056+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.298__shadow_.QrMj7wIX45VQBMq7cHXxL17iQlRL89-_0 2024-09-12T17:41:33.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.056+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12678473002413091777', time=2024-09-12T19:32:07.355200+0000, chain.objs.size()=1 2024-09-12T17:41:33.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.056+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.319__shadow:2onHKMvpnkFFSTWNtFMkAS8jW6e2Qp1_.IIddEc-y4Ls-BzhuQ1LmKZ6Ac5qQmmV_0 2024-09-12T17:41:33.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.056+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11047609317644078299', time=2024-09-12T19:32:27.893865+0000, chain.objs.size()=1 2024-09-12T17:41:33.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.056+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.X3eeFWAxyvyumKnk7hcJuPXE0wIwjz1_0 2024-09-12T17:41:33.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.056+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16398997561414284138', time=2024-09-12T19:32:28.093981+0000, chain.objs.size()=1 2024-09-12T17:41:33.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.056+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.OtoEuiug4Ap98OWE__In43w0_NXFIKU_0 2024-09-12T17:41:33.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.056+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1529931775509474781', time=2024-09-12T19:32:28.246856+0000, chain.objs.size()=1 2024-09-12T17:41:33.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.056+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.y_f9BskCH1C_NOwu7Ckq2jjHbcWM8CH_0 2024-09-12T17:41:33.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.056+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1379825131701349281', time=2024-09-12T19:32:28.257270+0000, chain.objs.size()=1 2024-09-12T17:41:33.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.056+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.unpQX0IJw9f2SoSOhZ9tp-l5-ye4jid_0 2024-09-12T17:41:33.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.056+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16666468579641768754', time=2024-09-12T19:32:28.285513+0000, chain.objs.size()=1 2024-09-12T17:41:33.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.056+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Zl-25krtibSNS3r_Mqb3YwWXFpZaO2W_0 2024-09-12T17:41:33.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.056+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4283690214651465042', time=2024-09-12T19:32:28.291165+0000, chain.objs.size()=1 2024-09-12T17:41:33.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.056+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.ITPn7vKqBQDfGscKn9lvixP62qWpuAT_0 2024-09-12T17:41:33.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.056+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3666868308836975899', time=2024-09-12T19:32:28.327801+0000, chain.objs.size()=1 2024-09-12T17:41:33.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.056+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.JzxJ3-Qpq4TdsPjOm6y414kfRI7vVtU_0 2024-09-12T17:41:33.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.056+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10203362601944505229', time=2024-09-12T19:32:28.415084+0000, chain.objs.size()=1 2024-09-12T17:41:33.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.056+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.oxq4Fca8eLcQKBYJeXIoduZZf1PPlrd_0 2024-09-12T17:41:33.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.056+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4324967125438574525', time=2024-09-12T19:32:28.451684+0000, chain.objs.size()=1 2024-09-12T17:41:33.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.056+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.nOlbWviEdHfwwB9c2HIuPQbD_ufv4NH_0 2024-09-12T17:41:33.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.056+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6801390911414311274', time=2024-09-12T19:32:28.551433+0000, chain.objs.size()=1 2024-09-12T17:41:33.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.056+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.ZpOTQsQ1-BIQRWMkqFDdr7qQ5TML92g_0 2024-09-12T17:41:33.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.060+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5509370613560147289', time=2024-09-12T19:32:28.754379+0000, chain.objs.size()=1 2024-09-12T17:41:33.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.060+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.h5RQpzgi05TSuCEL_HvhKj-gd7hAbK0_0 2024-09-12T17:41:33.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.060+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12254202150552680556', time=2024-09-12T19:32:28.768005+0000, chain.objs.size()=1 2024-09-12T17:41:33.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.060+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.bhBcZK-saurtn17kwrNe7I90_-eeW4b_0 2024-09-12T17:41:33.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.060+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13051082415132729038', time=2024-09-12T19:32:28.815452+0000, chain.objs.size()=1 2024-09-12T17:41:33.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.060+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.95gAvJNyhtXNQ0P1WwvT4qTEMOl7wnU_0 2024-09-12T17:41:33.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.060+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18385262984734539194', time=2024-09-12T19:32:28.843854+0000, chain.objs.size()=1 2024-09-12T17:41:33.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.060+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.QYGqF0BX2JMZciLc6CgCWhjwlooVyx1_0 2024-09-12T17:41:33.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.060+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6308292586278514080', time=2024-09-12T19:32:29.111831+0000, chain.objs.size()=1 2024-09-12T17:41:33.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.060+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.z1wi_sQ3IxCkoMMxJvlO2N6oOyXSUg7_0 2024-09-12T17:41:33.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.060+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.755877774285859669', time=2024-09-12T19:32:29.165215+0000, chain.objs.size()=1 2024-09-12T17:41:33.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.060+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.qrA3HF1nivnYMAv1r2BBs-S9JdVtO6z_0 2024-09-12T17:41:33.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.060+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14973565408534667187', time=2024-09-12T19:32:29.222283+0000, chain.objs.size()=1 2024-09-12T17:41:33.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.060+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.BAMYdxRF_Qcu8n9D5CAVQQGKVyhq7hI_0 2024-09-12T17:41:33.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.060+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7986297999129631608', time=2024-09-12T19:32:29.445166+0000, chain.objs.size()=1 2024-09-12T17:41:33.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.060+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.fepcwzyYhZH3OAt2WBZyOVznGHc8P18_0 2024-09-12T17:41:33.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.060+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16100100328648212805', time=2024-09-12T19:32:29.524106+0000, chain.objs.size()=1 2024-09-12T17:41:33.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.060+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.vbS8zr-LjQEekcqBmQm9f2Hgk2uf-E2_0 2024-09-12T17:41:33.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.060+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17108031906168480528', time=2024-09-12T19:32:29.525527+0000, chain.objs.size()=1 2024-09-12T17:41:33.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.060+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.fn-HKs1zrIJwOxzeY6TdVbAyIe-A7hS_0 2024-09-12T17:41:33.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.060+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4570723804504245523', time=2024-09-12T19:32:29.679812+0000, chain.objs.size()=1 2024-09-12T17:41:33.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.060+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.BkCo4Kot3wc_S0x-ph3jTZTvo9a0gpD_0 2024-09-12T17:41:33.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.060+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13364238157547405835', time=2024-09-12T19:32:29.737254+0000, chain.objs.size()=1 2024-09-12T17:41:33.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.060+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.hOuXTaA7cPjcC0OXR2iswYZYVphHNOP_0 2024-09-12T17:41:33.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.060+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12286381804887716864', time=2024-09-12T19:32:29.826788+0000, chain.objs.size()=1 2024-09-12T17:41:33.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.060+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.fFPG9AOrTbZ6pZq2NVdxZ--fN71UESj_0 2024-09-12T17:41:33.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.060+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8280001083287197986', time=2024-09-12T19:32:29.845027+0000, chain.objs.size()=1 2024-09-12T17:41:33.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.060+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.JCw7xaLJvPEUSpsw_MntIK3ZUJDUIV1_0 2024-09-12T17:41:33.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.060+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4423506244595736661', time=2024-09-12T19:32:30.110638+0000, chain.objs.size()=1 2024-09-12T17:41:33.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.060+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.FNJPTzRy-HDnXu7IAdEaZ4nhf1SNQ-T_0 2024-09-12T17:41:33.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.060+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16663530814054399865', time=2024-09-12T19:32:30.111425+0000, chain.objs.size()=1 2024-09-12T17:41:33.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.060+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.7HCXCfHpGeNevpcj-x5uDeqG5gz7hJt_0 2024-09-12T17:41:33.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.060+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13493468251512993854', time=2024-09-12T19:32:30.143923+0000, chain.objs.size()=1 2024-09-12T17:41:33.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.060+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.zlvs8bnlrIL_7LD4ZSxzoEozuCy0FFs_0 2024-09-12T17:41:33.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.064+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10508163751546318900', time=2024-09-12T19:32:30.144722+0000, chain.objs.size()=1 2024-09-12T17:41:33.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.064+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.KlVC2PK12AKGoY2CQZ_JphdxTHNOgJz_0 2024-09-12T17:41:33.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.064+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14449189035654071623', time=2024-09-12T19:32:49.519606+0000, chain.objs.size()=1 2024-09-12T17:41:33.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.064+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.hDijn0oD4hIW9TWGhxG-PDVGFnAyXR8_0 2024-09-12T17:41:33.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.064+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8748851065971500274', time=2024-09-12T19:32:49.649856+0000, chain.objs.size()=1 2024-09-12T17:41:33.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.064+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Cd0aiHi-VLic9UrN3oJFTyjpaVuYxCR_0 2024-09-12T17:41:33.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.064+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10634345054151101124', time=2024-09-12T19:32:49.696268+0000, chain.objs.size()=1 2024-09-12T17:41:33.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.064+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.wYNV9g3MBKDGOMpmEH2BWSyBtTVeMAT_0 2024-09-12T17:41:33.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.064+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15305525865369708019', time=2024-09-12T19:32:49.752692+0000, chain.objs.size()=1 2024-09-12T17:41:33.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.064+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.7OYJpXlGov0tTWY87ZIq8kBszxiVcjG_0 2024-09-12T17:41:33.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.064+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13004525691944078042', time=2024-09-12T19:32:49.973127+0000, chain.objs.size()=1 2024-09-12T17:41:33.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.064+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_._tRfGw9HWwTgXGtEzotumUsrvirbsvR_0 2024-09-12T17:41:33.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.064+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5871352179682260202', time=2024-09-12T19:32:50.139333+0000, chain.objs.size()=1 2024-09-12T17:41:33.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.064+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.CfeDHAHNEZCboxHXScX4ijbacXWy0Gj_0 2024-09-12T17:41:33.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.064+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13285495112034795160', time=2024-09-12T19:32:50.146526+0000, chain.objs.size()=1 2024-09-12T17:41:33.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.064+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.R8qUTnhRA_CPTvVVKcNlvQ715bfMqOH_0 2024-09-12T17:41:33.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.064+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7805359755740916426', time=2024-09-12T19:32:50.172954+0000, chain.objs.size()=1 2024-09-12T17:41:33.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.064+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.XRhK47vwwI16_Dgtlm-V1_D2JvSJ9RZ_0 2024-09-12T17:41:33.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.064+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18180594418953635378', time=2024-09-12T19:32:50.184584+0000, chain.objs.size()=1 2024-09-12T17:41:33.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.064+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.iaQ-P3uxf_o998yQCW_9R9KFnwxgzZs_0 2024-09-12T17:41:33.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.064+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13801782587301090923', time=2024-09-12T19:32:50.232871+0000, chain.objs.size()=1 2024-09-12T17:41:33.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.064+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.ua7if55V4lOQp-M7zW8Ys1WQQxA1Fnz_0 2024-09-12T17:41:33.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.064+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2110671992895585896', time=2024-09-12T19:32:50.237092+0000, chain.objs.size()=1 2024-09-12T17:41:33.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.064+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.NP4f2Ybfhn5pC9cFQmYDMvP9nBQaG3h_0 2024-09-12T17:41:33.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.064+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18177908688314431475', time=2024-09-12T19:32:50.249456+0000, chain.objs.size()=1 2024-09-12T17:41:33.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.064+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.23aibzLt9Xa_foAGqVL6QpHbe4BKGIR_0 2024-09-12T17:41:33.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.064+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14608649401155869823', time=2024-09-12T19:32:50.295778+0000, chain.objs.size()=1 2024-09-12T17:41:33.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.064+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.YxFYUjU0OhlA10nqI-6ZkE-DNeVcVFb_0 2024-09-12T17:41:33.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.064+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10948489716229433933', time=2024-09-12T19:32:50.474616+0000, chain.objs.size()=1 2024-09-12T17:41:33.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.064+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.gPvoVSGKiWYaT0ut3l9YtsskiFqhxoY_0 2024-09-12T17:41:33.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.064+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14042913840303308987', time=2024-09-12T19:32:50.549079+0000, chain.objs.size()=1 2024-09-12T17:41:33.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.064+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.D7rNKzAJfcnAnXQ8L3Zaa0ya7M4MzJp_0 2024-09-12T17:41:33.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.064+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4908606835658997970', time=2024-09-12T19:32:50.550217+0000, chain.objs.size()=1 2024-09-12T17:41:33.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.064+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.G00QUCR6NoqEZ3czXxVk0ArEgp8BciW_0 2024-09-12T17:41:33.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.068+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14250403674067024154', time=2024-09-12T19:32:50.580496+0000, chain.objs.size()=1 2024-09-12T17:41:33.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.068+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.VT3zn2ChuXG0gGrr_I7LjBt9QnBCFY0_0 2024-09-12T17:41:33.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.068+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15276377674214305443', time=2024-09-12T19:32:50.607229+0000, chain.objs.size()=1 2024-09-12T17:41:33.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.068+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.2qiSrFX3lBcSxqax2hRP9_efkBoceg8_0 2024-09-12T17:41:33.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.068+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14531690217697153041', time=2024-09-12T19:32:50.612738+0000, chain.objs.size()=1 2024-09-12T17:41:33.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.068+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.8sVsih8gHjMaVZgrj4Ac-UZE_bnJutK_0 2024-09-12T17:41:33.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.068+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9029798411905061005', time=2024-09-12T19:32:50.648782+0000, chain.objs.size()=1 2024-09-12T17:41:33.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.068+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.M4GRfCOPKH93f5evB6fYF4eTdNJ2pcY_0 2024-09-12T17:41:33.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.068+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11524251933075151802', time=2024-09-12T19:32:50.649662+0000, chain.objs.size()=1 2024-09-12T17:41:33.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.068+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Jb6flZBiFqQfq87opgxePlVe449QW-t_0 2024-09-12T17:41:33.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.068+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4440447544955409065', time=2024-09-12T19:32:50.952403+0000, chain.objs.size()=1 2024-09-12T17:41:33.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.068+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.W3rI-UjLu1Md4WHmINa8G4x-8THyspS_0 2024-09-12T17:41:33.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.068+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17374314031637609419', time=2024-09-12T19:32:50.984136+0000, chain.objs.size()=1 2024-09-12T17:41:33.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.068+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.iIfdiAP3kx6_V4pa3Z83d0uJ9HIFPCs_0 2024-09-12T17:41:33.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.068+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11339857781632218832', time=2024-09-12T19:32:51.010031+0000, chain.objs.size()=1 2024-09-12T17:41:33.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.068+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.mQnzBPE1tvUH0vHIXtpXk4bi0A1h2ix_0 2024-09-12T17:41:33.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.068+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15969602161435066498', time=2024-09-12T19:32:51.018794+0000, chain.objs.size()=1 2024-09-12T17:41:33.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.068+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.fyKPq9n7fb6GF_izdYELumPqEyxnGRf_0 2024-09-12T17:41:33.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.068+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9807493964007070750', time=2024-09-12T19:32:51.300733+0000, chain.objs.size()=1 2024-09-12T17:41:33.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.068+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.SlbuXTBz7tF-81Q_Iz1IajAiqFJaFKn_0 2024-09-12T17:41:33.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.068+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1920363498502194467', time=2024-09-12T19:32:51.314673+0000, chain.objs.size()=1 2024-09-12T17:41:33.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.068+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.cmjNTkfPlMlpnQBlQta2NroybduLCDc_0 2024-09-12T17:41:33.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.068+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10676403466123096355', time=2024-09-12T19:32:51.341481+0000, chain.objs.size()=1 2024-09-12T17:41:33.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.068+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.--Nh7dSoeQoyIMkFTJhem6W7oN1w2ex_0 2024-09-12T17:41:33.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.068+0000 7fd7635e5640 0 -- 172.21.15.16:0/1166938650 >> [v2:172.21.15.16:6824/465585330,v1:172.21.15.16:6825/465585330] conn(0x7fd754029040 msgr2=0x7fd62c087ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:41:33.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.068+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.692547869957983021', time=2024-09-12T19:32:51.509294+0000, chain.objs.size()=1 2024-09-12T17:41:33.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.068+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Whs88genWl3wM4O1CVw4TeFrwEZ8A-V_0 2024-09-12T17:41:33.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.068+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4957429328593248289', time=2024-09-12T19:32:51.663251+0000, chain.objs.size()=1 2024-09-12T17:41:33.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.068+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.qKzqYb7lXnUkr6-Eq_EjVqQt0qDCFcI_0 2024-09-12T17:41:33.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.068+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16837731772991529299', time=2024-09-12T19:32:51.673796+0000, chain.objs.size()=1 2024-09-12T17:41:33.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.068+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Jph0V7IsKHDuDoMuf49asJIfBv6vHsT_0 2024-09-12T17:41:33.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.068+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17514896738571139727', time=2024-09-12T19:32:51.700879+0000, chain.objs.size()=1 2024-09-12T17:41:33.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.068+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.UBHjYuVlSGw4_I-rOCPrnUSwLAS5VSY_0 2024-09-12T17:41:33.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.068+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15522474328371725389', time=2024-09-12T19:32:51.904665+0000, chain.objs.size()=1 2024-09-12T17:41:33.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.068+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.hopqmqihN7RiQr1WCh0_WZZa7CdKqVA_0 2024-09-12T17:41:33.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.068+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9262385643226957266', time=2024-09-12T19:32:51.964245+0000, chain.objs.size()=1 2024-09-12T17:41:33.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.068+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.rTpkW5IcqyzGnLcN9g1a9riwlI0HG4X_0 2024-09-12T17:41:33.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.068+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7720076559875804044', time=2024-09-12T19:33:41.935638+0000, chain.objs.size()=1 2024-09-12T17:41:33.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.068+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.461__shadow_.ZrQRfKyEV7KkCNBoQbl9a4_EVeegpNQ_0 2024-09-12T17:41:33.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.068+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6377417634396688163', time=2024-09-12T19:34:17.058952+0000, chain.objs.size()=12 2024-09-12T17:41:33.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.068+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__multipart_mymultipart.2~M_SXawQyEWAILrgeQxMqN-zQ4C1EFSr.1 2024-09-12T17:41:33.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.072+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__shadow_mymultipart.2~M_SXawQyEWAILrgeQxMqN-zQ4C1EFSr.1_1 2024-09-12T17:41:33.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.072+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__multipart_mymultipart.2~M_SXawQyEWAILrgeQxMqN-zQ4C1EFSr.2 2024-09-12T17:41:33.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.072+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__shadow_mymultipart.2~M_SXawQyEWAILrgeQxMqN-zQ4C1EFSr.2_1 2024-09-12T17:41:33.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.072+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__multipart_mymultipart.Adp9_-izwySsItygsbtkIiEzYQ_H74Ne.3 2024-09-12T17:41:33.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.072+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__shadow_mymultipart.Adp9_-izwySsItygsbtkIiEzYQ_H74Ne.3_1 2024-09-12T17:41:33.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.072+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__multipart_mymultipart.2~M_SXawQyEWAILrgeQxMqN-zQ4C1EFSr.4 2024-09-12T17:41:33.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.072+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__shadow_mymultipart.2~M_SXawQyEWAILrgeQxMqN-zQ4C1EFSr.4_1 2024-09-12T17:41:33.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.072+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__multipart_mymultipart.2~M_SXawQyEWAILrgeQxMqN-zQ4C1EFSr.5 2024-09-12T17:41:33.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.072+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__shadow_mymultipart.2~M_SXawQyEWAILrgeQxMqN-zQ4C1EFSr.5_1 2024-09-12T17:41:33.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.072+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__multipart_mymultipart.2~M_SXawQyEWAILrgeQxMqN-zQ4C1EFSr.6 2024-09-12T17:41:33.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.072+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__shadow_mymultipart.2~M_SXawQyEWAILrgeQxMqN-zQ4C1EFSr.6_1 2024-09-12T17:41:33.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.076+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45711 2024-09-12T17:41:33.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.080+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T17:41:33.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.080+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~24Ppn8uCENdrv52RgCwb8LoHPhoIkUq', time=2024-09-12T19:34:29.282715+0000, chain.objs.size()=1 2024-09-12T17:41:33.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.080+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.531__multipart_mymultipart2.2~24Ppn8uCENdrv52RgCwb8LoHPhoIkUq.1 2024-09-12T17:41:33.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.080+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6101314248467712165', time=2024-09-12T19:35:02.052369+0000, chain.objs.size()=1 2024-09-12T17:41:33.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.080+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.553__shadow_.UQAzvWMZgtZnUNtxR1aCS249WuO2YTI_0 2024-09-12T17:41:33.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.080+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8334728959800016848', time=2024-09-12T19:35:23.943653+0000, chain.objs.size()=1 2024-09-12T17:41:33.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.080+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.570__shadow:hNoQk.la9unbUmq3-tmd9v3higD5s8u_.NBU0rtPPWAUFnN2Hqhw--v0clPlWGF9_0 2024-09-12T17:41:33.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.080+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2309755182730458123', time=2024-09-12T19:35:49.551507+0000, chain.objs.size()=1 2024-09-12T17:41:33.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.080+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.577__shadow:wZSlWDdhx2.2rks7XZE38DDFHn0CYuw_.8L0RyocSnm5ElrmfG1tWf_cNO_eL-8H_0 2024-09-12T17:41:33.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.080+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16046473471322730167', time=2024-09-12T19:35:54.211093+0000, chain.objs.size()=1 2024-09-12T17:41:33.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.080+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.579__shadow:i1C4L.Gg1Zq3uQgb-k92DExbHe2t1hw_.naUniFMfxXO8dBeEzEgh2Nt-VjQNV2a_0 2024-09-12T17:41:33.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.080+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7719610309609918243', time=2024-09-12T19:35:58.098772+0000, chain.objs.size()=1 2024-09-12T17:41:33.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.080+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.585__shadow:0NL-18.mw.BJicS9465e4b6VkgGIDLG_.TTrPzKcrng5axUS02GMqXYqwrseockl_0 2024-09-12T17:41:33.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.080+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11301949483005912687', time=2024-09-12T19:38:20.351229+0000, chain.objs.size()=12 2024-09-12T17:41:33.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.080+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.623__multipart_multipart_enc.2~9HRTBEsui5AIi0m6Ed9HsO9hRbjB4ZZ.1 2024-09-12T17:41:33.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.080+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.623__shadow_multipart_enc.2~9HRTBEsui5AIi0m6Ed9HsO9hRbjB4ZZ.1_1 2024-09-12T17:41:33.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.080+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.623__multipart_multipart_enc.2~9HRTBEsui5AIi0m6Ed9HsO9hRbjB4ZZ.2 2024-09-12T17:41:33.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.080+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.623__shadow_multipart_enc.2~9HRTBEsui5AIi0m6Ed9HsO9hRbjB4ZZ.2_1 2024-09-12T17:41:33.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.080+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.623__multipart_multipart_enc.2~9HRTBEsui5AIi0m6Ed9HsO9hRbjB4ZZ.3 2024-09-12T17:41:33.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.080+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.623__shadow_multipart_enc.2~9HRTBEsui5AIi0m6Ed9HsO9hRbjB4ZZ.3_1 2024-09-12T17:41:33.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.080+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.623__multipart_multipart_enc.2~9HRTBEsui5AIi0m6Ed9HsO9hRbjB4ZZ.4 2024-09-12T17:41:33.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.080+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.623__shadow_multipart_enc.2~9HRTBEsui5AIi0m6Ed9HsO9hRbjB4ZZ.4_1 2024-09-12T17:41:33.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.084+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.623__multipart_multipart_enc.2~9HRTBEsui5AIi0m6Ed9HsO9hRbjB4ZZ.5 2024-09-12T17:41:33.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.084+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.623__shadow_multipart_enc.2~9HRTBEsui5AIi0m6Ed9HsO9hRbjB4ZZ.5_1 2024-09-12T17:41:33.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.084+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.623__multipart_multipart_enc.2~9HRTBEsui5AIi0m6Ed9HsO9hRbjB4ZZ.6 2024-09-12T17:41:33.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.084+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.623__shadow_multipart_enc.2~9HRTBEsui5AIi0m6Ed9HsO9hRbjB4ZZ.6_1 2024-09-12T17:41:33.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.084+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1849243559903094734', time=2024-09-12T19:38:34.408238+0000, chain.objs.size()=1 2024-09-12T17:41:33.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.084+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.651__shadow_.a7Mz_5tp2xKIniZrstYKBbuyon-bH1L_0 2024-09-12T17:41:33.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.084+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.798026565961936664', time=2024-09-12T19:38:44.669475+0000, chain.objs.size()=1 2024-09-12T17:41:33.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.084+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.668__shadow_.ZJg8_3wtWU_7GynajawKXjbh7_koieE_0 2024-09-12T17:41:33.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.084+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~h0gHA8K38R3TMmUvFmZCtHDPXQFEToO', time=2024-09-12T19:39:31.664502+0000, chain.objs.size()=1 2024-09-12T17:41:33.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.084+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.742__multipart_mymultipart2.2~h0gHA8K38R3TMmUvFmZCtHDPXQFEToO.1 2024-09-12T17:41:33.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.088+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:41:33.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.088+0000 7fd765adf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:41:33.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.092+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:41:33.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.092+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:41:33.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.092+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46937' 2024-09-12T17:41:33.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.092+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11847045835766001602', time=2024-09-12T19:29:51.469364+0000, chain.objs.size()=1 2024-09-12T17:41:33.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.092+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.171__shadow_.dV4vsarAmEpDiY5vjI2bl3OfbYgzNOX_0 2024-09-12T17:41:33.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.092+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16887624096964003311', time=2024-09-12T19:29:57.774125+0000, chain.objs.size()=1 2024-09-12T17:41:33.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.092+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.182__shadow_.3x4XjOesRP4JprL_8pjEvx4LOPVTSuQ_0 2024-09-12T17:41:33.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.092+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8966110465564141126', time=2024-09-12T19:31:17.566611+0000, chain.objs.size()=1 2024-09-12T17:41:33.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.092+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.247__shadow_.BYOcDWoSUpw0lp_EaIkx0xX1SD3le4t_0 2024-09-12T17:41:33.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.092+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6792335544106091123', time=2024-09-12T19:31:17.942036+0000, chain.objs.size()=1 2024-09-12T17:41:33.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.092+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.248__shadow_.b7tpQVURxwCOt0MTySfVdmKZdD32Xrj_0 2024-09-12T17:41:33.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.092+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12661929316057310035', time=2024-09-12T19:31:17.944258+0000, chain.objs.size()=1 2024-09-12T17:41:33.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.092+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.248__shadow_.Cqwd5Qz7rpyXQRmGCyZ4d3KhlwYXczx_0 2024-09-12T17:41:33.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.092+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11358689846618369081', time=2024-09-12T19:31:21.002338+0000, chain.objs.size()=1 2024-09-12T17:41:33.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.092+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.256__shadow_.XQEYKV1yYuA3XNTXBakEwi4K_id3DCt_0 2024-09-12T17:41:33.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.092+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12967724543618884630', time=2024-09-12T19:31:42.326538+0000, chain.objs.size()=1 2024-09-12T17:41:33.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.092+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.VIAxRseqkmcLUbC-R4zWG79QvBbj6nh_0 2024-09-12T17:41:33.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.092+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9250162504442816502', time=2024-09-12T19:31:42.367189+0000, chain.objs.size()=1 2024-09-12T17:41:33.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.092+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.GQBdsPuHfstt51WZASX_fYzW20euVbO_0 2024-09-12T17:41:33.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.092+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.780616629463358370', time=2024-09-12T19:31:42.545428+0000, chain.objs.size()=1 2024-09-12T17:41:33.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.092+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.g-yJ8SYVXMoyn70MoPCuegC4EjPfqwi_0 2024-09-12T17:41:33.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.092+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17592008821914609656', time=2024-09-12T19:31:42.623031+0000, chain.objs.size()=1 2024-09-12T17:41:33.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.092+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.NU-KjqgJQ09V_9nyBP4gPlfDAq68yNv_0 2024-09-12T17:41:33.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.092+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10647866019801576491', time=2024-09-12T19:31:42.676263+0000, chain.objs.size()=1 2024-09-12T17:41:33.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.092+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.6vqfRO0MAzkBpXf7m3Jtlh4pfMcRXAp_0 2024-09-12T17:41:33.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.092+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1670080925724032566', time=2024-09-12T19:31:42.697845+0000, chain.objs.size()=1 2024-09-12T17:41:33.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.092+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.kbbaw6MPYowt_bjME4G2xxPt5d9yYnV_0 2024-09-12T17:41:33.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.092+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15434444466542055229', time=2024-09-12T19:31:42.936384+0000, chain.objs.size()=1 2024-09-12T17:41:33.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.092+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.-8tJilrXRGD9rlM2-SUm_9Pdf5ux_gv_0 2024-09-12T17:41:33.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.092+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11703903048444789227', time=2024-09-12T19:31:43.072353+0000, chain.objs.size()=1 2024-09-12T17:41:33.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.092+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.exUtXQmmgIbAw71qrODs38VN9J_eBud_0 2024-09-12T17:41:33.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.092+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12681735551674005092', time=2024-09-12T19:31:43.106874+0000, chain.objs.size()=1 2024-09-12T17:41:33.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.092+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.0qbJ_-EQkiGXoHZzhfGU-40j1xrWclN_0 2024-09-12T17:41:33.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.092+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3351491924251252733', time=2024-09-12T19:31:43.118863+0000, chain.objs.size()=1 2024-09-12T17:41:33.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.092+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Zi69Mey-xrrPzus6m5I0osvUg8bOvJU_0 2024-09-12T17:41:33.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.092+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9113902185488815392', time=2024-09-12T19:31:43.537826+0000, chain.objs.size()=1 2024-09-12T17:41:33.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.092+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.XHt-xASkKjQwamDgqqdEsNPhegby3ol_0 2024-09-12T17:41:33.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.092+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15200986883351547605', time=2024-09-12T19:31:43.599795+0000, chain.objs.size()=1 2024-09-12T17:41:33.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.092+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.ctuoD5v1FWvBOMcxKMP1OxFsjPZ1LvU_0 2024-09-12T17:41:33.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.092+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.185906000351947618', time=2024-09-12T19:31:43.755421+0000, chain.objs.size()=1 2024-09-12T17:41:33.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.092+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.JB5eLlz6aFT2CPO7eMEFuETyOH3EMCb_0 2024-09-12T17:41:33.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.092+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13336181289614777382', time=2024-09-12T19:31:43.780606+0000, chain.objs.size()=1 2024-09-12T17:41:33.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.092+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.4UkEOoDHAQUi0bw2VKnowUIHyfcCpp__0 2024-09-12T17:41:33.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.096+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6398116600984248909', time=2024-09-12T19:31:43.820781+0000, chain.objs.size()=1 2024-09-12T17:41:33.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.096+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.p1LYe8v5OJYIvJqCyF-WeBNMWLFaYVB_0 2024-09-12T17:41:33.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.096+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17946125936432301675', time=2024-09-12T19:31:43.898909+0000, chain.objs.size()=1 2024-09-12T17:41:33.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.096+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.mxImI3qRl7yzyzrTrK2DoPSPq5SReo1_0 2024-09-12T17:41:33.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.096+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13272469935518919803', time=2024-09-12T19:31:43.915362+0000, chain.objs.size()=1 2024-09-12T17:41:33.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.096+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.S54DCKYZDCijN-jQvL7vSx8qI__a6U1_0 2024-09-12T17:41:33.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.096+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18055902296243069128', time=2024-09-12T19:31:44.065577+0000, chain.objs.size()=1 2024-09-12T17:41:33.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.096+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.oEvoFgjvZKcBzqXu3XxrFMq1Wlt0pi4_0 2024-09-12T17:41:33.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.096+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15795398273307319172', time=2024-09-12T19:31:44.149359+0000, chain.objs.size()=1 2024-09-12T17:41:33.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.096+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.xPuy2kwr9Zp1ZYrYvrabgOkNTPgBj2U_0 2024-09-12T17:41:33.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.096+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16435207517898900', time=2024-09-12T19:31:44.165920+0000, chain.objs.size()=1 2024-09-12T17:41:33.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.096+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.aMt1DmmZ54GWVkrhG3q7cPXyugO2_Fp_0 2024-09-12T17:41:33.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.096+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.913820473299932850', time=2024-09-12T19:31:44.221086+0000, chain.objs.size()=1 2024-09-12T17:41:33.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.096+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.i4Byj5P5suBImTM0R6UKrpGQvtikf2u_0 2024-09-12T17:41:33.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.096+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13587861004712757389', time=2024-09-12T19:31:44.249330+0000, chain.objs.size()=1 2024-09-12T17:41:33.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.096+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.BwR5fwWOSX87ME_s-XFGjoKTYujbc_i_0 2024-09-12T17:41:33.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.096+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1444350094261382217', time=2024-09-12T19:31:44.372119+0000, chain.objs.size()=1 2024-09-12T17:41:33.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.096+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.kc2bHi3SnkFBaHg5VTv-19vMMuT58QF_0 2024-09-12T17:41:33.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.096+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12429600068259867183', time=2024-09-12T19:31:44.378905+0000, chain.objs.size()=1 2024-09-12T17:41:33.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.096+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.o4k4NRd2oCYVFrNbpXut7dbMg_k0Wtm_0 2024-09-12T17:41:33.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.096+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17581954649998148334', time=2024-09-12T19:31:44.387591+0000, chain.objs.size()=1 2024-09-12T17:41:33.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.096+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.UXO_e0tVd0AbT2A5-0_JBQzT-1GW6fO_0 2024-09-12T17:41:33.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.096+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8829244248684796532', time=2024-09-12T19:31:44.406391+0000, chain.objs.size()=1 2024-09-12T17:41:33.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.096+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.MlJzl8EPngL-J5bG1uv_VNTu_bb-72N_0 2024-09-12T17:41:33.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.096+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9781596998342709626', time=2024-09-12T19:31:44.408141+0000, chain.objs.size()=1 2024-09-12T17:41:33.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.096+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.yP10Yh74ewiIR8hdxGs_hBGaW2Ud5Rw_0 2024-09-12T17:41:33.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.096+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17052781351667872837', time=2024-09-12T19:31:44.472552+0000, chain.objs.size()=1 2024-09-12T17:41:33.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.096+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.gjtHWA1UTLLjIKDXUApqcCo47IuerEe_0 2024-09-12T17:41:33.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.096+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13472638111302746156', time=2024-09-12T19:31:44.477712+0000, chain.objs.size()=1 2024-09-12T17:41:33.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.100+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.3JIBUvbmG_lYcF5Er7QpHnI6QTog1wR_0 2024-09-12T17:41:33.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.100+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.366594229590424087', time=2024-09-12T19:31:44.483530+0000, chain.objs.size()=1 2024-09-12T17:41:33.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.100+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.oXM1_eJXnivQu9p8dcpR4FVs4fg1GRH_0 2024-09-12T17:41:33.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.100+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12900587471030177537', time=2024-09-12T19:31:50.256577+0000, chain.objs.size()=1 2024-09-12T17:41:33.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.100+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.278__shadow_.kjyu1sSgO_ZT4CYG6tN_nsENPl5lKF2_0 2024-09-12T17:41:33.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.100+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10212854429392327165', time=2024-09-12T19:31:53.003782+0000, chain.objs.size()=1 2024-09-12T17:41:33.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.100+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.285__shadow_.1XKjWdFRwF_ZGD6ZggrfWjOkRztwvu3_0 2024-09-12T17:41:33.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.100+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2529359663555428494', time=2024-09-12T19:31:53.814338+0000, chain.objs.size()=1 2024-09-12T17:41:33.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.100+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.287__shadow_.FOcYXzPQCs4ceTncvHkYTW8LjF-o6ml_0 2024-09-12T17:41:33.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.100+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10997889730018041795', time=2024-09-12T19:31:54.237722+0000, chain.objs.size()=1 2024-09-12T17:41:33.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.100+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.288__shadow_.Meu42XzPXfpRovfTMuZ4oiAc_rawV0R_0 2024-09-12T17:41:33.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.100+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17620306383845527608', time=2024-09-12T19:31:57.973722+0000, chain.objs.size()=1 2024-09-12T17:41:33.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.100+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.294__shadow_.wfD9MLzEnwg7BOnuF45GFvkbLqMy3N9_0 2024-09-12T17:41:33.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.100+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12273784028207048891', time=2024-09-12T19:32:01.513836+0000, chain.objs.size()=1 2024-09-12T17:41:33.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.100+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.303__shadow_.8N2GHKlWJ8TKn6UOz1SAuVou7rxtdlR_0 2024-09-12T17:41:33.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.100+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6025877387277719312', time=2024-09-12T19:32:01.886056+0000, chain.objs.size()=1 2024-09-12T17:41:33.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.100+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.304__shadow_.fes_Tw5EX73netVfEmDu2UkaspPiBrD_0 2024-09-12T17:41:33.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.100+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13120284079624581608', time=2024-09-12T19:32:28.006752+0000, chain.objs.size()=1 2024-09-12T17:41:33.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.100+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Ud_05tnD06hWWFYGkXj-cE56XHUSYka_0 2024-09-12T17:41:33.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.100+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15356048888750274019', time=2024-09-12T19:32:28.017368+0000, chain.objs.size()=1 2024-09-12T17:41:33.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.100+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.pm4uMIFvpvgDYehS4ppOyn5BNQF6cr0_0 2024-09-12T17:41:33.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.100+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10676715478611429984', time=2024-09-12T19:32:28.018647+0000, chain.objs.size()=1 2024-09-12T17:41:33.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.100+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.nOGVmfPTbpmqcZAfYmEGDg-1DSYK2Uj_0 2024-09-12T17:41:33.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.100+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5708257279186064127', time=2024-09-12T19:32:28.037920+0000, chain.objs.size()=1 2024-09-12T17:41:33.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.100+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.hh64e6ZI7i0vr4GWYgcPa0JhOFGeiTu_0 2024-09-12T17:41:33.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.100+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4918360933042143890', time=2024-09-12T19:32:28.074096+0000, chain.objs.size()=1 2024-09-12T17:41:33.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.100+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.w0jB_f85Bw8E9u19PxgMtoYVRxb_0mb_0 2024-09-12T17:41:33.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.100+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7805880589025816128', time=2024-09-12T19:32:28.093357+0000, chain.objs.size()=1 2024-09-12T17:41:33.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.100+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.jUt-rM3Tt_PEQpU4LljIKZ3EqXircQf_0 2024-09-12T17:41:33.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.100+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17052103529657357476', time=2024-09-12T19:32:28.096766+0000, chain.objs.size()=1 2024-09-12T17:41:33.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.100+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Wq61GkdYugHp4uec8BOxSUyjjG5HpM0_0 2024-09-12T17:41:33.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.100+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12779242859140963447', time=2024-09-12T19:32:28.192047+0000, chain.objs.size()=1 2024-09-12T17:41:33.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.100+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.1dmZxcDf6FIIbInDs-C6Yy0M71_lXTm_0 2024-09-12T17:41:33.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.100+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4117943039425622351', time=2024-09-12T19:32:28.209859+0000, chain.objs.size()=1 2024-09-12T17:41:33.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.100+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.qRWWN086zXj0P0j_TR6rTGqrssudHcS_0 2024-09-12T17:41:33.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.100+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6596300394006849335', time=2024-09-12T19:32:28.303290+0000, chain.objs.size()=1 2024-09-12T17:41:33.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.100+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Eo_18jcHw7cgp3rLEFZsMTyySjpMzGJ_0 2024-09-12T17:41:33.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.100+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14995439105115096123', time=2024-09-12T19:32:28.414584+0000, chain.objs.size()=1 2024-09-12T17:41:33.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.100+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.0CVkp08Iir6fMX1HCFvx8F1JX46WXPe_0 2024-09-12T17:41:33.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.100+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6942240947794249640', time=2024-09-12T19:32:28.460615+0000, chain.objs.size()=1 2024-09-12T17:41:33.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.100+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.3w5cJnpZ80kqeTtUCBY3N9BFsw7uKH9_0 2024-09-12T17:41:33.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.104+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10965994099797918361', time=2024-09-12T19:32:28.526162+0000, chain.objs.size()=1 2024-09-12T17:41:33.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.104+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.dnSRF7qvxjjqCMYkYOEoGiFRjF1UXGO_0 2024-09-12T17:41:33.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.104+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7064610793579796778', time=2024-09-12T19:32:28.688025+0000, chain.objs.size()=1 2024-09-12T17:41:33.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.104+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.KRMA3yc8UACvLLayywLyD-G6Ex-nXmF_0 2024-09-12T17:41:33.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.104+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1541320878805131252', time=2024-09-12T19:32:28.888865+0000, chain.objs.size()=1 2024-09-12T17:41:33.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.104+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.BPEPXxiApEBS40Ti4mgrQjJPesnhz8H_0 2024-09-12T17:41:33.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.104+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6814639866067391043', time=2024-09-12T19:32:29.030409+0000, chain.objs.size()=1 2024-09-12T17:41:33.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.104+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.UgtkyT900468JGoV57gXxfOFq0WUtRM_0 2024-09-12T17:41:33.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.104+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1861229371969656303', time=2024-09-12T19:32:29.086587+0000, chain.objs.size()=1 2024-09-12T17:41:33.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.104+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.uhD_SWVZFayucIIrWkUXxaRM8gUiNZV_0 2024-09-12T17:41:33.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.104+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4132133170512303842', time=2024-09-12T19:32:29.157498+0000, chain.objs.size()=1 2024-09-12T17:41:33.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.104+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.7l8de5XsCq_ZVM9CL2c4_qYFaoxa19N_0 2024-09-12T17:41:33.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.104+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17220494015945955961', time=2024-09-12T19:32:29.185183+0000, chain.objs.size()=1 2024-09-12T17:41:33.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.104+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.e6Zb8nKA1YaOrE2hY13oUzRQZFRAh2n_0 2024-09-12T17:41:33.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.104+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11968608369558701579', time=2024-09-12T19:32:29.198584+0000, chain.objs.size()=1 2024-09-12T17:41:33.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.104+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.R5Bm_KZVfIAu1MzpB_tcMxdfBN3rxne_0 2024-09-12T17:41:33.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.104+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4775582726872854131', time=2024-09-12T19:32:29.220632+0000, chain.objs.size()=1 2024-09-12T17:41:33.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.104+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.zTdob3kiwrV2sVI6tA7e1_Yv_4vVFBS_0 2024-09-12T17:41:33.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.104+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2932244005083196071', time=2024-09-12T19:32:29.223161+0000, chain.objs.size()=1 2024-09-12T17:41:33.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.104+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.mzOIl48_D4hUdXAQA1F-PqL-03Ze-xk_0 2024-09-12T17:41:33.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.104+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4781071879766088149', time=2024-09-12T19:32:29.239482+0000, chain.objs.size()=1 2024-09-12T17:41:33.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.104+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.KZwgiBHL1ghxDhZuRW2IGcanosFiQ9D_0 2024-09-12T17:41:33.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.104+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5675340989245589341', time=2024-09-12T19:32:29.357916+0000, chain.objs.size()=1 2024-09-12T17:41:33.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.104+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.T9rFoaQO92BmCrjeFxX6e6Sml0pSE39_0 2024-09-12T17:41:33.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.104+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17843721239149487947', time=2024-09-12T19:32:29.364778+0000, chain.objs.size()=1 2024-09-12T17:41:33.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.104+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.L6ay2ZDZqlgojfYSvPj1iME46INm2qY_0 2024-09-12T17:41:33.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.104+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8583544027406034904', time=2024-09-12T19:32:29.807592+0000, chain.objs.size()=1 2024-09-12T17:41:33.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.104+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.uiSc_kfcL36FieDXg9Al-KETdQVRvY-_0 2024-09-12T17:41:33.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.104+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.103539404309756163', time=2024-09-12T19:32:29.830782+0000, chain.objs.size()=1 2024-09-12T17:41:33.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.104+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.9K0n25in9Luj8Cg_wYvmfeHv_rHwC84_0 2024-09-12T17:41:33.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.104+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11610423629335237463', time=2024-09-12T19:32:29.857946+0000, chain.objs.size()=1 2024-09-12T17:41:33.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.104+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.mPhtqf_sA8Dx7zeRc5A0Pg5HCqrers4_0 2024-09-12T17:41:33.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.104+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12362731089627746222', time=2024-09-12T19:32:29.991767+0000, chain.objs.size()=1 2024-09-12T17:41:33.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.104+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.TVpnfM3R9lQsDlTXk5EAiqs4x9YmX6U_0 2024-09-12T17:41:33.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.108+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16293012721028529313', time=2024-09-12T19:32:30.002211+0000, chain.objs.size()=1 2024-09-12T17:41:33.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.108+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.4uVVQABHC5A_7GswHH4O1diMv2ZFl6q_0 2024-09-12T17:41:33.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.108+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3268975851440013407', time=2024-09-12T19:32:30.126595+0000, chain.objs.size()=1 2024-09-12T17:41:33.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.108+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.4cI9MRbC2N4rfDXRzMbGOcJ30-koBb9_0 2024-09-12T17:41:33.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.108+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15776745954109101829', time=2024-09-12T19:32:49.596289+0000, chain.objs.size()=1 2024-09-12T17:41:33.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.108+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.uwL5BygOAyF5rM3Ob6AYOSggNIZw0xR_0 2024-09-12T17:41:33.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.108+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8158300186040311219', time=2024-09-12T19:32:49.721017+0000, chain.objs.size()=1 2024-09-12T17:41:33.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.108+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.0hMClLtmuCJr_zCzkGfRvQHM6PntMcG_0 2024-09-12T17:41:33.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.108+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8451096947696644871', time=2024-09-12T19:32:49.730020+0000, chain.objs.size()=1 2024-09-12T17:41:33.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.108+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.geL7LGicPY-TMQM4XNDTbEkviLM2T8Z_0 2024-09-12T17:41:33.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.108+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13816152814218279159', time=2024-09-12T19:32:49.745849+0000, chain.objs.size()=1 2024-09-12T17:41:33.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.108+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.1ZNNkblD1PuHS_IKIf-96-Sv3zHQP3K_0 2024-09-12T17:41:33.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.108+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13947016292733535715', time=2024-09-12T19:32:49.770998+0000, chain.objs.size()=1 2024-09-12T17:41:33.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.108+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.B4OnaDnABZbXlvi66Iew4Oiwfhm43WL_0 2024-09-12T17:41:33.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.108+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2786805015787464910', time=2024-09-12T19:32:49.828760+0000, chain.objs.size()=1 2024-09-12T17:41:33.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.108+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.iJBn48wS8vtnqx8mHKXWSEiMxfJaW4s_0 2024-09-12T17:41:33.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.108+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17092113086609543620', time=2024-09-12T19:32:49.915177+0000, chain.objs.size()=1 2024-09-12T17:41:33.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.108+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.MExtZp2BOaPgRB9hhVekHixSsx8ayy1_0 2024-09-12T17:41:33.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.108+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17856895563866825060', time=2024-09-12T19:32:50.182650+0000, chain.objs.size()=1 2024-09-12T17:41:33.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.108+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.JTIRUrNiI8qlnINhQBZHeaJJL1v7hor_0 2024-09-12T17:41:33.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.108+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6851180260592563483', time=2024-09-12T19:32:50.234145+0000, chain.objs.size()=1 2024-09-12T17:41:33.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.108+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.D6_w8C5Idu9yigEcFleW1qHkyo3eIkb_0 2024-09-12T17:41:33.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.108+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10567370897389276776', time=2024-09-12T19:32:50.287012+0000, chain.objs.size()=1 2024-09-12T17:41:33.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.108+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.UgtSXWOBKQ9HIzazAcqoy8sRhkDljxy_0 2024-09-12T17:41:33.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.108+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17441238469468945911', time=2024-09-12T19:32:50.299193+0000, chain.objs.size()=1 2024-09-12T17:41:33.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.108+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.xG4XYz6jHzENGS665ygWmJto4GnixJI_0 2024-09-12T17:41:33.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.108+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13448970745033820864', time=2024-09-12T19:32:50.460518+0000, chain.objs.size()=1 2024-09-12T17:41:33.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.108+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.TXJA_iR7w30WhpAOmxZLqO18qSyGNaV_0 2024-09-12T17:41:33.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.108+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5410664345852709545', time=2024-09-12T19:32:50.592206+0000, chain.objs.size()=1 2024-09-12T17:41:33.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.108+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.d_0o8xNs8RRwg91TRPVTylIaFOBYQyq_0 2024-09-12T17:41:33.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.108+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13445534177368699600', time=2024-09-12T19:32:50.680916+0000, chain.objs.size()=1 2024-09-12T17:41:33.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.108+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.veeuJ81JL5tN2sMGm1ItCnYjc0J-clS_0 2024-09-12T17:41:33.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.108+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8527582319540380839', time=2024-09-12T19:32:50.684425+0000, chain.objs.size()=1 2024-09-12T17:41:33.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.108+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.R3B1we2WFoDOrDVowMG-bVWsSq3LbxU_0 2024-09-12T17:41:33.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.108+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5440465349228351844', time=2024-09-12T19:32:50.873500+0000, chain.objs.size()=1 2024-09-12T17:41:33.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.108+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.X4AXPLlvvIlVHNO94n71A5RerRQkql2_0 2024-09-12T17:41:33.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.112+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9779784780692817515', time=2024-09-12T19:32:50.900946+0000, chain.objs.size()=1 2024-09-12T17:41:33.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.112+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.9d2w1dippHomEf2-FDGz129NteUA7ZP_0 2024-09-12T17:41:33.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.112+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4134438445676219747', time=2024-09-12T19:32:50.990894+0000, chain.objs.size()=1 2024-09-12T17:41:33.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.112+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.P1nxTGOmxZGTgpkzsm1itTr8T1YcupX_0 2024-09-12T17:41:33.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.112+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13208993034785035305', time=2024-09-12T19:32:51.008101+0000, chain.objs.size()=1 2024-09-12T17:41:33.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.112+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.kYalut_VNKwc3U49CUP42r2NhS0rHK4_0 2024-09-12T17:41:33.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.112+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11917286705792117632', time=2024-09-12T19:32:51.239861+0000, chain.objs.size()=1 2024-09-12T17:41:33.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.112+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.D7gSTbKsqIjjr0fbAG_xooQOojy6qpo_0 2024-09-12T17:41:33.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.112+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1162500658549981623', time=2024-09-12T19:32:51.292822+0000, chain.objs.size()=1 2024-09-12T17:41:33.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.112+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Rn53Gu3lIyfptkOg_WUVT-DI3A_wN-N_0 2024-09-12T17:41:33.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.112+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16209063273269845671', time=2024-09-12T19:32:51.326690+0000, chain.objs.size()=1 2024-09-12T17:41:33.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.112+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Jk2VbAthbknVJOgZJx20u0xakH9pqdl_0 2024-09-12T17:41:33.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.112+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4478772510209641694', time=2024-09-12T19:32:51.362429+0000, chain.objs.size()=1 2024-09-12T17:41:33.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.112+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.bAgHlWSv3YGrGDIqNehDb81Ry5lPDLd_0 2024-09-12T17:41:33.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.112+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5070922762578324672', time=2024-09-12T19:32:51.364051+0000, chain.objs.size()=1 2024-09-12T17:41:33.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.112+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.J5k82SUAty6Jmpo1MQthFIVr_9r5IKc_0 2024-09-12T17:41:33.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.112+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18210115933735287927', time=2024-09-12T19:32:51.383310+0000, chain.objs.size()=1 2024-09-12T17:41:33.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.112+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.FC36asCaxKGFsdfEixQIKxAlwYttfKD_0 2024-09-12T17:41:33.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.112+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5063907494930583533', time=2024-09-12T19:32:51.624615+0000, chain.objs.size()=1 2024-09-12T17:41:33.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.112+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.YQ6RqEqELD3LvE6Ue38Xeq3b6Dcj424_0 2024-09-12T17:41:33.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.112+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/46937 2024-09-12T17:41:33.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.116+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-12T17:41:33.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.116+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13219026610024651904', time=2024-09-12T19:32:51.671088+0000, chain.objs.size()=1 2024-09-12T17:41:33.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.116+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.JTGEQDsVbxStp9xv4bCDsPoKKow8dG8_0 2024-09-12T17:41:33.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.116+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.696942072500177799', time=2024-09-12T19:32:51.683115+0000, chain.objs.size()=1 2024-09-12T17:41:33.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.116+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.M5JqEv2U7qCIw6rjqxVT9vqdQozUQ84_0 2024-09-12T17:41:33.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.116+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2099606404100689322', time=2024-09-12T19:32:54.601953+0000, chain.objs.size()=1 2024-09-12T17:41:33.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.116+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.332__shadow_.GCSdhHS8om5KSMGL7IHckDQ4La72iVy_0 2024-09-12T17:41:33.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.116+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4675804074749137271', time=2024-09-12T19:33:11.281829+0000, chain.objs.size()=1 2024-09-12T17:41:33.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.116+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.382__shadow_.hCT2yJfvftCDcqpZQmuv42zHDhbScdZ_0 2024-09-12T17:41:33.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.116+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9179303285283713686', time=2024-09-12T19:33:11.645573+0000, chain.objs.size()=1 2024-09-12T17:41:33.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.116+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.383__shadow_.gleej6dta-LL67pHQTVVse7ZM0D7gCk_0 2024-09-12T17:41:33.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.116+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14501722525336348882', time=2024-09-12T19:33:39.675736+0000, chain.objs.size()=1 2024-09-12T17:41:33.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.116+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.457__shadow_.-h2ZIODPdFMK209-GL9HP28q_Yqlo8J_0 2024-09-12T17:41:33.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.116+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8810611514690710549', time=2024-09-12T19:33:43.664666+0000, chain.objs.size()=1 2024-09-12T17:41:33.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.116+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.464__shadow_.8utkhgbxO7KTLeha7zwXUAYqybT876B_0 2024-09-12T17:41:33.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.116+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5525043366074661292', time=2024-09-12T19:33:49.663646+0000, chain.objs.size()=1 2024-09-12T17:41:33.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.116+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.484__shadow_.FrucC_L5Br99fgxsb6NPY6HMpigPevw_0 2024-09-12T17:41:33.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.116+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7148682689666810027', time=2024-09-12T19:33:55.145307+0000, chain.objs.size()=1 2024-09-12T17:41:33.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.116+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.498__shadow_.kjuwG94bplErST5QQ76FPV4snbqqwDZ_0 2024-09-12T17:41:33.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.116+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10065589482738805599', time=2024-09-12T19:33:55.884476+0000, chain.objs.size()=1 2024-09-12T17:41:33.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.116+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.500__shadow_.vcrNgBTm03A6jfUQ1BA-4QkK9biseU3_0 2024-09-12T17:41:33.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.116+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13649221069152475826', time=2024-09-12T19:33:57.455419+0000, chain.objs.size()=1 2024-09-12T17:41:33.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.116+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.503__shadow:5PZwxWS6kVU04L4agSYet4YqDKg.iTJ_.vEQTiH10KZ8H36ScYyTe7asHZOEv9fv_0 2024-09-12T17:41:33.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.116+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11473543017760356410', time=2024-09-12T19:34:05.372310+0000, chain.objs.size()=1 2024-09-12T17:41:33.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.116+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.517__shadow_.zGSSXdg45cH5OJQS7ldkvafTttiIZvu_0 2024-09-12T17:41:33.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.116+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18401397157786420201', time=2024-09-12T19:34:10.793783+0000, chain.objs.size()=4 2024-09-12T17:41:33.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.116+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.520__shadow:9foiay0w.ofiYaiRey.Bub7NzxK0Dsr_.BBtiB5TJf3M3k7rmT2UNnx3Z_9esmdX_0 2024-09-12T17:41:33.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.116+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.520__shadow:9foiay0w.ofiYaiRey.Bub7NzxK0Dsr_.BBtiB5TJf3M3k7rmT2UNnx3Z_9esmdX_1 2024-09-12T17:41:33.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.116+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.520__shadow:9foiay0w.ofiYaiRey.Bub7NzxK0Dsr_.BBtiB5TJf3M3k7rmT2UNnx3Z_9esmdX_2 2024-09-12T17:41:33.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.116+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.520__shadow:9foiay0w.ofiYaiRey.Bub7NzxK0Dsr_.BBtiB5TJf3M3k7rmT2UNnx3Z_9esmdX_3 2024-09-12T17:41:33.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.116+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11204147343054244703', time=2024-09-12T19:34:46.373858+0000, chain.objs.size()=1 2024-09-12T17:41:33.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.116+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.536__multipart_mymultipart.2~HSv4djR9iBnKGU9hirfhqN1wucUENZg.1 2024-09-12T17:41:33.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.116+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12784352490721606522', time=2024-09-12T19:35:24.200686+0000, chain.objs.size()=1 2024-09-12T17:41:33.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.116+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.570__shadow:86RQSGWIu7BuJ4yKAsDeZFK9NejwOTT_.DRD5kbdo4Ql7EhmlZyoj7OPZysHoH6B_0 2024-09-12T17:41:33.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.116+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11838194712930882181', time=2024-09-12T19:35:30.047565+0000, chain.objs.size()=1 2024-09-12T17:41:33.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.116+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.575__shadow:nDnVflGg0-Q5HTZj0-.ruy-NSW9fiL._.fOJPfkKLUPY4X2-ohfGWCEw-I-ByupN_0 2024-09-12T17:41:33.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.116+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1517046555893139146', time=2024-09-12T19:35:38.629217+0000, chain.objs.size()=1 2024-09-12T17:41:33.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.116+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.577__shadow:Nte7rtvygCPwOq-e60gAq.tB9fVLd14_.4XoYjWy_rGnZ12ajggPhR0FXnBojHJS_0 2024-09-12T17:41:33.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.120+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13823407216778980919', time=2024-09-12T19:35:46.183697+0000, chain.objs.size()=1 2024-09-12T17:41:33.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.120+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.577__shadow:hXWji8s48cyHRDwwS93q1nCZb9PKBCh_.rOnxYaIucbyiuVqQ4Mz6z-ehGJDSx09_0 2024-09-12T17:41:33.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.120+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2248460005016927081', time=2024-09-12T19:36:04.802144+0000, chain.objs.size()=1 2024-09-12T17:41:33.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.120+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.605__shadow_.u-8gEhrml9DiGHnBMwEQ3QMMeIrjLMq_0 2024-09-12T17:41:33.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.120+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14868456290916207097', time=2024-09-12T19:38:29.435084+0000, chain.objs.size()=2 2024-09-12T17:41:33.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.120+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.642__shadow_.w-3C740udEmPA-GiYBxhC4_2fnZjM5Q_0 2024-09-12T17:41:33.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.120+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.642__shadow_.w-3C740udEmPA-GiYBxhC4_2fnZjM5Q_1 2024-09-12T17:41:33.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.120+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8161750673803368829', time=2024-09-12T19:38:30.490378+0000, chain.objs.size()=1 2024-09-12T17:41:33.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.120+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.644__shadow_.n5o7dW9A0GavebrOHp3gLGBsNo5y8Bp_0 2024-09-12T17:41:33.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.120+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15229547170487885577', time=2024-09-12T19:38:32.123482+0000, chain.objs.size()=1 2024-09-12T17:41:33.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.120+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.647__shadow_.i1GlihgXs2eRcQdlduvDpC5N0Ja2uxz_0 2024-09-12T17:41:33.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.124+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:41:33.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.124+0000 7fd765adf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:41:33.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.128+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:41:33.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.128+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:41:33.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.128+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46943' 2024-09-12T17:41:33.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.128+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7063018847198886136', time=2024-09-12T19:29:41.162803+0000, chain.objs.size()=1 2024-09-12T17:41:33.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.128+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.157__shadow:6T1fi7N0LJAduxu8uwtwXzHhNJLhGQy_.23fkkOp8W545RTJnvRj7Kr1h0DPVuwt_0 2024-09-12T17:41:33.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.128+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='_mVG8C0LeraXu-dBwBQSN5ccl2jcbxwj', time=2024-09-12T19:29:47.929823+0000, chain.objs.size()=3 2024-09-12T17:41:33.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.128+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.161__shadow_.vmQMDxasD2kIF5Ph4UhjsPSh1blfOo__0 2024-09-12T17:41:33.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.128+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.161__shadow_.vmQMDxasD2kIF5Ph4UhjsPSh1blfOo__1 2024-09-12T17:41:33.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.128+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.161__shadow_.vmQMDxasD2kIF5Ph4UhjsPSh1blfOo__2 2024-09-12T17:41:33.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.128+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='_VbVJ3aOA-xNmKIg5dIMyQX9-dQbIn_k', time=2024-09-12T19:29:48.119617+0000, chain.objs.size()=3 2024-09-12T17:41:33.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.128+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.161__shadow_.EE10cRxdgxWOGGPpftbMX2jsb6Tkgfj_0 2024-09-12T17:41:33.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.128+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.161__shadow_.EE10cRxdgxWOGGPpftbMX2jsb6Tkgfj_1 2024-09-12T17:41:33.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.128+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.161__shadow_.EE10cRxdgxWOGGPpftbMX2jsb6Tkgfj_2 2024-09-12T17:41:33.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.128+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4841523010344023012', time=2024-09-12T19:29:58.075163+0000, chain.objs.size()=1 2024-09-12T17:41:33.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.128+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.183__shadow_.tV7h72AzrgwHnjMhE7GU7zbycsEIwgX_0 2024-09-12T17:41:33.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.128+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10948237870261292005', time=2024-09-12T19:31:13.461394+0000, chain.objs.size()=1 2024-09-12T17:41:33.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.128+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.237__shadow_.G2Rvmnia4VxbyxWcwx64FzK0EeWUR6__0 2024-09-12T17:41:33.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.128+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10120499458700037049', time=2024-09-12T19:31:15.027210+0000, chain.objs.size()=1 2024-09-12T17:41:33.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.128+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.241__shadow_.gaLX-M4fTov3U5ZNV80rZshSh6c7drV_0 2024-09-12T17:41:33.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.128+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1531543893362140452', time=2024-09-12T19:31:16.778119+0000, chain.objs.size()=1 2024-09-12T17:41:33.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.128+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.245__shadow_.k5R0DXYebqdWAPlToBVlGKALCEJbmRy_0 2024-09-12T17:41:33.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.128+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7873462688133415217', time=2024-09-12T19:31:19.490374+0000, chain.objs.size()=1 2024-09-12T17:41:33.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.128+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.252__shadow_.69S7MuBqGlcsoLU2Uzce_-MtszQSqHE_0 2024-09-12T17:41:33.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.132+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7097858775702756485', time=2024-09-12T19:31:22.512384+0000, chain.objs.size()=1 2024-09-12T17:41:33.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.132+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.260__shadow_.6p1YJdldwWuC3Gje6gGTbOeJkvSsxCN_0 2024-09-12T17:41:33.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.132+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14026548935507739948', time=2024-09-12T19:31:42.309387+0000, chain.objs.size()=1 2024-09-12T17:41:33.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.132+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.hJvIGiv3zA8q4J3GWZz_pDNNnSxLWDk_0 2024-09-12T17:41:33.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.132+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10217404860444977240', time=2024-09-12T19:31:42.334330+0000, chain.objs.size()=1 2024-09-12T17:41:33.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.132+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.i6viOtHagTdnHbXENN97n27_ub6iQC5_0 2024-09-12T17:41:33.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.132+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12979429488396165623', time=2024-09-12T19:31:42.360874+0000, chain.objs.size()=1 2024-09-12T17:41:33.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.132+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.cGuinACB93s-68WdxSI6ZUqzn2bu874_0 2024-09-12T17:41:33.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.132+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3776924739214339059', time=2024-09-12T19:31:42.394130+0000, chain.objs.size()=1 2024-09-12T17:41:33.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.132+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.ajhB-svIaxICN3XBgCKKMKwYlXARWIM_0 2024-09-12T17:41:33.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.132+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12786128160061289026', time=2024-09-12T19:31:42.437280+0000, chain.objs.size()=1 2024-09-12T17:41:33.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.132+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.LHlDPjJW6QnBTm8PBPZ4gtLjQMlTT0B_0 2024-09-12T17:41:33.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.132+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16158907728019330190', time=2024-09-12T19:31:42.568727+0000, chain.objs.size()=1 2024-09-12T17:41:33.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.132+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.NP3idjOvSV83lvCuDLYX4zIctdBsTey_0 2024-09-12T17:41:33.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.132+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10781063350269260216', time=2024-09-12T19:31:42.638951+0000, chain.objs.size()=1 2024-09-12T17:41:33.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.132+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.RvGJYYhf1tQXoqVY69pY-k1yCp4jeep_0 2024-09-12T17:41:33.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.132+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3918162438081085691', time=2024-09-12T19:31:42.649043+0000, chain.objs.size()=1 2024-09-12T17:41:33.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.132+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.9lmmLuYGgGk8ow0OrRk--x2sMUwEwGW_0 2024-09-12T17:41:33.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.132+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8616185108720939575', time=2024-09-12T19:31:42.660780+0000, chain.objs.size()=1 2024-09-12T17:41:33.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.132+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.LdfaoqFaM7nQA4L9VX2RcYfyajClBji_0 2024-09-12T17:41:33.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.132+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10731232391122230679', time=2024-09-12T19:31:42.693483+0000, chain.objs.size()=1 2024-09-12T17:41:33.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.132+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.EiCnUFrGqkvXLuE1NR1kbdX0mCwdjRH_0 2024-09-12T17:41:33.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.132+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11767970810305845304', time=2024-09-12T19:31:42.700685+0000, chain.objs.size()=1 2024-09-12T17:41:33.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.132+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.AGfU1d2-zhdPyr-LoTp4Z05Of6XQlqD_0 2024-09-12T17:41:33.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.132+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3026445935687690126', time=2024-09-12T19:31:42.825536+0000, chain.objs.size()=1 2024-09-12T17:41:33.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.132+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.tWAxjNx0AzcsAxiZI--o-aOp_Ymq4ZN_0 2024-09-12T17:41:33.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.132+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14511566304485929341', time=2024-09-12T19:31:42.896433+0000, chain.objs.size()=1 2024-09-12T17:41:33.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.132+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.GDLq1-W3Vgs0nfT1HHN3iZRuD1FDPA__0 2024-09-12T17:41:33.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.132+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13078947887087467060', time=2024-09-12T19:31:42.899344+0000, chain.objs.size()=1 2024-09-12T17:41:33.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.132+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.1fLvIR0gDaQgErXawJLvF_rqKo3bHTm_0 2024-09-12T17:41:33.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.132+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11696575620131166396', time=2024-09-12T19:31:42.913541+0000, chain.objs.size()=1 2024-09-12T17:41:33.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.132+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.65Lr-SJi6XWTBOI3eswBAcRfE0aFKVZ_0 2024-09-12T17:41:33.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.132+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3591758121120909306', time=2024-09-12T19:31:42.918401+0000, chain.objs.size()=1 2024-09-12T17:41:33.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.132+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.x0A2sY9RXGbTVgIXzRAur2N1zYSU5lG_0 2024-09-12T17:41:33.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.132+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2054800018336360436', time=2024-09-12T19:31:43.074017+0000, chain.objs.size()=1 2024-09-12T17:41:33.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.132+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.ZZYiAfeiK4Vb2uzSwVBj4tbvzx905u0_0 2024-09-12T17:41:33.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.132+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1902254172646051333', time=2024-09-12T19:31:43.187099+0000, chain.objs.size()=1 2024-09-12T17:41:33.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.132+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.C7-lCZMwDtbA-ETmXhOqQVnmUgFNiRQ_0 2024-09-12T17:41:33.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.132+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14109635554091865473', time=2024-09-12T19:31:43.426455+0000, chain.objs.size()=1 2024-09-12T17:41:33.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.132+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.EZUskYc29fPp_w4TbywhvTnKCxurSWr_0 2024-09-12T17:41:33.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.132+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5251530149162231150', time=2024-09-12T19:31:43.494381+0000, chain.objs.size()=1 2024-09-12T17:41:33.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.132+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.67dM_F-wkyw7eAiPlbUdMmEgLQr2vk8_0 2024-09-12T17:41:33.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.132+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13465142114941048284', time=2024-09-12T19:31:43.496631+0000, chain.objs.size()=1 2024-09-12T17:41:33.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.132+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.qZVR2ozrOMYa2ZHhSLnhEtk1s9BaRup_0 2024-09-12T17:41:33.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.132+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9633260646533115512', time=2024-09-12T19:31:43.514139+0000, chain.objs.size()=1 2024-09-12T17:41:33.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.132+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.P7yWQhbvipbAb2in-ofvVqVs4gbB2QW_0 2024-09-12T17:41:33.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.136+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1620441950970000776', time=2024-09-12T19:31:43.529414+0000, chain.objs.size()=1 2024-09-12T17:41:33.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.136+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Q-UNBAQ533kr3iWbTX683Q0PUD6WriP_0 2024-09-12T17:41:33.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.136+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15342034002290575946', time=2024-09-12T19:31:43.567753+0000, chain.objs.size()=1 2024-09-12T17:41:33.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.136+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.4zoiy9b4BbPWwMV5-k8P_K3n5uwG264_0 2024-09-12T17:41:33.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.136+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1668622341268770483', time=2024-09-12T19:31:43.579307+0000, chain.objs.size()=1 2024-09-12T17:41:33.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.136+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.tEQeTdQwDZC81jwQaqVLZy__GvllkMp_0 2024-09-12T17:41:33.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.136+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13146358828261461596', time=2024-09-12T19:31:43.609824+0000, chain.objs.size()=1 2024-09-12T17:41:33.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.136+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_._vWlFHzvdfF_rXNkQtRIkLNNXIyMzQS_0 2024-09-12T17:41:33.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.136+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7901162819733259057', time=2024-09-12T19:31:43.849885+0000, chain.objs.size()=1 2024-09-12T17:41:33.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.136+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.ERfjWLevlcKY1miuz16T4e3QiMi_myq_0 2024-09-12T17:41:33.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.136+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7196343861601020688', time=2024-09-12T19:31:43.864537+0000, chain.objs.size()=1 2024-09-12T17:41:33.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.136+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.tkKnaMN7ONWgy7cwfxNrUKM-FkEvidk_0 2024-09-12T17:41:33.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.136+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11939655487127031606', time=2024-09-12T19:31:43.935051+0000, chain.objs.size()=1 2024-09-12T17:41:33.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.136+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.KChPUNqBy8NfB8IV-1OsyB67YF0-PYm_0 2024-09-12T17:41:33.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.136+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5307636894913496735', time=2024-09-12T19:31:44.264044+0000, chain.objs.size()=1 2024-09-12T17:41:33.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.136+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Io06frc9ZqzQMFysai72Exy4KUDccXt_0 2024-09-12T17:41:33.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.136+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14533448408530648578', time=2024-09-12T19:31:44.430749+0000, chain.objs.size()=1 2024-09-12T17:41:33.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.136+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.qR63lcIM7fscklsABIZcK4vzqwebp_b_0 2024-09-12T17:41:33.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.136+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14017889958128169055', time=2024-09-12T19:31:44.507603+0000, chain.objs.size()=1 2024-09-12T17:41:33.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.136+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.fot-NgRdxJ2yWlYnlMfWGoeN5mgq-70_0 2024-09-12T17:41:33.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.136+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8351177146810653680', time=2024-09-12T19:31:44.514412+0000, chain.objs.size()=1 2024-09-12T17:41:33.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.136+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.YurOwW9WaO-jwlDOmT7a4aN3jQcyh9v_0 2024-09-12T17:41:33.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.136+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11958809894078694414', time=2024-09-12T19:31:48.373427+0000, chain.objs.size()=1 2024-09-12T17:41:33.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.136+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.273__shadow_.-mkxmvYyWpA-nwQo3Fjrvcf6ZzwLcqA_0 2024-09-12T17:41:33.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.136+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10180251760418025305', time=2024-09-12T19:31:51.819101+0000, chain.objs.size()=1 2024-09-12T17:41:33.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.136+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.282__shadow_.7BtijEd4mYblbx3fP7uowSl6mKLbZYf_0 2024-09-12T17:41:33.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.140+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9859736216120413508', time=2024-09-12T19:31:52.573947+0000, chain.objs.size()=1 2024-09-12T17:41:33.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.140+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.284__shadow_.9DMujLI2f_NEYHSKrQy6NM5FqPq1krr_0 2024-09-12T17:41:33.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.140+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5006508784989203229', time=2024-09-12T19:31:54.990318+0000, chain.objs.size()=1 2024-09-12T17:41:33.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.140+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.290__shadow_.4zTU3PVkVxSDy9l65Ey58tNx_zoIqj-_0 2024-09-12T17:41:33.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.140+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.382935754548544509', time=2024-09-12T19:31:56.461812+0000, chain.objs.size()=1 2024-09-12T17:41:33.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.140+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.292__shadow_.e6g3fo-9ECPpmvm6UPls3C2lmbjbcjA_0 2024-09-12T17:41:33.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.140+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17177765296067513610', time=2024-09-12T19:31:56.505245+0000, chain.objs.size()=1 2024-09-12T17:41:33.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.140+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.292__shadow_.VsSwV_oOzxlMcpriBq_OcM7iwSS5fmI_0 2024-09-12T17:41:33.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.140+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13409730238058910780', time=2024-09-12T19:31:57.596351+0000, chain.objs.size()=1 2024-09-12T17:41:33.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.140+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.293__shadow_.FbW-QcJhsImPKFH26OS8hBcr5NkNr-M_0 2024-09-12T17:41:33.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.140+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4799193605289846905', time=2024-09-12T19:31:57.629635+0000, chain.objs.size()=1 2024-09-12T17:41:33.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.140+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.293__shadow_.Vwo_U3FQLEYYwIMvoqODIHcqNtkKxnw_0 2024-09-12T17:41:33.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.140+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8745459935120963584', time=2024-09-12T19:31:58.357560+0000, chain.objs.size()=1 2024-09-12T17:41:33.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.140+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.295__shadow_.mH0IawPV2oXa6CgS5FFU07yhe8pYkO-_0 2024-09-12T17:41:33.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.140+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11841081565577528152', time=2024-09-12T19:32:02.878062+0000, chain.objs.size()=1 2024-09-12T17:41:33.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.140+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.306__shadow_.uSZJtMmuuAonlS7fgS3D36LV68lOIHH_0 2024-09-12T17:41:33.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.140+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14365728051905942808', time=2024-09-12T19:32:27.842455+0000, chain.objs.size()=1 2024-09-12T17:41:33.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.140+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.MBTMIbSu6vG1xcpaJVJuZpNkMzIGhQA_0 2024-09-12T17:41:33.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.140+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7882882917916117327', time=2024-09-12T19:32:27.935661+0000, chain.objs.size()=1 2024-09-12T17:41:33.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.140+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.QOWvfo9-1JqXVcpHoriDZebN6u8qPwL_0 2024-09-12T17:41:33.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.140+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3953788302358294039', time=2024-09-12T19:32:28.023853+0000, chain.objs.size()=1 2024-09-12T17:41:33.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.140+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.BQsj39fHWElpzt6ix1DKfrqU1rP75Kl_0 2024-09-12T17:41:33.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.140+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9343450282759426193', time=2024-09-12T19:32:28.172202+0000, chain.objs.size()=1 2024-09-12T17:41:33.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.140+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.QxzPNYPQgolw0fRDZbG7E5Hewyh_HCe_0 2024-09-12T17:41:33.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.140+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11773834001942996950', time=2024-09-12T19:32:28.182776+0000, chain.objs.size()=1 2024-09-12T17:41:33.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.140+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.j1s9sPkr17d48SbJJKlQE458qDGiUpi_0 2024-09-12T17:41:33.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.140+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18059057287943793938', time=2024-09-12T19:32:28.270878+0000, chain.objs.size()=1 2024-09-12T17:41:33.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.140+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.F4BOH7oZJME44sq-ggM1AijO_ZozBa8_0 2024-09-12T17:41:33.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.140+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3924478428041285546', time=2024-09-12T19:32:28.391904+0000, chain.objs.size()=1 2024-09-12T17:41:33.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.140+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.EZHUZ2gogg7E4jo4U4SsqFtPu3rLjCO_0 2024-09-12T17:41:33.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.140+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13729028901224762903', time=2024-09-12T19:32:28.397480+0000, chain.objs.size()=1 2024-09-12T17:41:33.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.140+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Eq3Y1eENznzJW-C4bbVKbNM1NERzP3E_0 2024-09-12T17:41:33.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.140+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3019485336958981008', time=2024-09-12T19:32:28.434061+0000, chain.objs.size()=1 2024-09-12T17:41:33.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.140+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.pymgzUfCuuuzh0KW714nKLBZ-zuNL-u_0 2024-09-12T17:41:33.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.140+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10161205681979213629', time=2024-09-12T19:32:28.506682+0000, chain.objs.size()=1 2024-09-12T17:41:33.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.140+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.9OWSsLbVezFF_4b-CBjE0dPQHNyVHFe_0 2024-09-12T17:41:33.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.140+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8134792462807578300', time=2024-09-12T19:32:28.541690+0000, chain.objs.size()=1 2024-09-12T17:41:33.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.140+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.ty7pl1NM-cb5POqX5FlkKrq8b9U19RK_0 2024-09-12T17:41:33.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.140+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1541951885305771213', time=2024-09-12T19:32:28.561622+0000, chain.objs.size()=1 2024-09-12T17:41:33.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.140+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.XBKf29nXpOEc3g_0dyduKYidnFp49WN_0 2024-09-12T17:41:33.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.140+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5158727920698078371', time=2024-09-12T19:32:28.778204+0000, chain.objs.size()=1 2024-09-12T17:41:33.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.140+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.p2UZBpmWBeVj4fDQUvlBBYbyloSnUDO_0 2024-09-12T17:41:33.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.140+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14668742066663172214', time=2024-09-12T19:32:28.808775+0000, chain.objs.size()=1 2024-09-12T17:41:33.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.140+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.d3GKB8sMHhKEJg7xHApT7uYYDac4gmY_0 2024-09-12T17:41:33.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.144+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3352646755504923425', time=2024-09-12T19:32:28.842783+0000, chain.objs.size()=1 2024-09-12T17:41:33.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.144+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.gQBN3oz48mBA41JnavBQ46YfxnXBtIX_0 2024-09-12T17:41:33.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.144+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2310636581341433331', time=2024-09-12T19:32:28.881474+0000, chain.objs.size()=1 2024-09-12T17:41:33.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.144+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.2gArxoJ91b8rBit2ECOsbwlFzg7ltBr_0 2024-09-12T17:41:33.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.144+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9227916716901364003', time=2024-09-12T19:32:29.015891+0000, chain.objs.size()=1 2024-09-12T17:41:33.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.144+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.646Fz5QaCgSdO-tBzDqZwWo-Bou3cZN_0 2024-09-12T17:41:33.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.144+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13817127863176509244', time=2024-09-12T19:32:29.018162+0000, chain.objs.size()=1 2024-09-12T17:41:33.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.144+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.-bzSz7Iw_8OzU-NtS4k2fyYkk4zXyKm_0 2024-09-12T17:41:33.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.144+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10689156122683951947', time=2024-09-12T19:32:29.020092+0000, chain.objs.size()=1 2024-09-12T17:41:33.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.144+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.i7R7hdwghwz5KSA4j5ho36HIO8tkh7G_0 2024-09-12T17:41:33.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.144+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15892296375698219616', time=2024-09-12T19:32:29.026971+0000, chain.objs.size()=1 2024-09-12T17:41:33.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.144+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.hx-6IuLDuRdjJhxTYr6K8wlHCkht8wG_0 2024-09-12T17:41:33.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.144+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18405841062079099211', time=2024-09-12T19:32:29.032662+0000, chain.objs.size()=1 2024-09-12T17:41:33.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.144+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.12d4gQXTQ45Qz4HoUhyEmjiLSvaNye4_0 2024-09-12T17:41:33.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.144+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3444322291413841171', time=2024-09-12T19:32:29.121978+0000, chain.objs.size()=1 2024-09-12T17:41:33.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.144+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.ieYsGcXpxTdC-3BurTKC3Bd0A_5AehN_0 2024-09-12T17:41:33.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.144+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12204060052949984955', time=2024-09-12T19:32:29.163298+0000, chain.objs.size()=1 2024-09-12T17:41:33.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.144+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.8ZTR3K9QF-55mTxpYE9UpAJduWTVr9J_0 2024-09-12T17:41:33.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.144+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5138571030469898403', time=2024-09-12T19:32:29.180190+0000, chain.objs.size()=1 2024-09-12T17:41:33.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.144+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.iR0xy1q-2zffxI8t5e_-IpEQMnO8foe_0 2024-09-12T17:41:33.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.144+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12147570285460423649', time=2024-09-12T19:32:29.189533+0000, chain.objs.size()=1 2024-09-12T17:41:33.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.144+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.hlQRQMqVn49IhATNeAMDRK6Awvkh_bT_0 2024-09-12T17:41:33.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.144+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.767866590705554985', time=2024-09-12T19:32:29.232561+0000, chain.objs.size()=1 2024-09-12T17:41:33.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.144+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.I33UgKbbNjWnbk5Lx-X6NrLxQBKPPg-_0 2024-09-12T17:41:33.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.144+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7749936434828864885', time=2024-09-12T19:32:29.357276+0000, chain.objs.size()=1 2024-09-12T17:41:33.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.144+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.lKzobCgENMMhF_8ty02--2j4vsl5g2a_0 2024-09-12T17:41:33.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.144+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6885137199187622951', time=2024-09-12T19:32:29.452360+0000, chain.objs.size()=1 2024-09-12T17:41:33.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.144+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.RwGDJcSaKs09viUtnN0iStHxvLwJrfB_0 2024-09-12T17:41:33.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.144+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.795614248637924168', time=2024-09-12T19:32:29.458423+0000, chain.objs.size()=1 2024-09-12T17:41:33.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.144+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.c4mTZLjJTVrsKtf-w_GlddvkIqSoMPe_0 2024-09-12T17:41:33.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.148+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3560032529986688024', time=2024-09-12T19:32:29.468530+0000, chain.objs.size()=1 2024-09-12T17:41:33.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.148+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.kD6ItIy1OISW6kGkGVQ7UeI8F3gMlDy_0 2024-09-12T17:41:33.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.148+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.251388466791526435', time=2024-09-12T19:32:29.537194+0000, chain.objs.size()=1 2024-09-12T17:41:33.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.148+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.ApgKczqM08MtZ2SkmHMWcvmf8pHUW1W_0 2024-09-12T17:41:33.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.148+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.373571497217649391', time=2024-09-12T19:32:29.551703+0000, chain.objs.size()=1 2024-09-12T17:41:33.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.148+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.tu_7xmLZmuJYDKDAV--_kC09ER5_gFe_0 2024-09-12T17:41:33.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.148+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12918199266128836472', time=2024-09-12T19:32:29.682117+0000, chain.objs.size()=1 2024-09-12T17:41:33.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.148+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.1KuRnOr8bmlACfECbglT8dJQEwF5LIl_0 2024-09-12T17:41:33.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.148+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6467702464044662250', time=2024-09-12T19:32:29.745214+0000, chain.objs.size()=1 2024-09-12T17:41:33.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.148+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.pe5zf7g25Vq8VrA-ugSfQNqS0ONp7y0_0 2024-09-12T17:41:33.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.148+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12334534859653220334', time=2024-09-12T19:32:29.773513+0000, chain.objs.size()=1 2024-09-12T17:41:33.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.148+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.UMbR6wLb88OI7gfhs1u9orBYrEmtWkc_0 2024-09-12T17:41:33.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.148+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12167976719536259929', time=2024-09-12T19:32:29.793938+0000, chain.objs.size()=1 2024-09-12T17:41:33.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.148+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.4q5O7TFq0CVqnqZBinXePx192XWIGJr_0 2024-09-12T17:41:33.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.148+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6898569945519489078', time=2024-09-12T19:32:29.834561+0000, chain.objs.size()=1 2024-09-12T17:41:33.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.148+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.GtXDc5OOI3Z1Qvyp39xc3OEdrpG2Ye9_0 2024-09-12T17:41:33.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.148+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10359637191326601670', time=2024-09-12T19:32:49.561774+0000, chain.objs.size()=1 2024-09-12T17:41:33.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.148+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.jiipiti9WaUQRyIwcIVkofmDD1GEp90_0 2024-09-12T17:41:33.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.148+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4784689627749444923', time=2024-09-12T19:32:49.852408+0000, chain.objs.size()=1 2024-09-12T17:41:33.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.148+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.K7RapZQTB3fz1IgDdfQmZw9GaZ88vi2_0 2024-09-12T17:41:33.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.148+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4338955125192601038', time=2024-09-12T19:32:49.925913+0000, chain.objs.size()=1 2024-09-12T17:41:33.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.148+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.eqd7nHAZvf_RKN3irmE3mkZ04yWqTI0_0 2024-09-12T17:41:33.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.148+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14290838189146385815', time=2024-09-12T19:32:49.937224+0000, chain.objs.size()=1 2024-09-12T17:41:33.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.148+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.p7xQQiLHl0djUAeDhuI7nAdo5CtFKjZ_0 2024-09-12T17:41:33.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.148+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4498680127175239234', time=2024-09-12T19:32:49.965068+0000, chain.objs.size()=1 2024-09-12T17:41:33.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.148+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.NjirFq7DC3_2KUogeYH__iuJl-xGDUf_0 2024-09-12T17:41:33.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.148+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11598985865826816465', time=2024-09-12T19:32:49.971082+0000, chain.objs.size()=1 2024-09-12T17:41:33.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.148+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.IgrkWfQSDzVq3uax6MIkUX7CdKu32Tb_0 2024-09-12T17:41:33.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.148+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15708536533611623321', time=2024-09-12T19:32:50.129257+0000, chain.objs.size()=1 2024-09-12T17:41:33.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.148+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.SmtbyghBcZIIsptDF2L8AcpP_F0fQ57_0 2024-09-12T17:41:33.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.152+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7969919779831253969', time=2024-09-12T19:32:50.146548+0000, chain.objs.size()=1 2024-09-12T17:41:33.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.152+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_._ASpWE8F8EffJiMgkpaKzKqgMjCrvm6_0 2024-09-12T17:41:33.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.152+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3553355682640334249', time=2024-09-12T19:32:50.180356+0000, chain.objs.size()=1 2024-09-12T17:41:33.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.152+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.NJwgcOA6nB9uXr2ZAeNKyzlferl4kOp_0 2024-09-12T17:41:33.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.152+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13750564076571283184', time=2024-09-12T19:32:50.461212+0000, chain.objs.size()=1 2024-09-12T17:41:33.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.152+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.rtLU_Zk3jAyj8GNZE8mOHuVTg7qpPWW_0 2024-09-12T17:41:33.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.152+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5454502116570165534', time=2024-09-12T19:32:50.509769+0000, chain.objs.size()=1 2024-09-12T17:41:33.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.152+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.oHoleF9cbMyDrvDo0--tl_V1PxRY4lc_0 2024-09-12T17:41:33.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.152+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/46943 2024-09-12T17:41:33.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.152+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=24, truncated=0, next_marker='' 2024-09-12T17:41:33.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.152+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14330932518678954134', time=2024-09-12T19:32:50.527914+0000, chain.objs.size()=1 2024-09-12T17:41:33.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.152+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.jMrKCr-zVUbAzLUXg7oUncuDzJffTg8_0 2024-09-12T17:41:33.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.152+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2510042939929509328', time=2024-09-12T19:32:50.565040+0000, chain.objs.size()=1 2024-09-12T17:41:33.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.152+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.I4AfMixL7N_32QdcNfIVLqcCpmpi76t_0 2024-09-12T17:41:33.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.152+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5500592954568024545', time=2024-09-12T19:32:50.596212+0000, chain.objs.size()=1 2024-09-12T17:41:33.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.152+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Y7nbi0l_MKR1RJROagHXUUp-P-YAQhS_0 2024-09-12T17:41:33.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.152+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.721144890089586364', time=2024-09-12T19:32:50.643941+0000, chain.objs.size()=1 2024-09-12T17:41:33.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.152+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.uL0EY1NQ67IPHOo6zg6UBPF_dlehlmJ_0 2024-09-12T17:41:33.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.152+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17705834538644812341', time=2024-09-12T19:32:50.676201+0000, chain.objs.size()=1 2024-09-12T17:41:33.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.152+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.lidLlqCsG2S8QmUF5Y_baeYtQIwx78Z_0 2024-09-12T17:41:33.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.152+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1230348092076067933', time=2024-09-12T19:32:50.911212+0000, chain.objs.size()=1 2024-09-12T17:41:33.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.152+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.apa-fVSdRoazdele0LqEtS_vQqOhwRB_0 2024-09-12T17:41:33.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.152+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7435911540998296339', time=2024-09-12T19:32:50.930376+0000, chain.objs.size()=1 2024-09-12T17:41:33.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.152+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.8xxjNJxSLtwUm-sz2C--Qbsb9L2sPUb_0 2024-09-12T17:41:33.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.152+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5460577500579594463', time=2024-09-12T19:32:50.968363+0000, chain.objs.size()=1 2024-09-12T17:41:33.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.152+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.JTCWUDwW3nw-OkYi6D4NFuLz-vncQBc_0 2024-09-12T17:41:33.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.156+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9247110371571305839', time=2024-09-12T19:32:50.969520+0000, chain.objs.size()=1 2024-09-12T17:41:33.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.156+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.qm_V0rQ5WSoVGK5YYRO6tJ-y-vZ_hYR_0 2024-09-12T17:41:33.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.156+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4704327581645216712', time=2024-09-12T19:32:51.020928+0000, chain.objs.size()=1 2024-09-12T17:41:33.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.156+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Ux312XdVE_C1DzGifR2LmPogRRPePwW_0 2024-09-12T17:41:33.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.156+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18384987015893808717', time=2024-09-12T19:32:51.320180+0000, chain.objs.size()=1 2024-09-12T17:41:33.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.156+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.egJZBkSfsXralACL-PNzCW6_QCLeBe-_0 2024-09-12T17:41:33.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.156+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15696963836207238974', time=2024-09-12T19:32:51.324655+0000, chain.objs.size()=1 2024-09-12T17:41:33.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.156+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.doOAlwXTK5EGL6Bdm-oTZJTPXiahj5w_0 2024-09-12T17:41:33.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.156+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13254009012298592891', time=2024-09-12T19:32:51.369628+0000, chain.objs.size()=1 2024-09-12T17:41:33.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.156+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.h6o9Y48rZBZRY0akznErYoyHNgol3Pu_0 2024-09-12T17:41:33.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.156+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1409456899156275656', time=2024-09-12T19:32:51.371240+0000, chain.objs.size()=1 2024-09-12T17:41:33.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.156+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.k_tLl_XfGeC2_LWTiq3gQDU4FeDEhxu_0 2024-09-12T17:41:33.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.156+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17973880756278681613', time=2024-09-12T19:32:51.598631+0000, chain.objs.size()=1 2024-09-12T17:41:33.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.156+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.mIr9H8Gyk_KdM__FoEjvfrguA0VQU0X_0 2024-09-12T17:41:33.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.156+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10076936598105588208', time=2024-09-12T19:32:51.613511+0000, chain.objs.size()=1 2024-09-12T17:41:33.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.156+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.2Vs8GDKFcB9dlmldsbld1HW_V6nztbg_0 2024-09-12T17:41:33.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.156+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9703375415332631382', time=2024-09-12T19:32:51.852289+0000, chain.objs.size()=1 2024-09-12T17:41:33.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.156+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.mDuV605397-pttyJtAkHV_Q2NLbB9CK_0 2024-09-12T17:41:33.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.156+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18147971889895144174', time=2024-09-12T19:32:51.954324+0000, chain.objs.size()=1 2024-09-12T17:41:33.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.156+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.lWq1sVQ6OWG0f-bETqBJTmvs678PLTP_0 2024-09-12T17:41:33.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.156+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11511930801697840195', time=2024-09-12T19:32:56.918609+0000, chain.objs.size()=1 2024-09-12T17:41:33.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.156+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.339__shadow_.6GGzsMFkPvIGxIzmCsoUzzlyDDUS2BK_0 2024-09-12T17:41:33.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.156+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4106800501394493881', time=2024-09-12T19:32:58.876540+0000, chain.objs.size()=1 2024-09-12T17:41:33.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.156+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.345__shadow_.R9PD6Kkhz26DIGw4Pu0wkLdD7yMJuw4_0 2024-09-12T17:41:33.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.156+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4800958822744807852', time=2024-09-12T19:35:32.302304+0000, chain.objs.size()=1 2024-09-12T17:41:33.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.156+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.576__shadow:WU6rbhC8xAjU6n5-bI8nVRVBr9X21NZ_.53Uj7hXXTjk-ReJ52bBHUixkTLsCnFB_0 2024-09-12T17:41:33.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.156+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8940701439920224297', time=2024-09-12T19:35:54.104860+0000, chain.objs.size()=1 2024-09-12T17:41:33.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.156+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.579__shadow:xVr03SMc0UY5bTY1kclt2-CfBdtxyZQ_.qbsNXVDH22OcrWsD7jGGRPiraKa4Xsh_0 2024-09-12T17:41:33.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.156+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9545191094600073006', time=2024-09-12T19:35:55.692874+0000, chain.objs.size()=1 2024-09-12T17:41:33.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.156+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.580__shadow:poCnLVLzAbdV6gjPIQFyco37HLje8y9_.n23XEbNh5XDaH_EAtK2tTLLFrN38shm_0 2024-09-12T17:41:33.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.156+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4412042605854357466', time=2024-09-12T19:38:42.770960+0000, chain.objs.size()=1 2024-09-12T17:41:33.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.156+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.664__shadow_.281jmFqXEDRV7FwYmmaa43gJHEC1ooR_0 2024-09-12T17:41:33.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.160+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:41:33.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.164+0000 7fd765adf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:41:33.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.164+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:41:33.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.164+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:41:33.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.164+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/60644' 2024-09-12T17:41:33.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.164+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='_JOynoHtOAslq6FISHnShHG53GiRAqhQ', time=2024-09-12T19:29:45.414491+0000, chain.objs.size()=3 2024-09-12T17:41:33.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.164+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.160__shadow_.J3dChg-YzWrlo2Vx5t0EvmOnNh302_q_0 2024-09-12T17:41:33.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.164+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.160__shadow_.J3dChg-YzWrlo2Vx5t0EvmOnNh302_q_1 2024-09-12T17:41:33.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.164+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.160__shadow_.J3dChg-YzWrlo2Vx5t0EvmOnNh302_q_2 2024-09-12T17:41:33.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.164+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7868558263106059010', time=2024-09-12T19:31:13.968013+0000, chain.objs.size()=1 2024-09-12T17:41:33.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.164+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.238__shadow_.B4GtpI7kRqZ7Bk6pkY1l0x_v0DZ8-dN_0 2024-09-12T17:41:33.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.164+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13064603906920832196', time=2024-09-12T19:31:17.186653+0000, chain.objs.size()=1 2024-09-12T17:41:33.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.164+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.246__shadow_.O6BG7kr2Se0xY-6epq8s-Vq9h1MzbLE_0 2024-09-12T17:41:33.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.164+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5508948320481050751', time=2024-09-12T19:31:18.314155+0000, chain.objs.size()=1 2024-09-12T17:41:33.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.164+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.249__shadow_.vRwodFFqcXZvlHn9ifmXJFFC5gE-N0r_0 2024-09-12T17:41:33.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.164+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13334683581996262545', time=2024-09-12T19:31:18.694251+0000, chain.objs.size()=1 2024-09-12T17:41:33.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.164+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.250__shadow_.Nwx3vpTDnRA_p4ZC1l693B7QocR53wt_0 2024-09-12T17:41:33.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.164+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8506755720558380138', time=2024-09-12T19:31:20.624355+0000, chain.objs.size()=1 2024-09-12T17:41:33.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.164+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.255__shadow_.86EnHnPIBR8c1H_uJYY8UuUuUU-ptWT_0 2024-09-12T17:41:33.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.164+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12611623211697518371', time=2024-09-12T19:31:22.131207+0000, chain.objs.size()=1 2024-09-12T17:41:33.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.164+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.259__shadow_.aID_47kgzsvUKjNilEVE74YNXJ4rOT-_0 2024-09-12T17:41:33.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.164+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6575242356753528371', time=2024-09-12T19:31:42.297602+0000, chain.objs.size()=1 2024-09-12T17:41:33.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.164+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.NImS1UDxr4bxfyydcTFT_-sZsJKG5Sf_0 2024-09-12T17:41:33.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.164+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7471430970858053101', time=2024-09-12T19:31:42.339030+0000, chain.objs.size()=1 2024-09-12T17:41:33.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.164+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.imb6buN_rIoQWEGkAPga9s2ahsdX7Gw_0 2024-09-12T17:41:33.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.164+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.913928526932725998', time=2024-09-12T19:31:42.340036+0000, chain.objs.size()=1 2024-09-12T17:41:33.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.164+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.bKHO61yCGf_t_FE8HHfQhy82C8GVnuw_0 2024-09-12T17:41:33.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.168+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18235018258794786247', time=2024-09-12T19:31:42.434282+0000, chain.objs.size()=1 2024-09-12T17:41:33.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.168+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.SsTW6y_wDt3qdsqNFFAfcKGeZL0AIi0_0 2024-09-12T17:41:33.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.168+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.616297728871400926', time=2024-09-12T19:31:42.477652+0000, chain.objs.size()=1 2024-09-12T17:41:33.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.168+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.B1tb2cwQGnkR1OXdIapF2Z3HvwmbZ01_0 2024-09-12T17:41:33.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.168+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16442485495717911003', time=2024-09-12T19:31:42.637294+0000, chain.objs.size()=1 2024-09-12T17:41:33.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.168+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.tg_son_wRPnu8ky4QIwwno2Hq7fnbJp_0 2024-09-12T17:41:33.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.168+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15135479514496715800', time=2024-09-12T19:31:42.646345+0000, chain.objs.size()=1 2024-09-12T17:41:33.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.168+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.wWb8sIstHyCW3Dr5tpR34wcUUkO8UhB_0 2024-09-12T17:41:33.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.168+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6088488458778929658', time=2024-09-12T19:31:42.659388+0000, chain.objs.size()=1 2024-09-12T17:41:33.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.168+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.pmbteE6HmqQITCV8KUKTSL1y1UseX-x_0 2024-09-12T17:41:33.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.168+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6421554472469730291', time=2024-09-12T19:31:42.688176+0000, chain.objs.size()=1 2024-09-12T17:41:33.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.168+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.TKl90ak4DQoLBRrveU2Z7JkyjxGjcof_0 2024-09-12T17:41:33.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.168+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11106597532258337378', time=2024-09-12T19:31:42.817002+0000, chain.objs.size()=1 2024-09-12T17:41:33.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.168+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.XW63CXU2baQanGi4byNZhB9RhrzWTD4_0 2024-09-12T17:41:33.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.168+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8976984527383619636', time=2024-09-12T19:31:42.875557+0000, chain.objs.size()=1 2024-09-12T17:41:33.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.168+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.5wApaoKOqcTIF4OCrd0jfyC0WUcN0rZ_0 2024-09-12T17:41:33.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.168+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8141955360373977730', time=2024-09-12T19:31:42.900291+0000, chain.objs.size()=1 2024-09-12T17:41:33.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.168+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.eVqkLxku6Ap2V-JvSRHc1n_Tkrq4Tye_0 2024-09-12T17:41:33.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.168+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14013507648443482991', time=2024-09-12T19:31:43.136325+0000, chain.objs.size()=1 2024-09-12T17:41:33.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.168+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.weO9_djB3V9YyXoUUsSvpDgm8mTmKkD_0 2024-09-12T17:41:33.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.168+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15424789579384837003', time=2024-09-12T19:31:43.154395+0000, chain.objs.size()=1 2024-09-12T17:41:33.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.168+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.1GY3i_4KtEXQSorAlI0SDFCAn-9kCYZ_0 2024-09-12T17:41:33.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.168+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5752097972651636649', time=2024-09-12T19:31:43.165842+0000, chain.objs.size()=1 2024-09-12T17:41:33.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.168+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.rTnM1DpplBxlbq_z4rf9ngfQCC51xlH_0 2024-09-12T17:41:33.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.168+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.489448218615614616', time=2024-09-12T19:31:43.166910+0000, chain.objs.size()=1 2024-09-12T17:41:33.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.168+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.86_Rfff_bd78j8-O59ky9tkMhiYx6BY_0 2024-09-12T17:41:33.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3980729215237935653', time=2024-09-12T19:31:43.182513+0000, chain.objs.size()=1 2024-09-12T17:41:33.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.xK-f7NXYHbz5JL5esB7iOqDRVWpo61G_0 2024-09-12T17:41:33.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12698718165647409116', time=2024-09-12T19:31:43.193734+0000, chain.objs.size()=1 2024-09-12T17:41:33.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.aH3fzlq5ET85eFwA6BBPkmx-pVgNwxx_0 2024-09-12T17:41:33.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12087118259374783079', time=2024-09-12T19:31:43.224660+0000, chain.objs.size()=1 2024-09-12T17:41:33.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.5yKpDkWaC9KtQ3sAm2MvTUNOnix6uaN_0 2024-09-12T17:41:33.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14575156189513663881', time=2024-09-12T19:31:43.403187+0000, chain.objs.size()=1 2024-09-12T17:41:33.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.xoFYgOyNGHpDTrKW4FwdzozNym_IUwQ_0 2024-09-12T17:41:33.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10299031747808598780', time=2024-09-12T19:31:43.412943+0000, chain.objs.size()=1 2024-09-12T17:41:33.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.R_Gh0UUTM5YiiSVb3SHx6PMJZ3pbFwD_0 2024-09-12T17:41:33.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12168700830919056511', time=2024-09-12T19:31:43.470599+0000, chain.objs.size()=1 2024-09-12T17:41:33.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.WWvQI8qaRJDZvC3mFhFPu340VIVj3kR_0 2024-09-12T17:41:33.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.148320181131183024', time=2024-09-12T19:31:43.556868+0000, chain.objs.size()=1 2024-09-12T17:41:33.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.NVQMbftO5-eaNc--sN-ryU1WAbhGVbd_0 2024-09-12T17:41:33.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14614946864629661647', time=2024-09-12T19:31:43.826755+0000, chain.objs.size()=1 2024-09-12T17:41:33.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.-BXOSZhZdEIstUfZ4rm6kOSZ_CVxdnx_0 2024-09-12T17:41:33.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2099942346186587536', time=2024-09-12T19:31:44.059821+0000, chain.objs.size()=1 2024-09-12T17:41:33.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.BTjBNl37KHLSLTvWvqnbJREITMmHIRu_0 2024-09-12T17:41:33.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13109691286676951579', time=2024-09-12T19:31:44.065096+0000, chain.objs.size()=1 2024-09-12T17:41:33.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.YEd3YIAZQRD4AVEIj7Eg7REHP40UDo9_0 2024-09-12T17:41:33.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5830986631579963442', time=2024-09-12T19:31:44.073834+0000, chain.objs.size()=1 2024-09-12T17:41:33.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.CiLb4DpUOtYanuDK899WmlbnXedtZlT_0 2024-09-12T17:41:33.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3430567621879050820', time=2024-09-12T19:31:44.226536+0000, chain.objs.size()=1 2024-09-12T17:41:33.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.oxNmT3QOaV2FGI9WoWwvJFIKJQqgs_n_0 2024-09-12T17:41:33.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5039080871409553916', time=2024-09-12T19:31:44.265792+0000, chain.objs.size()=1 2024-09-12T17:41:33.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.TPbU-c126zQjVTm6SeE7HuueLHKlwNx_0 2024-09-12T17:41:33.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14653877216704129947', time=2024-09-12T19:31:44.372780+0000, chain.objs.size()=1 2024-09-12T17:41:33.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.P2AY89vNanHXKCg0MYMYlwR0oHcCidc_0 2024-09-12T17:41:33.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15795047612253332902', time=2024-09-12T19:31:44.460944+0000, chain.objs.size()=1 2024-09-12T17:41:33.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.0P1sFcTuSzIByr9udHSnyKmEOlKr8k0_0 2024-09-12T17:41:33.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1685503954000852205', time=2024-09-12T19:31:44.505358+0000, chain.objs.size()=1 2024-09-12T17:41:33.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.ySbkfmWGL1ZGUOeTTOY6EBQqhlQwipq_0 2024-09-12T17:41:33.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6029973890422099706', time=2024-09-12T19:31:44.528160+0000, chain.objs.size()=1 2024-09-12T17:41:33.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.MKXRePtgJ-hFPiF2EM-r_R4LCZSh0e3_0 2024-09-12T17:41:33.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2250782677082012739', time=2024-09-12T19:31:45.470520+0000, chain.objs.size()=1 2024-09-12T17:41:33.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.265__shadow_.ogLhWQf9-lO-fsS6giQTYiqrTXsiFEb_0 2024-09-12T17:41:33.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11378051199598685687', time=2024-09-12T19:31:50.256960+0000, chain.objs.size()=1 2024-09-12T17:41:33.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.278__shadow_.QyiZVofBmjM-odUOMsk5MU-cbrZhyuq_0 2024-09-12T17:41:33.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1039847574634670603', time=2024-09-12T19:31:52.204271+0000, chain.objs.size()=1 2024-09-12T17:41:33.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.283__shadow_.TW7CLdTqqtqZ2oOzNRT3ZH_024a09sI_0 2024-09-12T17:41:33.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12840613620280438277', time=2024-09-12T19:31:54.239316+0000, chain.objs.size()=1 2024-09-12T17:41:33.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.288__shadow_.CvwBAXGvGTdqyTGezTNCPPdpynWkvAo_0 2024-09-12T17:41:33.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4851073329261683309', time=2024-09-12T19:31:57.581284+0000, chain.objs.size()=1 2024-09-12T17:41:33.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.293__shadow_.kimWB7HHQeewZETDPDPkDGmordLXqYC_0 2024-09-12T17:41:33.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14126833285333163766', time=2024-09-12T19:31:57.600078+0000, chain.objs.size()=1 2024-09-12T17:41:33.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.293__shadow_.YfbdXuuhMqCrnXmt74t0t1F1E9LbQ1u_0 2024-09-12T17:41:33.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17715766786223054588', time=2024-09-12T19:31:57.608506+0000, chain.objs.size()=1 2024-09-12T17:41:33.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.172+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.293__shadow_.yEz2tTjB0v1TKF21qWLAhQkrM6hdItQ_0 2024-09-12T17:41:33.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.176+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9749502022098035561', time=2024-09-12T19:32:03.633325+0000, chain.objs.size()=1 2024-09-12T17:41:33.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.176+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.307__shadow:0PAEAd8McyBTxles6cY3FJXaXk3KfmC_.kjwDuMTZycgyVJUiz_Mus_pjYzXUDVF_0 2024-09-12T17:41:33.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.176+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.507850768478628082', time=2024-09-12T19:32:07.349716+0000, chain.objs.size()=1 2024-09-12T17:41:33.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.176+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.319__shadow:-zmixwEp-CKAkQuw3EXCO1eHL6-RU2i_.3nk4bF5bm-gQyLhCWi9YhARek9lTK2h_0 2024-09-12T17:41:33.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.176+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1291735208579009617', time=2024-09-12T19:32:27.862980+0000, chain.objs.size()=1 2024-09-12T17:41:33.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.176+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.3kS0N9DeDguRY41clOVw7xToIns7mGN_0 2024-09-12T17:41:33.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.176+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3095139153677255898', time=2024-09-12T19:32:27.899199+0000, chain.objs.size()=1 2024-09-12T17:41:33.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.176+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.1Is2iQJKKM03NMCBi0PaGOgkNMI87u9_0 2024-09-12T17:41:33.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.176+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9662852219222063086', time=2024-09-12T19:32:27.925515+0000, chain.objs.size()=1 2024-09-12T17:41:33.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.176+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.JUXaORVisGWFZ0B0NEc8TsjrzEVraUl_0 2024-09-12T17:41:33.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.176+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10188852291425267350', time=2024-09-12T19:32:27.938955+0000, chain.objs.size()=1 2024-09-12T17:41:33.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.176+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.rOTJevsLQzuMaRvmmIHYwCttL-Kytxr_0 2024-09-12T17:41:33.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.176+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3032545393177197185', time=2024-09-12T19:32:28.060023+0000, chain.objs.size()=1 2024-09-12T17:41:33.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.176+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.lY9xM-H4h4Di-gpKOzW0fBm0Tbevtux_0 2024-09-12T17:41:33.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.176+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2252689266639311935', time=2024-09-12T19:32:28.195852+0000, chain.objs.size()=1 2024-09-12T17:41:33.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.176+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.eUIZez7q_DtWVJ3fslu84A5eGOGAJfK_0 2024-09-12T17:41:33.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.176+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8392935550821847552', time=2024-09-12T19:32:28.254603+0000, chain.objs.size()=1 2024-09-12T17:41:33.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.176+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.jDHOeu6sBmO8w0dxVTeddAwx3fUs-sy_0 2024-09-12T17:41:33.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.176+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1382572826318624046', time=2024-09-12T19:32:28.306235+0000, chain.objs.size()=1 2024-09-12T17:41:33.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.176+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.JQy2Cr8CHpPNhjlBpDnHZe0Y74tMFtp_0 2024-09-12T17:41:33.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.176+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9800698662683246754', time=2024-09-12T19:32:28.315802+0000, chain.objs.size()=1 2024-09-12T17:41:33.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.176+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.QZtXrNRJgoILz7LCOfS_sk1CB9mzHYy_0 2024-09-12T17:41:33.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.176+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10924683282126173267', time=2024-09-12T19:32:28.692105+0000, chain.objs.size()=1 2024-09-12T17:41:33.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.176+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.RRliiaeF84MNpHV3GJkRnAXFG2y3Irg_0 2024-09-12T17:41:33.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.176+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7302183889588711558', time=2024-09-12T19:32:28.790668+0000, chain.objs.size()=1 2024-09-12T17:41:33.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.176+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.lQu79K6g--zTOkKyGXbQ1-aKsbF9brg_0 2024-09-12T17:41:33.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.176+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2222945996665864894', time=2024-09-12T19:32:28.800711+0000, chain.objs.size()=1 2024-09-12T17:41:33.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.176+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.TOizLyLuX_GH1YMAAecRHZnZtLjPUvW_0 2024-09-12T17:41:33.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.176+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17110312371259662924', time=2024-09-12T19:32:28.879904+0000, chain.objs.size()=1 2024-09-12T17:41:33.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.176+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.LQw6pbKEh4H8vY-IaiWw-1fIeLB_vKr_0 2024-09-12T17:41:33.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.176+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5513267583847420835', time=2024-09-12T19:32:29.221967+0000, chain.objs.size()=1 2024-09-12T17:41:33.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.176+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.aPIdKTjZ3CUWnDjPdN4KnxIcg6_sQNV_0 2024-09-12T17:41:33.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.176+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1592133715961848220', time=2024-09-12T19:32:29.343572+0000, chain.objs.size()=1 2024-09-12T17:41:33.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.176+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.1MVSOH9-EHrB233_izGCxvOn1n5D2Ec_0 2024-09-12T17:41:33.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.176+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16392971754600313167', time=2024-09-12T19:32:29.478657+0000, chain.objs.size()=1 2024-09-12T17:41:33.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.176+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.VNPd47fd1Nwaal5slKYUdcBhNawNxC7_0 2024-09-12T17:41:33.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.176+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18373478943220556499', time=2024-09-12T19:32:29.534527+0000, chain.objs.size()=1 2024-09-12T17:41:33.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.176+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.ibx1vnO5kLd0MK4wCZhe2T-QkNz0rc6_0 2024-09-12T17:41:33.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.176+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14938207515806502344', time=2024-09-12T19:32:29.546912+0000, chain.objs.size()=1 2024-09-12T17:41:33.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.176+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.fx5iShDp9_D_2S1En7n0kHH3k4Gm-L6_0 2024-09-12T17:41:33.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.176+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15934102810704545286', time=2024-09-12T19:32:29.552859+0000, chain.objs.size()=1 2024-09-12T17:41:33.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.176+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Ad2MBbBDLoHQv8fa7xtyDlG6rhU87vX_0 2024-09-12T17:41:33.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.176+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.857095986158325485', time=2024-09-12T19:32:29.757525+0000, chain.objs.size()=1 2024-09-12T17:41:33.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.176+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.MArhG57iuSzEHyWDhXdJ-Rlu8egsZik_0 2024-09-12T17:41:33.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.180+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1660528519435931953', time=2024-09-12T19:32:29.790307+0000, chain.objs.size()=1 2024-09-12T17:41:33.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.180+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.IW8VFl2HdHyOBzhkpOr7j8NANq1dMLJ_0 2024-09-12T17:41:33.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.180+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.376354790949933537', time=2024-09-12T19:32:29.794440+0000, chain.objs.size()=1 2024-09-12T17:41:33.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.180+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_._OUkbFxu54mbm3-gUEjTPNyLs0Z6wuP_0 2024-09-12T17:41:33.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.180+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14552780083054704724', time=2024-09-12T19:32:30.018628+0000, chain.objs.size()=1 2024-09-12T17:41:33.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.180+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.eb6UJkfU3vutTvYRk6idoSFAq6L_PO1_0 2024-09-12T17:41:33.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.180+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13310804089927590819', time=2024-09-12T19:32:30.153076+0000, chain.objs.size()=1 2024-09-12T17:41:33.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.180+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.UrIcZWkM6gLl-vKVy-uQtGq-BFAvfgN_0 2024-09-12T17:41:33.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.180+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12563653686615745993', time=2024-09-12T19:32:49.706220+0000, chain.objs.size()=1 2024-09-12T17:41:33.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.180+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.OSnzo5z9t47Ibh5HHjRQp-5Q-k4ACJ1_0 2024-09-12T17:41:33.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.180+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13271269012463026372', time=2024-09-12T19:32:49.851964+0000, chain.objs.size()=1 2024-09-12T17:41:33.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.180+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.d7vvNecHNTthV7ImnPmvf1r5Fc2xl-u_0 2024-09-12T17:41:33.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.180+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1791921915162987594', time=2024-09-12T19:32:49.914412+0000, chain.objs.size()=1 2024-09-12T17:41:33.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.180+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.ZU7RqHrfmQSENdYlQTdNeu0i_RBOXN0_0 2024-09-12T17:41:33.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.180+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5821237907242950928', time=2024-09-12T19:32:50.194452+0000, chain.objs.size()=1 2024-09-12T17:41:33.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.180+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.MoAMRVw04rttm_GXFBzJE52o9PhU-VA_0 2024-09-12T17:41:33.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.180+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12991417868873268980', time=2024-09-12T19:32:50.252092+0000, chain.objs.size()=1 2024-09-12T17:41:33.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.180+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.9NP9E--A6ZLEUZILCRfmeSRZKWjjzJv_0 2024-09-12T17:41:33.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.180+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8472054142623693861', time=2024-09-12T19:32:50.297270+0000, chain.objs.size()=1 2024-09-12T17:41:33.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.180+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.4p1tdxFUTSzIhPxNYeEho87oxa4ciMC_0 2024-09-12T17:41:33.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.180+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12426805852340279079', time=2024-09-12T19:32:50.552541+0000, chain.objs.size()=1 2024-09-12T17:41:33.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.180+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.BNt9qdx2o9kbqYXFGuGb_XoxPP34uDO_0 2024-09-12T17:41:33.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.180+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3327074438221561382', time=2024-09-12T19:32:50.667812+0000, chain.objs.size()=1 2024-09-12T17:41:33.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.180+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.YVwKS655XAGH2DE8QD11kerMovYUI9U_0 2024-09-12T17:41:33.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.180+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11587320935425476221', time=2024-09-12T19:32:50.826080+0000, chain.objs.size()=1 2024-09-12T17:41:33.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.180+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.6njiMWeP-FSyf9-Ugnle_hsCfiiIND4_0 2024-09-12T17:41:33.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.184+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4277880227338036471', time=2024-09-12T19:32:50.887401+0000, chain.objs.size()=1 2024-09-12T17:41:33.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.184+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.cy8Jjfin1QWthtK53fALnprHIMZnzFH_0 2024-09-12T17:41:33.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.184+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8221439510440469576', time=2024-09-12T19:32:51.026845+0000, chain.objs.size()=1 2024-09-12T17:41:33.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.184+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.TwyuHcxjf_aJ2N-nFFAm4rkwUAUDHr9_0 2024-09-12T17:41:33.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.184+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3409167054008441838', time=2024-09-12T19:32:51.332649+0000, chain.objs.size()=1 2024-09-12T17:41:33.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.184+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.QFaOsTxmz66xqdFWAhdtBv-LybJwIJT_0 2024-09-12T17:41:33.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.184+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12807148832954228243', time=2024-09-12T19:32:51.556575+0000, chain.objs.size()=1 2024-09-12T17:41:33.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.184+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.B_-YEuQOvCF-rdgb-LHe51PIahWg_Rq_0 2024-09-12T17:41:33.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.184+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3633578424685177256', time=2024-09-12T19:32:51.568116+0000, chain.objs.size()=1 2024-09-12T17:41:33.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.184+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.5C5B7_j6U1sFmX8JQr-XzVax9DHu4PG_0 2024-09-12T17:41:33.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.184+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4465436010553094927', time=2024-09-12T19:32:51.599951+0000, chain.objs.size()=1 2024-09-12T17:41:33.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.184+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.jcHxKUIGX2QGGJuJMx4UDVjEE3eiUDi_0 2024-09-12T17:41:33.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.184+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6381732422372114195', time=2024-09-12T19:32:51.619710+0000, chain.objs.size()=1 2024-09-12T17:41:33.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.184+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.wc8wc8TiDMHaAVXeSV3tGX54gK90QDf_0 2024-09-12T17:41:33.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.184+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16769745971716238487', time=2024-09-12T19:32:51.654225+0000, chain.objs.size()=1 2024-09-12T17:41:33.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.184+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.8RPoIIpeUd-Qi8M0jpaRkbm6_7K3CHS_0 2024-09-12T17:41:33.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.184+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15433729617328729242', time=2024-09-12T19:32:51.836039+0000, chain.objs.size()=1 2024-09-12T17:41:33.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.184+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Edrom2No6cACbIYBhSzGwikHnwzlVSQ_0 2024-09-12T17:41:33.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.184+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4673803443999500752', time=2024-09-12T19:32:51.839416+0000, chain.objs.size()=1 2024-09-12T17:41:33.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.184+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.N_N-KPmBdvnhKaGzk6Y74bbcF10CZoO_0 2024-09-12T17:41:33.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.184+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3677940305773224225', time=2024-09-12T19:32:51.951540+0000, chain.objs.size()=1 2024-09-12T17:41:33.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.184+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.RD-mzH_Z0KDcmOR61_JM0m6tEK0PtF9_0 2024-09-12T17:41:33.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.184+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1455405671409166905', time=2024-09-12T19:33:12.127209+0000, chain.objs.size()=1 2024-09-12T17:41:33.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.184+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.384__shadow_.wRfJgXSkHFmkdIlcHvx-VGDG7JxQqjw_0 2024-09-12T17:41:33.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.184+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12680135601558906119', time=2024-09-12T19:33:43.480218+0000, chain.objs.size()=1 2024-09-12T17:41:33.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.184+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.464__shadow_.TMV4iJ71rqs5j689YCKa8WGDU13fT0l_0 2024-09-12T17:41:33.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.184+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5464291911853358479', time=2024-09-12T19:33:49.900583+0000, chain.objs.size()=1 2024-09-12T17:41:33.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.184+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.485__shadow_.NFWnyRe27ONdOv0e6DpDoQ1mQVarUvW_0 2024-09-12T17:41:33.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.184+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9079595457724953572', time=2024-09-12T19:34:00.284777+0000, chain.objs.size()=6 2024-09-12T17:41:33.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.184+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.507__multipart_srcmultipart.2~PH2AaCAKTBRXF-9QaLILt69t4ifQcL6.1 2024-09-12T17:41:33.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.184+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.507__multipart_srcmultipart.2~PH2AaCAKTBRXF-9QaLILt69t4ifQcL6.2 2024-09-12T17:41:33.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.184+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.507__multipart_srcmultipart.2~PH2AaCAKTBRXF-9QaLILt69t4ifQcL6.3 2024-09-12T17:41:33.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.184+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.507__multipart_srcmultipart.2~PH2AaCAKTBRXF-9QaLILt69t4ifQcL6.4 2024-09-12T17:41:33.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.188+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.507__multipart_srcmultipart.2~PH2AaCAKTBRXF-9QaLILt69t4ifQcL6.5 2024-09-12T17:41:33.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.188+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.507__multipart_srcmultipart.2~PH2AaCAKTBRXF-9QaLILt69t4ifQcL6.6 2024-09-12T17:41:33.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.188+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5234589310515156141', time=2024-09-12T19:34:00.548514+0000, chain.objs.size()=6 2024-09-12T17:41:33.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.188+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.507__multipart_srcmultipart.2~PH2AaCAKTBRXF-9QaLILt69t4ifQcL6.1 2024-09-12T17:41:33.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.188+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.507__multipart_srcmultipart.2~PH2AaCAKTBRXF-9QaLILt69t4ifQcL6.2 2024-09-12T17:41:33.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.188+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.507__multipart_srcmultipart.2~PH2AaCAKTBRXF-9QaLILt69t4ifQcL6.3 2024-09-12T17:41:33.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.188+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.507__multipart_srcmultipart.2~PH2AaCAKTBRXF-9QaLILt69t4ifQcL6.4 2024-09-12T17:41:33.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.188+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.507__multipart_srcmultipart.2~PH2AaCAKTBRXF-9QaLILt69t4ifQcL6.5 2024-09-12T17:41:33.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.188+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.507__multipart_srcmultipart.2~PH2AaCAKTBRXF-9QaLILt69t4ifQcL6.6 2024-09-12T17:41:33.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.188+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1732801990050945119', time=2024-09-12T19:34:20.433026+0000, chain.objs.size()=2 2024-09-12T17:41:33.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.188+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.523__multipart_mymultipart.2~shS09UEX_iATPKorBmyCphNiEnbFSeI.1 2024-09-12T17:41:33.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.188+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.523__shadow_mymultipart.2~shS09UEX_iATPKorBmyCphNiEnbFSeI.1_1 2024-09-12T17:41:33.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.188+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6475213542302024735', time=2024-09-12T19:34:23.734481+0000, chain.objs.size()=2 2024-09-12T17:41:33.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.188+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.525__multipart_mymultipart.2~qrzvKNDxh1QRbvibfbXx1o1es5XK8GP.1 2024-09-12T17:41:33.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.188+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.525__multipart_mymultipart.2~qrzvKNDxh1QRbvibfbXx1o1es5XK8GP.2 2024-09-12T17:41:33.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.192+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/60644 2024-09-12T17:41:33.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.192+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T17:41:33.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.192+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10624500720946403791', time=2024-09-12T19:35:48.538374+0000, chain.objs.size()=1 2024-09-12T17:41:33.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.192+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.577__shadow:k-RJ7E0E.JZWWv-iXBrTJdsuE7FhE8Q_.2_nKRUHNTKSabKGp-hqWnWraGtV8Pzg_0 2024-09-12T17:41:33.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.192+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7143150747827049984', time=2024-09-12T19:35:54.218988+0000, chain.objs.size()=1 2024-09-12T17:41:33.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.192+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.579__shadow:mT3YpALrrwnXSHJ4QpwwIA3ivi6syQg_.23Chicp4DEmKWb48fWllAwDoOZvDP-c_0 2024-09-12T17:41:33.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.192+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16182884347238490200', time=2024-09-12T19:35:55.550639+0000, chain.objs.size()=1 2024-09-12T17:41:33.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.192+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.580__shadow:9cx0qT15wcNHqXpzLww1IY7EUW93xsO_.t382k31759m1WVTIZZ-F3kEbGUitOA9_0 2024-09-12T17:41:33.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.192+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9608258357475030495', time=2024-09-12T19:38:24.348177+0000, chain.objs.size()=1 2024-09-12T17:41:33.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.192+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.628__shadow_.lIsFEUYeiTT8cYOXarFoySvOW0W1FHr_0 2024-09-12T17:41:33.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.192+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.354973604270912880', time=2024-09-12T19:38:41.711661+0000, chain.objs.size()=6 2024-09-12T17:41:33.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.192+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.662__multipart_foo.2~OSNqlh2o1bZfiRcSHld48ke8RhwtIol.1 2024-09-12T17:41:33.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.192+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.662__multipart_foo.2~OSNqlh2o1bZfiRcSHld48ke8RhwtIol.2 2024-09-12T17:41:33.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.192+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.662__multipart_foo.2~OSNqlh2o1bZfiRcSHld48ke8RhwtIol.3 2024-09-12T17:41:33.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.192+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.662__multipart_foo.2~OSNqlh2o1bZfiRcSHld48ke8RhwtIol.4 2024-09-12T17:41:33.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.192+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.662__multipart_foo.2~OSNqlh2o1bZfiRcSHld48ke8RhwtIol.5 2024-09-12T17:41:33.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.192+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.662__multipart_foo.2~OSNqlh2o1bZfiRcSHld48ke8RhwtIol.6 2024-09-12T17:41:33.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.192+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4293027447836659608', time=2024-09-12T19:38:53.338456+0000, chain.objs.size()=1 2024-09-12T17:41:33.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.192+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.695__shadow_.CowNqMPxzyo151PE3dwebUrz1ZFFQtF_0 2024-09-12T17:41:33.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.196+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:41:33.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.196+0000 7fd765adf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:41:33.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.196+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:41:33.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:41:33.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47652' 2024-09-12T17:41:33.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2507534461830212398', time=2024-09-12T19:31:14.648069+0000, chain.objs.size()=1 2024-09-12T17:41:33.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.240__shadow_.h8b3Gid3LZXM7qeDXWsZxy5Go_nYSCp_0 2024-09-12T17:41:33.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13929606575280003627', time=2024-09-12T19:31:19.489945+0000, chain.objs.size()=1 2024-09-12T17:41:33.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.252__shadow_.gGScazwf-pDh-Gm8Ks0yioDdpKUiTcF_0 2024-09-12T17:41:33.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8399294952503704802', time=2024-09-12T19:31:19.865261+0000, chain.objs.size()=1 2024-09-12T17:41:33.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.253__shadow_.fHnk3t-2RCHK-TyYtX0P_l6mXDse99d_0 2024-09-12T17:41:33.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14428043180664709324', time=2024-09-12T19:31:42.291810+0000, chain.objs.size()=1 2024-09-12T17:41:33.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.U7-0M4uK4FpKCTfGfmasOD2GLflNpxU_0 2024-09-12T17:41:33.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4300852033242687816', time=2024-09-12T19:31:42.304612+0000, chain.objs.size()=1 2024-09-12T17:41:33.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.OPmXHQqS-SfkdsPBvDtF5C4NYF81on8_0 2024-09-12T17:41:33.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10293182285141826357', time=2024-09-12T19:31:42.360604+0000, chain.objs.size()=1 2024-09-12T17:41:33.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.7-GJurYu8SFa_Rgi0ybxjWMw1lgHJ5t_0 2024-09-12T17:41:33.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6095907402824357084', time=2024-09-12T19:31:42.392821+0000, chain.objs.size()=1 2024-09-12T17:41:33.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.xl_-AukybAEM9-DPM2p6yrSMeSUo_pj_0 2024-09-12T17:41:33.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4081071156730508025', time=2024-09-12T19:31:42.396833+0000, chain.objs.size()=1 2024-09-12T17:41:33.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Izuar79e_hWhUSd1leAZiFBqoLS5jL6_0 2024-09-12T17:41:33.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17174962198086051898', time=2024-09-12T19:31:42.448006+0000, chain.objs.size()=1 2024-09-12T17:41:33.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Ro3kxBt_khar6awT3pR2P1sC_I42sHj_0 2024-09-12T17:41:33.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15013516053106909376', time=2024-09-12T19:31:42.641978+0000, chain.objs.size()=1 2024-09-12T17:41:33.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.dYY4ZtU0h0t9mkDEoLVNjqAHrQDkFm5_0 2024-09-12T17:41:33.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2336445813022304399', time=2024-09-12T19:31:42.666787+0000, chain.objs.size()=1 2024-09-12T17:41:33.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.yjkYBZga5NOiRR-7EqVJrXm8NbRZm3D_0 2024-09-12T17:41:33.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15455496853721701156', time=2024-09-12T19:31:42.700587+0000, chain.objs.size()=1 2024-09-12T17:41:33.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.dnb8KOzHu0M2M87UjgP9SEufffohHb6_0 2024-09-12T17:41:33.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2303409121321414909', time=2024-09-12T19:31:42.836612+0000, chain.objs.size()=1 2024-09-12T17:41:33.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.EWZvgcD-jG6JiWcZSVmWRJRHgs3N8dX_0 2024-09-12T17:41:33.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11760057595408621333', time=2024-09-12T19:31:42.887290+0000, chain.objs.size()=1 2024-09-12T17:41:33.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.6xc2fTa9izwtgra5l5IRZtaLhJkuCM0_0 2024-09-12T17:41:33.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5465552964921935910', time=2024-09-12T19:31:42.937174+0000, chain.objs.size()=1 2024-09-12T17:41:33.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.9qmnhtGE_ehBIaYcI1dvYcgqZIuZEL2_0 2024-09-12T17:41:33.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9451911058022596380', time=2024-09-12T19:31:43.084943+0000, chain.objs.size()=1 2024-09-12T17:41:33.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.MlO7kYz979W7yYPdjemfYyFPfq6PvMc_0 2024-09-12T17:41:33.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1953807440041507230', time=2024-09-12T19:31:43.134717+0000, chain.objs.size()=1 2024-09-12T17:41:33.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.dVuKGwuILN_6ia4dUViSy7D8PN4tJyQ_0 2024-09-12T17:41:33.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7693950458060591467', time=2024-09-12T19:31:43.158713+0000, chain.objs.size()=1 2024-09-12T17:41:33.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.0_Nt58C8rESh539BusPH5yiCcM-xoQw_0 2024-09-12T17:41:33.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6621923501823442087', time=2024-09-12T19:31:43.197628+0000, chain.objs.size()=1 2024-09-12T17:41:33.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.kSOBduSB0h6_gAMikHvN00xfGzNkkIV_0 2024-09-12T17:41:33.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1584329645627647521', time=2024-09-12T19:31:43.410911+0000, chain.objs.size()=1 2024-09-12T17:41:33.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Ak-K22XwWGGQ3bFC2JnvceijahH808g_0 2024-09-12T17:41:33.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.990930611007992361', time=2024-09-12T19:31:43.455379+0000, chain.objs.size()=1 2024-09-12T17:41:33.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.CqyDzu71ooGhnGKjDM-vhBGrubsEt7h_0 2024-09-12T17:41:33.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13732916963680157405', time=2024-09-12T19:31:43.519050+0000, chain.objs.size()=1 2024-09-12T17:41:33.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.gCTAYYteemSehxlgKDvB4KXt1-5OXUF_0 2024-09-12T17:41:33.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13413040884887469936', time=2024-09-12T19:31:43.544857+0000, chain.objs.size()=1 2024-09-12T17:41:33.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.cYo_xWbR3R_qQRQ38M0jZZ2Z0JbSNy4_0 2024-09-12T17:41:33.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2925596990813152178', time=2024-09-12T19:31:43.620851+0000, chain.objs.size()=1 2024-09-12T17:41:33.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.200+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.BRTkpE56rqYGbn23uFldLOwEj_gEGEX_0 2024-09-12T17:41:33.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.204+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1223760952266154133', time=2024-09-12T19:31:43.783550+0000, chain.objs.size()=1 2024-09-12T17:41:33.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.204+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.CwfcJiH7ff0ZP_mjPNjuoyATorNYTb1_0 2024-09-12T17:41:33.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.204+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16196040201304431060', time=2024-09-12T19:31:43.839023+0000, chain.objs.size()=1 2024-09-12T17:41:33.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.204+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.lujvSKxvpOmfmtCqeNt9m7nGNqqFjK3_0 2024-09-12T17:41:33.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.204+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7833833159303910118', time=2024-09-12T19:31:43.844556+0000, chain.objs.size()=1 2024-09-12T17:41:33.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.204+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Mx6kTucUArnLEwVaGjUGAv03ZPjMuJ9_0 2024-09-12T17:41:33.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.204+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8294859533694907119', time=2024-09-12T19:31:44.168816+0000, chain.objs.size()=1 2024-09-12T17:41:33.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.204+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.X4NQYqXH_3Zv__rvFPnN7RK5PMjUHjt_0 2024-09-12T17:41:33.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.204+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4546899928402305591', time=2024-09-12T19:31:44.213977+0000, chain.objs.size()=1 2024-09-12T17:41:33.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.204+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.CuzK8jnuyiMf1c63Zl5-oktQAmIIcfk_0 2024-09-12T17:41:33.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.204+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17828514781998352452', time=2024-09-12T19:31:44.250393+0000, chain.objs.size()=1 2024-09-12T17:41:33.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.204+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.M40cCePfEzhq2L0n4UU2h0DCXBxuU3z_0 2024-09-12T17:41:33.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.204+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2962643476032614475', time=2024-09-12T19:31:44.448860+0000, chain.objs.size()=1 2024-09-12T17:41:33.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.204+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.e8JwDgttft2GnstqviTBe5UCTctW1JZ_0 2024-09-12T17:41:33.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.204+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7659708112360310587', time=2024-09-12T19:31:44.508828+0000, chain.objs.size()=1 2024-09-12T17:41:33.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.204+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.YzBj2jZaZZxpCmvQTjyzlK0Y6uBZNnO_0 2024-09-12T17:41:33.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.204+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7145601707274213762', time=2024-09-12T19:31:44.512626+0000, chain.objs.size()=1 2024-09-12T17:41:33.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.204+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.9AIpsizEaJh85a0knhEWtKXrRrsY-Lj_0 2024-09-12T17:41:33.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.204+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10156342059460481228', time=2024-09-12T19:31:44.540821+0000, chain.objs.size()=1 2024-09-12T17:41:33.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.204+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.OJ1dUIooKLdrYmnTxqoC5afhoMbw_jh_0 2024-09-12T17:41:33.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.204+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9220130863813506102', time=2024-09-12T19:31:53.003130+0000, chain.objs.size()=1 2024-09-12T17:41:33.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.204+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.285__shadow_.EWJyilK0ZHVMW2Qx5Zma1Egm2hadyQA_0 2024-09-12T17:41:33.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.204+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3959982606352808296', time=2024-09-12T19:31:56.500977+0000, chain.objs.size()=1 2024-09-12T17:41:33.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.204+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.292__shadow_.I40xBFUiaTYTUHHJ37P6u1yUZirRJEO_0 2024-09-12T17:41:33.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.208+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16471049828745102427', time=2024-09-12T19:31:57.579321+0000, chain.objs.size()=1 2024-09-12T17:41:33.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.208+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.293__shadow_.w9ZU4i3Yi76_twvBGOoQ8PoOTHUFRJk_0 2024-09-12T17:41:33.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.208+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2393217315391312487', time=2024-09-12T19:32:00.756317+0000, chain.objs.size()=1 2024-09-12T17:41:33.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.208+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.301__shadow_.hNipUNwWIPMtdYx6l3PVW7FrJWXAX3w_0 2024-09-12T17:41:33.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.208+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10062290574147722541', time=2024-09-12T19:32:27.851583+0000, chain.objs.size()=1 2024-09-12T17:41:33.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.208+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.adFVNMer70WzMhk6fou-oRpDWey0fX3_0 2024-09-12T17:41:33.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.208+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4838386280987167320', time=2024-09-12T19:32:27.967322+0000, chain.objs.size()=1 2024-09-12T17:41:33.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.208+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.XHQCrVhZC_8fydXk-XdLdtC59O0QQf0_0 2024-09-12T17:41:33.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.208+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2304254197109728075', time=2024-09-12T19:32:28.080045+0000, chain.objs.size()=1 2024-09-12T17:41:33.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.208+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Iwupyig1qgIp8BkVWRJSlRfBawZyKdg_0 2024-09-12T17:41:33.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.208+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3086102312855443778', time=2024-09-12T19:32:28.081649+0000, chain.objs.size()=1 2024-09-12T17:41:33.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.208+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.eW7MvcD6xZfyDivpghtbQ1Nx05a_ePI_0 2024-09-12T17:41:33.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.208+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7136996307883444766', time=2024-09-12T19:32:28.161476+0000, chain.objs.size()=1 2024-09-12T17:41:33.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.208+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.o9VaFs4URrkGhGrYjb1iXbwVcPs8cUx_0 2024-09-12T17:41:33.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.208+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7668494342026741254', time=2024-09-12T19:32:28.243976+0000, chain.objs.size()=1 2024-09-12T17:41:33.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.208+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.sQHAZjDgitiQtupEHlUbeLw8CziTFnM_0 2024-09-12T17:41:33.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.208+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1598193103240402752', time=2024-09-12T19:32:28.281832+0000, chain.objs.size()=1 2024-09-12T17:41:33.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.208+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.DAiu-n15dAQBIWTl6EUO11yGLNGhS9__0 2024-09-12T17:41:33.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.208+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16958490984847223789', time=2024-09-12T19:32:28.384181+0000, chain.objs.size()=1 2024-09-12T17:41:33.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.208+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.i3hFPOEDTfUQ9hyLt-mYN0Uzsk-1_4-_0 2024-09-12T17:41:33.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.208+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3645718768736836252', time=2024-09-12T19:32:28.462712+0000, chain.objs.size()=1 2024-09-12T17:41:33.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.208+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.MnqnOlNpcplpaLYrA5_XQRMwKfF_3iH_0 2024-09-12T17:41:33.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.208+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8602001946273228069', time=2024-09-12T19:32:28.480466+0000, chain.objs.size()=1 2024-09-12T17:41:33.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.208+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.NLv4n0DpqAd0rhFQRU2rhWIUr27M7q6_0 2024-09-12T17:41:33.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.208+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10320907407204441758', time=2024-09-12T19:32:28.517946+0000, chain.objs.size()=1 2024-09-12T17:41:33.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.208+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.LSi0vVL4znYlRjJ-Z5_cpp_XL-LUCvt_0 2024-09-12T17:41:33.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.208+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18052775421765792253', time=2024-09-12T19:32:28.541083+0000, chain.objs.size()=1 2024-09-12T17:41:33.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.208+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.S2x64LFmBzXOFoiKiKdLzq9ZmCVwVCM_0 2024-09-12T17:41:33.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.208+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.872981087812649840', time=2024-09-12T19:32:28.793828+0000, chain.objs.size()=1 2024-09-12T17:41:33.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.208+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.5VbNLubp7U3eTVPW-_Tg4X4zPb724J7_0 2024-09-12T17:41:33.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.208+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9250995461886073389', time=2024-09-12T19:32:28.820073+0000, chain.objs.size()=1 2024-09-12T17:41:33.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.208+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.x_ejzm4uLMNXEr0QdwU1a0bCc0ySsY5_0 2024-09-12T17:41:33.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.208+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5707195185591955787', time=2024-09-12T19:32:29.020908+0000, chain.objs.size()=1 2024-09-12T17:41:33.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.208+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.L0akSgm6BqiUAYJSCEkU1JXVNYeIkxu_0 2024-09-12T17:41:33.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.212+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1499638818435041530', time=2024-09-12T19:32:29.044047+0000, chain.objs.size()=1 2024-09-12T17:41:33.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.212+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_._KOoaGqZyOw4eqSO0o7jWjJ9R2XbvQC_0 2024-09-12T17:41:33.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.212+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9787663605517787144', time=2024-09-12T19:32:29.176720+0000, chain.objs.size()=1 2024-09-12T17:41:33.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.212+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.sbOC4ulmsrOqsquwKJguu48DE9cQ4Fx_0 2024-09-12T17:41:33.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.212+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11388777375946951999', time=2024-09-12T19:32:29.356970+0000, chain.objs.size()=1 2024-09-12T17:41:33.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.212+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.fnJ3zt9UtCb-bIsdU3qcCNwm-nnY_SV_0 2024-09-12T17:41:33.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.212+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16078010724519722896', time=2024-09-12T19:32:29.393274+0000, chain.objs.size()=1 2024-09-12T17:41:33.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.212+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.8eLzGYEu26yZi9C8vIUPxm9ppkHOx2-_0 2024-09-12T17:41:33.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.212+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16659293488567797190', time=2024-09-12T19:32:29.468012+0000, chain.objs.size()=1 2024-09-12T17:41:33.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.212+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.-YJelbWUYCR94gxdKFYbtbsa8dDApSk_0 2024-09-12T17:41:33.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.212+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3963650077561670638', time=2024-09-12T19:32:29.475196+0000, chain.objs.size()=1 2024-09-12T17:41:33.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.212+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.9I_lnbG3WNkCAzwOzR5cZnQw47hQ5kd_0 2024-09-12T17:41:33.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.212+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14974093859003673680', time=2024-09-12T19:32:29.484252+0000, chain.objs.size()=1 2024-09-12T17:41:33.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.212+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.heW7vnGJbmsxoC-CNvqFJ9bqwe-fz6R_0 2024-09-12T17:41:33.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.212+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2326570416223554421', time=2024-09-12T19:32:29.495932+0000, chain.objs.size()=1 2024-09-12T17:41:33.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.212+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.s_KTeWD8jtjrJd9InMedAB3umPP7d_t_0 2024-09-12T17:41:33.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.212+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9989430816581502686', time=2024-09-12T19:32:29.503783+0000, chain.objs.size()=1 2024-09-12T17:41:33.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.212+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.K_o7J2UDPVkuyNxGlo1P8-SNMzASoKL_0 2024-09-12T17:41:33.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.212+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.167300994883710771', time=2024-09-12T19:32:29.534332+0000, chain.objs.size()=1 2024-09-12T17:41:33.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.212+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.wglEFexAHDHap79Vsyb0_KWC-_Wmgxx_0 2024-09-12T17:41:33.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.212+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17392948417059543759', time=2024-09-12T19:32:29.712093+0000, chain.objs.size()=1 2024-09-12T17:41:33.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.212+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.8lHYppGnyR4KCmsSS6Cl_HhtBB0k6yf_0 2024-09-12T17:41:33.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.212+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2465718002291772124', time=2024-09-12T19:32:29.712940+0000, chain.objs.size()=1 2024-09-12T17:41:33.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.212+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.7jYuzBVU7nEvUBkqvnEaxFiMrqOqV8j_0 2024-09-12T17:41:33.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.212+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15164217097122969805', time=2024-09-12T19:32:29.747619+0000, chain.objs.size()=1 2024-09-12T17:41:33.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.212+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.skgbfLKL2d3Yde1LFhB0R7_R1rvANz2_0 2024-09-12T17:41:33.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.212+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8718783416054610777', time=2024-09-12T19:32:29.756248+0000, chain.objs.size()=1 2024-09-12T17:41:33.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.212+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.ZwvjbwQiNHhIELUkdDH3EsLLRMkIE_E_0 2024-09-12T17:41:33.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.212+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11389053301837673416', time=2024-09-12T19:32:29.765633+0000, chain.objs.size()=1 2024-09-12T17:41:33.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.212+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.V5hnBHYhvHecegbCgdwD3aeR4Nqpukw_0 2024-09-12T17:41:33.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.212+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13106953341711733434', time=2024-09-12T19:32:29.826401+0000, chain.objs.size()=1 2024-09-12T17:41:33.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.212+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.6_aIUYKTM8C_8vNKWrvEFF158qKR1pX_0 2024-09-12T17:41:33.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.212+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13082580208008897892', time=2024-09-12T19:32:29.858611+0000, chain.objs.size()=1 2024-09-12T17:41:33.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.212+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.FJL8cHQhG-J0ykapxXv4jonaEvVsndD_0 2024-09-12T17:41:33.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.212+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8231940446203706177', time=2024-09-12T19:32:29.984926+0000, chain.objs.size()=1 2024-09-12T17:41:33.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.212+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.4I2-KnTCEPSbkEwGqcT1Tgo7mJ_G3Lz_0 2024-09-12T17:41:33.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.212+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6225607775766663926', time=2024-09-12T19:32:30.048931+0000, chain.objs.size()=1 2024-09-12T17:41:33.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.212+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.7FAqCY8kojoLAjJOFECywM1aClnZXnS_0 2024-09-12T17:41:33.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.212+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11066827844664266781', time=2024-09-12T19:32:30.080240+0000, chain.objs.size()=1 2024-09-12T17:41:33.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.212+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.aHePcimEhf8pUTe6HkvTSeIRZzuklmt_0 2024-09-12T17:41:33.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.212+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7260661384207295636', time=2024-09-12T19:32:49.633672+0000, chain.objs.size()=1 2024-09-12T17:41:33.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.212+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.dK1r5QJZstbXw5h-spSqfrcPM7iB1TX_0 2024-09-12T17:41:33.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.212+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.757761093528250157', time=2024-09-12T19:32:49.701862+0000, chain.objs.size()=1 2024-09-12T17:41:33.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.212+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.6_g92KSDhQOxbad25f-ycevXqxFVw5Y_0 2024-09-12T17:41:33.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.216+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11604962864250491652', time=2024-09-12T19:32:49.831459+0000, chain.objs.size()=1 2024-09-12T17:41:33.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.216+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.ZQ4j8kZInHf919eUnAB6XPvmdF848Q-_0 2024-09-12T17:41:33.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.216+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11348705799181683215', time=2024-09-12T19:32:49.846452+0000, chain.objs.size()=1 2024-09-12T17:41:33.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.216+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.2JS4cYINc3RpRMza-oJxkqjyIUshdsO_0 2024-09-12T17:41:33.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.216+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16371098590599979769', time=2024-09-12T19:32:50.144272+0000, chain.objs.size()=1 2024-09-12T17:41:33.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.216+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.6IX8CQYqrKQ3-Ty9sBsHJd_XhwaxfhU_0 2024-09-12T17:41:33.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.216+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13610537774120139264', time=2024-09-12T19:32:50.161187+0000, chain.objs.size()=1 2024-09-12T17:41:33.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.216+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.F-1LG7HDoIVOhtDhw5lYDj0BHxMNPEz_0 2024-09-12T17:41:33.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.216+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8530253129346420492', time=2024-09-12T19:32:50.204149+0000, chain.objs.size()=1 2024-09-12T17:41:33.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.216+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.g9ZZlSlSiqv0g0mMDFtp65m9JlS6FtA_0 2024-09-12T17:41:33.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.216+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18034874250981057956', time=2024-09-12T19:32:50.219948+0000, chain.objs.size()=1 2024-09-12T17:41:33.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.216+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.oq0zPFrhbQQa_N6ldKZ7a5PzCSYD4h4_0 2024-09-12T17:41:33.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.216+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13027461525068624378', time=2024-09-12T19:32:50.306367+0000, chain.objs.size()=1 2024-09-12T17:41:33.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.216+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.nUQnW0Jc6Gcx44fFewXPanI3G4y1ZO-_0 2024-09-12T17:41:33.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.216+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2845997947324924379', time=2024-09-12T19:32:50.480657+0000, chain.objs.size()=1 2024-09-12T17:41:33.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.216+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.IE7vq1UOigdmUJ4feO46gkuVWKRp4rO_0 2024-09-12T17:41:33.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.216+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11301164861502851924', time=2024-09-12T19:32:50.483342+0000, chain.objs.size()=1 2024-09-12T17:41:33.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.216+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.TjsYlTgxnXP__ttmG5vvnqE3lapp3ek_0 2024-09-12T17:41:33.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.216+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17379628893394061151', time=2024-09-12T19:32:50.644839+0000, chain.objs.size()=1 2024-09-12T17:41:33.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.216+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.p0bKc4WkSBLRDErlO3tb394oRKWDOPK_0 2024-09-12T17:41:33.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.216+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16454976301106030946', time=2024-09-12T19:32:50.656233+0000, chain.objs.size()=1 2024-09-12T17:41:33.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.216+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.JmJxhu3xkc4WWFQ-VwX2zZS2YTDPXwR_0 2024-09-12T17:41:33.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.216+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15876328084171346947', time=2024-09-12T19:32:50.943948+0000, chain.objs.size()=1 2024-09-12T17:41:33.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.216+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.pz-bs4rpedtt8rgQDsATM4DCMd2CaJe_0 2024-09-12T17:41:33.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.216+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13098149807486652493', time=2024-09-12T19:32:50.965730+0000, chain.objs.size()=1 2024-09-12T17:41:33.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.216+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.JIE4XlcqGqn5VseazAO-_qAgkab53EV_0 2024-09-12T17:41:33.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.216+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14467354016131954705', time=2024-09-12T19:32:51.031162+0000, chain.objs.size()=1 2024-09-12T17:41:33.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.216+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.DHIPUU4H-zgc46STheLgPoRdpFJ6vGr_0 2024-09-12T17:41:33.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.216+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11618221834845684213', time=2024-09-12T19:32:51.035819+0000, chain.objs.size()=1 2024-09-12T17:41:33.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.216+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.o8CsBJN96Blpu3p9qCaTP5H4IZ8KdA4_0 2024-09-12T17:41:33.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.216+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15294897827644643354', time=2024-09-12T19:32:51.176860+0000, chain.objs.size()=1 2024-09-12T17:41:33.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.216+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.95aYjtK1mwBkQvG3weBHSTCxbB-IsCY_0 2024-09-12T17:41:33.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.216+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1843873052114888060', time=2024-09-12T19:32:51.268108+0000, chain.objs.size()=1 2024-09-12T17:41:33.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.216+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.N0VSMsSs9q0HY1Yc69VrkJ1AGp-NZQg_0 2024-09-12T17:41:33.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.216+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11901678103411135645', time=2024-09-12T19:32:51.276099+0000, chain.objs.size()=1 2024-09-12T17:41:33.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.216+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Xiu8Gln7pZwgXrBuZiDaC5esBjZp4_f_0 2024-09-12T17:41:33.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.220+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11404424315506020942', time=2024-09-12T19:32:51.295680+0000, chain.objs.size()=1 2024-09-12T17:41:33.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.220+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.y4LfdunXoTQzQXL6D25enrA5z1gaKoY_0 2024-09-12T17:41:33.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.220+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9917646172904654516', time=2024-09-12T19:32:51.296523+0000, chain.objs.size()=1 2024-09-12T17:41:33.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.220+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.kvnI2UblGOd6xYUzmopiyVJD8vw5BMe_0 2024-09-12T17:41:33.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.220+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4104450755791197252', time=2024-09-12T19:32:51.352715+0000, chain.objs.size()=1 2024-09-12T17:41:33.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.220+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.QCe2unk6szgRPJn839Gv851QkFMKykW_0 2024-09-12T17:41:33.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.220+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10678176425317190367', time=2024-09-12T19:32:51.615455+0000, chain.objs.size()=1 2024-09-12T17:41:33.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.220+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.G6PAe3d24nflVXSG3FEg46-QNUuqjMS_0 2024-09-12T17:41:33.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.220+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12900329734468293030', time=2024-09-12T19:32:51.624882+0000, chain.objs.size()=1 2024-09-12T17:41:33.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.220+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.z-xzh7f0IghTNWN_GtADCSOKA--4cVF_0 2024-09-12T17:41:33.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.224+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1394408551726009092', time=2024-09-12T19:32:51.633229+0000, chain.objs.size()=1 2024-09-12T17:41:33.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.224+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.SoCCSo9FoVbAherr4VM5IoljyOAv6zO_0 2024-09-12T17:41:33.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.224+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2291621220749118173', time=2024-09-12T19:32:51.642707+0000, chain.objs.size()=1 2024-09-12T17:41:33.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.224+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.mdXlWGYtRWo-EHiUA6jvZo2XgdfTazs_0 2024-09-12T17:41:33.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.224+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47652 2024-09-12T17:41:33.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.228+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T17:41:33.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.228+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3292250929506154671', time=2024-09-12T19:32:51.717449+0000, chain.objs.size()=1 2024-09-12T17:41:33.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.228+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.4N1FlUDrmO_7YrEN8CqW6Wbtfc4-UFS_0 2024-09-12T17:41:33.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.228+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14469816340151515759', time=2024-09-12T19:32:51.959021+0000, chain.objs.size()=1 2024-09-12T17:41:33.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.228+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.2HFJlJjeAEFeZctp3Io6kLJ6Tu8JCo1_0 2024-09-12T17:41:33.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.228+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10197804018214125268', time=2024-09-12T19:32:55.725538+0000, chain.objs.size()=1 2024-09-12T17:41:33.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.228+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.335__shadow_.LMnF5RFyWOoVJ506iKyW_ZpMwDGPlzF_0 2024-09-12T17:41:33.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.228+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16576690555805735373', time=2024-09-12T19:32:56.389435+0000, chain.objs.size()=1 2024-09-12T17:41:33.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.228+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.337__shadow_.eqv2-6xIwTJ5x3D5yoDfm-pz7Nh1sUO_0 2024-09-12T17:41:33.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.228+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6281501487325474652', time=2024-09-12T19:33:17.248607+0000, chain.objs.size()=1 2024-09-12T17:41:33.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.228+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.394__shadow:YNTjQI40lvgg7neaNUofqD0dxeX4SPT_.ur81Ds7KJd0otcpHnp4eZaoVPgwwcM4_0 2024-09-12T17:41:33.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.228+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3126296099576491886', time=2024-09-12T19:33:32.538752+0000, chain.objs.size()=1 2024-09-12T17:41:33.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.228+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.440__shadow_.MeGXzgDFhd-J8jNYk7ALjJ2yC-e-kDM_0 2024-09-12T17:41:33.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.228+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.626943934450281165', time=2024-09-12T19:33:51.639132+0000, chain.objs.size()=1 2024-09-12T17:41:33.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.228+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.488__shadow_.MyWObROKuDaZ9tItgIBYoKUO7lcOMQZ_0 2024-09-12T17:41:33.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.228+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7119163487743145359', time=2024-09-12T19:33:57.453989+0000, chain.objs.size()=1 2024-09-12T17:41:33.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.228+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.503__shadow:5PZwxWS6kVU04L4agSYet4YqDKg.iTJ_.vEQTiH10KZ8H36ScYyTe7asHZOEv9fv_0 2024-09-12T17:41:33.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.228+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2893855735810609908', time=2024-09-12T19:34:27.426922+0000, chain.objs.size()=2 2024-09-12T17:41:33.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.228+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.528__multipart_mymultipart.2~UcdsomblMYM5xKR4jEe4itopSUqn31C.1 2024-09-12T17:41:33.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.228+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.528__multipart_mymultipart.2~UcdsomblMYM5xKR4jEe4itopSUqn31C.2 2024-09-12T17:41:33.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.228+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5590961272591109913', time=2024-09-12T19:35:04.300529+0000, chain.objs.size()=1 2024-09-12T17:41:33.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.228+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.556__shadow_.Ew1aS2uOgPq_7NAToh62BdhnY1APikg_0 2024-09-12T17:41:33.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.228+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13543839337088992845', time=2024-09-12T19:35:06.957706+0000, chain.objs.size()=1 2024-09-12T17:41:33.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.228+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.559__shadow_.-_UzEyHap2ExK3__wUn-dB3RiC67qmd_0 2024-09-12T17:41:33.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.228+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9576289866859554483', time=2024-09-12T19:35:08.462162+0000, chain.objs.size()=1 2024-09-12T17:41:33.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.228+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.562__shadow_.WRY9FPX3EQ3sbMIm9qkJIdl0D4W4oeq_0 2024-09-12T17:41:33.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.228+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.919228938158646299', time=2024-09-12T19:35:21.449639+0000, chain.objs.size()=1 2024-09-12T17:41:33.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.228+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.569__shadow:NFfmItriX3Bqls71QhbQhtcwXYA7ZrZ_.lUzIJSoAcNaY6wo8AtXza_U6Z5f9GZS_0 2024-09-12T17:41:33.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.228+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13984910353431838470', time=2024-09-12T19:35:24.099196+0000, chain.objs.size()=1 2024-09-12T17:41:33.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.228+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.570__shadow:Icl30lAFZfEPQk67WrKd-y343HBjUdP_.n_a_fupz3OGp4IfR6bOrYrFOhgGM9PW_0 2024-09-12T17:41:33.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.228+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1051492655689340574', time=2024-09-12T19:38:32.626408+0000, chain.objs.size()=1 2024-09-12T17:41:33.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.228+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.648__shadow_.jNtGtQ5Mz9Gp1DBwO-AlQBTOH8OgyrW_0 2024-09-12T17:41:33.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.228+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9419301480539354025', time=2024-09-12T19:38:41.567910+0000, chain.objs.size()=6 2024-09-12T17:41:33.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.228+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.661__multipart_baz.2~mCz5o1ozJV20KTCVEWLDUgDgtXILafg.1 2024-09-12T17:41:33.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.228+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.661__multipart_baz.2~mCz5o1ozJV20KTCVEWLDUgDgtXILafg.2 2024-09-12T17:41:33.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.228+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.661__multipart_baz.2~mCz5o1ozJV20KTCVEWLDUgDgtXILafg.3 2024-09-12T17:41:33.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.228+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.661__multipart_baz.2~mCz5o1ozJV20KTCVEWLDUgDgtXILafg.4 2024-09-12T17:41:33.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.228+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.661__multipart_baz.2~mCz5o1ozJV20KTCVEWLDUgDgtXILafg.5 2024-09-12T17:41:33.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.228+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.661__multipart_baz.2~mCz5o1ozJV20KTCVEWLDUgDgtXILafg.6 2024-09-12T17:41:33.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.228+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.529457788452803478', time=2024-09-12T19:38:45.655101+0000, chain.objs.size()=1 2024-09-12T17:41:33.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.228+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.671__shadow_.DkEz4ElVX16WE5zXsBc2Srz6gcAxRgK_0 2024-09-12T17:41:33.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.228+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5419528407378075097', time=2024-09-12T19:38:56.609358+0000, chain.objs.size()=1 2024-09-12T17:41:33.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.228+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.703__shadow:4i3NzbBdmfaEUOtmKEpMIX8Id01FIJy_.IXLqwzSiABYTYoHZDD3KhKtJ-OW99pY_0 2024-09-12T17:41:33.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.232+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:41:33.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.236+0000 7fd765adf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:41:33.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.236+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:41:33.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.240+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:41:33.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.240+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47073' 2024-09-12T17:41:33.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.240+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7251312670484662526', time=2024-09-12T19:29:42.034145+0000, chain.objs.size()=3 2024-09-12T17:41:33.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.240+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.158__shadow_.a3F_5PBP8U60dG3p_tRmd7urOdvUTW5_0 2024-09-12T17:41:33.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.240+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.158__shadow_.a3F_5PBP8U60dG3p_tRmd7urOdvUTW5_1 2024-09-12T17:41:33.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.240+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.158__shadow_.a3F_5PBP8U60dG3p_tRmd7urOdvUTW5_2 2024-09-12T17:41:33.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.240+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7552719766487822974', time=2024-09-12T19:31:22.895409+0000, chain.objs.size()=1 2024-09-12T17:41:33.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.240+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.261__shadow_.UXTKwcnJxezlQbjdswDeEll1eBVZJYw_0 2024-09-12T17:41:33.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.240+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.319779692529855470', time=2024-09-12T19:31:42.314953+0000, chain.objs.size()=1 2024-09-12T17:41:33.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.240+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.PE_PH0-Dd-VymDj4u48C1qCapUcVv47_0 2024-09-12T17:41:33.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.240+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14483103213220094149', time=2024-09-12T19:31:42.383846+0000, chain.objs.size()=1 2024-09-12T17:41:33.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.240+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.khXmVPGuiMuQ11UXSNwBmKa66NyFE3U_0 2024-09-12T17:41:33.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.240+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7521533485732382200', time=2024-09-12T19:31:42.398027+0000, chain.objs.size()=1 2024-09-12T17:41:33.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.240+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.08HTPY-mnkvmGnVxN5Bq2g6zVb2tY2T_0 2024-09-12T17:41:33.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.240+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9880741622432632348', time=2024-09-12T19:31:42.459556+0000, chain.objs.size()=1 2024-09-12T17:41:33.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.240+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.PEh2S_Md0rLA-LoHIhE52QalLJu3bwu_0 2024-09-12T17:41:33.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.240+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5160919399812989806', time=2024-09-12T19:31:42.552638+0000, chain.objs.size()=1 2024-09-12T17:41:33.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.240+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Mzx2EWbqhiKeMKJ4W-w8xZLAzyrGghe_0 2024-09-12T17:41:33.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.240+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.565629905977773689', time=2024-09-12T19:31:42.568836+0000, chain.objs.size()=1 2024-09-12T17:41:33.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.240+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.qU1-pao53oP0JgAeOViQ4KRwD-LXP3q_0 2024-09-12T17:41:33.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.240+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11706181705340590197', time=2024-09-12T19:31:42.591195+0000, chain.objs.size()=1 2024-09-12T17:41:33.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.240+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.qKjHSiq1TpUo8sV2uY2j-p66zSGHtqe_0 2024-09-12T17:41:33.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.240+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1360233371249913046', time=2024-09-12T19:31:42.664826+0000, chain.objs.size()=1 2024-09-12T17:41:33.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.240+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.PQUPUYR3vDsW9rMJStCf1QSGRJNBBb7_0 2024-09-12T17:41:33.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.240+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15606104307520502586', time=2024-09-12T19:31:42.766976+0000, chain.objs.size()=1 2024-09-12T17:41:33.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.240+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Q3UVCv4Vha4pgIV64rnVoiZN7OpGSHX_0 2024-09-12T17:41:33.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.240+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6867579836782946207', time=2024-09-12T19:31:42.776076+0000, chain.objs.size()=1 2024-09-12T17:41:33.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.240+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.mz0udLCKU9MXWRZnPFtxlRU8N-d7rLg_0 2024-09-12T17:41:33.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.240+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6604288170119801466', time=2024-09-12T19:31:42.857839+0000, chain.objs.size()=1 2024-09-12T17:41:33.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.240+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.kccO-tCGJkMfa64CI20z5kzsX1fZoF0_0 2024-09-12T17:41:33.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.240+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16656630521433411893', time=2024-09-12T19:31:42.927132+0000, chain.objs.size()=1 2024-09-12T17:41:33.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.240+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.ii3uCygNXHjLZ3tpnmJdB18dnmhLKgj_0 2024-09-12T17:41:33.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.244+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12160591169122876653', time=2024-09-12T19:31:42.940777+0000, chain.objs.size()=1 2024-09-12T17:41:33.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.244+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.ojQ1eU8OMKJkc_luBQKtb6TxYTlmMEL_0 2024-09-12T17:41:33.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.244+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9355538670185125307', time=2024-09-12T19:31:42.943815+0000, chain.objs.size()=1 2024-09-12T17:41:33.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.244+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.2KmM2HJBft0Hi65DAvPCMy-U5Md4Qk9_0 2024-09-12T17:41:33.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.244+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1859131405761970753', time=2024-09-12T19:31:43.216806+0000, chain.objs.size()=1 2024-09-12T17:41:33.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.244+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.nSyr8jvV7HyRAAn2lHPwalNbsRX2f87_0 2024-09-12T17:41:33.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.244+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8855010549684094871', time=2024-09-12T19:31:43.238353+0000, chain.objs.size()=1 2024-09-12T17:41:33.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.244+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.fZ2MZcg19be_X8l2LfNNBdM_FuEb-Q3_0 2024-09-12T17:41:33.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.244+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4390434432672438809', time=2024-09-12T19:31:43.522573+0000, chain.objs.size()=1 2024-09-12T17:41:33.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.244+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.TY5ZvpZvri_0KLGnqy9Z1EseE02b1AN_0 2024-09-12T17:41:33.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.244+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7273346486846401207', time=2024-09-12T19:31:43.538428+0000, chain.objs.size()=1 2024-09-12T17:41:33.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.244+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.MJWzpeoSADoo3pO9_T2_q6yPwsQX4bS_0 2024-09-12T17:41:33.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.244+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3300560493529502487', time=2024-09-12T19:31:43.611152+0000, chain.objs.size()=1 2024-09-12T17:41:33.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.244+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.MjT4eJhmdh7VSYv6IQxyNxfMiFo7EVy_0 2024-09-12T17:41:33.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.244+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1988580355793741714', time=2024-09-12T19:31:43.736090+0000, chain.objs.size()=1 2024-09-12T17:41:33.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.244+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.uxQTxaBZuMawk6jka2PY7J82isTEBHA_0 2024-09-12T17:41:33.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.244+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17577782638590340007', time=2024-09-12T19:31:43.810010+0000, chain.objs.size()=1 2024-09-12T17:41:33.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.244+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.BQqFAVWuaEW4IdexWIoBN80caLwBL3m_0 2024-09-12T17:41:33.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.244+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2284704214132104502', time=2024-09-12T19:31:43.922046+0000, chain.objs.size()=1 2024-09-12T17:41:33.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.244+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.9f6fLji8ydJDobNDv7RXnDRfNJmqLj3_0 2024-09-12T17:41:33.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.244+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14073000244341671339', time=2024-09-12T19:31:43.935718+0000, chain.objs.size()=1 2024-09-12T17:41:33.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.244+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.n5uBjqzU8NGzd_NOH8BG7jJhR44pHvK_0 2024-09-12T17:41:33.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.244+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4436187475291525473', time=2024-09-12T19:31:44.055614+0000, chain.objs.size()=1 2024-09-12T17:41:33.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.244+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Yaau6RTkooXbSNwsGcKBd8HmVdy52gw_0 2024-09-12T17:41:33.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.244+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.620663414755063511', time=2024-09-12T19:31:44.134158+0000, chain.objs.size()=1 2024-09-12T17:41:33.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.244+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.UN2ZETSVrX4r_ufc8sdjplZ-3zg2paP_0 2024-09-12T17:41:33.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.244+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3262117896790456330', time=2024-09-12T19:31:44.152091+0000, chain.objs.size()=1 2024-09-12T17:41:33.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.244+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.szzOASRJkc4NOFZYIJf1eMH5GZ2AGZf_0 2024-09-12T17:41:33.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.244+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11112869131236673270', time=2024-09-12T19:31:44.187367+0000, chain.objs.size()=1 2024-09-12T17:41:33.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.244+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.vOiz2AFGdmjxzxZc7hRGV64IKPU9W4N_0 2024-09-12T17:41:33.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.244+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6721376436110917466', time=2024-09-12T19:31:44.192942+0000, chain.objs.size()=1 2024-09-12T17:41:33.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.244+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.LV95sZ6eEUuO2XnKL2oo-dPwNz4frGM_0 2024-09-12T17:41:33.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.244+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2922231389447983946', time=2024-09-12T19:31:44.208863+0000, chain.objs.size()=1 2024-09-12T17:41:33.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.244+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.N_pqmY8cPRZ-DgUcy3I1HLrzt-8IkSa_0 2024-09-12T17:41:33.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.244+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3496983177265508555', time=2024-09-12T19:31:44.229874+0000, chain.objs.size()=1 2024-09-12T17:41:33.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.244+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.o0gizd8yCWdX40w1QulooocWbwqnUOd_0 2024-09-12T17:41:33.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.244+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1115673663839301959', time=2024-09-12T19:31:44.421529+0000, chain.objs.size()=1 2024-09-12T17:41:33.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.244+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.HeY0a4O3wPF3ArARAdv6RM2E7IlAJQn_0 2024-09-12T17:41:33.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.244+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13518142612956888059', time=2024-09-12T19:31:44.470308+0000, chain.objs.size()=1 2024-09-12T17:41:33.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.244+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.F2xLC5gn8128q6KKFQ6Rqdm49pc4yCJ_0 2024-09-12T17:41:33.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.248+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16018608186200531556', time=2024-09-12T19:31:44.491072+0000, chain.objs.size()=1 2024-09-12T17:41:33.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.248+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.xsV-tjzD44g3lFn31A6ZlRLutLNatoZ_0 2024-09-12T17:41:33.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.248+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13881702042151940841', time=2024-09-12T19:31:44.516826+0000, chain.objs.size()=1 2024-09-12T17:41:33.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.248+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.o1ivs-LifTr7Au6OAYK5iUBEStwmwTz_0 2024-09-12T17:41:33.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.248+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11154566907015078046', time=2024-09-12T19:31:48.023002+0000, chain.objs.size()=1 2024-09-12T17:41:33.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.248+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.272__shadow_.Rn17LR9h90S5f_e-1WRzgCrXry3HmWe_0 2024-09-12T17:41:33.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.248+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10337970889602421209', time=2024-09-12T19:31:49.543406+0000, chain.objs.size()=1 2024-09-12T17:41:33.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.248+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.276__shadow_.e0Agawv4ET4UBLP7vpUQuxAGT4EF7em_0 2024-09-12T17:41:33.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.248+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13033248995839803244', time=2024-09-12T19:31:56.447333+0000, chain.objs.size()=1 2024-09-12T17:41:33.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.248+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.292__shadow_.hlDnbtEjrSx2U7DmT-YtODqzukapJmp_0 2024-09-12T17:41:33.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.248+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16158941458808945461', time=2024-09-12T19:31:56.470575+0000, chain.objs.size()=1 2024-09-12T17:41:33.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.248+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.292__shadow_.yu33-8bWhAlsXfcqNf65bhHvc0AheQc_0 2024-09-12T17:41:33.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.248+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16286350788072838429', time=2024-09-12T19:32:27.946471+0000, chain.objs.size()=1 2024-09-12T17:41:33.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.248+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.P-Vlnp3tyO3VxV4C8sgjNl-98bN2Vqe_0 2024-09-12T17:41:33.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.248+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15453237466347464955', time=2024-09-12T19:32:27.993344+0000, chain.objs.size()=1 2024-09-12T17:41:33.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.248+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.mrqBv5zSw_aApjF9qKRZVBNTNwwgULW_0 2024-09-12T17:41:33.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.248+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6142517557971795979', time=2024-09-12T19:32:28.006874+0000, chain.objs.size()=1 2024-09-12T17:41:33.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.248+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.eKfP_EXgnC4NWt24Yj4PHNRQxlSwTfg_0 2024-09-12T17:41:33.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.248+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.296560213250442376', time=2024-09-12T19:32:28.018704+0000, chain.objs.size()=1 2024-09-12T17:41:33.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.248+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.qFH5iZKJPDVl5C3FHqc1R8AfSLvBSTC_0 2024-09-12T17:41:33.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.248+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8510426093040337677', time=2024-09-12T19:32:28.038916+0000, chain.objs.size()=1 2024-09-12T17:41:33.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.248+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.4wb19vx7hfVVb1SDH80muAF0xJCnoMS_0 2024-09-12T17:41:33.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.248+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2328156461273203413', time=2024-09-12T19:32:28.043483+0000, chain.objs.size()=1 2024-09-12T17:41:33.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.248+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.X9OWA4q83xH7TeQKvKIjgDVXQJ92sjd_0 2024-09-12T17:41:33.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.248+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3231150504313705293', time=2024-09-12T19:32:28.061641+0000, chain.objs.size()=1 2024-09-12T17:41:33.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.248+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.spZslkVszTmrt5wIYeb-B3zzGp_4CEn_0 2024-09-12T17:41:33.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.248+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8123537625535261101', time=2024-09-12T19:32:28.177608+0000, chain.objs.size()=1 2024-09-12T17:41:33.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.248+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.bgdd64Gzk4q90esPdaMaUApkJOsC9f6_0 2024-09-12T17:41:33.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.248+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13742563555043125692', time=2024-09-12T19:32:28.199739+0000, chain.objs.size()=1 2024-09-12T17:41:33.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.248+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.3vHPRhYBd8a1J582HtWGDBBp0_Z0AOM_0 2024-09-12T17:41:33.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.248+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2890604115179501910', time=2024-09-12T19:32:28.323113+0000, chain.objs.size()=1 2024-09-12T17:41:33.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.248+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.DXs-gZgUlbrvkuQ_15e8X70FXoddlBS_0 2024-09-12T17:41:33.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.248+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3036711904836362185', time=2024-09-12T19:32:28.547084+0000, chain.objs.size()=1 2024-09-12T17:41:33.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.248+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.IZBAbFQsjvlA2heQimiFCTqaoRCs2yA_0 2024-09-12T17:41:33.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.248+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13229998827647335685', time=2024-09-12T19:32:28.565436+0000, chain.objs.size()=1 2024-09-12T17:41:33.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.248+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Ix-CPRd83KN-2UiUoW8sUSGQQM79d7P_0 2024-09-12T17:41:33.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.248+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6602406951132870818', time=2024-09-12T19:32:28.731170+0000, chain.objs.size()=1 2024-09-12T17:41:33.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.248+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.yEdVWXLVkUpjFTE30OZnHGNYEUJGcdK_0 2024-09-12T17:41:33.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.252+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1464907456816572596', time=2024-09-12T19:32:28.789684+0000, chain.objs.size()=1 2024-09-12T17:41:33.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.252+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.lWQ1YmtaYY5hGHiCzs5086Mq0HqQ7f7_0 2024-09-12T17:41:33.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.252+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2674778550099419122', time=2024-09-12T19:32:28.793980+0000, chain.objs.size()=1 2024-09-12T17:41:33.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.252+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Pza3vK3mvDCMu7o5i9biIjMYkLPvF0J_0 2024-09-12T17:41:33.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.252+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13245522751937955429', time=2024-09-12T19:32:28.805213+0000, chain.objs.size()=1 2024-09-12T17:41:33.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.252+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.OPRHnUWwJSyAWDxBLPomSJMZ3G53gmY_0 2024-09-12T17:41:33.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.252+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4411779060303747594', time=2024-09-12T19:32:28.837016+0000, chain.objs.size()=1 2024-09-12T17:41:33.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.252+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.0BEXHEU1r2lt4Y_iawE9fS1paa6a8Ap_0 2024-09-12T17:41:33.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.252+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13643366300012100846', time=2024-09-12T19:32:28.854628+0000, chain.objs.size()=1 2024-09-12T17:41:33.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.252+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.oDzE8qPs8_gEpEv-cyXKVZGxt4H7hjY_0 2024-09-12T17:41:33.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.252+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14445568871732688418', time=2024-09-12T19:32:28.889779+0000, chain.objs.size()=1 2024-09-12T17:41:33.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.252+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_._Xd6jEb_m1AGUAXlLwluCR1nOGjfcK4_0 2024-09-12T17:41:33.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.252+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.924544697570287385', time=2024-09-12T19:32:28.891899+0000, chain.objs.size()=1 2024-09-12T17:41:33.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.252+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.6baiV_zMSsJoIqi371FMVd-Dt7OjJR3_0 2024-09-12T17:41:33.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.252+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10368861547592968844', time=2024-09-12T19:32:28.897165+0000, chain.objs.size()=1 2024-09-12T17:41:33.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.252+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.vC2GwOfKvJeML38VblZLTJTSVkLZliX_0 2024-09-12T17:41:33.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.252+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1858266064011882626', time=2024-09-12T19:32:29.023221+0000, chain.objs.size()=1 2024-09-12T17:41:33.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.252+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.coxxKxIJEVPPIfa8bJrrM42TNFBtuOX_0 2024-09-12T17:41:33.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.252+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4871551865665245870', time=2024-09-12T19:32:29.037620+0000, chain.objs.size()=1 2024-09-12T17:41:33.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.252+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.U9aqj4jm_iEqVmGoGdct23QWIfyntxx_0 2024-09-12T17:41:33.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.252+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2822642737426863067', time=2024-09-12T19:32:29.113351+0000, chain.objs.size()=1 2024-09-12T17:41:33.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.252+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.ii2qm1EsLyxxGejA_1t_y-qVuYj0Hul_0 2024-09-12T17:41:33.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.252+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6886813505828828792', time=2024-09-12T19:32:29.146261+0000, chain.objs.size()=1 2024-09-12T17:41:33.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.252+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.nYjQzJIgt4dxBfJ79J_ah9EyhHh-nkJ_0 2024-09-12T17:41:33.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.252+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6951236709079896323', time=2024-09-12T19:32:29.217174+0000, chain.objs.size()=1 2024-09-12T17:41:33.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.252+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.a6W3j4C6bUapw3ZkOZjd73jNKIWFWO-_0 2024-09-12T17:41:33.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.252+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9728213691191102171', time=2024-09-12T19:32:29.487320+0000, chain.objs.size()=1 2024-09-12T17:41:33.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.252+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.su--0iiAEv7n8gqK8EN1BbwT8uN4rdi_0 2024-09-12T17:41:33.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.252+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2744452696903438487', time=2024-09-12T19:32:29.817051+0000, chain.objs.size()=1 2024-09-12T17:41:33.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.252+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.wbC8MwBBoREdYR_xxpGRrasK829-9ZL_0 2024-09-12T17:41:33.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.252+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18445970185414023842', time=2024-09-12T19:32:29.840647+0000, chain.objs.size()=1 2024-09-12T17:41:33.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.252+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Oc6BLhbd_yb-8FXubQXMMoGduG5L0td_0 2024-09-12T17:41:33.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.252+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8056580111901947503', time=2024-09-12T19:32:29.998745+0000, chain.objs.size()=1 2024-09-12T17:41:33.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.252+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.QgwVYmOgC1qcA3a1J9Mj_bF-r2YGTyO_0 2024-09-12T17:41:33.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.252+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4330521083452978724', time=2024-09-12T19:32:30.036934+0000, chain.objs.size()=1 2024-09-12T17:41:33.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.252+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.URckEOQ31YzXliSrEURN0jx5jTTNQFz_0 2024-09-12T17:41:33.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.252+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6599281936390969435', time=2024-09-12T19:32:30.112214+0000, chain.objs.size()=1 2024-09-12T17:41:33.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.252+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.7QRnH2GWpmLe6T68sVyJAGOBUlNpaZx_0 2024-09-12T17:41:33.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.252+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12368184106530857609', time=2024-09-12T19:32:49.586595+0000, chain.objs.size()=1 2024-09-12T17:41:33.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.252+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Urzfqerud2awA1OZhvblFMNR6JfMFJi_0 2024-09-12T17:41:33.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.252+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15389722647198065030', time=2024-09-12T19:32:49.686158+0000, chain.objs.size()=1 2024-09-12T17:41:33.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.252+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.FLRZQBqGKBfFmLd8xz6_LqT0xhVbLst_0 2024-09-12T17:41:33.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.252+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2375505152563981691', time=2024-09-12T19:32:49.695019+0000, chain.objs.size()=1 2024-09-12T17:41:33.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.252+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.7Kw8TT_4M2KfBGao9jFfmRXlHPosqA__0 2024-09-12T17:41:33.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.252+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9665465813173550266', time=2024-09-12T19:32:49.763057+0000, chain.objs.size()=1 2024-09-12T17:41:33.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.252+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.pLGc_MTmaGf7Z47oF2cRpm0SdOtAwYz_0 2024-09-12T17:41:33.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.256+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1564476315326018174', time=2024-09-12T19:32:49.827431+0000, chain.objs.size()=1 2024-09-12T17:41:33.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.256+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Ykwnxni4y0iRP88JVqoj3rdCbOlY_6y_0 2024-09-12T17:41:33.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.256+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5175962193807084912', time=2024-09-12T19:32:49.875892+0000, chain.objs.size()=1 2024-09-12T17:41:33.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.256+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.JrswbdwpLCCU8cNDZQzqlGCEl8g_L63_0 2024-09-12T17:41:33.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.256+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6050533235120208204', time=2024-09-12T19:32:49.891788+0000, chain.objs.size()=1 2024-09-12T17:41:33.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.256+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.RzrMo4g9xjfQrJaeePh2ohU1ptlxsHC_0 2024-09-12T17:41:33.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.256+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.954511685550942960', time=2024-09-12T19:32:49.911592+0000, chain.objs.size()=1 2024-09-12T17:41:33.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.256+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.R4vXhgQAlQXCOQ69BTgrNeQAlzn3Do5_0 2024-09-12T17:41:33.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.256+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3804940037980681985', time=2024-09-12T19:32:49.919906+0000, chain.objs.size()=1 2024-09-12T17:41:33.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.256+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.teIJl-cwJlbGH0CI-72LAWvCnubwXWY_0 2024-09-12T17:41:33.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.256+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18050868029043323635', time=2024-09-12T19:32:49.929684+0000, chain.objs.size()=1 2024-09-12T17:41:33.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.256+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.n3kcYrfKLfsM2URpyG0SJRKvkkFSTcY_0 2024-09-12T17:41:33.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.256+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11484214319029547213', time=2024-09-12T19:32:49.938166+0000, chain.objs.size()=1 2024-09-12T17:41:33.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.256+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Fg5Jf34MG-RsdaZxEZoA2o8mpBdTYMs_0 2024-09-12T17:41:33.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.256+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16656432934211715463', time=2024-09-12T19:32:49.940795+0000, chain.objs.size()=1 2024-09-12T17:41:33.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.256+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.YU9Hl3PAHo_8nNqSPlI9rk1twIyy3Wk_0 2024-09-12T17:41:33.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.256+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13182927623480124961', time=2024-09-12T19:32:50.119788+0000, chain.objs.size()=1 2024-09-12T17:41:33.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.256+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.di3VSEZA9M5Gd4fqTGYbwYFBzAjFWYD_0 2024-09-12T17:41:33.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.256+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17878997080180327760', time=2024-09-12T19:32:50.199751+0000, chain.objs.size()=1 2024-09-12T17:41:33.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.256+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.hs-dEAlGpyNvLTZsVGTGAPPrGx20Iad_0 2024-09-12T17:41:33.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.256+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16199855484969473392', time=2024-09-12T19:32:50.224078+0000, chain.objs.size()=1 2024-09-12T17:41:33.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.256+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.tzNoINgymjNVxarJ4fTZAunjsQjxefk_0 2024-09-12T17:41:33.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.256+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18245909425455372902', time=2024-09-12T19:32:50.243000+0000, chain.objs.size()=1 2024-09-12T17:41:33.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.256+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.dif_nss-9fbmXIz8T_cyOMJo_CgDQGi_0 2024-09-12T17:41:33.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.256+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13564020491924808066', time=2024-09-12T19:32:50.270717+0000, chain.objs.size()=1 2024-09-12T17:41:33.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.256+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.-0U4uMU4hGi9Y_jtcYJghW3tjKUyj8a_0 2024-09-12T17:41:33.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.256+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.829416101192752529', time=2024-09-12T19:32:50.278867+0000, chain.objs.size()=1 2024-09-12T17:41:33.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.256+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.geabGOY46QDgObV1aV9HVfexvnfToDg_0 2024-09-12T17:41:33.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.256+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9446506823739792147', time=2024-09-12T19:32:50.329805+0000, chain.objs.size()=1 2024-09-12T17:41:33.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.256+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.O-wtaGaE8k-hrWjbbCV7OkAKeXJjtVh_0 2024-09-12T17:41:33.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.256+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6505476928295220176', time=2024-09-12T19:32:50.510003+0000, chain.objs.size()=1 2024-09-12T17:41:33.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.256+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.w-VA62MPPR_1tkYDhHYJvfKOm6zGSad_0 2024-09-12T17:41:33.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.260+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11842550385019949233', time=2024-09-12T19:32:50.587768+0000, chain.objs.size()=1 2024-09-12T17:41:33.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.260+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.sG7aXLklzVgVtjpKzP90we9K8vwVmFx_0 2024-09-12T17:41:33.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.260+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2119866234763100651', time=2024-09-12T19:32:50.599663+0000, chain.objs.size()=1 2024-09-12T17:41:33.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.260+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.JyAcCuNe-Beymhu_TKDf9PsKbapNprz_0 2024-09-12T17:41:33.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.260+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16386824442210694650', time=2024-09-12T19:32:50.620934+0000, chain.objs.size()=1 2024-09-12T17:41:33.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.260+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.gg6ZGnHjBXTTTtSU1nysSGe6mfDXl_P_0 2024-09-12T17:41:33.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.260+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4685600134291151617', time=2024-09-12T19:32:50.680892+0000, chain.objs.size()=1 2024-09-12T17:41:33.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.260+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.x8ZLOrbw_ablok2-4B3XG2Xb7Lb_2qo_0 2024-09-12T17:41:33.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.260+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16618036897429990799', time=2024-09-12T19:32:50.690106+0000, chain.objs.size()=1 2024-09-12T17:41:33.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.260+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.6_KrleHvEL60n3tSj2vLKTTWyBUzw0W_0 2024-09-12T17:41:33.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.260+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2347955489878378202', time=2024-09-12T19:32:50.978367+0000, chain.objs.size()=1 2024-09-12T17:41:33.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.260+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.UT19sEMFJ80_Ujvny0BvuE96_JXiTdr_0 2024-09-12T17:41:33.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.260+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16335530300809916351', time=2024-09-12T19:32:50.980003+0000, chain.objs.size()=1 2024-09-12T17:41:33.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.260+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Nq31gmRLs19F9Rk3vlRUF9Icocr3iTd_0 2024-09-12T17:41:33.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.260+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8816709801792470723', time=2024-09-12T19:32:50.996261+0000, chain.objs.size()=1 2024-09-12T17:41:33.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.260+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.8H5Onh0S_ECQLFJnM0HIKJt8JmPUnZW_0 2024-09-12T17:41:33.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.260+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47073 2024-09-12T17:41:33.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.264+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-12T17:41:33.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.264+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17748017303778055796', time=2024-09-12T19:32:51.234525+0000, chain.objs.size()=1 2024-09-12T17:41:33.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.264+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.NBxnGhEDeIDI5pXmeoFqIXDAJ3IXFhq_0 2024-09-12T17:41:33.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.264+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6017432653133358317', time=2024-09-12T19:32:51.338922+0000, chain.objs.size()=1 2024-09-12T17:41:33.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.264+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.kRHBnIUXzJxuWKJ8dU0jo6h3aGRF2XS_0 2024-09-12T17:41:33.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.264+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.602961948627489108', time=2024-09-12T19:32:51.510462+0000, chain.objs.size()=1 2024-09-12T17:41:33.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.264+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.j37FjWHM9hVMB5aelEELeiI4RgOElYG_0 2024-09-12T17:41:33.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.264+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12075861171521991136', time=2024-09-12T19:32:51.723941+0000, chain.objs.size()=1 2024-09-12T17:41:33.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.264+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.xQlKin0If1_b6FSujxLl3OcsuagR0Nu_0 2024-09-12T17:41:33.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.264+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2384598650890245310', time=2024-09-12T19:32:51.842701+0000, chain.objs.size()=1 2024-09-12T17:41:33.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.264+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.FgQ9atTU6Ck7fZMp_kRqvf5EvhX9Flg_0 2024-09-12T17:41:33.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.264+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15736240442664763988', time=2024-09-12T19:32:51.977584+0000, chain.objs.size()=1 2024-09-12T17:41:33.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.264+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.tGBwpr-QCXZWnalDDT00KAIUE5AYJYb_0 2024-09-12T17:41:33.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.264+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8240603349214121960', time=2024-09-12T19:32:51.980621+0000, chain.objs.size()=1 2024-09-12T17:41:33.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.264+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.2Pvpxj7n4qw7-c7O4Qf62wNIJ4oHqf8_0 2024-09-12T17:41:33.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.264+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4862741925446296824', time=2024-09-12T19:32:51.989909+0000, chain.objs.size()=1 2024-09-12T17:41:33.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.264+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.TlUstKrYEbFHyB6LX-5k1MnocxpX9h2_0 2024-09-12T17:41:33.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.264+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7933257634915399147', time=2024-09-12T19:32:52.014137+0000, chain.objs.size()=1 2024-09-12T17:41:33.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.264+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.7-7buT5I5xFXNpeQW3GE1nyirDHWspS_0 2024-09-12T17:41:33.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.264+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4987367136337748500', time=2024-09-12T19:33:31.446254+0000, chain.objs.size()=1 2024-09-12T17:41:33.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.264+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.437__shadow_.0WWJMURKhPY3k2CAk1kwD6sGWCqHnGo_0 2024-09-12T17:41:33.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.264+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12406981240562207701', time=2024-09-12T19:33:49.244422+0000, chain.objs.size()=1 2024-09-12T17:41:33.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.264+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.483__shadow_.HE0z3TrR7kiSy4UHE4dNRQxv4Gx_Z7b_0 2024-09-12T17:41:33.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.264+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~P3COAHl_p2NI0B0mIg7hHse1KzjvH_3', time=2024-09-12T19:34:30.517315+0000, chain.objs.size()=1 2024-09-12T17:41:33.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.264+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.534__multipart_mymultipart.2~P3COAHl_p2NI0B0mIg7hHse1KzjvH_3.1 2024-09-12T17:41:33.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.264+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14968944264587083922', time=2024-09-12T19:35:06.354249+0000, chain.objs.size()=2 2024-09-12T17:41:33.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.264+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.558__shadow_.22fAuU8lEzz2XhAahChZCw114OQlKDu_0 2024-09-12T17:41:33.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.264+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.558__shadow_.22fAuU8lEzz2XhAahChZCw114OQlKDu_1 2024-09-12T17:41:33.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.264+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17683796075092110174', time=2024-09-12T19:35:22.425727+0000, chain.objs.size()=1 2024-09-12T17:41:33.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.264+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.569__shadow:8UuDmcvKadW4sVyt0R4EDSIHjF92Xh4_.z1LnohLhCaXVgH0cBAp1t6RE5EC9Tfb_0 2024-09-12T17:41:33.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.264+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12057934353139363466', time=2024-09-12T19:35:29.309234+0000, chain.objs.size()=1 2024-09-12T17:41:33.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.264+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.574__shadow:g56etRDirwR6orYxCqWkHPio6BlC311_.tW08JEkFj62uNDsWah0KIMzxm1teCJv_0 2024-09-12T17:41:33.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.264+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16360342493127901808', time=2024-09-12T19:35:39.194814+0000, chain.objs.size()=1 2024-09-12T17:41:33.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.264+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.577__shadow:j0s2TmyQJhYld-6DH1MFj-uDU4tvpec_.VcXJcOurpueAiEGttq5cSYhVrjZsUak_0 2024-09-12T17:41:33.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.264+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14043013804301895684', time=2024-09-12T19:35:59.125099+0000, chain.objs.size()=1 2024-09-12T17:41:33.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.264+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.587__shadow:8AFHl6AEjmdy-mSUZseYdhpfoldjyPP_.WSLGggXGnFLkH89ji-DPEIlx_QB2LJr_0 2024-09-12T17:41:33.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.264+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5943753490999240458', time=2024-09-12T19:38:16.716337+0000, chain.objs.size()=1 2024-09-12T17:41:33.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.264+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.618__shadow_.qTTJEsz1LjfIDbFGNmlmFbPZAFfyXgw_0 2024-09-12T17:41:33.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.264+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17281121883663672271', time=2024-09-12T19:38:25.447135+0000, chain.objs.size()=1 2024-09-12T17:41:33.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.264+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.631__shadow_.5B2E9oD-M_8RhuT7tP6sYsKwInwBkEq_0 2024-09-12T17:41:33.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.264+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6343542163378813703', time=2024-09-12T19:38:26.570780+0000, chain.objs.size()=1 2024-09-12T17:41:33.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.264+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.634__shadow_.ectnUsVT1qJ9JUrJ9WbPUdwUQzdxvMy_0 2024-09-12T17:41:33.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.264+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5654781245112396585', time=2024-09-12T19:38:43.303335+0000, chain.objs.size()=1 2024-09-12T17:41:33.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.264+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.665__shadow_.4enCkytZWKtp2x078n-fZfPgl5qAH-Q_0 2024-09-12T17:41:33.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.264+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1823774584636531957', time=2024-09-12T19:39:00.601850+0000, chain.objs.size()=1 2024-09-12T17:41:33.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.264+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.713__shadow:CUyH6TqaZ6J-bIU0vejNLDV4xhPuIlz_.BWrUKlWAUHr52EsyA2vidci_hG0CedE_0 2024-09-12T17:41:33.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.268+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:41:33.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.268+0000 7fd765adf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:41:33.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.272+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:41:33.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.272+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:41:33.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.272+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/57671' 2024-09-12T17:41:33.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.272+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10431431341987955271', time=2024-09-12T19:31:11.026023+0000, chain.objs.size()=1 2024-09-12T17:41:33.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.272+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.231__shadow_.q2R-iTedlXsydSkLAj27Hxra8nOzTEP_0 2024-09-12T17:41:33.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.272+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2737592324168371332', time=2024-09-12T19:31:14.278907+0000, chain.objs.size()=1 2024-09-12T17:41:33.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.272+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.239__shadow_.Cxxz_bRAJmeLPKehO1WAO2mIF94tJEt_0 2024-09-12T17:41:33.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.272+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3932906415977130853', time=2024-09-12T19:31:16.777120+0000, chain.objs.size()=1 2024-09-12T17:41:33.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.272+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.245__shadow_.BY4pIoqv6Z7AEvdRMU0LLmri6PpZkTO_0 2024-09-12T17:41:33.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.272+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4599126933262432049', time=2024-09-12T19:31:16.780184+0000, chain.objs.size()=1 2024-09-12T17:41:33.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.272+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.245__shadow_.RDmRMNB-rEVD8J7MDCxiM7j6MNReMp1_0 2024-09-12T17:41:33.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.272+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10880417679925935647', time=2024-09-12T19:31:19.075641+0000, chain.objs.size()=1 2024-09-12T17:41:33.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.272+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.251__shadow_.rVGJsMYvkFaKRI1evaB0zCO6AlKd20W_0 2024-09-12T17:41:33.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.272+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16158109274465851654', time=2024-09-12T19:31:42.286432+0000, chain.objs.size()=1 2024-09-12T17:41:33.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.272+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.mUtd9Ptc9fPlSZEzcUWJBEPFlznDNIp_0 2024-09-12T17:41:33.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.272+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4084817456238481832', time=2024-09-12T19:31:42.366179+0000, chain.objs.size()=1 2024-09-12T17:41:33.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.272+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.1RQ0Q8F-DGGB6h7B4yf9klrcW3fhDiG_0 2024-09-12T17:41:33.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.272+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14980825613641592953', time=2024-09-12T19:31:42.391475+0000, chain.objs.size()=1 2024-09-12T17:41:33.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.272+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.LwA2WbliF3RCPe_6EM48o_r85O8pXu8_0 2024-09-12T17:41:33.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.272+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13621947959427742836', time=2024-09-12T19:31:42.426271+0000, chain.objs.size()=1 2024-09-12T17:41:33.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.272+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.gVdN5J2ZFi9PkPUwV8tvee5uKfhw4YU_0 2024-09-12T17:41:33.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.272+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7093390510164938643', time=2024-09-12T19:31:42.684145+0000, chain.objs.size()=1 2024-09-12T17:41:33.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.272+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.WA1HcudtZJpvY2AIFoYlgST4LuwSG8w_0 2024-09-12T17:41:33.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.272+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12268825458250754389', time=2024-09-12T19:31:42.770318+0000, chain.objs.size()=1 2024-09-12T17:41:33.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.272+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.1008Zv5TeodOWD85lvjxbGeday8-RkS_0 2024-09-12T17:41:33.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.272+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6780442196966534375', time=2024-09-12T19:31:42.806305+0000, chain.objs.size()=1 2024-09-12T17:41:33.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.272+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.U0Zri2Y0NWx7R3QSgRxr9moq6KNlr9d_0 2024-09-12T17:41:33.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.272+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.541078310692276135', time=2024-09-12T19:31:42.916723+0000, chain.objs.size()=1 2024-09-12T17:41:33.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.272+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.lW8ifQMs2GFdpSkYW_vlZCSocA2A4Im_0 2024-09-12T17:41:33.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.272+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18265234567283051022', time=2024-09-12T19:31:42.930872+0000, chain.objs.size()=1 2024-09-12T17:41:33.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.272+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.RfXRHz0h4E1vP9unSqEq4_MePkmpp6c_0 2024-09-12T17:41:33.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.272+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9932221681537645475', time=2024-09-12T19:31:42.931621+0000, chain.objs.size()=1 2024-09-12T17:41:33.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.272+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.vPFLbcI7mO45MKphINHrwmeydylg2AD_0 2024-09-12T17:41:33.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.272+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2671243622618532746', time=2024-09-12T19:31:43.089569+0000, chain.objs.size()=1 2024-09-12T17:41:33.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.272+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.WtE7VtPNyPIPf_l-23rqC99dSR_DNbQ_0 2024-09-12T17:41:33.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.272+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10152102552113418305', time=2024-09-12T19:31:43.107908+0000, chain.objs.size()=1 2024-09-12T17:41:33.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.272+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.4uW-6iOIfX1N62cF5---Z90OiqlwkuE_0 2024-09-12T17:41:33.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.276+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5275939887010288077', time=2024-09-12T19:31:43.133363+0000, chain.objs.size()=1 2024-09-12T17:41:33.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.276+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.WG3kx2lmyddEUgxSyZI2gdOzf53wJnv_0 2024-09-12T17:41:33.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.276+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4101250563500937698', time=2024-09-12T19:31:43.203053+0000, chain.objs.size()=1 2024-09-12T17:41:33.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.276+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.edtPESjlBKSJSM0EVXkYZ430WAF8gk0_0 2024-09-12T17:41:33.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.276+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13353580559478605625', time=2024-09-12T19:31:43.232803+0000, chain.objs.size()=1 2024-09-12T17:41:33.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.276+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.67d3pYXGU8jczvjA4fxQ60fWS54CxKe_0 2024-09-12T17:41:33.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.276+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10726375964877499475', time=2024-09-12T19:31:43.270785+0000, chain.objs.size()=1 2024-09-12T17:41:33.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.276+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.RNh4-msPD5CEoKtQs8IyaF4RWiYEwBL_0 2024-09-12T17:41:33.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.276+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14209576419809800141', time=2024-09-12T19:31:43.441800+0000, chain.objs.size()=1 2024-09-12T17:41:33.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.276+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.kzivKsLca13rAuMa6y2eJX8rDHp4zxm_0 2024-09-12T17:41:33.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.276+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11919052681314755294', time=2024-09-12T19:31:43.504597+0000, chain.objs.size()=1 2024-09-12T17:41:33.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.276+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.4Wa2wqZwx4JbGGJhM-pBns5CXxotTfa_0 2024-09-12T17:41:33.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.276+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13668579484352189534', time=2024-09-12T19:31:43.510302+0000, chain.objs.size()=1 2024-09-12T17:41:33.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.276+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.iJ9DjITIrq0vkp7Y5uMcC6TQMqWDYr7_0 2024-09-12T17:41:33.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.276+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7880130236802790696', time=2024-09-12T19:31:43.606444+0000, chain.objs.size()=1 2024-09-12T17:41:33.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.276+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.s88locYgc8rWVqzjkKdds7EmYVtiYhn_0 2024-09-12T17:41:33.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.276+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4010221584143456892', time=2024-09-12T19:31:43.773345+0000, chain.objs.size()=1 2024-09-12T17:41:33.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.276+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.XCysc98cULgKHHjul3RsZu4ewYjmlyl_0 2024-09-12T17:41:33.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.276+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9710626070505042657', time=2024-09-12T19:31:43.818201+0000, chain.objs.size()=1 2024-09-12T17:41:33.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.276+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.lJJNM2ZO7vt--AoMvOQCV19EZrmYc8e_0 2024-09-12T17:41:33.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.276+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16275856640558533761', time=2024-09-12T19:31:43.843273+0000, chain.objs.size()=1 2024-09-12T17:41:33.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.276+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Sc14OzX3_xzi2rYenk8K9o81ronI8Sm_0 2024-09-12T17:41:33.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.276+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13993155659946631620', time=2024-09-12T19:31:43.849250+0000, chain.objs.size()=1 2024-09-12T17:41:33.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.276+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.jgner1LiwRYYyE-bgwK0Hx4fBoKnzVo_0 2024-09-12T17:41:33.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.276+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6642822024890614664', time=2024-09-12T19:31:43.859368+0000, chain.objs.size()=1 2024-09-12T17:41:33.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.276+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.08kDyGEluEs5XWHfg1rrf4LsaUciCRI_0 2024-09-12T17:41:33.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.276+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.485929038755550089', time=2024-09-12T19:31:43.928330+0000, chain.objs.size()=1 2024-09-12T17:41:33.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.276+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.b-m5KxdZWtlqvEasE7i-vLyAl5stAsL_0 2024-09-12T17:41:33.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.276+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7060182342700377556', time=2024-09-12T19:31:44.068358+0000, chain.objs.size()=1 2024-09-12T17:41:33.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.276+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.5Pp-SR5LLCFwjAfHTdmEVQoAAIbq-iD_0 2024-09-12T17:41:33.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.276+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9328380559109650467', time=2024-09-12T19:31:44.100364+0000, chain.objs.size()=1 2024-09-12T17:41:33.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.276+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.PEm9sJ7f9cl5SIb432HWhF9wTVWiSPe_0 2024-09-12T17:41:33.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.276+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10813999163136353225', time=2024-09-12T19:31:44.199010+0000, chain.objs.size()=1 2024-09-12T17:41:33.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.276+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.82Jf4Mn0ZjNzVWpX2o3CwfwcvQbVY4l_0 2024-09-12T17:41:33.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.276+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14149844450626117695', time=2024-09-12T19:31:44.414374+0000, chain.objs.size()=1 2024-09-12T17:41:33.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.276+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.HL5xf0Pqc_SYUbLaZacRXglyByPX_iL_0 2024-09-12T17:41:33.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.276+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.743048744018876779', time=2024-09-12T19:31:44.452813+0000, chain.objs.size()=1 2024-09-12T17:41:33.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.276+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.S7SAfHeFlWb-Tc-aldPO-Cv65WkV41Z_0 2024-09-12T17:41:33.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.276+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1100103267638879295', time=2024-09-12T19:31:44.755562+0000, chain.objs.size()=1 2024-09-12T17:41:33.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.276+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.263__shadow_.StZKzuSX0kS9JzwlkPiGR-0KKCfx0_V_0 2024-09-12T17:41:33.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.280+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2584903912365488918', time=2024-09-12T19:31:48.729697+0000, chain.objs.size()=1 2024-09-12T17:41:33.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.280+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.274__shadow_.nlGpW-zZlJXi3facYlTCSolK-e3CxD8_0 2024-09-12T17:41:33.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.280+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8966405622321419158', time=2024-09-12T19:31:54.616897+0000, chain.objs.size()=1 2024-09-12T17:41:33.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.280+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.289__shadow_.DJC1bAZeDnPw5SVKHfD51JF4OB5GiAj_0 2024-09-12T17:41:33.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.280+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15054120025299516814', time=2024-09-12T19:31:56.470193+0000, chain.objs.size()=1 2024-09-12T17:41:33.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.280+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.292__shadow_.c6oPuZy2WnufNqrUwxK_EVteBqTNNCD_0 2024-09-12T17:41:33.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.280+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15627987944880545265', time=2024-09-12T19:31:56.477096+0000, chain.objs.size()=1 2024-09-12T17:41:33.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.280+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.292__shadow_.Y2IfaeKLczePI5-KCmCdED0ZX_u0b1i_0 2024-09-12T17:41:33.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.280+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17227243100912530944', time=2024-09-12T19:31:56.492873+0000, chain.objs.size()=1 2024-09-12T17:41:33.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.280+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.292__shadow_.wuhV7M4o4DnU1VA8lofy7sFfe_iBhTM_0 2024-09-12T17:41:33.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.280+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6484389575513198503', time=2024-09-12T19:31:57.584999+0000, chain.objs.size()=1 2024-09-12T17:41:33.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.280+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.293__shadow_.ch7qNaKV-gafThVRfujQj8tqAFjooUu_0 2024-09-12T17:41:33.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.280+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15789020862686663064', time=2024-09-12T19:31:57.611204+0000, chain.objs.size()=1 2024-09-12T17:41:33.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.280+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.293__shadow_.hCuo7IYexeS2ymo4s0djR0uOSAveL0d_0 2024-09-12T17:41:33.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.280+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12374438091710461189', time=2024-09-12T19:32:02.321581+0000, chain.objs.size()=1 2024-09-12T17:41:33.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.280+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.305__shadow_.IVVqhMYm2hH4GQUpfgq8vUYY0eBIBdo_0 2024-09-12T17:41:33.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.280+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11538543911518317271', time=2024-09-12T19:32:27.978434+0000, chain.objs.size()=1 2024-09-12T17:41:33.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.280+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.tveMtWOGTaT8FpqFAQLOaXqvx8q6Pjw_0 2024-09-12T17:41:33.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.280+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2100578719290859544', time=2024-09-12T19:32:27.988881+0000, chain.objs.size()=1 2024-09-12T17:41:33.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.280+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.ihuRmQctf5hVv19fapqtpjUkmHzNSPc_0 2024-09-12T17:41:33.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.280+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5965417578650453876', time=2024-09-12T19:32:28.056900+0000, chain.objs.size()=1 2024-09-12T17:41:33.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.280+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.4FKAxxeZrASMUCsr0DhDtnlTIMN1top_0 2024-09-12T17:41:33.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.280+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6518496594324933135', time=2024-09-12T19:32:28.087249+0000, chain.objs.size()=1 2024-09-12T17:41:33.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.280+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.o-ld-YE6ioxaA_mfhZ5ndGWjloenGRg_0 2024-09-12T17:41:33.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.280+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11810123510432746759', time=2024-09-12T19:32:28.172378+0000, chain.objs.size()=1 2024-09-12T17:41:33.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.280+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.glDxljVQS6dThKRakmFjz5uYRe-_me9_0 2024-09-12T17:41:33.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.280+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6723672238650351994', time=2024-09-12T19:32:28.405169+0000, chain.objs.size()=1 2024-09-12T17:41:33.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.280+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.3pt9m3Vqy7UarEw7ANRoCVo2uzeq5Np_0 2024-09-12T17:41:33.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.280+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16273021027272713176', time=2024-09-12T19:32:28.408453+0000, chain.objs.size()=1 2024-09-12T17:41:33.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.280+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.YHkmSFk-5RtD9g13E2mrSRy1TAbsk-G_0 2024-09-12T17:41:33.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.280+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.162250563448055547', time=2024-09-12T19:32:28.481694+0000, chain.objs.size()=1 2024-09-12T17:41:33.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.280+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.PuyAB90eppT96FH-zMtrM1sxzfIfJrg_0 2024-09-12T17:41:33.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.280+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16641963378956074618', time=2024-09-12T19:32:28.491188+0000, chain.objs.size()=1 2024-09-12T17:41:33.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.280+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Gql4aJAp8n2-ndPt4XpjujLxV0WoImQ_0 2024-09-12T17:41:33.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.284+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12029423948143547778', time=2024-09-12T19:32:28.535407+0000, chain.objs.size()=1 2024-09-12T17:41:33.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.284+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.G4zD_Px946jS8ESF3rMjFc3acLOv8Bm_0 2024-09-12T17:41:33.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.284+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8727280798320094326', time=2024-09-12T19:32:28.545548+0000, chain.objs.size()=1 2024-09-12T17:41:33.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.284+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.tosZ-l71VQTGO_xvMZUamZeHWS5sofr_0 2024-09-12T17:41:33.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.284+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1637909324515695008', time=2024-09-12T19:32:28.692270+0000, chain.objs.size()=1 2024-09-12T17:41:33.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.284+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.8s4IuhIOziXy-Ela67waR6tRvB2GRle_0 2024-09-12T17:41:33.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.284+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3329366347342657815', time=2024-09-12T19:32:28.738837+0000, chain.objs.size()=1 2024-09-12T17:41:33.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.284+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.v3yAx-J4L48CgnYEtHcmBy9_LOYmsmH_0 2024-09-12T17:41:33.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.284+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.594248321656373465', time=2024-09-12T19:32:29.088280+0000, chain.objs.size()=1 2024-09-12T17:41:33.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.284+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.nHeVYRph_CWhaiBTPNxBLrL597pucqU_0 2024-09-12T17:41:33.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.284+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13555408873372710376', time=2024-09-12T19:32:29.178113+0000, chain.objs.size()=1 2024-09-12T17:41:33.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.284+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.iW7fHx6aAYWVQ1z-52jNglg0-GuxpFh_0 2024-09-12T17:41:33.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.284+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1493730434798340146', time=2024-09-12T19:32:29.217317+0000, chain.objs.size()=1 2024-09-12T17:41:33.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.284+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.COsYOESM_cK3HgKNbd4IzxejI_ETE2x_0 2024-09-12T17:41:33.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.284+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6604466152809862459', time=2024-09-12T19:32:29.428875+0000, chain.objs.size()=1 2024-09-12T17:41:33.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.284+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.YrDs5TxLhgWoN8wdd9K5ebshw_C_5oC_0 2024-09-12T17:41:33.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.284+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8845099740602874923', time=2024-09-12T19:32:29.679000+0000, chain.objs.size()=1 2024-09-12T17:41:33.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.284+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.D9Kd1iZB7O6fky_voAljMyAzj-nzF8c_0 2024-09-12T17:41:33.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.284+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15177657005368846687', time=2024-09-12T19:32:29.785420+0000, chain.objs.size()=1 2024-09-12T17:41:33.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.284+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.gZWKyHwDqvE_LEN5-z4lDRRN73IWJmL_0 2024-09-12T17:41:33.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.284+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4130506709504112584', time=2024-09-12T19:32:29.794318+0000, chain.objs.size()=1 2024-09-12T17:41:33.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.284+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Fx-ARCVpnO5H6J3tKtoAM4ktOg2unnS_0 2024-09-12T17:41:33.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.284+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12894365915254897904', time=2024-09-12T19:32:29.868812+0000, chain.objs.size()=1 2024-09-12T17:41:33.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.284+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.taX05BWjm_ybkXTwulvke_Vderz2hfY_0 2024-09-12T17:41:33.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.284+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11860806769559613354', time=2024-09-12T19:32:29.884793+0000, chain.objs.size()=1 2024-09-12T17:41:33.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.284+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Mvil1jCQRJluM9w40kGHDC7-OEzs9B4_0 2024-09-12T17:41:33.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.284+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7732262110959499143', time=2024-09-12T19:32:30.073515+0000, chain.objs.size()=1 2024-09-12T17:41:33.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.284+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.w950AvoNgRjGK_sdc5Typi440RNWAfO_0 2024-09-12T17:41:33.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.284+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4084025024276273508', time=2024-09-12T19:32:30.074534+0000, chain.objs.size()=1 2024-09-12T17:41:33.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.284+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.iTcUb4-4FsUipWdyGoHRh23s2UdqGb__0 2024-09-12T17:41:33.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.284+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.182455746666422579', time=2024-09-12T19:32:49.528680+0000, chain.objs.size()=1 2024-09-12T17:41:33.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.284+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.-HHeW7MDmRoD0uE78hxcaaLaPc076Jq_0 2024-09-12T17:41:33.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.284+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3003856550221241274', time=2024-09-12T19:32:49.550626+0000, chain.objs.size()=1 2024-09-12T17:41:33.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.284+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.H1CmYY6Y9TQcwDaiN5uhA-EwKBYKX8i_0 2024-09-12T17:41:33.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.284+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8069634406376465087', time=2024-09-12T19:32:49.563800+0000, chain.objs.size()=1 2024-09-12T17:41:33.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.284+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.M4CZooUeOv6yS99Fr3KNxe1x195SijN_0 2024-09-12T17:41:33.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.284+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10698160903471501230', time=2024-09-12T19:32:49.571124+0000, chain.objs.size()=1 2024-09-12T17:41:33.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.284+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.CUSo2c619OMnEcmw73kTUagJNjZwfQt_0 2024-09-12T17:41:33.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.284+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12376936571047648951', time=2024-09-12T19:32:49.677055+0000, chain.objs.size()=1 2024-09-12T17:41:33.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.284+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.92LxHU9coAtjzB8pa4a1QfZW7kYaKSV_0 2024-09-12T17:41:33.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.284+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9491384317539120769', time=2024-09-12T19:32:49.678107+0000, chain.objs.size()=1 2024-09-12T17:41:33.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.284+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.bsY-1JxZtIHxE0PBtJIyIwHb7dngvhC_0 2024-09-12T17:41:33.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.284+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5914296001796093651', time=2024-09-12T19:32:49.715924+0000, chain.objs.size()=1 2024-09-12T17:41:33.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.284+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Izd92rG4v8RjQw3k-W1MSf4MMK2qFKR_0 2024-09-12T17:41:33.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.288+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3762349879126484906', time=2024-09-12T19:32:49.729393+0000, chain.objs.size()=1 2024-09-12T17:41:33.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.288+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.59No9J0HWYW9G9sZ_j6NsGJPg0wDD2M_0 2024-09-12T17:41:33.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.288+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6960326236677822345', time=2024-09-12T19:32:49.746888+0000, chain.objs.size()=1 2024-09-12T17:41:33.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.288+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.ubCuoj1gqkllScxXWWrJYJvhDTBQ_6m_0 2024-09-12T17:41:33.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.288+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16689714801744323057', time=2024-09-12T19:32:49.748591+0000, chain.objs.size()=1 2024-09-12T17:41:33.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.288+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.yY6dbK4PpFlA-JWJ18G3oT5f2fveUFP_0 2024-09-12T17:41:33.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.288+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3375801313698125070', time=2024-09-12T19:32:49.871611+0000, chain.objs.size()=1 2024-09-12T17:41:33.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.288+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.ndU0uI7ZgfUF51y2f7up1x2ZFV8c4sy_0 2024-09-12T17:41:33.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.288+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18414467242831768694', time=2024-09-12T19:32:49.883688+0000, chain.objs.size()=1 2024-09-12T17:41:33.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.288+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.84II9-gF4_8-ohYdly1q0QEu8BuBOv5_0 2024-09-12T17:41:33.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.288+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12940224730861296630', time=2024-09-12T19:32:49.898697+0000, chain.objs.size()=1 2024-09-12T17:41:33.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.288+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.dG_Bk7QkNV_zoIWuzDqxJpbBH_cZWBg_0 2024-09-12T17:41:33.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.288+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13117714202339816149', time=2024-09-12T19:32:49.904210+0000, chain.objs.size()=1 2024-09-12T17:41:33.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.288+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_._dCEW9O4pwKqFK3V-X_nv0LoSaCZilg_0 2024-09-12T17:41:33.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.288+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1605748308337090287', time=2024-09-12T19:32:49.949836+0000, chain.objs.size()=1 2024-09-12T17:41:33.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.288+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.XAOoo-CWpUT8U-FSBCpYgkQZYNgXhjr_0 2024-09-12T17:41:33.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.288+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3470280226763580224', time=2024-09-12T19:32:50.003653+0000, chain.objs.size()=1 2024-09-12T17:41:33.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.288+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.7X8LoxbUOtkkMC0xbWIw67ftlpOynNn_0 2024-09-12T17:41:33.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.288+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.539809221677003578', time=2024-09-12T19:32:50.253898+0000, chain.objs.size()=1 2024-09-12T17:41:33.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.288+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.M4SAwKX8tjjjdOUG9C3CLa0fPlCHJAO_0 2024-09-12T17:41:33.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.288+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4020521030676673962', time=2024-09-12T19:32:50.475423+0000, chain.objs.size()=1 2024-09-12T17:41:33.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.288+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.6CUL0pC2GbOwO4rEkh4_16fOO2qYsmk_0 2024-09-12T17:41:33.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.288+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1792998751347705779', time=2024-09-12T19:32:50.502655+0000, chain.objs.size()=1 2024-09-12T17:41:33.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.288+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.QSJ-sDFljiLJIabHeurotzhRgfjkRfM_0 2024-09-12T17:41:33.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.288+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8007121301698436954', time=2024-09-12T19:32:50.578408+0000, chain.objs.size()=1 2024-09-12T17:41:33.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.288+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.JNyNT-AWfcWbVuHlG78V19jjlSFidzT_0 2024-09-12T17:41:33.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.288+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12173781389638566872', time=2024-09-12T19:32:50.592391+0000, chain.objs.size()=1 2024-09-12T17:41:33.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.288+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.XOrJZKl3lB8s45kxGyERY2OAAi9H9jn_0 2024-09-12T17:41:33.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.288+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15056869345574634500', time=2024-09-12T19:32:50.820457+0000, chain.objs.size()=1 2024-09-12T17:41:33.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.288+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.0mhcwytmNTAqz0Iy9c8LkABH_DRq-oW_0 2024-09-12T17:41:33.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.288+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16942692867698748199', time=2024-09-12T19:32:50.843208+0000, chain.objs.size()=1 2024-09-12T17:41:33.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.288+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.rcgl0JYps_9AEQmST9tGEFeKeTpyx7U_0 2024-09-12T17:41:33.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.288+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5461510617443996076', time=2024-09-12T19:32:50.895603+0000, chain.objs.size()=1 2024-09-12T17:41:33.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.288+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.CYtZ4N1O3-sscoWC5T-VgNrwt72HaCK_0 2024-09-12T17:41:33.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.292+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17789270665075180875', time=2024-09-12T19:32:50.921403+0000, chain.objs.size()=1 2024-09-12T17:41:33.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.292+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.d9J0kCmqGlMhcAJzyJoP8wxuXjFcLQ__0 2024-09-12T17:41:33.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.292+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4643383981968365371', time=2024-09-12T19:32:51.026705+0000, chain.objs.size()=1 2024-09-12T17:41:33.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.292+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.a9Rwfp-lvRkratKGVVscIGBgc2CRmH3_0 2024-09-12T17:41:33.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.292+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6369967268124615635', time=2024-09-12T19:32:51.155387+0000, chain.objs.size()=1 2024-09-12T17:41:33.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.292+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.VavDUBdttvkfLGnahz8QLskHF9LPjPB_0 2024-09-12T17:41:33.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.292+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3876538139030680310', time=2024-09-12T19:32:51.157211+0000, chain.objs.size()=1 2024-09-12T17:41:33.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.292+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.DU0dOx-My7eQ2b3BjCnzcHz0XspwI4h_0 2024-09-12T17:41:33.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.292+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9041633527422317399', time=2024-09-12T19:32:51.285915+0000, chain.objs.size()=1 2024-09-12T17:41:33.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.292+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.nxQQWm55HVu85CQKQA5uwfxyGlJWvfK_0 2024-09-12T17:41:33.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.292+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17374184346232753202', time=2024-09-12T19:32:51.287241+0000, chain.objs.size()=1 2024-09-12T17:41:33.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.292+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.dup5FeOY6k1gGbhvFWPhFgR6YvaqKBu_0 2024-09-12T17:41:33.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.292+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14536595722917237107', time=2024-09-12T19:32:51.519304+0000, chain.objs.size()=1 2024-09-12T17:41:33.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.292+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.yKeB1AfGP9Vmz-aEvO0RcDs2IGzXory_0 2024-09-12T17:41:33.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.292+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/57671 2024-09-12T17:41:33.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.296+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=31, truncated=0, next_marker='' 2024-09-12T17:41:33.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.296+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.745367943575746742', time=2024-09-12T19:32:51.575221+0000, chain.objs.size()=1 2024-09-12T17:41:33.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.296+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.KucuZgEvQZ0DTyhkRF4_ztDTeEjW0tM_0 2024-09-12T17:41:33.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.296+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17285627966684484249', time=2024-09-12T19:32:51.652585+0000, chain.objs.size()=1 2024-09-12T17:41:33.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.296+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.DHWIbLQ5cA8GZxF2PR0JgBNACCDXEt-_0 2024-09-12T17:41:33.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.296+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14679600035114239136', time=2024-09-12T19:32:51.678507+0000, chain.objs.size()=1 2024-09-12T17:41:33.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.296+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.f0yz-Ua8JDcTRn2xdSBBjYiMjZiwaUW_0 2024-09-12T17:41:33.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.296+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5951169860191624737', time=2024-09-12T19:32:51.954150+0000, chain.objs.size()=1 2024-09-12T17:41:33.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.296+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.yR9qwz6aX_HJzCDdUZ9794WpIbS87Xg_0 2024-09-12T17:41:33.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.296+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.622139763334089616', time=2024-09-12T19:32:51.972769+0000, chain.objs.size()=1 2024-09-12T17:41:33.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.296+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.O1uKT1kwc4hQBloLhk2Fpz9zQNasQ9x_0 2024-09-12T17:41:33.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.296+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14126897274404161807', time=2024-09-12T19:32:51.982781+0000, chain.objs.size()=1 2024-09-12T17:41:33.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.296+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.426EAXbkkOFnHA27bxjQ-95qrmwf7xC_0 2024-09-12T17:41:33.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.296+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6632548575997864806', time=2024-09-12T19:32:51.995662+0000, chain.objs.size()=1 2024-09-12T17:41:33.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.296+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Y-iuyG5XiVh1h_Nfj-6HYp5ihWu9g67_0 2024-09-12T17:41:33.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.296+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11848076504985981193', time=2024-09-12T19:32:54.832352+0000, chain.objs.size()=1 2024-09-12T17:41:33.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.296+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.333__shadow_.xbHpxueKSn6rkcNUOuzS051GDje1wIq_0 2024-09-12T17:41:33.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.296+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18025759526760316885', time=2024-09-12T19:33:05.484262+0000, chain.objs.size()=1 2024-09-12T17:41:33.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.296+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.370__shadow_.y0CQVp4aqlyL2wssNTg3YY6FLxvnucx_0 2024-09-12T17:41:33.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.296+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3143204639816770581', time=2024-09-12T19:33:29.070734+0000, chain.objs.size()=1 2024-09-12T17:41:33.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.296+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.431__shadow_.BUXS3BRMTiCHJpmBEpHSSz61Va3rdEb_0 2024-09-12T17:41:33.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.296+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8005552425914892891', time=2024-09-12T19:33:44.766181+0000, chain.objs.size()=1 2024-09-12T17:41:33.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.296+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.466__shadow_.CtYE6PoNHWEq8t38zNMlJSMZ3-uFpMm_0 2024-09-12T17:41:33.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.296+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14914468405842443228', time=2024-09-12T19:34:05.505892+0000, chain.objs.size()=1 2024-09-12T17:41:33.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.296+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.518__multipart_mymultipart.2~iCm5p2vz7msVvouOVzJIDzqiw-1-KNy.1 2024-09-12T17:41:33.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.300+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16932833690970919730', time=2024-09-12T19:34:13.673407+0000, chain.objs.size()=6 2024-09-12T17:41:33.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.300+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__multipart_mymultipart.w6FU_vTJ9xYSkz4vBPSGVXNUZKNuWVr0.1 2024-09-12T17:41:33.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.300+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__multipart_mymultipart.2~yppf9Blt80zUleMXAaz0VITaklI2GA_.2 2024-09-12T17:41:33.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.300+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__multipart_mymultipart.2~yppf9Blt80zUleMXAaz0VITaklI2GA_.3 2024-09-12T17:41:33.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.300+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__multipart_mymultipart.2~yppf9Blt80zUleMXAaz0VITaklI2GA_.4 2024-09-12T17:41:33.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.300+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__multipart_mymultipart.2~yppf9Blt80zUleMXAaz0VITaklI2GA_.5 2024-09-12T17:41:33.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.300+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.522__multipart_mymultipart.2~yppf9Blt80zUleMXAaz0VITaklI2GA_.6 2024-09-12T17:41:33.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.300+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7345985782016082470', time=2024-09-12T19:34:21.166326+0000, chain.objs.size()=3 2024-09-12T17:41:33.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.300+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.523__multipart_mymultipart.2~qOq7vIRMcPyUJCOaMUdA1_dGT4KxVFS.1 2024-09-12T17:41:33.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.300+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.523__shadow_mymultipart.2~qOq7vIRMcPyUJCOaMUdA1_dGT4KxVFS.1_1 2024-09-12T17:41:33.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.300+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.523__multipart_mymultipart.2~qOq7vIRMcPyUJCOaMUdA1_dGT4KxVFS.2 2024-09-12T17:41:33.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.300+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12251422657896198220', time=2024-09-12T19:34:24.822229+0000, chain.objs.size()=1 2024-09-12T17:41:33.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.300+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.524__shadow_.uiILDFOvh5ibNoYNwJPhuO6QO1cGPDO_0 2024-09-12T17:41:33.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.300+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~qZAfP61daLrL-1803pWOop1BT2FI_r4', time=2024-09-12T19:34:27.928616+0000, chain.objs.size()=2 2024-09-12T17:41:33.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.300+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.529__multipart_mymultipart.2~qZAfP61daLrL-1803pWOop1BT2FI_r4.1 2024-09-12T17:41:33.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.300+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.529__multipart_mymultipart.2~qZAfP61daLrL-1803pWOop1BT2FI_r4.2 2024-09-12T17:41:33.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.300+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~3P4AOmJiDuMjH07TGGWY3pTmfVwYSL-', time=2024-09-12T19:34:31.318657+0000, chain.objs.size()=1 2024-09-12T17:41:33.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.300+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.535__multipart_mymultipart.2~3P4AOmJiDuMjH07TGGWY3pTmfVwYSL-.3 2024-09-12T17:41:33.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.300+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7746031810849960041', time=2024-09-12T19:35:19.330225+0000, chain.objs.size()=1 2024-09-12T17:41:33.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.300+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.569__shadow:YHd8aoLnuVZJK6FfonuuKeGe2zfetJO_.zn42nATm6MXbaBfBwe8__7zEQZYrkpy_0 2024-09-12T17:41:33.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.300+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.179325386795910485', time=2024-09-12T19:35:24.525863+0000, chain.objs.size()=1 2024-09-12T17:41:33.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.300+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.571__shadow_.wTSTzHjQmopTdsT2XOo3MXhJgxWclfD_0 2024-09-12T17:41:33.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.300+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7790539097046195993', time=2024-09-12T19:35:34.101364+0000, chain.objs.size()=1 2024-09-12T17:41:33.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.300+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.576__shadow:7VQau2fJQpo48-XDpBiHd5FQI5ek2EF_.-xz0IjZCx5KwCo0ISqgEjC3mZDaJ8J5_0 2024-09-12T17:41:33.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.300+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4549407886806509701', time=2024-09-12T19:35:45.594119+0000, chain.objs.size()=1 2024-09-12T17:41:33.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.300+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.577__shadow:TluYThClf3DKCXo-nVLHAM8mk1s1Kje_.HE-zyfYBPdhZmyo7zaJJ0TNnXSD9PE6_0 2024-09-12T17:41:33.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.300+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7041159525986489582', time=2024-09-12T19:35:55.689500+0000, chain.objs.size()=1 2024-09-12T17:41:33.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.300+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.580__shadow:9cx0qT15wcNHqXpzLww1IY7EUW93xsO_.t382k31759m1WVTIZZ-F3kEbGUitOA9_0 2024-09-12T17:41:33.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.304+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14374025151836678218', time=2024-09-12T19:35:59.098374+0000, chain.objs.size()=1 2024-09-12T17:41:33.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.304+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.587__shadow:DYZ2vTqsk6CcZvu6kHGJau5XSxREASZ_.CMlWzStuBjHVHe1oy0OCJJn53BzYNUY_0 2024-09-12T17:41:33.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.304+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15955567290336152807', time=2024-09-12T19:35:59.134616+0000, chain.objs.size()=1 2024-09-12T17:41:33.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.304+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.587__shadow:yXdw1sSJKwB4COezrNc2Sn7LWnLj-6I_.E-piyjMCSv3O_gYJmNv7DWIcPZVbgdM_0 2024-09-12T17:41:33.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.304+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11810377830321410543', time=2024-09-12T19:37:15.562904+0000, chain.objs.size()=1 2024-09-12T17:41:33.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.304+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.617__shadow_.cVE8XSui-dJ6NNdCJg2BoUCaQh3dVBn_0 2024-09-12T17:41:33.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.304+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4652886070173351741', time=2024-09-12T19:38:27.627903+0000, chain.objs.size()=1 2024-09-12T17:41:33.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.304+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.637__shadow_.Jc3g-hiqZyBpVhyhMGTPPOWKiCZ274P_0 2024-09-12T17:41:33.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.304+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6888632629840177751', time=2024-09-12T19:38:28.834963+0000, chain.objs.size()=1 2024-09-12T17:41:33.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.304+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.641__shadow_.qVtXt92X__nfC4hbUAms_391lifIhcI_0 2024-09-12T17:41:33.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.304+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6239016665515997676', time=2024-09-12T19:38:43.302865+0000, chain.objs.size()=1 2024-09-12T17:41:33.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.304+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.665__shadow_.vbeETgS1xFiZcFjcZ14T0c0huxq4hAA_0 2024-09-12T17:41:33.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.304+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13279885931046225260', time=2024-09-12T19:38:53.679789+0000, chain.objs.size()=1 2024-09-12T17:41:33.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.304+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.696__shadow:mHiMj3aIU9ma.VSvFqa421z4ifc.PWq_.Avw0t2IDXZQFXI-cXI-nmCCyFbsTPuK_0 2024-09-12T17:41:33.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.304+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11452141938784639614', time=2024-09-12T19:38:53.812068+0000, chain.objs.size()=1 2024-09-12T17:41:33.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.304+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.696__shadow:6ZjpAuPQe6fRRmJuwNjTZ-vIChrZhg1_.YNntqLQJrEZWZJLkFGblAQQpu-mAvFm_0 2024-09-12T17:41:33.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.304+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12237552854419604374', time=2024-09-12T19:39:32.869755+0000, chain.objs.size()=1 2024-09-12T17:41:33.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.304+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.744__shadow_.Cp4-aIBxntTqTrkrfAh8DsUBDAMxBqt_0 2024-09-12T17:41:33.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.304+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:41:33.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.308+0000 7fd765adf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:41:33.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.308+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:41:33.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.308+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:41:33.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.308+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/53185' 2024-09-12T17:41:33.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.308+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='_TegNr9Q_rhPLz04us_yNUI9jKD_9JAS', time=2024-09-12T19:29:47.115104+0000, chain.objs.size()=3 2024-09-12T17:41:33.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.308+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.161__shadow_.W7gCk1RAoC-okLj1enGnXTa_6ZRzFa7_0 2024-09-12T17:41:33.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.308+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.161__shadow_.W7gCk1RAoC-okLj1enGnXTa_6ZRzFa7_1 2024-09-12T17:41:33.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.308+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.161__shadow_.W7gCk1RAoC-okLj1enGnXTa_6ZRzFa7_2 2024-09-12T17:41:33.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.308+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8643593349911694396', time=2024-09-12T19:31:12.222292+0000, chain.objs.size()=1 2024-09-12T17:41:33.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.308+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.234__shadow_.sAxwN3v655EBC_4d3hY7cULUQom5v2J_0 2024-09-12T17:41:33.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.308+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16230934137297193906', time=2024-09-12T19:31:20.631382+0000, chain.objs.size()=1 2024-09-12T17:41:33.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.308+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.255__shadow_.y-0srb0VYy0wBSBitA16pmQBv4k42rH_0 2024-09-12T17:41:33.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.308+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15606314736794907956', time=2024-09-12T19:31:42.353389+0000, chain.objs.size()=1 2024-09-12T17:41:33.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.308+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.MXmnt4LsNgTfOkCAlSyA8TwBTz12G1N_0 2024-09-12T17:41:33.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.308+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13542934236515517876', time=2024-09-12T19:31:42.376927+0000, chain.objs.size()=1 2024-09-12T17:41:33.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.308+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.tYaIyMCEScfC7r6mDx6fkONmmBfDnnc_0 2024-09-12T17:41:33.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.308+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10471013146914876545', time=2024-09-12T19:31:42.386054+0000, chain.objs.size()=1 2024-09-12T17:41:33.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.308+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.q5juqVMqfvtylmLt4f44GnGBKZepfY8_0 2024-09-12T17:41:33.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.308+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15495013194244813178', time=2024-09-12T19:31:42.472080+0000, chain.objs.size()=1 2024-09-12T17:41:33.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.308+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.65XmFob-S4cHTV41FZYHMK5B2t0KxXI_0 2024-09-12T17:41:33.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.308+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12966520337034781756', time=2024-09-12T19:31:42.545052+0000, chain.objs.size()=1 2024-09-12T17:41:33.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.308+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.pyFJOeCtr307Ss0rD7yyYGStjfJk7GL_0 2024-09-12T17:41:33.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.308+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14508821672204300554', time=2024-09-12T19:31:42.578373+0000, chain.objs.size()=1 2024-09-12T17:41:33.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.308+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.ALR6mPs7fIjdc_vbNqEi_1_CydAxzCO_0 2024-09-12T17:41:33.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.308+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5362098547942624028', time=2024-09-12T19:31:42.634185+0000, chain.objs.size()=1 2024-09-12T17:41:33.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.308+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.42fGpacbvITi685I2sBpNk8E1BP3uOc_0 2024-09-12T17:41:33.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.312+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1923853723613651195', time=2024-09-12T19:31:42.641202+0000, chain.objs.size()=1 2024-09-12T17:41:33.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.312+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.PFMY4ENMgemhZ16Ax1ZFbOoD7WQgCyQ_0 2024-09-12T17:41:33.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.312+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3436589464407185553', time=2024-09-12T19:31:42.650757+0000, chain.objs.size()=1 2024-09-12T17:41:33.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.312+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.dy0SUlxcK4vkkUzvMM1ckjZz4J95i94_0 2024-09-12T17:41:33.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.312+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5383380215155651759', time=2024-09-12T19:31:42.654051+0000, chain.objs.size()=1 2024-09-12T17:41:33.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.312+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.Cec-7bTgK7G0t_r9iita-oo89Ho5Zas_0 2024-09-12T17:41:33.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.312+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14989316738090756460', time=2024-09-12T19:31:42.892736+0000, chain.objs.size()=1 2024-09-12T17:41:33.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.312+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.WN4EhcoAAU_CKA-SfhNgWk1-mcMWKMC_0 2024-09-12T17:41:33.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.312+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14915528242413575465', time=2024-09-12T19:31:43.126942+0000, chain.objs.size()=1 2024-09-12T17:41:33.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.312+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.ROOdodhzOLTRrFD1seBeQ6kbYTuQXfj_0 2024-09-12T17:41:33.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.312+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14541934613056274262', time=2024-09-12T19:31:43.149029+0000, chain.objs.size()=1 2024-09-12T17:41:33.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.312+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.inbtOglcKHrUP4WwUK9i1ewZnWTn2EC_0 2024-09-12T17:41:33.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.312+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9614519839578732304', time=2024-09-12T19:31:43.209838+0000, chain.objs.size()=1 2024-09-12T17:41:33.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.312+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.zU1wZV16ZliC5_CrcM-aIBMfSGWq_VE_0 2024-09-12T17:41:33.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.312+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11889484316663203291', time=2024-09-12T19:31:43.593358+0000, chain.objs.size()=1 2024-09-12T17:41:33.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.312+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.u4dmO00M7SiumTQI_rI5qUG1wG5bxiB_0 2024-09-12T17:41:33.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.312+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8687842317573406272', time=2024-09-12T19:31:43.599099+0000, chain.objs.size()=1 2024-09-12T17:41:33.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.312+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.sbgWFaxLrzcIO2wr1_x7D0l7a0OlnSx_0 2024-09-12T17:41:33.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.312+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.717817348874963457', time=2024-09-12T19:31:43.727884+0000, chain.objs.size()=1 2024-09-12T17:41:33.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.312+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.sgKAPpYlLbwEei0LacmBRubTp6cLiYe_0 2024-09-12T17:41:33.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.312+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13941312333959973113', time=2024-09-12T19:31:43.761027+0000, chain.objs.size()=1 2024-09-12T17:41:33.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.312+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.WdFpFynB6_a1mjdHaDVX9PWsz8HGMlU_0 2024-09-12T17:41:33.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.316+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5842898455813417802', time=2024-09-12T19:31:43.785145+0000, chain.objs.size()=1 2024-09-12T17:41:33.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.316+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.ONlp7iYK2nAOkj9J7ZXBhbGgaNQLm1s_0 2024-09-12T17:41:33.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.316+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12254057503512168288', time=2024-09-12T19:31:43.811247+0000, chain.objs.size()=1 2024-09-12T17:41:33.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.316+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.L5qaNOdNpkZsDarWTjbAD3YsCfyRmjk_0 2024-09-12T17:41:33.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.316+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9085880985391210816', time=2024-09-12T19:31:43.885953+0000, chain.objs.size()=1 2024-09-12T17:41:33.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.316+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.AxGEGKHnC_QwmWTwlmz9wyEKZNS_c95_0 2024-09-12T17:41:33.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.316+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4014746444908213096', time=2024-09-12T19:31:43.907555+0000, chain.objs.size()=1 2024-09-12T17:41:33.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.316+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.YKqfJ_yiD3kDRrwE9WH35zpL1eqfYqI_0 2024-09-12T17:41:33.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.316+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5191233705189443136', time=2024-09-12T19:31:44.081000+0000, chain.objs.size()=1 2024-09-12T17:41:33.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.316+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.umblAoJA85rMBti9d13bUycAn9Ygzz0_0 2024-09-12T17:41:33.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.316+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1842186628599048136', time=2024-09-12T19:31:44.125027+0000, chain.objs.size()=1 2024-09-12T17:41:33.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.316+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.61oBGybi-2IW6srY0ls6LLc0Vh0IS3P_0 2024-09-12T17:41:33.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.316+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5218502313753226638', time=2024-09-12T19:31:44.242123+0000, chain.objs.size()=1 2024-09-12T17:41:33.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.316+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.LQ2pHP7dunHIj4bKPA3yEVQj45HUKp7_0 2024-09-12T17:41:33.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.316+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1029136709964634181', time=2024-09-12T19:31:44.247588+0000, chain.objs.size()=1 2024-09-12T17:41:33.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.316+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.bFm77_-zObyb21fhKNqeQMV9SRUFunD_0 2024-09-12T17:41:33.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.316+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17013458191695527689', time=2024-09-12T19:31:44.370129+0000, chain.objs.size()=1 2024-09-12T17:41:33.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.316+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.wuCI6Zmx6_SoPahXGsLht5YMstinXMv_0 2024-09-12T17:41:33.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.316+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6535532906547164424', time=2024-09-12T19:31:44.380886+0000, chain.objs.size()=1 2024-09-12T17:41:33.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.316+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.7mshpZ-HqB3u4QS_lfh1UtaFAm68psY_0 2024-09-12T17:41:33.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.316+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9598488763728615727', time=2024-09-12T19:31:44.463816+0000, chain.objs.size()=1 2024-09-12T17:41:33.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.316+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.dvDX1z-HZpuhclEaxdMQleMTTpi7uE9_0 2024-09-12T17:41:33.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.316+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11310673020691618925', time=2024-09-12T19:31:44.489208+0000, chain.objs.size()=1 2024-09-12T17:41:33.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.316+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.262__shadow_.LrZKfzL_9NCN_OK5qy829RcS1JJN31-_0 2024-09-12T17:41:33.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.316+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10675851496229128606', time=2024-09-12T19:31:47.662037+0000, chain.objs.size()=1 2024-09-12T17:41:33.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.316+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.271__shadow_.2X7KVTx2zb1mM9m8eP5xD4D_8fISqqu_0 2024-09-12T17:41:33.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.316+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7351433724375623418', time=2024-09-12T19:31:50.628201+0000, chain.objs.size()=1 2024-09-12T17:41:33.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.316+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.279__shadow_.VgIYHIanFXuj1C-KUm5zuEU-HhjgWWO_0 2024-09-12T17:41:33.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.316+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17298340235204320270', time=2024-09-12T19:31:51.446274+0000, chain.objs.size()=1 2024-09-12T17:41:33.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.316+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.281__shadow_.p_Z11pH0rNmpu67yDXpWcNgWY5ctViW_0 2024-09-12T17:41:33.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.316+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17701015431662970177', time=2024-09-12T19:31:51.820117+0000, chain.objs.size()=1 2024-09-12T17:41:33.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.316+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.282__shadow_.4BBKfo22HZS2dgPt2tTpi93oSDwuZc__0 2024-09-12T17:41:33.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.316+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8141632969015954752', time=2024-09-12T19:31:53.005093+0000, chain.objs.size()=1 2024-09-12T17:41:33.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.316+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.285__shadow_.4J5EOXfueodg4Dj0NE2lAxqW2jwM0Uu_0 2024-09-12T17:41:33.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.316+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.470117903459345219', time=2024-09-12T19:31:56.478530+0000, chain.objs.size()=1 2024-09-12T17:41:33.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.316+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.292__shadow_.PVH1jS_Cqtxk-dTnH7frXRWBloNEOOf_0 2024-09-12T17:41:33.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.316+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.291615610637110992', time=2024-09-12T19:31:56.480586+0000, chain.objs.size()=1 2024-09-12T17:41:33.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.316+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.292__shadow_.HLVaOvpj9Z2Z6ExXwkc2oVumF2UMmib_0 2024-09-12T17:41:33.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.316+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7059059191373389520', time=2024-09-12T19:31:57.567612+0000, chain.objs.size()=1 2024-09-12T17:41:33.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.316+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.293__shadow_.8-MXS1ChJniaP9VHjl-5WTcU5FIDwMx_0 2024-09-12T17:41:33.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.316+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7326830393656729447', time=2024-09-12T19:31:57.579606+0000, chain.objs.size()=1 2024-09-12T17:41:33.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.316+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.293__shadow_.f2pxqnTls8Z8rN7HRkUYdG9XectF-67_0 2024-09-12T17:41:33.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.316+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11608393326571841843', time=2024-09-12T19:32:00.384535+0000, chain.objs.size()=1 2024-09-12T17:41:33.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.316+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.300__shadow_.0x7KB91_qu43rWpDooLyjiFq4OiDXKD_0 2024-09-12T17:41:33.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.320+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5432004983428176656', time=2024-09-12T19:32:27.916350+0000, chain.objs.size()=1 2024-09-12T17:41:33.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.320+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.GZgOwXrTRIS2g9Yr0YCtFzj_zASOC-p_0 2024-09-12T17:41:33.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.320+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17569424248996675977', time=2024-09-12T19:32:27.976628+0000, chain.objs.size()=1 2024-09-12T17:41:33.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.320+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.yHR-T_Jkq6ys0NZtM2Jlh3qU4tihnfm_0 2024-09-12T17:41:33.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.320+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.14319489163079353524', time=2024-09-12T19:32:28.016564+0000, chain.objs.size()=1 2024-09-12T17:41:33.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.320+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.5xjavpRR6ywE903DiU-yQydoeRkM5P__0 2024-09-12T17:41:33.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.320+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11163399103928705178', time=2024-09-12T19:32:28.083790+0000, chain.objs.size()=1 2024-09-12T17:41:33.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.320+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.pkM6YDuJWYGHnednfnzGvM7IhNM4Q5x_0 2024-09-12T17:41:33.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.320+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10773181993541273306', time=2024-09-12T19:32:28.152236+0000, chain.objs.size()=1 2024-09-12T17:41:33.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.320+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.MGg00h6jWKe3hiZ7zlgRyDVmY81hAjx_0 2024-09-12T17:41:33.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.320+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18066790327552994403', time=2024-09-12T19:32:28.243740+0000, chain.objs.size()=1 2024-09-12T17:41:33.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.320+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.3zyozLAFc88ZLTiumRz7HZzEUN_sEwQ_0 2024-09-12T17:41:33.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.320+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12656726405646973646', time=2024-09-12T19:32:28.252694+0000, chain.objs.size()=1 2024-09-12T17:41:33.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.320+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.KQq0OD-MILgVVzseOs4y0_wombL-oC3_0 2024-09-12T17:41:33.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.320+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6479608294604335481', time=2024-09-12T19:32:28.263939+0000, chain.objs.size()=1 2024-09-12T17:41:33.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.320+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.X83JL5ZdeRjz_7B198FRLJroTI7Tmmb_0 2024-09-12T17:41:33.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.320+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11731348361935864187', time=2024-09-12T19:32:28.275068+0000, chain.objs.size()=1 2024-09-12T17:41:33.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.320+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.hBL6QPNkOPUBD6t-zaczPNEFZDXyo1j_0 2024-09-12T17:41:33.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.320+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17820423575821082482', time=2024-09-12T19:32:28.279197+0000, chain.objs.size()=1 2024-09-12T17:41:33.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.320+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.bH-HV005mK0lou9eaiLUJ2twmOR_xRm_0 2024-09-12T17:41:33.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.320+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13707979748180799194', time=2024-09-12T19:32:28.304061+0000, chain.objs.size()=1 2024-09-12T17:41:33.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.320+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.oqtrQf_mhv6I7bWmcmJ5LxafvACoAgk_0 2024-09-12T17:41:33.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.320+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1311355206513919155', time=2024-09-12T19:32:28.323300+0000, chain.objs.size()=1 2024-09-12T17:41:33.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.320+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.vl9fpP2gGDurFCTWF7jW5aTkzlqBgi1_0 2024-09-12T17:41:33.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.320+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5703475669709614990', time=2024-09-12T19:32:28.330048+0000, chain.objs.size()=1 2024-09-12T17:41:33.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.320+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.6gB1jUSMKlw9mr2ScV5KaKHCE_FVYkU_0 2024-09-12T17:41:33.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.324+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7077344867819232561', time=2024-09-12T19:32:28.516130+0000, chain.objs.size()=1 2024-09-12T17:41:33.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.324+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.iaK8ulY4BNZehLx773voxp3c4pk227u_0 2024-09-12T17:41:33.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.324+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4185074483415642131', time=2024-09-12T19:32:28.706839+0000, chain.objs.size()=1 2024-09-12T17:41:33.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.324+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.GCez8AKH_odaqiLkRloqyyYwKM3t56L_0 2024-09-12T17:41:33.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.324+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17396488953811613371', time=2024-09-12T19:32:28.718416+0000, chain.objs.size()=1 2024-09-12T17:41:33.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.324+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.S9Jt8nK4RmmwSlKSy5UzgM9l7fkrV7r_0 2024-09-12T17:41:33.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.324+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12711155236279194093', time=2024-09-12T19:32:28.813660+0000, chain.objs.size()=1 2024-09-12T17:41:33.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.324+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.mxRwDQOxH2sEIF2f4V2nquQmAD9pqje_0 2024-09-12T17:41:33.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.324+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12267068014747433302', time=2024-09-12T19:32:28.823003+0000, chain.objs.size()=1 2024-09-12T17:41:33.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.324+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.bo0tPRb0DTvMBD4v90Khjkri8zapLjI_0 2024-09-12T17:41:33.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.324+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8828557125849819228', time=2024-09-12T19:32:28.826504+0000, chain.objs.size()=1 2024-09-12T17:41:33.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.324+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.iEGlmeHusnVmyXNyui5hFqx9Oc3qTrR_0 2024-09-12T17:41:33.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.324+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18098697285837990606', time=2024-09-12T19:32:28.859769+0000, chain.objs.size()=1 2024-09-12T17:41:33.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.324+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.1o5r2JS0EiLsRYdf02WTq4EfXLXsFNn_0 2024-09-12T17:41:33.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.324+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9635649244714624623', time=2024-09-12T19:32:28.894321+0000, chain.objs.size()=1 2024-09-12T17:41:33.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.324+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.iKcXcxBk73Nrwk2yNCbmsqPcCFTlf6a_0 2024-09-12T17:41:33.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.324+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9796739238787782256', time=2024-09-12T19:32:29.015498+0000, chain.objs.size()=1 2024-09-12T17:41:33.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.324+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.oBuy3whCBC26nXrXJP1UVoZSWm20Nk7_0 2024-09-12T17:41:33.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.324+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7559136779164332855', time=2024-09-12T19:32:29.094171+0000, chain.objs.size()=1 2024-09-12T17:41:33.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.324+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.o89xE5GtCI_fm1BnJkjzhfFqi9Nw4Tk_0 2024-09-12T17:41:33.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.324+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13772572062797556375', time=2024-09-12T19:32:29.174937+0000, chain.objs.size()=1 2024-09-12T17:41:33.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.324+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.CKYqbV3esXz0sZhQWQnJHHR2JQ0HwOe_0 2024-09-12T17:41:33.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.324+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1046554182042302052', time=2024-09-12T19:32:29.178170+0000, chain.objs.size()=1 2024-09-12T17:41:33.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.324+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.VdzAuhIjwfORanH4Kn2lIR6LFEBIMTp_0 2024-09-12T17:41:33.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.324+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15181553726546067685', time=2024-09-12T19:32:29.203815+0000, chain.objs.size()=1 2024-09-12T17:41:33.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.324+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.UnsuZAKu5wWyda0kDqf7J20Q6amRYPJ_0 2024-09-12T17:41:33.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.324+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16912274676987880994', time=2024-09-12T19:32:29.389825+0000, chain.objs.size()=1 2024-09-12T17:41:33.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.324+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.PqASZvfocrw9VJevZawagrBkaTpHMqA_0 2024-09-12T17:41:33.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7850435564764595045', time=2024-09-12T19:32:29.392769+0000, chain.objs.size()=1 2024-09-12T17:41:33.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.jnZW_nf0d3av9mxrOTtWFi5jwzWbyQ5_0 2024-09-12T17:41:33.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16176099787711915304', time=2024-09-12T19:32:29.400261+0000, chain.objs.size()=1 2024-09-12T17:41:33.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Zq0XBJhL3ED-Ph-iu__nQYKTsLfybAP_0 2024-09-12T17:41:33.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1499871594599160818', time=2024-09-12T19:32:29.427792+0000, chain.objs.size()=1 2024-09-12T17:41:33.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.Of2_UIquCyEi62uBPcCFNzN-DA-rdwn_0 2024-09-12T17:41:33.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4554512302108552439', time=2024-09-12T19:32:29.435071+0000, chain.objs.size()=1 2024-09-12T17:41:33.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.t_bmDtkDAnrA9IajUmY24s_VOzqquE6_0 2024-09-12T17:41:33.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1455073551874075031', time=2024-09-12T19:32:29.481525+0000, chain.objs.size()=1 2024-09-12T17:41:33.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.dZXf3J807DOGbyxhnKL0v4A0dCZIDFL_0 2024-09-12T17:41:33.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2573308331196277403', time=2024-09-12T19:32:29.546721+0000, chain.objs.size()=1 2024-09-12T17:41:33.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.hhHaL4i2ii0ZkhfIY5LzxeBZsi6cyOu_0 2024-09-12T17:41:33.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13039138447112510980', time=2024-09-12T19:32:29.668750+0000, chain.objs.size()=1 2024-09-12T17:41:33.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.hd8Z6R-1mnE-vDxKl9A6d3L8DWXZP___0 2024-09-12T17:41:33.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8216176781405014872', time=2024-09-12T19:32:29.708575+0000, chain.objs.size()=1 2024-09-12T17:41:33.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.dop_GTcP4N3jsDZw15hvC2d5LyUNK-Z_0 2024-09-12T17:41:33.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15596281331207810338', time=2024-09-12T19:32:29.718350+0000, chain.objs.size()=1 2024-09-12T17:41:33.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.gS6bnjGcC95rKnPLmrSbyNiAmX8wVyS_0 2024-09-12T17:41:33.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12188982007735953854', time=2024-09-12T19:32:29.725921+0000, chain.objs.size()=1 2024-09-12T17:41:33.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.zgAPS2SOIwupfeTYr1GEEfZep5RkT7G_0 2024-09-12T17:41:33.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2684966519884120962', time=2024-09-12T19:32:29.855027+0000, chain.objs.size()=1 2024-09-12T17:41:33.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.1PTOGIkyL1nSNVi8HPVO9FKKxCL1C0I_0 2024-09-12T17:41:33.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8752054973437543518', time=2024-09-12T19:32:29.993970+0000, chain.objs.size()=1 2024-09-12T17:41:33.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.wbrdthn7kEzcDxdxNrINU0cLDslHfOh_0 2024-09-12T17:41:33.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9813819055074190419', time=2024-09-12T19:32:30.106049+0000, chain.objs.size()=1 2024-09-12T17:41:33.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.-2mE8uNEEd1ufMfRcewJnQmqwydP6Vl_0 2024-09-12T17:41:33.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12806943164688343980', time=2024-09-12T19:32:30.121816+0000, chain.objs.size()=1 2024-09-12T17:41:33.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.323__shadow_.-8IvAN9dAFBmS6X2XgJr85qOrEPpR9p_0 2024-09-12T17:41:33.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13396709646456519384', time=2024-09-12T19:32:49.512487+0000, chain.objs.size()=1 2024-09-12T17:41:33.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.dkqg_S8eIujI340XxbuMWxkF91aD8a__0 2024-09-12T17:41:33.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7777893733902973187', time=2024-09-12T19:32:49.679981+0000, chain.objs.size()=1 2024-09-12T17:41:33.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.3-qTMosKzF85jW6vcV8Ix0QiuQjRTcP_0 2024-09-12T17:41:33.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5856603485875237058', time=2024-09-12T19:32:49.768471+0000, chain.objs.size()=1 2024-09-12T17:41:33.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.pWqqHylMT2njHQtxe36fH5rUbjLOl04_0 2024-09-12T17:41:33.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17204313620094324582', time=2024-09-12T19:32:49.837281+0000, chain.objs.size()=1 2024-09-12T17:41:33.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.5uXes5zcLgJbXJL5jrHnnfldLO2AsY8_0 2024-09-12T17:41:33.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6202721824782639874', time=2024-09-12T19:32:49.962948+0000, chain.objs.size()=1 2024-09-12T17:41:33.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.Y71qemv3ar0s33tumqOFOB59NtleVwh_0 2024-09-12T17:41:33.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12373827705509170934', time=2024-09-12T19:32:50.174326+0000, chain.objs.size()=1 2024-09-12T17:41:33.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.XJfU-3_gD8KZw4kg4-sA1_KVUIdNBag_0 2024-09-12T17:41:33.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9226980161888753943', time=2024-09-12T19:32:50.288713+0000, chain.objs.size()=1 2024-09-12T17:41:33.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.qzTgjtrIlWvlMaHAarSHACYWaOupbXd_0 2024-09-12T17:41:33.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.1205726614978346112', time=2024-09-12T19:32:50.304333+0000, chain.objs.size()=1 2024-09-12T17:41:33.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.D0i3xpzxWQ2tsyQwvQBxz-8zKsM0whJ_0 2024-09-12T17:41:33.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15676208686712810036', time=2024-09-12T19:32:50.323081+0000, chain.objs.size()=1 2024-09-12T17:41:33.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.0Mb9pcaa24_PF7Hb3y6ImYwybfV7T4i_0 2024-09-12T17:41:33.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2824863201355405449', time=2024-09-12T19:32:50.524158+0000, chain.objs.size()=1 2024-09-12T17:41:33.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.328+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.bgUza48FUX-9ccADRaJn8Fh-s6X4NMU_0 2024-09-12T17:41:33.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.332+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2484532217254140231', time=2024-09-12T19:32:50.587933+0000, chain.objs.size()=1 2024-09-12T17:41:33.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.332+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.pGFztcKkDzgfc2F5UCV5PAqh7dU9BHB_0 2024-09-12T17:41:33.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.332+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17848887970619692645', time=2024-09-12T19:32:50.634758+0000, chain.objs.size()=1 2024-09-12T17:41:33.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.332+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.E24AUWsL9FVFqbl9iNoKj3kTKKaRCoi_0 2024-09-12T17:41:33.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.332+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9128366904573419275', time=2024-09-12T19:32:50.671614+0000, chain.objs.size()=1 2024-09-12T17:41:33.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.332+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.LHC9Ao_fDgOv25maL7V8O-QmTHybqTh_0 2024-09-12T17:41:33.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.332+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5780937563696908607', time=2024-09-12T19:32:50.819593+0000, chain.objs.size()=1 2024-09-12T17:41:33.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.332+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.udYo3Og0ml5fjRFQ4nthNBYb8Jc0mRm_0 2024-09-12T17:41:33.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.332+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.372077904210002502', time=2024-09-12T19:32:50.855432+0000, chain.objs.size()=1 2024-09-12T17:41:33.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.332+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.RIUN08tcYHqZlnoGO9NN3Cuzk-pVxBZ_0 2024-09-12T17:41:33.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.332+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.7952608160198431727', time=2024-09-12T19:32:50.956229+0000, chain.objs.size()=1 2024-09-12T17:41:33.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.332+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.GFo8NuHgV19MpJ6x9RVKKZt-GkDhPkG_0 2024-09-12T17:41:33.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.332+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/53185 2024-09-12T17:41:33.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.336+0000 7fd765adf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=41, truncated=0, next_marker='' 2024-09-12T17:41:33.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.336+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13212154331547073317', time=2024-09-12T19:32:51.282069+0000, chain.objs.size()=1 2024-09-12T17:41:33.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.336+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.-7utqxEP_IIzLpeVgHOABAx66Yr-ac8_0 2024-09-12T17:41:33.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.336+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16280977784889122175', time=2024-09-12T19:32:51.283868+0000, chain.objs.size()=1 2024-09-12T17:41:33.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.336+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.0G2CklKQ4BmsYDDbayHL3AxV57rZ35v_0 2024-09-12T17:41:33.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.336+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6319749806141022452', time=2024-09-12T19:32:51.332264+0000, chain.objs.size()=1 2024-09-12T17:41:33.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.336+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.TMXeSXdmszyHtkN76Rq0638pjJdimFP_0 2024-09-12T17:41:33.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.336+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10374908213078839804', time=2024-09-12T19:32:51.514365+0000, chain.objs.size()=1 2024-09-12T17:41:33.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.336+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.LMlg0-W_cdczHQ9DCcb2VKw6jRJ2vx-_0 2024-09-12T17:41:33.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.336+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2632095243413056362', time=2024-09-12T19:32:51.554871+0000, chain.objs.size()=1 2024-09-12T17:41:33.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.336+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.ybcSjRNZ_CsVx1ZDb9Gwrl1Yq4Mswgw_0 2024-09-12T17:41:33.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.336+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13527025415718690136', time=2024-09-12T19:32:51.567627+0000, chain.objs.size()=1 2024-09-12T17:41:33.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.336+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.TCUmeLaobo39bRIy9toGmGcXteA7Qyk_0 2024-09-12T17:41:33.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.336+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6908385442088103527', time=2024-09-12T19:32:51.592480+0000, chain.objs.size()=1 2024-09-12T17:41:33.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.336+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.U71Oq7D5u0EmZANng1JHV6jO5lQQUeJ_0 2024-09-12T17:41:33.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.336+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11873094863789956009', time=2024-09-12T19:32:51.642171+0000, chain.objs.size()=1 2024-09-12T17:41:33.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.336+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.pVU1lWaxhAZ40mNty873lZEc0Z_xF2n_0 2024-09-12T17:41:33.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.336+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5462458094643910094', time=2024-09-12T19:32:51.665353+0000, chain.objs.size()=1 2024-09-12T17:41:33.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.336+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.qB9TE9yQgfQmO9ehJJES84v4DVxOh6-_0 2024-09-12T17:41:33.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.336+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5780380912251953318', time=2024-09-12T19:32:51.718688+0000, chain.objs.size()=1 2024-09-12T17:41:33.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.336+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.7UOIrQr2Js5kynJDOy4bfRWXsRnUmXF_0 2024-09-12T17:41:33.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.336+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15175831702998694447', time=2024-09-12T19:32:51.873904+0000, chain.objs.size()=1 2024-09-12T17:41:33.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.336+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.ZH3W08LnckCpBxRICe_MVQMGZVEUDDs_0 2024-09-12T17:41:33.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.336+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6288411286930968055', time=2024-09-12T19:32:51.875574+0000, chain.objs.size()=1 2024-09-12T17:41:33.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.336+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.bgCw2ZLMu-HCNo_rTocXSmB8pPXPG-0_0 2024-09-12T17:41:33.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.336+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10752819727107237071', time=2024-09-12T19:32:51.914092+0000, chain.objs.size()=1 2024-09-12T17:41:33.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.336+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.6KjSHYekSJeXlB5lN1vSXpe18p67XIu_0 2024-09-12T17:41:33.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.340+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16904036938264684216', time=2024-09-12T19:32:51.965391+0000, chain.objs.size()=1 2024-09-12T17:41:33.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.340+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.VaT4-ctEQXd_piKxJyOrzMlJM_jCU-l_0 2024-09-12T17:41:33.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.340+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.15192182634008799009', time=2024-09-12T19:32:51.995405+0000, chain.objs.size()=1 2024-09-12T17:41:33.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.340+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.324__shadow_.BI5rkd5jjra2pLWcbmeZEpz3oROhfTz_0 2024-09-12T17:41:33.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.340+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.5490581221555515409', time=2024-09-12T19:32:56.039250+0000, chain.objs.size()=1 2024-09-12T17:41:33.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.340+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.336__shadow_.1zQGu23EseqTdM44Or_4jCH_Fe7pGIl_0 2024-09-12T17:41:33.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.340+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.18076718198525313436', time=2024-09-12T19:33:36.922661+0000, chain.objs.size()=1 2024-09-12T17:41:33.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.340+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.451__shadow_.XtRaAgq4Safas4bs9065-YnlXHekm66_0 2024-09-12T17:41:33.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.340+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10811638396560731800', time=2024-09-12T19:33:40.811692+0000, chain.objs.size()=1 2024-09-12T17:41:33.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.340+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.459__shadow_.PnZNRtoXIAlXVZ5ujS7B_pQf0fil8S4_0 2024-09-12T17:41:33.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.340+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12456139246082248828', time=2024-09-12T19:33:41.373277+0000, chain.objs.size()=1 2024-09-12T17:41:33.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.340+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.460__shadow_.xdncNR4cc5OrP8HvFxi_L2tbXpKvbpF_0 2024-09-12T17:41:33.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.340+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9734001928619942758', time=2024-09-12T19:33:49.262567+0000, chain.objs.size()=1 2024-09-12T17:41:33.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.340+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.483__shadow_.5-26-LDX6_m0fjLv5SFEhUt4odeqxAO_0 2024-09-12T17:41:33.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.340+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16689660942432961817', time=2024-09-12T19:33:54.397135+0000, chain.objs.size()=1 2024-09-12T17:41:33.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.340+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.496__shadow_.mH3ExzquKA50T1_O-2b9TiKhR4LxAe8_0 2024-09-12T17:41:33.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.340+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8703768616876420979', time=2024-09-12T19:33:57.456286+0000, chain.objs.size()=1 2024-09-12T17:41:33.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.340+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.503__shadow:5PZwxWS6kVU04L4agSYet4YqDKg.iTJ_.vEQTiH10KZ8H36ScYyTe7asHZOEv9fv_0 2024-09-12T17:41:33.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.340+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13209820642804663769', time=2024-09-12T19:34:00.287520+0000, chain.objs.size()=6 2024-09-12T17:41:33.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.340+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.507__multipart_srcmultipart.2~PH2AaCAKTBRXF-9QaLILt69t4ifQcL6.1 2024-09-12T17:41:33.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.340+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.507__multipart_srcmultipart.2~PH2AaCAKTBRXF-9QaLILt69t4ifQcL6.2 2024-09-12T17:41:33.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.340+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.507__multipart_srcmultipart.2~PH2AaCAKTBRXF-9QaLILt69t4ifQcL6.3 2024-09-12T17:41:33.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.340+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.507__multipart_srcmultipart.2~PH2AaCAKTBRXF-9QaLILt69t4ifQcL6.4 2024-09-12T17:41:33.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.340+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.507__multipart_srcmultipart.2~PH2AaCAKTBRXF-9QaLILt69t4ifQcL6.5 2024-09-12T17:41:33.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.340+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.507__multipart_srcmultipart.2~PH2AaCAKTBRXF-9QaLILt69t4ifQcL6.6 2024-09-12T17:41:33.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.340+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3795940303819214058', time=2024-09-12T19:34:02.156782+0000, chain.objs.size()=1 2024-09-12T17:41:33.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.340+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.513__multipart_mymultipart.2~baGV7zQQeH555r2XJGSfH_6Cap2tro8.1 2024-09-12T17:41:33.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.340+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.6091982856483749759', time=2024-09-12T19:34:21.999996+0000, chain.objs.size()=2 2024-09-12T17:41:33.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.340+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.523__multipart_mymultipart.2~nXMuKJ20pQQ6zdYrCW98M-eszQa5DFM.1 2024-09-12T17:41:33.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.340+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.523__multipart_mymultipart.2~nXMuKJ20pQQ6zdYrCW98M-eszQa5DFM.2 2024-09-12T17:41:33.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.340+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.17757897218917758886', time=2024-09-12T19:35:07.443297+0000, chain.objs.size()=1 2024-09-12T17:41:33.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.340+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.560__shadow_.6JlzWXio991ZoPKF7hbDuUCHPPHwOII_0 2024-09-12T17:41:33.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.340+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.12205451654718634321', time=2024-09-12T19:35:08.102562+0000, chain.objs.size()=1 2024-09-12T17:41:33.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.340+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.561__multipart_mymultipart.KALebpbkXYHJcZnJZwZOtxXPQFLf7yVe.1 2024-09-12T17:41:33.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.340+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.4982294577057408758', time=2024-09-12T19:35:22.129783+0000, chain.objs.size()=1 2024-09-12T17:41:33.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.340+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.569__shadow:wSPZlmVcZJkWvqSd7fDfXMldXVVQyBE_.KYoIGisMg9SsujGfGcMLtkEM9FSNceJ_0 2024-09-12T17:41:33.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.340+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.2490624817774700861', time=2024-09-12T19:35:29.124708+0000, chain.objs.size()=1 2024-09-12T17:41:33.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.340+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.574__shadow:bV4iikmx3IZhvLt92oUqMYJbFAOJFb8_.5v4LenRNof3lg_e7YHc0vRqeVRq8MEC_0 2024-09-12T17:41:33.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.340+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16674372225276974157', time=2024-09-12T19:35:31.828872+0000, chain.objs.size()=1 2024-09-12T17:41:33.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.340+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.576__shadow:0hLVFnN05rwaLM6yUk48d64QVyuA6nw_.yEPHP4cPbwn9xk_0xQlx9BMu-uZ7-se_0 2024-09-12T17:41:33.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.344+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.811904837032799883', time=2024-09-12T19:35:35.962117+0000, chain.objs.size()=1 2024-09-12T17:41:33.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.344+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.577__shadow:ZRnOKpU7B3umCw7wBqbuQ8YO5VcQ0Z6_.mfTfXVeV5SeD3LzYGgCcjsovK5oilho_0 2024-09-12T17:41:33.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.344+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.13450740074952166112', time=2024-09-12T19:35:43.973160+0000, chain.objs.size()=1 2024-09-12T17:41:33.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.344+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.577__shadow:jX5d7OxJeKRk-27jLP.2OD7e3oMljD2_.t1-N6uy2VW6KMruZ32axOEKA72ZTzCg_0 2024-09-12T17:41:33.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.344+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16617927100026813009', time=2024-09-12T19:35:52.766476+0000, chain.objs.size()=4 2024-09-12T17:41:33.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.344+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.578__multipart_testobj.2~Ih27uOdnEXo0figJ1A6q5ULqXWBESoC.1 2024-09-12T17:41:33.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.344+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.578__multipart_testobj.2~Ih27uOdnEXo0figJ1A6q5ULqXWBESoC.2 2024-09-12T17:41:33.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.344+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.578__multipart_testobj.2~Ih27uOdnEXo0figJ1A6q5ULqXWBESoC.3 2024-09-12T17:41:33.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.344+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.578__multipart_testobj.2~Ih27uOdnEXo0figJ1A6q5ULqXWBESoC.4 2024-09-12T17:41:33.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.344+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.10408093752331127630', time=2024-09-12T19:35:54.145161+0000, chain.objs.size()=1 2024-09-12T17:41:33.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.344+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.579__shadow:TsfQIERgjxilAmCjB5--ak0u2RuUy21_.iW-FhEEN1V8lROYuoZOemCu4F_tOf8s_0 2024-09-12T17:41:33.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.344+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.962208711577546615', time=2024-09-12T19:35:55.689071+0000, chain.objs.size()=1 2024-09-12T17:41:33.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.344+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.580__shadow:poCnLVLzAbdV6gjPIQFyco37HLje8y9_.n23XEbNh5XDaH_EAtK2tTLLFrN38shm_0 2024-09-12T17:41:33.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.344+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.3080603210592611011', time=2024-09-12T19:35:56.652772+0000, chain.objs.size()=1 2024-09-12T17:41:33.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.344+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.583__shadow:KUTBphNuytJExp6p9y4TuwNarBwvqS9_.GyYIIOOIad5thYJpC-qzIC3gnkghNm-_0 2024-09-12T17:41:33.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.344+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8055621177787116730', time=2024-09-12T19:38:35.670675+0000, chain.objs.size()=1 2024-09-12T17:41:33.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.344+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.654__shadow_.mbquu6uVIbr6qrW5BX3XguwS-tyMXzo_0 2024-09-12T17:41:33.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.344+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.8071490969910711648', time=2024-09-12T19:38:48.074560+0000, chain.objs.size()=1 2024-09-12T17:41:33.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.344+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.679__shadow_.XeSOKDyLTl7_LBU46miHCJAbU_0sqwc_0 2024-09-12T17:41:33.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.344+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.11603879302094354671', time=2024-09-12T19:38:51.797203+0000, chain.objs.size()=1 2024-09-12T17:41:33.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.344+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.691__shadow_.ySm3dWMBxDgvM29SEQPlkbRfKnNCIlh_0 2024-09-12T17:41:33.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.344+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.9777012632487884439', time=2024-09-12T19:38:52.530138+0000, chain.objs.size()=1 2024-09-12T17:41:33.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.344+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.693__shadow:RGtTj1nQZF0iKzJeieZlfeV9vwkDw-g_.MQhTejwhDstc03z34Up7BX_Xt-FXx_Q_0 2024-09-12T17:41:33.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.344+0000 7fd765adf9c0 20 garbage collection: RGWGC::process iterating over entry tag='4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.16082967069665531284', time=2024-09-12T19:39:26.902954+0000, chain.objs.size()=1 2024-09-12T17:41:33.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.344+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4327bd0c-d98b-4f4e-a078-83290070ac8d.4608.734__shadow_.pufFrJMJ_j-hBerSJKgwIqlnej6wCwt_0 2024-09-12T17:41:33.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.348+0000 7fd765adf9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:41:33.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.352+0000 7fd619fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:41:33.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.352+0000 7fd765adf9c0 20 remove_watcher() i=0 2024-09-12T17:41:33.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.352+0000 7fd765adf9c0 2 removed watcher, disabling cache 2024-09-12T17:41:33.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.352+0000 7fd765adf9c0 20 remove_watcher() i=1 2024-09-12T17:41:33.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.352+0000 7fd765adf9c0 20 remove_watcher() i=2 2024-09-12T17:41:33.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.356+0000 7fd765adf9c0 20 remove_watcher() i=3 2024-09-12T17:41:33.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.356+0000 7fd765adf9c0 20 remove_watcher() i=4 2024-09-12T17:41:33.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.356+0000 7fd765adf9c0 20 remove_watcher() i=5 2024-09-12T17:41:33.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.356+0000 7fd765adf9c0 20 remove_watcher() i=6 2024-09-12T17:41:33.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-12T17:41:33.360+0000 7fd765adf9c0 20 remove_watcher() i=7 2024-09-12T17:41:33.426 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-09-12T17:41:33.440 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T17:41:33.453 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T17:41:33.453 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:41:33.803 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:41:33.816 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-09-12T17:41:33.821 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":1563,"stamp":"2024-09-12T17:41:31.772260+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":651325842,"num_objects":4846,"num_object_clones":0,"num_object_copies":9692,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4846,"num_whiteouts":0,"num_read":176826,"num_read_kb":2438071,"num_write":139204,"num_write_kb":2379850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1087,"num_keys_recovered":0,"num_objects_omap":62,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14149,"ondisk_log_size":14149,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2604376,"kb_used_data":1331992,"kb_used_omap":12,"kb_used_meta":1272243,"kb_avail":752370344,"statfs":{"total":773094113280,"available":770427232256,"internally_reserved":0,"allocated":1363959808,"data_stored":1318738366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1302777393},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-823,"num_objects":-5,"num_object_clones":0,"num_object_copies":-10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-5,"num_whiteouts":0,"num_read":189,"num_read_kb":176,"num_write":101,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008297"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:17.322563+0000","last_change":"2024-09-12T17:27:17.404693+0000","last_active":"2024-09-12T17:37:17.322563+0000","last_peered":"2024-09-12T17:37:17.322563+0000","last_clean":"2024-09-12T17:37:17.322563+0000","last_became_active":"2024-09-12T17:27:17.403833+0000","last_became_peered":"2024-09-12T17:27:17.403833+0000","last_unstale":"2024-09-12T17:37:17.322563+0000","last_undegraded":"2024-09-12T17:37:17.322563+0000","last_fullsized":"2024-09-12T17:37:17.322563+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:43.551735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"265'4","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:12.334840+0000","last_change":"2024-09-12T17:15:43.159517+0000","last_active":"2024-09-12T17:38:12.334840+0000","last_peered":"2024-09-12T17:38:12.334840+0000","last_clean":"2024-09-12T17:38:12.334840+0000","last_became_active":"2024-09-12T17:15:43.158714+0000","last_became_peered":"2024-09-12T17:15:43.158714+0000","last_unstale":"2024-09-12T17:38:12.334840+0000","last_undegraded":"2024-09-12T17:38:12.334840+0000","last_fullsized":"2024-09-12T17:38:12.334840+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:19.068813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"262'2","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:12.353310+0000","last_change":"2024-09-12T17:15:40.126960+0000","last_active":"2024-09-12T17:38:12.353310+0000","last_peered":"2024-09-12T17:38:12.353310+0000","last_clean":"2024-09-12T17:38:12.353310+0000","last_became_active":"2024-09-12T17:15:40.126170+0000","last_became_peered":"2024-09-12T17:15:40.126170+0000","last_unstale":"2024-09-12T17:38:12.353310+0000","last_undegraded":"2024-09-12T17:38:12.353310+0000","last_fullsized":"2024-09-12T17:38:12.353310+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:57.038622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"265'24","reported_seq":111,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:57.361076+0000","last_change":"2024-09-12T17:13:54.846274+0000","last_active":"2024-09-12T17:38:57.361076+0000","last_peered":"2024-09-12T17:38:57.361076+0000","last_clean":"2024-09-12T17:38:57.361076+0000","last_became_active":"2024-09-12T17:13:54.845556+0000","last_became_peered":"2024-09-12T17:13:54.845556+0000","last_unstale":"2024-09-12T17:38:57.361076+0000","last_undegraded":"2024-09-12T17:38:57.361076+0000","last_fullsized":"2024-09-12T17:38:57.361076+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:34.627718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":82,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:20.262014+0000","last_change":"2024-09-12T17:27:17.422429+0000","last_active":"2024-09-12T17:37:20.262014+0000","last_peered":"2024-09-12T17:37:20.262014+0000","last_clean":"2024-09-12T17:37:20.262014+0000","last_became_active":"2024-09-12T17:27:17.421771+0000","last_became_peered":"2024-09-12T17:27:17.421771+0000","last_unstale":"2024-09-12T17:37:20.262014+0000","last_undegraded":"2024-09-12T17:37:20.262014+0000","last_fullsized":"2024-09-12T17:37:20.262014+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:44.139866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:16.281883+0000","last_change":"2024-09-12T17:15:43.160447+0000","last_active":"2024-09-12T17:38:16.281883+0000","last_peered":"2024-09-12T17:38:16.281883+0000","last_clean":"2024-09-12T17:38:16.281883+0000","last_became_active":"2024-09-12T17:15:43.159316+0000","last_became_peered":"2024-09-12T17:15:43.159316+0000","last_unstale":"2024-09-12T17:38:16.281883+0000","last_undegraded":"2024-09-12T17:38:16.281883+0000","last_fullsized":"2024-09-12T17:38:16.281883+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:44.109670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"265'6","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:13.696097+0000","last_change":"2024-09-12T17:15:40.126819+0000","last_active":"2024-09-12T17:38:13.696097+0000","last_peered":"2024-09-12T17:38:13.696097+0000","last_clean":"2024-09-12T17:38:13.696097+0000","last_became_active":"2024-09-12T17:15:40.126087+0000","last_became_peered":"2024-09-12T17:15:40.126087+0000","last_unstale":"2024-09-12T17:38:13.696097+0000","last_undegraded":"2024-09-12T17:38:13.696097+0000","last_fullsized":"2024-09-12T17:38:13.696097+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:09.968319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":1026,"num_write":11,"num_write_kb":5122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"265'36","reported_seq":144,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:19.460209+0000","last_change":"2024-09-12T17:13:54.838770+0000","last_active":"2024-09-12T17:38:19.460209+0000","last_peered":"2024-09-12T17:38:19.460209+0000","last_clean":"2024-09-12T17:38:19.460209+0000","last_became_active":"2024-09-12T17:13:54.837820+0000","last_became_peered":"2024-09-12T17:13:54.837820+0000","last_unstale":"2024-09-12T17:38:19.460209+0000","last_undegraded":"2024-09-12T17:38:19.460209+0000","last_fullsized":"2024-09-12T17:38:19.460209+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:56:27.573050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":180,"num_read_kb":123,"num_write":74,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:36:56.280248+0000","last_change":"2024-09-12T17:27:17.406442+0000","last_active":"2024-09-12T17:36:56.280248+0000","last_peered":"2024-09-12T17:36:56.280248+0000","last_clean":"2024-09-12T17:36:56.280248+0000","last_became_active":"2024-09-12T17:27:17.405657+0000","last_became_peered":"2024-09-12T17:27:17.405657+0000","last_unstale":"2024-09-12T17:36:56.280248+0000","last_undegraded":"2024-09-12T17:36:56.280248+0000","last_fullsized":"2024-09-12T17:36:56.280248+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:12.985689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:37.355505+0000","last_change":"2024-09-12T17:15:43.869720+0000","last_active":"2024-09-12T17:38:37.355505+0000","last_peered":"2024-09-12T17:38:37.355505+0000","last_clean":"2024-09-12T17:38:37.355505+0000","last_became_active":"2024-09-12T17:15:43.868960+0000","last_became_peered":"2024-09-12T17:15:43.868960+0000","last_unstale":"2024-09-12T17:38:37.355505+0000","last_undegraded":"2024-09-12T17:38:37.355505+0000","last_fullsized":"2024-09-12T17:38:37.355505+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:01.285114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"262'2","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:45.267370+0000","last_change":"2024-09-12T17:15:40.135488+0000","last_active":"2024-09-12T17:37:45.267370+0000","last_peered":"2024-09-12T17:37:45.267370+0000","last_clean":"2024-09-12T17:37:45.267370+0000","last_became_active":"2024-09-12T17:15:40.134513+0000","last_became_peered":"2024-09-12T17:15:40.134513+0000","last_unstale":"2024-09-12T17:37:45.267370+0000","last_undegraded":"2024-09-12T17:37:45.267370+0000","last_fullsized":"2024-09-12T17:37:45.267370+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:39.657856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"265'19","reported_seq":94,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:57.360940+0000","last_change":"2024-09-12T17:13:54.827570+0000","last_active":"2024-09-12T17:38:57.360940+0000","last_peered":"2024-09-12T17:38:57.360940+0000","last_clean":"2024-09-12T17:38:57.360940+0000","last_became_active":"2024-09-12T17:13:54.826480+0000","last_became_peered":"2024-09-12T17:13:54.826480+0000","last_unstale":"2024-09-12T17:38:57.360940+0000","last_undegraded":"2024-09-12T17:38:57.360940+0000","last_fullsized":"2024-09-12T17:38:57.360940+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:09.477709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:02.336888+0000","last_change":"2024-09-12T17:27:17.419282+0000","last_active":"2024-09-12T17:37:02.336888+0000","last_peered":"2024-09-12T17:37:02.336888+0000","last_clean":"2024-09-12T17:37:02.336888+0000","last_became_active":"2024-09-12T17:27:17.418519+0000","last_became_peered":"2024-09-12T17:27:17.418519+0000","last_unstale":"2024-09-12T17:37:02.336888+0000","last_undegraded":"2024-09-12T17:37:02.336888+0000","last_fullsized":"2024-09-12T17:37:02.336888+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:37.212267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"265'1","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:47.347348+0000","last_change":"2024-09-12T17:15:43.869355+0000","last_active":"2024-09-12T17:37:47.347348+0000","last_peered":"2024-09-12T17:37:47.347348+0000","last_clean":"2024-09-12T17:37:47.347348+0000","last_became_active":"2024-09-12T17:15:43.868600+0000","last_became_peered":"2024-09-12T17:15:43.868600+0000","last_unstale":"2024-09-12T17:37:47.347348+0000","last_undegraded":"2024-09-12T17:37:47.347348+0000","last_fullsized":"2024-09-12T17:37:47.347348+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:55.218786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48422,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":48,"num_write":1,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"262'3","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:36.286516+0000","last_change":"2024-09-12T17:15:40.109807+0000","last_active":"2024-09-12T17:38:36.286516+0000","last_peered":"2024-09-12T17:38:36.286516+0000","last_clean":"2024-09-12T17:38:36.286516+0000","last_became_active":"2024-09-12T17:15:40.109161+0000","last_became_peered":"2024-09-12T17:15:40.109161+0000","last_unstale":"2024-09-12T17:38:36.286516+0000","last_undegraded":"2024-09-12T17:38:36.286516+0000","last_fullsized":"2024-09-12T17:38:36.286516+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:38.091651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"265'31","reported_seq":127,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:28.552554+0000","last_change":"2024-09-12T17:13:54.839575+0000","last_active":"2024-09-12T17:39:28.552554+0000","last_peered":"2024-09-12T17:39:28.552554+0000","last_clean":"2024-09-12T17:39:28.552554+0000","last_became_active":"2024-09-12T17:13:54.838968+0000","last_became_peered":"2024-09-12T17:13:54.838968+0000","last_unstale":"2024-09-12T17:39:28.552554+0000","last_undegraded":"2024-09-12T17:39:28.552554+0000","last_fullsized":"2024-09-12T17:39:28.552554+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:01.149483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":108,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:22.370396+0000","last_change":"2024-09-12T17:27:17.418362+0000","last_active":"2024-09-12T17:39:22.370396+0000","last_peered":"2024-09-12T17:39:22.370396+0000","last_clean":"2024-09-12T17:39:22.370396+0000","last_became_active":"2024-09-12T17:27:17.416509+0000","last_became_peered":"2024-09-12T17:27:17.416509+0000","last_unstale":"2024-09-12T17:39:22.370396+0000","last_undegraded":"2024-09-12T17:39:22.370396+0000","last_fullsized":"2024-09-12T17:39:22.370396+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:54.908041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"265'10","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:32.325931+0000","last_change":"2024-09-12T17:15:43.163407+0000","last_active":"2024-09-12T17:37:32.325931+0000","last_peered":"2024-09-12T17:37:32.325931+0000","last_clean":"2024-09-12T17:37:32.325931+0000","last_became_active":"2024-09-12T17:15:43.162643+0000","last_became_peered":"2024-09-12T17:15:43.162643+0000","last_unstale":"2024-09-12T17:37:32.325931+0000","last_undegraded":"2024-09-12T17:37:32.325931+0000","last_fullsized":"2024-09-12T17:37:32.325931+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:26.465579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48416,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":23650,"num_write":15,"num_write_kb":11312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"265'6","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:27.338729+0000","last_change":"2024-09-12T17:15:40.111961+0000","last_active":"2024-09-12T17:37:27.338729+0000","last_peered":"2024-09-12T17:37:27.338729+0000","last_clean":"2024-09-12T17:37:27.338729+0000","last_became_active":"2024-09-12T17:15:40.111105+0000","last_became_peered":"2024-09-12T17:15:40.111105+0000","last_unstale":"2024-09-12T17:37:27.338729+0000","last_undegraded":"2024-09-12T17:37:27.338729+0000","last_fullsized":"2024-09-12T17:37:27.338729+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:17.726065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"265'54","reported_seq":197,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:31.662260+0000","last_change":"2024-09-12T17:13:54.842088+0000","last_active":"2024-09-12T17:39:31.662260+0000","last_peered":"2024-09-12T17:39:31.662260+0000","last_clean":"2024-09-12T17:39:31.662260+0000","last_became_active":"2024-09-12T17:13:54.841072+0000","last_became_peered":"2024-09-12T17:13:54.841072+0000","last_unstale":"2024-09-12T17:39:31.662260+0000","last_undegraded":"2024-09-12T17:39:31.662260+0000","last_fullsized":"2024-09-12T17:39:31.662260+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:22:11.118120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":282,"num_read_kb":222,"num_write":88,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:43.689296+0000","last_change":"2024-09-12T17:27:17.410975+0000","last_active":"2024-09-12T17:37:43.689296+0000","last_peered":"2024-09-12T17:37:43.689296+0000","last_clean":"2024-09-12T17:37:43.689296+0000","last_became_active":"2024-09-12T17:27:17.392355+0000","last_became_peered":"2024-09-12T17:27:17.392355+0000","last_unstale":"2024-09-12T17:37:43.689296+0000","last_undegraded":"2024-09-12T17:37:43.689296+0000","last_fullsized":"2024-09-12T17:37:43.689296+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:41.915255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"265'3","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:31.287683+0000","last_change":"2024-09-12T17:15:57.748482+0000","last_active":"2024-09-12T17:37:31.287683+0000","last_peered":"2024-09-12T17:37:31.287683+0000","last_clean":"2024-09-12T17:37:31.287683+0000","last_became_active":"2024-09-12T17:15:57.742342+0000","last_became_peered":"2024-09-12T17:15:57.742342+0000","last_unstale":"2024-09-12T17:37:31.287683+0000","last_undegraded":"2024-09-12T17:37:31.287683+0000","last_fullsized":"2024-09-12T17:37:31.287683+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:00.488944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":3,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1087,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:36.272606+0000","last_change":"2024-09-12T17:15:40.120329+0000","last_active":"2024-09-12T17:37:36.272606+0000","last_peered":"2024-09-12T17:37:36.272606+0000","last_clean":"2024-09-12T17:37:36.272606+0000","last_became_active":"2024-09-12T17:15:40.119439+0000","last_became_peered":"2024-09-12T17:15:40.119439+0000","last_unstale":"2024-09-12T17:37:36.272606+0000","last_undegraded":"2024-09-12T17:37:36.272606+0000","last_fullsized":"2024-09-12T17:37:36.272606+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:50.536461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"265'35","reported_seq":142,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:56.306273+0000","last_change":"2024-09-12T17:13:54.842916+0000","last_active":"2024-09-12T17:38:56.306273+0000","last_peered":"2024-09-12T17:38:56.306273+0000","last_clean":"2024-09-12T17:38:56.306273+0000","last_became_active":"2024-09-12T17:13:54.842215+0000","last_became_peered":"2024-09-12T17:13:54.842215+0000","last_unstale":"2024-09-12T17:38:56.306273+0000","last_undegraded":"2024-09-12T17:38:56.306273+0000","last_fullsized":"2024-09-12T17:38:56.306273+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:02.592935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":135,"num_write":51,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"265'1","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:21.291709+0000","last_change":"2024-09-12T17:27:17.415995+0000","last_active":"2024-09-12T17:37:21.291709+0000","last_peered":"2024-09-12T17:37:21.291709+0000","last_clean":"2024-09-12T17:37:21.291709+0000","last_became_active":"2024-09-12T17:27:17.415277+0000","last_became_peered":"2024-09-12T17:27:17.415277+0000","last_unstale":"2024-09-12T17:37:21.291709+0000","last_undegraded":"2024-09-12T17:37:21.291709+0000","last_fullsized":"2024-09-12T17:37:21.291709+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:19.223166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"265'3","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:16.297571+0000","last_change":"2024-09-12T17:15:43.172814+0000","last_active":"2024-09-12T17:38:16.297571+0000","last_peered":"2024-09-12T17:38:16.297571+0000","last_clean":"2024-09-12T17:38:16.297571+0000","last_became_active":"2024-09-12T17:15:43.172142+0000","last_became_peered":"2024-09-12T17:15:43.172142+0000","last_unstale":"2024-09-12T17:38:16.297571+0000","last_undegraded":"2024-09-12T17:38:16.297571+0000","last_fullsized":"2024-09-12T17:38:16.297571+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:41.542977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"262'4","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:11.280709+0000","last_change":"2024-09-12T17:15:40.109940+0000","last_active":"2024-09-12T17:38:11.280709+0000","last_peered":"2024-09-12T17:38:11.280709+0000","last_clean":"2024-09-12T17:38:11.280709+0000","last_became_active":"2024-09-12T17:15:40.109076+0000","last_became_peered":"2024-09-12T17:15:40.109076+0000","last_unstale":"2024-09-12T17:38:11.280709+0000","last_undegraded":"2024-09-12T17:38:11.280709+0000","last_fullsized":"2024-09-12T17:38:11.280709+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:05.822624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"262'6","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:12.349294+0000","last_change":"2024-09-12T17:13:54.820144+0000","last_active":"2024-09-12T17:38:12.349294+0000","last_peered":"2024-09-12T17:38:12.349294+0000","last_clean":"2024-09-12T17:38:12.349294+0000","last_became_active":"2024-09-12T17:13:54.819399+0000","last_became_peered":"2024-09-12T17:13:54.819399+0000","last_unstale":"2024-09-12T17:38:12.349294+0000","last_undegraded":"2024-09-12T17:38:12.349294+0000","last_fullsized":"2024-09-12T17:38:12.349294+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:25.721158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:21.291799+0000","last_change":"2024-09-12T17:27:17.420256+0000","last_active":"2024-09-12T17:37:21.291799+0000","last_peered":"2024-09-12T17:37:21.291799+0000","last_clean":"2024-09-12T17:37:21.291799+0000","last_became_active":"2024-09-12T17:27:17.419839+0000","last_became_peered":"2024-09-12T17:27:17.419839+0000","last_unstale":"2024-09-12T17:37:21.291799+0000","last_undegraded":"2024-09-12T17:37:21.291799+0000","last_fullsized":"2024-09-12T17:37:21.291799+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:46.578295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"265'4","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:12.353158+0000","last_change":"2024-09-12T17:15:43.160492+0000","last_active":"2024-09-12T17:38:12.353158+0000","last_peered":"2024-09-12T17:38:12.353158+0000","last_clean":"2024-09-12T17:38:12.353158+0000","last_became_active":"2024-09-12T17:15:43.159663+0000","last_became_peered":"2024-09-12T17:15:43.159663+0000","last_unstale":"2024-09-12T17:38:12.353158+0000","last_undegraded":"2024-09-12T17:38:12.353158+0000","last_fullsized":"2024-09-12T17:38:12.353158+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:48.671220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":9,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"265'1","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:12.349386+0000","last_change":"2024-09-12T17:15:40.131992+0000","last_active":"2024-09-12T17:38:12.349386+0000","last_peered":"2024-09-12T17:38:12.349386+0000","last_clean":"2024-09-12T17:38:12.349386+0000","last_became_active":"2024-09-12T17:15:40.131140+0000","last_became_peered":"2024-09-12T17:15:40.131140+0000","last_unstale":"2024-09-12T17:38:12.349386+0000","last_undegraded":"2024-09-12T17:38:12.349386+0000","last_fullsized":"2024-09-12T17:38:12.349386+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:26.319835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"265'19","reported_seq":94,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:08.694781+0000","last_change":"2024-09-12T17:13:54.832206+0000","last_active":"2024-09-12T17:38:08.694781+0000","last_peered":"2024-09-12T17:38:08.694781+0000","last_clean":"2024-09-12T17:38:08.694781+0000","last_became_active":"2024-09-12T17:13:54.831374+0000","last_became_peered":"2024-09-12T17:13:54.831374+0000","last_unstale":"2024-09-12T17:38:08.694781+0000","last_undegraded":"2024-09-12T17:38:08.694781+0000","last_fullsized":"2024-09-12T17:38:08.694781+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:25.250277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:58.706411+0000","last_change":"2024-09-12T17:27:17.416704+0000","last_active":"2024-09-12T17:38:58.706411+0000","last_peered":"2024-09-12T17:38:58.706411+0000","last_clean":"2024-09-12T17:38:58.706411+0000","last_became_active":"2024-09-12T17:27:17.415918+0000","last_became_peered":"2024-09-12T17:27:17.415918+0000","last_unstale":"2024-09-12T17:38:58.706411+0000","last_undegraded":"2024-09-12T17:38:58.706411+0000","last_fullsized":"2024-09-12T17:38:58.706411+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:40.069574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"265'3","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:27.342821+0000","last_change":"2024-09-12T17:15:43.872202+0000","last_active":"2024-09-12T17:37:27.342821+0000","last_peered":"2024-09-12T17:37:27.342821+0000","last_clean":"2024-09-12T17:37:27.342821+0000","last_became_active":"2024-09-12T17:15:43.871380+0000","last_became_peered":"2024-09-12T17:15:43.871380+0000","last_unstale":"2024-09-12T17:37:27.342821+0000","last_undegraded":"2024-09-12T17:37:27.342821+0000","last_fullsized":"2024-09-12T17:37:27.342821+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:54.178710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"265'2","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:07.347492+0000","last_change":"2024-09-12T17:15:40.117517+0000","last_active":"2024-09-12T17:39:07.347492+0000","last_peered":"2024-09-12T17:39:07.347492+0000","last_clean":"2024-09-12T17:39:07.347492+0000","last_became_active":"2024-09-12T17:15:40.116781+0000","last_became_peered":"2024-09-12T17:15:40.116781+0000","last_unstale":"2024-09-12T17:39:07.347492+0000","last_undegraded":"2024-09-12T17:39:07.347492+0000","last_fullsized":"2024-09-12T17:39:07.347492+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:04.218708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":7168,"num_write":2,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"265'68","reported_seq":230,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:31.441127+0000","last_change":"2024-09-12T17:13:54.830908+0000","last_active":"2024-09-12T17:39:31.441127+0000","last_peered":"2024-09-12T17:39:31.441127+0000","last_clean":"2024-09-12T17:39:31.441127+0000","last_became_active":"2024-09-12T17:13:54.829335+0000","last_became_peered":"2024-09-12T17:13:54.829335+0000","last_unstale":"2024-09-12T17:39:31.441127+0000","last_undegraded":"2024-09-12T17:39:31.441127+0000","last_fullsized":"2024-09-12T17:39:31.441127+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:18:25.184524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":349,"num_read_kb":240,"num_write":120,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"265'1","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:00.283371+0000","last_change":"2024-09-12T17:27:17.410174+0000","last_active":"2024-09-12T17:39:00.283371+0000","last_peered":"2024-09-12T17:39:00.283371+0000","last_clean":"2024-09-12T17:39:00.283371+0000","last_became_active":"2024-09-12T17:27:17.409364+0000","last_became_peered":"2024-09-12T17:27:17.409364+0000","last_unstale":"2024-09-12T17:39:00.283371+0000","last_undegraded":"2024-09-12T17:39:00.283371+0000","last_fullsized":"2024-09-12T17:39:00.283371+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:34.250496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"265'1","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:07.366937+0000","last_change":"2024-09-12T17:15:43.875351+0000","last_active":"2024-09-12T17:39:07.366937+0000","last_peered":"2024-09-12T17:39:07.366937+0000","last_clean":"2024-09-12T17:39:07.366937+0000","last_became_active":"2024-09-12T17:15:43.874421+0000","last_became_peered":"2024-09-12T17:15:43.874421+0000","last_unstale":"2024-09-12T17:39:07.366937+0000","last_undegraded":"2024-09-12T17:39:07.366937+0000","last_fullsized":"2024-09-12T17:39:07.366937+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:12.382448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"265'2","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:26.293177+0000","last_change":"2024-09-12T17:15:40.127851+0000","last_active":"2024-09-12T17:37:26.293177+0000","last_peered":"2024-09-12T17:37:26.293177+0000","last_clean":"2024-09-12T17:37:26.293177+0000","last_became_active":"2024-09-12T17:15:40.126898+0000","last_became_peered":"2024-09-12T17:15:40.126898+0000","last_unstale":"2024-09-12T17:37:26.293177+0000","last_undegraded":"2024-09-12T17:37:26.293177+0000","last_fullsized":"2024-09-12T17:37:26.293177+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:27.692907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"265'19","reported_seq":92,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:07.352095+0000","last_change":"2024-09-12T17:13:54.833584+0000","last_active":"2024-09-12T17:38:07.352095+0000","last_peered":"2024-09-12T17:38:07.352095+0000","last_clean":"2024-09-12T17:38:07.352095+0000","last_became_active":"2024-09-12T17:13:54.832780+0000","last_became_peered":"2024-09-12T17:13:54.832780+0000","last_unstale":"2024-09-12T17:38:07.352095+0000","last_undegraded":"2024-09-12T17:38:07.352095+0000","last_fullsized":"2024-09-12T17:38:07.352095+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:33.420620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":55,"num_write":40,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:01.315516+0000","last_change":"2024-09-12T17:27:17.415211+0000","last_active":"2024-09-12T17:39:01.315516+0000","last_peered":"2024-09-12T17:39:01.315516+0000","last_clean":"2024-09-12T17:39:01.315516+0000","last_became_active":"2024-09-12T17:27:17.414739+0000","last_became_peered":"2024-09-12T17:27:17.414739+0000","last_unstale":"2024-09-12T17:39:01.315516+0000","last_undegraded":"2024-09-12T17:39:01.315516+0000","last_fullsized":"2024-09-12T17:39:01.315516+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:57.434689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"265'4","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:27.342949+0000","last_change":"2024-09-12T17:15:43.872275+0000","last_active":"2024-09-12T17:37:27.342949+0000","last_peered":"2024-09-12T17:37:27.342949+0000","last_clean":"2024-09-12T17:37:27.342949+0000","last_became_active":"2024-09-12T17:15:43.871502+0000","last_became_peered":"2024-09-12T17:15:43.871502+0000","last_unstale":"2024-09-12T17:37:27.342949+0000","last_undegraded":"2024-09-12T17:37:27.342949+0000","last_fullsized":"2024-09-12T17:37:27.342949+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:07.859526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":9,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"265'3","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:25.263115+0000","last_change":"2024-09-12T17:15:40.133504+0000","last_active":"2024-09-12T17:37:25.263115+0000","last_peered":"2024-09-12T17:37:25.263115+0000","last_clean":"2024-09-12T17:37:25.263115+0000","last_became_active":"2024-09-12T17:15:40.132311+0000","last_became_peered":"2024-09-12T17:15:40.132311+0000","last_unstale":"2024-09-12T17:37:25.263115+0000","last_undegraded":"2024-09-12T17:37:25.263115+0000","last_fullsized":"2024-09-12T17:37:25.263115+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:42.985929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"265'33","reported_seq":136,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:05.271852+0000","last_change":"2024-09-12T17:13:54.828548+0000","last_active":"2024-09-12T17:38:05.271852+0000","last_peered":"2024-09-12T17:38:05.271852+0000","last_clean":"2024-09-12T17:38:05.271852+0000","last_became_active":"2024-09-12T17:13:54.827785+0000","last_became_peered":"2024-09-12T17:13:54.827785+0000","last_unstale":"2024-09-12T17:38:05.271852+0000","last_undegraded":"2024-09-12T17:38:05.271852+0000","last_fullsized":"2024-09-12T17:38:05.271852+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:29.075567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":116,"num_write":64,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:57.345260+0000","last_change":"2024-09-12T17:27:17.391923+0000","last_active":"2024-09-12T17:38:57.345260+0000","last_peered":"2024-09-12T17:38:57.345260+0000","last_clean":"2024-09-12T17:38:57.345260+0000","last_became_active":"2024-09-12T17:27:17.391154+0000","last_became_peered":"2024-09-12T17:27:17.391154+0000","last_unstale":"2024-09-12T17:38:57.345260+0000","last_undegraded":"2024-09-12T17:38:57.345260+0000","last_fullsized":"2024-09-12T17:38:57.345260+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:12.682141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"265'9","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:31.271602+0000","last_change":"2024-09-12T17:15:43.171314+0000","last_active":"2024-09-12T17:37:31.271602+0000","last_peered":"2024-09-12T17:37:31.271602+0000","last_clean":"2024-09-12T17:37:31.271602+0000","last_became_active":"2024-09-12T17:15:43.169085+0000","last_became_peered":"2024-09-12T17:15:43.169085+0000","last_unstale":"2024-09-12T17:37:31.271602+0000","last_undegraded":"2024-09-12T17:37:31.271602+0000","last_fullsized":"2024-09-12T17:37:31.271602+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:01.989288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13631488,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":43010,"num_write":14,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"265'1","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:27.339090+0000","last_change":"2024-09-12T17:15:40.139824+0000","last_active":"2024-09-12T17:37:27.339090+0000","last_peered":"2024-09-12T17:37:27.339090+0000","last_clean":"2024-09-12T17:37:27.339090+0000","last_became_active":"2024-09-12T17:15:40.139145+0000","last_became_peered":"2024-09-12T17:15:40.139145+0000","last_unstale":"2024-09-12T17:37:27.339090+0000","last_undegraded":"2024-09-12T17:37:27.339090+0000","last_fullsized":"2024-09-12T17:37:27.339090+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:52:16.027902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"265'28","reported_seq":124,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:38.948450+0000","last_change":"2024-09-12T17:13:54.843550+0000","last_active":"2024-09-12T17:38:38.948450+0000","last_peered":"2024-09-12T17:38:38.948450+0000","last_clean":"2024-09-12T17:38:38.948450+0000","last_became_active":"2024-09-12T17:13:54.842816+0000","last_became_peered":"2024-09-12T17:13:54.842816+0000","last_unstale":"2024-09-12T17:38:38.948450+0000","last_undegraded":"2024-09-12T17:38:38.948450+0000","last_fullsized":"2024-09-12T17:38:38.948450+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:02.403853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":108,"num_write":46,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:36:57.335925+0000","last_change":"2024-09-12T17:27:17.422713+0000","last_active":"2024-09-12T17:36:57.335925+0000","last_peered":"2024-09-12T17:36:57.335925+0000","last_clean":"2024-09-12T17:36:57.335925+0000","last_became_active":"2024-09-12T17:27:17.421939+0000","last_became_peered":"2024-09-12T17:27:17.421939+0000","last_unstale":"2024-09-12T17:36:57.335925+0000","last_undegraded":"2024-09-12T17:36:57.335925+0000","last_fullsized":"2024-09-12T17:36:57.335925+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:53.787184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"262'8","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:03.708024+0000","last_change":"2024-09-12T17:15:43.162064+0000","last_active":"2024-09-12T17:39:03.708024+0000","last_peered":"2024-09-12T17:39:03.708024+0000","last_clean":"2024-09-12T17:39:03.708024+0000","last_became_active":"2024-09-12T17:15:43.158530+0000","last_became_peered":"2024-09-12T17:15:43.158530+0000","last_unstale":"2024-09-12T17:39:03.708024+0000","last_undegraded":"2024-09-12T17:39:03.708024+0000","last_fullsized":"2024-09-12T17:39:03.708024+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:52.110653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10242,"num_write":8,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"265'3","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:01.291728+0000","last_change":"2024-09-12T17:15:40.131385+0000","last_active":"2024-09-12T17:39:01.291728+0000","last_peered":"2024-09-12T17:39:01.291728+0000","last_clean":"2024-09-12T17:39:01.291728+0000","last_became_active":"2024-09-12T17:15:40.130644+0000","last_became_peered":"2024-09-12T17:15:40.130644+0000","last_unstale":"2024-09-12T17:39:01.291728+0000","last_undegraded":"2024-09-12T17:39:01.291728+0000","last_fullsized":"2024-09-12T17:39:01.291728+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:14.166806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"265'14","reported_seq":88,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:16.290475+0000","last_change":"2024-09-12T17:13:54.843769+0000","last_active":"2024-09-12T17:37:16.290475+0000","last_peered":"2024-09-12T17:37:16.290475+0000","last_clean":"2024-09-12T17:37:16.290475+0000","last_became_active":"2024-09-12T17:13:54.843036+0000","last_became_peered":"2024-09-12T17:13:54.843036+0000","last_unstale":"2024-09-12T17:37:16.290475+0000","last_undegraded":"2024-09-12T17:37:16.290475+0000","last_fullsized":"2024-09-12T17:37:16.290475+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:08:22.840485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:36:57.331873+0000","last_change":"2024-09-12T17:27:17.426185+0000","last_active":"2024-09-12T17:36:57.331873+0000","last_peered":"2024-09-12T17:36:57.331873+0000","last_clean":"2024-09-12T17:36:57.331873+0000","last_became_active":"2024-09-12T17:27:17.421187+0000","last_became_peered":"2024-09-12T17:27:17.421187+0000","last_unstale":"2024-09-12T17:36:57.331873+0000","last_undegraded":"2024-09-12T17:36:57.331873+0000","last_fullsized":"2024-09-12T17:36:57.331873+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:54.922802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"265'6","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:58.706229+0000","last_change":"2024-09-12T17:15:43.156779+0000","last_active":"2024-09-12T17:38:58.706229+0000","last_peered":"2024-09-12T17:38:58.706229+0000","last_clean":"2024-09-12T17:38:58.706229+0000","last_became_active":"2024-09-12T17:15:43.155891+0000","last_became_peered":"2024-09-12T17:15:43.155891+0000","last_unstale":"2024-09-12T17:38:58.706229+0000","last_undegraded":"2024-09-12T17:38:58.706229+0000","last_fullsized":"2024-09-12T17:38:58.706229+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:51.266851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8194,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:02.365695+0000","last_change":"2024-09-12T17:15:40.129236+0000","last_active":"2024-09-12T17:39:02.365695+0000","last_peered":"2024-09-12T17:39:02.365695+0000","last_clean":"2024-09-12T17:39:02.365695+0000","last_became_active":"2024-09-12T17:15:40.128470+0000","last_became_peered":"2024-09-12T17:15:40.128470+0000","last_unstale":"2024-09-12T17:39:02.365695+0000","last_undegraded":"2024-09-12T17:39:02.365695+0000","last_fullsized":"2024-09-12T17:39:02.365695+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:17.232330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"265'46","reported_seq":175,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:59.769241+0000","last_change":"2024-09-12T17:13:54.822640+0000","last_active":"2024-09-12T17:38:59.769241+0000","last_peered":"2024-09-12T17:38:59.769241+0000","last_clean":"2024-09-12T17:38:59.769241+0000","last_became_active":"2024-09-12T17:13:54.821816+0000","last_became_peered":"2024-09-12T17:13:54.821816+0000","last_unstale":"2024-09-12T17:38:59.769241+0000","last_undegraded":"2024-09-12T17:38:59.769241+0000","last_fullsized":"2024-09-12T17:38:59.769241+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:01.101266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":166,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"264'1","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:02.362079+0000","last_change":"2024-09-12T17:27:17.423856+0000","last_active":"2024-09-12T17:39:02.362079+0000","last_peered":"2024-09-12T17:39:02.362079+0000","last_clean":"2024-09-12T17:39:02.362079+0000","last_became_active":"2024-09-12T17:27:17.422464+0000","last_became_peered":"2024-09-12T17:27:17.422464+0000","last_unstale":"2024-09-12T17:39:02.362079+0000","last_undegraded":"2024-09-12T17:39:02.362079+0000","last_fullsized":"2024-09-12T17:39:02.362079+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:44.192139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"265'6","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:02.365796+0000","last_change":"2024-09-12T17:15:43.172138+0000","last_active":"2024-09-12T17:39:02.365796+0000","last_peered":"2024-09-12T17:39:02.365796+0000","last_clean":"2024-09-12T17:39:02.365796+0000","last_became_active":"2024-09-12T17:15:43.171254+0000","last_became_peered":"2024-09-12T17:15:43.171254+0000","last_unstale":"2024-09-12T17:39:02.365796+0000","last_undegraded":"2024-09-12T17:39:02.365796+0000","last_fullsized":"2024-09-12T17:39:02.365796+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:22.106658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"265'3","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:01.307298+0000","last_change":"2024-09-12T17:15:40.117718+0000","last_active":"2024-09-12T17:39:01.307298+0000","last_peered":"2024-09-12T17:39:01.307298+0000","last_clean":"2024-09-12T17:39:01.307298+0000","last_became_active":"2024-09-12T17:15:40.116989+0000","last_became_peered":"2024-09-12T17:15:40.116989+0000","last_unstale":"2024-09-12T17:39:01.307298+0000","last_undegraded":"2024-09-12T17:39:01.307298+0000","last_fullsized":"2024-09-12T17:39:01.307298+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:05.611483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4119,"num_write":3,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"265'42","reported_seq":160,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:16.268235+0000","last_change":"2024-09-12T17:13:54.812445+0000","last_active":"2024-09-12T17:37:16.268235+0000","last_peered":"2024-09-12T17:37:16.268235+0000","last_clean":"2024-09-12T17:37:16.268235+0000","last_became_active":"2024-09-12T17:13:54.811613+0000","last_became_peered":"2024-09-12T17:13:54.811613+0000","last_unstale":"2024-09-12T17:37:16.268235+0000","last_undegraded":"2024-09-12T17:37:16.268235+0000","last_fullsized":"2024-09-12T17:37:16.268235+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:57.189420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":153,"num_write":74,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"265'1","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:36:57.335846+0000","last_change":"2024-09-12T17:27:17.405875+0000","last_active":"2024-09-12T17:36:57.335846+0000","last_peered":"2024-09-12T17:36:57.335846+0000","last_clean":"2024-09-12T17:36:57.335846+0000","last_became_active":"2024-09-12T17:27:17.405051+0000","last_became_peered":"2024-09-12T17:27:17.405051+0000","last_unstale":"2024-09-12T17:36:57.335846+0000","last_undegraded":"2024-09-12T17:36:57.335846+0000","last_fullsized":"2024-09-12T17:36:57.335846+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:07.362927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"265'1","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:06.308426+0000","last_change":"2024-09-12T17:15:43.158356+0000","last_active":"2024-09-12T17:39:06.308426+0000","last_peered":"2024-09-12T17:39:06.308426+0000","last_clean":"2024-09-12T17:39:06.308426+0000","last_became_active":"2024-09-12T17:15:43.157624+0000","last_became_peered":"2024-09-12T17:15:43.157624+0000","last_unstale":"2024-09-12T17:39:06.308426+0000","last_undegraded":"2024-09-12T17:39:06.308426+0000","last_fullsized":"2024-09-12T17:39:06.308426+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:44.475418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:02.346406+0000","last_change":"2024-09-12T17:15:40.118796+0000","last_active":"2024-09-12T17:39:02.346406+0000","last_peered":"2024-09-12T17:39:02.346406+0000","last_clean":"2024-09-12T17:39:02.346406+0000","last_became_active":"2024-09-12T17:15:40.118074+0000","last_became_peered":"2024-09-12T17:15:40.118074+0000","last_unstale":"2024-09-12T17:39:02.346406+0000","last_undegraded":"2024-09-12T17:39:02.346406+0000","last_fullsized":"2024-09-12T17:39:02.346406+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:53:01.242885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"265'16","reported_seq":89,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:17.340332+0000","last_change":"2024-09-12T17:13:54.841589+0000","last_active":"2024-09-12T17:37:17.340332+0000","last_peered":"2024-09-12T17:37:17.340332+0000","last_clean":"2024-09-12T17:37:17.340332+0000","last_became_active":"2024-09-12T17:13:54.840781+0000","last_became_peered":"2024-09-12T17:13:54.840781+0000","last_unstale":"2024-09-12T17:37:17.340332+0000","last_undegraded":"2024-09-12T17:37:17.340332+0000","last_fullsized":"2024-09-12T17:37:17.340332+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:48.110422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":56,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:15.273963+0000","last_change":"2024-09-12T17:27:17.409764+0000","last_active":"2024-09-12T17:38:15.273963+0000","last_peered":"2024-09-12T17:38:15.273963+0000","last_clean":"2024-09-12T17:38:15.273963+0000","last_became_active":"2024-09-12T17:27:17.408953+0000","last_became_peered":"2024-09-12T17:27:17.408953+0000","last_unstale":"2024-09-12T17:38:15.273963+0000","last_undegraded":"2024-09-12T17:38:15.273963+0000","last_fullsized":"2024-09-12T17:38:15.273963+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:26.794007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:12.353382+0000","last_change":"2024-09-12T17:15:43.165887+0000","last_active":"2024-09-12T17:38:12.353382+0000","last_peered":"2024-09-12T17:38:12.353382+0000","last_clean":"2024-09-12T17:38:12.353382+0000","last_became_active":"2024-09-12T17:15:43.164943+0000","last_became_peered":"2024-09-12T17:15:43.164943+0000","last_unstale":"2024-09-12T17:38:12.353382+0000","last_undegraded":"2024-09-12T17:38:12.353382+0000","last_fullsized":"2024-09-12T17:38:12.353382+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:08.542268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"265'6","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:11.303936+0000","last_change":"2024-09-12T17:15:40.129503+0000","last_active":"2024-09-12T17:38:11.303936+0000","last_peered":"2024-09-12T17:38:11.303936+0000","last_clean":"2024-09-12T17:38:11.303936+0000","last_became_active":"2024-09-12T17:15:40.128681+0000","last_became_peered":"2024-09-12T17:15:40.128681+0000","last_unstale":"2024-09-12T17:38:11.303936+0000","last_undegraded":"2024-09-12T17:38:11.303936+0000","last_fullsized":"2024-09-12T17:38:11.303936+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:21.306746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":11,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"265'9","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:47.361596+0000","last_change":"2024-09-12T17:13:54.844500+0000","last_active":"2024-09-12T17:38:47.361596+0000","last_peered":"2024-09-12T17:38:47.361596+0000","last_clean":"2024-09-12T17:38:47.361596+0000","last_became_active":"2024-09-12T17:13:54.842287+0000","last_became_peered":"2024-09-12T17:13:54.842287+0000","last_unstale":"2024-09-12T17:38:47.361596+0000","last_undegraded":"2024-09-12T17:38:47.361596+0000","last_fullsized":"2024-09-12T17:38:47.361596+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:09.440211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":28,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:36.309617+0000","last_change":"2024-09-12T17:27:17.416766+0000","last_active":"2024-09-12T17:38:36.309617+0000","last_peered":"2024-09-12T17:38:36.309617+0000","last_clean":"2024-09-12T17:38:36.309617+0000","last_became_active":"2024-09-12T17:27:17.415241+0000","last_became_peered":"2024-09-12T17:27:17.415241+0000","last_unstale":"2024-09-12T17:38:36.309617+0000","last_undegraded":"2024-09-12T17:38:36.309617+0000","last_fullsized":"2024-09-12T17:38:36.309617+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:04.923059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"265'7","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:12.353274+0000","last_change":"2024-09-12T17:15:43.171921+0000","last_active":"2024-09-12T17:38:12.353274+0000","last_peered":"2024-09-12T17:38:12.353274+0000","last_clean":"2024-09-12T17:38:12.353274+0000","last_became_active":"2024-09-12T17:15:43.168676+0000","last_became_peered":"2024-09-12T17:15:43.168676+0000","last_unstale":"2024-09-12T17:38:12.353274+0000","last_undegraded":"2024-09-12T17:38:12.353274+0000","last_fullsized":"2024-09-12T17:38:12.353274+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:51.743678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":24578,"num_write":17,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"265'5","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:10.272991+0000","last_change":"2024-09-12T17:15:40.129433+0000","last_active":"2024-09-12T17:38:10.272991+0000","last_peered":"2024-09-12T17:38:10.272991+0000","last_clean":"2024-09-12T17:38:10.272991+0000","last_became_active":"2024-09-12T17:15:40.128708+0000","last_became_peered":"2024-09-12T17:15:40.128708+0000","last_unstale":"2024-09-12T17:38:10.272991+0000","last_undegraded":"2024-09-12T17:38:10.272991+0000","last_fullsized":"2024-09-12T17:38:10.272991+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:54.970720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8194,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"265'35","reported_seq":144,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:42.341793+0000","last_change":"2024-09-12T17:13:54.830851+0000","last_active":"2024-09-12T17:38:42.341793+0000","last_peered":"2024-09-12T17:38:42.341793+0000","last_clean":"2024-09-12T17:38:42.341793+0000","last_became_active":"2024-09-12T17:13:54.830096+0000","last_became_peered":"2024-09-12T17:13:54.830096+0000","last_unstale":"2024-09-12T17:38:42.341793+0000","last_undegraded":"2024-09-12T17:38:42.341793+0000","last_fullsized":"2024-09-12T17:38:42.341793+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:08.715298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":131,"num_write":60,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:06.295390+0000","last_change":"2024-09-12T17:27:17.412405+0000","last_active":"2024-09-12T17:38:06.295390+0000","last_peered":"2024-09-12T17:38:06.295390+0000","last_clean":"2024-09-12T17:38:06.295390+0000","last_became_active":"2024-09-12T17:27:17.411635+0000","last_became_peered":"2024-09-12T17:27:17.411635+0000","last_unstale":"2024-09-12T17:38:06.295390+0000","last_undegraded":"2024-09-12T17:38:06.295390+0000","last_fullsized":"2024-09-12T17:38:06.295390+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:12.596567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:13.696208+0000","last_change":"2024-09-12T17:15:43.870101+0000","last_active":"2024-09-12T17:38:13.696208+0000","last_peered":"2024-09-12T17:38:13.696208+0000","last_clean":"2024-09-12T17:38:13.696208+0000","last_became_active":"2024-09-12T17:15:43.869197+0000","last_became_peered":"2024-09-12T17:15:43.869197+0000","last_unstale":"2024-09-12T17:38:13.696208+0000","last_undegraded":"2024-09-12T17:38:13.696208+0000","last_fullsized":"2024-09-12T17:38:13.696208+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:50:50.852439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:12.349506+0000","last_change":"2024-09-12T17:15:40.115375+0000","last_active":"2024-09-12T17:38:12.349506+0000","last_peered":"2024-09-12T17:38:12.349506+0000","last_clean":"2024-09-12T17:38:12.349506+0000","last_became_active":"2024-09-12T17:15:40.114636+0000","last_became_peered":"2024-09-12T17:15:40.114636+0000","last_unstale":"2024-09-12T17:38:12.349506+0000","last_undegraded":"2024-09-12T17:38:12.349506+0000","last_fullsized":"2024-09-12T17:38:12.349506+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:25.820396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"265'11","reported_seq":77,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:41.303136+0000","last_change":"2024-09-12T17:13:54.837741+0000","last_active":"2024-09-12T17:38:41.303136+0000","last_peered":"2024-09-12T17:38:41.303136+0000","last_clean":"2024-09-12T17:38:41.303136+0000","last_became_active":"2024-09-12T17:13:54.836955+0000","last_became_peered":"2024-09-12T17:13:54.836955+0000","last_unstale":"2024-09-12T17:38:41.303136+0000","last_undegraded":"2024-09-12T17:38:41.303136+0000","last_fullsized":"2024-09-12T17:38:41.303136+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:27.239370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":38,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:11.303795+0000","last_change":"2024-09-12T17:27:17.409364+0000","last_active":"2024-09-12T17:38:11.303795+0000","last_peered":"2024-09-12T17:38:11.303795+0000","last_clean":"2024-09-12T17:38:11.303795+0000","last_became_active":"2024-09-12T17:27:17.408128+0000","last_became_peered":"2024-09-12T17:27:17.408128+0000","last_unstale":"2024-09-12T17:38:11.303795+0000","last_undegraded":"2024-09-12T17:38:11.303795+0000","last_fullsized":"2024-09-12T17:38:11.303795+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:44.771065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"265'2","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:12.353412+0000","last_change":"2024-09-12T17:15:43.171004+0000","last_active":"2024-09-12T17:38:12.353412+0000","last_peered":"2024-09-12T17:38:12.353412+0000","last_clean":"2024-09-12T17:38:12.353412+0000","last_became_active":"2024-09-12T17:15:43.169936+0000","last_became_peered":"2024-09-12T17:15:43.169936+0000","last_unstale":"2024-09-12T17:38:12.353412+0000","last_undegraded":"2024-09-12T17:38:12.353412+0000","last_fullsized":"2024-09-12T17:38:12.353412+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:21.292046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"265'7","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:13.696177+0000","last_change":"2024-09-12T17:15:40.122273+0000","last_active":"2024-09-12T17:38:13.696177+0000","last_peered":"2024-09-12T17:38:13.696177+0000","last_clean":"2024-09-12T17:38:13.696177+0000","last_became_active":"2024-09-12T17:15:40.121181+0000","last_became_peered":"2024-09-12T17:15:40.121181+0000","last_unstale":"2024-09-12T17:38:13.696177+0000","last_undegraded":"2024-09-12T17:38:13.696177+0000","last_fullsized":"2024-09-12T17:38:13.696177+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:36.422026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4242726,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12338,"num_write":12,"num_write_kb":5168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"265'48","reported_seq":176,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:41.282547+0000","last_change":"2024-09-12T17:13:54.842918+0000","last_active":"2024-09-12T17:38:41.282547+0000","last_peered":"2024-09-12T17:38:41.282547+0000","last_clean":"2024-09-12T17:38:41.282547+0000","last_became_active":"2024-09-12T17:13:54.841923+0000","last_became_peered":"2024-09-12T17:13:54.841923+0000","last_unstale":"2024-09-12T17:38:41.282547+0000","last_undegraded":"2024-09-12T17:38:41.282547+0000","last_fullsized":"2024-09-12T17:38:41.282547+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:08.355932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":241,"num_read_kb":172,"num_write":100,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:32.357996+0000","last_change":"2024-09-12T17:27:17.419285+0000","last_active":"2024-09-12T17:38:32.357996+0000","last_peered":"2024-09-12T17:38:32.357996+0000","last_clean":"2024-09-12T17:38:32.357996+0000","last_became_active":"2024-09-12T17:27:17.417566+0000","last_became_peered":"2024-09-12T17:27:17.417566+0000","last_unstale":"2024-09-12T17:38:32.357996+0000","last_undegraded":"2024-09-12T17:38:32.357996+0000","last_fullsized":"2024-09-12T17:38:32.357996+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:32.507294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"262'4","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:26.270382+0000","last_change":"2024-09-12T17:15:43.162593+0000","last_active":"2024-09-12T17:37:26.270382+0000","last_peered":"2024-09-12T17:37:26.270382+0000","last_clean":"2024-09-12T17:37:26.270382+0000","last_became_active":"2024-09-12T17:15:43.161858+0000","last_became_peered":"2024-09-12T17:15:43.161858+0000","last_unstale":"2024-09-12T17:37:26.270382+0000","last_undegraded":"2024-09-12T17:37:26.270382+0000","last_fullsized":"2024-09-12T17:37:26.270382+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:23.655020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:22.337556+0000","last_change":"2024-09-12T17:15:40.113046+0000","last_active":"2024-09-12T17:37:22.337556+0000","last_peered":"2024-09-12T17:37:22.337556+0000","last_clean":"2024-09-12T17:37:22.337556+0000","last_became_active":"2024-09-12T17:15:40.112179+0000","last_became_peered":"2024-09-12T17:15:40.112179+0000","last_unstale":"2024-09-12T17:37:22.337556+0000","last_undegraded":"2024-09-12T17:37:22.337556+0000","last_fullsized":"2024-09-12T17:37:22.337556+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:35.125445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"265'67","reported_seq":229,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:42.356505+0000","last_change":"2024-09-12T17:13:54.828364+0000","last_active":"2024-09-12T17:38:42.356505+0000","last_peered":"2024-09-12T17:38:42.356505+0000","last_clean":"2024-09-12T17:38:42.356505+0000","last_became_active":"2024-09-12T17:13:54.827402+0000","last_became_peered":"2024-09-12T17:13:54.827402+0000","last_unstale":"2024-09-12T17:38:42.356505+0000","last_undegraded":"2024-09-12T17:38:42.356505+0000","last_fullsized":"2024-09-12T17:38:42.356505+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:52.664896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":342,"num_read_kb":248,"num_write":117,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:41.310813+0000","last_change":"2024-09-12T17:27:17.418505+0000","last_active":"2024-09-12T17:38:41.310813+0000","last_peered":"2024-09-12T17:38:41.310813+0000","last_clean":"2024-09-12T17:38:41.310813+0000","last_became_active":"2024-09-12T17:27:17.418022+0000","last_became_peered":"2024-09-12T17:27:17.418022+0000","last_unstale":"2024-09-12T17:38:41.310813+0000","last_undegraded":"2024-09-12T17:38:41.310813+0000","last_fullsized":"2024-09-12T17:38:41.310813+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:55.678220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"265'4","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:26.292871+0000","last_change":"2024-09-12T17:15:43.865245+0000","last_active":"2024-09-12T17:37:26.292871+0000","last_peered":"2024-09-12T17:37:26.292871+0000","last_clean":"2024-09-12T17:37:26.292871+0000","last_became_active":"2024-09-12T17:15:43.864657+0000","last_became_peered":"2024-09-12T17:15:43.864657+0000","last_unstale":"2024-09-12T17:37:26.292871+0000","last_undegraded":"2024-09-12T17:37:26.292871+0000","last_fullsized":"2024-09-12T17:37:26.292871+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:57.152668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":9,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"265'11","reported_seq":66,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:23.684774+0000","last_change":"2024-09-12T17:15:40.123025+0000","last_active":"2024-09-12T17:37:23.684774+0000","last_peered":"2024-09-12T17:37:23.684774+0000","last_clean":"2024-09-12T17:37:23.684774+0000","last_became_active":"2024-09-12T17:15:40.122001+0000","last_became_peered":"2024-09-12T17:15:40.122001+0000","last_unstale":"2024-09-12T17:37:23.684774+0000","last_undegraded":"2024-09-12T17:37:23.684774+0000","last_fullsized":"2024-09-12T17:37:23.684774+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:47.430779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48416,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":12340,"num_write":11,"num_write_kb":6192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"265'23","reported_seq":105,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:51.298999+0000","last_change":"2024-09-12T17:13:54.831219+0000","last_active":"2024-09-12T17:37:51.298999+0000","last_peered":"2024-09-12T17:37:51.298999+0000","last_clean":"2024-09-12T17:37:51.298999+0000","last_became_active":"2024-09-12T17:13:54.825019+0000","last_became_peered":"2024-09-12T17:13:54.825019+0000","last_unstale":"2024-09-12T17:37:51.298999+0000","last_undegraded":"2024-09-12T17:37:51.298999+0000","last_fullsized":"2024-09-12T17:37:51.298999+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:13.461017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":38,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"265'1","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:36.309680+0000","last_change":"2024-09-12T17:27:17.408731+0000","last_active":"2024-09-12T17:38:36.309680+0000","last_peered":"2024-09-12T17:38:36.309680+0000","last_clean":"2024-09-12T17:38:36.309680+0000","last_became_active":"2024-09-12T17:27:17.408151+0000","last_became_peered":"2024-09-12T17:27:17.408151+0000","last_unstale":"2024-09-12T17:38:36.309680+0000","last_undegraded":"2024-09-12T17:38:36.309680+0000","last_fullsized":"2024-09-12T17:38:36.309680+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:04.214744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"265'5","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:08.694920+0000","last_change":"2024-09-12T17:15:43.167300+0000","last_active":"2024-09-12T17:38:08.694920+0000","last_peered":"2024-09-12T17:38:08.694920+0000","last_clean":"2024-09-12T17:38:08.694920+0000","last_became_active":"2024-09-12T17:15:43.166482+0000","last_became_peered":"2024-09-12T17:15:43.166482+0000","last_unstale":"2024-09-12T17:38:08.694920+0000","last_undegraded":"2024-09-12T17:38:08.694920+0000","last_fullsized":"2024-09-12T17:38:08.694920+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:11.626906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":10,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:27.338914+0000","last_change":"2024-09-12T17:15:40.138867+0000","last_active":"2024-09-12T17:37:27.338914+0000","last_peered":"2024-09-12T17:37:27.338914+0000","last_clean":"2024-09-12T17:37:27.338914+0000","last_became_active":"2024-09-12T17:15:40.138190+0000","last_became_peered":"2024-09-12T17:15:40.138190+0000","last_unstale":"2024-09-12T17:37:27.338914+0000","last_undegraded":"2024-09-12T17:37:27.338914+0000","last_fullsized":"2024-09-12T17:37:27.338914+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:31.598623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"265'18","reported_seq":93,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:47.347138+0000","last_change":"2024-09-12T17:13:54.833230+0000","last_active":"2024-09-12T17:37:47.347138+0000","last_peered":"2024-09-12T17:37:47.347138+0000","last_clean":"2024-09-12T17:37:47.347138+0000","last_became_active":"2024-09-12T17:13:54.832453+0000","last_became_peered":"2024-09-12T17:13:54.832453+0000","last_unstale":"2024-09-12T17:37:47.347138+0000","last_undegraded":"2024-09-12T17:37:47.347138+0000","last_fullsized":"2024-09-12T17:37:47.347138+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:14.336440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":60,"num_write":35,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:32.354215+0000","last_change":"2024-09-12T17:27:17.418555+0000","last_active":"2024-09-12T17:38:32.354215+0000","last_peered":"2024-09-12T17:38:32.354215+0000","last_clean":"2024-09-12T17:38:32.354215+0000","last_became_active":"2024-09-12T17:27:17.417574+0000","last_became_peered":"2024-09-12T17:27:17.417574+0000","last_unstale":"2024-09-12T17:38:32.354215+0000","last_undegraded":"2024-09-12T17:38:32.354215+0000","last_fullsized":"2024-09-12T17:38:32.354215+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:54.585796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"265'2","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:31.294406+0000","last_change":"2024-09-12T17:15:43.151790+0000","last_active":"2024-09-12T17:37:31.294406+0000","last_peered":"2024-09-12T17:37:31.294406+0000","last_clean":"2024-09-12T17:37:31.294406+0000","last_became_active":"2024-09-12T17:15:43.151000+0000","last_became_peered":"2024-09-12T17:15:43.151000+0000","last_unstale":"2024-09-12T17:37:31.294406+0000","last_undegraded":"2024-09-12T17:37:31.294406+0000","last_fullsized":"2024-09-12T17:37:31.294406+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:26:12.163255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"262'2","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:11.280772+0000","last_change":"2024-09-12T17:15:40.119321+0000","last_active":"2024-09-12T17:38:11.280772+0000","last_peered":"2024-09-12T17:38:11.280772+0000","last_clean":"2024-09-12T17:38:11.280772+0000","last_became_active":"2024-09-12T17:15:40.118469+0000","last_became_peered":"2024-09-12T17:15:40.118469+0000","last_unstale":"2024-09-12T17:38:11.280772+0000","last_undegraded":"2024-09-12T17:38:11.280772+0000","last_fullsized":"2024-09-12T17:38:11.280772+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:28.762279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"265'20","reported_seq":99,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:46.290866+0000","last_change":"2024-09-12T17:13:54.828421+0000","last_active":"2024-09-12T17:37:46.290866+0000","last_peered":"2024-09-12T17:37:46.290866+0000","last_clean":"2024-09-12T17:37:46.290866+0000","last_became_active":"2024-09-12T17:13:54.827570+0000","last_became_peered":"2024-09-12T17:13:54.827570+0000","last_unstale":"2024-09-12T17:37:46.290866+0000","last_undegraded":"2024-09-12T17:37:46.290866+0000","last_fullsized":"2024-09-12T17:37:46.290866+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:42.149748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":63,"num_write":42,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:46.297919+0000","last_change":"2024-09-12T17:27:17.411486+0000","last_active":"2024-09-12T17:37:46.297919+0000","last_peered":"2024-09-12T17:37:46.297919+0000","last_clean":"2024-09-12T17:37:46.297919+0000","last_became_active":"2024-09-12T17:27:17.411175+0000","last_became_peered":"2024-09-12T17:27:17.411175+0000","last_unstale":"2024-09-12T17:37:46.297919+0000","last_undegraded":"2024-09-12T17:37:46.297919+0000","last_fullsized":"2024-09-12T17:37:46.297919+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:59.115945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"265'4","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:42.356637+0000","last_change":"2024-09-12T17:15:43.159928+0000","last_active":"2024-09-12T17:38:42.356637+0000","last_peered":"2024-09-12T17:38:42.356637+0000","last_clean":"2024-09-12T17:38:42.356637+0000","last_became_active":"2024-09-12T17:15:43.159149+0000","last_became_peered":"2024-09-12T17:15:43.159149+0000","last_unstale":"2024-09-12T17:38:42.356637+0000","last_undegraded":"2024-09-12T17:38:42.356637+0000","last_fullsized":"2024-09-12T17:38:42.356637+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:34.107337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":9,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"265'6","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:36.309657+0000","last_change":"2024-09-12T17:15:40.122291+0000","last_active":"2024-09-12T17:38:36.309657+0000","last_peered":"2024-09-12T17:38:36.309657+0000","last_clean":"2024-09-12T17:38:36.309657+0000","last_became_active":"2024-09-12T17:15:40.121513+0000","last_became_peered":"2024-09-12T17:15:40.121513+0000","last_unstale":"2024-09-12T17:38:36.309657+0000","last_undegraded":"2024-09-12T17:38:36.309657+0000","last_fullsized":"2024-09-12T17:38:36.309657+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:00.339305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":11,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"265'31","reported_seq":131,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:47.343574+0000","last_change":"2024-09-12T17:13:54.830067+0000","last_active":"2024-09-12T17:37:47.343574+0000","last_peered":"2024-09-12T17:37:47.343574+0000","last_clean":"2024-09-12T17:37:47.343574+0000","last_became_active":"2024-09-12T17:13:54.828393+0000","last_became_peered":"2024-09-12T17:13:54.828393+0000","last_unstale":"2024-09-12T17:37:47.343574+0000","last_undegraded":"2024-09-12T17:37:47.343574+0000","last_fullsized":"2024-09-12T17:37:47.343574+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:22:33.149059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":109,"num_write":58,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:42.328164+0000","last_change":"2024-09-12T17:27:17.402782+0000","last_active":"2024-09-12T17:37:42.328164+0000","last_peered":"2024-09-12T17:37:42.328164+0000","last_clean":"2024-09-12T17:37:42.328164+0000","last_became_active":"2024-09-12T17:27:17.402024+0000","last_became_peered":"2024-09-12T17:27:17.402024+0000","last_unstale":"2024-09-12T17:37:42.328164+0000","last_undegraded":"2024-09-12T17:37:42.328164+0000","last_fullsized":"2024-09-12T17:37:42.328164+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:24.176691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:37.355395+0000","last_change":"2024-09-12T17:15:43.871865+0000","last_active":"2024-09-12T17:38:37.355395+0000","last_peered":"2024-09-12T17:38:37.355395+0000","last_clean":"2024-09-12T17:38:37.355395+0000","last_became_active":"2024-09-12T17:15:43.871095+0000","last_became_peered":"2024-09-12T17:15:43.871095+0000","last_unstale":"2024-09-12T17:38:37.355395+0000","last_undegraded":"2024-09-12T17:38:37.355395+0000","last_fullsized":"2024-09-12T17:38:37.355395+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:26.988527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'7","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:40.279107+0000","last_change":"2024-09-12T17:15:40.126453+0000","last_active":"2024-09-12T17:38:40.279107+0000","last_peered":"2024-09-12T17:38:40.279107+0000","last_clean":"2024-09-12T17:38:40.279107+0000","last_became_active":"2024-09-12T17:15:40.125684+0000","last_became_peered":"2024-09-12T17:15:40.125684+0000","last_unstale":"2024-09-12T17:38:40.279107+0000","last_undegraded":"2024-09-12T17:38:40.279107+0000","last_fullsized":"2024-09-12T17:38:40.279107+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:40.660204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":32770,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"265'38","reported_seq":147,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:46.291003+0000","last_change":"2024-09-12T17:13:54.826751+0000","last_active":"2024-09-12T17:37:46.291003+0000","last_peered":"2024-09-12T17:37:46.291003+0000","last_clean":"2024-09-12T17:37:46.291003+0000","last_became_active":"2024-09-12T17:13:54.825945+0000","last_became_peered":"2024-09-12T17:13:54.825945+0000","last_unstale":"2024-09-12T17:37:46.291003+0000","last_undegraded":"2024-09-12T17:37:46.291003+0000","last_fullsized":"2024-09-12T17:37:46.291003+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:17.823826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":132,"num_write":66,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:18.711398+0000","last_change":"2024-09-12T17:27:17.409234+0000","last_active":"2024-09-12T17:39:18.711398+0000","last_peered":"2024-09-12T17:39:18.711398+0000","last_clean":"2024-09-12T17:39:18.711398+0000","last_became_active":"2024-09-12T17:27:17.408445+0000","last_became_peered":"2024-09-12T17:27:17.408445+0000","last_unstale":"2024-09-12T17:39:18.711398+0000","last_undegraded":"2024-09-12T17:39:18.711398+0000","last_fullsized":"2024-09-12T17:39:18.711398+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:52.795384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:26.293254+0000","last_change":"2024-09-12T17:15:43.867204+0000","last_active":"2024-09-12T17:37:26.293254+0000","last_peered":"2024-09-12T17:37:26.293254+0000","last_clean":"2024-09-12T17:37:26.293254+0000","last_became_active":"2024-09-12T17:15:43.866375+0000","last_became_peered":"2024-09-12T17:15:43.866375+0000","last_unstale":"2024-09-12T17:37:26.293254+0000","last_undegraded":"2024-09-12T17:37:26.293254+0000","last_fullsized":"2024-09-12T17:37:26.293254+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:23:05.372335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"265'4","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:22.323810+0000","last_change":"2024-09-12T17:15:40.125566+0000","last_active":"2024-09-12T17:37:22.323810+0000","last_peered":"2024-09-12T17:37:22.323810+0000","last_clean":"2024-09-12T17:37:22.323810+0000","last_became_active":"2024-09-12T17:15:40.124901+0000","last_became_peered":"2024-09-12T17:15:40.124901+0000","last_unstale":"2024-09-12T17:37:22.323810+0000","last_undegraded":"2024-09-12T17:37:22.323810+0000","last_fullsized":"2024-09-12T17:37:22.323810+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:00.285681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"265'32","reported_seq":130,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:01.315756+0000","last_change":"2024-09-12T17:13:54.830950+0000","last_active":"2024-09-12T17:39:01.315756+0000","last_peered":"2024-09-12T17:39:01.315756+0000","last_clean":"2024-09-12T17:39:01.315756+0000","last_became_active":"2024-09-12T17:13:54.824810+0000","last_became_peered":"2024-09-12T17:13:54.824810+0000","last_unstale":"2024-09-12T17:39:01.315756+0000","last_undegraded":"2024-09-12T17:39:01.315756+0000","last_fullsized":"2024-09-12T17:39:01.315756+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:18.942711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":107,"num_write":61,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:46.274844+0000","last_change":"2024-09-12T17:27:17.410104+0000","last_active":"2024-09-12T17:37:46.274844+0000","last_peered":"2024-09-12T17:37:46.274844+0000","last_clean":"2024-09-12T17:37:46.274844+0000","last_became_active":"2024-09-12T17:27:17.409774+0000","last_became_peered":"2024-09-12T17:27:17.409774+0000","last_unstale":"2024-09-12T17:37:46.274844+0000","last_undegraded":"2024-09-12T17:37:46.274844+0000","last_fullsized":"2024-09-12T17:37:46.274844+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:24.438283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:26.270554+0000","last_change":"2024-09-12T17:15:43.171491+0000","last_active":"2024-09-12T17:37:26.270554+0000","last_peered":"2024-09-12T17:37:26.270554+0000","last_clean":"2024-09-12T17:37:26.270554+0000","last_became_active":"2024-09-12T17:15:43.167221+0000","last_became_peered":"2024-09-12T17:15:43.167221+0000","last_unstale":"2024-09-12T17:37:26.270554+0000","last_undegraded":"2024-09-12T17:37:26.270554+0000","last_fullsized":"2024-09-12T17:37:26.270554+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:22.949060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"262'5","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:21.291867+0000","last_change":"2024-09-12T17:15:40.131852+0000","last_active":"2024-09-12T17:37:21.291867+0000","last_peered":"2024-09-12T17:37:21.291867+0000","last_clean":"2024-09-12T17:37:21.291867+0000","last_became_active":"2024-09-12T17:15:40.131162+0000","last_became_peered":"2024-09-12T17:15:40.131162+0000","last_unstale":"2024-09-12T17:37:21.291867+0000","last_undegraded":"2024-09-12T17:37:21.291867+0000","last_fullsized":"2024-09-12T17:37:21.291867+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:28.505817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"262'228","reported_seq":763,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:58.706524+0000","last_change":"2024-09-12T17:13:54.825163+0000","last_active":"2024-09-12T17:38:58.706524+0000","last_peered":"2024-09-12T17:38:58.706524+0000","last_clean":"2024-09-12T17:38:58.706524+0000","last_became_active":"2024-09-12T17:13:54.824372+0000","last_became_peered":"2024-09-12T17:13:54.824372+0000","last_unstale":"2024-09-12T17:38:58.706524+0000","last_undegraded":"2024-09-12T17:38:58.706524+0000","last_fullsized":"2024-09-12T17:38:58.706524+0000","mapping_epoch":252,"log_start":"262'200","ondisk_log_start":"262'200","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:21.156675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1417,"num_read_kb":1102,"num_write":261,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"265'1","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:10.273048+0000","last_change":"2024-09-12T17:27:17.404784+0000","last_active":"2024-09-12T17:38:10.273048+0000","last_peered":"2024-09-12T17:38:10.273048+0000","last_clean":"2024-09-12T17:38:10.273048+0000","last_became_active":"2024-09-12T17:27:17.404001+0000","last_became_peered":"2024-09-12T17:27:17.404001+0000","last_unstale":"2024-09-12T17:38:10.273048+0000","last_undegraded":"2024-09-12T17:38:10.273048+0000","last_fullsized":"2024-09-12T17:38:10.273048+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:30.724589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:33.700764+0000","last_change":"2024-09-12T17:15:43.159967+0000","last_active":"2024-09-12T17:38:33.700764+0000","last_peered":"2024-09-12T17:38:33.700764+0000","last_clean":"2024-09-12T17:38:33.700764+0000","last_became_active":"2024-09-12T17:15:43.159256+0000","last_became_peered":"2024-09-12T17:15:43.159256+0000","last_unstale":"2024-09-12T17:38:33.700764+0000","last_undegraded":"2024-09-12T17:38:33.700764+0000","last_fullsized":"2024-09-12T17:38:33.700764+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:56.377319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"265'1","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:46.297815+0000","last_change":"2024-09-12T17:15:40.139358+0000","last_active":"2024-09-12T17:37:46.297815+0000","last_peered":"2024-09-12T17:37:46.297815+0000","last_clean":"2024-09-12T17:37:46.297815+0000","last_became_active":"2024-09-12T17:15:40.138844+0000","last_became_peered":"2024-09-12T17:15:40.138844+0000","last_unstale":"2024-09-12T17:37:46.297815+0000","last_undegraded":"2024-09-12T17:37:46.297815+0000","last_fullsized":"2024-09-12T17:37:46.297815+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:16.913094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"265'38","reported_seq":148,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:57.345346+0000","last_change":"2024-09-12T17:13:54.831688+0000","last_active":"2024-09-12T17:38:57.345346+0000","last_peered":"2024-09-12T17:38:57.345346+0000","last_clean":"2024-09-12T17:38:57.345346+0000","last_became_active":"2024-09-12T17:13:54.830999+0000","last_became_peered":"2024-09-12T17:13:54.830999+0000","last_unstale":"2024-09-12T17:38:57.345346+0000","last_undegraded":"2024-09-12T17:38:57.345346+0000","last_fullsized":"2024-09-12T17:38:57.345346+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:34.484369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":129,"num_write":64,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:07.348306+0000","last_change":"2024-09-12T17:27:17.413681+0000","last_active":"2024-09-12T17:38:07.348306+0000","last_peered":"2024-09-12T17:38:07.348306+0000","last_clean":"2024-09-12T17:38:07.348306+0000","last_became_active":"2024-09-12T17:27:17.412921+0000","last_became_peered":"2024-09-12T17:27:17.412921+0000","last_unstale":"2024-09-12T17:38:07.348306+0000","last_undegraded":"2024-09-12T17:38:07.348306+0000","last_fullsized":"2024-09-12T17:38:07.348306+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:10.295122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"265'2","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:47.329147+0000","last_change":"2024-09-12T17:15:43.155640+0000","last_active":"2024-09-12T17:37:47.329147+0000","last_peered":"2024-09-12T17:37:47.329147+0000","last_clean":"2024-09-12T17:37:47.329147+0000","last_became_active":"2024-09-12T17:15:43.154940+0000","last_became_peered":"2024-09-12T17:15:43.154940+0000","last_unstale":"2024-09-12T17:37:47.329147+0000","last_undegraded":"2024-09-12T17:37:47.329147+0000","last_fullsized":"2024-09-12T17:37:47.329147+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:09:53.313111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:36.309541+0000","last_change":"2024-09-12T17:15:40.127548+0000","last_active":"2024-09-12T17:38:36.309541+0000","last_peered":"2024-09-12T17:38:36.309541+0000","last_clean":"2024-09-12T17:38:36.309541+0000","last_became_active":"2024-09-12T17:15:40.126745+0000","last_became_peered":"2024-09-12T17:15:40.126745+0000","last_unstale":"2024-09-12T17:38:36.309541+0000","last_undegraded":"2024-09-12T17:38:36.309541+0000","last_fullsized":"2024-09-12T17:38:36.309541+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:58.903944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"265'14","reported_seq":86,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:32.319736+0000","last_change":"2024-09-12T17:13:54.841357+0000","last_active":"2024-09-12T17:39:32.319736+0000","last_peered":"2024-09-12T17:39:32.319736+0000","last_clean":"2024-09-12T17:39:32.319736+0000","last_became_active":"2024-09-12T17:13:54.840501+0000","last_became_peered":"2024-09-12T17:13:54.840501+0000","last_unstale":"2024-09-12T17:39:32.319736+0000","last_undegraded":"2024-09-12T17:39:32.319736+0000","last_fullsized":"2024-09-12T17:39:32.319736+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:07:40.561312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":51,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:42.342324+0000","last_change":"2024-09-12T17:27:17.423169+0000","last_active":"2024-09-12T17:37:42.342324+0000","last_peered":"2024-09-12T17:37:42.342324+0000","last_clean":"2024-09-12T17:37:42.342324+0000","last_became_active":"2024-09-12T17:27:17.421504+0000","last_became_peered":"2024-09-12T17:27:17.421504+0000","last_unstale":"2024-09-12T17:37:42.342324+0000","last_undegraded":"2024-09-12T17:37:42.342324+0000","last_fullsized":"2024-09-12T17:37:42.342324+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:59.982039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"265'2","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:41.303042+0000","last_change":"2024-09-12T17:15:43.163468+0000","last_active":"2024-09-12T17:38:41.303042+0000","last_peered":"2024-09-12T17:38:41.303042+0000","last_clean":"2024-09-12T17:38:41.303042+0000","last_became_active":"2024-09-12T17:15:43.162406+0000","last_became_peered":"2024-09-12T17:15:43.162406+0000","last_unstale":"2024-09-12T17:38:41.303042+0000","last_undegraded":"2024-09-12T17:38:41.303042+0000","last_fullsized":"2024-09-12T17:38:41.303042+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:52.019907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"265'8","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:38.701839+0000","last_change":"2024-09-12T17:15:40.116483+0000","last_active":"2024-09-12T17:38:38.701839+0000","last_peered":"2024-09-12T17:38:38.701839+0000","last_clean":"2024-09-12T17:38:38.701839+0000","last_became_active":"2024-09-12T17:15:40.115746+0000","last_became_peered":"2024-09-12T17:15:40.115746+0000","last_unstale":"2024-09-12T17:38:38.701839+0000","last_undegraded":"2024-09-12T17:38:38.701839+0000","last_fullsized":"2024-09-12T17:38:38.701839+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:04.139173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":12288,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"265'17","reported_seq":96,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:31.674540+0000","last_change":"2024-09-12T17:13:54.838973+0000","last_active":"2024-09-12T17:39:31.674540+0000","last_peered":"2024-09-12T17:39:31.674540+0000","last_clean":"2024-09-12T17:39:31.674540+0000","last_became_active":"2024-09-12T17:13:54.838008+0000","last_became_peered":"2024-09-12T17:13:54.838008+0000","last_unstale":"2024-09-12T17:39:31.674540+0000","last_undegraded":"2024-09-12T17:39:31.674540+0000","last_fullsized":"2024-09-12T17:39:31.674540+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:41.998918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":61,"num_write":32,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:51.299103+0000","last_change":"2024-09-12T17:27:17.409064+0000","last_active":"2024-09-12T17:37:51.299103+0000","last_peered":"2024-09-12T17:37:51.299103+0000","last_clean":"2024-09-12T17:37:51.299103+0000","last_became_active":"2024-09-12T17:27:17.408296+0000","last_became_peered":"2024-09-12T17:27:17.408296+0000","last_unstale":"2024-09-12T17:37:51.299103+0000","last_undegraded":"2024-09-12T17:37:51.299103+0000","last_fullsized":"2024-09-12T17:37:51.299103+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:40.080273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"265'5","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:41.287411+0000","last_change":"2024-09-12T17:15:43.165243+0000","last_active":"2024-09-12T17:38:41.287411+0000","last_peered":"2024-09-12T17:38:41.287411+0000","last_clean":"2024-09-12T17:38:41.287411+0000","last_became_active":"2024-09-12T17:15:43.163824+0000","last_became_peered":"2024-09-12T17:15:43.163824+0000","last_unstale":"2024-09-12T17:38:41.287411+0000","last_undegraded":"2024-09-12T17:38:41.287411+0000","last_fullsized":"2024-09-12T17:38:41.287411+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:49.835850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":5122,"num_write":5,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:36.301685+0000","last_change":"2024-09-12T17:15:40.115586+0000","last_active":"2024-09-12T17:38:36.301685+0000","last_peered":"2024-09-12T17:38:36.301685+0000","last_clean":"2024-09-12T17:38:36.301685+0000","last_became_active":"2024-09-12T17:15:40.114860+0000","last_became_peered":"2024-09-12T17:15:40.114860+0000","last_unstale":"2024-09-12T17:38:36.301685+0000","last_undegraded":"2024-09-12T17:38:36.301685+0000","last_fullsized":"2024-09-12T17:38:36.301685+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:40:36.955089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"265'55","reported_seq":197,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:56.027098+0000","last_change":"2024-09-12T17:13:54.833779+0000","last_active":"2024-09-12T17:38:56.027098+0000","last_peered":"2024-09-12T17:38:56.027098+0000","last_clean":"2024-09-12T17:38:56.027098+0000","last_became_active":"2024-09-12T17:13:54.832949+0000","last_became_peered":"2024-09-12T17:13:54.832949+0000","last_unstale":"2024-09-12T17:38:56.027098+0000","last_undegraded":"2024-09-12T17:38:56.027098+0000","last_fullsized":"2024-09-12T17:38:56.027098+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:16.134614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":283,"num_read_kb":200,"num_write":95,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"265'313","reported_seq":1004,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:01.804770+0000","last_change":"2024-09-12T16:58:18.717372+0000","last_active":"2024-09-12T17:40:01.804770+0000","last_peered":"2024-09-12T17:40:01.804770+0000","last_clean":"2024-09-12T17:40:01.804770+0000","last_became_active":"2024-09-12T16:58:18.713754+0000","last_became_peered":"2024-09-12T16:58:18.713754+0000","last_unstale":"2024-09-12T17:40:01.804770+0000","last_undegraded":"2024-09-12T17:40:01.804770+0000","last_fullsized":"2024-09-12T17:40:01.804770+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:28.092364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14978175,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":556,"num_read_kb":52178,"num_write":1174,"num_write_kb":52679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"265'127","reported_seq":726,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:04.402662+0000","last_change":"2024-09-12T16:58:21.709064+0000","last_active":"2024-09-12T17:40:04.402662+0000","last_peered":"2024-09-12T17:40:04.402662+0000","last_clean":"2024-09-12T17:40:04.402662+0000","last_became_active":"2024-09-12T16:58:21.708409+0000","last_became_peered":"2024-09-12T16:58:21.708409+0000","last_unstale":"2024-09-12T17:40:04.402662+0000","last_undegraded":"2024-09-12T17:40:04.402662+0000","last_fullsized":"2024-09-12T17:40:04.402662+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:23.027142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":568,"num_read_kb":472,"num_write":186,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"265'295","reported_seq":920,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:31.602712+0000","last_change":"2024-09-12T16:58:18.700441+0000","last_active":"2024-09-12T17:39:31.602712+0000","last_peered":"2024-09-12T17:39:31.602712+0000","last_clean":"2024-09-12T17:39:31.602712+0000","last_became_active":"2024-09-12T16:58:18.699994+0000","last_became_peered":"2024-09-12T16:58:18.699994+0000","last_unstale":"2024-09-12T17:39:31.602712+0000","last_undegraded":"2024-09-12T17:39:31.602712+0000","last_fullsized":"2024-09-12T17:39:31.602712+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:51.655272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12849432,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":450,"num_read_kb":14778,"num_write":1056,"num_write_kb":32109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"265'61","reported_seq":640,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:48.739807+0000","last_change":"2024-09-12T16:58:21.722398+0000","last_active":"2024-09-12T17:39:48.739807+0000","last_peered":"2024-09-12T17:39:48.739807+0000","last_clean":"2024-09-12T17:39:48.739807+0000","last_became_active":"2024-09-12T16:58:21.721536+0000","last_became_peered":"2024-09-12T16:58:21.721536+0000","last_unstale":"2024-09-12T17:39:48.739807+0000","last_undegraded":"2024-09-12T17:39:48.739807+0000","last_fullsized":"2024-09-12T17:39:48.739807+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:56:41.263387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":297,"num_read_kb":264,"num_write":81,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"265'356","reported_seq":1163,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:38.827758+0000","last_change":"2024-09-12T16:58:18.688221+0000","last_active":"2024-09-12T17:39:38.827758+0000","last_peered":"2024-09-12T17:39:38.827758+0000","last_clean":"2024-09-12T17:39:38.827758+0000","last_became_active":"2024-09-12T16:58:18.687865+0000","last_became_peered":"2024-09-12T16:58:18.687865+0000","last_unstale":"2024-09-12T17:39:38.827758+0000","last_undegraded":"2024-09-12T17:39:38.827758+0000","last_fullsized":"2024-09-12T17:39:38.827758+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:22:44.289065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12150407,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":1002,"num_read_kb":27565,"num_write":1495,"num_write_kb":41677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"265'166","reported_seq":760,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:33.434442+0000","last_change":"2024-09-12T16:58:21.704684+0000","last_active":"2024-09-12T17:38:33.434442+0000","last_peered":"2024-09-12T17:38:33.434442+0000","last_clean":"2024-09-12T17:38:33.434442+0000","last_became_active":"2024-09-12T16:58:21.703861+0000","last_became_peered":"2024-09-12T16:58:21.703861+0000","last_unstale":"2024-09-12T17:38:33.434442+0000","last_undegraded":"2024-09-12T17:38:33.434442+0000","last_fullsized":"2024-09-12T17:38:33.434442+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:16.015246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":693,"num_read_kb":563,"num_write":272,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"265'300","reported_seq":953,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:40.000316+0000","last_change":"2024-09-12T16:58:18.717382+0000","last_active":"2024-09-12T17:39:40.000316+0000","last_peered":"2024-09-12T17:39:40.000316+0000","last_clean":"2024-09-12T17:39:40.000316+0000","last_became_active":"2024-09-12T16:58:18.716783+0000","last_became_peered":"2024-09-12T16:58:18.716783+0000","last_unstale":"2024-09-12T17:39:40.000316+0000","last_undegraded":"2024-09-12T17:39:40.000316+0000","last_fullsized":"2024-09-12T17:39:40.000316+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:09:30.963463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7484559,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":475,"num_read_kb":33905,"num_write":1138,"num_write_kb":31442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"265'206","reported_seq":808,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:23.453730+0000","last_change":"2024-09-12T16:58:21.700629+0000","last_active":"2024-09-12T17:39:23.453730+0000","last_peered":"2024-09-12T17:39:23.453730+0000","last_clean":"2024-09-12T17:39:23.453730+0000","last_became_active":"2024-09-12T16:58:21.699869+0000","last_became_peered":"2024-09-12T16:58:21.699869+0000","last_unstale":"2024-09-12T17:39:23.453730+0000","last_undegraded":"2024-09-12T17:39:23.453730+0000","last_fullsized":"2024-09-12T17:39:23.453730+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:31:52.012945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":874,"num_read_kb":727,"num_write":307,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"265'291","reported_seq":955,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:32.483128+0000","last_change":"2024-09-12T16:58:18.689386+0000","last_active":"2024-09-12T17:39:32.483128+0000","last_peered":"2024-09-12T17:39:32.483128+0000","last_clean":"2024-09-12T17:39:32.483128+0000","last_became_active":"2024-09-12T16:58:18.688345+0000","last_became_peered":"2024-09-12T16:58:18.688345+0000","last_unstale":"2024-09-12T17:39:32.483128+0000","last_undegraded":"2024-09-12T17:39:32.483128+0000","last_fullsized":"2024-09-12T17:39:32.483128+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:07.865303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7953469,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":524,"num_read_kb":27999,"num_write":1068,"num_write_kb":20285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"265'277","reported_seq":920,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:59.523406+0000","last_change":"2024-09-12T16:58:21.710632+0000","last_active":"2024-09-12T17:38:59.523406+0000","last_peered":"2024-09-12T17:38:59.523406+0000","last_clean":"2024-09-12T17:38:59.523406+0000","last_became_active":"2024-09-12T16:58:21.709879+0000","last_became_peered":"2024-09-12T16:58:21.709879+0000","last_unstale":"2024-09-12T17:38:59.523406+0000","last_undegraded":"2024-09-12T17:38:59.523406+0000","last_fullsized":"2024-09-12T17:38:59.523406+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:10.455020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1330,"num_read_kb":1122,"num_write":481,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"265'326","reported_seq":975,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:52.370950+0000","last_change":"2024-09-12T16:58:18.699099+0000","last_active":"2024-09-12T17:40:52.370950+0000","last_peered":"2024-09-12T17:40:52.370950+0000","last_clean":"2024-09-12T17:40:52.370950+0000","last_became_active":"2024-09-12T16:58:18.698280+0000","last_became_peered":"2024-09-12T16:58:18.698280+0000","last_unstale":"2024-09-12T17:40:52.370950+0000","last_undegraded":"2024-09-12T17:40:52.370950+0000","last_fullsized":"2024-09-12T17:40:52.370950+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:21:53.931060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17388488,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":534,"num_read_kb":25091,"num_write":1230,"num_write_kb":36260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"265'157","reported_seq":760,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:25.144333+0000","last_change":"2024-09-12T16:58:21.710011+0000","last_active":"2024-09-12T17:38:25.144333+0000","last_peered":"2024-09-12T17:38:25.144333+0000","last_clean":"2024-09-12T17:38:25.144333+0000","last_became_active":"2024-09-12T16:58:21.706493+0000","last_became_peered":"2024-09-12T16:58:21.706493+0000","last_unstale":"2024-09-12T17:38:25.144333+0000","last_undegraded":"2024-09-12T17:38:25.144333+0000","last_fullsized":"2024-09-12T17:38:25.144333+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:28.236536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":697,"num_read_kb":578,"num_write":245,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"265'272","reported_seq":930,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:57.873465+0000","last_change":"2024-09-12T16:58:18.695130+0000","last_active":"2024-09-12T17:38:57.873465+0000","last_peered":"2024-09-12T17:38:57.873465+0000","last_clean":"2024-09-12T17:38:57.873465+0000","last_became_active":"2024-09-12T16:58:18.694357+0000","last_became_peered":"2024-09-12T16:58:18.694357+0000","last_unstale":"2024-09-12T17:38:57.873465+0000","last_undegraded":"2024-09-12T17:38:57.873465+0000","last_fullsized":"2024-09-12T17:38:57.873465+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:09.763291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15005396,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":427,"num_read_kb":76106,"num_write":1010,"num_write_kb":48403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"265'76","reported_seq":653,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:57.331489+0000","last_change":"2024-09-12T16:58:21.723849+0000","last_active":"2024-09-12T17:37:57.331489+0000","last_peered":"2024-09-12T17:37:57.331489+0000","last_clean":"2024-09-12T17:37:57.331489+0000","last_became_active":"2024-09-12T16:58:21.723077+0000","last_became_peered":"2024-09-12T16:58:21.723077+0000","last_unstale":"2024-09-12T17:37:57.331489+0000","last_undegraded":"2024-09-12T17:37:57.331489+0000","last_fullsized":"2024-09-12T17:37:57.331489+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:24.692985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":363,"num_read_kb":315,"num_write":111,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"265'239","reported_seq":848,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:55.279526+0000","last_change":"2024-09-12T16:58:18.702345+0000","last_active":"2024-09-12T17:38:55.279526+0000","last_peered":"2024-09-12T17:38:55.279526+0000","last_clean":"2024-09-12T17:38:55.279526+0000","last_became_active":"2024-09-12T16:58:18.701590+0000","last_became_peered":"2024-09-12T16:58:18.701590+0000","last_unstale":"2024-09-12T17:38:55.279526+0000","last_undegraded":"2024-09-12T17:38:55.279526+0000","last_fullsized":"2024-09-12T17:38:55.279526+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:06.256813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9935696,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":333,"num_read_kb":1371,"num_write":858,"num_write_kb":18073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"265'138","reported_seq":739,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:36.361716+0000","last_change":"2024-09-12T16:58:21.725837+0000","last_active":"2024-09-12T17:39:36.361716+0000","last_peered":"2024-09-12T17:39:36.361716+0000","last_clean":"2024-09-12T17:39:36.361716+0000","last_became_active":"2024-09-12T16:58:21.718167+0000","last_became_peered":"2024-09-12T16:58:21.718167+0000","last_unstale":"2024-09-12T17:39:36.361716+0000","last_undegraded":"2024-09-12T17:39:36.361716+0000","last_fullsized":"2024-09-12T17:39:36.361716+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:29.353963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":612,"num_read_kb":510,"num_write":201,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"265'4234","reported_seq":4884,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:42.781502+0000","last_change":"2024-09-12T16:58:21.698194+0000","last_active":"2024-09-12T17:39:42.781502+0000","last_peered":"2024-09-12T17:39:42.781502+0000","last_clean":"2024-09-12T17:39:42.781502+0000","last_became_active":"2024-09-12T16:58:21.697479+0000","last_became_peered":"2024-09-12T16:58:21.697479+0000","last_unstale":"2024-09-12T17:39:42.781502+0000","last_undegraded":"2024-09-12T17:39:42.781502+0000","last_fullsized":"2024-09-12T17:39:42.781502+0000","mapping_epoch":26,"log_start":"265'4200","ondisk_log_start":"265'4200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":3000,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:12:15.711479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17044,"num_read_kb":14289,"num_write":6359,"num_write_kb":3183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"265'252","reported_seq":876,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:40.903484+0000","last_change":"2024-09-12T16:58:18.714631+0000","last_active":"2024-09-12T17:39:40.903484+0000","last_peered":"2024-09-12T17:39:40.903484+0000","last_clean":"2024-09-12T17:39:40.903484+0000","last_became_active":"2024-09-12T16:58:18.713739+0000","last_became_peered":"2024-09-12T16:58:18.713739+0000","last_unstale":"2024-09-12T17:39:40.903484+0000","last_undegraded":"2024-09-12T17:39:40.903484+0000","last_fullsized":"2024-09-12T17:39:40.903484+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:29.786536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14027714,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":371,"num_read_kb":10222,"num_write":899,"num_write_kb":31220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"265'294","reported_seq":1006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:48.145728+0000","last_change":"2024-09-12T16:58:21.724340+0000","last_active":"2024-09-12T17:39:48.145728+0000","last_peered":"2024-09-12T17:39:48.145728+0000","last_clean":"2024-09-12T17:39:48.145728+0000","last_became_active":"2024-09-12T16:58:21.723238+0000","last_became_peered":"2024-09-12T16:58:21.723238+0000","last_unstale":"2024-09-12T17:39:48.145728+0000","last_undegraded":"2024-09-12T17:39:48.145728+0000","last_fullsized":"2024-09-12T17:39:48.145728+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:26.233677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1552,"num_read_kb":1372,"num_write":472,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"265'268","reported_seq":880,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:47.702960+0000","last_change":"2024-09-12T16:58:18.702745+0000","last_active":"2024-09-12T17:38:47.702960+0000","last_peered":"2024-09-12T17:38:47.702960+0000","last_clean":"2024-09-12T17:38:47.702960+0000","last_became_active":"2024-09-12T16:58:18.701989+0000","last_became_peered":"2024-09-12T16:58:18.701989+0000","last_unstale":"2024-09-12T17:38:47.702960+0000","last_undegraded":"2024-09-12T17:38:47.702960+0000","last_fullsized":"2024-09-12T17:38:47.702960+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:43:11.774703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3469327,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":370,"num_read_kb":5557,"num_write":955,"num_write_kb":22464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"265'183","reported_seq":791,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:12.334752+0000","last_change":"2024-09-12T16:58:21.716125+0000","last_active":"2024-09-12T17:38:12.334752+0000","last_peered":"2024-09-12T17:38:12.334752+0000","last_clean":"2024-09-12T17:38:12.334752+0000","last_became_active":"2024-09-12T16:58:21.715289+0000","last_became_peered":"2024-09-12T16:58:21.715289+0000","last_unstale":"2024-09-12T17:38:12.334752+0000","last_undegraded":"2024-09-12T17:38:12.334752+0000","last_fullsized":"2024-09-12T17:38:12.334752+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:51.702306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":782,"num_read_kb":649,"num_write":263,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"265'309","reported_seq":982,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:47.106484+0000","last_change":"2024-09-12T16:58:18.703102+0000","last_active":"2024-09-12T17:39:47.106484+0000","last_peered":"2024-09-12T17:39:47.106484+0000","last_clean":"2024-09-12T17:39:47.106484+0000","last_became_active":"2024-09-12T16:58:18.702185+0000","last_became_peered":"2024-09-12T16:58:18.702185+0000","last_unstale":"2024-09-12T17:39:47.106484+0000","last_undegraded":"2024-09-12T17:39:47.106484+0000","last_fullsized":"2024-09-12T17:39:47.106484+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:26.576879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":654678,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":530,"num_read_kb":49217,"num_write":1151,"num_write_kb":37016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"265'189","reported_seq":821,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:50.846518+0000","last_change":"2024-09-12T16:58:21.725319+0000","last_active":"2024-09-12T17:38:50.846518+0000","last_peered":"2024-09-12T17:38:50.846518+0000","last_clean":"2024-09-12T17:38:50.846518+0000","last_became_active":"2024-09-12T16:58:21.718158+0000","last_became_peered":"2024-09-12T16:58:21.718158+0000","last_unstale":"2024-09-12T17:38:50.846518+0000","last_undegraded":"2024-09-12T17:38:50.846518+0000","last_fullsized":"2024-09-12T17:38:50.846518+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:25.653319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":878,"num_read_kb":727,"num_write":304,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"265'282","reported_seq":1019,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:46.135403+0000","last_change":"2024-09-12T16:58:18.702967+0000","last_active":"2024-09-12T17:39:46.135403+0000","last_peered":"2024-09-12T17:39:46.135403+0000","last_clean":"2024-09-12T17:39:46.135403+0000","last_became_active":"2024-09-12T16:58:18.699360+0000","last_became_peered":"2024-09-12T16:58:18.699360+0000","last_unstale":"2024-09-12T17:39:46.135403+0000","last_undegraded":"2024-09-12T17:39:46.135403+0000","last_fullsized":"2024-09-12T17:39:46.135403+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:23.551727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10819431,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":555,"num_read_kb":143202,"num_write":992,"num_write_kb":36082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"265'136","reported_seq":765,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:49.202472+0000","last_change":"2024-09-12T16:58:21.728829+0000","last_active":"2024-09-12T17:39:49.202472+0000","last_peered":"2024-09-12T17:39:49.202472+0000","last_clean":"2024-09-12T17:39:49.202472+0000","last_became_active":"2024-09-12T16:58:21.728321+0000","last_became_peered":"2024-09-12T16:58:21.728321+0000","last_unstale":"2024-09-12T17:39:49.202472+0000","last_undegraded":"2024-09-12T17:39:49.202472+0000","last_fullsized":"2024-09-12T17:39:49.202472+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:15.718429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":636,"num_read_kb":537,"num_write":197,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"265'245","reported_seq":857,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:51.627999+0000","last_change":"2024-09-12T16:58:18.691138+0000","last_active":"2024-09-12T17:39:51.627999+0000","last_peered":"2024-09-12T17:39:51.627999+0000","last_clean":"2024-09-12T17:39:51.627999+0000","last_became_active":"2024-09-12T16:58:18.690634+0000","last_became_peered":"2024-09-12T16:58:18.690634+0000","last_unstale":"2024-09-12T17:39:51.627999+0000","last_undegraded":"2024-09-12T17:39:51.627999+0000","last_fullsized":"2024-09-12T17:39:51.627999+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:16.345304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15090829,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":322,"num_read_kb":27088,"num_write":877,"num_write_kb":25947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"265'299","reported_seq":897,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:01.264914+0000","last_change":"2024-09-12T16:58:21.705137+0000","last_active":"2024-09-12T17:37:01.264914+0000","last_peered":"2024-09-12T17:37:01.264914+0000","last_clean":"2024-09-12T17:37:01.264914+0000","last_became_active":"2024-09-12T16:58:21.702643+0000","last_became_peered":"2024-09-12T16:58:21.702643+0000","last_unstale":"2024-09-12T17:37:01.264914+0000","last_undegraded":"2024-09-12T17:37:01.264914+0000","last_fullsized":"2024-09-12T17:37:01.264914+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:27.298302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1307,"num_read_kb":1045,"num_write":505,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"265'274","reported_seq":1026,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:47.920128+0000","last_change":"2024-09-12T16:58:18.703569+0000","last_active":"2024-09-12T17:39:47.920128+0000","last_peered":"2024-09-12T17:39:47.920128+0000","last_clean":"2024-09-12T17:39:47.920128+0000","last_became_active":"2024-09-12T16:58:18.702310+0000","last_became_peered":"2024-09-12T16:58:18.702310+0000","last_unstale":"2024-09-12T17:39:47.920128+0000","last_undegraded":"2024-09-12T17:39:47.920128+0000","last_fullsized":"2024-09-12T17:39:47.920128+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:28.757489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5240784,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":516,"num_read_kb":31840,"num_write":994,"num_write_kb":30837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"265'153","reported_seq":661,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:05.039986+0000","last_change":"2024-09-12T16:58:29.792625+0000","last_active":"2024-09-12T17:40:05.039986+0000","last_peered":"2024-09-12T17:40:05.039986+0000","last_clean":"2024-09-12T17:40:05.039986+0000","last_became_active":"2024-09-12T16:58:29.792043+0000","last_became_peered":"2024-09-12T16:58:29.792043+0000","last_unstale":"2024-09-12T17:40:05.039986+0000","last_undegraded":"2024-09-12T17:40:05.039986+0000","last_fullsized":"2024-09-12T17:40:05.039986+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:46.501133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":230,"num_read_kb":220,"num_write":374,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"265'102","reported_seq":686,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:24.677630+0000","last_change":"2024-09-12T16:58:21.707802+0000","last_active":"2024-09-12T17:39:24.677630+0000","last_peered":"2024-09-12T17:39:24.677630+0000","last_clean":"2024-09-12T17:39:24.677630+0000","last_became_active":"2024-09-12T16:58:21.707428+0000","last_became_peered":"2024-09-12T16:58:21.707428+0000","last_unstale":"2024-09-12T17:39:24.677630+0000","last_undegraded":"2024-09-12T17:39:24.677630+0000","last_fullsized":"2024-09-12T17:39:24.677630+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:42.024002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":440,"num_read_kb":374,"num_write":161,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"265'313","reported_seq":966,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:19.144021+0000","last_change":"2024-09-12T16:58:18.716412+0000","last_active":"2024-09-12T17:41:19.144021+0000","last_peered":"2024-09-12T17:41:19.144021+0000","last_clean":"2024-09-12T17:41:19.144021+0000","last_became_active":"2024-09-12T16:58:18.714782+0000","last_became_peered":"2024-09-12T16:58:18.714782+0000","last_unstale":"2024-09-12T17:41:19.144021+0000","last_undegraded":"2024-09-12T17:41:19.144021+0000","last_fullsized":"2024-09-12T17:41:19.144021+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:30.616876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15141195,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":493,"num_read_kb":18943,"num_write":1164,"num_write_kb":58984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:07.320348+0000","last_change":"2024-09-12T16:58:23.713332+0000","last_active":"2024-09-12T17:37:07.320348+0000","last_peered":"2024-09-12T17:37:07.320348+0000","last_clean":"2024-09-12T17:37:07.320348+0000","last_became_active":"2024-09-12T16:58:23.712621+0000","last_became_peered":"2024-09-12T16:58:23.712621+0000","last_unstale":"2024-09-12T17:37:07.320348+0000","last_undegraded":"2024-09-12T17:37:07.320348+0000","last_fullsized":"2024-09-12T17:37:07.320348+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:58:32.081784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"265'333","reported_seq":926,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:04.977502+0000","last_change":"2024-09-12T16:58:25.730728+0000","last_active":"2024-09-12T17:40:04.977502+0000","last_peered":"2024-09-12T17:40:04.977502+0000","last_clean":"2024-09-12T17:40:04.977502+0000","last_became_active":"2024-09-12T16:58:25.728901+0000","last_became_peered":"2024-09-12T16:58:25.728901+0000","last_unstale":"2024-09-12T17:40:04.977502+0000","last_undegraded":"2024-09-12T17:40:04.977502+0000","last_fullsized":"2024-09-12T17:40:04.977502+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:04.800787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57249,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":536,"num_read_kb":1031,"num_write":432,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:11.289497+0000","last_change":"2024-09-12T16:58:27.753040+0000","last_active":"2024-09-12T17:37:11.289497+0000","last_peered":"2024-09-12T17:37:11.289497+0000","last_clean":"2024-09-12T17:37:11.289497+0000","last_became_active":"2024-09-12T16:58:27.752315+0000","last_became_peered":"2024-09-12T16:58:27.752315+0000","last_unstale":"2024-09-12T17:37:11.289497+0000","last_undegraded":"2024-09-12T17:37:11.289497+0000","last_fullsized":"2024-09-12T17:37:11.289497+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:39.272577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"265'126","reported_seq":675,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:03.062821+0000","last_change":"2024-09-12T16:58:29.774689+0000","last_active":"2024-09-12T17:40:03.062821+0000","last_peered":"2024-09-12T17:40:03.062821+0000","last_clean":"2024-09-12T17:40:03.062821+0000","last_became_active":"2024-09-12T16:58:29.773874+0000","last_became_peered":"2024-09-12T16:58:29.773874+0000","last_unstale":"2024-09-12T17:40:03.062821+0000","last_undegraded":"2024-09-12T17:40:03.062821+0000","last_fullsized":"2024-09-12T17:40:03.062821+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:24.286576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":191,"num_read_kb":190,"num_write":216,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"265'400","reported_seq":1050,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:42.832514+0000","last_change":"2024-09-12T16:58:21.719455+0000","last_active":"2024-09-12T17:38:42.832514+0000","last_peered":"2024-09-12T17:38:42.832514+0000","last_clean":"2024-09-12T17:38:42.832514+0000","last_became_active":"2024-09-12T16:58:21.717806+0000","last_became_peered":"2024-09-12T16:58:21.717806+0000","last_unstale":"2024-09-12T17:38:42.832514+0000","last_undegraded":"2024-09-12T17:38:42.832514+0000","last_fullsized":"2024-09-12T17:38:42.832514+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:24.079041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1815,"num_read_kb":1449,"num_write":653,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"265'287","reported_seq":973,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:44.100427+0000","last_change":"2024-09-12T16:58:18.692396+0000","last_active":"2024-09-12T17:39:44.100427+0000","last_peered":"2024-09-12T17:39:44.100427+0000","last_clean":"2024-09-12T17:39:44.100427+0000","last_became_active":"2024-09-12T16:58:18.691335+0000","last_became_peered":"2024-09-12T16:58:18.691335+0000","last_unstale":"2024-09-12T17:39:44.100427+0000","last_undegraded":"2024-09-12T17:39:44.100427+0000","last_fullsized":"2024-09-12T17:39:44.100427+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:42:36.520626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13189818,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":487,"num_read_kb":106559,"num_write":1040,"num_write_kb":67871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:17.354558+0000","last_change":"2024-09-12T16:58:23.719306+0000","last_active":"2024-09-12T17:38:17.354558+0000","last_peered":"2024-09-12T17:38:17.354558+0000","last_clean":"2024-09-12T17:38:17.354558+0000","last_became_active":"2024-09-12T16:58:23.718656+0000","last_became_peered":"2024-09-12T16:58:23.718656+0000","last_unstale":"2024-09-12T17:38:17.354558+0000","last_undegraded":"2024-09-12T17:38:17.354558+0000","last_fullsized":"2024-09-12T17:38:17.354558+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:05:10.035449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"265'99","reported_seq":621,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:22.810700+0000","last_change":"2024-09-12T16:58:25.714387+0000","last_active":"2024-09-12T17:39:22.810700+0000","last_peered":"2024-09-12T17:39:22.810700+0000","last_clean":"2024-09-12T17:39:22.810700+0000","last_became_active":"2024-09-12T16:58:25.713567+0000","last_became_peered":"2024-09-12T16:58:25.713567+0000","last_unstale":"2024-09-12T17:39:22.810700+0000","last_undegraded":"2024-09-12T17:39:22.810700+0000","last_fullsized":"2024-09-12T17:39:22.810700+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:13.593060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":95,"num_read_kb":90,"num_write":66,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:11.267295+0000","last_change":"2024-09-12T16:58:27.729072+0000","last_active":"2024-09-12T17:37:11.267295+0000","last_peered":"2024-09-12T17:37:11.267295+0000","last_clean":"2024-09-12T17:37:11.267295+0000","last_became_active":"2024-09-12T16:58:27.728276+0000","last_became_peered":"2024-09-12T16:58:27.728276+0000","last_unstale":"2024-09-12T17:37:11.267295+0000","last_undegraded":"2024-09-12T17:37:11.267295+0000","last_fullsized":"2024-09-12T17:37:11.267295+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:19.029657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"265'125","reported_seq":630,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:04.398546+0000","last_change":"2024-09-12T16:58:29.781407+0000","last_active":"2024-09-12T17:40:04.398546+0000","last_peered":"2024-09-12T17:40:04.398546+0000","last_clean":"2024-09-12T17:40:04.398546+0000","last_became_active":"2024-09-12T16:58:29.780598+0000","last_became_peered":"2024-09-12T16:58:29.780598+0000","last_unstale":"2024-09-12T17:40:04.398546+0000","last_undegraded":"2024-09-12T17:40:04.398546+0000","last_fullsized":"2024-09-12T17:40:04.398546+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:18.860850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":203,"num_read_kb":191,"num_write":301,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"265'80","reported_seq":642,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:41.116398+0000","last_change":"2024-09-12T16:58:21.719225+0000","last_active":"2024-09-12T17:39:41.116398+0000","last_peered":"2024-09-12T17:39:41.116398+0000","last_clean":"2024-09-12T17:39:41.116398+0000","last_became_active":"2024-09-12T16:58:21.718773+0000","last_became_peered":"2024-09-12T16:58:21.718773+0000","last_unstale":"2024-09-12T17:39:41.116398+0000","last_undegraded":"2024-09-12T17:39:41.116398+0000","last_fullsized":"2024-09-12T17:39:41.116398+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:06.541968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":373,"num_read_kb":312,"num_write":123,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"265'259","reported_seq":850,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:42.997703+0000","last_change":"2024-09-12T16:58:55.845287+0000","last_active":"2024-09-12T17:38:42.997703+0000","last_peered":"2024-09-12T17:38:42.997703+0000","last_clean":"2024-09-12T17:38:42.997703+0000","last_became_active":"2024-09-12T16:58:55.843826+0000","last_became_peered":"2024-09-12T16:58:55.843826+0000","last_unstale":"2024-09-12T17:38:42.997703+0000","last_undegraded":"2024-09-12T17:38:42.997703+0000","last_fullsized":"2024-09-12T17:38:42.997703+0000","mapping_epoch":37,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:56.799291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1670299,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":355,"num_read_kb":4809,"num_write":916,"num_write_kb":23718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:07.338234+0000","last_change":"2024-09-12T16:58:23.707417+0000","last_active":"2024-09-12T17:37:07.338234+0000","last_peered":"2024-09-12T17:37:07.338234+0000","last_clean":"2024-09-12T17:37:07.338234+0000","last_became_active":"2024-09-12T16:58:23.706953+0000","last_became_peered":"2024-09-12T16:58:23.706953+0000","last_unstale":"2024-09-12T17:37:07.338234+0000","last_undegraded":"2024-09-12T17:37:07.338234+0000","last_fullsized":"2024-09-12T17:37:07.338234+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:53.755342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"265'105","reported_seq":638,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:11.702449+0000","last_change":"2024-09-12T16:58:25.714085+0000","last_active":"2024-09-12T17:39:11.702449+0000","last_peered":"2024-09-12T17:39:11.702449+0000","last_clean":"2024-09-12T17:39:11.702449+0000","last_became_active":"2024-09-12T16:58:25.713213+0000","last_became_peered":"2024-09-12T16:58:25.713213+0000","last_unstale":"2024-09-12T17:39:11.702449+0000","last_undegraded":"2024-09-12T17:39:11.702449+0000","last_fullsized":"2024-09-12T17:39:11.702449+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:25.447055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":116,"num_write":82,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"265'765","reported_seq":4617,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:25.115189+0000","last_change":"2024-09-12T16:58:27.753546+0000","last_active":"2024-09-12T17:41:25.115189+0000","last_peered":"2024-09-12T17:41:25.115189+0000","last_clean":"2024-09-12T17:41:25.115189+0000","last_became_active":"2024-09-12T16:58:27.752801+0000","last_became_peered":"2024-09-12T16:58:27.752801+0000","last_unstale":"2024-09-12T17:41:25.115189+0000","last_undegraded":"2024-09-12T17:41:25.115189+0000","last_fullsized":"2024-09-12T17:41:25.115189+0000","mapping_epoch":32,"log_start":"265'702","ondisk_log_start":"265'702","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":702,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:03.558787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"265'204","reported_seq":1022,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:05.112599+0000","last_change":"2024-09-12T16:58:29.770179+0000","last_active":"2024-09-12T17:40:05.112599+0000","last_peered":"2024-09-12T17:40:05.112599+0000","last_clean":"2024-09-12T17:40:05.112599+0000","last_became_active":"2024-09-12T16:58:29.769351+0000","last_became_peered":"2024-09-12T16:58:29.769351+0000","last_unstale":"2024-09-12T17:40:05.112599+0000","last_undegraded":"2024-09-12T17:40:05.112599+0000","last_fullsized":"2024-09-12T17:40:05.112599+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:38.433650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":633,"num_read_kb":631,"num_write":454,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"265'164","reported_seq":753,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:34.507430+0000","last_change":"2024-09-12T16:58:21.711086+0000","last_active":"2024-09-12T17:39:34.507430+0000","last_peered":"2024-09-12T17:39:34.507430+0000","last_clean":"2024-09-12T17:39:34.507430+0000","last_became_active":"2024-09-12T16:58:21.710646+0000","last_became_peered":"2024-09-12T16:58:21.710646+0000","last_unstale":"2024-09-12T17:39:34.507430+0000","last_undegraded":"2024-09-12T17:39:34.507430+0000","last_fullsized":"2024-09-12T17:39:34.507430+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:34:16.873776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":698,"num_read_kb":573,"num_write":260,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"265'270","reported_seq":895,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:02.051145+0000","last_change":"2024-09-12T16:58:18.690508+0000","last_active":"2024-09-12T17:40:02.051145+0000","last_peered":"2024-09-12T17:40:02.051145+0000","last_clean":"2024-09-12T17:40:02.051145+0000","last_became_active":"2024-09-12T16:58:18.689915+0000","last_became_peered":"2024-09-12T16:58:18.689915+0000","last_unstale":"2024-09-12T17:40:02.051145+0000","last_undegraded":"2024-09-12T17:40:02.051145+0000","last_fullsized":"2024-09-12T17:40:02.051145+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:30.087379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14032561,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":367,"num_read_kb":42591,"num_write":1036,"num_write_kb":36991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:07.320434+0000","last_change":"2024-09-12T16:58:23.697918+0000","last_active":"2024-09-12T17:37:07.320434+0000","last_peered":"2024-09-12T17:37:07.320434+0000","last_clean":"2024-09-12T17:37:07.320434+0000","last_became_active":"2024-09-12T16:58:23.697159+0000","last_became_peered":"2024-09-12T16:58:23.697159+0000","last_unstale":"2024-09-12T17:37:07.320434+0000","last_undegraded":"2024-09-12T17:37:07.320434+0000","last_fullsized":"2024-09-12T17:37:07.320434+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:03.312839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"265'243","reported_seq":804,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:31.322745+0000","last_change":"2024-09-12T16:58:25.949946+0000","last_active":"2024-09-12T17:39:31.322745+0000","last_peered":"2024-09-12T17:39:31.322745+0000","last_clean":"2024-09-12T17:39:31.322745+0000","last_became_active":"2024-09-12T16:58:25.949179+0000","last_became_peered":"2024-09-12T16:58:25.949179+0000","last_unstale":"2024-09-12T17:39:31.322745+0000","last_undegraded":"2024-09-12T17:39:31.322745+0000","last_fullsized":"2024-09-12T17:39:31.322745+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:40.413824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52397,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":409,"num_read_kb":858,"num_write":334,"num_write_kb":274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"265'778","reported_seq":2092,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:25.115680+0000","last_change":"2024-09-12T16:58:27.746737+0000","last_active":"2024-09-12T17:41:25.115680+0000","last_peered":"2024-09-12T17:41:25.115680+0000","last_clean":"2024-09-12T17:41:25.115680+0000","last_became_active":"2024-09-12T16:58:27.745988+0000","last_became_peered":"2024-09-12T16:58:27.745988+0000","last_unstale":"2024-09-12T17:41:25.115680+0000","last_undegraded":"2024-09-12T17:41:25.115680+0000","last_fullsized":"2024-09-12T17:41:25.115680+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":700,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:10.802947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"265'150","reported_seq":720,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:22.323591+0000","last_change":"2024-09-12T16:58:21.710840+0000","last_active":"2024-09-12T17:37:22.323591+0000","last_peered":"2024-09-12T17:37:22.323591+0000","last_clean":"2024-09-12T17:37:22.323591+0000","last_became_active":"2024-09-12T16:58:21.710029+0000","last_became_peered":"2024-09-12T16:58:21.710029+0000","last_unstale":"2024-09-12T17:37:22.323591+0000","last_undegraded":"2024-09-12T17:37:22.323591+0000","last_fullsized":"2024-09-12T17:37:22.323591+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:16.606525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":614,"num_read_kb":496,"num_write":228,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"265'293","reported_seq":940,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:48.924397+0000","last_change":"2024-09-12T16:58:18.717733+0000","last_active":"2024-09-12T17:39:48.924397+0000","last_peered":"2024-09-12T17:39:48.924397+0000","last_clean":"2024-09-12T17:39:48.924397+0000","last_became_active":"2024-09-12T16:58:18.715448+0000","last_became_peered":"2024-09-12T16:58:18.715448+0000","last_unstale":"2024-09-12T17:39:48.924397+0000","last_undegraded":"2024-09-12T17:39:48.924397+0000","last_fullsized":"2024-09-12T17:39:48.924397+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:12.664073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9540151,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":477,"num_read_kb":11904,"num_write":1150,"num_write_kb":32051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:26.293032+0000","last_change":"2024-09-12T16:58:23.720919+0000","last_active":"2024-09-12T17:37:26.293032+0000","last_peered":"2024-09-12T17:37:26.293032+0000","last_clean":"2024-09-12T17:37:26.293032+0000","last_became_active":"2024-09-12T16:58:23.720096+0000","last_became_peered":"2024-09-12T16:58:23.720096+0000","last_unstale":"2024-09-12T17:37:26.293032+0000","last_undegraded":"2024-09-12T17:37:26.293032+0000","last_fullsized":"2024-09-12T17:37:26.293032+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:35.342690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"265'354","reported_seq":958,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:47.356446+0000","last_change":"2024-09-12T16:58:25.947522+0000","last_active":"2024-09-12T17:39:47.356446+0000","last_peered":"2024-09-12T17:39:47.356446+0000","last_clean":"2024-09-12T17:39:47.356446+0000","last_became_active":"2024-09-12T16:58:25.946765+0000","last_became_peered":"2024-09-12T16:58:25.946765+0000","last_unstale":"2024-09-12T17:39:47.356446+0000","last_undegraded":"2024-09-12T17:39:47.356446+0000","last_fullsized":"2024-09-12T17:39:47.356446+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:15.651894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60390,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":570,"num_read_kb":1072,"num_write":458,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:53.705109+0000","last_change":"2024-09-12T16:58:27.754351+0000","last_active":"2024-09-12T17:38:53.705109+0000","last_peered":"2024-09-12T17:38:53.705109+0000","last_clean":"2024-09-12T17:38:53.705109+0000","last_became_active":"2024-09-12T16:58:27.753616+0000","last_became_peered":"2024-09-12T16:58:27.753616+0000","last_unstale":"2024-09-12T17:38:53.705109+0000","last_undegraded":"2024-09-12T17:38:53.705109+0000","last_fullsized":"2024-09-12T17:38:53.705109+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:26.306126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"265'550","reported_seq":1358,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:24.912198+0000","last_change":"2024-09-12T16:58:29.774852+0000","last_active":"2024-09-12T17:41:24.912198+0000","last_peered":"2024-09-12T17:41:24.912198+0000","last_clean":"2024-09-12T17:41:24.912198+0000","last_became_active":"2024-09-12T16:58:29.774093+0000","last_became_peered":"2024-09-12T16:58:29.774093+0000","last_unstale":"2024-09-12T17:41:24.912198+0000","last_undegraded":"2024-09-12T17:41:24.912198+0000","last_fullsized":"2024-09-12T17:41:24.912198+0000","mapping_epoch":34,"log_start":"265'500","ondisk_log_start":"265'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":500,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:00.606117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":455,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1305,"num_read_kb":1304,"num_write":1151,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"265'502","reported_seq":1254,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:45.251893+0000","last_change":"2024-09-12T16:58:21.700218+0000","last_active":"2024-09-12T17:39:45.251893+0000","last_peered":"2024-09-12T17:39:45.251893+0000","last_clean":"2024-09-12T17:39:45.251893+0000","last_became_active":"2024-09-12T16:58:21.699243+0000","last_became_peered":"2024-09-12T16:58:21.699243+0000","last_unstale":"2024-09-12T17:39:45.251893+0000","last_undegraded":"2024-09-12T17:39:45.251893+0000","last_fullsized":"2024-09-12T17:39:45.251893+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:06:32.179023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2329,"num_read_kb":1984,"num_write":852,"num_write_kb":550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"265'301","reported_seq":964,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:48.925978+0000","last_change":"2024-09-12T16:58:18.715397+0000","last_active":"2024-09-12T17:39:48.925978+0000","last_peered":"2024-09-12T17:39:48.925978+0000","last_clean":"2024-09-12T17:39:48.925978+0000","last_became_active":"2024-09-12T16:58:18.714412+0000","last_became_peered":"2024-09-12T16:58:18.714412+0000","last_unstale":"2024-09-12T17:39:48.925978+0000","last_undegraded":"2024-09-12T17:39:48.925978+0000","last_fullsized":"2024-09-12T17:39:48.925978+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:27.766473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8695797,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":447,"num_read_kb":85960,"num_write":1110,"num_write_kb":38984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:25.262997+0000","last_change":"2024-09-12T16:58:23.703982+0000","last_active":"2024-09-12T17:37:25.262997+0000","last_peered":"2024-09-12T17:37:25.262997+0000","last_clean":"2024-09-12T17:37:25.262997+0000","last_became_active":"2024-09-12T16:58:23.703534+0000","last_became_peered":"2024-09-12T16:58:23.703534+0000","last_unstale":"2024-09-12T17:37:25.262997+0000","last_undegraded":"2024-09-12T17:37:25.262997+0000","last_fullsized":"2024-09-12T17:37:25.262997+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:58.941243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"265'274","reported_seq":840,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:12.394277+0000","last_change":"2024-09-12T16:58:25.732078+0000","last_active":"2024-09-12T17:41:12.394277+0000","last_peered":"2024-09-12T17:41:12.394277+0000","last_clean":"2024-09-12T17:41:12.394277+0000","last_became_active":"2024-09-12T16:58:25.730470+0000","last_became_peered":"2024-09-12T16:58:25.730470+0000","last_unstale":"2024-09-12T17:41:12.394277+0000","last_undegraded":"2024-09-12T17:41:12.394277+0000","last_fullsized":"2024-09-12T17:41:12.394277+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:12.290691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70696,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":467,"num_read_kb":1031,"num_write":392,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:37.344950+0000","last_change":"2024-09-12T16:58:27.749638+0000","last_active":"2024-09-12T17:37:37.344950+0000","last_peered":"2024-09-12T17:37:37.344950+0000","last_clean":"2024-09-12T17:37:37.344950+0000","last_became_active":"2024-09-12T16:58:27.748461+0000","last_became_peered":"2024-09-12T16:58:27.748461+0000","last_unstale":"2024-09-12T17:37:37.344950+0000","last_undegraded":"2024-09-12T17:37:37.344950+0000","last_fullsized":"2024-09-12T17:37:37.344950+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:12.377398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"265'2416","reported_seq":4248,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:13.859519+0000","last_change":"2024-09-12T16:58:29.771539+0000","last_active":"2024-09-12T17:41:13.859519+0000","last_peered":"2024-09-12T17:41:13.859519+0000","last_clean":"2024-09-12T17:41:13.859519+0000","last_became_active":"2024-09-12T16:58:29.768469+0000","last_became_peered":"2024-09-12T16:58:29.768469+0000","last_unstale":"2024-09-12T17:41:13.859519+0000","last_undegraded":"2024-09-12T17:41:13.859519+0000","last_fullsized":"2024-09-12T17:41:13.859519+0000","mapping_epoch":34,"log_start":"265'2400","ondisk_log_start":"265'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":2400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:15.157148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":849,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6073,"num_read_kb":6065,"num_write":4892,"num_write_kb":1798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"265'217","reported_seq":796,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:29.667612+0000","last_change":"2024-09-12T16:58:21.725294+0000","last_active":"2024-09-12T17:39:29.667612+0000","last_peered":"2024-09-12T17:39:29.667612+0000","last_clean":"2024-09-12T17:39:29.667612+0000","last_became_active":"2024-09-12T16:58:21.724552+0000","last_became_peered":"2024-09-12T16:58:21.724552+0000","last_unstale":"2024-09-12T17:39:29.667612+0000","last_undegraded":"2024-09-12T17:39:29.667612+0000","last_fullsized":"2024-09-12T17:39:29.667612+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:04.685886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":914,"num_read_kb":736,"num_write":337,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"265'401","reported_seq":1145,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:51.313166+0000","last_change":"2024-09-12T16:58:55.852901+0000","last_active":"2024-09-12T17:38:51.313166+0000","last_peered":"2024-09-12T17:38:51.313166+0000","last_clean":"2024-09-12T17:38:51.313166+0000","last_became_active":"2024-09-12T16:58:55.852305+0000","last_became_peered":"2024-09-12T16:58:55.852305+0000","last_unstale":"2024-09-12T17:38:51.313166+0000","last_undegraded":"2024-09-12T17:38:51.313166+0000","last_fullsized":"2024-09-12T17:38:51.313166+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:46.869138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079522,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":846,"num_read_kb":12354,"num_write":1424,"num_write_kb":33200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:55.282325+0000","last_change":"2024-09-12T16:58:23.713816+0000","last_active":"2024-09-12T17:38:55.282325+0000","last_peered":"2024-09-12T17:38:55.282325+0000","last_clean":"2024-09-12T17:38:55.282325+0000","last_became_active":"2024-09-12T16:58:23.713241+0000","last_became_peered":"2024-09-12T16:58:23.713241+0000","last_unstale":"2024-09-12T17:38:55.282325+0000","last_undegraded":"2024-09-12T17:38:55.282325+0000","last_fullsized":"2024-09-12T17:38:55.282325+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:48.740741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"265'314","reported_seq":892,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:04.406606+0000","last_change":"2024-09-12T16:58:25.733750+0000","last_active":"2024-09-12T17:40:04.406606+0000","last_peered":"2024-09-12T17:40:04.406606+0000","last_clean":"2024-09-12T17:40:04.406606+0000","last_became_active":"2024-09-12T16:58:25.732918+0000","last_became_peered":"2024-09-12T16:58:25.732918+0000","last_unstale":"2024-09-12T17:40:04.406606+0000","last_undegraded":"2024-09-12T17:40:04.406606+0000","last_fullsized":"2024-09-12T17:40:04.406606+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:42.495838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83498,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":501,"num_read_kb":1068,"num_write":414,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"265'754","reported_seq":2456,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:25.115520+0000","last_change":"2024-09-12T16:58:27.737407+0000","last_active":"2024-09-12T17:41:25.115520+0000","last_peered":"2024-09-12T17:41:25.115520+0000","last_clean":"2024-09-12T17:41:25.115520+0000","last_became_active":"2024-09-12T16:58:27.736160+0000","last_became_peered":"2024-09-12T16:58:27.736160+0000","last_unstale":"2024-09-12T17:41:25.115520+0000","last_undegraded":"2024-09-12T17:41:25.115520+0000","last_fullsized":"2024-09-12T17:41:25.115520+0000","mapping_epoch":32,"log_start":"265'701","ondisk_log_start":"265'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":701,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:07.364813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"265'167","reported_seq":655,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:23.671352+0000","last_change":"2024-09-12T16:58:29.786539+0000","last_active":"2024-09-12T17:41:23.671352+0000","last_peered":"2024-09-12T17:41:23.671352+0000","last_clean":"2024-09-12T17:41:23.671352+0000","last_became_active":"2024-09-12T16:58:29.785621+0000","last_became_peered":"2024-09-12T16:58:29.785621+0000","last_unstale":"2024-09-12T17:41:23.671352+0000","last_undegraded":"2024-09-12T17:41:23.671352+0000","last_fullsized":"2024-09-12T17:41:23.671352+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:08.331708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":406,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":130,"num_read_kb":128,"num_write":373,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"265'203","reported_seq":795,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:52.359574+0000","last_change":"2024-09-12T16:58:21.702147+0000","last_active":"2024-09-12T17:38:52.359574+0000","last_peered":"2024-09-12T17:38:52.359574+0000","last_clean":"2024-09-12T17:38:52.359574+0000","last_became_active":"2024-09-12T16:58:21.701704+0000","last_became_peered":"2024-09-12T16:58:21.701704+0000","last_unstale":"2024-09-12T17:38:52.359574+0000","last_undegraded":"2024-09-12T17:38:52.359574+0000","last_fullsized":"2024-09-12T17:38:52.359574+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:12.535631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":867,"num_read_kb":717,"num_write":300,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"265'264","reported_seq":894,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:49.959021+0000","last_change":"2024-09-12T16:58:18.715784+0000","last_active":"2024-09-12T17:39:49.959021+0000","last_peered":"2024-09-12T17:39:49.959021+0000","last_clean":"2024-09-12T17:39:49.959021+0000","last_became_active":"2024-09-12T16:58:18.715232+0000","last_became_peered":"2024-09-12T16:58:18.715232+0000","last_unstale":"2024-09-12T17:39:49.959021+0000","last_undegraded":"2024-09-12T17:39:49.959021+0000","last_fullsized":"2024-09-12T17:39:49.959021+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:14.558882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5919472,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":406,"num_read_kb":18626,"num_write":966,"num_write_kb":30032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:30.264112+0000","last_change":"2024-09-12T16:58:23.709304+0000","last_active":"2024-09-12T17:37:30.264112+0000","last_peered":"2024-09-12T17:37:30.264112+0000","last_clean":"2024-09-12T17:37:30.264112+0000","last_became_active":"2024-09-12T16:58:23.708641+0000","last_became_peered":"2024-09-12T16:58:23.708641+0000","last_unstale":"2024-09-12T17:37:30.264112+0000","last_undegraded":"2024-09-12T17:37:30.264112+0000","last_fullsized":"2024-09-12T17:37:30.264112+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:30.695754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"265'462","reported_seq":1079,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:24.823696+0000","last_change":"2024-09-12T16:58:25.729871+0000","last_active":"2024-09-12T17:41:24.823696+0000","last_peered":"2024-09-12T17:41:24.823696+0000","last_clean":"2024-09-12T17:41:24.823696+0000","last_became_active":"2024-09-12T16:58:25.729071+0000","last_became_peered":"2024-09-12T16:58:25.729071+0000","last_unstale":"2024-09-12T17:41:24.823696+0000","last_undegraded":"2024-09-12T17:41:24.823696+0000","last_fullsized":"2024-09-12T17:41:24.823696+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:44.050528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":791,"num_read_kb":1795,"num_write":658,"num_write_kb":599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:30.264053+0000","last_change":"2024-09-12T16:58:27.734880+0000","last_active":"2024-09-12T17:37:30.264053+0000","last_peered":"2024-09-12T17:37:30.264053+0000","last_clean":"2024-09-12T17:37:30.264053+0000","last_became_active":"2024-09-12T16:58:27.734078+0000","last_became_peered":"2024-09-12T16:58:27.734078+0000","last_unstale":"2024-09-12T17:37:30.264053+0000","last_undegraded":"2024-09-12T17:37:30.264053+0000","last_fullsized":"2024-09-12T17:37:30.264053+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:51.965911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"265'88","reported_seq":588,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:25.836784+0000","last_change":"2024-09-12T16:58:29.795094+0000","last_active":"2024-09-12T17:39:25.836784+0000","last_peered":"2024-09-12T17:39:25.836784+0000","last_clean":"2024-09-12T17:39:25.836784+0000","last_became_active":"2024-09-12T16:58:29.794347+0000","last_became_peered":"2024-09-12T16:58:29.794347+0000","last_unstale":"2024-09-12T17:39:25.836784+0000","last_undegraded":"2024-09-12T17:39:25.836784+0000","last_fullsized":"2024-09-12T17:39:25.836784+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:31:39.752933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":704,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":193,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"265'212","reported_seq":801,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:41.644167+0000","last_change":"2024-09-12T16:58:21.707885+0000","last_active":"2024-09-12T17:39:41.644167+0000","last_peered":"2024-09-12T17:39:41.644167+0000","last_clean":"2024-09-12T17:39:41.644167+0000","last_became_active":"2024-09-12T16:58:21.702684+0000","last_became_peered":"2024-09-12T16:58:21.702684+0000","last_unstale":"2024-09-12T17:39:41.644167+0000","last_undegraded":"2024-09-12T17:39:41.644167+0000","last_fullsized":"2024-09-12T17:39:41.644167+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:49.497498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":882,"num_read_kb":712,"num_write":314,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"265'301","reported_seq":983,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:21.048083+0000","last_change":"2024-09-12T16:58:18.695913+0000","last_active":"2024-09-12T17:39:21.048083+0000","last_peered":"2024-09-12T17:39:21.048083+0000","last_clean":"2024-09-12T17:39:21.048083+0000","last_became_active":"2024-09-12T16:58:18.695549+0000","last_became_peered":"2024-09-12T16:58:18.695549+0000","last_unstale":"2024-09-12T17:39:21.048083+0000","last_undegraded":"2024-09-12T17:39:21.048083+0000","last_fullsized":"2024-09-12T17:39:21.048083+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:34:55.744463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10838496,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":562,"num_read_kb":12631,"num_write":1030,"num_write_kb":15900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:55.282389+0000","last_change":"2024-09-12T16:58:23.720806+0000","last_active":"2024-09-12T17:38:55.282389+0000","last_peered":"2024-09-12T17:38:55.282389+0000","last_clean":"2024-09-12T17:38:55.282389+0000","last_became_active":"2024-09-12T16:58:23.720279+0000","last_became_peered":"2024-09-12T16:58:23.720279+0000","last_unstale":"2024-09-12T17:38:55.282389+0000","last_undegraded":"2024-09-12T17:38:55.282389+0000","last_fullsized":"2024-09-12T17:38:55.282389+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:05.351245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"265'287","reported_seq":856,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:11.321522+0000","last_change":"2024-09-12T16:58:25.713751+0000","last_active":"2024-09-12T17:41:11.321522+0000","last_peered":"2024-09-12T17:41:11.321522+0000","last_clean":"2024-09-12T17:41:11.321522+0000","last_became_active":"2024-09-12T16:58:25.711682+0000","last_became_peered":"2024-09-12T16:58:25.711682+0000","last_unstale":"2024-09-12T17:41:11.321522+0000","last_undegraded":"2024-09-12T17:41:11.321522+0000","last_fullsized":"2024-09-12T17:41:11.321522+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:16.044074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60114,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":508,"num_read_kb":1032,"num_write":466,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:07.363377+0000","last_change":"2024-09-12T16:58:27.752363+0000","last_active":"2024-09-12T17:39:07.363377+0000","last_peered":"2024-09-12T17:39:07.363377+0000","last_clean":"2024-09-12T17:39:07.363377+0000","last_became_active":"2024-09-12T16:58:27.751664+0000","last_became_peered":"2024-09-12T16:58:27.751664+0000","last_unstale":"2024-09-12T17:39:07.363377+0000","last_undegraded":"2024-09-12T17:39:07.363377+0000","last_fullsized":"2024-09-12T17:39:07.363377+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:48.576997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"265'126","reported_seq":626,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:42.388904+0000","last_change":"2024-09-12T16:58:29.785130+0000","last_active":"2024-09-12T17:40:42.388904+0000","last_peered":"2024-09-12T17:40:42.388904+0000","last_clean":"2024-09-12T17:40:42.388904+0000","last_became_active":"2024-09-12T16:58:29.784095+0000","last_became_peered":"2024-09-12T16:58:29.784095+0000","last_unstale":"2024-09-12T17:40:42.388904+0000","last_undegraded":"2024-09-12T17:40:42.388904+0000","last_fullsized":"2024-09-12T17:40:42.388904+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:32.305201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":487,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":177,"num_read_kb":165,"num_write":304,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"265'166","reported_seq":772,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:22.504965+0000","last_change":"2024-09-12T16:58:21.730323+0000","last_active":"2024-09-12T17:39:22.504965+0000","last_peered":"2024-09-12T17:39:22.504965+0000","last_clean":"2024-09-12T17:39:22.504965+0000","last_became_active":"2024-09-12T16:58:21.728963+0000","last_became_peered":"2024-09-12T16:58:21.728963+0000","last_unstale":"2024-09-12T17:39:22.504965+0000","last_undegraded":"2024-09-12T17:39:22.504965+0000","last_fullsized":"2024-09-12T17:39:22.504965+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:54.629377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":751,"num_read_kb":615,"num_write":255,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"265'279","reported_seq":947,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:47.104983+0000","last_change":"2024-09-12T16:58:18.709400+0000","last_active":"2024-09-12T17:39:47.104983+0000","last_peered":"2024-09-12T17:39:47.104983+0000","last_clean":"2024-09-12T17:39:47.104983+0000","last_became_active":"2024-09-12T16:58:18.708689+0000","last_became_peered":"2024-09-12T16:58:18.708689+0000","last_unstale":"2024-09-12T17:39:47.104983+0000","last_undegraded":"2024-09-12T17:39:47.104983+0000","last_fullsized":"2024-09-12T17:39:47.104983+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:03.022185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9753785,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":444,"num_read_kb":124256,"num_write":1072,"num_write_kb":36504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:58.706576+0000","last_change":"2024-09-12T16:58:23.709600+0000","last_active":"2024-09-12T17:38:58.706576+0000","last_peered":"2024-09-12T17:38:58.706576+0000","last_clean":"2024-09-12T17:38:58.706576+0000","last_became_active":"2024-09-12T16:58:23.709099+0000","last_became_peered":"2024-09-12T16:58:23.709099+0000","last_unstale":"2024-09-12T17:38:58.706576+0000","last_undegraded":"2024-09-12T17:38:58.706576+0000","last_fullsized":"2024-09-12T17:38:58.706576+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:40.419144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"265'273","reported_seq":852,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:15.312923+0000","last_change":"2024-09-12T16:58:25.724609+0000","last_active":"2024-09-12T17:41:15.312923+0000","last_peered":"2024-09-12T17:41:15.312923+0000","last_clean":"2024-09-12T17:41:15.312923+0000","last_became_active":"2024-09-12T16:58:25.723894+0000","last_became_peered":"2024-09-12T16:58:25.723894+0000","last_unstale":"2024-09-12T17:41:15.312923+0000","last_undegraded":"2024-09-12T17:41:15.312923+0000","last_fullsized":"2024-09-12T17:41:15.312923+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:02.360836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64085,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":444,"num_read_kb":901,"num_write":354,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"265'724","reported_seq":2345,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:25.115608+0000","last_change":"2024-09-12T16:58:27.754030+0000","last_active":"2024-09-12T17:41:25.115608+0000","last_peered":"2024-09-12T17:41:25.115608+0000","last_clean":"2024-09-12T17:41:25.115608+0000","last_became_active":"2024-09-12T16:58:27.753179+0000","last_became_peered":"2024-09-12T16:58:27.753179+0000","last_unstale":"2024-09-12T17:41:25.115608+0000","last_undegraded":"2024-09-12T17:41:25.115608+0000","last_fullsized":"2024-09-12T17:41:25.115608+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":700,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:00.243547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"265'139","reported_seq":662,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:23.672296+0000","last_change":"2024-09-12T16:58:29.779572+0000","last_active":"2024-09-12T17:41:23.672296+0000","last_peered":"2024-09-12T17:41:23.672296+0000","last_clean":"2024-09-12T17:41:23.672296+0000","last_became_active":"2024-09-12T16:58:29.778839+0000","last_became_peered":"2024-09-12T16:58:29.778839+0000","last_unstale":"2024-09-12T17:41:23.672296+0000","last_undegraded":"2024-09-12T17:41:23.672296+0000","last_fullsized":"2024-09-12T17:41:23.672296+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:04.060160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":288,"num_read_kb":252,"num_write":342,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"265'188","reported_seq":776,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:51.289772+0000","last_change":"2024-09-12T16:58:21.707767+0000","last_active":"2024-09-12T17:38:51.289772+0000","last_peered":"2024-09-12T17:38:51.289772+0000","last_clean":"2024-09-12T17:38:51.289772+0000","last_became_active":"2024-09-12T16:58:21.706953+0000","last_became_peered":"2024-09-12T16:58:21.706953+0000","last_unstale":"2024-09-12T17:38:51.289772+0000","last_undegraded":"2024-09-12T17:38:51.289772+0000","last_fullsized":"2024-09-12T17:38:51.289772+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:00.611915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":782,"num_read_kb":644,"num_write":280,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"265'274","reported_seq":908,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:49.358546+0000","last_change":"2024-09-12T16:58:18.693726+0000","last_active":"2024-09-12T17:39:49.358546+0000","last_peered":"2024-09-12T17:39:49.358546+0000","last_clean":"2024-09-12T17:39:49.358546+0000","last_became_active":"2024-09-12T16:58:18.686189+0000","last_became_peered":"2024-09-12T16:58:18.686189+0000","last_unstale":"2024-09-12T17:39:49.358546+0000","last_undegraded":"2024-09-12T17:39:49.358546+0000","last_fullsized":"2024-09-12T17:39:49.358546+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:38.741983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3594,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":463,"num_read_kb":6575,"num_write":1003,"num_write_kb":19619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1450,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:24.537581+0000","last_change":"2024-09-12T16:58:23.707182+0000","last_active":"2024-09-12T17:41:24.537581+0000","last_peered":"2024-09-12T17:41:24.537581+0000","last_clean":"2024-09-12T17:41:24.537581+0000","last_became_active":"2024-09-12T16:58:23.706471+0000","last_became_peered":"2024-09-12T16:58:23.706471+0000","last_unstale":"2024-09-12T17:41:24.537581+0000","last_undegraded":"2024-09-12T17:41:24.537581+0000","last_fullsized":"2024-09-12T17:41:24.537581+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:02.525244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":952,"num_read_kb":952,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"265'78","reported_seq":598,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:26.200090+0000","last_change":"2024-09-12T16:58:25.950921+0000","last_active":"2024-09-12T17:39:26.200090+0000","last_peered":"2024-09-12T17:39:26.200090+0000","last_clean":"2024-09-12T17:39:26.200090+0000","last_became_active":"2024-09-12T16:58:25.949962+0000","last_became_peered":"2024-09-12T16:58:25.949962+0000","last_unstale":"2024-09-12T17:39:26.200090+0000","last_undegraded":"2024-09-12T17:39:26.200090+0000","last_fullsized":"2024-09-12T17:39:26.200090+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:35.151455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"265'754","reported_seq":4002,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:25.115415+0000","last_change":"2024-09-12T16:58:27.756362+0000","last_active":"2024-09-12T17:41:25.115415+0000","last_peered":"2024-09-12T17:41:25.115415+0000","last_clean":"2024-09-12T17:41:25.115415+0000","last_became_active":"2024-09-12T16:58:27.755569+0000","last_became_peered":"2024-09-12T16:58:27.755569+0000","last_unstale":"2024-09-12T17:41:25.115415+0000","last_undegraded":"2024-09-12T17:41:25.115415+0000","last_fullsized":"2024-09-12T17:41:25.115415+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:36.568674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"265'116","reported_seq":624,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:24.000291+0000","last_change":"2024-09-12T16:58:29.781541+0000","last_active":"2024-09-12T17:39:24.000291+0000","last_peered":"2024-09-12T17:39:24.000291+0000","last_clean":"2024-09-12T17:39:24.000291+0000","last_became_active":"2024-09-12T16:58:29.780289+0000","last_became_peered":"2024-09-12T16:58:29.780289+0000","last_unstale":"2024-09-12T17:39:24.000291+0000","last_undegraded":"2024-09-12T17:39:24.000291+0000","last_fullsized":"2024-09-12T17:39:24.000291+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:45.266710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":175,"num_write":267,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"265'140","reported_seq":797,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:32.931293+0000","last_change":"2024-09-12T16:58:21.720633+0000","last_active":"2024-09-12T17:39:32.931293+0000","last_peered":"2024-09-12T17:39:32.931293+0000","last_clean":"2024-09-12T17:39:32.931293+0000","last_became_active":"2024-09-12T16:58:21.719827+0000","last_became_peered":"2024-09-12T16:58:21.719827+0000","last_unstale":"2024-09-12T17:39:32.931293+0000","last_undegraded":"2024-09-12T17:39:32.931293+0000","last_fullsized":"2024-09-12T17:39:32.931293+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:57.062320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":689,"num_read_kb":590,"num_write":204,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"265'262","reported_seq":908,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:46.681521+0000","last_change":"2024-09-12T16:58:18.705680+0000","last_active":"2024-09-12T17:39:46.681521+0000","last_peered":"2024-09-12T17:39:46.681521+0000","last_clean":"2024-09-12T17:39:46.681521+0000","last_became_active":"2024-09-12T16:58:18.705048+0000","last_became_peered":"2024-09-12T16:58:18.705048+0000","last_unstale":"2024-09-12T17:39:46.681521+0000","last_undegraded":"2024-09-12T17:39:46.681521+0000","last_fullsized":"2024-09-12T17:39:46.681521+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:04.638122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2641574,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":432,"num_read_kb":3390,"num_write":985,"num_write_kb":22669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"36'5","reported_seq":977,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:24.522437+0000","last_change":"2024-09-12T16:58:23.703535+0000","last_active":"2024-09-12T17:41:24.522437+0000","last_peered":"2024-09-12T17:41:24.522437+0000","last_clean":"2024-09-12T17:41:24.522437+0000","last_became_active":"2024-09-12T16:58:23.702699+0000","last_became_peered":"2024-09-12T16:58:23.702699+0000","last_unstale":"2024-09-12T17:41:24.522437+0000","last_undegraded":"2024-09-12T17:41:24.522437+0000","last_fullsized":"2024-09-12T17:41:24.522437+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:52.474180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"265'339","reported_seq":938,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:12.375733+0000","last_change":"2024-09-12T16:58:25.725360+0000","last_active":"2024-09-12T17:41:12.375733+0000","last_peered":"2024-09-12T17:41:12.375733+0000","last_clean":"2024-09-12T17:41:12.375733+0000","last_became_active":"2024-09-12T16:58:25.724694+0000","last_became_peered":"2024-09-12T16:58:25.724694+0000","last_unstale":"2024-09-12T17:41:12.375733+0000","last_undegraded":"2024-09-12T17:41:12.375733+0000","last_fullsized":"2024-09-12T17:41:12.375733+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:22.997913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63869,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":549,"num_read_kb":1058,"num_write":438,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:01.307379+0000","last_change":"2024-09-12T16:58:27.741238+0000","last_active":"2024-09-12T17:39:01.307379+0000","last_peered":"2024-09-12T17:39:01.307379+0000","last_clean":"2024-09-12T17:39:01.307379+0000","last_became_active":"2024-09-12T16:58:27.740510+0000","last_became_peered":"2024-09-12T16:58:27.740510+0000","last_unstale":"2024-09-12T17:39:01.307379+0000","last_undegraded":"2024-09-12T17:39:01.307379+0000","last_fullsized":"2024-09-12T17:39:01.307379+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:22.805172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"265'127","reported_seq":619,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:03.172275+0000","last_change":"2024-09-12T16:58:29.776743+0000","last_active":"2024-09-12T17:40:03.172275+0000","last_peered":"2024-09-12T17:40:03.172275+0000","last_clean":"2024-09-12T17:40:03.172275+0000","last_became_active":"2024-09-12T16:58:29.776007+0000","last_became_peered":"2024-09-12T16:58:29.776007+0000","last_unstale":"2024-09-12T17:40:03.172275+0000","last_undegraded":"2024-09-12T17:40:03.172275+0000","last_fullsized":"2024-09-12T17:40:03.172275+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:10.538331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":162,"num_read_kb":158,"num_write":308,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"265'143","reported_seq":755,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:26.457471+0000","last_change":"2024-09-12T16:58:21.726965+0000","last_active":"2024-09-12T17:39:26.457471+0000","last_peered":"2024-09-12T17:39:26.457471+0000","last_clean":"2024-09-12T17:39:26.457471+0000","last_became_active":"2024-09-12T16:58:21.726160+0000","last_became_peered":"2024-09-12T16:58:21.726160+0000","last_unstale":"2024-09-12T17:39:26.457471+0000","last_undegraded":"2024-09-12T17:39:26.457471+0000","last_fullsized":"2024-09-12T17:39:26.457471+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:57.204197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":643,"num_read_kb":537,"num_write":216,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":612,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:16.305011+0000","last_change":"2024-09-12T16:58:04.218615+0000","last_active":"2024-09-12T17:38:16.305011+0000","last_peered":"2024-09-12T17:38:16.305011+0000","last_clean":"2024-09-12T17:38:16.305011+0000","last_became_active":"2024-09-12T16:58:04.216387+0000","last_became_peered":"2024-09-12T16:58:04.216387+0000","last_unstale":"2024-09-12T17:38:16.305011+0000","last_undegraded":"2024-09-12T17:38:16.305011+0000","last_fullsized":"2024-09-12T17:38:16.305011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:02.482619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:02.482619+0000","last_clean_scrub_stamp":"2024-09-12T16:58:02.482619+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:20.111220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":521,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:47.329290+0000","last_change":"2024-09-12T16:58:10.535498+0000","last_active":"2024-09-12T17:37:47.329290+0000","last_peered":"2024-09-12T17:37:47.329290+0000","last_clean":"2024-09-12T17:37:47.329290+0000","last_became_active":"2024-09-12T16:58:08.538227+0000","last_became_peered":"2024-09-12T16:58:08.538227+0000","last_unstale":"2024-09-12T17:37:47.329290+0000","last_undegraded":"2024-09-12T17:37:47.329290+0000","last_fullsized":"2024-09-12T17:37:47.329290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_clean_scrub_stamp":"2024-09-12T16:58:07.519706+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:36.699923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001171044,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"265'291","reported_seq":917,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:42.012113+0000","last_change":"2024-09-12T16:58:55.958137+0000","last_active":"2024-09-12T17:39:42.012113+0000","last_peered":"2024-09-12T17:39:42.012113+0000","last_clean":"2024-09-12T17:39:42.012113+0000","last_became_active":"2024-09-12T16:58:55.957231+0000","last_became_peered":"2024-09-12T16:58:55.957231+0000","last_unstale":"2024-09-12T17:39:42.012113+0000","last_undegraded":"2024-09-12T17:39:42.012113+0000","last_fullsized":"2024-09-12T17:39:42.012113+0000","mapping_epoch":37,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:39.817907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16149763,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":484,"num_read_kb":44869,"num_write":1058,"num_write_kb":45418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"36'3","reported_seq":977,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:24.524924+0000","last_change":"2024-09-12T16:58:23.719701+0000","last_active":"2024-09-12T17:41:24.524924+0000","last_peered":"2024-09-12T17:41:24.524924+0000","last_clean":"2024-09-12T17:41:24.524924+0000","last_became_active":"2024-09-12T16:58:23.718720+0000","last_became_peered":"2024-09-12T16:58:23.718720+0000","last_unstale":"2024-09-12T17:41:24.524924+0000","last_undegraded":"2024-09-12T17:41:24.524924+0000","last_fullsized":"2024-09-12T17:41:24.524924+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:27.937180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"265'673","reported_seq":1359,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:24.873674+0000","last_change":"2024-09-12T16:58:25.721421+0000","last_active":"2024-09-12T17:41:24.873674+0000","last_peered":"2024-09-12T17:41:24.873674+0000","last_clean":"2024-09-12T17:41:24.873674+0000","last_became_active":"2024-09-12T16:58:25.720741+0000","last_became_peered":"2024-09-12T16:58:25.720741+0000","last_unstale":"2024-09-12T17:41:24.873674+0000","last_undegraded":"2024-09-12T17:41:24.873674+0000","last_fullsized":"2024-09-12T17:41:24.873674+0000","mapping_epoch":30,"log_start":"265'600","ondisk_log_start":"265'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":600,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:58.053661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":173015,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1318,"num_read_kb":2750,"num_write":1232,"num_write_kb":1100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:27.339048+0000","last_change":"2024-09-12T16:58:27.746911+0000","last_active":"2024-09-12T17:37:27.339048+0000","last_peered":"2024-09-12T17:37:27.339048+0000","last_clean":"2024-09-12T17:37:27.339048+0000","last_became_active":"2024-09-12T16:58:27.746171+0000","last_became_peered":"2024-09-12T16:58:27.746171+0000","last_unstale":"2024-09-12T17:37:27.339048+0000","last_undegraded":"2024-09-12T17:37:27.339048+0000","last_fullsized":"2024-09-12T17:37:27.339048+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:24:35.029842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"265'209","reported_seq":915,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:03.864055+0000","last_change":"2024-09-12T16:58:29.769292+0000","last_active":"2024-09-12T17:40:03.864055+0000","last_peered":"2024-09-12T17:40:03.864055+0000","last_clean":"2024-09-12T17:40:03.864055+0000","last_became_active":"2024-09-12T16:58:29.768536+0000","last_became_peered":"2024-09-12T16:58:29.768536+0000","last_unstale":"2024-09-12T17:40:03.864055+0000","last_undegraded":"2024-09-12T17:40:03.864055+0000","last_fullsized":"2024-09-12T17:40:03.864055+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:00.483017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":520,"num_read_kb":510,"num_write":443,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"265'70","reported_seq":624,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:01.041564+0000","last_change":"2024-09-12T16:58:21.724410+0000","last_active":"2024-09-12T17:40:01.041564+0000","last_peered":"2024-09-12T17:40:01.041564+0000","last_clean":"2024-09-12T17:40:01.041564+0000","last_became_active":"2024-09-12T16:58:21.723703+0000","last_became_peered":"2024-09-12T16:58:21.723703+0000","last_unstale":"2024-09-12T17:40:01.041564+0000","last_undegraded":"2024-09-12T17:40:01.041564+0000","last_fullsized":"2024-09-12T17:40:01.041564+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:47.327553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":317,"num_read_kb":265,"num_write":106,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":521,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:21.306154+0000","last_change":"2024-09-12T16:58:10.928592+0000","last_active":"2024-09-12T17:38:21.306154+0000","last_peered":"2024-09-12T17:38:21.306154+0000","last_clean":"2024-09-12T17:38:21.306154+0000","last_became_active":"2024-09-12T16:58:08.536415+0000","last_became_peered":"2024-09-12T16:58:08.536415+0000","last_unstale":"2024-09-12T17:38:21.306154+0000","last_undegraded":"2024-09-12T17:38:21.306154+0000","last_fullsized":"2024-09-12T17:38:21.306154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_clean_scrub_stamp":"2024-09-12T16:58:07.519706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:44.873424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001332909,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"265'263","reported_seq":909,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:47.437833+0000","last_change":"2024-09-12T16:58:18.696403+0000","last_active":"2024-09-12T17:39:47.437833+0000","last_peered":"2024-09-12T17:39:47.437833+0000","last_clean":"2024-09-12T17:39:47.437833+0000","last_became_active":"2024-09-12T16:58:18.695755+0000","last_became_peered":"2024-09-12T16:58:18.695755+0000","last_unstale":"2024-09-12T17:39:47.437833+0000","last_undegraded":"2024-09-12T17:39:47.437833+0000","last_fullsized":"2024-09-12T17:39:47.437833+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:56.681369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":473740,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":478,"num_read_kb":2857,"num_write":1006,"num_write_kb":24939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:27.324815+0000","last_change":"2024-09-12T16:58:23.713076+0000","last_active":"2024-09-12T17:37:27.324815+0000","last_peered":"2024-09-12T17:37:27.324815+0000","last_clean":"2024-09-12T17:37:27.324815+0000","last_became_active":"2024-09-12T16:58:23.712354+0000","last_became_peered":"2024-09-12T16:58:23.712354+0000","last_unstale":"2024-09-12T17:37:27.324815+0000","last_undegraded":"2024-09-12T17:37:27.324815+0000","last_fullsized":"2024-09-12T17:37:27.324815+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:23.368180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"265'1232","reported_seq":2673,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:25.115495+0000","last_change":"2024-09-12T16:58:25.721009+0000","last_active":"2024-09-12T17:41:25.115495+0000","last_peered":"2024-09-12T17:41:25.115495+0000","last_clean":"2024-09-12T17:41:25.115495+0000","last_became_active":"2024-09-12T16:58:25.720266+0000","last_became_peered":"2024-09-12T16:58:25.720266+0000","last_unstale":"2024-09-12T17:41:25.115495+0000","last_undegraded":"2024-09-12T17:41:25.115495+0000","last_fullsized":"2024-09-12T17:41:25.115495+0000","mapping_epoch":30,"log_start":"265'1200","ondisk_log_start":"265'1200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":1200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:01.087152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183780,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2007,"num_read_kb":3540,"num_write":1122,"num_write_kb":982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:16.305184+0000","last_change":"2024-09-12T16:58:27.746109+0000","last_active":"2024-09-12T17:38:16.305184+0000","last_peered":"2024-09-12T17:38:16.305184+0000","last_clean":"2024-09-12T17:38:16.305184+0000","last_became_active":"2024-09-12T16:58:27.745341+0000","last_became_peered":"2024-09-12T16:58:27.745341+0000","last_unstale":"2024-09-12T17:38:16.305184+0000","last_undegraded":"2024-09-12T17:38:16.305184+0000","last_fullsized":"2024-09-12T17:38:16.305184+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:12.798309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"265'209","reported_seq":724,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:45.564670+0000","last_change":"2024-09-12T16:58:29.776726+0000","last_active":"2024-09-12T17:39:45.564670+0000","last_peered":"2024-09-12T17:39:45.564670+0000","last_clean":"2024-09-12T17:39:45.564670+0000","last_became_active":"2024-09-12T16:58:29.775944+0000","last_became_peered":"2024-09-12T16:58:29.775944+0000","last_unstale":"2024-09-12T17:39:45.564670+0000","last_undegraded":"2024-09-12T17:39:45.564670+0000","last_fullsized":"2024-09-12T17:39:45.564670+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:58.956084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":347,"num_read_kb":347,"num_write":464,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"265'122","reported_seq":674,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:23.685021+0000","last_change":"2024-09-12T16:58:21.722030+0000","last_active":"2024-09-12T17:37:23.685021+0000","last_peered":"2024-09-12T17:37:23.685021+0000","last_clean":"2024-09-12T17:37:23.685021+0000","last_became_active":"2024-09-12T16:58:21.721591+0000","last_became_peered":"2024-09-12T16:58:21.721591+0000","last_unstale":"2024-09-12T17:37:23.685021+0000","last_undegraded":"2024-09-12T17:37:23.685021+0000","last_fullsized":"2024-09-12T17:37:23.685021+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:36.430469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":495,"num_read_kb":400,"num_write":173,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":521,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:45.267241+0000","last_change":"2024-09-12T16:58:10.591264+0000","last_active":"2024-09-12T17:37:45.267241+0000","last_peered":"2024-09-12T17:37:45.267241+0000","last_clean":"2024-09-12T17:37:45.267241+0000","last_became_active":"2024-09-12T16:58:08.534076+0000","last_became_peered":"2024-09-12T16:58:08.534076+0000","last_unstale":"2024-09-12T17:37:45.267241+0000","last_undegraded":"2024-09-12T17:37:45.267241+0000","last_fullsized":"2024-09-12T17:37:45.267241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_clean_scrub_stamp":"2024-09-12T16:58:07.519706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:08.414186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083305900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"265'259","reported_seq":880,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:16.236358+0000","last_change":"2024-09-12T16:58:18.706724+0000","last_active":"2024-09-12T17:41:16.236358+0000","last_peered":"2024-09-12T17:41:16.236358+0000","last_clean":"2024-09-12T17:41:16.236358+0000","last_became_active":"2024-09-12T16:58:18.702490+0000","last_became_peered":"2024-09-12T16:58:18.702490+0000","last_unstale":"2024-09-12T17:41:16.236358+0000","last_undegraded":"2024-09-12T17:41:16.236358+0000","last_fullsized":"2024-09-12T17:41:16.236358+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:03:09.377111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1385655,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":402,"num_read_kb":7668,"num_write":1001,"num_write_kb":10637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:25.263146+0000","last_change":"2024-09-12T16:58:23.724826+0000","last_active":"2024-09-12T17:37:25.263146+0000","last_peered":"2024-09-12T17:37:25.263146+0000","last_clean":"2024-09-12T17:37:25.263146+0000","last_became_active":"2024-09-12T16:58:23.724300+0000","last_became_peered":"2024-09-12T16:58:23.724300+0000","last_unstale":"2024-09-12T17:37:25.263146+0000","last_undegraded":"2024-09-12T17:37:25.263146+0000","last_fullsized":"2024-09-12T17:37:25.263146+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:36.764896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"265'230","reported_seq":1294,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:20.111355+0000","last_change":"2024-09-12T16:58:25.949888+0000","last_active":"2024-09-12T17:41:20.111355+0000","last_peered":"2024-09-12T17:41:20.111355+0000","last_clean":"2024-09-12T17:41:20.111355+0000","last_became_active":"2024-09-12T16:58:25.949120+0000","last_became_peered":"2024-09-12T16:58:25.949120+0000","last_unstale":"2024-09-12T17:41:20.111355+0000","last_undegraded":"2024-09-12T17:41:20.111355+0000","last_fullsized":"2024-09-12T17:41:20.111355+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:25.274870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":178,"num_read_kb":168,"num_write":143,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:02.347062+0000","last_change":"2024-09-12T16:58:27.736961+0000","last_active":"2024-09-12T17:38:02.347062+0000","last_peered":"2024-09-12T17:38:02.347062+0000","last_clean":"2024-09-12T17:38:02.347062+0000","last_became_active":"2024-09-12T16:58:27.736215+0000","last_became_peered":"2024-09-12T16:58:27.736215+0000","last_unstale":"2024-09-12T17:38:02.347062+0000","last_undegraded":"2024-09-12T17:38:02.347062+0000","last_fullsized":"2024-09-12T17:38:02.347062+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:39.723240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"265'249","reported_seq":855,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:05.168772+0000","last_change":"2024-09-12T16:58:29.792850+0000","last_active":"2024-09-12T17:40:05.168772+0000","last_peered":"2024-09-12T17:40:05.168772+0000","last_clean":"2024-09-12T17:40:05.168772+0000","last_became_active":"2024-09-12T16:58:29.792069+0000","last_became_peered":"2024-09-12T16:58:29.792069+0000","last_unstale":"2024-09-12T17:40:05.168772+0000","last_undegraded":"2024-09-12T17:40:05.168772+0000","last_fullsized":"2024-09-12T17:40:05.168772+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:03.093750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1041,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":529,"num_read_kb":546,"num_write":531,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"265'182","reported_seq":838,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:55.411179+0000","last_change":"2024-09-12T16:58:21.730485+0000","last_active":"2024-09-12T17:38:55.411179+0000","last_peered":"2024-09-12T17:38:55.411179+0000","last_clean":"2024-09-12T17:38:55.411179+0000","last_became_active":"2024-09-12T16:58:21.729848+0000","last_became_peered":"2024-09-12T16:58:21.729848+0000","last_unstale":"2024-09-12T17:38:55.411179+0000","last_undegraded":"2024-09-12T17:38:55.411179+0000","last_fullsized":"2024-09-12T17:38:55.411179+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:36.732505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":860,"num_read_kb":722,"num_write":267,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:47.329231+0000","last_change":"2024-09-12T16:58:10.535375+0000","last_active":"2024-09-12T17:37:47.329231+0000","last_peered":"2024-09-12T17:37:47.329231+0000","last_clean":"2024-09-12T17:37:47.329231+0000","last_became_active":"2024-09-12T16:58:08.538078+0000","last_became_peered":"2024-09-12T16:58:08.538078+0000","last_unstale":"2024-09-12T17:37:47.329231+0000","last_undegraded":"2024-09-12T17:37:47.329231+0000","last_fullsized":"2024-09-12T17:37:47.329231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_clean_scrub_stamp":"2024-09-12T16:58:07.519706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:19.309437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012028640000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"265'308","reported_seq":1019,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:51.332245+0000","last_change":"2024-09-12T16:58:18.694335+0000","last_active":"2024-09-12T17:39:51.332245+0000","last_peered":"2024-09-12T17:39:51.332245+0000","last_clean":"2024-09-12T17:39:51.332245+0000","last_became_active":"2024-09-12T16:58:18.690974+0000","last_became_peered":"2024-09-12T16:58:18.690974+0000","last_unstale":"2024-09-12T17:39:51.332245+0000","last_undegraded":"2024-09-12T17:39:51.332245+0000","last_fullsized":"2024-09-12T17:39:51.332245+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:48.350096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5648829,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":603,"num_read_kb":31815,"num_write":1085,"num_write_kb":57340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:12.349471+0000","last_change":"2024-09-12T16:58:23.713734+0000","last_active":"2024-09-12T17:38:12.349471+0000","last_peered":"2024-09-12T17:38:12.349471+0000","last_clean":"2024-09-12T17:38:12.349471+0000","last_became_active":"2024-09-12T16:58:23.713019+0000","last_became_peered":"2024-09-12T16:58:23.713019+0000","last_unstale":"2024-09-12T17:38:12.349471+0000","last_undegraded":"2024-09-12T17:38:12.349471+0000","last_fullsized":"2024-09-12T17:38:12.349471+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:50.721387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"265'106","reported_seq":647,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:37.374180+0000","last_change":"2024-09-12T16:58:25.719093+0000","last_active":"2024-09-12T17:39:37.374180+0000","last_peered":"2024-09-12T17:39:37.374180+0000","last_clean":"2024-09-12T17:39:37.374180+0000","last_became_active":"2024-09-12T16:58:25.718364+0000","last_became_peered":"2024-09-12T16:58:25.718364+0000","last_unstale":"2024-09-12T17:39:37.374180+0000","last_undegraded":"2024-09-12T17:39:37.374180+0000","last_fullsized":"2024-09-12T17:39:37.374180+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:32.974861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":134,"num_write":100,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:31.287928+0000","last_change":"2024-09-12T16:58:27.762825+0000","last_active":"2024-09-12T17:37:31.287928+0000","last_peered":"2024-09-12T17:37:31.287928+0000","last_clean":"2024-09-12T17:37:31.287928+0000","last_became_active":"2024-09-12T16:58:27.761992+0000","last_became_peered":"2024-09-12T16:58:27.761992+0000","last_unstale":"2024-09-12T17:37:31.287928+0000","last_undegraded":"2024-09-12T17:37:31.287928+0000","last_fullsized":"2024-09-12T17:37:31.287928+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:59:01.991644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"265'110","reported_seq":663,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:45.784115+0000","last_change":"2024-09-12T16:58:29.788605+0000","last_active":"2024-09-12T17:39:45.784115+0000","last_peered":"2024-09-12T17:39:45.784115+0000","last_clean":"2024-09-12T17:39:45.784115+0000","last_became_active":"2024-09-12T16:58:29.787823+0000","last_became_peered":"2024-09-12T16:58:29.787823+0000","last_unstale":"2024-09-12T17:39:45.784115+0000","last_undegraded":"2024-09-12T17:39:45.784115+0000","last_fullsized":"2024-09-12T17:39:45.784115+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:40.857819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":275,"num_read_kb":264,"num_write":276,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"265'60","reported_seq":613,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:45.856557+0000","last_change":"2024-09-12T16:58:21.722318+0000","last_active":"2024-09-12T17:38:45.856557+0000","last_peered":"2024-09-12T17:38:45.856557+0000","last_clean":"2024-09-12T17:38:45.856557+0000","last_became_active":"2024-09-12T16:58:21.720884+0000","last_became_peered":"2024-09-12T16:58:21.720884+0000","last_unstale":"2024-09-12T17:38:45.856557+0000","last_undegraded":"2024-09-12T17:38:45.856557+0000","last_fullsized":"2024-09-12T17:38:45.856557+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:32.526744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":223,"num_write":91,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"265'307","reported_seq":953,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:45.359479+0000","last_change":"2024-09-12T16:58:18.719301+0000","last_active":"2024-09-12T17:39:45.359479+0000","last_peered":"2024-09-12T17:39:45.359479+0000","last_clean":"2024-09-12T17:39:45.359479+0000","last_became_active":"2024-09-12T16:58:18.718447+0000","last_became_peered":"2024-09-12T16:58:18.718447+0000","last_unstale":"2024-09-12T17:39:45.359479+0000","last_undegraded":"2024-09-12T17:39:45.359479+0000","last_fullsized":"2024-09-12T17:39:45.359479+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:48.031054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6037511,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":446,"num_read_kb":35874,"num_write":1141,"num_write_kb":51856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":520,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:48.690429+0000","last_change":"2024-09-12T16:58:10.542079+0000","last_active":"2024-09-12T17:37:48.690429+0000","last_peered":"2024-09-12T17:37:48.690429+0000","last_clean":"2024-09-12T17:37:48.690429+0000","last_became_active":"2024-09-12T16:58:08.842793+0000","last_became_peered":"2024-09-12T16:58:08.842793+0000","last_unstale":"2024-09-12T17:37:48.690429+0000","last_undegraded":"2024-09-12T17:37:48.690429+0000","last_fullsized":"2024-09-12T17:37:48.690429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_clean_scrub_stamp":"2024-09-12T16:58:07.519706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:21.164130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001121181,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:02.347021+0000","last_change":"2024-09-12T16:58:23.712397+0000","last_active":"2024-09-12T17:38:02.347021+0000","last_peered":"2024-09-12T17:38:02.347021+0000","last_clean":"2024-09-12T17:38:02.347021+0000","last_became_active":"2024-09-12T16:58:23.710355+0000","last_became_peered":"2024-09-12T16:58:23.710355+0000","last_unstale":"2024-09-12T17:38:02.347021+0000","last_undegraded":"2024-09-12T17:38:02.347021+0000","last_fullsized":"2024-09-12T17:38:02.347021+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:49.303296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"265'560","reported_seq":1210,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:24.852082+0000","last_change":"2024-09-12T16:58:25.731056+0000","last_active":"2024-09-12T17:41:24.852082+0000","last_peered":"2024-09-12T17:41:24.852082+0000","last_clean":"2024-09-12T17:41:24.852082+0000","last_became_active":"2024-09-12T16:58:25.729627+0000","last_became_peered":"2024-09-12T16:58:25.729627+0000","last_unstale":"2024-09-12T17:41:24.852082+0000","last_undegraded":"2024-09-12T17:41:24.852082+0000","last_fullsized":"2024-09-12T17:41:24.852082+0000","mapping_epoch":30,"log_start":"265'500","ondisk_log_start":"265'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":500,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:16.481975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116167,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1549,"num_read_kb":2536,"num_write":2020,"num_write_kb":1866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:06.279604+0000","last_change":"2024-09-12T16:58:27.734028+0000","last_active":"2024-09-12T17:38:06.279604+0000","last_peered":"2024-09-12T17:38:06.279604+0000","last_clean":"2024-09-12T17:38:06.279604+0000","last_became_active":"2024-09-12T16:58:27.733289+0000","last_became_peered":"2024-09-12T16:58:27.733289+0000","last_unstale":"2024-09-12T17:38:06.279604+0000","last_undegraded":"2024-09-12T17:38:06.279604+0000","last_fullsized":"2024-09-12T17:38:06.279604+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:05.333134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"265'157","reported_seq":661,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:44.925507+0000","last_change":"2024-09-12T16:58:29.779788+0000","last_active":"2024-09-12T17:39:44.925507+0000","last_peered":"2024-09-12T17:39:44.925507+0000","last_clean":"2024-09-12T17:39:44.925507+0000","last_became_active":"2024-09-12T16:58:29.779052+0000","last_became_peered":"2024-09-12T16:58:29.779052+0000","last_unstale":"2024-09-12T17:39:44.925507+0000","last_undegraded":"2024-09-12T17:39:44.925507+0000","last_fullsized":"2024-09-12T17:39:44.925507+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:46.799747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":199,"num_read_kb":192,"num_write":361,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"265'202","reported_seq":806,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:57.345814+0000","last_change":"2024-09-12T16:58:21.702417+0000","last_active":"2024-09-12T17:37:57.345814+0000","last_peered":"2024-09-12T17:37:57.345814+0000","last_clean":"2024-09-12T17:37:57.345814+0000","last_became_active":"2024-09-12T16:58:21.701657+0000","last_became_peered":"2024-09-12T16:58:21.701657+0000","last_unstale":"2024-09-12T17:37:57.345814+0000","last_undegraded":"2024-09-12T17:37:57.345814+0000","last_fullsized":"2024-09-12T17:37:57.345814+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:39.768733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":888,"num_read_kb":728,"num_write":297,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"265'261","reported_seq":885,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:47.918431+0000","last_change":"2024-09-12T16:58:18.700995+0000","last_active":"2024-09-12T17:39:47.918431+0000","last_peered":"2024-09-12T17:39:47.918431+0000","last_clean":"2024-09-12T17:39:47.918431+0000","last_became_active":"2024-09-12T16:58:18.698417+0000","last_became_peered":"2024-09-12T16:58:18.698417+0000","last_unstale":"2024-09-12T17:39:47.918431+0000","last_undegraded":"2024-09-12T17:39:47.918431+0000","last_fullsized":"2024-09-12T17:39:47.918431+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:21:09.942403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4198169,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":393,"num_read_kb":2496,"num_write":929,"num_write_kb":19196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":520,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:56.300230+0000","last_change":"2024-09-12T16:58:10.928593+0000","last_active":"2024-09-12T17:37:56.300230+0000","last_peered":"2024-09-12T17:37:56.300230+0000","last_clean":"2024-09-12T17:37:56.300230+0000","last_became_active":"2024-09-12T16:58:08.841831+0000","last_became_peered":"2024-09-12T16:58:08.841831+0000","last_unstale":"2024-09-12T17:37:56.300230+0000","last_undegraded":"2024-09-12T17:37:56.300230+0000","last_fullsized":"2024-09-12T17:37:56.300230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_clean_scrub_stamp":"2024-09-12T16:58:07.519706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:41.789253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013535820000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:01.294217+0000","last_change":"2024-09-12T16:58:23.708567+0000","last_active":"2024-09-12T17:38:01.294217+0000","last_peered":"2024-09-12T17:38:01.294217+0000","last_clean":"2024-09-12T17:38:01.294217+0000","last_became_active":"2024-09-12T16:58:23.707729+0000","last_became_peered":"2024-09-12T16:58:23.707729+0000","last_unstale":"2024-09-12T17:38:01.294217+0000","last_undegraded":"2024-09-12T17:38:01.294217+0000","last_fullsized":"2024-09-12T17:38:01.294217+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:34.309579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"265'150","reported_seq":710,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:49.590614+0000","last_change":"2024-09-12T16:58:25.950943+0000","last_active":"2024-09-12T17:38:49.590614+0000","last_peered":"2024-09-12T17:38:49.590614+0000","last_clean":"2024-09-12T17:38:49.590614+0000","last_became_active":"2024-09-12T16:58:25.950057+0000","last_became_peered":"2024-09-12T16:58:25.950057+0000","last_unstale":"2024-09-12T17:38:49.590614+0000","last_undegraded":"2024-09-12T17:38:49.590614+0000","last_fullsized":"2024-09-12T17:38:49.590614+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:04.088948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":199,"num_read_kb":190,"num_write":134,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"265'766","reported_seq":2766,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:25.115126+0000","last_change":"2024-09-12T16:58:27.758626+0000","last_active":"2024-09-12T17:41:25.115126+0000","last_peered":"2024-09-12T17:41:25.115126+0000","last_clean":"2024-09-12T17:41:25.115126+0000","last_became_active":"2024-09-12T16:58:27.756883+0000","last_became_peered":"2024-09-12T16:58:27.756883+0000","last_unstale":"2024-09-12T17:41:25.115126+0000","last_undegraded":"2024-09-12T17:41:25.115126+0000","last_fullsized":"2024-09-12T17:41:25.115126+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:09.429114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"265'131","reported_seq":630,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:24.919336+0000","last_change":"2024-09-12T16:58:29.785504+0000","last_active":"2024-09-12T17:41:24.919336+0000","last_peered":"2024-09-12T17:41:24.919336+0000","last_clean":"2024-09-12T17:41:24.919336+0000","last_became_active":"2024-09-12T16:58:29.784743+0000","last_became_peered":"2024-09-12T16:58:29.784743+0000","last_unstale":"2024-09-12T17:41:24.919336+0000","last_undegraded":"2024-09-12T17:41:24.919336+0000","last_fullsized":"2024-09-12T17:41:24.919336+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:07.819438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1532,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":153,"num_read_kb":151,"num_write":316,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"265'49","reported_seq":586,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:32.357724+0000","last_change":"2024-09-12T16:58:21.723795+0000","last_active":"2024-09-12T17:38:32.357724+0000","last_peered":"2024-09-12T17:38:32.357724+0000","last_clean":"2024-09-12T17:38:32.357724+0000","last_became_active":"2024-09-12T16:58:21.723391+0000","last_became_peered":"2024-09-12T16:58:21.723391+0000","last_unstale":"2024-09-12T17:38:32.357724+0000","last_undegraded":"2024-09-12T17:38:32.357724+0000","last_fullsized":"2024-09-12T17:38:32.357724+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:53.524544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":182,"num_write":83,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"265'370","reported_seq":1008,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:50.752384+0000","last_change":"2024-09-12T16:58:18.687350+0000","last_active":"2024-09-12T17:39:50.752384+0000","last_peered":"2024-09-12T17:39:50.752384+0000","last_clean":"2024-09-12T17:39:50.752384+0000","last_became_active":"2024-09-12T16:58:18.686966+0000","last_became_peered":"2024-09-12T16:58:18.686966+0000","last_unstale":"2024-09-12T17:39:50.752384+0000","last_undegraded":"2024-09-12T17:39:50.752384+0000","last_fullsized":"2024-09-12T17:39:50.752384+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:41.879490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2896054,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":541,"num_read_kb":10296,"num_write":1135,"num_write_kb":24848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":520,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:18.711565+0000","last_change":"2024-09-12T16:58:10.542239+0000","last_active":"2024-09-12T17:39:18.711565+0000","last_peered":"2024-09-12T17:39:18.711565+0000","last_clean":"2024-09-12T17:39:18.711565+0000","last_became_active":"2024-09-12T16:58:08.544406+0000","last_became_peered":"2024-09-12T16:58:08.544406+0000","last_unstale":"2024-09-12T17:39:18.711565+0000","last_undegraded":"2024-09-12T17:39:18.711565+0000","last_fullsized":"2024-09-12T17:39:18.711565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_clean_scrub_stamp":"2024-09-12T16:58:07.519706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:42.866569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012247510000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:01.278478+0000","last_change":"2024-09-12T16:58:23.701057+0000","last_active":"2024-09-12T17:38:01.278478+0000","last_peered":"2024-09-12T17:38:01.278478+0000","last_clean":"2024-09-12T17:38:01.278478+0000","last_became_active":"2024-09-12T16:58:23.700331+0000","last_became_peered":"2024-09-12T16:58:23.700331+0000","last_unstale":"2024-09-12T17:38:01.278478+0000","last_undegraded":"2024-09-12T17:38:01.278478+0000","last_fullsized":"2024-09-12T17:38:01.278478+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:36.712880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"265'119","reported_seq":654,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:32.549144+0000","last_change":"2024-09-12T16:58:25.731260+0000","last_active":"2024-09-12T17:39:32.549144+0000","last_peered":"2024-09-12T17:39:32.549144+0000","last_clean":"2024-09-12T17:39:32.549144+0000","last_became_active":"2024-09-12T16:58:25.730018+0000","last_became_peered":"2024-09-12T16:58:25.730018+0000","last_unstale":"2024-09-12T17:39:32.549144+0000","last_undegraded":"2024-09-12T17:39:32.549144+0000","last_fullsized":"2024-09-12T17:39:32.549144+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:14.303705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":134,"num_read_kb":123,"num_write":96,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"265'779","reported_seq":2341,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:25.115505+0000","last_change":"2024-09-12T16:58:27.747091+0000","last_active":"2024-09-12T17:41:25.115505+0000","last_peered":"2024-09-12T17:41:25.115505+0000","last_clean":"2024-09-12T17:41:25.115505+0000","last_became_active":"2024-09-12T16:58:27.746177+0000","last_became_peered":"2024-09-12T16:58:27.746177+0000","last_unstale":"2024-09-12T17:41:25.115505+0000","last_undegraded":"2024-09-12T17:41:25.115505+0000","last_fullsized":"2024-09-12T17:41:25.115505+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:44:59.636233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"265'168","reported_seq":662,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:26.453883+0000","last_change":"2024-09-12T16:58:29.791161+0000","last_active":"2024-09-12T17:39:26.453883+0000","last_peered":"2024-09-12T17:39:26.453883+0000","last_clean":"2024-09-12T17:39:26.453883+0000","last_became_active":"2024-09-12T16:58:29.790535+0000","last_became_peered":"2024-09-12T16:58:29.790535+0000","last_unstale":"2024-09-12T17:39:26.453883+0000","last_undegraded":"2024-09-12T17:39:26.453883+0000","last_fullsized":"2024-09-12T17:39:26.453883+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:22:58.632183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":476,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":147,"num_read_kb":144,"num_write":393,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"265'96","reported_seq":660,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:46.106322+0000","last_change":"2024-09-12T16:58:21.702014+0000","last_active":"2024-09-12T17:38:46.106322+0000","last_peered":"2024-09-12T17:38:46.106322+0000","last_clean":"2024-09-12T17:38:46.106322+0000","last_became_active":"2024-09-12T16:58:21.701206+0000","last_became_peered":"2024-09-12T16:58:21.701206+0000","last_unstale":"2024-09-12T17:38:46.106322+0000","last_undegraded":"2024-09-12T17:38:46.106322+0000","last_fullsized":"2024-09-12T17:38:46.106322+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:06.784285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":405,"num_read_kb":331,"num_write":157,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"265'293","reported_seq":949,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:22.654255+0000","last_change":"2024-09-12T16:58:18.702748+0000","last_active":"2024-09-12T17:41:22.654255+0000","last_peered":"2024-09-12T17:41:22.654255+0000","last_clean":"2024-09-12T17:41:22.654255+0000","last_became_active":"2024-09-12T16:58:18.701270+0000","last_became_peered":"2024-09-12T16:58:18.701270+0000","last_unstale":"2024-09-12T17:41:22.654255+0000","last_undegraded":"2024-09-12T17:41:22.654255+0000","last_fullsized":"2024-09-12T17:41:22.654255+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:08.345573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6689943,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":501,"num_read_kb":17292,"num_write":1058,"num_write_kb":31476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":521,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:21.311776+0000","last_change":"2024-09-12T16:58:10.537187+0000","last_active":"2024-09-12T17:39:21.311776+0000","last_peered":"2024-09-12T17:39:21.311776+0000","last_clean":"2024-09-12T17:39:21.311776+0000","last_became_active":"2024-09-12T16:58:08.546519+0000","last_became_peered":"2024-09-12T16:58:08.546519+0000","last_unstale":"2024-09-12T17:39:21.311776+0000","last_undegraded":"2024-09-12T17:39:21.311776+0000","last_fullsized":"2024-09-12T17:39:21.311776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_clean_scrub_stamp":"2024-09-12T16:58:07.519706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:11.277662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088376600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:37.358927+0000","last_change":"2024-09-12T16:58:23.707506+0000","last_active":"2024-09-12T17:38:37.358927+0000","last_peered":"2024-09-12T17:38:37.358927+0000","last_clean":"2024-09-12T17:38:37.358927+0000","last_became_active":"2024-09-12T16:58:23.707022+0000","last_became_peered":"2024-09-12T16:58:23.707022+0000","last_unstale":"2024-09-12T17:38:37.358927+0000","last_undegraded":"2024-09-12T17:38:37.358927+0000","last_fullsized":"2024-09-12T17:38:37.358927+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:09.125943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"265'726","reported_seq":1428,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:24.843036+0000","last_change":"2024-09-12T16:58:25.949990+0000","last_active":"2024-09-12T17:41:24.843036+0000","last_peered":"2024-09-12T17:41:24.843036+0000","last_clean":"2024-09-12T17:41:24.843036+0000","last_became_active":"2024-09-12T16:58:25.949263+0000","last_became_peered":"2024-09-12T16:58:25.949263+0000","last_unstale":"2024-09-12T17:41:24.843036+0000","last_undegraded":"2024-09-12T17:41:24.843036+0000","last_fullsized":"2024-09-12T17:41:24.843036+0000","mapping_epoch":30,"log_start":"265'700","ondisk_log_start":"265'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":700,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:06.590619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177447,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1291,"num_read_kb":2791,"num_write":1072,"num_write_kb":912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:02.350591+0000","last_change":"2024-09-12T16:58:27.742543+0000","last_active":"2024-09-12T17:38:02.350591+0000","last_peered":"2024-09-12T17:38:02.350591+0000","last_clean":"2024-09-12T17:38:02.350591+0000","last_became_active":"2024-09-12T16:58:27.741779+0000","last_became_peered":"2024-09-12T16:58:27.741779+0000","last_unstale":"2024-09-12T17:38:02.350591+0000","last_undegraded":"2024-09-12T17:38:02.350591+0000","last_fullsized":"2024-09-12T17:38:02.350591+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:32.725498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"265'144","reported_seq":646,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:04.962585+0000","last_change":"2024-09-12T16:58:29.788557+0000","last_active":"2024-09-12T17:40:04.962585+0000","last_peered":"2024-09-12T17:40:04.962585+0000","last_clean":"2024-09-12T17:40:04.962585+0000","last_became_active":"2024-09-12T16:58:29.787692+0000","last_became_peered":"2024-09-12T16:58:29.787692+0000","last_unstale":"2024-09-12T17:40:04.962585+0000","last_undegraded":"2024-09-12T17:40:04.962585+0000","last_fullsized":"2024-09-12T17:40:04.962585+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:15.861385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":218,"num_read_kb":207,"num_write":364,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"265'162","reported_seq":712,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:05.120577+0000","last_change":"2024-09-12T16:58:29.785185+0000","last_active":"2024-09-12T17:40:05.120577+0000","last_peered":"2024-09-12T17:40:05.120577+0000","last_clean":"2024-09-12T17:40:05.120577+0000","last_became_active":"2024-09-12T16:58:29.782784+0000","last_became_peered":"2024-09-12T16:58:29.782784+0000","last_unstale":"2024-09-12T17:40:05.120577+0000","last_undegraded":"2024-09-12T17:40:05.120577+0000","last_fullsized":"2024-09-12T17:40:05.120577+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:48.171949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":629,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":266,"num_read_kb":264,"num_write":397,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"265'100","reported_seq":687,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:37.730070+0000","last_change":"2024-09-12T16:58:21.732323+0000","last_active":"2024-09-12T17:39:37.730070+0000","last_peered":"2024-09-12T17:39:37.730070+0000","last_clean":"2024-09-12T17:39:37.730070+0000","last_became_active":"2024-09-12T16:58:21.731509+0000","last_became_peered":"2024-09-12T16:58:21.731509+0000","last_unstale":"2024-09-12T17:39:37.730070+0000","last_undegraded":"2024-09-12T17:39:37.730070+0000","last_fullsized":"2024-09-12T17:39:37.730070+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:40.822664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":445,"num_read_kb":375,"num_write":158,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"265'245","reported_seq":870,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:49.957292+0000","last_change":"2024-09-12T16:58:18.701223+0000","last_active":"2024-09-12T17:39:49.957292+0000","last_peered":"2024-09-12T17:39:49.957292+0000","last_clean":"2024-09-12T17:39:49.957292+0000","last_became_active":"2024-09-12T16:58:18.700214+0000","last_became_peered":"2024-09-12T16:58:18.700214+0000","last_unstale":"2024-09-12T17:39:49.957292+0000","last_undegraded":"2024-09-12T17:39:49.957292+0000","last_fullsized":"2024-09-12T17:39:49.957292+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:13.616837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2635297,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":418,"num_read_kb":3767,"num_write":988,"num_write_kb":19533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:08.694880+0000","last_change":"2024-09-12T16:58:23.725522+0000","last_active":"2024-09-12T17:38:08.694880+0000","last_peered":"2024-09-12T17:38:08.694880+0000","last_clean":"2024-09-12T17:38:08.694880+0000","last_became_active":"2024-09-12T16:58:23.725034+0000","last_became_peered":"2024-09-12T16:58:23.725034+0000","last_unstale":"2024-09-12T17:38:08.694880+0000","last_undegraded":"2024-09-12T17:38:08.694880+0000","last_fullsized":"2024-09-12T17:38:08.694880+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:15.538364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"265'267","reported_seq":837,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:27.385791+0000","last_change":"2024-09-12T16:58:25.738410+0000","last_active":"2024-09-12T17:40:27.385791+0000","last_peered":"2024-09-12T17:40:27.385791+0000","last_clean":"2024-09-12T17:40:27.385791+0000","last_became_active":"2024-09-12T16:58:25.737706+0000","last_became_peered":"2024-09-12T16:58:25.737706+0000","last_unstale":"2024-09-12T17:40:27.385791+0000","last_undegraded":"2024-09-12T17:40:27.385791+0000","last_fullsized":"2024-09-12T17:40:27.385791+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:02:12.766927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58506,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":438,"num_read_kb":920,"num_write":360,"num_write_kb":290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:07.351743+0000","last_change":"2024-09-12T16:58:27.746931+0000","last_active":"2024-09-12T17:38:07.351743+0000","last_peered":"2024-09-12T17:38:07.351743+0000","last_clean":"2024-09-12T17:38:07.351743+0000","last_became_active":"2024-09-12T16:58:27.746143+0000","last_became_peered":"2024-09-12T16:58:27.746143+0000","last_unstale":"2024-09-12T17:38:07.351743+0000","last_undegraded":"2024-09-12T17:38:07.351743+0000","last_fullsized":"2024-09-12T17:38:07.351743+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:38.513197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"265'116","reported_seq":626,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:57.572381+0000","last_change":"2024-09-12T16:58:29.786922+0000","last_active":"2024-09-12T17:38:57.572381+0000","last_peered":"2024-09-12T17:38:57.572381+0000","last_clean":"2024-09-12T17:38:57.572381+0000","last_became_active":"2024-09-12T16:58:29.784143+0000","last_became_peered":"2024-09-12T16:58:29.784143+0000","last_unstale":"2024-09-12T17:38:57.572381+0000","last_undegraded":"2024-09-12T17:38:57.572381+0000","last_fullsized":"2024-09-12T17:38:57.572381+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:57.768618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":186,"num_write":283,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"265'174","reported_seq":827,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:47.685307+0000","last_change":"2024-09-12T16:58:21.715883+0000","last_active":"2024-09-12T17:39:47.685307+0000","last_peered":"2024-09-12T17:39:47.685307+0000","last_clean":"2024-09-12T17:39:47.685307+0000","last_became_active":"2024-09-12T16:58:21.715193+0000","last_became_peered":"2024-09-12T16:58:21.715193+0000","last_unstale":"2024-09-12T17:39:47.685307+0000","last_undegraded":"2024-09-12T17:39:47.685307+0000","last_fullsized":"2024-09-12T17:39:47.685307+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:10.766328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":752,"num_read_kb":633,"num_write":248,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"265'285","reported_seq":912,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:36.521893+0000","last_change":"2024-09-12T16:58:18.686877+0000","last_active":"2024-09-12T17:39:36.521893+0000","last_peered":"2024-09-12T17:39:36.521893+0000","last_clean":"2024-09-12T17:39:36.521893+0000","last_became_active":"2024-09-12T16:58:18.686155+0000","last_became_peered":"2024-09-12T16:58:18.686155+0000","last_unstale":"2024-09-12T17:39:36.521893+0000","last_undegraded":"2024-09-12T17:39:36.521893+0000","last_fullsized":"2024-09-12T17:39:36.521893+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:04.515838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8761417,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":474,"num_read_kb":20889,"num_write":963,"num_write_kb":24291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:07.351964+0000","last_change":"2024-09-12T16:58:23.713527+0000","last_active":"2024-09-12T17:38:07.351964+0000","last_peered":"2024-09-12T17:38:07.351964+0000","last_clean":"2024-09-12T17:38:07.351964+0000","last_became_active":"2024-09-12T16:58:23.713069+0000","last_became_peered":"2024-09-12T16:58:23.713069+0000","last_unstale":"2024-09-12T17:38:07.351964+0000","last_undegraded":"2024-09-12T17:38:07.351964+0000","last_fullsized":"2024-09-12T17:38:07.351964+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:22.939725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"265'35","reported_seq":534,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:25.845238+0000","last_change":"2024-09-12T16:58:25.731248+0000","last_active":"2024-09-12T17:39:25.845238+0000","last_peered":"2024-09-12T17:39:25.845238+0000","last_clean":"2024-09-12T17:39:25.845238+0000","last_became_active":"2024-09-12T16:58:25.730410+0000","last_became_peered":"2024-09-12T16:58:25.730410+0000","last_unstale":"2024-09-12T17:39:25.845238+0000","last_undegraded":"2024-09-12T17:39:25.845238+0000","last_fullsized":"2024-09-12T17:39:25.845238+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:19.441232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:11.303833+0000","last_change":"2024-09-12T16:58:27.743749+0000","last_active":"2024-09-12T17:38:11.303833+0000","last_peered":"2024-09-12T17:38:11.303833+0000","last_clean":"2024-09-12T17:38:11.303833+0000","last_became_active":"2024-09-12T16:58:27.742979+0000","last_became_peered":"2024-09-12T16:58:27.742979+0000","last_unstale":"2024-09-12T17:38:11.303833+0000","last_undegraded":"2024-09-12T17:38:11.303833+0000","last_fullsized":"2024-09-12T17:38:11.303833+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:29.367350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"265'208","reported_seq":728,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:04.410688+0000","last_change":"2024-09-12T16:58:29.782903+0000","last_active":"2024-09-12T17:40:04.410688+0000","last_peered":"2024-09-12T17:40:04.410688+0000","last_clean":"2024-09-12T17:40:04.410688+0000","last_became_active":"2024-09-12T16:58:29.782024+0000","last_became_peered":"2024-09-12T16:58:29.782024+0000","last_unstale":"2024-09-12T17:40:04.410688+0000","last_undegraded":"2024-09-12T17:40:04.410688+0000","last_fullsized":"2024-09-12T17:40:04.410688+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:51.452618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":358,"num_read_kb":350,"num_write":466,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"265'521","reported_seq":1253,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:02.350548+0000","last_change":"2024-09-12T16:58:21.712078+0000","last_active":"2024-09-12T17:38:02.350548+0000","last_peered":"2024-09-12T17:38:02.350548+0000","last_clean":"2024-09-12T17:38:02.350548+0000","last_became_active":"2024-09-12T16:58:21.711637+0000","last_became_peered":"2024-09-12T16:58:21.711637+0000","last_unstale":"2024-09-12T17:38:02.350548+0000","last_undegraded":"2024-09-12T17:38:02.350548+0000","last_fullsized":"2024-09-12T17:38:02.350548+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":500,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:57.113912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2547,"num_read_kb":2246,"num_write":971,"num_write_kb":585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"265'302","reported_seq":904,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:52.101304+0000","last_change":"2024-09-12T16:58:55.852662+0000","last_active":"2024-09-12T17:39:52.101304+0000","last_peered":"2024-09-12T17:39:52.101304+0000","last_clean":"2024-09-12T17:39:52.101304+0000","last_became_active":"2024-09-12T16:58:55.851886+0000","last_became_peered":"2024-09-12T16:58:55.851886+0000","last_unstale":"2024-09-12T17:39:52.101304+0000","last_undegraded":"2024-09-12T17:39:52.101304+0000","last_fullsized":"2024-09-12T17:39:52.101304+0000","mapping_epoch":37,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:44.817591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5940266,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":435,"num_read_kb":19428,"num_write":1151,"num_write_kb":23867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:06.302568+0000","last_change":"2024-09-12T16:58:23.718833+0000","last_active":"2024-09-12T17:38:06.302568+0000","last_peered":"2024-09-12T17:38:06.302568+0000","last_clean":"2024-09-12T17:38:06.302568+0000","last_became_active":"2024-09-12T16:58:23.718109+0000","last_became_peered":"2024-09-12T16:58:23.718109+0000","last_unstale":"2024-09-12T17:38:06.302568+0000","last_undegraded":"2024-09-12T17:38:06.302568+0000","last_fullsized":"2024-09-12T17:38:06.302568+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:01.727111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"265'306","reported_seq":892,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:27.385833+0000","last_change":"2024-09-12T16:58:25.739863+0000","last_active":"2024-09-12T17:40:27.385833+0000","last_peered":"2024-09-12T17:40:27.385833+0000","last_clean":"2024-09-12T17:40:27.385833+0000","last_became_active":"2024-09-12T16:58:25.738463+0000","last_became_peered":"2024-09-12T16:58:25.738463+0000","last_unstale":"2024-09-12T17:40:27.385833+0000","last_undegraded":"2024-09-12T17:40:27.385833+0000","last_fullsized":"2024-09-12T17:40:27.385833+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:48.664021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":514,"num_read_kb":1039,"num_write":420,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:11.296562+0000","last_change":"2024-09-12T16:58:27.760862+0000","last_active":"2024-09-12T17:38:11.296562+0000","last_peered":"2024-09-12T17:38:11.296562+0000","last_clean":"2024-09-12T17:38:11.296562+0000","last_became_active":"2024-09-12T16:58:27.760265+0000","last_became_peered":"2024-09-12T16:58:27.760265+0000","last_unstale":"2024-09-12T17:38:11.296562+0000","last_undegraded":"2024-09-12T17:38:11.296562+0000","last_fullsized":"2024-09-12T17:38:11.296562+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:32.912040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"265'144","reported_seq":673,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:21.515529+0000","last_change":"2024-09-12T16:58:29.777889+0000","last_active":"2024-09-12T17:39:21.515529+0000","last_peered":"2024-09-12T17:39:21.515529+0000","last_clean":"2024-09-12T17:39:21.515529+0000","last_became_active":"2024-09-12T16:58:29.776448+0000","last_became_peered":"2024-09-12T16:58:29.776448+0000","last_unstale":"2024-09-12T17:39:21.515529+0000","last_undegraded":"2024-09-12T17:39:21.515529+0000","last_fullsized":"2024-09-12T17:39:21.515529+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:41.421501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":253,"num_read_kb":229,"num_write":261,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"265'251","reported_seq":879,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:22.384616+0000","last_change":"2024-09-12T16:58:21.706067+0000","last_active":"2024-09-12T17:40:22.384616+0000","last_peered":"2024-09-12T17:40:22.384616+0000","last_clean":"2024-09-12T17:40:22.384616+0000","last_became_active":"2024-09-12T16:58:21.705619+0000","last_became_peered":"2024-09-12T16:58:21.705619+0000","last_unstale":"2024-09-12T17:40:22.384616+0000","last_undegraded":"2024-09-12T17:40:22.384616+0000","last_fullsized":"2024-09-12T17:40:22.384616+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:17.879048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1131,"num_read_kb":917,"num_write":399,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"265'253","reported_seq":897,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:39.559676+0000","last_change":"2024-09-12T16:58:18.701775+0000","last_active":"2024-09-12T17:39:39.559676+0000","last_peered":"2024-09-12T17:39:39.559676+0000","last_clean":"2024-09-12T17:39:39.559676+0000","last_became_active":"2024-09-12T16:58:18.700720+0000","last_became_peered":"2024-09-12T16:58:18.700720+0000","last_unstale":"2024-09-12T17:39:39.559676+0000","last_undegraded":"2024-09-12T17:39:39.559676+0000","last_fullsized":"2024-09-12T17:39:39.559676+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:37.311441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4941531,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":365,"num_read_kb":68507,"num_write":880,"num_write_kb":27085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:06.295440+0000","last_change":"2024-09-12T16:58:23.721747+0000","last_active":"2024-09-12T17:38:06.295440+0000","last_peered":"2024-09-12T17:38:06.295440+0000","last_clean":"2024-09-12T17:38:06.295440+0000","last_became_active":"2024-09-12T16:58:23.721005+0000","last_became_peered":"2024-09-12T16:58:23.721005+0000","last_unstale":"2024-09-12T17:38:06.295440+0000","last_undegraded":"2024-09-12T17:38:06.295440+0000","last_fullsized":"2024-09-12T17:38:06.295440+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:29.561235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"265'241","reported_seq":803,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:26.336535+0000","last_change":"2024-09-12T16:58:25.733878+0000","last_active":"2024-09-12T17:40:26.336535+0000","last_peered":"2024-09-12T17:40:26.336535+0000","last_clean":"2024-09-12T17:40:26.336535+0000","last_became_active":"2024-09-12T16:58:25.732956+0000","last_became_peered":"2024-09-12T16:58:25.732956+0000","last_unstale":"2024-09-12T17:40:26.336535+0000","last_undegraded":"2024-09-12T17:40:26.336535+0000","last_fullsized":"2024-09-12T17:40:26.336535+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:50:45.059874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":402,"num_read_kb":847,"num_write":328,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:07.348165+0000","last_change":"2024-09-12T16:58:27.747511+0000","last_active":"2024-09-12T17:38:07.348165+0000","last_peered":"2024-09-12T17:38:07.348165+0000","last_clean":"2024-09-12T17:38:07.348165+0000","last_became_active":"2024-09-12T16:58:27.737089+0000","last_became_peered":"2024-09-12T16:58:27.737089+0000","last_unstale":"2024-09-12T17:38:07.348165+0000","last_undegraded":"2024-09-12T17:38:07.348165+0000","last_fullsized":"2024-09-12T17:38:07.348165+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:38.515071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"265'132","reported_seq":778,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:45.573465+0000","last_change":"2024-09-12T16:58:21.717882+0000","last_active":"2024-09-12T17:39:45.573465+0000","last_peered":"2024-09-12T17:39:45.573465+0000","last_clean":"2024-09-12T17:39:45.573465+0000","last_became_active":"2024-09-12T16:58:21.717079+0000","last_became_peered":"2024-09-12T16:58:21.717079+0000","last_unstale":"2024-09-12T17:39:45.573465+0000","last_undegraded":"2024-09-12T17:39:45.573465+0000","last_fullsized":"2024-09-12T17:39:45.573465+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:23.381407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":593,"num_read_kb":510,"num_write":185,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"265'275","reported_seq":911,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:01.840360+0000","last_change":"2024-09-12T16:58:18.677827+0000","last_active":"2024-09-12T17:40:01.840360+0000","last_peered":"2024-09-12T17:40:01.840360+0000","last_clean":"2024-09-12T17:40:01.840360+0000","last_became_active":"2024-09-12T16:58:18.677480+0000","last_became_peered":"2024-09-12T16:58:18.677480+0000","last_unstale":"2024-09-12T17:40:01.840360+0000","last_undegraded":"2024-09-12T17:40:01.840360+0000","last_fullsized":"2024-09-12T17:40:01.840360+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:38.035768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5638569,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":396,"num_read_kb":21305,"num_write":1051,"num_write_kb":20049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:37.355462+0000","last_change":"2024-09-12T16:58:23.719669+0000","last_active":"2024-09-12T17:38:37.355462+0000","last_peered":"2024-09-12T17:38:37.355462+0000","last_clean":"2024-09-12T17:38:37.355462+0000","last_became_active":"2024-09-12T16:58:23.719039+0000","last_became_peered":"2024-09-12T16:58:23.719039+0000","last_unstale":"2024-09-12T17:38:37.355462+0000","last_undegraded":"2024-09-12T17:38:37.355462+0000","last_fullsized":"2024-09-12T17:38:37.355462+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:00.880364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"265'461","reported_seq":1078,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:24.830097+0000","last_change":"2024-09-12T16:58:25.720911+0000","last_active":"2024-09-12T17:41:24.830097+0000","last_peered":"2024-09-12T17:41:24.830097+0000","last_clean":"2024-09-12T17:41:24.830097+0000","last_became_active":"2024-09-12T16:58:25.720165+0000","last_became_peered":"2024-09-12T16:58:25.720165+0000","last_unstale":"2024-09-12T17:41:24.830097+0000","last_undegraded":"2024-09-12T17:41:24.830097+0000","last_fullsized":"2024-09-12T17:41:24.830097+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:01.154748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110463,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":793,"num_read_kb":1686,"num_write":690,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:27.338321+0000","last_change":"2024-09-12T16:58:27.750193+0000","last_active":"2024-09-12T17:38:27.338321+0000","last_peered":"2024-09-12T17:38:27.338321+0000","last_clean":"2024-09-12T17:38:27.338321+0000","last_became_active":"2024-09-12T16:58:27.749390+0000","last_became_peered":"2024-09-12T16:58:27.749390+0000","last_unstale":"2024-09-12T17:38:27.338321+0000","last_undegraded":"2024-09-12T17:38:27.338321+0000","last_fullsized":"2024-09-12T17:38:27.338321+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:54.523888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"265'184","reported_seq":732,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:45.266732+0000","last_change":"2024-09-12T16:58:29.789122+0000","last_active":"2024-09-12T17:39:45.266732+0000","last_peered":"2024-09-12T17:39:45.266732+0000","last_clean":"2024-09-12T17:39:45.266732+0000","last_became_active":"2024-09-12T16:58:29.788460+0000","last_became_peered":"2024-09-12T16:58:29.788460+0000","last_unstale":"2024-09-12T17:39:45.266732+0000","last_undegraded":"2024-09-12T17:39:45.266732+0000","last_fullsized":"2024-09-12T17:39:45.266732+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:40.064167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":436,"num_read_kb":400,"num_write":425,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"265'128","reported_seq":737,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:37.856071+0000","last_change":"2024-09-12T16:58:21.724434+0000","last_active":"2024-09-12T17:38:37.856071+0000","last_peered":"2024-09-12T17:38:37.856071+0000","last_clean":"2024-09-12T17:38:37.856071+0000","last_became_active":"2024-09-12T16:58:21.724003+0000","last_became_peered":"2024-09-12T16:58:21.724003+0000","last_unstale":"2024-09-12T17:38:37.856071+0000","last_undegraded":"2024-09-12T17:38:37.856071+0000","last_fullsized":"2024-09-12T17:38:37.856071+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:30.276259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":616,"num_read_kb":520,"num_write":198,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"265'312","reported_seq":1002,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:41.980629+0000","last_change":"2024-09-12T16:58:18.707166+0000","last_active":"2024-09-12T17:39:41.980629+0000","last_peered":"2024-09-12T17:39:41.980629+0000","last_clean":"2024-09-12T17:39:41.980629+0000","last_became_active":"2024-09-12T16:58:18.706806+0000","last_became_peered":"2024-09-12T16:58:18.706806+0000","last_unstale":"2024-09-12T17:39:41.980629+0000","last_undegraded":"2024-09-12T17:39:41.980629+0000","last_fullsized":"2024-09-12T17:39:41.980629+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:51.584155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8297433,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":547,"num_read_kb":18575,"num_write":1187,"num_write_kb":49050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:01.294381+0000","last_change":"2024-09-12T16:58:23.721449+0000","last_active":"2024-09-12T17:38:01.294381+0000","last_peered":"2024-09-12T17:38:01.294381+0000","last_clean":"2024-09-12T17:38:01.294381+0000","last_became_active":"2024-09-12T16:58:23.720654+0000","last_became_peered":"2024-09-12T16:58:23.720654+0000","last_unstale":"2024-09-12T17:38:01.294381+0000","last_undegraded":"2024-09-12T17:38:01.294381+0000","last_fullsized":"2024-09-12T17:38:01.294381+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:08.970300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"265'311","reported_seq":887,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:56.343480+0000","last_change":"2024-09-12T16:58:25.734439+0000","last_active":"2024-09-12T17:40:56.343480+0000","last_peered":"2024-09-12T17:40:56.343480+0000","last_clean":"2024-09-12T17:40:56.343480+0000","last_became_active":"2024-09-12T16:58:25.733241+0000","last_became_peered":"2024-09-12T16:58:25.733241+0000","last_unstale":"2024-09-12T17:40:56.343480+0000","last_undegraded":"2024-09-12T17:40:56.343480+0000","last_fullsized":"2024-09-12T17:40:56.343480+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:46.538919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62402,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":505,"num_read_kb":1018,"num_write":428,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:28.699837+0000","last_change":"2024-09-12T16:58:27.751196+0000","last_active":"2024-09-12T17:38:28.699837+0000","last_peered":"2024-09-12T17:38:28.699837+0000","last_clean":"2024-09-12T17:38:28.699837+0000","last_became_active":"2024-09-12T16:58:27.750328+0000","last_became_peered":"2024-09-12T16:58:27.750328+0000","last_unstale":"2024-09-12T17:38:28.699837+0000","last_undegraded":"2024-09-12T17:38:28.699837+0000","last_fullsized":"2024-09-12T17:38:28.699837+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:06.616801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"265'181","reported_seq":680,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:04.425931+0000","last_change":"2024-09-12T16:58:29.777915+0000","last_active":"2024-09-12T17:40:04.425931+0000","last_peered":"2024-09-12T17:40:04.425931+0000","last_clean":"2024-09-12T17:40:04.425931+0000","last_became_active":"2024-09-12T16:58:29.777124+0000","last_became_peered":"2024-09-12T16:58:29.777124+0000","last_unstale":"2024-09-12T17:40:04.425931+0000","last_undegraded":"2024-09-12T17:40:04.425931+0000","last_fullsized":"2024-09-12T17:40:04.425931+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:43.622054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1215,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":228,"num_read_kb":227,"num_write":517,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"265'162","reported_seq":766,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:50.195600+0000","last_change":"2024-09-12T16:58:21.698980+0000","last_active":"2024-09-12T17:39:50.195600+0000","last_peered":"2024-09-12T17:39:50.195600+0000","last_clean":"2024-09-12T17:39:50.195600+0000","last_became_active":"2024-09-12T16:58:21.698565+0000","last_became_peered":"2024-09-12T16:58:21.698565+0000","last_unstale":"2024-09-12T17:39:50.195600+0000","last_undegraded":"2024-09-12T17:39:50.195600+0000","last_fullsized":"2024-09-12T17:39:50.195600+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:53.075338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":649,"num_read_kb":535,"num_write":267,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"265'271","reported_seq":920,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:29.247539+0000","last_change":"2024-09-12T16:58:18.701060+0000","last_active":"2024-09-12T17:38:29.247539+0000","last_peered":"2024-09-12T17:38:29.247539+0000","last_clean":"2024-09-12T17:38:29.247539+0000","last_became_active":"2024-09-12T16:58:18.700196+0000","last_became_peered":"2024-09-12T16:58:18.700196+0000","last_unstale":"2024-09-12T17:38:29.247539+0000","last_undegraded":"2024-09-12T17:38:29.247539+0000","last_fullsized":"2024-09-12T17:38:29.247539+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:18.696858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8463330,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":452,"num_read_kb":4020,"num_write":1020,"num_write_kb":21150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:26.284203+0000","last_change":"2024-09-12T16:58:23.703516+0000","last_active":"2024-09-12T17:38:26.284203+0000","last_peered":"2024-09-12T17:38:26.284203+0000","last_clean":"2024-09-12T17:38:26.284203+0000","last_became_active":"2024-09-12T16:58:23.702293+0000","last_became_peered":"2024-09-12T16:58:23.702293+0000","last_unstale":"2024-09-12T17:38:26.284203+0000","last_undegraded":"2024-09-12T17:38:26.284203+0000","last_fullsized":"2024-09-12T17:38:26.284203+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:48.660513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"265'320","reported_seq":892,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:07.381333+0000","last_change":"2024-09-12T16:58:25.950771+0000","last_active":"2024-09-12T17:40:07.381333+0000","last_peered":"2024-09-12T17:40:07.381333+0000","last_clean":"2024-09-12T17:40:07.381333+0000","last_became_active":"2024-09-12T16:58:25.949883+0000","last_became_peered":"2024-09-12T16:58:25.949883+0000","last_unstale":"2024-09-12T17:40:07.381333+0000","last_undegraded":"2024-09-12T17:40:07.381333+0000","last_fullsized":"2024-09-12T17:40:07.381333+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:22.560848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64150,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":503,"num_read_kb":1034,"num_write":428,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:28.699909+0000","last_change":"2024-09-12T16:58:27.749008+0000","last_active":"2024-09-12T17:38:28.699909+0000","last_peered":"2024-09-12T17:38:28.699909+0000","last_clean":"2024-09-12T17:38:28.699909+0000","last_became_active":"2024-09-12T16:58:27.739965+0000","last_became_peered":"2024-09-12T16:58:27.739965+0000","last_unstale":"2024-09-12T17:38:28.699909+0000","last_undegraded":"2024-09-12T17:38:28.699909+0000","last_fullsized":"2024-09-12T17:38:28.699909+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:19.228861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"265'138","reported_seq":629,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:24.910801+0000","last_change":"2024-09-12T16:58:29.772039+0000","last_active":"2024-09-12T17:41:24.910801+0000","last_peered":"2024-09-12T17:41:24.910801+0000","last_clean":"2024-09-12T17:41:24.910801+0000","last_became_active":"2024-09-12T16:58:29.771267+0000","last_became_peered":"2024-09-12T16:58:29.771267+0000","last_unstale":"2024-09-12T17:41:24.910801+0000","last_undegraded":"2024-09-12T17:41:24.910801+0000","last_fullsized":"2024-09-12T17:41:24.910801+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:22.290183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":401,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":154,"num_write":321,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"265'82","reported_seq":686,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:23.736000+0000","last_change":"2024-09-12T16:58:21.730974+0000","last_active":"2024-09-12T17:41:23.736000+0000","last_peered":"2024-09-12T17:41:23.736000+0000","last_clean":"2024-09-12T17:41:23.736000+0000","last_became_active":"2024-09-12T16:58:21.730342+0000","last_became_peered":"2024-09-12T16:58:21.730342+0000","last_unstale":"2024-09-12T17:41:23.736000+0000","last_undegraded":"2024-09-12T17:41:23.736000+0000","last_fullsized":"2024-09-12T17:41:23.736000+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:08.283142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":417,"num_read_kb":364,"num_write":119,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"265'257","reported_seq":945,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:31.276771+0000","last_change":"2024-09-12T16:58:18.689099+0000","last_active":"2024-09-12T17:39:31.276771+0000","last_peered":"2024-09-12T17:39:31.276771+0000","last_clean":"2024-09-12T17:39:31.276771+0000","last_became_active":"2024-09-12T16:58:18.688773+0000","last_became_peered":"2024-09-12T16:58:18.688773+0000","last_unstale":"2024-09-12T17:39:31.276771+0000","last_undegraded":"2024-09-12T17:39:31.276771+0000","last_fullsized":"2024-09-12T17:39:31.276771+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:33.745654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12614424,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":514,"num_read_kb":43210,"num_write":984,"num_write_kb":32802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:28.699789+0000","last_change":"2024-09-12T16:58:23.709450+0000","last_active":"2024-09-12T17:38:28.699789+0000","last_peered":"2024-09-12T17:38:28.699789+0000","last_clean":"2024-09-12T17:38:28.699789+0000","last_became_active":"2024-09-12T16:58:23.709009+0000","last_became_peered":"2024-09-12T16:58:23.709009+0000","last_unstale":"2024-09-12T17:38:28.699789+0000","last_undegraded":"2024-09-12T17:38:28.699789+0000","last_fullsized":"2024-09-12T17:38:28.699789+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:45.138172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"265'88","reported_seq":608,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:22.509004+0000","last_change":"2024-09-12T16:58:25.950055+0000","last_active":"2024-09-12T17:39:22.509004+0000","last_peered":"2024-09-12T17:39:22.509004+0000","last_clean":"2024-09-12T17:39:22.509004+0000","last_became_active":"2024-09-12T16:58:25.949196+0000","last_became_peered":"2024-09-12T16:58:25.949196+0000","last_unstale":"2024-09-12T17:39:22.509004+0000","last_undegraded":"2024-09-12T17:39:22.509004+0000","last_fullsized":"2024-09-12T17:39:22.509004+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:18:17.202967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":122,"num_read_kb":116,"num_write":142,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"265'754","reported_seq":2150,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:25.115187+0000","last_change":"2024-09-12T16:58:27.741265+0000","last_active":"2024-09-12T17:41:25.115187+0000","last_peered":"2024-09-12T17:41:25.115187+0000","last_clean":"2024-09-12T17:41:25.115187+0000","last_became_active":"2024-09-12T16:58:27.740416+0000","last_became_peered":"2024-09-12T16:58:27.740416+0000","last_unstale":"2024-09-12T17:41:25.115187+0000","last_undegraded":"2024-09-12T17:41:25.115187+0000","last_fullsized":"2024-09-12T17:41:25.115187+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:32.112107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"265'129","reported_seq":650,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:48.742930+0000","last_change":"2024-09-12T16:58:29.784795+0000","last_active":"2024-09-12T17:39:48.742930+0000","last_peered":"2024-09-12T17:39:48.742930+0000","last_clean":"2024-09-12T17:39:48.742930+0000","last_became_active":"2024-09-12T16:58:29.784128+0000","last_became_peered":"2024-09-12T16:58:29.784128+0000","last_unstale":"2024-09-12T17:39:48.742930+0000","last_undegraded":"2024-09-12T17:39:48.742930+0000","last_fullsized":"2024-09-12T17:39:48.742930+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:43.512905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":291,"num_read_kb":261,"num_write":354,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"265'159","reported_seq":754,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:46.951235+0000","last_change":"2024-09-12T16:58:21.701518+0000","last_active":"2024-09-12T17:39:46.951235+0000","last_peered":"2024-09-12T17:39:46.951235+0000","last_clean":"2024-09-12T17:39:46.951235+0000","last_became_active":"2024-09-12T16:58:21.700714+0000","last_became_peered":"2024-09-12T16:58:21.700714+0000","last_unstale":"2024-09-12T17:39:46.951235+0000","last_undegraded":"2024-09-12T17:39:46.951235+0000","last_fullsized":"2024-09-12T17:39:46.951235+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:00.095934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":716,"num_read_kb":600,"num_write":247,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"265'245","reported_seq":997,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:44.097677+0000","last_change":"2024-09-12T16:58:18.706734+0000","last_active":"2024-09-12T17:39:44.097677+0000","last_peered":"2024-09-12T17:39:44.097677+0000","last_clean":"2024-09-12T17:39:44.097677+0000","last_became_active":"2024-09-12T16:58:18.706117+0000","last_became_peered":"2024-09-12T16:58:18.706117+0000","last_unstale":"2024-09-12T17:39:44.097677+0000","last_undegraded":"2024-09-12T17:39:44.097677+0000","last_fullsized":"2024-09-12T17:39:44.097677+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:11.952844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10067430,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":498,"num_read_kb":60034,"num_write":822,"num_write_kb":44854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:26.307328+0000","last_change":"2024-09-12T16:58:23.719072+0000","last_active":"2024-09-12T17:38:26.307328+0000","last_peered":"2024-09-12T17:38:26.307328+0000","last_clean":"2024-09-12T17:38:26.307328+0000","last_became_active":"2024-09-12T16:58:23.718211+0000","last_became_peered":"2024-09-12T16:58:23.718211+0000","last_unstale":"2024-09-12T17:38:26.307328+0000","last_undegraded":"2024-09-12T17:38:26.307328+0000","last_fullsized":"2024-09-12T17:38:26.307328+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:55.776100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"265'298","reported_seq":874,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:42.354980+0000","last_change":"2024-09-12T16:58:25.726107+0000","last_active":"2024-09-12T17:39:42.354980+0000","last_peered":"2024-09-12T17:39:42.354980+0000","last_clean":"2024-09-12T17:39:42.354980+0000","last_became_active":"2024-09-12T16:58:25.724774+0000","last_became_peered":"2024-09-12T16:58:25.724774+0000","last_unstale":"2024-09-12T17:39:42.354980+0000","last_undegraded":"2024-09-12T17:39:42.354980+0000","last_fullsized":"2024-09-12T17:39:42.354980+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:29.986764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55502,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":478,"num_read_kb":960,"num_write":388,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:07.334035+0000","last_change":"2024-09-12T16:58:27.759894+0000","last_active":"2024-09-12T17:37:07.334035+0000","last_peered":"2024-09-12T17:37:07.334035+0000","last_clean":"2024-09-12T17:37:07.334035+0000","last_became_active":"2024-09-12T16:58:27.755232+0000","last_became_peered":"2024-09-12T16:58:27.755232+0000","last_unstale":"2024-09-12T17:37:07.334035+0000","last_undegraded":"2024-09-12T17:37:07.334035+0000","last_fullsized":"2024-09-12T17:37:07.334035+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:26.735098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"265'133","reported_seq":645,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:04.245111+0000","last_change":"2024-09-12T16:58:29.782745+0000","last_active":"2024-09-12T17:40:04.245111+0000","last_peered":"2024-09-12T17:40:04.245111+0000","last_clean":"2024-09-12T17:40:04.245111+0000","last_became_active":"2024-09-12T16:58:29.782006+0000","last_became_peered":"2024-09-12T16:58:29.782006+0000","last_unstale":"2024-09-12T17:40:04.245111+0000","last_undegraded":"2024-09-12T17:40:04.245111+0000","last_fullsized":"2024-09-12T17:40:04.245111+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:25.299681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":784,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":248,"num_read_kb":225,"num_write":333,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"265'366","reported_seq":973,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:33.892514+0000","last_change":"2024-09-12T16:58:21.702476+0000","last_active":"2024-09-12T17:40:33.892514+0000","last_peered":"2024-09-12T17:40:33.892514+0000","last_clean":"2024-09-12T17:40:33.892514+0000","last_became_active":"2024-09-12T16:58:21.700909+0000","last_became_peered":"2024-09-12T16:58:21.700909+0000","last_unstale":"2024-09-12T17:40:33.892514+0000","last_undegraded":"2024-09-12T17:40:33.892514+0000","last_fullsized":"2024-09-12T17:40:33.892514+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:45.552412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1540,"num_read_kb":1221,"num_write":577,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"265'280","reported_seq":912,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:14.164086+0000","last_change":"2024-09-12T16:58:18.708114+0000","last_active":"2024-09-12T17:41:14.164086+0000","last_peered":"2024-09-12T17:41:14.164086+0000","last_clean":"2024-09-12T17:41:14.164086+0000","last_became_active":"2024-09-12T16:58:18.706197+0000","last_became_peered":"2024-09-12T16:58:18.706197+0000","last_unstale":"2024-09-12T17:41:14.164086+0000","last_undegraded":"2024-09-12T17:41:14.164086+0000","last_fullsized":"2024-09-12T17:41:14.164086+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:37.230857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18945702,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":476,"num_read_kb":18954,"num_write":1061,"num_write_kb":43009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:27.338265+0000","last_change":"2024-09-12T16:58:23.712080+0000","last_active":"2024-09-12T17:38:27.338265+0000","last_peered":"2024-09-12T17:38:27.338265+0000","last_clean":"2024-09-12T17:38:27.338265+0000","last_became_active":"2024-09-12T16:58:23.711307+0000","last_became_peered":"2024-09-12T16:58:23.711307+0000","last_unstale":"2024-09-12T17:38:27.338265+0000","last_undegraded":"2024-09-12T17:38:27.338265+0000","last_fullsized":"2024-09-12T17:38:27.338265+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:54.962283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"265'263","reported_seq":822,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:32.369384+0000","last_change":"2024-09-12T16:58:25.737271+0000","last_active":"2024-09-12T17:39:32.369384+0000","last_peered":"2024-09-12T17:39:32.369384+0000","last_clean":"2024-09-12T17:39:32.369384+0000","last_became_active":"2024-09-12T16:58:25.736507+0000","last_became_peered":"2024-09-12T16:58:25.736507+0000","last_unstale":"2024-09-12T17:39:32.369384+0000","last_undegraded":"2024-09-12T17:39:32.369384+0000","last_fullsized":"2024-09-12T17:39:32.369384+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:21.434839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54941,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":437,"num_read_kb":921,"num_write":364,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:16.284549+0000","last_change":"2024-09-12T16:58:27.741029+0000","last_active":"2024-09-12T17:37:16.284549+0000","last_peered":"2024-09-12T17:37:16.284549+0000","last_clean":"2024-09-12T17:37:16.284549+0000","last_became_active":"2024-09-12T16:58:27.740278+0000","last_became_peered":"2024-09-12T16:58:27.740278+0000","last_unstale":"2024-09-12T17:37:16.284549+0000","last_undegraded":"2024-09-12T17:37:16.284549+0000","last_fullsized":"2024-09-12T17:37:16.284549+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:39.408264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"265'124","reported_seq":655,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:01.044134+0000","last_change":"2024-09-12T16:58:29.786287+0000","last_active":"2024-09-12T17:40:01.044134+0000","last_peered":"2024-09-12T17:40:01.044134+0000","last_clean":"2024-09-12T17:40:01.044134+0000","last_became_active":"2024-09-12T16:58:29.783969+0000","last_became_peered":"2024-09-12T16:58:29.783969+0000","last_unstale":"2024-09-12T17:40:01.044134+0000","last_undegraded":"2024-09-12T17:40:01.044134+0000","last_fullsized":"2024-09-12T17:40:01.044134+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:00.910931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":564,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":235,"num_read_kb":216,"num_write":292,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"265'255","reported_seq":876,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:12.339198+0000","last_change":"2024-09-12T16:58:21.716389+0000","last_active":"2024-09-12T17:37:12.339198+0000","last_peered":"2024-09-12T17:37:12.339198+0000","last_clean":"2024-09-12T17:37:12.339198+0000","last_became_active":"2024-09-12T16:58:21.715884+0000","last_became_peered":"2024-09-12T16:58:21.715884+0000","last_unstale":"2024-09-12T17:37:12.339198+0000","last_undegraded":"2024-09-12T17:37:12.339198+0000","last_fullsized":"2024-09-12T17:37:12.339198+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:57.326871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1137,"num_read_kb":949,"num_write":435,"num_write_kb":255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"265'242","reported_seq":842,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:34.209922+0000","last_change":"2024-09-12T16:58:18.705301+0000","last_active":"2024-09-12T17:38:34.209922+0000","last_peered":"2024-09-12T17:38:34.209922+0000","last_clean":"2024-09-12T17:38:34.209922+0000","last_became_active":"2024-09-12T16:58:18.704103+0000","last_became_peered":"2024-09-12T16:58:18.704103+0000","last_unstale":"2024-09-12T17:38:34.209922+0000","last_undegraded":"2024-09-12T17:38:34.209922+0000","last_fullsized":"2024-09-12T17:38:34.209922+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:50.142551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4234216,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":298,"num_read_kb":15361,"num_write":825,"num_write_kb":40766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:06.265887+0000","last_change":"2024-09-12T16:58:23.714514+0000","last_active":"2024-09-12T17:37:06.265887+0000","last_peered":"2024-09-12T17:37:06.265887+0000","last_clean":"2024-09-12T17:37:06.265887+0000","last_became_active":"2024-09-12T16:58:23.713731+0000","last_became_peered":"2024-09-12T16:58:23.713731+0000","last_unstale":"2024-09-12T17:37:06.265887+0000","last_undegraded":"2024-09-12T17:37:06.265887+0000","last_fullsized":"2024-09-12T17:37:06.265887+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:09.365842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"265'220","reported_seq":774,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:57.391164+0000","last_change":"2024-09-12T16:58:25.728704+0000","last_active":"2024-09-12T17:40:57.391164+0000","last_peered":"2024-09-12T17:40:57.391164+0000","last_clean":"2024-09-12T17:40:57.391164+0000","last_became_active":"2024-09-12T16:58:25.727897+0000","last_became_peered":"2024-09-12T16:58:25.727897+0000","last_unstale":"2024-09-12T17:40:57.391164+0000","last_undegraded":"2024-09-12T17:40:57.391164+0000","last_fullsized":"2024-09-12T17:40:57.391164+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:09.542441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55194,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":361,"num_read_kb":801,"num_write":296,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:31.285213+0000","last_change":"2024-09-12T16:58:27.736505+0000","last_active":"2024-09-12T17:38:31.285213+0000","last_peered":"2024-09-12T17:38:31.285213+0000","last_clean":"2024-09-12T17:38:31.285213+0000","last_became_active":"2024-09-12T16:58:27.735625+0000","last_became_peered":"2024-09-12T16:58:27.735625+0000","last_unstale":"2024-09-12T17:38:31.285213+0000","last_undegraded":"2024-09-12T17:38:31.285213+0000","last_fullsized":"2024-09-12T17:38:31.285213+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:53.678377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"265'170","reported_seq":1636,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:02.955759+0000","last_change":"2024-09-12T16:58:29.797070+0000","last_active":"2024-09-12T17:40:02.955759+0000","last_peered":"2024-09-12T17:40:02.955759+0000","last_clean":"2024-09-12T17:40:02.955759+0000","last_became_active":"2024-09-12T16:58:29.796358+0000","last_became_peered":"2024-09-12T16:58:29.796358+0000","last_unstale":"2024-09-12T17:40:02.955759+0000","last_undegraded":"2024-09-12T17:40:02.955759+0000","last_fullsized":"2024-09-12T17:40:02.955759+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:36.721617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1235,"num_read_kb":1225,"num_write":375,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"265'197","reported_seq":825,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:30.960561+0000","last_change":"2024-09-12T16:58:21.730823+0000","last_active":"2024-09-12T17:39:30.960561+0000","last_peered":"2024-09-12T17:39:30.960561+0000","last_clean":"2024-09-12T17:39:30.960561+0000","last_became_active":"2024-09-12T16:58:21.730029+0000","last_became_peered":"2024-09-12T16:58:21.730029+0000","last_unstale":"2024-09-12T17:39:30.960561+0000","last_undegraded":"2024-09-12T17:39:30.960561+0000","last_fullsized":"2024-09-12T17:39:30.960561+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:44.982580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":873,"num_read_kb":717,"num_write":316,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"265'282","reported_seq":924,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:39.665808+0000","last_change":"2024-09-12T16:58:18.712626+0000","last_active":"2024-09-12T17:38:39.665808+0000","last_peered":"2024-09-12T17:38:39.665808+0000","last_clean":"2024-09-12T17:38:39.665808+0000","last_became_active":"2024-09-12T16:58:18.712291+0000","last_became_peered":"2024-09-12T16:58:18.712291+0000","last_unstale":"2024-09-12T17:38:39.665808+0000","last_undegraded":"2024-09-12T17:38:39.665808+0000","last_fullsized":"2024-09-12T17:38:39.665808+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:27.324406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13014787,"num_objects":85,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":362,"num_read_kb":103450,"num_write":959,"num_write_kb":48235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:08.681452+0000","last_change":"2024-09-12T16:58:23.725501+0000","last_active":"2024-09-12T17:37:08.681452+0000","last_peered":"2024-09-12T17:37:08.681452+0000","last_clean":"2024-09-12T17:37:08.681452+0000","last_became_active":"2024-09-12T16:58:23.724981+0000","last_became_peered":"2024-09-12T16:58:23.724981+0000","last_unstale":"2024-09-12T17:37:08.681452+0000","last_undegraded":"2024-09-12T17:37:08.681452+0000","last_fullsized":"2024-09-12T17:37:08.681452+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:14.754031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"265'294","reported_seq":872,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:56.317877+0000","last_change":"2024-09-12T16:58:25.719753+0000","last_active":"2024-09-12T17:40:56.317877+0000","last_peered":"2024-09-12T17:40:56.317877+0000","last_clean":"2024-09-12T17:40:56.317877+0000","last_became_active":"2024-09-12T16:58:25.718962+0000","last_became_peered":"2024-09-12T16:58:25.718962+0000","last_unstale":"2024-09-12T17:40:56.317877+0000","last_undegraded":"2024-09-12T17:40:56.317877+0000","last_fullsized":"2024-09-12T17:40:56.317877+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:19.374426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":467,"num_read_kb":939,"num_write":378,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:27.352877+0000","last_change":"2024-09-12T16:58:27.749233+0000","last_active":"2024-09-12T17:38:27.352877+0000","last_peered":"2024-09-12T17:38:27.352877+0000","last_clean":"2024-09-12T17:38:27.352877+0000","last_became_active":"2024-09-12T16:58:27.748503+0000","last_became_peered":"2024-09-12T16:58:27.748503+0000","last_unstale":"2024-09-12T17:38:27.352877+0000","last_undegraded":"2024-09-12T17:38:27.352877+0000","last_fullsized":"2024-09-12T17:38:27.352877+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:00.394978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"265'150","reported_seq":645,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:23.734437+0000","last_change":"2024-09-12T16:58:29.781039+0000","last_active":"2024-09-12T17:41:23.734437+0000","last_peered":"2024-09-12T17:41:23.734437+0000","last_clean":"2024-09-12T17:41:23.734437+0000","last_became_active":"2024-09-12T16:58:29.780363+0000","last_became_peered":"2024-09-12T16:58:29.780363+0000","last_unstale":"2024-09-12T17:41:23.734437+0000","last_undegraded":"2024-09-12T17:41:23.734437+0000","last_fullsized":"2024-09-12T17:41:23.734437+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:21.350835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":838,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":195,"num_read_kb":185,"num_write":368,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"265'45","reported_seq":599,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:36.003227+0000","last_change":"2024-09-12T16:58:21.728691+0000","last_active":"2024-09-12T17:39:36.003227+0000","last_peered":"2024-09-12T17:39:36.003227+0000","last_clean":"2024-09-12T17:39:36.003227+0000","last_became_active":"2024-09-12T16:58:21.728147+0000","last_became_peered":"2024-09-12T16:58:21.728147+0000","last_unstale":"2024-09-12T17:39:36.003227+0000","last_undegraded":"2024-09-12T17:39:36.003227+0000","last_fullsized":"2024-09-12T17:39:36.003227+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:29.002979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":172,"num_write":56,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"265'302","reported_seq":947,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:51.330408+0000","last_change":"2024-09-12T16:58:18.702412+0000","last_active":"2024-09-12T17:39:51.330408+0000","last_peered":"2024-09-12T17:39:51.330408+0000","last_clean":"2024-09-12T17:39:51.330408+0000","last_became_active":"2024-09-12T16:58:18.692788+0000","last_became_peered":"2024-09-12T16:58:18.692788+0000","last_unstale":"2024-09-12T17:39:51.330408+0000","last_undegraded":"2024-09-12T17:39:51.330408+0000","last_fullsized":"2024-09-12T17:39:51.330408+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:00.730133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703008,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":512,"num_read_kb":2229,"num_write":1149,"num_write_kb":12634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"265'159","reported_seq":772,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:42.258550+0000","last_change":"2024-09-12T16:58:21.727362+0000","last_active":"2024-09-12T17:38:42.258550+0000","last_peered":"2024-09-12T17:38:42.258550+0000","last_clean":"2024-09-12T17:38:42.258550+0000","last_became_active":"2024-09-12T16:58:21.726882+0000","last_became_peered":"2024-09-12T16:58:21.726882+0000","last_unstale":"2024-09-12T17:38:42.258550+0000","last_undegraded":"2024-09-12T17:38:42.258550+0000","last_fullsized":"2024-09-12T17:38:42.258550+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:28.927326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":734,"num_read_kb":607,"num_write":248,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"265'425","reported_seq":1152,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:18.516669+0000","last_change":"2024-09-12T16:58:18.694523+0000","last_active":"2024-09-12T17:41:18.516669+0000","last_peered":"2024-09-12T17:41:18.516669+0000","last_clean":"2024-09-12T17:41:18.516669+0000","last_became_active":"2024-09-12T16:58:18.693764+0000","last_became_peered":"2024-09-12T16:58:18.693764+0000","last_unstale":"2024-09-12T17:41:18.516669+0000","last_undegraded":"2024-09-12T17:41:18.516669+0000","last_fullsized":"2024-09-12T17:41:18.516669+0000","mapping_epoch":23,"log_start":"265'400","ondisk_log_start":"265'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:36.280676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7160847,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":858,"num_read_kb":32173,"num_write":1365,"num_write_kb":32850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"265'188","reported_seq":822,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:28.760907+0000","last_change":"2024-09-12T16:58:21.718536+0000","last_active":"2024-09-12T17:38:28.760907+0000","last_peered":"2024-09-12T17:38:28.760907+0000","last_clean":"2024-09-12T17:38:28.760907+0000","last_became_active":"2024-09-12T16:58:21.716793+0000","last_became_peered":"2024-09-12T16:58:21.716793+0000","last_unstale":"2024-09-12T17:38:28.760907+0000","last_undegraded":"2024-09-12T17:38:28.760907+0000","last_fullsized":"2024-09-12T17:38:28.760907+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:03.494777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":842,"num_read_kb":696,"num_write":281,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"265'304","reported_seq":924,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:58.059009+0000","last_change":"2024-09-12T16:58:18.712375+0000","last_active":"2024-09-12T17:38:58.059009+0000","last_peered":"2024-09-12T17:38:58.059009+0000","last_clean":"2024-09-12T17:38:58.059009+0000","last_became_active":"2024-09-12T16:58:18.711667+0000","last_became_peered":"2024-09-12T16:58:18.711667+0000","last_unstale":"2024-09-12T17:38:58.059009+0000","last_undegraded":"2024-09-12T17:38:58.059009+0000","last_fullsized":"2024-09-12T17:38:58.059009+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:10:09.706153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1148826,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":395,"num_read_kb":3457,"num_write":1125,"num_write_kb":27732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"265'217","reported_seq":854,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:58.757688+0000","last_change":"2024-09-12T16:58:21.714181+0000","last_active":"2024-09-12T17:38:58.757688+0000","last_peered":"2024-09-12T17:38:58.757688+0000","last_clean":"2024-09-12T17:38:58.757688+0000","last_became_active":"2024-09-12T16:58:21.713518+0000","last_became_peered":"2024-09-12T16:58:21.713518+0000","last_unstale":"2024-09-12T17:38:58.757688+0000","last_undegraded":"2024-09-12T17:38:58.757688+0000","last_fullsized":"2024-09-12T17:38:58.757688+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:57.295971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":958,"num_read_kb":791,"num_write":328,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"265'271","reported_seq":1012,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:49.387819+0000","last_change":"2024-09-12T16:58:18.711348+0000","last_active":"2024-09-12T17:39:49.387819+0000","last_peered":"2024-09-12T17:39:49.387819+0000","last_clean":"2024-09-12T17:39:49.387819+0000","last_became_active":"2024-09-12T16:58:18.711021+0000","last_became_peered":"2024-09-12T16:58:18.711021+0000","last_unstale":"2024-09-12T17:39:49.387819+0000","last_undegraded":"2024-09-12T17:39:49.387819+0000","last_fullsized":"2024-09-12T17:39:49.387819+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:07.336724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3590094,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":737,"num_read_kb":13816,"num_write":1064,"num_write_kb":16955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"265'187","reported_seq":809,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:35.914369+0000","last_change":"2024-09-12T16:58:55.850452+0000","last_active":"2024-09-12T17:39:35.914369+0000","last_peered":"2024-09-12T17:39:35.914369+0000","last_clean":"2024-09-12T17:39:35.914369+0000","last_became_active":"2024-09-12T16:58:55.849635+0000","last_became_peered":"2024-09-12T16:58:55.849635+0000","last_unstale":"2024-09-12T17:39:35.914369+0000","last_undegraded":"2024-09-12T17:39:35.914369+0000","last_fullsized":"2024-09-12T17:39:35.914369+0000","mapping_epoch":37,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:15.847705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":876,"num_read_kb":735,"num_write":297,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"265'293","reported_seq":1129,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:01.844495+0000","last_change":"2024-09-12T16:58:18.678586+0000","last_active":"2024-09-12T17:40:01.844495+0000","last_peered":"2024-09-12T17:40:01.844495+0000","last_clean":"2024-09-12T17:40:01.844495+0000","last_became_active":"2024-09-12T16:58:18.677892+0000","last_became_peered":"2024-09-12T16:58:18.677892+0000","last_unstale":"2024-09-12T17:40:01.844495+0000","last_undegraded":"2024-09-12T17:40:01.844495+0000","last_fullsized":"2024-09-12T17:40:01.844495+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:25.218640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5111685,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":834,"num_read_kb":13074,"num_write":1115,"num_write_kb":22747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"265'420","reported_seq":1141,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:52.006442+0000","last_change":"2024-09-12T16:58:21.731074+0000","last_active":"2024-09-12T17:39:52.006442+0000","last_peered":"2024-09-12T17:39:52.006442+0000","last_clean":"2024-09-12T17:39:52.006442+0000","last_became_active":"2024-09-12T16:58:21.729867+0000","last_became_peered":"2024-09-12T16:58:21.729867+0000","last_unstale":"2024-09-12T17:39:52.006442+0000","last_undegraded":"2024-09-12T17:39:52.006442+0000","last_fullsized":"2024-09-12T17:39:52.006442+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:15.044983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1962,"num_read_kb":1662,"num_write":651,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"265'297","reported_seq":978,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:30.905399+0000","last_change":"2024-09-12T16:58:18.707438+0000","last_active":"2024-09-12T17:39:30.905399+0000","last_peered":"2024-09-12T17:39:30.905399+0000","last_clean":"2024-09-12T17:39:30.905399+0000","last_became_active":"2024-09-12T16:58:18.707110+0000","last_became_peered":"2024-09-12T16:58:18.707110+0000","last_unstale":"2024-09-12T17:39:30.905399+0000","last_undegraded":"2024-09-12T17:39:30.905399+0000","last_fullsized":"2024-09-12T17:39:30.905399+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:40.132907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1477174,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":637,"num_read_kb":1846,"num_write":1055,"num_write_kb":24861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"265'4296","reported_seq":4999,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:01.121603+0000","last_change":"2024-09-12T16:58:55.957719+0000","last_active":"2024-09-12T17:39:01.121603+0000","last_peered":"2024-09-12T17:39:01.121603+0000","last_clean":"2024-09-12T17:39:01.121603+0000","last_became_active":"2024-09-12T16:58:55.957007+0000","last_became_peered":"2024-09-12T16:58:55.957007+0000","last_unstale":"2024-09-12T17:39:01.121603+0000","last_undegraded":"2024-09-12T17:39:01.121603+0000","last_fullsized":"2024-09-12T17:39:01.121603+0000","mapping_epoch":37,"log_start":"265'4200","ondisk_log_start":"265'4200","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":3000,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:31.973980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17379,"num_read_kb":14566,"num_write":6493,"num_write_kb":3276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"265'257","reported_seq":961,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:57.708017+0000","last_change":"2024-09-12T16:58:18.715600+0000","last_active":"2024-09-12T17:38:57.708017+0000","last_peered":"2024-09-12T17:38:57.708017+0000","last_clean":"2024-09-12T17:38:57.708017+0000","last_became_active":"2024-09-12T16:58:18.715010+0000","last_became_peered":"2024-09-12T16:58:18.715010+0000","last_unstale":"2024-09-12T17:38:57.708017+0000","last_undegraded":"2024-09-12T17:38:57.708017+0000","last_fullsized":"2024-09-12T17:38:57.708017+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:49.947157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55071,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":559,"num_read_kb":2502,"num_write":895,"num_write_kb":15075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"265'104","reported_seq":685,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:45.793141+0000","last_change":"2024-09-12T16:58:21.721630+0000","last_active":"2024-09-12T17:39:45.793141+0000","last_peered":"2024-09-12T17:39:45.793141+0000","last_clean":"2024-09-12T17:39:45.793141+0000","last_became_active":"2024-09-12T16:58:21.720908+0000","last_became_peered":"2024-09-12T16:58:21.720908+0000","last_unstale":"2024-09-12T17:39:45.793141+0000","last_undegraded":"2024-09-12T17:39:45.793141+0000","last_fullsized":"2024-09-12T17:39:45.793141+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:48.720616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":432,"num_read_kb":360,"num_write":161,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"265'319","reported_seq":1040,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:52.074775+0000","last_change":"2024-09-12T16:58:18.680818+0000","last_active":"2024-09-12T17:39:52.074775+0000","last_peered":"2024-09-12T17:39:52.074775+0000","last_clean":"2024-09-12T17:39:52.074775+0000","last_became_active":"2024-09-12T16:58:18.680305+0000","last_became_peered":"2024-09-12T16:58:18.680305+0000","last_unstale":"2024-09-12T17:39:52.074775+0000","last_undegraded":"2024-09-12T17:39:52.074775+0000","last_fullsized":"2024-09-12T17:39:52.074775+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:01.306922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15589836,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":620,"num_read_kb":33513,"num_write":1308,"num_write_kb":33353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"265'175","reported_seq":792,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:04.973943+0000","last_change":"2024-09-12T16:58:21.714631+0000","last_active":"2024-09-12T17:40:04.973943+0000","last_peered":"2024-09-12T17:40:04.973943+0000","last_clean":"2024-09-12T17:40:04.973943+0000","last_became_active":"2024-09-12T16:58:21.713765+0000","last_became_peered":"2024-09-12T16:58:21.713765+0000","last_unstale":"2024-09-12T17:40:04.973943+0000","last_undegraded":"2024-09-12T17:40:04.973943+0000","last_fullsized":"2024-09-12T17:40:04.973943+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:08.424081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":769,"num_read_kb":637,"num_write":246,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"265'299","reported_seq":948,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:50.750315+0000","last_change":"2024-09-12T16:58:18.714233+0000","last_active":"2024-09-12T17:39:50.750315+0000","last_peered":"2024-09-12T17:39:50.750315+0000","last_clean":"2024-09-12T17:39:50.750315+0000","last_became_active":"2024-09-12T16:58:18.713629+0000","last_became_peered":"2024-09-12T16:58:18.713629+0000","last_unstale":"2024-09-12T17:39:50.750315+0000","last_undegraded":"2024-09-12T17:39:50.750315+0000","last_fullsized":"2024-09-12T17:39:50.750315+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:39.149486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10600044,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":464,"num_read_kb":40377,"num_write":1091,"num_write_kb":39449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"265'158","reported_seq":728,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:58.305709+0000","last_change":"2024-09-12T16:58:21.719777+0000","last_active":"2024-09-12T17:38:58.305709+0000","last_peered":"2024-09-12T17:38:58.305709+0000","last_clean":"2024-09-12T17:38:58.305709+0000","last_became_active":"2024-09-12T16:58:21.718980+0000","last_became_peered":"2024-09-12T16:58:21.718980+0000","last_unstale":"2024-09-12T17:38:58.305709+0000","last_undegraded":"2024-09-12T17:38:58.305709+0000","last_fullsized":"2024-09-12T17:38:58.305709+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:03.655078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":669,"num_read_kb":540,"num_write":242,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"265'313","reported_seq":997,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:27.858381+0000","last_change":"2024-09-12T16:58:18.678862+0000","last_active":"2024-09-12T17:39:27.858381+0000","last_peered":"2024-09-12T17:39:27.858381+0000","last_clean":"2024-09-12T17:39:27.858381+0000","last_became_active":"2024-09-12T16:58:18.678270+0000","last_became_peered":"2024-09-12T16:58:18.678270+0000","last_unstale":"2024-09-12T17:39:27.858381+0000","last_undegraded":"2024-09-12T17:39:27.858381+0000","last_fullsized":"2024-09-12T17:39:27.858381+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:05.439824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12939946,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":496,"num_read_kb":53850,"num_write":1158,"num_write_kb":47481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"265'252","reported_seq":871,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:00.283451+0000","last_change":"2024-09-12T16:58:21.729663+0000","last_active":"2024-09-12T17:39:00.283451+0000","last_peered":"2024-09-12T17:39:00.283451+0000","last_clean":"2024-09-12T17:39:00.283451+0000","last_became_active":"2024-09-12T16:58:21.729301+0000","last_became_peered":"2024-09-12T16:58:21.729301+0000","last_unstale":"2024-09-12T17:39:00.283451+0000","last_undegraded":"2024-09-12T17:39:00.283451+0000","last_fullsized":"2024-09-12T17:39:00.283451+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:14.701978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1107,"num_read_kb":902,"num_write":427,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"265'371","reported_seq":1044,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:48.484705+0000","last_change":"2024-09-12T16:58:18.722981+0000","last_active":"2024-09-12T17:39:48.484705+0000","last_peered":"2024-09-12T17:39:48.484705+0000","last_clean":"2024-09-12T17:39:48.484705+0000","last_became_active":"2024-09-12T16:58:18.719658+0000","last_became_peered":"2024-09-12T16:58:18.719658+0000","last_unstale":"2024-09-12T17:39:48.484705+0000","last_undegraded":"2024-09-12T17:39:48.484705+0000","last_fullsized":"2024-09-12T17:39:48.484705+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:07.503530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1631427,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":635,"num_read_kb":15766,"num_write":1320,"num_write_kb":33267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"265'203","reported_seq":839,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:30.590488+0000","last_change":"2024-09-12T16:58:21.731445+0000","last_active":"2024-09-12T17:39:30.590488+0000","last_peered":"2024-09-12T17:39:30.590488+0000","last_clean":"2024-09-12T17:39:30.590488+0000","last_became_active":"2024-09-12T16:58:21.730589+0000","last_became_peered":"2024-09-12T16:58:21.730589+0000","last_unstale":"2024-09-12T17:39:30.590488+0000","last_undegraded":"2024-09-12T17:39:30.590488+0000","last_fullsized":"2024-09-12T17:39:30.590488+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:55.311260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":887,"num_read_kb":736,"num_write":325,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"265'292","reported_seq":959,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:40.348438+0000","last_change":"2024-09-12T16:58:18.692286+0000","last_active":"2024-09-12T17:39:40.348438+0000","last_peered":"2024-09-12T17:39:40.348438+0000","last_clean":"2024-09-12T17:39:40.348438+0000","last_became_active":"2024-09-12T16:58:18.691716+0000","last_became_peered":"2024-09-12T16:58:18.691716+0000","last_unstale":"2024-09-12T17:39:40.348438+0000","last_undegraded":"2024-09-12T17:39:40.348438+0000","last_fullsized":"2024-09-12T17:39:40.348438+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:52.982861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8769852,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":458,"num_read_kb":37415,"num_write":1051,"num_write_kb":27973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"265'333","reported_seq":938,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:46.416171+0000","last_change":"2024-09-12T16:58:21.723290+0000","last_active":"2024-09-12T17:39:46.416171+0000","last_peered":"2024-09-12T17:39:46.416171+0000","last_clean":"2024-09-12T17:39:46.416171+0000","last_became_active":"2024-09-12T16:58:21.722380+0000","last_became_peered":"2024-09-12T16:58:21.722380+0000","last_unstale":"2024-09-12T17:39:46.416171+0000","last_undegraded":"2024-09-12T17:39:46.416171+0000","last_fullsized":"2024-09-12T17:39:46.416171+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:20.022303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1422,"num_read_kb":1143,"num_write":550,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"265'281","reported_seq":947,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:51.702167+0000","last_change":"2024-09-12T16:58:18.709809+0000","last_active":"2024-09-12T17:39:51.702167+0000","last_peered":"2024-09-12T17:39:51.702167+0000","last_clean":"2024-09-12T17:39:51.702167+0000","last_became_active":"2024-09-12T16:58:18.709090+0000","last_became_peered":"2024-09-12T16:58:18.709090+0000","last_unstale":"2024-09-12T17:39:51.702167+0000","last_undegraded":"2024-09-12T17:39:51.702167+0000","last_fullsized":"2024-09-12T17:39:51.702167+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:53.570807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6609011,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":475,"num_read_kb":42081,"num_write":1072,"num_write_kb":38244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"265'160","reported_seq":768,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:35.762962+0000","last_change":"2024-09-12T16:58:21.725647+0000","last_active":"2024-09-12T17:39:35.762962+0000","last_peered":"2024-09-12T17:39:35.762962+0000","last_clean":"2024-09-12T17:39:35.762962+0000","last_became_active":"2024-09-12T16:58:21.725262+0000","last_became_peered":"2024-09-12T16:58:21.725262+0000","last_unstale":"2024-09-12T17:39:35.762962+0000","last_undegraded":"2024-09-12T17:39:35.762962+0000","last_fullsized":"2024-09-12T17:39:35.762962+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:15.275246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":648,"num_read_kb":538,"num_write":222,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"265'296","reported_seq":965,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:17.041773+0000","last_change":"2024-09-12T16:58:18.713718+0000","last_active":"2024-09-12T17:41:17.041773+0000","last_peered":"2024-09-12T17:41:17.041773+0000","last_clean":"2024-09-12T17:41:17.041773+0000","last_became_active":"2024-09-12T16:58:18.713131+0000","last_became_peered":"2024-09-12T16:58:18.713131+0000","last_unstale":"2024-09-12T17:41:17.041773+0000","last_undegraded":"2024-09-12T17:41:17.041773+0000","last_fullsized":"2024-09-12T17:41:17.041773+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:06.542758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2374722,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":506,"num_read_kb":4620,"num_write":1061,"num_write_kb":30053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"265'101","reported_seq":696,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:49.682303+0000","last_change":"2024-09-12T16:58:21.695497+0000","last_active":"2024-09-12T17:39:49.682303+0000","last_peered":"2024-09-12T17:39:49.682303+0000","last_clean":"2024-09-12T17:39:49.682303+0000","last_became_active":"2024-09-12T16:58:21.693930+0000","last_became_peered":"2024-09-12T16:58:21.693930+0000","last_unstale":"2024-09-12T17:39:49.682303+0000","last_undegraded":"2024-09-12T17:39:49.682303+0000","last_fullsized":"2024-09-12T17:39:49.682303+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:50.200124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":454,"num_read_kb":382,"num_write":143,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"265'292","reported_seq":932,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:47.436633+0000","last_change":"2024-09-12T16:58:18.704503+0000","last_active":"2024-09-12T17:39:47.436633+0000","last_peered":"2024-09-12T17:39:47.436633+0000","last_clean":"2024-09-12T17:39:47.436633+0000","last_became_active":"2024-09-12T16:58:18.704118+0000","last_became_peered":"2024-09-12T16:58:18.704118+0000","last_unstale":"2024-09-12T17:39:47.436633+0000","last_undegraded":"2024-09-12T17:39:47.436633+0000","last_fullsized":"2024-09-12T17:39:47.436633+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:55.559259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2129208,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":488,"num_read_kb":7376,"num_write":1213,"num_write_kb":14643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"265'376","reported_seq":966,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:31.294301+0000","last_change":"2024-09-12T16:58:21.716931+0000","last_active":"2024-09-12T17:37:31.294301+0000","last_peered":"2024-09-12T17:37:31.294301+0000","last_clean":"2024-09-12T17:37:31.294301+0000","last_became_active":"2024-09-12T16:58:21.714554+0000","last_became_peered":"2024-09-12T16:58:21.714554+0000","last_unstale":"2024-09-12T17:37:31.294301+0000","last_undegraded":"2024-09-12T17:37:31.294301+0000","last_fullsized":"2024-09-12T17:37:31.294301+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:40.451432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1689,"num_read_kb":1453,"num_write":661,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"265'328","reported_seq":1036,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:11.450793+0000","last_change":"2024-09-12T16:58:18.722556+0000","last_active":"2024-09-12T17:39:11.450793+0000","last_peered":"2024-09-12T17:39:11.450793+0000","last_clean":"2024-09-12T17:39:11.450793+0000","last_became_active":"2024-09-12T16:58:18.719691+0000","last_became_peered":"2024-09-12T16:58:18.719691+0000","last_unstale":"2024-09-12T17:39:11.450793+0000","last_undegraded":"2024-09-12T17:39:11.450793+0000","last_fullsized":"2024-09-12T17:39:11.450793+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:16.205110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46645,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":702,"num_read_kb":7679,"num_write":1252,"num_write_kb":23567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"265'283","reported_seq":935,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:46.808503+0000","last_change":"2024-09-12T16:58:18.699166+0000","last_active":"2024-09-12T17:39:46.808503+0000","last_peered":"2024-09-12T17:39:46.808503+0000","last_clean":"2024-09-12T17:39:46.808503+0000","last_became_active":"2024-09-12T16:58:18.698393+0000","last_became_peered":"2024-09-12T16:58:18.698393+0000","last_unstale":"2024-09-12T17:39:46.808503+0000","last_undegraded":"2024-09-12T17:39:46.808503+0000","last_fullsized":"2024-09-12T17:39:46.808503+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:04.059507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8744990,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":467,"num_read_kb":34675,"num_write":1057,"num_write_kb":53307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"265'106","reported_seq":685,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:25.841940+0000","last_change":"2024-09-12T16:58:21.715263+0000","last_active":"2024-09-12T17:39:25.841940+0000","last_peered":"2024-09-12T17:39:25.841940+0000","last_clean":"2024-09-12T17:39:25.841940+0000","last_became_active":"2024-09-12T16:58:21.714240+0000","last_became_peered":"2024-09-12T16:58:21.714240+0000","last_unstale":"2024-09-12T17:39:25.841940+0000","last_undegraded":"2024-09-12T17:39:25.841940+0000","last_fullsized":"2024-09-12T17:39:25.841940+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:10.058451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":476,"num_read_kb":394,"num_write":172,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"265'290","reported_seq":969,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:00.496142+0000","last_change":"2024-09-12T16:58:18.708462+0000","last_active":"2024-09-12T17:39:00.496142+0000","last_peered":"2024-09-12T17:39:00.496142+0000","last_clean":"2024-09-12T17:39:00.496142+0000","last_became_active":"2024-09-12T16:58:18.707649+0000","last_became_peered":"2024-09-12T16:58:18.707649+0000","last_unstale":"2024-09-12T17:39:00.496142+0000","last_undegraded":"2024-09-12T17:39:00.496142+0000","last_fullsized":"2024-09-12T17:39:00.496142+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:46.590351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4545527,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":509,"num_read_kb":14651,"num_write":1051,"num_write_kb":33951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"265'4159","reported_seq":4793,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:51.063189+0000","last_change":"2024-09-12T16:58:21.719410+0000","last_active":"2024-09-12T17:39:51.063189+0000","last_peered":"2024-09-12T17:39:51.063189+0000","last_clean":"2024-09-12T17:39:51.063189+0000","last_became_active":"2024-09-12T16:58:21.718537+0000","last_became_peered":"2024-09-12T16:58:21.718537+0000","last_unstale":"2024-09-12T17:39:51.063189+0000","last_undegraded":"2024-09-12T17:39:51.063189+0000","last_fullsized":"2024-09-12T17:39:51.063189+0000","mapping_epoch":26,"log_start":"265'4100","ondisk_log_start":"265'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":3000,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:03.741045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16773,"num_read_kb":14078,"num_write":6250,"num_write_kb":3119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6189,"num_read_kb":4469,"num_write":2002,"num_write_kb":899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":974,"ondisk_log_size":974,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15645,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":16183,"num_read_kb":15867,"num_write":16715,"num_write_kb":4878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1753,"ondisk_log_size":1753,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":471,"ondisk_log_size":471,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1935553,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":16938,"num_read_kb":32666,"num_write":14311,"num_write_kb":11496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3317760,"data_stored":2789188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1861,"ondisk_log_size":1861,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2402,"num_read_kb":2863,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":102570,"num_read_kb":85739,"num_write":37214,"num_write_kb":18735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4257,"ondisk_log_size":4257,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":480816628,"num_objects":4456,"num_object_clones":0,"num_object_copies":8912,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4456,"num_whiteouts":0,"num_read":32179,"num_read_kb":1886484,"num_write":68499,"num_write_kb":2069560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":994451456,"data_stored":961633256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4540,"ondisk_log_size":4540,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":83982918,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":145,"num_read_kb":211125,"num_write":160,"num_write_kb":136313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1087,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":167968768,"data_stored":167965836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":83982918,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":142,"num_read_kb":198791,"num_write":160,"num_write_kb":136313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":167968768,"data_stored":167965836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509966,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310272,"kb_used_data":202800,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94061568,"statfs":{"total":96636764160,"available":96319045632,"internally_reserved":0,"allocated":207667200,"data_stored":201034528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509965,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":441040,"kb_used_data":197440,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":93930800,"statfs":{"total":96636764160,"available":96185139200,"internally_reserved":0,"allocated":202178560,"data_stored":195485373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":249428423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509970,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":206848,"kb_used_data":95216,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94164992,"statfs":{"total":96636764160,"available":96424951808,"internally_reserved":0,"allocated":97501184,"data_stored":93066069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509965,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":452352,"kb_used_data":226864,"kb_used_omap":1,"kb_used_meta":225470,"kb_avail":93919488,"statfs":{"total":96636764160,"available":96173555712,"internally_reserved":0,"allocated":232308736,"data_stored":225939994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":230881733},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542671,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":404528,"kb_used_data":170656,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":93967312,"statfs":{"total":96636764160,"available":96222527488,"internally_reserved":0,"allocated":174751744,"data_stored":168481208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":239466955},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542672,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":333836,"kb_used_data":126332,"kb_used_omap":1,"kb_used_meta":207486,"kb_avail":94038004,"statfs":{"total":96636764160,"available":96294916096,"internally_reserved":0,"allocated":129363968,"data_stored":124846922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":212466118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542670,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":294048,"kb_used_data":208784,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94077792,"statfs":{"total":96636764160,"available":96335659008,"internally_reserved":0,"allocated":213794816,"data_stored":207648782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575374,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":161452,"kb_used_data":103900,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94210388,"statfs":{"total":96636764160,"available":96471437312,"internally_reserved":0,"allocated":106393600,"data_stored":102235490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":177319936,"data_stored":172525149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":59768832,"data_stored":56868543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":63787008,"data_stored":61116399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":143331328,"data_stored":138233431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":163921920,"data_stored":159269009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":162381824,"data_stored":157369437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":86540288,"data_stored":83529300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":137400320,"data_stored":132721988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":341383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":475136,"data_stored":397458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":123306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":477204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":91316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":679936,"data_stored":571114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":319488,"data_stored":274248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":618496,"data_stored":513159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":5371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":5873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36700160,"data_stored":36700160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":17924096,"data_stored":17922630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18874368,"data_stored":18874368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":18874368,"data_stored":18874368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12681216,"data_stored":12679750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13631488,"data_stored":13631488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15728640,"data_stored":15728640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":15777792,"data_stored":15777062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35749888,"data_stored":35748422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":22069248,"data_stored":22068512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":26214400,"data_stored":26214400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15728640,"data_stored":15728640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:41:33.838 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:41:34.211 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:41:34.224 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-09-12T17:41:34.226 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":1564,"stamp":"2024-09-12T17:41:33.790435+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":560902211,"num_objects":3965,"num_object_clones":0,"num_object_copies":7930,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3965,"num_whiteouts":0,"num_read":177823,"num_read_kb":2438990,"num_write":140145,"num_write_kb":2379864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1087,"num_keys_recovered":0,"num_objects_omap":62,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13911,"ondisk_log_size":13911,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2498108,"kb_used_data":1238100,"kb_used_omap":12,"kb_used_meta":1259763,"kb_avail":752476612,"statfs":{"total":773094113280,"available":770536050688,"internally_reserved":0,"allocated":1267814400,"data_stored":1226074533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1289997873},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-90424458,"num_objects":-887,"num_object_clones":0,"num_object_copies":-1774,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-887,"num_whiteouts":0,"num_read":1098,"num_read_kb":1019,"num_write":993,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.025460"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:17.322563+0000","last_change":"2024-09-12T17:27:17.404693+0000","last_active":"2024-09-12T17:37:17.322563+0000","last_peered":"2024-09-12T17:37:17.322563+0000","last_clean":"2024-09-12T17:37:17.322563+0000","last_became_active":"2024-09-12T17:27:17.403833+0000","last_became_peered":"2024-09-12T17:27:17.403833+0000","last_unstale":"2024-09-12T17:37:17.322563+0000","last_undegraded":"2024-09-12T17:37:17.322563+0000","last_fullsized":"2024-09-12T17:37:17.322563+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:43.551735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"265'4","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:12.334840+0000","last_change":"2024-09-12T17:15:43.159517+0000","last_active":"2024-09-12T17:38:12.334840+0000","last_peered":"2024-09-12T17:38:12.334840+0000","last_clean":"2024-09-12T17:38:12.334840+0000","last_became_active":"2024-09-12T17:15:43.158714+0000","last_became_peered":"2024-09-12T17:15:43.158714+0000","last_unstale":"2024-09-12T17:38:12.334840+0000","last_undegraded":"2024-09-12T17:38:12.334840+0000","last_fullsized":"2024-09-12T17:38:12.334840+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:19.068813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"262'2","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:12.353310+0000","last_change":"2024-09-12T17:15:40.126960+0000","last_active":"2024-09-12T17:38:12.353310+0000","last_peered":"2024-09-12T17:38:12.353310+0000","last_clean":"2024-09-12T17:38:12.353310+0000","last_became_active":"2024-09-12T17:15:40.126170+0000","last_became_peered":"2024-09-12T17:15:40.126170+0000","last_unstale":"2024-09-12T17:38:12.353310+0000","last_undegraded":"2024-09-12T17:38:12.353310+0000","last_fullsized":"2024-09-12T17:38:12.353310+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:57.038622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"265'24","reported_seq":111,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:57.361076+0000","last_change":"2024-09-12T17:13:54.846274+0000","last_active":"2024-09-12T17:38:57.361076+0000","last_peered":"2024-09-12T17:38:57.361076+0000","last_clean":"2024-09-12T17:38:57.361076+0000","last_became_active":"2024-09-12T17:13:54.845556+0000","last_became_peered":"2024-09-12T17:13:54.845556+0000","last_unstale":"2024-09-12T17:38:57.361076+0000","last_undegraded":"2024-09-12T17:38:57.361076+0000","last_fullsized":"2024-09-12T17:38:57.361076+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:34.627718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":82,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:20.262014+0000","last_change":"2024-09-12T17:27:17.422429+0000","last_active":"2024-09-12T17:37:20.262014+0000","last_peered":"2024-09-12T17:37:20.262014+0000","last_clean":"2024-09-12T17:37:20.262014+0000","last_became_active":"2024-09-12T17:27:17.421771+0000","last_became_peered":"2024-09-12T17:27:17.421771+0000","last_unstale":"2024-09-12T17:37:20.262014+0000","last_undegraded":"2024-09-12T17:37:20.262014+0000","last_fullsized":"2024-09-12T17:37:20.262014+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:44.139866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:16.281883+0000","last_change":"2024-09-12T17:15:43.160447+0000","last_active":"2024-09-12T17:38:16.281883+0000","last_peered":"2024-09-12T17:38:16.281883+0000","last_clean":"2024-09-12T17:38:16.281883+0000","last_became_active":"2024-09-12T17:15:43.159316+0000","last_became_peered":"2024-09-12T17:15:43.159316+0000","last_unstale":"2024-09-12T17:38:16.281883+0000","last_undegraded":"2024-09-12T17:38:16.281883+0000","last_fullsized":"2024-09-12T17:38:16.281883+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:44.109670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"265'7","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:43.729290+0000","last_change":"2024-09-12T17:15:40.126819+0000","last_active":"2024-09-12T17:40:43.729290+0000","last_peered":"2024-09-12T17:40:43.729290+0000","last_clean":"2024-09-12T17:40:43.729290+0000","last_became_active":"2024-09-12T17:15:40.126087+0000","last_became_peered":"2024-09-12T17:15:40.126087+0000","last_unstale":"2024-09-12T17:40:43.729290+0000","last_undegraded":"2024-09-12T17:40:43.729290+0000","last_fullsized":"2024-09-12T17:40:43.729290+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:09.968319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":1026,"num_write":12,"num_write_kb":5122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"265'36","reported_seq":144,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:19.460209+0000","last_change":"2024-09-12T17:13:54.838770+0000","last_active":"2024-09-12T17:38:19.460209+0000","last_peered":"2024-09-12T17:38:19.460209+0000","last_clean":"2024-09-12T17:38:19.460209+0000","last_became_active":"2024-09-12T17:13:54.837820+0000","last_became_peered":"2024-09-12T17:13:54.837820+0000","last_unstale":"2024-09-12T17:38:19.460209+0000","last_undegraded":"2024-09-12T17:38:19.460209+0000","last_fullsized":"2024-09-12T17:38:19.460209+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:56:27.573050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":180,"num_read_kb":123,"num_write":74,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:36:56.280248+0000","last_change":"2024-09-12T17:27:17.406442+0000","last_active":"2024-09-12T17:36:56.280248+0000","last_peered":"2024-09-12T17:36:56.280248+0000","last_clean":"2024-09-12T17:36:56.280248+0000","last_became_active":"2024-09-12T17:27:17.405657+0000","last_became_peered":"2024-09-12T17:27:17.405657+0000","last_unstale":"2024-09-12T17:36:56.280248+0000","last_undegraded":"2024-09-12T17:36:56.280248+0000","last_fullsized":"2024-09-12T17:36:56.280248+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:12.985689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:37.355505+0000","last_change":"2024-09-12T17:15:43.869720+0000","last_active":"2024-09-12T17:38:37.355505+0000","last_peered":"2024-09-12T17:38:37.355505+0000","last_clean":"2024-09-12T17:38:37.355505+0000","last_became_active":"2024-09-12T17:15:43.868960+0000","last_became_peered":"2024-09-12T17:15:43.868960+0000","last_unstale":"2024-09-12T17:38:37.355505+0000","last_undegraded":"2024-09-12T17:38:37.355505+0000","last_fullsized":"2024-09-12T17:38:37.355505+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:01.285114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"262'2","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:45.267370+0000","last_change":"2024-09-12T17:15:40.135488+0000","last_active":"2024-09-12T17:37:45.267370+0000","last_peered":"2024-09-12T17:37:45.267370+0000","last_clean":"2024-09-12T17:37:45.267370+0000","last_became_active":"2024-09-12T17:15:40.134513+0000","last_became_peered":"2024-09-12T17:15:40.134513+0000","last_unstale":"2024-09-12T17:37:45.267370+0000","last_undegraded":"2024-09-12T17:37:45.267370+0000","last_fullsized":"2024-09-12T17:37:45.267370+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:39.657856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"265'19","reported_seq":94,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:57.360940+0000","last_change":"2024-09-12T17:13:54.827570+0000","last_active":"2024-09-12T17:38:57.360940+0000","last_peered":"2024-09-12T17:38:57.360940+0000","last_clean":"2024-09-12T17:38:57.360940+0000","last_became_active":"2024-09-12T17:13:54.826480+0000","last_became_peered":"2024-09-12T17:13:54.826480+0000","last_unstale":"2024-09-12T17:38:57.360940+0000","last_undegraded":"2024-09-12T17:38:57.360940+0000","last_fullsized":"2024-09-12T17:38:57.360940+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:09.477709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:02.336888+0000","last_change":"2024-09-12T17:27:17.419282+0000","last_active":"2024-09-12T17:37:02.336888+0000","last_peered":"2024-09-12T17:37:02.336888+0000","last_clean":"2024-09-12T17:37:02.336888+0000","last_became_active":"2024-09-12T17:27:17.418519+0000","last_became_peered":"2024-09-12T17:27:17.418519+0000","last_unstale":"2024-09-12T17:37:02.336888+0000","last_undegraded":"2024-09-12T17:37:02.336888+0000","last_fullsized":"2024-09-12T17:37:02.336888+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:37.212267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"265'1","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:47.347348+0000","last_change":"2024-09-12T17:15:43.869355+0000","last_active":"2024-09-12T17:37:47.347348+0000","last_peered":"2024-09-12T17:37:47.347348+0000","last_clean":"2024-09-12T17:37:47.347348+0000","last_became_active":"2024-09-12T17:15:43.868600+0000","last_became_peered":"2024-09-12T17:15:43.868600+0000","last_unstale":"2024-09-12T17:37:47.347348+0000","last_undegraded":"2024-09-12T17:37:47.347348+0000","last_fullsized":"2024-09-12T17:37:47.347348+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:55.218786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48422,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":48,"num_write":1,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"262'3","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:36.286516+0000","last_change":"2024-09-12T17:15:40.109807+0000","last_active":"2024-09-12T17:38:36.286516+0000","last_peered":"2024-09-12T17:38:36.286516+0000","last_clean":"2024-09-12T17:38:36.286516+0000","last_became_active":"2024-09-12T17:15:40.109161+0000","last_became_peered":"2024-09-12T17:15:40.109161+0000","last_unstale":"2024-09-12T17:38:36.286516+0000","last_undegraded":"2024-09-12T17:38:36.286516+0000","last_fullsized":"2024-09-12T17:38:36.286516+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:38.091651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"265'31","reported_seq":127,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:28.552554+0000","last_change":"2024-09-12T17:13:54.839575+0000","last_active":"2024-09-12T17:39:28.552554+0000","last_peered":"2024-09-12T17:39:28.552554+0000","last_clean":"2024-09-12T17:39:28.552554+0000","last_became_active":"2024-09-12T17:13:54.838968+0000","last_became_peered":"2024-09-12T17:13:54.838968+0000","last_unstale":"2024-09-12T17:39:28.552554+0000","last_undegraded":"2024-09-12T17:39:28.552554+0000","last_fullsized":"2024-09-12T17:39:28.552554+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:01.149483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":108,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:22.370396+0000","last_change":"2024-09-12T17:27:17.418362+0000","last_active":"2024-09-12T17:39:22.370396+0000","last_peered":"2024-09-12T17:39:22.370396+0000","last_clean":"2024-09-12T17:39:22.370396+0000","last_became_active":"2024-09-12T17:27:17.416509+0000","last_became_peered":"2024-09-12T17:27:17.416509+0000","last_unstale":"2024-09-12T17:39:22.370396+0000","last_undegraded":"2024-09-12T17:39:22.370396+0000","last_fullsized":"2024-09-12T17:39:22.370396+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:54.908041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"265'10","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:32.325931+0000","last_change":"2024-09-12T17:15:43.163407+0000","last_active":"2024-09-12T17:37:32.325931+0000","last_peered":"2024-09-12T17:37:32.325931+0000","last_clean":"2024-09-12T17:37:32.325931+0000","last_became_active":"2024-09-12T17:15:43.162643+0000","last_became_peered":"2024-09-12T17:15:43.162643+0000","last_unstale":"2024-09-12T17:37:32.325931+0000","last_undegraded":"2024-09-12T17:37:32.325931+0000","last_fullsized":"2024-09-12T17:37:32.325931+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:26.465579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48416,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":23650,"num_write":15,"num_write_kb":11312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"265'8","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.236529+0000","last_change":"2024-09-12T17:15:40.111961+0000","last_active":"2024-09-12T17:41:32.236529+0000","last_peered":"2024-09-12T17:41:32.236529+0000","last_clean":"2024-09-12T17:41:32.236529+0000","last_became_active":"2024-09-12T17:15:40.111105+0000","last_became_peered":"2024-09-12T17:15:40.111105+0000","last_unstale":"2024-09-12T17:41:32.236529+0000","last_undegraded":"2024-09-12T17:41:32.236529+0000","last_fullsized":"2024-09-12T17:41:32.236529+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:17.726065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"265'54","reported_seq":197,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:31.662260+0000","last_change":"2024-09-12T17:13:54.842088+0000","last_active":"2024-09-12T17:39:31.662260+0000","last_peered":"2024-09-12T17:39:31.662260+0000","last_clean":"2024-09-12T17:39:31.662260+0000","last_became_active":"2024-09-12T17:13:54.841072+0000","last_became_peered":"2024-09-12T17:13:54.841072+0000","last_unstale":"2024-09-12T17:39:31.662260+0000","last_undegraded":"2024-09-12T17:39:31.662260+0000","last_fullsized":"2024-09-12T17:39:31.662260+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:22:11.118120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":282,"num_read_kb":222,"num_write":88,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:43.689296+0000","last_change":"2024-09-12T17:27:17.410975+0000","last_active":"2024-09-12T17:37:43.689296+0000","last_peered":"2024-09-12T17:37:43.689296+0000","last_clean":"2024-09-12T17:37:43.689296+0000","last_became_active":"2024-09-12T17:27:17.392355+0000","last_became_peered":"2024-09-12T17:27:17.392355+0000","last_unstale":"2024-09-12T17:37:43.689296+0000","last_undegraded":"2024-09-12T17:37:43.689296+0000","last_fullsized":"2024-09-12T17:37:43.689296+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:41.915255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"265'3","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:31.287683+0000","last_change":"2024-09-12T17:15:57.748482+0000","last_active":"2024-09-12T17:37:31.287683+0000","last_peered":"2024-09-12T17:37:31.287683+0000","last_clean":"2024-09-12T17:37:31.287683+0000","last_became_active":"2024-09-12T17:15:57.742342+0000","last_became_peered":"2024-09-12T17:15:57.742342+0000","last_unstale":"2024-09-12T17:37:31.287683+0000","last_undegraded":"2024-09-12T17:37:31.287683+0000","last_fullsized":"2024-09-12T17:37:31.287683+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:00.488944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":3,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1087,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:36.272606+0000","last_change":"2024-09-12T17:15:40.120329+0000","last_active":"2024-09-12T17:37:36.272606+0000","last_peered":"2024-09-12T17:37:36.272606+0000","last_clean":"2024-09-12T17:37:36.272606+0000","last_became_active":"2024-09-12T17:15:40.119439+0000","last_became_peered":"2024-09-12T17:15:40.119439+0000","last_unstale":"2024-09-12T17:37:36.272606+0000","last_undegraded":"2024-09-12T17:37:36.272606+0000","last_fullsized":"2024-09-12T17:37:36.272606+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:50.536461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"265'35","reported_seq":142,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:56.306273+0000","last_change":"2024-09-12T17:13:54.842916+0000","last_active":"2024-09-12T17:38:56.306273+0000","last_peered":"2024-09-12T17:38:56.306273+0000","last_clean":"2024-09-12T17:38:56.306273+0000","last_became_active":"2024-09-12T17:13:54.842215+0000","last_became_peered":"2024-09-12T17:13:54.842215+0000","last_unstale":"2024-09-12T17:38:56.306273+0000","last_undegraded":"2024-09-12T17:38:56.306273+0000","last_fullsized":"2024-09-12T17:38:56.306273+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:02.592935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":135,"num_write":51,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"265'1","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:21.291709+0000","last_change":"2024-09-12T17:27:17.415995+0000","last_active":"2024-09-12T17:37:21.291709+0000","last_peered":"2024-09-12T17:37:21.291709+0000","last_clean":"2024-09-12T17:37:21.291709+0000","last_became_active":"2024-09-12T17:27:17.415277+0000","last_became_peered":"2024-09-12T17:27:17.415277+0000","last_unstale":"2024-09-12T17:37:21.291709+0000","last_undegraded":"2024-09-12T17:37:21.291709+0000","last_fullsized":"2024-09-12T17:37:21.291709+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:19.223166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"265'3","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:16.297571+0000","last_change":"2024-09-12T17:15:43.172814+0000","last_active":"2024-09-12T17:38:16.297571+0000","last_peered":"2024-09-12T17:38:16.297571+0000","last_clean":"2024-09-12T17:38:16.297571+0000","last_became_active":"2024-09-12T17:15:43.172142+0000","last_became_peered":"2024-09-12T17:15:43.172142+0000","last_unstale":"2024-09-12T17:38:16.297571+0000","last_undegraded":"2024-09-12T17:38:16.297571+0000","last_fullsized":"2024-09-12T17:38:16.297571+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:41.542977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"262'4","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:11.280709+0000","last_change":"2024-09-12T17:15:40.109940+0000","last_active":"2024-09-12T17:38:11.280709+0000","last_peered":"2024-09-12T17:38:11.280709+0000","last_clean":"2024-09-12T17:38:11.280709+0000","last_became_active":"2024-09-12T17:15:40.109076+0000","last_became_peered":"2024-09-12T17:15:40.109076+0000","last_unstale":"2024-09-12T17:38:11.280709+0000","last_undegraded":"2024-09-12T17:38:11.280709+0000","last_fullsized":"2024-09-12T17:38:11.280709+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:05.822624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"262'6","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:12.349294+0000","last_change":"2024-09-12T17:13:54.820144+0000","last_active":"2024-09-12T17:38:12.349294+0000","last_peered":"2024-09-12T17:38:12.349294+0000","last_clean":"2024-09-12T17:38:12.349294+0000","last_became_active":"2024-09-12T17:13:54.819399+0000","last_became_peered":"2024-09-12T17:13:54.819399+0000","last_unstale":"2024-09-12T17:38:12.349294+0000","last_undegraded":"2024-09-12T17:38:12.349294+0000","last_fullsized":"2024-09-12T17:38:12.349294+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:25.721158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:21.291799+0000","last_change":"2024-09-12T17:27:17.420256+0000","last_active":"2024-09-12T17:37:21.291799+0000","last_peered":"2024-09-12T17:37:21.291799+0000","last_clean":"2024-09-12T17:37:21.291799+0000","last_became_active":"2024-09-12T17:27:17.419839+0000","last_became_peered":"2024-09-12T17:27:17.419839+0000","last_unstale":"2024-09-12T17:37:21.291799+0000","last_undegraded":"2024-09-12T17:37:21.291799+0000","last_fullsized":"2024-09-12T17:37:21.291799+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:46.578295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"265'4","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:12.353158+0000","last_change":"2024-09-12T17:15:43.160492+0000","last_active":"2024-09-12T17:38:12.353158+0000","last_peered":"2024-09-12T17:38:12.353158+0000","last_clean":"2024-09-12T17:38:12.353158+0000","last_became_active":"2024-09-12T17:15:43.159663+0000","last_became_peered":"2024-09-12T17:15:43.159663+0000","last_unstale":"2024-09-12T17:38:12.353158+0000","last_undegraded":"2024-09-12T17:38:12.353158+0000","last_fullsized":"2024-09-12T17:38:12.353158+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:48.671220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":9,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"265'2","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:42.384696+0000","last_change":"2024-09-12T17:15:40.131992+0000","last_active":"2024-09-12T17:40:42.384696+0000","last_peered":"2024-09-12T17:40:42.384696+0000","last_clean":"2024-09-12T17:40:42.384696+0000","last_became_active":"2024-09-12T17:15:40.131140+0000","last_became_peered":"2024-09-12T17:15:40.131140+0000","last_unstale":"2024-09-12T17:40:42.384696+0000","last_undegraded":"2024-09-12T17:40:42.384696+0000","last_fullsized":"2024-09-12T17:40:42.384696+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:26.319835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"265'19","reported_seq":94,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:08.694781+0000","last_change":"2024-09-12T17:13:54.832206+0000","last_active":"2024-09-12T17:38:08.694781+0000","last_peered":"2024-09-12T17:38:08.694781+0000","last_clean":"2024-09-12T17:38:08.694781+0000","last_became_active":"2024-09-12T17:13:54.831374+0000","last_became_peered":"2024-09-12T17:13:54.831374+0000","last_unstale":"2024-09-12T17:38:08.694781+0000","last_undegraded":"2024-09-12T17:38:08.694781+0000","last_fullsized":"2024-09-12T17:38:08.694781+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:25.250277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:58.706411+0000","last_change":"2024-09-12T17:27:17.416704+0000","last_active":"2024-09-12T17:38:58.706411+0000","last_peered":"2024-09-12T17:38:58.706411+0000","last_clean":"2024-09-12T17:38:58.706411+0000","last_became_active":"2024-09-12T17:27:17.415918+0000","last_became_peered":"2024-09-12T17:27:17.415918+0000","last_unstale":"2024-09-12T17:38:58.706411+0000","last_undegraded":"2024-09-12T17:38:58.706411+0000","last_fullsized":"2024-09-12T17:38:58.706411+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:40.069574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"265'3","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:27.342821+0000","last_change":"2024-09-12T17:15:43.872202+0000","last_active":"2024-09-12T17:37:27.342821+0000","last_peered":"2024-09-12T17:37:27.342821+0000","last_clean":"2024-09-12T17:37:27.342821+0000","last_became_active":"2024-09-12T17:15:43.871380+0000","last_became_peered":"2024-09-12T17:15:43.871380+0000","last_unstale":"2024-09-12T17:37:27.342821+0000","last_undegraded":"2024-09-12T17:37:27.342821+0000","last_fullsized":"2024-09-12T17:37:27.342821+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:54.178710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"265'2","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:07.347492+0000","last_change":"2024-09-12T17:15:40.117517+0000","last_active":"2024-09-12T17:39:07.347492+0000","last_peered":"2024-09-12T17:39:07.347492+0000","last_clean":"2024-09-12T17:39:07.347492+0000","last_became_active":"2024-09-12T17:15:40.116781+0000","last_became_peered":"2024-09-12T17:15:40.116781+0000","last_unstale":"2024-09-12T17:39:07.347492+0000","last_undegraded":"2024-09-12T17:39:07.347492+0000","last_fullsized":"2024-09-12T17:39:07.347492+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:04.218708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":7168,"num_write":2,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"265'68","reported_seq":230,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:31.441127+0000","last_change":"2024-09-12T17:13:54.830908+0000","last_active":"2024-09-12T17:39:31.441127+0000","last_peered":"2024-09-12T17:39:31.441127+0000","last_clean":"2024-09-12T17:39:31.441127+0000","last_became_active":"2024-09-12T17:13:54.829335+0000","last_became_peered":"2024-09-12T17:13:54.829335+0000","last_unstale":"2024-09-12T17:39:31.441127+0000","last_undegraded":"2024-09-12T17:39:31.441127+0000","last_fullsized":"2024-09-12T17:39:31.441127+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:18:25.184524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":349,"num_read_kb":240,"num_write":120,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"265'1","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:00.283371+0000","last_change":"2024-09-12T17:27:17.410174+0000","last_active":"2024-09-12T17:39:00.283371+0000","last_peered":"2024-09-12T17:39:00.283371+0000","last_clean":"2024-09-12T17:39:00.283371+0000","last_became_active":"2024-09-12T17:27:17.409364+0000","last_became_peered":"2024-09-12T17:27:17.409364+0000","last_unstale":"2024-09-12T17:39:00.283371+0000","last_undegraded":"2024-09-12T17:39:00.283371+0000","last_fullsized":"2024-09-12T17:39:00.283371+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:34.250496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"265'1","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:07.366937+0000","last_change":"2024-09-12T17:15:43.875351+0000","last_active":"2024-09-12T17:39:07.366937+0000","last_peered":"2024-09-12T17:39:07.366937+0000","last_clean":"2024-09-12T17:39:07.366937+0000","last_became_active":"2024-09-12T17:15:43.874421+0000","last_became_peered":"2024-09-12T17:15:43.874421+0000","last_unstale":"2024-09-12T17:39:07.366937+0000","last_undegraded":"2024-09-12T17:39:07.366937+0000","last_fullsized":"2024-09-12T17:39:07.366937+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:12.382448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"265'2","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:26.293177+0000","last_change":"2024-09-12T17:15:40.127851+0000","last_active":"2024-09-12T17:37:26.293177+0000","last_peered":"2024-09-12T17:37:26.293177+0000","last_clean":"2024-09-12T17:37:26.293177+0000","last_became_active":"2024-09-12T17:15:40.126898+0000","last_became_peered":"2024-09-12T17:15:40.126898+0000","last_unstale":"2024-09-12T17:37:26.293177+0000","last_undegraded":"2024-09-12T17:37:26.293177+0000","last_fullsized":"2024-09-12T17:37:26.293177+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:27.692907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"265'19","reported_seq":92,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:07.352095+0000","last_change":"2024-09-12T17:13:54.833584+0000","last_active":"2024-09-12T17:38:07.352095+0000","last_peered":"2024-09-12T17:38:07.352095+0000","last_clean":"2024-09-12T17:38:07.352095+0000","last_became_active":"2024-09-12T17:13:54.832780+0000","last_became_peered":"2024-09-12T17:13:54.832780+0000","last_unstale":"2024-09-12T17:38:07.352095+0000","last_undegraded":"2024-09-12T17:38:07.352095+0000","last_fullsized":"2024-09-12T17:38:07.352095+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:33.420620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":55,"num_write":40,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:01.315516+0000","last_change":"2024-09-12T17:27:17.415211+0000","last_active":"2024-09-12T17:39:01.315516+0000","last_peered":"2024-09-12T17:39:01.315516+0000","last_clean":"2024-09-12T17:39:01.315516+0000","last_became_active":"2024-09-12T17:27:17.414739+0000","last_became_peered":"2024-09-12T17:27:17.414739+0000","last_unstale":"2024-09-12T17:39:01.315516+0000","last_undegraded":"2024-09-12T17:39:01.315516+0000","last_fullsized":"2024-09-12T17:39:01.315516+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:57.434689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"265'4","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:27.342949+0000","last_change":"2024-09-12T17:15:43.872275+0000","last_active":"2024-09-12T17:37:27.342949+0000","last_peered":"2024-09-12T17:37:27.342949+0000","last_clean":"2024-09-12T17:37:27.342949+0000","last_became_active":"2024-09-12T17:15:43.871502+0000","last_became_peered":"2024-09-12T17:15:43.871502+0000","last_unstale":"2024-09-12T17:37:27.342949+0000","last_undegraded":"2024-09-12T17:37:27.342949+0000","last_fullsized":"2024-09-12T17:37:27.342949+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:07.859526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":9,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"265'3","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:25.263115+0000","last_change":"2024-09-12T17:15:40.133504+0000","last_active":"2024-09-12T17:37:25.263115+0000","last_peered":"2024-09-12T17:37:25.263115+0000","last_clean":"2024-09-12T17:37:25.263115+0000","last_became_active":"2024-09-12T17:15:40.132311+0000","last_became_peered":"2024-09-12T17:15:40.132311+0000","last_unstale":"2024-09-12T17:37:25.263115+0000","last_undegraded":"2024-09-12T17:37:25.263115+0000","last_fullsized":"2024-09-12T17:37:25.263115+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:42.985929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"265'33","reported_seq":136,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:05.271852+0000","last_change":"2024-09-12T17:13:54.828548+0000","last_active":"2024-09-12T17:38:05.271852+0000","last_peered":"2024-09-12T17:38:05.271852+0000","last_clean":"2024-09-12T17:38:05.271852+0000","last_became_active":"2024-09-12T17:13:54.827785+0000","last_became_peered":"2024-09-12T17:13:54.827785+0000","last_unstale":"2024-09-12T17:38:05.271852+0000","last_undegraded":"2024-09-12T17:38:05.271852+0000","last_fullsized":"2024-09-12T17:38:05.271852+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:29.075567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":116,"num_write":64,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:57.345260+0000","last_change":"2024-09-12T17:27:17.391923+0000","last_active":"2024-09-12T17:38:57.345260+0000","last_peered":"2024-09-12T17:38:57.345260+0000","last_clean":"2024-09-12T17:38:57.345260+0000","last_became_active":"2024-09-12T17:27:17.391154+0000","last_became_peered":"2024-09-12T17:27:17.391154+0000","last_unstale":"2024-09-12T17:38:57.345260+0000","last_undegraded":"2024-09-12T17:38:57.345260+0000","last_fullsized":"2024-09-12T17:38:57.345260+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:12.682141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"265'9","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:31.271602+0000","last_change":"2024-09-12T17:15:43.171314+0000","last_active":"2024-09-12T17:37:31.271602+0000","last_peered":"2024-09-12T17:37:31.271602+0000","last_clean":"2024-09-12T17:37:31.271602+0000","last_became_active":"2024-09-12T17:15:43.169085+0000","last_became_peered":"2024-09-12T17:15:43.169085+0000","last_unstale":"2024-09-12T17:37:31.271602+0000","last_undegraded":"2024-09-12T17:37:31.271602+0000","last_fullsized":"2024-09-12T17:37:31.271602+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:01.989288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13631488,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":43010,"num_write":14,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"265'1","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:27.339090+0000","last_change":"2024-09-12T17:15:40.139824+0000","last_active":"2024-09-12T17:37:27.339090+0000","last_peered":"2024-09-12T17:37:27.339090+0000","last_clean":"2024-09-12T17:37:27.339090+0000","last_became_active":"2024-09-12T17:15:40.139145+0000","last_became_peered":"2024-09-12T17:15:40.139145+0000","last_unstale":"2024-09-12T17:37:27.339090+0000","last_undegraded":"2024-09-12T17:37:27.339090+0000","last_fullsized":"2024-09-12T17:37:27.339090+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:52:16.027902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"265'28","reported_seq":124,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:38.948450+0000","last_change":"2024-09-12T17:13:54.843550+0000","last_active":"2024-09-12T17:38:38.948450+0000","last_peered":"2024-09-12T17:38:38.948450+0000","last_clean":"2024-09-12T17:38:38.948450+0000","last_became_active":"2024-09-12T17:13:54.842816+0000","last_became_peered":"2024-09-12T17:13:54.842816+0000","last_unstale":"2024-09-12T17:38:38.948450+0000","last_undegraded":"2024-09-12T17:38:38.948450+0000","last_fullsized":"2024-09-12T17:38:38.948450+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:02.403853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":108,"num_write":46,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:36:57.335925+0000","last_change":"2024-09-12T17:27:17.422713+0000","last_active":"2024-09-12T17:36:57.335925+0000","last_peered":"2024-09-12T17:36:57.335925+0000","last_clean":"2024-09-12T17:36:57.335925+0000","last_became_active":"2024-09-12T17:27:17.421939+0000","last_became_peered":"2024-09-12T17:27:17.421939+0000","last_unstale":"2024-09-12T17:36:57.335925+0000","last_undegraded":"2024-09-12T17:36:57.335925+0000","last_fullsized":"2024-09-12T17:36:57.335925+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:53.787184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"262'8","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:03.708024+0000","last_change":"2024-09-12T17:15:43.162064+0000","last_active":"2024-09-12T17:39:03.708024+0000","last_peered":"2024-09-12T17:39:03.708024+0000","last_clean":"2024-09-12T17:39:03.708024+0000","last_became_active":"2024-09-12T17:15:43.158530+0000","last_became_peered":"2024-09-12T17:15:43.158530+0000","last_unstale":"2024-09-12T17:39:03.708024+0000","last_undegraded":"2024-09-12T17:39:03.708024+0000","last_fullsized":"2024-09-12T17:39:03.708024+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:52.110653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10242,"num_write":8,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"265'3","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:01.291728+0000","last_change":"2024-09-12T17:15:40.131385+0000","last_active":"2024-09-12T17:39:01.291728+0000","last_peered":"2024-09-12T17:39:01.291728+0000","last_clean":"2024-09-12T17:39:01.291728+0000","last_became_active":"2024-09-12T17:15:40.130644+0000","last_became_peered":"2024-09-12T17:15:40.130644+0000","last_unstale":"2024-09-12T17:39:01.291728+0000","last_undegraded":"2024-09-12T17:39:01.291728+0000","last_fullsized":"2024-09-12T17:39:01.291728+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:14.166806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"265'14","reported_seq":88,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:16.290475+0000","last_change":"2024-09-12T17:13:54.843769+0000","last_active":"2024-09-12T17:37:16.290475+0000","last_peered":"2024-09-12T17:37:16.290475+0000","last_clean":"2024-09-12T17:37:16.290475+0000","last_became_active":"2024-09-12T17:13:54.843036+0000","last_became_peered":"2024-09-12T17:13:54.843036+0000","last_unstale":"2024-09-12T17:37:16.290475+0000","last_undegraded":"2024-09-12T17:37:16.290475+0000","last_fullsized":"2024-09-12T17:37:16.290475+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:08:22.840485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:36:57.331873+0000","last_change":"2024-09-12T17:27:17.426185+0000","last_active":"2024-09-12T17:36:57.331873+0000","last_peered":"2024-09-12T17:36:57.331873+0000","last_clean":"2024-09-12T17:36:57.331873+0000","last_became_active":"2024-09-12T17:27:17.421187+0000","last_became_peered":"2024-09-12T17:27:17.421187+0000","last_unstale":"2024-09-12T17:36:57.331873+0000","last_undegraded":"2024-09-12T17:36:57.331873+0000","last_fullsized":"2024-09-12T17:36:57.331873+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:54.922802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"265'7","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:18.734815+0000","last_change":"2024-09-12T17:15:43.156779+0000","last_active":"2024-09-12T17:41:18.734815+0000","last_peered":"2024-09-12T17:41:18.734815+0000","last_clean":"2024-09-12T17:41:18.734815+0000","last_became_active":"2024-09-12T17:15:43.155891+0000","last_became_peered":"2024-09-12T17:15:43.155891+0000","last_unstale":"2024-09-12T17:41:18.734815+0000","last_undegraded":"2024-09-12T17:41:18.734815+0000","last_fullsized":"2024-09-12T17:41:18.734815+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:51.266851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8194,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:02.365695+0000","last_change":"2024-09-12T17:15:40.129236+0000","last_active":"2024-09-12T17:39:02.365695+0000","last_peered":"2024-09-12T17:39:02.365695+0000","last_clean":"2024-09-12T17:39:02.365695+0000","last_became_active":"2024-09-12T17:15:40.128470+0000","last_became_peered":"2024-09-12T17:15:40.128470+0000","last_unstale":"2024-09-12T17:39:02.365695+0000","last_undegraded":"2024-09-12T17:39:02.365695+0000","last_fullsized":"2024-09-12T17:39:02.365695+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:17.232330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"265'46","reported_seq":175,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:59.769241+0000","last_change":"2024-09-12T17:13:54.822640+0000","last_active":"2024-09-12T17:38:59.769241+0000","last_peered":"2024-09-12T17:38:59.769241+0000","last_clean":"2024-09-12T17:38:59.769241+0000","last_became_active":"2024-09-12T17:13:54.821816+0000","last_became_peered":"2024-09-12T17:13:54.821816+0000","last_unstale":"2024-09-12T17:38:59.769241+0000","last_undegraded":"2024-09-12T17:38:59.769241+0000","last_fullsized":"2024-09-12T17:38:59.769241+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:01.101266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":166,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"264'1","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:02.362079+0000","last_change":"2024-09-12T17:27:17.423856+0000","last_active":"2024-09-12T17:39:02.362079+0000","last_peered":"2024-09-12T17:39:02.362079+0000","last_clean":"2024-09-12T17:39:02.362079+0000","last_became_active":"2024-09-12T17:27:17.422464+0000","last_became_peered":"2024-09-12T17:27:17.422464+0000","last_unstale":"2024-09-12T17:39:02.362079+0000","last_undegraded":"2024-09-12T17:39:02.362079+0000","last_fullsized":"2024-09-12T17:39:02.362079+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:44.192139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"265'6","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:02.365796+0000","last_change":"2024-09-12T17:15:43.172138+0000","last_active":"2024-09-12T17:39:02.365796+0000","last_peered":"2024-09-12T17:39:02.365796+0000","last_clean":"2024-09-12T17:39:02.365796+0000","last_became_active":"2024-09-12T17:15:43.171254+0000","last_became_peered":"2024-09-12T17:15:43.171254+0000","last_unstale":"2024-09-12T17:39:02.365796+0000","last_undegraded":"2024-09-12T17:39:02.365796+0000","last_fullsized":"2024-09-12T17:39:02.365796+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:22.106658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"265'3","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:01.307298+0000","last_change":"2024-09-12T17:15:40.117718+0000","last_active":"2024-09-12T17:39:01.307298+0000","last_peered":"2024-09-12T17:39:01.307298+0000","last_clean":"2024-09-12T17:39:01.307298+0000","last_became_active":"2024-09-12T17:15:40.116989+0000","last_became_peered":"2024-09-12T17:15:40.116989+0000","last_unstale":"2024-09-12T17:39:01.307298+0000","last_undegraded":"2024-09-12T17:39:01.307298+0000","last_fullsized":"2024-09-12T17:39:01.307298+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:05.611483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4119,"num_write":3,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"265'42","reported_seq":160,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:16.268235+0000","last_change":"2024-09-12T17:13:54.812445+0000","last_active":"2024-09-12T17:37:16.268235+0000","last_peered":"2024-09-12T17:37:16.268235+0000","last_clean":"2024-09-12T17:37:16.268235+0000","last_became_active":"2024-09-12T17:13:54.811613+0000","last_became_peered":"2024-09-12T17:13:54.811613+0000","last_unstale":"2024-09-12T17:37:16.268235+0000","last_undegraded":"2024-09-12T17:37:16.268235+0000","last_fullsized":"2024-09-12T17:37:16.268235+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:57.189420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":153,"num_write":74,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"265'1","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:36:57.335846+0000","last_change":"2024-09-12T17:27:17.405875+0000","last_active":"2024-09-12T17:36:57.335846+0000","last_peered":"2024-09-12T17:36:57.335846+0000","last_clean":"2024-09-12T17:36:57.335846+0000","last_became_active":"2024-09-12T17:27:17.405051+0000","last_became_peered":"2024-09-12T17:27:17.405051+0000","last_unstale":"2024-09-12T17:36:57.335846+0000","last_undegraded":"2024-09-12T17:36:57.335846+0000","last_fullsized":"2024-09-12T17:36:57.335846+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:07.362927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"265'1","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:06.308426+0000","last_change":"2024-09-12T17:15:43.158356+0000","last_active":"2024-09-12T17:39:06.308426+0000","last_peered":"2024-09-12T17:39:06.308426+0000","last_clean":"2024-09-12T17:39:06.308426+0000","last_became_active":"2024-09-12T17:15:43.157624+0000","last_became_peered":"2024-09-12T17:15:43.157624+0000","last_unstale":"2024-09-12T17:39:06.308426+0000","last_undegraded":"2024-09-12T17:39:06.308426+0000","last_fullsized":"2024-09-12T17:39:06.308426+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:44.475418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:02.346406+0000","last_change":"2024-09-12T17:15:40.118796+0000","last_active":"2024-09-12T17:39:02.346406+0000","last_peered":"2024-09-12T17:39:02.346406+0000","last_clean":"2024-09-12T17:39:02.346406+0000","last_became_active":"2024-09-12T17:15:40.118074+0000","last_became_peered":"2024-09-12T17:15:40.118074+0000","last_unstale":"2024-09-12T17:39:02.346406+0000","last_undegraded":"2024-09-12T17:39:02.346406+0000","last_fullsized":"2024-09-12T17:39:02.346406+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:53:01.242885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"265'16","reported_seq":89,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:17.340332+0000","last_change":"2024-09-12T17:13:54.841589+0000","last_active":"2024-09-12T17:37:17.340332+0000","last_peered":"2024-09-12T17:37:17.340332+0000","last_clean":"2024-09-12T17:37:17.340332+0000","last_became_active":"2024-09-12T17:13:54.840781+0000","last_became_peered":"2024-09-12T17:13:54.840781+0000","last_unstale":"2024-09-12T17:37:17.340332+0000","last_undegraded":"2024-09-12T17:37:17.340332+0000","last_fullsized":"2024-09-12T17:37:17.340332+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:48.110422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":56,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:15.273963+0000","last_change":"2024-09-12T17:27:17.409764+0000","last_active":"2024-09-12T17:38:15.273963+0000","last_peered":"2024-09-12T17:38:15.273963+0000","last_clean":"2024-09-12T17:38:15.273963+0000","last_became_active":"2024-09-12T17:27:17.408953+0000","last_became_peered":"2024-09-12T17:27:17.408953+0000","last_unstale":"2024-09-12T17:38:15.273963+0000","last_undegraded":"2024-09-12T17:38:15.273963+0000","last_fullsized":"2024-09-12T17:38:15.273963+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:26.794007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:12.353382+0000","last_change":"2024-09-12T17:15:43.165887+0000","last_active":"2024-09-12T17:38:12.353382+0000","last_peered":"2024-09-12T17:38:12.353382+0000","last_clean":"2024-09-12T17:38:12.353382+0000","last_became_active":"2024-09-12T17:15:43.164943+0000","last_became_peered":"2024-09-12T17:15:43.164943+0000","last_unstale":"2024-09-12T17:38:12.353382+0000","last_undegraded":"2024-09-12T17:38:12.353382+0000","last_fullsized":"2024-09-12T17:38:12.353382+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:08.542268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"265'6","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:11.303936+0000","last_change":"2024-09-12T17:15:40.129503+0000","last_active":"2024-09-12T17:38:11.303936+0000","last_peered":"2024-09-12T17:38:11.303936+0000","last_clean":"2024-09-12T17:38:11.303936+0000","last_became_active":"2024-09-12T17:15:40.128681+0000","last_became_peered":"2024-09-12T17:15:40.128681+0000","last_unstale":"2024-09-12T17:38:11.303936+0000","last_undegraded":"2024-09-12T17:38:11.303936+0000","last_fullsized":"2024-09-12T17:38:11.303936+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:21.306746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":11,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"265'9","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:47.361596+0000","last_change":"2024-09-12T17:13:54.844500+0000","last_active":"2024-09-12T17:38:47.361596+0000","last_peered":"2024-09-12T17:38:47.361596+0000","last_clean":"2024-09-12T17:38:47.361596+0000","last_became_active":"2024-09-12T17:13:54.842287+0000","last_became_peered":"2024-09-12T17:13:54.842287+0000","last_unstale":"2024-09-12T17:38:47.361596+0000","last_undegraded":"2024-09-12T17:38:47.361596+0000","last_fullsized":"2024-09-12T17:38:47.361596+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:09.440211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":28,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:36.309617+0000","last_change":"2024-09-12T17:27:17.416766+0000","last_active":"2024-09-12T17:38:36.309617+0000","last_peered":"2024-09-12T17:38:36.309617+0000","last_clean":"2024-09-12T17:38:36.309617+0000","last_became_active":"2024-09-12T17:27:17.415241+0000","last_became_peered":"2024-09-12T17:27:17.415241+0000","last_unstale":"2024-09-12T17:38:36.309617+0000","last_undegraded":"2024-09-12T17:38:36.309617+0000","last_fullsized":"2024-09-12T17:38:36.309617+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:04.923059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"265'7","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:12.353274+0000","last_change":"2024-09-12T17:15:43.171921+0000","last_active":"2024-09-12T17:38:12.353274+0000","last_peered":"2024-09-12T17:38:12.353274+0000","last_clean":"2024-09-12T17:38:12.353274+0000","last_became_active":"2024-09-12T17:15:43.168676+0000","last_became_peered":"2024-09-12T17:15:43.168676+0000","last_unstale":"2024-09-12T17:38:12.353274+0000","last_undegraded":"2024-09-12T17:38:12.353274+0000","last_fullsized":"2024-09-12T17:38:12.353274+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:51.743678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":24578,"num_write":17,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"265'5","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:10.272991+0000","last_change":"2024-09-12T17:15:40.129433+0000","last_active":"2024-09-12T17:38:10.272991+0000","last_peered":"2024-09-12T17:38:10.272991+0000","last_clean":"2024-09-12T17:38:10.272991+0000","last_became_active":"2024-09-12T17:15:40.128708+0000","last_became_peered":"2024-09-12T17:15:40.128708+0000","last_unstale":"2024-09-12T17:38:10.272991+0000","last_undegraded":"2024-09-12T17:38:10.272991+0000","last_fullsized":"2024-09-12T17:38:10.272991+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:54.970720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8194,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"265'35","reported_seq":144,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:42.341793+0000","last_change":"2024-09-12T17:13:54.830851+0000","last_active":"2024-09-12T17:38:42.341793+0000","last_peered":"2024-09-12T17:38:42.341793+0000","last_clean":"2024-09-12T17:38:42.341793+0000","last_became_active":"2024-09-12T17:13:54.830096+0000","last_became_peered":"2024-09-12T17:13:54.830096+0000","last_unstale":"2024-09-12T17:38:42.341793+0000","last_undegraded":"2024-09-12T17:38:42.341793+0000","last_fullsized":"2024-09-12T17:38:42.341793+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:08.715298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":131,"num_write":60,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:06.295390+0000","last_change":"2024-09-12T17:27:17.412405+0000","last_active":"2024-09-12T17:38:06.295390+0000","last_peered":"2024-09-12T17:38:06.295390+0000","last_clean":"2024-09-12T17:38:06.295390+0000","last_became_active":"2024-09-12T17:27:17.411635+0000","last_became_peered":"2024-09-12T17:27:17.411635+0000","last_unstale":"2024-09-12T17:38:06.295390+0000","last_undegraded":"2024-09-12T17:38:06.295390+0000","last_fullsized":"2024-09-12T17:38:06.295390+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:12.596567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:13.696208+0000","last_change":"2024-09-12T17:15:43.870101+0000","last_active":"2024-09-12T17:38:13.696208+0000","last_peered":"2024-09-12T17:38:13.696208+0000","last_clean":"2024-09-12T17:38:13.696208+0000","last_became_active":"2024-09-12T17:15:43.869197+0000","last_became_peered":"2024-09-12T17:15:43.869197+0000","last_unstale":"2024-09-12T17:38:13.696208+0000","last_undegraded":"2024-09-12T17:38:13.696208+0000","last_fullsized":"2024-09-12T17:38:13.696208+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:50:50.852439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:12.349506+0000","last_change":"2024-09-12T17:15:40.115375+0000","last_active":"2024-09-12T17:38:12.349506+0000","last_peered":"2024-09-12T17:38:12.349506+0000","last_clean":"2024-09-12T17:38:12.349506+0000","last_became_active":"2024-09-12T17:15:40.114636+0000","last_became_peered":"2024-09-12T17:15:40.114636+0000","last_unstale":"2024-09-12T17:38:12.349506+0000","last_undegraded":"2024-09-12T17:38:12.349506+0000","last_fullsized":"2024-09-12T17:38:12.349506+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:25.820396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"265'11","reported_seq":77,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:41.303136+0000","last_change":"2024-09-12T17:13:54.837741+0000","last_active":"2024-09-12T17:38:41.303136+0000","last_peered":"2024-09-12T17:38:41.303136+0000","last_clean":"2024-09-12T17:38:41.303136+0000","last_became_active":"2024-09-12T17:13:54.836955+0000","last_became_peered":"2024-09-12T17:13:54.836955+0000","last_unstale":"2024-09-12T17:38:41.303136+0000","last_undegraded":"2024-09-12T17:38:41.303136+0000","last_fullsized":"2024-09-12T17:38:41.303136+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:27.239370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":38,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:11.303795+0000","last_change":"2024-09-12T17:27:17.409364+0000","last_active":"2024-09-12T17:38:11.303795+0000","last_peered":"2024-09-12T17:38:11.303795+0000","last_clean":"2024-09-12T17:38:11.303795+0000","last_became_active":"2024-09-12T17:27:17.408128+0000","last_became_peered":"2024-09-12T17:27:17.408128+0000","last_unstale":"2024-09-12T17:38:11.303795+0000","last_undegraded":"2024-09-12T17:38:11.303795+0000","last_fullsized":"2024-09-12T17:38:11.303795+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:44.771065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"265'2","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:12.353412+0000","last_change":"2024-09-12T17:15:43.171004+0000","last_active":"2024-09-12T17:38:12.353412+0000","last_peered":"2024-09-12T17:38:12.353412+0000","last_clean":"2024-09-12T17:38:12.353412+0000","last_became_active":"2024-09-12T17:15:43.169936+0000","last_became_peered":"2024-09-12T17:15:43.169936+0000","last_unstale":"2024-09-12T17:38:12.353412+0000","last_undegraded":"2024-09-12T17:38:12.353412+0000","last_fullsized":"2024-09-12T17:38:12.353412+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:21.292046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"265'9","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.083485+0000","last_change":"2024-09-12T17:15:40.122273+0000","last_active":"2024-09-12T17:41:32.083485+0000","last_peered":"2024-09-12T17:41:32.083485+0000","last_clean":"2024-09-12T17:41:32.083485+0000","last_became_active":"2024-09-12T17:15:40.121181+0000","last_became_peered":"2024-09-12T17:15:40.121181+0000","last_unstale":"2024-09-12T17:41:32.083485+0000","last_undegraded":"2024-09-12T17:41:32.083485+0000","last_fullsized":"2024-09-12T17:41:32.083485+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:36.422026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12338,"num_write":14,"num_write_kb":5168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"265'48","reported_seq":176,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:41.282547+0000","last_change":"2024-09-12T17:13:54.842918+0000","last_active":"2024-09-12T17:38:41.282547+0000","last_peered":"2024-09-12T17:38:41.282547+0000","last_clean":"2024-09-12T17:38:41.282547+0000","last_became_active":"2024-09-12T17:13:54.841923+0000","last_became_peered":"2024-09-12T17:13:54.841923+0000","last_unstale":"2024-09-12T17:38:41.282547+0000","last_undegraded":"2024-09-12T17:38:41.282547+0000","last_fullsized":"2024-09-12T17:38:41.282547+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:08.355932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":241,"num_read_kb":172,"num_write":100,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:32.357996+0000","last_change":"2024-09-12T17:27:17.419285+0000","last_active":"2024-09-12T17:38:32.357996+0000","last_peered":"2024-09-12T17:38:32.357996+0000","last_clean":"2024-09-12T17:38:32.357996+0000","last_became_active":"2024-09-12T17:27:17.417566+0000","last_became_peered":"2024-09-12T17:27:17.417566+0000","last_unstale":"2024-09-12T17:38:32.357996+0000","last_undegraded":"2024-09-12T17:38:32.357996+0000","last_fullsized":"2024-09-12T17:38:32.357996+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:32.507294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"262'4","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:26.270382+0000","last_change":"2024-09-12T17:15:43.162593+0000","last_active":"2024-09-12T17:37:26.270382+0000","last_peered":"2024-09-12T17:37:26.270382+0000","last_clean":"2024-09-12T17:37:26.270382+0000","last_became_active":"2024-09-12T17:15:43.161858+0000","last_became_peered":"2024-09-12T17:15:43.161858+0000","last_unstale":"2024-09-12T17:37:26.270382+0000","last_undegraded":"2024-09-12T17:37:26.270382+0000","last_fullsized":"2024-09-12T17:37:26.270382+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:23.655020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:22.337556+0000","last_change":"2024-09-12T17:15:40.113046+0000","last_active":"2024-09-12T17:37:22.337556+0000","last_peered":"2024-09-12T17:37:22.337556+0000","last_clean":"2024-09-12T17:37:22.337556+0000","last_became_active":"2024-09-12T17:15:40.112179+0000","last_became_peered":"2024-09-12T17:15:40.112179+0000","last_unstale":"2024-09-12T17:37:22.337556+0000","last_undegraded":"2024-09-12T17:37:22.337556+0000","last_fullsized":"2024-09-12T17:37:22.337556+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:35.125445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"265'67","reported_seq":229,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:42.356505+0000","last_change":"2024-09-12T17:13:54.828364+0000","last_active":"2024-09-12T17:38:42.356505+0000","last_peered":"2024-09-12T17:38:42.356505+0000","last_clean":"2024-09-12T17:38:42.356505+0000","last_became_active":"2024-09-12T17:13:54.827402+0000","last_became_peered":"2024-09-12T17:13:54.827402+0000","last_unstale":"2024-09-12T17:38:42.356505+0000","last_undegraded":"2024-09-12T17:38:42.356505+0000","last_fullsized":"2024-09-12T17:38:42.356505+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:52.664896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":342,"num_read_kb":248,"num_write":117,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:41.310813+0000","last_change":"2024-09-12T17:27:17.418505+0000","last_active":"2024-09-12T17:38:41.310813+0000","last_peered":"2024-09-12T17:38:41.310813+0000","last_clean":"2024-09-12T17:38:41.310813+0000","last_became_active":"2024-09-12T17:27:17.418022+0000","last_became_peered":"2024-09-12T17:27:17.418022+0000","last_unstale":"2024-09-12T17:38:41.310813+0000","last_undegraded":"2024-09-12T17:38:41.310813+0000","last_fullsized":"2024-09-12T17:38:41.310813+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:55.678220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"265'4","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:26.292871+0000","last_change":"2024-09-12T17:15:43.865245+0000","last_active":"2024-09-12T17:37:26.292871+0000","last_peered":"2024-09-12T17:37:26.292871+0000","last_clean":"2024-09-12T17:37:26.292871+0000","last_became_active":"2024-09-12T17:15:43.864657+0000","last_became_peered":"2024-09-12T17:15:43.864657+0000","last_unstale":"2024-09-12T17:37:26.292871+0000","last_undegraded":"2024-09-12T17:37:26.292871+0000","last_fullsized":"2024-09-12T17:37:26.292871+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:57.152668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":9,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"265'12","reported_seq":67,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:33.714998+0000","last_change":"2024-09-12T17:15:40.123025+0000","last_active":"2024-09-12T17:39:33.714998+0000","last_peered":"2024-09-12T17:39:33.714998+0000","last_clean":"2024-09-12T17:39:33.714998+0000","last_became_active":"2024-09-12T17:15:40.122001+0000","last_became_peered":"2024-09-12T17:15:40.122001+0000","last_unstale":"2024-09-12T17:39:33.714998+0000","last_undegraded":"2024-09-12T17:39:33.714998+0000","last_fullsized":"2024-09-12T17:39:33.714998+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:47.430779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12340,"num_write":12,"num_write_kb":6192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"265'23","reported_seq":105,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:51.298999+0000","last_change":"2024-09-12T17:13:54.831219+0000","last_active":"2024-09-12T17:37:51.298999+0000","last_peered":"2024-09-12T17:37:51.298999+0000","last_clean":"2024-09-12T17:37:51.298999+0000","last_became_active":"2024-09-12T17:13:54.825019+0000","last_became_peered":"2024-09-12T17:13:54.825019+0000","last_unstale":"2024-09-12T17:37:51.298999+0000","last_undegraded":"2024-09-12T17:37:51.298999+0000","last_fullsized":"2024-09-12T17:37:51.298999+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:13.461017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":38,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"265'1","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:36.309680+0000","last_change":"2024-09-12T17:27:17.408731+0000","last_active":"2024-09-12T17:38:36.309680+0000","last_peered":"2024-09-12T17:38:36.309680+0000","last_clean":"2024-09-12T17:38:36.309680+0000","last_became_active":"2024-09-12T17:27:17.408151+0000","last_became_peered":"2024-09-12T17:27:17.408151+0000","last_unstale":"2024-09-12T17:38:36.309680+0000","last_undegraded":"2024-09-12T17:38:36.309680+0000","last_fullsized":"2024-09-12T17:38:36.309680+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:04.214744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"265'7","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.648854+0000","last_change":"2024-09-12T17:15:43.167300+0000","last_active":"2024-09-12T17:41:32.648854+0000","last_peered":"2024-09-12T17:41:32.648854+0000","last_clean":"2024-09-12T17:41:32.648854+0000","last_became_active":"2024-09-12T17:15:43.166482+0000","last_became_peered":"2024-09-12T17:15:43.166482+0000","last_unstale":"2024-09-12T17:41:32.648854+0000","last_undegraded":"2024-09-12T17:41:32.648854+0000","last_fullsized":"2024-09-12T17:41:32.648854+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:11.626906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:27.338914+0000","last_change":"2024-09-12T17:15:40.138867+0000","last_active":"2024-09-12T17:37:27.338914+0000","last_peered":"2024-09-12T17:37:27.338914+0000","last_clean":"2024-09-12T17:37:27.338914+0000","last_became_active":"2024-09-12T17:15:40.138190+0000","last_became_peered":"2024-09-12T17:15:40.138190+0000","last_unstale":"2024-09-12T17:37:27.338914+0000","last_undegraded":"2024-09-12T17:37:27.338914+0000","last_fullsized":"2024-09-12T17:37:27.338914+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:31.598623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"265'18","reported_seq":93,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:47.347138+0000","last_change":"2024-09-12T17:13:54.833230+0000","last_active":"2024-09-12T17:37:47.347138+0000","last_peered":"2024-09-12T17:37:47.347138+0000","last_clean":"2024-09-12T17:37:47.347138+0000","last_became_active":"2024-09-12T17:13:54.832453+0000","last_became_peered":"2024-09-12T17:13:54.832453+0000","last_unstale":"2024-09-12T17:37:47.347138+0000","last_undegraded":"2024-09-12T17:37:47.347138+0000","last_fullsized":"2024-09-12T17:37:47.347138+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:14.336440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":60,"num_write":35,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:32.354215+0000","last_change":"2024-09-12T17:27:17.418555+0000","last_active":"2024-09-12T17:38:32.354215+0000","last_peered":"2024-09-12T17:38:32.354215+0000","last_clean":"2024-09-12T17:38:32.354215+0000","last_became_active":"2024-09-12T17:27:17.417574+0000","last_became_peered":"2024-09-12T17:27:17.417574+0000","last_unstale":"2024-09-12T17:38:32.354215+0000","last_undegraded":"2024-09-12T17:38:32.354215+0000","last_fullsized":"2024-09-12T17:38:32.354215+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:54.585796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"265'2","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:31.294406+0000","last_change":"2024-09-12T17:15:43.151790+0000","last_active":"2024-09-12T17:37:31.294406+0000","last_peered":"2024-09-12T17:37:31.294406+0000","last_clean":"2024-09-12T17:37:31.294406+0000","last_became_active":"2024-09-12T17:15:43.151000+0000","last_became_peered":"2024-09-12T17:15:43.151000+0000","last_unstale":"2024-09-12T17:37:31.294406+0000","last_undegraded":"2024-09-12T17:37:31.294406+0000","last_fullsized":"2024-09-12T17:37:31.294406+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:26:12.163255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"262'2","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:11.280772+0000","last_change":"2024-09-12T17:15:40.119321+0000","last_active":"2024-09-12T17:38:11.280772+0000","last_peered":"2024-09-12T17:38:11.280772+0000","last_clean":"2024-09-12T17:38:11.280772+0000","last_became_active":"2024-09-12T17:15:40.118469+0000","last_became_peered":"2024-09-12T17:15:40.118469+0000","last_unstale":"2024-09-12T17:38:11.280772+0000","last_undegraded":"2024-09-12T17:38:11.280772+0000","last_fullsized":"2024-09-12T17:38:11.280772+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:28.762279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"265'20","reported_seq":99,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:46.290866+0000","last_change":"2024-09-12T17:13:54.828421+0000","last_active":"2024-09-12T17:37:46.290866+0000","last_peered":"2024-09-12T17:37:46.290866+0000","last_clean":"2024-09-12T17:37:46.290866+0000","last_became_active":"2024-09-12T17:13:54.827570+0000","last_became_peered":"2024-09-12T17:13:54.827570+0000","last_unstale":"2024-09-12T17:37:46.290866+0000","last_undegraded":"2024-09-12T17:37:46.290866+0000","last_fullsized":"2024-09-12T17:37:46.290866+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:42.149748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":63,"num_write":42,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:46.297919+0000","last_change":"2024-09-12T17:27:17.411486+0000","last_active":"2024-09-12T17:37:46.297919+0000","last_peered":"2024-09-12T17:37:46.297919+0000","last_clean":"2024-09-12T17:37:46.297919+0000","last_became_active":"2024-09-12T17:27:17.411175+0000","last_became_peered":"2024-09-12T17:27:17.411175+0000","last_unstale":"2024-09-12T17:37:46.297919+0000","last_undegraded":"2024-09-12T17:37:46.297919+0000","last_fullsized":"2024-09-12T17:37:46.297919+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:59.115945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"265'4","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:42.356637+0000","last_change":"2024-09-12T17:15:43.159928+0000","last_active":"2024-09-12T17:38:42.356637+0000","last_peered":"2024-09-12T17:38:42.356637+0000","last_clean":"2024-09-12T17:38:42.356637+0000","last_became_active":"2024-09-12T17:15:43.159149+0000","last_became_peered":"2024-09-12T17:15:43.159149+0000","last_unstale":"2024-09-12T17:38:42.356637+0000","last_undegraded":"2024-09-12T17:38:42.356637+0000","last_fullsized":"2024-09-12T17:38:42.356637+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:34.107337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":9,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"265'6","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:36.309657+0000","last_change":"2024-09-12T17:15:40.122291+0000","last_active":"2024-09-12T17:38:36.309657+0000","last_peered":"2024-09-12T17:38:36.309657+0000","last_clean":"2024-09-12T17:38:36.309657+0000","last_became_active":"2024-09-12T17:15:40.121513+0000","last_became_peered":"2024-09-12T17:15:40.121513+0000","last_unstale":"2024-09-12T17:38:36.309657+0000","last_undegraded":"2024-09-12T17:38:36.309657+0000","last_fullsized":"2024-09-12T17:38:36.309657+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:00.339305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":11,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"265'31","reported_seq":131,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:47.343574+0000","last_change":"2024-09-12T17:13:54.830067+0000","last_active":"2024-09-12T17:37:47.343574+0000","last_peered":"2024-09-12T17:37:47.343574+0000","last_clean":"2024-09-12T17:37:47.343574+0000","last_became_active":"2024-09-12T17:13:54.828393+0000","last_became_peered":"2024-09-12T17:13:54.828393+0000","last_unstale":"2024-09-12T17:37:47.343574+0000","last_undegraded":"2024-09-12T17:37:47.343574+0000","last_fullsized":"2024-09-12T17:37:47.343574+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:22:33.149059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":109,"num_write":58,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:42.328164+0000","last_change":"2024-09-12T17:27:17.402782+0000","last_active":"2024-09-12T17:37:42.328164+0000","last_peered":"2024-09-12T17:37:42.328164+0000","last_clean":"2024-09-12T17:37:42.328164+0000","last_became_active":"2024-09-12T17:27:17.402024+0000","last_became_peered":"2024-09-12T17:27:17.402024+0000","last_unstale":"2024-09-12T17:37:42.328164+0000","last_undegraded":"2024-09-12T17:37:42.328164+0000","last_fullsized":"2024-09-12T17:37:42.328164+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:24.176691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:37.355395+0000","last_change":"2024-09-12T17:15:43.871865+0000","last_active":"2024-09-12T17:38:37.355395+0000","last_peered":"2024-09-12T17:38:37.355395+0000","last_clean":"2024-09-12T17:38:37.355395+0000","last_became_active":"2024-09-12T17:15:43.871095+0000","last_became_peered":"2024-09-12T17:15:43.871095+0000","last_unstale":"2024-09-12T17:38:37.355395+0000","last_undegraded":"2024-09-12T17:38:37.355395+0000","last_fullsized":"2024-09-12T17:38:37.355395+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:26.988527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'7","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:40.279107+0000","last_change":"2024-09-12T17:15:40.126453+0000","last_active":"2024-09-12T17:38:40.279107+0000","last_peered":"2024-09-12T17:38:40.279107+0000","last_clean":"2024-09-12T17:38:40.279107+0000","last_became_active":"2024-09-12T17:15:40.125684+0000","last_became_peered":"2024-09-12T17:15:40.125684+0000","last_unstale":"2024-09-12T17:38:40.279107+0000","last_undegraded":"2024-09-12T17:38:40.279107+0000","last_fullsized":"2024-09-12T17:38:40.279107+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:40.660204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":32770,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"265'38","reported_seq":147,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:46.291003+0000","last_change":"2024-09-12T17:13:54.826751+0000","last_active":"2024-09-12T17:37:46.291003+0000","last_peered":"2024-09-12T17:37:46.291003+0000","last_clean":"2024-09-12T17:37:46.291003+0000","last_became_active":"2024-09-12T17:13:54.825945+0000","last_became_peered":"2024-09-12T17:13:54.825945+0000","last_unstale":"2024-09-12T17:37:46.291003+0000","last_undegraded":"2024-09-12T17:37:46.291003+0000","last_fullsized":"2024-09-12T17:37:46.291003+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:17.823826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":132,"num_write":66,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:18.711398+0000","last_change":"2024-09-12T17:27:17.409234+0000","last_active":"2024-09-12T17:39:18.711398+0000","last_peered":"2024-09-12T17:39:18.711398+0000","last_clean":"2024-09-12T17:39:18.711398+0000","last_became_active":"2024-09-12T17:27:17.408445+0000","last_became_peered":"2024-09-12T17:27:17.408445+0000","last_unstale":"2024-09-12T17:39:18.711398+0000","last_undegraded":"2024-09-12T17:39:18.711398+0000","last_fullsized":"2024-09-12T17:39:18.711398+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:52.795384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:26.293254+0000","last_change":"2024-09-12T17:15:43.867204+0000","last_active":"2024-09-12T17:37:26.293254+0000","last_peered":"2024-09-12T17:37:26.293254+0000","last_clean":"2024-09-12T17:37:26.293254+0000","last_became_active":"2024-09-12T17:15:43.866375+0000","last_became_peered":"2024-09-12T17:15:43.866375+0000","last_unstale":"2024-09-12T17:37:26.293254+0000","last_undegraded":"2024-09-12T17:37:26.293254+0000","last_fullsized":"2024-09-12T17:37:26.293254+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:23:05.372335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"265'5","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:32.352788+0000","last_change":"2024-09-12T17:15:40.125566+0000","last_active":"2024-09-12T17:39:32.352788+0000","last_peered":"2024-09-12T17:39:32.352788+0000","last_clean":"2024-09-12T17:39:32.352788+0000","last_became_active":"2024-09-12T17:15:40.124901+0000","last_became_peered":"2024-09-12T17:15:40.124901+0000","last_unstale":"2024-09-12T17:39:32.352788+0000","last_undegraded":"2024-09-12T17:39:32.352788+0000","last_fullsized":"2024-09-12T17:39:32.352788+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:00.285681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"265'32","reported_seq":130,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:01.315756+0000","last_change":"2024-09-12T17:13:54.830950+0000","last_active":"2024-09-12T17:39:01.315756+0000","last_peered":"2024-09-12T17:39:01.315756+0000","last_clean":"2024-09-12T17:39:01.315756+0000","last_became_active":"2024-09-12T17:13:54.824810+0000","last_became_peered":"2024-09-12T17:13:54.824810+0000","last_unstale":"2024-09-12T17:39:01.315756+0000","last_undegraded":"2024-09-12T17:39:01.315756+0000","last_fullsized":"2024-09-12T17:39:01.315756+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:18.942711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":107,"num_write":61,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:46.274844+0000","last_change":"2024-09-12T17:27:17.410104+0000","last_active":"2024-09-12T17:37:46.274844+0000","last_peered":"2024-09-12T17:37:46.274844+0000","last_clean":"2024-09-12T17:37:46.274844+0000","last_became_active":"2024-09-12T17:27:17.409774+0000","last_became_peered":"2024-09-12T17:27:17.409774+0000","last_unstale":"2024-09-12T17:37:46.274844+0000","last_undegraded":"2024-09-12T17:37:46.274844+0000","last_fullsized":"2024-09-12T17:37:46.274844+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:24.438283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:26.270554+0000","last_change":"2024-09-12T17:15:43.171491+0000","last_active":"2024-09-12T17:37:26.270554+0000","last_peered":"2024-09-12T17:37:26.270554+0000","last_clean":"2024-09-12T17:37:26.270554+0000","last_became_active":"2024-09-12T17:15:43.167221+0000","last_became_peered":"2024-09-12T17:15:43.167221+0000","last_unstale":"2024-09-12T17:37:26.270554+0000","last_undegraded":"2024-09-12T17:37:26.270554+0000","last_fullsized":"2024-09-12T17:37:26.270554+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:22.949060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"262'5","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:21.291867+0000","last_change":"2024-09-12T17:15:40.131852+0000","last_active":"2024-09-12T17:37:21.291867+0000","last_peered":"2024-09-12T17:37:21.291867+0000","last_clean":"2024-09-12T17:37:21.291867+0000","last_became_active":"2024-09-12T17:15:40.131162+0000","last_became_peered":"2024-09-12T17:15:40.131162+0000","last_unstale":"2024-09-12T17:37:21.291867+0000","last_undegraded":"2024-09-12T17:37:21.291867+0000","last_fullsized":"2024-09-12T17:37:21.291867+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:28.505817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"262'228","reported_seq":763,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:58.706524+0000","last_change":"2024-09-12T17:13:54.825163+0000","last_active":"2024-09-12T17:38:58.706524+0000","last_peered":"2024-09-12T17:38:58.706524+0000","last_clean":"2024-09-12T17:38:58.706524+0000","last_became_active":"2024-09-12T17:13:54.824372+0000","last_became_peered":"2024-09-12T17:13:54.824372+0000","last_unstale":"2024-09-12T17:38:58.706524+0000","last_undegraded":"2024-09-12T17:38:58.706524+0000","last_fullsized":"2024-09-12T17:38:58.706524+0000","mapping_epoch":252,"log_start":"262'200","ondisk_log_start":"262'200","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:21.156675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1417,"num_read_kb":1102,"num_write":261,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"265'1","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:10.273048+0000","last_change":"2024-09-12T17:27:17.404784+0000","last_active":"2024-09-12T17:38:10.273048+0000","last_peered":"2024-09-12T17:38:10.273048+0000","last_clean":"2024-09-12T17:38:10.273048+0000","last_became_active":"2024-09-12T17:27:17.404001+0000","last_became_peered":"2024-09-12T17:27:17.404001+0000","last_unstale":"2024-09-12T17:38:10.273048+0000","last_undegraded":"2024-09-12T17:38:10.273048+0000","last_fullsized":"2024-09-12T17:38:10.273048+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:30.724589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:33.700764+0000","last_change":"2024-09-12T17:15:43.159967+0000","last_active":"2024-09-12T17:38:33.700764+0000","last_peered":"2024-09-12T17:38:33.700764+0000","last_clean":"2024-09-12T17:38:33.700764+0000","last_became_active":"2024-09-12T17:15:43.159256+0000","last_became_peered":"2024-09-12T17:15:43.159256+0000","last_unstale":"2024-09-12T17:38:33.700764+0000","last_undegraded":"2024-09-12T17:38:33.700764+0000","last_fullsized":"2024-09-12T17:38:33.700764+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:56.377319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"265'1","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:46.297815+0000","last_change":"2024-09-12T17:15:40.139358+0000","last_active":"2024-09-12T17:37:46.297815+0000","last_peered":"2024-09-12T17:37:46.297815+0000","last_clean":"2024-09-12T17:37:46.297815+0000","last_became_active":"2024-09-12T17:15:40.138844+0000","last_became_peered":"2024-09-12T17:15:40.138844+0000","last_unstale":"2024-09-12T17:37:46.297815+0000","last_undegraded":"2024-09-12T17:37:46.297815+0000","last_fullsized":"2024-09-12T17:37:46.297815+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:16.913094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"265'38","reported_seq":148,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:57.345346+0000","last_change":"2024-09-12T17:13:54.831688+0000","last_active":"2024-09-12T17:38:57.345346+0000","last_peered":"2024-09-12T17:38:57.345346+0000","last_clean":"2024-09-12T17:38:57.345346+0000","last_became_active":"2024-09-12T17:13:54.830999+0000","last_became_peered":"2024-09-12T17:13:54.830999+0000","last_unstale":"2024-09-12T17:38:57.345346+0000","last_undegraded":"2024-09-12T17:38:57.345346+0000","last_fullsized":"2024-09-12T17:38:57.345346+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:34.484369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":129,"num_write":64,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:07.348306+0000","last_change":"2024-09-12T17:27:17.413681+0000","last_active":"2024-09-12T17:38:07.348306+0000","last_peered":"2024-09-12T17:38:07.348306+0000","last_clean":"2024-09-12T17:38:07.348306+0000","last_became_active":"2024-09-12T17:27:17.412921+0000","last_became_peered":"2024-09-12T17:27:17.412921+0000","last_unstale":"2024-09-12T17:38:07.348306+0000","last_undegraded":"2024-09-12T17:38:07.348306+0000","last_fullsized":"2024-09-12T17:38:07.348306+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:10.295122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"265'2","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:47.329147+0000","last_change":"2024-09-12T17:15:43.155640+0000","last_active":"2024-09-12T17:37:47.329147+0000","last_peered":"2024-09-12T17:37:47.329147+0000","last_clean":"2024-09-12T17:37:47.329147+0000","last_became_active":"2024-09-12T17:15:43.154940+0000","last_became_peered":"2024-09-12T17:15:43.154940+0000","last_unstale":"2024-09-12T17:37:47.329147+0000","last_undegraded":"2024-09-12T17:37:47.329147+0000","last_fullsized":"2024-09-12T17:37:47.329147+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:09:53.313111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:36.309541+0000","last_change":"2024-09-12T17:15:40.127548+0000","last_active":"2024-09-12T17:38:36.309541+0000","last_peered":"2024-09-12T17:38:36.309541+0000","last_clean":"2024-09-12T17:38:36.309541+0000","last_became_active":"2024-09-12T17:15:40.126745+0000","last_became_peered":"2024-09-12T17:15:40.126745+0000","last_unstale":"2024-09-12T17:38:36.309541+0000","last_undegraded":"2024-09-12T17:38:36.309541+0000","last_fullsized":"2024-09-12T17:38:36.309541+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:58.903944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"265'14","reported_seq":86,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:32.319736+0000","last_change":"2024-09-12T17:13:54.841357+0000","last_active":"2024-09-12T17:39:32.319736+0000","last_peered":"2024-09-12T17:39:32.319736+0000","last_clean":"2024-09-12T17:39:32.319736+0000","last_became_active":"2024-09-12T17:13:54.840501+0000","last_became_peered":"2024-09-12T17:13:54.840501+0000","last_unstale":"2024-09-12T17:39:32.319736+0000","last_undegraded":"2024-09-12T17:39:32.319736+0000","last_fullsized":"2024-09-12T17:39:32.319736+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:07:40.561312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":51,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:42.342324+0000","last_change":"2024-09-12T17:27:17.423169+0000","last_active":"2024-09-12T17:37:42.342324+0000","last_peered":"2024-09-12T17:37:42.342324+0000","last_clean":"2024-09-12T17:37:42.342324+0000","last_became_active":"2024-09-12T17:27:17.421504+0000","last_became_peered":"2024-09-12T17:27:17.421504+0000","last_unstale":"2024-09-12T17:37:42.342324+0000","last_undegraded":"2024-09-12T17:37:42.342324+0000","last_fullsized":"2024-09-12T17:37:42.342324+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:59.982039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"265'2","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:41.303042+0000","last_change":"2024-09-12T17:15:43.163468+0000","last_active":"2024-09-12T17:38:41.303042+0000","last_peered":"2024-09-12T17:38:41.303042+0000","last_clean":"2024-09-12T17:38:41.303042+0000","last_became_active":"2024-09-12T17:15:43.162406+0000","last_became_peered":"2024-09-12T17:15:43.162406+0000","last_unstale":"2024-09-12T17:38:41.303042+0000","last_undegraded":"2024-09-12T17:38:41.303042+0000","last_fullsized":"2024-09-12T17:38:41.303042+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:52.019907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"265'11","reported_seq":60,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.733819+0000","last_change":"2024-09-12T17:15:40.116483+0000","last_active":"2024-09-12T17:41:32.733819+0000","last_peered":"2024-09-12T17:41:32.733819+0000","last_clean":"2024-09-12T17:41:32.733819+0000","last_became_active":"2024-09-12T17:15:40.115746+0000","last_became_peered":"2024-09-12T17:15:40.115746+0000","last_unstale":"2024-09-12T17:41:32.733819+0000","last_undegraded":"2024-09-12T17:41:32.733819+0000","last_fullsized":"2024-09-12T17:41:32.733819+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:04.139173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12288,"num_write":16,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"265'17","reported_seq":96,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:31.674540+0000","last_change":"2024-09-12T17:13:54.838973+0000","last_active":"2024-09-12T17:39:31.674540+0000","last_peered":"2024-09-12T17:39:31.674540+0000","last_clean":"2024-09-12T17:39:31.674540+0000","last_became_active":"2024-09-12T17:13:54.838008+0000","last_became_peered":"2024-09-12T17:13:54.838008+0000","last_unstale":"2024-09-12T17:39:31.674540+0000","last_undegraded":"2024-09-12T17:39:31.674540+0000","last_fullsized":"2024-09-12T17:39:31.674540+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:41.998918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":61,"num_write":32,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:51.299103+0000","last_change":"2024-09-12T17:27:17.409064+0000","last_active":"2024-09-12T17:37:51.299103+0000","last_peered":"2024-09-12T17:37:51.299103+0000","last_clean":"2024-09-12T17:37:51.299103+0000","last_became_active":"2024-09-12T17:27:17.408296+0000","last_became_peered":"2024-09-12T17:27:17.408296+0000","last_unstale":"2024-09-12T17:37:51.299103+0000","last_undegraded":"2024-09-12T17:37:51.299103+0000","last_fullsized":"2024-09-12T17:37:51.299103+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:40.080273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"265'5","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:41.287411+0000","last_change":"2024-09-12T17:15:43.165243+0000","last_active":"2024-09-12T17:38:41.287411+0000","last_peered":"2024-09-12T17:38:41.287411+0000","last_clean":"2024-09-12T17:38:41.287411+0000","last_became_active":"2024-09-12T17:15:43.163824+0000","last_became_peered":"2024-09-12T17:15:43.163824+0000","last_unstale":"2024-09-12T17:38:41.287411+0000","last_undegraded":"2024-09-12T17:38:41.287411+0000","last_fullsized":"2024-09-12T17:38:41.287411+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:49.835850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":5122,"num_write":5,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:36.301685+0000","last_change":"2024-09-12T17:15:40.115586+0000","last_active":"2024-09-12T17:38:36.301685+0000","last_peered":"2024-09-12T17:38:36.301685+0000","last_clean":"2024-09-12T17:38:36.301685+0000","last_became_active":"2024-09-12T17:15:40.114860+0000","last_became_peered":"2024-09-12T17:15:40.114860+0000","last_unstale":"2024-09-12T17:38:36.301685+0000","last_undegraded":"2024-09-12T17:38:36.301685+0000","last_fullsized":"2024-09-12T17:38:36.301685+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:40:36.955089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"265'55","reported_seq":197,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:56.027098+0000","last_change":"2024-09-12T17:13:54.833779+0000","last_active":"2024-09-12T17:38:56.027098+0000","last_peered":"2024-09-12T17:38:56.027098+0000","last_clean":"2024-09-12T17:38:56.027098+0000","last_became_active":"2024-09-12T17:13:54.832949+0000","last_became_peered":"2024-09-12T17:13:54.832949+0000","last_unstale":"2024-09-12T17:38:56.027098+0000","last_undegraded":"2024-09-12T17:38:56.027098+0000","last_fullsized":"2024-09-12T17:38:56.027098+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:16.134614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":283,"num_read_kb":200,"num_write":95,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"265'313","reported_seq":1004,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:01.804770+0000","last_change":"2024-09-12T16:58:18.717372+0000","last_active":"2024-09-12T17:40:01.804770+0000","last_peered":"2024-09-12T17:40:01.804770+0000","last_clean":"2024-09-12T17:40:01.804770+0000","last_became_active":"2024-09-12T16:58:18.713754+0000","last_became_peered":"2024-09-12T16:58:18.713754+0000","last_unstale":"2024-09-12T17:40:01.804770+0000","last_undegraded":"2024-09-12T17:40:01.804770+0000","last_fullsized":"2024-09-12T17:40:01.804770+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:28.092364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14978175,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":556,"num_read_kb":52178,"num_write":1174,"num_write_kb":52679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"265'127","reported_seq":726,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:04.402662+0000","last_change":"2024-09-12T16:58:21.709064+0000","last_active":"2024-09-12T17:40:04.402662+0000","last_peered":"2024-09-12T17:40:04.402662+0000","last_clean":"2024-09-12T17:40:04.402662+0000","last_became_active":"2024-09-12T16:58:21.708409+0000","last_became_peered":"2024-09-12T16:58:21.708409+0000","last_unstale":"2024-09-12T17:40:04.402662+0000","last_undegraded":"2024-09-12T17:40:04.402662+0000","last_fullsized":"2024-09-12T17:40:04.402662+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:23.027142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":568,"num_read_kb":472,"num_write":186,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"265'358","reported_seq":983,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.309772+0000","last_change":"2024-09-12T16:58:18.700441+0000","last_active":"2024-09-12T17:41:33.309772+0000","last_peered":"2024-09-12T17:41:33.309772+0000","last_clean":"2024-09-12T17:41:33.309772+0000","last_became_active":"2024-09-12T16:58:18.699994+0000","last_became_peered":"2024-09-12T16:58:18.699994+0000","last_unstale":"2024-09-12T17:41:33.309772+0000","last_undegraded":"2024-09-12T17:41:33.309772+0000","last_fullsized":"2024-09-12T17:41:33.309772+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:51.655272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263228,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":513,"num_read_kb":14780,"num_write":1119,"num_write_kb":32109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"265'61","reported_seq":640,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:48.739807+0000","last_change":"2024-09-12T16:58:21.722398+0000","last_active":"2024-09-12T17:39:48.739807+0000","last_peered":"2024-09-12T17:39:48.739807+0000","last_clean":"2024-09-12T17:39:48.739807+0000","last_became_active":"2024-09-12T16:58:21.721536+0000","last_became_peered":"2024-09-12T16:58:21.721536+0000","last_unstale":"2024-09-12T17:39:48.739807+0000","last_undegraded":"2024-09-12T17:39:48.739807+0000","last_fullsized":"2024-09-12T17:39:48.739807+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:56:41.263387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":297,"num_read_kb":264,"num_write":81,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"265'374","reported_seq":1181,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.358568+0000","last_change":"2024-09-12T16:58:18.688221+0000","last_active":"2024-09-12T17:41:32.358568+0000","last_peered":"2024-09-12T17:41:32.358568+0000","last_clean":"2024-09-12T17:41:32.358568+0000","last_became_active":"2024-09-12T16:58:18.687865+0000","last_became_peered":"2024-09-12T16:58:18.687865+0000","last_unstale":"2024-09-12T17:41:32.358568+0000","last_undegraded":"2024-09-12T17:41:32.358568+0000","last_fullsized":"2024-09-12T17:41:32.358568+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:22:44.289065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11074412,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1020,"num_read_kb":27565,"num_write":1513,"num_write_kb":41677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"265'166","reported_seq":760,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:33.434442+0000","last_change":"2024-09-12T16:58:21.704684+0000","last_active":"2024-09-12T17:38:33.434442+0000","last_peered":"2024-09-12T17:38:33.434442+0000","last_clean":"2024-09-12T17:38:33.434442+0000","last_became_active":"2024-09-12T16:58:21.703861+0000","last_became_peered":"2024-09-12T16:58:21.703861+0000","last_unstale":"2024-09-12T17:38:33.434442+0000","last_undegraded":"2024-09-12T17:38:33.434442+0000","last_fullsized":"2024-09-12T17:38:33.434442+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:16.015246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":693,"num_read_kb":563,"num_write":272,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"265'314","reported_seq":967,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.321427+0000","last_change":"2024-09-12T16:58:18.717382+0000","last_active":"2024-09-12T17:41:32.321427+0000","last_peered":"2024-09-12T17:41:32.321427+0000","last_clean":"2024-09-12T17:41:32.321427+0000","last_became_active":"2024-09-12T16:58:18.716783+0000","last_became_peered":"2024-09-12T16:58:18.716783+0000","last_unstale":"2024-09-12T17:41:32.321427+0000","last_undegraded":"2024-09-12T17:41:32.321427+0000","last_fullsized":"2024-09-12T17:41:32.321427+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:09:30.963463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7238482,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":489,"num_read_kb":33905,"num_write":1152,"num_write_kb":31442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"265'206","reported_seq":808,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:23.453730+0000","last_change":"2024-09-12T16:58:21.700629+0000","last_active":"2024-09-12T17:39:23.453730+0000","last_peered":"2024-09-12T17:39:23.453730+0000","last_clean":"2024-09-12T17:39:23.453730+0000","last_became_active":"2024-09-12T16:58:21.699869+0000","last_became_peered":"2024-09-12T16:58:21.699869+0000","last_unstale":"2024-09-12T17:39:23.453730+0000","last_undegraded":"2024-09-12T17:39:23.453730+0000","last_fullsized":"2024-09-12T17:39:23.453730+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:31:52.012945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":874,"num_read_kb":727,"num_write":307,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"265'291","reported_seq":955,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:32.483128+0000","last_change":"2024-09-12T16:58:18.689386+0000","last_active":"2024-09-12T17:39:32.483128+0000","last_peered":"2024-09-12T17:39:32.483128+0000","last_clean":"2024-09-12T17:39:32.483128+0000","last_became_active":"2024-09-12T16:58:18.688345+0000","last_became_peered":"2024-09-12T16:58:18.688345+0000","last_unstale":"2024-09-12T17:39:32.483128+0000","last_undegraded":"2024-09-12T17:39:32.483128+0000","last_fullsized":"2024-09-12T17:39:32.483128+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:07.865303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7953469,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":524,"num_read_kb":27999,"num_write":1068,"num_write_kb":20285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"265'277","reported_seq":920,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:59.523406+0000","last_change":"2024-09-12T16:58:21.710632+0000","last_active":"2024-09-12T17:38:59.523406+0000","last_peered":"2024-09-12T17:38:59.523406+0000","last_clean":"2024-09-12T17:38:59.523406+0000","last_became_active":"2024-09-12T16:58:21.709879+0000","last_became_peered":"2024-09-12T16:58:21.709879+0000","last_unstale":"2024-09-12T17:38:59.523406+0000","last_undegraded":"2024-09-12T17:38:59.523406+0000","last_fullsized":"2024-09-12T17:38:59.523406+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:10.455020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1330,"num_read_kb":1122,"num_write":481,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"265'346","reported_seq":995,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.332327+0000","last_change":"2024-09-12T16:58:18.699099+0000","last_active":"2024-09-12T17:41:32.332327+0000","last_peered":"2024-09-12T17:41:32.332327+0000","last_clean":"2024-09-12T17:41:32.332327+0000","last_became_active":"2024-09-12T16:58:18.698280+0000","last_became_peered":"2024-09-12T16:58:18.698280+0000","last_unstale":"2024-09-12T17:41:32.332327+0000","last_undegraded":"2024-09-12T17:41:32.332327+0000","last_fullsized":"2024-09-12T17:41:32.332327+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:21:53.931060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17388240,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":554,"num_read_kb":25091,"num_write":1250,"num_write_kb":36260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"265'157","reported_seq":760,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:25.144333+0000","last_change":"2024-09-12T16:58:21.710011+0000","last_active":"2024-09-12T17:38:25.144333+0000","last_peered":"2024-09-12T17:38:25.144333+0000","last_clean":"2024-09-12T17:38:25.144333+0000","last_became_active":"2024-09-12T16:58:21.706493+0000","last_became_peered":"2024-09-12T16:58:21.706493+0000","last_unstale":"2024-09-12T17:38:25.144333+0000","last_undegraded":"2024-09-12T17:38:25.144333+0000","last_fullsized":"2024-09-12T17:38:25.144333+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:28.236536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":697,"num_read_kb":578,"num_write":245,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"265'272","reported_seq":930,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:57.873465+0000","last_change":"2024-09-12T16:58:18.695130+0000","last_active":"2024-09-12T17:38:57.873465+0000","last_peered":"2024-09-12T17:38:57.873465+0000","last_clean":"2024-09-12T17:38:57.873465+0000","last_became_active":"2024-09-12T16:58:18.694357+0000","last_became_peered":"2024-09-12T16:58:18.694357+0000","last_unstale":"2024-09-12T17:38:57.873465+0000","last_undegraded":"2024-09-12T17:38:57.873465+0000","last_fullsized":"2024-09-12T17:38:57.873465+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:09.763291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15005396,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":427,"num_read_kb":76106,"num_write":1010,"num_write_kb":48403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"265'76","reported_seq":653,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:57.331489+0000","last_change":"2024-09-12T16:58:21.723849+0000","last_active":"2024-09-12T17:37:57.331489+0000","last_peered":"2024-09-12T17:37:57.331489+0000","last_clean":"2024-09-12T17:37:57.331489+0000","last_became_active":"2024-09-12T16:58:21.723077+0000","last_became_peered":"2024-09-12T16:58:21.723077+0000","last_unstale":"2024-09-12T17:37:57.331489+0000","last_undegraded":"2024-09-12T17:37:57.331489+0000","last_fullsized":"2024-09-12T17:37:57.331489+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:24.692985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":363,"num_read_kb":315,"num_write":111,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"265'256","reported_seq":865,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.383295+0000","last_change":"2024-09-12T16:58:18.702345+0000","last_active":"2024-09-12T17:41:32.383295+0000","last_peered":"2024-09-12T17:41:32.383295+0000","last_clean":"2024-09-12T17:41:32.383295+0000","last_became_active":"2024-09-12T16:58:18.701590+0000","last_became_peered":"2024-09-12T16:58:18.701590+0000","last_unstale":"2024-09-12T17:41:32.383295+0000","last_undegraded":"2024-09-12T17:41:32.383295+0000","last_fullsized":"2024-09-12T17:41:32.383295+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:06.256813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5286722,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":350,"num_read_kb":1373,"num_write":875,"num_write_kb":18073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"265'138","reported_seq":739,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:36.361716+0000","last_change":"2024-09-12T16:58:21.725837+0000","last_active":"2024-09-12T17:39:36.361716+0000","last_peered":"2024-09-12T17:39:36.361716+0000","last_clean":"2024-09-12T17:39:36.361716+0000","last_became_active":"2024-09-12T16:58:21.718167+0000","last_became_peered":"2024-09-12T16:58:21.718167+0000","last_unstale":"2024-09-12T17:39:36.361716+0000","last_undegraded":"2024-09-12T17:39:36.361716+0000","last_fullsized":"2024-09-12T17:39:36.361716+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:29.353963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":612,"num_read_kb":510,"num_write":201,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"265'4234","reported_seq":4884,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:42.781502+0000","last_change":"2024-09-12T16:58:21.698194+0000","last_active":"2024-09-12T17:39:42.781502+0000","last_peered":"2024-09-12T17:39:42.781502+0000","last_clean":"2024-09-12T17:39:42.781502+0000","last_became_active":"2024-09-12T16:58:21.697479+0000","last_became_peered":"2024-09-12T16:58:21.697479+0000","last_unstale":"2024-09-12T17:39:42.781502+0000","last_undegraded":"2024-09-12T17:39:42.781502+0000","last_fullsized":"2024-09-12T17:39:42.781502+0000","mapping_epoch":26,"log_start":"265'4200","ondisk_log_start":"265'4200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":3000,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:12:15.711479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17044,"num_read_kb":14289,"num_write":6359,"num_write_kb":3183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"265'252","reported_seq":876,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:40.903484+0000","last_change":"2024-09-12T16:58:18.714631+0000","last_active":"2024-09-12T17:39:40.903484+0000","last_peered":"2024-09-12T17:39:40.903484+0000","last_clean":"2024-09-12T17:39:40.903484+0000","last_became_active":"2024-09-12T16:58:18.713739+0000","last_became_peered":"2024-09-12T16:58:18.713739+0000","last_unstale":"2024-09-12T17:39:40.903484+0000","last_undegraded":"2024-09-12T17:39:40.903484+0000","last_fullsized":"2024-09-12T17:39:40.903484+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:29.786536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14027714,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":371,"num_read_kb":10222,"num_write":899,"num_write_kb":31220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"265'294","reported_seq":1006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:48.145728+0000","last_change":"2024-09-12T16:58:21.724340+0000","last_active":"2024-09-12T17:39:48.145728+0000","last_peered":"2024-09-12T17:39:48.145728+0000","last_clean":"2024-09-12T17:39:48.145728+0000","last_became_active":"2024-09-12T16:58:21.723238+0000","last_became_peered":"2024-09-12T16:58:21.723238+0000","last_unstale":"2024-09-12T17:39:48.145728+0000","last_undegraded":"2024-09-12T17:39:48.145728+0000","last_fullsized":"2024-09-12T17:39:48.145728+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:26.233677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1552,"num_read_kb":1372,"num_write":472,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"265'268","reported_seq":880,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:47.702960+0000","last_change":"2024-09-12T16:58:18.702745+0000","last_active":"2024-09-12T17:38:47.702960+0000","last_peered":"2024-09-12T17:38:47.702960+0000","last_clean":"2024-09-12T17:38:47.702960+0000","last_became_active":"2024-09-12T16:58:18.701989+0000","last_became_peered":"2024-09-12T16:58:18.701989+0000","last_unstale":"2024-09-12T17:38:47.702960+0000","last_undegraded":"2024-09-12T17:38:47.702960+0000","last_fullsized":"2024-09-12T17:38:47.702960+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:43:11.774703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3469327,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":370,"num_read_kb":5557,"num_write":955,"num_write_kb":22464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"265'183","reported_seq":791,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:12.334752+0000","last_change":"2024-09-12T16:58:21.716125+0000","last_active":"2024-09-12T17:38:12.334752+0000","last_peered":"2024-09-12T17:38:12.334752+0000","last_clean":"2024-09-12T17:38:12.334752+0000","last_became_active":"2024-09-12T16:58:21.715289+0000","last_became_peered":"2024-09-12T16:58:21.715289+0000","last_unstale":"2024-09-12T17:38:12.334752+0000","last_undegraded":"2024-09-12T17:38:12.334752+0000","last_fullsized":"2024-09-12T17:38:12.334752+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:51.702306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":782,"num_read_kb":649,"num_write":263,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"265'309","reported_seq":982,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:47.106484+0000","last_change":"2024-09-12T16:58:18.703102+0000","last_active":"2024-09-12T17:39:47.106484+0000","last_peered":"2024-09-12T17:39:47.106484+0000","last_clean":"2024-09-12T17:39:47.106484+0000","last_became_active":"2024-09-12T16:58:18.702185+0000","last_became_peered":"2024-09-12T16:58:18.702185+0000","last_unstale":"2024-09-12T17:39:47.106484+0000","last_undegraded":"2024-09-12T17:39:47.106484+0000","last_fullsized":"2024-09-12T17:39:47.106484+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:26.576879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":654678,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":530,"num_read_kb":49217,"num_write":1151,"num_write_kb":37016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"265'189","reported_seq":821,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:50.846518+0000","last_change":"2024-09-12T16:58:21.725319+0000","last_active":"2024-09-12T17:38:50.846518+0000","last_peered":"2024-09-12T17:38:50.846518+0000","last_clean":"2024-09-12T17:38:50.846518+0000","last_became_active":"2024-09-12T16:58:21.718158+0000","last_became_peered":"2024-09-12T16:58:21.718158+0000","last_unstale":"2024-09-12T17:38:50.846518+0000","last_undegraded":"2024-09-12T17:38:50.846518+0000","last_fullsized":"2024-09-12T17:38:50.846518+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:25.653319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":878,"num_read_kb":727,"num_write":304,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"265'282","reported_seq":1019,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:46.135403+0000","last_change":"2024-09-12T16:58:18.702967+0000","last_active":"2024-09-12T17:39:46.135403+0000","last_peered":"2024-09-12T17:39:46.135403+0000","last_clean":"2024-09-12T17:39:46.135403+0000","last_became_active":"2024-09-12T16:58:18.699360+0000","last_became_peered":"2024-09-12T16:58:18.699360+0000","last_unstale":"2024-09-12T17:39:46.135403+0000","last_undegraded":"2024-09-12T17:39:46.135403+0000","last_fullsized":"2024-09-12T17:39:46.135403+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:23.551727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10819431,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":555,"num_read_kb":143202,"num_write":992,"num_write_kb":36082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"265'136","reported_seq":765,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:49.202472+0000","last_change":"2024-09-12T16:58:21.728829+0000","last_active":"2024-09-12T17:39:49.202472+0000","last_peered":"2024-09-12T17:39:49.202472+0000","last_clean":"2024-09-12T17:39:49.202472+0000","last_became_active":"2024-09-12T16:58:21.728321+0000","last_became_peered":"2024-09-12T16:58:21.728321+0000","last_unstale":"2024-09-12T17:39:49.202472+0000","last_undegraded":"2024-09-12T17:39:49.202472+0000","last_fullsized":"2024-09-12T17:39:49.202472+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:15.718429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":636,"num_read_kb":537,"num_write":197,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"265'260","reported_seq":872,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.372557+0000","last_change":"2024-09-12T16:58:18.691138+0000","last_active":"2024-09-12T17:41:32.372557+0000","last_peered":"2024-09-12T17:41:32.372557+0000","last_clean":"2024-09-12T17:41:32.372557+0000","last_became_active":"2024-09-12T16:58:18.690634+0000","last_became_peered":"2024-09-12T16:58:18.690634+0000","last_unstale":"2024-09-12T17:41:32.372557+0000","last_undegraded":"2024-09-12T17:41:32.372557+0000","last_fullsized":"2024-09-12T17:41:32.372557+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:16.345304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15090613,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":337,"num_read_kb":27088,"num_write":892,"num_write_kb":25947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"265'299","reported_seq":897,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:01.264914+0000","last_change":"2024-09-12T16:58:21.705137+0000","last_active":"2024-09-12T17:37:01.264914+0000","last_peered":"2024-09-12T17:37:01.264914+0000","last_clean":"2024-09-12T17:37:01.264914+0000","last_became_active":"2024-09-12T16:58:21.702643+0000","last_became_peered":"2024-09-12T16:58:21.702643+0000","last_unstale":"2024-09-12T17:37:01.264914+0000","last_undegraded":"2024-09-12T17:37:01.264914+0000","last_fullsized":"2024-09-12T17:37:01.264914+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:27.298302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1307,"num_read_kb":1045,"num_write":505,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"265'287","reported_seq":1039,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.335074+0000","last_change":"2024-09-12T16:58:18.703569+0000","last_active":"2024-09-12T17:41:32.335074+0000","last_peered":"2024-09-12T17:41:32.335074+0000","last_clean":"2024-09-12T17:41:32.335074+0000","last_became_active":"2024-09-12T16:58:18.702310+0000","last_became_peered":"2024-09-12T16:58:18.702310+0000","last_unstale":"2024-09-12T17:41:32.335074+0000","last_undegraded":"2024-09-12T17:41:32.335074+0000","last_fullsized":"2024-09-12T17:41:32.335074+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:28.757489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5217971,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":529,"num_read_kb":31841,"num_write":1007,"num_write_kb":30837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"265'153","reported_seq":661,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:05.039986+0000","last_change":"2024-09-12T16:58:29.792625+0000","last_active":"2024-09-12T17:40:05.039986+0000","last_peered":"2024-09-12T17:40:05.039986+0000","last_clean":"2024-09-12T17:40:05.039986+0000","last_became_active":"2024-09-12T16:58:29.792043+0000","last_became_peered":"2024-09-12T16:58:29.792043+0000","last_unstale":"2024-09-12T17:40:05.039986+0000","last_undegraded":"2024-09-12T17:40:05.039986+0000","last_fullsized":"2024-09-12T17:40:05.039986+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:46.501133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":230,"num_read_kb":220,"num_write":374,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"265'102","reported_seq":686,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:24.677630+0000","last_change":"2024-09-12T16:58:21.707802+0000","last_active":"2024-09-12T17:39:24.677630+0000","last_peered":"2024-09-12T17:39:24.677630+0000","last_clean":"2024-09-12T17:39:24.677630+0000","last_became_active":"2024-09-12T16:58:21.707428+0000","last_became_peered":"2024-09-12T16:58:21.707428+0000","last_unstale":"2024-09-12T17:39:24.677630+0000","last_undegraded":"2024-09-12T17:39:24.677630+0000","last_fullsized":"2024-09-12T17:39:24.677630+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:42.024002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":440,"num_read_kb":374,"num_write":161,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"265'313","reported_seq":966,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:19.144021+0000","last_change":"2024-09-12T16:58:18.716412+0000","last_active":"2024-09-12T17:41:19.144021+0000","last_peered":"2024-09-12T17:41:19.144021+0000","last_clean":"2024-09-12T17:41:19.144021+0000","last_became_active":"2024-09-12T16:58:18.714782+0000","last_became_peered":"2024-09-12T16:58:18.714782+0000","last_unstale":"2024-09-12T17:41:19.144021+0000","last_undegraded":"2024-09-12T17:41:19.144021+0000","last_fullsized":"2024-09-12T17:41:19.144021+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:30.616876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15141195,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":493,"num_read_kb":18943,"num_write":1164,"num_write_kb":58984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:07.320348+0000","last_change":"2024-09-12T16:58:23.713332+0000","last_active":"2024-09-12T17:37:07.320348+0000","last_peered":"2024-09-12T17:37:07.320348+0000","last_clean":"2024-09-12T17:37:07.320348+0000","last_became_active":"2024-09-12T16:58:23.712621+0000","last_became_peered":"2024-09-12T16:58:23.712621+0000","last_unstale":"2024-09-12T17:37:07.320348+0000","last_undegraded":"2024-09-12T17:37:07.320348+0000","last_fullsized":"2024-09-12T17:37:07.320348+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:58:32.081784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"265'334","reported_seq":927,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:24.864562+0000","last_change":"2024-09-12T16:58:25.730728+0000","last_active":"2024-09-12T17:41:24.864562+0000","last_peered":"2024-09-12T17:41:24.864562+0000","last_clean":"2024-09-12T17:41:24.864562+0000","last_became_active":"2024-09-12T16:58:25.728901+0000","last_became_peered":"2024-09-12T16:58:25.728901+0000","last_unstale":"2024-09-12T17:41:24.864562+0000","last_undegraded":"2024-09-12T17:41:24.864562+0000","last_fullsized":"2024-09-12T17:41:24.864562+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:04.800787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57249,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":536,"num_read_kb":1031,"num_write":432,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:11.289497+0000","last_change":"2024-09-12T16:58:27.753040+0000","last_active":"2024-09-12T17:37:11.289497+0000","last_peered":"2024-09-12T17:37:11.289497+0000","last_clean":"2024-09-12T17:37:11.289497+0000","last_became_active":"2024-09-12T16:58:27.752315+0000","last_became_peered":"2024-09-12T16:58:27.752315+0000","last_unstale":"2024-09-12T17:37:11.289497+0000","last_undegraded":"2024-09-12T17:37:11.289497+0000","last_fullsized":"2024-09-12T17:37:11.289497+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:39.272577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"265'126","reported_seq":675,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:03.062821+0000","last_change":"2024-09-12T16:58:29.774689+0000","last_active":"2024-09-12T17:40:03.062821+0000","last_peered":"2024-09-12T17:40:03.062821+0000","last_clean":"2024-09-12T17:40:03.062821+0000","last_became_active":"2024-09-12T16:58:29.773874+0000","last_became_peered":"2024-09-12T16:58:29.773874+0000","last_unstale":"2024-09-12T17:40:03.062821+0000","last_undegraded":"2024-09-12T17:40:03.062821+0000","last_fullsized":"2024-09-12T17:40:03.062821+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:24.286576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":191,"num_read_kb":190,"num_write":216,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"265'400","reported_seq":1050,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:42.832514+0000","last_change":"2024-09-12T16:58:21.719455+0000","last_active":"2024-09-12T17:38:42.832514+0000","last_peered":"2024-09-12T17:38:42.832514+0000","last_clean":"2024-09-12T17:38:42.832514+0000","last_became_active":"2024-09-12T16:58:21.717806+0000","last_became_peered":"2024-09-12T16:58:21.717806+0000","last_unstale":"2024-09-12T17:38:42.832514+0000","last_undegraded":"2024-09-12T17:38:42.832514+0000","last_fullsized":"2024-09-12T17:38:42.832514+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:24.079041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1815,"num_read_kb":1449,"num_write":653,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"265'304","reported_seq":990,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.360124+0000","last_change":"2024-09-12T16:58:18.692396+0000","last_active":"2024-09-12T17:41:32.360124+0000","last_peered":"2024-09-12T17:41:32.360124+0000","last_clean":"2024-09-12T17:41:32.360124+0000","last_became_active":"2024-09-12T16:58:18.691335+0000","last_became_peered":"2024-09-12T16:58:18.691335+0000","last_unstale":"2024-09-12T17:41:32.360124+0000","last_undegraded":"2024-09-12T17:41:32.360124+0000","last_fullsized":"2024-09-12T17:41:32.360124+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:42:36.520626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13189614,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":504,"num_read_kb":106559,"num_write":1057,"num_write_kb":67871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:17.354558+0000","last_change":"2024-09-12T16:58:23.719306+0000","last_active":"2024-09-12T17:38:17.354558+0000","last_peered":"2024-09-12T17:38:17.354558+0000","last_clean":"2024-09-12T17:38:17.354558+0000","last_became_active":"2024-09-12T16:58:23.718656+0000","last_became_peered":"2024-09-12T16:58:23.718656+0000","last_unstale":"2024-09-12T17:38:17.354558+0000","last_undegraded":"2024-09-12T17:38:17.354558+0000","last_fullsized":"2024-09-12T17:38:17.354558+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:05:10.035449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"265'99","reported_seq":621,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:22.810700+0000","last_change":"2024-09-12T16:58:25.714387+0000","last_active":"2024-09-12T17:39:22.810700+0000","last_peered":"2024-09-12T17:39:22.810700+0000","last_clean":"2024-09-12T17:39:22.810700+0000","last_became_active":"2024-09-12T16:58:25.713567+0000","last_became_peered":"2024-09-12T16:58:25.713567+0000","last_unstale":"2024-09-12T17:39:22.810700+0000","last_undegraded":"2024-09-12T17:39:22.810700+0000","last_fullsized":"2024-09-12T17:39:22.810700+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:13.593060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":95,"num_read_kb":90,"num_write":66,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:11.267295+0000","last_change":"2024-09-12T16:58:27.729072+0000","last_active":"2024-09-12T17:37:11.267295+0000","last_peered":"2024-09-12T17:37:11.267295+0000","last_clean":"2024-09-12T17:37:11.267295+0000","last_became_active":"2024-09-12T16:58:27.728276+0000","last_became_peered":"2024-09-12T16:58:27.728276+0000","last_unstale":"2024-09-12T17:37:11.267295+0000","last_undegraded":"2024-09-12T17:37:11.267295+0000","last_fullsized":"2024-09-12T17:37:11.267295+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:19.029657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"265'125","reported_seq":630,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:04.398546+0000","last_change":"2024-09-12T16:58:29.781407+0000","last_active":"2024-09-12T17:40:04.398546+0000","last_peered":"2024-09-12T17:40:04.398546+0000","last_clean":"2024-09-12T17:40:04.398546+0000","last_became_active":"2024-09-12T16:58:29.780598+0000","last_became_peered":"2024-09-12T16:58:29.780598+0000","last_unstale":"2024-09-12T17:40:04.398546+0000","last_undegraded":"2024-09-12T17:40:04.398546+0000","last_fullsized":"2024-09-12T17:40:04.398546+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:18.860850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":203,"num_read_kb":191,"num_write":301,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"265'80","reported_seq":642,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:41.116398+0000","last_change":"2024-09-12T16:58:21.719225+0000","last_active":"2024-09-12T17:39:41.116398+0000","last_peered":"2024-09-12T17:39:41.116398+0000","last_clean":"2024-09-12T17:39:41.116398+0000","last_became_active":"2024-09-12T16:58:21.718773+0000","last_became_peered":"2024-09-12T16:58:21.718773+0000","last_unstale":"2024-09-12T17:39:41.116398+0000","last_undegraded":"2024-09-12T17:39:41.116398+0000","last_fullsized":"2024-09-12T17:39:41.116398+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:06.541968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":373,"num_read_kb":312,"num_write":123,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"265'259","reported_seq":850,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:42.997703+0000","last_change":"2024-09-12T16:58:55.845287+0000","last_active":"2024-09-12T17:38:42.997703+0000","last_peered":"2024-09-12T17:38:42.997703+0000","last_clean":"2024-09-12T17:38:42.997703+0000","last_became_active":"2024-09-12T16:58:55.843826+0000","last_became_peered":"2024-09-12T16:58:55.843826+0000","last_unstale":"2024-09-12T17:38:42.997703+0000","last_undegraded":"2024-09-12T17:38:42.997703+0000","last_fullsized":"2024-09-12T17:38:42.997703+0000","mapping_epoch":37,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:56.799291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1670299,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":355,"num_read_kb":4809,"num_write":916,"num_write_kb":23718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:07.338234+0000","last_change":"2024-09-12T16:58:23.707417+0000","last_active":"2024-09-12T17:37:07.338234+0000","last_peered":"2024-09-12T17:37:07.338234+0000","last_clean":"2024-09-12T17:37:07.338234+0000","last_became_active":"2024-09-12T16:58:23.706953+0000","last_became_peered":"2024-09-12T16:58:23.706953+0000","last_unstale":"2024-09-12T17:37:07.338234+0000","last_undegraded":"2024-09-12T17:37:07.338234+0000","last_fullsized":"2024-09-12T17:37:07.338234+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:53.755342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"265'105","reported_seq":638,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:11.702449+0000","last_change":"2024-09-12T16:58:25.714085+0000","last_active":"2024-09-12T17:39:11.702449+0000","last_peered":"2024-09-12T17:39:11.702449+0000","last_clean":"2024-09-12T17:39:11.702449+0000","last_became_active":"2024-09-12T16:58:25.713213+0000","last_became_peered":"2024-09-12T16:58:25.713213+0000","last_unstale":"2024-09-12T17:39:11.702449+0000","last_undegraded":"2024-09-12T17:39:11.702449+0000","last_fullsized":"2024-09-12T17:39:11.702449+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:25.447055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":116,"num_write":82,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"265'765","reported_seq":4617,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:25.115189+0000","last_change":"2024-09-12T16:58:27.753546+0000","last_active":"2024-09-12T17:41:25.115189+0000","last_peered":"2024-09-12T17:41:25.115189+0000","last_clean":"2024-09-12T17:41:25.115189+0000","last_became_active":"2024-09-12T16:58:27.752801+0000","last_became_peered":"2024-09-12T16:58:27.752801+0000","last_unstale":"2024-09-12T17:41:25.115189+0000","last_undegraded":"2024-09-12T17:41:25.115189+0000","last_fullsized":"2024-09-12T17:41:25.115189+0000","mapping_epoch":32,"log_start":"265'702","ondisk_log_start":"265'702","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":702,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:03.558787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"265'204","reported_seq":1022,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:05.112599+0000","last_change":"2024-09-12T16:58:29.770179+0000","last_active":"2024-09-12T17:40:05.112599+0000","last_peered":"2024-09-12T17:40:05.112599+0000","last_clean":"2024-09-12T17:40:05.112599+0000","last_became_active":"2024-09-12T16:58:29.769351+0000","last_became_peered":"2024-09-12T16:58:29.769351+0000","last_unstale":"2024-09-12T17:40:05.112599+0000","last_undegraded":"2024-09-12T17:40:05.112599+0000","last_fullsized":"2024-09-12T17:40:05.112599+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:38.433650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":633,"num_read_kb":631,"num_write":454,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"265'164","reported_seq":753,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:34.507430+0000","last_change":"2024-09-12T16:58:21.711086+0000","last_active":"2024-09-12T17:39:34.507430+0000","last_peered":"2024-09-12T17:39:34.507430+0000","last_clean":"2024-09-12T17:39:34.507430+0000","last_became_active":"2024-09-12T16:58:21.710646+0000","last_became_peered":"2024-09-12T16:58:21.710646+0000","last_unstale":"2024-09-12T17:39:34.507430+0000","last_undegraded":"2024-09-12T17:39:34.507430+0000","last_fullsized":"2024-09-12T17:39:34.507430+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:34:16.873776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":698,"num_read_kb":573,"num_write":260,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"265'270","reported_seq":895,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:02.051145+0000","last_change":"2024-09-12T16:58:18.690508+0000","last_active":"2024-09-12T17:40:02.051145+0000","last_peered":"2024-09-12T17:40:02.051145+0000","last_clean":"2024-09-12T17:40:02.051145+0000","last_became_active":"2024-09-12T16:58:18.689915+0000","last_became_peered":"2024-09-12T16:58:18.689915+0000","last_unstale":"2024-09-12T17:40:02.051145+0000","last_undegraded":"2024-09-12T17:40:02.051145+0000","last_fullsized":"2024-09-12T17:40:02.051145+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:30.087379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14032561,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":367,"num_read_kb":42591,"num_write":1036,"num_write_kb":36991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:07.320434+0000","last_change":"2024-09-12T16:58:23.697918+0000","last_active":"2024-09-12T17:37:07.320434+0000","last_peered":"2024-09-12T17:37:07.320434+0000","last_clean":"2024-09-12T17:37:07.320434+0000","last_became_active":"2024-09-12T16:58:23.697159+0000","last_became_peered":"2024-09-12T16:58:23.697159+0000","last_unstale":"2024-09-12T17:37:07.320434+0000","last_undegraded":"2024-09-12T17:37:07.320434+0000","last_fullsized":"2024-09-12T17:37:07.320434+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:03.312839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"265'243","reported_seq":804,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:31.322745+0000","last_change":"2024-09-12T16:58:25.949946+0000","last_active":"2024-09-12T17:39:31.322745+0000","last_peered":"2024-09-12T17:39:31.322745+0000","last_clean":"2024-09-12T17:39:31.322745+0000","last_became_active":"2024-09-12T16:58:25.949179+0000","last_became_peered":"2024-09-12T16:58:25.949179+0000","last_unstale":"2024-09-12T17:39:31.322745+0000","last_undegraded":"2024-09-12T17:39:31.322745+0000","last_fullsized":"2024-09-12T17:39:31.322745+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:40.413824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52397,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":409,"num_read_kb":858,"num_write":334,"num_write_kb":274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"265'781","reported_seq":2095,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:31.895501+0000","last_change":"2024-09-12T16:58:27.746737+0000","last_active":"2024-09-12T17:41:31.895501+0000","last_peered":"2024-09-12T17:41:31.895501+0000","last_clean":"2024-09-12T17:41:31.895501+0000","last_became_active":"2024-09-12T16:58:27.745988+0000","last_became_peered":"2024-09-12T16:58:27.745988+0000","last_unstale":"2024-09-12T17:41:31.895501+0000","last_undegraded":"2024-09-12T17:41:31.895501+0000","last_fullsized":"2024-09-12T17:41:31.895501+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:10.802947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"265'150","reported_seq":720,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:22.323591+0000","last_change":"2024-09-12T16:58:21.710840+0000","last_active":"2024-09-12T17:37:22.323591+0000","last_peered":"2024-09-12T17:37:22.323591+0000","last_clean":"2024-09-12T17:37:22.323591+0000","last_became_active":"2024-09-12T16:58:21.710029+0000","last_became_peered":"2024-09-12T16:58:21.710029+0000","last_unstale":"2024-09-12T17:37:22.323591+0000","last_undegraded":"2024-09-12T17:37:22.323591+0000","last_fullsized":"2024-09-12T17:37:22.323591+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:16.606525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":614,"num_read_kb":496,"num_write":228,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"265'293","reported_seq":940,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:48.924397+0000","last_change":"2024-09-12T16:58:18.717733+0000","last_active":"2024-09-12T17:39:48.924397+0000","last_peered":"2024-09-12T17:39:48.924397+0000","last_clean":"2024-09-12T17:39:48.924397+0000","last_became_active":"2024-09-12T16:58:18.715448+0000","last_became_peered":"2024-09-12T16:58:18.715448+0000","last_unstale":"2024-09-12T17:39:48.924397+0000","last_undegraded":"2024-09-12T17:39:48.924397+0000","last_fullsized":"2024-09-12T17:39:48.924397+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:12.664073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9540151,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":477,"num_read_kb":11904,"num_write":1150,"num_write_kb":32051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:26.293032+0000","last_change":"2024-09-12T16:58:23.720919+0000","last_active":"2024-09-12T17:37:26.293032+0000","last_peered":"2024-09-12T17:37:26.293032+0000","last_clean":"2024-09-12T17:37:26.293032+0000","last_became_active":"2024-09-12T16:58:23.720096+0000","last_became_peered":"2024-09-12T16:58:23.720096+0000","last_unstale":"2024-09-12T17:37:26.293032+0000","last_undegraded":"2024-09-12T17:37:26.293032+0000","last_fullsized":"2024-09-12T17:37:26.293032+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:35.342690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"265'355","reported_seq":959,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:24.876537+0000","last_change":"2024-09-12T16:58:25.947522+0000","last_active":"2024-09-12T17:41:24.876537+0000","last_peered":"2024-09-12T17:41:24.876537+0000","last_clean":"2024-09-12T17:41:24.876537+0000","last_became_active":"2024-09-12T16:58:25.946765+0000","last_became_peered":"2024-09-12T16:58:25.946765+0000","last_unstale":"2024-09-12T17:41:24.876537+0000","last_undegraded":"2024-09-12T17:41:24.876537+0000","last_fullsized":"2024-09-12T17:41:24.876537+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:15.651894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60390,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":570,"num_read_kb":1072,"num_write":458,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:53.705109+0000","last_change":"2024-09-12T16:58:27.754351+0000","last_active":"2024-09-12T17:38:53.705109+0000","last_peered":"2024-09-12T17:38:53.705109+0000","last_clean":"2024-09-12T17:38:53.705109+0000","last_became_active":"2024-09-12T16:58:27.753616+0000","last_became_peered":"2024-09-12T16:58:27.753616+0000","last_unstale":"2024-09-12T17:38:53.705109+0000","last_undegraded":"2024-09-12T17:38:53.705109+0000","last_fullsized":"2024-09-12T17:38:53.705109+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:26.306126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"265'550","reported_seq":1358,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:24.912198+0000","last_change":"2024-09-12T16:58:29.774852+0000","last_active":"2024-09-12T17:41:24.912198+0000","last_peered":"2024-09-12T17:41:24.912198+0000","last_clean":"2024-09-12T17:41:24.912198+0000","last_became_active":"2024-09-12T16:58:29.774093+0000","last_became_peered":"2024-09-12T16:58:29.774093+0000","last_unstale":"2024-09-12T17:41:24.912198+0000","last_undegraded":"2024-09-12T17:41:24.912198+0000","last_fullsized":"2024-09-12T17:41:24.912198+0000","mapping_epoch":34,"log_start":"265'500","ondisk_log_start":"265'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":500,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:00.606117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":455,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1305,"num_read_kb":1304,"num_write":1151,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"265'502","reported_seq":1254,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:45.251893+0000","last_change":"2024-09-12T16:58:21.700218+0000","last_active":"2024-09-12T17:39:45.251893+0000","last_peered":"2024-09-12T17:39:45.251893+0000","last_clean":"2024-09-12T17:39:45.251893+0000","last_became_active":"2024-09-12T16:58:21.699243+0000","last_became_peered":"2024-09-12T16:58:21.699243+0000","last_unstale":"2024-09-12T17:39:45.251893+0000","last_undegraded":"2024-09-12T17:39:45.251893+0000","last_fullsized":"2024-09-12T17:39:45.251893+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:06:32.179023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2329,"num_read_kb":1984,"num_write":852,"num_write_kb":550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"265'301","reported_seq":964,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:48.925978+0000","last_change":"2024-09-12T16:58:18.715397+0000","last_active":"2024-09-12T17:39:48.925978+0000","last_peered":"2024-09-12T17:39:48.925978+0000","last_clean":"2024-09-12T17:39:48.925978+0000","last_became_active":"2024-09-12T16:58:18.714412+0000","last_became_peered":"2024-09-12T16:58:18.714412+0000","last_unstale":"2024-09-12T17:39:48.925978+0000","last_undegraded":"2024-09-12T17:39:48.925978+0000","last_fullsized":"2024-09-12T17:39:48.925978+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:27.766473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8695797,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":447,"num_read_kb":85960,"num_write":1110,"num_write_kb":38984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:25.262997+0000","last_change":"2024-09-12T16:58:23.703982+0000","last_active":"2024-09-12T17:37:25.262997+0000","last_peered":"2024-09-12T17:37:25.262997+0000","last_clean":"2024-09-12T17:37:25.262997+0000","last_became_active":"2024-09-12T16:58:23.703534+0000","last_became_peered":"2024-09-12T16:58:23.703534+0000","last_unstale":"2024-09-12T17:37:25.262997+0000","last_undegraded":"2024-09-12T17:37:25.262997+0000","last_fullsized":"2024-09-12T17:37:25.262997+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:58.941243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"265'275","reported_seq":841,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:24.814994+0000","last_change":"2024-09-12T16:58:25.732078+0000","last_active":"2024-09-12T17:41:24.814994+0000","last_peered":"2024-09-12T17:41:24.814994+0000","last_clean":"2024-09-12T17:41:24.814994+0000","last_became_active":"2024-09-12T16:58:25.730470+0000","last_became_peered":"2024-09-12T16:58:25.730470+0000","last_unstale":"2024-09-12T17:41:24.814994+0000","last_undegraded":"2024-09-12T17:41:24.814994+0000","last_fullsized":"2024-09-12T17:41:24.814994+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:12.290691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70696,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":467,"num_read_kb":1031,"num_write":392,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:37.344950+0000","last_change":"2024-09-12T16:58:27.749638+0000","last_active":"2024-09-12T17:37:37.344950+0000","last_peered":"2024-09-12T17:37:37.344950+0000","last_clean":"2024-09-12T17:37:37.344950+0000","last_became_active":"2024-09-12T16:58:27.748461+0000","last_became_peered":"2024-09-12T16:58:27.748461+0000","last_unstale":"2024-09-12T17:37:37.344950+0000","last_undegraded":"2024-09-12T17:37:37.344950+0000","last_fullsized":"2024-09-12T17:37:37.344950+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:12.377398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"265'2416","reported_seq":4248,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:13.859519+0000","last_change":"2024-09-12T16:58:29.771539+0000","last_active":"2024-09-12T17:41:13.859519+0000","last_peered":"2024-09-12T17:41:13.859519+0000","last_clean":"2024-09-12T17:41:13.859519+0000","last_became_active":"2024-09-12T16:58:29.768469+0000","last_became_peered":"2024-09-12T16:58:29.768469+0000","last_unstale":"2024-09-12T17:41:13.859519+0000","last_undegraded":"2024-09-12T17:41:13.859519+0000","last_fullsized":"2024-09-12T17:41:13.859519+0000","mapping_epoch":34,"log_start":"265'2400","ondisk_log_start":"265'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":2400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:15.157148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":849,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6073,"num_read_kb":6065,"num_write":4892,"num_write_kb":1798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"265'217","reported_seq":796,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:29.667612+0000","last_change":"2024-09-12T16:58:21.725294+0000","last_active":"2024-09-12T17:39:29.667612+0000","last_peered":"2024-09-12T17:39:29.667612+0000","last_clean":"2024-09-12T17:39:29.667612+0000","last_became_active":"2024-09-12T16:58:21.724552+0000","last_became_peered":"2024-09-12T16:58:21.724552+0000","last_unstale":"2024-09-12T17:39:29.667612+0000","last_undegraded":"2024-09-12T17:39:29.667612+0000","last_fullsized":"2024-09-12T17:39:29.667612+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:04.685886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":914,"num_read_kb":736,"num_write":337,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"265'401","reported_seq":1145,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:51.313166+0000","last_change":"2024-09-12T16:58:55.852901+0000","last_active":"2024-09-12T17:38:51.313166+0000","last_peered":"2024-09-12T17:38:51.313166+0000","last_clean":"2024-09-12T17:38:51.313166+0000","last_became_active":"2024-09-12T16:58:55.852305+0000","last_became_peered":"2024-09-12T16:58:55.852305+0000","last_unstale":"2024-09-12T17:38:51.313166+0000","last_undegraded":"2024-09-12T17:38:51.313166+0000","last_fullsized":"2024-09-12T17:38:51.313166+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:46.869138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079522,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":846,"num_read_kb":12354,"num_write":1424,"num_write_kb":33200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:55.282325+0000","last_change":"2024-09-12T16:58:23.713816+0000","last_active":"2024-09-12T17:38:55.282325+0000","last_peered":"2024-09-12T17:38:55.282325+0000","last_clean":"2024-09-12T17:38:55.282325+0000","last_became_active":"2024-09-12T16:58:23.713241+0000","last_became_peered":"2024-09-12T16:58:23.713241+0000","last_unstale":"2024-09-12T17:38:55.282325+0000","last_undegraded":"2024-09-12T17:38:55.282325+0000","last_fullsized":"2024-09-12T17:38:55.282325+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:48.740741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"265'314","reported_seq":892,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:04.406606+0000","last_change":"2024-09-12T16:58:25.733750+0000","last_active":"2024-09-12T17:40:04.406606+0000","last_peered":"2024-09-12T17:40:04.406606+0000","last_clean":"2024-09-12T17:40:04.406606+0000","last_became_active":"2024-09-12T16:58:25.732918+0000","last_became_peered":"2024-09-12T16:58:25.732918+0000","last_unstale":"2024-09-12T17:40:04.406606+0000","last_undegraded":"2024-09-12T17:40:04.406606+0000","last_fullsized":"2024-09-12T17:40:04.406606+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:42.495838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83498,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":501,"num_read_kb":1068,"num_write":414,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"265'756","reported_seq":2458,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:31.895739+0000","last_change":"2024-09-12T16:58:27.737407+0000","last_active":"2024-09-12T17:41:31.895739+0000","last_peered":"2024-09-12T17:41:31.895739+0000","last_clean":"2024-09-12T17:41:31.895739+0000","last_became_active":"2024-09-12T16:58:27.736160+0000","last_became_peered":"2024-09-12T16:58:27.736160+0000","last_unstale":"2024-09-12T17:41:31.895739+0000","last_undegraded":"2024-09-12T17:41:31.895739+0000","last_fullsized":"2024-09-12T17:41:31.895739+0000","mapping_epoch":32,"log_start":"265'701","ondisk_log_start":"265'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":701,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:07.364813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"265'167","reported_seq":655,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:23.671352+0000","last_change":"2024-09-12T16:58:29.786539+0000","last_active":"2024-09-12T17:41:23.671352+0000","last_peered":"2024-09-12T17:41:23.671352+0000","last_clean":"2024-09-12T17:41:23.671352+0000","last_became_active":"2024-09-12T16:58:29.785621+0000","last_became_peered":"2024-09-12T16:58:29.785621+0000","last_unstale":"2024-09-12T17:41:23.671352+0000","last_undegraded":"2024-09-12T17:41:23.671352+0000","last_fullsized":"2024-09-12T17:41:23.671352+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:08.331708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":406,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":130,"num_read_kb":128,"num_write":373,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"265'203","reported_seq":795,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:52.359574+0000","last_change":"2024-09-12T16:58:21.702147+0000","last_active":"2024-09-12T17:38:52.359574+0000","last_peered":"2024-09-12T17:38:52.359574+0000","last_clean":"2024-09-12T17:38:52.359574+0000","last_became_active":"2024-09-12T16:58:21.701704+0000","last_became_peered":"2024-09-12T16:58:21.701704+0000","last_unstale":"2024-09-12T17:38:52.359574+0000","last_undegraded":"2024-09-12T17:38:52.359574+0000","last_fullsized":"2024-09-12T17:38:52.359574+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:12.535631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":867,"num_read_kb":717,"num_write":300,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"265'274","reported_seq":904,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.324318+0000","last_change":"2024-09-12T16:58:18.715784+0000","last_active":"2024-09-12T17:41:32.324318+0000","last_peered":"2024-09-12T17:41:32.324318+0000","last_clean":"2024-09-12T17:41:32.324318+0000","last_became_active":"2024-09-12T16:58:18.715232+0000","last_became_peered":"2024-09-12T16:58:18.715232+0000","last_unstale":"2024-09-12T17:41:32.324318+0000","last_undegraded":"2024-09-12T17:41:32.324318+0000","last_fullsized":"2024-09-12T17:41:32.324318+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:14.558882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5919350,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":416,"num_read_kb":18626,"num_write":976,"num_write_kb":30032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:30.264112+0000","last_change":"2024-09-12T16:58:23.709304+0000","last_active":"2024-09-12T17:37:30.264112+0000","last_peered":"2024-09-12T17:37:30.264112+0000","last_clean":"2024-09-12T17:37:30.264112+0000","last_became_active":"2024-09-12T16:58:23.708641+0000","last_became_peered":"2024-09-12T16:58:23.708641+0000","last_unstale":"2024-09-12T17:37:30.264112+0000","last_undegraded":"2024-09-12T17:37:30.264112+0000","last_fullsized":"2024-09-12T17:37:30.264112+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:30.695754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"265'468","reported_seq":1090,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.129700+0000","last_change":"2024-09-12T16:58:25.729871+0000","last_active":"2024-09-12T17:41:32.129700+0000","last_peered":"2024-09-12T17:41:32.129700+0000","last_clean":"2024-09-12T17:41:32.129700+0000","last_became_active":"2024-09-12T16:58:25.729071+0000","last_became_peered":"2024-09-12T16:58:25.729071+0000","last_unstale":"2024-09-12T17:41:32.129700+0000","last_undegraded":"2024-09-12T17:41:32.129700+0000","last_fullsized":"2024-09-12T17:41:32.129700+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:44.050528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136512,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":804,"num_read_kb":1900,"num_write":664,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:30.264053+0000","last_change":"2024-09-12T16:58:27.734880+0000","last_active":"2024-09-12T17:37:30.264053+0000","last_peered":"2024-09-12T17:37:30.264053+0000","last_clean":"2024-09-12T17:37:30.264053+0000","last_became_active":"2024-09-12T16:58:27.734078+0000","last_became_peered":"2024-09-12T16:58:27.734078+0000","last_unstale":"2024-09-12T17:37:30.264053+0000","last_undegraded":"2024-09-12T17:37:30.264053+0000","last_fullsized":"2024-09-12T17:37:30.264053+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:51.965911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"265'88","reported_seq":588,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:25.836784+0000","last_change":"2024-09-12T16:58:29.795094+0000","last_active":"2024-09-12T17:39:25.836784+0000","last_peered":"2024-09-12T17:39:25.836784+0000","last_clean":"2024-09-12T17:39:25.836784+0000","last_became_active":"2024-09-12T16:58:29.794347+0000","last_became_peered":"2024-09-12T16:58:29.794347+0000","last_unstale":"2024-09-12T17:39:25.836784+0000","last_undegraded":"2024-09-12T17:39:25.836784+0000","last_fullsized":"2024-09-12T17:39:25.836784+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:31:39.752933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":704,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":193,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"265'212","reported_seq":801,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:41.644167+0000","last_change":"2024-09-12T16:58:21.707885+0000","last_active":"2024-09-12T17:39:41.644167+0000","last_peered":"2024-09-12T17:39:41.644167+0000","last_clean":"2024-09-12T17:39:41.644167+0000","last_became_active":"2024-09-12T16:58:21.702684+0000","last_became_peered":"2024-09-12T16:58:21.702684+0000","last_unstale":"2024-09-12T17:39:41.644167+0000","last_undegraded":"2024-09-12T17:39:41.644167+0000","last_fullsized":"2024-09-12T17:39:41.644167+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:49.497498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":882,"num_read_kb":712,"num_write":314,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"265'320","reported_seq":1002,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.365918+0000","last_change":"2024-09-12T16:58:18.695913+0000","last_active":"2024-09-12T17:41:32.365918+0000","last_peered":"2024-09-12T17:41:32.365918+0000","last_clean":"2024-09-12T17:41:32.365918+0000","last_became_active":"2024-09-12T16:58:18.695549+0000","last_became_peered":"2024-09-12T16:58:18.695549+0000","last_unstale":"2024-09-12T17:41:32.365918+0000","last_undegraded":"2024-09-12T17:41:32.365918+0000","last_fullsized":"2024-09-12T17:41:32.365918+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:34:55.744463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6643992,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":581,"num_read_kb":12632,"num_write":1049,"num_write_kb":15900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:55.282389+0000","last_change":"2024-09-12T16:58:23.720806+0000","last_active":"2024-09-12T17:38:55.282389+0000","last_peered":"2024-09-12T17:38:55.282389+0000","last_clean":"2024-09-12T17:38:55.282389+0000","last_became_active":"2024-09-12T16:58:23.720279+0000","last_became_peered":"2024-09-12T16:58:23.720279+0000","last_unstale":"2024-09-12T17:38:55.282389+0000","last_undegraded":"2024-09-12T17:38:55.282389+0000","last_fullsized":"2024-09-12T17:38:55.282389+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:05.351245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"265'287","reported_seq":856,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:11.321522+0000","last_change":"2024-09-12T16:58:25.713751+0000","last_active":"2024-09-12T17:41:11.321522+0000","last_peered":"2024-09-12T17:41:11.321522+0000","last_clean":"2024-09-12T17:41:11.321522+0000","last_became_active":"2024-09-12T16:58:25.711682+0000","last_became_peered":"2024-09-12T16:58:25.711682+0000","last_unstale":"2024-09-12T17:41:11.321522+0000","last_undegraded":"2024-09-12T17:41:11.321522+0000","last_fullsized":"2024-09-12T17:41:11.321522+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:16.044074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60114,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":508,"num_read_kb":1032,"num_write":466,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:07.363377+0000","last_change":"2024-09-12T16:58:27.752363+0000","last_active":"2024-09-12T17:39:07.363377+0000","last_peered":"2024-09-12T17:39:07.363377+0000","last_clean":"2024-09-12T17:39:07.363377+0000","last_became_active":"2024-09-12T16:58:27.751664+0000","last_became_peered":"2024-09-12T16:58:27.751664+0000","last_unstale":"2024-09-12T17:39:07.363377+0000","last_undegraded":"2024-09-12T17:39:07.363377+0000","last_fullsized":"2024-09-12T17:39:07.363377+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:48.576997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"265'126","reported_seq":626,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:42.388904+0000","last_change":"2024-09-12T16:58:29.785130+0000","last_active":"2024-09-12T17:40:42.388904+0000","last_peered":"2024-09-12T17:40:42.388904+0000","last_clean":"2024-09-12T17:40:42.388904+0000","last_became_active":"2024-09-12T16:58:29.784095+0000","last_became_peered":"2024-09-12T16:58:29.784095+0000","last_unstale":"2024-09-12T17:40:42.388904+0000","last_undegraded":"2024-09-12T17:40:42.388904+0000","last_fullsized":"2024-09-12T17:40:42.388904+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:32.305201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":487,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":177,"num_read_kb":165,"num_write":304,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"265'166","reported_seq":772,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:22.504965+0000","last_change":"2024-09-12T16:58:21.730323+0000","last_active":"2024-09-12T17:39:22.504965+0000","last_peered":"2024-09-12T17:39:22.504965+0000","last_clean":"2024-09-12T17:39:22.504965+0000","last_became_active":"2024-09-12T16:58:21.728963+0000","last_became_peered":"2024-09-12T16:58:21.728963+0000","last_unstale":"2024-09-12T17:39:22.504965+0000","last_undegraded":"2024-09-12T17:39:22.504965+0000","last_fullsized":"2024-09-12T17:39:22.504965+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:54.629377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":751,"num_read_kb":615,"num_write":255,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"265'279","reported_seq":947,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:47.104983+0000","last_change":"2024-09-12T16:58:18.709400+0000","last_active":"2024-09-12T17:39:47.104983+0000","last_peered":"2024-09-12T17:39:47.104983+0000","last_clean":"2024-09-12T17:39:47.104983+0000","last_became_active":"2024-09-12T16:58:18.708689+0000","last_became_peered":"2024-09-12T16:58:18.708689+0000","last_unstale":"2024-09-12T17:39:47.104983+0000","last_undegraded":"2024-09-12T17:39:47.104983+0000","last_fullsized":"2024-09-12T17:39:47.104983+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:03.022185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9753785,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":444,"num_read_kb":124256,"num_write":1072,"num_write_kb":36504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:58.706576+0000","last_change":"2024-09-12T16:58:23.709600+0000","last_active":"2024-09-12T17:38:58.706576+0000","last_peered":"2024-09-12T17:38:58.706576+0000","last_clean":"2024-09-12T17:38:58.706576+0000","last_became_active":"2024-09-12T16:58:23.709099+0000","last_became_peered":"2024-09-12T16:58:23.709099+0000","last_unstale":"2024-09-12T17:38:58.706576+0000","last_undegraded":"2024-09-12T17:38:58.706576+0000","last_fullsized":"2024-09-12T17:38:58.706576+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:40.419144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"265'273","reported_seq":852,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:15.312923+0000","last_change":"2024-09-12T16:58:25.724609+0000","last_active":"2024-09-12T17:41:15.312923+0000","last_peered":"2024-09-12T17:41:15.312923+0000","last_clean":"2024-09-12T17:41:15.312923+0000","last_became_active":"2024-09-12T16:58:25.723894+0000","last_became_peered":"2024-09-12T16:58:25.723894+0000","last_unstale":"2024-09-12T17:41:15.312923+0000","last_undegraded":"2024-09-12T17:41:15.312923+0000","last_fullsized":"2024-09-12T17:41:15.312923+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:02.360836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64085,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":444,"num_read_kb":901,"num_write":354,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"265'724","reported_seq":2345,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:25.115608+0000","last_change":"2024-09-12T16:58:27.754030+0000","last_active":"2024-09-12T17:41:25.115608+0000","last_peered":"2024-09-12T17:41:25.115608+0000","last_clean":"2024-09-12T17:41:25.115608+0000","last_became_active":"2024-09-12T16:58:27.753179+0000","last_became_peered":"2024-09-12T16:58:27.753179+0000","last_unstale":"2024-09-12T17:41:25.115608+0000","last_undegraded":"2024-09-12T17:41:25.115608+0000","last_fullsized":"2024-09-12T17:41:25.115608+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":700,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:00.243547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"265'139","reported_seq":662,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:23.672296+0000","last_change":"2024-09-12T16:58:29.779572+0000","last_active":"2024-09-12T17:41:23.672296+0000","last_peered":"2024-09-12T17:41:23.672296+0000","last_clean":"2024-09-12T17:41:23.672296+0000","last_became_active":"2024-09-12T16:58:29.778839+0000","last_became_peered":"2024-09-12T16:58:29.778839+0000","last_unstale":"2024-09-12T17:41:23.672296+0000","last_undegraded":"2024-09-12T17:41:23.672296+0000","last_fullsized":"2024-09-12T17:41:23.672296+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:04.060160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":288,"num_read_kb":252,"num_write":342,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"265'188","reported_seq":776,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:51.289772+0000","last_change":"2024-09-12T16:58:21.707767+0000","last_active":"2024-09-12T17:38:51.289772+0000","last_peered":"2024-09-12T17:38:51.289772+0000","last_clean":"2024-09-12T17:38:51.289772+0000","last_became_active":"2024-09-12T16:58:21.706953+0000","last_became_peered":"2024-09-12T16:58:21.706953+0000","last_unstale":"2024-09-12T17:38:51.289772+0000","last_undegraded":"2024-09-12T17:38:51.289772+0000","last_fullsized":"2024-09-12T17:38:51.289772+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:00.611915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":782,"num_read_kb":644,"num_write":280,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"265'274","reported_seq":908,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:49.358546+0000","last_change":"2024-09-12T16:58:18.693726+0000","last_active":"2024-09-12T17:39:49.358546+0000","last_peered":"2024-09-12T17:39:49.358546+0000","last_clean":"2024-09-12T17:39:49.358546+0000","last_became_active":"2024-09-12T16:58:18.686189+0000","last_became_peered":"2024-09-12T16:58:18.686189+0000","last_unstale":"2024-09-12T17:39:49.358546+0000","last_undegraded":"2024-09-12T17:39:49.358546+0000","last_fullsized":"2024-09-12T17:39:49.358546+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:38.741983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3594,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":463,"num_read_kb":6575,"num_write":1003,"num_write_kb":19619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1454,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:31.424308+0000","last_change":"2024-09-12T16:58:23.707182+0000","last_active":"2024-09-12T17:41:31.424308+0000","last_peered":"2024-09-12T17:41:31.424308+0000","last_clean":"2024-09-12T17:41:31.424308+0000","last_became_active":"2024-09-12T16:58:23.706471+0000","last_became_peered":"2024-09-12T16:58:23.706471+0000","last_unstale":"2024-09-12T17:41:31.424308+0000","last_undegraded":"2024-09-12T17:41:31.424308+0000","last_fullsized":"2024-09-12T17:41:31.424308+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:02.525244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":956,"num_read_kb":956,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"265'78","reported_seq":598,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:26.200090+0000","last_change":"2024-09-12T16:58:25.950921+0000","last_active":"2024-09-12T17:39:26.200090+0000","last_peered":"2024-09-12T17:39:26.200090+0000","last_clean":"2024-09-12T17:39:26.200090+0000","last_became_active":"2024-09-12T16:58:25.949962+0000","last_became_peered":"2024-09-12T16:58:25.949962+0000","last_unstale":"2024-09-12T17:39:26.200090+0000","last_undegraded":"2024-09-12T17:39:26.200090+0000","last_fullsized":"2024-09-12T17:39:26.200090+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:35.151455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"265'754","reported_seq":4002,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:25.115415+0000","last_change":"2024-09-12T16:58:27.756362+0000","last_active":"2024-09-12T17:41:25.115415+0000","last_peered":"2024-09-12T17:41:25.115415+0000","last_clean":"2024-09-12T17:41:25.115415+0000","last_became_active":"2024-09-12T16:58:27.755569+0000","last_became_peered":"2024-09-12T16:58:27.755569+0000","last_unstale":"2024-09-12T17:41:25.115415+0000","last_undegraded":"2024-09-12T17:41:25.115415+0000","last_fullsized":"2024-09-12T17:41:25.115415+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:36.568674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"265'116","reported_seq":624,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:24.000291+0000","last_change":"2024-09-12T16:58:29.781541+0000","last_active":"2024-09-12T17:39:24.000291+0000","last_peered":"2024-09-12T17:39:24.000291+0000","last_clean":"2024-09-12T17:39:24.000291+0000","last_became_active":"2024-09-12T16:58:29.780289+0000","last_became_peered":"2024-09-12T16:58:29.780289+0000","last_unstale":"2024-09-12T17:39:24.000291+0000","last_undegraded":"2024-09-12T17:39:24.000291+0000","last_fullsized":"2024-09-12T17:39:24.000291+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:45.266710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":175,"num_write":267,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"265'140","reported_seq":797,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:32.931293+0000","last_change":"2024-09-12T16:58:21.720633+0000","last_active":"2024-09-12T17:39:32.931293+0000","last_peered":"2024-09-12T17:39:32.931293+0000","last_clean":"2024-09-12T17:39:32.931293+0000","last_became_active":"2024-09-12T16:58:21.719827+0000","last_became_peered":"2024-09-12T16:58:21.719827+0000","last_unstale":"2024-09-12T17:39:32.931293+0000","last_undegraded":"2024-09-12T17:39:32.931293+0000","last_fullsized":"2024-09-12T17:39:32.931293+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:57.062320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":689,"num_read_kb":590,"num_write":204,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"265'276","reported_seq":922,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.364338+0000","last_change":"2024-09-12T16:58:18.705680+0000","last_active":"2024-09-12T17:41:32.364338+0000","last_peered":"2024-09-12T17:41:32.364338+0000","last_clean":"2024-09-12T17:41:32.364338+0000","last_became_active":"2024-09-12T16:58:18.705048+0000","last_became_peered":"2024-09-12T16:58:18.705048+0000","last_unstale":"2024-09-12T17:41:32.364338+0000","last_undegraded":"2024-09-12T17:41:32.364338+0000","last_fullsized":"2024-09-12T17:41:32.364338+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:04.638122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2618767,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":446,"num_read_kb":3390,"num_write":999,"num_write_kb":22669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"36'5","reported_seq":977,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:24.522437+0000","last_change":"2024-09-12T16:58:23.703535+0000","last_active":"2024-09-12T17:41:24.522437+0000","last_peered":"2024-09-12T17:41:24.522437+0000","last_clean":"2024-09-12T17:41:24.522437+0000","last_became_active":"2024-09-12T16:58:23.702699+0000","last_became_peered":"2024-09-12T16:58:23.702699+0000","last_unstale":"2024-09-12T17:41:24.522437+0000","last_undegraded":"2024-09-12T17:41:24.522437+0000","last_fullsized":"2024-09-12T17:41:24.522437+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:52.474180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"265'340","reported_seq":939,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:24.867019+0000","last_change":"2024-09-12T16:58:25.725360+0000","last_active":"2024-09-12T17:41:24.867019+0000","last_peered":"2024-09-12T17:41:24.867019+0000","last_clean":"2024-09-12T17:41:24.867019+0000","last_became_active":"2024-09-12T16:58:25.724694+0000","last_became_peered":"2024-09-12T16:58:25.724694+0000","last_unstale":"2024-09-12T17:41:24.867019+0000","last_undegraded":"2024-09-12T17:41:24.867019+0000","last_fullsized":"2024-09-12T17:41:24.867019+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:22.997913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63869,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":549,"num_read_kb":1058,"num_write":438,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:01.307379+0000","last_change":"2024-09-12T16:58:27.741238+0000","last_active":"2024-09-12T17:39:01.307379+0000","last_peered":"2024-09-12T17:39:01.307379+0000","last_clean":"2024-09-12T17:39:01.307379+0000","last_became_active":"2024-09-12T16:58:27.740510+0000","last_became_peered":"2024-09-12T16:58:27.740510+0000","last_unstale":"2024-09-12T17:39:01.307379+0000","last_undegraded":"2024-09-12T17:39:01.307379+0000","last_fullsized":"2024-09-12T17:39:01.307379+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:22.805172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"265'127","reported_seq":619,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:03.172275+0000","last_change":"2024-09-12T16:58:29.776743+0000","last_active":"2024-09-12T17:40:03.172275+0000","last_peered":"2024-09-12T17:40:03.172275+0000","last_clean":"2024-09-12T17:40:03.172275+0000","last_became_active":"2024-09-12T16:58:29.776007+0000","last_became_peered":"2024-09-12T16:58:29.776007+0000","last_unstale":"2024-09-12T17:40:03.172275+0000","last_undegraded":"2024-09-12T17:40:03.172275+0000","last_fullsized":"2024-09-12T17:40:03.172275+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:10.538331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":162,"num_read_kb":158,"num_write":308,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"265'143","reported_seq":755,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:26.457471+0000","last_change":"2024-09-12T16:58:21.726965+0000","last_active":"2024-09-12T17:39:26.457471+0000","last_peered":"2024-09-12T17:39:26.457471+0000","last_clean":"2024-09-12T17:39:26.457471+0000","last_became_active":"2024-09-12T16:58:21.726160+0000","last_became_peered":"2024-09-12T16:58:21.726160+0000","last_unstale":"2024-09-12T17:39:26.457471+0000","last_undegraded":"2024-09-12T17:39:26.457471+0000","last_fullsized":"2024-09-12T17:39:26.457471+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:57.204197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":643,"num_read_kb":537,"num_write":216,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":612,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:16.305011+0000","last_change":"2024-09-12T16:58:04.218615+0000","last_active":"2024-09-12T17:38:16.305011+0000","last_peered":"2024-09-12T17:38:16.305011+0000","last_clean":"2024-09-12T17:38:16.305011+0000","last_became_active":"2024-09-12T16:58:04.216387+0000","last_became_peered":"2024-09-12T16:58:04.216387+0000","last_unstale":"2024-09-12T17:38:16.305011+0000","last_undegraded":"2024-09-12T17:38:16.305011+0000","last_fullsized":"2024-09-12T17:38:16.305011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:02.482619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:02.482619+0000","last_clean_scrub_stamp":"2024-09-12T16:58:02.482619+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:20.111220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":521,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:47.329290+0000","last_change":"2024-09-12T16:58:10.535498+0000","last_active":"2024-09-12T17:37:47.329290+0000","last_peered":"2024-09-12T17:37:47.329290+0000","last_clean":"2024-09-12T17:37:47.329290+0000","last_became_active":"2024-09-12T16:58:08.538227+0000","last_became_peered":"2024-09-12T16:58:08.538227+0000","last_unstale":"2024-09-12T17:37:47.329290+0000","last_undegraded":"2024-09-12T17:37:47.329290+0000","last_fullsized":"2024-09-12T17:37:47.329290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_clean_scrub_stamp":"2024-09-12T16:58:07.519706+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:36.699923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001171044,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"265'291","reported_seq":917,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:42.012113+0000","last_change":"2024-09-12T16:58:55.958137+0000","last_active":"2024-09-12T17:39:42.012113+0000","last_peered":"2024-09-12T17:39:42.012113+0000","last_clean":"2024-09-12T17:39:42.012113+0000","last_became_active":"2024-09-12T16:58:55.957231+0000","last_became_peered":"2024-09-12T16:58:55.957231+0000","last_unstale":"2024-09-12T17:39:42.012113+0000","last_undegraded":"2024-09-12T17:39:42.012113+0000","last_fullsized":"2024-09-12T17:39:42.012113+0000","mapping_epoch":37,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:39.817907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16149763,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":484,"num_read_kb":44869,"num_write":1058,"num_write_kb":45418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"36'3","reported_seq":977,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:24.524924+0000","last_change":"2024-09-12T16:58:23.719701+0000","last_active":"2024-09-12T17:41:24.524924+0000","last_peered":"2024-09-12T17:41:24.524924+0000","last_clean":"2024-09-12T17:41:24.524924+0000","last_became_active":"2024-09-12T16:58:23.718720+0000","last_became_peered":"2024-09-12T16:58:23.718720+0000","last_unstale":"2024-09-12T17:41:24.524924+0000","last_undegraded":"2024-09-12T17:41:24.524924+0000","last_fullsized":"2024-09-12T17:41:24.524924+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:27.937180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"265'676","reported_seq":1362,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:31.964232+0000","last_change":"2024-09-12T16:58:25.721421+0000","last_active":"2024-09-12T17:41:31.964232+0000","last_peered":"2024-09-12T17:41:31.964232+0000","last_clean":"2024-09-12T17:41:31.964232+0000","last_became_active":"2024-09-12T16:58:25.720741+0000","last_became_peered":"2024-09-12T16:58:25.720741+0000","last_unstale":"2024-09-12T17:41:31.964232+0000","last_undegraded":"2024-09-12T17:41:31.964232+0000","last_fullsized":"2024-09-12T17:41:31.964232+0000","mapping_epoch":30,"log_start":"265'600","ondisk_log_start":"265'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":600,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:58.053661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":173015,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1318,"num_read_kb":2750,"num_write":1232,"num_write_kb":1100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:27.339048+0000","last_change":"2024-09-12T16:58:27.746911+0000","last_active":"2024-09-12T17:37:27.339048+0000","last_peered":"2024-09-12T17:37:27.339048+0000","last_clean":"2024-09-12T17:37:27.339048+0000","last_became_active":"2024-09-12T16:58:27.746171+0000","last_became_peered":"2024-09-12T16:58:27.746171+0000","last_unstale":"2024-09-12T17:37:27.339048+0000","last_undegraded":"2024-09-12T17:37:27.339048+0000","last_fullsized":"2024-09-12T17:37:27.339048+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:24:35.029842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"265'209","reported_seq":915,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:03.864055+0000","last_change":"2024-09-12T16:58:29.769292+0000","last_active":"2024-09-12T17:40:03.864055+0000","last_peered":"2024-09-12T17:40:03.864055+0000","last_clean":"2024-09-12T17:40:03.864055+0000","last_became_active":"2024-09-12T16:58:29.768536+0000","last_became_peered":"2024-09-12T16:58:29.768536+0000","last_unstale":"2024-09-12T17:40:03.864055+0000","last_undegraded":"2024-09-12T17:40:03.864055+0000","last_fullsized":"2024-09-12T17:40:03.864055+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:00.483017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":520,"num_read_kb":510,"num_write":443,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"265'70","reported_seq":624,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:01.041564+0000","last_change":"2024-09-12T16:58:21.724410+0000","last_active":"2024-09-12T17:40:01.041564+0000","last_peered":"2024-09-12T17:40:01.041564+0000","last_clean":"2024-09-12T17:40:01.041564+0000","last_became_active":"2024-09-12T16:58:21.723703+0000","last_became_peered":"2024-09-12T16:58:21.723703+0000","last_unstale":"2024-09-12T17:40:01.041564+0000","last_undegraded":"2024-09-12T17:40:01.041564+0000","last_fullsized":"2024-09-12T17:40:01.041564+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:47.327553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":317,"num_read_kb":265,"num_write":106,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":521,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:21.306154+0000","last_change":"2024-09-12T16:58:10.928592+0000","last_active":"2024-09-12T17:38:21.306154+0000","last_peered":"2024-09-12T17:38:21.306154+0000","last_clean":"2024-09-12T17:38:21.306154+0000","last_became_active":"2024-09-12T16:58:08.536415+0000","last_became_peered":"2024-09-12T16:58:08.536415+0000","last_unstale":"2024-09-12T17:38:21.306154+0000","last_undegraded":"2024-09-12T17:38:21.306154+0000","last_fullsized":"2024-09-12T17:38:21.306154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_clean_scrub_stamp":"2024-09-12T16:58:07.519706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:44.873424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001332909,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"265'280","reported_seq":926,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.369380+0000","last_change":"2024-09-12T16:58:18.696403+0000","last_active":"2024-09-12T17:41:32.369380+0000","last_peered":"2024-09-12T17:41:32.369380+0000","last_clean":"2024-09-12T17:41:32.369380+0000","last_became_active":"2024-09-12T16:58:18.695755+0000","last_became_peered":"2024-09-12T16:58:18.695755+0000","last_unstale":"2024-09-12T17:41:32.369380+0000","last_undegraded":"2024-09-12T17:41:32.369380+0000","last_fullsized":"2024-09-12T17:41:32.369380+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:56.681369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448864,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":495,"num_read_kb":2857,"num_write":1023,"num_write_kb":24939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:27.324815+0000","last_change":"2024-09-12T16:58:23.713076+0000","last_active":"2024-09-12T17:37:27.324815+0000","last_peered":"2024-09-12T17:37:27.324815+0000","last_clean":"2024-09-12T17:37:27.324815+0000","last_became_active":"2024-09-12T16:58:23.712354+0000","last_became_peered":"2024-09-12T16:58:23.712354+0000","last_unstale":"2024-09-12T17:37:27.324815+0000","last_undegraded":"2024-09-12T17:37:27.324815+0000","last_fullsized":"2024-09-12T17:37:27.324815+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:23.368180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"265'1250","reported_seq":2707,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.353991+0000","last_change":"2024-09-12T16:58:25.721009+0000","last_active":"2024-09-12T17:41:33.353991+0000","last_peered":"2024-09-12T17:41:33.353991+0000","last_clean":"2024-09-12T17:41:33.353991+0000","last_became_active":"2024-09-12T16:58:25.720266+0000","last_became_peered":"2024-09-12T16:58:25.720266+0000","last_unstale":"2024-09-12T17:41:33.353991+0000","last_undegraded":"2024-09-12T17:41:33.353991+0000","last_fullsized":"2024-09-12T17:41:33.353991+0000","mapping_epoch":30,"log_start":"265'1200","ondisk_log_start":"265'1200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":1200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:01.087152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150793,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2049,"num_read_kb":3938,"num_write":1140,"num_write_kb":988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:16.305184+0000","last_change":"2024-09-12T16:58:27.746109+0000","last_active":"2024-09-12T17:38:16.305184+0000","last_peered":"2024-09-12T17:38:16.305184+0000","last_clean":"2024-09-12T17:38:16.305184+0000","last_became_active":"2024-09-12T16:58:27.745341+0000","last_became_peered":"2024-09-12T16:58:27.745341+0000","last_unstale":"2024-09-12T17:38:16.305184+0000","last_undegraded":"2024-09-12T17:38:16.305184+0000","last_fullsized":"2024-09-12T17:38:16.305184+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:12.798309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"265'209","reported_seq":724,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:45.564670+0000","last_change":"2024-09-12T16:58:29.776726+0000","last_active":"2024-09-12T17:39:45.564670+0000","last_peered":"2024-09-12T17:39:45.564670+0000","last_clean":"2024-09-12T17:39:45.564670+0000","last_became_active":"2024-09-12T16:58:29.775944+0000","last_became_peered":"2024-09-12T16:58:29.775944+0000","last_unstale":"2024-09-12T17:39:45.564670+0000","last_undegraded":"2024-09-12T17:39:45.564670+0000","last_fullsized":"2024-09-12T17:39:45.564670+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:58.956084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":347,"num_read_kb":347,"num_write":464,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"265'122","reported_seq":674,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:23.685021+0000","last_change":"2024-09-12T16:58:21.722030+0000","last_active":"2024-09-12T17:37:23.685021+0000","last_peered":"2024-09-12T17:37:23.685021+0000","last_clean":"2024-09-12T17:37:23.685021+0000","last_became_active":"2024-09-12T16:58:21.721591+0000","last_became_peered":"2024-09-12T16:58:21.721591+0000","last_unstale":"2024-09-12T17:37:23.685021+0000","last_undegraded":"2024-09-12T17:37:23.685021+0000","last_fullsized":"2024-09-12T17:37:23.685021+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:36.430469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":495,"num_read_kb":400,"num_write":173,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":521,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:45.267241+0000","last_change":"2024-09-12T16:58:10.591264+0000","last_active":"2024-09-12T17:37:45.267241+0000","last_peered":"2024-09-12T17:37:45.267241+0000","last_clean":"2024-09-12T17:37:45.267241+0000","last_became_active":"2024-09-12T16:58:08.534076+0000","last_became_peered":"2024-09-12T16:58:08.534076+0000","last_unstale":"2024-09-12T17:37:45.267241+0000","last_undegraded":"2024-09-12T17:37:45.267241+0000","last_fullsized":"2024-09-12T17:37:45.267241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_clean_scrub_stamp":"2024-09-12T16:58:07.519706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:08.414186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083305900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"265'312","reported_seq":933,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.325470+0000","last_change":"2024-09-12T16:58:18.706724+0000","last_active":"2024-09-12T17:41:33.325470+0000","last_peered":"2024-09-12T17:41:33.325470+0000","last_clean":"2024-09-12T17:41:33.325470+0000","last_became_active":"2024-09-12T16:58:18.702490+0000","last_became_peered":"2024-09-12T16:58:18.702490+0000","last_unstale":"2024-09-12T17:41:33.325470+0000","last_undegraded":"2024-09-12T17:41:33.325470+0000","last_fullsized":"2024-09-12T17:41:33.325470+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:03:09.377111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263185,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":455,"num_read_kb":7668,"num_write":1054,"num_write_kb":10637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:25.263146+0000","last_change":"2024-09-12T16:58:23.724826+0000","last_active":"2024-09-12T17:37:25.263146+0000","last_peered":"2024-09-12T17:37:25.263146+0000","last_clean":"2024-09-12T17:37:25.263146+0000","last_became_active":"2024-09-12T16:58:23.724300+0000","last_became_peered":"2024-09-12T16:58:23.724300+0000","last_unstale":"2024-09-12T17:37:25.263146+0000","last_undegraded":"2024-09-12T17:37:25.263146+0000","last_fullsized":"2024-09-12T17:37:25.263146+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:36.764896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"265'230","reported_seq":1294,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:20.111355+0000","last_change":"2024-09-12T16:58:25.949888+0000","last_active":"2024-09-12T17:41:20.111355+0000","last_peered":"2024-09-12T17:41:20.111355+0000","last_clean":"2024-09-12T17:41:20.111355+0000","last_became_active":"2024-09-12T16:58:25.949120+0000","last_became_peered":"2024-09-12T16:58:25.949120+0000","last_unstale":"2024-09-12T17:41:20.111355+0000","last_undegraded":"2024-09-12T17:41:20.111355+0000","last_fullsized":"2024-09-12T17:41:20.111355+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:25.274870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":178,"num_read_kb":168,"num_write":143,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:02.347062+0000","last_change":"2024-09-12T16:58:27.736961+0000","last_active":"2024-09-12T17:38:02.347062+0000","last_peered":"2024-09-12T17:38:02.347062+0000","last_clean":"2024-09-12T17:38:02.347062+0000","last_became_active":"2024-09-12T16:58:27.736215+0000","last_became_peered":"2024-09-12T16:58:27.736215+0000","last_unstale":"2024-09-12T17:38:02.347062+0000","last_undegraded":"2024-09-12T17:38:02.347062+0000","last_fullsized":"2024-09-12T17:38:02.347062+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:39.723240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"265'249","reported_seq":855,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:05.168772+0000","last_change":"2024-09-12T16:58:29.792850+0000","last_active":"2024-09-12T17:40:05.168772+0000","last_peered":"2024-09-12T17:40:05.168772+0000","last_clean":"2024-09-12T17:40:05.168772+0000","last_became_active":"2024-09-12T16:58:29.792069+0000","last_became_peered":"2024-09-12T16:58:29.792069+0000","last_unstale":"2024-09-12T17:40:05.168772+0000","last_undegraded":"2024-09-12T17:40:05.168772+0000","last_fullsized":"2024-09-12T17:40:05.168772+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:03.093750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1041,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":529,"num_read_kb":546,"num_write":531,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"265'182","reported_seq":838,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:55.411179+0000","last_change":"2024-09-12T16:58:21.730485+0000","last_active":"2024-09-12T17:38:55.411179+0000","last_peered":"2024-09-12T17:38:55.411179+0000","last_clean":"2024-09-12T17:38:55.411179+0000","last_became_active":"2024-09-12T16:58:21.729848+0000","last_became_peered":"2024-09-12T16:58:21.729848+0000","last_unstale":"2024-09-12T17:38:55.411179+0000","last_undegraded":"2024-09-12T17:38:55.411179+0000","last_fullsized":"2024-09-12T17:38:55.411179+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:36.732505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":860,"num_read_kb":722,"num_write":267,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:47.329231+0000","last_change":"2024-09-12T16:58:10.535375+0000","last_active":"2024-09-12T17:37:47.329231+0000","last_peered":"2024-09-12T17:37:47.329231+0000","last_clean":"2024-09-12T17:37:47.329231+0000","last_became_active":"2024-09-12T16:58:08.538078+0000","last_became_peered":"2024-09-12T16:58:08.538078+0000","last_unstale":"2024-09-12T17:37:47.329231+0000","last_undegraded":"2024-09-12T17:37:47.329231+0000","last_fullsized":"2024-09-12T17:37:47.329231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_clean_scrub_stamp":"2024-09-12T16:58:07.519706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:19.309437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012028640000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"265'308","reported_seq":1019,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:51.332245+0000","last_change":"2024-09-12T16:58:18.694335+0000","last_active":"2024-09-12T17:39:51.332245+0000","last_peered":"2024-09-12T17:39:51.332245+0000","last_clean":"2024-09-12T17:39:51.332245+0000","last_became_active":"2024-09-12T16:58:18.690974+0000","last_became_peered":"2024-09-12T16:58:18.690974+0000","last_unstale":"2024-09-12T17:39:51.332245+0000","last_undegraded":"2024-09-12T17:39:51.332245+0000","last_fullsized":"2024-09-12T17:39:51.332245+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:48.350096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5648829,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":603,"num_read_kb":31815,"num_write":1085,"num_write_kb":57340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:12.349471+0000","last_change":"2024-09-12T16:58:23.713734+0000","last_active":"2024-09-12T17:38:12.349471+0000","last_peered":"2024-09-12T17:38:12.349471+0000","last_clean":"2024-09-12T17:38:12.349471+0000","last_became_active":"2024-09-12T16:58:23.713019+0000","last_became_peered":"2024-09-12T16:58:23.713019+0000","last_unstale":"2024-09-12T17:38:12.349471+0000","last_undegraded":"2024-09-12T17:38:12.349471+0000","last_fullsized":"2024-09-12T17:38:12.349471+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:50.721387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"265'106","reported_seq":647,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:37.374180+0000","last_change":"2024-09-12T16:58:25.719093+0000","last_active":"2024-09-12T17:39:37.374180+0000","last_peered":"2024-09-12T17:39:37.374180+0000","last_clean":"2024-09-12T17:39:37.374180+0000","last_became_active":"2024-09-12T16:58:25.718364+0000","last_became_peered":"2024-09-12T16:58:25.718364+0000","last_unstale":"2024-09-12T17:39:37.374180+0000","last_undegraded":"2024-09-12T17:39:37.374180+0000","last_fullsized":"2024-09-12T17:39:37.374180+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:32.974861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":134,"num_write":100,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:31.287928+0000","last_change":"2024-09-12T16:58:27.762825+0000","last_active":"2024-09-12T17:37:31.287928+0000","last_peered":"2024-09-12T17:37:31.287928+0000","last_clean":"2024-09-12T17:37:31.287928+0000","last_became_active":"2024-09-12T16:58:27.761992+0000","last_became_peered":"2024-09-12T16:58:27.761992+0000","last_unstale":"2024-09-12T17:37:31.287928+0000","last_undegraded":"2024-09-12T17:37:31.287928+0000","last_fullsized":"2024-09-12T17:37:31.287928+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:59:01.991644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"265'110","reported_seq":663,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:45.784115+0000","last_change":"2024-09-12T16:58:29.788605+0000","last_active":"2024-09-12T17:39:45.784115+0000","last_peered":"2024-09-12T17:39:45.784115+0000","last_clean":"2024-09-12T17:39:45.784115+0000","last_became_active":"2024-09-12T16:58:29.787823+0000","last_became_peered":"2024-09-12T16:58:29.787823+0000","last_unstale":"2024-09-12T17:39:45.784115+0000","last_undegraded":"2024-09-12T17:39:45.784115+0000","last_fullsized":"2024-09-12T17:39:45.784115+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:40.857819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":275,"num_read_kb":264,"num_write":276,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"265'60","reported_seq":613,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:45.856557+0000","last_change":"2024-09-12T16:58:21.722318+0000","last_active":"2024-09-12T17:38:45.856557+0000","last_peered":"2024-09-12T17:38:45.856557+0000","last_clean":"2024-09-12T17:38:45.856557+0000","last_became_active":"2024-09-12T16:58:21.720884+0000","last_became_peered":"2024-09-12T16:58:21.720884+0000","last_unstale":"2024-09-12T17:38:45.856557+0000","last_undegraded":"2024-09-12T17:38:45.856557+0000","last_fullsized":"2024-09-12T17:38:45.856557+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:32.526744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":223,"num_write":91,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"265'328","reported_seq":974,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.362282+0000","last_change":"2024-09-12T16:58:18.719301+0000","last_active":"2024-09-12T17:41:32.362282+0000","last_peered":"2024-09-12T17:41:32.362282+0000","last_clean":"2024-09-12T17:41:32.362282+0000","last_became_active":"2024-09-12T16:58:18.718447+0000","last_became_peered":"2024-09-12T16:58:18.718447+0000","last_unstale":"2024-09-12T17:41:32.362282+0000","last_undegraded":"2024-09-12T17:41:32.362282+0000","last_fullsized":"2024-09-12T17:41:32.362282+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:48.031054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1820306,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":467,"num_read_kb":35874,"num_write":1162,"num_write_kb":51856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":520,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:48.690429+0000","last_change":"2024-09-12T16:58:10.542079+0000","last_active":"2024-09-12T17:37:48.690429+0000","last_peered":"2024-09-12T17:37:48.690429+0000","last_clean":"2024-09-12T17:37:48.690429+0000","last_became_active":"2024-09-12T16:58:08.842793+0000","last_became_peered":"2024-09-12T16:58:08.842793+0000","last_unstale":"2024-09-12T17:37:48.690429+0000","last_undegraded":"2024-09-12T17:37:48.690429+0000","last_fullsized":"2024-09-12T17:37:48.690429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_clean_scrub_stamp":"2024-09-12T16:58:07.519706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:21.164130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001121181,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:02.347021+0000","last_change":"2024-09-12T16:58:23.712397+0000","last_active":"2024-09-12T17:38:02.347021+0000","last_peered":"2024-09-12T17:38:02.347021+0000","last_clean":"2024-09-12T17:38:02.347021+0000","last_became_active":"2024-09-12T16:58:23.710355+0000","last_became_peered":"2024-09-12T16:58:23.710355+0000","last_unstale":"2024-09-12T17:38:02.347021+0000","last_undegraded":"2024-09-12T17:38:02.347021+0000","last_fullsized":"2024-09-12T17:38:02.347021+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:49.303296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"265'562","reported_seq":1212,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:31.944656+0000","last_change":"2024-09-12T16:58:25.731056+0000","last_active":"2024-09-12T17:41:31.944656+0000","last_peered":"2024-09-12T17:41:31.944656+0000","last_clean":"2024-09-12T17:41:31.944656+0000","last_became_active":"2024-09-12T16:58:25.729627+0000","last_became_peered":"2024-09-12T16:58:25.729627+0000","last_unstale":"2024-09-12T17:41:31.944656+0000","last_undegraded":"2024-09-12T17:41:31.944656+0000","last_fullsized":"2024-09-12T17:41:31.944656+0000","mapping_epoch":30,"log_start":"265'500","ondisk_log_start":"265'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":500,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:16.481975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116167,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1549,"num_read_kb":2536,"num_write":2020,"num_write_kb":1866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:06.279604+0000","last_change":"2024-09-12T16:58:27.734028+0000","last_active":"2024-09-12T17:38:06.279604+0000","last_peered":"2024-09-12T17:38:06.279604+0000","last_clean":"2024-09-12T17:38:06.279604+0000","last_became_active":"2024-09-12T16:58:27.733289+0000","last_became_peered":"2024-09-12T16:58:27.733289+0000","last_unstale":"2024-09-12T17:38:06.279604+0000","last_undegraded":"2024-09-12T17:38:06.279604+0000","last_fullsized":"2024-09-12T17:38:06.279604+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:05.333134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"265'157","reported_seq":661,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:44.925507+0000","last_change":"2024-09-12T16:58:29.779788+0000","last_active":"2024-09-12T17:39:44.925507+0000","last_peered":"2024-09-12T17:39:44.925507+0000","last_clean":"2024-09-12T17:39:44.925507+0000","last_became_active":"2024-09-12T16:58:29.779052+0000","last_became_peered":"2024-09-12T16:58:29.779052+0000","last_unstale":"2024-09-12T17:39:44.925507+0000","last_undegraded":"2024-09-12T17:39:44.925507+0000","last_fullsized":"2024-09-12T17:39:44.925507+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:46.799747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":199,"num_read_kb":192,"num_write":361,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"265'202","reported_seq":806,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:57.345814+0000","last_change":"2024-09-12T16:58:21.702417+0000","last_active":"2024-09-12T17:37:57.345814+0000","last_peered":"2024-09-12T17:37:57.345814+0000","last_clean":"2024-09-12T17:37:57.345814+0000","last_became_active":"2024-09-12T16:58:21.701657+0000","last_became_peered":"2024-09-12T16:58:21.701657+0000","last_unstale":"2024-09-12T17:37:57.345814+0000","last_undegraded":"2024-09-12T17:37:57.345814+0000","last_fullsized":"2024-09-12T17:37:57.345814+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:39.768733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":888,"num_read_kb":728,"num_write":297,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"265'330","reported_seq":954,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.294376+0000","last_change":"2024-09-12T16:58:18.700995+0000","last_active":"2024-09-12T17:41:33.294376+0000","last_peered":"2024-09-12T17:41:33.294376+0000","last_clean":"2024-09-12T17:41:33.294376+0000","last_became_active":"2024-09-12T16:58:18.698417+0000","last_became_peered":"2024-09-12T16:58:18.698417+0000","last_unstale":"2024-09-12T17:41:33.294376+0000","last_undegraded":"2024-09-12T17:41:33.294376+0000","last_fullsized":"2024-09-12T17:41:33.294376+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:21:09.942403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":462,"num_read_kb":2498,"num_write":998,"num_write_kb":19196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":520,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:56.300230+0000","last_change":"2024-09-12T16:58:10.928593+0000","last_active":"2024-09-12T17:37:56.300230+0000","last_peered":"2024-09-12T17:37:56.300230+0000","last_clean":"2024-09-12T17:37:56.300230+0000","last_became_active":"2024-09-12T16:58:08.841831+0000","last_became_peered":"2024-09-12T16:58:08.841831+0000","last_unstale":"2024-09-12T17:37:56.300230+0000","last_undegraded":"2024-09-12T17:37:56.300230+0000","last_fullsized":"2024-09-12T17:37:56.300230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_clean_scrub_stamp":"2024-09-12T16:58:07.519706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:41.789253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013535820000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:01.294217+0000","last_change":"2024-09-12T16:58:23.708567+0000","last_active":"2024-09-12T17:38:01.294217+0000","last_peered":"2024-09-12T17:38:01.294217+0000","last_clean":"2024-09-12T17:38:01.294217+0000","last_became_active":"2024-09-12T16:58:23.707729+0000","last_became_peered":"2024-09-12T16:58:23.707729+0000","last_unstale":"2024-09-12T17:38:01.294217+0000","last_undegraded":"2024-09-12T17:38:01.294217+0000","last_fullsized":"2024-09-12T17:38:01.294217+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:34.309579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"265'150","reported_seq":710,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:49.590614+0000","last_change":"2024-09-12T16:58:25.950943+0000","last_active":"2024-09-12T17:38:49.590614+0000","last_peered":"2024-09-12T17:38:49.590614+0000","last_clean":"2024-09-12T17:38:49.590614+0000","last_became_active":"2024-09-12T16:58:25.950057+0000","last_became_peered":"2024-09-12T16:58:25.950057+0000","last_unstale":"2024-09-12T17:38:49.590614+0000","last_undegraded":"2024-09-12T17:38:49.590614+0000","last_fullsized":"2024-09-12T17:38:49.590614+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:04.088948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":199,"num_read_kb":190,"num_write":134,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"265'768","reported_seq":2768,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:31.875034+0000","last_change":"2024-09-12T16:58:27.758626+0000","last_active":"2024-09-12T17:41:31.875034+0000","last_peered":"2024-09-12T17:41:31.875034+0000","last_clean":"2024-09-12T17:41:31.875034+0000","last_became_active":"2024-09-12T16:58:27.756883+0000","last_became_peered":"2024-09-12T16:58:27.756883+0000","last_unstale":"2024-09-12T17:41:31.875034+0000","last_undegraded":"2024-09-12T17:41:31.875034+0000","last_fullsized":"2024-09-12T17:41:31.875034+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:09.429114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"265'131","reported_seq":630,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:24.919336+0000","last_change":"2024-09-12T16:58:29.785504+0000","last_active":"2024-09-12T17:41:24.919336+0000","last_peered":"2024-09-12T17:41:24.919336+0000","last_clean":"2024-09-12T17:41:24.919336+0000","last_became_active":"2024-09-12T16:58:29.784743+0000","last_became_peered":"2024-09-12T16:58:29.784743+0000","last_unstale":"2024-09-12T17:41:24.919336+0000","last_undegraded":"2024-09-12T17:41:24.919336+0000","last_fullsized":"2024-09-12T17:41:24.919336+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:07.819438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1532,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":153,"num_read_kb":151,"num_write":316,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"265'49","reported_seq":586,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:32.357724+0000","last_change":"2024-09-12T16:58:21.723795+0000","last_active":"2024-09-12T17:38:32.357724+0000","last_peered":"2024-09-12T17:38:32.357724+0000","last_clean":"2024-09-12T17:38:32.357724+0000","last_became_active":"2024-09-12T16:58:21.723391+0000","last_became_peered":"2024-09-12T16:58:21.723391+0000","last_unstale":"2024-09-12T17:38:32.357724+0000","last_undegraded":"2024-09-12T17:38:32.357724+0000","last_fullsized":"2024-09-12T17:38:32.357724+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:53.524544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":182,"num_write":83,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"265'398","reported_seq":1036,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.384226+0000","last_change":"2024-09-12T16:58:18.687350+0000","last_active":"2024-09-12T17:41:32.384226+0000","last_peered":"2024-09-12T17:41:32.384226+0000","last_clean":"2024-09-12T17:41:32.384226+0000","last_became_active":"2024-09-12T16:58:18.686966+0000","last_became_peered":"2024-09-12T16:58:18.686966+0000","last_unstale":"2024-09-12T17:41:32.384226+0000","last_undegraded":"2024-09-12T17:41:32.384226+0000","last_fullsized":"2024-09-12T17:41:32.384226+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:41.879490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1404504,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":569,"num_read_kb":10296,"num_write":1163,"num_write_kb":24848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":520,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:18.711565+0000","last_change":"2024-09-12T16:58:10.542239+0000","last_active":"2024-09-12T17:39:18.711565+0000","last_peered":"2024-09-12T17:39:18.711565+0000","last_clean":"2024-09-12T17:39:18.711565+0000","last_became_active":"2024-09-12T16:58:08.544406+0000","last_became_peered":"2024-09-12T16:58:08.544406+0000","last_unstale":"2024-09-12T17:39:18.711565+0000","last_undegraded":"2024-09-12T17:39:18.711565+0000","last_fullsized":"2024-09-12T17:39:18.711565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_clean_scrub_stamp":"2024-09-12T16:58:07.519706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:42.866569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012247510000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:01.278478+0000","last_change":"2024-09-12T16:58:23.701057+0000","last_active":"2024-09-12T17:38:01.278478+0000","last_peered":"2024-09-12T17:38:01.278478+0000","last_clean":"2024-09-12T17:38:01.278478+0000","last_became_active":"2024-09-12T16:58:23.700331+0000","last_became_peered":"2024-09-12T16:58:23.700331+0000","last_unstale":"2024-09-12T17:38:01.278478+0000","last_undegraded":"2024-09-12T17:38:01.278478+0000","last_fullsized":"2024-09-12T17:38:01.278478+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:36.712880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"265'119","reported_seq":654,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:32.549144+0000","last_change":"2024-09-12T16:58:25.731260+0000","last_active":"2024-09-12T17:39:32.549144+0000","last_peered":"2024-09-12T17:39:32.549144+0000","last_clean":"2024-09-12T17:39:32.549144+0000","last_became_active":"2024-09-12T16:58:25.730018+0000","last_became_peered":"2024-09-12T16:58:25.730018+0000","last_unstale":"2024-09-12T17:39:32.549144+0000","last_undegraded":"2024-09-12T17:39:32.549144+0000","last_fullsized":"2024-09-12T17:39:32.549144+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:14.303705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":134,"num_read_kb":123,"num_write":96,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"265'782","reported_seq":2344,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:31.891910+0000","last_change":"2024-09-12T16:58:27.747091+0000","last_active":"2024-09-12T17:41:31.891910+0000","last_peered":"2024-09-12T17:41:31.891910+0000","last_clean":"2024-09-12T17:41:31.891910+0000","last_became_active":"2024-09-12T16:58:27.746177+0000","last_became_peered":"2024-09-12T16:58:27.746177+0000","last_unstale":"2024-09-12T17:41:31.891910+0000","last_undegraded":"2024-09-12T17:41:31.891910+0000","last_fullsized":"2024-09-12T17:41:31.891910+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:44:59.636233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"265'168","reported_seq":662,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:26.453883+0000","last_change":"2024-09-12T16:58:29.791161+0000","last_active":"2024-09-12T17:39:26.453883+0000","last_peered":"2024-09-12T17:39:26.453883+0000","last_clean":"2024-09-12T17:39:26.453883+0000","last_became_active":"2024-09-12T16:58:29.790535+0000","last_became_peered":"2024-09-12T16:58:29.790535+0000","last_unstale":"2024-09-12T17:39:26.453883+0000","last_undegraded":"2024-09-12T17:39:26.453883+0000","last_fullsized":"2024-09-12T17:39:26.453883+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:22:58.632183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":476,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":147,"num_read_kb":144,"num_write":393,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"265'96","reported_seq":660,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:46.106322+0000","last_change":"2024-09-12T16:58:21.702014+0000","last_active":"2024-09-12T17:38:46.106322+0000","last_peered":"2024-09-12T17:38:46.106322+0000","last_clean":"2024-09-12T17:38:46.106322+0000","last_became_active":"2024-09-12T16:58:21.701206+0000","last_became_peered":"2024-09-12T16:58:21.701206+0000","last_unstale":"2024-09-12T17:38:46.106322+0000","last_undegraded":"2024-09-12T17:38:46.106322+0000","last_fullsized":"2024-09-12T17:38:46.106322+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:06.784285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":405,"num_read_kb":331,"num_write":157,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"265'312","reported_seq":968,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.370987+0000","last_change":"2024-09-12T16:58:18.702748+0000","last_active":"2024-09-12T17:41:32.370987+0000","last_peered":"2024-09-12T17:41:32.370987+0000","last_clean":"2024-09-12T17:41:32.370987+0000","last_became_active":"2024-09-12T16:58:18.701270+0000","last_became_peered":"2024-09-12T16:58:18.701270+0000","last_unstale":"2024-09-12T17:41:32.370987+0000","last_undegraded":"2024-09-12T17:41:32.370987+0000","last_fullsized":"2024-09-12T17:41:32.370987+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:08.345573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6689697,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":520,"num_read_kb":17292,"num_write":1077,"num_write_kb":31476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":521,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:21.311776+0000","last_change":"2024-09-12T16:58:10.537187+0000","last_active":"2024-09-12T17:39:21.311776+0000","last_peered":"2024-09-12T17:39:21.311776+0000","last_clean":"2024-09-12T17:39:21.311776+0000","last_became_active":"2024-09-12T16:58:08.546519+0000","last_became_peered":"2024-09-12T16:58:08.546519+0000","last_unstale":"2024-09-12T17:39:21.311776+0000","last_undegraded":"2024-09-12T17:39:21.311776+0000","last_fullsized":"2024-09-12T17:39:21.311776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_clean_scrub_stamp":"2024-09-12T16:58:07.519706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:11.277662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088376600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:37.358927+0000","last_change":"2024-09-12T16:58:23.707506+0000","last_active":"2024-09-12T17:38:37.358927+0000","last_peered":"2024-09-12T17:38:37.358927+0000","last_clean":"2024-09-12T17:38:37.358927+0000","last_became_active":"2024-09-12T16:58:23.707022+0000","last_became_peered":"2024-09-12T16:58:23.707022+0000","last_unstale":"2024-09-12T17:38:37.358927+0000","last_undegraded":"2024-09-12T17:38:37.358927+0000","last_fullsized":"2024-09-12T17:38:37.358927+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:09.125943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"265'726","reported_seq":1428,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:24.843036+0000","last_change":"2024-09-12T16:58:25.949990+0000","last_active":"2024-09-12T17:41:24.843036+0000","last_peered":"2024-09-12T17:41:24.843036+0000","last_clean":"2024-09-12T17:41:24.843036+0000","last_became_active":"2024-09-12T16:58:25.949263+0000","last_became_peered":"2024-09-12T16:58:25.949263+0000","last_unstale":"2024-09-12T17:41:24.843036+0000","last_undegraded":"2024-09-12T17:41:24.843036+0000","last_fullsized":"2024-09-12T17:41:24.843036+0000","mapping_epoch":30,"log_start":"265'700","ondisk_log_start":"265'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":700,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:06.590619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177447,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1291,"num_read_kb":2791,"num_write":1072,"num_write_kb":912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:02.350591+0000","last_change":"2024-09-12T16:58:27.742543+0000","last_active":"2024-09-12T17:38:02.350591+0000","last_peered":"2024-09-12T17:38:02.350591+0000","last_clean":"2024-09-12T17:38:02.350591+0000","last_became_active":"2024-09-12T16:58:27.741779+0000","last_became_peered":"2024-09-12T16:58:27.741779+0000","last_unstale":"2024-09-12T17:38:02.350591+0000","last_undegraded":"2024-09-12T17:38:02.350591+0000","last_fullsized":"2024-09-12T17:38:02.350591+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:32.725498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"265'144","reported_seq":646,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:04.962585+0000","last_change":"2024-09-12T16:58:29.788557+0000","last_active":"2024-09-12T17:40:04.962585+0000","last_peered":"2024-09-12T17:40:04.962585+0000","last_clean":"2024-09-12T17:40:04.962585+0000","last_became_active":"2024-09-12T16:58:29.787692+0000","last_became_peered":"2024-09-12T16:58:29.787692+0000","last_unstale":"2024-09-12T17:40:04.962585+0000","last_undegraded":"2024-09-12T17:40:04.962585+0000","last_fullsized":"2024-09-12T17:40:04.962585+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:15.861385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":218,"num_read_kb":207,"num_write":364,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"265'162","reported_seq":712,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:05.120577+0000","last_change":"2024-09-12T16:58:29.785185+0000","last_active":"2024-09-12T17:40:05.120577+0000","last_peered":"2024-09-12T17:40:05.120577+0000","last_clean":"2024-09-12T17:40:05.120577+0000","last_became_active":"2024-09-12T16:58:29.782784+0000","last_became_peered":"2024-09-12T16:58:29.782784+0000","last_unstale":"2024-09-12T17:40:05.120577+0000","last_undegraded":"2024-09-12T17:40:05.120577+0000","last_fullsized":"2024-09-12T17:40:05.120577+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:48.171949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":629,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":266,"num_read_kb":264,"num_write":397,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"265'100","reported_seq":687,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:37.730070+0000","last_change":"2024-09-12T16:58:21.732323+0000","last_active":"2024-09-12T17:39:37.730070+0000","last_peered":"2024-09-12T17:39:37.730070+0000","last_clean":"2024-09-12T17:39:37.730070+0000","last_became_active":"2024-09-12T16:58:21.731509+0000","last_became_peered":"2024-09-12T16:58:21.731509+0000","last_unstale":"2024-09-12T17:39:37.730070+0000","last_undegraded":"2024-09-12T17:39:37.730070+0000","last_fullsized":"2024-09-12T17:39:37.730070+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:40.822664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":445,"num_read_kb":375,"num_write":158,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"265'245","reported_seq":870,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:49.957292+0000","last_change":"2024-09-12T16:58:18.701223+0000","last_active":"2024-09-12T17:39:49.957292+0000","last_peered":"2024-09-12T17:39:49.957292+0000","last_clean":"2024-09-12T17:39:49.957292+0000","last_became_active":"2024-09-12T16:58:18.700214+0000","last_became_peered":"2024-09-12T16:58:18.700214+0000","last_unstale":"2024-09-12T17:39:49.957292+0000","last_undegraded":"2024-09-12T17:39:49.957292+0000","last_fullsized":"2024-09-12T17:39:49.957292+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:13.616837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2635297,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":418,"num_read_kb":3767,"num_write":988,"num_write_kb":19533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:08.694880+0000","last_change":"2024-09-12T16:58:23.725522+0000","last_active":"2024-09-12T17:38:08.694880+0000","last_peered":"2024-09-12T17:38:08.694880+0000","last_clean":"2024-09-12T17:38:08.694880+0000","last_became_active":"2024-09-12T16:58:23.725034+0000","last_became_peered":"2024-09-12T16:58:23.725034+0000","last_unstale":"2024-09-12T17:38:08.694880+0000","last_undegraded":"2024-09-12T17:38:08.694880+0000","last_fullsized":"2024-09-12T17:38:08.694880+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:15.538364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"265'268","reported_seq":838,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:24.880266+0000","last_change":"2024-09-12T16:58:25.738410+0000","last_active":"2024-09-12T17:41:24.880266+0000","last_peered":"2024-09-12T17:41:24.880266+0000","last_clean":"2024-09-12T17:41:24.880266+0000","last_became_active":"2024-09-12T16:58:25.737706+0000","last_became_peered":"2024-09-12T16:58:25.737706+0000","last_unstale":"2024-09-12T17:41:24.880266+0000","last_undegraded":"2024-09-12T17:41:24.880266+0000","last_fullsized":"2024-09-12T17:41:24.880266+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:02:12.766927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58506,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":438,"num_read_kb":920,"num_write":360,"num_write_kb":290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:07.351743+0000","last_change":"2024-09-12T16:58:27.746931+0000","last_active":"2024-09-12T17:38:07.351743+0000","last_peered":"2024-09-12T17:38:07.351743+0000","last_clean":"2024-09-12T17:38:07.351743+0000","last_became_active":"2024-09-12T16:58:27.746143+0000","last_became_peered":"2024-09-12T16:58:27.746143+0000","last_unstale":"2024-09-12T17:38:07.351743+0000","last_undegraded":"2024-09-12T17:38:07.351743+0000","last_fullsized":"2024-09-12T17:38:07.351743+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:38.513197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"265'116","reported_seq":626,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:57.572381+0000","last_change":"2024-09-12T16:58:29.786922+0000","last_active":"2024-09-12T17:38:57.572381+0000","last_peered":"2024-09-12T17:38:57.572381+0000","last_clean":"2024-09-12T17:38:57.572381+0000","last_became_active":"2024-09-12T16:58:29.784143+0000","last_became_peered":"2024-09-12T16:58:29.784143+0000","last_unstale":"2024-09-12T17:38:57.572381+0000","last_undegraded":"2024-09-12T17:38:57.572381+0000","last_fullsized":"2024-09-12T17:38:57.572381+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:57.768618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":186,"num_write":283,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"265'174","reported_seq":827,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:47.685307+0000","last_change":"2024-09-12T16:58:21.715883+0000","last_active":"2024-09-12T17:39:47.685307+0000","last_peered":"2024-09-12T17:39:47.685307+0000","last_clean":"2024-09-12T17:39:47.685307+0000","last_became_active":"2024-09-12T16:58:21.715193+0000","last_became_peered":"2024-09-12T16:58:21.715193+0000","last_unstale":"2024-09-12T17:39:47.685307+0000","last_undegraded":"2024-09-12T17:39:47.685307+0000","last_fullsized":"2024-09-12T17:39:47.685307+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:10.766328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":752,"num_read_kb":633,"num_write":248,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"265'285","reported_seq":912,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:36.521893+0000","last_change":"2024-09-12T16:58:18.686877+0000","last_active":"2024-09-12T17:39:36.521893+0000","last_peered":"2024-09-12T17:39:36.521893+0000","last_clean":"2024-09-12T17:39:36.521893+0000","last_became_active":"2024-09-12T16:58:18.686155+0000","last_became_peered":"2024-09-12T16:58:18.686155+0000","last_unstale":"2024-09-12T17:39:36.521893+0000","last_undegraded":"2024-09-12T17:39:36.521893+0000","last_fullsized":"2024-09-12T17:39:36.521893+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:04.515838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8761417,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":474,"num_read_kb":20889,"num_write":963,"num_write_kb":24291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:07.351964+0000","last_change":"2024-09-12T16:58:23.713527+0000","last_active":"2024-09-12T17:38:07.351964+0000","last_peered":"2024-09-12T17:38:07.351964+0000","last_clean":"2024-09-12T17:38:07.351964+0000","last_became_active":"2024-09-12T16:58:23.713069+0000","last_became_peered":"2024-09-12T16:58:23.713069+0000","last_unstale":"2024-09-12T17:38:07.351964+0000","last_undegraded":"2024-09-12T17:38:07.351964+0000","last_fullsized":"2024-09-12T17:38:07.351964+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:22.939725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"265'35","reported_seq":534,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:25.845238+0000","last_change":"2024-09-12T16:58:25.731248+0000","last_active":"2024-09-12T17:39:25.845238+0000","last_peered":"2024-09-12T17:39:25.845238+0000","last_clean":"2024-09-12T17:39:25.845238+0000","last_became_active":"2024-09-12T16:58:25.730410+0000","last_became_peered":"2024-09-12T16:58:25.730410+0000","last_unstale":"2024-09-12T17:39:25.845238+0000","last_undegraded":"2024-09-12T17:39:25.845238+0000","last_fullsized":"2024-09-12T17:39:25.845238+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:19.441232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:11.303833+0000","last_change":"2024-09-12T16:58:27.743749+0000","last_active":"2024-09-12T17:38:11.303833+0000","last_peered":"2024-09-12T17:38:11.303833+0000","last_clean":"2024-09-12T17:38:11.303833+0000","last_became_active":"2024-09-12T16:58:27.742979+0000","last_became_peered":"2024-09-12T16:58:27.742979+0000","last_unstale":"2024-09-12T17:38:11.303833+0000","last_undegraded":"2024-09-12T17:38:11.303833+0000","last_fullsized":"2024-09-12T17:38:11.303833+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:29.367350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"265'208","reported_seq":728,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:04.410688+0000","last_change":"2024-09-12T16:58:29.782903+0000","last_active":"2024-09-12T17:40:04.410688+0000","last_peered":"2024-09-12T17:40:04.410688+0000","last_clean":"2024-09-12T17:40:04.410688+0000","last_became_active":"2024-09-12T16:58:29.782024+0000","last_became_peered":"2024-09-12T16:58:29.782024+0000","last_unstale":"2024-09-12T17:40:04.410688+0000","last_undegraded":"2024-09-12T17:40:04.410688+0000","last_fullsized":"2024-09-12T17:40:04.410688+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:51.452618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":358,"num_read_kb":350,"num_write":466,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"265'521","reported_seq":1253,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:02.350548+0000","last_change":"2024-09-12T16:58:21.712078+0000","last_active":"2024-09-12T17:38:02.350548+0000","last_peered":"2024-09-12T17:38:02.350548+0000","last_clean":"2024-09-12T17:38:02.350548+0000","last_became_active":"2024-09-12T16:58:21.711637+0000","last_became_peered":"2024-09-12T16:58:21.711637+0000","last_unstale":"2024-09-12T17:38:02.350548+0000","last_undegraded":"2024-09-12T17:38:02.350548+0000","last_fullsized":"2024-09-12T17:38:02.350548+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":500,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:57.113912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2547,"num_read_kb":2246,"num_write":971,"num_write_kb":585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"265'302","reported_seq":904,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:52.101304+0000","last_change":"2024-09-12T16:58:55.852662+0000","last_active":"2024-09-12T17:39:52.101304+0000","last_peered":"2024-09-12T17:39:52.101304+0000","last_clean":"2024-09-12T17:39:52.101304+0000","last_became_active":"2024-09-12T16:58:55.851886+0000","last_became_peered":"2024-09-12T16:58:55.851886+0000","last_unstale":"2024-09-12T17:39:52.101304+0000","last_undegraded":"2024-09-12T17:39:52.101304+0000","last_fullsized":"2024-09-12T17:39:52.101304+0000","mapping_epoch":37,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:44.817591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5940266,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":435,"num_read_kb":19428,"num_write":1151,"num_write_kb":23867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:06.302568+0000","last_change":"2024-09-12T16:58:23.718833+0000","last_active":"2024-09-12T17:38:06.302568+0000","last_peered":"2024-09-12T17:38:06.302568+0000","last_clean":"2024-09-12T17:38:06.302568+0000","last_became_active":"2024-09-12T16:58:23.718109+0000","last_became_peered":"2024-09-12T16:58:23.718109+0000","last_unstale":"2024-09-12T17:38:06.302568+0000","last_undegraded":"2024-09-12T17:38:06.302568+0000","last_fullsized":"2024-09-12T17:38:06.302568+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:01.727111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"265'311","reported_seq":902,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.393549+0000","last_change":"2024-09-12T16:58:25.739863+0000","last_active":"2024-09-12T17:41:32.393549+0000","last_peered":"2024-09-12T17:41:32.393549+0000","last_clean":"2024-09-12T17:41:32.393549+0000","last_became_active":"2024-09-12T16:58:25.738463+0000","last_became_peered":"2024-09-12T16:58:25.738463+0000","last_unstale":"2024-09-12T17:41:32.393549+0000","last_undegraded":"2024-09-12T17:41:32.393549+0000","last_fullsized":"2024-09-12T17:41:32.393549+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:48.664021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46394,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":527,"num_read_kb":1194,"num_write":426,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:11.296562+0000","last_change":"2024-09-12T16:58:27.760862+0000","last_active":"2024-09-12T17:38:11.296562+0000","last_peered":"2024-09-12T17:38:11.296562+0000","last_clean":"2024-09-12T17:38:11.296562+0000","last_became_active":"2024-09-12T16:58:27.760265+0000","last_became_peered":"2024-09-12T16:58:27.760265+0000","last_unstale":"2024-09-12T17:38:11.296562+0000","last_undegraded":"2024-09-12T17:38:11.296562+0000","last_fullsized":"2024-09-12T17:38:11.296562+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:32.912040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"265'144","reported_seq":673,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:21.515529+0000","last_change":"2024-09-12T16:58:29.777889+0000","last_active":"2024-09-12T17:39:21.515529+0000","last_peered":"2024-09-12T17:39:21.515529+0000","last_clean":"2024-09-12T17:39:21.515529+0000","last_became_active":"2024-09-12T16:58:29.776448+0000","last_became_peered":"2024-09-12T16:58:29.776448+0000","last_unstale":"2024-09-12T17:39:21.515529+0000","last_undegraded":"2024-09-12T17:39:21.515529+0000","last_fullsized":"2024-09-12T17:39:21.515529+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:41.421501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":253,"num_read_kb":229,"num_write":261,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"265'251","reported_seq":879,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:22.384616+0000","last_change":"2024-09-12T16:58:21.706067+0000","last_active":"2024-09-12T17:40:22.384616+0000","last_peered":"2024-09-12T17:40:22.384616+0000","last_clean":"2024-09-12T17:40:22.384616+0000","last_became_active":"2024-09-12T16:58:21.705619+0000","last_became_peered":"2024-09-12T16:58:21.705619+0000","last_unstale":"2024-09-12T17:40:22.384616+0000","last_undegraded":"2024-09-12T17:40:22.384616+0000","last_fullsized":"2024-09-12T17:40:22.384616+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:17.879048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1131,"num_read_kb":917,"num_write":399,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"265'266","reported_seq":910,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.330134+0000","last_change":"2024-09-12T16:58:18.701775+0000","last_active":"2024-09-12T17:41:32.330134+0000","last_peered":"2024-09-12T17:41:32.330134+0000","last_clean":"2024-09-12T17:41:32.330134+0000","last_became_active":"2024-09-12T16:58:18.700720+0000","last_became_peered":"2024-09-12T16:58:18.700720+0000","last_unstale":"2024-09-12T17:41:32.330134+0000","last_undegraded":"2024-09-12T17:41:32.330134+0000","last_fullsized":"2024-09-12T17:41:32.330134+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:37.311441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":747088,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":378,"num_read_kb":68507,"num_write":893,"num_write_kb":27085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:06.295440+0000","last_change":"2024-09-12T16:58:23.721747+0000","last_active":"2024-09-12T17:38:06.295440+0000","last_peered":"2024-09-12T17:38:06.295440+0000","last_clean":"2024-09-12T17:38:06.295440+0000","last_became_active":"2024-09-12T16:58:23.721005+0000","last_became_peered":"2024-09-12T16:58:23.721005+0000","last_unstale":"2024-09-12T17:38:06.295440+0000","last_undegraded":"2024-09-12T17:38:06.295440+0000","last_fullsized":"2024-09-12T17:38:06.295440+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:29.561235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"265'241","reported_seq":803,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:26.336535+0000","last_change":"2024-09-12T16:58:25.733878+0000","last_active":"2024-09-12T17:40:26.336535+0000","last_peered":"2024-09-12T17:40:26.336535+0000","last_clean":"2024-09-12T17:40:26.336535+0000","last_became_active":"2024-09-12T16:58:25.732956+0000","last_became_peered":"2024-09-12T16:58:25.732956+0000","last_unstale":"2024-09-12T17:40:26.336535+0000","last_undegraded":"2024-09-12T17:40:26.336535+0000","last_fullsized":"2024-09-12T17:40:26.336535+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:50:45.059874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":402,"num_read_kb":847,"num_write":328,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:07.348165+0000","last_change":"2024-09-12T16:58:27.747511+0000","last_active":"2024-09-12T17:38:07.348165+0000","last_peered":"2024-09-12T17:38:07.348165+0000","last_clean":"2024-09-12T17:38:07.348165+0000","last_became_active":"2024-09-12T16:58:27.737089+0000","last_became_peered":"2024-09-12T16:58:27.737089+0000","last_unstale":"2024-09-12T17:38:07.348165+0000","last_undegraded":"2024-09-12T17:38:07.348165+0000","last_fullsized":"2024-09-12T17:38:07.348165+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:38.515071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"265'132","reported_seq":778,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:45.573465+0000","last_change":"2024-09-12T16:58:21.717882+0000","last_active":"2024-09-12T17:39:45.573465+0000","last_peered":"2024-09-12T17:39:45.573465+0000","last_clean":"2024-09-12T17:39:45.573465+0000","last_became_active":"2024-09-12T16:58:21.717079+0000","last_became_peered":"2024-09-12T16:58:21.717079+0000","last_unstale":"2024-09-12T17:39:45.573465+0000","last_undegraded":"2024-09-12T17:39:45.573465+0000","last_fullsized":"2024-09-12T17:39:45.573465+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:23.381407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":593,"num_read_kb":510,"num_write":185,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"265'291","reported_seq":927,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.364936+0000","last_change":"2024-09-12T16:58:18.677827+0000","last_active":"2024-09-12T17:41:32.364936+0000","last_peered":"2024-09-12T17:41:32.364936+0000","last_clean":"2024-09-12T17:41:32.364936+0000","last_became_active":"2024-09-12T16:58:18.677480+0000","last_became_peered":"2024-09-12T16:58:18.677480+0000","last_unstale":"2024-09-12T17:41:32.364936+0000","last_undegraded":"2024-09-12T17:41:32.364936+0000","last_fullsized":"2024-09-12T17:41:32.364936+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:38.035768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5638326,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":412,"num_read_kb":21305,"num_write":1067,"num_write_kb":20049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:37.355462+0000","last_change":"2024-09-12T16:58:23.719669+0000","last_active":"2024-09-12T17:38:37.355462+0000","last_peered":"2024-09-12T17:38:37.355462+0000","last_clean":"2024-09-12T17:38:37.355462+0000","last_became_active":"2024-09-12T16:58:23.719039+0000","last_became_peered":"2024-09-12T16:58:23.719039+0000","last_unstale":"2024-09-12T17:38:37.355462+0000","last_undegraded":"2024-09-12T17:38:37.355462+0000","last_fullsized":"2024-09-12T17:38:37.355462+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:00.880364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"265'471","reported_seq":1098,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.092416+0000","last_change":"2024-09-12T16:58:25.720911+0000","last_active":"2024-09-12T17:41:33.092416+0000","last_peered":"2024-09-12T17:41:33.092416+0000","last_clean":"2024-09-12T17:41:33.092416+0000","last_became_active":"2024-09-12T16:58:25.720165+0000","last_became_peered":"2024-09-12T16:58:25.720165+0000","last_unstale":"2024-09-12T17:41:33.092416+0000","last_undegraded":"2024-09-12T17:41:33.092416+0000","last_fullsized":"2024-09-12T17:41:33.092416+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:01.154748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97109,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":819,"num_read_kb":1920,"num_write":702,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:27.338321+0000","last_change":"2024-09-12T16:58:27.750193+0000","last_active":"2024-09-12T17:38:27.338321+0000","last_peered":"2024-09-12T17:38:27.338321+0000","last_clean":"2024-09-12T17:38:27.338321+0000","last_became_active":"2024-09-12T16:58:27.749390+0000","last_became_peered":"2024-09-12T16:58:27.749390+0000","last_unstale":"2024-09-12T17:38:27.338321+0000","last_undegraded":"2024-09-12T17:38:27.338321+0000","last_fullsized":"2024-09-12T17:38:27.338321+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:54.523888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"265'184","reported_seq":732,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:45.266732+0000","last_change":"2024-09-12T16:58:29.789122+0000","last_active":"2024-09-12T17:39:45.266732+0000","last_peered":"2024-09-12T17:39:45.266732+0000","last_clean":"2024-09-12T17:39:45.266732+0000","last_became_active":"2024-09-12T16:58:29.788460+0000","last_became_peered":"2024-09-12T16:58:29.788460+0000","last_unstale":"2024-09-12T17:39:45.266732+0000","last_undegraded":"2024-09-12T17:39:45.266732+0000","last_fullsized":"2024-09-12T17:39:45.266732+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:40.064167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":436,"num_read_kb":400,"num_write":425,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"265'128","reported_seq":737,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:37.856071+0000","last_change":"2024-09-12T16:58:21.724434+0000","last_active":"2024-09-12T17:38:37.856071+0000","last_peered":"2024-09-12T17:38:37.856071+0000","last_clean":"2024-09-12T17:38:37.856071+0000","last_became_active":"2024-09-12T16:58:21.724003+0000","last_became_peered":"2024-09-12T16:58:21.724003+0000","last_unstale":"2024-09-12T17:38:37.856071+0000","last_undegraded":"2024-09-12T17:38:37.856071+0000","last_fullsized":"2024-09-12T17:38:37.856071+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:30.276259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":616,"num_read_kb":520,"num_write":198,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"265'371","reported_seq":1061,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.307669+0000","last_change":"2024-09-12T16:58:18.707166+0000","last_active":"2024-09-12T17:41:33.307669+0000","last_peered":"2024-09-12T17:41:33.307669+0000","last_clean":"2024-09-12T17:41:33.307669+0000","last_became_active":"2024-09-12T16:58:18.706806+0000","last_became_peered":"2024-09-12T16:58:18.706806+0000","last_unstale":"2024-09-12T17:41:33.307669+0000","last_undegraded":"2024-09-12T17:41:33.307669+0000","last_fullsized":"2024-09-12T17:41:33.307669+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:51.584155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2005288,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":606,"num_read_kb":18575,"num_write":1246,"num_write_kb":49050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:01.294381+0000","last_change":"2024-09-12T16:58:23.721449+0000","last_active":"2024-09-12T17:38:01.294381+0000","last_peered":"2024-09-12T17:38:01.294381+0000","last_clean":"2024-09-12T17:38:01.294381+0000","last_became_active":"2024-09-12T16:58:23.720654+0000","last_became_peered":"2024-09-12T16:58:23.720654+0000","last_unstale":"2024-09-12T17:38:01.294381+0000","last_undegraded":"2024-09-12T17:38:01.294381+0000","last_fullsized":"2024-09-12T17:38:01.294381+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:08.970300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"265'311","reported_seq":887,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:56.343480+0000","last_change":"2024-09-12T16:58:25.734439+0000","last_active":"2024-09-12T17:40:56.343480+0000","last_peered":"2024-09-12T17:40:56.343480+0000","last_clean":"2024-09-12T17:40:56.343480+0000","last_became_active":"2024-09-12T16:58:25.733241+0000","last_became_peered":"2024-09-12T16:58:25.733241+0000","last_unstale":"2024-09-12T17:40:56.343480+0000","last_undegraded":"2024-09-12T17:40:56.343480+0000","last_fullsized":"2024-09-12T17:40:56.343480+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:46.538919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62402,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":505,"num_read_kb":1018,"num_write":428,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:28.699837+0000","last_change":"2024-09-12T16:58:27.751196+0000","last_active":"2024-09-12T17:38:28.699837+0000","last_peered":"2024-09-12T17:38:28.699837+0000","last_clean":"2024-09-12T17:38:28.699837+0000","last_became_active":"2024-09-12T16:58:27.750328+0000","last_became_peered":"2024-09-12T16:58:27.750328+0000","last_unstale":"2024-09-12T17:38:28.699837+0000","last_undegraded":"2024-09-12T17:38:28.699837+0000","last_fullsized":"2024-09-12T17:38:28.699837+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:06.616801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"265'181","reported_seq":680,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:04.425931+0000","last_change":"2024-09-12T16:58:29.777915+0000","last_active":"2024-09-12T17:40:04.425931+0000","last_peered":"2024-09-12T17:40:04.425931+0000","last_clean":"2024-09-12T17:40:04.425931+0000","last_became_active":"2024-09-12T16:58:29.777124+0000","last_became_peered":"2024-09-12T16:58:29.777124+0000","last_unstale":"2024-09-12T17:40:04.425931+0000","last_undegraded":"2024-09-12T17:40:04.425931+0000","last_fullsized":"2024-09-12T17:40:04.425931+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:43.622054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1215,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":228,"num_read_kb":227,"num_write":517,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"265'162","reported_seq":766,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:50.195600+0000","last_change":"2024-09-12T16:58:21.698980+0000","last_active":"2024-09-12T17:39:50.195600+0000","last_peered":"2024-09-12T17:39:50.195600+0000","last_clean":"2024-09-12T17:39:50.195600+0000","last_became_active":"2024-09-12T16:58:21.698565+0000","last_became_peered":"2024-09-12T16:58:21.698565+0000","last_unstale":"2024-09-12T17:39:50.195600+0000","last_undegraded":"2024-09-12T17:39:50.195600+0000","last_fullsized":"2024-09-12T17:39:50.195600+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:53.075338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":649,"num_read_kb":535,"num_write":267,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"265'271","reported_seq":920,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:29.247539+0000","last_change":"2024-09-12T16:58:18.701060+0000","last_active":"2024-09-12T17:38:29.247539+0000","last_peered":"2024-09-12T17:38:29.247539+0000","last_clean":"2024-09-12T17:38:29.247539+0000","last_became_active":"2024-09-12T16:58:18.700196+0000","last_became_peered":"2024-09-12T16:58:18.700196+0000","last_unstale":"2024-09-12T17:38:29.247539+0000","last_undegraded":"2024-09-12T17:38:29.247539+0000","last_fullsized":"2024-09-12T17:38:29.247539+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:18.696858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8463330,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":452,"num_read_kb":4020,"num_write":1020,"num_write_kb":21150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:26.284203+0000","last_change":"2024-09-12T16:58:23.703516+0000","last_active":"2024-09-12T17:38:26.284203+0000","last_peered":"2024-09-12T17:38:26.284203+0000","last_clean":"2024-09-12T17:38:26.284203+0000","last_became_active":"2024-09-12T16:58:23.702293+0000","last_became_peered":"2024-09-12T16:58:23.702293+0000","last_unstale":"2024-09-12T17:38:26.284203+0000","last_undegraded":"2024-09-12T17:38:26.284203+0000","last_fullsized":"2024-09-12T17:38:26.284203+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:48.660513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"265'321","reported_seq":893,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:24.892490+0000","last_change":"2024-09-12T16:58:25.950771+0000","last_active":"2024-09-12T17:41:24.892490+0000","last_peered":"2024-09-12T17:41:24.892490+0000","last_clean":"2024-09-12T17:41:24.892490+0000","last_became_active":"2024-09-12T16:58:25.949883+0000","last_became_peered":"2024-09-12T16:58:25.949883+0000","last_unstale":"2024-09-12T17:41:24.892490+0000","last_undegraded":"2024-09-12T17:41:24.892490+0000","last_fullsized":"2024-09-12T17:41:24.892490+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:22.560848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64150,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":503,"num_read_kb":1034,"num_write":428,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:28.699909+0000","last_change":"2024-09-12T16:58:27.749008+0000","last_active":"2024-09-12T17:38:28.699909+0000","last_peered":"2024-09-12T17:38:28.699909+0000","last_clean":"2024-09-12T17:38:28.699909+0000","last_became_active":"2024-09-12T16:58:27.739965+0000","last_became_peered":"2024-09-12T16:58:27.739965+0000","last_unstale":"2024-09-12T17:38:28.699909+0000","last_undegraded":"2024-09-12T17:38:28.699909+0000","last_fullsized":"2024-09-12T17:38:28.699909+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:19.228861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"265'138","reported_seq":629,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:24.910801+0000","last_change":"2024-09-12T16:58:29.772039+0000","last_active":"2024-09-12T17:41:24.910801+0000","last_peered":"2024-09-12T17:41:24.910801+0000","last_clean":"2024-09-12T17:41:24.910801+0000","last_became_active":"2024-09-12T16:58:29.771267+0000","last_became_peered":"2024-09-12T16:58:29.771267+0000","last_unstale":"2024-09-12T17:41:24.910801+0000","last_undegraded":"2024-09-12T17:41:24.910801+0000","last_fullsized":"2024-09-12T17:41:24.910801+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:22.290183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":401,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":154,"num_write":321,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"265'82","reported_seq":686,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:23.736000+0000","last_change":"2024-09-12T16:58:21.730974+0000","last_active":"2024-09-12T17:41:23.736000+0000","last_peered":"2024-09-12T17:41:23.736000+0000","last_clean":"2024-09-12T17:41:23.736000+0000","last_became_active":"2024-09-12T16:58:21.730342+0000","last_became_peered":"2024-09-12T16:58:21.730342+0000","last_unstale":"2024-09-12T17:41:23.736000+0000","last_undegraded":"2024-09-12T17:41:23.736000+0000","last_fullsized":"2024-09-12T17:41:23.736000+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:08.283142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":417,"num_read_kb":364,"num_write":119,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"265'272","reported_seq":960,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.369585+0000","last_change":"2024-09-12T16:58:18.689099+0000","last_active":"2024-09-12T17:41:32.369585+0000","last_peered":"2024-09-12T17:41:32.369585+0000","last_clean":"2024-09-12T17:41:32.369585+0000","last_became_active":"2024-09-12T16:58:18.688773+0000","last_became_peered":"2024-09-12T16:58:18.688773+0000","last_unstale":"2024-09-12T17:41:32.369585+0000","last_undegraded":"2024-09-12T17:41:32.369585+0000","last_fullsized":"2024-09-12T17:41:32.369585+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:33.745654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12614235,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":529,"num_read_kb":43210,"num_write":999,"num_write_kb":32802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:28.699789+0000","last_change":"2024-09-12T16:58:23.709450+0000","last_active":"2024-09-12T17:38:28.699789+0000","last_peered":"2024-09-12T17:38:28.699789+0000","last_clean":"2024-09-12T17:38:28.699789+0000","last_became_active":"2024-09-12T16:58:23.709009+0000","last_became_peered":"2024-09-12T16:58:23.709009+0000","last_unstale":"2024-09-12T17:38:28.699789+0000","last_undegraded":"2024-09-12T17:38:28.699789+0000","last_fullsized":"2024-09-12T17:38:28.699789+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:45.138172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"265'88","reported_seq":608,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:22.509004+0000","last_change":"2024-09-12T16:58:25.950055+0000","last_active":"2024-09-12T17:39:22.509004+0000","last_peered":"2024-09-12T17:39:22.509004+0000","last_clean":"2024-09-12T17:39:22.509004+0000","last_became_active":"2024-09-12T16:58:25.949196+0000","last_became_peered":"2024-09-12T16:58:25.949196+0000","last_unstale":"2024-09-12T17:39:22.509004+0000","last_undegraded":"2024-09-12T17:39:22.509004+0000","last_fullsized":"2024-09-12T17:39:22.509004+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:18:17.202967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":122,"num_read_kb":116,"num_write":142,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"265'754","reported_seq":2150,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:25.115187+0000","last_change":"2024-09-12T16:58:27.741265+0000","last_active":"2024-09-12T17:41:25.115187+0000","last_peered":"2024-09-12T17:41:25.115187+0000","last_clean":"2024-09-12T17:41:25.115187+0000","last_became_active":"2024-09-12T16:58:27.740416+0000","last_became_peered":"2024-09-12T16:58:27.740416+0000","last_unstale":"2024-09-12T17:41:25.115187+0000","last_undegraded":"2024-09-12T17:41:25.115187+0000","last_fullsized":"2024-09-12T17:41:25.115187+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:32.112107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"265'129","reported_seq":650,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:48.742930+0000","last_change":"2024-09-12T16:58:29.784795+0000","last_active":"2024-09-12T17:39:48.742930+0000","last_peered":"2024-09-12T17:39:48.742930+0000","last_clean":"2024-09-12T17:39:48.742930+0000","last_became_active":"2024-09-12T16:58:29.784128+0000","last_became_peered":"2024-09-12T16:58:29.784128+0000","last_unstale":"2024-09-12T17:39:48.742930+0000","last_undegraded":"2024-09-12T17:39:48.742930+0000","last_fullsized":"2024-09-12T17:39:48.742930+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:43.512905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":291,"num_read_kb":261,"num_write":354,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"265'159","reported_seq":754,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:46.951235+0000","last_change":"2024-09-12T16:58:21.701518+0000","last_active":"2024-09-12T17:39:46.951235+0000","last_peered":"2024-09-12T17:39:46.951235+0000","last_clean":"2024-09-12T17:39:46.951235+0000","last_became_active":"2024-09-12T16:58:21.700714+0000","last_became_peered":"2024-09-12T16:58:21.700714+0000","last_unstale":"2024-09-12T17:39:46.951235+0000","last_undegraded":"2024-09-12T17:39:46.951235+0000","last_fullsized":"2024-09-12T17:39:46.951235+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:00.095934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":716,"num_read_kb":600,"num_write":247,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"265'272","reported_seq":1024,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.364274+0000","last_change":"2024-09-12T16:58:18.706734+0000","last_active":"2024-09-12T17:41:32.364274+0000","last_peered":"2024-09-12T17:41:32.364274+0000","last_clean":"2024-09-12T17:41:32.364274+0000","last_became_active":"2024-09-12T16:58:18.706117+0000","last_became_peered":"2024-09-12T16:58:18.706117+0000","last_unstale":"2024-09-12T17:41:32.364274+0000","last_undegraded":"2024-09-12T17:41:32.364274+0000","last_fullsized":"2024-09-12T17:41:32.364274+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:11.952844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10067083,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":525,"num_read_kb":60034,"num_write":849,"num_write_kb":44854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:26.307328+0000","last_change":"2024-09-12T16:58:23.719072+0000","last_active":"2024-09-12T17:38:26.307328+0000","last_peered":"2024-09-12T17:38:26.307328+0000","last_clean":"2024-09-12T17:38:26.307328+0000","last_became_active":"2024-09-12T16:58:23.718211+0000","last_became_peered":"2024-09-12T16:58:23.718211+0000","last_unstale":"2024-09-12T17:38:26.307328+0000","last_undegraded":"2024-09-12T17:38:26.307328+0000","last_fullsized":"2024-09-12T17:38:26.307328+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:55.776100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"265'299","reported_seq":875,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:24.809083+0000","last_change":"2024-09-12T16:58:25.726107+0000","last_active":"2024-09-12T17:41:24.809083+0000","last_peered":"2024-09-12T17:41:24.809083+0000","last_clean":"2024-09-12T17:41:24.809083+0000","last_became_active":"2024-09-12T16:58:25.724774+0000","last_became_peered":"2024-09-12T16:58:25.724774+0000","last_unstale":"2024-09-12T17:41:24.809083+0000","last_undegraded":"2024-09-12T17:41:24.809083+0000","last_fullsized":"2024-09-12T17:41:24.809083+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:29.986764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55502,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":478,"num_read_kb":960,"num_write":388,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:07.334035+0000","last_change":"2024-09-12T16:58:27.759894+0000","last_active":"2024-09-12T17:37:07.334035+0000","last_peered":"2024-09-12T17:37:07.334035+0000","last_clean":"2024-09-12T17:37:07.334035+0000","last_became_active":"2024-09-12T16:58:27.755232+0000","last_became_peered":"2024-09-12T16:58:27.755232+0000","last_unstale":"2024-09-12T17:37:07.334035+0000","last_undegraded":"2024-09-12T17:37:07.334035+0000","last_fullsized":"2024-09-12T17:37:07.334035+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:26.735098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"265'133","reported_seq":645,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:04.245111+0000","last_change":"2024-09-12T16:58:29.782745+0000","last_active":"2024-09-12T17:40:04.245111+0000","last_peered":"2024-09-12T17:40:04.245111+0000","last_clean":"2024-09-12T17:40:04.245111+0000","last_became_active":"2024-09-12T16:58:29.782006+0000","last_became_peered":"2024-09-12T16:58:29.782006+0000","last_unstale":"2024-09-12T17:40:04.245111+0000","last_undegraded":"2024-09-12T17:40:04.245111+0000","last_fullsized":"2024-09-12T17:40:04.245111+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:25.299681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":784,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":248,"num_read_kb":225,"num_write":333,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"265'366","reported_seq":973,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:33.892514+0000","last_change":"2024-09-12T16:58:21.702476+0000","last_active":"2024-09-12T17:40:33.892514+0000","last_peered":"2024-09-12T17:40:33.892514+0000","last_clean":"2024-09-12T17:40:33.892514+0000","last_became_active":"2024-09-12T16:58:21.700909+0000","last_became_peered":"2024-09-12T16:58:21.700909+0000","last_unstale":"2024-09-12T17:40:33.892514+0000","last_undegraded":"2024-09-12T17:40:33.892514+0000","last_fullsized":"2024-09-12T17:40:33.892514+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:45.552412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1540,"num_read_kb":1221,"num_write":577,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"265'295","reported_seq":927,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.355530+0000","last_change":"2024-09-12T16:58:18.708114+0000","last_active":"2024-09-12T17:41:32.355530+0000","last_peered":"2024-09-12T17:41:32.355530+0000","last_clean":"2024-09-12T17:41:32.355530+0000","last_became_active":"2024-09-12T16:58:18.706197+0000","last_became_peered":"2024-09-12T16:58:18.706197+0000","last_unstale":"2024-09-12T17:41:32.355530+0000","last_undegraded":"2024-09-12T17:41:32.355530+0000","last_fullsized":"2024-09-12T17:41:32.355530+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:37.230857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18939560,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":491,"num_read_kb":18954,"num_write":1076,"num_write_kb":43009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:27.338265+0000","last_change":"2024-09-12T16:58:23.712080+0000","last_active":"2024-09-12T17:38:27.338265+0000","last_peered":"2024-09-12T17:38:27.338265+0000","last_clean":"2024-09-12T17:38:27.338265+0000","last_became_active":"2024-09-12T16:58:23.711307+0000","last_became_peered":"2024-09-12T16:58:23.711307+0000","last_unstale":"2024-09-12T17:38:27.338265+0000","last_undegraded":"2024-09-12T17:38:27.338265+0000","last_fullsized":"2024-09-12T17:38:27.338265+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:54.962283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"265'264","reported_seq":823,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:24.812396+0000","last_change":"2024-09-12T16:58:25.737271+0000","last_active":"2024-09-12T17:41:24.812396+0000","last_peered":"2024-09-12T17:41:24.812396+0000","last_clean":"2024-09-12T17:41:24.812396+0000","last_became_active":"2024-09-12T16:58:25.736507+0000","last_became_peered":"2024-09-12T16:58:25.736507+0000","last_unstale":"2024-09-12T17:41:24.812396+0000","last_undegraded":"2024-09-12T17:41:24.812396+0000","last_fullsized":"2024-09-12T17:41:24.812396+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:21.434839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54941,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":437,"num_read_kb":921,"num_write":364,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:16.284549+0000","last_change":"2024-09-12T16:58:27.741029+0000","last_active":"2024-09-12T17:37:16.284549+0000","last_peered":"2024-09-12T17:37:16.284549+0000","last_clean":"2024-09-12T17:37:16.284549+0000","last_became_active":"2024-09-12T16:58:27.740278+0000","last_became_peered":"2024-09-12T16:58:27.740278+0000","last_unstale":"2024-09-12T17:37:16.284549+0000","last_undegraded":"2024-09-12T17:37:16.284549+0000","last_fullsized":"2024-09-12T17:37:16.284549+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:39.408264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"265'124","reported_seq":655,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:01.044134+0000","last_change":"2024-09-12T16:58:29.786287+0000","last_active":"2024-09-12T17:40:01.044134+0000","last_peered":"2024-09-12T17:40:01.044134+0000","last_clean":"2024-09-12T17:40:01.044134+0000","last_became_active":"2024-09-12T16:58:29.783969+0000","last_became_peered":"2024-09-12T16:58:29.783969+0000","last_unstale":"2024-09-12T17:40:01.044134+0000","last_undegraded":"2024-09-12T17:40:01.044134+0000","last_fullsized":"2024-09-12T17:40:01.044134+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:00.910931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":564,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":235,"num_read_kb":216,"num_write":292,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"265'255","reported_seq":876,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:12.339198+0000","last_change":"2024-09-12T16:58:21.716389+0000","last_active":"2024-09-12T17:37:12.339198+0000","last_peered":"2024-09-12T17:37:12.339198+0000","last_clean":"2024-09-12T17:37:12.339198+0000","last_became_active":"2024-09-12T16:58:21.715884+0000","last_became_peered":"2024-09-12T16:58:21.715884+0000","last_unstale":"2024-09-12T17:37:12.339198+0000","last_undegraded":"2024-09-12T17:37:12.339198+0000","last_fullsized":"2024-09-12T17:37:12.339198+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:57.326871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1137,"num_read_kb":949,"num_write":435,"num_write_kb":255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"265'253","reported_seq":853,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.374895+0000","last_change":"2024-09-12T16:58:18.705301+0000","last_active":"2024-09-12T17:41:32.374895+0000","last_peered":"2024-09-12T17:41:32.374895+0000","last_clean":"2024-09-12T17:41:32.374895+0000","last_became_active":"2024-09-12T16:58:18.704103+0000","last_became_peered":"2024-09-12T16:58:18.704103+0000","last_unstale":"2024-09-12T17:41:32.374895+0000","last_undegraded":"2024-09-12T17:41:32.374895+0000","last_fullsized":"2024-09-12T17:41:32.374895+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:50.142551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4230017,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":309,"num_read_kb":15361,"num_write":836,"num_write_kb":40766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:06.265887+0000","last_change":"2024-09-12T16:58:23.714514+0000","last_active":"2024-09-12T17:37:06.265887+0000","last_peered":"2024-09-12T17:37:06.265887+0000","last_clean":"2024-09-12T17:37:06.265887+0000","last_became_active":"2024-09-12T16:58:23.713731+0000","last_became_peered":"2024-09-12T16:58:23.713731+0000","last_unstale":"2024-09-12T17:37:06.265887+0000","last_undegraded":"2024-09-12T17:37:06.265887+0000","last_fullsized":"2024-09-12T17:37:06.265887+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:09.365842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"265'221","reported_seq":775,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:24.886087+0000","last_change":"2024-09-12T16:58:25.728704+0000","last_active":"2024-09-12T17:41:24.886087+0000","last_peered":"2024-09-12T17:41:24.886087+0000","last_clean":"2024-09-12T17:41:24.886087+0000","last_became_active":"2024-09-12T16:58:25.727897+0000","last_became_peered":"2024-09-12T16:58:25.727897+0000","last_unstale":"2024-09-12T17:41:24.886087+0000","last_undegraded":"2024-09-12T17:41:24.886087+0000","last_fullsized":"2024-09-12T17:41:24.886087+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:09.542441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55194,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":361,"num_read_kb":801,"num_write":296,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:31.285213+0000","last_change":"2024-09-12T16:58:27.736505+0000","last_active":"2024-09-12T17:38:31.285213+0000","last_peered":"2024-09-12T17:38:31.285213+0000","last_clean":"2024-09-12T17:38:31.285213+0000","last_became_active":"2024-09-12T16:58:27.735625+0000","last_became_peered":"2024-09-12T16:58:27.735625+0000","last_unstale":"2024-09-12T17:38:31.285213+0000","last_undegraded":"2024-09-12T17:38:31.285213+0000","last_fullsized":"2024-09-12T17:38:31.285213+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:53.678377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"265'170","reported_seq":1636,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:02.955759+0000","last_change":"2024-09-12T16:58:29.797070+0000","last_active":"2024-09-12T17:40:02.955759+0000","last_peered":"2024-09-12T17:40:02.955759+0000","last_clean":"2024-09-12T17:40:02.955759+0000","last_became_active":"2024-09-12T16:58:29.796358+0000","last_became_peered":"2024-09-12T16:58:29.796358+0000","last_unstale":"2024-09-12T17:40:02.955759+0000","last_undegraded":"2024-09-12T17:40:02.955759+0000","last_fullsized":"2024-09-12T17:40:02.955759+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:36.721617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1235,"num_read_kb":1225,"num_write":375,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"265'197","reported_seq":825,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:30.960561+0000","last_change":"2024-09-12T16:58:21.730823+0000","last_active":"2024-09-12T17:39:30.960561+0000","last_peered":"2024-09-12T17:39:30.960561+0000","last_clean":"2024-09-12T17:39:30.960561+0000","last_became_active":"2024-09-12T16:58:21.730029+0000","last_became_peered":"2024-09-12T16:58:21.730029+0000","last_unstale":"2024-09-12T17:39:30.960561+0000","last_undegraded":"2024-09-12T17:39:30.960561+0000","last_fullsized":"2024-09-12T17:39:30.960561+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:44.982580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":873,"num_read_kb":717,"num_write":316,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"265'298","reported_seq":940,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.380905+0000","last_change":"2024-09-12T16:58:18.712626+0000","last_active":"2024-09-12T17:41:32.380905+0000","last_peered":"2024-09-12T17:41:32.380905+0000","last_clean":"2024-09-12T17:41:32.380905+0000","last_became_active":"2024-09-12T16:58:18.712291+0000","last_became_peered":"2024-09-12T16:58:18.712291+0000","last_unstale":"2024-09-12T17:41:32.380905+0000","last_undegraded":"2024-09-12T17:41:32.380905+0000","last_fullsized":"2024-09-12T17:41:32.380905+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:27.324406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11949576,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":378,"num_read_kb":103450,"num_write":975,"num_write_kb":48235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:08.681452+0000","last_change":"2024-09-12T16:58:23.725501+0000","last_active":"2024-09-12T17:37:08.681452+0000","last_peered":"2024-09-12T17:37:08.681452+0000","last_clean":"2024-09-12T17:37:08.681452+0000","last_became_active":"2024-09-12T16:58:23.724981+0000","last_became_peered":"2024-09-12T16:58:23.724981+0000","last_unstale":"2024-09-12T17:37:08.681452+0000","last_undegraded":"2024-09-12T17:37:08.681452+0000","last_fullsized":"2024-09-12T17:37:08.681452+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:14.754031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"265'294","reported_seq":872,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:56.317877+0000","last_change":"2024-09-12T16:58:25.719753+0000","last_active":"2024-09-12T17:40:56.317877+0000","last_peered":"2024-09-12T17:40:56.317877+0000","last_clean":"2024-09-12T17:40:56.317877+0000","last_became_active":"2024-09-12T16:58:25.718962+0000","last_became_peered":"2024-09-12T16:58:25.718962+0000","last_unstale":"2024-09-12T17:40:56.317877+0000","last_undegraded":"2024-09-12T17:40:56.317877+0000","last_fullsized":"2024-09-12T17:40:56.317877+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:19.374426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":467,"num_read_kb":939,"num_write":378,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:27.352877+0000","last_change":"2024-09-12T16:58:27.749233+0000","last_active":"2024-09-12T17:38:27.352877+0000","last_peered":"2024-09-12T17:38:27.352877+0000","last_clean":"2024-09-12T17:38:27.352877+0000","last_became_active":"2024-09-12T16:58:27.748503+0000","last_became_peered":"2024-09-12T16:58:27.748503+0000","last_unstale":"2024-09-12T17:38:27.352877+0000","last_undegraded":"2024-09-12T17:38:27.352877+0000","last_fullsized":"2024-09-12T17:38:27.352877+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:00.394978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"265'150","reported_seq":645,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:23.734437+0000","last_change":"2024-09-12T16:58:29.781039+0000","last_active":"2024-09-12T17:41:23.734437+0000","last_peered":"2024-09-12T17:41:23.734437+0000","last_clean":"2024-09-12T17:41:23.734437+0000","last_became_active":"2024-09-12T16:58:29.780363+0000","last_became_peered":"2024-09-12T16:58:29.780363+0000","last_unstale":"2024-09-12T17:41:23.734437+0000","last_undegraded":"2024-09-12T17:41:23.734437+0000","last_fullsized":"2024-09-12T17:41:23.734437+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:21.350835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":838,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":195,"num_read_kb":185,"num_write":368,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"265'45","reported_seq":599,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:36.003227+0000","last_change":"2024-09-12T16:58:21.728691+0000","last_active":"2024-09-12T17:39:36.003227+0000","last_peered":"2024-09-12T17:39:36.003227+0000","last_clean":"2024-09-12T17:39:36.003227+0000","last_became_active":"2024-09-12T16:58:21.728147+0000","last_became_peered":"2024-09-12T16:58:21.728147+0000","last_unstale":"2024-09-12T17:39:36.003227+0000","last_undegraded":"2024-09-12T17:39:36.003227+0000","last_fullsized":"2024-09-12T17:39:36.003227+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:29.002979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":172,"num_write":56,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"265'302","reported_seq":947,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:51.330408+0000","last_change":"2024-09-12T16:58:18.702412+0000","last_active":"2024-09-12T17:39:51.330408+0000","last_peered":"2024-09-12T17:39:51.330408+0000","last_clean":"2024-09-12T17:39:51.330408+0000","last_became_active":"2024-09-12T16:58:18.692788+0000","last_became_peered":"2024-09-12T16:58:18.692788+0000","last_unstale":"2024-09-12T17:39:51.330408+0000","last_undegraded":"2024-09-12T17:39:51.330408+0000","last_fullsized":"2024-09-12T17:39:51.330408+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:00.730133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703008,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":512,"num_read_kb":2229,"num_write":1149,"num_write_kb":12634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"265'159","reported_seq":772,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:42.258550+0000","last_change":"2024-09-12T16:58:21.727362+0000","last_active":"2024-09-12T17:38:42.258550+0000","last_peered":"2024-09-12T17:38:42.258550+0000","last_clean":"2024-09-12T17:38:42.258550+0000","last_became_active":"2024-09-12T16:58:21.726882+0000","last_became_peered":"2024-09-12T16:58:21.726882+0000","last_unstale":"2024-09-12T17:38:42.258550+0000","last_undegraded":"2024-09-12T17:38:42.258550+0000","last_fullsized":"2024-09-12T17:38:42.258550+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:28.927326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":734,"num_read_kb":607,"num_write":248,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"265'425","reported_seq":1152,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:18.516669+0000","last_change":"2024-09-12T16:58:18.694523+0000","last_active":"2024-09-12T17:41:18.516669+0000","last_peered":"2024-09-12T17:41:18.516669+0000","last_clean":"2024-09-12T17:41:18.516669+0000","last_became_active":"2024-09-12T16:58:18.693764+0000","last_became_peered":"2024-09-12T16:58:18.693764+0000","last_unstale":"2024-09-12T17:41:18.516669+0000","last_undegraded":"2024-09-12T17:41:18.516669+0000","last_fullsized":"2024-09-12T17:41:18.516669+0000","mapping_epoch":23,"log_start":"265'400","ondisk_log_start":"265'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:36.280676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7160847,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":858,"num_read_kb":32173,"num_write":1365,"num_write_kb":32850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"265'188","reported_seq":822,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:28.760907+0000","last_change":"2024-09-12T16:58:21.718536+0000","last_active":"2024-09-12T17:38:28.760907+0000","last_peered":"2024-09-12T17:38:28.760907+0000","last_clean":"2024-09-12T17:38:28.760907+0000","last_became_active":"2024-09-12T16:58:21.716793+0000","last_became_peered":"2024-09-12T16:58:21.716793+0000","last_unstale":"2024-09-12T17:38:28.760907+0000","last_undegraded":"2024-09-12T17:38:28.760907+0000","last_fullsized":"2024-09-12T17:38:28.760907+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:03.494777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":842,"num_read_kb":696,"num_write":281,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"265'325","reported_seq":945,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.363961+0000","last_change":"2024-09-12T16:58:18.712375+0000","last_active":"2024-09-12T17:41:32.363961+0000","last_peered":"2024-09-12T17:41:32.363961+0000","last_clean":"2024-09-12T17:41:32.363961+0000","last_became_active":"2024-09-12T16:58:18.711667+0000","last_became_peered":"2024-09-12T16:58:18.711667+0000","last_unstale":"2024-09-12T17:41:32.363961+0000","last_undegraded":"2024-09-12T17:41:32.363961+0000","last_fullsized":"2024-09-12T17:41:32.363961+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:10:09.706153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1125887,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":416,"num_read_kb":3457,"num_write":1146,"num_write_kb":27732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"265'217","reported_seq":854,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:58.757688+0000","last_change":"2024-09-12T16:58:21.714181+0000","last_active":"2024-09-12T17:38:58.757688+0000","last_peered":"2024-09-12T17:38:58.757688+0000","last_clean":"2024-09-12T17:38:58.757688+0000","last_became_active":"2024-09-12T16:58:21.713518+0000","last_became_peered":"2024-09-12T16:58:21.713518+0000","last_unstale":"2024-09-12T17:38:58.757688+0000","last_undegraded":"2024-09-12T17:38:58.757688+0000","last_fullsized":"2024-09-12T17:38:58.757688+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:57.295971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":958,"num_read_kb":791,"num_write":328,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"265'289","reported_seq":1030,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.372948+0000","last_change":"2024-09-12T16:58:18.711348+0000","last_active":"2024-09-12T17:41:32.372948+0000","last_peered":"2024-09-12T17:41:32.372948+0000","last_clean":"2024-09-12T17:41:32.372948+0000","last_became_active":"2024-09-12T16:58:18.711021+0000","last_became_peered":"2024-09-12T16:58:18.711021+0000","last_unstale":"2024-09-12T17:41:32.372948+0000","last_undegraded":"2024-09-12T17:41:32.372948+0000","last_fullsized":"2024-09-12T17:41:32.372948+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:07.336724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3562701,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":755,"num_read_kb":13816,"num_write":1082,"num_write_kb":16955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"265'187","reported_seq":809,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:35.914369+0000","last_change":"2024-09-12T16:58:55.850452+0000","last_active":"2024-09-12T17:39:35.914369+0000","last_peered":"2024-09-12T17:39:35.914369+0000","last_clean":"2024-09-12T17:39:35.914369+0000","last_became_active":"2024-09-12T16:58:55.849635+0000","last_became_peered":"2024-09-12T16:58:55.849635+0000","last_unstale":"2024-09-12T17:39:35.914369+0000","last_undegraded":"2024-09-12T17:39:35.914369+0000","last_fullsized":"2024-09-12T17:39:35.914369+0000","mapping_epoch":37,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:15.847705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":876,"num_read_kb":735,"num_write":297,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"265'301","reported_seq":1137,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.325634+0000","last_change":"2024-09-12T16:58:18.678586+0000","last_active":"2024-09-12T17:41:32.325634+0000","last_peered":"2024-09-12T17:41:32.325634+0000","last_clean":"2024-09-12T17:41:32.325634+0000","last_became_active":"2024-09-12T16:58:18.677892+0000","last_became_peered":"2024-09-12T16:58:18.677892+0000","last_unstale":"2024-09-12T17:41:32.325634+0000","last_undegraded":"2024-09-12T17:41:32.325634+0000","last_fullsized":"2024-09-12T17:41:32.325634+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:25.218640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5111586,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":842,"num_read_kb":13074,"num_write":1123,"num_write_kb":22747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"265'420","reported_seq":1141,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:52.006442+0000","last_change":"2024-09-12T16:58:21.731074+0000","last_active":"2024-09-12T17:39:52.006442+0000","last_peered":"2024-09-12T17:39:52.006442+0000","last_clean":"2024-09-12T17:39:52.006442+0000","last_became_active":"2024-09-12T16:58:21.729867+0000","last_became_peered":"2024-09-12T16:58:21.729867+0000","last_unstale":"2024-09-12T17:39:52.006442+0000","last_undegraded":"2024-09-12T17:39:52.006442+0000","last_fullsized":"2024-09-12T17:39:52.006442+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:15.044983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1962,"num_read_kb":1662,"num_write":651,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"265'362","reported_seq":1043,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.344674+0000","last_change":"2024-09-12T16:58:18.707438+0000","last_active":"2024-09-12T17:41:33.344674+0000","last_peered":"2024-09-12T17:41:33.344674+0000","last_clean":"2024-09-12T17:41:33.344674+0000","last_became_active":"2024-09-12T16:58:18.707110+0000","last_became_peered":"2024-09-12T16:58:18.707110+0000","last_unstale":"2024-09-12T17:41:33.344674+0000","last_undegraded":"2024-09-12T17:41:33.344674+0000","last_fullsized":"2024-09-12T17:41:33.344674+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:40.132907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079974,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":702,"num_read_kb":1852,"num_write":1120,"num_write_kb":24861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"265'4296","reported_seq":4999,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:01.121603+0000","last_change":"2024-09-12T16:58:55.957719+0000","last_active":"2024-09-12T17:39:01.121603+0000","last_peered":"2024-09-12T17:39:01.121603+0000","last_clean":"2024-09-12T17:39:01.121603+0000","last_became_active":"2024-09-12T16:58:55.957007+0000","last_became_peered":"2024-09-12T16:58:55.957007+0000","last_unstale":"2024-09-12T17:39:01.121603+0000","last_undegraded":"2024-09-12T17:39:01.121603+0000","last_fullsized":"2024-09-12T17:39:01.121603+0000","mapping_epoch":37,"log_start":"265'4200","ondisk_log_start":"265'4200","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":3000,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:31.973980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17379,"num_read_kb":14566,"num_write":6493,"num_write_kb":3276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"265'257","reported_seq":961,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:57.708017+0000","last_change":"2024-09-12T16:58:18.715600+0000","last_active":"2024-09-12T17:38:57.708017+0000","last_peered":"2024-09-12T17:38:57.708017+0000","last_clean":"2024-09-12T17:38:57.708017+0000","last_became_active":"2024-09-12T16:58:18.715010+0000","last_became_peered":"2024-09-12T16:58:18.715010+0000","last_unstale":"2024-09-12T17:38:57.708017+0000","last_undegraded":"2024-09-12T17:38:57.708017+0000","last_fullsized":"2024-09-12T17:38:57.708017+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:49.947157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55071,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":559,"num_read_kb":2502,"num_write":895,"num_write_kb":15075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"265'104","reported_seq":685,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:45.793141+0000","last_change":"2024-09-12T16:58:21.721630+0000","last_active":"2024-09-12T17:39:45.793141+0000","last_peered":"2024-09-12T17:39:45.793141+0000","last_clean":"2024-09-12T17:39:45.793141+0000","last_became_active":"2024-09-12T16:58:21.720908+0000","last_became_peered":"2024-09-12T16:58:21.720908+0000","last_unstale":"2024-09-12T17:39:45.793141+0000","last_undegraded":"2024-09-12T17:39:45.793141+0000","last_fullsized":"2024-09-12T17:39:45.793141+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:48.720616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":432,"num_read_kb":360,"num_write":161,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"265'336","reported_seq":1057,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.372175+0000","last_change":"2024-09-12T16:58:18.680818+0000","last_active":"2024-09-12T17:41:32.372175+0000","last_peered":"2024-09-12T17:41:32.372175+0000","last_clean":"2024-09-12T17:41:32.372175+0000","last_became_active":"2024-09-12T16:58:18.680305+0000","last_became_peered":"2024-09-12T16:58:18.680305+0000","last_unstale":"2024-09-12T17:41:32.372175+0000","last_undegraded":"2024-09-12T17:41:32.372175+0000","last_fullsized":"2024-09-12T17:41:32.372175+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:01.306922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15589576,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":637,"num_read_kb":33513,"num_write":1325,"num_write_kb":33353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"265'175","reported_seq":792,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:04.973943+0000","last_change":"2024-09-12T16:58:21.714631+0000","last_active":"2024-09-12T17:40:04.973943+0000","last_peered":"2024-09-12T17:40:04.973943+0000","last_clean":"2024-09-12T17:40:04.973943+0000","last_became_active":"2024-09-12T16:58:21.713765+0000","last_became_peered":"2024-09-12T16:58:21.713765+0000","last_unstale":"2024-09-12T17:40:04.973943+0000","last_undegraded":"2024-09-12T17:40:04.973943+0000","last_fullsized":"2024-09-12T17:40:04.973943+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:08.424081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":769,"num_read_kb":637,"num_write":246,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"265'309","reported_seq":958,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.337225+0000","last_change":"2024-09-12T16:58:18.714233+0000","last_active":"2024-09-12T17:41:32.337225+0000","last_peered":"2024-09-12T17:41:32.337225+0000","last_clean":"2024-09-12T17:41:32.337225+0000","last_became_active":"2024-09-12T16:58:18.713629+0000","last_became_peered":"2024-09-12T16:58:18.713629+0000","last_unstale":"2024-09-12T17:41:32.337225+0000","last_undegraded":"2024-09-12T17:41:32.337225+0000","last_fullsized":"2024-09-12T17:41:32.337225+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:39.149486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10599923,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":474,"num_read_kb":40377,"num_write":1101,"num_write_kb":39449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"265'158","reported_seq":728,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:58.305709+0000","last_change":"2024-09-12T16:58:21.719777+0000","last_active":"2024-09-12T17:38:58.305709+0000","last_peered":"2024-09-12T17:38:58.305709+0000","last_clean":"2024-09-12T17:38:58.305709+0000","last_became_active":"2024-09-12T16:58:21.718980+0000","last_became_peered":"2024-09-12T16:58:21.718980+0000","last_unstale":"2024-09-12T17:38:58.305709+0000","last_undegraded":"2024-09-12T17:38:58.305709+0000","last_fullsized":"2024-09-12T17:38:58.305709+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:03.655078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":669,"num_read_kb":540,"num_write":242,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"265'324","reported_seq":1008,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.345579+0000","last_change":"2024-09-12T16:58:18.678862+0000","last_active":"2024-09-12T17:41:32.345579+0000","last_peered":"2024-09-12T17:41:32.345579+0000","last_clean":"2024-09-12T17:41:32.345579+0000","last_became_active":"2024-09-12T16:58:18.678270+0000","last_became_peered":"2024-09-12T16:58:18.678270+0000","last_unstale":"2024-09-12T17:41:32.345579+0000","last_undegraded":"2024-09-12T17:41:32.345579+0000","last_fullsized":"2024-09-12T17:41:32.345579+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:05.439824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12939821,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":507,"num_read_kb":53851,"num_write":1169,"num_write_kb":47481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"265'252","reported_seq":871,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:00.283451+0000","last_change":"2024-09-12T16:58:21.729663+0000","last_active":"2024-09-12T17:39:00.283451+0000","last_peered":"2024-09-12T17:39:00.283451+0000","last_clean":"2024-09-12T17:39:00.283451+0000","last_became_active":"2024-09-12T16:58:21.729301+0000","last_became_peered":"2024-09-12T16:58:21.729301+0000","last_unstale":"2024-09-12T17:39:00.283451+0000","last_undegraded":"2024-09-12T17:39:00.283451+0000","last_fullsized":"2024-09-12T17:39:00.283451+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:14.701978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1107,"num_read_kb":902,"num_write":427,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"265'385","reported_seq":1058,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.359275+0000","last_change":"2024-09-12T16:58:18.722981+0000","last_active":"2024-09-12T17:41:32.359275+0000","last_peered":"2024-09-12T17:41:32.359275+0000","last_clean":"2024-09-12T17:41:32.359275+0000","last_became_active":"2024-09-12T16:58:18.719658+0000","last_became_peered":"2024-09-12T16:58:18.719658+0000","last_unstale":"2024-09-12T17:41:32.359275+0000","last_undegraded":"2024-09-12T17:41:32.359275+0000","last_fullsized":"2024-09-12T17:41:32.359275+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:07.503530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1631301,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":649,"num_read_kb":15766,"num_write":1334,"num_write_kb":33267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"265'203","reported_seq":839,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:30.590488+0000","last_change":"2024-09-12T16:58:21.731445+0000","last_active":"2024-09-12T17:39:30.590488+0000","last_peered":"2024-09-12T17:39:30.590488+0000","last_clean":"2024-09-12T17:39:30.590488+0000","last_became_active":"2024-09-12T16:58:21.730589+0000","last_became_peered":"2024-09-12T16:58:21.730589+0000","last_unstale":"2024-09-12T17:39:30.590488+0000","last_undegraded":"2024-09-12T17:39:30.590488+0000","last_fullsized":"2024-09-12T17:39:30.590488+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:55.311260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":887,"num_read_kb":736,"num_write":325,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"265'313","reported_seq":980,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.390069+0000","last_change":"2024-09-12T16:58:18.692286+0000","last_active":"2024-09-12T17:41:32.390069+0000","last_peered":"2024-09-12T17:41:32.390069+0000","last_clean":"2024-09-12T17:41:32.390069+0000","last_became_active":"2024-09-12T16:58:18.691716+0000","last_became_peered":"2024-09-12T16:58:18.691716+0000","last_unstale":"2024-09-12T17:41:32.390069+0000","last_undegraded":"2024-09-12T17:41:32.390069+0000","last_fullsized":"2024-09-12T17:41:32.390069+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:52.982861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5619824,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":479,"num_read_kb":37415,"num_write":1072,"num_write_kb":27973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"265'333","reported_seq":938,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:46.416171+0000","last_change":"2024-09-12T16:58:21.723290+0000","last_active":"2024-09-12T17:39:46.416171+0000","last_peered":"2024-09-12T17:39:46.416171+0000","last_clean":"2024-09-12T17:39:46.416171+0000","last_became_active":"2024-09-12T16:58:21.722380+0000","last_became_peered":"2024-09-12T16:58:21.722380+0000","last_unstale":"2024-09-12T17:39:46.416171+0000","last_undegraded":"2024-09-12T17:39:46.416171+0000","last_fullsized":"2024-09-12T17:39:46.416171+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:20.022303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1422,"num_read_kb":1143,"num_write":550,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"265'281","reported_seq":947,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:51.702167+0000","last_change":"2024-09-12T16:58:18.709809+0000","last_active":"2024-09-12T17:39:51.702167+0000","last_peered":"2024-09-12T17:39:51.702167+0000","last_clean":"2024-09-12T17:39:51.702167+0000","last_became_active":"2024-09-12T16:58:18.709090+0000","last_became_peered":"2024-09-12T16:58:18.709090+0000","last_unstale":"2024-09-12T17:39:51.702167+0000","last_undegraded":"2024-09-12T17:39:51.702167+0000","last_fullsized":"2024-09-12T17:39:51.702167+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:53.570807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6609011,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":475,"num_read_kb":42081,"num_write":1072,"num_write_kb":38244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"265'160","reported_seq":768,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:35.762962+0000","last_change":"2024-09-12T16:58:21.725647+0000","last_active":"2024-09-12T17:39:35.762962+0000","last_peered":"2024-09-12T17:39:35.762962+0000","last_clean":"2024-09-12T17:39:35.762962+0000","last_became_active":"2024-09-12T16:58:21.725262+0000","last_became_peered":"2024-09-12T16:58:21.725262+0000","last_unstale":"2024-09-12T17:39:35.762962+0000","last_undegraded":"2024-09-12T17:39:35.762962+0000","last_fullsized":"2024-09-12T17:39:35.762962+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:15.275246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":648,"num_read_kb":538,"num_write":222,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"265'296","reported_seq":965,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:17.041773+0000","last_change":"2024-09-12T16:58:18.713718+0000","last_active":"2024-09-12T17:41:17.041773+0000","last_peered":"2024-09-12T17:41:17.041773+0000","last_clean":"2024-09-12T17:41:17.041773+0000","last_became_active":"2024-09-12T16:58:18.713131+0000","last_became_peered":"2024-09-12T16:58:18.713131+0000","last_unstale":"2024-09-12T17:41:17.041773+0000","last_undegraded":"2024-09-12T17:41:17.041773+0000","last_fullsized":"2024-09-12T17:41:17.041773+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:06.542758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2374722,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":506,"num_read_kb":4620,"num_write":1061,"num_write_kb":30053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"265'101","reported_seq":696,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:49.682303+0000","last_change":"2024-09-12T16:58:21.695497+0000","last_active":"2024-09-12T17:39:49.682303+0000","last_peered":"2024-09-12T17:39:49.682303+0000","last_clean":"2024-09-12T17:39:49.682303+0000","last_became_active":"2024-09-12T16:58:21.693930+0000","last_became_peered":"2024-09-12T16:58:21.693930+0000","last_unstale":"2024-09-12T17:39:49.682303+0000","last_undegraded":"2024-09-12T17:39:49.682303+0000","last_fullsized":"2024-09-12T17:39:49.682303+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:50.200124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":454,"num_read_kb":382,"num_write":143,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"265'292","reported_seq":932,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:47.436633+0000","last_change":"2024-09-12T16:58:18.704503+0000","last_active":"2024-09-12T17:39:47.436633+0000","last_peered":"2024-09-12T17:39:47.436633+0000","last_clean":"2024-09-12T17:39:47.436633+0000","last_became_active":"2024-09-12T16:58:18.704118+0000","last_became_peered":"2024-09-12T16:58:18.704118+0000","last_unstale":"2024-09-12T17:39:47.436633+0000","last_undegraded":"2024-09-12T17:39:47.436633+0000","last_fullsized":"2024-09-12T17:39:47.436633+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:55.559259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2129208,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":488,"num_read_kb":7376,"num_write":1213,"num_write_kb":14643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"265'376","reported_seq":966,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:31.294301+0000","last_change":"2024-09-12T16:58:21.716931+0000","last_active":"2024-09-12T17:37:31.294301+0000","last_peered":"2024-09-12T17:37:31.294301+0000","last_clean":"2024-09-12T17:37:31.294301+0000","last_became_active":"2024-09-12T16:58:21.714554+0000","last_became_peered":"2024-09-12T16:58:21.714554+0000","last_unstale":"2024-09-12T17:37:31.294301+0000","last_undegraded":"2024-09-12T17:37:31.294301+0000","last_fullsized":"2024-09-12T17:37:31.294301+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:40.451432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1689,"num_read_kb":1453,"num_write":661,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"265'345","reported_seq":1053,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.342094+0000","last_change":"2024-09-12T16:58:18.722556+0000","last_active":"2024-09-12T17:41:32.342094+0000","last_peered":"2024-09-12T17:41:32.342094+0000","last_clean":"2024-09-12T17:41:32.342094+0000","last_became_active":"2024-09-12T16:58:18.719691+0000","last_became_peered":"2024-09-12T16:58:18.719691+0000","last_unstale":"2024-09-12T17:41:32.342094+0000","last_undegraded":"2024-09-12T17:41:32.342094+0000","last_fullsized":"2024-09-12T17:41:32.342094+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:16.205110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46377,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":719,"num_read_kb":7679,"num_write":1269,"num_write_kb":23567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"265'296","reported_seq":948,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.359591+0000","last_change":"2024-09-12T16:58:18.699166+0000","last_active":"2024-09-12T17:41:32.359591+0000","last_peered":"2024-09-12T17:41:32.359591+0000","last_clean":"2024-09-12T17:41:32.359591+0000","last_became_active":"2024-09-12T16:58:18.698393+0000","last_became_peered":"2024-09-12T16:58:18.698393+0000","last_unstale":"2024-09-12T17:41:32.359591+0000","last_undegraded":"2024-09-12T17:41:32.359591+0000","last_fullsized":"2024-09-12T17:41:32.359591+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:04.059507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8744826,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":480,"num_read_kb":34675,"num_write":1070,"num_write_kb":53307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"265'106","reported_seq":685,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:25.841940+0000","last_change":"2024-09-12T16:58:21.715263+0000","last_active":"2024-09-12T17:39:25.841940+0000","last_peered":"2024-09-12T17:39:25.841940+0000","last_clean":"2024-09-12T17:39:25.841940+0000","last_became_active":"2024-09-12T16:58:21.714240+0000","last_became_peered":"2024-09-12T16:58:21.714240+0000","last_unstale":"2024-09-12T17:39:25.841940+0000","last_undegraded":"2024-09-12T17:39:25.841940+0000","last_fullsized":"2024-09-12T17:39:25.841940+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:10.058451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":476,"num_read_kb":394,"num_write":172,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"265'361","reported_seq":1040,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.346881+0000","last_change":"2024-09-12T16:58:18.708462+0000","last_active":"2024-09-12T17:41:33.346881+0000","last_peered":"2024-09-12T17:41:33.346881+0000","last_clean":"2024-09-12T17:41:33.346881+0000","last_became_active":"2024-09-12T16:58:18.707649+0000","last_became_peered":"2024-09-12T16:58:18.707649+0000","last_unstale":"2024-09-12T17:41:33.346881+0000","last_undegraded":"2024-09-12T17:41:33.346881+0000","last_fullsized":"2024-09-12T17:41:33.346881+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:46.590351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":580,"num_read_kb":14659,"num_write":1122,"num_write_kb":33951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"265'4159","reported_seq":4793,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:51.063189+0000","last_change":"2024-09-12T16:58:21.719410+0000","last_active":"2024-09-12T17:39:51.063189+0000","last_peered":"2024-09-12T17:39:51.063189+0000","last_clean":"2024-09-12T17:39:51.063189+0000","last_became_active":"2024-09-12T16:58:21.718537+0000","last_became_peered":"2024-09-12T16:58:21.718537+0000","last_unstale":"2024-09-12T17:39:51.063189+0000","last_undegraded":"2024-09-12T17:39:51.063189+0000","last_fullsized":"2024-09-12T17:39:51.063189+0000","mapping_epoch":26,"log_start":"265'4100","ondisk_log_start":"265'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":3000,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:03.741045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16773,"num_read_kb":14078,"num_write":6250,"num_write_kb":3119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6189,"num_read_kb":4469,"num_write":2002,"num_write_kb":899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":974,"ondisk_log_size":974,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15645,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":16183,"num_read_kb":15867,"num_write":16715,"num_write_kb":4878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1753,"ondisk_log_size":1753,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":481,"ondisk_log_size":481,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1868718,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":17032,"num_read_kb":33558,"num_write":14353,"num_write_kb":11510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2637824,"data_stored":2171293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1814,"ondisk_log_size":1814,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2406,"num_read_kb":2867,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":102570,"num_read_kb":85739,"num_write":37214,"num_write_kb":18735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4257,"ondisk_log_size":4257,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":427256830,"num_objects":3589,"num_object_clones":0,"num_object_copies":7178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3589,"num_whiteouts":0,"num_read":33064,"num_read_kb":1886507,"num_write":69384,"num_write_kb":2069560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":881819648,"data_stored":855189081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4325,"ondisk_log_size":4325,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":71400006,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":148,"num_read_kb":211125,"num_write":163,"num_write_kb":136313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1087,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":152240128,"data_stored":152237196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":103,"ondisk_log_size":103,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":59768832,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":153,"num_read_kb":198791,"num_write":171,"num_write_kb":136313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":120684544,"data_stored":120683078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509967,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310272,"kb_used_data":202800,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94061568,"statfs":{"total":96636764160,"available":96319045632,"internally_reserved":0,"allocated":207667200,"data_stored":201034528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509966,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":441040,"kb_used_data":197440,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":93930800,"statfs":{"total":96636764160,"available":96185139200,"internally_reserved":0,"allocated":202178560,"data_stored":195485373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":249428423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509971,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110536,"kb_used_data":11328,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94261304,"statfs":{"total":96636764160,"available":96523575296,"internally_reserved":0,"allocated":11599872,"data_stored":9988574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509966,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":442396,"kb_used_data":216860,"kb_used_omap":1,"kb_used_meta":225470,"kb_avail":93929444,"statfs":{"total":96636764160,"available":96183750656,"internally_reserved":0,"allocated":222064640,"data_stored":216353656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":230881733},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542671,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":404528,"kb_used_data":170656,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":93967312,"statfs":{"total":96636764160,"available":96222527488,"internally_reserved":0,"allocated":174751744,"data_stored":168481208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":239466955},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542672,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":333836,"kb_used_data":126332,"kb_used_omap":1,"kb_used_meta":207486,"kb_avail":94038004,"statfs":{"total":96636764160,"available":96294916096,"internally_reserved":0,"allocated":129363968,"data_stored":124846922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":212466118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542670,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":294048,"kb_used_data":208784,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94077792,"statfs":{"total":96636764160,"available":96335659008,"internally_reserved":0,"allocated":213794816,"data_stored":207648782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575374,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":161452,"kb_used_data":103900,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94210388,"statfs":{"total":96636764160,"available":96471437312,"internally_reserved":0,"allocated":106393600,"data_stored":102235490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":158121984,"data_stored":154525876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7954432,"data_stored":7838758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":63787008,"data_stored":61116399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":123113472,"data_stored":119112704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":163921920,"data_stored":159269009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":140980224,"data_stored":137075047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":86540288,"data_stored":83529300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":137400320,"data_stored":132721988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":307200,"data_stored":253243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":123306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":512000,"data_stored":426985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":91316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":585728,"data_stored":488018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":319488,"data_stored":274248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":618496,"data_stored":513159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":5371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":5873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":22020096,"data_stored":22020096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13631488,"data_stored":13631488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12681216,"data_stored":12679750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13631488,"data_stored":13631488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":15777792,"data_stored":15777062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35749888,"data_stored":35748422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":22069248,"data_stored":22068512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":26214400,"data_stored":26214400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15728640,"data_stored":15728640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:41:34.243 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T17:41:34.243 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:41:34.621 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:41:34.633 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-09-12T17:41:34.635 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":1564,"stamp":"2024-09-12T17:41:33.790435+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":560902211,"num_objects":3965,"num_object_clones":0,"num_object_copies":7930,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3965,"num_whiteouts":0,"num_read":177823,"num_read_kb":2438990,"num_write":140145,"num_write_kb":2379864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1087,"num_keys_recovered":0,"num_objects_omap":62,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13911,"ondisk_log_size":13911,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2498108,"kb_used_data":1238100,"kb_used_omap":12,"kb_used_meta":1259763,"kb_avail":752476612,"statfs":{"total":773094113280,"available":770536050688,"internally_reserved":0,"allocated":1267814400,"data_stored":1226074533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1289997873},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-90424458,"num_objects":-887,"num_object_clones":0,"num_object_copies":-1774,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-887,"num_whiteouts":0,"num_read":1098,"num_read_kb":1019,"num_write":993,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.025460"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:17.322563+0000","last_change":"2024-09-12T17:27:17.404693+0000","last_active":"2024-09-12T17:37:17.322563+0000","last_peered":"2024-09-12T17:37:17.322563+0000","last_clean":"2024-09-12T17:37:17.322563+0000","last_became_active":"2024-09-12T17:27:17.403833+0000","last_became_peered":"2024-09-12T17:27:17.403833+0000","last_unstale":"2024-09-12T17:37:17.322563+0000","last_undegraded":"2024-09-12T17:37:17.322563+0000","last_fullsized":"2024-09-12T17:37:17.322563+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:43.551735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"265'4","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:12.334840+0000","last_change":"2024-09-12T17:15:43.159517+0000","last_active":"2024-09-12T17:38:12.334840+0000","last_peered":"2024-09-12T17:38:12.334840+0000","last_clean":"2024-09-12T17:38:12.334840+0000","last_became_active":"2024-09-12T17:15:43.158714+0000","last_became_peered":"2024-09-12T17:15:43.158714+0000","last_unstale":"2024-09-12T17:38:12.334840+0000","last_undegraded":"2024-09-12T17:38:12.334840+0000","last_fullsized":"2024-09-12T17:38:12.334840+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:19.068813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"262'2","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:12.353310+0000","last_change":"2024-09-12T17:15:40.126960+0000","last_active":"2024-09-12T17:38:12.353310+0000","last_peered":"2024-09-12T17:38:12.353310+0000","last_clean":"2024-09-12T17:38:12.353310+0000","last_became_active":"2024-09-12T17:15:40.126170+0000","last_became_peered":"2024-09-12T17:15:40.126170+0000","last_unstale":"2024-09-12T17:38:12.353310+0000","last_undegraded":"2024-09-12T17:38:12.353310+0000","last_fullsized":"2024-09-12T17:38:12.353310+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:57.038622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"265'24","reported_seq":111,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:57.361076+0000","last_change":"2024-09-12T17:13:54.846274+0000","last_active":"2024-09-12T17:38:57.361076+0000","last_peered":"2024-09-12T17:38:57.361076+0000","last_clean":"2024-09-12T17:38:57.361076+0000","last_became_active":"2024-09-12T17:13:54.845556+0000","last_became_peered":"2024-09-12T17:13:54.845556+0000","last_unstale":"2024-09-12T17:38:57.361076+0000","last_undegraded":"2024-09-12T17:38:57.361076+0000","last_fullsized":"2024-09-12T17:38:57.361076+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:34.627718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":82,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:20.262014+0000","last_change":"2024-09-12T17:27:17.422429+0000","last_active":"2024-09-12T17:37:20.262014+0000","last_peered":"2024-09-12T17:37:20.262014+0000","last_clean":"2024-09-12T17:37:20.262014+0000","last_became_active":"2024-09-12T17:27:17.421771+0000","last_became_peered":"2024-09-12T17:27:17.421771+0000","last_unstale":"2024-09-12T17:37:20.262014+0000","last_undegraded":"2024-09-12T17:37:20.262014+0000","last_fullsized":"2024-09-12T17:37:20.262014+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:44.139866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:16.281883+0000","last_change":"2024-09-12T17:15:43.160447+0000","last_active":"2024-09-12T17:38:16.281883+0000","last_peered":"2024-09-12T17:38:16.281883+0000","last_clean":"2024-09-12T17:38:16.281883+0000","last_became_active":"2024-09-12T17:15:43.159316+0000","last_became_peered":"2024-09-12T17:15:43.159316+0000","last_unstale":"2024-09-12T17:38:16.281883+0000","last_undegraded":"2024-09-12T17:38:16.281883+0000","last_fullsized":"2024-09-12T17:38:16.281883+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:44.109670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"265'7","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:43.729290+0000","last_change":"2024-09-12T17:15:40.126819+0000","last_active":"2024-09-12T17:40:43.729290+0000","last_peered":"2024-09-12T17:40:43.729290+0000","last_clean":"2024-09-12T17:40:43.729290+0000","last_became_active":"2024-09-12T17:15:40.126087+0000","last_became_peered":"2024-09-12T17:15:40.126087+0000","last_unstale":"2024-09-12T17:40:43.729290+0000","last_undegraded":"2024-09-12T17:40:43.729290+0000","last_fullsized":"2024-09-12T17:40:43.729290+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:09.968319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":1026,"num_write":12,"num_write_kb":5122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"265'36","reported_seq":144,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:19.460209+0000","last_change":"2024-09-12T17:13:54.838770+0000","last_active":"2024-09-12T17:38:19.460209+0000","last_peered":"2024-09-12T17:38:19.460209+0000","last_clean":"2024-09-12T17:38:19.460209+0000","last_became_active":"2024-09-12T17:13:54.837820+0000","last_became_peered":"2024-09-12T17:13:54.837820+0000","last_unstale":"2024-09-12T17:38:19.460209+0000","last_undegraded":"2024-09-12T17:38:19.460209+0000","last_fullsized":"2024-09-12T17:38:19.460209+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:56:27.573050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":180,"num_read_kb":123,"num_write":74,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:36:56.280248+0000","last_change":"2024-09-12T17:27:17.406442+0000","last_active":"2024-09-12T17:36:56.280248+0000","last_peered":"2024-09-12T17:36:56.280248+0000","last_clean":"2024-09-12T17:36:56.280248+0000","last_became_active":"2024-09-12T17:27:17.405657+0000","last_became_peered":"2024-09-12T17:27:17.405657+0000","last_unstale":"2024-09-12T17:36:56.280248+0000","last_undegraded":"2024-09-12T17:36:56.280248+0000","last_fullsized":"2024-09-12T17:36:56.280248+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:12.985689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:37.355505+0000","last_change":"2024-09-12T17:15:43.869720+0000","last_active":"2024-09-12T17:38:37.355505+0000","last_peered":"2024-09-12T17:38:37.355505+0000","last_clean":"2024-09-12T17:38:37.355505+0000","last_became_active":"2024-09-12T17:15:43.868960+0000","last_became_peered":"2024-09-12T17:15:43.868960+0000","last_unstale":"2024-09-12T17:38:37.355505+0000","last_undegraded":"2024-09-12T17:38:37.355505+0000","last_fullsized":"2024-09-12T17:38:37.355505+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:01.285114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"262'2","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:45.267370+0000","last_change":"2024-09-12T17:15:40.135488+0000","last_active":"2024-09-12T17:37:45.267370+0000","last_peered":"2024-09-12T17:37:45.267370+0000","last_clean":"2024-09-12T17:37:45.267370+0000","last_became_active":"2024-09-12T17:15:40.134513+0000","last_became_peered":"2024-09-12T17:15:40.134513+0000","last_unstale":"2024-09-12T17:37:45.267370+0000","last_undegraded":"2024-09-12T17:37:45.267370+0000","last_fullsized":"2024-09-12T17:37:45.267370+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:39.657856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"265'19","reported_seq":94,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:57.360940+0000","last_change":"2024-09-12T17:13:54.827570+0000","last_active":"2024-09-12T17:38:57.360940+0000","last_peered":"2024-09-12T17:38:57.360940+0000","last_clean":"2024-09-12T17:38:57.360940+0000","last_became_active":"2024-09-12T17:13:54.826480+0000","last_became_peered":"2024-09-12T17:13:54.826480+0000","last_unstale":"2024-09-12T17:38:57.360940+0000","last_undegraded":"2024-09-12T17:38:57.360940+0000","last_fullsized":"2024-09-12T17:38:57.360940+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:09.477709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:02.336888+0000","last_change":"2024-09-12T17:27:17.419282+0000","last_active":"2024-09-12T17:37:02.336888+0000","last_peered":"2024-09-12T17:37:02.336888+0000","last_clean":"2024-09-12T17:37:02.336888+0000","last_became_active":"2024-09-12T17:27:17.418519+0000","last_became_peered":"2024-09-12T17:27:17.418519+0000","last_unstale":"2024-09-12T17:37:02.336888+0000","last_undegraded":"2024-09-12T17:37:02.336888+0000","last_fullsized":"2024-09-12T17:37:02.336888+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:37.212267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"265'1","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:47.347348+0000","last_change":"2024-09-12T17:15:43.869355+0000","last_active":"2024-09-12T17:37:47.347348+0000","last_peered":"2024-09-12T17:37:47.347348+0000","last_clean":"2024-09-12T17:37:47.347348+0000","last_became_active":"2024-09-12T17:15:43.868600+0000","last_became_peered":"2024-09-12T17:15:43.868600+0000","last_unstale":"2024-09-12T17:37:47.347348+0000","last_undegraded":"2024-09-12T17:37:47.347348+0000","last_fullsized":"2024-09-12T17:37:47.347348+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:55.218786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48422,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":48,"num_write":1,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"262'3","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:36.286516+0000","last_change":"2024-09-12T17:15:40.109807+0000","last_active":"2024-09-12T17:38:36.286516+0000","last_peered":"2024-09-12T17:38:36.286516+0000","last_clean":"2024-09-12T17:38:36.286516+0000","last_became_active":"2024-09-12T17:15:40.109161+0000","last_became_peered":"2024-09-12T17:15:40.109161+0000","last_unstale":"2024-09-12T17:38:36.286516+0000","last_undegraded":"2024-09-12T17:38:36.286516+0000","last_fullsized":"2024-09-12T17:38:36.286516+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:38.091651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"265'31","reported_seq":127,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:28.552554+0000","last_change":"2024-09-12T17:13:54.839575+0000","last_active":"2024-09-12T17:39:28.552554+0000","last_peered":"2024-09-12T17:39:28.552554+0000","last_clean":"2024-09-12T17:39:28.552554+0000","last_became_active":"2024-09-12T17:13:54.838968+0000","last_became_peered":"2024-09-12T17:13:54.838968+0000","last_unstale":"2024-09-12T17:39:28.552554+0000","last_undegraded":"2024-09-12T17:39:28.552554+0000","last_fullsized":"2024-09-12T17:39:28.552554+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:01.149483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":108,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:22.370396+0000","last_change":"2024-09-12T17:27:17.418362+0000","last_active":"2024-09-12T17:39:22.370396+0000","last_peered":"2024-09-12T17:39:22.370396+0000","last_clean":"2024-09-12T17:39:22.370396+0000","last_became_active":"2024-09-12T17:27:17.416509+0000","last_became_peered":"2024-09-12T17:27:17.416509+0000","last_unstale":"2024-09-12T17:39:22.370396+0000","last_undegraded":"2024-09-12T17:39:22.370396+0000","last_fullsized":"2024-09-12T17:39:22.370396+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:54.908041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"265'10","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:32.325931+0000","last_change":"2024-09-12T17:15:43.163407+0000","last_active":"2024-09-12T17:37:32.325931+0000","last_peered":"2024-09-12T17:37:32.325931+0000","last_clean":"2024-09-12T17:37:32.325931+0000","last_became_active":"2024-09-12T17:15:43.162643+0000","last_became_peered":"2024-09-12T17:15:43.162643+0000","last_unstale":"2024-09-12T17:37:32.325931+0000","last_undegraded":"2024-09-12T17:37:32.325931+0000","last_fullsized":"2024-09-12T17:37:32.325931+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:26.465579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48416,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":23650,"num_write":15,"num_write_kb":11312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"265'8","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.236529+0000","last_change":"2024-09-12T17:15:40.111961+0000","last_active":"2024-09-12T17:41:32.236529+0000","last_peered":"2024-09-12T17:41:32.236529+0000","last_clean":"2024-09-12T17:41:32.236529+0000","last_became_active":"2024-09-12T17:15:40.111105+0000","last_became_peered":"2024-09-12T17:15:40.111105+0000","last_unstale":"2024-09-12T17:41:32.236529+0000","last_undegraded":"2024-09-12T17:41:32.236529+0000","last_fullsized":"2024-09-12T17:41:32.236529+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:17.726065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"265'54","reported_seq":197,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:31.662260+0000","last_change":"2024-09-12T17:13:54.842088+0000","last_active":"2024-09-12T17:39:31.662260+0000","last_peered":"2024-09-12T17:39:31.662260+0000","last_clean":"2024-09-12T17:39:31.662260+0000","last_became_active":"2024-09-12T17:13:54.841072+0000","last_became_peered":"2024-09-12T17:13:54.841072+0000","last_unstale":"2024-09-12T17:39:31.662260+0000","last_undegraded":"2024-09-12T17:39:31.662260+0000","last_fullsized":"2024-09-12T17:39:31.662260+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:22:11.118120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":282,"num_read_kb":222,"num_write":88,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:43.689296+0000","last_change":"2024-09-12T17:27:17.410975+0000","last_active":"2024-09-12T17:37:43.689296+0000","last_peered":"2024-09-12T17:37:43.689296+0000","last_clean":"2024-09-12T17:37:43.689296+0000","last_became_active":"2024-09-12T17:27:17.392355+0000","last_became_peered":"2024-09-12T17:27:17.392355+0000","last_unstale":"2024-09-12T17:37:43.689296+0000","last_undegraded":"2024-09-12T17:37:43.689296+0000","last_fullsized":"2024-09-12T17:37:43.689296+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:41.915255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"265'3","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:31.287683+0000","last_change":"2024-09-12T17:15:57.748482+0000","last_active":"2024-09-12T17:37:31.287683+0000","last_peered":"2024-09-12T17:37:31.287683+0000","last_clean":"2024-09-12T17:37:31.287683+0000","last_became_active":"2024-09-12T17:15:57.742342+0000","last_became_peered":"2024-09-12T17:15:57.742342+0000","last_unstale":"2024-09-12T17:37:31.287683+0000","last_undegraded":"2024-09-12T17:37:31.287683+0000","last_fullsized":"2024-09-12T17:37:31.287683+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:00.488944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":3,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1087,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:36.272606+0000","last_change":"2024-09-12T17:15:40.120329+0000","last_active":"2024-09-12T17:37:36.272606+0000","last_peered":"2024-09-12T17:37:36.272606+0000","last_clean":"2024-09-12T17:37:36.272606+0000","last_became_active":"2024-09-12T17:15:40.119439+0000","last_became_peered":"2024-09-12T17:15:40.119439+0000","last_unstale":"2024-09-12T17:37:36.272606+0000","last_undegraded":"2024-09-12T17:37:36.272606+0000","last_fullsized":"2024-09-12T17:37:36.272606+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:50.536461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"265'35","reported_seq":142,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:56.306273+0000","last_change":"2024-09-12T17:13:54.842916+0000","last_active":"2024-09-12T17:38:56.306273+0000","last_peered":"2024-09-12T17:38:56.306273+0000","last_clean":"2024-09-12T17:38:56.306273+0000","last_became_active":"2024-09-12T17:13:54.842215+0000","last_became_peered":"2024-09-12T17:13:54.842215+0000","last_unstale":"2024-09-12T17:38:56.306273+0000","last_undegraded":"2024-09-12T17:38:56.306273+0000","last_fullsized":"2024-09-12T17:38:56.306273+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:02.592935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":135,"num_write":51,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"265'1","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:21.291709+0000","last_change":"2024-09-12T17:27:17.415995+0000","last_active":"2024-09-12T17:37:21.291709+0000","last_peered":"2024-09-12T17:37:21.291709+0000","last_clean":"2024-09-12T17:37:21.291709+0000","last_became_active":"2024-09-12T17:27:17.415277+0000","last_became_peered":"2024-09-12T17:27:17.415277+0000","last_unstale":"2024-09-12T17:37:21.291709+0000","last_undegraded":"2024-09-12T17:37:21.291709+0000","last_fullsized":"2024-09-12T17:37:21.291709+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:19.223166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"265'3","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:16.297571+0000","last_change":"2024-09-12T17:15:43.172814+0000","last_active":"2024-09-12T17:38:16.297571+0000","last_peered":"2024-09-12T17:38:16.297571+0000","last_clean":"2024-09-12T17:38:16.297571+0000","last_became_active":"2024-09-12T17:15:43.172142+0000","last_became_peered":"2024-09-12T17:15:43.172142+0000","last_unstale":"2024-09-12T17:38:16.297571+0000","last_undegraded":"2024-09-12T17:38:16.297571+0000","last_fullsized":"2024-09-12T17:38:16.297571+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:41.542977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"262'4","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:11.280709+0000","last_change":"2024-09-12T17:15:40.109940+0000","last_active":"2024-09-12T17:38:11.280709+0000","last_peered":"2024-09-12T17:38:11.280709+0000","last_clean":"2024-09-12T17:38:11.280709+0000","last_became_active":"2024-09-12T17:15:40.109076+0000","last_became_peered":"2024-09-12T17:15:40.109076+0000","last_unstale":"2024-09-12T17:38:11.280709+0000","last_undegraded":"2024-09-12T17:38:11.280709+0000","last_fullsized":"2024-09-12T17:38:11.280709+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:05.822624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"262'6","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:12.349294+0000","last_change":"2024-09-12T17:13:54.820144+0000","last_active":"2024-09-12T17:38:12.349294+0000","last_peered":"2024-09-12T17:38:12.349294+0000","last_clean":"2024-09-12T17:38:12.349294+0000","last_became_active":"2024-09-12T17:13:54.819399+0000","last_became_peered":"2024-09-12T17:13:54.819399+0000","last_unstale":"2024-09-12T17:38:12.349294+0000","last_undegraded":"2024-09-12T17:38:12.349294+0000","last_fullsized":"2024-09-12T17:38:12.349294+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:25.721158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:21.291799+0000","last_change":"2024-09-12T17:27:17.420256+0000","last_active":"2024-09-12T17:37:21.291799+0000","last_peered":"2024-09-12T17:37:21.291799+0000","last_clean":"2024-09-12T17:37:21.291799+0000","last_became_active":"2024-09-12T17:27:17.419839+0000","last_became_peered":"2024-09-12T17:27:17.419839+0000","last_unstale":"2024-09-12T17:37:21.291799+0000","last_undegraded":"2024-09-12T17:37:21.291799+0000","last_fullsized":"2024-09-12T17:37:21.291799+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:46.578295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"265'4","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:12.353158+0000","last_change":"2024-09-12T17:15:43.160492+0000","last_active":"2024-09-12T17:38:12.353158+0000","last_peered":"2024-09-12T17:38:12.353158+0000","last_clean":"2024-09-12T17:38:12.353158+0000","last_became_active":"2024-09-12T17:15:43.159663+0000","last_became_peered":"2024-09-12T17:15:43.159663+0000","last_unstale":"2024-09-12T17:38:12.353158+0000","last_undegraded":"2024-09-12T17:38:12.353158+0000","last_fullsized":"2024-09-12T17:38:12.353158+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:48.671220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":9,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"265'2","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:42.384696+0000","last_change":"2024-09-12T17:15:40.131992+0000","last_active":"2024-09-12T17:40:42.384696+0000","last_peered":"2024-09-12T17:40:42.384696+0000","last_clean":"2024-09-12T17:40:42.384696+0000","last_became_active":"2024-09-12T17:15:40.131140+0000","last_became_peered":"2024-09-12T17:15:40.131140+0000","last_unstale":"2024-09-12T17:40:42.384696+0000","last_undegraded":"2024-09-12T17:40:42.384696+0000","last_fullsized":"2024-09-12T17:40:42.384696+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:26.319835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"265'19","reported_seq":94,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:08.694781+0000","last_change":"2024-09-12T17:13:54.832206+0000","last_active":"2024-09-12T17:38:08.694781+0000","last_peered":"2024-09-12T17:38:08.694781+0000","last_clean":"2024-09-12T17:38:08.694781+0000","last_became_active":"2024-09-12T17:13:54.831374+0000","last_became_peered":"2024-09-12T17:13:54.831374+0000","last_unstale":"2024-09-12T17:38:08.694781+0000","last_undegraded":"2024-09-12T17:38:08.694781+0000","last_fullsized":"2024-09-12T17:38:08.694781+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:25.250277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:58.706411+0000","last_change":"2024-09-12T17:27:17.416704+0000","last_active":"2024-09-12T17:38:58.706411+0000","last_peered":"2024-09-12T17:38:58.706411+0000","last_clean":"2024-09-12T17:38:58.706411+0000","last_became_active":"2024-09-12T17:27:17.415918+0000","last_became_peered":"2024-09-12T17:27:17.415918+0000","last_unstale":"2024-09-12T17:38:58.706411+0000","last_undegraded":"2024-09-12T17:38:58.706411+0000","last_fullsized":"2024-09-12T17:38:58.706411+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:40.069574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"265'3","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:27.342821+0000","last_change":"2024-09-12T17:15:43.872202+0000","last_active":"2024-09-12T17:37:27.342821+0000","last_peered":"2024-09-12T17:37:27.342821+0000","last_clean":"2024-09-12T17:37:27.342821+0000","last_became_active":"2024-09-12T17:15:43.871380+0000","last_became_peered":"2024-09-12T17:15:43.871380+0000","last_unstale":"2024-09-12T17:37:27.342821+0000","last_undegraded":"2024-09-12T17:37:27.342821+0000","last_fullsized":"2024-09-12T17:37:27.342821+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:54.178710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"265'2","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:07.347492+0000","last_change":"2024-09-12T17:15:40.117517+0000","last_active":"2024-09-12T17:39:07.347492+0000","last_peered":"2024-09-12T17:39:07.347492+0000","last_clean":"2024-09-12T17:39:07.347492+0000","last_became_active":"2024-09-12T17:15:40.116781+0000","last_became_peered":"2024-09-12T17:15:40.116781+0000","last_unstale":"2024-09-12T17:39:07.347492+0000","last_undegraded":"2024-09-12T17:39:07.347492+0000","last_fullsized":"2024-09-12T17:39:07.347492+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:04.218708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":7168,"num_write":2,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"265'68","reported_seq":230,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:31.441127+0000","last_change":"2024-09-12T17:13:54.830908+0000","last_active":"2024-09-12T17:39:31.441127+0000","last_peered":"2024-09-12T17:39:31.441127+0000","last_clean":"2024-09-12T17:39:31.441127+0000","last_became_active":"2024-09-12T17:13:54.829335+0000","last_became_peered":"2024-09-12T17:13:54.829335+0000","last_unstale":"2024-09-12T17:39:31.441127+0000","last_undegraded":"2024-09-12T17:39:31.441127+0000","last_fullsized":"2024-09-12T17:39:31.441127+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:18:25.184524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":349,"num_read_kb":240,"num_write":120,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"265'1","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:00.283371+0000","last_change":"2024-09-12T17:27:17.410174+0000","last_active":"2024-09-12T17:39:00.283371+0000","last_peered":"2024-09-12T17:39:00.283371+0000","last_clean":"2024-09-12T17:39:00.283371+0000","last_became_active":"2024-09-12T17:27:17.409364+0000","last_became_peered":"2024-09-12T17:27:17.409364+0000","last_unstale":"2024-09-12T17:39:00.283371+0000","last_undegraded":"2024-09-12T17:39:00.283371+0000","last_fullsized":"2024-09-12T17:39:00.283371+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:34.250496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"265'1","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:07.366937+0000","last_change":"2024-09-12T17:15:43.875351+0000","last_active":"2024-09-12T17:39:07.366937+0000","last_peered":"2024-09-12T17:39:07.366937+0000","last_clean":"2024-09-12T17:39:07.366937+0000","last_became_active":"2024-09-12T17:15:43.874421+0000","last_became_peered":"2024-09-12T17:15:43.874421+0000","last_unstale":"2024-09-12T17:39:07.366937+0000","last_undegraded":"2024-09-12T17:39:07.366937+0000","last_fullsized":"2024-09-12T17:39:07.366937+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:12.382448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"265'2","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:26.293177+0000","last_change":"2024-09-12T17:15:40.127851+0000","last_active":"2024-09-12T17:37:26.293177+0000","last_peered":"2024-09-12T17:37:26.293177+0000","last_clean":"2024-09-12T17:37:26.293177+0000","last_became_active":"2024-09-12T17:15:40.126898+0000","last_became_peered":"2024-09-12T17:15:40.126898+0000","last_unstale":"2024-09-12T17:37:26.293177+0000","last_undegraded":"2024-09-12T17:37:26.293177+0000","last_fullsized":"2024-09-12T17:37:26.293177+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:27.692907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"265'19","reported_seq":92,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:07.352095+0000","last_change":"2024-09-12T17:13:54.833584+0000","last_active":"2024-09-12T17:38:07.352095+0000","last_peered":"2024-09-12T17:38:07.352095+0000","last_clean":"2024-09-12T17:38:07.352095+0000","last_became_active":"2024-09-12T17:13:54.832780+0000","last_became_peered":"2024-09-12T17:13:54.832780+0000","last_unstale":"2024-09-12T17:38:07.352095+0000","last_undegraded":"2024-09-12T17:38:07.352095+0000","last_fullsized":"2024-09-12T17:38:07.352095+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:33.420620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":55,"num_write":40,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:01.315516+0000","last_change":"2024-09-12T17:27:17.415211+0000","last_active":"2024-09-12T17:39:01.315516+0000","last_peered":"2024-09-12T17:39:01.315516+0000","last_clean":"2024-09-12T17:39:01.315516+0000","last_became_active":"2024-09-12T17:27:17.414739+0000","last_became_peered":"2024-09-12T17:27:17.414739+0000","last_unstale":"2024-09-12T17:39:01.315516+0000","last_undegraded":"2024-09-12T17:39:01.315516+0000","last_fullsized":"2024-09-12T17:39:01.315516+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:57.434689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"265'4","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:27.342949+0000","last_change":"2024-09-12T17:15:43.872275+0000","last_active":"2024-09-12T17:37:27.342949+0000","last_peered":"2024-09-12T17:37:27.342949+0000","last_clean":"2024-09-12T17:37:27.342949+0000","last_became_active":"2024-09-12T17:15:43.871502+0000","last_became_peered":"2024-09-12T17:15:43.871502+0000","last_unstale":"2024-09-12T17:37:27.342949+0000","last_undegraded":"2024-09-12T17:37:27.342949+0000","last_fullsized":"2024-09-12T17:37:27.342949+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:07.859526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":9,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"265'3","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:25.263115+0000","last_change":"2024-09-12T17:15:40.133504+0000","last_active":"2024-09-12T17:37:25.263115+0000","last_peered":"2024-09-12T17:37:25.263115+0000","last_clean":"2024-09-12T17:37:25.263115+0000","last_became_active":"2024-09-12T17:15:40.132311+0000","last_became_peered":"2024-09-12T17:15:40.132311+0000","last_unstale":"2024-09-12T17:37:25.263115+0000","last_undegraded":"2024-09-12T17:37:25.263115+0000","last_fullsized":"2024-09-12T17:37:25.263115+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:42.985929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"265'33","reported_seq":136,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:05.271852+0000","last_change":"2024-09-12T17:13:54.828548+0000","last_active":"2024-09-12T17:38:05.271852+0000","last_peered":"2024-09-12T17:38:05.271852+0000","last_clean":"2024-09-12T17:38:05.271852+0000","last_became_active":"2024-09-12T17:13:54.827785+0000","last_became_peered":"2024-09-12T17:13:54.827785+0000","last_unstale":"2024-09-12T17:38:05.271852+0000","last_undegraded":"2024-09-12T17:38:05.271852+0000","last_fullsized":"2024-09-12T17:38:05.271852+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:29.075567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":116,"num_write":64,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:57.345260+0000","last_change":"2024-09-12T17:27:17.391923+0000","last_active":"2024-09-12T17:38:57.345260+0000","last_peered":"2024-09-12T17:38:57.345260+0000","last_clean":"2024-09-12T17:38:57.345260+0000","last_became_active":"2024-09-12T17:27:17.391154+0000","last_became_peered":"2024-09-12T17:27:17.391154+0000","last_unstale":"2024-09-12T17:38:57.345260+0000","last_undegraded":"2024-09-12T17:38:57.345260+0000","last_fullsized":"2024-09-12T17:38:57.345260+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:12.682141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"265'9","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:31.271602+0000","last_change":"2024-09-12T17:15:43.171314+0000","last_active":"2024-09-12T17:37:31.271602+0000","last_peered":"2024-09-12T17:37:31.271602+0000","last_clean":"2024-09-12T17:37:31.271602+0000","last_became_active":"2024-09-12T17:15:43.169085+0000","last_became_peered":"2024-09-12T17:15:43.169085+0000","last_unstale":"2024-09-12T17:37:31.271602+0000","last_undegraded":"2024-09-12T17:37:31.271602+0000","last_fullsized":"2024-09-12T17:37:31.271602+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:01.989288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13631488,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":43010,"num_write":14,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"265'1","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:27.339090+0000","last_change":"2024-09-12T17:15:40.139824+0000","last_active":"2024-09-12T17:37:27.339090+0000","last_peered":"2024-09-12T17:37:27.339090+0000","last_clean":"2024-09-12T17:37:27.339090+0000","last_became_active":"2024-09-12T17:15:40.139145+0000","last_became_peered":"2024-09-12T17:15:40.139145+0000","last_unstale":"2024-09-12T17:37:27.339090+0000","last_undegraded":"2024-09-12T17:37:27.339090+0000","last_fullsized":"2024-09-12T17:37:27.339090+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:52:16.027902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"265'28","reported_seq":124,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:38.948450+0000","last_change":"2024-09-12T17:13:54.843550+0000","last_active":"2024-09-12T17:38:38.948450+0000","last_peered":"2024-09-12T17:38:38.948450+0000","last_clean":"2024-09-12T17:38:38.948450+0000","last_became_active":"2024-09-12T17:13:54.842816+0000","last_became_peered":"2024-09-12T17:13:54.842816+0000","last_unstale":"2024-09-12T17:38:38.948450+0000","last_undegraded":"2024-09-12T17:38:38.948450+0000","last_fullsized":"2024-09-12T17:38:38.948450+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:02.403853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":108,"num_write":46,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:36:57.335925+0000","last_change":"2024-09-12T17:27:17.422713+0000","last_active":"2024-09-12T17:36:57.335925+0000","last_peered":"2024-09-12T17:36:57.335925+0000","last_clean":"2024-09-12T17:36:57.335925+0000","last_became_active":"2024-09-12T17:27:17.421939+0000","last_became_peered":"2024-09-12T17:27:17.421939+0000","last_unstale":"2024-09-12T17:36:57.335925+0000","last_undegraded":"2024-09-12T17:36:57.335925+0000","last_fullsized":"2024-09-12T17:36:57.335925+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:53.787184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"262'8","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:03.708024+0000","last_change":"2024-09-12T17:15:43.162064+0000","last_active":"2024-09-12T17:39:03.708024+0000","last_peered":"2024-09-12T17:39:03.708024+0000","last_clean":"2024-09-12T17:39:03.708024+0000","last_became_active":"2024-09-12T17:15:43.158530+0000","last_became_peered":"2024-09-12T17:15:43.158530+0000","last_unstale":"2024-09-12T17:39:03.708024+0000","last_undegraded":"2024-09-12T17:39:03.708024+0000","last_fullsized":"2024-09-12T17:39:03.708024+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:52.110653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10242,"num_write":8,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"265'3","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:01.291728+0000","last_change":"2024-09-12T17:15:40.131385+0000","last_active":"2024-09-12T17:39:01.291728+0000","last_peered":"2024-09-12T17:39:01.291728+0000","last_clean":"2024-09-12T17:39:01.291728+0000","last_became_active":"2024-09-12T17:15:40.130644+0000","last_became_peered":"2024-09-12T17:15:40.130644+0000","last_unstale":"2024-09-12T17:39:01.291728+0000","last_undegraded":"2024-09-12T17:39:01.291728+0000","last_fullsized":"2024-09-12T17:39:01.291728+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:14.166806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"265'14","reported_seq":88,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:16.290475+0000","last_change":"2024-09-12T17:13:54.843769+0000","last_active":"2024-09-12T17:37:16.290475+0000","last_peered":"2024-09-12T17:37:16.290475+0000","last_clean":"2024-09-12T17:37:16.290475+0000","last_became_active":"2024-09-12T17:13:54.843036+0000","last_became_peered":"2024-09-12T17:13:54.843036+0000","last_unstale":"2024-09-12T17:37:16.290475+0000","last_undegraded":"2024-09-12T17:37:16.290475+0000","last_fullsized":"2024-09-12T17:37:16.290475+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:08:22.840485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:36:57.331873+0000","last_change":"2024-09-12T17:27:17.426185+0000","last_active":"2024-09-12T17:36:57.331873+0000","last_peered":"2024-09-12T17:36:57.331873+0000","last_clean":"2024-09-12T17:36:57.331873+0000","last_became_active":"2024-09-12T17:27:17.421187+0000","last_became_peered":"2024-09-12T17:27:17.421187+0000","last_unstale":"2024-09-12T17:36:57.331873+0000","last_undegraded":"2024-09-12T17:36:57.331873+0000","last_fullsized":"2024-09-12T17:36:57.331873+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:54.922802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"265'7","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:18.734815+0000","last_change":"2024-09-12T17:15:43.156779+0000","last_active":"2024-09-12T17:41:18.734815+0000","last_peered":"2024-09-12T17:41:18.734815+0000","last_clean":"2024-09-12T17:41:18.734815+0000","last_became_active":"2024-09-12T17:15:43.155891+0000","last_became_peered":"2024-09-12T17:15:43.155891+0000","last_unstale":"2024-09-12T17:41:18.734815+0000","last_undegraded":"2024-09-12T17:41:18.734815+0000","last_fullsized":"2024-09-12T17:41:18.734815+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:51.266851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8194,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:02.365695+0000","last_change":"2024-09-12T17:15:40.129236+0000","last_active":"2024-09-12T17:39:02.365695+0000","last_peered":"2024-09-12T17:39:02.365695+0000","last_clean":"2024-09-12T17:39:02.365695+0000","last_became_active":"2024-09-12T17:15:40.128470+0000","last_became_peered":"2024-09-12T17:15:40.128470+0000","last_unstale":"2024-09-12T17:39:02.365695+0000","last_undegraded":"2024-09-12T17:39:02.365695+0000","last_fullsized":"2024-09-12T17:39:02.365695+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:17.232330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"265'46","reported_seq":175,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:59.769241+0000","last_change":"2024-09-12T17:13:54.822640+0000","last_active":"2024-09-12T17:38:59.769241+0000","last_peered":"2024-09-12T17:38:59.769241+0000","last_clean":"2024-09-12T17:38:59.769241+0000","last_became_active":"2024-09-12T17:13:54.821816+0000","last_became_peered":"2024-09-12T17:13:54.821816+0000","last_unstale":"2024-09-12T17:38:59.769241+0000","last_undegraded":"2024-09-12T17:38:59.769241+0000","last_fullsized":"2024-09-12T17:38:59.769241+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:01.101266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":166,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"264'1","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:02.362079+0000","last_change":"2024-09-12T17:27:17.423856+0000","last_active":"2024-09-12T17:39:02.362079+0000","last_peered":"2024-09-12T17:39:02.362079+0000","last_clean":"2024-09-12T17:39:02.362079+0000","last_became_active":"2024-09-12T17:27:17.422464+0000","last_became_peered":"2024-09-12T17:27:17.422464+0000","last_unstale":"2024-09-12T17:39:02.362079+0000","last_undegraded":"2024-09-12T17:39:02.362079+0000","last_fullsized":"2024-09-12T17:39:02.362079+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:44.192139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"265'6","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:02.365796+0000","last_change":"2024-09-12T17:15:43.172138+0000","last_active":"2024-09-12T17:39:02.365796+0000","last_peered":"2024-09-12T17:39:02.365796+0000","last_clean":"2024-09-12T17:39:02.365796+0000","last_became_active":"2024-09-12T17:15:43.171254+0000","last_became_peered":"2024-09-12T17:15:43.171254+0000","last_unstale":"2024-09-12T17:39:02.365796+0000","last_undegraded":"2024-09-12T17:39:02.365796+0000","last_fullsized":"2024-09-12T17:39:02.365796+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:22.106658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"265'3","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:01.307298+0000","last_change":"2024-09-12T17:15:40.117718+0000","last_active":"2024-09-12T17:39:01.307298+0000","last_peered":"2024-09-12T17:39:01.307298+0000","last_clean":"2024-09-12T17:39:01.307298+0000","last_became_active":"2024-09-12T17:15:40.116989+0000","last_became_peered":"2024-09-12T17:15:40.116989+0000","last_unstale":"2024-09-12T17:39:01.307298+0000","last_undegraded":"2024-09-12T17:39:01.307298+0000","last_fullsized":"2024-09-12T17:39:01.307298+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:05.611483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4119,"num_write":3,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"265'42","reported_seq":160,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:16.268235+0000","last_change":"2024-09-12T17:13:54.812445+0000","last_active":"2024-09-12T17:37:16.268235+0000","last_peered":"2024-09-12T17:37:16.268235+0000","last_clean":"2024-09-12T17:37:16.268235+0000","last_became_active":"2024-09-12T17:13:54.811613+0000","last_became_peered":"2024-09-12T17:13:54.811613+0000","last_unstale":"2024-09-12T17:37:16.268235+0000","last_undegraded":"2024-09-12T17:37:16.268235+0000","last_fullsized":"2024-09-12T17:37:16.268235+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:57.189420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":153,"num_write":74,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"265'1","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:36:57.335846+0000","last_change":"2024-09-12T17:27:17.405875+0000","last_active":"2024-09-12T17:36:57.335846+0000","last_peered":"2024-09-12T17:36:57.335846+0000","last_clean":"2024-09-12T17:36:57.335846+0000","last_became_active":"2024-09-12T17:27:17.405051+0000","last_became_peered":"2024-09-12T17:27:17.405051+0000","last_unstale":"2024-09-12T17:36:57.335846+0000","last_undegraded":"2024-09-12T17:36:57.335846+0000","last_fullsized":"2024-09-12T17:36:57.335846+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:07.362927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"265'1","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:06.308426+0000","last_change":"2024-09-12T17:15:43.158356+0000","last_active":"2024-09-12T17:39:06.308426+0000","last_peered":"2024-09-12T17:39:06.308426+0000","last_clean":"2024-09-12T17:39:06.308426+0000","last_became_active":"2024-09-12T17:15:43.157624+0000","last_became_peered":"2024-09-12T17:15:43.157624+0000","last_unstale":"2024-09-12T17:39:06.308426+0000","last_undegraded":"2024-09-12T17:39:06.308426+0000","last_fullsized":"2024-09-12T17:39:06.308426+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:44.475418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:02.346406+0000","last_change":"2024-09-12T17:15:40.118796+0000","last_active":"2024-09-12T17:39:02.346406+0000","last_peered":"2024-09-12T17:39:02.346406+0000","last_clean":"2024-09-12T17:39:02.346406+0000","last_became_active":"2024-09-12T17:15:40.118074+0000","last_became_peered":"2024-09-12T17:15:40.118074+0000","last_unstale":"2024-09-12T17:39:02.346406+0000","last_undegraded":"2024-09-12T17:39:02.346406+0000","last_fullsized":"2024-09-12T17:39:02.346406+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:53:01.242885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"265'16","reported_seq":89,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:17.340332+0000","last_change":"2024-09-12T17:13:54.841589+0000","last_active":"2024-09-12T17:37:17.340332+0000","last_peered":"2024-09-12T17:37:17.340332+0000","last_clean":"2024-09-12T17:37:17.340332+0000","last_became_active":"2024-09-12T17:13:54.840781+0000","last_became_peered":"2024-09-12T17:13:54.840781+0000","last_unstale":"2024-09-12T17:37:17.340332+0000","last_undegraded":"2024-09-12T17:37:17.340332+0000","last_fullsized":"2024-09-12T17:37:17.340332+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:48.110422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":56,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:15.273963+0000","last_change":"2024-09-12T17:27:17.409764+0000","last_active":"2024-09-12T17:38:15.273963+0000","last_peered":"2024-09-12T17:38:15.273963+0000","last_clean":"2024-09-12T17:38:15.273963+0000","last_became_active":"2024-09-12T17:27:17.408953+0000","last_became_peered":"2024-09-12T17:27:17.408953+0000","last_unstale":"2024-09-12T17:38:15.273963+0000","last_undegraded":"2024-09-12T17:38:15.273963+0000","last_fullsized":"2024-09-12T17:38:15.273963+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:26.794007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:12.353382+0000","last_change":"2024-09-12T17:15:43.165887+0000","last_active":"2024-09-12T17:38:12.353382+0000","last_peered":"2024-09-12T17:38:12.353382+0000","last_clean":"2024-09-12T17:38:12.353382+0000","last_became_active":"2024-09-12T17:15:43.164943+0000","last_became_peered":"2024-09-12T17:15:43.164943+0000","last_unstale":"2024-09-12T17:38:12.353382+0000","last_undegraded":"2024-09-12T17:38:12.353382+0000","last_fullsized":"2024-09-12T17:38:12.353382+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:08.542268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"265'6","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:11.303936+0000","last_change":"2024-09-12T17:15:40.129503+0000","last_active":"2024-09-12T17:38:11.303936+0000","last_peered":"2024-09-12T17:38:11.303936+0000","last_clean":"2024-09-12T17:38:11.303936+0000","last_became_active":"2024-09-12T17:15:40.128681+0000","last_became_peered":"2024-09-12T17:15:40.128681+0000","last_unstale":"2024-09-12T17:38:11.303936+0000","last_undegraded":"2024-09-12T17:38:11.303936+0000","last_fullsized":"2024-09-12T17:38:11.303936+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:21.306746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":11,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"265'9","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:47.361596+0000","last_change":"2024-09-12T17:13:54.844500+0000","last_active":"2024-09-12T17:38:47.361596+0000","last_peered":"2024-09-12T17:38:47.361596+0000","last_clean":"2024-09-12T17:38:47.361596+0000","last_became_active":"2024-09-12T17:13:54.842287+0000","last_became_peered":"2024-09-12T17:13:54.842287+0000","last_unstale":"2024-09-12T17:38:47.361596+0000","last_undegraded":"2024-09-12T17:38:47.361596+0000","last_fullsized":"2024-09-12T17:38:47.361596+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:09.440211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":28,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:36.309617+0000","last_change":"2024-09-12T17:27:17.416766+0000","last_active":"2024-09-12T17:38:36.309617+0000","last_peered":"2024-09-12T17:38:36.309617+0000","last_clean":"2024-09-12T17:38:36.309617+0000","last_became_active":"2024-09-12T17:27:17.415241+0000","last_became_peered":"2024-09-12T17:27:17.415241+0000","last_unstale":"2024-09-12T17:38:36.309617+0000","last_undegraded":"2024-09-12T17:38:36.309617+0000","last_fullsized":"2024-09-12T17:38:36.309617+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:04.923059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"265'7","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:12.353274+0000","last_change":"2024-09-12T17:15:43.171921+0000","last_active":"2024-09-12T17:38:12.353274+0000","last_peered":"2024-09-12T17:38:12.353274+0000","last_clean":"2024-09-12T17:38:12.353274+0000","last_became_active":"2024-09-12T17:15:43.168676+0000","last_became_peered":"2024-09-12T17:15:43.168676+0000","last_unstale":"2024-09-12T17:38:12.353274+0000","last_undegraded":"2024-09-12T17:38:12.353274+0000","last_fullsized":"2024-09-12T17:38:12.353274+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:51.743678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":24578,"num_write":17,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"265'5","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:10.272991+0000","last_change":"2024-09-12T17:15:40.129433+0000","last_active":"2024-09-12T17:38:10.272991+0000","last_peered":"2024-09-12T17:38:10.272991+0000","last_clean":"2024-09-12T17:38:10.272991+0000","last_became_active":"2024-09-12T17:15:40.128708+0000","last_became_peered":"2024-09-12T17:15:40.128708+0000","last_unstale":"2024-09-12T17:38:10.272991+0000","last_undegraded":"2024-09-12T17:38:10.272991+0000","last_fullsized":"2024-09-12T17:38:10.272991+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:54.970720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8194,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"265'35","reported_seq":144,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:42.341793+0000","last_change":"2024-09-12T17:13:54.830851+0000","last_active":"2024-09-12T17:38:42.341793+0000","last_peered":"2024-09-12T17:38:42.341793+0000","last_clean":"2024-09-12T17:38:42.341793+0000","last_became_active":"2024-09-12T17:13:54.830096+0000","last_became_peered":"2024-09-12T17:13:54.830096+0000","last_unstale":"2024-09-12T17:38:42.341793+0000","last_undegraded":"2024-09-12T17:38:42.341793+0000","last_fullsized":"2024-09-12T17:38:42.341793+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:08.715298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":131,"num_write":60,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:06.295390+0000","last_change":"2024-09-12T17:27:17.412405+0000","last_active":"2024-09-12T17:38:06.295390+0000","last_peered":"2024-09-12T17:38:06.295390+0000","last_clean":"2024-09-12T17:38:06.295390+0000","last_became_active":"2024-09-12T17:27:17.411635+0000","last_became_peered":"2024-09-12T17:27:17.411635+0000","last_unstale":"2024-09-12T17:38:06.295390+0000","last_undegraded":"2024-09-12T17:38:06.295390+0000","last_fullsized":"2024-09-12T17:38:06.295390+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:12.596567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:13.696208+0000","last_change":"2024-09-12T17:15:43.870101+0000","last_active":"2024-09-12T17:38:13.696208+0000","last_peered":"2024-09-12T17:38:13.696208+0000","last_clean":"2024-09-12T17:38:13.696208+0000","last_became_active":"2024-09-12T17:15:43.869197+0000","last_became_peered":"2024-09-12T17:15:43.869197+0000","last_unstale":"2024-09-12T17:38:13.696208+0000","last_undegraded":"2024-09-12T17:38:13.696208+0000","last_fullsized":"2024-09-12T17:38:13.696208+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:50:50.852439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:12.349506+0000","last_change":"2024-09-12T17:15:40.115375+0000","last_active":"2024-09-12T17:38:12.349506+0000","last_peered":"2024-09-12T17:38:12.349506+0000","last_clean":"2024-09-12T17:38:12.349506+0000","last_became_active":"2024-09-12T17:15:40.114636+0000","last_became_peered":"2024-09-12T17:15:40.114636+0000","last_unstale":"2024-09-12T17:38:12.349506+0000","last_undegraded":"2024-09-12T17:38:12.349506+0000","last_fullsized":"2024-09-12T17:38:12.349506+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:25.820396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"265'11","reported_seq":77,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:41.303136+0000","last_change":"2024-09-12T17:13:54.837741+0000","last_active":"2024-09-12T17:38:41.303136+0000","last_peered":"2024-09-12T17:38:41.303136+0000","last_clean":"2024-09-12T17:38:41.303136+0000","last_became_active":"2024-09-12T17:13:54.836955+0000","last_became_peered":"2024-09-12T17:13:54.836955+0000","last_unstale":"2024-09-12T17:38:41.303136+0000","last_undegraded":"2024-09-12T17:38:41.303136+0000","last_fullsized":"2024-09-12T17:38:41.303136+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:27.239370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":38,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:11.303795+0000","last_change":"2024-09-12T17:27:17.409364+0000","last_active":"2024-09-12T17:38:11.303795+0000","last_peered":"2024-09-12T17:38:11.303795+0000","last_clean":"2024-09-12T17:38:11.303795+0000","last_became_active":"2024-09-12T17:27:17.408128+0000","last_became_peered":"2024-09-12T17:27:17.408128+0000","last_unstale":"2024-09-12T17:38:11.303795+0000","last_undegraded":"2024-09-12T17:38:11.303795+0000","last_fullsized":"2024-09-12T17:38:11.303795+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:44.771065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"265'2","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:12.353412+0000","last_change":"2024-09-12T17:15:43.171004+0000","last_active":"2024-09-12T17:38:12.353412+0000","last_peered":"2024-09-12T17:38:12.353412+0000","last_clean":"2024-09-12T17:38:12.353412+0000","last_became_active":"2024-09-12T17:15:43.169936+0000","last_became_peered":"2024-09-12T17:15:43.169936+0000","last_unstale":"2024-09-12T17:38:12.353412+0000","last_undegraded":"2024-09-12T17:38:12.353412+0000","last_fullsized":"2024-09-12T17:38:12.353412+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:21.292046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"265'9","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.083485+0000","last_change":"2024-09-12T17:15:40.122273+0000","last_active":"2024-09-12T17:41:32.083485+0000","last_peered":"2024-09-12T17:41:32.083485+0000","last_clean":"2024-09-12T17:41:32.083485+0000","last_became_active":"2024-09-12T17:15:40.121181+0000","last_became_peered":"2024-09-12T17:15:40.121181+0000","last_unstale":"2024-09-12T17:41:32.083485+0000","last_undegraded":"2024-09-12T17:41:32.083485+0000","last_fullsized":"2024-09-12T17:41:32.083485+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:36.422026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12338,"num_write":14,"num_write_kb":5168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"265'48","reported_seq":176,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:41.282547+0000","last_change":"2024-09-12T17:13:54.842918+0000","last_active":"2024-09-12T17:38:41.282547+0000","last_peered":"2024-09-12T17:38:41.282547+0000","last_clean":"2024-09-12T17:38:41.282547+0000","last_became_active":"2024-09-12T17:13:54.841923+0000","last_became_peered":"2024-09-12T17:13:54.841923+0000","last_unstale":"2024-09-12T17:38:41.282547+0000","last_undegraded":"2024-09-12T17:38:41.282547+0000","last_fullsized":"2024-09-12T17:38:41.282547+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:08.355932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":241,"num_read_kb":172,"num_write":100,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:32.357996+0000","last_change":"2024-09-12T17:27:17.419285+0000","last_active":"2024-09-12T17:38:32.357996+0000","last_peered":"2024-09-12T17:38:32.357996+0000","last_clean":"2024-09-12T17:38:32.357996+0000","last_became_active":"2024-09-12T17:27:17.417566+0000","last_became_peered":"2024-09-12T17:27:17.417566+0000","last_unstale":"2024-09-12T17:38:32.357996+0000","last_undegraded":"2024-09-12T17:38:32.357996+0000","last_fullsized":"2024-09-12T17:38:32.357996+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:32.507294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"262'4","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:26.270382+0000","last_change":"2024-09-12T17:15:43.162593+0000","last_active":"2024-09-12T17:37:26.270382+0000","last_peered":"2024-09-12T17:37:26.270382+0000","last_clean":"2024-09-12T17:37:26.270382+0000","last_became_active":"2024-09-12T17:15:43.161858+0000","last_became_peered":"2024-09-12T17:15:43.161858+0000","last_unstale":"2024-09-12T17:37:26.270382+0000","last_undegraded":"2024-09-12T17:37:26.270382+0000","last_fullsized":"2024-09-12T17:37:26.270382+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:23.655020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:22.337556+0000","last_change":"2024-09-12T17:15:40.113046+0000","last_active":"2024-09-12T17:37:22.337556+0000","last_peered":"2024-09-12T17:37:22.337556+0000","last_clean":"2024-09-12T17:37:22.337556+0000","last_became_active":"2024-09-12T17:15:40.112179+0000","last_became_peered":"2024-09-12T17:15:40.112179+0000","last_unstale":"2024-09-12T17:37:22.337556+0000","last_undegraded":"2024-09-12T17:37:22.337556+0000","last_fullsized":"2024-09-12T17:37:22.337556+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:35.125445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"265'67","reported_seq":229,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:42.356505+0000","last_change":"2024-09-12T17:13:54.828364+0000","last_active":"2024-09-12T17:38:42.356505+0000","last_peered":"2024-09-12T17:38:42.356505+0000","last_clean":"2024-09-12T17:38:42.356505+0000","last_became_active":"2024-09-12T17:13:54.827402+0000","last_became_peered":"2024-09-12T17:13:54.827402+0000","last_unstale":"2024-09-12T17:38:42.356505+0000","last_undegraded":"2024-09-12T17:38:42.356505+0000","last_fullsized":"2024-09-12T17:38:42.356505+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:52.664896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":342,"num_read_kb":248,"num_write":117,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:41.310813+0000","last_change":"2024-09-12T17:27:17.418505+0000","last_active":"2024-09-12T17:38:41.310813+0000","last_peered":"2024-09-12T17:38:41.310813+0000","last_clean":"2024-09-12T17:38:41.310813+0000","last_became_active":"2024-09-12T17:27:17.418022+0000","last_became_peered":"2024-09-12T17:27:17.418022+0000","last_unstale":"2024-09-12T17:38:41.310813+0000","last_undegraded":"2024-09-12T17:38:41.310813+0000","last_fullsized":"2024-09-12T17:38:41.310813+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:55.678220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"265'4","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:26.292871+0000","last_change":"2024-09-12T17:15:43.865245+0000","last_active":"2024-09-12T17:37:26.292871+0000","last_peered":"2024-09-12T17:37:26.292871+0000","last_clean":"2024-09-12T17:37:26.292871+0000","last_became_active":"2024-09-12T17:15:43.864657+0000","last_became_peered":"2024-09-12T17:15:43.864657+0000","last_unstale":"2024-09-12T17:37:26.292871+0000","last_undegraded":"2024-09-12T17:37:26.292871+0000","last_fullsized":"2024-09-12T17:37:26.292871+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:57.152668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":9,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"265'12","reported_seq":67,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:33.714998+0000","last_change":"2024-09-12T17:15:40.123025+0000","last_active":"2024-09-12T17:39:33.714998+0000","last_peered":"2024-09-12T17:39:33.714998+0000","last_clean":"2024-09-12T17:39:33.714998+0000","last_became_active":"2024-09-12T17:15:40.122001+0000","last_became_peered":"2024-09-12T17:15:40.122001+0000","last_unstale":"2024-09-12T17:39:33.714998+0000","last_undegraded":"2024-09-12T17:39:33.714998+0000","last_fullsized":"2024-09-12T17:39:33.714998+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:47.430779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12340,"num_write":12,"num_write_kb":6192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"265'23","reported_seq":105,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:51.298999+0000","last_change":"2024-09-12T17:13:54.831219+0000","last_active":"2024-09-12T17:37:51.298999+0000","last_peered":"2024-09-12T17:37:51.298999+0000","last_clean":"2024-09-12T17:37:51.298999+0000","last_became_active":"2024-09-12T17:13:54.825019+0000","last_became_peered":"2024-09-12T17:13:54.825019+0000","last_unstale":"2024-09-12T17:37:51.298999+0000","last_undegraded":"2024-09-12T17:37:51.298999+0000","last_fullsized":"2024-09-12T17:37:51.298999+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:13.461017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":38,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"265'1","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:36.309680+0000","last_change":"2024-09-12T17:27:17.408731+0000","last_active":"2024-09-12T17:38:36.309680+0000","last_peered":"2024-09-12T17:38:36.309680+0000","last_clean":"2024-09-12T17:38:36.309680+0000","last_became_active":"2024-09-12T17:27:17.408151+0000","last_became_peered":"2024-09-12T17:27:17.408151+0000","last_unstale":"2024-09-12T17:38:36.309680+0000","last_undegraded":"2024-09-12T17:38:36.309680+0000","last_fullsized":"2024-09-12T17:38:36.309680+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:04.214744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"265'7","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.648854+0000","last_change":"2024-09-12T17:15:43.167300+0000","last_active":"2024-09-12T17:41:32.648854+0000","last_peered":"2024-09-12T17:41:32.648854+0000","last_clean":"2024-09-12T17:41:32.648854+0000","last_became_active":"2024-09-12T17:15:43.166482+0000","last_became_peered":"2024-09-12T17:15:43.166482+0000","last_unstale":"2024-09-12T17:41:32.648854+0000","last_undegraded":"2024-09-12T17:41:32.648854+0000","last_fullsized":"2024-09-12T17:41:32.648854+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:11.626906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:27.338914+0000","last_change":"2024-09-12T17:15:40.138867+0000","last_active":"2024-09-12T17:37:27.338914+0000","last_peered":"2024-09-12T17:37:27.338914+0000","last_clean":"2024-09-12T17:37:27.338914+0000","last_became_active":"2024-09-12T17:15:40.138190+0000","last_became_peered":"2024-09-12T17:15:40.138190+0000","last_unstale":"2024-09-12T17:37:27.338914+0000","last_undegraded":"2024-09-12T17:37:27.338914+0000","last_fullsized":"2024-09-12T17:37:27.338914+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:31.598623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"265'18","reported_seq":93,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:47.347138+0000","last_change":"2024-09-12T17:13:54.833230+0000","last_active":"2024-09-12T17:37:47.347138+0000","last_peered":"2024-09-12T17:37:47.347138+0000","last_clean":"2024-09-12T17:37:47.347138+0000","last_became_active":"2024-09-12T17:13:54.832453+0000","last_became_peered":"2024-09-12T17:13:54.832453+0000","last_unstale":"2024-09-12T17:37:47.347138+0000","last_undegraded":"2024-09-12T17:37:47.347138+0000","last_fullsized":"2024-09-12T17:37:47.347138+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:14.336440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":60,"num_write":35,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:32.354215+0000","last_change":"2024-09-12T17:27:17.418555+0000","last_active":"2024-09-12T17:38:32.354215+0000","last_peered":"2024-09-12T17:38:32.354215+0000","last_clean":"2024-09-12T17:38:32.354215+0000","last_became_active":"2024-09-12T17:27:17.417574+0000","last_became_peered":"2024-09-12T17:27:17.417574+0000","last_unstale":"2024-09-12T17:38:32.354215+0000","last_undegraded":"2024-09-12T17:38:32.354215+0000","last_fullsized":"2024-09-12T17:38:32.354215+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:54.585796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"265'2","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:31.294406+0000","last_change":"2024-09-12T17:15:43.151790+0000","last_active":"2024-09-12T17:37:31.294406+0000","last_peered":"2024-09-12T17:37:31.294406+0000","last_clean":"2024-09-12T17:37:31.294406+0000","last_became_active":"2024-09-12T17:15:43.151000+0000","last_became_peered":"2024-09-12T17:15:43.151000+0000","last_unstale":"2024-09-12T17:37:31.294406+0000","last_undegraded":"2024-09-12T17:37:31.294406+0000","last_fullsized":"2024-09-12T17:37:31.294406+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:26:12.163255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"262'2","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:11.280772+0000","last_change":"2024-09-12T17:15:40.119321+0000","last_active":"2024-09-12T17:38:11.280772+0000","last_peered":"2024-09-12T17:38:11.280772+0000","last_clean":"2024-09-12T17:38:11.280772+0000","last_became_active":"2024-09-12T17:15:40.118469+0000","last_became_peered":"2024-09-12T17:15:40.118469+0000","last_unstale":"2024-09-12T17:38:11.280772+0000","last_undegraded":"2024-09-12T17:38:11.280772+0000","last_fullsized":"2024-09-12T17:38:11.280772+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:28.762279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"265'20","reported_seq":99,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:46.290866+0000","last_change":"2024-09-12T17:13:54.828421+0000","last_active":"2024-09-12T17:37:46.290866+0000","last_peered":"2024-09-12T17:37:46.290866+0000","last_clean":"2024-09-12T17:37:46.290866+0000","last_became_active":"2024-09-12T17:13:54.827570+0000","last_became_peered":"2024-09-12T17:13:54.827570+0000","last_unstale":"2024-09-12T17:37:46.290866+0000","last_undegraded":"2024-09-12T17:37:46.290866+0000","last_fullsized":"2024-09-12T17:37:46.290866+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:42.149748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":63,"num_write":42,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:46.297919+0000","last_change":"2024-09-12T17:27:17.411486+0000","last_active":"2024-09-12T17:37:46.297919+0000","last_peered":"2024-09-12T17:37:46.297919+0000","last_clean":"2024-09-12T17:37:46.297919+0000","last_became_active":"2024-09-12T17:27:17.411175+0000","last_became_peered":"2024-09-12T17:27:17.411175+0000","last_unstale":"2024-09-12T17:37:46.297919+0000","last_undegraded":"2024-09-12T17:37:46.297919+0000","last_fullsized":"2024-09-12T17:37:46.297919+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:59.115945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"265'4","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:42.356637+0000","last_change":"2024-09-12T17:15:43.159928+0000","last_active":"2024-09-12T17:38:42.356637+0000","last_peered":"2024-09-12T17:38:42.356637+0000","last_clean":"2024-09-12T17:38:42.356637+0000","last_became_active":"2024-09-12T17:15:43.159149+0000","last_became_peered":"2024-09-12T17:15:43.159149+0000","last_unstale":"2024-09-12T17:38:42.356637+0000","last_undegraded":"2024-09-12T17:38:42.356637+0000","last_fullsized":"2024-09-12T17:38:42.356637+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:34.107337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":9,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"265'6","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:36.309657+0000","last_change":"2024-09-12T17:15:40.122291+0000","last_active":"2024-09-12T17:38:36.309657+0000","last_peered":"2024-09-12T17:38:36.309657+0000","last_clean":"2024-09-12T17:38:36.309657+0000","last_became_active":"2024-09-12T17:15:40.121513+0000","last_became_peered":"2024-09-12T17:15:40.121513+0000","last_unstale":"2024-09-12T17:38:36.309657+0000","last_undegraded":"2024-09-12T17:38:36.309657+0000","last_fullsized":"2024-09-12T17:38:36.309657+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:00.339305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":11,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"265'31","reported_seq":131,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:47.343574+0000","last_change":"2024-09-12T17:13:54.830067+0000","last_active":"2024-09-12T17:37:47.343574+0000","last_peered":"2024-09-12T17:37:47.343574+0000","last_clean":"2024-09-12T17:37:47.343574+0000","last_became_active":"2024-09-12T17:13:54.828393+0000","last_became_peered":"2024-09-12T17:13:54.828393+0000","last_unstale":"2024-09-12T17:37:47.343574+0000","last_undegraded":"2024-09-12T17:37:47.343574+0000","last_fullsized":"2024-09-12T17:37:47.343574+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:22:33.149059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":109,"num_write":58,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:42.328164+0000","last_change":"2024-09-12T17:27:17.402782+0000","last_active":"2024-09-12T17:37:42.328164+0000","last_peered":"2024-09-12T17:37:42.328164+0000","last_clean":"2024-09-12T17:37:42.328164+0000","last_became_active":"2024-09-12T17:27:17.402024+0000","last_became_peered":"2024-09-12T17:27:17.402024+0000","last_unstale":"2024-09-12T17:37:42.328164+0000","last_undegraded":"2024-09-12T17:37:42.328164+0000","last_fullsized":"2024-09-12T17:37:42.328164+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:24.176691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:37.355395+0000","last_change":"2024-09-12T17:15:43.871865+0000","last_active":"2024-09-12T17:38:37.355395+0000","last_peered":"2024-09-12T17:38:37.355395+0000","last_clean":"2024-09-12T17:38:37.355395+0000","last_became_active":"2024-09-12T17:15:43.871095+0000","last_became_peered":"2024-09-12T17:15:43.871095+0000","last_unstale":"2024-09-12T17:38:37.355395+0000","last_undegraded":"2024-09-12T17:38:37.355395+0000","last_fullsized":"2024-09-12T17:38:37.355395+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:26.988527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'7","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:40.279107+0000","last_change":"2024-09-12T17:15:40.126453+0000","last_active":"2024-09-12T17:38:40.279107+0000","last_peered":"2024-09-12T17:38:40.279107+0000","last_clean":"2024-09-12T17:38:40.279107+0000","last_became_active":"2024-09-12T17:15:40.125684+0000","last_became_peered":"2024-09-12T17:15:40.125684+0000","last_unstale":"2024-09-12T17:38:40.279107+0000","last_undegraded":"2024-09-12T17:38:40.279107+0000","last_fullsized":"2024-09-12T17:38:40.279107+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:40.660204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":32770,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"265'38","reported_seq":147,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:46.291003+0000","last_change":"2024-09-12T17:13:54.826751+0000","last_active":"2024-09-12T17:37:46.291003+0000","last_peered":"2024-09-12T17:37:46.291003+0000","last_clean":"2024-09-12T17:37:46.291003+0000","last_became_active":"2024-09-12T17:13:54.825945+0000","last_became_peered":"2024-09-12T17:13:54.825945+0000","last_unstale":"2024-09-12T17:37:46.291003+0000","last_undegraded":"2024-09-12T17:37:46.291003+0000","last_fullsized":"2024-09-12T17:37:46.291003+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:17.823826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":132,"num_write":66,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:18.711398+0000","last_change":"2024-09-12T17:27:17.409234+0000","last_active":"2024-09-12T17:39:18.711398+0000","last_peered":"2024-09-12T17:39:18.711398+0000","last_clean":"2024-09-12T17:39:18.711398+0000","last_became_active":"2024-09-12T17:27:17.408445+0000","last_became_peered":"2024-09-12T17:27:17.408445+0000","last_unstale":"2024-09-12T17:39:18.711398+0000","last_undegraded":"2024-09-12T17:39:18.711398+0000","last_fullsized":"2024-09-12T17:39:18.711398+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:52.795384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:26.293254+0000","last_change":"2024-09-12T17:15:43.867204+0000","last_active":"2024-09-12T17:37:26.293254+0000","last_peered":"2024-09-12T17:37:26.293254+0000","last_clean":"2024-09-12T17:37:26.293254+0000","last_became_active":"2024-09-12T17:15:43.866375+0000","last_became_peered":"2024-09-12T17:15:43.866375+0000","last_unstale":"2024-09-12T17:37:26.293254+0000","last_undegraded":"2024-09-12T17:37:26.293254+0000","last_fullsized":"2024-09-12T17:37:26.293254+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:23:05.372335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"265'5","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:32.352788+0000","last_change":"2024-09-12T17:15:40.125566+0000","last_active":"2024-09-12T17:39:32.352788+0000","last_peered":"2024-09-12T17:39:32.352788+0000","last_clean":"2024-09-12T17:39:32.352788+0000","last_became_active":"2024-09-12T17:15:40.124901+0000","last_became_peered":"2024-09-12T17:15:40.124901+0000","last_unstale":"2024-09-12T17:39:32.352788+0000","last_undegraded":"2024-09-12T17:39:32.352788+0000","last_fullsized":"2024-09-12T17:39:32.352788+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:00.285681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"265'32","reported_seq":130,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:01.315756+0000","last_change":"2024-09-12T17:13:54.830950+0000","last_active":"2024-09-12T17:39:01.315756+0000","last_peered":"2024-09-12T17:39:01.315756+0000","last_clean":"2024-09-12T17:39:01.315756+0000","last_became_active":"2024-09-12T17:13:54.824810+0000","last_became_peered":"2024-09-12T17:13:54.824810+0000","last_unstale":"2024-09-12T17:39:01.315756+0000","last_undegraded":"2024-09-12T17:39:01.315756+0000","last_fullsized":"2024-09-12T17:39:01.315756+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:18.942711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":107,"num_write":61,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:46.274844+0000","last_change":"2024-09-12T17:27:17.410104+0000","last_active":"2024-09-12T17:37:46.274844+0000","last_peered":"2024-09-12T17:37:46.274844+0000","last_clean":"2024-09-12T17:37:46.274844+0000","last_became_active":"2024-09-12T17:27:17.409774+0000","last_became_peered":"2024-09-12T17:27:17.409774+0000","last_unstale":"2024-09-12T17:37:46.274844+0000","last_undegraded":"2024-09-12T17:37:46.274844+0000","last_fullsized":"2024-09-12T17:37:46.274844+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:24.438283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:26.270554+0000","last_change":"2024-09-12T17:15:43.171491+0000","last_active":"2024-09-12T17:37:26.270554+0000","last_peered":"2024-09-12T17:37:26.270554+0000","last_clean":"2024-09-12T17:37:26.270554+0000","last_became_active":"2024-09-12T17:15:43.167221+0000","last_became_peered":"2024-09-12T17:15:43.167221+0000","last_unstale":"2024-09-12T17:37:26.270554+0000","last_undegraded":"2024-09-12T17:37:26.270554+0000","last_fullsized":"2024-09-12T17:37:26.270554+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:22.949060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"262'5","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:21.291867+0000","last_change":"2024-09-12T17:15:40.131852+0000","last_active":"2024-09-12T17:37:21.291867+0000","last_peered":"2024-09-12T17:37:21.291867+0000","last_clean":"2024-09-12T17:37:21.291867+0000","last_became_active":"2024-09-12T17:15:40.131162+0000","last_became_peered":"2024-09-12T17:15:40.131162+0000","last_unstale":"2024-09-12T17:37:21.291867+0000","last_undegraded":"2024-09-12T17:37:21.291867+0000","last_fullsized":"2024-09-12T17:37:21.291867+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:28.505817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"262'228","reported_seq":763,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:58.706524+0000","last_change":"2024-09-12T17:13:54.825163+0000","last_active":"2024-09-12T17:38:58.706524+0000","last_peered":"2024-09-12T17:38:58.706524+0000","last_clean":"2024-09-12T17:38:58.706524+0000","last_became_active":"2024-09-12T17:13:54.824372+0000","last_became_peered":"2024-09-12T17:13:54.824372+0000","last_unstale":"2024-09-12T17:38:58.706524+0000","last_undegraded":"2024-09-12T17:38:58.706524+0000","last_fullsized":"2024-09-12T17:38:58.706524+0000","mapping_epoch":252,"log_start":"262'200","ondisk_log_start":"262'200","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:21.156675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1417,"num_read_kb":1102,"num_write":261,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"265'1","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:10.273048+0000","last_change":"2024-09-12T17:27:17.404784+0000","last_active":"2024-09-12T17:38:10.273048+0000","last_peered":"2024-09-12T17:38:10.273048+0000","last_clean":"2024-09-12T17:38:10.273048+0000","last_became_active":"2024-09-12T17:27:17.404001+0000","last_became_peered":"2024-09-12T17:27:17.404001+0000","last_unstale":"2024-09-12T17:38:10.273048+0000","last_undegraded":"2024-09-12T17:38:10.273048+0000","last_fullsized":"2024-09-12T17:38:10.273048+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:30.724589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:33.700764+0000","last_change":"2024-09-12T17:15:43.159967+0000","last_active":"2024-09-12T17:38:33.700764+0000","last_peered":"2024-09-12T17:38:33.700764+0000","last_clean":"2024-09-12T17:38:33.700764+0000","last_became_active":"2024-09-12T17:15:43.159256+0000","last_became_peered":"2024-09-12T17:15:43.159256+0000","last_unstale":"2024-09-12T17:38:33.700764+0000","last_undegraded":"2024-09-12T17:38:33.700764+0000","last_fullsized":"2024-09-12T17:38:33.700764+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:56.377319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"265'1","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:46.297815+0000","last_change":"2024-09-12T17:15:40.139358+0000","last_active":"2024-09-12T17:37:46.297815+0000","last_peered":"2024-09-12T17:37:46.297815+0000","last_clean":"2024-09-12T17:37:46.297815+0000","last_became_active":"2024-09-12T17:15:40.138844+0000","last_became_peered":"2024-09-12T17:15:40.138844+0000","last_unstale":"2024-09-12T17:37:46.297815+0000","last_undegraded":"2024-09-12T17:37:46.297815+0000","last_fullsized":"2024-09-12T17:37:46.297815+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:16.913094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"265'38","reported_seq":148,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:57.345346+0000","last_change":"2024-09-12T17:13:54.831688+0000","last_active":"2024-09-12T17:38:57.345346+0000","last_peered":"2024-09-12T17:38:57.345346+0000","last_clean":"2024-09-12T17:38:57.345346+0000","last_became_active":"2024-09-12T17:13:54.830999+0000","last_became_peered":"2024-09-12T17:13:54.830999+0000","last_unstale":"2024-09-12T17:38:57.345346+0000","last_undegraded":"2024-09-12T17:38:57.345346+0000","last_fullsized":"2024-09-12T17:38:57.345346+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:34.484369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":129,"num_write":64,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:07.348306+0000","last_change":"2024-09-12T17:27:17.413681+0000","last_active":"2024-09-12T17:38:07.348306+0000","last_peered":"2024-09-12T17:38:07.348306+0000","last_clean":"2024-09-12T17:38:07.348306+0000","last_became_active":"2024-09-12T17:27:17.412921+0000","last_became_peered":"2024-09-12T17:27:17.412921+0000","last_unstale":"2024-09-12T17:38:07.348306+0000","last_undegraded":"2024-09-12T17:38:07.348306+0000","last_fullsized":"2024-09-12T17:38:07.348306+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:10.295122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"265'2","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:47.329147+0000","last_change":"2024-09-12T17:15:43.155640+0000","last_active":"2024-09-12T17:37:47.329147+0000","last_peered":"2024-09-12T17:37:47.329147+0000","last_clean":"2024-09-12T17:37:47.329147+0000","last_became_active":"2024-09-12T17:15:43.154940+0000","last_became_peered":"2024-09-12T17:15:43.154940+0000","last_unstale":"2024-09-12T17:37:47.329147+0000","last_undegraded":"2024-09-12T17:37:47.329147+0000","last_fullsized":"2024-09-12T17:37:47.329147+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:09:53.313111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:36.309541+0000","last_change":"2024-09-12T17:15:40.127548+0000","last_active":"2024-09-12T17:38:36.309541+0000","last_peered":"2024-09-12T17:38:36.309541+0000","last_clean":"2024-09-12T17:38:36.309541+0000","last_became_active":"2024-09-12T17:15:40.126745+0000","last_became_peered":"2024-09-12T17:15:40.126745+0000","last_unstale":"2024-09-12T17:38:36.309541+0000","last_undegraded":"2024-09-12T17:38:36.309541+0000","last_fullsized":"2024-09-12T17:38:36.309541+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:58.903944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"265'14","reported_seq":86,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:32.319736+0000","last_change":"2024-09-12T17:13:54.841357+0000","last_active":"2024-09-12T17:39:32.319736+0000","last_peered":"2024-09-12T17:39:32.319736+0000","last_clean":"2024-09-12T17:39:32.319736+0000","last_became_active":"2024-09-12T17:13:54.840501+0000","last_became_peered":"2024-09-12T17:13:54.840501+0000","last_unstale":"2024-09-12T17:39:32.319736+0000","last_undegraded":"2024-09-12T17:39:32.319736+0000","last_fullsized":"2024-09-12T17:39:32.319736+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:07:40.561312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":51,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:42.342324+0000","last_change":"2024-09-12T17:27:17.423169+0000","last_active":"2024-09-12T17:37:42.342324+0000","last_peered":"2024-09-12T17:37:42.342324+0000","last_clean":"2024-09-12T17:37:42.342324+0000","last_became_active":"2024-09-12T17:27:17.421504+0000","last_became_peered":"2024-09-12T17:27:17.421504+0000","last_unstale":"2024-09-12T17:37:42.342324+0000","last_undegraded":"2024-09-12T17:37:42.342324+0000","last_fullsized":"2024-09-12T17:37:42.342324+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:59.982039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"265'2","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:41.303042+0000","last_change":"2024-09-12T17:15:43.163468+0000","last_active":"2024-09-12T17:38:41.303042+0000","last_peered":"2024-09-12T17:38:41.303042+0000","last_clean":"2024-09-12T17:38:41.303042+0000","last_became_active":"2024-09-12T17:15:43.162406+0000","last_became_peered":"2024-09-12T17:15:43.162406+0000","last_unstale":"2024-09-12T17:38:41.303042+0000","last_undegraded":"2024-09-12T17:38:41.303042+0000","last_fullsized":"2024-09-12T17:38:41.303042+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:52.019907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"265'11","reported_seq":60,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.733819+0000","last_change":"2024-09-12T17:15:40.116483+0000","last_active":"2024-09-12T17:41:32.733819+0000","last_peered":"2024-09-12T17:41:32.733819+0000","last_clean":"2024-09-12T17:41:32.733819+0000","last_became_active":"2024-09-12T17:15:40.115746+0000","last_became_peered":"2024-09-12T17:15:40.115746+0000","last_unstale":"2024-09-12T17:41:32.733819+0000","last_undegraded":"2024-09-12T17:41:32.733819+0000","last_fullsized":"2024-09-12T17:41:32.733819+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:04.139173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12288,"num_write":16,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"265'17","reported_seq":96,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:31.674540+0000","last_change":"2024-09-12T17:13:54.838973+0000","last_active":"2024-09-12T17:39:31.674540+0000","last_peered":"2024-09-12T17:39:31.674540+0000","last_clean":"2024-09-12T17:39:31.674540+0000","last_became_active":"2024-09-12T17:13:54.838008+0000","last_became_peered":"2024-09-12T17:13:54.838008+0000","last_unstale":"2024-09-12T17:39:31.674540+0000","last_undegraded":"2024-09-12T17:39:31.674540+0000","last_fullsized":"2024-09-12T17:39:31.674540+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:41.998918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":61,"num_write":32,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:51.299103+0000","last_change":"2024-09-12T17:27:17.409064+0000","last_active":"2024-09-12T17:37:51.299103+0000","last_peered":"2024-09-12T17:37:51.299103+0000","last_clean":"2024-09-12T17:37:51.299103+0000","last_became_active":"2024-09-12T17:27:17.408296+0000","last_became_peered":"2024-09-12T17:27:17.408296+0000","last_unstale":"2024-09-12T17:37:51.299103+0000","last_undegraded":"2024-09-12T17:37:51.299103+0000","last_fullsized":"2024-09-12T17:37:51.299103+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:40.080273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"265'5","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:41.287411+0000","last_change":"2024-09-12T17:15:43.165243+0000","last_active":"2024-09-12T17:38:41.287411+0000","last_peered":"2024-09-12T17:38:41.287411+0000","last_clean":"2024-09-12T17:38:41.287411+0000","last_became_active":"2024-09-12T17:15:43.163824+0000","last_became_peered":"2024-09-12T17:15:43.163824+0000","last_unstale":"2024-09-12T17:38:41.287411+0000","last_undegraded":"2024-09-12T17:38:41.287411+0000","last_fullsized":"2024-09-12T17:38:41.287411+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:49.835850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":5122,"num_write":5,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:36.301685+0000","last_change":"2024-09-12T17:15:40.115586+0000","last_active":"2024-09-12T17:38:36.301685+0000","last_peered":"2024-09-12T17:38:36.301685+0000","last_clean":"2024-09-12T17:38:36.301685+0000","last_became_active":"2024-09-12T17:15:40.114860+0000","last_became_peered":"2024-09-12T17:15:40.114860+0000","last_unstale":"2024-09-12T17:38:36.301685+0000","last_undegraded":"2024-09-12T17:38:36.301685+0000","last_fullsized":"2024-09-12T17:38:36.301685+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:40:36.955089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"265'55","reported_seq":197,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:56.027098+0000","last_change":"2024-09-12T17:13:54.833779+0000","last_active":"2024-09-12T17:38:56.027098+0000","last_peered":"2024-09-12T17:38:56.027098+0000","last_clean":"2024-09-12T17:38:56.027098+0000","last_became_active":"2024-09-12T17:13:54.832949+0000","last_became_peered":"2024-09-12T17:13:54.832949+0000","last_unstale":"2024-09-12T17:38:56.027098+0000","last_undegraded":"2024-09-12T17:38:56.027098+0000","last_fullsized":"2024-09-12T17:38:56.027098+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:16.134614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":283,"num_read_kb":200,"num_write":95,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"265'313","reported_seq":1004,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:01.804770+0000","last_change":"2024-09-12T16:58:18.717372+0000","last_active":"2024-09-12T17:40:01.804770+0000","last_peered":"2024-09-12T17:40:01.804770+0000","last_clean":"2024-09-12T17:40:01.804770+0000","last_became_active":"2024-09-12T16:58:18.713754+0000","last_became_peered":"2024-09-12T16:58:18.713754+0000","last_unstale":"2024-09-12T17:40:01.804770+0000","last_undegraded":"2024-09-12T17:40:01.804770+0000","last_fullsized":"2024-09-12T17:40:01.804770+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:28.092364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14978175,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":556,"num_read_kb":52178,"num_write":1174,"num_write_kb":52679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"265'127","reported_seq":726,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:04.402662+0000","last_change":"2024-09-12T16:58:21.709064+0000","last_active":"2024-09-12T17:40:04.402662+0000","last_peered":"2024-09-12T17:40:04.402662+0000","last_clean":"2024-09-12T17:40:04.402662+0000","last_became_active":"2024-09-12T16:58:21.708409+0000","last_became_peered":"2024-09-12T16:58:21.708409+0000","last_unstale":"2024-09-12T17:40:04.402662+0000","last_undegraded":"2024-09-12T17:40:04.402662+0000","last_fullsized":"2024-09-12T17:40:04.402662+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:23.027142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":568,"num_read_kb":472,"num_write":186,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"265'358","reported_seq":983,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.309772+0000","last_change":"2024-09-12T16:58:18.700441+0000","last_active":"2024-09-12T17:41:33.309772+0000","last_peered":"2024-09-12T17:41:33.309772+0000","last_clean":"2024-09-12T17:41:33.309772+0000","last_became_active":"2024-09-12T16:58:18.699994+0000","last_became_peered":"2024-09-12T16:58:18.699994+0000","last_unstale":"2024-09-12T17:41:33.309772+0000","last_undegraded":"2024-09-12T17:41:33.309772+0000","last_fullsized":"2024-09-12T17:41:33.309772+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:51.655272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263228,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":513,"num_read_kb":14780,"num_write":1119,"num_write_kb":32109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"265'61","reported_seq":640,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:48.739807+0000","last_change":"2024-09-12T16:58:21.722398+0000","last_active":"2024-09-12T17:39:48.739807+0000","last_peered":"2024-09-12T17:39:48.739807+0000","last_clean":"2024-09-12T17:39:48.739807+0000","last_became_active":"2024-09-12T16:58:21.721536+0000","last_became_peered":"2024-09-12T16:58:21.721536+0000","last_unstale":"2024-09-12T17:39:48.739807+0000","last_undegraded":"2024-09-12T17:39:48.739807+0000","last_fullsized":"2024-09-12T17:39:48.739807+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:56:41.263387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":297,"num_read_kb":264,"num_write":81,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"265'374","reported_seq":1181,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.358568+0000","last_change":"2024-09-12T16:58:18.688221+0000","last_active":"2024-09-12T17:41:32.358568+0000","last_peered":"2024-09-12T17:41:32.358568+0000","last_clean":"2024-09-12T17:41:32.358568+0000","last_became_active":"2024-09-12T16:58:18.687865+0000","last_became_peered":"2024-09-12T16:58:18.687865+0000","last_unstale":"2024-09-12T17:41:32.358568+0000","last_undegraded":"2024-09-12T17:41:32.358568+0000","last_fullsized":"2024-09-12T17:41:32.358568+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:22:44.289065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11074412,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1020,"num_read_kb":27565,"num_write":1513,"num_write_kb":41677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"265'166","reported_seq":760,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:33.434442+0000","last_change":"2024-09-12T16:58:21.704684+0000","last_active":"2024-09-12T17:38:33.434442+0000","last_peered":"2024-09-12T17:38:33.434442+0000","last_clean":"2024-09-12T17:38:33.434442+0000","last_became_active":"2024-09-12T16:58:21.703861+0000","last_became_peered":"2024-09-12T16:58:21.703861+0000","last_unstale":"2024-09-12T17:38:33.434442+0000","last_undegraded":"2024-09-12T17:38:33.434442+0000","last_fullsized":"2024-09-12T17:38:33.434442+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:16.015246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":693,"num_read_kb":563,"num_write":272,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"265'314","reported_seq":967,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.321427+0000","last_change":"2024-09-12T16:58:18.717382+0000","last_active":"2024-09-12T17:41:32.321427+0000","last_peered":"2024-09-12T17:41:32.321427+0000","last_clean":"2024-09-12T17:41:32.321427+0000","last_became_active":"2024-09-12T16:58:18.716783+0000","last_became_peered":"2024-09-12T16:58:18.716783+0000","last_unstale":"2024-09-12T17:41:32.321427+0000","last_undegraded":"2024-09-12T17:41:32.321427+0000","last_fullsized":"2024-09-12T17:41:32.321427+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:09:30.963463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7238482,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":489,"num_read_kb":33905,"num_write":1152,"num_write_kb":31442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"265'206","reported_seq":808,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:23.453730+0000","last_change":"2024-09-12T16:58:21.700629+0000","last_active":"2024-09-12T17:39:23.453730+0000","last_peered":"2024-09-12T17:39:23.453730+0000","last_clean":"2024-09-12T17:39:23.453730+0000","last_became_active":"2024-09-12T16:58:21.699869+0000","last_became_peered":"2024-09-12T16:58:21.699869+0000","last_unstale":"2024-09-12T17:39:23.453730+0000","last_undegraded":"2024-09-12T17:39:23.453730+0000","last_fullsized":"2024-09-12T17:39:23.453730+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:31:52.012945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":874,"num_read_kb":727,"num_write":307,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"265'291","reported_seq":955,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:32.483128+0000","last_change":"2024-09-12T16:58:18.689386+0000","last_active":"2024-09-12T17:39:32.483128+0000","last_peered":"2024-09-12T17:39:32.483128+0000","last_clean":"2024-09-12T17:39:32.483128+0000","last_became_active":"2024-09-12T16:58:18.688345+0000","last_became_peered":"2024-09-12T16:58:18.688345+0000","last_unstale":"2024-09-12T17:39:32.483128+0000","last_undegraded":"2024-09-12T17:39:32.483128+0000","last_fullsized":"2024-09-12T17:39:32.483128+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:07.865303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7953469,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":524,"num_read_kb":27999,"num_write":1068,"num_write_kb":20285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"265'277","reported_seq":920,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:59.523406+0000","last_change":"2024-09-12T16:58:21.710632+0000","last_active":"2024-09-12T17:38:59.523406+0000","last_peered":"2024-09-12T17:38:59.523406+0000","last_clean":"2024-09-12T17:38:59.523406+0000","last_became_active":"2024-09-12T16:58:21.709879+0000","last_became_peered":"2024-09-12T16:58:21.709879+0000","last_unstale":"2024-09-12T17:38:59.523406+0000","last_undegraded":"2024-09-12T17:38:59.523406+0000","last_fullsized":"2024-09-12T17:38:59.523406+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:10.455020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1330,"num_read_kb":1122,"num_write":481,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"265'346","reported_seq":995,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.332327+0000","last_change":"2024-09-12T16:58:18.699099+0000","last_active":"2024-09-12T17:41:32.332327+0000","last_peered":"2024-09-12T17:41:32.332327+0000","last_clean":"2024-09-12T17:41:32.332327+0000","last_became_active":"2024-09-12T16:58:18.698280+0000","last_became_peered":"2024-09-12T16:58:18.698280+0000","last_unstale":"2024-09-12T17:41:32.332327+0000","last_undegraded":"2024-09-12T17:41:32.332327+0000","last_fullsized":"2024-09-12T17:41:32.332327+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:21:53.931060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17388240,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":554,"num_read_kb":25091,"num_write":1250,"num_write_kb":36260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"265'157","reported_seq":760,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:25.144333+0000","last_change":"2024-09-12T16:58:21.710011+0000","last_active":"2024-09-12T17:38:25.144333+0000","last_peered":"2024-09-12T17:38:25.144333+0000","last_clean":"2024-09-12T17:38:25.144333+0000","last_became_active":"2024-09-12T16:58:21.706493+0000","last_became_peered":"2024-09-12T16:58:21.706493+0000","last_unstale":"2024-09-12T17:38:25.144333+0000","last_undegraded":"2024-09-12T17:38:25.144333+0000","last_fullsized":"2024-09-12T17:38:25.144333+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:28.236536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":697,"num_read_kb":578,"num_write":245,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"265'272","reported_seq":930,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:57.873465+0000","last_change":"2024-09-12T16:58:18.695130+0000","last_active":"2024-09-12T17:38:57.873465+0000","last_peered":"2024-09-12T17:38:57.873465+0000","last_clean":"2024-09-12T17:38:57.873465+0000","last_became_active":"2024-09-12T16:58:18.694357+0000","last_became_peered":"2024-09-12T16:58:18.694357+0000","last_unstale":"2024-09-12T17:38:57.873465+0000","last_undegraded":"2024-09-12T17:38:57.873465+0000","last_fullsized":"2024-09-12T17:38:57.873465+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:09.763291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15005396,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":427,"num_read_kb":76106,"num_write":1010,"num_write_kb":48403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"265'76","reported_seq":653,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:57.331489+0000","last_change":"2024-09-12T16:58:21.723849+0000","last_active":"2024-09-12T17:37:57.331489+0000","last_peered":"2024-09-12T17:37:57.331489+0000","last_clean":"2024-09-12T17:37:57.331489+0000","last_became_active":"2024-09-12T16:58:21.723077+0000","last_became_peered":"2024-09-12T16:58:21.723077+0000","last_unstale":"2024-09-12T17:37:57.331489+0000","last_undegraded":"2024-09-12T17:37:57.331489+0000","last_fullsized":"2024-09-12T17:37:57.331489+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:24.692985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":363,"num_read_kb":315,"num_write":111,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"265'256","reported_seq":865,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.383295+0000","last_change":"2024-09-12T16:58:18.702345+0000","last_active":"2024-09-12T17:41:32.383295+0000","last_peered":"2024-09-12T17:41:32.383295+0000","last_clean":"2024-09-12T17:41:32.383295+0000","last_became_active":"2024-09-12T16:58:18.701590+0000","last_became_peered":"2024-09-12T16:58:18.701590+0000","last_unstale":"2024-09-12T17:41:32.383295+0000","last_undegraded":"2024-09-12T17:41:32.383295+0000","last_fullsized":"2024-09-12T17:41:32.383295+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:06.256813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5286722,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":350,"num_read_kb":1373,"num_write":875,"num_write_kb":18073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"265'138","reported_seq":739,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:36.361716+0000","last_change":"2024-09-12T16:58:21.725837+0000","last_active":"2024-09-12T17:39:36.361716+0000","last_peered":"2024-09-12T17:39:36.361716+0000","last_clean":"2024-09-12T17:39:36.361716+0000","last_became_active":"2024-09-12T16:58:21.718167+0000","last_became_peered":"2024-09-12T16:58:21.718167+0000","last_unstale":"2024-09-12T17:39:36.361716+0000","last_undegraded":"2024-09-12T17:39:36.361716+0000","last_fullsized":"2024-09-12T17:39:36.361716+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:29.353963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":612,"num_read_kb":510,"num_write":201,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"265'4234","reported_seq":4884,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:42.781502+0000","last_change":"2024-09-12T16:58:21.698194+0000","last_active":"2024-09-12T17:39:42.781502+0000","last_peered":"2024-09-12T17:39:42.781502+0000","last_clean":"2024-09-12T17:39:42.781502+0000","last_became_active":"2024-09-12T16:58:21.697479+0000","last_became_peered":"2024-09-12T16:58:21.697479+0000","last_unstale":"2024-09-12T17:39:42.781502+0000","last_undegraded":"2024-09-12T17:39:42.781502+0000","last_fullsized":"2024-09-12T17:39:42.781502+0000","mapping_epoch":26,"log_start":"265'4200","ondisk_log_start":"265'4200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":3000,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:12:15.711479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17044,"num_read_kb":14289,"num_write":6359,"num_write_kb":3183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"265'252","reported_seq":876,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:40.903484+0000","last_change":"2024-09-12T16:58:18.714631+0000","last_active":"2024-09-12T17:39:40.903484+0000","last_peered":"2024-09-12T17:39:40.903484+0000","last_clean":"2024-09-12T17:39:40.903484+0000","last_became_active":"2024-09-12T16:58:18.713739+0000","last_became_peered":"2024-09-12T16:58:18.713739+0000","last_unstale":"2024-09-12T17:39:40.903484+0000","last_undegraded":"2024-09-12T17:39:40.903484+0000","last_fullsized":"2024-09-12T17:39:40.903484+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:29.786536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14027714,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":371,"num_read_kb":10222,"num_write":899,"num_write_kb":31220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"265'294","reported_seq":1006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:48.145728+0000","last_change":"2024-09-12T16:58:21.724340+0000","last_active":"2024-09-12T17:39:48.145728+0000","last_peered":"2024-09-12T17:39:48.145728+0000","last_clean":"2024-09-12T17:39:48.145728+0000","last_became_active":"2024-09-12T16:58:21.723238+0000","last_became_peered":"2024-09-12T16:58:21.723238+0000","last_unstale":"2024-09-12T17:39:48.145728+0000","last_undegraded":"2024-09-12T17:39:48.145728+0000","last_fullsized":"2024-09-12T17:39:48.145728+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:26.233677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1552,"num_read_kb":1372,"num_write":472,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"265'268","reported_seq":880,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:47.702960+0000","last_change":"2024-09-12T16:58:18.702745+0000","last_active":"2024-09-12T17:38:47.702960+0000","last_peered":"2024-09-12T17:38:47.702960+0000","last_clean":"2024-09-12T17:38:47.702960+0000","last_became_active":"2024-09-12T16:58:18.701989+0000","last_became_peered":"2024-09-12T16:58:18.701989+0000","last_unstale":"2024-09-12T17:38:47.702960+0000","last_undegraded":"2024-09-12T17:38:47.702960+0000","last_fullsized":"2024-09-12T17:38:47.702960+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:43:11.774703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3469327,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":370,"num_read_kb":5557,"num_write":955,"num_write_kb":22464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"265'183","reported_seq":791,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:12.334752+0000","last_change":"2024-09-12T16:58:21.716125+0000","last_active":"2024-09-12T17:38:12.334752+0000","last_peered":"2024-09-12T17:38:12.334752+0000","last_clean":"2024-09-12T17:38:12.334752+0000","last_became_active":"2024-09-12T16:58:21.715289+0000","last_became_peered":"2024-09-12T16:58:21.715289+0000","last_unstale":"2024-09-12T17:38:12.334752+0000","last_undegraded":"2024-09-12T17:38:12.334752+0000","last_fullsized":"2024-09-12T17:38:12.334752+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:51.702306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":782,"num_read_kb":649,"num_write":263,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"265'309","reported_seq":982,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:47.106484+0000","last_change":"2024-09-12T16:58:18.703102+0000","last_active":"2024-09-12T17:39:47.106484+0000","last_peered":"2024-09-12T17:39:47.106484+0000","last_clean":"2024-09-12T17:39:47.106484+0000","last_became_active":"2024-09-12T16:58:18.702185+0000","last_became_peered":"2024-09-12T16:58:18.702185+0000","last_unstale":"2024-09-12T17:39:47.106484+0000","last_undegraded":"2024-09-12T17:39:47.106484+0000","last_fullsized":"2024-09-12T17:39:47.106484+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:26.576879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":654678,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":530,"num_read_kb":49217,"num_write":1151,"num_write_kb":37016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"265'189","reported_seq":821,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:50.846518+0000","last_change":"2024-09-12T16:58:21.725319+0000","last_active":"2024-09-12T17:38:50.846518+0000","last_peered":"2024-09-12T17:38:50.846518+0000","last_clean":"2024-09-12T17:38:50.846518+0000","last_became_active":"2024-09-12T16:58:21.718158+0000","last_became_peered":"2024-09-12T16:58:21.718158+0000","last_unstale":"2024-09-12T17:38:50.846518+0000","last_undegraded":"2024-09-12T17:38:50.846518+0000","last_fullsized":"2024-09-12T17:38:50.846518+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:25.653319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":878,"num_read_kb":727,"num_write":304,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"265'282","reported_seq":1019,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:46.135403+0000","last_change":"2024-09-12T16:58:18.702967+0000","last_active":"2024-09-12T17:39:46.135403+0000","last_peered":"2024-09-12T17:39:46.135403+0000","last_clean":"2024-09-12T17:39:46.135403+0000","last_became_active":"2024-09-12T16:58:18.699360+0000","last_became_peered":"2024-09-12T16:58:18.699360+0000","last_unstale":"2024-09-12T17:39:46.135403+0000","last_undegraded":"2024-09-12T17:39:46.135403+0000","last_fullsized":"2024-09-12T17:39:46.135403+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:23.551727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10819431,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":555,"num_read_kb":143202,"num_write":992,"num_write_kb":36082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"265'136","reported_seq":765,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:49.202472+0000","last_change":"2024-09-12T16:58:21.728829+0000","last_active":"2024-09-12T17:39:49.202472+0000","last_peered":"2024-09-12T17:39:49.202472+0000","last_clean":"2024-09-12T17:39:49.202472+0000","last_became_active":"2024-09-12T16:58:21.728321+0000","last_became_peered":"2024-09-12T16:58:21.728321+0000","last_unstale":"2024-09-12T17:39:49.202472+0000","last_undegraded":"2024-09-12T17:39:49.202472+0000","last_fullsized":"2024-09-12T17:39:49.202472+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:15.718429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":636,"num_read_kb":537,"num_write":197,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"265'260","reported_seq":872,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.372557+0000","last_change":"2024-09-12T16:58:18.691138+0000","last_active":"2024-09-12T17:41:32.372557+0000","last_peered":"2024-09-12T17:41:32.372557+0000","last_clean":"2024-09-12T17:41:32.372557+0000","last_became_active":"2024-09-12T16:58:18.690634+0000","last_became_peered":"2024-09-12T16:58:18.690634+0000","last_unstale":"2024-09-12T17:41:32.372557+0000","last_undegraded":"2024-09-12T17:41:32.372557+0000","last_fullsized":"2024-09-12T17:41:32.372557+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:16.345304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15090613,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":337,"num_read_kb":27088,"num_write":892,"num_write_kb":25947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"265'299","reported_seq":897,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:01.264914+0000","last_change":"2024-09-12T16:58:21.705137+0000","last_active":"2024-09-12T17:37:01.264914+0000","last_peered":"2024-09-12T17:37:01.264914+0000","last_clean":"2024-09-12T17:37:01.264914+0000","last_became_active":"2024-09-12T16:58:21.702643+0000","last_became_peered":"2024-09-12T16:58:21.702643+0000","last_unstale":"2024-09-12T17:37:01.264914+0000","last_undegraded":"2024-09-12T17:37:01.264914+0000","last_fullsized":"2024-09-12T17:37:01.264914+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:27.298302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1307,"num_read_kb":1045,"num_write":505,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"265'287","reported_seq":1039,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.335074+0000","last_change":"2024-09-12T16:58:18.703569+0000","last_active":"2024-09-12T17:41:32.335074+0000","last_peered":"2024-09-12T17:41:32.335074+0000","last_clean":"2024-09-12T17:41:32.335074+0000","last_became_active":"2024-09-12T16:58:18.702310+0000","last_became_peered":"2024-09-12T16:58:18.702310+0000","last_unstale":"2024-09-12T17:41:32.335074+0000","last_undegraded":"2024-09-12T17:41:32.335074+0000","last_fullsized":"2024-09-12T17:41:32.335074+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:28.757489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5217971,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":529,"num_read_kb":31841,"num_write":1007,"num_write_kb":30837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"265'153","reported_seq":661,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:05.039986+0000","last_change":"2024-09-12T16:58:29.792625+0000","last_active":"2024-09-12T17:40:05.039986+0000","last_peered":"2024-09-12T17:40:05.039986+0000","last_clean":"2024-09-12T17:40:05.039986+0000","last_became_active":"2024-09-12T16:58:29.792043+0000","last_became_peered":"2024-09-12T16:58:29.792043+0000","last_unstale":"2024-09-12T17:40:05.039986+0000","last_undegraded":"2024-09-12T17:40:05.039986+0000","last_fullsized":"2024-09-12T17:40:05.039986+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:46.501133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":230,"num_read_kb":220,"num_write":374,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"265'102","reported_seq":686,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:24.677630+0000","last_change":"2024-09-12T16:58:21.707802+0000","last_active":"2024-09-12T17:39:24.677630+0000","last_peered":"2024-09-12T17:39:24.677630+0000","last_clean":"2024-09-12T17:39:24.677630+0000","last_became_active":"2024-09-12T16:58:21.707428+0000","last_became_peered":"2024-09-12T16:58:21.707428+0000","last_unstale":"2024-09-12T17:39:24.677630+0000","last_undegraded":"2024-09-12T17:39:24.677630+0000","last_fullsized":"2024-09-12T17:39:24.677630+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:42.024002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":440,"num_read_kb":374,"num_write":161,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"265'313","reported_seq":966,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:19.144021+0000","last_change":"2024-09-12T16:58:18.716412+0000","last_active":"2024-09-12T17:41:19.144021+0000","last_peered":"2024-09-12T17:41:19.144021+0000","last_clean":"2024-09-12T17:41:19.144021+0000","last_became_active":"2024-09-12T16:58:18.714782+0000","last_became_peered":"2024-09-12T16:58:18.714782+0000","last_unstale":"2024-09-12T17:41:19.144021+0000","last_undegraded":"2024-09-12T17:41:19.144021+0000","last_fullsized":"2024-09-12T17:41:19.144021+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:30.616876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15141195,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":493,"num_read_kb":18943,"num_write":1164,"num_write_kb":58984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:07.320348+0000","last_change":"2024-09-12T16:58:23.713332+0000","last_active":"2024-09-12T17:37:07.320348+0000","last_peered":"2024-09-12T17:37:07.320348+0000","last_clean":"2024-09-12T17:37:07.320348+0000","last_became_active":"2024-09-12T16:58:23.712621+0000","last_became_peered":"2024-09-12T16:58:23.712621+0000","last_unstale":"2024-09-12T17:37:07.320348+0000","last_undegraded":"2024-09-12T17:37:07.320348+0000","last_fullsized":"2024-09-12T17:37:07.320348+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:58:32.081784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"265'334","reported_seq":927,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:24.864562+0000","last_change":"2024-09-12T16:58:25.730728+0000","last_active":"2024-09-12T17:41:24.864562+0000","last_peered":"2024-09-12T17:41:24.864562+0000","last_clean":"2024-09-12T17:41:24.864562+0000","last_became_active":"2024-09-12T16:58:25.728901+0000","last_became_peered":"2024-09-12T16:58:25.728901+0000","last_unstale":"2024-09-12T17:41:24.864562+0000","last_undegraded":"2024-09-12T17:41:24.864562+0000","last_fullsized":"2024-09-12T17:41:24.864562+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:04.800787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57249,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":536,"num_read_kb":1031,"num_write":432,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:11.289497+0000","last_change":"2024-09-12T16:58:27.753040+0000","last_active":"2024-09-12T17:37:11.289497+0000","last_peered":"2024-09-12T17:37:11.289497+0000","last_clean":"2024-09-12T17:37:11.289497+0000","last_became_active":"2024-09-12T16:58:27.752315+0000","last_became_peered":"2024-09-12T16:58:27.752315+0000","last_unstale":"2024-09-12T17:37:11.289497+0000","last_undegraded":"2024-09-12T17:37:11.289497+0000","last_fullsized":"2024-09-12T17:37:11.289497+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:39.272577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"265'126","reported_seq":675,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:03.062821+0000","last_change":"2024-09-12T16:58:29.774689+0000","last_active":"2024-09-12T17:40:03.062821+0000","last_peered":"2024-09-12T17:40:03.062821+0000","last_clean":"2024-09-12T17:40:03.062821+0000","last_became_active":"2024-09-12T16:58:29.773874+0000","last_became_peered":"2024-09-12T16:58:29.773874+0000","last_unstale":"2024-09-12T17:40:03.062821+0000","last_undegraded":"2024-09-12T17:40:03.062821+0000","last_fullsized":"2024-09-12T17:40:03.062821+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:24.286576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":191,"num_read_kb":190,"num_write":216,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"265'400","reported_seq":1050,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:42.832514+0000","last_change":"2024-09-12T16:58:21.719455+0000","last_active":"2024-09-12T17:38:42.832514+0000","last_peered":"2024-09-12T17:38:42.832514+0000","last_clean":"2024-09-12T17:38:42.832514+0000","last_became_active":"2024-09-12T16:58:21.717806+0000","last_became_peered":"2024-09-12T16:58:21.717806+0000","last_unstale":"2024-09-12T17:38:42.832514+0000","last_undegraded":"2024-09-12T17:38:42.832514+0000","last_fullsized":"2024-09-12T17:38:42.832514+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:24.079041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1815,"num_read_kb":1449,"num_write":653,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"265'304","reported_seq":990,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.360124+0000","last_change":"2024-09-12T16:58:18.692396+0000","last_active":"2024-09-12T17:41:32.360124+0000","last_peered":"2024-09-12T17:41:32.360124+0000","last_clean":"2024-09-12T17:41:32.360124+0000","last_became_active":"2024-09-12T16:58:18.691335+0000","last_became_peered":"2024-09-12T16:58:18.691335+0000","last_unstale":"2024-09-12T17:41:32.360124+0000","last_undegraded":"2024-09-12T17:41:32.360124+0000","last_fullsized":"2024-09-12T17:41:32.360124+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:42:36.520626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13189614,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":504,"num_read_kb":106559,"num_write":1057,"num_write_kb":67871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:17.354558+0000","last_change":"2024-09-12T16:58:23.719306+0000","last_active":"2024-09-12T17:38:17.354558+0000","last_peered":"2024-09-12T17:38:17.354558+0000","last_clean":"2024-09-12T17:38:17.354558+0000","last_became_active":"2024-09-12T16:58:23.718656+0000","last_became_peered":"2024-09-12T16:58:23.718656+0000","last_unstale":"2024-09-12T17:38:17.354558+0000","last_undegraded":"2024-09-12T17:38:17.354558+0000","last_fullsized":"2024-09-12T17:38:17.354558+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:05:10.035449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"265'99","reported_seq":621,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:22.810700+0000","last_change":"2024-09-12T16:58:25.714387+0000","last_active":"2024-09-12T17:39:22.810700+0000","last_peered":"2024-09-12T17:39:22.810700+0000","last_clean":"2024-09-12T17:39:22.810700+0000","last_became_active":"2024-09-12T16:58:25.713567+0000","last_became_peered":"2024-09-12T16:58:25.713567+0000","last_unstale":"2024-09-12T17:39:22.810700+0000","last_undegraded":"2024-09-12T17:39:22.810700+0000","last_fullsized":"2024-09-12T17:39:22.810700+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:13.593060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":95,"num_read_kb":90,"num_write":66,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:11.267295+0000","last_change":"2024-09-12T16:58:27.729072+0000","last_active":"2024-09-12T17:37:11.267295+0000","last_peered":"2024-09-12T17:37:11.267295+0000","last_clean":"2024-09-12T17:37:11.267295+0000","last_became_active":"2024-09-12T16:58:27.728276+0000","last_became_peered":"2024-09-12T16:58:27.728276+0000","last_unstale":"2024-09-12T17:37:11.267295+0000","last_undegraded":"2024-09-12T17:37:11.267295+0000","last_fullsized":"2024-09-12T17:37:11.267295+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:19.029657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"265'125","reported_seq":630,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:04.398546+0000","last_change":"2024-09-12T16:58:29.781407+0000","last_active":"2024-09-12T17:40:04.398546+0000","last_peered":"2024-09-12T17:40:04.398546+0000","last_clean":"2024-09-12T17:40:04.398546+0000","last_became_active":"2024-09-12T16:58:29.780598+0000","last_became_peered":"2024-09-12T16:58:29.780598+0000","last_unstale":"2024-09-12T17:40:04.398546+0000","last_undegraded":"2024-09-12T17:40:04.398546+0000","last_fullsized":"2024-09-12T17:40:04.398546+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:18.860850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":203,"num_read_kb":191,"num_write":301,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"265'80","reported_seq":642,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:41.116398+0000","last_change":"2024-09-12T16:58:21.719225+0000","last_active":"2024-09-12T17:39:41.116398+0000","last_peered":"2024-09-12T17:39:41.116398+0000","last_clean":"2024-09-12T17:39:41.116398+0000","last_became_active":"2024-09-12T16:58:21.718773+0000","last_became_peered":"2024-09-12T16:58:21.718773+0000","last_unstale":"2024-09-12T17:39:41.116398+0000","last_undegraded":"2024-09-12T17:39:41.116398+0000","last_fullsized":"2024-09-12T17:39:41.116398+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:06.541968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":373,"num_read_kb":312,"num_write":123,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"265'259","reported_seq":850,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:42.997703+0000","last_change":"2024-09-12T16:58:55.845287+0000","last_active":"2024-09-12T17:38:42.997703+0000","last_peered":"2024-09-12T17:38:42.997703+0000","last_clean":"2024-09-12T17:38:42.997703+0000","last_became_active":"2024-09-12T16:58:55.843826+0000","last_became_peered":"2024-09-12T16:58:55.843826+0000","last_unstale":"2024-09-12T17:38:42.997703+0000","last_undegraded":"2024-09-12T17:38:42.997703+0000","last_fullsized":"2024-09-12T17:38:42.997703+0000","mapping_epoch":37,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:56.799291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1670299,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":355,"num_read_kb":4809,"num_write":916,"num_write_kb":23718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:07.338234+0000","last_change":"2024-09-12T16:58:23.707417+0000","last_active":"2024-09-12T17:37:07.338234+0000","last_peered":"2024-09-12T17:37:07.338234+0000","last_clean":"2024-09-12T17:37:07.338234+0000","last_became_active":"2024-09-12T16:58:23.706953+0000","last_became_peered":"2024-09-12T16:58:23.706953+0000","last_unstale":"2024-09-12T17:37:07.338234+0000","last_undegraded":"2024-09-12T17:37:07.338234+0000","last_fullsized":"2024-09-12T17:37:07.338234+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:53.755342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"265'105","reported_seq":638,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:11.702449+0000","last_change":"2024-09-12T16:58:25.714085+0000","last_active":"2024-09-12T17:39:11.702449+0000","last_peered":"2024-09-12T17:39:11.702449+0000","last_clean":"2024-09-12T17:39:11.702449+0000","last_became_active":"2024-09-12T16:58:25.713213+0000","last_became_peered":"2024-09-12T16:58:25.713213+0000","last_unstale":"2024-09-12T17:39:11.702449+0000","last_undegraded":"2024-09-12T17:39:11.702449+0000","last_fullsized":"2024-09-12T17:39:11.702449+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:25.447055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":116,"num_write":82,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"265'765","reported_seq":4617,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:25.115189+0000","last_change":"2024-09-12T16:58:27.753546+0000","last_active":"2024-09-12T17:41:25.115189+0000","last_peered":"2024-09-12T17:41:25.115189+0000","last_clean":"2024-09-12T17:41:25.115189+0000","last_became_active":"2024-09-12T16:58:27.752801+0000","last_became_peered":"2024-09-12T16:58:27.752801+0000","last_unstale":"2024-09-12T17:41:25.115189+0000","last_undegraded":"2024-09-12T17:41:25.115189+0000","last_fullsized":"2024-09-12T17:41:25.115189+0000","mapping_epoch":32,"log_start":"265'702","ondisk_log_start":"265'702","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":702,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:03.558787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"265'204","reported_seq":1022,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:05.112599+0000","last_change":"2024-09-12T16:58:29.770179+0000","last_active":"2024-09-12T17:40:05.112599+0000","last_peered":"2024-09-12T17:40:05.112599+0000","last_clean":"2024-09-12T17:40:05.112599+0000","last_became_active":"2024-09-12T16:58:29.769351+0000","last_became_peered":"2024-09-12T16:58:29.769351+0000","last_unstale":"2024-09-12T17:40:05.112599+0000","last_undegraded":"2024-09-12T17:40:05.112599+0000","last_fullsized":"2024-09-12T17:40:05.112599+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:38.433650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":633,"num_read_kb":631,"num_write":454,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"265'164","reported_seq":753,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:34.507430+0000","last_change":"2024-09-12T16:58:21.711086+0000","last_active":"2024-09-12T17:39:34.507430+0000","last_peered":"2024-09-12T17:39:34.507430+0000","last_clean":"2024-09-12T17:39:34.507430+0000","last_became_active":"2024-09-12T16:58:21.710646+0000","last_became_peered":"2024-09-12T16:58:21.710646+0000","last_unstale":"2024-09-12T17:39:34.507430+0000","last_undegraded":"2024-09-12T17:39:34.507430+0000","last_fullsized":"2024-09-12T17:39:34.507430+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:34:16.873776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":698,"num_read_kb":573,"num_write":260,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"265'270","reported_seq":895,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:02.051145+0000","last_change":"2024-09-12T16:58:18.690508+0000","last_active":"2024-09-12T17:40:02.051145+0000","last_peered":"2024-09-12T17:40:02.051145+0000","last_clean":"2024-09-12T17:40:02.051145+0000","last_became_active":"2024-09-12T16:58:18.689915+0000","last_became_peered":"2024-09-12T16:58:18.689915+0000","last_unstale":"2024-09-12T17:40:02.051145+0000","last_undegraded":"2024-09-12T17:40:02.051145+0000","last_fullsized":"2024-09-12T17:40:02.051145+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:30.087379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14032561,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":367,"num_read_kb":42591,"num_write":1036,"num_write_kb":36991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:07.320434+0000","last_change":"2024-09-12T16:58:23.697918+0000","last_active":"2024-09-12T17:37:07.320434+0000","last_peered":"2024-09-12T17:37:07.320434+0000","last_clean":"2024-09-12T17:37:07.320434+0000","last_became_active":"2024-09-12T16:58:23.697159+0000","last_became_peered":"2024-09-12T16:58:23.697159+0000","last_unstale":"2024-09-12T17:37:07.320434+0000","last_undegraded":"2024-09-12T17:37:07.320434+0000","last_fullsized":"2024-09-12T17:37:07.320434+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:03.312839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"265'243","reported_seq":804,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:31.322745+0000","last_change":"2024-09-12T16:58:25.949946+0000","last_active":"2024-09-12T17:39:31.322745+0000","last_peered":"2024-09-12T17:39:31.322745+0000","last_clean":"2024-09-12T17:39:31.322745+0000","last_became_active":"2024-09-12T16:58:25.949179+0000","last_became_peered":"2024-09-12T16:58:25.949179+0000","last_unstale":"2024-09-12T17:39:31.322745+0000","last_undegraded":"2024-09-12T17:39:31.322745+0000","last_fullsized":"2024-09-12T17:39:31.322745+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:40.413824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52397,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":409,"num_read_kb":858,"num_write":334,"num_write_kb":274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"265'781","reported_seq":2095,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:31.895501+0000","last_change":"2024-09-12T16:58:27.746737+0000","last_active":"2024-09-12T17:41:31.895501+0000","last_peered":"2024-09-12T17:41:31.895501+0000","last_clean":"2024-09-12T17:41:31.895501+0000","last_became_active":"2024-09-12T16:58:27.745988+0000","last_became_peered":"2024-09-12T16:58:27.745988+0000","last_unstale":"2024-09-12T17:41:31.895501+0000","last_undegraded":"2024-09-12T17:41:31.895501+0000","last_fullsized":"2024-09-12T17:41:31.895501+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:10.802947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"265'150","reported_seq":720,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:22.323591+0000","last_change":"2024-09-12T16:58:21.710840+0000","last_active":"2024-09-12T17:37:22.323591+0000","last_peered":"2024-09-12T17:37:22.323591+0000","last_clean":"2024-09-12T17:37:22.323591+0000","last_became_active":"2024-09-12T16:58:21.710029+0000","last_became_peered":"2024-09-12T16:58:21.710029+0000","last_unstale":"2024-09-12T17:37:22.323591+0000","last_undegraded":"2024-09-12T17:37:22.323591+0000","last_fullsized":"2024-09-12T17:37:22.323591+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:16.606525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":614,"num_read_kb":496,"num_write":228,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"265'293","reported_seq":940,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:48.924397+0000","last_change":"2024-09-12T16:58:18.717733+0000","last_active":"2024-09-12T17:39:48.924397+0000","last_peered":"2024-09-12T17:39:48.924397+0000","last_clean":"2024-09-12T17:39:48.924397+0000","last_became_active":"2024-09-12T16:58:18.715448+0000","last_became_peered":"2024-09-12T16:58:18.715448+0000","last_unstale":"2024-09-12T17:39:48.924397+0000","last_undegraded":"2024-09-12T17:39:48.924397+0000","last_fullsized":"2024-09-12T17:39:48.924397+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:12.664073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9540151,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":477,"num_read_kb":11904,"num_write":1150,"num_write_kb":32051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:26.293032+0000","last_change":"2024-09-12T16:58:23.720919+0000","last_active":"2024-09-12T17:37:26.293032+0000","last_peered":"2024-09-12T17:37:26.293032+0000","last_clean":"2024-09-12T17:37:26.293032+0000","last_became_active":"2024-09-12T16:58:23.720096+0000","last_became_peered":"2024-09-12T16:58:23.720096+0000","last_unstale":"2024-09-12T17:37:26.293032+0000","last_undegraded":"2024-09-12T17:37:26.293032+0000","last_fullsized":"2024-09-12T17:37:26.293032+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:35.342690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"265'355","reported_seq":959,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:24.876537+0000","last_change":"2024-09-12T16:58:25.947522+0000","last_active":"2024-09-12T17:41:24.876537+0000","last_peered":"2024-09-12T17:41:24.876537+0000","last_clean":"2024-09-12T17:41:24.876537+0000","last_became_active":"2024-09-12T16:58:25.946765+0000","last_became_peered":"2024-09-12T16:58:25.946765+0000","last_unstale":"2024-09-12T17:41:24.876537+0000","last_undegraded":"2024-09-12T17:41:24.876537+0000","last_fullsized":"2024-09-12T17:41:24.876537+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:15.651894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60390,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":570,"num_read_kb":1072,"num_write":458,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:53.705109+0000","last_change":"2024-09-12T16:58:27.754351+0000","last_active":"2024-09-12T17:38:53.705109+0000","last_peered":"2024-09-12T17:38:53.705109+0000","last_clean":"2024-09-12T17:38:53.705109+0000","last_became_active":"2024-09-12T16:58:27.753616+0000","last_became_peered":"2024-09-12T16:58:27.753616+0000","last_unstale":"2024-09-12T17:38:53.705109+0000","last_undegraded":"2024-09-12T17:38:53.705109+0000","last_fullsized":"2024-09-12T17:38:53.705109+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:26.306126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"265'550","reported_seq":1358,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:24.912198+0000","last_change":"2024-09-12T16:58:29.774852+0000","last_active":"2024-09-12T17:41:24.912198+0000","last_peered":"2024-09-12T17:41:24.912198+0000","last_clean":"2024-09-12T17:41:24.912198+0000","last_became_active":"2024-09-12T16:58:29.774093+0000","last_became_peered":"2024-09-12T16:58:29.774093+0000","last_unstale":"2024-09-12T17:41:24.912198+0000","last_undegraded":"2024-09-12T17:41:24.912198+0000","last_fullsized":"2024-09-12T17:41:24.912198+0000","mapping_epoch":34,"log_start":"265'500","ondisk_log_start":"265'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":500,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:00.606117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":455,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1305,"num_read_kb":1304,"num_write":1151,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"265'502","reported_seq":1254,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:45.251893+0000","last_change":"2024-09-12T16:58:21.700218+0000","last_active":"2024-09-12T17:39:45.251893+0000","last_peered":"2024-09-12T17:39:45.251893+0000","last_clean":"2024-09-12T17:39:45.251893+0000","last_became_active":"2024-09-12T16:58:21.699243+0000","last_became_peered":"2024-09-12T16:58:21.699243+0000","last_unstale":"2024-09-12T17:39:45.251893+0000","last_undegraded":"2024-09-12T17:39:45.251893+0000","last_fullsized":"2024-09-12T17:39:45.251893+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:06:32.179023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2329,"num_read_kb":1984,"num_write":852,"num_write_kb":550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"265'301","reported_seq":964,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:48.925978+0000","last_change":"2024-09-12T16:58:18.715397+0000","last_active":"2024-09-12T17:39:48.925978+0000","last_peered":"2024-09-12T17:39:48.925978+0000","last_clean":"2024-09-12T17:39:48.925978+0000","last_became_active":"2024-09-12T16:58:18.714412+0000","last_became_peered":"2024-09-12T16:58:18.714412+0000","last_unstale":"2024-09-12T17:39:48.925978+0000","last_undegraded":"2024-09-12T17:39:48.925978+0000","last_fullsized":"2024-09-12T17:39:48.925978+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:27.766473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8695797,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":447,"num_read_kb":85960,"num_write":1110,"num_write_kb":38984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:25.262997+0000","last_change":"2024-09-12T16:58:23.703982+0000","last_active":"2024-09-12T17:37:25.262997+0000","last_peered":"2024-09-12T17:37:25.262997+0000","last_clean":"2024-09-12T17:37:25.262997+0000","last_became_active":"2024-09-12T16:58:23.703534+0000","last_became_peered":"2024-09-12T16:58:23.703534+0000","last_unstale":"2024-09-12T17:37:25.262997+0000","last_undegraded":"2024-09-12T17:37:25.262997+0000","last_fullsized":"2024-09-12T17:37:25.262997+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:58.941243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"265'275","reported_seq":841,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:24.814994+0000","last_change":"2024-09-12T16:58:25.732078+0000","last_active":"2024-09-12T17:41:24.814994+0000","last_peered":"2024-09-12T17:41:24.814994+0000","last_clean":"2024-09-12T17:41:24.814994+0000","last_became_active":"2024-09-12T16:58:25.730470+0000","last_became_peered":"2024-09-12T16:58:25.730470+0000","last_unstale":"2024-09-12T17:41:24.814994+0000","last_undegraded":"2024-09-12T17:41:24.814994+0000","last_fullsized":"2024-09-12T17:41:24.814994+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:12.290691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70696,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":467,"num_read_kb":1031,"num_write":392,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:37.344950+0000","last_change":"2024-09-12T16:58:27.749638+0000","last_active":"2024-09-12T17:37:37.344950+0000","last_peered":"2024-09-12T17:37:37.344950+0000","last_clean":"2024-09-12T17:37:37.344950+0000","last_became_active":"2024-09-12T16:58:27.748461+0000","last_became_peered":"2024-09-12T16:58:27.748461+0000","last_unstale":"2024-09-12T17:37:37.344950+0000","last_undegraded":"2024-09-12T17:37:37.344950+0000","last_fullsized":"2024-09-12T17:37:37.344950+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:12.377398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"265'2416","reported_seq":4248,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:13.859519+0000","last_change":"2024-09-12T16:58:29.771539+0000","last_active":"2024-09-12T17:41:13.859519+0000","last_peered":"2024-09-12T17:41:13.859519+0000","last_clean":"2024-09-12T17:41:13.859519+0000","last_became_active":"2024-09-12T16:58:29.768469+0000","last_became_peered":"2024-09-12T16:58:29.768469+0000","last_unstale":"2024-09-12T17:41:13.859519+0000","last_undegraded":"2024-09-12T17:41:13.859519+0000","last_fullsized":"2024-09-12T17:41:13.859519+0000","mapping_epoch":34,"log_start":"265'2400","ondisk_log_start":"265'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":2400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:15.157148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":849,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6073,"num_read_kb":6065,"num_write":4892,"num_write_kb":1798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"265'217","reported_seq":796,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:29.667612+0000","last_change":"2024-09-12T16:58:21.725294+0000","last_active":"2024-09-12T17:39:29.667612+0000","last_peered":"2024-09-12T17:39:29.667612+0000","last_clean":"2024-09-12T17:39:29.667612+0000","last_became_active":"2024-09-12T16:58:21.724552+0000","last_became_peered":"2024-09-12T16:58:21.724552+0000","last_unstale":"2024-09-12T17:39:29.667612+0000","last_undegraded":"2024-09-12T17:39:29.667612+0000","last_fullsized":"2024-09-12T17:39:29.667612+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:04.685886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":914,"num_read_kb":736,"num_write":337,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"265'401","reported_seq":1145,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:51.313166+0000","last_change":"2024-09-12T16:58:55.852901+0000","last_active":"2024-09-12T17:38:51.313166+0000","last_peered":"2024-09-12T17:38:51.313166+0000","last_clean":"2024-09-12T17:38:51.313166+0000","last_became_active":"2024-09-12T16:58:55.852305+0000","last_became_peered":"2024-09-12T16:58:55.852305+0000","last_unstale":"2024-09-12T17:38:51.313166+0000","last_undegraded":"2024-09-12T17:38:51.313166+0000","last_fullsized":"2024-09-12T17:38:51.313166+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:46.869138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079522,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":846,"num_read_kb":12354,"num_write":1424,"num_write_kb":33200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:55.282325+0000","last_change":"2024-09-12T16:58:23.713816+0000","last_active":"2024-09-12T17:38:55.282325+0000","last_peered":"2024-09-12T17:38:55.282325+0000","last_clean":"2024-09-12T17:38:55.282325+0000","last_became_active":"2024-09-12T16:58:23.713241+0000","last_became_peered":"2024-09-12T16:58:23.713241+0000","last_unstale":"2024-09-12T17:38:55.282325+0000","last_undegraded":"2024-09-12T17:38:55.282325+0000","last_fullsized":"2024-09-12T17:38:55.282325+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:48.740741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"265'314","reported_seq":892,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:04.406606+0000","last_change":"2024-09-12T16:58:25.733750+0000","last_active":"2024-09-12T17:40:04.406606+0000","last_peered":"2024-09-12T17:40:04.406606+0000","last_clean":"2024-09-12T17:40:04.406606+0000","last_became_active":"2024-09-12T16:58:25.732918+0000","last_became_peered":"2024-09-12T16:58:25.732918+0000","last_unstale":"2024-09-12T17:40:04.406606+0000","last_undegraded":"2024-09-12T17:40:04.406606+0000","last_fullsized":"2024-09-12T17:40:04.406606+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:42.495838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83498,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":501,"num_read_kb":1068,"num_write":414,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"265'756","reported_seq":2458,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:31.895739+0000","last_change":"2024-09-12T16:58:27.737407+0000","last_active":"2024-09-12T17:41:31.895739+0000","last_peered":"2024-09-12T17:41:31.895739+0000","last_clean":"2024-09-12T17:41:31.895739+0000","last_became_active":"2024-09-12T16:58:27.736160+0000","last_became_peered":"2024-09-12T16:58:27.736160+0000","last_unstale":"2024-09-12T17:41:31.895739+0000","last_undegraded":"2024-09-12T17:41:31.895739+0000","last_fullsized":"2024-09-12T17:41:31.895739+0000","mapping_epoch":32,"log_start":"265'701","ondisk_log_start":"265'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":701,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:07.364813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"265'167","reported_seq":655,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:23.671352+0000","last_change":"2024-09-12T16:58:29.786539+0000","last_active":"2024-09-12T17:41:23.671352+0000","last_peered":"2024-09-12T17:41:23.671352+0000","last_clean":"2024-09-12T17:41:23.671352+0000","last_became_active":"2024-09-12T16:58:29.785621+0000","last_became_peered":"2024-09-12T16:58:29.785621+0000","last_unstale":"2024-09-12T17:41:23.671352+0000","last_undegraded":"2024-09-12T17:41:23.671352+0000","last_fullsized":"2024-09-12T17:41:23.671352+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:08.331708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":406,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":130,"num_read_kb":128,"num_write":373,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"265'203","reported_seq":795,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:52.359574+0000","last_change":"2024-09-12T16:58:21.702147+0000","last_active":"2024-09-12T17:38:52.359574+0000","last_peered":"2024-09-12T17:38:52.359574+0000","last_clean":"2024-09-12T17:38:52.359574+0000","last_became_active":"2024-09-12T16:58:21.701704+0000","last_became_peered":"2024-09-12T16:58:21.701704+0000","last_unstale":"2024-09-12T17:38:52.359574+0000","last_undegraded":"2024-09-12T17:38:52.359574+0000","last_fullsized":"2024-09-12T17:38:52.359574+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:12.535631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":867,"num_read_kb":717,"num_write":300,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"265'274","reported_seq":904,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.324318+0000","last_change":"2024-09-12T16:58:18.715784+0000","last_active":"2024-09-12T17:41:32.324318+0000","last_peered":"2024-09-12T17:41:32.324318+0000","last_clean":"2024-09-12T17:41:32.324318+0000","last_became_active":"2024-09-12T16:58:18.715232+0000","last_became_peered":"2024-09-12T16:58:18.715232+0000","last_unstale":"2024-09-12T17:41:32.324318+0000","last_undegraded":"2024-09-12T17:41:32.324318+0000","last_fullsized":"2024-09-12T17:41:32.324318+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:14.558882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5919350,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":416,"num_read_kb":18626,"num_write":976,"num_write_kb":30032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:30.264112+0000","last_change":"2024-09-12T16:58:23.709304+0000","last_active":"2024-09-12T17:37:30.264112+0000","last_peered":"2024-09-12T17:37:30.264112+0000","last_clean":"2024-09-12T17:37:30.264112+0000","last_became_active":"2024-09-12T16:58:23.708641+0000","last_became_peered":"2024-09-12T16:58:23.708641+0000","last_unstale":"2024-09-12T17:37:30.264112+0000","last_undegraded":"2024-09-12T17:37:30.264112+0000","last_fullsized":"2024-09-12T17:37:30.264112+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:30.695754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"265'468","reported_seq":1090,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.129700+0000","last_change":"2024-09-12T16:58:25.729871+0000","last_active":"2024-09-12T17:41:32.129700+0000","last_peered":"2024-09-12T17:41:32.129700+0000","last_clean":"2024-09-12T17:41:32.129700+0000","last_became_active":"2024-09-12T16:58:25.729071+0000","last_became_peered":"2024-09-12T16:58:25.729071+0000","last_unstale":"2024-09-12T17:41:32.129700+0000","last_undegraded":"2024-09-12T17:41:32.129700+0000","last_fullsized":"2024-09-12T17:41:32.129700+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:44.050528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136512,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":804,"num_read_kb":1900,"num_write":664,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:30.264053+0000","last_change":"2024-09-12T16:58:27.734880+0000","last_active":"2024-09-12T17:37:30.264053+0000","last_peered":"2024-09-12T17:37:30.264053+0000","last_clean":"2024-09-12T17:37:30.264053+0000","last_became_active":"2024-09-12T16:58:27.734078+0000","last_became_peered":"2024-09-12T16:58:27.734078+0000","last_unstale":"2024-09-12T17:37:30.264053+0000","last_undegraded":"2024-09-12T17:37:30.264053+0000","last_fullsized":"2024-09-12T17:37:30.264053+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:51.965911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"265'88","reported_seq":588,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:25.836784+0000","last_change":"2024-09-12T16:58:29.795094+0000","last_active":"2024-09-12T17:39:25.836784+0000","last_peered":"2024-09-12T17:39:25.836784+0000","last_clean":"2024-09-12T17:39:25.836784+0000","last_became_active":"2024-09-12T16:58:29.794347+0000","last_became_peered":"2024-09-12T16:58:29.794347+0000","last_unstale":"2024-09-12T17:39:25.836784+0000","last_undegraded":"2024-09-12T17:39:25.836784+0000","last_fullsized":"2024-09-12T17:39:25.836784+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:31:39.752933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":704,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":193,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"265'212","reported_seq":801,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:41.644167+0000","last_change":"2024-09-12T16:58:21.707885+0000","last_active":"2024-09-12T17:39:41.644167+0000","last_peered":"2024-09-12T17:39:41.644167+0000","last_clean":"2024-09-12T17:39:41.644167+0000","last_became_active":"2024-09-12T16:58:21.702684+0000","last_became_peered":"2024-09-12T16:58:21.702684+0000","last_unstale":"2024-09-12T17:39:41.644167+0000","last_undegraded":"2024-09-12T17:39:41.644167+0000","last_fullsized":"2024-09-12T17:39:41.644167+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:49.497498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":882,"num_read_kb":712,"num_write":314,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"265'320","reported_seq":1002,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.365918+0000","last_change":"2024-09-12T16:58:18.695913+0000","last_active":"2024-09-12T17:41:32.365918+0000","last_peered":"2024-09-12T17:41:32.365918+0000","last_clean":"2024-09-12T17:41:32.365918+0000","last_became_active":"2024-09-12T16:58:18.695549+0000","last_became_peered":"2024-09-12T16:58:18.695549+0000","last_unstale":"2024-09-12T17:41:32.365918+0000","last_undegraded":"2024-09-12T17:41:32.365918+0000","last_fullsized":"2024-09-12T17:41:32.365918+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:34:55.744463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6643992,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":581,"num_read_kb":12632,"num_write":1049,"num_write_kb":15900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:55.282389+0000","last_change":"2024-09-12T16:58:23.720806+0000","last_active":"2024-09-12T17:38:55.282389+0000","last_peered":"2024-09-12T17:38:55.282389+0000","last_clean":"2024-09-12T17:38:55.282389+0000","last_became_active":"2024-09-12T16:58:23.720279+0000","last_became_peered":"2024-09-12T16:58:23.720279+0000","last_unstale":"2024-09-12T17:38:55.282389+0000","last_undegraded":"2024-09-12T17:38:55.282389+0000","last_fullsized":"2024-09-12T17:38:55.282389+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:05.351245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"265'287","reported_seq":856,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:11.321522+0000","last_change":"2024-09-12T16:58:25.713751+0000","last_active":"2024-09-12T17:41:11.321522+0000","last_peered":"2024-09-12T17:41:11.321522+0000","last_clean":"2024-09-12T17:41:11.321522+0000","last_became_active":"2024-09-12T16:58:25.711682+0000","last_became_peered":"2024-09-12T16:58:25.711682+0000","last_unstale":"2024-09-12T17:41:11.321522+0000","last_undegraded":"2024-09-12T17:41:11.321522+0000","last_fullsized":"2024-09-12T17:41:11.321522+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:16.044074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60114,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":508,"num_read_kb":1032,"num_write":466,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:07.363377+0000","last_change":"2024-09-12T16:58:27.752363+0000","last_active":"2024-09-12T17:39:07.363377+0000","last_peered":"2024-09-12T17:39:07.363377+0000","last_clean":"2024-09-12T17:39:07.363377+0000","last_became_active":"2024-09-12T16:58:27.751664+0000","last_became_peered":"2024-09-12T16:58:27.751664+0000","last_unstale":"2024-09-12T17:39:07.363377+0000","last_undegraded":"2024-09-12T17:39:07.363377+0000","last_fullsized":"2024-09-12T17:39:07.363377+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:48.576997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"265'126","reported_seq":626,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:42.388904+0000","last_change":"2024-09-12T16:58:29.785130+0000","last_active":"2024-09-12T17:40:42.388904+0000","last_peered":"2024-09-12T17:40:42.388904+0000","last_clean":"2024-09-12T17:40:42.388904+0000","last_became_active":"2024-09-12T16:58:29.784095+0000","last_became_peered":"2024-09-12T16:58:29.784095+0000","last_unstale":"2024-09-12T17:40:42.388904+0000","last_undegraded":"2024-09-12T17:40:42.388904+0000","last_fullsized":"2024-09-12T17:40:42.388904+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:32.305201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":487,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":177,"num_read_kb":165,"num_write":304,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"265'166","reported_seq":772,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:22.504965+0000","last_change":"2024-09-12T16:58:21.730323+0000","last_active":"2024-09-12T17:39:22.504965+0000","last_peered":"2024-09-12T17:39:22.504965+0000","last_clean":"2024-09-12T17:39:22.504965+0000","last_became_active":"2024-09-12T16:58:21.728963+0000","last_became_peered":"2024-09-12T16:58:21.728963+0000","last_unstale":"2024-09-12T17:39:22.504965+0000","last_undegraded":"2024-09-12T17:39:22.504965+0000","last_fullsized":"2024-09-12T17:39:22.504965+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:54.629377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":751,"num_read_kb":615,"num_write":255,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"265'279","reported_seq":947,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:47.104983+0000","last_change":"2024-09-12T16:58:18.709400+0000","last_active":"2024-09-12T17:39:47.104983+0000","last_peered":"2024-09-12T17:39:47.104983+0000","last_clean":"2024-09-12T17:39:47.104983+0000","last_became_active":"2024-09-12T16:58:18.708689+0000","last_became_peered":"2024-09-12T16:58:18.708689+0000","last_unstale":"2024-09-12T17:39:47.104983+0000","last_undegraded":"2024-09-12T17:39:47.104983+0000","last_fullsized":"2024-09-12T17:39:47.104983+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:03.022185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9753785,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":444,"num_read_kb":124256,"num_write":1072,"num_write_kb":36504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:58.706576+0000","last_change":"2024-09-12T16:58:23.709600+0000","last_active":"2024-09-12T17:38:58.706576+0000","last_peered":"2024-09-12T17:38:58.706576+0000","last_clean":"2024-09-12T17:38:58.706576+0000","last_became_active":"2024-09-12T16:58:23.709099+0000","last_became_peered":"2024-09-12T16:58:23.709099+0000","last_unstale":"2024-09-12T17:38:58.706576+0000","last_undegraded":"2024-09-12T17:38:58.706576+0000","last_fullsized":"2024-09-12T17:38:58.706576+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:40.419144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"265'273","reported_seq":852,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:15.312923+0000","last_change":"2024-09-12T16:58:25.724609+0000","last_active":"2024-09-12T17:41:15.312923+0000","last_peered":"2024-09-12T17:41:15.312923+0000","last_clean":"2024-09-12T17:41:15.312923+0000","last_became_active":"2024-09-12T16:58:25.723894+0000","last_became_peered":"2024-09-12T16:58:25.723894+0000","last_unstale":"2024-09-12T17:41:15.312923+0000","last_undegraded":"2024-09-12T17:41:15.312923+0000","last_fullsized":"2024-09-12T17:41:15.312923+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:02.360836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64085,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":444,"num_read_kb":901,"num_write":354,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"265'724","reported_seq":2345,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:25.115608+0000","last_change":"2024-09-12T16:58:27.754030+0000","last_active":"2024-09-12T17:41:25.115608+0000","last_peered":"2024-09-12T17:41:25.115608+0000","last_clean":"2024-09-12T17:41:25.115608+0000","last_became_active":"2024-09-12T16:58:27.753179+0000","last_became_peered":"2024-09-12T16:58:27.753179+0000","last_unstale":"2024-09-12T17:41:25.115608+0000","last_undegraded":"2024-09-12T17:41:25.115608+0000","last_fullsized":"2024-09-12T17:41:25.115608+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":700,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:00.243547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"265'139","reported_seq":662,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:23.672296+0000","last_change":"2024-09-12T16:58:29.779572+0000","last_active":"2024-09-12T17:41:23.672296+0000","last_peered":"2024-09-12T17:41:23.672296+0000","last_clean":"2024-09-12T17:41:23.672296+0000","last_became_active":"2024-09-12T16:58:29.778839+0000","last_became_peered":"2024-09-12T16:58:29.778839+0000","last_unstale":"2024-09-12T17:41:23.672296+0000","last_undegraded":"2024-09-12T17:41:23.672296+0000","last_fullsized":"2024-09-12T17:41:23.672296+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:04.060160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":288,"num_read_kb":252,"num_write":342,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"265'188","reported_seq":776,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:51.289772+0000","last_change":"2024-09-12T16:58:21.707767+0000","last_active":"2024-09-12T17:38:51.289772+0000","last_peered":"2024-09-12T17:38:51.289772+0000","last_clean":"2024-09-12T17:38:51.289772+0000","last_became_active":"2024-09-12T16:58:21.706953+0000","last_became_peered":"2024-09-12T16:58:21.706953+0000","last_unstale":"2024-09-12T17:38:51.289772+0000","last_undegraded":"2024-09-12T17:38:51.289772+0000","last_fullsized":"2024-09-12T17:38:51.289772+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:00.611915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":782,"num_read_kb":644,"num_write":280,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"265'274","reported_seq":908,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:49.358546+0000","last_change":"2024-09-12T16:58:18.693726+0000","last_active":"2024-09-12T17:39:49.358546+0000","last_peered":"2024-09-12T17:39:49.358546+0000","last_clean":"2024-09-12T17:39:49.358546+0000","last_became_active":"2024-09-12T16:58:18.686189+0000","last_became_peered":"2024-09-12T16:58:18.686189+0000","last_unstale":"2024-09-12T17:39:49.358546+0000","last_undegraded":"2024-09-12T17:39:49.358546+0000","last_fullsized":"2024-09-12T17:39:49.358546+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:38.741983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3594,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":463,"num_read_kb":6575,"num_write":1003,"num_write_kb":19619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1454,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:31.424308+0000","last_change":"2024-09-12T16:58:23.707182+0000","last_active":"2024-09-12T17:41:31.424308+0000","last_peered":"2024-09-12T17:41:31.424308+0000","last_clean":"2024-09-12T17:41:31.424308+0000","last_became_active":"2024-09-12T16:58:23.706471+0000","last_became_peered":"2024-09-12T16:58:23.706471+0000","last_unstale":"2024-09-12T17:41:31.424308+0000","last_undegraded":"2024-09-12T17:41:31.424308+0000","last_fullsized":"2024-09-12T17:41:31.424308+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:02.525244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":956,"num_read_kb":956,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"265'78","reported_seq":598,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:26.200090+0000","last_change":"2024-09-12T16:58:25.950921+0000","last_active":"2024-09-12T17:39:26.200090+0000","last_peered":"2024-09-12T17:39:26.200090+0000","last_clean":"2024-09-12T17:39:26.200090+0000","last_became_active":"2024-09-12T16:58:25.949962+0000","last_became_peered":"2024-09-12T16:58:25.949962+0000","last_unstale":"2024-09-12T17:39:26.200090+0000","last_undegraded":"2024-09-12T17:39:26.200090+0000","last_fullsized":"2024-09-12T17:39:26.200090+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:35.151455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"265'754","reported_seq":4002,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:25.115415+0000","last_change":"2024-09-12T16:58:27.756362+0000","last_active":"2024-09-12T17:41:25.115415+0000","last_peered":"2024-09-12T17:41:25.115415+0000","last_clean":"2024-09-12T17:41:25.115415+0000","last_became_active":"2024-09-12T16:58:27.755569+0000","last_became_peered":"2024-09-12T16:58:27.755569+0000","last_unstale":"2024-09-12T17:41:25.115415+0000","last_undegraded":"2024-09-12T17:41:25.115415+0000","last_fullsized":"2024-09-12T17:41:25.115415+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:36.568674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"265'116","reported_seq":624,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:24.000291+0000","last_change":"2024-09-12T16:58:29.781541+0000","last_active":"2024-09-12T17:39:24.000291+0000","last_peered":"2024-09-12T17:39:24.000291+0000","last_clean":"2024-09-12T17:39:24.000291+0000","last_became_active":"2024-09-12T16:58:29.780289+0000","last_became_peered":"2024-09-12T16:58:29.780289+0000","last_unstale":"2024-09-12T17:39:24.000291+0000","last_undegraded":"2024-09-12T17:39:24.000291+0000","last_fullsized":"2024-09-12T17:39:24.000291+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:45.266710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":175,"num_write":267,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"265'140","reported_seq":797,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:32.931293+0000","last_change":"2024-09-12T16:58:21.720633+0000","last_active":"2024-09-12T17:39:32.931293+0000","last_peered":"2024-09-12T17:39:32.931293+0000","last_clean":"2024-09-12T17:39:32.931293+0000","last_became_active":"2024-09-12T16:58:21.719827+0000","last_became_peered":"2024-09-12T16:58:21.719827+0000","last_unstale":"2024-09-12T17:39:32.931293+0000","last_undegraded":"2024-09-12T17:39:32.931293+0000","last_fullsized":"2024-09-12T17:39:32.931293+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:57.062320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":689,"num_read_kb":590,"num_write":204,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"265'276","reported_seq":922,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.364338+0000","last_change":"2024-09-12T16:58:18.705680+0000","last_active":"2024-09-12T17:41:32.364338+0000","last_peered":"2024-09-12T17:41:32.364338+0000","last_clean":"2024-09-12T17:41:32.364338+0000","last_became_active":"2024-09-12T16:58:18.705048+0000","last_became_peered":"2024-09-12T16:58:18.705048+0000","last_unstale":"2024-09-12T17:41:32.364338+0000","last_undegraded":"2024-09-12T17:41:32.364338+0000","last_fullsized":"2024-09-12T17:41:32.364338+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:04.638122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2618767,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":446,"num_read_kb":3390,"num_write":999,"num_write_kb":22669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"36'5","reported_seq":977,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:24.522437+0000","last_change":"2024-09-12T16:58:23.703535+0000","last_active":"2024-09-12T17:41:24.522437+0000","last_peered":"2024-09-12T17:41:24.522437+0000","last_clean":"2024-09-12T17:41:24.522437+0000","last_became_active":"2024-09-12T16:58:23.702699+0000","last_became_peered":"2024-09-12T16:58:23.702699+0000","last_unstale":"2024-09-12T17:41:24.522437+0000","last_undegraded":"2024-09-12T17:41:24.522437+0000","last_fullsized":"2024-09-12T17:41:24.522437+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:52.474180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"265'340","reported_seq":939,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:24.867019+0000","last_change":"2024-09-12T16:58:25.725360+0000","last_active":"2024-09-12T17:41:24.867019+0000","last_peered":"2024-09-12T17:41:24.867019+0000","last_clean":"2024-09-12T17:41:24.867019+0000","last_became_active":"2024-09-12T16:58:25.724694+0000","last_became_peered":"2024-09-12T16:58:25.724694+0000","last_unstale":"2024-09-12T17:41:24.867019+0000","last_undegraded":"2024-09-12T17:41:24.867019+0000","last_fullsized":"2024-09-12T17:41:24.867019+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:22.997913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63869,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":549,"num_read_kb":1058,"num_write":438,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:01.307379+0000","last_change":"2024-09-12T16:58:27.741238+0000","last_active":"2024-09-12T17:39:01.307379+0000","last_peered":"2024-09-12T17:39:01.307379+0000","last_clean":"2024-09-12T17:39:01.307379+0000","last_became_active":"2024-09-12T16:58:27.740510+0000","last_became_peered":"2024-09-12T16:58:27.740510+0000","last_unstale":"2024-09-12T17:39:01.307379+0000","last_undegraded":"2024-09-12T17:39:01.307379+0000","last_fullsized":"2024-09-12T17:39:01.307379+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:22.805172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"265'127","reported_seq":619,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:03.172275+0000","last_change":"2024-09-12T16:58:29.776743+0000","last_active":"2024-09-12T17:40:03.172275+0000","last_peered":"2024-09-12T17:40:03.172275+0000","last_clean":"2024-09-12T17:40:03.172275+0000","last_became_active":"2024-09-12T16:58:29.776007+0000","last_became_peered":"2024-09-12T16:58:29.776007+0000","last_unstale":"2024-09-12T17:40:03.172275+0000","last_undegraded":"2024-09-12T17:40:03.172275+0000","last_fullsized":"2024-09-12T17:40:03.172275+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:10.538331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":162,"num_read_kb":158,"num_write":308,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"265'143","reported_seq":755,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:26.457471+0000","last_change":"2024-09-12T16:58:21.726965+0000","last_active":"2024-09-12T17:39:26.457471+0000","last_peered":"2024-09-12T17:39:26.457471+0000","last_clean":"2024-09-12T17:39:26.457471+0000","last_became_active":"2024-09-12T16:58:21.726160+0000","last_became_peered":"2024-09-12T16:58:21.726160+0000","last_unstale":"2024-09-12T17:39:26.457471+0000","last_undegraded":"2024-09-12T17:39:26.457471+0000","last_fullsized":"2024-09-12T17:39:26.457471+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:57.204197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":643,"num_read_kb":537,"num_write":216,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":612,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:16.305011+0000","last_change":"2024-09-12T16:58:04.218615+0000","last_active":"2024-09-12T17:38:16.305011+0000","last_peered":"2024-09-12T17:38:16.305011+0000","last_clean":"2024-09-12T17:38:16.305011+0000","last_became_active":"2024-09-12T16:58:04.216387+0000","last_became_peered":"2024-09-12T16:58:04.216387+0000","last_unstale":"2024-09-12T17:38:16.305011+0000","last_undegraded":"2024-09-12T17:38:16.305011+0000","last_fullsized":"2024-09-12T17:38:16.305011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:02.482619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:02.482619+0000","last_clean_scrub_stamp":"2024-09-12T16:58:02.482619+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:20.111220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":521,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:47.329290+0000","last_change":"2024-09-12T16:58:10.535498+0000","last_active":"2024-09-12T17:37:47.329290+0000","last_peered":"2024-09-12T17:37:47.329290+0000","last_clean":"2024-09-12T17:37:47.329290+0000","last_became_active":"2024-09-12T16:58:08.538227+0000","last_became_peered":"2024-09-12T16:58:08.538227+0000","last_unstale":"2024-09-12T17:37:47.329290+0000","last_undegraded":"2024-09-12T17:37:47.329290+0000","last_fullsized":"2024-09-12T17:37:47.329290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_clean_scrub_stamp":"2024-09-12T16:58:07.519706+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:36.699923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001171044,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"265'291","reported_seq":917,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:42.012113+0000","last_change":"2024-09-12T16:58:55.958137+0000","last_active":"2024-09-12T17:39:42.012113+0000","last_peered":"2024-09-12T17:39:42.012113+0000","last_clean":"2024-09-12T17:39:42.012113+0000","last_became_active":"2024-09-12T16:58:55.957231+0000","last_became_peered":"2024-09-12T16:58:55.957231+0000","last_unstale":"2024-09-12T17:39:42.012113+0000","last_undegraded":"2024-09-12T17:39:42.012113+0000","last_fullsized":"2024-09-12T17:39:42.012113+0000","mapping_epoch":37,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:39.817907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16149763,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":484,"num_read_kb":44869,"num_write":1058,"num_write_kb":45418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"36'3","reported_seq":977,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:24.524924+0000","last_change":"2024-09-12T16:58:23.719701+0000","last_active":"2024-09-12T17:41:24.524924+0000","last_peered":"2024-09-12T17:41:24.524924+0000","last_clean":"2024-09-12T17:41:24.524924+0000","last_became_active":"2024-09-12T16:58:23.718720+0000","last_became_peered":"2024-09-12T16:58:23.718720+0000","last_unstale":"2024-09-12T17:41:24.524924+0000","last_undegraded":"2024-09-12T17:41:24.524924+0000","last_fullsized":"2024-09-12T17:41:24.524924+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:27.937180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"265'676","reported_seq":1362,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:31.964232+0000","last_change":"2024-09-12T16:58:25.721421+0000","last_active":"2024-09-12T17:41:31.964232+0000","last_peered":"2024-09-12T17:41:31.964232+0000","last_clean":"2024-09-12T17:41:31.964232+0000","last_became_active":"2024-09-12T16:58:25.720741+0000","last_became_peered":"2024-09-12T16:58:25.720741+0000","last_unstale":"2024-09-12T17:41:31.964232+0000","last_undegraded":"2024-09-12T17:41:31.964232+0000","last_fullsized":"2024-09-12T17:41:31.964232+0000","mapping_epoch":30,"log_start":"265'600","ondisk_log_start":"265'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":600,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:58.053661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":173015,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1318,"num_read_kb":2750,"num_write":1232,"num_write_kb":1100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:27.339048+0000","last_change":"2024-09-12T16:58:27.746911+0000","last_active":"2024-09-12T17:37:27.339048+0000","last_peered":"2024-09-12T17:37:27.339048+0000","last_clean":"2024-09-12T17:37:27.339048+0000","last_became_active":"2024-09-12T16:58:27.746171+0000","last_became_peered":"2024-09-12T16:58:27.746171+0000","last_unstale":"2024-09-12T17:37:27.339048+0000","last_undegraded":"2024-09-12T17:37:27.339048+0000","last_fullsized":"2024-09-12T17:37:27.339048+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:24:35.029842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"265'209","reported_seq":915,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:03.864055+0000","last_change":"2024-09-12T16:58:29.769292+0000","last_active":"2024-09-12T17:40:03.864055+0000","last_peered":"2024-09-12T17:40:03.864055+0000","last_clean":"2024-09-12T17:40:03.864055+0000","last_became_active":"2024-09-12T16:58:29.768536+0000","last_became_peered":"2024-09-12T16:58:29.768536+0000","last_unstale":"2024-09-12T17:40:03.864055+0000","last_undegraded":"2024-09-12T17:40:03.864055+0000","last_fullsized":"2024-09-12T17:40:03.864055+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:00.483017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":520,"num_read_kb":510,"num_write":443,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"265'70","reported_seq":624,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:01.041564+0000","last_change":"2024-09-12T16:58:21.724410+0000","last_active":"2024-09-12T17:40:01.041564+0000","last_peered":"2024-09-12T17:40:01.041564+0000","last_clean":"2024-09-12T17:40:01.041564+0000","last_became_active":"2024-09-12T16:58:21.723703+0000","last_became_peered":"2024-09-12T16:58:21.723703+0000","last_unstale":"2024-09-12T17:40:01.041564+0000","last_undegraded":"2024-09-12T17:40:01.041564+0000","last_fullsized":"2024-09-12T17:40:01.041564+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:47.327553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":317,"num_read_kb":265,"num_write":106,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":521,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:21.306154+0000","last_change":"2024-09-12T16:58:10.928592+0000","last_active":"2024-09-12T17:38:21.306154+0000","last_peered":"2024-09-12T17:38:21.306154+0000","last_clean":"2024-09-12T17:38:21.306154+0000","last_became_active":"2024-09-12T16:58:08.536415+0000","last_became_peered":"2024-09-12T16:58:08.536415+0000","last_unstale":"2024-09-12T17:38:21.306154+0000","last_undegraded":"2024-09-12T17:38:21.306154+0000","last_fullsized":"2024-09-12T17:38:21.306154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_clean_scrub_stamp":"2024-09-12T16:58:07.519706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:44.873424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001332909,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"265'280","reported_seq":926,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.369380+0000","last_change":"2024-09-12T16:58:18.696403+0000","last_active":"2024-09-12T17:41:32.369380+0000","last_peered":"2024-09-12T17:41:32.369380+0000","last_clean":"2024-09-12T17:41:32.369380+0000","last_became_active":"2024-09-12T16:58:18.695755+0000","last_became_peered":"2024-09-12T16:58:18.695755+0000","last_unstale":"2024-09-12T17:41:32.369380+0000","last_undegraded":"2024-09-12T17:41:32.369380+0000","last_fullsized":"2024-09-12T17:41:32.369380+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:56.681369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448864,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":495,"num_read_kb":2857,"num_write":1023,"num_write_kb":24939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:27.324815+0000","last_change":"2024-09-12T16:58:23.713076+0000","last_active":"2024-09-12T17:37:27.324815+0000","last_peered":"2024-09-12T17:37:27.324815+0000","last_clean":"2024-09-12T17:37:27.324815+0000","last_became_active":"2024-09-12T16:58:23.712354+0000","last_became_peered":"2024-09-12T16:58:23.712354+0000","last_unstale":"2024-09-12T17:37:27.324815+0000","last_undegraded":"2024-09-12T17:37:27.324815+0000","last_fullsized":"2024-09-12T17:37:27.324815+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:23.368180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"265'1250","reported_seq":2707,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.353991+0000","last_change":"2024-09-12T16:58:25.721009+0000","last_active":"2024-09-12T17:41:33.353991+0000","last_peered":"2024-09-12T17:41:33.353991+0000","last_clean":"2024-09-12T17:41:33.353991+0000","last_became_active":"2024-09-12T16:58:25.720266+0000","last_became_peered":"2024-09-12T16:58:25.720266+0000","last_unstale":"2024-09-12T17:41:33.353991+0000","last_undegraded":"2024-09-12T17:41:33.353991+0000","last_fullsized":"2024-09-12T17:41:33.353991+0000","mapping_epoch":30,"log_start":"265'1200","ondisk_log_start":"265'1200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":1200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:01.087152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150793,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2049,"num_read_kb":3938,"num_write":1140,"num_write_kb":988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:16.305184+0000","last_change":"2024-09-12T16:58:27.746109+0000","last_active":"2024-09-12T17:38:16.305184+0000","last_peered":"2024-09-12T17:38:16.305184+0000","last_clean":"2024-09-12T17:38:16.305184+0000","last_became_active":"2024-09-12T16:58:27.745341+0000","last_became_peered":"2024-09-12T16:58:27.745341+0000","last_unstale":"2024-09-12T17:38:16.305184+0000","last_undegraded":"2024-09-12T17:38:16.305184+0000","last_fullsized":"2024-09-12T17:38:16.305184+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:12.798309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"265'209","reported_seq":724,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:45.564670+0000","last_change":"2024-09-12T16:58:29.776726+0000","last_active":"2024-09-12T17:39:45.564670+0000","last_peered":"2024-09-12T17:39:45.564670+0000","last_clean":"2024-09-12T17:39:45.564670+0000","last_became_active":"2024-09-12T16:58:29.775944+0000","last_became_peered":"2024-09-12T16:58:29.775944+0000","last_unstale":"2024-09-12T17:39:45.564670+0000","last_undegraded":"2024-09-12T17:39:45.564670+0000","last_fullsized":"2024-09-12T17:39:45.564670+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:58.956084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":347,"num_read_kb":347,"num_write":464,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"265'122","reported_seq":674,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:23.685021+0000","last_change":"2024-09-12T16:58:21.722030+0000","last_active":"2024-09-12T17:37:23.685021+0000","last_peered":"2024-09-12T17:37:23.685021+0000","last_clean":"2024-09-12T17:37:23.685021+0000","last_became_active":"2024-09-12T16:58:21.721591+0000","last_became_peered":"2024-09-12T16:58:21.721591+0000","last_unstale":"2024-09-12T17:37:23.685021+0000","last_undegraded":"2024-09-12T17:37:23.685021+0000","last_fullsized":"2024-09-12T17:37:23.685021+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:36.430469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":495,"num_read_kb":400,"num_write":173,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":521,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:45.267241+0000","last_change":"2024-09-12T16:58:10.591264+0000","last_active":"2024-09-12T17:37:45.267241+0000","last_peered":"2024-09-12T17:37:45.267241+0000","last_clean":"2024-09-12T17:37:45.267241+0000","last_became_active":"2024-09-12T16:58:08.534076+0000","last_became_peered":"2024-09-12T16:58:08.534076+0000","last_unstale":"2024-09-12T17:37:45.267241+0000","last_undegraded":"2024-09-12T17:37:45.267241+0000","last_fullsized":"2024-09-12T17:37:45.267241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_clean_scrub_stamp":"2024-09-12T16:58:07.519706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:08.414186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083305900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"265'312","reported_seq":933,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.325470+0000","last_change":"2024-09-12T16:58:18.706724+0000","last_active":"2024-09-12T17:41:33.325470+0000","last_peered":"2024-09-12T17:41:33.325470+0000","last_clean":"2024-09-12T17:41:33.325470+0000","last_became_active":"2024-09-12T16:58:18.702490+0000","last_became_peered":"2024-09-12T16:58:18.702490+0000","last_unstale":"2024-09-12T17:41:33.325470+0000","last_undegraded":"2024-09-12T17:41:33.325470+0000","last_fullsized":"2024-09-12T17:41:33.325470+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:03:09.377111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263185,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":455,"num_read_kb":7668,"num_write":1054,"num_write_kb":10637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:25.263146+0000","last_change":"2024-09-12T16:58:23.724826+0000","last_active":"2024-09-12T17:37:25.263146+0000","last_peered":"2024-09-12T17:37:25.263146+0000","last_clean":"2024-09-12T17:37:25.263146+0000","last_became_active":"2024-09-12T16:58:23.724300+0000","last_became_peered":"2024-09-12T16:58:23.724300+0000","last_unstale":"2024-09-12T17:37:25.263146+0000","last_undegraded":"2024-09-12T17:37:25.263146+0000","last_fullsized":"2024-09-12T17:37:25.263146+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:36.764896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"265'230","reported_seq":1294,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:20.111355+0000","last_change":"2024-09-12T16:58:25.949888+0000","last_active":"2024-09-12T17:41:20.111355+0000","last_peered":"2024-09-12T17:41:20.111355+0000","last_clean":"2024-09-12T17:41:20.111355+0000","last_became_active":"2024-09-12T16:58:25.949120+0000","last_became_peered":"2024-09-12T16:58:25.949120+0000","last_unstale":"2024-09-12T17:41:20.111355+0000","last_undegraded":"2024-09-12T17:41:20.111355+0000","last_fullsized":"2024-09-12T17:41:20.111355+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:25.274870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":178,"num_read_kb":168,"num_write":143,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:02.347062+0000","last_change":"2024-09-12T16:58:27.736961+0000","last_active":"2024-09-12T17:38:02.347062+0000","last_peered":"2024-09-12T17:38:02.347062+0000","last_clean":"2024-09-12T17:38:02.347062+0000","last_became_active":"2024-09-12T16:58:27.736215+0000","last_became_peered":"2024-09-12T16:58:27.736215+0000","last_unstale":"2024-09-12T17:38:02.347062+0000","last_undegraded":"2024-09-12T17:38:02.347062+0000","last_fullsized":"2024-09-12T17:38:02.347062+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:39.723240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"265'249","reported_seq":855,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:05.168772+0000","last_change":"2024-09-12T16:58:29.792850+0000","last_active":"2024-09-12T17:40:05.168772+0000","last_peered":"2024-09-12T17:40:05.168772+0000","last_clean":"2024-09-12T17:40:05.168772+0000","last_became_active":"2024-09-12T16:58:29.792069+0000","last_became_peered":"2024-09-12T16:58:29.792069+0000","last_unstale":"2024-09-12T17:40:05.168772+0000","last_undegraded":"2024-09-12T17:40:05.168772+0000","last_fullsized":"2024-09-12T17:40:05.168772+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:03.093750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1041,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":529,"num_read_kb":546,"num_write":531,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"265'182","reported_seq":838,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:55.411179+0000","last_change":"2024-09-12T16:58:21.730485+0000","last_active":"2024-09-12T17:38:55.411179+0000","last_peered":"2024-09-12T17:38:55.411179+0000","last_clean":"2024-09-12T17:38:55.411179+0000","last_became_active":"2024-09-12T16:58:21.729848+0000","last_became_peered":"2024-09-12T16:58:21.729848+0000","last_unstale":"2024-09-12T17:38:55.411179+0000","last_undegraded":"2024-09-12T17:38:55.411179+0000","last_fullsized":"2024-09-12T17:38:55.411179+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:36.732505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":860,"num_read_kb":722,"num_write":267,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:47.329231+0000","last_change":"2024-09-12T16:58:10.535375+0000","last_active":"2024-09-12T17:37:47.329231+0000","last_peered":"2024-09-12T17:37:47.329231+0000","last_clean":"2024-09-12T17:37:47.329231+0000","last_became_active":"2024-09-12T16:58:08.538078+0000","last_became_peered":"2024-09-12T16:58:08.538078+0000","last_unstale":"2024-09-12T17:37:47.329231+0000","last_undegraded":"2024-09-12T17:37:47.329231+0000","last_fullsized":"2024-09-12T17:37:47.329231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_clean_scrub_stamp":"2024-09-12T16:58:07.519706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:19.309437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012028640000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"265'308","reported_seq":1019,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:51.332245+0000","last_change":"2024-09-12T16:58:18.694335+0000","last_active":"2024-09-12T17:39:51.332245+0000","last_peered":"2024-09-12T17:39:51.332245+0000","last_clean":"2024-09-12T17:39:51.332245+0000","last_became_active":"2024-09-12T16:58:18.690974+0000","last_became_peered":"2024-09-12T16:58:18.690974+0000","last_unstale":"2024-09-12T17:39:51.332245+0000","last_undegraded":"2024-09-12T17:39:51.332245+0000","last_fullsized":"2024-09-12T17:39:51.332245+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:48.350096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5648829,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":603,"num_read_kb":31815,"num_write":1085,"num_write_kb":57340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:12.349471+0000","last_change":"2024-09-12T16:58:23.713734+0000","last_active":"2024-09-12T17:38:12.349471+0000","last_peered":"2024-09-12T17:38:12.349471+0000","last_clean":"2024-09-12T17:38:12.349471+0000","last_became_active":"2024-09-12T16:58:23.713019+0000","last_became_peered":"2024-09-12T16:58:23.713019+0000","last_unstale":"2024-09-12T17:38:12.349471+0000","last_undegraded":"2024-09-12T17:38:12.349471+0000","last_fullsized":"2024-09-12T17:38:12.349471+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:50.721387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"265'106","reported_seq":647,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:37.374180+0000","last_change":"2024-09-12T16:58:25.719093+0000","last_active":"2024-09-12T17:39:37.374180+0000","last_peered":"2024-09-12T17:39:37.374180+0000","last_clean":"2024-09-12T17:39:37.374180+0000","last_became_active":"2024-09-12T16:58:25.718364+0000","last_became_peered":"2024-09-12T16:58:25.718364+0000","last_unstale":"2024-09-12T17:39:37.374180+0000","last_undegraded":"2024-09-12T17:39:37.374180+0000","last_fullsized":"2024-09-12T17:39:37.374180+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:32.974861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":134,"num_write":100,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:31.287928+0000","last_change":"2024-09-12T16:58:27.762825+0000","last_active":"2024-09-12T17:37:31.287928+0000","last_peered":"2024-09-12T17:37:31.287928+0000","last_clean":"2024-09-12T17:37:31.287928+0000","last_became_active":"2024-09-12T16:58:27.761992+0000","last_became_peered":"2024-09-12T16:58:27.761992+0000","last_unstale":"2024-09-12T17:37:31.287928+0000","last_undegraded":"2024-09-12T17:37:31.287928+0000","last_fullsized":"2024-09-12T17:37:31.287928+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:59:01.991644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"265'110","reported_seq":663,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:45.784115+0000","last_change":"2024-09-12T16:58:29.788605+0000","last_active":"2024-09-12T17:39:45.784115+0000","last_peered":"2024-09-12T17:39:45.784115+0000","last_clean":"2024-09-12T17:39:45.784115+0000","last_became_active":"2024-09-12T16:58:29.787823+0000","last_became_peered":"2024-09-12T16:58:29.787823+0000","last_unstale":"2024-09-12T17:39:45.784115+0000","last_undegraded":"2024-09-12T17:39:45.784115+0000","last_fullsized":"2024-09-12T17:39:45.784115+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:40.857819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":275,"num_read_kb":264,"num_write":276,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"265'60","reported_seq":613,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:45.856557+0000","last_change":"2024-09-12T16:58:21.722318+0000","last_active":"2024-09-12T17:38:45.856557+0000","last_peered":"2024-09-12T17:38:45.856557+0000","last_clean":"2024-09-12T17:38:45.856557+0000","last_became_active":"2024-09-12T16:58:21.720884+0000","last_became_peered":"2024-09-12T16:58:21.720884+0000","last_unstale":"2024-09-12T17:38:45.856557+0000","last_undegraded":"2024-09-12T17:38:45.856557+0000","last_fullsized":"2024-09-12T17:38:45.856557+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:32.526744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":223,"num_write":91,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"265'328","reported_seq":974,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.362282+0000","last_change":"2024-09-12T16:58:18.719301+0000","last_active":"2024-09-12T17:41:32.362282+0000","last_peered":"2024-09-12T17:41:32.362282+0000","last_clean":"2024-09-12T17:41:32.362282+0000","last_became_active":"2024-09-12T16:58:18.718447+0000","last_became_peered":"2024-09-12T16:58:18.718447+0000","last_unstale":"2024-09-12T17:41:32.362282+0000","last_undegraded":"2024-09-12T17:41:32.362282+0000","last_fullsized":"2024-09-12T17:41:32.362282+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:48.031054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1820306,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":467,"num_read_kb":35874,"num_write":1162,"num_write_kb":51856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":520,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:48.690429+0000","last_change":"2024-09-12T16:58:10.542079+0000","last_active":"2024-09-12T17:37:48.690429+0000","last_peered":"2024-09-12T17:37:48.690429+0000","last_clean":"2024-09-12T17:37:48.690429+0000","last_became_active":"2024-09-12T16:58:08.842793+0000","last_became_peered":"2024-09-12T16:58:08.842793+0000","last_unstale":"2024-09-12T17:37:48.690429+0000","last_undegraded":"2024-09-12T17:37:48.690429+0000","last_fullsized":"2024-09-12T17:37:48.690429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_clean_scrub_stamp":"2024-09-12T16:58:07.519706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:21.164130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001121181,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:02.347021+0000","last_change":"2024-09-12T16:58:23.712397+0000","last_active":"2024-09-12T17:38:02.347021+0000","last_peered":"2024-09-12T17:38:02.347021+0000","last_clean":"2024-09-12T17:38:02.347021+0000","last_became_active":"2024-09-12T16:58:23.710355+0000","last_became_peered":"2024-09-12T16:58:23.710355+0000","last_unstale":"2024-09-12T17:38:02.347021+0000","last_undegraded":"2024-09-12T17:38:02.347021+0000","last_fullsized":"2024-09-12T17:38:02.347021+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:49.303296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"265'562","reported_seq":1212,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:31.944656+0000","last_change":"2024-09-12T16:58:25.731056+0000","last_active":"2024-09-12T17:41:31.944656+0000","last_peered":"2024-09-12T17:41:31.944656+0000","last_clean":"2024-09-12T17:41:31.944656+0000","last_became_active":"2024-09-12T16:58:25.729627+0000","last_became_peered":"2024-09-12T16:58:25.729627+0000","last_unstale":"2024-09-12T17:41:31.944656+0000","last_undegraded":"2024-09-12T17:41:31.944656+0000","last_fullsized":"2024-09-12T17:41:31.944656+0000","mapping_epoch":30,"log_start":"265'500","ondisk_log_start":"265'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":500,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:16.481975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116167,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1549,"num_read_kb":2536,"num_write":2020,"num_write_kb":1866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:06.279604+0000","last_change":"2024-09-12T16:58:27.734028+0000","last_active":"2024-09-12T17:38:06.279604+0000","last_peered":"2024-09-12T17:38:06.279604+0000","last_clean":"2024-09-12T17:38:06.279604+0000","last_became_active":"2024-09-12T16:58:27.733289+0000","last_became_peered":"2024-09-12T16:58:27.733289+0000","last_unstale":"2024-09-12T17:38:06.279604+0000","last_undegraded":"2024-09-12T17:38:06.279604+0000","last_fullsized":"2024-09-12T17:38:06.279604+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:05.333134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"265'157","reported_seq":661,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:44.925507+0000","last_change":"2024-09-12T16:58:29.779788+0000","last_active":"2024-09-12T17:39:44.925507+0000","last_peered":"2024-09-12T17:39:44.925507+0000","last_clean":"2024-09-12T17:39:44.925507+0000","last_became_active":"2024-09-12T16:58:29.779052+0000","last_became_peered":"2024-09-12T16:58:29.779052+0000","last_unstale":"2024-09-12T17:39:44.925507+0000","last_undegraded":"2024-09-12T17:39:44.925507+0000","last_fullsized":"2024-09-12T17:39:44.925507+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:46.799747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":199,"num_read_kb":192,"num_write":361,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"265'202","reported_seq":806,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:57.345814+0000","last_change":"2024-09-12T16:58:21.702417+0000","last_active":"2024-09-12T17:37:57.345814+0000","last_peered":"2024-09-12T17:37:57.345814+0000","last_clean":"2024-09-12T17:37:57.345814+0000","last_became_active":"2024-09-12T16:58:21.701657+0000","last_became_peered":"2024-09-12T16:58:21.701657+0000","last_unstale":"2024-09-12T17:37:57.345814+0000","last_undegraded":"2024-09-12T17:37:57.345814+0000","last_fullsized":"2024-09-12T17:37:57.345814+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:39.768733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":888,"num_read_kb":728,"num_write":297,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"265'330","reported_seq":954,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.294376+0000","last_change":"2024-09-12T16:58:18.700995+0000","last_active":"2024-09-12T17:41:33.294376+0000","last_peered":"2024-09-12T17:41:33.294376+0000","last_clean":"2024-09-12T17:41:33.294376+0000","last_became_active":"2024-09-12T16:58:18.698417+0000","last_became_peered":"2024-09-12T16:58:18.698417+0000","last_unstale":"2024-09-12T17:41:33.294376+0000","last_undegraded":"2024-09-12T17:41:33.294376+0000","last_fullsized":"2024-09-12T17:41:33.294376+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:21:09.942403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":462,"num_read_kb":2498,"num_write":998,"num_write_kb":19196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":520,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:56.300230+0000","last_change":"2024-09-12T16:58:10.928593+0000","last_active":"2024-09-12T17:37:56.300230+0000","last_peered":"2024-09-12T17:37:56.300230+0000","last_clean":"2024-09-12T17:37:56.300230+0000","last_became_active":"2024-09-12T16:58:08.841831+0000","last_became_peered":"2024-09-12T16:58:08.841831+0000","last_unstale":"2024-09-12T17:37:56.300230+0000","last_undegraded":"2024-09-12T17:37:56.300230+0000","last_fullsized":"2024-09-12T17:37:56.300230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_clean_scrub_stamp":"2024-09-12T16:58:07.519706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:41.789253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013535820000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:01.294217+0000","last_change":"2024-09-12T16:58:23.708567+0000","last_active":"2024-09-12T17:38:01.294217+0000","last_peered":"2024-09-12T17:38:01.294217+0000","last_clean":"2024-09-12T17:38:01.294217+0000","last_became_active":"2024-09-12T16:58:23.707729+0000","last_became_peered":"2024-09-12T16:58:23.707729+0000","last_unstale":"2024-09-12T17:38:01.294217+0000","last_undegraded":"2024-09-12T17:38:01.294217+0000","last_fullsized":"2024-09-12T17:38:01.294217+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:34.309579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"265'150","reported_seq":710,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:49.590614+0000","last_change":"2024-09-12T16:58:25.950943+0000","last_active":"2024-09-12T17:38:49.590614+0000","last_peered":"2024-09-12T17:38:49.590614+0000","last_clean":"2024-09-12T17:38:49.590614+0000","last_became_active":"2024-09-12T16:58:25.950057+0000","last_became_peered":"2024-09-12T16:58:25.950057+0000","last_unstale":"2024-09-12T17:38:49.590614+0000","last_undegraded":"2024-09-12T17:38:49.590614+0000","last_fullsized":"2024-09-12T17:38:49.590614+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:04.088948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":199,"num_read_kb":190,"num_write":134,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"265'768","reported_seq":2768,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:31.875034+0000","last_change":"2024-09-12T16:58:27.758626+0000","last_active":"2024-09-12T17:41:31.875034+0000","last_peered":"2024-09-12T17:41:31.875034+0000","last_clean":"2024-09-12T17:41:31.875034+0000","last_became_active":"2024-09-12T16:58:27.756883+0000","last_became_peered":"2024-09-12T16:58:27.756883+0000","last_unstale":"2024-09-12T17:41:31.875034+0000","last_undegraded":"2024-09-12T17:41:31.875034+0000","last_fullsized":"2024-09-12T17:41:31.875034+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:09.429114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"265'131","reported_seq":630,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:24.919336+0000","last_change":"2024-09-12T16:58:29.785504+0000","last_active":"2024-09-12T17:41:24.919336+0000","last_peered":"2024-09-12T17:41:24.919336+0000","last_clean":"2024-09-12T17:41:24.919336+0000","last_became_active":"2024-09-12T16:58:29.784743+0000","last_became_peered":"2024-09-12T16:58:29.784743+0000","last_unstale":"2024-09-12T17:41:24.919336+0000","last_undegraded":"2024-09-12T17:41:24.919336+0000","last_fullsized":"2024-09-12T17:41:24.919336+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:07.819438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1532,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":153,"num_read_kb":151,"num_write":316,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"265'49","reported_seq":586,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:32.357724+0000","last_change":"2024-09-12T16:58:21.723795+0000","last_active":"2024-09-12T17:38:32.357724+0000","last_peered":"2024-09-12T17:38:32.357724+0000","last_clean":"2024-09-12T17:38:32.357724+0000","last_became_active":"2024-09-12T16:58:21.723391+0000","last_became_peered":"2024-09-12T16:58:21.723391+0000","last_unstale":"2024-09-12T17:38:32.357724+0000","last_undegraded":"2024-09-12T17:38:32.357724+0000","last_fullsized":"2024-09-12T17:38:32.357724+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:53.524544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":182,"num_write":83,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"265'398","reported_seq":1036,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.384226+0000","last_change":"2024-09-12T16:58:18.687350+0000","last_active":"2024-09-12T17:41:32.384226+0000","last_peered":"2024-09-12T17:41:32.384226+0000","last_clean":"2024-09-12T17:41:32.384226+0000","last_became_active":"2024-09-12T16:58:18.686966+0000","last_became_peered":"2024-09-12T16:58:18.686966+0000","last_unstale":"2024-09-12T17:41:32.384226+0000","last_undegraded":"2024-09-12T17:41:32.384226+0000","last_fullsized":"2024-09-12T17:41:32.384226+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:41.879490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1404504,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":569,"num_read_kb":10296,"num_write":1163,"num_write_kb":24848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":520,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:18.711565+0000","last_change":"2024-09-12T16:58:10.542239+0000","last_active":"2024-09-12T17:39:18.711565+0000","last_peered":"2024-09-12T17:39:18.711565+0000","last_clean":"2024-09-12T17:39:18.711565+0000","last_became_active":"2024-09-12T16:58:08.544406+0000","last_became_peered":"2024-09-12T16:58:08.544406+0000","last_unstale":"2024-09-12T17:39:18.711565+0000","last_undegraded":"2024-09-12T17:39:18.711565+0000","last_fullsized":"2024-09-12T17:39:18.711565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_clean_scrub_stamp":"2024-09-12T16:58:07.519706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:42.866569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012247510000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:01.278478+0000","last_change":"2024-09-12T16:58:23.701057+0000","last_active":"2024-09-12T17:38:01.278478+0000","last_peered":"2024-09-12T17:38:01.278478+0000","last_clean":"2024-09-12T17:38:01.278478+0000","last_became_active":"2024-09-12T16:58:23.700331+0000","last_became_peered":"2024-09-12T16:58:23.700331+0000","last_unstale":"2024-09-12T17:38:01.278478+0000","last_undegraded":"2024-09-12T17:38:01.278478+0000","last_fullsized":"2024-09-12T17:38:01.278478+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:36.712880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"265'119","reported_seq":654,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:32.549144+0000","last_change":"2024-09-12T16:58:25.731260+0000","last_active":"2024-09-12T17:39:32.549144+0000","last_peered":"2024-09-12T17:39:32.549144+0000","last_clean":"2024-09-12T17:39:32.549144+0000","last_became_active":"2024-09-12T16:58:25.730018+0000","last_became_peered":"2024-09-12T16:58:25.730018+0000","last_unstale":"2024-09-12T17:39:32.549144+0000","last_undegraded":"2024-09-12T17:39:32.549144+0000","last_fullsized":"2024-09-12T17:39:32.549144+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:14.303705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":134,"num_read_kb":123,"num_write":96,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"265'782","reported_seq":2344,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:31.891910+0000","last_change":"2024-09-12T16:58:27.747091+0000","last_active":"2024-09-12T17:41:31.891910+0000","last_peered":"2024-09-12T17:41:31.891910+0000","last_clean":"2024-09-12T17:41:31.891910+0000","last_became_active":"2024-09-12T16:58:27.746177+0000","last_became_peered":"2024-09-12T16:58:27.746177+0000","last_unstale":"2024-09-12T17:41:31.891910+0000","last_undegraded":"2024-09-12T17:41:31.891910+0000","last_fullsized":"2024-09-12T17:41:31.891910+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:44:59.636233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"265'168","reported_seq":662,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:26.453883+0000","last_change":"2024-09-12T16:58:29.791161+0000","last_active":"2024-09-12T17:39:26.453883+0000","last_peered":"2024-09-12T17:39:26.453883+0000","last_clean":"2024-09-12T17:39:26.453883+0000","last_became_active":"2024-09-12T16:58:29.790535+0000","last_became_peered":"2024-09-12T16:58:29.790535+0000","last_unstale":"2024-09-12T17:39:26.453883+0000","last_undegraded":"2024-09-12T17:39:26.453883+0000","last_fullsized":"2024-09-12T17:39:26.453883+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:22:58.632183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":476,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":147,"num_read_kb":144,"num_write":393,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"265'96","reported_seq":660,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:46.106322+0000","last_change":"2024-09-12T16:58:21.702014+0000","last_active":"2024-09-12T17:38:46.106322+0000","last_peered":"2024-09-12T17:38:46.106322+0000","last_clean":"2024-09-12T17:38:46.106322+0000","last_became_active":"2024-09-12T16:58:21.701206+0000","last_became_peered":"2024-09-12T16:58:21.701206+0000","last_unstale":"2024-09-12T17:38:46.106322+0000","last_undegraded":"2024-09-12T17:38:46.106322+0000","last_fullsized":"2024-09-12T17:38:46.106322+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:06.784285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":405,"num_read_kb":331,"num_write":157,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"265'312","reported_seq":968,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.370987+0000","last_change":"2024-09-12T16:58:18.702748+0000","last_active":"2024-09-12T17:41:32.370987+0000","last_peered":"2024-09-12T17:41:32.370987+0000","last_clean":"2024-09-12T17:41:32.370987+0000","last_became_active":"2024-09-12T16:58:18.701270+0000","last_became_peered":"2024-09-12T16:58:18.701270+0000","last_unstale":"2024-09-12T17:41:32.370987+0000","last_undegraded":"2024-09-12T17:41:32.370987+0000","last_fullsized":"2024-09-12T17:41:32.370987+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:08.345573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6689697,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":520,"num_read_kb":17292,"num_write":1077,"num_write_kb":31476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":521,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:21.311776+0000","last_change":"2024-09-12T16:58:10.537187+0000","last_active":"2024-09-12T17:39:21.311776+0000","last_peered":"2024-09-12T17:39:21.311776+0000","last_clean":"2024-09-12T17:39:21.311776+0000","last_became_active":"2024-09-12T16:58:08.546519+0000","last_became_peered":"2024-09-12T16:58:08.546519+0000","last_unstale":"2024-09-12T17:39:21.311776+0000","last_undegraded":"2024-09-12T17:39:21.311776+0000","last_fullsized":"2024-09-12T17:39:21.311776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_clean_scrub_stamp":"2024-09-12T16:58:07.519706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:11.277662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088376600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:37.358927+0000","last_change":"2024-09-12T16:58:23.707506+0000","last_active":"2024-09-12T17:38:37.358927+0000","last_peered":"2024-09-12T17:38:37.358927+0000","last_clean":"2024-09-12T17:38:37.358927+0000","last_became_active":"2024-09-12T16:58:23.707022+0000","last_became_peered":"2024-09-12T16:58:23.707022+0000","last_unstale":"2024-09-12T17:38:37.358927+0000","last_undegraded":"2024-09-12T17:38:37.358927+0000","last_fullsized":"2024-09-12T17:38:37.358927+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:09.125943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"265'726","reported_seq":1428,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:24.843036+0000","last_change":"2024-09-12T16:58:25.949990+0000","last_active":"2024-09-12T17:41:24.843036+0000","last_peered":"2024-09-12T17:41:24.843036+0000","last_clean":"2024-09-12T17:41:24.843036+0000","last_became_active":"2024-09-12T16:58:25.949263+0000","last_became_peered":"2024-09-12T16:58:25.949263+0000","last_unstale":"2024-09-12T17:41:24.843036+0000","last_undegraded":"2024-09-12T17:41:24.843036+0000","last_fullsized":"2024-09-12T17:41:24.843036+0000","mapping_epoch":30,"log_start":"265'700","ondisk_log_start":"265'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":700,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:06.590619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177447,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1291,"num_read_kb":2791,"num_write":1072,"num_write_kb":912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:02.350591+0000","last_change":"2024-09-12T16:58:27.742543+0000","last_active":"2024-09-12T17:38:02.350591+0000","last_peered":"2024-09-12T17:38:02.350591+0000","last_clean":"2024-09-12T17:38:02.350591+0000","last_became_active":"2024-09-12T16:58:27.741779+0000","last_became_peered":"2024-09-12T16:58:27.741779+0000","last_unstale":"2024-09-12T17:38:02.350591+0000","last_undegraded":"2024-09-12T17:38:02.350591+0000","last_fullsized":"2024-09-12T17:38:02.350591+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:32.725498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"265'144","reported_seq":646,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:04.962585+0000","last_change":"2024-09-12T16:58:29.788557+0000","last_active":"2024-09-12T17:40:04.962585+0000","last_peered":"2024-09-12T17:40:04.962585+0000","last_clean":"2024-09-12T17:40:04.962585+0000","last_became_active":"2024-09-12T16:58:29.787692+0000","last_became_peered":"2024-09-12T16:58:29.787692+0000","last_unstale":"2024-09-12T17:40:04.962585+0000","last_undegraded":"2024-09-12T17:40:04.962585+0000","last_fullsized":"2024-09-12T17:40:04.962585+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:15.861385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":218,"num_read_kb":207,"num_write":364,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"265'162","reported_seq":712,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:05.120577+0000","last_change":"2024-09-12T16:58:29.785185+0000","last_active":"2024-09-12T17:40:05.120577+0000","last_peered":"2024-09-12T17:40:05.120577+0000","last_clean":"2024-09-12T17:40:05.120577+0000","last_became_active":"2024-09-12T16:58:29.782784+0000","last_became_peered":"2024-09-12T16:58:29.782784+0000","last_unstale":"2024-09-12T17:40:05.120577+0000","last_undegraded":"2024-09-12T17:40:05.120577+0000","last_fullsized":"2024-09-12T17:40:05.120577+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:48.171949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":629,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":266,"num_read_kb":264,"num_write":397,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"265'100","reported_seq":687,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:37.730070+0000","last_change":"2024-09-12T16:58:21.732323+0000","last_active":"2024-09-12T17:39:37.730070+0000","last_peered":"2024-09-12T17:39:37.730070+0000","last_clean":"2024-09-12T17:39:37.730070+0000","last_became_active":"2024-09-12T16:58:21.731509+0000","last_became_peered":"2024-09-12T16:58:21.731509+0000","last_unstale":"2024-09-12T17:39:37.730070+0000","last_undegraded":"2024-09-12T17:39:37.730070+0000","last_fullsized":"2024-09-12T17:39:37.730070+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:40.822664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":445,"num_read_kb":375,"num_write":158,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"265'245","reported_seq":870,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:49.957292+0000","last_change":"2024-09-12T16:58:18.701223+0000","last_active":"2024-09-12T17:39:49.957292+0000","last_peered":"2024-09-12T17:39:49.957292+0000","last_clean":"2024-09-12T17:39:49.957292+0000","last_became_active":"2024-09-12T16:58:18.700214+0000","last_became_peered":"2024-09-12T16:58:18.700214+0000","last_unstale":"2024-09-12T17:39:49.957292+0000","last_undegraded":"2024-09-12T17:39:49.957292+0000","last_fullsized":"2024-09-12T17:39:49.957292+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:13.616837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2635297,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":418,"num_read_kb":3767,"num_write":988,"num_write_kb":19533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:08.694880+0000","last_change":"2024-09-12T16:58:23.725522+0000","last_active":"2024-09-12T17:38:08.694880+0000","last_peered":"2024-09-12T17:38:08.694880+0000","last_clean":"2024-09-12T17:38:08.694880+0000","last_became_active":"2024-09-12T16:58:23.725034+0000","last_became_peered":"2024-09-12T16:58:23.725034+0000","last_unstale":"2024-09-12T17:38:08.694880+0000","last_undegraded":"2024-09-12T17:38:08.694880+0000","last_fullsized":"2024-09-12T17:38:08.694880+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:15.538364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"265'268","reported_seq":838,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:24.880266+0000","last_change":"2024-09-12T16:58:25.738410+0000","last_active":"2024-09-12T17:41:24.880266+0000","last_peered":"2024-09-12T17:41:24.880266+0000","last_clean":"2024-09-12T17:41:24.880266+0000","last_became_active":"2024-09-12T16:58:25.737706+0000","last_became_peered":"2024-09-12T16:58:25.737706+0000","last_unstale":"2024-09-12T17:41:24.880266+0000","last_undegraded":"2024-09-12T17:41:24.880266+0000","last_fullsized":"2024-09-12T17:41:24.880266+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:02:12.766927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58506,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":438,"num_read_kb":920,"num_write":360,"num_write_kb":290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:07.351743+0000","last_change":"2024-09-12T16:58:27.746931+0000","last_active":"2024-09-12T17:38:07.351743+0000","last_peered":"2024-09-12T17:38:07.351743+0000","last_clean":"2024-09-12T17:38:07.351743+0000","last_became_active":"2024-09-12T16:58:27.746143+0000","last_became_peered":"2024-09-12T16:58:27.746143+0000","last_unstale":"2024-09-12T17:38:07.351743+0000","last_undegraded":"2024-09-12T17:38:07.351743+0000","last_fullsized":"2024-09-12T17:38:07.351743+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:38.513197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"265'116","reported_seq":626,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:57.572381+0000","last_change":"2024-09-12T16:58:29.786922+0000","last_active":"2024-09-12T17:38:57.572381+0000","last_peered":"2024-09-12T17:38:57.572381+0000","last_clean":"2024-09-12T17:38:57.572381+0000","last_became_active":"2024-09-12T16:58:29.784143+0000","last_became_peered":"2024-09-12T16:58:29.784143+0000","last_unstale":"2024-09-12T17:38:57.572381+0000","last_undegraded":"2024-09-12T17:38:57.572381+0000","last_fullsized":"2024-09-12T17:38:57.572381+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:57.768618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":186,"num_write":283,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"265'174","reported_seq":827,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:47.685307+0000","last_change":"2024-09-12T16:58:21.715883+0000","last_active":"2024-09-12T17:39:47.685307+0000","last_peered":"2024-09-12T17:39:47.685307+0000","last_clean":"2024-09-12T17:39:47.685307+0000","last_became_active":"2024-09-12T16:58:21.715193+0000","last_became_peered":"2024-09-12T16:58:21.715193+0000","last_unstale":"2024-09-12T17:39:47.685307+0000","last_undegraded":"2024-09-12T17:39:47.685307+0000","last_fullsized":"2024-09-12T17:39:47.685307+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:10.766328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":752,"num_read_kb":633,"num_write":248,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"265'285","reported_seq":912,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:36.521893+0000","last_change":"2024-09-12T16:58:18.686877+0000","last_active":"2024-09-12T17:39:36.521893+0000","last_peered":"2024-09-12T17:39:36.521893+0000","last_clean":"2024-09-12T17:39:36.521893+0000","last_became_active":"2024-09-12T16:58:18.686155+0000","last_became_peered":"2024-09-12T16:58:18.686155+0000","last_unstale":"2024-09-12T17:39:36.521893+0000","last_undegraded":"2024-09-12T17:39:36.521893+0000","last_fullsized":"2024-09-12T17:39:36.521893+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:04.515838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8761417,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":474,"num_read_kb":20889,"num_write":963,"num_write_kb":24291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:07.351964+0000","last_change":"2024-09-12T16:58:23.713527+0000","last_active":"2024-09-12T17:38:07.351964+0000","last_peered":"2024-09-12T17:38:07.351964+0000","last_clean":"2024-09-12T17:38:07.351964+0000","last_became_active":"2024-09-12T16:58:23.713069+0000","last_became_peered":"2024-09-12T16:58:23.713069+0000","last_unstale":"2024-09-12T17:38:07.351964+0000","last_undegraded":"2024-09-12T17:38:07.351964+0000","last_fullsized":"2024-09-12T17:38:07.351964+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:22.939725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"265'35","reported_seq":534,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:25.845238+0000","last_change":"2024-09-12T16:58:25.731248+0000","last_active":"2024-09-12T17:39:25.845238+0000","last_peered":"2024-09-12T17:39:25.845238+0000","last_clean":"2024-09-12T17:39:25.845238+0000","last_became_active":"2024-09-12T16:58:25.730410+0000","last_became_peered":"2024-09-12T16:58:25.730410+0000","last_unstale":"2024-09-12T17:39:25.845238+0000","last_undegraded":"2024-09-12T17:39:25.845238+0000","last_fullsized":"2024-09-12T17:39:25.845238+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:19.441232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:11.303833+0000","last_change":"2024-09-12T16:58:27.743749+0000","last_active":"2024-09-12T17:38:11.303833+0000","last_peered":"2024-09-12T17:38:11.303833+0000","last_clean":"2024-09-12T17:38:11.303833+0000","last_became_active":"2024-09-12T16:58:27.742979+0000","last_became_peered":"2024-09-12T16:58:27.742979+0000","last_unstale":"2024-09-12T17:38:11.303833+0000","last_undegraded":"2024-09-12T17:38:11.303833+0000","last_fullsized":"2024-09-12T17:38:11.303833+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:29.367350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"265'208","reported_seq":728,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:04.410688+0000","last_change":"2024-09-12T16:58:29.782903+0000","last_active":"2024-09-12T17:40:04.410688+0000","last_peered":"2024-09-12T17:40:04.410688+0000","last_clean":"2024-09-12T17:40:04.410688+0000","last_became_active":"2024-09-12T16:58:29.782024+0000","last_became_peered":"2024-09-12T16:58:29.782024+0000","last_unstale":"2024-09-12T17:40:04.410688+0000","last_undegraded":"2024-09-12T17:40:04.410688+0000","last_fullsized":"2024-09-12T17:40:04.410688+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:51.452618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":358,"num_read_kb":350,"num_write":466,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"265'521","reported_seq":1253,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:02.350548+0000","last_change":"2024-09-12T16:58:21.712078+0000","last_active":"2024-09-12T17:38:02.350548+0000","last_peered":"2024-09-12T17:38:02.350548+0000","last_clean":"2024-09-12T17:38:02.350548+0000","last_became_active":"2024-09-12T16:58:21.711637+0000","last_became_peered":"2024-09-12T16:58:21.711637+0000","last_unstale":"2024-09-12T17:38:02.350548+0000","last_undegraded":"2024-09-12T17:38:02.350548+0000","last_fullsized":"2024-09-12T17:38:02.350548+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":500,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:57.113912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2547,"num_read_kb":2246,"num_write":971,"num_write_kb":585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"265'302","reported_seq":904,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:52.101304+0000","last_change":"2024-09-12T16:58:55.852662+0000","last_active":"2024-09-12T17:39:52.101304+0000","last_peered":"2024-09-12T17:39:52.101304+0000","last_clean":"2024-09-12T17:39:52.101304+0000","last_became_active":"2024-09-12T16:58:55.851886+0000","last_became_peered":"2024-09-12T16:58:55.851886+0000","last_unstale":"2024-09-12T17:39:52.101304+0000","last_undegraded":"2024-09-12T17:39:52.101304+0000","last_fullsized":"2024-09-12T17:39:52.101304+0000","mapping_epoch":37,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:44.817591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5940266,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":435,"num_read_kb":19428,"num_write":1151,"num_write_kb":23867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:06.302568+0000","last_change":"2024-09-12T16:58:23.718833+0000","last_active":"2024-09-12T17:38:06.302568+0000","last_peered":"2024-09-12T17:38:06.302568+0000","last_clean":"2024-09-12T17:38:06.302568+0000","last_became_active":"2024-09-12T16:58:23.718109+0000","last_became_peered":"2024-09-12T16:58:23.718109+0000","last_unstale":"2024-09-12T17:38:06.302568+0000","last_undegraded":"2024-09-12T17:38:06.302568+0000","last_fullsized":"2024-09-12T17:38:06.302568+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:01.727111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"265'311","reported_seq":902,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.393549+0000","last_change":"2024-09-12T16:58:25.739863+0000","last_active":"2024-09-12T17:41:32.393549+0000","last_peered":"2024-09-12T17:41:32.393549+0000","last_clean":"2024-09-12T17:41:32.393549+0000","last_became_active":"2024-09-12T16:58:25.738463+0000","last_became_peered":"2024-09-12T16:58:25.738463+0000","last_unstale":"2024-09-12T17:41:32.393549+0000","last_undegraded":"2024-09-12T17:41:32.393549+0000","last_fullsized":"2024-09-12T17:41:32.393549+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:48.664021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46394,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":527,"num_read_kb":1194,"num_write":426,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:11.296562+0000","last_change":"2024-09-12T16:58:27.760862+0000","last_active":"2024-09-12T17:38:11.296562+0000","last_peered":"2024-09-12T17:38:11.296562+0000","last_clean":"2024-09-12T17:38:11.296562+0000","last_became_active":"2024-09-12T16:58:27.760265+0000","last_became_peered":"2024-09-12T16:58:27.760265+0000","last_unstale":"2024-09-12T17:38:11.296562+0000","last_undegraded":"2024-09-12T17:38:11.296562+0000","last_fullsized":"2024-09-12T17:38:11.296562+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:32.912040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"265'144","reported_seq":673,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:21.515529+0000","last_change":"2024-09-12T16:58:29.777889+0000","last_active":"2024-09-12T17:39:21.515529+0000","last_peered":"2024-09-12T17:39:21.515529+0000","last_clean":"2024-09-12T17:39:21.515529+0000","last_became_active":"2024-09-12T16:58:29.776448+0000","last_became_peered":"2024-09-12T16:58:29.776448+0000","last_unstale":"2024-09-12T17:39:21.515529+0000","last_undegraded":"2024-09-12T17:39:21.515529+0000","last_fullsized":"2024-09-12T17:39:21.515529+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:41.421501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":253,"num_read_kb":229,"num_write":261,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"265'251","reported_seq":879,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:22.384616+0000","last_change":"2024-09-12T16:58:21.706067+0000","last_active":"2024-09-12T17:40:22.384616+0000","last_peered":"2024-09-12T17:40:22.384616+0000","last_clean":"2024-09-12T17:40:22.384616+0000","last_became_active":"2024-09-12T16:58:21.705619+0000","last_became_peered":"2024-09-12T16:58:21.705619+0000","last_unstale":"2024-09-12T17:40:22.384616+0000","last_undegraded":"2024-09-12T17:40:22.384616+0000","last_fullsized":"2024-09-12T17:40:22.384616+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:17.879048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1131,"num_read_kb":917,"num_write":399,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"265'266","reported_seq":910,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.330134+0000","last_change":"2024-09-12T16:58:18.701775+0000","last_active":"2024-09-12T17:41:32.330134+0000","last_peered":"2024-09-12T17:41:32.330134+0000","last_clean":"2024-09-12T17:41:32.330134+0000","last_became_active":"2024-09-12T16:58:18.700720+0000","last_became_peered":"2024-09-12T16:58:18.700720+0000","last_unstale":"2024-09-12T17:41:32.330134+0000","last_undegraded":"2024-09-12T17:41:32.330134+0000","last_fullsized":"2024-09-12T17:41:32.330134+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:37.311441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":747088,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":378,"num_read_kb":68507,"num_write":893,"num_write_kb":27085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:06.295440+0000","last_change":"2024-09-12T16:58:23.721747+0000","last_active":"2024-09-12T17:38:06.295440+0000","last_peered":"2024-09-12T17:38:06.295440+0000","last_clean":"2024-09-12T17:38:06.295440+0000","last_became_active":"2024-09-12T16:58:23.721005+0000","last_became_peered":"2024-09-12T16:58:23.721005+0000","last_unstale":"2024-09-12T17:38:06.295440+0000","last_undegraded":"2024-09-12T17:38:06.295440+0000","last_fullsized":"2024-09-12T17:38:06.295440+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:29.561235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"265'241","reported_seq":803,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:26.336535+0000","last_change":"2024-09-12T16:58:25.733878+0000","last_active":"2024-09-12T17:40:26.336535+0000","last_peered":"2024-09-12T17:40:26.336535+0000","last_clean":"2024-09-12T17:40:26.336535+0000","last_became_active":"2024-09-12T16:58:25.732956+0000","last_became_peered":"2024-09-12T16:58:25.732956+0000","last_unstale":"2024-09-12T17:40:26.336535+0000","last_undegraded":"2024-09-12T17:40:26.336535+0000","last_fullsized":"2024-09-12T17:40:26.336535+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:50:45.059874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":402,"num_read_kb":847,"num_write":328,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:07.348165+0000","last_change":"2024-09-12T16:58:27.747511+0000","last_active":"2024-09-12T17:38:07.348165+0000","last_peered":"2024-09-12T17:38:07.348165+0000","last_clean":"2024-09-12T17:38:07.348165+0000","last_became_active":"2024-09-12T16:58:27.737089+0000","last_became_peered":"2024-09-12T16:58:27.737089+0000","last_unstale":"2024-09-12T17:38:07.348165+0000","last_undegraded":"2024-09-12T17:38:07.348165+0000","last_fullsized":"2024-09-12T17:38:07.348165+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:38.515071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"265'132","reported_seq":778,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:45.573465+0000","last_change":"2024-09-12T16:58:21.717882+0000","last_active":"2024-09-12T17:39:45.573465+0000","last_peered":"2024-09-12T17:39:45.573465+0000","last_clean":"2024-09-12T17:39:45.573465+0000","last_became_active":"2024-09-12T16:58:21.717079+0000","last_became_peered":"2024-09-12T16:58:21.717079+0000","last_unstale":"2024-09-12T17:39:45.573465+0000","last_undegraded":"2024-09-12T17:39:45.573465+0000","last_fullsized":"2024-09-12T17:39:45.573465+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:23.381407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":593,"num_read_kb":510,"num_write":185,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"265'291","reported_seq":927,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.364936+0000","last_change":"2024-09-12T16:58:18.677827+0000","last_active":"2024-09-12T17:41:32.364936+0000","last_peered":"2024-09-12T17:41:32.364936+0000","last_clean":"2024-09-12T17:41:32.364936+0000","last_became_active":"2024-09-12T16:58:18.677480+0000","last_became_peered":"2024-09-12T16:58:18.677480+0000","last_unstale":"2024-09-12T17:41:32.364936+0000","last_undegraded":"2024-09-12T17:41:32.364936+0000","last_fullsized":"2024-09-12T17:41:32.364936+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:38.035768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5638326,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":412,"num_read_kb":21305,"num_write":1067,"num_write_kb":20049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:37.355462+0000","last_change":"2024-09-12T16:58:23.719669+0000","last_active":"2024-09-12T17:38:37.355462+0000","last_peered":"2024-09-12T17:38:37.355462+0000","last_clean":"2024-09-12T17:38:37.355462+0000","last_became_active":"2024-09-12T16:58:23.719039+0000","last_became_peered":"2024-09-12T16:58:23.719039+0000","last_unstale":"2024-09-12T17:38:37.355462+0000","last_undegraded":"2024-09-12T17:38:37.355462+0000","last_fullsized":"2024-09-12T17:38:37.355462+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:00.880364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"265'471","reported_seq":1098,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.092416+0000","last_change":"2024-09-12T16:58:25.720911+0000","last_active":"2024-09-12T17:41:33.092416+0000","last_peered":"2024-09-12T17:41:33.092416+0000","last_clean":"2024-09-12T17:41:33.092416+0000","last_became_active":"2024-09-12T16:58:25.720165+0000","last_became_peered":"2024-09-12T16:58:25.720165+0000","last_unstale":"2024-09-12T17:41:33.092416+0000","last_undegraded":"2024-09-12T17:41:33.092416+0000","last_fullsized":"2024-09-12T17:41:33.092416+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:01.154748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97109,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":819,"num_read_kb":1920,"num_write":702,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:27.338321+0000","last_change":"2024-09-12T16:58:27.750193+0000","last_active":"2024-09-12T17:38:27.338321+0000","last_peered":"2024-09-12T17:38:27.338321+0000","last_clean":"2024-09-12T17:38:27.338321+0000","last_became_active":"2024-09-12T16:58:27.749390+0000","last_became_peered":"2024-09-12T16:58:27.749390+0000","last_unstale":"2024-09-12T17:38:27.338321+0000","last_undegraded":"2024-09-12T17:38:27.338321+0000","last_fullsized":"2024-09-12T17:38:27.338321+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:54.523888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"265'184","reported_seq":732,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:45.266732+0000","last_change":"2024-09-12T16:58:29.789122+0000","last_active":"2024-09-12T17:39:45.266732+0000","last_peered":"2024-09-12T17:39:45.266732+0000","last_clean":"2024-09-12T17:39:45.266732+0000","last_became_active":"2024-09-12T16:58:29.788460+0000","last_became_peered":"2024-09-12T16:58:29.788460+0000","last_unstale":"2024-09-12T17:39:45.266732+0000","last_undegraded":"2024-09-12T17:39:45.266732+0000","last_fullsized":"2024-09-12T17:39:45.266732+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:40.064167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":436,"num_read_kb":400,"num_write":425,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"265'128","reported_seq":737,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:37.856071+0000","last_change":"2024-09-12T16:58:21.724434+0000","last_active":"2024-09-12T17:38:37.856071+0000","last_peered":"2024-09-12T17:38:37.856071+0000","last_clean":"2024-09-12T17:38:37.856071+0000","last_became_active":"2024-09-12T16:58:21.724003+0000","last_became_peered":"2024-09-12T16:58:21.724003+0000","last_unstale":"2024-09-12T17:38:37.856071+0000","last_undegraded":"2024-09-12T17:38:37.856071+0000","last_fullsized":"2024-09-12T17:38:37.856071+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:30.276259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":616,"num_read_kb":520,"num_write":198,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"265'371","reported_seq":1061,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.307669+0000","last_change":"2024-09-12T16:58:18.707166+0000","last_active":"2024-09-12T17:41:33.307669+0000","last_peered":"2024-09-12T17:41:33.307669+0000","last_clean":"2024-09-12T17:41:33.307669+0000","last_became_active":"2024-09-12T16:58:18.706806+0000","last_became_peered":"2024-09-12T16:58:18.706806+0000","last_unstale":"2024-09-12T17:41:33.307669+0000","last_undegraded":"2024-09-12T17:41:33.307669+0000","last_fullsized":"2024-09-12T17:41:33.307669+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:51.584155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2005288,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":606,"num_read_kb":18575,"num_write":1246,"num_write_kb":49050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:01.294381+0000","last_change":"2024-09-12T16:58:23.721449+0000","last_active":"2024-09-12T17:38:01.294381+0000","last_peered":"2024-09-12T17:38:01.294381+0000","last_clean":"2024-09-12T17:38:01.294381+0000","last_became_active":"2024-09-12T16:58:23.720654+0000","last_became_peered":"2024-09-12T16:58:23.720654+0000","last_unstale":"2024-09-12T17:38:01.294381+0000","last_undegraded":"2024-09-12T17:38:01.294381+0000","last_fullsized":"2024-09-12T17:38:01.294381+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:08.970300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"265'311","reported_seq":887,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:56.343480+0000","last_change":"2024-09-12T16:58:25.734439+0000","last_active":"2024-09-12T17:40:56.343480+0000","last_peered":"2024-09-12T17:40:56.343480+0000","last_clean":"2024-09-12T17:40:56.343480+0000","last_became_active":"2024-09-12T16:58:25.733241+0000","last_became_peered":"2024-09-12T16:58:25.733241+0000","last_unstale":"2024-09-12T17:40:56.343480+0000","last_undegraded":"2024-09-12T17:40:56.343480+0000","last_fullsized":"2024-09-12T17:40:56.343480+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:46.538919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62402,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":505,"num_read_kb":1018,"num_write":428,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:28.699837+0000","last_change":"2024-09-12T16:58:27.751196+0000","last_active":"2024-09-12T17:38:28.699837+0000","last_peered":"2024-09-12T17:38:28.699837+0000","last_clean":"2024-09-12T17:38:28.699837+0000","last_became_active":"2024-09-12T16:58:27.750328+0000","last_became_peered":"2024-09-12T16:58:27.750328+0000","last_unstale":"2024-09-12T17:38:28.699837+0000","last_undegraded":"2024-09-12T17:38:28.699837+0000","last_fullsized":"2024-09-12T17:38:28.699837+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:06.616801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"265'181","reported_seq":680,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:04.425931+0000","last_change":"2024-09-12T16:58:29.777915+0000","last_active":"2024-09-12T17:40:04.425931+0000","last_peered":"2024-09-12T17:40:04.425931+0000","last_clean":"2024-09-12T17:40:04.425931+0000","last_became_active":"2024-09-12T16:58:29.777124+0000","last_became_peered":"2024-09-12T16:58:29.777124+0000","last_unstale":"2024-09-12T17:40:04.425931+0000","last_undegraded":"2024-09-12T17:40:04.425931+0000","last_fullsized":"2024-09-12T17:40:04.425931+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:43.622054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1215,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":228,"num_read_kb":227,"num_write":517,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"265'162","reported_seq":766,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:50.195600+0000","last_change":"2024-09-12T16:58:21.698980+0000","last_active":"2024-09-12T17:39:50.195600+0000","last_peered":"2024-09-12T17:39:50.195600+0000","last_clean":"2024-09-12T17:39:50.195600+0000","last_became_active":"2024-09-12T16:58:21.698565+0000","last_became_peered":"2024-09-12T16:58:21.698565+0000","last_unstale":"2024-09-12T17:39:50.195600+0000","last_undegraded":"2024-09-12T17:39:50.195600+0000","last_fullsized":"2024-09-12T17:39:50.195600+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:53.075338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":649,"num_read_kb":535,"num_write":267,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"265'271","reported_seq":920,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:29.247539+0000","last_change":"2024-09-12T16:58:18.701060+0000","last_active":"2024-09-12T17:38:29.247539+0000","last_peered":"2024-09-12T17:38:29.247539+0000","last_clean":"2024-09-12T17:38:29.247539+0000","last_became_active":"2024-09-12T16:58:18.700196+0000","last_became_peered":"2024-09-12T16:58:18.700196+0000","last_unstale":"2024-09-12T17:38:29.247539+0000","last_undegraded":"2024-09-12T17:38:29.247539+0000","last_fullsized":"2024-09-12T17:38:29.247539+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:18.696858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8463330,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":452,"num_read_kb":4020,"num_write":1020,"num_write_kb":21150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:26.284203+0000","last_change":"2024-09-12T16:58:23.703516+0000","last_active":"2024-09-12T17:38:26.284203+0000","last_peered":"2024-09-12T17:38:26.284203+0000","last_clean":"2024-09-12T17:38:26.284203+0000","last_became_active":"2024-09-12T16:58:23.702293+0000","last_became_peered":"2024-09-12T16:58:23.702293+0000","last_unstale":"2024-09-12T17:38:26.284203+0000","last_undegraded":"2024-09-12T17:38:26.284203+0000","last_fullsized":"2024-09-12T17:38:26.284203+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:48.660513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"265'321","reported_seq":893,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:24.892490+0000","last_change":"2024-09-12T16:58:25.950771+0000","last_active":"2024-09-12T17:41:24.892490+0000","last_peered":"2024-09-12T17:41:24.892490+0000","last_clean":"2024-09-12T17:41:24.892490+0000","last_became_active":"2024-09-12T16:58:25.949883+0000","last_became_peered":"2024-09-12T16:58:25.949883+0000","last_unstale":"2024-09-12T17:41:24.892490+0000","last_undegraded":"2024-09-12T17:41:24.892490+0000","last_fullsized":"2024-09-12T17:41:24.892490+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:22.560848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64150,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":503,"num_read_kb":1034,"num_write":428,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:28.699909+0000","last_change":"2024-09-12T16:58:27.749008+0000","last_active":"2024-09-12T17:38:28.699909+0000","last_peered":"2024-09-12T17:38:28.699909+0000","last_clean":"2024-09-12T17:38:28.699909+0000","last_became_active":"2024-09-12T16:58:27.739965+0000","last_became_peered":"2024-09-12T16:58:27.739965+0000","last_unstale":"2024-09-12T17:38:28.699909+0000","last_undegraded":"2024-09-12T17:38:28.699909+0000","last_fullsized":"2024-09-12T17:38:28.699909+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:19.228861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"265'138","reported_seq":629,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:24.910801+0000","last_change":"2024-09-12T16:58:29.772039+0000","last_active":"2024-09-12T17:41:24.910801+0000","last_peered":"2024-09-12T17:41:24.910801+0000","last_clean":"2024-09-12T17:41:24.910801+0000","last_became_active":"2024-09-12T16:58:29.771267+0000","last_became_peered":"2024-09-12T16:58:29.771267+0000","last_unstale":"2024-09-12T17:41:24.910801+0000","last_undegraded":"2024-09-12T17:41:24.910801+0000","last_fullsized":"2024-09-12T17:41:24.910801+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:22.290183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":401,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":154,"num_write":321,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"265'82","reported_seq":686,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:23.736000+0000","last_change":"2024-09-12T16:58:21.730974+0000","last_active":"2024-09-12T17:41:23.736000+0000","last_peered":"2024-09-12T17:41:23.736000+0000","last_clean":"2024-09-12T17:41:23.736000+0000","last_became_active":"2024-09-12T16:58:21.730342+0000","last_became_peered":"2024-09-12T16:58:21.730342+0000","last_unstale":"2024-09-12T17:41:23.736000+0000","last_undegraded":"2024-09-12T17:41:23.736000+0000","last_fullsized":"2024-09-12T17:41:23.736000+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:08.283142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":417,"num_read_kb":364,"num_write":119,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"265'272","reported_seq":960,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.369585+0000","last_change":"2024-09-12T16:58:18.689099+0000","last_active":"2024-09-12T17:41:32.369585+0000","last_peered":"2024-09-12T17:41:32.369585+0000","last_clean":"2024-09-12T17:41:32.369585+0000","last_became_active":"2024-09-12T16:58:18.688773+0000","last_became_peered":"2024-09-12T16:58:18.688773+0000","last_unstale":"2024-09-12T17:41:32.369585+0000","last_undegraded":"2024-09-12T17:41:32.369585+0000","last_fullsized":"2024-09-12T17:41:32.369585+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:33.745654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12614235,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":529,"num_read_kb":43210,"num_write":999,"num_write_kb":32802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:28.699789+0000","last_change":"2024-09-12T16:58:23.709450+0000","last_active":"2024-09-12T17:38:28.699789+0000","last_peered":"2024-09-12T17:38:28.699789+0000","last_clean":"2024-09-12T17:38:28.699789+0000","last_became_active":"2024-09-12T16:58:23.709009+0000","last_became_peered":"2024-09-12T16:58:23.709009+0000","last_unstale":"2024-09-12T17:38:28.699789+0000","last_undegraded":"2024-09-12T17:38:28.699789+0000","last_fullsized":"2024-09-12T17:38:28.699789+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:45.138172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"265'88","reported_seq":608,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:22.509004+0000","last_change":"2024-09-12T16:58:25.950055+0000","last_active":"2024-09-12T17:39:22.509004+0000","last_peered":"2024-09-12T17:39:22.509004+0000","last_clean":"2024-09-12T17:39:22.509004+0000","last_became_active":"2024-09-12T16:58:25.949196+0000","last_became_peered":"2024-09-12T16:58:25.949196+0000","last_unstale":"2024-09-12T17:39:22.509004+0000","last_undegraded":"2024-09-12T17:39:22.509004+0000","last_fullsized":"2024-09-12T17:39:22.509004+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:18:17.202967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":122,"num_read_kb":116,"num_write":142,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"265'754","reported_seq":2150,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:25.115187+0000","last_change":"2024-09-12T16:58:27.741265+0000","last_active":"2024-09-12T17:41:25.115187+0000","last_peered":"2024-09-12T17:41:25.115187+0000","last_clean":"2024-09-12T17:41:25.115187+0000","last_became_active":"2024-09-12T16:58:27.740416+0000","last_became_peered":"2024-09-12T16:58:27.740416+0000","last_unstale":"2024-09-12T17:41:25.115187+0000","last_undegraded":"2024-09-12T17:41:25.115187+0000","last_fullsized":"2024-09-12T17:41:25.115187+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:32.112107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"265'129","reported_seq":650,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:48.742930+0000","last_change":"2024-09-12T16:58:29.784795+0000","last_active":"2024-09-12T17:39:48.742930+0000","last_peered":"2024-09-12T17:39:48.742930+0000","last_clean":"2024-09-12T17:39:48.742930+0000","last_became_active":"2024-09-12T16:58:29.784128+0000","last_became_peered":"2024-09-12T16:58:29.784128+0000","last_unstale":"2024-09-12T17:39:48.742930+0000","last_undegraded":"2024-09-12T17:39:48.742930+0000","last_fullsized":"2024-09-12T17:39:48.742930+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:43.512905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":291,"num_read_kb":261,"num_write":354,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"265'159","reported_seq":754,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:46.951235+0000","last_change":"2024-09-12T16:58:21.701518+0000","last_active":"2024-09-12T17:39:46.951235+0000","last_peered":"2024-09-12T17:39:46.951235+0000","last_clean":"2024-09-12T17:39:46.951235+0000","last_became_active":"2024-09-12T16:58:21.700714+0000","last_became_peered":"2024-09-12T16:58:21.700714+0000","last_unstale":"2024-09-12T17:39:46.951235+0000","last_undegraded":"2024-09-12T17:39:46.951235+0000","last_fullsized":"2024-09-12T17:39:46.951235+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:00.095934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":716,"num_read_kb":600,"num_write":247,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"265'272","reported_seq":1024,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.364274+0000","last_change":"2024-09-12T16:58:18.706734+0000","last_active":"2024-09-12T17:41:32.364274+0000","last_peered":"2024-09-12T17:41:32.364274+0000","last_clean":"2024-09-12T17:41:32.364274+0000","last_became_active":"2024-09-12T16:58:18.706117+0000","last_became_peered":"2024-09-12T16:58:18.706117+0000","last_unstale":"2024-09-12T17:41:32.364274+0000","last_undegraded":"2024-09-12T17:41:32.364274+0000","last_fullsized":"2024-09-12T17:41:32.364274+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:11.952844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10067083,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":525,"num_read_kb":60034,"num_write":849,"num_write_kb":44854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:26.307328+0000","last_change":"2024-09-12T16:58:23.719072+0000","last_active":"2024-09-12T17:38:26.307328+0000","last_peered":"2024-09-12T17:38:26.307328+0000","last_clean":"2024-09-12T17:38:26.307328+0000","last_became_active":"2024-09-12T16:58:23.718211+0000","last_became_peered":"2024-09-12T16:58:23.718211+0000","last_unstale":"2024-09-12T17:38:26.307328+0000","last_undegraded":"2024-09-12T17:38:26.307328+0000","last_fullsized":"2024-09-12T17:38:26.307328+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:55.776100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"265'299","reported_seq":875,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:24.809083+0000","last_change":"2024-09-12T16:58:25.726107+0000","last_active":"2024-09-12T17:41:24.809083+0000","last_peered":"2024-09-12T17:41:24.809083+0000","last_clean":"2024-09-12T17:41:24.809083+0000","last_became_active":"2024-09-12T16:58:25.724774+0000","last_became_peered":"2024-09-12T16:58:25.724774+0000","last_unstale":"2024-09-12T17:41:24.809083+0000","last_undegraded":"2024-09-12T17:41:24.809083+0000","last_fullsized":"2024-09-12T17:41:24.809083+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:29.986764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55502,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":478,"num_read_kb":960,"num_write":388,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:07.334035+0000","last_change":"2024-09-12T16:58:27.759894+0000","last_active":"2024-09-12T17:37:07.334035+0000","last_peered":"2024-09-12T17:37:07.334035+0000","last_clean":"2024-09-12T17:37:07.334035+0000","last_became_active":"2024-09-12T16:58:27.755232+0000","last_became_peered":"2024-09-12T16:58:27.755232+0000","last_unstale":"2024-09-12T17:37:07.334035+0000","last_undegraded":"2024-09-12T17:37:07.334035+0000","last_fullsized":"2024-09-12T17:37:07.334035+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:26.735098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"265'133","reported_seq":645,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:04.245111+0000","last_change":"2024-09-12T16:58:29.782745+0000","last_active":"2024-09-12T17:40:04.245111+0000","last_peered":"2024-09-12T17:40:04.245111+0000","last_clean":"2024-09-12T17:40:04.245111+0000","last_became_active":"2024-09-12T16:58:29.782006+0000","last_became_peered":"2024-09-12T16:58:29.782006+0000","last_unstale":"2024-09-12T17:40:04.245111+0000","last_undegraded":"2024-09-12T17:40:04.245111+0000","last_fullsized":"2024-09-12T17:40:04.245111+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:25.299681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":784,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":248,"num_read_kb":225,"num_write":333,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"265'366","reported_seq":973,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:33.892514+0000","last_change":"2024-09-12T16:58:21.702476+0000","last_active":"2024-09-12T17:40:33.892514+0000","last_peered":"2024-09-12T17:40:33.892514+0000","last_clean":"2024-09-12T17:40:33.892514+0000","last_became_active":"2024-09-12T16:58:21.700909+0000","last_became_peered":"2024-09-12T16:58:21.700909+0000","last_unstale":"2024-09-12T17:40:33.892514+0000","last_undegraded":"2024-09-12T17:40:33.892514+0000","last_fullsized":"2024-09-12T17:40:33.892514+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:45.552412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1540,"num_read_kb":1221,"num_write":577,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"265'295","reported_seq":927,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.355530+0000","last_change":"2024-09-12T16:58:18.708114+0000","last_active":"2024-09-12T17:41:32.355530+0000","last_peered":"2024-09-12T17:41:32.355530+0000","last_clean":"2024-09-12T17:41:32.355530+0000","last_became_active":"2024-09-12T16:58:18.706197+0000","last_became_peered":"2024-09-12T16:58:18.706197+0000","last_unstale":"2024-09-12T17:41:32.355530+0000","last_undegraded":"2024-09-12T17:41:32.355530+0000","last_fullsized":"2024-09-12T17:41:32.355530+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:37.230857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18939560,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":491,"num_read_kb":18954,"num_write":1076,"num_write_kb":43009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:27.338265+0000","last_change":"2024-09-12T16:58:23.712080+0000","last_active":"2024-09-12T17:38:27.338265+0000","last_peered":"2024-09-12T17:38:27.338265+0000","last_clean":"2024-09-12T17:38:27.338265+0000","last_became_active":"2024-09-12T16:58:23.711307+0000","last_became_peered":"2024-09-12T16:58:23.711307+0000","last_unstale":"2024-09-12T17:38:27.338265+0000","last_undegraded":"2024-09-12T17:38:27.338265+0000","last_fullsized":"2024-09-12T17:38:27.338265+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:54.962283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"265'264","reported_seq":823,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:24.812396+0000","last_change":"2024-09-12T16:58:25.737271+0000","last_active":"2024-09-12T17:41:24.812396+0000","last_peered":"2024-09-12T17:41:24.812396+0000","last_clean":"2024-09-12T17:41:24.812396+0000","last_became_active":"2024-09-12T16:58:25.736507+0000","last_became_peered":"2024-09-12T16:58:25.736507+0000","last_unstale":"2024-09-12T17:41:24.812396+0000","last_undegraded":"2024-09-12T17:41:24.812396+0000","last_fullsized":"2024-09-12T17:41:24.812396+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:21.434839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54941,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":437,"num_read_kb":921,"num_write":364,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:16.284549+0000","last_change":"2024-09-12T16:58:27.741029+0000","last_active":"2024-09-12T17:37:16.284549+0000","last_peered":"2024-09-12T17:37:16.284549+0000","last_clean":"2024-09-12T17:37:16.284549+0000","last_became_active":"2024-09-12T16:58:27.740278+0000","last_became_peered":"2024-09-12T16:58:27.740278+0000","last_unstale":"2024-09-12T17:37:16.284549+0000","last_undegraded":"2024-09-12T17:37:16.284549+0000","last_fullsized":"2024-09-12T17:37:16.284549+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:39.408264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"265'124","reported_seq":655,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:01.044134+0000","last_change":"2024-09-12T16:58:29.786287+0000","last_active":"2024-09-12T17:40:01.044134+0000","last_peered":"2024-09-12T17:40:01.044134+0000","last_clean":"2024-09-12T17:40:01.044134+0000","last_became_active":"2024-09-12T16:58:29.783969+0000","last_became_peered":"2024-09-12T16:58:29.783969+0000","last_unstale":"2024-09-12T17:40:01.044134+0000","last_undegraded":"2024-09-12T17:40:01.044134+0000","last_fullsized":"2024-09-12T17:40:01.044134+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:00.910931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":564,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":235,"num_read_kb":216,"num_write":292,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"265'255","reported_seq":876,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:12.339198+0000","last_change":"2024-09-12T16:58:21.716389+0000","last_active":"2024-09-12T17:37:12.339198+0000","last_peered":"2024-09-12T17:37:12.339198+0000","last_clean":"2024-09-12T17:37:12.339198+0000","last_became_active":"2024-09-12T16:58:21.715884+0000","last_became_peered":"2024-09-12T16:58:21.715884+0000","last_unstale":"2024-09-12T17:37:12.339198+0000","last_undegraded":"2024-09-12T17:37:12.339198+0000","last_fullsized":"2024-09-12T17:37:12.339198+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:57.326871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1137,"num_read_kb":949,"num_write":435,"num_write_kb":255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"265'253","reported_seq":853,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.374895+0000","last_change":"2024-09-12T16:58:18.705301+0000","last_active":"2024-09-12T17:41:32.374895+0000","last_peered":"2024-09-12T17:41:32.374895+0000","last_clean":"2024-09-12T17:41:32.374895+0000","last_became_active":"2024-09-12T16:58:18.704103+0000","last_became_peered":"2024-09-12T16:58:18.704103+0000","last_unstale":"2024-09-12T17:41:32.374895+0000","last_undegraded":"2024-09-12T17:41:32.374895+0000","last_fullsized":"2024-09-12T17:41:32.374895+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:50.142551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4230017,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":309,"num_read_kb":15361,"num_write":836,"num_write_kb":40766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:06.265887+0000","last_change":"2024-09-12T16:58:23.714514+0000","last_active":"2024-09-12T17:37:06.265887+0000","last_peered":"2024-09-12T17:37:06.265887+0000","last_clean":"2024-09-12T17:37:06.265887+0000","last_became_active":"2024-09-12T16:58:23.713731+0000","last_became_peered":"2024-09-12T16:58:23.713731+0000","last_unstale":"2024-09-12T17:37:06.265887+0000","last_undegraded":"2024-09-12T17:37:06.265887+0000","last_fullsized":"2024-09-12T17:37:06.265887+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:09.365842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"265'221","reported_seq":775,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:24.886087+0000","last_change":"2024-09-12T16:58:25.728704+0000","last_active":"2024-09-12T17:41:24.886087+0000","last_peered":"2024-09-12T17:41:24.886087+0000","last_clean":"2024-09-12T17:41:24.886087+0000","last_became_active":"2024-09-12T16:58:25.727897+0000","last_became_peered":"2024-09-12T16:58:25.727897+0000","last_unstale":"2024-09-12T17:41:24.886087+0000","last_undegraded":"2024-09-12T17:41:24.886087+0000","last_fullsized":"2024-09-12T17:41:24.886087+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:09.542441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55194,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":361,"num_read_kb":801,"num_write":296,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:31.285213+0000","last_change":"2024-09-12T16:58:27.736505+0000","last_active":"2024-09-12T17:38:31.285213+0000","last_peered":"2024-09-12T17:38:31.285213+0000","last_clean":"2024-09-12T17:38:31.285213+0000","last_became_active":"2024-09-12T16:58:27.735625+0000","last_became_peered":"2024-09-12T16:58:27.735625+0000","last_unstale":"2024-09-12T17:38:31.285213+0000","last_undegraded":"2024-09-12T17:38:31.285213+0000","last_fullsized":"2024-09-12T17:38:31.285213+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:53.678377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"265'170","reported_seq":1636,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:02.955759+0000","last_change":"2024-09-12T16:58:29.797070+0000","last_active":"2024-09-12T17:40:02.955759+0000","last_peered":"2024-09-12T17:40:02.955759+0000","last_clean":"2024-09-12T17:40:02.955759+0000","last_became_active":"2024-09-12T16:58:29.796358+0000","last_became_peered":"2024-09-12T16:58:29.796358+0000","last_unstale":"2024-09-12T17:40:02.955759+0000","last_undegraded":"2024-09-12T17:40:02.955759+0000","last_fullsized":"2024-09-12T17:40:02.955759+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:36.721617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1235,"num_read_kb":1225,"num_write":375,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"265'197","reported_seq":825,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:30.960561+0000","last_change":"2024-09-12T16:58:21.730823+0000","last_active":"2024-09-12T17:39:30.960561+0000","last_peered":"2024-09-12T17:39:30.960561+0000","last_clean":"2024-09-12T17:39:30.960561+0000","last_became_active":"2024-09-12T16:58:21.730029+0000","last_became_peered":"2024-09-12T16:58:21.730029+0000","last_unstale":"2024-09-12T17:39:30.960561+0000","last_undegraded":"2024-09-12T17:39:30.960561+0000","last_fullsized":"2024-09-12T17:39:30.960561+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:44.982580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":873,"num_read_kb":717,"num_write":316,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"265'298","reported_seq":940,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.380905+0000","last_change":"2024-09-12T16:58:18.712626+0000","last_active":"2024-09-12T17:41:32.380905+0000","last_peered":"2024-09-12T17:41:32.380905+0000","last_clean":"2024-09-12T17:41:32.380905+0000","last_became_active":"2024-09-12T16:58:18.712291+0000","last_became_peered":"2024-09-12T16:58:18.712291+0000","last_unstale":"2024-09-12T17:41:32.380905+0000","last_undegraded":"2024-09-12T17:41:32.380905+0000","last_fullsized":"2024-09-12T17:41:32.380905+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:27.324406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11949576,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":378,"num_read_kb":103450,"num_write":975,"num_write_kb":48235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:08.681452+0000","last_change":"2024-09-12T16:58:23.725501+0000","last_active":"2024-09-12T17:37:08.681452+0000","last_peered":"2024-09-12T17:37:08.681452+0000","last_clean":"2024-09-12T17:37:08.681452+0000","last_became_active":"2024-09-12T16:58:23.724981+0000","last_became_peered":"2024-09-12T16:58:23.724981+0000","last_unstale":"2024-09-12T17:37:08.681452+0000","last_undegraded":"2024-09-12T17:37:08.681452+0000","last_fullsized":"2024-09-12T17:37:08.681452+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:14.754031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"265'294","reported_seq":872,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:56.317877+0000","last_change":"2024-09-12T16:58:25.719753+0000","last_active":"2024-09-12T17:40:56.317877+0000","last_peered":"2024-09-12T17:40:56.317877+0000","last_clean":"2024-09-12T17:40:56.317877+0000","last_became_active":"2024-09-12T16:58:25.718962+0000","last_became_peered":"2024-09-12T16:58:25.718962+0000","last_unstale":"2024-09-12T17:40:56.317877+0000","last_undegraded":"2024-09-12T17:40:56.317877+0000","last_fullsized":"2024-09-12T17:40:56.317877+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:19.374426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":467,"num_read_kb":939,"num_write":378,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:27.352877+0000","last_change":"2024-09-12T16:58:27.749233+0000","last_active":"2024-09-12T17:38:27.352877+0000","last_peered":"2024-09-12T17:38:27.352877+0000","last_clean":"2024-09-12T17:38:27.352877+0000","last_became_active":"2024-09-12T16:58:27.748503+0000","last_became_peered":"2024-09-12T16:58:27.748503+0000","last_unstale":"2024-09-12T17:38:27.352877+0000","last_undegraded":"2024-09-12T17:38:27.352877+0000","last_fullsized":"2024-09-12T17:38:27.352877+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:00.394978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"265'150","reported_seq":645,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:23.734437+0000","last_change":"2024-09-12T16:58:29.781039+0000","last_active":"2024-09-12T17:41:23.734437+0000","last_peered":"2024-09-12T17:41:23.734437+0000","last_clean":"2024-09-12T17:41:23.734437+0000","last_became_active":"2024-09-12T16:58:29.780363+0000","last_became_peered":"2024-09-12T16:58:29.780363+0000","last_unstale":"2024-09-12T17:41:23.734437+0000","last_undegraded":"2024-09-12T17:41:23.734437+0000","last_fullsized":"2024-09-12T17:41:23.734437+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:21.350835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":838,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":195,"num_read_kb":185,"num_write":368,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"265'45","reported_seq":599,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:36.003227+0000","last_change":"2024-09-12T16:58:21.728691+0000","last_active":"2024-09-12T17:39:36.003227+0000","last_peered":"2024-09-12T17:39:36.003227+0000","last_clean":"2024-09-12T17:39:36.003227+0000","last_became_active":"2024-09-12T16:58:21.728147+0000","last_became_peered":"2024-09-12T16:58:21.728147+0000","last_unstale":"2024-09-12T17:39:36.003227+0000","last_undegraded":"2024-09-12T17:39:36.003227+0000","last_fullsized":"2024-09-12T17:39:36.003227+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:29.002979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":172,"num_write":56,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"265'302","reported_seq":947,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:51.330408+0000","last_change":"2024-09-12T16:58:18.702412+0000","last_active":"2024-09-12T17:39:51.330408+0000","last_peered":"2024-09-12T17:39:51.330408+0000","last_clean":"2024-09-12T17:39:51.330408+0000","last_became_active":"2024-09-12T16:58:18.692788+0000","last_became_peered":"2024-09-12T16:58:18.692788+0000","last_unstale":"2024-09-12T17:39:51.330408+0000","last_undegraded":"2024-09-12T17:39:51.330408+0000","last_fullsized":"2024-09-12T17:39:51.330408+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:00.730133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703008,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":512,"num_read_kb":2229,"num_write":1149,"num_write_kb":12634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"265'159","reported_seq":772,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:42.258550+0000","last_change":"2024-09-12T16:58:21.727362+0000","last_active":"2024-09-12T17:38:42.258550+0000","last_peered":"2024-09-12T17:38:42.258550+0000","last_clean":"2024-09-12T17:38:42.258550+0000","last_became_active":"2024-09-12T16:58:21.726882+0000","last_became_peered":"2024-09-12T16:58:21.726882+0000","last_unstale":"2024-09-12T17:38:42.258550+0000","last_undegraded":"2024-09-12T17:38:42.258550+0000","last_fullsized":"2024-09-12T17:38:42.258550+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:28.927326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":734,"num_read_kb":607,"num_write":248,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"265'425","reported_seq":1152,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:18.516669+0000","last_change":"2024-09-12T16:58:18.694523+0000","last_active":"2024-09-12T17:41:18.516669+0000","last_peered":"2024-09-12T17:41:18.516669+0000","last_clean":"2024-09-12T17:41:18.516669+0000","last_became_active":"2024-09-12T16:58:18.693764+0000","last_became_peered":"2024-09-12T16:58:18.693764+0000","last_unstale":"2024-09-12T17:41:18.516669+0000","last_undegraded":"2024-09-12T17:41:18.516669+0000","last_fullsized":"2024-09-12T17:41:18.516669+0000","mapping_epoch":23,"log_start":"265'400","ondisk_log_start":"265'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:36.280676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7160847,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":858,"num_read_kb":32173,"num_write":1365,"num_write_kb":32850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"265'188","reported_seq":822,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:28.760907+0000","last_change":"2024-09-12T16:58:21.718536+0000","last_active":"2024-09-12T17:38:28.760907+0000","last_peered":"2024-09-12T17:38:28.760907+0000","last_clean":"2024-09-12T17:38:28.760907+0000","last_became_active":"2024-09-12T16:58:21.716793+0000","last_became_peered":"2024-09-12T16:58:21.716793+0000","last_unstale":"2024-09-12T17:38:28.760907+0000","last_undegraded":"2024-09-12T17:38:28.760907+0000","last_fullsized":"2024-09-12T17:38:28.760907+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:03.494777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":842,"num_read_kb":696,"num_write":281,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"265'325","reported_seq":945,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.363961+0000","last_change":"2024-09-12T16:58:18.712375+0000","last_active":"2024-09-12T17:41:32.363961+0000","last_peered":"2024-09-12T17:41:32.363961+0000","last_clean":"2024-09-12T17:41:32.363961+0000","last_became_active":"2024-09-12T16:58:18.711667+0000","last_became_peered":"2024-09-12T16:58:18.711667+0000","last_unstale":"2024-09-12T17:41:32.363961+0000","last_undegraded":"2024-09-12T17:41:32.363961+0000","last_fullsized":"2024-09-12T17:41:32.363961+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:10:09.706153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1125887,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":416,"num_read_kb":3457,"num_write":1146,"num_write_kb":27732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"265'217","reported_seq":854,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:58.757688+0000","last_change":"2024-09-12T16:58:21.714181+0000","last_active":"2024-09-12T17:38:58.757688+0000","last_peered":"2024-09-12T17:38:58.757688+0000","last_clean":"2024-09-12T17:38:58.757688+0000","last_became_active":"2024-09-12T16:58:21.713518+0000","last_became_peered":"2024-09-12T16:58:21.713518+0000","last_unstale":"2024-09-12T17:38:58.757688+0000","last_undegraded":"2024-09-12T17:38:58.757688+0000","last_fullsized":"2024-09-12T17:38:58.757688+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:57.295971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":958,"num_read_kb":791,"num_write":328,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"265'289","reported_seq":1030,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.372948+0000","last_change":"2024-09-12T16:58:18.711348+0000","last_active":"2024-09-12T17:41:32.372948+0000","last_peered":"2024-09-12T17:41:32.372948+0000","last_clean":"2024-09-12T17:41:32.372948+0000","last_became_active":"2024-09-12T16:58:18.711021+0000","last_became_peered":"2024-09-12T16:58:18.711021+0000","last_unstale":"2024-09-12T17:41:32.372948+0000","last_undegraded":"2024-09-12T17:41:32.372948+0000","last_fullsized":"2024-09-12T17:41:32.372948+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:07.336724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3562701,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":755,"num_read_kb":13816,"num_write":1082,"num_write_kb":16955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"265'187","reported_seq":809,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:35.914369+0000","last_change":"2024-09-12T16:58:55.850452+0000","last_active":"2024-09-12T17:39:35.914369+0000","last_peered":"2024-09-12T17:39:35.914369+0000","last_clean":"2024-09-12T17:39:35.914369+0000","last_became_active":"2024-09-12T16:58:55.849635+0000","last_became_peered":"2024-09-12T16:58:55.849635+0000","last_unstale":"2024-09-12T17:39:35.914369+0000","last_undegraded":"2024-09-12T17:39:35.914369+0000","last_fullsized":"2024-09-12T17:39:35.914369+0000","mapping_epoch":37,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:15.847705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":876,"num_read_kb":735,"num_write":297,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"265'301","reported_seq":1137,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.325634+0000","last_change":"2024-09-12T16:58:18.678586+0000","last_active":"2024-09-12T17:41:32.325634+0000","last_peered":"2024-09-12T17:41:32.325634+0000","last_clean":"2024-09-12T17:41:32.325634+0000","last_became_active":"2024-09-12T16:58:18.677892+0000","last_became_peered":"2024-09-12T16:58:18.677892+0000","last_unstale":"2024-09-12T17:41:32.325634+0000","last_undegraded":"2024-09-12T17:41:32.325634+0000","last_fullsized":"2024-09-12T17:41:32.325634+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:25.218640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5111586,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":842,"num_read_kb":13074,"num_write":1123,"num_write_kb":22747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"265'420","reported_seq":1141,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:52.006442+0000","last_change":"2024-09-12T16:58:21.731074+0000","last_active":"2024-09-12T17:39:52.006442+0000","last_peered":"2024-09-12T17:39:52.006442+0000","last_clean":"2024-09-12T17:39:52.006442+0000","last_became_active":"2024-09-12T16:58:21.729867+0000","last_became_peered":"2024-09-12T16:58:21.729867+0000","last_unstale":"2024-09-12T17:39:52.006442+0000","last_undegraded":"2024-09-12T17:39:52.006442+0000","last_fullsized":"2024-09-12T17:39:52.006442+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:15.044983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1962,"num_read_kb":1662,"num_write":651,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"265'362","reported_seq":1043,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.344674+0000","last_change":"2024-09-12T16:58:18.707438+0000","last_active":"2024-09-12T17:41:33.344674+0000","last_peered":"2024-09-12T17:41:33.344674+0000","last_clean":"2024-09-12T17:41:33.344674+0000","last_became_active":"2024-09-12T16:58:18.707110+0000","last_became_peered":"2024-09-12T16:58:18.707110+0000","last_unstale":"2024-09-12T17:41:33.344674+0000","last_undegraded":"2024-09-12T17:41:33.344674+0000","last_fullsized":"2024-09-12T17:41:33.344674+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:40.132907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079974,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":702,"num_read_kb":1852,"num_write":1120,"num_write_kb":24861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"265'4296","reported_seq":4999,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:01.121603+0000","last_change":"2024-09-12T16:58:55.957719+0000","last_active":"2024-09-12T17:39:01.121603+0000","last_peered":"2024-09-12T17:39:01.121603+0000","last_clean":"2024-09-12T17:39:01.121603+0000","last_became_active":"2024-09-12T16:58:55.957007+0000","last_became_peered":"2024-09-12T16:58:55.957007+0000","last_unstale":"2024-09-12T17:39:01.121603+0000","last_undegraded":"2024-09-12T17:39:01.121603+0000","last_fullsized":"2024-09-12T17:39:01.121603+0000","mapping_epoch":37,"log_start":"265'4200","ondisk_log_start":"265'4200","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":3000,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:31.973980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17379,"num_read_kb":14566,"num_write":6493,"num_write_kb":3276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"265'257","reported_seq":961,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:57.708017+0000","last_change":"2024-09-12T16:58:18.715600+0000","last_active":"2024-09-12T17:38:57.708017+0000","last_peered":"2024-09-12T17:38:57.708017+0000","last_clean":"2024-09-12T17:38:57.708017+0000","last_became_active":"2024-09-12T16:58:18.715010+0000","last_became_peered":"2024-09-12T16:58:18.715010+0000","last_unstale":"2024-09-12T17:38:57.708017+0000","last_undegraded":"2024-09-12T17:38:57.708017+0000","last_fullsized":"2024-09-12T17:38:57.708017+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:49.947157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55071,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":559,"num_read_kb":2502,"num_write":895,"num_write_kb":15075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"265'104","reported_seq":685,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:45.793141+0000","last_change":"2024-09-12T16:58:21.721630+0000","last_active":"2024-09-12T17:39:45.793141+0000","last_peered":"2024-09-12T17:39:45.793141+0000","last_clean":"2024-09-12T17:39:45.793141+0000","last_became_active":"2024-09-12T16:58:21.720908+0000","last_became_peered":"2024-09-12T16:58:21.720908+0000","last_unstale":"2024-09-12T17:39:45.793141+0000","last_undegraded":"2024-09-12T17:39:45.793141+0000","last_fullsized":"2024-09-12T17:39:45.793141+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:48.720616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":432,"num_read_kb":360,"num_write":161,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"265'336","reported_seq":1057,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.372175+0000","last_change":"2024-09-12T16:58:18.680818+0000","last_active":"2024-09-12T17:41:32.372175+0000","last_peered":"2024-09-12T17:41:32.372175+0000","last_clean":"2024-09-12T17:41:32.372175+0000","last_became_active":"2024-09-12T16:58:18.680305+0000","last_became_peered":"2024-09-12T16:58:18.680305+0000","last_unstale":"2024-09-12T17:41:32.372175+0000","last_undegraded":"2024-09-12T17:41:32.372175+0000","last_fullsized":"2024-09-12T17:41:32.372175+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:01.306922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15589576,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":637,"num_read_kb":33513,"num_write":1325,"num_write_kb":33353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"265'175","reported_seq":792,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:04.973943+0000","last_change":"2024-09-12T16:58:21.714631+0000","last_active":"2024-09-12T17:40:04.973943+0000","last_peered":"2024-09-12T17:40:04.973943+0000","last_clean":"2024-09-12T17:40:04.973943+0000","last_became_active":"2024-09-12T16:58:21.713765+0000","last_became_peered":"2024-09-12T16:58:21.713765+0000","last_unstale":"2024-09-12T17:40:04.973943+0000","last_undegraded":"2024-09-12T17:40:04.973943+0000","last_fullsized":"2024-09-12T17:40:04.973943+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:08.424081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":769,"num_read_kb":637,"num_write":246,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"265'309","reported_seq":958,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.337225+0000","last_change":"2024-09-12T16:58:18.714233+0000","last_active":"2024-09-12T17:41:32.337225+0000","last_peered":"2024-09-12T17:41:32.337225+0000","last_clean":"2024-09-12T17:41:32.337225+0000","last_became_active":"2024-09-12T16:58:18.713629+0000","last_became_peered":"2024-09-12T16:58:18.713629+0000","last_unstale":"2024-09-12T17:41:32.337225+0000","last_undegraded":"2024-09-12T17:41:32.337225+0000","last_fullsized":"2024-09-12T17:41:32.337225+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:39.149486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10599923,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":474,"num_read_kb":40377,"num_write":1101,"num_write_kb":39449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"265'158","reported_seq":728,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:58.305709+0000","last_change":"2024-09-12T16:58:21.719777+0000","last_active":"2024-09-12T17:38:58.305709+0000","last_peered":"2024-09-12T17:38:58.305709+0000","last_clean":"2024-09-12T17:38:58.305709+0000","last_became_active":"2024-09-12T16:58:21.718980+0000","last_became_peered":"2024-09-12T16:58:21.718980+0000","last_unstale":"2024-09-12T17:38:58.305709+0000","last_undegraded":"2024-09-12T17:38:58.305709+0000","last_fullsized":"2024-09-12T17:38:58.305709+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:03.655078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":669,"num_read_kb":540,"num_write":242,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"265'324","reported_seq":1008,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.345579+0000","last_change":"2024-09-12T16:58:18.678862+0000","last_active":"2024-09-12T17:41:32.345579+0000","last_peered":"2024-09-12T17:41:32.345579+0000","last_clean":"2024-09-12T17:41:32.345579+0000","last_became_active":"2024-09-12T16:58:18.678270+0000","last_became_peered":"2024-09-12T16:58:18.678270+0000","last_unstale":"2024-09-12T17:41:32.345579+0000","last_undegraded":"2024-09-12T17:41:32.345579+0000","last_fullsized":"2024-09-12T17:41:32.345579+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:05.439824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12939821,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":507,"num_read_kb":53851,"num_write":1169,"num_write_kb":47481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"265'252","reported_seq":871,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:00.283451+0000","last_change":"2024-09-12T16:58:21.729663+0000","last_active":"2024-09-12T17:39:00.283451+0000","last_peered":"2024-09-12T17:39:00.283451+0000","last_clean":"2024-09-12T17:39:00.283451+0000","last_became_active":"2024-09-12T16:58:21.729301+0000","last_became_peered":"2024-09-12T16:58:21.729301+0000","last_unstale":"2024-09-12T17:39:00.283451+0000","last_undegraded":"2024-09-12T17:39:00.283451+0000","last_fullsized":"2024-09-12T17:39:00.283451+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:14.701978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1107,"num_read_kb":902,"num_write":427,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"265'385","reported_seq":1058,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.359275+0000","last_change":"2024-09-12T16:58:18.722981+0000","last_active":"2024-09-12T17:41:32.359275+0000","last_peered":"2024-09-12T17:41:32.359275+0000","last_clean":"2024-09-12T17:41:32.359275+0000","last_became_active":"2024-09-12T16:58:18.719658+0000","last_became_peered":"2024-09-12T16:58:18.719658+0000","last_unstale":"2024-09-12T17:41:32.359275+0000","last_undegraded":"2024-09-12T17:41:32.359275+0000","last_fullsized":"2024-09-12T17:41:32.359275+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:07.503530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1631301,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":649,"num_read_kb":15766,"num_write":1334,"num_write_kb":33267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"265'203","reported_seq":839,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:30.590488+0000","last_change":"2024-09-12T16:58:21.731445+0000","last_active":"2024-09-12T17:39:30.590488+0000","last_peered":"2024-09-12T17:39:30.590488+0000","last_clean":"2024-09-12T17:39:30.590488+0000","last_became_active":"2024-09-12T16:58:21.730589+0000","last_became_peered":"2024-09-12T16:58:21.730589+0000","last_unstale":"2024-09-12T17:39:30.590488+0000","last_undegraded":"2024-09-12T17:39:30.590488+0000","last_fullsized":"2024-09-12T17:39:30.590488+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:55.311260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":887,"num_read_kb":736,"num_write":325,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"265'313","reported_seq":980,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.390069+0000","last_change":"2024-09-12T16:58:18.692286+0000","last_active":"2024-09-12T17:41:32.390069+0000","last_peered":"2024-09-12T17:41:32.390069+0000","last_clean":"2024-09-12T17:41:32.390069+0000","last_became_active":"2024-09-12T16:58:18.691716+0000","last_became_peered":"2024-09-12T16:58:18.691716+0000","last_unstale":"2024-09-12T17:41:32.390069+0000","last_undegraded":"2024-09-12T17:41:32.390069+0000","last_fullsized":"2024-09-12T17:41:32.390069+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:52.982861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5619824,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":479,"num_read_kb":37415,"num_write":1072,"num_write_kb":27973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"265'333","reported_seq":938,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:46.416171+0000","last_change":"2024-09-12T16:58:21.723290+0000","last_active":"2024-09-12T17:39:46.416171+0000","last_peered":"2024-09-12T17:39:46.416171+0000","last_clean":"2024-09-12T17:39:46.416171+0000","last_became_active":"2024-09-12T16:58:21.722380+0000","last_became_peered":"2024-09-12T16:58:21.722380+0000","last_unstale":"2024-09-12T17:39:46.416171+0000","last_undegraded":"2024-09-12T17:39:46.416171+0000","last_fullsized":"2024-09-12T17:39:46.416171+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:20.022303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1422,"num_read_kb":1143,"num_write":550,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"265'281","reported_seq":947,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:51.702167+0000","last_change":"2024-09-12T16:58:18.709809+0000","last_active":"2024-09-12T17:39:51.702167+0000","last_peered":"2024-09-12T17:39:51.702167+0000","last_clean":"2024-09-12T17:39:51.702167+0000","last_became_active":"2024-09-12T16:58:18.709090+0000","last_became_peered":"2024-09-12T16:58:18.709090+0000","last_unstale":"2024-09-12T17:39:51.702167+0000","last_undegraded":"2024-09-12T17:39:51.702167+0000","last_fullsized":"2024-09-12T17:39:51.702167+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:53.570807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6609011,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":475,"num_read_kb":42081,"num_write":1072,"num_write_kb":38244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"265'160","reported_seq":768,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:35.762962+0000","last_change":"2024-09-12T16:58:21.725647+0000","last_active":"2024-09-12T17:39:35.762962+0000","last_peered":"2024-09-12T17:39:35.762962+0000","last_clean":"2024-09-12T17:39:35.762962+0000","last_became_active":"2024-09-12T16:58:21.725262+0000","last_became_peered":"2024-09-12T16:58:21.725262+0000","last_unstale":"2024-09-12T17:39:35.762962+0000","last_undegraded":"2024-09-12T17:39:35.762962+0000","last_fullsized":"2024-09-12T17:39:35.762962+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:15.275246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":648,"num_read_kb":538,"num_write":222,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"265'296","reported_seq":965,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:17.041773+0000","last_change":"2024-09-12T16:58:18.713718+0000","last_active":"2024-09-12T17:41:17.041773+0000","last_peered":"2024-09-12T17:41:17.041773+0000","last_clean":"2024-09-12T17:41:17.041773+0000","last_became_active":"2024-09-12T16:58:18.713131+0000","last_became_peered":"2024-09-12T16:58:18.713131+0000","last_unstale":"2024-09-12T17:41:17.041773+0000","last_undegraded":"2024-09-12T17:41:17.041773+0000","last_fullsized":"2024-09-12T17:41:17.041773+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:06.542758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2374722,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":506,"num_read_kb":4620,"num_write":1061,"num_write_kb":30053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"265'101","reported_seq":696,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:49.682303+0000","last_change":"2024-09-12T16:58:21.695497+0000","last_active":"2024-09-12T17:39:49.682303+0000","last_peered":"2024-09-12T17:39:49.682303+0000","last_clean":"2024-09-12T17:39:49.682303+0000","last_became_active":"2024-09-12T16:58:21.693930+0000","last_became_peered":"2024-09-12T16:58:21.693930+0000","last_unstale":"2024-09-12T17:39:49.682303+0000","last_undegraded":"2024-09-12T17:39:49.682303+0000","last_fullsized":"2024-09-12T17:39:49.682303+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:50.200124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":454,"num_read_kb":382,"num_write":143,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"265'292","reported_seq":932,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:47.436633+0000","last_change":"2024-09-12T16:58:18.704503+0000","last_active":"2024-09-12T17:39:47.436633+0000","last_peered":"2024-09-12T17:39:47.436633+0000","last_clean":"2024-09-12T17:39:47.436633+0000","last_became_active":"2024-09-12T16:58:18.704118+0000","last_became_peered":"2024-09-12T16:58:18.704118+0000","last_unstale":"2024-09-12T17:39:47.436633+0000","last_undegraded":"2024-09-12T17:39:47.436633+0000","last_fullsized":"2024-09-12T17:39:47.436633+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:55.559259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2129208,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":488,"num_read_kb":7376,"num_write":1213,"num_write_kb":14643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"265'376","reported_seq":966,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:31.294301+0000","last_change":"2024-09-12T16:58:21.716931+0000","last_active":"2024-09-12T17:37:31.294301+0000","last_peered":"2024-09-12T17:37:31.294301+0000","last_clean":"2024-09-12T17:37:31.294301+0000","last_became_active":"2024-09-12T16:58:21.714554+0000","last_became_peered":"2024-09-12T16:58:21.714554+0000","last_unstale":"2024-09-12T17:37:31.294301+0000","last_undegraded":"2024-09-12T17:37:31.294301+0000","last_fullsized":"2024-09-12T17:37:31.294301+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:40.451432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1689,"num_read_kb":1453,"num_write":661,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"265'345","reported_seq":1053,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.342094+0000","last_change":"2024-09-12T16:58:18.722556+0000","last_active":"2024-09-12T17:41:32.342094+0000","last_peered":"2024-09-12T17:41:32.342094+0000","last_clean":"2024-09-12T17:41:32.342094+0000","last_became_active":"2024-09-12T16:58:18.719691+0000","last_became_peered":"2024-09-12T16:58:18.719691+0000","last_unstale":"2024-09-12T17:41:32.342094+0000","last_undegraded":"2024-09-12T17:41:32.342094+0000","last_fullsized":"2024-09-12T17:41:32.342094+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:16.205110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46377,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":719,"num_read_kb":7679,"num_write":1269,"num_write_kb":23567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"265'296","reported_seq":948,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.359591+0000","last_change":"2024-09-12T16:58:18.699166+0000","last_active":"2024-09-12T17:41:32.359591+0000","last_peered":"2024-09-12T17:41:32.359591+0000","last_clean":"2024-09-12T17:41:32.359591+0000","last_became_active":"2024-09-12T16:58:18.698393+0000","last_became_peered":"2024-09-12T16:58:18.698393+0000","last_unstale":"2024-09-12T17:41:32.359591+0000","last_undegraded":"2024-09-12T17:41:32.359591+0000","last_fullsized":"2024-09-12T17:41:32.359591+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:04.059507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8744826,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":480,"num_read_kb":34675,"num_write":1070,"num_write_kb":53307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"265'106","reported_seq":685,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:25.841940+0000","last_change":"2024-09-12T16:58:21.715263+0000","last_active":"2024-09-12T17:39:25.841940+0000","last_peered":"2024-09-12T17:39:25.841940+0000","last_clean":"2024-09-12T17:39:25.841940+0000","last_became_active":"2024-09-12T16:58:21.714240+0000","last_became_peered":"2024-09-12T16:58:21.714240+0000","last_unstale":"2024-09-12T17:39:25.841940+0000","last_undegraded":"2024-09-12T17:39:25.841940+0000","last_fullsized":"2024-09-12T17:39:25.841940+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:10.058451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":476,"num_read_kb":394,"num_write":172,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"265'361","reported_seq":1040,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.346881+0000","last_change":"2024-09-12T16:58:18.708462+0000","last_active":"2024-09-12T17:41:33.346881+0000","last_peered":"2024-09-12T17:41:33.346881+0000","last_clean":"2024-09-12T17:41:33.346881+0000","last_became_active":"2024-09-12T16:58:18.707649+0000","last_became_peered":"2024-09-12T16:58:18.707649+0000","last_unstale":"2024-09-12T17:41:33.346881+0000","last_undegraded":"2024-09-12T17:41:33.346881+0000","last_fullsized":"2024-09-12T17:41:33.346881+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:46.590351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":580,"num_read_kb":14659,"num_write":1122,"num_write_kb":33951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"265'4159","reported_seq":4793,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:51.063189+0000","last_change":"2024-09-12T16:58:21.719410+0000","last_active":"2024-09-12T17:39:51.063189+0000","last_peered":"2024-09-12T17:39:51.063189+0000","last_clean":"2024-09-12T17:39:51.063189+0000","last_became_active":"2024-09-12T16:58:21.718537+0000","last_became_peered":"2024-09-12T16:58:21.718537+0000","last_unstale":"2024-09-12T17:39:51.063189+0000","last_undegraded":"2024-09-12T17:39:51.063189+0000","last_fullsized":"2024-09-12T17:39:51.063189+0000","mapping_epoch":26,"log_start":"265'4100","ondisk_log_start":"265'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":3000,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:03.741045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16773,"num_read_kb":14078,"num_write":6250,"num_write_kb":3119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6189,"num_read_kb":4469,"num_write":2002,"num_write_kb":899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":974,"ondisk_log_size":974,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15645,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":16183,"num_read_kb":15867,"num_write":16715,"num_write_kb":4878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1753,"ondisk_log_size":1753,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":481,"ondisk_log_size":481,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1868718,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":17032,"num_read_kb":33558,"num_write":14353,"num_write_kb":11510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2637824,"data_stored":2171293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1814,"ondisk_log_size":1814,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2406,"num_read_kb":2867,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":102570,"num_read_kb":85739,"num_write":37214,"num_write_kb":18735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4257,"ondisk_log_size":4257,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":427256830,"num_objects":3589,"num_object_clones":0,"num_object_copies":7178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3589,"num_whiteouts":0,"num_read":33064,"num_read_kb":1886507,"num_write":69384,"num_write_kb":2069560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":881819648,"data_stored":855189081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4325,"ondisk_log_size":4325,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":71400006,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":148,"num_read_kb":211125,"num_write":163,"num_write_kb":136313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1087,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":152240128,"data_stored":152237196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":103,"ondisk_log_size":103,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":59768832,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":153,"num_read_kb":198791,"num_write":171,"num_write_kb":136313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":120684544,"data_stored":120683078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509967,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310272,"kb_used_data":202800,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94061568,"statfs":{"total":96636764160,"available":96319045632,"internally_reserved":0,"allocated":207667200,"data_stored":201034528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509966,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":441040,"kb_used_data":197440,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":93930800,"statfs":{"total":96636764160,"available":96185139200,"internally_reserved":0,"allocated":202178560,"data_stored":195485373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":249428423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509971,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110536,"kb_used_data":11328,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94261304,"statfs":{"total":96636764160,"available":96523575296,"internally_reserved":0,"allocated":11599872,"data_stored":9988574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509966,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":442396,"kb_used_data":216860,"kb_used_omap":1,"kb_used_meta":225470,"kb_avail":93929444,"statfs":{"total":96636764160,"available":96183750656,"internally_reserved":0,"allocated":222064640,"data_stored":216353656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":230881733},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542671,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":404528,"kb_used_data":170656,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":93967312,"statfs":{"total":96636764160,"available":96222527488,"internally_reserved":0,"allocated":174751744,"data_stored":168481208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":239466955},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542672,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":333836,"kb_used_data":126332,"kb_used_omap":1,"kb_used_meta":207486,"kb_avail":94038004,"statfs":{"total":96636764160,"available":96294916096,"internally_reserved":0,"allocated":129363968,"data_stored":124846922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":212466118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542670,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":294048,"kb_used_data":208784,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94077792,"statfs":{"total":96636764160,"available":96335659008,"internally_reserved":0,"allocated":213794816,"data_stored":207648782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575374,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":161452,"kb_used_data":103900,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94210388,"statfs":{"total":96636764160,"available":96471437312,"internally_reserved":0,"allocated":106393600,"data_stored":102235490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":158121984,"data_stored":154525876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7954432,"data_stored":7838758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":63787008,"data_stored":61116399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":123113472,"data_stored":119112704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":163921920,"data_stored":159269009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":140980224,"data_stored":137075047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":86540288,"data_stored":83529300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":137400320,"data_stored":132721988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":307200,"data_stored":253243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":123306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":512000,"data_stored":426985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":91316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":585728,"data_stored":488018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":319488,"data_stored":274248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":618496,"data_stored":513159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":5371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":5873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":22020096,"data_stored":22020096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13631488,"data_stored":13631488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12681216,"data_stored":12679750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13631488,"data_stored":13631488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":15777792,"data_stored":15777062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35749888,"data_stored":35748422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":22069248,"data_stored":22068512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":26214400,"data_stored":26214400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15728640,"data_stored":15728640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:41:34.652 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T17:41:34.984 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:41:34.984 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":265,"fsid":"78b0e714-9967-46cd-8c81-870ee811f04f","created":"2024-09-12T16:57:48.948012+0000","modified":"2024-09-12T17:27:18.371598+0000","last_up_change":"2024-09-12T16:58:01.479457+0000","last_in_change":"2024-09-12T16:57:51.235408+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":15,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T16:58:02.117200+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T16:58:07.238522+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-12T16:58:18.029247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-12T16:58:20.017101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-12T16:58:21.811694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-12T16:58:23.828858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-12T16:58:25.744433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-12T16:58:27.888332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-09-12T17:13:53.476213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"254","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-09-12T17:15:38.895949+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"257","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-09-12T17:15:41.286665+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"260","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-09-12T17:27:15.615891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"265","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"97f57c05-370a-4b28-82e4-d5b5f51b1f8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":2391470178},{"type":"v1","addr":"172.21.15.16:6809","nonce":2391470178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":2391470178},{"type":"v1","addr":"172.21.15.16:6811","nonce":2391470178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2391470178},{"type":"v1","addr":"172.21.15.16:6815","nonce":2391470178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2391470178},{"type":"v1","addr":"172.21.15.16:6813","nonce":2391470178}]},"public_addr":"172.21.15.16:6809/2391470178","cluster_addr":"172.21.15.16:6811/2391470178","heartbeat_back_addr":"172.21.15.16:6815/2391470178","heartbeat_front_addr":"172.21.15.16:6813/2391470178","state":["exists","up"]},{"osd":1,"uuid":"75d950b7-2dcc-4439-bdc2-30acbd68aa41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1659555054},{"type":"v1","addr":"172.21.15.16:6817","nonce":1659555054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1659555054},{"type":"v1","addr":"172.21.15.16:6819","nonce":1659555054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":1659555054},{"type":"v1","addr":"172.21.15.16:6823","nonce":1659555054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1659555054},{"type":"v1","addr":"172.21.15.16:6821","nonce":1659555054}]},"public_addr":"172.21.15.16:6817/1659555054","cluster_addr":"172.21.15.16:6819/1659555054","heartbeat_back_addr":"172.21.15.16:6823/1659555054","heartbeat_front_addr":"172.21.15.16:6821/1659555054","state":["exists","up"]},{"osd":2,"uuid":"c64ae3d0-e4d6-4dcf-a8d1-3b084d198fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1359899637},{"type":"v1","addr":"172.21.15.16:6801","nonce":1359899637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1359899637},{"type":"v1","addr":"172.21.15.16:6803","nonce":1359899637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1359899637},{"type":"v1","addr":"172.21.15.16:6807","nonce":1359899637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1359899637},{"type":"v1","addr":"172.21.15.16:6805","nonce":1359899637}]},"public_addr":"172.21.15.16:6801/1359899637","cluster_addr":"172.21.15.16:6803/1359899637","heartbeat_back_addr":"172.21.15.16:6807/1359899637","heartbeat_front_addr":"172.21.15.16:6805/1359899637","state":["exists","up"]},{"osd":3,"uuid":"7a4fac7c-fa31-42e4-9ce0-6a1c9443124d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":465585330},{"type":"v1","addr":"172.21.15.16:6825","nonce":465585330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":465585330},{"type":"v1","addr":"172.21.15.16:6827","nonce":465585330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":465585330},{"type":"v1","addr":"172.21.15.16:6831","nonce":465585330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":465585330},{"type":"v1","addr":"172.21.15.16:6829","nonce":465585330}]},"public_addr":"172.21.15.16:6825/465585330","cluster_addr":"172.21.15.16:6827/465585330","heartbeat_back_addr":"172.21.15.16:6831/465585330","heartbeat_front_addr":"172.21.15.16:6829/465585330","state":["exists","up"]},{"osd":4,"uuid":"af3099b9-372c-449b-a86c-5556cac63c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":1509147557},{"type":"v1","addr":"172.21.15.19:6801","nonce":1509147557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6803","nonce":1509147557},{"type":"v1","addr":"172.21.15.19:6805","nonce":1509147557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6811","nonce":1509147557},{"type":"v1","addr":"172.21.15.19:6813","nonce":1509147557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6807","nonce":1509147557},{"type":"v1","addr":"172.21.15.19:6809","nonce":1509147557}]},"public_addr":"172.21.15.19:6801/1509147557","cluster_addr":"172.21.15.19:6805/1509147557","heartbeat_back_addr":"172.21.15.19:6813/1509147557","heartbeat_front_addr":"172.21.15.19:6809/1509147557","state":["exists","up"]},{"osd":5,"uuid":"425fa554-75e8-45ef-8444-072280e8d8b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2441769319},{"type":"v1","addr":"172.21.15.19:6825","nonce":2441769319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":2441769319},{"type":"v1","addr":"172.21.15.19:6827","nonce":2441769319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":2441769319},{"type":"v1","addr":"172.21.15.19:6831","nonce":2441769319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":2441769319},{"type":"v1","addr":"172.21.15.19:6829","nonce":2441769319}]},"public_addr":"172.21.15.19:6825/2441769319","cluster_addr":"172.21.15.19:6827/2441769319","heartbeat_back_addr":"172.21.15.19:6831/2441769319","heartbeat_front_addr":"172.21.15.19:6829/2441769319","state":["exists","up"]},{"osd":6,"uuid":"9530f71e-3731-43dd-89b2-a58b0a05cd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":36415917},{"type":"v1","addr":"172.21.15.19:6804","nonce":36415917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":36415917},{"type":"v1","addr":"172.21.15.19:6808","nonce":36415917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":36415917},{"type":"v1","addr":"172.21.15.19:6815","nonce":36415917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":36415917},{"type":"v1","addr":"172.21.15.19:6812","nonce":36415917}]},"public_addr":"172.21.15.19:6804/36415917","cluster_addr":"172.21.15.19:6808/36415917","heartbeat_back_addr":"172.21.15.19:6815/36415917","heartbeat_front_addr":"172.21.15.19:6812/36415917","state":["exists","up"]},{"osd":7,"uuid":"23c92063-e73a-476a-b073-c7a8ee7b9906","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2884335714},{"type":"v1","addr":"172.21.15.19:6817","nonce":2884335714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":2884335714},{"type":"v1","addr":"172.21.15.19:6819","nonce":2884335714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":2884335714},{"type":"v1","addr":"172.21.15.19:6823","nonce":2884335714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":2884335714},{"type":"v1","addr":"172.21.15.19:6821","nonce":2884335714}]},"public_addr":"172.21.15.19:6817/2884335714","cluster_addr":"172.21.15.19:6819/2884335714","heartbeat_back_addr":"172.21.15.19:6823/2884335714","heartbeat_front_addr":"172.21.15.19:6821/2884335714","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:57:58.256342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:57:58.207411+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:57:57.674118+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:57:58.125116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:57:57.765410+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:57:58.259970+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:57:57.878594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T16:57:58.044022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"4.21","mappings":[{"from":1,"to":5}]},{"pgid":"4.23","mappings":[{"from":3,"to":2}]},{"pgid":"67.18","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:41:36.004 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T17:41:36.004 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T17:41:36.161 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-09-12T17:41:36.170 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-12T17:41:36.170 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T17:41:36.170 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-12T17:41:36.187 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T17:41:36.501 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T17:41:36.521 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T17:41:36.524 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T17:41:36.672 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-12T17:41:36.672 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T17:41:36.672 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-12T17:41:36.689 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T17:41:36.993 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T17:41:37.012 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T17:41:37.012 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T17:41:37.156 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-12T17:41:37.156 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T17:41:37.156 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-12T17:41:37.172 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T17:41:37.463 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T17:41:37.482 INFO:tasks.ceph:Scrubbing osd.3 2024-09-12T17:41:37.482 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-12T17:41:37.624 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-12T17:41:37.624 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T17:41:37.624 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-12T17:41:37.639 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-12T17:41:37.936 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 3 to deep-scrub 2024-09-12T17:41:37.957 INFO:tasks.ceph:Scrubbing osd.4 2024-09-12T17:41:37.957 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-12T17:41:38.112 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-12T17:41:38.112 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T17:41:38.112 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-12T17:41:38.128 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-12T17:41:38.436 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 4 to deep-scrub 2024-09-12T17:41:38.457 INFO:tasks.ceph:Scrubbing osd.5 2024-09-12T17:41:38.457 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-12T17:41:38.614 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-12T17:41:38.615 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T17:41:38.615 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-12T17:41:38.632 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-12T17:41:38.949 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 5 to deep-scrub 2024-09-12T17:41:38.973 INFO:tasks.ceph:Scrubbing osd.6 2024-09-12T17:41:38.973 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-12T17:41:39.128 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-12T17:41:39.129 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T17:41:39.129 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-12T17:41:39.144 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-12T17:41:39.441 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 6 to deep-scrub 2024-09-12T17:41:39.460 INFO:tasks.ceph:Scrubbing osd.7 2024-09-12T17:41:39.460 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-12T17:41:39.603 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-12T17:41:39.603 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T17:41:39.604 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-12T17:41:39.619 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-12T17:41:39.924 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 7 to deep-scrub 2024-09-12T17:41:39.944 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:41:40.298 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:41:40.311 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-09-12T17:41:40.313 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":1567,"stamp":"2024-09-12T17:41:39.795697+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":77092809,"num_objects":701,"num_object_clones":0,"num_object_copies":1402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":701,"num_whiteouts":0,"num_read":181455,"num_read_kb":2442205,"num_write":143598,"num_write_kb":2379913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1087,"num_keys_recovered":0,"num_objects_omap":62,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13261,"ondisk_log_size":13261,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1481192,"kb_used_data":177280,"kb_used_omap":12,"kb_used_meta":1302771,"kb_avail":753493528,"statfs":{"total":773094113280,"available":771577372672,"internally_reserved":0,"allocated":181534720,"data_stored":168164780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1334038065},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-574233464,"num_objects":-4146,"num_object_clones":0,"num_object_copies":-8292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4146,"num_whiteouts":0,"num_read":4634,"num_read_kb":4139,"num_write":4396,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.026446"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:17.322563+0000","last_change":"2024-09-12T17:27:17.404693+0000","last_active":"2024-09-12T17:37:17.322563+0000","last_peered":"2024-09-12T17:37:17.322563+0000","last_clean":"2024-09-12T17:37:17.322563+0000","last_became_active":"2024-09-12T17:27:17.403833+0000","last_became_peered":"2024-09-12T17:27:17.403833+0000","last_unstale":"2024-09-12T17:37:17.322563+0000","last_undegraded":"2024-09-12T17:37:17.322563+0000","last_fullsized":"2024-09-12T17:37:17.322563+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:43.551735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"265'5","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:42.368823+0000","last_change":"2024-09-12T17:15:43.159517+0000","last_active":"2024-09-12T17:40:42.368823+0000","last_peered":"2024-09-12T17:40:42.368823+0000","last_clean":"2024-09-12T17:40:42.368823+0000","last_became_active":"2024-09-12T17:15:43.158714+0000","last_became_peered":"2024-09-12T17:15:43.158714+0000","last_unstale":"2024-09-12T17:40:42.368823+0000","last_undegraded":"2024-09-12T17:40:42.368823+0000","last_fullsized":"2024-09-12T17:40:42.368823+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:19.068813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"262'2","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:12.353310+0000","last_change":"2024-09-12T17:15:40.126960+0000","last_active":"2024-09-12T17:38:12.353310+0000","last_peered":"2024-09-12T17:38:12.353310+0000","last_clean":"2024-09-12T17:38:12.353310+0000","last_became_active":"2024-09-12T17:15:40.126170+0000","last_became_peered":"2024-09-12T17:15:40.126170+0000","last_unstale":"2024-09-12T17:38:12.353310+0000","last_undegraded":"2024-09-12T17:38:12.353310+0000","last_fullsized":"2024-09-12T17:38:12.353310+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:57.038622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"265'24","reported_seq":111,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:57.361076+0000","last_change":"2024-09-12T17:13:54.846274+0000","last_active":"2024-09-12T17:38:57.361076+0000","last_peered":"2024-09-12T17:38:57.361076+0000","last_clean":"2024-09-12T17:38:57.361076+0000","last_became_active":"2024-09-12T17:13:54.845556+0000","last_became_peered":"2024-09-12T17:13:54.845556+0000","last_unstale":"2024-09-12T17:38:57.361076+0000","last_undegraded":"2024-09-12T17:38:57.361076+0000","last_fullsized":"2024-09-12T17:38:57.361076+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:34.627718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":82,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:20.262014+0000","last_change":"2024-09-12T17:27:17.422429+0000","last_active":"2024-09-12T17:37:20.262014+0000","last_peered":"2024-09-12T17:37:20.262014+0000","last_clean":"2024-09-12T17:37:20.262014+0000","last_became_active":"2024-09-12T17:27:17.421771+0000","last_became_peered":"2024-09-12T17:27:17.421771+0000","last_unstale":"2024-09-12T17:37:20.262014+0000","last_undegraded":"2024-09-12T17:37:20.262014+0000","last_fullsized":"2024-09-12T17:37:20.262014+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:44.139866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:16.281883+0000","last_change":"2024-09-12T17:15:43.160447+0000","last_active":"2024-09-12T17:38:16.281883+0000","last_peered":"2024-09-12T17:38:16.281883+0000","last_clean":"2024-09-12T17:38:16.281883+0000","last_became_active":"2024-09-12T17:15:43.159316+0000","last_became_peered":"2024-09-12T17:15:43.159316+0000","last_unstale":"2024-09-12T17:38:16.281883+0000","last_undegraded":"2024-09-12T17:38:16.281883+0000","last_fullsized":"2024-09-12T17:38:16.281883+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:44.109670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"265'7","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:43.729290+0000","last_change":"2024-09-12T17:15:40.126819+0000","last_active":"2024-09-12T17:40:43.729290+0000","last_peered":"2024-09-12T17:40:43.729290+0000","last_clean":"2024-09-12T17:40:43.729290+0000","last_became_active":"2024-09-12T17:15:40.126087+0000","last_became_peered":"2024-09-12T17:15:40.126087+0000","last_unstale":"2024-09-12T17:40:43.729290+0000","last_undegraded":"2024-09-12T17:40:43.729290+0000","last_fullsized":"2024-09-12T17:40:43.729290+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:09.968319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":1026,"num_write":12,"num_write_kb":5122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"265'36","reported_seq":144,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:19.460209+0000","last_change":"2024-09-12T17:13:54.838770+0000","last_active":"2024-09-12T17:38:19.460209+0000","last_peered":"2024-09-12T17:38:19.460209+0000","last_clean":"2024-09-12T17:38:19.460209+0000","last_became_active":"2024-09-12T17:13:54.837820+0000","last_became_peered":"2024-09-12T17:13:54.837820+0000","last_unstale":"2024-09-12T17:38:19.460209+0000","last_undegraded":"2024-09-12T17:38:19.460209+0000","last_fullsized":"2024-09-12T17:38:19.460209+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:56:27.573050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":180,"num_read_kb":123,"num_write":74,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:36:56.280248+0000","last_change":"2024-09-12T17:27:17.406442+0000","last_active":"2024-09-12T17:36:56.280248+0000","last_peered":"2024-09-12T17:36:56.280248+0000","last_clean":"2024-09-12T17:36:56.280248+0000","last_became_active":"2024-09-12T17:27:17.405657+0000","last_became_peered":"2024-09-12T17:27:17.405657+0000","last_unstale":"2024-09-12T17:36:56.280248+0000","last_undegraded":"2024-09-12T17:36:56.280248+0000","last_fullsized":"2024-09-12T17:36:56.280248+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:12.985689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:37.355505+0000","last_change":"2024-09-12T17:15:43.869720+0000","last_active":"2024-09-12T17:38:37.355505+0000","last_peered":"2024-09-12T17:38:37.355505+0000","last_clean":"2024-09-12T17:38:37.355505+0000","last_became_active":"2024-09-12T17:15:43.868960+0000","last_became_peered":"2024-09-12T17:15:43.868960+0000","last_unstale":"2024-09-12T17:38:37.355505+0000","last_undegraded":"2024-09-12T17:38:37.355505+0000","last_fullsized":"2024-09-12T17:38:37.355505+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:01.285114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"262'2","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:45.267370+0000","last_change":"2024-09-12T17:15:40.135488+0000","last_active":"2024-09-12T17:37:45.267370+0000","last_peered":"2024-09-12T17:37:45.267370+0000","last_clean":"2024-09-12T17:37:45.267370+0000","last_became_active":"2024-09-12T17:15:40.134513+0000","last_became_peered":"2024-09-12T17:15:40.134513+0000","last_unstale":"2024-09-12T17:37:45.267370+0000","last_undegraded":"2024-09-12T17:37:45.267370+0000","last_fullsized":"2024-09-12T17:37:45.267370+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:39.657856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"265'19","reported_seq":94,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:57.360940+0000","last_change":"2024-09-12T17:13:54.827570+0000","last_active":"2024-09-12T17:38:57.360940+0000","last_peered":"2024-09-12T17:38:57.360940+0000","last_clean":"2024-09-12T17:38:57.360940+0000","last_became_active":"2024-09-12T17:13:54.826480+0000","last_became_peered":"2024-09-12T17:13:54.826480+0000","last_unstale":"2024-09-12T17:38:57.360940+0000","last_undegraded":"2024-09-12T17:38:57.360940+0000","last_fullsized":"2024-09-12T17:38:57.360940+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:09.477709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:02.336888+0000","last_change":"2024-09-12T17:27:17.419282+0000","last_active":"2024-09-12T17:37:02.336888+0000","last_peered":"2024-09-12T17:37:02.336888+0000","last_clean":"2024-09-12T17:37:02.336888+0000","last_became_active":"2024-09-12T17:27:17.418519+0000","last_became_peered":"2024-09-12T17:27:17.418519+0000","last_unstale":"2024-09-12T17:37:02.336888+0000","last_undegraded":"2024-09-12T17:37:02.336888+0000","last_fullsized":"2024-09-12T17:37:02.336888+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:37.212267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"265'2","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:47.376802+0000","last_change":"2024-09-12T17:15:43.869355+0000","last_active":"2024-09-12T17:39:47.376802+0000","last_peered":"2024-09-12T17:39:47.376802+0000","last_clean":"2024-09-12T17:39:47.376802+0000","last_became_active":"2024-09-12T17:15:43.868600+0000","last_became_peered":"2024-09-12T17:15:43.868600+0000","last_unstale":"2024-09-12T17:39:47.376802+0000","last_undegraded":"2024-09-12T17:39:47.376802+0000","last_fullsized":"2024-09-12T17:39:47.376802+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:55.218786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"262'3","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:36.286516+0000","last_change":"2024-09-12T17:15:40.109807+0000","last_active":"2024-09-12T17:38:36.286516+0000","last_peered":"2024-09-12T17:38:36.286516+0000","last_clean":"2024-09-12T17:38:36.286516+0000","last_became_active":"2024-09-12T17:15:40.109161+0000","last_became_peered":"2024-09-12T17:15:40.109161+0000","last_unstale":"2024-09-12T17:38:36.286516+0000","last_undegraded":"2024-09-12T17:38:36.286516+0000","last_fullsized":"2024-09-12T17:38:36.286516+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:38.091651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"265'31","reported_seq":127,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:28.552554+0000","last_change":"2024-09-12T17:13:54.839575+0000","last_active":"2024-09-12T17:39:28.552554+0000","last_peered":"2024-09-12T17:39:28.552554+0000","last_clean":"2024-09-12T17:39:28.552554+0000","last_became_active":"2024-09-12T17:13:54.838968+0000","last_became_peered":"2024-09-12T17:13:54.838968+0000","last_unstale":"2024-09-12T17:39:28.552554+0000","last_undegraded":"2024-09-12T17:39:28.552554+0000","last_fullsized":"2024-09-12T17:39:28.552554+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:01.149483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":108,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:22.370396+0000","last_change":"2024-09-12T17:27:17.418362+0000","last_active":"2024-09-12T17:39:22.370396+0000","last_peered":"2024-09-12T17:39:22.370396+0000","last_clean":"2024-09-12T17:39:22.370396+0000","last_became_active":"2024-09-12T17:27:17.416509+0000","last_became_peered":"2024-09-12T17:27:17.416509+0000","last_unstale":"2024-09-12T17:39:22.370396+0000","last_undegraded":"2024-09-12T17:39:22.370396+0000","last_fullsized":"2024-09-12T17:39:22.370396+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:54.908041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"265'11","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:57.358703+0000","last_change":"2024-09-12T17:15:43.163407+0000","last_active":"2024-09-12T17:39:57.358703+0000","last_peered":"2024-09-12T17:39:57.358703+0000","last_clean":"2024-09-12T17:39:57.358703+0000","last_became_active":"2024-09-12T17:15:43.162643+0000","last_became_peered":"2024-09-12T17:15:43.162643+0000","last_unstale":"2024-09-12T17:39:57.358703+0000","last_undegraded":"2024-09-12T17:39:57.358703+0000","last_fullsized":"2024-09-12T17:39:57.358703+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:26.465579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":23650,"num_write":16,"num_write_kb":11312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"265'10","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.608802+0000","last_change":"2024-09-12T17:15:40.111961+0000","last_active":"2024-09-12T17:41:32.608802+0000","last_peered":"2024-09-12T17:41:32.608802+0000","last_clean":"2024-09-12T17:41:32.608802+0000","last_became_active":"2024-09-12T17:15:40.111105+0000","last_became_peered":"2024-09-12T17:15:40.111105+0000","last_unstale":"2024-09-12T17:41:32.608802+0000","last_undegraded":"2024-09-12T17:41:32.608802+0000","last_fullsized":"2024-09-12T17:41:32.608802+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:17.726065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":20,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"265'54","reported_seq":197,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:31.662260+0000","last_change":"2024-09-12T17:13:54.842088+0000","last_active":"2024-09-12T17:39:31.662260+0000","last_peered":"2024-09-12T17:39:31.662260+0000","last_clean":"2024-09-12T17:39:31.662260+0000","last_became_active":"2024-09-12T17:13:54.841072+0000","last_became_peered":"2024-09-12T17:13:54.841072+0000","last_unstale":"2024-09-12T17:39:31.662260+0000","last_undegraded":"2024-09-12T17:39:31.662260+0000","last_fullsized":"2024-09-12T17:39:31.662260+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:22:11.118120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":282,"num_read_kb":222,"num_write":88,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:43.689296+0000","last_change":"2024-09-12T17:27:17.410975+0000","last_active":"2024-09-12T17:37:43.689296+0000","last_peered":"2024-09-12T17:37:43.689296+0000","last_clean":"2024-09-12T17:37:43.689296+0000","last_became_active":"2024-09-12T17:27:17.392355+0000","last_became_peered":"2024-09-12T17:27:17.392355+0000","last_unstale":"2024-09-12T17:37:43.689296+0000","last_undegraded":"2024-09-12T17:37:43.689296+0000","last_fullsized":"2024-09-12T17:37:43.689296+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:41.915255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"265'4","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:56.319320+0000","last_change":"2024-09-12T17:15:57.748482+0000","last_active":"2024-09-12T17:39:56.319320+0000","last_peered":"2024-09-12T17:39:56.319320+0000","last_clean":"2024-09-12T17:39:56.319320+0000","last_became_active":"2024-09-12T17:15:57.742342+0000","last_became_peered":"2024-09-12T17:15:57.742342+0000","last_unstale":"2024-09-12T17:39:56.319320+0000","last_undegraded":"2024-09-12T17:39:56.319320+0000","last_fullsized":"2024-09-12T17:39:56.319320+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:00.488944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1087,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:36.272606+0000","last_change":"2024-09-12T17:15:40.120329+0000","last_active":"2024-09-12T17:37:36.272606+0000","last_peered":"2024-09-12T17:37:36.272606+0000","last_clean":"2024-09-12T17:37:36.272606+0000","last_became_active":"2024-09-12T17:15:40.119439+0000","last_became_peered":"2024-09-12T17:15:40.119439+0000","last_unstale":"2024-09-12T17:37:36.272606+0000","last_undegraded":"2024-09-12T17:37:36.272606+0000","last_fullsized":"2024-09-12T17:37:36.272606+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:50.536461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"265'35","reported_seq":142,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:56.306273+0000","last_change":"2024-09-12T17:13:54.842916+0000","last_active":"2024-09-12T17:38:56.306273+0000","last_peered":"2024-09-12T17:38:56.306273+0000","last_clean":"2024-09-12T17:38:56.306273+0000","last_became_active":"2024-09-12T17:13:54.842215+0000","last_became_peered":"2024-09-12T17:13:54.842215+0000","last_unstale":"2024-09-12T17:38:56.306273+0000","last_undegraded":"2024-09-12T17:38:56.306273+0000","last_fullsized":"2024-09-12T17:38:56.306273+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:02.592935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":135,"num_write":51,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"265'1","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:21.291709+0000","last_change":"2024-09-12T17:27:17.415995+0000","last_active":"2024-09-12T17:37:21.291709+0000","last_peered":"2024-09-12T17:37:21.291709+0000","last_clean":"2024-09-12T17:37:21.291709+0000","last_became_active":"2024-09-12T17:27:17.415277+0000","last_became_peered":"2024-09-12T17:27:17.415277+0000","last_unstale":"2024-09-12T17:37:21.291709+0000","last_undegraded":"2024-09-12T17:37:21.291709+0000","last_fullsized":"2024-09-12T17:37:21.291709+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:19.223166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"265'4","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:46.331410+0000","last_change":"2024-09-12T17:15:43.172814+0000","last_active":"2024-09-12T17:40:46.331410+0000","last_peered":"2024-09-12T17:40:46.331410+0000","last_clean":"2024-09-12T17:40:46.331410+0000","last_became_active":"2024-09-12T17:15:43.172142+0000","last_became_peered":"2024-09-12T17:15:43.172142+0000","last_unstale":"2024-09-12T17:40:46.331410+0000","last_undegraded":"2024-09-12T17:40:46.331410+0000","last_fullsized":"2024-09-12T17:40:46.331410+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:41.542977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"262'4","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:11.280709+0000","last_change":"2024-09-12T17:15:40.109940+0000","last_active":"2024-09-12T17:38:11.280709+0000","last_peered":"2024-09-12T17:38:11.280709+0000","last_clean":"2024-09-12T17:38:11.280709+0000","last_became_active":"2024-09-12T17:15:40.109076+0000","last_became_peered":"2024-09-12T17:15:40.109076+0000","last_unstale":"2024-09-12T17:38:11.280709+0000","last_undegraded":"2024-09-12T17:38:11.280709+0000","last_fullsized":"2024-09-12T17:38:11.280709+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:05.822624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"262'6","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:12.349294+0000","last_change":"2024-09-12T17:13:54.820144+0000","last_active":"2024-09-12T17:38:12.349294+0000","last_peered":"2024-09-12T17:38:12.349294+0000","last_clean":"2024-09-12T17:38:12.349294+0000","last_became_active":"2024-09-12T17:13:54.819399+0000","last_became_peered":"2024-09-12T17:13:54.819399+0000","last_unstale":"2024-09-12T17:38:12.349294+0000","last_undegraded":"2024-09-12T17:38:12.349294+0000","last_fullsized":"2024-09-12T17:38:12.349294+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:25.721158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:21.291799+0000","last_change":"2024-09-12T17:27:17.420256+0000","last_active":"2024-09-12T17:37:21.291799+0000","last_peered":"2024-09-12T17:37:21.291799+0000","last_clean":"2024-09-12T17:37:21.291799+0000","last_became_active":"2024-09-12T17:27:17.419839+0000","last_became_peered":"2024-09-12T17:27:17.419839+0000","last_unstale":"2024-09-12T17:37:21.291799+0000","last_undegraded":"2024-09-12T17:37:21.291799+0000","last_fullsized":"2024-09-12T17:37:21.291799+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:46.578295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"265'5","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:42.388952+0000","last_change":"2024-09-12T17:15:43.160492+0000","last_active":"2024-09-12T17:40:42.388952+0000","last_peered":"2024-09-12T17:40:42.388952+0000","last_clean":"2024-09-12T17:40:42.388952+0000","last_became_active":"2024-09-12T17:15:43.159663+0000","last_became_peered":"2024-09-12T17:15:43.159663+0000","last_unstale":"2024-09-12T17:40:42.388952+0000","last_undegraded":"2024-09-12T17:40:42.388952+0000","last_fullsized":"2024-09-12T17:40:42.388952+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:48.671220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":23,"num_write":10,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"265'2","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:42.384696+0000","last_change":"2024-09-12T17:15:40.131992+0000","last_active":"2024-09-12T17:40:42.384696+0000","last_peered":"2024-09-12T17:40:42.384696+0000","last_clean":"2024-09-12T17:40:42.384696+0000","last_became_active":"2024-09-12T17:15:40.131140+0000","last_became_peered":"2024-09-12T17:15:40.131140+0000","last_unstale":"2024-09-12T17:40:42.384696+0000","last_undegraded":"2024-09-12T17:40:42.384696+0000","last_fullsized":"2024-09-12T17:40:42.384696+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:26.319835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"265'19","reported_seq":94,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:08.694781+0000","last_change":"2024-09-12T17:13:54.832206+0000","last_active":"2024-09-12T17:38:08.694781+0000","last_peered":"2024-09-12T17:38:08.694781+0000","last_clean":"2024-09-12T17:38:08.694781+0000","last_became_active":"2024-09-12T17:13:54.831374+0000","last_became_peered":"2024-09-12T17:13:54.831374+0000","last_unstale":"2024-09-12T17:38:08.694781+0000","last_undegraded":"2024-09-12T17:38:08.694781+0000","last_fullsized":"2024-09-12T17:38:08.694781+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:25.250277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:58.706411+0000","last_change":"2024-09-12T17:27:17.416704+0000","last_active":"2024-09-12T17:38:58.706411+0000","last_peered":"2024-09-12T17:38:58.706411+0000","last_clean":"2024-09-12T17:38:58.706411+0000","last_became_active":"2024-09-12T17:27:17.415918+0000","last_became_peered":"2024-09-12T17:27:17.415918+0000","last_unstale":"2024-09-12T17:38:58.706411+0000","last_undegraded":"2024-09-12T17:38:58.706411+0000","last_fullsized":"2024-09-12T17:38:58.706411+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:40.069574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"265'4","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:52.377797+0000","last_change":"2024-09-12T17:15:43.872202+0000","last_active":"2024-09-12T17:39:52.377797+0000","last_peered":"2024-09-12T17:39:52.377797+0000","last_clean":"2024-09-12T17:39:52.377797+0000","last_became_active":"2024-09-12T17:15:43.871380+0000","last_became_peered":"2024-09-12T17:15:43.871380+0000","last_unstale":"2024-09-12T17:39:52.377797+0000","last_undegraded":"2024-09-12T17:39:52.377797+0000","last_fullsized":"2024-09-12T17:39:52.377797+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:54.178710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"265'4","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.733120+0000","last_change":"2024-09-12T17:15:40.117517+0000","last_active":"2024-09-12T17:41:32.733120+0000","last_peered":"2024-09-12T17:41:32.733120+0000","last_clean":"2024-09-12T17:41:32.733120+0000","last_became_active":"2024-09-12T17:15:40.116781+0000","last_became_peered":"2024-09-12T17:15:40.116781+0000","last_unstale":"2024-09-12T17:41:32.733120+0000","last_undegraded":"2024-09-12T17:41:32.733120+0000","last_fullsized":"2024-09-12T17:41:32.733120+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:04.218708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":7168,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"265'68","reported_seq":230,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:31.441127+0000","last_change":"2024-09-12T17:13:54.830908+0000","last_active":"2024-09-12T17:39:31.441127+0000","last_peered":"2024-09-12T17:39:31.441127+0000","last_clean":"2024-09-12T17:39:31.441127+0000","last_became_active":"2024-09-12T17:13:54.829335+0000","last_became_peered":"2024-09-12T17:13:54.829335+0000","last_unstale":"2024-09-12T17:39:31.441127+0000","last_undegraded":"2024-09-12T17:39:31.441127+0000","last_fullsized":"2024-09-12T17:39:31.441127+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:18:25.184524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":349,"num_read_kb":240,"num_write":120,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"265'1","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:00.283371+0000","last_change":"2024-09-12T17:27:17.410174+0000","last_active":"2024-09-12T17:39:00.283371+0000","last_peered":"2024-09-12T17:39:00.283371+0000","last_clean":"2024-09-12T17:39:00.283371+0000","last_became_active":"2024-09-12T17:27:17.409364+0000","last_became_peered":"2024-09-12T17:27:17.409364+0000","last_unstale":"2024-09-12T17:39:00.283371+0000","last_undegraded":"2024-09-12T17:39:00.283371+0000","last_fullsized":"2024-09-12T17:39:00.283371+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:34.250496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"265'2","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:27.397626+0000","last_change":"2024-09-12T17:15:43.875351+0000","last_active":"2024-09-12T17:41:27.397626+0000","last_peered":"2024-09-12T17:41:27.397626+0000","last_clean":"2024-09-12T17:41:27.397626+0000","last_became_active":"2024-09-12T17:15:43.874421+0000","last_became_peered":"2024-09-12T17:15:43.874421+0000","last_unstale":"2024-09-12T17:41:27.397626+0000","last_undegraded":"2024-09-12T17:41:27.397626+0000","last_fullsized":"2024-09-12T17:41:27.397626+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:12.382448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"265'4","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.400829+0000","last_change":"2024-09-12T17:15:40.127851+0000","last_active":"2024-09-12T17:41:32.400829+0000","last_peered":"2024-09-12T17:41:32.400829+0000","last_clean":"2024-09-12T17:41:32.400829+0000","last_became_active":"2024-09-12T17:15:40.126898+0000","last_became_peered":"2024-09-12T17:15:40.126898+0000","last_unstale":"2024-09-12T17:41:32.400829+0000","last_undegraded":"2024-09-12T17:41:32.400829+0000","last_fullsized":"2024-09-12T17:41:32.400829+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:27.692907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"265'19","reported_seq":92,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:07.352095+0000","last_change":"2024-09-12T17:13:54.833584+0000","last_active":"2024-09-12T17:38:07.352095+0000","last_peered":"2024-09-12T17:38:07.352095+0000","last_clean":"2024-09-12T17:38:07.352095+0000","last_became_active":"2024-09-12T17:13:54.832780+0000","last_became_peered":"2024-09-12T17:13:54.832780+0000","last_unstale":"2024-09-12T17:38:07.352095+0000","last_undegraded":"2024-09-12T17:38:07.352095+0000","last_fullsized":"2024-09-12T17:38:07.352095+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:33.420620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":55,"num_write":40,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:01.315516+0000","last_change":"2024-09-12T17:27:17.415211+0000","last_active":"2024-09-12T17:39:01.315516+0000","last_peered":"2024-09-12T17:39:01.315516+0000","last_clean":"2024-09-12T17:39:01.315516+0000","last_became_active":"2024-09-12T17:27:17.414739+0000","last_became_peered":"2024-09-12T17:27:17.414739+0000","last_unstale":"2024-09-12T17:39:01.315516+0000","last_undegraded":"2024-09-12T17:39:01.315516+0000","last_fullsized":"2024-09-12T17:39:01.315516+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:57.434689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"265'5","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:52.377909+0000","last_change":"2024-09-12T17:15:43.872275+0000","last_active":"2024-09-12T17:39:52.377909+0000","last_peered":"2024-09-12T17:39:52.377909+0000","last_clean":"2024-09-12T17:39:52.377909+0000","last_became_active":"2024-09-12T17:15:43.871502+0000","last_became_peered":"2024-09-12T17:15:43.871502+0000","last_unstale":"2024-09-12T17:39:52.377909+0000","last_undegraded":"2024-09-12T17:39:52.377909+0000","last_fullsized":"2024-09-12T17:39:52.377909+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:07.859526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"265'5","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.236206+0000","last_change":"2024-09-12T17:15:40.133504+0000","last_active":"2024-09-12T17:41:32.236206+0000","last_peered":"2024-09-12T17:41:32.236206+0000","last_clean":"2024-09-12T17:41:32.236206+0000","last_became_active":"2024-09-12T17:15:40.132311+0000","last_became_peered":"2024-09-12T17:15:40.132311+0000","last_unstale":"2024-09-12T17:41:32.236206+0000","last_undegraded":"2024-09-12T17:41:32.236206+0000","last_fullsized":"2024-09-12T17:41:32.236206+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:42.985929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"265'33","reported_seq":136,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:05.271852+0000","last_change":"2024-09-12T17:13:54.828548+0000","last_active":"2024-09-12T17:38:05.271852+0000","last_peered":"2024-09-12T17:38:05.271852+0000","last_clean":"2024-09-12T17:38:05.271852+0000","last_became_active":"2024-09-12T17:13:54.827785+0000","last_became_peered":"2024-09-12T17:13:54.827785+0000","last_unstale":"2024-09-12T17:38:05.271852+0000","last_undegraded":"2024-09-12T17:38:05.271852+0000","last_fullsized":"2024-09-12T17:38:05.271852+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:29.075567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":116,"num_write":64,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:57.345260+0000","last_change":"2024-09-12T17:27:17.391923+0000","last_active":"2024-09-12T17:38:57.345260+0000","last_peered":"2024-09-12T17:38:57.345260+0000","last_clean":"2024-09-12T17:38:57.345260+0000","last_became_active":"2024-09-12T17:27:17.391154+0000","last_became_peered":"2024-09-12T17:27:17.391154+0000","last_unstale":"2024-09-12T17:38:57.345260+0000","last_undegraded":"2024-09-12T17:38:57.345260+0000","last_fullsized":"2024-09-12T17:38:57.345260+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:12.682141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"265'13","reported_seq":60,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.774812+0000","last_change":"2024-09-12T17:15:43.171314+0000","last_active":"2024-09-12T17:41:32.774812+0000","last_peered":"2024-09-12T17:41:32.774812+0000","last_clean":"2024-09-12T17:41:32.774812+0000","last_became_active":"2024-09-12T17:15:43.169085+0000","last_became_peered":"2024-09-12T17:15:43.169085+0000","last_unstale":"2024-09-12T17:41:32.774812+0000","last_undegraded":"2024-09-12T17:41:32.774812+0000","last_fullsized":"2024-09-12T17:41:32.774812+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:01.989288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":43010,"num_write":18,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"265'2","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:52.374200+0000","last_change":"2024-09-12T17:15:40.139824+0000","last_active":"2024-09-12T17:39:52.374200+0000","last_peered":"2024-09-12T17:39:52.374200+0000","last_clean":"2024-09-12T17:39:52.374200+0000","last_became_active":"2024-09-12T17:15:40.139145+0000","last_became_peered":"2024-09-12T17:15:40.139145+0000","last_unstale":"2024-09-12T17:39:52.374200+0000","last_undegraded":"2024-09-12T17:39:52.374200+0000","last_fullsized":"2024-09-12T17:39:52.374200+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:52:16.027902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"265'28","reported_seq":124,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:38.948450+0000","last_change":"2024-09-12T17:13:54.843550+0000","last_active":"2024-09-12T17:38:38.948450+0000","last_peered":"2024-09-12T17:38:38.948450+0000","last_clean":"2024-09-12T17:38:38.948450+0000","last_became_active":"2024-09-12T17:13:54.842816+0000","last_became_peered":"2024-09-12T17:13:54.842816+0000","last_unstale":"2024-09-12T17:38:38.948450+0000","last_undegraded":"2024-09-12T17:38:38.948450+0000","last_fullsized":"2024-09-12T17:38:38.948450+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:02.403853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":108,"num_write":46,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:36:57.335925+0000","last_change":"2024-09-12T17:27:17.422713+0000","last_active":"2024-09-12T17:36:57.335925+0000","last_peered":"2024-09-12T17:36:57.335925+0000","last_clean":"2024-09-12T17:36:57.335925+0000","last_became_active":"2024-09-12T17:27:17.421939+0000","last_became_peered":"2024-09-12T17:27:17.421939+0000","last_unstale":"2024-09-12T17:36:57.335925+0000","last_undegraded":"2024-09-12T17:36:57.335925+0000","last_fullsized":"2024-09-12T17:36:57.335925+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:53.787184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"262'8","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:03.708024+0000","last_change":"2024-09-12T17:15:43.162064+0000","last_active":"2024-09-12T17:39:03.708024+0000","last_peered":"2024-09-12T17:39:03.708024+0000","last_clean":"2024-09-12T17:39:03.708024+0000","last_became_active":"2024-09-12T17:15:43.158530+0000","last_became_peered":"2024-09-12T17:15:43.158530+0000","last_unstale":"2024-09-12T17:39:03.708024+0000","last_undegraded":"2024-09-12T17:39:03.708024+0000","last_fullsized":"2024-09-12T17:39:03.708024+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:52.110653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10242,"num_write":8,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"265'5","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.607865+0000","last_change":"2024-09-12T17:15:40.131385+0000","last_active":"2024-09-12T17:41:32.607865+0000","last_peered":"2024-09-12T17:41:32.607865+0000","last_clean":"2024-09-12T17:41:32.607865+0000","last_became_active":"2024-09-12T17:15:40.130644+0000","last_became_peered":"2024-09-12T17:15:40.130644+0000","last_unstale":"2024-09-12T17:41:32.607865+0000","last_undegraded":"2024-09-12T17:41:32.607865+0000","last_fullsized":"2024-09-12T17:41:32.607865+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:14.166806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"265'14","reported_seq":88,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:16.290475+0000","last_change":"2024-09-12T17:13:54.843769+0000","last_active":"2024-09-12T17:37:16.290475+0000","last_peered":"2024-09-12T17:37:16.290475+0000","last_clean":"2024-09-12T17:37:16.290475+0000","last_became_active":"2024-09-12T17:13:54.843036+0000","last_became_peered":"2024-09-12T17:13:54.843036+0000","last_unstale":"2024-09-12T17:37:16.290475+0000","last_undegraded":"2024-09-12T17:37:16.290475+0000","last_fullsized":"2024-09-12T17:37:16.290475+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:08:22.840485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:36:57.331873+0000","last_change":"2024-09-12T17:27:17.426185+0000","last_active":"2024-09-12T17:36:57.331873+0000","last_peered":"2024-09-12T17:36:57.331873+0000","last_clean":"2024-09-12T17:36:57.331873+0000","last_became_active":"2024-09-12T17:27:17.421187+0000","last_became_peered":"2024-09-12T17:27:17.421187+0000","last_unstale":"2024-09-12T17:36:57.331873+0000","last_undegraded":"2024-09-12T17:36:57.331873+0000","last_fullsized":"2024-09-12T17:36:57.331873+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:54.922802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"265'7","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:18.734815+0000","last_change":"2024-09-12T17:15:43.156779+0000","last_active":"2024-09-12T17:41:18.734815+0000","last_peered":"2024-09-12T17:41:18.734815+0000","last_clean":"2024-09-12T17:41:18.734815+0000","last_became_active":"2024-09-12T17:15:43.155891+0000","last_became_peered":"2024-09-12T17:15:43.155891+0000","last_unstale":"2024-09-12T17:41:18.734815+0000","last_undegraded":"2024-09-12T17:41:18.734815+0000","last_fullsized":"2024-09-12T17:41:18.734815+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:51.266851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8194,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:02.365695+0000","last_change":"2024-09-12T17:15:40.129236+0000","last_active":"2024-09-12T17:39:02.365695+0000","last_peered":"2024-09-12T17:39:02.365695+0000","last_clean":"2024-09-12T17:39:02.365695+0000","last_became_active":"2024-09-12T17:15:40.128470+0000","last_became_peered":"2024-09-12T17:15:40.128470+0000","last_unstale":"2024-09-12T17:39:02.365695+0000","last_undegraded":"2024-09-12T17:39:02.365695+0000","last_fullsized":"2024-09-12T17:39:02.365695+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:17.232330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"265'46","reported_seq":175,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:59.769241+0000","last_change":"2024-09-12T17:13:54.822640+0000","last_active":"2024-09-12T17:38:59.769241+0000","last_peered":"2024-09-12T17:38:59.769241+0000","last_clean":"2024-09-12T17:38:59.769241+0000","last_became_active":"2024-09-12T17:13:54.821816+0000","last_became_peered":"2024-09-12T17:13:54.821816+0000","last_unstale":"2024-09-12T17:38:59.769241+0000","last_undegraded":"2024-09-12T17:38:59.769241+0000","last_fullsized":"2024-09-12T17:38:59.769241+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:01.101266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":166,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"264'1","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:02.362079+0000","last_change":"2024-09-12T17:27:17.423856+0000","last_active":"2024-09-12T17:39:02.362079+0000","last_peered":"2024-09-12T17:39:02.362079+0000","last_clean":"2024-09-12T17:39:02.362079+0000","last_became_active":"2024-09-12T17:27:17.422464+0000","last_became_peered":"2024-09-12T17:27:17.422464+0000","last_unstale":"2024-09-12T17:39:02.362079+0000","last_undegraded":"2024-09-12T17:39:02.362079+0000","last_fullsized":"2024-09-12T17:39:02.362079+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:44.192139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"265'8","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.819159+0000","last_change":"2024-09-12T17:15:43.172138+0000","last_active":"2024-09-12T17:41:32.819159+0000","last_peered":"2024-09-12T17:41:32.819159+0000","last_clean":"2024-09-12T17:41:32.819159+0000","last_became_active":"2024-09-12T17:15:43.171254+0000","last_became_peered":"2024-09-12T17:15:43.171254+0000","last_unstale":"2024-09-12T17:41:32.819159+0000","last_undegraded":"2024-09-12T17:41:32.819159+0000","last_fullsized":"2024-09-12T17:41:32.819159+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:22.106658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10240,"num_write":8,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"265'4","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:21.338666+0000","last_change":"2024-09-12T17:15:40.117718+0000","last_active":"2024-09-12T17:41:21.338666+0000","last_peered":"2024-09-12T17:41:21.338666+0000","last_clean":"2024-09-12T17:41:21.338666+0000","last_became_active":"2024-09-12T17:15:40.116989+0000","last_became_peered":"2024-09-12T17:15:40.116989+0000","last_unstale":"2024-09-12T17:41:21.338666+0000","last_undegraded":"2024-09-12T17:41:21.338666+0000","last_fullsized":"2024-09-12T17:41:21.338666+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:05.611483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4119,"num_write":4,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"265'42","reported_seq":160,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:16.268235+0000","last_change":"2024-09-12T17:13:54.812445+0000","last_active":"2024-09-12T17:37:16.268235+0000","last_peered":"2024-09-12T17:37:16.268235+0000","last_clean":"2024-09-12T17:37:16.268235+0000","last_became_active":"2024-09-12T17:13:54.811613+0000","last_became_peered":"2024-09-12T17:13:54.811613+0000","last_unstale":"2024-09-12T17:37:16.268235+0000","last_undegraded":"2024-09-12T17:37:16.268235+0000","last_fullsized":"2024-09-12T17:37:16.268235+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:57.189420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":153,"num_write":74,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"265'1","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:36:57.335846+0000","last_change":"2024-09-12T17:27:17.405875+0000","last_active":"2024-09-12T17:36:57.335846+0000","last_peered":"2024-09-12T17:36:57.335846+0000","last_clean":"2024-09-12T17:36:57.335846+0000","last_became_active":"2024-09-12T17:27:17.405051+0000","last_became_peered":"2024-09-12T17:27:17.405051+0000","last_unstale":"2024-09-12T17:36:57.335846+0000","last_undegraded":"2024-09-12T17:36:57.335846+0000","last_fullsized":"2024-09-12T17:36:57.335846+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:07.362927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"265'2","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:26.339686+0000","last_change":"2024-09-12T17:15:43.158356+0000","last_active":"2024-09-12T17:41:26.339686+0000","last_peered":"2024-09-12T17:41:26.339686+0000","last_clean":"2024-09-12T17:41:26.339686+0000","last_became_active":"2024-09-12T17:15:43.157624+0000","last_became_peered":"2024-09-12T17:15:43.157624+0000","last_unstale":"2024-09-12T17:41:26.339686+0000","last_undegraded":"2024-09-12T17:41:26.339686+0000","last_fullsized":"2024-09-12T17:41:26.339686+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:44.475418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:02.346406+0000","last_change":"2024-09-12T17:15:40.118796+0000","last_active":"2024-09-12T17:39:02.346406+0000","last_peered":"2024-09-12T17:39:02.346406+0000","last_clean":"2024-09-12T17:39:02.346406+0000","last_became_active":"2024-09-12T17:15:40.118074+0000","last_became_peered":"2024-09-12T17:15:40.118074+0000","last_unstale":"2024-09-12T17:39:02.346406+0000","last_undegraded":"2024-09-12T17:39:02.346406+0000","last_fullsized":"2024-09-12T17:39:02.346406+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:53:01.242885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"265'16","reported_seq":89,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:17.340332+0000","last_change":"2024-09-12T17:13:54.841589+0000","last_active":"2024-09-12T17:37:17.340332+0000","last_peered":"2024-09-12T17:37:17.340332+0000","last_clean":"2024-09-12T17:37:17.340332+0000","last_became_active":"2024-09-12T17:13:54.840781+0000","last_became_peered":"2024-09-12T17:13:54.840781+0000","last_unstale":"2024-09-12T17:37:17.340332+0000","last_undegraded":"2024-09-12T17:37:17.340332+0000","last_fullsized":"2024-09-12T17:37:17.340332+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:48.110422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":56,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:15.273963+0000","last_change":"2024-09-12T17:27:17.409764+0000","last_active":"2024-09-12T17:38:15.273963+0000","last_peered":"2024-09-12T17:38:15.273963+0000","last_clean":"2024-09-12T17:38:15.273963+0000","last_became_active":"2024-09-12T17:27:17.408953+0000","last_became_peered":"2024-09-12T17:27:17.408953+0000","last_unstale":"2024-09-12T17:38:15.273963+0000","last_undegraded":"2024-09-12T17:38:15.273963+0000","last_fullsized":"2024-09-12T17:38:15.273963+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:26.794007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:12.353382+0000","last_change":"2024-09-12T17:15:43.165887+0000","last_active":"2024-09-12T17:38:12.353382+0000","last_peered":"2024-09-12T17:38:12.353382+0000","last_clean":"2024-09-12T17:38:12.353382+0000","last_became_active":"2024-09-12T17:15:43.164943+0000","last_became_peered":"2024-09-12T17:15:43.164943+0000","last_unstale":"2024-09-12T17:38:12.353382+0000","last_undegraded":"2024-09-12T17:38:12.353382+0000","last_fullsized":"2024-09-12T17:38:12.353382+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:08.542268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"265'7","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:26.336598+0000","last_change":"2024-09-12T17:15:40.129503+0000","last_active":"2024-09-12T17:40:26.336598+0000","last_peered":"2024-09-12T17:40:26.336598+0000","last_clean":"2024-09-12T17:40:26.336598+0000","last_became_active":"2024-09-12T17:15:40.128681+0000","last_became_peered":"2024-09-12T17:15:40.128681+0000","last_unstale":"2024-09-12T17:40:26.336598+0000","last_undegraded":"2024-09-12T17:40:26.336598+0000","last_fullsized":"2024-09-12T17:40:26.336598+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:21.306746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16384,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"265'9","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:47.361596+0000","last_change":"2024-09-12T17:13:54.844500+0000","last_active":"2024-09-12T17:38:47.361596+0000","last_peered":"2024-09-12T17:38:47.361596+0000","last_clean":"2024-09-12T17:38:47.361596+0000","last_became_active":"2024-09-12T17:13:54.842287+0000","last_became_peered":"2024-09-12T17:13:54.842287+0000","last_unstale":"2024-09-12T17:38:47.361596+0000","last_undegraded":"2024-09-12T17:38:47.361596+0000","last_fullsized":"2024-09-12T17:38:47.361596+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:09.440211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":28,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:36.309617+0000","last_change":"2024-09-12T17:27:17.416766+0000","last_active":"2024-09-12T17:38:36.309617+0000","last_peered":"2024-09-12T17:38:36.309617+0000","last_clean":"2024-09-12T17:38:36.309617+0000","last_became_active":"2024-09-12T17:27:17.415241+0000","last_became_peered":"2024-09-12T17:27:17.415241+0000","last_unstale":"2024-09-12T17:38:36.309617+0000","last_undegraded":"2024-09-12T17:38:36.309617+0000","last_fullsized":"2024-09-12T17:38:36.309617+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:04.923059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"265'8","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:27.385923+0000","last_change":"2024-09-12T17:15:43.171921+0000","last_active":"2024-09-12T17:40:27.385923+0000","last_peered":"2024-09-12T17:40:27.385923+0000","last_clean":"2024-09-12T17:40:27.385923+0000","last_became_active":"2024-09-12T17:15:43.168676+0000","last_became_peered":"2024-09-12T17:15:43.168676+0000","last_unstale":"2024-09-12T17:40:27.385923+0000","last_undegraded":"2024-09-12T17:40:27.385923+0000","last_fullsized":"2024-09-12T17:40:27.385923+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:51.743678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":24578,"num_write":18,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"265'6","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:25.304614+0000","last_change":"2024-09-12T17:15:40.129433+0000","last_active":"2024-09-12T17:40:25.304614+0000","last_peered":"2024-09-12T17:40:25.304614+0000","last_clean":"2024-09-12T17:40:25.304614+0000","last_became_active":"2024-09-12T17:15:40.128708+0000","last_became_peered":"2024-09-12T17:15:40.128708+0000","last_unstale":"2024-09-12T17:40:25.304614+0000","last_undegraded":"2024-09-12T17:40:25.304614+0000","last_fullsized":"2024-09-12T17:40:25.304614+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:54.970720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8194,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"265'35","reported_seq":144,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:42.341793+0000","last_change":"2024-09-12T17:13:54.830851+0000","last_active":"2024-09-12T17:38:42.341793+0000","last_peered":"2024-09-12T17:38:42.341793+0000","last_clean":"2024-09-12T17:38:42.341793+0000","last_became_active":"2024-09-12T17:13:54.830096+0000","last_became_peered":"2024-09-12T17:13:54.830096+0000","last_unstale":"2024-09-12T17:38:42.341793+0000","last_undegraded":"2024-09-12T17:38:42.341793+0000","last_fullsized":"2024-09-12T17:38:42.341793+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:08.715298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":131,"num_write":60,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:06.295390+0000","last_change":"2024-09-12T17:27:17.412405+0000","last_active":"2024-09-12T17:38:06.295390+0000","last_peered":"2024-09-12T17:38:06.295390+0000","last_clean":"2024-09-12T17:38:06.295390+0000","last_became_active":"2024-09-12T17:27:17.411635+0000","last_became_peered":"2024-09-12T17:27:17.411635+0000","last_unstale":"2024-09-12T17:38:06.295390+0000","last_undegraded":"2024-09-12T17:38:06.295390+0000","last_fullsized":"2024-09-12T17:38:06.295390+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:12.596567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:13.696208+0000","last_change":"2024-09-12T17:15:43.870101+0000","last_active":"2024-09-12T17:38:13.696208+0000","last_peered":"2024-09-12T17:38:13.696208+0000","last_clean":"2024-09-12T17:38:13.696208+0000","last_became_active":"2024-09-12T17:15:43.869197+0000","last_became_peered":"2024-09-12T17:15:43.869197+0000","last_unstale":"2024-09-12T17:38:13.696208+0000","last_undegraded":"2024-09-12T17:38:13.696208+0000","last_fullsized":"2024-09-12T17:38:13.696208+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:50:50.852439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:12.349506+0000","last_change":"2024-09-12T17:15:40.115375+0000","last_active":"2024-09-12T17:38:12.349506+0000","last_peered":"2024-09-12T17:38:12.349506+0000","last_clean":"2024-09-12T17:38:12.349506+0000","last_became_active":"2024-09-12T17:15:40.114636+0000","last_became_peered":"2024-09-12T17:15:40.114636+0000","last_unstale":"2024-09-12T17:38:12.349506+0000","last_undegraded":"2024-09-12T17:38:12.349506+0000","last_fullsized":"2024-09-12T17:38:12.349506+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:25.820396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"265'11","reported_seq":77,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:41.303136+0000","last_change":"2024-09-12T17:13:54.837741+0000","last_active":"2024-09-12T17:38:41.303136+0000","last_peered":"2024-09-12T17:38:41.303136+0000","last_clean":"2024-09-12T17:38:41.303136+0000","last_became_active":"2024-09-12T17:13:54.836955+0000","last_became_peered":"2024-09-12T17:13:54.836955+0000","last_unstale":"2024-09-12T17:38:41.303136+0000","last_undegraded":"2024-09-12T17:38:41.303136+0000","last_fullsized":"2024-09-12T17:38:41.303136+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:27.239370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":38,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:11.303795+0000","last_change":"2024-09-12T17:27:17.409364+0000","last_active":"2024-09-12T17:38:11.303795+0000","last_peered":"2024-09-12T17:38:11.303795+0000","last_clean":"2024-09-12T17:38:11.303795+0000","last_became_active":"2024-09-12T17:27:17.408128+0000","last_became_peered":"2024-09-12T17:27:17.408128+0000","last_unstale":"2024-09-12T17:38:11.303795+0000","last_undegraded":"2024-09-12T17:38:11.303795+0000","last_fullsized":"2024-09-12T17:38:11.303795+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:44.771065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"265'4","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.648372+0000","last_change":"2024-09-12T17:15:43.171004+0000","last_active":"2024-09-12T17:41:32.648372+0000","last_peered":"2024-09-12T17:41:32.648372+0000","last_clean":"2024-09-12T17:41:32.648372+0000","last_became_active":"2024-09-12T17:15:43.169936+0000","last_became_peered":"2024-09-12T17:15:43.169936+0000","last_unstale":"2024-09-12T17:41:32.648372+0000","last_undegraded":"2024-09-12T17:41:32.648372+0000","last_fullsized":"2024-09-12T17:41:32.648372+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:21.292046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"265'9","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.083485+0000","last_change":"2024-09-12T17:15:40.122273+0000","last_active":"2024-09-12T17:41:32.083485+0000","last_peered":"2024-09-12T17:41:32.083485+0000","last_clean":"2024-09-12T17:41:32.083485+0000","last_became_active":"2024-09-12T17:15:40.121181+0000","last_became_peered":"2024-09-12T17:15:40.121181+0000","last_unstale":"2024-09-12T17:41:32.083485+0000","last_undegraded":"2024-09-12T17:41:32.083485+0000","last_fullsized":"2024-09-12T17:41:32.083485+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:36.422026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12338,"num_write":14,"num_write_kb":5168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"265'48","reported_seq":176,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:41.282547+0000","last_change":"2024-09-12T17:13:54.842918+0000","last_active":"2024-09-12T17:38:41.282547+0000","last_peered":"2024-09-12T17:38:41.282547+0000","last_clean":"2024-09-12T17:38:41.282547+0000","last_became_active":"2024-09-12T17:13:54.841923+0000","last_became_peered":"2024-09-12T17:13:54.841923+0000","last_unstale":"2024-09-12T17:38:41.282547+0000","last_undegraded":"2024-09-12T17:38:41.282547+0000","last_fullsized":"2024-09-12T17:38:41.282547+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:08.355932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":241,"num_read_kb":172,"num_write":100,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:32.357996+0000","last_change":"2024-09-12T17:27:17.419285+0000","last_active":"2024-09-12T17:38:32.357996+0000","last_peered":"2024-09-12T17:38:32.357996+0000","last_clean":"2024-09-12T17:38:32.357996+0000","last_became_active":"2024-09-12T17:27:17.417566+0000","last_became_peered":"2024-09-12T17:27:17.417566+0000","last_unstale":"2024-09-12T17:38:32.357996+0000","last_undegraded":"2024-09-12T17:38:32.357996+0000","last_fullsized":"2024-09-12T17:38:32.357996+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:32.507294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"262'4","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:26.270382+0000","last_change":"2024-09-12T17:15:43.162593+0000","last_active":"2024-09-12T17:37:26.270382+0000","last_peered":"2024-09-12T17:37:26.270382+0000","last_clean":"2024-09-12T17:37:26.270382+0000","last_became_active":"2024-09-12T17:15:43.161858+0000","last_became_peered":"2024-09-12T17:15:43.161858+0000","last_unstale":"2024-09-12T17:37:26.270382+0000","last_undegraded":"2024-09-12T17:37:26.270382+0000","last_fullsized":"2024-09-12T17:37:26.270382+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:23.655020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:22.337556+0000","last_change":"2024-09-12T17:15:40.113046+0000","last_active":"2024-09-12T17:37:22.337556+0000","last_peered":"2024-09-12T17:37:22.337556+0000","last_clean":"2024-09-12T17:37:22.337556+0000","last_became_active":"2024-09-12T17:15:40.112179+0000","last_became_peered":"2024-09-12T17:15:40.112179+0000","last_unstale":"2024-09-12T17:37:22.337556+0000","last_undegraded":"2024-09-12T17:37:22.337556+0000","last_fullsized":"2024-09-12T17:37:22.337556+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:35.125445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"265'67","reported_seq":229,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:42.356505+0000","last_change":"2024-09-12T17:13:54.828364+0000","last_active":"2024-09-12T17:38:42.356505+0000","last_peered":"2024-09-12T17:38:42.356505+0000","last_clean":"2024-09-12T17:38:42.356505+0000","last_became_active":"2024-09-12T17:13:54.827402+0000","last_became_peered":"2024-09-12T17:13:54.827402+0000","last_unstale":"2024-09-12T17:38:42.356505+0000","last_undegraded":"2024-09-12T17:38:42.356505+0000","last_fullsized":"2024-09-12T17:38:42.356505+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:52.664896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":342,"num_read_kb":248,"num_write":117,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:41.310813+0000","last_change":"2024-09-12T17:27:17.418505+0000","last_active":"2024-09-12T17:38:41.310813+0000","last_peered":"2024-09-12T17:38:41.310813+0000","last_clean":"2024-09-12T17:38:41.310813+0000","last_became_active":"2024-09-12T17:27:17.418022+0000","last_became_peered":"2024-09-12T17:27:17.418022+0000","last_unstale":"2024-09-12T17:38:41.310813+0000","last_undegraded":"2024-09-12T17:38:41.310813+0000","last_fullsized":"2024-09-12T17:38:41.310813+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:55.678220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"265'5","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:36.323757+0000","last_change":"2024-09-12T17:15:43.865245+0000","last_active":"2024-09-12T17:39:36.323757+0000","last_peered":"2024-09-12T17:39:36.323757+0000","last_clean":"2024-09-12T17:39:36.323757+0000","last_became_active":"2024-09-12T17:15:43.864657+0000","last_became_peered":"2024-09-12T17:15:43.864657+0000","last_unstale":"2024-09-12T17:39:36.323757+0000","last_undegraded":"2024-09-12T17:39:36.323757+0000","last_fullsized":"2024-09-12T17:39:36.323757+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:57.152668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"265'12","reported_seq":67,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:33.714998+0000","last_change":"2024-09-12T17:15:40.123025+0000","last_active":"2024-09-12T17:39:33.714998+0000","last_peered":"2024-09-12T17:39:33.714998+0000","last_clean":"2024-09-12T17:39:33.714998+0000","last_became_active":"2024-09-12T17:15:40.122001+0000","last_became_peered":"2024-09-12T17:15:40.122001+0000","last_unstale":"2024-09-12T17:39:33.714998+0000","last_undegraded":"2024-09-12T17:39:33.714998+0000","last_fullsized":"2024-09-12T17:39:33.714998+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:47.430779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12340,"num_write":12,"num_write_kb":6192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"265'23","reported_seq":105,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:51.298999+0000","last_change":"2024-09-12T17:13:54.831219+0000","last_active":"2024-09-12T17:37:51.298999+0000","last_peered":"2024-09-12T17:37:51.298999+0000","last_clean":"2024-09-12T17:37:51.298999+0000","last_became_active":"2024-09-12T17:13:54.825019+0000","last_became_peered":"2024-09-12T17:13:54.825019+0000","last_unstale":"2024-09-12T17:37:51.298999+0000","last_undegraded":"2024-09-12T17:37:51.298999+0000","last_fullsized":"2024-09-12T17:37:51.298999+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:13.461017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":38,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"265'1","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:36.309680+0000","last_change":"2024-09-12T17:27:17.408731+0000","last_active":"2024-09-12T17:38:36.309680+0000","last_peered":"2024-09-12T17:38:36.309680+0000","last_clean":"2024-09-12T17:38:36.309680+0000","last_became_active":"2024-09-12T17:27:17.408151+0000","last_became_peered":"2024-09-12T17:27:17.408151+0000","last_unstale":"2024-09-12T17:38:36.309680+0000","last_undegraded":"2024-09-12T17:38:36.309680+0000","last_fullsized":"2024-09-12T17:38:36.309680+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:04.214744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"265'7","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.648854+0000","last_change":"2024-09-12T17:15:43.167300+0000","last_active":"2024-09-12T17:41:32.648854+0000","last_peered":"2024-09-12T17:41:32.648854+0000","last_clean":"2024-09-12T17:41:32.648854+0000","last_became_active":"2024-09-12T17:15:43.166482+0000","last_became_peered":"2024-09-12T17:15:43.166482+0000","last_unstale":"2024-09-12T17:41:32.648854+0000","last_undegraded":"2024-09-12T17:41:32.648854+0000","last_fullsized":"2024-09-12T17:41:32.648854+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:11.626906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:27.338914+0000","last_change":"2024-09-12T17:15:40.138867+0000","last_active":"2024-09-12T17:37:27.338914+0000","last_peered":"2024-09-12T17:37:27.338914+0000","last_clean":"2024-09-12T17:37:27.338914+0000","last_became_active":"2024-09-12T17:15:40.138190+0000","last_became_peered":"2024-09-12T17:15:40.138190+0000","last_unstale":"2024-09-12T17:37:27.338914+0000","last_undegraded":"2024-09-12T17:37:27.338914+0000","last_fullsized":"2024-09-12T17:37:27.338914+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:31.598623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"265'18","reported_seq":93,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:47.347138+0000","last_change":"2024-09-12T17:13:54.833230+0000","last_active":"2024-09-12T17:37:47.347138+0000","last_peered":"2024-09-12T17:37:47.347138+0000","last_clean":"2024-09-12T17:37:47.347138+0000","last_became_active":"2024-09-12T17:13:54.832453+0000","last_became_peered":"2024-09-12T17:13:54.832453+0000","last_unstale":"2024-09-12T17:37:47.347138+0000","last_undegraded":"2024-09-12T17:37:47.347138+0000","last_fullsized":"2024-09-12T17:37:47.347138+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:14.336440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":60,"num_write":35,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:32.354215+0000","last_change":"2024-09-12T17:27:17.418555+0000","last_active":"2024-09-12T17:38:32.354215+0000","last_peered":"2024-09-12T17:38:32.354215+0000","last_clean":"2024-09-12T17:38:32.354215+0000","last_became_active":"2024-09-12T17:27:17.417574+0000","last_became_peered":"2024-09-12T17:27:17.417574+0000","last_unstale":"2024-09-12T17:38:32.354215+0000","last_undegraded":"2024-09-12T17:38:32.354215+0000","last_fullsized":"2024-09-12T17:38:32.354215+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:54.585796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"265'4","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.647956+0000","last_change":"2024-09-12T17:15:43.151790+0000","last_active":"2024-09-12T17:41:32.647956+0000","last_peered":"2024-09-12T17:41:32.647956+0000","last_clean":"2024-09-12T17:41:32.647956+0000","last_became_active":"2024-09-12T17:15:43.151000+0000","last_became_peered":"2024-09-12T17:15:43.151000+0000","last_unstale":"2024-09-12T17:41:32.647956+0000","last_undegraded":"2024-09-12T17:41:32.647956+0000","last_fullsized":"2024-09-12T17:41:32.647956+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:26:12.163255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"262'2","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:11.280772+0000","last_change":"2024-09-12T17:15:40.119321+0000","last_active":"2024-09-12T17:38:11.280772+0000","last_peered":"2024-09-12T17:38:11.280772+0000","last_clean":"2024-09-12T17:38:11.280772+0000","last_became_active":"2024-09-12T17:15:40.118469+0000","last_became_peered":"2024-09-12T17:15:40.118469+0000","last_unstale":"2024-09-12T17:38:11.280772+0000","last_undegraded":"2024-09-12T17:38:11.280772+0000","last_fullsized":"2024-09-12T17:38:11.280772+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:28.762279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"265'20","reported_seq":99,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:46.290866+0000","last_change":"2024-09-12T17:13:54.828421+0000","last_active":"2024-09-12T17:37:46.290866+0000","last_peered":"2024-09-12T17:37:46.290866+0000","last_clean":"2024-09-12T17:37:46.290866+0000","last_became_active":"2024-09-12T17:13:54.827570+0000","last_became_peered":"2024-09-12T17:13:54.827570+0000","last_unstale":"2024-09-12T17:37:46.290866+0000","last_undegraded":"2024-09-12T17:37:46.290866+0000","last_fullsized":"2024-09-12T17:37:46.290866+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:42.149748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":63,"num_write":42,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:46.297919+0000","last_change":"2024-09-12T17:27:17.411486+0000","last_active":"2024-09-12T17:37:46.297919+0000","last_peered":"2024-09-12T17:37:46.297919+0000","last_clean":"2024-09-12T17:37:46.297919+0000","last_became_active":"2024-09-12T17:27:17.411175+0000","last_became_peered":"2024-09-12T17:27:17.411175+0000","last_unstale":"2024-09-12T17:37:46.297919+0000","last_undegraded":"2024-09-12T17:37:46.297919+0000","last_fullsized":"2024-09-12T17:37:46.297919+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:59.115945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"265'5","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:47.385482+0000","last_change":"2024-09-12T17:15:43.159928+0000","last_active":"2024-09-12T17:40:47.385482+0000","last_peered":"2024-09-12T17:40:47.385482+0000","last_clean":"2024-09-12T17:40:47.385482+0000","last_became_active":"2024-09-12T17:15:43.159149+0000","last_became_peered":"2024-09-12T17:15:43.159149+0000","last_unstale":"2024-09-12T17:40:47.385482+0000","last_undegraded":"2024-09-12T17:40:47.385482+0000","last_fullsized":"2024-09-12T17:40:47.385482+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:34.107337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2048,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"265'7","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:41.339938+0000","last_change":"2024-09-12T17:15:40.122291+0000","last_active":"2024-09-12T17:40:41.339938+0000","last_peered":"2024-09-12T17:40:41.339938+0000","last_clean":"2024-09-12T17:40:41.339938+0000","last_became_active":"2024-09-12T17:15:40.121513+0000","last_became_peered":"2024-09-12T17:15:40.121513+0000","last_unstale":"2024-09-12T17:40:41.339938+0000","last_undegraded":"2024-09-12T17:40:41.339938+0000","last_fullsized":"2024-09-12T17:40:41.339938+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:00.339305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6144,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"265'31","reported_seq":131,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:47.343574+0000","last_change":"2024-09-12T17:13:54.830067+0000","last_active":"2024-09-12T17:37:47.343574+0000","last_peered":"2024-09-12T17:37:47.343574+0000","last_clean":"2024-09-12T17:37:47.343574+0000","last_became_active":"2024-09-12T17:13:54.828393+0000","last_became_peered":"2024-09-12T17:13:54.828393+0000","last_unstale":"2024-09-12T17:37:47.343574+0000","last_undegraded":"2024-09-12T17:37:47.343574+0000","last_fullsized":"2024-09-12T17:37:47.343574+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:22:33.149059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":109,"num_write":58,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:42.328164+0000","last_change":"2024-09-12T17:27:17.402782+0000","last_active":"2024-09-12T17:37:42.328164+0000","last_peered":"2024-09-12T17:37:42.328164+0000","last_clean":"2024-09-12T17:37:42.328164+0000","last_became_active":"2024-09-12T17:27:17.402024+0000","last_became_peered":"2024-09-12T17:27:17.402024+0000","last_unstale":"2024-09-12T17:37:42.328164+0000","last_undegraded":"2024-09-12T17:37:42.328164+0000","last_fullsized":"2024-09-12T17:37:42.328164+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:24.176691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:37.355395+0000","last_change":"2024-09-12T17:15:43.871865+0000","last_active":"2024-09-12T17:38:37.355395+0000","last_peered":"2024-09-12T17:38:37.355395+0000","last_clean":"2024-09-12T17:38:37.355395+0000","last_became_active":"2024-09-12T17:15:43.871095+0000","last_became_peered":"2024-09-12T17:15:43.871095+0000","last_unstale":"2024-09-12T17:38:37.355395+0000","last_undegraded":"2024-09-12T17:38:37.355395+0000","last_fullsized":"2024-09-12T17:38:37.355395+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:26.988527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'9","reported_seq":60,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.083268+0000","last_change":"2024-09-12T17:15:40.126453+0000","last_active":"2024-09-12T17:41:32.083268+0000","last_peered":"2024-09-12T17:41:32.083268+0000","last_clean":"2024-09-12T17:41:32.083268+0000","last_became_active":"2024-09-12T17:15:40.125684+0000","last_became_peered":"2024-09-12T17:15:40.125684+0000","last_unstale":"2024-09-12T17:41:32.083268+0000","last_undegraded":"2024-09-12T17:41:32.083268+0000","last_fullsized":"2024-09-12T17:41:32.083268+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:40.660204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":32770,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"265'38","reported_seq":147,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:46.291003+0000","last_change":"2024-09-12T17:13:54.826751+0000","last_active":"2024-09-12T17:37:46.291003+0000","last_peered":"2024-09-12T17:37:46.291003+0000","last_clean":"2024-09-12T17:37:46.291003+0000","last_became_active":"2024-09-12T17:13:54.825945+0000","last_became_peered":"2024-09-12T17:13:54.825945+0000","last_unstale":"2024-09-12T17:37:46.291003+0000","last_undegraded":"2024-09-12T17:37:46.291003+0000","last_fullsized":"2024-09-12T17:37:46.291003+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:17.823826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":132,"num_write":66,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:18.711398+0000","last_change":"2024-09-12T17:27:17.409234+0000","last_active":"2024-09-12T17:39:18.711398+0000","last_peered":"2024-09-12T17:39:18.711398+0000","last_clean":"2024-09-12T17:39:18.711398+0000","last_became_active":"2024-09-12T17:27:17.408445+0000","last_became_peered":"2024-09-12T17:27:17.408445+0000","last_unstale":"2024-09-12T17:39:18.711398+0000","last_undegraded":"2024-09-12T17:39:18.711398+0000","last_fullsized":"2024-09-12T17:39:18.711398+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:52.795384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:26.293254+0000","last_change":"2024-09-12T17:15:43.867204+0000","last_active":"2024-09-12T17:37:26.293254+0000","last_peered":"2024-09-12T17:37:26.293254+0000","last_clean":"2024-09-12T17:37:26.293254+0000","last_became_active":"2024-09-12T17:15:43.866375+0000","last_became_peered":"2024-09-12T17:15:43.866375+0000","last_unstale":"2024-09-12T17:37:26.293254+0000","last_undegraded":"2024-09-12T17:37:26.293254+0000","last_fullsized":"2024-09-12T17:37:26.293254+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:23:05.372335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"265'6","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.138607+0000","last_change":"2024-09-12T17:15:40.125566+0000","last_active":"2024-09-12T17:41:32.138607+0000","last_peered":"2024-09-12T17:41:32.138607+0000","last_clean":"2024-09-12T17:41:32.138607+0000","last_became_active":"2024-09-12T17:15:40.124901+0000","last_became_peered":"2024-09-12T17:15:40.124901+0000","last_unstale":"2024-09-12T17:41:32.138607+0000","last_undegraded":"2024-09-12T17:41:32.138607+0000","last_fullsized":"2024-09-12T17:41:32.138607+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:00.285681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"265'32","reported_seq":130,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:01.315756+0000","last_change":"2024-09-12T17:13:54.830950+0000","last_active":"2024-09-12T17:39:01.315756+0000","last_peered":"2024-09-12T17:39:01.315756+0000","last_clean":"2024-09-12T17:39:01.315756+0000","last_became_active":"2024-09-12T17:13:54.824810+0000","last_became_peered":"2024-09-12T17:13:54.824810+0000","last_unstale":"2024-09-12T17:39:01.315756+0000","last_undegraded":"2024-09-12T17:39:01.315756+0000","last_fullsized":"2024-09-12T17:39:01.315756+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:18.942711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":107,"num_write":61,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:46.274844+0000","last_change":"2024-09-12T17:27:17.410104+0000","last_active":"2024-09-12T17:37:46.274844+0000","last_peered":"2024-09-12T17:37:46.274844+0000","last_clean":"2024-09-12T17:37:46.274844+0000","last_became_active":"2024-09-12T17:27:17.409774+0000","last_became_peered":"2024-09-12T17:27:17.409774+0000","last_unstale":"2024-09-12T17:37:46.274844+0000","last_undegraded":"2024-09-12T17:37:46.274844+0000","last_fullsized":"2024-09-12T17:37:46.274844+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:24.438283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:26.270554+0000","last_change":"2024-09-12T17:15:43.171491+0000","last_active":"2024-09-12T17:37:26.270554+0000","last_peered":"2024-09-12T17:37:26.270554+0000","last_clean":"2024-09-12T17:37:26.270554+0000","last_became_active":"2024-09-12T17:15:43.167221+0000","last_became_peered":"2024-09-12T17:15:43.167221+0000","last_unstale":"2024-09-12T17:37:26.270554+0000","last_undegraded":"2024-09-12T17:37:26.270554+0000","last_fullsized":"2024-09-12T17:37:26.270554+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:22.949060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"262'5","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:21.291867+0000","last_change":"2024-09-12T17:15:40.131852+0000","last_active":"2024-09-12T17:37:21.291867+0000","last_peered":"2024-09-12T17:37:21.291867+0000","last_clean":"2024-09-12T17:37:21.291867+0000","last_became_active":"2024-09-12T17:15:40.131162+0000","last_became_peered":"2024-09-12T17:15:40.131162+0000","last_unstale":"2024-09-12T17:37:21.291867+0000","last_undegraded":"2024-09-12T17:37:21.291867+0000","last_fullsized":"2024-09-12T17:37:21.291867+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:28.505817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"262'228","reported_seq":763,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:58.706524+0000","last_change":"2024-09-12T17:13:54.825163+0000","last_active":"2024-09-12T17:38:58.706524+0000","last_peered":"2024-09-12T17:38:58.706524+0000","last_clean":"2024-09-12T17:38:58.706524+0000","last_became_active":"2024-09-12T17:13:54.824372+0000","last_became_peered":"2024-09-12T17:13:54.824372+0000","last_unstale":"2024-09-12T17:38:58.706524+0000","last_undegraded":"2024-09-12T17:38:58.706524+0000","last_fullsized":"2024-09-12T17:38:58.706524+0000","mapping_epoch":252,"log_start":"262'200","ondisk_log_start":"262'200","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:21.156675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1417,"num_read_kb":1102,"num_write":261,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"265'1","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:10.273048+0000","last_change":"2024-09-12T17:27:17.404784+0000","last_active":"2024-09-12T17:38:10.273048+0000","last_peered":"2024-09-12T17:38:10.273048+0000","last_clean":"2024-09-12T17:38:10.273048+0000","last_became_active":"2024-09-12T17:27:17.404001+0000","last_became_peered":"2024-09-12T17:27:17.404001+0000","last_unstale":"2024-09-12T17:38:10.273048+0000","last_undegraded":"2024-09-12T17:38:10.273048+0000","last_fullsized":"2024-09-12T17:38:10.273048+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:30.724589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:33.700764+0000","last_change":"2024-09-12T17:15:43.159967+0000","last_active":"2024-09-12T17:38:33.700764+0000","last_peered":"2024-09-12T17:38:33.700764+0000","last_clean":"2024-09-12T17:38:33.700764+0000","last_became_active":"2024-09-12T17:15:43.159256+0000","last_became_peered":"2024-09-12T17:15:43.159256+0000","last_unstale":"2024-09-12T17:38:33.700764+0000","last_undegraded":"2024-09-12T17:38:33.700764+0000","last_fullsized":"2024-09-12T17:38:33.700764+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:56.377319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"265'2","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:46.326398+0000","last_change":"2024-09-12T17:15:40.139358+0000","last_active":"2024-09-12T17:39:46.326398+0000","last_peered":"2024-09-12T17:39:46.326398+0000","last_clean":"2024-09-12T17:39:46.326398+0000","last_became_active":"2024-09-12T17:15:40.138844+0000","last_became_peered":"2024-09-12T17:15:40.138844+0000","last_unstale":"2024-09-12T17:39:46.326398+0000","last_undegraded":"2024-09-12T17:39:46.326398+0000","last_fullsized":"2024-09-12T17:39:46.326398+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:16.913094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"265'38","reported_seq":148,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:57.345346+0000","last_change":"2024-09-12T17:13:54.831688+0000","last_active":"2024-09-12T17:38:57.345346+0000","last_peered":"2024-09-12T17:38:57.345346+0000","last_clean":"2024-09-12T17:38:57.345346+0000","last_became_active":"2024-09-12T17:13:54.830999+0000","last_became_peered":"2024-09-12T17:13:54.830999+0000","last_unstale":"2024-09-12T17:38:57.345346+0000","last_undegraded":"2024-09-12T17:38:57.345346+0000","last_fullsized":"2024-09-12T17:38:57.345346+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:34.484369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":129,"num_write":64,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:07.348306+0000","last_change":"2024-09-12T17:27:17.413681+0000","last_active":"2024-09-12T17:38:07.348306+0000","last_peered":"2024-09-12T17:38:07.348306+0000","last_clean":"2024-09-12T17:38:07.348306+0000","last_became_active":"2024-09-12T17:27:17.412921+0000","last_became_peered":"2024-09-12T17:27:17.412921+0000","last_unstale":"2024-09-12T17:38:07.348306+0000","last_undegraded":"2024-09-12T17:38:07.348306+0000","last_fullsized":"2024-09-12T17:38:07.348306+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:10.295122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"265'4","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.016754+0000","last_change":"2024-09-12T17:15:43.155640+0000","last_active":"2024-09-12T17:41:33.016754+0000","last_peered":"2024-09-12T17:41:33.016754+0000","last_clean":"2024-09-12T17:41:33.016754+0000","last_became_active":"2024-09-12T17:15:43.154940+0000","last_became_peered":"2024-09-12T17:15:43.154940+0000","last_unstale":"2024-09-12T17:41:33.016754+0000","last_undegraded":"2024-09-12T17:41:33.016754+0000","last_fullsized":"2024-09-12T17:41:33.016754+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:09:53.313111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:36.309541+0000","last_change":"2024-09-12T17:15:40.127548+0000","last_active":"2024-09-12T17:38:36.309541+0000","last_peered":"2024-09-12T17:38:36.309541+0000","last_clean":"2024-09-12T17:38:36.309541+0000","last_became_active":"2024-09-12T17:15:40.126745+0000","last_became_peered":"2024-09-12T17:15:40.126745+0000","last_unstale":"2024-09-12T17:38:36.309541+0000","last_undegraded":"2024-09-12T17:38:36.309541+0000","last_fullsized":"2024-09-12T17:38:36.309541+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:58.903944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"265'14","reported_seq":86,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:32.319736+0000","last_change":"2024-09-12T17:13:54.841357+0000","last_active":"2024-09-12T17:39:32.319736+0000","last_peered":"2024-09-12T17:39:32.319736+0000","last_clean":"2024-09-12T17:39:32.319736+0000","last_became_active":"2024-09-12T17:13:54.840501+0000","last_became_peered":"2024-09-12T17:13:54.840501+0000","last_unstale":"2024-09-12T17:39:32.319736+0000","last_undegraded":"2024-09-12T17:39:32.319736+0000","last_fullsized":"2024-09-12T17:39:32.319736+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:07:40.561312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":51,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:42.342324+0000","last_change":"2024-09-12T17:27:17.423169+0000","last_active":"2024-09-12T17:37:42.342324+0000","last_peered":"2024-09-12T17:37:42.342324+0000","last_clean":"2024-09-12T17:37:42.342324+0000","last_became_active":"2024-09-12T17:27:17.421504+0000","last_became_peered":"2024-09-12T17:27:17.421504+0000","last_unstale":"2024-09-12T17:37:42.342324+0000","last_undegraded":"2024-09-12T17:37:42.342324+0000","last_fullsized":"2024-09-12T17:37:42.342324+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:59.982039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"265'3","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:46.331365+0000","last_change":"2024-09-12T17:15:43.163468+0000","last_active":"2024-09-12T17:40:46.331365+0000","last_peered":"2024-09-12T17:40:46.331365+0000","last_clean":"2024-09-12T17:40:46.331365+0000","last_became_active":"2024-09-12T17:15:43.162406+0000","last_became_peered":"2024-09-12T17:15:43.162406+0000","last_unstale":"2024-09-12T17:40:46.331365+0000","last_undegraded":"2024-09-12T17:40:46.331365+0000","last_fullsized":"2024-09-12T17:40:46.331365+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:52.019907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"265'11","reported_seq":60,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.733819+0000","last_change":"2024-09-12T17:15:40.116483+0000","last_active":"2024-09-12T17:41:32.733819+0000","last_peered":"2024-09-12T17:41:32.733819+0000","last_clean":"2024-09-12T17:41:32.733819+0000","last_became_active":"2024-09-12T17:15:40.115746+0000","last_became_peered":"2024-09-12T17:15:40.115746+0000","last_unstale":"2024-09-12T17:41:32.733819+0000","last_undegraded":"2024-09-12T17:41:32.733819+0000","last_fullsized":"2024-09-12T17:41:32.733819+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:04.139173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12288,"num_write":16,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"265'17","reported_seq":96,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:31.674540+0000","last_change":"2024-09-12T17:13:54.838973+0000","last_active":"2024-09-12T17:39:31.674540+0000","last_peered":"2024-09-12T17:39:31.674540+0000","last_clean":"2024-09-12T17:39:31.674540+0000","last_became_active":"2024-09-12T17:13:54.838008+0000","last_became_peered":"2024-09-12T17:13:54.838008+0000","last_unstale":"2024-09-12T17:39:31.674540+0000","last_undegraded":"2024-09-12T17:39:31.674540+0000","last_fullsized":"2024-09-12T17:39:31.674540+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:41.998918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":61,"num_write":32,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:51.299103+0000","last_change":"2024-09-12T17:27:17.409064+0000","last_active":"2024-09-12T17:37:51.299103+0000","last_peered":"2024-09-12T17:37:51.299103+0000","last_clean":"2024-09-12T17:37:51.299103+0000","last_became_active":"2024-09-12T17:27:17.408296+0000","last_became_peered":"2024-09-12T17:27:17.408296+0000","last_unstale":"2024-09-12T17:37:51.299103+0000","last_undegraded":"2024-09-12T17:37:51.299103+0000","last_fullsized":"2024-09-12T17:37:51.299103+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:40.080273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"265'6","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:46.315558+0000","last_change":"2024-09-12T17:15:43.165243+0000","last_active":"2024-09-12T17:40:46.315558+0000","last_peered":"2024-09-12T17:40:46.315558+0000","last_clean":"2024-09-12T17:40:46.315558+0000","last_became_active":"2024-09-12T17:15:43.163824+0000","last_became_peered":"2024-09-12T17:15:43.163824+0000","last_unstale":"2024-09-12T17:40:46.315558+0000","last_undegraded":"2024-09-12T17:40:46.315558+0000","last_fullsized":"2024-09-12T17:40:46.315558+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:49.835850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5122,"num_write":6,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:36.301685+0000","last_change":"2024-09-12T17:15:40.115586+0000","last_active":"2024-09-12T17:38:36.301685+0000","last_peered":"2024-09-12T17:38:36.301685+0000","last_clean":"2024-09-12T17:38:36.301685+0000","last_became_active":"2024-09-12T17:15:40.114860+0000","last_became_peered":"2024-09-12T17:15:40.114860+0000","last_unstale":"2024-09-12T17:38:36.301685+0000","last_undegraded":"2024-09-12T17:38:36.301685+0000","last_fullsized":"2024-09-12T17:38:36.301685+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:40:36.955089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"265'55","reported_seq":197,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:56.027098+0000","last_change":"2024-09-12T17:13:54.833779+0000","last_active":"2024-09-12T17:38:56.027098+0000","last_peered":"2024-09-12T17:38:56.027098+0000","last_clean":"2024-09-12T17:38:56.027098+0000","last_became_active":"2024-09-12T17:13:54.832949+0000","last_became_peered":"2024-09-12T17:13:54.832949+0000","last_unstale":"2024-09-12T17:38:56.027098+0000","last_undegraded":"2024-09-12T17:38:56.027098+0000","last_fullsized":"2024-09-12T17:38:56.027098+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:16.134614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":283,"num_read_kb":200,"num_write":95,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"265'389","reported_seq":1080,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.343701+0000","last_change":"2024-09-12T16:58:18.717372+0000","last_active":"2024-09-12T17:41:33.343701+0000","last_peered":"2024-09-12T17:41:33.343701+0000","last_clean":"2024-09-12T17:41:33.343701+0000","last_became_active":"2024-09-12T16:58:18.713754+0000","last_became_peered":"2024-09-12T16:58:18.713754+0000","last_unstale":"2024-09-12T17:41:33.343701+0000","last_undegraded":"2024-09-12T17:41:33.343701+0000","last_fullsized":"2024-09-12T17:41:33.343701+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:28.092364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":207329,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":632,"num_read_kb":52184,"num_write":1250,"num_write_kb":52679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"265'127","reported_seq":726,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:04.402662+0000","last_change":"2024-09-12T16:58:21.709064+0000","last_active":"2024-09-12T17:40:04.402662+0000","last_peered":"2024-09-12T17:40:04.402662+0000","last_clean":"2024-09-12T17:40:04.402662+0000","last_became_active":"2024-09-12T16:58:21.708409+0000","last_became_peered":"2024-09-12T16:58:21.708409+0000","last_unstale":"2024-09-12T17:40:04.402662+0000","last_undegraded":"2024-09-12T17:40:04.402662+0000","last_fullsized":"2024-09-12T17:40:04.402662+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:23.027142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":568,"num_read_kb":472,"num_write":186,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"265'358","reported_seq":983,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.309772+0000","last_change":"2024-09-12T16:58:18.700441+0000","last_active":"2024-09-12T17:41:33.309772+0000","last_peered":"2024-09-12T17:41:33.309772+0000","last_clean":"2024-09-12T17:41:33.309772+0000","last_became_active":"2024-09-12T16:58:18.699994+0000","last_became_peered":"2024-09-12T16:58:18.699994+0000","last_unstale":"2024-09-12T17:41:33.309772+0000","last_undegraded":"2024-09-12T17:41:33.309772+0000","last_fullsized":"2024-09-12T17:41:33.309772+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:51.655272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263228,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":513,"num_read_kb":14780,"num_write":1119,"num_write_kb":32109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"265'61","reported_seq":640,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:48.739807+0000","last_change":"2024-09-12T16:58:21.722398+0000","last_active":"2024-09-12T17:39:48.739807+0000","last_peered":"2024-09-12T17:39:48.739807+0000","last_clean":"2024-09-12T17:39:48.739807+0000","last_became_active":"2024-09-12T16:58:21.721536+0000","last_became_peered":"2024-09-12T16:58:21.721536+0000","last_unstale":"2024-09-12T17:39:48.739807+0000","last_undegraded":"2024-09-12T17:39:48.739807+0000","last_fullsized":"2024-09-12T17:39:48.739807+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:56:41.263387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":297,"num_read_kb":264,"num_write":81,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"265'417","reported_seq":1224,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.319227+0000","last_change":"2024-09-12T16:58:18.688221+0000","last_active":"2024-09-12T17:41:33.319227+0000","last_peered":"2024-09-12T17:41:33.319227+0000","last_clean":"2024-09-12T17:41:33.319227+0000","last_became_active":"2024-09-12T16:58:18.687865+0000","last_became_peered":"2024-09-12T16:58:18.687865+0000","last_unstale":"2024-09-12T17:41:33.319227+0000","last_undegraded":"2024-09-12T17:41:33.319227+0000","last_fullsized":"2024-09-12T17:41:33.319227+0000","mapping_epoch":23,"log_start":"265'400","ondisk_log_start":"265'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:22:44.289065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263210,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1063,"num_read_kb":27565,"num_write":1556,"num_write_kb":41677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"265'166","reported_seq":760,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:33.434442+0000","last_change":"2024-09-12T16:58:21.704684+0000","last_active":"2024-09-12T17:38:33.434442+0000","last_peered":"2024-09-12T17:38:33.434442+0000","last_clean":"2024-09-12T17:38:33.434442+0000","last_became_active":"2024-09-12T16:58:21.703861+0000","last_became_peered":"2024-09-12T16:58:21.703861+0000","last_unstale":"2024-09-12T17:38:33.434442+0000","last_undegraded":"2024-09-12T17:38:33.434442+0000","last_fullsized":"2024-09-12T17:38:33.434442+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:16.015246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":693,"num_read_kb":563,"num_write":272,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"265'367","reported_seq":1020,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.324597+0000","last_change":"2024-09-12T16:58:18.717382+0000","last_active":"2024-09-12T17:41:33.324597+0000","last_peered":"2024-09-12T17:41:33.324597+0000","last_clean":"2024-09-12T17:41:33.324597+0000","last_became_active":"2024-09-12T16:58:18.716783+0000","last_became_peered":"2024-09-12T16:58:18.716783+0000","last_unstale":"2024-09-12T17:41:33.324597+0000","last_undegraded":"2024-09-12T17:41:33.324597+0000","last_fullsized":"2024-09-12T17:41:33.324597+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:09:30.963463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":698119,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":542,"num_read_kb":33905,"num_write":1205,"num_write_kb":31442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"265'206","reported_seq":808,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:23.453730+0000","last_change":"2024-09-12T16:58:21.700629+0000","last_active":"2024-09-12T17:39:23.453730+0000","last_peered":"2024-09-12T17:39:23.453730+0000","last_clean":"2024-09-12T17:39:23.453730+0000","last_became_active":"2024-09-12T16:58:21.699869+0000","last_became_peered":"2024-09-12T16:58:21.699869+0000","last_unstale":"2024-09-12T17:39:23.453730+0000","last_undegraded":"2024-09-12T17:39:23.453730+0000","last_fullsized":"2024-09-12T17:39:23.453730+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:31:52.012945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":874,"num_read_kb":727,"num_write":307,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"265'352","reported_seq":1016,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.337699+0000","last_change":"2024-09-12T16:58:18.689386+0000","last_active":"2024-09-12T17:41:33.337699+0000","last_peered":"2024-09-12T17:41:33.337699+0000","last_clean":"2024-09-12T17:41:33.337699+0000","last_became_active":"2024-09-12T16:58:18.688345+0000","last_became_peered":"2024-09-12T16:58:18.688345+0000","last_unstale":"2024-09-12T17:41:33.337699+0000","last_undegraded":"2024-09-12T17:41:33.337699+0000","last_fullsized":"2024-09-12T17:41:33.337699+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:07.865303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263227,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":585,"num_read_kb":27999,"num_write":1129,"num_write_kb":20285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"265'277","reported_seq":920,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:59.523406+0000","last_change":"2024-09-12T16:58:21.710632+0000","last_active":"2024-09-12T17:38:59.523406+0000","last_peered":"2024-09-12T17:38:59.523406+0000","last_clean":"2024-09-12T17:38:59.523406+0000","last_became_active":"2024-09-12T16:58:21.709879+0000","last_became_peered":"2024-09-12T16:58:21.709879+0000","last_unstale":"2024-09-12T17:38:59.523406+0000","last_undegraded":"2024-09-12T17:38:59.523406+0000","last_fullsized":"2024-09-12T17:38:59.523406+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:10.455020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1330,"num_read_kb":1122,"num_write":481,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"265'386","reported_seq":1035,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.341861+0000","last_change":"2024-09-12T16:58:18.699099+0000","last_active":"2024-09-12T17:41:33.341861+0000","last_peered":"2024-09-12T17:41:33.341861+0000","last_clean":"2024-09-12T17:41:33.341861+0000","last_became_active":"2024-09-12T16:58:18.698280+0000","last_became_peered":"2024-09-12T16:58:18.698280+0000","last_unstale":"2024-09-12T17:41:33.341861+0000","last_undegraded":"2024-09-12T17:41:33.341861+0000","last_fullsized":"2024-09-12T17:41:33.341861+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:21:53.931060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8651850,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":594,"num_read_kb":25091,"num_write":1290,"num_write_kb":36260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"265'157","reported_seq":760,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:25.144333+0000","last_change":"2024-09-12T16:58:21.710011+0000","last_active":"2024-09-12T17:38:25.144333+0000","last_peered":"2024-09-12T17:38:25.144333+0000","last_clean":"2024-09-12T17:38:25.144333+0000","last_became_active":"2024-09-12T16:58:21.706493+0000","last_became_peered":"2024-09-12T16:58:21.706493+0000","last_unstale":"2024-09-12T17:38:25.144333+0000","last_undegraded":"2024-09-12T17:38:25.144333+0000","last_fullsized":"2024-09-12T17:38:25.144333+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:28.236536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":697,"num_read_kb":578,"num_write":245,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"265'330","reported_seq":988,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.333168+0000","last_change":"2024-09-12T16:58:18.695130+0000","last_active":"2024-09-12T17:41:33.333168+0000","last_peered":"2024-09-12T17:41:33.333168+0000","last_clean":"2024-09-12T17:41:33.333168+0000","last_became_active":"2024-09-12T16:58:18.694357+0000","last_became_peered":"2024-09-12T16:58:18.694357+0000","last_unstale":"2024-09-12T17:41:33.333168+0000","last_undegraded":"2024-09-12T17:41:33.333168+0000","last_fullsized":"2024-09-12T17:41:33.333168+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:09.763291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":485,"num_read_kb":76108,"num_write":1068,"num_write_kb":48403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"265'76","reported_seq":653,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:57.331489+0000","last_change":"2024-09-12T16:58:21.723849+0000","last_active":"2024-09-12T17:37:57.331489+0000","last_peered":"2024-09-12T17:37:57.331489+0000","last_clean":"2024-09-12T17:37:57.331489+0000","last_became_active":"2024-09-12T16:58:21.723077+0000","last_became_peered":"2024-09-12T16:58:21.723077+0000","last_unstale":"2024-09-12T17:37:57.331489+0000","last_undegraded":"2024-09-12T17:37:57.331489+0000","last_fullsized":"2024-09-12T17:37:57.331489+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:24.692985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":363,"num_read_kb":315,"num_write":111,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"265'305","reported_seq":914,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.336509+0000","last_change":"2024-09-12T16:58:18.702345+0000","last_active":"2024-09-12T17:41:33.336509+0000","last_peered":"2024-09-12T17:41:33.336509+0000","last_clean":"2024-09-12T17:41:33.336509+0000","last_became_active":"2024-09-12T16:58:18.701590+0000","last_became_peered":"2024-09-12T16:58:18.701590+0000","last_unstale":"2024-09-12T17:41:33.336509+0000","last_undegraded":"2024-09-12T17:41:33.336509+0000","last_fullsized":"2024-09-12T17:41:33.336509+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:06.256813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":399,"num_read_kb":1374,"num_write":924,"num_write_kb":18073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"265'138","reported_seq":739,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:36.361716+0000","last_change":"2024-09-12T16:58:21.725837+0000","last_active":"2024-09-12T17:39:36.361716+0000","last_peered":"2024-09-12T17:39:36.361716+0000","last_clean":"2024-09-12T17:39:36.361716+0000","last_became_active":"2024-09-12T16:58:21.718167+0000","last_became_peered":"2024-09-12T16:58:21.718167+0000","last_unstale":"2024-09-12T17:39:36.361716+0000","last_undegraded":"2024-09-12T17:39:36.361716+0000","last_fullsized":"2024-09-12T17:39:36.361716+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:29.353963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":612,"num_read_kb":510,"num_write":201,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"265'4234","reported_seq":4884,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:42.781502+0000","last_change":"2024-09-12T16:58:21.698194+0000","last_active":"2024-09-12T17:39:42.781502+0000","last_peered":"2024-09-12T17:39:42.781502+0000","last_clean":"2024-09-12T17:39:42.781502+0000","last_became_active":"2024-09-12T16:58:21.697479+0000","last_became_peered":"2024-09-12T16:58:21.697479+0000","last_unstale":"2024-09-12T17:39:42.781502+0000","last_undegraded":"2024-09-12T17:39:42.781502+0000","last_fullsized":"2024-09-12T17:39:42.781502+0000","mapping_epoch":26,"log_start":"265'4200","ondisk_log_start":"265'4200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":3000,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:12:15.711479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17044,"num_read_kb":14289,"num_write":6359,"num_write_kb":3183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"265'317","reported_seq":941,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.294366+0000","last_change":"2024-09-12T16:58:18.714631+0000","last_active":"2024-09-12T17:41:33.294366+0000","last_peered":"2024-09-12T17:41:33.294366+0000","last_clean":"2024-09-12T17:41:33.294366+0000","last_became_active":"2024-09-12T16:58:18.713739+0000","last_became_peered":"2024-09-12T16:58:18.713739+0000","last_unstale":"2024-09-12T17:41:33.294366+0000","last_undegraded":"2024-09-12T17:41:33.294366+0000","last_fullsized":"2024-09-12T17:41:33.294366+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:29.786536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":436,"num_read_kb":10222,"num_write":964,"num_write_kb":31220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"265'294","reported_seq":1006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:48.145728+0000","last_change":"2024-09-12T16:58:21.724340+0000","last_active":"2024-09-12T17:39:48.145728+0000","last_peered":"2024-09-12T17:39:48.145728+0000","last_clean":"2024-09-12T17:39:48.145728+0000","last_became_active":"2024-09-12T16:58:21.723238+0000","last_became_peered":"2024-09-12T16:58:21.723238+0000","last_unstale":"2024-09-12T17:39:48.145728+0000","last_undegraded":"2024-09-12T17:39:48.145728+0000","last_fullsized":"2024-09-12T17:39:48.145728+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:26.233677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1552,"num_read_kb":1372,"num_write":472,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"265'342","reported_seq":954,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.341642+0000","last_change":"2024-09-12T16:58:18.702745+0000","last_active":"2024-09-12T17:41:33.341642+0000","last_peered":"2024-09-12T17:41:33.341642+0000","last_clean":"2024-09-12T17:41:33.341642+0000","last_became_active":"2024-09-12T16:58:18.701989+0000","last_became_peered":"2024-09-12T16:58:18.701989+0000","last_unstale":"2024-09-12T17:41:33.341642+0000","last_undegraded":"2024-09-12T17:41:33.341642+0000","last_fullsized":"2024-09-12T17:41:33.341642+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:43:11.774703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1343103,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":443,"num_read_kb":5557,"num_write":1028,"num_write_kb":22464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"265'183","reported_seq":791,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:12.334752+0000","last_change":"2024-09-12T16:58:21.716125+0000","last_active":"2024-09-12T17:38:12.334752+0000","last_peered":"2024-09-12T17:38:12.334752+0000","last_clean":"2024-09-12T17:38:12.334752+0000","last_became_active":"2024-09-12T16:58:21.715289+0000","last_became_peered":"2024-09-12T16:58:21.715289+0000","last_unstale":"2024-09-12T17:38:12.334752+0000","last_undegraded":"2024-09-12T17:38:12.334752+0000","last_fullsized":"2024-09-12T17:38:12.334752+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:51.702306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":782,"num_read_kb":649,"num_write":263,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"265'370","reported_seq":1043,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.330349+0000","last_change":"2024-09-12T16:58:18.703102+0000","last_active":"2024-09-12T17:41:33.330349+0000","last_peered":"2024-09-12T17:41:33.330349+0000","last_clean":"2024-09-12T17:41:33.330349+0000","last_became_active":"2024-09-12T16:58:18.702185+0000","last_became_peered":"2024-09-12T16:58:18.702185+0000","last_unstale":"2024-09-12T17:41:33.330349+0000","last_undegraded":"2024-09-12T17:41:33.330349+0000","last_fullsized":"2024-09-12T17:41:33.330349+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:26.576879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306656,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":591,"num_read_kb":49223,"num_write":1212,"num_write_kb":37016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"265'189","reported_seq":821,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:50.846518+0000","last_change":"2024-09-12T16:58:21.725319+0000","last_active":"2024-09-12T17:38:50.846518+0000","last_peered":"2024-09-12T17:38:50.846518+0000","last_clean":"2024-09-12T17:38:50.846518+0000","last_became_active":"2024-09-12T16:58:21.718158+0000","last_became_peered":"2024-09-12T16:58:21.718158+0000","last_unstale":"2024-09-12T17:38:50.846518+0000","last_undegraded":"2024-09-12T17:38:50.846518+0000","last_fullsized":"2024-09-12T17:38:50.846518+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:25.653319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":878,"num_read_kb":727,"num_write":304,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"265'353","reported_seq":1090,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.330452+0000","last_change":"2024-09-12T16:58:18.702967+0000","last_active":"2024-09-12T17:41:33.330452+0000","last_peered":"2024-09-12T17:41:33.330452+0000","last_clean":"2024-09-12T17:41:33.330452+0000","last_became_active":"2024-09-12T16:58:18.699360+0000","last_became_peered":"2024-09-12T16:58:18.699360+0000","last_unstale":"2024-09-12T17:41:33.330452+0000","last_undegraded":"2024-09-12T17:41:33.330452+0000","last_fullsized":"2024-09-12T17:41:33.330452+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:23.551727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":626,"num_read_kb":143204,"num_write":1063,"num_write_kb":36082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"265'136","reported_seq":765,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:49.202472+0000","last_change":"2024-09-12T16:58:21.728829+0000","last_active":"2024-09-12T17:39:49.202472+0000","last_peered":"2024-09-12T17:39:49.202472+0000","last_clean":"2024-09-12T17:39:49.202472+0000","last_became_active":"2024-09-12T16:58:21.728321+0000","last_became_peered":"2024-09-12T16:58:21.728321+0000","last_unstale":"2024-09-12T17:39:49.202472+0000","last_undegraded":"2024-09-12T17:39:49.202472+0000","last_fullsized":"2024-09-12T17:39:49.202472+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:15.718429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":636,"num_read_kb":537,"num_write":197,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"265'317","reported_seq":929,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.324696+0000","last_change":"2024-09-12T16:58:18.691138+0000","last_active":"2024-09-12T17:41:33.324696+0000","last_peered":"2024-09-12T17:41:33.324696+0000","last_clean":"2024-09-12T17:41:33.324696+0000","last_became_active":"2024-09-12T16:58:18.690634+0000","last_became_peered":"2024-09-12T16:58:18.690634+0000","last_unstale":"2024-09-12T17:41:33.324696+0000","last_undegraded":"2024-09-12T17:41:33.324696+0000","last_fullsized":"2024-09-12T17:41:33.324696+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:16.345304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159799,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":394,"num_read_kb":27088,"num_write":949,"num_write_kb":25947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"265'299","reported_seq":897,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:01.264914+0000","last_change":"2024-09-12T16:58:21.705137+0000","last_active":"2024-09-12T17:37:01.264914+0000","last_peered":"2024-09-12T17:37:01.264914+0000","last_clean":"2024-09-12T17:37:01.264914+0000","last_became_active":"2024-09-12T16:58:21.702643+0000","last_became_peered":"2024-09-12T16:58:21.702643+0000","last_unstale":"2024-09-12T17:37:01.264914+0000","last_undegraded":"2024-09-12T17:37:01.264914+0000","last_fullsized":"2024-09-12T17:37:01.264914+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:27.298302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1307,"num_read_kb":1045,"num_write":505,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"265'341","reported_seq":1093,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.303101+0000","last_change":"2024-09-12T16:58:18.703569+0000","last_active":"2024-09-12T17:41:33.303101+0000","last_peered":"2024-09-12T17:41:33.303101+0000","last_clean":"2024-09-12T17:41:33.303101+0000","last_became_active":"2024-09-12T16:58:18.702310+0000","last_became_peered":"2024-09-12T16:58:18.702310+0000","last_unstale":"2024-09-12T17:41:33.303101+0000","last_undegraded":"2024-09-12T17:41:33.303101+0000","last_fullsized":"2024-09-12T17:41:33.303101+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:28.757489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":950476,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":583,"num_read_kb":31842,"num_write":1061,"num_write_kb":30837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"265'153","reported_seq":661,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:05.039986+0000","last_change":"2024-09-12T16:58:29.792625+0000","last_active":"2024-09-12T17:40:05.039986+0000","last_peered":"2024-09-12T17:40:05.039986+0000","last_clean":"2024-09-12T17:40:05.039986+0000","last_became_active":"2024-09-12T16:58:29.792043+0000","last_became_peered":"2024-09-12T16:58:29.792043+0000","last_unstale":"2024-09-12T17:40:05.039986+0000","last_undegraded":"2024-09-12T17:40:05.039986+0000","last_fullsized":"2024-09-12T17:40:05.039986+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:46.501133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":230,"num_read_kb":220,"num_write":374,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"265'102","reported_seq":686,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:24.677630+0000","last_change":"2024-09-12T16:58:21.707802+0000","last_active":"2024-09-12T17:39:24.677630+0000","last_peered":"2024-09-12T17:39:24.677630+0000","last_clean":"2024-09-12T17:39:24.677630+0000","last_became_active":"2024-09-12T16:58:21.707428+0000","last_became_peered":"2024-09-12T16:58:21.707428+0000","last_unstale":"2024-09-12T17:39:24.677630+0000","last_undegraded":"2024-09-12T17:39:24.677630+0000","last_fullsized":"2024-09-12T17:39:24.677630+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:42.024002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":440,"num_read_kb":374,"num_write":161,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"265'378","reported_seq":1031,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.331949+0000","last_change":"2024-09-12T16:58:18.716412+0000","last_active":"2024-09-12T17:41:33.331949+0000","last_peered":"2024-09-12T17:41:33.331949+0000","last_clean":"2024-09-12T17:41:33.331949+0000","last_became_active":"2024-09-12T16:58:18.714782+0000","last_became_peered":"2024-09-12T16:58:18.714782+0000","last_unstale":"2024-09-12T17:41:33.331949+0000","last_undegraded":"2024-09-12T17:41:33.331949+0000","last_fullsized":"2024-09-12T17:41:33.331949+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:30.616876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194316,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":558,"num_read_kb":18943,"num_write":1229,"num_write_kb":58984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:07.320348+0000","last_change":"2024-09-12T16:58:23.713332+0000","last_active":"2024-09-12T17:37:07.320348+0000","last_peered":"2024-09-12T17:37:07.320348+0000","last_clean":"2024-09-12T17:37:07.320348+0000","last_became_active":"2024-09-12T16:58:23.712621+0000","last_became_peered":"2024-09-12T16:58:23.712621+0000","last_unstale":"2024-09-12T17:37:07.320348+0000","last_undegraded":"2024-09-12T17:37:07.320348+0000","last_fullsized":"2024-09-12T17:37:07.320348+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:58:32.081784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"265'338","reported_seq":936,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.641664+0000","last_change":"2024-09-12T16:58:25.730728+0000","last_active":"2024-09-12T17:41:32.641664+0000","last_peered":"2024-09-12T17:41:32.641664+0000","last_clean":"2024-09-12T17:41:32.641664+0000","last_became_active":"2024-09-12T16:58:25.728901+0000","last_became_peered":"2024-09-12T16:58:25.728901+0000","last_unstale":"2024-09-12T17:41:32.641664+0000","last_undegraded":"2024-09-12T17:41:32.641664+0000","last_fullsized":"2024-09-12T17:41:32.641664+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:04.800787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46434,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":549,"num_read_kb":1164,"num_write":438,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:11.289497+0000","last_change":"2024-09-12T16:58:27.753040+0000","last_active":"2024-09-12T17:37:11.289497+0000","last_peered":"2024-09-12T17:37:11.289497+0000","last_clean":"2024-09-12T17:37:11.289497+0000","last_became_active":"2024-09-12T16:58:27.752315+0000","last_became_peered":"2024-09-12T16:58:27.752315+0000","last_unstale":"2024-09-12T17:37:11.289497+0000","last_undegraded":"2024-09-12T17:37:11.289497+0000","last_fullsized":"2024-09-12T17:37:11.289497+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:39.272577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"265'126","reported_seq":675,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:03.062821+0000","last_change":"2024-09-12T16:58:29.774689+0000","last_active":"2024-09-12T17:40:03.062821+0000","last_peered":"2024-09-12T17:40:03.062821+0000","last_clean":"2024-09-12T17:40:03.062821+0000","last_became_active":"2024-09-12T16:58:29.773874+0000","last_became_peered":"2024-09-12T16:58:29.773874+0000","last_unstale":"2024-09-12T17:40:03.062821+0000","last_undegraded":"2024-09-12T17:40:03.062821+0000","last_fullsized":"2024-09-12T17:40:03.062821+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:24.286576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":191,"num_read_kb":190,"num_write":216,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"265'400","reported_seq":1050,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:42.832514+0000","last_change":"2024-09-12T16:58:21.719455+0000","last_active":"2024-09-12T17:38:42.832514+0000","last_peered":"2024-09-12T17:38:42.832514+0000","last_clean":"2024-09-12T17:38:42.832514+0000","last_became_active":"2024-09-12T16:58:21.717806+0000","last_became_peered":"2024-09-12T16:58:21.717806+0000","last_unstale":"2024-09-12T17:38:42.832514+0000","last_undegraded":"2024-09-12T17:38:42.832514+0000","last_fullsized":"2024-09-12T17:38:42.832514+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:24.079041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1815,"num_read_kb":1449,"num_write":653,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"265'348","reported_seq":1034,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.338470+0000","last_change":"2024-09-12T16:58:18.692396+0000","last_active":"2024-09-12T17:41:33.338470+0000","last_peered":"2024-09-12T17:41:33.338470+0000","last_clean":"2024-09-12T17:41:33.338470+0000","last_became_active":"2024-09-12T16:58:18.691335+0000","last_became_peered":"2024-09-12T16:58:18.691335+0000","last_unstale":"2024-09-12T17:41:33.338470+0000","last_undegraded":"2024-09-12T17:41:33.338470+0000","last_fullsized":"2024-09-12T17:41:33.338470+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:42:36.520626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1278687,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":548,"num_read_kb":106559,"num_write":1101,"num_write_kb":67871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:17.354558+0000","last_change":"2024-09-12T16:58:23.719306+0000","last_active":"2024-09-12T17:38:17.354558+0000","last_peered":"2024-09-12T17:38:17.354558+0000","last_clean":"2024-09-12T17:38:17.354558+0000","last_became_active":"2024-09-12T16:58:23.718656+0000","last_became_peered":"2024-09-12T16:58:23.718656+0000","last_unstale":"2024-09-12T17:38:17.354558+0000","last_undegraded":"2024-09-12T17:38:17.354558+0000","last_fullsized":"2024-09-12T17:38:17.354558+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:05:10.035449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"265'99","reported_seq":621,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:22.810700+0000","last_change":"2024-09-12T16:58:25.714387+0000","last_active":"2024-09-12T17:39:22.810700+0000","last_peered":"2024-09-12T17:39:22.810700+0000","last_clean":"2024-09-12T17:39:22.810700+0000","last_became_active":"2024-09-12T16:58:25.713567+0000","last_became_peered":"2024-09-12T16:58:25.713567+0000","last_unstale":"2024-09-12T17:39:22.810700+0000","last_undegraded":"2024-09-12T17:39:22.810700+0000","last_fullsized":"2024-09-12T17:39:22.810700+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:13.593060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":95,"num_read_kb":90,"num_write":66,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:11.267295+0000","last_change":"2024-09-12T16:58:27.729072+0000","last_active":"2024-09-12T17:37:11.267295+0000","last_peered":"2024-09-12T17:37:11.267295+0000","last_clean":"2024-09-12T17:37:11.267295+0000","last_became_active":"2024-09-12T16:58:27.728276+0000","last_became_peered":"2024-09-12T16:58:27.728276+0000","last_unstale":"2024-09-12T17:37:11.267295+0000","last_undegraded":"2024-09-12T17:37:11.267295+0000","last_fullsized":"2024-09-12T17:37:11.267295+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:19.029657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"265'125","reported_seq":630,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:04.398546+0000","last_change":"2024-09-12T16:58:29.781407+0000","last_active":"2024-09-12T17:40:04.398546+0000","last_peered":"2024-09-12T17:40:04.398546+0000","last_clean":"2024-09-12T17:40:04.398546+0000","last_became_active":"2024-09-12T16:58:29.780598+0000","last_became_peered":"2024-09-12T16:58:29.780598+0000","last_unstale":"2024-09-12T17:40:04.398546+0000","last_undegraded":"2024-09-12T17:40:04.398546+0000","last_fullsized":"2024-09-12T17:40:04.398546+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:18.860850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":203,"num_read_kb":191,"num_write":301,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"265'80","reported_seq":642,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:41.116398+0000","last_change":"2024-09-12T16:58:21.719225+0000","last_active":"2024-09-12T17:39:41.116398+0000","last_peered":"2024-09-12T17:39:41.116398+0000","last_clean":"2024-09-12T17:39:41.116398+0000","last_became_active":"2024-09-12T16:58:21.718773+0000","last_became_peered":"2024-09-12T16:58:21.718773+0000","last_unstale":"2024-09-12T17:39:41.116398+0000","last_undegraded":"2024-09-12T17:39:41.116398+0000","last_fullsized":"2024-09-12T17:39:41.116398+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:06.541968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":373,"num_read_kb":312,"num_write":123,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"265'328","reported_seq":919,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.307578+0000","last_change":"2024-09-12T16:58:55.845287+0000","last_active":"2024-09-12T17:41:33.307578+0000","last_peered":"2024-09-12T17:41:33.307578+0000","last_clean":"2024-09-12T17:41:33.307578+0000","last_became_active":"2024-09-12T16:58:55.843826+0000","last_became_peered":"2024-09-12T16:58:55.843826+0000","last_unstale":"2024-09-12T17:41:33.307578+0000","last_undegraded":"2024-09-12T17:41:33.307578+0000","last_fullsized":"2024-09-12T17:41:33.307578+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:56.799291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263214,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":424,"num_read_kb":4809,"num_write":985,"num_write_kb":23718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:07.338234+0000","last_change":"2024-09-12T16:58:23.707417+0000","last_active":"2024-09-12T17:37:07.338234+0000","last_peered":"2024-09-12T17:37:07.338234+0000","last_clean":"2024-09-12T17:37:07.338234+0000","last_became_active":"2024-09-12T16:58:23.706953+0000","last_became_peered":"2024-09-12T16:58:23.706953+0000","last_unstale":"2024-09-12T17:37:07.338234+0000","last_undegraded":"2024-09-12T17:37:07.338234+0000","last_fullsized":"2024-09-12T17:37:07.338234+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:53.755342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"265'105","reported_seq":638,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:11.702449+0000","last_change":"2024-09-12T16:58:25.714085+0000","last_active":"2024-09-12T17:39:11.702449+0000","last_peered":"2024-09-12T17:39:11.702449+0000","last_clean":"2024-09-12T17:39:11.702449+0000","last_became_active":"2024-09-12T16:58:25.713213+0000","last_became_peered":"2024-09-12T16:58:25.713213+0000","last_unstale":"2024-09-12T17:39:11.702449+0000","last_undegraded":"2024-09-12T17:39:11.702449+0000","last_fullsized":"2024-09-12T17:39:11.702449+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:25.447055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":116,"num_write":82,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"265'770","reported_seq":4622,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.976892+0000","last_change":"2024-09-12T16:58:27.753546+0000","last_active":"2024-09-12T17:41:32.976892+0000","last_peered":"2024-09-12T17:41:32.976892+0000","last_clean":"2024-09-12T17:41:32.976892+0000","last_became_active":"2024-09-12T16:58:27.752801+0000","last_became_peered":"2024-09-12T16:58:27.752801+0000","last_unstale":"2024-09-12T17:41:32.976892+0000","last_undegraded":"2024-09-12T17:41:32.976892+0000","last_fullsized":"2024-09-12T17:41:32.976892+0000","mapping_epoch":32,"log_start":"265'702","ondisk_log_start":"265'702","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":702,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:03.558787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"265'204","reported_seq":1022,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:05.112599+0000","last_change":"2024-09-12T16:58:29.770179+0000","last_active":"2024-09-12T17:40:05.112599+0000","last_peered":"2024-09-12T17:40:05.112599+0000","last_clean":"2024-09-12T17:40:05.112599+0000","last_became_active":"2024-09-12T16:58:29.769351+0000","last_became_peered":"2024-09-12T16:58:29.769351+0000","last_unstale":"2024-09-12T17:40:05.112599+0000","last_undegraded":"2024-09-12T17:40:05.112599+0000","last_fullsized":"2024-09-12T17:40:05.112599+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:38.433650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":633,"num_read_kb":631,"num_write":454,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"265'164","reported_seq":753,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:34.507430+0000","last_change":"2024-09-12T16:58:21.711086+0000","last_active":"2024-09-12T17:39:34.507430+0000","last_peered":"2024-09-12T17:39:34.507430+0000","last_clean":"2024-09-12T17:39:34.507430+0000","last_became_active":"2024-09-12T16:58:21.710646+0000","last_became_peered":"2024-09-12T16:58:21.710646+0000","last_unstale":"2024-09-12T17:39:34.507430+0000","last_undegraded":"2024-09-12T17:39:34.507430+0000","last_fullsized":"2024-09-12T17:39:34.507430+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:34:16.873776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":698,"num_read_kb":573,"num_write":260,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"265'337","reported_seq":962,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.320704+0000","last_change":"2024-09-12T16:58:18.690508+0000","last_active":"2024-09-12T17:41:33.320704+0000","last_peered":"2024-09-12T17:41:33.320704+0000","last_clean":"2024-09-12T17:41:33.320704+0000","last_became_active":"2024-09-12T16:58:18.689915+0000","last_became_peered":"2024-09-12T16:58:18.689915+0000","last_unstale":"2024-09-12T17:41:33.320704+0000","last_undegraded":"2024-09-12T17:41:33.320704+0000","last_fullsized":"2024-09-12T17:41:33.320704+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:30.087379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388626,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":434,"num_read_kb":42593,"num_write":1103,"num_write_kb":36991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:07.320434+0000","last_change":"2024-09-12T16:58:23.697918+0000","last_active":"2024-09-12T17:37:07.320434+0000","last_peered":"2024-09-12T17:37:07.320434+0000","last_clean":"2024-09-12T17:37:07.320434+0000","last_became_active":"2024-09-12T16:58:23.697159+0000","last_became_peered":"2024-09-12T16:58:23.697159+0000","last_unstale":"2024-09-12T17:37:07.320434+0000","last_undegraded":"2024-09-12T17:37:07.320434+0000","last_fullsized":"2024-09-12T17:37:07.320434+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:03.312839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"265'248","reported_seq":814,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.432252+0000","last_change":"2024-09-12T16:58:25.949946+0000","last_active":"2024-09-12T17:41:32.432252+0000","last_peered":"2024-09-12T17:41:32.432252+0000","last_clean":"2024-09-12T17:41:32.432252+0000","last_became_active":"2024-09-12T16:58:25.949179+0000","last_became_peered":"2024-09-12T16:58:25.949179+0000","last_unstale":"2024-09-12T17:41:32.432252+0000","last_undegraded":"2024-09-12T17:41:32.432252+0000","last_fullsized":"2024-09-12T17:41:32.432252+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:40.413824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43414,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":422,"num_read_kb":981,"num_write":340,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"265'785","reported_seq":2099,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.076506+0000","last_change":"2024-09-12T16:58:27.746737+0000","last_active":"2024-09-12T17:41:33.076506+0000","last_peered":"2024-09-12T17:41:33.076506+0000","last_clean":"2024-09-12T17:41:33.076506+0000","last_became_active":"2024-09-12T16:58:27.745988+0000","last_became_peered":"2024-09-12T16:58:27.745988+0000","last_unstale":"2024-09-12T17:41:33.076506+0000","last_undegraded":"2024-09-12T17:41:33.076506+0000","last_fullsized":"2024-09-12T17:41:33.076506+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:10.802947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"265'150","reported_seq":720,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:22.323591+0000","last_change":"2024-09-12T16:58:21.710840+0000","last_active":"2024-09-12T17:37:22.323591+0000","last_peered":"2024-09-12T17:37:22.323591+0000","last_clean":"2024-09-12T17:37:22.323591+0000","last_became_active":"2024-09-12T16:58:21.710029+0000","last_became_peered":"2024-09-12T16:58:21.710029+0000","last_unstale":"2024-09-12T17:37:22.323591+0000","last_undegraded":"2024-09-12T17:37:22.323591+0000","last_fullsized":"2024-09-12T17:37:22.323591+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:16.606525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":614,"num_read_kb":496,"num_write":228,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"265'362","reported_seq":1009,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.326650+0000","last_change":"2024-09-12T16:58:18.717733+0000","last_active":"2024-09-12T17:41:33.326650+0000","last_peered":"2024-09-12T17:41:33.326650+0000","last_clean":"2024-09-12T17:41:33.326650+0000","last_became_active":"2024-09-12T16:58:18.715448+0000","last_became_peered":"2024-09-12T16:58:18.715448+0000","last_unstale":"2024-09-12T17:41:33.326650+0000","last_undegraded":"2024-09-12T17:41:33.326650+0000","last_fullsized":"2024-09-12T17:41:33.326650+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:12.664073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1147727,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":546,"num_read_kb":11904,"num_write":1219,"num_write_kb":32051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:26.293032+0000","last_change":"2024-09-12T16:58:23.720919+0000","last_active":"2024-09-12T17:37:26.293032+0000","last_peered":"2024-09-12T17:37:26.293032+0000","last_clean":"2024-09-12T17:37:26.293032+0000","last_became_active":"2024-09-12T16:58:23.720096+0000","last_became_peered":"2024-09-12T16:58:23.720096+0000","last_unstale":"2024-09-12T17:37:26.293032+0000","last_undegraded":"2024-09-12T17:37:26.293032+0000","last_fullsized":"2024-09-12T17:37:26.293032+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:35.342690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"265'359","reported_seq":968,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.811436+0000","last_change":"2024-09-12T16:58:25.947522+0000","last_active":"2024-09-12T17:41:32.811436+0000","last_peered":"2024-09-12T17:41:32.811436+0000","last_clean":"2024-09-12T17:41:32.811436+0000","last_became_active":"2024-09-12T16:58:25.946765+0000","last_became_peered":"2024-09-12T16:58:25.946765+0000","last_unstale":"2024-09-12T17:41:32.811436+0000","last_undegraded":"2024-09-12T17:41:32.811436+0000","last_fullsized":"2024-09-12T17:41:32.811436+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:15.651894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46152,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":583,"num_read_kb":1215,"num_write":464,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:53.705109+0000","last_change":"2024-09-12T16:58:27.754351+0000","last_active":"2024-09-12T17:38:53.705109+0000","last_peered":"2024-09-12T17:38:53.705109+0000","last_clean":"2024-09-12T17:38:53.705109+0000","last_became_active":"2024-09-12T16:58:27.753616+0000","last_became_peered":"2024-09-12T16:58:27.753616+0000","last_unstale":"2024-09-12T17:38:53.705109+0000","last_undegraded":"2024-09-12T17:38:53.705109+0000","last_fullsized":"2024-09-12T17:38:53.705109+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:26.306126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"265'550","reported_seq":1358,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:24.912198+0000","last_change":"2024-09-12T16:58:29.774852+0000","last_active":"2024-09-12T17:41:24.912198+0000","last_peered":"2024-09-12T17:41:24.912198+0000","last_clean":"2024-09-12T17:41:24.912198+0000","last_became_active":"2024-09-12T16:58:29.774093+0000","last_became_peered":"2024-09-12T16:58:29.774093+0000","last_unstale":"2024-09-12T17:41:24.912198+0000","last_undegraded":"2024-09-12T17:41:24.912198+0000","last_fullsized":"2024-09-12T17:41:24.912198+0000","mapping_epoch":34,"log_start":"265'500","ondisk_log_start":"265'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":500,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:00.606117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":455,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1305,"num_read_kb":1304,"num_write":1151,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"265'502","reported_seq":1254,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:45.251893+0000","last_change":"2024-09-12T16:58:21.700218+0000","last_active":"2024-09-12T17:39:45.251893+0000","last_peered":"2024-09-12T17:39:45.251893+0000","last_clean":"2024-09-12T17:39:45.251893+0000","last_became_active":"2024-09-12T16:58:21.699243+0000","last_became_peered":"2024-09-12T16:58:21.699243+0000","last_unstale":"2024-09-12T17:39:45.251893+0000","last_undegraded":"2024-09-12T17:39:45.251893+0000","last_fullsized":"2024-09-12T17:39:45.251893+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:06:32.179023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2329,"num_read_kb":1984,"num_write":852,"num_write_kb":550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"265'365","reported_seq":1028,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.284586+0000","last_change":"2024-09-12T16:58:18.715397+0000","last_active":"2024-09-12T17:41:33.284586+0000","last_peered":"2024-09-12T17:41:33.284586+0000","last_clean":"2024-09-12T17:41:33.284586+0000","last_became_active":"2024-09-12T16:58:18.714412+0000","last_became_peered":"2024-09-12T16:58:18.714412+0000","last_unstale":"2024-09-12T17:41:33.284586+0000","last_undegraded":"2024-09-12T17:41:33.284586+0000","last_fullsized":"2024-09-12T17:41:33.284586+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:27.766473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306427,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":511,"num_read_kb":85960,"num_write":1174,"num_write_kb":38984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:25.262997+0000","last_change":"2024-09-12T16:58:23.703982+0000","last_active":"2024-09-12T17:37:25.262997+0000","last_peered":"2024-09-12T17:37:25.262997+0000","last_clean":"2024-09-12T17:37:25.262997+0000","last_became_active":"2024-09-12T16:58:23.703534+0000","last_became_peered":"2024-09-12T16:58:23.703534+0000","last_unstale":"2024-09-12T17:37:25.262997+0000","last_undegraded":"2024-09-12T17:37:25.262997+0000","last_fullsized":"2024-09-12T17:37:25.262997+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:58.941243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"265'279","reported_seq":850,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.311218+0000","last_change":"2024-09-12T16:58:25.732078+0000","last_active":"2024-09-12T17:41:33.311218+0000","last_peered":"2024-09-12T17:41:33.311218+0000","last_clean":"2024-09-12T17:41:33.311218+0000","last_became_active":"2024-09-12T16:58:25.730470+0000","last_became_peered":"2024-09-12T16:58:25.730470+0000","last_unstale":"2024-09-12T17:41:33.311218+0000","last_undegraded":"2024-09-12T17:41:33.311218+0000","last_fullsized":"2024-09-12T17:41:33.311218+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:12.290691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57671,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":480,"num_read_kb":1170,"num_write":398,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:37.344950+0000","last_change":"2024-09-12T16:58:27.749638+0000","last_active":"2024-09-12T17:37:37.344950+0000","last_peered":"2024-09-12T17:37:37.344950+0000","last_clean":"2024-09-12T17:37:37.344950+0000","last_became_active":"2024-09-12T16:58:27.748461+0000","last_became_peered":"2024-09-12T16:58:27.748461+0000","last_unstale":"2024-09-12T17:37:37.344950+0000","last_undegraded":"2024-09-12T17:37:37.344950+0000","last_fullsized":"2024-09-12T17:37:37.344950+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:12.377398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"265'2416","reported_seq":4248,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:13.859519+0000","last_change":"2024-09-12T16:58:29.771539+0000","last_active":"2024-09-12T17:41:13.859519+0000","last_peered":"2024-09-12T17:41:13.859519+0000","last_clean":"2024-09-12T17:41:13.859519+0000","last_became_active":"2024-09-12T16:58:29.768469+0000","last_became_peered":"2024-09-12T16:58:29.768469+0000","last_unstale":"2024-09-12T17:41:13.859519+0000","last_undegraded":"2024-09-12T17:41:13.859519+0000","last_fullsized":"2024-09-12T17:41:13.859519+0000","mapping_epoch":34,"log_start":"265'2400","ondisk_log_start":"265'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":2400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:15.157148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":849,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6073,"num_read_kb":6065,"num_write":4892,"num_write_kb":1798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"265'217","reported_seq":796,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:29.667612+0000","last_change":"2024-09-12T16:58:21.725294+0000","last_active":"2024-09-12T17:39:29.667612+0000","last_peered":"2024-09-12T17:39:29.667612+0000","last_clean":"2024-09-12T17:39:29.667612+0000","last_became_active":"2024-09-12T16:58:21.724552+0000","last_became_peered":"2024-09-12T16:58:21.724552+0000","last_unstale":"2024-09-12T17:39:29.667612+0000","last_undegraded":"2024-09-12T17:39:29.667612+0000","last_fullsized":"2024-09-12T17:39:29.667612+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:04.685886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":914,"num_read_kb":736,"num_write":337,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"265'474","reported_seq":1218,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.331651+0000","last_change":"2024-09-12T16:58:55.852901+0000","last_active":"2024-09-12T17:41:33.331651+0000","last_peered":"2024-09-12T17:41:33.331651+0000","last_clean":"2024-09-12T17:41:33.331651+0000","last_became_active":"2024-09-12T16:58:55.852305+0000","last_became_peered":"2024-09-12T16:58:55.852305+0000","last_unstale":"2024-09-12T17:41:33.331651+0000","last_undegraded":"2024-09-12T17:41:33.331651+0000","last_fullsized":"2024-09-12T17:41:33.331651+0000","mapping_epoch":37,"log_start":"265'400","ondisk_log_start":"265'400","created":23,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:46.869138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048839,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":919,"num_read_kb":12354,"num_write":1497,"num_write_kb":33200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:55.282325+0000","last_change":"2024-09-12T16:58:23.713816+0000","last_active":"2024-09-12T17:38:55.282325+0000","last_peered":"2024-09-12T17:38:55.282325+0000","last_clean":"2024-09-12T17:38:55.282325+0000","last_became_active":"2024-09-12T16:58:23.713241+0000","last_became_peered":"2024-09-12T16:58:23.713241+0000","last_unstale":"2024-09-12T17:38:55.282325+0000","last_undegraded":"2024-09-12T17:38:55.282325+0000","last_fullsized":"2024-09-12T17:38:55.282325+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:48.740741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"265'319","reported_seq":902,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.889047+0000","last_change":"2024-09-12T16:58:25.733750+0000","last_active":"2024-09-12T17:41:32.889047+0000","last_peered":"2024-09-12T17:41:32.889047+0000","last_clean":"2024-09-12T17:41:32.889047+0000","last_became_active":"2024-09-12T16:58:25.732918+0000","last_became_peered":"2024-09-12T16:58:25.732918+0000","last_unstale":"2024-09-12T17:41:32.889047+0000","last_undegraded":"2024-09-12T17:41:32.889047+0000","last_fullsized":"2024-09-12T17:41:32.889047+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:42.495838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71605,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":514,"num_read_kb":1203,"num_write":420,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"265'758","reported_seq":2460,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.458664+0000","last_change":"2024-09-12T16:58:27.737407+0000","last_active":"2024-09-12T17:41:32.458664+0000","last_peered":"2024-09-12T17:41:32.458664+0000","last_clean":"2024-09-12T17:41:32.458664+0000","last_became_active":"2024-09-12T16:58:27.736160+0000","last_became_peered":"2024-09-12T16:58:27.736160+0000","last_unstale":"2024-09-12T17:41:32.458664+0000","last_undegraded":"2024-09-12T17:41:32.458664+0000","last_fullsized":"2024-09-12T17:41:32.458664+0000","mapping_epoch":32,"log_start":"265'701","ondisk_log_start":"265'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":701,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:07.364813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"265'167","reported_seq":655,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:23.671352+0000","last_change":"2024-09-12T16:58:29.786539+0000","last_active":"2024-09-12T17:41:23.671352+0000","last_peered":"2024-09-12T17:41:23.671352+0000","last_clean":"2024-09-12T17:41:23.671352+0000","last_became_active":"2024-09-12T16:58:29.785621+0000","last_became_peered":"2024-09-12T16:58:29.785621+0000","last_unstale":"2024-09-12T17:41:23.671352+0000","last_undegraded":"2024-09-12T17:41:23.671352+0000","last_fullsized":"2024-09-12T17:41:23.671352+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:08.331708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":406,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":130,"num_read_kb":128,"num_write":373,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"265'203","reported_seq":795,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:52.359574+0000","last_change":"2024-09-12T16:58:21.702147+0000","last_active":"2024-09-12T17:38:52.359574+0000","last_peered":"2024-09-12T17:38:52.359574+0000","last_clean":"2024-09-12T17:38:52.359574+0000","last_became_active":"2024-09-12T16:58:21.701704+0000","last_became_peered":"2024-09-12T16:58:21.701704+0000","last_unstale":"2024-09-12T17:38:52.359574+0000","last_undegraded":"2024-09-12T17:38:52.359574+0000","last_fullsized":"2024-09-12T17:38:52.359574+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:12.535631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":867,"num_read_kb":717,"num_write":300,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"265'326","reported_seq":956,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.337581+0000","last_change":"2024-09-12T16:58:18.715784+0000","last_active":"2024-09-12T17:41:33.337581+0000","last_peered":"2024-09-12T17:41:33.337581+0000","last_clean":"2024-09-12T17:41:33.337581+0000","last_became_active":"2024-09-12T16:58:18.715232+0000","last_became_peered":"2024-09-12T16:58:18.715232+0000","last_unstale":"2024-09-12T17:41:33.337581+0000","last_undegraded":"2024-09-12T17:41:33.337581+0000","last_fullsized":"2024-09-12T17:41:33.337581+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:14.558882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1724025,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":468,"num_read_kb":18626,"num_write":1028,"num_write_kb":30032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:30.264112+0000","last_change":"2024-09-12T16:58:23.709304+0000","last_active":"2024-09-12T17:37:30.264112+0000","last_peered":"2024-09-12T17:37:30.264112+0000","last_clean":"2024-09-12T17:37:30.264112+0000","last_became_active":"2024-09-12T16:58:23.708641+0000","last_became_peered":"2024-09-12T16:58:23.708641+0000","last_unstale":"2024-09-12T17:37:30.264112+0000","last_undegraded":"2024-09-12T17:37:30.264112+0000","last_fullsized":"2024-09-12T17:37:30.264112+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:30.695754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"265'472","reported_seq":1099,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.962549+0000","last_change":"2024-09-12T16:58:25.729871+0000","last_active":"2024-09-12T17:41:32.962549+0000","last_peered":"2024-09-12T17:41:32.962549+0000","last_clean":"2024-09-12T17:41:32.962549+0000","last_became_active":"2024-09-12T16:58:25.729071+0000","last_became_peered":"2024-09-12T16:58:25.729071+0000","last_unstale":"2024-09-12T17:41:32.962549+0000","last_undegraded":"2024-09-12T17:41:32.962549+0000","last_fullsized":"2024-09-12T17:41:32.962549+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:44.050528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126127,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":817,"num_read_kb":2031,"num_write":670,"num_write_kb":603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:30.264053+0000","last_change":"2024-09-12T16:58:27.734880+0000","last_active":"2024-09-12T17:37:30.264053+0000","last_peered":"2024-09-12T17:37:30.264053+0000","last_clean":"2024-09-12T17:37:30.264053+0000","last_became_active":"2024-09-12T16:58:27.734078+0000","last_became_peered":"2024-09-12T16:58:27.734078+0000","last_unstale":"2024-09-12T17:37:30.264053+0000","last_undegraded":"2024-09-12T17:37:30.264053+0000","last_fullsized":"2024-09-12T17:37:30.264053+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:51.965911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"265'88","reported_seq":588,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:25.836784+0000","last_change":"2024-09-12T16:58:29.795094+0000","last_active":"2024-09-12T17:39:25.836784+0000","last_peered":"2024-09-12T17:39:25.836784+0000","last_clean":"2024-09-12T17:39:25.836784+0000","last_became_active":"2024-09-12T16:58:29.794347+0000","last_became_peered":"2024-09-12T16:58:29.794347+0000","last_unstale":"2024-09-12T17:39:25.836784+0000","last_undegraded":"2024-09-12T17:39:25.836784+0000","last_fullsized":"2024-09-12T17:39:25.836784+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:31:39.752933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":704,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":193,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"265'212","reported_seq":801,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:41.644167+0000","last_change":"2024-09-12T16:58:21.707885+0000","last_active":"2024-09-12T17:39:41.644167+0000","last_peered":"2024-09-12T17:39:41.644167+0000","last_clean":"2024-09-12T17:39:41.644167+0000","last_became_active":"2024-09-12T16:58:21.702684+0000","last_became_peered":"2024-09-12T16:58:21.702684+0000","last_unstale":"2024-09-12T17:39:41.644167+0000","last_undegraded":"2024-09-12T17:39:41.644167+0000","last_fullsized":"2024-09-12T17:39:41.644167+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:49.497498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":882,"num_read_kb":712,"num_write":314,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"265'372","reported_seq":1054,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.305645+0000","last_change":"2024-09-12T16:58:18.695913+0000","last_active":"2024-09-12T17:41:33.305645+0000","last_peered":"2024-09-12T17:41:33.305645+0000","last_clean":"2024-09-12T17:41:33.305645+0000","last_became_active":"2024-09-12T16:58:18.695549+0000","last_became_peered":"2024-09-12T16:58:18.695549+0000","last_unstale":"2024-09-12T17:41:33.305645+0000","last_undegraded":"2024-09-12T17:41:33.305645+0000","last_fullsized":"2024-09-12T17:41:33.305645+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:34:55.744463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":633,"num_read_kb":12633,"num_write":1101,"num_write_kb":15900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:55.282389+0000","last_change":"2024-09-12T16:58:23.720806+0000","last_active":"2024-09-12T17:38:55.282389+0000","last_peered":"2024-09-12T17:38:55.282389+0000","last_clean":"2024-09-12T17:38:55.282389+0000","last_became_active":"2024-09-12T16:58:23.720279+0000","last_became_peered":"2024-09-12T16:58:23.720279+0000","last_unstale":"2024-09-12T17:38:55.282389+0000","last_undegraded":"2024-09-12T17:38:55.282389+0000","last_fullsized":"2024-09-12T17:38:55.282389+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:05.351245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"265'292","reported_seq":866,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.189345+0000","last_change":"2024-09-12T16:58:25.713751+0000","last_active":"2024-09-12T17:41:32.189345+0000","last_peered":"2024-09-12T17:41:32.189345+0000","last_clean":"2024-09-12T17:41:32.189345+0000","last_became_active":"2024-09-12T16:58:25.711682+0000","last_became_peered":"2024-09-12T16:58:25.711682+0000","last_unstale":"2024-09-12T17:41:32.189345+0000","last_undegraded":"2024-09-12T17:41:32.189345+0000","last_fullsized":"2024-09-12T17:41:32.189345+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:16.044074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44554,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":521,"num_read_kb":1183,"num_write":472,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:07.363377+0000","last_change":"2024-09-12T16:58:27.752363+0000","last_active":"2024-09-12T17:39:07.363377+0000","last_peered":"2024-09-12T17:39:07.363377+0000","last_clean":"2024-09-12T17:39:07.363377+0000","last_became_active":"2024-09-12T16:58:27.751664+0000","last_became_peered":"2024-09-12T16:58:27.751664+0000","last_unstale":"2024-09-12T17:39:07.363377+0000","last_undegraded":"2024-09-12T17:39:07.363377+0000","last_fullsized":"2024-09-12T17:39:07.363377+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:48.576997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"265'126","reported_seq":626,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:42.388904+0000","last_change":"2024-09-12T16:58:29.785130+0000","last_active":"2024-09-12T17:40:42.388904+0000","last_peered":"2024-09-12T17:40:42.388904+0000","last_clean":"2024-09-12T17:40:42.388904+0000","last_became_active":"2024-09-12T16:58:29.784095+0000","last_became_peered":"2024-09-12T16:58:29.784095+0000","last_unstale":"2024-09-12T17:40:42.388904+0000","last_undegraded":"2024-09-12T17:40:42.388904+0000","last_fullsized":"2024-09-12T17:40:42.388904+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:32.305201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":487,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":177,"num_read_kb":165,"num_write":304,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"265'166","reported_seq":772,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:22.504965+0000","last_change":"2024-09-12T16:58:21.730323+0000","last_active":"2024-09-12T17:39:22.504965+0000","last_peered":"2024-09-12T17:39:22.504965+0000","last_clean":"2024-09-12T17:39:22.504965+0000","last_became_active":"2024-09-12T16:58:21.728963+0000","last_became_peered":"2024-09-12T16:58:21.728963+0000","last_unstale":"2024-09-12T17:39:22.504965+0000","last_undegraded":"2024-09-12T17:39:22.504965+0000","last_fullsized":"2024-09-12T17:39:22.504965+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:54.629377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":751,"num_read_kb":615,"num_write":255,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"265'340","reported_seq":1008,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.316959+0000","last_change":"2024-09-12T16:58:18.709400+0000","last_active":"2024-09-12T17:41:33.316959+0000","last_peered":"2024-09-12T17:41:33.316959+0000","last_clean":"2024-09-12T17:41:33.316959+0000","last_became_active":"2024-09-12T16:58:18.708689+0000","last_became_peered":"2024-09-12T16:58:18.708689+0000","last_unstale":"2024-09-12T17:41:33.316959+0000","last_undegraded":"2024-09-12T17:41:33.316959+0000","last_fullsized":"2024-09-12T17:41:33.316959+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:03.022185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":505,"num_read_kb":124256,"num_write":1133,"num_write_kb":36504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:58.706576+0000","last_change":"2024-09-12T16:58:23.709600+0000","last_active":"2024-09-12T17:38:58.706576+0000","last_peered":"2024-09-12T17:38:58.706576+0000","last_clean":"2024-09-12T17:38:58.706576+0000","last_became_active":"2024-09-12T16:58:23.709099+0000","last_became_peered":"2024-09-12T16:58:23.709099+0000","last_unstale":"2024-09-12T17:38:58.706576+0000","last_undegraded":"2024-09-12T17:38:58.706576+0000","last_fullsized":"2024-09-12T17:38:58.706576+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:40.419144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"265'278","reported_seq":862,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.200360+0000","last_change":"2024-09-12T16:58:25.724609+0000","last_active":"2024-09-12T17:41:33.200360+0000","last_peered":"2024-09-12T17:41:33.200360+0000","last_clean":"2024-09-12T17:41:33.200360+0000","last_became_active":"2024-09-12T16:58:25.723894+0000","last_became_peered":"2024-09-12T16:58:25.723894+0000","last_unstale":"2024-09-12T17:41:33.200360+0000","last_undegraded":"2024-09-12T17:41:33.200360+0000","last_fullsized":"2024-09-12T17:41:33.200360+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:02.360836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60644,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":457,"num_read_kb":1010,"num_write":360,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"265'727","reported_seq":2348,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:31.885082+0000","last_change":"2024-09-12T16:58:27.754030+0000","last_active":"2024-09-12T17:41:31.885082+0000","last_peered":"2024-09-12T17:41:31.885082+0000","last_clean":"2024-09-12T17:41:31.885082+0000","last_became_active":"2024-09-12T16:58:27.753179+0000","last_became_peered":"2024-09-12T16:58:27.753179+0000","last_unstale":"2024-09-12T17:41:31.885082+0000","last_undegraded":"2024-09-12T17:41:31.885082+0000","last_fullsized":"2024-09-12T17:41:31.885082+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":700,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:00.243547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"265'139","reported_seq":662,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:23.672296+0000","last_change":"2024-09-12T16:58:29.779572+0000","last_active":"2024-09-12T17:41:23.672296+0000","last_peered":"2024-09-12T17:41:23.672296+0000","last_clean":"2024-09-12T17:41:23.672296+0000","last_became_active":"2024-09-12T16:58:29.778839+0000","last_became_peered":"2024-09-12T16:58:29.778839+0000","last_unstale":"2024-09-12T17:41:23.672296+0000","last_undegraded":"2024-09-12T17:41:23.672296+0000","last_fullsized":"2024-09-12T17:41:23.672296+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:04.060160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":288,"num_read_kb":252,"num_write":342,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"265'188","reported_seq":776,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:51.289772+0000","last_change":"2024-09-12T16:58:21.707767+0000","last_active":"2024-09-12T17:38:51.289772+0000","last_peered":"2024-09-12T17:38:51.289772+0000","last_clean":"2024-09-12T17:38:51.289772+0000","last_became_active":"2024-09-12T16:58:21.706953+0000","last_became_peered":"2024-09-12T16:58:21.706953+0000","last_unstale":"2024-09-12T17:38:51.289772+0000","last_undegraded":"2024-09-12T17:38:51.289772+0000","last_fullsized":"2024-09-12T17:38:51.289772+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:00.611915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":782,"num_read_kb":644,"num_write":280,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"265'319","reported_seq":953,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.323618+0000","last_change":"2024-09-12T16:58:18.693726+0000","last_active":"2024-09-12T17:41:33.323618+0000","last_peered":"2024-09-12T17:41:33.323618+0000","last_clean":"2024-09-12T17:41:33.323618+0000","last_became_active":"2024-09-12T16:58:18.686189+0000","last_became_peered":"2024-09-12T16:58:18.686189+0000","last_unstale":"2024-09-12T17:41:33.323618+0000","last_undegraded":"2024-09-12T17:41:33.323618+0000","last_fullsized":"2024-09-12T17:41:33.323618+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:38.741983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":508,"num_read_kb":6575,"num_write":1048,"num_write_kb":19619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1454,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:31.424308+0000","last_change":"2024-09-12T16:58:23.707182+0000","last_active":"2024-09-12T17:41:31.424308+0000","last_peered":"2024-09-12T17:41:31.424308+0000","last_clean":"2024-09-12T17:41:31.424308+0000","last_became_active":"2024-09-12T16:58:23.706471+0000","last_became_peered":"2024-09-12T16:58:23.706471+0000","last_unstale":"2024-09-12T17:41:31.424308+0000","last_undegraded":"2024-09-12T17:41:31.424308+0000","last_fullsized":"2024-09-12T17:41:31.424308+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:02.525244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":956,"num_read_kb":956,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"265'78","reported_seq":598,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:26.200090+0000","last_change":"2024-09-12T16:58:25.950921+0000","last_active":"2024-09-12T17:39:26.200090+0000","last_peered":"2024-09-12T17:39:26.200090+0000","last_clean":"2024-09-12T17:39:26.200090+0000","last_became_active":"2024-09-12T16:58:25.949962+0000","last_became_peered":"2024-09-12T16:58:25.949962+0000","last_unstale":"2024-09-12T17:39:26.200090+0000","last_undegraded":"2024-09-12T17:39:26.200090+0000","last_fullsized":"2024-09-12T17:39:26.200090+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:35.151455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"265'758","reported_seq":4006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.979756+0000","last_change":"2024-09-12T16:58:27.756362+0000","last_active":"2024-09-12T17:41:32.979756+0000","last_peered":"2024-09-12T17:41:32.979756+0000","last_clean":"2024-09-12T17:41:32.979756+0000","last_became_active":"2024-09-12T16:58:27.755569+0000","last_became_peered":"2024-09-12T16:58:27.755569+0000","last_unstale":"2024-09-12T17:41:32.979756+0000","last_undegraded":"2024-09-12T17:41:32.979756+0000","last_fullsized":"2024-09-12T17:41:32.979756+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":700,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:36.568674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"265'116","reported_seq":624,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:24.000291+0000","last_change":"2024-09-12T16:58:29.781541+0000","last_active":"2024-09-12T17:39:24.000291+0000","last_peered":"2024-09-12T17:39:24.000291+0000","last_clean":"2024-09-12T17:39:24.000291+0000","last_became_active":"2024-09-12T16:58:29.780289+0000","last_became_peered":"2024-09-12T16:58:29.780289+0000","last_unstale":"2024-09-12T17:39:24.000291+0000","last_undegraded":"2024-09-12T17:39:24.000291+0000","last_fullsized":"2024-09-12T17:39:24.000291+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:45.266710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":175,"num_write":267,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"265'140","reported_seq":797,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:32.931293+0000","last_change":"2024-09-12T16:58:21.720633+0000","last_active":"2024-09-12T17:39:32.931293+0000","last_peered":"2024-09-12T17:39:32.931293+0000","last_clean":"2024-09-12T17:39:32.931293+0000","last_became_active":"2024-09-12T16:58:21.719827+0000","last_became_peered":"2024-09-12T16:58:21.719827+0000","last_unstale":"2024-09-12T17:39:32.931293+0000","last_undegraded":"2024-09-12T17:39:32.931293+0000","last_fullsized":"2024-09-12T17:39:32.931293+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:57.062320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":689,"num_read_kb":590,"num_write":204,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"265'327","reported_seq":973,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.295582+0000","last_change":"2024-09-12T16:58:18.705680+0000","last_active":"2024-09-12T17:41:33.295582+0000","last_peered":"2024-09-12T17:41:33.295582+0000","last_clean":"2024-09-12T17:41:33.295582+0000","last_became_active":"2024-09-12T16:58:18.705048+0000","last_became_peered":"2024-09-12T16:58:18.705048+0000","last_unstale":"2024-09-12T17:41:33.295582+0000","last_undegraded":"2024-09-12T17:41:33.295582+0000","last_fullsized":"2024-09-12T17:41:33.295582+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:04.638122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2227678,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":497,"num_read_kb":3392,"num_write":1050,"num_write_kb":22669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"36'5","reported_seq":979,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:31.408893+0000","last_change":"2024-09-12T16:58:23.703535+0000","last_active":"2024-09-12T17:41:31.408893+0000","last_peered":"2024-09-12T17:41:31.408893+0000","last_clean":"2024-09-12T17:41:31.408893+0000","last_became_active":"2024-09-12T16:58:23.702699+0000","last_became_peered":"2024-09-12T16:58:23.702699+0000","last_unstale":"2024-09-12T17:41:31.408893+0000","last_undegraded":"2024-09-12T17:41:31.408893+0000","last_fullsized":"2024-09-12T17:41:31.408893+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:52.474180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":729,"num_read_kb":1194,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"265'344","reported_seq":948,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.687313+0000","last_change":"2024-09-12T16:58:25.725360+0000","last_active":"2024-09-12T17:41:32.687313+0000","last_peered":"2024-09-12T17:41:32.687313+0000","last_clean":"2024-09-12T17:41:32.687313+0000","last_became_active":"2024-09-12T16:58:25.724694+0000","last_became_peered":"2024-09-12T16:58:25.724694+0000","last_unstale":"2024-09-12T17:41:32.687313+0000","last_undegraded":"2024-09-12T17:41:32.687313+0000","last_fullsized":"2024-09-12T17:41:32.687313+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:22.997913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52076,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":562,"num_read_kb":1199,"num_write":444,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:01.307379+0000","last_change":"2024-09-12T16:58:27.741238+0000","last_active":"2024-09-12T17:39:01.307379+0000","last_peered":"2024-09-12T17:39:01.307379+0000","last_clean":"2024-09-12T17:39:01.307379+0000","last_became_active":"2024-09-12T16:58:27.740510+0000","last_became_peered":"2024-09-12T16:58:27.740510+0000","last_unstale":"2024-09-12T17:39:01.307379+0000","last_undegraded":"2024-09-12T17:39:01.307379+0000","last_fullsized":"2024-09-12T17:39:01.307379+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:22.805172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"265'127","reported_seq":619,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:03.172275+0000","last_change":"2024-09-12T16:58:29.776743+0000","last_active":"2024-09-12T17:40:03.172275+0000","last_peered":"2024-09-12T17:40:03.172275+0000","last_clean":"2024-09-12T17:40:03.172275+0000","last_became_active":"2024-09-12T16:58:29.776007+0000","last_became_peered":"2024-09-12T16:58:29.776007+0000","last_unstale":"2024-09-12T17:40:03.172275+0000","last_undegraded":"2024-09-12T17:40:03.172275+0000","last_fullsized":"2024-09-12T17:40:03.172275+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:10.538331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":162,"num_read_kb":158,"num_write":308,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"265'143","reported_seq":755,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:26.457471+0000","last_change":"2024-09-12T16:58:21.726965+0000","last_active":"2024-09-12T17:39:26.457471+0000","last_peered":"2024-09-12T17:39:26.457471+0000","last_clean":"2024-09-12T17:39:26.457471+0000","last_became_active":"2024-09-12T16:58:21.726160+0000","last_became_peered":"2024-09-12T16:58:21.726160+0000","last_unstale":"2024-09-12T17:39:26.457471+0000","last_undegraded":"2024-09-12T17:39:26.457471+0000","last_fullsized":"2024-09-12T17:39:26.457471+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:57.204197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":643,"num_read_kb":537,"num_write":216,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":612,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:16.305011+0000","last_change":"2024-09-12T16:58:04.218615+0000","last_active":"2024-09-12T17:38:16.305011+0000","last_peered":"2024-09-12T17:38:16.305011+0000","last_clean":"2024-09-12T17:38:16.305011+0000","last_became_active":"2024-09-12T16:58:04.216387+0000","last_became_peered":"2024-09-12T16:58:04.216387+0000","last_unstale":"2024-09-12T17:38:16.305011+0000","last_undegraded":"2024-09-12T17:38:16.305011+0000","last_fullsized":"2024-09-12T17:38:16.305011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:02.482619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:02.482619+0000","last_clean_scrub_stamp":"2024-09-12T16:58:02.482619+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:20.111220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":521,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:47.329290+0000","last_change":"2024-09-12T16:58:10.535498+0000","last_active":"2024-09-12T17:37:47.329290+0000","last_peered":"2024-09-12T17:37:47.329290+0000","last_clean":"2024-09-12T17:37:47.329290+0000","last_became_active":"2024-09-12T16:58:08.538227+0000","last_became_peered":"2024-09-12T16:58:08.538227+0000","last_unstale":"2024-09-12T17:37:47.329290+0000","last_undegraded":"2024-09-12T17:37:47.329290+0000","last_fullsized":"2024-09-12T17:37:47.329290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_clean_scrub_stamp":"2024-09-12T16:58:07.519706+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:36.699923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001171044,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"265'358","reported_seq":984,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.334660+0000","last_change":"2024-09-12T16:58:55.958137+0000","last_active":"2024-09-12T17:41:33.334660+0000","last_peered":"2024-09-12T17:41:33.334660+0000","last_clean":"2024-09-12T17:41:33.334660+0000","last_became_active":"2024-09-12T16:58:55.957231+0000","last_became_peered":"2024-09-12T16:58:55.957231+0000","last_unstale":"2024-09-12T17:41:33.334660+0000","last_undegraded":"2024-09-12T17:41:33.334660+0000","last_fullsized":"2024-09-12T17:41:33.334660+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:39.817907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159822,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":551,"num_read_kb":44871,"num_write":1125,"num_write_kb":45418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"36'3","reported_seq":979,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:31.411309+0000","last_change":"2024-09-12T16:58:23.719701+0000","last_active":"2024-09-12T17:41:31.411309+0000","last_peered":"2024-09-12T17:41:31.411309+0000","last_clean":"2024-09-12T17:41:31.411309+0000","last_became_active":"2024-09-12T16:58:23.718720+0000","last_became_peered":"2024-09-12T16:58:23.718720+0000","last_unstale":"2024-09-12T17:41:31.411309+0000","last_undegraded":"2024-09-12T17:41:31.411309+0000","last_fullsized":"2024-09-12T17:41:31.411309+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:27.937180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":725,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"265'688","reported_seq":1389,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.128254+0000","last_change":"2024-09-12T16:58:25.721421+0000","last_active":"2024-09-12T17:41:33.128254+0000","last_peered":"2024-09-12T17:41:33.128254+0000","last_clean":"2024-09-12T17:41:33.128254+0000","last_became_active":"2024-09-12T16:58:25.720741+0000","last_became_peered":"2024-09-12T16:58:25.720741+0000","last_unstale":"2024-09-12T17:41:33.128254+0000","last_undegraded":"2024-09-12T17:41:33.128254+0000","last_fullsized":"2024-09-12T17:41:33.128254+0000","mapping_epoch":30,"log_start":"265'600","ondisk_log_start":"265'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":600,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:58.053661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142315,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1357,"num_read_kb":3135,"num_write":1250,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:27.339048+0000","last_change":"2024-09-12T16:58:27.746911+0000","last_active":"2024-09-12T17:37:27.339048+0000","last_peered":"2024-09-12T17:37:27.339048+0000","last_clean":"2024-09-12T17:37:27.339048+0000","last_became_active":"2024-09-12T16:58:27.746171+0000","last_became_peered":"2024-09-12T16:58:27.746171+0000","last_unstale":"2024-09-12T17:37:27.339048+0000","last_undegraded":"2024-09-12T17:37:27.339048+0000","last_fullsized":"2024-09-12T17:37:27.339048+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:24:35.029842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"265'209","reported_seq":915,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:03.864055+0000","last_change":"2024-09-12T16:58:29.769292+0000","last_active":"2024-09-12T17:40:03.864055+0000","last_peered":"2024-09-12T17:40:03.864055+0000","last_clean":"2024-09-12T17:40:03.864055+0000","last_became_active":"2024-09-12T16:58:29.768536+0000","last_became_peered":"2024-09-12T16:58:29.768536+0000","last_unstale":"2024-09-12T17:40:03.864055+0000","last_undegraded":"2024-09-12T17:40:03.864055+0000","last_fullsized":"2024-09-12T17:40:03.864055+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:00.483017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":520,"num_read_kb":510,"num_write":443,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"265'70","reported_seq":624,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:01.041564+0000","last_change":"2024-09-12T16:58:21.724410+0000","last_active":"2024-09-12T17:40:01.041564+0000","last_peered":"2024-09-12T17:40:01.041564+0000","last_clean":"2024-09-12T17:40:01.041564+0000","last_became_active":"2024-09-12T16:58:21.723703+0000","last_became_peered":"2024-09-12T16:58:21.723703+0000","last_unstale":"2024-09-12T17:40:01.041564+0000","last_undegraded":"2024-09-12T17:40:01.041564+0000","last_fullsized":"2024-09-12T17:40:01.041564+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:47.327553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":317,"num_read_kb":265,"num_write":106,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":521,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:21.306154+0000","last_change":"2024-09-12T16:58:10.928592+0000","last_active":"2024-09-12T17:38:21.306154+0000","last_peered":"2024-09-12T17:38:21.306154+0000","last_clean":"2024-09-12T17:38:21.306154+0000","last_became_active":"2024-09-12T16:58:08.536415+0000","last_became_peered":"2024-09-12T16:58:08.536415+0000","last_unstale":"2024-09-12T17:38:21.306154+0000","last_undegraded":"2024-09-12T17:38:21.306154+0000","last_fullsized":"2024-09-12T17:38:21.306154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_clean_scrub_stamp":"2024-09-12T16:58:07.519706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:44.873424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001332909,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"265'323","reported_seq":969,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.324224+0000","last_change":"2024-09-12T16:58:18.696403+0000","last_active":"2024-09-12T17:41:33.324224+0000","last_peered":"2024-09-12T17:41:33.324224+0000","last_clean":"2024-09-12T17:41:33.324224+0000","last_became_active":"2024-09-12T16:58:18.695755+0000","last_became_peered":"2024-09-12T16:58:18.695755+0000","last_unstale":"2024-09-12T17:41:33.324224+0000","last_undegraded":"2024-09-12T17:41:33.324224+0000","last_fullsized":"2024-09-12T17:41:33.324224+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:56.681369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399184,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":538,"num_read_kb":2859,"num_write":1066,"num_write_kb":24939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:27.324815+0000","last_change":"2024-09-12T16:58:23.713076+0000","last_active":"2024-09-12T17:37:27.324815+0000","last_peered":"2024-09-12T17:37:27.324815+0000","last_clean":"2024-09-12T17:37:27.324815+0000","last_became_active":"2024-09-12T16:58:23.712354+0000","last_became_peered":"2024-09-12T16:58:23.712354+0000","last_unstale":"2024-09-12T17:37:27.324815+0000","last_undegraded":"2024-09-12T17:37:27.324815+0000","last_fullsized":"2024-09-12T17:37:27.324815+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:23.368180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"265'1250","reported_seq":2707,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.353991+0000","last_change":"2024-09-12T16:58:25.721009+0000","last_active":"2024-09-12T17:41:33.353991+0000","last_peered":"2024-09-12T17:41:33.353991+0000","last_clean":"2024-09-12T17:41:33.353991+0000","last_became_active":"2024-09-12T16:58:25.720266+0000","last_became_peered":"2024-09-12T16:58:25.720266+0000","last_unstale":"2024-09-12T17:41:33.353991+0000","last_undegraded":"2024-09-12T17:41:33.353991+0000","last_fullsized":"2024-09-12T17:41:33.353991+0000","mapping_epoch":30,"log_start":"265'1200","ondisk_log_start":"265'1200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":1200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:01.087152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150793,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2049,"num_read_kb":3938,"num_write":1140,"num_write_kb":988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:16.305184+0000","last_change":"2024-09-12T16:58:27.746109+0000","last_active":"2024-09-12T17:38:16.305184+0000","last_peered":"2024-09-12T17:38:16.305184+0000","last_clean":"2024-09-12T17:38:16.305184+0000","last_became_active":"2024-09-12T16:58:27.745341+0000","last_became_peered":"2024-09-12T16:58:27.745341+0000","last_unstale":"2024-09-12T17:38:16.305184+0000","last_undegraded":"2024-09-12T17:38:16.305184+0000","last_fullsized":"2024-09-12T17:38:16.305184+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:12.798309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"265'209","reported_seq":724,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:45.564670+0000","last_change":"2024-09-12T16:58:29.776726+0000","last_active":"2024-09-12T17:39:45.564670+0000","last_peered":"2024-09-12T17:39:45.564670+0000","last_clean":"2024-09-12T17:39:45.564670+0000","last_became_active":"2024-09-12T16:58:29.775944+0000","last_became_peered":"2024-09-12T16:58:29.775944+0000","last_unstale":"2024-09-12T17:39:45.564670+0000","last_undegraded":"2024-09-12T17:39:45.564670+0000","last_fullsized":"2024-09-12T17:39:45.564670+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:58.956084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":347,"num_read_kb":347,"num_write":464,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"265'122","reported_seq":674,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:23.685021+0000","last_change":"2024-09-12T16:58:21.722030+0000","last_active":"2024-09-12T17:37:23.685021+0000","last_peered":"2024-09-12T17:37:23.685021+0000","last_clean":"2024-09-12T17:37:23.685021+0000","last_became_active":"2024-09-12T16:58:21.721591+0000","last_became_peered":"2024-09-12T16:58:21.721591+0000","last_unstale":"2024-09-12T17:37:23.685021+0000","last_undegraded":"2024-09-12T17:37:23.685021+0000","last_fullsized":"2024-09-12T17:37:23.685021+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:36.430469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":495,"num_read_kb":400,"num_write":173,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":521,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:45.267241+0000","last_change":"2024-09-12T16:58:10.591264+0000","last_active":"2024-09-12T17:37:45.267241+0000","last_peered":"2024-09-12T17:37:45.267241+0000","last_clean":"2024-09-12T17:37:45.267241+0000","last_became_active":"2024-09-12T16:58:08.534076+0000","last_became_peered":"2024-09-12T16:58:08.534076+0000","last_unstale":"2024-09-12T17:37:45.267241+0000","last_undegraded":"2024-09-12T17:37:45.267241+0000","last_fullsized":"2024-09-12T17:37:45.267241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_clean_scrub_stamp":"2024-09-12T16:58:07.519706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:08.414186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083305900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"265'316","reported_seq":945,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:38.395383+0000","last_change":"2024-09-12T17:41:38.395383+0000","last_active":"2024-09-12T17:41:38.395383+0000","last_peered":"2024-09-12T17:41:38.395383+0000","last_clean":"2024-09-12T17:41:38.395383+0000","last_became_active":"2024-09-12T16:58:18.702490+0000","last_became_peered":"2024-09-12T16:58:18.702490+0000","last_unstale":"2024-09-12T17:41:38.395383+0000","last_undegraded":"2024-09-12T17:41:38.395383+0000","last_fullsized":"2024-09-12T17:41:38.395383+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'316","last_scrub_stamp":"2024-09-12T17:41:38.395252+0000","last_deep_scrub":"265'316","last_deep_scrub_stamp":"2024-09-12T17:41:38.395252+0000","last_clean_scrub_stamp":"2024-09-12T17:41:38.395252+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:23.910993+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263185,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":455,"num_read_kb":7668,"num_write":1054,"num_write_kb":10637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:25.263146+0000","last_change":"2024-09-12T16:58:23.724826+0000","last_active":"2024-09-12T17:37:25.263146+0000","last_peered":"2024-09-12T17:37:25.263146+0000","last_clean":"2024-09-12T17:37:25.263146+0000","last_became_active":"2024-09-12T16:58:23.724300+0000","last_became_peered":"2024-09-12T16:58:23.724300+0000","last_unstale":"2024-09-12T17:37:25.263146+0000","last_undegraded":"2024-09-12T17:37:25.263146+0000","last_fullsized":"2024-09-12T17:37:25.263146+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:36.764896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"265'230","reported_seq":1294,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:20.111355+0000","last_change":"2024-09-12T16:58:25.949888+0000","last_active":"2024-09-12T17:41:20.111355+0000","last_peered":"2024-09-12T17:41:20.111355+0000","last_clean":"2024-09-12T17:41:20.111355+0000","last_became_active":"2024-09-12T16:58:25.949120+0000","last_became_peered":"2024-09-12T16:58:25.949120+0000","last_unstale":"2024-09-12T17:41:20.111355+0000","last_undegraded":"2024-09-12T17:41:20.111355+0000","last_fullsized":"2024-09-12T17:41:20.111355+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:25.274870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":178,"num_read_kb":168,"num_write":143,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:02.347062+0000","last_change":"2024-09-12T16:58:27.736961+0000","last_active":"2024-09-12T17:38:02.347062+0000","last_peered":"2024-09-12T17:38:02.347062+0000","last_clean":"2024-09-12T17:38:02.347062+0000","last_became_active":"2024-09-12T16:58:27.736215+0000","last_became_peered":"2024-09-12T16:58:27.736215+0000","last_unstale":"2024-09-12T17:38:02.347062+0000","last_undegraded":"2024-09-12T17:38:02.347062+0000","last_fullsized":"2024-09-12T17:38:02.347062+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:39.723240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"265'249","reported_seq":855,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:05.168772+0000","last_change":"2024-09-12T16:58:29.792850+0000","last_active":"2024-09-12T17:40:05.168772+0000","last_peered":"2024-09-12T17:40:05.168772+0000","last_clean":"2024-09-12T17:40:05.168772+0000","last_became_active":"2024-09-12T16:58:29.792069+0000","last_became_peered":"2024-09-12T16:58:29.792069+0000","last_unstale":"2024-09-12T17:40:05.168772+0000","last_undegraded":"2024-09-12T17:40:05.168772+0000","last_fullsized":"2024-09-12T17:40:05.168772+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:03.093750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1041,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":529,"num_read_kb":546,"num_write":531,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"265'182","reported_seq":838,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:55.411179+0000","last_change":"2024-09-12T16:58:21.730485+0000","last_active":"2024-09-12T17:38:55.411179+0000","last_peered":"2024-09-12T17:38:55.411179+0000","last_clean":"2024-09-12T17:38:55.411179+0000","last_became_active":"2024-09-12T16:58:21.729848+0000","last_became_peered":"2024-09-12T16:58:21.729848+0000","last_unstale":"2024-09-12T17:38:55.411179+0000","last_undegraded":"2024-09-12T17:38:55.411179+0000","last_fullsized":"2024-09-12T17:38:55.411179+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:36.732505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":860,"num_read_kb":722,"num_write":267,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:47.329231+0000","last_change":"2024-09-12T16:58:10.535375+0000","last_active":"2024-09-12T17:37:47.329231+0000","last_peered":"2024-09-12T17:37:47.329231+0000","last_clean":"2024-09-12T17:37:47.329231+0000","last_became_active":"2024-09-12T16:58:08.538078+0000","last_became_peered":"2024-09-12T16:58:08.538078+0000","last_unstale":"2024-09-12T17:37:47.329231+0000","last_undegraded":"2024-09-12T17:37:47.329231+0000","last_fullsized":"2024-09-12T17:37:47.329231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_clean_scrub_stamp":"2024-09-12T16:58:07.519706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:19.309437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012028640000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"265'362","reported_seq":1073,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.327154+0000","last_change":"2024-09-12T16:58:18.694335+0000","last_active":"2024-09-12T17:41:33.327154+0000","last_peered":"2024-09-12T17:41:33.327154+0000","last_clean":"2024-09-12T17:41:33.327154+0000","last_became_active":"2024-09-12T16:58:18.690974+0000","last_became_peered":"2024-09-12T16:58:18.690974+0000","last_unstale":"2024-09-12T17:41:33.327154+0000","last_undegraded":"2024-09-12T17:41:33.327154+0000","last_fullsized":"2024-09-12T17:41:33.327154+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:48.350096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1105801,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":657,"num_read_kb":31815,"num_write":1139,"num_write_kb":57340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:12.349471+0000","last_change":"2024-09-12T16:58:23.713734+0000","last_active":"2024-09-12T17:38:12.349471+0000","last_peered":"2024-09-12T17:38:12.349471+0000","last_clean":"2024-09-12T17:38:12.349471+0000","last_became_active":"2024-09-12T16:58:23.713019+0000","last_became_peered":"2024-09-12T16:58:23.713019+0000","last_unstale":"2024-09-12T17:38:12.349471+0000","last_undegraded":"2024-09-12T17:38:12.349471+0000","last_fullsized":"2024-09-12T17:38:12.349471+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:50.721387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"265'106","reported_seq":647,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:37.374180+0000","last_change":"2024-09-12T16:58:25.719093+0000","last_active":"2024-09-12T17:39:37.374180+0000","last_peered":"2024-09-12T17:39:37.374180+0000","last_clean":"2024-09-12T17:39:37.374180+0000","last_became_active":"2024-09-12T16:58:25.718364+0000","last_became_peered":"2024-09-12T16:58:25.718364+0000","last_unstale":"2024-09-12T17:39:37.374180+0000","last_undegraded":"2024-09-12T17:39:37.374180+0000","last_fullsized":"2024-09-12T17:39:37.374180+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:32.974861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":134,"num_write":100,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:31.287928+0000","last_change":"2024-09-12T16:58:27.762825+0000","last_active":"2024-09-12T17:37:31.287928+0000","last_peered":"2024-09-12T17:37:31.287928+0000","last_clean":"2024-09-12T17:37:31.287928+0000","last_became_active":"2024-09-12T16:58:27.761992+0000","last_became_peered":"2024-09-12T16:58:27.761992+0000","last_unstale":"2024-09-12T17:37:31.287928+0000","last_undegraded":"2024-09-12T17:37:31.287928+0000","last_fullsized":"2024-09-12T17:37:31.287928+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:59:01.991644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"265'110","reported_seq":663,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:45.784115+0000","last_change":"2024-09-12T16:58:29.788605+0000","last_active":"2024-09-12T17:39:45.784115+0000","last_peered":"2024-09-12T17:39:45.784115+0000","last_clean":"2024-09-12T17:39:45.784115+0000","last_became_active":"2024-09-12T16:58:29.787823+0000","last_became_peered":"2024-09-12T16:58:29.787823+0000","last_unstale":"2024-09-12T17:39:45.784115+0000","last_undegraded":"2024-09-12T17:39:45.784115+0000","last_fullsized":"2024-09-12T17:39:45.784115+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:40.857819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":275,"num_read_kb":264,"num_write":276,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"265'60","reported_seq":613,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:45.856557+0000","last_change":"2024-09-12T16:58:21.722318+0000","last_active":"2024-09-12T17:38:45.856557+0000","last_peered":"2024-09-12T17:38:45.856557+0000","last_clean":"2024-09-12T17:38:45.856557+0000","last_became_active":"2024-09-12T16:58:21.720884+0000","last_became_peered":"2024-09-12T16:58:21.720884+0000","last_unstale":"2024-09-12T17:38:45.856557+0000","last_undegraded":"2024-09-12T17:38:45.856557+0000","last_fullsized":"2024-09-12T17:38:45.856557+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:32.526744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":223,"num_write":91,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"265'376","reported_seq":1022,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.330121+0000","last_change":"2024-09-12T16:58:18.719301+0000","last_active":"2024-09-12T17:41:33.330121+0000","last_peered":"2024-09-12T17:41:33.330121+0000","last_clean":"2024-09-12T17:41:33.330121+0000","last_became_active":"2024-09-12T16:58:18.718447+0000","last_became_peered":"2024-09-12T16:58:18.718447+0000","last_unstale":"2024-09-12T17:41:33.330121+0000","last_undegraded":"2024-09-12T17:41:33.330121+0000","last_fullsized":"2024-09-12T17:41:33.330121+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:48.031054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569509,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":515,"num_read_kb":35874,"num_write":1210,"num_write_kb":51856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":520,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:48.690429+0000","last_change":"2024-09-12T16:58:10.542079+0000","last_active":"2024-09-12T17:37:48.690429+0000","last_peered":"2024-09-12T17:37:48.690429+0000","last_clean":"2024-09-12T17:37:48.690429+0000","last_became_active":"2024-09-12T16:58:08.842793+0000","last_became_peered":"2024-09-12T16:58:08.842793+0000","last_unstale":"2024-09-12T17:37:48.690429+0000","last_undegraded":"2024-09-12T17:37:48.690429+0000","last_fullsized":"2024-09-12T17:37:48.690429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_clean_scrub_stamp":"2024-09-12T16:58:07.519706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:21.164130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001121181,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:02.347021+0000","last_change":"2024-09-12T16:58:23.712397+0000","last_active":"2024-09-12T17:38:02.347021+0000","last_peered":"2024-09-12T17:38:02.347021+0000","last_clean":"2024-09-12T17:38:02.347021+0000","last_became_active":"2024-09-12T16:58:23.710355+0000","last_became_peered":"2024-09-12T16:58:23.710355+0000","last_unstale":"2024-09-12T17:38:02.347021+0000","last_undegraded":"2024-09-12T17:38:02.347021+0000","last_fullsized":"2024-09-12T17:38:02.347021+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:49.303296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"265'570","reported_seq":1230,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.165906+0000","last_change":"2024-09-12T16:58:25.731056+0000","last_active":"2024-09-12T17:41:33.165906+0000","last_peered":"2024-09-12T17:41:33.165906+0000","last_clean":"2024-09-12T17:41:33.165906+0000","last_became_active":"2024-09-12T16:58:25.729627+0000","last_became_peered":"2024-09-12T16:58:25.729627+0000","last_unstale":"2024-09-12T17:41:33.165906+0000","last_undegraded":"2024-09-12T17:41:33.165906+0000","last_fullsized":"2024-09-12T17:41:33.165906+0000","mapping_epoch":30,"log_start":"265'500","ondisk_log_start":"265'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":500,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:16.481975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101207,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1575,"num_read_kb":2772,"num_write":2032,"num_write_kb":1870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:06.279604+0000","last_change":"2024-09-12T16:58:27.734028+0000","last_active":"2024-09-12T17:38:06.279604+0000","last_peered":"2024-09-12T17:38:06.279604+0000","last_clean":"2024-09-12T17:38:06.279604+0000","last_became_active":"2024-09-12T16:58:27.733289+0000","last_became_peered":"2024-09-12T16:58:27.733289+0000","last_unstale":"2024-09-12T17:38:06.279604+0000","last_undegraded":"2024-09-12T17:38:06.279604+0000","last_fullsized":"2024-09-12T17:38:06.279604+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:05.333134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"265'157","reported_seq":661,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:44.925507+0000","last_change":"2024-09-12T16:58:29.779788+0000","last_active":"2024-09-12T17:39:44.925507+0000","last_peered":"2024-09-12T17:39:44.925507+0000","last_clean":"2024-09-12T17:39:44.925507+0000","last_became_active":"2024-09-12T16:58:29.779052+0000","last_became_peered":"2024-09-12T16:58:29.779052+0000","last_unstale":"2024-09-12T17:39:44.925507+0000","last_undegraded":"2024-09-12T17:39:44.925507+0000","last_fullsized":"2024-09-12T17:39:44.925507+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:46.799747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":199,"num_read_kb":192,"num_write":361,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"265'202","reported_seq":806,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:57.345814+0000","last_change":"2024-09-12T16:58:21.702417+0000","last_active":"2024-09-12T17:37:57.345814+0000","last_peered":"2024-09-12T17:37:57.345814+0000","last_clean":"2024-09-12T17:37:57.345814+0000","last_became_active":"2024-09-12T16:58:21.701657+0000","last_became_peered":"2024-09-12T16:58:21.701657+0000","last_unstale":"2024-09-12T17:37:57.345814+0000","last_undegraded":"2024-09-12T17:37:57.345814+0000","last_fullsized":"2024-09-12T17:37:57.345814+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:39.768733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":888,"num_read_kb":728,"num_write":297,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"265'330","reported_seq":954,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.294376+0000","last_change":"2024-09-12T16:58:18.700995+0000","last_active":"2024-09-12T17:41:33.294376+0000","last_peered":"2024-09-12T17:41:33.294376+0000","last_clean":"2024-09-12T17:41:33.294376+0000","last_became_active":"2024-09-12T16:58:18.698417+0000","last_became_peered":"2024-09-12T16:58:18.698417+0000","last_unstale":"2024-09-12T17:41:33.294376+0000","last_undegraded":"2024-09-12T17:41:33.294376+0000","last_fullsized":"2024-09-12T17:41:33.294376+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:21:09.942403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":462,"num_read_kb":2498,"num_write":998,"num_write_kb":19196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":520,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:56.300230+0000","last_change":"2024-09-12T16:58:10.928593+0000","last_active":"2024-09-12T17:37:56.300230+0000","last_peered":"2024-09-12T17:37:56.300230+0000","last_clean":"2024-09-12T17:37:56.300230+0000","last_became_active":"2024-09-12T16:58:08.841831+0000","last_became_peered":"2024-09-12T16:58:08.841831+0000","last_unstale":"2024-09-12T17:37:56.300230+0000","last_undegraded":"2024-09-12T17:37:56.300230+0000","last_fullsized":"2024-09-12T17:37:56.300230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_clean_scrub_stamp":"2024-09-12T16:58:07.519706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:41.789253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013535820000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:01.294217+0000","last_change":"2024-09-12T16:58:23.708567+0000","last_active":"2024-09-12T17:38:01.294217+0000","last_peered":"2024-09-12T17:38:01.294217+0000","last_clean":"2024-09-12T17:38:01.294217+0000","last_became_active":"2024-09-12T16:58:23.707729+0000","last_became_peered":"2024-09-12T16:58:23.707729+0000","last_unstale":"2024-09-12T17:38:01.294217+0000","last_undegraded":"2024-09-12T17:38:01.294217+0000","last_fullsized":"2024-09-12T17:38:01.294217+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:34.309579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"265'150","reported_seq":710,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:49.590614+0000","last_change":"2024-09-12T16:58:25.950943+0000","last_active":"2024-09-12T17:38:49.590614+0000","last_peered":"2024-09-12T17:38:49.590614+0000","last_clean":"2024-09-12T17:38:49.590614+0000","last_became_active":"2024-09-12T16:58:25.950057+0000","last_became_peered":"2024-09-12T16:58:25.950057+0000","last_unstale":"2024-09-12T17:38:49.590614+0000","last_undegraded":"2024-09-12T17:38:49.590614+0000","last_fullsized":"2024-09-12T17:38:49.590614+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:04.088948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":199,"num_read_kb":190,"num_write":134,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"265'770","reported_seq":2770,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.970057+0000","last_change":"2024-09-12T16:58:27.758626+0000","last_active":"2024-09-12T17:41:32.970057+0000","last_peered":"2024-09-12T17:41:32.970057+0000","last_clean":"2024-09-12T17:41:32.970057+0000","last_became_active":"2024-09-12T16:58:27.756883+0000","last_became_peered":"2024-09-12T16:58:27.756883+0000","last_unstale":"2024-09-12T17:41:32.970057+0000","last_undegraded":"2024-09-12T17:41:32.970057+0000","last_fullsized":"2024-09-12T17:41:32.970057+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:09.429114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"265'131","reported_seq":630,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:24.919336+0000","last_change":"2024-09-12T16:58:29.785504+0000","last_active":"2024-09-12T17:41:24.919336+0000","last_peered":"2024-09-12T17:41:24.919336+0000","last_clean":"2024-09-12T17:41:24.919336+0000","last_became_active":"2024-09-12T16:58:29.784743+0000","last_became_peered":"2024-09-12T16:58:29.784743+0000","last_unstale":"2024-09-12T17:41:24.919336+0000","last_undegraded":"2024-09-12T17:41:24.919336+0000","last_fullsized":"2024-09-12T17:41:24.919336+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:07.819438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1532,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":153,"num_read_kb":151,"num_write":316,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"265'49","reported_seq":586,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:32.357724+0000","last_change":"2024-09-12T16:58:21.723795+0000","last_active":"2024-09-12T17:38:32.357724+0000","last_peered":"2024-09-12T17:38:32.357724+0000","last_clean":"2024-09-12T17:38:32.357724+0000","last_became_active":"2024-09-12T16:58:21.723391+0000","last_became_peered":"2024-09-12T16:58:21.723391+0000","last_unstale":"2024-09-12T17:38:32.357724+0000","last_undegraded":"2024-09-12T17:38:32.357724+0000","last_fullsized":"2024-09-12T17:38:32.357724+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:53.524544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":182,"num_write":83,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"265'459","reported_seq":1097,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.330651+0000","last_change":"2024-09-12T16:58:18.687350+0000","last_active":"2024-09-12T17:41:33.330651+0000","last_peered":"2024-09-12T17:41:33.330651+0000","last_clean":"2024-09-12T17:41:33.330651+0000","last_became_active":"2024-09-12T16:58:18.686966+0000","last_became_peered":"2024-09-12T16:58:18.686966+0000","last_unstale":"2024-09-12T17:41:33.330651+0000","last_undegraded":"2024-09-12T17:41:33.330651+0000","last_fullsized":"2024-09-12T17:41:33.330651+0000","mapping_epoch":23,"log_start":"265'400","ondisk_log_start":"265'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:41.879490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376560,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":630,"num_read_kb":10296,"num_write":1224,"num_write_kb":24848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:37.425805+0000","last_change":"2024-09-12T17:41:37.425805+0000","last_active":"2024-09-12T17:41:37.425805+0000","last_peered":"2024-09-12T17:41:37.425805+0000","last_clean":"2024-09-12T17:41:37.425805+0000","last_became_active":"2024-09-12T16:58:08.544406+0000","last_became_peered":"2024-09-12T16:58:08.544406+0000","last_unstale":"2024-09-12T17:41:37.425805+0000","last_undegraded":"2024-09-12T17:41:37.425805+0000","last_fullsized":"2024-09-12T17:41:37.425805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:37.425638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:37.425638+0000","last_clean_scrub_stamp":"2024-09-12T17:41:37.425638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:38.294788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012247510000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:01.278478+0000","last_change":"2024-09-12T16:58:23.701057+0000","last_active":"2024-09-12T17:38:01.278478+0000","last_peered":"2024-09-12T17:38:01.278478+0000","last_clean":"2024-09-12T17:38:01.278478+0000","last_became_active":"2024-09-12T16:58:23.700331+0000","last_became_peered":"2024-09-12T16:58:23.700331+0000","last_unstale":"2024-09-12T17:38:01.278478+0000","last_undegraded":"2024-09-12T17:38:01.278478+0000","last_fullsized":"2024-09-12T17:38:01.278478+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:36.712880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"265'119","reported_seq":654,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:32.549144+0000","last_change":"2024-09-12T16:58:25.731260+0000","last_active":"2024-09-12T17:39:32.549144+0000","last_peered":"2024-09-12T17:39:32.549144+0000","last_clean":"2024-09-12T17:39:32.549144+0000","last_became_active":"2024-09-12T16:58:25.730018+0000","last_became_peered":"2024-09-12T16:58:25.730018+0000","last_unstale":"2024-09-12T17:39:32.549144+0000","last_undegraded":"2024-09-12T17:39:32.549144+0000","last_fullsized":"2024-09-12T17:39:32.549144+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:14.303705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":134,"num_read_kb":123,"num_write":96,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"265'786","reported_seq":2348,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.077589+0000","last_change":"2024-09-12T16:58:27.747091+0000","last_active":"2024-09-12T17:41:33.077589+0000","last_peered":"2024-09-12T17:41:33.077589+0000","last_clean":"2024-09-12T17:41:33.077589+0000","last_became_active":"2024-09-12T16:58:27.746177+0000","last_became_peered":"2024-09-12T16:58:27.746177+0000","last_unstale":"2024-09-12T17:41:33.077589+0000","last_undegraded":"2024-09-12T17:41:33.077589+0000","last_fullsized":"2024-09-12T17:41:33.077589+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:44:59.636233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"265'168","reported_seq":662,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:26.453883+0000","last_change":"2024-09-12T16:58:29.791161+0000","last_active":"2024-09-12T17:39:26.453883+0000","last_peered":"2024-09-12T17:39:26.453883+0000","last_clean":"2024-09-12T17:39:26.453883+0000","last_became_active":"2024-09-12T16:58:29.790535+0000","last_became_peered":"2024-09-12T16:58:29.790535+0000","last_unstale":"2024-09-12T17:39:26.453883+0000","last_undegraded":"2024-09-12T17:39:26.453883+0000","last_fullsized":"2024-09-12T17:39:26.453883+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:22:58.632183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":476,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":147,"num_read_kb":144,"num_write":393,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"265'96","reported_seq":660,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:46.106322+0000","last_change":"2024-09-12T16:58:21.702014+0000","last_active":"2024-09-12T17:38:46.106322+0000","last_peered":"2024-09-12T17:38:46.106322+0000","last_clean":"2024-09-12T17:38:46.106322+0000","last_became_active":"2024-09-12T16:58:21.701206+0000","last_became_peered":"2024-09-12T16:58:21.701206+0000","last_unstale":"2024-09-12T17:38:46.106322+0000","last_undegraded":"2024-09-12T17:38:46.106322+0000","last_fullsized":"2024-09-12T17:38:46.106322+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:06.784285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":405,"num_read_kb":331,"num_write":157,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"265'370","reported_seq":1034,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:37.268183+0000","last_change":"2024-09-12T17:41:37.268183+0000","last_active":"2024-09-12T17:41:37.268183+0000","last_peered":"2024-09-12T17:41:37.268183+0000","last_clean":"2024-09-12T17:41:37.268183+0000","last_became_active":"2024-09-12T16:58:18.701270+0000","last_became_peered":"2024-09-12T16:58:18.701270+0000","last_unstale":"2024-09-12T17:41:37.268183+0000","last_undegraded":"2024-09-12T17:41:37.268183+0000","last_fullsized":"2024-09-12T17:41:37.268183+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'370","last_scrub_stamp":"2024-09-12T17:41:37.268034+0000","last_deep_scrub":"265'370","last_deep_scrub_stamp":"2024-09-12T17:41:37.268034+0000","last_clean_scrub_stamp":"2024-09-12T17:41:37.268034+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:22.095358+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":575,"num_read_kb":17292,"num_write":1132,"num_write_kb":31476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":521,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:21.311776+0000","last_change":"2024-09-12T16:58:10.537187+0000","last_active":"2024-09-12T17:39:21.311776+0000","last_peered":"2024-09-12T17:39:21.311776+0000","last_clean":"2024-09-12T17:39:21.311776+0000","last_became_active":"2024-09-12T16:58:08.546519+0000","last_became_peered":"2024-09-12T16:58:08.546519+0000","last_unstale":"2024-09-12T17:39:21.311776+0000","last_undegraded":"2024-09-12T17:39:21.311776+0000","last_fullsized":"2024-09-12T17:39:21.311776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:07.519706+0000","last_clean_scrub_stamp":"2024-09-12T16:58:07.519706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:11.277662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088376600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:37.358927+0000","last_change":"2024-09-12T16:58:23.707506+0000","last_active":"2024-09-12T17:38:37.358927+0000","last_peered":"2024-09-12T17:38:37.358927+0000","last_clean":"2024-09-12T17:38:37.358927+0000","last_became_active":"2024-09-12T16:58:23.707022+0000","last_became_peered":"2024-09-12T16:58:23.707022+0000","last_unstale":"2024-09-12T17:38:37.358927+0000","last_undegraded":"2024-09-12T17:38:37.358927+0000","last_fullsized":"2024-09-12T17:38:37.358927+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:09.125943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"265'741","reported_seq":1458,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.601305+0000","last_change":"2024-09-12T16:58:25.949990+0000","last_active":"2024-09-12T17:41:32.601305+0000","last_peered":"2024-09-12T17:41:32.601305+0000","last_clean":"2024-09-12T17:41:32.601305+0000","last_became_active":"2024-09-12T16:58:25.949263+0000","last_became_peered":"2024-09-12T16:58:25.949263+0000","last_unstale":"2024-09-12T17:41:32.601305+0000","last_undegraded":"2024-09-12T17:41:32.601305+0000","last_fullsized":"2024-09-12T17:41:32.601305+0000","mapping_epoch":30,"log_start":"265'700","ondisk_log_start":"265'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":700,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:06.590619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143781,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1330,"num_read_kb":3188,"num_write":1090,"num_write_kb":918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:02.350591+0000","last_change":"2024-09-12T16:58:27.742543+0000","last_active":"2024-09-12T17:38:02.350591+0000","last_peered":"2024-09-12T17:38:02.350591+0000","last_clean":"2024-09-12T17:38:02.350591+0000","last_became_active":"2024-09-12T16:58:27.741779+0000","last_became_peered":"2024-09-12T16:58:27.741779+0000","last_unstale":"2024-09-12T17:38:02.350591+0000","last_undegraded":"2024-09-12T17:38:02.350591+0000","last_fullsized":"2024-09-12T17:38:02.350591+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:32.725498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"265'144","reported_seq":646,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:04.962585+0000","last_change":"2024-09-12T16:58:29.788557+0000","last_active":"2024-09-12T17:40:04.962585+0000","last_peered":"2024-09-12T17:40:04.962585+0000","last_clean":"2024-09-12T17:40:04.962585+0000","last_became_active":"2024-09-12T16:58:29.787692+0000","last_became_peered":"2024-09-12T16:58:29.787692+0000","last_unstale":"2024-09-12T17:40:04.962585+0000","last_undegraded":"2024-09-12T17:40:04.962585+0000","last_fullsized":"2024-09-12T17:40:04.962585+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:15.861385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":218,"num_read_kb":207,"num_write":364,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"265'162","reported_seq":712,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:05.120577+0000","last_change":"2024-09-12T16:58:29.785185+0000","last_active":"2024-09-12T17:40:05.120577+0000","last_peered":"2024-09-12T17:40:05.120577+0000","last_clean":"2024-09-12T17:40:05.120577+0000","last_became_active":"2024-09-12T16:58:29.782784+0000","last_became_peered":"2024-09-12T16:58:29.782784+0000","last_unstale":"2024-09-12T17:40:05.120577+0000","last_undegraded":"2024-09-12T17:40:05.120577+0000","last_fullsized":"2024-09-12T17:40:05.120577+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:48.171949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":629,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":266,"num_read_kb":264,"num_write":397,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"265'100","reported_seq":687,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:37.730070+0000","last_change":"2024-09-12T16:58:21.732323+0000","last_active":"2024-09-12T17:39:37.730070+0000","last_peered":"2024-09-12T17:39:37.730070+0000","last_clean":"2024-09-12T17:39:37.730070+0000","last_became_active":"2024-09-12T16:58:21.731509+0000","last_became_peered":"2024-09-12T16:58:21.731509+0000","last_unstale":"2024-09-12T17:39:37.730070+0000","last_undegraded":"2024-09-12T17:39:37.730070+0000","last_fullsized":"2024-09-12T17:39:37.730070+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:40.822664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":445,"num_read_kb":375,"num_write":158,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"265'299","reported_seq":924,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.331241+0000","last_change":"2024-09-12T16:58:18.701223+0000","last_active":"2024-09-12T17:41:33.331241+0000","last_peered":"2024-09-12T17:41:33.331241+0000","last_clean":"2024-09-12T17:41:33.331241+0000","last_became_active":"2024-09-12T16:58:18.700214+0000","last_became_peered":"2024-09-12T16:58:18.700214+0000","last_unstale":"2024-09-12T17:41:33.331241+0000","last_undegraded":"2024-09-12T17:41:33.331241+0000","last_fullsized":"2024-09-12T17:41:33.331241+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:13.616837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":472,"num_read_kb":3767,"num_write":1042,"num_write_kb":19533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:08.694880+0000","last_change":"2024-09-12T16:58:23.725522+0000","last_active":"2024-09-12T17:38:08.694880+0000","last_peered":"2024-09-12T17:38:08.694880+0000","last_clean":"2024-09-12T17:38:08.694880+0000","last_became_active":"2024-09-12T16:58:23.725034+0000","last_became_peered":"2024-09-12T16:58:23.725034+0000","last_unstale":"2024-09-12T17:38:08.694880+0000","last_undegraded":"2024-09-12T17:38:08.694880+0000","last_fullsized":"2024-09-12T17:38:08.694880+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:15.538364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"265'272","reported_seq":847,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.848043+0000","last_change":"2024-09-12T16:58:25.738410+0000","last_active":"2024-09-12T17:41:32.848043+0000","last_peered":"2024-09-12T17:41:32.848043+0000","last_clean":"2024-09-12T17:41:32.848043+0000","last_became_active":"2024-09-12T16:58:25.737706+0000","last_became_peered":"2024-09-12T16:58:25.737706+0000","last_unstale":"2024-09-12T17:41:32.848043+0000","last_undegraded":"2024-09-12T17:41:32.848043+0000","last_fullsized":"2024-09-12T17:41:32.848043+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:02:12.766927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54495,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":451,"num_read_kb":1025,"num_write":366,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:07.351743+0000","last_change":"2024-09-12T16:58:27.746931+0000","last_active":"2024-09-12T17:38:07.351743+0000","last_peered":"2024-09-12T17:38:07.351743+0000","last_clean":"2024-09-12T17:38:07.351743+0000","last_became_active":"2024-09-12T16:58:27.746143+0000","last_became_peered":"2024-09-12T16:58:27.746143+0000","last_unstale":"2024-09-12T17:38:07.351743+0000","last_undegraded":"2024-09-12T17:38:07.351743+0000","last_fullsized":"2024-09-12T17:38:07.351743+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:38.513197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"265'116","reported_seq":626,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:57.572381+0000","last_change":"2024-09-12T16:58:29.786922+0000","last_active":"2024-09-12T17:38:57.572381+0000","last_peered":"2024-09-12T17:38:57.572381+0000","last_clean":"2024-09-12T17:38:57.572381+0000","last_became_active":"2024-09-12T16:58:29.784143+0000","last_became_peered":"2024-09-12T16:58:29.784143+0000","last_unstale":"2024-09-12T17:38:57.572381+0000","last_undegraded":"2024-09-12T17:38:57.572381+0000","last_fullsized":"2024-09-12T17:38:57.572381+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:57.768618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":186,"num_write":283,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"265'174","reported_seq":827,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:47.685307+0000","last_change":"2024-09-12T16:58:21.715883+0000","last_active":"2024-09-12T17:39:47.685307+0000","last_peered":"2024-09-12T17:39:47.685307+0000","last_clean":"2024-09-12T17:39:47.685307+0000","last_became_active":"2024-09-12T16:58:21.715193+0000","last_became_peered":"2024-09-12T16:58:21.715193+0000","last_unstale":"2024-09-12T17:39:47.685307+0000","last_undegraded":"2024-09-12T17:39:47.685307+0000","last_fullsized":"2024-09-12T17:39:47.685307+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:10.766328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":752,"num_read_kb":633,"num_write":248,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"265'339","reported_seq":966,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.318607+0000","last_change":"2024-09-12T16:58:18.686877+0000","last_active":"2024-09-12T17:41:33.318607+0000","last_peered":"2024-09-12T17:41:33.318607+0000","last_clean":"2024-09-12T17:41:33.318607+0000","last_became_active":"2024-09-12T16:58:18.686155+0000","last_became_peered":"2024-09-12T16:58:18.686155+0000","last_unstale":"2024-09-12T17:41:33.318607+0000","last_undegraded":"2024-09-12T17:41:33.318607+0000","last_fullsized":"2024-09-12T17:41:33.318607+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:04.515838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029079,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":528,"num_read_kb":20889,"num_write":1017,"num_write_kb":24291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:07.351964+0000","last_change":"2024-09-12T16:58:23.713527+0000","last_active":"2024-09-12T17:38:07.351964+0000","last_peered":"2024-09-12T17:38:07.351964+0000","last_clean":"2024-09-12T17:38:07.351964+0000","last_became_active":"2024-09-12T16:58:23.713069+0000","last_became_peered":"2024-09-12T16:58:23.713069+0000","last_unstale":"2024-09-12T17:38:07.351964+0000","last_undegraded":"2024-09-12T17:38:07.351964+0000","last_fullsized":"2024-09-12T17:38:07.351964+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:22.939725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"265'35","reported_seq":534,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:25.845238+0000","last_change":"2024-09-12T16:58:25.731248+0000","last_active":"2024-09-12T17:39:25.845238+0000","last_peered":"2024-09-12T17:39:25.845238+0000","last_clean":"2024-09-12T17:39:25.845238+0000","last_became_active":"2024-09-12T16:58:25.730410+0000","last_became_peered":"2024-09-12T16:58:25.730410+0000","last_unstale":"2024-09-12T17:39:25.845238+0000","last_undegraded":"2024-09-12T17:39:25.845238+0000","last_fullsized":"2024-09-12T17:39:25.845238+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:19.441232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:11.303833+0000","last_change":"2024-09-12T16:58:27.743749+0000","last_active":"2024-09-12T17:38:11.303833+0000","last_peered":"2024-09-12T17:38:11.303833+0000","last_clean":"2024-09-12T17:38:11.303833+0000","last_became_active":"2024-09-12T16:58:27.742979+0000","last_became_peered":"2024-09-12T16:58:27.742979+0000","last_unstale":"2024-09-12T17:38:11.303833+0000","last_undegraded":"2024-09-12T17:38:11.303833+0000","last_fullsized":"2024-09-12T17:38:11.303833+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:29.367350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"265'208","reported_seq":728,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:04.410688+0000","last_change":"2024-09-12T16:58:29.782903+0000","last_active":"2024-09-12T17:40:04.410688+0000","last_peered":"2024-09-12T17:40:04.410688+0000","last_clean":"2024-09-12T17:40:04.410688+0000","last_became_active":"2024-09-12T16:58:29.782024+0000","last_became_peered":"2024-09-12T16:58:29.782024+0000","last_unstale":"2024-09-12T17:40:04.410688+0000","last_undegraded":"2024-09-12T17:40:04.410688+0000","last_fullsized":"2024-09-12T17:40:04.410688+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:51.452618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":358,"num_read_kb":350,"num_write":466,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"265'521","reported_seq":1253,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:02.350548+0000","last_change":"2024-09-12T16:58:21.712078+0000","last_active":"2024-09-12T17:38:02.350548+0000","last_peered":"2024-09-12T17:38:02.350548+0000","last_clean":"2024-09-12T17:38:02.350548+0000","last_became_active":"2024-09-12T16:58:21.711637+0000","last_became_peered":"2024-09-12T16:58:21.711637+0000","last_unstale":"2024-09-12T17:38:02.350548+0000","last_undegraded":"2024-09-12T17:38:02.350548+0000","last_fullsized":"2024-09-12T17:38:02.350548+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":500,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:57.113912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2547,"num_read_kb":2246,"num_write":971,"num_write_kb":585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"265'369","reported_seq":971,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.301178+0000","last_change":"2024-09-12T16:58:55.852662+0000","last_active":"2024-09-12T17:41:33.301178+0000","last_peered":"2024-09-12T17:41:33.301178+0000","last_clean":"2024-09-12T17:41:33.301178+0000","last_became_active":"2024-09-12T16:58:55.851886+0000","last_became_peered":"2024-09-12T16:58:55.851886+0000","last_unstale":"2024-09-12T17:41:33.301178+0000","last_undegraded":"2024-09-12T17:41:33.301178+0000","last_fullsized":"2024-09-12T17:41:33.301178+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:44.817591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":696596,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":502,"num_read_kb":19430,"num_write":1218,"num_write_kb":23867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:06.302568+0000","last_change":"2024-09-12T16:58:23.718833+0000","last_active":"2024-09-12T17:38:06.302568+0000","last_peered":"2024-09-12T17:38:06.302568+0000","last_clean":"2024-09-12T17:38:06.302568+0000","last_became_active":"2024-09-12T16:58:23.718109+0000","last_became_peered":"2024-09-12T16:58:23.718109+0000","last_unstale":"2024-09-12T17:38:06.302568+0000","last_undegraded":"2024-09-12T17:38:06.302568+0000","last_fullsized":"2024-09-12T17:38:06.302568+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:01.727111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"265'311","reported_seq":902,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.393549+0000","last_change":"2024-09-12T16:58:25.739863+0000","last_active":"2024-09-12T17:41:32.393549+0000","last_peered":"2024-09-12T17:41:32.393549+0000","last_clean":"2024-09-12T17:41:32.393549+0000","last_became_active":"2024-09-12T16:58:25.738463+0000","last_became_peered":"2024-09-12T16:58:25.738463+0000","last_unstale":"2024-09-12T17:41:32.393549+0000","last_undegraded":"2024-09-12T17:41:32.393549+0000","last_fullsized":"2024-09-12T17:41:32.393549+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:48.664021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46394,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":527,"num_read_kb":1194,"num_write":426,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:11.296562+0000","last_change":"2024-09-12T16:58:27.760862+0000","last_active":"2024-09-12T17:38:11.296562+0000","last_peered":"2024-09-12T17:38:11.296562+0000","last_clean":"2024-09-12T17:38:11.296562+0000","last_became_active":"2024-09-12T16:58:27.760265+0000","last_became_peered":"2024-09-12T16:58:27.760265+0000","last_unstale":"2024-09-12T17:38:11.296562+0000","last_undegraded":"2024-09-12T17:38:11.296562+0000","last_fullsized":"2024-09-12T17:38:11.296562+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:32.912040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"265'144","reported_seq":673,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:21.515529+0000","last_change":"2024-09-12T16:58:29.777889+0000","last_active":"2024-09-12T17:39:21.515529+0000","last_peered":"2024-09-12T17:39:21.515529+0000","last_clean":"2024-09-12T17:39:21.515529+0000","last_became_active":"2024-09-12T16:58:29.776448+0000","last_became_peered":"2024-09-12T16:58:29.776448+0000","last_unstale":"2024-09-12T17:39:21.515529+0000","last_undegraded":"2024-09-12T17:39:21.515529+0000","last_fullsized":"2024-09-12T17:39:21.515529+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:41.421501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":253,"num_read_kb":229,"num_write":261,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"265'251","reported_seq":879,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:22.384616+0000","last_change":"2024-09-12T16:58:21.706067+0000","last_active":"2024-09-12T17:40:22.384616+0000","last_peered":"2024-09-12T17:40:22.384616+0000","last_clean":"2024-09-12T17:40:22.384616+0000","last_became_active":"2024-09-12T16:58:21.705619+0000","last_became_peered":"2024-09-12T16:58:21.705619+0000","last_unstale":"2024-09-12T17:40:22.384616+0000","last_undegraded":"2024-09-12T17:40:22.384616+0000","last_fullsized":"2024-09-12T17:40:22.384616+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:17.879048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1131,"num_read_kb":917,"num_write":399,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"265'312","reported_seq":956,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.328854+0000","last_change":"2024-09-12T16:58:18.701775+0000","last_active":"2024-09-12T17:41:33.328854+0000","last_peered":"2024-09-12T17:41:33.328854+0000","last_clean":"2024-09-12T17:41:33.328854+0000","last_became_active":"2024-09-12T16:58:18.700720+0000","last_became_peered":"2024-09-12T16:58:18.700720+0000","last_unstale":"2024-09-12T17:41:33.328854+0000","last_undegraded":"2024-09-12T17:41:33.328854+0000","last_fullsized":"2024-09-12T17:41:33.328854+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:37.311441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399159,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":424,"num_read_kb":68507,"num_write":939,"num_write_kb":27085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:06.295440+0000","last_change":"2024-09-12T16:58:23.721747+0000","last_active":"2024-09-12T17:38:06.295440+0000","last_peered":"2024-09-12T17:38:06.295440+0000","last_clean":"2024-09-12T17:38:06.295440+0000","last_became_active":"2024-09-12T16:58:23.721005+0000","last_became_peered":"2024-09-12T16:58:23.721005+0000","last_unstale":"2024-09-12T17:38:06.295440+0000","last_undegraded":"2024-09-12T17:38:06.295440+0000","last_fullsized":"2024-09-12T17:38:06.295440+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:29.561235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"265'246","reported_seq":813,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.266477+0000","last_change":"2024-09-12T16:58:25.733878+0000","last_active":"2024-09-12T17:41:32.266477+0000","last_peered":"2024-09-12T17:41:32.266477+0000","last_clean":"2024-09-12T17:41:32.266477+0000","last_became_active":"2024-09-12T16:58:25.732956+0000","last_became_peered":"2024-09-12T16:58:25.732956+0000","last_unstale":"2024-09-12T17:41:32.266477+0000","last_undegraded":"2024-09-12T17:41:32.266477+0000","last_fullsized":"2024-09-12T17:41:32.266477+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:50:45.059874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52555,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":415,"num_read_kb":944,"num_write":334,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:07.348165+0000","last_change":"2024-09-12T16:58:27.747511+0000","last_active":"2024-09-12T17:38:07.348165+0000","last_peered":"2024-09-12T17:38:07.348165+0000","last_clean":"2024-09-12T17:38:07.348165+0000","last_became_active":"2024-09-12T16:58:27.737089+0000","last_became_peered":"2024-09-12T16:58:27.737089+0000","last_unstale":"2024-09-12T17:38:07.348165+0000","last_undegraded":"2024-09-12T17:38:07.348165+0000","last_fullsized":"2024-09-12T17:38:07.348165+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:38.515071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"265'132","reported_seq":778,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:45.573465+0000","last_change":"2024-09-12T16:58:21.717882+0000","last_active":"2024-09-12T17:39:45.573465+0000","last_peered":"2024-09-12T17:39:45.573465+0000","last_clean":"2024-09-12T17:39:45.573465+0000","last_became_active":"2024-09-12T16:58:21.717079+0000","last_became_peered":"2024-09-12T16:58:21.717079+0000","last_unstale":"2024-09-12T17:39:45.573465+0000","last_undegraded":"2024-09-12T17:39:45.573465+0000","last_fullsized":"2024-09-12T17:39:45.573465+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:23.381407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":593,"num_read_kb":510,"num_write":185,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"265'344","reported_seq":980,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.347258+0000","last_change":"2024-09-12T16:58:18.677827+0000","last_active":"2024-09-12T17:41:33.347258+0000","last_peered":"2024-09-12T17:41:33.347258+0000","last_clean":"2024-09-12T17:41:33.347258+0000","last_became_active":"2024-09-12T16:58:18.677480+0000","last_became_peered":"2024-09-12T16:58:18.677480+0000","last_unstale":"2024-09-12T17:41:33.347258+0000","last_undegraded":"2024-09-12T17:41:33.347258+0000","last_fullsized":"2024-09-12T17:41:33.347258+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:38.035768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4539352,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":465,"num_read_kb":21305,"num_write":1120,"num_write_kb":20049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:37.355462+0000","last_change":"2024-09-12T16:58:23.719669+0000","last_active":"2024-09-12T17:38:37.355462+0000","last_peered":"2024-09-12T17:38:37.355462+0000","last_clean":"2024-09-12T17:38:37.355462+0000","last_became_active":"2024-09-12T16:58:23.719039+0000","last_became_peered":"2024-09-12T16:58:23.719039+0000","last_unstale":"2024-09-12T17:38:37.355462+0000","last_undegraded":"2024-09-12T17:38:37.355462+0000","last_fullsized":"2024-09-12T17:38:37.355462+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:00.880364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"265'471","reported_seq":1098,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.092416+0000","last_change":"2024-09-12T16:58:25.720911+0000","last_active":"2024-09-12T17:41:33.092416+0000","last_peered":"2024-09-12T17:41:33.092416+0000","last_clean":"2024-09-12T17:41:33.092416+0000","last_became_active":"2024-09-12T16:58:25.720165+0000","last_became_peered":"2024-09-12T16:58:25.720165+0000","last_unstale":"2024-09-12T17:41:33.092416+0000","last_undegraded":"2024-09-12T17:41:33.092416+0000","last_fullsized":"2024-09-12T17:41:33.092416+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:01.154748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97109,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":819,"num_read_kb":1920,"num_write":702,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:27.338321+0000","last_change":"2024-09-12T16:58:27.750193+0000","last_active":"2024-09-12T17:38:27.338321+0000","last_peered":"2024-09-12T17:38:27.338321+0000","last_clean":"2024-09-12T17:38:27.338321+0000","last_became_active":"2024-09-12T16:58:27.749390+0000","last_became_peered":"2024-09-12T16:58:27.749390+0000","last_unstale":"2024-09-12T17:38:27.338321+0000","last_undegraded":"2024-09-12T17:38:27.338321+0000","last_fullsized":"2024-09-12T17:38:27.338321+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:54.523888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"265'184","reported_seq":732,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:45.266732+0000","last_change":"2024-09-12T16:58:29.789122+0000","last_active":"2024-09-12T17:39:45.266732+0000","last_peered":"2024-09-12T17:39:45.266732+0000","last_clean":"2024-09-12T17:39:45.266732+0000","last_became_active":"2024-09-12T16:58:29.788460+0000","last_became_peered":"2024-09-12T16:58:29.788460+0000","last_unstale":"2024-09-12T17:39:45.266732+0000","last_undegraded":"2024-09-12T17:39:45.266732+0000","last_fullsized":"2024-09-12T17:39:45.266732+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:40.064167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":436,"num_read_kb":400,"num_write":425,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"265'128","reported_seq":737,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:37.856071+0000","last_change":"2024-09-12T16:58:21.724434+0000","last_active":"2024-09-12T17:38:37.856071+0000","last_peered":"2024-09-12T17:38:37.856071+0000","last_clean":"2024-09-12T17:38:37.856071+0000","last_became_active":"2024-09-12T16:58:21.724003+0000","last_became_peered":"2024-09-12T16:58:21.724003+0000","last_unstale":"2024-09-12T17:38:37.856071+0000","last_undegraded":"2024-09-12T17:38:37.856071+0000","last_fullsized":"2024-09-12T17:38:37.856071+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:30.276259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":616,"num_read_kb":520,"num_write":198,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"265'371","reported_seq":1061,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.307669+0000","last_change":"2024-09-12T16:58:18.707166+0000","last_active":"2024-09-12T17:41:33.307669+0000","last_peered":"2024-09-12T17:41:33.307669+0000","last_clean":"2024-09-12T17:41:33.307669+0000","last_became_active":"2024-09-12T16:58:18.706806+0000","last_became_peered":"2024-09-12T16:58:18.706806+0000","last_unstale":"2024-09-12T17:41:33.307669+0000","last_undegraded":"2024-09-12T17:41:33.307669+0000","last_fullsized":"2024-09-12T17:41:33.307669+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:51.584155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2005288,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":606,"num_read_kb":18575,"num_write":1246,"num_write_kb":49050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:01.294381+0000","last_change":"2024-09-12T16:58:23.721449+0000","last_active":"2024-09-12T17:38:01.294381+0000","last_peered":"2024-09-12T17:38:01.294381+0000","last_clean":"2024-09-12T17:38:01.294381+0000","last_became_active":"2024-09-12T16:58:23.720654+0000","last_became_peered":"2024-09-12T16:58:23.720654+0000","last_unstale":"2024-09-12T17:38:01.294381+0000","last_undegraded":"2024-09-12T17:38:01.294381+0000","last_fullsized":"2024-09-12T17:38:01.294381+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:08.970300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"265'316","reported_seq":897,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.308318+0000","last_change":"2024-09-12T16:58:25.734439+0000","last_active":"2024-09-12T17:41:32.308318+0000","last_peered":"2024-09-12T17:41:32.308318+0000","last_clean":"2024-09-12T17:41:32.308318+0000","last_became_active":"2024-09-12T16:58:25.733241+0000","last_became_peered":"2024-09-12T16:58:25.733241+0000","last_unstale":"2024-09-12T17:41:32.308318+0000","last_undegraded":"2024-09-12T17:41:32.308318+0000","last_fullsized":"2024-09-12T17:41:32.308318+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:46.538919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53167,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":518,"num_read_kb":1145,"num_write":434,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:28.699837+0000","last_change":"2024-09-12T16:58:27.751196+0000","last_active":"2024-09-12T17:38:28.699837+0000","last_peered":"2024-09-12T17:38:28.699837+0000","last_clean":"2024-09-12T17:38:28.699837+0000","last_became_active":"2024-09-12T16:58:27.750328+0000","last_became_peered":"2024-09-12T16:58:27.750328+0000","last_unstale":"2024-09-12T17:38:28.699837+0000","last_undegraded":"2024-09-12T17:38:28.699837+0000","last_fullsized":"2024-09-12T17:38:28.699837+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:06.616801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"265'181","reported_seq":680,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:04.425931+0000","last_change":"2024-09-12T16:58:29.777915+0000","last_active":"2024-09-12T17:40:04.425931+0000","last_peered":"2024-09-12T17:40:04.425931+0000","last_clean":"2024-09-12T17:40:04.425931+0000","last_became_active":"2024-09-12T16:58:29.777124+0000","last_became_peered":"2024-09-12T16:58:29.777124+0000","last_unstale":"2024-09-12T17:40:04.425931+0000","last_undegraded":"2024-09-12T17:40:04.425931+0000","last_fullsized":"2024-09-12T17:40:04.425931+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:43.622054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1215,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":228,"num_read_kb":227,"num_write":517,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"265'162","reported_seq":766,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:50.195600+0000","last_change":"2024-09-12T16:58:21.698980+0000","last_active":"2024-09-12T17:39:50.195600+0000","last_peered":"2024-09-12T17:39:50.195600+0000","last_clean":"2024-09-12T17:39:50.195600+0000","last_became_active":"2024-09-12T16:58:21.698565+0000","last_became_peered":"2024-09-12T16:58:21.698565+0000","last_unstale":"2024-09-12T17:39:50.195600+0000","last_undegraded":"2024-09-12T17:39:50.195600+0000","last_fullsized":"2024-09-12T17:39:50.195600+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:53.075338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":649,"num_read_kb":535,"num_write":267,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"265'338","reported_seq":987,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.292099+0000","last_change":"2024-09-12T16:58:18.701060+0000","last_active":"2024-09-12T17:41:33.292099+0000","last_peered":"2024-09-12T17:41:33.292099+0000","last_clean":"2024-09-12T17:41:33.292099+0000","last_became_active":"2024-09-12T16:58:18.700196+0000","last_became_peered":"2024-09-12T16:58:18.700196+0000","last_unstale":"2024-09-12T17:41:33.292099+0000","last_undegraded":"2024-09-12T17:41:33.292099+0000","last_fullsized":"2024-09-12T17:41:33.292099+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:18.696858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":519,"num_read_kb":4020,"num_write":1087,"num_write_kb":21150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:26.284203+0000","last_change":"2024-09-12T16:58:23.703516+0000","last_active":"2024-09-12T17:38:26.284203+0000","last_peered":"2024-09-12T17:38:26.284203+0000","last_clean":"2024-09-12T17:38:26.284203+0000","last_became_active":"2024-09-12T16:58:23.702293+0000","last_became_peered":"2024-09-12T16:58:23.702293+0000","last_unstale":"2024-09-12T17:38:26.284203+0000","last_undegraded":"2024-09-12T17:38:26.284203+0000","last_fullsized":"2024-09-12T17:38:26.284203+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:48.660513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"265'325","reported_seq":902,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.010922+0000","last_change":"2024-09-12T16:58:25.950771+0000","last_active":"2024-09-12T17:41:33.010922+0000","last_peered":"2024-09-12T17:41:33.010922+0000","last_clean":"2024-09-12T17:41:33.010922+0000","last_became_active":"2024-09-12T16:58:25.949883+0000","last_became_peered":"2024-09-12T16:58:25.949883+0000","last_unstale":"2024-09-12T17:41:33.010922+0000","last_undegraded":"2024-09-12T17:41:33.010922+0000","last_fullsized":"2024-09-12T17:41:33.010922+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:22.560848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47961,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":516,"num_read_kb":1185,"num_write":434,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:28.699909+0000","last_change":"2024-09-12T16:58:27.749008+0000","last_active":"2024-09-12T17:38:28.699909+0000","last_peered":"2024-09-12T17:38:28.699909+0000","last_clean":"2024-09-12T17:38:28.699909+0000","last_became_active":"2024-09-12T16:58:27.739965+0000","last_became_peered":"2024-09-12T16:58:27.739965+0000","last_unstale":"2024-09-12T17:38:28.699909+0000","last_undegraded":"2024-09-12T17:38:28.699909+0000","last_fullsized":"2024-09-12T17:38:28.699909+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:19.228861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"265'138","reported_seq":629,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:24.910801+0000","last_change":"2024-09-12T16:58:29.772039+0000","last_active":"2024-09-12T17:41:24.910801+0000","last_peered":"2024-09-12T17:41:24.910801+0000","last_clean":"2024-09-12T17:41:24.910801+0000","last_became_active":"2024-09-12T16:58:29.771267+0000","last_became_peered":"2024-09-12T16:58:29.771267+0000","last_unstale":"2024-09-12T17:41:24.910801+0000","last_undegraded":"2024-09-12T17:41:24.910801+0000","last_fullsized":"2024-09-12T17:41:24.910801+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:22.290183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":401,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":154,"num_write":321,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"265'82","reported_seq":686,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:23.736000+0000","last_change":"2024-09-12T16:58:21.730974+0000","last_active":"2024-09-12T17:41:23.736000+0000","last_peered":"2024-09-12T17:41:23.736000+0000","last_clean":"2024-09-12T17:41:23.736000+0000","last_became_active":"2024-09-12T16:58:21.730342+0000","last_became_peered":"2024-09-12T16:58:21.730342+0000","last_unstale":"2024-09-12T17:41:23.736000+0000","last_undegraded":"2024-09-12T17:41:23.736000+0000","last_fullsized":"2024-09-12T17:41:23.736000+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:08.283142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":417,"num_read_kb":364,"num_write":119,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"265'309","reported_seq":997,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.330958+0000","last_change":"2024-09-12T16:58:18.689099+0000","last_active":"2024-09-12T17:41:33.330958+0000","last_peered":"2024-09-12T17:41:33.330958+0000","last_clean":"2024-09-12T17:41:33.330958+0000","last_became_active":"2024-09-12T16:58:18.688773+0000","last_became_peered":"2024-09-12T16:58:18.688773+0000","last_unstale":"2024-09-12T17:41:33.330958+0000","last_undegraded":"2024-09-12T17:41:33.330958+0000","last_fullsized":"2024-09-12T17:41:33.330958+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:33.745654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":566,"num_read_kb":43210,"num_write":1036,"num_write_kb":32802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:28.699789+0000","last_change":"2024-09-12T16:58:23.709450+0000","last_active":"2024-09-12T17:38:28.699789+0000","last_peered":"2024-09-12T17:38:28.699789+0000","last_clean":"2024-09-12T17:38:28.699789+0000","last_became_active":"2024-09-12T16:58:23.709009+0000","last_became_peered":"2024-09-12T16:58:23.709009+0000","last_unstale":"2024-09-12T17:38:28.699789+0000","last_undegraded":"2024-09-12T17:38:28.699789+0000","last_fullsized":"2024-09-12T17:38:28.699789+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:45.138172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"265'88","reported_seq":608,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:22.509004+0000","last_change":"2024-09-12T16:58:25.950055+0000","last_active":"2024-09-12T17:39:22.509004+0000","last_peered":"2024-09-12T17:39:22.509004+0000","last_clean":"2024-09-12T17:39:22.509004+0000","last_became_active":"2024-09-12T16:58:25.949196+0000","last_became_peered":"2024-09-12T16:58:25.949196+0000","last_unstale":"2024-09-12T17:39:22.509004+0000","last_undegraded":"2024-09-12T17:39:22.509004+0000","last_fullsized":"2024-09-12T17:39:22.509004+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:18:17.202967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":122,"num_read_kb":116,"num_write":142,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"265'758","reported_seq":2154,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.980472+0000","last_change":"2024-09-12T16:58:27.741265+0000","last_active":"2024-09-12T17:41:32.980472+0000","last_peered":"2024-09-12T17:41:32.980472+0000","last_clean":"2024-09-12T17:41:32.980472+0000","last_became_active":"2024-09-12T16:58:27.740416+0000","last_became_peered":"2024-09-12T16:58:27.740416+0000","last_unstale":"2024-09-12T17:41:32.980472+0000","last_undegraded":"2024-09-12T17:41:32.980472+0000","last_fullsized":"2024-09-12T17:41:32.980472+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":700,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:32.112107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"265'129","reported_seq":650,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:48.742930+0000","last_change":"2024-09-12T16:58:29.784795+0000","last_active":"2024-09-12T17:39:48.742930+0000","last_peered":"2024-09-12T17:39:48.742930+0000","last_clean":"2024-09-12T17:39:48.742930+0000","last_became_active":"2024-09-12T16:58:29.784128+0000","last_became_peered":"2024-09-12T16:58:29.784128+0000","last_unstale":"2024-09-12T17:39:48.742930+0000","last_undegraded":"2024-09-12T17:39:48.742930+0000","last_fullsized":"2024-09-12T17:39:48.742930+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:43.512905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":291,"num_read_kb":261,"num_write":354,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"265'159","reported_seq":754,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:46.951235+0000","last_change":"2024-09-12T16:58:21.701518+0000","last_active":"2024-09-12T17:39:46.951235+0000","last_peered":"2024-09-12T17:39:46.951235+0000","last_clean":"2024-09-12T17:39:46.951235+0000","last_became_active":"2024-09-12T16:58:21.700714+0000","last_became_peered":"2024-09-12T16:58:21.700714+0000","last_unstale":"2024-09-12T17:39:46.951235+0000","last_undegraded":"2024-09-12T17:39:46.951235+0000","last_fullsized":"2024-09-12T17:39:46.951235+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:00.095934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":716,"num_read_kb":600,"num_write":247,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"265'318","reported_seq":1070,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.341950+0000","last_change":"2024-09-12T16:58:18.706734+0000","last_active":"2024-09-12T17:41:33.341950+0000","last_peered":"2024-09-12T17:41:33.341950+0000","last_clean":"2024-09-12T17:41:33.341950+0000","last_became_active":"2024-09-12T16:58:18.706117+0000","last_became_peered":"2024-09-12T16:58:18.706117+0000","last_unstale":"2024-09-12T17:41:33.341950+0000","last_undegraded":"2024-09-12T17:41:33.341950+0000","last_fullsized":"2024-09-12T17:41:33.341950+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:11.952844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263228,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":571,"num_read_kb":60034,"num_write":895,"num_write_kb":44854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:26.307328+0000","last_change":"2024-09-12T16:58:23.719072+0000","last_active":"2024-09-12T17:38:26.307328+0000","last_peered":"2024-09-12T17:38:26.307328+0000","last_clean":"2024-09-12T17:38:26.307328+0000","last_became_active":"2024-09-12T16:58:23.718211+0000","last_became_peered":"2024-09-12T16:58:23.718211+0000","last_unstale":"2024-09-12T17:38:26.307328+0000","last_undegraded":"2024-09-12T17:38:26.307328+0000","last_fullsized":"2024-09-12T17:38:26.307328+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:55.776100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"265'303","reported_seq":884,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.239123+0000","last_change":"2024-09-12T16:58:25.726107+0000","last_active":"2024-09-12T17:41:33.239123+0000","last_peered":"2024-09-12T17:41:33.239123+0000","last_clean":"2024-09-12T17:41:33.239123+0000","last_became_active":"2024-09-12T16:58:25.724774+0000","last_became_peered":"2024-09-12T16:58:25.724774+0000","last_unstale":"2024-09-12T17:41:33.239123+0000","last_undegraded":"2024-09-12T17:41:33.239123+0000","last_fullsized":"2024-09-12T17:41:33.239123+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:29.986764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47652,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":491,"num_read_kb":1079,"num_write":394,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:07.334035+0000","last_change":"2024-09-12T16:58:27.759894+0000","last_active":"2024-09-12T17:37:07.334035+0000","last_peered":"2024-09-12T17:37:07.334035+0000","last_clean":"2024-09-12T17:37:07.334035+0000","last_became_active":"2024-09-12T16:58:27.755232+0000","last_became_peered":"2024-09-12T16:58:27.755232+0000","last_unstale":"2024-09-12T17:37:07.334035+0000","last_undegraded":"2024-09-12T17:37:07.334035+0000","last_fullsized":"2024-09-12T17:37:07.334035+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:26.735098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"265'133","reported_seq":645,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:04.245111+0000","last_change":"2024-09-12T16:58:29.782745+0000","last_active":"2024-09-12T17:40:04.245111+0000","last_peered":"2024-09-12T17:40:04.245111+0000","last_clean":"2024-09-12T17:40:04.245111+0000","last_became_active":"2024-09-12T16:58:29.782006+0000","last_became_peered":"2024-09-12T16:58:29.782006+0000","last_unstale":"2024-09-12T17:40:04.245111+0000","last_undegraded":"2024-09-12T17:40:04.245111+0000","last_fullsized":"2024-09-12T17:40:04.245111+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:25.299681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":784,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":248,"num_read_kb":225,"num_write":333,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"265'366","reported_seq":973,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:33.892514+0000","last_change":"2024-09-12T16:58:21.702476+0000","last_active":"2024-09-12T17:40:33.892514+0000","last_peered":"2024-09-12T17:40:33.892514+0000","last_clean":"2024-09-12T17:40:33.892514+0000","last_became_active":"2024-09-12T16:58:21.700909+0000","last_became_peered":"2024-09-12T16:58:21.700909+0000","last_unstale":"2024-09-12T17:40:33.892514+0000","last_undegraded":"2024-09-12T17:40:33.892514+0000","last_fullsized":"2024-09-12T17:40:33.892514+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:45.552412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1540,"num_read_kb":1221,"num_write":577,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"265'335","reported_seq":967,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.327782+0000","last_change":"2024-09-12T16:58:18.708114+0000","last_active":"2024-09-12T17:41:33.327782+0000","last_peered":"2024-09-12T17:41:33.327782+0000","last_clean":"2024-09-12T17:41:33.327782+0000","last_became_active":"2024-09-12T16:58:18.706197+0000","last_became_peered":"2024-09-12T16:58:18.706197+0000","last_unstale":"2024-09-12T17:41:33.327782+0000","last_undegraded":"2024-09-12T17:41:33.327782+0000","last_fullsized":"2024-09-12T17:41:33.327782+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:37.230857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10548403,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":531,"num_read_kb":18954,"num_write":1116,"num_write_kb":43009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:27.338265+0000","last_change":"2024-09-12T16:58:23.712080+0000","last_active":"2024-09-12T17:38:27.338265+0000","last_peered":"2024-09-12T17:38:27.338265+0000","last_clean":"2024-09-12T17:38:27.338265+0000","last_became_active":"2024-09-12T16:58:23.711307+0000","last_became_peered":"2024-09-12T16:58:23.711307+0000","last_unstale":"2024-09-12T17:38:27.338265+0000","last_undegraded":"2024-09-12T17:38:27.338265+0000","last_fullsized":"2024-09-12T17:38:27.338265+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:54.962283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"265'268","reported_seq":832,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.273343+0000","last_change":"2024-09-12T16:58:25.737271+0000","last_active":"2024-09-12T17:41:33.273343+0000","last_peered":"2024-09-12T17:41:33.273343+0000","last_clean":"2024-09-12T17:41:33.273343+0000","last_became_active":"2024-09-12T16:58:25.736507+0000","last_became_peered":"2024-09-12T16:58:25.736507+0000","last_unstale":"2024-09-12T17:41:33.273343+0000","last_undegraded":"2024-09-12T17:41:33.273343+0000","last_fullsized":"2024-09-12T17:41:33.273343+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:21.434839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47073,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":450,"num_read_kb":1040,"num_write":370,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:16.284549+0000","last_change":"2024-09-12T16:58:27.741029+0000","last_active":"2024-09-12T17:37:16.284549+0000","last_peered":"2024-09-12T17:37:16.284549+0000","last_clean":"2024-09-12T17:37:16.284549+0000","last_became_active":"2024-09-12T16:58:27.740278+0000","last_became_peered":"2024-09-12T16:58:27.740278+0000","last_unstale":"2024-09-12T17:37:16.284549+0000","last_undegraded":"2024-09-12T17:37:16.284549+0000","last_fullsized":"2024-09-12T17:37:16.284549+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:39.408264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"265'124","reported_seq":655,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:01.044134+0000","last_change":"2024-09-12T16:58:29.786287+0000","last_active":"2024-09-12T17:40:01.044134+0000","last_peered":"2024-09-12T17:40:01.044134+0000","last_clean":"2024-09-12T17:40:01.044134+0000","last_became_active":"2024-09-12T16:58:29.783969+0000","last_became_peered":"2024-09-12T16:58:29.783969+0000","last_unstale":"2024-09-12T17:40:01.044134+0000","last_undegraded":"2024-09-12T17:40:01.044134+0000","last_fullsized":"2024-09-12T17:40:01.044134+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:00.910931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":564,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":235,"num_read_kb":216,"num_write":292,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"265'255","reported_seq":876,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:12.339198+0000","last_change":"2024-09-12T16:58:21.716389+0000","last_active":"2024-09-12T17:37:12.339198+0000","last_peered":"2024-09-12T17:37:12.339198+0000","last_clean":"2024-09-12T17:37:12.339198+0000","last_became_active":"2024-09-12T16:58:21.715884+0000","last_became_peered":"2024-09-12T16:58:21.715884+0000","last_unstale":"2024-09-12T17:37:12.339198+0000","last_undegraded":"2024-09-12T17:37:12.339198+0000","last_fullsized":"2024-09-12T17:37:12.339198+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:57.326871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1137,"num_read_kb":949,"num_write":435,"num_write_kb":255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"265'297","reported_seq":897,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.332469+0000","last_change":"2024-09-12T16:58:18.705301+0000","last_active":"2024-09-12T17:41:33.332469+0000","last_peered":"2024-09-12T17:41:33.332469+0000","last_clean":"2024-09-12T17:41:33.332469+0000","last_became_active":"2024-09-12T16:58:18.704103+0000","last_became_peered":"2024-09-12T16:58:18.704103+0000","last_unstale":"2024-09-12T17:41:33.332469+0000","last_undegraded":"2024-09-12T17:41:33.332469+0000","last_fullsized":"2024-09-12T17:41:33.332469+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:50.142551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":353,"num_read_kb":15361,"num_write":880,"num_write_kb":40766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:06.265887+0000","last_change":"2024-09-12T16:58:23.714514+0000","last_active":"2024-09-12T17:37:06.265887+0000","last_peered":"2024-09-12T17:37:06.265887+0000","last_clean":"2024-09-12T17:37:06.265887+0000","last_became_active":"2024-09-12T16:58:23.713731+0000","last_became_peered":"2024-09-12T16:58:23.713731+0000","last_unstale":"2024-09-12T17:37:06.265887+0000","last_undegraded":"2024-09-12T17:37:06.265887+0000","last_fullsized":"2024-09-12T17:37:06.265887+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:09.365842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"265'224","reported_seq":782,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.923699+0000","last_change":"2024-09-12T16:58:25.728704+0000","last_active":"2024-09-12T17:41:32.923699+0000","last_peered":"2024-09-12T17:41:32.923699+0000","last_clean":"2024-09-12T17:41:32.923699+0000","last_became_active":"2024-09-12T16:58:25.727897+0000","last_became_peered":"2024-09-12T16:58:25.727897+0000","last_unstale":"2024-09-12T17:41:32.923699+0000","last_undegraded":"2024-09-12T17:41:32.923699+0000","last_fullsized":"2024-09-12T17:41:32.923699+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:09.542441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18508,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":370,"num_read_kb":886,"num_write":300,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:31.285213+0000","last_change":"2024-09-12T16:58:27.736505+0000","last_active":"2024-09-12T17:38:31.285213+0000","last_peered":"2024-09-12T17:38:31.285213+0000","last_clean":"2024-09-12T17:38:31.285213+0000","last_became_active":"2024-09-12T16:58:27.735625+0000","last_became_peered":"2024-09-12T16:58:27.735625+0000","last_unstale":"2024-09-12T17:38:31.285213+0000","last_undegraded":"2024-09-12T17:38:31.285213+0000","last_fullsized":"2024-09-12T17:38:31.285213+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:53.678377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"265'170","reported_seq":1636,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:02.955759+0000","last_change":"2024-09-12T16:58:29.797070+0000","last_active":"2024-09-12T17:40:02.955759+0000","last_peered":"2024-09-12T17:40:02.955759+0000","last_clean":"2024-09-12T17:40:02.955759+0000","last_became_active":"2024-09-12T16:58:29.796358+0000","last_became_peered":"2024-09-12T16:58:29.796358+0000","last_unstale":"2024-09-12T17:40:02.955759+0000","last_undegraded":"2024-09-12T17:40:02.955759+0000","last_fullsized":"2024-09-12T17:40:02.955759+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:36.721617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1235,"num_read_kb":1225,"num_write":375,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"265'197","reported_seq":825,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:30.960561+0000","last_change":"2024-09-12T16:58:21.730823+0000","last_active":"2024-09-12T17:39:30.960561+0000","last_peered":"2024-09-12T17:39:30.960561+0000","last_clean":"2024-09-12T17:39:30.960561+0000","last_became_active":"2024-09-12T16:58:21.730029+0000","last_became_peered":"2024-09-12T16:58:21.730029+0000","last_unstale":"2024-09-12T17:39:30.960561+0000","last_undegraded":"2024-09-12T17:39:30.960561+0000","last_fullsized":"2024-09-12T17:39:30.960561+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:44.982580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":873,"num_read_kb":717,"num_write":316,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"265'359","reported_seq":1001,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.304951+0000","last_change":"2024-09-12T16:58:18.712626+0000","last_active":"2024-09-12T17:41:33.304951+0000","last_peered":"2024-09-12T17:41:33.304951+0000","last_clean":"2024-09-12T17:41:33.304951+0000","last_became_active":"2024-09-12T16:58:18.712291+0000","last_became_peered":"2024-09-12T16:58:18.712291+0000","last_unstale":"2024-09-12T17:41:33.304951+0000","last_undegraded":"2024-09-12T17:41:33.304951+0000","last_fullsized":"2024-09-12T17:41:33.304951+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:27.324406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159793,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":439,"num_read_kb":103450,"num_write":1036,"num_write_kb":48235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:08.681452+0000","last_change":"2024-09-12T16:58:23.725501+0000","last_active":"2024-09-12T17:37:08.681452+0000","last_peered":"2024-09-12T17:37:08.681452+0000","last_clean":"2024-09-12T17:37:08.681452+0000","last_became_active":"2024-09-12T16:58:23.724981+0000","last_became_peered":"2024-09-12T16:58:23.724981+0000","last_unstale":"2024-09-12T17:37:08.681452+0000","last_undegraded":"2024-09-12T17:37:08.681452+0000","last_fullsized":"2024-09-12T17:37:08.681452+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:14.754031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"265'299","reported_seq":882,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.048848+0000","last_change":"2024-09-12T16:58:25.719753+0000","last_active":"2024-09-12T17:41:33.048848+0000","last_peered":"2024-09-12T17:41:33.048848+0000","last_clean":"2024-09-12T17:41:33.048848+0000","last_became_active":"2024-09-12T16:58:25.718962+0000","last_became_peered":"2024-09-12T16:58:25.718962+0000","last_unstale":"2024-09-12T17:41:33.048848+0000","last_undegraded":"2024-09-12T17:41:33.048848+0000","last_fullsized":"2024-09-12T17:41:33.048848+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:19.374426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46580,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":480,"num_read_kb":1058,"num_write":384,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:27.352877+0000","last_change":"2024-09-12T16:58:27.749233+0000","last_active":"2024-09-12T17:38:27.352877+0000","last_peered":"2024-09-12T17:38:27.352877+0000","last_clean":"2024-09-12T17:38:27.352877+0000","last_became_active":"2024-09-12T16:58:27.748503+0000","last_became_peered":"2024-09-12T16:58:27.748503+0000","last_unstale":"2024-09-12T17:38:27.352877+0000","last_undegraded":"2024-09-12T17:38:27.352877+0000","last_fullsized":"2024-09-12T17:38:27.352877+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:00.394978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"265'150","reported_seq":645,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:23.734437+0000","last_change":"2024-09-12T16:58:29.781039+0000","last_active":"2024-09-12T17:41:23.734437+0000","last_peered":"2024-09-12T17:41:23.734437+0000","last_clean":"2024-09-12T17:41:23.734437+0000","last_became_active":"2024-09-12T16:58:29.780363+0000","last_became_peered":"2024-09-12T16:58:29.780363+0000","last_unstale":"2024-09-12T17:41:23.734437+0000","last_undegraded":"2024-09-12T17:41:23.734437+0000","last_fullsized":"2024-09-12T17:41:23.734437+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:21.350835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":838,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":195,"num_read_kb":185,"num_write":368,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"265'45","reported_seq":599,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:36.003227+0000","last_change":"2024-09-12T16:58:21.728691+0000","last_active":"2024-09-12T17:39:36.003227+0000","last_peered":"2024-09-12T17:39:36.003227+0000","last_clean":"2024-09-12T17:39:36.003227+0000","last_became_active":"2024-09-12T16:58:21.728147+0000","last_became_peered":"2024-09-12T16:58:21.728147+0000","last_unstale":"2024-09-12T17:39:36.003227+0000","last_undegraded":"2024-09-12T17:39:36.003227+0000","last_fullsized":"2024-09-12T17:39:36.003227+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:29.002979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":172,"num_write":56,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"265'358","reported_seq":1003,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.342147+0000","last_change":"2024-09-12T16:58:18.702412+0000","last_active":"2024-09-12T17:41:33.342147+0000","last_peered":"2024-09-12T17:41:33.342147+0000","last_clean":"2024-09-12T17:41:33.342147+0000","last_became_active":"2024-09-12T16:58:18.692788+0000","last_became_peered":"2024-09-12T16:58:18.692788+0000","last_unstale":"2024-09-12T17:41:33.342147+0000","last_undegraded":"2024-09-12T17:41:33.342147+0000","last_fullsized":"2024-09-12T17:41:33.342147+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:00.730133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":568,"num_read_kb":2235,"num_write":1205,"num_write_kb":12634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"265'159","reported_seq":772,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:42.258550+0000","last_change":"2024-09-12T16:58:21.727362+0000","last_active":"2024-09-12T17:38:42.258550+0000","last_peered":"2024-09-12T17:38:42.258550+0000","last_clean":"2024-09-12T17:38:42.258550+0000","last_became_active":"2024-09-12T16:58:21.726882+0000","last_became_peered":"2024-09-12T16:58:21.726882+0000","last_unstale":"2024-09-12T17:38:42.258550+0000","last_undegraded":"2024-09-12T17:38:42.258550+0000","last_fullsized":"2024-09-12T17:38:42.258550+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:28.927326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":734,"num_read_kb":607,"num_write":248,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"265'486","reported_seq":1213,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.345461+0000","last_change":"2024-09-12T16:58:18.694523+0000","last_active":"2024-09-12T17:41:33.345461+0000","last_peered":"2024-09-12T17:41:33.345461+0000","last_clean":"2024-09-12T17:41:33.345461+0000","last_became_active":"2024-09-12T16:58:18.693764+0000","last_became_peered":"2024-09-12T16:58:18.693764+0000","last_unstale":"2024-09-12T17:41:33.345461+0000","last_undegraded":"2024-09-12T17:41:33.345461+0000","last_fullsized":"2024-09-12T17:41:33.345461+0000","mapping_epoch":23,"log_start":"265'400","ondisk_log_start":"265'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":400,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:36.280676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1848453,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":919,"num_read_kb":32179,"num_write":1426,"num_write_kb":32850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"265'188","reported_seq":822,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:28.760907+0000","last_change":"2024-09-12T16:58:21.718536+0000","last_active":"2024-09-12T17:38:28.760907+0000","last_peered":"2024-09-12T17:38:28.760907+0000","last_clean":"2024-09-12T17:38:28.760907+0000","last_became_active":"2024-09-12T16:58:21.716793+0000","last_became_peered":"2024-09-12T16:58:21.716793+0000","last_unstale":"2024-09-12T17:38:28.760907+0000","last_undegraded":"2024-09-12T17:38:28.760907+0000","last_fullsized":"2024-09-12T17:38:28.760907+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:03.494777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":842,"num_read_kb":696,"num_write":281,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"265'379","reported_seq":999,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.333691+0000","last_change":"2024-09-12T16:58:18.712375+0000","last_active":"2024-09-12T17:41:33.333691+0000","last_peered":"2024-09-12T17:41:33.333691+0000","last_clean":"2024-09-12T17:41:33.333691+0000","last_became_active":"2024-09-12T16:58:18.711667+0000","last_became_peered":"2024-09-12T16:58:18.711667+0000","last_unstale":"2024-09-12T17:41:33.333691+0000","last_undegraded":"2024-09-12T17:41:33.333691+0000","last_fullsized":"2024-09-12T17:41:33.333691+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:10:09.706153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079973,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":470,"num_read_kb":3460,"num_write":1200,"num_write_kb":27732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"265'217","reported_seq":855,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:28.713747+0000","last_change":"2024-09-12T16:58:21.714181+0000","last_active":"2024-09-12T17:39:28.713747+0000","last_peered":"2024-09-12T17:39:28.713747+0000","last_clean":"2024-09-12T17:39:28.713747+0000","last_became_active":"2024-09-12T16:58:21.713518+0000","last_became_peered":"2024-09-12T16:58:21.713518+0000","last_unstale":"2024-09-12T17:39:28.713747+0000","last_undegraded":"2024-09-12T17:39:28.713747+0000","last_fullsized":"2024-09-12T17:39:28.713747+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":958,"num_read_kb":791,"num_write":328,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"265'335","reported_seq":1076,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.332606+0000","last_change":"2024-09-12T16:58:18.711348+0000","last_active":"2024-09-12T17:41:33.332606+0000","last_peered":"2024-09-12T17:41:33.332606+0000","last_clean":"2024-09-12T17:41:33.332606+0000","last_became_active":"2024-09-12T16:58:18.711021+0000","last_became_peered":"2024-09-12T16:58:18.711021+0000","last_unstale":"2024-09-12T17:41:33.332606+0000","last_undegraded":"2024-09-12T17:41:33.332606+0000","last_fullsized":"2024-09-12T17:41:33.332606+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:07.336724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399320,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":801,"num_read_kb":13816,"num_write":1128,"num_write_kb":16955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"265'187","reported_seq":809,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:35.914369+0000","last_change":"2024-09-12T16:58:55.850452+0000","last_active":"2024-09-12T17:39:35.914369+0000","last_peered":"2024-09-12T17:39:35.914369+0000","last_clean":"2024-09-12T17:39:35.914369+0000","last_became_active":"2024-09-12T16:58:55.849635+0000","last_became_peered":"2024-09-12T16:58:55.849635+0000","last_unstale":"2024-09-12T17:39:35.914369+0000","last_undegraded":"2024-09-12T17:39:35.914369+0000","last_fullsized":"2024-09-12T17:39:35.914369+0000","mapping_epoch":37,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:15.847705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":876,"num_read_kb":735,"num_write":297,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"265'353","reported_seq":1189,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.294081+0000","last_change":"2024-09-12T16:58:18.678586+0000","last_active":"2024-09-12T17:41:33.294081+0000","last_peered":"2024-09-12T17:41:33.294081+0000","last_clean":"2024-09-12T17:41:33.294081+0000","last_became_active":"2024-09-12T16:58:18.677892+0000","last_became_peered":"2024-09-12T16:58:18.677892+0000","last_unstale":"2024-09-12T17:41:33.294081+0000","last_undegraded":"2024-09-12T17:41:33.294081+0000","last_fullsized":"2024-09-12T17:41:33.294081+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:25.218640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3586908,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":894,"num_read_kb":13074,"num_write":1175,"num_write_kb":22747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"265'420","reported_seq":1141,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:52.006442+0000","last_change":"2024-09-12T16:58:21.731074+0000","last_active":"2024-09-12T17:39:52.006442+0000","last_peered":"2024-09-12T17:39:52.006442+0000","last_clean":"2024-09-12T17:39:52.006442+0000","last_became_active":"2024-09-12T16:58:21.729867+0000","last_became_peered":"2024-09-12T16:58:21.729867+0000","last_unstale":"2024-09-12T17:39:52.006442+0000","last_undegraded":"2024-09-12T17:39:52.006442+0000","last_fullsized":"2024-09-12T17:39:52.006442+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:15.044983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1962,"num_read_kb":1662,"num_write":651,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"265'362","reported_seq":1043,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.344674+0000","last_change":"2024-09-12T16:58:18.707438+0000","last_active":"2024-09-12T17:41:33.344674+0000","last_peered":"2024-09-12T17:41:33.344674+0000","last_clean":"2024-09-12T17:41:33.344674+0000","last_became_active":"2024-09-12T16:58:18.707110+0000","last_became_peered":"2024-09-12T16:58:18.707110+0000","last_unstale":"2024-09-12T17:41:33.344674+0000","last_undegraded":"2024-09-12T17:41:33.344674+0000","last_fullsized":"2024-09-12T17:41:33.344674+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:40.132907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079974,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":702,"num_read_kb":1852,"num_write":1120,"num_write_kb":24861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"265'4296","reported_seq":4999,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:01.121603+0000","last_change":"2024-09-12T16:58:55.957719+0000","last_active":"2024-09-12T17:39:01.121603+0000","last_peered":"2024-09-12T17:39:01.121603+0000","last_clean":"2024-09-12T17:39:01.121603+0000","last_became_active":"2024-09-12T16:58:55.957007+0000","last_became_peered":"2024-09-12T16:58:55.957007+0000","last_unstale":"2024-09-12T17:39:01.121603+0000","last_undegraded":"2024-09-12T17:39:01.121603+0000","last_fullsized":"2024-09-12T17:39:01.121603+0000","mapping_epoch":37,"log_start":"265'4200","ondisk_log_start":"265'4200","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":3000,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:31.973980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17379,"num_read_kb":14566,"num_write":6493,"num_write_kb":3276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"265'326","reported_seq":1030,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.348859+0000","last_change":"2024-09-12T16:58:18.715600+0000","last_active":"2024-09-12T17:41:33.348859+0000","last_peered":"2024-09-12T17:41:33.348859+0000","last_clean":"2024-09-12T17:41:33.348859+0000","last_became_active":"2024-09-12T16:58:18.715010+0000","last_became_peered":"2024-09-12T16:58:18.715010+0000","last_unstale":"2024-09-12T17:41:33.348859+0000","last_undegraded":"2024-09-12T17:41:33.348859+0000","last_fullsized":"2024-09-12T17:41:33.348859+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:49.947157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":628,"num_read_kb":2506,"num_write":964,"num_write_kb":15075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"265'104","reported_seq":685,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:45.793141+0000","last_change":"2024-09-12T16:58:21.721630+0000","last_active":"2024-09-12T17:39:45.793141+0000","last_peered":"2024-09-12T17:39:45.793141+0000","last_clean":"2024-09-12T17:39:45.793141+0000","last_became_active":"2024-09-12T16:58:21.720908+0000","last_became_peered":"2024-09-12T16:58:21.720908+0000","last_unstale":"2024-09-12T17:39:45.793141+0000","last_undegraded":"2024-09-12T17:39:45.793141+0000","last_fullsized":"2024-09-12T17:39:45.793141+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:48.720616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":432,"num_read_kb":360,"num_write":161,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"265'387","reported_seq":1108,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.327229+0000","last_change":"2024-09-12T16:58:18.680818+0000","last_active":"2024-09-12T17:41:33.327229+0000","last_peered":"2024-09-12T17:41:33.327229+0000","last_clean":"2024-09-12T17:41:33.327229+0000","last_became_active":"2024-09-12T16:58:18.680305+0000","last_became_peered":"2024-09-12T16:58:18.680305+0000","last_unstale":"2024-09-12T17:41:33.327229+0000","last_undegraded":"2024-09-12T17:41:33.327229+0000","last_fullsized":"2024-09-12T17:41:33.327229+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:01.306922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263201,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":688,"num_read_kb":33513,"num_write":1376,"num_write_kb":33353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"265'175","reported_seq":792,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:04.973943+0000","last_change":"2024-09-12T16:58:21.714631+0000","last_active":"2024-09-12T17:40:04.973943+0000","last_peered":"2024-09-12T17:40:04.973943+0000","last_clean":"2024-09-12T17:40:04.973943+0000","last_became_active":"2024-09-12T16:58:21.713765+0000","last_became_peered":"2024-09-12T16:58:21.713765+0000","last_unstale":"2024-09-12T17:40:04.973943+0000","last_undegraded":"2024-09-12T17:40:04.973943+0000","last_fullsized":"2024-09-12T17:40:04.973943+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:08.424081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":769,"num_read_kb":637,"num_write":246,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"265'365","reported_seq":1014,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.329813+0000","last_change":"2024-09-12T16:58:18.714233+0000","last_active":"2024-09-12T17:41:33.329813+0000","last_peered":"2024-09-12T17:41:33.329813+0000","last_clean":"2024-09-12T17:41:33.329813+0000","last_became_active":"2024-09-12T16:58:18.713629+0000","last_became_peered":"2024-09-12T16:58:18.713629+0000","last_unstale":"2024-09-12T17:41:33.329813+0000","last_undegraded":"2024-09-12T17:41:33.329813+0000","last_fullsized":"2024-09-12T17:41:33.329813+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:39.149486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1369511,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":530,"num_read_kb":40377,"num_write":1157,"num_write_kb":39449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"265'158","reported_seq":728,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:58.305709+0000","last_change":"2024-09-12T16:58:21.719777+0000","last_active":"2024-09-12T17:38:58.305709+0000","last_peered":"2024-09-12T17:38:58.305709+0000","last_clean":"2024-09-12T17:38:58.305709+0000","last_became_active":"2024-09-12T16:58:21.718980+0000","last_became_peered":"2024-09-12T16:58:21.718980+0000","last_unstale":"2024-09-12T17:38:58.305709+0000","last_undegraded":"2024-09-12T17:38:58.305709+0000","last_fullsized":"2024-09-12T17:38:58.305709+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:03.655078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":669,"num_read_kb":540,"num_write":242,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"265'387","reported_seq":1071,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.336515+0000","last_change":"2024-09-12T16:58:18.678862+0000","last_active":"2024-09-12T17:41:33.336515+0000","last_peered":"2024-09-12T17:41:33.336515+0000","last_clean":"2024-09-12T17:41:33.336515+0000","last_became_active":"2024-09-12T16:58:18.678270+0000","last_became_peered":"2024-09-12T16:58:18.678270+0000","last_unstale":"2024-09-12T17:41:33.336515+0000","last_undegraded":"2024-09-12T17:41:33.336515+0000","last_fullsized":"2024-09-12T17:41:33.336515+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:05.439824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":570,"num_read_kb":53855,"num_write":1232,"num_write_kb":47481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"265'252","reported_seq":871,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:00.283451+0000","last_change":"2024-09-12T16:58:21.729663+0000","last_active":"2024-09-12T17:39:00.283451+0000","last_peered":"2024-09-12T17:39:00.283451+0000","last_clean":"2024-09-12T17:39:00.283451+0000","last_became_active":"2024-09-12T16:58:21.729301+0000","last_became_peered":"2024-09-12T16:58:21.729301+0000","last_unstale":"2024-09-12T17:39:00.283451+0000","last_undegraded":"2024-09-12T17:39:00.283451+0000","last_fullsized":"2024-09-12T17:39:00.283451+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:14.701978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1107,"num_read_kb":902,"num_write":427,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"265'444","reported_seq":1117,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.319499+0000","last_change":"2024-09-12T16:58:18.722981+0000","last_active":"2024-09-12T17:41:33.319499+0000","last_peered":"2024-09-12T17:41:33.319499+0000","last_clean":"2024-09-12T17:41:33.319499+0000","last_became_active":"2024-09-12T16:58:18.719658+0000","last_became_peered":"2024-09-12T16:58:18.719658+0000","last_unstale":"2024-09-12T17:41:33.319499+0000","last_undegraded":"2024-09-12T17:41:33.319499+0000","last_fullsized":"2024-09-12T17:41:33.319499+0000","mapping_epoch":23,"log_start":"265'400","ondisk_log_start":"265'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:07.503530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170320,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":708,"num_read_kb":15766,"num_write":1393,"num_write_kb":33267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"265'203","reported_seq":839,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:30.590488+0000","last_change":"2024-09-12T16:58:21.731445+0000","last_active":"2024-09-12T17:39:30.590488+0000","last_peered":"2024-09-12T17:39:30.590488+0000","last_clean":"2024-09-12T17:39:30.590488+0000","last_became_active":"2024-09-12T16:58:21.730589+0000","last_became_peered":"2024-09-12T16:58:21.730589+0000","last_unstale":"2024-09-12T17:39:30.590488+0000","last_undegraded":"2024-09-12T17:39:30.590488+0000","last_fullsized":"2024-09-12T17:39:30.590488+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:55.311260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":887,"num_read_kb":736,"num_write":325,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"265'362","reported_seq":1029,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.316933+0000","last_change":"2024-09-12T16:58:18.692286+0000","last_active":"2024-09-12T17:41:33.316933+0000","last_peered":"2024-09-12T17:41:33.316933+0000","last_clean":"2024-09-12T17:41:33.316933+0000","last_became_active":"2024-09-12T16:58:18.691716+0000","last_became_peered":"2024-09-12T16:58:18.691716+0000","last_unstale":"2024-09-12T17:41:33.316933+0000","last_undegraded":"2024-09-12T17:41:33.316933+0000","last_fullsized":"2024-09-12T17:41:33.316933+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:52.982861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":528,"num_read_kb":37415,"num_write":1121,"num_write_kb":27973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"265'333","reported_seq":938,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:46.416171+0000","last_change":"2024-09-12T16:58:21.723290+0000","last_active":"2024-09-12T17:39:46.416171+0000","last_peered":"2024-09-12T17:39:46.416171+0000","last_clean":"2024-09-12T17:39:46.416171+0000","last_became_active":"2024-09-12T16:58:21.722380+0000","last_became_peered":"2024-09-12T16:58:21.722380+0000","last_unstale":"2024-09-12T17:39:46.416171+0000","last_undegraded":"2024-09-12T17:39:46.416171+0000","last_fullsized":"2024-09-12T17:39:46.416171+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:20.022303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1422,"num_read_kb":1143,"num_write":550,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"265'343","reported_seq":1009,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.331358+0000","last_change":"2024-09-12T16:58:18.709809+0000","last_active":"2024-09-12T17:41:33.331358+0000","last_peered":"2024-09-12T17:41:33.331358+0000","last_clean":"2024-09-12T17:41:33.331358+0000","last_became_active":"2024-09-12T16:58:18.709090+0000","last_became_peered":"2024-09-12T16:58:18.709090+0000","last_unstale":"2024-09-12T17:41:33.331358+0000","last_undegraded":"2024-09-12T17:41:33.331358+0000","last_fullsized":"2024-09-12T17:41:33.331358+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:53.570807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289348,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":537,"num_read_kb":42087,"num_write":1134,"num_write_kb":38244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"265'160","reported_seq":768,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:35.762962+0000","last_change":"2024-09-12T16:58:21.725647+0000","last_active":"2024-09-12T17:39:35.762962+0000","last_peered":"2024-09-12T17:39:35.762962+0000","last_clean":"2024-09-12T17:39:35.762962+0000","last_became_active":"2024-09-12T16:58:21.725262+0000","last_became_peered":"2024-09-12T16:58:21.725262+0000","last_unstale":"2024-09-12T17:39:35.762962+0000","last_undegraded":"2024-09-12T17:39:35.762962+0000","last_fullsized":"2024-09-12T17:39:35.762962+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:15.275246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":648,"num_read_kb":538,"num_write":222,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"265'354","reported_seq":1023,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.233123+0000","last_change":"2024-09-12T16:58:18.713718+0000","last_active":"2024-09-12T17:41:33.233123+0000","last_peered":"2024-09-12T17:41:33.233123+0000","last_clean":"2024-09-12T17:41:33.233123+0000","last_became_active":"2024-09-12T16:58:18.713131+0000","last_became_peered":"2024-09-12T16:58:18.713131+0000","last_unstale":"2024-09-12T17:41:33.233123+0000","last_undegraded":"2024-09-12T17:41:33.233123+0000","last_fullsized":"2024-09-12T17:41:33.233123+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:06.542758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254228,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":564,"num_read_kb":4620,"num_write":1119,"num_write_kb":30053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"265'101","reported_seq":696,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:49.682303+0000","last_change":"2024-09-12T16:58:21.695497+0000","last_active":"2024-09-12T17:39:49.682303+0000","last_peered":"2024-09-12T17:39:49.682303+0000","last_clean":"2024-09-12T17:39:49.682303+0000","last_became_active":"2024-09-12T16:58:21.693930+0000","last_became_peered":"2024-09-12T16:58:21.693930+0000","last_unstale":"2024-09-12T17:39:49.682303+0000","last_undegraded":"2024-09-12T17:39:49.682303+0000","last_fullsized":"2024-09-12T17:39:49.682303+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:50.200124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":454,"num_read_kb":382,"num_write":143,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"265'350","reported_seq":990,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.345028+0000","last_change":"2024-09-12T16:58:18.704503+0000","last_active":"2024-09-12T17:41:33.345028+0000","last_peered":"2024-09-12T17:41:33.345028+0000","last_clean":"2024-09-12T17:41:33.345028+0000","last_became_active":"2024-09-12T16:58:18.704118+0000","last_became_peered":"2024-09-12T16:58:18.704118+0000","last_unstale":"2024-09-12T17:41:33.345028+0000","last_undegraded":"2024-09-12T17:41:33.345028+0000","last_fullsized":"2024-09-12T17:41:33.345028+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:55.559259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079958,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":546,"num_read_kb":7376,"num_write":1271,"num_write_kb":14643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"265'376","reported_seq":966,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:31.294301+0000","last_change":"2024-09-12T16:58:21.716931+0000","last_active":"2024-09-12T17:37:31.294301+0000","last_peered":"2024-09-12T17:37:31.294301+0000","last_clean":"2024-09-12T17:37:31.294301+0000","last_became_active":"2024-09-12T16:58:21.714554+0000","last_became_peered":"2024-09-12T16:58:21.714554+0000","last_unstale":"2024-09-12T17:37:31.294301+0000","last_undegraded":"2024-09-12T17:37:31.294301+0000","last_fullsized":"2024-09-12T17:37:31.294301+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:40.451432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1689,"num_read_kb":1453,"num_write":661,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"265'384","reported_seq":1092,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.248261+0000","last_change":"2024-09-12T16:58:18.722556+0000","last_active":"2024-09-12T17:41:33.248261+0000","last_peered":"2024-09-12T17:41:33.248261+0000","last_clean":"2024-09-12T17:41:33.248261+0000","last_became_active":"2024-09-12T16:58:18.719691+0000","last_became_peered":"2024-09-12T16:58:18.719691+0000","last_unstale":"2024-09-12T17:41:33.248261+0000","last_undegraded":"2024-09-12T17:41:33.248261+0000","last_fullsized":"2024-09-12T17:41:33.248261+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:16.205110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":758,"num_read_kb":7681,"num_write":1308,"num_write_kb":23567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"265'352","reported_seq":1004,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.321711+0000","last_change":"2024-09-12T16:58:18.699166+0000","last_active":"2024-09-12T17:41:33.321711+0000","last_peered":"2024-09-12T17:41:33.321711+0000","last_clean":"2024-09-12T17:41:33.321711+0000","last_became_active":"2024-09-12T16:58:18.698393+0000","last_became_peered":"2024-09-12T16:58:18.698393+0000","last_unstale":"2024-09-12T17:41:33.321711+0000","last_undegraded":"2024-09-12T17:41:33.321711+0000","last_fullsized":"2024-09-12T17:41:33.321711+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:04.059507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":536,"num_read_kb":34677,"num_write":1126,"num_write_kb":53307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"265'106","reported_seq":685,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:25.841940+0000","last_change":"2024-09-12T16:58:21.715263+0000","last_active":"2024-09-12T17:39:25.841940+0000","last_peered":"2024-09-12T17:39:25.841940+0000","last_clean":"2024-09-12T17:39:25.841940+0000","last_became_active":"2024-09-12T16:58:21.714240+0000","last_became_peered":"2024-09-12T16:58:21.714240+0000","last_unstale":"2024-09-12T17:39:25.841940+0000","last_undegraded":"2024-09-12T17:39:25.841940+0000","last_fullsized":"2024-09-12T17:39:25.841940+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:10.058451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":476,"num_read_kb":394,"num_write":172,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"265'361","reported_seq":1040,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.346881+0000","last_change":"2024-09-12T16:58:18.708462+0000","last_active":"2024-09-12T17:41:33.346881+0000","last_peered":"2024-09-12T17:41:33.346881+0000","last_clean":"2024-09-12T17:41:33.346881+0000","last_became_active":"2024-09-12T16:58:18.707649+0000","last_became_peered":"2024-09-12T16:58:18.707649+0000","last_unstale":"2024-09-12T17:41:33.346881+0000","last_undegraded":"2024-09-12T17:41:33.346881+0000","last_fullsized":"2024-09-12T17:41:33.346881+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:18.564808+0000","last_clean_scrub_stamp":"2024-09-12T16:58:18.564808+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:46.590351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":580,"num_read_kb":14659,"num_write":1122,"num_write_kb":33951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"265'4159","reported_seq":4793,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:51.063189+0000","last_change":"2024-09-12T16:58:21.719410+0000","last_active":"2024-09-12T17:39:51.063189+0000","last_peered":"2024-09-12T17:39:51.063189+0000","last_clean":"2024-09-12T17:39:51.063189+0000","last_became_active":"2024-09-12T16:58:21.718537+0000","last_became_peered":"2024-09-12T16:58:21.718537+0000","last_unstale":"2024-09-12T17:39:51.063189+0000","last_undegraded":"2024-09-12T17:39:51.063189+0000","last_fullsized":"2024-09-12T17:39:51.063189+0000","mapping_epoch":26,"log_start":"265'4100","ondisk_log_start":"265'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":3000,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:03.741045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16773,"num_read_kb":14078,"num_write":6250,"num_write_kb":3119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6189,"num_read_kb":4469,"num_write":2002,"num_write_kb":899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":974,"ondisk_log_size":974,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15645,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":16183,"num_read_kb":15867,"num_write":16715,"num_write_kb":4878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1753,"ondisk_log_size":1753,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":509,"ondisk_log_size":509,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1598421,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":17353,"num_read_kb":36703,"num_write":14501,"num_write_kb":11559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1923,"ondisk_log_size":1923,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2412,"num_read_kb":2875,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":102570,"num_read_kb":85739,"num_write":37214,"num_write_kb":18735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4257,"ondisk_log_size":4257,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":74886563,"num_objects":371,"num_object_clones":0,"num_object_copies":742,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":371,"num_whiteouts":0,"num_read":36323,"num_read_kb":1886569,"num_write":72643,"num_write_kb":2069560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":151003136,"data_stored":149773126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3492,"ondisk_log_size":3492,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":211125,"num_write":190,"num_write_kb":136313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1087,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":198791,"num_write":190,"num_write_kb":136313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509968,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":148220,"kb_used_data":36356,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94223620,"statfs":{"total":96636764160,"available":96484986880,"internally_reserved":0,"allocated":37228544,"data_stored":35444692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509967,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":275252,"kb_used_data":27384,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":94096588,"statfs":{"total":96636764160,"available":96354906112,"internally_reserved":0,"allocated":28041216,"data_stored":26261645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":253688263},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509972,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110480,"kb_used_data":11328,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94261360,"statfs":{"total":96636764160,"available":96523632640,"internally_reserved":0,"allocated":11599872,"data_stored":9988574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509967,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280168,"kb_used_data":32472,"kb_used_omap":1,"kb_used_meta":247678,"kb_avail":94091672,"statfs":{"total":96636764160,"available":96349872128,"internally_reserved":0,"allocated":33251328,"data_stored":31541637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":253622725},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542672,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":254264,"kb_used_data":16044,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94117576,"statfs":{"total":96636764160,"available":96376397824,"internally_reserved":0,"allocated":16429056,"data_stored":14715336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":243726795},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542673,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":229300,"kb_used_data":17352,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":94142540,"statfs":{"total":96636764160,"available":96401960960,"internally_reserved":0,"allocated":17768448,"data_stored":16188165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":216725958},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542671,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":115300,"kb_used_data":25780,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94256540,"statfs":{"total":96636764160,"available":96518696960,"internally_reserved":0,"allocated":26398720,"data_stored":24782410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575375,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68208,"kb_used_data":10564,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94303632,"statfs":{"total":96636764160,"available":96566919168,"internally_reserved":0,"allocated":10817536,"data_stored":9242321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28966912,"data_stored":28798943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7954432,"data_stored":7838758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":7192576,"data_stored":7091940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24338432,"data_stored":24108487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":22761472,"data_stored":22631077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":33509376,"data_stored":33292137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14131200,"data_stored":14038127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12148736,"data_stored":11973657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":5371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":5873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:41:40.332 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.333 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.333 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.333 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.333 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.333 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.334 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.334 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.334 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.334 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.334 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.334 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.334 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.334 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.335 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.335 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.335 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.335 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.335 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.335 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.336 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.336 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.336 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.336 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.336 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.336 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.336 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.336 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.336 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.337 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.337 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.337 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.337 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.337 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.337 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.337 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.337 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.337 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.338 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.338 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.338 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.338 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.338 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.338 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.338 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.338 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.338 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.339 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.339 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.339 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.339 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.339 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.339 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.339 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.339 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.339 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.340 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.340 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.340 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.340 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.340 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.340 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.340 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.340 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.341 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.341 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.341 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.341 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.341 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.341 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.341 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.341 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.341 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.342 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.342 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.342 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.342 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.342 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.342 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.342 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.342 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.343 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.343 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.343 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.343 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.343 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.344 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.344 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.344 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.344 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.344 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.344 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.345 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.345 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.345 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.345 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.345 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.345 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.346 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.346 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.346 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.346 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.346 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.346 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.346 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.346 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.347 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.347 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.347 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.347 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.347 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.347 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.347 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.347 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.347 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.348 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.348 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.348 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.348 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.348 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.348 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.348 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.348 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.348 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.349 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.349 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.349 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.349 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.349 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.349 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.349 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.349 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.350 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.350 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.350 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.350 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.350 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.350 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.350 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.350 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.350 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.351 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.351 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.351 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.351 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.351 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.351 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.351 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.351 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.351 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.352 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.352 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.352 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.352 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.352 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.352 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.352 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.352 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.352 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.353 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.353 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.353 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.353 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.353 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.353 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.353 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.353 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.354 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.354 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.354 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.354 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.354 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.354 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.354 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.354 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.354 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.355 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.355 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.355 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.355 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.355 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.355 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.355 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.355 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.355 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.356 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.356 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.356 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.356 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.356 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.356 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.356 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.356 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.357 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.357 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.357 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.357 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.357 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.357 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.357 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.357 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.357 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.358 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.358 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.358 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.358 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.358 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.358 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.358 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.358 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.358 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.359 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.359 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.359 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.359 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.359 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.359 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.360 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.360 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.360 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.360 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.360 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.360 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.360 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.360 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.361 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.361 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.361 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.361 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.361 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T16:58:02.482619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.361 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T16:58:07.519706+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.362 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.362 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.362 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.362 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.362 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.362 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.362 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-12T16:58:07.519706+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.362 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.362 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.363 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.363 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.363 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.363 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.363 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-12T16:58:07.519706+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.364 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.364 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.364 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.364 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.364 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.364 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-12T16:58:07.519706+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.364 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.364 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.364 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.365 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.365 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.365 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.365 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.365 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-12T16:58:07.519706+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.365 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.366 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.366 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.366 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.366 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.367 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.367 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T16:58:07.519706+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.367 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.367 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.367 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.367 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.367 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.368 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.368 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.368 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.368 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.368 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.368 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.369 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-12T16:58:07.519706+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.369 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.369 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.369 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.369 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.369 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.370 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.370 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.370 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.370 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.370 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.370 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.370 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.370 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.371 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.371 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.371 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.371 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.371 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.371 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.371 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.371 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.372 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.372 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.372 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.372 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.372 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.372 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.372 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.372 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.372 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.373 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.373 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.373 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.373 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.373 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.373 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.374 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.374 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.374 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.374 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.374 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.375 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.375 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.375 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.375 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.375 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.375 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.375 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.376 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.376 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.376 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.376 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.376 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.376 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.376 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.376 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.376 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.377 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.377 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.377 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.377 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.377 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.377 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.377 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.377 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.378 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.378 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.378 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.378 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.378 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.378 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.378 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.378 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.379 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.379 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.379 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.379 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.379 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.379 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.379 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.379 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.379 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.380 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.380 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.380 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.380 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.380 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.380 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.380 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.380 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.381 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.381 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.381 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.381 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.381 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.381 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.381 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.381 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.381 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.382 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.382 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.382 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.382 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.382 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.382 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.382 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.382 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.382 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.383 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.383 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.383 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-12T16:58:18.564808+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.383 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:41:40.383 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T17:42:00.384 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:42:00.751 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:42:00.763 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-09-12T17:42:00.769 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":1577,"stamp":"2024-09-12T17:41:59.810527+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":77092809,"num_objects":701,"num_object_clones":0,"num_object_copies":1402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":701,"num_whiteouts":0,"num_read":181455,"num_read_kb":2442205,"num_write":143598,"num_write_kb":2379913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1087,"num_keys_recovered":0,"num_objects_omap":62,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":50042,"num_omap_keys":194,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13465,"ondisk_log_size":13465,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1502400,"kb_used_data":177280,"kb_used_omap":12,"kb_used_meta":1324979,"kb_avail":753472320,"statfs":{"total":773094113280,"available":771555655680,"internally_reserved":0,"allocated":181534720,"data_stored":168164780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1356779057},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,2,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":49282,"num_omap_keys":190,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009609"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:17.322563+0000","last_change":"2024-09-12T17:27:17.404693+0000","last_active":"2024-09-12T17:37:17.322563+0000","last_peered":"2024-09-12T17:37:17.322563+0000","last_clean":"2024-09-12T17:37:17.322563+0000","last_became_active":"2024-09-12T17:27:17.403833+0000","last_became_peered":"2024-09-12T17:27:17.403833+0000","last_unstale":"2024-09-12T17:37:17.322563+0000","last_undegraded":"2024-09-12T17:37:17.322563+0000","last_fullsized":"2024-09-12T17:37:17.322563+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:43.551735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"265'5","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:42.368823+0000","last_change":"2024-09-12T17:15:43.159517+0000","last_active":"2024-09-12T17:40:42.368823+0000","last_peered":"2024-09-12T17:40:42.368823+0000","last_clean":"2024-09-12T17:40:42.368823+0000","last_became_active":"2024-09-12T17:15:43.158714+0000","last_became_peered":"2024-09-12T17:15:43.158714+0000","last_unstale":"2024-09-12T17:40:42.368823+0000","last_undegraded":"2024-09-12T17:40:42.368823+0000","last_fullsized":"2024-09-12T17:40:42.368823+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:19.068813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"262'2","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:12.353310+0000","last_change":"2024-09-12T17:15:40.126960+0000","last_active":"2024-09-12T17:38:12.353310+0000","last_peered":"2024-09-12T17:38:12.353310+0000","last_clean":"2024-09-12T17:38:12.353310+0000","last_became_active":"2024-09-12T17:15:40.126170+0000","last_became_peered":"2024-09-12T17:15:40.126170+0000","last_unstale":"2024-09-12T17:38:12.353310+0000","last_undegraded":"2024-09-12T17:38:12.353310+0000","last_fullsized":"2024-09-12T17:38:12.353310+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:57.038622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"265'24","reported_seq":111,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:57.361076+0000","last_change":"2024-09-12T17:13:54.846274+0000","last_active":"2024-09-12T17:38:57.361076+0000","last_peered":"2024-09-12T17:38:57.361076+0000","last_clean":"2024-09-12T17:38:57.361076+0000","last_became_active":"2024-09-12T17:13:54.845556+0000","last_became_peered":"2024-09-12T17:13:54.845556+0000","last_unstale":"2024-09-12T17:38:57.361076+0000","last_undegraded":"2024-09-12T17:38:57.361076+0000","last_fullsized":"2024-09-12T17:38:57.361076+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:34.627718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":82,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:20.262014+0000","last_change":"2024-09-12T17:27:17.422429+0000","last_active":"2024-09-12T17:37:20.262014+0000","last_peered":"2024-09-12T17:37:20.262014+0000","last_clean":"2024-09-12T17:37:20.262014+0000","last_became_active":"2024-09-12T17:27:17.421771+0000","last_became_peered":"2024-09-12T17:27:17.421771+0000","last_unstale":"2024-09-12T17:37:20.262014+0000","last_undegraded":"2024-09-12T17:37:20.262014+0000","last_fullsized":"2024-09-12T17:37:20.262014+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:44.139866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:16.281883+0000","last_change":"2024-09-12T17:15:43.160447+0000","last_active":"2024-09-12T17:38:16.281883+0000","last_peered":"2024-09-12T17:38:16.281883+0000","last_clean":"2024-09-12T17:38:16.281883+0000","last_became_active":"2024-09-12T17:15:43.159316+0000","last_became_peered":"2024-09-12T17:15:43.159316+0000","last_unstale":"2024-09-12T17:38:16.281883+0000","last_undegraded":"2024-09-12T17:38:16.281883+0000","last_fullsized":"2024-09-12T17:38:16.281883+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:44.109670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"265'7","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:43.729290+0000","last_change":"2024-09-12T17:15:40.126819+0000","last_active":"2024-09-12T17:40:43.729290+0000","last_peered":"2024-09-12T17:40:43.729290+0000","last_clean":"2024-09-12T17:40:43.729290+0000","last_became_active":"2024-09-12T17:15:40.126087+0000","last_became_peered":"2024-09-12T17:15:40.126087+0000","last_unstale":"2024-09-12T17:40:43.729290+0000","last_undegraded":"2024-09-12T17:40:43.729290+0000","last_fullsized":"2024-09-12T17:40:43.729290+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:09.968319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":1026,"num_write":12,"num_write_kb":5122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"265'36","reported_seq":144,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:19.460209+0000","last_change":"2024-09-12T17:13:54.838770+0000","last_active":"2024-09-12T17:38:19.460209+0000","last_peered":"2024-09-12T17:38:19.460209+0000","last_clean":"2024-09-12T17:38:19.460209+0000","last_became_active":"2024-09-12T17:13:54.837820+0000","last_became_peered":"2024-09-12T17:13:54.837820+0000","last_unstale":"2024-09-12T17:38:19.460209+0000","last_undegraded":"2024-09-12T17:38:19.460209+0000","last_fullsized":"2024-09-12T17:38:19.460209+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:56:27.573050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":180,"num_read_kb":123,"num_write":74,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:21.311643+0000","last_change":"2024-09-12T17:27:17.406442+0000","last_active":"2024-09-12T17:39:21.311643+0000","last_peered":"2024-09-12T17:39:21.311643+0000","last_clean":"2024-09-12T17:39:21.311643+0000","last_became_active":"2024-09-12T17:27:17.405657+0000","last_became_peered":"2024-09-12T17:27:17.405657+0000","last_unstale":"2024-09-12T17:39:21.311643+0000","last_undegraded":"2024-09-12T17:39:21.311643+0000","last_fullsized":"2024-09-12T17:39:21.311643+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:37.355505+0000","last_change":"2024-09-12T17:15:43.869720+0000","last_active":"2024-09-12T17:38:37.355505+0000","last_peered":"2024-09-12T17:38:37.355505+0000","last_clean":"2024-09-12T17:38:37.355505+0000","last_became_active":"2024-09-12T17:15:43.868960+0000","last_became_peered":"2024-09-12T17:15:43.868960+0000","last_unstale":"2024-09-12T17:38:37.355505+0000","last_undegraded":"2024-09-12T17:38:37.355505+0000","last_fullsized":"2024-09-12T17:38:37.355505+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:01.285114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"262'2","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:45.291859+0000","last_change":"2024-09-12T17:15:40.135488+0000","last_active":"2024-09-12T17:39:45.291859+0000","last_peered":"2024-09-12T17:39:45.291859+0000","last_clean":"2024-09-12T17:39:45.291859+0000","last_became_active":"2024-09-12T17:15:40.134513+0000","last_became_peered":"2024-09-12T17:15:40.134513+0000","last_unstale":"2024-09-12T17:39:45.291859+0000","last_undegraded":"2024-09-12T17:39:45.291859+0000","last_fullsized":"2024-09-12T17:39:45.291859+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"265'19","reported_seq":94,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:57.360940+0000","last_change":"2024-09-12T17:13:54.827570+0000","last_active":"2024-09-12T17:38:57.360940+0000","last_peered":"2024-09-12T17:38:57.360940+0000","last_clean":"2024-09-12T17:38:57.360940+0000","last_became_active":"2024-09-12T17:13:54.826480+0000","last_became_peered":"2024-09-12T17:13:54.826480+0000","last_unstale":"2024-09-12T17:38:57.360940+0000","last_undegraded":"2024-09-12T17:38:57.360940+0000","last_fullsized":"2024-09-12T17:38:57.360940+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:09.477709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:27.371439+0000","last_change":"2024-09-12T17:27:17.419282+0000","last_active":"2024-09-12T17:39:27.371439+0000","last_peered":"2024-09-12T17:39:27.371439+0000","last_clean":"2024-09-12T17:39:27.371439+0000","last_became_active":"2024-09-12T17:27:17.418519+0000","last_became_peered":"2024-09-12T17:27:17.418519+0000","last_unstale":"2024-09-12T17:39:27.371439+0000","last_undegraded":"2024-09-12T17:39:27.371439+0000","last_fullsized":"2024-09-12T17:39:27.371439+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"265'2","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.775211+0000","last_change":"2024-09-12T17:15:43.869355+0000","last_active":"2024-09-12T17:41:32.775211+0000","last_peered":"2024-09-12T17:41:32.775211+0000","last_clean":"2024-09-12T17:41:32.775211+0000","last_became_active":"2024-09-12T17:15:43.868600+0000","last_became_peered":"2024-09-12T17:15:43.868600+0000","last_unstale":"2024-09-12T17:41:32.775211+0000","last_undegraded":"2024-09-12T17:41:32.775211+0000","last_fullsized":"2024-09-12T17:41:32.775211+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"262'3","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:36.286516+0000","last_change":"2024-09-12T17:15:40.109807+0000","last_active":"2024-09-12T17:38:36.286516+0000","last_peered":"2024-09-12T17:38:36.286516+0000","last_clean":"2024-09-12T17:38:36.286516+0000","last_became_active":"2024-09-12T17:15:40.109161+0000","last_became_peered":"2024-09-12T17:15:40.109161+0000","last_unstale":"2024-09-12T17:38:36.286516+0000","last_undegraded":"2024-09-12T17:38:36.286516+0000","last_fullsized":"2024-09-12T17:38:36.286516+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:38.091651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"265'31","reported_seq":127,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:28.552554+0000","last_change":"2024-09-12T17:13:54.839575+0000","last_active":"2024-09-12T17:39:28.552554+0000","last_peered":"2024-09-12T17:39:28.552554+0000","last_clean":"2024-09-12T17:39:28.552554+0000","last_became_active":"2024-09-12T17:13:54.838968+0000","last_became_peered":"2024-09-12T17:13:54.838968+0000","last_unstale":"2024-09-12T17:39:28.552554+0000","last_undegraded":"2024-09-12T17:39:28.552554+0000","last_fullsized":"2024-09-12T17:39:28.552554+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:01.149483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":108,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:22.370396+0000","last_change":"2024-09-12T17:27:17.418362+0000","last_active":"2024-09-12T17:39:22.370396+0000","last_peered":"2024-09-12T17:39:22.370396+0000","last_clean":"2024-09-12T17:39:22.370396+0000","last_became_active":"2024-09-12T17:27:17.416509+0000","last_became_peered":"2024-09-12T17:27:17.416509+0000","last_unstale":"2024-09-12T17:39:22.370396+0000","last_undegraded":"2024-09-12T17:39:22.370396+0000","last_fullsized":"2024-09-12T17:39:22.370396+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:54.908041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"265'11","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:57.358703+0000","last_change":"2024-09-12T17:15:43.163407+0000","last_active":"2024-09-12T17:39:57.358703+0000","last_peered":"2024-09-12T17:39:57.358703+0000","last_clean":"2024-09-12T17:39:57.358703+0000","last_became_active":"2024-09-12T17:15:43.162643+0000","last_became_peered":"2024-09-12T17:15:43.162643+0000","last_unstale":"2024-09-12T17:39:57.358703+0000","last_undegraded":"2024-09-12T17:39:57.358703+0000","last_fullsized":"2024-09-12T17:39:57.358703+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:26.465579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":23650,"num_write":16,"num_write_kb":11312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"265'10","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.608802+0000","last_change":"2024-09-12T17:15:40.111961+0000","last_active":"2024-09-12T17:41:32.608802+0000","last_peered":"2024-09-12T17:41:32.608802+0000","last_clean":"2024-09-12T17:41:32.608802+0000","last_became_active":"2024-09-12T17:15:40.111105+0000","last_became_peered":"2024-09-12T17:15:40.111105+0000","last_unstale":"2024-09-12T17:41:32.608802+0000","last_undegraded":"2024-09-12T17:41:32.608802+0000","last_fullsized":"2024-09-12T17:41:32.608802+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:17.726065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":20,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"265'54","reported_seq":197,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:31.662260+0000","last_change":"2024-09-12T17:13:54.842088+0000","last_active":"2024-09-12T17:39:31.662260+0000","last_peered":"2024-09-12T17:39:31.662260+0000","last_clean":"2024-09-12T17:39:31.662260+0000","last_became_active":"2024-09-12T17:13:54.841072+0000","last_became_peered":"2024-09-12T17:13:54.841072+0000","last_unstale":"2024-09-12T17:39:31.662260+0000","last_undegraded":"2024-09-12T17:39:31.662260+0000","last_fullsized":"2024-09-12T17:39:31.662260+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:22:11.118120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":282,"num_read_kb":222,"num_write":88,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:48.718701+0000","last_change":"2024-09-12T17:27:17.410975+0000","last_active":"2024-09-12T17:39:48.718701+0000","last_peered":"2024-09-12T17:39:48.718701+0000","last_clean":"2024-09-12T17:39:48.718701+0000","last_became_active":"2024-09-12T17:27:17.392355+0000","last_became_peered":"2024-09-12T17:27:17.392355+0000","last_unstale":"2024-09-12T17:39:48.718701+0000","last_undegraded":"2024-09-12T17:39:48.718701+0000","last_fullsized":"2024-09-12T17:39:48.718701+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"265'4","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:56.319320+0000","last_change":"2024-09-12T17:15:57.748482+0000","last_active":"2024-09-12T17:39:56.319320+0000","last_peered":"2024-09-12T17:39:56.319320+0000","last_clean":"2024-09-12T17:39:56.319320+0000","last_became_active":"2024-09-12T17:15:57.742342+0000","last_became_peered":"2024-09-12T17:15:57.742342+0000","last_unstale":"2024-09-12T17:39:56.319320+0000","last_undegraded":"2024-09-12T17:39:56.319320+0000","last_fullsized":"2024-09-12T17:39:56.319320+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:00.488944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1087,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:36.272606+0000","last_change":"2024-09-12T17:15:40.120329+0000","last_active":"2024-09-12T17:37:36.272606+0000","last_peered":"2024-09-12T17:37:36.272606+0000","last_clean":"2024-09-12T17:37:36.272606+0000","last_became_active":"2024-09-12T17:15:40.119439+0000","last_became_peered":"2024-09-12T17:15:40.119439+0000","last_unstale":"2024-09-12T17:37:36.272606+0000","last_undegraded":"2024-09-12T17:37:36.272606+0000","last_fullsized":"2024-09-12T17:37:36.272606+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:50.536461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"265'35","reported_seq":142,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:56.306273+0000","last_change":"2024-09-12T17:13:54.842916+0000","last_active":"2024-09-12T17:38:56.306273+0000","last_peered":"2024-09-12T17:38:56.306273+0000","last_clean":"2024-09-12T17:38:56.306273+0000","last_became_active":"2024-09-12T17:13:54.842215+0000","last_became_peered":"2024-09-12T17:13:54.842215+0000","last_unstale":"2024-09-12T17:38:56.306273+0000","last_undegraded":"2024-09-12T17:38:56.306273+0000","last_fullsized":"2024-09-12T17:38:56.306273+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:02.592935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":135,"num_write":51,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"265'1","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:21.291709+0000","last_change":"2024-09-12T17:27:17.415995+0000","last_active":"2024-09-12T17:37:21.291709+0000","last_peered":"2024-09-12T17:37:21.291709+0000","last_clean":"2024-09-12T17:37:21.291709+0000","last_became_active":"2024-09-12T17:27:17.415277+0000","last_became_peered":"2024-09-12T17:27:17.415277+0000","last_unstale":"2024-09-12T17:37:21.291709+0000","last_undegraded":"2024-09-12T17:37:21.291709+0000","last_fullsized":"2024-09-12T17:37:21.291709+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:19.223166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"265'4","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:46.331410+0000","last_change":"2024-09-12T17:15:43.172814+0000","last_active":"2024-09-12T17:40:46.331410+0000","last_peered":"2024-09-12T17:40:46.331410+0000","last_clean":"2024-09-12T17:40:46.331410+0000","last_became_active":"2024-09-12T17:15:43.172142+0000","last_became_peered":"2024-09-12T17:15:43.172142+0000","last_unstale":"2024-09-12T17:40:46.331410+0000","last_undegraded":"2024-09-12T17:40:46.331410+0000","last_fullsized":"2024-09-12T17:40:46.331410+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:41.542977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"262'4","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:11.280709+0000","last_change":"2024-09-12T17:15:40.109940+0000","last_active":"2024-09-12T17:38:11.280709+0000","last_peered":"2024-09-12T17:38:11.280709+0000","last_clean":"2024-09-12T17:38:11.280709+0000","last_became_active":"2024-09-12T17:15:40.109076+0000","last_became_peered":"2024-09-12T17:15:40.109076+0000","last_unstale":"2024-09-12T17:38:11.280709+0000","last_undegraded":"2024-09-12T17:38:11.280709+0000","last_fullsized":"2024-09-12T17:38:11.280709+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:05.822624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"262'6","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:12.349294+0000","last_change":"2024-09-12T17:13:54.820144+0000","last_active":"2024-09-12T17:38:12.349294+0000","last_peered":"2024-09-12T17:38:12.349294+0000","last_clean":"2024-09-12T17:38:12.349294+0000","last_became_active":"2024-09-12T17:13:54.819399+0000","last_became_peered":"2024-09-12T17:13:54.819399+0000","last_unstale":"2024-09-12T17:38:12.349294+0000","last_undegraded":"2024-09-12T17:38:12.349294+0000","last_fullsized":"2024-09-12T17:38:12.349294+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:25.721158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:21.291799+0000","last_change":"2024-09-12T17:27:17.420256+0000","last_active":"2024-09-12T17:37:21.291799+0000","last_peered":"2024-09-12T17:37:21.291799+0000","last_clean":"2024-09-12T17:37:21.291799+0000","last_became_active":"2024-09-12T17:27:17.419839+0000","last_became_peered":"2024-09-12T17:27:17.419839+0000","last_unstale":"2024-09-12T17:37:21.291799+0000","last_undegraded":"2024-09-12T17:37:21.291799+0000","last_fullsized":"2024-09-12T17:37:21.291799+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:46.578295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"265'5","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:42.388952+0000","last_change":"2024-09-12T17:15:43.160492+0000","last_active":"2024-09-12T17:40:42.388952+0000","last_peered":"2024-09-12T17:40:42.388952+0000","last_clean":"2024-09-12T17:40:42.388952+0000","last_became_active":"2024-09-12T17:15:43.159663+0000","last_became_peered":"2024-09-12T17:15:43.159663+0000","last_unstale":"2024-09-12T17:40:42.388952+0000","last_undegraded":"2024-09-12T17:40:42.388952+0000","last_fullsized":"2024-09-12T17:40:42.388952+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:48.671220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":23,"num_write":10,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"265'2","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:42.384696+0000","last_change":"2024-09-12T17:15:40.131992+0000","last_active":"2024-09-12T17:40:42.384696+0000","last_peered":"2024-09-12T17:40:42.384696+0000","last_clean":"2024-09-12T17:40:42.384696+0000","last_became_active":"2024-09-12T17:15:40.131140+0000","last_became_peered":"2024-09-12T17:15:40.131140+0000","last_unstale":"2024-09-12T17:40:42.384696+0000","last_undegraded":"2024-09-12T17:40:42.384696+0000","last_fullsized":"2024-09-12T17:40:42.384696+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:26.319835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"265'19","reported_seq":94,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:08.694781+0000","last_change":"2024-09-12T17:13:54.832206+0000","last_active":"2024-09-12T17:38:08.694781+0000","last_peered":"2024-09-12T17:38:08.694781+0000","last_clean":"2024-09-12T17:38:08.694781+0000","last_became_active":"2024-09-12T17:13:54.831374+0000","last_became_peered":"2024-09-12T17:13:54.831374+0000","last_unstale":"2024-09-12T17:38:08.694781+0000","last_undegraded":"2024-09-12T17:38:08.694781+0000","last_fullsized":"2024-09-12T17:38:08.694781+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:25.250277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:58.706411+0000","last_change":"2024-09-12T17:27:17.416704+0000","last_active":"2024-09-12T17:38:58.706411+0000","last_peered":"2024-09-12T17:38:58.706411+0000","last_clean":"2024-09-12T17:38:58.706411+0000","last_became_active":"2024-09-12T17:27:17.415918+0000","last_became_peered":"2024-09-12T17:27:17.415918+0000","last_unstale":"2024-09-12T17:38:58.706411+0000","last_undegraded":"2024-09-12T17:38:58.706411+0000","last_fullsized":"2024-09-12T17:38:58.706411+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:40.069574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"265'4","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:52.377797+0000","last_change":"2024-09-12T17:15:43.872202+0000","last_active":"2024-09-12T17:39:52.377797+0000","last_peered":"2024-09-12T17:39:52.377797+0000","last_clean":"2024-09-12T17:39:52.377797+0000","last_became_active":"2024-09-12T17:15:43.871380+0000","last_became_peered":"2024-09-12T17:15:43.871380+0000","last_unstale":"2024-09-12T17:39:52.377797+0000","last_undegraded":"2024-09-12T17:39:52.377797+0000","last_fullsized":"2024-09-12T17:39:52.377797+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:54.178710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"265'4","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.733120+0000","last_change":"2024-09-12T17:15:40.117517+0000","last_active":"2024-09-12T17:41:32.733120+0000","last_peered":"2024-09-12T17:41:32.733120+0000","last_clean":"2024-09-12T17:41:32.733120+0000","last_became_active":"2024-09-12T17:15:40.116781+0000","last_became_peered":"2024-09-12T17:15:40.116781+0000","last_unstale":"2024-09-12T17:41:32.733120+0000","last_undegraded":"2024-09-12T17:41:32.733120+0000","last_fullsized":"2024-09-12T17:41:32.733120+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:04.218708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":7168,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"265'68","reported_seq":230,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:31.441127+0000","last_change":"2024-09-12T17:13:54.830908+0000","last_active":"2024-09-12T17:39:31.441127+0000","last_peered":"2024-09-12T17:39:31.441127+0000","last_clean":"2024-09-12T17:39:31.441127+0000","last_became_active":"2024-09-12T17:13:54.829335+0000","last_became_peered":"2024-09-12T17:13:54.829335+0000","last_unstale":"2024-09-12T17:39:31.441127+0000","last_undegraded":"2024-09-12T17:39:31.441127+0000","last_fullsized":"2024-09-12T17:39:31.441127+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:18:25.184524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":349,"num_read_kb":240,"num_write":120,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"265'1","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:00.283371+0000","last_change":"2024-09-12T17:27:17.410174+0000","last_active":"2024-09-12T17:39:00.283371+0000","last_peered":"2024-09-12T17:39:00.283371+0000","last_clean":"2024-09-12T17:39:00.283371+0000","last_became_active":"2024-09-12T17:27:17.409364+0000","last_became_peered":"2024-09-12T17:27:17.409364+0000","last_unstale":"2024-09-12T17:39:00.283371+0000","last_undegraded":"2024-09-12T17:39:00.283371+0000","last_fullsized":"2024-09-12T17:39:00.283371+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:34.250496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"265'2","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:27.397626+0000","last_change":"2024-09-12T17:15:43.875351+0000","last_active":"2024-09-12T17:41:27.397626+0000","last_peered":"2024-09-12T17:41:27.397626+0000","last_clean":"2024-09-12T17:41:27.397626+0000","last_became_active":"2024-09-12T17:15:43.874421+0000","last_became_peered":"2024-09-12T17:15:43.874421+0000","last_unstale":"2024-09-12T17:41:27.397626+0000","last_undegraded":"2024-09-12T17:41:27.397626+0000","last_fullsized":"2024-09-12T17:41:27.397626+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:12.382448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"265'4","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.400829+0000","last_change":"2024-09-12T17:15:40.127851+0000","last_active":"2024-09-12T17:41:32.400829+0000","last_peered":"2024-09-12T17:41:32.400829+0000","last_clean":"2024-09-12T17:41:32.400829+0000","last_became_active":"2024-09-12T17:15:40.126898+0000","last_became_peered":"2024-09-12T17:15:40.126898+0000","last_unstale":"2024-09-12T17:41:32.400829+0000","last_undegraded":"2024-09-12T17:41:32.400829+0000","last_fullsized":"2024-09-12T17:41:32.400829+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:27.692907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"265'19","reported_seq":92,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:07.352095+0000","last_change":"2024-09-12T17:13:54.833584+0000","last_active":"2024-09-12T17:38:07.352095+0000","last_peered":"2024-09-12T17:38:07.352095+0000","last_clean":"2024-09-12T17:38:07.352095+0000","last_became_active":"2024-09-12T17:13:54.832780+0000","last_became_peered":"2024-09-12T17:13:54.832780+0000","last_unstale":"2024-09-12T17:38:07.352095+0000","last_undegraded":"2024-09-12T17:38:07.352095+0000","last_fullsized":"2024-09-12T17:38:07.352095+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:33.420620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":55,"num_write":40,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:01.315516+0000","last_change":"2024-09-12T17:27:17.415211+0000","last_active":"2024-09-12T17:39:01.315516+0000","last_peered":"2024-09-12T17:39:01.315516+0000","last_clean":"2024-09-12T17:39:01.315516+0000","last_became_active":"2024-09-12T17:27:17.414739+0000","last_became_peered":"2024-09-12T17:27:17.414739+0000","last_unstale":"2024-09-12T17:39:01.315516+0000","last_undegraded":"2024-09-12T17:39:01.315516+0000","last_fullsized":"2024-09-12T17:39:01.315516+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:57.434689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"265'5","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:52.377909+0000","last_change":"2024-09-12T17:15:43.872275+0000","last_active":"2024-09-12T17:39:52.377909+0000","last_peered":"2024-09-12T17:39:52.377909+0000","last_clean":"2024-09-12T17:39:52.377909+0000","last_became_active":"2024-09-12T17:15:43.871502+0000","last_became_peered":"2024-09-12T17:15:43.871502+0000","last_unstale":"2024-09-12T17:39:52.377909+0000","last_undegraded":"2024-09-12T17:39:52.377909+0000","last_fullsized":"2024-09-12T17:39:52.377909+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:07.859526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"265'5","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.236206+0000","last_change":"2024-09-12T17:15:40.133504+0000","last_active":"2024-09-12T17:41:32.236206+0000","last_peered":"2024-09-12T17:41:32.236206+0000","last_clean":"2024-09-12T17:41:32.236206+0000","last_became_active":"2024-09-12T17:15:40.132311+0000","last_became_peered":"2024-09-12T17:15:40.132311+0000","last_unstale":"2024-09-12T17:41:32.236206+0000","last_undegraded":"2024-09-12T17:41:32.236206+0000","last_fullsized":"2024-09-12T17:41:32.236206+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:42.985929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"265'33","reported_seq":136,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:05.271852+0000","last_change":"2024-09-12T17:13:54.828548+0000","last_active":"2024-09-12T17:38:05.271852+0000","last_peered":"2024-09-12T17:38:05.271852+0000","last_clean":"2024-09-12T17:38:05.271852+0000","last_became_active":"2024-09-12T17:13:54.827785+0000","last_became_peered":"2024-09-12T17:13:54.827785+0000","last_unstale":"2024-09-12T17:38:05.271852+0000","last_undegraded":"2024-09-12T17:38:05.271852+0000","last_fullsized":"2024-09-12T17:38:05.271852+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:29.075567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":116,"num_write":64,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:57.345260+0000","last_change":"2024-09-12T17:27:17.391923+0000","last_active":"2024-09-12T17:38:57.345260+0000","last_peered":"2024-09-12T17:38:57.345260+0000","last_clean":"2024-09-12T17:38:57.345260+0000","last_became_active":"2024-09-12T17:27:17.391154+0000","last_became_peered":"2024-09-12T17:27:17.391154+0000","last_unstale":"2024-09-12T17:38:57.345260+0000","last_undegraded":"2024-09-12T17:38:57.345260+0000","last_fullsized":"2024-09-12T17:38:57.345260+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:12.682141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"265'13","reported_seq":60,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.774812+0000","last_change":"2024-09-12T17:15:43.171314+0000","last_active":"2024-09-12T17:41:32.774812+0000","last_peered":"2024-09-12T17:41:32.774812+0000","last_clean":"2024-09-12T17:41:32.774812+0000","last_became_active":"2024-09-12T17:15:43.169085+0000","last_became_peered":"2024-09-12T17:15:43.169085+0000","last_unstale":"2024-09-12T17:41:32.774812+0000","last_undegraded":"2024-09-12T17:41:32.774812+0000","last_fullsized":"2024-09-12T17:41:32.774812+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:01.989288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":43010,"num_write":18,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"265'2","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:52.374200+0000","last_change":"2024-09-12T17:15:40.139824+0000","last_active":"2024-09-12T17:39:52.374200+0000","last_peered":"2024-09-12T17:39:52.374200+0000","last_clean":"2024-09-12T17:39:52.374200+0000","last_became_active":"2024-09-12T17:15:40.139145+0000","last_became_peered":"2024-09-12T17:15:40.139145+0000","last_unstale":"2024-09-12T17:39:52.374200+0000","last_undegraded":"2024-09-12T17:39:52.374200+0000","last_fullsized":"2024-09-12T17:39:52.374200+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:52:16.027902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"265'28","reported_seq":124,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:38.948450+0000","last_change":"2024-09-12T17:13:54.843550+0000","last_active":"2024-09-12T17:38:38.948450+0000","last_peered":"2024-09-12T17:38:38.948450+0000","last_clean":"2024-09-12T17:38:38.948450+0000","last_became_active":"2024-09-12T17:13:54.842816+0000","last_became_peered":"2024-09-12T17:13:54.842816+0000","last_unstale":"2024-09-12T17:38:38.948450+0000","last_undegraded":"2024-09-12T17:38:38.948450+0000","last_fullsized":"2024-09-12T17:38:38.948450+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:02.403853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":108,"num_write":46,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:22.370428+0000","last_change":"2024-09-12T17:27:17.422713+0000","last_active":"2024-09-12T17:39:22.370428+0000","last_peered":"2024-09-12T17:39:22.370428+0000","last_clean":"2024-09-12T17:39:22.370428+0000","last_became_active":"2024-09-12T17:27:17.421939+0000","last_became_peered":"2024-09-12T17:27:17.421939+0000","last_unstale":"2024-09-12T17:39:22.370428+0000","last_undegraded":"2024-09-12T17:39:22.370428+0000","last_fullsized":"2024-09-12T17:39:22.370428+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"262'8","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:03.708024+0000","last_change":"2024-09-12T17:15:43.162064+0000","last_active":"2024-09-12T17:39:03.708024+0000","last_peered":"2024-09-12T17:39:03.708024+0000","last_clean":"2024-09-12T17:39:03.708024+0000","last_became_active":"2024-09-12T17:15:43.158530+0000","last_became_peered":"2024-09-12T17:15:43.158530+0000","last_unstale":"2024-09-12T17:39:03.708024+0000","last_undegraded":"2024-09-12T17:39:03.708024+0000","last_fullsized":"2024-09-12T17:39:03.708024+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:52.110653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10242,"num_write":8,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"265'5","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.607865+0000","last_change":"2024-09-12T17:15:40.131385+0000","last_active":"2024-09-12T17:41:32.607865+0000","last_peered":"2024-09-12T17:41:32.607865+0000","last_clean":"2024-09-12T17:41:32.607865+0000","last_became_active":"2024-09-12T17:15:40.130644+0000","last_became_peered":"2024-09-12T17:15:40.130644+0000","last_unstale":"2024-09-12T17:41:32.607865+0000","last_undegraded":"2024-09-12T17:41:32.607865+0000","last_fullsized":"2024-09-12T17:41:32.607865+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:14.166806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"265'14","reported_seq":89,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:36.324008+0000","last_change":"2024-09-12T17:13:54.843769+0000","last_active":"2024-09-12T17:39:36.324008+0000","last_peered":"2024-09-12T17:39:36.324008+0000","last_clean":"2024-09-12T17:39:36.324008+0000","last_became_active":"2024-09-12T17:13:54.843036+0000","last_became_peered":"2024-09-12T17:13:54.843036+0000","last_unstale":"2024-09-12T17:39:36.324008+0000","last_undegraded":"2024-09-12T17:39:36.324008+0000","last_fullsized":"2024-09-12T17:39:36.324008+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:22.366692+0000","last_change":"2024-09-12T17:27:17.426185+0000","last_active":"2024-09-12T17:39:22.366692+0000","last_peered":"2024-09-12T17:39:22.366692+0000","last_clean":"2024-09-12T17:39:22.366692+0000","last_became_active":"2024-09-12T17:27:17.421187+0000","last_became_peered":"2024-09-12T17:27:17.421187+0000","last_unstale":"2024-09-12T17:39:22.366692+0000","last_undegraded":"2024-09-12T17:39:22.366692+0000","last_fullsized":"2024-09-12T17:39:22.366692+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"265'7","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:18.734815+0000","last_change":"2024-09-12T17:15:43.156779+0000","last_active":"2024-09-12T17:41:18.734815+0000","last_peered":"2024-09-12T17:41:18.734815+0000","last_clean":"2024-09-12T17:41:18.734815+0000","last_became_active":"2024-09-12T17:15:43.155891+0000","last_became_peered":"2024-09-12T17:15:43.155891+0000","last_unstale":"2024-09-12T17:41:18.734815+0000","last_undegraded":"2024-09-12T17:41:18.734815+0000","last_fullsized":"2024-09-12T17:41:18.734815+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:51.266851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8194,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:02.365695+0000","last_change":"2024-09-12T17:15:40.129236+0000","last_active":"2024-09-12T17:39:02.365695+0000","last_peered":"2024-09-12T17:39:02.365695+0000","last_clean":"2024-09-12T17:39:02.365695+0000","last_became_active":"2024-09-12T17:15:40.128470+0000","last_became_peered":"2024-09-12T17:15:40.128470+0000","last_unstale":"2024-09-12T17:39:02.365695+0000","last_undegraded":"2024-09-12T17:39:02.365695+0000","last_fullsized":"2024-09-12T17:39:02.365695+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:17.232330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"265'46","reported_seq":176,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:37.370710+0000","last_change":"2024-09-12T17:13:54.822640+0000","last_active":"2024-09-12T17:39:37.370710+0000","last_peered":"2024-09-12T17:39:37.370710+0000","last_clean":"2024-09-12T17:39:37.370710+0000","last_became_active":"2024-09-12T17:13:54.821816+0000","last_became_peered":"2024-09-12T17:13:54.821816+0000","last_unstale":"2024-09-12T17:39:37.370710+0000","last_undegraded":"2024-09-12T17:39:37.370710+0000","last_fullsized":"2024-09-12T17:39:37.370710+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":166,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"264'1","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:02.362079+0000","last_change":"2024-09-12T17:27:17.423856+0000","last_active":"2024-09-12T17:39:02.362079+0000","last_peered":"2024-09-12T17:39:02.362079+0000","last_clean":"2024-09-12T17:39:02.362079+0000","last_became_active":"2024-09-12T17:27:17.422464+0000","last_became_peered":"2024-09-12T17:27:17.422464+0000","last_unstale":"2024-09-12T17:39:02.362079+0000","last_undegraded":"2024-09-12T17:39:02.362079+0000","last_fullsized":"2024-09-12T17:39:02.362079+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:44.192139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"265'8","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.819159+0000","last_change":"2024-09-12T17:15:43.172138+0000","last_active":"2024-09-12T17:41:32.819159+0000","last_peered":"2024-09-12T17:41:32.819159+0000","last_clean":"2024-09-12T17:41:32.819159+0000","last_became_active":"2024-09-12T17:15:43.171254+0000","last_became_peered":"2024-09-12T17:15:43.171254+0000","last_unstale":"2024-09-12T17:41:32.819159+0000","last_undegraded":"2024-09-12T17:41:32.819159+0000","last_fullsized":"2024-09-12T17:41:32.819159+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:22.106658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10240,"num_write":8,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"265'4","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:21.338666+0000","last_change":"2024-09-12T17:15:40.117718+0000","last_active":"2024-09-12T17:41:21.338666+0000","last_peered":"2024-09-12T17:41:21.338666+0000","last_clean":"2024-09-12T17:41:21.338666+0000","last_became_active":"2024-09-12T17:15:40.116989+0000","last_became_peered":"2024-09-12T17:15:40.116989+0000","last_unstale":"2024-09-12T17:41:21.338666+0000","last_undegraded":"2024-09-12T17:41:21.338666+0000","last_fullsized":"2024-09-12T17:41:21.338666+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:05.611483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4119,"num_write":4,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"265'42","reported_seq":161,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:36.299928+0000","last_change":"2024-09-12T17:13:54.812445+0000","last_active":"2024-09-12T17:39:36.299928+0000","last_peered":"2024-09-12T17:39:36.299928+0000","last_clean":"2024-09-12T17:39:36.299928+0000","last_became_active":"2024-09-12T17:13:54.811613+0000","last_became_peered":"2024-09-12T17:13:54.811613+0000","last_unstale":"2024-09-12T17:39:36.299928+0000","last_undegraded":"2024-09-12T17:39:36.299928+0000","last_fullsized":"2024-09-12T17:39:36.299928+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":153,"num_write":74,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"265'1","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:22.370331+0000","last_change":"2024-09-12T17:27:17.405875+0000","last_active":"2024-09-12T17:39:22.370331+0000","last_peered":"2024-09-12T17:39:22.370331+0000","last_clean":"2024-09-12T17:39:22.370331+0000","last_became_active":"2024-09-12T17:27:17.405051+0000","last_became_peered":"2024-09-12T17:27:17.405051+0000","last_unstale":"2024-09-12T17:39:22.370331+0000","last_undegraded":"2024-09-12T17:39:22.370331+0000","last_fullsized":"2024-09-12T17:39:22.370331+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"265'2","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:26.339686+0000","last_change":"2024-09-12T17:15:43.158356+0000","last_active":"2024-09-12T17:41:26.339686+0000","last_peered":"2024-09-12T17:41:26.339686+0000","last_clean":"2024-09-12T17:41:26.339686+0000","last_became_active":"2024-09-12T17:15:43.157624+0000","last_became_peered":"2024-09-12T17:15:43.157624+0000","last_unstale":"2024-09-12T17:41:26.339686+0000","last_undegraded":"2024-09-12T17:41:26.339686+0000","last_fullsized":"2024-09-12T17:41:26.339686+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:44.475418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:02.346406+0000","last_change":"2024-09-12T17:15:40.118796+0000","last_active":"2024-09-12T17:39:02.346406+0000","last_peered":"2024-09-12T17:39:02.346406+0000","last_clean":"2024-09-12T17:39:02.346406+0000","last_became_active":"2024-09-12T17:15:40.118074+0000","last_became_peered":"2024-09-12T17:15:40.118074+0000","last_unstale":"2024-09-12T17:39:02.346406+0000","last_undegraded":"2024-09-12T17:39:02.346406+0000","last_fullsized":"2024-09-12T17:39:02.346406+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:53:01.242885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"265'16","reported_seq":90,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:37.373836+0000","last_change":"2024-09-12T17:13:54.841589+0000","last_active":"2024-09-12T17:39:37.373836+0000","last_peered":"2024-09-12T17:39:37.373836+0000","last_clean":"2024-09-12T17:39:37.373836+0000","last_became_active":"2024-09-12T17:13:54.840781+0000","last_became_peered":"2024-09-12T17:13:54.840781+0000","last_unstale":"2024-09-12T17:39:37.373836+0000","last_undegraded":"2024-09-12T17:39:37.373836+0000","last_fullsized":"2024-09-12T17:39:37.373836+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":56,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:15.273963+0000","last_change":"2024-09-12T17:27:17.409764+0000","last_active":"2024-09-12T17:38:15.273963+0000","last_peered":"2024-09-12T17:38:15.273963+0000","last_clean":"2024-09-12T17:38:15.273963+0000","last_became_active":"2024-09-12T17:27:17.408953+0000","last_became_peered":"2024-09-12T17:27:17.408953+0000","last_unstale":"2024-09-12T17:38:15.273963+0000","last_undegraded":"2024-09-12T17:38:15.273963+0000","last_fullsized":"2024-09-12T17:38:15.273963+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:26.794007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:12.353382+0000","last_change":"2024-09-12T17:15:43.165887+0000","last_active":"2024-09-12T17:38:12.353382+0000","last_peered":"2024-09-12T17:38:12.353382+0000","last_clean":"2024-09-12T17:38:12.353382+0000","last_became_active":"2024-09-12T17:15:43.164943+0000","last_became_peered":"2024-09-12T17:15:43.164943+0000","last_unstale":"2024-09-12T17:38:12.353382+0000","last_undegraded":"2024-09-12T17:38:12.353382+0000","last_fullsized":"2024-09-12T17:38:12.353382+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:08.542268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"265'7","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:26.336598+0000","last_change":"2024-09-12T17:15:40.129503+0000","last_active":"2024-09-12T17:40:26.336598+0000","last_peered":"2024-09-12T17:40:26.336598+0000","last_clean":"2024-09-12T17:40:26.336598+0000","last_became_active":"2024-09-12T17:15:40.128681+0000","last_became_peered":"2024-09-12T17:15:40.128681+0000","last_unstale":"2024-09-12T17:40:26.336598+0000","last_undegraded":"2024-09-12T17:40:26.336598+0000","last_fullsized":"2024-09-12T17:40:26.336598+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:21.306746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16384,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"265'9","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:47.361596+0000","last_change":"2024-09-12T17:13:54.844500+0000","last_active":"2024-09-12T17:38:47.361596+0000","last_peered":"2024-09-12T17:38:47.361596+0000","last_clean":"2024-09-12T17:38:47.361596+0000","last_became_active":"2024-09-12T17:13:54.842287+0000","last_became_peered":"2024-09-12T17:13:54.842287+0000","last_unstale":"2024-09-12T17:38:47.361596+0000","last_undegraded":"2024-09-12T17:38:47.361596+0000","last_fullsized":"2024-09-12T17:38:47.361596+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:09.440211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":28,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:36.309617+0000","last_change":"2024-09-12T17:27:17.416766+0000","last_active":"2024-09-12T17:38:36.309617+0000","last_peered":"2024-09-12T17:38:36.309617+0000","last_clean":"2024-09-12T17:38:36.309617+0000","last_became_active":"2024-09-12T17:27:17.415241+0000","last_became_peered":"2024-09-12T17:27:17.415241+0000","last_unstale":"2024-09-12T17:38:36.309617+0000","last_undegraded":"2024-09-12T17:38:36.309617+0000","last_fullsized":"2024-09-12T17:38:36.309617+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:04.923059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"265'8","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:27.385923+0000","last_change":"2024-09-12T17:15:43.171921+0000","last_active":"2024-09-12T17:40:27.385923+0000","last_peered":"2024-09-12T17:40:27.385923+0000","last_clean":"2024-09-12T17:40:27.385923+0000","last_became_active":"2024-09-12T17:15:43.168676+0000","last_became_peered":"2024-09-12T17:15:43.168676+0000","last_unstale":"2024-09-12T17:40:27.385923+0000","last_undegraded":"2024-09-12T17:40:27.385923+0000","last_fullsized":"2024-09-12T17:40:27.385923+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:51.743678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":24578,"num_write":18,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"265'6","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:25.304614+0000","last_change":"2024-09-12T17:15:40.129433+0000","last_active":"2024-09-12T17:40:25.304614+0000","last_peered":"2024-09-12T17:40:25.304614+0000","last_clean":"2024-09-12T17:40:25.304614+0000","last_became_active":"2024-09-12T17:15:40.128708+0000","last_became_peered":"2024-09-12T17:15:40.128708+0000","last_unstale":"2024-09-12T17:40:25.304614+0000","last_undegraded":"2024-09-12T17:40:25.304614+0000","last_fullsized":"2024-09-12T17:40:25.304614+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:54.970720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8194,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"265'35","reported_seq":144,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:42.341793+0000","last_change":"2024-09-12T17:13:54.830851+0000","last_active":"2024-09-12T17:38:42.341793+0000","last_peered":"2024-09-12T17:38:42.341793+0000","last_clean":"2024-09-12T17:38:42.341793+0000","last_became_active":"2024-09-12T17:13:54.830096+0000","last_became_peered":"2024-09-12T17:13:54.830096+0000","last_unstale":"2024-09-12T17:38:42.341793+0000","last_undegraded":"2024-09-12T17:38:42.341793+0000","last_fullsized":"2024-09-12T17:38:42.341793+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:08.715298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":131,"num_write":60,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:06.295390+0000","last_change":"2024-09-12T17:27:17.412405+0000","last_active":"2024-09-12T17:38:06.295390+0000","last_peered":"2024-09-12T17:38:06.295390+0000","last_clean":"2024-09-12T17:38:06.295390+0000","last_became_active":"2024-09-12T17:27:17.411635+0000","last_became_peered":"2024-09-12T17:27:17.411635+0000","last_unstale":"2024-09-12T17:38:06.295390+0000","last_undegraded":"2024-09-12T17:38:06.295390+0000","last_fullsized":"2024-09-12T17:38:06.295390+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:12.596567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:13.696208+0000","last_change":"2024-09-12T17:15:43.870101+0000","last_active":"2024-09-12T17:38:13.696208+0000","last_peered":"2024-09-12T17:38:13.696208+0000","last_clean":"2024-09-12T17:38:13.696208+0000","last_became_active":"2024-09-12T17:15:43.869197+0000","last_became_peered":"2024-09-12T17:15:43.869197+0000","last_unstale":"2024-09-12T17:38:13.696208+0000","last_undegraded":"2024-09-12T17:38:13.696208+0000","last_fullsized":"2024-09-12T17:38:13.696208+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:50:50.852439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:12.349506+0000","last_change":"2024-09-12T17:15:40.115375+0000","last_active":"2024-09-12T17:38:12.349506+0000","last_peered":"2024-09-12T17:38:12.349506+0000","last_clean":"2024-09-12T17:38:12.349506+0000","last_became_active":"2024-09-12T17:15:40.114636+0000","last_became_peered":"2024-09-12T17:15:40.114636+0000","last_unstale":"2024-09-12T17:38:12.349506+0000","last_undegraded":"2024-09-12T17:38:12.349506+0000","last_fullsized":"2024-09-12T17:38:12.349506+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:25.820396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"265'11","reported_seq":77,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:41.303136+0000","last_change":"2024-09-12T17:13:54.837741+0000","last_active":"2024-09-12T17:38:41.303136+0000","last_peered":"2024-09-12T17:38:41.303136+0000","last_clean":"2024-09-12T17:38:41.303136+0000","last_became_active":"2024-09-12T17:13:54.836955+0000","last_became_peered":"2024-09-12T17:13:54.836955+0000","last_unstale":"2024-09-12T17:38:41.303136+0000","last_undegraded":"2024-09-12T17:38:41.303136+0000","last_fullsized":"2024-09-12T17:38:41.303136+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:27.239370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":38,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:11.303795+0000","last_change":"2024-09-12T17:27:17.409364+0000","last_active":"2024-09-12T17:38:11.303795+0000","last_peered":"2024-09-12T17:38:11.303795+0000","last_clean":"2024-09-12T17:38:11.303795+0000","last_became_active":"2024-09-12T17:27:17.408128+0000","last_became_peered":"2024-09-12T17:27:17.408128+0000","last_unstale":"2024-09-12T17:38:11.303795+0000","last_undegraded":"2024-09-12T17:38:11.303795+0000","last_fullsized":"2024-09-12T17:38:11.303795+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:44.771065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"265'4","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.648372+0000","last_change":"2024-09-12T17:15:43.171004+0000","last_active":"2024-09-12T17:41:32.648372+0000","last_peered":"2024-09-12T17:41:32.648372+0000","last_clean":"2024-09-12T17:41:32.648372+0000","last_became_active":"2024-09-12T17:15:43.169936+0000","last_became_peered":"2024-09-12T17:15:43.169936+0000","last_unstale":"2024-09-12T17:41:32.648372+0000","last_undegraded":"2024-09-12T17:41:32.648372+0000","last_fullsized":"2024-09-12T17:41:32.648372+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:21.292046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"265'9","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.083485+0000","last_change":"2024-09-12T17:15:40.122273+0000","last_active":"2024-09-12T17:41:32.083485+0000","last_peered":"2024-09-12T17:41:32.083485+0000","last_clean":"2024-09-12T17:41:32.083485+0000","last_became_active":"2024-09-12T17:15:40.121181+0000","last_became_peered":"2024-09-12T17:15:40.121181+0000","last_unstale":"2024-09-12T17:41:32.083485+0000","last_undegraded":"2024-09-12T17:41:32.083485+0000","last_fullsized":"2024-09-12T17:41:32.083485+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:36.422026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12338,"num_write":14,"num_write_kb":5168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"265'48","reported_seq":176,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:41.282547+0000","last_change":"2024-09-12T17:13:54.842918+0000","last_active":"2024-09-12T17:38:41.282547+0000","last_peered":"2024-09-12T17:38:41.282547+0000","last_clean":"2024-09-12T17:38:41.282547+0000","last_became_active":"2024-09-12T17:13:54.841923+0000","last_became_peered":"2024-09-12T17:13:54.841923+0000","last_unstale":"2024-09-12T17:38:41.282547+0000","last_undegraded":"2024-09-12T17:38:41.282547+0000","last_fullsized":"2024-09-12T17:38:41.282547+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:08.355932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":241,"num_read_kb":172,"num_write":100,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:32.357996+0000","last_change":"2024-09-12T17:27:17.419285+0000","last_active":"2024-09-12T17:38:32.357996+0000","last_peered":"2024-09-12T17:38:32.357996+0000","last_clean":"2024-09-12T17:38:32.357996+0000","last_became_active":"2024-09-12T17:27:17.417566+0000","last_became_peered":"2024-09-12T17:27:17.417566+0000","last_unstale":"2024-09-12T17:38:32.357996+0000","last_undegraded":"2024-09-12T17:38:32.357996+0000","last_fullsized":"2024-09-12T17:38:32.357996+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:32.507294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"262'4","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:36.299859+0000","last_change":"2024-09-12T17:15:43.162593+0000","last_active":"2024-09-12T17:39:36.299859+0000","last_peered":"2024-09-12T17:39:36.299859+0000","last_clean":"2024-09-12T17:39:36.299859+0000","last_became_active":"2024-09-12T17:15:43.161858+0000","last_became_peered":"2024-09-12T17:15:43.161858+0000","last_unstale":"2024-09-12T17:39:36.299859+0000","last_undegraded":"2024-09-12T17:39:36.299859+0000","last_fullsized":"2024-09-12T17:39:36.299859+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:32.369307+0000","last_change":"2024-09-12T17:15:40.113046+0000","last_active":"2024-09-12T17:39:32.369307+0000","last_peered":"2024-09-12T17:39:32.369307+0000","last_clean":"2024-09-12T17:39:32.369307+0000","last_became_active":"2024-09-12T17:15:40.112179+0000","last_became_peered":"2024-09-12T17:15:40.112179+0000","last_unstale":"2024-09-12T17:39:32.369307+0000","last_undegraded":"2024-09-12T17:39:32.369307+0000","last_fullsized":"2024-09-12T17:39:32.369307+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"265'67","reported_seq":229,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:42.356505+0000","last_change":"2024-09-12T17:13:54.828364+0000","last_active":"2024-09-12T17:38:42.356505+0000","last_peered":"2024-09-12T17:38:42.356505+0000","last_clean":"2024-09-12T17:38:42.356505+0000","last_became_active":"2024-09-12T17:13:54.827402+0000","last_became_peered":"2024-09-12T17:13:54.827402+0000","last_unstale":"2024-09-12T17:38:42.356505+0000","last_undegraded":"2024-09-12T17:38:42.356505+0000","last_fullsized":"2024-09-12T17:38:42.356505+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:52.664896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":342,"num_read_kb":248,"num_write":117,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:41.310813+0000","last_change":"2024-09-12T17:27:17.418505+0000","last_active":"2024-09-12T17:38:41.310813+0000","last_peered":"2024-09-12T17:38:41.310813+0000","last_clean":"2024-09-12T17:38:41.310813+0000","last_became_active":"2024-09-12T17:27:17.418022+0000","last_became_peered":"2024-09-12T17:27:17.418022+0000","last_unstale":"2024-09-12T17:38:41.310813+0000","last_undegraded":"2024-09-12T17:38:41.310813+0000","last_fullsized":"2024-09-12T17:38:41.310813+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:55.678220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"265'5","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.817763+0000","last_change":"2024-09-12T17:15:43.865245+0000","last_active":"2024-09-12T17:41:32.817763+0000","last_peered":"2024-09-12T17:41:32.817763+0000","last_clean":"2024-09-12T17:41:32.817763+0000","last_became_active":"2024-09-12T17:15:43.864657+0000","last_became_peered":"2024-09-12T17:15:43.864657+0000","last_unstale":"2024-09-12T17:41:32.817763+0000","last_undegraded":"2024-09-12T17:41:32.817763+0000","last_fullsized":"2024-09-12T17:41:32.817763+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"265'12","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.648810+0000","last_change":"2024-09-12T17:15:40.123025+0000","last_active":"2024-09-12T17:41:32.648810+0000","last_peered":"2024-09-12T17:41:32.648810+0000","last_clean":"2024-09-12T17:41:32.648810+0000","last_became_active":"2024-09-12T17:15:40.122001+0000","last_became_peered":"2024-09-12T17:15:40.122001+0000","last_unstale":"2024-09-12T17:41:32.648810+0000","last_undegraded":"2024-09-12T17:41:32.648810+0000","last_fullsized":"2024-09-12T17:41:32.648810+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12340,"num_write":12,"num_write_kb":6192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"265'23","reported_seq":105,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:51.298999+0000","last_change":"2024-09-12T17:13:54.831219+0000","last_active":"2024-09-12T17:37:51.298999+0000","last_peered":"2024-09-12T17:37:51.298999+0000","last_clean":"2024-09-12T17:37:51.298999+0000","last_became_active":"2024-09-12T17:13:54.825019+0000","last_became_peered":"2024-09-12T17:13:54.825019+0000","last_unstale":"2024-09-12T17:37:51.298999+0000","last_undegraded":"2024-09-12T17:37:51.298999+0000","last_fullsized":"2024-09-12T17:37:51.298999+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:13.461017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":38,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"265'1","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:36.309680+0000","last_change":"2024-09-12T17:27:17.408731+0000","last_active":"2024-09-12T17:38:36.309680+0000","last_peered":"2024-09-12T17:38:36.309680+0000","last_clean":"2024-09-12T17:38:36.309680+0000","last_became_active":"2024-09-12T17:27:17.408151+0000","last_became_peered":"2024-09-12T17:27:17.408151+0000","last_unstale":"2024-09-12T17:38:36.309680+0000","last_undegraded":"2024-09-12T17:38:36.309680+0000","last_fullsized":"2024-09-12T17:38:36.309680+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:04.214744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"265'7","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.648854+0000","last_change":"2024-09-12T17:15:43.167300+0000","last_active":"2024-09-12T17:41:32.648854+0000","last_peered":"2024-09-12T17:41:32.648854+0000","last_clean":"2024-09-12T17:41:32.648854+0000","last_became_active":"2024-09-12T17:15:43.166482+0000","last_became_peered":"2024-09-12T17:15:43.166482+0000","last_unstale":"2024-09-12T17:41:32.648854+0000","last_undegraded":"2024-09-12T17:41:32.648854+0000","last_fullsized":"2024-09-12T17:41:32.648854+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:11.626906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:37.370681+0000","last_change":"2024-09-12T17:15:40.138867+0000","last_active":"2024-09-12T17:39:37.370681+0000","last_peered":"2024-09-12T17:39:37.370681+0000","last_clean":"2024-09-12T17:39:37.370681+0000","last_became_active":"2024-09-12T17:15:40.138190+0000","last_became_peered":"2024-09-12T17:15:40.138190+0000","last_unstale":"2024-09-12T17:39:37.370681+0000","last_undegraded":"2024-09-12T17:39:37.370681+0000","last_fullsized":"2024-09-12T17:39:37.370681+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"265'18","reported_seq":93,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:47.347138+0000","last_change":"2024-09-12T17:13:54.833230+0000","last_active":"2024-09-12T17:37:47.347138+0000","last_peered":"2024-09-12T17:37:47.347138+0000","last_clean":"2024-09-12T17:37:47.347138+0000","last_became_active":"2024-09-12T17:13:54.832453+0000","last_became_peered":"2024-09-12T17:13:54.832453+0000","last_unstale":"2024-09-12T17:37:47.347138+0000","last_undegraded":"2024-09-12T17:37:47.347138+0000","last_fullsized":"2024-09-12T17:37:47.347138+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:14.336440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":60,"num_write":35,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:32.354215+0000","last_change":"2024-09-12T17:27:17.418555+0000","last_active":"2024-09-12T17:38:32.354215+0000","last_peered":"2024-09-12T17:38:32.354215+0000","last_clean":"2024-09-12T17:38:32.354215+0000","last_became_active":"2024-09-12T17:27:17.417574+0000","last_became_peered":"2024-09-12T17:27:17.417574+0000","last_unstale":"2024-09-12T17:38:32.354215+0000","last_undegraded":"2024-09-12T17:38:32.354215+0000","last_fullsized":"2024-09-12T17:38:32.354215+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:54.585796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"265'4","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.171147+0000","last_change":"2024-09-12T17:15:43.151790+0000","last_active":"2024-09-12T17:41:33.171147+0000","last_peered":"2024-09-12T17:41:33.171147+0000","last_clean":"2024-09-12T17:41:33.171147+0000","last_became_active":"2024-09-12T17:15:43.151000+0000","last_became_peered":"2024-09-12T17:15:43.151000+0000","last_unstale":"2024-09-12T17:41:33.171147+0000","last_undegraded":"2024-09-12T17:41:33.171147+0000","last_fullsized":"2024-09-12T17:41:33.171147+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"262'2","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:11.280772+0000","last_change":"2024-09-12T17:15:40.119321+0000","last_active":"2024-09-12T17:38:11.280772+0000","last_peered":"2024-09-12T17:38:11.280772+0000","last_clean":"2024-09-12T17:38:11.280772+0000","last_became_active":"2024-09-12T17:15:40.118469+0000","last_became_peered":"2024-09-12T17:15:40.118469+0000","last_unstale":"2024-09-12T17:38:11.280772+0000","last_undegraded":"2024-09-12T17:38:11.280772+0000","last_fullsized":"2024-09-12T17:38:11.280772+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:28.762279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"265'20","reported_seq":99,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:46.290866+0000","last_change":"2024-09-12T17:13:54.828421+0000","last_active":"2024-09-12T17:37:46.290866+0000","last_peered":"2024-09-12T17:37:46.290866+0000","last_clean":"2024-09-12T17:37:46.290866+0000","last_became_active":"2024-09-12T17:13:54.827570+0000","last_became_peered":"2024-09-12T17:13:54.827570+0000","last_unstale":"2024-09-12T17:37:46.290866+0000","last_undegraded":"2024-09-12T17:37:46.290866+0000","last_fullsized":"2024-09-12T17:37:46.290866+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:42.149748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":63,"num_write":42,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:51.327788+0000","last_change":"2024-09-12T17:27:17.411486+0000","last_active":"2024-09-12T17:39:51.327788+0000","last_peered":"2024-09-12T17:39:51.327788+0000","last_clean":"2024-09-12T17:39:51.327788+0000","last_became_active":"2024-09-12T17:27:17.411175+0000","last_became_peered":"2024-09-12T17:27:17.411175+0000","last_unstale":"2024-09-12T17:39:51.327788+0000","last_undegraded":"2024-09-12T17:39:51.327788+0000","last_fullsized":"2024-09-12T17:39:51.327788+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"265'5","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:47.385482+0000","last_change":"2024-09-12T17:15:43.159928+0000","last_active":"2024-09-12T17:40:47.385482+0000","last_peered":"2024-09-12T17:40:47.385482+0000","last_clean":"2024-09-12T17:40:47.385482+0000","last_became_active":"2024-09-12T17:15:43.159149+0000","last_became_peered":"2024-09-12T17:15:43.159149+0000","last_unstale":"2024-09-12T17:40:47.385482+0000","last_undegraded":"2024-09-12T17:40:47.385482+0000","last_fullsized":"2024-09-12T17:40:47.385482+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:34.107337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2048,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"265'7","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:41.339938+0000","last_change":"2024-09-12T17:15:40.122291+0000","last_active":"2024-09-12T17:40:41.339938+0000","last_peered":"2024-09-12T17:40:41.339938+0000","last_clean":"2024-09-12T17:40:41.339938+0000","last_became_active":"2024-09-12T17:15:40.121513+0000","last_became_peered":"2024-09-12T17:15:40.121513+0000","last_unstale":"2024-09-12T17:40:41.339938+0000","last_undegraded":"2024-09-12T17:40:41.339938+0000","last_fullsized":"2024-09-12T17:40:41.339938+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:00.339305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6144,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"265'31","reported_seq":131,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:47.343574+0000","last_change":"2024-09-12T17:13:54.830067+0000","last_active":"2024-09-12T17:37:47.343574+0000","last_peered":"2024-09-12T17:37:47.343574+0000","last_clean":"2024-09-12T17:37:47.343574+0000","last_became_active":"2024-09-12T17:13:54.828393+0000","last_became_peered":"2024-09-12T17:13:54.828393+0000","last_unstale":"2024-09-12T17:37:47.343574+0000","last_undegraded":"2024-09-12T17:37:47.343574+0000","last_fullsized":"2024-09-12T17:37:47.343574+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:22:33.149059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":109,"num_write":58,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:47.356489+0000","last_change":"2024-09-12T17:27:17.402782+0000","last_active":"2024-09-12T17:39:47.356489+0000","last_peered":"2024-09-12T17:39:47.356489+0000","last_clean":"2024-09-12T17:39:47.356489+0000","last_became_active":"2024-09-12T17:27:17.402024+0000","last_became_peered":"2024-09-12T17:27:17.402024+0000","last_unstale":"2024-09-12T17:39:47.356489+0000","last_undegraded":"2024-09-12T17:39:47.356489+0000","last_fullsized":"2024-09-12T17:39:47.356489+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:37.355395+0000","last_change":"2024-09-12T17:15:43.871865+0000","last_active":"2024-09-12T17:38:37.355395+0000","last_peered":"2024-09-12T17:38:37.355395+0000","last_clean":"2024-09-12T17:38:37.355395+0000","last_became_active":"2024-09-12T17:15:43.871095+0000","last_became_peered":"2024-09-12T17:15:43.871095+0000","last_unstale":"2024-09-12T17:38:37.355395+0000","last_undegraded":"2024-09-12T17:38:37.355395+0000","last_fullsized":"2024-09-12T17:38:37.355395+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:26.988527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'9","reported_seq":60,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.083268+0000","last_change":"2024-09-12T17:15:40.126453+0000","last_active":"2024-09-12T17:41:32.083268+0000","last_peered":"2024-09-12T17:41:32.083268+0000","last_clean":"2024-09-12T17:41:32.083268+0000","last_became_active":"2024-09-12T17:15:40.125684+0000","last_became_peered":"2024-09-12T17:15:40.125684+0000","last_unstale":"2024-09-12T17:41:32.083268+0000","last_undegraded":"2024-09-12T17:41:32.083268+0000","last_fullsized":"2024-09-12T17:41:32.083268+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:40.660204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":32770,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"265'38","reported_seq":147,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:46.291003+0000","last_change":"2024-09-12T17:13:54.826751+0000","last_active":"2024-09-12T17:37:46.291003+0000","last_peered":"2024-09-12T17:37:46.291003+0000","last_clean":"2024-09-12T17:37:46.291003+0000","last_became_active":"2024-09-12T17:13:54.825945+0000","last_became_peered":"2024-09-12T17:13:54.825945+0000","last_unstale":"2024-09-12T17:37:46.291003+0000","last_undegraded":"2024-09-12T17:37:46.291003+0000","last_fullsized":"2024-09-12T17:37:46.291003+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:17.823826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":132,"num_write":66,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:18.711398+0000","last_change":"2024-09-12T17:27:17.409234+0000","last_active":"2024-09-12T17:39:18.711398+0000","last_peered":"2024-09-12T17:39:18.711398+0000","last_clean":"2024-09-12T17:39:18.711398+0000","last_became_active":"2024-09-12T17:27:17.408445+0000","last_became_peered":"2024-09-12T17:27:17.408445+0000","last_unstale":"2024-09-12T17:39:18.711398+0000","last_undegraded":"2024-09-12T17:39:18.711398+0000","last_fullsized":"2024-09-12T17:39:18.711398+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:52.795384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:36.324164+0000","last_change":"2024-09-12T17:15:43.867204+0000","last_active":"2024-09-12T17:39:36.324164+0000","last_peered":"2024-09-12T17:39:36.324164+0000","last_clean":"2024-09-12T17:39:36.324164+0000","last_became_active":"2024-09-12T17:15:43.866375+0000","last_became_peered":"2024-09-12T17:15:43.866375+0000","last_unstale":"2024-09-12T17:39:36.324164+0000","last_undegraded":"2024-09-12T17:39:36.324164+0000","last_fullsized":"2024-09-12T17:39:36.324164+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"265'6","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.400557+0000","last_change":"2024-09-12T17:15:40.125566+0000","last_active":"2024-09-12T17:41:32.400557+0000","last_peered":"2024-09-12T17:41:32.400557+0000","last_clean":"2024-09-12T17:41:32.400557+0000","last_became_active":"2024-09-12T17:15:40.124901+0000","last_became_peered":"2024-09-12T17:15:40.124901+0000","last_unstale":"2024-09-12T17:41:32.400557+0000","last_undegraded":"2024-09-12T17:41:32.400557+0000","last_fullsized":"2024-09-12T17:41:32.400557+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"265'32","reported_seq":130,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:01.315756+0000","last_change":"2024-09-12T17:13:54.830950+0000","last_active":"2024-09-12T17:39:01.315756+0000","last_peered":"2024-09-12T17:39:01.315756+0000","last_clean":"2024-09-12T17:39:01.315756+0000","last_became_active":"2024-09-12T17:13:54.824810+0000","last_became_peered":"2024-09-12T17:13:54.824810+0000","last_unstale":"2024-09-12T17:39:01.315756+0000","last_undegraded":"2024-09-12T17:39:01.315756+0000","last_fullsized":"2024-09-12T17:39:01.315756+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:18.942711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":107,"num_write":61,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:51.303182+0000","last_change":"2024-09-12T17:27:17.410104+0000","last_active":"2024-09-12T17:39:51.303182+0000","last_peered":"2024-09-12T17:39:51.303182+0000","last_clean":"2024-09-12T17:39:51.303182+0000","last_became_active":"2024-09-12T17:27:17.409774+0000","last_became_peered":"2024-09-12T17:27:17.409774+0000","last_unstale":"2024-09-12T17:39:51.303182+0000","last_undegraded":"2024-09-12T17:39:51.303182+0000","last_fullsized":"2024-09-12T17:39:51.303182+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:36.300111+0000","last_change":"2024-09-12T17:15:43.171491+0000","last_active":"2024-09-12T17:39:36.300111+0000","last_peered":"2024-09-12T17:39:36.300111+0000","last_clean":"2024-09-12T17:39:36.300111+0000","last_became_active":"2024-09-12T17:15:43.167221+0000","last_became_peered":"2024-09-12T17:15:43.167221+0000","last_unstale":"2024-09-12T17:39:36.300111+0000","last_undegraded":"2024-09-12T17:39:36.300111+0000","last_fullsized":"2024-09-12T17:39:36.300111+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"262'5","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:31.322823+0000","last_change":"2024-09-12T17:15:40.131852+0000","last_active":"2024-09-12T17:39:31.322823+0000","last_peered":"2024-09-12T17:39:31.322823+0000","last_clean":"2024-09-12T17:39:31.322823+0000","last_became_active":"2024-09-12T17:15:40.131162+0000","last_became_peered":"2024-09-12T17:15:40.131162+0000","last_unstale":"2024-09-12T17:39:31.322823+0000","last_undegraded":"2024-09-12T17:39:31.322823+0000","last_fullsized":"2024-09-12T17:39:31.322823+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"262'228","reported_seq":763,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:58.706524+0000","last_change":"2024-09-12T17:13:54.825163+0000","last_active":"2024-09-12T17:38:58.706524+0000","last_peered":"2024-09-12T17:38:58.706524+0000","last_clean":"2024-09-12T17:38:58.706524+0000","last_became_active":"2024-09-12T17:13:54.824372+0000","last_became_peered":"2024-09-12T17:13:54.824372+0000","last_unstale":"2024-09-12T17:38:58.706524+0000","last_undegraded":"2024-09-12T17:38:58.706524+0000","last_fullsized":"2024-09-12T17:38:58.706524+0000","mapping_epoch":252,"log_start":"262'200","ondisk_log_start":"262'200","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:21.156675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1417,"num_read_kb":1102,"num_write":261,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"265'1","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:10.273048+0000","last_change":"2024-09-12T17:27:17.404784+0000","last_active":"2024-09-12T17:38:10.273048+0000","last_peered":"2024-09-12T17:38:10.273048+0000","last_clean":"2024-09-12T17:38:10.273048+0000","last_became_active":"2024-09-12T17:27:17.404001+0000","last_became_peered":"2024-09-12T17:27:17.404001+0000","last_unstale":"2024-09-12T17:38:10.273048+0000","last_undegraded":"2024-09-12T17:38:10.273048+0000","last_fullsized":"2024-09-12T17:38:10.273048+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:30.724589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:33.700764+0000","last_change":"2024-09-12T17:15:43.159967+0000","last_active":"2024-09-12T17:38:33.700764+0000","last_peered":"2024-09-12T17:38:33.700764+0000","last_clean":"2024-09-12T17:38:33.700764+0000","last_became_active":"2024-09-12T17:15:43.159256+0000","last_became_peered":"2024-09-12T17:15:43.159256+0000","last_unstale":"2024-09-12T17:38:33.700764+0000","last_undegraded":"2024-09-12T17:38:33.700764+0000","last_fullsized":"2024-09-12T17:38:33.700764+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:56.377319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"265'2","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.235653+0000","last_change":"2024-09-12T17:15:40.139358+0000","last_active":"2024-09-12T17:41:32.235653+0000","last_peered":"2024-09-12T17:41:32.235653+0000","last_clean":"2024-09-12T17:41:32.235653+0000","last_became_active":"2024-09-12T17:15:40.138844+0000","last_became_peered":"2024-09-12T17:15:40.138844+0000","last_unstale":"2024-09-12T17:41:32.235653+0000","last_undegraded":"2024-09-12T17:41:32.235653+0000","last_fullsized":"2024-09-12T17:41:32.235653+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"265'38","reported_seq":148,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:57.345346+0000","last_change":"2024-09-12T17:13:54.831688+0000","last_active":"2024-09-12T17:38:57.345346+0000","last_peered":"2024-09-12T17:38:57.345346+0000","last_clean":"2024-09-12T17:38:57.345346+0000","last_became_active":"2024-09-12T17:13:54.830999+0000","last_became_peered":"2024-09-12T17:13:54.830999+0000","last_unstale":"2024-09-12T17:38:57.345346+0000","last_undegraded":"2024-09-12T17:38:57.345346+0000","last_fullsized":"2024-09-12T17:38:57.345346+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:34.484369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":129,"num_write":64,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:07.348306+0000","last_change":"2024-09-12T17:27:17.413681+0000","last_active":"2024-09-12T17:38:07.348306+0000","last_peered":"2024-09-12T17:38:07.348306+0000","last_clean":"2024-09-12T17:38:07.348306+0000","last_became_active":"2024-09-12T17:27:17.412921+0000","last_became_peered":"2024-09-12T17:27:17.412921+0000","last_unstale":"2024-09-12T17:38:07.348306+0000","last_undegraded":"2024-09-12T17:38:07.348306+0000","last_fullsized":"2024-09-12T17:38:07.348306+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:10.295122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"265'4","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.171635+0000","last_change":"2024-09-12T17:15:43.155640+0000","last_active":"2024-09-12T17:41:33.171635+0000","last_peered":"2024-09-12T17:41:33.171635+0000","last_clean":"2024-09-12T17:41:33.171635+0000","last_became_active":"2024-09-12T17:15:43.154940+0000","last_became_peered":"2024-09-12T17:15:43.154940+0000","last_unstale":"2024-09-12T17:41:33.171635+0000","last_undegraded":"2024-09-12T17:41:33.171635+0000","last_fullsized":"2024-09-12T17:41:33.171635+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:36.309541+0000","last_change":"2024-09-12T17:15:40.127548+0000","last_active":"2024-09-12T17:38:36.309541+0000","last_peered":"2024-09-12T17:38:36.309541+0000","last_clean":"2024-09-12T17:38:36.309541+0000","last_became_active":"2024-09-12T17:15:40.126745+0000","last_became_peered":"2024-09-12T17:15:40.126745+0000","last_unstale":"2024-09-12T17:38:36.309541+0000","last_undegraded":"2024-09-12T17:38:36.309541+0000","last_fullsized":"2024-09-12T17:38:36.309541+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:58.903944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"265'14","reported_seq":86,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:32.319736+0000","last_change":"2024-09-12T17:13:54.841357+0000","last_active":"2024-09-12T17:39:32.319736+0000","last_peered":"2024-09-12T17:39:32.319736+0000","last_clean":"2024-09-12T17:39:32.319736+0000","last_became_active":"2024-09-12T17:13:54.840501+0000","last_became_peered":"2024-09-12T17:13:54.840501+0000","last_unstale":"2024-09-12T17:39:32.319736+0000","last_undegraded":"2024-09-12T17:39:32.319736+0000","last_fullsized":"2024-09-12T17:39:32.319736+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:07:40.561312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":51,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:47.372918+0000","last_change":"2024-09-12T17:27:17.423169+0000","last_active":"2024-09-12T17:39:47.372918+0000","last_peered":"2024-09-12T17:39:47.372918+0000","last_clean":"2024-09-12T17:39:47.372918+0000","last_became_active":"2024-09-12T17:27:17.421504+0000","last_became_peered":"2024-09-12T17:27:17.421504+0000","last_unstale":"2024-09-12T17:39:47.372918+0000","last_undegraded":"2024-09-12T17:39:47.372918+0000","last_fullsized":"2024-09-12T17:39:47.372918+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"265'3","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:46.331365+0000","last_change":"2024-09-12T17:15:43.163468+0000","last_active":"2024-09-12T17:40:46.331365+0000","last_peered":"2024-09-12T17:40:46.331365+0000","last_clean":"2024-09-12T17:40:46.331365+0000","last_became_active":"2024-09-12T17:15:43.162406+0000","last_became_peered":"2024-09-12T17:15:43.162406+0000","last_unstale":"2024-09-12T17:40:46.331365+0000","last_undegraded":"2024-09-12T17:40:46.331365+0000","last_fullsized":"2024-09-12T17:40:46.331365+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:52.019907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"265'11","reported_seq":60,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.733819+0000","last_change":"2024-09-12T17:15:40.116483+0000","last_active":"2024-09-12T17:41:32.733819+0000","last_peered":"2024-09-12T17:41:32.733819+0000","last_clean":"2024-09-12T17:41:32.733819+0000","last_became_active":"2024-09-12T17:15:40.115746+0000","last_became_peered":"2024-09-12T17:15:40.115746+0000","last_unstale":"2024-09-12T17:41:32.733819+0000","last_undegraded":"2024-09-12T17:41:32.733819+0000","last_fullsized":"2024-09-12T17:41:32.733819+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:04.139173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12288,"num_write":16,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"265'17","reported_seq":96,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:31.674540+0000","last_change":"2024-09-12T17:13:54.838973+0000","last_active":"2024-09-12T17:39:31.674540+0000","last_peered":"2024-09-12T17:39:31.674540+0000","last_clean":"2024-09-12T17:39:31.674540+0000","last_became_active":"2024-09-12T17:13:54.838008+0000","last_became_peered":"2024-09-12T17:13:54.838008+0000","last_unstale":"2024-09-12T17:39:31.674540+0000","last_undegraded":"2024-09-12T17:39:31.674540+0000","last_fullsized":"2024-09-12T17:39:31.674540+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:41.998918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":61,"num_write":32,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:51.299103+0000","last_change":"2024-09-12T17:27:17.409064+0000","last_active":"2024-09-12T17:37:51.299103+0000","last_peered":"2024-09-12T17:37:51.299103+0000","last_clean":"2024-09-12T17:37:51.299103+0000","last_became_active":"2024-09-12T17:27:17.408296+0000","last_became_peered":"2024-09-12T17:27:17.408296+0000","last_unstale":"2024-09-12T17:37:51.299103+0000","last_undegraded":"2024-09-12T17:37:51.299103+0000","last_fullsized":"2024-09-12T17:37:51.299103+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:40.080273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"265'6","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:46.315558+0000","last_change":"2024-09-12T17:15:43.165243+0000","last_active":"2024-09-12T17:40:46.315558+0000","last_peered":"2024-09-12T17:40:46.315558+0000","last_clean":"2024-09-12T17:40:46.315558+0000","last_became_active":"2024-09-12T17:15:43.163824+0000","last_became_peered":"2024-09-12T17:15:43.163824+0000","last_unstale":"2024-09-12T17:40:46.315558+0000","last_undegraded":"2024-09-12T17:40:46.315558+0000","last_fullsized":"2024-09-12T17:40:46.315558+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:49.835850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5122,"num_write":6,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:36.301685+0000","last_change":"2024-09-12T17:15:40.115586+0000","last_active":"2024-09-12T17:38:36.301685+0000","last_peered":"2024-09-12T17:38:36.301685+0000","last_clean":"2024-09-12T17:38:36.301685+0000","last_became_active":"2024-09-12T17:15:40.114860+0000","last_became_peered":"2024-09-12T17:15:40.114860+0000","last_unstale":"2024-09-12T17:38:36.301685+0000","last_undegraded":"2024-09-12T17:38:36.301685+0000","last_fullsized":"2024-09-12T17:38:36.301685+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:40:36.955089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"265'55","reported_seq":197,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:56.027098+0000","last_change":"2024-09-12T17:13:54.833779+0000","last_active":"2024-09-12T17:38:56.027098+0000","last_peered":"2024-09-12T17:38:56.027098+0000","last_clean":"2024-09-12T17:38:56.027098+0000","last_became_active":"2024-09-12T17:13:54.832949+0000","last_became_peered":"2024-09-12T17:13:54.832949+0000","last_unstale":"2024-09-12T17:38:56.027098+0000","last_undegraded":"2024-09-12T17:38:56.027098+0000","last_fullsized":"2024-09-12T17:38:56.027098+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:16.134614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":283,"num_read_kb":200,"num_write":95,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"265'393","reported_seq":1092,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:49.548572+0000","last_change":"2024-09-12T17:41:49.548572+0000","last_active":"2024-09-12T17:41:49.548572+0000","last_peered":"2024-09-12T17:41:49.548572+0000","last_clean":"2024-09-12T17:41:49.548572+0000","last_became_active":"2024-09-12T16:58:18.713754+0000","last_became_peered":"2024-09-12T16:58:18.713754+0000","last_unstale":"2024-09-12T17:41:49.548572+0000","last_undegraded":"2024-09-12T17:41:49.548572+0000","last_fullsized":"2024-09-12T17:41:49.548572+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'393","last_scrub_stamp":"2024-09-12T17:41:49.548319+0000","last_deep_scrub":"265'393","last_deep_scrub_stamp":"2024-09-12T17:41:49.548319+0000","last_clean_scrub_stamp":"2024-09-12T17:41:49.548319+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:37.288699+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":207329,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":632,"num_read_kb":52184,"num_write":1250,"num_write_kb":52679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"265'127","reported_seq":726,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:04.402662+0000","last_change":"2024-09-12T16:58:21.709064+0000","last_active":"2024-09-12T17:40:04.402662+0000","last_peered":"2024-09-12T17:40:04.402662+0000","last_clean":"2024-09-12T17:40:04.402662+0000","last_became_active":"2024-09-12T16:58:21.708409+0000","last_became_peered":"2024-09-12T16:58:21.708409+0000","last_unstale":"2024-09-12T17:40:04.402662+0000","last_undegraded":"2024-09-12T17:40:04.402662+0000","last_fullsized":"2024-09-12T17:40:04.402662+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:23.027142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":568,"num_read_kb":472,"num_write":186,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"265'363","reported_seq":996,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:45.351133+0000","last_change":"2024-09-12T17:41:45.351133+0000","last_active":"2024-09-12T17:41:45.351133+0000","last_peered":"2024-09-12T17:41:45.351133+0000","last_clean":"2024-09-12T17:41:45.351133+0000","last_became_active":"2024-09-12T16:58:18.699994+0000","last_became_peered":"2024-09-12T16:58:18.699994+0000","last_unstale":"2024-09-12T17:41:45.351133+0000","last_undegraded":"2024-09-12T17:41:45.351133+0000","last_fullsized":"2024-09-12T17:41:45.351133+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'363","last_scrub_stamp":"2024-09-12T17:41:45.350930+0000","last_deep_scrub":"265'363","last_deep_scrub_stamp":"2024-09-12T17:41:45.350930+0000","last_clean_scrub_stamp":"2024-09-12T17:41:45.350930+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:17.973292+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263228,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":513,"num_read_kb":14780,"num_write":1119,"num_write_kb":32109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"265'61","reported_seq":640,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:48.739807+0000","last_change":"2024-09-12T16:58:21.722398+0000","last_active":"2024-09-12T17:39:48.739807+0000","last_peered":"2024-09-12T17:39:48.739807+0000","last_clean":"2024-09-12T17:39:48.739807+0000","last_became_active":"2024-09-12T16:58:21.721536+0000","last_became_peered":"2024-09-12T16:58:21.721536+0000","last_unstale":"2024-09-12T17:39:48.739807+0000","last_undegraded":"2024-09-12T17:39:48.739807+0000","last_fullsized":"2024-09-12T17:39:48.739807+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:56:41.263387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":297,"num_read_kb":264,"num_write":81,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"265'426","reported_seq":1241,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:48.141167+0000","last_change":"2024-09-12T17:41:48.141167+0000","last_active":"2024-09-12T17:41:48.141167+0000","last_peered":"2024-09-12T17:41:48.141167+0000","last_clean":"2024-09-12T17:41:48.141167+0000","last_became_active":"2024-09-12T16:58:18.687865+0000","last_became_peered":"2024-09-12T16:58:18.687865+0000","last_unstale":"2024-09-12T17:41:48.141167+0000","last_undegraded":"2024-09-12T17:41:48.141167+0000","last_fullsized":"2024-09-12T17:41:48.141167+0000","mapping_epoch":23,"log_start":"265'400","ondisk_log_start":"265'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'426","last_scrub_stamp":"2024-09-12T17:41:48.140932+0000","last_deep_scrub":"265'426","last_deep_scrub_stamp":"2024-09-12T17:41:48.140932+0000","last_clean_scrub_stamp":"2024-09-12T17:41:48.140932+0000","objects_scrubbed":9,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:06.456200+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263210,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1063,"num_read_kb":27565,"num_write":1556,"num_write_kb":41677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"265'166","reported_seq":768,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:55.642706+0000","last_change":"2024-09-12T17:41:55.642706+0000","last_active":"2024-09-12T17:41:55.642706+0000","last_peered":"2024-09-12T17:41:55.642706+0000","last_clean":"2024-09-12T17:41:55.642706+0000","last_became_active":"2024-09-12T16:58:21.703861+0000","last_became_peered":"2024-09-12T16:58:21.703861+0000","last_unstale":"2024-09-12T17:41:55.642706+0000","last_undegraded":"2024-09-12T17:41:55.642706+0000","last_fullsized":"2024-09-12T17:41:55.642706+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'166","last_scrub_stamp":"2024-09-12T17:41:55.642509+0000","last_deep_scrub":"265'166","last_deep_scrub_stamp":"2024-09-12T17:41:55.642509+0000","last_clean_scrub_stamp":"2024-09-12T17:41:55.642509+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:44.318567+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":693,"num_read_kb":563,"num_write":272,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"265'374","reported_seq":1035,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:51.657131+0000","last_change":"2024-09-12T17:41:51.657131+0000","last_active":"2024-09-12T17:41:51.657131+0000","last_peered":"2024-09-12T17:41:51.657131+0000","last_clean":"2024-09-12T17:41:51.657131+0000","last_became_active":"2024-09-12T16:58:18.716783+0000","last_became_peered":"2024-09-12T16:58:18.716783+0000","last_unstale":"2024-09-12T17:41:51.657131+0000","last_undegraded":"2024-09-12T17:41:51.657131+0000","last_fullsized":"2024-09-12T17:41:51.657131+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'374","last_scrub_stamp":"2024-09-12T17:41:51.656864+0000","last_deep_scrub":"265'374","last_deep_scrub_stamp":"2024-09-12T17:41:51.656864+0000","last_clean_scrub_stamp":"2024-09-12T17:41:51.656864+0000","objects_scrubbed":7,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:26.088285+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":698119,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":542,"num_read_kb":33905,"num_write":1205,"num_write_kb":31442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"265'207","reported_seq":817,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:54.056910+0000","last_change":"2024-09-12T17:41:54.056910+0000","last_active":"2024-09-12T17:41:54.056910+0000","last_peered":"2024-09-12T17:41:54.056910+0000","last_clean":"2024-09-12T17:41:54.056910+0000","last_became_active":"2024-09-12T16:58:21.699869+0000","last_became_peered":"2024-09-12T16:58:21.699869+0000","last_unstale":"2024-09-12T17:41:54.056910+0000","last_undegraded":"2024-09-12T17:41:54.056910+0000","last_fullsized":"2024-09-12T17:41:54.056910+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'207","last_scrub_stamp":"2024-09-12T17:41:54.056679+0000","last_deep_scrub":"265'207","last_deep_scrub_stamp":"2024-09-12T17:41:54.056679+0000","last_clean_scrub_stamp":"2024-09-12T17:41:54.056679+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:21.954587+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":874,"num_read_kb":727,"num_write":307,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"265'359","reported_seq":1031,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:50.584607+0000","last_change":"2024-09-12T17:41:50.584607+0000","last_active":"2024-09-12T17:41:50.584607+0000","last_peered":"2024-09-12T17:41:50.584607+0000","last_clean":"2024-09-12T17:41:50.584607+0000","last_became_active":"2024-09-12T16:58:18.688345+0000","last_became_peered":"2024-09-12T16:58:18.688345+0000","last_unstale":"2024-09-12T17:41:50.584607+0000","last_undegraded":"2024-09-12T17:41:50.584607+0000","last_fullsized":"2024-09-12T17:41:50.584607+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'359","last_scrub_stamp":"2024-09-12T17:41:50.584401+0000","last_deep_scrub":"265'359","last_deep_scrub_stamp":"2024-09-12T17:41:50.584401+0000","last_clean_scrub_stamp":"2024-09-12T17:41:50.584401+0000","objects_scrubbed":7,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:59.917375+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263227,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":585,"num_read_kb":27999,"num_write":1129,"num_write_kb":20285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"265'277","reported_seq":928,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:51.482503+0000","last_change":"2024-09-12T17:41:51.482503+0000","last_active":"2024-09-12T17:41:51.482503+0000","last_peered":"2024-09-12T17:41:51.482503+0000","last_clean":"2024-09-12T17:41:51.482503+0000","last_became_active":"2024-09-12T16:58:21.709879+0000","last_became_peered":"2024-09-12T16:58:21.709879+0000","last_unstale":"2024-09-12T17:41:51.482503+0000","last_undegraded":"2024-09-12T17:41:51.482503+0000","last_fullsized":"2024-09-12T17:41:51.482503+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'277","last_scrub_stamp":"2024-09-12T17:41:51.482314+0000","last_deep_scrub":"265'277","last_deep_scrub_stamp":"2024-09-12T17:41:51.482314+0000","last_clean_scrub_stamp":"2024-09-12T17:41:51.482314+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:57.714571+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1330,"num_read_kb":1122,"num_write":481,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"265'397","reported_seq":1054,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:49.610921+0000","last_change":"2024-09-12T17:41:49.610921+0000","last_active":"2024-09-12T17:41:49.610921+0000","last_peered":"2024-09-12T17:41:49.610921+0000","last_clean":"2024-09-12T17:41:49.610921+0000","last_became_active":"2024-09-12T16:58:18.698280+0000","last_became_peered":"2024-09-12T16:58:18.698280+0000","last_unstale":"2024-09-12T17:41:49.610921+0000","last_undegraded":"2024-09-12T17:41:49.610921+0000","last_fullsized":"2024-09-12T17:41:49.610921+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'397","last_scrub_stamp":"2024-09-12T17:41:49.610656+0000","last_deep_scrub":"265'397","last_deep_scrub_stamp":"2024-09-12T17:41:49.610656+0000","last_clean_scrub_stamp":"2024-09-12T17:41:49.610656+0000","objects_scrubbed":11,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:39.785159+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8651850,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":594,"num_read_kb":25091,"num_write":1290,"num_write_kb":36260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"265'157","reported_seq":760,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:25.144333+0000","last_change":"2024-09-12T16:58:21.710011+0000","last_active":"2024-09-12T17:38:25.144333+0000","last_peered":"2024-09-12T17:38:25.144333+0000","last_clean":"2024-09-12T17:38:25.144333+0000","last_became_active":"2024-09-12T16:58:21.706493+0000","last_became_peered":"2024-09-12T16:58:21.706493+0000","last_unstale":"2024-09-12T17:38:25.144333+0000","last_undegraded":"2024-09-12T17:38:25.144333+0000","last_fullsized":"2024-09-12T17:38:25.144333+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:28.236536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":697,"num_read_kb":578,"num_write":245,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"265'335","reported_seq":1001,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:53.613886+0000","last_change":"2024-09-12T17:41:53.613886+0000","last_active":"2024-09-12T17:41:53.613886+0000","last_peered":"2024-09-12T17:41:53.613886+0000","last_clean":"2024-09-12T17:41:53.613886+0000","last_became_active":"2024-09-12T16:58:18.694357+0000","last_became_peered":"2024-09-12T16:58:18.694357+0000","last_unstale":"2024-09-12T17:41:53.613886+0000","last_undegraded":"2024-09-12T17:41:53.613886+0000","last_fullsized":"2024-09-12T17:41:53.613886+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'335","last_scrub_stamp":"2024-09-12T17:41:53.613673+0000","last_deep_scrub":"265'335","last_deep_scrub_stamp":"2024-09-12T17:41:53.613673+0000","last_clean_scrub_stamp":"2024-09-12T17:41:53.613673+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:18.786062+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":485,"num_read_kb":76108,"num_write":1068,"num_write_kb":48403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"265'76","reported_seq":653,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:57.331489+0000","last_change":"2024-09-12T16:58:21.723849+0000","last_active":"2024-09-12T17:37:57.331489+0000","last_peered":"2024-09-12T17:37:57.331489+0000","last_clean":"2024-09-12T17:37:57.331489+0000","last_became_active":"2024-09-12T16:58:21.723077+0000","last_became_peered":"2024-09-12T16:58:21.723077+0000","last_unstale":"2024-09-12T17:37:57.331489+0000","last_undegraded":"2024-09-12T17:37:57.331489+0000","last_fullsized":"2024-09-12T17:37:57.331489+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:24.692985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":363,"num_read_kb":315,"num_write":111,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"265'311","reported_seq":928,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:44.698572+0000","last_change":"2024-09-12T17:41:44.698572+0000","last_active":"2024-09-12T17:41:44.698572+0000","last_peered":"2024-09-12T17:41:44.698572+0000","last_clean":"2024-09-12T17:41:44.698572+0000","last_became_active":"2024-09-12T16:58:18.701590+0000","last_became_peered":"2024-09-12T16:58:18.701590+0000","last_unstale":"2024-09-12T17:41:44.698572+0000","last_undegraded":"2024-09-12T17:41:44.698572+0000","last_fullsized":"2024-09-12T17:41:44.698572+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'311","last_scrub_stamp":"2024-09-12T17:41:44.698375+0000","last_deep_scrub":"265'311","last_deep_scrub_stamp":"2024-09-12T17:41:44.698375+0000","last_clean_scrub_stamp":"2024-09-12T17:41:44.698375+0000","objects_scrubbed":6,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:04.975023+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":399,"num_read_kb":1374,"num_write":924,"num_write_kb":18073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"265'138","reported_seq":747,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:46.474441+0000","last_change":"2024-09-12T17:41:46.474441+0000","last_active":"2024-09-12T17:41:46.474441+0000","last_peered":"2024-09-12T17:41:46.474441+0000","last_clean":"2024-09-12T17:41:46.474441+0000","last_became_active":"2024-09-12T16:58:21.718167+0000","last_became_peered":"2024-09-12T16:58:21.718167+0000","last_unstale":"2024-09-12T17:41:46.474441+0000","last_undegraded":"2024-09-12T17:41:46.474441+0000","last_fullsized":"2024-09-12T17:41:46.474441+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'138","last_scrub_stamp":"2024-09-12T17:41:46.474256+0000","last_deep_scrub":"265'138","last_deep_scrub_stamp":"2024-09-12T17:41:46.474256+0000","last_clean_scrub_stamp":"2024-09-12T17:41:46.474256+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:54.299670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":612,"num_read_kb":510,"num_write":201,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"265'4234","reported_seq":4884,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:42.781502+0000","last_change":"2024-09-12T16:58:21.698194+0000","last_active":"2024-09-12T17:39:42.781502+0000","last_peered":"2024-09-12T17:39:42.781502+0000","last_clean":"2024-09-12T17:39:42.781502+0000","last_became_active":"2024-09-12T16:58:21.697479+0000","last_became_peered":"2024-09-12T16:58:21.697479+0000","last_unstale":"2024-09-12T17:39:42.781502+0000","last_undegraded":"2024-09-12T17:39:42.781502+0000","last_fullsized":"2024-09-12T17:39:42.781502+0000","mapping_epoch":26,"log_start":"265'4200","ondisk_log_start":"265'4200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":3000,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:12:15.711479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17044,"num_read_kb":14289,"num_write":6359,"num_write_kb":3183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"265'324","reported_seq":956,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:46.504070+0000","last_change":"2024-09-12T17:41:46.504070+0000","last_active":"2024-09-12T17:41:46.504070+0000","last_peered":"2024-09-12T17:41:46.504070+0000","last_clean":"2024-09-12T17:41:46.504070+0000","last_became_active":"2024-09-12T16:58:18.713739+0000","last_became_peered":"2024-09-12T16:58:18.713739+0000","last_unstale":"2024-09-12T17:41:46.504070+0000","last_undegraded":"2024-09-12T17:41:46.504070+0000","last_fullsized":"2024-09-12T17:41:46.504070+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'324","last_scrub_stamp":"2024-09-12T17:41:46.503833+0000","last_deep_scrub":"265'324","last_deep_scrub_stamp":"2024-09-12T17:41:46.503833+0000","last_clean_scrub_stamp":"2024-09-12T17:41:46.503833+0000","objects_scrubbed":7,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:49.063988+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":436,"num_read_kb":10222,"num_write":964,"num_write_kb":31220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"265'294","reported_seq":1014,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:55.651444+0000","last_change":"2024-09-12T17:41:55.651444+0000","last_active":"2024-09-12T17:41:55.651444+0000","last_peered":"2024-09-12T17:41:55.651444+0000","last_clean":"2024-09-12T17:41:55.651444+0000","last_became_active":"2024-09-12T16:58:21.723238+0000","last_became_peered":"2024-09-12T16:58:21.723238+0000","last_unstale":"2024-09-12T17:41:55.651444+0000","last_undegraded":"2024-09-12T17:41:55.651444+0000","last_fullsized":"2024-09-12T17:41:55.651444+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'294","last_scrub_stamp":"2024-09-12T17:41:55.651276+0000","last_deep_scrub":"265'294","last_deep_scrub_stamp":"2024-09-12T17:41:55.651276+0000","last_clean_scrub_stamp":"2024-09-12T17:41:55.651276+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:24.004372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1552,"num_read_kb":1372,"num_write":472,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"265'347","reported_seq":968,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:50.456694+0000","last_change":"2024-09-12T17:41:50.456526+0000","last_active":"2024-09-12T17:41:50.456694+0000","last_peered":"2024-09-12T17:41:50.456694+0000","last_clean":"2024-09-12T17:41:50.456694+0000","last_became_active":"2024-09-12T16:58:18.701989+0000","last_became_peered":"2024-09-12T16:58:18.701989+0000","last_unstale":"2024-09-12T17:41:50.456694+0000","last_undegraded":"2024-09-12T17:41:50.456694+0000","last_fullsized":"2024-09-12T17:41:50.456694+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'347","last_scrub_stamp":"2024-09-12T17:41:50.456302+0000","last_deep_scrub":"265'347","last_deep_scrub_stamp":"2024-09-12T17:41:50.456302+0000","last_clean_scrub_stamp":"2024-09-12T17:41:50.456302+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:22.993882+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1343103,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":443,"num_read_kb":5557,"num_write":1028,"num_write_kb":22464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"265'183","reported_seq":799,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:55.659451+0000","last_change":"2024-09-12T17:41:55.659451+0000","last_active":"2024-09-12T17:41:55.659451+0000","last_peered":"2024-09-12T17:41:55.659451+0000","last_clean":"2024-09-12T17:41:55.659451+0000","last_became_active":"2024-09-12T16:58:21.715289+0000","last_became_peered":"2024-09-12T16:58:21.715289+0000","last_unstale":"2024-09-12T17:41:55.659451+0000","last_undegraded":"2024-09-12T17:41:55.659451+0000","last_fullsized":"2024-09-12T17:41:55.659451+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'183","last_scrub_stamp":"2024-09-12T17:41:55.659266+0000","last_deep_scrub":"265'183","last_deep_scrub_stamp":"2024-09-12T17:41:55.659266+0000","last_clean_scrub_stamp":"2024-09-12T17:41:55.659266+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:00.448540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":782,"num_read_kb":649,"num_write":263,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"265'373","reported_seq":1055,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:44.497882+0000","last_change":"2024-09-12T17:41:44.497703+0000","last_active":"2024-09-12T17:41:44.497882+0000","last_peered":"2024-09-12T17:41:44.497882+0000","last_clean":"2024-09-12T17:41:44.497882+0000","last_became_active":"2024-09-12T16:58:18.702185+0000","last_became_peered":"2024-09-12T16:58:18.702185+0000","last_unstale":"2024-09-12T17:41:44.497882+0000","last_undegraded":"2024-09-12T17:41:44.497882+0000","last_fullsized":"2024-09-12T17:41:44.497882+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'373","last_scrub_stamp":"2024-09-12T17:41:44.497473+0000","last_deep_scrub":"265'373","last_deep_scrub_stamp":"2024-09-12T17:41:44.497473+0000","last_clean_scrub_stamp":"2024-09-12T17:41:44.497473+0000","objects_scrubbed":3,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:41.714848+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306656,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":591,"num_read_kb":49223,"num_write":1212,"num_write_kb":37016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"265'189","reported_seq":830,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:44.508406+0000","last_change":"2024-09-12T17:41:44.508120+0000","last_active":"2024-09-12T17:41:44.508406+0000","last_peered":"2024-09-12T17:41:44.508406+0000","last_clean":"2024-09-12T17:41:44.508406+0000","last_became_active":"2024-09-12T16:58:21.718158+0000","last_became_peered":"2024-09-12T16:58:21.718158+0000","last_unstale":"2024-09-12T17:41:44.508406+0000","last_undegraded":"2024-09-12T17:41:44.508406+0000","last_fullsized":"2024-09-12T17:41:44.508406+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'189","last_scrub_stamp":"2024-09-12T17:41:44.507884+0000","last_deep_scrub":"265'189","last_deep_scrub_stamp":"2024-09-12T17:41:44.507884+0000","last_clean_scrub_stamp":"2024-09-12T17:41:44.507884+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:21.650280+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":878,"num_read_kb":727,"num_write":304,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"265'358","reported_seq":1104,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:42.627771+0000","last_change":"2024-09-12T17:41:42.627593+0000","last_active":"2024-09-12T17:41:42.627771+0000","last_peered":"2024-09-12T17:41:42.627771+0000","last_clean":"2024-09-12T17:41:42.627771+0000","last_became_active":"2024-09-12T16:58:18.699360+0000","last_became_peered":"2024-09-12T16:58:18.699360+0000","last_unstale":"2024-09-12T17:41:42.627771+0000","last_undegraded":"2024-09-12T17:41:42.627771+0000","last_fullsized":"2024-09-12T17:41:42.627771+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'358","last_scrub_stamp":"2024-09-12T17:41:42.627381+0000","last_deep_scrub":"265'358","last_deep_scrub_stamp":"2024-09-12T17:41:42.627381+0000","last_clean_scrub_stamp":"2024-09-12T17:41:42.627381+0000","objects_scrubbed":5,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:07.285273+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":626,"num_read_kb":143204,"num_write":1063,"num_write_kb":36082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"265'136","reported_seq":774,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:51.542065+0000","last_change":"2024-09-12T17:41:51.541908+0000","last_active":"2024-09-12T17:41:51.542065+0000","last_peered":"2024-09-12T17:41:51.542065+0000","last_clean":"2024-09-12T17:41:51.542065+0000","last_became_active":"2024-09-12T16:58:21.728321+0000","last_became_peered":"2024-09-12T16:58:21.728321+0000","last_unstale":"2024-09-12T17:41:51.542065+0000","last_undegraded":"2024-09-12T17:41:51.542065+0000","last_fullsized":"2024-09-12T17:41:51.542065+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'136","last_scrub_stamp":"2024-09-12T17:41:51.541730+0000","last_deep_scrub":"265'136","last_deep_scrub_stamp":"2024-09-12T17:41:51.541730+0000","last_clean_scrub_stamp":"2024-09-12T17:41:51.541730+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:58.375721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":636,"num_read_kb":537,"num_write":197,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"265'322","reported_seq":943,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:48.598113+0000","last_change":"2024-09-12T17:41:48.597965+0000","last_active":"2024-09-12T17:41:48.598113+0000","last_peered":"2024-09-12T17:41:48.598113+0000","last_clean":"2024-09-12T17:41:48.598113+0000","last_became_active":"2024-09-12T16:58:18.690634+0000","last_became_peered":"2024-09-12T16:58:18.690634+0000","last_unstale":"2024-09-12T17:41:48.598113+0000","last_undegraded":"2024-09-12T17:41:48.598113+0000","last_fullsized":"2024-09-12T17:41:48.598113+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'322","last_scrub_stamp":"2024-09-12T17:41:48.597755+0000","last_deep_scrub":"265'322","last_deep_scrub_stamp":"2024-09-12T17:41:48.597755+0000","last_clean_scrub_stamp":"2024-09-12T17:41:48.597755+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:42.047491+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159799,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":394,"num_read_kb":27088,"num_write":949,"num_write_kb":25947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"265'299","reported_seq":898,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:26.297433+0000","last_change":"2024-09-12T16:58:21.705137+0000","last_active":"2024-09-12T17:39:26.297433+0000","last_peered":"2024-09-12T17:39:26.297433+0000","last_clean":"2024-09-12T17:39:26.297433+0000","last_became_active":"2024-09-12T16:58:21.702643+0000","last_became_peered":"2024-09-12T16:58:21.702643+0000","last_unstale":"2024-09-12T17:39:26.297433+0000","last_undegraded":"2024-09-12T17:39:26.297433+0000","last_fullsized":"2024-09-12T17:39:26.297433+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1307,"num_read_kb":1045,"num_write":505,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"265'347","reported_seq":1107,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:44.275966+0000","last_change":"2024-09-12T17:41:44.275966+0000","last_active":"2024-09-12T17:41:44.275966+0000","last_peered":"2024-09-12T17:41:44.275966+0000","last_clean":"2024-09-12T17:41:44.275966+0000","last_became_active":"2024-09-12T16:58:18.702310+0000","last_became_peered":"2024-09-12T16:58:18.702310+0000","last_unstale":"2024-09-12T17:41:44.275966+0000","last_undegraded":"2024-09-12T17:41:44.275966+0000","last_fullsized":"2024-09-12T17:41:44.275966+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'347","last_scrub_stamp":"2024-09-12T17:41:44.275743+0000","last_deep_scrub":"265'347","last_deep_scrub_stamp":"2024-09-12T17:41:44.275743+0000","last_clean_scrub_stamp":"2024-09-12T17:41:44.275743+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:46.939621+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":950476,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":583,"num_read_kb":31842,"num_write":1061,"num_write_kb":30837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"265'153","reported_seq":661,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:05.039986+0000","last_change":"2024-09-12T16:58:29.792625+0000","last_active":"2024-09-12T17:40:05.039986+0000","last_peered":"2024-09-12T17:40:05.039986+0000","last_clean":"2024-09-12T17:40:05.039986+0000","last_became_active":"2024-09-12T16:58:29.792043+0000","last_became_peered":"2024-09-12T16:58:29.792043+0000","last_unstale":"2024-09-12T17:40:05.039986+0000","last_undegraded":"2024-09-12T17:40:05.039986+0000","last_fullsized":"2024-09-12T17:40:05.039986+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:46.501133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":230,"num_read_kb":220,"num_write":374,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"265'102","reported_seq":694,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:50.519732+0000","last_change":"2024-09-12T17:41:50.519732+0000","last_active":"2024-09-12T17:41:50.519732+0000","last_peered":"2024-09-12T17:41:50.519732+0000","last_clean":"2024-09-12T17:41:50.519732+0000","last_became_active":"2024-09-12T16:58:21.707428+0000","last_became_peered":"2024-09-12T16:58:21.707428+0000","last_unstale":"2024-09-12T17:41:50.519732+0000","last_undegraded":"2024-09-12T17:41:50.519732+0000","last_fullsized":"2024-09-12T17:41:50.519732+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'102","last_scrub_stamp":"2024-09-12T17:41:50.519549+0000","last_deep_scrub":"265'102","last_deep_scrub_stamp":"2024-09-12T17:41:50.519549+0000","last_clean_scrub_stamp":"2024-09-12T17:41:50.519549+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:07.630997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":440,"num_read_kb":374,"num_write":161,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"265'380","reported_seq":1041,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:45.520248+0000","last_change":"2024-09-12T17:41:45.520248+0000","last_active":"2024-09-12T17:41:45.520248+0000","last_peered":"2024-09-12T17:41:45.520248+0000","last_clean":"2024-09-12T17:41:45.520248+0000","last_became_active":"2024-09-12T16:58:18.714782+0000","last_became_peered":"2024-09-12T16:58:18.714782+0000","last_unstale":"2024-09-12T17:41:45.520248+0000","last_undegraded":"2024-09-12T17:41:45.520248+0000","last_fullsized":"2024-09-12T17:41:45.520248+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'380","last_scrub_stamp":"2024-09-12T17:41:45.520059+0000","last_deep_scrub":"265'380","last_deep_scrub_stamp":"2024-09-12T17:41:45.520059+0000","last_clean_scrub_stamp":"2024-09-12T17:41:45.520059+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:52.748711+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194316,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":558,"num_read_kb":18943,"num_write":1229,"num_write_kb":58984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:32.352706+0000","last_change":"2024-09-12T16:58:23.713332+0000","last_active":"2024-09-12T17:39:32.352706+0000","last_peered":"2024-09-12T17:39:32.352706+0000","last_clean":"2024-09-12T17:39:32.352706+0000","last_became_active":"2024-09-12T16:58:23.712621+0000","last_became_peered":"2024-09-12T16:58:23.712621+0000","last_unstale":"2024-09-12T17:39:32.352706+0000","last_undegraded":"2024-09-12T17:39:32.352706+0000","last_fullsized":"2024-09-12T17:39:32.352706+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"265'338","reported_seq":937,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.642685+0000","last_change":"2024-09-12T16:58:25.730728+0000","last_active":"2024-09-12T17:41:32.642685+0000","last_peered":"2024-09-12T17:41:32.642685+0000","last_clean":"2024-09-12T17:41:32.642685+0000","last_became_active":"2024-09-12T16:58:25.728901+0000","last_became_peered":"2024-09-12T16:58:25.728901+0000","last_unstale":"2024-09-12T17:41:32.642685+0000","last_undegraded":"2024-09-12T17:41:32.642685+0000","last_fullsized":"2024-09-12T17:41:32.642685+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46434,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":549,"num_read_kb":1164,"num_write":438,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:11.289497+0000","last_change":"2024-09-12T16:58:27.753040+0000","last_active":"2024-09-12T17:37:11.289497+0000","last_peered":"2024-09-12T17:37:11.289497+0000","last_clean":"2024-09-12T17:37:11.289497+0000","last_became_active":"2024-09-12T16:58:27.752315+0000","last_became_peered":"2024-09-12T16:58:27.752315+0000","last_unstale":"2024-09-12T17:37:11.289497+0000","last_undegraded":"2024-09-12T17:37:11.289497+0000","last_fullsized":"2024-09-12T17:37:11.289497+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:39.272577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"265'126","reported_seq":675,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:03.062821+0000","last_change":"2024-09-12T16:58:29.774689+0000","last_active":"2024-09-12T17:40:03.062821+0000","last_peered":"2024-09-12T17:40:03.062821+0000","last_clean":"2024-09-12T17:40:03.062821+0000","last_became_active":"2024-09-12T16:58:29.773874+0000","last_became_peered":"2024-09-12T16:58:29.773874+0000","last_unstale":"2024-09-12T17:40:03.062821+0000","last_undegraded":"2024-09-12T17:40:03.062821+0000","last_fullsized":"2024-09-12T17:40:03.062821+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:24.286576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":191,"num_read_kb":190,"num_write":216,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"265'402","reported_seq":1061,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:52.691279+0000","last_change":"2024-09-12T17:41:52.691279+0000","last_active":"2024-09-12T17:41:52.691279+0000","last_peered":"2024-09-12T17:41:52.691279+0000","last_clean":"2024-09-12T17:41:52.691279+0000","last_became_active":"2024-09-12T16:58:21.717806+0000","last_became_peered":"2024-09-12T16:58:21.717806+0000","last_unstale":"2024-09-12T17:41:52.691279+0000","last_undegraded":"2024-09-12T17:41:52.691279+0000","last_fullsized":"2024-09-12T17:41:52.691279+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'402","last_scrub_stamp":"2024-09-12T17:41:52.691089+0000","last_deep_scrub":"265'402","last_deep_scrub_stamp":"2024-09-12T17:41:52.691089+0000","last_clean_scrub_stamp":"2024-09-12T17:41:52.691089+0000","objects_scrubbed":2,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:57.508897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1815,"num_read_kb":1449,"num_write":653,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4270,"num_omap_keys":19,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"265'351","reported_seq":1045,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:41.315205+0000","last_change":"2024-09-12T17:41:41.315205+0000","last_active":"2024-09-12T17:41:41.315205+0000","last_peered":"2024-09-12T17:41:41.315205+0000","last_clean":"2024-09-12T17:41:41.315205+0000","last_became_active":"2024-09-12T16:58:18.691335+0000","last_became_peered":"2024-09-12T16:58:18.691335+0000","last_unstale":"2024-09-12T17:41:41.315205+0000","last_undegraded":"2024-09-12T17:41:41.315205+0000","last_fullsized":"2024-09-12T17:41:41.315205+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'351","last_scrub_stamp":"2024-09-12T17:41:41.314984+0000","last_deep_scrub":"265'351","last_deep_scrub_stamp":"2024-09-12T17:41:41.314984+0000","last_clean_scrub_stamp":"2024-09-12T17:41:41.314984+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:10.989680+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1278687,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":548,"num_read_kb":106559,"num_write":1101,"num_write_kb":67871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:56.476590+0000","last_change":"2024-09-12T17:41:56.476590+0000","last_active":"2024-09-12T17:41:56.476590+0000","last_peered":"2024-09-12T17:41:56.476590+0000","last_clean":"2024-09-12T17:41:56.476590+0000","last_became_active":"2024-09-12T16:58:23.718656+0000","last_became_peered":"2024-09-12T16:58:23.718656+0000","last_unstale":"2024-09-12T17:41:56.476590+0000","last_undegraded":"2024-09-12T17:41:56.476590+0000","last_fullsized":"2024-09-12T17:41:56.476590+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:56.476408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:56.476408+0000","last_clean_scrub_stamp":"2024-09-12T17:41:56.476408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:17.560169+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"265'99","reported_seq":622,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:31.298822+0000","last_change":"2024-09-12T16:58:25.714387+0000","last_active":"2024-09-12T17:39:31.298822+0000","last_peered":"2024-09-12T17:39:31.298822+0000","last_clean":"2024-09-12T17:39:31.298822+0000","last_became_active":"2024-09-12T16:58:25.713567+0000","last_became_peered":"2024-09-12T16:58:25.713567+0000","last_unstale":"2024-09-12T17:39:31.298822+0000","last_undegraded":"2024-09-12T17:39:31.298822+0000","last_fullsized":"2024-09-12T17:39:31.298822+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":95,"num_read_kb":90,"num_write":66,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:11.267295+0000","last_change":"2024-09-12T16:58:27.729072+0000","last_active":"2024-09-12T17:37:11.267295+0000","last_peered":"2024-09-12T17:37:11.267295+0000","last_clean":"2024-09-12T17:37:11.267295+0000","last_became_active":"2024-09-12T16:58:27.728276+0000","last_became_peered":"2024-09-12T16:58:27.728276+0000","last_unstale":"2024-09-12T17:37:11.267295+0000","last_undegraded":"2024-09-12T17:37:11.267295+0000","last_fullsized":"2024-09-12T17:37:11.267295+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:19.029657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"265'125","reported_seq":630,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:04.398546+0000","last_change":"2024-09-12T16:58:29.781407+0000","last_active":"2024-09-12T17:40:04.398546+0000","last_peered":"2024-09-12T17:40:04.398546+0000","last_clean":"2024-09-12T17:40:04.398546+0000","last_became_active":"2024-09-12T16:58:29.780598+0000","last_became_peered":"2024-09-12T16:58:29.780598+0000","last_unstale":"2024-09-12T17:40:04.398546+0000","last_undegraded":"2024-09-12T17:40:04.398546+0000","last_fullsized":"2024-09-12T17:40:04.398546+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:18.860850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":203,"num_read_kb":191,"num_write":301,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"265'80","reported_seq":651,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:50.080879+0000","last_change":"2024-09-12T17:41:50.080720+0000","last_active":"2024-09-12T17:41:50.080879+0000","last_peered":"2024-09-12T17:41:50.080879+0000","last_clean":"2024-09-12T17:41:50.080879+0000","last_became_active":"2024-09-12T16:58:21.718773+0000","last_became_peered":"2024-09-12T16:58:21.718773+0000","last_unstale":"2024-09-12T17:41:50.080879+0000","last_undegraded":"2024-09-12T17:41:50.080879+0000","last_fullsized":"2024-09-12T17:41:50.080879+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'80","last_scrub_stamp":"2024-09-12T17:41:50.080528+0000","last_deep_scrub":"265'80","last_deep_scrub_stamp":"2024-09-12T17:41:50.080528+0000","last_clean_scrub_stamp":"2024-09-12T17:41:50.080528+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:21.460279+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":373,"num_read_kb":312,"num_write":123,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"265'334","reported_seq":933,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:47.460517+0000","last_change":"2024-09-12T17:41:47.460517+0000","last_active":"2024-09-12T17:41:47.460517+0000","last_peered":"2024-09-12T17:41:47.460517+0000","last_clean":"2024-09-12T17:41:47.460517+0000","last_became_active":"2024-09-12T16:58:55.843826+0000","last_became_peered":"2024-09-12T16:58:55.843826+0000","last_unstale":"2024-09-12T17:41:47.460517+0000","last_undegraded":"2024-09-12T17:41:47.460517+0000","last_fullsized":"2024-09-12T17:41:47.460517+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'334","last_scrub_stamp":"2024-09-12T17:41:47.460291+0000","last_deep_scrub":"265'334","last_deep_scrub_stamp":"2024-09-12T17:41:47.460291+0000","last_clean_scrub_stamp":"2024-09-12T17:41:47.460291+0000","objects_scrubbed":6,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:13.714567+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263214,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":424,"num_read_kb":4809,"num_write":985,"num_write_kb":23718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:32.372887+0000","last_change":"2024-09-12T16:58:23.707417+0000","last_active":"2024-09-12T17:39:32.372887+0000","last_peered":"2024-09-12T17:39:32.372887+0000","last_clean":"2024-09-12T17:39:32.372887+0000","last_became_active":"2024-09-12T16:58:23.706953+0000","last_became_peered":"2024-09-12T16:58:23.706953+0000","last_unstale":"2024-09-12T17:39:32.372887+0000","last_undegraded":"2024-09-12T17:39:32.372887+0000","last_fullsized":"2024-09-12T17:39:32.372887+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"265'105","reported_seq":638,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:11.702449+0000","last_change":"2024-09-12T16:58:25.714085+0000","last_active":"2024-09-12T17:39:11.702449+0000","last_peered":"2024-09-12T17:39:11.702449+0000","last_clean":"2024-09-12T17:39:11.702449+0000","last_became_active":"2024-09-12T16:58:25.713213+0000","last_became_peered":"2024-09-12T16:58:25.713213+0000","last_unstale":"2024-09-12T17:39:11.702449+0000","last_undegraded":"2024-09-12T17:39:11.702449+0000","last_fullsized":"2024-09-12T17:39:11.702449+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:25.447055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":116,"num_write":82,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"265'770","reported_seq":4622,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.976892+0000","last_change":"2024-09-12T16:58:27.753546+0000","last_active":"2024-09-12T17:41:32.976892+0000","last_peered":"2024-09-12T17:41:32.976892+0000","last_clean":"2024-09-12T17:41:32.976892+0000","last_became_active":"2024-09-12T16:58:27.752801+0000","last_became_peered":"2024-09-12T16:58:27.752801+0000","last_unstale":"2024-09-12T17:41:32.976892+0000","last_undegraded":"2024-09-12T17:41:32.976892+0000","last_fullsized":"2024-09-12T17:41:32.976892+0000","mapping_epoch":32,"log_start":"265'702","ondisk_log_start":"265'702","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":702,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:03.558787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"265'204","reported_seq":1022,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:05.112599+0000","last_change":"2024-09-12T16:58:29.770179+0000","last_active":"2024-09-12T17:40:05.112599+0000","last_peered":"2024-09-12T17:40:05.112599+0000","last_clean":"2024-09-12T17:40:05.112599+0000","last_became_active":"2024-09-12T16:58:29.769351+0000","last_became_peered":"2024-09-12T16:58:29.769351+0000","last_unstale":"2024-09-12T17:40:05.112599+0000","last_undegraded":"2024-09-12T17:40:05.112599+0000","last_fullsized":"2024-09-12T17:40:05.112599+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:38.433650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":633,"num_read_kb":631,"num_write":454,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"265'164","reported_seq":762,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:49.549548+0000","last_change":"2024-09-12T17:41:49.549407+0000","last_active":"2024-09-12T17:41:49.549548+0000","last_peered":"2024-09-12T17:41:49.549548+0000","last_clean":"2024-09-12T17:41:49.549548+0000","last_became_active":"2024-09-12T16:58:21.710646+0000","last_became_peered":"2024-09-12T16:58:21.710646+0000","last_unstale":"2024-09-12T17:41:49.549548+0000","last_undegraded":"2024-09-12T17:41:49.549548+0000","last_fullsized":"2024-09-12T17:41:49.549548+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'164","last_scrub_stamp":"2024-09-12T17:41:49.549228+0000","last_deep_scrub":"265'164","last_deep_scrub_stamp":"2024-09-12T17:41:49.549228+0000","last_clean_scrub_stamp":"2024-09-12T17:41:49.549228+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:48.619499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":698,"num_read_kb":573,"num_write":260,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"265'344","reported_seq":977,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:40.452831+0000","last_change":"2024-09-12T17:41:40.452831+0000","last_active":"2024-09-12T17:41:40.452831+0000","last_peered":"2024-09-12T17:41:40.452831+0000","last_clean":"2024-09-12T17:41:40.452831+0000","last_became_active":"2024-09-12T16:58:18.689915+0000","last_became_peered":"2024-09-12T16:58:18.689915+0000","last_unstale":"2024-09-12T17:41:40.452831+0000","last_undegraded":"2024-09-12T17:41:40.452831+0000","last_fullsized":"2024-09-12T17:41:40.452831+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'344","last_scrub_stamp":"2024-09-12T17:41:40.452621+0000","last_deep_scrub":"265'344","last_deep_scrub_stamp":"2024-09-12T17:41:40.452621+0000","last_clean_scrub_stamp":"2024-09-12T17:41:40.452621+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:57.294233+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388626,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":434,"num_read_kb":42593,"num_write":1103,"num_write_kb":36991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:32.352768+0000","last_change":"2024-09-12T16:58:23.697918+0000","last_active":"2024-09-12T17:39:32.352768+0000","last_peered":"2024-09-12T17:39:32.352768+0000","last_clean":"2024-09-12T17:39:32.352768+0000","last_became_active":"2024-09-12T16:58:23.697159+0000","last_became_peered":"2024-09-12T16:58:23.697159+0000","last_unstale":"2024-09-12T17:39:32.352768+0000","last_undegraded":"2024-09-12T17:39:32.352768+0000","last_fullsized":"2024-09-12T17:39:32.352768+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"265'248","reported_seq":815,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.433349+0000","last_change":"2024-09-12T16:58:25.949946+0000","last_active":"2024-09-12T17:41:32.433349+0000","last_peered":"2024-09-12T17:41:32.433349+0000","last_clean":"2024-09-12T17:41:32.433349+0000","last_became_active":"2024-09-12T16:58:25.949179+0000","last_became_peered":"2024-09-12T16:58:25.949179+0000","last_unstale":"2024-09-12T17:41:32.433349+0000","last_undegraded":"2024-09-12T17:41:32.433349+0000","last_fullsized":"2024-09-12T17:41:32.433349+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43414,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":422,"num_read_kb":981,"num_write":340,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"265'785","reported_seq":2099,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.076506+0000","last_change":"2024-09-12T16:58:27.746737+0000","last_active":"2024-09-12T17:41:33.076506+0000","last_peered":"2024-09-12T17:41:33.076506+0000","last_clean":"2024-09-12T17:41:33.076506+0000","last_became_active":"2024-09-12T16:58:27.745988+0000","last_became_peered":"2024-09-12T16:58:27.745988+0000","last_unstale":"2024-09-12T17:41:33.076506+0000","last_undegraded":"2024-09-12T17:41:33.076506+0000","last_fullsized":"2024-09-12T17:41:33.076506+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:10.802947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"265'150","reported_seq":729,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:53.700294+0000","last_change":"2024-09-12T17:41:53.700294+0000","last_active":"2024-09-12T17:41:53.700294+0000","last_peered":"2024-09-12T17:41:53.700294+0000","last_clean":"2024-09-12T17:41:53.700294+0000","last_became_active":"2024-09-12T16:58:21.710029+0000","last_became_peered":"2024-09-12T16:58:21.710029+0000","last_unstale":"2024-09-12T17:41:53.700294+0000","last_undegraded":"2024-09-12T17:41:53.700294+0000","last_fullsized":"2024-09-12T17:41:53.700294+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'150","last_scrub_stamp":"2024-09-12T17:41:53.700121+0000","last_deep_scrub":"265'150","last_deep_scrub_stamp":"2024-09-12T17:41:53.700121+0000","last_clean_scrub_stamp":"2024-09-12T17:41:53.700121+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:02.023536+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":614,"num_read_kb":496,"num_write":228,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"265'366","reported_seq":1021,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:44.502758+0000","last_change":"2024-09-12T17:41:44.502758+0000","last_active":"2024-09-12T17:41:44.502758+0000","last_peered":"2024-09-12T17:41:44.502758+0000","last_clean":"2024-09-12T17:41:44.502758+0000","last_became_active":"2024-09-12T16:58:18.715448+0000","last_became_peered":"2024-09-12T16:58:18.715448+0000","last_unstale":"2024-09-12T17:41:44.502758+0000","last_undegraded":"2024-09-12T17:41:44.502758+0000","last_fullsized":"2024-09-12T17:41:44.502758+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'366","last_scrub_stamp":"2024-09-12T17:41:44.502506+0000","last_deep_scrub":"265'366","last_deep_scrub_stamp":"2024-09-12T17:41:44.502506+0000","last_clean_scrub_stamp":"2024-09-12T17:41:44.502506+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:08.236868+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1147727,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":546,"num_read_kb":11904,"num_write":1219,"num_write_kb":32051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:36.323949+0000","last_change":"2024-09-12T16:58:23.720919+0000","last_active":"2024-09-12T17:39:36.323949+0000","last_peered":"2024-09-12T17:39:36.323949+0000","last_clean":"2024-09-12T17:39:36.323949+0000","last_became_active":"2024-09-12T16:58:23.720096+0000","last_became_peered":"2024-09-12T16:58:23.720096+0000","last_unstale":"2024-09-12T17:39:36.323949+0000","last_undegraded":"2024-09-12T17:39:36.323949+0000","last_fullsized":"2024-09-12T17:39:36.323949+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"265'359","reported_seq":969,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.812457+0000","last_change":"2024-09-12T16:58:25.947522+0000","last_active":"2024-09-12T17:41:32.812457+0000","last_peered":"2024-09-12T17:41:32.812457+0000","last_clean":"2024-09-12T17:41:32.812457+0000","last_became_active":"2024-09-12T16:58:25.946765+0000","last_became_peered":"2024-09-12T16:58:25.946765+0000","last_unstale":"2024-09-12T17:41:32.812457+0000","last_undegraded":"2024-09-12T17:41:32.812457+0000","last_fullsized":"2024-09-12T17:41:32.812457+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46152,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":583,"num_read_kb":1215,"num_write":464,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:53.705109+0000","last_change":"2024-09-12T16:58:27.754351+0000","last_active":"2024-09-12T17:38:53.705109+0000","last_peered":"2024-09-12T17:38:53.705109+0000","last_clean":"2024-09-12T17:38:53.705109+0000","last_became_active":"2024-09-12T16:58:27.753616+0000","last_became_peered":"2024-09-12T16:58:27.753616+0000","last_unstale":"2024-09-12T17:38:53.705109+0000","last_undegraded":"2024-09-12T17:38:53.705109+0000","last_fullsized":"2024-09-12T17:38:53.705109+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:26.306126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"265'550","reported_seq":1358,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:24.912198+0000","last_change":"2024-09-12T16:58:29.774852+0000","last_active":"2024-09-12T17:41:24.912198+0000","last_peered":"2024-09-12T17:41:24.912198+0000","last_clean":"2024-09-12T17:41:24.912198+0000","last_became_active":"2024-09-12T16:58:29.774093+0000","last_became_peered":"2024-09-12T16:58:29.774093+0000","last_unstale":"2024-09-12T17:41:24.912198+0000","last_undegraded":"2024-09-12T17:41:24.912198+0000","last_fullsized":"2024-09-12T17:41:24.912198+0000","mapping_epoch":34,"log_start":"265'500","ondisk_log_start":"265'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":500,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:00.606117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":455,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1305,"num_read_kb":1304,"num_write":1151,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"265'502","reported_seq":1263,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:48.602426+0000","last_change":"2024-09-12T17:41:48.602426+0000","last_active":"2024-09-12T17:41:48.602426+0000","last_peered":"2024-09-12T17:41:48.602426+0000","last_clean":"2024-09-12T17:41:48.602426+0000","last_became_active":"2024-09-12T16:58:21.699243+0000","last_became_peered":"2024-09-12T16:58:21.699243+0000","last_unstale":"2024-09-12T17:41:48.602426+0000","last_undegraded":"2024-09-12T17:41:48.602426+0000","last_fullsized":"2024-09-12T17:41:48.602426+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'502","last_scrub_stamp":"2024-09-12T17:41:48.602124+0000","last_deep_scrub":"265'502","last_deep_scrub_stamp":"2024-09-12T17:41:48.602124+0000","last_clean_scrub_stamp":"2024-09-12T17:41:48.602124+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:11.597872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2329,"num_read_kb":1984,"num_write":852,"num_write_kb":550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"265'371","reported_seq":1042,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:41.552046+0000","last_change":"2024-09-12T17:41:41.552046+0000","last_active":"2024-09-12T17:41:41.552046+0000","last_peered":"2024-09-12T17:41:41.552046+0000","last_clean":"2024-09-12T17:41:41.552046+0000","last_became_active":"2024-09-12T16:58:18.714412+0000","last_became_peered":"2024-09-12T16:58:18.714412+0000","last_unstale":"2024-09-12T17:41:41.552046+0000","last_undegraded":"2024-09-12T17:41:41.552046+0000","last_fullsized":"2024-09-12T17:41:41.552046+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'371","last_scrub_stamp":"2024-09-12T17:41:41.551754+0000","last_deep_scrub":"265'371","last_deep_scrub_stamp":"2024-09-12T17:41:41.551754+0000","last_clean_scrub_stamp":"2024-09-12T17:41:41.551754+0000","objects_scrubbed":6,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:46.467198+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306427,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":511,"num_read_kb":85960,"num_write":1174,"num_write_kb":38984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:48.434883+0000","last_change":"2024-09-12T17:41:48.434883+0000","last_active":"2024-09-12T17:41:48.434883+0000","last_peered":"2024-09-12T17:41:48.434883+0000","last_clean":"2024-09-12T17:41:48.434883+0000","last_became_active":"2024-09-12T16:58:23.703534+0000","last_became_peered":"2024-09-12T16:58:23.703534+0000","last_unstale":"2024-09-12T17:41:48.434883+0000","last_undegraded":"2024-09-12T17:41:48.434883+0000","last_fullsized":"2024-09-12T17:41:48.434883+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:48.434677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:48.434677+0000","last_clean_scrub_stamp":"2024-09-12T17:41:48.434677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:41.207200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"265'279","reported_seq":850,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.311218+0000","last_change":"2024-09-12T16:58:25.732078+0000","last_active":"2024-09-12T17:41:33.311218+0000","last_peered":"2024-09-12T17:41:33.311218+0000","last_clean":"2024-09-12T17:41:33.311218+0000","last_became_active":"2024-09-12T16:58:25.730470+0000","last_became_peered":"2024-09-12T16:58:25.730470+0000","last_unstale":"2024-09-12T17:41:33.311218+0000","last_undegraded":"2024-09-12T17:41:33.311218+0000","last_fullsized":"2024-09-12T17:41:33.311218+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:12.290691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57671,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":480,"num_read_kb":1170,"num_write":398,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:47.376638+0000","last_change":"2024-09-12T16:58:27.749638+0000","last_active":"2024-09-12T17:39:47.376638+0000","last_peered":"2024-09-12T17:39:47.376638+0000","last_clean":"2024-09-12T17:39:47.376638+0000","last_became_active":"2024-09-12T16:58:27.748461+0000","last_became_peered":"2024-09-12T16:58:27.748461+0000","last_unstale":"2024-09-12T17:39:47.376638+0000","last_undegraded":"2024-09-12T17:39:47.376638+0000","last_fullsized":"2024-09-12T17:39:47.376638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"265'2416","reported_seq":4248,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:13.859519+0000","last_change":"2024-09-12T16:58:29.771539+0000","last_active":"2024-09-12T17:41:13.859519+0000","last_peered":"2024-09-12T17:41:13.859519+0000","last_clean":"2024-09-12T17:41:13.859519+0000","last_became_active":"2024-09-12T16:58:29.768469+0000","last_became_peered":"2024-09-12T16:58:29.768469+0000","last_unstale":"2024-09-12T17:41:13.859519+0000","last_undegraded":"2024-09-12T17:41:13.859519+0000","last_fullsized":"2024-09-12T17:41:13.859519+0000","mapping_epoch":34,"log_start":"265'2400","ondisk_log_start":"265'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":2400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:15.157148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":849,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6073,"num_read_kb":6065,"num_write":4892,"num_write_kb":1798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"265'217","reported_seq":805,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:45.445128+0000","last_change":"2024-09-12T17:41:45.444945+0000","last_active":"2024-09-12T17:41:45.445128+0000","last_peered":"2024-09-12T17:41:45.445128+0000","last_clean":"2024-09-12T17:41:45.445128+0000","last_became_active":"2024-09-12T16:58:21.724552+0000","last_became_peered":"2024-09-12T16:58:21.724552+0000","last_unstale":"2024-09-12T17:41:45.445128+0000","last_undegraded":"2024-09-12T17:41:45.445128+0000","last_fullsized":"2024-09-12T17:41:45.445128+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'217","last_scrub_stamp":"2024-09-12T17:41:45.444760+0000","last_deep_scrub":"265'217","last_deep_scrub_stamp":"2024-09-12T17:41:45.444760+0000","last_clean_scrub_stamp":"2024-09-12T17:41:45.444760+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:07.480407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":914,"num_read_kb":736,"num_write":337,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"265'479","reported_seq":1231,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:42.515901+0000","last_change":"2024-09-12T17:41:42.515901+0000","last_active":"2024-09-12T17:41:42.515901+0000","last_peered":"2024-09-12T17:41:42.515901+0000","last_clean":"2024-09-12T17:41:42.515901+0000","last_became_active":"2024-09-12T16:58:55.852305+0000","last_became_peered":"2024-09-12T16:58:55.852305+0000","last_unstale":"2024-09-12T17:41:42.515901+0000","last_undegraded":"2024-09-12T17:41:42.515901+0000","last_fullsized":"2024-09-12T17:41:42.515901+0000","mapping_epoch":37,"log_start":"265'400","ondisk_log_start":"265'400","created":23,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'479","last_scrub_stamp":"2024-09-12T17:41:42.515648+0000","last_deep_scrub":"265'479","last_deep_scrub_stamp":"2024-09-12T17:41:42.515648+0000","last_clean_scrub_stamp":"2024-09-12T17:41:42.515648+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:36.727017+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048839,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":919,"num_read_kb":12354,"num_write":1497,"num_write_kb":33200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:50.493117+0000","last_change":"2024-09-12T17:41:50.493117+0000","last_active":"2024-09-12T17:41:50.493117+0000","last_peered":"2024-09-12T17:41:50.493117+0000","last_clean":"2024-09-12T17:41:50.493117+0000","last_became_active":"2024-09-12T16:58:23.713241+0000","last_became_peered":"2024-09-12T16:58:23.713241+0000","last_unstale":"2024-09-12T17:41:50.493117+0000","last_undegraded":"2024-09-12T17:41:50.493117+0000","last_fullsized":"2024-09-12T17:41:50.493117+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:50.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:50.492929+0000","last_clean_scrub_stamp":"2024-09-12T17:41:50.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:16.543100+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"265'319","reported_seq":903,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.890129+0000","last_change":"2024-09-12T16:58:25.733750+0000","last_active":"2024-09-12T17:41:32.890129+0000","last_peered":"2024-09-12T17:41:32.890129+0000","last_clean":"2024-09-12T17:41:32.890129+0000","last_became_active":"2024-09-12T16:58:25.732918+0000","last_became_peered":"2024-09-12T16:58:25.732918+0000","last_unstale":"2024-09-12T17:41:32.890129+0000","last_undegraded":"2024-09-12T17:41:32.890129+0000","last_fullsized":"2024-09-12T17:41:32.890129+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71605,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":514,"num_read_kb":1203,"num_write":420,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"265'758","reported_seq":2461,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.363538+0000","last_change":"2024-09-12T16:58:27.737407+0000","last_active":"2024-09-12T17:41:33.363538+0000","last_peered":"2024-09-12T17:41:33.363538+0000","last_clean":"2024-09-12T17:41:33.363538+0000","last_became_active":"2024-09-12T16:58:27.736160+0000","last_became_peered":"2024-09-12T16:58:27.736160+0000","last_unstale":"2024-09-12T17:41:33.363538+0000","last_undegraded":"2024-09-12T17:41:33.363538+0000","last_fullsized":"2024-09-12T17:41:33.363538+0000","mapping_epoch":32,"log_start":"265'701","ondisk_log_start":"265'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":701,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"265'167","reported_seq":656,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:23.738298+0000","last_change":"2024-09-12T16:58:29.786539+0000","last_active":"2024-09-12T17:41:23.738298+0000","last_peered":"2024-09-12T17:41:23.738298+0000","last_clean":"2024-09-12T17:41:23.738298+0000","last_became_active":"2024-09-12T16:58:29.785621+0000","last_became_peered":"2024-09-12T16:58:29.785621+0000","last_unstale":"2024-09-12T17:41:23.738298+0000","last_undegraded":"2024-09-12T17:41:23.738298+0000","last_fullsized":"2024-09-12T17:41:23.738298+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":406,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":130,"num_read_kb":128,"num_write":373,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"265'203","reported_seq":803,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:49.110136+0000","last_change":"2024-09-12T17:41:49.110136+0000","last_active":"2024-09-12T17:41:49.110136+0000","last_peered":"2024-09-12T17:41:49.110136+0000","last_clean":"2024-09-12T17:41:49.110136+0000","last_became_active":"2024-09-12T16:58:21.701704+0000","last_became_peered":"2024-09-12T16:58:21.701704+0000","last_unstale":"2024-09-12T17:41:49.110136+0000","last_undegraded":"2024-09-12T17:41:49.110136+0000","last_fullsized":"2024-09-12T17:41:49.110136+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'203","last_scrub_stamp":"2024-09-12T17:41:49.109939+0000","last_deep_scrub":"265'203","last_deep_scrub_stamp":"2024-09-12T17:41:49.109939+0000","last_clean_scrub_stamp":"2024-09-12T17:41:49.109939+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:31.594839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":867,"num_read_kb":717,"num_write":300,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"265'335","reported_seq":973,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:42.680714+0000","last_change":"2024-09-12T17:41:42.680714+0000","last_active":"2024-09-12T17:41:42.680714+0000","last_peered":"2024-09-12T17:41:42.680714+0000","last_clean":"2024-09-12T17:41:42.680714+0000","last_became_active":"2024-09-12T16:58:18.715232+0000","last_became_peered":"2024-09-12T16:58:18.715232+0000","last_unstale":"2024-09-12T17:41:42.680714+0000","last_undegraded":"2024-09-12T17:41:42.680714+0000","last_fullsized":"2024-09-12T17:41:42.680714+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'335","last_scrub_stamp":"2024-09-12T17:41:42.680418+0000","last_deep_scrub":"265'335","last_deep_scrub_stamp":"2024-09-12T17:41:42.680418+0000","last_clean_scrub_stamp":"2024-09-12T17:41:42.680418+0000","objects_scrubbed":9,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:52.761737+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1724025,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":468,"num_read_kb":18626,"num_write":1028,"num_write_kb":30032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:49.458628+0000","last_change":"2024-09-12T17:41:49.458503+0000","last_active":"2024-09-12T17:41:49.458628+0000","last_peered":"2024-09-12T17:41:49.458628+0000","last_clean":"2024-09-12T17:41:49.458628+0000","last_became_active":"2024-09-12T16:58:23.708641+0000","last_became_peered":"2024-09-12T16:58:23.708641+0000","last_unstale":"2024-09-12T17:41:49.458628+0000","last_undegraded":"2024-09-12T17:41:49.458628+0000","last_fullsized":"2024-09-12T17:41:49.458628+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:49.458319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:49.458319+0000","last_clean_scrub_stamp":"2024-09-12T17:41:49.458319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:57:34.059304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"265'472","reported_seq":1100,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.963503+0000","last_change":"2024-09-12T16:58:25.729871+0000","last_active":"2024-09-12T17:41:32.963503+0000","last_peered":"2024-09-12T17:41:32.963503+0000","last_clean":"2024-09-12T17:41:32.963503+0000","last_became_active":"2024-09-12T16:58:25.729071+0000","last_became_peered":"2024-09-12T16:58:25.729071+0000","last_unstale":"2024-09-12T17:41:32.963503+0000","last_undegraded":"2024-09-12T17:41:32.963503+0000","last_fullsized":"2024-09-12T17:41:32.963503+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126127,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":817,"num_read_kb":2031,"num_write":670,"num_write_kb":603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:40.290798+0000","last_change":"2024-09-12T16:58:27.734880+0000","last_active":"2024-09-12T17:39:40.290798+0000","last_peered":"2024-09-12T17:39:40.290798+0000","last_clean":"2024-09-12T17:39:40.290798+0000","last_became_active":"2024-09-12T16:58:27.734078+0000","last_became_peered":"2024-09-12T16:58:27.734078+0000","last_unstale":"2024-09-12T17:39:40.290798+0000","last_undegraded":"2024-09-12T17:39:40.290798+0000","last_fullsized":"2024-09-12T17:39:40.290798+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"265'88","reported_seq":589,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:43.717663+0000","last_change":"2024-09-12T16:58:29.795094+0000","last_active":"2024-09-12T17:39:43.717663+0000","last_peered":"2024-09-12T17:39:43.717663+0000","last_clean":"2024-09-12T17:39:43.717663+0000","last_became_active":"2024-09-12T16:58:29.794347+0000","last_became_peered":"2024-09-12T16:58:29.794347+0000","last_unstale":"2024-09-12T17:39:43.717663+0000","last_undegraded":"2024-09-12T17:39:43.717663+0000","last_fullsized":"2024-09-12T17:39:43.717663+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":704,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":193,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"265'212","reported_seq":809,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:44.640655+0000","last_change":"2024-09-12T17:41:44.640655+0000","last_active":"2024-09-12T17:41:44.640655+0000","last_peered":"2024-09-12T17:41:44.640655+0000","last_clean":"2024-09-12T17:41:44.640655+0000","last_became_active":"2024-09-12T16:58:21.702684+0000","last_became_peered":"2024-09-12T16:58:21.702684+0000","last_unstale":"2024-09-12T17:41:44.640655+0000","last_undegraded":"2024-09-12T17:41:44.640655+0000","last_fullsized":"2024-09-12T17:41:44.640655+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'212","last_scrub_stamp":"2024-09-12T17:41:44.640479+0000","last_deep_scrub":"265'212","last_deep_scrub_stamp":"2024-09-12T17:41:44.640479+0000","last_clean_scrub_stamp":"2024-09-12T17:41:44.640479+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:35.863889+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":882,"num_read_kb":712,"num_write":314,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"265'376","reported_seq":1066,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:41.751292+0000","last_change":"2024-09-12T17:41:41.751292+0000","last_active":"2024-09-12T17:41:41.751292+0000","last_peered":"2024-09-12T17:41:41.751292+0000","last_clean":"2024-09-12T17:41:41.751292+0000","last_became_active":"2024-09-12T16:58:18.695549+0000","last_became_peered":"2024-09-12T16:58:18.695549+0000","last_unstale":"2024-09-12T17:41:41.751292+0000","last_undegraded":"2024-09-12T17:41:41.751292+0000","last_fullsized":"2024-09-12T17:41:41.751292+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'376","last_scrub_stamp":"2024-09-12T17:41:41.751066+0000","last_deep_scrub":"265'376","last_deep_scrub_stamp":"2024-09-12T17:41:41.751066+0000","last_clean_scrub_stamp":"2024-09-12T17:41:41.751066+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:18.413154+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":633,"num_read_kb":12633,"num_write":1101,"num_write_kb":15900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:52.524952+0000","last_change":"2024-09-12T17:41:52.524952+0000","last_active":"2024-09-12T17:41:52.524952+0000","last_peered":"2024-09-12T17:41:52.524952+0000","last_clean":"2024-09-12T17:41:52.524952+0000","last_became_active":"2024-09-12T16:58:23.720279+0000","last_became_peered":"2024-09-12T16:58:23.720279+0000","last_unstale":"2024-09-12T17:41:52.524952+0000","last_undegraded":"2024-09-12T17:41:52.524952+0000","last_fullsized":"2024-09-12T17:41:52.524952+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:52.524776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:52.524776+0000","last_clean_scrub_stamp":"2024-09-12T17:41:52.524776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:24.970601+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"265'292","reported_seq":866,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.189345+0000","last_change":"2024-09-12T16:58:25.713751+0000","last_active":"2024-09-12T17:41:32.189345+0000","last_peered":"2024-09-12T17:41:32.189345+0000","last_clean":"2024-09-12T17:41:32.189345+0000","last_became_active":"2024-09-12T16:58:25.711682+0000","last_became_peered":"2024-09-12T16:58:25.711682+0000","last_unstale":"2024-09-12T17:41:32.189345+0000","last_undegraded":"2024-09-12T17:41:32.189345+0000","last_fullsized":"2024-09-12T17:41:32.189345+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:16.044074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44554,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":521,"num_read_kb":1183,"num_write":472,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:07.363377+0000","last_change":"2024-09-12T16:58:27.752363+0000","last_active":"2024-09-12T17:39:07.363377+0000","last_peered":"2024-09-12T17:39:07.363377+0000","last_clean":"2024-09-12T17:39:07.363377+0000","last_became_active":"2024-09-12T16:58:27.751664+0000","last_became_peered":"2024-09-12T16:58:27.751664+0000","last_unstale":"2024-09-12T17:39:07.363377+0000","last_undegraded":"2024-09-12T17:39:07.363377+0000","last_fullsized":"2024-09-12T17:39:07.363377+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:48.576997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"265'126","reported_seq":626,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:42.388904+0000","last_change":"2024-09-12T16:58:29.785130+0000","last_active":"2024-09-12T17:40:42.388904+0000","last_peered":"2024-09-12T17:40:42.388904+0000","last_clean":"2024-09-12T17:40:42.388904+0000","last_became_active":"2024-09-12T16:58:29.784095+0000","last_became_peered":"2024-09-12T16:58:29.784095+0000","last_unstale":"2024-09-12T17:40:42.388904+0000","last_undegraded":"2024-09-12T17:40:42.388904+0000","last_fullsized":"2024-09-12T17:40:42.388904+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:32.305201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":487,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":177,"num_read_kb":165,"num_write":304,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"265'166","reported_seq":780,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:45.621245+0000","last_change":"2024-09-12T17:41:45.621245+0000","last_active":"2024-09-12T17:41:45.621245+0000","last_peered":"2024-09-12T17:41:45.621245+0000","last_clean":"2024-09-12T17:41:45.621245+0000","last_became_active":"2024-09-12T16:58:21.728963+0000","last_became_peered":"2024-09-12T16:58:21.728963+0000","last_unstale":"2024-09-12T17:41:45.621245+0000","last_undegraded":"2024-09-12T17:41:45.621245+0000","last_fullsized":"2024-09-12T17:41:45.621245+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'166","last_scrub_stamp":"2024-09-12T17:41:45.621014+0000","last_deep_scrub":"265'166","last_deep_scrub_stamp":"2024-09-12T17:41:45.621014+0000","last_clean_scrub_stamp":"2024-09-12T17:41:45.621014+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:14.525844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":751,"num_read_kb":615,"num_write":255,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"265'343","reported_seq":1020,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:41.451773+0000","last_change":"2024-09-12T17:41:41.451544+0000","last_active":"2024-09-12T17:41:41.451773+0000","last_peered":"2024-09-12T17:41:41.451773+0000","last_clean":"2024-09-12T17:41:41.451773+0000","last_became_active":"2024-09-12T16:58:18.708689+0000","last_became_peered":"2024-09-12T16:58:18.708689+0000","last_unstale":"2024-09-12T17:41:41.451773+0000","last_undegraded":"2024-09-12T17:41:41.451773+0000","last_fullsized":"2024-09-12T17:41:41.451773+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'343","last_scrub_stamp":"2024-09-12T17:41:41.451261+0000","last_deep_scrub":"265'343","last_deep_scrub_stamp":"2024-09-12T17:41:41.451261+0000","last_clean_scrub_stamp":"2024-09-12T17:41:41.451261+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:06.939620+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":505,"num_read_kb":124256,"num_write":1133,"num_write_kb":36504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:56.391504+0000","last_change":"2024-09-12T17:41:56.391504+0000","last_active":"2024-09-12T17:41:56.391504+0000","last_peered":"2024-09-12T17:41:56.391504+0000","last_clean":"2024-09-12T17:41:56.391504+0000","last_became_active":"2024-09-12T16:58:23.709099+0000","last_became_peered":"2024-09-12T16:58:23.709099+0000","last_unstale":"2024-09-12T17:41:56.391504+0000","last_undegraded":"2024-09-12T17:41:56.391504+0000","last_fullsized":"2024-09-12T17:41:56.391504+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:56.391301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:56.391301+0000","last_clean_scrub_stamp":"2024-09-12T17:41:56.391301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:32.975832+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"265'284","reported_seq":876,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:54.532525+0000","last_change":"2024-09-12T17:41:54.532525+0000","last_active":"2024-09-12T17:41:54.532525+0000","last_peered":"2024-09-12T17:41:54.532525+0000","last_clean":"2024-09-12T17:41:54.532525+0000","last_became_active":"2024-09-12T16:58:25.723894+0000","last_became_peered":"2024-09-12T16:58:25.723894+0000","last_unstale":"2024-09-12T17:41:54.532525+0000","last_undegraded":"2024-09-12T17:41:54.532525+0000","last_fullsized":"2024-09-12T17:41:54.532525+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'284","last_scrub_stamp":"2024-09-12T17:41:54.532322+0000","last_deep_scrub":"265'284","last_deep_scrub_stamp":"2024-09-12T17:41:54.532322+0000","last_clean_scrub_stamp":"2024-09-12T17:41:54.532322+0000","objects_scrubbed":7,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:06.034171+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60644,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":457,"num_read_kb":1010,"num_write":360,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"265'727","reported_seq":2348,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:31.885082+0000","last_change":"2024-09-12T16:58:27.754030+0000","last_active":"2024-09-12T17:41:31.885082+0000","last_peered":"2024-09-12T17:41:31.885082+0000","last_clean":"2024-09-12T17:41:31.885082+0000","last_became_active":"2024-09-12T16:58:27.753179+0000","last_became_peered":"2024-09-12T16:58:27.753179+0000","last_unstale":"2024-09-12T17:41:31.885082+0000","last_undegraded":"2024-09-12T17:41:31.885082+0000","last_fullsized":"2024-09-12T17:41:31.885082+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":700,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:00.243547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"265'139","reported_seq":662,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:23.672296+0000","last_change":"2024-09-12T16:58:29.779572+0000","last_active":"2024-09-12T17:41:23.672296+0000","last_peered":"2024-09-12T17:41:23.672296+0000","last_clean":"2024-09-12T17:41:23.672296+0000","last_became_active":"2024-09-12T16:58:29.778839+0000","last_became_peered":"2024-09-12T16:58:29.778839+0000","last_unstale":"2024-09-12T17:41:23.672296+0000","last_undegraded":"2024-09-12T17:41:23.672296+0000","last_fullsized":"2024-09-12T17:41:23.672296+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:04.060160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":288,"num_read_kb":252,"num_write":342,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"265'188","reported_seq":784,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:46.597917+0000","last_change":"2024-09-12T17:41:46.597917+0000","last_active":"2024-09-12T17:41:46.597917+0000","last_peered":"2024-09-12T17:41:46.597917+0000","last_clean":"2024-09-12T17:41:46.597917+0000","last_became_active":"2024-09-12T16:58:21.706953+0000","last_became_peered":"2024-09-12T16:58:21.706953+0000","last_unstale":"2024-09-12T17:41:46.597917+0000","last_undegraded":"2024-09-12T17:41:46.597917+0000","last_fullsized":"2024-09-12T17:41:46.597917+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'188","last_scrub_stamp":"2024-09-12T17:41:46.597688+0000","last_deep_scrub":"265'188","last_deep_scrub_stamp":"2024-09-12T17:41:46.597688+0000","last_clean_scrub_stamp":"2024-09-12T17:41:46.597688+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:59.955032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":782,"num_read_kb":644,"num_write":280,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"265'327","reported_seq":970,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:40.693027+0000","last_change":"2024-09-12T17:41:40.692867+0000","last_active":"2024-09-12T17:41:40.693027+0000","last_peered":"2024-09-12T17:41:40.693027+0000","last_clean":"2024-09-12T17:41:40.693027+0000","last_became_active":"2024-09-12T16:58:18.686189+0000","last_became_peered":"2024-09-12T16:58:18.686189+0000","last_unstale":"2024-09-12T17:41:40.693027+0000","last_undegraded":"2024-09-12T17:41:40.693027+0000","last_fullsized":"2024-09-12T17:41:40.693027+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'327","last_scrub_stamp":"2024-09-12T17:41:40.692633+0000","last_deep_scrub":"265'327","last_deep_scrub_stamp":"2024-09-12T17:41:40.692633+0000","last_clean_scrub_stamp":"2024-09-12T17:41:40.692633+0000","objects_scrubbed":8,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:55.491689+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":508,"num_read_kb":6575,"num_write":1048,"num_write_kb":19619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1454,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:31.424308+0000","last_change":"2024-09-12T16:58:23.707182+0000","last_active":"2024-09-12T17:41:31.424308+0000","last_peered":"2024-09-12T17:41:31.424308+0000","last_clean":"2024-09-12T17:41:31.424308+0000","last_became_active":"2024-09-12T16:58:23.706471+0000","last_became_peered":"2024-09-12T16:58:23.706471+0000","last_unstale":"2024-09-12T17:41:31.424308+0000","last_undegraded":"2024-09-12T17:41:31.424308+0000","last_fullsized":"2024-09-12T17:41:31.424308+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:02.525244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":956,"num_read_kb":956,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"265'78","reported_seq":598,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:26.200090+0000","last_change":"2024-09-12T16:58:25.950921+0000","last_active":"2024-09-12T17:39:26.200090+0000","last_peered":"2024-09-12T17:39:26.200090+0000","last_clean":"2024-09-12T17:39:26.200090+0000","last_became_active":"2024-09-12T16:58:25.949962+0000","last_became_peered":"2024-09-12T16:58:25.949962+0000","last_unstale":"2024-09-12T17:39:26.200090+0000","last_undegraded":"2024-09-12T17:39:26.200090+0000","last_fullsized":"2024-09-12T17:39:26.200090+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:35.151455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"265'758","reported_seq":4014,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:55.401310+0000","last_change":"2024-09-12T17:41:55.401310+0000","last_active":"2024-09-12T17:41:55.401310+0000","last_peered":"2024-09-12T17:41:55.401310+0000","last_clean":"2024-09-12T17:41:55.401310+0000","last_became_active":"2024-09-12T16:58:27.755569+0000","last_became_peered":"2024-09-12T16:58:27.755569+0000","last_unstale":"2024-09-12T17:41:55.401310+0000","last_undegraded":"2024-09-12T17:41:55.401310+0000","last_fullsized":"2024-09-12T17:41:55.401310+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'758","last_scrub_stamp":"2024-09-12T17:41:55.401154+0000","last_deep_scrub":"265'758","last_deep_scrub_stamp":"2024-09-12T17:41:55.401154+0000","last_clean_scrub_stamp":"2024-09-12T17:41:55.401154+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":700,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:49.415648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"265'116","reported_seq":624,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:24.000291+0000","last_change":"2024-09-12T16:58:29.781541+0000","last_active":"2024-09-12T17:39:24.000291+0000","last_peered":"2024-09-12T17:39:24.000291+0000","last_clean":"2024-09-12T17:39:24.000291+0000","last_became_active":"2024-09-12T16:58:29.780289+0000","last_became_peered":"2024-09-12T16:58:29.780289+0000","last_unstale":"2024-09-12T17:39:24.000291+0000","last_undegraded":"2024-09-12T17:39:24.000291+0000","last_fullsized":"2024-09-12T17:39:24.000291+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:45.266710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":175,"num_write":267,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"265'140","reported_seq":805,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:51.379444+0000","last_change":"2024-09-12T17:41:51.379444+0000","last_active":"2024-09-12T17:41:51.379444+0000","last_peered":"2024-09-12T17:41:51.379444+0000","last_clean":"2024-09-12T17:41:51.379444+0000","last_became_active":"2024-09-12T16:58:21.719827+0000","last_became_peered":"2024-09-12T16:58:21.719827+0000","last_unstale":"2024-09-12T17:41:51.379444+0000","last_undegraded":"2024-09-12T17:41:51.379444+0000","last_fullsized":"2024-09-12T17:41:51.379444+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'140","last_scrub_stamp":"2024-09-12T17:41:51.379265+0000","last_deep_scrub":"265'140","last_deep_scrub_stamp":"2024-09-12T17:41:51.379265+0000","last_clean_scrub_stamp":"2024-09-12T17:41:51.379265+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:58.481342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":689,"num_read_kb":590,"num_write":204,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"265'335","reported_seq":990,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:39.806722+0000","last_change":"2024-09-12T17:41:39.806619+0000","last_active":"2024-09-12T17:41:39.806722+0000","last_peered":"2024-09-12T17:41:39.806722+0000","last_clean":"2024-09-12T17:41:39.806722+0000","last_became_active":"2024-09-12T16:58:18.705048+0000","last_became_peered":"2024-09-12T16:58:18.705048+0000","last_unstale":"2024-09-12T17:41:39.806722+0000","last_undegraded":"2024-09-12T17:41:39.806722+0000","last_fullsized":"2024-09-12T17:41:39.806722+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'335","last_scrub_stamp":"2024-09-12T17:41:39.806418+0000","last_deep_scrub":"265'335","last_deep_scrub_stamp":"2024-09-12T17:41:39.806418+0000","last_clean_scrub_stamp":"2024-09-12T17:41:39.806418+0000","objects_scrubbed":8,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:11.826972+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2227678,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":497,"num_read_kb":3392,"num_write":1050,"num_write_kb":22669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"36'5","reported_seq":979,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:31.408893+0000","last_change":"2024-09-12T16:58:23.703535+0000","last_active":"2024-09-12T17:41:31.408893+0000","last_peered":"2024-09-12T17:41:31.408893+0000","last_clean":"2024-09-12T17:41:31.408893+0000","last_became_active":"2024-09-12T16:58:23.702699+0000","last_became_peered":"2024-09-12T16:58:23.702699+0000","last_unstale":"2024-09-12T17:41:31.408893+0000","last_undegraded":"2024-09-12T17:41:31.408893+0000","last_fullsized":"2024-09-12T17:41:31.408893+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:52.474180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":729,"num_read_kb":1194,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"265'344","reported_seq":948,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.687313+0000","last_change":"2024-09-12T16:58:25.725360+0000","last_active":"2024-09-12T17:41:32.687313+0000","last_peered":"2024-09-12T17:41:32.687313+0000","last_clean":"2024-09-12T17:41:32.687313+0000","last_became_active":"2024-09-12T16:58:25.724694+0000","last_became_peered":"2024-09-12T16:58:25.724694+0000","last_unstale":"2024-09-12T17:41:32.687313+0000","last_undegraded":"2024-09-12T17:41:32.687313+0000","last_fullsized":"2024-09-12T17:41:32.687313+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:22.997913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52076,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":562,"num_read_kb":1199,"num_write":444,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:01.307379+0000","last_change":"2024-09-12T16:58:27.741238+0000","last_active":"2024-09-12T17:39:01.307379+0000","last_peered":"2024-09-12T17:39:01.307379+0000","last_clean":"2024-09-12T17:39:01.307379+0000","last_became_active":"2024-09-12T16:58:27.740510+0000","last_became_peered":"2024-09-12T16:58:27.740510+0000","last_unstale":"2024-09-12T17:39:01.307379+0000","last_undegraded":"2024-09-12T17:39:01.307379+0000","last_fullsized":"2024-09-12T17:39:01.307379+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:22.805172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"265'127","reported_seq":619,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:03.172275+0000","last_change":"2024-09-12T16:58:29.776743+0000","last_active":"2024-09-12T17:40:03.172275+0000","last_peered":"2024-09-12T17:40:03.172275+0000","last_clean":"2024-09-12T17:40:03.172275+0000","last_became_active":"2024-09-12T16:58:29.776007+0000","last_became_peered":"2024-09-12T16:58:29.776007+0000","last_unstale":"2024-09-12T17:40:03.172275+0000","last_undegraded":"2024-09-12T17:40:03.172275+0000","last_fullsized":"2024-09-12T17:40:03.172275+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:10.538331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":162,"num_read_kb":158,"num_write":308,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"265'143","reported_seq":763,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:49.448084+0000","last_change":"2024-09-12T17:41:49.448084+0000","last_active":"2024-09-12T17:41:49.448084+0000","last_peered":"2024-09-12T17:41:49.448084+0000","last_clean":"2024-09-12T17:41:49.448084+0000","last_became_active":"2024-09-12T16:58:21.726160+0000","last_became_peered":"2024-09-12T16:58:21.726160+0000","last_unstale":"2024-09-12T17:41:49.448084+0000","last_undegraded":"2024-09-12T17:41:49.448084+0000","last_fullsized":"2024-09-12T17:41:49.448084+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'143","last_scrub_stamp":"2024-09-12T17:41:49.447779+0000","last_deep_scrub":"265'143","last_deep_scrub_stamp":"2024-09-12T17:41:49.447779+0000","last_clean_scrub_stamp":"2024-09-12T17:41:49.447779+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:59.351840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":643,"num_read_kb":537,"num_write":216,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"265'74","reported_seq":622,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:40.572415+0000","last_change":"2024-09-12T17:41:40.572415+0000","last_active":"2024-09-12T17:41:40.572415+0000","last_peered":"2024-09-12T17:41:40.572415+0000","last_clean":"2024-09-12T17:41:40.572415+0000","last_became_active":"2024-09-12T16:58:04.216387+0000","last_became_peered":"2024-09-12T16:58:04.216387+0000","last_unstale":"2024-09-12T17:41:40.572415+0000","last_undegraded":"2024-09-12T17:41:40.572415+0000","last_fullsized":"2024-09-12T17:41:40.572415+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'74","last_scrub_stamp":"2024-09-12T17:41:40.572242+0000","last_deep_scrub":"265'74","last_deep_scrub_stamp":"2024-09-12T17:41:40.572242+0000","last_clean_scrub_stamp":"2024-09-12T17:41:40.572242+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:51.726519+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"265'2","reported_seq":531,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:40.628344+0000","last_change":"2024-09-12T17:41:40.628219+0000","last_active":"2024-09-12T17:41:40.628344+0000","last_peered":"2024-09-12T17:41:40.628344+0000","last_clean":"2024-09-12T17:41:40.628344+0000","last_became_active":"2024-09-12T16:58:08.538227+0000","last_became_peered":"2024-09-12T16:58:08.538227+0000","last_unstale":"2024-09-12T17:41:40.628344+0000","last_undegraded":"2024-09-12T17:41:40.628344+0000","last_fullsized":"2024-09-12T17:41:40.628344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T17:41:40.628040+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T17:41:40.628040+0000","last_clean_scrub_stamp":"2024-09-12T17:41:40.628040+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:51.377305+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.001171044,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"265'366","reported_seq":1000,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:40.595467+0000","last_change":"2024-09-12T17:41:40.595467+0000","last_active":"2024-09-12T17:41:40.595467+0000","last_peered":"2024-09-12T17:41:40.595467+0000","last_clean":"2024-09-12T17:41:40.595467+0000","last_became_active":"2024-09-12T16:58:55.957231+0000","last_became_peered":"2024-09-12T16:58:55.957231+0000","last_unstale":"2024-09-12T17:41:40.595467+0000","last_undegraded":"2024-09-12T17:41:40.595467+0000","last_fullsized":"2024-09-12T17:41:40.595467+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'366","last_scrub_stamp":"2024-09-12T17:41:40.595232+0000","last_deep_scrub":"265'366","last_deep_scrub_stamp":"2024-09-12T17:41:40.595232+0000","last_clean_scrub_stamp":"2024-09-12T17:41:40.595232+0000","objects_scrubbed":8,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:19.557999+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159822,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":551,"num_read_kb":44871,"num_write":1125,"num_write_kb":45418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"36'3","reported_seq":979,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:31.411309+0000","last_change":"2024-09-12T16:58:23.719701+0000","last_active":"2024-09-12T17:41:31.411309+0000","last_peered":"2024-09-12T17:41:31.411309+0000","last_clean":"2024-09-12T17:41:31.411309+0000","last_became_active":"2024-09-12T16:58:23.718720+0000","last_became_peered":"2024-09-12T16:58:23.718720+0000","last_unstale":"2024-09-12T17:41:31.411309+0000","last_undegraded":"2024-09-12T17:41:31.411309+0000","last_fullsized":"2024-09-12T17:41:31.411309+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:27.937180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":725,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"265'688","reported_seq":1390,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.129167+0000","last_change":"2024-09-12T16:58:25.721421+0000","last_active":"2024-09-12T17:41:33.129167+0000","last_peered":"2024-09-12T17:41:33.129167+0000","last_clean":"2024-09-12T17:41:33.129167+0000","last_became_active":"2024-09-12T16:58:25.720741+0000","last_became_peered":"2024-09-12T16:58:25.720741+0000","last_unstale":"2024-09-12T17:41:33.129167+0000","last_undegraded":"2024-09-12T17:41:33.129167+0000","last_fullsized":"2024-09-12T17:41:33.129167+0000","mapping_epoch":30,"log_start":"265'600","ondisk_log_start":"265'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":600,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142315,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1357,"num_read_kb":3135,"num_write":1250,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:37.370865+0000","last_change":"2024-09-12T16:58:27.746911+0000","last_active":"2024-09-12T17:39:37.370865+0000","last_peered":"2024-09-12T17:39:37.370865+0000","last_clean":"2024-09-12T17:39:37.370865+0000","last_became_active":"2024-09-12T16:58:27.746171+0000","last_became_peered":"2024-09-12T16:58:27.746171+0000","last_unstale":"2024-09-12T17:39:37.370865+0000","last_undegraded":"2024-09-12T17:39:37.370865+0000","last_fullsized":"2024-09-12T17:39:37.370865+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"265'209","reported_seq":916,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:04.986835+0000","last_change":"2024-09-12T16:58:29.769292+0000","last_active":"2024-09-12T17:40:04.986835+0000","last_peered":"2024-09-12T17:40:04.986835+0000","last_clean":"2024-09-12T17:40:04.986835+0000","last_became_active":"2024-09-12T16:58:29.768536+0000","last_became_peered":"2024-09-12T16:58:29.768536+0000","last_unstale":"2024-09-12T17:40:04.986835+0000","last_undegraded":"2024-09-12T17:40:04.986835+0000","last_fullsized":"2024-09-12T17:40:04.986835+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":520,"num_read_kb":510,"num_write":443,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"265'70","reported_seq":633,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:47.142743+0000","last_change":"2024-09-12T17:41:47.142743+0000","last_active":"2024-09-12T17:41:47.142743+0000","last_peered":"2024-09-12T17:41:47.142743+0000","last_clean":"2024-09-12T17:41:47.142743+0000","last_became_active":"2024-09-12T16:58:21.723703+0000","last_became_peered":"2024-09-12T16:58:21.723703+0000","last_unstale":"2024-09-12T17:41:47.142743+0000","last_undegraded":"2024-09-12T17:41:47.142743+0000","last_fullsized":"2024-09-12T17:41:47.142743+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'70","last_scrub_stamp":"2024-09-12T17:41:47.142558+0000","last_deep_scrub":"265'70","last_deep_scrub_stamp":"2024-09-12T17:41:47.142558+0000","last_clean_scrub_stamp":"2024-09-12T17:41:47.142558+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:44.829243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":317,"num_read_kb":265,"num_write":106,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:43.467257+0000","last_change":"2024-09-12T17:41:43.467257+0000","last_active":"2024-09-12T17:41:43.467257+0000","last_peered":"2024-09-12T17:41:43.467257+0000","last_clean":"2024-09-12T17:41:43.467257+0000","last_became_active":"2024-09-12T16:58:08.536415+0000","last_became_peered":"2024-09-12T16:58:08.536415+0000","last_unstale":"2024-09-12T17:41:43.467257+0000","last_undegraded":"2024-09-12T17:41:43.467257+0000","last_fullsized":"2024-09-12T17:41:43.467257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:43.467045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:43.467045+0000","last_clean_scrub_stamp":"2024-09-12T17:41:43.467045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:31.530851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001332909,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"265'329","reported_seq":983,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:38.252941+0000","last_change":"2024-09-12T17:41:38.252941+0000","last_active":"2024-09-12T17:41:38.252941+0000","last_peered":"2024-09-12T17:41:38.252941+0000","last_clean":"2024-09-12T17:41:38.252941+0000","last_became_active":"2024-09-12T16:58:18.695755+0000","last_became_peered":"2024-09-12T16:58:18.695755+0000","last_unstale":"2024-09-12T17:41:38.252941+0000","last_undegraded":"2024-09-12T17:41:38.252941+0000","last_fullsized":"2024-09-12T17:41:38.252941+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'329","last_scrub_stamp":"2024-09-12T17:41:38.252730+0000","last_deep_scrub":"265'329","last_deep_scrub_stamp":"2024-09-12T17:41:38.252730+0000","last_clean_scrub_stamp":"2024-09-12T17:41:38.252730+0000","objects_scrubbed":6,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:02.194179+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399184,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":538,"num_read_kb":2859,"num_write":1066,"num_write_kb":24939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:37.353947+0000","last_change":"2024-09-12T16:58:23.713076+0000","last_active":"2024-09-12T17:39:37.353947+0000","last_peered":"2024-09-12T17:39:37.353947+0000","last_clean":"2024-09-12T17:39:37.353947+0000","last_became_active":"2024-09-12T16:58:23.712354+0000","last_became_peered":"2024-09-12T16:58:23.712354+0000","last_unstale":"2024-09-12T17:39:37.353947+0000","last_undegraded":"2024-09-12T17:39:37.353947+0000","last_fullsized":"2024-09-12T17:39:37.353947+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"265'1257","reported_seq":2722,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:58.441384+0000","last_change":"2024-09-12T17:41:58.441384+0000","last_active":"2024-09-12T17:41:58.441384+0000","last_peered":"2024-09-12T17:41:58.441384+0000","last_clean":"2024-09-12T17:41:58.441384+0000","last_became_active":"2024-09-12T16:58:25.720266+0000","last_became_peered":"2024-09-12T16:58:25.720266+0000","last_unstale":"2024-09-12T17:41:58.441384+0000","last_undegraded":"2024-09-12T17:41:58.441384+0000","last_fullsized":"2024-09-12T17:41:58.441384+0000","mapping_epoch":30,"log_start":"265'1200","ondisk_log_start":"265'1200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1257","last_scrub_stamp":"2024-09-12T17:41:58.441125+0000","last_deep_scrub":"265'1257","last_deep_scrub_stamp":"2024-09-12T17:41:58.441125+0000","last_clean_scrub_stamp":"2024-09-12T17:41:58.441125+0000","objects_scrubbed":11,"log_size":57,"log_dups_size":1200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:43.727748+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150793,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2049,"num_read_kb":3938,"num_write":1140,"num_write_kb":988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:16.305184+0000","last_change":"2024-09-12T16:58:27.746109+0000","last_active":"2024-09-12T17:38:16.305184+0000","last_peered":"2024-09-12T17:38:16.305184+0000","last_clean":"2024-09-12T17:38:16.305184+0000","last_became_active":"2024-09-12T16:58:27.745341+0000","last_became_peered":"2024-09-12T16:58:27.745341+0000","last_unstale":"2024-09-12T17:38:16.305184+0000","last_undegraded":"2024-09-12T17:38:16.305184+0000","last_fullsized":"2024-09-12T17:38:16.305184+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:12.798309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"265'209","reported_seq":725,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:45.577501+0000","last_change":"2024-09-12T16:58:29.776726+0000","last_active":"2024-09-12T17:39:45.577501+0000","last_peered":"2024-09-12T17:39:45.577501+0000","last_clean":"2024-09-12T17:39:45.577501+0000","last_became_active":"2024-09-12T16:58:29.775944+0000","last_became_peered":"2024-09-12T16:58:29.775944+0000","last_unstale":"2024-09-12T17:39:45.577501+0000","last_undegraded":"2024-09-12T17:39:45.577501+0000","last_fullsized":"2024-09-12T17:39:45.577501+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":347,"num_read_kb":347,"num_write":464,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"265'122","reported_seq":683,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:47.372995+0000","last_change":"2024-09-12T17:41:47.372995+0000","last_active":"2024-09-12T17:41:47.372995+0000","last_peered":"2024-09-12T17:41:47.372995+0000","last_clean":"2024-09-12T17:41:47.372995+0000","last_became_active":"2024-09-12T16:58:21.721591+0000","last_became_peered":"2024-09-12T16:58:21.721591+0000","last_unstale":"2024-09-12T17:41:47.372995+0000","last_undegraded":"2024-09-12T17:41:47.372995+0000","last_fullsized":"2024-09-12T17:41:47.372995+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'122","last_scrub_stamp":"2024-09-12T17:41:47.372781+0000","last_deep_scrub":"265'122","last_deep_scrub_stamp":"2024-09-12T17:41:47.372781+0000","last_clean_scrub_stamp":"2024-09-12T17:41:47.372781+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:40.097427+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":495,"num_read_kb":400,"num_write":173,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":530,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:39.559720+0000","last_change":"2024-09-12T17:41:39.559674+0000","last_active":"2024-09-12T17:41:39.559720+0000","last_peered":"2024-09-12T17:41:39.559720+0000","last_clean":"2024-09-12T17:41:39.559720+0000","last_became_active":"2024-09-12T16:58:08.534076+0000","last_became_peered":"2024-09-12T16:58:08.534076+0000","last_unstale":"2024-09-12T17:41:39.559720+0000","last_undegraded":"2024-09-12T17:41:39.559720+0000","last_fullsized":"2024-09-12T17:41:39.559720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:39.559614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:39.559614+0000","last_clean_scrub_stamp":"2024-09-12T17:41:39.559614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:56.106176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00083305900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"265'316","reported_seq":945,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:38.395383+0000","last_change":"2024-09-12T17:41:38.395383+0000","last_active":"2024-09-12T17:41:38.395383+0000","last_peered":"2024-09-12T17:41:38.395383+0000","last_clean":"2024-09-12T17:41:38.395383+0000","last_became_active":"2024-09-12T16:58:18.702490+0000","last_became_peered":"2024-09-12T16:58:18.702490+0000","last_unstale":"2024-09-12T17:41:38.395383+0000","last_undegraded":"2024-09-12T17:41:38.395383+0000","last_fullsized":"2024-09-12T17:41:38.395383+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'316","last_scrub_stamp":"2024-09-12T17:41:38.395252+0000","last_deep_scrub":"265'316","last_deep_scrub_stamp":"2024-09-12T17:41:38.395252+0000","last_clean_scrub_stamp":"2024-09-12T17:41:38.395252+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:23.910993+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263185,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":455,"num_read_kb":7668,"num_write":1054,"num_write_kb":10637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"265'2","reported_seq":508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:45.506695+0000","last_change":"2024-09-12T17:41:45.506695+0000","last_active":"2024-09-12T17:41:45.506695+0000","last_peered":"2024-09-12T17:41:45.506695+0000","last_clean":"2024-09-12T17:41:45.506695+0000","last_became_active":"2024-09-12T16:58:23.724300+0000","last_became_peered":"2024-09-12T16:58:23.724300+0000","last_unstale":"2024-09-12T17:41:45.506695+0000","last_undegraded":"2024-09-12T17:41:45.506695+0000","last_fullsized":"2024-09-12T17:41:45.506695+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T17:41:45.506523+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T17:41:45.506523+0000","last_clean_scrub_stamp":"2024-09-12T17:41:45.506523+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:28.275981+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"265'230","reported_seq":1294,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:20.111355+0000","last_change":"2024-09-12T16:58:25.949888+0000","last_active":"2024-09-12T17:41:20.111355+0000","last_peered":"2024-09-12T17:41:20.111355+0000","last_clean":"2024-09-12T17:41:20.111355+0000","last_became_active":"2024-09-12T16:58:25.949120+0000","last_became_peered":"2024-09-12T16:58:25.949120+0000","last_unstale":"2024-09-12T17:41:20.111355+0000","last_undegraded":"2024-09-12T17:41:20.111355+0000","last_fullsized":"2024-09-12T17:41:20.111355+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:25.274870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":178,"num_read_kb":168,"num_write":143,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:02.347062+0000","last_change":"2024-09-12T16:58:27.736961+0000","last_active":"2024-09-12T17:38:02.347062+0000","last_peered":"2024-09-12T17:38:02.347062+0000","last_clean":"2024-09-12T17:38:02.347062+0000","last_became_active":"2024-09-12T16:58:27.736215+0000","last_became_peered":"2024-09-12T16:58:27.736215+0000","last_unstale":"2024-09-12T17:38:02.347062+0000","last_undegraded":"2024-09-12T17:38:02.347062+0000","last_fullsized":"2024-09-12T17:38:02.347062+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:39.723240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"265'249","reported_seq":855,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:05.168772+0000","last_change":"2024-09-12T16:58:29.792850+0000","last_active":"2024-09-12T17:40:05.168772+0000","last_peered":"2024-09-12T17:40:05.168772+0000","last_clean":"2024-09-12T17:40:05.168772+0000","last_became_active":"2024-09-12T16:58:29.792069+0000","last_became_peered":"2024-09-12T16:58:29.792069+0000","last_unstale":"2024-09-12T17:40:05.168772+0000","last_undegraded":"2024-09-12T17:40:05.168772+0000","last_fullsized":"2024-09-12T17:40:05.168772+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:03.093750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1041,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":529,"num_read_kb":546,"num_write":531,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"265'182","reported_seq":846,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:44.368734+0000","last_change":"2024-09-12T17:41:44.368734+0000","last_active":"2024-09-12T17:41:44.368734+0000","last_peered":"2024-09-12T17:41:44.368734+0000","last_clean":"2024-09-12T17:41:44.368734+0000","last_became_active":"2024-09-12T16:58:21.729848+0000","last_became_peered":"2024-09-12T16:58:21.729848+0000","last_unstale":"2024-09-12T17:41:44.368734+0000","last_undegraded":"2024-09-12T17:41:44.368734+0000","last_fullsized":"2024-09-12T17:41:44.368734+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'182","last_scrub_stamp":"2024-09-12T17:41:44.368559+0000","last_deep_scrub":"265'182","last_deep_scrub_stamp":"2024-09-12T17:41:44.368559+0000","last_clean_scrub_stamp":"2024-09-12T17:41:44.368559+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:17.854539+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":860,"num_read_kb":722,"num_write":267,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"265'3","reported_seq":532,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:39.591713+0000","last_change":"2024-09-12T17:41:39.591479+0000","last_active":"2024-09-12T17:41:39.591713+0000","last_peered":"2024-09-12T17:41:39.591713+0000","last_clean":"2024-09-12T17:41:39.591713+0000","last_became_active":"2024-09-12T16:58:08.538078+0000","last_became_peered":"2024-09-12T16:58:08.538078+0000","last_unstale":"2024-09-12T17:41:39.591713+0000","last_undegraded":"2024-09-12T17:41:39.591713+0000","last_fullsized":"2024-09-12T17:41:39.591713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T17:41:39.591211+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T17:41:39.591211+0000","last_clean_scrub_stamp":"2024-09-12T17:41:39.591211+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:33.661873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012028640000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"265'367","reported_seq":1086,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:38.629003+0000","last_change":"2024-09-12T17:41:38.629003+0000","last_active":"2024-09-12T17:41:38.629003+0000","last_peered":"2024-09-12T17:41:38.629003+0000","last_clean":"2024-09-12T17:41:38.629003+0000","last_became_active":"2024-09-12T16:58:18.690974+0000","last_became_peered":"2024-09-12T16:58:18.690974+0000","last_unstale":"2024-09-12T17:41:38.629003+0000","last_undegraded":"2024-09-12T17:41:38.629003+0000","last_fullsized":"2024-09-12T17:41:38.629003+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'367","last_scrub_stamp":"2024-09-12T17:41:38.628803+0000","last_deep_scrub":"265'367","last_deep_scrub_stamp":"2024-09-12T17:41:38.628803+0000","last_clean_scrub_stamp":"2024-09-12T17:41:38.628803+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:15.373546+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1105801,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":657,"num_read_kb":31815,"num_write":1139,"num_write_kb":57340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:56.985088+0000","last_change":"2024-09-12T17:41:56.985088+0000","last_active":"2024-09-12T17:41:56.985088+0000","last_peered":"2024-09-12T17:41:56.985088+0000","last_clean":"2024-09-12T17:41:56.985088+0000","last_became_active":"2024-09-12T16:58:23.713019+0000","last_became_peered":"2024-09-12T16:58:23.713019+0000","last_unstale":"2024-09-12T17:41:56.985088+0000","last_undegraded":"2024-09-12T17:41:56.985088+0000","last_fullsized":"2024-09-12T17:41:56.985088+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:56.984910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:56.984910+0000","last_clean_scrub_stamp":"2024-09-12T17:41:56.984910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:28.683508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"265'106","reported_seq":648,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:25.077602+0000","last_change":"2024-09-12T16:58:25.719093+0000","last_active":"2024-09-12T17:41:25.077602+0000","last_peered":"2024-09-12T17:41:25.077602+0000","last_clean":"2024-09-12T17:41:25.077602+0000","last_became_active":"2024-09-12T16:58:25.718364+0000","last_became_peered":"2024-09-12T16:58:25.718364+0000","last_unstale":"2024-09-12T17:41:25.077602+0000","last_undegraded":"2024-09-12T17:41:25.077602+0000","last_fullsized":"2024-09-12T17:41:25.077602+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":134,"num_write":100,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:41.316276+0000","last_change":"2024-09-12T16:58:27.762825+0000","last_active":"2024-09-12T17:39:41.316276+0000","last_peered":"2024-09-12T17:39:41.316276+0000","last_clean":"2024-09-12T17:39:41.316276+0000","last_became_active":"2024-09-12T16:58:27.761992+0000","last_became_peered":"2024-09-12T16:58:27.761992+0000","last_unstale":"2024-09-12T17:39:41.316276+0000","last_undegraded":"2024-09-12T17:39:41.316276+0000","last_fullsized":"2024-09-12T17:39:41.316276+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"265'110","reported_seq":664,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:45.796469+0000","last_change":"2024-09-12T16:58:29.788605+0000","last_active":"2024-09-12T17:39:45.796469+0000","last_peered":"2024-09-12T17:39:45.796469+0000","last_clean":"2024-09-12T17:39:45.796469+0000","last_became_active":"2024-09-12T16:58:29.787823+0000","last_became_peered":"2024-09-12T16:58:29.787823+0000","last_unstale":"2024-09-12T17:39:45.796469+0000","last_undegraded":"2024-09-12T17:39:45.796469+0000","last_fullsized":"2024-09-12T17:39:45.796469+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":275,"num_read_kb":264,"num_write":276,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"265'60","reported_seq":621,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:46.382243+0000","last_change":"2024-09-12T17:41:46.382243+0000","last_active":"2024-09-12T17:41:46.382243+0000","last_peered":"2024-09-12T17:41:46.382243+0000","last_clean":"2024-09-12T17:41:46.382243+0000","last_became_active":"2024-09-12T16:58:21.720884+0000","last_became_peered":"2024-09-12T16:58:21.720884+0000","last_unstale":"2024-09-12T17:41:46.382243+0000","last_undegraded":"2024-09-12T17:41:46.382243+0000","last_fullsized":"2024-09-12T17:41:46.382243+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'60","last_scrub_stamp":"2024-09-12T17:41:46.382003+0000","last_deep_scrub":"265'60","last_deep_scrub_stamp":"2024-09-12T17:41:46.382003+0000","last_clean_scrub_stamp":"2024-09-12T17:41:46.382003+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:39.632797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":223,"num_write":91,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"265'382","reported_seq":1036,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:41.627826+0000","last_change":"2024-09-12T17:41:41.627826+0000","last_active":"2024-09-12T17:41:41.627826+0000","last_peered":"2024-09-12T17:41:41.627826+0000","last_clean":"2024-09-12T17:41:41.627826+0000","last_became_active":"2024-09-12T16:58:18.718447+0000","last_became_peered":"2024-09-12T16:58:18.718447+0000","last_unstale":"2024-09-12T17:41:41.627826+0000","last_undegraded":"2024-09-12T17:41:41.627826+0000","last_fullsized":"2024-09-12T17:41:41.627826+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'382","last_scrub_stamp":"2024-09-12T17:41:41.627618+0000","last_deep_scrub":"265'382","last_deep_scrub_stamp":"2024-09-12T17:41:41.627618+0000","last_clean_scrub_stamp":"2024-09-12T17:41:41.627618+0000","objects_scrubbed":6,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:27.860391+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569509,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":515,"num_read_kb":35874,"num_write":1210,"num_write_kb":51856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:39.427247+0000","last_change":"2024-09-12T17:41:39.427122+0000","last_active":"2024-09-12T17:41:39.427247+0000","last_peered":"2024-09-12T17:41:39.427247+0000","last_clean":"2024-09-12T17:41:39.427247+0000","last_became_active":"2024-09-12T16:58:08.842793+0000","last_became_peered":"2024-09-12T16:58:08.842793+0000","last_unstale":"2024-09-12T17:41:39.427247+0000","last_undegraded":"2024-09-12T17:41:39.427247+0000","last_fullsized":"2024-09-12T17:41:39.427247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:39.426951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:39.426951+0000","last_clean_scrub_stamp":"2024-09-12T17:41:39.426951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:26.839539+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001121181,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:55.062333+0000","last_change":"2024-09-12T17:41:55.062333+0000","last_active":"2024-09-12T17:41:55.062333+0000","last_peered":"2024-09-12T17:41:55.062333+0000","last_clean":"2024-09-12T17:41:55.062333+0000","last_became_active":"2024-09-12T16:58:23.710355+0000","last_became_peered":"2024-09-12T16:58:23.710355+0000","last_unstale":"2024-09-12T17:41:55.062333+0000","last_undegraded":"2024-09-12T17:41:55.062333+0000","last_fullsized":"2024-09-12T17:41:55.062333+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:55.062149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:55.062149+0000","last_clean_scrub_stamp":"2024-09-12T17:41:55.062149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:43.683368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"265'570","reported_seq":1230,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.165906+0000","last_change":"2024-09-12T16:58:25.731056+0000","last_active":"2024-09-12T17:41:33.165906+0000","last_peered":"2024-09-12T17:41:33.165906+0000","last_clean":"2024-09-12T17:41:33.165906+0000","last_became_active":"2024-09-12T16:58:25.729627+0000","last_became_peered":"2024-09-12T16:58:25.729627+0000","last_unstale":"2024-09-12T17:41:33.165906+0000","last_undegraded":"2024-09-12T17:41:33.165906+0000","last_fullsized":"2024-09-12T17:41:33.165906+0000","mapping_epoch":30,"log_start":"265'500","ondisk_log_start":"265'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":500,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:16.481975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101207,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1575,"num_read_kb":2772,"num_write":2032,"num_write_kb":1870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:06.279604+0000","last_change":"2024-09-12T16:58:27.734028+0000","last_active":"2024-09-12T17:38:06.279604+0000","last_peered":"2024-09-12T17:38:06.279604+0000","last_clean":"2024-09-12T17:38:06.279604+0000","last_became_active":"2024-09-12T16:58:27.733289+0000","last_became_peered":"2024-09-12T16:58:27.733289+0000","last_unstale":"2024-09-12T17:38:06.279604+0000","last_undegraded":"2024-09-12T17:38:06.279604+0000","last_fullsized":"2024-09-12T17:38:06.279604+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:05.333134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"265'157","reported_seq":661,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:44.925507+0000","last_change":"2024-09-12T16:58:29.779788+0000","last_active":"2024-09-12T17:39:44.925507+0000","last_peered":"2024-09-12T17:39:44.925507+0000","last_clean":"2024-09-12T17:39:44.925507+0000","last_became_active":"2024-09-12T16:58:29.779052+0000","last_became_peered":"2024-09-12T16:58:29.779052+0000","last_unstale":"2024-09-12T17:39:44.925507+0000","last_undegraded":"2024-09-12T17:39:44.925507+0000","last_fullsized":"2024-09-12T17:39:44.925507+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:46.799747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":199,"num_read_kb":192,"num_write":361,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"265'202","reported_seq":814,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:46.191587+0000","last_change":"2024-09-12T17:41:46.191587+0000","last_active":"2024-09-12T17:41:46.191587+0000","last_peered":"2024-09-12T17:41:46.191587+0000","last_clean":"2024-09-12T17:41:46.191587+0000","last_became_active":"2024-09-12T16:58:21.701657+0000","last_became_peered":"2024-09-12T16:58:21.701657+0000","last_unstale":"2024-09-12T17:41:46.191587+0000","last_undegraded":"2024-09-12T17:41:46.191587+0000","last_fullsized":"2024-09-12T17:41:46.191587+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'202","last_scrub_stamp":"2024-09-12T17:41:46.191396+0000","last_deep_scrub":"265'202","last_deep_scrub_stamp":"2024-09-12T17:41:46.191396+0000","last_clean_scrub_stamp":"2024-09-12T17:41:46.191396+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:56.805877+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":888,"num_read_kb":728,"num_write":297,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"265'333","reported_seq":965,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:42.447586+0000","last_change":"2024-09-12T17:41:42.447586+0000","last_active":"2024-09-12T17:41:42.447586+0000","last_peered":"2024-09-12T17:41:42.447586+0000","last_clean":"2024-09-12T17:41:42.447586+0000","last_became_active":"2024-09-12T16:58:18.698417+0000","last_became_peered":"2024-09-12T16:58:18.698417+0000","last_unstale":"2024-09-12T17:41:42.447586+0000","last_undegraded":"2024-09-12T17:41:42.447586+0000","last_fullsized":"2024-09-12T17:41:42.447586+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'333","last_scrub_stamp":"2024-09-12T17:41:42.447381+0000","last_deep_scrub":"265'333","last_deep_scrub_stamp":"2024-09-12T17:41:42.447381+0000","last_clean_scrub_stamp":"2024-09-12T17:41:42.447381+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:25.913614+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":462,"num_read_kb":2498,"num_write":998,"num_write_kb":19196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:48.544587+0000","last_change":"2024-09-12T17:41:48.544587+0000","last_active":"2024-09-12T17:41:48.544587+0000","last_peered":"2024-09-12T17:41:48.544587+0000","last_clean":"2024-09-12T17:41:48.544587+0000","last_became_active":"2024-09-12T16:58:08.841831+0000","last_became_peered":"2024-09-12T16:58:08.841831+0000","last_unstale":"2024-09-12T17:41:48.544587+0000","last_undegraded":"2024-09-12T17:41:48.544587+0000","last_fullsized":"2024-09-12T17:41:48.544587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:48.544399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:48.544399+0000","last_clean_scrub_stamp":"2024-09-12T17:41:48.544399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:56.853257+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0013535820000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:52.494127+0000","last_change":"2024-09-12T17:41:52.494127+0000","last_active":"2024-09-12T17:41:52.494127+0000","last_peered":"2024-09-12T17:41:52.494127+0000","last_clean":"2024-09-12T17:41:52.494127+0000","last_became_active":"2024-09-12T16:58:23.707729+0000","last_became_peered":"2024-09-12T16:58:23.707729+0000","last_unstale":"2024-09-12T17:41:52.494127+0000","last_undegraded":"2024-09-12T17:41:52.494127+0000","last_fullsized":"2024-09-12T17:41:52.494127+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:52.493942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:52.493942+0000","last_clean_scrub_stamp":"2024-09-12T17:41:52.493942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:36.835671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"265'158","reported_seq":726,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:55.405867+0000","last_change":"2024-09-12T17:41:55.405867+0000","last_active":"2024-09-12T17:41:55.405867+0000","last_peered":"2024-09-12T17:41:55.405867+0000","last_clean":"2024-09-12T17:41:55.405867+0000","last_became_active":"2024-09-12T16:58:25.950057+0000","last_became_peered":"2024-09-12T16:58:25.950057+0000","last_unstale":"2024-09-12T17:41:55.405867+0000","last_undegraded":"2024-09-12T17:41:55.405867+0000","last_fullsized":"2024-09-12T17:41:55.405867+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'158","last_scrub_stamp":"2024-09-12T17:41:55.405681+0000","last_deep_scrub":"265'158","last_deep_scrub_stamp":"2024-09-12T17:41:55.405681+0000","last_clean_scrub_stamp":"2024-09-12T17:41:55.405681+0000","objects_scrubbed":8,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:53.277423+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":199,"num_read_kb":190,"num_write":134,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"265'770","reported_seq":2770,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.970057+0000","last_change":"2024-09-12T16:58:27.758626+0000","last_active":"2024-09-12T17:41:32.970057+0000","last_peered":"2024-09-12T17:41:32.970057+0000","last_clean":"2024-09-12T17:41:32.970057+0000","last_became_active":"2024-09-12T16:58:27.756883+0000","last_became_peered":"2024-09-12T16:58:27.756883+0000","last_unstale":"2024-09-12T17:41:32.970057+0000","last_undegraded":"2024-09-12T17:41:32.970057+0000","last_fullsized":"2024-09-12T17:41:32.970057+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:09.429114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"265'131","reported_seq":630,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:24.919336+0000","last_change":"2024-09-12T16:58:29.785504+0000","last_active":"2024-09-12T17:41:24.919336+0000","last_peered":"2024-09-12T17:41:24.919336+0000","last_clean":"2024-09-12T17:41:24.919336+0000","last_became_active":"2024-09-12T16:58:29.784743+0000","last_became_peered":"2024-09-12T16:58:29.784743+0000","last_unstale":"2024-09-12T17:41:24.919336+0000","last_undegraded":"2024-09-12T17:41:24.919336+0000","last_fullsized":"2024-09-12T17:41:24.919336+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:07.819438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1532,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":153,"num_read_kb":151,"num_write":316,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"265'50","reported_seq":595,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:46.640425+0000","last_change":"2024-09-12T17:41:46.640425+0000","last_active":"2024-09-12T17:41:46.640425+0000","last_peered":"2024-09-12T17:41:46.640425+0000","last_clean":"2024-09-12T17:41:46.640425+0000","last_became_active":"2024-09-12T16:58:21.723391+0000","last_became_peered":"2024-09-12T16:58:21.723391+0000","last_unstale":"2024-09-12T17:41:46.640425+0000","last_undegraded":"2024-09-12T17:41:46.640425+0000","last_fullsized":"2024-09-12T17:41:46.640425+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'50","last_scrub_stamp":"2024-09-12T17:41:46.640257+0000","last_deep_scrub":"265'50","last_deep_scrub_stamp":"2024-09-12T17:41:46.640257+0000","last_clean_scrub_stamp":"2024-09-12T17:41:46.640257+0000","objects_scrubbed":1,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:57.222046+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":182,"num_write":83,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":760,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"265'466","reported_seq":1113,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:38.799638+0000","last_change":"2024-09-12T17:41:38.799581+0000","last_active":"2024-09-12T17:41:38.799638+0000","last_peered":"2024-09-12T17:41:38.799638+0000","last_clean":"2024-09-12T17:41:38.799638+0000","last_became_active":"2024-09-12T16:58:18.686966+0000","last_became_peered":"2024-09-12T16:58:18.686966+0000","last_unstale":"2024-09-12T17:41:38.799638+0000","last_undegraded":"2024-09-12T17:41:38.799638+0000","last_fullsized":"2024-09-12T17:41:38.799638+0000","mapping_epoch":23,"log_start":"265'400","ondisk_log_start":"265'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'466","last_scrub_stamp":"2024-09-12T17:41:38.799492+0000","last_deep_scrub":"265'466","last_deep_scrub_stamp":"2024-09-12T17:41:38.799492+0000","last_clean_scrub_stamp":"2024-09-12T17:41:38.799492+0000","objects_scrubbed":7,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:31.946406+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376560,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":630,"num_read_kb":10296,"num_write":1224,"num_write_kb":24848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:37.425805+0000","last_change":"2024-09-12T17:41:37.425805+0000","last_active":"2024-09-12T17:41:37.425805+0000","last_peered":"2024-09-12T17:41:37.425805+0000","last_clean":"2024-09-12T17:41:37.425805+0000","last_became_active":"2024-09-12T16:58:08.544406+0000","last_became_peered":"2024-09-12T16:58:08.544406+0000","last_unstale":"2024-09-12T17:41:37.425805+0000","last_undegraded":"2024-09-12T17:41:37.425805+0000","last_fullsized":"2024-09-12T17:41:37.425805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:37.425638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:37.425638+0000","last_clean_scrub_stamp":"2024-09-12T17:41:37.425638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:38.294788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012247510000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:01.278478+0000","last_change":"2024-09-12T16:58:23.701057+0000","last_active":"2024-09-12T17:38:01.278478+0000","last_peered":"2024-09-12T17:38:01.278478+0000","last_clean":"2024-09-12T17:38:01.278478+0000","last_became_active":"2024-09-12T16:58:23.700331+0000","last_became_peered":"2024-09-12T16:58:23.700331+0000","last_unstale":"2024-09-12T17:38:01.278478+0000","last_undegraded":"2024-09-12T17:38:01.278478+0000","last_fullsized":"2024-09-12T17:38:01.278478+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:36.712880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"265'119","reported_seq":654,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:32.549144+0000","last_change":"2024-09-12T16:58:25.731260+0000","last_active":"2024-09-12T17:39:32.549144+0000","last_peered":"2024-09-12T17:39:32.549144+0000","last_clean":"2024-09-12T17:39:32.549144+0000","last_became_active":"2024-09-12T16:58:25.730018+0000","last_became_peered":"2024-09-12T16:58:25.730018+0000","last_unstale":"2024-09-12T17:39:32.549144+0000","last_undegraded":"2024-09-12T17:39:32.549144+0000","last_fullsized":"2024-09-12T17:39:32.549144+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:14.303705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":134,"num_read_kb":123,"num_write":96,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"265'786","reported_seq":2348,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.077589+0000","last_change":"2024-09-12T16:58:27.747091+0000","last_active":"2024-09-12T17:41:33.077589+0000","last_peered":"2024-09-12T17:41:33.077589+0000","last_clean":"2024-09-12T17:41:33.077589+0000","last_became_active":"2024-09-12T16:58:27.746177+0000","last_became_peered":"2024-09-12T16:58:27.746177+0000","last_unstale":"2024-09-12T17:41:33.077589+0000","last_undegraded":"2024-09-12T17:41:33.077589+0000","last_fullsized":"2024-09-12T17:41:33.077589+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:44:59.636233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"265'168","reported_seq":662,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:26.453883+0000","last_change":"2024-09-12T16:58:29.791161+0000","last_active":"2024-09-12T17:39:26.453883+0000","last_peered":"2024-09-12T17:39:26.453883+0000","last_clean":"2024-09-12T17:39:26.453883+0000","last_became_active":"2024-09-12T16:58:29.790535+0000","last_became_peered":"2024-09-12T16:58:29.790535+0000","last_unstale":"2024-09-12T17:39:26.453883+0000","last_undegraded":"2024-09-12T17:39:26.453883+0000","last_fullsized":"2024-09-12T17:39:26.453883+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:22:58.632183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":476,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":147,"num_read_kb":144,"num_write":393,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"265'96","reported_seq":668,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:43.661578+0000","last_change":"2024-09-12T17:41:43.661578+0000","last_active":"2024-09-12T17:41:43.661578+0000","last_peered":"2024-09-12T17:41:43.661578+0000","last_clean":"2024-09-12T17:41:43.661578+0000","last_became_active":"2024-09-12T16:58:21.701206+0000","last_became_peered":"2024-09-12T16:58:21.701206+0000","last_unstale":"2024-09-12T17:41:43.661578+0000","last_undegraded":"2024-09-12T17:41:43.661578+0000","last_fullsized":"2024-09-12T17:41:43.661578+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'96","last_scrub_stamp":"2024-09-12T17:41:43.661384+0000","last_deep_scrub":"265'96","last_deep_scrub_stamp":"2024-09-12T17:41:43.661384+0000","last_clean_scrub_stamp":"2024-09-12T17:41:43.661384+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:19.823171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":405,"num_read_kb":331,"num_write":157,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"265'370","reported_seq":1035,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:37.268281+0000","last_change":"2024-09-12T17:41:37.268183+0000","last_active":"2024-09-12T17:41:37.268281+0000","last_peered":"2024-09-12T17:41:37.268281+0000","last_clean":"2024-09-12T17:41:37.268281+0000","last_became_active":"2024-09-12T16:58:18.701270+0000","last_became_peered":"2024-09-12T16:58:18.701270+0000","last_unstale":"2024-09-12T17:41:37.268281+0000","last_undegraded":"2024-09-12T17:41:37.268281+0000","last_fullsized":"2024-09-12T17:41:37.268281+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'370","last_scrub_stamp":"2024-09-12T17:41:37.268034+0000","last_deep_scrub":"265'370","last_deep_scrub_stamp":"2024-09-12T17:41:37.268034+0000","last_clean_scrub_stamp":"2024-09-12T17:41:37.268034+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:22.095358+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":575,"num_read_kb":17292,"num_write":1132,"num_write_kb":31476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:39.456766+0000","last_change":"2024-09-12T17:41:39.456766+0000","last_active":"2024-09-12T17:41:39.456766+0000","last_peered":"2024-09-12T17:41:39.456766+0000","last_clean":"2024-09-12T17:41:39.456766+0000","last_became_active":"2024-09-12T16:58:08.546519+0000","last_became_peered":"2024-09-12T16:58:08.546519+0000","last_unstale":"2024-09-12T17:41:39.456766+0000","last_undegraded":"2024-09-12T17:41:39.456766+0000","last_fullsized":"2024-09-12T17:41:39.456766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:39.456592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:39.456592+0000","last_clean_scrub_stamp":"2024-09-12T17:41:39.456592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:55.571196+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00088376600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:37.358927+0000","last_change":"2024-09-12T16:58:23.707506+0000","last_active":"2024-09-12T17:38:37.358927+0000","last_peered":"2024-09-12T17:38:37.358927+0000","last_clean":"2024-09-12T17:38:37.358927+0000","last_became_active":"2024-09-12T16:58:23.707022+0000","last_became_peered":"2024-09-12T16:58:23.707022+0000","last_unstale":"2024-09-12T17:38:37.358927+0000","last_undegraded":"2024-09-12T17:38:37.358927+0000","last_fullsized":"2024-09-12T17:38:37.358927+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:09.125943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"265'741","reported_seq":1458,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.601305+0000","last_change":"2024-09-12T16:58:25.949990+0000","last_active":"2024-09-12T17:41:32.601305+0000","last_peered":"2024-09-12T17:41:32.601305+0000","last_clean":"2024-09-12T17:41:32.601305+0000","last_became_active":"2024-09-12T16:58:25.949263+0000","last_became_peered":"2024-09-12T16:58:25.949263+0000","last_unstale":"2024-09-12T17:41:32.601305+0000","last_undegraded":"2024-09-12T17:41:32.601305+0000","last_fullsized":"2024-09-12T17:41:32.601305+0000","mapping_epoch":30,"log_start":"265'700","ondisk_log_start":"265'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":700,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:06.590619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143781,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1330,"num_read_kb":3188,"num_write":1090,"num_write_kb":918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:02.350591+0000","last_change":"2024-09-12T16:58:27.742543+0000","last_active":"2024-09-12T17:38:02.350591+0000","last_peered":"2024-09-12T17:38:02.350591+0000","last_clean":"2024-09-12T17:38:02.350591+0000","last_became_active":"2024-09-12T16:58:27.741779+0000","last_became_peered":"2024-09-12T16:58:27.741779+0000","last_unstale":"2024-09-12T17:38:02.350591+0000","last_undegraded":"2024-09-12T17:38:02.350591+0000","last_fullsized":"2024-09-12T17:38:02.350591+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:32.725498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"265'144","reported_seq":646,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:04.962585+0000","last_change":"2024-09-12T16:58:29.788557+0000","last_active":"2024-09-12T17:40:04.962585+0000","last_peered":"2024-09-12T17:40:04.962585+0000","last_clean":"2024-09-12T17:40:04.962585+0000","last_became_active":"2024-09-12T16:58:29.787692+0000","last_became_peered":"2024-09-12T16:58:29.787692+0000","last_unstale":"2024-09-12T17:40:04.962585+0000","last_undegraded":"2024-09-12T17:40:04.962585+0000","last_fullsized":"2024-09-12T17:40:04.962585+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:15.861385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":218,"num_read_kb":207,"num_write":364,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"265'162","reported_seq":712,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:05.120577+0000","last_change":"2024-09-12T16:58:29.785185+0000","last_active":"2024-09-12T17:40:05.120577+0000","last_peered":"2024-09-12T17:40:05.120577+0000","last_clean":"2024-09-12T17:40:05.120577+0000","last_became_active":"2024-09-12T16:58:29.782784+0000","last_became_peered":"2024-09-12T16:58:29.782784+0000","last_unstale":"2024-09-12T17:40:05.120577+0000","last_undegraded":"2024-09-12T17:40:05.120577+0000","last_fullsized":"2024-09-12T17:40:05.120577+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:48.171949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":629,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":266,"num_read_kb":264,"num_write":397,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"265'100","reported_seq":695,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:47.569629+0000","last_change":"2024-09-12T17:41:47.569629+0000","last_active":"2024-09-12T17:41:47.569629+0000","last_peered":"2024-09-12T17:41:47.569629+0000","last_clean":"2024-09-12T17:41:47.569629+0000","last_became_active":"2024-09-12T16:58:21.731509+0000","last_became_peered":"2024-09-12T16:58:21.731509+0000","last_unstale":"2024-09-12T17:41:47.569629+0000","last_undegraded":"2024-09-12T17:41:47.569629+0000","last_fullsized":"2024-09-12T17:41:47.569629+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'100","last_scrub_stamp":"2024-09-12T17:41:47.569417+0000","last_deep_scrub":"265'100","last_deep_scrub_stamp":"2024-09-12T17:41:47.569417+0000","last_clean_scrub_stamp":"2024-09-12T17:41:47.569417+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:35.252758+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":445,"num_read_kb":375,"num_write":158,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"265'305","reported_seq":938,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:39.651915+0000","last_change":"2024-09-12T17:41:39.651915+0000","last_active":"2024-09-12T17:41:39.651915+0000","last_peered":"2024-09-12T17:41:39.651915+0000","last_clean":"2024-09-12T17:41:39.651915+0000","last_became_active":"2024-09-12T16:58:18.700214+0000","last_became_peered":"2024-09-12T16:58:18.700214+0000","last_unstale":"2024-09-12T17:41:39.651915+0000","last_undegraded":"2024-09-12T17:41:39.651915+0000","last_fullsized":"2024-09-12T17:41:39.651915+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'305","last_scrub_stamp":"2024-09-12T17:41:39.651676+0000","last_deep_scrub":"265'305","last_deep_scrub_stamp":"2024-09-12T17:41:39.651676+0000","last_clean_scrub_stamp":"2024-09-12T17:41:39.651676+0000","objects_scrubbed":6,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:32.335113+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":472,"num_read_kb":3767,"num_write":1042,"num_write_kb":19533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:53.398007+0000","last_change":"2024-09-12T17:41:53.398007+0000","last_active":"2024-09-12T17:41:53.398007+0000","last_peered":"2024-09-12T17:41:53.398007+0000","last_clean":"2024-09-12T17:41:53.398007+0000","last_became_active":"2024-09-12T16:58:23.725034+0000","last_became_peered":"2024-09-12T16:58:23.725034+0000","last_unstale":"2024-09-12T17:41:53.398007+0000","last_undegraded":"2024-09-12T17:41:53.398007+0000","last_fullsized":"2024-09-12T17:41:53.398007+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:53.397794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:53.397794+0000","last_clean_scrub_stamp":"2024-09-12T17:41:53.397794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:47.628035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"265'272","reported_seq":847,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.848043+0000","last_change":"2024-09-12T16:58:25.738410+0000","last_active":"2024-09-12T17:41:32.848043+0000","last_peered":"2024-09-12T17:41:32.848043+0000","last_clean":"2024-09-12T17:41:32.848043+0000","last_became_active":"2024-09-12T16:58:25.737706+0000","last_became_peered":"2024-09-12T16:58:25.737706+0000","last_unstale":"2024-09-12T17:41:32.848043+0000","last_undegraded":"2024-09-12T17:41:32.848043+0000","last_fullsized":"2024-09-12T17:41:32.848043+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:02:12.766927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54495,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":451,"num_read_kb":1025,"num_write":366,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:07.351743+0000","last_change":"2024-09-12T16:58:27.746931+0000","last_active":"2024-09-12T17:38:07.351743+0000","last_peered":"2024-09-12T17:38:07.351743+0000","last_clean":"2024-09-12T17:38:07.351743+0000","last_became_active":"2024-09-12T16:58:27.746143+0000","last_became_peered":"2024-09-12T16:58:27.746143+0000","last_unstale":"2024-09-12T17:38:07.351743+0000","last_undegraded":"2024-09-12T17:38:07.351743+0000","last_fullsized":"2024-09-12T17:38:07.351743+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:38.513197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"265'116","reported_seq":626,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:57.572381+0000","last_change":"2024-09-12T16:58:29.786922+0000","last_active":"2024-09-12T17:38:57.572381+0000","last_peered":"2024-09-12T17:38:57.572381+0000","last_clean":"2024-09-12T17:38:57.572381+0000","last_became_active":"2024-09-12T16:58:29.784143+0000","last_became_peered":"2024-09-12T16:58:29.784143+0000","last_unstale":"2024-09-12T17:38:57.572381+0000","last_undegraded":"2024-09-12T17:38:57.572381+0000","last_fullsized":"2024-09-12T17:38:57.572381+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:57.768618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":186,"num_write":283,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"265'174","reported_seq":835,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:49.351699+0000","last_change":"2024-09-12T17:41:49.351699+0000","last_active":"2024-09-12T17:41:49.351699+0000","last_peered":"2024-09-12T17:41:49.351699+0000","last_clean":"2024-09-12T17:41:49.351699+0000","last_became_active":"2024-09-12T16:58:21.715193+0000","last_became_peered":"2024-09-12T16:58:21.715193+0000","last_unstale":"2024-09-12T17:41:49.351699+0000","last_undegraded":"2024-09-12T17:41:49.351699+0000","last_fullsized":"2024-09-12T17:41:49.351699+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'174","last_scrub_stamp":"2024-09-12T17:41:49.351495+0000","last_deep_scrub":"265'174","last_deep_scrub_stamp":"2024-09-12T17:41:49.351495+0000","last_clean_scrub_stamp":"2024-09-12T17:41:49.351495+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:24.477655+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":752,"num_read_kb":633,"num_write":248,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"265'344","reported_seq":980,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:47.512874+0000","last_change":"2024-09-12T17:41:47.512734+0000","last_active":"2024-09-12T17:41:47.512874+0000","last_peered":"2024-09-12T17:41:47.512874+0000","last_clean":"2024-09-12T17:41:47.512874+0000","last_became_active":"2024-09-12T16:58:18.686155+0000","last_became_peered":"2024-09-12T16:58:18.686155+0000","last_unstale":"2024-09-12T17:41:47.512874+0000","last_undegraded":"2024-09-12T17:41:47.512874+0000","last_fullsized":"2024-09-12T17:41:47.512874+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'344","last_scrub_stamp":"2024-09-12T17:41:47.512547+0000","last_deep_scrub":"265'344","last_deep_scrub_stamp":"2024-09-12T17:41:47.512547+0000","last_clean_scrub_stamp":"2024-09-12T17:41:47.512547+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:09.454509+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029079,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":528,"num_read_kb":20889,"num_write":1017,"num_write_kb":24291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:55.515139+0000","last_change":"2024-09-12T17:41:55.515139+0000","last_active":"2024-09-12T17:41:55.515139+0000","last_peered":"2024-09-12T17:41:55.515139+0000","last_clean":"2024-09-12T17:41:55.515139+0000","last_became_active":"2024-09-12T16:58:23.713069+0000","last_became_peered":"2024-09-12T16:58:23.713069+0000","last_unstale":"2024-09-12T17:41:55.515139+0000","last_undegraded":"2024-09-12T17:41:55.515139+0000","last_fullsized":"2024-09-12T17:41:55.515139+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:55.514956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:55.514956+0000","last_clean_scrub_stamp":"2024-09-12T17:41:55.514956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:26.580464+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"265'35","reported_seq":534,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:25.845238+0000","last_change":"2024-09-12T16:58:25.731248+0000","last_active":"2024-09-12T17:39:25.845238+0000","last_peered":"2024-09-12T17:39:25.845238+0000","last_clean":"2024-09-12T17:39:25.845238+0000","last_became_active":"2024-09-12T16:58:25.730410+0000","last_became_peered":"2024-09-12T16:58:25.730410+0000","last_unstale":"2024-09-12T17:39:25.845238+0000","last_undegraded":"2024-09-12T17:39:25.845238+0000","last_fullsized":"2024-09-12T17:39:25.845238+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:19.441232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:11.303833+0000","last_change":"2024-09-12T16:58:27.743749+0000","last_active":"2024-09-12T17:38:11.303833+0000","last_peered":"2024-09-12T17:38:11.303833+0000","last_clean":"2024-09-12T17:38:11.303833+0000","last_became_active":"2024-09-12T16:58:27.742979+0000","last_became_peered":"2024-09-12T16:58:27.742979+0000","last_unstale":"2024-09-12T17:38:11.303833+0000","last_undegraded":"2024-09-12T17:38:11.303833+0000","last_fullsized":"2024-09-12T17:38:11.303833+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:29.367350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"265'208","reported_seq":728,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:04.410688+0000","last_change":"2024-09-12T16:58:29.782903+0000","last_active":"2024-09-12T17:40:04.410688+0000","last_peered":"2024-09-12T17:40:04.410688+0000","last_clean":"2024-09-12T17:40:04.410688+0000","last_became_active":"2024-09-12T16:58:29.782024+0000","last_became_peered":"2024-09-12T16:58:29.782024+0000","last_unstale":"2024-09-12T17:40:04.410688+0000","last_undegraded":"2024-09-12T17:40:04.410688+0000","last_fullsized":"2024-09-12T17:40:04.410688+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:51.452618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":358,"num_read_kb":350,"num_write":466,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"265'522","reported_seq":1262,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:52.511408+0000","last_change":"2024-09-12T17:41:52.511408+0000","last_active":"2024-09-12T17:41:52.511408+0000","last_peered":"2024-09-12T17:41:52.511408+0000","last_clean":"2024-09-12T17:41:52.511408+0000","last_became_active":"2024-09-12T16:58:21.711637+0000","last_became_peered":"2024-09-12T16:58:21.711637+0000","last_unstale":"2024-09-12T17:41:52.511408+0000","last_undegraded":"2024-09-12T17:41:52.511408+0000","last_fullsized":"2024-09-12T17:41:52.511408+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'522","last_scrub_stamp":"2024-09-12T17:41:52.511214+0000","last_deep_scrub":"265'522","last_deep_scrub_stamp":"2024-09-12T17:41:52.511214+0000","last_clean_scrub_stamp":"2024-09-12T17:41:52.511214+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:52.916702+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2547,"num_read_kb":2246,"num_write":971,"num_write_kb":585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2872,"num_omap_keys":12,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"265'374","reported_seq":984,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:37.559542+0000","last_change":"2024-09-12T17:41:37.559542+0000","last_active":"2024-09-12T17:41:37.559542+0000","last_peered":"2024-09-12T17:41:37.559542+0000","last_clean":"2024-09-12T17:41:37.559542+0000","last_became_active":"2024-09-12T16:58:55.851886+0000","last_became_peered":"2024-09-12T16:58:55.851886+0000","last_unstale":"2024-09-12T17:41:37.559542+0000","last_undegraded":"2024-09-12T17:41:37.559542+0000","last_fullsized":"2024-09-12T17:41:37.559542+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'374","last_scrub_stamp":"2024-09-12T17:41:37.559441+0000","last_deep_scrub":"265'374","last_deep_scrub_stamp":"2024-09-12T17:41:37.559441+0000","last_clean_scrub_stamp":"2024-09-12T17:41:37.559441+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:47.380450+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":696596,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":502,"num_read_kb":19430,"num_write":1218,"num_write_kb":23867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:06.302568+0000","last_change":"2024-09-12T16:58:23.718833+0000","last_active":"2024-09-12T17:38:06.302568+0000","last_peered":"2024-09-12T17:38:06.302568+0000","last_clean":"2024-09-12T17:38:06.302568+0000","last_became_active":"2024-09-12T16:58:23.718109+0000","last_became_peered":"2024-09-12T16:58:23.718109+0000","last_unstale":"2024-09-12T17:38:06.302568+0000","last_undegraded":"2024-09-12T17:38:06.302568+0000","last_fullsized":"2024-09-12T17:38:06.302568+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:01.727111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"265'311","reported_seq":902,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.393549+0000","last_change":"2024-09-12T16:58:25.739863+0000","last_active":"2024-09-12T17:41:32.393549+0000","last_peered":"2024-09-12T17:41:32.393549+0000","last_clean":"2024-09-12T17:41:32.393549+0000","last_became_active":"2024-09-12T16:58:25.738463+0000","last_became_peered":"2024-09-12T16:58:25.738463+0000","last_unstale":"2024-09-12T17:41:32.393549+0000","last_undegraded":"2024-09-12T17:41:32.393549+0000","last_fullsized":"2024-09-12T17:41:32.393549+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:48.664021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46394,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":527,"num_read_kb":1194,"num_write":426,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:11.296562+0000","last_change":"2024-09-12T16:58:27.760862+0000","last_active":"2024-09-12T17:38:11.296562+0000","last_peered":"2024-09-12T17:38:11.296562+0000","last_clean":"2024-09-12T17:38:11.296562+0000","last_became_active":"2024-09-12T16:58:27.760265+0000","last_became_peered":"2024-09-12T16:58:27.760265+0000","last_unstale":"2024-09-12T17:38:11.296562+0000","last_undegraded":"2024-09-12T17:38:11.296562+0000","last_fullsized":"2024-09-12T17:38:11.296562+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:32.912040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"265'144","reported_seq":673,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:21.515529+0000","last_change":"2024-09-12T16:58:29.777889+0000","last_active":"2024-09-12T17:39:21.515529+0000","last_peered":"2024-09-12T17:39:21.515529+0000","last_clean":"2024-09-12T17:39:21.515529+0000","last_became_active":"2024-09-12T16:58:29.776448+0000","last_became_peered":"2024-09-12T16:58:29.776448+0000","last_unstale":"2024-09-12T17:39:21.515529+0000","last_undegraded":"2024-09-12T17:39:21.515529+0000","last_fullsized":"2024-09-12T17:39:21.515529+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:41.421501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":253,"num_read_kb":229,"num_write":261,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"265'252","reported_seq":888,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:47.614719+0000","last_change":"2024-09-12T17:41:47.614719+0000","last_active":"2024-09-12T17:41:47.614719+0000","last_peered":"2024-09-12T17:41:47.614719+0000","last_clean":"2024-09-12T17:41:47.614719+0000","last_became_active":"2024-09-12T16:58:21.705619+0000","last_became_peered":"2024-09-12T16:58:21.705619+0000","last_unstale":"2024-09-12T17:41:47.614719+0000","last_undegraded":"2024-09-12T17:41:47.614719+0000","last_fullsized":"2024-09-12T17:41:47.614719+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'252","last_scrub_stamp":"2024-09-12T17:41:47.614536+0000","last_deep_scrub":"265'252","last_deep_scrub_stamp":"2024-09-12T17:41:47.614536+0000","last_clean_scrub_stamp":"2024-09-12T17:41:47.614536+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:16.229333+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1131,"num_read_kb":917,"num_write":399,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":504,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"265'315","reported_seq":968,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:40.264053+0000","last_change":"2024-09-12T17:41:40.263798+0000","last_active":"2024-09-12T17:41:40.264053+0000","last_peered":"2024-09-12T17:41:40.264053+0000","last_clean":"2024-09-12T17:41:40.264053+0000","last_became_active":"2024-09-12T16:58:18.700720+0000","last_became_peered":"2024-09-12T16:58:18.700720+0000","last_unstale":"2024-09-12T17:41:40.264053+0000","last_undegraded":"2024-09-12T17:41:40.264053+0000","last_fullsized":"2024-09-12T17:41:40.264053+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'315","last_scrub_stamp":"2024-09-12T17:41:40.263594+0000","last_deep_scrub":"265'315","last_deep_scrub_stamp":"2024-09-12T17:41:40.263594+0000","last_clean_scrub_stamp":"2024-09-12T17:41:40.263594+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:36.901664+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399159,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":424,"num_read_kb":68507,"num_write":939,"num_write_kb":27085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:53.480997+0000","last_change":"2024-09-12T17:41:53.480997+0000","last_active":"2024-09-12T17:41:53.480997+0000","last_peered":"2024-09-12T17:41:53.480997+0000","last_clean":"2024-09-12T17:41:53.480997+0000","last_became_active":"2024-09-12T16:58:23.721005+0000","last_became_peered":"2024-09-12T16:58:23.721005+0000","last_unstale":"2024-09-12T17:41:53.480997+0000","last_undegraded":"2024-09-12T17:41:53.480997+0000","last_fullsized":"2024-09-12T17:41:53.480997+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:53.480780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:53.480780+0000","last_clean_scrub_stamp":"2024-09-12T17:41:53.480780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:41.592134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"265'246","reported_seq":813,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.266477+0000","last_change":"2024-09-12T16:58:25.733878+0000","last_active":"2024-09-12T17:41:32.266477+0000","last_peered":"2024-09-12T17:41:32.266477+0000","last_clean":"2024-09-12T17:41:32.266477+0000","last_became_active":"2024-09-12T16:58:25.732956+0000","last_became_peered":"2024-09-12T16:58:25.732956+0000","last_unstale":"2024-09-12T17:41:32.266477+0000","last_undegraded":"2024-09-12T17:41:32.266477+0000","last_fullsized":"2024-09-12T17:41:32.266477+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:50:45.059874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52555,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":415,"num_read_kb":944,"num_write":334,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:07.348165+0000","last_change":"2024-09-12T16:58:27.747511+0000","last_active":"2024-09-12T17:38:07.348165+0000","last_peered":"2024-09-12T17:38:07.348165+0000","last_clean":"2024-09-12T17:38:07.348165+0000","last_became_active":"2024-09-12T16:58:27.737089+0000","last_became_peered":"2024-09-12T16:58:27.737089+0000","last_unstale":"2024-09-12T17:38:07.348165+0000","last_undegraded":"2024-09-12T17:38:07.348165+0000","last_fullsized":"2024-09-12T17:38:07.348165+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:38.515071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"265'132","reported_seq":786,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:46.446227+0000","last_change":"2024-09-12T17:41:46.446227+0000","last_active":"2024-09-12T17:41:46.446227+0000","last_peered":"2024-09-12T17:41:46.446227+0000","last_clean":"2024-09-12T17:41:46.446227+0000","last_became_active":"2024-09-12T16:58:21.717079+0000","last_became_peered":"2024-09-12T16:58:21.717079+0000","last_unstale":"2024-09-12T17:41:46.446227+0000","last_undegraded":"2024-09-12T17:41:46.446227+0000","last_fullsized":"2024-09-12T17:41:46.446227+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'132","last_scrub_stamp":"2024-09-12T17:41:46.446038+0000","last_deep_scrub":"265'132","last_deep_scrub_stamp":"2024-09-12T17:41:46.446038+0000","last_clean_scrub_stamp":"2024-09-12T17:41:46.446038+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:13.280751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":593,"num_read_kb":510,"num_write":185,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"265'352","reported_seq":997,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:40.787281+0000","last_change":"2024-09-12T17:41:40.787145+0000","last_active":"2024-09-12T17:41:40.787281+0000","last_peered":"2024-09-12T17:41:40.787281+0000","last_clean":"2024-09-12T17:41:40.787281+0000","last_became_active":"2024-09-12T16:58:18.677480+0000","last_became_peered":"2024-09-12T16:58:18.677480+0000","last_unstale":"2024-09-12T17:41:40.787281+0000","last_undegraded":"2024-09-12T17:41:40.787281+0000","last_fullsized":"2024-09-12T17:41:40.787281+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'352","last_scrub_stamp":"2024-09-12T17:41:40.786932+0000","last_deep_scrub":"265'352","last_deep_scrub_stamp":"2024-09-12T17:41:40.786932+0000","last_clean_scrub_stamp":"2024-09-12T17:41:40.786932+0000","objects_scrubbed":8,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:05.959550+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4539352,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":465,"num_read_kb":21305,"num_write":1120,"num_write_kb":20049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:37.355462+0000","last_change":"2024-09-12T16:58:23.719669+0000","last_active":"2024-09-12T17:38:37.355462+0000","last_peered":"2024-09-12T17:38:37.355462+0000","last_clean":"2024-09-12T17:38:37.355462+0000","last_became_active":"2024-09-12T16:58:23.719039+0000","last_became_peered":"2024-09-12T16:58:23.719039+0000","last_unstale":"2024-09-12T17:38:37.355462+0000","last_undegraded":"2024-09-12T17:38:37.355462+0000","last_fullsized":"2024-09-12T17:38:37.355462+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:00.880364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"265'471","reported_seq":1098,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.092416+0000","last_change":"2024-09-12T16:58:25.720911+0000","last_active":"2024-09-12T17:41:33.092416+0000","last_peered":"2024-09-12T17:41:33.092416+0000","last_clean":"2024-09-12T17:41:33.092416+0000","last_became_active":"2024-09-12T16:58:25.720165+0000","last_became_peered":"2024-09-12T16:58:25.720165+0000","last_unstale":"2024-09-12T17:41:33.092416+0000","last_undegraded":"2024-09-12T17:41:33.092416+0000","last_fullsized":"2024-09-12T17:41:33.092416+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:01.154748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97109,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":819,"num_read_kb":1920,"num_write":702,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:27.338321+0000","last_change":"2024-09-12T16:58:27.750193+0000","last_active":"2024-09-12T17:38:27.338321+0000","last_peered":"2024-09-12T17:38:27.338321+0000","last_clean":"2024-09-12T17:38:27.338321+0000","last_became_active":"2024-09-12T16:58:27.749390+0000","last_became_peered":"2024-09-12T16:58:27.749390+0000","last_unstale":"2024-09-12T17:38:27.338321+0000","last_undegraded":"2024-09-12T17:38:27.338321+0000","last_fullsized":"2024-09-12T17:38:27.338321+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:54.523888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"265'184","reported_seq":732,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:45.266732+0000","last_change":"2024-09-12T16:58:29.789122+0000","last_active":"2024-09-12T17:39:45.266732+0000","last_peered":"2024-09-12T17:39:45.266732+0000","last_clean":"2024-09-12T17:39:45.266732+0000","last_became_active":"2024-09-12T16:58:29.788460+0000","last_became_peered":"2024-09-12T16:58:29.788460+0000","last_unstale":"2024-09-12T17:39:45.266732+0000","last_undegraded":"2024-09-12T17:39:45.266732+0000","last_fullsized":"2024-09-12T17:39:45.266732+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:40.064167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":436,"num_read_kb":400,"num_write":425,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"265'128","reported_seq":745,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:51.118367+0000","last_change":"2024-09-12T17:41:51.118367+0000","last_active":"2024-09-12T17:41:51.118367+0000","last_peered":"2024-09-12T17:41:51.118367+0000","last_clean":"2024-09-12T17:41:51.118367+0000","last_became_active":"2024-09-12T16:58:21.724003+0000","last_became_peered":"2024-09-12T16:58:21.724003+0000","last_unstale":"2024-09-12T17:41:51.118367+0000","last_undegraded":"2024-09-12T17:41:51.118367+0000","last_fullsized":"2024-09-12T17:41:51.118367+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'128","last_scrub_stamp":"2024-09-12T17:41:51.118180+0000","last_deep_scrub":"265'128","last_deep_scrub_stamp":"2024-09-12T17:41:51.118180+0000","last_clean_scrub_stamp":"2024-09-12T17:41:51.118180+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:50.382693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":616,"num_read_kb":520,"num_write":198,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"265'382","reported_seq":1081,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:40.494181+0000","last_change":"2024-09-12T17:41:40.494019+0000","last_active":"2024-09-12T17:41:40.494181+0000","last_peered":"2024-09-12T17:41:40.494181+0000","last_clean":"2024-09-12T17:41:40.494181+0000","last_became_active":"2024-09-12T16:58:18.706806+0000","last_became_peered":"2024-09-12T16:58:18.706806+0000","last_unstale":"2024-09-12T17:41:40.494181+0000","last_undegraded":"2024-09-12T17:41:40.494181+0000","last_fullsized":"2024-09-12T17:41:40.494181+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'382","last_scrub_stamp":"2024-09-12T17:41:40.493763+0000","last_deep_scrub":"265'382","last_deep_scrub_stamp":"2024-09-12T17:41:40.493763+0000","last_clean_scrub_stamp":"2024-09-12T17:41:40.493763+0000","objects_scrubbed":11,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:01.630616+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2005288,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":606,"num_read_kb":18575,"num_write":1246,"num_write_kb":49050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:54.441149+0000","last_change":"2024-09-12T17:41:54.441149+0000","last_active":"2024-09-12T17:41:54.441149+0000","last_peered":"2024-09-12T17:41:54.441149+0000","last_clean":"2024-09-12T17:41:54.441149+0000","last_became_active":"2024-09-12T16:58:23.720654+0000","last_became_peered":"2024-09-12T16:58:23.720654+0000","last_unstale":"2024-09-12T17:41:54.441149+0000","last_undegraded":"2024-09-12T17:41:54.441149+0000","last_fullsized":"2024-09-12T17:41:54.441149+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:54.440953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:54.440953+0000","last_clean_scrub_stamp":"2024-09-12T17:41:54.440953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:46.885058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"265'316","reported_seq":897,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.308318+0000","last_change":"2024-09-12T16:58:25.734439+0000","last_active":"2024-09-12T17:41:32.308318+0000","last_peered":"2024-09-12T17:41:32.308318+0000","last_clean":"2024-09-12T17:41:32.308318+0000","last_became_active":"2024-09-12T16:58:25.733241+0000","last_became_peered":"2024-09-12T16:58:25.733241+0000","last_unstale":"2024-09-12T17:41:32.308318+0000","last_undegraded":"2024-09-12T17:41:32.308318+0000","last_fullsized":"2024-09-12T17:41:32.308318+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:46.538919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53167,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":518,"num_read_kb":1145,"num_write":434,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:28.699837+0000","last_change":"2024-09-12T16:58:27.751196+0000","last_active":"2024-09-12T17:38:28.699837+0000","last_peered":"2024-09-12T17:38:28.699837+0000","last_clean":"2024-09-12T17:38:28.699837+0000","last_became_active":"2024-09-12T16:58:27.750328+0000","last_became_peered":"2024-09-12T16:58:27.750328+0000","last_unstale":"2024-09-12T17:38:28.699837+0000","last_undegraded":"2024-09-12T17:38:28.699837+0000","last_fullsized":"2024-09-12T17:38:28.699837+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:06.616801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"265'181","reported_seq":680,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:04.425931+0000","last_change":"2024-09-12T16:58:29.777915+0000","last_active":"2024-09-12T17:40:04.425931+0000","last_peered":"2024-09-12T17:40:04.425931+0000","last_clean":"2024-09-12T17:40:04.425931+0000","last_became_active":"2024-09-12T16:58:29.777124+0000","last_became_peered":"2024-09-12T16:58:29.777124+0000","last_unstale":"2024-09-12T17:40:04.425931+0000","last_undegraded":"2024-09-12T17:40:04.425931+0000","last_fullsized":"2024-09-12T17:40:04.425931+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:43.622054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1215,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":228,"num_read_kb":227,"num_write":517,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"265'163","reported_seq":775,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:54.539232+0000","last_change":"2024-09-12T17:41:54.539232+0000","last_active":"2024-09-12T17:41:54.539232+0000","last_peered":"2024-09-12T17:41:54.539232+0000","last_clean":"2024-09-12T17:41:54.539232+0000","last_became_active":"2024-09-12T16:58:21.698565+0000","last_became_peered":"2024-09-12T16:58:21.698565+0000","last_unstale":"2024-09-12T17:41:54.539232+0000","last_undegraded":"2024-09-12T17:41:54.539232+0000","last_fullsized":"2024-09-12T17:41:54.539232+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'163","last_scrub_stamp":"2024-09-12T17:41:54.539052+0000","last_deep_scrub":"265'163","last_deep_scrub_stamp":"2024-09-12T17:41:54.539052+0000","last_clean_scrub_stamp":"2024-09-12T17:41:54.539052+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:56.134179+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":649,"num_read_kb":535,"num_write":267,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":466,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"265'341","reported_seq":998,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:41.643297+0000","last_change":"2024-09-12T17:41:41.643297+0000","last_active":"2024-09-12T17:41:41.643297+0000","last_peered":"2024-09-12T17:41:41.643297+0000","last_clean":"2024-09-12T17:41:41.643297+0000","last_became_active":"2024-09-12T16:58:18.700196+0000","last_became_peered":"2024-09-12T16:58:18.700196+0000","last_unstale":"2024-09-12T17:41:41.643297+0000","last_undegraded":"2024-09-12T17:41:41.643297+0000","last_fullsized":"2024-09-12T17:41:41.643297+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'341","last_scrub_stamp":"2024-09-12T17:41:41.643102+0000","last_deep_scrub":"265'341","last_deep_scrub_stamp":"2024-09-12T17:41:41.643102+0000","last_clean_scrub_stamp":"2024-09-12T17:41:41.643102+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:23.678015+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":519,"num_read_kb":4020,"num_write":1087,"num_write_kb":21150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:26.284203+0000","last_change":"2024-09-12T16:58:23.703516+0000","last_active":"2024-09-12T17:38:26.284203+0000","last_peered":"2024-09-12T17:38:26.284203+0000","last_clean":"2024-09-12T17:38:26.284203+0000","last_became_active":"2024-09-12T16:58:23.702293+0000","last_became_peered":"2024-09-12T16:58:23.702293+0000","last_unstale":"2024-09-12T17:38:26.284203+0000","last_undegraded":"2024-09-12T17:38:26.284203+0000","last_fullsized":"2024-09-12T17:38:26.284203+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:48.660513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"265'325","reported_seq":902,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.010922+0000","last_change":"2024-09-12T16:58:25.950771+0000","last_active":"2024-09-12T17:41:33.010922+0000","last_peered":"2024-09-12T17:41:33.010922+0000","last_clean":"2024-09-12T17:41:33.010922+0000","last_became_active":"2024-09-12T16:58:25.949883+0000","last_became_peered":"2024-09-12T16:58:25.949883+0000","last_unstale":"2024-09-12T17:41:33.010922+0000","last_undegraded":"2024-09-12T17:41:33.010922+0000","last_fullsized":"2024-09-12T17:41:33.010922+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:22.560848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47961,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":516,"num_read_kb":1185,"num_write":434,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:28.699909+0000","last_change":"2024-09-12T16:58:27.749008+0000","last_active":"2024-09-12T17:38:28.699909+0000","last_peered":"2024-09-12T17:38:28.699909+0000","last_clean":"2024-09-12T17:38:28.699909+0000","last_became_active":"2024-09-12T16:58:27.739965+0000","last_became_peered":"2024-09-12T16:58:27.739965+0000","last_unstale":"2024-09-12T17:38:28.699909+0000","last_undegraded":"2024-09-12T17:38:28.699909+0000","last_fullsized":"2024-09-12T17:38:28.699909+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:19.228861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"265'138","reported_seq":629,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:24.910801+0000","last_change":"2024-09-12T16:58:29.772039+0000","last_active":"2024-09-12T17:41:24.910801+0000","last_peered":"2024-09-12T17:41:24.910801+0000","last_clean":"2024-09-12T17:41:24.910801+0000","last_became_active":"2024-09-12T16:58:29.771267+0000","last_became_peered":"2024-09-12T16:58:29.771267+0000","last_unstale":"2024-09-12T17:41:24.910801+0000","last_undegraded":"2024-09-12T17:41:24.910801+0000","last_fullsized":"2024-09-12T17:41:24.910801+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:22.290183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":401,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":154,"num_write":321,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"265'82","reported_seq":694,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:43.505594+0000","last_change":"2024-09-12T17:41:43.505594+0000","last_active":"2024-09-12T17:41:43.505594+0000","last_peered":"2024-09-12T17:41:43.505594+0000","last_clean":"2024-09-12T17:41:43.505594+0000","last_became_active":"2024-09-12T16:58:21.730342+0000","last_became_peered":"2024-09-12T16:58:21.730342+0000","last_unstale":"2024-09-12T17:41:43.505594+0000","last_undegraded":"2024-09-12T17:41:43.505594+0000","last_fullsized":"2024-09-12T17:41:43.505594+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'82","last_scrub_stamp":"2024-09-12T17:41:43.505360+0000","last_deep_scrub":"265'82","last_deep_scrub_stamp":"2024-09-12T17:41:43.505360+0000","last_clean_scrub_stamp":"2024-09-12T17:41:43.505360+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:13.444514+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":417,"num_read_kb":364,"num_write":119,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"265'313","reported_seq":1009,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:39.237770+0000","last_change":"2024-09-12T17:41:39.237770+0000","last_active":"2024-09-12T17:41:39.237770+0000","last_peered":"2024-09-12T17:41:39.237770+0000","last_clean":"2024-09-12T17:41:39.237770+0000","last_became_active":"2024-09-12T16:58:18.688773+0000","last_became_peered":"2024-09-12T16:58:18.688773+0000","last_unstale":"2024-09-12T17:41:39.237770+0000","last_undegraded":"2024-09-12T17:41:39.237770+0000","last_fullsized":"2024-09-12T17:41:39.237770+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'313","last_scrub_stamp":"2024-09-12T17:41:39.237589+0000","last_deep_scrub":"265'313","last_deep_scrub_stamp":"2024-09-12T17:41:39.237589+0000","last_clean_scrub_stamp":"2024-09-12T17:41:39.237589+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:34.837693+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":566,"num_read_kb":43210,"num_write":1036,"num_write_kb":32802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:57.401448+0000","last_change":"2024-09-12T17:41:57.401448+0000","last_active":"2024-09-12T17:41:57.401448+0000","last_peered":"2024-09-12T17:41:57.401448+0000","last_clean":"2024-09-12T17:41:57.401448+0000","last_became_active":"2024-09-12T16:58:23.709009+0000","last_became_peered":"2024-09-12T16:58:23.709009+0000","last_unstale":"2024-09-12T17:41:57.401448+0000","last_undegraded":"2024-09-12T17:41:57.401448+0000","last_fullsized":"2024-09-12T17:41:57.401448+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:57.401263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:57.401263+0000","last_clean_scrub_stamp":"2024-09-12T17:41:57.401263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:55.509659+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"265'88","reported_seq":608,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:22.509004+0000","last_change":"2024-09-12T16:58:25.950055+0000","last_active":"2024-09-12T17:39:22.509004+0000","last_peered":"2024-09-12T17:39:22.509004+0000","last_clean":"2024-09-12T17:39:22.509004+0000","last_became_active":"2024-09-12T16:58:25.949196+0000","last_became_peered":"2024-09-12T16:58:25.949196+0000","last_unstale":"2024-09-12T17:39:22.509004+0000","last_undegraded":"2024-09-12T17:39:22.509004+0000","last_fullsized":"2024-09-12T17:39:22.509004+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:18:17.202967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":122,"num_read_kb":116,"num_write":142,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"265'758","reported_seq":2154,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.980472+0000","last_change":"2024-09-12T16:58:27.741265+0000","last_active":"2024-09-12T17:41:32.980472+0000","last_peered":"2024-09-12T17:41:32.980472+0000","last_clean":"2024-09-12T17:41:32.980472+0000","last_became_active":"2024-09-12T16:58:27.740416+0000","last_became_peered":"2024-09-12T16:58:27.740416+0000","last_unstale":"2024-09-12T17:41:32.980472+0000","last_undegraded":"2024-09-12T17:41:32.980472+0000","last_fullsized":"2024-09-12T17:41:32.980472+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":700,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:32.112107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"265'129","reported_seq":650,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:48.742930+0000","last_change":"2024-09-12T16:58:29.784795+0000","last_active":"2024-09-12T17:39:48.742930+0000","last_peered":"2024-09-12T17:39:48.742930+0000","last_clean":"2024-09-12T17:39:48.742930+0000","last_became_active":"2024-09-12T16:58:29.784128+0000","last_became_peered":"2024-09-12T16:58:29.784128+0000","last_unstale":"2024-09-12T17:39:48.742930+0000","last_undegraded":"2024-09-12T17:39:48.742930+0000","last_fullsized":"2024-09-12T17:39:48.742930+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:43.512905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":291,"num_read_kb":261,"num_write":354,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"265'160","reported_seq":763,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:51.677261+0000","last_change":"2024-09-12T17:41:51.677261+0000","last_active":"2024-09-12T17:41:51.677261+0000","last_peered":"2024-09-12T17:41:51.677261+0000","last_clean":"2024-09-12T17:41:51.677261+0000","last_became_active":"2024-09-12T16:58:21.700714+0000","last_became_peered":"2024-09-12T16:58:21.700714+0000","last_unstale":"2024-09-12T17:41:51.677261+0000","last_undegraded":"2024-09-12T17:41:51.677261+0000","last_fullsized":"2024-09-12T17:41:51.677261+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'160","last_scrub_stamp":"2024-09-12T17:41:51.677068+0000","last_deep_scrub":"265'160","last_deep_scrub_stamp":"2024-09-12T17:41:51.677068+0000","last_clean_scrub_stamp":"2024-09-12T17:41:51.677068+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:24.457151+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":716,"num_read_kb":600,"num_write":247,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":685,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"265'324","reported_seq":1084,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:47.592290+0000","last_change":"2024-09-12T17:41:47.592290+0000","last_active":"2024-09-12T17:41:47.592290+0000","last_peered":"2024-09-12T17:41:47.592290+0000","last_clean":"2024-09-12T17:41:47.592290+0000","last_became_active":"2024-09-12T16:58:18.706117+0000","last_became_peered":"2024-09-12T16:58:18.706117+0000","last_unstale":"2024-09-12T17:41:47.592290+0000","last_undegraded":"2024-09-12T17:41:47.592290+0000","last_fullsized":"2024-09-12T17:41:47.592290+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'324","last_scrub_stamp":"2024-09-12T17:41:47.592082+0000","last_deep_scrub":"265'324","last_deep_scrub_stamp":"2024-09-12T17:41:47.592082+0000","last_clean_scrub_stamp":"2024-09-12T17:41:47.592082+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:54.054534+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263228,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":571,"num_read_kb":60034,"num_write":895,"num_write_kb":44854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:26.307328+0000","last_change":"2024-09-12T16:58:23.719072+0000","last_active":"2024-09-12T17:38:26.307328+0000","last_peered":"2024-09-12T17:38:26.307328+0000","last_clean":"2024-09-12T17:38:26.307328+0000","last_became_active":"2024-09-12T16:58:23.718211+0000","last_became_peered":"2024-09-12T16:58:23.718211+0000","last_unstale":"2024-09-12T17:38:26.307328+0000","last_undegraded":"2024-09-12T17:38:26.307328+0000","last_fullsized":"2024-09-12T17:38:26.307328+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:55.776100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"265'303","reported_seq":884,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.239123+0000","last_change":"2024-09-12T16:58:25.726107+0000","last_active":"2024-09-12T17:41:33.239123+0000","last_peered":"2024-09-12T17:41:33.239123+0000","last_clean":"2024-09-12T17:41:33.239123+0000","last_became_active":"2024-09-12T16:58:25.724774+0000","last_became_peered":"2024-09-12T16:58:25.724774+0000","last_unstale":"2024-09-12T17:41:33.239123+0000","last_undegraded":"2024-09-12T17:41:33.239123+0000","last_fullsized":"2024-09-12T17:41:33.239123+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:29.986764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47652,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":491,"num_read_kb":1079,"num_write":394,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:32.369432+0000","last_change":"2024-09-12T16:58:27.759894+0000","last_active":"2024-09-12T17:39:32.369432+0000","last_peered":"2024-09-12T17:39:32.369432+0000","last_clean":"2024-09-12T17:39:32.369432+0000","last_became_active":"2024-09-12T16:58:27.755232+0000","last_became_peered":"2024-09-12T16:58:27.755232+0000","last_unstale":"2024-09-12T17:39:32.369432+0000","last_undegraded":"2024-09-12T17:39:32.369432+0000","last_fullsized":"2024-09-12T17:39:32.369432+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"265'133","reported_seq":645,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:04.245111+0000","last_change":"2024-09-12T16:58:29.782745+0000","last_active":"2024-09-12T17:40:04.245111+0000","last_peered":"2024-09-12T17:40:04.245111+0000","last_clean":"2024-09-12T17:40:04.245111+0000","last_became_active":"2024-09-12T16:58:29.782006+0000","last_became_peered":"2024-09-12T16:58:29.782006+0000","last_unstale":"2024-09-12T17:40:04.245111+0000","last_undegraded":"2024-09-12T17:40:04.245111+0000","last_fullsized":"2024-09-12T17:40:04.245111+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:25.299681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":784,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":248,"num_read_kb":225,"num_write":333,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"265'367","reported_seq":982,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:49.619878+0000","last_change":"2024-09-12T17:41:49.619878+0000","last_active":"2024-09-12T17:41:49.619878+0000","last_peered":"2024-09-12T17:41:49.619878+0000","last_clean":"2024-09-12T17:41:49.619878+0000","last_became_active":"2024-09-12T16:58:21.700909+0000","last_became_peered":"2024-09-12T16:58:21.700909+0000","last_unstale":"2024-09-12T17:41:49.619878+0000","last_undegraded":"2024-09-12T17:41:49.619878+0000","last_fullsized":"2024-09-12T17:41:49.619878+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'367","last_scrub_stamp":"2024-09-12T17:41:49.619757+0000","last_deep_scrub":"265'367","last_deep_scrub_stamp":"2024-09-12T17:41:49.619757+0000","last_clean_scrub_stamp":"2024-09-12T17:41:49.619757+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:59.864277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1540,"num_read_kb":1221,"num_write":577,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8073,"num_omap_keys":32,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"265'345","reported_seq":985,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:43.695319+0000","last_change":"2024-09-12T17:41:43.695319+0000","last_active":"2024-09-12T17:41:43.695319+0000","last_peered":"2024-09-12T17:41:43.695319+0000","last_clean":"2024-09-12T17:41:43.695319+0000","last_became_active":"2024-09-12T16:58:18.706197+0000","last_became_peered":"2024-09-12T16:58:18.706197+0000","last_unstale":"2024-09-12T17:41:43.695319+0000","last_undegraded":"2024-09-12T17:41:43.695319+0000","last_fullsized":"2024-09-12T17:41:43.695319+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'345","last_scrub_stamp":"2024-09-12T17:41:43.695067+0000","last_deep_scrub":"265'345","last_deep_scrub_stamp":"2024-09-12T17:41:43.695067+0000","last_clean_scrub_stamp":"2024-09-12T17:41:43.695067+0000","objects_scrubbed":10,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:07.116451+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10548403,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":531,"num_read_kb":18954,"num_write":1116,"num_write_kb":43009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:27.338265+0000","last_change":"2024-09-12T16:58:23.712080+0000","last_active":"2024-09-12T17:38:27.338265+0000","last_peered":"2024-09-12T17:38:27.338265+0000","last_clean":"2024-09-12T17:38:27.338265+0000","last_became_active":"2024-09-12T16:58:23.711307+0000","last_became_peered":"2024-09-12T16:58:23.711307+0000","last_unstale":"2024-09-12T17:38:27.338265+0000","last_undegraded":"2024-09-12T17:38:27.338265+0000","last_fullsized":"2024-09-12T17:38:27.338265+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:54.962283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"265'268","reported_seq":833,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.274204+0000","last_change":"2024-09-12T16:58:25.737271+0000","last_active":"2024-09-12T17:41:33.274204+0000","last_peered":"2024-09-12T17:41:33.274204+0000","last_clean":"2024-09-12T17:41:33.274204+0000","last_became_active":"2024-09-12T16:58:25.736507+0000","last_became_peered":"2024-09-12T16:58:25.736507+0000","last_unstale":"2024-09-12T17:41:33.274204+0000","last_undegraded":"2024-09-12T17:41:33.274204+0000","last_fullsized":"2024-09-12T17:41:33.274204+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47073,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":450,"num_read_kb":1040,"num_write":370,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:16.284549+0000","last_change":"2024-09-12T16:58:27.741029+0000","last_active":"2024-09-12T17:37:16.284549+0000","last_peered":"2024-09-12T17:37:16.284549+0000","last_clean":"2024-09-12T17:37:16.284549+0000","last_became_active":"2024-09-12T16:58:27.740278+0000","last_became_peered":"2024-09-12T16:58:27.740278+0000","last_unstale":"2024-09-12T17:37:16.284549+0000","last_undegraded":"2024-09-12T17:37:16.284549+0000","last_fullsized":"2024-09-12T17:37:16.284549+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:39.408264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"265'124","reported_seq":655,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:01.044134+0000","last_change":"2024-09-12T16:58:29.786287+0000","last_active":"2024-09-12T17:40:01.044134+0000","last_peered":"2024-09-12T17:40:01.044134+0000","last_clean":"2024-09-12T17:40:01.044134+0000","last_became_active":"2024-09-12T16:58:29.783969+0000","last_became_peered":"2024-09-12T16:58:29.783969+0000","last_unstale":"2024-09-12T17:40:01.044134+0000","last_undegraded":"2024-09-12T17:40:01.044134+0000","last_fullsized":"2024-09-12T17:40:01.044134+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:00.910931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":564,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":235,"num_read_kb":216,"num_write":292,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"265'256","reported_seq":885,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:53.554631+0000","last_change":"2024-09-12T17:41:53.554631+0000","last_active":"2024-09-12T17:41:53.554631+0000","last_peered":"2024-09-12T17:41:53.554631+0000","last_clean":"2024-09-12T17:41:53.554631+0000","last_became_active":"2024-09-12T16:58:21.715884+0000","last_became_peered":"2024-09-12T16:58:21.715884+0000","last_unstale":"2024-09-12T17:41:53.554631+0000","last_undegraded":"2024-09-12T17:41:53.554631+0000","last_fullsized":"2024-09-12T17:41:53.554631+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'256","last_scrub_stamp":"2024-09-12T17:41:53.554435+0000","last_deep_scrub":"265'256","last_deep_scrub_stamp":"2024-09-12T17:41:53.554435+0000","last_clean_scrub_stamp":"2024-09-12T17:41:53.554435+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:12.224842+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1137,"num_read_kb":949,"num_write":435,"num_write_kb":255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"265'303","reported_seq":911,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:42.742666+0000","last_change":"2024-09-12T17:41:42.742666+0000","last_active":"2024-09-12T17:41:42.742666+0000","last_peered":"2024-09-12T17:41:42.742666+0000","last_clean":"2024-09-12T17:41:42.742666+0000","last_became_active":"2024-09-12T16:58:18.704103+0000","last_became_peered":"2024-09-12T16:58:18.704103+0000","last_unstale":"2024-09-12T17:41:42.742666+0000","last_undegraded":"2024-09-12T17:41:42.742666+0000","last_fullsized":"2024-09-12T17:41:42.742666+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'303","last_scrub_stamp":"2024-09-12T17:41:42.742464+0000","last_deep_scrub":"265'303","last_deep_scrub_stamp":"2024-09-12T17:41:42.742464+0000","last_clean_scrub_stamp":"2024-09-12T17:41:42.742464+0000","objects_scrubbed":6,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:08.956555+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":353,"num_read_kb":15361,"num_write":880,"num_write_kb":40766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:31.298508+0000","last_change":"2024-09-12T16:58:23.714514+0000","last_active":"2024-09-12T17:39:31.298508+0000","last_peered":"2024-09-12T17:39:31.298508+0000","last_clean":"2024-09-12T17:39:31.298508+0000","last_became_active":"2024-09-12T16:58:23.713731+0000","last_became_peered":"2024-09-12T16:58:23.713731+0000","last_unstale":"2024-09-12T17:39:31.298508+0000","last_undegraded":"2024-09-12T17:39:31.298508+0000","last_fullsized":"2024-09-12T17:39:31.298508+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:22.678516+0000","last_clean_scrub_stamp":"2024-09-12T16:58:22.678516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"265'224","reported_seq":782,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.923699+0000","last_change":"2024-09-12T16:58:25.728704+0000","last_active":"2024-09-12T17:41:32.923699+0000","last_peered":"2024-09-12T17:41:32.923699+0000","last_clean":"2024-09-12T17:41:32.923699+0000","last_became_active":"2024-09-12T16:58:25.727897+0000","last_became_peered":"2024-09-12T16:58:25.727897+0000","last_unstale":"2024-09-12T17:41:32.923699+0000","last_undegraded":"2024-09-12T17:41:32.923699+0000","last_fullsized":"2024-09-12T17:41:32.923699+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:09.542441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18508,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":370,"num_read_kb":886,"num_write":300,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:31.285213+0000","last_change":"2024-09-12T16:58:27.736505+0000","last_active":"2024-09-12T17:38:31.285213+0000","last_peered":"2024-09-12T17:38:31.285213+0000","last_clean":"2024-09-12T17:38:31.285213+0000","last_became_active":"2024-09-12T16:58:27.735625+0000","last_became_peered":"2024-09-12T16:58:27.735625+0000","last_unstale":"2024-09-12T17:38:31.285213+0000","last_undegraded":"2024-09-12T17:38:31.285213+0000","last_fullsized":"2024-09-12T17:38:31.285213+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:53.678377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"265'170","reported_seq":1636,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:02.955759+0000","last_change":"2024-09-12T16:58:29.797070+0000","last_active":"2024-09-12T17:40:02.955759+0000","last_peered":"2024-09-12T17:40:02.955759+0000","last_clean":"2024-09-12T17:40:02.955759+0000","last_became_active":"2024-09-12T16:58:29.796358+0000","last_became_peered":"2024-09-12T16:58:29.796358+0000","last_unstale":"2024-09-12T17:40:02.955759+0000","last_undegraded":"2024-09-12T17:40:02.955759+0000","last_fullsized":"2024-09-12T17:40:02.955759+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:36.721617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1235,"num_read_kb":1225,"num_write":375,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"265'197","reported_seq":834,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:50.652697+0000","last_change":"2024-09-12T17:41:50.652541+0000","last_active":"2024-09-12T17:41:50.652697+0000","last_peered":"2024-09-12T17:41:50.652697+0000","last_clean":"2024-09-12T17:41:50.652697+0000","last_became_active":"2024-09-12T16:58:21.730029+0000","last_became_peered":"2024-09-12T16:58:21.730029+0000","last_unstale":"2024-09-12T17:41:50.652697+0000","last_undegraded":"2024-09-12T17:41:50.652697+0000","last_fullsized":"2024-09-12T17:41:50.652697+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'197","last_scrub_stamp":"2024-09-12T17:41:50.652360+0000","last_deep_scrub":"265'197","last_deep_scrub_stamp":"2024-09-12T17:41:50.652360+0000","last_clean_scrub_stamp":"2024-09-12T17:41:50.652360+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:58.816478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":873,"num_read_kb":717,"num_write":316,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"265'367","reported_seq":1017,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:42.296900+0000","last_change":"2024-09-12T17:41:42.296900+0000","last_active":"2024-09-12T17:41:42.296900+0000","last_peered":"2024-09-12T17:41:42.296900+0000","last_clean":"2024-09-12T17:41:42.296900+0000","last_became_active":"2024-09-12T16:58:18.712291+0000","last_became_peered":"2024-09-12T16:58:18.712291+0000","last_unstale":"2024-09-12T17:41:42.296900+0000","last_undegraded":"2024-09-12T17:41:42.296900+0000","last_fullsized":"2024-09-12T17:41:42.296900+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'367","last_scrub_stamp":"2024-09-12T17:41:42.296686+0000","last_deep_scrub":"265'367","last_deep_scrub_stamp":"2024-09-12T17:41:42.296686+0000","last_clean_scrub_stamp":"2024-09-12T17:41:42.296686+0000","objects_scrubbed":8,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:53.919784+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159793,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":439,"num_read_kb":103450,"num_write":1036,"num_write_kb":48235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"265'2","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:54.380961+0000","last_change":"2024-09-12T17:41:54.380823+0000","last_active":"2024-09-12T17:41:54.380961+0000","last_peered":"2024-09-12T17:41:54.380961+0000","last_clean":"2024-09-12T17:41:54.380961+0000","last_became_active":"2024-09-12T16:58:23.724981+0000","last_became_peered":"2024-09-12T16:58:23.724981+0000","last_unstale":"2024-09-12T17:41:54.380961+0000","last_undegraded":"2024-09-12T17:41:54.380961+0000","last_fullsized":"2024-09-12T17:41:54.380961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T17:41:54.380634+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T17:41:54.380634+0000","last_clean_scrub_stamp":"2024-09-12T17:41:54.380634+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:35.697170+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"265'299","reported_seq":882,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.048848+0000","last_change":"2024-09-12T16:58:25.719753+0000","last_active":"2024-09-12T17:41:33.048848+0000","last_peered":"2024-09-12T17:41:33.048848+0000","last_clean":"2024-09-12T17:41:33.048848+0000","last_became_active":"2024-09-12T16:58:25.718962+0000","last_became_peered":"2024-09-12T16:58:25.718962+0000","last_unstale":"2024-09-12T17:41:33.048848+0000","last_undegraded":"2024-09-12T17:41:33.048848+0000","last_fullsized":"2024-09-12T17:41:33.048848+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:24.684672+0000","last_clean_scrub_stamp":"2024-09-12T16:58:24.684672+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:19.374426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46580,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":480,"num_read_kb":1058,"num_write":384,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:27.352877+0000","last_change":"2024-09-12T16:58:27.749233+0000","last_active":"2024-09-12T17:38:27.352877+0000","last_peered":"2024-09-12T17:38:27.352877+0000","last_clean":"2024-09-12T17:38:27.352877+0000","last_became_active":"2024-09-12T16:58:27.748503+0000","last_became_peered":"2024-09-12T16:58:27.748503+0000","last_unstale":"2024-09-12T17:38:27.352877+0000","last_undegraded":"2024-09-12T17:38:27.352877+0000","last_fullsized":"2024-09-12T17:38:27.352877+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:26.697649+0000","last_clean_scrub_stamp":"2024-09-12T16:58:26.697649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:00.394978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"265'150","reported_seq":645,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:23.734437+0000","last_change":"2024-09-12T16:58:29.781039+0000","last_active":"2024-09-12T17:41:23.734437+0000","last_peered":"2024-09-12T17:41:23.734437+0000","last_clean":"2024-09-12T17:41:23.734437+0000","last_became_active":"2024-09-12T16:58:29.780363+0000","last_became_peered":"2024-09-12T16:58:29.780363+0000","last_unstale":"2024-09-12T17:41:23.734437+0000","last_undegraded":"2024-09-12T17:41:23.734437+0000","last_fullsized":"2024-09-12T17:41:23.734437+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:21.350835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":838,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":195,"num_read_kb":185,"num_write":368,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"265'45","reported_seq":608,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:52.410256+0000","last_change":"2024-09-12T17:41:52.410256+0000","last_active":"2024-09-12T17:41:52.410256+0000","last_peered":"2024-09-12T17:41:52.410256+0000","last_clean":"2024-09-12T17:41:52.410256+0000","last_became_active":"2024-09-12T16:58:21.728147+0000","last_became_peered":"2024-09-12T16:58:21.728147+0000","last_unstale":"2024-09-12T17:41:52.410256+0000","last_undegraded":"2024-09-12T17:41:52.410256+0000","last_fullsized":"2024-09-12T17:41:52.410256+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'45","last_scrub_stamp":"2024-09-12T17:41:52.410037+0000","last_deep_scrub":"265'45","last_deep_scrub_stamp":"2024-09-12T17:41:52.410037+0000","last_clean_scrub_stamp":"2024-09-12T17:41:52.410037+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:59.883537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":172,"num_write":56,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"265'364","reported_seq":1017,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:42.454962+0000","last_change":"2024-09-12T17:41:42.454962+0000","last_active":"2024-09-12T17:41:42.454962+0000","last_peered":"2024-09-12T17:41:42.454962+0000","last_clean":"2024-09-12T17:41:42.454962+0000","last_became_active":"2024-09-12T16:58:18.692788+0000","last_became_peered":"2024-09-12T16:58:18.692788+0000","last_unstale":"2024-09-12T17:41:42.454962+0000","last_undegraded":"2024-09-12T17:41:42.454962+0000","last_fullsized":"2024-09-12T17:41:42.454962+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'364","last_scrub_stamp":"2024-09-12T17:41:42.454759+0000","last_deep_scrub":"265'364","last_deep_scrub_stamp":"2024-09-12T17:41:42.454759+0000","last_clean_scrub_stamp":"2024-09-12T17:41:42.454759+0000","objects_scrubbed":6,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:43.884878+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":568,"num_read_kb":2235,"num_write":1205,"num_write_kb":12634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"265'160","reported_seq":782,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:48.329394+0000","last_change":"2024-09-12T17:41:48.329394+0000","last_active":"2024-09-12T17:41:48.329394+0000","last_peered":"2024-09-12T17:41:48.329394+0000","last_clean":"2024-09-12T17:41:48.329394+0000","last_became_active":"2024-09-12T16:58:21.726882+0000","last_became_peered":"2024-09-12T16:58:21.726882+0000","last_unstale":"2024-09-12T17:41:48.329394+0000","last_undegraded":"2024-09-12T17:41:48.329394+0000","last_fullsized":"2024-09-12T17:41:48.329394+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'160","last_scrub_stamp":"2024-09-12T17:41:48.329218+0000","last_deep_scrub":"265'160","last_deep_scrub_stamp":"2024-09-12T17:41:48.329218+0000","last_clean_scrub_stamp":"2024-09-12T17:41:48.329218+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:27.518612+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":734,"num_read_kb":607,"num_write":248,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":721,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"265'496","reported_seq":1231,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:53.589804+0000","last_change":"2024-09-12T17:41:53.589804+0000","last_active":"2024-09-12T17:41:53.589804+0000","last_peered":"2024-09-12T17:41:53.589804+0000","last_clean":"2024-09-12T17:41:53.589804+0000","last_became_active":"2024-09-12T16:58:18.693764+0000","last_became_peered":"2024-09-12T16:58:18.693764+0000","last_unstale":"2024-09-12T17:41:53.589804+0000","last_undegraded":"2024-09-12T17:41:53.589804+0000","last_fullsized":"2024-09-12T17:41:53.589804+0000","mapping_epoch":23,"log_start":"265'400","ondisk_log_start":"265'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'496","last_scrub_stamp":"2024-09-12T17:41:53.589553+0000","last_deep_scrub":"265'496","last_deep_scrub_stamp":"2024-09-12T17:41:53.589553+0000","last_clean_scrub_stamp":"2024-09-12T17:41:53.589553+0000","objects_scrubbed":10,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:17.934087+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1848453,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":919,"num_read_kb":32179,"num_write":1426,"num_write_kb":32850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"265'188","reported_seq":831,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:54.669791+0000","last_change":"2024-09-12T17:41:54.669791+0000","last_active":"2024-09-12T17:41:54.669791+0000","last_peered":"2024-09-12T17:41:54.669791+0000","last_clean":"2024-09-12T17:41:54.669791+0000","last_became_active":"2024-09-12T16:58:21.716793+0000","last_became_peered":"2024-09-12T16:58:21.716793+0000","last_unstale":"2024-09-12T17:41:54.669791+0000","last_undegraded":"2024-09-12T17:41:54.669791+0000","last_fullsized":"2024-09-12T17:41:54.669791+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'188","last_scrub_stamp":"2024-09-12T17:41:54.669596+0000","last_deep_scrub":"265'188","last_deep_scrub_stamp":"2024-09-12T17:41:54.669596+0000","last_clean_scrub_stamp":"2024-09-12T17:41:54.669596+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:38.714045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":842,"num_read_kb":696,"num_write":281,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"265'387","reported_seq":1015,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:44.632383+0000","last_change":"2024-09-12T17:41:44.632383+0000","last_active":"2024-09-12T17:41:44.632383+0000","last_peered":"2024-09-12T17:41:44.632383+0000","last_clean":"2024-09-12T17:41:44.632383+0000","last_became_active":"2024-09-12T16:58:18.711667+0000","last_became_peered":"2024-09-12T16:58:18.711667+0000","last_unstale":"2024-09-12T17:41:44.632383+0000","last_undegraded":"2024-09-12T17:41:44.632383+0000","last_fullsized":"2024-09-12T17:41:44.632383+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'387","last_scrub_stamp":"2024-09-12T17:41:44.632176+0000","last_deep_scrub":"265'387","last_deep_scrub_stamp":"2024-09-12T17:41:44.632176+0000","last_clean_scrub_stamp":"2024-09-12T17:41:44.632176+0000","objects_scrubbed":8,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:18.192979+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079973,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":470,"num_read_kb":3460,"num_write":1200,"num_write_kb":27732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"265'217","reported_seq":863,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:50.375635+0000","last_change":"2024-09-12T17:41:50.375635+0000","last_active":"2024-09-12T17:41:50.375635+0000","last_peered":"2024-09-12T17:41:50.375635+0000","last_clean":"2024-09-12T17:41:50.375635+0000","last_became_active":"2024-09-12T16:58:21.713518+0000","last_became_peered":"2024-09-12T16:58:21.713518+0000","last_unstale":"2024-09-12T17:41:50.375635+0000","last_undegraded":"2024-09-12T17:41:50.375635+0000","last_fullsized":"2024-09-12T17:41:50.375635+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'217","last_scrub_stamp":"2024-09-12T17:41:50.375457+0000","last_deep_scrub":"265'217","last_deep_scrub_stamp":"2024-09-12T17:41:50.375457+0000","last_clean_scrub_stamp":"2024-09-12T17:41:50.375457+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:56.530237+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":958,"num_read_kb":791,"num_write":328,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"265'342","reported_seq":1091,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:43.287240+0000","last_change":"2024-09-12T17:41:43.287240+0000","last_active":"2024-09-12T17:41:43.287240+0000","last_peered":"2024-09-12T17:41:43.287240+0000","last_clean":"2024-09-12T17:41:43.287240+0000","last_became_active":"2024-09-12T16:58:18.711021+0000","last_became_peered":"2024-09-12T16:58:18.711021+0000","last_unstale":"2024-09-12T17:41:43.287240+0000","last_undegraded":"2024-09-12T17:41:43.287240+0000","last_fullsized":"2024-09-12T17:41:43.287240+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'342","last_scrub_stamp":"2024-09-12T17:41:43.286936+0000","last_deep_scrub":"265'342","last_deep_scrub_stamp":"2024-09-12T17:41:43.286936+0000","last_clean_scrub_stamp":"2024-09-12T17:41:43.286936+0000","objects_scrubbed":7,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:58.141097+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399320,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":801,"num_read_kb":13816,"num_write":1128,"num_write_kb":16955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"265'187","reported_seq":817,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:38.578936+0000","last_change":"2024-09-12T17:41:38.578936+0000","last_active":"2024-09-12T17:41:38.578936+0000","last_peered":"2024-09-12T17:41:38.578936+0000","last_clean":"2024-09-12T17:41:38.578936+0000","last_became_active":"2024-09-12T16:58:55.849635+0000","last_became_peered":"2024-09-12T16:58:55.849635+0000","last_unstale":"2024-09-12T17:41:38.578936+0000","last_undegraded":"2024-09-12T17:41:38.578936+0000","last_fullsized":"2024-09-12T17:41:38.578936+0000","mapping_epoch":37,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'187","last_scrub_stamp":"2024-09-12T17:41:38.578864+0000","last_deep_scrub":"265'187","last_deep_scrub_stamp":"2024-09-12T17:41:38.578864+0000","last_clean_scrub_stamp":"2024-09-12T17:41:38.578864+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:15.935562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":876,"num_read_kb":735,"num_write":297,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"265'358","reported_seq":1203,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:45.678992+0000","last_change":"2024-09-12T17:41:45.678992+0000","last_active":"2024-09-12T17:41:45.678992+0000","last_peered":"2024-09-12T17:41:45.678992+0000","last_clean":"2024-09-12T17:41:45.678992+0000","last_became_active":"2024-09-12T16:58:18.677892+0000","last_became_peered":"2024-09-12T16:58:18.677892+0000","last_unstale":"2024-09-12T17:41:45.678992+0000","last_undegraded":"2024-09-12T17:41:45.678992+0000","last_fullsized":"2024-09-12T17:41:45.678992+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'358","last_scrub_stamp":"2024-09-12T17:41:45.678772+0000","last_deep_scrub":"265'358","last_deep_scrub_stamp":"2024-09-12T17:41:45.678772+0000","last_clean_scrub_stamp":"2024-09-12T17:41:45.678772+0000","objects_scrubbed":5,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:53.062308+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3586908,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":894,"num_read_kb":13074,"num_write":1175,"num_write_kb":22747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"265'421","reported_seq":1150,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:52.679684+0000","last_change":"2024-09-12T17:41:52.679684+0000","last_active":"2024-09-12T17:41:52.679684+0000","last_peered":"2024-09-12T17:41:52.679684+0000","last_clean":"2024-09-12T17:41:52.679684+0000","last_became_active":"2024-09-12T16:58:21.729867+0000","last_became_peered":"2024-09-12T16:58:21.729867+0000","last_unstale":"2024-09-12T17:41:52.679684+0000","last_undegraded":"2024-09-12T17:41:52.679684+0000","last_fullsized":"2024-09-12T17:41:52.679684+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'421","last_scrub_stamp":"2024-09-12T17:41:52.679449+0000","last_deep_scrub":"265'421","last_deep_scrub_stamp":"2024-09-12T17:41:52.679449+0000","last_clean_scrub_stamp":"2024-09-12T17:41:52.679449+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:02.342262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1962,"num_read_kb":1662,"num_write":651,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25753,"num_omap_keys":101,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"265'370","reported_seq":1060,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:41.467435+0000","last_change":"2024-09-12T17:41:41.467284+0000","last_active":"2024-09-12T17:41:41.467435+0000","last_peered":"2024-09-12T17:41:41.467435+0000","last_clean":"2024-09-12T17:41:41.467435+0000","last_became_active":"2024-09-12T16:58:18.707110+0000","last_became_peered":"2024-09-12T16:58:18.707110+0000","last_unstale":"2024-09-12T17:41:41.467435+0000","last_undegraded":"2024-09-12T17:41:41.467435+0000","last_fullsized":"2024-09-12T17:41:41.467435+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'370","last_scrub_stamp":"2024-09-12T17:41:41.467058+0000","last_deep_scrub":"265'370","last_deep_scrub_stamp":"2024-09-12T17:41:41.467058+0000","last_clean_scrub_stamp":"2024-09-12T17:41:41.467058+0000","objects_scrubbed":8,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:00.889176+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079974,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":702,"num_read_kb":1852,"num_write":1120,"num_write_kb":24861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"265'4296","reported_seq":4999,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:01.121603+0000","last_change":"2024-09-12T16:58:55.957719+0000","last_active":"2024-09-12T17:39:01.121603+0000","last_peered":"2024-09-12T17:39:01.121603+0000","last_clean":"2024-09-12T17:39:01.121603+0000","last_became_active":"2024-09-12T16:58:55.957007+0000","last_became_peered":"2024-09-12T16:58:55.957007+0000","last_unstale":"2024-09-12T17:39:01.121603+0000","last_undegraded":"2024-09-12T17:39:01.121603+0000","last_fullsized":"2024-09-12T17:39:01.121603+0000","mapping_epoch":37,"log_start":"265'4200","ondisk_log_start":"265'4200","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":3000,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:31.973980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17379,"num_read_kb":14566,"num_write":6493,"num_write_kb":3276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"265'330","reported_seq":1043,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:43.481239+0000","last_change":"2024-09-12T17:41:43.481239+0000","last_active":"2024-09-12T17:41:43.481239+0000","last_peered":"2024-09-12T17:41:43.481239+0000","last_clean":"2024-09-12T17:41:43.481239+0000","last_became_active":"2024-09-12T16:58:18.715010+0000","last_became_peered":"2024-09-12T16:58:18.715010+0000","last_unstale":"2024-09-12T17:41:43.481239+0000","last_undegraded":"2024-09-12T17:41:43.481239+0000","last_fullsized":"2024-09-12T17:41:43.481239+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'330","last_scrub_stamp":"2024-09-12T17:41:43.480992+0000","last_deep_scrub":"265'330","last_deep_scrub_stamp":"2024-09-12T17:41:43.480992+0000","last_clean_scrub_stamp":"2024-09-12T17:41:43.480992+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:26.534765+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":628,"num_read_kb":2506,"num_write":964,"num_write_kb":15075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"265'104","reported_seq":693,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:47.465918+0000","last_change":"2024-09-12T17:41:47.465918+0000","last_active":"2024-09-12T17:41:47.465918+0000","last_peered":"2024-09-12T17:41:47.465918+0000","last_clean":"2024-09-12T17:41:47.465918+0000","last_became_active":"2024-09-12T16:58:21.720908+0000","last_became_peered":"2024-09-12T16:58:21.720908+0000","last_unstale":"2024-09-12T17:41:47.465918+0000","last_undegraded":"2024-09-12T17:41:47.465918+0000","last_fullsized":"2024-09-12T17:41:47.465918+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'104","last_scrub_stamp":"2024-09-12T17:41:47.465734+0000","last_deep_scrub":"265'104","last_deep_scrub_stamp":"2024-09-12T17:41:47.465734+0000","last_clean_scrub_stamp":"2024-09-12T17:41:47.465734+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:02.185124+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":432,"num_read_kb":360,"num_write":161,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"265'394","reported_seq":1124,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:43.705321+0000","last_change":"2024-09-12T17:41:43.705321+0000","last_active":"2024-09-12T17:41:43.705321+0000","last_peered":"2024-09-12T17:41:43.705321+0000","last_clean":"2024-09-12T17:41:43.705321+0000","last_became_active":"2024-09-12T16:58:18.680305+0000","last_became_peered":"2024-09-12T16:58:18.680305+0000","last_unstale":"2024-09-12T17:41:43.705321+0000","last_undegraded":"2024-09-12T17:41:43.705321+0000","last_fullsized":"2024-09-12T17:41:43.705321+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'394","last_scrub_stamp":"2024-09-12T17:41:43.705097+0000","last_deep_scrub":"265'394","last_deep_scrub_stamp":"2024-09-12T17:41:43.705097+0000","last_clean_scrub_stamp":"2024-09-12T17:41:43.705097+0000","objects_scrubbed":7,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:48.384452+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263201,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":688,"num_read_kb":33513,"num_write":1376,"num_write_kb":33353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"265'175","reported_seq":800,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:53.039664+0000","last_change":"2024-09-12T17:41:53.039664+0000","last_active":"2024-09-12T17:41:53.039664+0000","last_peered":"2024-09-12T17:41:53.039664+0000","last_clean":"2024-09-12T17:41:53.039664+0000","last_became_active":"2024-09-12T16:58:21.713765+0000","last_became_peered":"2024-09-12T16:58:21.713765+0000","last_unstale":"2024-09-12T17:41:53.039664+0000","last_undegraded":"2024-09-12T17:41:53.039664+0000","last_fullsized":"2024-09-12T17:41:53.039664+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'175","last_scrub_stamp":"2024-09-12T17:41:53.039428+0000","last_deep_scrub":"265'175","last_deep_scrub_stamp":"2024-09-12T17:41:53.039428+0000","last_clean_scrub_stamp":"2024-09-12T17:41:53.039428+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:20.616593+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":769,"num_read_kb":637,"num_write":246,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"265'374","reported_seq":1032,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:46.639986+0000","last_change":"2024-09-12T17:41:46.639869+0000","last_active":"2024-09-12T17:41:46.639986+0000","last_peered":"2024-09-12T17:41:46.639986+0000","last_clean":"2024-09-12T17:41:46.639986+0000","last_became_active":"2024-09-12T16:58:18.713629+0000","last_became_peered":"2024-09-12T16:58:18.713629+0000","last_unstale":"2024-09-12T17:41:46.639986+0000","last_undegraded":"2024-09-12T17:41:46.639986+0000","last_fullsized":"2024-09-12T17:41:46.639986+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'374","last_scrub_stamp":"2024-09-12T17:41:46.639653+0000","last_deep_scrub":"265'374","last_deep_scrub_stamp":"2024-09-12T17:41:46.639653+0000","last_clean_scrub_stamp":"2024-09-12T17:41:46.639653+0000","objects_scrubbed":9,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:07.696868+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1369511,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":530,"num_read_kb":40377,"num_write":1157,"num_write_kb":39449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"265'158","reported_seq":736,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:54.669213+0000","last_change":"2024-09-12T17:41:54.669213+0000","last_active":"2024-09-12T17:41:54.669213+0000","last_peered":"2024-09-12T17:41:54.669213+0000","last_clean":"2024-09-12T17:41:54.669213+0000","last_became_active":"2024-09-12T16:58:21.718980+0000","last_became_peered":"2024-09-12T16:58:21.718980+0000","last_unstale":"2024-09-12T17:41:54.669213+0000","last_undegraded":"2024-09-12T17:41:54.669213+0000","last_fullsized":"2024-09-12T17:41:54.669213+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'158","last_scrub_stamp":"2024-09-12T17:41:54.668917+0000","last_deep_scrub":"265'158","last_deep_scrub_stamp":"2024-09-12T17:41:54.668917+0000","last_clean_scrub_stamp":"2024-09-12T17:41:54.668917+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:44.886998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":669,"num_read_kb":540,"num_write":242,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"265'388","reported_seq":1080,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:51.554602+0000","last_change":"2024-09-12T17:41:51.554602+0000","last_active":"2024-09-12T17:41:51.554602+0000","last_peered":"2024-09-12T17:41:51.554602+0000","last_clean":"2024-09-12T17:41:51.554602+0000","last_became_active":"2024-09-12T16:58:18.678270+0000","last_became_peered":"2024-09-12T16:58:18.678270+0000","last_unstale":"2024-09-12T17:41:51.554602+0000","last_undegraded":"2024-09-12T17:41:51.554602+0000","last_fullsized":"2024-09-12T17:41:51.554602+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'388","last_scrub_stamp":"2024-09-12T17:41:51.554411+0000","last_deep_scrub":"265'388","last_deep_scrub_stamp":"2024-09-12T17:41:51.554411+0000","last_clean_scrub_stamp":"2024-09-12T17:41:51.554411+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:05.022058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":570,"num_read_kb":53855,"num_write":1232,"num_write_kb":47481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"265'252","reported_seq":879,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:42.524940+0000","last_change":"2024-09-12T17:41:42.524940+0000","last_active":"2024-09-12T17:41:42.524940+0000","last_peered":"2024-09-12T17:41:42.524940+0000","last_clean":"2024-09-12T17:41:42.524940+0000","last_became_active":"2024-09-12T16:58:21.729301+0000","last_became_peered":"2024-09-12T16:58:21.729301+0000","last_unstale":"2024-09-12T17:41:42.524940+0000","last_undegraded":"2024-09-12T17:41:42.524940+0000","last_fullsized":"2024-09-12T17:41:42.524940+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'252","last_scrub_stamp":"2024-09-12T17:41:42.524765+0000","last_deep_scrub":"265'252","last_deep_scrub_stamp":"2024-09-12T17:41:42.524765+0000","last_clean_scrub_stamp":"2024-09-12T17:41:42.524765+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:58.178842+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1107,"num_read_kb":902,"num_write":427,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"265'448","reported_seq":1129,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:45.590167+0000","last_change":"2024-09-12T17:41:45.590167+0000","last_active":"2024-09-12T17:41:45.590167+0000","last_peered":"2024-09-12T17:41:45.590167+0000","last_clean":"2024-09-12T17:41:45.590167+0000","last_became_active":"2024-09-12T16:58:18.719658+0000","last_became_peered":"2024-09-12T16:58:18.719658+0000","last_unstale":"2024-09-12T17:41:45.590167+0000","last_undegraded":"2024-09-12T17:41:45.590167+0000","last_fullsized":"2024-09-12T17:41:45.590167+0000","mapping_epoch":23,"log_start":"265'400","ondisk_log_start":"265'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'448","last_scrub_stamp":"2024-09-12T17:41:45.589925+0000","last_deep_scrub":"265'448","last_deep_scrub_stamp":"2024-09-12T17:41:45.589925+0000","last_clean_scrub_stamp":"2024-09-12T17:41:45.589925+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:39.534937+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170320,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":708,"num_read_kb":15766,"num_write":1393,"num_write_kb":33267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"265'203","reported_seq":847,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:53.694005+0000","last_change":"2024-09-12T17:41:53.694005+0000","last_active":"2024-09-12T17:41:53.694005+0000","last_peered":"2024-09-12T17:41:53.694005+0000","last_clean":"2024-09-12T17:41:53.694005+0000","last_became_active":"2024-09-12T16:58:21.730589+0000","last_became_peered":"2024-09-12T16:58:21.730589+0000","last_unstale":"2024-09-12T17:41:53.694005+0000","last_undegraded":"2024-09-12T17:41:53.694005+0000","last_fullsized":"2024-09-12T17:41:53.694005+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'203","last_scrub_stamp":"2024-09-12T17:41:53.693830+0000","last_deep_scrub":"265'203","last_deep_scrub_stamp":"2024-09-12T17:41:53.693830+0000","last_clean_scrub_stamp":"2024-09-12T17:41:53.693830+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:02.739000+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":887,"num_read_kb":736,"num_write":325,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"265'366","reported_seq":1041,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:45.233630+0000","last_change":"2024-09-12T17:41:45.233630+0000","last_active":"2024-09-12T17:41:45.233630+0000","last_peered":"2024-09-12T17:41:45.233630+0000","last_clean":"2024-09-12T17:41:45.233630+0000","last_became_active":"2024-09-12T16:58:18.691716+0000","last_became_peered":"2024-09-12T16:58:18.691716+0000","last_unstale":"2024-09-12T17:41:45.233630+0000","last_undegraded":"2024-09-12T17:41:45.233630+0000","last_fullsized":"2024-09-12T17:41:45.233630+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'366","last_scrub_stamp":"2024-09-12T17:41:45.233427+0000","last_deep_scrub":"265'366","last_deep_scrub_stamp":"2024-09-12T17:41:45.233427+0000","last_clean_scrub_stamp":"2024-09-12T17:41:45.233427+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:39.091059+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":528,"num_read_kb":37415,"num_write":1121,"num_write_kb":27973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"265'333","reported_seq":946,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:54.648323+0000","last_change":"2024-09-12T17:41:54.648323+0000","last_active":"2024-09-12T17:41:54.648323+0000","last_peered":"2024-09-12T17:41:54.648323+0000","last_clean":"2024-09-12T17:41:54.648323+0000","last_became_active":"2024-09-12T16:58:21.722380+0000","last_became_peered":"2024-09-12T16:58:21.722380+0000","last_unstale":"2024-09-12T17:41:54.648323+0000","last_undegraded":"2024-09-12T17:41:54.648323+0000","last_fullsized":"2024-09-12T17:41:54.648323+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'333","last_scrub_stamp":"2024-09-12T17:41:54.648087+0000","last_deep_scrub":"265'333","last_deep_scrub_stamp":"2024-09-12T17:41:54.648087+0000","last_clean_scrub_stamp":"2024-09-12T17:41:54.648087+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:12.851283+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1422,"num_read_kb":1143,"num_write":550,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"265'349","reported_seq":1023,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:48.502516+0000","last_change":"2024-09-12T17:41:48.502516+0000","last_active":"2024-09-12T17:41:48.502516+0000","last_peered":"2024-09-12T17:41:48.502516+0000","last_clean":"2024-09-12T17:41:48.502516+0000","last_became_active":"2024-09-12T16:58:18.709090+0000","last_became_peered":"2024-09-12T16:58:18.709090+0000","last_unstale":"2024-09-12T17:41:48.502516+0000","last_undegraded":"2024-09-12T17:41:48.502516+0000","last_fullsized":"2024-09-12T17:41:48.502516+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'349","last_scrub_stamp":"2024-09-12T17:41:48.502301+0000","last_deep_scrub":"265'349","last_deep_scrub_stamp":"2024-09-12T17:41:48.502301+0000","last_clean_scrub_stamp":"2024-09-12T17:41:48.502301+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:56.806960+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289348,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":537,"num_read_kb":42087,"num_write":1134,"num_write_kb":38244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"265'160","reported_seq":776,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:52.084538+0000","last_change":"2024-09-12T17:41:52.084538+0000","last_active":"2024-09-12T17:41:52.084538+0000","last_peered":"2024-09-12T17:41:52.084538+0000","last_clean":"2024-09-12T17:41:52.084538+0000","last_became_active":"2024-09-12T16:58:21.725262+0000","last_became_peered":"2024-09-12T16:58:21.725262+0000","last_unstale":"2024-09-12T17:41:52.084538+0000","last_undegraded":"2024-09-12T17:41:52.084538+0000","last_fullsized":"2024-09-12T17:41:52.084538+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'160","last_scrub_stamp":"2024-09-12T17:41:52.084334+0000","last_deep_scrub":"265'160","last_deep_scrub_stamp":"2024-09-12T17:41:52.084334+0000","last_clean_scrub_stamp":"2024-09-12T17:41:52.084334+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:02:11.578223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":648,"num_read_kb":538,"num_write":222,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"265'356","reported_seq":1033,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:52.569090+0000","last_change":"2024-09-12T17:41:52.569090+0000","last_active":"2024-09-12T17:41:52.569090+0000","last_peered":"2024-09-12T17:41:52.569090+0000","last_clean":"2024-09-12T17:41:52.569090+0000","last_became_active":"2024-09-12T16:58:18.713131+0000","last_became_peered":"2024-09-12T16:58:18.713131+0000","last_unstale":"2024-09-12T17:41:52.569090+0000","last_undegraded":"2024-09-12T17:41:52.569090+0000","last_fullsized":"2024-09-12T17:41:52.569090+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'356","last_scrub_stamp":"2024-09-12T17:41:52.568904+0000","last_deep_scrub":"265'356","last_deep_scrub_stamp":"2024-09-12T17:41:52.568904+0000","last_clean_scrub_stamp":"2024-09-12T17:41:52.568904+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:36.659748+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254228,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":564,"num_read_kb":4620,"num_write":1119,"num_write_kb":30053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"265'101","reported_seq":696,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:49.682303+0000","last_change":"2024-09-12T16:58:21.695497+0000","last_active":"2024-09-12T17:39:49.682303+0000","last_peered":"2024-09-12T17:39:49.682303+0000","last_clean":"2024-09-12T17:39:49.682303+0000","last_became_active":"2024-09-12T16:58:21.693930+0000","last_became_peered":"2024-09-12T16:58:21.693930+0000","last_unstale":"2024-09-12T17:39:49.682303+0000","last_undegraded":"2024-09-12T17:39:49.682303+0000","last_fullsized":"2024-09-12T17:39:49.682303+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:20.666400+0000","last_clean_scrub_stamp":"2024-09-12T16:58:20.666400+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:50.200124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":454,"num_read_kb":382,"num_write":143,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"265'358","reported_seq":1006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:41.572498+0000","last_change":"2024-09-12T17:41:41.572498+0000","last_active":"2024-09-12T17:41:41.572498+0000","last_peered":"2024-09-12T17:41:41.572498+0000","last_clean":"2024-09-12T17:41:41.572498+0000","last_became_active":"2024-09-12T16:58:18.704118+0000","last_became_peered":"2024-09-12T16:58:18.704118+0000","last_unstale":"2024-09-12T17:41:41.572498+0000","last_undegraded":"2024-09-12T17:41:41.572498+0000","last_fullsized":"2024-09-12T17:41:41.572498+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'358","last_scrub_stamp":"2024-09-12T17:41:41.572292+0000","last_deep_scrub":"265'358","last_deep_scrub_stamp":"2024-09-12T17:41:41.572292+0000","last_clean_scrub_stamp":"2024-09-12T17:41:41.572292+0000","objects_scrubbed":8,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:25.803929+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079958,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":546,"num_read_kb":7376,"num_write":1271,"num_write_kb":14643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"265'376","reported_seq":975,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:51.551645+0000","last_change":"2024-09-12T17:41:51.551645+0000","last_active":"2024-09-12T17:41:51.551645+0000","last_peered":"2024-09-12T17:41:51.551645+0000","last_clean":"2024-09-12T17:41:51.551645+0000","last_became_active":"2024-09-12T16:58:21.714554+0000","last_became_peered":"2024-09-12T16:58:21.714554+0000","last_unstale":"2024-09-12T17:41:51.551645+0000","last_undegraded":"2024-09-12T17:41:51.551645+0000","last_fullsized":"2024-09-12T17:41:51.551645+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'376","last_scrub_stamp":"2024-09-12T17:41:51.551368+0000","last_deep_scrub":"265'376","last_deep_scrub_stamp":"2024-09-12T17:41:51.551368+0000","last_clean_scrub_stamp":"2024-09-12T17:41:51.551368+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:23.069379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1689,"num_read_kb":1453,"num_write":661,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"265'390","reported_seq":1106,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:48.614895+0000","last_change":"2024-09-12T17:41:48.614895+0000","last_active":"2024-09-12T17:41:48.614895+0000","last_peered":"2024-09-12T17:41:48.614895+0000","last_clean":"2024-09-12T17:41:48.614895+0000","last_became_active":"2024-09-12T16:58:18.719691+0000","last_became_peered":"2024-09-12T16:58:18.719691+0000","last_unstale":"2024-09-12T17:41:48.614895+0000","last_undegraded":"2024-09-12T17:41:48.614895+0000","last_fullsized":"2024-09-12T17:41:48.614895+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'390","last_scrub_stamp":"2024-09-12T17:41:48.614702+0000","last_deep_scrub":"265'390","last_deep_scrub_stamp":"2024-09-12T17:41:48.614702+0000","last_clean_scrub_stamp":"2024-09-12T17:41:48.614702+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:01.712719+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":758,"num_read_kb":7681,"num_write":1308,"num_write_kb":23567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"265'356","reported_seq":1016,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:50.628413+0000","last_change":"2024-09-12T17:41:50.628413+0000","last_active":"2024-09-12T17:41:50.628413+0000","last_peered":"2024-09-12T17:41:50.628413+0000","last_clean":"2024-09-12T17:41:50.628413+0000","last_became_active":"2024-09-12T16:58:18.698393+0000","last_became_peered":"2024-09-12T16:58:18.698393+0000","last_unstale":"2024-09-12T17:41:50.628413+0000","last_undegraded":"2024-09-12T17:41:50.628413+0000","last_fullsized":"2024-09-12T17:41:50.628413+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'356","last_scrub_stamp":"2024-09-12T17:41:50.628167+0000","last_deep_scrub":"265'356","last_deep_scrub_stamp":"2024-09-12T17:41:50.628167+0000","last_clean_scrub_stamp":"2024-09-12T17:41:50.628167+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:03.341903+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":536,"num_read_kb":34677,"num_write":1126,"num_write_kb":53307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"265'106","reported_seq":693,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:56.027469+0000","last_change":"2024-09-12T17:41:56.027469+0000","last_active":"2024-09-12T17:41:56.027469+0000","last_peered":"2024-09-12T17:41:56.027469+0000","last_clean":"2024-09-12T17:41:56.027469+0000","last_became_active":"2024-09-12T16:58:21.714240+0000","last_became_peered":"2024-09-12T16:58:21.714240+0000","last_unstale":"2024-09-12T17:41:56.027469+0000","last_undegraded":"2024-09-12T17:41:56.027469+0000","last_fullsized":"2024-09-12T17:41:56.027469+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'106","last_scrub_stamp":"2024-09-12T17:41:56.027242+0000","last_deep_scrub":"265'106","last_deep_scrub_stamp":"2024-09-12T17:41:56.027242+0000","last_clean_scrub_stamp":"2024-09-12T17:41:56.027242+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:14.917329+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":476,"num_read_kb":394,"num_write":172,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"265'366","reported_seq":1053,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:43.412364+0000","last_change":"2024-09-12T17:41:43.412364+0000","last_active":"2024-09-12T17:41:43.412364+0000","last_peered":"2024-09-12T17:41:43.412364+0000","last_clean":"2024-09-12T17:41:43.412364+0000","last_became_active":"2024-09-12T16:58:18.707649+0000","last_became_peered":"2024-09-12T16:58:18.707649+0000","last_unstale":"2024-09-12T17:41:43.412364+0000","last_undegraded":"2024-09-12T17:41:43.412364+0000","last_fullsized":"2024-09-12T17:41:43.412364+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'366","last_scrub_stamp":"2024-09-12T17:41:43.412171+0000","last_deep_scrub":"265'366","last_deep_scrub_stamp":"2024-09-12T17:41:43.412171+0000","last_clean_scrub_stamp":"2024-09-12T17:41:43.412171+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:07.821353+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":580,"num_read_kb":14659,"num_write":1122,"num_write_kb":33951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"265'4160","reported_seq":4803,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:56.630467+0000","last_change":"2024-09-12T17:41:56.630467+0000","last_active":"2024-09-12T17:41:56.630467+0000","last_peered":"2024-09-12T17:41:56.630467+0000","last_clean":"2024-09-12T17:41:56.630467+0000","last_became_active":"2024-09-12T16:58:21.718537+0000","last_became_peered":"2024-09-12T16:58:21.718537+0000","last_unstale":"2024-09-12T17:41:56.630467+0000","last_undegraded":"2024-09-12T17:41:56.630467+0000","last_fullsized":"2024-09-12T17:41:56.630467+0000","mapping_epoch":26,"log_start":"265'4100","ondisk_log_start":"265'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4160","last_scrub_stamp":"2024-09-12T17:41:56.630278+0000","last_deep_scrub":"265'4160","last_deep_scrub_stamp":"2024-09-12T17:41:56.630278+0000","last_clean_scrub_stamp":"2024-09-12T17:41:56.630278+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":3000,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:59.447977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16773,"num_read_kb":14078,"num_write":6250,"num_write_kb":3119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6189,"num_read_kb":4469,"num_write":2002,"num_write_kb":899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":974,"ondisk_log_size":974,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15645,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":16183,"num_read_kb":15867,"num_write":16715,"num_write_kb":4878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1753,"ondisk_log_size":1753,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":509,"ondisk_log_size":509,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1598421,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":17353,"num_read_kb":36703,"num_write":14501,"num_write_kb":11559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1944,"ondisk_log_size":1944,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2412,"num_read_kb":2875,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":102570,"num_read_kb":85739,"num_write":37214,"num_write_kb":18735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":44104,"num_omap_keys":178,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4270,"ondisk_log_size":4270,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":74886563,"num_objects":371,"num_object_clones":0,"num_object_copies":742,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":371,"num_whiteouts":0,"num_read":36323,"num_read_kb":1886569,"num_write":72643,"num_write_kb":2069560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":151003136,"data_stored":149773126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3656,"ondisk_log_size":3656,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":211125,"num_write":190,"num_write_kb":136313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1087,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":198791,"num_write":190,"num_write_kb":136313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509972,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":166036,"kb_used_data":36356,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94205804,"statfs":{"total":96636764160,"available":96466743296,"internally_reserved":0,"allocated":37228544,"data_stored":35444692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132774341},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509971,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":275144,"kb_used_data":27384,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":94096696,"statfs":{"total":96636764160,"available":96355016704,"internally_reserved":0,"allocated":28041216,"data_stored":26261645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":253688263},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509976,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110480,"kb_used_data":11328,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94261360,"statfs":{"total":96636764160,"available":96523632640,"internally_reserved":0,"allocated":11599872,"data_stored":9988574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509971,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280168,"kb_used_data":32472,"kb_used_omap":1,"kb_used_meta":247678,"kb_avail":94091672,"statfs":{"total":96636764160,"available":96349872128,"internally_reserved":0,"allocated":33251328,"data_stored":31541637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":253622725},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542676,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":254076,"kb_used_data":16044,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94117764,"statfs":{"total":96636764160,"available":96376590336,"internally_reserved":0,"allocated":16429056,"data_stored":14715336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":243726795},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542677,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":229016,"kb_used_data":17352,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":94142824,"statfs":{"total":96636764160,"available":96402251776,"internally_reserved":0,"allocated":17768448,"data_stored":16188165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":216725958},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542675,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":115204,"kb_used_data":25780,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94256636,"statfs":{"total":96636764160,"available":96518795264,"internally_reserved":0,"allocated":26398720,"data_stored":24782410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575379,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72276,"kb_used_data":10564,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94299564,"statfs":{"total":96636764160,"available":96562753536,"internally_reserved":0,"allocated":10817536,"data_stored":9242321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,2,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28966912,"data_stored":28798943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7954432,"data_stored":7838758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":7192576,"data_stored":7091940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24338432,"data_stored":24108487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":22761472,"data_stored":22631077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":33509376,"data_stored":33292137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14131200,"data_stored":14038127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12148736,"data_stored":11973657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":5371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":5873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:42:00.837 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.838 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.838 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.838 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.838 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.838 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.838 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.838 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.838 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.839 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.839 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.839 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.839 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.839 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.839 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.839 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.839 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.839 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.840 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.840 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.840 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.840 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.840 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.840 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.840 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.840 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.840 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.841 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.841 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.841 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.841 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.841 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.841 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.841 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.841 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.841 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.842 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.842 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.842 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.842 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.842 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.842 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.842 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.842 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.842 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.843 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.843 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.843 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.843 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.843 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.843 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.843 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.843 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.843 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.844 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.844 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.844 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.844 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.844 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.844 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.844 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.844 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.844 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.845 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.845 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.845 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.845 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.845 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.845 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.845 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.845 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.845 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.846 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.846 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.846 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.846 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.846 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.846 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.846 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.846 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.846 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.846 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.847 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.847 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.847 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.847 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.847 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.847 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.847 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.847 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.847 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.848 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.848 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.848 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.848 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.848 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.848 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.848 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.848 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.848 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.849 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.849 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.849 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.849 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.849 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.849 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.849 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.849 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.849 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.850 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.850 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.850 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.850 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.850 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.850 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.850 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.850 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.850 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.851 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.851 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.851 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.851 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.851 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.851 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.851 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.851 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.851 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.851 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.852 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.852 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.852 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.852 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.852 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.852 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.853 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.853 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.853 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.853 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.853 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.853 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.853 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.853 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.854 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.854 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.854 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.854 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.854 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.854 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.854 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.854 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.855 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.855 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.855 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.855 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.855 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.855 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.855 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.855 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.855 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.856 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.856 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.856 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.856 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.856 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.856 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.856 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.857 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.857 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.857 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.857 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.857 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.857 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.857 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.857 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.858 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.858 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.858 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.858 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.858 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.858 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.858 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.858 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.859 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.859 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.859 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.859 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.859 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.859 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.859 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.859 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.860 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.860 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.860 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.860 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.860 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.860 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.860 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.860 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.861 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.861 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.861 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.861 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.861 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.861 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.861 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.861 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.862 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.862 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.862 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.862 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.862 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.862 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.862 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.862 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.862 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.863 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.863 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.863 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.863 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.863 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.863 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.863 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.863 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.864 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.864 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.864 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.864 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.864 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.864 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.864 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.864 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.865 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.865 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.865 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.865 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.865 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T16:58:22.678516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.865 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.865 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.865 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.865 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T16:58:24.684672+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.866 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T16:58:26.697649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.866 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.866 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.866 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T16:58:20.666400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:00.866 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T17:42:20.868 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:42:21.239 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:42:21.256 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-09-12T17:42:21.271 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":1587,"stamp":"2024-09-12T17:42:19.826769+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":77092809,"num_objects":701,"num_object_clones":0,"num_object_copies":1402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":701,"num_whiteouts":0,"num_read":181455,"num_read_kb":2442205,"num_write":143598,"num_write_kb":2379913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1087,"num_keys_recovered":0,"num_objects_omap":62,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":734012,"num_omap_keys":1768,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13426,"ondisk_log_size":13426,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1519040,"kb_used_data":177280,"kb_used_omap":12,"kb_used_meta":1341619,"kb_avail":753455680,"statfs":{"total":773094113280,"available":771538616320,"internally_reserved":0,"allocated":181534720,"data_stored":168164780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1373818417},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":37618,"num_omap_keys":100,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.010344"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:47.356377+0000","last_change":"2024-09-12T17:27:17.404693+0000","last_active":"2024-09-12T17:39:47.356377+0000","last_peered":"2024-09-12T17:39:47.356377+0000","last_clean":"2024-09-12T17:39:47.356377+0000","last_became_active":"2024-09-12T17:27:17.403833+0000","last_became_peered":"2024-09-12T17:27:17.403833+0000","last_unstale":"2024-09-12T17:39:47.356377+0000","last_undegraded":"2024-09-12T17:39:47.356377+0000","last_fullsized":"2024-09-12T17:39:47.356377+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"265'5","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:42.368823+0000","last_change":"2024-09-12T17:15:43.159517+0000","last_active":"2024-09-12T17:40:42.368823+0000","last_peered":"2024-09-12T17:40:42.368823+0000","last_clean":"2024-09-12T17:40:42.368823+0000","last_became_active":"2024-09-12T17:15:43.158714+0000","last_became_peered":"2024-09-12T17:15:43.158714+0000","last_unstale":"2024-09-12T17:40:42.368823+0000","last_undegraded":"2024-09-12T17:40:42.368823+0000","last_fullsized":"2024-09-12T17:40:42.368823+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:19.068813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"262'2","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:12.353310+0000","last_change":"2024-09-12T17:15:40.126960+0000","last_active":"2024-09-12T17:38:12.353310+0000","last_peered":"2024-09-12T17:38:12.353310+0000","last_clean":"2024-09-12T17:38:12.353310+0000","last_became_active":"2024-09-12T17:15:40.126170+0000","last_became_peered":"2024-09-12T17:15:40.126170+0000","last_unstale":"2024-09-12T17:38:12.353310+0000","last_undegraded":"2024-09-12T17:38:12.353310+0000","last_fullsized":"2024-09-12T17:38:12.353310+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:57.038622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"265'24","reported_seq":111,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:57.361076+0000","last_change":"2024-09-12T17:13:54.846274+0000","last_active":"2024-09-12T17:38:57.361076+0000","last_peered":"2024-09-12T17:38:57.361076+0000","last_clean":"2024-09-12T17:38:57.361076+0000","last_became_active":"2024-09-12T17:13:54.845556+0000","last_became_peered":"2024-09-12T17:13:54.845556+0000","last_unstale":"2024-09-12T17:38:57.361076+0000","last_undegraded":"2024-09-12T17:38:57.361076+0000","last_fullsized":"2024-09-12T17:38:57.361076+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:34.627718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":82,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":26,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:08.597905+0000","last_change":"2024-09-12T17:42:08.597905+0000","last_active":"2024-09-12T17:42:08.597905+0000","last_peered":"2024-09-12T17:42:08.597905+0000","last_clean":"2024-09-12T17:42:08.597905+0000","last_became_active":"2024-09-12T17:27:17.421771+0000","last_became_peered":"2024-09-12T17:27:17.421771+0000","last_unstale":"2024-09-12T17:42:08.597905+0000","last_undegraded":"2024-09-12T17:42:08.597905+0000","last_fullsized":"2024-09-12T17:42:08.597905+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:08.597697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:08.597697+0000","last_clean_scrub_stamp":"2024-09-12T17:42:08.597697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:18.561900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:16.281883+0000","last_change":"2024-09-12T17:15:43.160447+0000","last_active":"2024-09-12T17:38:16.281883+0000","last_peered":"2024-09-12T17:38:16.281883+0000","last_clean":"2024-09-12T17:38:16.281883+0000","last_became_active":"2024-09-12T17:15:43.159316+0000","last_became_peered":"2024-09-12T17:15:43.159316+0000","last_unstale":"2024-09-12T17:38:16.281883+0000","last_undegraded":"2024-09-12T17:38:16.281883+0000","last_fullsized":"2024-09-12T17:38:16.281883+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:44.109670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"265'7","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:12.481578+0000","last_change":"2024-09-12T17:42:12.481578+0000","last_active":"2024-09-12T17:42:12.481578+0000","last_peered":"2024-09-12T17:42:12.481578+0000","last_clean":"2024-09-12T17:42:12.481578+0000","last_became_active":"2024-09-12T17:15:40.126087+0000","last_became_peered":"2024-09-12T17:15:40.126087+0000","last_unstale":"2024-09-12T17:42:12.481578+0000","last_undegraded":"2024-09-12T17:42:12.481578+0000","last_fullsized":"2024-09-12T17:42:12.481578+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T17:42:12.481394+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T17:42:12.481394+0000","last_clean_scrub_stamp":"2024-09-12T17:42:12.481394+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:23.055774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":1026,"num_write":12,"num_write_kb":5122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"265'36","reported_seq":153,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:01.717471+0000","last_change":"2024-09-12T17:42:01.717471+0000","last_active":"2024-09-12T17:42:01.717471+0000","last_peered":"2024-09-12T17:42:01.717471+0000","last_clean":"2024-09-12T17:42:01.717471+0000","last_became_active":"2024-09-12T17:13:54.837820+0000","last_became_peered":"2024-09-12T17:13:54.837820+0000","last_unstale":"2024-09-12T17:42:01.717471+0000","last_undegraded":"2024-09-12T17:42:01.717471+0000","last_fullsized":"2024-09-12T17:42:01.717471+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'36","last_scrub_stamp":"2024-09-12T17:42:01.717290+0000","last_deep_scrub":"265'36","last_deep_scrub_stamp":"2024-09-12T17:42:01.717290+0000","last_clean_scrub_stamp":"2024-09-12T17:42:01.717290+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:58.550806+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":180,"num_read_kb":123,"num_write":74,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:16.273609+0000","last_change":"2024-09-12T17:42:16.273609+0000","last_active":"2024-09-12T17:42:16.273609+0000","last_peered":"2024-09-12T17:42:16.273609+0000","last_clean":"2024-09-12T17:42:16.273609+0000","last_became_active":"2024-09-12T17:27:17.405657+0000","last_became_peered":"2024-09-12T17:27:17.405657+0000","last_unstale":"2024-09-12T17:42:16.273609+0000","last_undegraded":"2024-09-12T17:42:16.273609+0000","last_fullsized":"2024-09-12T17:42:16.273609+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:16.273412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:16.273412+0000","last_clean_scrub_stamp":"2024-09-12T17:42:16.273412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:31.670331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:37.355505+0000","last_change":"2024-09-12T17:15:43.869720+0000","last_active":"2024-09-12T17:38:37.355505+0000","last_peered":"2024-09-12T17:38:37.355505+0000","last_clean":"2024-09-12T17:38:37.355505+0000","last_became_active":"2024-09-12T17:15:43.868960+0000","last_became_peered":"2024-09-12T17:15:43.868960+0000","last_unstale":"2024-09-12T17:38:37.355505+0000","last_undegraded":"2024-09-12T17:38:37.355505+0000","last_fullsized":"2024-09-12T17:38:37.355505+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:01.285114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"262'2","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:03.638699+0000","last_change":"2024-09-12T17:42:03.638699+0000","last_active":"2024-09-12T17:42:03.638699+0000","last_peered":"2024-09-12T17:42:03.638699+0000","last_clean":"2024-09-12T17:42:03.638699+0000","last_became_active":"2024-09-12T17:15:40.134513+0000","last_became_peered":"2024-09-12T17:15:40.134513+0000","last_unstale":"2024-09-12T17:42:03.638699+0000","last_undegraded":"2024-09-12T17:42:03.638699+0000","last_fullsized":"2024-09-12T17:42:03.638699+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T17:42:03.638514+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T17:42:03.638514+0000","last_clean_scrub_stamp":"2024-09-12T17:42:03.638514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:14.324547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"265'19","reported_seq":94,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:57.360940+0000","last_change":"2024-09-12T17:13:54.827570+0000","last_active":"2024-09-12T17:38:57.360940+0000","last_peered":"2024-09-12T17:38:57.360940+0000","last_clean":"2024-09-12T17:38:57.360940+0000","last_became_active":"2024-09-12T17:13:54.826480+0000","last_became_peered":"2024-09-12T17:13:54.826480+0000","last_unstale":"2024-09-12T17:38:57.360940+0000","last_undegraded":"2024-09-12T17:38:57.360940+0000","last_fullsized":"2024-09-12T17:38:57.360940+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:09.477709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:27.371439+0000","last_change":"2024-09-12T17:27:17.419282+0000","last_active":"2024-09-12T17:39:27.371439+0000","last_peered":"2024-09-12T17:39:27.371439+0000","last_clean":"2024-09-12T17:39:27.371439+0000","last_became_active":"2024-09-12T17:27:17.418519+0000","last_became_peered":"2024-09-12T17:27:17.418519+0000","last_unstale":"2024-09-12T17:39:27.371439+0000","last_undegraded":"2024-09-12T17:39:27.371439+0000","last_fullsized":"2024-09-12T17:39:27.371439+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"265'2","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.775211+0000","last_change":"2024-09-12T17:15:43.869355+0000","last_active":"2024-09-12T17:41:32.775211+0000","last_peered":"2024-09-12T17:41:32.775211+0000","last_clean":"2024-09-12T17:41:32.775211+0000","last_became_active":"2024-09-12T17:15:43.868600+0000","last_became_peered":"2024-09-12T17:15:43.868600+0000","last_unstale":"2024-09-12T17:41:32.775211+0000","last_undegraded":"2024-09-12T17:41:32.775211+0000","last_fullsized":"2024-09-12T17:41:32.775211+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"262'3","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:36.286516+0000","last_change":"2024-09-12T17:15:40.109807+0000","last_active":"2024-09-12T17:38:36.286516+0000","last_peered":"2024-09-12T17:38:36.286516+0000","last_clean":"2024-09-12T17:38:36.286516+0000","last_became_active":"2024-09-12T17:15:40.109161+0000","last_became_peered":"2024-09-12T17:15:40.109161+0000","last_unstale":"2024-09-12T17:38:36.286516+0000","last_undegraded":"2024-09-12T17:38:36.286516+0000","last_fullsized":"2024-09-12T17:38:36.286516+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:38.091651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"265'31","reported_seq":127,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:28.552554+0000","last_change":"2024-09-12T17:13:54.839575+0000","last_active":"2024-09-12T17:39:28.552554+0000","last_peered":"2024-09-12T17:39:28.552554+0000","last_clean":"2024-09-12T17:39:28.552554+0000","last_became_active":"2024-09-12T17:13:54.838968+0000","last_became_peered":"2024-09-12T17:13:54.838968+0000","last_unstale":"2024-09-12T17:39:28.552554+0000","last_undegraded":"2024-09-12T17:39:28.552554+0000","last_fullsized":"2024-09-12T17:39:28.552554+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:01.149483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":108,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:22.370396+0000","last_change":"2024-09-12T17:27:17.418362+0000","last_active":"2024-09-12T17:39:22.370396+0000","last_peered":"2024-09-12T17:39:22.370396+0000","last_clean":"2024-09-12T17:39:22.370396+0000","last_became_active":"2024-09-12T17:27:17.416509+0000","last_became_peered":"2024-09-12T17:27:17.416509+0000","last_unstale":"2024-09-12T17:39:22.370396+0000","last_undegraded":"2024-09-12T17:39:22.370396+0000","last_fullsized":"2024-09-12T17:39:22.370396+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:54.908041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"265'11","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:57.358703+0000","last_change":"2024-09-12T17:15:43.163407+0000","last_active":"2024-09-12T17:39:57.358703+0000","last_peered":"2024-09-12T17:39:57.358703+0000","last_clean":"2024-09-12T17:39:57.358703+0000","last_became_active":"2024-09-12T17:15:43.162643+0000","last_became_peered":"2024-09-12T17:15:43.162643+0000","last_unstale":"2024-09-12T17:39:57.358703+0000","last_undegraded":"2024-09-12T17:39:57.358703+0000","last_fullsized":"2024-09-12T17:39:57.358703+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:26.465579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":23650,"num_write":16,"num_write_kb":11312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"265'10","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.608891+0000","last_change":"2024-09-12T17:15:40.111961+0000","last_active":"2024-09-12T17:41:32.608891+0000","last_peered":"2024-09-12T17:41:32.608891+0000","last_clean":"2024-09-12T17:41:32.608891+0000","last_became_active":"2024-09-12T17:15:40.111105+0000","last_became_peered":"2024-09-12T17:15:40.111105+0000","last_unstale":"2024-09-12T17:41:32.608891+0000","last_undegraded":"2024-09-12T17:41:32.608891+0000","last_fullsized":"2024-09-12T17:41:32.608891+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":20,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"265'54","reported_seq":197,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:31.662260+0000","last_change":"2024-09-12T17:13:54.842088+0000","last_active":"2024-09-12T17:39:31.662260+0000","last_peered":"2024-09-12T17:39:31.662260+0000","last_clean":"2024-09-12T17:39:31.662260+0000","last_became_active":"2024-09-12T17:13:54.841072+0000","last_became_peered":"2024-09-12T17:13:54.841072+0000","last_unstale":"2024-09-12T17:39:31.662260+0000","last_undegraded":"2024-09-12T17:39:31.662260+0000","last_fullsized":"2024-09-12T17:39:31.662260+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:22:11.118120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":282,"num_read_kb":222,"num_write":88,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:18.490676+0000","last_change":"2024-09-12T17:42:18.490676+0000","last_active":"2024-09-12T17:42:18.490676+0000","last_peered":"2024-09-12T17:42:18.490676+0000","last_clean":"2024-09-12T17:42:18.490676+0000","last_became_active":"2024-09-12T17:27:17.392355+0000","last_became_peered":"2024-09-12T17:27:17.392355+0000","last_unstale":"2024-09-12T17:42:18.490676+0000","last_undegraded":"2024-09-12T17:42:18.490676+0000","last_fullsized":"2024-09-12T17:42:18.490676+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:18.490490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:18.490490+0000","last_clean_scrub_stamp":"2024-09-12T17:42:18.490490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:41.103063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"265'4","reported_seq":60,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:13.319885+0000","last_change":"2024-09-12T17:42:13.319885+0000","last_active":"2024-09-12T17:42:13.319885+0000","last_peered":"2024-09-12T17:42:13.319885+0000","last_clean":"2024-09-12T17:42:13.319885+0000","last_became_active":"2024-09-12T17:15:57.742342+0000","last_became_peered":"2024-09-12T17:15:57.742342+0000","last_unstale":"2024-09-12T17:42:13.319885+0000","last_undegraded":"2024-09-12T17:42:13.319885+0000","last_fullsized":"2024-09-12T17:42:13.319885+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T17:42:13.319684+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T17:42:13.319684+0000","last_clean_scrub_stamp":"2024-09-12T17:42:13.319684+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:39.886328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1087,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:36.272606+0000","last_change":"2024-09-12T17:15:40.120329+0000","last_active":"2024-09-12T17:37:36.272606+0000","last_peered":"2024-09-12T17:37:36.272606+0000","last_clean":"2024-09-12T17:37:36.272606+0000","last_became_active":"2024-09-12T17:15:40.119439+0000","last_became_peered":"2024-09-12T17:15:40.119439+0000","last_unstale":"2024-09-12T17:37:36.272606+0000","last_undegraded":"2024-09-12T17:37:36.272606+0000","last_fullsized":"2024-09-12T17:37:36.272606+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:50.536461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"265'35","reported_seq":150,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:08.370054+0000","last_change":"2024-09-12T17:42:08.370054+0000","last_active":"2024-09-12T17:42:08.370054+0000","last_peered":"2024-09-12T17:42:08.370054+0000","last_clean":"2024-09-12T17:42:08.370054+0000","last_became_active":"2024-09-12T17:13:54.842215+0000","last_became_peered":"2024-09-12T17:13:54.842215+0000","last_unstale":"2024-09-12T17:42:08.370054+0000","last_undegraded":"2024-09-12T17:42:08.370054+0000","last_fullsized":"2024-09-12T17:42:08.370054+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'35","last_scrub_stamp":"2024-09-12T17:42:08.369871+0000","last_deep_scrub":"265'35","last_deep_scrub_stamp":"2024-09-12T17:42:08.369871+0000","last_clean_scrub_stamp":"2024-09-12T17:42:08.369871+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:38.605184+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":135,"num_write":51,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"265'1","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:21.291709+0000","last_change":"2024-09-12T17:27:17.415995+0000","last_active":"2024-09-12T17:37:21.291709+0000","last_peered":"2024-09-12T17:37:21.291709+0000","last_clean":"2024-09-12T17:37:21.291709+0000","last_became_active":"2024-09-12T17:27:17.415277+0000","last_became_peered":"2024-09-12T17:27:17.415277+0000","last_unstale":"2024-09-12T17:37:21.291709+0000","last_undegraded":"2024-09-12T17:37:21.291709+0000","last_fullsized":"2024-09-12T17:37:21.291709+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:19.223166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"265'4","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:14.316099+0000","last_change":"2024-09-12T17:42:14.316099+0000","last_active":"2024-09-12T17:42:14.316099+0000","last_peered":"2024-09-12T17:42:14.316099+0000","last_clean":"2024-09-12T17:42:14.316099+0000","last_became_active":"2024-09-12T17:15:43.172142+0000","last_became_peered":"2024-09-12T17:15:43.172142+0000","last_unstale":"2024-09-12T17:42:14.316099+0000","last_undegraded":"2024-09-12T17:42:14.316099+0000","last_fullsized":"2024-09-12T17:42:14.316099+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T17:42:14.315861+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T17:42:14.315861+0000","last_clean_scrub_stamp":"2024-09-12T17:42:14.315861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:29.719344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"262'4","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:11.280709+0000","last_change":"2024-09-12T17:15:40.109940+0000","last_active":"2024-09-12T17:38:11.280709+0000","last_peered":"2024-09-12T17:38:11.280709+0000","last_clean":"2024-09-12T17:38:11.280709+0000","last_became_active":"2024-09-12T17:15:40.109076+0000","last_became_peered":"2024-09-12T17:15:40.109076+0000","last_unstale":"2024-09-12T17:38:11.280709+0000","last_undegraded":"2024-09-12T17:38:11.280709+0000","last_fullsized":"2024-09-12T17:38:11.280709+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:05.822624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"262'6","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:12.349294+0000","last_change":"2024-09-12T17:13:54.820144+0000","last_active":"2024-09-12T17:38:12.349294+0000","last_peered":"2024-09-12T17:38:12.349294+0000","last_clean":"2024-09-12T17:38:12.349294+0000","last_became_active":"2024-09-12T17:13:54.819399+0000","last_became_peered":"2024-09-12T17:13:54.819399+0000","last_unstale":"2024-09-12T17:38:12.349294+0000","last_undegraded":"2024-09-12T17:38:12.349294+0000","last_fullsized":"2024-09-12T17:38:12.349294+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:25.721158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":18,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:37:21.291799+0000","last_change":"2024-09-12T17:27:17.420256+0000","last_active":"2024-09-12T17:37:21.291799+0000","last_peered":"2024-09-12T17:37:21.291799+0000","last_clean":"2024-09-12T17:37:21.291799+0000","last_became_active":"2024-09-12T17:27:17.419839+0000","last_became_peered":"2024-09-12T17:27:17.419839+0000","last_unstale":"2024-09-12T17:37:21.291799+0000","last_undegraded":"2024-09-12T17:37:21.291799+0000","last_fullsized":"2024-09-12T17:37:21.291799+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:46.578295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"265'5","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:42.388952+0000","last_change":"2024-09-12T17:15:43.160492+0000","last_active":"2024-09-12T17:40:42.388952+0000","last_peered":"2024-09-12T17:40:42.388952+0000","last_clean":"2024-09-12T17:40:42.388952+0000","last_became_active":"2024-09-12T17:15:43.159663+0000","last_became_peered":"2024-09-12T17:15:43.159663+0000","last_unstale":"2024-09-12T17:40:42.388952+0000","last_undegraded":"2024-09-12T17:40:42.388952+0000","last_fullsized":"2024-09-12T17:40:42.388952+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:48.671220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":23,"num_write":10,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"265'2","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:42.384696+0000","last_change":"2024-09-12T17:15:40.131992+0000","last_active":"2024-09-12T17:40:42.384696+0000","last_peered":"2024-09-12T17:40:42.384696+0000","last_clean":"2024-09-12T17:40:42.384696+0000","last_became_active":"2024-09-12T17:15:40.131140+0000","last_became_peered":"2024-09-12T17:15:40.131140+0000","last_unstale":"2024-09-12T17:40:42.384696+0000","last_undegraded":"2024-09-12T17:40:42.384696+0000","last_fullsized":"2024-09-12T17:40:42.384696+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:26.319835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"265'19","reported_seq":102,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:08.484896+0000","last_change":"2024-09-12T17:42:08.484896+0000","last_active":"2024-09-12T17:42:08.484896+0000","last_peered":"2024-09-12T17:42:08.484896+0000","last_clean":"2024-09-12T17:42:08.484896+0000","last_became_active":"2024-09-12T17:13:54.831374+0000","last_became_peered":"2024-09-12T17:13:54.831374+0000","last_unstale":"2024-09-12T17:42:08.484896+0000","last_undegraded":"2024-09-12T17:42:08.484896+0000","last_fullsized":"2024-09-12T17:42:08.484896+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'19","last_scrub_stamp":"2024-09-12T17:42:08.484711+0000","last_deep_scrub":"265'19","last_deep_scrub_stamp":"2024-09-12T17:42:08.484711+0000","last_clean_scrub_stamp":"2024-09-12T17:42:08.484711+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:29.635833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:58.706411+0000","last_change":"2024-09-12T17:27:17.416704+0000","last_active":"2024-09-12T17:38:58.706411+0000","last_peered":"2024-09-12T17:38:58.706411+0000","last_clean":"2024-09-12T17:38:58.706411+0000","last_became_active":"2024-09-12T17:27:17.415918+0000","last_became_peered":"2024-09-12T17:27:17.415918+0000","last_unstale":"2024-09-12T17:38:58.706411+0000","last_undegraded":"2024-09-12T17:38:58.706411+0000","last_fullsized":"2024-09-12T17:38:58.706411+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:40.069574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"265'4","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.439671+0000","last_change":"2024-09-12T17:15:43.872202+0000","last_active":"2024-09-12T17:41:32.439671+0000","last_peered":"2024-09-12T17:41:32.439671+0000","last_clean":"2024-09-12T17:41:32.439671+0000","last_became_active":"2024-09-12T17:15:43.871380+0000","last_became_peered":"2024-09-12T17:15:43.871380+0000","last_unstale":"2024-09-12T17:41:32.439671+0000","last_undegraded":"2024-09-12T17:41:32.439671+0000","last_fullsized":"2024-09-12T17:41:32.439671+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"265'4","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.733120+0000","last_change":"2024-09-12T17:15:40.117517+0000","last_active":"2024-09-12T17:41:32.733120+0000","last_peered":"2024-09-12T17:41:32.733120+0000","last_clean":"2024-09-12T17:41:32.733120+0000","last_became_active":"2024-09-12T17:15:40.116781+0000","last_became_peered":"2024-09-12T17:15:40.116781+0000","last_unstale":"2024-09-12T17:41:32.733120+0000","last_undegraded":"2024-09-12T17:41:32.733120+0000","last_fullsized":"2024-09-12T17:41:32.733120+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:04.218708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":7168,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"265'68","reported_seq":230,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:31.441127+0000","last_change":"2024-09-12T17:13:54.830908+0000","last_active":"2024-09-12T17:39:31.441127+0000","last_peered":"2024-09-12T17:39:31.441127+0000","last_clean":"2024-09-12T17:39:31.441127+0000","last_became_active":"2024-09-12T17:13:54.829335+0000","last_became_peered":"2024-09-12T17:13:54.829335+0000","last_unstale":"2024-09-12T17:39:31.441127+0000","last_undegraded":"2024-09-12T17:39:31.441127+0000","last_fullsized":"2024-09-12T17:39:31.441127+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:18:25.184524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":349,"num_read_kb":240,"num_write":120,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"265'2","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:04.688047+0000","last_change":"2024-09-12T17:42:04.688047+0000","last_active":"2024-09-12T17:42:04.688047+0000","last_peered":"2024-09-12T17:42:04.688047+0000","last_clean":"2024-09-12T17:42:04.688047+0000","last_became_active":"2024-09-12T17:27:17.409364+0000","last_became_peered":"2024-09-12T17:27:17.409364+0000","last_unstale":"2024-09-12T17:42:04.688047+0000","last_undegraded":"2024-09-12T17:42:04.688047+0000","last_fullsized":"2024-09-12T17:42:04.688047+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T17:42:04.687862+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T17:42:04.687862+0000","last_clean_scrub_stamp":"2024-09-12T17:42:04.687862+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:40.198659+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"265'2","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:27.397626+0000","last_change":"2024-09-12T17:15:43.875351+0000","last_active":"2024-09-12T17:41:27.397626+0000","last_peered":"2024-09-12T17:41:27.397626+0000","last_clean":"2024-09-12T17:41:27.397626+0000","last_became_active":"2024-09-12T17:15:43.874421+0000","last_became_peered":"2024-09-12T17:15:43.874421+0000","last_unstale":"2024-09-12T17:41:27.397626+0000","last_undegraded":"2024-09-12T17:41:27.397626+0000","last_fullsized":"2024-09-12T17:41:27.397626+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:12.382448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"265'4","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.606864+0000","last_change":"2024-09-12T17:15:40.127851+0000","last_active":"2024-09-12T17:41:32.606864+0000","last_peered":"2024-09-12T17:41:32.606864+0000","last_clean":"2024-09-12T17:41:32.606864+0000","last_became_active":"2024-09-12T17:15:40.126898+0000","last_became_peered":"2024-09-12T17:15:40.126898+0000","last_unstale":"2024-09-12T17:41:32.606864+0000","last_undegraded":"2024-09-12T17:41:32.606864+0000","last_fullsized":"2024-09-12T17:41:32.606864+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"265'19","reported_seq":92,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:07.352095+0000","last_change":"2024-09-12T17:13:54.833584+0000","last_active":"2024-09-12T17:38:07.352095+0000","last_peered":"2024-09-12T17:38:07.352095+0000","last_clean":"2024-09-12T17:38:07.352095+0000","last_became_active":"2024-09-12T17:13:54.832780+0000","last_became_peered":"2024-09-12T17:13:54.832780+0000","last_unstale":"2024-09-12T17:38:07.352095+0000","last_undegraded":"2024-09-12T17:38:07.352095+0000","last_fullsized":"2024-09-12T17:38:07.352095+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:33.420620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":55,"num_write":40,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:01.315516+0000","last_change":"2024-09-12T17:27:17.415211+0000","last_active":"2024-09-12T17:39:01.315516+0000","last_peered":"2024-09-12T17:39:01.315516+0000","last_clean":"2024-09-12T17:39:01.315516+0000","last_became_active":"2024-09-12T17:27:17.414739+0000","last_became_peered":"2024-09-12T17:27:17.414739+0000","last_unstale":"2024-09-12T17:39:01.315516+0000","last_undegraded":"2024-09-12T17:39:01.315516+0000","last_fullsized":"2024-09-12T17:39:01.315516+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:57.434689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"265'5","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.775356+0000","last_change":"2024-09-12T17:15:43.872275+0000","last_active":"2024-09-12T17:41:32.775356+0000","last_peered":"2024-09-12T17:41:32.775356+0000","last_clean":"2024-09-12T17:41:32.775356+0000","last_became_active":"2024-09-12T17:15:43.871502+0000","last_became_peered":"2024-09-12T17:15:43.871502+0000","last_unstale":"2024-09-12T17:41:32.775356+0000","last_undegraded":"2024-09-12T17:41:32.775356+0000","last_fullsized":"2024-09-12T17:41:32.775356+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"265'5","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:06.687034+0000","last_change":"2024-09-12T17:42:06.686874+0000","last_active":"2024-09-12T17:42:06.687034+0000","last_peered":"2024-09-12T17:42:06.687034+0000","last_clean":"2024-09-12T17:42:06.687034+0000","last_became_active":"2024-09-12T17:15:40.132311+0000","last_became_peered":"2024-09-12T17:15:40.132311+0000","last_unstale":"2024-09-12T17:42:06.687034+0000","last_undegraded":"2024-09-12T17:42:06.687034+0000","last_fullsized":"2024-09-12T17:42:06.687034+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T17:42:06.686674+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T17:42:06.686674+0000","last_clean_scrub_stamp":"2024-09-12T17:42:06.686674+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:57.501458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"265'33","reported_seq":144,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:58.627418+0000","last_change":"2024-09-12T17:41:58.627418+0000","last_active":"2024-09-12T17:41:58.627418+0000","last_peered":"2024-09-12T17:41:58.627418+0000","last_clean":"2024-09-12T17:41:58.627418+0000","last_became_active":"2024-09-12T17:13:54.827785+0000","last_became_peered":"2024-09-12T17:13:54.827785+0000","last_unstale":"2024-09-12T17:41:58.627418+0000","last_undegraded":"2024-09-12T17:41:58.627418+0000","last_fullsized":"2024-09-12T17:41:58.627418+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'33","last_scrub_stamp":"2024-09-12T17:41:58.627187+0000","last_deep_scrub":"265'33","last_deep_scrub_stamp":"2024-09-12T17:41:58.627187+0000","last_clean_scrub_stamp":"2024-09-12T17:41:58.627187+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:13.355618+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":116,"num_write":64,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:57.345260+0000","last_change":"2024-09-12T17:27:17.391923+0000","last_active":"2024-09-12T17:38:57.345260+0000","last_peered":"2024-09-12T17:38:57.345260+0000","last_clean":"2024-09-12T17:38:57.345260+0000","last_became_active":"2024-09-12T17:27:17.391154+0000","last_became_peered":"2024-09-12T17:27:17.391154+0000","last_unstale":"2024-09-12T17:38:57.345260+0000","last_undegraded":"2024-09-12T17:38:57.345260+0000","last_fullsized":"2024-09-12T17:38:57.345260+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:12.682141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"265'13","reported_seq":60,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.774812+0000","last_change":"2024-09-12T17:15:43.171314+0000","last_active":"2024-09-12T17:41:32.774812+0000","last_peered":"2024-09-12T17:41:32.774812+0000","last_clean":"2024-09-12T17:41:32.774812+0000","last_became_active":"2024-09-12T17:15:43.169085+0000","last_became_peered":"2024-09-12T17:15:43.169085+0000","last_unstale":"2024-09-12T17:41:32.774812+0000","last_undegraded":"2024-09-12T17:41:32.774812+0000","last_fullsized":"2024-09-12T17:41:32.774812+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:01.989288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":43010,"num_write":18,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"265'2","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.896113+0000","last_change":"2024-09-12T17:15:40.139824+0000","last_active":"2024-09-12T17:41:32.896113+0000","last_peered":"2024-09-12T17:41:32.896113+0000","last_clean":"2024-09-12T17:41:32.896113+0000","last_became_active":"2024-09-12T17:15:40.139145+0000","last_became_peered":"2024-09-12T17:15:40.139145+0000","last_unstale":"2024-09-12T17:41:32.896113+0000","last_undegraded":"2024-09-12T17:41:32.896113+0000","last_fullsized":"2024-09-12T17:41:32.896113+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"265'28","reported_seq":125,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:41.325275+0000","last_change":"2024-09-12T17:13:54.843550+0000","last_active":"2024-09-12T17:39:41.325275+0000","last_peered":"2024-09-12T17:39:41.325275+0000","last_clean":"2024-09-12T17:39:41.325275+0000","last_became_active":"2024-09-12T17:13:54.842816+0000","last_became_peered":"2024-09-12T17:13:54.842816+0000","last_unstale":"2024-09-12T17:39:41.325275+0000","last_undegraded":"2024-09-12T17:39:41.325275+0000","last_fullsized":"2024-09-12T17:39:41.325275+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":108,"num_write":46,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:22.370428+0000","last_change":"2024-09-12T17:27:17.422713+0000","last_active":"2024-09-12T17:39:22.370428+0000","last_peered":"2024-09-12T17:39:22.370428+0000","last_clean":"2024-09-12T17:39:22.370428+0000","last_became_active":"2024-09-12T17:27:17.421939+0000","last_became_peered":"2024-09-12T17:27:17.421939+0000","last_unstale":"2024-09-12T17:39:22.370428+0000","last_undegraded":"2024-09-12T17:39:22.370428+0000","last_fullsized":"2024-09-12T17:39:22.370428+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"262'8","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:03.708024+0000","last_change":"2024-09-12T17:15:43.162064+0000","last_active":"2024-09-12T17:39:03.708024+0000","last_peered":"2024-09-12T17:39:03.708024+0000","last_clean":"2024-09-12T17:39:03.708024+0000","last_became_active":"2024-09-12T17:15:43.158530+0000","last_became_peered":"2024-09-12T17:15:43.158530+0000","last_unstale":"2024-09-12T17:39:03.708024+0000","last_undegraded":"2024-09-12T17:39:03.708024+0000","last_fullsized":"2024-09-12T17:39:03.708024+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:52.110653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10242,"num_write":8,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"265'5","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.607865+0000","last_change":"2024-09-12T17:15:40.131385+0000","last_active":"2024-09-12T17:41:32.607865+0000","last_peered":"2024-09-12T17:41:32.607865+0000","last_clean":"2024-09-12T17:41:32.607865+0000","last_became_active":"2024-09-12T17:15:40.130644+0000","last_became_peered":"2024-09-12T17:15:40.130644+0000","last_unstale":"2024-09-12T17:41:32.607865+0000","last_undegraded":"2024-09-12T17:41:32.607865+0000","last_fullsized":"2024-09-12T17:41:32.607865+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:14.166806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"265'14","reported_seq":89,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:36.324008+0000","last_change":"2024-09-12T17:13:54.843769+0000","last_active":"2024-09-12T17:39:36.324008+0000","last_peered":"2024-09-12T17:39:36.324008+0000","last_clean":"2024-09-12T17:39:36.324008+0000","last_became_active":"2024-09-12T17:13:54.843036+0000","last_became_peered":"2024-09-12T17:13:54.843036+0000","last_unstale":"2024-09-12T17:39:36.324008+0000","last_undegraded":"2024-09-12T17:39:36.324008+0000","last_fullsized":"2024-09-12T17:39:36.324008+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:22.366692+0000","last_change":"2024-09-12T17:27:17.426185+0000","last_active":"2024-09-12T17:39:22.366692+0000","last_peered":"2024-09-12T17:39:22.366692+0000","last_clean":"2024-09-12T17:39:22.366692+0000","last_became_active":"2024-09-12T17:27:17.421187+0000","last_became_peered":"2024-09-12T17:27:17.421187+0000","last_unstale":"2024-09-12T17:39:22.366692+0000","last_undegraded":"2024-09-12T17:39:22.366692+0000","last_fullsized":"2024-09-12T17:39:22.366692+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"265'7","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:15.514370+0000","last_change":"2024-09-12T17:42:15.514370+0000","last_active":"2024-09-12T17:42:15.514370+0000","last_peered":"2024-09-12T17:42:15.514370+0000","last_clean":"2024-09-12T17:42:15.514370+0000","last_became_active":"2024-09-12T17:15:43.155891+0000","last_became_peered":"2024-09-12T17:15:43.155891+0000","last_unstale":"2024-09-12T17:42:15.514370+0000","last_undegraded":"2024-09-12T17:42:15.514370+0000","last_fullsized":"2024-09-12T17:42:15.514370+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T17:42:15.514187+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T17:42:15.514187+0000","last_clean_scrub_stamp":"2024-09-12T17:42:15.514187+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:18:06.736448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8194,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:02.365695+0000","last_change":"2024-09-12T17:15:40.129236+0000","last_active":"2024-09-12T17:39:02.365695+0000","last_peered":"2024-09-12T17:39:02.365695+0000","last_clean":"2024-09-12T17:39:02.365695+0000","last_became_active":"2024-09-12T17:15:40.128470+0000","last_became_peered":"2024-09-12T17:15:40.128470+0000","last_unstale":"2024-09-12T17:39:02.365695+0000","last_undegraded":"2024-09-12T17:39:02.365695+0000","last_fullsized":"2024-09-12T17:39:02.365695+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:17.232330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"265'46","reported_seq":176,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:37.370710+0000","last_change":"2024-09-12T17:13:54.822640+0000","last_active":"2024-09-12T17:39:37.370710+0000","last_peered":"2024-09-12T17:39:37.370710+0000","last_clean":"2024-09-12T17:39:37.370710+0000","last_became_active":"2024-09-12T17:13:54.821816+0000","last_became_peered":"2024-09-12T17:13:54.821816+0000","last_unstale":"2024-09-12T17:39:37.370710+0000","last_undegraded":"2024-09-12T17:39:37.370710+0000","last_fullsized":"2024-09-12T17:39:37.370710+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":166,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"264'1","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:02.362079+0000","last_change":"2024-09-12T17:27:17.423856+0000","last_active":"2024-09-12T17:39:02.362079+0000","last_peered":"2024-09-12T17:39:02.362079+0000","last_clean":"2024-09-12T17:39:02.362079+0000","last_became_active":"2024-09-12T17:27:17.422464+0000","last_became_peered":"2024-09-12T17:27:17.422464+0000","last_unstale":"2024-09-12T17:39:02.362079+0000","last_undegraded":"2024-09-12T17:39:02.362079+0000","last_fullsized":"2024-09-12T17:39:02.362079+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:44.192139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"265'8","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.819159+0000","last_change":"2024-09-12T17:15:43.172138+0000","last_active":"2024-09-12T17:41:32.819159+0000","last_peered":"2024-09-12T17:41:32.819159+0000","last_clean":"2024-09-12T17:41:32.819159+0000","last_became_active":"2024-09-12T17:15:43.171254+0000","last_became_peered":"2024-09-12T17:15:43.171254+0000","last_unstale":"2024-09-12T17:41:32.819159+0000","last_undegraded":"2024-09-12T17:41:32.819159+0000","last_fullsized":"2024-09-12T17:41:32.819159+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:22.106658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10240,"num_write":8,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"265'4","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:10.349759+0000","last_change":"2024-09-12T17:42:10.349759+0000","last_active":"2024-09-12T17:42:10.349759+0000","last_peered":"2024-09-12T17:42:10.349759+0000","last_clean":"2024-09-12T17:42:10.349759+0000","last_became_active":"2024-09-12T17:15:40.116989+0000","last_became_peered":"2024-09-12T17:15:40.116989+0000","last_unstale":"2024-09-12T17:42:10.349759+0000","last_undegraded":"2024-09-12T17:42:10.349759+0000","last_fullsized":"2024-09-12T17:42:10.349759+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T17:42:10.349535+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T17:42:10.349535+0000","last_clean_scrub_stamp":"2024-09-12T17:42:10.349535+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:12:31.542751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4119,"num_write":4,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"265'42","reported_seq":169,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:14.628040+0000","last_change":"2024-09-12T17:42:14.628040+0000","last_active":"2024-09-12T17:42:14.628040+0000","last_peered":"2024-09-12T17:42:14.628040+0000","last_clean":"2024-09-12T17:42:14.628040+0000","last_became_active":"2024-09-12T17:13:54.811613+0000","last_became_peered":"2024-09-12T17:13:54.811613+0000","last_unstale":"2024-09-12T17:42:14.628040+0000","last_undegraded":"2024-09-12T17:42:14.628040+0000","last_fullsized":"2024-09-12T17:42:14.628040+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'42","last_scrub_stamp":"2024-09-12T17:42:14.627840+0000","last_deep_scrub":"265'42","last_deep_scrub_stamp":"2024-09-12T17:42:14.627840+0000","last_clean_scrub_stamp":"2024-09-12T17:42:14.627840+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:12.213103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":153,"num_write":74,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"265'1","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:22.370331+0000","last_change":"2024-09-12T17:27:17.405875+0000","last_active":"2024-09-12T17:39:22.370331+0000","last_peered":"2024-09-12T17:39:22.370331+0000","last_clean":"2024-09-12T17:39:22.370331+0000","last_became_active":"2024-09-12T17:27:17.405051+0000","last_became_peered":"2024-09-12T17:27:17.405051+0000","last_unstale":"2024-09-12T17:39:22.370331+0000","last_undegraded":"2024-09-12T17:39:22.370331+0000","last_fullsized":"2024-09-12T17:39:22.370331+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"265'2","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:11.375720+0000","last_change":"2024-09-12T17:42:11.375720+0000","last_active":"2024-09-12T17:42:11.375720+0000","last_peered":"2024-09-12T17:42:11.375720+0000","last_clean":"2024-09-12T17:42:11.375720+0000","last_became_active":"2024-09-12T17:15:43.157624+0000","last_became_peered":"2024-09-12T17:15:43.157624+0000","last_unstale":"2024-09-12T17:42:11.375720+0000","last_undegraded":"2024-09-12T17:42:11.375720+0000","last_fullsized":"2024-09-12T17:42:11.375720+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T17:42:11.375527+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T17:42:11.375527+0000","last_clean_scrub_stamp":"2024-09-12T17:42:11.375527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:25.544419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:02.346406+0000","last_change":"2024-09-12T17:15:40.118796+0000","last_active":"2024-09-12T17:39:02.346406+0000","last_peered":"2024-09-12T17:39:02.346406+0000","last_clean":"2024-09-12T17:39:02.346406+0000","last_became_active":"2024-09-12T17:15:40.118074+0000","last_became_peered":"2024-09-12T17:15:40.118074+0000","last_unstale":"2024-09-12T17:39:02.346406+0000","last_undegraded":"2024-09-12T17:39:02.346406+0000","last_fullsized":"2024-09-12T17:39:02.346406+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:53:01.242885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"265'16","reported_seq":90,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:37.373836+0000","last_change":"2024-09-12T17:13:54.841589+0000","last_active":"2024-09-12T17:39:37.373836+0000","last_peered":"2024-09-12T17:39:37.373836+0000","last_clean":"2024-09-12T17:39:37.373836+0000","last_became_active":"2024-09-12T17:13:54.840781+0000","last_became_peered":"2024-09-12T17:13:54.840781+0000","last_unstale":"2024-09-12T17:39:37.373836+0000","last_undegraded":"2024-09-12T17:39:37.373836+0000","last_fullsized":"2024-09-12T17:39:37.373836+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":56,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":27,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:57.606875+0000","last_change":"2024-09-12T17:41:57.606875+0000","last_active":"2024-09-12T17:41:57.606875+0000","last_peered":"2024-09-12T17:41:57.606875+0000","last_clean":"2024-09-12T17:41:57.606875+0000","last_became_active":"2024-09-12T17:27:17.408953+0000","last_became_peered":"2024-09-12T17:27:17.408953+0000","last_unstale":"2024-09-12T17:41:57.606875+0000","last_undegraded":"2024-09-12T17:41:57.606875+0000","last_fullsized":"2024-09-12T17:41:57.606875+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:57.606663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:57.606663+0000","last_clean_scrub_stamp":"2024-09-12T17:41:57.606663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:02.509027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:12.353382+0000","last_change":"2024-09-12T17:15:43.165887+0000","last_active":"2024-09-12T17:38:12.353382+0000","last_peered":"2024-09-12T17:38:12.353382+0000","last_clean":"2024-09-12T17:38:12.353382+0000","last_became_active":"2024-09-12T17:15:43.164943+0000","last_became_peered":"2024-09-12T17:15:43.164943+0000","last_unstale":"2024-09-12T17:38:12.353382+0000","last_undegraded":"2024-09-12T17:38:12.353382+0000","last_fullsized":"2024-09-12T17:38:12.353382+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:08.542268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"265'7","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:26.336598+0000","last_change":"2024-09-12T17:15:40.129503+0000","last_active":"2024-09-12T17:40:26.336598+0000","last_peered":"2024-09-12T17:40:26.336598+0000","last_clean":"2024-09-12T17:40:26.336598+0000","last_became_active":"2024-09-12T17:15:40.128681+0000","last_became_peered":"2024-09-12T17:15:40.128681+0000","last_unstale":"2024-09-12T17:40:26.336598+0000","last_undegraded":"2024-09-12T17:40:26.336598+0000","last_fullsized":"2024-09-12T17:40:26.336598+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:21.306746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16384,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"265'9","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:47.361596+0000","last_change":"2024-09-12T17:13:54.844500+0000","last_active":"2024-09-12T17:38:47.361596+0000","last_peered":"2024-09-12T17:38:47.361596+0000","last_clean":"2024-09-12T17:38:47.361596+0000","last_became_active":"2024-09-12T17:13:54.842287+0000","last_became_peered":"2024-09-12T17:13:54.842287+0000","last_unstale":"2024-09-12T17:38:47.361596+0000","last_undegraded":"2024-09-12T17:38:47.361596+0000","last_fullsized":"2024-09-12T17:38:47.361596+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:09.440211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":28,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:36.309617+0000","last_change":"2024-09-12T17:27:17.416766+0000","last_active":"2024-09-12T17:38:36.309617+0000","last_peered":"2024-09-12T17:38:36.309617+0000","last_clean":"2024-09-12T17:38:36.309617+0000","last_became_active":"2024-09-12T17:27:17.415241+0000","last_became_peered":"2024-09-12T17:27:17.415241+0000","last_unstale":"2024-09-12T17:38:36.309617+0000","last_undegraded":"2024-09-12T17:38:36.309617+0000","last_fullsized":"2024-09-12T17:38:36.309617+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:04.923059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"265'8","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:27.385923+0000","last_change":"2024-09-12T17:15:43.171921+0000","last_active":"2024-09-12T17:40:27.385923+0000","last_peered":"2024-09-12T17:40:27.385923+0000","last_clean":"2024-09-12T17:40:27.385923+0000","last_became_active":"2024-09-12T17:15:43.168676+0000","last_became_peered":"2024-09-12T17:15:43.168676+0000","last_unstale":"2024-09-12T17:40:27.385923+0000","last_undegraded":"2024-09-12T17:40:27.385923+0000","last_fullsized":"2024-09-12T17:40:27.385923+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:51.743678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":24578,"num_write":18,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"265'6","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:05.641587+0000","last_change":"2024-09-12T17:42:05.641587+0000","last_active":"2024-09-12T17:42:05.641587+0000","last_peered":"2024-09-12T17:42:05.641587+0000","last_clean":"2024-09-12T17:42:05.641587+0000","last_became_active":"2024-09-12T17:15:40.128708+0000","last_became_peered":"2024-09-12T17:15:40.128708+0000","last_unstale":"2024-09-12T17:42:05.641587+0000","last_undegraded":"2024-09-12T17:42:05.641587+0000","last_fullsized":"2024-09-12T17:42:05.641587+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T17:42:05.641411+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T17:42:05.641411+0000","last_clean_scrub_stamp":"2024-09-12T17:42:05.641411+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:30.258368+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8194,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"265'35","reported_seq":144,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:42.341793+0000","last_change":"2024-09-12T17:13:54.830851+0000","last_active":"2024-09-12T17:38:42.341793+0000","last_peered":"2024-09-12T17:38:42.341793+0000","last_clean":"2024-09-12T17:38:42.341793+0000","last_became_active":"2024-09-12T17:13:54.830096+0000","last_became_peered":"2024-09-12T17:13:54.830096+0000","last_unstale":"2024-09-12T17:38:42.341793+0000","last_undegraded":"2024-09-12T17:38:42.341793+0000","last_fullsized":"2024-09-12T17:38:42.341793+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:08.715298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":131,"num_write":60,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":27,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:15.302511+0000","last_change":"2024-09-12T17:42:15.302511+0000","last_active":"2024-09-12T17:42:15.302511+0000","last_peered":"2024-09-12T17:42:15.302511+0000","last_clean":"2024-09-12T17:42:15.302511+0000","last_became_active":"2024-09-12T17:27:17.411635+0000","last_became_peered":"2024-09-12T17:27:17.411635+0000","last_unstale":"2024-09-12T17:42:15.302511+0000","last_undegraded":"2024-09-12T17:42:15.302511+0000","last_fullsized":"2024-09-12T17:42:15.302511+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:15.302324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:15.302324+0000","last_clean_scrub_stamp":"2024-09-12T17:42:15.302324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:56.811938+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:14.469466+0000","last_change":"2024-09-12T17:42:14.469466+0000","last_active":"2024-09-12T17:42:14.469466+0000","last_peered":"2024-09-12T17:42:14.469466+0000","last_clean":"2024-09-12T17:42:14.469466+0000","last_became_active":"2024-09-12T17:15:43.869197+0000","last_became_peered":"2024-09-12T17:15:43.869197+0000","last_unstale":"2024-09-12T17:42:14.469466+0000","last_undegraded":"2024-09-12T17:42:14.469466+0000","last_fullsized":"2024-09-12T17:42:14.469466+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:14.469273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:14.469273+0000","last_clean_scrub_stamp":"2024-09-12T17:42:14.469273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:22.066834+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:12.349506+0000","last_change":"2024-09-12T17:15:40.115375+0000","last_active":"2024-09-12T17:38:12.349506+0000","last_peered":"2024-09-12T17:38:12.349506+0000","last_clean":"2024-09-12T17:38:12.349506+0000","last_became_active":"2024-09-12T17:15:40.114636+0000","last_became_peered":"2024-09-12T17:15:40.114636+0000","last_unstale":"2024-09-12T17:38:12.349506+0000","last_undegraded":"2024-09-12T17:38:12.349506+0000","last_fullsized":"2024-09-12T17:38:12.349506+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:25.820396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"265'11","reported_seq":85,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:06.384673+0000","last_change":"2024-09-12T17:42:06.384673+0000","last_active":"2024-09-12T17:42:06.384673+0000","last_peered":"2024-09-12T17:42:06.384673+0000","last_clean":"2024-09-12T17:42:06.384673+0000","last_became_active":"2024-09-12T17:13:54.836955+0000","last_became_peered":"2024-09-12T17:13:54.836955+0000","last_unstale":"2024-09-12T17:42:06.384673+0000","last_undegraded":"2024-09-12T17:42:06.384673+0000","last_fullsized":"2024-09-12T17:42:06.384673+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'11","last_scrub_stamp":"2024-09-12T17:42:06.384479+0000","last_deep_scrub":"265'11","last_deep_scrub_stamp":"2024-09-12T17:42:06.384479+0000","last_clean_scrub_stamp":"2024-09-12T17:42:06.384479+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:34.190005+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":38,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:11.303795+0000","last_change":"2024-09-12T17:27:17.409364+0000","last_active":"2024-09-12T17:38:11.303795+0000","last_peered":"2024-09-12T17:38:11.303795+0000","last_clean":"2024-09-12T17:38:11.303795+0000","last_became_active":"2024-09-12T17:27:17.408128+0000","last_became_peered":"2024-09-12T17:27:17.408128+0000","last_unstale":"2024-09-12T17:38:11.303795+0000","last_undegraded":"2024-09-12T17:38:11.303795+0000","last_fullsized":"2024-09-12T17:38:11.303795+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:44.771065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"265'4","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.648372+0000","last_change":"2024-09-12T17:15:43.171004+0000","last_active":"2024-09-12T17:41:32.648372+0000","last_peered":"2024-09-12T17:41:32.648372+0000","last_clean":"2024-09-12T17:41:32.648372+0000","last_became_active":"2024-09-12T17:15:43.169936+0000","last_became_peered":"2024-09-12T17:15:43.169936+0000","last_unstale":"2024-09-12T17:41:32.648372+0000","last_undegraded":"2024-09-12T17:41:32.648372+0000","last_fullsized":"2024-09-12T17:41:32.648372+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:21.292046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"265'9","reported_seq":66,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:10.516621+0000","last_change":"2024-09-12T17:42:10.516621+0000","last_active":"2024-09-12T17:42:10.516621+0000","last_peered":"2024-09-12T17:42:10.516621+0000","last_clean":"2024-09-12T17:42:10.516621+0000","last_became_active":"2024-09-12T17:15:40.121181+0000","last_became_peered":"2024-09-12T17:15:40.121181+0000","last_unstale":"2024-09-12T17:42:10.516621+0000","last_undegraded":"2024-09-12T17:42:10.516621+0000","last_fullsized":"2024-09-12T17:42:10.516621+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'9","last_scrub_stamp":"2024-09-12T17:42:10.516395+0000","last_deep_scrub":"265'9","last_deep_scrub_stamp":"2024-09-12T17:42:10.516395+0000","last_clean_scrub_stamp":"2024-09-12T17:42:10.516395+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:29.653573+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12338,"num_write":14,"num_write_kb":5168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"265'48","reported_seq":184,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:02.687921+0000","last_change":"2024-09-12T17:42:02.687921+0000","last_active":"2024-09-12T17:42:02.687921+0000","last_peered":"2024-09-12T17:42:02.687921+0000","last_clean":"2024-09-12T17:42:02.687921+0000","last_became_active":"2024-09-12T17:13:54.841923+0000","last_became_peered":"2024-09-12T17:13:54.841923+0000","last_unstale":"2024-09-12T17:42:02.687921+0000","last_undegraded":"2024-09-12T17:42:02.687921+0000","last_fullsized":"2024-09-12T17:42:02.687921+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'48","last_scrub_stamp":"2024-09-12T17:42:02.687744+0000","last_deep_scrub":"265'48","last_deep_scrub_stamp":"2024-09-12T17:42:02.687744+0000","last_clean_scrub_stamp":"2024-09-12T17:42:02.687744+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:43.890945+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":241,"num_read_kb":172,"num_write":100,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:32.357996+0000","last_change":"2024-09-12T17:27:17.419285+0000","last_active":"2024-09-12T17:38:32.357996+0000","last_peered":"2024-09-12T17:38:32.357996+0000","last_clean":"2024-09-12T17:38:32.357996+0000","last_became_active":"2024-09-12T17:27:17.417566+0000","last_became_peered":"2024-09-12T17:27:17.417566+0000","last_unstale":"2024-09-12T17:38:32.357996+0000","last_undegraded":"2024-09-12T17:38:32.357996+0000","last_fullsized":"2024-09-12T17:38:32.357996+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:32.507294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"262'4","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:36.299859+0000","last_change":"2024-09-12T17:15:43.162593+0000","last_active":"2024-09-12T17:39:36.299859+0000","last_peered":"2024-09-12T17:39:36.299859+0000","last_clean":"2024-09-12T17:39:36.299859+0000","last_became_active":"2024-09-12T17:15:43.161858+0000","last_became_peered":"2024-09-12T17:15:43.161858+0000","last_unstale":"2024-09-12T17:39:36.299859+0000","last_undegraded":"2024-09-12T17:39:36.299859+0000","last_fullsized":"2024-09-12T17:39:36.299859+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:32.369307+0000","last_change":"2024-09-12T17:15:40.113046+0000","last_active":"2024-09-12T17:39:32.369307+0000","last_peered":"2024-09-12T17:39:32.369307+0000","last_clean":"2024-09-12T17:39:32.369307+0000","last_became_active":"2024-09-12T17:15:40.112179+0000","last_became_peered":"2024-09-12T17:15:40.112179+0000","last_unstale":"2024-09-12T17:39:32.369307+0000","last_undegraded":"2024-09-12T17:39:32.369307+0000","last_fullsized":"2024-09-12T17:39:32.369307+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"265'67","reported_seq":229,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:42.356505+0000","last_change":"2024-09-12T17:13:54.828364+0000","last_active":"2024-09-12T17:38:42.356505+0000","last_peered":"2024-09-12T17:38:42.356505+0000","last_clean":"2024-09-12T17:38:42.356505+0000","last_became_active":"2024-09-12T17:13:54.827402+0000","last_became_peered":"2024-09-12T17:13:54.827402+0000","last_unstale":"2024-09-12T17:38:42.356505+0000","last_undegraded":"2024-09-12T17:38:42.356505+0000","last_fullsized":"2024-09-12T17:38:42.356505+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:52.664896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":342,"num_read_kb":248,"num_write":117,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:41.310813+0000","last_change":"2024-09-12T17:27:17.418505+0000","last_active":"2024-09-12T17:38:41.310813+0000","last_peered":"2024-09-12T17:38:41.310813+0000","last_clean":"2024-09-12T17:38:41.310813+0000","last_became_active":"2024-09-12T17:27:17.418022+0000","last_became_peered":"2024-09-12T17:27:17.418022+0000","last_unstale":"2024-09-12T17:38:41.310813+0000","last_undegraded":"2024-09-12T17:38:41.310813+0000","last_fullsized":"2024-09-12T17:38:41.310813+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:55.678220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"265'5","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.817763+0000","last_change":"2024-09-12T17:15:43.865245+0000","last_active":"2024-09-12T17:41:32.817763+0000","last_peered":"2024-09-12T17:41:32.817763+0000","last_clean":"2024-09-12T17:41:32.817763+0000","last_became_active":"2024-09-12T17:15:43.864657+0000","last_became_peered":"2024-09-12T17:15:43.864657+0000","last_unstale":"2024-09-12T17:41:32.817763+0000","last_undegraded":"2024-09-12T17:41:32.817763+0000","last_fullsized":"2024-09-12T17:41:32.817763+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"265'12","reported_seq":76,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:11.521302+0000","last_change":"2024-09-12T17:42:11.521302+0000","last_active":"2024-09-12T17:42:11.521302+0000","last_peered":"2024-09-12T17:42:11.521302+0000","last_clean":"2024-09-12T17:42:11.521302+0000","last_became_active":"2024-09-12T17:15:40.122001+0000","last_became_peered":"2024-09-12T17:15:40.122001+0000","last_unstale":"2024-09-12T17:42:11.521302+0000","last_undegraded":"2024-09-12T17:42:11.521302+0000","last_fullsized":"2024-09-12T17:42:11.521302+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'12","last_scrub_stamp":"2024-09-12T17:42:11.521124+0000","last_deep_scrub":"265'12","last_deep_scrub_stamp":"2024-09-12T17:42:11.521124+0000","last_clean_scrub_stamp":"2024-09-12T17:42:11.521124+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:06.034884+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12340,"num_write":12,"num_write_kb":6192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"265'23","reported_seq":106,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:01.330404+0000","last_change":"2024-09-12T17:13:54.831219+0000","last_active":"2024-09-12T17:40:01.330404+0000","last_peered":"2024-09-12T17:40:01.330404+0000","last_clean":"2024-09-12T17:40:01.330404+0000","last_became_active":"2024-09-12T17:13:54.825019+0000","last_became_peered":"2024-09-12T17:13:54.825019+0000","last_unstale":"2024-09-12T17:40:01.330404+0000","last_undegraded":"2024-09-12T17:40:01.330404+0000","last_fullsized":"2024-09-12T17:40:01.330404+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":38,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"265'1","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:36.309680+0000","last_change":"2024-09-12T17:27:17.408731+0000","last_active":"2024-09-12T17:38:36.309680+0000","last_peered":"2024-09-12T17:38:36.309680+0000","last_clean":"2024-09-12T17:38:36.309680+0000","last_became_active":"2024-09-12T17:27:17.408151+0000","last_became_peered":"2024-09-12T17:27:17.408151+0000","last_unstale":"2024-09-12T17:38:36.309680+0000","last_undegraded":"2024-09-12T17:38:36.309680+0000","last_fullsized":"2024-09-12T17:38:36.309680+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:04.214744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"265'7","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:16.476254+0000","last_change":"2024-09-12T17:42:16.476254+0000","last_active":"2024-09-12T17:42:16.476254+0000","last_peered":"2024-09-12T17:42:16.476254+0000","last_clean":"2024-09-12T17:42:16.476254+0000","last_became_active":"2024-09-12T17:15:43.166482+0000","last_became_peered":"2024-09-12T17:15:43.166482+0000","last_unstale":"2024-09-12T17:42:16.476254+0000","last_undegraded":"2024-09-12T17:42:16.476254+0000","last_fullsized":"2024-09-12T17:42:16.476254+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T17:42:16.476055+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T17:42:16.476055+0000","last_clean_scrub_stamp":"2024-09-12T17:42:16.476055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:42.940708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:37.370681+0000","last_change":"2024-09-12T17:15:40.138867+0000","last_active":"2024-09-12T17:39:37.370681+0000","last_peered":"2024-09-12T17:39:37.370681+0000","last_clean":"2024-09-12T17:39:37.370681+0000","last_became_active":"2024-09-12T17:15:40.138190+0000","last_became_peered":"2024-09-12T17:15:40.138190+0000","last_unstale":"2024-09-12T17:39:37.370681+0000","last_undegraded":"2024-09-12T17:39:37.370681+0000","last_fullsized":"2024-09-12T17:39:37.370681+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"265'18","reported_seq":94,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:57.378881+0000","last_change":"2024-09-12T17:13:54.833230+0000","last_active":"2024-09-12T17:39:57.378881+0000","last_peered":"2024-09-12T17:39:57.378881+0000","last_clean":"2024-09-12T17:39:57.378881+0000","last_became_active":"2024-09-12T17:13:54.832453+0000","last_became_peered":"2024-09-12T17:13:54.832453+0000","last_unstale":"2024-09-12T17:39:57.378881+0000","last_undegraded":"2024-09-12T17:39:57.378881+0000","last_fullsized":"2024-09-12T17:39:57.378881+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":60,"num_write":35,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:32.354215+0000","last_change":"2024-09-12T17:27:17.418555+0000","last_active":"2024-09-12T17:38:32.354215+0000","last_peered":"2024-09-12T17:38:32.354215+0000","last_clean":"2024-09-12T17:38:32.354215+0000","last_became_active":"2024-09-12T17:27:17.417574+0000","last_became_peered":"2024-09-12T17:27:17.417574+0000","last_unstale":"2024-09-12T17:38:32.354215+0000","last_undegraded":"2024-09-12T17:38:32.354215+0000","last_fullsized":"2024-09-12T17:38:32.354215+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:54.585796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"265'4","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.171147+0000","last_change":"2024-09-12T17:15:43.151790+0000","last_active":"2024-09-12T17:41:33.171147+0000","last_peered":"2024-09-12T17:41:33.171147+0000","last_clean":"2024-09-12T17:41:33.171147+0000","last_became_active":"2024-09-12T17:15:43.151000+0000","last_became_peered":"2024-09-12T17:15:43.151000+0000","last_unstale":"2024-09-12T17:41:33.171147+0000","last_undegraded":"2024-09-12T17:41:33.171147+0000","last_fullsized":"2024-09-12T17:41:33.171147+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"262'2","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:15.619233+0000","last_change":"2024-09-12T17:42:15.619233+0000","last_active":"2024-09-12T17:42:15.619233+0000","last_peered":"2024-09-12T17:42:15.619233+0000","last_clean":"2024-09-12T17:42:15.619233+0000","last_became_active":"2024-09-12T17:15:40.118469+0000","last_became_peered":"2024-09-12T17:15:40.118469+0000","last_unstale":"2024-09-12T17:42:15.619233+0000","last_undegraded":"2024-09-12T17:42:15.619233+0000","last_fullsized":"2024-09-12T17:42:15.619233+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T17:42:15.619039+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T17:42:15.619039+0000","last_clean_scrub_stamp":"2024-09-12T17:42:15.619039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:33.245776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"265'20","reported_seq":108,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:05.415520+0000","last_change":"2024-09-12T17:42:05.415245+0000","last_active":"2024-09-12T17:42:05.415520+0000","last_peered":"2024-09-12T17:42:05.415520+0000","last_clean":"2024-09-12T17:42:05.415520+0000","last_became_active":"2024-09-12T17:13:54.827570+0000","last_became_peered":"2024-09-12T17:13:54.827570+0000","last_unstale":"2024-09-12T17:42:05.415520+0000","last_undegraded":"2024-09-12T17:42:05.415520+0000","last_fullsized":"2024-09-12T17:42:05.415520+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'20","last_scrub_stamp":"2024-09-12T17:42:05.415005+0000","last_deep_scrub":"265'20","last_deep_scrub_stamp":"2024-09-12T17:42:05.415005+0000","last_clean_scrub_stamp":"2024-09-12T17:42:05.415005+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:47.650137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":63,"num_write":42,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:51.327788+0000","last_change":"2024-09-12T17:27:17.411486+0000","last_active":"2024-09-12T17:39:51.327788+0000","last_peered":"2024-09-12T17:39:51.327788+0000","last_clean":"2024-09-12T17:39:51.327788+0000","last_became_active":"2024-09-12T17:27:17.411175+0000","last_became_peered":"2024-09-12T17:27:17.411175+0000","last_unstale":"2024-09-12T17:39:51.327788+0000","last_undegraded":"2024-09-12T17:39:51.327788+0000","last_fullsized":"2024-09-12T17:39:51.327788+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"265'5","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:47.385482+0000","last_change":"2024-09-12T17:15:43.159928+0000","last_active":"2024-09-12T17:40:47.385482+0000","last_peered":"2024-09-12T17:40:47.385482+0000","last_clean":"2024-09-12T17:40:47.385482+0000","last_became_active":"2024-09-12T17:15:43.159149+0000","last_became_peered":"2024-09-12T17:15:43.159149+0000","last_unstale":"2024-09-12T17:40:47.385482+0000","last_undegraded":"2024-09-12T17:40:47.385482+0000","last_fullsized":"2024-09-12T17:40:47.385482+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:34.107337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2048,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"265'7","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:41.339938+0000","last_change":"2024-09-12T17:15:40.122291+0000","last_active":"2024-09-12T17:40:41.339938+0000","last_peered":"2024-09-12T17:40:41.339938+0000","last_clean":"2024-09-12T17:40:41.339938+0000","last_became_active":"2024-09-12T17:15:40.121513+0000","last_became_peered":"2024-09-12T17:15:40.121513+0000","last_unstale":"2024-09-12T17:40:41.339938+0000","last_undegraded":"2024-09-12T17:40:41.339938+0000","last_fullsized":"2024-09-12T17:40:41.339938+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:00.339305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6144,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"265'31","reported_seq":140,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:16.929769+0000","last_change":"2024-09-12T17:42:16.929769+0000","last_active":"2024-09-12T17:42:16.929769+0000","last_peered":"2024-09-12T17:42:16.929769+0000","last_clean":"2024-09-12T17:42:16.929769+0000","last_became_active":"2024-09-12T17:13:54.828393+0000","last_became_peered":"2024-09-12T17:13:54.828393+0000","last_unstale":"2024-09-12T17:42:16.929769+0000","last_undegraded":"2024-09-12T17:42:16.929769+0000","last_fullsized":"2024-09-12T17:42:16.929769+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'31","last_scrub_stamp":"2024-09-12T17:42:16.929541+0000","last_deep_scrub":"265'31","last_deep_scrub_stamp":"2024-09-12T17:42:16.929541+0000","last_clean_scrub_stamp":"2024-09-12T17:42:16.929541+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:04.659867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":109,"num_write":58,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:47.356489+0000","last_change":"2024-09-12T17:27:17.402782+0000","last_active":"2024-09-12T17:39:47.356489+0000","last_peered":"2024-09-12T17:39:47.356489+0000","last_clean":"2024-09-12T17:39:47.356489+0000","last_became_active":"2024-09-12T17:27:17.402024+0000","last_became_peered":"2024-09-12T17:27:17.402024+0000","last_unstale":"2024-09-12T17:39:47.356489+0000","last_undegraded":"2024-09-12T17:39:47.356489+0000","last_fullsized":"2024-09-12T17:39:47.356489+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:37.355395+0000","last_change":"2024-09-12T17:15:43.871865+0000","last_active":"2024-09-12T17:38:37.355395+0000","last_peered":"2024-09-12T17:38:37.355395+0000","last_clean":"2024-09-12T17:38:37.355395+0000","last_became_active":"2024-09-12T17:15:43.871095+0000","last_became_peered":"2024-09-12T17:15:43.871095+0000","last_unstale":"2024-09-12T17:38:37.355395+0000","last_undegraded":"2024-09-12T17:38:37.355395+0000","last_fullsized":"2024-09-12T17:38:37.355395+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:26.988527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'9","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:00.694187+0000","last_change":"2024-09-12T17:42:00.694187+0000","last_active":"2024-09-12T17:42:00.694187+0000","last_peered":"2024-09-12T17:42:00.694187+0000","last_clean":"2024-09-12T17:42:00.694187+0000","last_became_active":"2024-09-12T17:15:40.125684+0000","last_became_peered":"2024-09-12T17:15:40.125684+0000","last_unstale":"2024-09-12T17:42:00.694187+0000","last_undegraded":"2024-09-12T17:42:00.694187+0000","last_fullsized":"2024-09-12T17:42:00.694187+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'9","last_scrub_stamp":"2024-09-12T17:42:00.694013+0000","last_deep_scrub":"265'9","last_deep_scrub_stamp":"2024-09-12T17:42:00.694013+0000","last_clean_scrub_stamp":"2024-09-12T17:42:00.694013+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:18.914344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":32770,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"265'38","reported_seq":156,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:04.376544+0000","last_change":"2024-09-12T17:42:04.376407+0000","last_active":"2024-09-12T17:42:04.376544+0000","last_peered":"2024-09-12T17:42:04.376544+0000","last_clean":"2024-09-12T17:42:04.376544+0000","last_became_active":"2024-09-12T17:13:54.825945+0000","last_became_peered":"2024-09-12T17:13:54.825945+0000","last_unstale":"2024-09-12T17:42:04.376544+0000","last_undegraded":"2024-09-12T17:42:04.376544+0000","last_fullsized":"2024-09-12T17:42:04.376544+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'38","last_scrub_stamp":"2024-09-12T17:42:04.376219+0000","last_deep_scrub":"265'38","last_deep_scrub_stamp":"2024-09-12T17:42:04.376219+0000","last_clean_scrub_stamp":"2024-09-12T17:42:04.376219+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:13.365245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":132,"num_write":66,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:17.484778+0000","last_change":"2024-09-12T17:42:17.484778+0000","last_active":"2024-09-12T17:42:17.484778+0000","last_peered":"2024-09-12T17:42:17.484778+0000","last_clean":"2024-09-12T17:42:17.484778+0000","last_became_active":"2024-09-12T17:27:17.408445+0000","last_became_peered":"2024-09-12T17:27:17.408445+0000","last_unstale":"2024-09-12T17:42:17.484778+0000","last_undegraded":"2024-09-12T17:42:17.484778+0000","last_fullsized":"2024-09-12T17:42:17.484778+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:17.484596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:17.484596+0000","last_clean_scrub_stamp":"2024-09-12T17:42:17.484596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:49:48.661676+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:36.324164+0000","last_change":"2024-09-12T17:15:43.867204+0000","last_active":"2024-09-12T17:39:36.324164+0000","last_peered":"2024-09-12T17:39:36.324164+0000","last_clean":"2024-09-12T17:39:36.324164+0000","last_became_active":"2024-09-12T17:15:43.866375+0000","last_became_peered":"2024-09-12T17:15:43.866375+0000","last_unstale":"2024-09-12T17:39:36.324164+0000","last_undegraded":"2024-09-12T17:39:36.324164+0000","last_fullsized":"2024-09-12T17:39:36.324164+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"265'6","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.400557+0000","last_change":"2024-09-12T17:15:40.125566+0000","last_active":"2024-09-12T17:41:32.400557+0000","last_peered":"2024-09-12T17:41:32.400557+0000","last_clean":"2024-09-12T17:41:32.400557+0000","last_became_active":"2024-09-12T17:15:40.124901+0000","last_became_peered":"2024-09-12T17:15:40.124901+0000","last_unstale":"2024-09-12T17:41:32.400557+0000","last_undegraded":"2024-09-12T17:41:32.400557+0000","last_fullsized":"2024-09-12T17:41:32.400557+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"265'32","reported_seq":138,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:15.700625+0000","last_change":"2024-09-12T17:42:15.700625+0000","last_active":"2024-09-12T17:42:15.700625+0000","last_peered":"2024-09-12T17:42:15.700625+0000","last_clean":"2024-09-12T17:42:15.700625+0000","last_became_active":"2024-09-12T17:13:54.824810+0000","last_became_peered":"2024-09-12T17:13:54.824810+0000","last_unstale":"2024-09-12T17:42:15.700625+0000","last_undegraded":"2024-09-12T17:42:15.700625+0000","last_fullsized":"2024-09-12T17:42:15.700625+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'32","last_scrub_stamp":"2024-09-12T17:42:15.700378+0000","last_deep_scrub":"265'32","last_deep_scrub_stamp":"2024-09-12T17:42:15.700378+0000","last_clean_scrub_stamp":"2024-09-12T17:42:15.700378+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:03:14.023849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":107,"num_write":61,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:51.303182+0000","last_change":"2024-09-12T17:27:17.410104+0000","last_active":"2024-09-12T17:39:51.303182+0000","last_peered":"2024-09-12T17:39:51.303182+0000","last_clean":"2024-09-12T17:39:51.303182+0000","last_became_active":"2024-09-12T17:27:17.409774+0000","last_became_peered":"2024-09-12T17:27:17.409774+0000","last_unstale":"2024-09-12T17:39:51.303182+0000","last_undegraded":"2024-09-12T17:39:51.303182+0000","last_fullsized":"2024-09-12T17:39:51.303182+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:36.300111+0000","last_change":"2024-09-12T17:15:43.171491+0000","last_active":"2024-09-12T17:39:36.300111+0000","last_peered":"2024-09-12T17:39:36.300111+0000","last_clean":"2024-09-12T17:39:36.300111+0000","last_became_active":"2024-09-12T17:15:43.167221+0000","last_became_peered":"2024-09-12T17:15:43.167221+0000","last_unstale":"2024-09-12T17:39:36.300111+0000","last_undegraded":"2024-09-12T17:39:36.300111+0000","last_fullsized":"2024-09-12T17:39:36.300111+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"262'5","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:31.322823+0000","last_change":"2024-09-12T17:15:40.131852+0000","last_active":"2024-09-12T17:39:31.322823+0000","last_peered":"2024-09-12T17:39:31.322823+0000","last_clean":"2024-09-12T17:39:31.322823+0000","last_became_active":"2024-09-12T17:15:40.131162+0000","last_became_peered":"2024-09-12T17:15:40.131162+0000","last_unstale":"2024-09-12T17:39:31.322823+0000","last_undegraded":"2024-09-12T17:39:31.322823+0000","last_fullsized":"2024-09-12T17:39:31.322823+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"265'229","reported_seq":772,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:07.444406+0000","last_change":"2024-09-12T17:42:07.444406+0000","last_active":"2024-09-12T17:42:07.444406+0000","last_peered":"2024-09-12T17:42:07.444406+0000","last_clean":"2024-09-12T17:42:07.444406+0000","last_became_active":"2024-09-12T17:13:54.824372+0000","last_became_peered":"2024-09-12T17:13:54.824372+0000","last_unstale":"2024-09-12T17:42:07.444406+0000","last_undegraded":"2024-09-12T17:42:07.444406+0000","last_fullsized":"2024-09-12T17:42:07.444406+0000","mapping_epoch":252,"log_start":"262'200","ondisk_log_start":"262'200","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'229","last_scrub_stamp":"2024-09-12T17:42:07.444210+0000","last_deep_scrub":"265'229","last_deep_scrub_stamp":"2024-09-12T17:42:07.444210+0000","last_clean_scrub_stamp":"2024-09-12T17:42:07.444210+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:01.339439+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1417,"num_read_kb":1102,"num_write":261,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4473,"num_omap_keys":9,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"265'2","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:07.648128+0000","last_change":"2024-09-12T17:42:07.648128+0000","last_active":"2024-09-12T17:42:07.648128+0000","last_peered":"2024-09-12T17:42:07.648128+0000","last_clean":"2024-09-12T17:42:07.648128+0000","last_became_active":"2024-09-12T17:27:17.404001+0000","last_became_peered":"2024-09-12T17:27:17.404001+0000","last_unstale":"2024-09-12T17:42:07.648128+0000","last_undegraded":"2024-09-12T17:42:07.648128+0000","last_fullsized":"2024-09-12T17:42:07.648128+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T17:42:07.647942+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T17:42:07.647942+0000","last_clean_scrub_stamp":"2024-09-12T17:42:07.647942+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:29.596236+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:13.486876+0000","last_change":"2024-09-12T17:42:13.486876+0000","last_active":"2024-09-12T17:42:13.486876+0000","last_peered":"2024-09-12T17:42:13.486876+0000","last_clean":"2024-09-12T17:42:13.486876+0000","last_became_active":"2024-09-12T17:15:43.159256+0000","last_became_peered":"2024-09-12T17:15:43.159256+0000","last_unstale":"2024-09-12T17:42:13.486876+0000","last_undegraded":"2024-09-12T17:42:13.486876+0000","last_fullsized":"2024-09-12T17:42:13.486876+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:13.486634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:13.486634+0000","last_clean_scrub_stamp":"2024-09-12T17:42:13.486634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:56.304484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"265'2","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.235653+0000","last_change":"2024-09-12T17:15:40.139358+0000","last_active":"2024-09-12T17:41:32.235653+0000","last_peered":"2024-09-12T17:41:32.235653+0000","last_clean":"2024-09-12T17:41:32.235653+0000","last_became_active":"2024-09-12T17:15:40.138844+0000","last_became_peered":"2024-09-12T17:15:40.138844+0000","last_unstale":"2024-09-12T17:41:32.235653+0000","last_undegraded":"2024-09-12T17:41:32.235653+0000","last_fullsized":"2024-09-12T17:41:32.235653+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"265'38","reported_seq":156,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:16.620946+0000","last_change":"2024-09-12T17:42:16.620946+0000","last_active":"2024-09-12T17:42:16.620946+0000","last_peered":"2024-09-12T17:42:16.620946+0000","last_clean":"2024-09-12T17:42:16.620946+0000","last_became_active":"2024-09-12T17:13:54.830999+0000","last_became_peered":"2024-09-12T17:13:54.830999+0000","last_unstale":"2024-09-12T17:42:16.620946+0000","last_undegraded":"2024-09-12T17:42:16.620946+0000","last_fullsized":"2024-09-12T17:42:16.620946+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'38","last_scrub_stamp":"2024-09-12T17:42:16.620766+0000","last_deep_scrub":"265'38","last_deep_scrub_stamp":"2024-09-12T17:42:16.620766+0000","last_clean_scrub_stamp":"2024-09-12T17:42:16.620766+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:21.210400+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":129,"num_write":64,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:07.348306+0000","last_change":"2024-09-12T17:27:17.413681+0000","last_active":"2024-09-12T17:38:07.348306+0000","last_peered":"2024-09-12T17:38:07.348306+0000","last_clean":"2024-09-12T17:38:07.348306+0000","last_became_active":"2024-09-12T17:27:17.412921+0000","last_became_peered":"2024-09-12T17:27:17.412921+0000","last_unstale":"2024-09-12T17:38:07.348306+0000","last_undegraded":"2024-09-12T17:38:07.348306+0000","last_fullsized":"2024-09-12T17:38:07.348306+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:10.295122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"265'4","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:33.171635+0000","last_change":"2024-09-12T17:15:43.155640+0000","last_active":"2024-09-12T17:41:33.171635+0000","last_peered":"2024-09-12T17:41:33.171635+0000","last_clean":"2024-09-12T17:41:33.171635+0000","last_became_active":"2024-09-12T17:15:43.154940+0000","last_became_peered":"2024-09-12T17:15:43.154940+0000","last_unstale":"2024-09-12T17:41:33.171635+0000","last_undegraded":"2024-09-12T17:41:33.171635+0000","last_fullsized":"2024-09-12T17:41:33.171635+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:36.309541+0000","last_change":"2024-09-12T17:15:40.127548+0000","last_active":"2024-09-12T17:38:36.309541+0000","last_peered":"2024-09-12T17:38:36.309541+0000","last_clean":"2024-09-12T17:38:36.309541+0000","last_became_active":"2024-09-12T17:15:40.126745+0000","last_became_peered":"2024-09-12T17:15:40.126745+0000","last_unstale":"2024-09-12T17:38:36.309541+0000","last_undegraded":"2024-09-12T17:38:36.309541+0000","last_fullsized":"2024-09-12T17:38:36.309541+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:39.072447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.072447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:58.903944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"265'14","reported_seq":86,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:32.319736+0000","last_change":"2024-09-12T17:13:54.841357+0000","last_active":"2024-09-12T17:39:32.319736+0000","last_peered":"2024-09-12T17:39:32.319736+0000","last_clean":"2024-09-12T17:39:32.319736+0000","last_became_active":"2024-09-12T17:13:54.840501+0000","last_became_peered":"2024-09-12T17:13:54.840501+0000","last_unstale":"2024-09-12T17:39:32.319736+0000","last_undegraded":"2024-09-12T17:39:32.319736+0000","last_fullsized":"2024-09-12T17:39:32.319736+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:13:53.783642+0000","last_clean_scrub_stamp":"2024-09-12T17:13:53.783642+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:07:40.561312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":51,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:47.372918+0000","last_change":"2024-09-12T17:27:17.423169+0000","last_active":"2024-09-12T17:39:47.372918+0000","last_peered":"2024-09-12T17:39:47.372918+0000","last_clean":"2024-09-12T17:39:47.372918+0000","last_became_active":"2024-09-12T17:27:17.421504+0000","last_became_peered":"2024-09-12T17:27:17.421504+0000","last_unstale":"2024-09-12T17:39:47.372918+0000","last_undegraded":"2024-09-12T17:39:47.372918+0000","last_fullsized":"2024-09-12T17:39:47.372918+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"265'3","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:12.364437+0000","last_change":"2024-09-12T17:42:12.364437+0000","last_active":"2024-09-12T17:42:12.364437+0000","last_peered":"2024-09-12T17:42:12.364437+0000","last_clean":"2024-09-12T17:42:12.364437+0000","last_became_active":"2024-09-12T17:15:43.162406+0000","last_became_peered":"2024-09-12T17:15:43.162406+0000","last_unstale":"2024-09-12T17:42:12.364437+0000","last_undegraded":"2024-09-12T17:42:12.364437+0000","last_fullsized":"2024-09-12T17:42:12.364437+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T17:42:12.364241+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T17:42:12.364241+0000","last_clean_scrub_stamp":"2024-09-12T17:42:12.364241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:18.772651+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"265'11","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:09.531921+0000","last_change":"2024-09-12T17:42:09.531921+0000","last_active":"2024-09-12T17:42:09.531921+0000","last_peered":"2024-09-12T17:42:09.531921+0000","last_clean":"2024-09-12T17:42:09.531921+0000","last_became_active":"2024-09-12T17:15:40.115746+0000","last_became_peered":"2024-09-12T17:15:40.115746+0000","last_unstale":"2024-09-12T17:42:09.531921+0000","last_undegraded":"2024-09-12T17:42:09.531921+0000","last_fullsized":"2024-09-12T17:42:09.531921+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'11","last_scrub_stamp":"2024-09-12T17:42:09.531744+0000","last_deep_scrub":"265'11","last_deep_scrub_stamp":"2024-09-12T17:42:09.531744+0000","last_clean_scrub_stamp":"2024-09-12T17:42:09.531744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:01.984539+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12288,"num_write":16,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"265'17","reported_seq":104,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:07.413545+0000","last_change":"2024-09-12T17:42:07.413545+0000","last_active":"2024-09-12T17:42:07.413545+0000","last_peered":"2024-09-12T17:42:07.413545+0000","last_clean":"2024-09-12T17:42:07.413545+0000","last_became_active":"2024-09-12T17:13:54.838008+0000","last_became_peered":"2024-09-12T17:13:54.838008+0000","last_unstale":"2024-09-12T17:42:07.413545+0000","last_undegraded":"2024-09-12T17:42:07.413545+0000","last_fullsized":"2024-09-12T17:42:07.413545+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'17","last_scrub_stamp":"2024-09-12T17:42:07.413371+0000","last_deep_scrub":"265'17","last_deep_scrub_stamp":"2024-09-12T17:42:07.413371+0000","last_clean_scrub_stamp":"2024-09-12T17:42:07.413371+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:32.085492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":61,"num_write":32,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:56.329010+0000","last_change":"2024-09-12T17:27:17.409064+0000","last_active":"2024-09-12T17:39:56.329010+0000","last_peered":"2024-09-12T17:39:56.329010+0000","last_clean":"2024-09-12T17:39:56.329010+0000","last_became_active":"2024-09-12T17:27:17.408296+0000","last_became_peered":"2024-09-12T17:27:17.408296+0000","last_unstale":"2024-09-12T17:39:56.329010+0000","last_undegraded":"2024-09-12T17:39:56.329010+0000","last_fullsized":"2024-09-12T17:39:56.329010+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"265'6","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:46.315558+0000","last_change":"2024-09-12T17:15:43.165243+0000","last_active":"2024-09-12T17:40:46.315558+0000","last_peered":"2024-09-12T17:40:46.315558+0000","last_clean":"2024-09-12T17:40:46.315558+0000","last_became_active":"2024-09-12T17:15:43.163824+0000","last_became_peered":"2024-09-12T17:15:43.163824+0000","last_unstale":"2024-09-12T17:40:46.315558+0000","last_undegraded":"2024-09-12T17:40:46.315558+0000","last_fullsized":"2024-09-12T17:40:46.315558+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:49.835850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5122,"num_write":6,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:09.367288+0000","last_change":"2024-09-12T17:42:09.367288+0000","last_active":"2024-09-12T17:42:09.367288+0000","last_peered":"2024-09-12T17:42:09.367288+0000","last_clean":"2024-09-12T17:42:09.367288+0000","last_became_active":"2024-09-12T17:15:40.114860+0000","last_became_peered":"2024-09-12T17:15:40.114860+0000","last_unstale":"2024-09-12T17:42:09.367288+0000","last_undegraded":"2024-09-12T17:42:09.367288+0000","last_fullsized":"2024-09-12T17:42:09.367288+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:09.367097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:09.367097+0000","last_clean_scrub_stamp":"2024-09-12T17:42:09.367097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:54.058677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"265'55","reported_seq":206,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:14.711159+0000","last_change":"2024-09-12T17:42:14.711159+0000","last_active":"2024-09-12T17:42:14.711159+0000","last_peered":"2024-09-12T17:42:14.711159+0000","last_clean":"2024-09-12T17:42:14.711159+0000","last_became_active":"2024-09-12T17:13:54.832949+0000","last_became_peered":"2024-09-12T17:13:54.832949+0000","last_unstale":"2024-09-12T17:42:14.711159+0000","last_undegraded":"2024-09-12T17:42:14.711159+0000","last_fullsized":"2024-09-12T17:42:14.711159+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'55","last_scrub_stamp":"2024-09-12T17:42:14.710966+0000","last_deep_scrub":"265'55","last_deep_scrub_stamp":"2024-09-12T17:42:14.710966+0000","last_clean_scrub_stamp":"2024-09-12T17:42:14.710966+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:59.222600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":283,"num_read_kb":200,"num_write":95,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"265'393","reported_seq":1093,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:49.548806+0000","last_change":"2024-09-12T17:41:49.548572+0000","last_active":"2024-09-12T17:41:49.548806+0000","last_peered":"2024-09-12T17:41:49.548806+0000","last_clean":"2024-09-12T17:41:49.548806+0000","last_became_active":"2024-09-12T16:58:18.713754+0000","last_became_peered":"2024-09-12T16:58:18.713754+0000","last_unstale":"2024-09-12T17:41:49.548806+0000","last_undegraded":"2024-09-12T17:41:49.548806+0000","last_fullsized":"2024-09-12T17:41:49.548806+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'393","last_scrub_stamp":"2024-09-12T17:41:49.548319+0000","last_deep_scrub":"265'393","last_deep_scrub_stamp":"2024-09-12T17:41:49.548319+0000","last_clean_scrub_stamp":"2024-09-12T17:41:49.548319+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:37.288699+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":207329,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":632,"num_read_kb":52184,"num_write":1250,"num_write_kb":52679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"265'127","reported_seq":734,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:57.590054+0000","last_change":"2024-09-12T17:41:57.590054+0000","last_active":"2024-09-12T17:41:57.590054+0000","last_peered":"2024-09-12T17:41:57.590054+0000","last_clean":"2024-09-12T17:41:57.590054+0000","last_became_active":"2024-09-12T16:58:21.708409+0000","last_became_peered":"2024-09-12T16:58:21.708409+0000","last_unstale":"2024-09-12T17:41:57.590054+0000","last_undegraded":"2024-09-12T17:41:57.590054+0000","last_fullsized":"2024-09-12T17:41:57.590054+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'127","last_scrub_stamp":"2024-09-12T17:41:57.589826+0000","last_deep_scrub":"265'127","last_deep_scrub_stamp":"2024-09-12T17:41:57.589826+0000","last_clean_scrub_stamp":"2024-09-12T17:41:57.589826+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:20.676074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":568,"num_read_kb":472,"num_write":186,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"265'363","reported_seq":997,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:45.351273+0000","last_change":"2024-09-12T17:41:45.351133+0000","last_active":"2024-09-12T17:41:45.351273+0000","last_peered":"2024-09-12T17:41:45.351273+0000","last_clean":"2024-09-12T17:41:45.351273+0000","last_became_active":"2024-09-12T16:58:18.699994+0000","last_became_peered":"2024-09-12T16:58:18.699994+0000","last_unstale":"2024-09-12T17:41:45.351273+0000","last_undegraded":"2024-09-12T17:41:45.351273+0000","last_fullsized":"2024-09-12T17:41:45.351273+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'363","last_scrub_stamp":"2024-09-12T17:41:45.350930+0000","last_deep_scrub":"265'363","last_deep_scrub_stamp":"2024-09-12T17:41:45.350930+0000","last_clean_scrub_stamp":"2024-09-12T17:41:45.350930+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:17.973292+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263228,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":513,"num_read_kb":14780,"num_write":1119,"num_write_kb":32109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"265'61","reported_seq":648,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:56.670046+0000","last_change":"2024-09-12T17:41:56.670046+0000","last_active":"2024-09-12T17:41:56.670046+0000","last_peered":"2024-09-12T17:41:56.670046+0000","last_clean":"2024-09-12T17:41:56.670046+0000","last_became_active":"2024-09-12T16:58:21.721536+0000","last_became_peered":"2024-09-12T16:58:21.721536+0000","last_unstale":"2024-09-12T17:41:56.670046+0000","last_undegraded":"2024-09-12T17:41:56.670046+0000","last_fullsized":"2024-09-12T17:41:56.670046+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'61","last_scrub_stamp":"2024-09-12T17:41:56.669852+0000","last_deep_scrub":"265'61","last_deep_scrub_stamp":"2024-09-12T17:41:56.669852+0000","last_clean_scrub_stamp":"2024-09-12T17:41:56.669852+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:36.236526+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":297,"num_read_kb":264,"num_write":81,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"265'426","reported_seq":1242,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:48.141322+0000","last_change":"2024-09-12T17:41:48.141167+0000","last_active":"2024-09-12T17:41:48.141322+0000","last_peered":"2024-09-12T17:41:48.141322+0000","last_clean":"2024-09-12T17:41:48.141322+0000","last_became_active":"2024-09-12T16:58:18.687865+0000","last_became_peered":"2024-09-12T16:58:18.687865+0000","last_unstale":"2024-09-12T17:41:48.141322+0000","last_undegraded":"2024-09-12T17:41:48.141322+0000","last_fullsized":"2024-09-12T17:41:48.141322+0000","mapping_epoch":23,"log_start":"265'400","ondisk_log_start":"265'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'426","last_scrub_stamp":"2024-09-12T17:41:48.140932+0000","last_deep_scrub":"265'426","last_deep_scrub_stamp":"2024-09-12T17:41:48.140932+0000","last_clean_scrub_stamp":"2024-09-12T17:41:48.140932+0000","objects_scrubbed":9,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:06.456200+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263210,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1063,"num_read_kb":27565,"num_write":1556,"num_write_kb":41677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"265'166","reported_seq":768,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:55.642706+0000","last_change":"2024-09-12T17:41:55.642706+0000","last_active":"2024-09-12T17:41:55.642706+0000","last_peered":"2024-09-12T17:41:55.642706+0000","last_clean":"2024-09-12T17:41:55.642706+0000","last_became_active":"2024-09-12T16:58:21.703861+0000","last_became_peered":"2024-09-12T16:58:21.703861+0000","last_unstale":"2024-09-12T17:41:55.642706+0000","last_undegraded":"2024-09-12T17:41:55.642706+0000","last_fullsized":"2024-09-12T17:41:55.642706+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'166","last_scrub_stamp":"2024-09-12T17:41:55.642509+0000","last_deep_scrub":"265'166","last_deep_scrub_stamp":"2024-09-12T17:41:55.642509+0000","last_clean_scrub_stamp":"2024-09-12T17:41:55.642509+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:44.318567+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":693,"num_read_kb":563,"num_write":272,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"265'374","reported_seq":1035,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:51.657131+0000","last_change":"2024-09-12T17:41:51.657131+0000","last_active":"2024-09-12T17:41:51.657131+0000","last_peered":"2024-09-12T17:41:51.657131+0000","last_clean":"2024-09-12T17:41:51.657131+0000","last_became_active":"2024-09-12T16:58:18.716783+0000","last_became_peered":"2024-09-12T16:58:18.716783+0000","last_unstale":"2024-09-12T17:41:51.657131+0000","last_undegraded":"2024-09-12T17:41:51.657131+0000","last_fullsized":"2024-09-12T17:41:51.657131+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'374","last_scrub_stamp":"2024-09-12T17:41:51.656864+0000","last_deep_scrub":"265'374","last_deep_scrub_stamp":"2024-09-12T17:41:51.656864+0000","last_clean_scrub_stamp":"2024-09-12T17:41:51.656864+0000","objects_scrubbed":7,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:26.088285+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":698119,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":542,"num_read_kb":33905,"num_write":1205,"num_write_kb":31442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"265'207","reported_seq":817,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:54.056910+0000","last_change":"2024-09-12T17:41:54.056910+0000","last_active":"2024-09-12T17:41:54.056910+0000","last_peered":"2024-09-12T17:41:54.056910+0000","last_clean":"2024-09-12T17:41:54.056910+0000","last_became_active":"2024-09-12T16:58:21.699869+0000","last_became_peered":"2024-09-12T16:58:21.699869+0000","last_unstale":"2024-09-12T17:41:54.056910+0000","last_undegraded":"2024-09-12T17:41:54.056910+0000","last_fullsized":"2024-09-12T17:41:54.056910+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'207","last_scrub_stamp":"2024-09-12T17:41:54.056679+0000","last_deep_scrub":"265'207","last_deep_scrub_stamp":"2024-09-12T17:41:54.056679+0000","last_clean_scrub_stamp":"2024-09-12T17:41:54.056679+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:21.954587+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":874,"num_read_kb":727,"num_write":307,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"265'359","reported_seq":1031,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:50.584607+0000","last_change":"2024-09-12T17:41:50.584607+0000","last_active":"2024-09-12T17:41:50.584607+0000","last_peered":"2024-09-12T17:41:50.584607+0000","last_clean":"2024-09-12T17:41:50.584607+0000","last_became_active":"2024-09-12T16:58:18.688345+0000","last_became_peered":"2024-09-12T16:58:18.688345+0000","last_unstale":"2024-09-12T17:41:50.584607+0000","last_undegraded":"2024-09-12T17:41:50.584607+0000","last_fullsized":"2024-09-12T17:41:50.584607+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'359","last_scrub_stamp":"2024-09-12T17:41:50.584401+0000","last_deep_scrub":"265'359","last_deep_scrub_stamp":"2024-09-12T17:41:50.584401+0000","last_clean_scrub_stamp":"2024-09-12T17:41:50.584401+0000","objects_scrubbed":7,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:59.917375+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263227,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":585,"num_read_kb":27999,"num_write":1129,"num_write_kb":20285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"265'277","reported_seq":928,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:51.482503+0000","last_change":"2024-09-12T17:41:51.482503+0000","last_active":"2024-09-12T17:41:51.482503+0000","last_peered":"2024-09-12T17:41:51.482503+0000","last_clean":"2024-09-12T17:41:51.482503+0000","last_became_active":"2024-09-12T16:58:21.709879+0000","last_became_peered":"2024-09-12T16:58:21.709879+0000","last_unstale":"2024-09-12T17:41:51.482503+0000","last_undegraded":"2024-09-12T17:41:51.482503+0000","last_fullsized":"2024-09-12T17:41:51.482503+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'277","last_scrub_stamp":"2024-09-12T17:41:51.482314+0000","last_deep_scrub":"265'277","last_deep_scrub_stamp":"2024-09-12T17:41:51.482314+0000","last_clean_scrub_stamp":"2024-09-12T17:41:51.482314+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:57.714571+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1330,"num_read_kb":1122,"num_write":481,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"265'397","reported_seq":1054,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:49.610921+0000","last_change":"2024-09-12T17:41:49.610921+0000","last_active":"2024-09-12T17:41:49.610921+0000","last_peered":"2024-09-12T17:41:49.610921+0000","last_clean":"2024-09-12T17:41:49.610921+0000","last_became_active":"2024-09-12T16:58:18.698280+0000","last_became_peered":"2024-09-12T16:58:18.698280+0000","last_unstale":"2024-09-12T17:41:49.610921+0000","last_undegraded":"2024-09-12T17:41:49.610921+0000","last_fullsized":"2024-09-12T17:41:49.610921+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'397","last_scrub_stamp":"2024-09-12T17:41:49.610656+0000","last_deep_scrub":"265'397","last_deep_scrub_stamp":"2024-09-12T17:41:49.610656+0000","last_clean_scrub_stamp":"2024-09-12T17:41:49.610656+0000","objects_scrubbed":11,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:39.785159+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8651850,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":594,"num_read_kb":25091,"num_write":1290,"num_write_kb":36260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"265'157","reported_seq":769,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:58.628960+0000","last_change":"2024-09-12T17:41:58.628784+0000","last_active":"2024-09-12T17:41:58.628960+0000","last_peered":"2024-09-12T17:41:58.628960+0000","last_clean":"2024-09-12T17:41:58.628960+0000","last_became_active":"2024-09-12T16:58:21.706493+0000","last_became_peered":"2024-09-12T16:58:21.706493+0000","last_unstale":"2024-09-12T17:41:58.628960+0000","last_undegraded":"2024-09-12T17:41:58.628960+0000","last_fullsized":"2024-09-12T17:41:58.628960+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'157","last_scrub_stamp":"2024-09-12T17:41:58.628606+0000","last_deep_scrub":"265'157","last_deep_scrub_stamp":"2024-09-12T17:41:58.628606+0000","last_clean_scrub_stamp":"2024-09-12T17:41:58.628606+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:25.437543+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":697,"num_read_kb":578,"num_write":245,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"265'335","reported_seq":1001,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:53.613886+0000","last_change":"2024-09-12T17:41:53.613886+0000","last_active":"2024-09-12T17:41:53.613886+0000","last_peered":"2024-09-12T17:41:53.613886+0000","last_clean":"2024-09-12T17:41:53.613886+0000","last_became_active":"2024-09-12T16:58:18.694357+0000","last_became_peered":"2024-09-12T16:58:18.694357+0000","last_unstale":"2024-09-12T17:41:53.613886+0000","last_undegraded":"2024-09-12T17:41:53.613886+0000","last_fullsized":"2024-09-12T17:41:53.613886+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'335","last_scrub_stamp":"2024-09-12T17:41:53.613673+0000","last_deep_scrub":"265'335","last_deep_scrub_stamp":"2024-09-12T17:41:53.613673+0000","last_clean_scrub_stamp":"2024-09-12T17:41:53.613673+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:18.786062+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":485,"num_read_kb":76108,"num_write":1068,"num_write_kb":48403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"265'76","reported_seq":662,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:58.572144+0000","last_change":"2024-09-12T17:41:58.571844+0000","last_active":"2024-09-12T17:41:58.572144+0000","last_peered":"2024-09-12T17:41:58.572144+0000","last_clean":"2024-09-12T17:41:58.572144+0000","last_became_active":"2024-09-12T16:58:21.723077+0000","last_became_peered":"2024-09-12T16:58:21.723077+0000","last_unstale":"2024-09-12T17:41:58.572144+0000","last_undegraded":"2024-09-12T17:41:58.572144+0000","last_fullsized":"2024-09-12T17:41:58.572144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'76","last_scrub_stamp":"2024-09-12T17:41:58.571628+0000","last_deep_scrub":"265'76","last_deep_scrub_stamp":"2024-09-12T17:41:58.571628+0000","last_clean_scrub_stamp":"2024-09-12T17:41:58.571628+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:40.655917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":363,"num_read_kb":315,"num_write":111,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"265'311","reported_seq":928,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:44.698572+0000","last_change":"2024-09-12T17:41:44.698572+0000","last_active":"2024-09-12T17:41:44.698572+0000","last_peered":"2024-09-12T17:41:44.698572+0000","last_clean":"2024-09-12T17:41:44.698572+0000","last_became_active":"2024-09-12T16:58:18.701590+0000","last_became_peered":"2024-09-12T16:58:18.701590+0000","last_unstale":"2024-09-12T17:41:44.698572+0000","last_undegraded":"2024-09-12T17:41:44.698572+0000","last_fullsized":"2024-09-12T17:41:44.698572+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'311","last_scrub_stamp":"2024-09-12T17:41:44.698375+0000","last_deep_scrub":"265'311","last_deep_scrub_stamp":"2024-09-12T17:41:44.698375+0000","last_clean_scrub_stamp":"2024-09-12T17:41:44.698375+0000","objects_scrubbed":6,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:04.975023+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":399,"num_read_kb":1374,"num_write":924,"num_write_kb":18073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"265'138","reported_seq":748,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:46.474613+0000","last_change":"2024-09-12T17:41:46.474441+0000","last_active":"2024-09-12T17:41:46.474613+0000","last_peered":"2024-09-12T17:41:46.474613+0000","last_clean":"2024-09-12T17:41:46.474613+0000","last_became_active":"2024-09-12T16:58:21.718167+0000","last_became_peered":"2024-09-12T16:58:21.718167+0000","last_unstale":"2024-09-12T17:41:46.474613+0000","last_undegraded":"2024-09-12T17:41:46.474613+0000","last_fullsized":"2024-09-12T17:41:46.474613+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'138","last_scrub_stamp":"2024-09-12T17:41:46.474256+0000","last_deep_scrub":"265'138","last_deep_scrub_stamp":"2024-09-12T17:41:46.474256+0000","last_clean_scrub_stamp":"2024-09-12T17:41:46.474256+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:54.299670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":612,"num_read_kb":510,"num_write":201,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"265'4235","reported_seq":4893,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:56.655702+0000","last_change":"2024-09-12T17:41:56.655702+0000","last_active":"2024-09-12T17:41:56.655702+0000","last_peered":"2024-09-12T17:41:56.655702+0000","last_clean":"2024-09-12T17:41:56.655702+0000","last_became_active":"2024-09-12T16:58:21.697479+0000","last_became_peered":"2024-09-12T16:58:21.697479+0000","last_unstale":"2024-09-12T17:41:56.655702+0000","last_undegraded":"2024-09-12T17:41:56.655702+0000","last_fullsized":"2024-09-12T17:41:56.655702+0000","mapping_epoch":26,"log_start":"265'4200","ondisk_log_start":"265'4200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4235","last_scrub_stamp":"2024-09-12T17:41:56.655505+0000","last_deep_scrub":"265'4235","last_deep_scrub_stamp":"2024-09-12T17:41:56.655505+0000","last_clean_scrub_stamp":"2024-09-12T17:41:56.655505+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":3000,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:42.994552+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17044,"num_read_kb":14289,"num_write":6359,"num_write_kb":3183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"265'324","reported_seq":957,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:46.504232+0000","last_change":"2024-09-12T17:41:46.504070+0000","last_active":"2024-09-12T17:41:46.504232+0000","last_peered":"2024-09-12T17:41:46.504232+0000","last_clean":"2024-09-12T17:41:46.504232+0000","last_became_active":"2024-09-12T16:58:18.713739+0000","last_became_peered":"2024-09-12T16:58:18.713739+0000","last_unstale":"2024-09-12T17:41:46.504232+0000","last_undegraded":"2024-09-12T17:41:46.504232+0000","last_fullsized":"2024-09-12T17:41:46.504232+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'324","last_scrub_stamp":"2024-09-12T17:41:46.503833+0000","last_deep_scrub":"265'324","last_deep_scrub_stamp":"2024-09-12T17:41:46.503833+0000","last_clean_scrub_stamp":"2024-09-12T17:41:46.503833+0000","objects_scrubbed":7,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:49.063988+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":436,"num_read_kb":10222,"num_write":964,"num_write_kb":31220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"265'294","reported_seq":1014,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:55.651444+0000","last_change":"2024-09-12T17:41:55.651444+0000","last_active":"2024-09-12T17:41:55.651444+0000","last_peered":"2024-09-12T17:41:55.651444+0000","last_clean":"2024-09-12T17:41:55.651444+0000","last_became_active":"2024-09-12T16:58:21.723238+0000","last_became_peered":"2024-09-12T16:58:21.723238+0000","last_unstale":"2024-09-12T17:41:55.651444+0000","last_undegraded":"2024-09-12T17:41:55.651444+0000","last_fullsized":"2024-09-12T17:41:55.651444+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'294","last_scrub_stamp":"2024-09-12T17:41:55.651276+0000","last_deep_scrub":"265'294","last_deep_scrub_stamp":"2024-09-12T17:41:55.651276+0000","last_clean_scrub_stamp":"2024-09-12T17:41:55.651276+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:24.004372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1552,"num_read_kb":1372,"num_write":472,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"265'347","reported_seq":968,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:50.456694+0000","last_change":"2024-09-12T17:41:50.456526+0000","last_active":"2024-09-12T17:41:50.456694+0000","last_peered":"2024-09-12T17:41:50.456694+0000","last_clean":"2024-09-12T17:41:50.456694+0000","last_became_active":"2024-09-12T16:58:18.701989+0000","last_became_peered":"2024-09-12T16:58:18.701989+0000","last_unstale":"2024-09-12T17:41:50.456694+0000","last_undegraded":"2024-09-12T17:41:50.456694+0000","last_fullsized":"2024-09-12T17:41:50.456694+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'347","last_scrub_stamp":"2024-09-12T17:41:50.456302+0000","last_deep_scrub":"265'347","last_deep_scrub_stamp":"2024-09-12T17:41:50.456302+0000","last_clean_scrub_stamp":"2024-09-12T17:41:50.456302+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:22.993882+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1343103,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":443,"num_read_kb":5557,"num_write":1028,"num_write_kb":22464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"265'183","reported_seq":799,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:55.659451+0000","last_change":"2024-09-12T17:41:55.659451+0000","last_active":"2024-09-12T17:41:55.659451+0000","last_peered":"2024-09-12T17:41:55.659451+0000","last_clean":"2024-09-12T17:41:55.659451+0000","last_became_active":"2024-09-12T16:58:21.715289+0000","last_became_peered":"2024-09-12T16:58:21.715289+0000","last_unstale":"2024-09-12T17:41:55.659451+0000","last_undegraded":"2024-09-12T17:41:55.659451+0000","last_fullsized":"2024-09-12T17:41:55.659451+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'183","last_scrub_stamp":"2024-09-12T17:41:55.659266+0000","last_deep_scrub":"265'183","last_deep_scrub_stamp":"2024-09-12T17:41:55.659266+0000","last_clean_scrub_stamp":"2024-09-12T17:41:55.659266+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:00.448540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":782,"num_read_kb":649,"num_write":263,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"265'373","reported_seq":1055,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:44.497882+0000","last_change":"2024-09-12T17:41:44.497703+0000","last_active":"2024-09-12T17:41:44.497882+0000","last_peered":"2024-09-12T17:41:44.497882+0000","last_clean":"2024-09-12T17:41:44.497882+0000","last_became_active":"2024-09-12T16:58:18.702185+0000","last_became_peered":"2024-09-12T16:58:18.702185+0000","last_unstale":"2024-09-12T17:41:44.497882+0000","last_undegraded":"2024-09-12T17:41:44.497882+0000","last_fullsized":"2024-09-12T17:41:44.497882+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'373","last_scrub_stamp":"2024-09-12T17:41:44.497473+0000","last_deep_scrub":"265'373","last_deep_scrub_stamp":"2024-09-12T17:41:44.497473+0000","last_clean_scrub_stamp":"2024-09-12T17:41:44.497473+0000","objects_scrubbed":3,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:41.714848+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306656,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":591,"num_read_kb":49223,"num_write":1212,"num_write_kb":37016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"265'189","reported_seq":830,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:44.508406+0000","last_change":"2024-09-12T17:41:44.508120+0000","last_active":"2024-09-12T17:41:44.508406+0000","last_peered":"2024-09-12T17:41:44.508406+0000","last_clean":"2024-09-12T17:41:44.508406+0000","last_became_active":"2024-09-12T16:58:21.718158+0000","last_became_peered":"2024-09-12T16:58:21.718158+0000","last_unstale":"2024-09-12T17:41:44.508406+0000","last_undegraded":"2024-09-12T17:41:44.508406+0000","last_fullsized":"2024-09-12T17:41:44.508406+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'189","last_scrub_stamp":"2024-09-12T17:41:44.507884+0000","last_deep_scrub":"265'189","last_deep_scrub_stamp":"2024-09-12T17:41:44.507884+0000","last_clean_scrub_stamp":"2024-09-12T17:41:44.507884+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:21.650280+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":878,"num_read_kb":727,"num_write":304,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"265'358","reported_seq":1104,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:42.627771+0000","last_change":"2024-09-12T17:41:42.627593+0000","last_active":"2024-09-12T17:41:42.627771+0000","last_peered":"2024-09-12T17:41:42.627771+0000","last_clean":"2024-09-12T17:41:42.627771+0000","last_became_active":"2024-09-12T16:58:18.699360+0000","last_became_peered":"2024-09-12T16:58:18.699360+0000","last_unstale":"2024-09-12T17:41:42.627771+0000","last_undegraded":"2024-09-12T17:41:42.627771+0000","last_fullsized":"2024-09-12T17:41:42.627771+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'358","last_scrub_stamp":"2024-09-12T17:41:42.627381+0000","last_deep_scrub":"265'358","last_deep_scrub_stamp":"2024-09-12T17:41:42.627381+0000","last_clean_scrub_stamp":"2024-09-12T17:41:42.627381+0000","objects_scrubbed":5,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:07.285273+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":626,"num_read_kb":143204,"num_write":1063,"num_write_kb":36082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"265'136","reported_seq":774,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:51.542065+0000","last_change":"2024-09-12T17:41:51.541908+0000","last_active":"2024-09-12T17:41:51.542065+0000","last_peered":"2024-09-12T17:41:51.542065+0000","last_clean":"2024-09-12T17:41:51.542065+0000","last_became_active":"2024-09-12T16:58:21.728321+0000","last_became_peered":"2024-09-12T16:58:21.728321+0000","last_unstale":"2024-09-12T17:41:51.542065+0000","last_undegraded":"2024-09-12T17:41:51.542065+0000","last_fullsized":"2024-09-12T17:41:51.542065+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'136","last_scrub_stamp":"2024-09-12T17:41:51.541730+0000","last_deep_scrub":"265'136","last_deep_scrub_stamp":"2024-09-12T17:41:51.541730+0000","last_clean_scrub_stamp":"2024-09-12T17:41:51.541730+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:58.375721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":636,"num_read_kb":537,"num_write":197,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"265'322","reported_seq":943,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:48.598113+0000","last_change":"2024-09-12T17:41:48.597965+0000","last_active":"2024-09-12T17:41:48.598113+0000","last_peered":"2024-09-12T17:41:48.598113+0000","last_clean":"2024-09-12T17:41:48.598113+0000","last_became_active":"2024-09-12T16:58:18.690634+0000","last_became_peered":"2024-09-12T16:58:18.690634+0000","last_unstale":"2024-09-12T17:41:48.598113+0000","last_undegraded":"2024-09-12T17:41:48.598113+0000","last_fullsized":"2024-09-12T17:41:48.598113+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'322","last_scrub_stamp":"2024-09-12T17:41:48.597755+0000","last_deep_scrub":"265'322","last_deep_scrub_stamp":"2024-09-12T17:41:48.597755+0000","last_clean_scrub_stamp":"2024-09-12T17:41:48.597755+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:42.047491+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159799,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":394,"num_read_kb":27088,"num_write":949,"num_write_kb":25947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"265'299","reported_seq":906,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:57.673364+0000","last_change":"2024-09-12T17:41:57.673364+0000","last_active":"2024-09-12T17:41:57.673364+0000","last_peered":"2024-09-12T17:41:57.673364+0000","last_clean":"2024-09-12T17:41:57.673364+0000","last_became_active":"2024-09-12T16:58:21.702643+0000","last_became_peered":"2024-09-12T16:58:21.702643+0000","last_unstale":"2024-09-12T17:41:57.673364+0000","last_undegraded":"2024-09-12T17:41:57.673364+0000","last_fullsized":"2024-09-12T17:41:57.673364+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'299","last_scrub_stamp":"2024-09-12T17:41:57.673176+0000","last_deep_scrub":"265'299","last_deep_scrub_stamp":"2024-09-12T17:41:57.673176+0000","last_clean_scrub_stamp":"2024-09-12T17:41:57.673176+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:49.957041+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1307,"num_read_kb":1045,"num_write":505,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"265'347","reported_seq":1107,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:44.275966+0000","last_change":"2024-09-12T17:41:44.275966+0000","last_active":"2024-09-12T17:41:44.275966+0000","last_peered":"2024-09-12T17:41:44.275966+0000","last_clean":"2024-09-12T17:41:44.275966+0000","last_became_active":"2024-09-12T16:58:18.702310+0000","last_became_peered":"2024-09-12T16:58:18.702310+0000","last_unstale":"2024-09-12T17:41:44.275966+0000","last_undegraded":"2024-09-12T17:41:44.275966+0000","last_fullsized":"2024-09-12T17:41:44.275966+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'347","last_scrub_stamp":"2024-09-12T17:41:44.275743+0000","last_deep_scrub":"265'347","last_deep_scrub_stamp":"2024-09-12T17:41:44.275743+0000","last_clean_scrub_stamp":"2024-09-12T17:41:44.275743+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:46.939621+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":950476,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":583,"num_read_kb":31842,"num_write":1061,"num_write_kb":30837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"265'153","reported_seq":662,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:05.061816+0000","last_change":"2024-09-12T16:58:29.792625+0000","last_active":"2024-09-12T17:40:05.061816+0000","last_peered":"2024-09-12T17:40:05.061816+0000","last_clean":"2024-09-12T17:40:05.061816+0000","last_became_active":"2024-09-12T16:58:29.792043+0000","last_became_peered":"2024-09-12T16:58:29.792043+0000","last_unstale":"2024-09-12T17:40:05.061816+0000","last_undegraded":"2024-09-12T17:40:05.061816+0000","last_fullsized":"2024-09-12T17:40:05.061816+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":230,"num_read_kb":220,"num_write":374,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"265'102","reported_seq":694,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:50.519732+0000","last_change":"2024-09-12T17:41:50.519732+0000","last_active":"2024-09-12T17:41:50.519732+0000","last_peered":"2024-09-12T17:41:50.519732+0000","last_clean":"2024-09-12T17:41:50.519732+0000","last_became_active":"2024-09-12T16:58:21.707428+0000","last_became_peered":"2024-09-12T16:58:21.707428+0000","last_unstale":"2024-09-12T17:41:50.519732+0000","last_undegraded":"2024-09-12T17:41:50.519732+0000","last_fullsized":"2024-09-12T17:41:50.519732+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'102","last_scrub_stamp":"2024-09-12T17:41:50.519549+0000","last_deep_scrub":"265'102","last_deep_scrub_stamp":"2024-09-12T17:41:50.519549+0000","last_clean_scrub_stamp":"2024-09-12T17:41:50.519549+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:07.630997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":440,"num_read_kb":374,"num_write":161,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"265'380","reported_seq":1041,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:45.520248+0000","last_change":"2024-09-12T17:41:45.520248+0000","last_active":"2024-09-12T17:41:45.520248+0000","last_peered":"2024-09-12T17:41:45.520248+0000","last_clean":"2024-09-12T17:41:45.520248+0000","last_became_active":"2024-09-12T16:58:18.714782+0000","last_became_peered":"2024-09-12T16:58:18.714782+0000","last_unstale":"2024-09-12T17:41:45.520248+0000","last_undegraded":"2024-09-12T17:41:45.520248+0000","last_fullsized":"2024-09-12T17:41:45.520248+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'380","last_scrub_stamp":"2024-09-12T17:41:45.520059+0000","last_deep_scrub":"265'380","last_deep_scrub_stamp":"2024-09-12T17:41:45.520059+0000","last_clean_scrub_stamp":"2024-09-12T17:41:45.520059+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:52.748711+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194316,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":558,"num_read_kb":18943,"num_write":1229,"num_write_kb":58984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:01.658167+0000","last_change":"2024-09-12T17:42:01.658167+0000","last_active":"2024-09-12T17:42:01.658167+0000","last_peered":"2024-09-12T17:42:01.658167+0000","last_clean":"2024-09-12T17:42:01.658167+0000","last_became_active":"2024-09-12T16:58:23.712621+0000","last_became_peered":"2024-09-12T16:58:23.712621+0000","last_unstale":"2024-09-12T17:42:01.658167+0000","last_undegraded":"2024-09-12T17:42:01.658167+0000","last_fullsized":"2024-09-12T17:42:01.658167+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:01.657990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:01.657990+0000","last_clean_scrub_stamp":"2024-09-12T17:42:01.657990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:51.018117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"265'342","reported_seq":949,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:03.866073+0000","last_change":"2024-09-12T17:42:03.866073+0000","last_active":"2024-09-12T17:42:03.866073+0000","last_peered":"2024-09-12T17:42:03.866073+0000","last_clean":"2024-09-12T17:42:03.866073+0000","last_became_active":"2024-09-12T16:58:25.728901+0000","last_became_peered":"2024-09-12T16:58:25.728901+0000","last_unstale":"2024-09-12T17:42:03.866073+0000","last_undegraded":"2024-09-12T17:42:03.866073+0000","last_fullsized":"2024-09-12T17:42:03.866073+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'342","last_scrub_stamp":"2024-09-12T17:42:03.865859+0000","last_deep_scrub":"265'342","last_deep_scrub_stamp":"2024-09-12T17:42:03.865859+0000","last_clean_scrub_stamp":"2024-09-12T17:42:03.865859+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:35.413458+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46434,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":549,"num_read_kb":1164,"num_write":438,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:10.679527+0000","last_change":"2024-09-12T17:42:10.679527+0000","last_active":"2024-09-12T17:42:10.679527+0000","last_peered":"2024-09-12T17:42:10.679527+0000","last_clean":"2024-09-12T17:42:10.679527+0000","last_became_active":"2024-09-12T16:58:27.752315+0000","last_became_peered":"2024-09-12T16:58:27.752315+0000","last_unstale":"2024-09-12T17:42:10.679527+0000","last_undegraded":"2024-09-12T17:42:10.679527+0000","last_fullsized":"2024-09-12T17:42:10.679527+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:10.679345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:10.679345+0000","last_clean_scrub_stamp":"2024-09-12T17:42:10.679345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:51.638492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"265'129","reported_seq":687,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:14.627941+0000","last_change":"2024-09-12T17:42:14.627941+0000","last_active":"2024-09-12T17:42:14.627941+0000","last_peered":"2024-09-12T17:42:14.627941+0000","last_clean":"2024-09-12T17:42:14.627941+0000","last_became_active":"2024-09-12T16:58:29.773874+0000","last_became_peered":"2024-09-12T16:58:29.773874+0000","last_unstale":"2024-09-12T17:42:14.627941+0000","last_undegraded":"2024-09-12T17:42:14.627941+0000","last_fullsized":"2024-09-12T17:42:14.627941+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'129","last_scrub_stamp":"2024-09-12T17:42:14.627593+0000","last_deep_scrub":"265'129","last_deep_scrub_stamp":"2024-09-12T17:42:14.627593+0000","last_clean_scrub_stamp":"2024-09-12T17:42:14.627593+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:44.736299+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":191,"num_read_kb":190,"num_write":216,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"265'402","reported_seq":1061,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:52.691279+0000","last_change":"2024-09-12T17:41:52.691279+0000","last_active":"2024-09-12T17:41:52.691279+0000","last_peered":"2024-09-12T17:41:52.691279+0000","last_clean":"2024-09-12T17:41:52.691279+0000","last_became_active":"2024-09-12T16:58:21.717806+0000","last_became_peered":"2024-09-12T16:58:21.717806+0000","last_unstale":"2024-09-12T17:41:52.691279+0000","last_undegraded":"2024-09-12T17:41:52.691279+0000","last_fullsized":"2024-09-12T17:41:52.691279+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'402","last_scrub_stamp":"2024-09-12T17:41:52.691089+0000","last_deep_scrub":"265'402","last_deep_scrub_stamp":"2024-09-12T17:41:52.691089+0000","last_clean_scrub_stamp":"2024-09-12T17:41:52.691089+0000","objects_scrubbed":2,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:57.508897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1815,"num_read_kb":1449,"num_write":653,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4270,"num_omap_keys":19,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"265'351","reported_seq":1045,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:41.315205+0000","last_change":"2024-09-12T17:41:41.315205+0000","last_active":"2024-09-12T17:41:41.315205+0000","last_peered":"2024-09-12T17:41:41.315205+0000","last_clean":"2024-09-12T17:41:41.315205+0000","last_became_active":"2024-09-12T16:58:18.691335+0000","last_became_peered":"2024-09-12T16:58:18.691335+0000","last_unstale":"2024-09-12T17:41:41.315205+0000","last_undegraded":"2024-09-12T17:41:41.315205+0000","last_fullsized":"2024-09-12T17:41:41.315205+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'351","last_scrub_stamp":"2024-09-12T17:41:41.314984+0000","last_deep_scrub":"265'351","last_deep_scrub_stamp":"2024-09-12T17:41:41.314984+0000","last_clean_scrub_stamp":"2024-09-12T17:41:41.314984+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:10.989680+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1278687,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":548,"num_read_kb":106559,"num_write":1101,"num_write_kb":67871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:56.476590+0000","last_change":"2024-09-12T17:41:56.476590+0000","last_active":"2024-09-12T17:41:56.476590+0000","last_peered":"2024-09-12T17:41:56.476590+0000","last_clean":"2024-09-12T17:41:56.476590+0000","last_became_active":"2024-09-12T16:58:23.718656+0000","last_became_peered":"2024-09-12T16:58:23.718656+0000","last_unstale":"2024-09-12T17:41:56.476590+0000","last_undegraded":"2024-09-12T17:41:56.476590+0000","last_fullsized":"2024-09-12T17:41:56.476590+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:56.476408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:56.476408+0000","last_clean_scrub_stamp":"2024-09-12T17:41:56.476408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:17.560169+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"265'103","reported_seq":634,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:05.645255+0000","last_change":"2024-09-12T17:42:05.645255+0000","last_active":"2024-09-12T17:42:05.645255+0000","last_peered":"2024-09-12T17:42:05.645255+0000","last_clean":"2024-09-12T17:42:05.645255+0000","last_became_active":"2024-09-12T16:58:25.713567+0000","last_became_peered":"2024-09-12T16:58:25.713567+0000","last_unstale":"2024-09-12T17:42:05.645255+0000","last_undegraded":"2024-09-12T17:42:05.645255+0000","last_fullsized":"2024-09-12T17:42:05.645255+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'103","last_scrub_stamp":"2024-09-12T17:42:05.645063+0000","last_deep_scrub":"265'103","last_deep_scrub_stamp":"2024-09-12T17:42:05.645063+0000","last_clean_scrub_stamp":"2024-09-12T17:42:05.645063+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:09.908392+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":95,"num_read_kb":90,"num_write":66,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:09.612352+0000","last_change":"2024-09-12T17:42:09.612352+0000","last_active":"2024-09-12T17:42:09.612352+0000","last_peered":"2024-09-12T17:42:09.612352+0000","last_clean":"2024-09-12T17:42:09.612352+0000","last_became_active":"2024-09-12T16:58:27.728276+0000","last_became_peered":"2024-09-12T16:58:27.728276+0000","last_unstale":"2024-09-12T17:42:09.612352+0000","last_undegraded":"2024-09-12T17:42:09.612352+0000","last_fullsized":"2024-09-12T17:42:09.612352+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:09.612169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:09.612169+0000","last_clean_scrub_stamp":"2024-09-12T17:42:09.612169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:17.864461+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"265'129","reported_seq":642,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:11.981999+0000","last_change":"2024-09-12T17:42:11.981999+0000","last_active":"2024-09-12T17:42:11.981999+0000","last_peered":"2024-09-12T17:42:11.981999+0000","last_clean":"2024-09-12T17:42:11.981999+0000","last_became_active":"2024-09-12T16:58:29.780598+0000","last_became_peered":"2024-09-12T16:58:29.780598+0000","last_unstale":"2024-09-12T17:42:11.981999+0000","last_undegraded":"2024-09-12T17:42:11.981999+0000","last_fullsized":"2024-09-12T17:42:11.981999+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'129","last_scrub_stamp":"2024-09-12T17:42:11.981812+0000","last_deep_scrub":"265'129","last_deep_scrub_stamp":"2024-09-12T17:42:11.981812+0000","last_clean_scrub_stamp":"2024-09-12T17:42:11.981812+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:04.450209+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":203,"num_read_kb":191,"num_write":301,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"265'80","reported_seq":651,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:50.080879+0000","last_change":"2024-09-12T17:41:50.080720+0000","last_active":"2024-09-12T17:41:50.080879+0000","last_peered":"2024-09-12T17:41:50.080879+0000","last_clean":"2024-09-12T17:41:50.080879+0000","last_became_active":"2024-09-12T16:58:21.718773+0000","last_became_peered":"2024-09-12T16:58:21.718773+0000","last_unstale":"2024-09-12T17:41:50.080879+0000","last_undegraded":"2024-09-12T17:41:50.080879+0000","last_fullsized":"2024-09-12T17:41:50.080879+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'80","last_scrub_stamp":"2024-09-12T17:41:50.080528+0000","last_deep_scrub":"265'80","last_deep_scrub_stamp":"2024-09-12T17:41:50.080528+0000","last_clean_scrub_stamp":"2024-09-12T17:41:50.080528+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:21.460279+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":373,"num_read_kb":312,"num_write":123,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"265'334","reported_seq":933,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:47.460517+0000","last_change":"2024-09-12T17:41:47.460517+0000","last_active":"2024-09-12T17:41:47.460517+0000","last_peered":"2024-09-12T17:41:47.460517+0000","last_clean":"2024-09-12T17:41:47.460517+0000","last_became_active":"2024-09-12T16:58:55.843826+0000","last_became_peered":"2024-09-12T16:58:55.843826+0000","last_unstale":"2024-09-12T17:41:47.460517+0000","last_undegraded":"2024-09-12T17:41:47.460517+0000","last_fullsized":"2024-09-12T17:41:47.460517+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'334","last_scrub_stamp":"2024-09-12T17:41:47.460291+0000","last_deep_scrub":"265'334","last_deep_scrub_stamp":"2024-09-12T17:41:47.460291+0000","last_clean_scrub_stamp":"2024-09-12T17:41:47.460291+0000","objects_scrubbed":6,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:13.714567+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263214,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":424,"num_read_kb":4809,"num_write":985,"num_write_kb":23718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:59.482339+0000","last_change":"2024-09-12T17:41:59.482339+0000","last_active":"2024-09-12T17:41:59.482339+0000","last_peered":"2024-09-12T17:41:59.482339+0000","last_clean":"2024-09-12T17:41:59.482339+0000","last_became_active":"2024-09-12T16:58:23.706953+0000","last_became_peered":"2024-09-12T16:58:23.706953+0000","last_unstale":"2024-09-12T17:41:59.482339+0000","last_undegraded":"2024-09-12T17:41:59.482339+0000","last_fullsized":"2024-09-12T17:41:59.482339+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:59.482154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:59.482154+0000","last_clean_scrub_stamp":"2024-09-12T17:41:59.482154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:45.005327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"265'110","reported_seq":651,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:56.600727+0000","last_change":"2024-09-12T17:41:56.600727+0000","last_active":"2024-09-12T17:41:56.600727+0000","last_peered":"2024-09-12T17:41:56.600727+0000","last_clean":"2024-09-12T17:41:56.600727+0000","last_became_active":"2024-09-12T16:58:25.713213+0000","last_became_peered":"2024-09-12T16:58:25.713213+0000","last_unstale":"2024-09-12T17:41:56.600727+0000","last_undegraded":"2024-09-12T17:41:56.600727+0000","last_fullsized":"2024-09-12T17:41:56.600727+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'110","last_scrub_stamp":"2024-09-12T17:41:56.600505+0000","last_deep_scrub":"265'110","last_deep_scrub_stamp":"2024-09-12T17:41:56.600505+0000","last_clean_scrub_stamp":"2024-09-12T17:41:56.600505+0000","objects_scrubbed":5,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:20.949800+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":116,"num_write":82,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"265'771","reported_seq":4632,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:09.687832+0000","last_change":"2024-09-12T17:42:09.687832+0000","last_active":"2024-09-12T17:42:09.687832+0000","last_peered":"2024-09-12T17:42:09.687832+0000","last_clean":"2024-09-12T17:42:09.687832+0000","last_became_active":"2024-09-12T16:58:27.752801+0000","last_became_peered":"2024-09-12T16:58:27.752801+0000","last_unstale":"2024-09-12T17:42:09.687832+0000","last_undegraded":"2024-09-12T17:42:09.687832+0000","last_fullsized":"2024-09-12T17:42:09.687832+0000","mapping_epoch":32,"log_start":"265'702","ondisk_log_start":"265'702","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'771","last_scrub_stamp":"2024-09-12T17:42:09.687648+0000","last_deep_scrub":"265'771","last_deep_scrub_stamp":"2024-09-12T17:42:09.687648+0000","last_clean_scrub_stamp":"2024-09-12T17:42:09.687648+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":702,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:16.370450+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"265'206","reported_seq":1032,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:12.572728+0000","last_change":"2024-09-12T17:42:12.572728+0000","last_active":"2024-09-12T17:42:12.572728+0000","last_peered":"2024-09-12T17:42:12.572728+0000","last_clean":"2024-09-12T17:42:12.572728+0000","last_became_active":"2024-09-12T16:58:29.769351+0000","last_became_peered":"2024-09-12T16:58:29.769351+0000","last_unstale":"2024-09-12T17:42:12.572728+0000","last_undegraded":"2024-09-12T17:42:12.572728+0000","last_fullsized":"2024-09-12T17:42:12.572728+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'206","last_scrub_stamp":"2024-09-12T17:42:12.572544+0000","last_deep_scrub":"265'206","last_deep_scrub_stamp":"2024-09-12T17:42:12.572544+0000","last_clean_scrub_stamp":"2024-09-12T17:42:12.572544+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:55.304646+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":633,"num_read_kb":631,"num_write":454,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"265'164","reported_seq":762,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:49.549548+0000","last_change":"2024-09-12T17:41:49.549407+0000","last_active":"2024-09-12T17:41:49.549548+0000","last_peered":"2024-09-12T17:41:49.549548+0000","last_clean":"2024-09-12T17:41:49.549548+0000","last_became_active":"2024-09-12T16:58:21.710646+0000","last_became_peered":"2024-09-12T16:58:21.710646+0000","last_unstale":"2024-09-12T17:41:49.549548+0000","last_undegraded":"2024-09-12T17:41:49.549548+0000","last_fullsized":"2024-09-12T17:41:49.549548+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'164","last_scrub_stamp":"2024-09-12T17:41:49.549228+0000","last_deep_scrub":"265'164","last_deep_scrub_stamp":"2024-09-12T17:41:49.549228+0000","last_clean_scrub_stamp":"2024-09-12T17:41:49.549228+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:48.619499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":698,"num_read_kb":573,"num_write":260,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"265'344","reported_seq":977,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:40.452831+0000","last_change":"2024-09-12T17:41:40.452831+0000","last_active":"2024-09-12T17:41:40.452831+0000","last_peered":"2024-09-12T17:41:40.452831+0000","last_clean":"2024-09-12T17:41:40.452831+0000","last_became_active":"2024-09-12T16:58:18.689915+0000","last_became_peered":"2024-09-12T16:58:18.689915+0000","last_unstale":"2024-09-12T17:41:40.452831+0000","last_undegraded":"2024-09-12T17:41:40.452831+0000","last_fullsized":"2024-09-12T17:41:40.452831+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'344","last_scrub_stamp":"2024-09-12T17:41:40.452621+0000","last_deep_scrub":"265'344","last_deep_scrub_stamp":"2024-09-12T17:41:40.452621+0000","last_clean_scrub_stamp":"2024-09-12T17:41:40.452621+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:57.294233+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388626,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":434,"num_read_kb":42593,"num_write":1103,"num_write_kb":36991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:02.632507+0000","last_change":"2024-09-12T17:42:02.632507+0000","last_active":"2024-09-12T17:42:02.632507+0000","last_peered":"2024-09-12T17:42:02.632507+0000","last_clean":"2024-09-12T17:42:02.632507+0000","last_became_active":"2024-09-12T16:58:23.697159+0000","last_became_peered":"2024-09-12T16:58:23.697159+0000","last_unstale":"2024-09-12T17:42:02.632507+0000","last_undegraded":"2024-09-12T17:42:02.632507+0000","last_fullsized":"2024-09-12T17:42:02.632507+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:02.632329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:02.632329+0000","last_clean_scrub_stamp":"2024-09-12T17:42:02.632329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:42.457952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"265'252","reported_seq":827,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:03.774177+0000","last_change":"2024-09-12T17:42:03.774177+0000","last_active":"2024-09-12T17:42:03.774177+0000","last_peered":"2024-09-12T17:42:03.774177+0000","last_clean":"2024-09-12T17:42:03.774177+0000","last_became_active":"2024-09-12T16:58:25.949179+0000","last_became_peered":"2024-09-12T16:58:25.949179+0000","last_unstale":"2024-09-12T17:42:03.774177+0000","last_undegraded":"2024-09-12T17:42:03.774177+0000","last_fullsized":"2024-09-12T17:42:03.774177+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'252","last_scrub_stamp":"2024-09-12T17:42:03.773982+0000","last_deep_scrub":"265'252","last_deep_scrub_stamp":"2024-09-12T17:42:03.773982+0000","last_clean_scrub_stamp":"2024-09-12T17:42:03.773982+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:42.695827+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43414,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":422,"num_read_kb":981,"num_write":340,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"265'786","reported_seq":2108,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:11.570731+0000","last_change":"2024-09-12T17:42:11.570731+0000","last_active":"2024-09-12T17:42:11.570731+0000","last_peered":"2024-09-12T17:42:11.570731+0000","last_clean":"2024-09-12T17:42:11.570731+0000","last_became_active":"2024-09-12T16:58:27.745988+0000","last_became_peered":"2024-09-12T16:58:27.745988+0000","last_unstale":"2024-09-12T17:42:11.570731+0000","last_undegraded":"2024-09-12T17:42:11.570731+0000","last_fullsized":"2024-09-12T17:42:11.570731+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'786","last_scrub_stamp":"2024-09-12T17:42:11.570546+0000","last_deep_scrub":"265'786","last_deep_scrub_stamp":"2024-09-12T17:42:11.570546+0000","last_clean_scrub_stamp":"2024-09-12T17:42:11.570546+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:17.461259+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"265'150","reported_seq":729,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:53.700294+0000","last_change":"2024-09-12T17:41:53.700294+0000","last_active":"2024-09-12T17:41:53.700294+0000","last_peered":"2024-09-12T17:41:53.700294+0000","last_clean":"2024-09-12T17:41:53.700294+0000","last_became_active":"2024-09-12T16:58:21.710029+0000","last_became_peered":"2024-09-12T16:58:21.710029+0000","last_unstale":"2024-09-12T17:41:53.700294+0000","last_undegraded":"2024-09-12T17:41:53.700294+0000","last_fullsized":"2024-09-12T17:41:53.700294+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'150","last_scrub_stamp":"2024-09-12T17:41:53.700121+0000","last_deep_scrub":"265'150","last_deep_scrub_stamp":"2024-09-12T17:41:53.700121+0000","last_clean_scrub_stamp":"2024-09-12T17:41:53.700121+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:02.023536+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":614,"num_read_kb":496,"num_write":228,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"265'366","reported_seq":1021,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:44.502758+0000","last_change":"2024-09-12T17:41:44.502758+0000","last_active":"2024-09-12T17:41:44.502758+0000","last_peered":"2024-09-12T17:41:44.502758+0000","last_clean":"2024-09-12T17:41:44.502758+0000","last_became_active":"2024-09-12T16:58:18.715448+0000","last_became_peered":"2024-09-12T16:58:18.715448+0000","last_unstale":"2024-09-12T17:41:44.502758+0000","last_undegraded":"2024-09-12T17:41:44.502758+0000","last_fullsized":"2024-09-12T17:41:44.502758+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'366","last_scrub_stamp":"2024-09-12T17:41:44.502506+0000","last_deep_scrub":"265'366","last_deep_scrub_stamp":"2024-09-12T17:41:44.502506+0000","last_clean_scrub_stamp":"2024-09-12T17:41:44.502506+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:08.236868+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1147727,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":546,"num_read_kb":11904,"num_write":1219,"num_write_kb":32051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:57.709766+0000","last_change":"2024-09-12T17:41:57.709766+0000","last_active":"2024-09-12T17:41:57.709766+0000","last_peered":"2024-09-12T17:41:57.709766+0000","last_clean":"2024-09-12T17:41:57.709766+0000","last_became_active":"2024-09-12T16:58:23.720096+0000","last_became_peered":"2024-09-12T16:58:23.720096+0000","last_unstale":"2024-09-12T17:41:57.709766+0000","last_undegraded":"2024-09-12T17:41:57.709766+0000","last_fullsized":"2024-09-12T17:41:57.709766+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:57.709583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:57.709583+0000","last_clean_scrub_stamp":"2024-09-12T17:41:57.709583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:39.596618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"265'369","reported_seq":987,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:05.604213+0000","last_change":"2024-09-12T17:42:05.604213+0000","last_active":"2024-09-12T17:42:05.604213+0000","last_peered":"2024-09-12T17:42:05.604213+0000","last_clean":"2024-09-12T17:42:05.604213+0000","last_became_active":"2024-09-12T16:58:25.946765+0000","last_became_peered":"2024-09-12T16:58:25.946765+0000","last_unstale":"2024-09-12T17:42:05.604213+0000","last_undegraded":"2024-09-12T17:42:05.604213+0000","last_fullsized":"2024-09-12T17:42:05.604213+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'369","last_scrub_stamp":"2024-09-12T17:42:05.604007+0000","last_deep_scrub":"265'369","last_deep_scrub_stamp":"2024-09-12T17:42:05.604007+0000","last_clean_scrub_stamp":"2024-09-12T17:42:05.604007+0000","objects_scrubbed":10,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:42.337337+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46152,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":583,"num_read_kb":1215,"num_write":464,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:01.378968+0000","last_change":"2024-09-12T17:42:01.378968+0000","last_active":"2024-09-12T17:42:01.378968+0000","last_peered":"2024-09-12T17:42:01.378968+0000","last_clean":"2024-09-12T17:42:01.378968+0000","last_became_active":"2024-09-12T16:58:27.753616+0000","last_became_peered":"2024-09-12T16:58:27.753616+0000","last_unstale":"2024-09-12T17:42:01.378968+0000","last_undegraded":"2024-09-12T17:42:01.378968+0000","last_fullsized":"2024-09-12T17:42:01.378968+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:01.378765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:01.378765+0000","last_clean_scrub_stamp":"2024-09-12T17:42:01.378765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:27.283128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"265'554","reported_seq":1371,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:12.556002+0000","last_change":"2024-09-12T17:42:12.555824+0000","last_active":"2024-09-12T17:42:12.556002+0000","last_peered":"2024-09-12T17:42:12.556002+0000","last_clean":"2024-09-12T17:42:12.556002+0000","last_became_active":"2024-09-12T16:58:29.774093+0000","last_became_peered":"2024-09-12T16:58:29.774093+0000","last_unstale":"2024-09-12T17:42:12.556002+0000","last_undegraded":"2024-09-12T17:42:12.556002+0000","last_fullsized":"2024-09-12T17:42:12.556002+0000","mapping_epoch":34,"log_start":"265'500","ondisk_log_start":"265'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'554","last_scrub_stamp":"2024-09-12T17:42:12.555633+0000","last_deep_scrub":"265'554","last_deep_scrub_stamp":"2024-09-12T17:42:12.555633+0000","last_clean_scrub_stamp":"2024-09-12T17:42:12.555633+0000","objects_scrubbed":4,"log_size":54,"log_dups_size":500,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:07.265979+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":455,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1305,"num_read_kb":1304,"num_write":1151,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"265'502","reported_seq":1263,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:48.602426+0000","last_change":"2024-09-12T17:41:48.602426+0000","last_active":"2024-09-12T17:41:48.602426+0000","last_peered":"2024-09-12T17:41:48.602426+0000","last_clean":"2024-09-12T17:41:48.602426+0000","last_became_active":"2024-09-12T16:58:21.699243+0000","last_became_peered":"2024-09-12T16:58:21.699243+0000","last_unstale":"2024-09-12T17:41:48.602426+0000","last_undegraded":"2024-09-12T17:41:48.602426+0000","last_fullsized":"2024-09-12T17:41:48.602426+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'502","last_scrub_stamp":"2024-09-12T17:41:48.602124+0000","last_deep_scrub":"265'502","last_deep_scrub_stamp":"2024-09-12T17:41:48.602124+0000","last_clean_scrub_stamp":"2024-09-12T17:41:48.602124+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:11.597872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2329,"num_read_kb":1984,"num_write":852,"num_write_kb":550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"265'371","reported_seq":1042,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:41.552046+0000","last_change":"2024-09-12T17:41:41.552046+0000","last_active":"2024-09-12T17:41:41.552046+0000","last_peered":"2024-09-12T17:41:41.552046+0000","last_clean":"2024-09-12T17:41:41.552046+0000","last_became_active":"2024-09-12T16:58:18.714412+0000","last_became_peered":"2024-09-12T16:58:18.714412+0000","last_unstale":"2024-09-12T17:41:41.552046+0000","last_undegraded":"2024-09-12T17:41:41.552046+0000","last_fullsized":"2024-09-12T17:41:41.552046+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'371","last_scrub_stamp":"2024-09-12T17:41:41.551754+0000","last_deep_scrub":"265'371","last_deep_scrub_stamp":"2024-09-12T17:41:41.551754+0000","last_clean_scrub_stamp":"2024-09-12T17:41:41.551754+0000","objects_scrubbed":6,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:46.467198+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306427,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":511,"num_read_kb":85960,"num_write":1174,"num_write_kb":38984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:48.434883+0000","last_change":"2024-09-12T17:41:48.434883+0000","last_active":"2024-09-12T17:41:48.434883+0000","last_peered":"2024-09-12T17:41:48.434883+0000","last_clean":"2024-09-12T17:41:48.434883+0000","last_became_active":"2024-09-12T16:58:23.703534+0000","last_became_peered":"2024-09-12T16:58:23.703534+0000","last_unstale":"2024-09-12T17:41:48.434883+0000","last_undegraded":"2024-09-12T17:41:48.434883+0000","last_fullsized":"2024-09-12T17:41:48.434883+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:48.434677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:48.434677+0000","last_clean_scrub_stamp":"2024-09-12T17:41:48.434677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:41.207200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"265'282","reported_seq":861,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:01.574232+0000","last_change":"2024-09-12T17:42:01.574232+0000","last_active":"2024-09-12T17:42:01.574232+0000","last_peered":"2024-09-12T17:42:01.574232+0000","last_clean":"2024-09-12T17:42:01.574232+0000","last_became_active":"2024-09-12T16:58:25.730470+0000","last_became_peered":"2024-09-12T16:58:25.730470+0000","last_unstale":"2024-09-12T17:42:01.574232+0000","last_undegraded":"2024-09-12T17:42:01.574232+0000","last_fullsized":"2024-09-12T17:42:01.574232+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'282","last_scrub_stamp":"2024-09-12T17:42:01.574044+0000","last_deep_scrub":"265'282","last_deep_scrub_stamp":"2024-09-12T17:42:01.574044+0000","last_clean_scrub_stamp":"2024-09-12T17:42:01.574044+0000","objects_scrubbed":4,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:01.929052+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57671,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":480,"num_read_kb":1170,"num_write":398,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:10.529115+0000","last_change":"2024-09-12T17:42:10.529115+0000","last_active":"2024-09-12T17:42:10.529115+0000","last_peered":"2024-09-12T17:42:10.529115+0000","last_clean":"2024-09-12T17:42:10.529115+0000","last_became_active":"2024-09-12T16:58:27.748461+0000","last_became_peered":"2024-09-12T16:58:27.748461+0000","last_unstale":"2024-09-12T17:42:10.529115+0000","last_undegraded":"2024-09-12T17:42:10.529115+0000","last_fullsized":"2024-09-12T17:42:10.529115+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:10.528945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:10.528945+0000","last_clean_scrub_stamp":"2024-09-12T17:42:10.528945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:06.400660+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"265'2419","reported_seq":4259,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:01.368039+0000","last_change":"2024-09-12T17:42:01.368039+0000","last_active":"2024-09-12T17:42:01.368039+0000","last_peered":"2024-09-12T17:42:01.368039+0000","last_clean":"2024-09-12T17:42:01.368039+0000","last_became_active":"2024-09-12T16:58:29.768469+0000","last_became_peered":"2024-09-12T16:58:29.768469+0000","last_unstale":"2024-09-12T17:42:01.368039+0000","last_undegraded":"2024-09-12T17:42:01.368039+0000","last_fullsized":"2024-09-12T17:42:01.368039+0000","mapping_epoch":34,"log_start":"265'2400","ondisk_log_start":"265'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2419","last_scrub_stamp":"2024-09-12T17:42:01.367825+0000","last_deep_scrub":"265'2419","last_deep_scrub_stamp":"2024-09-12T17:42:01.367825+0000","last_clean_scrub_stamp":"2024-09-12T17:42:01.367825+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":2400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:52.127983+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":849,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6073,"num_read_kb":6065,"num_write":4892,"num_write_kb":1798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"265'217","reported_seq":805,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:45.445128+0000","last_change":"2024-09-12T17:41:45.444945+0000","last_active":"2024-09-12T17:41:45.445128+0000","last_peered":"2024-09-12T17:41:45.445128+0000","last_clean":"2024-09-12T17:41:45.445128+0000","last_became_active":"2024-09-12T16:58:21.724552+0000","last_became_peered":"2024-09-12T16:58:21.724552+0000","last_unstale":"2024-09-12T17:41:45.445128+0000","last_undegraded":"2024-09-12T17:41:45.445128+0000","last_fullsized":"2024-09-12T17:41:45.445128+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'217","last_scrub_stamp":"2024-09-12T17:41:45.444760+0000","last_deep_scrub":"265'217","last_deep_scrub_stamp":"2024-09-12T17:41:45.444760+0000","last_clean_scrub_stamp":"2024-09-12T17:41:45.444760+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:07.480407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":914,"num_read_kb":736,"num_write":337,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"265'479","reported_seq":1231,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:42.515901+0000","last_change":"2024-09-12T17:41:42.515901+0000","last_active":"2024-09-12T17:41:42.515901+0000","last_peered":"2024-09-12T17:41:42.515901+0000","last_clean":"2024-09-12T17:41:42.515901+0000","last_became_active":"2024-09-12T16:58:55.852305+0000","last_became_peered":"2024-09-12T16:58:55.852305+0000","last_unstale":"2024-09-12T17:41:42.515901+0000","last_undegraded":"2024-09-12T17:41:42.515901+0000","last_fullsized":"2024-09-12T17:41:42.515901+0000","mapping_epoch":37,"log_start":"265'400","ondisk_log_start":"265'400","created":23,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'479","last_scrub_stamp":"2024-09-12T17:41:42.515648+0000","last_deep_scrub":"265'479","last_deep_scrub_stamp":"2024-09-12T17:41:42.515648+0000","last_clean_scrub_stamp":"2024-09-12T17:41:42.515648+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:36.727017+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048839,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":919,"num_read_kb":12354,"num_write":1497,"num_write_kb":33200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:50.493117+0000","last_change":"2024-09-12T17:41:50.493117+0000","last_active":"2024-09-12T17:41:50.493117+0000","last_peered":"2024-09-12T17:41:50.493117+0000","last_clean":"2024-09-12T17:41:50.493117+0000","last_became_active":"2024-09-12T16:58:23.713241+0000","last_became_peered":"2024-09-12T16:58:23.713241+0000","last_unstale":"2024-09-12T17:41:50.493117+0000","last_undegraded":"2024-09-12T17:41:50.493117+0000","last_fullsized":"2024-09-12T17:41:50.493117+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:50.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:50.492929+0000","last_clean_scrub_stamp":"2024-09-12T17:41:50.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:16.543100+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"265'326","reported_seq":918,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:02.766836+0000","last_change":"2024-09-12T17:42:02.766836+0000","last_active":"2024-09-12T17:42:02.766836+0000","last_peered":"2024-09-12T17:42:02.766836+0000","last_clean":"2024-09-12T17:42:02.766836+0000","last_became_active":"2024-09-12T16:58:25.732918+0000","last_became_peered":"2024-09-12T16:58:25.732918+0000","last_unstale":"2024-09-12T17:42:02.766836+0000","last_undegraded":"2024-09-12T17:42:02.766836+0000","last_fullsized":"2024-09-12T17:42:02.766836+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'326","last_scrub_stamp":"2024-09-12T17:42:02.766606+0000","last_deep_scrub":"265'326","last_deep_scrub_stamp":"2024-09-12T17:42:02.766606+0000","last_clean_scrub_stamp":"2024-09-12T17:42:02.766606+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:17.798594+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71605,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":514,"num_read_kb":1203,"num_write":420,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"265'759","reported_seq":2470,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:04.870764+0000","last_change":"2024-09-12T17:42:04.870764+0000","last_active":"2024-09-12T17:42:04.870764+0000","last_peered":"2024-09-12T17:42:04.870764+0000","last_clean":"2024-09-12T17:42:04.870764+0000","last_became_active":"2024-09-12T16:58:27.736160+0000","last_became_peered":"2024-09-12T16:58:27.736160+0000","last_unstale":"2024-09-12T17:42:04.870764+0000","last_undegraded":"2024-09-12T17:42:04.870764+0000","last_fullsized":"2024-09-12T17:42:04.870764+0000","mapping_epoch":32,"log_start":"265'701","ondisk_log_start":"265'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'759","last_scrub_stamp":"2024-09-12T17:42:04.870586+0000","last_deep_scrub":"265'759","last_deep_scrub_stamp":"2024-09-12T17:42:04.870586+0000","last_clean_scrub_stamp":"2024-09-12T17:42:04.870586+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":701,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:19.787370+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"265'169","reported_seq":666,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:10.968584+0000","last_change":"2024-09-12T17:42:10.968584+0000","last_active":"2024-09-12T17:42:10.968584+0000","last_peered":"2024-09-12T17:42:10.968584+0000","last_clean":"2024-09-12T17:42:10.968584+0000","last_became_active":"2024-09-12T16:58:29.785621+0000","last_became_peered":"2024-09-12T16:58:29.785621+0000","last_unstale":"2024-09-12T17:42:10.968584+0000","last_undegraded":"2024-09-12T17:42:10.968584+0000","last_fullsized":"2024-09-12T17:42:10.968584+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'169","last_scrub_stamp":"2024-09-12T17:42:10.968399+0000","last_deep_scrub":"265'169","last_deep_scrub_stamp":"2024-09-12T17:42:10.968399+0000","last_clean_scrub_stamp":"2024-09-12T17:42:10.968399+0000","objects_scrubbed":2,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:36.694831+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":406,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":130,"num_read_kb":128,"num_write":373,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"265'203","reported_seq":803,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:49.110136+0000","last_change":"2024-09-12T17:41:49.110136+0000","last_active":"2024-09-12T17:41:49.110136+0000","last_peered":"2024-09-12T17:41:49.110136+0000","last_clean":"2024-09-12T17:41:49.110136+0000","last_became_active":"2024-09-12T16:58:21.701704+0000","last_became_peered":"2024-09-12T16:58:21.701704+0000","last_unstale":"2024-09-12T17:41:49.110136+0000","last_undegraded":"2024-09-12T17:41:49.110136+0000","last_fullsized":"2024-09-12T17:41:49.110136+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'203","last_scrub_stamp":"2024-09-12T17:41:49.109939+0000","last_deep_scrub":"265'203","last_deep_scrub_stamp":"2024-09-12T17:41:49.109939+0000","last_clean_scrub_stamp":"2024-09-12T17:41:49.109939+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:31.594839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":867,"num_read_kb":717,"num_write":300,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"265'335","reported_seq":973,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:42.680714+0000","last_change":"2024-09-12T17:41:42.680714+0000","last_active":"2024-09-12T17:41:42.680714+0000","last_peered":"2024-09-12T17:41:42.680714+0000","last_clean":"2024-09-12T17:41:42.680714+0000","last_became_active":"2024-09-12T16:58:18.715232+0000","last_became_peered":"2024-09-12T16:58:18.715232+0000","last_unstale":"2024-09-12T17:41:42.680714+0000","last_undegraded":"2024-09-12T17:41:42.680714+0000","last_fullsized":"2024-09-12T17:41:42.680714+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'335","last_scrub_stamp":"2024-09-12T17:41:42.680418+0000","last_deep_scrub":"265'335","last_deep_scrub_stamp":"2024-09-12T17:41:42.680418+0000","last_clean_scrub_stamp":"2024-09-12T17:41:42.680418+0000","objects_scrubbed":9,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:52.761737+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1724025,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":468,"num_read_kb":18626,"num_write":1028,"num_write_kb":30032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:49.458628+0000","last_change":"2024-09-12T17:41:49.458503+0000","last_active":"2024-09-12T17:41:49.458628+0000","last_peered":"2024-09-12T17:41:49.458628+0000","last_clean":"2024-09-12T17:41:49.458628+0000","last_became_active":"2024-09-12T16:58:23.708641+0000","last_became_peered":"2024-09-12T16:58:23.708641+0000","last_unstale":"2024-09-12T17:41:49.458628+0000","last_undegraded":"2024-09-12T17:41:49.458628+0000","last_fullsized":"2024-09-12T17:41:49.458628+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:49.458319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:49.458319+0000","last_clean_scrub_stamp":"2024-09-12T17:41:49.458319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:57:34.059304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"265'475","reported_seq":1111,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:58.971445+0000","last_change":"2024-09-12T17:41:58.971445+0000","last_active":"2024-09-12T17:41:58.971445+0000","last_peered":"2024-09-12T17:41:58.971445+0000","last_clean":"2024-09-12T17:41:58.971445+0000","last_became_active":"2024-09-12T16:58:25.729071+0000","last_became_peered":"2024-09-12T16:58:25.729071+0000","last_unstale":"2024-09-12T17:41:58.971445+0000","last_undegraded":"2024-09-12T17:41:58.971445+0000","last_fullsized":"2024-09-12T17:41:58.971445+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'475","last_scrub_stamp":"2024-09-12T17:41:58.971256+0000","last_deep_scrub":"265'475","last_deep_scrub_stamp":"2024-09-12T17:41:58.971256+0000","last_clean_scrub_stamp":"2024-09-12T17:41:58.971256+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:44.218649+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126127,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":817,"num_read_kb":2031,"num_write":670,"num_write_kb":603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:55.551207+0000","last_change":"2024-09-12T17:41:55.551207+0000","last_active":"2024-09-12T17:41:55.551207+0000","last_peered":"2024-09-12T17:41:55.551207+0000","last_clean":"2024-09-12T17:41:55.551207+0000","last_became_active":"2024-09-12T16:58:27.734078+0000","last_became_peered":"2024-09-12T16:58:27.734078+0000","last_unstale":"2024-09-12T17:41:55.551207+0000","last_undegraded":"2024-09-12T17:41:55.551207+0000","last_fullsized":"2024-09-12T17:41:55.551207+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:55.551025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:55.551025+0000","last_clean_scrub_stamp":"2024-09-12T17:41:55.551025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:17.047074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"265'90","reported_seq":599,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:04.444250+0000","last_change":"2024-09-12T17:42:04.444250+0000","last_active":"2024-09-12T17:42:04.444250+0000","last_peered":"2024-09-12T17:42:04.444250+0000","last_clean":"2024-09-12T17:42:04.444250+0000","last_became_active":"2024-09-12T16:58:29.794347+0000","last_became_peered":"2024-09-12T16:58:29.794347+0000","last_unstale":"2024-09-12T17:42:04.444250+0000","last_undegraded":"2024-09-12T17:42:04.444250+0000","last_fullsized":"2024-09-12T17:42:04.444250+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'90","last_scrub_stamp":"2024-09-12T17:42:04.444035+0000","last_deep_scrub":"265'90","last_deep_scrub_stamp":"2024-09-12T17:42:04.444035+0000","last_clean_scrub_stamp":"2024-09-12T17:42:04.444035+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:38.772754+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":704,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":193,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"265'212","reported_seq":809,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:44.640655+0000","last_change":"2024-09-12T17:41:44.640655+0000","last_active":"2024-09-12T17:41:44.640655+0000","last_peered":"2024-09-12T17:41:44.640655+0000","last_clean":"2024-09-12T17:41:44.640655+0000","last_became_active":"2024-09-12T16:58:21.702684+0000","last_became_peered":"2024-09-12T16:58:21.702684+0000","last_unstale":"2024-09-12T17:41:44.640655+0000","last_undegraded":"2024-09-12T17:41:44.640655+0000","last_fullsized":"2024-09-12T17:41:44.640655+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'212","last_scrub_stamp":"2024-09-12T17:41:44.640479+0000","last_deep_scrub":"265'212","last_deep_scrub_stamp":"2024-09-12T17:41:44.640479+0000","last_clean_scrub_stamp":"2024-09-12T17:41:44.640479+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:35.863889+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":882,"num_read_kb":712,"num_write":314,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"265'376","reported_seq":1066,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:41.751292+0000","last_change":"2024-09-12T17:41:41.751292+0000","last_active":"2024-09-12T17:41:41.751292+0000","last_peered":"2024-09-12T17:41:41.751292+0000","last_clean":"2024-09-12T17:41:41.751292+0000","last_became_active":"2024-09-12T16:58:18.695549+0000","last_became_peered":"2024-09-12T16:58:18.695549+0000","last_unstale":"2024-09-12T17:41:41.751292+0000","last_undegraded":"2024-09-12T17:41:41.751292+0000","last_fullsized":"2024-09-12T17:41:41.751292+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'376","last_scrub_stamp":"2024-09-12T17:41:41.751066+0000","last_deep_scrub":"265'376","last_deep_scrub_stamp":"2024-09-12T17:41:41.751066+0000","last_clean_scrub_stamp":"2024-09-12T17:41:41.751066+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:18.413154+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":633,"num_read_kb":12633,"num_write":1101,"num_write_kb":15900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:52.524952+0000","last_change":"2024-09-12T17:41:52.524952+0000","last_active":"2024-09-12T17:41:52.524952+0000","last_peered":"2024-09-12T17:41:52.524952+0000","last_clean":"2024-09-12T17:41:52.524952+0000","last_became_active":"2024-09-12T16:58:23.720279+0000","last_became_peered":"2024-09-12T16:58:23.720279+0000","last_unstale":"2024-09-12T17:41:52.524952+0000","last_undegraded":"2024-09-12T17:41:52.524952+0000","last_fullsized":"2024-09-12T17:41:52.524952+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:52.524776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:52.524776+0000","last_clean_scrub_stamp":"2024-09-12T17:41:52.524776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:24.970601+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"265'298","reported_seq":880,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:04.604637+0000","last_change":"2024-09-12T17:42:04.604637+0000","last_active":"2024-09-12T17:42:04.604637+0000","last_peered":"2024-09-12T17:42:04.604637+0000","last_clean":"2024-09-12T17:42:04.604637+0000","last_became_active":"2024-09-12T16:58:25.711682+0000","last_became_peered":"2024-09-12T16:58:25.711682+0000","last_unstale":"2024-09-12T17:42:04.604637+0000","last_undegraded":"2024-09-12T17:42:04.604637+0000","last_fullsized":"2024-09-12T17:42:04.604637+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'298","last_scrub_stamp":"2024-09-12T17:42:04.604436+0000","last_deep_scrub":"265'298","last_deep_scrub_stamp":"2024-09-12T17:42:04.604436+0000","last_clean_scrub_stamp":"2024-09-12T17:42:04.604436+0000","objects_scrubbed":6,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:28.531688+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44554,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":521,"num_read_kb":1183,"num_write":472,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:05.917580+0000","last_change":"2024-09-12T17:42:05.917580+0000","last_active":"2024-09-12T17:42:05.917580+0000","last_peered":"2024-09-12T17:42:05.917580+0000","last_clean":"2024-09-12T17:42:05.917580+0000","last_became_active":"2024-09-12T16:58:27.751664+0000","last_became_peered":"2024-09-12T16:58:27.751664+0000","last_unstale":"2024-09-12T17:42:05.917580+0000","last_undegraded":"2024-09-12T17:42:05.917580+0000","last_fullsized":"2024-09-12T17:42:05.917580+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:05.917376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:05.917376+0000","last_clean_scrub_stamp":"2024-09-12T17:42:05.917376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:42.341012+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"265'126","reported_seq":626,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:40:42.388904+0000","last_change":"2024-09-12T16:58:29.785130+0000","last_active":"2024-09-12T17:40:42.388904+0000","last_peered":"2024-09-12T17:40:42.388904+0000","last_clean":"2024-09-12T17:40:42.388904+0000","last_became_active":"2024-09-12T16:58:29.784095+0000","last_became_peered":"2024-09-12T16:58:29.784095+0000","last_unstale":"2024-09-12T17:40:42.388904+0000","last_undegraded":"2024-09-12T17:40:42.388904+0000","last_fullsized":"2024-09-12T17:40:42.388904+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:32.305201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":487,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":177,"num_read_kb":165,"num_write":304,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"265'166","reported_seq":780,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:45.621245+0000","last_change":"2024-09-12T17:41:45.621245+0000","last_active":"2024-09-12T17:41:45.621245+0000","last_peered":"2024-09-12T17:41:45.621245+0000","last_clean":"2024-09-12T17:41:45.621245+0000","last_became_active":"2024-09-12T16:58:21.728963+0000","last_became_peered":"2024-09-12T16:58:21.728963+0000","last_unstale":"2024-09-12T17:41:45.621245+0000","last_undegraded":"2024-09-12T17:41:45.621245+0000","last_fullsized":"2024-09-12T17:41:45.621245+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'166","last_scrub_stamp":"2024-09-12T17:41:45.621014+0000","last_deep_scrub":"265'166","last_deep_scrub_stamp":"2024-09-12T17:41:45.621014+0000","last_clean_scrub_stamp":"2024-09-12T17:41:45.621014+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:14.525844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":751,"num_read_kb":615,"num_write":255,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"265'343","reported_seq":1020,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:41.451773+0000","last_change":"2024-09-12T17:41:41.451544+0000","last_active":"2024-09-12T17:41:41.451773+0000","last_peered":"2024-09-12T17:41:41.451773+0000","last_clean":"2024-09-12T17:41:41.451773+0000","last_became_active":"2024-09-12T16:58:18.708689+0000","last_became_peered":"2024-09-12T16:58:18.708689+0000","last_unstale":"2024-09-12T17:41:41.451773+0000","last_undegraded":"2024-09-12T17:41:41.451773+0000","last_fullsized":"2024-09-12T17:41:41.451773+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'343","last_scrub_stamp":"2024-09-12T17:41:41.451261+0000","last_deep_scrub":"265'343","last_deep_scrub_stamp":"2024-09-12T17:41:41.451261+0000","last_clean_scrub_stamp":"2024-09-12T17:41:41.451261+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:06.939620+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":505,"num_read_kb":124256,"num_write":1133,"num_write_kb":36504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:56.391504+0000","last_change":"2024-09-12T17:41:56.391504+0000","last_active":"2024-09-12T17:41:56.391504+0000","last_peered":"2024-09-12T17:41:56.391504+0000","last_clean":"2024-09-12T17:41:56.391504+0000","last_became_active":"2024-09-12T16:58:23.709099+0000","last_became_peered":"2024-09-12T16:58:23.709099+0000","last_unstale":"2024-09-12T17:41:56.391504+0000","last_undegraded":"2024-09-12T17:41:56.391504+0000","last_fullsized":"2024-09-12T17:41:56.391504+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:56.391301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:56.391301+0000","last_clean_scrub_stamp":"2024-09-12T17:41:56.391301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:32.975832+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"265'284","reported_seq":876,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:54.532525+0000","last_change":"2024-09-12T17:41:54.532525+0000","last_active":"2024-09-12T17:41:54.532525+0000","last_peered":"2024-09-12T17:41:54.532525+0000","last_clean":"2024-09-12T17:41:54.532525+0000","last_became_active":"2024-09-12T16:58:25.723894+0000","last_became_peered":"2024-09-12T16:58:25.723894+0000","last_unstale":"2024-09-12T17:41:54.532525+0000","last_undegraded":"2024-09-12T17:41:54.532525+0000","last_fullsized":"2024-09-12T17:41:54.532525+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'284","last_scrub_stamp":"2024-09-12T17:41:54.532322+0000","last_deep_scrub":"265'284","last_deep_scrub_stamp":"2024-09-12T17:41:54.532322+0000","last_clean_scrub_stamp":"2024-09-12T17:41:54.532322+0000","objects_scrubbed":7,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:06.034171+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60644,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":457,"num_read_kb":1010,"num_write":360,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"265'727","reported_seq":2356,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:59.659910+0000","last_change":"2024-09-12T17:41:59.659910+0000","last_active":"2024-09-12T17:41:59.659910+0000","last_peered":"2024-09-12T17:41:59.659910+0000","last_clean":"2024-09-12T17:41:59.659910+0000","last_became_active":"2024-09-12T16:58:27.753179+0000","last_became_peered":"2024-09-12T16:58:27.753179+0000","last_unstale":"2024-09-12T17:41:59.659910+0000","last_undegraded":"2024-09-12T17:41:59.659910+0000","last_fullsized":"2024-09-12T17:41:59.659910+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'727","last_scrub_stamp":"2024-09-12T17:41:59.659726+0000","last_deep_scrub":"265'727","last_deep_scrub_stamp":"2024-09-12T17:41:59.659726+0000","last_clean_scrub_stamp":"2024-09-12T17:41:59.659726+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":700,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:13.608476+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"265'142","reported_seq":674,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:05.434385+0000","last_change":"2024-09-12T17:42:05.434246+0000","last_active":"2024-09-12T17:42:05.434385+0000","last_peered":"2024-09-12T17:42:05.434385+0000","last_clean":"2024-09-12T17:42:05.434385+0000","last_became_active":"2024-09-12T16:58:29.778839+0000","last_became_peered":"2024-09-12T16:58:29.778839+0000","last_unstale":"2024-09-12T17:42:05.434385+0000","last_undegraded":"2024-09-12T17:42:05.434385+0000","last_fullsized":"2024-09-12T17:42:05.434385+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'142","last_scrub_stamp":"2024-09-12T17:42:05.434025+0000","last_deep_scrub":"265'142","last_deep_scrub_stamp":"2024-09-12T17:42:05.434025+0000","last_clean_scrub_stamp":"2024-09-12T17:42:05.434025+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:13.641037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":288,"num_read_kb":252,"num_write":342,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"265'188","reported_seq":784,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:46.597917+0000","last_change":"2024-09-12T17:41:46.597917+0000","last_active":"2024-09-12T17:41:46.597917+0000","last_peered":"2024-09-12T17:41:46.597917+0000","last_clean":"2024-09-12T17:41:46.597917+0000","last_became_active":"2024-09-12T16:58:21.706953+0000","last_became_peered":"2024-09-12T16:58:21.706953+0000","last_unstale":"2024-09-12T17:41:46.597917+0000","last_undegraded":"2024-09-12T17:41:46.597917+0000","last_fullsized":"2024-09-12T17:41:46.597917+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'188","last_scrub_stamp":"2024-09-12T17:41:46.597688+0000","last_deep_scrub":"265'188","last_deep_scrub_stamp":"2024-09-12T17:41:46.597688+0000","last_clean_scrub_stamp":"2024-09-12T17:41:46.597688+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:59.955032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":782,"num_read_kb":644,"num_write":280,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"265'327","reported_seq":970,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:40.693027+0000","last_change":"2024-09-12T17:41:40.692867+0000","last_active":"2024-09-12T17:41:40.693027+0000","last_peered":"2024-09-12T17:41:40.693027+0000","last_clean":"2024-09-12T17:41:40.693027+0000","last_became_active":"2024-09-12T16:58:18.686189+0000","last_became_peered":"2024-09-12T16:58:18.686189+0000","last_unstale":"2024-09-12T17:41:40.693027+0000","last_undegraded":"2024-09-12T17:41:40.693027+0000","last_fullsized":"2024-09-12T17:41:40.693027+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'327","last_scrub_stamp":"2024-09-12T17:41:40.692633+0000","last_deep_scrub":"265'327","last_deep_scrub_stamp":"2024-09-12T17:41:40.692633+0000","last_clean_scrub_stamp":"2024-09-12T17:41:40.692633+0000","objects_scrubbed":8,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:55.491689+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":508,"num_read_kb":6575,"num_write":1048,"num_write_kb":19619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"265'4","reported_seq":1464,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:00.640441+0000","last_change":"2024-09-12T17:42:00.640441+0000","last_active":"2024-09-12T17:42:00.640441+0000","last_peered":"2024-09-12T17:42:00.640441+0000","last_clean":"2024-09-12T17:42:00.640441+0000","last_became_active":"2024-09-12T16:58:23.706471+0000","last_became_peered":"2024-09-12T16:58:23.706471+0000","last_unstale":"2024-09-12T17:42:00.640441+0000","last_undegraded":"2024-09-12T17:42:00.640441+0000","last_fullsized":"2024-09-12T17:42:00.640441+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T17:42:00.640250+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T17:42:00.640250+0000","last_clean_scrub_stamp":"2024-09-12T17:42:00.640250+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:54:34.722743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":956,"num_read_kb":956,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"265'83","reported_seq":611,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:03.588353+0000","last_change":"2024-09-12T17:42:03.588353+0000","last_active":"2024-09-12T17:42:03.588353+0000","last_peered":"2024-09-12T17:42:03.588353+0000","last_clean":"2024-09-12T17:42:03.588353+0000","last_became_active":"2024-09-12T16:58:25.949962+0000","last_became_peered":"2024-09-12T16:58:25.949962+0000","last_unstale":"2024-09-12T17:42:03.588353+0000","last_undegraded":"2024-09-12T17:42:03.588353+0000","last_fullsized":"2024-09-12T17:42:03.588353+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'83","last_scrub_stamp":"2024-09-12T17:42:03.588160+0000","last_deep_scrub":"265'83","last_deep_scrub_stamp":"2024-09-12T17:42:03.588160+0000","last_clean_scrub_stamp":"2024-09-12T17:42:03.588160+0000","objects_scrubbed":5,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:22.497976+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"265'758","reported_seq":4014,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:55.401310+0000","last_change":"2024-09-12T17:41:55.401310+0000","last_active":"2024-09-12T17:41:55.401310+0000","last_peered":"2024-09-12T17:41:55.401310+0000","last_clean":"2024-09-12T17:41:55.401310+0000","last_became_active":"2024-09-12T16:58:27.755569+0000","last_became_peered":"2024-09-12T16:58:27.755569+0000","last_unstale":"2024-09-12T17:41:55.401310+0000","last_undegraded":"2024-09-12T17:41:55.401310+0000","last_fullsized":"2024-09-12T17:41:55.401310+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'758","last_scrub_stamp":"2024-09-12T17:41:55.401154+0000","last_deep_scrub":"265'758","last_deep_scrub_stamp":"2024-09-12T17:41:55.401154+0000","last_clean_scrub_stamp":"2024-09-12T17:41:55.401154+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":700,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:49.415648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"265'116","reported_seq":633,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:13.582180+0000","last_change":"2024-09-12T17:42:13.581935+0000","last_active":"2024-09-12T17:42:13.582180+0000","last_peered":"2024-09-12T17:42:13.582180+0000","last_clean":"2024-09-12T17:42:13.582180+0000","last_became_active":"2024-09-12T16:58:29.780289+0000","last_became_peered":"2024-09-12T16:58:29.780289+0000","last_unstale":"2024-09-12T17:42:13.582180+0000","last_undegraded":"2024-09-12T17:42:13.582180+0000","last_fullsized":"2024-09-12T17:42:13.582180+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'116","last_scrub_stamp":"2024-09-12T17:42:13.581645+0000","last_deep_scrub":"265'116","last_deep_scrub_stamp":"2024-09-12T17:42:13.581645+0000","last_clean_scrub_stamp":"2024-09-12T17:42:13.581645+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:41.170590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":175,"num_write":267,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"265'140","reported_seq":805,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:51.379444+0000","last_change":"2024-09-12T17:41:51.379444+0000","last_active":"2024-09-12T17:41:51.379444+0000","last_peered":"2024-09-12T17:41:51.379444+0000","last_clean":"2024-09-12T17:41:51.379444+0000","last_became_active":"2024-09-12T16:58:21.719827+0000","last_became_peered":"2024-09-12T16:58:21.719827+0000","last_unstale":"2024-09-12T17:41:51.379444+0000","last_undegraded":"2024-09-12T17:41:51.379444+0000","last_fullsized":"2024-09-12T17:41:51.379444+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'140","last_scrub_stamp":"2024-09-12T17:41:51.379265+0000","last_deep_scrub":"265'140","last_deep_scrub_stamp":"2024-09-12T17:41:51.379265+0000","last_clean_scrub_stamp":"2024-09-12T17:41:51.379265+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:58.481342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":689,"num_read_kb":590,"num_write":204,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"265'335","reported_seq":990,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:39.806722+0000","last_change":"2024-09-12T17:41:39.806619+0000","last_active":"2024-09-12T17:41:39.806722+0000","last_peered":"2024-09-12T17:41:39.806722+0000","last_clean":"2024-09-12T17:41:39.806722+0000","last_became_active":"2024-09-12T16:58:18.705048+0000","last_became_peered":"2024-09-12T16:58:18.705048+0000","last_unstale":"2024-09-12T17:41:39.806722+0000","last_undegraded":"2024-09-12T17:41:39.806722+0000","last_fullsized":"2024-09-12T17:41:39.806722+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'335","last_scrub_stamp":"2024-09-12T17:41:39.806418+0000","last_deep_scrub":"265'335","last_deep_scrub_stamp":"2024-09-12T17:41:39.806418+0000","last_clean_scrub_stamp":"2024-09-12T17:41:39.806418+0000","objects_scrubbed":8,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:11.826972+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2227678,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":497,"num_read_kb":3392,"num_write":1050,"num_write_kb":22669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"265'6","reported_seq":988,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:00.663027+0000","last_change":"2024-09-12T17:42:00.663027+0000","last_active":"2024-09-12T17:42:00.663027+0000","last_peered":"2024-09-12T17:42:00.663027+0000","last_clean":"2024-09-12T17:42:00.663027+0000","last_became_active":"2024-09-12T16:58:23.702699+0000","last_became_peered":"2024-09-12T16:58:23.702699+0000","last_unstale":"2024-09-12T17:42:00.663027+0000","last_undegraded":"2024-09-12T17:42:00.663027+0000","last_fullsized":"2024-09-12T17:42:00.663027+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T17:42:00.662845+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T17:42:00.662845+0000","last_clean_scrub_stamp":"2024-09-12T17:42:00.662845+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:03.303674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":729,"num_read_kb":1194,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"265'352","reported_seq":964,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:06.599729+0000","last_change":"2024-09-12T17:42:06.599729+0000","last_active":"2024-09-12T17:42:06.599729+0000","last_peered":"2024-09-12T17:42:06.599729+0000","last_clean":"2024-09-12T17:42:06.599729+0000","last_became_active":"2024-09-12T16:58:25.724694+0000","last_became_peered":"2024-09-12T16:58:25.724694+0000","last_unstale":"2024-09-12T17:42:06.599729+0000","last_undegraded":"2024-09-12T17:42:06.599729+0000","last_fullsized":"2024-09-12T17:42:06.599729+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'352","last_scrub_stamp":"2024-09-12T17:42:06.599476+0000","last_deep_scrub":"265'352","last_deep_scrub_stamp":"2024-09-12T17:42:06.599476+0000","last_clean_scrub_stamp":"2024-09-12T17:42:06.599476+0000","objects_scrubbed":8,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:48.102438+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52076,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":562,"num_read_kb":1199,"num_write":444,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:56.381658+0000","last_change":"2024-09-12T17:41:56.381658+0000","last_active":"2024-09-12T17:41:56.381658+0000","last_peered":"2024-09-12T17:41:56.381658+0000","last_clean":"2024-09-12T17:41:56.381658+0000","last_became_active":"2024-09-12T16:58:27.740510+0000","last_became_peered":"2024-09-12T16:58:27.740510+0000","last_unstale":"2024-09-12T17:41:56.381658+0000","last_undegraded":"2024-09-12T17:41:56.381658+0000","last_fullsized":"2024-09-12T17:41:56.381658+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:56.381466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:56.381466+0000","last_clean_scrub_stamp":"2024-09-12T17:41:56.381466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:56.865452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"265'130","reported_seq":631,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:03.451882+0000","last_change":"2024-09-12T17:42:03.451743+0000","last_active":"2024-09-12T17:42:03.451882+0000","last_peered":"2024-09-12T17:42:03.451882+0000","last_clean":"2024-09-12T17:42:03.451882+0000","last_became_active":"2024-09-12T16:58:29.776007+0000","last_became_peered":"2024-09-12T16:58:29.776007+0000","last_unstale":"2024-09-12T17:42:03.451882+0000","last_undegraded":"2024-09-12T17:42:03.451882+0000","last_fullsized":"2024-09-12T17:42:03.451882+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'130","last_scrub_stamp":"2024-09-12T17:42:03.451565+0000","last_deep_scrub":"265'130","last_deep_scrub_stamp":"2024-09-12T17:42:03.451565+0000","last_clean_scrub_stamp":"2024-09-12T17:42:03.451565+0000","objects_scrubbed":3,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:21.254085+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":162,"num_read_kb":158,"num_write":308,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"265'143","reported_seq":764,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:49.448232+0000","last_change":"2024-09-12T17:41:49.448084+0000","last_active":"2024-09-12T17:41:49.448232+0000","last_peered":"2024-09-12T17:41:49.448232+0000","last_clean":"2024-09-12T17:41:49.448232+0000","last_became_active":"2024-09-12T16:58:21.726160+0000","last_became_peered":"2024-09-12T16:58:21.726160+0000","last_unstale":"2024-09-12T17:41:49.448232+0000","last_undegraded":"2024-09-12T17:41:49.448232+0000","last_fullsized":"2024-09-12T17:41:49.448232+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'143","last_scrub_stamp":"2024-09-12T17:41:49.447779+0000","last_deep_scrub":"265'143","last_deep_scrub_stamp":"2024-09-12T17:41:49.447779+0000","last_clean_scrub_stamp":"2024-09-12T17:41:49.447779+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:59.351840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":643,"num_read_kb":537,"num_write":216,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"265'74","reported_seq":623,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:40.572560+0000","last_change":"2024-09-12T17:41:40.572415+0000","last_active":"2024-09-12T17:41:40.572560+0000","last_peered":"2024-09-12T17:41:40.572560+0000","last_clean":"2024-09-12T17:41:40.572560+0000","last_became_active":"2024-09-12T16:58:04.216387+0000","last_became_peered":"2024-09-12T16:58:04.216387+0000","last_unstale":"2024-09-12T17:41:40.572560+0000","last_undegraded":"2024-09-12T17:41:40.572560+0000","last_fullsized":"2024-09-12T17:41:40.572560+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'74","last_scrub_stamp":"2024-09-12T17:41:40.572242+0000","last_deep_scrub":"265'74","last_deep_scrub_stamp":"2024-09-12T17:41:40.572242+0000","last_clean_scrub_stamp":"2024-09-12T17:41:40.572242+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:51.726519+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"265'2","reported_seq":531,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:40.628344+0000","last_change":"2024-09-12T17:41:40.628219+0000","last_active":"2024-09-12T17:41:40.628344+0000","last_peered":"2024-09-12T17:41:40.628344+0000","last_clean":"2024-09-12T17:41:40.628344+0000","last_became_active":"2024-09-12T16:58:08.538227+0000","last_became_peered":"2024-09-12T16:58:08.538227+0000","last_unstale":"2024-09-12T17:41:40.628344+0000","last_undegraded":"2024-09-12T17:41:40.628344+0000","last_fullsized":"2024-09-12T17:41:40.628344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T17:41:40.628040+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T17:41:40.628040+0000","last_clean_scrub_stamp":"2024-09-12T17:41:40.628040+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:51.377305+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.001171044,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"265'366","reported_seq":1000,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:40.595467+0000","last_change":"2024-09-12T17:41:40.595467+0000","last_active":"2024-09-12T17:41:40.595467+0000","last_peered":"2024-09-12T17:41:40.595467+0000","last_clean":"2024-09-12T17:41:40.595467+0000","last_became_active":"2024-09-12T16:58:55.957231+0000","last_became_peered":"2024-09-12T16:58:55.957231+0000","last_unstale":"2024-09-12T17:41:40.595467+0000","last_undegraded":"2024-09-12T17:41:40.595467+0000","last_fullsized":"2024-09-12T17:41:40.595467+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'366","last_scrub_stamp":"2024-09-12T17:41:40.595232+0000","last_deep_scrub":"265'366","last_deep_scrub_stamp":"2024-09-12T17:41:40.595232+0000","last_clean_scrub_stamp":"2024-09-12T17:41:40.595232+0000","objects_scrubbed":8,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:19.557999+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159822,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":551,"num_read_kb":44871,"num_write":1125,"num_write_kb":45418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"265'4","reported_seq":989,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:58.751673+0000","last_change":"2024-09-12T17:41:58.751528+0000","last_active":"2024-09-12T17:41:58.751673+0000","last_peered":"2024-09-12T17:41:58.751673+0000","last_clean":"2024-09-12T17:41:58.751673+0000","last_became_active":"2024-09-12T16:58:23.718720+0000","last_became_peered":"2024-09-12T16:58:23.718720+0000","last_unstale":"2024-09-12T17:41:58.751673+0000","last_undegraded":"2024-09-12T17:41:58.751673+0000","last_fullsized":"2024-09-12T17:41:58.751673+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T17:41:58.751313+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T17:41:58.751313+0000","last_clean_scrub_stamp":"2024-09-12T17:41:58.751313+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:58.563273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":725,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"265'694","reported_seq":1404,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:04.586463+0000","last_change":"2024-09-12T17:42:04.586463+0000","last_active":"2024-09-12T17:42:04.586463+0000","last_peered":"2024-09-12T17:42:04.586463+0000","last_clean":"2024-09-12T17:42:04.586463+0000","last_became_active":"2024-09-12T16:58:25.720741+0000","last_became_peered":"2024-09-12T16:58:25.720741+0000","last_unstale":"2024-09-12T17:42:04.586463+0000","last_undegraded":"2024-09-12T17:42:04.586463+0000","last_fullsized":"2024-09-12T17:42:04.586463+0000","mapping_epoch":30,"log_start":"265'600","ondisk_log_start":"265'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'694","last_scrub_stamp":"2024-09-12T17:42:04.586272+0000","last_deep_scrub":"265'694","last_deep_scrub_stamp":"2024-09-12T17:42:04.586272+0000","last_clean_scrub_stamp":"2024-09-12T17:42:04.586272+0000","objects_scrubbed":6,"log_size":94,"log_dups_size":600,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:25.161493+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142315,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1357,"num_read_kb":3135,"num_write":1250,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89176,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:06.902659+0000","last_change":"2024-09-12T17:42:06.902659+0000","last_active":"2024-09-12T17:42:06.902659+0000","last_peered":"2024-09-12T17:42:06.902659+0000","last_clean":"2024-09-12T17:42:06.902659+0000","last_became_active":"2024-09-12T16:58:27.746171+0000","last_became_peered":"2024-09-12T16:58:27.746171+0000","last_unstale":"2024-09-12T17:42:06.902659+0000","last_undegraded":"2024-09-12T17:42:06.902659+0000","last_fullsized":"2024-09-12T17:42:06.902659+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:06.902447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:06.902447+0000","last_clean_scrub_stamp":"2024-09-12T17:42:06.902447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:57.883611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"265'211","reported_seq":926,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:02.328227+0000","last_change":"2024-09-12T17:42:02.328227+0000","last_active":"2024-09-12T17:42:02.328227+0000","last_peered":"2024-09-12T17:42:02.328227+0000","last_clean":"2024-09-12T17:42:02.328227+0000","last_became_active":"2024-09-12T16:58:29.768536+0000","last_became_peered":"2024-09-12T16:58:29.768536+0000","last_unstale":"2024-09-12T17:42:02.328227+0000","last_undegraded":"2024-09-12T17:42:02.328227+0000","last_fullsized":"2024-09-12T17:42:02.328227+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'211","last_scrub_stamp":"2024-09-12T17:42:02.328035+0000","last_deep_scrub":"265'211","last_deep_scrub_stamp":"2024-09-12T17:42:02.328035+0000","last_clean_scrub_stamp":"2024-09-12T17:42:02.328035+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:29.695906+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":520,"num_read_kb":510,"num_write":443,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"265'70","reported_seq":633,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:47.142743+0000","last_change":"2024-09-12T17:41:47.142743+0000","last_active":"2024-09-12T17:41:47.142743+0000","last_peered":"2024-09-12T17:41:47.142743+0000","last_clean":"2024-09-12T17:41:47.142743+0000","last_became_active":"2024-09-12T16:58:21.723703+0000","last_became_peered":"2024-09-12T16:58:21.723703+0000","last_unstale":"2024-09-12T17:41:47.142743+0000","last_undegraded":"2024-09-12T17:41:47.142743+0000","last_fullsized":"2024-09-12T17:41:47.142743+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'70","last_scrub_stamp":"2024-09-12T17:41:47.142558+0000","last_deep_scrub":"265'70","last_deep_scrub_stamp":"2024-09-12T17:41:47.142558+0000","last_clean_scrub_stamp":"2024-09-12T17:41:47.142558+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:44.829243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":317,"num_read_kb":265,"num_write":106,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:43.467257+0000","last_change":"2024-09-12T17:41:43.467257+0000","last_active":"2024-09-12T17:41:43.467257+0000","last_peered":"2024-09-12T17:41:43.467257+0000","last_clean":"2024-09-12T17:41:43.467257+0000","last_became_active":"2024-09-12T16:58:08.536415+0000","last_became_peered":"2024-09-12T16:58:08.536415+0000","last_unstale":"2024-09-12T17:41:43.467257+0000","last_undegraded":"2024-09-12T17:41:43.467257+0000","last_fullsized":"2024-09-12T17:41:43.467257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:43.467045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:43.467045+0000","last_clean_scrub_stamp":"2024-09-12T17:41:43.467045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:31.530851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001332909,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"265'329","reported_seq":984,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:38.253078+0000","last_change":"2024-09-12T17:41:38.252941+0000","last_active":"2024-09-12T17:41:38.253078+0000","last_peered":"2024-09-12T17:41:38.253078+0000","last_clean":"2024-09-12T17:41:38.253078+0000","last_became_active":"2024-09-12T16:58:18.695755+0000","last_became_peered":"2024-09-12T16:58:18.695755+0000","last_unstale":"2024-09-12T17:41:38.253078+0000","last_undegraded":"2024-09-12T17:41:38.253078+0000","last_fullsized":"2024-09-12T17:41:38.253078+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'329","last_scrub_stamp":"2024-09-12T17:41:38.252730+0000","last_deep_scrub":"265'329","last_deep_scrub_stamp":"2024-09-12T17:41:38.252730+0000","last_clean_scrub_stamp":"2024-09-12T17:41:38.252730+0000","objects_scrubbed":6,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:02.194179+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399184,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":538,"num_read_kb":2859,"num_write":1066,"num_write_kb":24939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:59.595833+0000","last_change":"2024-09-12T17:41:59.595833+0000","last_active":"2024-09-12T17:41:59.595833+0000","last_peered":"2024-09-12T17:41:59.595833+0000","last_clean":"2024-09-12T17:41:59.595833+0000","last_became_active":"2024-09-12T16:58:23.712354+0000","last_became_peered":"2024-09-12T16:58:23.712354+0000","last_unstale":"2024-09-12T17:41:59.595833+0000","last_undegraded":"2024-09-12T17:41:59.595833+0000","last_fullsized":"2024-09-12T17:41:59.595833+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:59.595625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:59.595625+0000","last_clean_scrub_stamp":"2024-09-12T17:41:59.595625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:30.801678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"265'1257","reported_seq":2723,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:58.441697+0000","last_change":"2024-09-12T17:41:58.441384+0000","last_active":"2024-09-12T17:41:58.441697+0000","last_peered":"2024-09-12T17:41:58.441697+0000","last_clean":"2024-09-12T17:41:58.441697+0000","last_became_active":"2024-09-12T16:58:25.720266+0000","last_became_peered":"2024-09-12T16:58:25.720266+0000","last_unstale":"2024-09-12T17:41:58.441697+0000","last_undegraded":"2024-09-12T17:41:58.441697+0000","last_fullsized":"2024-09-12T17:41:58.441697+0000","mapping_epoch":30,"log_start":"265'1200","ondisk_log_start":"265'1200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1257","last_scrub_stamp":"2024-09-12T17:41:58.441125+0000","last_deep_scrub":"265'1257","last_deep_scrub_stamp":"2024-09-12T17:41:58.441125+0000","last_clean_scrub_stamp":"2024-09-12T17:41:58.441125+0000","objects_scrubbed":11,"log_size":57,"log_dups_size":1200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:43.727748+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150793,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2049,"num_read_kb":3938,"num_write":1140,"num_write_kb":988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:07.701051+0000","last_change":"2024-09-12T17:42:07.701051+0000","last_active":"2024-09-12T17:42:07.701051+0000","last_peered":"2024-09-12T17:42:07.701051+0000","last_clean":"2024-09-12T17:42:07.701051+0000","last_became_active":"2024-09-12T16:58:27.745341+0000","last_became_peered":"2024-09-12T16:58:27.745341+0000","last_unstale":"2024-09-12T17:42:07.701051+0000","last_undegraded":"2024-09-12T17:42:07.701051+0000","last_fullsized":"2024-09-12T17:42:07.701051+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:07.700879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:07.700879+0000","last_clean_scrub_stamp":"2024-09-12T17:42:07.700879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:05.717581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"265'211","reported_seq":735,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:06.418399+0000","last_change":"2024-09-12T17:42:06.418399+0000","last_active":"2024-09-12T17:42:06.418399+0000","last_peered":"2024-09-12T17:42:06.418399+0000","last_clean":"2024-09-12T17:42:06.418399+0000","last_became_active":"2024-09-12T16:58:29.775944+0000","last_became_peered":"2024-09-12T16:58:29.775944+0000","last_unstale":"2024-09-12T17:42:06.418399+0000","last_undegraded":"2024-09-12T17:42:06.418399+0000","last_fullsized":"2024-09-12T17:42:06.418399+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'211","last_scrub_stamp":"2024-09-12T17:42:06.418203+0000","last_deep_scrub":"265'211","last_deep_scrub_stamp":"2024-09-12T17:42:06.418203+0000","last_clean_scrub_stamp":"2024-09-12T17:42:06.418203+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:04.604623+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":347,"num_read_kb":347,"num_write":464,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"265'122","reported_seq":683,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:47.372995+0000","last_change":"2024-09-12T17:41:47.372995+0000","last_active":"2024-09-12T17:41:47.372995+0000","last_peered":"2024-09-12T17:41:47.372995+0000","last_clean":"2024-09-12T17:41:47.372995+0000","last_became_active":"2024-09-12T16:58:21.721591+0000","last_became_peered":"2024-09-12T16:58:21.721591+0000","last_unstale":"2024-09-12T17:41:47.372995+0000","last_undegraded":"2024-09-12T17:41:47.372995+0000","last_fullsized":"2024-09-12T17:41:47.372995+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'122","last_scrub_stamp":"2024-09-12T17:41:47.372781+0000","last_deep_scrub":"265'122","last_deep_scrub_stamp":"2024-09-12T17:41:47.372781+0000","last_clean_scrub_stamp":"2024-09-12T17:41:47.372781+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:40.097427+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":495,"num_read_kb":400,"num_write":173,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":530,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:39.559720+0000","last_change":"2024-09-12T17:41:39.559674+0000","last_active":"2024-09-12T17:41:39.559720+0000","last_peered":"2024-09-12T17:41:39.559720+0000","last_clean":"2024-09-12T17:41:39.559720+0000","last_became_active":"2024-09-12T16:58:08.534076+0000","last_became_peered":"2024-09-12T16:58:08.534076+0000","last_unstale":"2024-09-12T17:41:39.559720+0000","last_undegraded":"2024-09-12T17:41:39.559720+0000","last_fullsized":"2024-09-12T17:41:39.559720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:39.559614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:39.559614+0000","last_clean_scrub_stamp":"2024-09-12T17:41:39.559614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:56.106176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00083305900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"265'316","reported_seq":945,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:38.395383+0000","last_change":"2024-09-12T17:41:38.395383+0000","last_active":"2024-09-12T17:41:38.395383+0000","last_peered":"2024-09-12T17:41:38.395383+0000","last_clean":"2024-09-12T17:41:38.395383+0000","last_became_active":"2024-09-12T16:58:18.702490+0000","last_became_peered":"2024-09-12T16:58:18.702490+0000","last_unstale":"2024-09-12T17:41:38.395383+0000","last_undegraded":"2024-09-12T17:41:38.395383+0000","last_fullsized":"2024-09-12T17:41:38.395383+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'316","last_scrub_stamp":"2024-09-12T17:41:38.395252+0000","last_deep_scrub":"265'316","last_deep_scrub_stamp":"2024-09-12T17:41:38.395252+0000","last_clean_scrub_stamp":"2024-09-12T17:41:38.395252+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:23.910993+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263185,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":455,"num_read_kb":7668,"num_write":1054,"num_write_kb":10637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"265'2","reported_seq":508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:45.506695+0000","last_change":"2024-09-12T17:41:45.506695+0000","last_active":"2024-09-12T17:41:45.506695+0000","last_peered":"2024-09-12T17:41:45.506695+0000","last_clean":"2024-09-12T17:41:45.506695+0000","last_became_active":"2024-09-12T16:58:23.724300+0000","last_became_peered":"2024-09-12T16:58:23.724300+0000","last_unstale":"2024-09-12T17:41:45.506695+0000","last_undegraded":"2024-09-12T17:41:45.506695+0000","last_fullsized":"2024-09-12T17:41:45.506695+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T17:41:45.506523+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T17:41:45.506523+0000","last_clean_scrub_stamp":"2024-09-12T17:41:45.506523+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:28.275981+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"265'239","reported_seq":1311,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:01.796002+0000","last_change":"2024-09-12T17:42:01.796002+0000","last_active":"2024-09-12T17:42:01.796002+0000","last_peered":"2024-09-12T17:42:01.796002+0000","last_clean":"2024-09-12T17:42:01.796002+0000","last_became_active":"2024-09-12T16:58:25.949120+0000","last_became_peered":"2024-09-12T16:58:25.949120+0000","last_unstale":"2024-09-12T17:42:01.796002+0000","last_undegraded":"2024-09-12T17:42:01.796002+0000","last_fullsized":"2024-09-12T17:42:01.796002+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'239","last_scrub_stamp":"2024-09-12T17:42:01.795779+0000","last_deep_scrub":"265'239","last_deep_scrub_stamp":"2024-09-12T17:42:01.795779+0000","last_clean_scrub_stamp":"2024-09-12T17:42:01.795779+0000","objects_scrubbed":9,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:22.527870+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":178,"num_read_kb":168,"num_write":143,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5278,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:02.853267+0000","last_change":"2024-09-12T17:42:02.853131+0000","last_active":"2024-09-12T17:42:02.853267+0000","last_peered":"2024-09-12T17:42:02.853267+0000","last_clean":"2024-09-12T17:42:02.853267+0000","last_became_active":"2024-09-12T16:58:27.736215+0000","last_became_peered":"2024-09-12T16:58:27.736215+0000","last_unstale":"2024-09-12T17:42:02.853267+0000","last_undegraded":"2024-09-12T17:42:02.853267+0000","last_fullsized":"2024-09-12T17:42:02.853267+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:02.852940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:02.852940+0000","last_clean_scrub_stamp":"2024-09-12T17:42:02.852940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:03.518647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"265'255","reported_seq":869,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:13.572723+0000","last_change":"2024-09-12T17:42:13.572723+0000","last_active":"2024-09-12T17:42:13.572723+0000","last_peered":"2024-09-12T17:42:13.572723+0000","last_clean":"2024-09-12T17:42:13.572723+0000","last_became_active":"2024-09-12T16:58:29.792069+0000","last_became_peered":"2024-09-12T16:58:29.792069+0000","last_unstale":"2024-09-12T17:42:13.572723+0000","last_undegraded":"2024-09-12T17:42:13.572723+0000","last_fullsized":"2024-09-12T17:42:13.572723+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'255","last_scrub_stamp":"2024-09-12T17:42:13.572532+0000","last_deep_scrub":"265'255","last_deep_scrub_stamp":"2024-09-12T17:42:13.572532+0000","last_clean_scrub_stamp":"2024-09-12T17:42:13.572532+0000","objects_scrubbed":6,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:14.576924+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1041,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":529,"num_read_kb":546,"num_write":531,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"265'182","reported_seq":847,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:44.368918+0000","last_change":"2024-09-12T17:41:44.368734+0000","last_active":"2024-09-12T17:41:44.368918+0000","last_peered":"2024-09-12T17:41:44.368918+0000","last_clean":"2024-09-12T17:41:44.368918+0000","last_became_active":"2024-09-12T16:58:21.729848+0000","last_became_peered":"2024-09-12T16:58:21.729848+0000","last_unstale":"2024-09-12T17:41:44.368918+0000","last_undegraded":"2024-09-12T17:41:44.368918+0000","last_fullsized":"2024-09-12T17:41:44.368918+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'182","last_scrub_stamp":"2024-09-12T17:41:44.368559+0000","last_deep_scrub":"265'182","last_deep_scrub_stamp":"2024-09-12T17:41:44.368559+0000","last_clean_scrub_stamp":"2024-09-12T17:41:44.368559+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:17.854539+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":860,"num_read_kb":722,"num_write":267,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"265'3","reported_seq":532,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:39.591713+0000","last_change":"2024-09-12T17:41:39.591479+0000","last_active":"2024-09-12T17:41:39.591713+0000","last_peered":"2024-09-12T17:41:39.591713+0000","last_clean":"2024-09-12T17:41:39.591713+0000","last_became_active":"2024-09-12T16:58:08.538078+0000","last_became_peered":"2024-09-12T16:58:08.538078+0000","last_unstale":"2024-09-12T17:41:39.591713+0000","last_undegraded":"2024-09-12T17:41:39.591713+0000","last_fullsized":"2024-09-12T17:41:39.591713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T17:41:39.591211+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T17:41:39.591211+0000","last_clean_scrub_stamp":"2024-09-12T17:41:39.591211+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:33.661873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012028640000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"265'367","reported_seq":1087,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:38.629163+0000","last_change":"2024-09-12T17:41:38.629003+0000","last_active":"2024-09-12T17:41:38.629163+0000","last_peered":"2024-09-12T17:41:38.629163+0000","last_clean":"2024-09-12T17:41:38.629163+0000","last_became_active":"2024-09-12T16:58:18.690974+0000","last_became_peered":"2024-09-12T16:58:18.690974+0000","last_unstale":"2024-09-12T17:41:38.629163+0000","last_undegraded":"2024-09-12T17:41:38.629163+0000","last_fullsized":"2024-09-12T17:41:38.629163+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'367","last_scrub_stamp":"2024-09-12T17:41:38.628803+0000","last_deep_scrub":"265'367","last_deep_scrub_stamp":"2024-09-12T17:41:38.628803+0000","last_clean_scrub_stamp":"2024-09-12T17:41:38.628803+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:15.373546+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1105801,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":657,"num_read_kb":31815,"num_write":1139,"num_write_kb":57340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:56.985088+0000","last_change":"2024-09-12T17:41:56.985088+0000","last_active":"2024-09-12T17:41:56.985088+0000","last_peered":"2024-09-12T17:41:56.985088+0000","last_clean":"2024-09-12T17:41:56.985088+0000","last_became_active":"2024-09-12T16:58:23.713019+0000","last_became_peered":"2024-09-12T16:58:23.713019+0000","last_unstale":"2024-09-12T17:41:56.985088+0000","last_undegraded":"2024-09-12T17:41:56.985088+0000","last_fullsized":"2024-09-12T17:41:56.985088+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:56.984910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:56.984910+0000","last_clean_scrub_stamp":"2024-09-12T17:41:56.984910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:28.683508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"265'113","reported_seq":663,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:02.605508+0000","last_change":"2024-09-12T17:42:02.605508+0000","last_active":"2024-09-12T17:42:02.605508+0000","last_peered":"2024-09-12T17:42:02.605508+0000","last_clean":"2024-09-12T17:42:02.605508+0000","last_became_active":"2024-09-12T16:58:25.718364+0000","last_became_peered":"2024-09-12T16:58:25.718364+0000","last_unstale":"2024-09-12T17:42:02.605508+0000","last_undegraded":"2024-09-12T17:42:02.605508+0000","last_fullsized":"2024-09-12T17:42:02.605508+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'113","last_scrub_stamp":"2024-09-12T17:42:02.605277+0000","last_deep_scrub":"265'113","last_deep_scrub_stamp":"2024-09-12T17:42:02.605277+0000","last_clean_scrub_stamp":"2024-09-12T17:42:02.605277+0000","objects_scrubbed":7,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:02.779136+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":134,"num_write":100,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3358,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:58.366963+0000","last_change":"2024-09-12T17:41:58.366963+0000","last_active":"2024-09-12T17:41:58.366963+0000","last_peered":"2024-09-12T17:41:58.366963+0000","last_clean":"2024-09-12T17:41:58.366963+0000","last_became_active":"2024-09-12T16:58:27.761992+0000","last_became_peered":"2024-09-12T16:58:27.761992+0000","last_unstale":"2024-09-12T17:41:58.366963+0000","last_undegraded":"2024-09-12T17:41:58.366963+0000","last_fullsized":"2024-09-12T17:41:58.366963+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:58.366783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:58.366783+0000","last_clean_scrub_stamp":"2024-09-12T17:41:58.366783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:00.374257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"265'110","reported_seq":672,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:10.566248+0000","last_change":"2024-09-12T17:42:10.566248+0000","last_active":"2024-09-12T17:42:10.566248+0000","last_peered":"2024-09-12T17:42:10.566248+0000","last_clean":"2024-09-12T17:42:10.566248+0000","last_became_active":"2024-09-12T16:58:29.787823+0000","last_became_peered":"2024-09-12T16:58:29.787823+0000","last_unstale":"2024-09-12T17:42:10.566248+0000","last_undegraded":"2024-09-12T17:42:10.566248+0000","last_fullsized":"2024-09-12T17:42:10.566248+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'110","last_scrub_stamp":"2024-09-12T17:42:10.566058+0000","last_deep_scrub":"265'110","last_deep_scrub_stamp":"2024-09-12T17:42:10.566058+0000","last_clean_scrub_stamp":"2024-09-12T17:42:10.566058+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:05.960107+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":275,"num_read_kb":264,"num_write":276,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"265'60","reported_seq":622,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:46.382523+0000","last_change":"2024-09-12T17:41:46.382243+0000","last_active":"2024-09-12T17:41:46.382523+0000","last_peered":"2024-09-12T17:41:46.382523+0000","last_clean":"2024-09-12T17:41:46.382523+0000","last_became_active":"2024-09-12T16:58:21.720884+0000","last_became_peered":"2024-09-12T16:58:21.720884+0000","last_unstale":"2024-09-12T17:41:46.382523+0000","last_undegraded":"2024-09-12T17:41:46.382523+0000","last_fullsized":"2024-09-12T17:41:46.382523+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'60","last_scrub_stamp":"2024-09-12T17:41:46.382003+0000","last_deep_scrub":"265'60","last_deep_scrub_stamp":"2024-09-12T17:41:46.382003+0000","last_clean_scrub_stamp":"2024-09-12T17:41:46.382003+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:39.632797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":223,"num_write":91,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"265'382","reported_seq":1037,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:41.628013+0000","last_change":"2024-09-12T17:41:41.627826+0000","last_active":"2024-09-12T17:41:41.628013+0000","last_peered":"2024-09-12T17:41:41.628013+0000","last_clean":"2024-09-12T17:41:41.628013+0000","last_became_active":"2024-09-12T16:58:18.718447+0000","last_became_peered":"2024-09-12T16:58:18.718447+0000","last_unstale":"2024-09-12T17:41:41.628013+0000","last_undegraded":"2024-09-12T17:41:41.628013+0000","last_fullsized":"2024-09-12T17:41:41.628013+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'382","last_scrub_stamp":"2024-09-12T17:41:41.627618+0000","last_deep_scrub":"265'382","last_deep_scrub_stamp":"2024-09-12T17:41:41.627618+0000","last_clean_scrub_stamp":"2024-09-12T17:41:41.627618+0000","objects_scrubbed":6,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:27.860391+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569509,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":515,"num_read_kb":35874,"num_write":1210,"num_write_kb":51856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:39.427247+0000","last_change":"2024-09-12T17:41:39.427122+0000","last_active":"2024-09-12T17:41:39.427247+0000","last_peered":"2024-09-12T17:41:39.427247+0000","last_clean":"2024-09-12T17:41:39.427247+0000","last_became_active":"2024-09-12T16:58:08.842793+0000","last_became_peered":"2024-09-12T16:58:08.842793+0000","last_unstale":"2024-09-12T17:41:39.427247+0000","last_undegraded":"2024-09-12T17:41:39.427247+0000","last_fullsized":"2024-09-12T17:41:39.427247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:39.426951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:39.426951+0000","last_clean_scrub_stamp":"2024-09-12T17:41:39.426951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:26.839539+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001121181,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:55.062525+0000","last_change":"2024-09-12T17:41:55.062333+0000","last_active":"2024-09-12T17:41:55.062525+0000","last_peered":"2024-09-12T17:41:55.062525+0000","last_clean":"2024-09-12T17:41:55.062525+0000","last_became_active":"2024-09-12T16:58:23.710355+0000","last_became_peered":"2024-09-12T16:58:23.710355+0000","last_unstale":"2024-09-12T17:41:55.062525+0000","last_undegraded":"2024-09-12T17:41:55.062525+0000","last_fullsized":"2024-09-12T17:41:55.062525+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:55.062149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:55.062149+0000","last_clean_scrub_stamp":"2024-09-12T17:41:55.062149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:43.683368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"265'579","reported_seq":1247,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:00.972950+0000","last_change":"2024-09-12T17:42:00.972950+0000","last_active":"2024-09-12T17:42:00.972950+0000","last_peered":"2024-09-12T17:42:00.972950+0000","last_clean":"2024-09-12T17:42:00.972950+0000","last_became_active":"2024-09-12T16:58:25.729627+0000","last_became_peered":"2024-09-12T16:58:25.729627+0000","last_unstale":"2024-09-12T17:42:00.972950+0000","last_undegraded":"2024-09-12T17:42:00.972950+0000","last_fullsized":"2024-09-12T17:42:00.972950+0000","mapping_epoch":30,"log_start":"265'500","ondisk_log_start":"265'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'579","last_scrub_stamp":"2024-09-12T17:42:00.972736+0000","last_deep_scrub":"265'579","last_deep_scrub_stamp":"2024-09-12T17:42:00.972736+0000","last_clean_scrub_stamp":"2024-09-12T17:42:00.972736+0000","objects_scrubbed":11,"log_size":79,"log_dups_size":500,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:33.694731+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101207,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1575,"num_read_kb":2772,"num_write":2032,"num_write_kb":1870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":506974,"num_omap_keys":1146,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:07.590551+0000","last_change":"2024-09-12T17:42:07.590263+0000","last_active":"2024-09-12T17:42:07.590551+0000","last_peered":"2024-09-12T17:42:07.590551+0000","last_clean":"2024-09-12T17:42:07.590551+0000","last_became_active":"2024-09-12T16:58:27.733289+0000","last_became_peered":"2024-09-12T16:58:27.733289+0000","last_unstale":"2024-09-12T17:42:07.590551+0000","last_undegraded":"2024-09-12T17:42:07.590551+0000","last_fullsized":"2024-09-12T17:42:07.590551+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:07.590042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:07.590042+0000","last_clean_scrub_stamp":"2024-09-12T17:42:07.590042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:02.078261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"265'161","reported_seq":673,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:13.948775+0000","last_change":"2024-09-12T17:42:13.948775+0000","last_active":"2024-09-12T17:42:13.948775+0000","last_peered":"2024-09-12T17:42:13.948775+0000","last_clean":"2024-09-12T17:42:13.948775+0000","last_became_active":"2024-09-12T16:58:29.779052+0000","last_became_peered":"2024-09-12T16:58:29.779052+0000","last_unstale":"2024-09-12T17:42:13.948775+0000","last_undegraded":"2024-09-12T17:42:13.948775+0000","last_fullsized":"2024-09-12T17:42:13.948775+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'161","last_scrub_stamp":"2024-09-12T17:42:13.948585+0000","last_deep_scrub":"265'161","last_deep_scrub_stamp":"2024-09-12T17:42:13.948585+0000","last_clean_scrub_stamp":"2024-09-12T17:42:13.948585+0000","objects_scrubbed":4,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:24.925033+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":199,"num_read_kb":192,"num_write":361,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"265'202","reported_seq":815,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:46.191761+0000","last_change":"2024-09-12T17:41:46.191587+0000","last_active":"2024-09-12T17:41:46.191761+0000","last_peered":"2024-09-12T17:41:46.191761+0000","last_clean":"2024-09-12T17:41:46.191761+0000","last_became_active":"2024-09-12T16:58:21.701657+0000","last_became_peered":"2024-09-12T16:58:21.701657+0000","last_unstale":"2024-09-12T17:41:46.191761+0000","last_undegraded":"2024-09-12T17:41:46.191761+0000","last_fullsized":"2024-09-12T17:41:46.191761+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'202","last_scrub_stamp":"2024-09-12T17:41:46.191396+0000","last_deep_scrub":"265'202","last_deep_scrub_stamp":"2024-09-12T17:41:46.191396+0000","last_clean_scrub_stamp":"2024-09-12T17:41:46.191396+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:56.805877+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":888,"num_read_kb":728,"num_write":297,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"265'333","reported_seq":966,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:42.447729+0000","last_change":"2024-09-12T17:41:42.447586+0000","last_active":"2024-09-12T17:41:42.447729+0000","last_peered":"2024-09-12T17:41:42.447729+0000","last_clean":"2024-09-12T17:41:42.447729+0000","last_became_active":"2024-09-12T16:58:18.698417+0000","last_became_peered":"2024-09-12T16:58:18.698417+0000","last_unstale":"2024-09-12T17:41:42.447729+0000","last_undegraded":"2024-09-12T17:41:42.447729+0000","last_fullsized":"2024-09-12T17:41:42.447729+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'333","last_scrub_stamp":"2024-09-12T17:41:42.447381+0000","last_deep_scrub":"265'333","last_deep_scrub_stamp":"2024-09-12T17:41:42.447381+0000","last_clean_scrub_stamp":"2024-09-12T17:41:42.447381+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:25.913614+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":462,"num_read_kb":2498,"num_write":998,"num_write_kb":19196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:48.544743+0000","last_change":"2024-09-12T17:41:48.544587+0000","last_active":"2024-09-12T17:41:48.544743+0000","last_peered":"2024-09-12T17:41:48.544743+0000","last_clean":"2024-09-12T17:41:48.544743+0000","last_became_active":"2024-09-12T16:58:08.841831+0000","last_became_peered":"2024-09-12T16:58:08.841831+0000","last_unstale":"2024-09-12T17:41:48.544743+0000","last_undegraded":"2024-09-12T17:41:48.544743+0000","last_fullsized":"2024-09-12T17:41:48.544743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:48.544399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:48.544399+0000","last_clean_scrub_stamp":"2024-09-12T17:41:48.544399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:56.853257+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0013535820000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:52.494249+0000","last_change":"2024-09-12T17:41:52.494127+0000","last_active":"2024-09-12T17:41:52.494249+0000","last_peered":"2024-09-12T17:41:52.494249+0000","last_clean":"2024-09-12T17:41:52.494249+0000","last_became_active":"2024-09-12T16:58:23.707729+0000","last_became_peered":"2024-09-12T16:58:23.707729+0000","last_unstale":"2024-09-12T17:41:52.494249+0000","last_undegraded":"2024-09-12T17:41:52.494249+0000","last_fullsized":"2024-09-12T17:41:52.494249+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:52.493942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:52.493942+0000","last_clean_scrub_stamp":"2024-09-12T17:41:52.493942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:36.835671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"265'158","reported_seq":727,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:55.406020+0000","last_change":"2024-09-12T17:41:55.405867+0000","last_active":"2024-09-12T17:41:55.406020+0000","last_peered":"2024-09-12T17:41:55.406020+0000","last_clean":"2024-09-12T17:41:55.406020+0000","last_became_active":"2024-09-12T16:58:25.950057+0000","last_became_peered":"2024-09-12T16:58:25.950057+0000","last_unstale":"2024-09-12T17:41:55.406020+0000","last_undegraded":"2024-09-12T17:41:55.406020+0000","last_fullsized":"2024-09-12T17:41:55.406020+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'158","last_scrub_stamp":"2024-09-12T17:41:55.405681+0000","last_deep_scrub":"265'158","last_deep_scrub_stamp":"2024-09-12T17:41:55.405681+0000","last_clean_scrub_stamp":"2024-09-12T17:41:55.405681+0000","objects_scrubbed":8,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:53.277423+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":199,"num_read_kb":190,"num_write":134,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"265'771","reported_seq":2779,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:08.616222+0000","last_change":"2024-09-12T17:42:08.616222+0000","last_active":"2024-09-12T17:42:08.616222+0000","last_peered":"2024-09-12T17:42:08.616222+0000","last_clean":"2024-09-12T17:42:08.616222+0000","last_became_active":"2024-09-12T16:58:27.756883+0000","last_became_peered":"2024-09-12T16:58:27.756883+0000","last_unstale":"2024-09-12T17:42:08.616222+0000","last_undegraded":"2024-09-12T17:42:08.616222+0000","last_fullsized":"2024-09-12T17:42:08.616222+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'771","last_scrub_stamp":"2024-09-12T17:42:08.616048+0000","last_deep_scrub":"265'771","last_deep_scrub_stamp":"2024-09-12T17:42:08.616048+0000","last_clean_scrub_stamp":"2024-09-12T17:42:08.616048+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:03.636002+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"265'137","reported_seq":644,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:12.551289+0000","last_change":"2024-09-12T17:42:12.551289+0000","last_active":"2024-09-12T17:42:12.551289+0000","last_peered":"2024-09-12T17:42:12.551289+0000","last_clean":"2024-09-12T17:42:12.551289+0000","last_became_active":"2024-09-12T16:58:29.784743+0000","last_became_peered":"2024-09-12T16:58:29.784743+0000","last_unstale":"2024-09-12T17:42:12.551289+0000","last_undegraded":"2024-09-12T17:42:12.551289+0000","last_fullsized":"2024-09-12T17:42:12.551289+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'137","last_scrub_stamp":"2024-09-12T17:42:12.551048+0000","last_deep_scrub":"265'137","last_deep_scrub_stamp":"2024-09-12T17:42:12.551048+0000","last_clean_scrub_stamp":"2024-09-12T17:42:12.551048+0000","objects_scrubbed":6,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:55.389053+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1532,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":153,"num_read_kb":151,"num_write":316,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"265'50","reported_seq":595,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:46.640425+0000","last_change":"2024-09-12T17:41:46.640425+0000","last_active":"2024-09-12T17:41:46.640425+0000","last_peered":"2024-09-12T17:41:46.640425+0000","last_clean":"2024-09-12T17:41:46.640425+0000","last_became_active":"2024-09-12T16:58:21.723391+0000","last_became_peered":"2024-09-12T16:58:21.723391+0000","last_unstale":"2024-09-12T17:41:46.640425+0000","last_undegraded":"2024-09-12T17:41:46.640425+0000","last_fullsized":"2024-09-12T17:41:46.640425+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'50","last_scrub_stamp":"2024-09-12T17:41:46.640257+0000","last_deep_scrub":"265'50","last_deep_scrub_stamp":"2024-09-12T17:41:46.640257+0000","last_clean_scrub_stamp":"2024-09-12T17:41:46.640257+0000","objects_scrubbed":1,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:57.222046+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":182,"num_write":83,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":760,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"265'466","reported_seq":1113,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:38.799638+0000","last_change":"2024-09-12T17:41:38.799581+0000","last_active":"2024-09-12T17:41:38.799638+0000","last_peered":"2024-09-12T17:41:38.799638+0000","last_clean":"2024-09-12T17:41:38.799638+0000","last_became_active":"2024-09-12T16:58:18.686966+0000","last_became_peered":"2024-09-12T16:58:18.686966+0000","last_unstale":"2024-09-12T17:41:38.799638+0000","last_undegraded":"2024-09-12T17:41:38.799638+0000","last_fullsized":"2024-09-12T17:41:38.799638+0000","mapping_epoch":23,"log_start":"265'400","ondisk_log_start":"265'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'466","last_scrub_stamp":"2024-09-12T17:41:38.799492+0000","last_deep_scrub":"265'466","last_deep_scrub_stamp":"2024-09-12T17:41:38.799492+0000","last_clean_scrub_stamp":"2024-09-12T17:41:38.799492+0000","objects_scrubbed":7,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:31.946406+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376560,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":630,"num_read_kb":10296,"num_write":1224,"num_write_kb":24848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:37.425805+0000","last_change":"2024-09-12T17:41:37.425805+0000","last_active":"2024-09-12T17:41:37.425805+0000","last_peered":"2024-09-12T17:41:37.425805+0000","last_clean":"2024-09-12T17:41:37.425805+0000","last_became_active":"2024-09-12T16:58:08.544406+0000","last_became_peered":"2024-09-12T16:58:08.544406+0000","last_unstale":"2024-09-12T17:41:37.425805+0000","last_undegraded":"2024-09-12T17:41:37.425805+0000","last_fullsized":"2024-09-12T17:41:37.425805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:37.425638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:37.425638+0000","last_clean_scrub_stamp":"2024-09-12T17:41:37.425638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:38.294788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012247510000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:59.649035+0000","last_change":"2024-09-12T17:41:59.648870+0000","last_active":"2024-09-12T17:41:59.649035+0000","last_peered":"2024-09-12T17:41:59.649035+0000","last_clean":"2024-09-12T17:41:59.649035+0000","last_became_active":"2024-09-12T16:58:23.700331+0000","last_became_peered":"2024-09-12T16:58:23.700331+0000","last_unstale":"2024-09-12T17:41:59.649035+0000","last_undegraded":"2024-09-12T17:41:59.649035+0000","last_fullsized":"2024-09-12T17:41:59.649035+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:59.648693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:59.648693+0000","last_clean_scrub_stamp":"2024-09-12T17:41:59.648693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:33.328184+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"265'125","reported_seq":669,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:03.557099+0000","last_change":"2024-09-12T17:42:03.556962+0000","last_active":"2024-09-12T17:42:03.557099+0000","last_peered":"2024-09-12T17:42:03.557099+0000","last_clean":"2024-09-12T17:42:03.557099+0000","last_became_active":"2024-09-12T16:58:25.730018+0000","last_became_peered":"2024-09-12T16:58:25.730018+0000","last_unstale":"2024-09-12T17:42:03.557099+0000","last_undegraded":"2024-09-12T17:42:03.557099+0000","last_fullsized":"2024-09-12T17:42:03.557099+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'125","last_scrub_stamp":"2024-09-12T17:42:03.556760+0000","last_deep_scrub":"265'125","last_deep_scrub_stamp":"2024-09-12T17:42:03.556760+0000","last_clean_scrub_stamp":"2024-09-12T17:42:03.556760+0000","objects_scrubbed":6,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:04.648557+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":134,"num_read_kb":123,"num_write":96,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"265'787","reported_seq":2358,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:09.504241+0000","last_change":"2024-09-12T17:42:09.504081+0000","last_active":"2024-09-12T17:42:09.504241+0000","last_peered":"2024-09-12T17:42:09.504241+0000","last_clean":"2024-09-12T17:42:09.504241+0000","last_became_active":"2024-09-12T16:58:27.746177+0000","last_became_peered":"2024-09-12T16:58:27.746177+0000","last_unstale":"2024-09-12T17:42:09.504241+0000","last_undegraded":"2024-09-12T17:42:09.504241+0000","last_fullsized":"2024-09-12T17:42:09.504241+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'787","last_scrub_stamp":"2024-09-12T17:42:09.503916+0000","last_deep_scrub":"265'787","last_deep_scrub_stamp":"2024-09-12T17:42:09.503916+0000","last_clean_scrub_stamp":"2024-09-12T17:42:09.503916+0000","objects_scrubbed":1,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:19.410476+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"265'172","reported_seq":674,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:12.969049+0000","last_change":"2024-09-12T17:42:12.969049+0000","last_active":"2024-09-12T17:42:12.969049+0000","last_peered":"2024-09-12T17:42:12.969049+0000","last_clean":"2024-09-12T17:42:12.969049+0000","last_became_active":"2024-09-12T16:58:29.790535+0000","last_became_peered":"2024-09-12T16:58:29.790535+0000","last_unstale":"2024-09-12T17:42:12.969049+0000","last_undegraded":"2024-09-12T17:42:12.969049+0000","last_fullsized":"2024-09-12T17:42:12.969049+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'172","last_scrub_stamp":"2024-09-12T17:42:12.968804+0000","last_deep_scrub":"265'172","last_deep_scrub_stamp":"2024-09-12T17:42:12.968804+0000","last_clean_scrub_stamp":"2024-09-12T17:42:12.968804+0000","objects_scrubbed":4,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:51:37.815722+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":476,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":147,"num_read_kb":144,"num_write":393,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"265'96","reported_seq":669,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:43.661704+0000","last_change":"2024-09-12T17:41:43.661578+0000","last_active":"2024-09-12T17:41:43.661704+0000","last_peered":"2024-09-12T17:41:43.661704+0000","last_clean":"2024-09-12T17:41:43.661704+0000","last_became_active":"2024-09-12T16:58:21.701206+0000","last_became_peered":"2024-09-12T16:58:21.701206+0000","last_unstale":"2024-09-12T17:41:43.661704+0000","last_undegraded":"2024-09-12T17:41:43.661704+0000","last_fullsized":"2024-09-12T17:41:43.661704+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'96","last_scrub_stamp":"2024-09-12T17:41:43.661384+0000","last_deep_scrub":"265'96","last_deep_scrub_stamp":"2024-09-12T17:41:43.661384+0000","last_clean_scrub_stamp":"2024-09-12T17:41:43.661384+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:19.823171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":405,"num_read_kb":331,"num_write":157,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"265'370","reported_seq":1035,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:37.268281+0000","last_change":"2024-09-12T17:41:37.268183+0000","last_active":"2024-09-12T17:41:37.268281+0000","last_peered":"2024-09-12T17:41:37.268281+0000","last_clean":"2024-09-12T17:41:37.268281+0000","last_became_active":"2024-09-12T16:58:18.701270+0000","last_became_peered":"2024-09-12T16:58:18.701270+0000","last_unstale":"2024-09-12T17:41:37.268281+0000","last_undegraded":"2024-09-12T17:41:37.268281+0000","last_fullsized":"2024-09-12T17:41:37.268281+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'370","last_scrub_stamp":"2024-09-12T17:41:37.268034+0000","last_deep_scrub":"265'370","last_deep_scrub_stamp":"2024-09-12T17:41:37.268034+0000","last_clean_scrub_stamp":"2024-09-12T17:41:37.268034+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:22.095358+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":575,"num_read_kb":17292,"num_write":1132,"num_write_kb":31476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:39.456766+0000","last_change":"2024-09-12T17:41:39.456766+0000","last_active":"2024-09-12T17:41:39.456766+0000","last_peered":"2024-09-12T17:41:39.456766+0000","last_clean":"2024-09-12T17:41:39.456766+0000","last_became_active":"2024-09-12T16:58:08.546519+0000","last_became_peered":"2024-09-12T16:58:08.546519+0000","last_unstale":"2024-09-12T17:41:39.456766+0000","last_undegraded":"2024-09-12T17:41:39.456766+0000","last_fullsized":"2024-09-12T17:41:39.456766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:39.456592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:39.456592+0000","last_clean_scrub_stamp":"2024-09-12T17:41:39.456592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:55.571196+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00088376600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":509,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:00.527570+0000","last_change":"2024-09-12T17:42:00.527570+0000","last_active":"2024-09-12T17:42:00.527570+0000","last_peered":"2024-09-12T17:42:00.527570+0000","last_clean":"2024-09-12T17:42:00.527570+0000","last_became_active":"2024-09-12T16:58:23.707022+0000","last_became_peered":"2024-09-12T16:58:23.707022+0000","last_unstale":"2024-09-12T17:42:00.527570+0000","last_undegraded":"2024-09-12T17:42:00.527570+0000","last_fullsized":"2024-09-12T17:42:00.527570+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:00.527484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:00.527484+0000","last_clean_scrub_stamp":"2024-09-12T17:42:00.527484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:59.130451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"265'749","reported_seq":1475,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:04.776744+0000","last_change":"2024-09-12T17:42:04.776585+0000","last_active":"2024-09-12T17:42:04.776744+0000","last_peered":"2024-09-12T17:42:04.776744+0000","last_clean":"2024-09-12T17:42:04.776744+0000","last_became_active":"2024-09-12T16:58:25.949263+0000","last_became_peered":"2024-09-12T16:58:25.949263+0000","last_unstale":"2024-09-12T17:42:04.776744+0000","last_undegraded":"2024-09-12T17:42:04.776744+0000","last_fullsized":"2024-09-12T17:42:04.776744+0000","mapping_epoch":30,"log_start":"265'700","ondisk_log_start":"265'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'749","last_scrub_stamp":"2024-09-12T17:42:04.776391+0000","last_deep_scrub":"265'749","last_deep_scrub_stamp":"2024-09-12T17:42:04.776391+0000","last_clean_scrub_stamp":"2024-09-12T17:42:04.776391+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":700,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:08:09.245677+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143781,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1330,"num_read_kb":3188,"num_write":1090,"num_write_kb":918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:08.521874+0000","last_change":"2024-09-12T17:42:08.521720+0000","last_active":"2024-09-12T17:42:08.521874+0000","last_peered":"2024-09-12T17:42:08.521874+0000","last_clean":"2024-09-12T17:42:08.521874+0000","last_became_active":"2024-09-12T16:58:27.741779+0000","last_became_peered":"2024-09-12T16:58:27.741779+0000","last_unstale":"2024-09-12T17:42:08.521874+0000","last_undegraded":"2024-09-12T17:42:08.521874+0000","last_fullsized":"2024-09-12T17:42:08.521874+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:08.521530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:08.521530+0000","last_clean_scrub_stamp":"2024-09-12T17:42:08.521530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:15.340697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"265'146","reported_seq":656,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:11.551278+0000","last_change":"2024-09-12T17:42:11.551278+0000","last_active":"2024-09-12T17:42:11.551278+0000","last_peered":"2024-09-12T17:42:11.551278+0000","last_clean":"2024-09-12T17:42:11.551278+0000","last_became_active":"2024-09-12T16:58:29.787692+0000","last_became_peered":"2024-09-12T16:58:29.787692+0000","last_unstale":"2024-09-12T17:42:11.551278+0000","last_undegraded":"2024-09-12T17:42:11.551278+0000","last_fullsized":"2024-09-12T17:42:11.551278+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'146","last_scrub_stamp":"2024-09-12T17:42:11.551054+0000","last_deep_scrub":"265'146","last_deep_scrub_stamp":"2024-09-12T17:42:11.551054+0000","last_clean_scrub_stamp":"2024-09-12T17:42:11.551054+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:05.463173+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":218,"num_read_kb":207,"num_write":364,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"265'165","reported_seq":724,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:15.907409+0000","last_change":"2024-09-12T17:42:15.907275+0000","last_active":"2024-09-12T17:42:15.907409+0000","last_peered":"2024-09-12T17:42:15.907409+0000","last_clean":"2024-09-12T17:42:15.907409+0000","last_became_active":"2024-09-12T16:58:29.782784+0000","last_became_peered":"2024-09-12T16:58:29.782784+0000","last_unstale":"2024-09-12T17:42:15.907409+0000","last_undegraded":"2024-09-12T17:42:15.907409+0000","last_fullsized":"2024-09-12T17:42:15.907409+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'165","last_scrub_stamp":"2024-09-12T17:42:15.907089+0000","last_deep_scrub":"265'165","last_deep_scrub_stamp":"2024-09-12T17:42:15.907089+0000","last_clean_scrub_stamp":"2024-09-12T17:42:15.907089+0000","objects_scrubbed":3,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:34.767730+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":629,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":266,"num_read_kb":264,"num_write":397,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"265'100","reported_seq":695,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:47.569629+0000","last_change":"2024-09-12T17:41:47.569629+0000","last_active":"2024-09-12T17:41:47.569629+0000","last_peered":"2024-09-12T17:41:47.569629+0000","last_clean":"2024-09-12T17:41:47.569629+0000","last_became_active":"2024-09-12T16:58:21.731509+0000","last_became_peered":"2024-09-12T16:58:21.731509+0000","last_unstale":"2024-09-12T17:41:47.569629+0000","last_undegraded":"2024-09-12T17:41:47.569629+0000","last_fullsized":"2024-09-12T17:41:47.569629+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'100","last_scrub_stamp":"2024-09-12T17:41:47.569417+0000","last_deep_scrub":"265'100","last_deep_scrub_stamp":"2024-09-12T17:41:47.569417+0000","last_clean_scrub_stamp":"2024-09-12T17:41:47.569417+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:35.252758+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":445,"num_read_kb":375,"num_write":158,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"265'305","reported_seq":938,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:39.651915+0000","last_change":"2024-09-12T17:41:39.651915+0000","last_active":"2024-09-12T17:41:39.651915+0000","last_peered":"2024-09-12T17:41:39.651915+0000","last_clean":"2024-09-12T17:41:39.651915+0000","last_became_active":"2024-09-12T16:58:18.700214+0000","last_became_peered":"2024-09-12T16:58:18.700214+0000","last_unstale":"2024-09-12T17:41:39.651915+0000","last_undegraded":"2024-09-12T17:41:39.651915+0000","last_fullsized":"2024-09-12T17:41:39.651915+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'305","last_scrub_stamp":"2024-09-12T17:41:39.651676+0000","last_deep_scrub":"265'305","last_deep_scrub_stamp":"2024-09-12T17:41:39.651676+0000","last_clean_scrub_stamp":"2024-09-12T17:41:39.651676+0000","objects_scrubbed":6,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:32.335113+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":472,"num_read_kb":3767,"num_write":1042,"num_write_kb":19533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:53.398007+0000","last_change":"2024-09-12T17:41:53.398007+0000","last_active":"2024-09-12T17:41:53.398007+0000","last_peered":"2024-09-12T17:41:53.398007+0000","last_clean":"2024-09-12T17:41:53.398007+0000","last_became_active":"2024-09-12T16:58:23.725034+0000","last_became_peered":"2024-09-12T16:58:23.725034+0000","last_unstale":"2024-09-12T17:41:53.398007+0000","last_undegraded":"2024-09-12T17:41:53.398007+0000","last_fullsized":"2024-09-12T17:41:53.398007+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:53.397794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:53.397794+0000","last_clean_scrub_stamp":"2024-09-12T17:41:53.397794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:47.628035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"265'277","reported_seq":860,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:06.606460+0000","last_change":"2024-09-12T17:42:06.606460+0000","last_active":"2024-09-12T17:42:06.606460+0000","last_peered":"2024-09-12T17:42:06.606460+0000","last_clean":"2024-09-12T17:42:06.606460+0000","last_became_active":"2024-09-12T16:58:25.737706+0000","last_became_peered":"2024-09-12T16:58:25.737706+0000","last_unstale":"2024-09-12T17:42:06.606460+0000","last_undegraded":"2024-09-12T17:42:06.606460+0000","last_fullsized":"2024-09-12T17:42:06.606460+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'277","last_scrub_stamp":"2024-09-12T17:42:06.606252+0000","last_deep_scrub":"265'277","last_deep_scrub_stamp":"2024-09-12T17:42:06.606252+0000","last_clean_scrub_stamp":"2024-09-12T17:42:06.606252+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:10.416041+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54495,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":451,"num_read_kb":1025,"num_write":366,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:14.553135+0000","last_change":"2024-09-12T17:42:14.553135+0000","last_active":"2024-09-12T17:42:14.553135+0000","last_peered":"2024-09-12T17:42:14.553135+0000","last_clean":"2024-09-12T17:42:14.553135+0000","last_became_active":"2024-09-12T16:58:27.746143+0000","last_became_peered":"2024-09-12T16:58:27.746143+0000","last_unstale":"2024-09-12T17:42:14.553135+0000","last_undegraded":"2024-09-12T17:42:14.553135+0000","last_fullsized":"2024-09-12T17:42:14.553135+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:14.552932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:14.552932+0000","last_clean_scrub_stamp":"2024-09-12T17:42:14.552932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:22.802420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"265'116","reported_seq":626,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:57.572381+0000","last_change":"2024-09-12T16:58:29.786922+0000","last_active":"2024-09-12T17:38:57.572381+0000","last_peered":"2024-09-12T17:38:57.572381+0000","last_clean":"2024-09-12T17:38:57.572381+0000","last_became_active":"2024-09-12T16:58:29.784143+0000","last_became_peered":"2024-09-12T16:58:29.784143+0000","last_unstale":"2024-09-12T17:38:57.572381+0000","last_undegraded":"2024-09-12T17:38:57.572381+0000","last_fullsized":"2024-09-12T17:38:57.572381+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T16:58:28.734039+0000","last_clean_scrub_stamp":"2024-09-12T16:58:28.734039+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:57.768618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":186,"num_write":283,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"265'174","reported_seq":835,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:49.351699+0000","last_change":"2024-09-12T17:41:49.351699+0000","last_active":"2024-09-12T17:41:49.351699+0000","last_peered":"2024-09-12T17:41:49.351699+0000","last_clean":"2024-09-12T17:41:49.351699+0000","last_became_active":"2024-09-12T16:58:21.715193+0000","last_became_peered":"2024-09-12T16:58:21.715193+0000","last_unstale":"2024-09-12T17:41:49.351699+0000","last_undegraded":"2024-09-12T17:41:49.351699+0000","last_fullsized":"2024-09-12T17:41:49.351699+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'174","last_scrub_stamp":"2024-09-12T17:41:49.351495+0000","last_deep_scrub":"265'174","last_deep_scrub_stamp":"2024-09-12T17:41:49.351495+0000","last_clean_scrub_stamp":"2024-09-12T17:41:49.351495+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:24.477655+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":752,"num_read_kb":633,"num_write":248,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"265'344","reported_seq":980,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:47.512874+0000","last_change":"2024-09-12T17:41:47.512734+0000","last_active":"2024-09-12T17:41:47.512874+0000","last_peered":"2024-09-12T17:41:47.512874+0000","last_clean":"2024-09-12T17:41:47.512874+0000","last_became_active":"2024-09-12T16:58:18.686155+0000","last_became_peered":"2024-09-12T16:58:18.686155+0000","last_unstale":"2024-09-12T17:41:47.512874+0000","last_undegraded":"2024-09-12T17:41:47.512874+0000","last_fullsized":"2024-09-12T17:41:47.512874+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'344","last_scrub_stamp":"2024-09-12T17:41:47.512547+0000","last_deep_scrub":"265'344","last_deep_scrub_stamp":"2024-09-12T17:41:47.512547+0000","last_clean_scrub_stamp":"2024-09-12T17:41:47.512547+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:09.454509+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029079,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":528,"num_read_kb":20889,"num_write":1017,"num_write_kb":24291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:55.515139+0000","last_change":"2024-09-12T17:41:55.515139+0000","last_active":"2024-09-12T17:41:55.515139+0000","last_peered":"2024-09-12T17:41:55.515139+0000","last_clean":"2024-09-12T17:41:55.515139+0000","last_became_active":"2024-09-12T16:58:23.713069+0000","last_became_peered":"2024-09-12T16:58:23.713069+0000","last_unstale":"2024-09-12T17:41:55.515139+0000","last_undegraded":"2024-09-12T17:41:55.515139+0000","last_fullsized":"2024-09-12T17:41:55.515139+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:55.514956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:55.514956+0000","last_clean_scrub_stamp":"2024-09-12T17:41:55.514956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:26.580464+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"265'38","reported_seq":545,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:59.987428+0000","last_change":"2024-09-12T17:41:59.987428+0000","last_active":"2024-09-12T17:41:59.987428+0000","last_peered":"2024-09-12T17:41:59.987428+0000","last_clean":"2024-09-12T17:41:59.987428+0000","last_became_active":"2024-09-12T16:58:25.730410+0000","last_became_peered":"2024-09-12T16:58:25.730410+0000","last_unstale":"2024-09-12T17:41:59.987428+0000","last_undegraded":"2024-09-12T17:41:59.987428+0000","last_fullsized":"2024-09-12T17:41:59.987428+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'38","last_scrub_stamp":"2024-09-12T17:41:59.987182+0000","last_deep_scrub":"265'38","last_deep_scrub_stamp":"2024-09-12T17:41:59.987182+0000","last_clean_scrub_stamp":"2024-09-12T17:41:59.987182+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:57.218911+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:08.666588+0000","last_change":"2024-09-12T17:42:08.666588+0000","last_active":"2024-09-12T17:42:08.666588+0000","last_peered":"2024-09-12T17:42:08.666588+0000","last_clean":"2024-09-12T17:42:08.666588+0000","last_became_active":"2024-09-12T16:58:27.742979+0000","last_became_peered":"2024-09-12T16:58:27.742979+0000","last_unstale":"2024-09-12T17:42:08.666588+0000","last_undegraded":"2024-09-12T17:42:08.666588+0000","last_fullsized":"2024-09-12T17:42:08.666588+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:08.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:08.666400+0000","last_clean_scrub_stamp":"2024-09-12T17:42:08.666400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:38.590316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"265'209","reported_seq":737,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:14.947644+0000","last_change":"2024-09-12T17:42:14.947644+0000","last_active":"2024-09-12T17:42:14.947644+0000","last_peered":"2024-09-12T17:42:14.947644+0000","last_clean":"2024-09-12T17:42:14.947644+0000","last_became_active":"2024-09-12T16:58:29.782024+0000","last_became_peered":"2024-09-12T16:58:29.782024+0000","last_unstale":"2024-09-12T17:42:14.947644+0000","last_undegraded":"2024-09-12T17:42:14.947644+0000","last_fullsized":"2024-09-12T17:42:14.947644+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'209","last_scrub_stamp":"2024-09-12T17:42:14.947455+0000","last_deep_scrub":"265'209","last_deep_scrub_stamp":"2024-09-12T17:42:14.947455+0000","last_clean_scrub_stamp":"2024-09-12T17:42:14.947455+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:44.960259+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":358,"num_read_kb":350,"num_write":466,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"265'522","reported_seq":1262,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:52.511408+0000","last_change":"2024-09-12T17:41:52.511408+0000","last_active":"2024-09-12T17:41:52.511408+0000","last_peered":"2024-09-12T17:41:52.511408+0000","last_clean":"2024-09-12T17:41:52.511408+0000","last_became_active":"2024-09-12T16:58:21.711637+0000","last_became_peered":"2024-09-12T16:58:21.711637+0000","last_unstale":"2024-09-12T17:41:52.511408+0000","last_undegraded":"2024-09-12T17:41:52.511408+0000","last_fullsized":"2024-09-12T17:41:52.511408+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'522","last_scrub_stamp":"2024-09-12T17:41:52.511214+0000","last_deep_scrub":"265'522","last_deep_scrub_stamp":"2024-09-12T17:41:52.511214+0000","last_clean_scrub_stamp":"2024-09-12T17:41:52.511214+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:52.916702+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2547,"num_read_kb":2246,"num_write":971,"num_write_kb":585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2872,"num_omap_keys":12,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"265'374","reported_seq":984,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:37.559542+0000","last_change":"2024-09-12T17:41:37.559542+0000","last_active":"2024-09-12T17:41:37.559542+0000","last_peered":"2024-09-12T17:41:37.559542+0000","last_clean":"2024-09-12T17:41:37.559542+0000","last_became_active":"2024-09-12T16:58:55.851886+0000","last_became_peered":"2024-09-12T16:58:55.851886+0000","last_unstale":"2024-09-12T17:41:37.559542+0000","last_undegraded":"2024-09-12T17:41:37.559542+0000","last_fullsized":"2024-09-12T17:41:37.559542+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'374","last_scrub_stamp":"2024-09-12T17:41:37.559441+0000","last_deep_scrub":"265'374","last_deep_scrub_stamp":"2024-09-12T17:41:37.559441+0000","last_clean_scrub_stamp":"2024-09-12T17:41:37.559441+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:47.380450+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":696596,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":502,"num_read_kb":19430,"num_write":1218,"num_write_kb":23867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:00.759267+0000","last_change":"2024-09-12T17:42:00.759267+0000","last_active":"2024-09-12T17:42:00.759267+0000","last_peered":"2024-09-12T17:42:00.759267+0000","last_clean":"2024-09-12T17:42:00.759267+0000","last_became_active":"2024-09-12T16:58:23.718109+0000","last_became_peered":"2024-09-12T16:58:23.718109+0000","last_unstale":"2024-09-12T17:42:00.759267+0000","last_undegraded":"2024-09-12T17:42:00.759267+0000","last_fullsized":"2024-09-12T17:42:00.759267+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:00.759080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:00.759080+0000","last_clean_scrub_stamp":"2024-09-12T17:42:00.759080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:46.884251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"265'316","reported_seq":915,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:04.617758+0000","last_change":"2024-09-12T17:42:04.617758+0000","last_active":"2024-09-12T17:42:04.617758+0000","last_peered":"2024-09-12T17:42:04.617758+0000","last_clean":"2024-09-12T17:42:04.617758+0000","last_became_active":"2024-09-12T16:58:25.738463+0000","last_became_peered":"2024-09-12T16:58:25.738463+0000","last_unstale":"2024-09-12T17:42:04.617758+0000","last_undegraded":"2024-09-12T17:42:04.617758+0000","last_fullsized":"2024-09-12T17:42:04.617758+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'316","last_scrub_stamp":"2024-09-12T17:42:04.617550+0000","last_deep_scrub":"265'316","last_deep_scrub_stamp":"2024-09-12T17:42:04.617550+0000","last_clean_scrub_stamp":"2024-09-12T17:42:04.617550+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:04.259493+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46394,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":527,"num_read_kb":1194,"num_write":426,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:57.398743+0000","last_change":"2024-09-12T17:41:57.398743+0000","last_active":"2024-09-12T17:41:57.398743+0000","last_peered":"2024-09-12T17:41:57.398743+0000","last_clean":"2024-09-12T17:41:57.398743+0000","last_became_active":"2024-09-12T16:58:27.760265+0000","last_became_peered":"2024-09-12T16:58:27.760265+0000","last_unstale":"2024-09-12T17:41:57.398743+0000","last_undegraded":"2024-09-12T17:41:57.398743+0000","last_fullsized":"2024-09-12T17:41:57.398743+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:57.398482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:57.398482+0000","last_clean_scrub_stamp":"2024-09-12T17:41:57.398482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:40.065598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"265'146","reported_seq":683,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:15.601225+0000","last_change":"2024-09-12T17:42:15.601225+0000","last_active":"2024-09-12T17:42:15.601225+0000","last_peered":"2024-09-12T17:42:15.601225+0000","last_clean":"2024-09-12T17:42:15.601225+0000","last_became_active":"2024-09-12T16:58:29.776448+0000","last_became_peered":"2024-09-12T16:58:29.776448+0000","last_unstale":"2024-09-12T17:42:15.601225+0000","last_undegraded":"2024-09-12T17:42:15.601225+0000","last_fullsized":"2024-09-12T17:42:15.601225+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'146","last_scrub_stamp":"2024-09-12T17:42:15.601028+0000","last_deep_scrub":"265'146","last_deep_scrub_stamp":"2024-09-12T17:42:15.601028+0000","last_clean_scrub_stamp":"2024-09-12T17:42:15.601028+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:24.604237+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":253,"num_read_kb":229,"num_write":261,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"265'252","reported_seq":888,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:47.614719+0000","last_change":"2024-09-12T17:41:47.614719+0000","last_active":"2024-09-12T17:41:47.614719+0000","last_peered":"2024-09-12T17:41:47.614719+0000","last_clean":"2024-09-12T17:41:47.614719+0000","last_became_active":"2024-09-12T16:58:21.705619+0000","last_became_peered":"2024-09-12T16:58:21.705619+0000","last_unstale":"2024-09-12T17:41:47.614719+0000","last_undegraded":"2024-09-12T17:41:47.614719+0000","last_fullsized":"2024-09-12T17:41:47.614719+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'252","last_scrub_stamp":"2024-09-12T17:41:47.614536+0000","last_deep_scrub":"265'252","last_deep_scrub_stamp":"2024-09-12T17:41:47.614536+0000","last_clean_scrub_stamp":"2024-09-12T17:41:47.614536+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:16.229333+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1131,"num_read_kb":917,"num_write":399,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":504,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"265'315","reported_seq":968,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:40.264053+0000","last_change":"2024-09-12T17:41:40.263798+0000","last_active":"2024-09-12T17:41:40.264053+0000","last_peered":"2024-09-12T17:41:40.264053+0000","last_clean":"2024-09-12T17:41:40.264053+0000","last_became_active":"2024-09-12T16:58:18.700720+0000","last_became_peered":"2024-09-12T16:58:18.700720+0000","last_unstale":"2024-09-12T17:41:40.264053+0000","last_undegraded":"2024-09-12T17:41:40.264053+0000","last_fullsized":"2024-09-12T17:41:40.264053+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'315","last_scrub_stamp":"2024-09-12T17:41:40.263594+0000","last_deep_scrub":"265'315","last_deep_scrub_stamp":"2024-09-12T17:41:40.263594+0000","last_clean_scrub_stamp":"2024-09-12T17:41:40.263594+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:36.901664+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399159,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":424,"num_read_kb":68507,"num_write":939,"num_write_kb":27085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:53.480997+0000","last_change":"2024-09-12T17:41:53.480997+0000","last_active":"2024-09-12T17:41:53.480997+0000","last_peered":"2024-09-12T17:41:53.480997+0000","last_clean":"2024-09-12T17:41:53.480997+0000","last_became_active":"2024-09-12T16:58:23.721005+0000","last_became_peered":"2024-09-12T16:58:23.721005+0000","last_unstale":"2024-09-12T17:41:53.480997+0000","last_undegraded":"2024-09-12T17:41:53.480997+0000","last_fullsized":"2024-09-12T17:41:53.480997+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:53.480780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:53.480780+0000","last_clean_scrub_stamp":"2024-09-12T17:41:53.480780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:41.592134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"265'250","reported_seq":825,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:05.772201+0000","last_change":"2024-09-12T17:42:05.772201+0000","last_active":"2024-09-12T17:42:05.772201+0000","last_peered":"2024-09-12T17:42:05.772201+0000","last_clean":"2024-09-12T17:42:05.772201+0000","last_became_active":"2024-09-12T16:58:25.732956+0000","last_became_peered":"2024-09-12T16:58:25.732956+0000","last_unstale":"2024-09-12T17:42:05.772201+0000","last_undegraded":"2024-09-12T17:42:05.772201+0000","last_fullsized":"2024-09-12T17:42:05.772201+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'250","last_scrub_stamp":"2024-09-12T17:42:05.771999+0000","last_deep_scrub":"265'250","last_deep_scrub_stamp":"2024-09-12T17:42:05.771999+0000","last_clean_scrub_stamp":"2024-09-12T17:42:05.771999+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:12.559809+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52555,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":415,"num_read_kb":944,"num_write":334,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:07.926808+0000","last_change":"2024-09-12T17:42:07.926808+0000","last_active":"2024-09-12T17:42:07.926808+0000","last_peered":"2024-09-12T17:42:07.926808+0000","last_clean":"2024-09-12T17:42:07.926808+0000","last_became_active":"2024-09-12T16:58:27.737089+0000","last_became_peered":"2024-09-12T16:58:27.737089+0000","last_unstale":"2024-09-12T17:42:07.926808+0000","last_undegraded":"2024-09-12T17:42:07.926808+0000","last_fullsized":"2024-09-12T17:42:07.926808+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:07.926612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:07.926612+0000","last_clean_scrub_stamp":"2024-09-12T17:42:07.926612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:23.544473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"265'132","reported_seq":787,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:46.446374+0000","last_change":"2024-09-12T17:41:46.446227+0000","last_active":"2024-09-12T17:41:46.446374+0000","last_peered":"2024-09-12T17:41:46.446374+0000","last_clean":"2024-09-12T17:41:46.446374+0000","last_became_active":"2024-09-12T16:58:21.717079+0000","last_became_peered":"2024-09-12T16:58:21.717079+0000","last_unstale":"2024-09-12T17:41:46.446374+0000","last_undegraded":"2024-09-12T17:41:46.446374+0000","last_fullsized":"2024-09-12T17:41:46.446374+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'132","last_scrub_stamp":"2024-09-12T17:41:46.446038+0000","last_deep_scrub":"265'132","last_deep_scrub_stamp":"2024-09-12T17:41:46.446038+0000","last_clean_scrub_stamp":"2024-09-12T17:41:46.446038+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:13.280751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":593,"num_read_kb":510,"num_write":185,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"265'352","reported_seq":997,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:40.787281+0000","last_change":"2024-09-12T17:41:40.787145+0000","last_active":"2024-09-12T17:41:40.787281+0000","last_peered":"2024-09-12T17:41:40.787281+0000","last_clean":"2024-09-12T17:41:40.787281+0000","last_became_active":"2024-09-12T16:58:18.677480+0000","last_became_peered":"2024-09-12T16:58:18.677480+0000","last_unstale":"2024-09-12T17:41:40.787281+0000","last_undegraded":"2024-09-12T17:41:40.787281+0000","last_fullsized":"2024-09-12T17:41:40.787281+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'352","last_scrub_stamp":"2024-09-12T17:41:40.786932+0000","last_deep_scrub":"265'352","last_deep_scrub_stamp":"2024-09-12T17:41:40.786932+0000","last_clean_scrub_stamp":"2024-09-12T17:41:40.786932+0000","objects_scrubbed":8,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:05.959550+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4539352,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":465,"num_read_kb":21305,"num_write":1120,"num_write_kb":20049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:58.000778+0000","last_change":"2024-09-12T17:41:58.000778+0000","last_active":"2024-09-12T17:41:58.000778+0000","last_peered":"2024-09-12T17:41:58.000778+0000","last_clean":"2024-09-12T17:41:58.000778+0000","last_became_active":"2024-09-12T16:58:23.719039+0000","last_became_peered":"2024-09-12T16:58:23.719039+0000","last_unstale":"2024-09-12T17:41:58.000778+0000","last_undegraded":"2024-09-12T17:41:58.000778+0000","last_fullsized":"2024-09-12T17:41:58.000778+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:58.000591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:58.000591+0000","last_clean_scrub_stamp":"2024-09-12T17:41:58.000591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:06.915186+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"265'476","reported_seq":1111,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:59.400710+0000","last_change":"2024-09-12T17:41:59.400710+0000","last_active":"2024-09-12T17:41:59.400710+0000","last_peered":"2024-09-12T17:41:59.400710+0000","last_clean":"2024-09-12T17:41:59.400710+0000","last_became_active":"2024-09-12T16:58:25.720165+0000","last_became_peered":"2024-09-12T16:58:25.720165+0000","last_unstale":"2024-09-12T17:41:59.400710+0000","last_undegraded":"2024-09-12T17:41:59.400710+0000","last_fullsized":"2024-09-12T17:41:59.400710+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'476","last_scrub_stamp":"2024-09-12T17:41:59.400502+0000","last_deep_scrub":"265'476","last_deep_scrub_stamp":"2024-09-12T17:41:59.400502+0000","last_clean_scrub_stamp":"2024-09-12T17:41:59.400502+0000","objects_scrubbed":7,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:59.538891+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97109,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":819,"num_read_kb":1920,"num_write":702,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:09.563408+0000","last_change":"2024-09-12T17:42:09.563408+0000","last_active":"2024-09-12T17:42:09.563408+0000","last_peered":"2024-09-12T17:42:09.563408+0000","last_clean":"2024-09-12T17:42:09.563408+0000","last_became_active":"2024-09-12T16:58:27.749390+0000","last_became_peered":"2024-09-12T16:58:27.749390+0000","last_unstale":"2024-09-12T17:42:09.563408+0000","last_undegraded":"2024-09-12T17:42:09.563408+0000","last_fullsized":"2024-09-12T17:42:09.563408+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:09.563237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:09.563237+0000","last_clean_scrub_stamp":"2024-09-12T17:42:09.563237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:08.669507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"265'186","reported_seq":742,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:15.596814+0000","last_change":"2024-09-12T17:42:15.596814+0000","last_active":"2024-09-12T17:42:15.596814+0000","last_peered":"2024-09-12T17:42:15.596814+0000","last_clean":"2024-09-12T17:42:15.596814+0000","last_became_active":"2024-09-12T16:58:29.788460+0000","last_became_peered":"2024-09-12T16:58:29.788460+0000","last_unstale":"2024-09-12T17:42:15.596814+0000","last_undegraded":"2024-09-12T17:42:15.596814+0000","last_fullsized":"2024-09-12T17:42:15.596814+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'186","last_scrub_stamp":"2024-09-12T17:42:15.596627+0000","last_deep_scrub":"265'186","last_deep_scrub_stamp":"2024-09-12T17:42:15.596627+0000","last_clean_scrub_stamp":"2024-09-12T17:42:15.596627+0000","objects_scrubbed":2,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:32.272451+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":436,"num_read_kb":400,"num_write":425,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"265'128","reported_seq":745,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:51.118367+0000","last_change":"2024-09-12T17:41:51.118367+0000","last_active":"2024-09-12T17:41:51.118367+0000","last_peered":"2024-09-12T17:41:51.118367+0000","last_clean":"2024-09-12T17:41:51.118367+0000","last_became_active":"2024-09-12T16:58:21.724003+0000","last_became_peered":"2024-09-12T16:58:21.724003+0000","last_unstale":"2024-09-12T17:41:51.118367+0000","last_undegraded":"2024-09-12T17:41:51.118367+0000","last_fullsized":"2024-09-12T17:41:51.118367+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'128","last_scrub_stamp":"2024-09-12T17:41:51.118180+0000","last_deep_scrub":"265'128","last_deep_scrub_stamp":"2024-09-12T17:41:51.118180+0000","last_clean_scrub_stamp":"2024-09-12T17:41:51.118180+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:50.382693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":616,"num_read_kb":520,"num_write":198,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"265'382","reported_seq":1081,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:40.494181+0000","last_change":"2024-09-12T17:41:40.494019+0000","last_active":"2024-09-12T17:41:40.494181+0000","last_peered":"2024-09-12T17:41:40.494181+0000","last_clean":"2024-09-12T17:41:40.494181+0000","last_became_active":"2024-09-12T16:58:18.706806+0000","last_became_peered":"2024-09-12T16:58:18.706806+0000","last_unstale":"2024-09-12T17:41:40.494181+0000","last_undegraded":"2024-09-12T17:41:40.494181+0000","last_fullsized":"2024-09-12T17:41:40.494181+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'382","last_scrub_stamp":"2024-09-12T17:41:40.493763+0000","last_deep_scrub":"265'382","last_deep_scrub_stamp":"2024-09-12T17:41:40.493763+0000","last_clean_scrub_stamp":"2024-09-12T17:41:40.493763+0000","objects_scrubbed":11,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:01.630616+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2005288,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":606,"num_read_kb":18575,"num_write":1246,"num_write_kb":49050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:54.441311+0000","last_change":"2024-09-12T17:41:54.441149+0000","last_active":"2024-09-12T17:41:54.441311+0000","last_peered":"2024-09-12T17:41:54.441311+0000","last_clean":"2024-09-12T17:41:54.441311+0000","last_became_active":"2024-09-12T16:58:23.720654+0000","last_became_peered":"2024-09-12T16:58:23.720654+0000","last_unstale":"2024-09-12T17:41:54.441311+0000","last_undegraded":"2024-09-12T17:41:54.441311+0000","last_fullsized":"2024-09-12T17:41:54.441311+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:54.440953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:54.440953+0000","last_clean_scrub_stamp":"2024-09-12T17:41:54.440953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:46.885058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"265'324","reported_seq":913,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:06.753628+0000","last_change":"2024-09-12T17:42:06.753628+0000","last_active":"2024-09-12T17:42:06.753628+0000","last_peered":"2024-09-12T17:42:06.753628+0000","last_clean":"2024-09-12T17:42:06.753628+0000","last_became_active":"2024-09-12T16:58:25.733241+0000","last_became_peered":"2024-09-12T16:58:25.733241+0000","last_unstale":"2024-09-12T17:42:06.753628+0000","last_undegraded":"2024-09-12T17:42:06.753628+0000","last_fullsized":"2024-09-12T17:42:06.753628+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'324","last_scrub_stamp":"2024-09-12T17:42:06.753421+0000","last_deep_scrub":"265'324","last_deep_scrub_stamp":"2024-09-12T17:42:06.753421+0000","last_clean_scrub_stamp":"2024-09-12T17:42:06.753421+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:02.524828+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53167,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":518,"num_read_kb":1145,"num_write":434,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:00.362276+0000","last_change":"2024-09-12T17:42:00.362276+0000","last_active":"2024-09-12T17:42:00.362276+0000","last_peered":"2024-09-12T17:42:00.362276+0000","last_clean":"2024-09-12T17:42:00.362276+0000","last_became_active":"2024-09-12T16:58:27.750328+0000","last_became_peered":"2024-09-12T16:58:27.750328+0000","last_unstale":"2024-09-12T17:42:00.362276+0000","last_undegraded":"2024-09-12T17:42:00.362276+0000","last_fullsized":"2024-09-12T17:42:00.362276+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:00.362082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:00.362082+0000","last_clean_scrub_stamp":"2024-09-12T17:42:00.362082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:37.237455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"265'186","reported_seq":693,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:03.340339+0000","last_change":"2024-09-12T17:42:03.340339+0000","last_active":"2024-09-12T17:42:03.340339+0000","last_peered":"2024-09-12T17:42:03.340339+0000","last_clean":"2024-09-12T17:42:03.340339+0000","last_became_active":"2024-09-12T16:58:29.777124+0000","last_became_peered":"2024-09-12T16:58:29.777124+0000","last_unstale":"2024-09-12T17:42:03.340339+0000","last_undegraded":"2024-09-12T17:42:03.340339+0000","last_fullsized":"2024-09-12T17:42:03.340339+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'186","last_scrub_stamp":"2024-09-12T17:42:03.340132+0000","last_deep_scrub":"265'186","last_deep_scrub_stamp":"2024-09-12T17:42:03.340132+0000","last_clean_scrub_stamp":"2024-09-12T17:42:03.340132+0000","objects_scrubbed":5,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:26.686575+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1215,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":228,"num_read_kb":227,"num_write":517,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"265'163","reported_seq":775,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:54.539232+0000","last_change":"2024-09-12T17:41:54.539232+0000","last_active":"2024-09-12T17:41:54.539232+0000","last_peered":"2024-09-12T17:41:54.539232+0000","last_clean":"2024-09-12T17:41:54.539232+0000","last_became_active":"2024-09-12T16:58:21.698565+0000","last_became_peered":"2024-09-12T16:58:21.698565+0000","last_unstale":"2024-09-12T17:41:54.539232+0000","last_undegraded":"2024-09-12T17:41:54.539232+0000","last_fullsized":"2024-09-12T17:41:54.539232+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'163","last_scrub_stamp":"2024-09-12T17:41:54.539052+0000","last_deep_scrub":"265'163","last_deep_scrub_stamp":"2024-09-12T17:41:54.539052+0000","last_clean_scrub_stamp":"2024-09-12T17:41:54.539052+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:56.134179+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":649,"num_read_kb":535,"num_write":267,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":466,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"265'341","reported_seq":998,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:41.643297+0000","last_change":"2024-09-12T17:41:41.643297+0000","last_active":"2024-09-12T17:41:41.643297+0000","last_peered":"2024-09-12T17:41:41.643297+0000","last_clean":"2024-09-12T17:41:41.643297+0000","last_became_active":"2024-09-12T16:58:18.700196+0000","last_became_peered":"2024-09-12T16:58:18.700196+0000","last_unstale":"2024-09-12T17:41:41.643297+0000","last_undegraded":"2024-09-12T17:41:41.643297+0000","last_fullsized":"2024-09-12T17:41:41.643297+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'341","last_scrub_stamp":"2024-09-12T17:41:41.643102+0000","last_deep_scrub":"265'341","last_deep_scrub_stamp":"2024-09-12T17:41:41.643102+0000","last_clean_scrub_stamp":"2024-09-12T17:41:41.643102+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:23.678015+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":519,"num_read_kb":4020,"num_write":1087,"num_write_kb":21150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:02.569081+0000","last_change":"2024-09-12T17:42:02.569081+0000","last_active":"2024-09-12T17:42:02.569081+0000","last_peered":"2024-09-12T17:42:02.569081+0000","last_clean":"2024-09-12T17:42:02.569081+0000","last_became_active":"2024-09-12T16:58:23.702293+0000","last_became_peered":"2024-09-12T16:58:23.702293+0000","last_unstale":"2024-09-12T17:42:02.569081+0000","last_undegraded":"2024-09-12T17:42:02.569081+0000","last_fullsized":"2024-09-12T17:42:02.569081+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:02.568901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:02.568901+0000","last_clean_scrub_stamp":"2024-09-12T17:42:02.568901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:48.291273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"265'330","reported_seq":916,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:07.569228+0000","last_change":"2024-09-12T17:42:07.569073+0000","last_active":"2024-09-12T17:42:07.569228+0000","last_peered":"2024-09-12T17:42:07.569228+0000","last_clean":"2024-09-12T17:42:07.569228+0000","last_became_active":"2024-09-12T16:58:25.949883+0000","last_became_peered":"2024-09-12T16:58:25.949883+0000","last_unstale":"2024-09-12T17:42:07.569228+0000","last_undegraded":"2024-09-12T17:42:07.569228+0000","last_fullsized":"2024-09-12T17:42:07.569228+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'330","last_scrub_stamp":"2024-09-12T17:42:07.568888+0000","last_deep_scrub":"265'330","last_deep_scrub_stamp":"2024-09-12T17:42:07.568888+0000","last_clean_scrub_stamp":"2024-09-12T17:42:07.568888+0000","objects_scrubbed":5,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:41.012993+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47961,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":516,"num_read_kb":1185,"num_write":434,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:02.402428+0000","last_change":"2024-09-12T17:42:02.402428+0000","last_active":"2024-09-12T17:42:02.402428+0000","last_peered":"2024-09-12T17:42:02.402428+0000","last_clean":"2024-09-12T17:42:02.402428+0000","last_became_active":"2024-09-12T16:58:27.739965+0000","last_became_peered":"2024-09-12T16:58:27.739965+0000","last_unstale":"2024-09-12T17:42:02.402428+0000","last_undegraded":"2024-09-12T17:42:02.402428+0000","last_fullsized":"2024-09-12T17:42:02.402428+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:02.402249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:02.402249+0000","last_clean_scrub_stamp":"2024-09-12T17:42:02.402249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:15.452036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"265'142","reported_seq":641,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:13.591281+0000","last_change":"2024-09-12T17:42:13.591281+0000","last_active":"2024-09-12T17:42:13.591281+0000","last_peered":"2024-09-12T17:42:13.591281+0000","last_clean":"2024-09-12T17:42:13.591281+0000","last_became_active":"2024-09-12T16:58:29.771267+0000","last_became_peered":"2024-09-12T16:58:29.771267+0000","last_unstale":"2024-09-12T17:42:13.591281+0000","last_undegraded":"2024-09-12T17:42:13.591281+0000","last_fullsized":"2024-09-12T17:42:13.591281+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'142","last_scrub_stamp":"2024-09-12T17:42:13.591041+0000","last_deep_scrub":"265'142","last_deep_scrub_stamp":"2024-09-12T17:42:13.591041+0000","last_clean_scrub_stamp":"2024-09-12T17:42:13.591041+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:35.315375+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":401,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":154,"num_write":321,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"265'82","reported_seq":694,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:43.505594+0000","last_change":"2024-09-12T17:41:43.505594+0000","last_active":"2024-09-12T17:41:43.505594+0000","last_peered":"2024-09-12T17:41:43.505594+0000","last_clean":"2024-09-12T17:41:43.505594+0000","last_became_active":"2024-09-12T16:58:21.730342+0000","last_became_peered":"2024-09-12T16:58:21.730342+0000","last_unstale":"2024-09-12T17:41:43.505594+0000","last_undegraded":"2024-09-12T17:41:43.505594+0000","last_fullsized":"2024-09-12T17:41:43.505594+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'82","last_scrub_stamp":"2024-09-12T17:41:43.505360+0000","last_deep_scrub":"265'82","last_deep_scrub_stamp":"2024-09-12T17:41:43.505360+0000","last_clean_scrub_stamp":"2024-09-12T17:41:43.505360+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:13.444514+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":417,"num_read_kb":364,"num_write":119,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"265'313","reported_seq":1009,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:39.237770+0000","last_change":"2024-09-12T17:41:39.237770+0000","last_active":"2024-09-12T17:41:39.237770+0000","last_peered":"2024-09-12T17:41:39.237770+0000","last_clean":"2024-09-12T17:41:39.237770+0000","last_became_active":"2024-09-12T16:58:18.688773+0000","last_became_peered":"2024-09-12T16:58:18.688773+0000","last_unstale":"2024-09-12T17:41:39.237770+0000","last_undegraded":"2024-09-12T17:41:39.237770+0000","last_fullsized":"2024-09-12T17:41:39.237770+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'313","last_scrub_stamp":"2024-09-12T17:41:39.237589+0000","last_deep_scrub":"265'313","last_deep_scrub_stamp":"2024-09-12T17:41:39.237589+0000","last_clean_scrub_stamp":"2024-09-12T17:41:39.237589+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:34.837693+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":566,"num_read_kb":43210,"num_write":1036,"num_write_kb":32802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:57.401448+0000","last_change":"2024-09-12T17:41:57.401448+0000","last_active":"2024-09-12T17:41:57.401448+0000","last_peered":"2024-09-12T17:41:57.401448+0000","last_clean":"2024-09-12T17:41:57.401448+0000","last_became_active":"2024-09-12T16:58:23.709009+0000","last_became_peered":"2024-09-12T16:58:23.709009+0000","last_unstale":"2024-09-12T17:41:57.401448+0000","last_undegraded":"2024-09-12T17:41:57.401448+0000","last_fullsized":"2024-09-12T17:41:57.401448+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:57.401263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:57.401263+0000","last_clean_scrub_stamp":"2024-09-12T17:41:57.401263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:55.509659+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"265'95","reported_seq":623,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:06.608408+0000","last_change":"2024-09-12T17:42:06.608408+0000","last_active":"2024-09-12T17:42:06.608408+0000","last_peered":"2024-09-12T17:42:06.608408+0000","last_clean":"2024-09-12T17:42:06.608408+0000","last_became_active":"2024-09-12T16:58:25.949196+0000","last_became_peered":"2024-09-12T16:58:25.949196+0000","last_unstale":"2024-09-12T17:42:06.608408+0000","last_undegraded":"2024-09-12T17:42:06.608408+0000","last_fullsized":"2024-09-12T17:42:06.608408+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'95","last_scrub_stamp":"2024-09-12T17:42:06.608197+0000","last_deep_scrub":"265'95","last_deep_scrub_stamp":"2024-09-12T17:42:06.608197+0000","last_clean_scrub_stamp":"2024-09-12T17:42:06.608197+0000","objects_scrubbed":7,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:30.948657+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":122,"num_read_kb":116,"num_write":142,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":19154,"num_omap_keys":50,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"265'758","reported_seq":2163,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:00.322103+0000","last_change":"2024-09-12T17:42:00.321961+0000","last_active":"2024-09-12T17:42:00.322103+0000","last_peered":"2024-09-12T17:42:00.322103+0000","last_clean":"2024-09-12T17:42:00.322103+0000","last_became_active":"2024-09-12T16:58:27.740416+0000","last_became_peered":"2024-09-12T16:58:27.740416+0000","last_unstale":"2024-09-12T17:42:00.322103+0000","last_undegraded":"2024-09-12T17:42:00.322103+0000","last_fullsized":"2024-09-12T17:42:00.322103+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'758","last_scrub_stamp":"2024-09-12T17:42:00.321759+0000","last_deep_scrub":"265'758","last_deep_scrub_stamp":"2024-09-12T17:42:00.321759+0000","last_clean_scrub_stamp":"2024-09-12T17:42:00.321759+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":700,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:00.274187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"265'129","reported_seq":658,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:11.668336+0000","last_change":"2024-09-12T17:42:11.668336+0000","last_active":"2024-09-12T17:42:11.668336+0000","last_peered":"2024-09-12T17:42:11.668336+0000","last_clean":"2024-09-12T17:42:11.668336+0000","last_became_active":"2024-09-12T16:58:29.784128+0000","last_became_peered":"2024-09-12T16:58:29.784128+0000","last_unstale":"2024-09-12T17:42:11.668336+0000","last_undegraded":"2024-09-12T17:42:11.668336+0000","last_fullsized":"2024-09-12T17:42:11.668336+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'129","last_scrub_stamp":"2024-09-12T17:42:11.668116+0000","last_deep_scrub":"265'129","last_deep_scrub_stamp":"2024-09-12T17:42:11.668116+0000","last_clean_scrub_stamp":"2024-09-12T17:42:11.668116+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:54.421856+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":291,"num_read_kb":261,"num_write":354,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"265'160","reported_seq":763,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:51.677261+0000","last_change":"2024-09-12T17:41:51.677261+0000","last_active":"2024-09-12T17:41:51.677261+0000","last_peered":"2024-09-12T17:41:51.677261+0000","last_clean":"2024-09-12T17:41:51.677261+0000","last_became_active":"2024-09-12T16:58:21.700714+0000","last_became_peered":"2024-09-12T16:58:21.700714+0000","last_unstale":"2024-09-12T17:41:51.677261+0000","last_undegraded":"2024-09-12T17:41:51.677261+0000","last_fullsized":"2024-09-12T17:41:51.677261+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'160","last_scrub_stamp":"2024-09-12T17:41:51.677068+0000","last_deep_scrub":"265'160","last_deep_scrub_stamp":"2024-09-12T17:41:51.677068+0000","last_clean_scrub_stamp":"2024-09-12T17:41:51.677068+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:24.457151+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":716,"num_read_kb":600,"num_write":247,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":685,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"265'324","reported_seq":1084,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:47.592290+0000","last_change":"2024-09-12T17:41:47.592290+0000","last_active":"2024-09-12T17:41:47.592290+0000","last_peered":"2024-09-12T17:41:47.592290+0000","last_clean":"2024-09-12T17:41:47.592290+0000","last_became_active":"2024-09-12T16:58:18.706117+0000","last_became_peered":"2024-09-12T16:58:18.706117+0000","last_unstale":"2024-09-12T17:41:47.592290+0000","last_undegraded":"2024-09-12T17:41:47.592290+0000","last_fullsized":"2024-09-12T17:41:47.592290+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'324","last_scrub_stamp":"2024-09-12T17:41:47.592082+0000","last_deep_scrub":"265'324","last_deep_scrub_stamp":"2024-09-12T17:41:47.592082+0000","last_clean_scrub_stamp":"2024-09-12T17:41:47.592082+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:54.054534+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263228,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":571,"num_read_kb":60034,"num_write":895,"num_write_kb":44854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:59.716085+0000","last_change":"2024-09-12T17:41:59.716085+0000","last_active":"2024-09-12T17:41:59.716085+0000","last_peered":"2024-09-12T17:41:59.716085+0000","last_clean":"2024-09-12T17:41:59.716085+0000","last_became_active":"2024-09-12T16:58:23.718211+0000","last_became_peered":"2024-09-12T16:58:23.718211+0000","last_unstale":"2024-09-12T17:41:59.716085+0000","last_undegraded":"2024-09-12T17:41:59.716085+0000","last_fullsized":"2024-09-12T17:41:59.716085+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:59.715910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:59.715910+0000","last_clean_scrub_stamp":"2024-09-12T17:41:59.715910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:23.485766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"265'310","reported_seq":900,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:07.600324+0000","last_change":"2024-09-12T17:42:07.600324+0000","last_active":"2024-09-12T17:42:07.600324+0000","last_peered":"2024-09-12T17:42:07.600324+0000","last_clean":"2024-09-12T17:42:07.600324+0000","last_became_active":"2024-09-12T16:58:25.724774+0000","last_became_peered":"2024-09-12T16:58:25.724774+0000","last_unstale":"2024-09-12T17:42:07.600324+0000","last_undegraded":"2024-09-12T17:42:07.600324+0000","last_fullsized":"2024-09-12T17:42:07.600324+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'310","last_scrub_stamp":"2024-09-12T17:42:07.600103+0000","last_deep_scrub":"265'310","last_deep_scrub_stamp":"2024-09-12T17:42:07.600103+0000","last_clean_scrub_stamp":"2024-09-12T17:42:07.600103+0000","objects_scrubbed":7,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:53.693190+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47652,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":491,"num_read_kb":1079,"num_write":394,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:08.965010+0000","last_change":"2024-09-12T17:42:08.965010+0000","last_active":"2024-09-12T17:42:08.965010+0000","last_peered":"2024-09-12T17:42:08.965010+0000","last_clean":"2024-09-12T17:42:08.965010+0000","last_became_active":"2024-09-12T16:58:27.755232+0000","last_became_peered":"2024-09-12T16:58:27.755232+0000","last_unstale":"2024-09-12T17:42:08.965010+0000","last_undegraded":"2024-09-12T17:42:08.965010+0000","last_fullsized":"2024-09-12T17:42:08.965010+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:08.964807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:08.964807+0000","last_clean_scrub_stamp":"2024-09-12T17:42:08.964807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:08.229206+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"265'137","reported_seq":658,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:13.742270+0000","last_change":"2024-09-12T17:42:13.742270+0000","last_active":"2024-09-12T17:42:13.742270+0000","last_peered":"2024-09-12T17:42:13.742270+0000","last_clean":"2024-09-12T17:42:13.742270+0000","last_became_active":"2024-09-12T16:58:29.782006+0000","last_became_peered":"2024-09-12T16:58:29.782006+0000","last_unstale":"2024-09-12T17:42:13.742270+0000","last_undegraded":"2024-09-12T17:42:13.742270+0000","last_fullsized":"2024-09-12T17:42:13.742270+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'137","last_scrub_stamp":"2024-09-12T17:42:13.742048+0000","last_deep_scrub":"265'137","last_deep_scrub_stamp":"2024-09-12T17:42:13.742048+0000","last_clean_scrub_stamp":"2024-09-12T17:42:13.742048+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.736080+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":784,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":248,"num_read_kb":225,"num_write":333,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"265'367","reported_seq":982,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:49.619878+0000","last_change":"2024-09-12T17:41:49.619878+0000","last_active":"2024-09-12T17:41:49.619878+0000","last_peered":"2024-09-12T17:41:49.619878+0000","last_clean":"2024-09-12T17:41:49.619878+0000","last_became_active":"2024-09-12T16:58:21.700909+0000","last_became_peered":"2024-09-12T16:58:21.700909+0000","last_unstale":"2024-09-12T17:41:49.619878+0000","last_undegraded":"2024-09-12T17:41:49.619878+0000","last_fullsized":"2024-09-12T17:41:49.619878+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'367","last_scrub_stamp":"2024-09-12T17:41:49.619757+0000","last_deep_scrub":"265'367","last_deep_scrub_stamp":"2024-09-12T17:41:49.619757+0000","last_clean_scrub_stamp":"2024-09-12T17:41:49.619757+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:59.864277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1540,"num_read_kb":1221,"num_write":577,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8073,"num_omap_keys":32,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"265'345","reported_seq":985,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:43.695319+0000","last_change":"2024-09-12T17:41:43.695319+0000","last_active":"2024-09-12T17:41:43.695319+0000","last_peered":"2024-09-12T17:41:43.695319+0000","last_clean":"2024-09-12T17:41:43.695319+0000","last_became_active":"2024-09-12T16:58:18.706197+0000","last_became_peered":"2024-09-12T16:58:18.706197+0000","last_unstale":"2024-09-12T17:41:43.695319+0000","last_undegraded":"2024-09-12T17:41:43.695319+0000","last_fullsized":"2024-09-12T17:41:43.695319+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'345","last_scrub_stamp":"2024-09-12T17:41:43.695067+0000","last_deep_scrub":"265'345","last_deep_scrub_stamp":"2024-09-12T17:41:43.695067+0000","last_clean_scrub_stamp":"2024-09-12T17:41:43.695067+0000","objects_scrubbed":10,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:07.116451+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10548403,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":531,"num_read_kb":18954,"num_write":1116,"num_write_kb":43009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:03.606588+0000","last_change":"2024-09-12T17:42:03.606588+0000","last_active":"2024-09-12T17:42:03.606588+0000","last_peered":"2024-09-12T17:42:03.606588+0000","last_clean":"2024-09-12T17:42:03.606588+0000","last_became_active":"2024-09-12T16:58:23.711307+0000","last_became_peered":"2024-09-12T16:58:23.711307+0000","last_unstale":"2024-09-12T17:42:03.606588+0000","last_undegraded":"2024-09-12T17:42:03.606588+0000","last_fullsized":"2024-09-12T17:42:03.606588+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:03.606372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:03.606372+0000","last_clean_scrub_stamp":"2024-09-12T17:42:03.606372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:19.011654+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"265'272","reported_seq":845,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:01.905547+0000","last_change":"2024-09-12T17:42:01.905547+0000","last_active":"2024-09-12T17:42:01.905547+0000","last_peered":"2024-09-12T17:42:01.905547+0000","last_clean":"2024-09-12T17:42:01.905547+0000","last_became_active":"2024-09-12T16:58:25.736507+0000","last_became_peered":"2024-09-12T16:58:25.736507+0000","last_unstale":"2024-09-12T17:42:01.905547+0000","last_undegraded":"2024-09-12T17:42:01.905547+0000","last_fullsized":"2024-09-12T17:42:01.905547+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'272","last_scrub_stamp":"2024-09-12T17:42:01.905321+0000","last_deep_scrub":"265'272","last_deep_scrub_stamp":"2024-09-12T17:42:01.905321+0000","last_clean_scrub_stamp":"2024-09-12T17:42:01.905321+0000","objects_scrubbed":5,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:36.227575+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47073,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":450,"num_read_kb":1040,"num_write":370,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:59.337211+0000","last_change":"2024-09-12T17:41:59.337032+0000","last_active":"2024-09-12T17:41:59.337211+0000","last_peered":"2024-09-12T17:41:59.337211+0000","last_clean":"2024-09-12T17:41:59.337211+0000","last_became_active":"2024-09-12T16:58:27.740278+0000","last_became_peered":"2024-09-12T16:58:27.740278+0000","last_unstale":"2024-09-12T17:41:59.337211+0000","last_undegraded":"2024-09-12T17:41:59.337211+0000","last_fullsized":"2024-09-12T17:41:59.337211+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:59.336840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:59.336840+0000","last_clean_scrub_stamp":"2024-09-12T17:41:59.336840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:16.116080+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"265'126","reported_seq":666,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:16.566991+0000","last_change":"2024-09-12T17:42:16.566991+0000","last_active":"2024-09-12T17:42:16.566991+0000","last_peered":"2024-09-12T17:42:16.566991+0000","last_clean":"2024-09-12T17:42:16.566991+0000","last_became_active":"2024-09-12T16:58:29.783969+0000","last_became_peered":"2024-09-12T16:58:29.783969+0000","last_unstale":"2024-09-12T17:42:16.566991+0000","last_undegraded":"2024-09-12T17:42:16.566991+0000","last_fullsized":"2024-09-12T17:42:16.566991+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'126","last_scrub_stamp":"2024-09-12T17:42:16.566785+0000","last_deep_scrub":"265'126","last_deep_scrub_stamp":"2024-09-12T17:42:16.566785+0000","last_clean_scrub_stamp":"2024-09-12T17:42:16.566785+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:27:14.270170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":564,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":235,"num_read_kb":216,"num_write":292,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"265'256","reported_seq":886,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:53.554782+0000","last_change":"2024-09-12T17:41:53.554631+0000","last_active":"2024-09-12T17:41:53.554782+0000","last_peered":"2024-09-12T17:41:53.554782+0000","last_clean":"2024-09-12T17:41:53.554782+0000","last_became_active":"2024-09-12T16:58:21.715884+0000","last_became_peered":"2024-09-12T16:58:21.715884+0000","last_unstale":"2024-09-12T17:41:53.554782+0000","last_undegraded":"2024-09-12T17:41:53.554782+0000","last_fullsized":"2024-09-12T17:41:53.554782+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'256","last_scrub_stamp":"2024-09-12T17:41:53.554435+0000","last_deep_scrub":"265'256","last_deep_scrub_stamp":"2024-09-12T17:41:53.554435+0000","last_clean_scrub_stamp":"2024-09-12T17:41:53.554435+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:12.224842+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1137,"num_read_kb":949,"num_write":435,"num_write_kb":255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"265'303","reported_seq":911,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:42.742666+0000","last_change":"2024-09-12T17:41:42.742666+0000","last_active":"2024-09-12T17:41:42.742666+0000","last_peered":"2024-09-12T17:41:42.742666+0000","last_clean":"2024-09-12T17:41:42.742666+0000","last_became_active":"2024-09-12T16:58:18.704103+0000","last_became_peered":"2024-09-12T16:58:18.704103+0000","last_unstale":"2024-09-12T17:41:42.742666+0000","last_undegraded":"2024-09-12T17:41:42.742666+0000","last_fullsized":"2024-09-12T17:41:42.742666+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'303","last_scrub_stamp":"2024-09-12T17:41:42.742464+0000","last_deep_scrub":"265'303","last_deep_scrub_stamp":"2024-09-12T17:41:42.742464+0000","last_clean_scrub_stamp":"2024-09-12T17:41:42.742464+0000","objects_scrubbed":6,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:08.956555+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":353,"num_read_kb":15361,"num_write":880,"num_write_kb":40766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:01.615440+0000","last_change":"2024-09-12T17:42:01.615440+0000","last_active":"2024-09-12T17:42:01.615440+0000","last_peered":"2024-09-12T17:42:01.615440+0000","last_clean":"2024-09-12T17:42:01.615440+0000","last_became_active":"2024-09-12T16:58:23.713731+0000","last_became_peered":"2024-09-12T16:58:23.713731+0000","last_unstale":"2024-09-12T17:42:01.615440+0000","last_undegraded":"2024-09-12T17:42:01.615440+0000","last_fullsized":"2024-09-12T17:42:01.615440+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:01.615260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:01.615260+0000","last_clean_scrub_stamp":"2024-09-12T17:42:01.615260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:44:08.902882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"265'226","reported_seq":792,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:05.587217+0000","last_change":"2024-09-12T17:42:05.587217+0000","last_active":"2024-09-12T17:42:05.587217+0000","last_peered":"2024-09-12T17:42:05.587217+0000","last_clean":"2024-09-12T17:42:05.587217+0000","last_became_active":"2024-09-12T16:58:25.727897+0000","last_became_peered":"2024-09-12T16:58:25.727897+0000","last_unstale":"2024-09-12T17:42:05.587217+0000","last_undegraded":"2024-09-12T17:42:05.587217+0000","last_fullsized":"2024-09-12T17:42:05.587217+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'226","last_scrub_stamp":"2024-09-12T17:42:05.587046+0000","last_deep_scrub":"265'226","last_deep_scrub_stamp":"2024-09-12T17:42:05.587046+0000","last_clean_scrub_stamp":"2024-09-12T17:42:05.587046+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:17.999381+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18508,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":370,"num_read_kb":886,"num_write":300,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:10.576646+0000","last_change":"2024-09-12T17:42:10.576646+0000","last_active":"2024-09-12T17:42:10.576646+0000","last_peered":"2024-09-12T17:42:10.576646+0000","last_clean":"2024-09-12T17:42:10.576646+0000","last_became_active":"2024-09-12T16:58:27.735625+0000","last_became_peered":"2024-09-12T16:58:27.735625+0000","last_unstale":"2024-09-12T17:42:10.576646+0000","last_undegraded":"2024-09-12T17:42:10.576646+0000","last_fullsized":"2024-09-12T17:42:10.576646+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:10.576449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:10.576449+0000","last_clean_scrub_stamp":"2024-09-12T17:42:10.576449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:15.024969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"265'175","reported_seq":1650,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:12.711756+0000","last_change":"2024-09-12T17:42:12.711756+0000","last_active":"2024-09-12T17:42:12.711756+0000","last_peered":"2024-09-12T17:42:12.711756+0000","last_clean":"2024-09-12T17:42:12.711756+0000","last_became_active":"2024-09-12T16:58:29.796358+0000","last_became_peered":"2024-09-12T16:58:29.796358+0000","last_unstale":"2024-09-12T17:42:12.711756+0000","last_undegraded":"2024-09-12T17:42:12.711756+0000","last_fullsized":"2024-09-12T17:42:12.711756+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'175","last_scrub_stamp":"2024-09-12T17:42:12.711577+0000","last_deep_scrub":"265'175","last_deep_scrub_stamp":"2024-09-12T17:42:12.711577+0000","last_clean_scrub_stamp":"2024-09-12T17:42:12.711577+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:27.055803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1235,"num_read_kb":1225,"num_write":375,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"265'197","reported_seq":834,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:50.652697+0000","last_change":"2024-09-12T17:41:50.652541+0000","last_active":"2024-09-12T17:41:50.652697+0000","last_peered":"2024-09-12T17:41:50.652697+0000","last_clean":"2024-09-12T17:41:50.652697+0000","last_became_active":"2024-09-12T16:58:21.730029+0000","last_became_peered":"2024-09-12T16:58:21.730029+0000","last_unstale":"2024-09-12T17:41:50.652697+0000","last_undegraded":"2024-09-12T17:41:50.652697+0000","last_fullsized":"2024-09-12T17:41:50.652697+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'197","last_scrub_stamp":"2024-09-12T17:41:50.652360+0000","last_deep_scrub":"265'197","last_deep_scrub_stamp":"2024-09-12T17:41:50.652360+0000","last_clean_scrub_stamp":"2024-09-12T17:41:50.652360+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:58.816478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":873,"num_read_kb":717,"num_write":316,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"265'367","reported_seq":1018,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:42.297063+0000","last_change":"2024-09-12T17:41:42.296900+0000","last_active":"2024-09-12T17:41:42.297063+0000","last_peered":"2024-09-12T17:41:42.297063+0000","last_clean":"2024-09-12T17:41:42.297063+0000","last_became_active":"2024-09-12T16:58:18.712291+0000","last_became_peered":"2024-09-12T16:58:18.712291+0000","last_unstale":"2024-09-12T17:41:42.297063+0000","last_undegraded":"2024-09-12T17:41:42.297063+0000","last_fullsized":"2024-09-12T17:41:42.297063+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'367","last_scrub_stamp":"2024-09-12T17:41:42.296686+0000","last_deep_scrub":"265'367","last_deep_scrub_stamp":"2024-09-12T17:41:42.296686+0000","last_clean_scrub_stamp":"2024-09-12T17:41:42.296686+0000","objects_scrubbed":8,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:53.919784+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159793,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":439,"num_read_kb":103450,"num_write":1036,"num_write_kb":48235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"265'2","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:54.380961+0000","last_change":"2024-09-12T17:41:54.380823+0000","last_active":"2024-09-12T17:41:54.380961+0000","last_peered":"2024-09-12T17:41:54.380961+0000","last_clean":"2024-09-12T17:41:54.380961+0000","last_became_active":"2024-09-12T16:58:23.724981+0000","last_became_peered":"2024-09-12T16:58:23.724981+0000","last_unstale":"2024-09-12T17:41:54.380961+0000","last_undegraded":"2024-09-12T17:41:54.380961+0000","last_fullsized":"2024-09-12T17:41:54.380961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T17:41:54.380634+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T17:41:54.380634+0000","last_clean_scrub_stamp":"2024-09-12T17:41:54.380634+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:35.697170+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"265'303","reported_seq":894,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:08.610756+0000","last_change":"2024-09-12T17:42:08.610756+0000","last_active":"2024-09-12T17:42:08.610756+0000","last_peered":"2024-09-12T17:42:08.610756+0000","last_clean":"2024-09-12T17:42:08.610756+0000","last_became_active":"2024-09-12T16:58:25.718962+0000","last_became_peered":"2024-09-12T16:58:25.718962+0000","last_unstale":"2024-09-12T17:42:08.610756+0000","last_undegraded":"2024-09-12T17:42:08.610756+0000","last_fullsized":"2024-09-12T17:42:08.610756+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'303","last_scrub_stamp":"2024-09-12T17:42:08.610554+0000","last_deep_scrub":"265'303","last_deep_scrub_stamp":"2024-09-12T17:42:08.610554+0000","last_clean_scrub_stamp":"2024-09-12T17:42:08.610554+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:41.314469+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46580,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":480,"num_read_kb":1058,"num_write":384,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:09.968403+0000","last_change":"2024-09-12T17:42:09.968403+0000","last_active":"2024-09-12T17:42:09.968403+0000","last_peered":"2024-09-12T17:42:09.968403+0000","last_clean":"2024-09-12T17:42:09.968403+0000","last_became_active":"2024-09-12T16:58:27.748503+0000","last_became_peered":"2024-09-12T16:58:27.748503+0000","last_unstale":"2024-09-12T17:42:09.968403+0000","last_undegraded":"2024-09-12T17:42:09.968403+0000","last_fullsized":"2024-09-12T17:42:09.968403+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:09.968216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:09.968216+0000","last_clean_scrub_stamp":"2024-09-12T17:42:09.968216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:48.003237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"265'155","reported_seq":658,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:11.605436+0000","last_change":"2024-09-12T17:42:11.605436+0000","last_active":"2024-09-12T17:42:11.605436+0000","last_peered":"2024-09-12T17:42:11.605436+0000","last_clean":"2024-09-12T17:42:11.605436+0000","last_became_active":"2024-09-12T16:58:29.780363+0000","last_became_peered":"2024-09-12T16:58:29.780363+0000","last_unstale":"2024-09-12T17:42:11.605436+0000","last_undegraded":"2024-09-12T17:42:11.605436+0000","last_fullsized":"2024-09-12T17:42:11.605436+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'155","last_scrub_stamp":"2024-09-12T17:42:11.605251+0000","last_deep_scrub":"265'155","last_deep_scrub_stamp":"2024-09-12T17:42:11.605251+0000","last_clean_scrub_stamp":"2024-09-12T17:42:11.605251+0000","objects_scrubbed":5,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:13.762046+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":838,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":195,"num_read_kb":185,"num_write":368,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"265'45","reported_seq":608,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:52.410256+0000","last_change":"2024-09-12T17:41:52.410256+0000","last_active":"2024-09-12T17:41:52.410256+0000","last_peered":"2024-09-12T17:41:52.410256+0000","last_clean":"2024-09-12T17:41:52.410256+0000","last_became_active":"2024-09-12T16:58:21.728147+0000","last_became_peered":"2024-09-12T16:58:21.728147+0000","last_unstale":"2024-09-12T17:41:52.410256+0000","last_undegraded":"2024-09-12T17:41:52.410256+0000","last_fullsized":"2024-09-12T17:41:52.410256+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'45","last_scrub_stamp":"2024-09-12T17:41:52.410037+0000","last_deep_scrub":"265'45","last_deep_scrub_stamp":"2024-09-12T17:41:52.410037+0000","last_clean_scrub_stamp":"2024-09-12T17:41:52.410037+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:59.883537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":172,"num_write":56,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"265'364","reported_seq":1018,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:42.455139+0000","last_change":"2024-09-12T17:41:42.454962+0000","last_active":"2024-09-12T17:41:42.455139+0000","last_peered":"2024-09-12T17:41:42.455139+0000","last_clean":"2024-09-12T17:41:42.455139+0000","last_became_active":"2024-09-12T16:58:18.692788+0000","last_became_peered":"2024-09-12T16:58:18.692788+0000","last_unstale":"2024-09-12T17:41:42.455139+0000","last_undegraded":"2024-09-12T17:41:42.455139+0000","last_fullsized":"2024-09-12T17:41:42.455139+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'364","last_scrub_stamp":"2024-09-12T17:41:42.454759+0000","last_deep_scrub":"265'364","last_deep_scrub_stamp":"2024-09-12T17:41:42.454759+0000","last_clean_scrub_stamp":"2024-09-12T17:41:42.454759+0000","objects_scrubbed":6,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:43.884878+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":568,"num_read_kb":2235,"num_write":1205,"num_write_kb":12634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"265'160","reported_seq":782,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:48.329394+0000","last_change":"2024-09-12T17:41:48.329394+0000","last_active":"2024-09-12T17:41:48.329394+0000","last_peered":"2024-09-12T17:41:48.329394+0000","last_clean":"2024-09-12T17:41:48.329394+0000","last_became_active":"2024-09-12T16:58:21.726882+0000","last_became_peered":"2024-09-12T16:58:21.726882+0000","last_unstale":"2024-09-12T17:41:48.329394+0000","last_undegraded":"2024-09-12T17:41:48.329394+0000","last_fullsized":"2024-09-12T17:41:48.329394+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'160","last_scrub_stamp":"2024-09-12T17:41:48.329218+0000","last_deep_scrub":"265'160","last_deep_scrub_stamp":"2024-09-12T17:41:48.329218+0000","last_clean_scrub_stamp":"2024-09-12T17:41:48.329218+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:27.518612+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":734,"num_read_kb":607,"num_write":248,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":721,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"265'496","reported_seq":1232,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:53.589942+0000","last_change":"2024-09-12T17:41:53.589804+0000","last_active":"2024-09-12T17:41:53.589942+0000","last_peered":"2024-09-12T17:41:53.589942+0000","last_clean":"2024-09-12T17:41:53.589942+0000","last_became_active":"2024-09-12T16:58:18.693764+0000","last_became_peered":"2024-09-12T16:58:18.693764+0000","last_unstale":"2024-09-12T17:41:53.589942+0000","last_undegraded":"2024-09-12T17:41:53.589942+0000","last_fullsized":"2024-09-12T17:41:53.589942+0000","mapping_epoch":23,"log_start":"265'400","ondisk_log_start":"265'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'496","last_scrub_stamp":"2024-09-12T17:41:53.589553+0000","last_deep_scrub":"265'496","last_deep_scrub_stamp":"2024-09-12T17:41:53.589553+0000","last_clean_scrub_stamp":"2024-09-12T17:41:53.589553+0000","objects_scrubbed":10,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:17.934087+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1848453,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":919,"num_read_kb":32179,"num_write":1426,"num_write_kb":32850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"265'188","reported_seq":831,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:54.669791+0000","last_change":"2024-09-12T17:41:54.669791+0000","last_active":"2024-09-12T17:41:54.669791+0000","last_peered":"2024-09-12T17:41:54.669791+0000","last_clean":"2024-09-12T17:41:54.669791+0000","last_became_active":"2024-09-12T16:58:21.716793+0000","last_became_peered":"2024-09-12T16:58:21.716793+0000","last_unstale":"2024-09-12T17:41:54.669791+0000","last_undegraded":"2024-09-12T17:41:54.669791+0000","last_fullsized":"2024-09-12T17:41:54.669791+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'188","last_scrub_stamp":"2024-09-12T17:41:54.669596+0000","last_deep_scrub":"265'188","last_deep_scrub_stamp":"2024-09-12T17:41:54.669596+0000","last_clean_scrub_stamp":"2024-09-12T17:41:54.669596+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:38.714045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":842,"num_read_kb":696,"num_write":281,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"265'387","reported_seq":1016,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:44.632558+0000","last_change":"2024-09-12T17:41:44.632383+0000","last_active":"2024-09-12T17:41:44.632558+0000","last_peered":"2024-09-12T17:41:44.632558+0000","last_clean":"2024-09-12T17:41:44.632558+0000","last_became_active":"2024-09-12T16:58:18.711667+0000","last_became_peered":"2024-09-12T16:58:18.711667+0000","last_unstale":"2024-09-12T17:41:44.632558+0000","last_undegraded":"2024-09-12T17:41:44.632558+0000","last_fullsized":"2024-09-12T17:41:44.632558+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'387","last_scrub_stamp":"2024-09-12T17:41:44.632176+0000","last_deep_scrub":"265'387","last_deep_scrub_stamp":"2024-09-12T17:41:44.632176+0000","last_clean_scrub_stamp":"2024-09-12T17:41:44.632176+0000","objects_scrubbed":8,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:18.192979+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079973,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":470,"num_read_kb":3460,"num_write":1200,"num_write_kb":27732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"265'217","reported_seq":863,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:50.375635+0000","last_change":"2024-09-12T17:41:50.375635+0000","last_active":"2024-09-12T17:41:50.375635+0000","last_peered":"2024-09-12T17:41:50.375635+0000","last_clean":"2024-09-12T17:41:50.375635+0000","last_became_active":"2024-09-12T16:58:21.713518+0000","last_became_peered":"2024-09-12T16:58:21.713518+0000","last_unstale":"2024-09-12T17:41:50.375635+0000","last_undegraded":"2024-09-12T17:41:50.375635+0000","last_fullsized":"2024-09-12T17:41:50.375635+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'217","last_scrub_stamp":"2024-09-12T17:41:50.375457+0000","last_deep_scrub":"265'217","last_deep_scrub_stamp":"2024-09-12T17:41:50.375457+0000","last_clean_scrub_stamp":"2024-09-12T17:41:50.375457+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:56.530237+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":958,"num_read_kb":791,"num_write":328,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"265'342","reported_seq":1092,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:43.287506+0000","last_change":"2024-09-12T17:41:43.287240+0000","last_active":"2024-09-12T17:41:43.287506+0000","last_peered":"2024-09-12T17:41:43.287506+0000","last_clean":"2024-09-12T17:41:43.287506+0000","last_became_active":"2024-09-12T16:58:18.711021+0000","last_became_peered":"2024-09-12T16:58:18.711021+0000","last_unstale":"2024-09-12T17:41:43.287506+0000","last_undegraded":"2024-09-12T17:41:43.287506+0000","last_fullsized":"2024-09-12T17:41:43.287506+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'342","last_scrub_stamp":"2024-09-12T17:41:43.286936+0000","last_deep_scrub":"265'342","last_deep_scrub_stamp":"2024-09-12T17:41:43.286936+0000","last_clean_scrub_stamp":"2024-09-12T17:41:43.286936+0000","objects_scrubbed":7,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:58.141097+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399320,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":801,"num_read_kb":13816,"num_write":1128,"num_write_kb":16955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"265'187","reported_seq":817,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:38.578936+0000","last_change":"2024-09-12T17:41:38.578936+0000","last_active":"2024-09-12T17:41:38.578936+0000","last_peered":"2024-09-12T17:41:38.578936+0000","last_clean":"2024-09-12T17:41:38.578936+0000","last_became_active":"2024-09-12T16:58:55.849635+0000","last_became_peered":"2024-09-12T16:58:55.849635+0000","last_unstale":"2024-09-12T17:41:38.578936+0000","last_undegraded":"2024-09-12T17:41:38.578936+0000","last_fullsized":"2024-09-12T17:41:38.578936+0000","mapping_epoch":37,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'187","last_scrub_stamp":"2024-09-12T17:41:38.578864+0000","last_deep_scrub":"265'187","last_deep_scrub_stamp":"2024-09-12T17:41:38.578864+0000","last_clean_scrub_stamp":"2024-09-12T17:41:38.578864+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:15.935562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":876,"num_read_kb":735,"num_write":297,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"265'358","reported_seq":1203,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:45.678992+0000","last_change":"2024-09-12T17:41:45.678992+0000","last_active":"2024-09-12T17:41:45.678992+0000","last_peered":"2024-09-12T17:41:45.678992+0000","last_clean":"2024-09-12T17:41:45.678992+0000","last_became_active":"2024-09-12T16:58:18.677892+0000","last_became_peered":"2024-09-12T16:58:18.677892+0000","last_unstale":"2024-09-12T17:41:45.678992+0000","last_undegraded":"2024-09-12T17:41:45.678992+0000","last_fullsized":"2024-09-12T17:41:45.678992+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'358","last_scrub_stamp":"2024-09-12T17:41:45.678772+0000","last_deep_scrub":"265'358","last_deep_scrub_stamp":"2024-09-12T17:41:45.678772+0000","last_clean_scrub_stamp":"2024-09-12T17:41:45.678772+0000","objects_scrubbed":5,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:53.062308+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3586908,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":894,"num_read_kb":13074,"num_write":1175,"num_write_kb":22747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"265'421","reported_seq":1151,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:52.679988+0000","last_change":"2024-09-12T17:41:52.679684+0000","last_active":"2024-09-12T17:41:52.679988+0000","last_peered":"2024-09-12T17:41:52.679988+0000","last_clean":"2024-09-12T17:41:52.679988+0000","last_became_active":"2024-09-12T16:58:21.729867+0000","last_became_peered":"2024-09-12T16:58:21.729867+0000","last_unstale":"2024-09-12T17:41:52.679988+0000","last_undegraded":"2024-09-12T17:41:52.679988+0000","last_fullsized":"2024-09-12T17:41:52.679988+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'421","last_scrub_stamp":"2024-09-12T17:41:52.679449+0000","last_deep_scrub":"265'421","last_deep_scrub_stamp":"2024-09-12T17:41:52.679449+0000","last_clean_scrub_stamp":"2024-09-12T17:41:52.679449+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:02.342262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1962,"num_read_kb":1662,"num_write":651,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25753,"num_omap_keys":101,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"265'370","reported_seq":1060,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:41.467435+0000","last_change":"2024-09-12T17:41:41.467284+0000","last_active":"2024-09-12T17:41:41.467435+0000","last_peered":"2024-09-12T17:41:41.467435+0000","last_clean":"2024-09-12T17:41:41.467435+0000","last_became_active":"2024-09-12T16:58:18.707110+0000","last_became_peered":"2024-09-12T16:58:18.707110+0000","last_unstale":"2024-09-12T17:41:41.467435+0000","last_undegraded":"2024-09-12T17:41:41.467435+0000","last_fullsized":"2024-09-12T17:41:41.467435+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'370","last_scrub_stamp":"2024-09-12T17:41:41.467058+0000","last_deep_scrub":"265'370","last_deep_scrub_stamp":"2024-09-12T17:41:41.467058+0000","last_clean_scrub_stamp":"2024-09-12T17:41:41.467058+0000","objects_scrubbed":8,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:00.889176+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079974,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":702,"num_read_kb":1852,"num_write":1120,"num_write_kb":24861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"265'4296","reported_seq":5008,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:58.441073+0000","last_change":"2024-09-12T17:41:58.440762+0000","last_active":"2024-09-12T17:41:58.441073+0000","last_peered":"2024-09-12T17:41:58.441073+0000","last_clean":"2024-09-12T17:41:58.441073+0000","last_became_active":"2024-09-12T16:58:55.957007+0000","last_became_peered":"2024-09-12T16:58:55.957007+0000","last_unstale":"2024-09-12T17:41:58.441073+0000","last_undegraded":"2024-09-12T17:41:58.441073+0000","last_fullsized":"2024-09-12T17:41:58.441073+0000","mapping_epoch":37,"log_start":"265'4200","ondisk_log_start":"265'4200","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4296","last_scrub_stamp":"2024-09-12T17:41:58.440458+0000","last_deep_scrub":"265'4296","last_deep_scrub_stamp":"2024-09-12T17:41:58.440458+0000","last_clean_scrub_stamp":"2024-09-12T17:41:58.440458+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":3000,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:53.198353+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17379,"num_read_kb":14566,"num_write":6493,"num_write_kb":3276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"265'330","reported_seq":1043,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:43.481239+0000","last_change":"2024-09-12T17:41:43.481239+0000","last_active":"2024-09-12T17:41:43.481239+0000","last_peered":"2024-09-12T17:41:43.481239+0000","last_clean":"2024-09-12T17:41:43.481239+0000","last_became_active":"2024-09-12T16:58:18.715010+0000","last_became_peered":"2024-09-12T16:58:18.715010+0000","last_unstale":"2024-09-12T17:41:43.481239+0000","last_undegraded":"2024-09-12T17:41:43.481239+0000","last_fullsized":"2024-09-12T17:41:43.481239+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'330","last_scrub_stamp":"2024-09-12T17:41:43.480992+0000","last_deep_scrub":"265'330","last_deep_scrub_stamp":"2024-09-12T17:41:43.480992+0000","last_clean_scrub_stamp":"2024-09-12T17:41:43.480992+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:26.534765+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":628,"num_read_kb":2506,"num_write":964,"num_write_kb":15075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"265'104","reported_seq":694,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:47.466090+0000","last_change":"2024-09-12T17:41:47.465918+0000","last_active":"2024-09-12T17:41:47.466090+0000","last_peered":"2024-09-12T17:41:47.466090+0000","last_clean":"2024-09-12T17:41:47.466090+0000","last_became_active":"2024-09-12T16:58:21.720908+0000","last_became_peered":"2024-09-12T16:58:21.720908+0000","last_unstale":"2024-09-12T17:41:47.466090+0000","last_undegraded":"2024-09-12T17:41:47.466090+0000","last_fullsized":"2024-09-12T17:41:47.466090+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'104","last_scrub_stamp":"2024-09-12T17:41:47.465734+0000","last_deep_scrub":"265'104","last_deep_scrub_stamp":"2024-09-12T17:41:47.465734+0000","last_clean_scrub_stamp":"2024-09-12T17:41:47.465734+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:02.185124+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":432,"num_read_kb":360,"num_write":161,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"265'394","reported_seq":1124,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:43.705321+0000","last_change":"2024-09-12T17:41:43.705321+0000","last_active":"2024-09-12T17:41:43.705321+0000","last_peered":"2024-09-12T17:41:43.705321+0000","last_clean":"2024-09-12T17:41:43.705321+0000","last_became_active":"2024-09-12T16:58:18.680305+0000","last_became_peered":"2024-09-12T16:58:18.680305+0000","last_unstale":"2024-09-12T17:41:43.705321+0000","last_undegraded":"2024-09-12T17:41:43.705321+0000","last_fullsized":"2024-09-12T17:41:43.705321+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'394","last_scrub_stamp":"2024-09-12T17:41:43.705097+0000","last_deep_scrub":"265'394","last_deep_scrub_stamp":"2024-09-12T17:41:43.705097+0000","last_clean_scrub_stamp":"2024-09-12T17:41:43.705097+0000","objects_scrubbed":7,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:48.384452+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263201,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":688,"num_read_kb":33513,"num_write":1376,"num_write_kb":33353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"265'175","reported_seq":800,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:53.039664+0000","last_change":"2024-09-12T17:41:53.039664+0000","last_active":"2024-09-12T17:41:53.039664+0000","last_peered":"2024-09-12T17:41:53.039664+0000","last_clean":"2024-09-12T17:41:53.039664+0000","last_became_active":"2024-09-12T16:58:21.713765+0000","last_became_peered":"2024-09-12T16:58:21.713765+0000","last_unstale":"2024-09-12T17:41:53.039664+0000","last_undegraded":"2024-09-12T17:41:53.039664+0000","last_fullsized":"2024-09-12T17:41:53.039664+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'175","last_scrub_stamp":"2024-09-12T17:41:53.039428+0000","last_deep_scrub":"265'175","last_deep_scrub_stamp":"2024-09-12T17:41:53.039428+0000","last_clean_scrub_stamp":"2024-09-12T17:41:53.039428+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:20.616593+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":769,"num_read_kb":637,"num_write":246,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"265'374","reported_seq":1032,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:46.639986+0000","last_change":"2024-09-12T17:41:46.639869+0000","last_active":"2024-09-12T17:41:46.639986+0000","last_peered":"2024-09-12T17:41:46.639986+0000","last_clean":"2024-09-12T17:41:46.639986+0000","last_became_active":"2024-09-12T16:58:18.713629+0000","last_became_peered":"2024-09-12T16:58:18.713629+0000","last_unstale":"2024-09-12T17:41:46.639986+0000","last_undegraded":"2024-09-12T17:41:46.639986+0000","last_fullsized":"2024-09-12T17:41:46.639986+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'374","last_scrub_stamp":"2024-09-12T17:41:46.639653+0000","last_deep_scrub":"265'374","last_deep_scrub_stamp":"2024-09-12T17:41:46.639653+0000","last_clean_scrub_stamp":"2024-09-12T17:41:46.639653+0000","objects_scrubbed":9,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:07.696868+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1369511,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":530,"num_read_kb":40377,"num_write":1157,"num_write_kb":39449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"265'158","reported_seq":736,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:54.669213+0000","last_change":"2024-09-12T17:41:54.669213+0000","last_active":"2024-09-12T17:41:54.669213+0000","last_peered":"2024-09-12T17:41:54.669213+0000","last_clean":"2024-09-12T17:41:54.669213+0000","last_became_active":"2024-09-12T16:58:21.718980+0000","last_became_peered":"2024-09-12T16:58:21.718980+0000","last_unstale":"2024-09-12T17:41:54.669213+0000","last_undegraded":"2024-09-12T17:41:54.669213+0000","last_fullsized":"2024-09-12T17:41:54.669213+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'158","last_scrub_stamp":"2024-09-12T17:41:54.668917+0000","last_deep_scrub":"265'158","last_deep_scrub_stamp":"2024-09-12T17:41:54.668917+0000","last_clean_scrub_stamp":"2024-09-12T17:41:54.668917+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:44.886998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":669,"num_read_kb":540,"num_write":242,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"265'388","reported_seq":1080,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:51.554602+0000","last_change":"2024-09-12T17:41:51.554602+0000","last_active":"2024-09-12T17:41:51.554602+0000","last_peered":"2024-09-12T17:41:51.554602+0000","last_clean":"2024-09-12T17:41:51.554602+0000","last_became_active":"2024-09-12T16:58:18.678270+0000","last_became_peered":"2024-09-12T16:58:18.678270+0000","last_unstale":"2024-09-12T17:41:51.554602+0000","last_undegraded":"2024-09-12T17:41:51.554602+0000","last_fullsized":"2024-09-12T17:41:51.554602+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'388","last_scrub_stamp":"2024-09-12T17:41:51.554411+0000","last_deep_scrub":"265'388","last_deep_scrub_stamp":"2024-09-12T17:41:51.554411+0000","last_clean_scrub_stamp":"2024-09-12T17:41:51.554411+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:05.022058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":570,"num_read_kb":53855,"num_write":1232,"num_write_kb":47481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"265'252","reported_seq":879,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:42.524940+0000","last_change":"2024-09-12T17:41:42.524940+0000","last_active":"2024-09-12T17:41:42.524940+0000","last_peered":"2024-09-12T17:41:42.524940+0000","last_clean":"2024-09-12T17:41:42.524940+0000","last_became_active":"2024-09-12T16:58:21.729301+0000","last_became_peered":"2024-09-12T16:58:21.729301+0000","last_unstale":"2024-09-12T17:41:42.524940+0000","last_undegraded":"2024-09-12T17:41:42.524940+0000","last_fullsized":"2024-09-12T17:41:42.524940+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'252","last_scrub_stamp":"2024-09-12T17:41:42.524765+0000","last_deep_scrub":"265'252","last_deep_scrub_stamp":"2024-09-12T17:41:42.524765+0000","last_clean_scrub_stamp":"2024-09-12T17:41:42.524765+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:58.178842+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1107,"num_read_kb":902,"num_write":427,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"265'448","reported_seq":1129,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:45.590167+0000","last_change":"2024-09-12T17:41:45.590167+0000","last_active":"2024-09-12T17:41:45.590167+0000","last_peered":"2024-09-12T17:41:45.590167+0000","last_clean":"2024-09-12T17:41:45.590167+0000","last_became_active":"2024-09-12T16:58:18.719658+0000","last_became_peered":"2024-09-12T16:58:18.719658+0000","last_unstale":"2024-09-12T17:41:45.590167+0000","last_undegraded":"2024-09-12T17:41:45.590167+0000","last_fullsized":"2024-09-12T17:41:45.590167+0000","mapping_epoch":23,"log_start":"265'400","ondisk_log_start":"265'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'448","last_scrub_stamp":"2024-09-12T17:41:45.589925+0000","last_deep_scrub":"265'448","last_deep_scrub_stamp":"2024-09-12T17:41:45.589925+0000","last_clean_scrub_stamp":"2024-09-12T17:41:45.589925+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:39.534937+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170320,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":708,"num_read_kb":15766,"num_write":1393,"num_write_kb":33267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"265'203","reported_seq":847,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:53.694005+0000","last_change":"2024-09-12T17:41:53.694005+0000","last_active":"2024-09-12T17:41:53.694005+0000","last_peered":"2024-09-12T17:41:53.694005+0000","last_clean":"2024-09-12T17:41:53.694005+0000","last_became_active":"2024-09-12T16:58:21.730589+0000","last_became_peered":"2024-09-12T16:58:21.730589+0000","last_unstale":"2024-09-12T17:41:53.694005+0000","last_undegraded":"2024-09-12T17:41:53.694005+0000","last_fullsized":"2024-09-12T17:41:53.694005+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'203","last_scrub_stamp":"2024-09-12T17:41:53.693830+0000","last_deep_scrub":"265'203","last_deep_scrub_stamp":"2024-09-12T17:41:53.693830+0000","last_clean_scrub_stamp":"2024-09-12T17:41:53.693830+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:02.739000+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":887,"num_read_kb":736,"num_write":325,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"265'366","reported_seq":1041,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:45.233630+0000","last_change":"2024-09-12T17:41:45.233630+0000","last_active":"2024-09-12T17:41:45.233630+0000","last_peered":"2024-09-12T17:41:45.233630+0000","last_clean":"2024-09-12T17:41:45.233630+0000","last_became_active":"2024-09-12T16:58:18.691716+0000","last_became_peered":"2024-09-12T16:58:18.691716+0000","last_unstale":"2024-09-12T17:41:45.233630+0000","last_undegraded":"2024-09-12T17:41:45.233630+0000","last_fullsized":"2024-09-12T17:41:45.233630+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'366","last_scrub_stamp":"2024-09-12T17:41:45.233427+0000","last_deep_scrub":"265'366","last_deep_scrub_stamp":"2024-09-12T17:41:45.233427+0000","last_clean_scrub_stamp":"2024-09-12T17:41:45.233427+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:39.091059+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":528,"num_read_kb":37415,"num_write":1121,"num_write_kb":27973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"265'333","reported_seq":946,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:54.648323+0000","last_change":"2024-09-12T17:41:54.648323+0000","last_active":"2024-09-12T17:41:54.648323+0000","last_peered":"2024-09-12T17:41:54.648323+0000","last_clean":"2024-09-12T17:41:54.648323+0000","last_became_active":"2024-09-12T16:58:21.722380+0000","last_became_peered":"2024-09-12T16:58:21.722380+0000","last_unstale":"2024-09-12T17:41:54.648323+0000","last_undegraded":"2024-09-12T17:41:54.648323+0000","last_fullsized":"2024-09-12T17:41:54.648323+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'333","last_scrub_stamp":"2024-09-12T17:41:54.648087+0000","last_deep_scrub":"265'333","last_deep_scrub_stamp":"2024-09-12T17:41:54.648087+0000","last_clean_scrub_stamp":"2024-09-12T17:41:54.648087+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:12.851283+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1422,"num_read_kb":1143,"num_write":550,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"265'349","reported_seq":1023,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:48.502516+0000","last_change":"2024-09-12T17:41:48.502516+0000","last_active":"2024-09-12T17:41:48.502516+0000","last_peered":"2024-09-12T17:41:48.502516+0000","last_clean":"2024-09-12T17:41:48.502516+0000","last_became_active":"2024-09-12T16:58:18.709090+0000","last_became_peered":"2024-09-12T16:58:18.709090+0000","last_unstale":"2024-09-12T17:41:48.502516+0000","last_undegraded":"2024-09-12T17:41:48.502516+0000","last_fullsized":"2024-09-12T17:41:48.502516+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'349","last_scrub_stamp":"2024-09-12T17:41:48.502301+0000","last_deep_scrub":"265'349","last_deep_scrub_stamp":"2024-09-12T17:41:48.502301+0000","last_clean_scrub_stamp":"2024-09-12T17:41:48.502301+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:56.806960+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289348,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":537,"num_read_kb":42087,"num_write":1134,"num_write_kb":38244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"265'160","reported_seq":776,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:52.084538+0000","last_change":"2024-09-12T17:41:52.084538+0000","last_active":"2024-09-12T17:41:52.084538+0000","last_peered":"2024-09-12T17:41:52.084538+0000","last_clean":"2024-09-12T17:41:52.084538+0000","last_became_active":"2024-09-12T16:58:21.725262+0000","last_became_peered":"2024-09-12T16:58:21.725262+0000","last_unstale":"2024-09-12T17:41:52.084538+0000","last_undegraded":"2024-09-12T17:41:52.084538+0000","last_fullsized":"2024-09-12T17:41:52.084538+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'160","last_scrub_stamp":"2024-09-12T17:41:52.084334+0000","last_deep_scrub":"265'160","last_deep_scrub_stamp":"2024-09-12T17:41:52.084334+0000","last_clean_scrub_stamp":"2024-09-12T17:41:52.084334+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:02:11.578223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":648,"num_read_kb":538,"num_write":222,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"265'356","reported_seq":1033,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:52.569090+0000","last_change":"2024-09-12T17:41:52.569090+0000","last_active":"2024-09-12T17:41:52.569090+0000","last_peered":"2024-09-12T17:41:52.569090+0000","last_clean":"2024-09-12T17:41:52.569090+0000","last_became_active":"2024-09-12T16:58:18.713131+0000","last_became_peered":"2024-09-12T16:58:18.713131+0000","last_unstale":"2024-09-12T17:41:52.569090+0000","last_undegraded":"2024-09-12T17:41:52.569090+0000","last_fullsized":"2024-09-12T17:41:52.569090+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'356","last_scrub_stamp":"2024-09-12T17:41:52.568904+0000","last_deep_scrub":"265'356","last_deep_scrub_stamp":"2024-09-12T17:41:52.568904+0000","last_clean_scrub_stamp":"2024-09-12T17:41:52.568904+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:36.659748+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254228,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":564,"num_read_kb":4620,"num_write":1119,"num_write_kb":30053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"265'101","reported_seq":704,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:57.446406+0000","last_change":"2024-09-12T17:41:57.446406+0000","last_active":"2024-09-12T17:41:57.446406+0000","last_peered":"2024-09-12T17:41:57.446406+0000","last_clean":"2024-09-12T17:41:57.446406+0000","last_became_active":"2024-09-12T16:58:21.693930+0000","last_became_peered":"2024-09-12T16:58:21.693930+0000","last_unstale":"2024-09-12T17:41:57.446406+0000","last_undegraded":"2024-09-12T17:41:57.446406+0000","last_fullsized":"2024-09-12T17:41:57.446406+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'101","last_scrub_stamp":"2024-09-12T17:41:57.446228+0000","last_deep_scrub":"265'101","last_deep_scrub_stamp":"2024-09-12T17:41:57.446228+0000","last_clean_scrub_stamp":"2024-09-12T17:41:57.446228+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:12.831695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":454,"num_read_kb":382,"num_write":143,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"265'358","reported_seq":1006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:41.572498+0000","last_change":"2024-09-12T17:41:41.572498+0000","last_active":"2024-09-12T17:41:41.572498+0000","last_peered":"2024-09-12T17:41:41.572498+0000","last_clean":"2024-09-12T17:41:41.572498+0000","last_became_active":"2024-09-12T16:58:18.704118+0000","last_became_peered":"2024-09-12T16:58:18.704118+0000","last_unstale":"2024-09-12T17:41:41.572498+0000","last_undegraded":"2024-09-12T17:41:41.572498+0000","last_fullsized":"2024-09-12T17:41:41.572498+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'358","last_scrub_stamp":"2024-09-12T17:41:41.572292+0000","last_deep_scrub":"265'358","last_deep_scrub_stamp":"2024-09-12T17:41:41.572292+0000","last_clean_scrub_stamp":"2024-09-12T17:41:41.572292+0000","objects_scrubbed":8,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:25.803929+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079958,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":546,"num_read_kb":7376,"num_write":1271,"num_write_kb":14643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"265'376","reported_seq":975,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:51.551645+0000","last_change":"2024-09-12T17:41:51.551645+0000","last_active":"2024-09-12T17:41:51.551645+0000","last_peered":"2024-09-12T17:41:51.551645+0000","last_clean":"2024-09-12T17:41:51.551645+0000","last_became_active":"2024-09-12T16:58:21.714554+0000","last_became_peered":"2024-09-12T16:58:21.714554+0000","last_unstale":"2024-09-12T17:41:51.551645+0000","last_undegraded":"2024-09-12T17:41:51.551645+0000","last_fullsized":"2024-09-12T17:41:51.551645+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'376","last_scrub_stamp":"2024-09-12T17:41:51.551368+0000","last_deep_scrub":"265'376","last_deep_scrub_stamp":"2024-09-12T17:41:51.551368+0000","last_clean_scrub_stamp":"2024-09-12T17:41:51.551368+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:23.069379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1689,"num_read_kb":1453,"num_write":661,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"265'390","reported_seq":1106,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:48.614895+0000","last_change":"2024-09-12T17:41:48.614895+0000","last_active":"2024-09-12T17:41:48.614895+0000","last_peered":"2024-09-12T17:41:48.614895+0000","last_clean":"2024-09-12T17:41:48.614895+0000","last_became_active":"2024-09-12T16:58:18.719691+0000","last_became_peered":"2024-09-12T16:58:18.719691+0000","last_unstale":"2024-09-12T17:41:48.614895+0000","last_undegraded":"2024-09-12T17:41:48.614895+0000","last_fullsized":"2024-09-12T17:41:48.614895+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'390","last_scrub_stamp":"2024-09-12T17:41:48.614702+0000","last_deep_scrub":"265'390","last_deep_scrub_stamp":"2024-09-12T17:41:48.614702+0000","last_clean_scrub_stamp":"2024-09-12T17:41:48.614702+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:01.712719+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":758,"num_read_kb":7681,"num_write":1308,"num_write_kb":23567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"265'356","reported_seq":1016,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:50.628413+0000","last_change":"2024-09-12T17:41:50.628413+0000","last_active":"2024-09-12T17:41:50.628413+0000","last_peered":"2024-09-12T17:41:50.628413+0000","last_clean":"2024-09-12T17:41:50.628413+0000","last_became_active":"2024-09-12T16:58:18.698393+0000","last_became_peered":"2024-09-12T16:58:18.698393+0000","last_unstale":"2024-09-12T17:41:50.628413+0000","last_undegraded":"2024-09-12T17:41:50.628413+0000","last_fullsized":"2024-09-12T17:41:50.628413+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'356","last_scrub_stamp":"2024-09-12T17:41:50.628167+0000","last_deep_scrub":"265'356","last_deep_scrub_stamp":"2024-09-12T17:41:50.628167+0000","last_clean_scrub_stamp":"2024-09-12T17:41:50.628167+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:03.341903+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":536,"num_read_kb":34677,"num_write":1126,"num_write_kb":53307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"265'106","reported_seq":694,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:56.027628+0000","last_change":"2024-09-12T17:41:56.027469+0000","last_active":"2024-09-12T17:41:56.027628+0000","last_peered":"2024-09-12T17:41:56.027628+0000","last_clean":"2024-09-12T17:41:56.027628+0000","last_became_active":"2024-09-12T16:58:21.714240+0000","last_became_peered":"2024-09-12T16:58:21.714240+0000","last_unstale":"2024-09-12T17:41:56.027628+0000","last_undegraded":"2024-09-12T17:41:56.027628+0000","last_fullsized":"2024-09-12T17:41:56.027628+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'106","last_scrub_stamp":"2024-09-12T17:41:56.027242+0000","last_deep_scrub":"265'106","last_deep_scrub_stamp":"2024-09-12T17:41:56.027242+0000","last_clean_scrub_stamp":"2024-09-12T17:41:56.027242+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:14.917329+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":476,"num_read_kb":394,"num_write":172,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"265'366","reported_seq":1053,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:43.412364+0000","last_change":"2024-09-12T17:41:43.412364+0000","last_active":"2024-09-12T17:41:43.412364+0000","last_peered":"2024-09-12T17:41:43.412364+0000","last_clean":"2024-09-12T17:41:43.412364+0000","last_became_active":"2024-09-12T16:58:18.707649+0000","last_became_peered":"2024-09-12T16:58:18.707649+0000","last_unstale":"2024-09-12T17:41:43.412364+0000","last_undegraded":"2024-09-12T17:41:43.412364+0000","last_fullsized":"2024-09-12T17:41:43.412364+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'366","last_scrub_stamp":"2024-09-12T17:41:43.412171+0000","last_deep_scrub":"265'366","last_deep_scrub_stamp":"2024-09-12T17:41:43.412171+0000","last_clean_scrub_stamp":"2024-09-12T17:41:43.412171+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:07.821353+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":580,"num_read_kb":14659,"num_write":1122,"num_write_kb":33951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"265'4160","reported_seq":4803,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:56.630467+0000","last_change":"2024-09-12T17:41:56.630467+0000","last_active":"2024-09-12T17:41:56.630467+0000","last_peered":"2024-09-12T17:41:56.630467+0000","last_clean":"2024-09-12T17:41:56.630467+0000","last_became_active":"2024-09-12T16:58:21.718537+0000","last_became_peered":"2024-09-12T16:58:21.718537+0000","last_unstale":"2024-09-12T17:41:56.630467+0000","last_undegraded":"2024-09-12T17:41:56.630467+0000","last_fullsized":"2024-09-12T17:41:56.630467+0000","mapping_epoch":26,"log_start":"265'4100","ondisk_log_start":"265'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4160","last_scrub_stamp":"2024-09-12T17:41:56.630278+0000","last_deep_scrub":"265'4160","last_deep_scrub_stamp":"2024-09-12T17:41:56.630278+0000","last_clean_scrub_stamp":"2024-09-12T17:41:56.630278+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":3000,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:59.447977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16773,"num_read_kb":14078,"num_write":6250,"num_write_kb":3119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6189,"num_read_kb":4469,"num_write":2002,"num_write_kb":899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4473,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":975,"ondisk_log_size":975,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15645,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":16183,"num_read_kb":15867,"num_write":16715,"num_write_kb":4878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2756,"num_omap_keys":18,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1638,"ondisk_log_size":1638,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":514,"ondisk_log_size":514,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1598421,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":17353,"num_read_kb":36703,"num_write":14501,"num_write_kb":11559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":682084,"num_omap_keys":1558,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2007,"ondisk_log_size":2007,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2412,"num_read_kb":2875,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":102570,"num_read_kb":85739,"num_write":37214,"num_write_kb":18735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":44323,"num_omap_keys":179,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4271,"ondisk_log_size":4271,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":376,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":74886563,"num_objects":371,"num_object_clones":0,"num_object_copies":742,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":371,"num_whiteouts":0,"num_read":36323,"num_read_kb":1886569,"num_write":72643,"num_write_kb":2069560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":151003136,"data_stored":149773126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3656,"ondisk_log_size":3656,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":211125,"num_write":190,"num_write_kb":136313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1087,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":198791,"num_write":190,"num_write_kb":136313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509976,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":170196,"kb_used_data":36356,"kb_used_omap":1,"kb_used_meta":133822,"kb_avail":94201644,"statfs":{"total":96636764160,"available":96462483456,"internally_reserved":0,"allocated":37228544,"data_stored":35444692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":137034181},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509975,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":279304,"kb_used_data":27384,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94092536,"statfs":{"total":96636764160,"available":96350756864,"internally_reserved":0,"allocated":28041216,"data_stored":26261645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":257948103},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509980,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110480,"kb_used_data":11328,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94261360,"statfs":{"total":96636764160,"available":96523632640,"internally_reserved":0,"allocated":11599872,"data_stored":9988574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509975,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284328,"kb_used_data":32472,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":94087512,"statfs":{"total":96636764160,"available":96345612288,"internally_reserved":0,"allocated":33251328,"data_stored":31541637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":257882565},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542680,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":254076,"kb_used_data":16044,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94117764,"statfs":{"total":96636764160,"available":96376590336,"internally_reserved":0,"allocated":16429056,"data_stored":14715336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":243726795},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542681,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":229016,"kb_used_data":17352,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":94142824,"statfs":{"total":96636764160,"available":96402251776,"internally_reserved":0,"allocated":17768448,"data_stored":16188165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":216725958},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542679,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119364,"kb_used_data":25780,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94252476,"statfs":{"total":96636764160,"available":96514535424,"internally_reserved":0,"allocated":26398720,"data_stored":24782410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575383,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72276,"kb_used_data":10564,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94299564,"statfs":{"total":96636764160,"available":96562753536,"internally_reserved":0,"allocated":10817536,"data_stored":9242321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28966912,"data_stored":28798943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7954432,"data_stored":7838758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":7192576,"data_stored":7091940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24338432,"data_stored":24108487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":22761472,"data_stored":22631077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":33509376,"data_stored":33292137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14131200,"data_stored":14038127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12148736,"data_stored":11973657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":5371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":5873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:42:21.290 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.290 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.290 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.290 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.290 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.291 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.291 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.291 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.291 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.291 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.291 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.291 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.291 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.292 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.292 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.292 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.292 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.292 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.292 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.292 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.292 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.293 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.293 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.293 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.293 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.293 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.293 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.293 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.293 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.293 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.294 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.294 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.294 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.294 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.294 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.294 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.294 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.294 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.294 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.295 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.295 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.295 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.295 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.295 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.295 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.295 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.295 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.296 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.296 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.296 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.296 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.296 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.296 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.296 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.296 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.297 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.297 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.297 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.297 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.297 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.297 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.297 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.297 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.297 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.298 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.298 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.298 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.298 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.298 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.298 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.298 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.298 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.299 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.299 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.299 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.299 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.299 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.299 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.299 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.299 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.300 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.300 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T17:15:39.072447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.300 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T17:13:53.783642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=13, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.300 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.300 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.300 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.301 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.301 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.302 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T16:58:28.734039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=16, tm_min=58, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:21.304 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T17:42:41.305 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:42:41.680 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:42:41.692 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-09-12T17:42:41.699 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":1597,"stamp":"2024-09-12T17:42:39.841169+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":77092809,"num_objects":701,"num_object_clones":0,"num_object_copies":1402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":701,"num_whiteouts":0,"num_read":181455,"num_read_kb":2442205,"num_write":143598,"num_write_kb":2379913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1087,"num_keys_recovered":0,"num_objects_omap":62,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":734576,"num_omap_keys":1774,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13437,"ondisk_log_size":13437,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1523264,"kb_used_data":177280,"kb_used_omap":12,"kb_used_meta":1345843,"kb_avail":753451456,"statfs":{"total":773094113280,"available":771534290944,"internally_reserved":0,"allocated":181534720,"data_stored":168164780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1378143793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":564,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009246"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":27,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:25.710304+0000","last_change":"2024-09-12T17:42:25.710304+0000","last_active":"2024-09-12T17:42:25.710304+0000","last_peered":"2024-09-12T17:42:25.710304+0000","last_clean":"2024-09-12T17:42:25.710304+0000","last_became_active":"2024-09-12T17:27:17.403833+0000","last_became_peered":"2024-09-12T17:27:17.403833+0000","last_unstale":"2024-09-12T17:42:25.710304+0000","last_undegraded":"2024-09-12T17:42:25.710304+0000","last_fullsized":"2024-09-12T17:42:25.710304+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:25.710119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:25.710119+0000","last_clean_scrub_stamp":"2024-09-12T17:42:25.710119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:55.995072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"265'5","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:26.703218+0000","last_change":"2024-09-12T17:42:26.703218+0000","last_active":"2024-09-12T17:42:26.703218+0000","last_peered":"2024-09-12T17:42:26.703218+0000","last_clean":"2024-09-12T17:42:26.703218+0000","last_became_active":"2024-09-12T17:15:43.158714+0000","last_became_peered":"2024-09-12T17:15:43.158714+0000","last_unstale":"2024-09-12T17:42:26.703218+0000","last_undegraded":"2024-09-12T17:42:26.703218+0000","last_fullsized":"2024-09-12T17:42:26.703218+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T17:42:26.703037+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T17:42:26.703037+0000","last_clean_scrub_stamp":"2024-09-12T17:42:26.703037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:10.522034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"262'2","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:24.574786+0000","last_change":"2024-09-12T17:42:24.574786+0000","last_active":"2024-09-12T17:42:24.574786+0000","last_peered":"2024-09-12T17:42:24.574786+0000","last_clean":"2024-09-12T17:42:24.574786+0000","last_became_active":"2024-09-12T17:15:40.126170+0000","last_became_peered":"2024-09-12T17:15:40.126170+0000","last_unstale":"2024-09-12T17:42:24.574786+0000","last_undegraded":"2024-09-12T17:42:24.574786+0000","last_fullsized":"2024-09-12T17:42:24.574786+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T17:42:24.574547+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T17:42:24.574547+0000","last_clean_scrub_stamp":"2024-09-12T17:42:24.574547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:52.073634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"265'24","reported_seq":119,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:21.885160+0000","last_change":"2024-09-12T17:42:21.885160+0000","last_active":"2024-09-12T17:42:21.885160+0000","last_peered":"2024-09-12T17:42:21.885160+0000","last_clean":"2024-09-12T17:42:21.885160+0000","last_became_active":"2024-09-12T17:13:54.845556+0000","last_became_peered":"2024-09-12T17:13:54.845556+0000","last_unstale":"2024-09-12T17:42:21.885160+0000","last_undegraded":"2024-09-12T17:42:21.885160+0000","last_fullsized":"2024-09-12T17:42:21.885160+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'24","last_scrub_stamp":"2024-09-12T17:42:21.884946+0000","last_deep_scrub":"265'24","last_deep_scrub_stamp":"2024-09-12T17:42:21.884946+0000","last_clean_scrub_stamp":"2024-09-12T17:42:21.884946+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:59.677554+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":82,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":27,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:08.598201+0000","last_change":"2024-09-12T17:42:08.597905+0000","last_active":"2024-09-12T17:42:08.598201+0000","last_peered":"2024-09-12T17:42:08.598201+0000","last_clean":"2024-09-12T17:42:08.598201+0000","last_became_active":"2024-09-12T17:27:17.421771+0000","last_became_peered":"2024-09-12T17:27:17.421771+0000","last_unstale":"2024-09-12T17:42:08.598201+0000","last_undegraded":"2024-09-12T17:42:08.598201+0000","last_fullsized":"2024-09-12T17:42:08.598201+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:08.597697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:08.597697+0000","last_clean_scrub_stamp":"2024-09-12T17:42:08.597697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:18.561900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:26.605233+0000","last_change":"2024-09-12T17:42:26.605233+0000","last_active":"2024-09-12T17:42:26.605233+0000","last_peered":"2024-09-12T17:42:26.605233+0000","last_clean":"2024-09-12T17:42:26.605233+0000","last_became_active":"2024-09-12T17:15:43.159316+0000","last_became_peered":"2024-09-12T17:15:43.159316+0000","last_unstale":"2024-09-12T17:42:26.605233+0000","last_undegraded":"2024-09-12T17:42:26.605233+0000","last_fullsized":"2024-09-12T17:42:26.605233+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:26.605047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:26.605047+0000","last_clean_scrub_stamp":"2024-09-12T17:42:26.605047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:24:03.182026+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"265'7","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:12.481578+0000","last_change":"2024-09-12T17:42:12.481578+0000","last_active":"2024-09-12T17:42:12.481578+0000","last_peered":"2024-09-12T17:42:12.481578+0000","last_clean":"2024-09-12T17:42:12.481578+0000","last_became_active":"2024-09-12T17:15:40.126087+0000","last_became_peered":"2024-09-12T17:15:40.126087+0000","last_unstale":"2024-09-12T17:42:12.481578+0000","last_undegraded":"2024-09-12T17:42:12.481578+0000","last_fullsized":"2024-09-12T17:42:12.481578+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T17:42:12.481394+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T17:42:12.481394+0000","last_clean_scrub_stamp":"2024-09-12T17:42:12.481394+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:23.055774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":1026,"num_write":12,"num_write_kb":5122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"265'36","reported_seq":153,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:01.717471+0000","last_change":"2024-09-12T17:42:01.717471+0000","last_active":"2024-09-12T17:42:01.717471+0000","last_peered":"2024-09-12T17:42:01.717471+0000","last_clean":"2024-09-12T17:42:01.717471+0000","last_became_active":"2024-09-12T17:13:54.837820+0000","last_became_peered":"2024-09-12T17:13:54.837820+0000","last_unstale":"2024-09-12T17:42:01.717471+0000","last_undegraded":"2024-09-12T17:42:01.717471+0000","last_fullsized":"2024-09-12T17:42:01.717471+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'36","last_scrub_stamp":"2024-09-12T17:42:01.717290+0000","last_deep_scrub":"265'36","last_deep_scrub_stamp":"2024-09-12T17:42:01.717290+0000","last_clean_scrub_stamp":"2024-09-12T17:42:01.717290+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:58.550806+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":180,"num_read_kb":123,"num_write":74,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:16.273609+0000","last_change":"2024-09-12T17:42:16.273609+0000","last_active":"2024-09-12T17:42:16.273609+0000","last_peered":"2024-09-12T17:42:16.273609+0000","last_clean":"2024-09-12T17:42:16.273609+0000","last_became_active":"2024-09-12T17:27:17.405657+0000","last_became_peered":"2024-09-12T17:27:17.405657+0000","last_unstale":"2024-09-12T17:42:16.273609+0000","last_undegraded":"2024-09-12T17:42:16.273609+0000","last_fullsized":"2024-09-12T17:42:16.273609+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:16.273412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:16.273412+0000","last_clean_scrub_stamp":"2024-09-12T17:42:16.273412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:31.670331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:30.868518+0000","last_change":"2024-09-12T17:42:30.868518+0000","last_active":"2024-09-12T17:42:30.868518+0000","last_peered":"2024-09-12T17:42:30.868518+0000","last_clean":"2024-09-12T17:42:30.868518+0000","last_became_active":"2024-09-12T17:15:43.868960+0000","last_became_peered":"2024-09-12T17:15:43.868960+0000","last_unstale":"2024-09-12T17:42:30.868518+0000","last_undegraded":"2024-09-12T17:42:30.868518+0000","last_fullsized":"2024-09-12T17:42:30.868518+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:30.868335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:30.868335+0000","last_clean_scrub_stamp":"2024-09-12T17:42:30.868335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:46.591979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"262'2","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:03.638699+0000","last_change":"2024-09-12T17:42:03.638699+0000","last_active":"2024-09-12T17:42:03.638699+0000","last_peered":"2024-09-12T17:42:03.638699+0000","last_clean":"2024-09-12T17:42:03.638699+0000","last_became_active":"2024-09-12T17:15:40.134513+0000","last_became_peered":"2024-09-12T17:15:40.134513+0000","last_unstale":"2024-09-12T17:42:03.638699+0000","last_undegraded":"2024-09-12T17:42:03.638699+0000","last_fullsized":"2024-09-12T17:42:03.638699+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T17:42:03.638514+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T17:42:03.638514+0000","last_clean_scrub_stamp":"2024-09-12T17:42:03.638514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:14.324547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"265'19","reported_seq":102,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:23.944405+0000","last_change":"2024-09-12T17:42:23.944405+0000","last_active":"2024-09-12T17:42:23.944405+0000","last_peered":"2024-09-12T17:42:23.944405+0000","last_clean":"2024-09-12T17:42:23.944405+0000","last_became_active":"2024-09-12T17:13:54.826480+0000","last_became_peered":"2024-09-12T17:13:54.826480+0000","last_unstale":"2024-09-12T17:42:23.944405+0000","last_undegraded":"2024-09-12T17:42:23.944405+0000","last_fullsized":"2024-09-12T17:42:23.944405+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'19","last_scrub_stamp":"2024-09-12T17:42:23.944188+0000","last_deep_scrub":"265'19","last_deep_scrub_stamp":"2024-09-12T17:42:23.944188+0000","last_clean_scrub_stamp":"2024-09-12T17:42:23.944188+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:00.522456+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":27,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:36.460565+0000","last_change":"2024-09-12T17:42:36.460565+0000","last_active":"2024-09-12T17:42:36.460565+0000","last_peered":"2024-09-12T17:42:36.460565+0000","last_clean":"2024-09-12T17:42:36.460565+0000","last_became_active":"2024-09-12T17:27:17.418519+0000","last_became_peered":"2024-09-12T17:27:17.418519+0000","last_unstale":"2024-09-12T17:42:36.460565+0000","last_undegraded":"2024-09-12T17:42:36.460565+0000","last_fullsized":"2024-09-12T17:42:36.460565+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:36.460375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:36.460375+0000","last_clean_scrub_stamp":"2024-09-12T17:42:36.460375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:29.205184+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"265'2","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:35.442495+0000","last_change":"2024-09-12T17:42:35.442495+0000","last_active":"2024-09-12T17:42:35.442495+0000","last_peered":"2024-09-12T17:42:35.442495+0000","last_clean":"2024-09-12T17:42:35.442495+0000","last_became_active":"2024-09-12T17:15:43.868600+0000","last_became_peered":"2024-09-12T17:15:43.868600+0000","last_unstale":"2024-09-12T17:42:35.442495+0000","last_undegraded":"2024-09-12T17:42:35.442495+0000","last_fullsized":"2024-09-12T17:42:35.442495+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T17:42:35.442301+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T17:42:35.442301+0000","last_clean_scrub_stamp":"2024-09-12T17:42:35.442301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:47.547957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"262'3","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:18.626500+0000","last_change":"2024-09-12T17:42:18.626500+0000","last_active":"2024-09-12T17:42:18.626500+0000","last_peered":"2024-09-12T17:42:18.626500+0000","last_clean":"2024-09-12T17:42:18.626500+0000","last_became_active":"2024-09-12T17:15:40.109161+0000","last_became_peered":"2024-09-12T17:15:40.109161+0000","last_unstale":"2024-09-12T17:42:18.626500+0000","last_undegraded":"2024-09-12T17:42:18.626500+0000","last_fullsized":"2024-09-12T17:42:18.626500+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-12T17:42:18.626303+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-12T17:42:18.626303+0000","last_clean_scrub_stamp":"2024-09-12T17:42:18.626303+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:27.434362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"265'31","reported_seq":135,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:20.554457+0000","last_change":"2024-09-12T17:42:20.554457+0000","last_active":"2024-09-12T17:42:20.554457+0000","last_peered":"2024-09-12T17:42:20.554457+0000","last_clean":"2024-09-12T17:42:20.554457+0000","last_became_active":"2024-09-12T17:13:54.838968+0000","last_became_peered":"2024-09-12T17:13:54.838968+0000","last_unstale":"2024-09-12T17:42:20.554457+0000","last_undegraded":"2024-09-12T17:42:20.554457+0000","last_fullsized":"2024-09-12T17:42:20.554457+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'31","last_scrub_stamp":"2024-09-12T17:42:20.554269+0000","last_deep_scrub":"265'31","last_deep_scrub_stamp":"2024-09-12T17:42:20.554269+0000","last_clean_scrub_stamp":"2024-09-12T17:42:20.554269+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:24.364242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":108,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:22.370396+0000","last_change":"2024-09-12T17:27:17.418362+0000","last_active":"2024-09-12T17:39:22.370396+0000","last_peered":"2024-09-12T17:39:22.370396+0000","last_clean":"2024-09-12T17:39:22.370396+0000","last_became_active":"2024-09-12T17:27:17.416509+0000","last_became_peered":"2024-09-12T17:27:17.416509+0000","last_unstale":"2024-09-12T17:39:22.370396+0000","last_undegraded":"2024-09-12T17:39:22.370396+0000","last_fullsized":"2024-09-12T17:39:22.370396+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:54.908041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"265'11","reported_seq":65,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:22.655641+0000","last_change":"2024-09-12T17:42:22.655641+0000","last_active":"2024-09-12T17:42:22.655641+0000","last_peered":"2024-09-12T17:42:22.655641+0000","last_clean":"2024-09-12T17:42:22.655641+0000","last_became_active":"2024-09-12T17:15:43.162643+0000","last_became_peered":"2024-09-12T17:15:43.162643+0000","last_unstale":"2024-09-12T17:42:22.655641+0000","last_undegraded":"2024-09-12T17:42:22.655641+0000","last_fullsized":"2024-09-12T17:42:22.655641+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'11","last_scrub_stamp":"2024-09-12T17:42:22.655465+0000","last_deep_scrub":"265'11","last_deep_scrub_stamp":"2024-09-12T17:42:22.655465+0000","last_clean_scrub_stamp":"2024-09-12T17:42:22.655465+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:16.668659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":23650,"num_write":16,"num_write_kb":11312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"265'10","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:26.930541+0000","last_change":"2024-09-12T17:42:26.930541+0000","last_active":"2024-09-12T17:42:26.930541+0000","last_peered":"2024-09-12T17:42:26.930541+0000","last_clean":"2024-09-12T17:42:26.930541+0000","last_became_active":"2024-09-12T17:15:40.111105+0000","last_became_peered":"2024-09-12T17:15:40.111105+0000","last_unstale":"2024-09-12T17:42:26.930541+0000","last_undegraded":"2024-09-12T17:42:26.930541+0000","last_fullsized":"2024-09-12T17:42:26.930541+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'10","last_scrub_stamp":"2024-09-12T17:42:26.930359+0000","last_deep_scrub":"265'10","last_deep_scrub_stamp":"2024-09-12T17:42:26.930359+0000","last_clean_scrub_stamp":"2024-09-12T17:42:26.930359+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:29.510932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":20,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"265'54","reported_seq":205,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:23.581613+0000","last_change":"2024-09-12T17:42:23.581613+0000","last_active":"2024-09-12T17:42:23.581613+0000","last_peered":"2024-09-12T17:42:23.581613+0000","last_clean":"2024-09-12T17:42:23.581613+0000","last_became_active":"2024-09-12T17:13:54.841072+0000","last_became_peered":"2024-09-12T17:13:54.841072+0000","last_unstale":"2024-09-12T17:42:23.581613+0000","last_undegraded":"2024-09-12T17:42:23.581613+0000","last_fullsized":"2024-09-12T17:42:23.581613+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'54","last_scrub_stamp":"2024-09-12T17:42:23.581434+0000","last_deep_scrub":"265'54","last_deep_scrub_stamp":"2024-09-12T17:42:23.581434+0000","last_clean_scrub_stamp":"2024-09-12T17:42:23.581434+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:06.949169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":282,"num_read_kb":222,"num_write":88,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:18.490676+0000","last_change":"2024-09-12T17:42:18.490676+0000","last_active":"2024-09-12T17:42:18.490676+0000","last_peered":"2024-09-12T17:42:18.490676+0000","last_clean":"2024-09-12T17:42:18.490676+0000","last_became_active":"2024-09-12T17:27:17.392355+0000","last_became_peered":"2024-09-12T17:27:17.392355+0000","last_unstale":"2024-09-12T17:42:18.490676+0000","last_undegraded":"2024-09-12T17:42:18.490676+0000","last_fullsized":"2024-09-12T17:42:18.490676+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:18.490490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:18.490490+0000","last_clean_scrub_stamp":"2024-09-12T17:42:18.490490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:41.103063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"265'4","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:13.320062+0000","last_change":"2024-09-12T17:42:13.319885+0000","last_active":"2024-09-12T17:42:13.320062+0000","last_peered":"2024-09-12T17:42:13.320062+0000","last_clean":"2024-09-12T17:42:13.320062+0000","last_became_active":"2024-09-12T17:15:57.742342+0000","last_became_peered":"2024-09-12T17:15:57.742342+0000","last_unstale":"2024-09-12T17:42:13.320062+0000","last_undegraded":"2024-09-12T17:42:13.320062+0000","last_fullsized":"2024-09-12T17:42:13.320062+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T17:42:13.319684+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T17:42:13.319684+0000","last_clean_scrub_stamp":"2024-09-12T17:42:13.319684+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:39.886328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1087,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:17.653293+0000","last_change":"2024-09-12T17:42:17.653096+0000","last_active":"2024-09-12T17:42:17.653293+0000","last_peered":"2024-09-12T17:42:17.653293+0000","last_clean":"2024-09-12T17:42:17.653293+0000","last_became_active":"2024-09-12T17:15:40.119439+0000","last_became_peered":"2024-09-12T17:15:40.119439+0000","last_unstale":"2024-09-12T17:42:17.653293+0000","last_undegraded":"2024-09-12T17:42:17.653293+0000","last_fullsized":"2024-09-12T17:42:17.653293+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:17.652915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:17.652915+0000","last_clean_scrub_stamp":"2024-09-12T17:42:17.652915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:47.333137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"265'35","reported_seq":150,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:08.370054+0000","last_change":"2024-09-12T17:42:08.370054+0000","last_active":"2024-09-12T17:42:08.370054+0000","last_peered":"2024-09-12T17:42:08.370054+0000","last_clean":"2024-09-12T17:42:08.370054+0000","last_became_active":"2024-09-12T17:13:54.842215+0000","last_became_peered":"2024-09-12T17:13:54.842215+0000","last_unstale":"2024-09-12T17:42:08.370054+0000","last_undegraded":"2024-09-12T17:42:08.370054+0000","last_fullsized":"2024-09-12T17:42:08.370054+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'35","last_scrub_stamp":"2024-09-12T17:42:08.369871+0000","last_deep_scrub":"265'35","last_deep_scrub_stamp":"2024-09-12T17:42:08.369871+0000","last_clean_scrub_stamp":"2024-09-12T17:42:08.369871+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:38.605184+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":135,"num_write":51,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"265'1","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:51.327899+0000","last_change":"2024-09-12T17:27:17.415995+0000","last_active":"2024-09-12T17:39:51.327899+0000","last_peered":"2024-09-12T17:39:51.327899+0000","last_clean":"2024-09-12T17:39:51.327899+0000","last_became_active":"2024-09-12T17:27:17.415277+0000","last_became_peered":"2024-09-12T17:27:17.415277+0000","last_unstale":"2024-09-12T17:39:51.327899+0000","last_undegraded":"2024-09-12T17:39:51.327899+0000","last_fullsized":"2024-09-12T17:39:51.327899+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"265'4","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:14.316099+0000","last_change":"2024-09-12T17:42:14.316099+0000","last_active":"2024-09-12T17:42:14.316099+0000","last_peered":"2024-09-12T17:42:14.316099+0000","last_clean":"2024-09-12T17:42:14.316099+0000","last_became_active":"2024-09-12T17:15:43.172142+0000","last_became_peered":"2024-09-12T17:15:43.172142+0000","last_unstale":"2024-09-12T17:42:14.316099+0000","last_undegraded":"2024-09-12T17:42:14.316099+0000","last_fullsized":"2024-09-12T17:42:14.316099+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T17:42:14.315861+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T17:42:14.315861+0000","last_clean_scrub_stamp":"2024-09-12T17:42:14.315861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:29.719344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"262'4","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:21.608401+0000","last_change":"2024-09-12T17:42:21.608401+0000","last_active":"2024-09-12T17:42:21.608401+0000","last_peered":"2024-09-12T17:42:21.608401+0000","last_clean":"2024-09-12T17:42:21.608401+0000","last_became_active":"2024-09-12T17:15:40.109076+0000","last_became_peered":"2024-09-12T17:15:40.109076+0000","last_unstale":"2024-09-12T17:42:21.608401+0000","last_undegraded":"2024-09-12T17:42:21.608401+0000","last_fullsized":"2024-09-12T17:42:21.608401+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-12T17:42:21.608200+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-12T17:42:21.608200+0000","last_clean_scrub_stamp":"2024-09-12T17:42:21.608200+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:01.459822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"262'6","reported_seq":69,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:19.901002+0000","last_change":"2024-09-12T17:42:19.901002+0000","last_active":"2024-09-12T17:42:19.901002+0000","last_peered":"2024-09-12T17:42:19.901002+0000","last_clean":"2024-09-12T17:42:19.901002+0000","last_became_active":"2024-09-12T17:13:54.819399+0000","last_became_peered":"2024-09-12T17:13:54.819399+0000","last_unstale":"2024-09-12T17:42:19.901002+0000","last_undegraded":"2024-09-12T17:42:19.901002+0000","last_fullsized":"2024-09-12T17:42:19.901002+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-12T17:42:19.900771+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-12T17:42:19.900771+0000","last_clean_scrub_stamp":"2024-09-12T17:42:19.900771+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:19.184425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":27,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:35.903957+0000","last_change":"2024-09-12T17:42:35.903957+0000","last_active":"2024-09-12T17:42:35.903957+0000","last_peered":"2024-09-12T17:42:35.903957+0000","last_clean":"2024-09-12T17:42:35.903957+0000","last_became_active":"2024-09-12T17:27:17.419839+0000","last_became_peered":"2024-09-12T17:27:17.419839+0000","last_unstale":"2024-09-12T17:42:35.903957+0000","last_undegraded":"2024-09-12T17:42:35.903957+0000","last_fullsized":"2024-09-12T17:42:35.903957+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:35.903720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:35.903720+0000","last_clean_scrub_stamp":"2024-09-12T17:42:35.903720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:58.557491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"265'5","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:34.423866+0000","last_change":"2024-09-12T17:42:34.423866+0000","last_active":"2024-09-12T17:42:34.423866+0000","last_peered":"2024-09-12T17:42:34.423866+0000","last_clean":"2024-09-12T17:42:34.423866+0000","last_became_active":"2024-09-12T17:15:43.159663+0000","last_became_peered":"2024-09-12T17:15:43.159663+0000","last_unstale":"2024-09-12T17:42:34.423866+0000","last_undegraded":"2024-09-12T17:42:34.423866+0000","last_fullsized":"2024-09-12T17:42:34.423866+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T17:42:34.423686+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T17:42:34.423686+0000","last_clean_scrub_stamp":"2024-09-12T17:42:34.423686+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:37.860450+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":23,"num_write":10,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"265'2","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:28.896143+0000","last_change":"2024-09-12T17:42:28.896143+0000","last_active":"2024-09-12T17:42:28.896143+0000","last_peered":"2024-09-12T17:42:28.896143+0000","last_clean":"2024-09-12T17:42:28.896143+0000","last_became_active":"2024-09-12T17:15:40.131140+0000","last_became_peered":"2024-09-12T17:15:40.131140+0000","last_unstale":"2024-09-12T17:42:28.896143+0000","last_undegraded":"2024-09-12T17:42:28.896143+0000","last_fullsized":"2024-09-12T17:42:28.896143+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T17:42:28.895924+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T17:42:28.895924+0000","last_clean_scrub_stamp":"2024-09-12T17:42:28.895924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:48:53.352231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"265'19","reported_seq":102,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:08.484896+0000","last_change":"2024-09-12T17:42:08.484896+0000","last_active":"2024-09-12T17:42:08.484896+0000","last_peered":"2024-09-12T17:42:08.484896+0000","last_clean":"2024-09-12T17:42:08.484896+0000","last_became_active":"2024-09-12T17:13:54.831374+0000","last_became_peered":"2024-09-12T17:13:54.831374+0000","last_unstale":"2024-09-12T17:42:08.484896+0000","last_undegraded":"2024-09-12T17:42:08.484896+0000","last_fullsized":"2024-09-12T17:42:08.484896+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'19","last_scrub_stamp":"2024-09-12T17:42:08.484711+0000","last_deep_scrub":"265'19","last_deep_scrub_stamp":"2024-09-12T17:42:08.484711+0000","last_clean_scrub_stamp":"2024-09-12T17:42:08.484711+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:29.635833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":27,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:19.445438+0000","last_change":"2024-09-12T17:42:19.445438+0000","last_active":"2024-09-12T17:42:19.445438+0000","last_peered":"2024-09-12T17:42:19.445438+0000","last_clean":"2024-09-12T17:42:19.445438+0000","last_became_active":"2024-09-12T17:27:17.415918+0000","last_became_peered":"2024-09-12T17:27:17.415918+0000","last_unstale":"2024-09-12T17:42:19.445438+0000","last_undegraded":"2024-09-12T17:42:19.445438+0000","last_fullsized":"2024-09-12T17:42:19.445438+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:19.445231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:19.445231+0000","last_clean_scrub_stamp":"2024-09-12T17:42:19.445231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:23.049505+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"265'4","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:33.456205+0000","last_change":"2024-09-12T17:42:33.456205+0000","last_active":"2024-09-12T17:42:33.456205+0000","last_peered":"2024-09-12T17:42:33.456205+0000","last_clean":"2024-09-12T17:42:33.456205+0000","last_became_active":"2024-09-12T17:15:43.871380+0000","last_became_peered":"2024-09-12T17:15:43.871380+0000","last_unstale":"2024-09-12T17:42:33.456205+0000","last_undegraded":"2024-09-12T17:42:33.456205+0000","last_fullsized":"2024-09-12T17:42:33.456205+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T17:42:33.455955+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T17:42:33.455955+0000","last_clean_scrub_stamp":"2024-09-12T17:42:33.455955+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:12.533244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"265'4","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:20.663190+0000","last_change":"2024-09-12T17:42:20.663190+0000","last_active":"2024-09-12T17:42:20.663190+0000","last_peered":"2024-09-12T17:42:20.663190+0000","last_clean":"2024-09-12T17:42:20.663190+0000","last_became_active":"2024-09-12T17:15:40.116781+0000","last_became_peered":"2024-09-12T17:15:40.116781+0000","last_unstale":"2024-09-12T17:42:20.663190+0000","last_undegraded":"2024-09-12T17:42:20.663190+0000","last_fullsized":"2024-09-12T17:42:20.663190+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T17:42:20.662986+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T17:42:20.662986+0000","last_clean_scrub_stamp":"2024-09-12T17:42:20.662986+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:20.755371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":7168,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"265'68","reported_seq":238,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:20.895705+0000","last_change":"2024-09-12T17:42:20.895705+0000","last_active":"2024-09-12T17:42:20.895705+0000","last_peered":"2024-09-12T17:42:20.895705+0000","last_clean":"2024-09-12T17:42:20.895705+0000","last_became_active":"2024-09-12T17:13:54.829335+0000","last_became_peered":"2024-09-12T17:13:54.829335+0000","last_unstale":"2024-09-12T17:42:20.895705+0000","last_undegraded":"2024-09-12T17:42:20.895705+0000","last_fullsized":"2024-09-12T17:42:20.895705+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'68","last_scrub_stamp":"2024-09-12T17:42:20.895585+0000","last_deep_scrub":"265'68","last_deep_scrub_stamp":"2024-09-12T17:42:20.895585+0000","last_clean_scrub_stamp":"2024-09-12T17:42:20.895585+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:23.337685+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":349,"num_read_kb":240,"num_write":120,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"265'2","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:04.688047+0000","last_change":"2024-09-12T17:42:04.688047+0000","last_active":"2024-09-12T17:42:04.688047+0000","last_peered":"2024-09-12T17:42:04.688047+0000","last_clean":"2024-09-12T17:42:04.688047+0000","last_became_active":"2024-09-12T17:27:17.409364+0000","last_became_peered":"2024-09-12T17:27:17.409364+0000","last_unstale":"2024-09-12T17:42:04.688047+0000","last_undegraded":"2024-09-12T17:42:04.688047+0000","last_fullsized":"2024-09-12T17:42:04.688047+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T17:42:04.687862+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T17:42:04.687862+0000","last_clean_scrub_stamp":"2024-09-12T17:42:04.687862+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:40.198659+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"265'2","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:30.533591+0000","last_change":"2024-09-12T17:42:30.533591+0000","last_active":"2024-09-12T17:42:30.533591+0000","last_peered":"2024-09-12T17:42:30.533591+0000","last_clean":"2024-09-12T17:42:30.533591+0000","last_became_active":"2024-09-12T17:15:43.874421+0000","last_became_peered":"2024-09-12T17:15:43.874421+0000","last_unstale":"2024-09-12T17:42:30.533591+0000","last_undegraded":"2024-09-12T17:42:30.533591+0000","last_fullsized":"2024-09-12T17:42:30.533591+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T17:42:30.533404+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T17:42:30.533404+0000","last_clean_scrub_stamp":"2024-09-12T17:42:30.533404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:49.185869+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"265'4","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:21.711442+0000","last_change":"2024-09-12T17:42:21.711442+0000","last_active":"2024-09-12T17:42:21.711442+0000","last_peered":"2024-09-12T17:42:21.711442+0000","last_clean":"2024-09-12T17:42:21.711442+0000","last_became_active":"2024-09-12T17:15:40.126898+0000","last_became_peered":"2024-09-12T17:15:40.126898+0000","last_unstale":"2024-09-12T17:42:21.711442+0000","last_undegraded":"2024-09-12T17:42:21.711442+0000","last_fullsized":"2024-09-12T17:42:21.711442+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T17:42:21.711262+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T17:42:21.711262+0000","last_clean_scrub_stamp":"2024-09-12T17:42:21.711262+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:54.135788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"265'19","reported_seq":100,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:26.591823+0000","last_change":"2024-09-12T17:42:26.591823+0000","last_active":"2024-09-12T17:42:26.591823+0000","last_peered":"2024-09-12T17:42:26.591823+0000","last_clean":"2024-09-12T17:42:26.591823+0000","last_became_active":"2024-09-12T17:13:54.832780+0000","last_became_peered":"2024-09-12T17:13:54.832780+0000","last_unstale":"2024-09-12T17:42:26.591823+0000","last_undegraded":"2024-09-12T17:42:26.591823+0000","last_fullsized":"2024-09-12T17:42:26.591823+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'19","last_scrub_stamp":"2024-09-12T17:42:26.591536+0000","last_deep_scrub":"265'19","last_deep_scrub_stamp":"2024-09-12T17:42:26.591536+0000","last_clean_scrub_stamp":"2024-09-12T17:42:26.591536+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:52.124781+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":55,"num_write":40,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":27,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:34.869194+0000","last_change":"2024-09-12T17:42:34.869194+0000","last_active":"2024-09-12T17:42:34.869194+0000","last_peered":"2024-09-12T17:42:34.869194+0000","last_clean":"2024-09-12T17:42:34.869194+0000","last_became_active":"2024-09-12T17:27:17.414739+0000","last_became_peered":"2024-09-12T17:27:17.414739+0000","last_unstale":"2024-09-12T17:42:34.869194+0000","last_undegraded":"2024-09-12T17:42:34.869194+0000","last_fullsized":"2024-09-12T17:42:34.869194+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:34.869005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:34.869005+0000","last_clean_scrub_stamp":"2024-09-12T17:42:34.869005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:54.794077+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"265'5","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:32.775356+0000","last_change":"2024-09-12T17:15:43.872275+0000","last_active":"2024-09-12T17:41:32.775356+0000","last_peered":"2024-09-12T17:41:32.775356+0000","last_clean":"2024-09-12T17:41:32.775356+0000","last_became_active":"2024-09-12T17:15:43.871502+0000","last_became_peered":"2024-09-12T17:15:43.871502+0000","last_unstale":"2024-09-12T17:41:32.775356+0000","last_undegraded":"2024-09-12T17:41:32.775356+0000","last_fullsized":"2024-09-12T17:41:32.775356+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.110346+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.110346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"265'5","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:06.687034+0000","last_change":"2024-09-12T17:42:06.686874+0000","last_active":"2024-09-12T17:42:06.687034+0000","last_peered":"2024-09-12T17:42:06.687034+0000","last_clean":"2024-09-12T17:42:06.687034+0000","last_became_active":"2024-09-12T17:15:40.132311+0000","last_became_peered":"2024-09-12T17:15:40.132311+0000","last_unstale":"2024-09-12T17:42:06.687034+0000","last_undegraded":"2024-09-12T17:42:06.687034+0000","last_fullsized":"2024-09-12T17:42:06.687034+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T17:42:06.686674+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T17:42:06.686674+0000","last_clean_scrub_stamp":"2024-09-12T17:42:06.686674+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:57.501458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"265'33","reported_seq":144,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:58.627418+0000","last_change":"2024-09-12T17:41:58.627418+0000","last_active":"2024-09-12T17:41:58.627418+0000","last_peered":"2024-09-12T17:41:58.627418+0000","last_clean":"2024-09-12T17:41:58.627418+0000","last_became_active":"2024-09-12T17:13:54.827785+0000","last_became_peered":"2024-09-12T17:13:54.827785+0000","last_unstale":"2024-09-12T17:41:58.627418+0000","last_undegraded":"2024-09-12T17:41:58.627418+0000","last_fullsized":"2024-09-12T17:41:58.627418+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'33","last_scrub_stamp":"2024-09-12T17:41:58.627187+0000","last_deep_scrub":"265'33","last_deep_scrub_stamp":"2024-09-12T17:41:58.627187+0000","last_clean_scrub_stamp":"2024-09-12T17:41:58.627187+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:13.355618+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":116,"num_write":64,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":27,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:23.670969+0000","last_change":"2024-09-12T17:42:23.670969+0000","last_active":"2024-09-12T17:42:23.670969+0000","last_peered":"2024-09-12T17:42:23.670969+0000","last_clean":"2024-09-12T17:42:23.670969+0000","last_became_active":"2024-09-12T17:27:17.391154+0000","last_became_peered":"2024-09-12T17:27:17.391154+0000","last_unstale":"2024-09-12T17:42:23.670969+0000","last_undegraded":"2024-09-12T17:42:23.670969+0000","last_fullsized":"2024-09-12T17:42:23.670969+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:23.670785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:23.670785+0000","last_clean_scrub_stamp":"2024-09-12T17:42:23.670785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:20.638562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"265'13","reported_seq":69,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:25.611723+0000","last_change":"2024-09-12T17:42:25.611723+0000","last_active":"2024-09-12T17:42:25.611723+0000","last_peered":"2024-09-12T17:42:25.611723+0000","last_clean":"2024-09-12T17:42:25.611723+0000","last_became_active":"2024-09-12T17:15:43.169085+0000","last_became_peered":"2024-09-12T17:15:43.169085+0000","last_unstale":"2024-09-12T17:42:25.611723+0000","last_undegraded":"2024-09-12T17:42:25.611723+0000","last_fullsized":"2024-09-12T17:42:25.611723+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'13","last_scrub_stamp":"2024-09-12T17:42:25.611532+0000","last_deep_scrub":"265'13","last_deep_scrub_stamp":"2024-09-12T17:42:25.611532+0000","last_clean_scrub_stamp":"2024-09-12T17:42:25.611532+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:33.786471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":43010,"num_write":18,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"265'2","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:25.905824+0000","last_change":"2024-09-12T17:42:25.905824+0000","last_active":"2024-09-12T17:42:25.905824+0000","last_peered":"2024-09-12T17:42:25.905824+0000","last_clean":"2024-09-12T17:42:25.905824+0000","last_became_active":"2024-09-12T17:15:40.139145+0000","last_became_peered":"2024-09-12T17:15:40.139145+0000","last_unstale":"2024-09-12T17:42:25.905824+0000","last_undegraded":"2024-09-12T17:42:25.905824+0000","last_fullsized":"2024-09-12T17:42:25.905824+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T17:42:25.905619+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T17:42:25.905619+0000","last_clean_scrub_stamp":"2024-09-12T17:42:25.905619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:07.036912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"265'28","reported_seq":133,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:24.809026+0000","last_change":"2024-09-12T17:42:24.809026+0000","last_active":"2024-09-12T17:42:24.809026+0000","last_peered":"2024-09-12T17:42:24.809026+0000","last_clean":"2024-09-12T17:42:24.809026+0000","last_became_active":"2024-09-12T17:13:54.842816+0000","last_became_peered":"2024-09-12T17:13:54.842816+0000","last_unstale":"2024-09-12T17:42:24.809026+0000","last_undegraded":"2024-09-12T17:42:24.809026+0000","last_fullsized":"2024-09-12T17:42:24.809026+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'28","last_scrub_stamp":"2024-09-12T17:42:24.808840+0000","last_deep_scrub":"265'28","last_deep_scrub_stamp":"2024-09-12T17:42:24.808840+0000","last_clean_scrub_stamp":"2024-09-12T17:42:24.808840+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:35.059706+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":108,"num_write":46,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:39:22.370428+0000","last_change":"2024-09-12T17:27:17.422713+0000","last_active":"2024-09-12T17:39:22.370428+0000","last_peered":"2024-09-12T17:39:22.370428+0000","last_clean":"2024-09-12T17:39:22.370428+0000","last_became_active":"2024-09-12T17:27:17.421939+0000","last_became_peered":"2024-09-12T17:27:17.421939+0000","last_unstale":"2024-09-12T17:39:22.370428+0000","last_undegraded":"2024-09-12T17:39:22.370428+0000","last_fullsized":"2024-09-12T17:39:22.370428+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"262'8","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:20.397898+0000","last_change":"2024-09-12T17:42:20.397898+0000","last_active":"2024-09-12T17:42:20.397898+0000","last_peered":"2024-09-12T17:42:20.397898+0000","last_clean":"2024-09-12T17:42:20.397898+0000","last_became_active":"2024-09-12T17:15:43.158530+0000","last_became_peered":"2024-09-12T17:15:43.158530+0000","last_unstale":"2024-09-12T17:42:20.397898+0000","last_undegraded":"2024-09-12T17:42:20.397898+0000","last_fullsized":"2024-09-12T17:42:20.397898+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'8","last_scrub_stamp":"2024-09-12T17:42:20.397715+0000","last_deep_scrub":"262'8","last_deep_scrub_stamp":"2024-09-12T17:42:20.397715+0000","last_clean_scrub_stamp":"2024-09-12T17:42:20.397715+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:51.915535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10242,"num_write":8,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"265'5","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:16.666203+0000","last_change":"2024-09-12T17:42:16.666203+0000","last_active":"2024-09-12T17:42:16.666203+0000","last_peered":"2024-09-12T17:42:16.666203+0000","last_clean":"2024-09-12T17:42:16.666203+0000","last_became_active":"2024-09-12T17:15:40.130644+0000","last_became_peered":"2024-09-12T17:15:40.130644+0000","last_unstale":"2024-09-12T17:42:16.666203+0000","last_undegraded":"2024-09-12T17:42:16.666203+0000","last_fullsized":"2024-09-12T17:42:16.666203+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T17:42:16.666011+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T17:42:16.666011+0000","last_clean_scrub_stamp":"2024-09-12T17:42:16.666011+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:16.063757+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"265'14","reported_seq":97,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:26.858382+0000","last_change":"2024-09-12T17:42:26.858382+0000","last_active":"2024-09-12T17:42:26.858382+0000","last_peered":"2024-09-12T17:42:26.858382+0000","last_clean":"2024-09-12T17:42:26.858382+0000","last_became_active":"2024-09-12T17:13:54.843036+0000","last_became_peered":"2024-09-12T17:13:54.843036+0000","last_unstale":"2024-09-12T17:42:26.858382+0000","last_undegraded":"2024-09-12T17:42:26.858382+0000","last_fullsized":"2024-09-12T17:42:26.858382+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'14","last_scrub_stamp":"2024-09-12T17:42:26.858208+0000","last_deep_scrub":"265'14","last_deep_scrub_stamp":"2024-09-12T17:42:26.858208+0000","last_clean_scrub_stamp":"2024-09-12T17:42:26.858208+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:42.888679+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":27,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:35.876476+0000","last_change":"2024-09-12T17:42:35.876476+0000","last_active":"2024-09-12T17:42:35.876476+0000","last_peered":"2024-09-12T17:42:35.876476+0000","last_clean":"2024-09-12T17:42:35.876476+0000","last_became_active":"2024-09-12T17:27:17.421187+0000","last_became_peered":"2024-09-12T17:27:17.421187+0000","last_unstale":"2024-09-12T17:42:35.876476+0000","last_undegraded":"2024-09-12T17:42:35.876476+0000","last_fullsized":"2024-09-12T17:42:35.876476+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:35.876290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:35.876290+0000","last_clean_scrub_stamp":"2024-09-12T17:42:35.876290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:06.564471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"265'7","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:15.514370+0000","last_change":"2024-09-12T17:42:15.514370+0000","last_active":"2024-09-12T17:42:15.514370+0000","last_peered":"2024-09-12T17:42:15.514370+0000","last_clean":"2024-09-12T17:42:15.514370+0000","last_became_active":"2024-09-12T17:15:43.155891+0000","last_became_peered":"2024-09-12T17:15:43.155891+0000","last_unstale":"2024-09-12T17:42:15.514370+0000","last_undegraded":"2024-09-12T17:42:15.514370+0000","last_fullsized":"2024-09-12T17:42:15.514370+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T17:42:15.514187+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T17:42:15.514187+0000","last_clean_scrub_stamp":"2024-09-12T17:42:15.514187+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:18:06.736448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8194,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:22.629123+0000","last_change":"2024-09-12T17:42:22.629123+0000","last_active":"2024-09-12T17:42:22.629123+0000","last_peered":"2024-09-12T17:42:22.629123+0000","last_clean":"2024-09-12T17:42:22.629123+0000","last_became_active":"2024-09-12T17:15:40.128470+0000","last_became_peered":"2024-09-12T17:15:40.128470+0000","last_unstale":"2024-09-12T17:42:22.629123+0000","last_undegraded":"2024-09-12T17:42:22.629123+0000","last_fullsized":"2024-09-12T17:42:22.629123+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:22.628950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:22.628950+0000","last_clean_scrub_stamp":"2024-09-12T17:42:22.628950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:54.962037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"265'46","reported_seq":184,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:18.894128+0000","last_change":"2024-09-12T17:42:18.894128+0000","last_active":"2024-09-12T17:42:18.894128+0000","last_peered":"2024-09-12T17:42:18.894128+0000","last_clean":"2024-09-12T17:42:18.894128+0000","last_became_active":"2024-09-12T17:13:54.821816+0000","last_became_peered":"2024-09-12T17:13:54.821816+0000","last_unstale":"2024-09-12T17:42:18.894128+0000","last_undegraded":"2024-09-12T17:42:18.894128+0000","last_fullsized":"2024-09-12T17:42:18.894128+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'46","last_scrub_stamp":"2024-09-12T17:42:18.893943+0000","last_deep_scrub":"265'46","last_deep_scrub_stamp":"2024-09-12T17:42:18.893943+0000","last_clean_scrub_stamp":"2024-09-12T17:42:18.893943+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:59:05.994235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":166,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"265'2","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:34.919993+0000","last_change":"2024-09-12T17:42:34.919993+0000","last_active":"2024-09-12T17:42:34.919993+0000","last_peered":"2024-09-12T17:42:34.919993+0000","last_clean":"2024-09-12T17:42:34.919993+0000","last_became_active":"2024-09-12T17:27:17.422464+0000","last_became_peered":"2024-09-12T17:27:17.422464+0000","last_unstale":"2024-09-12T17:42:34.919993+0000","last_undegraded":"2024-09-12T17:42:34.919993+0000","last_fullsized":"2024-09-12T17:42:34.919993+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T17:42:34.919760+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T17:42:34.919760+0000","last_clean_scrub_stamp":"2024-09-12T17:42:34.919760+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:00.624690+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"265'8","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:29.573709+0000","last_change":"2024-09-12T17:42:29.573709+0000","last_active":"2024-09-12T17:42:29.573709+0000","last_peered":"2024-09-12T17:42:29.573709+0000","last_clean":"2024-09-12T17:42:29.573709+0000","last_became_active":"2024-09-12T17:15:43.171254+0000","last_became_peered":"2024-09-12T17:15:43.171254+0000","last_unstale":"2024-09-12T17:42:29.573709+0000","last_undegraded":"2024-09-12T17:42:29.573709+0000","last_fullsized":"2024-09-12T17:42:29.573709+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-12T17:42:29.573533+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-12T17:42:29.573533+0000","last_clean_scrub_stamp":"2024-09-12T17:42:29.573533+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:12.991144+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10240,"num_write":8,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"265'4","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:10.349759+0000","last_change":"2024-09-12T17:42:10.349759+0000","last_active":"2024-09-12T17:42:10.349759+0000","last_peered":"2024-09-12T17:42:10.349759+0000","last_clean":"2024-09-12T17:42:10.349759+0000","last_became_active":"2024-09-12T17:15:40.116989+0000","last_became_peered":"2024-09-12T17:15:40.116989+0000","last_unstale":"2024-09-12T17:42:10.349759+0000","last_undegraded":"2024-09-12T17:42:10.349759+0000","last_fullsized":"2024-09-12T17:42:10.349759+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T17:42:10.349535+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T17:42:10.349535+0000","last_clean_scrub_stamp":"2024-09-12T17:42:10.349535+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:12:31.542751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4119,"num_write":4,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"265'42","reported_seq":169,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:14.628040+0000","last_change":"2024-09-12T17:42:14.628040+0000","last_active":"2024-09-12T17:42:14.628040+0000","last_peered":"2024-09-12T17:42:14.628040+0000","last_clean":"2024-09-12T17:42:14.628040+0000","last_became_active":"2024-09-12T17:13:54.811613+0000","last_became_peered":"2024-09-12T17:13:54.811613+0000","last_unstale":"2024-09-12T17:42:14.628040+0000","last_undegraded":"2024-09-12T17:42:14.628040+0000","last_fullsized":"2024-09-12T17:42:14.628040+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'42","last_scrub_stamp":"2024-09-12T17:42:14.627840+0000","last_deep_scrub":"265'42","last_deep_scrub_stamp":"2024-09-12T17:42:14.627840+0000","last_clean_scrub_stamp":"2024-09-12T17:42:14.627840+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:12.213103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":153,"num_write":74,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"265'2","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:32.478143+0000","last_change":"2024-09-12T17:42:32.478143+0000","last_active":"2024-09-12T17:42:32.478143+0000","last_peered":"2024-09-12T17:42:32.478143+0000","last_clean":"2024-09-12T17:42:32.478143+0000","last_became_active":"2024-09-12T17:27:17.405051+0000","last_became_peered":"2024-09-12T17:27:17.405051+0000","last_unstale":"2024-09-12T17:42:32.478143+0000","last_undegraded":"2024-09-12T17:42:32.478143+0000","last_fullsized":"2024-09-12T17:42:32.478143+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T17:42:32.477912+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T17:42:32.477912+0000","last_clean_scrub_stamp":"2024-09-12T17:42:32.477912+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:18.425286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"265'2","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:11.375720+0000","last_change":"2024-09-12T17:42:11.375720+0000","last_active":"2024-09-12T17:42:11.375720+0000","last_peered":"2024-09-12T17:42:11.375720+0000","last_clean":"2024-09-12T17:42:11.375720+0000","last_became_active":"2024-09-12T17:15:43.157624+0000","last_became_peered":"2024-09-12T17:15:43.157624+0000","last_unstale":"2024-09-12T17:42:11.375720+0000","last_undegraded":"2024-09-12T17:42:11.375720+0000","last_fullsized":"2024-09-12T17:42:11.375720+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T17:42:11.375527+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T17:42:11.375527+0000","last_clean_scrub_stamp":"2024-09-12T17:42:11.375527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:25.544419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:19.613547+0000","last_change":"2024-09-12T17:42:19.613547+0000","last_active":"2024-09-12T17:42:19.613547+0000","last_peered":"2024-09-12T17:42:19.613547+0000","last_clean":"2024-09-12T17:42:19.613547+0000","last_became_active":"2024-09-12T17:15:40.118074+0000","last_became_peered":"2024-09-12T17:15:40.118074+0000","last_unstale":"2024-09-12T17:42:19.613547+0000","last_undegraded":"2024-09-12T17:42:19.613547+0000","last_fullsized":"2024-09-12T17:42:19.613547+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:19.613366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:19.613366+0000","last_clean_scrub_stamp":"2024-09-12T17:42:19.613366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:40.620215+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"265'16","reported_seq":98,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:19.519736+0000","last_change":"2024-09-12T17:42:19.519736+0000","last_active":"2024-09-12T17:42:19.519736+0000","last_peered":"2024-09-12T17:42:19.519736+0000","last_clean":"2024-09-12T17:42:19.519736+0000","last_became_active":"2024-09-12T17:13:54.840781+0000","last_became_peered":"2024-09-12T17:13:54.840781+0000","last_unstale":"2024-09-12T17:42:19.519736+0000","last_undegraded":"2024-09-12T17:42:19.519736+0000","last_fullsized":"2024-09-12T17:42:19.519736+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'16","last_scrub_stamp":"2024-09-12T17:42:19.519557+0000","last_deep_scrub":"265'16","last_deep_scrub_stamp":"2024-09-12T17:42:19.519557+0000","last_clean_scrub_stamp":"2024-09-12T17:42:19.519557+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:46.190221+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":56,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:57.607003+0000","last_change":"2024-09-12T17:41:57.606875+0000","last_active":"2024-09-12T17:41:57.607003+0000","last_peered":"2024-09-12T17:41:57.607003+0000","last_clean":"2024-09-12T17:41:57.607003+0000","last_became_active":"2024-09-12T17:27:17.408953+0000","last_became_peered":"2024-09-12T17:27:17.408953+0000","last_unstale":"2024-09-12T17:41:57.607003+0000","last_undegraded":"2024-09-12T17:41:57.607003+0000","last_fullsized":"2024-09-12T17:41:57.607003+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:57.606663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:57.606663+0000","last_clean_scrub_stamp":"2024-09-12T17:41:57.606663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:02.509027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:27.575659+0000","last_change":"2024-09-12T17:42:27.575659+0000","last_active":"2024-09-12T17:42:27.575659+0000","last_peered":"2024-09-12T17:42:27.575659+0000","last_clean":"2024-09-12T17:42:27.575659+0000","last_became_active":"2024-09-12T17:15:43.164943+0000","last_became_peered":"2024-09-12T17:15:43.164943+0000","last_unstale":"2024-09-12T17:42:27.575659+0000","last_undegraded":"2024-09-12T17:42:27.575659+0000","last_fullsized":"2024-09-12T17:42:27.575659+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:27.575488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:27.575488+0000","last_clean_scrub_stamp":"2024-09-12T17:42:27.575488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:00.665878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"265'7","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:23.789740+0000","last_change":"2024-09-12T17:42:23.789740+0000","last_active":"2024-09-12T17:42:23.789740+0000","last_peered":"2024-09-12T17:42:23.789740+0000","last_clean":"2024-09-12T17:42:23.789740+0000","last_became_active":"2024-09-12T17:15:40.128681+0000","last_became_peered":"2024-09-12T17:15:40.128681+0000","last_unstale":"2024-09-12T17:42:23.789740+0000","last_undegraded":"2024-09-12T17:42:23.789740+0000","last_fullsized":"2024-09-12T17:42:23.789740+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T17:42:23.789553+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T17:42:23.789553+0000","last_clean_scrub_stamp":"2024-09-12T17:42:23.789553+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:20.314596+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16384,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"265'9","reported_seq":78,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:31.503641+0000","last_change":"2024-09-12T17:42:31.503641+0000","last_active":"2024-09-12T17:42:31.503641+0000","last_peered":"2024-09-12T17:42:31.503641+0000","last_clean":"2024-09-12T17:42:31.503641+0000","last_became_active":"2024-09-12T17:13:54.842287+0000","last_became_peered":"2024-09-12T17:13:54.842287+0000","last_unstale":"2024-09-12T17:42:31.503641+0000","last_undegraded":"2024-09-12T17:42:31.503641+0000","last_fullsized":"2024-09-12T17:42:31.503641+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'9","last_scrub_stamp":"2024-09-12T17:42:31.503443+0000","last_deep_scrub":"265'9","last_deep_scrub_stamp":"2024-09-12T17:42:31.503443+0000","last_clean_scrub_stamp":"2024-09-12T17:42:31.503443+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:14.443276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":28,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":27,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:30.842138+0000","last_change":"2024-09-12T17:42:30.842138+0000","last_active":"2024-09-12T17:42:30.842138+0000","last_peered":"2024-09-12T17:42:30.842138+0000","last_clean":"2024-09-12T17:42:30.842138+0000","last_became_active":"2024-09-12T17:27:17.415241+0000","last_became_peered":"2024-09-12T17:27:17.415241+0000","last_unstale":"2024-09-12T17:42:30.842138+0000","last_undegraded":"2024-09-12T17:42:30.842138+0000","last_fullsized":"2024-09-12T17:42:30.842138+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:30.841945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:30.841945+0000","last_clean_scrub_stamp":"2024-09-12T17:42:30.841945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:43.363356+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"265'8","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:25.567454+0000","last_change":"2024-09-12T17:42:25.567454+0000","last_active":"2024-09-12T17:42:25.567454+0000","last_peered":"2024-09-12T17:42:25.567454+0000","last_clean":"2024-09-12T17:42:25.567454+0000","last_became_active":"2024-09-12T17:15:43.168676+0000","last_became_peered":"2024-09-12T17:15:43.168676+0000","last_unstale":"2024-09-12T17:42:25.567454+0000","last_undegraded":"2024-09-12T17:42:25.567454+0000","last_fullsized":"2024-09-12T17:42:25.567454+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-12T17:42:25.567270+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-12T17:42:25.567270+0000","last_clean_scrub_stamp":"2024-09-12T17:42:25.567270+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:01.519169+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":24578,"num_write":18,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"265'6","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:05.641587+0000","last_change":"2024-09-12T17:42:05.641587+0000","last_active":"2024-09-12T17:42:05.641587+0000","last_peered":"2024-09-12T17:42:05.641587+0000","last_clean":"2024-09-12T17:42:05.641587+0000","last_became_active":"2024-09-12T17:15:40.128708+0000","last_became_peered":"2024-09-12T17:15:40.128708+0000","last_unstale":"2024-09-12T17:42:05.641587+0000","last_undegraded":"2024-09-12T17:42:05.641587+0000","last_fullsized":"2024-09-12T17:42:05.641587+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T17:42:05.641411+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T17:42:05.641411+0000","last_clean_scrub_stamp":"2024-09-12T17:42:05.641411+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:30.258368+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8194,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"265'35","reported_seq":152,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:17.633364+0000","last_change":"2024-09-12T17:42:17.633364+0000","last_active":"2024-09-12T17:42:17.633364+0000","last_peered":"2024-09-12T17:42:17.633364+0000","last_clean":"2024-09-12T17:42:17.633364+0000","last_became_active":"2024-09-12T17:13:54.830096+0000","last_became_peered":"2024-09-12T17:13:54.830096+0000","last_unstale":"2024-09-12T17:42:17.633364+0000","last_undegraded":"2024-09-12T17:42:17.633364+0000","last_fullsized":"2024-09-12T17:42:17.633364+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'35","last_scrub_stamp":"2024-09-12T17:42:17.633192+0000","last_deep_scrub":"265'35","last_deep_scrub_stamp":"2024-09-12T17:42:17.633192+0000","last_clean_scrub_stamp":"2024-09-12T17:42:17.633192+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:13.045874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":131,"num_write":60,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:15.302638+0000","last_change":"2024-09-12T17:42:15.302511+0000","last_active":"2024-09-12T17:42:15.302638+0000","last_peered":"2024-09-12T17:42:15.302638+0000","last_clean":"2024-09-12T17:42:15.302638+0000","last_became_active":"2024-09-12T17:27:17.411635+0000","last_became_peered":"2024-09-12T17:27:17.411635+0000","last_unstale":"2024-09-12T17:42:15.302638+0000","last_undegraded":"2024-09-12T17:42:15.302638+0000","last_fullsized":"2024-09-12T17:42:15.302638+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:15.302324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:15.302324+0000","last_clean_scrub_stamp":"2024-09-12T17:42:15.302324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:56.811938+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:14.469466+0000","last_change":"2024-09-12T17:42:14.469466+0000","last_active":"2024-09-12T17:42:14.469466+0000","last_peered":"2024-09-12T17:42:14.469466+0000","last_clean":"2024-09-12T17:42:14.469466+0000","last_became_active":"2024-09-12T17:15:43.869197+0000","last_became_peered":"2024-09-12T17:15:43.869197+0000","last_unstale":"2024-09-12T17:42:14.469466+0000","last_undegraded":"2024-09-12T17:42:14.469466+0000","last_fullsized":"2024-09-12T17:42:14.469466+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:14.469273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:14.469273+0000","last_clean_scrub_stamp":"2024-09-12T17:42:14.469273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:22.066834+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:27.944887+0000","last_change":"2024-09-12T17:42:27.944887+0000","last_active":"2024-09-12T17:42:27.944887+0000","last_peered":"2024-09-12T17:42:27.944887+0000","last_clean":"2024-09-12T17:42:27.944887+0000","last_became_active":"2024-09-12T17:15:40.114636+0000","last_became_peered":"2024-09-12T17:15:40.114636+0000","last_unstale":"2024-09-12T17:42:27.944887+0000","last_undegraded":"2024-09-12T17:42:27.944887+0000","last_fullsized":"2024-09-12T17:42:27.944887+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:27.944715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:27.944715+0000","last_clean_scrub_stamp":"2024-09-12T17:42:27.944715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:29.584910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"265'11","reported_seq":85,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:06.384673+0000","last_change":"2024-09-12T17:42:06.384673+0000","last_active":"2024-09-12T17:42:06.384673+0000","last_peered":"2024-09-12T17:42:06.384673+0000","last_clean":"2024-09-12T17:42:06.384673+0000","last_became_active":"2024-09-12T17:13:54.836955+0000","last_became_peered":"2024-09-12T17:13:54.836955+0000","last_unstale":"2024-09-12T17:42:06.384673+0000","last_undegraded":"2024-09-12T17:42:06.384673+0000","last_fullsized":"2024-09-12T17:42:06.384673+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'11","last_scrub_stamp":"2024-09-12T17:42:06.384479+0000","last_deep_scrub":"265'11","last_deep_scrub_stamp":"2024-09-12T17:42:06.384479+0000","last_clean_scrub_stamp":"2024-09-12T17:42:06.384479+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:34.190005+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":38,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:31.865401+0000","last_change":"2024-09-12T17:42:31.865401+0000","last_active":"2024-09-12T17:42:31.865401+0000","last_peered":"2024-09-12T17:42:31.865401+0000","last_clean":"2024-09-12T17:42:31.865401+0000","last_became_active":"2024-09-12T17:27:17.408128+0000","last_became_peered":"2024-09-12T17:27:17.408128+0000","last_unstale":"2024-09-12T17:42:31.865401+0000","last_undegraded":"2024-09-12T17:42:31.865401+0000","last_fullsized":"2024-09-12T17:42:31.865401+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:31.865207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:31.865207+0000","last_clean_scrub_stamp":"2024-09-12T17:42:31.865207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:45.932154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"265'4","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:28.553737+0000","last_change":"2024-09-12T17:42:28.553737+0000","last_active":"2024-09-12T17:42:28.553737+0000","last_peered":"2024-09-12T17:42:28.553737+0000","last_clean":"2024-09-12T17:42:28.553737+0000","last_became_active":"2024-09-12T17:15:43.169936+0000","last_became_peered":"2024-09-12T17:15:43.169936+0000","last_unstale":"2024-09-12T17:42:28.553737+0000","last_undegraded":"2024-09-12T17:42:28.553737+0000","last_fullsized":"2024-09-12T17:42:28.553737+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T17:42:28.553560+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T17:42:28.553560+0000","last_clean_scrub_stamp":"2024-09-12T17:42:28.553560+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:56.719767+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"265'9","reported_seq":66,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:10.516621+0000","last_change":"2024-09-12T17:42:10.516621+0000","last_active":"2024-09-12T17:42:10.516621+0000","last_peered":"2024-09-12T17:42:10.516621+0000","last_clean":"2024-09-12T17:42:10.516621+0000","last_became_active":"2024-09-12T17:15:40.121181+0000","last_became_peered":"2024-09-12T17:15:40.121181+0000","last_unstale":"2024-09-12T17:42:10.516621+0000","last_undegraded":"2024-09-12T17:42:10.516621+0000","last_fullsized":"2024-09-12T17:42:10.516621+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'9","last_scrub_stamp":"2024-09-12T17:42:10.516395+0000","last_deep_scrub":"265'9","last_deep_scrub_stamp":"2024-09-12T17:42:10.516395+0000","last_clean_scrub_stamp":"2024-09-12T17:42:10.516395+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:29.653573+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12338,"num_write":14,"num_write_kb":5168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"265'48","reported_seq":184,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:02.687921+0000","last_change":"2024-09-12T17:42:02.687921+0000","last_active":"2024-09-12T17:42:02.687921+0000","last_peered":"2024-09-12T17:42:02.687921+0000","last_clean":"2024-09-12T17:42:02.687921+0000","last_became_active":"2024-09-12T17:13:54.841923+0000","last_became_peered":"2024-09-12T17:13:54.841923+0000","last_unstale":"2024-09-12T17:42:02.687921+0000","last_undegraded":"2024-09-12T17:42:02.687921+0000","last_fullsized":"2024-09-12T17:42:02.687921+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'48","last_scrub_stamp":"2024-09-12T17:42:02.687744+0000","last_deep_scrub":"265'48","last_deep_scrub_stamp":"2024-09-12T17:42:02.687744+0000","last_clean_scrub_stamp":"2024-09-12T17:42:02.687744+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:43.890945+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":241,"num_read_kb":172,"num_write":100,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:38:32.357996+0000","last_change":"2024-09-12T17:27:17.419285+0000","last_active":"2024-09-12T17:38:32.357996+0000","last_peered":"2024-09-12T17:38:32.357996+0000","last_clean":"2024-09-12T17:38:32.357996+0000","last_became_active":"2024-09-12T17:27:17.417566+0000","last_became_peered":"2024-09-12T17:27:17.417566+0000","last_unstale":"2024-09-12T17:38:32.357996+0000","last_undegraded":"2024-09-12T17:38:32.357996+0000","last_fullsized":"2024-09-12T17:38:32.357996+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:27:16.350181+0000","last_clean_scrub_stamp":"2024-09-12T17:27:16.350181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:32.507294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"262'4","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:24.656776+0000","last_change":"2024-09-12T17:42:24.656776+0000","last_active":"2024-09-12T17:42:24.656776+0000","last_peered":"2024-09-12T17:42:24.656776+0000","last_clean":"2024-09-12T17:42:24.656776+0000","last_became_active":"2024-09-12T17:15:43.161858+0000","last_became_peered":"2024-09-12T17:15:43.161858+0000","last_unstale":"2024-09-12T17:42:24.656776+0000","last_undegraded":"2024-09-12T17:42:24.656776+0000","last_fullsized":"2024-09-12T17:42:24.656776+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-12T17:42:24.656587+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-12T17:42:24.656587+0000","last_clean_scrub_stamp":"2024-09-12T17:42:24.656587+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:56:03.318854+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:22.909120+0000","last_change":"2024-09-12T17:42:22.909120+0000","last_active":"2024-09-12T17:42:22.909120+0000","last_peered":"2024-09-12T17:42:22.909120+0000","last_clean":"2024-09-12T17:42:22.909120+0000","last_became_active":"2024-09-12T17:15:40.112179+0000","last_became_peered":"2024-09-12T17:15:40.112179+0000","last_unstale":"2024-09-12T17:42:22.909120+0000","last_undegraded":"2024-09-12T17:42:22.909120+0000","last_fullsized":"2024-09-12T17:42:22.909120+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:22.908920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:22.908920+0000","last_clean_scrub_stamp":"2024-09-12T17:42:22.908920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:27.576224+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"265'67","reported_seq":237,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:17.913371+0000","last_change":"2024-09-12T17:42:17.913371+0000","last_active":"2024-09-12T17:42:17.913371+0000","last_peered":"2024-09-12T17:42:17.913371+0000","last_clean":"2024-09-12T17:42:17.913371+0000","last_became_active":"2024-09-12T17:13:54.827402+0000","last_became_peered":"2024-09-12T17:13:54.827402+0000","last_unstale":"2024-09-12T17:42:17.913371+0000","last_undegraded":"2024-09-12T17:42:17.913371+0000","last_fullsized":"2024-09-12T17:42:17.913371+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'67","last_scrub_stamp":"2024-09-12T17:42:17.913094+0000","last_deep_scrub":"265'67","last_deep_scrub_stamp":"2024-09-12T17:42:17.913094+0000","last_clean_scrub_stamp":"2024-09-12T17:42:17.913094+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:27.784194+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":342,"num_read_kb":248,"num_write":117,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":27,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:33.885530+0000","last_change":"2024-09-12T17:42:33.885530+0000","last_active":"2024-09-12T17:42:33.885530+0000","last_peered":"2024-09-12T17:42:33.885530+0000","last_clean":"2024-09-12T17:42:33.885530+0000","last_became_active":"2024-09-12T17:27:17.418022+0000","last_became_peered":"2024-09-12T17:27:17.418022+0000","last_unstale":"2024-09-12T17:42:33.885530+0000","last_undegraded":"2024-09-12T17:42:33.885530+0000","last_fullsized":"2024-09-12T17:42:33.885530+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:33.885333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:33.885333+0000","last_clean_scrub_stamp":"2024-09-12T17:42:33.885333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:21.072016+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"265'5","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:25.854890+0000","last_change":"2024-09-12T17:42:25.854890+0000","last_active":"2024-09-12T17:42:25.854890+0000","last_peered":"2024-09-12T17:42:25.854890+0000","last_clean":"2024-09-12T17:42:25.854890+0000","last_became_active":"2024-09-12T17:15:43.864657+0000","last_became_peered":"2024-09-12T17:15:43.864657+0000","last_unstale":"2024-09-12T17:42:25.854890+0000","last_undegraded":"2024-09-12T17:42:25.854890+0000","last_fullsized":"2024-09-12T17:42:25.854890+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T17:42:25.854675+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T17:42:25.854675+0000","last_clean_scrub_stamp":"2024-09-12T17:42:25.854675+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:19.312298+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"265'12","reported_seq":76,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:11.521302+0000","last_change":"2024-09-12T17:42:11.521302+0000","last_active":"2024-09-12T17:42:11.521302+0000","last_peered":"2024-09-12T17:42:11.521302+0000","last_clean":"2024-09-12T17:42:11.521302+0000","last_became_active":"2024-09-12T17:15:40.122001+0000","last_became_peered":"2024-09-12T17:15:40.122001+0000","last_unstale":"2024-09-12T17:42:11.521302+0000","last_undegraded":"2024-09-12T17:42:11.521302+0000","last_fullsized":"2024-09-12T17:42:11.521302+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'12","last_scrub_stamp":"2024-09-12T17:42:11.521124+0000","last_deep_scrub":"265'12","last_deep_scrub_stamp":"2024-09-12T17:42:11.521124+0000","last_clean_scrub_stamp":"2024-09-12T17:42:11.521124+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:06.034884+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12340,"num_write":12,"num_write_kb":6192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"265'23","reported_seq":114,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:16.721715+0000","last_change":"2024-09-12T17:42:16.721715+0000","last_active":"2024-09-12T17:42:16.721715+0000","last_peered":"2024-09-12T17:42:16.721715+0000","last_clean":"2024-09-12T17:42:16.721715+0000","last_became_active":"2024-09-12T17:13:54.825019+0000","last_became_peered":"2024-09-12T17:13:54.825019+0000","last_unstale":"2024-09-12T17:42:16.721715+0000","last_undegraded":"2024-09-12T17:42:16.721715+0000","last_fullsized":"2024-09-12T17:42:16.721715+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'23","last_scrub_stamp":"2024-09-12T17:42:16.721533+0000","last_deep_scrub":"265'23","last_deep_scrub_stamp":"2024-09-12T17:42:16.721533+0000","last_clean_scrub_stamp":"2024-09-12T17:42:16.721533+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:09.433502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":38,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"265'2","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:32.898724+0000","last_change":"2024-09-12T17:42:32.898724+0000","last_active":"2024-09-12T17:42:32.898724+0000","last_peered":"2024-09-12T17:42:32.898724+0000","last_clean":"2024-09-12T17:42:32.898724+0000","last_became_active":"2024-09-12T17:27:17.408151+0000","last_became_peered":"2024-09-12T17:27:17.408151+0000","last_unstale":"2024-09-12T17:42:32.898724+0000","last_undegraded":"2024-09-12T17:42:32.898724+0000","last_fullsized":"2024-09-12T17:42:32.898724+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T17:42:32.898543+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T17:42:32.898543+0000","last_clean_scrub_stamp":"2024-09-12T17:42:32.898543+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:06.424871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"265'7","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:16.476434+0000","last_change":"2024-09-12T17:42:16.476254+0000","last_active":"2024-09-12T17:42:16.476434+0000","last_peered":"2024-09-12T17:42:16.476434+0000","last_clean":"2024-09-12T17:42:16.476434+0000","last_became_active":"2024-09-12T17:15:43.166482+0000","last_became_peered":"2024-09-12T17:15:43.166482+0000","last_unstale":"2024-09-12T17:42:16.476434+0000","last_undegraded":"2024-09-12T17:42:16.476434+0000","last_fullsized":"2024-09-12T17:42:16.476434+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T17:42:16.476055+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T17:42:16.476055+0000","last_clean_scrub_stamp":"2024-09-12T17:42:16.476055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:42.940708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:24.905257+0000","last_change":"2024-09-12T17:42:24.905257+0000","last_active":"2024-09-12T17:42:24.905257+0000","last_peered":"2024-09-12T17:42:24.905257+0000","last_clean":"2024-09-12T17:42:24.905257+0000","last_became_active":"2024-09-12T17:15:40.138190+0000","last_became_peered":"2024-09-12T17:15:40.138190+0000","last_unstale":"2024-09-12T17:42:24.905257+0000","last_undegraded":"2024-09-12T17:42:24.905257+0000","last_fullsized":"2024-09-12T17:42:24.905257+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:24.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:24.905052+0000","last_clean_scrub_stamp":"2024-09-12T17:42:24.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:55.049818+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"265'18","reported_seq":102,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:21.599090+0000","last_change":"2024-09-12T17:42:21.599090+0000","last_active":"2024-09-12T17:42:21.599090+0000","last_peered":"2024-09-12T17:42:21.599090+0000","last_clean":"2024-09-12T17:42:21.599090+0000","last_became_active":"2024-09-12T17:13:54.832453+0000","last_became_peered":"2024-09-12T17:13:54.832453+0000","last_unstale":"2024-09-12T17:42:21.599090+0000","last_undegraded":"2024-09-12T17:42:21.599090+0000","last_fullsized":"2024-09-12T17:42:21.599090+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'18","last_scrub_stamp":"2024-09-12T17:42:21.598904+0000","last_deep_scrub":"265'18","last_deep_scrub_stamp":"2024-09-12T17:42:21.598904+0000","last_clean_scrub_stamp":"2024-09-12T17:42:21.598904+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:42.851732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":60,"num_write":35,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":27,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:36.869358+0000","last_change":"2024-09-12T17:42:36.869358+0000","last_active":"2024-09-12T17:42:36.869358+0000","last_peered":"2024-09-12T17:42:36.869358+0000","last_clean":"2024-09-12T17:42:36.869358+0000","last_became_active":"2024-09-12T17:27:17.417574+0000","last_became_peered":"2024-09-12T17:27:17.417574+0000","last_unstale":"2024-09-12T17:42:36.869358+0000","last_undegraded":"2024-09-12T17:42:36.869358+0000","last_fullsized":"2024-09-12T17:42:36.869358+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:36.869156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:36.869156+0000","last_clean_scrub_stamp":"2024-09-12T17:42:36.869156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:28.911858+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"265'4","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:27.876604+0000","last_change":"2024-09-12T17:42:27.876604+0000","last_active":"2024-09-12T17:42:27.876604+0000","last_peered":"2024-09-12T17:42:27.876604+0000","last_clean":"2024-09-12T17:42:27.876604+0000","last_became_active":"2024-09-12T17:15:43.151000+0000","last_became_peered":"2024-09-12T17:15:43.151000+0000","last_unstale":"2024-09-12T17:42:27.876604+0000","last_undegraded":"2024-09-12T17:42:27.876604+0000","last_fullsized":"2024-09-12T17:42:27.876604+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T17:42:27.876431+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T17:42:27.876431+0000","last_clean_scrub_stamp":"2024-09-12T17:42:27.876431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:41.034087+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"262'2","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:15.619233+0000","last_change":"2024-09-12T17:42:15.619233+0000","last_active":"2024-09-12T17:42:15.619233+0000","last_peered":"2024-09-12T17:42:15.619233+0000","last_clean":"2024-09-12T17:42:15.619233+0000","last_became_active":"2024-09-12T17:15:40.118469+0000","last_became_peered":"2024-09-12T17:15:40.118469+0000","last_unstale":"2024-09-12T17:42:15.619233+0000","last_undegraded":"2024-09-12T17:42:15.619233+0000","last_fullsized":"2024-09-12T17:42:15.619233+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T17:42:15.619039+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T17:42:15.619039+0000","last_clean_scrub_stamp":"2024-09-12T17:42:15.619039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:33.245776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"265'20","reported_seq":108,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:05.415520+0000","last_change":"2024-09-12T17:42:05.415245+0000","last_active":"2024-09-12T17:42:05.415520+0000","last_peered":"2024-09-12T17:42:05.415520+0000","last_clean":"2024-09-12T17:42:05.415520+0000","last_became_active":"2024-09-12T17:13:54.827570+0000","last_became_peered":"2024-09-12T17:13:54.827570+0000","last_unstale":"2024-09-12T17:42:05.415520+0000","last_undegraded":"2024-09-12T17:42:05.415520+0000","last_fullsized":"2024-09-12T17:42:05.415520+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'20","last_scrub_stamp":"2024-09-12T17:42:05.415005+0000","last_deep_scrub":"265'20","last_deep_scrub_stamp":"2024-09-12T17:42:05.415005+0000","last_clean_scrub_stamp":"2024-09-12T17:42:05.415005+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:47.650137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":63,"num_write":42,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:28.895633+0000","last_change":"2024-09-12T17:42:28.895633+0000","last_active":"2024-09-12T17:42:28.895633+0000","last_peered":"2024-09-12T17:42:28.895633+0000","last_clean":"2024-09-12T17:42:28.895633+0000","last_became_active":"2024-09-12T17:27:17.411175+0000","last_became_peered":"2024-09-12T17:27:17.411175+0000","last_unstale":"2024-09-12T17:42:28.895633+0000","last_undegraded":"2024-09-12T17:42:28.895633+0000","last_fullsized":"2024-09-12T17:42:28.895633+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:28.895441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:28.895441+0000","last_clean_scrub_stamp":"2024-09-12T17:42:28.895441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:16.800456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"265'5","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:33.915200+0000","last_change":"2024-09-12T17:42:33.915200+0000","last_active":"2024-09-12T17:42:33.915200+0000","last_peered":"2024-09-12T17:42:33.915200+0000","last_clean":"2024-09-12T17:42:33.915200+0000","last_became_active":"2024-09-12T17:15:43.159149+0000","last_became_peered":"2024-09-12T17:15:43.159149+0000","last_unstale":"2024-09-12T17:42:33.915200+0000","last_undegraded":"2024-09-12T17:42:33.915200+0000","last_fullsized":"2024-09-12T17:42:33.915200+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T17:42:33.915014+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T17:42:33.915014+0000","last_clean_scrub_stamp":"2024-09-12T17:42:33.915014+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:34.264799+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2048,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"265'7","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:17.743182+0000","last_change":"2024-09-12T17:42:17.743182+0000","last_active":"2024-09-12T17:42:17.743182+0000","last_peered":"2024-09-12T17:42:17.743182+0000","last_clean":"2024-09-12T17:42:17.743182+0000","last_became_active":"2024-09-12T17:15:40.121513+0000","last_became_peered":"2024-09-12T17:15:40.121513+0000","last_unstale":"2024-09-12T17:42:17.743182+0000","last_undegraded":"2024-09-12T17:42:17.743182+0000","last_fullsized":"2024-09-12T17:42:17.743182+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T17:42:17.742962+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T17:42:17.742962+0000","last_clean_scrub_stamp":"2024-09-12T17:42:17.742962+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:27.364682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6144,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"265'31","reported_seq":140,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:16.929769+0000","last_change":"2024-09-12T17:42:16.929769+0000","last_active":"2024-09-12T17:42:16.929769+0000","last_peered":"2024-09-12T17:42:16.929769+0000","last_clean":"2024-09-12T17:42:16.929769+0000","last_became_active":"2024-09-12T17:13:54.828393+0000","last_became_peered":"2024-09-12T17:13:54.828393+0000","last_unstale":"2024-09-12T17:42:16.929769+0000","last_undegraded":"2024-09-12T17:42:16.929769+0000","last_fullsized":"2024-09-12T17:42:16.929769+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'31","last_scrub_stamp":"2024-09-12T17:42:16.929541+0000","last_deep_scrub":"265'31","last_deep_scrub_stamp":"2024-09-12T17:42:16.929541+0000","last_clean_scrub_stamp":"2024-09-12T17:42:16.929541+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:04.659867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":109,"num_write":58,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:24.679943+0000","last_change":"2024-09-12T17:42:24.679943+0000","last_active":"2024-09-12T17:42:24.679943+0000","last_peered":"2024-09-12T17:42:24.679943+0000","last_clean":"2024-09-12T17:42:24.679943+0000","last_became_active":"2024-09-12T17:27:17.402024+0000","last_became_peered":"2024-09-12T17:27:17.402024+0000","last_unstale":"2024-09-12T17:42:24.679943+0000","last_undegraded":"2024-09-12T17:42:24.679943+0000","last_fullsized":"2024-09-12T17:42:24.679943+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:24.679738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:24.679738+0000","last_clean_scrub_stamp":"2024-09-12T17:42:24.679738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:35.046672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:29.882332+0000","last_change":"2024-09-12T17:42:29.882332+0000","last_active":"2024-09-12T17:42:29.882332+0000","last_peered":"2024-09-12T17:42:29.882332+0000","last_clean":"2024-09-12T17:42:29.882332+0000","last_became_active":"2024-09-12T17:15:43.871095+0000","last_became_peered":"2024-09-12T17:15:43.871095+0000","last_unstale":"2024-09-12T17:42:29.882332+0000","last_undegraded":"2024-09-12T17:42:29.882332+0000","last_fullsized":"2024-09-12T17:42:29.882332+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:29.881821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:29.881821+0000","last_clean_scrub_stamp":"2024-09-12T17:42:29.881821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:12.488014+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'9","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:00.694187+0000","last_change":"2024-09-12T17:42:00.694187+0000","last_active":"2024-09-12T17:42:00.694187+0000","last_peered":"2024-09-12T17:42:00.694187+0000","last_clean":"2024-09-12T17:42:00.694187+0000","last_became_active":"2024-09-12T17:15:40.125684+0000","last_became_peered":"2024-09-12T17:15:40.125684+0000","last_unstale":"2024-09-12T17:42:00.694187+0000","last_undegraded":"2024-09-12T17:42:00.694187+0000","last_fullsized":"2024-09-12T17:42:00.694187+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'9","last_scrub_stamp":"2024-09-12T17:42:00.694013+0000","last_deep_scrub":"265'9","last_deep_scrub_stamp":"2024-09-12T17:42:00.694013+0000","last_clean_scrub_stamp":"2024-09-12T17:42:00.694013+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:18.914344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":32770,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"265'38","reported_seq":156,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:04.376544+0000","last_change":"2024-09-12T17:42:04.376407+0000","last_active":"2024-09-12T17:42:04.376544+0000","last_peered":"2024-09-12T17:42:04.376544+0000","last_clean":"2024-09-12T17:42:04.376544+0000","last_became_active":"2024-09-12T17:13:54.825945+0000","last_became_peered":"2024-09-12T17:13:54.825945+0000","last_unstale":"2024-09-12T17:42:04.376544+0000","last_undegraded":"2024-09-12T17:42:04.376544+0000","last_fullsized":"2024-09-12T17:42:04.376544+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'38","last_scrub_stamp":"2024-09-12T17:42:04.376219+0000","last_deep_scrub":"265'38","last_deep_scrub_stamp":"2024-09-12T17:42:04.376219+0000","last_clean_scrub_stamp":"2024-09-12T17:42:04.376219+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:13.365245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":132,"num_write":66,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:17.484778+0000","last_change":"2024-09-12T17:42:17.484778+0000","last_active":"2024-09-12T17:42:17.484778+0000","last_peered":"2024-09-12T17:42:17.484778+0000","last_clean":"2024-09-12T17:42:17.484778+0000","last_became_active":"2024-09-12T17:27:17.408445+0000","last_became_peered":"2024-09-12T17:27:17.408445+0000","last_unstale":"2024-09-12T17:42:17.484778+0000","last_undegraded":"2024-09-12T17:42:17.484778+0000","last_fullsized":"2024-09-12T17:42:17.484778+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:17.484596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:17.484596+0000","last_clean_scrub_stamp":"2024-09-12T17:42:17.484596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:49:48.661676+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:22.739241+0000","last_change":"2024-09-12T17:42:22.739241+0000","last_active":"2024-09-12T17:42:22.739241+0000","last_peered":"2024-09-12T17:42:22.739241+0000","last_clean":"2024-09-12T17:42:22.739241+0000","last_became_active":"2024-09-12T17:15:43.866375+0000","last_became_peered":"2024-09-12T17:15:43.866375+0000","last_unstale":"2024-09-12T17:42:22.739241+0000","last_undegraded":"2024-09-12T17:42:22.739241+0000","last_fullsized":"2024-09-12T17:42:22.739241+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:22.739070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:22.739070+0000","last_clean_scrub_stamp":"2024-09-12T17:42:22.739070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:43.987911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"265'6","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:18.655613+0000","last_change":"2024-09-12T17:42:18.655613+0000","last_active":"2024-09-12T17:42:18.655613+0000","last_peered":"2024-09-12T17:42:18.655613+0000","last_clean":"2024-09-12T17:42:18.655613+0000","last_became_active":"2024-09-12T17:15:40.124901+0000","last_became_peered":"2024-09-12T17:15:40.124901+0000","last_unstale":"2024-09-12T17:42:18.655613+0000","last_undegraded":"2024-09-12T17:42:18.655613+0000","last_fullsized":"2024-09-12T17:42:18.655613+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T17:42:18.655413+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T17:42:18.655413+0000","last_clean_scrub_stamp":"2024-09-12T17:42:18.655413+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:41.250021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"265'32","reported_seq":138,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:15.700625+0000","last_change":"2024-09-12T17:42:15.700625+0000","last_active":"2024-09-12T17:42:15.700625+0000","last_peered":"2024-09-12T17:42:15.700625+0000","last_clean":"2024-09-12T17:42:15.700625+0000","last_became_active":"2024-09-12T17:13:54.824810+0000","last_became_peered":"2024-09-12T17:13:54.824810+0000","last_unstale":"2024-09-12T17:42:15.700625+0000","last_undegraded":"2024-09-12T17:42:15.700625+0000","last_fullsized":"2024-09-12T17:42:15.700625+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'32","last_scrub_stamp":"2024-09-12T17:42:15.700378+0000","last_deep_scrub":"265'32","last_deep_scrub_stamp":"2024-09-12T17:42:15.700378+0000","last_clean_scrub_stamp":"2024-09-12T17:42:15.700378+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:03:14.023849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":107,"num_write":61,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:27.560570+0000","last_change":"2024-09-12T17:42:27.560570+0000","last_active":"2024-09-12T17:42:27.560570+0000","last_peered":"2024-09-12T17:42:27.560570+0000","last_clean":"2024-09-12T17:42:27.560570+0000","last_became_active":"2024-09-12T17:27:17.409774+0000","last_became_peered":"2024-09-12T17:27:17.409774+0000","last_unstale":"2024-09-12T17:42:27.560570+0000","last_undegraded":"2024-09-12T17:42:27.560570+0000","last_fullsized":"2024-09-12T17:42:27.560570+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:27.560347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:27.560347+0000","last_clean_scrub_stamp":"2024-09-12T17:42:27.560347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:34.481687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:22.581013+0000","last_change":"2024-09-12T17:42:22.581013+0000","last_active":"2024-09-12T17:42:22.581013+0000","last_peered":"2024-09-12T17:42:22.581013+0000","last_clean":"2024-09-12T17:42:22.581013+0000","last_became_active":"2024-09-12T17:15:43.167221+0000","last_became_peered":"2024-09-12T17:15:43.167221+0000","last_unstale":"2024-09-12T17:42:22.581013+0000","last_undegraded":"2024-09-12T17:42:22.581013+0000","last_fullsized":"2024-09-12T17:42:22.581013+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:22.580814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:22.580814+0000","last_clean_scrub_stamp":"2024-09-12T17:42:22.580814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:30:24.154414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"262'5","reported_seq":60,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:20.707577+0000","last_change":"2024-09-12T17:42:20.707577+0000","last_active":"2024-09-12T17:42:20.707577+0000","last_peered":"2024-09-12T17:42:20.707577+0000","last_clean":"2024-09-12T17:42:20.707577+0000","last_became_active":"2024-09-12T17:15:40.131162+0000","last_became_peered":"2024-09-12T17:15:40.131162+0000","last_unstale":"2024-09-12T17:42:20.707577+0000","last_undegraded":"2024-09-12T17:42:20.707577+0000","last_fullsized":"2024-09-12T17:42:20.707577+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T17:42:20.707379+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T17:42:20.707379+0000","last_clean_scrub_stamp":"2024-09-12T17:42:20.707379+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:33.838322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"265'229","reported_seq":772,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:07.444406+0000","last_change":"2024-09-12T17:42:07.444406+0000","last_active":"2024-09-12T17:42:07.444406+0000","last_peered":"2024-09-12T17:42:07.444406+0000","last_clean":"2024-09-12T17:42:07.444406+0000","last_became_active":"2024-09-12T17:13:54.824372+0000","last_became_peered":"2024-09-12T17:13:54.824372+0000","last_unstale":"2024-09-12T17:42:07.444406+0000","last_undegraded":"2024-09-12T17:42:07.444406+0000","last_fullsized":"2024-09-12T17:42:07.444406+0000","mapping_epoch":252,"log_start":"262'200","ondisk_log_start":"262'200","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'229","last_scrub_stamp":"2024-09-12T17:42:07.444210+0000","last_deep_scrub":"265'229","last_deep_scrub_stamp":"2024-09-12T17:42:07.444210+0000","last_clean_scrub_stamp":"2024-09-12T17:42:07.444210+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:01.339439+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1417,"num_read_kb":1102,"num_write":261,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4473,"num_omap_keys":9,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"265'2","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:07.648286+0000","last_change":"2024-09-12T17:42:07.648128+0000","last_active":"2024-09-12T17:42:07.648286+0000","last_peered":"2024-09-12T17:42:07.648286+0000","last_clean":"2024-09-12T17:42:07.648286+0000","last_became_active":"2024-09-12T17:27:17.404001+0000","last_became_peered":"2024-09-12T17:27:17.404001+0000","last_unstale":"2024-09-12T17:42:07.648286+0000","last_undegraded":"2024-09-12T17:42:07.648286+0000","last_fullsized":"2024-09-12T17:42:07.648286+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T17:42:07.647942+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T17:42:07.647942+0000","last_clean_scrub_stamp":"2024-09-12T17:42:07.647942+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:29.596236+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:13.486876+0000","last_change":"2024-09-12T17:42:13.486876+0000","last_active":"2024-09-12T17:42:13.486876+0000","last_peered":"2024-09-12T17:42:13.486876+0000","last_clean":"2024-09-12T17:42:13.486876+0000","last_became_active":"2024-09-12T17:15:43.159256+0000","last_became_peered":"2024-09-12T17:15:43.159256+0000","last_unstale":"2024-09-12T17:42:13.486876+0000","last_undegraded":"2024-09-12T17:42:13.486876+0000","last_fullsized":"2024-09-12T17:42:13.486876+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:13.486634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:13.486634+0000","last_clean_scrub_stamp":"2024-09-12T17:42:13.486634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:56.304484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"265'2","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:19.705186+0000","last_change":"2024-09-12T17:42:19.705186+0000","last_active":"2024-09-12T17:42:19.705186+0000","last_peered":"2024-09-12T17:42:19.705186+0000","last_clean":"2024-09-12T17:42:19.705186+0000","last_became_active":"2024-09-12T17:15:40.138844+0000","last_became_peered":"2024-09-12T17:15:40.138844+0000","last_unstale":"2024-09-12T17:42:19.705186+0000","last_undegraded":"2024-09-12T17:42:19.705186+0000","last_fullsized":"2024-09-12T17:42:19.705186+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T17:42:19.705002+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T17:42:19.705002+0000","last_clean_scrub_stamp":"2024-09-12T17:42:19.705002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:12.317463+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"265'38","reported_seq":156,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:16.620946+0000","last_change":"2024-09-12T17:42:16.620946+0000","last_active":"2024-09-12T17:42:16.620946+0000","last_peered":"2024-09-12T17:42:16.620946+0000","last_clean":"2024-09-12T17:42:16.620946+0000","last_became_active":"2024-09-12T17:13:54.830999+0000","last_became_peered":"2024-09-12T17:13:54.830999+0000","last_unstale":"2024-09-12T17:42:16.620946+0000","last_undegraded":"2024-09-12T17:42:16.620946+0000","last_fullsized":"2024-09-12T17:42:16.620946+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'38","last_scrub_stamp":"2024-09-12T17:42:16.620766+0000","last_deep_scrub":"265'38","last_deep_scrub_stamp":"2024-09-12T17:42:16.620766+0000","last_clean_scrub_stamp":"2024-09-12T17:42:16.620766+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:21.210400+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":129,"num_write":64,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:32.875755+0000","last_change":"2024-09-12T17:42:32.875755+0000","last_active":"2024-09-12T17:42:32.875755+0000","last_peered":"2024-09-12T17:42:32.875755+0000","last_clean":"2024-09-12T17:42:32.875755+0000","last_became_active":"2024-09-12T17:27:17.412921+0000","last_became_peered":"2024-09-12T17:27:17.412921+0000","last_unstale":"2024-09-12T17:42:32.875755+0000","last_undegraded":"2024-09-12T17:42:32.875755+0000","last_fullsized":"2024-09-12T17:42:32.875755+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:32.875570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:32.875570+0000","last_clean_scrub_stamp":"2024-09-12T17:42:32.875570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:31.677110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"265'4","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:21.649266+0000","last_change":"2024-09-12T17:42:21.649266+0000","last_active":"2024-09-12T17:42:21.649266+0000","last_peered":"2024-09-12T17:42:21.649266+0000","last_clean":"2024-09-12T17:42:21.649266+0000","last_became_active":"2024-09-12T17:15:43.154940+0000","last_became_peered":"2024-09-12T17:15:43.154940+0000","last_unstale":"2024-09-12T17:42:21.649266+0000","last_undegraded":"2024-09-12T17:42:21.649266+0000","last_fullsized":"2024-09-12T17:42:21.649266+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T17:42:21.649077+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T17:42:21.649077+0000","last_clean_scrub_stamp":"2024-09-12T17:42:21.649077+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:29.594849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:18.695221+0000","last_change":"2024-09-12T17:42:18.695221+0000","last_active":"2024-09-12T17:42:18.695221+0000","last_peered":"2024-09-12T17:42:18.695221+0000","last_clean":"2024-09-12T17:42:18.695221+0000","last_became_active":"2024-09-12T17:15:40.126745+0000","last_became_peered":"2024-09-12T17:15:40.126745+0000","last_unstale":"2024-09-12T17:42:18.695221+0000","last_undegraded":"2024-09-12T17:42:18.695221+0000","last_fullsized":"2024-09-12T17:42:18.695221+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:18.695035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:18.695035+0000","last_clean_scrub_stamp":"2024-09-12T17:42:18.695035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:20.019015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"265'14","reported_seq":94,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:19.618475+0000","last_change":"2024-09-12T17:42:19.618475+0000","last_active":"2024-09-12T17:42:19.618475+0000","last_peered":"2024-09-12T17:42:19.618475+0000","last_clean":"2024-09-12T17:42:19.618475+0000","last_became_active":"2024-09-12T17:13:54.840501+0000","last_became_peered":"2024-09-12T17:13:54.840501+0000","last_unstale":"2024-09-12T17:42:19.618475+0000","last_undegraded":"2024-09-12T17:42:19.618475+0000","last_fullsized":"2024-09-12T17:42:19.618475+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'14","last_scrub_stamp":"2024-09-12T17:42:19.618278+0000","last_deep_scrub":"265'14","last_deep_scrub_stamp":"2024-09-12T17:42:19.618278+0000","last_clean_scrub_stamp":"2024-09-12T17:42:19.618278+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:04.285683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":51,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:31.887001+0000","last_change":"2024-09-12T17:42:31.887001+0000","last_active":"2024-09-12T17:42:31.887001+0000","last_peered":"2024-09-12T17:42:31.887001+0000","last_clean":"2024-09-12T17:42:31.887001+0000","last_became_active":"2024-09-12T17:27:17.421504+0000","last_became_peered":"2024-09-12T17:27:17.421504+0000","last_unstale":"2024-09-12T17:42:31.887001+0000","last_undegraded":"2024-09-12T17:42:31.887001+0000","last_fullsized":"2024-09-12T17:42:31.887001+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:31.886797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:31.886797+0000","last_clean_scrub_stamp":"2024-09-12T17:42:31.886797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:14.106354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"265'3","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:12.364437+0000","last_change":"2024-09-12T17:42:12.364437+0000","last_active":"2024-09-12T17:42:12.364437+0000","last_peered":"2024-09-12T17:42:12.364437+0000","last_clean":"2024-09-12T17:42:12.364437+0000","last_became_active":"2024-09-12T17:15:43.162406+0000","last_became_peered":"2024-09-12T17:15:43.162406+0000","last_unstale":"2024-09-12T17:42:12.364437+0000","last_undegraded":"2024-09-12T17:42:12.364437+0000","last_fullsized":"2024-09-12T17:42:12.364437+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T17:42:12.364241+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T17:42:12.364241+0000","last_clean_scrub_stamp":"2024-09-12T17:42:12.364241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:18.772651+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"265'11","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:09.531921+0000","last_change":"2024-09-12T17:42:09.531921+0000","last_active":"2024-09-12T17:42:09.531921+0000","last_peered":"2024-09-12T17:42:09.531921+0000","last_clean":"2024-09-12T17:42:09.531921+0000","last_became_active":"2024-09-12T17:15:40.115746+0000","last_became_peered":"2024-09-12T17:15:40.115746+0000","last_unstale":"2024-09-12T17:42:09.531921+0000","last_undegraded":"2024-09-12T17:42:09.531921+0000","last_fullsized":"2024-09-12T17:42:09.531921+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'11","last_scrub_stamp":"2024-09-12T17:42:09.531744+0000","last_deep_scrub":"265'11","last_deep_scrub_stamp":"2024-09-12T17:42:09.531744+0000","last_clean_scrub_stamp":"2024-09-12T17:42:09.531744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:01.984539+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12288,"num_write":16,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"265'17","reported_seq":104,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:07.413545+0000","last_change":"2024-09-12T17:42:07.413545+0000","last_active":"2024-09-12T17:42:07.413545+0000","last_peered":"2024-09-12T17:42:07.413545+0000","last_clean":"2024-09-12T17:42:07.413545+0000","last_became_active":"2024-09-12T17:13:54.838008+0000","last_became_peered":"2024-09-12T17:13:54.838008+0000","last_unstale":"2024-09-12T17:42:07.413545+0000","last_undegraded":"2024-09-12T17:42:07.413545+0000","last_fullsized":"2024-09-12T17:42:07.413545+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'17","last_scrub_stamp":"2024-09-12T17:42:07.413371+0000","last_deep_scrub":"265'17","last_deep_scrub_stamp":"2024-09-12T17:42:07.413371+0000","last_clean_scrub_stamp":"2024-09-12T17:42:07.413371+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:32.085492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":61,"num_write":32,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:29.860840+0000","last_change":"2024-09-12T17:42:29.860840+0000","last_active":"2024-09-12T17:42:29.860840+0000","last_peered":"2024-09-12T17:42:29.860840+0000","last_clean":"2024-09-12T17:42:29.860840+0000","last_became_active":"2024-09-12T17:27:17.408296+0000","last_became_peered":"2024-09-12T17:27:17.408296+0000","last_unstale":"2024-09-12T17:42:29.860840+0000","last_undegraded":"2024-09-12T17:42:29.860840+0000","last_fullsized":"2024-09-12T17:42:29.860840+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:29.860656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:29.860656+0000","last_clean_scrub_stamp":"2024-09-12T17:42:29.860656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:41.835129+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"265'6","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:23.615622+0000","last_change":"2024-09-12T17:42:23.615622+0000","last_active":"2024-09-12T17:42:23.615622+0000","last_peered":"2024-09-12T17:42:23.615622+0000","last_clean":"2024-09-12T17:42:23.615622+0000","last_became_active":"2024-09-12T17:15:43.163824+0000","last_became_peered":"2024-09-12T17:15:43.163824+0000","last_unstale":"2024-09-12T17:42:23.615622+0000","last_undegraded":"2024-09-12T17:42:23.615622+0000","last_fullsized":"2024-09-12T17:42:23.615622+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T17:42:23.615435+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T17:42:23.615435+0000","last_clean_scrub_stamp":"2024-09-12T17:42:23.615435+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:04.108730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5122,"num_write":6,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:09.367288+0000","last_change":"2024-09-12T17:42:09.367288+0000","last_active":"2024-09-12T17:42:09.367288+0000","last_peered":"2024-09-12T17:42:09.367288+0000","last_clean":"2024-09-12T17:42:09.367288+0000","last_became_active":"2024-09-12T17:15:40.114860+0000","last_became_peered":"2024-09-12T17:15:40.114860+0000","last_unstale":"2024-09-12T17:42:09.367288+0000","last_undegraded":"2024-09-12T17:42:09.367288+0000","last_fullsized":"2024-09-12T17:42:09.367288+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:09.367097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:09.367097+0000","last_clean_scrub_stamp":"2024-09-12T17:42:09.367097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:54.058677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"265'55","reported_seq":206,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:14.711159+0000","last_change":"2024-09-12T17:42:14.711159+0000","last_active":"2024-09-12T17:42:14.711159+0000","last_peered":"2024-09-12T17:42:14.711159+0000","last_clean":"2024-09-12T17:42:14.711159+0000","last_became_active":"2024-09-12T17:13:54.832949+0000","last_became_peered":"2024-09-12T17:13:54.832949+0000","last_unstale":"2024-09-12T17:42:14.711159+0000","last_undegraded":"2024-09-12T17:42:14.711159+0000","last_fullsized":"2024-09-12T17:42:14.711159+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'55","last_scrub_stamp":"2024-09-12T17:42:14.710966+0000","last_deep_scrub":"265'55","last_deep_scrub_stamp":"2024-09-12T17:42:14.710966+0000","last_clean_scrub_stamp":"2024-09-12T17:42:14.710966+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:59.222600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":283,"num_read_kb":200,"num_write":95,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"265'393","reported_seq":1093,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:49.548806+0000","last_change":"2024-09-12T17:41:49.548572+0000","last_active":"2024-09-12T17:41:49.548806+0000","last_peered":"2024-09-12T17:41:49.548806+0000","last_clean":"2024-09-12T17:41:49.548806+0000","last_became_active":"2024-09-12T16:58:18.713754+0000","last_became_peered":"2024-09-12T16:58:18.713754+0000","last_unstale":"2024-09-12T17:41:49.548806+0000","last_undegraded":"2024-09-12T17:41:49.548806+0000","last_fullsized":"2024-09-12T17:41:49.548806+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'393","last_scrub_stamp":"2024-09-12T17:41:49.548319+0000","last_deep_scrub":"265'393","last_deep_scrub_stamp":"2024-09-12T17:41:49.548319+0000","last_clean_scrub_stamp":"2024-09-12T17:41:49.548319+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:37.288699+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":207329,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":632,"num_read_kb":52184,"num_write":1250,"num_write_kb":52679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"265'127","reported_seq":734,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:57.590054+0000","last_change":"2024-09-12T17:41:57.590054+0000","last_active":"2024-09-12T17:41:57.590054+0000","last_peered":"2024-09-12T17:41:57.590054+0000","last_clean":"2024-09-12T17:41:57.590054+0000","last_became_active":"2024-09-12T16:58:21.708409+0000","last_became_peered":"2024-09-12T16:58:21.708409+0000","last_unstale":"2024-09-12T17:41:57.590054+0000","last_undegraded":"2024-09-12T17:41:57.590054+0000","last_fullsized":"2024-09-12T17:41:57.590054+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'127","last_scrub_stamp":"2024-09-12T17:41:57.589826+0000","last_deep_scrub":"265'127","last_deep_scrub_stamp":"2024-09-12T17:41:57.589826+0000","last_clean_scrub_stamp":"2024-09-12T17:41:57.589826+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:20.676074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":568,"num_read_kb":472,"num_write":186,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"265'363","reported_seq":997,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:45.351273+0000","last_change":"2024-09-12T17:41:45.351133+0000","last_active":"2024-09-12T17:41:45.351273+0000","last_peered":"2024-09-12T17:41:45.351273+0000","last_clean":"2024-09-12T17:41:45.351273+0000","last_became_active":"2024-09-12T16:58:18.699994+0000","last_became_peered":"2024-09-12T16:58:18.699994+0000","last_unstale":"2024-09-12T17:41:45.351273+0000","last_undegraded":"2024-09-12T17:41:45.351273+0000","last_fullsized":"2024-09-12T17:41:45.351273+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'363","last_scrub_stamp":"2024-09-12T17:41:45.350930+0000","last_deep_scrub":"265'363","last_deep_scrub_stamp":"2024-09-12T17:41:45.350930+0000","last_clean_scrub_stamp":"2024-09-12T17:41:45.350930+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:17.973292+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263228,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":513,"num_read_kb":14780,"num_write":1119,"num_write_kb":32109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"265'61","reported_seq":648,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:56.670046+0000","last_change":"2024-09-12T17:41:56.670046+0000","last_active":"2024-09-12T17:41:56.670046+0000","last_peered":"2024-09-12T17:41:56.670046+0000","last_clean":"2024-09-12T17:41:56.670046+0000","last_became_active":"2024-09-12T16:58:21.721536+0000","last_became_peered":"2024-09-12T16:58:21.721536+0000","last_unstale":"2024-09-12T17:41:56.670046+0000","last_undegraded":"2024-09-12T17:41:56.670046+0000","last_fullsized":"2024-09-12T17:41:56.670046+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'61","last_scrub_stamp":"2024-09-12T17:41:56.669852+0000","last_deep_scrub":"265'61","last_deep_scrub_stamp":"2024-09-12T17:41:56.669852+0000","last_clean_scrub_stamp":"2024-09-12T17:41:56.669852+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:36.236526+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":297,"num_read_kb":264,"num_write":81,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"265'426","reported_seq":1242,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:48.141322+0000","last_change":"2024-09-12T17:41:48.141167+0000","last_active":"2024-09-12T17:41:48.141322+0000","last_peered":"2024-09-12T17:41:48.141322+0000","last_clean":"2024-09-12T17:41:48.141322+0000","last_became_active":"2024-09-12T16:58:18.687865+0000","last_became_peered":"2024-09-12T16:58:18.687865+0000","last_unstale":"2024-09-12T17:41:48.141322+0000","last_undegraded":"2024-09-12T17:41:48.141322+0000","last_fullsized":"2024-09-12T17:41:48.141322+0000","mapping_epoch":23,"log_start":"265'400","ondisk_log_start":"265'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'426","last_scrub_stamp":"2024-09-12T17:41:48.140932+0000","last_deep_scrub":"265'426","last_deep_scrub_stamp":"2024-09-12T17:41:48.140932+0000","last_clean_scrub_stamp":"2024-09-12T17:41:48.140932+0000","objects_scrubbed":9,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:06.456200+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263210,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1063,"num_read_kb":27565,"num_write":1556,"num_write_kb":41677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"265'166","reported_seq":768,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:55.642706+0000","last_change":"2024-09-12T17:41:55.642706+0000","last_active":"2024-09-12T17:41:55.642706+0000","last_peered":"2024-09-12T17:41:55.642706+0000","last_clean":"2024-09-12T17:41:55.642706+0000","last_became_active":"2024-09-12T16:58:21.703861+0000","last_became_peered":"2024-09-12T16:58:21.703861+0000","last_unstale":"2024-09-12T17:41:55.642706+0000","last_undegraded":"2024-09-12T17:41:55.642706+0000","last_fullsized":"2024-09-12T17:41:55.642706+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'166","last_scrub_stamp":"2024-09-12T17:41:55.642509+0000","last_deep_scrub":"265'166","last_deep_scrub_stamp":"2024-09-12T17:41:55.642509+0000","last_clean_scrub_stamp":"2024-09-12T17:41:55.642509+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:44.318567+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":693,"num_read_kb":563,"num_write":272,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"265'374","reported_seq":1036,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:51.657360+0000","last_change":"2024-09-12T17:41:51.657131+0000","last_active":"2024-09-12T17:41:51.657360+0000","last_peered":"2024-09-12T17:41:51.657360+0000","last_clean":"2024-09-12T17:41:51.657360+0000","last_became_active":"2024-09-12T16:58:18.716783+0000","last_became_peered":"2024-09-12T16:58:18.716783+0000","last_unstale":"2024-09-12T17:41:51.657360+0000","last_undegraded":"2024-09-12T17:41:51.657360+0000","last_fullsized":"2024-09-12T17:41:51.657360+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'374","last_scrub_stamp":"2024-09-12T17:41:51.656864+0000","last_deep_scrub":"265'374","last_deep_scrub_stamp":"2024-09-12T17:41:51.656864+0000","last_clean_scrub_stamp":"2024-09-12T17:41:51.656864+0000","objects_scrubbed":7,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:26.088285+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":698119,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":542,"num_read_kb":33905,"num_write":1205,"num_write_kb":31442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"265'207","reported_seq":817,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:54.056910+0000","last_change":"2024-09-12T17:41:54.056910+0000","last_active":"2024-09-12T17:41:54.056910+0000","last_peered":"2024-09-12T17:41:54.056910+0000","last_clean":"2024-09-12T17:41:54.056910+0000","last_became_active":"2024-09-12T16:58:21.699869+0000","last_became_peered":"2024-09-12T16:58:21.699869+0000","last_unstale":"2024-09-12T17:41:54.056910+0000","last_undegraded":"2024-09-12T17:41:54.056910+0000","last_fullsized":"2024-09-12T17:41:54.056910+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'207","last_scrub_stamp":"2024-09-12T17:41:54.056679+0000","last_deep_scrub":"265'207","last_deep_scrub_stamp":"2024-09-12T17:41:54.056679+0000","last_clean_scrub_stamp":"2024-09-12T17:41:54.056679+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:21.954587+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":874,"num_read_kb":727,"num_write":307,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"265'359","reported_seq":1031,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:50.584607+0000","last_change":"2024-09-12T17:41:50.584607+0000","last_active":"2024-09-12T17:41:50.584607+0000","last_peered":"2024-09-12T17:41:50.584607+0000","last_clean":"2024-09-12T17:41:50.584607+0000","last_became_active":"2024-09-12T16:58:18.688345+0000","last_became_peered":"2024-09-12T16:58:18.688345+0000","last_unstale":"2024-09-12T17:41:50.584607+0000","last_undegraded":"2024-09-12T17:41:50.584607+0000","last_fullsized":"2024-09-12T17:41:50.584607+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'359","last_scrub_stamp":"2024-09-12T17:41:50.584401+0000","last_deep_scrub":"265'359","last_deep_scrub_stamp":"2024-09-12T17:41:50.584401+0000","last_clean_scrub_stamp":"2024-09-12T17:41:50.584401+0000","objects_scrubbed":7,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:59.917375+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263227,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":585,"num_read_kb":27999,"num_write":1129,"num_write_kb":20285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"265'277","reported_seq":929,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:51.482677+0000","last_change":"2024-09-12T17:41:51.482503+0000","last_active":"2024-09-12T17:41:51.482677+0000","last_peered":"2024-09-12T17:41:51.482677+0000","last_clean":"2024-09-12T17:41:51.482677+0000","last_became_active":"2024-09-12T16:58:21.709879+0000","last_became_peered":"2024-09-12T16:58:21.709879+0000","last_unstale":"2024-09-12T17:41:51.482677+0000","last_undegraded":"2024-09-12T17:41:51.482677+0000","last_fullsized":"2024-09-12T17:41:51.482677+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'277","last_scrub_stamp":"2024-09-12T17:41:51.482314+0000","last_deep_scrub":"265'277","last_deep_scrub_stamp":"2024-09-12T17:41:51.482314+0000","last_clean_scrub_stamp":"2024-09-12T17:41:51.482314+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:57.714571+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1330,"num_read_kb":1122,"num_write":481,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"265'397","reported_seq":1054,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:49.610921+0000","last_change":"2024-09-12T17:41:49.610921+0000","last_active":"2024-09-12T17:41:49.610921+0000","last_peered":"2024-09-12T17:41:49.610921+0000","last_clean":"2024-09-12T17:41:49.610921+0000","last_became_active":"2024-09-12T16:58:18.698280+0000","last_became_peered":"2024-09-12T16:58:18.698280+0000","last_unstale":"2024-09-12T17:41:49.610921+0000","last_undegraded":"2024-09-12T17:41:49.610921+0000","last_fullsized":"2024-09-12T17:41:49.610921+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'397","last_scrub_stamp":"2024-09-12T17:41:49.610656+0000","last_deep_scrub":"265'397","last_deep_scrub_stamp":"2024-09-12T17:41:49.610656+0000","last_clean_scrub_stamp":"2024-09-12T17:41:49.610656+0000","objects_scrubbed":11,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:39.785159+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8651850,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":594,"num_read_kb":25091,"num_write":1290,"num_write_kb":36260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"265'157","reported_seq":769,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:58.628960+0000","last_change":"2024-09-12T17:41:58.628784+0000","last_active":"2024-09-12T17:41:58.628960+0000","last_peered":"2024-09-12T17:41:58.628960+0000","last_clean":"2024-09-12T17:41:58.628960+0000","last_became_active":"2024-09-12T16:58:21.706493+0000","last_became_peered":"2024-09-12T16:58:21.706493+0000","last_unstale":"2024-09-12T17:41:58.628960+0000","last_undegraded":"2024-09-12T17:41:58.628960+0000","last_fullsized":"2024-09-12T17:41:58.628960+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'157","last_scrub_stamp":"2024-09-12T17:41:58.628606+0000","last_deep_scrub":"265'157","last_deep_scrub_stamp":"2024-09-12T17:41:58.628606+0000","last_clean_scrub_stamp":"2024-09-12T17:41:58.628606+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:25.437543+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":697,"num_read_kb":578,"num_write":245,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"265'335","reported_seq":1001,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:53.613886+0000","last_change":"2024-09-12T17:41:53.613886+0000","last_active":"2024-09-12T17:41:53.613886+0000","last_peered":"2024-09-12T17:41:53.613886+0000","last_clean":"2024-09-12T17:41:53.613886+0000","last_became_active":"2024-09-12T16:58:18.694357+0000","last_became_peered":"2024-09-12T16:58:18.694357+0000","last_unstale":"2024-09-12T17:41:53.613886+0000","last_undegraded":"2024-09-12T17:41:53.613886+0000","last_fullsized":"2024-09-12T17:41:53.613886+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'335","last_scrub_stamp":"2024-09-12T17:41:53.613673+0000","last_deep_scrub":"265'335","last_deep_scrub_stamp":"2024-09-12T17:41:53.613673+0000","last_clean_scrub_stamp":"2024-09-12T17:41:53.613673+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:18.786062+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":485,"num_read_kb":76108,"num_write":1068,"num_write_kb":48403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"265'76","reported_seq":662,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:58.572144+0000","last_change":"2024-09-12T17:41:58.571844+0000","last_active":"2024-09-12T17:41:58.572144+0000","last_peered":"2024-09-12T17:41:58.572144+0000","last_clean":"2024-09-12T17:41:58.572144+0000","last_became_active":"2024-09-12T16:58:21.723077+0000","last_became_peered":"2024-09-12T16:58:21.723077+0000","last_unstale":"2024-09-12T17:41:58.572144+0000","last_undegraded":"2024-09-12T17:41:58.572144+0000","last_fullsized":"2024-09-12T17:41:58.572144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'76","last_scrub_stamp":"2024-09-12T17:41:58.571628+0000","last_deep_scrub":"265'76","last_deep_scrub_stamp":"2024-09-12T17:41:58.571628+0000","last_clean_scrub_stamp":"2024-09-12T17:41:58.571628+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:40.655917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":363,"num_read_kb":315,"num_write":111,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"265'311","reported_seq":928,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:44.698572+0000","last_change":"2024-09-12T17:41:44.698572+0000","last_active":"2024-09-12T17:41:44.698572+0000","last_peered":"2024-09-12T17:41:44.698572+0000","last_clean":"2024-09-12T17:41:44.698572+0000","last_became_active":"2024-09-12T16:58:18.701590+0000","last_became_peered":"2024-09-12T16:58:18.701590+0000","last_unstale":"2024-09-12T17:41:44.698572+0000","last_undegraded":"2024-09-12T17:41:44.698572+0000","last_fullsized":"2024-09-12T17:41:44.698572+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'311","last_scrub_stamp":"2024-09-12T17:41:44.698375+0000","last_deep_scrub":"265'311","last_deep_scrub_stamp":"2024-09-12T17:41:44.698375+0000","last_clean_scrub_stamp":"2024-09-12T17:41:44.698375+0000","objects_scrubbed":6,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:04.975023+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":399,"num_read_kb":1374,"num_write":924,"num_write_kb":18073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"265'138","reported_seq":748,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:46.474613+0000","last_change":"2024-09-12T17:41:46.474441+0000","last_active":"2024-09-12T17:41:46.474613+0000","last_peered":"2024-09-12T17:41:46.474613+0000","last_clean":"2024-09-12T17:41:46.474613+0000","last_became_active":"2024-09-12T16:58:21.718167+0000","last_became_peered":"2024-09-12T16:58:21.718167+0000","last_unstale":"2024-09-12T17:41:46.474613+0000","last_undegraded":"2024-09-12T17:41:46.474613+0000","last_fullsized":"2024-09-12T17:41:46.474613+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'138","last_scrub_stamp":"2024-09-12T17:41:46.474256+0000","last_deep_scrub":"265'138","last_deep_scrub_stamp":"2024-09-12T17:41:46.474256+0000","last_clean_scrub_stamp":"2024-09-12T17:41:46.474256+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:54.299670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":612,"num_read_kb":510,"num_write":201,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"265'4235","reported_seq":4893,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:56.655702+0000","last_change":"2024-09-12T17:41:56.655702+0000","last_active":"2024-09-12T17:41:56.655702+0000","last_peered":"2024-09-12T17:41:56.655702+0000","last_clean":"2024-09-12T17:41:56.655702+0000","last_became_active":"2024-09-12T16:58:21.697479+0000","last_became_peered":"2024-09-12T16:58:21.697479+0000","last_unstale":"2024-09-12T17:41:56.655702+0000","last_undegraded":"2024-09-12T17:41:56.655702+0000","last_fullsized":"2024-09-12T17:41:56.655702+0000","mapping_epoch":26,"log_start":"265'4200","ondisk_log_start":"265'4200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4235","last_scrub_stamp":"2024-09-12T17:41:56.655505+0000","last_deep_scrub":"265'4235","last_deep_scrub_stamp":"2024-09-12T17:41:56.655505+0000","last_clean_scrub_stamp":"2024-09-12T17:41:56.655505+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":3000,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:42.994552+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17044,"num_read_kb":14289,"num_write":6359,"num_write_kb":3183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"265'324","reported_seq":957,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:46.504232+0000","last_change":"2024-09-12T17:41:46.504070+0000","last_active":"2024-09-12T17:41:46.504232+0000","last_peered":"2024-09-12T17:41:46.504232+0000","last_clean":"2024-09-12T17:41:46.504232+0000","last_became_active":"2024-09-12T16:58:18.713739+0000","last_became_peered":"2024-09-12T16:58:18.713739+0000","last_unstale":"2024-09-12T17:41:46.504232+0000","last_undegraded":"2024-09-12T17:41:46.504232+0000","last_fullsized":"2024-09-12T17:41:46.504232+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'324","last_scrub_stamp":"2024-09-12T17:41:46.503833+0000","last_deep_scrub":"265'324","last_deep_scrub_stamp":"2024-09-12T17:41:46.503833+0000","last_clean_scrub_stamp":"2024-09-12T17:41:46.503833+0000","objects_scrubbed":7,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:49.063988+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":436,"num_read_kb":10222,"num_write":964,"num_write_kb":31220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"265'294","reported_seq":1014,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:55.651444+0000","last_change":"2024-09-12T17:41:55.651444+0000","last_active":"2024-09-12T17:41:55.651444+0000","last_peered":"2024-09-12T17:41:55.651444+0000","last_clean":"2024-09-12T17:41:55.651444+0000","last_became_active":"2024-09-12T16:58:21.723238+0000","last_became_peered":"2024-09-12T16:58:21.723238+0000","last_unstale":"2024-09-12T17:41:55.651444+0000","last_undegraded":"2024-09-12T17:41:55.651444+0000","last_fullsized":"2024-09-12T17:41:55.651444+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'294","last_scrub_stamp":"2024-09-12T17:41:55.651276+0000","last_deep_scrub":"265'294","last_deep_scrub_stamp":"2024-09-12T17:41:55.651276+0000","last_clean_scrub_stamp":"2024-09-12T17:41:55.651276+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:24.004372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1552,"num_read_kb":1372,"num_write":472,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"265'347","reported_seq":968,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:50.456694+0000","last_change":"2024-09-12T17:41:50.456526+0000","last_active":"2024-09-12T17:41:50.456694+0000","last_peered":"2024-09-12T17:41:50.456694+0000","last_clean":"2024-09-12T17:41:50.456694+0000","last_became_active":"2024-09-12T16:58:18.701989+0000","last_became_peered":"2024-09-12T16:58:18.701989+0000","last_unstale":"2024-09-12T17:41:50.456694+0000","last_undegraded":"2024-09-12T17:41:50.456694+0000","last_fullsized":"2024-09-12T17:41:50.456694+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'347","last_scrub_stamp":"2024-09-12T17:41:50.456302+0000","last_deep_scrub":"265'347","last_deep_scrub_stamp":"2024-09-12T17:41:50.456302+0000","last_clean_scrub_stamp":"2024-09-12T17:41:50.456302+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:22.993882+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1343103,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":443,"num_read_kb":5557,"num_write":1028,"num_write_kb":22464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"265'183","reported_seq":799,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:55.659451+0000","last_change":"2024-09-12T17:41:55.659451+0000","last_active":"2024-09-12T17:41:55.659451+0000","last_peered":"2024-09-12T17:41:55.659451+0000","last_clean":"2024-09-12T17:41:55.659451+0000","last_became_active":"2024-09-12T16:58:21.715289+0000","last_became_peered":"2024-09-12T16:58:21.715289+0000","last_unstale":"2024-09-12T17:41:55.659451+0000","last_undegraded":"2024-09-12T17:41:55.659451+0000","last_fullsized":"2024-09-12T17:41:55.659451+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'183","last_scrub_stamp":"2024-09-12T17:41:55.659266+0000","last_deep_scrub":"265'183","last_deep_scrub_stamp":"2024-09-12T17:41:55.659266+0000","last_clean_scrub_stamp":"2024-09-12T17:41:55.659266+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:00.448540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":782,"num_read_kb":649,"num_write":263,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"265'373","reported_seq":1055,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:44.497882+0000","last_change":"2024-09-12T17:41:44.497703+0000","last_active":"2024-09-12T17:41:44.497882+0000","last_peered":"2024-09-12T17:41:44.497882+0000","last_clean":"2024-09-12T17:41:44.497882+0000","last_became_active":"2024-09-12T16:58:18.702185+0000","last_became_peered":"2024-09-12T16:58:18.702185+0000","last_unstale":"2024-09-12T17:41:44.497882+0000","last_undegraded":"2024-09-12T17:41:44.497882+0000","last_fullsized":"2024-09-12T17:41:44.497882+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'373","last_scrub_stamp":"2024-09-12T17:41:44.497473+0000","last_deep_scrub":"265'373","last_deep_scrub_stamp":"2024-09-12T17:41:44.497473+0000","last_clean_scrub_stamp":"2024-09-12T17:41:44.497473+0000","objects_scrubbed":3,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:41.714848+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306656,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":591,"num_read_kb":49223,"num_write":1212,"num_write_kb":37016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"265'189","reported_seq":830,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:44.508406+0000","last_change":"2024-09-12T17:41:44.508120+0000","last_active":"2024-09-12T17:41:44.508406+0000","last_peered":"2024-09-12T17:41:44.508406+0000","last_clean":"2024-09-12T17:41:44.508406+0000","last_became_active":"2024-09-12T16:58:21.718158+0000","last_became_peered":"2024-09-12T16:58:21.718158+0000","last_unstale":"2024-09-12T17:41:44.508406+0000","last_undegraded":"2024-09-12T17:41:44.508406+0000","last_fullsized":"2024-09-12T17:41:44.508406+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'189","last_scrub_stamp":"2024-09-12T17:41:44.507884+0000","last_deep_scrub":"265'189","last_deep_scrub_stamp":"2024-09-12T17:41:44.507884+0000","last_clean_scrub_stamp":"2024-09-12T17:41:44.507884+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:21.650280+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":878,"num_read_kb":727,"num_write":304,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"265'358","reported_seq":1104,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:42.627771+0000","last_change":"2024-09-12T17:41:42.627593+0000","last_active":"2024-09-12T17:41:42.627771+0000","last_peered":"2024-09-12T17:41:42.627771+0000","last_clean":"2024-09-12T17:41:42.627771+0000","last_became_active":"2024-09-12T16:58:18.699360+0000","last_became_peered":"2024-09-12T16:58:18.699360+0000","last_unstale":"2024-09-12T17:41:42.627771+0000","last_undegraded":"2024-09-12T17:41:42.627771+0000","last_fullsized":"2024-09-12T17:41:42.627771+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'358","last_scrub_stamp":"2024-09-12T17:41:42.627381+0000","last_deep_scrub":"265'358","last_deep_scrub_stamp":"2024-09-12T17:41:42.627381+0000","last_clean_scrub_stamp":"2024-09-12T17:41:42.627381+0000","objects_scrubbed":5,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:07.285273+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":626,"num_read_kb":143204,"num_write":1063,"num_write_kb":36082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"265'136","reported_seq":774,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:51.542065+0000","last_change":"2024-09-12T17:41:51.541908+0000","last_active":"2024-09-12T17:41:51.542065+0000","last_peered":"2024-09-12T17:41:51.542065+0000","last_clean":"2024-09-12T17:41:51.542065+0000","last_became_active":"2024-09-12T16:58:21.728321+0000","last_became_peered":"2024-09-12T16:58:21.728321+0000","last_unstale":"2024-09-12T17:41:51.542065+0000","last_undegraded":"2024-09-12T17:41:51.542065+0000","last_fullsized":"2024-09-12T17:41:51.542065+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'136","last_scrub_stamp":"2024-09-12T17:41:51.541730+0000","last_deep_scrub":"265'136","last_deep_scrub_stamp":"2024-09-12T17:41:51.541730+0000","last_clean_scrub_stamp":"2024-09-12T17:41:51.541730+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:58.375721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":636,"num_read_kb":537,"num_write":197,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"265'322","reported_seq":943,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:48.598113+0000","last_change":"2024-09-12T17:41:48.597965+0000","last_active":"2024-09-12T17:41:48.598113+0000","last_peered":"2024-09-12T17:41:48.598113+0000","last_clean":"2024-09-12T17:41:48.598113+0000","last_became_active":"2024-09-12T16:58:18.690634+0000","last_became_peered":"2024-09-12T16:58:18.690634+0000","last_unstale":"2024-09-12T17:41:48.598113+0000","last_undegraded":"2024-09-12T17:41:48.598113+0000","last_fullsized":"2024-09-12T17:41:48.598113+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'322","last_scrub_stamp":"2024-09-12T17:41:48.597755+0000","last_deep_scrub":"265'322","last_deep_scrub_stamp":"2024-09-12T17:41:48.597755+0000","last_clean_scrub_stamp":"2024-09-12T17:41:48.597755+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:42.047491+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159799,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":394,"num_read_kb":27088,"num_write":949,"num_write_kb":25947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"265'299","reported_seq":906,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:57.673364+0000","last_change":"2024-09-12T17:41:57.673364+0000","last_active":"2024-09-12T17:41:57.673364+0000","last_peered":"2024-09-12T17:41:57.673364+0000","last_clean":"2024-09-12T17:41:57.673364+0000","last_became_active":"2024-09-12T16:58:21.702643+0000","last_became_peered":"2024-09-12T16:58:21.702643+0000","last_unstale":"2024-09-12T17:41:57.673364+0000","last_undegraded":"2024-09-12T17:41:57.673364+0000","last_fullsized":"2024-09-12T17:41:57.673364+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'299","last_scrub_stamp":"2024-09-12T17:41:57.673176+0000","last_deep_scrub":"265'299","last_deep_scrub_stamp":"2024-09-12T17:41:57.673176+0000","last_clean_scrub_stamp":"2024-09-12T17:41:57.673176+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:49.957041+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1307,"num_read_kb":1045,"num_write":505,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"265'347","reported_seq":1107,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:44.275966+0000","last_change":"2024-09-12T17:41:44.275966+0000","last_active":"2024-09-12T17:41:44.275966+0000","last_peered":"2024-09-12T17:41:44.275966+0000","last_clean":"2024-09-12T17:41:44.275966+0000","last_became_active":"2024-09-12T16:58:18.702310+0000","last_became_peered":"2024-09-12T16:58:18.702310+0000","last_unstale":"2024-09-12T17:41:44.275966+0000","last_undegraded":"2024-09-12T17:41:44.275966+0000","last_fullsized":"2024-09-12T17:41:44.275966+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'347","last_scrub_stamp":"2024-09-12T17:41:44.275743+0000","last_deep_scrub":"265'347","last_deep_scrub_stamp":"2024-09-12T17:41:44.275743+0000","last_clean_scrub_stamp":"2024-09-12T17:41:44.275743+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:46.939621+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":950476,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":583,"num_read_kb":31842,"num_write":1061,"num_write_kb":30837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"265'156","reported_seq":673,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:20.662572+0000","last_change":"2024-09-12T17:42:20.662572+0000","last_active":"2024-09-12T17:42:20.662572+0000","last_peered":"2024-09-12T17:42:20.662572+0000","last_clean":"2024-09-12T17:42:20.662572+0000","last_became_active":"2024-09-12T16:58:29.792043+0000","last_became_peered":"2024-09-12T16:58:29.792043+0000","last_unstale":"2024-09-12T17:42:20.662572+0000","last_undegraded":"2024-09-12T17:42:20.662572+0000","last_fullsized":"2024-09-12T17:42:20.662572+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'156","last_scrub_stamp":"2024-09-12T17:42:20.662386+0000","last_deep_scrub":"265'156","last_deep_scrub_stamp":"2024-09-12T17:42:20.662386+0000","last_clean_scrub_stamp":"2024-09-12T17:42:20.662386+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:18.127401+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":230,"num_read_kb":220,"num_write":374,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"265'102","reported_seq":694,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:50.519732+0000","last_change":"2024-09-12T17:41:50.519732+0000","last_active":"2024-09-12T17:41:50.519732+0000","last_peered":"2024-09-12T17:41:50.519732+0000","last_clean":"2024-09-12T17:41:50.519732+0000","last_became_active":"2024-09-12T16:58:21.707428+0000","last_became_peered":"2024-09-12T16:58:21.707428+0000","last_unstale":"2024-09-12T17:41:50.519732+0000","last_undegraded":"2024-09-12T17:41:50.519732+0000","last_fullsized":"2024-09-12T17:41:50.519732+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'102","last_scrub_stamp":"2024-09-12T17:41:50.519549+0000","last_deep_scrub":"265'102","last_deep_scrub_stamp":"2024-09-12T17:41:50.519549+0000","last_clean_scrub_stamp":"2024-09-12T17:41:50.519549+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:07.630997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":440,"num_read_kb":374,"num_write":161,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"265'380","reported_seq":1041,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:45.520248+0000","last_change":"2024-09-12T17:41:45.520248+0000","last_active":"2024-09-12T17:41:45.520248+0000","last_peered":"2024-09-12T17:41:45.520248+0000","last_clean":"2024-09-12T17:41:45.520248+0000","last_became_active":"2024-09-12T16:58:18.714782+0000","last_became_peered":"2024-09-12T16:58:18.714782+0000","last_unstale":"2024-09-12T17:41:45.520248+0000","last_undegraded":"2024-09-12T17:41:45.520248+0000","last_fullsized":"2024-09-12T17:41:45.520248+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'380","last_scrub_stamp":"2024-09-12T17:41:45.520059+0000","last_deep_scrub":"265'380","last_deep_scrub_stamp":"2024-09-12T17:41:45.520059+0000","last_clean_scrub_stamp":"2024-09-12T17:41:45.520059+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:52.748711+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194316,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":558,"num_read_kb":18943,"num_write":1229,"num_write_kb":58984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:01.658167+0000","last_change":"2024-09-12T17:42:01.658167+0000","last_active":"2024-09-12T17:42:01.658167+0000","last_peered":"2024-09-12T17:42:01.658167+0000","last_clean":"2024-09-12T17:42:01.658167+0000","last_became_active":"2024-09-12T16:58:23.712621+0000","last_became_peered":"2024-09-12T16:58:23.712621+0000","last_unstale":"2024-09-12T17:42:01.658167+0000","last_undegraded":"2024-09-12T17:42:01.658167+0000","last_fullsized":"2024-09-12T17:42:01.658167+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:01.657990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:01.657990+0000","last_clean_scrub_stamp":"2024-09-12T17:42:01.657990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:51.018117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"265'342","reported_seq":949,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:03.866073+0000","last_change":"2024-09-12T17:42:03.866073+0000","last_active":"2024-09-12T17:42:03.866073+0000","last_peered":"2024-09-12T17:42:03.866073+0000","last_clean":"2024-09-12T17:42:03.866073+0000","last_became_active":"2024-09-12T16:58:25.728901+0000","last_became_peered":"2024-09-12T16:58:25.728901+0000","last_unstale":"2024-09-12T17:42:03.866073+0000","last_undegraded":"2024-09-12T17:42:03.866073+0000","last_fullsized":"2024-09-12T17:42:03.866073+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'342","last_scrub_stamp":"2024-09-12T17:42:03.865859+0000","last_deep_scrub":"265'342","last_deep_scrub_stamp":"2024-09-12T17:42:03.865859+0000","last_clean_scrub_stamp":"2024-09-12T17:42:03.865859+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:35.413458+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46434,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":549,"num_read_kb":1164,"num_write":438,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:10.679527+0000","last_change":"2024-09-12T17:42:10.679527+0000","last_active":"2024-09-12T17:42:10.679527+0000","last_peered":"2024-09-12T17:42:10.679527+0000","last_clean":"2024-09-12T17:42:10.679527+0000","last_became_active":"2024-09-12T16:58:27.752315+0000","last_became_peered":"2024-09-12T16:58:27.752315+0000","last_unstale":"2024-09-12T17:42:10.679527+0000","last_undegraded":"2024-09-12T17:42:10.679527+0000","last_fullsized":"2024-09-12T17:42:10.679527+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:10.679345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:10.679345+0000","last_clean_scrub_stamp":"2024-09-12T17:42:10.679345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:51.638492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"265'129","reported_seq":687,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:14.627941+0000","last_change":"2024-09-12T17:42:14.627941+0000","last_active":"2024-09-12T17:42:14.627941+0000","last_peered":"2024-09-12T17:42:14.627941+0000","last_clean":"2024-09-12T17:42:14.627941+0000","last_became_active":"2024-09-12T16:58:29.773874+0000","last_became_peered":"2024-09-12T16:58:29.773874+0000","last_unstale":"2024-09-12T17:42:14.627941+0000","last_undegraded":"2024-09-12T17:42:14.627941+0000","last_fullsized":"2024-09-12T17:42:14.627941+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'129","last_scrub_stamp":"2024-09-12T17:42:14.627593+0000","last_deep_scrub":"265'129","last_deep_scrub_stamp":"2024-09-12T17:42:14.627593+0000","last_clean_scrub_stamp":"2024-09-12T17:42:14.627593+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:44.736299+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":191,"num_read_kb":190,"num_write":216,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"265'402","reported_seq":1061,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:52.691279+0000","last_change":"2024-09-12T17:41:52.691279+0000","last_active":"2024-09-12T17:41:52.691279+0000","last_peered":"2024-09-12T17:41:52.691279+0000","last_clean":"2024-09-12T17:41:52.691279+0000","last_became_active":"2024-09-12T16:58:21.717806+0000","last_became_peered":"2024-09-12T16:58:21.717806+0000","last_unstale":"2024-09-12T17:41:52.691279+0000","last_undegraded":"2024-09-12T17:41:52.691279+0000","last_fullsized":"2024-09-12T17:41:52.691279+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'402","last_scrub_stamp":"2024-09-12T17:41:52.691089+0000","last_deep_scrub":"265'402","last_deep_scrub_stamp":"2024-09-12T17:41:52.691089+0000","last_clean_scrub_stamp":"2024-09-12T17:41:52.691089+0000","objects_scrubbed":2,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:57.508897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1815,"num_read_kb":1449,"num_write":653,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4270,"num_omap_keys":19,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"265'351","reported_seq":1045,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:41.315205+0000","last_change":"2024-09-12T17:41:41.315205+0000","last_active":"2024-09-12T17:41:41.315205+0000","last_peered":"2024-09-12T17:41:41.315205+0000","last_clean":"2024-09-12T17:41:41.315205+0000","last_became_active":"2024-09-12T16:58:18.691335+0000","last_became_peered":"2024-09-12T16:58:18.691335+0000","last_unstale":"2024-09-12T17:41:41.315205+0000","last_undegraded":"2024-09-12T17:41:41.315205+0000","last_fullsized":"2024-09-12T17:41:41.315205+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'351","last_scrub_stamp":"2024-09-12T17:41:41.314984+0000","last_deep_scrub":"265'351","last_deep_scrub_stamp":"2024-09-12T17:41:41.314984+0000","last_clean_scrub_stamp":"2024-09-12T17:41:41.314984+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:10.989680+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1278687,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":548,"num_read_kb":106559,"num_write":1101,"num_write_kb":67871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:56.476590+0000","last_change":"2024-09-12T17:41:56.476590+0000","last_active":"2024-09-12T17:41:56.476590+0000","last_peered":"2024-09-12T17:41:56.476590+0000","last_clean":"2024-09-12T17:41:56.476590+0000","last_became_active":"2024-09-12T16:58:23.718656+0000","last_became_peered":"2024-09-12T16:58:23.718656+0000","last_unstale":"2024-09-12T17:41:56.476590+0000","last_undegraded":"2024-09-12T17:41:56.476590+0000","last_fullsized":"2024-09-12T17:41:56.476590+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:56.476408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:56.476408+0000","last_clean_scrub_stamp":"2024-09-12T17:41:56.476408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:17.560169+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"265'103","reported_seq":634,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:05.645255+0000","last_change":"2024-09-12T17:42:05.645255+0000","last_active":"2024-09-12T17:42:05.645255+0000","last_peered":"2024-09-12T17:42:05.645255+0000","last_clean":"2024-09-12T17:42:05.645255+0000","last_became_active":"2024-09-12T16:58:25.713567+0000","last_became_peered":"2024-09-12T16:58:25.713567+0000","last_unstale":"2024-09-12T17:42:05.645255+0000","last_undegraded":"2024-09-12T17:42:05.645255+0000","last_fullsized":"2024-09-12T17:42:05.645255+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'103","last_scrub_stamp":"2024-09-12T17:42:05.645063+0000","last_deep_scrub":"265'103","last_deep_scrub_stamp":"2024-09-12T17:42:05.645063+0000","last_clean_scrub_stamp":"2024-09-12T17:42:05.645063+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:09.908392+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":95,"num_read_kb":90,"num_write":66,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:09.612352+0000","last_change":"2024-09-12T17:42:09.612352+0000","last_active":"2024-09-12T17:42:09.612352+0000","last_peered":"2024-09-12T17:42:09.612352+0000","last_clean":"2024-09-12T17:42:09.612352+0000","last_became_active":"2024-09-12T16:58:27.728276+0000","last_became_peered":"2024-09-12T16:58:27.728276+0000","last_unstale":"2024-09-12T17:42:09.612352+0000","last_undegraded":"2024-09-12T17:42:09.612352+0000","last_fullsized":"2024-09-12T17:42:09.612352+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:09.612169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:09.612169+0000","last_clean_scrub_stamp":"2024-09-12T17:42:09.612169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:17.864461+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"265'129","reported_seq":642,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:11.981999+0000","last_change":"2024-09-12T17:42:11.981999+0000","last_active":"2024-09-12T17:42:11.981999+0000","last_peered":"2024-09-12T17:42:11.981999+0000","last_clean":"2024-09-12T17:42:11.981999+0000","last_became_active":"2024-09-12T16:58:29.780598+0000","last_became_peered":"2024-09-12T16:58:29.780598+0000","last_unstale":"2024-09-12T17:42:11.981999+0000","last_undegraded":"2024-09-12T17:42:11.981999+0000","last_fullsized":"2024-09-12T17:42:11.981999+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'129","last_scrub_stamp":"2024-09-12T17:42:11.981812+0000","last_deep_scrub":"265'129","last_deep_scrub_stamp":"2024-09-12T17:42:11.981812+0000","last_clean_scrub_stamp":"2024-09-12T17:42:11.981812+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:04.450209+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":203,"num_read_kb":191,"num_write":301,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"265'80","reported_seq":651,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:50.080879+0000","last_change":"2024-09-12T17:41:50.080720+0000","last_active":"2024-09-12T17:41:50.080879+0000","last_peered":"2024-09-12T17:41:50.080879+0000","last_clean":"2024-09-12T17:41:50.080879+0000","last_became_active":"2024-09-12T16:58:21.718773+0000","last_became_peered":"2024-09-12T16:58:21.718773+0000","last_unstale":"2024-09-12T17:41:50.080879+0000","last_undegraded":"2024-09-12T17:41:50.080879+0000","last_fullsized":"2024-09-12T17:41:50.080879+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'80","last_scrub_stamp":"2024-09-12T17:41:50.080528+0000","last_deep_scrub":"265'80","last_deep_scrub_stamp":"2024-09-12T17:41:50.080528+0000","last_clean_scrub_stamp":"2024-09-12T17:41:50.080528+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:21.460279+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":373,"num_read_kb":312,"num_write":123,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"265'334","reported_seq":933,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:47.460517+0000","last_change":"2024-09-12T17:41:47.460517+0000","last_active":"2024-09-12T17:41:47.460517+0000","last_peered":"2024-09-12T17:41:47.460517+0000","last_clean":"2024-09-12T17:41:47.460517+0000","last_became_active":"2024-09-12T16:58:55.843826+0000","last_became_peered":"2024-09-12T16:58:55.843826+0000","last_unstale":"2024-09-12T17:41:47.460517+0000","last_undegraded":"2024-09-12T17:41:47.460517+0000","last_fullsized":"2024-09-12T17:41:47.460517+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'334","last_scrub_stamp":"2024-09-12T17:41:47.460291+0000","last_deep_scrub":"265'334","last_deep_scrub_stamp":"2024-09-12T17:41:47.460291+0000","last_clean_scrub_stamp":"2024-09-12T17:41:47.460291+0000","objects_scrubbed":6,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:13.714567+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263214,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":424,"num_read_kb":4809,"num_write":985,"num_write_kb":23718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:59.482339+0000","last_change":"2024-09-12T17:41:59.482339+0000","last_active":"2024-09-12T17:41:59.482339+0000","last_peered":"2024-09-12T17:41:59.482339+0000","last_clean":"2024-09-12T17:41:59.482339+0000","last_became_active":"2024-09-12T16:58:23.706953+0000","last_became_peered":"2024-09-12T16:58:23.706953+0000","last_unstale":"2024-09-12T17:41:59.482339+0000","last_undegraded":"2024-09-12T17:41:59.482339+0000","last_fullsized":"2024-09-12T17:41:59.482339+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:59.482154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:59.482154+0000","last_clean_scrub_stamp":"2024-09-12T17:41:59.482154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:45.005327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"265'110","reported_seq":651,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:56.600727+0000","last_change":"2024-09-12T17:41:56.600727+0000","last_active":"2024-09-12T17:41:56.600727+0000","last_peered":"2024-09-12T17:41:56.600727+0000","last_clean":"2024-09-12T17:41:56.600727+0000","last_became_active":"2024-09-12T16:58:25.713213+0000","last_became_peered":"2024-09-12T16:58:25.713213+0000","last_unstale":"2024-09-12T17:41:56.600727+0000","last_undegraded":"2024-09-12T17:41:56.600727+0000","last_fullsized":"2024-09-12T17:41:56.600727+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'110","last_scrub_stamp":"2024-09-12T17:41:56.600505+0000","last_deep_scrub":"265'110","last_deep_scrub_stamp":"2024-09-12T17:41:56.600505+0000","last_clean_scrub_stamp":"2024-09-12T17:41:56.600505+0000","objects_scrubbed":5,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:20.949800+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":116,"num_write":82,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"265'771","reported_seq":4632,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:09.687832+0000","last_change":"2024-09-12T17:42:09.687832+0000","last_active":"2024-09-12T17:42:09.687832+0000","last_peered":"2024-09-12T17:42:09.687832+0000","last_clean":"2024-09-12T17:42:09.687832+0000","last_became_active":"2024-09-12T16:58:27.752801+0000","last_became_peered":"2024-09-12T16:58:27.752801+0000","last_unstale":"2024-09-12T17:42:09.687832+0000","last_undegraded":"2024-09-12T17:42:09.687832+0000","last_fullsized":"2024-09-12T17:42:09.687832+0000","mapping_epoch":32,"log_start":"265'702","ondisk_log_start":"265'702","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'771","last_scrub_stamp":"2024-09-12T17:42:09.687648+0000","last_deep_scrub":"265'771","last_deep_scrub_stamp":"2024-09-12T17:42:09.687648+0000","last_clean_scrub_stamp":"2024-09-12T17:42:09.687648+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":702,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:16.370450+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"265'206","reported_seq":1032,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:12.572728+0000","last_change":"2024-09-12T17:42:12.572728+0000","last_active":"2024-09-12T17:42:12.572728+0000","last_peered":"2024-09-12T17:42:12.572728+0000","last_clean":"2024-09-12T17:42:12.572728+0000","last_became_active":"2024-09-12T16:58:29.769351+0000","last_became_peered":"2024-09-12T16:58:29.769351+0000","last_unstale":"2024-09-12T17:42:12.572728+0000","last_undegraded":"2024-09-12T17:42:12.572728+0000","last_fullsized":"2024-09-12T17:42:12.572728+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'206","last_scrub_stamp":"2024-09-12T17:42:12.572544+0000","last_deep_scrub":"265'206","last_deep_scrub_stamp":"2024-09-12T17:42:12.572544+0000","last_clean_scrub_stamp":"2024-09-12T17:42:12.572544+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:55.304646+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":633,"num_read_kb":631,"num_write":454,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"265'164","reported_seq":762,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:49.549548+0000","last_change":"2024-09-12T17:41:49.549407+0000","last_active":"2024-09-12T17:41:49.549548+0000","last_peered":"2024-09-12T17:41:49.549548+0000","last_clean":"2024-09-12T17:41:49.549548+0000","last_became_active":"2024-09-12T16:58:21.710646+0000","last_became_peered":"2024-09-12T16:58:21.710646+0000","last_unstale":"2024-09-12T17:41:49.549548+0000","last_undegraded":"2024-09-12T17:41:49.549548+0000","last_fullsized":"2024-09-12T17:41:49.549548+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'164","last_scrub_stamp":"2024-09-12T17:41:49.549228+0000","last_deep_scrub":"265'164","last_deep_scrub_stamp":"2024-09-12T17:41:49.549228+0000","last_clean_scrub_stamp":"2024-09-12T17:41:49.549228+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:48.619499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":698,"num_read_kb":573,"num_write":260,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"265'344","reported_seq":977,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:40.452831+0000","last_change":"2024-09-12T17:41:40.452831+0000","last_active":"2024-09-12T17:41:40.452831+0000","last_peered":"2024-09-12T17:41:40.452831+0000","last_clean":"2024-09-12T17:41:40.452831+0000","last_became_active":"2024-09-12T16:58:18.689915+0000","last_became_peered":"2024-09-12T16:58:18.689915+0000","last_unstale":"2024-09-12T17:41:40.452831+0000","last_undegraded":"2024-09-12T17:41:40.452831+0000","last_fullsized":"2024-09-12T17:41:40.452831+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'344","last_scrub_stamp":"2024-09-12T17:41:40.452621+0000","last_deep_scrub":"265'344","last_deep_scrub_stamp":"2024-09-12T17:41:40.452621+0000","last_clean_scrub_stamp":"2024-09-12T17:41:40.452621+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:57.294233+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388626,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":434,"num_read_kb":42593,"num_write":1103,"num_write_kb":36991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:02.632507+0000","last_change":"2024-09-12T17:42:02.632507+0000","last_active":"2024-09-12T17:42:02.632507+0000","last_peered":"2024-09-12T17:42:02.632507+0000","last_clean":"2024-09-12T17:42:02.632507+0000","last_became_active":"2024-09-12T16:58:23.697159+0000","last_became_peered":"2024-09-12T16:58:23.697159+0000","last_unstale":"2024-09-12T17:42:02.632507+0000","last_undegraded":"2024-09-12T17:42:02.632507+0000","last_fullsized":"2024-09-12T17:42:02.632507+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:02.632329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:02.632329+0000","last_clean_scrub_stamp":"2024-09-12T17:42:02.632329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:42.457952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"265'252","reported_seq":827,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:03.774177+0000","last_change":"2024-09-12T17:42:03.774177+0000","last_active":"2024-09-12T17:42:03.774177+0000","last_peered":"2024-09-12T17:42:03.774177+0000","last_clean":"2024-09-12T17:42:03.774177+0000","last_became_active":"2024-09-12T16:58:25.949179+0000","last_became_peered":"2024-09-12T16:58:25.949179+0000","last_unstale":"2024-09-12T17:42:03.774177+0000","last_undegraded":"2024-09-12T17:42:03.774177+0000","last_fullsized":"2024-09-12T17:42:03.774177+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'252","last_scrub_stamp":"2024-09-12T17:42:03.773982+0000","last_deep_scrub":"265'252","last_deep_scrub_stamp":"2024-09-12T17:42:03.773982+0000","last_clean_scrub_stamp":"2024-09-12T17:42:03.773982+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:42.695827+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43414,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":422,"num_read_kb":981,"num_write":340,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"265'786","reported_seq":2108,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:11.570731+0000","last_change":"2024-09-12T17:42:11.570731+0000","last_active":"2024-09-12T17:42:11.570731+0000","last_peered":"2024-09-12T17:42:11.570731+0000","last_clean":"2024-09-12T17:42:11.570731+0000","last_became_active":"2024-09-12T16:58:27.745988+0000","last_became_peered":"2024-09-12T16:58:27.745988+0000","last_unstale":"2024-09-12T17:42:11.570731+0000","last_undegraded":"2024-09-12T17:42:11.570731+0000","last_fullsized":"2024-09-12T17:42:11.570731+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'786","last_scrub_stamp":"2024-09-12T17:42:11.570546+0000","last_deep_scrub":"265'786","last_deep_scrub_stamp":"2024-09-12T17:42:11.570546+0000","last_clean_scrub_stamp":"2024-09-12T17:42:11.570546+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:17.461259+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"265'150","reported_seq":729,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:53.700294+0000","last_change":"2024-09-12T17:41:53.700294+0000","last_active":"2024-09-12T17:41:53.700294+0000","last_peered":"2024-09-12T17:41:53.700294+0000","last_clean":"2024-09-12T17:41:53.700294+0000","last_became_active":"2024-09-12T16:58:21.710029+0000","last_became_peered":"2024-09-12T16:58:21.710029+0000","last_unstale":"2024-09-12T17:41:53.700294+0000","last_undegraded":"2024-09-12T17:41:53.700294+0000","last_fullsized":"2024-09-12T17:41:53.700294+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'150","last_scrub_stamp":"2024-09-12T17:41:53.700121+0000","last_deep_scrub":"265'150","last_deep_scrub_stamp":"2024-09-12T17:41:53.700121+0000","last_clean_scrub_stamp":"2024-09-12T17:41:53.700121+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:02.023536+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":614,"num_read_kb":496,"num_write":228,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"265'366","reported_seq":1021,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:44.502758+0000","last_change":"2024-09-12T17:41:44.502758+0000","last_active":"2024-09-12T17:41:44.502758+0000","last_peered":"2024-09-12T17:41:44.502758+0000","last_clean":"2024-09-12T17:41:44.502758+0000","last_became_active":"2024-09-12T16:58:18.715448+0000","last_became_peered":"2024-09-12T16:58:18.715448+0000","last_unstale":"2024-09-12T17:41:44.502758+0000","last_undegraded":"2024-09-12T17:41:44.502758+0000","last_fullsized":"2024-09-12T17:41:44.502758+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'366","last_scrub_stamp":"2024-09-12T17:41:44.502506+0000","last_deep_scrub":"265'366","last_deep_scrub_stamp":"2024-09-12T17:41:44.502506+0000","last_clean_scrub_stamp":"2024-09-12T17:41:44.502506+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:08.236868+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1147727,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":546,"num_read_kb":11904,"num_write":1219,"num_write_kb":32051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:57.709766+0000","last_change":"2024-09-12T17:41:57.709766+0000","last_active":"2024-09-12T17:41:57.709766+0000","last_peered":"2024-09-12T17:41:57.709766+0000","last_clean":"2024-09-12T17:41:57.709766+0000","last_became_active":"2024-09-12T16:58:23.720096+0000","last_became_peered":"2024-09-12T16:58:23.720096+0000","last_unstale":"2024-09-12T17:41:57.709766+0000","last_undegraded":"2024-09-12T17:41:57.709766+0000","last_fullsized":"2024-09-12T17:41:57.709766+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:57.709583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:57.709583+0000","last_clean_scrub_stamp":"2024-09-12T17:41:57.709583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:39.596618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"265'369","reported_seq":987,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:05.604213+0000","last_change":"2024-09-12T17:42:05.604213+0000","last_active":"2024-09-12T17:42:05.604213+0000","last_peered":"2024-09-12T17:42:05.604213+0000","last_clean":"2024-09-12T17:42:05.604213+0000","last_became_active":"2024-09-12T16:58:25.946765+0000","last_became_peered":"2024-09-12T16:58:25.946765+0000","last_unstale":"2024-09-12T17:42:05.604213+0000","last_undegraded":"2024-09-12T17:42:05.604213+0000","last_fullsized":"2024-09-12T17:42:05.604213+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'369","last_scrub_stamp":"2024-09-12T17:42:05.604007+0000","last_deep_scrub":"265'369","last_deep_scrub_stamp":"2024-09-12T17:42:05.604007+0000","last_clean_scrub_stamp":"2024-09-12T17:42:05.604007+0000","objects_scrubbed":10,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:42.337337+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46152,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":583,"num_read_kb":1215,"num_write":464,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:01.378968+0000","last_change":"2024-09-12T17:42:01.378968+0000","last_active":"2024-09-12T17:42:01.378968+0000","last_peered":"2024-09-12T17:42:01.378968+0000","last_clean":"2024-09-12T17:42:01.378968+0000","last_became_active":"2024-09-12T16:58:27.753616+0000","last_became_peered":"2024-09-12T16:58:27.753616+0000","last_unstale":"2024-09-12T17:42:01.378968+0000","last_undegraded":"2024-09-12T17:42:01.378968+0000","last_fullsized":"2024-09-12T17:42:01.378968+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:01.378765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:01.378765+0000","last_clean_scrub_stamp":"2024-09-12T17:42:01.378765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:27.283128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"265'554","reported_seq":1371,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:12.556002+0000","last_change":"2024-09-12T17:42:12.555824+0000","last_active":"2024-09-12T17:42:12.556002+0000","last_peered":"2024-09-12T17:42:12.556002+0000","last_clean":"2024-09-12T17:42:12.556002+0000","last_became_active":"2024-09-12T16:58:29.774093+0000","last_became_peered":"2024-09-12T16:58:29.774093+0000","last_unstale":"2024-09-12T17:42:12.556002+0000","last_undegraded":"2024-09-12T17:42:12.556002+0000","last_fullsized":"2024-09-12T17:42:12.556002+0000","mapping_epoch":34,"log_start":"265'500","ondisk_log_start":"265'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'554","last_scrub_stamp":"2024-09-12T17:42:12.555633+0000","last_deep_scrub":"265'554","last_deep_scrub_stamp":"2024-09-12T17:42:12.555633+0000","last_clean_scrub_stamp":"2024-09-12T17:42:12.555633+0000","objects_scrubbed":4,"log_size":54,"log_dups_size":500,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:07.265979+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":455,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1305,"num_read_kb":1304,"num_write":1151,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"265'502","reported_seq":1263,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:48.602426+0000","last_change":"2024-09-12T17:41:48.602426+0000","last_active":"2024-09-12T17:41:48.602426+0000","last_peered":"2024-09-12T17:41:48.602426+0000","last_clean":"2024-09-12T17:41:48.602426+0000","last_became_active":"2024-09-12T16:58:21.699243+0000","last_became_peered":"2024-09-12T16:58:21.699243+0000","last_unstale":"2024-09-12T17:41:48.602426+0000","last_undegraded":"2024-09-12T17:41:48.602426+0000","last_fullsized":"2024-09-12T17:41:48.602426+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'502","last_scrub_stamp":"2024-09-12T17:41:48.602124+0000","last_deep_scrub":"265'502","last_deep_scrub_stamp":"2024-09-12T17:41:48.602124+0000","last_clean_scrub_stamp":"2024-09-12T17:41:48.602124+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:11.597872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2329,"num_read_kb":1984,"num_write":852,"num_write_kb":550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"265'371","reported_seq":1042,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:41.552046+0000","last_change":"2024-09-12T17:41:41.552046+0000","last_active":"2024-09-12T17:41:41.552046+0000","last_peered":"2024-09-12T17:41:41.552046+0000","last_clean":"2024-09-12T17:41:41.552046+0000","last_became_active":"2024-09-12T16:58:18.714412+0000","last_became_peered":"2024-09-12T16:58:18.714412+0000","last_unstale":"2024-09-12T17:41:41.552046+0000","last_undegraded":"2024-09-12T17:41:41.552046+0000","last_fullsized":"2024-09-12T17:41:41.552046+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'371","last_scrub_stamp":"2024-09-12T17:41:41.551754+0000","last_deep_scrub":"265'371","last_deep_scrub_stamp":"2024-09-12T17:41:41.551754+0000","last_clean_scrub_stamp":"2024-09-12T17:41:41.551754+0000","objects_scrubbed":6,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:46.467198+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306427,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":511,"num_read_kb":85960,"num_write":1174,"num_write_kb":38984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:48.434883+0000","last_change":"2024-09-12T17:41:48.434883+0000","last_active":"2024-09-12T17:41:48.434883+0000","last_peered":"2024-09-12T17:41:48.434883+0000","last_clean":"2024-09-12T17:41:48.434883+0000","last_became_active":"2024-09-12T16:58:23.703534+0000","last_became_peered":"2024-09-12T16:58:23.703534+0000","last_unstale":"2024-09-12T17:41:48.434883+0000","last_undegraded":"2024-09-12T17:41:48.434883+0000","last_fullsized":"2024-09-12T17:41:48.434883+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:48.434677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:48.434677+0000","last_clean_scrub_stamp":"2024-09-12T17:41:48.434677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:41.207200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"265'282","reported_seq":861,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:01.574232+0000","last_change":"2024-09-12T17:42:01.574232+0000","last_active":"2024-09-12T17:42:01.574232+0000","last_peered":"2024-09-12T17:42:01.574232+0000","last_clean":"2024-09-12T17:42:01.574232+0000","last_became_active":"2024-09-12T16:58:25.730470+0000","last_became_peered":"2024-09-12T16:58:25.730470+0000","last_unstale":"2024-09-12T17:42:01.574232+0000","last_undegraded":"2024-09-12T17:42:01.574232+0000","last_fullsized":"2024-09-12T17:42:01.574232+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'282","last_scrub_stamp":"2024-09-12T17:42:01.574044+0000","last_deep_scrub":"265'282","last_deep_scrub_stamp":"2024-09-12T17:42:01.574044+0000","last_clean_scrub_stamp":"2024-09-12T17:42:01.574044+0000","objects_scrubbed":4,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:01.929052+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57671,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":480,"num_read_kb":1170,"num_write":398,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:10.529115+0000","last_change":"2024-09-12T17:42:10.529115+0000","last_active":"2024-09-12T17:42:10.529115+0000","last_peered":"2024-09-12T17:42:10.529115+0000","last_clean":"2024-09-12T17:42:10.529115+0000","last_became_active":"2024-09-12T16:58:27.748461+0000","last_became_peered":"2024-09-12T16:58:27.748461+0000","last_unstale":"2024-09-12T17:42:10.529115+0000","last_undegraded":"2024-09-12T17:42:10.529115+0000","last_fullsized":"2024-09-12T17:42:10.529115+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:10.528945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:10.528945+0000","last_clean_scrub_stamp":"2024-09-12T17:42:10.528945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:06.400660+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"265'2419","reported_seq":4260,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:01.368182+0000","last_change":"2024-09-12T17:42:01.368039+0000","last_active":"2024-09-12T17:42:01.368182+0000","last_peered":"2024-09-12T17:42:01.368182+0000","last_clean":"2024-09-12T17:42:01.368182+0000","last_became_active":"2024-09-12T16:58:29.768469+0000","last_became_peered":"2024-09-12T16:58:29.768469+0000","last_unstale":"2024-09-12T17:42:01.368182+0000","last_undegraded":"2024-09-12T17:42:01.368182+0000","last_fullsized":"2024-09-12T17:42:01.368182+0000","mapping_epoch":34,"log_start":"265'2400","ondisk_log_start":"265'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2419","last_scrub_stamp":"2024-09-12T17:42:01.367825+0000","last_deep_scrub":"265'2419","last_deep_scrub_stamp":"2024-09-12T17:42:01.367825+0000","last_clean_scrub_stamp":"2024-09-12T17:42:01.367825+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":2400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:52.127983+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":849,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6073,"num_read_kb":6065,"num_write":4892,"num_write_kb":1798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"265'217","reported_seq":805,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:45.445128+0000","last_change":"2024-09-12T17:41:45.444945+0000","last_active":"2024-09-12T17:41:45.445128+0000","last_peered":"2024-09-12T17:41:45.445128+0000","last_clean":"2024-09-12T17:41:45.445128+0000","last_became_active":"2024-09-12T16:58:21.724552+0000","last_became_peered":"2024-09-12T16:58:21.724552+0000","last_unstale":"2024-09-12T17:41:45.445128+0000","last_undegraded":"2024-09-12T17:41:45.445128+0000","last_fullsized":"2024-09-12T17:41:45.445128+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'217","last_scrub_stamp":"2024-09-12T17:41:45.444760+0000","last_deep_scrub":"265'217","last_deep_scrub_stamp":"2024-09-12T17:41:45.444760+0000","last_clean_scrub_stamp":"2024-09-12T17:41:45.444760+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:07.480407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":914,"num_read_kb":736,"num_write":337,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"265'479","reported_seq":1231,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:42.515901+0000","last_change":"2024-09-12T17:41:42.515901+0000","last_active":"2024-09-12T17:41:42.515901+0000","last_peered":"2024-09-12T17:41:42.515901+0000","last_clean":"2024-09-12T17:41:42.515901+0000","last_became_active":"2024-09-12T16:58:55.852305+0000","last_became_peered":"2024-09-12T16:58:55.852305+0000","last_unstale":"2024-09-12T17:41:42.515901+0000","last_undegraded":"2024-09-12T17:41:42.515901+0000","last_fullsized":"2024-09-12T17:41:42.515901+0000","mapping_epoch":37,"log_start":"265'400","ondisk_log_start":"265'400","created":23,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'479","last_scrub_stamp":"2024-09-12T17:41:42.515648+0000","last_deep_scrub":"265'479","last_deep_scrub_stamp":"2024-09-12T17:41:42.515648+0000","last_clean_scrub_stamp":"2024-09-12T17:41:42.515648+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:36.727017+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048839,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":919,"num_read_kb":12354,"num_write":1497,"num_write_kb":33200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:50.493117+0000","last_change":"2024-09-12T17:41:50.493117+0000","last_active":"2024-09-12T17:41:50.493117+0000","last_peered":"2024-09-12T17:41:50.493117+0000","last_clean":"2024-09-12T17:41:50.493117+0000","last_became_active":"2024-09-12T16:58:23.713241+0000","last_became_peered":"2024-09-12T16:58:23.713241+0000","last_unstale":"2024-09-12T17:41:50.493117+0000","last_undegraded":"2024-09-12T17:41:50.493117+0000","last_fullsized":"2024-09-12T17:41:50.493117+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:50.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:50.492929+0000","last_clean_scrub_stamp":"2024-09-12T17:41:50.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:16.543100+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"265'326","reported_seq":918,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:02.766836+0000","last_change":"2024-09-12T17:42:02.766836+0000","last_active":"2024-09-12T17:42:02.766836+0000","last_peered":"2024-09-12T17:42:02.766836+0000","last_clean":"2024-09-12T17:42:02.766836+0000","last_became_active":"2024-09-12T16:58:25.732918+0000","last_became_peered":"2024-09-12T16:58:25.732918+0000","last_unstale":"2024-09-12T17:42:02.766836+0000","last_undegraded":"2024-09-12T17:42:02.766836+0000","last_fullsized":"2024-09-12T17:42:02.766836+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'326","last_scrub_stamp":"2024-09-12T17:42:02.766606+0000","last_deep_scrub":"265'326","last_deep_scrub_stamp":"2024-09-12T17:42:02.766606+0000","last_clean_scrub_stamp":"2024-09-12T17:42:02.766606+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:17.798594+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71605,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":514,"num_read_kb":1203,"num_write":420,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"265'759","reported_seq":2470,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:04.870764+0000","last_change":"2024-09-12T17:42:04.870764+0000","last_active":"2024-09-12T17:42:04.870764+0000","last_peered":"2024-09-12T17:42:04.870764+0000","last_clean":"2024-09-12T17:42:04.870764+0000","last_became_active":"2024-09-12T16:58:27.736160+0000","last_became_peered":"2024-09-12T16:58:27.736160+0000","last_unstale":"2024-09-12T17:42:04.870764+0000","last_undegraded":"2024-09-12T17:42:04.870764+0000","last_fullsized":"2024-09-12T17:42:04.870764+0000","mapping_epoch":32,"log_start":"265'701","ondisk_log_start":"265'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'759","last_scrub_stamp":"2024-09-12T17:42:04.870586+0000","last_deep_scrub":"265'759","last_deep_scrub_stamp":"2024-09-12T17:42:04.870586+0000","last_clean_scrub_stamp":"2024-09-12T17:42:04.870586+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":701,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:19.787370+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"265'169","reported_seq":666,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:10.968584+0000","last_change":"2024-09-12T17:42:10.968584+0000","last_active":"2024-09-12T17:42:10.968584+0000","last_peered":"2024-09-12T17:42:10.968584+0000","last_clean":"2024-09-12T17:42:10.968584+0000","last_became_active":"2024-09-12T16:58:29.785621+0000","last_became_peered":"2024-09-12T16:58:29.785621+0000","last_unstale":"2024-09-12T17:42:10.968584+0000","last_undegraded":"2024-09-12T17:42:10.968584+0000","last_fullsized":"2024-09-12T17:42:10.968584+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'169","last_scrub_stamp":"2024-09-12T17:42:10.968399+0000","last_deep_scrub":"265'169","last_deep_scrub_stamp":"2024-09-12T17:42:10.968399+0000","last_clean_scrub_stamp":"2024-09-12T17:42:10.968399+0000","objects_scrubbed":2,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:36.694831+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":406,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":130,"num_read_kb":128,"num_write":373,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"265'203","reported_seq":803,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:49.110136+0000","last_change":"2024-09-12T17:41:49.110136+0000","last_active":"2024-09-12T17:41:49.110136+0000","last_peered":"2024-09-12T17:41:49.110136+0000","last_clean":"2024-09-12T17:41:49.110136+0000","last_became_active":"2024-09-12T16:58:21.701704+0000","last_became_peered":"2024-09-12T16:58:21.701704+0000","last_unstale":"2024-09-12T17:41:49.110136+0000","last_undegraded":"2024-09-12T17:41:49.110136+0000","last_fullsized":"2024-09-12T17:41:49.110136+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'203","last_scrub_stamp":"2024-09-12T17:41:49.109939+0000","last_deep_scrub":"265'203","last_deep_scrub_stamp":"2024-09-12T17:41:49.109939+0000","last_clean_scrub_stamp":"2024-09-12T17:41:49.109939+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:31.594839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":867,"num_read_kb":717,"num_write":300,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"265'335","reported_seq":973,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:42.680714+0000","last_change":"2024-09-12T17:41:42.680714+0000","last_active":"2024-09-12T17:41:42.680714+0000","last_peered":"2024-09-12T17:41:42.680714+0000","last_clean":"2024-09-12T17:41:42.680714+0000","last_became_active":"2024-09-12T16:58:18.715232+0000","last_became_peered":"2024-09-12T16:58:18.715232+0000","last_unstale":"2024-09-12T17:41:42.680714+0000","last_undegraded":"2024-09-12T17:41:42.680714+0000","last_fullsized":"2024-09-12T17:41:42.680714+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'335","last_scrub_stamp":"2024-09-12T17:41:42.680418+0000","last_deep_scrub":"265'335","last_deep_scrub_stamp":"2024-09-12T17:41:42.680418+0000","last_clean_scrub_stamp":"2024-09-12T17:41:42.680418+0000","objects_scrubbed":9,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:52.761737+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1724025,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":468,"num_read_kb":18626,"num_write":1028,"num_write_kb":30032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:49.458628+0000","last_change":"2024-09-12T17:41:49.458503+0000","last_active":"2024-09-12T17:41:49.458628+0000","last_peered":"2024-09-12T17:41:49.458628+0000","last_clean":"2024-09-12T17:41:49.458628+0000","last_became_active":"2024-09-12T16:58:23.708641+0000","last_became_peered":"2024-09-12T16:58:23.708641+0000","last_unstale":"2024-09-12T17:41:49.458628+0000","last_undegraded":"2024-09-12T17:41:49.458628+0000","last_fullsized":"2024-09-12T17:41:49.458628+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:49.458319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:49.458319+0000","last_clean_scrub_stamp":"2024-09-12T17:41:49.458319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:57:34.059304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"265'475","reported_seq":1111,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:58.971445+0000","last_change":"2024-09-12T17:41:58.971445+0000","last_active":"2024-09-12T17:41:58.971445+0000","last_peered":"2024-09-12T17:41:58.971445+0000","last_clean":"2024-09-12T17:41:58.971445+0000","last_became_active":"2024-09-12T16:58:25.729071+0000","last_became_peered":"2024-09-12T16:58:25.729071+0000","last_unstale":"2024-09-12T17:41:58.971445+0000","last_undegraded":"2024-09-12T17:41:58.971445+0000","last_fullsized":"2024-09-12T17:41:58.971445+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'475","last_scrub_stamp":"2024-09-12T17:41:58.971256+0000","last_deep_scrub":"265'475","last_deep_scrub_stamp":"2024-09-12T17:41:58.971256+0000","last_clean_scrub_stamp":"2024-09-12T17:41:58.971256+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:44.218649+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126127,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":817,"num_read_kb":2031,"num_write":670,"num_write_kb":603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:55.551207+0000","last_change":"2024-09-12T17:41:55.551207+0000","last_active":"2024-09-12T17:41:55.551207+0000","last_peered":"2024-09-12T17:41:55.551207+0000","last_clean":"2024-09-12T17:41:55.551207+0000","last_became_active":"2024-09-12T16:58:27.734078+0000","last_became_peered":"2024-09-12T16:58:27.734078+0000","last_unstale":"2024-09-12T17:41:55.551207+0000","last_undegraded":"2024-09-12T17:41:55.551207+0000","last_fullsized":"2024-09-12T17:41:55.551207+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:55.551025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:55.551025+0000","last_clean_scrub_stamp":"2024-09-12T17:41:55.551025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:17.047074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"265'90","reported_seq":599,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:04.444250+0000","last_change":"2024-09-12T17:42:04.444250+0000","last_active":"2024-09-12T17:42:04.444250+0000","last_peered":"2024-09-12T17:42:04.444250+0000","last_clean":"2024-09-12T17:42:04.444250+0000","last_became_active":"2024-09-12T16:58:29.794347+0000","last_became_peered":"2024-09-12T16:58:29.794347+0000","last_unstale":"2024-09-12T17:42:04.444250+0000","last_undegraded":"2024-09-12T17:42:04.444250+0000","last_fullsized":"2024-09-12T17:42:04.444250+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'90","last_scrub_stamp":"2024-09-12T17:42:04.444035+0000","last_deep_scrub":"265'90","last_deep_scrub_stamp":"2024-09-12T17:42:04.444035+0000","last_clean_scrub_stamp":"2024-09-12T17:42:04.444035+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:38.772754+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":704,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":193,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"265'212","reported_seq":809,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:44.640655+0000","last_change":"2024-09-12T17:41:44.640655+0000","last_active":"2024-09-12T17:41:44.640655+0000","last_peered":"2024-09-12T17:41:44.640655+0000","last_clean":"2024-09-12T17:41:44.640655+0000","last_became_active":"2024-09-12T16:58:21.702684+0000","last_became_peered":"2024-09-12T16:58:21.702684+0000","last_unstale":"2024-09-12T17:41:44.640655+0000","last_undegraded":"2024-09-12T17:41:44.640655+0000","last_fullsized":"2024-09-12T17:41:44.640655+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'212","last_scrub_stamp":"2024-09-12T17:41:44.640479+0000","last_deep_scrub":"265'212","last_deep_scrub_stamp":"2024-09-12T17:41:44.640479+0000","last_clean_scrub_stamp":"2024-09-12T17:41:44.640479+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:35.863889+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":882,"num_read_kb":712,"num_write":314,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"265'376","reported_seq":1066,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:41.751292+0000","last_change":"2024-09-12T17:41:41.751292+0000","last_active":"2024-09-12T17:41:41.751292+0000","last_peered":"2024-09-12T17:41:41.751292+0000","last_clean":"2024-09-12T17:41:41.751292+0000","last_became_active":"2024-09-12T16:58:18.695549+0000","last_became_peered":"2024-09-12T16:58:18.695549+0000","last_unstale":"2024-09-12T17:41:41.751292+0000","last_undegraded":"2024-09-12T17:41:41.751292+0000","last_fullsized":"2024-09-12T17:41:41.751292+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'376","last_scrub_stamp":"2024-09-12T17:41:41.751066+0000","last_deep_scrub":"265'376","last_deep_scrub_stamp":"2024-09-12T17:41:41.751066+0000","last_clean_scrub_stamp":"2024-09-12T17:41:41.751066+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:18.413154+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":633,"num_read_kb":12633,"num_write":1101,"num_write_kb":15900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:52.524952+0000","last_change":"2024-09-12T17:41:52.524952+0000","last_active":"2024-09-12T17:41:52.524952+0000","last_peered":"2024-09-12T17:41:52.524952+0000","last_clean":"2024-09-12T17:41:52.524952+0000","last_became_active":"2024-09-12T16:58:23.720279+0000","last_became_peered":"2024-09-12T16:58:23.720279+0000","last_unstale":"2024-09-12T17:41:52.524952+0000","last_undegraded":"2024-09-12T17:41:52.524952+0000","last_fullsized":"2024-09-12T17:41:52.524952+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:52.524776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:52.524776+0000","last_clean_scrub_stamp":"2024-09-12T17:41:52.524776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:24.970601+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"265'298","reported_seq":880,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:04.604637+0000","last_change":"2024-09-12T17:42:04.604637+0000","last_active":"2024-09-12T17:42:04.604637+0000","last_peered":"2024-09-12T17:42:04.604637+0000","last_clean":"2024-09-12T17:42:04.604637+0000","last_became_active":"2024-09-12T16:58:25.711682+0000","last_became_peered":"2024-09-12T16:58:25.711682+0000","last_unstale":"2024-09-12T17:42:04.604637+0000","last_undegraded":"2024-09-12T17:42:04.604637+0000","last_fullsized":"2024-09-12T17:42:04.604637+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'298","last_scrub_stamp":"2024-09-12T17:42:04.604436+0000","last_deep_scrub":"265'298","last_deep_scrub_stamp":"2024-09-12T17:42:04.604436+0000","last_clean_scrub_stamp":"2024-09-12T17:42:04.604436+0000","objects_scrubbed":6,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:28.531688+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44554,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":521,"num_read_kb":1183,"num_write":472,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:05.917580+0000","last_change":"2024-09-12T17:42:05.917580+0000","last_active":"2024-09-12T17:42:05.917580+0000","last_peered":"2024-09-12T17:42:05.917580+0000","last_clean":"2024-09-12T17:42:05.917580+0000","last_became_active":"2024-09-12T16:58:27.751664+0000","last_became_peered":"2024-09-12T16:58:27.751664+0000","last_unstale":"2024-09-12T17:42:05.917580+0000","last_undegraded":"2024-09-12T17:42:05.917580+0000","last_fullsized":"2024-09-12T17:42:05.917580+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:05.917376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:05.917376+0000","last_clean_scrub_stamp":"2024-09-12T17:42:05.917376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:42.341012+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"265'131","reported_seq":639,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:17.541332+0000","last_change":"2024-09-12T17:42:17.541332+0000","last_active":"2024-09-12T17:42:17.541332+0000","last_peered":"2024-09-12T17:42:17.541332+0000","last_clean":"2024-09-12T17:42:17.541332+0000","last_became_active":"2024-09-12T16:58:29.784095+0000","last_became_peered":"2024-09-12T16:58:29.784095+0000","last_unstale":"2024-09-12T17:42:17.541332+0000","last_undegraded":"2024-09-12T17:42:17.541332+0000","last_fullsized":"2024-09-12T17:42:17.541332+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'131","last_scrub_stamp":"2024-09-12T17:42:17.541136+0000","last_deep_scrub":"265'131","last_deep_scrub_stamp":"2024-09-12T17:42:17.541136+0000","last_clean_scrub_stamp":"2024-09-12T17:42:17.541136+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:45.054091+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":487,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":177,"num_read_kb":165,"num_write":304,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"265'166","reported_seq":780,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:45.621245+0000","last_change":"2024-09-12T17:41:45.621245+0000","last_active":"2024-09-12T17:41:45.621245+0000","last_peered":"2024-09-12T17:41:45.621245+0000","last_clean":"2024-09-12T17:41:45.621245+0000","last_became_active":"2024-09-12T16:58:21.728963+0000","last_became_peered":"2024-09-12T16:58:21.728963+0000","last_unstale":"2024-09-12T17:41:45.621245+0000","last_undegraded":"2024-09-12T17:41:45.621245+0000","last_fullsized":"2024-09-12T17:41:45.621245+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'166","last_scrub_stamp":"2024-09-12T17:41:45.621014+0000","last_deep_scrub":"265'166","last_deep_scrub_stamp":"2024-09-12T17:41:45.621014+0000","last_clean_scrub_stamp":"2024-09-12T17:41:45.621014+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:14.525844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":751,"num_read_kb":615,"num_write":255,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"265'343","reported_seq":1020,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:41.451773+0000","last_change":"2024-09-12T17:41:41.451544+0000","last_active":"2024-09-12T17:41:41.451773+0000","last_peered":"2024-09-12T17:41:41.451773+0000","last_clean":"2024-09-12T17:41:41.451773+0000","last_became_active":"2024-09-12T16:58:18.708689+0000","last_became_peered":"2024-09-12T16:58:18.708689+0000","last_unstale":"2024-09-12T17:41:41.451773+0000","last_undegraded":"2024-09-12T17:41:41.451773+0000","last_fullsized":"2024-09-12T17:41:41.451773+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'343","last_scrub_stamp":"2024-09-12T17:41:41.451261+0000","last_deep_scrub":"265'343","last_deep_scrub_stamp":"2024-09-12T17:41:41.451261+0000","last_clean_scrub_stamp":"2024-09-12T17:41:41.451261+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:06.939620+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":505,"num_read_kb":124256,"num_write":1133,"num_write_kb":36504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:56.391504+0000","last_change":"2024-09-12T17:41:56.391504+0000","last_active":"2024-09-12T17:41:56.391504+0000","last_peered":"2024-09-12T17:41:56.391504+0000","last_clean":"2024-09-12T17:41:56.391504+0000","last_became_active":"2024-09-12T16:58:23.709099+0000","last_became_peered":"2024-09-12T16:58:23.709099+0000","last_unstale":"2024-09-12T17:41:56.391504+0000","last_undegraded":"2024-09-12T17:41:56.391504+0000","last_fullsized":"2024-09-12T17:41:56.391504+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:56.391301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:56.391301+0000","last_clean_scrub_stamp":"2024-09-12T17:41:56.391301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:32.975832+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"265'284","reported_seq":876,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:54.532525+0000","last_change":"2024-09-12T17:41:54.532525+0000","last_active":"2024-09-12T17:41:54.532525+0000","last_peered":"2024-09-12T17:41:54.532525+0000","last_clean":"2024-09-12T17:41:54.532525+0000","last_became_active":"2024-09-12T16:58:25.723894+0000","last_became_peered":"2024-09-12T16:58:25.723894+0000","last_unstale":"2024-09-12T17:41:54.532525+0000","last_undegraded":"2024-09-12T17:41:54.532525+0000","last_fullsized":"2024-09-12T17:41:54.532525+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'284","last_scrub_stamp":"2024-09-12T17:41:54.532322+0000","last_deep_scrub":"265'284","last_deep_scrub_stamp":"2024-09-12T17:41:54.532322+0000","last_clean_scrub_stamp":"2024-09-12T17:41:54.532322+0000","objects_scrubbed":7,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:06.034171+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60644,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":457,"num_read_kb":1010,"num_write":360,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"265'727","reported_seq":2356,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:59.659910+0000","last_change":"2024-09-12T17:41:59.659910+0000","last_active":"2024-09-12T17:41:59.659910+0000","last_peered":"2024-09-12T17:41:59.659910+0000","last_clean":"2024-09-12T17:41:59.659910+0000","last_became_active":"2024-09-12T16:58:27.753179+0000","last_became_peered":"2024-09-12T16:58:27.753179+0000","last_unstale":"2024-09-12T17:41:59.659910+0000","last_undegraded":"2024-09-12T17:41:59.659910+0000","last_fullsized":"2024-09-12T17:41:59.659910+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'727","last_scrub_stamp":"2024-09-12T17:41:59.659726+0000","last_deep_scrub":"265'727","last_deep_scrub_stamp":"2024-09-12T17:41:59.659726+0000","last_clean_scrub_stamp":"2024-09-12T17:41:59.659726+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":700,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:13.608476+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"265'142","reported_seq":674,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:05.434385+0000","last_change":"2024-09-12T17:42:05.434246+0000","last_active":"2024-09-12T17:42:05.434385+0000","last_peered":"2024-09-12T17:42:05.434385+0000","last_clean":"2024-09-12T17:42:05.434385+0000","last_became_active":"2024-09-12T16:58:29.778839+0000","last_became_peered":"2024-09-12T16:58:29.778839+0000","last_unstale":"2024-09-12T17:42:05.434385+0000","last_undegraded":"2024-09-12T17:42:05.434385+0000","last_fullsized":"2024-09-12T17:42:05.434385+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'142","last_scrub_stamp":"2024-09-12T17:42:05.434025+0000","last_deep_scrub":"265'142","last_deep_scrub_stamp":"2024-09-12T17:42:05.434025+0000","last_clean_scrub_stamp":"2024-09-12T17:42:05.434025+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:13.641037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":288,"num_read_kb":252,"num_write":342,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"265'188","reported_seq":784,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:46.597917+0000","last_change":"2024-09-12T17:41:46.597917+0000","last_active":"2024-09-12T17:41:46.597917+0000","last_peered":"2024-09-12T17:41:46.597917+0000","last_clean":"2024-09-12T17:41:46.597917+0000","last_became_active":"2024-09-12T16:58:21.706953+0000","last_became_peered":"2024-09-12T16:58:21.706953+0000","last_unstale":"2024-09-12T17:41:46.597917+0000","last_undegraded":"2024-09-12T17:41:46.597917+0000","last_fullsized":"2024-09-12T17:41:46.597917+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'188","last_scrub_stamp":"2024-09-12T17:41:46.597688+0000","last_deep_scrub":"265'188","last_deep_scrub_stamp":"2024-09-12T17:41:46.597688+0000","last_clean_scrub_stamp":"2024-09-12T17:41:46.597688+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:59.955032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":782,"num_read_kb":644,"num_write":280,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"265'327","reported_seq":970,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:40.693027+0000","last_change":"2024-09-12T17:41:40.692867+0000","last_active":"2024-09-12T17:41:40.693027+0000","last_peered":"2024-09-12T17:41:40.693027+0000","last_clean":"2024-09-12T17:41:40.693027+0000","last_became_active":"2024-09-12T16:58:18.686189+0000","last_became_peered":"2024-09-12T16:58:18.686189+0000","last_unstale":"2024-09-12T17:41:40.693027+0000","last_undegraded":"2024-09-12T17:41:40.693027+0000","last_fullsized":"2024-09-12T17:41:40.693027+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'327","last_scrub_stamp":"2024-09-12T17:41:40.692633+0000","last_deep_scrub":"265'327","last_deep_scrub_stamp":"2024-09-12T17:41:40.692633+0000","last_clean_scrub_stamp":"2024-09-12T17:41:40.692633+0000","objects_scrubbed":8,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:55.491689+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":508,"num_read_kb":6575,"num_write":1048,"num_write_kb":19619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"265'4","reported_seq":1464,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:00.640441+0000","last_change":"2024-09-12T17:42:00.640441+0000","last_active":"2024-09-12T17:42:00.640441+0000","last_peered":"2024-09-12T17:42:00.640441+0000","last_clean":"2024-09-12T17:42:00.640441+0000","last_became_active":"2024-09-12T16:58:23.706471+0000","last_became_peered":"2024-09-12T16:58:23.706471+0000","last_unstale":"2024-09-12T17:42:00.640441+0000","last_undegraded":"2024-09-12T17:42:00.640441+0000","last_fullsized":"2024-09-12T17:42:00.640441+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T17:42:00.640250+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T17:42:00.640250+0000","last_clean_scrub_stamp":"2024-09-12T17:42:00.640250+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:54:34.722743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":956,"num_read_kb":956,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"265'83","reported_seq":611,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:03.588353+0000","last_change":"2024-09-12T17:42:03.588353+0000","last_active":"2024-09-12T17:42:03.588353+0000","last_peered":"2024-09-12T17:42:03.588353+0000","last_clean":"2024-09-12T17:42:03.588353+0000","last_became_active":"2024-09-12T16:58:25.949962+0000","last_became_peered":"2024-09-12T16:58:25.949962+0000","last_unstale":"2024-09-12T17:42:03.588353+0000","last_undegraded":"2024-09-12T17:42:03.588353+0000","last_fullsized":"2024-09-12T17:42:03.588353+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'83","last_scrub_stamp":"2024-09-12T17:42:03.588160+0000","last_deep_scrub":"265'83","last_deep_scrub_stamp":"2024-09-12T17:42:03.588160+0000","last_clean_scrub_stamp":"2024-09-12T17:42:03.588160+0000","objects_scrubbed":5,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:22.497976+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"265'758","reported_seq":4014,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:55.401310+0000","last_change":"2024-09-12T17:41:55.401310+0000","last_active":"2024-09-12T17:41:55.401310+0000","last_peered":"2024-09-12T17:41:55.401310+0000","last_clean":"2024-09-12T17:41:55.401310+0000","last_became_active":"2024-09-12T16:58:27.755569+0000","last_became_peered":"2024-09-12T16:58:27.755569+0000","last_unstale":"2024-09-12T17:41:55.401310+0000","last_undegraded":"2024-09-12T17:41:55.401310+0000","last_fullsized":"2024-09-12T17:41:55.401310+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'758","last_scrub_stamp":"2024-09-12T17:41:55.401154+0000","last_deep_scrub":"265'758","last_deep_scrub_stamp":"2024-09-12T17:41:55.401154+0000","last_clean_scrub_stamp":"2024-09-12T17:41:55.401154+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":700,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:49.415648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"265'116","reported_seq":633,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:13.582180+0000","last_change":"2024-09-12T17:42:13.581935+0000","last_active":"2024-09-12T17:42:13.582180+0000","last_peered":"2024-09-12T17:42:13.582180+0000","last_clean":"2024-09-12T17:42:13.582180+0000","last_became_active":"2024-09-12T16:58:29.780289+0000","last_became_peered":"2024-09-12T16:58:29.780289+0000","last_unstale":"2024-09-12T17:42:13.582180+0000","last_undegraded":"2024-09-12T17:42:13.582180+0000","last_fullsized":"2024-09-12T17:42:13.582180+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'116","last_scrub_stamp":"2024-09-12T17:42:13.581645+0000","last_deep_scrub":"265'116","last_deep_scrub_stamp":"2024-09-12T17:42:13.581645+0000","last_clean_scrub_stamp":"2024-09-12T17:42:13.581645+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:41.170590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":175,"num_write":267,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"265'140","reported_seq":805,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:51.379444+0000","last_change":"2024-09-12T17:41:51.379444+0000","last_active":"2024-09-12T17:41:51.379444+0000","last_peered":"2024-09-12T17:41:51.379444+0000","last_clean":"2024-09-12T17:41:51.379444+0000","last_became_active":"2024-09-12T16:58:21.719827+0000","last_became_peered":"2024-09-12T16:58:21.719827+0000","last_unstale":"2024-09-12T17:41:51.379444+0000","last_undegraded":"2024-09-12T17:41:51.379444+0000","last_fullsized":"2024-09-12T17:41:51.379444+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'140","last_scrub_stamp":"2024-09-12T17:41:51.379265+0000","last_deep_scrub":"265'140","last_deep_scrub_stamp":"2024-09-12T17:41:51.379265+0000","last_clean_scrub_stamp":"2024-09-12T17:41:51.379265+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:58.481342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":689,"num_read_kb":590,"num_write":204,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"265'335","reported_seq":990,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:39.806722+0000","last_change":"2024-09-12T17:41:39.806619+0000","last_active":"2024-09-12T17:41:39.806722+0000","last_peered":"2024-09-12T17:41:39.806722+0000","last_clean":"2024-09-12T17:41:39.806722+0000","last_became_active":"2024-09-12T16:58:18.705048+0000","last_became_peered":"2024-09-12T16:58:18.705048+0000","last_unstale":"2024-09-12T17:41:39.806722+0000","last_undegraded":"2024-09-12T17:41:39.806722+0000","last_fullsized":"2024-09-12T17:41:39.806722+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'335","last_scrub_stamp":"2024-09-12T17:41:39.806418+0000","last_deep_scrub":"265'335","last_deep_scrub_stamp":"2024-09-12T17:41:39.806418+0000","last_clean_scrub_stamp":"2024-09-12T17:41:39.806418+0000","objects_scrubbed":8,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:11.826972+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2227678,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":497,"num_read_kb":3392,"num_write":1050,"num_write_kb":22669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"265'6","reported_seq":988,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:00.663027+0000","last_change":"2024-09-12T17:42:00.663027+0000","last_active":"2024-09-12T17:42:00.663027+0000","last_peered":"2024-09-12T17:42:00.663027+0000","last_clean":"2024-09-12T17:42:00.663027+0000","last_became_active":"2024-09-12T16:58:23.702699+0000","last_became_peered":"2024-09-12T16:58:23.702699+0000","last_unstale":"2024-09-12T17:42:00.663027+0000","last_undegraded":"2024-09-12T17:42:00.663027+0000","last_fullsized":"2024-09-12T17:42:00.663027+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T17:42:00.662845+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T17:42:00.662845+0000","last_clean_scrub_stamp":"2024-09-12T17:42:00.662845+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:03.303674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":729,"num_read_kb":1194,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"265'352","reported_seq":964,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:06.599729+0000","last_change":"2024-09-12T17:42:06.599729+0000","last_active":"2024-09-12T17:42:06.599729+0000","last_peered":"2024-09-12T17:42:06.599729+0000","last_clean":"2024-09-12T17:42:06.599729+0000","last_became_active":"2024-09-12T16:58:25.724694+0000","last_became_peered":"2024-09-12T16:58:25.724694+0000","last_unstale":"2024-09-12T17:42:06.599729+0000","last_undegraded":"2024-09-12T17:42:06.599729+0000","last_fullsized":"2024-09-12T17:42:06.599729+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'352","last_scrub_stamp":"2024-09-12T17:42:06.599476+0000","last_deep_scrub":"265'352","last_deep_scrub_stamp":"2024-09-12T17:42:06.599476+0000","last_clean_scrub_stamp":"2024-09-12T17:42:06.599476+0000","objects_scrubbed":8,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:48.102438+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52076,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":562,"num_read_kb":1199,"num_write":444,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:56.381658+0000","last_change":"2024-09-12T17:41:56.381658+0000","last_active":"2024-09-12T17:41:56.381658+0000","last_peered":"2024-09-12T17:41:56.381658+0000","last_clean":"2024-09-12T17:41:56.381658+0000","last_became_active":"2024-09-12T16:58:27.740510+0000","last_became_peered":"2024-09-12T16:58:27.740510+0000","last_unstale":"2024-09-12T17:41:56.381658+0000","last_undegraded":"2024-09-12T17:41:56.381658+0000","last_fullsized":"2024-09-12T17:41:56.381658+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:56.381466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:56.381466+0000","last_clean_scrub_stamp":"2024-09-12T17:41:56.381466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:56.865452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"265'130","reported_seq":631,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:03.451882+0000","last_change":"2024-09-12T17:42:03.451743+0000","last_active":"2024-09-12T17:42:03.451882+0000","last_peered":"2024-09-12T17:42:03.451882+0000","last_clean":"2024-09-12T17:42:03.451882+0000","last_became_active":"2024-09-12T16:58:29.776007+0000","last_became_peered":"2024-09-12T16:58:29.776007+0000","last_unstale":"2024-09-12T17:42:03.451882+0000","last_undegraded":"2024-09-12T17:42:03.451882+0000","last_fullsized":"2024-09-12T17:42:03.451882+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'130","last_scrub_stamp":"2024-09-12T17:42:03.451565+0000","last_deep_scrub":"265'130","last_deep_scrub_stamp":"2024-09-12T17:42:03.451565+0000","last_clean_scrub_stamp":"2024-09-12T17:42:03.451565+0000","objects_scrubbed":3,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:21.254085+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":162,"num_read_kb":158,"num_write":308,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"265'143","reported_seq":764,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:49.448232+0000","last_change":"2024-09-12T17:41:49.448084+0000","last_active":"2024-09-12T17:41:49.448232+0000","last_peered":"2024-09-12T17:41:49.448232+0000","last_clean":"2024-09-12T17:41:49.448232+0000","last_became_active":"2024-09-12T16:58:21.726160+0000","last_became_peered":"2024-09-12T16:58:21.726160+0000","last_unstale":"2024-09-12T17:41:49.448232+0000","last_undegraded":"2024-09-12T17:41:49.448232+0000","last_fullsized":"2024-09-12T17:41:49.448232+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'143","last_scrub_stamp":"2024-09-12T17:41:49.447779+0000","last_deep_scrub":"265'143","last_deep_scrub_stamp":"2024-09-12T17:41:49.447779+0000","last_clean_scrub_stamp":"2024-09-12T17:41:49.447779+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:59.351840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":643,"num_read_kb":537,"num_write":216,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"265'74","reported_seq":623,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:40.572560+0000","last_change":"2024-09-12T17:41:40.572415+0000","last_active":"2024-09-12T17:41:40.572560+0000","last_peered":"2024-09-12T17:41:40.572560+0000","last_clean":"2024-09-12T17:41:40.572560+0000","last_became_active":"2024-09-12T16:58:04.216387+0000","last_became_peered":"2024-09-12T16:58:04.216387+0000","last_unstale":"2024-09-12T17:41:40.572560+0000","last_undegraded":"2024-09-12T17:41:40.572560+0000","last_fullsized":"2024-09-12T17:41:40.572560+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'74","last_scrub_stamp":"2024-09-12T17:41:40.572242+0000","last_deep_scrub":"265'74","last_deep_scrub_stamp":"2024-09-12T17:41:40.572242+0000","last_clean_scrub_stamp":"2024-09-12T17:41:40.572242+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:51.726519+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"265'2","reported_seq":531,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:40.628344+0000","last_change":"2024-09-12T17:41:40.628219+0000","last_active":"2024-09-12T17:41:40.628344+0000","last_peered":"2024-09-12T17:41:40.628344+0000","last_clean":"2024-09-12T17:41:40.628344+0000","last_became_active":"2024-09-12T16:58:08.538227+0000","last_became_peered":"2024-09-12T16:58:08.538227+0000","last_unstale":"2024-09-12T17:41:40.628344+0000","last_undegraded":"2024-09-12T17:41:40.628344+0000","last_fullsized":"2024-09-12T17:41:40.628344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T17:41:40.628040+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T17:41:40.628040+0000","last_clean_scrub_stamp":"2024-09-12T17:41:40.628040+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:51.377305+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.001171044,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"265'366","reported_seq":1000,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:40.595467+0000","last_change":"2024-09-12T17:41:40.595467+0000","last_active":"2024-09-12T17:41:40.595467+0000","last_peered":"2024-09-12T17:41:40.595467+0000","last_clean":"2024-09-12T17:41:40.595467+0000","last_became_active":"2024-09-12T16:58:55.957231+0000","last_became_peered":"2024-09-12T16:58:55.957231+0000","last_unstale":"2024-09-12T17:41:40.595467+0000","last_undegraded":"2024-09-12T17:41:40.595467+0000","last_fullsized":"2024-09-12T17:41:40.595467+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'366","last_scrub_stamp":"2024-09-12T17:41:40.595232+0000","last_deep_scrub":"265'366","last_deep_scrub_stamp":"2024-09-12T17:41:40.595232+0000","last_clean_scrub_stamp":"2024-09-12T17:41:40.595232+0000","objects_scrubbed":8,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:19.557999+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159822,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":551,"num_read_kb":44871,"num_write":1125,"num_write_kb":45418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"265'4","reported_seq":989,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:58.751673+0000","last_change":"2024-09-12T17:41:58.751528+0000","last_active":"2024-09-12T17:41:58.751673+0000","last_peered":"2024-09-12T17:41:58.751673+0000","last_clean":"2024-09-12T17:41:58.751673+0000","last_became_active":"2024-09-12T16:58:23.718720+0000","last_became_peered":"2024-09-12T16:58:23.718720+0000","last_unstale":"2024-09-12T17:41:58.751673+0000","last_undegraded":"2024-09-12T17:41:58.751673+0000","last_fullsized":"2024-09-12T17:41:58.751673+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T17:41:58.751313+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T17:41:58.751313+0000","last_clean_scrub_stamp":"2024-09-12T17:41:58.751313+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:58.563273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":725,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"265'694","reported_seq":1404,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:04.586463+0000","last_change":"2024-09-12T17:42:04.586463+0000","last_active":"2024-09-12T17:42:04.586463+0000","last_peered":"2024-09-12T17:42:04.586463+0000","last_clean":"2024-09-12T17:42:04.586463+0000","last_became_active":"2024-09-12T16:58:25.720741+0000","last_became_peered":"2024-09-12T16:58:25.720741+0000","last_unstale":"2024-09-12T17:42:04.586463+0000","last_undegraded":"2024-09-12T17:42:04.586463+0000","last_fullsized":"2024-09-12T17:42:04.586463+0000","mapping_epoch":30,"log_start":"265'600","ondisk_log_start":"265'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'694","last_scrub_stamp":"2024-09-12T17:42:04.586272+0000","last_deep_scrub":"265'694","last_deep_scrub_stamp":"2024-09-12T17:42:04.586272+0000","last_clean_scrub_stamp":"2024-09-12T17:42:04.586272+0000","objects_scrubbed":6,"log_size":94,"log_dups_size":600,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:25.161493+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142315,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1357,"num_read_kb":3135,"num_write":1250,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89176,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:06.902659+0000","last_change":"2024-09-12T17:42:06.902659+0000","last_active":"2024-09-12T17:42:06.902659+0000","last_peered":"2024-09-12T17:42:06.902659+0000","last_clean":"2024-09-12T17:42:06.902659+0000","last_became_active":"2024-09-12T16:58:27.746171+0000","last_became_peered":"2024-09-12T16:58:27.746171+0000","last_unstale":"2024-09-12T17:42:06.902659+0000","last_undegraded":"2024-09-12T17:42:06.902659+0000","last_fullsized":"2024-09-12T17:42:06.902659+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:06.902447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:06.902447+0000","last_clean_scrub_stamp":"2024-09-12T17:42:06.902447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:57.883611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"265'211","reported_seq":926,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:02.328227+0000","last_change":"2024-09-12T17:42:02.328227+0000","last_active":"2024-09-12T17:42:02.328227+0000","last_peered":"2024-09-12T17:42:02.328227+0000","last_clean":"2024-09-12T17:42:02.328227+0000","last_became_active":"2024-09-12T16:58:29.768536+0000","last_became_peered":"2024-09-12T16:58:29.768536+0000","last_unstale":"2024-09-12T17:42:02.328227+0000","last_undegraded":"2024-09-12T17:42:02.328227+0000","last_fullsized":"2024-09-12T17:42:02.328227+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'211","last_scrub_stamp":"2024-09-12T17:42:02.328035+0000","last_deep_scrub":"265'211","last_deep_scrub_stamp":"2024-09-12T17:42:02.328035+0000","last_clean_scrub_stamp":"2024-09-12T17:42:02.328035+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:29.695906+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":520,"num_read_kb":510,"num_write":443,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"265'70","reported_seq":633,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:47.142743+0000","last_change":"2024-09-12T17:41:47.142743+0000","last_active":"2024-09-12T17:41:47.142743+0000","last_peered":"2024-09-12T17:41:47.142743+0000","last_clean":"2024-09-12T17:41:47.142743+0000","last_became_active":"2024-09-12T16:58:21.723703+0000","last_became_peered":"2024-09-12T16:58:21.723703+0000","last_unstale":"2024-09-12T17:41:47.142743+0000","last_undegraded":"2024-09-12T17:41:47.142743+0000","last_fullsized":"2024-09-12T17:41:47.142743+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'70","last_scrub_stamp":"2024-09-12T17:41:47.142558+0000","last_deep_scrub":"265'70","last_deep_scrub_stamp":"2024-09-12T17:41:47.142558+0000","last_clean_scrub_stamp":"2024-09-12T17:41:47.142558+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:44.829243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":317,"num_read_kb":265,"num_write":106,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":530,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:43.467758+0000","last_change":"2024-09-12T17:41:43.467257+0000","last_active":"2024-09-12T17:41:43.467758+0000","last_peered":"2024-09-12T17:41:43.467758+0000","last_clean":"2024-09-12T17:41:43.467758+0000","last_became_active":"2024-09-12T16:58:08.536415+0000","last_became_peered":"2024-09-12T16:58:08.536415+0000","last_unstale":"2024-09-12T17:41:43.467758+0000","last_undegraded":"2024-09-12T17:41:43.467758+0000","last_fullsized":"2024-09-12T17:41:43.467758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:43.467045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:43.467045+0000","last_clean_scrub_stamp":"2024-09-12T17:41:43.467045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:31.530851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001332909,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"265'329","reported_seq":984,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:38.253078+0000","last_change":"2024-09-12T17:41:38.252941+0000","last_active":"2024-09-12T17:41:38.253078+0000","last_peered":"2024-09-12T17:41:38.253078+0000","last_clean":"2024-09-12T17:41:38.253078+0000","last_became_active":"2024-09-12T16:58:18.695755+0000","last_became_peered":"2024-09-12T16:58:18.695755+0000","last_unstale":"2024-09-12T17:41:38.253078+0000","last_undegraded":"2024-09-12T17:41:38.253078+0000","last_fullsized":"2024-09-12T17:41:38.253078+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'329","last_scrub_stamp":"2024-09-12T17:41:38.252730+0000","last_deep_scrub":"265'329","last_deep_scrub_stamp":"2024-09-12T17:41:38.252730+0000","last_clean_scrub_stamp":"2024-09-12T17:41:38.252730+0000","objects_scrubbed":6,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:02.194179+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399184,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":538,"num_read_kb":2859,"num_write":1066,"num_write_kb":24939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:59.595833+0000","last_change":"2024-09-12T17:41:59.595833+0000","last_active":"2024-09-12T17:41:59.595833+0000","last_peered":"2024-09-12T17:41:59.595833+0000","last_clean":"2024-09-12T17:41:59.595833+0000","last_became_active":"2024-09-12T16:58:23.712354+0000","last_became_peered":"2024-09-12T16:58:23.712354+0000","last_unstale":"2024-09-12T17:41:59.595833+0000","last_undegraded":"2024-09-12T17:41:59.595833+0000","last_fullsized":"2024-09-12T17:41:59.595833+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:59.595625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:59.595625+0000","last_clean_scrub_stamp":"2024-09-12T17:41:59.595625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:30.801678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"265'1257","reported_seq":2723,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:58.441697+0000","last_change":"2024-09-12T17:41:58.441384+0000","last_active":"2024-09-12T17:41:58.441697+0000","last_peered":"2024-09-12T17:41:58.441697+0000","last_clean":"2024-09-12T17:41:58.441697+0000","last_became_active":"2024-09-12T16:58:25.720266+0000","last_became_peered":"2024-09-12T16:58:25.720266+0000","last_unstale":"2024-09-12T17:41:58.441697+0000","last_undegraded":"2024-09-12T17:41:58.441697+0000","last_fullsized":"2024-09-12T17:41:58.441697+0000","mapping_epoch":30,"log_start":"265'1200","ondisk_log_start":"265'1200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1257","last_scrub_stamp":"2024-09-12T17:41:58.441125+0000","last_deep_scrub":"265'1257","last_deep_scrub_stamp":"2024-09-12T17:41:58.441125+0000","last_clean_scrub_stamp":"2024-09-12T17:41:58.441125+0000","objects_scrubbed":11,"log_size":57,"log_dups_size":1200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:43.727748+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150793,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2049,"num_read_kb":3938,"num_write":1140,"num_write_kb":988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:07.701197+0000","last_change":"2024-09-12T17:42:07.701051+0000","last_active":"2024-09-12T17:42:07.701197+0000","last_peered":"2024-09-12T17:42:07.701197+0000","last_clean":"2024-09-12T17:42:07.701197+0000","last_became_active":"2024-09-12T16:58:27.745341+0000","last_became_peered":"2024-09-12T16:58:27.745341+0000","last_unstale":"2024-09-12T17:42:07.701197+0000","last_undegraded":"2024-09-12T17:42:07.701197+0000","last_fullsized":"2024-09-12T17:42:07.701197+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:07.700879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:07.700879+0000","last_clean_scrub_stamp":"2024-09-12T17:42:07.700879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:05.717581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"265'211","reported_seq":735,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:06.418399+0000","last_change":"2024-09-12T17:42:06.418399+0000","last_active":"2024-09-12T17:42:06.418399+0000","last_peered":"2024-09-12T17:42:06.418399+0000","last_clean":"2024-09-12T17:42:06.418399+0000","last_became_active":"2024-09-12T16:58:29.775944+0000","last_became_peered":"2024-09-12T16:58:29.775944+0000","last_unstale":"2024-09-12T17:42:06.418399+0000","last_undegraded":"2024-09-12T17:42:06.418399+0000","last_fullsized":"2024-09-12T17:42:06.418399+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'211","last_scrub_stamp":"2024-09-12T17:42:06.418203+0000","last_deep_scrub":"265'211","last_deep_scrub_stamp":"2024-09-12T17:42:06.418203+0000","last_clean_scrub_stamp":"2024-09-12T17:42:06.418203+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:04.604623+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":347,"num_read_kb":347,"num_write":464,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"265'122","reported_seq":683,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:47.372995+0000","last_change":"2024-09-12T17:41:47.372995+0000","last_active":"2024-09-12T17:41:47.372995+0000","last_peered":"2024-09-12T17:41:47.372995+0000","last_clean":"2024-09-12T17:41:47.372995+0000","last_became_active":"2024-09-12T16:58:21.721591+0000","last_became_peered":"2024-09-12T16:58:21.721591+0000","last_unstale":"2024-09-12T17:41:47.372995+0000","last_undegraded":"2024-09-12T17:41:47.372995+0000","last_fullsized":"2024-09-12T17:41:47.372995+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'122","last_scrub_stamp":"2024-09-12T17:41:47.372781+0000","last_deep_scrub":"265'122","last_deep_scrub_stamp":"2024-09-12T17:41:47.372781+0000","last_clean_scrub_stamp":"2024-09-12T17:41:47.372781+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:40.097427+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":495,"num_read_kb":400,"num_write":173,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":530,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:39.559720+0000","last_change":"2024-09-12T17:41:39.559674+0000","last_active":"2024-09-12T17:41:39.559720+0000","last_peered":"2024-09-12T17:41:39.559720+0000","last_clean":"2024-09-12T17:41:39.559720+0000","last_became_active":"2024-09-12T16:58:08.534076+0000","last_became_peered":"2024-09-12T16:58:08.534076+0000","last_unstale":"2024-09-12T17:41:39.559720+0000","last_undegraded":"2024-09-12T17:41:39.559720+0000","last_fullsized":"2024-09-12T17:41:39.559720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:39.559614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:39.559614+0000","last_clean_scrub_stamp":"2024-09-12T17:41:39.559614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:56.106176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00083305900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"265'316","reported_seq":946,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:38.395488+0000","last_change":"2024-09-12T17:41:38.395383+0000","last_active":"2024-09-12T17:41:38.395488+0000","last_peered":"2024-09-12T17:41:38.395488+0000","last_clean":"2024-09-12T17:41:38.395488+0000","last_became_active":"2024-09-12T16:58:18.702490+0000","last_became_peered":"2024-09-12T16:58:18.702490+0000","last_unstale":"2024-09-12T17:41:38.395488+0000","last_undegraded":"2024-09-12T17:41:38.395488+0000","last_fullsized":"2024-09-12T17:41:38.395488+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'316","last_scrub_stamp":"2024-09-12T17:41:38.395252+0000","last_deep_scrub":"265'316","last_deep_scrub_stamp":"2024-09-12T17:41:38.395252+0000","last_clean_scrub_stamp":"2024-09-12T17:41:38.395252+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:23.910993+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263185,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":455,"num_read_kb":7668,"num_write":1054,"num_write_kb":10637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"265'2","reported_seq":508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:45.506695+0000","last_change":"2024-09-12T17:41:45.506695+0000","last_active":"2024-09-12T17:41:45.506695+0000","last_peered":"2024-09-12T17:41:45.506695+0000","last_clean":"2024-09-12T17:41:45.506695+0000","last_became_active":"2024-09-12T16:58:23.724300+0000","last_became_peered":"2024-09-12T16:58:23.724300+0000","last_unstale":"2024-09-12T17:41:45.506695+0000","last_undegraded":"2024-09-12T17:41:45.506695+0000","last_fullsized":"2024-09-12T17:41:45.506695+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T17:41:45.506523+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T17:41:45.506523+0000","last_clean_scrub_stamp":"2024-09-12T17:41:45.506523+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:28.275981+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"265'239","reported_seq":1312,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:01.796160+0000","last_change":"2024-09-12T17:42:01.796002+0000","last_active":"2024-09-12T17:42:01.796160+0000","last_peered":"2024-09-12T17:42:01.796160+0000","last_clean":"2024-09-12T17:42:01.796160+0000","last_became_active":"2024-09-12T16:58:25.949120+0000","last_became_peered":"2024-09-12T16:58:25.949120+0000","last_unstale":"2024-09-12T17:42:01.796160+0000","last_undegraded":"2024-09-12T17:42:01.796160+0000","last_fullsized":"2024-09-12T17:42:01.796160+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'239","last_scrub_stamp":"2024-09-12T17:42:01.795779+0000","last_deep_scrub":"265'239","last_deep_scrub_stamp":"2024-09-12T17:42:01.795779+0000","last_clean_scrub_stamp":"2024-09-12T17:42:01.795779+0000","objects_scrubbed":9,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:22.527870+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":178,"num_read_kb":168,"num_write":143,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5278,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:02.853267+0000","last_change":"2024-09-12T17:42:02.853131+0000","last_active":"2024-09-12T17:42:02.853267+0000","last_peered":"2024-09-12T17:42:02.853267+0000","last_clean":"2024-09-12T17:42:02.853267+0000","last_became_active":"2024-09-12T16:58:27.736215+0000","last_became_peered":"2024-09-12T16:58:27.736215+0000","last_unstale":"2024-09-12T17:42:02.853267+0000","last_undegraded":"2024-09-12T17:42:02.853267+0000","last_fullsized":"2024-09-12T17:42:02.853267+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:02.852940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:02.852940+0000","last_clean_scrub_stamp":"2024-09-12T17:42:02.852940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:03.518647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"265'255","reported_seq":869,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:13.572723+0000","last_change":"2024-09-12T17:42:13.572723+0000","last_active":"2024-09-12T17:42:13.572723+0000","last_peered":"2024-09-12T17:42:13.572723+0000","last_clean":"2024-09-12T17:42:13.572723+0000","last_became_active":"2024-09-12T16:58:29.792069+0000","last_became_peered":"2024-09-12T16:58:29.792069+0000","last_unstale":"2024-09-12T17:42:13.572723+0000","last_undegraded":"2024-09-12T17:42:13.572723+0000","last_fullsized":"2024-09-12T17:42:13.572723+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'255","last_scrub_stamp":"2024-09-12T17:42:13.572532+0000","last_deep_scrub":"265'255","last_deep_scrub_stamp":"2024-09-12T17:42:13.572532+0000","last_clean_scrub_stamp":"2024-09-12T17:42:13.572532+0000","objects_scrubbed":6,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:14.576924+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1041,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":529,"num_read_kb":546,"num_write":531,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"265'182","reported_seq":847,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:44.368918+0000","last_change":"2024-09-12T17:41:44.368734+0000","last_active":"2024-09-12T17:41:44.368918+0000","last_peered":"2024-09-12T17:41:44.368918+0000","last_clean":"2024-09-12T17:41:44.368918+0000","last_became_active":"2024-09-12T16:58:21.729848+0000","last_became_peered":"2024-09-12T16:58:21.729848+0000","last_unstale":"2024-09-12T17:41:44.368918+0000","last_undegraded":"2024-09-12T17:41:44.368918+0000","last_fullsized":"2024-09-12T17:41:44.368918+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'182","last_scrub_stamp":"2024-09-12T17:41:44.368559+0000","last_deep_scrub":"265'182","last_deep_scrub_stamp":"2024-09-12T17:41:44.368559+0000","last_clean_scrub_stamp":"2024-09-12T17:41:44.368559+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:17.854539+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":860,"num_read_kb":722,"num_write":267,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"265'3","reported_seq":532,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:39.591713+0000","last_change":"2024-09-12T17:41:39.591479+0000","last_active":"2024-09-12T17:41:39.591713+0000","last_peered":"2024-09-12T17:41:39.591713+0000","last_clean":"2024-09-12T17:41:39.591713+0000","last_became_active":"2024-09-12T16:58:08.538078+0000","last_became_peered":"2024-09-12T16:58:08.538078+0000","last_unstale":"2024-09-12T17:41:39.591713+0000","last_undegraded":"2024-09-12T17:41:39.591713+0000","last_fullsized":"2024-09-12T17:41:39.591713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T17:41:39.591211+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T17:41:39.591211+0000","last_clean_scrub_stamp":"2024-09-12T17:41:39.591211+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:33.661873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012028640000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"265'367","reported_seq":1087,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:38.629163+0000","last_change":"2024-09-12T17:41:38.629003+0000","last_active":"2024-09-12T17:41:38.629163+0000","last_peered":"2024-09-12T17:41:38.629163+0000","last_clean":"2024-09-12T17:41:38.629163+0000","last_became_active":"2024-09-12T16:58:18.690974+0000","last_became_peered":"2024-09-12T16:58:18.690974+0000","last_unstale":"2024-09-12T17:41:38.629163+0000","last_undegraded":"2024-09-12T17:41:38.629163+0000","last_fullsized":"2024-09-12T17:41:38.629163+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'367","last_scrub_stamp":"2024-09-12T17:41:38.628803+0000","last_deep_scrub":"265'367","last_deep_scrub_stamp":"2024-09-12T17:41:38.628803+0000","last_clean_scrub_stamp":"2024-09-12T17:41:38.628803+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:15.373546+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1105801,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":657,"num_read_kb":31815,"num_write":1139,"num_write_kb":57340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:56.985235+0000","last_change":"2024-09-12T17:41:56.985088+0000","last_active":"2024-09-12T17:41:56.985235+0000","last_peered":"2024-09-12T17:41:56.985235+0000","last_clean":"2024-09-12T17:41:56.985235+0000","last_became_active":"2024-09-12T16:58:23.713019+0000","last_became_peered":"2024-09-12T16:58:23.713019+0000","last_unstale":"2024-09-12T17:41:56.985235+0000","last_undegraded":"2024-09-12T17:41:56.985235+0000","last_fullsized":"2024-09-12T17:41:56.985235+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:56.984910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:56.984910+0000","last_clean_scrub_stamp":"2024-09-12T17:41:56.984910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:28.683508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"265'113","reported_seq":663,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:02.605508+0000","last_change":"2024-09-12T17:42:02.605508+0000","last_active":"2024-09-12T17:42:02.605508+0000","last_peered":"2024-09-12T17:42:02.605508+0000","last_clean":"2024-09-12T17:42:02.605508+0000","last_became_active":"2024-09-12T16:58:25.718364+0000","last_became_peered":"2024-09-12T16:58:25.718364+0000","last_unstale":"2024-09-12T17:42:02.605508+0000","last_undegraded":"2024-09-12T17:42:02.605508+0000","last_fullsized":"2024-09-12T17:42:02.605508+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'113","last_scrub_stamp":"2024-09-12T17:42:02.605277+0000","last_deep_scrub":"265'113","last_deep_scrub_stamp":"2024-09-12T17:42:02.605277+0000","last_clean_scrub_stamp":"2024-09-12T17:42:02.605277+0000","objects_scrubbed":7,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:02.779136+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":134,"num_write":100,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3358,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:58.366963+0000","last_change":"2024-09-12T17:41:58.366963+0000","last_active":"2024-09-12T17:41:58.366963+0000","last_peered":"2024-09-12T17:41:58.366963+0000","last_clean":"2024-09-12T17:41:58.366963+0000","last_became_active":"2024-09-12T16:58:27.761992+0000","last_became_peered":"2024-09-12T16:58:27.761992+0000","last_unstale":"2024-09-12T17:41:58.366963+0000","last_undegraded":"2024-09-12T17:41:58.366963+0000","last_fullsized":"2024-09-12T17:41:58.366963+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:58.366783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:58.366783+0000","last_clean_scrub_stamp":"2024-09-12T17:41:58.366783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:00.374257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"265'110","reported_seq":672,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:10.566248+0000","last_change":"2024-09-12T17:42:10.566248+0000","last_active":"2024-09-12T17:42:10.566248+0000","last_peered":"2024-09-12T17:42:10.566248+0000","last_clean":"2024-09-12T17:42:10.566248+0000","last_became_active":"2024-09-12T16:58:29.787823+0000","last_became_peered":"2024-09-12T16:58:29.787823+0000","last_unstale":"2024-09-12T17:42:10.566248+0000","last_undegraded":"2024-09-12T17:42:10.566248+0000","last_fullsized":"2024-09-12T17:42:10.566248+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'110","last_scrub_stamp":"2024-09-12T17:42:10.566058+0000","last_deep_scrub":"265'110","last_deep_scrub_stamp":"2024-09-12T17:42:10.566058+0000","last_clean_scrub_stamp":"2024-09-12T17:42:10.566058+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:05.960107+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":275,"num_read_kb":264,"num_write":276,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"265'60","reported_seq":622,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:46.382523+0000","last_change":"2024-09-12T17:41:46.382243+0000","last_active":"2024-09-12T17:41:46.382523+0000","last_peered":"2024-09-12T17:41:46.382523+0000","last_clean":"2024-09-12T17:41:46.382523+0000","last_became_active":"2024-09-12T16:58:21.720884+0000","last_became_peered":"2024-09-12T16:58:21.720884+0000","last_unstale":"2024-09-12T17:41:46.382523+0000","last_undegraded":"2024-09-12T17:41:46.382523+0000","last_fullsized":"2024-09-12T17:41:46.382523+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'60","last_scrub_stamp":"2024-09-12T17:41:46.382003+0000","last_deep_scrub":"265'60","last_deep_scrub_stamp":"2024-09-12T17:41:46.382003+0000","last_clean_scrub_stamp":"2024-09-12T17:41:46.382003+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:39.632797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":223,"num_write":91,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"265'382","reported_seq":1037,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:41.628013+0000","last_change":"2024-09-12T17:41:41.627826+0000","last_active":"2024-09-12T17:41:41.628013+0000","last_peered":"2024-09-12T17:41:41.628013+0000","last_clean":"2024-09-12T17:41:41.628013+0000","last_became_active":"2024-09-12T16:58:18.718447+0000","last_became_peered":"2024-09-12T16:58:18.718447+0000","last_unstale":"2024-09-12T17:41:41.628013+0000","last_undegraded":"2024-09-12T17:41:41.628013+0000","last_fullsized":"2024-09-12T17:41:41.628013+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'382","last_scrub_stamp":"2024-09-12T17:41:41.627618+0000","last_deep_scrub":"265'382","last_deep_scrub_stamp":"2024-09-12T17:41:41.627618+0000","last_clean_scrub_stamp":"2024-09-12T17:41:41.627618+0000","objects_scrubbed":6,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:27.860391+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569509,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":515,"num_read_kb":35874,"num_write":1210,"num_write_kb":51856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:39.427247+0000","last_change":"2024-09-12T17:41:39.427122+0000","last_active":"2024-09-12T17:41:39.427247+0000","last_peered":"2024-09-12T17:41:39.427247+0000","last_clean":"2024-09-12T17:41:39.427247+0000","last_became_active":"2024-09-12T16:58:08.842793+0000","last_became_peered":"2024-09-12T16:58:08.842793+0000","last_unstale":"2024-09-12T17:41:39.427247+0000","last_undegraded":"2024-09-12T17:41:39.427247+0000","last_fullsized":"2024-09-12T17:41:39.427247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:39.426951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:39.426951+0000","last_clean_scrub_stamp":"2024-09-12T17:41:39.426951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:26.839539+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001121181,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:55.062525+0000","last_change":"2024-09-12T17:41:55.062333+0000","last_active":"2024-09-12T17:41:55.062525+0000","last_peered":"2024-09-12T17:41:55.062525+0000","last_clean":"2024-09-12T17:41:55.062525+0000","last_became_active":"2024-09-12T16:58:23.710355+0000","last_became_peered":"2024-09-12T16:58:23.710355+0000","last_unstale":"2024-09-12T17:41:55.062525+0000","last_undegraded":"2024-09-12T17:41:55.062525+0000","last_fullsized":"2024-09-12T17:41:55.062525+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:55.062149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:55.062149+0000","last_clean_scrub_stamp":"2024-09-12T17:41:55.062149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:43.683368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"265'579","reported_seq":1248,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:00.973116+0000","last_change":"2024-09-12T17:42:00.972950+0000","last_active":"2024-09-12T17:42:00.973116+0000","last_peered":"2024-09-12T17:42:00.973116+0000","last_clean":"2024-09-12T17:42:00.973116+0000","last_became_active":"2024-09-12T16:58:25.729627+0000","last_became_peered":"2024-09-12T16:58:25.729627+0000","last_unstale":"2024-09-12T17:42:00.973116+0000","last_undegraded":"2024-09-12T17:42:00.973116+0000","last_fullsized":"2024-09-12T17:42:00.973116+0000","mapping_epoch":30,"log_start":"265'500","ondisk_log_start":"265'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'579","last_scrub_stamp":"2024-09-12T17:42:00.972736+0000","last_deep_scrub":"265'579","last_deep_scrub_stamp":"2024-09-12T17:42:00.972736+0000","last_clean_scrub_stamp":"2024-09-12T17:42:00.972736+0000","objects_scrubbed":11,"log_size":79,"log_dups_size":500,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:33.694731+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101207,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1575,"num_read_kb":2772,"num_write":2032,"num_write_kb":1870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":506974,"num_omap_keys":1146,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:07.590551+0000","last_change":"2024-09-12T17:42:07.590263+0000","last_active":"2024-09-12T17:42:07.590551+0000","last_peered":"2024-09-12T17:42:07.590551+0000","last_clean":"2024-09-12T17:42:07.590551+0000","last_became_active":"2024-09-12T16:58:27.733289+0000","last_became_peered":"2024-09-12T16:58:27.733289+0000","last_unstale":"2024-09-12T17:42:07.590551+0000","last_undegraded":"2024-09-12T17:42:07.590551+0000","last_fullsized":"2024-09-12T17:42:07.590551+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:07.590042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:07.590042+0000","last_clean_scrub_stamp":"2024-09-12T17:42:07.590042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:02.078261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"265'161","reported_seq":673,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:13.948775+0000","last_change":"2024-09-12T17:42:13.948775+0000","last_active":"2024-09-12T17:42:13.948775+0000","last_peered":"2024-09-12T17:42:13.948775+0000","last_clean":"2024-09-12T17:42:13.948775+0000","last_became_active":"2024-09-12T16:58:29.779052+0000","last_became_peered":"2024-09-12T16:58:29.779052+0000","last_unstale":"2024-09-12T17:42:13.948775+0000","last_undegraded":"2024-09-12T17:42:13.948775+0000","last_fullsized":"2024-09-12T17:42:13.948775+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'161","last_scrub_stamp":"2024-09-12T17:42:13.948585+0000","last_deep_scrub":"265'161","last_deep_scrub_stamp":"2024-09-12T17:42:13.948585+0000","last_clean_scrub_stamp":"2024-09-12T17:42:13.948585+0000","objects_scrubbed":4,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:24.925033+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":199,"num_read_kb":192,"num_write":361,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"265'202","reported_seq":815,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:46.191761+0000","last_change":"2024-09-12T17:41:46.191587+0000","last_active":"2024-09-12T17:41:46.191761+0000","last_peered":"2024-09-12T17:41:46.191761+0000","last_clean":"2024-09-12T17:41:46.191761+0000","last_became_active":"2024-09-12T16:58:21.701657+0000","last_became_peered":"2024-09-12T16:58:21.701657+0000","last_unstale":"2024-09-12T17:41:46.191761+0000","last_undegraded":"2024-09-12T17:41:46.191761+0000","last_fullsized":"2024-09-12T17:41:46.191761+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'202","last_scrub_stamp":"2024-09-12T17:41:46.191396+0000","last_deep_scrub":"265'202","last_deep_scrub_stamp":"2024-09-12T17:41:46.191396+0000","last_clean_scrub_stamp":"2024-09-12T17:41:46.191396+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:56.805877+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":888,"num_read_kb":728,"num_write":297,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"265'333","reported_seq":966,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:42.447729+0000","last_change":"2024-09-12T17:41:42.447586+0000","last_active":"2024-09-12T17:41:42.447729+0000","last_peered":"2024-09-12T17:41:42.447729+0000","last_clean":"2024-09-12T17:41:42.447729+0000","last_became_active":"2024-09-12T16:58:18.698417+0000","last_became_peered":"2024-09-12T16:58:18.698417+0000","last_unstale":"2024-09-12T17:41:42.447729+0000","last_undegraded":"2024-09-12T17:41:42.447729+0000","last_fullsized":"2024-09-12T17:41:42.447729+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'333","last_scrub_stamp":"2024-09-12T17:41:42.447381+0000","last_deep_scrub":"265'333","last_deep_scrub_stamp":"2024-09-12T17:41:42.447381+0000","last_clean_scrub_stamp":"2024-09-12T17:41:42.447381+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:25.913614+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":462,"num_read_kb":2498,"num_write":998,"num_write_kb":19196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:48.544743+0000","last_change":"2024-09-12T17:41:48.544587+0000","last_active":"2024-09-12T17:41:48.544743+0000","last_peered":"2024-09-12T17:41:48.544743+0000","last_clean":"2024-09-12T17:41:48.544743+0000","last_became_active":"2024-09-12T16:58:08.841831+0000","last_became_peered":"2024-09-12T16:58:08.841831+0000","last_unstale":"2024-09-12T17:41:48.544743+0000","last_undegraded":"2024-09-12T17:41:48.544743+0000","last_fullsized":"2024-09-12T17:41:48.544743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:48.544399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:48.544399+0000","last_clean_scrub_stamp":"2024-09-12T17:41:48.544399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:56.853257+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0013535820000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:52.494249+0000","last_change":"2024-09-12T17:41:52.494127+0000","last_active":"2024-09-12T17:41:52.494249+0000","last_peered":"2024-09-12T17:41:52.494249+0000","last_clean":"2024-09-12T17:41:52.494249+0000","last_became_active":"2024-09-12T16:58:23.707729+0000","last_became_peered":"2024-09-12T16:58:23.707729+0000","last_unstale":"2024-09-12T17:41:52.494249+0000","last_undegraded":"2024-09-12T17:41:52.494249+0000","last_fullsized":"2024-09-12T17:41:52.494249+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:52.493942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:52.493942+0000","last_clean_scrub_stamp":"2024-09-12T17:41:52.493942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:36.835671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"265'158","reported_seq":727,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:55.406020+0000","last_change":"2024-09-12T17:41:55.405867+0000","last_active":"2024-09-12T17:41:55.406020+0000","last_peered":"2024-09-12T17:41:55.406020+0000","last_clean":"2024-09-12T17:41:55.406020+0000","last_became_active":"2024-09-12T16:58:25.950057+0000","last_became_peered":"2024-09-12T16:58:25.950057+0000","last_unstale":"2024-09-12T17:41:55.406020+0000","last_undegraded":"2024-09-12T17:41:55.406020+0000","last_fullsized":"2024-09-12T17:41:55.406020+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'158","last_scrub_stamp":"2024-09-12T17:41:55.405681+0000","last_deep_scrub":"265'158","last_deep_scrub_stamp":"2024-09-12T17:41:55.405681+0000","last_clean_scrub_stamp":"2024-09-12T17:41:55.405681+0000","objects_scrubbed":8,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:53.277423+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":199,"num_read_kb":190,"num_write":134,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"265'771","reported_seq":2780,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:08.616365+0000","last_change":"2024-09-12T17:42:08.616222+0000","last_active":"2024-09-12T17:42:08.616365+0000","last_peered":"2024-09-12T17:42:08.616365+0000","last_clean":"2024-09-12T17:42:08.616365+0000","last_became_active":"2024-09-12T16:58:27.756883+0000","last_became_peered":"2024-09-12T16:58:27.756883+0000","last_unstale":"2024-09-12T17:42:08.616365+0000","last_undegraded":"2024-09-12T17:42:08.616365+0000","last_fullsized":"2024-09-12T17:42:08.616365+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'771","last_scrub_stamp":"2024-09-12T17:42:08.616048+0000","last_deep_scrub":"265'771","last_deep_scrub_stamp":"2024-09-12T17:42:08.616048+0000","last_clean_scrub_stamp":"2024-09-12T17:42:08.616048+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:03.636002+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"265'137","reported_seq":644,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:12.551289+0000","last_change":"2024-09-12T17:42:12.551289+0000","last_active":"2024-09-12T17:42:12.551289+0000","last_peered":"2024-09-12T17:42:12.551289+0000","last_clean":"2024-09-12T17:42:12.551289+0000","last_became_active":"2024-09-12T16:58:29.784743+0000","last_became_peered":"2024-09-12T16:58:29.784743+0000","last_unstale":"2024-09-12T17:42:12.551289+0000","last_undegraded":"2024-09-12T17:42:12.551289+0000","last_fullsized":"2024-09-12T17:42:12.551289+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'137","last_scrub_stamp":"2024-09-12T17:42:12.551048+0000","last_deep_scrub":"265'137","last_deep_scrub_stamp":"2024-09-12T17:42:12.551048+0000","last_clean_scrub_stamp":"2024-09-12T17:42:12.551048+0000","objects_scrubbed":6,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:55.389053+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1532,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":153,"num_read_kb":151,"num_write":316,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"265'50","reported_seq":596,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:46.640601+0000","last_change":"2024-09-12T17:41:46.640425+0000","last_active":"2024-09-12T17:41:46.640601+0000","last_peered":"2024-09-12T17:41:46.640601+0000","last_clean":"2024-09-12T17:41:46.640601+0000","last_became_active":"2024-09-12T16:58:21.723391+0000","last_became_peered":"2024-09-12T16:58:21.723391+0000","last_unstale":"2024-09-12T17:41:46.640601+0000","last_undegraded":"2024-09-12T17:41:46.640601+0000","last_fullsized":"2024-09-12T17:41:46.640601+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'50","last_scrub_stamp":"2024-09-12T17:41:46.640257+0000","last_deep_scrub":"265'50","last_deep_scrub_stamp":"2024-09-12T17:41:46.640257+0000","last_clean_scrub_stamp":"2024-09-12T17:41:46.640257+0000","objects_scrubbed":1,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:57.222046+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":182,"num_write":83,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":760,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"265'466","reported_seq":1113,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:38.799638+0000","last_change":"2024-09-12T17:41:38.799581+0000","last_active":"2024-09-12T17:41:38.799638+0000","last_peered":"2024-09-12T17:41:38.799638+0000","last_clean":"2024-09-12T17:41:38.799638+0000","last_became_active":"2024-09-12T16:58:18.686966+0000","last_became_peered":"2024-09-12T16:58:18.686966+0000","last_unstale":"2024-09-12T17:41:38.799638+0000","last_undegraded":"2024-09-12T17:41:38.799638+0000","last_fullsized":"2024-09-12T17:41:38.799638+0000","mapping_epoch":23,"log_start":"265'400","ondisk_log_start":"265'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'466","last_scrub_stamp":"2024-09-12T17:41:38.799492+0000","last_deep_scrub":"265'466","last_deep_scrub_stamp":"2024-09-12T17:41:38.799492+0000","last_clean_scrub_stamp":"2024-09-12T17:41:38.799492+0000","objects_scrubbed":7,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:31.946406+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376560,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":630,"num_read_kb":10296,"num_write":1224,"num_write_kb":24848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:37.425805+0000","last_change":"2024-09-12T17:41:37.425805+0000","last_active":"2024-09-12T17:41:37.425805+0000","last_peered":"2024-09-12T17:41:37.425805+0000","last_clean":"2024-09-12T17:41:37.425805+0000","last_became_active":"2024-09-12T16:58:08.544406+0000","last_became_peered":"2024-09-12T16:58:08.544406+0000","last_unstale":"2024-09-12T17:41:37.425805+0000","last_undegraded":"2024-09-12T17:41:37.425805+0000","last_fullsized":"2024-09-12T17:41:37.425805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:37.425638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:37.425638+0000","last_clean_scrub_stamp":"2024-09-12T17:41:37.425638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:38.294788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012247510000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:59.649035+0000","last_change":"2024-09-12T17:41:59.648870+0000","last_active":"2024-09-12T17:41:59.649035+0000","last_peered":"2024-09-12T17:41:59.649035+0000","last_clean":"2024-09-12T17:41:59.649035+0000","last_became_active":"2024-09-12T16:58:23.700331+0000","last_became_peered":"2024-09-12T16:58:23.700331+0000","last_unstale":"2024-09-12T17:41:59.649035+0000","last_undegraded":"2024-09-12T17:41:59.649035+0000","last_fullsized":"2024-09-12T17:41:59.649035+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:59.648693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:59.648693+0000","last_clean_scrub_stamp":"2024-09-12T17:41:59.648693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:33.328184+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"265'125","reported_seq":669,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:03.557099+0000","last_change":"2024-09-12T17:42:03.556962+0000","last_active":"2024-09-12T17:42:03.557099+0000","last_peered":"2024-09-12T17:42:03.557099+0000","last_clean":"2024-09-12T17:42:03.557099+0000","last_became_active":"2024-09-12T16:58:25.730018+0000","last_became_peered":"2024-09-12T16:58:25.730018+0000","last_unstale":"2024-09-12T17:42:03.557099+0000","last_undegraded":"2024-09-12T17:42:03.557099+0000","last_fullsized":"2024-09-12T17:42:03.557099+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'125","last_scrub_stamp":"2024-09-12T17:42:03.556760+0000","last_deep_scrub":"265'125","last_deep_scrub_stamp":"2024-09-12T17:42:03.556760+0000","last_clean_scrub_stamp":"2024-09-12T17:42:03.556760+0000","objects_scrubbed":6,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:04.648557+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":134,"num_read_kb":123,"num_write":96,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"265'787","reported_seq":2358,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:09.504241+0000","last_change":"2024-09-12T17:42:09.504081+0000","last_active":"2024-09-12T17:42:09.504241+0000","last_peered":"2024-09-12T17:42:09.504241+0000","last_clean":"2024-09-12T17:42:09.504241+0000","last_became_active":"2024-09-12T16:58:27.746177+0000","last_became_peered":"2024-09-12T16:58:27.746177+0000","last_unstale":"2024-09-12T17:42:09.504241+0000","last_undegraded":"2024-09-12T17:42:09.504241+0000","last_fullsized":"2024-09-12T17:42:09.504241+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'787","last_scrub_stamp":"2024-09-12T17:42:09.503916+0000","last_deep_scrub":"265'787","last_deep_scrub_stamp":"2024-09-12T17:42:09.503916+0000","last_clean_scrub_stamp":"2024-09-12T17:42:09.503916+0000","objects_scrubbed":1,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:19.410476+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"265'172","reported_seq":674,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:12.969049+0000","last_change":"2024-09-12T17:42:12.969049+0000","last_active":"2024-09-12T17:42:12.969049+0000","last_peered":"2024-09-12T17:42:12.969049+0000","last_clean":"2024-09-12T17:42:12.969049+0000","last_became_active":"2024-09-12T16:58:29.790535+0000","last_became_peered":"2024-09-12T16:58:29.790535+0000","last_unstale":"2024-09-12T17:42:12.969049+0000","last_undegraded":"2024-09-12T17:42:12.969049+0000","last_fullsized":"2024-09-12T17:42:12.969049+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'172","last_scrub_stamp":"2024-09-12T17:42:12.968804+0000","last_deep_scrub":"265'172","last_deep_scrub_stamp":"2024-09-12T17:42:12.968804+0000","last_clean_scrub_stamp":"2024-09-12T17:42:12.968804+0000","objects_scrubbed":4,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:51:37.815722+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":476,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":147,"num_read_kb":144,"num_write":393,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"265'96","reported_seq":669,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:43.661704+0000","last_change":"2024-09-12T17:41:43.661578+0000","last_active":"2024-09-12T17:41:43.661704+0000","last_peered":"2024-09-12T17:41:43.661704+0000","last_clean":"2024-09-12T17:41:43.661704+0000","last_became_active":"2024-09-12T16:58:21.701206+0000","last_became_peered":"2024-09-12T16:58:21.701206+0000","last_unstale":"2024-09-12T17:41:43.661704+0000","last_undegraded":"2024-09-12T17:41:43.661704+0000","last_fullsized":"2024-09-12T17:41:43.661704+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'96","last_scrub_stamp":"2024-09-12T17:41:43.661384+0000","last_deep_scrub":"265'96","last_deep_scrub_stamp":"2024-09-12T17:41:43.661384+0000","last_clean_scrub_stamp":"2024-09-12T17:41:43.661384+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:19.823171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":405,"num_read_kb":331,"num_write":157,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"265'370","reported_seq":1035,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:37.268281+0000","last_change":"2024-09-12T17:41:37.268183+0000","last_active":"2024-09-12T17:41:37.268281+0000","last_peered":"2024-09-12T17:41:37.268281+0000","last_clean":"2024-09-12T17:41:37.268281+0000","last_became_active":"2024-09-12T16:58:18.701270+0000","last_became_peered":"2024-09-12T16:58:18.701270+0000","last_unstale":"2024-09-12T17:41:37.268281+0000","last_undegraded":"2024-09-12T17:41:37.268281+0000","last_fullsized":"2024-09-12T17:41:37.268281+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'370","last_scrub_stamp":"2024-09-12T17:41:37.268034+0000","last_deep_scrub":"265'370","last_deep_scrub_stamp":"2024-09-12T17:41:37.268034+0000","last_clean_scrub_stamp":"2024-09-12T17:41:37.268034+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:22.095358+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":575,"num_read_kb":17292,"num_write":1132,"num_write_kb":31476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:39.456766+0000","last_change":"2024-09-12T17:41:39.456766+0000","last_active":"2024-09-12T17:41:39.456766+0000","last_peered":"2024-09-12T17:41:39.456766+0000","last_clean":"2024-09-12T17:41:39.456766+0000","last_became_active":"2024-09-12T16:58:08.546519+0000","last_became_peered":"2024-09-12T16:58:08.546519+0000","last_unstale":"2024-09-12T17:41:39.456766+0000","last_undegraded":"2024-09-12T17:41:39.456766+0000","last_fullsized":"2024-09-12T17:41:39.456766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:39.456592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:39.456592+0000","last_clean_scrub_stamp":"2024-09-12T17:41:39.456592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:55.571196+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00088376600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":510,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:00.527620+0000","last_change":"2024-09-12T17:42:00.527570+0000","last_active":"2024-09-12T17:42:00.527620+0000","last_peered":"2024-09-12T17:42:00.527620+0000","last_clean":"2024-09-12T17:42:00.527620+0000","last_became_active":"2024-09-12T16:58:23.707022+0000","last_became_peered":"2024-09-12T16:58:23.707022+0000","last_unstale":"2024-09-12T17:42:00.527620+0000","last_undegraded":"2024-09-12T17:42:00.527620+0000","last_fullsized":"2024-09-12T17:42:00.527620+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:00.527484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:00.527484+0000","last_clean_scrub_stamp":"2024-09-12T17:42:00.527484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:59.130451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"265'749","reported_seq":1475,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:04.776744+0000","last_change":"2024-09-12T17:42:04.776585+0000","last_active":"2024-09-12T17:42:04.776744+0000","last_peered":"2024-09-12T17:42:04.776744+0000","last_clean":"2024-09-12T17:42:04.776744+0000","last_became_active":"2024-09-12T16:58:25.949263+0000","last_became_peered":"2024-09-12T16:58:25.949263+0000","last_unstale":"2024-09-12T17:42:04.776744+0000","last_undegraded":"2024-09-12T17:42:04.776744+0000","last_fullsized":"2024-09-12T17:42:04.776744+0000","mapping_epoch":30,"log_start":"265'700","ondisk_log_start":"265'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'749","last_scrub_stamp":"2024-09-12T17:42:04.776391+0000","last_deep_scrub":"265'749","last_deep_scrub_stamp":"2024-09-12T17:42:04.776391+0000","last_clean_scrub_stamp":"2024-09-12T17:42:04.776391+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":700,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:08:09.245677+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143781,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1330,"num_read_kb":3188,"num_write":1090,"num_write_kb":918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:08.521874+0000","last_change":"2024-09-12T17:42:08.521720+0000","last_active":"2024-09-12T17:42:08.521874+0000","last_peered":"2024-09-12T17:42:08.521874+0000","last_clean":"2024-09-12T17:42:08.521874+0000","last_became_active":"2024-09-12T16:58:27.741779+0000","last_became_peered":"2024-09-12T16:58:27.741779+0000","last_unstale":"2024-09-12T17:42:08.521874+0000","last_undegraded":"2024-09-12T17:42:08.521874+0000","last_fullsized":"2024-09-12T17:42:08.521874+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:08.521530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:08.521530+0000","last_clean_scrub_stamp":"2024-09-12T17:42:08.521530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:15.340697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"265'146","reported_seq":656,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:11.551278+0000","last_change":"2024-09-12T17:42:11.551278+0000","last_active":"2024-09-12T17:42:11.551278+0000","last_peered":"2024-09-12T17:42:11.551278+0000","last_clean":"2024-09-12T17:42:11.551278+0000","last_became_active":"2024-09-12T16:58:29.787692+0000","last_became_peered":"2024-09-12T16:58:29.787692+0000","last_unstale":"2024-09-12T17:42:11.551278+0000","last_undegraded":"2024-09-12T17:42:11.551278+0000","last_fullsized":"2024-09-12T17:42:11.551278+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'146","last_scrub_stamp":"2024-09-12T17:42:11.551054+0000","last_deep_scrub":"265'146","last_deep_scrub_stamp":"2024-09-12T17:42:11.551054+0000","last_clean_scrub_stamp":"2024-09-12T17:42:11.551054+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:05.463173+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":218,"num_read_kb":207,"num_write":364,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"265'165","reported_seq":724,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:15.907409+0000","last_change":"2024-09-12T17:42:15.907275+0000","last_active":"2024-09-12T17:42:15.907409+0000","last_peered":"2024-09-12T17:42:15.907409+0000","last_clean":"2024-09-12T17:42:15.907409+0000","last_became_active":"2024-09-12T16:58:29.782784+0000","last_became_peered":"2024-09-12T16:58:29.782784+0000","last_unstale":"2024-09-12T17:42:15.907409+0000","last_undegraded":"2024-09-12T17:42:15.907409+0000","last_fullsized":"2024-09-12T17:42:15.907409+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'165","last_scrub_stamp":"2024-09-12T17:42:15.907089+0000","last_deep_scrub":"265'165","last_deep_scrub_stamp":"2024-09-12T17:42:15.907089+0000","last_clean_scrub_stamp":"2024-09-12T17:42:15.907089+0000","objects_scrubbed":3,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:34.767730+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":629,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":266,"num_read_kb":264,"num_write":397,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"265'100","reported_seq":695,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:47.569629+0000","last_change":"2024-09-12T17:41:47.569629+0000","last_active":"2024-09-12T17:41:47.569629+0000","last_peered":"2024-09-12T17:41:47.569629+0000","last_clean":"2024-09-12T17:41:47.569629+0000","last_became_active":"2024-09-12T16:58:21.731509+0000","last_became_peered":"2024-09-12T16:58:21.731509+0000","last_unstale":"2024-09-12T17:41:47.569629+0000","last_undegraded":"2024-09-12T17:41:47.569629+0000","last_fullsized":"2024-09-12T17:41:47.569629+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'100","last_scrub_stamp":"2024-09-12T17:41:47.569417+0000","last_deep_scrub":"265'100","last_deep_scrub_stamp":"2024-09-12T17:41:47.569417+0000","last_clean_scrub_stamp":"2024-09-12T17:41:47.569417+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:35.252758+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":445,"num_read_kb":375,"num_write":158,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"265'305","reported_seq":938,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:39.651915+0000","last_change":"2024-09-12T17:41:39.651915+0000","last_active":"2024-09-12T17:41:39.651915+0000","last_peered":"2024-09-12T17:41:39.651915+0000","last_clean":"2024-09-12T17:41:39.651915+0000","last_became_active":"2024-09-12T16:58:18.700214+0000","last_became_peered":"2024-09-12T16:58:18.700214+0000","last_unstale":"2024-09-12T17:41:39.651915+0000","last_undegraded":"2024-09-12T17:41:39.651915+0000","last_fullsized":"2024-09-12T17:41:39.651915+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'305","last_scrub_stamp":"2024-09-12T17:41:39.651676+0000","last_deep_scrub":"265'305","last_deep_scrub_stamp":"2024-09-12T17:41:39.651676+0000","last_clean_scrub_stamp":"2024-09-12T17:41:39.651676+0000","objects_scrubbed":6,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:32.335113+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":472,"num_read_kb":3767,"num_write":1042,"num_write_kb":19533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:53.398007+0000","last_change":"2024-09-12T17:41:53.398007+0000","last_active":"2024-09-12T17:41:53.398007+0000","last_peered":"2024-09-12T17:41:53.398007+0000","last_clean":"2024-09-12T17:41:53.398007+0000","last_became_active":"2024-09-12T16:58:23.725034+0000","last_became_peered":"2024-09-12T16:58:23.725034+0000","last_unstale":"2024-09-12T17:41:53.398007+0000","last_undegraded":"2024-09-12T17:41:53.398007+0000","last_fullsized":"2024-09-12T17:41:53.398007+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:53.397794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:53.397794+0000","last_clean_scrub_stamp":"2024-09-12T17:41:53.397794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:47.628035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"265'277","reported_seq":860,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:06.606460+0000","last_change":"2024-09-12T17:42:06.606460+0000","last_active":"2024-09-12T17:42:06.606460+0000","last_peered":"2024-09-12T17:42:06.606460+0000","last_clean":"2024-09-12T17:42:06.606460+0000","last_became_active":"2024-09-12T16:58:25.737706+0000","last_became_peered":"2024-09-12T16:58:25.737706+0000","last_unstale":"2024-09-12T17:42:06.606460+0000","last_undegraded":"2024-09-12T17:42:06.606460+0000","last_fullsized":"2024-09-12T17:42:06.606460+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'277","last_scrub_stamp":"2024-09-12T17:42:06.606252+0000","last_deep_scrub":"265'277","last_deep_scrub_stamp":"2024-09-12T17:42:06.606252+0000","last_clean_scrub_stamp":"2024-09-12T17:42:06.606252+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:10.416041+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54495,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":451,"num_read_kb":1025,"num_write":366,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:14.553135+0000","last_change":"2024-09-12T17:42:14.553135+0000","last_active":"2024-09-12T17:42:14.553135+0000","last_peered":"2024-09-12T17:42:14.553135+0000","last_clean":"2024-09-12T17:42:14.553135+0000","last_became_active":"2024-09-12T16:58:27.746143+0000","last_became_peered":"2024-09-12T16:58:27.746143+0000","last_unstale":"2024-09-12T17:42:14.553135+0000","last_undegraded":"2024-09-12T17:42:14.553135+0000","last_fullsized":"2024-09-12T17:42:14.553135+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:14.552932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:14.552932+0000","last_clean_scrub_stamp":"2024-09-12T17:42:14.552932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:22.802420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"265'116","reported_seq":634,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:18.559711+0000","last_change":"2024-09-12T17:42:18.559711+0000","last_active":"2024-09-12T17:42:18.559711+0000","last_peered":"2024-09-12T17:42:18.559711+0000","last_clean":"2024-09-12T17:42:18.559711+0000","last_became_active":"2024-09-12T16:58:29.784143+0000","last_became_peered":"2024-09-12T16:58:29.784143+0000","last_unstale":"2024-09-12T17:42:18.559711+0000","last_undegraded":"2024-09-12T17:42:18.559711+0000","last_fullsized":"2024-09-12T17:42:18.559711+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'116","last_scrub_stamp":"2024-09-12T17:42:18.559531+0000","last_deep_scrub":"265'116","last_deep_scrub_stamp":"2024-09-12T17:42:18.559531+0000","last_clean_scrub_stamp":"2024-09-12T17:42:18.559531+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:37.445695+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":186,"num_write":283,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"265'174","reported_seq":835,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:49.351699+0000","last_change":"2024-09-12T17:41:49.351699+0000","last_active":"2024-09-12T17:41:49.351699+0000","last_peered":"2024-09-12T17:41:49.351699+0000","last_clean":"2024-09-12T17:41:49.351699+0000","last_became_active":"2024-09-12T16:58:21.715193+0000","last_became_peered":"2024-09-12T16:58:21.715193+0000","last_unstale":"2024-09-12T17:41:49.351699+0000","last_undegraded":"2024-09-12T17:41:49.351699+0000","last_fullsized":"2024-09-12T17:41:49.351699+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'174","last_scrub_stamp":"2024-09-12T17:41:49.351495+0000","last_deep_scrub":"265'174","last_deep_scrub_stamp":"2024-09-12T17:41:49.351495+0000","last_clean_scrub_stamp":"2024-09-12T17:41:49.351495+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:24.477655+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":752,"num_read_kb":633,"num_write":248,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"265'344","reported_seq":980,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:47.512874+0000","last_change":"2024-09-12T17:41:47.512734+0000","last_active":"2024-09-12T17:41:47.512874+0000","last_peered":"2024-09-12T17:41:47.512874+0000","last_clean":"2024-09-12T17:41:47.512874+0000","last_became_active":"2024-09-12T16:58:18.686155+0000","last_became_peered":"2024-09-12T16:58:18.686155+0000","last_unstale":"2024-09-12T17:41:47.512874+0000","last_undegraded":"2024-09-12T17:41:47.512874+0000","last_fullsized":"2024-09-12T17:41:47.512874+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'344","last_scrub_stamp":"2024-09-12T17:41:47.512547+0000","last_deep_scrub":"265'344","last_deep_scrub_stamp":"2024-09-12T17:41:47.512547+0000","last_clean_scrub_stamp":"2024-09-12T17:41:47.512547+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:09.454509+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029079,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":528,"num_read_kb":20889,"num_write":1017,"num_write_kb":24291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:55.515139+0000","last_change":"2024-09-12T17:41:55.515139+0000","last_active":"2024-09-12T17:41:55.515139+0000","last_peered":"2024-09-12T17:41:55.515139+0000","last_clean":"2024-09-12T17:41:55.515139+0000","last_became_active":"2024-09-12T16:58:23.713069+0000","last_became_peered":"2024-09-12T16:58:23.713069+0000","last_unstale":"2024-09-12T17:41:55.515139+0000","last_undegraded":"2024-09-12T17:41:55.515139+0000","last_fullsized":"2024-09-12T17:41:55.515139+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:55.514956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:55.514956+0000","last_clean_scrub_stamp":"2024-09-12T17:41:55.514956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:26.580464+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"265'38","reported_seq":545,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:59.987428+0000","last_change":"2024-09-12T17:41:59.987428+0000","last_active":"2024-09-12T17:41:59.987428+0000","last_peered":"2024-09-12T17:41:59.987428+0000","last_clean":"2024-09-12T17:41:59.987428+0000","last_became_active":"2024-09-12T16:58:25.730410+0000","last_became_peered":"2024-09-12T16:58:25.730410+0000","last_unstale":"2024-09-12T17:41:59.987428+0000","last_undegraded":"2024-09-12T17:41:59.987428+0000","last_fullsized":"2024-09-12T17:41:59.987428+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'38","last_scrub_stamp":"2024-09-12T17:41:59.987182+0000","last_deep_scrub":"265'38","last_deep_scrub_stamp":"2024-09-12T17:41:59.987182+0000","last_clean_scrub_stamp":"2024-09-12T17:41:59.987182+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:57.218911+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:08.666588+0000","last_change":"2024-09-12T17:42:08.666588+0000","last_active":"2024-09-12T17:42:08.666588+0000","last_peered":"2024-09-12T17:42:08.666588+0000","last_clean":"2024-09-12T17:42:08.666588+0000","last_became_active":"2024-09-12T16:58:27.742979+0000","last_became_peered":"2024-09-12T16:58:27.742979+0000","last_unstale":"2024-09-12T17:42:08.666588+0000","last_undegraded":"2024-09-12T17:42:08.666588+0000","last_fullsized":"2024-09-12T17:42:08.666588+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:08.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:08.666400+0000","last_clean_scrub_stamp":"2024-09-12T17:42:08.666400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:38.590316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"265'209","reported_seq":737,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:14.947644+0000","last_change":"2024-09-12T17:42:14.947644+0000","last_active":"2024-09-12T17:42:14.947644+0000","last_peered":"2024-09-12T17:42:14.947644+0000","last_clean":"2024-09-12T17:42:14.947644+0000","last_became_active":"2024-09-12T16:58:29.782024+0000","last_became_peered":"2024-09-12T16:58:29.782024+0000","last_unstale":"2024-09-12T17:42:14.947644+0000","last_undegraded":"2024-09-12T17:42:14.947644+0000","last_fullsized":"2024-09-12T17:42:14.947644+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'209","last_scrub_stamp":"2024-09-12T17:42:14.947455+0000","last_deep_scrub":"265'209","last_deep_scrub_stamp":"2024-09-12T17:42:14.947455+0000","last_clean_scrub_stamp":"2024-09-12T17:42:14.947455+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:44.960259+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":358,"num_read_kb":350,"num_write":466,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"265'522","reported_seq":1262,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:52.511408+0000","last_change":"2024-09-12T17:41:52.511408+0000","last_active":"2024-09-12T17:41:52.511408+0000","last_peered":"2024-09-12T17:41:52.511408+0000","last_clean":"2024-09-12T17:41:52.511408+0000","last_became_active":"2024-09-12T16:58:21.711637+0000","last_became_peered":"2024-09-12T16:58:21.711637+0000","last_unstale":"2024-09-12T17:41:52.511408+0000","last_undegraded":"2024-09-12T17:41:52.511408+0000","last_fullsized":"2024-09-12T17:41:52.511408+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'522","last_scrub_stamp":"2024-09-12T17:41:52.511214+0000","last_deep_scrub":"265'522","last_deep_scrub_stamp":"2024-09-12T17:41:52.511214+0000","last_clean_scrub_stamp":"2024-09-12T17:41:52.511214+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:52.916702+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2547,"num_read_kb":2246,"num_write":971,"num_write_kb":585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2872,"num_omap_keys":12,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"265'374","reported_seq":985,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:37.559690+0000","last_change":"2024-09-12T17:41:37.559542+0000","last_active":"2024-09-12T17:41:37.559690+0000","last_peered":"2024-09-12T17:41:37.559690+0000","last_clean":"2024-09-12T17:41:37.559690+0000","last_became_active":"2024-09-12T16:58:55.851886+0000","last_became_peered":"2024-09-12T16:58:55.851886+0000","last_unstale":"2024-09-12T17:41:37.559690+0000","last_undegraded":"2024-09-12T17:41:37.559690+0000","last_fullsized":"2024-09-12T17:41:37.559690+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'374","last_scrub_stamp":"2024-09-12T17:41:37.559441+0000","last_deep_scrub":"265'374","last_deep_scrub_stamp":"2024-09-12T17:41:37.559441+0000","last_clean_scrub_stamp":"2024-09-12T17:41:37.559441+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:47.380450+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":696596,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":502,"num_read_kb":19430,"num_write":1218,"num_write_kb":23867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:00.759267+0000","last_change":"2024-09-12T17:42:00.759267+0000","last_active":"2024-09-12T17:42:00.759267+0000","last_peered":"2024-09-12T17:42:00.759267+0000","last_clean":"2024-09-12T17:42:00.759267+0000","last_became_active":"2024-09-12T16:58:23.718109+0000","last_became_peered":"2024-09-12T16:58:23.718109+0000","last_unstale":"2024-09-12T17:42:00.759267+0000","last_undegraded":"2024-09-12T17:42:00.759267+0000","last_fullsized":"2024-09-12T17:42:00.759267+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:00.759080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:00.759080+0000","last_clean_scrub_stamp":"2024-09-12T17:42:00.759080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:46.884251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"265'316","reported_seq":915,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:04.617758+0000","last_change":"2024-09-12T17:42:04.617758+0000","last_active":"2024-09-12T17:42:04.617758+0000","last_peered":"2024-09-12T17:42:04.617758+0000","last_clean":"2024-09-12T17:42:04.617758+0000","last_became_active":"2024-09-12T16:58:25.738463+0000","last_became_peered":"2024-09-12T16:58:25.738463+0000","last_unstale":"2024-09-12T17:42:04.617758+0000","last_undegraded":"2024-09-12T17:42:04.617758+0000","last_fullsized":"2024-09-12T17:42:04.617758+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'316","last_scrub_stamp":"2024-09-12T17:42:04.617550+0000","last_deep_scrub":"265'316","last_deep_scrub_stamp":"2024-09-12T17:42:04.617550+0000","last_clean_scrub_stamp":"2024-09-12T17:42:04.617550+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:04.259493+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46394,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":527,"num_read_kb":1194,"num_write":426,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:57.398743+0000","last_change":"2024-09-12T17:41:57.398743+0000","last_active":"2024-09-12T17:41:57.398743+0000","last_peered":"2024-09-12T17:41:57.398743+0000","last_clean":"2024-09-12T17:41:57.398743+0000","last_became_active":"2024-09-12T16:58:27.760265+0000","last_became_peered":"2024-09-12T16:58:27.760265+0000","last_unstale":"2024-09-12T17:41:57.398743+0000","last_undegraded":"2024-09-12T17:41:57.398743+0000","last_fullsized":"2024-09-12T17:41:57.398743+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:57.398482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:57.398482+0000","last_clean_scrub_stamp":"2024-09-12T17:41:57.398482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:40.065598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"265'146","reported_seq":683,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:15.601225+0000","last_change":"2024-09-12T17:42:15.601225+0000","last_active":"2024-09-12T17:42:15.601225+0000","last_peered":"2024-09-12T17:42:15.601225+0000","last_clean":"2024-09-12T17:42:15.601225+0000","last_became_active":"2024-09-12T16:58:29.776448+0000","last_became_peered":"2024-09-12T16:58:29.776448+0000","last_unstale":"2024-09-12T17:42:15.601225+0000","last_undegraded":"2024-09-12T17:42:15.601225+0000","last_fullsized":"2024-09-12T17:42:15.601225+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'146","last_scrub_stamp":"2024-09-12T17:42:15.601028+0000","last_deep_scrub":"265'146","last_deep_scrub_stamp":"2024-09-12T17:42:15.601028+0000","last_clean_scrub_stamp":"2024-09-12T17:42:15.601028+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:24.604237+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":253,"num_read_kb":229,"num_write":261,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"265'252","reported_seq":888,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:47.614719+0000","last_change":"2024-09-12T17:41:47.614719+0000","last_active":"2024-09-12T17:41:47.614719+0000","last_peered":"2024-09-12T17:41:47.614719+0000","last_clean":"2024-09-12T17:41:47.614719+0000","last_became_active":"2024-09-12T16:58:21.705619+0000","last_became_peered":"2024-09-12T16:58:21.705619+0000","last_unstale":"2024-09-12T17:41:47.614719+0000","last_undegraded":"2024-09-12T17:41:47.614719+0000","last_fullsized":"2024-09-12T17:41:47.614719+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'252","last_scrub_stamp":"2024-09-12T17:41:47.614536+0000","last_deep_scrub":"265'252","last_deep_scrub_stamp":"2024-09-12T17:41:47.614536+0000","last_clean_scrub_stamp":"2024-09-12T17:41:47.614536+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:16.229333+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1131,"num_read_kb":917,"num_write":399,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":504,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"265'315","reported_seq":968,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:40.264053+0000","last_change":"2024-09-12T17:41:40.263798+0000","last_active":"2024-09-12T17:41:40.264053+0000","last_peered":"2024-09-12T17:41:40.264053+0000","last_clean":"2024-09-12T17:41:40.264053+0000","last_became_active":"2024-09-12T16:58:18.700720+0000","last_became_peered":"2024-09-12T16:58:18.700720+0000","last_unstale":"2024-09-12T17:41:40.264053+0000","last_undegraded":"2024-09-12T17:41:40.264053+0000","last_fullsized":"2024-09-12T17:41:40.264053+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'315","last_scrub_stamp":"2024-09-12T17:41:40.263594+0000","last_deep_scrub":"265'315","last_deep_scrub_stamp":"2024-09-12T17:41:40.263594+0000","last_clean_scrub_stamp":"2024-09-12T17:41:40.263594+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:36.901664+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399159,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":424,"num_read_kb":68507,"num_write":939,"num_write_kb":27085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:53.480997+0000","last_change":"2024-09-12T17:41:53.480997+0000","last_active":"2024-09-12T17:41:53.480997+0000","last_peered":"2024-09-12T17:41:53.480997+0000","last_clean":"2024-09-12T17:41:53.480997+0000","last_became_active":"2024-09-12T16:58:23.721005+0000","last_became_peered":"2024-09-12T16:58:23.721005+0000","last_unstale":"2024-09-12T17:41:53.480997+0000","last_undegraded":"2024-09-12T17:41:53.480997+0000","last_fullsized":"2024-09-12T17:41:53.480997+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:53.480780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:53.480780+0000","last_clean_scrub_stamp":"2024-09-12T17:41:53.480780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:41.592134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"265'250","reported_seq":825,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:05.772201+0000","last_change":"2024-09-12T17:42:05.772201+0000","last_active":"2024-09-12T17:42:05.772201+0000","last_peered":"2024-09-12T17:42:05.772201+0000","last_clean":"2024-09-12T17:42:05.772201+0000","last_became_active":"2024-09-12T16:58:25.732956+0000","last_became_peered":"2024-09-12T16:58:25.732956+0000","last_unstale":"2024-09-12T17:42:05.772201+0000","last_undegraded":"2024-09-12T17:42:05.772201+0000","last_fullsized":"2024-09-12T17:42:05.772201+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'250","last_scrub_stamp":"2024-09-12T17:42:05.771999+0000","last_deep_scrub":"265'250","last_deep_scrub_stamp":"2024-09-12T17:42:05.771999+0000","last_clean_scrub_stamp":"2024-09-12T17:42:05.771999+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:12.559809+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52555,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":415,"num_read_kb":944,"num_write":334,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:07.926808+0000","last_change":"2024-09-12T17:42:07.926808+0000","last_active":"2024-09-12T17:42:07.926808+0000","last_peered":"2024-09-12T17:42:07.926808+0000","last_clean":"2024-09-12T17:42:07.926808+0000","last_became_active":"2024-09-12T16:58:27.737089+0000","last_became_peered":"2024-09-12T16:58:27.737089+0000","last_unstale":"2024-09-12T17:42:07.926808+0000","last_undegraded":"2024-09-12T17:42:07.926808+0000","last_fullsized":"2024-09-12T17:42:07.926808+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:07.926612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:07.926612+0000","last_clean_scrub_stamp":"2024-09-12T17:42:07.926612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:23.544473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"265'132","reported_seq":787,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:46.446374+0000","last_change":"2024-09-12T17:41:46.446227+0000","last_active":"2024-09-12T17:41:46.446374+0000","last_peered":"2024-09-12T17:41:46.446374+0000","last_clean":"2024-09-12T17:41:46.446374+0000","last_became_active":"2024-09-12T16:58:21.717079+0000","last_became_peered":"2024-09-12T16:58:21.717079+0000","last_unstale":"2024-09-12T17:41:46.446374+0000","last_undegraded":"2024-09-12T17:41:46.446374+0000","last_fullsized":"2024-09-12T17:41:46.446374+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'132","last_scrub_stamp":"2024-09-12T17:41:46.446038+0000","last_deep_scrub":"265'132","last_deep_scrub_stamp":"2024-09-12T17:41:46.446038+0000","last_clean_scrub_stamp":"2024-09-12T17:41:46.446038+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:13.280751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":593,"num_read_kb":510,"num_write":185,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"265'352","reported_seq":997,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:40.787281+0000","last_change":"2024-09-12T17:41:40.787145+0000","last_active":"2024-09-12T17:41:40.787281+0000","last_peered":"2024-09-12T17:41:40.787281+0000","last_clean":"2024-09-12T17:41:40.787281+0000","last_became_active":"2024-09-12T16:58:18.677480+0000","last_became_peered":"2024-09-12T16:58:18.677480+0000","last_unstale":"2024-09-12T17:41:40.787281+0000","last_undegraded":"2024-09-12T17:41:40.787281+0000","last_fullsized":"2024-09-12T17:41:40.787281+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'352","last_scrub_stamp":"2024-09-12T17:41:40.786932+0000","last_deep_scrub":"265'352","last_deep_scrub_stamp":"2024-09-12T17:41:40.786932+0000","last_clean_scrub_stamp":"2024-09-12T17:41:40.786932+0000","objects_scrubbed":8,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:05.959550+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4539352,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":465,"num_read_kb":21305,"num_write":1120,"num_write_kb":20049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:58.000921+0000","last_change":"2024-09-12T17:41:58.000778+0000","last_active":"2024-09-12T17:41:58.000921+0000","last_peered":"2024-09-12T17:41:58.000921+0000","last_clean":"2024-09-12T17:41:58.000921+0000","last_became_active":"2024-09-12T16:58:23.719039+0000","last_became_peered":"2024-09-12T16:58:23.719039+0000","last_unstale":"2024-09-12T17:41:58.000921+0000","last_undegraded":"2024-09-12T17:41:58.000921+0000","last_fullsized":"2024-09-12T17:41:58.000921+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:58.000591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:58.000591+0000","last_clean_scrub_stamp":"2024-09-12T17:41:58.000591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:06.915186+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"265'476","reported_seq":1111,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:59.400710+0000","last_change":"2024-09-12T17:41:59.400710+0000","last_active":"2024-09-12T17:41:59.400710+0000","last_peered":"2024-09-12T17:41:59.400710+0000","last_clean":"2024-09-12T17:41:59.400710+0000","last_became_active":"2024-09-12T16:58:25.720165+0000","last_became_peered":"2024-09-12T16:58:25.720165+0000","last_unstale":"2024-09-12T17:41:59.400710+0000","last_undegraded":"2024-09-12T17:41:59.400710+0000","last_fullsized":"2024-09-12T17:41:59.400710+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'476","last_scrub_stamp":"2024-09-12T17:41:59.400502+0000","last_deep_scrub":"265'476","last_deep_scrub_stamp":"2024-09-12T17:41:59.400502+0000","last_clean_scrub_stamp":"2024-09-12T17:41:59.400502+0000","objects_scrubbed":7,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:59.538891+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97109,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":819,"num_read_kb":1920,"num_write":702,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:09.563408+0000","last_change":"2024-09-12T17:42:09.563408+0000","last_active":"2024-09-12T17:42:09.563408+0000","last_peered":"2024-09-12T17:42:09.563408+0000","last_clean":"2024-09-12T17:42:09.563408+0000","last_became_active":"2024-09-12T16:58:27.749390+0000","last_became_peered":"2024-09-12T16:58:27.749390+0000","last_unstale":"2024-09-12T17:42:09.563408+0000","last_undegraded":"2024-09-12T17:42:09.563408+0000","last_fullsized":"2024-09-12T17:42:09.563408+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:09.563237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:09.563237+0000","last_clean_scrub_stamp":"2024-09-12T17:42:09.563237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:08.669507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"265'186","reported_seq":742,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:15.596814+0000","last_change":"2024-09-12T17:42:15.596814+0000","last_active":"2024-09-12T17:42:15.596814+0000","last_peered":"2024-09-12T17:42:15.596814+0000","last_clean":"2024-09-12T17:42:15.596814+0000","last_became_active":"2024-09-12T16:58:29.788460+0000","last_became_peered":"2024-09-12T16:58:29.788460+0000","last_unstale":"2024-09-12T17:42:15.596814+0000","last_undegraded":"2024-09-12T17:42:15.596814+0000","last_fullsized":"2024-09-12T17:42:15.596814+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'186","last_scrub_stamp":"2024-09-12T17:42:15.596627+0000","last_deep_scrub":"265'186","last_deep_scrub_stamp":"2024-09-12T17:42:15.596627+0000","last_clean_scrub_stamp":"2024-09-12T17:42:15.596627+0000","objects_scrubbed":2,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:32.272451+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":436,"num_read_kb":400,"num_write":425,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"265'128","reported_seq":746,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:51.118553+0000","last_change":"2024-09-12T17:41:51.118367+0000","last_active":"2024-09-12T17:41:51.118553+0000","last_peered":"2024-09-12T17:41:51.118553+0000","last_clean":"2024-09-12T17:41:51.118553+0000","last_became_active":"2024-09-12T16:58:21.724003+0000","last_became_peered":"2024-09-12T16:58:21.724003+0000","last_unstale":"2024-09-12T17:41:51.118553+0000","last_undegraded":"2024-09-12T17:41:51.118553+0000","last_fullsized":"2024-09-12T17:41:51.118553+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'128","last_scrub_stamp":"2024-09-12T17:41:51.118180+0000","last_deep_scrub":"265'128","last_deep_scrub_stamp":"2024-09-12T17:41:51.118180+0000","last_clean_scrub_stamp":"2024-09-12T17:41:51.118180+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:50.382693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":616,"num_read_kb":520,"num_write":198,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"265'382","reported_seq":1081,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:40.494181+0000","last_change":"2024-09-12T17:41:40.494019+0000","last_active":"2024-09-12T17:41:40.494181+0000","last_peered":"2024-09-12T17:41:40.494181+0000","last_clean":"2024-09-12T17:41:40.494181+0000","last_became_active":"2024-09-12T16:58:18.706806+0000","last_became_peered":"2024-09-12T16:58:18.706806+0000","last_unstale":"2024-09-12T17:41:40.494181+0000","last_undegraded":"2024-09-12T17:41:40.494181+0000","last_fullsized":"2024-09-12T17:41:40.494181+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'382","last_scrub_stamp":"2024-09-12T17:41:40.493763+0000","last_deep_scrub":"265'382","last_deep_scrub_stamp":"2024-09-12T17:41:40.493763+0000","last_clean_scrub_stamp":"2024-09-12T17:41:40.493763+0000","objects_scrubbed":11,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:01.630616+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2005288,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":606,"num_read_kb":18575,"num_write":1246,"num_write_kb":49050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:54.441311+0000","last_change":"2024-09-12T17:41:54.441149+0000","last_active":"2024-09-12T17:41:54.441311+0000","last_peered":"2024-09-12T17:41:54.441311+0000","last_clean":"2024-09-12T17:41:54.441311+0000","last_became_active":"2024-09-12T16:58:23.720654+0000","last_became_peered":"2024-09-12T16:58:23.720654+0000","last_unstale":"2024-09-12T17:41:54.441311+0000","last_undegraded":"2024-09-12T17:41:54.441311+0000","last_fullsized":"2024-09-12T17:41:54.441311+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:54.440953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:54.440953+0000","last_clean_scrub_stamp":"2024-09-12T17:41:54.440953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:46.885058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"265'324","reported_seq":913,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:06.753628+0000","last_change":"2024-09-12T17:42:06.753628+0000","last_active":"2024-09-12T17:42:06.753628+0000","last_peered":"2024-09-12T17:42:06.753628+0000","last_clean":"2024-09-12T17:42:06.753628+0000","last_became_active":"2024-09-12T16:58:25.733241+0000","last_became_peered":"2024-09-12T16:58:25.733241+0000","last_unstale":"2024-09-12T17:42:06.753628+0000","last_undegraded":"2024-09-12T17:42:06.753628+0000","last_fullsized":"2024-09-12T17:42:06.753628+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'324","last_scrub_stamp":"2024-09-12T17:42:06.753421+0000","last_deep_scrub":"265'324","last_deep_scrub_stamp":"2024-09-12T17:42:06.753421+0000","last_clean_scrub_stamp":"2024-09-12T17:42:06.753421+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:02.524828+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53167,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":518,"num_read_kb":1145,"num_write":434,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:00.362276+0000","last_change":"2024-09-12T17:42:00.362276+0000","last_active":"2024-09-12T17:42:00.362276+0000","last_peered":"2024-09-12T17:42:00.362276+0000","last_clean":"2024-09-12T17:42:00.362276+0000","last_became_active":"2024-09-12T16:58:27.750328+0000","last_became_peered":"2024-09-12T16:58:27.750328+0000","last_unstale":"2024-09-12T17:42:00.362276+0000","last_undegraded":"2024-09-12T17:42:00.362276+0000","last_fullsized":"2024-09-12T17:42:00.362276+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:00.362082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:00.362082+0000","last_clean_scrub_stamp":"2024-09-12T17:42:00.362082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:37.237455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"265'186","reported_seq":693,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:03.340339+0000","last_change":"2024-09-12T17:42:03.340339+0000","last_active":"2024-09-12T17:42:03.340339+0000","last_peered":"2024-09-12T17:42:03.340339+0000","last_clean":"2024-09-12T17:42:03.340339+0000","last_became_active":"2024-09-12T16:58:29.777124+0000","last_became_peered":"2024-09-12T16:58:29.777124+0000","last_unstale":"2024-09-12T17:42:03.340339+0000","last_undegraded":"2024-09-12T17:42:03.340339+0000","last_fullsized":"2024-09-12T17:42:03.340339+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'186","last_scrub_stamp":"2024-09-12T17:42:03.340132+0000","last_deep_scrub":"265'186","last_deep_scrub_stamp":"2024-09-12T17:42:03.340132+0000","last_clean_scrub_stamp":"2024-09-12T17:42:03.340132+0000","objects_scrubbed":5,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:26.686575+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1215,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":228,"num_read_kb":227,"num_write":517,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"265'163","reported_seq":775,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:54.539232+0000","last_change":"2024-09-12T17:41:54.539232+0000","last_active":"2024-09-12T17:41:54.539232+0000","last_peered":"2024-09-12T17:41:54.539232+0000","last_clean":"2024-09-12T17:41:54.539232+0000","last_became_active":"2024-09-12T16:58:21.698565+0000","last_became_peered":"2024-09-12T16:58:21.698565+0000","last_unstale":"2024-09-12T17:41:54.539232+0000","last_undegraded":"2024-09-12T17:41:54.539232+0000","last_fullsized":"2024-09-12T17:41:54.539232+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'163","last_scrub_stamp":"2024-09-12T17:41:54.539052+0000","last_deep_scrub":"265'163","last_deep_scrub_stamp":"2024-09-12T17:41:54.539052+0000","last_clean_scrub_stamp":"2024-09-12T17:41:54.539052+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:56.134179+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":649,"num_read_kb":535,"num_write":267,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":466,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"265'341","reported_seq":998,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:41.643297+0000","last_change":"2024-09-12T17:41:41.643297+0000","last_active":"2024-09-12T17:41:41.643297+0000","last_peered":"2024-09-12T17:41:41.643297+0000","last_clean":"2024-09-12T17:41:41.643297+0000","last_became_active":"2024-09-12T16:58:18.700196+0000","last_became_peered":"2024-09-12T16:58:18.700196+0000","last_unstale":"2024-09-12T17:41:41.643297+0000","last_undegraded":"2024-09-12T17:41:41.643297+0000","last_fullsized":"2024-09-12T17:41:41.643297+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'341","last_scrub_stamp":"2024-09-12T17:41:41.643102+0000","last_deep_scrub":"265'341","last_deep_scrub_stamp":"2024-09-12T17:41:41.643102+0000","last_clean_scrub_stamp":"2024-09-12T17:41:41.643102+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:23.678015+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":519,"num_read_kb":4020,"num_write":1087,"num_write_kb":21150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:02.569081+0000","last_change":"2024-09-12T17:42:02.569081+0000","last_active":"2024-09-12T17:42:02.569081+0000","last_peered":"2024-09-12T17:42:02.569081+0000","last_clean":"2024-09-12T17:42:02.569081+0000","last_became_active":"2024-09-12T16:58:23.702293+0000","last_became_peered":"2024-09-12T16:58:23.702293+0000","last_unstale":"2024-09-12T17:42:02.569081+0000","last_undegraded":"2024-09-12T17:42:02.569081+0000","last_fullsized":"2024-09-12T17:42:02.569081+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:02.568901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:02.568901+0000","last_clean_scrub_stamp":"2024-09-12T17:42:02.568901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:48.291273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"265'330","reported_seq":916,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:07.569228+0000","last_change":"2024-09-12T17:42:07.569073+0000","last_active":"2024-09-12T17:42:07.569228+0000","last_peered":"2024-09-12T17:42:07.569228+0000","last_clean":"2024-09-12T17:42:07.569228+0000","last_became_active":"2024-09-12T16:58:25.949883+0000","last_became_peered":"2024-09-12T16:58:25.949883+0000","last_unstale":"2024-09-12T17:42:07.569228+0000","last_undegraded":"2024-09-12T17:42:07.569228+0000","last_fullsized":"2024-09-12T17:42:07.569228+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'330","last_scrub_stamp":"2024-09-12T17:42:07.568888+0000","last_deep_scrub":"265'330","last_deep_scrub_stamp":"2024-09-12T17:42:07.568888+0000","last_clean_scrub_stamp":"2024-09-12T17:42:07.568888+0000","objects_scrubbed":5,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:41.012993+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47961,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":516,"num_read_kb":1185,"num_write":434,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:02.402563+0000","last_change":"2024-09-12T17:42:02.402428+0000","last_active":"2024-09-12T17:42:02.402563+0000","last_peered":"2024-09-12T17:42:02.402563+0000","last_clean":"2024-09-12T17:42:02.402563+0000","last_became_active":"2024-09-12T16:58:27.739965+0000","last_became_peered":"2024-09-12T16:58:27.739965+0000","last_unstale":"2024-09-12T17:42:02.402563+0000","last_undegraded":"2024-09-12T17:42:02.402563+0000","last_fullsized":"2024-09-12T17:42:02.402563+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:02.402249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:02.402249+0000","last_clean_scrub_stamp":"2024-09-12T17:42:02.402249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:15.452036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"265'142","reported_seq":641,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:13.591281+0000","last_change":"2024-09-12T17:42:13.591281+0000","last_active":"2024-09-12T17:42:13.591281+0000","last_peered":"2024-09-12T17:42:13.591281+0000","last_clean":"2024-09-12T17:42:13.591281+0000","last_became_active":"2024-09-12T16:58:29.771267+0000","last_became_peered":"2024-09-12T16:58:29.771267+0000","last_unstale":"2024-09-12T17:42:13.591281+0000","last_undegraded":"2024-09-12T17:42:13.591281+0000","last_fullsized":"2024-09-12T17:42:13.591281+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'142","last_scrub_stamp":"2024-09-12T17:42:13.591041+0000","last_deep_scrub":"265'142","last_deep_scrub_stamp":"2024-09-12T17:42:13.591041+0000","last_clean_scrub_stamp":"2024-09-12T17:42:13.591041+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:35.315375+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":401,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":154,"num_write":321,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"265'82","reported_seq":694,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:43.505594+0000","last_change":"2024-09-12T17:41:43.505594+0000","last_active":"2024-09-12T17:41:43.505594+0000","last_peered":"2024-09-12T17:41:43.505594+0000","last_clean":"2024-09-12T17:41:43.505594+0000","last_became_active":"2024-09-12T16:58:21.730342+0000","last_became_peered":"2024-09-12T16:58:21.730342+0000","last_unstale":"2024-09-12T17:41:43.505594+0000","last_undegraded":"2024-09-12T17:41:43.505594+0000","last_fullsized":"2024-09-12T17:41:43.505594+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'82","last_scrub_stamp":"2024-09-12T17:41:43.505360+0000","last_deep_scrub":"265'82","last_deep_scrub_stamp":"2024-09-12T17:41:43.505360+0000","last_clean_scrub_stamp":"2024-09-12T17:41:43.505360+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:13.444514+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":417,"num_read_kb":364,"num_write":119,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"265'313","reported_seq":1009,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:39.237770+0000","last_change":"2024-09-12T17:41:39.237770+0000","last_active":"2024-09-12T17:41:39.237770+0000","last_peered":"2024-09-12T17:41:39.237770+0000","last_clean":"2024-09-12T17:41:39.237770+0000","last_became_active":"2024-09-12T16:58:18.688773+0000","last_became_peered":"2024-09-12T16:58:18.688773+0000","last_unstale":"2024-09-12T17:41:39.237770+0000","last_undegraded":"2024-09-12T17:41:39.237770+0000","last_fullsized":"2024-09-12T17:41:39.237770+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'313","last_scrub_stamp":"2024-09-12T17:41:39.237589+0000","last_deep_scrub":"265'313","last_deep_scrub_stamp":"2024-09-12T17:41:39.237589+0000","last_clean_scrub_stamp":"2024-09-12T17:41:39.237589+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:34.837693+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":566,"num_read_kb":43210,"num_write":1036,"num_write_kb":32802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:57.401448+0000","last_change":"2024-09-12T17:41:57.401448+0000","last_active":"2024-09-12T17:41:57.401448+0000","last_peered":"2024-09-12T17:41:57.401448+0000","last_clean":"2024-09-12T17:41:57.401448+0000","last_became_active":"2024-09-12T16:58:23.709009+0000","last_became_peered":"2024-09-12T16:58:23.709009+0000","last_unstale":"2024-09-12T17:41:57.401448+0000","last_undegraded":"2024-09-12T17:41:57.401448+0000","last_fullsized":"2024-09-12T17:41:57.401448+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:57.401263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:57.401263+0000","last_clean_scrub_stamp":"2024-09-12T17:41:57.401263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:55.509659+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"265'95","reported_seq":624,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:06.608548+0000","last_change":"2024-09-12T17:42:06.608408+0000","last_active":"2024-09-12T17:42:06.608548+0000","last_peered":"2024-09-12T17:42:06.608548+0000","last_clean":"2024-09-12T17:42:06.608548+0000","last_became_active":"2024-09-12T16:58:25.949196+0000","last_became_peered":"2024-09-12T16:58:25.949196+0000","last_unstale":"2024-09-12T17:42:06.608548+0000","last_undegraded":"2024-09-12T17:42:06.608548+0000","last_fullsized":"2024-09-12T17:42:06.608548+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'95","last_scrub_stamp":"2024-09-12T17:42:06.608197+0000","last_deep_scrub":"265'95","last_deep_scrub_stamp":"2024-09-12T17:42:06.608197+0000","last_clean_scrub_stamp":"2024-09-12T17:42:06.608197+0000","objects_scrubbed":7,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:30.948657+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":122,"num_read_kb":116,"num_write":142,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":19154,"num_omap_keys":50,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"265'758","reported_seq":2163,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:00.322103+0000","last_change":"2024-09-12T17:42:00.321961+0000","last_active":"2024-09-12T17:42:00.322103+0000","last_peered":"2024-09-12T17:42:00.322103+0000","last_clean":"2024-09-12T17:42:00.322103+0000","last_became_active":"2024-09-12T16:58:27.740416+0000","last_became_peered":"2024-09-12T16:58:27.740416+0000","last_unstale":"2024-09-12T17:42:00.322103+0000","last_undegraded":"2024-09-12T17:42:00.322103+0000","last_fullsized":"2024-09-12T17:42:00.322103+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'758","last_scrub_stamp":"2024-09-12T17:42:00.321759+0000","last_deep_scrub":"265'758","last_deep_scrub_stamp":"2024-09-12T17:42:00.321759+0000","last_clean_scrub_stamp":"2024-09-12T17:42:00.321759+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":700,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:00.274187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"265'129","reported_seq":658,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:11.668336+0000","last_change":"2024-09-12T17:42:11.668336+0000","last_active":"2024-09-12T17:42:11.668336+0000","last_peered":"2024-09-12T17:42:11.668336+0000","last_clean":"2024-09-12T17:42:11.668336+0000","last_became_active":"2024-09-12T16:58:29.784128+0000","last_became_peered":"2024-09-12T16:58:29.784128+0000","last_unstale":"2024-09-12T17:42:11.668336+0000","last_undegraded":"2024-09-12T17:42:11.668336+0000","last_fullsized":"2024-09-12T17:42:11.668336+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'129","last_scrub_stamp":"2024-09-12T17:42:11.668116+0000","last_deep_scrub":"265'129","last_deep_scrub_stamp":"2024-09-12T17:42:11.668116+0000","last_clean_scrub_stamp":"2024-09-12T17:42:11.668116+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:54.421856+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":291,"num_read_kb":261,"num_write":354,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"265'160","reported_seq":763,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:51.677261+0000","last_change":"2024-09-12T17:41:51.677261+0000","last_active":"2024-09-12T17:41:51.677261+0000","last_peered":"2024-09-12T17:41:51.677261+0000","last_clean":"2024-09-12T17:41:51.677261+0000","last_became_active":"2024-09-12T16:58:21.700714+0000","last_became_peered":"2024-09-12T16:58:21.700714+0000","last_unstale":"2024-09-12T17:41:51.677261+0000","last_undegraded":"2024-09-12T17:41:51.677261+0000","last_fullsized":"2024-09-12T17:41:51.677261+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'160","last_scrub_stamp":"2024-09-12T17:41:51.677068+0000","last_deep_scrub":"265'160","last_deep_scrub_stamp":"2024-09-12T17:41:51.677068+0000","last_clean_scrub_stamp":"2024-09-12T17:41:51.677068+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:24.457151+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":716,"num_read_kb":600,"num_write":247,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":685,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"265'324","reported_seq":1084,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:47.592290+0000","last_change":"2024-09-12T17:41:47.592290+0000","last_active":"2024-09-12T17:41:47.592290+0000","last_peered":"2024-09-12T17:41:47.592290+0000","last_clean":"2024-09-12T17:41:47.592290+0000","last_became_active":"2024-09-12T16:58:18.706117+0000","last_became_peered":"2024-09-12T16:58:18.706117+0000","last_unstale":"2024-09-12T17:41:47.592290+0000","last_undegraded":"2024-09-12T17:41:47.592290+0000","last_fullsized":"2024-09-12T17:41:47.592290+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'324","last_scrub_stamp":"2024-09-12T17:41:47.592082+0000","last_deep_scrub":"265'324","last_deep_scrub_stamp":"2024-09-12T17:41:47.592082+0000","last_clean_scrub_stamp":"2024-09-12T17:41:47.592082+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:54.054534+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263228,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":571,"num_read_kb":60034,"num_write":895,"num_write_kb":44854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:59.716085+0000","last_change":"2024-09-12T17:41:59.716085+0000","last_active":"2024-09-12T17:41:59.716085+0000","last_peered":"2024-09-12T17:41:59.716085+0000","last_clean":"2024-09-12T17:41:59.716085+0000","last_became_active":"2024-09-12T16:58:23.718211+0000","last_became_peered":"2024-09-12T16:58:23.718211+0000","last_unstale":"2024-09-12T17:41:59.716085+0000","last_undegraded":"2024-09-12T17:41:59.716085+0000","last_fullsized":"2024-09-12T17:41:59.716085+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:59.715910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:59.715910+0000","last_clean_scrub_stamp":"2024-09-12T17:41:59.715910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:23.485766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"265'310","reported_seq":900,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:07.600324+0000","last_change":"2024-09-12T17:42:07.600324+0000","last_active":"2024-09-12T17:42:07.600324+0000","last_peered":"2024-09-12T17:42:07.600324+0000","last_clean":"2024-09-12T17:42:07.600324+0000","last_became_active":"2024-09-12T16:58:25.724774+0000","last_became_peered":"2024-09-12T16:58:25.724774+0000","last_unstale":"2024-09-12T17:42:07.600324+0000","last_undegraded":"2024-09-12T17:42:07.600324+0000","last_fullsized":"2024-09-12T17:42:07.600324+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'310","last_scrub_stamp":"2024-09-12T17:42:07.600103+0000","last_deep_scrub":"265'310","last_deep_scrub_stamp":"2024-09-12T17:42:07.600103+0000","last_clean_scrub_stamp":"2024-09-12T17:42:07.600103+0000","objects_scrubbed":7,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:53.693190+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47652,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":491,"num_read_kb":1079,"num_write":394,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:08.965010+0000","last_change":"2024-09-12T17:42:08.965010+0000","last_active":"2024-09-12T17:42:08.965010+0000","last_peered":"2024-09-12T17:42:08.965010+0000","last_clean":"2024-09-12T17:42:08.965010+0000","last_became_active":"2024-09-12T16:58:27.755232+0000","last_became_peered":"2024-09-12T16:58:27.755232+0000","last_unstale":"2024-09-12T17:42:08.965010+0000","last_undegraded":"2024-09-12T17:42:08.965010+0000","last_fullsized":"2024-09-12T17:42:08.965010+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:08.964807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:08.964807+0000","last_clean_scrub_stamp":"2024-09-12T17:42:08.964807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:08.229206+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"265'137","reported_seq":658,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:13.742270+0000","last_change":"2024-09-12T17:42:13.742270+0000","last_active":"2024-09-12T17:42:13.742270+0000","last_peered":"2024-09-12T17:42:13.742270+0000","last_clean":"2024-09-12T17:42:13.742270+0000","last_became_active":"2024-09-12T16:58:29.782006+0000","last_became_peered":"2024-09-12T16:58:29.782006+0000","last_unstale":"2024-09-12T17:42:13.742270+0000","last_undegraded":"2024-09-12T17:42:13.742270+0000","last_fullsized":"2024-09-12T17:42:13.742270+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'137","last_scrub_stamp":"2024-09-12T17:42:13.742048+0000","last_deep_scrub":"265'137","last_deep_scrub_stamp":"2024-09-12T17:42:13.742048+0000","last_clean_scrub_stamp":"2024-09-12T17:42:13.742048+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.736080+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":784,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":248,"num_read_kb":225,"num_write":333,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"265'367","reported_seq":982,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:49.619878+0000","last_change":"2024-09-12T17:41:49.619878+0000","last_active":"2024-09-12T17:41:49.619878+0000","last_peered":"2024-09-12T17:41:49.619878+0000","last_clean":"2024-09-12T17:41:49.619878+0000","last_became_active":"2024-09-12T16:58:21.700909+0000","last_became_peered":"2024-09-12T16:58:21.700909+0000","last_unstale":"2024-09-12T17:41:49.619878+0000","last_undegraded":"2024-09-12T17:41:49.619878+0000","last_fullsized":"2024-09-12T17:41:49.619878+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'367","last_scrub_stamp":"2024-09-12T17:41:49.619757+0000","last_deep_scrub":"265'367","last_deep_scrub_stamp":"2024-09-12T17:41:49.619757+0000","last_clean_scrub_stamp":"2024-09-12T17:41:49.619757+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:59.864277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1540,"num_read_kb":1221,"num_write":577,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8073,"num_omap_keys":32,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"265'345","reported_seq":985,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:43.695319+0000","last_change":"2024-09-12T17:41:43.695319+0000","last_active":"2024-09-12T17:41:43.695319+0000","last_peered":"2024-09-12T17:41:43.695319+0000","last_clean":"2024-09-12T17:41:43.695319+0000","last_became_active":"2024-09-12T16:58:18.706197+0000","last_became_peered":"2024-09-12T16:58:18.706197+0000","last_unstale":"2024-09-12T17:41:43.695319+0000","last_undegraded":"2024-09-12T17:41:43.695319+0000","last_fullsized":"2024-09-12T17:41:43.695319+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'345","last_scrub_stamp":"2024-09-12T17:41:43.695067+0000","last_deep_scrub":"265'345","last_deep_scrub_stamp":"2024-09-12T17:41:43.695067+0000","last_clean_scrub_stamp":"2024-09-12T17:41:43.695067+0000","objects_scrubbed":10,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:07.116451+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10548403,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":531,"num_read_kb":18954,"num_write":1116,"num_write_kb":43009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:03.606588+0000","last_change":"2024-09-12T17:42:03.606588+0000","last_active":"2024-09-12T17:42:03.606588+0000","last_peered":"2024-09-12T17:42:03.606588+0000","last_clean":"2024-09-12T17:42:03.606588+0000","last_became_active":"2024-09-12T16:58:23.711307+0000","last_became_peered":"2024-09-12T16:58:23.711307+0000","last_unstale":"2024-09-12T17:42:03.606588+0000","last_undegraded":"2024-09-12T17:42:03.606588+0000","last_fullsized":"2024-09-12T17:42:03.606588+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:03.606372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:03.606372+0000","last_clean_scrub_stamp":"2024-09-12T17:42:03.606372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:19.011654+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"265'272","reported_seq":845,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:01.905547+0000","last_change":"2024-09-12T17:42:01.905547+0000","last_active":"2024-09-12T17:42:01.905547+0000","last_peered":"2024-09-12T17:42:01.905547+0000","last_clean":"2024-09-12T17:42:01.905547+0000","last_became_active":"2024-09-12T16:58:25.736507+0000","last_became_peered":"2024-09-12T16:58:25.736507+0000","last_unstale":"2024-09-12T17:42:01.905547+0000","last_undegraded":"2024-09-12T17:42:01.905547+0000","last_fullsized":"2024-09-12T17:42:01.905547+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'272","last_scrub_stamp":"2024-09-12T17:42:01.905321+0000","last_deep_scrub":"265'272","last_deep_scrub_stamp":"2024-09-12T17:42:01.905321+0000","last_clean_scrub_stamp":"2024-09-12T17:42:01.905321+0000","objects_scrubbed":5,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:36.227575+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47073,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":450,"num_read_kb":1040,"num_write":370,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:59.337211+0000","last_change":"2024-09-12T17:41:59.337032+0000","last_active":"2024-09-12T17:41:59.337211+0000","last_peered":"2024-09-12T17:41:59.337211+0000","last_clean":"2024-09-12T17:41:59.337211+0000","last_became_active":"2024-09-12T16:58:27.740278+0000","last_became_peered":"2024-09-12T16:58:27.740278+0000","last_unstale":"2024-09-12T17:41:59.337211+0000","last_undegraded":"2024-09-12T17:41:59.337211+0000","last_fullsized":"2024-09-12T17:41:59.337211+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:59.336840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:59.336840+0000","last_clean_scrub_stamp":"2024-09-12T17:41:59.336840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:16.116080+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"265'126","reported_seq":666,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:16.566991+0000","last_change":"2024-09-12T17:42:16.566991+0000","last_active":"2024-09-12T17:42:16.566991+0000","last_peered":"2024-09-12T17:42:16.566991+0000","last_clean":"2024-09-12T17:42:16.566991+0000","last_became_active":"2024-09-12T16:58:29.783969+0000","last_became_peered":"2024-09-12T16:58:29.783969+0000","last_unstale":"2024-09-12T17:42:16.566991+0000","last_undegraded":"2024-09-12T17:42:16.566991+0000","last_fullsized":"2024-09-12T17:42:16.566991+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'126","last_scrub_stamp":"2024-09-12T17:42:16.566785+0000","last_deep_scrub":"265'126","last_deep_scrub_stamp":"2024-09-12T17:42:16.566785+0000","last_clean_scrub_stamp":"2024-09-12T17:42:16.566785+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:27:14.270170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":564,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":235,"num_read_kb":216,"num_write":292,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"265'256","reported_seq":886,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:53.554782+0000","last_change":"2024-09-12T17:41:53.554631+0000","last_active":"2024-09-12T17:41:53.554782+0000","last_peered":"2024-09-12T17:41:53.554782+0000","last_clean":"2024-09-12T17:41:53.554782+0000","last_became_active":"2024-09-12T16:58:21.715884+0000","last_became_peered":"2024-09-12T16:58:21.715884+0000","last_unstale":"2024-09-12T17:41:53.554782+0000","last_undegraded":"2024-09-12T17:41:53.554782+0000","last_fullsized":"2024-09-12T17:41:53.554782+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'256","last_scrub_stamp":"2024-09-12T17:41:53.554435+0000","last_deep_scrub":"265'256","last_deep_scrub_stamp":"2024-09-12T17:41:53.554435+0000","last_clean_scrub_stamp":"2024-09-12T17:41:53.554435+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:12.224842+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1137,"num_read_kb":949,"num_write":435,"num_write_kb":255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"265'303","reported_seq":912,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:42.742805+0000","last_change":"2024-09-12T17:41:42.742666+0000","last_active":"2024-09-12T17:41:42.742805+0000","last_peered":"2024-09-12T17:41:42.742805+0000","last_clean":"2024-09-12T17:41:42.742805+0000","last_became_active":"2024-09-12T16:58:18.704103+0000","last_became_peered":"2024-09-12T16:58:18.704103+0000","last_unstale":"2024-09-12T17:41:42.742805+0000","last_undegraded":"2024-09-12T17:41:42.742805+0000","last_fullsized":"2024-09-12T17:41:42.742805+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'303","last_scrub_stamp":"2024-09-12T17:41:42.742464+0000","last_deep_scrub":"265'303","last_deep_scrub_stamp":"2024-09-12T17:41:42.742464+0000","last_clean_scrub_stamp":"2024-09-12T17:41:42.742464+0000","objects_scrubbed":6,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:08.956555+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":353,"num_read_kb":15361,"num_write":880,"num_write_kb":40766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:01.615440+0000","last_change":"2024-09-12T17:42:01.615440+0000","last_active":"2024-09-12T17:42:01.615440+0000","last_peered":"2024-09-12T17:42:01.615440+0000","last_clean":"2024-09-12T17:42:01.615440+0000","last_became_active":"2024-09-12T16:58:23.713731+0000","last_became_peered":"2024-09-12T16:58:23.713731+0000","last_unstale":"2024-09-12T17:42:01.615440+0000","last_undegraded":"2024-09-12T17:42:01.615440+0000","last_fullsized":"2024-09-12T17:42:01.615440+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:01.615260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:01.615260+0000","last_clean_scrub_stamp":"2024-09-12T17:42:01.615260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:44:08.902882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"265'226","reported_seq":792,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:05.587217+0000","last_change":"2024-09-12T17:42:05.587217+0000","last_active":"2024-09-12T17:42:05.587217+0000","last_peered":"2024-09-12T17:42:05.587217+0000","last_clean":"2024-09-12T17:42:05.587217+0000","last_became_active":"2024-09-12T16:58:25.727897+0000","last_became_peered":"2024-09-12T16:58:25.727897+0000","last_unstale":"2024-09-12T17:42:05.587217+0000","last_undegraded":"2024-09-12T17:42:05.587217+0000","last_fullsized":"2024-09-12T17:42:05.587217+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'226","last_scrub_stamp":"2024-09-12T17:42:05.587046+0000","last_deep_scrub":"265'226","last_deep_scrub_stamp":"2024-09-12T17:42:05.587046+0000","last_clean_scrub_stamp":"2024-09-12T17:42:05.587046+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:17.999381+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18508,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":370,"num_read_kb":886,"num_write":300,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:10.576646+0000","last_change":"2024-09-12T17:42:10.576646+0000","last_active":"2024-09-12T17:42:10.576646+0000","last_peered":"2024-09-12T17:42:10.576646+0000","last_clean":"2024-09-12T17:42:10.576646+0000","last_became_active":"2024-09-12T16:58:27.735625+0000","last_became_peered":"2024-09-12T16:58:27.735625+0000","last_unstale":"2024-09-12T17:42:10.576646+0000","last_undegraded":"2024-09-12T17:42:10.576646+0000","last_fullsized":"2024-09-12T17:42:10.576646+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:10.576449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:10.576449+0000","last_clean_scrub_stamp":"2024-09-12T17:42:10.576449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:15.024969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"265'175","reported_seq":1650,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:12.711756+0000","last_change":"2024-09-12T17:42:12.711756+0000","last_active":"2024-09-12T17:42:12.711756+0000","last_peered":"2024-09-12T17:42:12.711756+0000","last_clean":"2024-09-12T17:42:12.711756+0000","last_became_active":"2024-09-12T16:58:29.796358+0000","last_became_peered":"2024-09-12T16:58:29.796358+0000","last_unstale":"2024-09-12T17:42:12.711756+0000","last_undegraded":"2024-09-12T17:42:12.711756+0000","last_fullsized":"2024-09-12T17:42:12.711756+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'175","last_scrub_stamp":"2024-09-12T17:42:12.711577+0000","last_deep_scrub":"265'175","last_deep_scrub_stamp":"2024-09-12T17:42:12.711577+0000","last_clean_scrub_stamp":"2024-09-12T17:42:12.711577+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:27.055803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1235,"num_read_kb":1225,"num_write":375,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"265'197","reported_seq":834,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:50.652697+0000","last_change":"2024-09-12T17:41:50.652541+0000","last_active":"2024-09-12T17:41:50.652697+0000","last_peered":"2024-09-12T17:41:50.652697+0000","last_clean":"2024-09-12T17:41:50.652697+0000","last_became_active":"2024-09-12T16:58:21.730029+0000","last_became_peered":"2024-09-12T16:58:21.730029+0000","last_unstale":"2024-09-12T17:41:50.652697+0000","last_undegraded":"2024-09-12T17:41:50.652697+0000","last_fullsized":"2024-09-12T17:41:50.652697+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'197","last_scrub_stamp":"2024-09-12T17:41:50.652360+0000","last_deep_scrub":"265'197","last_deep_scrub_stamp":"2024-09-12T17:41:50.652360+0000","last_clean_scrub_stamp":"2024-09-12T17:41:50.652360+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:58.816478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":873,"num_read_kb":717,"num_write":316,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"265'367","reported_seq":1018,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:42.297063+0000","last_change":"2024-09-12T17:41:42.296900+0000","last_active":"2024-09-12T17:41:42.297063+0000","last_peered":"2024-09-12T17:41:42.297063+0000","last_clean":"2024-09-12T17:41:42.297063+0000","last_became_active":"2024-09-12T16:58:18.712291+0000","last_became_peered":"2024-09-12T16:58:18.712291+0000","last_unstale":"2024-09-12T17:41:42.297063+0000","last_undegraded":"2024-09-12T17:41:42.297063+0000","last_fullsized":"2024-09-12T17:41:42.297063+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'367","last_scrub_stamp":"2024-09-12T17:41:42.296686+0000","last_deep_scrub":"265'367","last_deep_scrub_stamp":"2024-09-12T17:41:42.296686+0000","last_clean_scrub_stamp":"2024-09-12T17:41:42.296686+0000","objects_scrubbed":8,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:53.919784+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159793,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":439,"num_read_kb":103450,"num_write":1036,"num_write_kb":48235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"265'2","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:54.380961+0000","last_change":"2024-09-12T17:41:54.380823+0000","last_active":"2024-09-12T17:41:54.380961+0000","last_peered":"2024-09-12T17:41:54.380961+0000","last_clean":"2024-09-12T17:41:54.380961+0000","last_became_active":"2024-09-12T16:58:23.724981+0000","last_became_peered":"2024-09-12T16:58:23.724981+0000","last_unstale":"2024-09-12T17:41:54.380961+0000","last_undegraded":"2024-09-12T17:41:54.380961+0000","last_fullsized":"2024-09-12T17:41:54.380961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T17:41:54.380634+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T17:41:54.380634+0000","last_clean_scrub_stamp":"2024-09-12T17:41:54.380634+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:35.697170+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"265'303","reported_seq":894,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:08.610756+0000","last_change":"2024-09-12T17:42:08.610756+0000","last_active":"2024-09-12T17:42:08.610756+0000","last_peered":"2024-09-12T17:42:08.610756+0000","last_clean":"2024-09-12T17:42:08.610756+0000","last_became_active":"2024-09-12T16:58:25.718962+0000","last_became_peered":"2024-09-12T16:58:25.718962+0000","last_unstale":"2024-09-12T17:42:08.610756+0000","last_undegraded":"2024-09-12T17:42:08.610756+0000","last_fullsized":"2024-09-12T17:42:08.610756+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'303","last_scrub_stamp":"2024-09-12T17:42:08.610554+0000","last_deep_scrub":"265'303","last_deep_scrub_stamp":"2024-09-12T17:42:08.610554+0000","last_clean_scrub_stamp":"2024-09-12T17:42:08.610554+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:41.314469+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46580,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":480,"num_read_kb":1058,"num_write":384,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:09.968403+0000","last_change":"2024-09-12T17:42:09.968403+0000","last_active":"2024-09-12T17:42:09.968403+0000","last_peered":"2024-09-12T17:42:09.968403+0000","last_clean":"2024-09-12T17:42:09.968403+0000","last_became_active":"2024-09-12T16:58:27.748503+0000","last_became_peered":"2024-09-12T16:58:27.748503+0000","last_unstale":"2024-09-12T17:42:09.968403+0000","last_undegraded":"2024-09-12T17:42:09.968403+0000","last_fullsized":"2024-09-12T17:42:09.968403+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:09.968216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:09.968216+0000","last_clean_scrub_stamp":"2024-09-12T17:42:09.968216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:48.003237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"265'155","reported_seq":658,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:11.605436+0000","last_change":"2024-09-12T17:42:11.605436+0000","last_active":"2024-09-12T17:42:11.605436+0000","last_peered":"2024-09-12T17:42:11.605436+0000","last_clean":"2024-09-12T17:42:11.605436+0000","last_became_active":"2024-09-12T16:58:29.780363+0000","last_became_peered":"2024-09-12T16:58:29.780363+0000","last_unstale":"2024-09-12T17:42:11.605436+0000","last_undegraded":"2024-09-12T17:42:11.605436+0000","last_fullsized":"2024-09-12T17:42:11.605436+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'155","last_scrub_stamp":"2024-09-12T17:42:11.605251+0000","last_deep_scrub":"265'155","last_deep_scrub_stamp":"2024-09-12T17:42:11.605251+0000","last_clean_scrub_stamp":"2024-09-12T17:42:11.605251+0000","objects_scrubbed":5,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:13.762046+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":838,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":195,"num_read_kb":185,"num_write":368,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"265'45","reported_seq":608,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:52.410256+0000","last_change":"2024-09-12T17:41:52.410256+0000","last_active":"2024-09-12T17:41:52.410256+0000","last_peered":"2024-09-12T17:41:52.410256+0000","last_clean":"2024-09-12T17:41:52.410256+0000","last_became_active":"2024-09-12T16:58:21.728147+0000","last_became_peered":"2024-09-12T16:58:21.728147+0000","last_unstale":"2024-09-12T17:41:52.410256+0000","last_undegraded":"2024-09-12T17:41:52.410256+0000","last_fullsized":"2024-09-12T17:41:52.410256+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'45","last_scrub_stamp":"2024-09-12T17:41:52.410037+0000","last_deep_scrub":"265'45","last_deep_scrub_stamp":"2024-09-12T17:41:52.410037+0000","last_clean_scrub_stamp":"2024-09-12T17:41:52.410037+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:59.883537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":172,"num_write":56,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"265'364","reported_seq":1018,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:42.455139+0000","last_change":"2024-09-12T17:41:42.454962+0000","last_active":"2024-09-12T17:41:42.455139+0000","last_peered":"2024-09-12T17:41:42.455139+0000","last_clean":"2024-09-12T17:41:42.455139+0000","last_became_active":"2024-09-12T16:58:18.692788+0000","last_became_peered":"2024-09-12T16:58:18.692788+0000","last_unstale":"2024-09-12T17:41:42.455139+0000","last_undegraded":"2024-09-12T17:41:42.455139+0000","last_fullsized":"2024-09-12T17:41:42.455139+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'364","last_scrub_stamp":"2024-09-12T17:41:42.454759+0000","last_deep_scrub":"265'364","last_deep_scrub_stamp":"2024-09-12T17:41:42.454759+0000","last_clean_scrub_stamp":"2024-09-12T17:41:42.454759+0000","objects_scrubbed":6,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:43.884878+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":568,"num_read_kb":2235,"num_write":1205,"num_write_kb":12634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"265'160","reported_seq":782,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:48.329394+0000","last_change":"2024-09-12T17:41:48.329394+0000","last_active":"2024-09-12T17:41:48.329394+0000","last_peered":"2024-09-12T17:41:48.329394+0000","last_clean":"2024-09-12T17:41:48.329394+0000","last_became_active":"2024-09-12T16:58:21.726882+0000","last_became_peered":"2024-09-12T16:58:21.726882+0000","last_unstale":"2024-09-12T17:41:48.329394+0000","last_undegraded":"2024-09-12T17:41:48.329394+0000","last_fullsized":"2024-09-12T17:41:48.329394+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'160","last_scrub_stamp":"2024-09-12T17:41:48.329218+0000","last_deep_scrub":"265'160","last_deep_scrub_stamp":"2024-09-12T17:41:48.329218+0000","last_clean_scrub_stamp":"2024-09-12T17:41:48.329218+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:27.518612+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":734,"num_read_kb":607,"num_write":248,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":721,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"265'496","reported_seq":1232,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:53.589942+0000","last_change":"2024-09-12T17:41:53.589804+0000","last_active":"2024-09-12T17:41:53.589942+0000","last_peered":"2024-09-12T17:41:53.589942+0000","last_clean":"2024-09-12T17:41:53.589942+0000","last_became_active":"2024-09-12T16:58:18.693764+0000","last_became_peered":"2024-09-12T16:58:18.693764+0000","last_unstale":"2024-09-12T17:41:53.589942+0000","last_undegraded":"2024-09-12T17:41:53.589942+0000","last_fullsized":"2024-09-12T17:41:53.589942+0000","mapping_epoch":23,"log_start":"265'400","ondisk_log_start":"265'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'496","last_scrub_stamp":"2024-09-12T17:41:53.589553+0000","last_deep_scrub":"265'496","last_deep_scrub_stamp":"2024-09-12T17:41:53.589553+0000","last_clean_scrub_stamp":"2024-09-12T17:41:53.589553+0000","objects_scrubbed":10,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:17.934087+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1848453,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":919,"num_read_kb":32179,"num_write":1426,"num_write_kb":32850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"265'188","reported_seq":831,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:54.669791+0000","last_change":"2024-09-12T17:41:54.669791+0000","last_active":"2024-09-12T17:41:54.669791+0000","last_peered":"2024-09-12T17:41:54.669791+0000","last_clean":"2024-09-12T17:41:54.669791+0000","last_became_active":"2024-09-12T16:58:21.716793+0000","last_became_peered":"2024-09-12T16:58:21.716793+0000","last_unstale":"2024-09-12T17:41:54.669791+0000","last_undegraded":"2024-09-12T17:41:54.669791+0000","last_fullsized":"2024-09-12T17:41:54.669791+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'188","last_scrub_stamp":"2024-09-12T17:41:54.669596+0000","last_deep_scrub":"265'188","last_deep_scrub_stamp":"2024-09-12T17:41:54.669596+0000","last_clean_scrub_stamp":"2024-09-12T17:41:54.669596+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:38.714045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":842,"num_read_kb":696,"num_write":281,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"265'387","reported_seq":1016,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:44.632558+0000","last_change":"2024-09-12T17:41:44.632383+0000","last_active":"2024-09-12T17:41:44.632558+0000","last_peered":"2024-09-12T17:41:44.632558+0000","last_clean":"2024-09-12T17:41:44.632558+0000","last_became_active":"2024-09-12T16:58:18.711667+0000","last_became_peered":"2024-09-12T16:58:18.711667+0000","last_unstale":"2024-09-12T17:41:44.632558+0000","last_undegraded":"2024-09-12T17:41:44.632558+0000","last_fullsized":"2024-09-12T17:41:44.632558+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'387","last_scrub_stamp":"2024-09-12T17:41:44.632176+0000","last_deep_scrub":"265'387","last_deep_scrub_stamp":"2024-09-12T17:41:44.632176+0000","last_clean_scrub_stamp":"2024-09-12T17:41:44.632176+0000","objects_scrubbed":8,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:18.192979+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079973,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":470,"num_read_kb":3460,"num_write":1200,"num_write_kb":27732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"265'217","reported_seq":863,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:50.375635+0000","last_change":"2024-09-12T17:41:50.375635+0000","last_active":"2024-09-12T17:41:50.375635+0000","last_peered":"2024-09-12T17:41:50.375635+0000","last_clean":"2024-09-12T17:41:50.375635+0000","last_became_active":"2024-09-12T16:58:21.713518+0000","last_became_peered":"2024-09-12T16:58:21.713518+0000","last_unstale":"2024-09-12T17:41:50.375635+0000","last_undegraded":"2024-09-12T17:41:50.375635+0000","last_fullsized":"2024-09-12T17:41:50.375635+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'217","last_scrub_stamp":"2024-09-12T17:41:50.375457+0000","last_deep_scrub":"265'217","last_deep_scrub_stamp":"2024-09-12T17:41:50.375457+0000","last_clean_scrub_stamp":"2024-09-12T17:41:50.375457+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:56.530237+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":958,"num_read_kb":791,"num_write":328,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"265'342","reported_seq":1092,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:43.287506+0000","last_change":"2024-09-12T17:41:43.287240+0000","last_active":"2024-09-12T17:41:43.287506+0000","last_peered":"2024-09-12T17:41:43.287506+0000","last_clean":"2024-09-12T17:41:43.287506+0000","last_became_active":"2024-09-12T16:58:18.711021+0000","last_became_peered":"2024-09-12T16:58:18.711021+0000","last_unstale":"2024-09-12T17:41:43.287506+0000","last_undegraded":"2024-09-12T17:41:43.287506+0000","last_fullsized":"2024-09-12T17:41:43.287506+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'342","last_scrub_stamp":"2024-09-12T17:41:43.286936+0000","last_deep_scrub":"265'342","last_deep_scrub_stamp":"2024-09-12T17:41:43.286936+0000","last_clean_scrub_stamp":"2024-09-12T17:41:43.286936+0000","objects_scrubbed":7,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:58.141097+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399320,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":801,"num_read_kb":13816,"num_write":1128,"num_write_kb":16955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"265'187","reported_seq":817,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:38.578936+0000","last_change":"2024-09-12T17:41:38.578936+0000","last_active":"2024-09-12T17:41:38.578936+0000","last_peered":"2024-09-12T17:41:38.578936+0000","last_clean":"2024-09-12T17:41:38.578936+0000","last_became_active":"2024-09-12T16:58:55.849635+0000","last_became_peered":"2024-09-12T16:58:55.849635+0000","last_unstale":"2024-09-12T17:41:38.578936+0000","last_undegraded":"2024-09-12T17:41:38.578936+0000","last_fullsized":"2024-09-12T17:41:38.578936+0000","mapping_epoch":37,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'187","last_scrub_stamp":"2024-09-12T17:41:38.578864+0000","last_deep_scrub":"265'187","last_deep_scrub_stamp":"2024-09-12T17:41:38.578864+0000","last_clean_scrub_stamp":"2024-09-12T17:41:38.578864+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:15.935562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":876,"num_read_kb":735,"num_write":297,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"265'358","reported_seq":1203,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:45.678992+0000","last_change":"2024-09-12T17:41:45.678992+0000","last_active":"2024-09-12T17:41:45.678992+0000","last_peered":"2024-09-12T17:41:45.678992+0000","last_clean":"2024-09-12T17:41:45.678992+0000","last_became_active":"2024-09-12T16:58:18.677892+0000","last_became_peered":"2024-09-12T16:58:18.677892+0000","last_unstale":"2024-09-12T17:41:45.678992+0000","last_undegraded":"2024-09-12T17:41:45.678992+0000","last_fullsized":"2024-09-12T17:41:45.678992+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'358","last_scrub_stamp":"2024-09-12T17:41:45.678772+0000","last_deep_scrub":"265'358","last_deep_scrub_stamp":"2024-09-12T17:41:45.678772+0000","last_clean_scrub_stamp":"2024-09-12T17:41:45.678772+0000","objects_scrubbed":5,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:53.062308+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3586908,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":894,"num_read_kb":13074,"num_write":1175,"num_write_kb":22747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"265'421","reported_seq":1151,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:52.679988+0000","last_change":"2024-09-12T17:41:52.679684+0000","last_active":"2024-09-12T17:41:52.679988+0000","last_peered":"2024-09-12T17:41:52.679988+0000","last_clean":"2024-09-12T17:41:52.679988+0000","last_became_active":"2024-09-12T16:58:21.729867+0000","last_became_peered":"2024-09-12T16:58:21.729867+0000","last_unstale":"2024-09-12T17:41:52.679988+0000","last_undegraded":"2024-09-12T17:41:52.679988+0000","last_fullsized":"2024-09-12T17:41:52.679988+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'421","last_scrub_stamp":"2024-09-12T17:41:52.679449+0000","last_deep_scrub":"265'421","last_deep_scrub_stamp":"2024-09-12T17:41:52.679449+0000","last_clean_scrub_stamp":"2024-09-12T17:41:52.679449+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:02.342262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1962,"num_read_kb":1662,"num_write":651,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25753,"num_omap_keys":101,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"265'370","reported_seq":1060,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:41.467435+0000","last_change":"2024-09-12T17:41:41.467284+0000","last_active":"2024-09-12T17:41:41.467435+0000","last_peered":"2024-09-12T17:41:41.467435+0000","last_clean":"2024-09-12T17:41:41.467435+0000","last_became_active":"2024-09-12T16:58:18.707110+0000","last_became_peered":"2024-09-12T16:58:18.707110+0000","last_unstale":"2024-09-12T17:41:41.467435+0000","last_undegraded":"2024-09-12T17:41:41.467435+0000","last_fullsized":"2024-09-12T17:41:41.467435+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'370","last_scrub_stamp":"2024-09-12T17:41:41.467058+0000","last_deep_scrub":"265'370","last_deep_scrub_stamp":"2024-09-12T17:41:41.467058+0000","last_clean_scrub_stamp":"2024-09-12T17:41:41.467058+0000","objects_scrubbed":8,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:00.889176+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079974,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":702,"num_read_kb":1852,"num_write":1120,"num_write_kb":24861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"265'4296","reported_seq":5008,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:58.441073+0000","last_change":"2024-09-12T17:41:58.440762+0000","last_active":"2024-09-12T17:41:58.441073+0000","last_peered":"2024-09-12T17:41:58.441073+0000","last_clean":"2024-09-12T17:41:58.441073+0000","last_became_active":"2024-09-12T16:58:55.957007+0000","last_became_peered":"2024-09-12T16:58:55.957007+0000","last_unstale":"2024-09-12T17:41:58.441073+0000","last_undegraded":"2024-09-12T17:41:58.441073+0000","last_fullsized":"2024-09-12T17:41:58.441073+0000","mapping_epoch":37,"log_start":"265'4200","ondisk_log_start":"265'4200","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4296","last_scrub_stamp":"2024-09-12T17:41:58.440458+0000","last_deep_scrub":"265'4296","last_deep_scrub_stamp":"2024-09-12T17:41:58.440458+0000","last_clean_scrub_stamp":"2024-09-12T17:41:58.440458+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":3000,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:53.198353+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17379,"num_read_kb":14566,"num_write":6493,"num_write_kb":3276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"265'330","reported_seq":1043,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:43.481239+0000","last_change":"2024-09-12T17:41:43.481239+0000","last_active":"2024-09-12T17:41:43.481239+0000","last_peered":"2024-09-12T17:41:43.481239+0000","last_clean":"2024-09-12T17:41:43.481239+0000","last_became_active":"2024-09-12T16:58:18.715010+0000","last_became_peered":"2024-09-12T16:58:18.715010+0000","last_unstale":"2024-09-12T17:41:43.481239+0000","last_undegraded":"2024-09-12T17:41:43.481239+0000","last_fullsized":"2024-09-12T17:41:43.481239+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'330","last_scrub_stamp":"2024-09-12T17:41:43.480992+0000","last_deep_scrub":"265'330","last_deep_scrub_stamp":"2024-09-12T17:41:43.480992+0000","last_clean_scrub_stamp":"2024-09-12T17:41:43.480992+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:26.534765+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":628,"num_read_kb":2506,"num_write":964,"num_write_kb":15075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"265'104","reported_seq":694,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:47.466090+0000","last_change":"2024-09-12T17:41:47.465918+0000","last_active":"2024-09-12T17:41:47.466090+0000","last_peered":"2024-09-12T17:41:47.466090+0000","last_clean":"2024-09-12T17:41:47.466090+0000","last_became_active":"2024-09-12T16:58:21.720908+0000","last_became_peered":"2024-09-12T16:58:21.720908+0000","last_unstale":"2024-09-12T17:41:47.466090+0000","last_undegraded":"2024-09-12T17:41:47.466090+0000","last_fullsized":"2024-09-12T17:41:47.466090+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'104","last_scrub_stamp":"2024-09-12T17:41:47.465734+0000","last_deep_scrub":"265'104","last_deep_scrub_stamp":"2024-09-12T17:41:47.465734+0000","last_clean_scrub_stamp":"2024-09-12T17:41:47.465734+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:02.185124+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":432,"num_read_kb":360,"num_write":161,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"265'394","reported_seq":1124,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:43.705321+0000","last_change":"2024-09-12T17:41:43.705321+0000","last_active":"2024-09-12T17:41:43.705321+0000","last_peered":"2024-09-12T17:41:43.705321+0000","last_clean":"2024-09-12T17:41:43.705321+0000","last_became_active":"2024-09-12T16:58:18.680305+0000","last_became_peered":"2024-09-12T16:58:18.680305+0000","last_unstale":"2024-09-12T17:41:43.705321+0000","last_undegraded":"2024-09-12T17:41:43.705321+0000","last_fullsized":"2024-09-12T17:41:43.705321+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'394","last_scrub_stamp":"2024-09-12T17:41:43.705097+0000","last_deep_scrub":"265'394","last_deep_scrub_stamp":"2024-09-12T17:41:43.705097+0000","last_clean_scrub_stamp":"2024-09-12T17:41:43.705097+0000","objects_scrubbed":7,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:48.384452+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263201,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":688,"num_read_kb":33513,"num_write":1376,"num_write_kb":33353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"265'175","reported_seq":800,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:53.039664+0000","last_change":"2024-09-12T17:41:53.039664+0000","last_active":"2024-09-12T17:41:53.039664+0000","last_peered":"2024-09-12T17:41:53.039664+0000","last_clean":"2024-09-12T17:41:53.039664+0000","last_became_active":"2024-09-12T16:58:21.713765+0000","last_became_peered":"2024-09-12T16:58:21.713765+0000","last_unstale":"2024-09-12T17:41:53.039664+0000","last_undegraded":"2024-09-12T17:41:53.039664+0000","last_fullsized":"2024-09-12T17:41:53.039664+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'175","last_scrub_stamp":"2024-09-12T17:41:53.039428+0000","last_deep_scrub":"265'175","last_deep_scrub_stamp":"2024-09-12T17:41:53.039428+0000","last_clean_scrub_stamp":"2024-09-12T17:41:53.039428+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:20.616593+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":769,"num_read_kb":637,"num_write":246,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"265'374","reported_seq":1032,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:46.639986+0000","last_change":"2024-09-12T17:41:46.639869+0000","last_active":"2024-09-12T17:41:46.639986+0000","last_peered":"2024-09-12T17:41:46.639986+0000","last_clean":"2024-09-12T17:41:46.639986+0000","last_became_active":"2024-09-12T16:58:18.713629+0000","last_became_peered":"2024-09-12T16:58:18.713629+0000","last_unstale":"2024-09-12T17:41:46.639986+0000","last_undegraded":"2024-09-12T17:41:46.639986+0000","last_fullsized":"2024-09-12T17:41:46.639986+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'374","last_scrub_stamp":"2024-09-12T17:41:46.639653+0000","last_deep_scrub":"265'374","last_deep_scrub_stamp":"2024-09-12T17:41:46.639653+0000","last_clean_scrub_stamp":"2024-09-12T17:41:46.639653+0000","objects_scrubbed":9,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:07.696868+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1369511,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":530,"num_read_kb":40377,"num_write":1157,"num_write_kb":39449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"265'158","reported_seq":736,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:54.669213+0000","last_change":"2024-09-12T17:41:54.669213+0000","last_active":"2024-09-12T17:41:54.669213+0000","last_peered":"2024-09-12T17:41:54.669213+0000","last_clean":"2024-09-12T17:41:54.669213+0000","last_became_active":"2024-09-12T16:58:21.718980+0000","last_became_peered":"2024-09-12T16:58:21.718980+0000","last_unstale":"2024-09-12T17:41:54.669213+0000","last_undegraded":"2024-09-12T17:41:54.669213+0000","last_fullsized":"2024-09-12T17:41:54.669213+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'158","last_scrub_stamp":"2024-09-12T17:41:54.668917+0000","last_deep_scrub":"265'158","last_deep_scrub_stamp":"2024-09-12T17:41:54.668917+0000","last_clean_scrub_stamp":"2024-09-12T17:41:54.668917+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:44.886998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":669,"num_read_kb":540,"num_write":242,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"265'388","reported_seq":1080,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:51.554602+0000","last_change":"2024-09-12T17:41:51.554602+0000","last_active":"2024-09-12T17:41:51.554602+0000","last_peered":"2024-09-12T17:41:51.554602+0000","last_clean":"2024-09-12T17:41:51.554602+0000","last_became_active":"2024-09-12T16:58:18.678270+0000","last_became_peered":"2024-09-12T16:58:18.678270+0000","last_unstale":"2024-09-12T17:41:51.554602+0000","last_undegraded":"2024-09-12T17:41:51.554602+0000","last_fullsized":"2024-09-12T17:41:51.554602+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'388","last_scrub_stamp":"2024-09-12T17:41:51.554411+0000","last_deep_scrub":"265'388","last_deep_scrub_stamp":"2024-09-12T17:41:51.554411+0000","last_clean_scrub_stamp":"2024-09-12T17:41:51.554411+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:05.022058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":570,"num_read_kb":53855,"num_write":1232,"num_write_kb":47481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"265'252","reported_seq":879,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:42.524940+0000","last_change":"2024-09-12T17:41:42.524940+0000","last_active":"2024-09-12T17:41:42.524940+0000","last_peered":"2024-09-12T17:41:42.524940+0000","last_clean":"2024-09-12T17:41:42.524940+0000","last_became_active":"2024-09-12T16:58:21.729301+0000","last_became_peered":"2024-09-12T16:58:21.729301+0000","last_unstale":"2024-09-12T17:41:42.524940+0000","last_undegraded":"2024-09-12T17:41:42.524940+0000","last_fullsized":"2024-09-12T17:41:42.524940+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'252","last_scrub_stamp":"2024-09-12T17:41:42.524765+0000","last_deep_scrub":"265'252","last_deep_scrub_stamp":"2024-09-12T17:41:42.524765+0000","last_clean_scrub_stamp":"2024-09-12T17:41:42.524765+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:58.178842+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1107,"num_read_kb":902,"num_write":427,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"265'448","reported_seq":1129,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:45.590167+0000","last_change":"2024-09-12T17:41:45.590167+0000","last_active":"2024-09-12T17:41:45.590167+0000","last_peered":"2024-09-12T17:41:45.590167+0000","last_clean":"2024-09-12T17:41:45.590167+0000","last_became_active":"2024-09-12T16:58:18.719658+0000","last_became_peered":"2024-09-12T16:58:18.719658+0000","last_unstale":"2024-09-12T17:41:45.590167+0000","last_undegraded":"2024-09-12T17:41:45.590167+0000","last_fullsized":"2024-09-12T17:41:45.590167+0000","mapping_epoch":23,"log_start":"265'400","ondisk_log_start":"265'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'448","last_scrub_stamp":"2024-09-12T17:41:45.589925+0000","last_deep_scrub":"265'448","last_deep_scrub_stamp":"2024-09-12T17:41:45.589925+0000","last_clean_scrub_stamp":"2024-09-12T17:41:45.589925+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:39.534937+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170320,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":708,"num_read_kb":15766,"num_write":1393,"num_write_kb":33267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"265'203","reported_seq":847,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:53.694005+0000","last_change":"2024-09-12T17:41:53.694005+0000","last_active":"2024-09-12T17:41:53.694005+0000","last_peered":"2024-09-12T17:41:53.694005+0000","last_clean":"2024-09-12T17:41:53.694005+0000","last_became_active":"2024-09-12T16:58:21.730589+0000","last_became_peered":"2024-09-12T16:58:21.730589+0000","last_unstale":"2024-09-12T17:41:53.694005+0000","last_undegraded":"2024-09-12T17:41:53.694005+0000","last_fullsized":"2024-09-12T17:41:53.694005+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'203","last_scrub_stamp":"2024-09-12T17:41:53.693830+0000","last_deep_scrub":"265'203","last_deep_scrub_stamp":"2024-09-12T17:41:53.693830+0000","last_clean_scrub_stamp":"2024-09-12T17:41:53.693830+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:02.739000+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":887,"num_read_kb":736,"num_write":325,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"265'366","reported_seq":1041,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:45.233630+0000","last_change":"2024-09-12T17:41:45.233630+0000","last_active":"2024-09-12T17:41:45.233630+0000","last_peered":"2024-09-12T17:41:45.233630+0000","last_clean":"2024-09-12T17:41:45.233630+0000","last_became_active":"2024-09-12T16:58:18.691716+0000","last_became_peered":"2024-09-12T16:58:18.691716+0000","last_unstale":"2024-09-12T17:41:45.233630+0000","last_undegraded":"2024-09-12T17:41:45.233630+0000","last_fullsized":"2024-09-12T17:41:45.233630+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'366","last_scrub_stamp":"2024-09-12T17:41:45.233427+0000","last_deep_scrub":"265'366","last_deep_scrub_stamp":"2024-09-12T17:41:45.233427+0000","last_clean_scrub_stamp":"2024-09-12T17:41:45.233427+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:39.091059+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":528,"num_read_kb":37415,"num_write":1121,"num_write_kb":27973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"265'333","reported_seq":946,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:54.648323+0000","last_change":"2024-09-12T17:41:54.648323+0000","last_active":"2024-09-12T17:41:54.648323+0000","last_peered":"2024-09-12T17:41:54.648323+0000","last_clean":"2024-09-12T17:41:54.648323+0000","last_became_active":"2024-09-12T16:58:21.722380+0000","last_became_peered":"2024-09-12T16:58:21.722380+0000","last_unstale":"2024-09-12T17:41:54.648323+0000","last_undegraded":"2024-09-12T17:41:54.648323+0000","last_fullsized":"2024-09-12T17:41:54.648323+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'333","last_scrub_stamp":"2024-09-12T17:41:54.648087+0000","last_deep_scrub":"265'333","last_deep_scrub_stamp":"2024-09-12T17:41:54.648087+0000","last_clean_scrub_stamp":"2024-09-12T17:41:54.648087+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:12.851283+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1422,"num_read_kb":1143,"num_write":550,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"265'349","reported_seq":1023,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:48.502516+0000","last_change":"2024-09-12T17:41:48.502516+0000","last_active":"2024-09-12T17:41:48.502516+0000","last_peered":"2024-09-12T17:41:48.502516+0000","last_clean":"2024-09-12T17:41:48.502516+0000","last_became_active":"2024-09-12T16:58:18.709090+0000","last_became_peered":"2024-09-12T16:58:18.709090+0000","last_unstale":"2024-09-12T17:41:48.502516+0000","last_undegraded":"2024-09-12T17:41:48.502516+0000","last_fullsized":"2024-09-12T17:41:48.502516+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'349","last_scrub_stamp":"2024-09-12T17:41:48.502301+0000","last_deep_scrub":"265'349","last_deep_scrub_stamp":"2024-09-12T17:41:48.502301+0000","last_clean_scrub_stamp":"2024-09-12T17:41:48.502301+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:56.806960+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289348,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":537,"num_read_kb":42087,"num_write":1134,"num_write_kb":38244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"265'160","reported_seq":776,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:52.084538+0000","last_change":"2024-09-12T17:41:52.084538+0000","last_active":"2024-09-12T17:41:52.084538+0000","last_peered":"2024-09-12T17:41:52.084538+0000","last_clean":"2024-09-12T17:41:52.084538+0000","last_became_active":"2024-09-12T16:58:21.725262+0000","last_became_peered":"2024-09-12T16:58:21.725262+0000","last_unstale":"2024-09-12T17:41:52.084538+0000","last_undegraded":"2024-09-12T17:41:52.084538+0000","last_fullsized":"2024-09-12T17:41:52.084538+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'160","last_scrub_stamp":"2024-09-12T17:41:52.084334+0000","last_deep_scrub":"265'160","last_deep_scrub_stamp":"2024-09-12T17:41:52.084334+0000","last_clean_scrub_stamp":"2024-09-12T17:41:52.084334+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:02:11.578223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":648,"num_read_kb":538,"num_write":222,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"265'356","reported_seq":1033,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:52.569090+0000","last_change":"2024-09-12T17:41:52.569090+0000","last_active":"2024-09-12T17:41:52.569090+0000","last_peered":"2024-09-12T17:41:52.569090+0000","last_clean":"2024-09-12T17:41:52.569090+0000","last_became_active":"2024-09-12T16:58:18.713131+0000","last_became_peered":"2024-09-12T16:58:18.713131+0000","last_unstale":"2024-09-12T17:41:52.569090+0000","last_undegraded":"2024-09-12T17:41:52.569090+0000","last_fullsized":"2024-09-12T17:41:52.569090+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'356","last_scrub_stamp":"2024-09-12T17:41:52.568904+0000","last_deep_scrub":"265'356","last_deep_scrub_stamp":"2024-09-12T17:41:52.568904+0000","last_clean_scrub_stamp":"2024-09-12T17:41:52.568904+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:36.659748+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254228,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":564,"num_read_kb":4620,"num_write":1119,"num_write_kb":30053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"265'101","reported_seq":704,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:57.446406+0000","last_change":"2024-09-12T17:41:57.446406+0000","last_active":"2024-09-12T17:41:57.446406+0000","last_peered":"2024-09-12T17:41:57.446406+0000","last_clean":"2024-09-12T17:41:57.446406+0000","last_became_active":"2024-09-12T16:58:21.693930+0000","last_became_peered":"2024-09-12T16:58:21.693930+0000","last_unstale":"2024-09-12T17:41:57.446406+0000","last_undegraded":"2024-09-12T17:41:57.446406+0000","last_fullsized":"2024-09-12T17:41:57.446406+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'101","last_scrub_stamp":"2024-09-12T17:41:57.446228+0000","last_deep_scrub":"265'101","last_deep_scrub_stamp":"2024-09-12T17:41:57.446228+0000","last_clean_scrub_stamp":"2024-09-12T17:41:57.446228+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:12.831695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":454,"num_read_kb":382,"num_write":143,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"265'358","reported_seq":1006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:41.572498+0000","last_change":"2024-09-12T17:41:41.572498+0000","last_active":"2024-09-12T17:41:41.572498+0000","last_peered":"2024-09-12T17:41:41.572498+0000","last_clean":"2024-09-12T17:41:41.572498+0000","last_became_active":"2024-09-12T16:58:18.704118+0000","last_became_peered":"2024-09-12T16:58:18.704118+0000","last_unstale":"2024-09-12T17:41:41.572498+0000","last_undegraded":"2024-09-12T17:41:41.572498+0000","last_fullsized":"2024-09-12T17:41:41.572498+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'358","last_scrub_stamp":"2024-09-12T17:41:41.572292+0000","last_deep_scrub":"265'358","last_deep_scrub_stamp":"2024-09-12T17:41:41.572292+0000","last_clean_scrub_stamp":"2024-09-12T17:41:41.572292+0000","objects_scrubbed":8,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:25.803929+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079958,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":546,"num_read_kb":7376,"num_write":1271,"num_write_kb":14643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"265'376","reported_seq":975,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:51.551645+0000","last_change":"2024-09-12T17:41:51.551645+0000","last_active":"2024-09-12T17:41:51.551645+0000","last_peered":"2024-09-12T17:41:51.551645+0000","last_clean":"2024-09-12T17:41:51.551645+0000","last_became_active":"2024-09-12T16:58:21.714554+0000","last_became_peered":"2024-09-12T16:58:21.714554+0000","last_unstale":"2024-09-12T17:41:51.551645+0000","last_undegraded":"2024-09-12T17:41:51.551645+0000","last_fullsized":"2024-09-12T17:41:51.551645+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'376","last_scrub_stamp":"2024-09-12T17:41:51.551368+0000","last_deep_scrub":"265'376","last_deep_scrub_stamp":"2024-09-12T17:41:51.551368+0000","last_clean_scrub_stamp":"2024-09-12T17:41:51.551368+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:23.069379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1689,"num_read_kb":1453,"num_write":661,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"265'390","reported_seq":1106,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:48.614895+0000","last_change":"2024-09-12T17:41:48.614895+0000","last_active":"2024-09-12T17:41:48.614895+0000","last_peered":"2024-09-12T17:41:48.614895+0000","last_clean":"2024-09-12T17:41:48.614895+0000","last_became_active":"2024-09-12T16:58:18.719691+0000","last_became_peered":"2024-09-12T16:58:18.719691+0000","last_unstale":"2024-09-12T17:41:48.614895+0000","last_undegraded":"2024-09-12T17:41:48.614895+0000","last_fullsized":"2024-09-12T17:41:48.614895+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'390","last_scrub_stamp":"2024-09-12T17:41:48.614702+0000","last_deep_scrub":"265'390","last_deep_scrub_stamp":"2024-09-12T17:41:48.614702+0000","last_clean_scrub_stamp":"2024-09-12T17:41:48.614702+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:01.712719+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":758,"num_read_kb":7681,"num_write":1308,"num_write_kb":23567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"265'356","reported_seq":1016,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:50.628413+0000","last_change":"2024-09-12T17:41:50.628413+0000","last_active":"2024-09-12T17:41:50.628413+0000","last_peered":"2024-09-12T17:41:50.628413+0000","last_clean":"2024-09-12T17:41:50.628413+0000","last_became_active":"2024-09-12T16:58:18.698393+0000","last_became_peered":"2024-09-12T16:58:18.698393+0000","last_unstale":"2024-09-12T17:41:50.628413+0000","last_undegraded":"2024-09-12T17:41:50.628413+0000","last_fullsized":"2024-09-12T17:41:50.628413+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'356","last_scrub_stamp":"2024-09-12T17:41:50.628167+0000","last_deep_scrub":"265'356","last_deep_scrub_stamp":"2024-09-12T17:41:50.628167+0000","last_clean_scrub_stamp":"2024-09-12T17:41:50.628167+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:03.341903+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":536,"num_read_kb":34677,"num_write":1126,"num_write_kb":53307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"265'106","reported_seq":694,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:56.027628+0000","last_change":"2024-09-12T17:41:56.027469+0000","last_active":"2024-09-12T17:41:56.027628+0000","last_peered":"2024-09-12T17:41:56.027628+0000","last_clean":"2024-09-12T17:41:56.027628+0000","last_became_active":"2024-09-12T16:58:21.714240+0000","last_became_peered":"2024-09-12T16:58:21.714240+0000","last_unstale":"2024-09-12T17:41:56.027628+0000","last_undegraded":"2024-09-12T17:41:56.027628+0000","last_fullsized":"2024-09-12T17:41:56.027628+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'106","last_scrub_stamp":"2024-09-12T17:41:56.027242+0000","last_deep_scrub":"265'106","last_deep_scrub_stamp":"2024-09-12T17:41:56.027242+0000","last_clean_scrub_stamp":"2024-09-12T17:41:56.027242+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:14.917329+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":476,"num_read_kb":394,"num_write":172,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"265'366","reported_seq":1053,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:43.412364+0000","last_change":"2024-09-12T17:41:43.412364+0000","last_active":"2024-09-12T17:41:43.412364+0000","last_peered":"2024-09-12T17:41:43.412364+0000","last_clean":"2024-09-12T17:41:43.412364+0000","last_became_active":"2024-09-12T16:58:18.707649+0000","last_became_peered":"2024-09-12T16:58:18.707649+0000","last_unstale":"2024-09-12T17:41:43.412364+0000","last_undegraded":"2024-09-12T17:41:43.412364+0000","last_fullsized":"2024-09-12T17:41:43.412364+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'366","last_scrub_stamp":"2024-09-12T17:41:43.412171+0000","last_deep_scrub":"265'366","last_deep_scrub_stamp":"2024-09-12T17:41:43.412171+0000","last_clean_scrub_stamp":"2024-09-12T17:41:43.412171+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:07.821353+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":580,"num_read_kb":14659,"num_write":1122,"num_write_kb":33951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"265'4160","reported_seq":4803,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:56.630467+0000","last_change":"2024-09-12T17:41:56.630467+0000","last_active":"2024-09-12T17:41:56.630467+0000","last_peered":"2024-09-12T17:41:56.630467+0000","last_clean":"2024-09-12T17:41:56.630467+0000","last_became_active":"2024-09-12T16:58:21.718537+0000","last_became_peered":"2024-09-12T16:58:21.718537+0000","last_unstale":"2024-09-12T17:41:56.630467+0000","last_undegraded":"2024-09-12T17:41:56.630467+0000","last_fullsized":"2024-09-12T17:41:56.630467+0000","mapping_epoch":26,"log_start":"265'4100","ondisk_log_start":"265'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4160","last_scrub_stamp":"2024-09-12T17:41:56.630278+0000","last_deep_scrub":"265'4160","last_deep_scrub_stamp":"2024-09-12T17:41:56.630278+0000","last_clean_scrub_stamp":"2024-09-12T17:41:56.630278+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":3000,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:59.447977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16773,"num_read_kb":14078,"num_write":6250,"num_write_kb":3119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6189,"num_read_kb":4469,"num_write":2002,"num_write_kb":899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4473,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":975,"ondisk_log_size":975,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15645,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":16183,"num_read_kb":15867,"num_write":16715,"num_write_kb":4878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2756,"num_omap_keys":18,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1646,"ondisk_log_size":1646,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":514,"ondisk_log_size":514,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1598421,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":17353,"num_read_kb":36703,"num_write":14501,"num_write_kb":11559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":682084,"num_omap_keys":1558,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2007,"ondisk_log_size":2007,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2412,"num_read_kb":2875,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":102570,"num_read_kb":85739,"num_write":37214,"num_write_kb":18735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":44323,"num_omap_keys":179,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4271,"ondisk_log_size":4271,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":940,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":74886563,"num_objects":371,"num_object_clones":0,"num_object_copies":742,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":371,"num_whiteouts":0,"num_read":36323,"num_read_kb":1886569,"num_write":72643,"num_write_kb":2069560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":151003136,"data_stored":149773126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3656,"ondisk_log_size":3656,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":211125,"num_write":190,"num_write_kb":136313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1087,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":198791,"num_write":190,"num_write_kb":136313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509980,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":170196,"kb_used_data":36356,"kb_used_omap":1,"kb_used_meta":133822,"kb_avail":94201644,"statfs":{"total":96636764160,"available":96462483456,"internally_reserved":0,"allocated":37228544,"data_stored":35444692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":137034181},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509979,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":279304,"kb_used_data":27384,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94092536,"statfs":{"total":96636764160,"available":96350756864,"internally_reserved":0,"allocated":28041216,"data_stored":26261645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":257948103},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509984,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110480,"kb_used_data":11328,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94261360,"statfs":{"total":96636764160,"available":96523632640,"internally_reserved":0,"allocated":11599872,"data_stored":9988574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509979,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284328,"kb_used_data":32472,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":94087512,"statfs":{"total":96636764160,"available":96345612288,"internally_reserved":0,"allocated":33251328,"data_stored":31541637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":257882565},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542684,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":254076,"kb_used_data":16044,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94117764,"statfs":{"total":96636764160,"available":96376590336,"internally_reserved":0,"allocated":16429056,"data_stored":14715336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":243726795},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542685,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":229016,"kb_used_data":17352,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":94142824,"statfs":{"total":96636764160,"available":96402251776,"internally_reserved":0,"allocated":17768448,"data_stored":16188165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":216725958},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542683,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119364,"kb_used_data":25780,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94252476,"statfs":{"total":96636764160,"available":96514535424,"internally_reserved":0,"allocated":26398720,"data_stored":24782410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575387,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76500,"kb_used_data":10564,"kb_used_omap":1,"kb_used_meta":65918,"kb_avail":94295340,"statfs":{"total":96636764160,"available":96558428160,"internally_reserved":0,"allocated":10817536,"data_stored":9242321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":67500485},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28966912,"data_stored":28798943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7954432,"data_stored":7838758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":7192576,"data_stored":7091940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24338432,"data_stored":24108487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":22761472,"data_stored":22631077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":33509376,"data_stored":33292137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14131200,"data_stored":14038127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12148736,"data_stored":11973657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":5371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":5873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:42:41.716 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:41.716 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:41.717 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T17:15:42.110346+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=15, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:41.717 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:41.718 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T17:27:16.350181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=41, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:42:41.722 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T17:43:01.722 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:43:02.098 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-12T17:43:02.110 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-09-12T17:43:02.120 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":1608,"stamp":"2024-09-12T17:43:01.856698+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":77092809,"num_objects":701,"num_object_clones":0,"num_object_copies":1402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":701,"num_whiteouts":0,"num_read":181455,"num_read_kb":2442205,"num_write":143598,"num_write_kb":2379913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1087,"num_keys_recovered":0,"num_objects_omap":62,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":734764,"num_omap_keys":1776,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13438,"ondisk_log_size":13438,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1502400,"kb_used_data":177280,"kb_used_omap":12,"kb_used_meta":1324979,"kb_avail":753472320,"statfs":{"total":773094113280,"available":771555655680,"internally_reserved":0,"allocated":181534720,"data_stored":168164780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1356779057},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008366"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":27,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:25.710304+0000","last_change":"2024-09-12T17:42:25.710304+0000","last_active":"2024-09-12T17:42:25.710304+0000","last_peered":"2024-09-12T17:42:25.710304+0000","last_clean":"2024-09-12T17:42:25.710304+0000","last_became_active":"2024-09-12T17:27:17.403833+0000","last_became_peered":"2024-09-12T17:27:17.403833+0000","last_unstale":"2024-09-12T17:42:25.710304+0000","last_undegraded":"2024-09-12T17:42:25.710304+0000","last_fullsized":"2024-09-12T17:42:25.710304+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:25.710119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:25.710119+0000","last_clean_scrub_stamp":"2024-09-12T17:42:25.710119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:55.995072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"265'5","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:26.703218+0000","last_change":"2024-09-12T17:42:26.703218+0000","last_active":"2024-09-12T17:42:26.703218+0000","last_peered":"2024-09-12T17:42:26.703218+0000","last_clean":"2024-09-12T17:42:26.703218+0000","last_became_active":"2024-09-12T17:15:43.158714+0000","last_became_peered":"2024-09-12T17:15:43.158714+0000","last_unstale":"2024-09-12T17:42:26.703218+0000","last_undegraded":"2024-09-12T17:42:26.703218+0000","last_fullsized":"2024-09-12T17:42:26.703218+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T17:42:26.703037+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T17:42:26.703037+0000","last_clean_scrub_stamp":"2024-09-12T17:42:26.703037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:10.522034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"262'2","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:24.574786+0000","last_change":"2024-09-12T17:42:24.574786+0000","last_active":"2024-09-12T17:42:24.574786+0000","last_peered":"2024-09-12T17:42:24.574786+0000","last_clean":"2024-09-12T17:42:24.574786+0000","last_became_active":"2024-09-12T17:15:40.126170+0000","last_became_peered":"2024-09-12T17:15:40.126170+0000","last_unstale":"2024-09-12T17:42:24.574786+0000","last_undegraded":"2024-09-12T17:42:24.574786+0000","last_fullsized":"2024-09-12T17:42:24.574786+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T17:42:24.574547+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T17:42:24.574547+0000","last_clean_scrub_stamp":"2024-09-12T17:42:24.574547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:52.073634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"265'24","reported_seq":119,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:21.885160+0000","last_change":"2024-09-12T17:42:21.885160+0000","last_active":"2024-09-12T17:42:21.885160+0000","last_peered":"2024-09-12T17:42:21.885160+0000","last_clean":"2024-09-12T17:42:21.885160+0000","last_became_active":"2024-09-12T17:13:54.845556+0000","last_became_peered":"2024-09-12T17:13:54.845556+0000","last_unstale":"2024-09-12T17:42:21.885160+0000","last_undegraded":"2024-09-12T17:42:21.885160+0000","last_fullsized":"2024-09-12T17:42:21.885160+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'24","last_scrub_stamp":"2024-09-12T17:42:21.884946+0000","last_deep_scrub":"265'24","last_deep_scrub_stamp":"2024-09-12T17:42:21.884946+0000","last_clean_scrub_stamp":"2024-09-12T17:42:21.884946+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:59.677554+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":82,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":27,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:08.598201+0000","last_change":"2024-09-12T17:42:08.597905+0000","last_active":"2024-09-12T17:42:08.598201+0000","last_peered":"2024-09-12T17:42:08.598201+0000","last_clean":"2024-09-12T17:42:08.598201+0000","last_became_active":"2024-09-12T17:27:17.421771+0000","last_became_peered":"2024-09-12T17:27:17.421771+0000","last_unstale":"2024-09-12T17:42:08.598201+0000","last_undegraded":"2024-09-12T17:42:08.598201+0000","last_fullsized":"2024-09-12T17:42:08.598201+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:08.597697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:08.597697+0000","last_clean_scrub_stamp":"2024-09-12T17:42:08.597697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:18.561900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:26.605233+0000","last_change":"2024-09-12T17:42:26.605233+0000","last_active":"2024-09-12T17:42:26.605233+0000","last_peered":"2024-09-12T17:42:26.605233+0000","last_clean":"2024-09-12T17:42:26.605233+0000","last_became_active":"2024-09-12T17:15:43.159316+0000","last_became_peered":"2024-09-12T17:15:43.159316+0000","last_unstale":"2024-09-12T17:42:26.605233+0000","last_undegraded":"2024-09-12T17:42:26.605233+0000","last_fullsized":"2024-09-12T17:42:26.605233+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:26.605047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:26.605047+0000","last_clean_scrub_stamp":"2024-09-12T17:42:26.605047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:24:03.182026+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"265'7","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:12.481578+0000","last_change":"2024-09-12T17:42:12.481578+0000","last_active":"2024-09-12T17:42:12.481578+0000","last_peered":"2024-09-12T17:42:12.481578+0000","last_clean":"2024-09-12T17:42:12.481578+0000","last_became_active":"2024-09-12T17:15:40.126087+0000","last_became_peered":"2024-09-12T17:15:40.126087+0000","last_unstale":"2024-09-12T17:42:12.481578+0000","last_undegraded":"2024-09-12T17:42:12.481578+0000","last_fullsized":"2024-09-12T17:42:12.481578+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T17:42:12.481394+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T17:42:12.481394+0000","last_clean_scrub_stamp":"2024-09-12T17:42:12.481394+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:23.055774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":1026,"num_write":12,"num_write_kb":5122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"265'36","reported_seq":153,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:01.717471+0000","last_change":"2024-09-12T17:42:01.717471+0000","last_active":"2024-09-12T17:42:01.717471+0000","last_peered":"2024-09-12T17:42:01.717471+0000","last_clean":"2024-09-12T17:42:01.717471+0000","last_became_active":"2024-09-12T17:13:54.837820+0000","last_became_peered":"2024-09-12T17:13:54.837820+0000","last_unstale":"2024-09-12T17:42:01.717471+0000","last_undegraded":"2024-09-12T17:42:01.717471+0000","last_fullsized":"2024-09-12T17:42:01.717471+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'36","last_scrub_stamp":"2024-09-12T17:42:01.717290+0000","last_deep_scrub":"265'36","last_deep_scrub_stamp":"2024-09-12T17:42:01.717290+0000","last_clean_scrub_stamp":"2024-09-12T17:42:01.717290+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:58.550806+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":180,"num_read_kb":123,"num_write":74,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:16.273609+0000","last_change":"2024-09-12T17:42:16.273609+0000","last_active":"2024-09-12T17:42:16.273609+0000","last_peered":"2024-09-12T17:42:16.273609+0000","last_clean":"2024-09-12T17:42:16.273609+0000","last_became_active":"2024-09-12T17:27:17.405657+0000","last_became_peered":"2024-09-12T17:27:17.405657+0000","last_unstale":"2024-09-12T17:42:16.273609+0000","last_undegraded":"2024-09-12T17:42:16.273609+0000","last_fullsized":"2024-09-12T17:42:16.273609+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:16.273412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:16.273412+0000","last_clean_scrub_stamp":"2024-09-12T17:42:16.273412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:31.670331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:30.868712+0000","last_change":"2024-09-12T17:42:30.868518+0000","last_active":"2024-09-12T17:42:30.868712+0000","last_peered":"2024-09-12T17:42:30.868712+0000","last_clean":"2024-09-12T17:42:30.868712+0000","last_became_active":"2024-09-12T17:15:43.868960+0000","last_became_peered":"2024-09-12T17:15:43.868960+0000","last_unstale":"2024-09-12T17:42:30.868712+0000","last_undegraded":"2024-09-12T17:42:30.868712+0000","last_fullsized":"2024-09-12T17:42:30.868712+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:30.868335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:30.868335+0000","last_clean_scrub_stamp":"2024-09-12T17:42:30.868335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:46.591979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"262'2","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:03.638699+0000","last_change":"2024-09-12T17:42:03.638699+0000","last_active":"2024-09-12T17:42:03.638699+0000","last_peered":"2024-09-12T17:42:03.638699+0000","last_clean":"2024-09-12T17:42:03.638699+0000","last_became_active":"2024-09-12T17:15:40.134513+0000","last_became_peered":"2024-09-12T17:15:40.134513+0000","last_unstale":"2024-09-12T17:42:03.638699+0000","last_undegraded":"2024-09-12T17:42:03.638699+0000","last_fullsized":"2024-09-12T17:42:03.638699+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T17:42:03.638514+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T17:42:03.638514+0000","last_clean_scrub_stamp":"2024-09-12T17:42:03.638514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:14.324547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"265'19","reported_seq":102,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:23.944405+0000","last_change":"2024-09-12T17:42:23.944405+0000","last_active":"2024-09-12T17:42:23.944405+0000","last_peered":"2024-09-12T17:42:23.944405+0000","last_clean":"2024-09-12T17:42:23.944405+0000","last_became_active":"2024-09-12T17:13:54.826480+0000","last_became_peered":"2024-09-12T17:13:54.826480+0000","last_unstale":"2024-09-12T17:42:23.944405+0000","last_undegraded":"2024-09-12T17:42:23.944405+0000","last_fullsized":"2024-09-12T17:42:23.944405+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'19","last_scrub_stamp":"2024-09-12T17:42:23.944188+0000","last_deep_scrub":"265'19","last_deep_scrub_stamp":"2024-09-12T17:42:23.944188+0000","last_clean_scrub_stamp":"2024-09-12T17:42:23.944188+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:00.522456+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":27,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:36.460565+0000","last_change":"2024-09-12T17:42:36.460565+0000","last_active":"2024-09-12T17:42:36.460565+0000","last_peered":"2024-09-12T17:42:36.460565+0000","last_clean":"2024-09-12T17:42:36.460565+0000","last_became_active":"2024-09-12T17:27:17.418519+0000","last_became_peered":"2024-09-12T17:27:17.418519+0000","last_unstale":"2024-09-12T17:42:36.460565+0000","last_undegraded":"2024-09-12T17:42:36.460565+0000","last_fullsized":"2024-09-12T17:42:36.460565+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:36.460375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:36.460375+0000","last_clean_scrub_stamp":"2024-09-12T17:42:36.460375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:29.205184+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"265'2","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:35.442495+0000","last_change":"2024-09-12T17:42:35.442495+0000","last_active":"2024-09-12T17:42:35.442495+0000","last_peered":"2024-09-12T17:42:35.442495+0000","last_clean":"2024-09-12T17:42:35.442495+0000","last_became_active":"2024-09-12T17:15:43.868600+0000","last_became_peered":"2024-09-12T17:15:43.868600+0000","last_unstale":"2024-09-12T17:42:35.442495+0000","last_undegraded":"2024-09-12T17:42:35.442495+0000","last_fullsized":"2024-09-12T17:42:35.442495+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T17:42:35.442301+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T17:42:35.442301+0000","last_clean_scrub_stamp":"2024-09-12T17:42:35.442301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:47.547957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"262'3","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:18.626693+0000","last_change":"2024-09-12T17:42:18.626500+0000","last_active":"2024-09-12T17:42:18.626693+0000","last_peered":"2024-09-12T17:42:18.626693+0000","last_clean":"2024-09-12T17:42:18.626693+0000","last_became_active":"2024-09-12T17:15:40.109161+0000","last_became_peered":"2024-09-12T17:15:40.109161+0000","last_unstale":"2024-09-12T17:42:18.626693+0000","last_undegraded":"2024-09-12T17:42:18.626693+0000","last_fullsized":"2024-09-12T17:42:18.626693+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-12T17:42:18.626303+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-12T17:42:18.626303+0000","last_clean_scrub_stamp":"2024-09-12T17:42:18.626303+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:27.434362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"265'31","reported_seq":135,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:20.554457+0000","last_change":"2024-09-12T17:42:20.554457+0000","last_active":"2024-09-12T17:42:20.554457+0000","last_peered":"2024-09-12T17:42:20.554457+0000","last_clean":"2024-09-12T17:42:20.554457+0000","last_became_active":"2024-09-12T17:13:54.838968+0000","last_became_peered":"2024-09-12T17:13:54.838968+0000","last_unstale":"2024-09-12T17:42:20.554457+0000","last_undegraded":"2024-09-12T17:42:20.554457+0000","last_fullsized":"2024-09-12T17:42:20.554457+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'31","last_scrub_stamp":"2024-09-12T17:42:20.554269+0000","last_deep_scrub":"265'31","last_deep_scrub_stamp":"2024-09-12T17:42:20.554269+0000","last_clean_scrub_stamp":"2024-09-12T17:42:20.554269+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:24.364242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":108,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:40.516582+0000","last_change":"2024-09-12T17:42:40.516582+0000","last_active":"2024-09-12T17:42:40.516582+0000","last_peered":"2024-09-12T17:42:40.516582+0000","last_clean":"2024-09-12T17:42:40.516582+0000","last_became_active":"2024-09-12T17:27:17.416509+0000","last_became_peered":"2024-09-12T17:27:17.416509+0000","last_unstale":"2024-09-12T17:42:40.516582+0000","last_undegraded":"2024-09-12T17:42:40.516582+0000","last_fullsized":"2024-09-12T17:42:40.516582+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:40.516395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:40.516395+0000","last_clean_scrub_stamp":"2024-09-12T17:42:40.516395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:56.866619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"265'11","reported_seq":65,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:22.655641+0000","last_change":"2024-09-12T17:42:22.655641+0000","last_active":"2024-09-12T17:42:22.655641+0000","last_peered":"2024-09-12T17:42:22.655641+0000","last_clean":"2024-09-12T17:42:22.655641+0000","last_became_active":"2024-09-12T17:15:43.162643+0000","last_became_peered":"2024-09-12T17:15:43.162643+0000","last_unstale":"2024-09-12T17:42:22.655641+0000","last_undegraded":"2024-09-12T17:42:22.655641+0000","last_fullsized":"2024-09-12T17:42:22.655641+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'11","last_scrub_stamp":"2024-09-12T17:42:22.655465+0000","last_deep_scrub":"265'11","last_deep_scrub_stamp":"2024-09-12T17:42:22.655465+0000","last_clean_scrub_stamp":"2024-09-12T17:42:22.655465+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:16.668659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":23650,"num_write":16,"num_write_kb":11312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"265'10","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:26.930541+0000","last_change":"2024-09-12T17:42:26.930541+0000","last_active":"2024-09-12T17:42:26.930541+0000","last_peered":"2024-09-12T17:42:26.930541+0000","last_clean":"2024-09-12T17:42:26.930541+0000","last_became_active":"2024-09-12T17:15:40.111105+0000","last_became_peered":"2024-09-12T17:15:40.111105+0000","last_unstale":"2024-09-12T17:42:26.930541+0000","last_undegraded":"2024-09-12T17:42:26.930541+0000","last_fullsized":"2024-09-12T17:42:26.930541+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'10","last_scrub_stamp":"2024-09-12T17:42:26.930359+0000","last_deep_scrub":"265'10","last_deep_scrub_stamp":"2024-09-12T17:42:26.930359+0000","last_clean_scrub_stamp":"2024-09-12T17:42:26.930359+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:29.510932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":20,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"265'54","reported_seq":205,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:23.581613+0000","last_change":"2024-09-12T17:42:23.581613+0000","last_active":"2024-09-12T17:42:23.581613+0000","last_peered":"2024-09-12T17:42:23.581613+0000","last_clean":"2024-09-12T17:42:23.581613+0000","last_became_active":"2024-09-12T17:13:54.841072+0000","last_became_peered":"2024-09-12T17:13:54.841072+0000","last_unstale":"2024-09-12T17:42:23.581613+0000","last_undegraded":"2024-09-12T17:42:23.581613+0000","last_fullsized":"2024-09-12T17:42:23.581613+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'54","last_scrub_stamp":"2024-09-12T17:42:23.581434+0000","last_deep_scrub":"265'54","last_deep_scrub_stamp":"2024-09-12T17:42:23.581434+0000","last_clean_scrub_stamp":"2024-09-12T17:42:23.581434+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:06.949169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":282,"num_read_kb":222,"num_write":88,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:18.490676+0000","last_change":"2024-09-12T17:42:18.490676+0000","last_active":"2024-09-12T17:42:18.490676+0000","last_peered":"2024-09-12T17:42:18.490676+0000","last_clean":"2024-09-12T17:42:18.490676+0000","last_became_active":"2024-09-12T17:27:17.392355+0000","last_became_peered":"2024-09-12T17:27:17.392355+0000","last_unstale":"2024-09-12T17:42:18.490676+0000","last_undegraded":"2024-09-12T17:42:18.490676+0000","last_fullsized":"2024-09-12T17:42:18.490676+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:18.490490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:18.490490+0000","last_clean_scrub_stamp":"2024-09-12T17:42:18.490490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:41.103063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"265'4","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:13.320062+0000","last_change":"2024-09-12T17:42:13.319885+0000","last_active":"2024-09-12T17:42:13.320062+0000","last_peered":"2024-09-12T17:42:13.320062+0000","last_clean":"2024-09-12T17:42:13.320062+0000","last_became_active":"2024-09-12T17:15:57.742342+0000","last_became_peered":"2024-09-12T17:15:57.742342+0000","last_unstale":"2024-09-12T17:42:13.320062+0000","last_undegraded":"2024-09-12T17:42:13.320062+0000","last_fullsized":"2024-09-12T17:42:13.320062+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T17:42:13.319684+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T17:42:13.319684+0000","last_clean_scrub_stamp":"2024-09-12T17:42:13.319684+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:39.886328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1087,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:17.653293+0000","last_change":"2024-09-12T17:42:17.653096+0000","last_active":"2024-09-12T17:42:17.653293+0000","last_peered":"2024-09-12T17:42:17.653293+0000","last_clean":"2024-09-12T17:42:17.653293+0000","last_became_active":"2024-09-12T17:15:40.119439+0000","last_became_peered":"2024-09-12T17:15:40.119439+0000","last_unstale":"2024-09-12T17:42:17.653293+0000","last_undegraded":"2024-09-12T17:42:17.653293+0000","last_fullsized":"2024-09-12T17:42:17.653293+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:17.652915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:17.652915+0000","last_clean_scrub_stamp":"2024-09-12T17:42:17.652915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:47.333137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"265'35","reported_seq":150,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:08.370054+0000","last_change":"2024-09-12T17:42:08.370054+0000","last_active":"2024-09-12T17:42:08.370054+0000","last_peered":"2024-09-12T17:42:08.370054+0000","last_clean":"2024-09-12T17:42:08.370054+0000","last_became_active":"2024-09-12T17:13:54.842215+0000","last_became_peered":"2024-09-12T17:13:54.842215+0000","last_unstale":"2024-09-12T17:42:08.370054+0000","last_undegraded":"2024-09-12T17:42:08.370054+0000","last_fullsized":"2024-09-12T17:42:08.370054+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'35","last_scrub_stamp":"2024-09-12T17:42:08.369871+0000","last_deep_scrub":"265'35","last_deep_scrub_stamp":"2024-09-12T17:42:08.369871+0000","last_clean_scrub_stamp":"2024-09-12T17:42:08.369871+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:38.605184+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":135,"num_write":51,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"265'2","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:36.887615+0000","last_change":"2024-09-12T17:42:36.887615+0000","last_active":"2024-09-12T17:42:36.887615+0000","last_peered":"2024-09-12T17:42:36.887615+0000","last_clean":"2024-09-12T17:42:36.887615+0000","last_became_active":"2024-09-12T17:27:17.415277+0000","last_became_peered":"2024-09-12T17:27:17.415277+0000","last_unstale":"2024-09-12T17:42:36.887615+0000","last_undegraded":"2024-09-12T17:42:36.887615+0000","last_fullsized":"2024-09-12T17:42:36.887615+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T17:42:36.887382+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T17:42:36.887382+0000","last_clean_scrub_stamp":"2024-09-12T17:42:36.887382+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:52.514866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"265'4","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:14.316099+0000","last_change":"2024-09-12T17:42:14.316099+0000","last_active":"2024-09-12T17:42:14.316099+0000","last_peered":"2024-09-12T17:42:14.316099+0000","last_clean":"2024-09-12T17:42:14.316099+0000","last_became_active":"2024-09-12T17:15:43.172142+0000","last_became_peered":"2024-09-12T17:15:43.172142+0000","last_unstale":"2024-09-12T17:42:14.316099+0000","last_undegraded":"2024-09-12T17:42:14.316099+0000","last_fullsized":"2024-09-12T17:42:14.316099+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T17:42:14.315861+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T17:42:14.315861+0000","last_clean_scrub_stamp":"2024-09-12T17:42:14.315861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:29.719344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"262'4","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:21.608401+0000","last_change":"2024-09-12T17:42:21.608401+0000","last_active":"2024-09-12T17:42:21.608401+0000","last_peered":"2024-09-12T17:42:21.608401+0000","last_clean":"2024-09-12T17:42:21.608401+0000","last_became_active":"2024-09-12T17:15:40.109076+0000","last_became_peered":"2024-09-12T17:15:40.109076+0000","last_unstale":"2024-09-12T17:42:21.608401+0000","last_undegraded":"2024-09-12T17:42:21.608401+0000","last_fullsized":"2024-09-12T17:42:21.608401+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-12T17:42:21.608200+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-12T17:42:21.608200+0000","last_clean_scrub_stamp":"2024-09-12T17:42:21.608200+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:01.459822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"262'6","reported_seq":69,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:19.901002+0000","last_change":"2024-09-12T17:42:19.901002+0000","last_active":"2024-09-12T17:42:19.901002+0000","last_peered":"2024-09-12T17:42:19.901002+0000","last_clean":"2024-09-12T17:42:19.901002+0000","last_became_active":"2024-09-12T17:13:54.819399+0000","last_became_peered":"2024-09-12T17:13:54.819399+0000","last_unstale":"2024-09-12T17:42:19.901002+0000","last_undegraded":"2024-09-12T17:42:19.901002+0000","last_fullsized":"2024-09-12T17:42:19.901002+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-12T17:42:19.900771+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-12T17:42:19.900771+0000","last_clean_scrub_stamp":"2024-09-12T17:42:19.900771+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:19.184425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":27,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:35.903957+0000","last_change":"2024-09-12T17:42:35.903957+0000","last_active":"2024-09-12T17:42:35.903957+0000","last_peered":"2024-09-12T17:42:35.903957+0000","last_clean":"2024-09-12T17:42:35.903957+0000","last_became_active":"2024-09-12T17:27:17.419839+0000","last_became_peered":"2024-09-12T17:27:17.419839+0000","last_unstale":"2024-09-12T17:42:35.903957+0000","last_undegraded":"2024-09-12T17:42:35.903957+0000","last_fullsized":"2024-09-12T17:42:35.903957+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:35.903720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:35.903720+0000","last_clean_scrub_stamp":"2024-09-12T17:42:35.903720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:58.557491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"265'5","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:34.423866+0000","last_change":"2024-09-12T17:42:34.423866+0000","last_active":"2024-09-12T17:42:34.423866+0000","last_peered":"2024-09-12T17:42:34.423866+0000","last_clean":"2024-09-12T17:42:34.423866+0000","last_became_active":"2024-09-12T17:15:43.159663+0000","last_became_peered":"2024-09-12T17:15:43.159663+0000","last_unstale":"2024-09-12T17:42:34.423866+0000","last_undegraded":"2024-09-12T17:42:34.423866+0000","last_fullsized":"2024-09-12T17:42:34.423866+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T17:42:34.423686+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T17:42:34.423686+0000","last_clean_scrub_stamp":"2024-09-12T17:42:34.423686+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:37.860450+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":23,"num_write":10,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"265'2","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:28.896143+0000","last_change":"2024-09-12T17:42:28.896143+0000","last_active":"2024-09-12T17:42:28.896143+0000","last_peered":"2024-09-12T17:42:28.896143+0000","last_clean":"2024-09-12T17:42:28.896143+0000","last_became_active":"2024-09-12T17:15:40.131140+0000","last_became_peered":"2024-09-12T17:15:40.131140+0000","last_unstale":"2024-09-12T17:42:28.896143+0000","last_undegraded":"2024-09-12T17:42:28.896143+0000","last_fullsized":"2024-09-12T17:42:28.896143+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T17:42:28.895924+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T17:42:28.895924+0000","last_clean_scrub_stamp":"2024-09-12T17:42:28.895924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:48:53.352231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"265'19","reported_seq":103,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:08.485099+0000","last_change":"2024-09-12T17:42:08.484896+0000","last_active":"2024-09-12T17:42:08.485099+0000","last_peered":"2024-09-12T17:42:08.485099+0000","last_clean":"2024-09-12T17:42:08.485099+0000","last_became_active":"2024-09-12T17:13:54.831374+0000","last_became_peered":"2024-09-12T17:13:54.831374+0000","last_unstale":"2024-09-12T17:42:08.485099+0000","last_undegraded":"2024-09-12T17:42:08.485099+0000","last_fullsized":"2024-09-12T17:42:08.485099+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'19","last_scrub_stamp":"2024-09-12T17:42:08.484711+0000","last_deep_scrub":"265'19","last_deep_scrub_stamp":"2024-09-12T17:42:08.484711+0000","last_clean_scrub_stamp":"2024-09-12T17:42:08.484711+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:29.635833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":27,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:19.445438+0000","last_change":"2024-09-12T17:42:19.445438+0000","last_active":"2024-09-12T17:42:19.445438+0000","last_peered":"2024-09-12T17:42:19.445438+0000","last_clean":"2024-09-12T17:42:19.445438+0000","last_became_active":"2024-09-12T17:27:17.415918+0000","last_became_peered":"2024-09-12T17:27:17.415918+0000","last_unstale":"2024-09-12T17:42:19.445438+0000","last_undegraded":"2024-09-12T17:42:19.445438+0000","last_fullsized":"2024-09-12T17:42:19.445438+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:19.445231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:19.445231+0000","last_clean_scrub_stamp":"2024-09-12T17:42:19.445231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:23.049505+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"265'4","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:33.456205+0000","last_change":"2024-09-12T17:42:33.456205+0000","last_active":"2024-09-12T17:42:33.456205+0000","last_peered":"2024-09-12T17:42:33.456205+0000","last_clean":"2024-09-12T17:42:33.456205+0000","last_became_active":"2024-09-12T17:15:43.871380+0000","last_became_peered":"2024-09-12T17:15:43.871380+0000","last_unstale":"2024-09-12T17:42:33.456205+0000","last_undegraded":"2024-09-12T17:42:33.456205+0000","last_fullsized":"2024-09-12T17:42:33.456205+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T17:42:33.455955+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T17:42:33.455955+0000","last_clean_scrub_stamp":"2024-09-12T17:42:33.455955+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:12.533244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"265'4","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:20.663190+0000","last_change":"2024-09-12T17:42:20.663190+0000","last_active":"2024-09-12T17:42:20.663190+0000","last_peered":"2024-09-12T17:42:20.663190+0000","last_clean":"2024-09-12T17:42:20.663190+0000","last_became_active":"2024-09-12T17:15:40.116781+0000","last_became_peered":"2024-09-12T17:15:40.116781+0000","last_unstale":"2024-09-12T17:42:20.663190+0000","last_undegraded":"2024-09-12T17:42:20.663190+0000","last_fullsized":"2024-09-12T17:42:20.663190+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T17:42:20.662986+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T17:42:20.662986+0000","last_clean_scrub_stamp":"2024-09-12T17:42:20.662986+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:20.755371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":7168,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"265'68","reported_seq":239,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:20.895784+0000","last_change":"2024-09-12T17:42:20.895705+0000","last_active":"2024-09-12T17:42:20.895784+0000","last_peered":"2024-09-12T17:42:20.895784+0000","last_clean":"2024-09-12T17:42:20.895784+0000","last_became_active":"2024-09-12T17:13:54.829335+0000","last_became_peered":"2024-09-12T17:13:54.829335+0000","last_unstale":"2024-09-12T17:42:20.895784+0000","last_undegraded":"2024-09-12T17:42:20.895784+0000","last_fullsized":"2024-09-12T17:42:20.895784+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'68","last_scrub_stamp":"2024-09-12T17:42:20.895585+0000","last_deep_scrub":"265'68","last_deep_scrub_stamp":"2024-09-12T17:42:20.895585+0000","last_clean_scrub_stamp":"2024-09-12T17:42:20.895585+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:23.337685+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":349,"num_read_kb":240,"num_write":120,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"265'2","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:04.688047+0000","last_change":"2024-09-12T17:42:04.688047+0000","last_active":"2024-09-12T17:42:04.688047+0000","last_peered":"2024-09-12T17:42:04.688047+0000","last_clean":"2024-09-12T17:42:04.688047+0000","last_became_active":"2024-09-12T17:27:17.409364+0000","last_became_peered":"2024-09-12T17:27:17.409364+0000","last_unstale":"2024-09-12T17:42:04.688047+0000","last_undegraded":"2024-09-12T17:42:04.688047+0000","last_fullsized":"2024-09-12T17:42:04.688047+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T17:42:04.687862+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T17:42:04.687862+0000","last_clean_scrub_stamp":"2024-09-12T17:42:04.687862+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:40.198659+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"265'2","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:30.533591+0000","last_change":"2024-09-12T17:42:30.533591+0000","last_active":"2024-09-12T17:42:30.533591+0000","last_peered":"2024-09-12T17:42:30.533591+0000","last_clean":"2024-09-12T17:42:30.533591+0000","last_became_active":"2024-09-12T17:15:43.874421+0000","last_became_peered":"2024-09-12T17:15:43.874421+0000","last_unstale":"2024-09-12T17:42:30.533591+0000","last_undegraded":"2024-09-12T17:42:30.533591+0000","last_fullsized":"2024-09-12T17:42:30.533591+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T17:42:30.533404+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T17:42:30.533404+0000","last_clean_scrub_stamp":"2024-09-12T17:42:30.533404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:49.185869+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"265'4","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:21.711442+0000","last_change":"2024-09-12T17:42:21.711442+0000","last_active":"2024-09-12T17:42:21.711442+0000","last_peered":"2024-09-12T17:42:21.711442+0000","last_clean":"2024-09-12T17:42:21.711442+0000","last_became_active":"2024-09-12T17:15:40.126898+0000","last_became_peered":"2024-09-12T17:15:40.126898+0000","last_unstale":"2024-09-12T17:42:21.711442+0000","last_undegraded":"2024-09-12T17:42:21.711442+0000","last_fullsized":"2024-09-12T17:42:21.711442+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T17:42:21.711262+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T17:42:21.711262+0000","last_clean_scrub_stamp":"2024-09-12T17:42:21.711262+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:54.135788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"265'19","reported_seq":101,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:26.592098+0000","last_change":"2024-09-12T17:42:26.591823+0000","last_active":"2024-09-12T17:42:26.592098+0000","last_peered":"2024-09-12T17:42:26.592098+0000","last_clean":"2024-09-12T17:42:26.592098+0000","last_became_active":"2024-09-12T17:13:54.832780+0000","last_became_peered":"2024-09-12T17:13:54.832780+0000","last_unstale":"2024-09-12T17:42:26.592098+0000","last_undegraded":"2024-09-12T17:42:26.592098+0000","last_fullsized":"2024-09-12T17:42:26.592098+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'19","last_scrub_stamp":"2024-09-12T17:42:26.591536+0000","last_deep_scrub":"265'19","last_deep_scrub_stamp":"2024-09-12T17:42:26.591536+0000","last_clean_scrub_stamp":"2024-09-12T17:42:26.591536+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:52.124781+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":55,"num_write":40,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":27,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:34.869194+0000","last_change":"2024-09-12T17:42:34.869194+0000","last_active":"2024-09-12T17:42:34.869194+0000","last_peered":"2024-09-12T17:42:34.869194+0000","last_clean":"2024-09-12T17:42:34.869194+0000","last_became_active":"2024-09-12T17:27:17.414739+0000","last_became_peered":"2024-09-12T17:27:17.414739+0000","last_unstale":"2024-09-12T17:42:34.869194+0000","last_undegraded":"2024-09-12T17:42:34.869194+0000","last_fullsized":"2024-09-12T17:42:34.869194+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:34.869005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:34.869005+0000","last_clean_scrub_stamp":"2024-09-12T17:42:34.869005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:54.794077+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"265'5","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:37.465135+0000","last_change":"2024-09-12T17:42:37.465135+0000","last_active":"2024-09-12T17:42:37.465135+0000","last_peered":"2024-09-12T17:42:37.465135+0000","last_clean":"2024-09-12T17:42:37.465135+0000","last_became_active":"2024-09-12T17:15:43.871502+0000","last_became_peered":"2024-09-12T17:15:43.871502+0000","last_unstale":"2024-09-12T17:42:37.465135+0000","last_undegraded":"2024-09-12T17:42:37.465135+0000","last_fullsized":"2024-09-12T17:42:37.465135+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T17:42:37.464948+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T17:42:37.464948+0000","last_clean_scrub_stamp":"2024-09-12T17:42:37.464948+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:54.808054+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"265'5","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:06.687034+0000","last_change":"2024-09-12T17:42:06.686874+0000","last_active":"2024-09-12T17:42:06.687034+0000","last_peered":"2024-09-12T17:42:06.687034+0000","last_clean":"2024-09-12T17:42:06.687034+0000","last_became_active":"2024-09-12T17:15:40.132311+0000","last_became_peered":"2024-09-12T17:15:40.132311+0000","last_unstale":"2024-09-12T17:42:06.687034+0000","last_undegraded":"2024-09-12T17:42:06.687034+0000","last_fullsized":"2024-09-12T17:42:06.687034+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T17:42:06.686674+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T17:42:06.686674+0000","last_clean_scrub_stamp":"2024-09-12T17:42:06.686674+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:57.501458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"265'33","reported_seq":145,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:58.627554+0000","last_change":"2024-09-12T17:41:58.627418+0000","last_active":"2024-09-12T17:41:58.627554+0000","last_peered":"2024-09-12T17:41:58.627554+0000","last_clean":"2024-09-12T17:41:58.627554+0000","last_became_active":"2024-09-12T17:13:54.827785+0000","last_became_peered":"2024-09-12T17:13:54.827785+0000","last_unstale":"2024-09-12T17:41:58.627554+0000","last_undegraded":"2024-09-12T17:41:58.627554+0000","last_fullsized":"2024-09-12T17:41:58.627554+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'33","last_scrub_stamp":"2024-09-12T17:41:58.627187+0000","last_deep_scrub":"265'33","last_deep_scrub_stamp":"2024-09-12T17:41:58.627187+0000","last_clean_scrub_stamp":"2024-09-12T17:41:58.627187+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:13.355618+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":116,"num_write":64,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":27,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:23.670969+0000","last_change":"2024-09-12T17:42:23.670969+0000","last_active":"2024-09-12T17:42:23.670969+0000","last_peered":"2024-09-12T17:42:23.670969+0000","last_clean":"2024-09-12T17:42:23.670969+0000","last_became_active":"2024-09-12T17:27:17.391154+0000","last_became_peered":"2024-09-12T17:27:17.391154+0000","last_unstale":"2024-09-12T17:42:23.670969+0000","last_undegraded":"2024-09-12T17:42:23.670969+0000","last_fullsized":"2024-09-12T17:42:23.670969+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:23.670785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:23.670785+0000","last_clean_scrub_stamp":"2024-09-12T17:42:23.670785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:20.638562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"265'13","reported_seq":69,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:25.611723+0000","last_change":"2024-09-12T17:42:25.611723+0000","last_active":"2024-09-12T17:42:25.611723+0000","last_peered":"2024-09-12T17:42:25.611723+0000","last_clean":"2024-09-12T17:42:25.611723+0000","last_became_active":"2024-09-12T17:15:43.169085+0000","last_became_peered":"2024-09-12T17:15:43.169085+0000","last_unstale":"2024-09-12T17:42:25.611723+0000","last_undegraded":"2024-09-12T17:42:25.611723+0000","last_fullsized":"2024-09-12T17:42:25.611723+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'13","last_scrub_stamp":"2024-09-12T17:42:25.611532+0000","last_deep_scrub":"265'13","last_deep_scrub_stamp":"2024-09-12T17:42:25.611532+0000","last_clean_scrub_stamp":"2024-09-12T17:42:25.611532+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:33.786471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":43010,"num_write":18,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"265'2","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:25.905824+0000","last_change":"2024-09-12T17:42:25.905824+0000","last_active":"2024-09-12T17:42:25.905824+0000","last_peered":"2024-09-12T17:42:25.905824+0000","last_clean":"2024-09-12T17:42:25.905824+0000","last_became_active":"2024-09-12T17:15:40.139145+0000","last_became_peered":"2024-09-12T17:15:40.139145+0000","last_unstale":"2024-09-12T17:42:25.905824+0000","last_undegraded":"2024-09-12T17:42:25.905824+0000","last_fullsized":"2024-09-12T17:42:25.905824+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T17:42:25.905619+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T17:42:25.905619+0000","last_clean_scrub_stamp":"2024-09-12T17:42:25.905619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:07.036912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"265'28","reported_seq":133,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:24.809026+0000","last_change":"2024-09-12T17:42:24.809026+0000","last_active":"2024-09-12T17:42:24.809026+0000","last_peered":"2024-09-12T17:42:24.809026+0000","last_clean":"2024-09-12T17:42:24.809026+0000","last_became_active":"2024-09-12T17:13:54.842816+0000","last_became_peered":"2024-09-12T17:13:54.842816+0000","last_unstale":"2024-09-12T17:42:24.809026+0000","last_undegraded":"2024-09-12T17:42:24.809026+0000","last_fullsized":"2024-09-12T17:42:24.809026+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'28","last_scrub_stamp":"2024-09-12T17:42:24.808840+0000","last_deep_scrub":"265'28","last_deep_scrub_stamp":"2024-09-12T17:42:24.808840+0000","last_clean_scrub_stamp":"2024-09-12T17:42:24.808840+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:35.059706+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":108,"num_write":46,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":27,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:39.484405+0000","last_change":"2024-09-12T17:42:39.484405+0000","last_active":"2024-09-12T17:42:39.484405+0000","last_peered":"2024-09-12T17:42:39.484405+0000","last_clean":"2024-09-12T17:42:39.484405+0000","last_became_active":"2024-09-12T17:27:17.421939+0000","last_became_peered":"2024-09-12T17:27:17.421939+0000","last_unstale":"2024-09-12T17:42:39.484405+0000","last_undegraded":"2024-09-12T17:42:39.484405+0000","last_fullsized":"2024-09-12T17:42:39.484405+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:39.484217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:39.484217+0000","last_clean_scrub_stamp":"2024-09-12T17:42:39.484217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:36.583029+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"262'8","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:20.397898+0000","last_change":"2024-09-12T17:42:20.397898+0000","last_active":"2024-09-12T17:42:20.397898+0000","last_peered":"2024-09-12T17:42:20.397898+0000","last_clean":"2024-09-12T17:42:20.397898+0000","last_became_active":"2024-09-12T17:15:43.158530+0000","last_became_peered":"2024-09-12T17:15:43.158530+0000","last_unstale":"2024-09-12T17:42:20.397898+0000","last_undegraded":"2024-09-12T17:42:20.397898+0000","last_fullsized":"2024-09-12T17:42:20.397898+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'8","last_scrub_stamp":"2024-09-12T17:42:20.397715+0000","last_deep_scrub":"262'8","last_deep_scrub_stamp":"2024-09-12T17:42:20.397715+0000","last_clean_scrub_stamp":"2024-09-12T17:42:20.397715+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:51.915535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10242,"num_write":8,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"265'5","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:16.666203+0000","last_change":"2024-09-12T17:42:16.666203+0000","last_active":"2024-09-12T17:42:16.666203+0000","last_peered":"2024-09-12T17:42:16.666203+0000","last_clean":"2024-09-12T17:42:16.666203+0000","last_became_active":"2024-09-12T17:15:40.130644+0000","last_became_peered":"2024-09-12T17:15:40.130644+0000","last_unstale":"2024-09-12T17:42:16.666203+0000","last_undegraded":"2024-09-12T17:42:16.666203+0000","last_fullsized":"2024-09-12T17:42:16.666203+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T17:42:16.666011+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T17:42:16.666011+0000","last_clean_scrub_stamp":"2024-09-12T17:42:16.666011+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:16.063757+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"265'14","reported_seq":97,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:26.858382+0000","last_change":"2024-09-12T17:42:26.858382+0000","last_active":"2024-09-12T17:42:26.858382+0000","last_peered":"2024-09-12T17:42:26.858382+0000","last_clean":"2024-09-12T17:42:26.858382+0000","last_became_active":"2024-09-12T17:13:54.843036+0000","last_became_peered":"2024-09-12T17:13:54.843036+0000","last_unstale":"2024-09-12T17:42:26.858382+0000","last_undegraded":"2024-09-12T17:42:26.858382+0000","last_fullsized":"2024-09-12T17:42:26.858382+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'14","last_scrub_stamp":"2024-09-12T17:42:26.858208+0000","last_deep_scrub":"265'14","last_deep_scrub_stamp":"2024-09-12T17:42:26.858208+0000","last_clean_scrub_stamp":"2024-09-12T17:42:26.858208+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:42.888679+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":27,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:35.876476+0000","last_change":"2024-09-12T17:42:35.876476+0000","last_active":"2024-09-12T17:42:35.876476+0000","last_peered":"2024-09-12T17:42:35.876476+0000","last_clean":"2024-09-12T17:42:35.876476+0000","last_became_active":"2024-09-12T17:27:17.421187+0000","last_became_peered":"2024-09-12T17:27:17.421187+0000","last_unstale":"2024-09-12T17:42:35.876476+0000","last_undegraded":"2024-09-12T17:42:35.876476+0000","last_fullsized":"2024-09-12T17:42:35.876476+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:35.876290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:35.876290+0000","last_clean_scrub_stamp":"2024-09-12T17:42:35.876290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:06.564471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"265'7","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:15.514370+0000","last_change":"2024-09-12T17:42:15.514370+0000","last_active":"2024-09-12T17:42:15.514370+0000","last_peered":"2024-09-12T17:42:15.514370+0000","last_clean":"2024-09-12T17:42:15.514370+0000","last_became_active":"2024-09-12T17:15:43.155891+0000","last_became_peered":"2024-09-12T17:15:43.155891+0000","last_unstale":"2024-09-12T17:42:15.514370+0000","last_undegraded":"2024-09-12T17:42:15.514370+0000","last_fullsized":"2024-09-12T17:42:15.514370+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T17:42:15.514187+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T17:42:15.514187+0000","last_clean_scrub_stamp":"2024-09-12T17:42:15.514187+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:18:06.736448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8194,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:22.629123+0000","last_change":"2024-09-12T17:42:22.629123+0000","last_active":"2024-09-12T17:42:22.629123+0000","last_peered":"2024-09-12T17:42:22.629123+0000","last_clean":"2024-09-12T17:42:22.629123+0000","last_became_active":"2024-09-12T17:15:40.128470+0000","last_became_peered":"2024-09-12T17:15:40.128470+0000","last_unstale":"2024-09-12T17:42:22.629123+0000","last_undegraded":"2024-09-12T17:42:22.629123+0000","last_fullsized":"2024-09-12T17:42:22.629123+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:22.628950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:22.628950+0000","last_clean_scrub_stamp":"2024-09-12T17:42:22.628950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:54.962037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"265'46","reported_seq":184,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:18.894128+0000","last_change":"2024-09-12T17:42:18.894128+0000","last_active":"2024-09-12T17:42:18.894128+0000","last_peered":"2024-09-12T17:42:18.894128+0000","last_clean":"2024-09-12T17:42:18.894128+0000","last_became_active":"2024-09-12T17:13:54.821816+0000","last_became_peered":"2024-09-12T17:13:54.821816+0000","last_unstale":"2024-09-12T17:42:18.894128+0000","last_undegraded":"2024-09-12T17:42:18.894128+0000","last_fullsized":"2024-09-12T17:42:18.894128+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'46","last_scrub_stamp":"2024-09-12T17:42:18.893943+0000","last_deep_scrub":"265'46","last_deep_scrub_stamp":"2024-09-12T17:42:18.893943+0000","last_clean_scrub_stamp":"2024-09-12T17:42:18.893943+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:59:05.994235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":166,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"265'2","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:34.919993+0000","last_change":"2024-09-12T17:42:34.919993+0000","last_active":"2024-09-12T17:42:34.919993+0000","last_peered":"2024-09-12T17:42:34.919993+0000","last_clean":"2024-09-12T17:42:34.919993+0000","last_became_active":"2024-09-12T17:27:17.422464+0000","last_became_peered":"2024-09-12T17:27:17.422464+0000","last_unstale":"2024-09-12T17:42:34.919993+0000","last_undegraded":"2024-09-12T17:42:34.919993+0000","last_fullsized":"2024-09-12T17:42:34.919993+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T17:42:34.919760+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T17:42:34.919760+0000","last_clean_scrub_stamp":"2024-09-12T17:42:34.919760+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:00.624690+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"265'8","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:29.573709+0000","last_change":"2024-09-12T17:42:29.573709+0000","last_active":"2024-09-12T17:42:29.573709+0000","last_peered":"2024-09-12T17:42:29.573709+0000","last_clean":"2024-09-12T17:42:29.573709+0000","last_became_active":"2024-09-12T17:15:43.171254+0000","last_became_peered":"2024-09-12T17:15:43.171254+0000","last_unstale":"2024-09-12T17:42:29.573709+0000","last_undegraded":"2024-09-12T17:42:29.573709+0000","last_fullsized":"2024-09-12T17:42:29.573709+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-12T17:42:29.573533+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-12T17:42:29.573533+0000","last_clean_scrub_stamp":"2024-09-12T17:42:29.573533+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:12.991144+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10240,"num_write":8,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"265'4","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:10.349759+0000","last_change":"2024-09-12T17:42:10.349759+0000","last_active":"2024-09-12T17:42:10.349759+0000","last_peered":"2024-09-12T17:42:10.349759+0000","last_clean":"2024-09-12T17:42:10.349759+0000","last_became_active":"2024-09-12T17:15:40.116989+0000","last_became_peered":"2024-09-12T17:15:40.116989+0000","last_unstale":"2024-09-12T17:42:10.349759+0000","last_undegraded":"2024-09-12T17:42:10.349759+0000","last_fullsized":"2024-09-12T17:42:10.349759+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T17:42:10.349535+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T17:42:10.349535+0000","last_clean_scrub_stamp":"2024-09-12T17:42:10.349535+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:12:31.542751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4119,"num_write":4,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"265'42","reported_seq":169,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:14.628040+0000","last_change":"2024-09-12T17:42:14.628040+0000","last_active":"2024-09-12T17:42:14.628040+0000","last_peered":"2024-09-12T17:42:14.628040+0000","last_clean":"2024-09-12T17:42:14.628040+0000","last_became_active":"2024-09-12T17:13:54.811613+0000","last_became_peered":"2024-09-12T17:13:54.811613+0000","last_unstale":"2024-09-12T17:42:14.628040+0000","last_undegraded":"2024-09-12T17:42:14.628040+0000","last_fullsized":"2024-09-12T17:42:14.628040+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'42","last_scrub_stamp":"2024-09-12T17:42:14.627840+0000","last_deep_scrub":"265'42","last_deep_scrub_stamp":"2024-09-12T17:42:14.627840+0000","last_clean_scrub_stamp":"2024-09-12T17:42:14.627840+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:12.213103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":153,"num_write":74,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"265'2","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:32.478143+0000","last_change":"2024-09-12T17:42:32.478143+0000","last_active":"2024-09-12T17:42:32.478143+0000","last_peered":"2024-09-12T17:42:32.478143+0000","last_clean":"2024-09-12T17:42:32.478143+0000","last_became_active":"2024-09-12T17:27:17.405051+0000","last_became_peered":"2024-09-12T17:27:17.405051+0000","last_unstale":"2024-09-12T17:42:32.478143+0000","last_undegraded":"2024-09-12T17:42:32.478143+0000","last_fullsized":"2024-09-12T17:42:32.478143+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T17:42:32.477912+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T17:42:32.477912+0000","last_clean_scrub_stamp":"2024-09-12T17:42:32.477912+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:18.425286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"265'2","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:11.375720+0000","last_change":"2024-09-12T17:42:11.375720+0000","last_active":"2024-09-12T17:42:11.375720+0000","last_peered":"2024-09-12T17:42:11.375720+0000","last_clean":"2024-09-12T17:42:11.375720+0000","last_became_active":"2024-09-12T17:15:43.157624+0000","last_became_peered":"2024-09-12T17:15:43.157624+0000","last_unstale":"2024-09-12T17:42:11.375720+0000","last_undegraded":"2024-09-12T17:42:11.375720+0000","last_fullsized":"2024-09-12T17:42:11.375720+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T17:42:11.375527+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T17:42:11.375527+0000","last_clean_scrub_stamp":"2024-09-12T17:42:11.375527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:25.544419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:19.613547+0000","last_change":"2024-09-12T17:42:19.613547+0000","last_active":"2024-09-12T17:42:19.613547+0000","last_peered":"2024-09-12T17:42:19.613547+0000","last_clean":"2024-09-12T17:42:19.613547+0000","last_became_active":"2024-09-12T17:15:40.118074+0000","last_became_peered":"2024-09-12T17:15:40.118074+0000","last_unstale":"2024-09-12T17:42:19.613547+0000","last_undegraded":"2024-09-12T17:42:19.613547+0000","last_fullsized":"2024-09-12T17:42:19.613547+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:19.613366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:19.613366+0000","last_clean_scrub_stamp":"2024-09-12T17:42:19.613366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:40.620215+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"265'16","reported_seq":98,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:19.519736+0000","last_change":"2024-09-12T17:42:19.519736+0000","last_active":"2024-09-12T17:42:19.519736+0000","last_peered":"2024-09-12T17:42:19.519736+0000","last_clean":"2024-09-12T17:42:19.519736+0000","last_became_active":"2024-09-12T17:13:54.840781+0000","last_became_peered":"2024-09-12T17:13:54.840781+0000","last_unstale":"2024-09-12T17:42:19.519736+0000","last_undegraded":"2024-09-12T17:42:19.519736+0000","last_fullsized":"2024-09-12T17:42:19.519736+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'16","last_scrub_stamp":"2024-09-12T17:42:19.519557+0000","last_deep_scrub":"265'16","last_deep_scrub_stamp":"2024-09-12T17:42:19.519557+0000","last_clean_scrub_stamp":"2024-09-12T17:42:19.519557+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:46.190221+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":56,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:57.607003+0000","last_change":"2024-09-12T17:41:57.606875+0000","last_active":"2024-09-12T17:41:57.607003+0000","last_peered":"2024-09-12T17:41:57.607003+0000","last_clean":"2024-09-12T17:41:57.607003+0000","last_became_active":"2024-09-12T17:27:17.408953+0000","last_became_peered":"2024-09-12T17:27:17.408953+0000","last_unstale":"2024-09-12T17:41:57.607003+0000","last_undegraded":"2024-09-12T17:41:57.607003+0000","last_fullsized":"2024-09-12T17:41:57.607003+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:57.606663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:57.606663+0000","last_clean_scrub_stamp":"2024-09-12T17:41:57.606663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:02.509027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:27.575835+0000","last_change":"2024-09-12T17:42:27.575659+0000","last_active":"2024-09-12T17:42:27.575835+0000","last_peered":"2024-09-12T17:42:27.575835+0000","last_clean":"2024-09-12T17:42:27.575835+0000","last_became_active":"2024-09-12T17:15:43.164943+0000","last_became_peered":"2024-09-12T17:15:43.164943+0000","last_unstale":"2024-09-12T17:42:27.575835+0000","last_undegraded":"2024-09-12T17:42:27.575835+0000","last_fullsized":"2024-09-12T17:42:27.575835+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:27.575488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:27.575488+0000","last_clean_scrub_stamp":"2024-09-12T17:42:27.575488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:00.665878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"265'7","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:23.789917+0000","last_change":"2024-09-12T17:42:23.789740+0000","last_active":"2024-09-12T17:42:23.789917+0000","last_peered":"2024-09-12T17:42:23.789917+0000","last_clean":"2024-09-12T17:42:23.789917+0000","last_became_active":"2024-09-12T17:15:40.128681+0000","last_became_peered":"2024-09-12T17:15:40.128681+0000","last_unstale":"2024-09-12T17:42:23.789917+0000","last_undegraded":"2024-09-12T17:42:23.789917+0000","last_fullsized":"2024-09-12T17:42:23.789917+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T17:42:23.789553+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T17:42:23.789553+0000","last_clean_scrub_stamp":"2024-09-12T17:42:23.789553+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:20.314596+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16384,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"265'9","reported_seq":78,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:31.503641+0000","last_change":"2024-09-12T17:42:31.503641+0000","last_active":"2024-09-12T17:42:31.503641+0000","last_peered":"2024-09-12T17:42:31.503641+0000","last_clean":"2024-09-12T17:42:31.503641+0000","last_became_active":"2024-09-12T17:13:54.842287+0000","last_became_peered":"2024-09-12T17:13:54.842287+0000","last_unstale":"2024-09-12T17:42:31.503641+0000","last_undegraded":"2024-09-12T17:42:31.503641+0000","last_fullsized":"2024-09-12T17:42:31.503641+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'9","last_scrub_stamp":"2024-09-12T17:42:31.503443+0000","last_deep_scrub":"265'9","last_deep_scrub_stamp":"2024-09-12T17:42:31.503443+0000","last_clean_scrub_stamp":"2024-09-12T17:42:31.503443+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:14.443276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":28,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":27,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:30.842138+0000","last_change":"2024-09-12T17:42:30.842138+0000","last_active":"2024-09-12T17:42:30.842138+0000","last_peered":"2024-09-12T17:42:30.842138+0000","last_clean":"2024-09-12T17:42:30.842138+0000","last_became_active":"2024-09-12T17:27:17.415241+0000","last_became_peered":"2024-09-12T17:27:17.415241+0000","last_unstale":"2024-09-12T17:42:30.842138+0000","last_undegraded":"2024-09-12T17:42:30.842138+0000","last_fullsized":"2024-09-12T17:42:30.842138+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:30.841945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:30.841945+0000","last_clean_scrub_stamp":"2024-09-12T17:42:30.841945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:43.363356+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"265'8","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:25.567641+0000","last_change":"2024-09-12T17:42:25.567454+0000","last_active":"2024-09-12T17:42:25.567641+0000","last_peered":"2024-09-12T17:42:25.567641+0000","last_clean":"2024-09-12T17:42:25.567641+0000","last_became_active":"2024-09-12T17:15:43.168676+0000","last_became_peered":"2024-09-12T17:15:43.168676+0000","last_unstale":"2024-09-12T17:42:25.567641+0000","last_undegraded":"2024-09-12T17:42:25.567641+0000","last_fullsized":"2024-09-12T17:42:25.567641+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-12T17:42:25.567270+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-12T17:42:25.567270+0000","last_clean_scrub_stamp":"2024-09-12T17:42:25.567270+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:01.519169+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":24578,"num_write":18,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"265'6","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:05.641742+0000","last_change":"2024-09-12T17:42:05.641587+0000","last_active":"2024-09-12T17:42:05.641742+0000","last_peered":"2024-09-12T17:42:05.641742+0000","last_clean":"2024-09-12T17:42:05.641742+0000","last_became_active":"2024-09-12T17:15:40.128708+0000","last_became_peered":"2024-09-12T17:15:40.128708+0000","last_unstale":"2024-09-12T17:42:05.641742+0000","last_undegraded":"2024-09-12T17:42:05.641742+0000","last_fullsized":"2024-09-12T17:42:05.641742+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T17:42:05.641411+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T17:42:05.641411+0000","last_clean_scrub_stamp":"2024-09-12T17:42:05.641411+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:30.258368+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8194,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"265'35","reported_seq":152,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:17.633364+0000","last_change":"2024-09-12T17:42:17.633364+0000","last_active":"2024-09-12T17:42:17.633364+0000","last_peered":"2024-09-12T17:42:17.633364+0000","last_clean":"2024-09-12T17:42:17.633364+0000","last_became_active":"2024-09-12T17:13:54.830096+0000","last_became_peered":"2024-09-12T17:13:54.830096+0000","last_unstale":"2024-09-12T17:42:17.633364+0000","last_undegraded":"2024-09-12T17:42:17.633364+0000","last_fullsized":"2024-09-12T17:42:17.633364+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'35","last_scrub_stamp":"2024-09-12T17:42:17.633192+0000","last_deep_scrub":"265'35","last_deep_scrub_stamp":"2024-09-12T17:42:17.633192+0000","last_clean_scrub_stamp":"2024-09-12T17:42:17.633192+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:13.045874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":131,"num_write":60,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:15.302638+0000","last_change":"2024-09-12T17:42:15.302511+0000","last_active":"2024-09-12T17:42:15.302638+0000","last_peered":"2024-09-12T17:42:15.302638+0000","last_clean":"2024-09-12T17:42:15.302638+0000","last_became_active":"2024-09-12T17:27:17.411635+0000","last_became_peered":"2024-09-12T17:27:17.411635+0000","last_unstale":"2024-09-12T17:42:15.302638+0000","last_undegraded":"2024-09-12T17:42:15.302638+0000","last_fullsized":"2024-09-12T17:42:15.302638+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:15.302324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:15.302324+0000","last_clean_scrub_stamp":"2024-09-12T17:42:15.302324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:56.811938+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:14.469628+0000","last_change":"2024-09-12T17:42:14.469466+0000","last_active":"2024-09-12T17:42:14.469628+0000","last_peered":"2024-09-12T17:42:14.469628+0000","last_clean":"2024-09-12T17:42:14.469628+0000","last_became_active":"2024-09-12T17:15:43.869197+0000","last_became_peered":"2024-09-12T17:15:43.869197+0000","last_unstale":"2024-09-12T17:42:14.469628+0000","last_undegraded":"2024-09-12T17:42:14.469628+0000","last_fullsized":"2024-09-12T17:42:14.469628+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:14.469273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:14.469273+0000","last_clean_scrub_stamp":"2024-09-12T17:42:14.469273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:22.066834+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:27.945030+0000","last_change":"2024-09-12T17:42:27.944887+0000","last_active":"2024-09-12T17:42:27.945030+0000","last_peered":"2024-09-12T17:42:27.945030+0000","last_clean":"2024-09-12T17:42:27.945030+0000","last_became_active":"2024-09-12T17:15:40.114636+0000","last_became_peered":"2024-09-12T17:15:40.114636+0000","last_unstale":"2024-09-12T17:42:27.945030+0000","last_undegraded":"2024-09-12T17:42:27.945030+0000","last_fullsized":"2024-09-12T17:42:27.945030+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:27.944715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:27.944715+0000","last_clean_scrub_stamp":"2024-09-12T17:42:27.944715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:29.584910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"265'11","reported_seq":85,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:06.384673+0000","last_change":"2024-09-12T17:42:06.384673+0000","last_active":"2024-09-12T17:42:06.384673+0000","last_peered":"2024-09-12T17:42:06.384673+0000","last_clean":"2024-09-12T17:42:06.384673+0000","last_became_active":"2024-09-12T17:13:54.836955+0000","last_became_peered":"2024-09-12T17:13:54.836955+0000","last_unstale":"2024-09-12T17:42:06.384673+0000","last_undegraded":"2024-09-12T17:42:06.384673+0000","last_fullsized":"2024-09-12T17:42:06.384673+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'11","last_scrub_stamp":"2024-09-12T17:42:06.384479+0000","last_deep_scrub":"265'11","last_deep_scrub_stamp":"2024-09-12T17:42:06.384479+0000","last_clean_scrub_stamp":"2024-09-12T17:42:06.384479+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:34.190005+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":38,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:31.865401+0000","last_change":"2024-09-12T17:42:31.865401+0000","last_active":"2024-09-12T17:42:31.865401+0000","last_peered":"2024-09-12T17:42:31.865401+0000","last_clean":"2024-09-12T17:42:31.865401+0000","last_became_active":"2024-09-12T17:27:17.408128+0000","last_became_peered":"2024-09-12T17:27:17.408128+0000","last_unstale":"2024-09-12T17:42:31.865401+0000","last_undegraded":"2024-09-12T17:42:31.865401+0000","last_fullsized":"2024-09-12T17:42:31.865401+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:31.865207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:31.865207+0000","last_clean_scrub_stamp":"2024-09-12T17:42:31.865207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:45.932154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"265'4","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:28.553914+0000","last_change":"2024-09-12T17:42:28.553737+0000","last_active":"2024-09-12T17:42:28.553914+0000","last_peered":"2024-09-12T17:42:28.553914+0000","last_clean":"2024-09-12T17:42:28.553914+0000","last_became_active":"2024-09-12T17:15:43.169936+0000","last_became_peered":"2024-09-12T17:15:43.169936+0000","last_unstale":"2024-09-12T17:42:28.553914+0000","last_undegraded":"2024-09-12T17:42:28.553914+0000","last_fullsized":"2024-09-12T17:42:28.553914+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T17:42:28.553560+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T17:42:28.553560+0000","last_clean_scrub_stamp":"2024-09-12T17:42:28.553560+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:56.719767+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"265'9","reported_seq":67,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:10.516894+0000","last_change":"2024-09-12T17:42:10.516621+0000","last_active":"2024-09-12T17:42:10.516894+0000","last_peered":"2024-09-12T17:42:10.516894+0000","last_clean":"2024-09-12T17:42:10.516894+0000","last_became_active":"2024-09-12T17:15:40.121181+0000","last_became_peered":"2024-09-12T17:15:40.121181+0000","last_unstale":"2024-09-12T17:42:10.516894+0000","last_undegraded":"2024-09-12T17:42:10.516894+0000","last_fullsized":"2024-09-12T17:42:10.516894+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'9","last_scrub_stamp":"2024-09-12T17:42:10.516395+0000","last_deep_scrub":"265'9","last_deep_scrub_stamp":"2024-09-12T17:42:10.516395+0000","last_clean_scrub_stamp":"2024-09-12T17:42:10.516395+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:29.653573+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12338,"num_write":14,"num_write_kb":5168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"265'48","reported_seq":184,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:02.687921+0000","last_change":"2024-09-12T17:42:02.687921+0000","last_active":"2024-09-12T17:42:02.687921+0000","last_peered":"2024-09-12T17:42:02.687921+0000","last_clean":"2024-09-12T17:42:02.687921+0000","last_became_active":"2024-09-12T17:13:54.841923+0000","last_became_peered":"2024-09-12T17:13:54.841923+0000","last_unstale":"2024-09-12T17:42:02.687921+0000","last_undegraded":"2024-09-12T17:42:02.687921+0000","last_fullsized":"2024-09-12T17:42:02.687921+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'48","last_scrub_stamp":"2024-09-12T17:42:02.687744+0000","last_deep_scrub":"265'48","last_deep_scrub_stamp":"2024-09-12T17:42:02.687744+0000","last_clean_scrub_stamp":"2024-09-12T17:42:02.687744+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:43.890945+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":241,"num_read_kb":172,"num_write":100,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":27,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:38.479742+0000","last_change":"2024-09-12T17:42:38.479742+0000","last_active":"2024-09-12T17:42:38.479742+0000","last_peered":"2024-09-12T17:42:38.479742+0000","last_clean":"2024-09-12T17:42:38.479742+0000","last_became_active":"2024-09-12T17:27:17.417566+0000","last_became_peered":"2024-09-12T17:27:17.417566+0000","last_unstale":"2024-09-12T17:42:38.479742+0000","last_undegraded":"2024-09-12T17:42:38.479742+0000","last_fullsized":"2024-09-12T17:42:38.479742+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:38.479524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:38.479524+0000","last_clean_scrub_stamp":"2024-09-12T17:42:38.479524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:28.346672+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"262'4","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:24.656776+0000","last_change":"2024-09-12T17:42:24.656776+0000","last_active":"2024-09-12T17:42:24.656776+0000","last_peered":"2024-09-12T17:42:24.656776+0000","last_clean":"2024-09-12T17:42:24.656776+0000","last_became_active":"2024-09-12T17:15:43.161858+0000","last_became_peered":"2024-09-12T17:15:43.161858+0000","last_unstale":"2024-09-12T17:42:24.656776+0000","last_undegraded":"2024-09-12T17:42:24.656776+0000","last_fullsized":"2024-09-12T17:42:24.656776+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-12T17:42:24.656587+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-12T17:42:24.656587+0000","last_clean_scrub_stamp":"2024-09-12T17:42:24.656587+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:56:03.318854+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:22.909120+0000","last_change":"2024-09-12T17:42:22.909120+0000","last_active":"2024-09-12T17:42:22.909120+0000","last_peered":"2024-09-12T17:42:22.909120+0000","last_clean":"2024-09-12T17:42:22.909120+0000","last_became_active":"2024-09-12T17:15:40.112179+0000","last_became_peered":"2024-09-12T17:15:40.112179+0000","last_unstale":"2024-09-12T17:42:22.909120+0000","last_undegraded":"2024-09-12T17:42:22.909120+0000","last_fullsized":"2024-09-12T17:42:22.909120+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:22.908920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:22.908920+0000","last_clean_scrub_stamp":"2024-09-12T17:42:22.908920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:27.576224+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"265'67","reported_seq":237,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:17.913371+0000","last_change":"2024-09-12T17:42:17.913371+0000","last_active":"2024-09-12T17:42:17.913371+0000","last_peered":"2024-09-12T17:42:17.913371+0000","last_clean":"2024-09-12T17:42:17.913371+0000","last_became_active":"2024-09-12T17:13:54.827402+0000","last_became_peered":"2024-09-12T17:13:54.827402+0000","last_unstale":"2024-09-12T17:42:17.913371+0000","last_undegraded":"2024-09-12T17:42:17.913371+0000","last_fullsized":"2024-09-12T17:42:17.913371+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'67","last_scrub_stamp":"2024-09-12T17:42:17.913094+0000","last_deep_scrub":"265'67","last_deep_scrub_stamp":"2024-09-12T17:42:17.913094+0000","last_clean_scrub_stamp":"2024-09-12T17:42:17.913094+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:27.784194+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":342,"num_read_kb":248,"num_write":117,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":27,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:33.885530+0000","last_change":"2024-09-12T17:42:33.885530+0000","last_active":"2024-09-12T17:42:33.885530+0000","last_peered":"2024-09-12T17:42:33.885530+0000","last_clean":"2024-09-12T17:42:33.885530+0000","last_became_active":"2024-09-12T17:27:17.418022+0000","last_became_peered":"2024-09-12T17:27:17.418022+0000","last_unstale":"2024-09-12T17:42:33.885530+0000","last_undegraded":"2024-09-12T17:42:33.885530+0000","last_fullsized":"2024-09-12T17:42:33.885530+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:33.885333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:33.885333+0000","last_clean_scrub_stamp":"2024-09-12T17:42:33.885333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:21.072016+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"265'5","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:25.854890+0000","last_change":"2024-09-12T17:42:25.854890+0000","last_active":"2024-09-12T17:42:25.854890+0000","last_peered":"2024-09-12T17:42:25.854890+0000","last_clean":"2024-09-12T17:42:25.854890+0000","last_became_active":"2024-09-12T17:15:43.864657+0000","last_became_peered":"2024-09-12T17:15:43.864657+0000","last_unstale":"2024-09-12T17:42:25.854890+0000","last_undegraded":"2024-09-12T17:42:25.854890+0000","last_fullsized":"2024-09-12T17:42:25.854890+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T17:42:25.854675+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T17:42:25.854675+0000","last_clean_scrub_stamp":"2024-09-12T17:42:25.854675+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:19.312298+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"265'12","reported_seq":76,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:11.521302+0000","last_change":"2024-09-12T17:42:11.521302+0000","last_active":"2024-09-12T17:42:11.521302+0000","last_peered":"2024-09-12T17:42:11.521302+0000","last_clean":"2024-09-12T17:42:11.521302+0000","last_became_active":"2024-09-12T17:15:40.122001+0000","last_became_peered":"2024-09-12T17:15:40.122001+0000","last_unstale":"2024-09-12T17:42:11.521302+0000","last_undegraded":"2024-09-12T17:42:11.521302+0000","last_fullsized":"2024-09-12T17:42:11.521302+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'12","last_scrub_stamp":"2024-09-12T17:42:11.521124+0000","last_deep_scrub":"265'12","last_deep_scrub_stamp":"2024-09-12T17:42:11.521124+0000","last_clean_scrub_stamp":"2024-09-12T17:42:11.521124+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:06.034884+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12340,"num_write":12,"num_write_kb":6192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"265'23","reported_seq":114,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:16.721715+0000","last_change":"2024-09-12T17:42:16.721715+0000","last_active":"2024-09-12T17:42:16.721715+0000","last_peered":"2024-09-12T17:42:16.721715+0000","last_clean":"2024-09-12T17:42:16.721715+0000","last_became_active":"2024-09-12T17:13:54.825019+0000","last_became_peered":"2024-09-12T17:13:54.825019+0000","last_unstale":"2024-09-12T17:42:16.721715+0000","last_undegraded":"2024-09-12T17:42:16.721715+0000","last_fullsized":"2024-09-12T17:42:16.721715+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'23","last_scrub_stamp":"2024-09-12T17:42:16.721533+0000","last_deep_scrub":"265'23","last_deep_scrub_stamp":"2024-09-12T17:42:16.721533+0000","last_clean_scrub_stamp":"2024-09-12T17:42:16.721533+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:09.433502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":38,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"265'2","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:32.898724+0000","last_change":"2024-09-12T17:42:32.898724+0000","last_active":"2024-09-12T17:42:32.898724+0000","last_peered":"2024-09-12T17:42:32.898724+0000","last_clean":"2024-09-12T17:42:32.898724+0000","last_became_active":"2024-09-12T17:27:17.408151+0000","last_became_peered":"2024-09-12T17:27:17.408151+0000","last_unstale":"2024-09-12T17:42:32.898724+0000","last_undegraded":"2024-09-12T17:42:32.898724+0000","last_fullsized":"2024-09-12T17:42:32.898724+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T17:42:32.898543+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T17:42:32.898543+0000","last_clean_scrub_stamp":"2024-09-12T17:42:32.898543+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:06.424871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"265'7","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:16.476434+0000","last_change":"2024-09-12T17:42:16.476254+0000","last_active":"2024-09-12T17:42:16.476434+0000","last_peered":"2024-09-12T17:42:16.476434+0000","last_clean":"2024-09-12T17:42:16.476434+0000","last_became_active":"2024-09-12T17:15:43.166482+0000","last_became_peered":"2024-09-12T17:15:43.166482+0000","last_unstale":"2024-09-12T17:42:16.476434+0000","last_undegraded":"2024-09-12T17:42:16.476434+0000","last_fullsized":"2024-09-12T17:42:16.476434+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T17:42:16.476055+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T17:42:16.476055+0000","last_clean_scrub_stamp":"2024-09-12T17:42:16.476055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:42.940708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:24.905257+0000","last_change":"2024-09-12T17:42:24.905257+0000","last_active":"2024-09-12T17:42:24.905257+0000","last_peered":"2024-09-12T17:42:24.905257+0000","last_clean":"2024-09-12T17:42:24.905257+0000","last_became_active":"2024-09-12T17:15:40.138190+0000","last_became_peered":"2024-09-12T17:15:40.138190+0000","last_unstale":"2024-09-12T17:42:24.905257+0000","last_undegraded":"2024-09-12T17:42:24.905257+0000","last_fullsized":"2024-09-12T17:42:24.905257+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:24.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:24.905052+0000","last_clean_scrub_stamp":"2024-09-12T17:42:24.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:55.049818+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"265'18","reported_seq":102,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:21.599090+0000","last_change":"2024-09-12T17:42:21.599090+0000","last_active":"2024-09-12T17:42:21.599090+0000","last_peered":"2024-09-12T17:42:21.599090+0000","last_clean":"2024-09-12T17:42:21.599090+0000","last_became_active":"2024-09-12T17:13:54.832453+0000","last_became_peered":"2024-09-12T17:13:54.832453+0000","last_unstale":"2024-09-12T17:42:21.599090+0000","last_undegraded":"2024-09-12T17:42:21.599090+0000","last_fullsized":"2024-09-12T17:42:21.599090+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'18","last_scrub_stamp":"2024-09-12T17:42:21.598904+0000","last_deep_scrub":"265'18","last_deep_scrub_stamp":"2024-09-12T17:42:21.598904+0000","last_clean_scrub_stamp":"2024-09-12T17:42:21.598904+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:42.851732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":60,"num_write":35,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":27,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:36.869358+0000","last_change":"2024-09-12T17:42:36.869358+0000","last_active":"2024-09-12T17:42:36.869358+0000","last_peered":"2024-09-12T17:42:36.869358+0000","last_clean":"2024-09-12T17:42:36.869358+0000","last_became_active":"2024-09-12T17:27:17.417574+0000","last_became_peered":"2024-09-12T17:27:17.417574+0000","last_unstale":"2024-09-12T17:42:36.869358+0000","last_undegraded":"2024-09-12T17:42:36.869358+0000","last_fullsized":"2024-09-12T17:42:36.869358+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:36.869156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:36.869156+0000","last_clean_scrub_stamp":"2024-09-12T17:42:36.869156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:28.911858+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"265'4","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:27.876604+0000","last_change":"2024-09-12T17:42:27.876604+0000","last_active":"2024-09-12T17:42:27.876604+0000","last_peered":"2024-09-12T17:42:27.876604+0000","last_clean":"2024-09-12T17:42:27.876604+0000","last_became_active":"2024-09-12T17:15:43.151000+0000","last_became_peered":"2024-09-12T17:15:43.151000+0000","last_unstale":"2024-09-12T17:42:27.876604+0000","last_undegraded":"2024-09-12T17:42:27.876604+0000","last_fullsized":"2024-09-12T17:42:27.876604+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T17:42:27.876431+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T17:42:27.876431+0000","last_clean_scrub_stamp":"2024-09-12T17:42:27.876431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:41.034087+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"262'2","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:15.619408+0000","last_change":"2024-09-12T17:42:15.619233+0000","last_active":"2024-09-12T17:42:15.619408+0000","last_peered":"2024-09-12T17:42:15.619408+0000","last_clean":"2024-09-12T17:42:15.619408+0000","last_became_active":"2024-09-12T17:15:40.118469+0000","last_became_peered":"2024-09-12T17:15:40.118469+0000","last_unstale":"2024-09-12T17:42:15.619408+0000","last_undegraded":"2024-09-12T17:42:15.619408+0000","last_fullsized":"2024-09-12T17:42:15.619408+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T17:42:15.619039+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T17:42:15.619039+0000","last_clean_scrub_stamp":"2024-09-12T17:42:15.619039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:33.245776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"265'20","reported_seq":108,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:05.415520+0000","last_change":"2024-09-12T17:42:05.415245+0000","last_active":"2024-09-12T17:42:05.415520+0000","last_peered":"2024-09-12T17:42:05.415520+0000","last_clean":"2024-09-12T17:42:05.415520+0000","last_became_active":"2024-09-12T17:13:54.827570+0000","last_became_peered":"2024-09-12T17:13:54.827570+0000","last_unstale":"2024-09-12T17:42:05.415520+0000","last_undegraded":"2024-09-12T17:42:05.415520+0000","last_fullsized":"2024-09-12T17:42:05.415520+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'20","last_scrub_stamp":"2024-09-12T17:42:05.415005+0000","last_deep_scrub":"265'20","last_deep_scrub_stamp":"2024-09-12T17:42:05.415005+0000","last_clean_scrub_stamp":"2024-09-12T17:42:05.415005+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:47.650137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":63,"num_write":42,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:28.895633+0000","last_change":"2024-09-12T17:42:28.895633+0000","last_active":"2024-09-12T17:42:28.895633+0000","last_peered":"2024-09-12T17:42:28.895633+0000","last_clean":"2024-09-12T17:42:28.895633+0000","last_became_active":"2024-09-12T17:27:17.411175+0000","last_became_peered":"2024-09-12T17:27:17.411175+0000","last_unstale":"2024-09-12T17:42:28.895633+0000","last_undegraded":"2024-09-12T17:42:28.895633+0000","last_fullsized":"2024-09-12T17:42:28.895633+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:28.895441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:28.895441+0000","last_clean_scrub_stamp":"2024-09-12T17:42:28.895441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:16.800456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"265'5","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:33.915335+0000","last_change":"2024-09-12T17:42:33.915200+0000","last_active":"2024-09-12T17:42:33.915335+0000","last_peered":"2024-09-12T17:42:33.915335+0000","last_clean":"2024-09-12T17:42:33.915335+0000","last_became_active":"2024-09-12T17:15:43.159149+0000","last_became_peered":"2024-09-12T17:15:43.159149+0000","last_unstale":"2024-09-12T17:42:33.915335+0000","last_undegraded":"2024-09-12T17:42:33.915335+0000","last_fullsized":"2024-09-12T17:42:33.915335+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T17:42:33.915014+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T17:42:33.915014+0000","last_clean_scrub_stamp":"2024-09-12T17:42:33.915014+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:34.264799+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2048,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"265'7","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:17.743461+0000","last_change":"2024-09-12T17:42:17.743182+0000","last_active":"2024-09-12T17:42:17.743461+0000","last_peered":"2024-09-12T17:42:17.743461+0000","last_clean":"2024-09-12T17:42:17.743461+0000","last_became_active":"2024-09-12T17:15:40.121513+0000","last_became_peered":"2024-09-12T17:15:40.121513+0000","last_unstale":"2024-09-12T17:42:17.743461+0000","last_undegraded":"2024-09-12T17:42:17.743461+0000","last_fullsized":"2024-09-12T17:42:17.743461+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T17:42:17.742962+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T17:42:17.742962+0000","last_clean_scrub_stamp":"2024-09-12T17:42:17.742962+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:27.364682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6144,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"265'31","reported_seq":140,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:16.929769+0000","last_change":"2024-09-12T17:42:16.929769+0000","last_active":"2024-09-12T17:42:16.929769+0000","last_peered":"2024-09-12T17:42:16.929769+0000","last_clean":"2024-09-12T17:42:16.929769+0000","last_became_active":"2024-09-12T17:13:54.828393+0000","last_became_peered":"2024-09-12T17:13:54.828393+0000","last_unstale":"2024-09-12T17:42:16.929769+0000","last_undegraded":"2024-09-12T17:42:16.929769+0000","last_fullsized":"2024-09-12T17:42:16.929769+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'31","last_scrub_stamp":"2024-09-12T17:42:16.929541+0000","last_deep_scrub":"265'31","last_deep_scrub_stamp":"2024-09-12T17:42:16.929541+0000","last_clean_scrub_stamp":"2024-09-12T17:42:16.929541+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:04.659867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":109,"num_write":58,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:24.679943+0000","last_change":"2024-09-12T17:42:24.679943+0000","last_active":"2024-09-12T17:42:24.679943+0000","last_peered":"2024-09-12T17:42:24.679943+0000","last_clean":"2024-09-12T17:42:24.679943+0000","last_became_active":"2024-09-12T17:27:17.402024+0000","last_became_peered":"2024-09-12T17:27:17.402024+0000","last_unstale":"2024-09-12T17:42:24.679943+0000","last_undegraded":"2024-09-12T17:42:24.679943+0000","last_fullsized":"2024-09-12T17:42:24.679943+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:24.679738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:24.679738+0000","last_clean_scrub_stamp":"2024-09-12T17:42:24.679738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:35.046672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:29.882550+0000","last_change":"2024-09-12T17:42:29.882332+0000","last_active":"2024-09-12T17:42:29.882550+0000","last_peered":"2024-09-12T17:42:29.882550+0000","last_clean":"2024-09-12T17:42:29.882550+0000","last_became_active":"2024-09-12T17:15:43.871095+0000","last_became_peered":"2024-09-12T17:15:43.871095+0000","last_unstale":"2024-09-12T17:42:29.882550+0000","last_undegraded":"2024-09-12T17:42:29.882550+0000","last_fullsized":"2024-09-12T17:42:29.882550+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:29.881821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:29.881821+0000","last_clean_scrub_stamp":"2024-09-12T17:42:29.881821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:12.488014+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'9","reported_seq":69,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:00.694323+0000","last_change":"2024-09-12T17:42:00.694187+0000","last_active":"2024-09-12T17:42:00.694323+0000","last_peered":"2024-09-12T17:42:00.694323+0000","last_clean":"2024-09-12T17:42:00.694323+0000","last_became_active":"2024-09-12T17:15:40.125684+0000","last_became_peered":"2024-09-12T17:15:40.125684+0000","last_unstale":"2024-09-12T17:42:00.694323+0000","last_undegraded":"2024-09-12T17:42:00.694323+0000","last_fullsized":"2024-09-12T17:42:00.694323+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'9","last_scrub_stamp":"2024-09-12T17:42:00.694013+0000","last_deep_scrub":"265'9","last_deep_scrub_stamp":"2024-09-12T17:42:00.694013+0000","last_clean_scrub_stamp":"2024-09-12T17:42:00.694013+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:18.914344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":32770,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"265'38","reported_seq":156,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:04.376544+0000","last_change":"2024-09-12T17:42:04.376407+0000","last_active":"2024-09-12T17:42:04.376544+0000","last_peered":"2024-09-12T17:42:04.376544+0000","last_clean":"2024-09-12T17:42:04.376544+0000","last_became_active":"2024-09-12T17:13:54.825945+0000","last_became_peered":"2024-09-12T17:13:54.825945+0000","last_unstale":"2024-09-12T17:42:04.376544+0000","last_undegraded":"2024-09-12T17:42:04.376544+0000","last_fullsized":"2024-09-12T17:42:04.376544+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'38","last_scrub_stamp":"2024-09-12T17:42:04.376219+0000","last_deep_scrub":"265'38","last_deep_scrub_stamp":"2024-09-12T17:42:04.376219+0000","last_clean_scrub_stamp":"2024-09-12T17:42:04.376219+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:13.365245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":132,"num_write":66,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:17.484778+0000","last_change":"2024-09-12T17:42:17.484778+0000","last_active":"2024-09-12T17:42:17.484778+0000","last_peered":"2024-09-12T17:42:17.484778+0000","last_clean":"2024-09-12T17:42:17.484778+0000","last_became_active":"2024-09-12T17:27:17.408445+0000","last_became_peered":"2024-09-12T17:27:17.408445+0000","last_unstale":"2024-09-12T17:42:17.484778+0000","last_undegraded":"2024-09-12T17:42:17.484778+0000","last_fullsized":"2024-09-12T17:42:17.484778+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:17.484596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:17.484596+0000","last_clean_scrub_stamp":"2024-09-12T17:42:17.484596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:49:48.661676+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:22.739241+0000","last_change":"2024-09-12T17:42:22.739241+0000","last_active":"2024-09-12T17:42:22.739241+0000","last_peered":"2024-09-12T17:42:22.739241+0000","last_clean":"2024-09-12T17:42:22.739241+0000","last_became_active":"2024-09-12T17:15:43.866375+0000","last_became_peered":"2024-09-12T17:15:43.866375+0000","last_unstale":"2024-09-12T17:42:22.739241+0000","last_undegraded":"2024-09-12T17:42:22.739241+0000","last_fullsized":"2024-09-12T17:42:22.739241+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:22.739070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:22.739070+0000","last_clean_scrub_stamp":"2024-09-12T17:42:22.739070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:43.987911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"265'6","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:18.655613+0000","last_change":"2024-09-12T17:42:18.655613+0000","last_active":"2024-09-12T17:42:18.655613+0000","last_peered":"2024-09-12T17:42:18.655613+0000","last_clean":"2024-09-12T17:42:18.655613+0000","last_became_active":"2024-09-12T17:15:40.124901+0000","last_became_peered":"2024-09-12T17:15:40.124901+0000","last_unstale":"2024-09-12T17:42:18.655613+0000","last_undegraded":"2024-09-12T17:42:18.655613+0000","last_fullsized":"2024-09-12T17:42:18.655613+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T17:42:18.655413+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T17:42:18.655413+0000","last_clean_scrub_stamp":"2024-09-12T17:42:18.655413+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:41.250021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"265'32","reported_seq":138,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:15.700625+0000","last_change":"2024-09-12T17:42:15.700625+0000","last_active":"2024-09-12T17:42:15.700625+0000","last_peered":"2024-09-12T17:42:15.700625+0000","last_clean":"2024-09-12T17:42:15.700625+0000","last_became_active":"2024-09-12T17:13:54.824810+0000","last_became_peered":"2024-09-12T17:13:54.824810+0000","last_unstale":"2024-09-12T17:42:15.700625+0000","last_undegraded":"2024-09-12T17:42:15.700625+0000","last_fullsized":"2024-09-12T17:42:15.700625+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'32","last_scrub_stamp":"2024-09-12T17:42:15.700378+0000","last_deep_scrub":"265'32","last_deep_scrub_stamp":"2024-09-12T17:42:15.700378+0000","last_clean_scrub_stamp":"2024-09-12T17:42:15.700378+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:03:14.023849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":107,"num_write":61,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:27.560570+0000","last_change":"2024-09-12T17:42:27.560570+0000","last_active":"2024-09-12T17:42:27.560570+0000","last_peered":"2024-09-12T17:42:27.560570+0000","last_clean":"2024-09-12T17:42:27.560570+0000","last_became_active":"2024-09-12T17:27:17.409774+0000","last_became_peered":"2024-09-12T17:27:17.409774+0000","last_unstale":"2024-09-12T17:42:27.560570+0000","last_undegraded":"2024-09-12T17:42:27.560570+0000","last_fullsized":"2024-09-12T17:42:27.560570+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:27.560347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:27.560347+0000","last_clean_scrub_stamp":"2024-09-12T17:42:27.560347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:34.481687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:22.581013+0000","last_change":"2024-09-12T17:42:22.581013+0000","last_active":"2024-09-12T17:42:22.581013+0000","last_peered":"2024-09-12T17:42:22.581013+0000","last_clean":"2024-09-12T17:42:22.581013+0000","last_became_active":"2024-09-12T17:15:43.167221+0000","last_became_peered":"2024-09-12T17:15:43.167221+0000","last_unstale":"2024-09-12T17:42:22.581013+0000","last_undegraded":"2024-09-12T17:42:22.581013+0000","last_fullsized":"2024-09-12T17:42:22.581013+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:22.580814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:22.580814+0000","last_clean_scrub_stamp":"2024-09-12T17:42:22.580814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:30:24.154414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"262'5","reported_seq":60,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:20.707577+0000","last_change":"2024-09-12T17:42:20.707577+0000","last_active":"2024-09-12T17:42:20.707577+0000","last_peered":"2024-09-12T17:42:20.707577+0000","last_clean":"2024-09-12T17:42:20.707577+0000","last_became_active":"2024-09-12T17:15:40.131162+0000","last_became_peered":"2024-09-12T17:15:40.131162+0000","last_unstale":"2024-09-12T17:42:20.707577+0000","last_undegraded":"2024-09-12T17:42:20.707577+0000","last_fullsized":"2024-09-12T17:42:20.707577+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T17:42:20.707379+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T17:42:20.707379+0000","last_clean_scrub_stamp":"2024-09-12T17:42:20.707379+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:33.838322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"265'229","reported_seq":772,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:07.444406+0000","last_change":"2024-09-12T17:42:07.444406+0000","last_active":"2024-09-12T17:42:07.444406+0000","last_peered":"2024-09-12T17:42:07.444406+0000","last_clean":"2024-09-12T17:42:07.444406+0000","last_became_active":"2024-09-12T17:13:54.824372+0000","last_became_peered":"2024-09-12T17:13:54.824372+0000","last_unstale":"2024-09-12T17:42:07.444406+0000","last_undegraded":"2024-09-12T17:42:07.444406+0000","last_fullsized":"2024-09-12T17:42:07.444406+0000","mapping_epoch":252,"log_start":"262'200","ondisk_log_start":"262'200","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'229","last_scrub_stamp":"2024-09-12T17:42:07.444210+0000","last_deep_scrub":"265'229","last_deep_scrub_stamp":"2024-09-12T17:42:07.444210+0000","last_clean_scrub_stamp":"2024-09-12T17:42:07.444210+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:01.339439+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1417,"num_read_kb":1102,"num_write":261,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4473,"num_omap_keys":9,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"265'2","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:07.648286+0000","last_change":"2024-09-12T17:42:07.648128+0000","last_active":"2024-09-12T17:42:07.648286+0000","last_peered":"2024-09-12T17:42:07.648286+0000","last_clean":"2024-09-12T17:42:07.648286+0000","last_became_active":"2024-09-12T17:27:17.404001+0000","last_became_peered":"2024-09-12T17:27:17.404001+0000","last_unstale":"2024-09-12T17:42:07.648286+0000","last_undegraded":"2024-09-12T17:42:07.648286+0000","last_fullsized":"2024-09-12T17:42:07.648286+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T17:42:07.647942+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T17:42:07.647942+0000","last_clean_scrub_stamp":"2024-09-12T17:42:07.647942+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:29.596236+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:13.487050+0000","last_change":"2024-09-12T17:42:13.486876+0000","last_active":"2024-09-12T17:42:13.487050+0000","last_peered":"2024-09-12T17:42:13.487050+0000","last_clean":"2024-09-12T17:42:13.487050+0000","last_became_active":"2024-09-12T17:15:43.159256+0000","last_became_peered":"2024-09-12T17:15:43.159256+0000","last_unstale":"2024-09-12T17:42:13.487050+0000","last_undegraded":"2024-09-12T17:42:13.487050+0000","last_fullsized":"2024-09-12T17:42:13.487050+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:13.486634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:13.486634+0000","last_clean_scrub_stamp":"2024-09-12T17:42:13.486634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:56.304484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"265'2","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:19.705186+0000","last_change":"2024-09-12T17:42:19.705186+0000","last_active":"2024-09-12T17:42:19.705186+0000","last_peered":"2024-09-12T17:42:19.705186+0000","last_clean":"2024-09-12T17:42:19.705186+0000","last_became_active":"2024-09-12T17:15:40.138844+0000","last_became_peered":"2024-09-12T17:15:40.138844+0000","last_unstale":"2024-09-12T17:42:19.705186+0000","last_undegraded":"2024-09-12T17:42:19.705186+0000","last_fullsized":"2024-09-12T17:42:19.705186+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T17:42:19.705002+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T17:42:19.705002+0000","last_clean_scrub_stamp":"2024-09-12T17:42:19.705002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:12.317463+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"265'38","reported_seq":156,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:16.620946+0000","last_change":"2024-09-12T17:42:16.620946+0000","last_active":"2024-09-12T17:42:16.620946+0000","last_peered":"2024-09-12T17:42:16.620946+0000","last_clean":"2024-09-12T17:42:16.620946+0000","last_became_active":"2024-09-12T17:13:54.830999+0000","last_became_peered":"2024-09-12T17:13:54.830999+0000","last_unstale":"2024-09-12T17:42:16.620946+0000","last_undegraded":"2024-09-12T17:42:16.620946+0000","last_fullsized":"2024-09-12T17:42:16.620946+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'38","last_scrub_stamp":"2024-09-12T17:42:16.620766+0000","last_deep_scrub":"265'38","last_deep_scrub_stamp":"2024-09-12T17:42:16.620766+0000","last_clean_scrub_stamp":"2024-09-12T17:42:16.620766+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:21.210400+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":129,"num_write":64,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:32.875755+0000","last_change":"2024-09-12T17:42:32.875755+0000","last_active":"2024-09-12T17:42:32.875755+0000","last_peered":"2024-09-12T17:42:32.875755+0000","last_clean":"2024-09-12T17:42:32.875755+0000","last_became_active":"2024-09-12T17:27:17.412921+0000","last_became_peered":"2024-09-12T17:27:17.412921+0000","last_unstale":"2024-09-12T17:42:32.875755+0000","last_undegraded":"2024-09-12T17:42:32.875755+0000","last_fullsized":"2024-09-12T17:42:32.875755+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:32.875570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:32.875570+0000","last_clean_scrub_stamp":"2024-09-12T17:42:32.875570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:31.677110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"265'4","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:21.649266+0000","last_change":"2024-09-12T17:42:21.649266+0000","last_active":"2024-09-12T17:42:21.649266+0000","last_peered":"2024-09-12T17:42:21.649266+0000","last_clean":"2024-09-12T17:42:21.649266+0000","last_became_active":"2024-09-12T17:15:43.154940+0000","last_became_peered":"2024-09-12T17:15:43.154940+0000","last_unstale":"2024-09-12T17:42:21.649266+0000","last_undegraded":"2024-09-12T17:42:21.649266+0000","last_fullsized":"2024-09-12T17:42:21.649266+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T17:42:21.649077+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T17:42:21.649077+0000","last_clean_scrub_stamp":"2024-09-12T17:42:21.649077+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:29.594849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:18.695399+0000","last_change":"2024-09-12T17:42:18.695221+0000","last_active":"2024-09-12T17:42:18.695399+0000","last_peered":"2024-09-12T17:42:18.695399+0000","last_clean":"2024-09-12T17:42:18.695399+0000","last_became_active":"2024-09-12T17:15:40.126745+0000","last_became_peered":"2024-09-12T17:15:40.126745+0000","last_unstale":"2024-09-12T17:42:18.695399+0000","last_undegraded":"2024-09-12T17:42:18.695399+0000","last_fullsized":"2024-09-12T17:42:18.695399+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:18.695035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:18.695035+0000","last_clean_scrub_stamp":"2024-09-12T17:42:18.695035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:20.019015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"265'14","reported_seq":94,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:19.618475+0000","last_change":"2024-09-12T17:42:19.618475+0000","last_active":"2024-09-12T17:42:19.618475+0000","last_peered":"2024-09-12T17:42:19.618475+0000","last_clean":"2024-09-12T17:42:19.618475+0000","last_became_active":"2024-09-12T17:13:54.840501+0000","last_became_peered":"2024-09-12T17:13:54.840501+0000","last_unstale":"2024-09-12T17:42:19.618475+0000","last_undegraded":"2024-09-12T17:42:19.618475+0000","last_fullsized":"2024-09-12T17:42:19.618475+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'14","last_scrub_stamp":"2024-09-12T17:42:19.618278+0000","last_deep_scrub":"265'14","last_deep_scrub_stamp":"2024-09-12T17:42:19.618278+0000","last_clean_scrub_stamp":"2024-09-12T17:42:19.618278+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:04.285683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":51,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:31.887001+0000","last_change":"2024-09-12T17:42:31.887001+0000","last_active":"2024-09-12T17:42:31.887001+0000","last_peered":"2024-09-12T17:42:31.887001+0000","last_clean":"2024-09-12T17:42:31.887001+0000","last_became_active":"2024-09-12T17:27:17.421504+0000","last_became_peered":"2024-09-12T17:27:17.421504+0000","last_unstale":"2024-09-12T17:42:31.887001+0000","last_undegraded":"2024-09-12T17:42:31.887001+0000","last_fullsized":"2024-09-12T17:42:31.887001+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:31.886797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:31.886797+0000","last_clean_scrub_stamp":"2024-09-12T17:42:31.886797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:14.106354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"265'3","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:12.364605+0000","last_change":"2024-09-12T17:42:12.364437+0000","last_active":"2024-09-12T17:42:12.364605+0000","last_peered":"2024-09-12T17:42:12.364605+0000","last_clean":"2024-09-12T17:42:12.364605+0000","last_became_active":"2024-09-12T17:15:43.162406+0000","last_became_peered":"2024-09-12T17:15:43.162406+0000","last_unstale":"2024-09-12T17:42:12.364605+0000","last_undegraded":"2024-09-12T17:42:12.364605+0000","last_fullsized":"2024-09-12T17:42:12.364605+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T17:42:12.364241+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T17:42:12.364241+0000","last_clean_scrub_stamp":"2024-09-12T17:42:12.364241+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:18.772651+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"265'11","reported_seq":69,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:09.532087+0000","last_change":"2024-09-12T17:42:09.531921+0000","last_active":"2024-09-12T17:42:09.532087+0000","last_peered":"2024-09-12T17:42:09.532087+0000","last_clean":"2024-09-12T17:42:09.532087+0000","last_became_active":"2024-09-12T17:15:40.115746+0000","last_became_peered":"2024-09-12T17:15:40.115746+0000","last_unstale":"2024-09-12T17:42:09.532087+0000","last_undegraded":"2024-09-12T17:42:09.532087+0000","last_fullsized":"2024-09-12T17:42:09.532087+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'11","last_scrub_stamp":"2024-09-12T17:42:09.531744+0000","last_deep_scrub":"265'11","last_deep_scrub_stamp":"2024-09-12T17:42:09.531744+0000","last_clean_scrub_stamp":"2024-09-12T17:42:09.531744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:01.984539+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12288,"num_write":16,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"265'17","reported_seq":104,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:07.413545+0000","last_change":"2024-09-12T17:42:07.413545+0000","last_active":"2024-09-12T17:42:07.413545+0000","last_peered":"2024-09-12T17:42:07.413545+0000","last_clean":"2024-09-12T17:42:07.413545+0000","last_became_active":"2024-09-12T17:13:54.838008+0000","last_became_peered":"2024-09-12T17:13:54.838008+0000","last_unstale":"2024-09-12T17:42:07.413545+0000","last_undegraded":"2024-09-12T17:42:07.413545+0000","last_fullsized":"2024-09-12T17:42:07.413545+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'17","last_scrub_stamp":"2024-09-12T17:42:07.413371+0000","last_deep_scrub":"265'17","last_deep_scrub_stamp":"2024-09-12T17:42:07.413371+0000","last_clean_scrub_stamp":"2024-09-12T17:42:07.413371+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:32.085492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":61,"num_write":32,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:29.860840+0000","last_change":"2024-09-12T17:42:29.860840+0000","last_active":"2024-09-12T17:42:29.860840+0000","last_peered":"2024-09-12T17:42:29.860840+0000","last_clean":"2024-09-12T17:42:29.860840+0000","last_became_active":"2024-09-12T17:27:17.408296+0000","last_became_peered":"2024-09-12T17:27:17.408296+0000","last_unstale":"2024-09-12T17:42:29.860840+0000","last_undegraded":"2024-09-12T17:42:29.860840+0000","last_fullsized":"2024-09-12T17:42:29.860840+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:29.860656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:29.860656+0000","last_clean_scrub_stamp":"2024-09-12T17:42:29.860656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:41.835129+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"265'6","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:23.615780+0000","last_change":"2024-09-12T17:42:23.615622+0000","last_active":"2024-09-12T17:42:23.615780+0000","last_peered":"2024-09-12T17:42:23.615780+0000","last_clean":"2024-09-12T17:42:23.615780+0000","last_became_active":"2024-09-12T17:15:43.163824+0000","last_became_peered":"2024-09-12T17:15:43.163824+0000","last_unstale":"2024-09-12T17:42:23.615780+0000","last_undegraded":"2024-09-12T17:42:23.615780+0000","last_fullsized":"2024-09-12T17:42:23.615780+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T17:42:23.615435+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T17:42:23.615435+0000","last_clean_scrub_stamp":"2024-09-12T17:42:23.615435+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:04.108730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5122,"num_write":6,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:09.367441+0000","last_change":"2024-09-12T17:42:09.367288+0000","last_active":"2024-09-12T17:42:09.367441+0000","last_peered":"2024-09-12T17:42:09.367441+0000","last_clean":"2024-09-12T17:42:09.367441+0000","last_became_active":"2024-09-12T17:15:40.114860+0000","last_became_peered":"2024-09-12T17:15:40.114860+0000","last_unstale":"2024-09-12T17:42:09.367441+0000","last_undegraded":"2024-09-12T17:42:09.367441+0000","last_fullsized":"2024-09-12T17:42:09.367441+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:09.367097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:09.367097+0000","last_clean_scrub_stamp":"2024-09-12T17:42:09.367097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:54.058677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"265'55","reported_seq":206,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:14.711159+0000","last_change":"2024-09-12T17:42:14.711159+0000","last_active":"2024-09-12T17:42:14.711159+0000","last_peered":"2024-09-12T17:42:14.711159+0000","last_clean":"2024-09-12T17:42:14.711159+0000","last_became_active":"2024-09-12T17:13:54.832949+0000","last_became_peered":"2024-09-12T17:13:54.832949+0000","last_unstale":"2024-09-12T17:42:14.711159+0000","last_undegraded":"2024-09-12T17:42:14.711159+0000","last_fullsized":"2024-09-12T17:42:14.711159+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'55","last_scrub_stamp":"2024-09-12T17:42:14.710966+0000","last_deep_scrub":"265'55","last_deep_scrub_stamp":"2024-09-12T17:42:14.710966+0000","last_clean_scrub_stamp":"2024-09-12T17:42:14.710966+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:59.222600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":283,"num_read_kb":200,"num_write":95,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"265'393","reported_seq":1093,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:49.548806+0000","last_change":"2024-09-12T17:41:49.548572+0000","last_active":"2024-09-12T17:41:49.548806+0000","last_peered":"2024-09-12T17:41:49.548806+0000","last_clean":"2024-09-12T17:41:49.548806+0000","last_became_active":"2024-09-12T16:58:18.713754+0000","last_became_peered":"2024-09-12T16:58:18.713754+0000","last_unstale":"2024-09-12T17:41:49.548806+0000","last_undegraded":"2024-09-12T17:41:49.548806+0000","last_fullsized":"2024-09-12T17:41:49.548806+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'393","last_scrub_stamp":"2024-09-12T17:41:49.548319+0000","last_deep_scrub":"265'393","last_deep_scrub_stamp":"2024-09-12T17:41:49.548319+0000","last_clean_scrub_stamp":"2024-09-12T17:41:49.548319+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:37.288699+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":207329,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":632,"num_read_kb":52184,"num_write":1250,"num_write_kb":52679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"265'127","reported_seq":734,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:57.590054+0000","last_change":"2024-09-12T17:41:57.590054+0000","last_active":"2024-09-12T17:41:57.590054+0000","last_peered":"2024-09-12T17:41:57.590054+0000","last_clean":"2024-09-12T17:41:57.590054+0000","last_became_active":"2024-09-12T16:58:21.708409+0000","last_became_peered":"2024-09-12T16:58:21.708409+0000","last_unstale":"2024-09-12T17:41:57.590054+0000","last_undegraded":"2024-09-12T17:41:57.590054+0000","last_fullsized":"2024-09-12T17:41:57.590054+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'127","last_scrub_stamp":"2024-09-12T17:41:57.589826+0000","last_deep_scrub":"265'127","last_deep_scrub_stamp":"2024-09-12T17:41:57.589826+0000","last_clean_scrub_stamp":"2024-09-12T17:41:57.589826+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:20.676074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":568,"num_read_kb":472,"num_write":186,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"265'363","reported_seq":997,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:45.351273+0000","last_change":"2024-09-12T17:41:45.351133+0000","last_active":"2024-09-12T17:41:45.351273+0000","last_peered":"2024-09-12T17:41:45.351273+0000","last_clean":"2024-09-12T17:41:45.351273+0000","last_became_active":"2024-09-12T16:58:18.699994+0000","last_became_peered":"2024-09-12T16:58:18.699994+0000","last_unstale":"2024-09-12T17:41:45.351273+0000","last_undegraded":"2024-09-12T17:41:45.351273+0000","last_fullsized":"2024-09-12T17:41:45.351273+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'363","last_scrub_stamp":"2024-09-12T17:41:45.350930+0000","last_deep_scrub":"265'363","last_deep_scrub_stamp":"2024-09-12T17:41:45.350930+0000","last_clean_scrub_stamp":"2024-09-12T17:41:45.350930+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:17.973292+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263228,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":513,"num_read_kb":14780,"num_write":1119,"num_write_kb":32109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"265'61","reported_seq":648,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:56.670046+0000","last_change":"2024-09-12T17:41:56.670046+0000","last_active":"2024-09-12T17:41:56.670046+0000","last_peered":"2024-09-12T17:41:56.670046+0000","last_clean":"2024-09-12T17:41:56.670046+0000","last_became_active":"2024-09-12T16:58:21.721536+0000","last_became_peered":"2024-09-12T16:58:21.721536+0000","last_unstale":"2024-09-12T17:41:56.670046+0000","last_undegraded":"2024-09-12T17:41:56.670046+0000","last_fullsized":"2024-09-12T17:41:56.670046+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'61","last_scrub_stamp":"2024-09-12T17:41:56.669852+0000","last_deep_scrub":"265'61","last_deep_scrub_stamp":"2024-09-12T17:41:56.669852+0000","last_clean_scrub_stamp":"2024-09-12T17:41:56.669852+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:36.236526+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":297,"num_read_kb":264,"num_write":81,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"265'426","reported_seq":1242,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:48.141322+0000","last_change":"2024-09-12T17:41:48.141167+0000","last_active":"2024-09-12T17:41:48.141322+0000","last_peered":"2024-09-12T17:41:48.141322+0000","last_clean":"2024-09-12T17:41:48.141322+0000","last_became_active":"2024-09-12T16:58:18.687865+0000","last_became_peered":"2024-09-12T16:58:18.687865+0000","last_unstale":"2024-09-12T17:41:48.141322+0000","last_undegraded":"2024-09-12T17:41:48.141322+0000","last_fullsized":"2024-09-12T17:41:48.141322+0000","mapping_epoch":23,"log_start":"265'400","ondisk_log_start":"265'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'426","last_scrub_stamp":"2024-09-12T17:41:48.140932+0000","last_deep_scrub":"265'426","last_deep_scrub_stamp":"2024-09-12T17:41:48.140932+0000","last_clean_scrub_stamp":"2024-09-12T17:41:48.140932+0000","objects_scrubbed":9,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:06.456200+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263210,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1063,"num_read_kb":27565,"num_write":1556,"num_write_kb":41677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"265'166","reported_seq":768,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:55.642706+0000","last_change":"2024-09-12T17:41:55.642706+0000","last_active":"2024-09-12T17:41:55.642706+0000","last_peered":"2024-09-12T17:41:55.642706+0000","last_clean":"2024-09-12T17:41:55.642706+0000","last_became_active":"2024-09-12T16:58:21.703861+0000","last_became_peered":"2024-09-12T16:58:21.703861+0000","last_unstale":"2024-09-12T17:41:55.642706+0000","last_undegraded":"2024-09-12T17:41:55.642706+0000","last_fullsized":"2024-09-12T17:41:55.642706+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'166","last_scrub_stamp":"2024-09-12T17:41:55.642509+0000","last_deep_scrub":"265'166","last_deep_scrub_stamp":"2024-09-12T17:41:55.642509+0000","last_clean_scrub_stamp":"2024-09-12T17:41:55.642509+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:44.318567+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":693,"num_read_kb":563,"num_write":272,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"265'374","reported_seq":1036,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:51.657360+0000","last_change":"2024-09-12T17:41:51.657131+0000","last_active":"2024-09-12T17:41:51.657360+0000","last_peered":"2024-09-12T17:41:51.657360+0000","last_clean":"2024-09-12T17:41:51.657360+0000","last_became_active":"2024-09-12T16:58:18.716783+0000","last_became_peered":"2024-09-12T16:58:18.716783+0000","last_unstale":"2024-09-12T17:41:51.657360+0000","last_undegraded":"2024-09-12T17:41:51.657360+0000","last_fullsized":"2024-09-12T17:41:51.657360+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'374","last_scrub_stamp":"2024-09-12T17:41:51.656864+0000","last_deep_scrub":"265'374","last_deep_scrub_stamp":"2024-09-12T17:41:51.656864+0000","last_clean_scrub_stamp":"2024-09-12T17:41:51.656864+0000","objects_scrubbed":7,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:26.088285+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":698119,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":542,"num_read_kb":33905,"num_write":1205,"num_write_kb":31442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"265'207","reported_seq":817,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:54.056910+0000","last_change":"2024-09-12T17:41:54.056910+0000","last_active":"2024-09-12T17:41:54.056910+0000","last_peered":"2024-09-12T17:41:54.056910+0000","last_clean":"2024-09-12T17:41:54.056910+0000","last_became_active":"2024-09-12T16:58:21.699869+0000","last_became_peered":"2024-09-12T16:58:21.699869+0000","last_unstale":"2024-09-12T17:41:54.056910+0000","last_undegraded":"2024-09-12T17:41:54.056910+0000","last_fullsized":"2024-09-12T17:41:54.056910+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'207","last_scrub_stamp":"2024-09-12T17:41:54.056679+0000","last_deep_scrub":"265'207","last_deep_scrub_stamp":"2024-09-12T17:41:54.056679+0000","last_clean_scrub_stamp":"2024-09-12T17:41:54.056679+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:21.954587+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":874,"num_read_kb":727,"num_write":307,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"265'359","reported_seq":1031,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:50.584607+0000","last_change":"2024-09-12T17:41:50.584607+0000","last_active":"2024-09-12T17:41:50.584607+0000","last_peered":"2024-09-12T17:41:50.584607+0000","last_clean":"2024-09-12T17:41:50.584607+0000","last_became_active":"2024-09-12T16:58:18.688345+0000","last_became_peered":"2024-09-12T16:58:18.688345+0000","last_unstale":"2024-09-12T17:41:50.584607+0000","last_undegraded":"2024-09-12T17:41:50.584607+0000","last_fullsized":"2024-09-12T17:41:50.584607+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'359","last_scrub_stamp":"2024-09-12T17:41:50.584401+0000","last_deep_scrub":"265'359","last_deep_scrub_stamp":"2024-09-12T17:41:50.584401+0000","last_clean_scrub_stamp":"2024-09-12T17:41:50.584401+0000","objects_scrubbed":7,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:59.917375+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263227,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":585,"num_read_kb":27999,"num_write":1129,"num_write_kb":20285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"265'277","reported_seq":929,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:51.482677+0000","last_change":"2024-09-12T17:41:51.482503+0000","last_active":"2024-09-12T17:41:51.482677+0000","last_peered":"2024-09-12T17:41:51.482677+0000","last_clean":"2024-09-12T17:41:51.482677+0000","last_became_active":"2024-09-12T16:58:21.709879+0000","last_became_peered":"2024-09-12T16:58:21.709879+0000","last_unstale":"2024-09-12T17:41:51.482677+0000","last_undegraded":"2024-09-12T17:41:51.482677+0000","last_fullsized":"2024-09-12T17:41:51.482677+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'277","last_scrub_stamp":"2024-09-12T17:41:51.482314+0000","last_deep_scrub":"265'277","last_deep_scrub_stamp":"2024-09-12T17:41:51.482314+0000","last_clean_scrub_stamp":"2024-09-12T17:41:51.482314+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:57.714571+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1330,"num_read_kb":1122,"num_write":481,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"265'397","reported_seq":1054,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:49.610921+0000","last_change":"2024-09-12T17:41:49.610921+0000","last_active":"2024-09-12T17:41:49.610921+0000","last_peered":"2024-09-12T17:41:49.610921+0000","last_clean":"2024-09-12T17:41:49.610921+0000","last_became_active":"2024-09-12T16:58:18.698280+0000","last_became_peered":"2024-09-12T16:58:18.698280+0000","last_unstale":"2024-09-12T17:41:49.610921+0000","last_undegraded":"2024-09-12T17:41:49.610921+0000","last_fullsized":"2024-09-12T17:41:49.610921+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'397","last_scrub_stamp":"2024-09-12T17:41:49.610656+0000","last_deep_scrub":"265'397","last_deep_scrub_stamp":"2024-09-12T17:41:49.610656+0000","last_clean_scrub_stamp":"2024-09-12T17:41:49.610656+0000","objects_scrubbed":11,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:39.785159+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8651850,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":594,"num_read_kb":25091,"num_write":1290,"num_write_kb":36260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"265'157","reported_seq":769,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:58.628960+0000","last_change":"2024-09-12T17:41:58.628784+0000","last_active":"2024-09-12T17:41:58.628960+0000","last_peered":"2024-09-12T17:41:58.628960+0000","last_clean":"2024-09-12T17:41:58.628960+0000","last_became_active":"2024-09-12T16:58:21.706493+0000","last_became_peered":"2024-09-12T16:58:21.706493+0000","last_unstale":"2024-09-12T17:41:58.628960+0000","last_undegraded":"2024-09-12T17:41:58.628960+0000","last_fullsized":"2024-09-12T17:41:58.628960+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'157","last_scrub_stamp":"2024-09-12T17:41:58.628606+0000","last_deep_scrub":"265'157","last_deep_scrub_stamp":"2024-09-12T17:41:58.628606+0000","last_clean_scrub_stamp":"2024-09-12T17:41:58.628606+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:25.437543+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":697,"num_read_kb":578,"num_write":245,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"265'335","reported_seq":1001,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:53.613886+0000","last_change":"2024-09-12T17:41:53.613886+0000","last_active":"2024-09-12T17:41:53.613886+0000","last_peered":"2024-09-12T17:41:53.613886+0000","last_clean":"2024-09-12T17:41:53.613886+0000","last_became_active":"2024-09-12T16:58:18.694357+0000","last_became_peered":"2024-09-12T16:58:18.694357+0000","last_unstale":"2024-09-12T17:41:53.613886+0000","last_undegraded":"2024-09-12T17:41:53.613886+0000","last_fullsized":"2024-09-12T17:41:53.613886+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'335","last_scrub_stamp":"2024-09-12T17:41:53.613673+0000","last_deep_scrub":"265'335","last_deep_scrub_stamp":"2024-09-12T17:41:53.613673+0000","last_clean_scrub_stamp":"2024-09-12T17:41:53.613673+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:18.786062+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":485,"num_read_kb":76108,"num_write":1068,"num_write_kb":48403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"265'76","reported_seq":662,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:58.572144+0000","last_change":"2024-09-12T17:41:58.571844+0000","last_active":"2024-09-12T17:41:58.572144+0000","last_peered":"2024-09-12T17:41:58.572144+0000","last_clean":"2024-09-12T17:41:58.572144+0000","last_became_active":"2024-09-12T16:58:21.723077+0000","last_became_peered":"2024-09-12T16:58:21.723077+0000","last_unstale":"2024-09-12T17:41:58.572144+0000","last_undegraded":"2024-09-12T17:41:58.572144+0000","last_fullsized":"2024-09-12T17:41:58.572144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'76","last_scrub_stamp":"2024-09-12T17:41:58.571628+0000","last_deep_scrub":"265'76","last_deep_scrub_stamp":"2024-09-12T17:41:58.571628+0000","last_clean_scrub_stamp":"2024-09-12T17:41:58.571628+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:40.655917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":363,"num_read_kb":315,"num_write":111,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"265'311","reported_seq":928,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:44.698572+0000","last_change":"2024-09-12T17:41:44.698572+0000","last_active":"2024-09-12T17:41:44.698572+0000","last_peered":"2024-09-12T17:41:44.698572+0000","last_clean":"2024-09-12T17:41:44.698572+0000","last_became_active":"2024-09-12T16:58:18.701590+0000","last_became_peered":"2024-09-12T16:58:18.701590+0000","last_unstale":"2024-09-12T17:41:44.698572+0000","last_undegraded":"2024-09-12T17:41:44.698572+0000","last_fullsized":"2024-09-12T17:41:44.698572+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'311","last_scrub_stamp":"2024-09-12T17:41:44.698375+0000","last_deep_scrub":"265'311","last_deep_scrub_stamp":"2024-09-12T17:41:44.698375+0000","last_clean_scrub_stamp":"2024-09-12T17:41:44.698375+0000","objects_scrubbed":6,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:04.975023+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":399,"num_read_kb":1374,"num_write":924,"num_write_kb":18073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"265'138","reported_seq":748,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:46.474613+0000","last_change":"2024-09-12T17:41:46.474441+0000","last_active":"2024-09-12T17:41:46.474613+0000","last_peered":"2024-09-12T17:41:46.474613+0000","last_clean":"2024-09-12T17:41:46.474613+0000","last_became_active":"2024-09-12T16:58:21.718167+0000","last_became_peered":"2024-09-12T16:58:21.718167+0000","last_unstale":"2024-09-12T17:41:46.474613+0000","last_undegraded":"2024-09-12T17:41:46.474613+0000","last_fullsized":"2024-09-12T17:41:46.474613+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'138","last_scrub_stamp":"2024-09-12T17:41:46.474256+0000","last_deep_scrub":"265'138","last_deep_scrub_stamp":"2024-09-12T17:41:46.474256+0000","last_clean_scrub_stamp":"2024-09-12T17:41:46.474256+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:54.299670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":612,"num_read_kb":510,"num_write":201,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"265'4235","reported_seq":4894,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:56.655831+0000","last_change":"2024-09-12T17:41:56.655702+0000","last_active":"2024-09-12T17:41:56.655831+0000","last_peered":"2024-09-12T17:41:56.655831+0000","last_clean":"2024-09-12T17:41:56.655831+0000","last_became_active":"2024-09-12T16:58:21.697479+0000","last_became_peered":"2024-09-12T16:58:21.697479+0000","last_unstale":"2024-09-12T17:41:56.655831+0000","last_undegraded":"2024-09-12T17:41:56.655831+0000","last_fullsized":"2024-09-12T17:41:56.655831+0000","mapping_epoch":26,"log_start":"265'4200","ondisk_log_start":"265'4200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4235","last_scrub_stamp":"2024-09-12T17:41:56.655505+0000","last_deep_scrub":"265'4235","last_deep_scrub_stamp":"2024-09-12T17:41:56.655505+0000","last_clean_scrub_stamp":"2024-09-12T17:41:56.655505+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":3000,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:42.994552+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17044,"num_read_kb":14289,"num_write":6359,"num_write_kb":3183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"265'324","reported_seq":957,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:46.504232+0000","last_change":"2024-09-12T17:41:46.504070+0000","last_active":"2024-09-12T17:41:46.504232+0000","last_peered":"2024-09-12T17:41:46.504232+0000","last_clean":"2024-09-12T17:41:46.504232+0000","last_became_active":"2024-09-12T16:58:18.713739+0000","last_became_peered":"2024-09-12T16:58:18.713739+0000","last_unstale":"2024-09-12T17:41:46.504232+0000","last_undegraded":"2024-09-12T17:41:46.504232+0000","last_fullsized":"2024-09-12T17:41:46.504232+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'324","last_scrub_stamp":"2024-09-12T17:41:46.503833+0000","last_deep_scrub":"265'324","last_deep_scrub_stamp":"2024-09-12T17:41:46.503833+0000","last_clean_scrub_stamp":"2024-09-12T17:41:46.503833+0000","objects_scrubbed":7,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:49.063988+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":436,"num_read_kb":10222,"num_write":964,"num_write_kb":31220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"265'294","reported_seq":1015,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:55.651633+0000","last_change":"2024-09-12T17:41:55.651444+0000","last_active":"2024-09-12T17:41:55.651633+0000","last_peered":"2024-09-12T17:41:55.651633+0000","last_clean":"2024-09-12T17:41:55.651633+0000","last_became_active":"2024-09-12T16:58:21.723238+0000","last_became_peered":"2024-09-12T16:58:21.723238+0000","last_unstale":"2024-09-12T17:41:55.651633+0000","last_undegraded":"2024-09-12T17:41:55.651633+0000","last_fullsized":"2024-09-12T17:41:55.651633+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'294","last_scrub_stamp":"2024-09-12T17:41:55.651276+0000","last_deep_scrub":"265'294","last_deep_scrub_stamp":"2024-09-12T17:41:55.651276+0000","last_clean_scrub_stamp":"2024-09-12T17:41:55.651276+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:24.004372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1552,"num_read_kb":1372,"num_write":472,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"265'347","reported_seq":968,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:50.456694+0000","last_change":"2024-09-12T17:41:50.456526+0000","last_active":"2024-09-12T17:41:50.456694+0000","last_peered":"2024-09-12T17:41:50.456694+0000","last_clean":"2024-09-12T17:41:50.456694+0000","last_became_active":"2024-09-12T16:58:18.701989+0000","last_became_peered":"2024-09-12T16:58:18.701989+0000","last_unstale":"2024-09-12T17:41:50.456694+0000","last_undegraded":"2024-09-12T17:41:50.456694+0000","last_fullsized":"2024-09-12T17:41:50.456694+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'347","last_scrub_stamp":"2024-09-12T17:41:50.456302+0000","last_deep_scrub":"265'347","last_deep_scrub_stamp":"2024-09-12T17:41:50.456302+0000","last_clean_scrub_stamp":"2024-09-12T17:41:50.456302+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:22.993882+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1343103,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":443,"num_read_kb":5557,"num_write":1028,"num_write_kb":22464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"265'183","reported_seq":800,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:55.659604+0000","last_change":"2024-09-12T17:41:55.659451+0000","last_active":"2024-09-12T17:41:55.659604+0000","last_peered":"2024-09-12T17:41:55.659604+0000","last_clean":"2024-09-12T17:41:55.659604+0000","last_became_active":"2024-09-12T16:58:21.715289+0000","last_became_peered":"2024-09-12T16:58:21.715289+0000","last_unstale":"2024-09-12T17:41:55.659604+0000","last_undegraded":"2024-09-12T17:41:55.659604+0000","last_fullsized":"2024-09-12T17:41:55.659604+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'183","last_scrub_stamp":"2024-09-12T17:41:55.659266+0000","last_deep_scrub":"265'183","last_deep_scrub_stamp":"2024-09-12T17:41:55.659266+0000","last_clean_scrub_stamp":"2024-09-12T17:41:55.659266+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:00.448540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":782,"num_read_kb":649,"num_write":263,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"265'373","reported_seq":1055,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:44.497882+0000","last_change":"2024-09-12T17:41:44.497703+0000","last_active":"2024-09-12T17:41:44.497882+0000","last_peered":"2024-09-12T17:41:44.497882+0000","last_clean":"2024-09-12T17:41:44.497882+0000","last_became_active":"2024-09-12T16:58:18.702185+0000","last_became_peered":"2024-09-12T16:58:18.702185+0000","last_unstale":"2024-09-12T17:41:44.497882+0000","last_undegraded":"2024-09-12T17:41:44.497882+0000","last_fullsized":"2024-09-12T17:41:44.497882+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'373","last_scrub_stamp":"2024-09-12T17:41:44.497473+0000","last_deep_scrub":"265'373","last_deep_scrub_stamp":"2024-09-12T17:41:44.497473+0000","last_clean_scrub_stamp":"2024-09-12T17:41:44.497473+0000","objects_scrubbed":3,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:41.714848+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306656,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":591,"num_read_kb":49223,"num_write":1212,"num_write_kb":37016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"265'189","reported_seq":830,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:44.508406+0000","last_change":"2024-09-12T17:41:44.508120+0000","last_active":"2024-09-12T17:41:44.508406+0000","last_peered":"2024-09-12T17:41:44.508406+0000","last_clean":"2024-09-12T17:41:44.508406+0000","last_became_active":"2024-09-12T16:58:21.718158+0000","last_became_peered":"2024-09-12T16:58:21.718158+0000","last_unstale":"2024-09-12T17:41:44.508406+0000","last_undegraded":"2024-09-12T17:41:44.508406+0000","last_fullsized":"2024-09-12T17:41:44.508406+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'189","last_scrub_stamp":"2024-09-12T17:41:44.507884+0000","last_deep_scrub":"265'189","last_deep_scrub_stamp":"2024-09-12T17:41:44.507884+0000","last_clean_scrub_stamp":"2024-09-12T17:41:44.507884+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:21.650280+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":878,"num_read_kb":727,"num_write":304,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"265'358","reported_seq":1104,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:42.627771+0000","last_change":"2024-09-12T17:41:42.627593+0000","last_active":"2024-09-12T17:41:42.627771+0000","last_peered":"2024-09-12T17:41:42.627771+0000","last_clean":"2024-09-12T17:41:42.627771+0000","last_became_active":"2024-09-12T16:58:18.699360+0000","last_became_peered":"2024-09-12T16:58:18.699360+0000","last_unstale":"2024-09-12T17:41:42.627771+0000","last_undegraded":"2024-09-12T17:41:42.627771+0000","last_fullsized":"2024-09-12T17:41:42.627771+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'358","last_scrub_stamp":"2024-09-12T17:41:42.627381+0000","last_deep_scrub":"265'358","last_deep_scrub_stamp":"2024-09-12T17:41:42.627381+0000","last_clean_scrub_stamp":"2024-09-12T17:41:42.627381+0000","objects_scrubbed":5,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:07.285273+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":626,"num_read_kb":143204,"num_write":1063,"num_write_kb":36082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"265'136","reported_seq":774,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:51.542065+0000","last_change":"2024-09-12T17:41:51.541908+0000","last_active":"2024-09-12T17:41:51.542065+0000","last_peered":"2024-09-12T17:41:51.542065+0000","last_clean":"2024-09-12T17:41:51.542065+0000","last_became_active":"2024-09-12T16:58:21.728321+0000","last_became_peered":"2024-09-12T16:58:21.728321+0000","last_unstale":"2024-09-12T17:41:51.542065+0000","last_undegraded":"2024-09-12T17:41:51.542065+0000","last_fullsized":"2024-09-12T17:41:51.542065+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'136","last_scrub_stamp":"2024-09-12T17:41:51.541730+0000","last_deep_scrub":"265'136","last_deep_scrub_stamp":"2024-09-12T17:41:51.541730+0000","last_clean_scrub_stamp":"2024-09-12T17:41:51.541730+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:58.375721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":636,"num_read_kb":537,"num_write":197,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"265'322","reported_seq":943,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:48.598113+0000","last_change":"2024-09-12T17:41:48.597965+0000","last_active":"2024-09-12T17:41:48.598113+0000","last_peered":"2024-09-12T17:41:48.598113+0000","last_clean":"2024-09-12T17:41:48.598113+0000","last_became_active":"2024-09-12T16:58:18.690634+0000","last_became_peered":"2024-09-12T16:58:18.690634+0000","last_unstale":"2024-09-12T17:41:48.598113+0000","last_undegraded":"2024-09-12T17:41:48.598113+0000","last_fullsized":"2024-09-12T17:41:48.598113+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'322","last_scrub_stamp":"2024-09-12T17:41:48.597755+0000","last_deep_scrub":"265'322","last_deep_scrub_stamp":"2024-09-12T17:41:48.597755+0000","last_clean_scrub_stamp":"2024-09-12T17:41:48.597755+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:42.047491+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159799,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":394,"num_read_kb":27088,"num_write":949,"num_write_kb":25947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"265'299","reported_seq":906,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:57.673364+0000","last_change":"2024-09-12T17:41:57.673364+0000","last_active":"2024-09-12T17:41:57.673364+0000","last_peered":"2024-09-12T17:41:57.673364+0000","last_clean":"2024-09-12T17:41:57.673364+0000","last_became_active":"2024-09-12T16:58:21.702643+0000","last_became_peered":"2024-09-12T16:58:21.702643+0000","last_unstale":"2024-09-12T17:41:57.673364+0000","last_undegraded":"2024-09-12T17:41:57.673364+0000","last_fullsized":"2024-09-12T17:41:57.673364+0000","mapping_epoch":26,"log_start":"262'200","ondisk_log_start":"262'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'299","last_scrub_stamp":"2024-09-12T17:41:57.673176+0000","last_deep_scrub":"265'299","last_deep_scrub_stamp":"2024-09-12T17:41:57.673176+0000","last_clean_scrub_stamp":"2024-09-12T17:41:57.673176+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:49.957041+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1307,"num_read_kb":1045,"num_write":505,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"265'347","reported_seq":1108,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:44.276099+0000","last_change":"2024-09-12T17:41:44.275966+0000","last_active":"2024-09-12T17:41:44.276099+0000","last_peered":"2024-09-12T17:41:44.276099+0000","last_clean":"2024-09-12T17:41:44.276099+0000","last_became_active":"2024-09-12T16:58:18.702310+0000","last_became_peered":"2024-09-12T16:58:18.702310+0000","last_unstale":"2024-09-12T17:41:44.276099+0000","last_undegraded":"2024-09-12T17:41:44.276099+0000","last_fullsized":"2024-09-12T17:41:44.276099+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'347","last_scrub_stamp":"2024-09-12T17:41:44.275743+0000","last_deep_scrub":"265'347","last_deep_scrub_stamp":"2024-09-12T17:41:44.275743+0000","last_clean_scrub_stamp":"2024-09-12T17:41:44.275743+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:46.939621+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":950476,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":583,"num_read_kb":31842,"num_write":1061,"num_write_kb":30837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"265'156","reported_seq":673,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:20.662572+0000","last_change":"2024-09-12T17:42:20.662572+0000","last_active":"2024-09-12T17:42:20.662572+0000","last_peered":"2024-09-12T17:42:20.662572+0000","last_clean":"2024-09-12T17:42:20.662572+0000","last_became_active":"2024-09-12T16:58:29.792043+0000","last_became_peered":"2024-09-12T16:58:29.792043+0000","last_unstale":"2024-09-12T17:42:20.662572+0000","last_undegraded":"2024-09-12T17:42:20.662572+0000","last_fullsized":"2024-09-12T17:42:20.662572+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'156","last_scrub_stamp":"2024-09-12T17:42:20.662386+0000","last_deep_scrub":"265'156","last_deep_scrub_stamp":"2024-09-12T17:42:20.662386+0000","last_clean_scrub_stamp":"2024-09-12T17:42:20.662386+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:18.127401+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":230,"num_read_kb":220,"num_write":374,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"265'102","reported_seq":695,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:50.519894+0000","last_change":"2024-09-12T17:41:50.519732+0000","last_active":"2024-09-12T17:41:50.519894+0000","last_peered":"2024-09-12T17:41:50.519894+0000","last_clean":"2024-09-12T17:41:50.519894+0000","last_became_active":"2024-09-12T16:58:21.707428+0000","last_became_peered":"2024-09-12T16:58:21.707428+0000","last_unstale":"2024-09-12T17:41:50.519894+0000","last_undegraded":"2024-09-12T17:41:50.519894+0000","last_fullsized":"2024-09-12T17:41:50.519894+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'102","last_scrub_stamp":"2024-09-12T17:41:50.519549+0000","last_deep_scrub":"265'102","last_deep_scrub_stamp":"2024-09-12T17:41:50.519549+0000","last_clean_scrub_stamp":"2024-09-12T17:41:50.519549+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:07.630997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":440,"num_read_kb":374,"num_write":161,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"265'380","reported_seq":1042,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:45.520407+0000","last_change":"2024-09-12T17:41:45.520248+0000","last_active":"2024-09-12T17:41:45.520407+0000","last_peered":"2024-09-12T17:41:45.520407+0000","last_clean":"2024-09-12T17:41:45.520407+0000","last_became_active":"2024-09-12T16:58:18.714782+0000","last_became_peered":"2024-09-12T16:58:18.714782+0000","last_unstale":"2024-09-12T17:41:45.520407+0000","last_undegraded":"2024-09-12T17:41:45.520407+0000","last_fullsized":"2024-09-12T17:41:45.520407+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'380","last_scrub_stamp":"2024-09-12T17:41:45.520059+0000","last_deep_scrub":"265'380","last_deep_scrub_stamp":"2024-09-12T17:41:45.520059+0000","last_clean_scrub_stamp":"2024-09-12T17:41:45.520059+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:52.748711+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194316,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":558,"num_read_kb":18943,"num_write":1229,"num_write_kb":58984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:01.658167+0000","last_change":"2024-09-12T17:42:01.658167+0000","last_active":"2024-09-12T17:42:01.658167+0000","last_peered":"2024-09-12T17:42:01.658167+0000","last_clean":"2024-09-12T17:42:01.658167+0000","last_became_active":"2024-09-12T16:58:23.712621+0000","last_became_peered":"2024-09-12T16:58:23.712621+0000","last_unstale":"2024-09-12T17:42:01.658167+0000","last_undegraded":"2024-09-12T17:42:01.658167+0000","last_fullsized":"2024-09-12T17:42:01.658167+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:01.657990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:01.657990+0000","last_clean_scrub_stamp":"2024-09-12T17:42:01.657990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:51.018117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"265'342","reported_seq":949,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:03.866073+0000","last_change":"2024-09-12T17:42:03.866073+0000","last_active":"2024-09-12T17:42:03.866073+0000","last_peered":"2024-09-12T17:42:03.866073+0000","last_clean":"2024-09-12T17:42:03.866073+0000","last_became_active":"2024-09-12T16:58:25.728901+0000","last_became_peered":"2024-09-12T16:58:25.728901+0000","last_unstale":"2024-09-12T17:42:03.866073+0000","last_undegraded":"2024-09-12T17:42:03.866073+0000","last_fullsized":"2024-09-12T17:42:03.866073+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'342","last_scrub_stamp":"2024-09-12T17:42:03.865859+0000","last_deep_scrub":"265'342","last_deep_scrub_stamp":"2024-09-12T17:42:03.865859+0000","last_clean_scrub_stamp":"2024-09-12T17:42:03.865859+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:35.413458+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46434,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":549,"num_read_kb":1164,"num_write":438,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:10.679527+0000","last_change":"2024-09-12T17:42:10.679527+0000","last_active":"2024-09-12T17:42:10.679527+0000","last_peered":"2024-09-12T17:42:10.679527+0000","last_clean":"2024-09-12T17:42:10.679527+0000","last_became_active":"2024-09-12T16:58:27.752315+0000","last_became_peered":"2024-09-12T16:58:27.752315+0000","last_unstale":"2024-09-12T17:42:10.679527+0000","last_undegraded":"2024-09-12T17:42:10.679527+0000","last_fullsized":"2024-09-12T17:42:10.679527+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:10.679345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:10.679345+0000","last_clean_scrub_stamp":"2024-09-12T17:42:10.679345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:51.638492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"265'129","reported_seq":687,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:14.627941+0000","last_change":"2024-09-12T17:42:14.627941+0000","last_active":"2024-09-12T17:42:14.627941+0000","last_peered":"2024-09-12T17:42:14.627941+0000","last_clean":"2024-09-12T17:42:14.627941+0000","last_became_active":"2024-09-12T16:58:29.773874+0000","last_became_peered":"2024-09-12T16:58:29.773874+0000","last_unstale":"2024-09-12T17:42:14.627941+0000","last_undegraded":"2024-09-12T17:42:14.627941+0000","last_fullsized":"2024-09-12T17:42:14.627941+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'129","last_scrub_stamp":"2024-09-12T17:42:14.627593+0000","last_deep_scrub":"265'129","last_deep_scrub_stamp":"2024-09-12T17:42:14.627593+0000","last_clean_scrub_stamp":"2024-09-12T17:42:14.627593+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:44.736299+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":191,"num_read_kb":190,"num_write":216,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"265'402","reported_seq":1061,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:52.691279+0000","last_change":"2024-09-12T17:41:52.691279+0000","last_active":"2024-09-12T17:41:52.691279+0000","last_peered":"2024-09-12T17:41:52.691279+0000","last_clean":"2024-09-12T17:41:52.691279+0000","last_became_active":"2024-09-12T16:58:21.717806+0000","last_became_peered":"2024-09-12T16:58:21.717806+0000","last_unstale":"2024-09-12T17:41:52.691279+0000","last_undegraded":"2024-09-12T17:41:52.691279+0000","last_fullsized":"2024-09-12T17:41:52.691279+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'402","last_scrub_stamp":"2024-09-12T17:41:52.691089+0000","last_deep_scrub":"265'402","last_deep_scrub_stamp":"2024-09-12T17:41:52.691089+0000","last_clean_scrub_stamp":"2024-09-12T17:41:52.691089+0000","objects_scrubbed":2,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:57.508897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1815,"num_read_kb":1449,"num_write":653,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4270,"num_omap_keys":19,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"265'351","reported_seq":1046,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:41.315352+0000","last_change":"2024-09-12T17:41:41.315205+0000","last_active":"2024-09-12T17:41:41.315352+0000","last_peered":"2024-09-12T17:41:41.315352+0000","last_clean":"2024-09-12T17:41:41.315352+0000","last_became_active":"2024-09-12T16:58:18.691335+0000","last_became_peered":"2024-09-12T16:58:18.691335+0000","last_unstale":"2024-09-12T17:41:41.315352+0000","last_undegraded":"2024-09-12T17:41:41.315352+0000","last_fullsized":"2024-09-12T17:41:41.315352+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'351","last_scrub_stamp":"2024-09-12T17:41:41.314984+0000","last_deep_scrub":"265'351","last_deep_scrub_stamp":"2024-09-12T17:41:41.314984+0000","last_clean_scrub_stamp":"2024-09-12T17:41:41.314984+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:10.989680+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1278687,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":548,"num_read_kb":106559,"num_write":1101,"num_write_kb":67871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:56.476793+0000","last_change":"2024-09-12T17:41:56.476590+0000","last_active":"2024-09-12T17:41:56.476793+0000","last_peered":"2024-09-12T17:41:56.476793+0000","last_clean":"2024-09-12T17:41:56.476793+0000","last_became_active":"2024-09-12T16:58:23.718656+0000","last_became_peered":"2024-09-12T16:58:23.718656+0000","last_unstale":"2024-09-12T17:41:56.476793+0000","last_undegraded":"2024-09-12T17:41:56.476793+0000","last_fullsized":"2024-09-12T17:41:56.476793+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:56.476408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:56.476408+0000","last_clean_scrub_stamp":"2024-09-12T17:41:56.476408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:17.560169+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"265'103","reported_seq":634,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:05.645255+0000","last_change":"2024-09-12T17:42:05.645255+0000","last_active":"2024-09-12T17:42:05.645255+0000","last_peered":"2024-09-12T17:42:05.645255+0000","last_clean":"2024-09-12T17:42:05.645255+0000","last_became_active":"2024-09-12T16:58:25.713567+0000","last_became_peered":"2024-09-12T16:58:25.713567+0000","last_unstale":"2024-09-12T17:42:05.645255+0000","last_undegraded":"2024-09-12T17:42:05.645255+0000","last_fullsized":"2024-09-12T17:42:05.645255+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'103","last_scrub_stamp":"2024-09-12T17:42:05.645063+0000","last_deep_scrub":"265'103","last_deep_scrub_stamp":"2024-09-12T17:42:05.645063+0000","last_clean_scrub_stamp":"2024-09-12T17:42:05.645063+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:09.908392+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":95,"num_read_kb":90,"num_write":66,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:09.612352+0000","last_change":"2024-09-12T17:42:09.612352+0000","last_active":"2024-09-12T17:42:09.612352+0000","last_peered":"2024-09-12T17:42:09.612352+0000","last_clean":"2024-09-12T17:42:09.612352+0000","last_became_active":"2024-09-12T16:58:27.728276+0000","last_became_peered":"2024-09-12T16:58:27.728276+0000","last_unstale":"2024-09-12T17:42:09.612352+0000","last_undegraded":"2024-09-12T17:42:09.612352+0000","last_fullsized":"2024-09-12T17:42:09.612352+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:09.612169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:09.612169+0000","last_clean_scrub_stamp":"2024-09-12T17:42:09.612169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:17.864461+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"265'129","reported_seq":642,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:11.981999+0000","last_change":"2024-09-12T17:42:11.981999+0000","last_active":"2024-09-12T17:42:11.981999+0000","last_peered":"2024-09-12T17:42:11.981999+0000","last_clean":"2024-09-12T17:42:11.981999+0000","last_became_active":"2024-09-12T16:58:29.780598+0000","last_became_peered":"2024-09-12T16:58:29.780598+0000","last_unstale":"2024-09-12T17:42:11.981999+0000","last_undegraded":"2024-09-12T17:42:11.981999+0000","last_fullsized":"2024-09-12T17:42:11.981999+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'129","last_scrub_stamp":"2024-09-12T17:42:11.981812+0000","last_deep_scrub":"265'129","last_deep_scrub_stamp":"2024-09-12T17:42:11.981812+0000","last_clean_scrub_stamp":"2024-09-12T17:42:11.981812+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:04.450209+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":203,"num_read_kb":191,"num_write":301,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"265'80","reported_seq":651,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:50.080879+0000","last_change":"2024-09-12T17:41:50.080720+0000","last_active":"2024-09-12T17:41:50.080879+0000","last_peered":"2024-09-12T17:41:50.080879+0000","last_clean":"2024-09-12T17:41:50.080879+0000","last_became_active":"2024-09-12T16:58:21.718773+0000","last_became_peered":"2024-09-12T16:58:21.718773+0000","last_unstale":"2024-09-12T17:41:50.080879+0000","last_undegraded":"2024-09-12T17:41:50.080879+0000","last_fullsized":"2024-09-12T17:41:50.080879+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'80","last_scrub_stamp":"2024-09-12T17:41:50.080528+0000","last_deep_scrub":"265'80","last_deep_scrub_stamp":"2024-09-12T17:41:50.080528+0000","last_clean_scrub_stamp":"2024-09-12T17:41:50.080528+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:21.460279+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":373,"num_read_kb":312,"num_write":123,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"265'334","reported_seq":933,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:47.460517+0000","last_change":"2024-09-12T17:41:47.460517+0000","last_active":"2024-09-12T17:41:47.460517+0000","last_peered":"2024-09-12T17:41:47.460517+0000","last_clean":"2024-09-12T17:41:47.460517+0000","last_became_active":"2024-09-12T16:58:55.843826+0000","last_became_peered":"2024-09-12T16:58:55.843826+0000","last_unstale":"2024-09-12T17:41:47.460517+0000","last_undegraded":"2024-09-12T17:41:47.460517+0000","last_fullsized":"2024-09-12T17:41:47.460517+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'334","last_scrub_stamp":"2024-09-12T17:41:47.460291+0000","last_deep_scrub":"265'334","last_deep_scrub_stamp":"2024-09-12T17:41:47.460291+0000","last_clean_scrub_stamp":"2024-09-12T17:41:47.460291+0000","objects_scrubbed":6,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:13.714567+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263214,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":424,"num_read_kb":4809,"num_write":985,"num_write_kb":23718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:59.482339+0000","last_change":"2024-09-12T17:41:59.482339+0000","last_active":"2024-09-12T17:41:59.482339+0000","last_peered":"2024-09-12T17:41:59.482339+0000","last_clean":"2024-09-12T17:41:59.482339+0000","last_became_active":"2024-09-12T16:58:23.706953+0000","last_became_peered":"2024-09-12T16:58:23.706953+0000","last_unstale":"2024-09-12T17:41:59.482339+0000","last_undegraded":"2024-09-12T17:41:59.482339+0000","last_fullsized":"2024-09-12T17:41:59.482339+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:59.482154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:59.482154+0000","last_clean_scrub_stamp":"2024-09-12T17:41:59.482154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:45.005327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"265'110","reported_seq":652,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:56.601021+0000","last_change":"2024-09-12T17:41:56.600727+0000","last_active":"2024-09-12T17:41:56.601021+0000","last_peered":"2024-09-12T17:41:56.601021+0000","last_clean":"2024-09-12T17:41:56.601021+0000","last_became_active":"2024-09-12T16:58:25.713213+0000","last_became_peered":"2024-09-12T16:58:25.713213+0000","last_unstale":"2024-09-12T17:41:56.601021+0000","last_undegraded":"2024-09-12T17:41:56.601021+0000","last_fullsized":"2024-09-12T17:41:56.601021+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'110","last_scrub_stamp":"2024-09-12T17:41:56.600505+0000","last_deep_scrub":"265'110","last_deep_scrub_stamp":"2024-09-12T17:41:56.600505+0000","last_clean_scrub_stamp":"2024-09-12T17:41:56.600505+0000","objects_scrubbed":5,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:20.949800+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":116,"num_write":82,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"265'771","reported_seq":4632,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:09.687832+0000","last_change":"2024-09-12T17:42:09.687832+0000","last_active":"2024-09-12T17:42:09.687832+0000","last_peered":"2024-09-12T17:42:09.687832+0000","last_clean":"2024-09-12T17:42:09.687832+0000","last_became_active":"2024-09-12T16:58:27.752801+0000","last_became_peered":"2024-09-12T16:58:27.752801+0000","last_unstale":"2024-09-12T17:42:09.687832+0000","last_undegraded":"2024-09-12T17:42:09.687832+0000","last_fullsized":"2024-09-12T17:42:09.687832+0000","mapping_epoch":32,"log_start":"265'702","ondisk_log_start":"265'702","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'771","last_scrub_stamp":"2024-09-12T17:42:09.687648+0000","last_deep_scrub":"265'771","last_deep_scrub_stamp":"2024-09-12T17:42:09.687648+0000","last_clean_scrub_stamp":"2024-09-12T17:42:09.687648+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":702,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:16.370450+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"265'206","reported_seq":1032,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:12.572728+0000","last_change":"2024-09-12T17:42:12.572728+0000","last_active":"2024-09-12T17:42:12.572728+0000","last_peered":"2024-09-12T17:42:12.572728+0000","last_clean":"2024-09-12T17:42:12.572728+0000","last_became_active":"2024-09-12T16:58:29.769351+0000","last_became_peered":"2024-09-12T16:58:29.769351+0000","last_unstale":"2024-09-12T17:42:12.572728+0000","last_undegraded":"2024-09-12T17:42:12.572728+0000","last_fullsized":"2024-09-12T17:42:12.572728+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'206","last_scrub_stamp":"2024-09-12T17:42:12.572544+0000","last_deep_scrub":"265'206","last_deep_scrub_stamp":"2024-09-12T17:42:12.572544+0000","last_clean_scrub_stamp":"2024-09-12T17:42:12.572544+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:55.304646+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":633,"num_read_kb":631,"num_write":454,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"265'164","reported_seq":762,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:49.549548+0000","last_change":"2024-09-12T17:41:49.549407+0000","last_active":"2024-09-12T17:41:49.549548+0000","last_peered":"2024-09-12T17:41:49.549548+0000","last_clean":"2024-09-12T17:41:49.549548+0000","last_became_active":"2024-09-12T16:58:21.710646+0000","last_became_peered":"2024-09-12T16:58:21.710646+0000","last_unstale":"2024-09-12T17:41:49.549548+0000","last_undegraded":"2024-09-12T17:41:49.549548+0000","last_fullsized":"2024-09-12T17:41:49.549548+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'164","last_scrub_stamp":"2024-09-12T17:41:49.549228+0000","last_deep_scrub":"265'164","last_deep_scrub_stamp":"2024-09-12T17:41:49.549228+0000","last_clean_scrub_stamp":"2024-09-12T17:41:49.549228+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:48.619499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":698,"num_read_kb":573,"num_write":260,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"265'344","reported_seq":978,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:40.452986+0000","last_change":"2024-09-12T17:41:40.452831+0000","last_active":"2024-09-12T17:41:40.452986+0000","last_peered":"2024-09-12T17:41:40.452986+0000","last_clean":"2024-09-12T17:41:40.452986+0000","last_became_active":"2024-09-12T16:58:18.689915+0000","last_became_peered":"2024-09-12T16:58:18.689915+0000","last_unstale":"2024-09-12T17:41:40.452986+0000","last_undegraded":"2024-09-12T17:41:40.452986+0000","last_fullsized":"2024-09-12T17:41:40.452986+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'344","last_scrub_stamp":"2024-09-12T17:41:40.452621+0000","last_deep_scrub":"265'344","last_deep_scrub_stamp":"2024-09-12T17:41:40.452621+0000","last_clean_scrub_stamp":"2024-09-12T17:41:40.452621+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:57.294233+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388626,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":434,"num_read_kb":42593,"num_write":1103,"num_write_kb":36991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:02.632507+0000","last_change":"2024-09-12T17:42:02.632507+0000","last_active":"2024-09-12T17:42:02.632507+0000","last_peered":"2024-09-12T17:42:02.632507+0000","last_clean":"2024-09-12T17:42:02.632507+0000","last_became_active":"2024-09-12T16:58:23.697159+0000","last_became_peered":"2024-09-12T16:58:23.697159+0000","last_unstale":"2024-09-12T17:42:02.632507+0000","last_undegraded":"2024-09-12T17:42:02.632507+0000","last_fullsized":"2024-09-12T17:42:02.632507+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:02.632329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:02.632329+0000","last_clean_scrub_stamp":"2024-09-12T17:42:02.632329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:42.457952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"265'252","reported_seq":827,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:03.774177+0000","last_change":"2024-09-12T17:42:03.774177+0000","last_active":"2024-09-12T17:42:03.774177+0000","last_peered":"2024-09-12T17:42:03.774177+0000","last_clean":"2024-09-12T17:42:03.774177+0000","last_became_active":"2024-09-12T16:58:25.949179+0000","last_became_peered":"2024-09-12T16:58:25.949179+0000","last_unstale":"2024-09-12T17:42:03.774177+0000","last_undegraded":"2024-09-12T17:42:03.774177+0000","last_fullsized":"2024-09-12T17:42:03.774177+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'252","last_scrub_stamp":"2024-09-12T17:42:03.773982+0000","last_deep_scrub":"265'252","last_deep_scrub_stamp":"2024-09-12T17:42:03.773982+0000","last_clean_scrub_stamp":"2024-09-12T17:42:03.773982+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:42.695827+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43414,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":422,"num_read_kb":981,"num_write":340,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"265'786","reported_seq":2109,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:11.570929+0000","last_change":"2024-09-12T17:42:11.570731+0000","last_active":"2024-09-12T17:42:11.570929+0000","last_peered":"2024-09-12T17:42:11.570929+0000","last_clean":"2024-09-12T17:42:11.570929+0000","last_became_active":"2024-09-12T16:58:27.745988+0000","last_became_peered":"2024-09-12T16:58:27.745988+0000","last_unstale":"2024-09-12T17:42:11.570929+0000","last_undegraded":"2024-09-12T17:42:11.570929+0000","last_fullsized":"2024-09-12T17:42:11.570929+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'786","last_scrub_stamp":"2024-09-12T17:42:11.570546+0000","last_deep_scrub":"265'786","last_deep_scrub_stamp":"2024-09-12T17:42:11.570546+0000","last_clean_scrub_stamp":"2024-09-12T17:42:11.570546+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:17.461259+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"265'150","reported_seq":729,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:53.700294+0000","last_change":"2024-09-12T17:41:53.700294+0000","last_active":"2024-09-12T17:41:53.700294+0000","last_peered":"2024-09-12T17:41:53.700294+0000","last_clean":"2024-09-12T17:41:53.700294+0000","last_became_active":"2024-09-12T16:58:21.710029+0000","last_became_peered":"2024-09-12T16:58:21.710029+0000","last_unstale":"2024-09-12T17:41:53.700294+0000","last_undegraded":"2024-09-12T17:41:53.700294+0000","last_fullsized":"2024-09-12T17:41:53.700294+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'150","last_scrub_stamp":"2024-09-12T17:41:53.700121+0000","last_deep_scrub":"265'150","last_deep_scrub_stamp":"2024-09-12T17:41:53.700121+0000","last_clean_scrub_stamp":"2024-09-12T17:41:53.700121+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:02.023536+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":614,"num_read_kb":496,"num_write":228,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"265'366","reported_seq":1021,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:44.502758+0000","last_change":"2024-09-12T17:41:44.502758+0000","last_active":"2024-09-12T17:41:44.502758+0000","last_peered":"2024-09-12T17:41:44.502758+0000","last_clean":"2024-09-12T17:41:44.502758+0000","last_became_active":"2024-09-12T16:58:18.715448+0000","last_became_peered":"2024-09-12T16:58:18.715448+0000","last_unstale":"2024-09-12T17:41:44.502758+0000","last_undegraded":"2024-09-12T17:41:44.502758+0000","last_fullsized":"2024-09-12T17:41:44.502758+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'366","last_scrub_stamp":"2024-09-12T17:41:44.502506+0000","last_deep_scrub":"265'366","last_deep_scrub_stamp":"2024-09-12T17:41:44.502506+0000","last_clean_scrub_stamp":"2024-09-12T17:41:44.502506+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:08.236868+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1147727,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":546,"num_read_kb":11904,"num_write":1219,"num_write_kb":32051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:57.709766+0000","last_change":"2024-09-12T17:41:57.709766+0000","last_active":"2024-09-12T17:41:57.709766+0000","last_peered":"2024-09-12T17:41:57.709766+0000","last_clean":"2024-09-12T17:41:57.709766+0000","last_became_active":"2024-09-12T16:58:23.720096+0000","last_became_peered":"2024-09-12T16:58:23.720096+0000","last_unstale":"2024-09-12T17:41:57.709766+0000","last_undegraded":"2024-09-12T17:41:57.709766+0000","last_fullsized":"2024-09-12T17:41:57.709766+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:57.709583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:57.709583+0000","last_clean_scrub_stamp":"2024-09-12T17:41:57.709583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:39.596618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"265'369","reported_seq":987,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:05.604213+0000","last_change":"2024-09-12T17:42:05.604213+0000","last_active":"2024-09-12T17:42:05.604213+0000","last_peered":"2024-09-12T17:42:05.604213+0000","last_clean":"2024-09-12T17:42:05.604213+0000","last_became_active":"2024-09-12T16:58:25.946765+0000","last_became_peered":"2024-09-12T16:58:25.946765+0000","last_unstale":"2024-09-12T17:42:05.604213+0000","last_undegraded":"2024-09-12T17:42:05.604213+0000","last_fullsized":"2024-09-12T17:42:05.604213+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'369","last_scrub_stamp":"2024-09-12T17:42:05.604007+0000","last_deep_scrub":"265'369","last_deep_scrub_stamp":"2024-09-12T17:42:05.604007+0000","last_clean_scrub_stamp":"2024-09-12T17:42:05.604007+0000","objects_scrubbed":10,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:42.337337+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46152,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":583,"num_read_kb":1215,"num_write":464,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:01.378968+0000","last_change":"2024-09-12T17:42:01.378968+0000","last_active":"2024-09-12T17:42:01.378968+0000","last_peered":"2024-09-12T17:42:01.378968+0000","last_clean":"2024-09-12T17:42:01.378968+0000","last_became_active":"2024-09-12T16:58:27.753616+0000","last_became_peered":"2024-09-12T16:58:27.753616+0000","last_unstale":"2024-09-12T17:42:01.378968+0000","last_undegraded":"2024-09-12T17:42:01.378968+0000","last_fullsized":"2024-09-12T17:42:01.378968+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:01.378765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:01.378765+0000","last_clean_scrub_stamp":"2024-09-12T17:42:01.378765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:27.283128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"265'554","reported_seq":1371,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:12.556002+0000","last_change":"2024-09-12T17:42:12.555824+0000","last_active":"2024-09-12T17:42:12.556002+0000","last_peered":"2024-09-12T17:42:12.556002+0000","last_clean":"2024-09-12T17:42:12.556002+0000","last_became_active":"2024-09-12T16:58:29.774093+0000","last_became_peered":"2024-09-12T16:58:29.774093+0000","last_unstale":"2024-09-12T17:42:12.556002+0000","last_undegraded":"2024-09-12T17:42:12.556002+0000","last_fullsized":"2024-09-12T17:42:12.556002+0000","mapping_epoch":34,"log_start":"265'500","ondisk_log_start":"265'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'554","last_scrub_stamp":"2024-09-12T17:42:12.555633+0000","last_deep_scrub":"265'554","last_deep_scrub_stamp":"2024-09-12T17:42:12.555633+0000","last_clean_scrub_stamp":"2024-09-12T17:42:12.555633+0000","objects_scrubbed":4,"log_size":54,"log_dups_size":500,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:07.265979+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":455,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1305,"num_read_kb":1304,"num_write":1151,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"265'502","reported_seq":1263,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:48.602426+0000","last_change":"2024-09-12T17:41:48.602426+0000","last_active":"2024-09-12T17:41:48.602426+0000","last_peered":"2024-09-12T17:41:48.602426+0000","last_clean":"2024-09-12T17:41:48.602426+0000","last_became_active":"2024-09-12T16:58:21.699243+0000","last_became_peered":"2024-09-12T16:58:21.699243+0000","last_unstale":"2024-09-12T17:41:48.602426+0000","last_undegraded":"2024-09-12T17:41:48.602426+0000","last_fullsized":"2024-09-12T17:41:48.602426+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'502","last_scrub_stamp":"2024-09-12T17:41:48.602124+0000","last_deep_scrub":"265'502","last_deep_scrub_stamp":"2024-09-12T17:41:48.602124+0000","last_clean_scrub_stamp":"2024-09-12T17:41:48.602124+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:11.597872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2329,"num_read_kb":1984,"num_write":852,"num_write_kb":550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"265'371","reported_seq":1042,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:41.552046+0000","last_change":"2024-09-12T17:41:41.552046+0000","last_active":"2024-09-12T17:41:41.552046+0000","last_peered":"2024-09-12T17:41:41.552046+0000","last_clean":"2024-09-12T17:41:41.552046+0000","last_became_active":"2024-09-12T16:58:18.714412+0000","last_became_peered":"2024-09-12T16:58:18.714412+0000","last_unstale":"2024-09-12T17:41:41.552046+0000","last_undegraded":"2024-09-12T17:41:41.552046+0000","last_fullsized":"2024-09-12T17:41:41.552046+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'371","last_scrub_stamp":"2024-09-12T17:41:41.551754+0000","last_deep_scrub":"265'371","last_deep_scrub_stamp":"2024-09-12T17:41:41.551754+0000","last_clean_scrub_stamp":"2024-09-12T17:41:41.551754+0000","objects_scrubbed":6,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:46.467198+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306427,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":511,"num_read_kb":85960,"num_write":1174,"num_write_kb":38984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:48.434883+0000","last_change":"2024-09-12T17:41:48.434883+0000","last_active":"2024-09-12T17:41:48.434883+0000","last_peered":"2024-09-12T17:41:48.434883+0000","last_clean":"2024-09-12T17:41:48.434883+0000","last_became_active":"2024-09-12T16:58:23.703534+0000","last_became_peered":"2024-09-12T16:58:23.703534+0000","last_unstale":"2024-09-12T17:41:48.434883+0000","last_undegraded":"2024-09-12T17:41:48.434883+0000","last_fullsized":"2024-09-12T17:41:48.434883+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:48.434677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:48.434677+0000","last_clean_scrub_stamp":"2024-09-12T17:41:48.434677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:41.207200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"265'282","reported_seq":861,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:01.574232+0000","last_change":"2024-09-12T17:42:01.574232+0000","last_active":"2024-09-12T17:42:01.574232+0000","last_peered":"2024-09-12T17:42:01.574232+0000","last_clean":"2024-09-12T17:42:01.574232+0000","last_became_active":"2024-09-12T16:58:25.730470+0000","last_became_peered":"2024-09-12T16:58:25.730470+0000","last_unstale":"2024-09-12T17:42:01.574232+0000","last_undegraded":"2024-09-12T17:42:01.574232+0000","last_fullsized":"2024-09-12T17:42:01.574232+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'282","last_scrub_stamp":"2024-09-12T17:42:01.574044+0000","last_deep_scrub":"265'282","last_deep_scrub_stamp":"2024-09-12T17:42:01.574044+0000","last_clean_scrub_stamp":"2024-09-12T17:42:01.574044+0000","objects_scrubbed":4,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:01.929052+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57671,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":480,"num_read_kb":1170,"num_write":398,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:10.529115+0000","last_change":"2024-09-12T17:42:10.529115+0000","last_active":"2024-09-12T17:42:10.529115+0000","last_peered":"2024-09-12T17:42:10.529115+0000","last_clean":"2024-09-12T17:42:10.529115+0000","last_became_active":"2024-09-12T16:58:27.748461+0000","last_became_peered":"2024-09-12T16:58:27.748461+0000","last_unstale":"2024-09-12T17:42:10.529115+0000","last_undegraded":"2024-09-12T17:42:10.529115+0000","last_fullsized":"2024-09-12T17:42:10.529115+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:10.528945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:10.528945+0000","last_clean_scrub_stamp":"2024-09-12T17:42:10.528945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:06.400660+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"265'2419","reported_seq":4260,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:01.368182+0000","last_change":"2024-09-12T17:42:01.368039+0000","last_active":"2024-09-12T17:42:01.368182+0000","last_peered":"2024-09-12T17:42:01.368182+0000","last_clean":"2024-09-12T17:42:01.368182+0000","last_became_active":"2024-09-12T16:58:29.768469+0000","last_became_peered":"2024-09-12T16:58:29.768469+0000","last_unstale":"2024-09-12T17:42:01.368182+0000","last_undegraded":"2024-09-12T17:42:01.368182+0000","last_fullsized":"2024-09-12T17:42:01.368182+0000","mapping_epoch":34,"log_start":"265'2400","ondisk_log_start":"265'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2419","last_scrub_stamp":"2024-09-12T17:42:01.367825+0000","last_deep_scrub":"265'2419","last_deep_scrub_stamp":"2024-09-12T17:42:01.367825+0000","last_clean_scrub_stamp":"2024-09-12T17:42:01.367825+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":2400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:52.127983+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":849,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6073,"num_read_kb":6065,"num_write":4892,"num_write_kb":1798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"265'217","reported_seq":805,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:45.445128+0000","last_change":"2024-09-12T17:41:45.444945+0000","last_active":"2024-09-12T17:41:45.445128+0000","last_peered":"2024-09-12T17:41:45.445128+0000","last_clean":"2024-09-12T17:41:45.445128+0000","last_became_active":"2024-09-12T16:58:21.724552+0000","last_became_peered":"2024-09-12T16:58:21.724552+0000","last_unstale":"2024-09-12T17:41:45.445128+0000","last_undegraded":"2024-09-12T17:41:45.445128+0000","last_fullsized":"2024-09-12T17:41:45.445128+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'217","last_scrub_stamp":"2024-09-12T17:41:45.444760+0000","last_deep_scrub":"265'217","last_deep_scrub_stamp":"2024-09-12T17:41:45.444760+0000","last_clean_scrub_stamp":"2024-09-12T17:41:45.444760+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:07.480407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":914,"num_read_kb":736,"num_write":337,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"265'479","reported_seq":1231,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:42.515901+0000","last_change":"2024-09-12T17:41:42.515901+0000","last_active":"2024-09-12T17:41:42.515901+0000","last_peered":"2024-09-12T17:41:42.515901+0000","last_clean":"2024-09-12T17:41:42.515901+0000","last_became_active":"2024-09-12T16:58:55.852305+0000","last_became_peered":"2024-09-12T16:58:55.852305+0000","last_unstale":"2024-09-12T17:41:42.515901+0000","last_undegraded":"2024-09-12T17:41:42.515901+0000","last_fullsized":"2024-09-12T17:41:42.515901+0000","mapping_epoch":37,"log_start":"265'400","ondisk_log_start":"265'400","created":23,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'479","last_scrub_stamp":"2024-09-12T17:41:42.515648+0000","last_deep_scrub":"265'479","last_deep_scrub_stamp":"2024-09-12T17:41:42.515648+0000","last_clean_scrub_stamp":"2024-09-12T17:41:42.515648+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:36.727017+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048839,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":919,"num_read_kb":12354,"num_write":1497,"num_write_kb":33200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:50.493117+0000","last_change":"2024-09-12T17:41:50.493117+0000","last_active":"2024-09-12T17:41:50.493117+0000","last_peered":"2024-09-12T17:41:50.493117+0000","last_clean":"2024-09-12T17:41:50.493117+0000","last_became_active":"2024-09-12T16:58:23.713241+0000","last_became_peered":"2024-09-12T16:58:23.713241+0000","last_unstale":"2024-09-12T17:41:50.493117+0000","last_undegraded":"2024-09-12T17:41:50.493117+0000","last_fullsized":"2024-09-12T17:41:50.493117+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:50.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:50.492929+0000","last_clean_scrub_stamp":"2024-09-12T17:41:50.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:16.543100+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"265'326","reported_seq":918,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:02.766836+0000","last_change":"2024-09-12T17:42:02.766836+0000","last_active":"2024-09-12T17:42:02.766836+0000","last_peered":"2024-09-12T17:42:02.766836+0000","last_clean":"2024-09-12T17:42:02.766836+0000","last_became_active":"2024-09-12T16:58:25.732918+0000","last_became_peered":"2024-09-12T16:58:25.732918+0000","last_unstale":"2024-09-12T17:42:02.766836+0000","last_undegraded":"2024-09-12T17:42:02.766836+0000","last_fullsized":"2024-09-12T17:42:02.766836+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'326","last_scrub_stamp":"2024-09-12T17:42:02.766606+0000","last_deep_scrub":"265'326","last_deep_scrub_stamp":"2024-09-12T17:42:02.766606+0000","last_clean_scrub_stamp":"2024-09-12T17:42:02.766606+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:17.798594+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71605,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":514,"num_read_kb":1203,"num_write":420,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"265'759","reported_seq":2470,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:04.870764+0000","last_change":"2024-09-12T17:42:04.870764+0000","last_active":"2024-09-12T17:42:04.870764+0000","last_peered":"2024-09-12T17:42:04.870764+0000","last_clean":"2024-09-12T17:42:04.870764+0000","last_became_active":"2024-09-12T16:58:27.736160+0000","last_became_peered":"2024-09-12T16:58:27.736160+0000","last_unstale":"2024-09-12T17:42:04.870764+0000","last_undegraded":"2024-09-12T17:42:04.870764+0000","last_fullsized":"2024-09-12T17:42:04.870764+0000","mapping_epoch":32,"log_start":"265'701","ondisk_log_start":"265'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'759","last_scrub_stamp":"2024-09-12T17:42:04.870586+0000","last_deep_scrub":"265'759","last_deep_scrub_stamp":"2024-09-12T17:42:04.870586+0000","last_clean_scrub_stamp":"2024-09-12T17:42:04.870586+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":701,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:19.787370+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"265'169","reported_seq":666,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:10.968584+0000","last_change":"2024-09-12T17:42:10.968584+0000","last_active":"2024-09-12T17:42:10.968584+0000","last_peered":"2024-09-12T17:42:10.968584+0000","last_clean":"2024-09-12T17:42:10.968584+0000","last_became_active":"2024-09-12T16:58:29.785621+0000","last_became_peered":"2024-09-12T16:58:29.785621+0000","last_unstale":"2024-09-12T17:42:10.968584+0000","last_undegraded":"2024-09-12T17:42:10.968584+0000","last_fullsized":"2024-09-12T17:42:10.968584+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'169","last_scrub_stamp":"2024-09-12T17:42:10.968399+0000","last_deep_scrub":"265'169","last_deep_scrub_stamp":"2024-09-12T17:42:10.968399+0000","last_clean_scrub_stamp":"2024-09-12T17:42:10.968399+0000","objects_scrubbed":2,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:36.694831+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":406,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":130,"num_read_kb":128,"num_write":373,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"265'203","reported_seq":803,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:49.110136+0000","last_change":"2024-09-12T17:41:49.110136+0000","last_active":"2024-09-12T17:41:49.110136+0000","last_peered":"2024-09-12T17:41:49.110136+0000","last_clean":"2024-09-12T17:41:49.110136+0000","last_became_active":"2024-09-12T16:58:21.701704+0000","last_became_peered":"2024-09-12T16:58:21.701704+0000","last_unstale":"2024-09-12T17:41:49.110136+0000","last_undegraded":"2024-09-12T17:41:49.110136+0000","last_fullsized":"2024-09-12T17:41:49.110136+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'203","last_scrub_stamp":"2024-09-12T17:41:49.109939+0000","last_deep_scrub":"265'203","last_deep_scrub_stamp":"2024-09-12T17:41:49.109939+0000","last_clean_scrub_stamp":"2024-09-12T17:41:49.109939+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:31.594839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":867,"num_read_kb":717,"num_write":300,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"265'335","reported_seq":973,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:42.680714+0000","last_change":"2024-09-12T17:41:42.680714+0000","last_active":"2024-09-12T17:41:42.680714+0000","last_peered":"2024-09-12T17:41:42.680714+0000","last_clean":"2024-09-12T17:41:42.680714+0000","last_became_active":"2024-09-12T16:58:18.715232+0000","last_became_peered":"2024-09-12T16:58:18.715232+0000","last_unstale":"2024-09-12T17:41:42.680714+0000","last_undegraded":"2024-09-12T17:41:42.680714+0000","last_fullsized":"2024-09-12T17:41:42.680714+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'335","last_scrub_stamp":"2024-09-12T17:41:42.680418+0000","last_deep_scrub":"265'335","last_deep_scrub_stamp":"2024-09-12T17:41:42.680418+0000","last_clean_scrub_stamp":"2024-09-12T17:41:42.680418+0000","objects_scrubbed":9,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:52.761737+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1724025,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":468,"num_read_kb":18626,"num_write":1028,"num_write_kb":30032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:49.458628+0000","last_change":"2024-09-12T17:41:49.458503+0000","last_active":"2024-09-12T17:41:49.458628+0000","last_peered":"2024-09-12T17:41:49.458628+0000","last_clean":"2024-09-12T17:41:49.458628+0000","last_became_active":"2024-09-12T16:58:23.708641+0000","last_became_peered":"2024-09-12T16:58:23.708641+0000","last_unstale":"2024-09-12T17:41:49.458628+0000","last_undegraded":"2024-09-12T17:41:49.458628+0000","last_fullsized":"2024-09-12T17:41:49.458628+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:49.458319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:49.458319+0000","last_clean_scrub_stamp":"2024-09-12T17:41:49.458319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:57:34.059304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"265'475","reported_seq":1111,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:58.971445+0000","last_change":"2024-09-12T17:41:58.971445+0000","last_active":"2024-09-12T17:41:58.971445+0000","last_peered":"2024-09-12T17:41:58.971445+0000","last_clean":"2024-09-12T17:41:58.971445+0000","last_became_active":"2024-09-12T16:58:25.729071+0000","last_became_peered":"2024-09-12T16:58:25.729071+0000","last_unstale":"2024-09-12T17:41:58.971445+0000","last_undegraded":"2024-09-12T17:41:58.971445+0000","last_fullsized":"2024-09-12T17:41:58.971445+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'475","last_scrub_stamp":"2024-09-12T17:41:58.971256+0000","last_deep_scrub":"265'475","last_deep_scrub_stamp":"2024-09-12T17:41:58.971256+0000","last_clean_scrub_stamp":"2024-09-12T17:41:58.971256+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:44.218649+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126127,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":817,"num_read_kb":2031,"num_write":670,"num_write_kb":603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:55.551207+0000","last_change":"2024-09-12T17:41:55.551207+0000","last_active":"2024-09-12T17:41:55.551207+0000","last_peered":"2024-09-12T17:41:55.551207+0000","last_clean":"2024-09-12T17:41:55.551207+0000","last_became_active":"2024-09-12T16:58:27.734078+0000","last_became_peered":"2024-09-12T16:58:27.734078+0000","last_unstale":"2024-09-12T17:41:55.551207+0000","last_undegraded":"2024-09-12T17:41:55.551207+0000","last_fullsized":"2024-09-12T17:41:55.551207+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:55.551025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:55.551025+0000","last_clean_scrub_stamp":"2024-09-12T17:41:55.551025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:17.047074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"265'90","reported_seq":599,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:04.444250+0000","last_change":"2024-09-12T17:42:04.444250+0000","last_active":"2024-09-12T17:42:04.444250+0000","last_peered":"2024-09-12T17:42:04.444250+0000","last_clean":"2024-09-12T17:42:04.444250+0000","last_became_active":"2024-09-12T16:58:29.794347+0000","last_became_peered":"2024-09-12T16:58:29.794347+0000","last_unstale":"2024-09-12T17:42:04.444250+0000","last_undegraded":"2024-09-12T17:42:04.444250+0000","last_fullsized":"2024-09-12T17:42:04.444250+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'90","last_scrub_stamp":"2024-09-12T17:42:04.444035+0000","last_deep_scrub":"265'90","last_deep_scrub_stamp":"2024-09-12T17:42:04.444035+0000","last_clean_scrub_stamp":"2024-09-12T17:42:04.444035+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:38.772754+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":704,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":193,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"265'212","reported_seq":809,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:44.640655+0000","last_change":"2024-09-12T17:41:44.640655+0000","last_active":"2024-09-12T17:41:44.640655+0000","last_peered":"2024-09-12T17:41:44.640655+0000","last_clean":"2024-09-12T17:41:44.640655+0000","last_became_active":"2024-09-12T16:58:21.702684+0000","last_became_peered":"2024-09-12T16:58:21.702684+0000","last_unstale":"2024-09-12T17:41:44.640655+0000","last_undegraded":"2024-09-12T17:41:44.640655+0000","last_fullsized":"2024-09-12T17:41:44.640655+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'212","last_scrub_stamp":"2024-09-12T17:41:44.640479+0000","last_deep_scrub":"265'212","last_deep_scrub_stamp":"2024-09-12T17:41:44.640479+0000","last_clean_scrub_stamp":"2024-09-12T17:41:44.640479+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:35.863889+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":882,"num_read_kb":712,"num_write":314,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"265'376","reported_seq":1066,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:41.751292+0000","last_change":"2024-09-12T17:41:41.751292+0000","last_active":"2024-09-12T17:41:41.751292+0000","last_peered":"2024-09-12T17:41:41.751292+0000","last_clean":"2024-09-12T17:41:41.751292+0000","last_became_active":"2024-09-12T16:58:18.695549+0000","last_became_peered":"2024-09-12T16:58:18.695549+0000","last_unstale":"2024-09-12T17:41:41.751292+0000","last_undegraded":"2024-09-12T17:41:41.751292+0000","last_fullsized":"2024-09-12T17:41:41.751292+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'376","last_scrub_stamp":"2024-09-12T17:41:41.751066+0000","last_deep_scrub":"265'376","last_deep_scrub_stamp":"2024-09-12T17:41:41.751066+0000","last_clean_scrub_stamp":"2024-09-12T17:41:41.751066+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:18.413154+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":633,"num_read_kb":12633,"num_write":1101,"num_write_kb":15900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:52.524952+0000","last_change":"2024-09-12T17:41:52.524952+0000","last_active":"2024-09-12T17:41:52.524952+0000","last_peered":"2024-09-12T17:41:52.524952+0000","last_clean":"2024-09-12T17:41:52.524952+0000","last_became_active":"2024-09-12T16:58:23.720279+0000","last_became_peered":"2024-09-12T16:58:23.720279+0000","last_unstale":"2024-09-12T17:41:52.524952+0000","last_undegraded":"2024-09-12T17:41:52.524952+0000","last_fullsized":"2024-09-12T17:41:52.524952+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:52.524776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:52.524776+0000","last_clean_scrub_stamp":"2024-09-12T17:41:52.524776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:24.970601+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"265'298","reported_seq":880,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:04.604637+0000","last_change":"2024-09-12T17:42:04.604637+0000","last_active":"2024-09-12T17:42:04.604637+0000","last_peered":"2024-09-12T17:42:04.604637+0000","last_clean":"2024-09-12T17:42:04.604637+0000","last_became_active":"2024-09-12T16:58:25.711682+0000","last_became_peered":"2024-09-12T16:58:25.711682+0000","last_unstale":"2024-09-12T17:42:04.604637+0000","last_undegraded":"2024-09-12T17:42:04.604637+0000","last_fullsized":"2024-09-12T17:42:04.604637+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'298","last_scrub_stamp":"2024-09-12T17:42:04.604436+0000","last_deep_scrub":"265'298","last_deep_scrub_stamp":"2024-09-12T17:42:04.604436+0000","last_clean_scrub_stamp":"2024-09-12T17:42:04.604436+0000","objects_scrubbed":6,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:28.531688+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44554,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":521,"num_read_kb":1183,"num_write":472,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:05.917580+0000","last_change":"2024-09-12T17:42:05.917580+0000","last_active":"2024-09-12T17:42:05.917580+0000","last_peered":"2024-09-12T17:42:05.917580+0000","last_clean":"2024-09-12T17:42:05.917580+0000","last_became_active":"2024-09-12T16:58:27.751664+0000","last_became_peered":"2024-09-12T16:58:27.751664+0000","last_unstale":"2024-09-12T17:42:05.917580+0000","last_undegraded":"2024-09-12T17:42:05.917580+0000","last_fullsized":"2024-09-12T17:42:05.917580+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:05.917376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:05.917376+0000","last_clean_scrub_stamp":"2024-09-12T17:42:05.917376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:42.341012+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"265'131","reported_seq":640,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:17.541480+0000","last_change":"2024-09-12T17:42:17.541332+0000","last_active":"2024-09-12T17:42:17.541480+0000","last_peered":"2024-09-12T17:42:17.541480+0000","last_clean":"2024-09-12T17:42:17.541480+0000","last_became_active":"2024-09-12T16:58:29.784095+0000","last_became_peered":"2024-09-12T16:58:29.784095+0000","last_unstale":"2024-09-12T17:42:17.541480+0000","last_undegraded":"2024-09-12T17:42:17.541480+0000","last_fullsized":"2024-09-12T17:42:17.541480+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'131","last_scrub_stamp":"2024-09-12T17:42:17.541136+0000","last_deep_scrub":"265'131","last_deep_scrub_stamp":"2024-09-12T17:42:17.541136+0000","last_clean_scrub_stamp":"2024-09-12T17:42:17.541136+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:45.054091+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":487,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":177,"num_read_kb":165,"num_write":304,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"265'166","reported_seq":780,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:45.621245+0000","last_change":"2024-09-12T17:41:45.621245+0000","last_active":"2024-09-12T17:41:45.621245+0000","last_peered":"2024-09-12T17:41:45.621245+0000","last_clean":"2024-09-12T17:41:45.621245+0000","last_became_active":"2024-09-12T16:58:21.728963+0000","last_became_peered":"2024-09-12T16:58:21.728963+0000","last_unstale":"2024-09-12T17:41:45.621245+0000","last_undegraded":"2024-09-12T17:41:45.621245+0000","last_fullsized":"2024-09-12T17:41:45.621245+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'166","last_scrub_stamp":"2024-09-12T17:41:45.621014+0000","last_deep_scrub":"265'166","last_deep_scrub_stamp":"2024-09-12T17:41:45.621014+0000","last_clean_scrub_stamp":"2024-09-12T17:41:45.621014+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:14.525844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":751,"num_read_kb":615,"num_write":255,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"265'343","reported_seq":1020,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:41.451773+0000","last_change":"2024-09-12T17:41:41.451544+0000","last_active":"2024-09-12T17:41:41.451773+0000","last_peered":"2024-09-12T17:41:41.451773+0000","last_clean":"2024-09-12T17:41:41.451773+0000","last_became_active":"2024-09-12T16:58:18.708689+0000","last_became_peered":"2024-09-12T16:58:18.708689+0000","last_unstale":"2024-09-12T17:41:41.451773+0000","last_undegraded":"2024-09-12T17:41:41.451773+0000","last_fullsized":"2024-09-12T17:41:41.451773+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'343","last_scrub_stamp":"2024-09-12T17:41:41.451261+0000","last_deep_scrub":"265'343","last_deep_scrub_stamp":"2024-09-12T17:41:41.451261+0000","last_clean_scrub_stamp":"2024-09-12T17:41:41.451261+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:06.939620+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":505,"num_read_kb":124256,"num_write":1133,"num_write_kb":36504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:56.391504+0000","last_change":"2024-09-12T17:41:56.391504+0000","last_active":"2024-09-12T17:41:56.391504+0000","last_peered":"2024-09-12T17:41:56.391504+0000","last_clean":"2024-09-12T17:41:56.391504+0000","last_became_active":"2024-09-12T16:58:23.709099+0000","last_became_peered":"2024-09-12T16:58:23.709099+0000","last_unstale":"2024-09-12T17:41:56.391504+0000","last_undegraded":"2024-09-12T17:41:56.391504+0000","last_fullsized":"2024-09-12T17:41:56.391504+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:56.391301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:56.391301+0000","last_clean_scrub_stamp":"2024-09-12T17:41:56.391301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:32.975832+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"265'284","reported_seq":876,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:54.532525+0000","last_change":"2024-09-12T17:41:54.532525+0000","last_active":"2024-09-12T17:41:54.532525+0000","last_peered":"2024-09-12T17:41:54.532525+0000","last_clean":"2024-09-12T17:41:54.532525+0000","last_became_active":"2024-09-12T16:58:25.723894+0000","last_became_peered":"2024-09-12T16:58:25.723894+0000","last_unstale":"2024-09-12T17:41:54.532525+0000","last_undegraded":"2024-09-12T17:41:54.532525+0000","last_fullsized":"2024-09-12T17:41:54.532525+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'284","last_scrub_stamp":"2024-09-12T17:41:54.532322+0000","last_deep_scrub":"265'284","last_deep_scrub_stamp":"2024-09-12T17:41:54.532322+0000","last_clean_scrub_stamp":"2024-09-12T17:41:54.532322+0000","objects_scrubbed":7,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:06.034171+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60644,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":457,"num_read_kb":1010,"num_write":360,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"265'727","reported_seq":2356,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:59.659910+0000","last_change":"2024-09-12T17:41:59.659910+0000","last_active":"2024-09-12T17:41:59.659910+0000","last_peered":"2024-09-12T17:41:59.659910+0000","last_clean":"2024-09-12T17:41:59.659910+0000","last_became_active":"2024-09-12T16:58:27.753179+0000","last_became_peered":"2024-09-12T16:58:27.753179+0000","last_unstale":"2024-09-12T17:41:59.659910+0000","last_undegraded":"2024-09-12T17:41:59.659910+0000","last_fullsized":"2024-09-12T17:41:59.659910+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'727","last_scrub_stamp":"2024-09-12T17:41:59.659726+0000","last_deep_scrub":"265'727","last_deep_scrub_stamp":"2024-09-12T17:41:59.659726+0000","last_clean_scrub_stamp":"2024-09-12T17:41:59.659726+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":700,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:13.608476+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"265'142","reported_seq":674,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:05.434385+0000","last_change":"2024-09-12T17:42:05.434246+0000","last_active":"2024-09-12T17:42:05.434385+0000","last_peered":"2024-09-12T17:42:05.434385+0000","last_clean":"2024-09-12T17:42:05.434385+0000","last_became_active":"2024-09-12T16:58:29.778839+0000","last_became_peered":"2024-09-12T16:58:29.778839+0000","last_unstale":"2024-09-12T17:42:05.434385+0000","last_undegraded":"2024-09-12T17:42:05.434385+0000","last_fullsized":"2024-09-12T17:42:05.434385+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'142","last_scrub_stamp":"2024-09-12T17:42:05.434025+0000","last_deep_scrub":"265'142","last_deep_scrub_stamp":"2024-09-12T17:42:05.434025+0000","last_clean_scrub_stamp":"2024-09-12T17:42:05.434025+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:13.641037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":288,"num_read_kb":252,"num_write":342,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"265'188","reported_seq":784,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:46.597917+0000","last_change":"2024-09-12T17:41:46.597917+0000","last_active":"2024-09-12T17:41:46.597917+0000","last_peered":"2024-09-12T17:41:46.597917+0000","last_clean":"2024-09-12T17:41:46.597917+0000","last_became_active":"2024-09-12T16:58:21.706953+0000","last_became_peered":"2024-09-12T16:58:21.706953+0000","last_unstale":"2024-09-12T17:41:46.597917+0000","last_undegraded":"2024-09-12T17:41:46.597917+0000","last_fullsized":"2024-09-12T17:41:46.597917+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'188","last_scrub_stamp":"2024-09-12T17:41:46.597688+0000","last_deep_scrub":"265'188","last_deep_scrub_stamp":"2024-09-12T17:41:46.597688+0000","last_clean_scrub_stamp":"2024-09-12T17:41:46.597688+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:59.955032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":782,"num_read_kb":644,"num_write":280,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"265'327","reported_seq":970,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:40.693027+0000","last_change":"2024-09-12T17:41:40.692867+0000","last_active":"2024-09-12T17:41:40.693027+0000","last_peered":"2024-09-12T17:41:40.693027+0000","last_clean":"2024-09-12T17:41:40.693027+0000","last_became_active":"2024-09-12T16:58:18.686189+0000","last_became_peered":"2024-09-12T16:58:18.686189+0000","last_unstale":"2024-09-12T17:41:40.693027+0000","last_undegraded":"2024-09-12T17:41:40.693027+0000","last_fullsized":"2024-09-12T17:41:40.693027+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'327","last_scrub_stamp":"2024-09-12T17:41:40.692633+0000","last_deep_scrub":"265'327","last_deep_scrub_stamp":"2024-09-12T17:41:40.692633+0000","last_clean_scrub_stamp":"2024-09-12T17:41:40.692633+0000","objects_scrubbed":8,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:55.491689+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":508,"num_read_kb":6575,"num_write":1048,"num_write_kb":19619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"265'4","reported_seq":1464,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:00.640441+0000","last_change":"2024-09-12T17:42:00.640441+0000","last_active":"2024-09-12T17:42:00.640441+0000","last_peered":"2024-09-12T17:42:00.640441+0000","last_clean":"2024-09-12T17:42:00.640441+0000","last_became_active":"2024-09-12T16:58:23.706471+0000","last_became_peered":"2024-09-12T16:58:23.706471+0000","last_unstale":"2024-09-12T17:42:00.640441+0000","last_undegraded":"2024-09-12T17:42:00.640441+0000","last_fullsized":"2024-09-12T17:42:00.640441+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T17:42:00.640250+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T17:42:00.640250+0000","last_clean_scrub_stamp":"2024-09-12T17:42:00.640250+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:54:34.722743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":956,"num_read_kb":956,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"265'83","reported_seq":611,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:03.588353+0000","last_change":"2024-09-12T17:42:03.588353+0000","last_active":"2024-09-12T17:42:03.588353+0000","last_peered":"2024-09-12T17:42:03.588353+0000","last_clean":"2024-09-12T17:42:03.588353+0000","last_became_active":"2024-09-12T16:58:25.949962+0000","last_became_peered":"2024-09-12T16:58:25.949962+0000","last_unstale":"2024-09-12T17:42:03.588353+0000","last_undegraded":"2024-09-12T17:42:03.588353+0000","last_fullsized":"2024-09-12T17:42:03.588353+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'83","last_scrub_stamp":"2024-09-12T17:42:03.588160+0000","last_deep_scrub":"265'83","last_deep_scrub_stamp":"2024-09-12T17:42:03.588160+0000","last_clean_scrub_stamp":"2024-09-12T17:42:03.588160+0000","objects_scrubbed":5,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:22.497976+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"265'758","reported_seq":4014,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:55.401310+0000","last_change":"2024-09-12T17:41:55.401310+0000","last_active":"2024-09-12T17:41:55.401310+0000","last_peered":"2024-09-12T17:41:55.401310+0000","last_clean":"2024-09-12T17:41:55.401310+0000","last_became_active":"2024-09-12T16:58:27.755569+0000","last_became_peered":"2024-09-12T16:58:27.755569+0000","last_unstale":"2024-09-12T17:41:55.401310+0000","last_undegraded":"2024-09-12T17:41:55.401310+0000","last_fullsized":"2024-09-12T17:41:55.401310+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'758","last_scrub_stamp":"2024-09-12T17:41:55.401154+0000","last_deep_scrub":"265'758","last_deep_scrub_stamp":"2024-09-12T17:41:55.401154+0000","last_clean_scrub_stamp":"2024-09-12T17:41:55.401154+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":700,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:49.415648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"265'116","reported_seq":633,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:13.582180+0000","last_change":"2024-09-12T17:42:13.581935+0000","last_active":"2024-09-12T17:42:13.582180+0000","last_peered":"2024-09-12T17:42:13.582180+0000","last_clean":"2024-09-12T17:42:13.582180+0000","last_became_active":"2024-09-12T16:58:29.780289+0000","last_became_peered":"2024-09-12T16:58:29.780289+0000","last_unstale":"2024-09-12T17:42:13.582180+0000","last_undegraded":"2024-09-12T17:42:13.582180+0000","last_fullsized":"2024-09-12T17:42:13.582180+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'116","last_scrub_stamp":"2024-09-12T17:42:13.581645+0000","last_deep_scrub":"265'116","last_deep_scrub_stamp":"2024-09-12T17:42:13.581645+0000","last_clean_scrub_stamp":"2024-09-12T17:42:13.581645+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:41.170590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":175,"num_write":267,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"265'140","reported_seq":805,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:51.379444+0000","last_change":"2024-09-12T17:41:51.379444+0000","last_active":"2024-09-12T17:41:51.379444+0000","last_peered":"2024-09-12T17:41:51.379444+0000","last_clean":"2024-09-12T17:41:51.379444+0000","last_became_active":"2024-09-12T16:58:21.719827+0000","last_became_peered":"2024-09-12T16:58:21.719827+0000","last_unstale":"2024-09-12T17:41:51.379444+0000","last_undegraded":"2024-09-12T17:41:51.379444+0000","last_fullsized":"2024-09-12T17:41:51.379444+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'140","last_scrub_stamp":"2024-09-12T17:41:51.379265+0000","last_deep_scrub":"265'140","last_deep_scrub_stamp":"2024-09-12T17:41:51.379265+0000","last_clean_scrub_stamp":"2024-09-12T17:41:51.379265+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:58.481342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":689,"num_read_kb":590,"num_write":204,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"265'335","reported_seq":990,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:39.806722+0000","last_change":"2024-09-12T17:41:39.806619+0000","last_active":"2024-09-12T17:41:39.806722+0000","last_peered":"2024-09-12T17:41:39.806722+0000","last_clean":"2024-09-12T17:41:39.806722+0000","last_became_active":"2024-09-12T16:58:18.705048+0000","last_became_peered":"2024-09-12T16:58:18.705048+0000","last_unstale":"2024-09-12T17:41:39.806722+0000","last_undegraded":"2024-09-12T17:41:39.806722+0000","last_fullsized":"2024-09-12T17:41:39.806722+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'335","last_scrub_stamp":"2024-09-12T17:41:39.806418+0000","last_deep_scrub":"265'335","last_deep_scrub_stamp":"2024-09-12T17:41:39.806418+0000","last_clean_scrub_stamp":"2024-09-12T17:41:39.806418+0000","objects_scrubbed":8,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:11.826972+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2227678,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":497,"num_read_kb":3392,"num_write":1050,"num_write_kb":22669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"265'6","reported_seq":988,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:00.663027+0000","last_change":"2024-09-12T17:42:00.663027+0000","last_active":"2024-09-12T17:42:00.663027+0000","last_peered":"2024-09-12T17:42:00.663027+0000","last_clean":"2024-09-12T17:42:00.663027+0000","last_became_active":"2024-09-12T16:58:23.702699+0000","last_became_peered":"2024-09-12T16:58:23.702699+0000","last_unstale":"2024-09-12T17:42:00.663027+0000","last_undegraded":"2024-09-12T17:42:00.663027+0000","last_fullsized":"2024-09-12T17:42:00.663027+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T17:42:00.662845+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T17:42:00.662845+0000","last_clean_scrub_stamp":"2024-09-12T17:42:00.662845+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:03.303674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":729,"num_read_kb":1194,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"265'352","reported_seq":964,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:06.599729+0000","last_change":"2024-09-12T17:42:06.599729+0000","last_active":"2024-09-12T17:42:06.599729+0000","last_peered":"2024-09-12T17:42:06.599729+0000","last_clean":"2024-09-12T17:42:06.599729+0000","last_became_active":"2024-09-12T16:58:25.724694+0000","last_became_peered":"2024-09-12T16:58:25.724694+0000","last_unstale":"2024-09-12T17:42:06.599729+0000","last_undegraded":"2024-09-12T17:42:06.599729+0000","last_fullsized":"2024-09-12T17:42:06.599729+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'352","last_scrub_stamp":"2024-09-12T17:42:06.599476+0000","last_deep_scrub":"265'352","last_deep_scrub_stamp":"2024-09-12T17:42:06.599476+0000","last_clean_scrub_stamp":"2024-09-12T17:42:06.599476+0000","objects_scrubbed":8,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:48.102438+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52076,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":562,"num_read_kb":1199,"num_write":444,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:56.381658+0000","last_change":"2024-09-12T17:41:56.381658+0000","last_active":"2024-09-12T17:41:56.381658+0000","last_peered":"2024-09-12T17:41:56.381658+0000","last_clean":"2024-09-12T17:41:56.381658+0000","last_became_active":"2024-09-12T16:58:27.740510+0000","last_became_peered":"2024-09-12T16:58:27.740510+0000","last_unstale":"2024-09-12T17:41:56.381658+0000","last_undegraded":"2024-09-12T17:41:56.381658+0000","last_fullsized":"2024-09-12T17:41:56.381658+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:56.381466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:56.381466+0000","last_clean_scrub_stamp":"2024-09-12T17:41:56.381466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:56.865452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"265'130","reported_seq":631,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:03.451882+0000","last_change":"2024-09-12T17:42:03.451743+0000","last_active":"2024-09-12T17:42:03.451882+0000","last_peered":"2024-09-12T17:42:03.451882+0000","last_clean":"2024-09-12T17:42:03.451882+0000","last_became_active":"2024-09-12T16:58:29.776007+0000","last_became_peered":"2024-09-12T16:58:29.776007+0000","last_unstale":"2024-09-12T17:42:03.451882+0000","last_undegraded":"2024-09-12T17:42:03.451882+0000","last_fullsized":"2024-09-12T17:42:03.451882+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'130","last_scrub_stamp":"2024-09-12T17:42:03.451565+0000","last_deep_scrub":"265'130","last_deep_scrub_stamp":"2024-09-12T17:42:03.451565+0000","last_clean_scrub_stamp":"2024-09-12T17:42:03.451565+0000","objects_scrubbed":3,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:21.254085+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":162,"num_read_kb":158,"num_write":308,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"265'143","reported_seq":764,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:49.448232+0000","last_change":"2024-09-12T17:41:49.448084+0000","last_active":"2024-09-12T17:41:49.448232+0000","last_peered":"2024-09-12T17:41:49.448232+0000","last_clean":"2024-09-12T17:41:49.448232+0000","last_became_active":"2024-09-12T16:58:21.726160+0000","last_became_peered":"2024-09-12T16:58:21.726160+0000","last_unstale":"2024-09-12T17:41:49.448232+0000","last_undegraded":"2024-09-12T17:41:49.448232+0000","last_fullsized":"2024-09-12T17:41:49.448232+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'143","last_scrub_stamp":"2024-09-12T17:41:49.447779+0000","last_deep_scrub":"265'143","last_deep_scrub_stamp":"2024-09-12T17:41:49.447779+0000","last_clean_scrub_stamp":"2024-09-12T17:41:49.447779+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:59.351840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":643,"num_read_kb":537,"num_write":216,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"265'74","reported_seq":623,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:40.572560+0000","last_change":"2024-09-12T17:41:40.572415+0000","last_active":"2024-09-12T17:41:40.572560+0000","last_peered":"2024-09-12T17:41:40.572560+0000","last_clean":"2024-09-12T17:41:40.572560+0000","last_became_active":"2024-09-12T16:58:04.216387+0000","last_became_peered":"2024-09-12T16:58:04.216387+0000","last_unstale":"2024-09-12T17:41:40.572560+0000","last_undegraded":"2024-09-12T17:41:40.572560+0000","last_fullsized":"2024-09-12T17:41:40.572560+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'74","last_scrub_stamp":"2024-09-12T17:41:40.572242+0000","last_deep_scrub":"265'74","last_deep_scrub_stamp":"2024-09-12T17:41:40.572242+0000","last_clean_scrub_stamp":"2024-09-12T17:41:40.572242+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:51.726519+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"265'2","reported_seq":531,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:40.628344+0000","last_change":"2024-09-12T17:41:40.628219+0000","last_active":"2024-09-12T17:41:40.628344+0000","last_peered":"2024-09-12T17:41:40.628344+0000","last_clean":"2024-09-12T17:41:40.628344+0000","last_became_active":"2024-09-12T16:58:08.538227+0000","last_became_peered":"2024-09-12T16:58:08.538227+0000","last_unstale":"2024-09-12T17:41:40.628344+0000","last_undegraded":"2024-09-12T17:41:40.628344+0000","last_fullsized":"2024-09-12T17:41:40.628344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T17:41:40.628040+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T17:41:40.628040+0000","last_clean_scrub_stamp":"2024-09-12T17:41:40.628040+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:51.377305+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.001171044,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"265'366","reported_seq":1001,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:40.595609+0000","last_change":"2024-09-12T17:41:40.595467+0000","last_active":"2024-09-12T17:41:40.595609+0000","last_peered":"2024-09-12T17:41:40.595609+0000","last_clean":"2024-09-12T17:41:40.595609+0000","last_became_active":"2024-09-12T16:58:55.957231+0000","last_became_peered":"2024-09-12T16:58:55.957231+0000","last_unstale":"2024-09-12T17:41:40.595609+0000","last_undegraded":"2024-09-12T17:41:40.595609+0000","last_fullsized":"2024-09-12T17:41:40.595609+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'366","last_scrub_stamp":"2024-09-12T17:41:40.595232+0000","last_deep_scrub":"265'366","last_deep_scrub_stamp":"2024-09-12T17:41:40.595232+0000","last_clean_scrub_stamp":"2024-09-12T17:41:40.595232+0000","objects_scrubbed":8,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:19.557999+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159822,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":551,"num_read_kb":44871,"num_write":1125,"num_write_kb":45418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"265'4","reported_seq":989,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:58.751673+0000","last_change":"2024-09-12T17:41:58.751528+0000","last_active":"2024-09-12T17:41:58.751673+0000","last_peered":"2024-09-12T17:41:58.751673+0000","last_clean":"2024-09-12T17:41:58.751673+0000","last_became_active":"2024-09-12T16:58:23.718720+0000","last_became_peered":"2024-09-12T16:58:23.718720+0000","last_unstale":"2024-09-12T17:41:58.751673+0000","last_undegraded":"2024-09-12T17:41:58.751673+0000","last_fullsized":"2024-09-12T17:41:58.751673+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T17:41:58.751313+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T17:41:58.751313+0000","last_clean_scrub_stamp":"2024-09-12T17:41:58.751313+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:58.563273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":725,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"265'694","reported_seq":1404,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:04.586463+0000","last_change":"2024-09-12T17:42:04.586463+0000","last_active":"2024-09-12T17:42:04.586463+0000","last_peered":"2024-09-12T17:42:04.586463+0000","last_clean":"2024-09-12T17:42:04.586463+0000","last_became_active":"2024-09-12T16:58:25.720741+0000","last_became_peered":"2024-09-12T16:58:25.720741+0000","last_unstale":"2024-09-12T17:42:04.586463+0000","last_undegraded":"2024-09-12T17:42:04.586463+0000","last_fullsized":"2024-09-12T17:42:04.586463+0000","mapping_epoch":30,"log_start":"265'600","ondisk_log_start":"265'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'694","last_scrub_stamp":"2024-09-12T17:42:04.586272+0000","last_deep_scrub":"265'694","last_deep_scrub_stamp":"2024-09-12T17:42:04.586272+0000","last_clean_scrub_stamp":"2024-09-12T17:42:04.586272+0000","objects_scrubbed":6,"log_size":94,"log_dups_size":600,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:25.161493+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142315,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1357,"num_read_kb":3135,"num_write":1250,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89176,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:06.902659+0000","last_change":"2024-09-12T17:42:06.902659+0000","last_active":"2024-09-12T17:42:06.902659+0000","last_peered":"2024-09-12T17:42:06.902659+0000","last_clean":"2024-09-12T17:42:06.902659+0000","last_became_active":"2024-09-12T16:58:27.746171+0000","last_became_peered":"2024-09-12T16:58:27.746171+0000","last_unstale":"2024-09-12T17:42:06.902659+0000","last_undegraded":"2024-09-12T17:42:06.902659+0000","last_fullsized":"2024-09-12T17:42:06.902659+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:06.902447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:06.902447+0000","last_clean_scrub_stamp":"2024-09-12T17:42:06.902447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:57.883611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"265'211","reported_seq":926,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:02.328227+0000","last_change":"2024-09-12T17:42:02.328227+0000","last_active":"2024-09-12T17:42:02.328227+0000","last_peered":"2024-09-12T17:42:02.328227+0000","last_clean":"2024-09-12T17:42:02.328227+0000","last_became_active":"2024-09-12T16:58:29.768536+0000","last_became_peered":"2024-09-12T16:58:29.768536+0000","last_unstale":"2024-09-12T17:42:02.328227+0000","last_undegraded":"2024-09-12T17:42:02.328227+0000","last_fullsized":"2024-09-12T17:42:02.328227+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'211","last_scrub_stamp":"2024-09-12T17:42:02.328035+0000","last_deep_scrub":"265'211","last_deep_scrub_stamp":"2024-09-12T17:42:02.328035+0000","last_clean_scrub_stamp":"2024-09-12T17:42:02.328035+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:29.695906+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":520,"num_read_kb":510,"num_write":443,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"265'70","reported_seq":633,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:47.142743+0000","last_change":"2024-09-12T17:41:47.142743+0000","last_active":"2024-09-12T17:41:47.142743+0000","last_peered":"2024-09-12T17:41:47.142743+0000","last_clean":"2024-09-12T17:41:47.142743+0000","last_became_active":"2024-09-12T16:58:21.723703+0000","last_became_peered":"2024-09-12T16:58:21.723703+0000","last_unstale":"2024-09-12T17:41:47.142743+0000","last_undegraded":"2024-09-12T17:41:47.142743+0000","last_fullsized":"2024-09-12T17:41:47.142743+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'70","last_scrub_stamp":"2024-09-12T17:41:47.142558+0000","last_deep_scrub":"265'70","last_deep_scrub_stamp":"2024-09-12T17:41:47.142558+0000","last_clean_scrub_stamp":"2024-09-12T17:41:47.142558+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:44.829243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":317,"num_read_kb":265,"num_write":106,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":530,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:43.467758+0000","last_change":"2024-09-12T17:41:43.467257+0000","last_active":"2024-09-12T17:41:43.467758+0000","last_peered":"2024-09-12T17:41:43.467758+0000","last_clean":"2024-09-12T17:41:43.467758+0000","last_became_active":"2024-09-12T16:58:08.536415+0000","last_became_peered":"2024-09-12T16:58:08.536415+0000","last_unstale":"2024-09-12T17:41:43.467758+0000","last_undegraded":"2024-09-12T17:41:43.467758+0000","last_fullsized":"2024-09-12T17:41:43.467758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:43.467045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:43.467045+0000","last_clean_scrub_stamp":"2024-09-12T17:41:43.467045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:31.530851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001332909,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"265'329","reported_seq":984,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:38.253078+0000","last_change":"2024-09-12T17:41:38.252941+0000","last_active":"2024-09-12T17:41:38.253078+0000","last_peered":"2024-09-12T17:41:38.253078+0000","last_clean":"2024-09-12T17:41:38.253078+0000","last_became_active":"2024-09-12T16:58:18.695755+0000","last_became_peered":"2024-09-12T16:58:18.695755+0000","last_unstale":"2024-09-12T17:41:38.253078+0000","last_undegraded":"2024-09-12T17:41:38.253078+0000","last_fullsized":"2024-09-12T17:41:38.253078+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'329","last_scrub_stamp":"2024-09-12T17:41:38.252730+0000","last_deep_scrub":"265'329","last_deep_scrub_stamp":"2024-09-12T17:41:38.252730+0000","last_clean_scrub_stamp":"2024-09-12T17:41:38.252730+0000","objects_scrubbed":6,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:02.194179+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399184,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":538,"num_read_kb":2859,"num_write":1066,"num_write_kb":24939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:59.595833+0000","last_change":"2024-09-12T17:41:59.595833+0000","last_active":"2024-09-12T17:41:59.595833+0000","last_peered":"2024-09-12T17:41:59.595833+0000","last_clean":"2024-09-12T17:41:59.595833+0000","last_became_active":"2024-09-12T16:58:23.712354+0000","last_became_peered":"2024-09-12T16:58:23.712354+0000","last_unstale":"2024-09-12T17:41:59.595833+0000","last_undegraded":"2024-09-12T17:41:59.595833+0000","last_fullsized":"2024-09-12T17:41:59.595833+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:59.595625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:59.595625+0000","last_clean_scrub_stamp":"2024-09-12T17:41:59.595625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:30.801678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"265'1257","reported_seq":2723,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:58.441697+0000","last_change":"2024-09-12T17:41:58.441384+0000","last_active":"2024-09-12T17:41:58.441697+0000","last_peered":"2024-09-12T17:41:58.441697+0000","last_clean":"2024-09-12T17:41:58.441697+0000","last_became_active":"2024-09-12T16:58:25.720266+0000","last_became_peered":"2024-09-12T16:58:25.720266+0000","last_unstale":"2024-09-12T17:41:58.441697+0000","last_undegraded":"2024-09-12T17:41:58.441697+0000","last_fullsized":"2024-09-12T17:41:58.441697+0000","mapping_epoch":30,"log_start":"265'1200","ondisk_log_start":"265'1200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1257","last_scrub_stamp":"2024-09-12T17:41:58.441125+0000","last_deep_scrub":"265'1257","last_deep_scrub_stamp":"2024-09-12T17:41:58.441125+0000","last_clean_scrub_stamp":"2024-09-12T17:41:58.441125+0000","objects_scrubbed":11,"log_size":57,"log_dups_size":1200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:43.727748+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150793,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2049,"num_read_kb":3938,"num_write":1140,"num_write_kb":988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:07.701197+0000","last_change":"2024-09-12T17:42:07.701051+0000","last_active":"2024-09-12T17:42:07.701197+0000","last_peered":"2024-09-12T17:42:07.701197+0000","last_clean":"2024-09-12T17:42:07.701197+0000","last_became_active":"2024-09-12T16:58:27.745341+0000","last_became_peered":"2024-09-12T16:58:27.745341+0000","last_unstale":"2024-09-12T17:42:07.701197+0000","last_undegraded":"2024-09-12T17:42:07.701197+0000","last_fullsized":"2024-09-12T17:42:07.701197+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:07.700879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:07.700879+0000","last_clean_scrub_stamp":"2024-09-12T17:42:07.700879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:05.717581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"265'211","reported_seq":735,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:06.418399+0000","last_change":"2024-09-12T17:42:06.418399+0000","last_active":"2024-09-12T17:42:06.418399+0000","last_peered":"2024-09-12T17:42:06.418399+0000","last_clean":"2024-09-12T17:42:06.418399+0000","last_became_active":"2024-09-12T16:58:29.775944+0000","last_became_peered":"2024-09-12T16:58:29.775944+0000","last_unstale":"2024-09-12T17:42:06.418399+0000","last_undegraded":"2024-09-12T17:42:06.418399+0000","last_fullsized":"2024-09-12T17:42:06.418399+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'211","last_scrub_stamp":"2024-09-12T17:42:06.418203+0000","last_deep_scrub":"265'211","last_deep_scrub_stamp":"2024-09-12T17:42:06.418203+0000","last_clean_scrub_stamp":"2024-09-12T17:42:06.418203+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:04.604623+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":347,"num_read_kb":347,"num_write":464,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"265'122","reported_seq":683,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:47.372995+0000","last_change":"2024-09-12T17:41:47.372995+0000","last_active":"2024-09-12T17:41:47.372995+0000","last_peered":"2024-09-12T17:41:47.372995+0000","last_clean":"2024-09-12T17:41:47.372995+0000","last_became_active":"2024-09-12T16:58:21.721591+0000","last_became_peered":"2024-09-12T16:58:21.721591+0000","last_unstale":"2024-09-12T17:41:47.372995+0000","last_undegraded":"2024-09-12T17:41:47.372995+0000","last_fullsized":"2024-09-12T17:41:47.372995+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'122","last_scrub_stamp":"2024-09-12T17:41:47.372781+0000","last_deep_scrub":"265'122","last_deep_scrub_stamp":"2024-09-12T17:41:47.372781+0000","last_clean_scrub_stamp":"2024-09-12T17:41:47.372781+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:40.097427+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":495,"num_read_kb":400,"num_write":173,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":530,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:39.559720+0000","last_change":"2024-09-12T17:41:39.559674+0000","last_active":"2024-09-12T17:41:39.559720+0000","last_peered":"2024-09-12T17:41:39.559720+0000","last_clean":"2024-09-12T17:41:39.559720+0000","last_became_active":"2024-09-12T16:58:08.534076+0000","last_became_peered":"2024-09-12T16:58:08.534076+0000","last_unstale":"2024-09-12T17:41:39.559720+0000","last_undegraded":"2024-09-12T17:41:39.559720+0000","last_fullsized":"2024-09-12T17:41:39.559720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:39.559614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:39.559614+0000","last_clean_scrub_stamp":"2024-09-12T17:41:39.559614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:56.106176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00083305900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"265'316","reported_seq":946,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:38.395488+0000","last_change":"2024-09-12T17:41:38.395383+0000","last_active":"2024-09-12T17:41:38.395488+0000","last_peered":"2024-09-12T17:41:38.395488+0000","last_clean":"2024-09-12T17:41:38.395488+0000","last_became_active":"2024-09-12T16:58:18.702490+0000","last_became_peered":"2024-09-12T16:58:18.702490+0000","last_unstale":"2024-09-12T17:41:38.395488+0000","last_undegraded":"2024-09-12T17:41:38.395488+0000","last_fullsized":"2024-09-12T17:41:38.395488+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'316","last_scrub_stamp":"2024-09-12T17:41:38.395252+0000","last_deep_scrub":"265'316","last_deep_scrub_stamp":"2024-09-12T17:41:38.395252+0000","last_clean_scrub_stamp":"2024-09-12T17:41:38.395252+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:23.910993+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263185,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":455,"num_read_kb":7668,"num_write":1054,"num_write_kb":10637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"265'2","reported_seq":508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:45.506695+0000","last_change":"2024-09-12T17:41:45.506695+0000","last_active":"2024-09-12T17:41:45.506695+0000","last_peered":"2024-09-12T17:41:45.506695+0000","last_clean":"2024-09-12T17:41:45.506695+0000","last_became_active":"2024-09-12T16:58:23.724300+0000","last_became_peered":"2024-09-12T16:58:23.724300+0000","last_unstale":"2024-09-12T17:41:45.506695+0000","last_undegraded":"2024-09-12T17:41:45.506695+0000","last_fullsized":"2024-09-12T17:41:45.506695+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T17:41:45.506523+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T17:41:45.506523+0000","last_clean_scrub_stamp":"2024-09-12T17:41:45.506523+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:28.275981+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"265'239","reported_seq":1312,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:01.796160+0000","last_change":"2024-09-12T17:42:01.796002+0000","last_active":"2024-09-12T17:42:01.796160+0000","last_peered":"2024-09-12T17:42:01.796160+0000","last_clean":"2024-09-12T17:42:01.796160+0000","last_became_active":"2024-09-12T16:58:25.949120+0000","last_became_peered":"2024-09-12T16:58:25.949120+0000","last_unstale":"2024-09-12T17:42:01.796160+0000","last_undegraded":"2024-09-12T17:42:01.796160+0000","last_fullsized":"2024-09-12T17:42:01.796160+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'239","last_scrub_stamp":"2024-09-12T17:42:01.795779+0000","last_deep_scrub":"265'239","last_deep_scrub_stamp":"2024-09-12T17:42:01.795779+0000","last_clean_scrub_stamp":"2024-09-12T17:42:01.795779+0000","objects_scrubbed":9,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:22.527870+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":178,"num_read_kb":168,"num_write":143,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5278,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:02.853267+0000","last_change":"2024-09-12T17:42:02.853131+0000","last_active":"2024-09-12T17:42:02.853267+0000","last_peered":"2024-09-12T17:42:02.853267+0000","last_clean":"2024-09-12T17:42:02.853267+0000","last_became_active":"2024-09-12T16:58:27.736215+0000","last_became_peered":"2024-09-12T16:58:27.736215+0000","last_unstale":"2024-09-12T17:42:02.853267+0000","last_undegraded":"2024-09-12T17:42:02.853267+0000","last_fullsized":"2024-09-12T17:42:02.853267+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:02.852940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:02.852940+0000","last_clean_scrub_stamp":"2024-09-12T17:42:02.852940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:03.518647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"265'255","reported_seq":869,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:13.572723+0000","last_change":"2024-09-12T17:42:13.572723+0000","last_active":"2024-09-12T17:42:13.572723+0000","last_peered":"2024-09-12T17:42:13.572723+0000","last_clean":"2024-09-12T17:42:13.572723+0000","last_became_active":"2024-09-12T16:58:29.792069+0000","last_became_peered":"2024-09-12T16:58:29.792069+0000","last_unstale":"2024-09-12T17:42:13.572723+0000","last_undegraded":"2024-09-12T17:42:13.572723+0000","last_fullsized":"2024-09-12T17:42:13.572723+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'255","last_scrub_stamp":"2024-09-12T17:42:13.572532+0000","last_deep_scrub":"265'255","last_deep_scrub_stamp":"2024-09-12T17:42:13.572532+0000","last_clean_scrub_stamp":"2024-09-12T17:42:13.572532+0000","objects_scrubbed":6,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:14.576924+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1041,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":529,"num_read_kb":546,"num_write":531,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"265'182","reported_seq":847,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:44.368918+0000","last_change":"2024-09-12T17:41:44.368734+0000","last_active":"2024-09-12T17:41:44.368918+0000","last_peered":"2024-09-12T17:41:44.368918+0000","last_clean":"2024-09-12T17:41:44.368918+0000","last_became_active":"2024-09-12T16:58:21.729848+0000","last_became_peered":"2024-09-12T16:58:21.729848+0000","last_unstale":"2024-09-12T17:41:44.368918+0000","last_undegraded":"2024-09-12T17:41:44.368918+0000","last_fullsized":"2024-09-12T17:41:44.368918+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'182","last_scrub_stamp":"2024-09-12T17:41:44.368559+0000","last_deep_scrub":"265'182","last_deep_scrub_stamp":"2024-09-12T17:41:44.368559+0000","last_clean_scrub_stamp":"2024-09-12T17:41:44.368559+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:17.854539+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":860,"num_read_kb":722,"num_write":267,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"265'3","reported_seq":532,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:39.591713+0000","last_change":"2024-09-12T17:41:39.591479+0000","last_active":"2024-09-12T17:41:39.591713+0000","last_peered":"2024-09-12T17:41:39.591713+0000","last_clean":"2024-09-12T17:41:39.591713+0000","last_became_active":"2024-09-12T16:58:08.538078+0000","last_became_peered":"2024-09-12T16:58:08.538078+0000","last_unstale":"2024-09-12T17:41:39.591713+0000","last_undegraded":"2024-09-12T17:41:39.591713+0000","last_fullsized":"2024-09-12T17:41:39.591713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T17:41:39.591211+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T17:41:39.591211+0000","last_clean_scrub_stamp":"2024-09-12T17:41:39.591211+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:33.661873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012028640000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"265'367","reported_seq":1087,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:38.629163+0000","last_change":"2024-09-12T17:41:38.629003+0000","last_active":"2024-09-12T17:41:38.629163+0000","last_peered":"2024-09-12T17:41:38.629163+0000","last_clean":"2024-09-12T17:41:38.629163+0000","last_became_active":"2024-09-12T16:58:18.690974+0000","last_became_peered":"2024-09-12T16:58:18.690974+0000","last_unstale":"2024-09-12T17:41:38.629163+0000","last_undegraded":"2024-09-12T17:41:38.629163+0000","last_fullsized":"2024-09-12T17:41:38.629163+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'367","last_scrub_stamp":"2024-09-12T17:41:38.628803+0000","last_deep_scrub":"265'367","last_deep_scrub_stamp":"2024-09-12T17:41:38.628803+0000","last_clean_scrub_stamp":"2024-09-12T17:41:38.628803+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:15.373546+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1105801,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":657,"num_read_kb":31815,"num_write":1139,"num_write_kb":57340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:56.985235+0000","last_change":"2024-09-12T17:41:56.985088+0000","last_active":"2024-09-12T17:41:56.985235+0000","last_peered":"2024-09-12T17:41:56.985235+0000","last_clean":"2024-09-12T17:41:56.985235+0000","last_became_active":"2024-09-12T16:58:23.713019+0000","last_became_peered":"2024-09-12T16:58:23.713019+0000","last_unstale":"2024-09-12T17:41:56.985235+0000","last_undegraded":"2024-09-12T17:41:56.985235+0000","last_fullsized":"2024-09-12T17:41:56.985235+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:56.984910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:56.984910+0000","last_clean_scrub_stamp":"2024-09-12T17:41:56.984910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:28.683508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"265'113","reported_seq":663,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:02.605508+0000","last_change":"2024-09-12T17:42:02.605508+0000","last_active":"2024-09-12T17:42:02.605508+0000","last_peered":"2024-09-12T17:42:02.605508+0000","last_clean":"2024-09-12T17:42:02.605508+0000","last_became_active":"2024-09-12T16:58:25.718364+0000","last_became_peered":"2024-09-12T16:58:25.718364+0000","last_unstale":"2024-09-12T17:42:02.605508+0000","last_undegraded":"2024-09-12T17:42:02.605508+0000","last_fullsized":"2024-09-12T17:42:02.605508+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'113","last_scrub_stamp":"2024-09-12T17:42:02.605277+0000","last_deep_scrub":"265'113","last_deep_scrub_stamp":"2024-09-12T17:42:02.605277+0000","last_clean_scrub_stamp":"2024-09-12T17:42:02.605277+0000","objects_scrubbed":7,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:02.779136+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":134,"num_write":100,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3358,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:58.366963+0000","last_change":"2024-09-12T17:41:58.366963+0000","last_active":"2024-09-12T17:41:58.366963+0000","last_peered":"2024-09-12T17:41:58.366963+0000","last_clean":"2024-09-12T17:41:58.366963+0000","last_became_active":"2024-09-12T16:58:27.761992+0000","last_became_peered":"2024-09-12T16:58:27.761992+0000","last_unstale":"2024-09-12T17:41:58.366963+0000","last_undegraded":"2024-09-12T17:41:58.366963+0000","last_fullsized":"2024-09-12T17:41:58.366963+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:58.366783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:58.366783+0000","last_clean_scrub_stamp":"2024-09-12T17:41:58.366783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:00.374257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"265'110","reported_seq":672,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:10.566248+0000","last_change":"2024-09-12T17:42:10.566248+0000","last_active":"2024-09-12T17:42:10.566248+0000","last_peered":"2024-09-12T17:42:10.566248+0000","last_clean":"2024-09-12T17:42:10.566248+0000","last_became_active":"2024-09-12T16:58:29.787823+0000","last_became_peered":"2024-09-12T16:58:29.787823+0000","last_unstale":"2024-09-12T17:42:10.566248+0000","last_undegraded":"2024-09-12T17:42:10.566248+0000","last_fullsized":"2024-09-12T17:42:10.566248+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'110","last_scrub_stamp":"2024-09-12T17:42:10.566058+0000","last_deep_scrub":"265'110","last_deep_scrub_stamp":"2024-09-12T17:42:10.566058+0000","last_clean_scrub_stamp":"2024-09-12T17:42:10.566058+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:05.960107+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":275,"num_read_kb":264,"num_write":276,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"265'60","reported_seq":622,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:46.382523+0000","last_change":"2024-09-12T17:41:46.382243+0000","last_active":"2024-09-12T17:41:46.382523+0000","last_peered":"2024-09-12T17:41:46.382523+0000","last_clean":"2024-09-12T17:41:46.382523+0000","last_became_active":"2024-09-12T16:58:21.720884+0000","last_became_peered":"2024-09-12T16:58:21.720884+0000","last_unstale":"2024-09-12T17:41:46.382523+0000","last_undegraded":"2024-09-12T17:41:46.382523+0000","last_fullsized":"2024-09-12T17:41:46.382523+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'60","last_scrub_stamp":"2024-09-12T17:41:46.382003+0000","last_deep_scrub":"265'60","last_deep_scrub_stamp":"2024-09-12T17:41:46.382003+0000","last_clean_scrub_stamp":"2024-09-12T17:41:46.382003+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:39.632797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":223,"num_write":91,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"265'382","reported_seq":1037,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:41.628013+0000","last_change":"2024-09-12T17:41:41.627826+0000","last_active":"2024-09-12T17:41:41.628013+0000","last_peered":"2024-09-12T17:41:41.628013+0000","last_clean":"2024-09-12T17:41:41.628013+0000","last_became_active":"2024-09-12T16:58:18.718447+0000","last_became_peered":"2024-09-12T16:58:18.718447+0000","last_unstale":"2024-09-12T17:41:41.628013+0000","last_undegraded":"2024-09-12T17:41:41.628013+0000","last_fullsized":"2024-09-12T17:41:41.628013+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'382","last_scrub_stamp":"2024-09-12T17:41:41.627618+0000","last_deep_scrub":"265'382","last_deep_scrub_stamp":"2024-09-12T17:41:41.627618+0000","last_clean_scrub_stamp":"2024-09-12T17:41:41.627618+0000","objects_scrubbed":6,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:27.860391+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569509,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":515,"num_read_kb":35874,"num_write":1210,"num_write_kb":51856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:39.427247+0000","last_change":"2024-09-12T17:41:39.427122+0000","last_active":"2024-09-12T17:41:39.427247+0000","last_peered":"2024-09-12T17:41:39.427247+0000","last_clean":"2024-09-12T17:41:39.427247+0000","last_became_active":"2024-09-12T16:58:08.842793+0000","last_became_peered":"2024-09-12T16:58:08.842793+0000","last_unstale":"2024-09-12T17:41:39.427247+0000","last_undegraded":"2024-09-12T17:41:39.427247+0000","last_fullsized":"2024-09-12T17:41:39.427247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:39.426951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:39.426951+0000","last_clean_scrub_stamp":"2024-09-12T17:41:39.426951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:26.839539+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001121181,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:55.062525+0000","last_change":"2024-09-12T17:41:55.062333+0000","last_active":"2024-09-12T17:41:55.062525+0000","last_peered":"2024-09-12T17:41:55.062525+0000","last_clean":"2024-09-12T17:41:55.062525+0000","last_became_active":"2024-09-12T16:58:23.710355+0000","last_became_peered":"2024-09-12T16:58:23.710355+0000","last_unstale":"2024-09-12T17:41:55.062525+0000","last_undegraded":"2024-09-12T17:41:55.062525+0000","last_fullsized":"2024-09-12T17:41:55.062525+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:55.062149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:55.062149+0000","last_clean_scrub_stamp":"2024-09-12T17:41:55.062149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:43.683368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"265'579","reported_seq":1248,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:00.973116+0000","last_change":"2024-09-12T17:42:00.972950+0000","last_active":"2024-09-12T17:42:00.973116+0000","last_peered":"2024-09-12T17:42:00.973116+0000","last_clean":"2024-09-12T17:42:00.973116+0000","last_became_active":"2024-09-12T16:58:25.729627+0000","last_became_peered":"2024-09-12T16:58:25.729627+0000","last_unstale":"2024-09-12T17:42:00.973116+0000","last_undegraded":"2024-09-12T17:42:00.973116+0000","last_fullsized":"2024-09-12T17:42:00.973116+0000","mapping_epoch":30,"log_start":"265'500","ondisk_log_start":"265'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'579","last_scrub_stamp":"2024-09-12T17:42:00.972736+0000","last_deep_scrub":"265'579","last_deep_scrub_stamp":"2024-09-12T17:42:00.972736+0000","last_clean_scrub_stamp":"2024-09-12T17:42:00.972736+0000","objects_scrubbed":11,"log_size":79,"log_dups_size":500,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:33.694731+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101207,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1575,"num_read_kb":2772,"num_write":2032,"num_write_kb":1870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":506974,"num_omap_keys":1146,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:07.590551+0000","last_change":"2024-09-12T17:42:07.590263+0000","last_active":"2024-09-12T17:42:07.590551+0000","last_peered":"2024-09-12T17:42:07.590551+0000","last_clean":"2024-09-12T17:42:07.590551+0000","last_became_active":"2024-09-12T16:58:27.733289+0000","last_became_peered":"2024-09-12T16:58:27.733289+0000","last_unstale":"2024-09-12T17:42:07.590551+0000","last_undegraded":"2024-09-12T17:42:07.590551+0000","last_fullsized":"2024-09-12T17:42:07.590551+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:07.590042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:07.590042+0000","last_clean_scrub_stamp":"2024-09-12T17:42:07.590042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:02.078261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"265'161","reported_seq":673,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:13.948775+0000","last_change":"2024-09-12T17:42:13.948775+0000","last_active":"2024-09-12T17:42:13.948775+0000","last_peered":"2024-09-12T17:42:13.948775+0000","last_clean":"2024-09-12T17:42:13.948775+0000","last_became_active":"2024-09-12T16:58:29.779052+0000","last_became_peered":"2024-09-12T16:58:29.779052+0000","last_unstale":"2024-09-12T17:42:13.948775+0000","last_undegraded":"2024-09-12T17:42:13.948775+0000","last_fullsized":"2024-09-12T17:42:13.948775+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'161","last_scrub_stamp":"2024-09-12T17:42:13.948585+0000","last_deep_scrub":"265'161","last_deep_scrub_stamp":"2024-09-12T17:42:13.948585+0000","last_clean_scrub_stamp":"2024-09-12T17:42:13.948585+0000","objects_scrubbed":4,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:24.925033+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":199,"num_read_kb":192,"num_write":361,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"265'202","reported_seq":815,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:46.191761+0000","last_change":"2024-09-12T17:41:46.191587+0000","last_active":"2024-09-12T17:41:46.191761+0000","last_peered":"2024-09-12T17:41:46.191761+0000","last_clean":"2024-09-12T17:41:46.191761+0000","last_became_active":"2024-09-12T16:58:21.701657+0000","last_became_peered":"2024-09-12T16:58:21.701657+0000","last_unstale":"2024-09-12T17:41:46.191761+0000","last_undegraded":"2024-09-12T17:41:46.191761+0000","last_fullsized":"2024-09-12T17:41:46.191761+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'202","last_scrub_stamp":"2024-09-12T17:41:46.191396+0000","last_deep_scrub":"265'202","last_deep_scrub_stamp":"2024-09-12T17:41:46.191396+0000","last_clean_scrub_stamp":"2024-09-12T17:41:46.191396+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:56.805877+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":888,"num_read_kb":728,"num_write":297,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"265'333","reported_seq":966,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:42.447729+0000","last_change":"2024-09-12T17:41:42.447586+0000","last_active":"2024-09-12T17:41:42.447729+0000","last_peered":"2024-09-12T17:41:42.447729+0000","last_clean":"2024-09-12T17:41:42.447729+0000","last_became_active":"2024-09-12T16:58:18.698417+0000","last_became_peered":"2024-09-12T16:58:18.698417+0000","last_unstale":"2024-09-12T17:41:42.447729+0000","last_undegraded":"2024-09-12T17:41:42.447729+0000","last_fullsized":"2024-09-12T17:41:42.447729+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'333","last_scrub_stamp":"2024-09-12T17:41:42.447381+0000","last_deep_scrub":"265'333","last_deep_scrub_stamp":"2024-09-12T17:41:42.447381+0000","last_clean_scrub_stamp":"2024-09-12T17:41:42.447381+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:25.913614+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":462,"num_read_kb":2498,"num_write":998,"num_write_kb":19196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:48.544743+0000","last_change":"2024-09-12T17:41:48.544587+0000","last_active":"2024-09-12T17:41:48.544743+0000","last_peered":"2024-09-12T17:41:48.544743+0000","last_clean":"2024-09-12T17:41:48.544743+0000","last_became_active":"2024-09-12T16:58:08.841831+0000","last_became_peered":"2024-09-12T16:58:08.841831+0000","last_unstale":"2024-09-12T17:41:48.544743+0000","last_undegraded":"2024-09-12T17:41:48.544743+0000","last_fullsized":"2024-09-12T17:41:48.544743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:48.544399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:48.544399+0000","last_clean_scrub_stamp":"2024-09-12T17:41:48.544399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:56.853257+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0013535820000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:52.494249+0000","last_change":"2024-09-12T17:41:52.494127+0000","last_active":"2024-09-12T17:41:52.494249+0000","last_peered":"2024-09-12T17:41:52.494249+0000","last_clean":"2024-09-12T17:41:52.494249+0000","last_became_active":"2024-09-12T16:58:23.707729+0000","last_became_peered":"2024-09-12T16:58:23.707729+0000","last_unstale":"2024-09-12T17:41:52.494249+0000","last_undegraded":"2024-09-12T17:41:52.494249+0000","last_fullsized":"2024-09-12T17:41:52.494249+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:52.493942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:52.493942+0000","last_clean_scrub_stamp":"2024-09-12T17:41:52.493942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:36.835671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"265'158","reported_seq":727,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:55.406020+0000","last_change":"2024-09-12T17:41:55.405867+0000","last_active":"2024-09-12T17:41:55.406020+0000","last_peered":"2024-09-12T17:41:55.406020+0000","last_clean":"2024-09-12T17:41:55.406020+0000","last_became_active":"2024-09-12T16:58:25.950057+0000","last_became_peered":"2024-09-12T16:58:25.950057+0000","last_unstale":"2024-09-12T17:41:55.406020+0000","last_undegraded":"2024-09-12T17:41:55.406020+0000","last_fullsized":"2024-09-12T17:41:55.406020+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'158","last_scrub_stamp":"2024-09-12T17:41:55.405681+0000","last_deep_scrub":"265'158","last_deep_scrub_stamp":"2024-09-12T17:41:55.405681+0000","last_clean_scrub_stamp":"2024-09-12T17:41:55.405681+0000","objects_scrubbed":8,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:53.277423+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":199,"num_read_kb":190,"num_write":134,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"265'771","reported_seq":2780,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:08.616365+0000","last_change":"2024-09-12T17:42:08.616222+0000","last_active":"2024-09-12T17:42:08.616365+0000","last_peered":"2024-09-12T17:42:08.616365+0000","last_clean":"2024-09-12T17:42:08.616365+0000","last_became_active":"2024-09-12T16:58:27.756883+0000","last_became_peered":"2024-09-12T16:58:27.756883+0000","last_unstale":"2024-09-12T17:42:08.616365+0000","last_undegraded":"2024-09-12T17:42:08.616365+0000","last_fullsized":"2024-09-12T17:42:08.616365+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'771","last_scrub_stamp":"2024-09-12T17:42:08.616048+0000","last_deep_scrub":"265'771","last_deep_scrub_stamp":"2024-09-12T17:42:08.616048+0000","last_clean_scrub_stamp":"2024-09-12T17:42:08.616048+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:03.636002+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"265'137","reported_seq":644,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:12.551289+0000","last_change":"2024-09-12T17:42:12.551289+0000","last_active":"2024-09-12T17:42:12.551289+0000","last_peered":"2024-09-12T17:42:12.551289+0000","last_clean":"2024-09-12T17:42:12.551289+0000","last_became_active":"2024-09-12T16:58:29.784743+0000","last_became_peered":"2024-09-12T16:58:29.784743+0000","last_unstale":"2024-09-12T17:42:12.551289+0000","last_undegraded":"2024-09-12T17:42:12.551289+0000","last_fullsized":"2024-09-12T17:42:12.551289+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'137","last_scrub_stamp":"2024-09-12T17:42:12.551048+0000","last_deep_scrub":"265'137","last_deep_scrub_stamp":"2024-09-12T17:42:12.551048+0000","last_clean_scrub_stamp":"2024-09-12T17:42:12.551048+0000","objects_scrubbed":6,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:55.389053+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1532,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":153,"num_read_kb":151,"num_write":316,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"265'50","reported_seq":596,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:46.640601+0000","last_change":"2024-09-12T17:41:46.640425+0000","last_active":"2024-09-12T17:41:46.640601+0000","last_peered":"2024-09-12T17:41:46.640601+0000","last_clean":"2024-09-12T17:41:46.640601+0000","last_became_active":"2024-09-12T16:58:21.723391+0000","last_became_peered":"2024-09-12T16:58:21.723391+0000","last_unstale":"2024-09-12T17:41:46.640601+0000","last_undegraded":"2024-09-12T17:41:46.640601+0000","last_fullsized":"2024-09-12T17:41:46.640601+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'50","last_scrub_stamp":"2024-09-12T17:41:46.640257+0000","last_deep_scrub":"265'50","last_deep_scrub_stamp":"2024-09-12T17:41:46.640257+0000","last_clean_scrub_stamp":"2024-09-12T17:41:46.640257+0000","objects_scrubbed":1,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:57.222046+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":182,"num_write":83,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":760,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"265'466","reported_seq":1113,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:38.799638+0000","last_change":"2024-09-12T17:41:38.799581+0000","last_active":"2024-09-12T17:41:38.799638+0000","last_peered":"2024-09-12T17:41:38.799638+0000","last_clean":"2024-09-12T17:41:38.799638+0000","last_became_active":"2024-09-12T16:58:18.686966+0000","last_became_peered":"2024-09-12T16:58:18.686966+0000","last_unstale":"2024-09-12T17:41:38.799638+0000","last_undegraded":"2024-09-12T17:41:38.799638+0000","last_fullsized":"2024-09-12T17:41:38.799638+0000","mapping_epoch":23,"log_start":"265'400","ondisk_log_start":"265'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'466","last_scrub_stamp":"2024-09-12T17:41:38.799492+0000","last_deep_scrub":"265'466","last_deep_scrub_stamp":"2024-09-12T17:41:38.799492+0000","last_clean_scrub_stamp":"2024-09-12T17:41:38.799492+0000","objects_scrubbed":7,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:31.946406+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376560,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":630,"num_read_kb":10296,"num_write":1224,"num_write_kb":24848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:37.425805+0000","last_change":"2024-09-12T17:41:37.425805+0000","last_active":"2024-09-12T17:41:37.425805+0000","last_peered":"2024-09-12T17:41:37.425805+0000","last_clean":"2024-09-12T17:41:37.425805+0000","last_became_active":"2024-09-12T16:58:08.544406+0000","last_became_peered":"2024-09-12T16:58:08.544406+0000","last_unstale":"2024-09-12T17:41:37.425805+0000","last_undegraded":"2024-09-12T17:41:37.425805+0000","last_fullsized":"2024-09-12T17:41:37.425805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:37.425638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:37.425638+0000","last_clean_scrub_stamp":"2024-09-12T17:41:37.425638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:38.294788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012247510000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:59.649035+0000","last_change":"2024-09-12T17:41:59.648870+0000","last_active":"2024-09-12T17:41:59.649035+0000","last_peered":"2024-09-12T17:41:59.649035+0000","last_clean":"2024-09-12T17:41:59.649035+0000","last_became_active":"2024-09-12T16:58:23.700331+0000","last_became_peered":"2024-09-12T16:58:23.700331+0000","last_unstale":"2024-09-12T17:41:59.649035+0000","last_undegraded":"2024-09-12T17:41:59.649035+0000","last_fullsized":"2024-09-12T17:41:59.649035+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:59.648693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:59.648693+0000","last_clean_scrub_stamp":"2024-09-12T17:41:59.648693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:33.328184+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"265'125","reported_seq":669,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:03.557099+0000","last_change":"2024-09-12T17:42:03.556962+0000","last_active":"2024-09-12T17:42:03.557099+0000","last_peered":"2024-09-12T17:42:03.557099+0000","last_clean":"2024-09-12T17:42:03.557099+0000","last_became_active":"2024-09-12T16:58:25.730018+0000","last_became_peered":"2024-09-12T16:58:25.730018+0000","last_unstale":"2024-09-12T17:42:03.557099+0000","last_undegraded":"2024-09-12T17:42:03.557099+0000","last_fullsized":"2024-09-12T17:42:03.557099+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'125","last_scrub_stamp":"2024-09-12T17:42:03.556760+0000","last_deep_scrub":"265'125","last_deep_scrub_stamp":"2024-09-12T17:42:03.556760+0000","last_clean_scrub_stamp":"2024-09-12T17:42:03.556760+0000","objects_scrubbed":6,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:04.648557+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":134,"num_read_kb":123,"num_write":96,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"265'787","reported_seq":2358,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:09.504241+0000","last_change":"2024-09-12T17:42:09.504081+0000","last_active":"2024-09-12T17:42:09.504241+0000","last_peered":"2024-09-12T17:42:09.504241+0000","last_clean":"2024-09-12T17:42:09.504241+0000","last_became_active":"2024-09-12T16:58:27.746177+0000","last_became_peered":"2024-09-12T16:58:27.746177+0000","last_unstale":"2024-09-12T17:42:09.504241+0000","last_undegraded":"2024-09-12T17:42:09.504241+0000","last_fullsized":"2024-09-12T17:42:09.504241+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'787","last_scrub_stamp":"2024-09-12T17:42:09.503916+0000","last_deep_scrub":"265'787","last_deep_scrub_stamp":"2024-09-12T17:42:09.503916+0000","last_clean_scrub_stamp":"2024-09-12T17:42:09.503916+0000","objects_scrubbed":1,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:19.410476+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"265'172","reported_seq":674,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:12.969049+0000","last_change":"2024-09-12T17:42:12.969049+0000","last_active":"2024-09-12T17:42:12.969049+0000","last_peered":"2024-09-12T17:42:12.969049+0000","last_clean":"2024-09-12T17:42:12.969049+0000","last_became_active":"2024-09-12T16:58:29.790535+0000","last_became_peered":"2024-09-12T16:58:29.790535+0000","last_unstale":"2024-09-12T17:42:12.969049+0000","last_undegraded":"2024-09-12T17:42:12.969049+0000","last_fullsized":"2024-09-12T17:42:12.969049+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'172","last_scrub_stamp":"2024-09-12T17:42:12.968804+0000","last_deep_scrub":"265'172","last_deep_scrub_stamp":"2024-09-12T17:42:12.968804+0000","last_clean_scrub_stamp":"2024-09-12T17:42:12.968804+0000","objects_scrubbed":4,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:51:37.815722+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":476,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":147,"num_read_kb":144,"num_write":393,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"265'96","reported_seq":669,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:43.661704+0000","last_change":"2024-09-12T17:41:43.661578+0000","last_active":"2024-09-12T17:41:43.661704+0000","last_peered":"2024-09-12T17:41:43.661704+0000","last_clean":"2024-09-12T17:41:43.661704+0000","last_became_active":"2024-09-12T16:58:21.701206+0000","last_became_peered":"2024-09-12T16:58:21.701206+0000","last_unstale":"2024-09-12T17:41:43.661704+0000","last_undegraded":"2024-09-12T17:41:43.661704+0000","last_fullsized":"2024-09-12T17:41:43.661704+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'96","last_scrub_stamp":"2024-09-12T17:41:43.661384+0000","last_deep_scrub":"265'96","last_deep_scrub_stamp":"2024-09-12T17:41:43.661384+0000","last_clean_scrub_stamp":"2024-09-12T17:41:43.661384+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:19.823171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":405,"num_read_kb":331,"num_write":157,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"265'370","reported_seq":1035,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:37.268281+0000","last_change":"2024-09-12T17:41:37.268183+0000","last_active":"2024-09-12T17:41:37.268281+0000","last_peered":"2024-09-12T17:41:37.268281+0000","last_clean":"2024-09-12T17:41:37.268281+0000","last_became_active":"2024-09-12T16:58:18.701270+0000","last_became_peered":"2024-09-12T16:58:18.701270+0000","last_unstale":"2024-09-12T17:41:37.268281+0000","last_undegraded":"2024-09-12T17:41:37.268281+0000","last_fullsized":"2024-09-12T17:41:37.268281+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'370","last_scrub_stamp":"2024-09-12T17:41:37.268034+0000","last_deep_scrub":"265'370","last_deep_scrub_stamp":"2024-09-12T17:41:37.268034+0000","last_clean_scrub_stamp":"2024-09-12T17:41:37.268034+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:22.095358+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":575,"num_read_kb":17292,"num_write":1132,"num_write_kb":31476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:39.456766+0000","last_change":"2024-09-12T17:41:39.456766+0000","last_active":"2024-09-12T17:41:39.456766+0000","last_peered":"2024-09-12T17:41:39.456766+0000","last_clean":"2024-09-12T17:41:39.456766+0000","last_became_active":"2024-09-12T16:58:08.546519+0000","last_became_peered":"2024-09-12T16:58:08.546519+0000","last_unstale":"2024-09-12T17:41:39.456766+0000","last_undegraded":"2024-09-12T17:41:39.456766+0000","last_fullsized":"2024-09-12T17:41:39.456766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:39.456592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:39.456592+0000","last_clean_scrub_stamp":"2024-09-12T17:41:39.456592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:55.571196+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00088376600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":510,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:00.527620+0000","last_change":"2024-09-12T17:42:00.527570+0000","last_active":"2024-09-12T17:42:00.527620+0000","last_peered":"2024-09-12T17:42:00.527620+0000","last_clean":"2024-09-12T17:42:00.527620+0000","last_became_active":"2024-09-12T16:58:23.707022+0000","last_became_peered":"2024-09-12T16:58:23.707022+0000","last_unstale":"2024-09-12T17:42:00.527620+0000","last_undegraded":"2024-09-12T17:42:00.527620+0000","last_fullsized":"2024-09-12T17:42:00.527620+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:00.527484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:00.527484+0000","last_clean_scrub_stamp":"2024-09-12T17:42:00.527484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:59.130451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"265'749","reported_seq":1475,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:04.776744+0000","last_change":"2024-09-12T17:42:04.776585+0000","last_active":"2024-09-12T17:42:04.776744+0000","last_peered":"2024-09-12T17:42:04.776744+0000","last_clean":"2024-09-12T17:42:04.776744+0000","last_became_active":"2024-09-12T16:58:25.949263+0000","last_became_peered":"2024-09-12T16:58:25.949263+0000","last_unstale":"2024-09-12T17:42:04.776744+0000","last_undegraded":"2024-09-12T17:42:04.776744+0000","last_fullsized":"2024-09-12T17:42:04.776744+0000","mapping_epoch":30,"log_start":"265'700","ondisk_log_start":"265'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'749","last_scrub_stamp":"2024-09-12T17:42:04.776391+0000","last_deep_scrub":"265'749","last_deep_scrub_stamp":"2024-09-12T17:42:04.776391+0000","last_clean_scrub_stamp":"2024-09-12T17:42:04.776391+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":700,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:08:09.245677+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143781,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1330,"num_read_kb":3188,"num_write":1090,"num_write_kb":918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:08.521874+0000","last_change":"2024-09-12T17:42:08.521720+0000","last_active":"2024-09-12T17:42:08.521874+0000","last_peered":"2024-09-12T17:42:08.521874+0000","last_clean":"2024-09-12T17:42:08.521874+0000","last_became_active":"2024-09-12T16:58:27.741779+0000","last_became_peered":"2024-09-12T16:58:27.741779+0000","last_unstale":"2024-09-12T17:42:08.521874+0000","last_undegraded":"2024-09-12T17:42:08.521874+0000","last_fullsized":"2024-09-12T17:42:08.521874+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:08.521530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:08.521530+0000","last_clean_scrub_stamp":"2024-09-12T17:42:08.521530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:15.340697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"265'146","reported_seq":656,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:11.551278+0000","last_change":"2024-09-12T17:42:11.551278+0000","last_active":"2024-09-12T17:42:11.551278+0000","last_peered":"2024-09-12T17:42:11.551278+0000","last_clean":"2024-09-12T17:42:11.551278+0000","last_became_active":"2024-09-12T16:58:29.787692+0000","last_became_peered":"2024-09-12T16:58:29.787692+0000","last_unstale":"2024-09-12T17:42:11.551278+0000","last_undegraded":"2024-09-12T17:42:11.551278+0000","last_fullsized":"2024-09-12T17:42:11.551278+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'146","last_scrub_stamp":"2024-09-12T17:42:11.551054+0000","last_deep_scrub":"265'146","last_deep_scrub_stamp":"2024-09-12T17:42:11.551054+0000","last_clean_scrub_stamp":"2024-09-12T17:42:11.551054+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:05.463173+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":218,"num_read_kb":207,"num_write":364,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"265'165","reported_seq":724,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:15.907409+0000","last_change":"2024-09-12T17:42:15.907275+0000","last_active":"2024-09-12T17:42:15.907409+0000","last_peered":"2024-09-12T17:42:15.907409+0000","last_clean":"2024-09-12T17:42:15.907409+0000","last_became_active":"2024-09-12T16:58:29.782784+0000","last_became_peered":"2024-09-12T16:58:29.782784+0000","last_unstale":"2024-09-12T17:42:15.907409+0000","last_undegraded":"2024-09-12T17:42:15.907409+0000","last_fullsized":"2024-09-12T17:42:15.907409+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'165","last_scrub_stamp":"2024-09-12T17:42:15.907089+0000","last_deep_scrub":"265'165","last_deep_scrub_stamp":"2024-09-12T17:42:15.907089+0000","last_clean_scrub_stamp":"2024-09-12T17:42:15.907089+0000","objects_scrubbed":3,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:34.767730+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":629,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":266,"num_read_kb":264,"num_write":397,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"265'100","reported_seq":696,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:47.569766+0000","last_change":"2024-09-12T17:41:47.569629+0000","last_active":"2024-09-12T17:41:47.569766+0000","last_peered":"2024-09-12T17:41:47.569766+0000","last_clean":"2024-09-12T17:41:47.569766+0000","last_became_active":"2024-09-12T16:58:21.731509+0000","last_became_peered":"2024-09-12T16:58:21.731509+0000","last_unstale":"2024-09-12T17:41:47.569766+0000","last_undegraded":"2024-09-12T17:41:47.569766+0000","last_fullsized":"2024-09-12T17:41:47.569766+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'100","last_scrub_stamp":"2024-09-12T17:41:47.569417+0000","last_deep_scrub":"265'100","last_deep_scrub_stamp":"2024-09-12T17:41:47.569417+0000","last_clean_scrub_stamp":"2024-09-12T17:41:47.569417+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:35.252758+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":445,"num_read_kb":375,"num_write":158,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"265'305","reported_seq":939,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:39.652053+0000","last_change":"2024-09-12T17:41:39.651915+0000","last_active":"2024-09-12T17:41:39.652053+0000","last_peered":"2024-09-12T17:41:39.652053+0000","last_clean":"2024-09-12T17:41:39.652053+0000","last_became_active":"2024-09-12T16:58:18.700214+0000","last_became_peered":"2024-09-12T16:58:18.700214+0000","last_unstale":"2024-09-12T17:41:39.652053+0000","last_undegraded":"2024-09-12T17:41:39.652053+0000","last_fullsized":"2024-09-12T17:41:39.652053+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'305","last_scrub_stamp":"2024-09-12T17:41:39.651676+0000","last_deep_scrub":"265'305","last_deep_scrub_stamp":"2024-09-12T17:41:39.651676+0000","last_clean_scrub_stamp":"2024-09-12T17:41:39.651676+0000","objects_scrubbed":6,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:32.335113+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":472,"num_read_kb":3767,"num_write":1042,"num_write_kb":19533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:53.398268+0000","last_change":"2024-09-12T17:41:53.398007+0000","last_active":"2024-09-12T17:41:53.398268+0000","last_peered":"2024-09-12T17:41:53.398268+0000","last_clean":"2024-09-12T17:41:53.398268+0000","last_became_active":"2024-09-12T16:58:23.725034+0000","last_became_peered":"2024-09-12T16:58:23.725034+0000","last_unstale":"2024-09-12T17:41:53.398268+0000","last_undegraded":"2024-09-12T17:41:53.398268+0000","last_fullsized":"2024-09-12T17:41:53.398268+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:53.397794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:53.397794+0000","last_clean_scrub_stamp":"2024-09-12T17:41:53.397794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:47.628035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"265'277","reported_seq":861,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:06.606593+0000","last_change":"2024-09-12T17:42:06.606460+0000","last_active":"2024-09-12T17:42:06.606593+0000","last_peered":"2024-09-12T17:42:06.606593+0000","last_clean":"2024-09-12T17:42:06.606593+0000","last_became_active":"2024-09-12T16:58:25.737706+0000","last_became_peered":"2024-09-12T16:58:25.737706+0000","last_unstale":"2024-09-12T17:42:06.606593+0000","last_undegraded":"2024-09-12T17:42:06.606593+0000","last_fullsized":"2024-09-12T17:42:06.606593+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'277","last_scrub_stamp":"2024-09-12T17:42:06.606252+0000","last_deep_scrub":"265'277","last_deep_scrub_stamp":"2024-09-12T17:42:06.606252+0000","last_clean_scrub_stamp":"2024-09-12T17:42:06.606252+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:10.416041+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54495,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":451,"num_read_kb":1025,"num_write":366,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:14.553409+0000","last_change":"2024-09-12T17:42:14.553135+0000","last_active":"2024-09-12T17:42:14.553409+0000","last_peered":"2024-09-12T17:42:14.553409+0000","last_clean":"2024-09-12T17:42:14.553409+0000","last_became_active":"2024-09-12T16:58:27.746143+0000","last_became_peered":"2024-09-12T16:58:27.746143+0000","last_unstale":"2024-09-12T17:42:14.553409+0000","last_undegraded":"2024-09-12T17:42:14.553409+0000","last_fullsized":"2024-09-12T17:42:14.553409+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:14.552932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:14.552932+0000","last_clean_scrub_stamp":"2024-09-12T17:42:14.552932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:22.802420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"265'116","reported_seq":635,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:18.559852+0000","last_change":"2024-09-12T17:42:18.559711+0000","last_active":"2024-09-12T17:42:18.559852+0000","last_peered":"2024-09-12T17:42:18.559852+0000","last_clean":"2024-09-12T17:42:18.559852+0000","last_became_active":"2024-09-12T16:58:29.784143+0000","last_became_peered":"2024-09-12T16:58:29.784143+0000","last_unstale":"2024-09-12T17:42:18.559852+0000","last_undegraded":"2024-09-12T17:42:18.559852+0000","last_fullsized":"2024-09-12T17:42:18.559852+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'116","last_scrub_stamp":"2024-09-12T17:42:18.559531+0000","last_deep_scrub":"265'116","last_deep_scrub_stamp":"2024-09-12T17:42:18.559531+0000","last_clean_scrub_stamp":"2024-09-12T17:42:18.559531+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:37.445695+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":186,"num_write":283,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"265'174","reported_seq":836,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:49.351838+0000","last_change":"2024-09-12T17:41:49.351699+0000","last_active":"2024-09-12T17:41:49.351838+0000","last_peered":"2024-09-12T17:41:49.351838+0000","last_clean":"2024-09-12T17:41:49.351838+0000","last_became_active":"2024-09-12T16:58:21.715193+0000","last_became_peered":"2024-09-12T16:58:21.715193+0000","last_unstale":"2024-09-12T17:41:49.351838+0000","last_undegraded":"2024-09-12T17:41:49.351838+0000","last_fullsized":"2024-09-12T17:41:49.351838+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'174","last_scrub_stamp":"2024-09-12T17:41:49.351495+0000","last_deep_scrub":"265'174","last_deep_scrub_stamp":"2024-09-12T17:41:49.351495+0000","last_clean_scrub_stamp":"2024-09-12T17:41:49.351495+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:24.477655+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":752,"num_read_kb":633,"num_write":248,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"265'344","reported_seq":980,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:47.512874+0000","last_change":"2024-09-12T17:41:47.512734+0000","last_active":"2024-09-12T17:41:47.512874+0000","last_peered":"2024-09-12T17:41:47.512874+0000","last_clean":"2024-09-12T17:41:47.512874+0000","last_became_active":"2024-09-12T16:58:18.686155+0000","last_became_peered":"2024-09-12T16:58:18.686155+0000","last_unstale":"2024-09-12T17:41:47.512874+0000","last_undegraded":"2024-09-12T17:41:47.512874+0000","last_fullsized":"2024-09-12T17:41:47.512874+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'344","last_scrub_stamp":"2024-09-12T17:41:47.512547+0000","last_deep_scrub":"265'344","last_deep_scrub_stamp":"2024-09-12T17:41:47.512547+0000","last_clean_scrub_stamp":"2024-09-12T17:41:47.512547+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:09.454509+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029079,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":528,"num_read_kb":20889,"num_write":1017,"num_write_kb":24291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:55.515286+0000","last_change":"2024-09-12T17:41:55.515139+0000","last_active":"2024-09-12T17:41:55.515286+0000","last_peered":"2024-09-12T17:41:55.515286+0000","last_clean":"2024-09-12T17:41:55.515286+0000","last_became_active":"2024-09-12T16:58:23.713069+0000","last_became_peered":"2024-09-12T16:58:23.713069+0000","last_unstale":"2024-09-12T17:41:55.515286+0000","last_undegraded":"2024-09-12T17:41:55.515286+0000","last_fullsized":"2024-09-12T17:41:55.515286+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:55.514956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:55.514956+0000","last_clean_scrub_stamp":"2024-09-12T17:41:55.514956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:26.580464+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"265'38","reported_seq":546,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:59.987749+0000","last_change":"2024-09-12T17:41:59.987428+0000","last_active":"2024-09-12T17:41:59.987749+0000","last_peered":"2024-09-12T17:41:59.987749+0000","last_clean":"2024-09-12T17:41:59.987749+0000","last_became_active":"2024-09-12T16:58:25.730410+0000","last_became_peered":"2024-09-12T16:58:25.730410+0000","last_unstale":"2024-09-12T17:41:59.987749+0000","last_undegraded":"2024-09-12T17:41:59.987749+0000","last_fullsized":"2024-09-12T17:41:59.987749+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'38","last_scrub_stamp":"2024-09-12T17:41:59.987182+0000","last_deep_scrub":"265'38","last_deep_scrub_stamp":"2024-09-12T17:41:59.987182+0000","last_clean_scrub_stamp":"2024-09-12T17:41:59.987182+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:57.218911+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:08.666747+0000","last_change":"2024-09-12T17:42:08.666588+0000","last_active":"2024-09-12T17:42:08.666747+0000","last_peered":"2024-09-12T17:42:08.666747+0000","last_clean":"2024-09-12T17:42:08.666747+0000","last_became_active":"2024-09-12T16:58:27.742979+0000","last_became_peered":"2024-09-12T16:58:27.742979+0000","last_unstale":"2024-09-12T17:42:08.666747+0000","last_undegraded":"2024-09-12T17:42:08.666747+0000","last_fullsized":"2024-09-12T17:42:08.666747+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:08.666400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:08.666400+0000","last_clean_scrub_stamp":"2024-09-12T17:42:08.666400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:38.590316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"265'209","reported_seq":737,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:14.947644+0000","last_change":"2024-09-12T17:42:14.947644+0000","last_active":"2024-09-12T17:42:14.947644+0000","last_peered":"2024-09-12T17:42:14.947644+0000","last_clean":"2024-09-12T17:42:14.947644+0000","last_became_active":"2024-09-12T16:58:29.782024+0000","last_became_peered":"2024-09-12T16:58:29.782024+0000","last_unstale":"2024-09-12T17:42:14.947644+0000","last_undegraded":"2024-09-12T17:42:14.947644+0000","last_fullsized":"2024-09-12T17:42:14.947644+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'209","last_scrub_stamp":"2024-09-12T17:42:14.947455+0000","last_deep_scrub":"265'209","last_deep_scrub_stamp":"2024-09-12T17:42:14.947455+0000","last_clean_scrub_stamp":"2024-09-12T17:42:14.947455+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:44.960259+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":358,"num_read_kb":350,"num_write":466,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"265'522","reported_seq":1263,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:52.511575+0000","last_change":"2024-09-12T17:41:52.511408+0000","last_active":"2024-09-12T17:41:52.511575+0000","last_peered":"2024-09-12T17:41:52.511575+0000","last_clean":"2024-09-12T17:41:52.511575+0000","last_became_active":"2024-09-12T16:58:21.711637+0000","last_became_peered":"2024-09-12T16:58:21.711637+0000","last_unstale":"2024-09-12T17:41:52.511575+0000","last_undegraded":"2024-09-12T17:41:52.511575+0000","last_fullsized":"2024-09-12T17:41:52.511575+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'522","last_scrub_stamp":"2024-09-12T17:41:52.511214+0000","last_deep_scrub":"265'522","last_deep_scrub_stamp":"2024-09-12T17:41:52.511214+0000","last_clean_scrub_stamp":"2024-09-12T17:41:52.511214+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:52.916702+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2547,"num_read_kb":2246,"num_write":971,"num_write_kb":585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2872,"num_omap_keys":12,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"265'374","reported_seq":985,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:37.559690+0000","last_change":"2024-09-12T17:41:37.559542+0000","last_active":"2024-09-12T17:41:37.559690+0000","last_peered":"2024-09-12T17:41:37.559690+0000","last_clean":"2024-09-12T17:41:37.559690+0000","last_became_active":"2024-09-12T16:58:55.851886+0000","last_became_peered":"2024-09-12T16:58:55.851886+0000","last_unstale":"2024-09-12T17:41:37.559690+0000","last_undegraded":"2024-09-12T17:41:37.559690+0000","last_fullsized":"2024-09-12T17:41:37.559690+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'374","last_scrub_stamp":"2024-09-12T17:41:37.559441+0000","last_deep_scrub":"265'374","last_deep_scrub_stamp":"2024-09-12T17:41:37.559441+0000","last_clean_scrub_stamp":"2024-09-12T17:41:37.559441+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:47.380450+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":696596,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":502,"num_read_kb":19430,"num_write":1218,"num_write_kb":23867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:00.759412+0000","last_change":"2024-09-12T17:42:00.759267+0000","last_active":"2024-09-12T17:42:00.759412+0000","last_peered":"2024-09-12T17:42:00.759412+0000","last_clean":"2024-09-12T17:42:00.759412+0000","last_became_active":"2024-09-12T16:58:23.718109+0000","last_became_peered":"2024-09-12T16:58:23.718109+0000","last_unstale":"2024-09-12T17:42:00.759412+0000","last_undegraded":"2024-09-12T17:42:00.759412+0000","last_fullsized":"2024-09-12T17:42:00.759412+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:00.759080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:00.759080+0000","last_clean_scrub_stamp":"2024-09-12T17:42:00.759080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:46.884251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"265'316","reported_seq":916,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:04.617913+0000","last_change":"2024-09-12T17:42:04.617758+0000","last_active":"2024-09-12T17:42:04.617913+0000","last_peered":"2024-09-12T17:42:04.617913+0000","last_clean":"2024-09-12T17:42:04.617913+0000","last_became_active":"2024-09-12T16:58:25.738463+0000","last_became_peered":"2024-09-12T16:58:25.738463+0000","last_unstale":"2024-09-12T17:42:04.617913+0000","last_undegraded":"2024-09-12T17:42:04.617913+0000","last_fullsized":"2024-09-12T17:42:04.617913+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'316","last_scrub_stamp":"2024-09-12T17:42:04.617550+0000","last_deep_scrub":"265'316","last_deep_scrub_stamp":"2024-09-12T17:42:04.617550+0000","last_clean_scrub_stamp":"2024-09-12T17:42:04.617550+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:04.259493+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46394,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":527,"num_read_kb":1194,"num_write":426,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:57.398918+0000","last_change":"2024-09-12T17:41:57.398743+0000","last_active":"2024-09-12T17:41:57.398918+0000","last_peered":"2024-09-12T17:41:57.398918+0000","last_clean":"2024-09-12T17:41:57.398918+0000","last_became_active":"2024-09-12T16:58:27.760265+0000","last_became_peered":"2024-09-12T16:58:27.760265+0000","last_unstale":"2024-09-12T17:41:57.398918+0000","last_undegraded":"2024-09-12T17:41:57.398918+0000","last_fullsized":"2024-09-12T17:41:57.398918+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:57.398482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:57.398482+0000","last_clean_scrub_stamp":"2024-09-12T17:41:57.398482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:40.065598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"265'146","reported_seq":683,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:15.601225+0000","last_change":"2024-09-12T17:42:15.601225+0000","last_active":"2024-09-12T17:42:15.601225+0000","last_peered":"2024-09-12T17:42:15.601225+0000","last_clean":"2024-09-12T17:42:15.601225+0000","last_became_active":"2024-09-12T16:58:29.776448+0000","last_became_peered":"2024-09-12T16:58:29.776448+0000","last_unstale":"2024-09-12T17:42:15.601225+0000","last_undegraded":"2024-09-12T17:42:15.601225+0000","last_fullsized":"2024-09-12T17:42:15.601225+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'146","last_scrub_stamp":"2024-09-12T17:42:15.601028+0000","last_deep_scrub":"265'146","last_deep_scrub_stamp":"2024-09-12T17:42:15.601028+0000","last_clean_scrub_stamp":"2024-09-12T17:42:15.601028+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:24.604237+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":253,"num_read_kb":229,"num_write":261,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"265'252","reported_seq":889,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:47.614921+0000","last_change":"2024-09-12T17:41:47.614719+0000","last_active":"2024-09-12T17:41:47.614921+0000","last_peered":"2024-09-12T17:41:47.614921+0000","last_clean":"2024-09-12T17:41:47.614921+0000","last_became_active":"2024-09-12T16:58:21.705619+0000","last_became_peered":"2024-09-12T16:58:21.705619+0000","last_unstale":"2024-09-12T17:41:47.614921+0000","last_undegraded":"2024-09-12T17:41:47.614921+0000","last_fullsized":"2024-09-12T17:41:47.614921+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'252","last_scrub_stamp":"2024-09-12T17:41:47.614536+0000","last_deep_scrub":"265'252","last_deep_scrub_stamp":"2024-09-12T17:41:47.614536+0000","last_clean_scrub_stamp":"2024-09-12T17:41:47.614536+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:16.229333+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1131,"num_read_kb":917,"num_write":399,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":504,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"265'315","reported_seq":968,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:40.264053+0000","last_change":"2024-09-12T17:41:40.263798+0000","last_active":"2024-09-12T17:41:40.264053+0000","last_peered":"2024-09-12T17:41:40.264053+0000","last_clean":"2024-09-12T17:41:40.264053+0000","last_became_active":"2024-09-12T16:58:18.700720+0000","last_became_peered":"2024-09-12T16:58:18.700720+0000","last_unstale":"2024-09-12T17:41:40.264053+0000","last_undegraded":"2024-09-12T17:41:40.264053+0000","last_fullsized":"2024-09-12T17:41:40.264053+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'315","last_scrub_stamp":"2024-09-12T17:41:40.263594+0000","last_deep_scrub":"265'315","last_deep_scrub_stamp":"2024-09-12T17:41:40.263594+0000","last_clean_scrub_stamp":"2024-09-12T17:41:40.263594+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:36.901664+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399159,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":424,"num_read_kb":68507,"num_write":939,"num_write_kb":27085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:53.481263+0000","last_change":"2024-09-12T17:41:53.480997+0000","last_active":"2024-09-12T17:41:53.481263+0000","last_peered":"2024-09-12T17:41:53.481263+0000","last_clean":"2024-09-12T17:41:53.481263+0000","last_became_active":"2024-09-12T16:58:23.721005+0000","last_became_peered":"2024-09-12T16:58:23.721005+0000","last_unstale":"2024-09-12T17:41:53.481263+0000","last_undegraded":"2024-09-12T17:41:53.481263+0000","last_fullsized":"2024-09-12T17:41:53.481263+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:53.480780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:53.480780+0000","last_clean_scrub_stamp":"2024-09-12T17:41:53.480780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:41.592134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"265'250","reported_seq":826,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:05.772352+0000","last_change":"2024-09-12T17:42:05.772201+0000","last_active":"2024-09-12T17:42:05.772352+0000","last_peered":"2024-09-12T17:42:05.772352+0000","last_clean":"2024-09-12T17:42:05.772352+0000","last_became_active":"2024-09-12T16:58:25.732956+0000","last_became_peered":"2024-09-12T16:58:25.732956+0000","last_unstale":"2024-09-12T17:42:05.772352+0000","last_undegraded":"2024-09-12T17:42:05.772352+0000","last_fullsized":"2024-09-12T17:42:05.772352+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'250","last_scrub_stamp":"2024-09-12T17:42:05.771999+0000","last_deep_scrub":"265'250","last_deep_scrub_stamp":"2024-09-12T17:42:05.771999+0000","last_clean_scrub_stamp":"2024-09-12T17:42:05.771999+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:12.559809+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52555,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":415,"num_read_kb":944,"num_write":334,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:07.926955+0000","last_change":"2024-09-12T17:42:07.926808+0000","last_active":"2024-09-12T17:42:07.926955+0000","last_peered":"2024-09-12T17:42:07.926955+0000","last_clean":"2024-09-12T17:42:07.926955+0000","last_became_active":"2024-09-12T16:58:27.737089+0000","last_became_peered":"2024-09-12T16:58:27.737089+0000","last_unstale":"2024-09-12T17:42:07.926955+0000","last_undegraded":"2024-09-12T17:42:07.926955+0000","last_fullsized":"2024-09-12T17:42:07.926955+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:07.926612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:07.926612+0000","last_clean_scrub_stamp":"2024-09-12T17:42:07.926612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:23.544473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"265'132","reported_seq":787,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:46.446374+0000","last_change":"2024-09-12T17:41:46.446227+0000","last_active":"2024-09-12T17:41:46.446374+0000","last_peered":"2024-09-12T17:41:46.446374+0000","last_clean":"2024-09-12T17:41:46.446374+0000","last_became_active":"2024-09-12T16:58:21.717079+0000","last_became_peered":"2024-09-12T16:58:21.717079+0000","last_unstale":"2024-09-12T17:41:46.446374+0000","last_undegraded":"2024-09-12T17:41:46.446374+0000","last_fullsized":"2024-09-12T17:41:46.446374+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'132","last_scrub_stamp":"2024-09-12T17:41:46.446038+0000","last_deep_scrub":"265'132","last_deep_scrub_stamp":"2024-09-12T17:41:46.446038+0000","last_clean_scrub_stamp":"2024-09-12T17:41:46.446038+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:13.280751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":593,"num_read_kb":510,"num_write":185,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"265'352","reported_seq":997,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:40.787281+0000","last_change":"2024-09-12T17:41:40.787145+0000","last_active":"2024-09-12T17:41:40.787281+0000","last_peered":"2024-09-12T17:41:40.787281+0000","last_clean":"2024-09-12T17:41:40.787281+0000","last_became_active":"2024-09-12T16:58:18.677480+0000","last_became_peered":"2024-09-12T16:58:18.677480+0000","last_unstale":"2024-09-12T17:41:40.787281+0000","last_undegraded":"2024-09-12T17:41:40.787281+0000","last_fullsized":"2024-09-12T17:41:40.787281+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'352","last_scrub_stamp":"2024-09-12T17:41:40.786932+0000","last_deep_scrub":"265'352","last_deep_scrub_stamp":"2024-09-12T17:41:40.786932+0000","last_clean_scrub_stamp":"2024-09-12T17:41:40.786932+0000","objects_scrubbed":8,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:05.959550+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4539352,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":465,"num_read_kb":21305,"num_write":1120,"num_write_kb":20049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:58.000921+0000","last_change":"2024-09-12T17:41:58.000778+0000","last_active":"2024-09-12T17:41:58.000921+0000","last_peered":"2024-09-12T17:41:58.000921+0000","last_clean":"2024-09-12T17:41:58.000921+0000","last_became_active":"2024-09-12T16:58:23.719039+0000","last_became_peered":"2024-09-12T16:58:23.719039+0000","last_unstale":"2024-09-12T17:41:58.000921+0000","last_undegraded":"2024-09-12T17:41:58.000921+0000","last_fullsized":"2024-09-12T17:41:58.000921+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:58.000591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:58.000591+0000","last_clean_scrub_stamp":"2024-09-12T17:41:58.000591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:06.915186+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"265'476","reported_seq":1111,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:59.400710+0000","last_change":"2024-09-12T17:41:59.400710+0000","last_active":"2024-09-12T17:41:59.400710+0000","last_peered":"2024-09-12T17:41:59.400710+0000","last_clean":"2024-09-12T17:41:59.400710+0000","last_became_active":"2024-09-12T16:58:25.720165+0000","last_became_peered":"2024-09-12T16:58:25.720165+0000","last_unstale":"2024-09-12T17:41:59.400710+0000","last_undegraded":"2024-09-12T17:41:59.400710+0000","last_fullsized":"2024-09-12T17:41:59.400710+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'476","last_scrub_stamp":"2024-09-12T17:41:59.400502+0000","last_deep_scrub":"265'476","last_deep_scrub_stamp":"2024-09-12T17:41:59.400502+0000","last_clean_scrub_stamp":"2024-09-12T17:41:59.400502+0000","objects_scrubbed":7,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:59.538891+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97109,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":819,"num_read_kb":1920,"num_write":702,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:09.563408+0000","last_change":"2024-09-12T17:42:09.563408+0000","last_active":"2024-09-12T17:42:09.563408+0000","last_peered":"2024-09-12T17:42:09.563408+0000","last_clean":"2024-09-12T17:42:09.563408+0000","last_became_active":"2024-09-12T16:58:27.749390+0000","last_became_peered":"2024-09-12T16:58:27.749390+0000","last_unstale":"2024-09-12T17:42:09.563408+0000","last_undegraded":"2024-09-12T17:42:09.563408+0000","last_fullsized":"2024-09-12T17:42:09.563408+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:09.563237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:09.563237+0000","last_clean_scrub_stamp":"2024-09-12T17:42:09.563237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:08.669507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"265'186","reported_seq":743,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:15.596954+0000","last_change":"2024-09-12T17:42:15.596814+0000","last_active":"2024-09-12T17:42:15.596954+0000","last_peered":"2024-09-12T17:42:15.596954+0000","last_clean":"2024-09-12T17:42:15.596954+0000","last_became_active":"2024-09-12T16:58:29.788460+0000","last_became_peered":"2024-09-12T16:58:29.788460+0000","last_unstale":"2024-09-12T17:42:15.596954+0000","last_undegraded":"2024-09-12T17:42:15.596954+0000","last_fullsized":"2024-09-12T17:42:15.596954+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'186","last_scrub_stamp":"2024-09-12T17:42:15.596627+0000","last_deep_scrub":"265'186","last_deep_scrub_stamp":"2024-09-12T17:42:15.596627+0000","last_clean_scrub_stamp":"2024-09-12T17:42:15.596627+0000","objects_scrubbed":2,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:32.272451+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":436,"num_read_kb":400,"num_write":425,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"265'128","reported_seq":746,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:51.118553+0000","last_change":"2024-09-12T17:41:51.118367+0000","last_active":"2024-09-12T17:41:51.118553+0000","last_peered":"2024-09-12T17:41:51.118553+0000","last_clean":"2024-09-12T17:41:51.118553+0000","last_became_active":"2024-09-12T16:58:21.724003+0000","last_became_peered":"2024-09-12T16:58:21.724003+0000","last_unstale":"2024-09-12T17:41:51.118553+0000","last_undegraded":"2024-09-12T17:41:51.118553+0000","last_fullsized":"2024-09-12T17:41:51.118553+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'128","last_scrub_stamp":"2024-09-12T17:41:51.118180+0000","last_deep_scrub":"265'128","last_deep_scrub_stamp":"2024-09-12T17:41:51.118180+0000","last_clean_scrub_stamp":"2024-09-12T17:41:51.118180+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:50.382693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":616,"num_read_kb":520,"num_write":198,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"265'382","reported_seq":1081,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:40.494181+0000","last_change":"2024-09-12T17:41:40.494019+0000","last_active":"2024-09-12T17:41:40.494181+0000","last_peered":"2024-09-12T17:41:40.494181+0000","last_clean":"2024-09-12T17:41:40.494181+0000","last_became_active":"2024-09-12T16:58:18.706806+0000","last_became_peered":"2024-09-12T16:58:18.706806+0000","last_unstale":"2024-09-12T17:41:40.494181+0000","last_undegraded":"2024-09-12T17:41:40.494181+0000","last_fullsized":"2024-09-12T17:41:40.494181+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'382","last_scrub_stamp":"2024-09-12T17:41:40.493763+0000","last_deep_scrub":"265'382","last_deep_scrub_stamp":"2024-09-12T17:41:40.493763+0000","last_clean_scrub_stamp":"2024-09-12T17:41:40.493763+0000","objects_scrubbed":11,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:01.630616+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2005288,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":606,"num_read_kb":18575,"num_write":1246,"num_write_kb":49050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:54.441311+0000","last_change":"2024-09-12T17:41:54.441149+0000","last_active":"2024-09-12T17:41:54.441311+0000","last_peered":"2024-09-12T17:41:54.441311+0000","last_clean":"2024-09-12T17:41:54.441311+0000","last_became_active":"2024-09-12T16:58:23.720654+0000","last_became_peered":"2024-09-12T16:58:23.720654+0000","last_unstale":"2024-09-12T17:41:54.441311+0000","last_undegraded":"2024-09-12T17:41:54.441311+0000","last_fullsized":"2024-09-12T17:41:54.441311+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:54.440953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:54.440953+0000","last_clean_scrub_stamp":"2024-09-12T17:41:54.440953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:46.885058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"265'324","reported_seq":913,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:06.753628+0000","last_change":"2024-09-12T17:42:06.753628+0000","last_active":"2024-09-12T17:42:06.753628+0000","last_peered":"2024-09-12T17:42:06.753628+0000","last_clean":"2024-09-12T17:42:06.753628+0000","last_became_active":"2024-09-12T16:58:25.733241+0000","last_became_peered":"2024-09-12T16:58:25.733241+0000","last_unstale":"2024-09-12T17:42:06.753628+0000","last_undegraded":"2024-09-12T17:42:06.753628+0000","last_fullsized":"2024-09-12T17:42:06.753628+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'324","last_scrub_stamp":"2024-09-12T17:42:06.753421+0000","last_deep_scrub":"265'324","last_deep_scrub_stamp":"2024-09-12T17:42:06.753421+0000","last_clean_scrub_stamp":"2024-09-12T17:42:06.753421+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:02.524828+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53167,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":518,"num_read_kb":1145,"num_write":434,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:00.362276+0000","last_change":"2024-09-12T17:42:00.362276+0000","last_active":"2024-09-12T17:42:00.362276+0000","last_peered":"2024-09-12T17:42:00.362276+0000","last_clean":"2024-09-12T17:42:00.362276+0000","last_became_active":"2024-09-12T16:58:27.750328+0000","last_became_peered":"2024-09-12T16:58:27.750328+0000","last_unstale":"2024-09-12T17:42:00.362276+0000","last_undegraded":"2024-09-12T17:42:00.362276+0000","last_fullsized":"2024-09-12T17:42:00.362276+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:00.362082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:00.362082+0000","last_clean_scrub_stamp":"2024-09-12T17:42:00.362082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:37.237455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"265'186","reported_seq":694,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:03.340482+0000","last_change":"2024-09-12T17:42:03.340339+0000","last_active":"2024-09-12T17:42:03.340482+0000","last_peered":"2024-09-12T17:42:03.340482+0000","last_clean":"2024-09-12T17:42:03.340482+0000","last_became_active":"2024-09-12T16:58:29.777124+0000","last_became_peered":"2024-09-12T16:58:29.777124+0000","last_unstale":"2024-09-12T17:42:03.340482+0000","last_undegraded":"2024-09-12T17:42:03.340482+0000","last_fullsized":"2024-09-12T17:42:03.340482+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'186","last_scrub_stamp":"2024-09-12T17:42:03.340132+0000","last_deep_scrub":"265'186","last_deep_scrub_stamp":"2024-09-12T17:42:03.340132+0000","last_clean_scrub_stamp":"2024-09-12T17:42:03.340132+0000","objects_scrubbed":5,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:26.686575+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1215,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":228,"num_read_kb":227,"num_write":517,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"265'163","reported_seq":775,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:54.539232+0000","last_change":"2024-09-12T17:41:54.539232+0000","last_active":"2024-09-12T17:41:54.539232+0000","last_peered":"2024-09-12T17:41:54.539232+0000","last_clean":"2024-09-12T17:41:54.539232+0000","last_became_active":"2024-09-12T16:58:21.698565+0000","last_became_peered":"2024-09-12T16:58:21.698565+0000","last_unstale":"2024-09-12T17:41:54.539232+0000","last_undegraded":"2024-09-12T17:41:54.539232+0000","last_fullsized":"2024-09-12T17:41:54.539232+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'163","last_scrub_stamp":"2024-09-12T17:41:54.539052+0000","last_deep_scrub":"265'163","last_deep_scrub_stamp":"2024-09-12T17:41:54.539052+0000","last_clean_scrub_stamp":"2024-09-12T17:41:54.539052+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:56.134179+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":649,"num_read_kb":535,"num_write":267,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":466,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"265'341","reported_seq":998,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:41.643297+0000","last_change":"2024-09-12T17:41:41.643297+0000","last_active":"2024-09-12T17:41:41.643297+0000","last_peered":"2024-09-12T17:41:41.643297+0000","last_clean":"2024-09-12T17:41:41.643297+0000","last_became_active":"2024-09-12T16:58:18.700196+0000","last_became_peered":"2024-09-12T16:58:18.700196+0000","last_unstale":"2024-09-12T17:41:41.643297+0000","last_undegraded":"2024-09-12T17:41:41.643297+0000","last_fullsized":"2024-09-12T17:41:41.643297+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'341","last_scrub_stamp":"2024-09-12T17:41:41.643102+0000","last_deep_scrub":"265'341","last_deep_scrub_stamp":"2024-09-12T17:41:41.643102+0000","last_clean_scrub_stamp":"2024-09-12T17:41:41.643102+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:23.678015+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":519,"num_read_kb":4020,"num_write":1087,"num_write_kb":21150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:02.569081+0000","last_change":"2024-09-12T17:42:02.569081+0000","last_active":"2024-09-12T17:42:02.569081+0000","last_peered":"2024-09-12T17:42:02.569081+0000","last_clean":"2024-09-12T17:42:02.569081+0000","last_became_active":"2024-09-12T16:58:23.702293+0000","last_became_peered":"2024-09-12T16:58:23.702293+0000","last_unstale":"2024-09-12T17:42:02.569081+0000","last_undegraded":"2024-09-12T17:42:02.569081+0000","last_fullsized":"2024-09-12T17:42:02.569081+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:02.568901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:02.568901+0000","last_clean_scrub_stamp":"2024-09-12T17:42:02.568901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:48.291273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"265'330","reported_seq":916,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:07.569228+0000","last_change":"2024-09-12T17:42:07.569073+0000","last_active":"2024-09-12T17:42:07.569228+0000","last_peered":"2024-09-12T17:42:07.569228+0000","last_clean":"2024-09-12T17:42:07.569228+0000","last_became_active":"2024-09-12T16:58:25.949883+0000","last_became_peered":"2024-09-12T16:58:25.949883+0000","last_unstale":"2024-09-12T17:42:07.569228+0000","last_undegraded":"2024-09-12T17:42:07.569228+0000","last_fullsized":"2024-09-12T17:42:07.569228+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'330","last_scrub_stamp":"2024-09-12T17:42:07.568888+0000","last_deep_scrub":"265'330","last_deep_scrub_stamp":"2024-09-12T17:42:07.568888+0000","last_clean_scrub_stamp":"2024-09-12T17:42:07.568888+0000","objects_scrubbed":5,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:41.012993+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47961,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":516,"num_read_kb":1185,"num_write":434,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:02.402563+0000","last_change":"2024-09-12T17:42:02.402428+0000","last_active":"2024-09-12T17:42:02.402563+0000","last_peered":"2024-09-12T17:42:02.402563+0000","last_clean":"2024-09-12T17:42:02.402563+0000","last_became_active":"2024-09-12T16:58:27.739965+0000","last_became_peered":"2024-09-12T16:58:27.739965+0000","last_unstale":"2024-09-12T17:42:02.402563+0000","last_undegraded":"2024-09-12T17:42:02.402563+0000","last_fullsized":"2024-09-12T17:42:02.402563+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:02.402249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:02.402249+0000","last_clean_scrub_stamp":"2024-09-12T17:42:02.402249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:15.452036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"265'142","reported_seq":642,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:13.591538+0000","last_change":"2024-09-12T17:42:13.591281+0000","last_active":"2024-09-12T17:42:13.591538+0000","last_peered":"2024-09-12T17:42:13.591538+0000","last_clean":"2024-09-12T17:42:13.591538+0000","last_became_active":"2024-09-12T16:58:29.771267+0000","last_became_peered":"2024-09-12T16:58:29.771267+0000","last_unstale":"2024-09-12T17:42:13.591538+0000","last_undegraded":"2024-09-12T17:42:13.591538+0000","last_fullsized":"2024-09-12T17:42:13.591538+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'142","last_scrub_stamp":"2024-09-12T17:42:13.591041+0000","last_deep_scrub":"265'142","last_deep_scrub_stamp":"2024-09-12T17:42:13.591041+0000","last_clean_scrub_stamp":"2024-09-12T17:42:13.591041+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:35.315375+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":401,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":154,"num_write":321,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"265'82","reported_seq":694,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:43.505594+0000","last_change":"2024-09-12T17:41:43.505594+0000","last_active":"2024-09-12T17:41:43.505594+0000","last_peered":"2024-09-12T17:41:43.505594+0000","last_clean":"2024-09-12T17:41:43.505594+0000","last_became_active":"2024-09-12T16:58:21.730342+0000","last_became_peered":"2024-09-12T16:58:21.730342+0000","last_unstale":"2024-09-12T17:41:43.505594+0000","last_undegraded":"2024-09-12T17:41:43.505594+0000","last_fullsized":"2024-09-12T17:41:43.505594+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'82","last_scrub_stamp":"2024-09-12T17:41:43.505360+0000","last_deep_scrub":"265'82","last_deep_scrub_stamp":"2024-09-12T17:41:43.505360+0000","last_clean_scrub_stamp":"2024-09-12T17:41:43.505360+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:13.444514+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":417,"num_read_kb":364,"num_write":119,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"265'313","reported_seq":1009,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:39.237770+0000","last_change":"2024-09-12T17:41:39.237770+0000","last_active":"2024-09-12T17:41:39.237770+0000","last_peered":"2024-09-12T17:41:39.237770+0000","last_clean":"2024-09-12T17:41:39.237770+0000","last_became_active":"2024-09-12T16:58:18.688773+0000","last_became_peered":"2024-09-12T16:58:18.688773+0000","last_unstale":"2024-09-12T17:41:39.237770+0000","last_undegraded":"2024-09-12T17:41:39.237770+0000","last_fullsized":"2024-09-12T17:41:39.237770+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'313","last_scrub_stamp":"2024-09-12T17:41:39.237589+0000","last_deep_scrub":"265'313","last_deep_scrub_stamp":"2024-09-12T17:41:39.237589+0000","last_clean_scrub_stamp":"2024-09-12T17:41:39.237589+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:34.837693+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":566,"num_read_kb":43210,"num_write":1036,"num_write_kb":32802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:57.401448+0000","last_change":"2024-09-12T17:41:57.401448+0000","last_active":"2024-09-12T17:41:57.401448+0000","last_peered":"2024-09-12T17:41:57.401448+0000","last_clean":"2024-09-12T17:41:57.401448+0000","last_became_active":"2024-09-12T16:58:23.709009+0000","last_became_peered":"2024-09-12T16:58:23.709009+0000","last_unstale":"2024-09-12T17:41:57.401448+0000","last_undegraded":"2024-09-12T17:41:57.401448+0000","last_fullsized":"2024-09-12T17:41:57.401448+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:57.401263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:57.401263+0000","last_clean_scrub_stamp":"2024-09-12T17:41:57.401263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:55.509659+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"265'95","reported_seq":624,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:06.608548+0000","last_change":"2024-09-12T17:42:06.608408+0000","last_active":"2024-09-12T17:42:06.608548+0000","last_peered":"2024-09-12T17:42:06.608548+0000","last_clean":"2024-09-12T17:42:06.608548+0000","last_became_active":"2024-09-12T16:58:25.949196+0000","last_became_peered":"2024-09-12T16:58:25.949196+0000","last_unstale":"2024-09-12T17:42:06.608548+0000","last_undegraded":"2024-09-12T17:42:06.608548+0000","last_fullsized":"2024-09-12T17:42:06.608548+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'95","last_scrub_stamp":"2024-09-12T17:42:06.608197+0000","last_deep_scrub":"265'95","last_deep_scrub_stamp":"2024-09-12T17:42:06.608197+0000","last_clean_scrub_stamp":"2024-09-12T17:42:06.608197+0000","objects_scrubbed":7,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:30.948657+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":122,"num_read_kb":116,"num_write":142,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":19154,"num_omap_keys":50,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"265'758","reported_seq":2163,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:00.322103+0000","last_change":"2024-09-12T17:42:00.321961+0000","last_active":"2024-09-12T17:42:00.322103+0000","last_peered":"2024-09-12T17:42:00.322103+0000","last_clean":"2024-09-12T17:42:00.322103+0000","last_became_active":"2024-09-12T16:58:27.740416+0000","last_became_peered":"2024-09-12T16:58:27.740416+0000","last_unstale":"2024-09-12T17:42:00.322103+0000","last_undegraded":"2024-09-12T17:42:00.322103+0000","last_fullsized":"2024-09-12T17:42:00.322103+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'758","last_scrub_stamp":"2024-09-12T17:42:00.321759+0000","last_deep_scrub":"265'758","last_deep_scrub_stamp":"2024-09-12T17:42:00.321759+0000","last_clean_scrub_stamp":"2024-09-12T17:42:00.321759+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":700,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:00.274187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"265'129","reported_seq":659,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:11.668633+0000","last_change":"2024-09-12T17:42:11.668336+0000","last_active":"2024-09-12T17:42:11.668633+0000","last_peered":"2024-09-12T17:42:11.668633+0000","last_clean":"2024-09-12T17:42:11.668633+0000","last_became_active":"2024-09-12T16:58:29.784128+0000","last_became_peered":"2024-09-12T16:58:29.784128+0000","last_unstale":"2024-09-12T17:42:11.668633+0000","last_undegraded":"2024-09-12T17:42:11.668633+0000","last_fullsized":"2024-09-12T17:42:11.668633+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'129","last_scrub_stamp":"2024-09-12T17:42:11.668116+0000","last_deep_scrub":"265'129","last_deep_scrub_stamp":"2024-09-12T17:42:11.668116+0000","last_clean_scrub_stamp":"2024-09-12T17:42:11.668116+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:54.421856+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":291,"num_read_kb":261,"num_write":354,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"265'160","reported_seq":763,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:51.677261+0000","last_change":"2024-09-12T17:41:51.677261+0000","last_active":"2024-09-12T17:41:51.677261+0000","last_peered":"2024-09-12T17:41:51.677261+0000","last_clean":"2024-09-12T17:41:51.677261+0000","last_became_active":"2024-09-12T16:58:21.700714+0000","last_became_peered":"2024-09-12T16:58:21.700714+0000","last_unstale":"2024-09-12T17:41:51.677261+0000","last_undegraded":"2024-09-12T17:41:51.677261+0000","last_fullsized":"2024-09-12T17:41:51.677261+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'160","last_scrub_stamp":"2024-09-12T17:41:51.677068+0000","last_deep_scrub":"265'160","last_deep_scrub_stamp":"2024-09-12T17:41:51.677068+0000","last_clean_scrub_stamp":"2024-09-12T17:41:51.677068+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:24.457151+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":716,"num_read_kb":600,"num_write":247,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":685,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"265'324","reported_seq":1084,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:47.592290+0000","last_change":"2024-09-12T17:41:47.592290+0000","last_active":"2024-09-12T17:41:47.592290+0000","last_peered":"2024-09-12T17:41:47.592290+0000","last_clean":"2024-09-12T17:41:47.592290+0000","last_became_active":"2024-09-12T16:58:18.706117+0000","last_became_peered":"2024-09-12T16:58:18.706117+0000","last_unstale":"2024-09-12T17:41:47.592290+0000","last_undegraded":"2024-09-12T17:41:47.592290+0000","last_fullsized":"2024-09-12T17:41:47.592290+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'324","last_scrub_stamp":"2024-09-12T17:41:47.592082+0000","last_deep_scrub":"265'324","last_deep_scrub_stamp":"2024-09-12T17:41:47.592082+0000","last_clean_scrub_stamp":"2024-09-12T17:41:47.592082+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:54.054534+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263228,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":571,"num_read_kb":60034,"num_write":895,"num_write_kb":44854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:59.716085+0000","last_change":"2024-09-12T17:41:59.716085+0000","last_active":"2024-09-12T17:41:59.716085+0000","last_peered":"2024-09-12T17:41:59.716085+0000","last_clean":"2024-09-12T17:41:59.716085+0000","last_became_active":"2024-09-12T16:58:23.718211+0000","last_became_peered":"2024-09-12T16:58:23.718211+0000","last_unstale":"2024-09-12T17:41:59.716085+0000","last_undegraded":"2024-09-12T17:41:59.716085+0000","last_fullsized":"2024-09-12T17:41:59.716085+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:59.715910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:59.715910+0000","last_clean_scrub_stamp":"2024-09-12T17:41:59.715910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:23.485766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"265'310","reported_seq":900,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:07.600324+0000","last_change":"2024-09-12T17:42:07.600324+0000","last_active":"2024-09-12T17:42:07.600324+0000","last_peered":"2024-09-12T17:42:07.600324+0000","last_clean":"2024-09-12T17:42:07.600324+0000","last_became_active":"2024-09-12T16:58:25.724774+0000","last_became_peered":"2024-09-12T16:58:25.724774+0000","last_unstale":"2024-09-12T17:42:07.600324+0000","last_undegraded":"2024-09-12T17:42:07.600324+0000","last_fullsized":"2024-09-12T17:42:07.600324+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'310","last_scrub_stamp":"2024-09-12T17:42:07.600103+0000","last_deep_scrub":"265'310","last_deep_scrub_stamp":"2024-09-12T17:42:07.600103+0000","last_clean_scrub_stamp":"2024-09-12T17:42:07.600103+0000","objects_scrubbed":7,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:53.693190+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47652,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":491,"num_read_kb":1079,"num_write":394,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:08.965010+0000","last_change":"2024-09-12T17:42:08.965010+0000","last_active":"2024-09-12T17:42:08.965010+0000","last_peered":"2024-09-12T17:42:08.965010+0000","last_clean":"2024-09-12T17:42:08.965010+0000","last_became_active":"2024-09-12T16:58:27.755232+0000","last_became_peered":"2024-09-12T16:58:27.755232+0000","last_unstale":"2024-09-12T17:42:08.965010+0000","last_undegraded":"2024-09-12T17:42:08.965010+0000","last_fullsized":"2024-09-12T17:42:08.965010+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:08.964807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:08.964807+0000","last_clean_scrub_stamp":"2024-09-12T17:42:08.964807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:08.229206+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"265'137","reported_seq":658,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:13.742270+0000","last_change":"2024-09-12T17:42:13.742270+0000","last_active":"2024-09-12T17:42:13.742270+0000","last_peered":"2024-09-12T17:42:13.742270+0000","last_clean":"2024-09-12T17:42:13.742270+0000","last_became_active":"2024-09-12T16:58:29.782006+0000","last_became_peered":"2024-09-12T16:58:29.782006+0000","last_unstale":"2024-09-12T17:42:13.742270+0000","last_undegraded":"2024-09-12T17:42:13.742270+0000","last_fullsized":"2024-09-12T17:42:13.742270+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'137","last_scrub_stamp":"2024-09-12T17:42:13.742048+0000","last_deep_scrub":"265'137","last_deep_scrub_stamp":"2024-09-12T17:42:13.742048+0000","last_clean_scrub_stamp":"2024-09-12T17:42:13.742048+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.736080+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":784,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":248,"num_read_kb":225,"num_write":333,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"265'367","reported_seq":982,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:49.619878+0000","last_change":"2024-09-12T17:41:49.619878+0000","last_active":"2024-09-12T17:41:49.619878+0000","last_peered":"2024-09-12T17:41:49.619878+0000","last_clean":"2024-09-12T17:41:49.619878+0000","last_became_active":"2024-09-12T16:58:21.700909+0000","last_became_peered":"2024-09-12T16:58:21.700909+0000","last_unstale":"2024-09-12T17:41:49.619878+0000","last_undegraded":"2024-09-12T17:41:49.619878+0000","last_fullsized":"2024-09-12T17:41:49.619878+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'367","last_scrub_stamp":"2024-09-12T17:41:49.619757+0000","last_deep_scrub":"265'367","last_deep_scrub_stamp":"2024-09-12T17:41:49.619757+0000","last_clean_scrub_stamp":"2024-09-12T17:41:49.619757+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:59.864277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1540,"num_read_kb":1221,"num_write":577,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8073,"num_omap_keys":32,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"265'345","reported_seq":985,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:43.695319+0000","last_change":"2024-09-12T17:41:43.695319+0000","last_active":"2024-09-12T17:41:43.695319+0000","last_peered":"2024-09-12T17:41:43.695319+0000","last_clean":"2024-09-12T17:41:43.695319+0000","last_became_active":"2024-09-12T16:58:18.706197+0000","last_became_peered":"2024-09-12T16:58:18.706197+0000","last_unstale":"2024-09-12T17:41:43.695319+0000","last_undegraded":"2024-09-12T17:41:43.695319+0000","last_fullsized":"2024-09-12T17:41:43.695319+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'345","last_scrub_stamp":"2024-09-12T17:41:43.695067+0000","last_deep_scrub":"265'345","last_deep_scrub_stamp":"2024-09-12T17:41:43.695067+0000","last_clean_scrub_stamp":"2024-09-12T17:41:43.695067+0000","objects_scrubbed":10,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:07.116451+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10548403,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":531,"num_read_kb":18954,"num_write":1116,"num_write_kb":43009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:03.606588+0000","last_change":"2024-09-12T17:42:03.606588+0000","last_active":"2024-09-12T17:42:03.606588+0000","last_peered":"2024-09-12T17:42:03.606588+0000","last_clean":"2024-09-12T17:42:03.606588+0000","last_became_active":"2024-09-12T16:58:23.711307+0000","last_became_peered":"2024-09-12T16:58:23.711307+0000","last_unstale":"2024-09-12T17:42:03.606588+0000","last_undegraded":"2024-09-12T17:42:03.606588+0000","last_fullsized":"2024-09-12T17:42:03.606588+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:03.606372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:03.606372+0000","last_clean_scrub_stamp":"2024-09-12T17:42:03.606372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:19.011654+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"265'272","reported_seq":845,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:01.905547+0000","last_change":"2024-09-12T17:42:01.905547+0000","last_active":"2024-09-12T17:42:01.905547+0000","last_peered":"2024-09-12T17:42:01.905547+0000","last_clean":"2024-09-12T17:42:01.905547+0000","last_became_active":"2024-09-12T16:58:25.736507+0000","last_became_peered":"2024-09-12T16:58:25.736507+0000","last_unstale":"2024-09-12T17:42:01.905547+0000","last_undegraded":"2024-09-12T17:42:01.905547+0000","last_fullsized":"2024-09-12T17:42:01.905547+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'272","last_scrub_stamp":"2024-09-12T17:42:01.905321+0000","last_deep_scrub":"265'272","last_deep_scrub_stamp":"2024-09-12T17:42:01.905321+0000","last_clean_scrub_stamp":"2024-09-12T17:42:01.905321+0000","objects_scrubbed":5,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:36.227575+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47073,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":450,"num_read_kb":1040,"num_write":370,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:59.337211+0000","last_change":"2024-09-12T17:41:59.337032+0000","last_active":"2024-09-12T17:41:59.337211+0000","last_peered":"2024-09-12T17:41:59.337211+0000","last_clean":"2024-09-12T17:41:59.337211+0000","last_became_active":"2024-09-12T16:58:27.740278+0000","last_became_peered":"2024-09-12T16:58:27.740278+0000","last_unstale":"2024-09-12T17:41:59.337211+0000","last_undegraded":"2024-09-12T17:41:59.337211+0000","last_fullsized":"2024-09-12T17:41:59.337211+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:41:59.336840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:41:59.336840+0000","last_clean_scrub_stamp":"2024-09-12T17:41:59.336840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:16.116080+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"265'126","reported_seq":666,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:16.566991+0000","last_change":"2024-09-12T17:42:16.566991+0000","last_active":"2024-09-12T17:42:16.566991+0000","last_peered":"2024-09-12T17:42:16.566991+0000","last_clean":"2024-09-12T17:42:16.566991+0000","last_became_active":"2024-09-12T16:58:29.783969+0000","last_became_peered":"2024-09-12T16:58:29.783969+0000","last_unstale":"2024-09-12T17:42:16.566991+0000","last_undegraded":"2024-09-12T17:42:16.566991+0000","last_fullsized":"2024-09-12T17:42:16.566991+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'126","last_scrub_stamp":"2024-09-12T17:42:16.566785+0000","last_deep_scrub":"265'126","last_deep_scrub_stamp":"2024-09-12T17:42:16.566785+0000","last_clean_scrub_stamp":"2024-09-12T17:42:16.566785+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:27:14.270170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":564,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":235,"num_read_kb":216,"num_write":292,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"265'256","reported_seq":886,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:53.554782+0000","last_change":"2024-09-12T17:41:53.554631+0000","last_active":"2024-09-12T17:41:53.554782+0000","last_peered":"2024-09-12T17:41:53.554782+0000","last_clean":"2024-09-12T17:41:53.554782+0000","last_became_active":"2024-09-12T16:58:21.715884+0000","last_became_peered":"2024-09-12T16:58:21.715884+0000","last_unstale":"2024-09-12T17:41:53.554782+0000","last_undegraded":"2024-09-12T17:41:53.554782+0000","last_fullsized":"2024-09-12T17:41:53.554782+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'256","last_scrub_stamp":"2024-09-12T17:41:53.554435+0000","last_deep_scrub":"265'256","last_deep_scrub_stamp":"2024-09-12T17:41:53.554435+0000","last_clean_scrub_stamp":"2024-09-12T17:41:53.554435+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:12.224842+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1137,"num_read_kb":949,"num_write":435,"num_write_kb":255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"265'303","reported_seq":912,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:42.742805+0000","last_change":"2024-09-12T17:41:42.742666+0000","last_active":"2024-09-12T17:41:42.742805+0000","last_peered":"2024-09-12T17:41:42.742805+0000","last_clean":"2024-09-12T17:41:42.742805+0000","last_became_active":"2024-09-12T16:58:18.704103+0000","last_became_peered":"2024-09-12T16:58:18.704103+0000","last_unstale":"2024-09-12T17:41:42.742805+0000","last_undegraded":"2024-09-12T17:41:42.742805+0000","last_fullsized":"2024-09-12T17:41:42.742805+0000","mapping_epoch":23,"log_start":"265'200","ondisk_log_start":"265'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'303","last_scrub_stamp":"2024-09-12T17:41:42.742464+0000","last_deep_scrub":"265'303","last_deep_scrub_stamp":"2024-09-12T17:41:42.742464+0000","last_clean_scrub_stamp":"2024-09-12T17:41:42.742464+0000","objects_scrubbed":6,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:08.956555+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":353,"num_read_kb":15361,"num_write":880,"num_write_kb":40766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:01.615440+0000","last_change":"2024-09-12T17:42:01.615440+0000","last_active":"2024-09-12T17:42:01.615440+0000","last_peered":"2024-09-12T17:42:01.615440+0000","last_clean":"2024-09-12T17:42:01.615440+0000","last_became_active":"2024-09-12T16:58:23.713731+0000","last_became_peered":"2024-09-12T16:58:23.713731+0000","last_unstale":"2024-09-12T17:42:01.615440+0000","last_undegraded":"2024-09-12T17:42:01.615440+0000","last_fullsized":"2024-09-12T17:42:01.615440+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:01.615260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:01.615260+0000","last_clean_scrub_stamp":"2024-09-12T17:42:01.615260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:44:08.902882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"265'226","reported_seq":792,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:05.587217+0000","last_change":"2024-09-12T17:42:05.587217+0000","last_active":"2024-09-12T17:42:05.587217+0000","last_peered":"2024-09-12T17:42:05.587217+0000","last_clean":"2024-09-12T17:42:05.587217+0000","last_became_active":"2024-09-12T16:58:25.727897+0000","last_became_peered":"2024-09-12T16:58:25.727897+0000","last_unstale":"2024-09-12T17:42:05.587217+0000","last_undegraded":"2024-09-12T17:42:05.587217+0000","last_fullsized":"2024-09-12T17:42:05.587217+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'226","last_scrub_stamp":"2024-09-12T17:42:05.587046+0000","last_deep_scrub":"265'226","last_deep_scrub_stamp":"2024-09-12T17:42:05.587046+0000","last_clean_scrub_stamp":"2024-09-12T17:42:05.587046+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:17.999381+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18508,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":370,"num_read_kb":886,"num_write":300,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:10.576646+0000","last_change":"2024-09-12T17:42:10.576646+0000","last_active":"2024-09-12T17:42:10.576646+0000","last_peered":"2024-09-12T17:42:10.576646+0000","last_clean":"2024-09-12T17:42:10.576646+0000","last_became_active":"2024-09-12T16:58:27.735625+0000","last_became_peered":"2024-09-12T16:58:27.735625+0000","last_unstale":"2024-09-12T17:42:10.576646+0000","last_undegraded":"2024-09-12T17:42:10.576646+0000","last_fullsized":"2024-09-12T17:42:10.576646+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:10.576449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:10.576449+0000","last_clean_scrub_stamp":"2024-09-12T17:42:10.576449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:15.024969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"265'175","reported_seq":1650,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:12.711756+0000","last_change":"2024-09-12T17:42:12.711756+0000","last_active":"2024-09-12T17:42:12.711756+0000","last_peered":"2024-09-12T17:42:12.711756+0000","last_clean":"2024-09-12T17:42:12.711756+0000","last_became_active":"2024-09-12T16:58:29.796358+0000","last_became_peered":"2024-09-12T16:58:29.796358+0000","last_unstale":"2024-09-12T17:42:12.711756+0000","last_undegraded":"2024-09-12T17:42:12.711756+0000","last_fullsized":"2024-09-12T17:42:12.711756+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'175","last_scrub_stamp":"2024-09-12T17:42:12.711577+0000","last_deep_scrub":"265'175","last_deep_scrub_stamp":"2024-09-12T17:42:12.711577+0000","last_clean_scrub_stamp":"2024-09-12T17:42:12.711577+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:27.055803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1235,"num_read_kb":1225,"num_write":375,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"265'197","reported_seq":834,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:50.652697+0000","last_change":"2024-09-12T17:41:50.652541+0000","last_active":"2024-09-12T17:41:50.652697+0000","last_peered":"2024-09-12T17:41:50.652697+0000","last_clean":"2024-09-12T17:41:50.652697+0000","last_became_active":"2024-09-12T16:58:21.730029+0000","last_became_peered":"2024-09-12T16:58:21.730029+0000","last_unstale":"2024-09-12T17:41:50.652697+0000","last_undegraded":"2024-09-12T17:41:50.652697+0000","last_fullsized":"2024-09-12T17:41:50.652697+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'197","last_scrub_stamp":"2024-09-12T17:41:50.652360+0000","last_deep_scrub":"265'197","last_deep_scrub_stamp":"2024-09-12T17:41:50.652360+0000","last_clean_scrub_stamp":"2024-09-12T17:41:50.652360+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:58.816478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":873,"num_read_kb":717,"num_write":316,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"265'367","reported_seq":1018,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:42.297063+0000","last_change":"2024-09-12T17:41:42.296900+0000","last_active":"2024-09-12T17:41:42.297063+0000","last_peered":"2024-09-12T17:41:42.297063+0000","last_clean":"2024-09-12T17:41:42.297063+0000","last_became_active":"2024-09-12T16:58:18.712291+0000","last_became_peered":"2024-09-12T16:58:18.712291+0000","last_unstale":"2024-09-12T17:41:42.297063+0000","last_undegraded":"2024-09-12T17:41:42.297063+0000","last_fullsized":"2024-09-12T17:41:42.297063+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'367","last_scrub_stamp":"2024-09-12T17:41:42.296686+0000","last_deep_scrub":"265'367","last_deep_scrub_stamp":"2024-09-12T17:41:42.296686+0000","last_clean_scrub_stamp":"2024-09-12T17:41:42.296686+0000","objects_scrubbed":8,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:53.919784+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159793,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":439,"num_read_kb":103450,"num_write":1036,"num_write_kb":48235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"265'2","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:54.380961+0000","last_change":"2024-09-12T17:41:54.380823+0000","last_active":"2024-09-12T17:41:54.380961+0000","last_peered":"2024-09-12T17:41:54.380961+0000","last_clean":"2024-09-12T17:41:54.380961+0000","last_became_active":"2024-09-12T16:58:23.724981+0000","last_became_peered":"2024-09-12T16:58:23.724981+0000","last_unstale":"2024-09-12T17:41:54.380961+0000","last_undegraded":"2024-09-12T17:41:54.380961+0000","last_fullsized":"2024-09-12T17:41:54.380961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T17:41:54.380634+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T17:41:54.380634+0000","last_clean_scrub_stamp":"2024-09-12T17:41:54.380634+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:35.697170+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"265'303","reported_seq":894,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:08.610756+0000","last_change":"2024-09-12T17:42:08.610756+0000","last_active":"2024-09-12T17:42:08.610756+0000","last_peered":"2024-09-12T17:42:08.610756+0000","last_clean":"2024-09-12T17:42:08.610756+0000","last_became_active":"2024-09-12T16:58:25.718962+0000","last_became_peered":"2024-09-12T16:58:25.718962+0000","last_unstale":"2024-09-12T17:42:08.610756+0000","last_undegraded":"2024-09-12T17:42:08.610756+0000","last_fullsized":"2024-09-12T17:42:08.610756+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'303","last_scrub_stamp":"2024-09-12T17:42:08.610554+0000","last_deep_scrub":"265'303","last_deep_scrub_stamp":"2024-09-12T17:42:08.610554+0000","last_clean_scrub_stamp":"2024-09-12T17:42:08.610554+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:41.314469+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46580,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":480,"num_read_kb":1058,"num_write":384,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:09.968403+0000","last_change":"2024-09-12T17:42:09.968403+0000","last_active":"2024-09-12T17:42:09.968403+0000","last_peered":"2024-09-12T17:42:09.968403+0000","last_clean":"2024-09-12T17:42:09.968403+0000","last_became_active":"2024-09-12T16:58:27.748503+0000","last_became_peered":"2024-09-12T16:58:27.748503+0000","last_unstale":"2024-09-12T17:42:09.968403+0000","last_undegraded":"2024-09-12T17:42:09.968403+0000","last_fullsized":"2024-09-12T17:42:09.968403+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:42:09.968216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:42:09.968216+0000","last_clean_scrub_stamp":"2024-09-12T17:42:09.968216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:48.003237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"265'155","reported_seq":659,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:42:11.605587+0000","last_change":"2024-09-12T17:42:11.605436+0000","last_active":"2024-09-12T17:42:11.605587+0000","last_peered":"2024-09-12T17:42:11.605587+0000","last_clean":"2024-09-12T17:42:11.605587+0000","last_became_active":"2024-09-12T16:58:29.780363+0000","last_became_peered":"2024-09-12T16:58:29.780363+0000","last_unstale":"2024-09-12T17:42:11.605587+0000","last_undegraded":"2024-09-12T17:42:11.605587+0000","last_fullsized":"2024-09-12T17:42:11.605587+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'155","last_scrub_stamp":"2024-09-12T17:42:11.605251+0000","last_deep_scrub":"265'155","last_deep_scrub_stamp":"2024-09-12T17:42:11.605251+0000","last_clean_scrub_stamp":"2024-09-12T17:42:11.605251+0000","objects_scrubbed":5,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:13.762046+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":838,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":195,"num_read_kb":185,"num_write":368,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"265'45","reported_seq":608,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:52.410256+0000","last_change":"2024-09-12T17:41:52.410256+0000","last_active":"2024-09-12T17:41:52.410256+0000","last_peered":"2024-09-12T17:41:52.410256+0000","last_clean":"2024-09-12T17:41:52.410256+0000","last_became_active":"2024-09-12T16:58:21.728147+0000","last_became_peered":"2024-09-12T16:58:21.728147+0000","last_unstale":"2024-09-12T17:41:52.410256+0000","last_undegraded":"2024-09-12T17:41:52.410256+0000","last_fullsized":"2024-09-12T17:41:52.410256+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'45","last_scrub_stamp":"2024-09-12T17:41:52.410037+0000","last_deep_scrub":"265'45","last_deep_scrub_stamp":"2024-09-12T17:41:52.410037+0000","last_clean_scrub_stamp":"2024-09-12T17:41:52.410037+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:59.883537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":172,"num_write":56,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"265'364","reported_seq":1018,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:42.455139+0000","last_change":"2024-09-12T17:41:42.454962+0000","last_active":"2024-09-12T17:41:42.455139+0000","last_peered":"2024-09-12T17:41:42.455139+0000","last_clean":"2024-09-12T17:41:42.455139+0000","last_became_active":"2024-09-12T16:58:18.692788+0000","last_became_peered":"2024-09-12T16:58:18.692788+0000","last_unstale":"2024-09-12T17:41:42.455139+0000","last_undegraded":"2024-09-12T17:41:42.455139+0000","last_fullsized":"2024-09-12T17:41:42.455139+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'364","last_scrub_stamp":"2024-09-12T17:41:42.454759+0000","last_deep_scrub":"265'364","last_deep_scrub_stamp":"2024-09-12T17:41:42.454759+0000","last_clean_scrub_stamp":"2024-09-12T17:41:42.454759+0000","objects_scrubbed":6,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:43.884878+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":568,"num_read_kb":2235,"num_write":1205,"num_write_kb":12634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"265'160","reported_seq":782,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:48.329394+0000","last_change":"2024-09-12T17:41:48.329394+0000","last_active":"2024-09-12T17:41:48.329394+0000","last_peered":"2024-09-12T17:41:48.329394+0000","last_clean":"2024-09-12T17:41:48.329394+0000","last_became_active":"2024-09-12T16:58:21.726882+0000","last_became_peered":"2024-09-12T16:58:21.726882+0000","last_unstale":"2024-09-12T17:41:48.329394+0000","last_undegraded":"2024-09-12T17:41:48.329394+0000","last_fullsized":"2024-09-12T17:41:48.329394+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'160","last_scrub_stamp":"2024-09-12T17:41:48.329218+0000","last_deep_scrub":"265'160","last_deep_scrub_stamp":"2024-09-12T17:41:48.329218+0000","last_clean_scrub_stamp":"2024-09-12T17:41:48.329218+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:27.518612+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":734,"num_read_kb":607,"num_write":248,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":721,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"265'496","reported_seq":1232,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:53.589942+0000","last_change":"2024-09-12T17:41:53.589804+0000","last_active":"2024-09-12T17:41:53.589942+0000","last_peered":"2024-09-12T17:41:53.589942+0000","last_clean":"2024-09-12T17:41:53.589942+0000","last_became_active":"2024-09-12T16:58:18.693764+0000","last_became_peered":"2024-09-12T16:58:18.693764+0000","last_unstale":"2024-09-12T17:41:53.589942+0000","last_undegraded":"2024-09-12T17:41:53.589942+0000","last_fullsized":"2024-09-12T17:41:53.589942+0000","mapping_epoch":23,"log_start":"265'400","ondisk_log_start":"265'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'496","last_scrub_stamp":"2024-09-12T17:41:53.589553+0000","last_deep_scrub":"265'496","last_deep_scrub_stamp":"2024-09-12T17:41:53.589553+0000","last_clean_scrub_stamp":"2024-09-12T17:41:53.589553+0000","objects_scrubbed":10,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:17.934087+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1848453,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":919,"num_read_kb":32179,"num_write":1426,"num_write_kb":32850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"265'188","reported_seq":831,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:54.669791+0000","last_change":"2024-09-12T17:41:54.669791+0000","last_active":"2024-09-12T17:41:54.669791+0000","last_peered":"2024-09-12T17:41:54.669791+0000","last_clean":"2024-09-12T17:41:54.669791+0000","last_became_active":"2024-09-12T16:58:21.716793+0000","last_became_peered":"2024-09-12T16:58:21.716793+0000","last_unstale":"2024-09-12T17:41:54.669791+0000","last_undegraded":"2024-09-12T17:41:54.669791+0000","last_fullsized":"2024-09-12T17:41:54.669791+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'188","last_scrub_stamp":"2024-09-12T17:41:54.669596+0000","last_deep_scrub":"265'188","last_deep_scrub_stamp":"2024-09-12T17:41:54.669596+0000","last_clean_scrub_stamp":"2024-09-12T17:41:54.669596+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:38.714045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":842,"num_read_kb":696,"num_write":281,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"265'387","reported_seq":1016,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:44.632558+0000","last_change":"2024-09-12T17:41:44.632383+0000","last_active":"2024-09-12T17:41:44.632558+0000","last_peered":"2024-09-12T17:41:44.632558+0000","last_clean":"2024-09-12T17:41:44.632558+0000","last_became_active":"2024-09-12T16:58:18.711667+0000","last_became_peered":"2024-09-12T16:58:18.711667+0000","last_unstale":"2024-09-12T17:41:44.632558+0000","last_undegraded":"2024-09-12T17:41:44.632558+0000","last_fullsized":"2024-09-12T17:41:44.632558+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'387","last_scrub_stamp":"2024-09-12T17:41:44.632176+0000","last_deep_scrub":"265'387","last_deep_scrub_stamp":"2024-09-12T17:41:44.632176+0000","last_clean_scrub_stamp":"2024-09-12T17:41:44.632176+0000","objects_scrubbed":8,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:18.192979+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079973,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":470,"num_read_kb":3460,"num_write":1200,"num_write_kb":27732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"265'217","reported_seq":863,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:50.375635+0000","last_change":"2024-09-12T17:41:50.375635+0000","last_active":"2024-09-12T17:41:50.375635+0000","last_peered":"2024-09-12T17:41:50.375635+0000","last_clean":"2024-09-12T17:41:50.375635+0000","last_became_active":"2024-09-12T16:58:21.713518+0000","last_became_peered":"2024-09-12T16:58:21.713518+0000","last_unstale":"2024-09-12T17:41:50.375635+0000","last_undegraded":"2024-09-12T17:41:50.375635+0000","last_fullsized":"2024-09-12T17:41:50.375635+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'217","last_scrub_stamp":"2024-09-12T17:41:50.375457+0000","last_deep_scrub":"265'217","last_deep_scrub_stamp":"2024-09-12T17:41:50.375457+0000","last_clean_scrub_stamp":"2024-09-12T17:41:50.375457+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:56.530237+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":958,"num_read_kb":791,"num_write":328,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"265'342","reported_seq":1092,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:43.287506+0000","last_change":"2024-09-12T17:41:43.287240+0000","last_active":"2024-09-12T17:41:43.287506+0000","last_peered":"2024-09-12T17:41:43.287506+0000","last_clean":"2024-09-12T17:41:43.287506+0000","last_became_active":"2024-09-12T16:58:18.711021+0000","last_became_peered":"2024-09-12T16:58:18.711021+0000","last_unstale":"2024-09-12T17:41:43.287506+0000","last_undegraded":"2024-09-12T17:41:43.287506+0000","last_fullsized":"2024-09-12T17:41:43.287506+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'342","last_scrub_stamp":"2024-09-12T17:41:43.286936+0000","last_deep_scrub":"265'342","last_deep_scrub_stamp":"2024-09-12T17:41:43.286936+0000","last_clean_scrub_stamp":"2024-09-12T17:41:43.286936+0000","objects_scrubbed":7,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:58.141097+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399320,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":801,"num_read_kb":13816,"num_write":1128,"num_write_kb":16955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"265'187","reported_seq":818,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:38.578996+0000","last_change":"2024-09-12T17:41:38.578936+0000","last_active":"2024-09-12T17:41:38.578996+0000","last_peered":"2024-09-12T17:41:38.578996+0000","last_clean":"2024-09-12T17:41:38.578996+0000","last_became_active":"2024-09-12T16:58:55.849635+0000","last_became_peered":"2024-09-12T16:58:55.849635+0000","last_unstale":"2024-09-12T17:41:38.578996+0000","last_undegraded":"2024-09-12T17:41:38.578996+0000","last_fullsized":"2024-09-12T17:41:38.578996+0000","mapping_epoch":37,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'187","last_scrub_stamp":"2024-09-12T17:41:38.578864+0000","last_deep_scrub":"265'187","last_deep_scrub_stamp":"2024-09-12T17:41:38.578864+0000","last_clean_scrub_stamp":"2024-09-12T17:41:38.578864+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:15.935562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":876,"num_read_kb":735,"num_write":297,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"265'358","reported_seq":1203,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:45.678992+0000","last_change":"2024-09-12T17:41:45.678992+0000","last_active":"2024-09-12T17:41:45.678992+0000","last_peered":"2024-09-12T17:41:45.678992+0000","last_clean":"2024-09-12T17:41:45.678992+0000","last_became_active":"2024-09-12T16:58:18.677892+0000","last_became_peered":"2024-09-12T16:58:18.677892+0000","last_unstale":"2024-09-12T17:41:45.678992+0000","last_undegraded":"2024-09-12T17:41:45.678992+0000","last_fullsized":"2024-09-12T17:41:45.678992+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'358","last_scrub_stamp":"2024-09-12T17:41:45.678772+0000","last_deep_scrub":"265'358","last_deep_scrub_stamp":"2024-09-12T17:41:45.678772+0000","last_clean_scrub_stamp":"2024-09-12T17:41:45.678772+0000","objects_scrubbed":5,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:53.062308+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3586908,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":894,"num_read_kb":13074,"num_write":1175,"num_write_kb":22747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"265'421","reported_seq":1151,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:52.679988+0000","last_change":"2024-09-12T17:41:52.679684+0000","last_active":"2024-09-12T17:41:52.679988+0000","last_peered":"2024-09-12T17:41:52.679988+0000","last_clean":"2024-09-12T17:41:52.679988+0000","last_became_active":"2024-09-12T16:58:21.729867+0000","last_became_peered":"2024-09-12T16:58:21.729867+0000","last_unstale":"2024-09-12T17:41:52.679988+0000","last_undegraded":"2024-09-12T17:41:52.679988+0000","last_fullsized":"2024-09-12T17:41:52.679988+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'421","last_scrub_stamp":"2024-09-12T17:41:52.679449+0000","last_deep_scrub":"265'421","last_deep_scrub_stamp":"2024-09-12T17:41:52.679449+0000","last_clean_scrub_stamp":"2024-09-12T17:41:52.679449+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:02.342262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1962,"num_read_kb":1662,"num_write":651,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25753,"num_omap_keys":101,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"265'370","reported_seq":1060,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:41.467435+0000","last_change":"2024-09-12T17:41:41.467284+0000","last_active":"2024-09-12T17:41:41.467435+0000","last_peered":"2024-09-12T17:41:41.467435+0000","last_clean":"2024-09-12T17:41:41.467435+0000","last_became_active":"2024-09-12T16:58:18.707110+0000","last_became_peered":"2024-09-12T16:58:18.707110+0000","last_unstale":"2024-09-12T17:41:41.467435+0000","last_undegraded":"2024-09-12T17:41:41.467435+0000","last_fullsized":"2024-09-12T17:41:41.467435+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'370","last_scrub_stamp":"2024-09-12T17:41:41.467058+0000","last_deep_scrub":"265'370","last_deep_scrub_stamp":"2024-09-12T17:41:41.467058+0000","last_clean_scrub_stamp":"2024-09-12T17:41:41.467058+0000","objects_scrubbed":8,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:00.889176+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079974,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":702,"num_read_kb":1852,"num_write":1120,"num_write_kb":24861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"265'4296","reported_seq":5008,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:58.441073+0000","last_change":"2024-09-12T17:41:58.440762+0000","last_active":"2024-09-12T17:41:58.441073+0000","last_peered":"2024-09-12T17:41:58.441073+0000","last_clean":"2024-09-12T17:41:58.441073+0000","last_became_active":"2024-09-12T16:58:55.957007+0000","last_became_peered":"2024-09-12T16:58:55.957007+0000","last_unstale":"2024-09-12T17:41:58.441073+0000","last_undegraded":"2024-09-12T17:41:58.441073+0000","last_fullsized":"2024-09-12T17:41:58.441073+0000","mapping_epoch":37,"log_start":"265'4200","ondisk_log_start":"265'4200","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4296","last_scrub_stamp":"2024-09-12T17:41:58.440458+0000","last_deep_scrub":"265'4296","last_deep_scrub_stamp":"2024-09-12T17:41:58.440458+0000","last_clean_scrub_stamp":"2024-09-12T17:41:58.440458+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":3000,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:53.198353+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17379,"num_read_kb":14566,"num_write":6493,"num_write_kb":3276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"265'330","reported_seq":1043,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:43.481239+0000","last_change":"2024-09-12T17:41:43.481239+0000","last_active":"2024-09-12T17:41:43.481239+0000","last_peered":"2024-09-12T17:41:43.481239+0000","last_clean":"2024-09-12T17:41:43.481239+0000","last_became_active":"2024-09-12T16:58:18.715010+0000","last_became_peered":"2024-09-12T16:58:18.715010+0000","last_unstale":"2024-09-12T17:41:43.481239+0000","last_undegraded":"2024-09-12T17:41:43.481239+0000","last_fullsized":"2024-09-12T17:41:43.481239+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'330","last_scrub_stamp":"2024-09-12T17:41:43.480992+0000","last_deep_scrub":"265'330","last_deep_scrub_stamp":"2024-09-12T17:41:43.480992+0000","last_clean_scrub_stamp":"2024-09-12T17:41:43.480992+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:26.534765+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":628,"num_read_kb":2506,"num_write":964,"num_write_kb":15075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"265'104","reported_seq":694,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:47.466090+0000","last_change":"2024-09-12T17:41:47.465918+0000","last_active":"2024-09-12T17:41:47.466090+0000","last_peered":"2024-09-12T17:41:47.466090+0000","last_clean":"2024-09-12T17:41:47.466090+0000","last_became_active":"2024-09-12T16:58:21.720908+0000","last_became_peered":"2024-09-12T16:58:21.720908+0000","last_unstale":"2024-09-12T17:41:47.466090+0000","last_undegraded":"2024-09-12T17:41:47.466090+0000","last_fullsized":"2024-09-12T17:41:47.466090+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'104","last_scrub_stamp":"2024-09-12T17:41:47.465734+0000","last_deep_scrub":"265'104","last_deep_scrub_stamp":"2024-09-12T17:41:47.465734+0000","last_clean_scrub_stamp":"2024-09-12T17:41:47.465734+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:02.185124+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":432,"num_read_kb":360,"num_write":161,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"265'394","reported_seq":1124,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:43.705321+0000","last_change":"2024-09-12T17:41:43.705321+0000","last_active":"2024-09-12T17:41:43.705321+0000","last_peered":"2024-09-12T17:41:43.705321+0000","last_clean":"2024-09-12T17:41:43.705321+0000","last_became_active":"2024-09-12T16:58:18.680305+0000","last_became_peered":"2024-09-12T16:58:18.680305+0000","last_unstale":"2024-09-12T17:41:43.705321+0000","last_undegraded":"2024-09-12T17:41:43.705321+0000","last_fullsized":"2024-09-12T17:41:43.705321+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'394","last_scrub_stamp":"2024-09-12T17:41:43.705097+0000","last_deep_scrub":"265'394","last_deep_scrub_stamp":"2024-09-12T17:41:43.705097+0000","last_clean_scrub_stamp":"2024-09-12T17:41:43.705097+0000","objects_scrubbed":7,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:48.384452+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263201,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":688,"num_read_kb":33513,"num_write":1376,"num_write_kb":33353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"265'175","reported_seq":801,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:53.039939+0000","last_change":"2024-09-12T17:41:53.039664+0000","last_active":"2024-09-12T17:41:53.039939+0000","last_peered":"2024-09-12T17:41:53.039939+0000","last_clean":"2024-09-12T17:41:53.039939+0000","last_became_active":"2024-09-12T16:58:21.713765+0000","last_became_peered":"2024-09-12T16:58:21.713765+0000","last_unstale":"2024-09-12T17:41:53.039939+0000","last_undegraded":"2024-09-12T17:41:53.039939+0000","last_fullsized":"2024-09-12T17:41:53.039939+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'175","last_scrub_stamp":"2024-09-12T17:41:53.039428+0000","last_deep_scrub":"265'175","last_deep_scrub_stamp":"2024-09-12T17:41:53.039428+0000","last_clean_scrub_stamp":"2024-09-12T17:41:53.039428+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:20.616593+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":769,"num_read_kb":637,"num_write":246,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"265'374","reported_seq":1032,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:46.639986+0000","last_change":"2024-09-12T17:41:46.639869+0000","last_active":"2024-09-12T17:41:46.639986+0000","last_peered":"2024-09-12T17:41:46.639986+0000","last_clean":"2024-09-12T17:41:46.639986+0000","last_became_active":"2024-09-12T16:58:18.713629+0000","last_became_peered":"2024-09-12T16:58:18.713629+0000","last_unstale":"2024-09-12T17:41:46.639986+0000","last_undegraded":"2024-09-12T17:41:46.639986+0000","last_fullsized":"2024-09-12T17:41:46.639986+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'374","last_scrub_stamp":"2024-09-12T17:41:46.639653+0000","last_deep_scrub":"265'374","last_deep_scrub_stamp":"2024-09-12T17:41:46.639653+0000","last_clean_scrub_stamp":"2024-09-12T17:41:46.639653+0000","objects_scrubbed":9,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:07.696868+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1369511,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":530,"num_read_kb":40377,"num_write":1157,"num_write_kb":39449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"265'158","reported_seq":737,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:54.669388+0000","last_change":"2024-09-12T17:41:54.669213+0000","last_active":"2024-09-12T17:41:54.669388+0000","last_peered":"2024-09-12T17:41:54.669388+0000","last_clean":"2024-09-12T17:41:54.669388+0000","last_became_active":"2024-09-12T16:58:21.718980+0000","last_became_peered":"2024-09-12T16:58:21.718980+0000","last_unstale":"2024-09-12T17:41:54.669388+0000","last_undegraded":"2024-09-12T17:41:54.669388+0000","last_fullsized":"2024-09-12T17:41:54.669388+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'158","last_scrub_stamp":"2024-09-12T17:41:54.668917+0000","last_deep_scrub":"265'158","last_deep_scrub_stamp":"2024-09-12T17:41:54.668917+0000","last_clean_scrub_stamp":"2024-09-12T17:41:54.668917+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:44.886998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":669,"num_read_kb":540,"num_write":242,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"265'388","reported_seq":1080,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:51.554602+0000","last_change":"2024-09-12T17:41:51.554602+0000","last_active":"2024-09-12T17:41:51.554602+0000","last_peered":"2024-09-12T17:41:51.554602+0000","last_clean":"2024-09-12T17:41:51.554602+0000","last_became_active":"2024-09-12T16:58:18.678270+0000","last_became_peered":"2024-09-12T16:58:18.678270+0000","last_unstale":"2024-09-12T17:41:51.554602+0000","last_undegraded":"2024-09-12T17:41:51.554602+0000","last_fullsized":"2024-09-12T17:41:51.554602+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'388","last_scrub_stamp":"2024-09-12T17:41:51.554411+0000","last_deep_scrub":"265'388","last_deep_scrub_stamp":"2024-09-12T17:41:51.554411+0000","last_clean_scrub_stamp":"2024-09-12T17:41:51.554411+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:05.022058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":570,"num_read_kb":53855,"num_write":1232,"num_write_kb":47481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"265'252","reported_seq":879,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:42.524940+0000","last_change":"2024-09-12T17:41:42.524940+0000","last_active":"2024-09-12T17:41:42.524940+0000","last_peered":"2024-09-12T17:41:42.524940+0000","last_clean":"2024-09-12T17:41:42.524940+0000","last_became_active":"2024-09-12T16:58:21.729301+0000","last_became_peered":"2024-09-12T16:58:21.729301+0000","last_unstale":"2024-09-12T17:41:42.524940+0000","last_undegraded":"2024-09-12T17:41:42.524940+0000","last_fullsized":"2024-09-12T17:41:42.524940+0000","mapping_epoch":26,"log_start":"265'200","ondisk_log_start":"265'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'252","last_scrub_stamp":"2024-09-12T17:41:42.524765+0000","last_deep_scrub":"265'252","last_deep_scrub_stamp":"2024-09-12T17:41:42.524765+0000","last_clean_scrub_stamp":"2024-09-12T17:41:42.524765+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:58.178842+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1107,"num_read_kb":902,"num_write":427,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"265'448","reported_seq":1129,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:45.590167+0000","last_change":"2024-09-12T17:41:45.590167+0000","last_active":"2024-09-12T17:41:45.590167+0000","last_peered":"2024-09-12T17:41:45.590167+0000","last_clean":"2024-09-12T17:41:45.590167+0000","last_became_active":"2024-09-12T16:58:18.719658+0000","last_became_peered":"2024-09-12T16:58:18.719658+0000","last_unstale":"2024-09-12T17:41:45.590167+0000","last_undegraded":"2024-09-12T17:41:45.590167+0000","last_fullsized":"2024-09-12T17:41:45.590167+0000","mapping_epoch":23,"log_start":"265'400","ondisk_log_start":"265'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'448","last_scrub_stamp":"2024-09-12T17:41:45.589925+0000","last_deep_scrub":"265'448","last_deep_scrub_stamp":"2024-09-12T17:41:45.589925+0000","last_clean_scrub_stamp":"2024-09-12T17:41:45.589925+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:39.534937+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170320,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":708,"num_read_kb":15766,"num_write":1393,"num_write_kb":33267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"265'203","reported_seq":847,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:53.694005+0000","last_change":"2024-09-12T17:41:53.694005+0000","last_active":"2024-09-12T17:41:53.694005+0000","last_peered":"2024-09-12T17:41:53.694005+0000","last_clean":"2024-09-12T17:41:53.694005+0000","last_became_active":"2024-09-12T16:58:21.730589+0000","last_became_peered":"2024-09-12T16:58:21.730589+0000","last_unstale":"2024-09-12T17:41:53.694005+0000","last_undegraded":"2024-09-12T17:41:53.694005+0000","last_fullsized":"2024-09-12T17:41:53.694005+0000","mapping_epoch":26,"log_start":"262'100","ondisk_log_start":"262'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'203","last_scrub_stamp":"2024-09-12T17:41:53.693830+0000","last_deep_scrub":"265'203","last_deep_scrub_stamp":"2024-09-12T17:41:53.693830+0000","last_clean_scrub_stamp":"2024-09-12T17:41:53.693830+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:02.739000+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":887,"num_read_kb":736,"num_write":325,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"265'366","reported_seq":1041,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:45.233630+0000","last_change":"2024-09-12T17:41:45.233630+0000","last_active":"2024-09-12T17:41:45.233630+0000","last_peered":"2024-09-12T17:41:45.233630+0000","last_clean":"2024-09-12T17:41:45.233630+0000","last_became_active":"2024-09-12T16:58:18.691716+0000","last_became_peered":"2024-09-12T16:58:18.691716+0000","last_unstale":"2024-09-12T17:41:45.233630+0000","last_undegraded":"2024-09-12T17:41:45.233630+0000","last_fullsized":"2024-09-12T17:41:45.233630+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'366","last_scrub_stamp":"2024-09-12T17:41:45.233427+0000","last_deep_scrub":"265'366","last_deep_scrub_stamp":"2024-09-12T17:41:45.233427+0000","last_clean_scrub_stamp":"2024-09-12T17:41:45.233427+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:39.091059+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":528,"num_read_kb":37415,"num_write":1121,"num_write_kb":27973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"265'333","reported_seq":946,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:54.648323+0000","last_change":"2024-09-12T17:41:54.648323+0000","last_active":"2024-09-12T17:41:54.648323+0000","last_peered":"2024-09-12T17:41:54.648323+0000","last_clean":"2024-09-12T17:41:54.648323+0000","last_became_active":"2024-09-12T16:58:21.722380+0000","last_became_peered":"2024-09-12T16:58:21.722380+0000","last_unstale":"2024-09-12T17:41:54.648323+0000","last_undegraded":"2024-09-12T17:41:54.648323+0000","last_fullsized":"2024-09-12T17:41:54.648323+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'333","last_scrub_stamp":"2024-09-12T17:41:54.648087+0000","last_deep_scrub":"265'333","last_deep_scrub_stamp":"2024-09-12T17:41:54.648087+0000","last_clean_scrub_stamp":"2024-09-12T17:41:54.648087+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:12.851283+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1422,"num_read_kb":1143,"num_write":550,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"265'349","reported_seq":1023,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:48.502516+0000","last_change":"2024-09-12T17:41:48.502516+0000","last_active":"2024-09-12T17:41:48.502516+0000","last_peered":"2024-09-12T17:41:48.502516+0000","last_clean":"2024-09-12T17:41:48.502516+0000","last_became_active":"2024-09-12T16:58:18.709090+0000","last_became_peered":"2024-09-12T16:58:18.709090+0000","last_unstale":"2024-09-12T17:41:48.502516+0000","last_undegraded":"2024-09-12T17:41:48.502516+0000","last_fullsized":"2024-09-12T17:41:48.502516+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'349","last_scrub_stamp":"2024-09-12T17:41:48.502301+0000","last_deep_scrub":"265'349","last_deep_scrub_stamp":"2024-09-12T17:41:48.502301+0000","last_clean_scrub_stamp":"2024-09-12T17:41:48.502301+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:56.806960+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289348,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":537,"num_read_kb":42087,"num_write":1134,"num_write_kb":38244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"265'160","reported_seq":776,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:52.084538+0000","last_change":"2024-09-12T17:41:52.084538+0000","last_active":"2024-09-12T17:41:52.084538+0000","last_peered":"2024-09-12T17:41:52.084538+0000","last_clean":"2024-09-12T17:41:52.084538+0000","last_became_active":"2024-09-12T16:58:21.725262+0000","last_became_peered":"2024-09-12T16:58:21.725262+0000","last_unstale":"2024-09-12T17:41:52.084538+0000","last_undegraded":"2024-09-12T17:41:52.084538+0000","last_fullsized":"2024-09-12T17:41:52.084538+0000","mapping_epoch":26,"log_start":"265'100","ondisk_log_start":"265'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'160","last_scrub_stamp":"2024-09-12T17:41:52.084334+0000","last_deep_scrub":"265'160","last_deep_scrub_stamp":"2024-09-12T17:41:52.084334+0000","last_clean_scrub_stamp":"2024-09-12T17:41:52.084334+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:02:11.578223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":648,"num_read_kb":538,"num_write":222,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"265'356","reported_seq":1033,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:52.569090+0000","last_change":"2024-09-12T17:41:52.569090+0000","last_active":"2024-09-12T17:41:52.569090+0000","last_peered":"2024-09-12T17:41:52.569090+0000","last_clean":"2024-09-12T17:41:52.569090+0000","last_became_active":"2024-09-12T16:58:18.713131+0000","last_became_peered":"2024-09-12T16:58:18.713131+0000","last_unstale":"2024-09-12T17:41:52.569090+0000","last_undegraded":"2024-09-12T17:41:52.569090+0000","last_fullsized":"2024-09-12T17:41:52.569090+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'356","last_scrub_stamp":"2024-09-12T17:41:52.568904+0000","last_deep_scrub":"265'356","last_deep_scrub_stamp":"2024-09-12T17:41:52.568904+0000","last_clean_scrub_stamp":"2024-09-12T17:41:52.568904+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:36.659748+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254228,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":564,"num_read_kb":4620,"num_write":1119,"num_write_kb":30053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"265'101","reported_seq":704,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:57.446406+0000","last_change":"2024-09-12T17:41:57.446406+0000","last_active":"2024-09-12T17:41:57.446406+0000","last_peered":"2024-09-12T17:41:57.446406+0000","last_clean":"2024-09-12T17:41:57.446406+0000","last_became_active":"2024-09-12T16:58:21.693930+0000","last_became_peered":"2024-09-12T16:58:21.693930+0000","last_unstale":"2024-09-12T17:41:57.446406+0000","last_undegraded":"2024-09-12T17:41:57.446406+0000","last_fullsized":"2024-09-12T17:41:57.446406+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'101","last_scrub_stamp":"2024-09-12T17:41:57.446228+0000","last_deep_scrub":"265'101","last_deep_scrub_stamp":"2024-09-12T17:41:57.446228+0000","last_clean_scrub_stamp":"2024-09-12T17:41:57.446228+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:12.831695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":454,"num_read_kb":382,"num_write":143,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"265'358","reported_seq":1007,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:41.572666+0000","last_change":"2024-09-12T17:41:41.572498+0000","last_active":"2024-09-12T17:41:41.572666+0000","last_peered":"2024-09-12T17:41:41.572666+0000","last_clean":"2024-09-12T17:41:41.572666+0000","last_became_active":"2024-09-12T16:58:18.704118+0000","last_became_peered":"2024-09-12T16:58:18.704118+0000","last_unstale":"2024-09-12T17:41:41.572666+0000","last_undegraded":"2024-09-12T17:41:41.572666+0000","last_fullsized":"2024-09-12T17:41:41.572666+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'358","last_scrub_stamp":"2024-09-12T17:41:41.572292+0000","last_deep_scrub":"265'358","last_deep_scrub_stamp":"2024-09-12T17:41:41.572292+0000","last_clean_scrub_stamp":"2024-09-12T17:41:41.572292+0000","objects_scrubbed":8,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:25.803929+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079958,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":546,"num_read_kb":7376,"num_write":1271,"num_write_kb":14643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"265'376","reported_seq":975,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:51.551645+0000","last_change":"2024-09-12T17:41:51.551645+0000","last_active":"2024-09-12T17:41:51.551645+0000","last_peered":"2024-09-12T17:41:51.551645+0000","last_clean":"2024-09-12T17:41:51.551645+0000","last_became_active":"2024-09-12T16:58:21.714554+0000","last_became_peered":"2024-09-12T16:58:21.714554+0000","last_unstale":"2024-09-12T17:41:51.551645+0000","last_undegraded":"2024-09-12T17:41:51.551645+0000","last_fullsized":"2024-09-12T17:41:51.551645+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'376","last_scrub_stamp":"2024-09-12T17:41:51.551368+0000","last_deep_scrub":"265'376","last_deep_scrub_stamp":"2024-09-12T17:41:51.551368+0000","last_clean_scrub_stamp":"2024-09-12T17:41:51.551368+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:23.069379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1689,"num_read_kb":1453,"num_write":661,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"265'390","reported_seq":1107,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:48.615061+0000","last_change":"2024-09-12T17:41:48.614895+0000","last_active":"2024-09-12T17:41:48.615061+0000","last_peered":"2024-09-12T17:41:48.615061+0000","last_clean":"2024-09-12T17:41:48.615061+0000","last_became_active":"2024-09-12T16:58:18.719691+0000","last_became_peered":"2024-09-12T16:58:18.719691+0000","last_unstale":"2024-09-12T17:41:48.615061+0000","last_undegraded":"2024-09-12T17:41:48.615061+0000","last_fullsized":"2024-09-12T17:41:48.615061+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'390","last_scrub_stamp":"2024-09-12T17:41:48.614702+0000","last_deep_scrub":"265'390","last_deep_scrub_stamp":"2024-09-12T17:41:48.614702+0000","last_clean_scrub_stamp":"2024-09-12T17:41:48.614702+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:01.712719+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":758,"num_read_kb":7681,"num_write":1308,"num_write_kb":23567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"265'356","reported_seq":1017,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:50.628660+0000","last_change":"2024-09-12T17:41:50.628413+0000","last_active":"2024-09-12T17:41:50.628660+0000","last_peered":"2024-09-12T17:41:50.628660+0000","last_clean":"2024-09-12T17:41:50.628660+0000","last_became_active":"2024-09-12T16:58:18.698393+0000","last_became_peered":"2024-09-12T16:58:18.698393+0000","last_unstale":"2024-09-12T17:41:50.628660+0000","last_undegraded":"2024-09-12T17:41:50.628660+0000","last_fullsized":"2024-09-12T17:41:50.628660+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'356","last_scrub_stamp":"2024-09-12T17:41:50.628167+0000","last_deep_scrub":"265'356","last_deep_scrub_stamp":"2024-09-12T17:41:50.628167+0000","last_clean_scrub_stamp":"2024-09-12T17:41:50.628167+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:03.341903+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":536,"num_read_kb":34677,"num_write":1126,"num_write_kb":53307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"265'106","reported_seq":694,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:56.027628+0000","last_change":"2024-09-12T17:41:56.027469+0000","last_active":"2024-09-12T17:41:56.027628+0000","last_peered":"2024-09-12T17:41:56.027628+0000","last_clean":"2024-09-12T17:41:56.027628+0000","last_became_active":"2024-09-12T16:58:21.714240+0000","last_became_peered":"2024-09-12T16:58:21.714240+0000","last_unstale":"2024-09-12T17:41:56.027628+0000","last_undegraded":"2024-09-12T17:41:56.027628+0000","last_fullsized":"2024-09-12T17:41:56.027628+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'106","last_scrub_stamp":"2024-09-12T17:41:56.027242+0000","last_deep_scrub":"265'106","last_deep_scrub_stamp":"2024-09-12T17:41:56.027242+0000","last_clean_scrub_stamp":"2024-09-12T17:41:56.027242+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:14.917329+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":476,"num_read_kb":394,"num_write":172,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"265'366","reported_seq":1054,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:43.412511+0000","last_change":"2024-09-12T17:41:43.412364+0000","last_active":"2024-09-12T17:41:43.412511+0000","last_peered":"2024-09-12T17:41:43.412511+0000","last_clean":"2024-09-12T17:41:43.412511+0000","last_became_active":"2024-09-12T16:58:18.707649+0000","last_became_peered":"2024-09-12T16:58:18.707649+0000","last_unstale":"2024-09-12T17:41:43.412511+0000","last_undegraded":"2024-09-12T17:41:43.412511+0000","last_fullsized":"2024-09-12T17:41:43.412511+0000","mapping_epoch":23,"log_start":"265'300","ondisk_log_start":"265'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'366","last_scrub_stamp":"2024-09-12T17:41:43.412171+0000","last_deep_scrub":"265'366","last_deep_scrub_stamp":"2024-09-12T17:41:43.412171+0000","last_clean_scrub_stamp":"2024-09-12T17:41:43.412171+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:07.821353+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":580,"num_read_kb":14659,"num_write":1122,"num_write_kb":33951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"265'4160","reported_seq":4803,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T17:41:56.630467+0000","last_change":"2024-09-12T17:41:56.630467+0000","last_active":"2024-09-12T17:41:56.630467+0000","last_peered":"2024-09-12T17:41:56.630467+0000","last_clean":"2024-09-12T17:41:56.630467+0000","last_became_active":"2024-09-12T16:58:21.718537+0000","last_became_peered":"2024-09-12T16:58:21.718537+0000","last_unstale":"2024-09-12T17:41:56.630467+0000","last_undegraded":"2024-09-12T17:41:56.630467+0000","last_fullsized":"2024-09-12T17:41:56.630467+0000","mapping_epoch":26,"log_start":"265'4100","ondisk_log_start":"265'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4160","last_scrub_stamp":"2024-09-12T17:41:56.630278+0000","last_deep_scrub":"265'4160","last_deep_scrub_stamp":"2024-09-12T17:41:56.630278+0000","last_clean_scrub_stamp":"2024-09-12T17:41:56.630278+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":3000,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:59.447977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16773,"num_read_kb":14078,"num_write":6250,"num_write_kb":3119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6189,"num_read_kb":4469,"num_write":2002,"num_write_kb":899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4473,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":975,"ondisk_log_size":975,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15645,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":16183,"num_read_kb":15867,"num_write":16715,"num_write_kb":4878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2756,"num_omap_keys":18,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1646,"ondisk_log_size":1646,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":514,"ondisk_log_size":514,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1598421,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":17353,"num_read_kb":36703,"num_write":14501,"num_write_kb":11559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":682084,"num_omap_keys":1558,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2007,"ondisk_log_size":2007,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2412,"num_read_kb":2875,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":102570,"num_read_kb":85739,"num_write":37214,"num_write_kb":18735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":44323,"num_omap_keys":179,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4271,"ondisk_log_size":4271,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":74886563,"num_objects":371,"num_object_clones":0,"num_object_copies":742,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":371,"num_whiteouts":0,"num_read":36323,"num_read_kb":1886569,"num_write":72643,"num_write_kb":2069560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":151003136,"data_stored":149773126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3656,"ondisk_log_size":3656,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":211125,"num_write":190,"num_write_kb":136313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1087,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":198791,"num_write":190,"num_write_kb":136313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":15,"seq":64424509984,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":170196,"kb_used_data":36356,"kb_used_omap":1,"kb_used_meta":133822,"kb_avail":94201644,"statfs":{"total":96636764160,"available":96462483456,"internally_reserved":0,"allocated":37228544,"data_stored":35444692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":137034181},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509983,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":279304,"kb_used_data":27384,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94092536,"statfs":{"total":96636764160,"available":96350756864,"internally_reserved":0,"allocated":28041216,"data_stored":26261645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":257948103},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509988,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110480,"kb_used_data":11328,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94261360,"statfs":{"total":96636764160,"available":96523632640,"internally_reserved":0,"allocated":11599872,"data_stored":9988574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509983,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284328,"kb_used_data":32472,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":94087512,"statfs":{"total":96636764160,"available":96345612288,"internally_reserved":0,"allocated":33251328,"data_stored":31541637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":257882565},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542689,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":254076,"kb_used_data":16044,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94117764,"statfs":{"total":96636764160,"available":96376590336,"internally_reserved":0,"allocated":16429056,"data_stored":14715336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":243726795},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542690,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":229016,"kb_used_data":17352,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":94142824,"statfs":{"total":96636764160,"available":96402251776,"internally_reserved":0,"allocated":17768448,"data_stored":16188165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":216725958},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542688,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119364,"kb_used_data":25780,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94252476,"statfs":{"total":96636764160,"available":96514535424,"internally_reserved":0,"allocated":26398720,"data_stored":24782410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575392,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55636,"kb_used_data":10564,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94316204,"statfs":{"total":96636764160,"available":96579792896,"internally_reserved":0,"allocated":10817536,"data_stored":9242321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28966912,"data_stored":28798943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7954432,"data_stored":7838758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":7192576,"data_stored":7091940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24338432,"data_stored":24108487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":22761472,"data_stored":22631077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":33509376,"data_stored":33292137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14131200,"data_stored":14038127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12148736,"data_stored":11973657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":5371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":5873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:43:02.141 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T17:43:02.508 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T17:43:02.508 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T17:43:02.509 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T17:43:02.509 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T17:43:02.608 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T17:43:02.608 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T17:43:02.608 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T17:43:04.377 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-09-12T17:43:08.710 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T17:43:08.710 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T17:43:08.711 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T17:43:08.778 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T17:43:08.778 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-12T17:43:08.778 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T17:43:10.285 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-12T17:43:10.286 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-09-12T17:43:14.879 INFO:tasks.ceph.osd.3:Stopped 2024-09-12T17:43:14.880 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-12T17:43:14.880 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T17:43:14.954 INFO:tasks.ceph.osd.4:Stopped 2024-09-12T17:43:14.954 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-12T17:43:14.954 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T17:43:15.992 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-09-12T17:43:15.992 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-09-12T17:43:21.057 INFO:tasks.ceph.osd.5:Stopped 2024-09-12T17:43:21.057 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-12T17:43:21.057 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T17:43:21.698 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~6s 2024-09-12T17:43:27.159 INFO:tasks.ceph.osd.6:Stopped 2024-09-12T17:43:27.160 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-12T17:43:27.160 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T17:43:27.246 INFO:tasks.ceph.osd.7:Stopped 2024-09-12T17:43:27.246 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T17:43:27.247 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-12T17:43:27.247 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T17:43:27.274 INFO:tasks.ceph.mgr.y:Stopped 2024-09-12T17:43:27.274 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T17:43:27.274 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T17:43:27.302 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-09-12T17:43:27.303 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-09-12T17:43:27.306 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T17:43:27.306 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T17:43:27.306 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T17:43:27.306 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T17:43:27.342 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T17:43:27.342 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T17:43:27.342 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T17:43:27.403 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T17:43:27.403 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T17:43:27.403 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T17:43:27.425 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T17:43:27.426 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T17:43:27.426 DEBUG:teuthology.orchestra.run.smithi016:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-12T17:43:27.461 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi016.front.sepia.ceph.com 2024-09-12T17:43:27.462 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T17:43:27.724 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi016.front.sepia.ceph.com 2024-09-12T17:43:27.725 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T17:43:27.929 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi016.front.sepia.ceph.com 2024-09-12T17:43:27.929 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T17:43:28.143 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi016.front.sepia.ceph.com 2024-09-12T17:43:28.144 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-12T17:43:28.347 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T17:43:28.347 DEBUG:teuthology.orchestra.run.smithi019:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-12T17:43:28.580 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T17:43:28.580 DEBUG:teuthology.orchestra.run.smithi019:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-12T17:43:28.722 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T17:43:28.722 DEBUG:teuthology.orchestra.run.smithi019:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-12T17:43:28.844 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T17:43:28.844 DEBUG:teuthology.orchestra.run.smithi019:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-12T17:43:28.971 INFO:tasks.ceph:Archiving mon data... 2024-09-12T17:43:28.972 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902695/data/mon.a.tgz 2024-09-12T17:43:28.973 DEBUG:teuthology.orchestra.run.smithi016:> mktemp 2024-09-12T17:43:28.979 INFO:teuthology.orchestra.run.smithi016.stdout:/tmp/tmp.nLOAOEPmuL 2024-09-12T17:43:28.979 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.nLOAOEPmuL 2024-09-12T17:43:29.157 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0666 /tmp/tmp.nLOAOEPmuL 2024-09-12T17:43:29.223 DEBUG:teuthology.orchestra.remote:smithi016:/tmp/tmp.nLOAOEPmuL is 519KB 2024-09-12T17:43:29.288 DEBUG:teuthology.orchestra.run.smithi016:> rm -fr /tmp/tmp.nLOAOEPmuL 2024-09-12T17:43:29.294 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902695/data/mon.c.tgz 2024-09-12T17:43:29.294 DEBUG:teuthology.orchestra.run.smithi016:> mktemp 2024-09-12T17:43:29.342 INFO:teuthology.orchestra.run.smithi016.stdout:/tmp/tmp.uEStNNwkEc 2024-09-12T17:43:29.343 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.uEStNNwkEc 2024-09-12T17:43:29.532 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0666 /tmp/tmp.uEStNNwkEc 2024-09-12T17:43:29.598 DEBUG:teuthology.orchestra.remote:smithi016:/tmp/tmp.uEStNNwkEc is 552KB 2024-09-12T17:43:29.660 DEBUG:teuthology.orchestra.run.smithi016:> rm -fr /tmp/tmp.uEStNNwkEc 2024-09-12T17:43:29.666 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902695/data/mon.b.tgz 2024-09-12T17:43:29.666 DEBUG:teuthology.orchestra.run.smithi019:> mktemp 2024-09-12T17:43:29.673 INFO:teuthology.orchestra.run.smithi019.stdout:/tmp/tmp.4xyShZhQA8 2024-09-12T17:43:29.673 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.4xyShZhQA8 2024-09-12T17:43:29.869 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0666 /tmp/tmp.4xyShZhQA8 2024-09-12T17:43:29.933 DEBUG:teuthology.orchestra.remote:smithi019:/tmp/tmp.4xyShZhQA8 is 552KB 2024-09-12T17:43:30.041 DEBUG:teuthology.orchestra.run.smithi019:> rm -fr /tmp/tmp.4xyShZhQA8 2024-09-12T17:43:30.047 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T17:43:30.048 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T17:43:30.050 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T17:43:30.115 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T17:43:30.156 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T17:43:30.157 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T17:43:30.158 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902695/remote/smithi016/crash 2024-09-12T17:43:30.159 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T17:43:30.174 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902695/remote/smithi019/crash 2024-09-12T17:43:30.175 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T17:43:30.213 INFO:tasks.ceph:Compressing logs... 2024-09-12T17:43:30.214 DEBUG:teuthology.orchestra.run.smithi016:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T17:43:30.219 DEBUG:teuthology.orchestra.run.smithi019:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T17:43:30.239 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31482.log 2024-09-12T17:43:30.241 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87876.log 2024-09-12T17:43:30.241 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157937.log 2024-09-12T17:43:30.241 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31482.log.gz 2024-09-12T17:43:30.243 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.87876.log: gzip 82.2% -- replaced with /var/log/ceph/ceph-client.admin.87876.log.gz -5 2024-09-12T17:43:30.243 INFO:teuthology.orchestra.run.smithi016.stderr: --verbose -- /var/log/ceph/ceph-client.admin.180483.log 2024-09-12T17:43:30.244 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.157937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52297.log 2024-09-12T17:43:30.244 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.180483.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180483.log.gz 2024-09-12T17:43:30.244 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64616.log 2024-09-12T17:43:30.244 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.52297.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.52297.log.gz 2024-09-12T17:43:30.244 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T17:43:30.244 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.64616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.174002.log 2024-09-12T17:43:30.244 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31054.log 2024-09-12T17:43:30.247 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.0.174002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139800.log 2024-09-12T17:43:30.247 INFO:teuthology.orchestra.run.smithi016.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.0.174002.log.gz 2024-09-12T17:43:30.247 INFO:teuthology.orchestra.run.smithi016.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.64616.log.gz 2024-09-12T17:43:30.248 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109118.log 2024-09-12T17:43:30.248 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31054.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31054.log.gz 2024-09-12T17:43:30.248 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.139800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99088.log 2024-09-12T17:43:30.248 INFO:teuthology.orchestra.run.smithi016.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.139800.log.gz 2024-09-12T17:43:30.248 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.109118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52981.log 2024-09-12T17:43:30.248 INFO:teuthology.orchestra.run.smithi016.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.109118.log.gz 2024-09-12T17:43:30.248 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180432.log 2024-09-12T17:43:30.248 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.99088.log: /var/log/ceph/ceph-client.admin.52981.log: 57.4% -- replaced with /var/log/ceph/ceph-client.admin.52981.log.gz 2024-09-12T17:43:30.248 INFO:teuthology.orchestra.run.smithi016.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.157937.log.gz 2024-09-12T17:43:30.248 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45117.log 2024-09-12T17:43:30.248 INFO:teuthology.orchestra.run.smithi016.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.99088.log.gz 2024-09-12T17:43:30.248 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61901.log 2024-09-12T17:43:30.248 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.180432.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180432.log.gz 2024-09-12T17:43:30.249 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.45117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65206.log 2024-09-12T17:43:30.249 INFO:teuthology.orchestra.run.smithi016.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.45117.log.gz 2024-09-12T17:43:30.249 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.61901.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-12T17:43:30.254 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117378.log 2024-09-12T17:43:30.255 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.65206.log: /var/log/ceph/ceph-mgr.y.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.65206.log.gz 2024-09-12T17:43:30.255 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53552.log 2024-09-12T17:43:30.255 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50477.log 2024-09-12T17:43:30.255 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.117378.log: /var/log/ceph/ceph-client.admin.53552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.167512.log 2024-09-12T17:43:30.255 INFO:teuthology.orchestra.run.smithi016.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.117378.log.gz 2024-09-12T17:43:30.255 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.50477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104988.log 80.6% 2024-09-12T17:43:30.255 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50477.log.gz 2024-09-12T17:43:30.255 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.0.167512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76076.log 2024-09-12T17:43:30.255 INFO:teuthology.orchestra.run.smithi016.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.0.167512.log.gz 2024-09-12T17:43:30.255 INFO:teuthology.orchestra.run.smithi016.stderr:gzip/var/log/ceph/ceph-client.admin.104988.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.140980.log 2024-09-12T17:43:30.255 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.76076.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.104988.log.gz 2024-09-12T17:43:30.255 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- 81.1% -- replaced with /var/log/ceph/ceph-client.admin.76076.log.gz 2024-09-12T17:43:30.256 INFO:teuthology.orchestra.run.smithi016.stderr: /var/log/ceph/ceph-client.admin.179937.log 2024-09-12T17:43:30.256 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.140980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31670.log 2024-09-12T17:43:30.256 INFO:teuthology.orchestra.run.smithi016.stderr:gzip/var/log/ceph/ceph-client.admin.179937.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.177283.log 2024-09-12T17:43:30.256 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0%/var/log/ceph/ceph-client.admin.31670.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.61901.log.gz 2024-09-12T17:43:30.256 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.179937.log.gz 2024-09-12T17:43:30.256 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31670.log.gz 2024-09-12T17:43:30.256 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.179240.log 2024-09-12T17:43:30.256 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.177283.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T17:43:30.256 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.177283.log.gz 2024-09-12T17:43:30.256 INFO:teuthology.orchestra.run.smithi016.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.140980.log.gz 2024-09-12T17:43:30.256 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.0.179240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42732.log 2024-09-12T17:43:30.256 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146881.log 2024-09-12T17:43:30.260 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143341.log 2024-09-12T17:43:30.260 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42732.log.gz 2024-09-12T17:43:30.260 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.146881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101448.log 2024-09-12T17:43:30.260 INFO:teuthology.orchestra.run.smithi016.stderr: 82.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116788.log 2024-09-12T17:43:30.260 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.146881.log.gz 2024-09-12T17:43:30.261 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.143341.log: /var/log/ceph/ceph-client.admin.101448.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.143341.log.gz 2024-09-12T17:43:30.261 INFO:teuthology.orchestra.run.smithi016.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.101448.log.gz 2024-09-12T17:43:30.261 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97908.log 2024-09-12T17:43:30.261 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.116788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180301.log 2024-09-12T17:43:30.261 INFO:teuthology.orchestra.run.smithi016.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.116788.log.gz 2024-09-12T17:43:30.261 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.97908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.171642.log 2024-09-12T17:43:30.261 INFO:teuthology.orchestra.run.smithi016.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.97908.log.gz 2024-09-12T17:43:30.261 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.180301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136260.log 2024-09-12T17:43:30.261 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180301.log.gz 2024-09-12T17:43:30.261 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180197.log 2024-09-12T17:43:30.261 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.0.171642.log: /var/log/ceph/ceph-client.admin.136260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31266.log 2024-09-12T17:43:30.261 INFO:teuthology.orchestra.run.smithi016.stderr: 81.9% 80.5% -- replaced with /var/log/ceph/ceph-client.0.171642.log.gz 2024-09-12T17:43:30.262 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.136260.log.gz 2024-09-12T17:43:30.262 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.180197.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180197.log.gz 2024-09-12T17:43:30.262 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37937.log 2024-09-12T17:43:30.265 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142751.log 2024-09-12T17:43:30.265 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31266.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31266.log.gz 2024-09-12T17:43:30.265 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102628.log 2024-09-12T17:43:30.265 INFO:teuthology.orchestra.run.smithi016.stderr: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.37937.log.gz 2024-09-12T17:43:30.265 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.142751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.166920.log 2024-09-12T17:43:30.265 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61256.log 2024-09-12T17:43:30.265 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.102628.log: /var/log/ceph/ceph-client.0.166920.log: 80.6% 82.2% -- replaced with /var/log/ceph/ceph-client.admin.102628.log.gz 2024-09-12T17:43:30.265 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.0.166920.log.gz 2024-09-12T17:43:30.265 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21767.log 2024-09-12T17:43:30.265 INFO:teuthology.orchestra.run.smithi016.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.142751.log.gz 2024-09-12T17:43:30.265 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80206.log 2024-09-12T17:43:30.265 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.61256.log: /var/log/ceph/ceph.tmp-client.admin.21767.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21767.log.gz 2024-09-12T17:43:30.267 INFO:teuthology.orchestra.run.smithi016.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.61256.log.gz 2024-09-12T17:43:30.267 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31060.log 2024-09-12T17:43:30.267 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.80206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70176.log 2024-09-12T17:43:30.267 INFO:teuthology.orchestra.run.smithi016.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.80206.log.gz 2024-09-12T17:43:30.268 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104398.log 2024-09-12T17:43:30.268 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31060.log.gz 2024-09-12T17:43:30.268 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.70176.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.70176.log.gz 2024-09-12T17:43:30.272 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92006.log 2024-09-12T17:43:30.272 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53552.log.gz 2024-09-12T17:43:30.272 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114428.log 2024-09-12T17:43:30.272 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.104398.log: /var/log/ceph/ceph-client.admin.92006.log: 82.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.173412.log 2024-09-12T17:43:30.272 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.104398.log.gz 2024-09-12T17:43:30.272 INFO:teuthology.orchestra.run.smithi016.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.92006.log.gz 2024-09-12T17:43:30.272 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.114428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26794.log 2024-09-12T17:43:30.273 INFO:teuthology.orchestra.run.smithi016.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.114428.log.gz 2024-09-12T17:43:30.273 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.0.173412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162516.log 2024-09-12T17:43:30.273 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155238.log 2024-09-12T17:43:30.273 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.26794.log: 80.3% -- replaced with /var/log/ceph/ceph-client.0.173412.log.gz 2024-09-12T17:43:30.273 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26794.log.gz 2024-09-12T17:43:30.273 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.162516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159443.log 2024-09-12T17:43:30.273 INFO:teuthology.orchestra.run.smithi016.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.162516.log.gz 2024-09-12T17:43:30.273 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72536.log 2024-09-12T17:43:30.273 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.155238.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155238.log.gz 2024-09-12T17:43:30.273 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.159443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149241.log 2024-09-12T17:43:30.273 INFO:teuthology.orchestra.run.smithi016.stderr:gzip/var/log/ceph/ceph-client.admin.72536.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.155853.log 2024-09-12T17:43:30.273 INFO:teuthology.orchestra.run.smithi016.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.72536.log.gz/var/log/ceph/ceph-client.admin.149241.log: 2024-09-12T17:43:30.273 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107348.log 2024-09-12T17:43:30.274 INFO:teuthology.orchestra.run.smithi016.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.149241.log.gz 2024-09-12T17:43:30.278 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.155853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31503.log 2024-09-12T17:43:30.278 INFO:teuthology.orchestra.run.smithi016.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.159443.log.gz 2024-09-12T17:43:30.278 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.107348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107938.log 2024-09-12T17:43:30.278 INFO:teuthology.orchestra.run.smithi016.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.155853.log.gz 85.7% 2024-09-12T17:43:30.278 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.107348.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146291.log 2024-09-12T17:43:30.278 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-09-12T17:43:30.278 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31503.log: /var/log/ceph/ceph-client.admin.107938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31820.log 2024-09-12T17:43:30.278 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31503.log.gz 2024-09-12T17:43:30.278 INFO:teuthology.orchestra.run.smithi016.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.107938.log.gz 2024-09-12T17:43:30.278 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.146291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179833.log 2024-09-12T17:43:30.279 INFO:teuthology.orchestra.run.smithi016.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.146291.log.gz 2024-09-12T17:43:30.279 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85516.log 2024-09-12T17:43:30.279 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31820.log.gz 2024-09-12T17:43:30.279 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51067.log 2024-09-12T17:43:30.279 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.179833.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179833.log.gz 2024-09-12T17:43:30.279 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.85516.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T17:43:30.279 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.51067.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.85516.log.gz 2024-09-12T17:43:30.279 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31066.log 2024-09-12T17:43:30.279 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51067.log.gz 2024-09-12T17:43:30.279 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose --/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.93186.log 2024-09-12T17:43:30.280 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64024.log 2024-09-12T17:43:30.280 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31066.log.gz 2024-09-12T17:43:30.280 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.93186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31067.log 2024-09-12T17:43:30.280 INFO:teuthology.orchestra.run.smithi016.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.93186.log.gz 2024-09-12T17:43:30.280 INFO:teuthology.orchestra.run.smithi016.stderr: 95.0% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-12T17:43:30.280 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.64024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137440.log 2024-09-12T17:43:30.280 INFO:teuthology.orchestra.run.smithi016.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.64024.log.gz 2024-09-12T17:43:30.280 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180015.log 2024-09-12T17:43:30.280 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31067.log.gz 2024-09-12T17:43:30.284 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30990.log 2024-09-12T17:43:30.284 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.137440.log: /var/log/ceph/ceph-client.admin.180015.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.137440.log.gz 2024-09-12T17:43:30.285 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26707.log 2024-09-12T17:43:30.285 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180015.log.gz 2024-09-12T17:43:30.285 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.30990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60611.log 2024-09-12T17:43:30.285 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30990.log.gz 2024-09-12T17:43:30.285 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.26707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120328.log 2024-09-12T17:43:30.285 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26707.log.gz 2024-09-12T17:43:30.285 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.60611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39707.log 2024-09-12T17:43:30.285 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.120328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80796.log 2024-09-12T17:43:30.285 INFO:teuthology.orchestra.run.smithi016.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.120328.log.gz 2024-09-12T17:43:30.285 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.39707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68296.log 2024-09-12T17:43:30.285 INFO:teuthology.orchestra.run.smithi016.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.39707.log.gz 2024-09-12T17:43:30.285 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160032.log 2024-09-12T17:43:30.286 INFO:teuthology.orchestra.run.smithi016.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60611.log.gz 2024-09-12T17:43:30.286 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.80796.log: /var/log/ceph/ceph-client.0.68296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119738.log 2024-09-12T17:43:30.286 INFO:teuthology.orchestra.run.smithi016.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.0.68296.log.gz 2024-09-12T17:43:30.286 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.160032.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.160032.log.gz 2024-09-12T17:43:30.286 INFO:teuthology.orchestra.run.smithi016.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.80796.log.gz 2024-09-12T17:43:30.286 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96726.log 2024-09-12T17:43:30.286 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.119738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30868.log 2024-09-12T17:43:30.286 INFO:teuthology.orchestra.run.smithi016.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.119738.log.gz 2024-09-12T17:43:30.286 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.96726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58675.log 2024-09-12T17:43:30.286 INFO:teuthology.orchestra.run.smithi016.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.96726.log.gz 2024-09-12T17:43:30.286 INFO:teuthology.orchestra.run.smithi016.stderr:gzip/var/log/ceph/ceph-client.admin.30868.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.92596.log 2024-09-12T17:43:30.286 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30868.log.gz 2024-09-12T17:43:30.286 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.58675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83746.log 2024-09-12T17:43:30.288 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.92596.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-12T17:43:30.288 INFO:teuthology.orchestra.run.smithi016.stderr: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.92596.log.gz/var/log/ceph/ceph-client.admin.83746.log: 2024-09-12T17:43:30.289 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.165740.log 2024-09-12T17:43:30.289 INFO:teuthology.orchestra.run.smithi016.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.83746.log.gz 2024-09-12T17:43:30.289 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177923.log 2024-09-12T17:43:30.289 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.0.165740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152213.log 2024-09-12T17:43:30.289 INFO:teuthology.orchestra.run.smithi016.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.58675.log.gz 2024-09-12T17:43:30.289 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.177923.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.165740.log.gz 2024-09-12T17:43:30.289 INFO:teuthology.orchestra.run.smithi016.stderr: 25.5% -- replaced with /var/log/ceph/ceph-client.admin.177923.log.gz 2024-09-12T17:43:30.290 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59965.log 2024-09-12T17:43:30.290 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.152213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139210.log 2024-09-12T17:43:30.291 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26669.log 2024-09-12T17:43:30.306 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-12T17:43:30.307 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.26669.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26669.log.gz 2024-09-12T17:43:30.307 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-12T17:43:30.307 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26693.log 2024-09-12T17:43:30.307 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26717.log 2024-09-12T17:43:30.307 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.admin.26693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26597.log 2024-09-12T17:43:30.307 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26693.log.gz 2024-09-12T17:43:30.307 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.26717.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26717.log.gz 2024-09-12T17:43:30.307 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-12T17:43:30.307 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.26597.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26597.log.gz 2024-09-12T17:43:30.308 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26741.log 2024-09-12T17:43:30.308 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26621.log 2024-09-12T17:43:30.308 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.26741.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26741.log.gz 2024-09-12T17:43:30.308 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T17:43:30.308 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T17:43:30.308 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.26621.log: /var/log/ceph/ceph-mgr.x.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26621.log.gz 2024-09-12T17:43:30.308 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T17:43:30.308 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26645.log 2024-09-12T17:43:30.308 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26765.log 2024-09-12T17:43:30.308 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.26645.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26645.log.gz 2024-09-12T17:43:30.308 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-12T17:43:30.308 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.26765.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26765.log.gz 2024-09-12T17:43:30.308 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-12T17:43:30.309 INFO:teuthology.orchestra.run.smithi019.stderr: 90.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T17:43:30.309 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-osd.4.log: 87.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T17:43:30.316 INFO:teuthology.orchestra.run.smithi016.stderr: 82.1%/var/log/ceph/ceph-client.admin.59965.log: -- replaced with /var/log/ceph/ceph-client.admin.152213.log.gz 2024-09-12T17:43:30.316 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177946.log 2024-09-12T17:43:30.316 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74896.log 2024-09-12T17:43:30.316 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.139210.log: /var/log/ceph/ceph-client.admin.177946.log: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.139210.log.gz 2024-09-12T17:43:30.316 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.177946.log.gz 2024-09-12T17:43:30.317 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73716.log 2024-09-12T17:43:30.317 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.74896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43937.log 2024-09-12T17:43:30.317 INFO:teuthology.orchestra.run.smithi016.stderr: 92.8% 87.2% -- replaced with /var/log/ceph/ceph-client.0.179240.log.gz 2024-09-12T17:43:30.317 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59965.log.gz 2024-09-12T17:43:30.317 INFO:teuthology.orchestra.run.smithi016.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.74896.log.gz 2024-09-12T17:43:30.317 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.73716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110298.log 2024-09-12T17:43:30.317 INFO:teuthology.orchestra.run.smithi016.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.73716.log.gz 2024-09-12T17:43:30.317 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.43937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130949.log 2024-09-12T17:43:30.317 INFO:teuthology.orchestra.run.smithi016.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.43937.log.gz 2024-09-12T17:43:30.317 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.110298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86696.log 2024-09-12T17:43:30.317 INFO:teuthology.orchestra.run.smithi016.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.110298.log.gz 2024-09-12T17:43:30.317 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.130949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149831.log 2024-09-12T17:43:30.318 INFO:teuthology.orchestra.run.smithi016.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.130949.log.gz 2024-09-12T17:43:30.318 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.86696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177996.log 2024-09-12T17:43:30.318 INFO:teuthology.orchestra.run.smithi016.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.86696.log.gz 2024-09-12T17:43:30.318 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.149831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31462.log 2024-09-12T17:43:30.318 INFO:teuthology.orchestra.run.smithi016.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.149831.log.gz 2024-09-12T17:43:30.318 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.177996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53485.log 2024-09-12T17:43:30.318 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.177996.log.gz 2024-09-12T17:43:30.318 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46297.log 2024-09-12T17:43:30.318 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31462.log.gz 2024-09-12T17:43:30.318 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.53485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47477.log 2024-09-12T17:43:30.318 INFO:teuthology.orchestra.run.smithi016.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.53485.log.gz 2024-09-12T17:43:30.318 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.46297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154033.log 2024-09-12T17:43:30.319 INFO:teuthology.orchestra.run.smithi016.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.46297.log.gz 2024-09-12T17:43:30.319 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.47477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53298.log 2024-09-12T17:43:30.319 INFO:teuthology.orchestra.run.smithi016.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.47477.log.gz 2024-09-12T17:43:30.319 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.154033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66440.log 2024-09-12T17:43:30.319 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.53298.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.154033.log.gz 2024-09-12T17:43:30.319 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 47.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.53298.log.gz 2024-09-12T17:43:30.319 INFO:teuthology.orchestra.run.smithi016.stderr: /var/log/ceph/ceph-client.admin.39117.log 2024-09-12T17:43:30.319 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.0.66440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83156.log 2024-09-12T17:43:30.319 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.39117.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.66440.log.gz 2024-09-12T17:43:30.319 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138620.log 2024-09-12T17:43:30.319 INFO:teuthology.orchestra.run.smithi016.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.39117.log.gz 2024-09-12T17:43:30.319 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.83156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176080.log 2024-09-12T17:43:30.319 INFO:teuthology.orchestra.run.smithi016.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.83156.log.gz 2024-09-12T17:43:30.320 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.138620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74306.log 2024-09-12T17:43:30.320 INFO:teuthology.orchestra.run.smithi016.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.138620.log.gz 2024-09-12T17:43:30.320 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.176080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125638.log 2024-09-12T17:43:30.320 INFO:teuthology.orchestra.run.smithi016.stderr: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.176080.log.gz 2024-09-12T17:43:30.320 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.74306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177333.log 2024-09-12T17:43:30.320 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.125638.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.74306.log.gz 2024-09-12T17:43:30.320 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31870.log 2024-09-12T17:43:30.320 INFO:teuthology.orchestra.run.smithi016.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.125638.log.gz 2024-09-12T17:43:30.321 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.177333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54177.log 2024-09-12T17:43:30.321 INFO:teuthology.orchestra.run.smithi016.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.177333.log.gz 2024-09-12T17:43:30.321 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180249.log 2024-09-12T17:43:30.321 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31870.log.gz 2024-09-12T17:43:30.321 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.54177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161927.log 2024-09-12T17:43:30.321 INFO:teuthology.orchestra.run.smithi016.stderr: 21.2% -- replaced with /var/log/ceph/ceph-client.admin.54177.log.gz 2024-09-12T17:43:30.322 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164550.log 2024-09-12T17:43:30.322 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.180249.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180249.log.gz 2024-09-12T17:43:30.322 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.161927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42757.log 2024-09-12T17:43:30.322 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.164550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179963.log 2024-09-12T17:43:30.322 INFO:teuthology.orchestra.run.smithi016.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.161927.log.gz 2024-09-12T17:43:30.322 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31744.log 2024-09-12T17:43:30.323 INFO:teuthology.orchestra.run.smithi016.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.42757.log.gz 2024-09-12T17:43:30.323 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180353.log 2024-09-12T17:43:30.323 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.179963.log: /var/log/ceph/ceph-client.admin.31744.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179963.log.gz 2024-09-12T17:43:30.323 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31744.log.gz 2024-09-12T17:43:30.323 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54802.log 2024-09-12T17:43:30.323 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.180353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179911.log 2024-09-12T17:43:30.323 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180353.log.gz 2024-09-12T17:43:30.324 INFO:teuthology.orchestra.run.smithi016.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.164550.log.gz 2024-09-12T17:43:30.324 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.54802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150421.log 2024-09-12T17:43:30.324 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31481.log 2024-09-12T17:43:30.324 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.179911.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179911.log.gz 2024-09-12T17:43:30.324 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.150421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49887.log 2024-09-12T17:43:30.324 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150421.log.gz 2024-09-12T17:43:30.324 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31481.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31481.log.gz 2024-09-12T17:43:30.325 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.170462.log 2024-09-12T17:43:30.325 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180041.log 2024-09-12T17:43:30.325 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.49887.log: gzip -5 --verbose --/var/log/ceph/ceph-client.0.170462.log: /var/log/ceph/ceph-client.admin.163105.log 2024-09-12T17:43:30.325 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.180041.log: 84.1% -- replaced with /var/log/ceph/ceph-client.0.170462.log.gz 2024-09-12T17:43:30.325 INFO:teuthology.orchestra.run.smithi016.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.49887.log.gz 2024-09-12T17:43:30.325 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180041.log.gz 2024-09-12T17:43:30.325 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103808.log 2024-09-12T17:43:30.326 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31473.log 2024-09-12T17:43:30.326 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.163105.log: /var/log/ceph/ceph-client.admin.103808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123868.log 2024-09-12T17:43:30.326 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31473.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.163105.log.gz 2024-09-12T17:43:30.326 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31473.log.gz 2024-09-12T17:43:30.326 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-12T17:43:30.326 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158526.log 2024-09-12T17:43:30.327 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.123868.log: /var/log/ceph/ceph-osd.3.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.103808.log.gz 2024-09-12T17:43:30.327 INFO:teuthology.orchestra.run.smithi016.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.123868.log.gz 2024-09-12T17:43:30.327 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30918.log 2024-09-12T17:43:30.327 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115018.log 2024-09-12T17:43:30.327 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.158526.log: /var/log/ceph/ceph-client.admin.30918.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30918.log.gz 2024-09-12T17:43:30.327 INFO:teuthology.orchestra.run.smithi016.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.158526.log.gz 2024-09-12T17:43:30.328 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30893.log 2024-09-12T17:43:30.328 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128589.log 2024-09-12T17:43:30.328 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.115018.log: /var/log/ceph/ceph-client.admin.30893.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.115018.log.gz 2024-09-12T17:43:30.328 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30893.log.gz 2024-09-12T17:43:30.328 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89646.log 2024-09-12T17:43:30.328 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178047.log 2024-09-12T17:43:30.329 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.128589.log: /var/log/ceph/ceph-client.admin.89646.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.128589.log.gz 2024-09-12T17:43:30.329 INFO:teuthology.orchestra.run.smithi016.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.89646.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180067.log 2024-09-12T17:43:30.329 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-09-12T17:43:30.329 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.178047.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.178047.log.gz 2024-09-12T17:43:30.341 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106758.log 2024-09-12T17:43:30.342 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127409.log 2024-09-12T17:43:30.342 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.180067.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180067.log.gz 2024-09-12T17:43:30.342 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.106758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77256.log 2024-09-12T17:43:30.342 INFO:teuthology.orchestra.run.smithi016.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.106758.log.gz 2024-09-12T17:43:30.342 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.127409.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.127409.log.gz 2024-09-12T17:43:30.342 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67668.log 2024-09-12T17:43:30.342 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151623.log 2024-09-12T17:43:30.342 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.77256.log: /var/log/ceph/ceph-client.admin.67668.log: 51.6% -- replaced with /var/log/ceph/ceph-client.admin.67668.log.gz 2024-09-12T17:43:30.342 INFO:teuthology.orchestra.run.smithi016.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.77256.log.gz 2024-09-12T17:43:30.342 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93776.log 2024-09-12T17:43:30.342 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112068.log 2024-09-12T17:43:30.342 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.151623.log: 93.9%/var/log/ceph/ceph-client.admin.93776.log: -- replaced with /var/log/ceph/ceph-client.admin.54802.log.gz 2024-09-12T17:43:30.342 INFO:teuthology.orchestra.run.smithi016.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.151623.log.gz 2024-09-12T17:43:30.343 INFO:teuthology.orchestra.run.smithi016.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.93776.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31461.log 2024-09-12T17:43:30.343 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-09-12T17:43:30.343 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.112068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76666.log 2024-09-12T17:43:30.343 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.172232.log 2024-09-12T17:43:30.343 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31461.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31461.log.gz 2024-09-12T17:43:30.343 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.76666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31468.log 2024-09-12T17:43:30.343 INFO:teuthology.orchestra.run.smithi016.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.76666.log.gz 2024-09-12T17:43:30.343 INFO:teuthology.orchestra.run.smithi016.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.112068.log.gz 2024-09-12T17:43:30.343 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.0.172232.log: 84.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38527.log 2024-09-12T17:43:30.343 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.0.172232.log.gz 2024-09-12T17:43:30.343 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145111.log 2024-09-12T17:43:30.343 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31468.log.gz 2024-09-12T17:43:30.344 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.38527.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-09-12T17:43:30.344 INFO:teuthology.orchestra.run.smithi016.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.38527.log.gz 2024-09-12T17:43:30.344 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.145111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31016.log 2024-09-12T17:43:30.344 INFO:teuthology.orchestra.run.smithi016.stderr: 82.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86106.log 2024-09-12T17:43:30.344 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.145111.log.gz 2024-09-12T17:43:30.344 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ops-log-ceph-client.admin.log: /var/log/ceph/ceph-client.admin.31016.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31016.log.gz 2024-09-12T17:43:30.344 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T17:43:30.344 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55449.log 2024-09-12T17:43:30.344 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.86106.log: 94.1% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-09-12T17:43:30.344 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-osd.1.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.86106.log.gz 2024-09-12T17:43:30.344 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58029.log 2024-09-12T17:43:30.344 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.55449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176670.log 2024-09-12T17:43:30.344 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.58029.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.55449.log.gz 2024-09-12T17:43:30.344 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126229.log 2024-09-12T17:43:30.345 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.176670.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.176670.log.gz 2024-09-12T17:43:30.345 INFO:teuthology.orchestra.run.smithi016.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.58029.log.gz 2024-09-12T17:43:30.345 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78436.log 2024-09-12T17:43:30.345 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84336.log 2024-09-12T17:43:30.345 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.126229.log: /var/log/ceph/ceph-client.admin.78436.log: 87.1% 82.1% -- replaced with /var/log/ceph/ceph-client.admin.126229.log.gz 2024-09-12T17:43:30.345 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.78436.log.gz 2024-09-12T17:43:30.345 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141570.log 2024-09-12T17:43:30.345 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.172822.log 2024-09-12T17:43:30.345 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.84336.log: /var/log/ceph/ceph-client.admin.141570.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.84336.log.gz 2024-09-12T17:43:30.345 INFO:teuthology.orchestra.run.smithi016.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.141570.log.gz 2024-09-12T17:43:30.345 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143931.log 2024-09-12T17:43:30.345 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180119.log 2024-09-12T17:43:30.345 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.0.172822.log: /var/log/ceph/ceph-client.admin.143931.log: 84.5% -- replaced with /var/log/ceph/ceph-client.0.172822.log.gz 2024-09-12T17:43:30.346 INFO:teuthology.orchestra.run.smithi016.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.143931.log.gz 2024-09-12T17:43:30.346 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178644.log 2024-09-12T17:43:30.346 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133309.log 2024-09-12T17:43:30.346 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.180119.log: /var/log/ceph/ceph-client.0.178644.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180119.log.gz 2024-09-12T17:43:30.346 INFO:teuthology.orchestra.run.smithi016.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.0.178644.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145701.log 2024-09-12T17:43:30.346 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-09-12T17:43:30.346 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.133309.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.133309.log.gz 2024-09-12T17:43:30.346 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54213.log 2024-09-12T17:43:30.346 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132719.log 2024-09-12T17:43:30.346 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.145701.log: /var/log/ceph/ceph-client.admin.54213.log: 83.0% -- replaced with /var/log/ceph/ceph-client.admin.145701.log.gz 2024-09-12T17:43:30.347 INFO:teuthology.orchestra.run.smithi016.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.54213.log.gz 2024-09-12T17:43:30.347 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103218.log 2024-09-12T17:43:30.350 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136850.log 2024-09-12T17:43:30.350 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.132719.log: /var/log/ceph/ceph-client.admin.103218.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.103218.log.gz 2024-09-12T17:43:30.350 INFO:teuthology.orchestra.run.smithi016.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.132719.log.gz 2024-09-12T17:43:30.350 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67706.log 2024-09-12T17:43:30.351 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177971.log 2024-09-12T17:43:30.351 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.136850.log: /var/log/ceph/ceph-client.0.67706.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.136850.log.gz 2024-09-12T17:43:30.351 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140390.log 2024-09-12T17:43:30.351 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.177971.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.177971.log.gz 2024-09-12T17:43:30.351 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96136.log 2024-09-12T17:43:30.351 INFO:teuthology.orchestra.run.smithi016.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.0.67706.log.gz 2024-09-12T17:43:30.351 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.140390.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.140390.log.gz 2024-09-12T17:43:30.351 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31666.log 2024-09-12T17:43:30.351 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116198.log 2024-09-12T17:43:30.351 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.96136.log: /var/log/ceph/ceph-client.admin.31666.log: 0.0% 82.6% -- replaced with /var/log/ceph/ceph-client.admin.31666.log.gz -- replaced with /var/log/ceph/ceph-client.admin.96136.log.gz 2024-09-12T17:43:30.351 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-09-12T17:43:30.352 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63435.log 2024-09-12T17:43:30.352 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118558.log 2024-09-12T17:43:30.354 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.116198.log: /var/log/ceph/ceph-client.admin.63435.log: 81.3% 86.8% -- replaced with /var/log/ceph/ceph-client.admin.116198.log.gz 2024-09-12T17:43:30.354 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63435.log.gz 2024-09-12T17:43:30.354 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135670.log 2024-09-12T17:43:30.354 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31256.log 2024-09-12T17:43:30.354 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.118558.log: /var/log/ceph/ceph-client.admin.135670.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.118558.log.gz 2024-09-12T17:43:30.354 INFO:teuthology.orchestra.run.smithi016.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.135670.log.gz 2024-09-12T17:43:30.355 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180093.log 2024-09-12T17:43:30.355 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30606.log 2024-09-12T17:43:30.355 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31256.log: /var/log/ceph/ceph-client.admin.180093.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31256.log.gz 2024-09-12T17:43:30.355 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180093.log.gz 2024-09-12T17:43:30.355 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91416.log 2024-09-12T17:43:30.355 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.30606.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30606.log.gz 2024-09-12T17:43:30.357 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180327.log 2024-09-12T17:43:30.357 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122688.log 2024-09-12T17:43:30.357 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.91416.log: /var/log/ceph/ceph-client.admin.180327.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.91416.log.gz 2024-09-12T17:43:30.357 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180327.log.gz 2024-09-12T17:43:30.357 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131539.log 2024-09-12T17:43:30.357 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90236.log 2024-09-12T17:43:30.357 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.122688.log: /var/log/ceph/ceph-client.admin.131539.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.122688.log.gz 2024-09-12T17:43:30.357 INFO:teuthology.orchestra.run.smithi016.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.131539.log.gz 2024-09-12T17:43:30.358 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160621.log 2024-09-12T17:43:30.359 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122098.log 2024-09-12T17:43:30.359 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.90236.log: /var/log/ceph/ceph-client.admin.160621.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.90236.log.gz 2024-09-12T17:43:30.360 INFO:teuthology.orchestra.run.smithi016.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.160621.log.gz 2024-09-12T17:43:30.360 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68996.log 2024-09-12T17:43:30.360 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56739.log 2024-09-12T17:43:30.360 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.122098.log: /var/log/ceph/ceph-client.admin.68996.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.122098.log.gz 2024-09-12T17:43:30.360 INFO:teuthology.orchestra.run.smithi016.stderr: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.68996.log.gz 2024-09-12T17:43:30.360 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71356.log 2024-09-12T17:43:30.361 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127999.log 2024-09-12T17:43:30.361 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.56739.log: /var/log/ceph/ceph-client.admin.71356.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.71356.log.gz 2024-09-12T17:43:30.365 INFO:teuthology.orchestra.run.smithi016.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.56739.log.gz 2024-09-12T17:43:30.365 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113248.log 2024-09-12T17:43:30.366 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31068.log 2024-09-12T17:43:30.366 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.127999.log: /var/log/ceph/ceph-client.admin.113248.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.127999.log.gz 2024-09-12T17:43:30.368 INFO:teuthology.orchestra.run.smithi016.stderr: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180406.log 2024-09-12T17:43:30.368 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.113248.log.gz 2024-09-12T17:43:30.368 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132129.log 2024-09-12T17:43:30.368 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0%/var/log/ceph/ceph-client.admin.180406.log: -- replaced with /var/log/ceph/ceph-client.admin.31068.log.gz 2024-09-12T17:43:30.369 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180406.log.gz 2024-09-12T17:43:30.369 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117968.log 2024-09-12T17:43:30.369 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T17:43:30.369 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.132129.log: /var/log/ceph/ceph-client.admin.117968.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.132129.log.gz 2024-09-12T17:43:30.370 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89056.log 2024-09-12T17:43:30.371 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.117968.log.gz 2024-09-12T17:43:30.374 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69586.log 2024-09-12T17:43:30.376 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.89056.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.89056.log.gz 2024-09-12T17:43:30.376 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30938.log 2024-09-12T17:43:30.377 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.69586.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.69586.log.gz 2024-09-12T17:43:30.377 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31278.log 2024-09-12T17:43:30.378 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.30938.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30938.log.gz 2024-09-12T17:43:30.378 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31263.log 2024-09-12T17:43:30.379 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31278.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31278.log.gz 2024-09-12T17:43:30.379 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53583.log 2024-09-12T17:43:30.381 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31263.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31263.log.gz 2024-09-12T17:43:30.381 INFO:teuthology.orchestra.run.smithi016.stderr: 93.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T17:43:30.381 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129179.log 2024-09-12T17:43:30.382 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57384.log 2024-09-12T17:43:30.382 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.53583.log: /var/log/ceph/ceph-client.admin.129179.log: 52.4% -- replaced with /var/log/ceph/ceph-client.admin.53583.log.gz 2024-09-12T17:43:30.382 INFO:teuthology.orchestra.run.smithi016.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.129179.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.169282.log 2024-09-12T17:43:30.382 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-09-12T17:43:30.387 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.57384.log: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.57384.log.gz 2024-09-12T17:43:30.388 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65797.log 2024-09-12T17:43:30.389 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94366.log 2024-09-12T17:43:30.389 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.0.169282.log: /var/log/ceph/ceph-client.admin.65797.log: 84.6% -- replaced with /var/log/ceph/ceph-client.0.169282.log.gz 2024-09-12T17:43:30.389 INFO:teuthology.orchestra.run.smithi016.stderr: 83.5% -- replaced with /var/log/ceph/ceph-client.admin.65797.log.gz 2024-09-12T17:43:30.389 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42117.log 2024-09-12T17:43:30.391 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125048.log 2024-09-12T17:43:30.391 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.94366.log: /var/log/ceph/ceph-client.admin.42117.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.94366.log.gz 2024-09-12T17:43:30.391 INFO:teuthology.orchestra.run.smithi016.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.42117.log.gz 2024-09-12T17:43:30.391 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31062.log 2024-09-12T17:43:30.393 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79026.log 2024-09-12T17:43:30.393 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.125048.log: /var/log/ceph/ceph-client.admin.31062.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31062.log.gz 2024-09-12T17:43:30.393 INFO:teuthology.orchestra.run.smithi016.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.125048.log.gz 2024-09-12T17:43:30.393 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48657.log 2024-09-12T17:43:30.393 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.79026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99678.log 2024-09-12T17:43:30.393 INFO:teuthology.orchestra.run.smithi016.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.79026.log.gz 2024-09-12T17:43:30.394 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.48657.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48657.log.gz 2024-09-12T17:43:30.394 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98498.log 2024-09-12T17:43:30.396 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.99678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133899.log 2024-09-12T17:43:30.396 INFO:teuthology.orchestra.run.smithi016.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.99678.log.gz 2024-09-12T17:43:30.396 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.98498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31844.log 2024-09-12T17:43:30.396 INFO:teuthology.orchestra.run.smithi016.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.98498.log.gz/var/log/ceph/ceph-client.admin.133899.log: 2024-09-12T17:43:30.396 INFO:teuthology.orchestra.run.smithi016.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.133899.log.gz 2024-09-12T17:43:30.396 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51092.log 2024-09-12T17:43:30.396 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31844.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31844.log.gz 2024-09-12T17:43:30.396 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31069.log 2024-09-12T17:43:30.398 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177308.log 2024-09-12T17:43:30.398 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.51092.log: /var/log/ceph/ceph-client.admin.31069.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51092.log.gz 2024-09-12T17:43:30.398 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31069.log.gz 2024-09-12T17:43:30.398 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.169872.log 2024-09-12T17:43:30.398 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130359.log 2024-09-12T17:43:30.399 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.177308.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.177308.log.gz 2024-09-12T17:43:30.399 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.0.169872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26560.log 2024-09-12T17:43:30.399 INFO:teuthology.orchestra.run.smithi016.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.0.169872.log.gz 2024-09-12T17:43:30.400 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.130359.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.130359.log.gz 2024-09-12T17:43:30.400 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81386.log 2024-09-12T17:43:30.401 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48682.log 2024-09-12T17:43:30.401 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.26560.log: /var/log/ceph/ceph-client.admin.81386.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26560.log.gz 2024-09-12T17:43:30.401 INFO:teuthology.orchestra.run.smithi016.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.81386.log.gz 2024-09-12T17:43:30.401 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110888.log 2024-09-12T17:43:30.402 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.48682.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48682.log.gz 2024-09-12T17:43:30.402 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109708.log 2024-09-12T17:43:30.402 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31794.log 2024-09-12T17:43:30.402 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.110888.log: /var/log/ceph/ceph-client.admin.109708.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.110888.log.gz 2024-09-12T17:43:30.403 INFO:teuthology.orchestra.run.smithi016.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.109708.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147471.log 2024-09-12T17:43:30.403 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-09-12T17:43:30.403 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31794.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31794.log.gz 2024-09-12T17:43:30.403 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-12T17:43:30.404 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154623.log 2024-09-12T17:43:30.404 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.147471.log: /var/log/ceph/ceph-mon.c.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.147471.log.gz 2024-09-12T17:43:30.404 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152803.log 2024-09-12T17:43:30.405 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.154623.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.154623.log.gz 2024-09-12T17:43:30.405 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.157344.log 2024-09-12T17:43:30.406 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.152803.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.152803.log.gz 2024-09-12T17:43:30.407 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51707.log 2024-09-12T17:43:30.408 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.0.157344.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.157344.log.gz 2024-09-12T17:43:30.408 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126819.log 2024-09-12T17:43:30.409 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.51707.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.51707.log.gz 2024-09-12T17:43:30.409 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40297.log 2024-09-12T17:43:30.410 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.126819.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.126819.log.gz 2024-09-12T17:43:30.411 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71946.log 2024-09-12T17:43:30.411 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.40297.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40297.log.gz 2024-09-12T17:43:30.412 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32491.log 2024-09-12T17:43:30.413 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.71946.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.71946.log.gz 2024-09-12T17:43:30.413 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30964.log 2024-09-12T17:43:30.414 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.0.32491.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.32491.log.gz 2024-09-12T17:43:30.414 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123278.log 2024-09-12T17:43:30.415 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.30964.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30964.log.gz 2024-09-12T17:43:30.415 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115608.log 2024-09-12T17:43:30.416 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.123278.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.123278.log.gz 2024-09-12T17:43:30.416 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67030.log 2024-09-12T17:43:30.417 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.115608.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.115608.log.gz 2024-09-12T17:43:30.418 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-12T17:43:30.419 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.0.67030.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.67030.log.gz 2024-09-12T17:43:30.419 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82566.log 2024-09-12T17:43:30.426 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180275.log 2024-09-12T17:43:30.438 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150443.log 2024-09-12T17:43:30.439 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.180275.log: /var/log/ceph/ceph-client.admin.82566.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180275.log.gz 2024-09-12T17:43:30.439 INFO:teuthology.orchestra.run.smithi016.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.82566.log.gz 2024-09-12T17:43:30.450 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153418.log 2024-09-12T17:43:30.451 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.150443.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.150443.log.gz 2024-09-12T17:43:30.467 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49297.log 2024-09-12T17:43:30.467 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.153418.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153418.log.gz 2024-09-12T17:43:30.482 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100858.log 2024-09-12T17:43:30.482 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.49297.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.49297.log.gz 2024-09-12T17:43:30.490 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T17:43:30.490 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.100858.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.100858.log.gz 2024-09-12T17:43:30.498 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31893.log 2024-09-12T17:43:30.501 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph.audit.log: 94.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T17:43:30.506 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41527.log 2024-09-12T17:43:30.507 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.0.31893.log: 95.9% -- replaced with /var/log/ceph/ceph-client.0.31893.log.gz 2024-09-12T17:43:30.519 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.175182.log 2024-09-12T17:43:30.519 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.41527.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.41527.log.gz 2024-09-12T17:43:30.526 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31474.log 2024-09-12T17:43:30.526 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.0.175182.log: 80.6% -- replaced with /var/log/ceph/ceph-client.0.175182.log.gz 2024-09-12T17:43:30.542 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77846.log 2024-09-12T17:43:30.543 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31474.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31474.log.gz 2024-09-12T17:43:30.554 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180171.log 2024-09-12T17:43:30.554 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.77846.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.77846.log.gz 2024-09-12T17:43:30.563 INFO:teuthology.orchestra.run.smithi016.stderr: 94.7% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-12T17:43:30.564 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.166330.log 2024-09-12T17:43:30.565 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.180171.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180171.log.gz 2024-09-12T17:43:30.565 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90826.log 2024-09-12T17:43:30.566 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.0.166330.log: 84.4% -- replaced with /var/log/ceph/ceph-client.0.166330.log.gz 2024-09-12T17:43:30.566 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135080.log 2024-09-12T17:43:30.567 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.90826.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.90826.log.gz 2024-09-12T17:43:30.567 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144521.log 2024-09-12T17:43:30.568 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.135080.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.135080.log.gz 2024-09-12T17:43:30.568 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155213.log 2024-09-12T17:43:30.570 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.144521.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.144521.log.gz 2024-09-12T17:43:30.571 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81976.log 2024-09-12T17:43:30.571 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.155213.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155213.log.gz 2024-09-12T17:43:30.571 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53608.log 2024-09-12T17:43:30.572 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.81976.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.81976.log.gz 2024-09-12T17:43:30.572 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165139.log 2024-09-12T17:43:30.573 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.53608.log: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.53608.log.gz 2024-09-12T17:43:30.574 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119148.log 2024-09-12T17:43:30.575 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.165139.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.165139.log.gz 2024-09-12T17:43:30.575 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106168.log 2024-09-12T17:43:30.576 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.119148.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.119148.log.gz 2024-09-12T17:43:30.576 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43347.log 2024-09-12T17:43:30.577 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.106168.log: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.106168.log.gz 2024-09-12T17:43:30.577 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.168692.log 2024-09-12T17:43:30.578 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.43347.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.43347.log.gz 2024-09-12T17:43:30.578 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153393.log 2024-09-12T17:43:30.579 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.0.168692.log: 83.9% -- replaced with /var/log/ceph/ceph-client.0.168692.log.gz 2024-09-12T17:43:30.579 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134490.log 2024-09-12T17:43:30.580 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.153393.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153393.log.gz 2024-09-12T17:43:30.580 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87286.log 2024-09-12T17:43:30.581 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.134490.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.134490.log.gz 2024-09-12T17:43:30.582 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51117.log 2024-09-12T17:43:30.582 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.87286.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.87286.log.gz 2024-09-12T17:43:30.583 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161210.log 2024-09-12T17:43:30.583 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.51117.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.51117.log.gz 2024-09-12T17:43:30.583 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56094.log 2024-09-12T17:43:30.584 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.161210.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.161210.log.gz 2024-09-12T17:43:30.585 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31270.log 2024-09-12T17:43:30.593 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.56094.log: 93.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102038.log 2024-09-12T17:43:30.593 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31270.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31270.log.gz 2024-09-12T17:43:30.593 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56094.log.gz 2024-09-12T17:43:30.593 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113838.log 2024-09-12T17:43:30.594 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.102038.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.102038.log.gz 2024-09-12T17:43:30.594 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180380.log 2024-09-12T17:43:30.595 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.113838.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.113838.log.gz 2024-09-12T17:43:30.596 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.174592.log 2024-09-12T17:43:30.596 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.180380.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180380.log.gz 2024-09-12T17:43:30.596 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97318.log 2024-09-12T17:43:30.597 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.0.174592.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.174592.log.gz 2024-09-12T17:43:30.597 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40347.log 2024-09-12T17:43:30.599 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.97318.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.97318.log.gz 2024-09-12T17:43:30.600 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48067.log 2024-09-12T17:43:30.600 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.40347.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.40347.log.gz 2024-09-12T17:43:30.601 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31250.log 2024-09-12T17:43:30.601 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.48067.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.48067.log.gz 2024-09-12T17:43:30.602 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34839.log 2024-09-12T17:43:30.602 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31250.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31250.log.gz 2024-09-12T17:43:30.602 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179989.log 2024-09-12T17:43:30.603 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.0.34839.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.34839.log.gz 2024-09-12T17:43:30.603 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179859.log 2024-09-12T17:43:30.604 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.179989.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179989.log.gz 2024-09-12T17:43:30.604 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105578.log 2024-09-12T17:43:30.605 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.179859.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179859.log.gz 2024-09-12T17:43:30.606 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180223.log 2024-09-12T17:43:30.606 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.105578.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.105578.log.gz 2024-09-12T17:43:30.607 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151033.log 2024-09-12T17:43:30.607 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.180223.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180223.log.gz 2024-09-12T17:43:30.608 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40322.log 2024-09-12T17:43:30.609 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.151033.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.151033.log.gz 2024-09-12T17:43:30.609 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45707.log 2024-09-12T17:43:30.610 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.40322.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40322.log.gz 2024-09-12T17:43:30.610 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62552.log 2024-09-12T17:43:30.611 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.45707.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.45707.log.gz 2024-09-12T17:43:30.611 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34249.log 2024-09-12T17:43:30.612 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.62552.log: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.62552.log.gz 2024-09-12T17:43:30.612 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54150.log 2024-09-12T17:43:30.613 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.0.34249.log: 80.7% -- replaced with /var/log/ceph/ceph-client.0.34249.log.gz 2024-09-12T17:43:30.614 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31718.log 2024-09-12T17:43:30.614 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.54150.log: 19.9% -- replaced with /var/log/ceph/ceph-client.admin.54150.log.gz 2024-09-12T17:43:30.615 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36591.log 2024-09-12T17:43:30.615 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31718.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31718.log.gz 2024-09-12T17:43:30.616 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111478.log 2024-09-12T17:43:30.617 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.0.36591.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.36591.log.gz 2024-09-12T17:43:30.617 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129769.log 2024-09-12T17:43:30.618 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.111478.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.111478.log.gz 2024-09-12T17:43:30.618 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33075.log 2024-09-12T17:43:30.619 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.129769.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.129769.log.gz 2024-09-12T17:43:30.619 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148061.log 2024-09-12T17:43:30.620 INFO:teuthology.orchestra.run.smithi019.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T17:43:30.621 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.0.33075.log: 80.6% -- replaced with /var/log/ceph/ceph-client.0.33075.log.gz 2024-09-12T17:43:30.621 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94956.log 2024-09-12T17:43:30.622 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.148061.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.148061.log.gz 2024-09-12T17:43:30.622 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120918.log 2024-09-12T17:43:30.623 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.94956.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.94956.log.gz 2024-09-12T17:43:30.623 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44527.log 2024-09-12T17:43:30.624 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.120918.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.120918.log.gz 2024-09-12T17:43:30.624 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180459.log 2024-09-12T17:43:30.625 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.44527.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.44527.log.gz 2024-09-12T17:43:30.625 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142160.log 2024-09-12T17:43:30.626 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.180459.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180459.log.gz 2024-09-12T17:43:30.626 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.171052.log 2024-09-12T17:43:30.627 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.142160.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.142160.log.gz 2024-09-12T17:43:30.627 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153443.log 2024-09-12T17:43:30.628 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.0.171052.log: 80.4% -- replaced with /var/log/ceph/ceph-client.0.171052.log.gz 2024-09-12T17:43:30.629 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.168102.log 2024-09-12T17:43:30.629 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.153443.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.153443.log.gz 2024-09-12T17:43:30.630 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46887.log 2024-09-12T17:43:30.631 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.0.168102.log: 80.8% -- replaced with /var/log/ceph/ceph-client.0.168102.log.gz 2024-09-12T17:43:30.631 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40937.log 2024-09-12T17:43:30.632 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.46887.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.46887.log.gz 2024-09-12T17:43:30.632 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66388.log 2024-09-12T17:43:30.633 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.40937.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.40937.log.gz 2024-09-12T17:43:30.633 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35423.log 2024-09-12T17:43:30.634 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.66388.log: 25.0% -- replaced with /var/log/ceph/ceph-client.admin.66388.log.gz 2024-09-12T17:43:30.634 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79616.log 2024-09-12T17:43:30.635 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.0.35423.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.35423.log.gz 2024-09-12T17:43:30.636 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163694.log 2024-09-12T17:43:30.636 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.79616.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.79616.log.gz 2024-09-12T17:43:30.637 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138030.log 2024-09-12T17:43:30.638 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.163694.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.163694.log.gz 2024-09-12T17:43:30.638 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53219.log 2024-09-12T17:43:30.639 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.138030.log: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.138030.log.gz 2024-09-12T17:43:30.639 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33665.log 2024-09-12T17:43:30.640 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.53219.log: 51.5% -- replaced with /var/log/ceph/ceph-client.admin.53219.log.gz 2024-09-12T17:43:30.640 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178022.log 2024-09-12T17:43:30.641 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.0.33665.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.33665.log.gz 2024-09-12T17:43:30.641 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95546.log 2024-09-12T17:43:30.642 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.178022.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.178022.log.gz 2024-09-12T17:43:30.642 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73126.log 2024-09-12T17:43:30.643 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.95546.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.95546.log.gz 2024-09-12T17:43:30.643 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177260.log 2024-09-12T17:43:30.644 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.73126.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.73126.log.gz 2024-09-12T17:43:30.645 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124458.log 2024-09-12T17:43:30.645 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.177260.log: 24.8% -- replaced with /var/log/ceph/ceph-client.admin.177260.log.gz 2024-09-12T17:43:30.646 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59320.log 2024-09-12T17:43:30.648 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.124458.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.124458.log.gz 2024-09-12T17:43:30.648 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112658.log 2024-09-12T17:43:30.662 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.59320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53527.log 2024-09-12T17:43:30.663 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.112658.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.112658.log.gz 2024-09-12T17:43:30.677 INFO:teuthology.orchestra.run.smithi016.stderr: 95.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121508.log 2024-09-12T17:43:30.678 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.53527.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53527.log.gz 2024-09-12T17:43:30.678 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88466.log 2024-09-12T17:43:30.679 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.121508.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.121508.log.gz 2024-09-12T17:43:30.679 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59320.log.gz 2024-09-12T17:43:30.680 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155263.log 2024-09-12T17:43:30.680 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.88466.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.88466.log.gz 2024-09-12T17:43:30.681 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84926.log 2024-09-12T17:43:30.682 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.155263.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.155263.log.gz 2024-09-12T17:43:30.682 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148651.log 2024-09-12T17:43:30.683 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.84926.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.84926.log.gz 2024-09-12T17:43:30.684 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31262.log 2024-09-12T17:43:30.684 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.148651.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.148651.log.gz 2024-09-12T17:43:30.685 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31770.log 2024-09-12T17:43:30.685 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31262.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31262.log.gz 2024-09-12T17:43:30.686 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36007.log 2024-09-12T17:43:30.686 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31770.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31770.log.gz 2024-09-12T17:43:30.686 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31070.log 2024-09-12T17:43:30.687 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.0.36007.log: 43.2% -- replaced with /var/log/ceph/ceph-client.0.36007.log.gz 2024-09-12T17:43:30.688 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75486.log 2024-09-12T17:43:30.688 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31070.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31070.log.gz 2024-09-12T17:43:30.689 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156443.log 2024-09-12T17:43:30.689 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.75486.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.75486.log.gz 2024-09-12T17:43:30.690 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31277.log 2024-09-12T17:43:30.690 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.156443.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.156443.log.gz 2024-09-12T17:43:30.691 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179885.log 2024-09-12T17:43:30.692 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31277.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31277.log.gz 2024-09-12T17:43:30.692 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42707.log 2024-09-12T17:43:30.693 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.179885.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179885.log.gz 2024-09-12T17:43:30.693 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108528.log 2024-09-12T17:43:30.694 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42707.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42707.log.gz 2024-09-12T17:43:30.694 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70766.log 2024-09-12T17:43:30.695 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.108528.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.108528.log.gz 2024-09-12T17:43:30.695 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100268.log 2024-09-12T17:43:30.696 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.70766.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.70766.log.gz 2024-09-12T17:43:30.696 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48707.log 2024-09-12T17:43:30.697 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.100268.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.100268.log.gz 2024-09-12T17:43:30.697 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180145.log 2024-09-12T17:43:30.698 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.48707.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.48707.log.gz 2024-09-12T17:43:30.699 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.180145.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180145.log.gz 2024-09-12T17:43:31.253 INFO:teuthology.orchestra.run.smithi016.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-12T17:43:31.295 INFO:teuthology.orchestra.run.smithi019.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-12T17:43:32.303 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-09-12T17:43:32.656 INFO:teuthology.orchestra.run.smithi016.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T17:43:33.262 INFO:teuthology.orchestra.run.smithi016.stderr: 93.3% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-12T17:43:35.862 INFO:teuthology.orchestra.run.smithi016.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T17:43:37.375 INFO:teuthology.orchestra.run.smithi016.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T17:43:37.984 INFO:teuthology.orchestra.run.smithi019.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-12T17:43:38.675 INFO:teuthology.orchestra.run.smithi019.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-12T17:43:39.034 INFO:teuthology.orchestra.run.smithi019.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-12T17:43:42.595 INFO:teuthology.orchestra.run.smithi016.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-12T17:43:43.930 INFO:teuthology.orchestra.run.smithi019.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-12T17:43:43.931 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T17:43:43.931 INFO:teuthology.orchestra.run.smithi019.stderr:real 0m13.661s 2024-09-12T17:43:43.931 INFO:teuthology.orchestra.run.smithi019.stderr:user 0m38.683s 2024-09-12T17:43:43.931 INFO:teuthology.orchestra.run.smithi019.stderr:sys 0m1.127s 2024-09-12T17:43:47.891 INFO:teuthology.orchestra.run.smithi016.stderr: 94.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T17:43:47.892 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-09-12T17:43:47.892 INFO:teuthology.orchestra.run.smithi016.stderr:real 0m17.671s 2024-09-12T17:43:47.892 INFO:teuthology.orchestra.run.smithi016.stderr:user 0m47.800s 2024-09-12T17:43:47.892 INFO:teuthology.orchestra.run.smithi016.stderr:sys 0m1.712s 2024-09-12T17:43:47.893 INFO:tasks.ceph:Archiving logs... 2024-09-12T17:43:47.893 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902695/remote/smithi016/log 2024-09-12T17:43:47.894 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T17:43:53.331 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902695/remote/smithi019/log 2024-09-12T17:43:53.332 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T17:43:57.994 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T17:43:58.005 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T17:43:58.005 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T17:43:58.008 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T17:43:58.085 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T17:43:58.099 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T17:43:58.099 DEBUG:teuthology.orchestra.run.smithi016:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T17:43:58.101 DEBUG:teuthology.orchestra.run.smithi019:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T17:43:58.112 INFO:teuthology.orchestra.run.smithi016.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T17:43:58.112 INFO:teuthology.orchestra.run.smithi016.stdout:============================================================================== 2024-09-12T17:43:58.112 INFO:teuthology.orchestra.run.smithi016.stdout:+hv01.front.sepi 67.205.162.81 3 u 54 64 377 0.062 -1.937 0.088 2024-09-12T17:43:58.112 INFO:teuthology.orchestra.run.smithi016.stdout:*hv02.front.sepi 63.231.80.2 3 u 53 64 377 0.090 -0.760 0.081 2024-09-12T17:43:58.112 INFO:teuthology.orchestra.run.smithi016.stdout:+hv03.front.sepi 74.6.168.72 3 u 45 64 377 0.100 -0.058 0.134 2024-09-12T17:43:58.112 INFO:teuthology.orchestra.run.smithi016.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-09-12T17:43:58.113 INFO:teuthology.orchestra.run.smithi019.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T17:43:58.114 INFO:teuthology.orchestra.run.smithi019.stdout:============================================================================== 2024-09-12T17:43:58.114 INFO:teuthology.orchestra.run.smithi019.stdout:+hv01.front.sepi 67.205.162.81 3 u 50 64 377 0.095 -1.226 0.165 2024-09-12T17:43:58.114 INFO:teuthology.orchestra.run.smithi019.stdout:*hv02.front.sepi 63.231.80.2 3 u 56 64 377 0.103 -0.052 0.136 2024-09-12T17:43:58.114 INFO:teuthology.orchestra.run.smithi019.stdout:+hv03.front.sepi 74.6.168.72 3 u 54 64 377 0.086 +0.688 0.028 2024-09-12T17:43:58.114 INFO:teuthology.orchestra.run.smithi019.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-09-12T17:43:58.115 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T17:43:58.124 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T17:43:58.125 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T17:43:58.135 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T17:43:58.145 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T17:43:58.154 INFO:teuthology.task.internal:Duration was 3413.460485 seconds 2024-09-12T17:43:58.155 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T17:43:58.165 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T17:43:58.165 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T17:43:58.168 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T17:43:58.208 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T17:43:58.208 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi016.front.sepia.ceph.com 2024-09-12T17:43:58.208 DEBUG:teuthology.orchestra.run.smithi016:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T17:43:58.255 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T17:43:58.255 DEBUG:teuthology.orchestra.run.smithi019:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T17:43:58.265 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T17:43:58.266 DEBUG:teuthology.orchestra.run.smithi016:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T17:43:58.303 DEBUG:teuthology.orchestra.run.smithi019:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T17:43:58.333 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T17:43:58.334 DEBUG:teuthology.orchestra.run.smithi016:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T17:43:58.375 DEBUG:teuthology.orchestra.run.smithi019:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T17:43:58.433 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T17:43:58.445 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T17:43:58.446 DEBUG:teuthology.orchestra.run.smithi016:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T17:43:58.457 DEBUG:teuthology.orchestra.run.smithi019:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T17:43:58.468 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T17:43:58.480 DEBUG:teuthology.orchestra.run.smithi016:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T17:43:58.503 DEBUG:teuthology.orchestra.run.smithi019:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T17:43:58.512 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern = core 2024-09-12T17:43:58.520 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern = core 2024-09-12T17:43:58.541 DEBUG:teuthology.orchestra.run.smithi016:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T17:43:58.569 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:43:58.570 DEBUG:teuthology.orchestra.run.smithi019:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T17:43:58.587 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:43:58.587 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T17:43:58.598 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T17:43:58.599 DEBUG:teuthology.misc:Transferring archived files from smithi016:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902695/remote/smithi016 2024-09-12T17:43:58.599 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T17:43:58.637 DEBUG:teuthology.misc:Transferring archived files from smithi019:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902695/remote/smithi019 2024-09-12T17:43:58.637 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T17:43:58.658 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T17:43:58.659 DEBUG:teuthology.orchestra.run.smithi016:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T17:43:58.675 DEBUG:teuthology.orchestra.run.smithi019:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T17:43:58.704 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T17:43:58.717 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T17:43:58.717 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T17:43:58.729 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T17:43:58.729 DEBUG:teuthology.orchestra.run.smithi016:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T17:43:58.731 DEBUG:teuthology.orchestra.run.smithi019:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T17:43:58.735 INFO:teuthology.orchestra.run.smithi016.stdout: 658641 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 17:43 /home/ubuntu/cephtest 2024-09-12T17:43:58.752 INFO:teuthology.orchestra.run.smithi019.stdout: 658622 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 17:43 /home/ubuntu/cephtest 2024-09-12T17:43:58.754 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T17:43:58.766 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T17:43:58.795 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} duration: 3413.460484981537 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-09-12T17:43:58.796 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T17:43:58.897 INFO:teuthology.run:pass